Commit Graph

7217 Commits

Author SHA1 Message Date
Brad Fitzpatrick 3b1828d79f pkg/test: remove check that GOPATH is set
We can also use the implicit one, so don't require an explicit one.

Change-Id: Ie4712be849f40b8f8cc30f99d019dd863944289f
2018-05-01 14:13:41 -07:00
Brad Fitzpatrick 2f39adc517 server/sigserver: delete old and unused sigserver
We can resurrect later. Or more likely: we'll support perkeepd
being configured (#1134) as only a signing server.

Change-Id: I19278e107baf02864c085421327392a6ffbb3364
2018-05-01 13:59:57 -07:00
Brad Fitzpatrick f5de76de22 diskpacked: fix tests on Windows
Delete some test code I don't see the value of (not sure what it's
testing).

Change-Id: I7c27bce5601e1b2780eb8bb6eeadf45f7ea97d00
2018-05-01 13:14:41 -07:00
Brad Fitzpatrick 858136cfa6 Merge "app/publisher: fix the tests" 2018-05-01 19:59:19 +00:00
mpl d196d34d63 app/publisher: fix the tests
Change-Id: I87534c8fff76e2b28693c8176012b1b0864c153a
2018-05-01 12:52:02 -07:00
Brad Fitzpatrick bf119f08c4 internal/osutil: remove hard-coded /tmp to fix tests on Windows
Change-Id: If0594ef866d6b20d2e235f4734efbb4e1d6a37d4
2018-05-01 12:44:12 -07:00
Brad Fitzpatrick 3aca4399c5 internal: fix compilation errors in tests
Not found earlier due to #1138

Change-Id: I1601554adb746f7b67cd361e8779d5092e8b3696
2018-05-01 12:31:33 -07:00
Mathieu Lonjaret 5cee661fb0 Merge "devcam, localhost, storagetest: fixes for Windows" 2018-05-01 18:10:50 +00:00
Brad Fitzpatrick b1abccd287 devcam, localhost, storagetest: fixes for Windows
Unset CGO_ENABLED if no sign of gcc.

The localdisk renaming stuff was fixed in Go ages ago in
golang/go#13673 and https://golang.org/cl/6140

And a defer in storagetest meant Windows couldn't delete files
because a file was still open.

Change-Id: I57aef85f24653b19ce10e3d1e18c778cee2d48f6
2018-05-01 10:46:19 -07:00
mpl 326de1d794 website: revert bin name to camlistored for demo
We have not updated the camlistore/demoblobserver image that the website
runs, so the binary it should execute is camlistored, not perkeepd.
As it is, it keeps on trying to run it every 10s, which makes it busy
for nothing. And I don't think it's worth spending time on updating the
image for now, so it's easier to just revert to the old name.

Change-Id: I769aecaaecdb027d686a78adf9a37a14e9ef9b9d
2018-05-01 10:19:43 -07:00
mpl 76e61108c7 doc: add lfnw 2018 talk
Change-Id: I512a0620b13c0d070db28198271ad2ca0e80ad3b
2018-04-30 22:40:50 -07:00
Brad Fitzpatrick c806ab4bcd doc: update build instructions
Fixes #1135

Change-Id: I7e5897308594acc591c66dd6656605cdad1a7f3c
2018-04-30 16:38:29 -07:00
Brad Fitzpatrick b1c1d1be68 blobserver/localdisk: be sure to implement SubFetcher for blobpacked
My fault for not running the (slow) integration tests before I broke
things in a4d0cc6ab7.

Fixes #1136

Change-Id: Ia30051da02974d0c3e79e0b220ff86dcab5771e4
2018-04-30 16:23:43 -07:00
Mathieu Lonjaret 2f933f83af Merge "server/perkeepd: self-fix instance user-data" 2018-04-30 23:00:38 +00:00
mpl 4d16a0e5c3 server/perkeepd: self-fix instance user-data
Since we renamed Camlistore to Perkeep, we also renamed the docker image
deployed by the launcher, as well as the systemd service that this
docker image runs in.
This means existing users on GCE do not get updates when they restart
the service or reset their instance.

This change adds a check and a function that allows perkeepd to fix the
user-data metadata of its own GCE instance, which is where the names
mentioned above are defined.

Therefore, if we deploy a new camlistore docker image containing that
code, the existing users should get a server capable of self-fixing its
own instance into a perkeep one.

Change-Id: I9ff66f684f0ad647d15e5fcdd08d26c524a18329
2018-04-30 15:58:26 -07:00
Brad Fitzpatrick a4d0cc6ab7 blobserver/{localdisk,files}: move generic localdisk code to the files package
Just code movement.

Except I did delete some 5 year old localdisk migration code that's no
longer relevant.

Updates #1111 (this is prep for SFTP support)

Change-Id: Ibe1de1d4d804a6c86919a9df454ab125027e4c33
2018-04-29 20:59:42 -07:00
Mathieu Lonjaret 87d22ea432 Merge "vendor: update gopherjs to 8dffc02ea1cb8398bb73f30424697c60fcf8d4c5" 2018-04-29 18:14:32 +00:00
Paul Jolly e0d014a6fc
vendor: update gopherjs to 8dffc02ea1cb8398bb73f30424697c60fcf8d4c5
Revert back to using master of https://github.com/gopherjs/gopherjs.

Includes:

* recently-merged support for using a vendored GopherJS
* removes dependency on legacy golang.org/x/tools/go/gcimporter15,
switching to golang.org/x/tools/go/gcexportdata

Change-Id: I1f8b4c829bcfa8562614d9f8368c1d58edd10fab
2018-04-29 18:25:37 +01:00
Brad Fitzpatrick c25b330d8d test/integration: fix tests after earlier change to root handler
In f8bc4ac6e5 I made the root handler start returning 404s for
unknown URLs, which broke this test. Update this tests.

Fixes #1132

Change-Id: I6e14811dda00e741d80e1c5603f849ffcb26f361
2018-04-29 10:15:21 -07:00
Brad Fitzpatrick 0ff6a4954e pkg/blobserver/gethandler: fix vet error
Change-Id: Ib3a86f74230f76c5fa9e3965d360e82c07a41e80
2018-04-29 10:07:54 -07:00
Brad Fitzpatrick b0c1faccfe importer: add missing file from earlier commit
I missed this file from 2c05f1a3d9 for #1105.

Change-Id: I38d95f2944fba8a0e6fe5176e1987f8fbe5b63bd
2018-04-28 07:42:23 -07:00
Mathieu Lonjaret 2c93b93e60 Merge "server/perkeepd/ui: perm aspect takes precedence over map aspect" 2018-04-28 06:22:13 +00:00
mpl a735460c3f server/perkeepd/ui: perm aspect takes precedence over map aspect
This change makes the Permanode aspect come before the Map in the list
of aspects. That way, if there is no specific aspect selected for a
permanode, the default one should then be Permanode rather than Map.

I'm not sure it's not going to break a specific workflow though.

Change-Id: I3d54dc84c7f4fb313d8ed0f7285db69b4ecbf366
2018-04-27 17:31:47 -07:00
Brad Fitzpatrick f8bc4ac6e5 ui: link to mobile setup in UI drop-down
Updates #1120

Change-Id: I2185c656038637aec04a44a5754e67a6de20fee0
2018-04-27 17:22:13 -07:00
Brad Fitzpatrick 2c05f1a3d9 importer: refresh importer root page, add Titles, Descriptions, TODO bugs
And also speed up /importer/TYPE page's query by saying it's unsorted, which
gets us a better index. Hacky workaround. Should fix it in the query planner
later instead.

Fixes #1105

Change-Id: I140ffb40456ec802844584568d2f1a7a38b26e41
2018-04-27 17:06:59 -07:00
Brad Fitzpatrick c698ff5add misc/docker/heiftojpeg: switch to ImageMagick
Still slow, but no more ffmpeg child processes, and I'm confident
ImageMagick will improve over time. There are actually ImageMagick
commits in the past few hours that look promising. We have a demo
tomorrow, so we're not going to bump our git rev & Docker image to the
latest ImageMagick master yet.

Updates #969

Change-Id: I7a8545821cae4214ea521d7cb46aa235ae3f0ed3
2018-04-27 16:26:14 -07:00
Brad Fitzpatrick 3d5c28511f Log instead of panicking in HTTP handler on GET to /index/ (no Fetcher)
And change two Camlistore instances to Perkeep.

Change-Id: Id515480ecdc0c997e1700204d63ef4cc6a8c8cc4
2018-04-27 13:29:01 -07:00
Brad Fitzpatrick 6b88e2a73f internal/images: broaden pattern that matches HEIC images
A bunch of mine had a larger initial ftyp box, which broke the second
part of the pattern. But the second part of the pattern doesn't matter
anyway.  This only needs to casually recognize them. A later full
parse will determine what they really are.

This also adds some new debugging when CAMLI_DEBUG is true.

Change-Id: Ib4adc9b5447a64ba4682624e42b55f1d65779ef7
2018-04-27 12:29:00 -07:00
Brad Fitzpatrick 576dabac82 Merge "cmd/pk-mount: in debug mode, dump stacks on SIGQUIT" 2018-04-27 18:24:38 +00:00
Brad Fitzpatrick c5c5270dd0 cmd/pk-mount: in debug mode, dump stacks on SIGQUIT
Change-Id: I70737247bf29063a7061c330960b7657213266cb
2018-04-27 11:24:04 -07:00
Mathieu Lonjaret 930a42d466 Merge "clients/android: Keepy icon" 2018-04-27 06:43:30 +00:00
Brad Fitzpatrick e52593865b cmd/pk-mount: default to mounting at /pk if it exists
And recommend /pk.

Change-Id: I5255c203e46b503a1b4c59856e085d7359d84f4f
2018-04-26 15:46:24 -07:00
Brad Fitzpatrick 2b720aa101 search, index: rewrite, fix the "map" sort algorithm, index camliNodeType
Change-Id: Idb0e44c3f61bea9fc2cc76619223b86aa5aa4c58
2018-04-26 15:19:03 -07:00
mpl 084d618fc5 clients/android: Keepy icon
Also downgrade the target sdk as 21 still seems to be building and
working.

Change-Id: Ib7f74442e9db0f334063dc2cc6858b1b64ed4ccf
2018-04-26 14:21:52 -07:00
Brad Fitzpatrick ad0b3918b7 search: optimize searching for a single blob
Fixes #1118

Change-Id: I6e63faeb3f994a3cc4718d92894f513d38ac371f
2018-04-26 13:56:32 -07:00
mpl 2c9fbcf2ef client/android: remove self-signed cert option
Change-Id: I902b45cf7ac6e05d9085494a902a4554ac3a17af
2018-04-26 13:28:15 -07:00
mpl 87a8e7ad54 website: fix test working dir
Change-Id: If92dc43b4ee3e5fd2ac9c6490d242d3dacff74b1
2018-04-25 23:18:16 -07:00
mpl a6ad4d88e9 dev/devcam: do not look for pk in ./bin dir
Change-Id: I1903b389fbed1bf836d4d3c91c5fb6d2db117b84
2018-04-25 22:51:41 -07:00
Mathieu Lonjaret 11dfa3850d Merge "internal/geocode: change Lookup behavior wrt to AltLookupFn" 2018-04-26 02:22:21 +00:00
mpl 8b30515218 internal/geocode: change Lookup behavior wrt to AltLookupFn
Even when AltLookupFun was defined, Lookup used to fallthrough after the
AltLookupFn, depending on what AltLookupFn returned.
This means in some cases, our tests in pkg/search did end up calling the
Google API (which was not intended). We found out because with the new
dependency on an API key for the Google service, we now rely on reading
the key from the config dir, which is wired to panic if it is accessed
during tests.

This change therefore simplifies Lookup, by making it return the results
of the AltLookupFn call, if AltLookupFn exists.

Change-Id: Ie196f892f36d309c725a6e869094364d49cffdc8
2018-04-25 18:01:39 -07:00
Brad Fitzpatrick 6a68c7dea3 server/perkeepd/ui: fix size of swarm logo
Change-Id: I66aaf4053e5a129d112fe389cf222004ace3f20d
2018-04-25 13:43:40 -07:00
Brad Fitzpatrick f636f75b75 server/perkeepd/ui: change foursquare logo to swarm logo
Upstream rebranded.

Change-Id: I0ce6e98f29c5c3fe59ec9ac905cf4bb8976f0a4f
2018-04-25 13:31:48 -07:00
Brad Fitzpatrick b424d3f4c8 Merge "importer: change some camlistore.org to perkeep.org; fix devcam --makethings" 2018-04-25 20:23:55 +00:00
Brad Fitzpatrick bc24f7920a importer: change some camlistore.org to perkeep.org; fix devcam --makethings
Change-Id: I517a77a5ef2dd7495402c1357f99a6223fe8481a
2018-04-25 13:23:18 -07:00
mpl b75523bbea dev/devcam: fix website go code location
also do not set GOBIN when building self

Change-Id: Ibea2ab4fcc7b60ef28dfcb6620a44b29541eedef
2018-04-25 12:19:10 -07:00
Mathieu Lonjaret 66788a29af Merge "clients/android: Camlistore->Perkeep renames" 2018-04-25 19:03:38 +00:00
mpl 92c60d7c69 clients/android: Camlistore->Perkeep renames
Change-Id: I7012bfad11b5582bb0c2383a3b3a1eb84512819a
2018-04-25 11:26:13 -07:00
Brad Fitzpatrick aad03ce0d3 Merge "geocode: support the now-required Google API key and document how to configure" 2018-04-25 18:25:41 +00:00
Brad Fitzpatrick 70a9c72528 geocode: support the now-required Google API key and document how to configure
Change-Id: Ic4f01c7bf0ad37d06ee76aad53ad99a91d986c03
2018-04-25 11:20:47 -07:00
mpl 5f6517b728 clients/android: adjust version numbers for incoming release
Change-Id: Iac6ca39be04e334e7a6129cf5a8c2ed299c7be25
2018-04-25 10:51:57 -07:00