Commit Graph

7217 Commits

Author SHA1 Message Date
Niklas Merz 2e1b075acf
importer/pinboard: add incremental import
Enable "SupportsIncremental"

Fixes #1182

Change-Id: I75202fba95f5e481f68cfd95f20e40d32e33b377
2018-06-13 18:05:46 +02:00
Mathieu Lonjaret 21c05c53ce Merge "CONTRIBUTING: fix clone url" 2018-06-13 14:13:03 +00:00
Niklas Merz 3a45ef75db
CONTRIBUTING: fix clone url
Use Perkeep repo instead of frozen Camlistore one.

Change-Id: I1ca473fad29c5718e1ba1b987a910f1f5c310a5f
2018-06-12 22:33:07 +02:00
Mathieu Lonjaret 5fd317cbac Merge "pkg/blobserver: print RemoveBlobs errors" 2018-06-11 17:34:48 +00:00
mpl b48e2de0c6 pkg/blobserver: print RemoveBlobs errors
Both on server and client sides. So far we did on neither.

Fixes #1186

Change-Id: I7ff3484d82329b4f83a5f3fa8f150ac7ad7f732c
2018-06-11 19:32:35 +02:00
Euan Kemp f37c7ca7ac devcam hook: ignore vendor in whitespace check
While I was there, I also switched gofmt's vendor ignoring logic to use
git's builtin pathspec filtering.

Change-Id: Iab8093d795e7f967cceef351c6a593ba776d9790
2018-06-11 01:38:31 -07:00
Euan Kemp 2e2b390d1b vendor: update github.com/syndtr/goleveldb
to db3ee9ee8931e51af7158114b9d02bf93d1a7811
and also update golang.org/x/crytpo to b47b1587369238182299fe4dad77d05b8b461e06

The golang.org/x/crypto change is to correct a typo in 'Gopkg.toml'
which resulted in the 'Gopkg.lock' not containing an actually locked
down revision.

The leveldb change fixes #1185

Change-Id: If14a0c4d6fc011716c2371351f2572b0ca2b588a
2018-06-08 10:47:36 -07:00
Will Norris b2f5e85b51 pkg/importer/swarm: update importer URLs
update URLs used when registering Foursquare App to use updated importer
name.

Fixes #1179

Change-Id: If0889c3d4a9f323b2729d6061549524cdfc4d148
2018-05-29 14:51:10 +00:00
Mathieu Lonjaret d344b5cc92 Merge "devcam: review: fix origin in git config" 2018-05-26 17:54:24 +00:00
mpl 64f77af5b6 devcam: review: fix origin in git config
Fixes #1176

Change-Id: I18222fd7b2d9ac47d4ab01740ef55b14d44b8b11
2018-05-26 02:16:32 +02:00
Mathieu Lonjaret 76bdea88d6 Merge "web UI: show progress dialog when adding items to set" 2018-05-25 19:28:43 +00:00
mpl 84633f4cb7 web UI: show progress dialog when adding items to set
Fixes #551

Change-Id: Ic103f718866e194b69576c81106702c8475840ba
2018-05-25 21:01:01 +02:00
mpl a140b28f5d website: Gerrit instance update
Updates #1176

Change-Id: I9f5cf347f1a6b369cf490cc30cc05134d14d7b8a
2018-05-24 21:32:18 +02:00
Stephen Searles d6c616c615 server/sync: add sha-224 to the sync'd prefixes
Updates #1172

Change-Id: Ic9e927aad5f90e926bd50a5ab4a17d540c3f5a2b
2018-05-19 22:05:29 -04:00
Brad Fitzpatrick a884a9181e Merge "devcam: add -branch option to review mode" 2018-05-19 02:44:41 +00:00
Brad Fitzpatrick 9d0472a968 Merge "pk/fs: add Logger, set it to discard when not debugging" 2018-05-19 02:44:04 +00:00
Stephen Searles a462466f37 perkeepd: added --keep-going flag to start after index/recovery errors
In order to facilitate manual recovery in severe scenarios, the
--keep-going flag will make the server come back online even when there
are index or recovery errors. This will allow further querying on the
unhealthy server to identify missing data or to extract data for
migration to a new/healthy instance.

Fixes #1166

Change-Id: I4153905757d9e7d8014780dd5660a862cb8ba1ab
2018-05-18 22:29:12 -04:00
Mathieu Lonjaret f7a98b698c Merge "vendor: update github.com/rwcarlsen/goexif" 2018-05-18 19:20:30 +00:00
mpl 1d894fb933 README: remove extra test CI badge
I was playing with various locations to put the badges in, and I
forgot to remove that one.

Change-Id: I0683c7598798cbcd7a91d9fbf86fc26db1a2ce0b
2018-05-18 21:03:34 +02:00
mpl b311ba008b vendor: update github.com/rwcarlsen/goexif
To rev 8d986c03457a2057c7b0fb0a48113f7dd48f9619

Fixes #1127

Change-Id: I1febf824d10f4f38075cab1bbd0d4540305d1016
2018-05-18 20:39:48 +02:00
Brad Fitzpatrick 41ed0359e1 client, serverinit: fix tests from API change in earlier change
I forgot to fix these as part of 8e71a705d.

Fixes #1171

Change-Id: I22402dfad36bc26fc598b760ab4514cee71e1e38
2018-05-18 09:48:17 -07:00
Mathieu Lonjaret 706e5f9f72 Merge "website: fix clone URL to the perkeep on github one" 2018-05-18 15:39:56 +00:00
mpl 4a53f0fddf website: fix clone URL to the perkeep on github one
Updates #981

Change-Id: I54138307b56ab683eac658b38b20a770f147b014
2018-05-18 17:38:21 +02:00
Brad Fitzpatrick 05d5ea0ab0 Merge "pkg/serverinit: remove reindex parameter to InstallHandlers" 2018-05-18 02:53:14 +00:00
Brad Fitzpatrick 0ccf258ca4 blob: specify "oh, nevermind" error value for optional SubFetcher interface
To support composition, all optional interfaces in Go need a way to
say, at runtime, that "oh, nevermind, I defensively implemented this
interface but it turns out the thing I'm wrapping doesn't support it".

We learned that lesson only in the past few years, but SubFetcher
predates that.

So do that here and make proxycache implemented SubFetcher and make
everything respect the fallback oh-nevermind error value.

Fixes #1170

Change-Id: I3c0958cf6692a324e98f526571d10a352a8e18b4
2018-05-17 19:49:02 -07:00
Brad Fitzpatrick 6ddd633871 appveyor: set CGO_ENABLED=0 to disable need for gcc
Change-Id: I41990762ce8f8160faf013b6449efd3d34bc6e48
2018-05-17 18:01:43 -04:00
mpl 079024338d pkg/test: append .exe to bin name on Windows
Change-Id: I3de5f33768dffafd79cbe973e3e0435b0614bd9e
2018-05-17 21:10:21 +02:00
mpl 7815d546e4 README: add CI badges
Change-Id: I5af961b09ea89c8ab23df83854914a121806d6d7
2018-05-17 20:37:35 +02:00
mpl 821034929f AppVeyor: CI for Windows builds
Fixes #1165

Change-Id: I959d41fbb5b598c9e1db7af5690e99ea42c4209a
2018-05-17 19:06:08 +02:00
mpl 17c1685159 pk/fs: add Logger, set it to discard when not debugging
Change-Id: I66914d436b7e3d15416a8089fac0d1c1107ce13e
2018-05-16 20:08:56 +02:00
mpl 5789ec4b8d pkg/fs: add sha224-xx...xx hint dir
And fix sha1 assumption for file name.

Fixes #1169

Change-Id: I2a907c6cf11631a4a86268a4dc393c64402b5d35
2018-05-16 18:03:18 +02:00
Mathieu Lonjaret f95d49f99c Merge "pk-web: remove extra trailing slash on file URL" 2018-05-16 14:13:24 +00:00
mpl 2f2280880b pk-web: remove extra trailing slash on file URL
Fixes #1160

Change-Id: I2f1f2e57ba888eb4a5eec1e222a76e7abbdec428
2018-05-16 02:28:11 +02:00
mpl 0ce4a8b2a4 pkg/test: give the World a GOBIN
I have tested that, starting with an empty $GOPATH/bin, after running
devcam test, $GOPATH/bin still has none of the Perkeep related binaries.

Fixes #1139

Change-Id: I60b63ff917cf91c8d424b448f874f40a18e1c23b
2018-05-16 01:34:22 +02:00
mpl 8b40fb83fe make.go: add with_embed build tag to all generated resources
And then build targets with with_embed only if embed_static command-line
flag is true.

Fixes #1157

Change-Id: If6a998749e0caae5ee21037d667bcc476562a354
2018-05-15 20:14:50 +02:00
Mathieu Lonjaret fe934a3c72 Merge "devcam test: add internal and app/publisher to the list of tests" 2018-05-15 17:37:30 +00:00
mpl f95bd2a593 devcam test: add internal and app/publisher to the list of tests
Fixes #1138

Change-Id: I71f46da09fb9d14c7a3648d6da901ac712466f72
2018-05-15 19:36:14 +02:00
Brad Fitzpatrick e984a6aa88 Merge "pkg/serverinit: revert change that enabled https if cert or key was specified" 2018-05-15 17:33:27 +00:00
mpl 2549b78425 server/perkeepd/ui: new directory view
The old directory aspect (directory_detail.js), was done before the
current (React-based) look and layout of the web UI. It is still
functional, but does not look very good, and does not match the look of
the rest of the web UI.

Therefore, this change adds a new directory layout, with a
blob container approach and layout similar to the one for permanode
sets, and replaces the old one as the default Directory aspect.

It seems to have performance issues (slow loads), but I think it's
better to enable it now, rather than wait again for many months to
land it. Especially if it forces us to address said performance issues.
If it's too bad and users want the old one in the meantime, it should be
easy to re-enable the old as the default.

Change-Id: Ieb0cde8290f0a058008cdc73b596ad1a330ded1a
2018-05-15 18:53:06 +02:00
Brad Fitzpatrick cd5413ff54 pkg/serverinit: revert change that enabled https if cert or key was specified
My previous commit (f3f38f0c76) made a change that https became true
if httpsCert or httpsKey was enabled. This broke devcam server, which
always sets the cert+key fields in config/dev-server-config.json but
always set "https" to either true or false.

Instead, make it an error to omit "https" if the cert or key is
specified. (It's still currently legal to specify https==false but
specify a cert or key files, so devcam server now works, but it's not
clear that that's a good idea. I might revisit this later when I
update dev-server-config.json to the upcoming TOML format.)

Fixes #1168

Change-Id: I29d000c5eb9472cc901fbd4cb91159a6c293570e
2018-05-15 09:14:18 -07:00
Mathieu Lonjaret bb88d740e5 Merge "website: add date to 0.10.1 release" 2018-05-15 14:42:22 +00:00
mpl 18c895f9f1 website: add date to 0.10.1 release
Change-Id: Ie5af3ebcd48c3997bbcda0177a16ed7c2f6dc5d8
2018-05-15 16:40:49 +02:00
Brad Fitzpatrick 8e71a705db pkg/serverinit: remove reindex parameter to InstallHandlers
Push it down into the index.

Change-Id: I327bfcbc314b652d5f24a457e1b62b138a187db5
2018-05-14 23:13:32 -04:00
mpl 18a9f6fc93 misc/release: enable upload of existing archives
Change-Id: Ic1bbb50448734cb68a8eed72ea9a90de4e9fbc76
2018-05-15 01:54:53 +02:00
Mathieu Lonjaret dac0c9af20 Merge "website: 0.10.1 release" 2018-05-14 23:10:58 +00:00
mpl 6d84759bfc website: 0.10.1 release
Change-Id: I6684867d9130d5f6039530f08c3913d38d9d1edc
2018-05-15 01:10:04 +02:00
mpl 0917920684 pk-web: handle new perkeep-release download bucket
And keep handling downloads from legacy camlistore-release bucket.

Change-Id: Ia4b411bce5c3575df0167ecb1390f392b6597202
2018-05-14 18:48:14 +02:00
Stephen Searles 350b369030 pkg/schema: expose signer and signature information on claims
This will allow consumers of pkg/schema to do things like verify the
signature on claims.

Fixes #1167

Change-Id: Iec76e382e18d91f82694412bc855ac5be82df825
2018-05-14 08:45:36 -04:00
Brad Fitzpatrick 89ee36e9ec pkg/serverinit: make receiver names consistent
c is good for a config.

Change-Id: I89fe738e3c3b26cb26e471d37d55c24284fc5d2c
2018-05-13 18:48:30 -07:00
Brad Fitzpatrick 1dff48c6e3 Stop using the legacy variable name "conn" for http.ResponseWriter values.
They were named conn because nearly 8 years ago the pre-ResponseWriter
type was named *http.Conn:

    https://golang.org/doc/devel/weekly.html#2010-09-29

Time to modernize.

Change-Id: I68d1a5f16dfa6fc2e7a1f863e5d9edb7308527dc
2018-05-13 18:48:12 -07:00