Rooba
/
perkeep
mirror of https://github.com/perkeep/perkeep.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,152 Commits 44 Branches 11 Tags 59 MiB
Commit Graph

4152 Commits

Author SHA1 Message Date
Brad Fitzpatrick bfa8efc1b9 sync: background validation of src-vs-destination in sync handler 
Currently controlled by an environment variable, but will become
a config option + on-demand button in UI in later commits.

Change-Id: I25fa878c9b30cdd713e2859585210eb722092f7b
 2014-03-07 10:57:41 -08:00
Brad Fitzpatrick bf22f2db1e Add missing moved file from 76ba33b2 
Change-Id: Iadbdc7e576c40da11fbf3261f26bdbae5afe7f1b
 2014-03-07 10:06:01 -08:00
Brad Fitzpatrick abca567581 sync: work on full-validation-on-startup. 90% done, disabled. 
Change-Id: I5bf062f3b22c2cc41329ff6b23f11198ae543c0f
 2014-03-06 16:52:29 -08:00
Brad Fitzpatrick 4e257ed14d Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-03-06 15:05:19 -08:00
Brad Fitzpatrick 76ba33b27a Move ListMissingDestinationBlobs from pkg/client to blobserver 
Change-Id: I7489531fe2a1a5127b2212d5a5f80d4c4c614353
 2014-03-06 15:04:15 -08:00
mpl da7a9b8dcb Merge "UI: add support for deleting selected permanodes" 2014-03-06 22:07:31 +00:00
mpl 8ab115cb21 UI: add support for deleting selected permanodes 
Feature disabled for now, until the backend (corpus) part is ready.

Change-Id: Ib3527b8f3bfb6793bb60d5e91cd06bc8fab5a5c0
 2014-03-06 23:05:20 +01:00
Brad Fitzpatrick 58ac8b5469 sync: restore key part accidentally removed prior to earlier submit 
Would cause accounting errors before in the face of duplicate uploads.

Change-Id: Ie7c49da1adaf2b9c98ef1015f875a4df8b66729f
 2014-03-06 13:23:27 -08:00
Brad Fitzpatrick c1892b5ae5 Rewritten sync handler. 
Fix deadlock, much better status page, show per-blob status & errors,
clear errors when they've resolved themselves, fix known data race.

Change-Id: I968de0de4f308ff0a410adceb181a0712800d401
 2014-03-05 08:51:22 -08:00
Brad Fitzpatrick 023fba5629 Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-03-05 08:39:15 -08:00
Brad Fitzpatrick 344980114a doc: add CAMLI_S3_FAIL_PERCENT var 
Change-Id: Ie2c85da2bfeefc9e5ae98c14c5d879d7208a82f1
 2014-03-05 08:26:34 -08:00
Brad Fitzpatrick 658472577d s3: be a Stringer, make default host more explicit, add failure injection 
Change-Id: I1c24e97ef4b901e3be62fbb7e34c3f53787eedb1
 2014-03-05 08:24:30 -08:00
Brad Fitzpatrick 260a33aa2a Make various popular storage targets be Stringers. Optional, for upcoming sync handler rewrite. 
Change-Id: I8cc961ace8b6093b1dbd82bc39ba3fc334f1d5c7
 2014-03-05 08:23:07 -08:00
Brad Fitzpatrick f1a4aae0da camput: add --blobdir=discard debug option 
Does a dry-run and just shows the final blobref, without writing data anywhere.

Change-Id: Ia234b642b5b9029ee4fd9c61bc7edcdcfa5ca858
 2014-03-04 22:47:58 -08:00
Brad Fitzpatrick 97338594c7 blobserver: simplify NoImplStorage code 
Change-Id: Icc133667b5038783609082ec412f7fca7ecce927
 2014-03-04 22:45:35 -08:00
Nick O'Neill 78fdefab1e Merge "Fixed an issue where checking for files was slow" 2014-03-05 02:50:39 +00:00
Brad Fitzpatrick 07178b877a Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-03-04 14:18:27 -08:00
Brad Fitzpatrick 4731e3abec sync: rename lk to more conventional mu 
Change-Id: I59f12da9462e4768b59eb135c10f356916191ea7
 2014-03-04 13:57:33 -08:00
Brad Fitzpatrick ea15158f7c Enumerate changes for future sync changes 
Add blobserver.EnumerateAllFrom, make S3 client API match the underlying S3 protocol
with marker instead of after, and then push after->marker conversion logic up
into the s3 enumerate code that's using the S3 client.

Change-Id: I034a7c1c8af441881ebba74bcb523bd690cd16d3
 2014-03-04 12:11:59 -08:00
Brad Fitzpatrick 2b27dd53c0 Handle Photoshop images better. 
We still can't find their width/height or thumbnail the, but at least
we don't wedge the UI now.

Fixes camlistore.org/issue/389

Change-Id: I8af6cefa5d84e7f6e26f3920e4dd6e1d5eb8b192
 2014-03-04 10:58:51 -08:00
mpl 851f5a313b Merge "buildbot: add some context to error" 2014-03-04 18:18:26 +00:00
mpl 335f6416b9 buildbot: add some context to error 
Change-Id: Ia0733909ffd4d9e9451ac663cb7ece799169ab7c
 2014-03-04 18:53:05 +01:00
Brian Gitonga Marete d373f86d9f pkg/client: Fix ignored files matching. 
Because of Go's rules regaring closures (function literals) and bound
variables, in the case in which there were multiple patterns in the
ignoredFiles configuration variable, the entire slice (vector) of
registered matching functions was being called with the
last-configured ignoredFiles pattern as the first variable. This meant
that ignoredFiles did not work if it contained more than one pattern
and in certain circumstances, such a configuration would lead to a
crash.

Change-Id: I0b991aa74d079d4ce27fc0ba373e2ee2cf9eb772
 2014-03-04 17:30:50 +03:00
Brad Fitzpatrick e3491e5515 camput: fix tests 2014-03-03 12:53:40 -08:00
mpl 08923e1c00 camtool sync: warn when src and dest have different identities 
http://camlistore.org/issue/281

Change-Id: I2e2d595534b14476293a031b88e312de3e0b3f4a
 2014-03-01 23:47:49 +01:00
Brad Fitzpatrick 11cd3127c8 Backwards-compatible protocol + handler change on boundary of enumerating blobs. 
The handler was adding 1 to things to see if it was at the end, but that was causing
HTTP requests to Amazon like: limit 1000, limit 1, limit 1000, limit 1, etc.

This makes it twice as fast.

Change-Id: Ibb7e3f6ae7229a21c87817c7438324d36e7b491a
 2014-03-01 13:12:05 -08:00
Brad Fitzpatrick 440d0c461e blobserver/handler: rename conn to rw, per more recent conventions 
Change-Id: Ibd28bc66f9d1f6c9dac776ce78a9da9baddba7c4
 2014-03-01 12:24:56 -08:00
Brad Fitzpatrick 448bbfa0e2 client: better enumerate docs 
Change-Id: Id46950fb578f31e17a7600bedf3108eb386826c8
 2014-03-01 11:48:20 -08:00
Brad Fitzpatrick bbfcc27d85 sync: use blob.Ref.Less instead of stringify to compare, fix API wart, more tests 
Change-Id: Iffd98463becbcf6d62dd666b38fb00572b34725b
 2014-03-01 11:34:57 -08:00
Brad Fitzpatrick 9f70025a29 Add 0.7 to the release history 
Change-Id: Ieb895939d302c594b35dfd51361c93fe9078a039
 2014-02-28 15:33:48 -08:00
Tamás Gulácsi 46da1cdcdb serverinit: shared camli-cache for multiple publish roots 
czninc/kv cannot be shared (locks), so a separate directory
is needed in the multiple publish root case, for the thumbs caches.

Change-Id: I8c07302778e597a2ccf9b3265111a503dd037249
 2014-02-28 18:31:07 +01:00
Nick O'Neill 4ab503399d Merge "Updates to front page." 2014-02-28 06:12:14 +00:00
Nick O'Neill 43198b5a3a Updates to front page. 
Change-Id: I759fc11d5c0807b14d31c74b8b10a8089106b863
 2014-02-27 22:11:18 -08:00
Brad Fitzpatrick acef7ddd8a website: add 0.7 to download page 
Change-Id: I4c703abb8ebeb06b90e0a22071fb6af0957ee779
 2014-02-27 22:05:56 -08:00
Brad Fitzpatrick 249eea79b8 Website: more 0.7 docs 
Change-Id: I4ede3866db99a75087cb25950dec32bac615a9e6
 2014-02-27 22:04:29 -08:00
Brad Fitzpatrick 8ce47c69d4 make-release: don't clean stuff from the zip 
Change-Id: I775926080f7cec04b3de4b574f78396613ae27c5
 2014-02-27 22:03:52 -08:00
Nick O'Neill ae048b06a2 Merge "Almost finalized release notes for 0.7" 2014-02-28 05:43:18 +00:00
Nick O'Neill 926e3fcef8 Almost finalized release notes for 0.7 
Change-Id: I5db1362d893af760af6b03131fd993e30d9b2245
 2014-02-27 21:42:33 -08:00
Brad Fitzpatrick 4a079bbec4 Move dev-db shell script out of the root. 
Change-Id: Iddb0b2316121ad13395b0624b1c1fdf61150bb6a
 2014-02-27 21:26:02 -08:00
Brad Fitzpatrick 26cbd36e0b camput, camtool: update docs 
Change-Id: If54df42be3b95ec9f10782454bc247449e1a74e6
 2014-02-27 21:23:01 -08:00
Brad Fitzpatrick 306f727e9e TODO: remove done item 
Change-Id: Ia3ac1d922953df3c6ab33863581fd823d6a8a1a6
 2014-02-27 21:06:42 -08:00
Brad Fitzpatrick 01f2173e64 ui: fix link from old detail page to new UI detail page 
Change-Id: Iaa36f532169d3f6697060d9baa2178caaa19423d
 2014-02-27 21:06:03 -08:00
Brad Fitzpatrick 40e0a86315 genfileembed: touch the file modtime, even if contents are same, but it's old 
Change-Id: I88d429445da6e251e4aebc0e31017e4ca8f0dd51
 2014-02-27 21:00:01 -08:00
Brad Fitzpatrick 593e0f0f81 cmdmain, camput: PreExit should always run, not just in verbose mode 
Change-Id: I6001a3474071a00f0ab56b031ac8c5504e5e9da5
 2014-02-27 20:47:15 -08:00
mpl a73715c92a Merge "client: default to None auth if no auth in config" 2014-02-27 15:23:02 +00:00
Aaron Boodman ff16bcf1e9 Merge "Starting to fool around with property sheet UI" 2014-02-27 09:59:35 +00:00
Aaron Boodman 7ecc4858b9 Starting to fool around with property sheet UI 
Looks like: http://i.imgur.com/HxE1oFi.png

Change-Id: Id3188148fd1ef97dac16a53e96ebe41f64cf1ee7
 2014-02-27 01:57:49 -08:00
mpl c4c4d6407a client: default to None auth if no auth in config 
Defer warning until discovery fails.
Also fix SetupAuth error checks in camtool.

Change-Id: Ib554595603994e929d465e4e0de6acaf319d5b42
 2014-02-27 01:37:59 +01:00
Nick O'Neill c1b51d839e Fixed an issue where checking for files was slow 
Don't sha1 every file before we know if we need it.

Change-Id: I8adcc869113b8ad84269450121ad1ba73267fb54
 2014-02-26 12:46:52 -08:00
Brad Fitzpatrick a3d915e5a9 leak: fix racy test 
Based largely on Mathieu Lonjaret's Gerrit CL 2267.

Change-Id: I14634b6fc892e84cbdc718a9bb5a1aafca1ec4e9
 2014-02-25 16:06:56 -08:00