Commit Graph

4237 Commits

Author SHA1 Message Date
mpl d9f33ac45b Merge "UI: enable "deleting" items on search page" 2014-03-12 13:42:47 +00:00
Brad Fitzpatrick 2369d0b009 Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-03-11 18:25:41 -07:00
Brad Fitzpatrick bf7e30d84e website: add foursquare importer to 0.8 notes
Change-Id: If91d9b9332e8234783de17bd7a25e0a9f6813976
2014-03-11 18:25:33 -07:00
Nick O'Neill f4f4368a40 Added some icons for checkins and venues.
Change-Id: I4bfc5b7a8e099643c159ee6cb2532c71b0e62159
2014-03-11 18:23:13 -07:00
Brad Fitzpatrick dc164e0af3 Merge "Import places and checkins from foursquare." 2014-03-12 00:33:30 +00:00
Nick O'Neill 729d5c5851 Import places and checkins from foursquare.
Change-Id: Ida2e411821f48a88212856398f5fe94caf7acd75
2014-03-11 17:31:17 -07:00
mpl 9263181931 UI: enable "deleting" items on search page
Items can be selected and effectively hidden from a UI point of view.

For now, since only the selected permanode is marked as deleted, and
GC is not yet implemented, no content is actually deleted. This is
really more like hiding the content permanently without deleting it.

Change-Id: I6ebc228905e3612503f153ff3bbb44ba24a43d09
2014-03-11 21:39:58 +01:00
Brad Fitzpatrick bfe7128e94 fs: avoid possible nil pointer crash
http://camlistore.org/issue/401

Change-Id: I7ae091798e2f250898f14ec325a89cbfad4ee6aa
2014-03-11 13:30:58 -07:00
Aaron Boodman 6ad180e592 Merge "Inital support for camliContentImage." 2014-03-11 04:29:32 +00:00
Aaron Boodman 2add0472e1 Inital support for camliContentImage.
Change-Id: Ie89d296eb1ce5b8ae4ff4d4cb8c1f97f09a4c98c
2014-03-10 21:28:13 -07:00
Brian Gitonga Marete 68074bbadd pkg/schema: Fix camput panic on non-utf8 filenames or symlink targets.
Also implement the relevant integration tests for camput and camget.

Depends on CL 2216.

Change-Id: I3f541efd4e583674e9817473292fa3de8a3cdabc
2014-03-10 21:01:51 -07:00
Brad Fitzpatrick d10c9f070b Merge "cmd/camget: Support restoring symbolic links when writing to filesystem." 2014-03-11 03:51:01 +00:00
Brad Fitzpatrick bf48a198c8 search: add test for camliContentImage describing
Test was missing from bf5cc362b5

Change-Id: Ie42bef6f7cff19b69e3bad37f42b8d3a694d9a28
2014-03-10 20:11:32 -07:00
Brad Fitzpatrick bffe14c682 diskpacked: fix dev server
Was broken in bf6bde214a

Change-Id: Ia184a7c8373e2b303cfd6e8ae6091150de1a8d15
2014-03-10 20:10:00 -07:00
Brad Fitzpatrick bf5cc362b5 search: also describe camliContentImage
Change-Id: I64cd4818dead81f5a0dac0e275994df17b7740ef
2014-03-10 19:53:56 -07:00
Brad Fitzpatrick bf892c7637 camtool: add search subcommand
Change-Id: I8738c2eb7eae4417778be39a4237e02d42965615
2014-03-10 19:47:30 -07:00
Brad Fitzpatrick bfe5eafb44 search: remove check on negative search limit.
It's defined and implemented to mean infinite.

Change-Id: Ia50fd2b101d800ba442b4767ddf1c9bf57ea999f
2014-03-10 19:31:33 -07:00
Brad Fitzpatrick bfaf8fa120 Add camliContentImage.
See camlistore.org/issue/395

Change-Id: I7057593c6733f0e6312681399c3d707dd3aac147
2014-03-10 19:11:29 -07:00
Brad Fitzpatrick bf6bde214a diskpacked: optional support for alternate index sorted.KeyValue store
By default it will use cznic/kv. But if you want to use something else
(like MySQL, or leveldb, or Postgres, or Mongo), you can.

Change-Id: I8ce3571a701717ffde3b80856c72a9e3223ab439
2014-03-10 19:01:21 -07:00
Nick O'Neill a30364a243 Merge "Add doc/search-ui.txt" 2014-03-11 00:47:43 +00:00
Brad Fitzpatrick d13bb4aaed Merge "corpus: deleted check when enumerating permanodes" 2014-03-10 17:56:53 +00:00
mpl 0fdca769e0 corpus: deleted check when enumerating permanodes
http://camlistore.org/issue/354

Change-Id: I7d76c654eb3b875ad8017a14a08a5c909bd696a0
2014-03-10 18:43:57 +01:00
Brad Fitzpatrick 15b0c251ba Merge "Convert all S3 requests to HTTPS" 2014-03-09 22:33:14 +00:00
Brad Fitzpatrick bf6d32a8ff C+A: add Antti Rasinen (Individual CLA)
Change-Id: I23c01f45741e8c856afe568476107e67debbc5ba
2014-03-09 15:31:33 -07:00
Antti Rasinen f837fcb9d8 Convert all S3 requests to HTTPS
Also includes fixes for two missing data items
for errors.

Change-Id: Ib174b4bf83f3f264f463b4c203c1f42213b18f5e
2014-03-09 21:00:13 +02:00
Brad Fitzpatrick 34d4513eb4 Merge "camtool list/sync: fix 3 bugs" 2014-03-09 05:22:31 +00:00
Brad Fitzpatrick bfca89314d website: update 0.8 notes
Change-Id: I6f536cdd3f8bb23dfb322438bbea5ddd35e61a75
2014-03-08 21:14:35 -08:00
Brad Fitzpatrick bf6d91545c search: remove expr TODO
Change-Id: Iea7826f2924ad229585a1ec3921fceb6130e8207
2014-03-08 21:11:03 -08:00
Brad Fitzpatrick 4d33d6ced3 Merge "attribute search" 2014-03-09 05:11:42 +00:00
Steven L. Speek b326c2db11 attribute search
Change-Id: I9638ca9ef325076122721c601aade05ce99c0c24
2014-03-08 20:58:42 +01:00
mpl 73526917a1 camtool list/sync: fix 3 bugs
1) revert to printing to stdout (broke in
08923e1c00) for actual output

2) do not warn about different identities when "syncing" to stdout

3) check blob was actually described before using its fields

Change-Id: Ibb3aa4c560e1b0036aba080807400e8820163cc9
2014-03-08 19:15:46 +01:00
Brian Gitonga Marete 0c4b67d3bf cmd/camget: Support restoring symbolic links when writing to filesystem.
This patch adds support for restoring symbolic links when camget is
called with the -o option.

This fixes an issue which caused `camget -o' to write an incomplete
snapshot to the target directory when it encountered a symlink.

Note that no attempt is made to restore the symlink metadata since: a)
A symlink's permissions do not matter and are fixed to 1777 on some
systems b) Go's os.Chtimes() always acts on the symlink target c)
os.Chown() is not currently called for any file in the current code.

Tested on Linux.

Change-Id: I7099592dcd5cc513c2685671be6f6b165f8f8053
2014-03-08 05:14:59 +03:00
Brad Fitzpatrick bfa30b3013 sync: add a button to start a full validation, even when disabled
Change-Id: I229fa70843bb4b9d206788bf150c436c56c82cb7
2014-03-07 17:32:59 -08:00
Brad Fitzpatrick bf2790f740 C+A: add Steven L. Speek
Change-Id: Iadbdc7e576c40da11fbf3261f26bdbae5afe7f1b
2014-03-07 16:54:57 -08:00
Brad Fitzpatrick bfa8efc1b9 sync: background validation of src-vs-destination in sync handler
Currently controlled by an environment variable, but will become
a config option + on-demand button in UI in later commits.

Change-Id: I25fa878c9b30cdd713e2859585210eb722092f7b
2014-03-07 10:57:41 -08:00
Brad Fitzpatrick bf22f2db1e Add missing moved file from 76ba33b2
Change-Id: Iadbdc7e576c40da11fbf3261f26bdbae5afe7f1b
2014-03-07 10:06:01 -08:00
Brad Fitzpatrick abca567581 sync: work on full-validation-on-startup. 90% done, disabled.
Change-Id: I5bf062f3b22c2cc41329ff6b23f11198ae543c0f
2014-03-06 16:52:29 -08:00
Brad Fitzpatrick 4e257ed14d Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-03-06 15:05:19 -08:00
Brad Fitzpatrick 76ba33b27a Move ListMissingDestinationBlobs from pkg/client to blobserver
Change-Id: I7489531fe2a1a5127b2212d5a5f80d4c4c614353
2014-03-06 15:04:15 -08:00
mpl da7a9b8dcb Merge "UI: add support for deleting selected permanodes" 2014-03-06 22:07:31 +00:00
mpl 8ab115cb21 UI: add support for deleting selected permanodes
Feature disabled for now, until the backend (corpus) part is ready.

Change-Id: Ib3527b8f3bfb6793bb60d5e91cd06bc8fab5a5c0
2014-03-06 23:05:20 +01:00
Brad Fitzpatrick 58ac8b5469 sync: restore key part accidentally removed prior to earlier submit
Would cause accounting errors before in the face of duplicate uploads.

Change-Id: Ie7c49da1adaf2b9c98ef1015f875a4df8b66729f
2014-03-06 13:23:27 -08:00
Brad Fitzpatrick c1892b5ae5 Rewritten sync handler.
Fix deadlock, much better status page, show per-blob status & errors,
clear errors when they've resolved themselves, fix known data race.

Change-Id: I968de0de4f308ff0a410adceb181a0712800d401
2014-03-05 08:51:22 -08:00
Brad Fitzpatrick 023fba5629 Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-03-05 08:39:15 -08:00
Brad Fitzpatrick 344980114a doc: add CAMLI_S3_FAIL_PERCENT var
Change-Id: Ie2c85da2bfeefc9e5ae98c14c5d879d7208a82f1
2014-03-05 08:26:34 -08:00
Brad Fitzpatrick 658472577d s3: be a Stringer, make default host more explicit, add failure injection
Change-Id: I1c24e97ef4b901e3be62fbb7e34c3f53787eedb1
2014-03-05 08:24:30 -08:00
Brad Fitzpatrick 260a33aa2a Make various popular storage targets be Stringers. Optional, for upcoming sync handler rewrite.
Change-Id: I8cc961ace8b6093b1dbd82bc39ba3fc334f1d5c7
2014-03-05 08:23:07 -08:00
Brad Fitzpatrick f1a4aae0da camput: add --blobdir=discard debug option
Does a dry-run and just shows the final blobref, without writing data anywhere.

Change-Id: Ia234b642b5b9029ee4fd9c61bc7edcdcfa5ca858
2014-03-04 22:47:58 -08:00
Brad Fitzpatrick 97338594c7 blobserver: simplify NoImplStorage code
Change-Id: Icc133667b5038783609082ec412f7fca7ecce927
2014-03-04 22:45:35 -08:00
Nick O'Neill 78fdefab1e Merge "Fixed an issue where checking for files was slow" 2014-03-05 02:50:39 +00:00