Commit Graph

4205 Commits

Author SHA1 Message Date
Brad Fitzpatrick bfbf660cd1 serverinit: fix flaky test. sort publishRoot prefixes, for predictable output
Change-Id: I230a7d344f9c982539b3ed6d3a88eb1066322ea5
2014-03-14 12:09:17 -07:00
Brad Fitzpatrick bf4e8f7238 gethandler: rewrite to not use SeekerFromStreamingFetcher; add tests
Change-Id: I785dd56f7bc7c1f113575700c74f910b4f4ea4a0
2014-03-14 11:52:11 -07:00
Brad Fitzpatrick bfcd26a2ff blob: move Blob type to its own file, add FromFetcher, FromReader
Prep for killing SeekFetcher.

Change-Id: Iade678ccf74d5ebc9613dbb9dbf44b9ed9ff4dea
2014-03-14 11:47:37 -07:00
Brad Fitzpatrick bf96b2af24 types: add NewFakeSeeker
NewFakeSeeker returns a ReadSeeker that can pretend to Seek (based
on the provided total size of the reader's content), but any reads
will fail if the fake seek position doesn't match reality.

Change-Id: I4e63aa78c80fdbcd87b2133018009ed72bedb9f3
2014-03-14 11:09:00 -07:00
Brad Fitzpatrick bf5e1a43b6 TODO: more
Change-Id: Id83f4c319340d28e500ce889cd2ed951bd3998a1
2014-03-14 09:23:18 -07:00
Brad Fitzpatrick bf01b14961 index: move seekFetcherMissTracker up a layer
In prep for missing blob dependency rescheduling in indexer.

Change-Id: I1d492e6aa64cfb658daec17e4621d1453c6d3607
2014-03-14 09:14:46 -07:00
Brad Fitzpatrick bf6031a397 search: add operator "childrenof:sha1-xxxxx" to find permanode children of a parent
Change-Id: I9e756147c70f5230aa843ab215dafe5ed6d80087
2014-03-13 19:02:26 -07:00
Brad Fitzpatrick bfa412de5d search: implement some of RelationConstraint (only the "parent" relation)
Allows searching for permanodes based on their parent(s).

Change-Id: I949f159edc43d895e1657bd6ae4c983758ac59f2
2014-03-13 18:49:28 -07:00
Brad Fitzpatrick bfeb745882 corpus: add PermanodeHasAttrValueLocked convenience accessor
Change-Id: Ie73270ce54c3125a76987daa9f50895c5acf42db
2014-03-13 18:48:00 -07:00
Brad Fitzpatrick bf6ae30368 corpus: reverse-index claims with values that look like blobrefs
Allows efficiently finding parents of permanodes, or permanodes of
file contents, etc.

Adds Corpus.ForeachClaimBackLocked.

Change-Id: I6dffb32eab4a959cd3c5922a7f47d11fdcea5f3d
2014-03-13 18:47:25 -07:00
Brad Fitzpatrick 18bd4cdc0b Merge "camtool sync: ignore diff identity with localdisk" 2014-03-13 16:33:55 +00:00
Aaron Boodman 75fb861821 Merge "Web UI: Fix for infinite loop with extremely wide aspect ratio images." 2014-03-13 15:44:21 +00:00
Aaron Boodman 12a4c07c54 Web UI: Fix for infinite loop with extremely wide aspect ratio images.
Change-Id: I567000d10adc542e5759d06a82a28db380d225ad
2014-03-13 08:43:38 -07:00
mpl dab702ea49 camtool sync: ignore diff identity with localdisk
When either the source or the destination is a localdisk, there is no
need to warn about differing identities.

Change-Id: Ia61779dd7907099c5ab58d9ca876cf4690f6fe05
2014-03-13 16:10:34 +01:00
Brad Fitzpatrick 9bd781c453 Merge "No 'and' or 'or' yet. Added description for attr and tag." 2014-03-12 21:52:24 +00:00
Steven L. Speek 6d9117f1c0 No 'and' or 'or' yet. Added description for attr and tag.
Change-Id: Ib1ab293dabc264657a970c8ef3ca54b9d59868ce
2014-03-12 22:48:19 +01:00
mpl 607a20f349 Merge "0.8 release notes" 2014-03-12 20:35:56 +00:00
mpl 2e421013f7 0.8 release notes
Change-Id: I1fb43617f7667d65239b3d264662d7ce89c76203
2014-03-12 21:34:36 +01:00
mpl d9f33ac45b Merge "UI: enable "deleting" items on search page" 2014-03-12 13:42:47 +00:00
Brad Fitzpatrick 2369d0b009 Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-03-11 18:25:41 -07:00
Brad Fitzpatrick bf7e30d84e website: add foursquare importer to 0.8 notes
Change-Id: If91d9b9332e8234783de17bd7a25e0a9f6813976
2014-03-11 18:25:33 -07:00
Nick O'Neill f4f4368a40 Added some icons for checkins and venues.
Change-Id: I4bfc5b7a8e099643c159ee6cb2532c71b0e62159
2014-03-11 18:23:13 -07:00
Brad Fitzpatrick dc164e0af3 Merge "Import places and checkins from foursquare." 2014-03-12 00:33:30 +00:00
Nick O'Neill 729d5c5851 Import places and checkins from foursquare.
Change-Id: Ida2e411821f48a88212856398f5fe94caf7acd75
2014-03-11 17:31:17 -07:00
mpl 9263181931 UI: enable "deleting" items on search page
Items can be selected and effectively hidden from a UI point of view.

For now, since only the selected permanode is marked as deleted, and
GC is not yet implemented, no content is actually deleted. This is
really more like hiding the content permanently without deleting it.

Change-Id: I6ebc228905e3612503f153ff3bbb44ba24a43d09
2014-03-11 21:39:58 +01:00
Brad Fitzpatrick bfe7128e94 fs: avoid possible nil pointer crash
http://camlistore.org/issue/401

Change-Id: I7ae091798e2f250898f14ec325a89cbfad4ee6aa
2014-03-11 13:30:58 -07:00
Aaron Boodman 6ad180e592 Merge "Inital support for camliContentImage." 2014-03-11 04:29:32 +00:00
Aaron Boodman 2add0472e1 Inital support for camliContentImage.
Change-Id: Ie89d296eb1ce5b8ae4ff4d4cb8c1f97f09a4c98c
2014-03-10 21:28:13 -07:00
Brian Gitonga Marete 68074bbadd pkg/schema: Fix camput panic on non-utf8 filenames or symlink targets.
Also implement the relevant integration tests for camput and camget.

Depends on CL 2216.

Change-Id: I3f541efd4e583674e9817473292fa3de8a3cdabc
2014-03-10 21:01:51 -07:00
Brad Fitzpatrick d10c9f070b Merge "cmd/camget: Support restoring symbolic links when writing to filesystem." 2014-03-11 03:51:01 +00:00
Brad Fitzpatrick bf48a198c8 search: add test for camliContentImage describing
Test was missing from bf5cc362b5

Change-Id: Ie42bef6f7cff19b69e3bad37f42b8d3a694d9a28
2014-03-10 20:11:32 -07:00
Brad Fitzpatrick bffe14c682 diskpacked: fix dev server
Was broken in bf6bde214a

Change-Id: Ia184a7c8373e2b303cfd6e8ae6091150de1a8d15
2014-03-10 20:10:00 -07:00
Brad Fitzpatrick bf5cc362b5 search: also describe camliContentImage
Change-Id: I64cd4818dead81f5a0dac0e275994df17b7740ef
2014-03-10 19:53:56 -07:00
Brad Fitzpatrick bf892c7637 camtool: add search subcommand
Change-Id: I8738c2eb7eae4417778be39a4237e02d42965615
2014-03-10 19:47:30 -07:00
Brad Fitzpatrick bfe5eafb44 search: remove check on negative search limit.
It's defined and implemented to mean infinite.

Change-Id: Ia50fd2b101d800ba442b4767ddf1c9bf57ea999f
2014-03-10 19:31:33 -07:00
Brad Fitzpatrick bfaf8fa120 Add camliContentImage.
See camlistore.org/issue/395

Change-Id: I7057593c6733f0e6312681399c3d707dd3aac147
2014-03-10 19:11:29 -07:00
Brad Fitzpatrick bf6bde214a diskpacked: optional support for alternate index sorted.KeyValue store
By default it will use cznic/kv. But if you want to use something else
(like MySQL, or leveldb, or Postgres, or Mongo), you can.

Change-Id: I8ce3571a701717ffde3b80856c72a9e3223ab439
2014-03-10 19:01:21 -07:00
Nick O'Neill a30364a243 Merge "Add doc/search-ui.txt" 2014-03-11 00:47:43 +00:00
Brad Fitzpatrick d13bb4aaed Merge "corpus: deleted check when enumerating permanodes" 2014-03-10 17:56:53 +00:00
mpl 0fdca769e0 corpus: deleted check when enumerating permanodes
http://camlistore.org/issue/354

Change-Id: I7d76c654eb3b875ad8017a14a08a5c909bd696a0
2014-03-10 18:43:57 +01:00
Brad Fitzpatrick 15b0c251ba Merge "Convert all S3 requests to HTTPS" 2014-03-09 22:33:14 +00:00
Brad Fitzpatrick bf6d32a8ff C+A: add Antti Rasinen (Individual CLA)
Change-Id: I23c01f45741e8c856afe568476107e67debbc5ba
2014-03-09 15:31:33 -07:00
Antti Rasinen f837fcb9d8 Convert all S3 requests to HTTPS
Also includes fixes for two missing data items
for errors.

Change-Id: Ib174b4bf83f3f264f463b4c203c1f42213b18f5e
2014-03-09 21:00:13 +02:00
Brad Fitzpatrick 34d4513eb4 Merge "camtool list/sync: fix 3 bugs" 2014-03-09 05:22:31 +00:00
Brad Fitzpatrick bfca89314d website: update 0.8 notes
Change-Id: I6f536cdd3f8bb23dfb322438bbea5ddd35e61a75
2014-03-08 21:14:35 -08:00
Brad Fitzpatrick bf6d91545c search: remove expr TODO
Change-Id: Iea7826f2924ad229585a1ec3921fceb6130e8207
2014-03-08 21:11:03 -08:00
Brad Fitzpatrick 4d33d6ced3 Merge "attribute search" 2014-03-09 05:11:42 +00:00
Steven L. Speek b326c2db11 attribute search
Change-Id: I9638ca9ef325076122721c601aade05ce99c0c24
2014-03-08 20:58:42 +01:00
mpl 73526917a1 camtool list/sync: fix 3 bugs
1) revert to printing to stdout (broke in
08923e1c00) for actual output

2) do not warn about different identities when "syncing" to stdout

3) check blob was actually described before using its fields

Change-Id: Ibb3aa4c560e1b0036aba080807400e8820163cc9
2014-03-08 19:15:46 +01:00
Brian Gitonga Marete 0c4b67d3bf cmd/camget: Support restoring symbolic links when writing to filesystem.
This patch adds support for restoring symbolic links when camget is
called with the -o option.

This fixes an issue which caused `camget -o' to write an incomplete
snapshot to the target directory when it encountered a symlink.

Note that no attempt is made to restore the symlink metadata since: a)
A symlink's permissions do not matter and are fixed to 1777 on some
systems b) Go's os.Chtimes() always acts on the symlink target c)
os.Chown() is not currently called for any file in the current code.

Tested on Linux.

Change-Id: I7099592dcd5cc513c2685671be6f6b165f8f8053
2014-03-08 05:14:59 +03:00