Rooba
/
perkeep
mirror of https://github.com/perkeep/perkeep.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,763 Commits 44 Branches 11 Tags 59 MiB
Commit Graph

68 Commits

Author SHA1 Message Date
mpl 295cbade1b Add postgres support 
Also added the -short option for make presubmit
because postgres test is too slow.

Change-Id: I6be21c4d4cd67671eb44ab65333fc32c1e261bbd
 2012-11-03 19:59:22 +01:00
Brad Fitzpatrick 22495f8bfd schema: adjust rollsum splitting algorithm, make it the default 
We might tweak the parameters yet, and I want to add a bunch more
tests, but this is a major relief for me.  I've been reluctant to
put too much data into my personal Camlistore instance until I
figured out how I wanted the file chunks to split.

This also simplifies (deletes) a fair bit of code.

Change-Id: I35c38cc5d39a8a43e3f62445434f8d7fd5de5d17
 2012-10-29 02:03:05 +01:00
Brad Fitzpatrick 0ddc9dcadb camget: add a graphviz output mode with -graph 
Change-Id: I472a1e7fda0f1a15bdcba1a7be8e0d586741bf08
 2012-10-28 19:32:25 +01:00
mpl f91f1f88c4 camput: final error printing 
Change-Id: Icc51560545b20315a0383d7bda80170c5612e1f2
 2012-10-24 16:02:37 +02:00
mpl 202c45a04a camput file: 
This change introduces 2 features, illustrated by those examples:
1) camput file -filenodes *.jpg
This was not previously possible because -filenodes option only worked
with directories.
2) camput file -filenodes -tag 'nice pics' /media/foo/DCIM/
This was not previously possible because the -tag option could only be
used with the -permanode option.

Change-Id: I80ed95fdc819d359cacfe97ba3b7849b96e406f4
 2012-10-22 19:25:56 +02:00
Brad Fitzpatrick 6be58c9ce0 camput: start of proper tests 
Change-Id: Icc9257154fecaaf2018971ab94e0dc54086d3719
 2012-10-21 14:14:51 -07:00
Brad Fitzpatrick ef8e746cb5 merge 
Change-Id: I06ab89274e35bad61944e208e366cd7436381e63
 2012-10-21 13:59:13 -07:00
Brad Fitzpatrick e9b5bca10e camput: start of making it more testable 
Change-Id: Ie65afeaa14ea483231674433cda5a90669ca0bc7
 2012-10-21 13:58:06 -07:00
mpl 159c2a5216 camput: moved/added examples, added -help as a global flag to display usage 
Change-Id: I3de13057c555d68752101043f671d7694a311021
 2012-10-19 17:57:17 +02:00
mpl a534e02c2d camput: client becomes StatReceiver. 
also added ReaderSize function to
guess before reading the size of
a source.

Change-Id: I659e174821696b3c58759b132b82710a49583018
 2012-10-11 11:51:12 +02:00
Brad Fitzpatrick 228c0ca56f schema: change PopulateSymlinkMap to be Map.SetSymlinkTarget 
Change-Id: I072ce65331048b54c90c32e951f5034060c1764c
 2012-08-22 04:38:25 +10:00
Brad Fitzpatrick 439db110ec schema: more cleanup; ditch the Claimer type 
Change-Id: I2a52564c1a99c96a2cd8bc84a791784f0a4e4b2e
 2012-08-22 04:31:48 +10:00
Brad Fitzpatrick 11eac8721e Convert more code to use schema.Map instead of map[string]interface{} 
Change-Id: I285fd1b0e730ebd32069688a71cb992c43770ade
 2012-08-22 03:47:38 +10:00
Brad Fitzpatrick 3cd7f75f89 schema: introduce type Map 
Change-Id: I8209930d8505a4cb74b8ea29b5b57f2cd6bd14d2
 2012-08-22 03:36:36 +10:00
Brad Fitzpatrick 0a0b012eba camput,schema: cleanup, docs 
Change-Id: Ifa94cb1e9e086f85222692508ab12616f4cc3211
 2012-08-22 03:31:44 +10:00
Brad Fitzpatrick dc684dfa6a camput: updated comments, TODO 
Change-Id: I8df73d4c1c44c71424bcfaf7d3cb124c1738c791
 2012-08-22 02:39:36 +10:00
Brad Fitzpatrick 8fec29c974 camput: make file permanodes consistent between runs (fix claim times) 
Change-Id: Idd2bbda2372802772703eaeaf6fe2e74f9bcdd83
 2012-08-21 20:43:38 +10:00
Brad Fitzpatrick b815a2b758 camput: add -filenodes option for per-file content-based planned permanodes 
Change-Id: Ic03b990654d860e03b4cc710de92f7d40c392df8
 2012-08-21 16:11:10 +10:00
Brad Fitzpatrick 51e88cac65 Support for "planned permanodes" in pkg/jsonsign, pkg/schema and cmd/camput. 
A planned permanode involves setting the contents of the permanode
(instead of a random string) as well as the OpenPGP signing time so
the resultant bytes of the blob (and thus its blobref) is deterministic.

This allows multiple independent devices (my laptops) to create the
same permanodes for the same files (photos backed up from my phone)
when offline (airplane) and then when they sync later, still only have
one permanode per unique file.  This means that tagging and other
metadata applied to permanodes on one laptop merge cleanly with
metadata from the other.
 2012-07-28 16:32:31 -07:00
Brad Fitzpatrick 8c293e34b6 Per Go initialism style, rename Json to JSON 2012-07-28 15:42:56 -07:00
mpl 326d62aea4 camput: actually catch errors when trying to upload, 
also added startupcheck for remote blobserver

Change-Id: Id9f5383c6fd3fdf697f2b75052f3e63b0972205d
 2012-07-23 11:05:57 +02:00
mpl e3c0d11011 camput share, argument bugfix 
Change-Id: Ic1bc9889b50dc69509810a619f34b4896e68587b
 2012-05-13 15:55:12 +02:00
Brad Fitzpatrick 4b8df05859 fs,fuse: new 'welcome' root node, where you can navigate/search anywhere. 
Change-Id: I66f076a85d8e474bb5d93ad8743fc8181de7502f
 2012-04-29 14:29:51 +10:00
Brad Fitzpatrick f19c1f9026 cammount: fix fmt pattern 
Change-Id: I8bb3df8a14cd3d3b44c899f3e2754b50b35b0028
 2012-04-26 19:34:29 -07:00
Brad Fitzpatrick 5315bbf232 camput: re-do the stat/have flatcaches. 
still waiting on leveldb-go, but this works for now.

Change-Id: I630d7bd2757a02d3a711c48075486c5cc6339118
 2012-04-22 17:18:19 -07:00
Brad Fitzpatrick b4bff6a7d9 camput: check decode errors, exposes bugs in flat cache 
Change-Id: I5fd812300c0c92892447a57d1da49cceedca9e3f
 2012-04-21 08:54:26 -07:00
Brad Fitzpatrick df339b446a camput: show blob stats during upload too 
Change-Id: I988e5e12cfee355dce0170165c42cb4d162dc259
 2012-04-21 08:30:04 -07:00
Brad Fitzpatrick da42bdf523 camput: more code movement 
Change-Id: I775096c39b5c9671a3c054b7d02562cfa787f0a1
 2012-04-21 07:22:32 -07:00
Brad Fitzpatrick e6e26f2017 camput: move common uploader stuff to uploader.go 
Change-Id: I6137a945f89f4a0603189a5fc04b49a570a3403b
 2012-04-21 07:14:57 -07:00
Brad Fitzpatrick cd79828912 camput: move nodeworker into its own file 
Change-Id: Ic61d35955fe4dd59ada65a314f0c94cc3f7b0f87
 2012-04-21 07:07:07 -07:00
Brad Fitzpatrick 2274bd97b1 camput: bunch of cleanups and bugs and usability stuff. 
Change-Id: I029cc38d5b10a2d322e26148eb4971b3c838c889
 2012-04-20 14:43:23 -07:00
Brad Fitzpatrick 0d989a6ae6 camput: fix up statcache to work with Go 1. crashed before with gob error on os.FileInfo. 
Change-Id: I9b88435e00352988e5f89e64f45ea4cb3d2c76ab
 2012-04-20 14:27:52 -07:00
Brad Fitzpatrick 9168eb84f0 camput: fix logging bug 
Change-Id: I8781b523013dca814b81f99fed85ba59a489862c
 2012-04-20 14:03:09 -07:00
Brad Fitzpatrick 5005dcf751 camput: fix statcache/havecache flag mix-up. 
Change-Id: Ie7caea7841d055ed47774d0279095f218740ab5a
 2012-04-20 13:05:34 -07:00
Brad Fitzpatrick 0baa073b44 camput: switch to new tree upload code. 
Change-Id: Iae653e4442bab63979d584caecdce58df942385d
 2012-04-19 17:59:41 -07:00
Brad Fitzpatrick 0f3ce52c54 camput: memoize SumBytes 
Change-Id: Ie0ea05a895f97de2b069c088d4195b533b70ea8e
 2012-04-18 07:24:45 -07:00
Brad Fitzpatrick 7e94879e86 camput: in du mode, only run 1 upload worker. 
Change-Id: I65b642095ca9f162f14db512f34bb7073ef7a13b
 2012-04-17 17:46:05 -07:00
Brad Fitzpatrick 715c5278e0 camput: working diskusage mode. 
Change-Id: I7c3df20fed7720e3535b5e618d20842d1ddaadcc
 2012-04-15 17:21:19 -07:00
Brad Fitzpatrick 4f0f53a90e camput: more TreeUpload work; adds NodeWorker helper. 
Change-Id: Ie5919faa34fd2f6eb1b61669598e0a06e1d8ba07
 2012-04-15 17:11:25 -07:00
Brad Fitzpatrick 69ce6654e8 camput: fix bug so default switch case can be hit now. 
otherwise all other files were hitting the not-directory case.

Change-Id: I03e6021e947eee301e21db3f20c2da3c2f92ab2d
 2012-04-15 14:25:41 -07:00
Brad Fitzpatrick 92b10a39a4 camput: remove dead flag 
Change-Id: Idf6ec9416b5878379de19b53a93b86982125f7cb
 2012-04-15 14:21:38 -07:00
Brad Fitzpatrick d05a336cb0 camput: move more blob-only stuff to blobs.go 
Change-Id: I967e9dc975db18088b88c00b2672353a5a72f458
 2012-04-15 14:21:00 -07:00
Brad Fitzpatrick 90c254038c camput: remove dead code 
Change-Id: Ifab0247b6c23d050abd822b479558a0d75930b8b
 2012-04-15 14:10:08 -07:00
Brad Fitzpatrick 77fc9e8abb camput: only support '-' meaning stdin for the 'blob' subcommand, not 'file' 
Change-Id: I9a8923792385e232dc42c7707c1b748f82a5ac37
 2012-04-15 14:01:39 -07:00
Brad Fitzpatrick 88cff46f28 camput: more TreeUpload work 
Change-Id: I8638ccdc342642447661e68918259878e04ef756
 2012-04-15 13:54:21 -07:00
Brad Fitzpatrick 61a895b1f8 camput: some more TreeUpload work 
Change-Id: I2b4e74f7892720bbf6b544a7abb9867d5ad3415b
 2012-04-15 11:26:36 -07:00
Brad Fitzpatrick f366dfb850 some TreeUpload TODO notes 
Change-Id: If26ddcb6ee8ebc1b35f569ecbf835da5f666c3a7
 2012-04-15 08:55:11 -07:00
Brad Fitzpatrick 72ac3fc8b1 camput: TODOs for VFS 
Change-Id: I9b403ec5e3e66f150da4277eabe99e079c61d2b8
 2012-04-15 08:28:18 -07:00
Brad Fitzpatrick 683e762c79 camput: go through virtual filesystem. will be good for filtering skipDirs & testing. 
Change-Id: I2fa56615b6b199ab054de388dde652749049d5e1
 2012-04-15 08:11:37 -07:00
Brad Fitzpatrick 147cdb05c9 camput: unindent 
Change-Id: I151b136a97a129a75f3f83fca8f1be841f7bec2b
 2012-04-15 07:47:38 -07:00