Rooba
/
perkeep
mirror of https://github.com/perkeep/perkeep.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,281 Commits 44 Branches 11 Tags 59 MiB
Commit Graph

143 Commits

Author SHA1 Message Date
mpl 59566cd0ab camsync: some verbiage 
Change-Id: Id386173d5710021e13dc6a3f9c4ab56dc05edc32
 2013-02-14 01:24:20 +01:00
mpl 981a4c9fbd camput: even with -vivify, do not reupload "big" file when server has it 
This change takes advantage of Uploader.fileMapFromDuplicate to avoid
reuploading "large" files when the server already has them and the
client has lost its cache (and hence does not know about it).

Fixes: http://code.google.com/p/camlistore/issues/detail?id=88

Change-Id: I9fa819cef37e1d930a5393c9bdce5f8bb71da9c6
 2013-02-12 19:02:05 +01:00
Brad Fitzpatrick 1b06c3a8c1 NewCamliFileSystem needs a client. Work on Issue 95. 
Change-Id: I417d9d04398e734d88d3139a91309a8f0eb8084d
 2013-02-06 21:47:01 -08:00
mpl f7d048d4ee Merge "rm TODO" 2013-02-03 22:50:42 +00:00
Marc-Antoine Ruel 73870dc3c2 Enable the use of localhost as a proxy for debugging purposes. 
This is useful to do blackbox performance analysis at the http layer.

Change-Id: Idf26f17e1fd0cb9421b3def9c846c4bffecaa433
 2013-02-03 12:26:29 -08:00
Brad Fitzpatrick a8e3cfde54 update TODO 
Change-Id: I5075de51cc8fa64658c1d74038a37c3f1a92383c
 2013-02-03 10:26:18 -08:00
Brad Fitzpatrick 96ea9af952 camput: add debug mechanism CAMLI_NO_FILE_DUP_SEARCH to disable fileMapFromDuplicate 
Change-Id: I1772ed69cccd4245e660887e257da2ab30bd59e4
 2013-02-02 21:34:05 -08:00
Brad Fitzpatrick ddcec4e92c Add --version flags to tools. 
Change-Id: I1c86c3de09fb59bc20539f7d1efbd4d4710bf494
 2013-02-02 10:59:39 -08:00
Brad Fitzpatrick ed40fc89f7 Clean up the clients dir a bit 
Change-Id: I1fb8e188044e8a552aa02acedb92c1c9b1d75330
 2013-02-02 09:02:43 -08:00
mpl 9ef7e5d2b9 rm TODO 
Verified: if a claimDate is set, the client will create
a signRequest that has a signature time set to that claimDate.
Then when the opengpg signing is done, it will use that time
instead of time.Now().

Change-Id: I658d52dadfcea7a9b6f9291c4d8020ac0efa83b5
 2013-02-01 16:09:58 +01:00
mpl 0b2532d96a camput: s/androidStatusRecevier/androidStatusReceiver/ 
Change-Id: I9cefc638b821948fad911c3e51e4a07c4da655b0
 2013-02-01 15:52:39 +01:00
Brad Fitzpatrick e8ef81c626 android/camput: more stats 
Change-Id: I668b8ee0b7c32d33075e421445af2973be1f576a
 2013-01-30 17:22:53 -08:00
Brad Fitzpatrick dfb45e6784 camput/android: more stat tracking. camput side only so far. 
Change-Id: Ifbafda6f5fae01db44cfd557f7b3e81433f85e70
 2013-01-30 10:56:10 -08:00
Brad Fitzpatrick 0c2aa8058a android: TODO notes for camput 
Change-Id: I751756a6d69bda73ecc5e6b3bd52e7b8b523cc1c
 2013-01-29 17:12:32 -08:00
Brad Fitzpatrick 5945b3a7dc campt: in android mode, also notify on skipped chunk uploads 
Change-Id: I25e6991c3d8a0703f00091154258e1d5073a28a2
 2013-01-29 16:39:18 -08:00
Brad Fitzpatrick 14f038c667 android: working but kinda-sucky progress bars. need camput to broadcast better stats. 
Change-Id: I28e6a16eba835116d8e8e205fe71073e0357b9c7
 2013-01-28 21:52:23 -08:00
Brad Fitzpatrick 502026bd89 android: UploadThread re-work. use pipe-to-camput-stdin model, and be more Go-like. 
Change-Id: I0f598dae28e47036bf713bfde488a7af0884e932
 2013-01-28 19:06:37 -08:00
Brad Fitzpatrick 34d1588a6f camput: add android child process input/input mode 
Change-Id: I54c80b958c3610b5f9e9b229f68f626553241d47
 2013-01-28 17:17:46 -08:00
Brad Fitzpatrick f1dc25c9c5 camput: move initCache to its own function 
Change-Id: I1d2029652fe4215a71b89bce178e6df8c40826b9
 2013-01-28 07:14:11 -08:00
Brad Fitzpatrick f5a588527b android: untested: more upload / status work 
Change-Id: I15dbf861b0bd8684a4e61a09f910315b874db1ed
 2013-01-27 17:12:08 -08:00
Brad Fitzpatrick dc49611c53 android: clean-up and start of protocol from camput to android host 
Change-Id: Icda33c1d54bdcd0a57f6ac62c09fd3e9cf9cd6f7
 2013-01-27 15:27:17 -08:00
Brad Fitzpatrick 2ef8612595 camput: android dialer cleanup 
Change-Id: I7f3749cc81029b5a24a3d8696660c79aefdffa84
 2013-01-26 17:12:07 -08:00
Brad Fitzpatrick 51e88c7434 camput: run in an Android linux non-cgo environment. 
Teaches it about Android DNS resolution and Android SSL root certs.

Change-Id: I22b53d4f836f58cd3dfc8c97e993138a8a5fe318
 2013-01-26 16:50:24 -08:00
Brad Fitzpatrick c7bbccf435 config: Rename blobServer config key and flag to just server. use auth from environment when an explicit server is given 
Change-Id: I07cfe3df3b644e143fcb92456e56d238bbbdd52e
 2013-01-25 16:23:31 -08:00
Brad Fitzpatrick cfc32e4a05 schema, camget: more work on deleting the Superset type. 
not much more remains.

Change-Id: I6cfe4145f67b100a0e2509f88ce6e1c580b7f9fe
 2013-01-22 09:32:40 -08:00
Brad Fitzpatrick 1bf01d7315 schema: lot of Blob/Builder work, and kill schema.Map. 
Next up: unexport schema.Superset.

Change-Id: Ia4bb34790abba75bdb4d4101df7a4f15875f4237
 2013-01-21 20:56:12 -08:00
Brad Fitzpatrick 02e3c08947 schema: start of eliminating/unexporting schema.Superset and schema.Map 
For now, unfortunately, there are even more types. The old ones will hopefully die soon.

Change-Id: I9d0bb1743c94a0de429175ef0b05ad6a964e07c0
 2013-01-21 17:31:08 -08:00
Brad Fitzpatrick 7ceaaa0012 blobref: simplify the FromHash func. Make type implicit. 
Change-Id: I2e01c3663bdb1151c11dfc9a1d59c7081940ffac
 2013-01-20 13:36:27 -08:00
Brad Fitzpatrick 7c319ca284 pkg/cacher: unify the cammount and camget disk caching code 
Change-Id: I8e53d00f1f5459856a4e2b863d74c2b7c3f515bc
 2013-01-20 09:52:03 -08:00
mpl ff382ceef5 camput: concurrent tagging 
Change-Id: Ice7a77d030087648187c1c8ad37888a1a9f406ca
 2013-01-17 23:20:40 +01:00
mpl 8268b2a298 camsync: set logger for all clients 
Change-Id: I9d3e9eeeadbceebbd7ef371e4e405a2cea202282
 2013-01-17 01:24:42 +01:00
mpl bb665b9584 camsync: added --all flag 
and some guessing/discovery for --src.

This option enables camsync to discover the sync handlers on the
source server, and use that information to run all possible syncs.

Change-Id: Ie1f3c309780a168372a674c6c3a18f679a67d804
 2013-01-17 00:37:40 +01:00
Brad Fitzpatrick dd72cd4434 schema: verify no slashes in fileName in FileNameString accessor. 
Change-Id: I1b02e67144fed1f80123530786af55c74bd64f36
 2013-01-13 20:43:55 -08:00
mpl 77d044f4b7 schema: add FileTime to guess the file 
creation time from potential file metadata.
camput: add the -exiftime option that allows
the use of the above for -filenodes and -vivify.

Fixes: http://code.google.com/p/camlistore/issues/detail?id=77

Change-Id: I05d1af3d875bb984e47e06775fd149e5ed0ed7b1
 2013-01-10 17:43:05 +01:00
Brad Fitzpatrick d689b8df88 camget: say the cache dir if verbose 
Change-Id: Ic9e8fa9379e354d920e8c896fbcd4f3a861dfe20
 2013-01-06 10:44:50 -08:00
Brad Fitzpatrick 3e5940a7ff camget, schema: read chunks more aggressively 
Change-Id: I31bc3a145fc2f3a51c3cecbaa33872da077e7bd7
 2013-01-05 23:12:42 -08:00
Brad Fitzpatrick ff9492c6cd camget: buffer the workc channel 
Change-Id: Ic6bf443c4d91f240b0b86c34a33bf74a1f2b627f
 2013-01-05 16:44:43 -08:00
Brad Fitzpatrick 9f6776dddb camget, httputil: more verbose HTTP debugging 
Change-Id: I2fc1a1fe0fff99202245d391a8a76e9fab07adc2
 2013-01-05 16:44:34 -08:00
mpl 39218e3cd5 Merge "Changed auth to take into account not only the credentials, but the requested operation/action too." 2013-01-04 21:09:37 +00:00
mpl 12213c058e Changed auth to take into account not only the credentials, 
but the requested operation/action too.

This allows to restrict vivify credentials to only upload
(as well as get and stat, because they're needed) to the
blobserver.

Change-Id: Idaed60d1f0d679cb9795ba9a11f094f964774335
 2013-01-04 22:17:12 +01:00
Brad Fitzpatrick c89dbc7130 camget: put a local disk cache in front of the client. 
a simple localhost test with only 4.4 MB and 4 files drops from 350 HTTP requests to 76.

more work to be done, but this is better.

Change-Id: I66ed67fe95ddd30aeefe742395874b2eabc237c7
 2013-01-03 17:55:30 -08:00
Brad Fitzpatrick fe13c7c712 move camput's statsTransport to httputil.StatsTransport, use it in camget too. 
Change-Id: Iab48e32ccb8a99b8ec6b058061cff9a5b99e8712
 2013-01-02 20:32:13 -08:00
Brad Fitzpatrick 8866e88db0 camget: do 10 at once. better, much pref work remains. 
Change-Id: Ib2e159a8a290aff249fbec109d4e76099fa0491a
 2013-01-02 15:13:22 -08:00
Brad Fitzpatrick 827feaa3ac camget, client, schema: start of camget --shared support. see flag docs. 
Change-Id: I5dd43129cb0032821a5913a8f20da0ddb38c63da
 2013-01-02 12:55:12 -08:00
Brad Fitzpatrick edd5cff32a camget: fix directory restoring 
Change-Id: I16c433fdda8a3220befd33309b1a31bbb69c0e58
 2013-01-02 11:23:00 -08:00
Brad Fitzpatrick 378b854479 camget: use bytes.NewReader instead of bytes.NewBuffer 
Change-Id: If51c47f356460b32355836e67a1ce443c071b65c
 2013-01-02 09:20:35 -08:00
Brad Fitzpatrick 6b7d73d757 camput: ignore atimes 
Change-Id: Ia55d6fef6a8e3aa95b6265c958853da7b170e3c4
 2013-01-01 21:05:02 -08:00
Brad Fitzpatrick 6b466d0faa camput, client: push havecache down deeper, make it track blob sizes. 
also, clean up some camput HTTP stuff.

Change-Id: I2762e5a1b83139132b5f660d306ed45584a7799a
 2013-01-01 20:23:44 -08:00
Brad Fitzpatrick f8df0845ea camput: Don't use statcache when using vivify 
Change-Id: I2c450afd36efdcd2d0fbd16023435936fbc43397
 2013-01-01 13:29:15 -08:00
Brad Fitzpatrick 57a60aa944 camput: flatcache TODO. 
Change-Id: I4e2368f8e22d5aa71bee8f5319f59444f3c0e638
 2012-12-31 13:53:44 -08:00