Rooba
/
perkeep
mirror of https://github.com/perkeep/perkeep.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,051 Commits 44 Branches 11 Tags 59 MiB
Commit Graph

2051 Commits

Author SHA1 Message Date
Brad Fitzpatrick 88e92a6cc5 Document blobserver.Loader methods, fix GetHandlerType to not force-load, diagnose loops better. 
Change-Id: I03e989267e80ad610d3877c97fbf8adc8a88bb60
 2013-01-11 12:42:30 -08:00
Brad Fitzpatrick 4be9f2f264 serverconfig: fix test on OS X 
Change-Id: Ic5a8f820abe3cad920a18991cc21b5386fdf9553
 2013-01-11 10:52:22 -08:00
Brad Fitzpatrick 446f03619c root: lazily load the search handler as needed. Don't block start-up. 
This means we can prevent cycles elsewhere in load.

Change-Id: I670b7563b50818ef489a7f2fc832489e4bc659c8
 2013-01-11 10:39:14 -08:00
Brad Fitzpatrick 5998fecc22 publish: don't retain a blobserver.Loader, just a FindHandlerByTyper 
Change-Id: I37d5873ce4c30f67841f31fa744afaf80b24d4b3
 2013-01-11 10:14:18 -08:00
Brad Fitzpatrick d80cad8e2d auth stuff: clean up, allow scheme registration, integrate App Engine auth. 
Change-Id: Idc7ac3782d3669a8f68255bd54d03f583814d5e2
 2013-01-10 23:04:24 -08:00
Brad Fitzpatrick 23d11a5835 Unbreak line 
Change-Id: Ia1d287d4c04744c57877281f393ba8ee267807bb
 2013-01-10 19:29:10 -08:00
Brad Fitzpatrick 6ca0efac8c camlistored: much better sqlite support, by default, and help/docs/hints 2013-01-10 16:16:10 -08:00
Brad Fitzpatrick 0640f5873a Merge branch 'master' of ssh://camlistore.org:29418/camlistore 2013-01-10 15:29:35 -08:00
Brad Fitzpatrick 642613ebfc serverconfig: sqlite support and general cleanups. 2013-01-10 15:29:08 -08:00
mpl 9357d82a8f Merge "schema: add FileTime to guess the file creation time from potential file metadata. camput: add the -exiftime option that allows the use of the above for -filenodes and -vivify." 2013-01-10 23:17:57 +00:00
Brad Fitzpatrick 37e1a4b7ae Merge branch 'master' of ssh://camlistore.org:29418/camlistore 2013-01-10 14:37:44 -08:00
Brad Fitzpatrick 02b8b35b51 Make sqlite support optional and detectable. 2013-01-10 14:29:20 -08:00
Brad Fitzpatrick 080dd4be58 Merge "serverconfig: make the localdisk optional, so that s3 can be used as the primary blobserver." 2013-01-10 22:13:16 +00:00
mpl 03ca023b03 serverconfig: make the localdisk optional, so that 
s3 can be used as the primary blobserver.

Fixes http://code.google.com/p/camlistore/issues/detail?id=81

Change-Id: I12a7eb9a3dafc885eaaf14ba8da8716a6440416a
 2013-01-10 23:14:56 +01:00
Brad Fitzpatrick fb6c89a24f appengine: don't build contextpool except in appengine context 2013-01-10 13:13:27 -08:00
mpl 77d044f4b7 schema: add FileTime to guess the file 
creation time from potential file metadata.
camput: add the -exiftime option that allows
the use of the above for -filenodes and -vivify.

Fixes: http://code.google.com/p/camlistore/issues/detail?id=77

Change-Id: I05d1af3d875bb984e47e06775fd149e5ed0ed7b1
 2013-01-10 17:43:05 +01:00
Brad Fitzpatrick b013697e51 App Engine: the index works now, and everything seems to basically work! 
yay.

Change-Id: Ib6c7983de4a81decf16389b5883726830fc4d9db
 2013-01-09 14:45:00 -08:00
Brad Fitzpatrick bc61e17d16 App Engine: use proper types + noindex in storage handler 
Change-Id: I6f85086d89659b1cef9d9953627ff7e468b273e1
 2013-01-09 14:23:22 -08:00
Brad Fitzpatrick 5d0290e590 index: typo and more logging 
Change-Id: I814939ba7338eefb8ba919cada24feed8249d3dd
 2013-01-09 14:21:32 -08:00
Brad Fitzpatrick a4b2d8cf12 rename TODO 
Change-Id: I544c7bb2db76fd67200b9d00bb2c8ea15bb8042c
 2013-01-09 14:20:51 -08:00
Brad Fitzpatrick 94a478c117 App Engine: index: implement Delete 
Change-Id: I4ddf8656dd93094336d380cce9a92983baea502c
 2013-01-09 10:47:39 -08:00
Brad Fitzpatrick 31872f20f9 App Engine: use an Entity Group per namespace index 
Change-Id: I885b6093ff87f71cf032bf984eb2041f0705cf08
 2013-01-09 10:46:24 -08:00
mpl 67c5678062 Index directories with "fileinfo", and use this to 
find their name in a search request.

Fixes http://code.google.com/p/camlistore/issues/detail?id=79

Change-Id: I755afd8f52dbd2f8a48ba72bed0a6b0192d1dd71
 2013-01-09 16:59:04 +01:00
Brad Fitzpatrick 360f63a64b More App Engine index work. 
But fail: 2013/01/09 03:38:54 replica: receiving blob, 1 successes, 1 failures; last error = API error 1 (datastore_v3: BAD_REQUEST): ApplicationError: 1 operating on too many entity groups in a single transactio

See http://stackoverflow.com/questions/8251594/how-many-objects-is-too-many-for-in-a-single-transaction-to-googles-datastore

Sigh.

Change-Id: I90dff1b6bd40a00b4be19c5599583d2131b739d4
 2013-01-08 19:43:09 -08:00
Brad Fitzpatrick 2f188a1916 Fix JavaScript UI things I broke earlier when simplifying signing discovery 
Change-Id: Idf4effe3cbf97ec4ccb51197a0b3c857cb7c3569
 2013-01-08 19:40:27 -08:00
Brad Fitzpatrick e9acf32d48 App Engine: implement IndexStorage.Get 
Change-Id: I7f123df494f32f5f8a28bbd8e4d0aeb11aecce8b
 2013-01-08 18:49:54 -08:00
Brad Fitzpatrick f48cb8ff33 App Engine: ContextPool 
Change-Id: I8eb3116fc9a06d99a4d14850c8cbcc0bc61da26f
 2013-01-08 18:41:51 -08:00
Brad Fitzpatrick 7685c26751 gofmt 
Change-Id: I14f5c2129fb50c84ec3977049d1b8c1787636c65
 2013-01-08 18:41:06 -08:00
Brad Fitzpatrick 77f4faec7c App Engine: start of writing an IndexStorage impl for datastore. 
Change-Id: I03fb6be33b570fa56a4370f6ca86da6858490510
 2013-01-08 17:38:56 -08:00
Brad Fitzpatrick 99d7a93896 App Engine: remove a directory that is now just stutter 
Change-Id: Iee8847ef670b1dd192f3f05c55f22aab3d71ba95
 2013-01-08 16:47:20 -08:00
Brad Fitzpatrick 4eab9f29a6 App Engine: more ressurection work. gets further. 
Change-Id: I88a36eb637fe531e2666dea8dc6c94cc442804f8
 2013-01-08 16:29:40 -08:00
Brad Fitzpatrick 7b7af4c457 App Engine: compiles and kinda starts again; doesn't work. 
With SDK 1.7.4.

Change-Id: Ide16c990fc139e7f450cea508c74f13ed79aac21
 2013-01-07 17:20:48 -08:00
Brad Fitzpatrick be8836cad8 appengine: remove all the symlinks. 
No longer necessary as of Go App Engine SDK 1.7.4.

Change-Id: Ie724d31ce73fe034c4039dc9068077750b7175a5
 2013-01-07 16:49:25 -08:00
Brad Fitzpatrick c5df8cf7b6 get handler: still set content-type text/plain when it's a small all-utf-8 blob (for JSON metadata) 
Change-Id: I8a55bb44199c015515ea3aa46f912d8d5a472a5c
 2013-01-06 15:40:25 -08:00
Brad Fitzpatrick bdb54d7cef schema: various FileReader optimizations and bug fixes 
Now much faster.

Change-Id: I94920b7ab6903e986b045a6ed862eff0796a7f7e
 2013-01-06 10:50:41 -08:00
Brad Fitzpatrick d689b8df88 camget: say the cache dir if verbose 
Change-Id: Ic9e8fa9379e354d920e8c896fbcd4f3a861dfe20
 2013-01-06 10:44:50 -08:00
Brad Fitzpatrick c408e19ec4 httputil: more Transport timing stats 
Change-Id: I536d8f549e6cdbc0778c44943e770e4f0665c868
 2013-01-06 09:03:47 -08:00
Brad Fitzpatrick e95e6db11d schema: actually populate the superset cache map. whoops. 
Change-Id: I461c789bdf01a3341867faa30cac07e645c510e5
 2013-01-06 08:53:29 -08:00
Brad Fitzpatrick 3e5940a7ff camget, schema: read chunks more aggressively 
Change-Id: I31bc3a145fc2f3a51c3cecbaa33872da077e7bd7
 2013-01-05 23:12:42 -08:00
Brad Fitzpatrick c353994066 cacher: use singleflight 
Change-Id: I695753fac736b8abf54214deee506c20f3052b8b
 2013-01-05 22:51:33 -08:00
Brad Fitzpatrick a0b7d2e0b2 schema: use singleflight for FileReader superset loading 
Change-Id: Ia3db1a3521ea805440f6ceb884c4f4e6ed76f409
 2013-01-05 20:07:38 -08:00
Brad Fitzpatrick 056d1efb26 httputil: more Transport debugging 
Change-Id: If3ea30237abf8614d41bb340c24a65f7725234c2
 2013-01-05 17:17:56 -08:00
Brad Fitzpatrick 906388d91a get handler: remove old sniffing for demos which no longer works and makes things much slower 
Change-Id: I1d9e7368881894cba9a1febab6c5efcf765b0d59
 2013-01-05 17:17:38 -08:00
Brad Fitzpatrick ff9492c6cd camget: buffer the workc channel 
Change-Id: Ic6bf443c4d91f240b0b86c34a33bf74a1f2b627f
 2013-01-05 16:44:43 -08:00
Brad Fitzpatrick 9f6776dddb camget, httputil: more verbose HTTP debugging 
Change-Id: I2fc1a1fe0fff99202245d391a8a76e9fab07adc2
 2013-01-05 16:44:34 -08:00
Brad Fitzpatrick 6f9f0bdda9 singleflight: open soure this package. 
I wrote this for servers at Google but forgot I hadn't
open sourced it yet.  Maybe I should move this out of Camlistore
in the future, but putting it here for now.

Change-Id: I9120b2bc9c4a1be34d8166f00fb1933318db9783
 2013-01-05 16:23:53 -08:00
Brad Fitzpatrick 3cd8af2c7d schema: more incremental work on making FileReader faster 
Change-Id: I033df1654a062dfa57dfe0afce7030f605e88450
 2013-01-04 20:20:41 -08:00
Brad Fitzpatrick 7791d5bc27 Update template header's copyright date to 2013. 
Change-Id: I5c5ea1bb78473a23c622c4ce12af974e40001ffe
 2013-01-04 19:29:34 -08:00
Brad Fitzpatrick e8ab934464 schema: start of more efficient/aggressive file reading 
Change-Id: I027881c9844b0df3d70c1e05da69b04d853da883
 2013-01-04 18:11:40 -08:00
Brad Fitzpatrick 75a0361165 cacher: add missing error checks 
Change-Id: I4cd13d3c971d23b2ed226897928ec47dc698c366
 2013-01-04 17:05:20 -08:00