Rooba
/
perkeep
mirror of https://github.com/perkeep/perkeep.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,108 Commits 44 Branches 11 Tags 59 MiB
Commit Graph

412 Commits

Author SHA1 Message Date
Brad Fitzpatrick d304cb7a42 Merge "Implemented config file includes." 2011-07-01 20:34:12 +00:00
Brad Fitzpatrick 789ea237fc Merge "server: Support deleting paths." 2011-07-01 19:45:56 +00:00
Daniel Erat 80d4e8912a server: Support deleting paths. 
Add an "active" column to the indexer's path table and use
it to track deletion of path attributes.

Change-Id: I579d53a80302d0f7ecc51b5c49913cd23814ce73
 2011-07-01 19:45:03 +00:00
Brad Fitzpatrick eeeef01aff Start of some describe tests. 
Change-Id: Ie6d4c7cc2040113cca611a1a72bd6d2efd2dbbb7
 2011-07-01 12:38:00 -07:00
Brad Fitzpatrick 3040ca7d81 Start of search tests & an index fake. 
Change-Id: I890048878c269d6a569d1aff9bd1982280daab5f
 2011-07-01 12:00:10 -07:00
Brad Fitzpatrick 5ee34188f2 Revert bogus defer httputil.ReturnJson change. 
Change-Id: I92f2bf63ba86e6829e697f28417e02e72f681245
 2011-07-01 11:19:54 -07:00
Brad Fitzpatrick 68de472c53 More Describe work TODO notes 
Change-Id: Ibd7c3dfdf4d75ac54bc908e8e534a17040f2608a
 2011-06-30 16:25:18 -07:00
Brad Fitzpatrick 18b4f25b06 use defer httputil.ReturnJson 
Change-Id: I4b454b3b68c3be52ba26cd640c4ba1163b32ec0e
 2011-06-30 16:16:08 -07:00
Brad Fitzpatrick 1c014249e5 search: start of generalizing DescribeRequest 
... into a usable API inside Go land, not just JavaScript.

Change-Id: Ic47508047d3eebaf903c98b50b60e64d05112a0f
 2011-06-30 16:14:58 -07:00
Brad Fitzpatrick d572f898f7 search/publich: rename PathLookup to PathsLookup, add PathLookup 
Change-Id: If6804af2229885cfa22d67d608d17e600d7402f3
 2011-06-30 14:36:07 -07:00
Iain Peet 0ca7712691 Implemented config file includes. 
I've implemented the previously stubbed out "_file" config expression.  The root
JSON object of the included file becomes the value of the field.  In addition to
searching the CWD and the config dir, the include will search directories listed
in the CAMLI_INCLUDE_PATH environment variable.  The include path is useful
because it gives us the ability to have default configs in git which can be
overridden by custom configs which are provided in another path directory which
gets searched first.

I ended up working on this because, as I was thinking about how to approach
supporting Google Storage, I realized that we would need to have secrets in
includes; this would be a pain when combined with the current configs and
runscripts in GIT.  So, one thing lead to another, and now this is done.

Change-Id: Ib256859326dfceefed90d0fadf83a76adffd538b
 2011-06-30 14:21:26 -04:00
Brad Fitzpatrick 96cedf05db Update go. Fix struct tags. 
Change-Id: I08d05144dbd4c4a50474d05f1f4ecea67c3424e4
 2011-06-29 21:36:14 -07:00
Brad Fitzpatrick 15057eec02 Update to Go 8944 
Change-Id: I7940180cbe882884286e56ee4fc7bf5589aad9e0
 2011-06-29 21:13:03 -07:00
Brad Fitzpatrick a251f4064c search/publish: Add PathLook, wire up to publish handler. 
Change-Id: I8645c54adbc6d84c18ecc814ca1966113da32d85
 2011-06-27 18:42:00 -07:00
Brad Fitzpatrick 40739efa6b search + UI support for finding paths of a permanode 
Change-Id: Iae9cfed38660204cf7e85342cd951d542a7258a2
 2011-06-25 17:50:38 -07:00
Brad Fitzpatrick b2edc4a5f9 publishing work: index path mounts 
Change-Id: I9e6f273289f136fbbfa8565c24be250e28ae1a6e
 2011-06-24 18:50:00 -07:00
Brad Fitzpatrick 12abade62f Merge "lib/go/client/upload: make use of multipart writer in conjunction with io.pipe" 2011-06-24 02:02:13 +00:00
caine d4ff6f7932 lib/go/client/upload: make use of multipart writer in conjunction with io.pipe 
Change-Id: I5b56d340a80ab6b96730ece84aaa8002d785a73c
 2011-06-23 21:57:56 -04:00
Brad Fitzpatrick 23ff0a071f publish work: optionally create publish root permanodes+claims on start 
Change-Id: I8659e977cea8872443ff2b311a7d0d8a2804c269
 2011-06-23 12:12:37 -07:00
Julien Danjou 494d57cb4a Use auth.SendUnauthorized() to really request auth 
Local function sendUnauthorized does not send all the header like
WWW-Authenticate, therefore browser do not propose a popup.
auth.SendUnauthorized is more complete in this regard.

Change-Id: Icef0a41394883e9606cab2557482bfa5b7b995ec
Signed-off-by: Julien Danjou <julien@danjou.info>
 2011-06-23 17:44:08 +02:00
Julien Danjou d6aaafa9c3 Fix return code in RequestEntityTooLargeError 
Change-Id: Ic7fb562ba58e6807b4c2561d2a506ca02afa8c2b
Signed-off-by: Julien Danjou <julien@danjou.info>
 2011-06-23 17:44:08 +02:00
Brad Fitzpatrick 5b2ae24c69 search: add signerattrvalue handler, for publishing 
Change-Id: I623570a719d4d713e0754d20064973de73a7241b
 2011-06-22 22:21:18 -07:00
Brad Fitzpatrick 1f39a91eee Relegate camli/search to camli/search/recent 
Change-Id: I7f76db980fe1788a6d0ac556e8176bc83cd6828f
 2011-06-22 21:59:17 -07:00
Brad Fitzpatrick 4b0f04257f mysqlindexer: implement PermanodeOfSignerAttrValue for publishing 
This was Brett's magical pony interface. Done.

Change-Id: Ifed76ca703ee3ec413dee39078c665d351a55e63
 2011-06-22 20:24:16 -07:00
Brad Fitzpatrick 1f8723d30b mysqlindexer: keep map of gpg public key blobref -> keyid 
Change-Id: I90f40d23bdaacf30f02e1ae20f17ec7844623e51
 2011-06-22 18:58:06 -07:00
Brad Fitzpatrick 374872e002 mysqlindex: verify claims; add to signerattrvalue table 
Change-Id: I44d6d6a6defe972c1a7dab9f8d39217704a809cc
 2011-06-22 18:08:07 -07:00
Brad Fitzpatrick a49ffa1239 jsonsign: comment updates 
Change-Id: I32ca3fc47b7f2ee4208aa69b05cf3cd1fcc57696
 2011-06-22 18:04:20 -07:00
Brad Fitzpatrick 81cc07f564 update for Go change 
Change-Id: Ibe1507e8cf3f9d1f8196201739e9c74a9b9d8e0a
 2011-06-22 15:38:03 -07:00
Brad Fitzpatrick a56420c984 mysqlindexer: use receiver for populate methods 
Change-Id: If2cbaee7acd86db837d1ca6c31aeee6a97be67e5
 2011-06-19 14:54:57 -07:00
Brad Fitzpatrick 6ca4b975f7 Work on search/index/schema of PermanodeOfSignerAttrValue 
Change-Id: I8c0c75ae8e4a62717ab69246f535b3fd5d594c47
 2011-06-19 14:52:11 -07:00
Brad Fitzpatrick 30adc073f5 Version the mysql db schemas; warn on startup if wrong with tip to fix. 
Change-Id: I3bc881bc5b078062bc96f80dec1e8f9ac71ece61
 2011-06-19 14:36:46 -07:00
Brad Fitzpatrick d8f7bc9d98 jsonconfig: add OptionalList 
Change-Id: I51bd6a785e47ddeca7b2ddd23c4665f61ef1d099
 2011-06-19 13:09:05 -07:00
Brad Fitzpatrick bd15b4a4c2 Serve UI files from binary's embedded copy. 
Change-Id: Ibb7902381f80111c943897e82e1eaa2b0ee7fc2c
 2011-06-18 12:01:34 -07:00
Brad Fitzpatrick 81547a9eb6 Support for embedding static files (html/js) into the resulting binary. 
Also build system changes for start of move to camlistore.org/* namespace
for Go packages.

Not yet wired up to ui.go.

Potential changes required for Go's http package first:
http://codereview.appspot.com/4629047/

Change-Id: I3ae264a5401d3a41e0b6e42b12010f19a9c9dcf7
 2011-06-17 14:13:01 -07:00
Brett Slatkin 58bb35939e beginning of setting URL mount points for permanodes; nothing working yet 
Change-Id: I9c33d67121e101369cdd797ef3b1c0ef74c8bdb0
 2011-06-16 21:24:59 -07:00
Brad Fitzpatrick 0d7581ede6 Start of publish handler. 
Change-Id: I229c9e00a19aa985050373beda696c5468a94105
 2011-06-16 20:48:06 -07:00
Brad Fitzpatrick 8f38212408 Update for gofix httpheaders 2011-06-16 18:38:21 -07:00
Brad Fitzpatrick a170c567a3 Merge "auth: add SendUnauthorized" 2011-06-15 08:38:14 -07:00
Brad Fitzpatrick 6b77e2dd57 Merge "httputil: add ForbiddenError and RequestEntityTooLargeError" 2011-06-15 08:37:18 -07:00
Julien Danjou b07e7f61b3 auth: add SendUnauthorized 
Change-Id: I6bf97fee5097af56dfa4b1d1cd1157f5e15d08e5
Signed-off-by: Julien Danjou <julien@danjou.info>
 2011-06-15 11:48:36 +02:00
Julien Danjou 310e0474be httputil: add ForbiddenError and RequestEntityTooLargeError 
Change-Id: Ie013c2b79bd75b3c1ba14f94b334bb009b61c4d3
Signed-off-by: Julien Danjou <julien@danjou.info>
 2011-06-15 11:48:28 +02:00
mpl 34c776c81c thumbnail support 
Change-Id: Ie0ee67ce278c1d9790c43a9270fc909dd6e68923
 2011-06-15 10:42:18 +02:00
Brad Fitzpatrick 20c4ef7154 search / file work 2011-06-12 00:20:57 -07:00
Brad Fitzpatrick 72c4a42d06 more jpeg sniffing 2011-06-12 00:13:06 -07:00
Brad Fitzpatrick 2086b96993 errorText to error 2011-06-11 20:10:10 -07:00
Brad Fitzpatrick 691273a284 index more about files: filename, properties set, mime type 2011-06-11 10:55:35 -07:00
Brad Fitzpatrick 42d80271d8 show children in describe 2011-06-11 10:12:39 -07:00
Brad Fitzpatrick 60e3fa2574 more content -> camliContent cleanup 2011-06-11 09:51:08 -07:00
Brad Fitzpatrick d2b9f80a03 send error response JSON 2011-06-11 09:30:01 -07:00
Brad Fitzpatrick 179b706248 don't promote camliContent attr, make member be camliMember 2011-06-11 00:27:17 -07:00
Brad Fitzpatrick 3c6c4207be download handler: support for verifying a digest in a HEAD request 
for use in javascript uploads.
 2011-06-09 18:33:26 -07:00
Brad Fitzpatrick 6f35e66385 let file reader be closed 2011-06-09 18:28:07 -07:00
Brad Fitzpatrick bdfde0a5fe Advertise the dev server password in the realm. 2011-06-09 16:09:21 -07:00
Brad Fitzpatrick 0ada583435 UI: js file upload work 2011-06-09 15:00:20 -07:00
Brad Fitzpatrick 3b3b682c1e Search interface + impl to find file schema refs by their content ref 2011-06-09 12:55:38 -07:00
Brad Fitzpatrick e5acdb2e38 send 400 or 500 with some json replies 2011-06-09 12:54:53 -07:00
Brad Fitzpatrick 97978b56d4 don't retry forever indexing files. 2011-06-08 18:56:56 -07:00
Brad Fitzpatrick c61317703c indexer: index file sha1s, sizes (for js search lookup later) 2011-06-08 18:26:57 -07:00
Brad Fitzpatrick fa3715134a Start of indexer indexing file schema's content digests. 2011-06-08 17:49:31 -07:00
Brad Fitzpatrick a4c43c359f Add blobref.SeekerFromStreamingFetcher, moving it from UI code. 2011-06-08 17:48:56 -07:00
Brad Fitzpatrick f31959c24c Update for Go: use http.Values 2011-06-08 13:41:39 -07:00
Brad Fitzpatrick d65fc1391a schema & blobref: implement JSON [Un]Marshal interfaces, clean up code 2011-06-07 17:00:21 -07:00
caine tighe 1fabcfbeb0 osutil/paths.go : update for windows support 2011-06-07 16:25:44 -04:00
Brad Fitzpatrick 1f0aec0612 rollsum: add a benchmark, and more attribution 2011-06-06 19:09:58 -07:00
Brad Fitzpatrick 39ac2c072e schema: filereader support for hash tree files. 2011-06-06 13:30:54 -07:00
Brad Fitzpatrick 319a12f982 schema/filereader: support zero regions, start of subfile support 2011-06-06 11:31:45 -07:00
Brad Fitzpatrick fac6b7f020 schema filewriter: rollsum chunking version 2011-06-06 08:54:31 -07:00
Brad Fitzpatrick 5f86c64b95 schema filereader: verify top-level size matches part sizes when reading 2011-06-06 08:50:20 -07:00
Brad Fitzpatrick 8ab1532a15 rollsum: OnSplit, Bits. add camput debug mode for it. 2011-06-04 16:14:33 -07:00
Brad Fitzpatrick 742051f813 rollsum: Port of apenwarr's bar rollsum to Go. 2011-06-04 12:00:53 -07:00
Brad Fitzpatrick 1ed6a4a50c search: remove dup attributes 2011-06-04 10:18:38 -07:00
Brad Fitzpatrick 8d84a4de10 Add blobref.SeekTester interface; fixing UI downloads from cond storage. 2011-06-04 09:58:50 -07:00
Brad Fitzpatrick b652dc62e8 make CachingFetcher also a StreamingFetcher 2011-06-04 09:12:02 -07:00
Brad Fitzpatrick 59e577c023 Rename blobref.Fetcher to blobref.SeekFetcher 2011-06-04 08:56:03 -07:00
Brad Fitzpatrick 0df00167ec cond: implement it (routing incoming blobs) and use it. 2011-06-04 08:46:42 -07:00
Brad Fitzpatrick 0a7752afe5 jsonconfig: RequiredStringOrObject, OptionalStringOrObject 2011-06-04 08:45:03 -07:00
Brad Fitzpatrick c6cfe2fda4 Start of 'cond' handler. 2011-06-03 21:52:56 -07:00
Brad Fitzpatrick 811f75954a magic: add a fake text/ mime type for public keys 2011-06-03 18:41:26 -07:00
Brad Fitzpatrick 9f2daec131 UI/search: show all claims for a permanode 2011-06-03 15:23:23 -07:00
Brad Fitzpatrick b28ae35c35 UI: deleting tags 2011-06-03 14:16:00 -07:00
Brad Fitzpatrick 2db013a3b4 Add a dev-pass-camput script, improve error messages. 2011-06-02 16:57:49 -07:00
Brad Fitzpatrick 9b3280ce10 Update to new Go exec API 2011-06-02 16:47:40 -07:00
Brad Fitzpatrick 5725dbaf75 Fix localdisk queue error on dup uploads. 2011-05-31 18:58:58 -07:00
Brad Fitzpatrick 0dfc7a5770 Fix a performance TODO in schema.FileReader 2011-05-31 10:35:45 -07:00
Brad Fitzpatrick 2da1ef4093 UI: file download support 2011-05-31 10:20:28 -07:00
Brad Fitzpatrick 2c66ab38ad whoops, was using offset wrong in filewriter 2011-05-30 19:24:19 -07:00
Brad Fitzpatrick ae221c0712 Fighting GoMySQL library; see https://groups.google.com/group/gomysql/browse_thread/thread/594ffd08c6370261 2011-05-30 18:10:13 -07:00
Brad Fitzpatrick 7de40d3b5c more mysql paranoia 2011-05-30 17:20:15 -07:00
Brad Fitzpatrick 335f3187a8 blob info page 2011-05-30 16:41:56 -07:00
Brad Fitzpatrick a3dc3f3ad7 close stmt on exit? 2011-05-30 16:39:56 -07:00
Brad Fitzpatrick 1c6470b3b3 Search: add a describe handler for javascript UI 2011-05-30 15:44:25 -07:00
Brad Fitzpatrick 4e08e4805f Move some key stuff from camlistored to jsonsign, use from camput. 2011-05-30 12:38:26 -07:00
Brad Fitzpatrick 10c3ec682c convert search to use handler registry 2011-05-29 22:52:31 -07:00
Brad Fitzpatrick c4fa4d25b4 Protocol change: remove some upload restrictions that were only for App Engine. 
Now effective SHOULDs.  Not changing the spec yet, though.  Need to fix App Engine python impl.
 2011-05-29 21:39:51 -07:00
Brad Fitzpatrick 884e8a63ea fix WriteFileFromReader bug when chunks already exist. 2011-05-29 18:22:56 -07:00
Brad Fitzpatrick f9b879d3bf Add schema.WriteFileFromReader and use it in UI upload helper 2011-05-29 10:50:17 -07:00
Brad Fitzpatrick 90405dc424 schema: PopulateRegularFileMap take just size, not FileInfo, add NewCommonFilenameMap 2011-05-29 10:39:41 -07:00
Brad Fitzpatrick 5ea8b64217 client: Use blobref.Sha1FromString 2011-05-29 10:38:53 -07:00
Brad Fitzpatrick f4512d3c6c blobref: add Sha1FromString helper and SizedBlobRef Equal/String 2011-05-29 10:38:21 -07:00
Brad Fitzpatrick eb0bf1e3d1 schema: move FileReader to its own file 2011-05-26 16:46:27 -07:00