Rooba
/
perkeep
mirror of https://github.com/perkeep/perkeep.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
7,017 Commits 44 Branches 11 Tags 59 MiB
Commit Graph

583 Commits

Author SHA1 Message Date
Brad Fitzpatrick f91404ecfc Update gomemcache in third_party. 
Change-Id: Ide78f9528c1327fd91a681595429eb0ebdffacf0
 2011-07-03 16:13:44 -07:00
Brad Fitzpatrick 3e792ae70b Permit updating a subset of third_party. 
Change-Id: Iccb3b8ed7f6baed3c9494b86bbdba9d39bd368d7
 2011-07-03 16:13:35 -07:00
Brad Fitzpatrick 2c126a4841 Photo gallery thumbnails. 
Change-Id: I71a628057ff790928e96909512e43d2997a76f85
 2011-07-03 13:33:56 -07:00
Brad Fitzpatrick 182a058232 publish: serve subresource files (e.g. gallery members), with access control 
Change-Id: I9f91b596b145c83bb026ba93becb5174480acadc
 2011-07-03 12:28:39 -07:00
Brad Fitzpatrick 78078701d0 publish: start of file resource downloads, later thumbnails. 
Change-Id: Ida5b009c11d359887edad7612aeec5dab96447e4
 2011-07-02 23:32:42 -07:00
Brad Fitzpatrick 6179e508e3 publish: show title, members, include javascript blob metadata 
start of awesomeness.

Change-Id: I45d63b04fa223b9aafceb9452b179e4ddc52bce5
 2011-07-02 17:16:30 -07:00
Brad Fitzpatrick e55f01d3ea GoMySQL third_party git update. 
Change-Id: I49f87a1f474af835d06104fbffa759468cf1daf9
 2011-07-02 09:57:11 -07:00
Brad Fitzpatrick 0020e785b4 Add gomemcache to third_party. 
Change-Id: Id2a33229da783521f875c6a5e2a9d219dbbc6b59
 2011-07-02 09:56:50 -07:00
Brad Fitzpatrick 024e801ca7 gofmt the whole tree 
Change-Id: Ic1b3dd12a4ede83b299dcf51f342e72d4f8700da
 2011-07-02 09:09:50 -07:00
Brad Fitzpatrick 91ec88b7bd Add GetTaggedPermanodes to FakeIndex for testing. 
Change-Id: I6b70a298efecb5e577027e0c5e6cf435af33c2b4
 2011-07-02 09:06:15 -07:00
mpl 05c18e873e search for permanodes with the given tag(s) 
Change-Id: Ibbe0163da522698c253615a26d4201a7e28348de
 2011-07-02 17:16:19 +02:00
Brad Fitzpatrick f0470c4d8f search: add docs, DescribeError, Result 
Change-Id: I8c891fd2832da3f49e653288fded2a7bd2f7fd2c
 2011-07-01 19:36:22 -07:00
Brad Fitzpatrick 13b9ebcd0e Use os.Remove, not syscall 
Change-Id: I60cda72e8d48fb3c9de7770c1affe23fc96c1f10
 2011-07-01 14:36:48 -07:00
Brad Fitzpatrick 7e633e48f2 Merge branch 'master' of ssh://camlistore.org:29418/camlistore 2011-07-01 14:33:43 -07:00
Brad Fitzpatrick 981f7d88a8 Describe cleanup + more search/index tests. 
Change-Id: Ia7b6e83966c5c9481400f88495fe7fd518be2f77
 2011-07-01 14:33:15 -07:00
Brad Fitzpatrick d304cb7a42 Merge "Implemented config file includes." 2011-07-01 20:34:12 +00:00
Brad Fitzpatrick 789ea237fc Merge "server: Support deleting paths." 2011-07-01 19:45:56 +00:00
Daniel Erat 80d4e8912a server: Support deleting paths. 
Add an "active" column to the indexer's path table and use
it to track deletion of path attributes.

Change-Id: I579d53a80302d0f7ecc51b5c49913cd23814ce73
 2011-07-01 19:45:03 +00:00
Brad Fitzpatrick eeeef01aff Start of some describe tests. 
Change-Id: Ie6d4c7cc2040113cca611a1a72bd6d2efd2dbbb7
 2011-07-01 12:38:00 -07:00
Brad Fitzpatrick 3040ca7d81 Start of search tests & an index fake. 
Change-Id: I890048878c269d6a569d1aff9bd1982280daab5f
 2011-07-01 12:00:10 -07:00
Brad Fitzpatrick 5ee34188f2 Revert bogus defer httputil.ReturnJson change. 
Change-Id: I92f2bf63ba86e6829e697f28417e02e72f681245
 2011-07-01 11:19:54 -07:00
Brad Fitzpatrick 68de472c53 More Describe work TODO notes 
Change-Id: Ibd7c3dfdf4d75ac54bc908e8e534a17040f2608a
 2011-06-30 16:25:18 -07:00
Brad Fitzpatrick 18b4f25b06 use defer httputil.ReturnJson 
Change-Id: I4b454b3b68c3be52ba26cd640c4ba1163b32ec0e
 2011-06-30 16:16:08 -07:00
Brad Fitzpatrick 1c014249e5 search: start of generalizing DescribeRequest 
... into a usable API inside Go land, not just JavaScript.

Change-Id: Ic47508047d3eebaf903c98b50b60e64d05112a0f
 2011-06-30 16:14:58 -07:00
Brad Fitzpatrick d572f898f7 search/publich: rename PathLookup to PathsLookup, add PathLookup 
Change-Id: If6804af2229885cfa22d67d608d17e600d7402f3
 2011-06-30 14:36:07 -07:00
Iain Peet 0ca7712691 Implemented config file includes. 
I've implemented the previously stubbed out "_file" config expression.  The root
JSON object of the included file becomes the value of the field.  In addition to
searching the CWD and the config dir, the include will search directories listed
in the CAMLI_INCLUDE_PATH environment variable.  The include path is useful
because it gives us the ability to have default configs in git which can be
overridden by custom configs which are provided in another path directory which
gets searched first.

I ended up working on this because, as I was thinking about how to approach
supporting Google Storage, I realized that we would need to have secrets in
includes; this would be a pain when combined with the current configs and
runscripts in GIT.  So, one thing lead to another, and now this is done.

Change-Id: Ib256859326dfceefed90d0fadf83a76adffd538b
 2011-06-30 14:21:26 -04:00
Brad Fitzpatrick 96cedf05db Update go. Fix struct tags. 
Change-Id: I08d05144dbd4c4a50474d05f1f4ecea67c3424e4
 2011-06-29 21:36:14 -07:00
Brad Fitzpatrick 15057eec02 Update to Go 8944 
Change-Id: I7940180cbe882884286e56ee4fc7bf5589aad9e0
 2011-06-29 21:13:03 -07:00
Brad Fitzpatrick a251f4064c search/publish: Add PathLook, wire up to publish handler. 
Change-Id: I8645c54adbc6d84c18ecc814ca1966113da32d85
 2011-06-27 18:42:00 -07:00
Brad Fitzpatrick 40739efa6b search + UI support for finding paths of a permanode 
Change-Id: Iae9cfed38660204cf7e85342cd951d542a7258a2
 2011-06-25 17:50:38 -07:00
Brad Fitzpatrick b2edc4a5f9 publishing work: index path mounts 
Change-Id: I9e6f273289f136fbbfa8565c24be250e28ae1a6e
 2011-06-24 18:50:00 -07:00
Brad Fitzpatrick 12abade62f Merge "lib/go/client/upload: make use of multipart writer in conjunction with io.pipe" 2011-06-24 02:02:13 +00:00
caine d4ff6f7932 lib/go/client/upload: make use of multipart writer in conjunction with io.pipe 
Change-Id: I5b56d340a80ab6b96730ece84aaa8002d785a73c
 2011-06-23 21:57:56 -04:00
Brad Fitzpatrick 23ff0a071f publish work: optionally create publish root permanodes+claims on start 
Change-Id: I8659e977cea8872443ff2b311a7d0d8a2804c269
 2011-06-23 12:12:37 -07:00
Julien Danjou 494d57cb4a Use auth.SendUnauthorized() to really request auth 
Local function sendUnauthorized does not send all the header like
WWW-Authenticate, therefore browser do not propose a popup.
auth.SendUnauthorized is more complete in this regard.

Change-Id: Icef0a41394883e9606cab2557482bfa5b7b995ec
Signed-off-by: Julien Danjou <julien@danjou.info>
 2011-06-23 17:44:08 +02:00
Julien Danjou d6aaafa9c3 Fix return code in RequestEntityTooLargeError 
Change-Id: Ic7fb562ba58e6807b4c2561d2a506ca02afa8c2b
Signed-off-by: Julien Danjou <julien@danjou.info>
 2011-06-23 17:44:08 +02:00
Brad Fitzpatrick 5b2ae24c69 search: add signerattrvalue handler, for publishing 
Change-Id: I623570a719d4d713e0754d20064973de73a7241b
 2011-06-22 22:21:18 -07:00
Brad Fitzpatrick 1f39a91eee Relegate camli/search to camli/search/recent 
Change-Id: I7f76db980fe1788a6d0ac556e8176bc83cd6828f
 2011-06-22 21:59:17 -07:00
Brad Fitzpatrick 4b0f04257f mysqlindexer: implement PermanodeOfSignerAttrValue for publishing 
This was Brett's magical pony interface. Done.

Change-Id: Ifed76ca703ee3ec413dee39078c665d351a55e63
 2011-06-22 20:24:16 -07:00
Brad Fitzpatrick 1f8723d30b mysqlindexer: keep map of gpg public key blobref -> keyid 
Change-Id: I90f40d23bdaacf30f02e1ae20f17ec7844623e51
 2011-06-22 18:58:06 -07:00
Brad Fitzpatrick 374872e002 mysqlindex: verify claims; add to signerattrvalue table 
Change-Id: I44d6d6a6defe972c1a7dab9f8d39217704a809cc
 2011-06-22 18:08:07 -07:00
Brad Fitzpatrick a49ffa1239 jsonsign: comment updates 
Change-Id: I32ca3fc47b7f2ee4208aa69b05cf3cd1fcc57696
 2011-06-22 18:04:20 -07:00
Brad Fitzpatrick 81cc07f564 update for Go change 
Change-Id: Ibe1507e8cf3f9d1f8196201739e9c74a9b9d8e0a
 2011-06-22 15:38:03 -07:00
Brad Fitzpatrick a56420c984 mysqlindexer: use receiver for populate methods 
Change-Id: If2cbaee7acd86db837d1ca6c31aeee6a97be67e5
 2011-06-19 14:54:57 -07:00
Brad Fitzpatrick 6ca4b975f7 Work on search/index/schema of PermanodeOfSignerAttrValue 
Change-Id: I8c0c75ae8e4a62717ab69246f535b3fd5d594c47
 2011-06-19 14:52:11 -07:00
Brad Fitzpatrick 30adc073f5 Version the mysql db schemas; warn on startup if wrong with tip to fix. 
Change-Id: I3bc881bc5b078062bc96f80dec1e8f9ac71ece61
 2011-06-19 14:36:46 -07:00
Brad Fitzpatrick d8f7bc9d98 jsonconfig: add OptionalList 
Change-Id: I51bd6a785e47ddeca7b2ddd23c4665f61ef1d099
 2011-06-19 13:09:05 -07:00
Brad Fitzpatrick bd15b4a4c2 Serve UI files from binary's embedded copy. 
Change-Id: Ibb7902381f80111c943897e82e1eaa2b0ee7fc2c
 2011-06-18 12:01:34 -07:00
Brad Fitzpatrick 81547a9eb6 Support for embedding static files (html/js) into the resulting binary. 
Also build system changes for start of move to camlistore.org/* namespace
for Go packages.

Not yet wired up to ui.go.

Potential changes required for Go's http package first:
http://codereview.appspot.com/4629047/

Change-Id: I3ae264a5401d3a41e0b6e42b12010f19a9c9dcf7
 2011-06-17 14:13:01 -07:00
Brett Slatkin 58bb35939e beginning of setting URL mount points for permanodes; nothing working yet 
Change-Id: I9c33d67121e101369cdd797ef3b1c0ef74c8bdb0
 2011-06-16 21:24:59 -07:00
Brad Fitzpatrick 0d7581ede6 Start of publish handler. 
Change-Id: I229c9e00a19aa985050373beda696c5468a94105
 2011-06-16 20:48:06 -07:00
Brad Fitzpatrick 8f38212408 Update for gofix httpheaders 2011-06-16 18:38:21 -07:00
Brad Fitzpatrick a170c567a3 Merge "auth: add SendUnauthorized" 2011-06-15 08:38:14 -07:00
Brad Fitzpatrick 6b77e2dd57 Merge "httputil: add ForbiddenError and RequestEntityTooLargeError" 2011-06-15 08:37:18 -07:00
Julien Danjou b07e7f61b3 auth: add SendUnauthorized 
Change-Id: I6bf97fee5097af56dfa4b1d1cd1157f5e15d08e5
Signed-off-by: Julien Danjou <julien@danjou.info>
 2011-06-15 11:48:36 +02:00
Julien Danjou 310e0474be httputil: add ForbiddenError and RequestEntityTooLargeError 
Change-Id: Ie013c2b79bd75b3c1ba14f94b334bb009b61c4d3
Signed-off-by: Julien Danjou <julien@danjou.info>
 2011-06-15 11:48:28 +02:00
mpl 34c776c81c thumbnail support 
Change-Id: Ie0ee67ce278c1d9790c43a9270fc909dd6e68923
 2011-06-15 10:42:18 +02:00
Brad Fitzpatrick 20c4ef7154 search / file work 2011-06-12 00:20:57 -07:00
Brad Fitzpatrick 72c4a42d06 more jpeg sniffing 2011-06-12 00:13:06 -07:00
Brad Fitzpatrick 2086b96993 errorText to error 2011-06-11 20:10:10 -07:00
Brad Fitzpatrick 691273a284 index more about files: filename, properties set, mime type 2011-06-11 10:55:35 -07:00
Brad Fitzpatrick 42d80271d8 show children in describe 2011-06-11 10:12:39 -07:00
Brad Fitzpatrick 60e3fa2574 more content -> camliContent cleanup 2011-06-11 09:51:08 -07:00
Brad Fitzpatrick d2b9f80a03 send error response JSON 2011-06-11 09:30:01 -07:00
Brad Fitzpatrick 179b706248 don't promote camliContent attr, make member be camliMember 2011-06-11 00:27:17 -07:00
Brad Fitzpatrick 3c6c4207be download handler: support for verifying a digest in a HEAD request 
for use in javascript uploads.
 2011-06-09 18:33:26 -07:00
Brad Fitzpatrick 6f35e66385 let file reader be closed 2011-06-09 18:28:07 -07:00
Brad Fitzpatrick bdfde0a5fe Advertise the dev server password in the realm. 2011-06-09 16:09:21 -07:00
Brad Fitzpatrick 0ada583435 UI: js file upload work 2011-06-09 15:00:20 -07:00
Brad Fitzpatrick 3b3b682c1e Search interface + impl to find file schema refs by their content ref 2011-06-09 12:55:38 -07:00
Brad Fitzpatrick e5acdb2e38 send 400 or 500 with some json replies 2011-06-09 12:54:53 -07:00
Brad Fitzpatrick 97978b56d4 don't retry forever indexing files. 2011-06-08 18:56:56 -07:00
Brad Fitzpatrick c61317703c indexer: index file sha1s, sizes (for js search lookup later) 2011-06-08 18:26:57 -07:00
Brad Fitzpatrick fa3715134a Start of indexer indexing file schema's content digests. 2011-06-08 17:49:31 -07:00
Brad Fitzpatrick a4c43c359f Add blobref.SeekerFromStreamingFetcher, moving it from UI code. 2011-06-08 17:48:56 -07:00
Brad Fitzpatrick f31959c24c Update for Go: use http.Values 2011-06-08 13:41:39 -07:00
Brad Fitzpatrick d65fc1391a schema & blobref: implement JSON [Un]Marshal interfaces, clean up code 2011-06-07 17:00:21 -07:00
caine tighe 1fabcfbeb0 osutil/paths.go : update for windows support 2011-06-07 16:25:44 -04:00
Brad Fitzpatrick 1f0aec0612 rollsum: add a benchmark, and more attribution 2011-06-06 19:09:58 -07:00
Brad Fitzpatrick 39ac2c072e schema: filereader support for hash tree files. 2011-06-06 13:30:54 -07:00
Brad Fitzpatrick 319a12f982 schema/filereader: support zero regions, start of subfile support 2011-06-06 11:31:45 -07:00
Brad Fitzpatrick fac6b7f020 schema filewriter: rollsum chunking version 2011-06-06 08:54:31 -07:00
Brad Fitzpatrick 5f86c64b95 schema filereader: verify top-level size matches part sizes when reading 2011-06-06 08:50:20 -07:00
Brad Fitzpatrick 8ab1532a15 rollsum: OnSplit, Bits. add camput debug mode for it. 2011-06-04 16:14:33 -07:00
Brad Fitzpatrick 742051f813 rollsum: Port of apenwarr's bar rollsum to Go. 2011-06-04 12:00:53 -07:00
Brad Fitzpatrick 1ed6a4a50c search: remove dup attributes 2011-06-04 10:18:38 -07:00
Brad Fitzpatrick 8d84a4de10 Add blobref.SeekTester interface; fixing UI downloads from cond storage. 2011-06-04 09:58:50 -07:00
Brad Fitzpatrick b652dc62e8 make CachingFetcher also a StreamingFetcher 2011-06-04 09:12:02 -07:00
Brad Fitzpatrick 59e577c023 Rename blobref.Fetcher to blobref.SeekFetcher 2011-06-04 08:56:03 -07:00
Brad Fitzpatrick 0df00167ec cond: implement it (routing incoming blobs) and use it. 2011-06-04 08:46:42 -07:00
Brad Fitzpatrick 0a7752afe5 jsonconfig: RequiredStringOrObject, OptionalStringOrObject 2011-06-04 08:45:03 -07:00
Brad Fitzpatrick c6cfe2fda4 Start of 'cond' handler. 2011-06-03 21:52:56 -07:00
Brad Fitzpatrick 811f75954a magic: add a fake text/ mime type for public keys 2011-06-03 18:41:26 -07:00
Brad Fitzpatrick 9f2daec131 UI/search: show all claims for a permanode 2011-06-03 15:23:23 -07:00
Brad Fitzpatrick b28ae35c35 UI: deleting tags 2011-06-03 14:16:00 -07:00
Brad Fitzpatrick 2db013a3b4 Add a dev-pass-camput script, improve error messages. 2011-06-02 16:57:49 -07:00
Brad Fitzpatrick 9b3280ce10 Update to new Go exec API 2011-06-02 16:47:40 -07:00
Brad Fitzpatrick 5725dbaf75 Fix localdisk queue error on dup uploads. 2011-05-31 18:58:58 -07:00
Brad Fitzpatrick 0dfc7a5770 Fix a performance TODO in schema.FileReader 2011-05-31 10:35:45 -07:00
Brad Fitzpatrick 2da1ef4093 UI: file download support 2011-05-31 10:20:28 -07:00
Brad Fitzpatrick 2c66ab38ad whoops, was using offset wrong in filewriter 2011-05-30 19:24:19 -07:00
Brad Fitzpatrick ae221c0712 Fighting GoMySQL library; see https://groups.google.com/group/gomysql/browse_thread/thread/594ffd08c6370261 2011-05-30 18:10:13 -07:00
Brad Fitzpatrick 7de40d3b5c more mysql paranoia 2011-05-30 17:20:15 -07:00
Brad Fitzpatrick 335f3187a8 blob info page 2011-05-30 16:41:56 -07:00
Brad Fitzpatrick a3dc3f3ad7 close stmt on exit? 2011-05-30 16:39:56 -07:00
Brad Fitzpatrick 1c6470b3b3 Search: add a describe handler for javascript UI 2011-05-30 15:44:25 -07:00
Brad Fitzpatrick 4e08e4805f Move some key stuff from camlistored to jsonsign, use from camput. 2011-05-30 12:38:26 -07:00
Brad Fitzpatrick 10c3ec682c convert search to use handler registry 2011-05-29 22:52:31 -07:00
Brad Fitzpatrick c4fa4d25b4 Protocol change: remove some upload restrictions that were only for App Engine. 
Now effective SHOULDs.  Not changing the spec yet, though.  Need to fix App Engine python impl.
 2011-05-29 21:39:51 -07:00
Brad Fitzpatrick 884e8a63ea fix WriteFileFromReader bug when chunks already exist. 2011-05-29 18:22:56 -07:00
Brad Fitzpatrick f9b879d3bf Add schema.WriteFileFromReader and use it in UI upload helper 2011-05-29 10:50:17 -07:00
Brad Fitzpatrick 90405dc424 schema: PopulateRegularFileMap take just size, not FileInfo, add NewCommonFilenameMap 2011-05-29 10:39:41 -07:00
Brad Fitzpatrick 5ea8b64217 client: Use blobref.Sha1FromString 2011-05-29 10:38:53 -07:00
Brad Fitzpatrick f4512d3c6c blobref: add Sha1FromString helper and SizedBlobRef Equal/String 2011-05-29 10:38:21 -07:00
Brad Fitzpatrick eb0bf1e3d1 schema: move FileReader to its own file 2011-05-26 16:46:27 -07:00
Brad Fitzpatrick 50abe93da6 gofmt on camput and little style things 2011-05-26 16:41:49 -07:00
Brad Fitzpatrick 4317da0308 camlistored: convert ui, root, jsonsign to use handler registry 2011-05-26 07:34:39 -07:00
Brad Fitzpatrick 9ad7346474 blobserver registry: finish RegisterHandlerConstructor stuff 
going to use it now.
 2011-05-25 22:15:55 -07:00
Brad Fitzpatrick 513b594dbc replica: notify blob hub 2011-05-22 21:23:23 -07:00
Brad Fitzpatrick ccf33926c8 Replica blob handler for live replication. 2011-05-22 21:22:21 -07:00
Brad Fitzpatrick 11c959caab jsonconfig: clean up duplication, add Optiona/RequiredInt 2011-05-22 21:20:54 -07:00
Brad Fitzpatrick 9e7233bd4c shard: notify hub when file received. 2011-05-22 16:02:44 -07:00
Brad Fitzpatrick 7fb3c5a5e1 Implement MergedEnumerate; finishes shard handler. 2011-05-22 12:39:54 -07:00
Brad Fitzpatrick 3765151953 Move ChanPeeker into blobref pkg. Need it elsewhere. 2011-05-22 12:38:50 -07:00
Brad Fitzpatrick 21797e2150 Make shard Enumerate use new blobserver.MergedEnumerated; not yet implemented. 
Will need for replica target too.
 2011-05-21 18:19:37 -07:00
Brad Fitzpatrick 941ac98281 Shard handler implementation, except for enumerate. 2011-05-21 14:32:25 -07:00
Brad Fitzpatrick 5b1657a2d4 Make blob storage constructors take a blobserver.Loader 2011-05-21 13:40:17 -07:00
Brad Fitzpatrick 621d3e2cc9 Start of 'shard' handler. 2011-05-21 09:26:20 -07:00
Brad Fitzpatrick 0e9921e6f3 Update to get dev-server working again after jsonsign & Go changes. 2011-05-21 08:51:49 -07:00
Brad Fitzpatrick 415f2b903a pinentry: default to reading from stdin if pinentry not found 2011-05-17 20:48:57 -07:00
Brad Fitzpatrick 19b822efdd More gpgagent, pinentry, and jsonsign work. 2011-05-17 20:25:00 -07:00
Brad Fitzpatrick e9918ac445 Flesh out gpgagent library. 2011-05-17 19:32:01 -07:00
Brad Fitzpatrick 7af8ab94e6 use cachekey in code + test 2011-05-16 22:06:03 -07:00
Brad Fitzpatrick 2ac8794abe Start of gpgagent client too, similar to pinentry. 2011-05-16 21:52:01 -07:00
Brad Fitzpatrick 27ddde1db4 Add caching of decrypted entity private keys. 2011-05-16 14:35:38 -07:00
Brad Fitzpatrick ca19b8ddaa jsonsign: use Go's openpgp library; don't shell out to gpg 2011-05-16 09:01:35 -07:00
Brad Fitzpatrick bbf3408920 client config: use JSON errorutil.HighlightBytePosition helper 2011-05-15 21:56:17 -07:00
Brad Fitzpatrick 5cf560c600 osutil paths: let CAMLI_CONFIG_DIR environment override the default config directory 2011-05-15 21:55:46 -07:00
Brad Fitzpatrick e2c955bddb blobref fetcher: use osutil.CamliConfigDir, don't duplicate 2011-05-15 21:55:19 -07:00
Brad Fitzpatrick 2bc5d53aea pinentry library to be used with jsonsign shortly here. 2011-05-14 18:43:07 -07:00
Brad Fitzpatrick 95ea9ac630 Use new Go http.Request.SetBasicAuth 2011-05-14 17:14:54 -07:00
Brad Fitzpatrick 6faab75120 gofix: open for fuse 2011-05-14 16:40:39 -07:00
Brad Fitzpatrick 35e61582db gofix: get finalurl 2011-05-14 16:40:31 -07:00
Brad Fitzpatrick c5e93ceecd Rename CorruptBlobError -> ErrCorruptBlob, per Go convention 2011-05-12 19:19:49 -07:00
Brad Fitzpatrick 860f020ec4 This bug is already filed. 2011-05-12 19:18:20 -07:00
Brad Fitzpatrick 475561d74c Remove old partition interface. 2011-05-12 19:17:59 -07:00
Brad Fitzpatrick f3c7d79a2d Update NoImplStorage to latest API; add type check 2011-05-12 19:16:08 -07:00
Brad Fitzpatrick 8bfcb6a5a3 Move CountingReader to new camli/misc library 2011-05-11 08:19:23 -07:00
Brad Fitzpatrick 54057fb914 fix some logging printfs 2011-05-11 08:07:02 -07:00
Brad Fitzpatrick 76dd41e18a localdisk: use defer to reliably close the channel. missed a case on enumerate timeout before. 2011-05-11 06:55:14 -07:00
Brad Fitzpatrick 7e3c711395 localdisk: Create queue should create directory too 2011-05-11 06:30:11 -07:00
Brad Fitzpatrick 68898203e5 Add TODO to rename StreamingFetcher to be Fetcher 2011-05-11 06:29:40 -07:00
Brad Fitzpatrick 9a6b0799d2 use filepath.Join, not fmt.Sprintf 2011-05-11 06:20:35 -07:00
Brad Fitzpatrick d4f63d89d3 Clarify enumerate docs: after and maxWaitSec are mutually exclusive 2011-05-11 06:11:44 -07:00
Brad Fitzpatrick 480350936e Revert "Work around Go http bug with zero length files." 
This reverts commit 1e7ff7b46c.

Fixed with: http://codereview.appspot.com/4529050
 2011-05-11 04:59:45 -07:00
Brad Fitzpatrick 1e7ff7b46c Work around Go http bug with zero length files. 2011-05-10 19:29:20 -07:00
Brad Fitzpatrick 257e550740 use blobref.SizedBlobRef as a value, not a mutable *blobref.SizedBlobRef on heap 2011-05-10 16:13:37 -07:00
Brad Fitzpatrick a0e38478d3 blobserver/remote: ReceiveBlob, which is now easy after previous commits. 2011-05-10 15:51:10 -07:00
Brad Fitzpatrick cb0498a7a9 Work around gotest/6g bug. 2011-05-10 15:22:46 -07:00
Brad Fitzpatrick d43263035a client: allow UploadHandle.Size to be -1, and associated cleanup, including: 
-- new StorageConfiger interface & use it in camlistored.
-- bunch of little bug fixes and TODOs done.
 2011-05-10 14:55:12 -07:00
Brad Fitzpatrick bce74ef24c add TODO 2011-05-10 13:04:20 -07:00
Brad Fitzpatrick b99db2dd17 implement Client.Stat 2011-05-10 13:02:48 -07:00
Brad Fitzpatrick 70892e9f23 client: parseStatResponse 2011-05-10 12:56:59 -07:00
Brad Fitzpatrick 8e7c92be02 gofmt only 2011-05-10 12:56:40 -07:00
Brad Fitzpatrick 67b1d6cb43 More remote blobserver work 2011-05-10 11:35:48 -07:00
Brad Fitzpatrick 651fac6a3d put directional constraints on all the channel types 2011-05-10 11:21:28 -07:00
Brad Fitzpatrick c4eb6bb68d Some work on remote blobserver & camli client; allow client to use alt http clients 2011-05-10 06:25:18 -07:00
Brad Fitzpatrick a31431a11b use new Go API http.NewRequest 2011-05-10 05:59:36 -07:00
Brad Fitzpatrick a010e605fa flag cleanup: remove some GPG flags 2011-05-10 05:00:53 -07:00
Brad Fitzpatrick ab2a1e1fb4 jsonconfig: add optional object 2011-05-09 14:17:30 -07:00
Brad Fitzpatrick a5bdaef70d better client error message 2011-05-09 14:16:59 -07:00
Brad Fitzpatrick c619cdcdf1 Allow dev-* scripts listening on port 0, and then log resolved port. 2011-05-09 12:22:31 -07:00
Brad Fitzpatrick ec0c73f08d allow default value in jsonconfig _env expansion 2011-05-09 12:12:54 -07:00
Brad Fitzpatrick 17a804b7c1 Move TLS setup to config file, not flags. Use jsonconfig for root config. 2011-05-09 11:49:02 -07:00
Brad Fitzpatrick 0d3f7305cb Remove --showimages demo flag; make it an env variable. 2011-05-09 11:16:48 -07:00
Brad Fitzpatrick 1b7aceac3f Automatic blobserver queue creation from sync Handler. 2011-05-09 11:08:14 -07:00
Brad Fitzpatrick bed26de507 Cleanup: remove partitions from interfaces. WIP but compiles. 
Still need to fix up blobhub notification for localdisk
mirroring, since now localdisk can't find the notification
hub for mirrored partitions.  (and also can't be configured
yet)
 2011-05-09 09:11:18 -07:00
Brad Fitzpatrick 77cfa748f5 Start of remote (proxy) blobserver type 2011-05-09 06:32:24 -07:00
Brad Fitzpatrick 771393f89e update for multipart return EOF change 2011-05-07 05:37:54 -07:00
Brad Fitzpatrick b68e0184b1 in verify reply, include SignerKeyId 2011-05-06 05:37:17 -07:00
Brad Fitzpatrick 1f6bee57c7 wire up verification handler to web UI 2011-05-05 21:45:24 -07:00
Brad Fitzpatrick 6d0639054d woot, signing handler hooked up to web UI now. 2011-05-05 21:21:30 -07:00
Brad Fitzpatrick 1a14a121d0 improve jsonsign discovery handler 2011-05-05 17:15:32 -07:00
Brad Fitzpatrick 962d65877d some sig discovery work 2011-05-05 16:41:00 -07:00
Brad Fitzpatrick 73a7329401 blobref memory store 2011-05-05 16:31:19 -07:00
Brad Fitzpatrick 54efd345d8 start of blobref.MemoryStore 2011-05-03 17:55:57 -07:00
Brad Fitzpatrick 1ba5fd168a allow fetcher or streaming fetcher in jsonsign signing 2011-05-03 17:34:16 -07:00
Brad Fitzpatrick 8658894096 add keyring with a passphrase for testing 2011-05-03 07:26:57 -07:00
Brad Fitzpatrick 36989b6dcf Add dev-server helper script to run a full dev config. 2011-05-01 18:36:11 -07:00
Brad Fitzpatrick 12b8190828 jsonconfig expansion support; start making dev-* helper scripts use config files 2011-05-01 16:10:53 -07:00
Brad Fitzpatrick d02b3e8d1b reflect NewValue -> ValueOf (latest Go changes) 2011-04-25 18:19:48 -07:00
Brad Fitzpatrick 3db60c316c camlistored: configuration + cleanup work 
working on gutting partition stuff from everywhere,
and gutting the command-line mode that statically
mounted various dev handlers based on flags.

more stuff moves into the config file now
and jsonconfig is used in more places.
 2011-04-15 22:25:45 -07:00
Brad Fitzpatrick 2bcb748cf0 Make jsonconfig into its own library 
Will move away from camli/blobserver in future commit.
 2011-04-15 22:22:30 -07:00
Brad Fitzpatrick a76551fe4f Highlight position of JSON parser errors. 2011-04-15 17:17:33 -07:00
Brad Fitzpatrick da0cb14ab8 Amazon: untested delete support 2011-04-08 23:22:52 -07:00
Brad Fitzpatrick df73e53494 Amazon fetch support; misc refactorings 
Blobservers only need a streaming fetcher now.
 2011-04-08 23:20:24 -07:00
Brad Fitzpatrick f5174a008b Amazon S3 enumerate support. 2011-04-08 21:05:39 -07:00
Brad Fitzpatrick fd22dafa7b Let storage layers declare their max enumerate size 2011-04-08 21:03:43 -07:00
Brad Fitzpatrick 0de477e15f remove unnecessary channel closes, one of which was buggy 2011-04-07 19:26:05 -07:00
Brad Fitzpatrick c56f82c5dd Updates for Go Open changes. 2011-04-07 10:58:29 -07:00
Brad Fitzpatrick 036e4756cb S3 storage works now, with last night's weekly release of Go. 2011-04-05 09:19:30 -07:00
Brad Fitzpatrick 46542e2e3f Amazon S3 stat/upload support. Basically works. 
Might be a bug or two yet, and requires a yet-unsubmitted fix to
Go's HTTP library.
 2011-04-04 15:15:09 -07:00
Brad Fitzpatrick 17dc73b291 s3 signing: use req.URL.Host if req.Host isn't set 2011-04-04 15:10:50 -07:00
Brad Fitzpatrick f9d167d9cc Start of s3 stat/receive. 2011-04-03 19:59:46 -07:00
Brad Fitzpatrick 87d749f781 use fmt.Errorf instead of os.NewError(fmt.Sprintf(..)) 2011-04-03 19:58:41 -07:00
Brad Fitzpatrick 978a46fd4a add skipStartupCheck option to s3 2011-04-03 19:57:30 -07:00
Brad Fitzpatrick ed9caf9116 boolean config accessors 2011-04-03 19:57:12 -07:00
Brad Fitzpatrick 133c9dea1d Complain about unknown keys in config files. 2011-04-03 19:16:11 -07:00
Brad Fitzpatrick b5528c4a6b s3: add bucket to config 2011-04-03 19:15:09 -07:00
Brad Fitzpatrick 59901467fd Server config file support. 2011-04-03 08:07:40 -07:00
Brad Fitzpatrick 2a61dcfd9e Put some path-related stuff in camli/osutil 2011-04-01 22:26:33 -07:00
Brad Fitzpatrick 173f5615a2 register as s3, not filesystem 2011-04-01 22:13:55 -07:00
Brad Fitzpatrick 68b044592c more s3 client work 2011-04-01 21:49:12 -07:00
Brad Fitzpatrick 2c3ea22973 S3 http request signing 2011-04-01 21:26:10 -07:00
Brad Fitzpatrick 63668853d9 Make s3 storage use registry; start trimming blobserver 2011-04-01 20:45:40 -07:00
Brad Fitzpatrick 00f9ede8a6 Start of blobserver handler registry for config file work. 2011-04-01 18:20:28 -07:00
Brad Fitzpatrick 5634523637 Add camli/netutil library for ident-like lookups. 2011-04-01 12:47:07 -07:00
Brad Fitzpatrick 5d3557772a Fix MySQL mysql.go for net.Dial laddr removal. 2011-03-29 16:05:19 -07:00
Brad Fitzpatrick 8006b0538c Add NanosFromRFC3339 to schema; + tests 2011-03-29 10:29:16 -07:00
Brad Fitzpatrick 84c891a8e5 Start of s3 blobserver support + prep cleanup 2011-03-27 22:06:29 -07:00
Brad Fitzpatrick cb742f43f9 Start of Amazon S3 library. For now signing + tests. 2011-03-27 15:25:21 -07:00
Brad Fitzpatrick d9e09f7513 Export Rfc3339FromNanos, more tests, start of doing reverse for fuse. 2011-03-25 21:43:49 -07:00
Brad Fitzpatrick 3b94bd0578 camli/lru and a few tests 2011-03-25 20:58:17 -07:00
Brad Fitzpatrick 7c1e08c55f Start of simple camli/lru class for fuse caches. 2011-03-25 18:58:14 -07:00
Brad Fitzpatrick cac9d9ff86 schema: camli non-utf8 JSON string decoding 2011-03-25 18:45:10 -07:00
Brad Fitzpatrick 912a5a304c fuse readlink support 2011-03-25 18:36:08 -07:00
Brad Fitzpatrick 28975e8fc3 Change EnumerateBlobs interface to close channel, not send nil. 2011-03-25 09:52:51 -07:00
Brad Fitzpatrick 83a814148b Define blobserver.Cache interface. 2011-03-24 19:57:57 -07:00
Brad Fitzpatrick a774c3dc19 camli/client: implement FetchStreaming, not Fetch 2011-03-24 19:22:35 -07:00
Brad Fitzpatrick 468a4849c4 add StreamingFetcher interface 2011-03-24 19:20:47 -07:00
Brad Fitzpatrick ff25acb45c FileReader tests & bug fixes. 2011-03-24 17:42:34 -07:00
Brad Fitzpatrick db5e3fe358 move json blob TestFetcher to camli/test package 2011-03-24 16:47:51 -07:00
Brad Fitzpatrick 3db542645c schema/fuse file reading, but still buggy in parts 2011-03-24 15:33:15 -07:00
Brad Fitzpatrick a8739674e1 cammount: Start of Open and file ops 2011-03-23 22:04:50 -07:00
Brad Fitzpatrick b366f7c699 cammount: more working Opendir 2011-03-23 19:57:40 -07:00
Brad Fitzpatrick 6ce55da2f4 Update to go-fuse 142724315 2011-03-23 19:14:04 -07:00
Brad Fitzpatrick 95b3214789 Merge branch 'master' of camlistore.org:camlistore 2011-03-22 22:59:48 -07:00
Brad Fitzpatrick 367d4d7bef cammount: more FUSE work; kinda-working Opendir 2011-03-22 22:59:45 -07:00
Brett Slatkin f6a9c55cd8 Merge branch 'master' of camlistore.org:camlistore 2011-03-22 22:50:35 -07:00
Brett Slatkin f674c9a644 added python library for schema blobs 2011-03-22 22:50:14 -07:00
Brad Fitzpatrick 9771c314e3 cammount: more FUSE work: basic GetAttr support 2011-03-22 22:32:11 -07:00
Brad Fitzpatrick 0707a092e0 cammount: more FUSE work, inode lookup 2011-03-22 22:11:27 -07:00
Brett Slatkin 87be928fa9 adds fusepy library 2011-03-22 17:27:27 -07:00
Brad Fitzpatrick 43d058ae77 Merge commit '7262d8a' 2011-03-20 10:25:23 -07:00
Brad Fitzpatrick 042619c4b6 Use GoMySQL in third_party instead. 2011-03-19 21:25:24 -07:00
Brad Fitzpatrick cc516df2bc third_party: add https://github.com/Philio/GoMySQL 
As of commit:

commit 9840aab51952df13259ee88f9d00dcc61eb31fd7
Author: Philio <phil@bayfmail.com>
Date:   Tue Mar 1 19:00:26 2011 +0000

    update to 0.3.0 release
 2011-03-19 21:22:59 -07:00
Brad Fitzpatrick c4a269cc69 Ignore third_party/workdir 2011-03-19 21:21:58 -07:00
Brad Fitzpatrick b94cf58ee7 Update go-fuse mount.go to work with Go weekly API changes. 2011-03-19 20:14:02 -07:00
Brad Fitzpatrick 772ed95a3a third_party: import https://github.com/hanwen/go-fuse/ at 79426f97e60 
commit 79426f97e60ee827aa5745e0f17e8a293e51c0c4
Author: Han-Wen Nienhuys <hanwen@google.com>
Date:   Thu Mar 17 22:21:31 2011 -0300

    Stop serializing writes - the kernel is multithreaded too.
 2011-03-19 20:07:05 -07:00
Brad Fitzpatrick d4ce983b1d Start of camli third_party lib directory & maintenance script. 2011-03-19 20:05:41 -07:00