Commit Graph

582 Commits

Author SHA1 Message Date
Brad Fitzpatrick 57a5439648 camli/db: some more insert work
Change-Id: I80af5b64ba834674df36bafea75ab84ce5922ea3
2011-08-24 18:23:14 +04:00
Brad Fitzpatrick 80b91d5ba8 more camli/db work.
Change-Id: I9c86df6a9e528432305d6042a59dd171f1b67109
2011-08-24 18:10:05 +04:00
Brad Fitzpatrick 501736e54d db: more Go db work, including intro goals doc
Change-Id: I69e914bc533b3f69fba5d869c90337ee2da2fa06
2011-08-21 14:14:04 +04:00
Iain Peet cb183a1ae2 Implemented Google Storage requests required for blobserver.
This commit really just contains the camlistore-independent
google storage code (googlestorage.go).  I've stubbed out the Storage
interface, but that's not yet done.

Committing now because this is large enough already.

Change-Id: Ie122b11bebed13b36f99f80144787ad4edc0ed51
2011-08-18 10:47:45 -04:00
Jrabbit fdcc33356d namespace problem & setup.py file used for pypi uploading
Change-Id: I52a21f602a4cda201f5b446a427d0c5098e3d701
2011-08-18 08:48:35 -05:00
Brad Fitzpatrick 61b901104d Merge "Fixes camlistore's python library. And style" 2011-08-09 21:50:17 +00:00
Brad Fitzpatrick d72e6c4e47 Merge branch 'master' of ssh://camlistore.org:29418/camlistore 2011-08-08 16:21:54 -07:00
Jrabbit 4edf0bbda4 Fixes camlistore's python library. And style
Change-Id: Iea860ff9986098263d4fd596441ce363c464c654
2011-08-08 16:06:33 -05:00
Robert Hencke 52a15c7b91 first cut at a Camlistore WebDAV server
don't let it burn out your eyes too badly

Change-Id: I7b1b1df0abbcafff411025d30bd32cd250d2221d
2011-08-06 20:46:37 -05:00
Brad Fitzpatrick 8566612dde db WIP
Change-Id: I41d53d4345623955698f5664047dce2c1f429616
2011-07-31 18:20:36 -07:00
Brad Fitzpatrick 86e9e5ecd8 More db work
Change-Id: I45cea988ce785277ab5f59e59af4b72b24d18d55
2011-07-31 17:34:16 -07:00
Robert Hencke 999098b187 client: close HTTP responses when done.
camput was failing for large amounts of files because there
were too many open connections.

Change-Id: I5a8b93070f14601ec0f4102634ed62fd83a021d8
2011-07-30 22:29:01 -05:00
Brad Fitzpatrick 85d2472b34 Start of Go's db & db/dbimpl packages, being prototyped here.
Change-Id: I3f2e868403b44f878d5f3fdcb6b7d0971ac12a8d
2011-07-25 12:46:29 -07:00
Iain Peet 46881bb549 Initial work on google storage for developers.
Brought in goauth2 client library, added a utility for obtaining
tokens for the first time.

Change-Id: I7c8301912a086df55732c1a1bc4ddf619438d66c
2011-07-20 15:31:55 -04:00
Brad Fitzpatrick fc154b900e schema: make DirectoryEntry return errors instead of nil
Change-Id: I7965e35fef75e54023903044f0b8150e4420a653
2011-07-18 19:06:56 -07:00
Brad Fitzpatrick 41c701d1f7 Merge "browsing a (permanoded) dir continuation of https://camlistore.org/r/36" 2011-07-19 01:47:18 +00:00
mpl 42dcd20ccb browsing a (permanoded) dir
continuation of https://camlistore.org/r/36

Change-Id: Idd4977bb5f4d3c5bf80831ffa4d09085485da0f0
2011-07-18 15:49:31 +02:00
Brad Fitzpatrick a0dcdfc74d Fix URL opening on windows.
Change-Id: I802b8d9a41a551c8af10d848ba9e60439a3a00d2
2011-07-17 17:57:48 -07:00
Brad Fitzpatrick 95a98d991d open admin UI on windows
Change-Id: I0df5042ddd9bb9058660468b862916a97b86c280
2011-07-17 17:30:40 -07:00
Brad Fitzpatrick 7a0e7a30ce webserver: split Serve into Listen+Serve
Change-Id: I8dd6d9b660ee56d33551993dafb5c86da8d77805
2011-07-17 17:24:38 -07:00
Nigel Tao 8833cd00d3 Fix bug in image resizing code.
Change-Id: I76049f4a1353bd6f63c8022d3b69f2bb43631966
2011-07-17 17:24:15 -07:00
Brad Fitzpatrick 114404d4a7 make webserver build on windows
Change-Id: Ib580d8a39607a28ce6670a2a11cfc3ca42dcc866
2011-07-17 15:27:20 -07:00
Brad Fitzpatrick 98d0739753 fixes to go-flickr to make it compile with recent Go
Change-Id: I95e9c0ad7ca948022ae083a06f6f8e082f62d376
2011-07-17 13:11:53 -07:00
Brad Fitzpatrick ddc1485d28 Add github.com/mncaudill/go-flickr to third_party
Change-Id: Ie13d717076a14175ebff11b2847281014d7d8d70
2011-07-16 13:12:08 -07:00
Brad Fitzpatrick 8403b0bd27 Merge branch 'master' of ssh://camlistore.org:29418/camlistore 2011-07-14 16:52:47 -07:00
Brad Fitzpatrick d420e2da20 DirectoryEntry interface.
Change-Id: Ide492cd8f273ff2ae440ac15d67d02acee87c612
2011-07-14 10:43:30 -07:00
mpl 42a60238da added Type test to Superset.NewFileReader (as per TODO)
Change-Id: I2c9b0868e1df65306e978552db2e135c5d623289
2011-07-13 10:52:37 +02:00
Brad Fitzpatrick 08c37e0469 updates for latest image changes
Change-Id: Ife974ec53109fe7c1a5f1b1223649e1b1be99e69
2011-07-12 18:21:05 -07:00
Lindsey Simon a461c76ccd Photo gallery stylin
Change-Id: Ibfe50a8d58ee2bb0f1f85b45a1b617026f154a71
2011-07-11 13:09:25 -07:00
mpl bce36761a1 undo merging of change If30e0a9613db42a94feda66bb225a844de6d1839 because still a wip
Change-Id: Id25f5aa0ae63b9d41d8a3ac9fd832194eafd07ee
2011-07-11 10:51:40 +02:00
Nigel Tao dca7cac879 Update image resizing code for Go change 9031:5c33eaa24213
Change-Id: I42a1ac64ee1721b9d47500884f94c7ce95fbd966
2011-07-10 19:33:21 -07:00
mpl ad49800183 hacky sketch for browsing a dir
Change-Id: If30e0a9613db42a94feda66bb225a844de6d1839
2011-07-10 12:30:29 -07:00
Brad Fitzpatrick ad06f285ae Merge "make govet even happier" 2011-07-09 22:32:15 +00:00
Robert Hencke c7e6967cf4 make govet even happier
Change-Id: Ic3f0f6ae543cb661f7bdc4068f32c386cb453b85
2011-07-09 17:27:31 -05:00
Robert Hencke 910cd043a8 make Brad happier
Change-Id: I21100b3c63de0982b8991a1ccde331f36d681c0d
2011-07-09 17:20:14 -05:00
Robert Hencke b886a74d39 make govet happier
Change-Id: Iee52786e9f68f0a0f94dd70fa7917cf24d54e8c3
2011-07-09 16:11:20 -05:00
Brad Fitzpatrick 591ced28b8 Merge "Changed all references of sort.SortStrings to sort.Strings per commit 9012 of go" 2011-07-09 01:12:29 +00:00
Brad Fitzpatrick 16cc888842 Add configuration discovery to publish handler.
This permits metadata edits on the publish page if the
viewer is the owner.

(e.g. tagging, titling photos...)

Change-Id: I08b098eaae92f5b629b02707d67bec23a705c29f
2011-07-08 15:05:46 -07:00
Amit Levy d6825c9af8 Changed all references of sort.SortStrings to sort.Strings per commit 9012 of go
Change-Id: I2af1eeea05b65db10b17bc077a8af2dd5778910d
2011-07-08 17:54:03 -04:00
Brad Fitzpatrick 6fe189a4cd publishing: new URLs, tests. Yay photo galleries.
Change-Id: I9081b49faf95f5193945032cbc6711f412bca198
2011-07-06 18:38:27 -07:00
Brad Fitzpatrick 94242a9ac4 more publish path tests.
Change-Id: Ieeea2d76a476bc169f4fd3f962c18b0e3896719d
2011-07-06 16:33:31 -07:00
Brad Fitzpatrick 40c4e2e1f0 Start of publish tests.
Change-Id: I0fe2d03942c25d0bf28ba334568781a55324f013
2011-07-06 11:59:50 -07:00
Brad Fitzpatrick 443cfd5268 move FakeIndex from camli/search's private tests to camli/test so others can use it
Change-Id: I927add0bd645d92d6c36133ff8df5fa0fe33f770
2011-07-06 11:20:25 -07:00
Brad Fitzpatrick a477909f09 publish: support /mxxx subresources. aka HTML pages for permanode members. aka photo one-up pages from galleries.
Change-Id: I404e836a728048631c6149ef76eb6d7014ec7978
2011-07-05 17:27:10 -07:00
Brad Fitzpatrick ebaf8b563e publish: static file support. and ditch camli/misc/vfs now that it's in Go's pkg http.
Change-Id: I5bf87d3ee305173c722fab6d9f1568a7c1be081a
2011-07-05 12:10:35 -07:00
mpl 5926a965d9 add limit to GetTaggedPermanodes
Change-Id: I59efbbb0a6645b262aa739344d31979e11e4351e
2011-07-05 19:31:05 +02:00
Brad Fitzpatrick 767d6f16cc New working but incomplete MySQL wrapper. Makes DB stuff easier.
Change-Id: I43333f9410e6ffabe3c24f4c505aeba5dc7d46f4
2011-07-05 00:11:29 -07:00
Brad Fitzpatrick 0fc83ee54a Don't reference potentially nil s.result.
Change-Id: If0768550b54a6a206e38be7b4e951ef526a873cf
2011-07-04 14:57:08 -07:00
Brad Fitzpatrick 4ecffa2f59 Add temporary github GoMySQL fork to third_party.
Change-Id: I84cb505ec4f480caf30e0fbfed77a1d823c05a04
2011-07-04 13:03:58 -07:00
Brad Fitzpatrick f91404ecfc Update gomemcache in third_party.
Change-Id: Ide78f9528c1327fd91a681595429eb0ebdffacf0
2011-07-03 16:13:44 -07:00
Brad Fitzpatrick 3e792ae70b Permit updating a subset of third_party.
Change-Id: Iccb3b8ed7f6baed3c9494b86bbdba9d39bd368d7
2011-07-03 16:13:35 -07:00
Brad Fitzpatrick 2c126a4841 Photo gallery thumbnails.
Change-Id: I71a628057ff790928e96909512e43d2997a76f85
2011-07-03 13:33:56 -07:00
Brad Fitzpatrick 182a058232 publish: serve subresource files (e.g. gallery members), with access control
Change-Id: I9f91b596b145c83bb026ba93becb5174480acadc
2011-07-03 12:28:39 -07:00
Brad Fitzpatrick 78078701d0 publish: start of file resource downloads, later thumbnails.
Change-Id: Ida5b009c11d359887edad7612aeec5dab96447e4
2011-07-02 23:32:42 -07:00
Brad Fitzpatrick 6179e508e3 publish: show title, members, include javascript blob metadata
start of awesomeness.

Change-Id: I45d63b04fa223b9aafceb9452b179e4ddc52bce5
2011-07-02 17:16:30 -07:00
Brad Fitzpatrick e55f01d3ea GoMySQL third_party git update.
Change-Id: I49f87a1f474af835d06104fbffa759468cf1daf9
2011-07-02 09:57:11 -07:00
Brad Fitzpatrick 0020e785b4 Add gomemcache to third_party.
Change-Id: Id2a33229da783521f875c6a5e2a9d219dbbc6b59
2011-07-02 09:56:50 -07:00
Brad Fitzpatrick 024e801ca7 gofmt the whole tree
Change-Id: Ic1b3dd12a4ede83b299dcf51f342e72d4f8700da
2011-07-02 09:09:50 -07:00
Brad Fitzpatrick 91ec88b7bd Add GetTaggedPermanodes to FakeIndex for testing.
Change-Id: I6b70a298efecb5e577027e0c5e6cf435af33c2b4
2011-07-02 09:06:15 -07:00
mpl 05c18e873e search for permanodes with the given tag(s)
Change-Id: Ibbe0163da522698c253615a26d4201a7e28348de
2011-07-02 17:16:19 +02:00
Brad Fitzpatrick f0470c4d8f search: add docs, DescribeError, Result
Change-Id: I8c891fd2832da3f49e653288fded2a7bd2f7fd2c
2011-07-01 19:36:22 -07:00
Brad Fitzpatrick 13b9ebcd0e Use os.Remove, not syscall
Change-Id: I60cda72e8d48fb3c9de7770c1affe23fc96c1f10
2011-07-01 14:36:48 -07:00
Brad Fitzpatrick 7e633e48f2 Merge branch 'master' of ssh://camlistore.org:29418/camlistore 2011-07-01 14:33:43 -07:00
Brad Fitzpatrick 981f7d88a8 Describe cleanup + more search/index tests.
Change-Id: Ia7b6e83966c5c9481400f88495fe7fd518be2f77
2011-07-01 14:33:15 -07:00
Brad Fitzpatrick d304cb7a42 Merge "Implemented config file includes." 2011-07-01 20:34:12 +00:00
Brad Fitzpatrick 789ea237fc Merge "server: Support deleting paths." 2011-07-01 19:45:56 +00:00
Daniel Erat 80d4e8912a server: Support deleting paths.
Add an "active" column to the indexer's path table and use
it to track deletion of path attributes.

Change-Id: I579d53a80302d0f7ecc51b5c49913cd23814ce73
2011-07-01 19:45:03 +00:00
Brad Fitzpatrick eeeef01aff Start of some describe tests.
Change-Id: Ie6d4c7cc2040113cca611a1a72bd6d2efd2dbbb7
2011-07-01 12:38:00 -07:00
Brad Fitzpatrick 3040ca7d81 Start of search tests & an index fake.
Change-Id: I890048878c269d6a569d1aff9bd1982280daab5f
2011-07-01 12:00:10 -07:00
Brad Fitzpatrick 5ee34188f2 Revert bogus defer httputil.ReturnJson change.
Change-Id: I92f2bf63ba86e6829e697f28417e02e72f681245
2011-07-01 11:19:54 -07:00
Brad Fitzpatrick 68de472c53 More Describe work TODO notes
Change-Id: Ibd7c3dfdf4d75ac54bc908e8e534a17040f2608a
2011-06-30 16:25:18 -07:00
Brad Fitzpatrick 18b4f25b06 use defer httputil.ReturnJson
Change-Id: I4b454b3b68c3be52ba26cd640c4ba1163b32ec0e
2011-06-30 16:16:08 -07:00
Brad Fitzpatrick 1c014249e5 search: start of generalizing DescribeRequest
... into a usable API inside Go land, not just JavaScript.

Change-Id: Ic47508047d3eebaf903c98b50b60e64d05112a0f
2011-06-30 16:14:58 -07:00
Brad Fitzpatrick d572f898f7 search/publich: rename PathLookup to PathsLookup, add PathLookup
Change-Id: If6804af2229885cfa22d67d608d17e600d7402f3
2011-06-30 14:36:07 -07:00
Iain Peet 0ca7712691 Implemented config file includes.
I've implemented the previously stubbed out "_file" config expression.  The root
JSON object of the included file becomes the value of the field.  In addition to
searching the CWD and the config dir, the include will search directories listed
in the CAMLI_INCLUDE_PATH environment variable.  The include path is useful
because it gives us the ability to have default configs in git which can be
overridden by custom configs which are provided in another path directory which
gets searched first.

I ended up working on this because, as I was thinking about how to approach
supporting Google Storage, I realized that we would need to have secrets in
includes; this would be a pain when combined with the current configs and
runscripts in GIT.  So, one thing lead to another, and now this is done.

Change-Id: Ib256859326dfceefed90d0fadf83a76adffd538b
2011-06-30 14:21:26 -04:00
Brad Fitzpatrick 96cedf05db Update go. Fix struct tags.
Change-Id: I08d05144dbd4c4a50474d05f1f4ecea67c3424e4
2011-06-29 21:36:14 -07:00
Brad Fitzpatrick 15057eec02 Update to Go 8944
Change-Id: I7940180cbe882884286e56ee4fc7bf5589aad9e0
2011-06-29 21:13:03 -07:00
Brad Fitzpatrick a251f4064c search/publish: Add PathLook, wire up to publish handler.
Change-Id: I8645c54adbc6d84c18ecc814ca1966113da32d85
2011-06-27 18:42:00 -07:00
Brad Fitzpatrick 40739efa6b search + UI support for finding paths of a permanode
Change-Id: Iae9cfed38660204cf7e85342cd951d542a7258a2
2011-06-25 17:50:38 -07:00
Brad Fitzpatrick b2edc4a5f9 publishing work: index path mounts
Change-Id: I9e6f273289f136fbbfa8565c24be250e28ae1a6e
2011-06-24 18:50:00 -07:00
Brad Fitzpatrick 12abade62f Merge "lib/go/client/upload: make use of multipart writer in conjunction with io.pipe" 2011-06-24 02:02:13 +00:00
caine d4ff6f7932 lib/go/client/upload: make use of multipart writer in conjunction with io.pipe
Change-Id: I5b56d340a80ab6b96730ece84aaa8002d785a73c
2011-06-23 21:57:56 -04:00
Brad Fitzpatrick 23ff0a071f publish work: optionally create publish root permanodes+claims on start
Change-Id: I8659e977cea8872443ff2b311a7d0d8a2804c269
2011-06-23 12:12:37 -07:00
Julien Danjou 494d57cb4a Use auth.SendUnauthorized() to really request auth
Local function sendUnauthorized does not send all the header like
WWW-Authenticate, therefore browser do not propose a popup.
auth.SendUnauthorized is more complete in this regard.

Change-Id: Icef0a41394883e9606cab2557482bfa5b7b995ec
Signed-off-by: Julien Danjou <julien@danjou.info>
2011-06-23 17:44:08 +02:00
Julien Danjou d6aaafa9c3 Fix return code in RequestEntityTooLargeError
Change-Id: Ic7fb562ba58e6807b4c2561d2a506ca02afa8c2b
Signed-off-by: Julien Danjou <julien@danjou.info>
2011-06-23 17:44:08 +02:00
Brad Fitzpatrick 5b2ae24c69 search: add signerattrvalue handler, for publishing
Change-Id: I623570a719d4d713e0754d20064973de73a7241b
2011-06-22 22:21:18 -07:00
Brad Fitzpatrick 1f39a91eee Relegate camli/search to camli/search/recent
Change-Id: I7f76db980fe1788a6d0ac556e8176bc83cd6828f
2011-06-22 21:59:17 -07:00
Brad Fitzpatrick 4b0f04257f mysqlindexer: implement PermanodeOfSignerAttrValue for publishing
This was Brett's magical pony interface. Done.

Change-Id: Ifed76ca703ee3ec413dee39078c665d351a55e63
2011-06-22 20:24:16 -07:00
Brad Fitzpatrick 1f8723d30b mysqlindexer: keep map of gpg public key blobref -> keyid
Change-Id: I90f40d23bdaacf30f02e1ae20f17ec7844623e51
2011-06-22 18:58:06 -07:00
Brad Fitzpatrick 374872e002 mysqlindex: verify claims; add to signerattrvalue table
Change-Id: I44d6d6a6defe972c1a7dab9f8d39217704a809cc
2011-06-22 18:08:07 -07:00
Brad Fitzpatrick a49ffa1239 jsonsign: comment updates
Change-Id: I32ca3fc47b7f2ee4208aa69b05cf3cd1fcc57696
2011-06-22 18:04:20 -07:00
Brad Fitzpatrick 81cc07f564 update for Go change
Change-Id: Ibe1507e8cf3f9d1f8196201739e9c74a9b9d8e0a
2011-06-22 15:38:03 -07:00
Brad Fitzpatrick a56420c984 mysqlindexer: use receiver for populate methods
Change-Id: If2cbaee7acd86db837d1ca6c31aeee6a97be67e5
2011-06-19 14:54:57 -07:00
Brad Fitzpatrick 6ca4b975f7 Work on search/index/schema of PermanodeOfSignerAttrValue
Change-Id: I8c0c75ae8e4a62717ab69246f535b3fd5d594c47
2011-06-19 14:52:11 -07:00
Brad Fitzpatrick 30adc073f5 Version the mysql db schemas; warn on startup if wrong with tip to fix.
Change-Id: I3bc881bc5b078062bc96f80dec1e8f9ac71ece61
2011-06-19 14:36:46 -07:00
Brad Fitzpatrick d8f7bc9d98 jsonconfig: add OptionalList
Change-Id: I51bd6a785e47ddeca7b2ddd23c4665f61ef1d099
2011-06-19 13:09:05 -07:00
Brad Fitzpatrick bd15b4a4c2 Serve UI files from binary's embedded copy.
Change-Id: Ibb7902381f80111c943897e82e1eaa2b0ee7fc2c
2011-06-18 12:01:34 -07:00
Brad Fitzpatrick 81547a9eb6 Support for embedding static files (html/js) into the resulting binary.
Also build system changes for start of move to camlistore.org/* namespace
for Go packages.

Not yet wired up to ui.go.

Potential changes required for Go's http package first:
http://codereview.appspot.com/4629047/

Change-Id: I3ae264a5401d3a41e0b6e42b12010f19a9c9dcf7
2011-06-17 14:13:01 -07:00
Brett Slatkin 58bb35939e beginning of setting URL mount points for permanodes; nothing working yet
Change-Id: I9c33d67121e101369cdd797ef3b1c0ef74c8bdb0
2011-06-16 21:24:59 -07:00
Brad Fitzpatrick 0d7581ede6 Start of publish handler.
Change-Id: I229c9e00a19aa985050373beda696c5468a94105
2011-06-16 20:48:06 -07:00
Brad Fitzpatrick 8f38212408 Update for gofix httpheaders 2011-06-16 18:38:21 -07:00
Brad Fitzpatrick a170c567a3 Merge "auth: add SendUnauthorized" 2011-06-15 08:38:14 -07:00
Brad Fitzpatrick 6b77e2dd57 Merge "httputil: add ForbiddenError and RequestEntityTooLargeError" 2011-06-15 08:37:18 -07:00
Julien Danjou b07e7f61b3 auth: add SendUnauthorized
Change-Id: I6bf97fee5097af56dfa4b1d1cd1157f5e15d08e5
Signed-off-by: Julien Danjou <julien@danjou.info>
2011-06-15 11:48:36 +02:00
Julien Danjou 310e0474be httputil: add ForbiddenError and RequestEntityTooLargeError
Change-Id: Ie013c2b79bd75b3c1ba14f94b334bb009b61c4d3
Signed-off-by: Julien Danjou <julien@danjou.info>
2011-06-15 11:48:28 +02:00
mpl 34c776c81c thumbnail support
Change-Id: Ie0ee67ce278c1d9790c43a9270fc909dd6e68923
2011-06-15 10:42:18 +02:00
Brad Fitzpatrick 20c4ef7154 search / file work 2011-06-12 00:20:57 -07:00
Brad Fitzpatrick 72c4a42d06 more jpeg sniffing 2011-06-12 00:13:06 -07:00
Brad Fitzpatrick 2086b96993 errorText to error 2011-06-11 20:10:10 -07:00
Brad Fitzpatrick 691273a284 index more about files: filename, properties set, mime type 2011-06-11 10:55:35 -07:00
Brad Fitzpatrick 42d80271d8 show children in describe 2011-06-11 10:12:39 -07:00
Brad Fitzpatrick 60e3fa2574 more content -> camliContent cleanup 2011-06-11 09:51:08 -07:00
Brad Fitzpatrick d2b9f80a03 send error response JSON 2011-06-11 09:30:01 -07:00
Brad Fitzpatrick 179b706248 don't promote camliContent attr, make member be camliMember 2011-06-11 00:27:17 -07:00
Brad Fitzpatrick 3c6c4207be download handler: support for verifying a digest in a HEAD request
for use in javascript uploads.
2011-06-09 18:33:26 -07:00
Brad Fitzpatrick 6f35e66385 let file reader be closed 2011-06-09 18:28:07 -07:00
Brad Fitzpatrick bdfde0a5fe Advertise the dev server password in the realm. 2011-06-09 16:09:21 -07:00
Brad Fitzpatrick 0ada583435 UI: js file upload work 2011-06-09 15:00:20 -07:00
Brad Fitzpatrick 3b3b682c1e Search interface + impl to find file schema refs by their content ref 2011-06-09 12:55:38 -07:00
Brad Fitzpatrick e5acdb2e38 send 400 or 500 with some json replies 2011-06-09 12:54:53 -07:00
Brad Fitzpatrick 97978b56d4 don't retry forever indexing files. 2011-06-08 18:56:56 -07:00
Brad Fitzpatrick c61317703c indexer: index file sha1s, sizes (for js search lookup later) 2011-06-08 18:26:57 -07:00
Brad Fitzpatrick fa3715134a Start of indexer indexing file schema's content digests. 2011-06-08 17:49:31 -07:00
Brad Fitzpatrick a4c43c359f Add blobref.SeekerFromStreamingFetcher, moving it from UI code. 2011-06-08 17:48:56 -07:00
Brad Fitzpatrick f31959c24c Update for Go: use http.Values 2011-06-08 13:41:39 -07:00
Brad Fitzpatrick d65fc1391a schema & blobref: implement JSON [Un]Marshal interfaces, clean up code 2011-06-07 17:00:21 -07:00
caine tighe 1fabcfbeb0 osutil/paths.go : update for windows support 2011-06-07 16:25:44 -04:00
Brad Fitzpatrick 1f0aec0612 rollsum: add a benchmark, and more attribution 2011-06-06 19:09:58 -07:00
Brad Fitzpatrick 39ac2c072e schema: filereader support for hash tree files. 2011-06-06 13:30:54 -07:00
Brad Fitzpatrick 319a12f982 schema/filereader: support zero regions, start of subfile support 2011-06-06 11:31:45 -07:00
Brad Fitzpatrick fac6b7f020 schema filewriter: rollsum chunking version 2011-06-06 08:54:31 -07:00
Brad Fitzpatrick 5f86c64b95 schema filereader: verify top-level size matches part sizes when reading 2011-06-06 08:50:20 -07:00
Brad Fitzpatrick 8ab1532a15 rollsum: OnSplit, Bits. add camput debug mode for it. 2011-06-04 16:14:33 -07:00
Brad Fitzpatrick 742051f813 rollsum: Port of apenwarr's bar rollsum to Go. 2011-06-04 12:00:53 -07:00
Brad Fitzpatrick 1ed6a4a50c search: remove dup attributes 2011-06-04 10:18:38 -07:00
Brad Fitzpatrick 8d84a4de10 Add blobref.SeekTester interface; fixing UI downloads from cond storage. 2011-06-04 09:58:50 -07:00
Brad Fitzpatrick b652dc62e8 make CachingFetcher also a StreamingFetcher 2011-06-04 09:12:02 -07:00
Brad Fitzpatrick 59e577c023 Rename blobref.Fetcher to blobref.SeekFetcher 2011-06-04 08:56:03 -07:00
Brad Fitzpatrick 0df00167ec cond: implement it (routing incoming blobs) and use it. 2011-06-04 08:46:42 -07:00
Brad Fitzpatrick 0a7752afe5 jsonconfig: RequiredStringOrObject, OptionalStringOrObject 2011-06-04 08:45:03 -07:00
Brad Fitzpatrick c6cfe2fda4 Start of 'cond' handler. 2011-06-03 21:52:56 -07:00
Brad Fitzpatrick 811f75954a magic: add a fake text/ mime type for public keys 2011-06-03 18:41:26 -07:00
Brad Fitzpatrick 9f2daec131 UI/search: show all claims for a permanode 2011-06-03 15:23:23 -07:00
Brad Fitzpatrick b28ae35c35 UI: deleting tags 2011-06-03 14:16:00 -07:00
Brad Fitzpatrick 2db013a3b4 Add a dev-pass-camput script, improve error messages. 2011-06-02 16:57:49 -07:00
Brad Fitzpatrick 9b3280ce10 Update to new Go exec API 2011-06-02 16:47:40 -07:00
Brad Fitzpatrick 5725dbaf75 Fix localdisk queue error on dup uploads. 2011-05-31 18:58:58 -07:00
Brad Fitzpatrick 0dfc7a5770 Fix a performance TODO in schema.FileReader 2011-05-31 10:35:45 -07:00
Brad Fitzpatrick 2da1ef4093 UI: file download support 2011-05-31 10:20:28 -07:00
Brad Fitzpatrick 2c66ab38ad whoops, was using offset wrong in filewriter 2011-05-30 19:24:19 -07:00
Brad Fitzpatrick ae221c0712 Fighting GoMySQL library; see https://groups.google.com/group/gomysql/browse_thread/thread/594ffd08c6370261 2011-05-30 18:10:13 -07:00
Brad Fitzpatrick 7de40d3b5c more mysql paranoia 2011-05-30 17:20:15 -07:00
Brad Fitzpatrick 335f3187a8 blob info page 2011-05-30 16:41:56 -07:00
Brad Fitzpatrick a3dc3f3ad7 close stmt on exit? 2011-05-30 16:39:56 -07:00
Brad Fitzpatrick 1c6470b3b3 Search: add a describe handler for javascript UI 2011-05-30 15:44:25 -07:00
Brad Fitzpatrick 4e08e4805f Move some key stuff from camlistored to jsonsign, use from camput. 2011-05-30 12:38:26 -07:00
Brad Fitzpatrick 10c3ec682c convert search to use handler registry 2011-05-29 22:52:31 -07:00
Brad Fitzpatrick c4fa4d25b4 Protocol change: remove some upload restrictions that were only for App Engine.
Now effective SHOULDs.  Not changing the spec yet, though.  Need to fix App Engine python impl.
2011-05-29 21:39:51 -07:00
Brad Fitzpatrick 884e8a63ea fix WriteFileFromReader bug when chunks already exist. 2011-05-29 18:22:56 -07:00
Brad Fitzpatrick f9b879d3bf Add schema.WriteFileFromReader and use it in UI upload helper 2011-05-29 10:50:17 -07:00
Brad Fitzpatrick 90405dc424 schema: PopulateRegularFileMap take just size, not FileInfo, add NewCommonFilenameMap 2011-05-29 10:39:41 -07:00
Brad Fitzpatrick 5ea8b64217 client: Use blobref.Sha1FromString 2011-05-29 10:38:53 -07:00
Brad Fitzpatrick f4512d3c6c blobref: add Sha1FromString helper and SizedBlobRef Equal/String 2011-05-29 10:38:21 -07:00
Brad Fitzpatrick eb0bf1e3d1 schema: move FileReader to its own file 2011-05-26 16:46:27 -07:00
Brad Fitzpatrick 50abe93da6 gofmt on camput and little style things 2011-05-26 16:41:49 -07:00
Brad Fitzpatrick 4317da0308 camlistored: convert ui, root, jsonsign to use handler registry 2011-05-26 07:34:39 -07:00
Brad Fitzpatrick 9ad7346474 blobserver registry: finish RegisterHandlerConstructor stuff
going to use it now.
2011-05-25 22:15:55 -07:00
Brad Fitzpatrick 513b594dbc replica: notify blob hub 2011-05-22 21:23:23 -07:00
Brad Fitzpatrick ccf33926c8 Replica blob handler for live replication. 2011-05-22 21:22:21 -07:00
Brad Fitzpatrick 11c959caab jsonconfig: clean up duplication, add Optiona/RequiredInt 2011-05-22 21:20:54 -07:00
Brad Fitzpatrick 9e7233bd4c shard: notify hub when file received. 2011-05-22 16:02:44 -07:00
Brad Fitzpatrick 7fb3c5a5e1 Implement MergedEnumerate; finishes shard handler. 2011-05-22 12:39:54 -07:00
Brad Fitzpatrick 3765151953 Move ChanPeeker into blobref pkg. Need it elsewhere. 2011-05-22 12:38:50 -07:00
Brad Fitzpatrick 21797e2150 Make shard Enumerate use new blobserver.MergedEnumerated; not yet implemented.
Will need for replica target too.
2011-05-21 18:19:37 -07:00
Brad Fitzpatrick 941ac98281 Shard handler implementation, except for enumerate. 2011-05-21 14:32:25 -07:00
Brad Fitzpatrick 5b1657a2d4 Make blob storage constructors take a blobserver.Loader 2011-05-21 13:40:17 -07:00
Brad Fitzpatrick 621d3e2cc9 Start of 'shard' handler. 2011-05-21 09:26:20 -07:00
Brad Fitzpatrick 0e9921e6f3 Update to get dev-server working again after jsonsign & Go changes. 2011-05-21 08:51:49 -07:00
Brad Fitzpatrick 415f2b903a pinentry: default to reading from stdin if pinentry not found 2011-05-17 20:48:57 -07:00
Brad Fitzpatrick 19b822efdd More gpgagent, pinentry, and jsonsign work. 2011-05-17 20:25:00 -07:00
Brad Fitzpatrick e9918ac445 Flesh out gpgagent library. 2011-05-17 19:32:01 -07:00
Brad Fitzpatrick 7af8ab94e6 use cachekey in code + test 2011-05-16 22:06:03 -07:00
Brad Fitzpatrick 2ac8794abe Start of gpgagent client too, similar to pinentry. 2011-05-16 21:52:01 -07:00
Brad Fitzpatrick 27ddde1db4 Add caching of decrypted entity private keys. 2011-05-16 14:35:38 -07:00
Brad Fitzpatrick ca19b8ddaa jsonsign: use Go's openpgp library; don't shell out to gpg 2011-05-16 09:01:35 -07:00
Brad Fitzpatrick bbf3408920 client config: use JSON errorutil.HighlightBytePosition helper 2011-05-15 21:56:17 -07:00
Brad Fitzpatrick 5cf560c600 osutil paths: let CAMLI_CONFIG_DIR environment override the default config directory 2011-05-15 21:55:46 -07:00
Brad Fitzpatrick e2c955bddb blobref fetcher: use osutil.CamliConfigDir, don't duplicate 2011-05-15 21:55:19 -07:00
Brad Fitzpatrick 2bc5d53aea pinentry library to be used with jsonsign shortly here. 2011-05-14 18:43:07 -07:00
Brad Fitzpatrick 95ea9ac630 Use new Go http.Request.SetBasicAuth 2011-05-14 17:14:54 -07:00
Brad Fitzpatrick 6faab75120 gofix: open for fuse 2011-05-14 16:40:39 -07:00
Brad Fitzpatrick 35e61582db gofix: get finalurl 2011-05-14 16:40:31 -07:00
Brad Fitzpatrick c5e93ceecd Rename CorruptBlobError -> ErrCorruptBlob, per Go convention 2011-05-12 19:19:49 -07:00
Brad Fitzpatrick 860f020ec4 This bug is already filed. 2011-05-12 19:18:20 -07:00
Brad Fitzpatrick 475561d74c Remove old partition interface. 2011-05-12 19:17:59 -07:00
Brad Fitzpatrick f3c7d79a2d Update NoImplStorage to latest API; add type check 2011-05-12 19:16:08 -07:00
Brad Fitzpatrick 8bfcb6a5a3 Move CountingReader to new camli/misc library 2011-05-11 08:19:23 -07:00
Brad Fitzpatrick 54057fb914 fix some logging printfs 2011-05-11 08:07:02 -07:00
Brad Fitzpatrick 76dd41e18a localdisk: use defer to reliably close the channel. missed a case on enumerate timeout before. 2011-05-11 06:55:14 -07:00
Brad Fitzpatrick 7e3c711395 localdisk: Create queue should create directory too 2011-05-11 06:30:11 -07:00