Rooba
/
perkeep
mirror of https://github.com/perkeep/perkeep.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
7,048 Commits 44 Branches 11 Tags 59 MiB
Commit Graph

2951 Commits

Author SHA1 Message Date
Brad Fitzpatrick 17a3faf2df index: export NewMemoryIndex 
Change-Id: Iaa6d3268ce0f6c531e37c97799deeb31c11eabdb
 2012-11-04 12:18:11 +01:00
Brad Fitzpatrick 0ccf9ba3f1 some TODOs 
Change-Id: Ifcc2612ea323347ba78d5cb493ebe9fabd3a10aa
 2012-11-03 22:27:27 +01:00
mpl 295cbade1b Add postgres support 
Also added the -short option for make presubmit
because postgres test is too slow.

Change-Id: I6be21c4d4cd67671eb44ab65333fc32c1e261bbd
 2012-11-03 19:59:22 +01:00
Brad Fitzpatrick 4b0d2841ee Add search.EdgesTo method to search interface. No implementation yet. 
Change-Id: Ie3a9eb91e218e172b195d55cb9c17cb6c8f819ce
 2012-11-03 16:08:37 +01:00
Brad Fitzpatrick 69e155af64 Replace panics with t.Fatal 
Change-Id: I7a514f4a67dbf44eff2448a423082c528e9ee365
 2012-11-03 14:54:53 +01:00
Brad Fitzpatrick d2e2652eea gofmt 
Change-Id: Ib9aca9d648317f1f17fce0e5e7dba5315a95c274
 2012-11-03 14:54:45 +01:00
Brad Fitzpatrick 13f85afe8c Merge "Modification to allow windows build and deployement" 2012-11-03 13:25:43 +00:00
Brad Fitzpatrick 1466c77198 Add 'edgeback' key to index, for going backwards. 
Change-Id: I43057a6fb96c3e8d9364002288d5c7b9ad2fd034
 2012-11-03 14:25:48 +01:00
Brad Fitzpatrick 7cde834f2a Merge branch 'master' of ssh://camlistore.org:29418/camlistore 2012-11-03 14:18:26 +01:00
Brad Fitzpatrick 9b6cb04c6e pkg/index: remove pre-Go 1 trimRFC3339Subseconds 
Confirmed it's no longer needed.

Change-Id: I83fdbec205476cd749c668e04b26a304c543e7b6
 2012-11-02 13:36:33 +01:00
Maxime Lavigne 5a7510c384 Modification to allow windows build and deployement 
Webserver were initialized with "tcp" and ":3179" by default and
listenURL assumed that it would be treated as IPv6 and replaced [::]
by localhost. Host that were listening on IPv4 0.0.0.0 didn't get
the modification.

Receive in localdisk were using link that failed on windows plateforms.

Camlistored didn't use Json Marshaling which caused problem with the
way Windows stores its paths.

Change-Id: I9f62f7d46399c3514707383efcb2752dbaf1f420
 2012-10-30 23:17:58 -04:00
mpl c61feaa0bd wizard: placeholder for gallery field 
The gallery field of the wizard is awkward and undocumented.
This placeholder at least gives a hint to devs (and maybe users)
on what is expected in that field.

Change-Id: Ie707dbecaf87ec98e267fcf6b987cd3b6a1d13e0
 2012-10-29 11:10:42 +01:00
Brad Fitzpatrick 22495f8bfd schema: adjust rollsum splitting algorithm, make it the default 
We might tweak the parameters yet, and I want to add a bunch more
tests, but this is a major relief for me.  I've been reluctant to
put too much data into my personal Camlistore instance until I
figured out how I wanted the file chunks to split.

This also simplifies (deletes) a fair bit of code.

Change-Id: I35c38cc5d39a8a43e3f62445434f8d7fd5de5d17
 2012-10-29 02:03:05 +01:00
Brad Fitzpatrick 044194b746 schema: document PopulateParts, add a missing error check 
Change-Id: Ic9d65fe3e56c4233f481254c6f730a8b382fb4ba
 2012-10-29 00:10:31 +01:00
Brad Fitzpatrick 15ad53c545 rollsum: revert change. I was using the API wrong. 
Change-Id: I5973ae82188f67493f15aa1359867c220a2b28eb
 2012-10-28 13:40:29 +01:00
Brad Fitzpatrick d2b8dc2327 rollsum: decrease split frequency by 4x 
Change-Id: Ibf945004abff61134fbcd07f47734ea3f0944ba0
 2012-10-28 13:08:39 +01:00
Brad Fitzpatrick 82329b5882 rollsum: log stats after benchmark run 
Change-Id: I2c8983d13ea80efb383ebf77316e6ad0a5da9f57
 2012-10-28 13:07:42 +01:00
Brad Fitzpatrick a364983788 Merge "mongo: added user:pass style authentication" 2012-10-28 11:05:19 +00:00
mpl 231c3d7405 wizard: bugfix, TLS is now https 
this should have been done along with
the other changes in 94cb8cf05a

Change-Id: I376e6616c3aeaa9d5accb65b64a43d101de25d3b
 2012-10-25 18:39:55 +02:00
mpl 8138cf8fd6 mongo: added user:pass style authentication 
The mongo indexer didn't have any authentication
scheme, so this change adds the user:pass@host
authentication.
The mongo indexer tests now use the root:root
credentials.

Change-Id: I7867f46e3b5f0a4a1a50f86f26d76c0bfd69e9ac
 2012-10-25 00:35:19 +02:00
mpl 3e9aef409c search handler: documented the "attr" values when searching for a permanode 
Change-Id: I607d1fe016078912faac9864630552cd2b496aa2
 2012-10-24 17:26:46 +02:00
Brad Fitzpatrick 0645035db7 Make serverconfig tests pass again. 
Change-Id: I83077f7573a81b643639c78de1a72169e82b09e9
 2012-10-20 12:33:39 -07:00
Brad Fitzpatrick d0faee5726 Compile with Go tip. 
Change-Id: I518c357613049e80939ccab9c30b6aaf03ebe140
 2012-10-20 12:27:50 -07:00
mpl 83ce85b59f old TODOs 
Change-Id: Ifa8877f594e65e081536b97f536106301f5c9836
 2012-10-19 23:37:14 +02:00
Brad Fitzpatrick 44b0592135 Merge "jsonconfig: remove TODO and revert bogus change; float always works apparently." 2012-10-19 20:30:34 +00:00
Brad Fitzpatrick 6b8fc9b23a webserver: use runsit listener instead of net.Listen 
Change-Id: I635d1ac5dcd89905a2fadf4b71d3bffec88389ad
 2012-10-19 13:24:18 -07:00
Brad Fitzpatrick 7fba04d71a Compile with Go tip again. 
See https://groups.google.com/forum/?fromgroups=#!topic/golang-dev/yULJVYAbIzg

Change-Id: I11e8dd99a9ec4a065f03b888b616c13e5ce0e92c
 2012-10-19 12:51:10 -07:00
mpl 41e8215abe jsonconfig: remove TODO and revert bogus change; float always works apparently. 
Change-Id: Ia80edbfd122063895ffb76d361c33b2cd70a725c
 2012-10-19 19:26:15 +02:00
mpl 94cb8cf05a Be consistent between high and low level configs for https 
Change-Id: Ie7e1d9c554e09a34416a2ae3ac9e10f1a2f8fce0
 2012-10-18 11:58:30 +02:00
Brad Fitzpatrick c1730d6151 Merge "cammount: check that input is a directory blobref" 2012-10-18 05:47:30 +00:00
mpl 2d4f37176c cammount: check that input is a directory blobref 
Change-Id: I9b33f2ae31ef902e01ddaa0504e1c960bb4e3640
 2012-10-18 00:33:37 +02:00
mpl 6ac49843ab fix IPv4 assumption 
Change-Id: I334e6ccb5b26a083b55750271262a3469f63e78e
 2012-10-16 00:20:57 +02:00
mpl 0b15eb0cc8 handlers in wizard: swap arguments to match http handlers style 
Change-Id: I78e9b218392979017682c375ce8a4b636ed3a832
 2012-10-15 17:29:12 +02:00
Brad Fitzpatrick 42fb5290fd Merge "If baseURL was not user defined, this change makes sure it is dynamically defined from incoming requests. The listen flag has moved from pkg/webserver to server/camlistored and is not using runsit anymore. httputil.ServerError now only outputs the full error if we're in internal/debug mode. http://code.google.com/p/camlistore/issues/detail?id=53" 2012-10-15 14:33:43 +00:00
mpl 844551d0b2 If baseURL was not user defined, this change makes sure it is 
dynamically defined from incoming requests.
The listen flag has moved from pkg/webserver to server/camlistored
and is not using runsit anymore.
httputil.ServerError now only outputs the full error if we're
in internal/debug mode.
http://code.google.com/p/camlistore/issues/detail?id=53

Change-Id: I55a1c6d43a549d9ee2022742a83aa142dc19e02a
 2012-10-15 16:26:50 +02:00
mpl a534e02c2d camput: client becomes StatReceiver. 
also added ReaderSize function to
guess before reading the size of
a source.

Change-Id: I659e174821696b3c58759b132b82710a49583018
 2012-10-11 11:51:12 +02:00
mpl 6baedb3dc7 delete permanode: defined the keyDeleted index key, 
and added check in index searches to exclude deleted
permanodes from the results

Change-Id: I7097e4a5dc893a212c91dff987ad7e505793fda9
 2012-10-09 01:29:59 +02:00
Brad Fitzpatrick e557066f1d schema: more cleanup, making FileReader a ReaderAt. 
testing TODOs and further cleanup TODOs remain.

Change-Id: I997153c66805cfe3220d3d735322be14b68b75dc
 2012-08-23 20:09:31 -07:00
Brad Fitzpatrick faf3c90d6f schema: more docs and some FileReader work 
Change-Id: Id9e754e3b6358a651a826a4cdeb00efb330e3c3a
 2012-08-23 18:44:03 -07:00
mpl b355a29150 just one missing map[string]interface{} -> Map conversion 
Change-Id: I616ef7260dac9187ea5157f8d47c1b05815ad723
 2012-08-22 15:09:42 +02:00
Brad Fitzpatrick 1a51f44196 schema: fix test 
Change-Id: Iaacc42167e40233dcb9f5f03bfcfcfe86655a2b1
 2012-08-22 04:38:51 +10:00
Brad Fitzpatrick 228c0ca56f schema: change PopulateSymlinkMap to be Map.SetSymlinkTarget 
Change-Id: I072ce65331048b54c90c32e951f5034060c1764c
 2012-08-22 04:38:25 +10:00
Brad Fitzpatrick a8629ec5dd schema: unexport NewBytes 
Change-Id: Ia6ec7c9aec33319bf277b93a189b4fa43d0540b9
 2012-08-22 04:33:06 +10:00
Brad Fitzpatrick 439db110ec schema: more cleanup; ditch the Claimer type 
Change-Id: I2a52564c1a99c96a2cd8bc84a791784f0a4e4b2e
 2012-08-22 04:31:48 +10:00
Brad Fitzpatrick b67d753364 schema: docs and cleanup 
Change-Id: Ib720b7f711d71bdeaaf33374f376f14b30a5a97c
 2012-08-22 04:14:47 +10:00
Brad Fitzpatrick 11eac8721e Convert more code to use schema.Map instead of map[string]interface{} 
Change-Id: I285fd1b0e730ebd32069688a71cb992c43770ade
 2012-08-22 03:47:38 +10:00
Brad Fitzpatrick 3cd7f75f89 schema: introduce type Map 
Change-Id: I8209930d8505a4cb74b8ea29b5b57f2cd6bd14d2
 2012-08-22 03:36:36 +10:00
Brad Fitzpatrick 0a0b012eba camput,schema: cleanup, docs 
Change-Id: Ifa94cb1e9e086f85222692508ab12616f4cc3211
 2012-08-22 03:31:44 +10:00
Brad Fitzpatrick 8fec29c974 camput: make file permanodes consistent between runs (fix claim times) 
Change-Id: Idd2bbda2372802772703eaeaf6fe2e74f9bcdd83
 2012-08-21 20:43:38 +10:00
Brad Fitzpatrick b815a2b758 camput: add -filenodes option for per-file content-based planned permanodes 
Change-Id: Ic03b990654d860e03b4cc710de92f7d40c392df8
 2012-08-21 16:11:10 +10:00
Andrew Gerrand aa5392f510 import image/gif to handle gif files 
Change-Id: If9742b89562909bd70d2c9b8ceddd394975c7db0
 2012-08-05 11:01:12 +10:00
Andrew Gerrand 7874bef34e add bsds to osutil/restart_unix build rule 
Change-Id: If5e7f811ad8c656bcfa48f26c12f7ea59ddef830
 2012-08-05 10:55:36 +10:00
Brad Fitzpatrick a5169d1468 client: memoize SignerPublicKeyBlobref 2012-08-05 09:25:21 +10:00
Brad Fitzpatrick b3ab27e049 remove log noise 2012-08-05 09:15:17 +10:00
Brad Fitzpatrick 11842fcf33 serverconfig: let baseURL and listen be optionally separate 2012-08-04 21:42:10 +10:00
Brad Fitzpatrick 42833a76e0 serverconfig: be consistent between low- and high-level config 
Use TLSCertFile and TLSKeyFile in both.
 2012-08-04 21:11:52 +10:00
Brad Fitzpatrick 63418fe0fc webserver: use runsit's listen package, for running under runsit 2012-08-04 11:24:51 +10:00
Brad Fitzpatrick 493f75a72e serverconfig: allow configuring TLS cert/key 2012-08-04 11:12:39 +10:00
Brad Fitzpatrick 51e88cac65 Support for "planned permanodes" in pkg/jsonsign, pkg/schema and cmd/camput. 
A planned permanode involves setting the contents of the permanode
(instead of a random string) as well as the OpenPGP signing time so
the resultant bytes of the blob (and thus its blobref) is deterministic.

This allows multiple independent devices (my laptops) to create the
same permanodes for the same files (photos backed up from my phone)
when offline (airplane) and then when they sync later, still only have
one permanode per unique file.  This means that tagging and other
metadata applied to permanodes on one laptop merge cleanly with
metadata from the other.
 2012-07-28 16:32:31 -07:00
Brad Fitzpatrick 8c293e34b6 Per Go initialism style, rename Json to JSON 2012-07-28 15:42:56 -07:00
Brad Fitzpatrick 2db390d58e Add schema.NewPlannedPermanode 2012-07-28 15:41:19 -07:00
mpl 326d62aea4 camput: actually catch errors when trying to upload, 
also added startupcheck for remote blobserver

Change-Id: Id9f5383c6fd3fdf697f2b75052f3e63b0972205d
 2012-07-23 11:05:57 +02:00
mpl 71ab8c787b quickfix for "race" between root handler and ui handler creations 
Change-Id: Id92cf57442ef8c2a503fde7522ff7824efbfb9e9
 2012-07-12 01:29:54 +02:00
mpl 8a642172ce update mongo 
Change-Id: I1fb9c657c799560f030b35203c952745919d02ef
 2012-07-02 10:50:09 +02:00
Brad Fitzpatrick ed4e781075 Merge branch 'master' of ssh://camlistore.org:29418/camlistore 2012-06-16 10:19:04 -07:00
mpl 497fc21385 Added/changed copyright 
Change-Id: I1de302b52903ebf61100ab061c1fa7f14495fde8
 2012-05-27 01:37:54 +02:00
mpl b2f079f081 handle SIGHUP, restart camli from wizard 
Change-Id: I9856e49b9c4d76dc3bed1827594451349d4f5810
 2012-05-16 11:37:29 +02:00
mpl ec70a6e2c8 typo 
Change-Id: I52c06b45976e67413a133ce9229dd79701953495
 2012-05-14 00:10:40 +02:00
Brad Fitzpatrick 3b30cbd63f add TODO 
Change-Id: Icd386f58b9004b78dd52bdaf32cca257d1593495
 2012-05-13 13:30:42 -07:00
Brad Fitzpatrick 6fec55a384 simplify legacy time code 
Change-Id: I643b722adddaa3bfecab6044de2c5a373e5d7dd1
 2012-05-13 13:27:11 -07:00
Brad Fitzpatrick ad6047abf0 initialism 
Change-Id: I3ae54133a56b48f614938ac3082dd28ae6197980
 2012-05-13 13:06:50 -07:00
Brad Fitzpatrick 50fe7a2fda Make UI discovery have absolute paths, so root discovery using UI's discovery handler works. 
Change-Id: Ieb1b5d143c528b4b15875aa810038c3ebdf30251
 2012-05-13 13:02:20 -07:00
Brad Fitzpatrick a63556640d proper initialism case style 
Change-Id: I622dcfc7076403470573ec76cef58307fdff3ffa
 2012-05-13 12:53:17 -07:00
Brad Fitzpatrick 70c273ef93 style nit. use composite literal. 
Change-Id: I7b70ee26c3ea799ad601d72cb1414a4a98992cbc
 2012-05-13 12:20:18 -07:00
Brad Fitzpatrick 618efee2f5 Add discovery handler on root. 
Change-Id: If816ff0dd5bb57d52445aff8cc67b8c801b606a8
 2012-05-13 12:16:59 -07:00
Brad Fitzpatrick de535fa264 factored syntax for block of regexps 
Change-Id: Ie0f2e343fa9a37be8fd32356a72c26ccf46af311
 2012-05-13 12:14:31 -07:00
Brad Fitzpatrick 420dccdd10 simplify code using newer Go APIs 
Change-Id: I2425102367c4842e2b4a065f2e993ca9151bf9cc
 2012-05-13 12:13:58 -07:00
Brad Fitzpatrick 1b63c44b4e Update all os.ENOENT references to ErrNotExist. Mostly docs/dead code. 
Change-Id: I2bb4d5a9d9c610e8dce2309335d06046dbb1e049
 2012-05-13 12:06:21 -07:00
Brad Fitzpatrick 0df3e3c689 Merge branch 'master' of ssh://camlistore.org:29418/camlistore 2012-05-13 10:52:50 -07:00
Brad Fitzpatrick d29cbb5e35 rename FindHandlerByTypeIfLoaded to be shorter. document better. 
Change-Id: I20b1a191d2d67972ba1f7a7fd3678d4ab4adae55
 2012-05-14 03:48:51 +10:00
Brad Fitzpatrick 0f90f864f6 Add some serverconfig docs 
Change-Id: Ibecb0cc21c2273a97956892ed6a37a0f53fd43a2
 2012-05-14 01:51:39 +10:00
Brad Fitzpatrick 5f5da19d45 rename a function 
Change-Id: I328ed897f55a0bfcc5b4c806aac18966edb1c990
 2012-05-14 01:46:39 +10:00
Brad Fitzpatrick 610e708924 fix more references to lib/go/camli 
Change-Id: Ic35c67b0255d713185e8c77fdeb91c17c79a11c7
 2012-05-14 01:07:13 +10:00
Brad Fitzpatrick cb7e5aa474 remove old stuff 
Change-Id: I81b3a7ed3b9568818b6385d74d49825fed000c27
 2012-05-13 15:57:34 +10:00
Brad Fitzpatrick 6fd46add5c remove old directory 
Change-Id: I84e80af9ef7ca91d2ab162e90b2aa5a7916ef402
 2012-05-13 15:53:21 +10:00
mpl da73bef166 support user provided rootNode for published entities 
Change-Id: I54810bded2cc03f320e1081945ff5cb2fce0d852
 2012-05-02 16:18:05 +02:00
Brad Fitzpatrick 180147ce02 fs: add a WELCOME.txt fuse node at the root. 
Change-Id: Ifd7d38aaec93e9a9d33c887e50cc49a240c4d656
 2012-04-30 19:43:06 +10:00
Brad Fitzpatrick 4b8df05859 fs,fuse: new 'welcome' root node, where you can navigate/search anywhere. 
Change-Id: I66f076a85d8e474bb5d93ad8743fc8181de7502f
 2012-04-29 14:29:51 +10:00
Brad Fitzpatrick add0f80721 fs: implement fuse owner/groups 
Change-Id: I3cb8fea6aa7dc572e1a77bc2bf872b8c584d1cbf
 2012-04-29 10:03:07 +10:00
Brad Fitzpatrick 5cb597ec04 fs: fuse reading of file contents. 
Change-Id: I2969e16cf694ea4d4d15a2c69d25d34813fac4a3
 2012-04-28 21:47:02 +10:00
Brad Fitzpatrick 947a963373 fs: fix fuse Lookups when there hasn't been a Readdir. also start on file reading. 
Change-Id: Ie3e53e24a6e1053f665c1c239f32eda805c90df9
 2012-04-28 21:15:45 +10:00
Brad Fitzpatrick de252375f9 fs: set mode, permission, mtime 
Change-Id: Ife6aa6ea93e2a4d54131080e94a6e4f926d0c25a
 2012-04-28 01:35:45 -07:00
Brad Fitzpatrick e67e7fef50 schema: add ModTime accessor, and fix unixPermission logic error 
Change-Id: Id0637f1a4ab7e9efefe1de0decb28b7965ea50eb
 2012-04-28 01:34:53 -07:00
Brad Fitzpatrick e473c142ad pkg/fs: fuse readdir and lookup working again. 
Change-Id: Ib5479d627fbcefa93667e372e79f4fcb2df7d191
 2012-04-28 00:55:46 -07:00
Brad Fitzpatrick 89eeb6e3d5 auth: remove import 
Change-Id: Ic31bc3ce05caee2b41aad127ed807be8c057f3d2
 2012-04-27 18:57:24 -07:00
Brad Fitzpatrick 767c81071d netutil: change mac lsof args. might be faster. didn't fix previous deadlock, though. 
Change-Id: I159e9de4526683ae2f1fd2c18042b94e20029fdb
 2012-04-27 18:51:07 -07:00
Brad Fitzpatrick 8bcae0d59b auth: work around darwin lameness 
Change-Id: I5899bffd9383dd22cac3f4fe5e4cd4da11b3a167
 2012-04-27 18:49:42 -07:00
Brad Fitzpatrick 95d46f1c47 netutil: better error message when ident connection isn't found. 
Change-Id: If18d32d31b0701f7ac770313f337ea0aef43adaf
 2012-04-27 16:27:25 -07:00
Brad Fitzpatrick fa3deaab41 cammount: some more fuse work. 
Change-Id: I84df5c10eca3bb7c4617077f28d3b00bcda75a67
 2012-04-27 01:46:31 -07:00
Brad Fitzpatrick f7a7ada018 pkg/fs: move old style fuse code into old.go for salvage/deletion. 
Change-Id: I6a5ec7ab071c9deb3a824bd3700b103d8d5da154
 2012-04-26 19:44:17 -07:00
Brad Fitzpatrick 736d969cb9 fix build 
Change-Id: Idf0168efdcec0868925cad5c9e51c3476696dab7
 2012-04-26 17:04:20 -07:00
Brad Fitzpatrick 0cce981b11 Merge "support for published entities in genconfig and in wizard" 2012-04-25 15:51:51 +00:00
Brad Fitzpatrick 7b0df24a64 maybe a windows build problem, found by gophorge 
Change-Id: I21c5a17eebb1c1efce8bf12f98cab966f1ce0bc9
 2012-04-24 14:41:15 -07:00
mpl 2a844730b3 support for published entities in genconfig and in wizard 
Change-Id: I1768dac9628edb59cf0b987e9054b920d234b36b
 2012-04-23 21:00:05 +02:00
Brad Fitzpatrick 7b6a26ffeb localdisk: fix TODO which resulted in a race/crash. 
Change-Id: I7ff0be046c07e5fd33c861afd10b5e725066a033
 2012-04-22 18:51:41 -07:00
Brad Fitzpatrick 1d3703f7ef Clean up some logging. 
Change-Id: I92ff6e68e9866784e643682c5e6db5d03f877c5b
 2012-04-22 17:56:52 -07:00
Brad Fitzpatrick ebc77dabd2 cond: implement more efficient JSON sniffing. 
Change-Id: I2c1e3f70832dc38a1103fbbfb3a4d8efff8f51bf
 2012-04-22 17:50:35 -07:00
Brad Fitzpatrick 353a6baad3 Merge branch 'master' of ssh://camlistore.org:29418/camlistore 2012-04-22 17:18:38 -07:00
Brad Fitzpatrick 9d57c52c34 localdisk: attempt #3 at fixing queue directory delete/create race. 
this version seems to work for quite awhile now, at least.

Change-Id: I1484838a9b1b2b12a8af72e57e6c7ba6bd06e07d
 2012-04-22 17:17:51 -07:00
Brad Fitzpatrick 8fafe38f37 osutil: create cache directory on first access 
Change-Id: Ifc599a21ad984028bc7ad2df7bf6fd6099f25f24
 2012-04-22 16:19:21 -07:00
Brad Fitzpatrick 487d9a6eab client: use ioutil.Discard 
Change-Id: I24478df1f9d41e3aa7440ae0b383f21e1dad921c
 2012-04-22 16:19:04 -07:00
mpl 651d7779df bugfix: allow for other tests in serverconfig 
Change-Id: I33a50e470ebb7ef8b17157c7b9d51aff427b2585
 2012-04-22 16:35:30 +02:00
mpl 255ed2a472 support arrays as comma separated values in wizard 
Change-Id: I44de427c91859ee23c230f4649d5f27a1502370b
 2012-04-21 22:44:13 +02:00
Brad Fitzpatrick 63d201cdc8 client: remove some log verbosity 
Change-Id: I107ebd67e2540e0477ed46ddeacc0533da38586f
 2012-04-21 08:29:43 -07:00
Brad Fitzpatrick b5bccf2261 localdisk: fix double slash in full path, preventing race lock from working 
Change-Id: I171099214b06ec99d0ad766d1604442879fb3183
 2012-04-21 08:29:32 -07:00
Brad Fitzpatrick 0e5d27a05c localdisk: fix race deleting empty directories w/ uploading new blobs 
Change-Id: Icae0b7dd3de051bba23d1a583b47f5421adedb47
 2012-04-20 13:04:42 -07:00
Brad Fitzpatrick 26ebfa7e3a schema: fix/optimize uid/gid lookups 
Change-Id: Icc6f9b4912e0ac640af2cba9b39fd803184ceab2
 2012-04-19 17:59:25 -07:00
Brad Fitzpatrick c7333e7f9b osutil: implement CacheDir on darwin 
Change-Id: I73ef36039037f9469df5dc262b5b976cd33a1fd6
 2012-04-18 07:44:08 -07:00
Brad Fitzpatrick a907348ed3 Merge "restrict setup access to localhost" 2012-04-15 18:27:58 +00:00
Brad Fitzpatrick 1c19140c7a schema: fix build breakage on darwin; syscall ctim vs ctimespec naming difference 
Change-Id: Icbd844d585d331ebe46e9a097ca0e155eb543844
 2012-04-15 11:33:59 -07:00
mpl f7448ec758 restrict setup access to localhost 
Change-Id: I889b9debfc65e25084c1e9715e7d14621f009039
 2012-04-15 20:09:51 +02:00
Brad Fitzpatrick 18e53cd72f rename MapToCamliJson to Go style initialism MapToCamliJSON 
Change-Id: I674944c9fafa6b78c495d22c525b9ffd0b75dbf9
 2012-04-15 07:45:10 -07:00
Brad Fitzpatrick 7961187a0f schema: use filepath.Base instead of by hand, fixes bug with trailing slash 
Change-Id: I0216ce084d6a68bdb1c92d85304db030d22f05fb
 2012-04-14 15:26:51 -07:00
Brad Fitzpatrick 6aca4d1aee remove debug 
Change-Id: I7ced1f4d6376444b8c7491e038addaf9ef35f8c4
 2012-04-14 15:22:41 -07:00
Brad Fitzpatrick eaa9c427ac schema: include ctime, if it differs from mtime 
Change-Id: Ifc511cc9abb00cee870e5d12fae86d34dd00e054
 2012-04-14 15:22:07 -07:00
Brad Fitzpatrick 83727904a5 schema: port some pre-Go 1 schema stuff 
Change-Id: Ib5081f38ba2b8997d8c0f58dfbad8e0234f18f8c
 2012-04-13 18:40:59 -07:00
Brad Fitzpatrick a519105585 index/sqlite: new indexer, using sqlite3 
Change-Id: If1405fe3ee7c632c05431f4b0be1077d6d42c4a3
 2012-04-13 16:11:16 -07:00
Brad Fitzpatrick da32d8d1e8 fix typo in test name 
Change-Id: I565422ee6868893a543525853a8e9c24fb14b9fc
 2012-04-13 16:08:40 -07:00
Brad Fitzpatrick 8d6c4fdc81 errorutil: write docs 
Change-Id: I23b60fe920a897427c4d473fd8c7c9ba6ee40d44
 2012-04-13 15:51:39 -07:00
Brad Fitzpatrick 6a8a5e197e serverconfig: fix serverconfig tests, which got broken with genconfig changes 
Change-Id: I163ea61b568c966439d054962a9dfaa722645606
 2012-04-13 15:46:01 -07:00
Brad Fitzpatrick e0dacfa164 jsonconfig: export File type 
Change-Id: I46ad536b1494ff1f0d56b9d34d735fbd227f4a27
 2012-04-13 15:06:04 -07:00
Brad Fitzpatrick 1f8dc0e90e improve TODO 
Change-Id: I6efb0855ab1ee89094f6f828745552fb07fcb3c2
 2012-04-13 15:01:48 -07:00
Brad Fitzpatrick d3949afc89 jsonconfig: make more configurable, to fix serverconfig tests in future patch 
Change-Id: I1cc363c4ac1f0283f0d0183179b2602b6c359990
 2012-04-13 14:36:30 -07:00
Brad Fitzpatrick 3826cc11be index: fix test by excluding the sqlindex package. 
it's not a full index, but just an IndexStorage.

Change-Id: I2a3b7c5705c8a01645f2ac3f97f2621b042ef19c
 2012-04-13 14:12:04 -07:00
Brad Fitzpatrick e4a17bc8ac camput: fix init and some config stuff. 
Change-Id: I121bd9c2dfac3c076db0db75d8f939b5ec571ca4
 2012-04-12 19:36:00 -07:00
Brad Fitzpatrick 71ee67264d osutil: add IdentitySecretRing accessor 
Change-Id: Idcb7a62530292eb3e0a98c798dc86a985fc491f1
 2012-04-12 16:54:57 -07:00
Brad Fitzpatrick 93af191e77 auth: add some more auth modes 
Change-Id: I1674f5fff8a8ea3490f315844df68a474f8c6d5e
 2012-04-12 16:54:25 -07:00
Brad Fitzpatrick 51c99e7d32 jsonconfig: remove stutter in error message 
Change-Id: I42009d832f3e26bb847b0fc3f3d0ebcbcd4eada6
 2012-04-12 14:09:59 -07:00
Brad Fitzpatrick fbeb934c17 serverconfig: remove hard-coded search owner in genconfig. 
Change-Id: I9161bcab5f9deb2ac8b0691c6858ae8615f435ab
 2012-04-12 11:39:53 -07:00
Brad Fitzpatrick 7b8105d561 serverconfig: fix generated low-level config for mysql indexer 
Change-Id: I8376bf134cf234b1a671aaacffba98fe5eaf3271
 2012-04-11 19:22:02 -07:00
Brad Fitzpatrick 1186c452ba Split mysql and generic sql index code. (Prep for sqlite indexer) 
Untested.

Change-Id: Iaf53abf5bea9087ab2f8f1e2a7cda53b73ae094d
 2012-04-09 09:53:57 -07:00
Brad Fitzpatrick b07f2f9973 Debug environment variable to CAMLI_DEBUG_CONFIG dump low-level config. 
Change-Id: I7e7830112b8f10c5695ad53fd867fb5736925cef
 2012-04-08 10:58:34 -07:00
Brad Fitzpatrick 029d66fa9e In default config, allow localhost access for auth also. 
Change-Id: Ie3fc2f3c44d7fc17a367f6a456c6db6511d08f33
 2012-04-07 19:02:31 -07:00
mpl 8466cd9e44 wip: setup wizard 
Change-Id: I9989f7ff3981eb7c9025bbb9bd174cc92862af35
 2012-04-06 19:29:58 +02:00
Brad Fitzpatrick 2ac4da75a7 Add SKIP_DEP_TESTS env var to skip tests with depdendencies. 
Now all tests pass like this:

bradmac-2:camlistore.org $ SKIP_DEP_TESTS=1 go test ./pkg/...
?       camlistore.org/pkg/auth [no test files]
ok      camlistore.org/pkg/blobref      0.023s
ok      camlistore.org/pkg/blobserver   0.032s
?       camlistore.org/pkg/blobserver/cond      [no test files]
?       camlistore.org/pkg/blobserver/google    [no test files]
ok      camlistore.org/pkg/blobserver/handlers  0.031s
ok      camlistore.org/pkg/blobserver/localdisk 1.693s
?       camlistore.org/pkg/blobserver/remote    [no test files]
?       camlistore.org/pkg/blobserver/replica   [no test files]
?       camlistore.org/pkg/blobserver/s3        [no test files]
?       camlistore.org/pkg/blobserver/shard     [no test files]
?       camlistore.org/pkg/cacher       [no test files]
ok      camlistore.org/pkg/client       0.029s
?       camlistore.org/pkg/errorutil    [no test files]
?       camlistore.org/pkg/fileembed    [no test files]
?       camlistore.org/pkg/fileembed/genfileembed       [no test files]
?       camlistore.org/pkg/fs   [no test files]
ok      camlistore.org/pkg/googlestorage        0.034s
?       camlistore.org/pkg/httputil     [no test files]
ok      camlistore.org/pkg/index        0.298s
?       camlistore.org/pkg/index/indextest      [no test files]
ok      camlistore.org/pkg/index/mongo  0.524s
ok      camlistore.org/pkg/index/mysql  0.020s
ok      camlistore.org/pkg/jsonconfig   0.022s
ok      camlistore.org/pkg/jsonsign     0.155s
ok      camlistore.org/pkg/lru  0.015s
ok      camlistore.org/pkg/magic        0.030s
?       camlistore.org/pkg/misc [no test files]
ok      camlistore.org/pkg/misc/amazon/s3       0.028s
ok      camlistore.org/pkg/misc/gpgagent        0.018s
ok      camlistore.org/pkg/misc/httprange       0.026s
?       camlistore.org/pkg/misc/pinentry        [no test files]
?       camlistore.org/pkg/misc/resize  [no test files]
ok      camlistore.org/pkg/netutil      0.088s
ok      camlistore.org/pkg/osutil       0.016s
ok      camlistore.org/pkg/rollsum      0.027s
ok      camlistore.org/pkg/schema       0.017s
ok      camlistore.org/pkg/search       0.016s
ok      camlistore.org/pkg/server       0.039s
ok      camlistore.org/pkg/serverconfig 0.031s
?       camlistore.org/pkg/test [no test files]
?       camlistore.org/pkg/test/asserts [no test files]
?       camlistore.org/pkg/test/testdep [no test files]
?       camlistore.org/pkg/webserver    [no test files]

Change-Id: I9c9b0ee4f51cbcf785aed665bbb494339dd84261
 2012-03-29 18:21:37 -07:00
Brad Fitzpatrick 997f0db09e fix pkg/server tests 
Change-Id: I2b34e61a128c15f20392b325a532b113a457f488
 2012-03-29 16:22:05 -07:00
Brad Fitzpatrick c463c3a26e fix pkg/server tests 
Change-Id: I66fa74f52035b3185ac6390d4e38244f4b29597f
 2012-03-29 16:21:07 -07:00
Brad Fitzpatrick 8ee9eddf6f googlestorage: get test failing in new ways 
Change-Id: Icf03b0d17058504463c1db33d66924efce25290e
 2012-03-29 16:18:00 -07:00
Brad Fitzpatrick 40712671ee pkg/auth and pkg/schema: fix tests. 
Change-Id: I54f391241c77902ad301edea92d39660f7cf0008
 2012-03-29 16:15:59 -07:00
Brad Fitzpatrick 55edf14a70 jsonconfig: fix test build. passes now. 
Change-Id: I12097d09342f30165c29a787c5e1b2271b146f8f
 2012-03-29 16:13:15 -07:00
Brad Fitzpatrick cf2813a5a4 mysql indexer: implement indextest tests & fix Get bug that it found. 
also, delete the other index package's testdata symlinks.

Change-Id: Ie848b880b5d7397e8d334e636a358396024ad144
 2012-03-29 16:12:12 -07:00
Brad Fitzpatrick 427ef88dc2 mysql indexer: start of tests. 
Change-Id: I5df79f57607b5e4fe4f67f79a8e5ba8966e8dec5
 2012-03-28 17:15:37 -07:00
Brad Fitzpatrick 2d0e0de553 index: skip dirs stating with _, like _obj 
Change-Id: I6c12e2f2740e417fa3858f9872e7ea60843c4877
 2012-03-28 16:45:54 -07:00
mpl 95b9622271 Check that all indexer packages have all the required tests 
Change-Id: I3c189060bce299235828a9d57a7bb679b05adffd
 2012-03-28 10:33:48 +02:00
Brad Fitzpatrick 6c6dcdc8a1 auth: in dev mode, use localhost TCP port owners before http basic auth 
Change-Id: I6a45518811fd8726233171d5436c625c645b4037
 2012-03-27 17:57:13 -07:00
Brad Fitzpatrick af78a93c9a netutil: implement IPv6 ident on Linux; add http auth handler example. 
Change-Id: I35c8993909cbddd22ace481a4a5bf7e36c323fec
 2012-03-27 17:28:42 -07:00
Brad Fitzpatrick 6078992fe0 netutil: implement ConnUserid on darwin. 
Change-Id: I6d163a921966dea4be9908c676bdb5d035cba295
 2012-03-27 15:54:34 -07:00
Brad Fitzpatrick 2838ec13dd netutil: add end-to-end ident test; passes on Linux, fails on Darwin 
Next up: implement on Darwin.

Change-Id: Ib41f5e5c6fd086dfc4bfd3205d1d807fbd9cecb2
 2012-03-27 10:58:41 -07:00
Brad Fitzpatrick 7f90db0291 rename mysqlindexer to mysql to match import 
Change-Id: I23cd9cfc40a0e01cb0086fc5c9a3ad108f3705a8
 2012-03-27 09:37:32 -07:00
Brad Fitzpatrick 69328c751f fix camdbinit; use correct mysqlindexer import 
Change-Id: I227e219ec32f81a11cc6192cd60de8b89878bedc
 2012-03-27 09:17:26 -07:00
Brad Fitzpatrick 10cf23c700 Get the MySQL indexer working again. 
It now uses the generic indexing layer, rather than its own schema.
Also, move it under pkg/index/, like mongo.
Also, link in mongo to the main binary.
Not using the tests yet (leaving for mpl :))

Change-Id: I47a2203ca6c0b5244cd458aedec46227c4363c62
 2012-03-26 13:57:53 -07:00
Brad Fitzpatrick ab9edea228 mysqlindexer: implement iterator. untested. 
Change-Id: I168e2b6c30c4f8a83c73a3530652f4fb82333cda
 2012-03-25 20:45:15 -07:00
Brad Fitzpatrick 0983831e68 mysqlindexer: implement batch mutation 
Change-Id: I7ff3c17cf082245cd11b29635079e73d9a565577
 2012-03-25 16:41:31 -07:00
Brad Fitzpatrick 401f07f6cf mysqlindexer: implement Get, Set, Delete 
Change-Id: I5670bfc9ac91044be663f248c034ae20c11562bb
 2012-03-25 00:30:22 -07:00
Brad Fitzpatrick cc75c449cf remove/move remnants of pkg/third_party 
Change-Id: Id86dc22bf3a870fee41bbc139872f549df278073
 2012-03-25 00:24:13 -07:00
Brad Fitzpatrick 26e8171f40 move third_party README 
Change-Id: Ia8ac7c601ca75d3fd51be3ac8bb462bd96b58c89
 2012-03-25 00:20:00 -07:00
Brad Fitzpatrick 615c85c3dc remove go-flickr from third_party 
Change-Id: Ic71d2f1964fbde26b8bd8d8a322d5de4743832da
 2012-03-25 00:17:45 -07:00
Brad Fitzpatrick c80b84c214 update gomemcache in third_party 
Change-Id: Ib7e39ebeed1a80351b90b6d9ee583952d0a255e6
 2012-03-25 00:00:43 -07:00
Brad Fitzpatrick 18fc785b33 remove github.com/Philio/GoMySQL from third_party 
Change-Id: Iaff46d2a4f6f11793e31ac5f6ae99e7e7b396612
 2012-03-24 23:54:07 -07:00
Brad Fitzpatrick c8e19a90d0 mysqlindexer: connect; ping 
Change-Id: Ic9a8422dc10c8514a4f10a14a878c5729068d56f
 2012-03-24 23:53:35 -07:00
Brad Fitzpatrick 9561cf3142 remove go-fuse from third_party 
Change-Id: Iccc1425d40ae895a585839fd0da0be16295c18a7
 2012-03-24 23:52:26 -07:00
Brad Fitzpatrick ef7e3c2e90 make pkg/mysqlindexer and camdbinit compile again, even if not working yet 
Change-Id: I3fbdfda6c456c079a3ac58ea988e43301e957f11
 2012-03-24 19:45:23 -07:00
Brad Fitzpatrick 125c33f019 camlistored: auto-generate a secring/keyId for new users, without gpg 
Change-Id: Ib653f9cb5fa0f5e4730854dfaea6c4654f94f377
 2012-03-19 21:31:20 -07:00
Brad Fitzpatrick ea2342bf35 jsonsign: add WriteKeyRing function & tests. 
Change-Id: Ic90751fd7834bf0e3bb0e1073fca647370561165
 2012-03-19 21:00:51 -07:00
Brad Fitzpatrick a7200af73e jsonsign: start of WriteKeyRing 
Change-Id: Id312578956d36b234d67d0c3f2ea3a261d122d48
 2012-03-19 19:02:18 -07:00
Brad Fitzpatrick 67e32df2bd Fix a bunch of broken tests, lost in the Go 1 conversion. 
Change-Id: I7c16563bc25f52868984c63e42125cd9bd9d5812
 2012-03-19 18:44:50 -07:00
Brad Fitzpatrick 81ac8e61ec serverconfig: don't hard-code .camli in default secring path 
Change-Id: Id174acaa5aa080e1c021c5032d1aa7cf45501b3e
 2012-03-19 13:49:41 -07:00
Brad Fitzpatrick 73cd34a6a0 serverconfig & camlistored: simplify low/high-level config bootstrapping. 
Change-Id: I22e003ff2eaa29b09a5c4cbb59afa1ca9bd624df
 2012-03-19 13:09:00 -07:00
Brad Fitzpatrick c7d3f606b2 osutil: add per-OS CamliBlobRoot; use .camlistore, not .camli 
Change-Id: I9e085d3f7a38357eca0bee0d5576a3db7cb1455e
 2012-03-19 13:07:46 -07:00
Brad Fitzpatrick f877e849d6 jsonconfig: sort unknown keys when returning errors 
Change-Id: I5930e8b6c18581e2b9901b4d7ebc1e02af7a7be6
 2012-03-19 13:07:17 -07:00
Brad Fitzpatrick 685189ca4c cammount: update to use rsc's fuse library; pkg/fs: butcher it up to make it compile. 
doesn't work again yet.

Change-Id: I462320918026944716638588d08ba76c67c72a73
 2012-03-18 23:54:20 -07:00
Brad Fitzpatrick 6ac0b8c027 WIP, porting pkg/fs to rsc's fuse library 
Change-Id: I81156bc518892d9b387607a89dc0655c74aeb42a
 2012-03-18 23:14:34 -07:00
mpl 7f630657d5 generate low level configuration 
Change-Id: I43d1610bdc386954dea724b4b38e184bf16e2d34
 2012-03-16 00:05:24 +01:00
Brad Fitzpatrick a229abeebd camget: fix build. update dev-camget. 
Change-Id: I5289801de7b50caedeabd9cc2513d768aafd424b
 2012-03-05 08:04:42 -08:00
Brad Fitzpatrick 1026c32f06 remove the db and dbimpl packages; now in the Go core as database/sql and database/sql/driver 
Change-Id: Ie88df6466f9b81e4320895049dd3611c43e0ea4a
 2012-03-05 07:34:01 -08:00
mpl 882f2d5eef generate default config for user when needed 
Change-Id: Ifb5897b38cd72f18ff7ce1e9c3a8c23ee8751ba1
 2012-03-05 00:04:35 +01:00
Brad Fitzpatrick 35e0f4805f cond: use new bytes.NewReader instead of bytes.NewBuffer 
Change-Id: If55c959983b5a894fc838d3d5aa2dd45e1e86892
 2012-03-03 12:43:37 -08:00
Brad Fitzpatrick 3ab1618f0b schema: generate unique permanodes. 
it was using second time granularity for both the random and the signing,
leading to dup permanode creation on fast machines.

Change-Id: Id7ea50f8ce8c4c3da6964e98bb3a09dc7992cec7
 2012-03-03 12:37:54 -08:00
Brad Fitzpatrick 7751fac185 fix dev-server for file embedding 
Change-Id: I23254930eaedf11a87389d85f54f86bafac20866
 2012-02-29 08:01:59 -08:00
Brad Fitzpatrick a98c59f082 include file modtimes in filembed 
Change-Id: I9255071c163664bd9b00786df65e630668e227d0
 2012-02-28 22:49:52 -08:00
Brad Fitzpatrick 552b768eeb add genfileembed tool, to embed html/css/js/etc into zembed_*.go files 2012-02-28 14:50:17 +11:00
Brad Fitzpatrick 64bbffc3b5 move fileembed from misc 2012-02-28 12:45:46 +11:00
mpl f9d0ad487e index packages reorganization 
Change-Id: Ie91c4bb5ea02a49e59ad093ac972d84b17a046d4
 2012-02-26 13:50:14 +01:00
ranveer d1e1f2bcb1 Add path/filepath 
Fixes broken build.

Change-Id: Ia691b76b9a4d3c92f310223166f53d65f1286ec1
 2012-02-22 10:52:21 -02:00
Brad Fitzpatrick af57ae8ae1 don't fail if mongo isn't available 
Change-Id: I60754c1f0ec6a942c77ae9618c9a9ee12071ddb4
 2012-02-22 01:23:23 -08:00
mpl 5a2c060409 mongo tests now actually fail when no mongodb running 
Change-Id: I470c2184c620fa0bba02001ea6877a95cf53d9d6
 2012-02-21 15:25:29 +01:00
mpl d40c9dce1d update memindex: use default for db r/w options, 
update secring path in test,
-> all tests in index now pass

Change-Id: I8fdd99aad1d0d009cf99c773801a9ae875b56137
 2012-02-21 11:51:54 +01:00
mpl a7c4d1f03a time details 
Change-Id: Ic4041956e1d7d3b50fea00ab970a68f3c4c2e80d
 2012-02-21 11:01:27 +01:00
mpl 28caffab1f remove empty blob dirs in queue. fixes issue 47. 
Change-Id: If07576825123be910f040f0c5a0dc6988d55de08
 2012-02-20 15:07:14 +01:00
mpl 50df48d519 first pass with mgo as indexer 
fixed indexer so that it builds as a package
added mgo as a third party
fixed mgoindexer
fixed (hackishly) tests so that they pass
I ignored everything memindex for now

Change-Id: I3c03ecfa859cf92b088a759239278b1c0edaf8aa
 2012-02-20 14:40:24 +01:00
Brad Fitzpatrick 0714a463c9 Update from r60 to [almost] Go 1. 
A lot is still broken, but most stuff at least compiles now.

The directory tree has been rearranged now too.  Go libraries are now
under "pkg".  Fully qualified, they are e.g. "camlistore.org/pkg/jsonsign".

The go tool cannot yet fetch from arbitrary domains, but discussion is
happening now on which mechanism to use to allow that.

For now, put the camlistore root under $GOPATH/src.  Typically $GOPATH
is $HOME, so Camlistore should be at $HOME/src/camlistore.org.

Then you can:

$ go build ./server/camlistored

... etc

The build.pl script is currently disabled.  It'll be resurrected at
some point, but with a very different role (helping create a fake
GOPATH and running the go build command, if things are installed at
the wrong place, and/or running fileembed generators).

Many things are certainly broken.

Many things are disabled.  (MySQL, all indexing, etc).

Many things need to be moved into
camlistore.org/third_party/{code.google.com,github.com} and updated
from their r60 to Go 1 versions, where applicable.

The GoMySQL stuff should be updated to use database/sql and the ziutek
library implementing database/sql/driver.

Help wanted.

Change-Id: If71217dc5c8f0e70dbe46e9504ca5131c6eeacde
 2012-02-18 21:53:06 -08:00