Commit Graph

3095 Commits

Author SHA1 Message Date
Brad Fitzpatrick ec5e56a578 Handle stale locks. (0b2efbb556 from github.com/camlistore/lock)
Change-Id: I31879f4f98c8a8dcc55734d35842009c2158a8e6
2013-08-26 09:06:55 -05:00
mpl 6bc558910d devcam: bugfix; do not fail when binary does not exist
http://camlistore.org/issue/213

Change-Id: I432a8ec04cb02c4c5241bd38361fad3d6d39ee02
2013-08-26 15:14:52 +02:00
Bill Thiede ac4ed5492b envvardoc: new tool to find undocumented env vars.
This tool will walk over interesting directories (-srcDirs flag) in the
source tree and look for references to environement variables. It then
cross-references these with environment variables found in a documentaion file
(-doc flag).  Any values found in source but not documented are printed to the
screen, and the exit code is set to non-zero.  Not all environment variables
are considered, only those matching one of the prefixes (-prefixes flag).

The change also begins the process of documenting environment variables.

Change-Id: Ie122b64b7befcb3104b960cf3d2d22bae443f67f
2013-08-25 21:28:23 -07:00
Brad Fitzpatrick c55bf01f84 Move osutil.Lock to its own package
Now in a small repo at github.com/camlistore/lock and brought into our third_party.

Change-Id: I966ca6126dde8b7c2e03f0d9fab1e36abd66c2ef
2013-08-25 19:53:01 -05:00
Brad Fitzpatrick 496b3d091f kv: import c721b822b5
Change-Id: Iff228f076abd5deacab1f8771edc9d87221a4dcc
2013-08-25 14:11:10 -05:00
Brad Fitzpatrick ef6bc9499e Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2013-08-25 12:58:34 -05:00
Brad Fitzpatrick 46020e1551 Make kvfile index the default if SQLite isn't available.
We now work out of the box, with no external dependencies.

Change-Id: I8d0cedb33518e418a7ff28cdb22f9ba9ef400d6f
2013-08-25 12:57:51 -05:00
Brad Fitzpatrick 87451bb5bd index/kvfile: use new Locker hook in kv to use osutil's Lock func
Change-Id: I7573ea79f5f99ef1b7fe03bd9270b61940339a56
2013-08-25 12:56:36 -05:00
Brad Fitzpatrick 6a8f653ef0 osutil: more details on Lock failure
Change-Id: I84764dc257a9a8bf8fddd55f9f22fa67a8c3bdfb
2013-08-25 12:56:04 -05:00
Brad Fitzpatrick 2ddb716b83 Merge "devcam: add -openbrowser flag. Don't open the start page on browser by default." 2013-08-25 17:31:46 +00:00
Brad Fitzpatrick 1e15d7ee89 Merge "camlistored: Adding --openbrowser flag, determines whether start page should be opened in browser. Start page should be / on the initial startup to let the user to config the server, and /<uiPath> on the following starts." 2013-08-25 17:31:35 +00:00
Brad Fitzpatrick e9d5346eb2 Update github.com/cznic/kv to github.com/camlistore/kv fork at c7613936816
(Let lock function be pluggable.)

Change-Id: I3bd33527ab52a020d152262aeb19c8c87ac45409
2013-08-25 12:30:09 -05:00
Brad Fitzpatrick 44acc3b2e7 serverconfig: add kvfile support
Change-Id: If8b4d6b74711cfc169e66ab60a568bcb9b67a7d0
2013-08-25 12:25:30 -05:00
Burcu Dogan 2de9f8aafd devcam: add -openbrowser flag. Don't open the start page on browser by default.
Change-Id: I1dc3804bf192dc5119c7d05758ccbacd0e7740f1
2013-08-25 18:28:54 +02:00
Burcu Dogan d0d5f3a1fa camlistored: Adding --openbrowser flag, determines whether start page should be opened in browser. Start page should be / on the initial startup to let the user to config the server, and /<uiPath> on the following starts.
Change-Id: I3ac055161c5023bd338fccccda83376df7381c64
2013-08-25 12:30:46 +02:00
Brad Fitzpatrick db18ff8a60 Fix Windows build.
Change-Id: I7c42165ac632a63e18d1cf6eea844b0025a4060d
2013-08-23 18:05:33 -05:00
Brad Fitzpatrick 500ba50b97 devcam: make kvfile the default dev-server indexer.
Memory index requires -memindex now.

Change-Id: I6df424e88c3783e397c528cd8633402a9edf3d95
2013-08-23 17:19:21 -05:00
Brad Fitzpatrick d6a0b34e5f camlistored: link in kvfile
Change-Id: I55f65275b45f7de0efc0c52e84ac61f4baebaa38
2013-08-23 17:14:33 -05:00
Brad Fitzpatrick 4fa8c3117a Add pkg/index/kvfile: index.Storage impl on top of github.com/cznic/kv
Change-Id: I4adb44c4e70ad8e68b4292fefbbd02e0a52beb6c
2013-08-23 17:13:42 -05:00
Brad Fitzpatrick 2c2c1723bd Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2013-08-23 17:11:03 -05:00
Brad Fitzpatrick 1d53a84c66 jsonconfig: fix inconsistencies with booleans from environment variables
Use strconv.ParseBool.

Change-Id: Icbf27c78d9f144e333ba67063f4c1e32822fe9e8
2013-08-23 17:10:56 -05:00
mpl 99aaf3b55e client: take into account "selfPubKeyDir" from config when signing
http://camlistore.org/issue/210

Change-Id: Id6d75393a90bdf3141acc10fddc2b3cedee64422
2013-08-23 21:31:03 +02:00
Brad Fitzpatrick 9bfb89967c pkg/blob: optimize MarshalJSON.
No real reason. Just finishing a TODO.

Change-Id: I9266cee9d3872f9b27baa8287b967e9446e1314d
2013-08-23 13:41:20 -05:00
Brad Fitzpatrick ec4af83d19 pkg/blob: implement Go 1.2's encoding.BinaryMarshaler
Change-Id: Ic9fbbd4cdd99fbf19ed2467f9fc151c688ec048f
2013-08-23 13:30:18 -05:00
Brad Fitzpatrick f243811297 Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2013-08-23 11:54:30 -05:00
Brad Fitzpatrick d7898d4712 pkg/osutil: add Lock function and tests.
Prep for using cznic/kv in camput and as index.Storage.

Change-Id: If912f7cb6b33247217f7812ac2082414436c0bf5
2013-08-23 11:54:25 -05:00
Bill Thiede 80dfa10a62 github.com/cznic/fileutil: fix FreeBSD build.
Fixes build broken in
https://camlistore.org/gw/01ce3859291e9e012b497af13a4c2dd82d2d1d4f

Change-Id: Ieede30ab41c6896f0b9964895ca7237fa6c34b5a
2013-08-23 09:47:08 -07:00
Brad Fitzpatrick 7dd7f948cc localdisk: fix Stat deadlock regression, use pkg/gate.
The errc channel needs to be buffered. Broken by b24cad68dd which
radically simplified this method.

Change-Id: I7f4df7d47cca78d6098000b926d7b734dd712bfa
2013-08-23 09:20:21 -05:00
Brad Fitzpatrick 9c42969138 client: cleanup. use blob.Ref as map key, not its String form
Change-Id: I52d7e6db891b9f92054088701374896750f42390
2013-08-23 09:06:40 -05:00
Brad Fitzpatrick c5761f5ed8 Add dev/push script.
Change-Id: I84f12d8df8d65a3d7a5d3287266849f250283502
2013-08-23 00:13:09 -05:00
Brad Fitzpatrick c8479f6fd4 camweb: fix git fetch command.
Change-Id: Ibf4203324ea182750815df4dee48bd30cc70920b
2013-08-23 00:08:13 -05:00
Brad Fitzpatrick 0c6c9d597f website: more debug logging
Change-Id: Idd7b42a0f518878f8b941dc79f8d94663ed4c697
2013-08-23 00:03:07 -05:00
Brad Fitzpatrick d93cb4098f website: support 304 Not Modified
Change-Id: I711e78d1a138f243bcacbcba3f9559202ee8d808
2013-08-22 23:53:49 -05:00
Brad Fitzpatrick e5dfcf644f website: configure camlistore.org to send emails on commits
Change-Id: I976897b59006dbfb0e51f676fb6ea4f893bfb3c7
2013-08-22 23:41:49 -05:00
Brad Fitzpatrick c304ea4b40 Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2013-08-22 23:33:31 -05:00
Brad Fitzpatrick dac140ff52 camweb: also watch git and email list on new commits
Change-Id: I032b1c86226137f19b800d6fdebae0207e90f271
2013-08-22 23:33:23 -05:00
Brad Fitzpatrick 01ce385929 Import github.com/cznic/kv to third_party at commit 65538fcfac3fcb64c15964827dfb7eb8634b3997
Change-Id: I89c53724978695cfe5457ee20aca482d8830fa00
2013-08-22 15:38:24 -05:00
Josh Huckabee 8bf1eb8a9b Add postgres setting to default config file.
Change-Id: I45f374e61f17286f5c825ef537d052407ff1bccd
2013-08-22 10:02:58 -07:00
Brad Fitzpatrick 97ae2ba095 Merge "camweb: Correct redirect URL for /gw/" 2013-08-22 05:25:34 +00:00
Bill Thiede ef4719a78c devcam: handle failed camlistored execution.
Issue https://camlistore.org/issue/208

Change-Id: Ie5bf46d13023bc82f7e2934947393708c9308915
2013-08-21 20:22:33 -07:00
Bill Thiede ad876efcb1 camweb: Correct redirect URL for /gw/
Tested with:

$ curl -i -L http://localhost:31798/gw/502aff1fd522c454e39a3723b596aca43d206d4e
HTTP/1.1 302 Found
Location:
https://camlistore.googlesource.com/camlistore/+/502aff1fd522c454e39a3723b596aca43d206d4e
Content-Type: text/html; charset=utf-8
Content-Length: 112
Date: Thu, 22 Aug 2013 03:05:28 GMT

HTTP/1.1 200 OK
Content-Type: text/html; charset=UTF-8
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Pragma: no-cache
Expires: Fri, 01 Jan 1990 00:00:00 GMT
Date: Thu, 22 Aug 2013 03:05:28 GMT
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-XSS-Protection: 1; mode=block
Server: GSE
Transfer-Encoding: chunked

<!DOCTYPE HTML PUBLIC...

Change-Id: Id10f8ea1668dee85f08d3e30947464a45dc4666a
2013-08-21 20:04:53 -07:00
Brad Fitzpatrick d662024fcf Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2013-08-21 20:04:21 -05:00
Brad Fitzpatrick d293b8fd34 Use pkg/gate in a couple places. Do s3 parallel state. Update TODO.
Change-Id: I23006baa7b454ceca3f07c8fa7789ad54c524849
2013-08-21 19:05:52 -05:00
Brad Fitzpatrick 41bbabc26f Add pkg/gate, to limit concurrency.
Change-Id: I0a75e0caa7bcf16f7b7b93ca7366cfe0c9a4cbd2
2013-08-21 19:00:43 -05:00
Brad Fitzpatrick ae20a0f7de Ditch App Engine ContextWrapper noise; add test that App Engine always compiles.
I had broken App Engine in my previous commit, since it wasn't part of 'make presubmit'

Change-Id: I32c25efbc7c348ff516128c87b6e817ae0685386
2013-08-21 18:51:10 -05:00
Brad Fitzpatrick 5ce2aa2ba0 Ignore server/appengine/source_root/
Change-Id: Iaf784f7d0df83b4e7a7425f37a2f2f60f7507114
2013-08-21 18:30:10 -05:00
Brad Fitzpatrick 09ad86f964 Merge "buildbot: use make.go" 2013-08-21 21:57:42 +00:00
Brad Fitzpatrick b24cad68dd Cleanup: remove BlobHub and time.Duration waits from storage interface
Move up a layer to the HTTP.  Also, start to remove ContextWrapper
stuff.  We've done it differently for App Engine instead, and will do
it differently yet moving forward.

Also add blobserver.Receive and use it in most places, moving checksum
verification up a layer.

Bunch of other cleanup and TODO fixing too.

Much simpler and cleaner.

Change-Id: I12e56c5d4e53bfcf82bdd8fb0b6d57c248ff605c
2013-08-21 13:57:28 -07:00
mpl b3b16f73c2 buildbot: use make.go
Change-Id: I76544d7e0601be9a5bc2b9378a29db6c97894d76
2013-08-21 19:33:55 +02:00
Brad Fitzpatrick f13fe9303f Merge "serverconfig: cleanup from previous review." 2013-08-21 17:02:38 +00:00