Rooba
/
perkeep
mirror of https://github.com/perkeep/perkeep.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,861 Commits 44 Branches 11 Tags 59 MiB
Commit Graph

2861 Commits

Author SHA1 Message Date
Brad Fitzpatrick c304ea4b40 Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2013-08-22 23:33:31 -05:00
Brad Fitzpatrick dac140ff52 camweb: also watch git and email list on new commits 
Change-Id: I032b1c86226137f19b800d6fdebae0207e90f271
 2013-08-22 23:33:23 -05:00
Brad Fitzpatrick 01ce385929 Import github.com/cznic/kv to third_party at commit 65538fcfac3fcb64c15964827dfb7eb8634b3997 
Change-Id: I89c53724978695cfe5457ee20aca482d8830fa00
 2013-08-22 15:38:24 -05:00
Josh Huckabee 8bf1eb8a9b Add postgres setting to default config file. 
Change-Id: I45f374e61f17286f5c825ef537d052407ff1bccd
 2013-08-22 10:02:58 -07:00
Brad Fitzpatrick 97ae2ba095 Merge "camweb: Correct redirect URL for /gw/" 2013-08-22 05:25:34 +00:00
Bill Thiede ef4719a78c devcam: handle failed camlistored execution. 
Issue https://camlistore.org/issue/208

Change-Id: Ie5bf46d13023bc82f7e2934947393708c9308915
 2013-08-21 20:22:33 -07:00
Bill Thiede ad876efcb1 camweb: Correct redirect URL for /gw/ 
Tested with:

$ curl -i -L http://localhost:31798/gw/502aff1fd522c454e39a3723b596aca43d206d4e
HTTP/1.1 302 Found
Location:
https://camlistore.googlesource.com/camlistore/+/502aff1fd522c454e39a3723b596aca43d206d4e
Content-Type: text/html; charset=utf-8
Content-Length: 112
Date: Thu, 22 Aug 2013 03:05:28 GMT

HTTP/1.1 200 OK
Content-Type: text/html; charset=UTF-8
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Pragma: no-cache
Expires: Fri, 01 Jan 1990 00:00:00 GMT
Date: Thu, 22 Aug 2013 03:05:28 GMT
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-XSS-Protection: 1; mode=block
Server: GSE
Transfer-Encoding: chunked

<!DOCTYPE HTML PUBLIC...

Change-Id: Id10f8ea1668dee85f08d3e30947464a45dc4666a
 2013-08-21 20:04:53 -07:00
Brad Fitzpatrick d662024fcf Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2013-08-21 20:04:21 -05:00
Brad Fitzpatrick d293b8fd34 Use pkg/gate in a couple places. Do s3 parallel state. Update TODO. 
Change-Id: I23006baa7b454ceca3f07c8fa7789ad54c524849
 2013-08-21 19:05:52 -05:00
Brad Fitzpatrick 41bbabc26f Add pkg/gate, to limit concurrency. 
Change-Id: I0a75e0caa7bcf16f7b7b93ca7366cfe0c9a4cbd2
 2013-08-21 19:00:43 -05:00
Brad Fitzpatrick ae20a0f7de Ditch App Engine ContextWrapper noise; add test that App Engine always compiles. 
I had broken App Engine in my previous commit, since it wasn't part of 'make presubmit'

Change-Id: I32c25efbc7c348ff516128c87b6e817ae0685386
 2013-08-21 18:51:10 -05:00
Brad Fitzpatrick 5ce2aa2ba0 Ignore server/appengine/source_root/ 
Change-Id: Iaf784f7d0df83b4e7a7425f37a2f2f60f7507114
 2013-08-21 18:30:10 -05:00
Brad Fitzpatrick 09ad86f964 Merge "buildbot: use make.go" 2013-08-21 21:57:42 +00:00
Brad Fitzpatrick b24cad68dd Cleanup: remove BlobHub and time.Duration waits from storage interface 
Move up a layer to the HTTP.  Also, start to remove ContextWrapper
stuff.  We've done it differently for App Engine instead, and will do
it differently yet moving forward.

Also add blobserver.Receive and use it in most places, moving checksum
verification up a layer.

Bunch of other cleanup and TODO fixing too.

Much simpler and cleaner.

Change-Id: I12e56c5d4e53bfcf82bdd8fb0b6d57c248ff605c
 2013-08-21 13:57:28 -07:00
mpl b3b16f73c2 buildbot: use make.go 
Change-Id: I76544d7e0601be9a5bc2b9378a29db6c97894d76
 2013-08-21 19:33:55 +02:00
Brad Fitzpatrick f13fe9303f Merge "serverconfig: cleanup from previous review." 2013-08-21 17:02:38 +00:00
Bill Thiede 1ffd89a918 serverconfig: cleanup from previous review. 
Addressing the comments in https://camlistore.org/r/510

Change-Id: I4523afe76805dbbb2247ece527b8e058ecd087f4
 2013-08-21 09:55:57 -07:00
Brad Fitzpatrick 5b63bcb628 Note to add more tests for pkg/auth 
Change-Id: I5b2d0139c4acc60a3b8ed33f92cd5ea085baea8a
 2013-08-21 07:39:55 -07:00
Brad Fitzpatrick a406f3e884 Merge "auth: Fixed regression introduced with a4d187f" 2013-08-21 14:39:26 +00:00
mpl b8bcbc6cfe Merge "serverconfig: idle synchandler when no localdisk as primary storage" 2013-08-21 13:18:20 +00:00
mpl 4acc10e6e4 serverconfig: idle synchandler when no localdisk as primary storage 
Because no localdisk means either s3 or google is the primary,
and none of them support efficient replication.

1) Added a dummy synchandler constructor for when config has "idle"
2) Set "idle" for synchandler config when no localdisk
3) fixed corresponding tests

Also:
- added error (and test) when no localdisk and both s3 and google
in config
- added s3 + mysql test

http://camlistore.org/issue/201

Change-Id: I861fdca0c203bc0181ab6d548adab501ed98d2f0
 2013-08-21 15:17:13 +02:00
Bill Thiede 8152d513d9 auth: Fixed regression introduced with a4d187f 
Tested with:

(shell1) host1$ devcam server -all
(shell2) host1$  curl -i http://localhost:3179/ui/
HTTP/1.1 200 OK
...

(shell1) host2$  wget -qS http://sagan:3179/ui/ -O -
  HTTP/1.1 401 Unauthorized
  Www-Authenticate: Basic realm="Any username, password is: pass3179"
  Content-Type: text/html; charset=utf-8
  Content-Length: 33
  Date: Wed, 21 Aug 2013 03:07:50 GMT

(shell1) host2$ wget -qS http://user:pass3179@sagan:3179/ui/ -O -
  HTTP/1.1 401 Unauthorized
  Www-Authenticate: Basic realm="Any username, password is: pass3179"
  Content-Type: text/html; charset=utf-8
  Content-Length: 33
  Date: Wed, 21 Aug 2013 03:06:54 GMT
  HTTP/1.1 200 OK
  Accept-Ranges: bytes
  Content-Length: 1213
  Content-Type: text/html; charset=utf-8
  Last-Modified: Thu, 04 Jul 2013 02:08:28 GMT
  Vary: Accept
  Date: Wed, 21 Aug 2013 03:06:54 GMT
<!doctype html>
...

This should resolve https://code.google.com/p/camlistore/issues/detail?id=204

Change-Id: I68ef2a0d93df56172033c2cbac4170e54d6452be
 2013-08-20 20:02:16 -07:00
Brad Fitzpatrick 6dac08f539 localdisk: don't allocate 512 KB on each readdir 
Change-Id: I3e71605f0ef53351f0ee50bb78bdfbf6b5d7dca1
 2013-08-20 16:29:24 -07:00
Brad Fitzpatrick 3ec3588f06 Merge "perf: perform password auth before checking UID." 2013-08-20 15:18:35 +00:00
Brad Fitzpatrick 3eb520617e Merge "serverconfig: conditionally install pprof handler." 2013-08-20 15:17:25 +00:00
mpl b243dc268d make.go: fix cross-compiling 
http://camlistore.org/issue/198

Change-Id: Ic1bf1e458d8e197b85137ad1721820fbf31cb755
 2013-08-20 17:09:53 +02:00
Bill Thiede a4d187f7ee perf: perform password auth before checking UID. 
On FreeBSD DevAuth was showing up as consuming ~10% of the time when doing big
camputs.  It disappears with this change. FreeBSD and Mac exec external
programs for localhost auth, so I imagine they'll both benefit.
On linux, checking the password in memory is (probably) still faster than
reading from /proc (which I'm assuming turns into a roundtrip
userland->kernel->userland which is nice to avoid).

Making the change to UserPass under the assumption the performance improvement
would be similar.  Untested/unprofiled though.

Change-Id: Idb7e888df6e9a36db0be671a44911e018eb7986e
 2013-08-19 21:46:01 -07:00
Bill Thiede 75c79b5a77 serverconfig: conditionally install pprof handler. 
This change enables the ability to profile with:
go tool pprof http://<host>:<port>/debug/pprof/profile

Setting CAMLI_HTTP_PPROF=1 in your environment before running camlistored will
enable the handler.

Change-Id: I91993f5166e257e5be406a4d2c3e6bc0028a435a
 2013-08-19 21:36:13 -07:00
mpl 1d9e606ccd Merge "devcam appengine: replaces ./dev-appengine" 2013-08-19 22:11:21 +00:00
mpl a41c89a24e devcam appengine: replaces ./dev-appengine 
Change-Id: Ic4adcb8898fc3ead801aefd679682bcc646f3573
 2013-08-20 00:10:01 +02:00
mpl 47ff2102c3 server config: document implicit mirroring for blob storage 
http://camlistore.org/issue/201

Change-Id: Icda250242f88dad80cd48d6417d4944341e3dd26
 2013-08-19 22:51:57 +02:00
mpl 071525e06c google drive: fix import example to shut rewrite-imports.sh up 
Change-Id: Id699b35e9beb99f2ba84a1e427a04c892a5e7b73
 2013-08-19 17:33:59 +02:00
mpl 31df3635a4 camput: ignore files like .DS_Store with -filenodes 
Also made initTrustedCertsOnce a field of the Client
object, as it is a similar change.

http://camlistore.org/issue/104

Change-Id: Iabbd7f06e06d31265f390a23c4bdaac956f856f7
 2013-08-19 17:21:10 +02:00
Burcu Dogan 2309d3d77b server-config doc: fix google cloud storage config identifier. 
Change-Id: I35769c851d67131581f3c3ef43b5daa5f4130ec7
 2013-08-18 21:48:02 +02:00
Bill Thiede c5434e293d netutil: for better backtraces use named function. 
Per feedback on https://camlistore-review.googlesource.com/507

Change-Id: Id6c0e4f66d221e6677167aaf590dc3cc696e5391
 2013-08-18 11:36:35 -07:00
Brad Fitzpatrick f665ca05d3 Merge "netutil: On FreeBSD replace call to lsof(1) with sockstat(1)." 2013-08-18 17:12:02 +00:00
Bill Thiede 502aff1fd5 camweb,buildbot: Update camlistore git repo URLs. 
Also add redirect for /code/ request with a commit hash to new code host.

Change-Id: I68a8746dacb6f0a4fc6719e3f5ed23ee0f37778b
 2013-08-18 08:56:16 -07:00
Bill Thiede 3418ed1d89 netutil: On FreeBSD replace call to lsof(1) with sockstat(1). 
sockstat(1) is in the base system image, whereas lsof(1) is only avaible
through ports.

The addresses Issue 190

Change-Id: I5e3cd6b6c10d2aa75f799320d80acfd61275ea62
 2013-08-18 03:41:03 +00:00
Brad Fitzpatrick b0d2a8f0e5 Merge "Adding Google Drive as a storage backend experimentally. No cheap-enough way of enumerating Drive files, needs to be fixed once Drive supports range queries. Allows you to sync to /sto-googledrive/, but not from." 2013-08-17 15:51:51 +00:00
Brad Fitzpatrick a2e79bf45d C: add Burcu Dogan (Google CLA) 
Change-Id: I235d7d4a4653e23f9c0f9e18f165d76ec167fc96
 2013-08-17 08:48:35 -07:00
Burcu Dogan 6e6e910af1 Adding Google Drive as a storage backend experimentally. No cheap-enough way 
of enumerating Drive files, needs to be fixed once Drive supports
range queries. Allows you to sync to /sto-googledrive/, but not from.

Change-Id: I6ac5ef02c5f51a6abdab5c207a3a5693c6bb8581
 2013-08-17 15:30:02 +02:00
mpl 477bf96f33 devcam server: handle SIGQUIT 
Somehow forgot last patch when doing
http://camlistore.org/r/452

Change-Id: I10841ebff29689af19773e8f9d99c5c16659cfc1
 2013-08-17 00:43:53 +02:00
mpl 3239048566 server-config doc: added section anchors 
Change-Id: Id35566e6cdf7e38e576494008f2bbdf9405021fd
 2013-08-16 19:45:05 +02:00
mpl d992780f03 Merge "camlistored: help getting started on windows" 2013-08-16 17:19:12 +00:00
mpl f5709afdd8 camlistored: help getting started on windows 
-fail early when new config has sqlite but no sqlite installed
-hint at the server config doc url
-added windows with mysql section in the server config doc
-fixed typo in mongo indexer option

Change-Id: I4266eb6e34a55901e6af90a32eb1411fb5c37688
 2013-08-16 19:14:30 +02:00
Brad Fitzpatrick 5f4f42dfa7 Merge "appengine: fix the UI" 2013-08-16 16:58:27 +00:00
Brad Fitzpatrick b6e9e98c69 website: typo 
Change-Id: I1cbaaf3e9b4ec898dc55a5bc423d72205a9d4dee
 2013-08-16 09:52:29 -07:00
mpl 40951c103f appengine: fix the UI 
-dev-appengine populates the default sourceRoot.
-app.yaml filters out the go files from the static
resources
-the UI handler warns that sourceRoot is required

Change-Id: I816456a882ff4b0573bc8962cce85139d8a0f611
 2013-08-16 18:49:51 +02:00
Brad Fitzpatrick 7364fd6110 link to camlipy 
Change-Id: I54b16e8f0d6c8216957e9a0655edbd596e3f3036
 2013-08-15 10:07:58 -07:00
Brad Fitzpatrick b6a8dc3351 More git links updated 
Change-Id: I2e527d73c2907dbc87e84a876b0f0ba7b2cf18b9
 2013-08-14 10:47:56 -07:00