Commit Graph

2846 Commits

Author SHA1 Message Date
Brad Fitzpatrick f13fe9303f Merge "serverconfig: cleanup from previous review." 2013-08-21 17:02:38 +00:00
Bill Thiede 1ffd89a918 serverconfig: cleanup from previous review.
Addressing the comments in https://camlistore.org/r/510

Change-Id: I4523afe76805dbbb2247ece527b8e058ecd087f4
2013-08-21 09:55:57 -07:00
Brad Fitzpatrick 5b63bcb628 Note to add more tests for pkg/auth
Change-Id: I5b2d0139c4acc60a3b8ed33f92cd5ea085baea8a
2013-08-21 07:39:55 -07:00
Brad Fitzpatrick a406f3e884 Merge "auth: Fixed regression introduced with a4d187f" 2013-08-21 14:39:26 +00:00
mpl b8bcbc6cfe Merge "serverconfig: idle synchandler when no localdisk as primary storage" 2013-08-21 13:18:20 +00:00
mpl 4acc10e6e4 serverconfig: idle synchandler when no localdisk as primary storage
Because no localdisk means either s3 or google is the primary,
and none of them support efficient replication.

1) Added a dummy synchandler constructor for when config has "idle"
2) Set "idle" for synchandler config when no localdisk
3) fixed corresponding tests

Also:
- added error (and test) when no localdisk and both s3 and google
in config
- added s3 + mysql test

http://camlistore.org/issue/201

Change-Id: I861fdca0c203bc0181ab6d548adab501ed98d2f0
2013-08-21 15:17:13 +02:00
Bill Thiede 8152d513d9 auth: Fixed regression introduced with a4d187f
Tested with:

(shell1) host1$ devcam server -all
(shell2) host1$  curl -i http://localhost:3179/ui/
HTTP/1.1 200 OK
...

(shell1) host2$  wget -qS http://sagan:3179/ui/ -O -
  HTTP/1.1 401 Unauthorized
  Www-Authenticate: Basic realm="Any username, password is: pass3179"
  Content-Type: text/html; charset=utf-8
  Content-Length: 33
  Date: Wed, 21 Aug 2013 03:07:50 GMT

(shell1) host2$ wget -qS http://user:pass3179@sagan:3179/ui/ -O -
  HTTP/1.1 401 Unauthorized
  Www-Authenticate: Basic realm="Any username, password is: pass3179"
  Content-Type: text/html; charset=utf-8
  Content-Length: 33
  Date: Wed, 21 Aug 2013 03:06:54 GMT
  HTTP/1.1 200 OK
  Accept-Ranges: bytes
  Content-Length: 1213
  Content-Type: text/html; charset=utf-8
  Last-Modified: Thu, 04 Jul 2013 02:08:28 GMT
  Vary: Accept
  Date: Wed, 21 Aug 2013 03:06:54 GMT
<!doctype html>
...

This should resolve https://code.google.com/p/camlistore/issues/detail?id=204

Change-Id: I68ef2a0d93df56172033c2cbac4170e54d6452be
2013-08-20 20:02:16 -07:00
Brad Fitzpatrick 6dac08f539 localdisk: don't allocate 512 KB on each readdir
Change-Id: I3e71605f0ef53351f0ee50bb78bdfbf6b5d7dca1
2013-08-20 16:29:24 -07:00
Brad Fitzpatrick 3ec3588f06 Merge "perf: perform password auth before checking UID." 2013-08-20 15:18:35 +00:00
Brad Fitzpatrick 3eb520617e Merge "serverconfig: conditionally install pprof handler." 2013-08-20 15:17:25 +00:00
mpl b243dc268d make.go: fix cross-compiling
http://camlistore.org/issue/198

Change-Id: Ic1bf1e458d8e197b85137ad1721820fbf31cb755
2013-08-20 17:09:53 +02:00
Bill Thiede a4d187f7ee perf: perform password auth before checking UID.
On FreeBSD DevAuth was showing up as consuming ~10% of the time when doing big
camputs.  It disappears with this change. FreeBSD and Mac exec external
programs for localhost auth, so I imagine they'll both benefit.
On linux, checking the password in memory is (probably) still faster than
reading from /proc (which I'm assuming turns into a roundtrip
userland->kernel->userland which is nice to avoid).

Making the change to UserPass under the assumption the performance improvement
would be similar.  Untested/unprofiled though.

Change-Id: Idb7e888df6e9a36db0be671a44911e018eb7986e
2013-08-19 21:46:01 -07:00
Bill Thiede 75c79b5a77 serverconfig: conditionally install pprof handler.
This change enables the ability to profile with:
go tool pprof http://<host>:<port>/debug/pprof/profile

Setting CAMLI_HTTP_PPROF=1 in your environment before running camlistored will
enable the handler.

Change-Id: I91993f5166e257e5be406a4d2c3e6bc0028a435a
2013-08-19 21:36:13 -07:00
mpl 1d9e606ccd Merge "devcam appengine: replaces ./dev-appengine" 2013-08-19 22:11:21 +00:00
mpl a41c89a24e devcam appengine: replaces ./dev-appengine
Change-Id: Ic4adcb8898fc3ead801aefd679682bcc646f3573
2013-08-20 00:10:01 +02:00
mpl 47ff2102c3 server config: document implicit mirroring for blob storage
http://camlistore.org/issue/201

Change-Id: Icda250242f88dad80cd48d6417d4944341e3dd26
2013-08-19 22:51:57 +02:00
mpl 071525e06c google drive: fix import example to shut rewrite-imports.sh up
Change-Id: Id699b35e9beb99f2ba84a1e427a04c892a5e7b73
2013-08-19 17:33:59 +02:00
mpl 31df3635a4 camput: ignore files like .DS_Store with -filenodes
Also made initTrustedCertsOnce a field of the Client
object, as it is a similar change.

http://camlistore.org/issue/104

Change-Id: Iabbd7f06e06d31265f390a23c4bdaac956f856f7
2013-08-19 17:21:10 +02:00
Burcu Dogan 2309d3d77b server-config doc: fix google cloud storage config identifier.
Change-Id: I35769c851d67131581f3c3ef43b5daa5f4130ec7
2013-08-18 21:48:02 +02:00
Bill Thiede c5434e293d netutil: for better backtraces use named function.
Per feedback on https://camlistore-review.googlesource.com/507

Change-Id: Id6c0e4f66d221e6677167aaf590dc3cc696e5391
2013-08-18 11:36:35 -07:00
Brad Fitzpatrick f665ca05d3 Merge "netutil: On FreeBSD replace call to lsof(1) with sockstat(1)." 2013-08-18 17:12:02 +00:00
Bill Thiede 502aff1fd5 camweb,buildbot: Update camlistore git repo URLs.
Also add redirect for /code/ request with a commit hash to new code host.

Change-Id: I68a8746dacb6f0a4fc6719e3f5ed23ee0f37778b
2013-08-18 08:56:16 -07:00
Bill Thiede 3418ed1d89 netutil: On FreeBSD replace call to lsof(1) with sockstat(1).
sockstat(1) is in the base system image, whereas lsof(1) is only avaible
through ports.

The addresses Issue 190

Change-Id: I5e3cd6b6c10d2aa75f799320d80acfd61275ea62
2013-08-18 03:41:03 +00:00
Brad Fitzpatrick b0d2a8f0e5 Merge "Adding Google Drive as a storage backend experimentally. No cheap-enough way of enumerating Drive files, needs to be fixed once Drive supports range queries. Allows you to sync to /sto-googledrive/, but not from." 2013-08-17 15:51:51 +00:00
Brad Fitzpatrick a2e79bf45d C: add Burcu Dogan (Google CLA)
Change-Id: I235d7d4a4653e23f9c0f9e18f165d76ec167fc96
2013-08-17 08:48:35 -07:00
Burcu Dogan 6e6e910af1 Adding Google Drive as a storage backend experimentally. No cheap-enough way
of enumerating Drive files, needs to be fixed once Drive supports
range queries. Allows you to sync to /sto-googledrive/, but not from.

Change-Id: I6ac5ef02c5f51a6abdab5c207a3a5693c6bb8581
2013-08-17 15:30:02 +02:00
mpl 477bf96f33 devcam server: handle SIGQUIT
Somehow forgot last patch when doing
http://camlistore.org/r/452

Change-Id: I10841ebff29689af19773e8f9d99c5c16659cfc1
2013-08-17 00:43:53 +02:00
mpl 3239048566 server-config doc: added section anchors
Change-Id: Id35566e6cdf7e38e576494008f2bbdf9405021fd
2013-08-16 19:45:05 +02:00
mpl d992780f03 Merge "camlistored: help getting started on windows" 2013-08-16 17:19:12 +00:00
mpl f5709afdd8 camlistored: help getting started on windows
-fail early when new config has sqlite but no sqlite installed
-hint at the server config doc url
-added windows with mysql section in the server config doc
-fixed typo in mongo indexer option

Change-Id: I4266eb6e34a55901e6af90a32eb1411fb5c37688
2013-08-16 19:14:30 +02:00
Brad Fitzpatrick 5f4f42dfa7 Merge "appengine: fix the UI" 2013-08-16 16:58:27 +00:00
Brad Fitzpatrick b6e9e98c69 website: typo
Change-Id: I1cbaaf3e9b4ec898dc55a5bc423d72205a9d4dee
2013-08-16 09:52:29 -07:00
mpl 40951c103f appengine: fix the UI
-dev-appengine populates the default sourceRoot.
-app.yaml filters out the go files from the static
resources
-the UI handler warns that sourceRoot is required

Change-Id: I816456a882ff4b0573bc8962cce85139d8a0f611
2013-08-16 18:49:51 +02:00
Brad Fitzpatrick 7364fd6110 link to camlipy
Change-Id: I54b16e8f0d6c8216957e9a0655edbd596e3f3036
2013-08-15 10:07:58 -07:00
Brad Fitzpatrick b6a8dc3351 More git links updated
Change-Id: I2e527d73c2907dbc87e84a876b0f0ba7b2cf18b9
2013-08-14 10:47:56 -07:00
Brad Fitzpatrick 36f93b8240 Updating website for new git & Gerrit location.
Change-Id: Ifaceae9e40e2028c7c643020ea82abcece2e3554
2013-08-14 10:35:33 -07:00
Brad Fitzpatrick 5f5e8fcee4 Merge "appengine: more fixes" 2013-08-13 03:56:55 +00:00
Brad Fitzpatrick 1cf817f677 Merge "ui: deal better with unexpected non JSON responses" 2013-08-13 03:55:54 +00:00
mpl 860f136019 client: on android, do not parse config file
http://camlistore.org/issue/189

Change-Id: I9de22ce16950e4844ad82d97ff48207a80586a34
2013-08-12 18:21:53 +02:00
mpl f66077e48b appengine: more fixes
-added status handler to the config
-made pkg/jsonconfig/eval.go use the relative path
for the config file, since appengine does not like
absolute paths.

Change-Id: If9d275e308ae60e15ecd9c831e22fa6301de0be6
2013-08-11 21:17:05 +02:00
mpl 489c78746b ui: deal better with unexpected non JSON responses
Change-Id: Ieacac4dc734421743ca30bf79b0f3afdbbe00892
2013-08-11 21:11:02 +02:00
mpl e682cda008 appengine: fix build issues
split pkg/jsonconfig/sign.go and pkg/server/root.go
because of unsupported stuff on appengine

Change-Id: I6f97ec2e043dabbe54971a88dc401a45ba36a60a
2013-08-11 19:42:57 +02:00
mpl 9fcb4b6434 dumpconfig: typo in date
Change-Id: Iebd75442070896b588092f8bad62e0d21cab3b27
2013-08-09 18:12:47 +02:00
Brad Fitzpatrick f3f0030b25 serverconfig: error on bad baseURL values.
Fixes https://code.google.com/p/camlistore/issues/detail?id=195

Change-Id: I74e194a3903cd7ae36319bc98659e436e9b142d4
2013-08-08 17:50:50 -07:00
Brad Fitzpatrick 462eb7e4c2 Add camtool dumpconfig subcommand.
Fixes http://code.google.com/p/camlistore/issues/detail?id=192
2013-08-08 17:06:45 -07:00
Brad Fitzpatrick ba63f77d32 Merge "Improve appearance of non-image permanodes." 2013-08-05 15:01:20 +00:00
Brad Fitzpatrick 1f1c54e9f3 Merge "Schedule relayout whenever children are added to BlobItemContainer." 2013-08-05 14:59:59 +00:00
Brad Fitzpatrick 02a95a503d goexif: fix crash observed in the wild.
Reported by ajft@ajft.org

Change-Id: I4d4ddc998bb07f75d484341b8e423151d6c1aaa0
2013-08-05 07:51:53 -07:00
Aaron Boodman 5e24502348 Schedule relayout whenever children are added to BlobItemContainer.
This fixes some bugs where we don't relayout when items are added
to BlobItemContainer for various reasons.

Change-Id: Ie434acc12e660af438b93d2dabd41f3d75fb7493
2013-08-05 00:05:32 -07:00
Aaron Boodman ace41589a8 Improve appearance of non-image permanodes.
The add button still looks poo, but that will be a separate change.

Change-Id: Iea5fd53f7f4eabfc8c2ed45c043fcbd661b68077
Screenshots: http://imgur.com/JARUznn,tsv6dgU
2013-08-04 22:55:08 -07:00