Commit Graph

5601 Commits

Author SHA1 Message Date
mpl 54d9ad1f0e Merge "devcam: move modtime check after cwd check" 2015-05-12 22:36:00 +00:00
mpl 368f893828 Merge "blobserver/drive: allow config file for tests" 2015-05-12 22:34:00 +00:00
mpl c8e44860da Merge "dock.go: upload versioned tarball" 2015-05-12 22:32:27 +00:00
mpl 3ec28bef79 Merge "website: easier launcher dev workflow" 2015-05-12 22:30:48 +00:00
mpl f336dc8331 website: easier launcher dev workflow
Use the website/launcher-config.json JSON config file to provide
all the deploy handler parameters.

Change-Id: I6156eaa80269ad3e70e9d48d7b8253a9a507036e
2015-05-13 00:26:25 +02:00
mpl 0f9a56241a index: automatically fix missing wholeRef in FileInfo rows
Issue #577

Change-Id: I45f210b32bcecb68b0ae3f60540cb33b58a729e5
2015-05-12 23:47:29 +02:00
Tamás Gulácsi 6bc123758e third_party: upgrade golang.org/x/net/webdav
rev a8c61998a557a37435f719980da368469c10bfed
"Add PROPPATCH support to in-memory property system."

Change-Id: I547344bdcc946e138ad15fedb9b8edc0446e26a6
2015-05-12 21:32:33 +02:00
Mathieu Lonjaret 19eb7d1a8c Merge "pkg/server: replace JSON map with struct for file tree response" 2015-05-12 15:54:05 +00:00
Mathieu Lonjaret 96121ba48a Merge "pkg/blobserver: replace JSON map with struct for remove response" 2015-05-12 15:35:24 +00:00
mpl 2b1ce70c15 dock.go: upload versioned tarball
Instead of just uploading the unversioned tarball, this change first
uploads a versioned tarball, then makes a copy of it as the unversioned one.
This allows for easier reverts when overwriting the unversioned tarball
by mistake.

Change-Id: Ia8a1b9008e7a203f2fb3b640dc12da432be1baf3
2015-05-12 15:41:20 +02:00
Brad Fitzpatrick 99aebc3037 third_party: update cloud logging API w/ generator updates
Update to rev be882d4ca533 of the google-api-go-client generated code.

Upstream CL is: https://code-review.googlesource.com/#/c/2461/

This lets the logging code log JSON payloads as well.

Change-Id: Iaba12126291aef3665f77dcc8e157d6166f33228
2015-05-11 12:43:29 -07:00
Fabian Reinartz f701562661 pkg/server: replace JSON map with struct for file tree response
This change is related to Issue #539.

Change-Id: I47480a4fd4c5eddd999c6247682dbba36c11d05f
2015-05-09 12:31:43 +02:00
Fabian Reinartz 7f5f7b1547 pkg/blobserver: replace JSON map with struct for remove response
This change is related to Issue #539.

Change-Id: I26d4ae5cc2d1605f534ba0ecccda78b6b17c9bc9
2015-05-09 12:24:48 +02:00
mpl 9a3073e106 blobserver/drive: allow config file for tests
Makes it easier to run the tests, compared with having to pass all
the OAuth stuff on the CLI.

Change-Id: I5fbc2f62a3815805d5d523ff897b6bdea618e230
2015-05-08 19:36:39 +02:00
mpl 89488a3cf4 pkg/server: redirect "/" to "/ui/"
Fixes #593

Change-Id: I6d98c3560aa329e9fd8a30012a8f283903d7d274
2015-05-07 17:39:42 +02:00
mpl 3db00e5e98 devcam: move modtime check after cwd check
checkCamliSrcRoot was meant to give a nice error msg if devcam is
invoked from outside the Camlistore source tree. However, it was never
called because the modtime check (checkModtime), which itself needs to
be run from that same location, was called first. So we were always
getting the terse "open dev/devcam: no such file or directory" error
message instead.

Fixes #589

Change-Id: I13a1bb3819217ffbaf727fa6154f077dd8babd49
2015-05-07 16:53:44 +02:00
mpl 1a483159c3 Merge "cloudstorage: allow config file for test parameters" 2015-05-04 14:26:17 +00:00
mpl 718f12131f cloudstorage: allow config file for test parameters
Makes it easier to run the tests, compared with having to pass all the
OAuth stuff on the CLI.

I also removed the bucket name restrictions, and instead added a check
for the bucket emptyness.

Change-Id: I1079541089ba304b152886121711ea5ba0208819
2015-05-04 16:24:31 +02:00
mpl 002b8e7212 deploy/gce: do not display login/pass on success
Fixes #597

Change-Id: Id53ad64651fdc9922eb33bb70d320b16e1d7777f
2015-04-29 22:59:00 +02:00
Brad Fitzpatrick 016f3082af Merge "Adds golang.org/x/image version 76b4869e5a for decoding tiff" 2015-04-27 12:01:55 +00:00
Felix Geller 3b5b5495f9 Adds golang.org/x/image version 76b4869e5a for decoding tiff
source: https://github.com/golang/image/commit/76b4869e5a

Change-Id: I098f1cdc512c1fd15737867acab7630953ec56ea
2015-04-27 21:02:17 +12:00
Mathieu Lonjaret d5d6cd5fe6 Merge "ui: added 'No references' placeholder text to the blob detail aspect when there are no references to display" 2015-04-24 14:39:11 +00:00
Mathieu Lonjaret 1a79246b12 Merge "added ui improvements to 0.9 release notes" 2015-04-23 13:02:43 +00:00
Mario Russo 2ed76105e2 added ui improvements to 0.9 release notes
Updates #601

Change-Id: I9ff85dd44f651fdeacab04804abe15bc560a52e2
2015-04-23 11:17:38 +02:00
Mario Russo ae85a3ff4e ui: added 'No references' placeholder text to the blob detail aspect when there are no references to display
Change-Id: I9bd7b10ab8954c41a3b4a7c375748e087fdc77b3
2015-04-23 11:08:17 +02:00
Brad Fitzpatrick a185f20f49 Merge "Upgrade github.com/syndtr/goleveldb" 2015-04-23 02:50:36 +00:00
Tamás Gulácsi 325dfc60b9 Upgrade golang.org/x/net/webdav
Commit 4977ec316d25d824a5da6df00ef57ae03833166c

For the needed fixes which allows us to reimplement camwebdav based on
this code (see later CL).

Change-Id: I9416ec817988b5975c2793197be52d84891d279e
2015-04-22 22:57:07 +02:00
Tamás Gulácsi a9a7cd73fc Upgrade github.com/syndtr/goleveldb
Commit 4875955338b0a434238a31165cb87255ab6e9e4a

Because camlistored ate my CPU time (constant 170% from 2 cpu, GOMAXPROCS=1):

(pprof) top10
36 of 40 total (90.00%)
Showing top 10 nodes out of 75 (cum >= 3)
      flat  flat%   sum%        cum   cum%
         1  2.50%  2.50%         40   100%  runtime.goexit
        35 87.50% 90.00%         35 87.50%  runtime.gopark
         0     0% 90.00%         21 52.50%  runtime.selectgo
         0     0% 90.00%         21 52.50%  runtime.selectgoImpl
         0     0% 90.00%          9 22.50%  runtime.goparkunlock
         0     0% 90.00%          5 12.50%  runtime.chanrecv
         0     0% 90.00%          3  7.50%  camlistore.org/third_party/github.com/syndtr/goleveldb/leveldb.(*DB).compactionError
         0     0% 90.00%          3  7.50%  camlistore.org/third_party/github.com/syndtr/goleveldb/leveldb.(*DB).jWriter
         0     0% 90.00%          3  7.50%  camlistore.org/third_party/github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction
         0     0% 90.00%          3  7.50%  camlistore.org/third_party/github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain

Change-Id: I792840b32bcb04d304621e61fca87aeb30f21b91
2015-04-22 22:48:16 +02:00
mpl 090db39dd2 Merge "dock.go improvements" 2015-04-21 20:58:00 +00:00
mpl 7242a824db dock.go improvements
The (camlistored builder + UI resources bundler) was a piece of shell
run in a docker container. That piece of shell is replaced with the
misc/docker/server/build-camlistore-server.go go program. This
program is still run within a container of the camlistore/go image.
It is added "on the fly" as a resource to the camlistore/go image
as a mounted resource.

In addition, build-camlistore-server.go can take a local directory as
the camlistore source (instead of fetching a tarball at the given
revision). dock.go has been adapted to take advantage of that.

Change-Id: If32b523d850f6c932016f18231bb1b1a283e50d3
2015-04-21 22:56:03 +02:00
mpl 750cc42bfe Merge "camput: add -contents_only flag" 2015-04-21 14:20:14 +00:00
mpl 40f99f5f6e Merge "google blobservers: migrate to golang.org/x/oauth2" 2015-04-20 21:21:51 +00:00
mpl 5147aff319 google blobservers: migrate to golang.org/x/oauth2
Previous oauth2 (code.google.com/p/goauth2/oauth) still used in:
third_party/github.com/tgulacsi/picago
pkg/importer/picasa
pkg/importer/foursquare

Final cleanup in a subsequent CL.

Change-Id: I805d81fcaa651e03a17823c78abe5040d51346c3
2015-04-20 23:17:28 +02:00
mpl 529dca734a third_party: add google cloud logging
upstream rev: b80bb08538855e6efebabd0df2dc2d8cf46cc2db

Also update googleapi to same revision (because UserAgent needed).
And in turn drive and storage updates are needed too so doing them in
the same commit.

Change-Id: I126dfd1cdaaca80a57e3582a90d45b47495ee687
2015-04-20 19:08:38 +02:00
Mario Russo 23e9f65b43 updated year in header template to 2015
Change-Id: I06a53a8abfcead81ce0415fbc9db4a4fc6cfdce2
2015-04-19 21:47:46 +02:00
Brad Fitzpatrick 2d1241bbbd conv: add package to ease common parsing tasks
Forgotten in earlier commits.

Change-Id: I7df2f7884b0077db2ff21c734c667b4b9a7566b3
2015-04-13 18:56:40 -07:00
Brad Fitzpatrick a928b6f0f9 Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2015-04-13 16:13:46 -05:00
Brad Fitzpatrick f88da2ae70 Set X-Camlistore-Packed in download handler for debugging.
Change-Id: I30704f566159df6b4cd3b57b16d89f0ba8b0b042
2015-04-13 21:02:41 +02:00
Brad Fitzpatrick dda34f8fb7 blobpacked: implement blobserver.WholeRefFetcher
Fixes #532

Change-Id: I4fc052b99b2e7f05c12a53adf8eb16e333efe8c4
2015-04-13 20:38:42 +02:00
Brad Fitzpatrick f3ae8c8c9a sorted: fix crash on double close of memory iterator
The sorted.KeyValue and Iterator interfaces both promise that it's okay
to Close twice.

Change-Id: I169f84d64c86da86e1be417b6be8551fd4d20ced
2015-04-13 20:38:42 +02:00
Brad Fitzpatrick 80d0487a22 make.go: more verbose and add option for whether to stamp the version into the binary
Disabled by default temporarily.

Change-Id: I9f40d881dc6f83088f4086fc06b7ebf345725d92
2015-04-13 20:38:41 +02:00
Brad Fitzpatrick f947f8fc19 ui: use WholeRefFetcher for downloads and thumbnails, if available
This makes downloads and the thumbnailer's reading of full images use
blobpacked's WholeRefFetcher fast path, when available. The end result
is many fewer blob fetches.

Updates #532

Change-Id: I3bfd1cb0f04f68f81b80a63378c7b365bd73c974
2015-04-13 20:38:41 +02:00
Brad Fitzpatrick 9040f94d1f blobserver: fix errant word in comment
Change-Id: Ibd8b5f0a68ee28827f2fe1bffcee2e78b494ce06
2015-04-13 20:38:40 +02:00
Brad Fitzpatrick d5f02aaacf replica: add blobserver.WholeRefFetcher pass-through support
Otherwise replica in front of a real WholeRefFetcher shadows it.
(in particular, this is bad for devcam server which uses replica
in its default configuration)

Change-Id: I12f8b60d23e35843c6ef9f4df3e073d56f7a0fb2
2015-04-13 20:38:40 +02:00
Brad Fitzpatrick 85380193cf types: add CloseFunc and update TB's docs
Change-Id: I49dcbc5c48754e5d5074dfbbb278fb969b35aee5
2015-04-13 20:38:40 +02:00
Tamás Gulácsi 892d6abfe0 Import golang.org/x/net/webdav
Commit 84ba27dd5b2d8135e9da1395277f2c9333a2ffda

Change-Id: I7cac1da70d8f4e5a4aa89d49957c2e220dd4c915
2015-04-11 18:25:53 +02:00
mpl 8fc17c4d75 camput: add -contents_only flag
Allows to upload only the contents of a file, without any of its
attributes, i.e. the file JSON schema on top only has its camlitype,
and the file's parts, set.

Issue #42

Change-Id: I1d0ab8d7cff0f0350439553a37b618b941067c93
2015-04-08 18:21:56 +02:00
mpl 42287fddca Merge "search: fix tests needing null around" 2015-04-05 17:07:32 +00:00
mpl 25a545da57 search: fix tests needing null around
follow-up of 491bbf525e

Change-Id: Id32e33f8bce1944510283da8e8cfa8bf96c0765e
2015-04-04 19:10:10 +02:00
Brad Fitzpatrick 58035c4c1b pkg/server: richer /status/ page
Shows Camlistore version, Go version, GOOS/GOARCH/cgo support, djpeg availability.

Fixes #594

Change-Id: I9ae8e16bc78765382d8b33e7a69bb9fc56618585
2015-04-02 18:17:18 +02:00