Commit Graph

5645 Commits

Author SHA1 Message Date
mpl 839ec5574e travis: make FUSE work for cammount tests
Change-Id: Ieb84446571dfea3eb44c07a8ed2f3ff7a874f817
2015-11-27 17:07:16 +01:00
mpl 3dbaa49395 vendor: go4.org/oauthutil
Previously pkg/oauthutil

Imported from go4.org at rev
3970dd22c0e7e2397304ad626a20b72f8db41b58

Change-Id: Iffb751d03af9bc0c3008e5cd3833ed42fba0bdb1
2015-11-27 00:31:40 +01:00
mpl 40c0d80b07 vendor: go4.org/wkfs
Previously pkg/wkfs

Copied from go4.org at rev 3970dd22c0e7e2397304ad626a20b72f8db41b58

Note that pkg/wkfs/gcs has not been moved yet (for dependencies
reasons).

Change-Id: I737e88a360bccfc643e1fa43541f65f2384c3157
2015-11-27 00:23:03 +01:00
Mathieu Lonjaret 6ffc170d7d Merge "pkg/images/resize: disable TestCompareResizeToHalveInplace for now" 2015-11-26 16:16:35 +00:00
mpl 997d400cbd pkg/images/resize: disable TestCompareResizeToHalveInplace for now
It's more important for now to be able to monitor for other failures in
the Camlistore repo than leaving this test on.

After having looked into the issue, I know a little more but not enough
for a definitive conclusion or fix.
It's all added as comments so we don't start from scratch again later.

Also, to make up for the loss of this test, I'm adding two other tests,
TestCompareOriginalToHalveInPlace, and TestCompareOriginalToResized,
that are similar enough to catch other problems in the same context I
believe.

Context: issue #635

Change-Id: I80a30f544fb9ab2e7c69118ef8509d3d687c2d27
2015-11-26 16:59:52 +01:00
mpl 1e2a306e8d vendor: add go4.org/cloud, update google.golang.org/api, and golang.org/x/net/context
Import go4.org/cloud/cloudlaunch and go4.org/cloud/gceutil, which were
previously in pkg/cloudlaunch, at rev
2c497a8c195996d6c48402c150da4919c1d99f33

Because the version on go4.org was updated to use the latest
google.golang.org/api/* , we also update our
vendor/google.golang.org/api/* to rev
030d584ade5f79aa2ed0ce067e8f7da50c9a10d5

This in turns requires to add vendor/golang.org/x/net/context/ctxhttp
(and update vendor/golang.org/x/net/context/) to rev
4f2fc6c1e69d41baf187332ee08fbd2b296f21ed

Also adding vendor/google.golang.org/api/gensupport for the same reason.

Change-Id: I9d6c3059626f7ecc0fbf2df0415043a464d27caa
2015-11-25 19:29:46 +01:00
mpl 8d76f0563b vendor: go4.org/syncutil/singleflight
Previously pkg/singleflight

Imported from github.com/camlistore/go4/ at rev
039bcc4ca7e407e5611cbdf15a1f208be0bceda0

Also reimport vendor/go4.org/syncutil because some of it got split into
github.com/camlistore/go4/syncutil/syncdebug

Change-Id: Iaf48de71928d17e0410442ea6f5bef7262ba60d2
2015-11-24 17:28:28 +01:00
mpl fd2d58e61b vendor: go4.org/net/throttle
Previously known as pkg/throttle

Imported from github.com/camlistore/go4 at rev
4d87fc99168459b13e7c78086d210cf11474ade2

Change-Id: I21298db0790b2cf125efb612befd7dfb24780861
2015-11-24 16:27:11 +01:00
Brad Fitzpatrick 9868aa0f8d Remove httputil.CloseBody relic. 2015-11-23 19:02:10 -08:00
Mathieu Lonjaret fe71c93af6 Merge "pkg/images/resize: fix filenames in tests" 2015-11-23 16:07:27 +00:00
mpl 12eddf9c19 vendor: go4.org/strutil go4.org/syncutil
They were internal packages (under pkg), which we are now moving to
go4.org, so we in turn need to vendor them in now.

Change-Id: I92224f731404d0bd4ca1c57492bed37cb3367ed4
2015-11-21 00:21:20 +01:00
mpl be155b4503 pkg/images/resize: fix filenames in tests
Setting the filename from the type, after resizing, does not work anymore
after fc890a65cd , because resized images
are now always RGBA, since we're using xdraw.

Change-Id: I561f43a3ebe9cb3e1d7404295635899ab6b62e7a
2015-11-20 21:43:12 +01:00
mpl e1798e796e website: set builder redirect in production
Change-Id: I36c9be9786b14a564b4c67e3562cd06ae402ae25
2015-11-20 16:47:43 +01:00
mpl 8a10bb52e0 pkg/server/status: link to GCL logs on GCE
Fixes issue #592

Change-Id: Ife405816ee42902258c93eac917a6ff5bada4138
2015-11-20 01:26:12 +01:00
Mathieu Lonjaret 64a8d7d26b Merge "pkg/index/sqlite: add build tag for test" 2015-11-19 14:40:10 +00:00
mpl 0fe6be3a47 pkg/serverinit: fix diskpacked test
Because I broke it with 7cb8884f00

Change-Id: I39e72d5093c26ed71f5c9076487837b0395b9e73
2015-11-18 23:57:13 +01:00
mpl 59e30b9433 pkg/index/sqlite: add build tag for test
so we don't get a failed test when we're not running with
--tags=with_sqlite

Change-Id: I2de4c21b4f3ee673132f56b12c2dfff8272d5d79
2015-11-18 23:17:20 +01:00
mpl d3e4a01b4f pkg/deploy/gce: rm debugging handler
I broke it recently by removing gce.DevHandler and I don't think it's of
any use anymore nowadays.

Change-Id: I8d9ff85c980999bc5fb61ea08e1fce2cd4b7bea9
2015-11-18 18:49:34 +01:00
mpl 58958f44ee enable travis CI with a .travis.yml
Change-Id: I9d42251659fd46dc84943d7644ce644de063d6da
2015-11-18 18:24:38 +01:00
mpl 775da29abe pkg/deploy/gce: always use latest stable CoreOS
Added pkg/cloudlaunch/gceutil package.

Fixes issue #649

Change-Id: I47830489b29de9c555b4706fe387be08e3f57e16
2015-11-18 00:17:33 +01:00
mpl cca20e7080 website: revert latest to 0.8, add blank line because markdown
I believe the added blank line is needed for markdown to "realize" it's
a comment tag, or whatever. The comment is actually hidden again now.

Change-Id: Ia8f63177e9363db676e970b866fe1ffa6f3cab10
2015-11-17 00:27:09 +01:00
mpl 621388f0bf camweb: send deploy handler logs to GCLogging as well
When logging to Google Cloud Logging, make sure the deploy handler logs
are written there too.

We tag them with the from:camli-gce-launcher label.

Change-Id: I4dab010009f98efd2aeba7c57dc4ab3ca6a566b3
2015-11-16 23:40:05 +01:00
mpl a2aee25cfb website: update (camlistored) deployer to run on GCE
Change-Id: I205c6df51e8d8c4bcf2710fc9da1db68419fc2df
2015-11-13 17:41:46 +01:00
Brad Fitzpatrick afd28ae279 website: name the demo blobserver container, kill on start-up 2015-11-11 14:45:50 +00:00
Brad Fitzpatrick 321272d65c website: make sure 'src/camlistore.org' is in our source path for godoc
It was making that assumption and crashing otherwise.
2015-11-11 14:32:00 +00:00
Brad Fitzpatrick ee2ec3bce1 website: revert the pre-0.9 download page for now 2015-11-11 13:03:43 +00:00
Brad Fitzpatrick 96dc004af7 website: run on GCE under CoreOS. Containerize demo blob server. 2015-11-11 12:58:01 +00:00
Brad Fitzpatrick b4ef019bc2 website: now runs on GCE/coreos with cloudlaunch 2015-11-10 12:10:16 +00:00
mpl 96bde7b1d4 website/camweb: setup TLS for when in production (on GCE)
Change-Id: I7d3ec69d0a4cdae4493cbe62ec14ea4e41f5d0ba
2015-11-10 10:14:07 +01:00
Brad Fitzpatrick 5b00bc2617 website: untar content to local disk when running in prod on GCE 2015-11-08 21:45:09 +00:00
Brad Fitzpatrick 1ce6518f68 website: more work on moving to GCE 2015-11-08 21:20:35 +00:00
Brad Fitzpatrick 785b6ce1c2 cloudlaunch: automatically use the latest CoreOS stable image 2015-11-08 20:38:27 +00:00
Brad Fitzpatrick 3a473f32d3 cloudlaunch: upload binary, create instance 2015-11-08 20:29:04 +00:00
mpl f2c8ae1fcb pkg/cloudlaunch: added latestStableCoreOSImage
To get the latest stable CoreOS image URL for GCE.

Change-Id: I608b4c8d6d1628046cf5f03440afcf158a3ee609
2015-11-08 20:03:25 +01:00
Brad Fitzpatrick 7578502c33 Start of a new cloudlaunch package, to be used by the website first. 2015-11-08 16:49:59 +01:00
Brad Fitzpatrick 0d3b78edef vendor: update google cloud logging
Rev: cae1d9bade07b
Only test changes.
2015-11-08 15:52:25 +01:00
mpl 2e34259de8 vendor: update http2
Replaced github.com/bradfitz/http2 with the latest golang.org/x/net/http2
and updated the following dependencies:

golang.org/x/net @ a179abb31d787abdb406d922dff79635a8d784a4
golang.org/x/oauth2 @ 038cb4adce85ed41e285c2e7cc6221a92bfa44aa
google.golang.org/grpc @ 1684e4a49ba8e6c88a8628b26395f310a1e3d99f

Change-Id: Ic8f294f22a4ec7f7ee513fd1eb29a0b72ac41886
2015-11-08 11:52:24 +01:00
Mathieu Lonjaret 9e697d9067 Merge "make.go: default sqlite to "false" instead of "auto"" 2015-11-01 21:18:31 +00:00
Mathieu Lonjaret 8efe27aa58 Merge "pkg/serverinit: use syndtr/goleveldb in default config" 2015-11-01 21:17:27 +00:00
mpl 7cb8884f00 pkg/serverinit: use sortedStorageAt for diskpacked
This makes diskpacked index type/location be set the same way it is done for
blobpacked, that is, its type will be the same as the camlistore index's
is. e.g. if the camli index is in MySQL, then the diskpacked index will
be another database in MySQL too.

Additionally, for added clarity wrt to the changes in
https://camlistore-review.googlesource.com/5496 , if we use a file based
indexer, the diskpacked index filename will now be
blobPath/diskpacked-index.kvtype (instead of blobPath/index.kvtype).

Change-Id: I7a9eb5c9caf07f62732ba2771308d351ec37b814
2015-10-31 00:01:38 +01:00
mpl 69fdcbb797 pkg/serverinit: use syndtr/goleveldb in default config
Because benchmarks from ./pkg/index/stress seem to show that levelDB
is more efficient than kvfile for us.

Also changed the filenames to index.kvtype, because the "camli-" prefix
is redundant, and because that's how we name the index files in the rest
of genconfig.go anyway.

Fixes issue #632

Change-Id: If663e94f2c24d646b994c39044eedc9b86327bf2
2015-10-30 23:58:03 +01:00
mpl 11ed82555e make.go: default sqlite to "false" instead of "auto"
Even if sqlite libs are installed on the host, since sqlite as an
indexer seems to be less efficient than kvfile (and way less efficient
than leveldb) for us, we should not build camlistored with it, unless
user-specified.

Related: issue #632 (relevant benchmarks posted there).

Change-Id: I6f87e554ee03ccb8dbbcf4d918971dba715647f4
2015-10-30 19:19:20 +01:00
mpl a7ccb62bf6 vendor: mv github.com/hjfreyer/taglib-go from third_party
Also bump it at 0ef8bba9c41b66c12f60ce9833786838d2c2d3d8 to fix panic

Fixes #647

Change-Id: Ic348ef6a19446de6a027d93aab748224b5f46a1d
2015-10-27 23:18:07 +01:00
mpl d9d5088fbe pkg/server/sync: actually use runSync 1st arg
Change-Id: I9866b980595f72cdb1996fdd40c7195a7265d071
2015-10-26 19:18:01 +01:00
Mathieu Lonjaret c75ef4e08b Merge "pkg/server/help: fix server's hostname when needed" 2015-10-26 14:29:54 +00:00
Mathieu Lonjaret 69d3f9c937 Merge "pkg/index/receive: unless CAMLI_DEBUG_IMAGES, be less EXIF-verbose" 2015-10-23 13:48:52 +00:00
mpl 2b2ad502e5 pkg/index/receive: unless CAMLI_DEBUG_IMAGES, be less EXIF-verbose
Change-Id: Iec0c9acae268285980ce04943c58d56ae19fb711
2015-10-22 17:37:21 +02:00
mpl afa5d42469 pkg/deploy/gce: remove now useless debugging code
Change-Id: Ib2f71056330805287932f259b0c2eec3e1b4b09f
2015-10-21 16:08:25 +02:00
mpl 20ad3d699b pkg/deploy/gce: use WIP tarball if WIP=1 in request URL
That way I don't have to constantly edit deploy.go (and fix it before
committing a CL) when debugging for GCE.

Change-Id: Ie4f75443e4356c5ce1a59931f3cb9e34344350be
2015-10-21 01:46:38 +02:00
mpl 7410fc29ab pkg/server/help: fix server's hostname when needed
When baseURL or listen is something like ":3179" or "0.0.0.0:3179", the
resulting server hostname in the client config would be useless.
Therefore, in that case we use req.Host to set the hostname instead.

Fixes issue #641

Change-Id: I33d65776fbac945a411f4328ebbbc5763dec8eb6
2015-10-21 00:16:21 +02:00