Commit Graph

158 Commits

Author SHA1 Message Date
Brad Fitzpatrick 5ee33643fd More dock.go image building work, with mpl
Change-Id: I290d9364a49c95c5c5f35864f94d04780ae30843
2015-04-01 03:48:12 -07:00
mpl db4813e19f misc/docker: final Dockerfile for camlistored
Change-Id: I9dce6a2d04b342e3c5045cc460b227d1bd49b334
2015-04-01 11:51:16 +02:00
Brad Fitzpatrick 2e923925db misc/docker: start of dock command
Change-Id: I758081373b5e109a32fd3e22c0b983598c5a31d8
2015-04-01 02:24:56 -07:00
mpl c3853b5222 misc/docker/go: go without cgo
Change-Id: I662d97467e0621af3b20f3c77bc113ace2c48456
2015-04-01 11:17:30 +02:00
mpl b2cdca7f11 docker/camlistored: use djpeg-static
Issue #564

Change-Id: I4efcbadcedff8f120497869e11784f372d93188e
2015-02-16 19:00:39 +01:00
Salmān Aljammāz 1b087e719c docker image for a static djpeg
updates #564

Change-Id: Idf40aa915e20c0584ed02ecab90b304dc159a371
2015-02-13 20:20:40 +00:00
mpl 6819477c6f docker: build djpeg, squash it, use it as base for camlistored
Issue #564

Change-Id: I78e3a7a286dedc413299de7ad4f7a99c6c889fa8
2015-02-10 17:22:51 +01:00
mpl bee9fdcaea docker/camlistored/Makefile: change build tag, add target to save
Change-Id: Ie2bcad5f9349fd4e2f1006b56de4427b5eed1461
2015-02-03 18:00:27 +01:00
mpl 424ccbdeba misc/buildbot: keep it alive until rewrite
Because of the hg->git switch and the switch to Go 1.4, which requires
bootstrapping for building from source:

-master now requires an env with a working Go to build builder (instead of
building go tip from source), and master does not monitor changes to the go
tree anymore.

-builder gets Go1.4.1 from the binary tarball (instead of building from
source), and does not build go tip anymore (nor does it run tests with
it).

Keeping it alive properly was not deemed worth the trouble since we plan
on replacing it with a new builder based on the same tools used for the
Go builders.

Change-Id: Idd0864350b27b6523675006f00719fba2d6fc72f
2015-01-27 00:56:40 +01:00
mpl 00b18d99d4 misc/docker: rm spdy proxy since we have http2
issue #534

Change-Id: Ic05b60aa1c220b9df76718edc2ca222cddc427dc
2015-01-14 15:46:18 +01:00
mpl cfd784269e deploy/gce: use subdirs for config and blobs (instead of buckets)
http://camlistore.org/issue/528

Change-Id: Icb558d7de032f9367e8fb100be87ef24c2982c23
2014-12-17 16:20:58 +01:00
mpl 99fe925efc pkg/deploy/gce: lib + tool to deploy on Google Cloud
http://camlistore.org/issue/531

Change-Id: I69ffe0544341d380bb844aef1dcca8a1ae441ea7
2014-11-26 22:50:27 +01:00
Salmān Aljammāz 4ed9ebb9fd Dockerfile for an nginx SPDY proxy
We can enable this once the changes to gce/create.go are in.

https://code.google.com/p/camlistore/issues/detail?id=534

Change-Id: I7ea77bf9b09a2f6d91e4f5e228320fa97d54dfa2
2014-11-16 14:00:52 +00:00
Salmān Aljammāz 4e39af1086 Generate self-signed certs with the correct hostname.
This change makes gce/create.go generate a self-signed certificate
with the hostname from the -hostname argument and upload it to GCS
before creating a new camlistore instance.

It also makes camlistored use baseURL to figure out the hostname
when generating its self-signed certificate.

Change-Id: I64f85853dab34a7ce95e5d5997e58f2e5da43496
2014-11-13 15:53:40 +00:00
Mathieu Lonjaret 0ac70ad2a5 Merge "devcam: run git pre-commit hook as a test." 2014-10-27 21:44:55 +00:00
mpl 762d2d2974 gce: make token cache file project dependent.
Also add a few hints.

Change-Id: Id51a933be35bc73622e335a9d323696f77dd8395
2014-10-25 01:04:49 +02:00
Bill Thiede af19bf089c devcam: run git pre-commit hook as a test.
Additional check to prevent b bad imports and un-go-fmt'd code
from sneaking in.
If users don't run tests, it will break the builder.

Change-Id: I95c74724aac68d915aa5195b6d8fcb78f92349e0
2014-10-02 09:32:23 -07:00
Brad Fitzpatrick 8bbd38f2dd GCE: put the thumbnail cache on /var so CoreOS doesn't wipe it
Also, move MySQL's data dir so they're both under /var/lib/camlistore

Change-Id: Iffc35efb68a69748ecbe59a6bfc99e9886ae325b
2014-08-23 19:55:44 -07:00
Brad Fitzpatrick f9a00dce0b GCE: use our own lighter MySQL Docker image.
Use systemd/CoreOS instead of supervisor,
Less InnoDB memory,
No snapshots,
unrelated to Docker image: keep data files on CoreOS /var/lib/mysql-camli so
they persist across reboots.

Change-Id: Ib903c386fb3e2df0b7cf2d3eb466290f2b16f94b
2014-08-23 17:49:59 -07:00
Brad Fitzpatrick 1ca6a739cd gce: use systemd-docker on CoreOS
Change-Id: I4f5a169c78ca3806aa40b3716b267b539c8bfbca
2014-08-23 09:13:06 -07:00
Brad Fitzpatrick c78e9af4b6 gce: run mysql too. link it with camlistored.
I think I'm not using systemd correctly here. Things get very unhappy
if I reboot CoreOS: the Docker container named 'db' already exists, things keep
flapping up and down (not waiting for their dependencies), etc.

Maybe I need to register stop actions too.

Change-Id: I75ac3e965c03df4f7f3938ff13c66f137948bf4d
2014-08-18 23:18:45 -07:00
Brad Fitzpatrick 082876c600 gce: don't make http client twice.
doesn't really matter, but.

Change-Id: I21495be1780e74464c7016979174ba722400ef1a
2014-08-18 17:17:33 -07:00
Brad Fitzpatrick 5a95215fcc GCE: use host's /tmp dir instead of inside container.
Change-Id: I2a52249148541c97dfdd84bac57a1605e0366471
2014-08-18 17:13:46 -07:00
Brad Fitzpatrick e86d90dd42 GCE: expose host's systemd journal to camlistored; add /var/logs handler
The machine now boots with a new pair of cooperating systemd units:

1) cam-journal-gatewayd.service: a copy of the systemd-journal-gatewayd service,
   which runs an HTTP interface to the systemd journal.
2) cam-journal-gatewayd.socket: a unix socket listener listening on unix
   socket /run/camjournald.sock. Incoming connections will forward to 1).

Then the camlistored.service unit running camlistored under Docker now
passes -v /run/camjournald.sock:/run/camjournald.sock to make that unix socket
available to the Docker container.

Then in camlistored, a new handler at /debug/logs (wrapped in auth
checks) then opens that socket and makes an HTTP request to it,
copying its response (of log lines) back to the browser.

This will ease debugging, letting people only use their browser to
debug (or send logs to the Camlistore developers more likely), rather
than sshing in to CoreOS and learning CoreOS and systemd arcana.

Change-Id: Icd5967ae7e9946d36229bdbc5d37644a11ee5e9f
2014-08-18 15:20:59 -07:00
Brad Fitzpatrick b191ece806 GCE: start systemd-journal-gatewayd.socket on boot.
Change-Id: I53e679f9a5f745c9a35904cdf65ff7844420e23b
2014-08-17 14:21:59 -07:00
Brad Fitzpatrick 274f838f6f Add make.go support for building the camlistored Docker binary.
Change-Id: I2f8ad914b217843749c0aee57c24ce44c1c619f1
2014-08-16 14:56:40 -07:00
Brad Fitzpatrick 494e9e7814 docker: add push target
Change-Id: I82fd35a3f1e5c4a76c9774aff28328a7acc97e78
2014-08-16 14:27:51 -07:00
Brad Fitzpatrick 38b97e1b9a Add Dockerfile and Makefile for 'camlistore/camlistored' Docker image.
Change-Id: Ied7055689f1946ce0e6a857b4e6ddd5f8dca79b9
2014-08-15 22:20:57 -07:00
Brad Fitzpatrick 38cceb30aa misc/gce: flesh out enough to boot instances running Camlistore.
Polish remains.

Change-Id: I998cf4d515049e6d0e462fa6c259c39fc1638cf2
2014-08-15 22:18:10 -07:00
Brad Fitzpatrick fd08eb7e1d Create GCE instance, but without Camlistore running.
Change-Id: I3775ad8dc90562f9d4cb6c59da9a4df63aa417e8
2014-08-15 13:19:12 -07:00
Brad Fitzpatrick bb8fe1aa33 GCE setup tool: more graceful OAuth setup
Change-Id: I28893735c49da18d3890a0df07b071048c29ba68
2014-08-15 12:47:05 -07:00
Brad Fitzpatrick c6c76ef859 Start of tool to create Camlistore instances on GCE.
Will be wrapped in a webserver later.

Change-Id: I95738e57e3e3db11436af777cbf21e680dd10d66
2014-08-14 14:55:06 -07:00
mpl e3e25c885f buildbot: option to skip test suite, mainly for debugging.
Change-Id: Ief506ed1403a48eecd3ef37e17818d3612ae40b4
2014-08-05 16:46:27 +02:00
Brad Fitzpatrick 73b5665805 re-tag 0.8
Change-Id: Ibbeb9027fd5719a8faca915a32207564041dce7d
2014-08-03 18:27:18 -07:00
Brad Fitzpatrick d57489b521 Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-08-03 18:26:38 -07:00
Brad Fitzpatrick 992ae392fa tagging 0.8
Change-Id: I0aaed33cb582a7b2aeecacd33e70ee5effda86c2
2014-08-03 18:17:54 -07:00
Brad Fitzpatrick 43a50b9fbf google cloudstorage: stat bucket at start. WIP.
Change-Id: Ia5c0981a1f31e347218d334a0748af19867b1adf
2014-08-02 21:00:43 -07:00
Brad Fitzpatrick 90175c209c Add some GCE+Docker+CoreOS notes.
Change-Id: I67d37b3aaf08e22315bda6aae9e7c7d48c67dba5
2014-08-02 17:24:21 -07:00
mpl c23933efdc buildbot: be more patient when waiting for camlistored
I'm hoping this will help with our first test suite run (Go1) which
is often failing at the test trying to hit http://localhost:3179/ui

Change-Id: I972072ebc27b7a59136a90532000ca7e9d58a471
2014-07-05 18:20:06 +02:00
tnt 5d8eeb534b Fixed wrong calls to formatting functions.
E.g: fmt.Println("%s", "hello world") -> fmt.Printf("%s", "hello world")

Change-Id: I51c0bd54c14173e074fafd86c83a5287fcdb1520
2014-06-30 22:05:22 +02:00
mpl a52585d7b0 buildbot README: link to setup script for hacking
Change-Id: Id583796ede48fad0e3000b3ab97551e889fa2c37
2014-06-19 15:03:29 +02:00
mpl 678d7cc45a misc/pre-commit.githook: print gofmt to run
Change-Id: I1e177a2cbbc33bae2afc9bcef8c3da387f5bb303
2014-06-06 18:46:44 +02:00
mpl 4569a7f475 devcam review: submit changes for review
Context: http://camlistore.org/issue/408

Change-Id: I587de65c9dc8d87c02541096e1f4f7765e644962
2014-05-13 23:06:30 +02:00
mpl 335f6416b9 buildbot: add some context to error
Change-Id: Ia0733909ffd4d9e9451ac663cb7ece799169ab7c
2014-03-04 18:53:05 +01:00
Brad Fitzpatrick 9f70025a29 Add 0.7 to the release history
Change-Id: Ieb895939d302c594b35dfd51361c93fe9078a039
2014-02-28 15:33:48 -08:00
mpl 8f2c67241f buildbot: send sigterm instead of sigkill to child
Because if e.g. 'devcam test' is the current child process, we want it to be
able to catch the signal and kill its own child too.

Change-Id: I3e3c9c10c8d7f5d793c98b604baf8df56608003e
2014-02-21 20:52:30 +01:00
mpl e004ef414b buildbot: add timeout for task run
Change-Id: I49594d7d9aaa20d94213033d41e055c64e3da30c
2014-02-19 16:30:04 +01:00
mpl 08dad1803e camlibot: set GOROOT properly, stricter hash checks, simplify
Change-Id: I27fed6c52eeae239b9f8a17600331fc08dfd9ef7
2013-12-30 19:50:54 +01:00
Bill Thiede b030952753 buidbot/master: remove auto refresh on stderr view.
I thought this was clever, but now I see it is just annoying when
dealing with long stderr logs.

Change-Id: Iddb172240a046aedb9abb78fa5a74ebeded3c387
2013-12-27 11:21:21 -08:00
Brad Fitzpatrick 401579d656 Record 0.6 tag
Change-Id: I52da474ca3831c8be4685edfc0e132b27255f8a4
2013-12-25 10:59:18 -08:00