Commit Graph

2189 Commits

Author SHA1 Message Date
mpl 9e699068f0 Merge "googlestorage: fix fetch test, add partial fetch test" 2015-02-18 17:34:46 +00:00
mpl 9cd14b0ab4 googlestorage: fix fetch test, add partial fetch test
Without this change, I'm getting:

=== RUN TestGetObject
--- FAIL: TestGetObject (0.65s)
	googlestorage_test.go:88: Failed to read response body: EOF:

Change-Id: Ibe2eaf6af0c9854e4232c4df2a63b3ff1ebac717
2015-02-18 01:36:10 +01:00
mpl b2cdca7f11 docker/camlistored: use djpeg-static
Issue #564

Change-Id: I4efcbadcedff8f120497869e11784f372d93188e
2015-02-16 19:00:39 +01:00
mpl 376e53ccd5 deploy/gce: make sure mysql is done starting...
...before starting camlistored.

Issue #569

Change-Id: I38578be631373b9a78127283b1c0b2a05d72a8f5
2015-02-11 23:51:34 +01:00
mpl 9f93493b0b images/fastjpeg: add check for missing loader induced panic
Change-Id: I137945869aa6983a466326338270cbe8331c8ba0
2015-02-10 23:56:18 +01:00
mpl 6819477c6f docker: build djpeg, squash it, use it as base for camlistored
Issue #564

Change-Id: I78e3a7a286dedc413299de7ad4f7a99c6c889fa8
2015-02-10 17:22:51 +01:00
mpl e997a152a3 Merge "deploy/gce: do not overwrite TLS cert and key" 2015-02-05 13:58:18 +00:00
Brad Fitzpatrick f6348948a7 Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2015-02-04 21:08:08 -08:00
Brad Fitzpatrick ff31f9f3d3 blobpacked: start of serving from blobpacked packs
Update #532

Change-Id: I35cc74a5013fe8796b05ae1a4bd27f10b5c90cea
2015-02-04 21:07:59 -08:00
Brad Fitzpatrick b4255c3d72 blobpacked: stub TODO implementation of blobserver.WholeRefFetcher
Change-Id: I96d986fe1cec8ceb093d59f0a725e4f542824f69
2015-02-04 21:07:05 -08:00
Brad Fitzpatrick 8229c19850 search, index: add WholeRef to pkg camtypes' FileInfo struct
So when you describe a file, you also gets its wholeref.

TODO: we'll need to migrate old indexes to this new format on
start-up.

Change-Id: I4a3fb000d68bde46474275c2070ef285a6d6ecfc
2015-02-04 21:04:39 -08:00
Brad Fitzpatrick 73063c70ab blobserver: add WholeRefFetcher interface
Change-Id: I5807918b9e362b098d6633f6c25e94f719cf4104
2015-02-04 21:03:08 -08:00
mpl 10a0689c11 deploy/gce: do not overwrite TLS cert and key
Issue #535

Change-Id: I26eea8f9f6b18ec1ef4ea3ca373a65f03903994b
2015-02-04 20:33:08 +01:00
mpl e47bdd5c93 Merge "deploy/gce: on success, show SHA-1 of certificate too" 2015-02-04 18:57:22 +00:00
mpl e02ac6b36c deploy/gce: on success, show SHA-1 of certificate too
Also small TODO, template cleanup, and further cosmetics.

Change-Id: I9171e8e1389abaae216068c9fded518786e1a3a0
2015-02-04 19:54:27 +01:00
mpl b3bb0d58e6 Merge "serverinit: add genconfig for blobpacked on Google Cloud Storage." 2015-02-04 18:10:15 +00:00
mpl b78ce17e13 serverinit: add genconfig for blobpacked on Google Cloud Storage.
And enable it (blobpacked) on GCE.

Change-Id: I7b51c186325e80987e48d32392d88bb4c30ee3d5
2015-02-04 19:08:43 +01:00
Brad Fitzpatrick 5c0e9a1fbe Rename search.IGetRecentPermanodes to search.GetRecentPermanoder
Better Go style. Plus Permanoder is funny. And IFoo looks like C#.

Change-Id: Ie418117c15a145c6c61a2f7e5fb31ae53a5d8bb6
2015-02-02 10:45:41 +01:00
Brad Fitzpatrick 6425d033fd server: refactor ui's DownloadHandler
Prep for efficient serving from blobpacked.

Change-Id: I5ea0902e6adcc0ba24e89984f684f0f2d4052022
2015-02-02 10:41:35 +01:00
Brad Fitzpatrick 34a5e1e475 magic: fix MIMETypeFromReader error handling, add test
Change-Id: I4eaf96fab366caf69daed946b13b6ef897147606
2015-02-02 09:29:52 +01:00
mpl ec6bfeb586 deploy/gce: cosmetic changes to the success page
Change-Id: I09f99db47d43c70ce73b8e2041d6bcaa47fc79a4
2015-01-31 23:55:53 +01:00
mpl 0265e91a28 deploy/gce: redid the form
Change-Id: I62fd3eb432f2c9a6f85d08adbb073e587a4387ab
2015-01-31 19:05:08 +01:00
Salmān Aljammāz df8209ca7a gce deploy: add http(s) firewall rules if they're missing.
fixes #572

Change-Id: Ibb69cf256331378c54597e20d09565578eebd777
2015-01-29 17:26:25 +03:00
mpl 83bb6bce78 deploy/gce: add HTTP auth creds to wizard.
And instruction to change them through GCP UI.

Issue #573

Change-Id: I39e6a2904cd1ca57bed40e4c361ca963049438fc
2015-01-28 22:29:42 +01:00
mpl 0e31e41767 deploy/gce: fix project label, check project id exists
Issue #571

Also moved the "file an issue" msg appending to sooner, so I can do a
proper error type check, instead of a lame string contents check.

Also fixed progress msg as per Aaron suggestion.

Change-Id: Ifa31a8d58cdf20d5068b4db4f7ab0370633bbd34
2015-01-27 22:58:16 +01:00
mpl 763a8a9e8e Merge "sorted/kv: typo in comment about max size" 2015-01-26 19:10:41 +00:00
mpl ae989d0d19 sorted/kv: typo in comment about max size
Change-Id: I8423e7ff798cc040d684f0182be17fafda1b0331
2015-01-26 20:10:02 +01:00
mpl 36dd866f36 Merge "pkg/sorted: define (larger) values for key and value sizes" 2015-01-26 19:05:22 +00:00
mpl ae38f657b8 pkg/sorted: define (larger) values for key and value sizes
Issue #429

Change-Id: Id8205ca1581c1f21b3983e13d8c3f61293868529
2015-01-26 19:39:41 +01:00
mpl 8c1cd14a84 pkg/deploy/gce: check for any possible instance before trying to create
Go through all the existing zones to check for existing instances.

Issue #568

Change-Id: Id67d1b9e19f246b993465de9d7d022512187c1aa
2015-01-25 02:35:41 +01:00
mpl 0098b8e691 pkg/deploy/gce: detect when requested instance already exists
Issue #568

Change-Id: I6fe56417ffdc56ce3ddc5412c313d9a329bdbaf7
2015-01-23 20:37:49 +01:00
Brad Fitzpatrick aada432c52 third_party: add oauth2/google, google.golang.org/cloud, google.golang.org/api
oauth2 at 267028f9bc2a1177dc5769be38c68c1b4fbe91c4
google cloud at 2e43671e4ad874a7bca65746ff3edb38e6e93762
google api at fc402b0d6f2a46ba7dcf0a4606031f45fb82a728
  (partial commit only, since it's 16+ MB)

And update all callers from the old
code.google.com/p/google-api-go-client over to google.golang.org/api.

Change-Id: Ide190e04bb863928f98369a7c4d2b8c19fda1f66
2015-01-22 15:10:36 -08:00
Brad Fitzpatrick 9c3f196019 client: add Client.NewPathClient constructor
Change-Id: I49321e33d32f539f98ba6f1c1b405f94d1f13839
2015-01-19 15:05:29 -08:00
Brad Fitzpatrick eeb8f61dd3 client: make Fetch return os.ErrNotExist on 404, per blob.Fetcher contract
Change-Id: I8a554c6facb34f2257e3e6035030e404a051ec50
2015-01-19 15:04:54 -08:00
Brad Fitzpatrick d251a9b367 localdisk: skip the 'packed' directory in enumerate, like 'cache'
Change-Id: I33bb39921d466a0c476c23d9da436273845c6628
2015-01-19 14:28:32 -08:00
Brad Fitzpatrick 79adb124b4 blobpacked: more tests and adjusted various constants
Updates #532

Change-Id: I1e52714c831f893c9d1fe92c31e59a7c8f8c5446
2015-01-19 13:23:39 -08:00
Brad Fitzpatrick 0124c140ce blobpacked: implement blobserver.Generationer
Update #532

Change-Id: If3cba244d62f110d6620141d1de0f61c544807c7
2015-01-19 10:11:24 -08:00
Brad Fitzpatrick 659ccafbdd Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2015-01-19 09:29:40 -08:00
Brad Fitzpatrick 5c2ad4eaae search: fix websocket crash
Fixes #563

Change-Id: Iff04e4a40406ddd391f3c8fc93dcfe0209806ee3
2015-01-19 09:29:19 -08:00
mpl e3f16b8ead pkg/deploy/gce: add web wizard to deploy on Google Cloud
Issue #531

Change-Id: I47900eb7b82b7775ec1d26b1d6796e5701ee672d
2015-01-19 16:24:37 +01:00
Brad Fitzpatrick 3026631521 serverinit: move incompatible option checks further down, into the right places
I was getting bogus errors because I replicate to s3, but the
s3+blobpacked error should only come up if s3 is primary.

Also, document the database key used for blobpack's index when mysql
or another db is in use.

Change-Id: I21a1815715f70edc3f98abf7209744703aaf6d3b
2015-01-18 19:04:31 -08:00
Brad Fitzpatrick 81bca97523 localdisk: auto-create packed directory on start-up
Change-Id: I2e3453929c9f55b0fe22847699118876e4d2640e
2015-01-18 19:02:42 -08:00
Brad Fitzpatrick 9bea14733d importer: support for disabling importers at start-up
Change-Id: Ia2fc81f496ed020669a1c6ede489197d4a52ae89
2015-01-18 19:02:02 -08:00
Brad Fitzpatrick 4155ac6a3c serverinit: high-level config support for using blobpacked
Users need to set:

     "packRelated": true,

... in their server config. This will probably become the default
value in the future.

This is currently mutually exclusive with diskpacked, which isn't good
at deleting things, and blobpacked loves to delete things (from the
loose blobs).

Updates #532

Change-Id: I8f4ea9406859b2705f26e9d1103d3acf9d1a8411
2015-01-18 18:08:18 -08:00
Brad Fitzpatrick e0624177cd search: add blobref sorting, implementing sorting of results when source is unsorted
Part of upcoming blobpacked migration tool.

Change-Id: Ifdc4723d4d1468eb4d2798fadb256b409cfe0555
2015-01-17 20:31:41 -08:00
Tamás Gulácsi a6329fa8b8 pkg/app: use netutil.HostPort for ListenAddress()
As TODO said, so we gain IPv6 support.

Change-Id: Ia40824481e47a15dfdb376be624dde20c92e3af5
2015-01-17 18:57:06 +01:00
Brad Fitzpatrick ab9cd80301 httputil: use a random serial number in self-signed certs, not 0
Change-Id: Ifdba7c3efb9bd08e09da883eecdf3ba36dfa3f12
2015-01-16 16:46:15 -08:00
mpl cb492fdcc7 Merge "pkg/deploy/gce: revert to hardcoded google endpoints for oauth2" 2015-01-13 00:53:02 +00:00
mpl 1a286f919f pkg/deploy/gce: revert to hardcoded google endpoints for oauth2
google.Endpoint is the only thing we were using from
third_party/golang.org/x/oauth2/google
And pkg google would in turn bring in lots of dependencies (that I had
forgotten in 22f45f14a5).
Replacing Endpoint with the hardcoded values hence allows us to not
vendor in all those dependencies.

Also fix make.go to build camdeploy as well.

Change-Id: I6ba51991187a11705c97c9546848303540f99aa1
2015-01-13 01:28:09 +01:00
Mathieu Lonjaret a6981ff97b Merge "client: log when GPG signatures mismatch" 2015-01-12 21:10:16 +00:00