ac6acf5d70
index/sqlite tests: let sorted/sqlite pkg do initDB and enable WAL
...
The problem was newSorted was taking care of doing the DB
initialization. It was not only unnecessary, since newKeyValueFromConfig
from sorted/sqlite will do it by calling initDB, but also incorrect
because WAL was not getting enabled. Which is what was causing the
"database is locked" error "fixed" in commit
f6bf779cd6
2015-03-13 19:11:33 +01:00
f6bf779cd6
sorted/kvtest: close iterator ASAP to make sqlite happy
...
Change-Id: I7dcca4447bea262fedc6a5fbe572034bfd8cc61d
2015-03-12 16:15:56 +01:00
dcab33a2ae
blobserver/diskpacked: use named errors in SubFetch
...
Forgot to do it in b6eb85631c
2015-03-11 18:37:55 +01:00
e7bc92191a
Merge "deploy/gce: query the regions, use them in form, pick random zone"
2015-03-02 20:44:41 +00:00
8a93e80a8b
Merge "blob, server: show hash functions in discovery"
2015-03-02 18:30:31 +00:00
fd5e8c4048
deploy/gce: query the regions, use them in form, pick random zone
...
Change-Id: Ie7170c7c12aeb4e32474510d9931f662795bcd41
2015-03-02 19:25:08 +01:00
dfe854e168
blob, server: show hash functions in discovery
...
Issue #122
Change-Id: Iddc3edd4d10065b4cf94f4d554cc6c24ca78a26c
2015-03-02 18:45:58 +01:00
fc2afa208e
Merge "blob SubFetcher: explicitely states with errors the testSubFetcher constraints"
2015-03-02 15:23:09 +00:00
68836026b8
Merge "Capture the file's lastModifiedDate provided by File API when uploading from the UI"
2015-02-27 16:27:03 +00:00
b6eb85631c
blob SubFetcher: explicitely states with errors the testSubFetcher constraints
...
testSubFetcher in blobserver/storagetest was already checking that we'd
get specific error messages in the case of negative input parameters or
an out of range offset.
This change rationalizes these constraints with named errors
(ErrNegativeSubFetch and ErrOutOfRangeOffsetSubFetch) specified
in the SubFetcher interface.
It also fixes the googlestorage and s3 implementations so that they pass
the aforementioned test.
Change-Id: I25b72b842855b90ee3cab44c90654581dccf4b8e
2015-02-26 15:18:27 +01:00
a6fe834326
Capture the file's lastModifiedDate provided by File API when uploading from the UI
...
this change introduces one API to filewriter, which takes an additional param for the file's lastmodtime to store with the file blob
Issue #317
Change-Id: I8da3134306c28e6945661296aaafb7752b4bf8b5
2015-02-26 09:59:43 +01:00
f29b2665ff
test/integration: give the world a corpus
...
Reasons:
1) TestWebsocketQuery test now needs its world to have a corpus for its
query to succeed, because we now always sort unless specified
otherwise (and the query in the test does not do so).
2) it's more realistic to have an indexer with a corpus anyway, since
that's the canonical use-case.
Change-Id: Icdb31f8600f246227e237b851a1be825dc230d61
2015-02-25 17:16:17 +01:00
3e79e73272
search: implement post-search Created sort
...
Fix some UI queries, since UI always queries with "-created".
Also add Unsorted, to override the CreatedDesc default, for when we
really do not want to sort, e.g. when we don't have a corpus and
trying to sort would make us error out.
Issue #579
Change-Id: Ife0aa816c5e8cac8dc6612d0ffd104238abc6838
2015-02-25 16:43:35 +01:00
017d57d9d2
index,search: fix/finish wholeRef for fileInfo indexing
...
Bump index requiredSchemaVersion to 5.
Issue #581
Issue #577
Change-Id: I18e30aef280f97781132ef0841a189c7ca7e64be
2015-02-25 01:50:57 +01:00
9e699068f0
Merge "googlestorage: fix fetch test, add partial fetch test"
2015-02-18 17:34:46 +00:00
9cd14b0ab4
googlestorage: fix fetch test, add partial fetch test
...
Without this change, I'm getting:
=== RUN TestGetObject
--- FAIL: TestGetObject (0.65s)
googlestorage_test.go:88: Failed to read response body: EOF:
Change-Id: Ibe2eaf6af0c9854e4232c4df2a63b3ff1ebac717
2015-02-18 01:36:10 +01:00
b2cdca7f11
docker/camlistored: use djpeg-static
...
Issue #564
Change-Id: I4efcbadcedff8f120497869e11784f372d93188e
2015-02-16 19:00:39 +01:00
376e53ccd5
deploy/gce: make sure mysql is done starting...
...
...before starting camlistored.
Issue #569
Change-Id: I38578be631373b9a78127283b1c0b2a05d72a8f5
2015-02-11 23:51:34 +01:00
9f93493b0b
images/fastjpeg: add check for missing loader induced panic
...
Change-Id: I137945869aa6983a466326338270cbe8331c8ba0
2015-02-10 23:56:18 +01:00
6819477c6f
docker: build djpeg, squash it, use it as base for camlistored
...
Issue #564
Change-Id: I78e3a7a286dedc413299de7ad4f7a99c6c889fa8
2015-02-10 17:22:51 +01:00
e997a152a3
Merge "deploy/gce: do not overwrite TLS cert and key"
2015-02-05 13:58:18 +00:00
f6348948a7
Merge branch 'master' of https://camlistore.googlesource.com/camlistore
2015-02-04 21:08:08 -08:00
ff31f9f3d3
blobpacked: start of serving from blobpacked packs
...
Update #532
Change-Id: I35cc74a5013fe8796b05ae1a4bd27f10b5c90cea
2015-02-04 21:07:59 -08:00
b4255c3d72
blobpacked: stub TODO implementation of blobserver.WholeRefFetcher
...
Change-Id: I96d986fe1cec8ceb093d59f0a725e4f542824f69
2015-02-04 21:07:05 -08:00
8229c19850
search, index: add WholeRef to pkg camtypes' FileInfo struct
...
So when you describe a file, you also gets its wholeref.
TODO: we'll need to migrate old indexes to this new format on
start-up.
Change-Id: I4a3fb000d68bde46474275c2070ef285a6d6ecfc
2015-02-04 21:04:39 -08:00
73063c70ab
blobserver: add WholeRefFetcher interface
...
Change-Id: I5807918b9e362b098d6633f6c25e94f719cf4104
2015-02-04 21:03:08 -08:00
10a0689c11
deploy/gce: do not overwrite TLS cert and key
...
Issue #535
Change-Id: I26eea8f9f6b18ec1ef4ea3ca373a65f03903994b
2015-02-04 20:33:08 +01:00
e47bdd5c93
Merge "deploy/gce: on success, show SHA-1 of certificate too"
2015-02-04 18:57:22 +00:00
e02ac6b36c
deploy/gce: on success, show SHA-1 of certificate too
...
Also small TODO, template cleanup, and further cosmetics.
Change-Id: I9171e8e1389abaae216068c9fded518786e1a3a0
2015-02-04 19:54:27 +01:00
b3bb0d58e6
Merge "serverinit: add genconfig for blobpacked on Google Cloud Storage."
2015-02-04 18:10:15 +00:00
b78ce17e13
serverinit: add genconfig for blobpacked on Google Cloud Storage.
...
And enable it (blobpacked) on GCE.
Change-Id: I7b51c186325e80987e48d32392d88bb4c30ee3d5
2015-02-04 19:08:43 +01:00
5c0e9a1fbe
Rename search.IGetRecentPermanodes to search.GetRecentPermanoder
...
Better Go style. Plus Permanoder is funny. And IFoo looks like C#.
Change-Id: Ie418117c15a145c6c61a2f7e5fb31ae53a5d8bb6
2015-02-02 10:45:41 +01:00
6425d033fd
server: refactor ui's DownloadHandler
...
Prep for efficient serving from blobpacked.
Change-Id: I5ea0902e6adcc0ba24e89984f684f0f2d4052022
2015-02-02 10:41:35 +01:00
34a5e1e475
magic: fix MIMETypeFromReader error handling, add test
...
Change-Id: I4eaf96fab366caf69daed946b13b6ef897147606
2015-02-02 09:29:52 +01:00
ec6bfeb586
deploy/gce: cosmetic changes to the success page
...
Change-Id: I09f99db47d43c70ce73b8e2041d6bcaa47fc79a4
2015-01-31 23:55:53 +01:00
0265e91a28
deploy/gce: redid the form
...
Change-Id: I62fd3eb432f2c9a6f85d08adbb073e587a4387ab
2015-01-31 19:05:08 +01:00
df8209ca7a
gce deploy: add http(s) firewall rules if they're missing.
...
fixes #572
Change-Id: Ibb69cf256331378c54597e20d09565578eebd777
2015-01-29 17:26:25 +03:00
83bb6bce78
deploy/gce: add HTTP auth creds to wizard.
...
And instruction to change them through GCP UI.
Issue #573
Change-Id: I39e6a2904cd1ca57bed40e4c361ca963049438fc
2015-01-28 22:29:42 +01:00
0e31e41767
deploy/gce: fix project label, check project id exists
...
Issue #571
Also moved the "file an issue" msg appending to sooner, so I can do a
proper error type check, instead of a lame string contents check.
Also fixed progress msg as per Aaron suggestion.
Change-Id: Ifa31a8d58cdf20d5068b4db4f7ab0370633bbd34
2015-01-27 22:58:16 +01:00
763a8a9e8e
Merge "sorted/kv: typo in comment about max size"
2015-01-26 19:10:41 +00:00
ae989d0d19
sorted/kv: typo in comment about max size
...
Change-Id: I8423e7ff798cc040d684f0182be17fafda1b0331
2015-01-26 20:10:02 +01:00
36dd866f36
Merge "pkg/sorted: define (larger) values for key and value sizes"
2015-01-26 19:05:22 +00:00
ae38f657b8
pkg/sorted: define (larger) values for key and value sizes
...
Issue #429
Change-Id: Id8205ca1581c1f21b3983e13d8c3f61293868529
2015-01-26 19:39:41 +01:00
8c1cd14a84
pkg/deploy/gce: check for any possible instance before trying to create
...
Go through all the existing zones to check for existing instances.
Issue #568
Change-Id: Id67d1b9e19f246b993465de9d7d022512187c1aa
2015-01-25 02:35:41 +01:00
0098b8e691
pkg/deploy/gce: detect when requested instance already exists
...
Issue #568
Change-Id: I6fe56417ffdc56ce3ddc5412c313d9a329bdbaf7
2015-01-23 20:37:49 +01:00
aada432c52
third_party: add oauth2/google, google.golang.org/cloud, google.golang.org/api
...
oauth2 at 267028f9bc2a1177dc5769be38c68c1b4fbe91c4
google cloud at 2e43671e4ad874a7bca65746ff3edb38e6e93762
google api at fc402b0d6f2a46ba7dcf0a4606031f45fb82a728
(partial commit only, since it's 16+ MB)
And update all callers from the old
code.google.com/p/google-api-go-client over to google.golang.org/api.
Change-Id: Ide190e04bb863928f98369a7c4d2b8c19fda1f66
2015-01-22 15:10:36 -08:00
9c3f196019
client: add Client.NewPathClient constructor
...
Change-Id: I49321e33d32f539f98ba6f1c1b405f94d1f13839
2015-01-19 15:05:29 -08:00
eeb8f61dd3
client: make Fetch return os.ErrNotExist on 404, per blob.Fetcher contract
...
Change-Id: I8a554c6facb34f2257e3e6035030e404a051ec50
2015-01-19 15:04:54 -08:00
d251a9b367
localdisk: skip the 'packed' directory in enumerate, like 'cache'
...
Change-Id: I33bb39921d466a0c476c23d9da436273845c6628
2015-01-19 14:28:32 -08:00
79adb124b4
blobpacked: more tests and adjusted various constants
...
Updates #532
Change-Id: I1e52714c831f893c9d1fe92c31e59a7c8f8c5446
2015-01-19 13:23:39 -08:00
mpl