The b.sortedStorageAt call had an empty filePrefix argument, which
means it would fail if the current index was not a DBMS (but a
file-based DB).
Also, this change adds a default "blobpacked_index" database name value
for the case when a user wants a DBMS index, but hasn't configured a
DBNames map.
Issue #693
Change-Id: Ie4386e789542c006530983e20bccc7a564bc4ee3
configHandler strips the key "_knownkeys" from all JSON objects in its
output using a regex on the marshaled JSON. If this was the last key of
an object which contains multiples keys, this leaves the JSON in an
invalid state. For example,
{
"foo": "bar",
"_knownkeys": {}
}
becomes:
{
"foo": "bar",
}
The trailing comma here is illegal. To fix this, we run one more regex
across the output removing any comma at the end of a line just before a
closing brace. This is never valid in JSON, so is safe to remove
globally here.
Change-Id: I05f54e9f094fbe9cbc720f073b2b78ae80525106
make the "REDACTED" placeholder a valid JSON string and include trailing
comma in attempt to make the document valid JSON (primarily helpful with
browser extensions that parse and render JSON documents, even though the
content type is text/plain).
Add client_secret to the list of redacted keys (used with google cloud
storage, possibly others).
Change-Id: Ia10fc9fffbd667ea7018b750b2a98db0b05dcf82
The import path was added to the go file that included the package
documentation if one existed. Otherwise, I used what seemed to be the
primary file for the package.
Fixes#689
Change-Id: If51be0e86529fd6f179e80af6781e639f8550fd2
Previously pkg/jsonconfig and pkg/errorutil
Copied from go4.org at rev d1b8a2fb2de6160036e4801aa5e4d855571078b8
Change-Id: I673ed55b0825baa2607289b6082f205100261d7a
Previously pkg/wkfs
Copied from go4.org at rev 3970dd22c0e7e2397304ad626a20b72f8db41b58
Note that pkg/wkfs/gcs has not been moved yet (for dependencies
reasons).
Change-Id: I737e88a360bccfc643e1fa43541f65f2384c3157
This makes diskpacked index type/location be set the same way it is done for
blobpacked, that is, its type will be the same as the camlistore index's
is. e.g. if the camli index is in MySQL, then the diskpacked index will
be another database in MySQL too.
Additionally, for added clarity wrt to the changes in
https://camlistore-review.googlesource.com/5496 , if we use a file based
indexer, the diskpacked index filename will now be
blobPath/diskpacked-index.kvtype (instead of blobPath/index.kvtype).
Change-Id: I7a9eb5c9caf07f62732ba2771308d351ec37b814
Because benchmarks from ./pkg/index/stress seem to show that levelDB
is more efficient than kvfile for us.
Also changed the filenames to index.kvtype, because the "camli-" prefix
is redundant, and because that's how we name the index files in the rest
of genconfig.go anyway.
Fixes issue #632
Change-Id: If663e94f2c24d646b994c39044eedc9b86327bf2
See https://golang.org/s/go15vendor
This commit moves the google.golang.org/cloud/... packages. The rest
of third_party will move later.
This commit is a dependency for some cloud logging work which we'll
develop in Camlistore's tree.
In a few places, cznic/kv use was hardcoded, instead of picking the user
set kv type, if any. This change makes sure we use the user-defined one,
if set, syndtr/leveldb otherwise.
Relatedly, the low-level config generated for diskpacked now uses that
same principle for its internal index. Also, if a diskpacked is
configured without an index, it now defaults to syndtr/leveldb.
Please note that this patch DOES NOT change the default kv type in the
automatically generated high-level config.
Related: #632
Change-Id: I55dbd385230878e92776e6b83d34c36fd1fa9382
I suspect the plan was to let the importer handler take care of its own
auth, but I don't think it's done. So this change lets camlistored wrap
the importer handler with the usual auth layer.
Change-Id: I6101eaec9b9cdc0d9b670c917122533d367bc73d
- Available at '/help/'
- Loads and parses server config upon init and generates the necessary client config for access
- Links to 'Downloadable Tools' are not functional (task is not yet completed)
- A link was added to the default server page as well as a 'Help' option to the Piggy menu
Issue: #536
Change-Id: I10629de034c908ebc76f6feacbbfca1df7bf1c2b
Signhandler was moved from the ui to the root handler and genconfig
adjusted accordingly.
New discovery struct types to replace the JSON maps are defined in
pkg/types/camtypes. The changes are related to Issue #539.
Change-Id: Ib3f12feeaf6fa81107de2d468cab491723e590ae
Also, delete my old gce package from third_party and only use the
google metadata package (which my gce package became, and which was
also already vendored into third_party)
Fixes#596
Change-Id: I64fd6f1e9dc6f433466f91f81efd2ecbf039334f
I was getting bogus errors because I replicate to s3, but the
s3+blobpacked error should only come up if s3 is primary.
Also, document the database key used for blobpack's index when mysql
or another db is in use.
Change-Id: I21a1815715f70edc3f98abf7209744703aaf6d3b
Users need to set:
"packRelated": true,
... in their server config. This will probably become the default
value in the future.
This is currently mutually exclusive with diskpacked, which isn't good
at deleting things, and blobpacked loves to delete things (from the
loose blobs).
Updates #532
Change-Id: I8f4ea9406859b2705f26e9d1103d3acf9d1a8411
To avoid confusion, the previously named "memoryIndex" configuration
parameter, which actually meant to slurp the index into the memory
corpus, has been renamed to "copyIndexToMemory". "memoryIndex" is now
the parameter to enable a memory-only indexer.
http://camlistore.org/issue/416
Change-Id: I7026e5463fda3a1887a88e0b07d4e3431c60c8b7
Mathieu Lonjaret