Rooba
/
perkeep
mirror of https://github.com/perkeep/perkeep.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,038 Commits 44 Branches 11 Tags 59 MiB
Commit Graph

54 Commits

Author SHA1 Message Date
Brad Fitzpatrick 9a3a3795bb camtool: remove TODO 
Change-Id: I3d9ac173335bd68b66bd8dfb5e0e40894aef3f79
 2014-02-09 15:49:24 -08:00
Brad Fitzpatrick ca58231336 camtool: remove duplicated code 
Change-Id: I2009b132a1c10e60132333b9942aa4b5943b3932
 2014-02-09 15:48:07 -08:00
Brad Fitzpatrick 16b4d5c7e3 camtool: add discovery subcommand 
Change-Id: Ic4cbc2777719301d3e4f3cdb0b14c10be6f64b3e
 2014-02-09 15:16:47 -08:00
Tamás Gulácsi 97520583b8 Use 'uint32' instead of 'int64' for blob sizes everywhere. 
Not just in blob.SizedRef, but in blobserver.Fetch and
blobserver.FetchStreaming, too.
Blobs have a max size of 10-32 MB anyway, and the index.Corpus is now using
uint32 to save memory.

Change-Id: I1172445c2f9463fdaee55bfe0f1218d44be4aa53
 2014-02-08 17:58:12 +01:00
mpl 9add1d2c87 Merge "camtool list: introduce -describe to print camliType for each blob" 2014-01-31 23:10:54 +00:00
mpl 8084d6a4c7 camtool list: introduce -describe to print camliType for each blob 
Change-Id: I73630dc135a169f5b24a403b5662e7ad617cb40d
 2014-01-31 19:12:29 +01:00
Brad Fitzpatrick bda047eef7 camtool: add env camsrcroot 
Change-Id: I701e81ab732d7574a227e8f01ca09ac91c608481
 2014-01-31 12:21:04 +01:00
Brad Fitzpatrick eb27581da7 httputil: add DecodeJSON and CloseBody helpers, then use them everywhere 
httputil.CloseBody closes a http.Response.Body nicely, such that it's
more likely to be re-used.

httputil.DecodeJSON parses JSON from a Response.Body and closes the
body. It also keeps a temporary copy of the input, for error messages.

Then use them everywhere, to improve HTTP TCP connection re-use.

And misc other clean-ups.

Change-Id: I5dc44be0165b13659459ed29ce5ab44c17d9739f
 2014-01-28 22:00:52 -08:00
mpl 448f266d72 rename pkg/serverconfig to pkg/serverinit 
To avoid awkwardness with future pkg/types/serverconfig

http://camlistore.org/issue/339

Change-Id: If8a00941cdc269d6bcfe0f76c596154d5969bf0d
 2014-01-23 17:18:46 +01:00
Brad Fitzpatrick 94ff6ac141 pkg/search, pkg/client, cmd/camtool: add 'camtool claims' subcommand 
Change-Id: Id9d8381facd97a946c3582b226d433ab59b18da7
 2014-01-14 11:48:49 -08:00
Brad Fitzpatrick d3b0e933b9 camtool: add describe command 
Change-Id: I956c4a76f00bc96f2e5f2b1e5b19a1b656dd1585
 2014-01-11 16:46:03 -08:00
Brad Fitzpatrick 67a2425ea7 Add camtool list subcommand. 
Alias for sync --dest=stdout

Change-Id: Ic3714e3728852c09073f3adafe539ce494d5e219
 2014-01-11 15:28:40 -08:00
mpl 1db2e7eaf3 pkg/client: auth and (camtool) TLS fixes 
1) disallow auth from env when not in dev mode or on android
2) allow insecureTLS with flag in debug mode
3) set transport so that insecureTLS or trustedCert modes work

http://camlistore.org/issue/325

Change-Id: I6d8056bb75ffff5f002dfe9bd631ae996dc4e5ef
 2014-01-09 11:23:40 -08:00
mpl 2588ff8c83 camtool: apparently forgot to add index.go in 2d85e017ff 
Change-Id: I6b7ce9e70b15d622935950ac8b1f06d843590659
 2013-12-29 00:03:58 +01:00
Brad Fitzpatrick 9fd329df80 Merge "cmd/camtool: (re)index command" 2013-12-26 17:29:03 +00:00
mpl 2d85e017ff cmd/camtool: (re)index command 
http://camlistore.org/issue/193

Change-Id: I498f92bdc153f44dc84d4b47f03c47a8e7b54ad9
 2013-12-26 18:23:15 +01:00
Dustin Sallings 3f967a1111 camput: set handlerConfig=true when generating a config 
Change-Id: I10ca5274a90640dd72f7c678f1000cf0ddf5adf9
 2013-12-25 01:53:02 -08:00
Brad Fitzpatrick 649390b9ef camtool: make diskpacked-reindex command a bit more user-friendly 
Change-Id: Ic7cde2f453f5cd2716d929800b297cb766826acd
 2013-12-24 20:16:36 -08:00
mpl 8fec95752c pkg/index: move postgresql to sorted + some fixes 
Change-Id: Ia6410256ffe8d4cbc2b9a5c056d075707105ab08
 2013-12-24 00:37:14 +01:00
mpl 62f8a252ff pkg/index: move mysql to sorted 
also minor cleanups in sqlite and mongo

Change-Id: I1f371358997d929c72a8f63d2630a1c3fa4a0240
 2013-12-18 20:18:20 +01:00
Brad Fitzpatrick 2af4040223 camtool: add env sub-command 2013-12-17 11:27:24 -08:00
mpl b62c94fdd1 pkg/index: move sqlite implementation to sorted 
Change-Id: I1e300ffa14547fabeac8d255fd694054ebcb9e53
 2013-12-16 17:35:27 +01:00
mpl 8c562e9135 camtool: dbinit mongo support 
Change-Id: I289759ed9bdb34a6e108af1364c4a6bcfbb5982f
 2013-12-13 17:25:03 +01:00
Brad Fitzpatrick b82b8efe4c Start of new context package and *context.Context type. 
Will eventually be plumbed through lots of APIs, especially those requiring or benefiting from
cancelation notification and/or those needing access to the HTTP context (e.g. App Engine).

Change-Id: I591496725d620126e09d49eb07cade7707c7fc64
 2013-12-02 13:20:51 -08:00
Brad Fitzpatrick 3fd356f457 gofmt 
Change-Id: I900a49b3f76aec7ef65419f2a5ecaf3eae95defb
 2013-11-28 11:58:47 -08:00
Tamás Gulácsi cb6f423eeb Add diskpacked-reindex subcommand to camtool 
For checking and/or rebuilding index.kv of diskpacked packs.

Change-Id: I1ad87974b2daf58b1e767bb1df6f7b64e8b6359a
 2013-11-28 20:44:27 +01:00
Steve Phillips 5dc853110f Added missing var 'which' used in a fmt.Errorf 
Change-Id: I0b9a7c6a0c7e523a75f3e5beebbd860e0092a81f
 2013-10-04 18:44:40 -07:00
Brad Fitzpatrick 79065de4b9 For SQLite compile errors, link to the wiki. 
Change-Id: I34b1485daba6173d6665cfc56b6bba43164534d8
 2013-09-19 10:17:57 +01:00
Brad Fitzpatrick 8319411ab4 Convert more ReceiveBlob into blobserver.Receive or blobserver.ReceiveNoHash 
Change-Id: I9199555324b617167a6062a8b55ed09b449bae4f
 2013-09-16 15:57:14 +01:00
Brad Fitzpatrick b24cad68dd Cleanup: remove BlobHub and time.Duration waits from storage interface 
Move up a layer to the HTTP.  Also, start to remove ContextWrapper
stuff.  We've done it differently for App Engine instead, and will do
it differently yet moving forward.

Also add blobserver.Receive and use it in most places, moving checksum
verification up a layer.

Bunch of other cleanup and TODO fixing too.

Much simpler and cleaner.

Change-Id: I12e56c5d4e53bfcf82bdd8fb0b6d57c248ff605c
 2013-08-21 13:57:28 -07:00
mpl 9fcb4b6434 dumpconfig: typo in date 
Change-Id: Iebd75442070896b588092f8bad62e0d21cab3b27
 2013-08-09 18:12:47 +02:00
Brad Fitzpatrick 462eb7e4c2 Add camtool dumpconfig subcommand. 
Fixes http://code.google.com/p/camlistore/issues/detail?id=192
 2013-08-08 17:06:45 -07:00
Brad Fitzpatrick 0bdf20884b all: delete pkg/blobref; convert all from *blobref.BlobRef to new blob.Ref 
Change-Id: Id2dfb7f19452bedf4f3c9310b36227fd8117b225
 2013-08-03 19:54:30 -07:00
Brad Fitzpatrick 38bb307085 camtool: typo from Adrian (ajft.org) and run gofmt 
Change-Id: Ibbebea7bcf9a583c0ea1e86f09eff69acd2b174e
 2013-08-02 16:32:50 -07:00
Michael Zuffoletti c2669a6dfc issue 23: Fix google storage blobserver as sync dest 
Change-Id: I33d88dc5028ebb76d4c17d2a00d8f8346114f876
 2013-07-08 11:33:10 -05:00
Brad Fitzpatrick 9468e5ba70 More docs. Every package is documented now. 
misc.CountingReader moves into readerutil.

pkg/atomics is folded into pkg/types.

pkg/test/testdep is folded into pkg/test, with better name/docs.

Old cruft from pkg/webserver is deleted.

Change-Id: I3f72d8b29804254ef944995fb085837c878f79f5
 2013-07-07 21:12:30 -07:00
Brad Fitzpatrick 90ecd785ba Merge "client: factorize the transport setup, and use it in camget" 2013-06-26 01:58:07 +00:00
Josh Huckabee a5d72541c3 Enhance PostgreSQL support: 
* Fix dbinit command in dev server
* Make sslmode configurable in dbinit
* Don't fail on index schema setup when plpsql language already exists

Change-Id: Ic70461963f6266172d21cda8e6f071e2442d7651
 2013-06-25 16:48:38 -07:00
Josh Huckabee 65f3079498 Replace github.com/bmizerany/pq with github.com/lib/pq postgres driver. 
Change-Id: If62fd5b489696171c8be6b42a988e1c7d0a634d0
 2013-06-25 16:13:22 -07:00
mpl b24ac50965 client: factorize the transport setup, and use it in camget 
Fixes http://camlistore.org/issue/153

Change-Id: If393b34bbfcf4a6282357c9c57ebb85bae8741a3
 2013-06-25 23:37:41 +02:00
Brad Fitzpatrick ded8f8d0d7 Be helpful about how to setup SQLite, especially on a Mac. 
Change-Id: I87dbcd077383f0148a8c50f4120e6606139fcacd
 2013-06-22 17:51:09 -07:00
Brad Fitzpatrick 2e632793ca encrypt: start of index recovery/compaction from meta blobs on start-up 
Change-Id: I8aae66194ee67b1d63704ff98868e02f8b943e17
 2013-06-17 21:56:25 -07:00
mpl a32b4a10be Merge "sqlite: Write-Ahead Logging, for improved concurrency" 2013-06-12 15:00:30 +00:00
Brad Fitzpatrick 36c1ecebd9 Let camtool sync's --dest and --thirdleg flags take local disk paths, instead of servers. 
Change-Id: I8daddf06a7201384edff2cb22ecfd5872fc84928
 2013-06-09 11:36:26 +02:00
mpl a4aba6671a sqlite: Write-Ahead Logging, for improved concurrency 
http://camlistore.org/issue/114

Change-Id: I93c3d48f06a6cb0703bd9ce3f89b03fc59826a73
 2013-05-01 18:04:03 +02:00
mpl 1148a51b09 camtool dbinit: sqlite support 
Change-Id: I649a28e52df8d2689daa784dd2b1c06770e4b857
 2013-03-20 18:10:57 +01:00
mpl e6a5882511 website doc: cmds: golang style + install command 
Change-Id: I4f38dfb87e066ef81881bc9a2262c52109e172c9
 2013-03-15 23:18:09 +01:00
mpl 698e8605e6 website: /pkg/ and /cmd/ work. 
-added some doc.go for each command to make /cmd/*
work nicely.
-hacked a bit of style, mostly borrowed from golang too.

Change-Id: I011d70bca2c0151a29dfd53c78a896821730d5fb
 2013-03-15 16:40:44 +01:00
Andrew Gerrand eb81f69fdd implement camtool sync -thirdleg flag 
Fixes issue 92.

Change-Id: Ib6d5620a98d197d84f6f2954dbcbc14eaaa8e228
 2013-03-11 21:09:25 +11:00
mpl b5e75e9207 cmdmain: use ExitWithFailure, exit on error instead of returning it 
Change-Id: I553bed110394cb8ab48b331ba74d551b840ada5c
 2013-02-27 22:04:50 +01:00