Commit Graph

227 Commits

Author SHA1 Message Date
Brad Fitzpatrick 6b466d0faa camput, client: push havecache down deeper, make it track blob sizes.
also, clean up some camput HTTP stuff.

Change-Id: I2762e5a1b83139132b5f660d306ed45584a7799a
2013-01-01 20:23:44 -08:00
Brad Fitzpatrick 9bee164972 camput: enabling client caching by default
make havecache/statcache named on disk by remote server's generation,
hide debug options in camput unless CAMLI_DEBUG=1 is set,
push havecache down into pkg/client.

Change-Id: Ic152397abc11b4ff3931468ffe93cf1eba62b438
2012-12-31 13:45:13 -08:00
Brad Fitzpatrick 9605d3e950 client: add StorageGeneration accessor
Change-Id: Ie61a5386f433659421cdf5cc89d216b654f5b0fb
2012-12-31 11:36:58 -08:00
Brad Fitzpatrick cefe9b42ee client: cap the number of in-flight requests to 5, for now
keeps camput and the server from running out of file descriptors. will do something
smarter in a subsequent patch.

Change-Id: Icca5027388eb838d45b443b7f2c331ba0f2c6585
2012-12-28 09:24:26 -08:00
Brad Fitzpatrick 764e41a50c Work around golang.org/issue/4590
Change-Id: Ibde7a93db7dcb8c51eb828b6c4e50505904fce6a
2012-12-26 13:36:45 -08:00
Brad Fitzpatrick a2df86d08e More workarounds for http://golang.org/issue/4589.
These ones don't matter as much, though (just debug output)

Change-Id: Ief8c49e0243e21feacf035e63dbe925bb417f716
2012-12-26 13:17:36 -08:00
Brad Fitzpatrick 3d64c9fd7f client: add temporary CAMLI_DEBUG_UPLOADS env option
Change-Id: Ibd6543789e944f66d0f2feaa25c295ca14f3b530
2012-12-24 12:16:03 -08:00
Brad Fitzpatrick 642f5d5679 client: minor cleanup
Change-Id: Ic61b7db69b993ed88ceda946cdcb6bf26f251538
2012-12-24 11:04:39 -08:00
Brad Fitzpatrick a40078e3b6 client: fix test failure
Change-Id: I811b572c79e7e3797a23376bf01b90c49382d7fd
2012-12-23 14:20:15 -08:00
Brad Fitzpatrick 896dba2cc8 camsync, client: check size consistency in sync pass too.
Change-Id: I4509f1799bbe578d76b94285309c5ad364311a42
2012-12-23 09:22:25 -08:00
Brad Fitzpatrick 0b022b433a camput, schema, client: query server for dups before uploading, like the JavaScript UI.
Change-Id: Id12f78cf2a095adcfad90ca4c6416bb80b6e9b14
2012-12-22 22:48:21 -08:00
Brad Fitzpatrick b32008ed34 camput, client: start of making camput file check searchRoot for wholedigest dups
Change-Id: Ic014ef54705b14482c42936bf6957dc87efa1cf7
2012-12-22 18:42:35 -08:00
mpl a536e2a6d3 Merge "camput: Preparation for vivify." 2012-12-23 00:11:08 +00:00
mpl 6cb7ecd644 camput: Preparation for vivify.
Refactor writeFileMapRolling so we can write the chunks,
then the top level contents, separately.

Change-Id: Ib56cd4b2aa295516fafbe7072ad5b352d1aaaa89
2012-12-23 01:15:29 +01:00
Brad Fitzpatrick a03c25c74c client: qualify channel directions
Change-Id: I49d7c9d18b256beb1fbc7af2a33da94511cf97a2
2012-12-22 14:23:26 -08:00
Brad Fitzpatrick cc353f5748 client: case style
Change-Id: Ie72ebd19c09a863ba1be00fb35904daf867daa14
2012-12-21 17:00:24 -08:00
Brad Fitzpatrick db55ee77d9 camput: automatic blobroot path discovery 2012-11-07 22:23:45 -06:00
Brad Fitzpatrick a51cda3a34 client: move stats stuff to stats.go 2012-11-07 21:11:12 -06:00
Brad Fitzpatrick 5221a1ded9 client: document SetHTTPClient 2012-11-07 21:06:10 -06:00
Brad Fitzpatrick 281a6c40f4 client: correct case of SetHTTPClient 2012-11-07 21:03:46 -06:00
mpl a534e02c2d camput: client becomes StatReceiver.
also added ReaderSize function to
guess before reading the size of
a source.

Change-Id: I659e174821696b3c58759b132b82710a49583018
2012-10-11 11:51:12 +02:00
Brad Fitzpatrick a5169d1468 client: memoize SignerPublicKeyBlobref 2012-08-05 09:25:21 +10:00
Brad Fitzpatrick b3ab27e049 remove log noise 2012-08-05 09:15:17 +10:00
Brad Fitzpatrick 487d9a6eab client: use ioutil.Discard
Change-Id: I24478df1f9d41e3aa7440ae0b383f21e1dad921c
2012-04-22 16:19:04 -07:00
Brad Fitzpatrick 63d201cdc8 client: remove some log verbosity
Change-Id: I107ebd67e2540e0477ed46ddeacc0533da38586f
2012-04-21 08:29:43 -07:00
Brad Fitzpatrick e4a17bc8ac camput: fix init and some config stuff.
Change-Id: I121bd9c2dfac3c076db0db75d8f939b5ec571ca4
2012-04-12 19:36:00 -07:00
Brad Fitzpatrick 0714a463c9 Update from r60 to [almost] Go 1.
A lot is still broken, but most stuff at least compiles now.

The directory tree has been rearranged now too.  Go libraries are now
under "pkg".  Fully qualified, they are e.g. "camlistore.org/pkg/jsonsign".

The go tool cannot yet fetch from arbitrary domains, but discussion is
happening now on which mechanism to use to allow that.

For now, put the camlistore root under $GOPATH/src.  Typically $GOPATH
is $HOME, so Camlistore should be at $HOME/src/camlistore.org.

Then you can:

$ go build ./server/camlistored

... etc

The build.pl script is currently disabled.  It'll be resurrected at
some point, but with a very different role (helping create a fake
GOPATH and running the go build command, if things are installed at
the wrong place, and/or running fileembed generators).

Many things are certainly broken.

Many things are disabled.  (MySQL, all indexing, etc).

Many things need to be moved into
camlistore.org/third_party/{code.google.com,github.com} and updated
from their r60 to Go 1 versions, where applicable.

The GoMySQL stuff should be updated to use database/sql and the ziutek
library implementing database/sql/driver.

Help wanted.

Change-Id: If71217dc5c8f0e70dbe46e9504ca5131c6eeacde
2012-02-18 21:53:06 -08:00