Commit Graph

23 Commits

Author SHA1 Message Date
Brad Fitzpatrick 4cc81262b4 schema: clarify that WriteFileFromReader's filename is optional
Change-Id: I0df3783b282492db1dac29ed3c07e9a38df30a5e
2013-10-20 12:24:32 -07:00
Brad Fitzpatrick 59534f0ad6 Move pkg/gate to pkg/syncutil, to house more stuff.
Change-Id: I737458641a9de03da55ed627bfac10f3377a13aa
2013-09-12 16:04:10 +01:00
Brad Fitzpatrick d293b8fd34 Use pkg/gate in a couple places. Do s3 parallel state. Update TODO.
Change-Id: I23006baa7b454ceca3f07c8fa7789ad54c524849
2013-08-21 19:05:52 -05:00
Brad Fitzpatrick 0bdf20884b all: delete pkg/blobref; convert all from *blobref.BlobRef to new blob.Ref
Change-Id: Id2dfb7f19452bedf4f3c9310b36227fd8117b225
2013-08-03 19:54:30 -07:00
Brad Fitzpatrick ca58d8e2e0 Remove noisy var _ = log.Printf lines.
Change-Id: Ia58b8ef5f271f542ae4fe61c7fb1497322770322
2013-06-14 12:55:55 -07:00
Brad Fitzpatrick 0309c22285 schema: work-around fix for Issue 97/100 until 102 is fixed
Change-Id: Ied51ffe2b50acc390d068696ebbe88e60061ef91
2013-02-07 17:12:08 -08:00
Brad Fitzpatrick 16c70de194 schema: fix hang in WriteFileChunks, used by vivify & the Android app
Change-Id: I6099633a300119ef3f0e47266bb6196c475b6378
2013-02-03 22:28:11 -08:00
Brad Fitzpatrick 9eed2f6082 schema: remove FileWriter's serial byte/file schema uploads after chunks are uploaded
Change-Id: I1c3a9c496ce168cc8b6d087ef1a0de99cac22127
2013-02-02 22:35:08 -08:00
Brad Fitzpatrick 6a4eff5b84 schema: make serverHasBlob just use blobserver.StatBlob
Change-Id: I3012763660c9ed87eb48b2d95b8265c3c77f32df
2013-02-02 21:50:03 -08:00
Brad Fitzpatrick 9d339355f0 schema: make FileWriter upload different chunks in parallel
Change-Id: I4608a21ffc45324512a696dfe070b38416aae130
2013-02-02 20:17:14 -08:00
Brad Fitzpatrick f266b843ed schema: simplify WriteFileChunks
Change-Id: Icf9077db0adb5081b93f89ddc9d74a4cc45f20e1
2013-02-02 19:34:23 -08:00
Brad Fitzpatrick ebb6fc85c2 schema: simplify uploadBytes signature
Change-Id: I508934ab83b25ef3a066de9128e16a18a7d82dd3
2013-02-02 10:58:47 -08:00
Brad Fitzpatrick 1bf01d7315 schema: lot of Blob/Builder work, and kill schema.Map.
Next up: unexport schema.Superset.

Change-Id: Ia4bb34790abba75bdb4d4101df7a4f15875f4237
2013-01-21 20:56:12 -08:00
Brad Fitzpatrick 7ceaaa0012 blobref: simplify the FromHash func. Make type implicit.
Change-Id: I2e01c3663bdb1151c11dfc9a1d59c7081940ffac
2013-01-20 13:36:27 -08:00
mpl 6cb7ecd644 camput: Preparation for vivify.
Refactor writeFileMapRolling so we can write the chunks,
then the top level contents, separately.

Change-Id: Ib56cd4b2aa295516fafbe7072ad5b352d1aaaa89
2012-12-23 01:15:29 +01:00
Brad Fitzpatrick 22495f8bfd schema: adjust rollsum splitting algorithm, make it the default
We might tweak the parameters yet, and I want to add a bunch more
tests, but this is a major relief for me.  I've been reluctant to
put too much data into my personal Camlistore instance until I
figured out how I wanted the file chunks to split.

This also simplifies (deletes) a fair bit of code.

Change-Id: I35c38cc5d39a8a43e3f62445434f8d7fd5de5d17
2012-10-29 02:03:05 +01:00
Brad Fitzpatrick a8629ec5dd schema: unexport NewBytes
Change-Id: Ia6ec7c9aec33319bf277b93a189b4fa43d0540b9
2012-08-22 04:33:06 +10:00
Brad Fitzpatrick b67d753364 schema: docs and cleanup
Change-Id: Ib720b7f711d71bdeaaf33374f376f14b30a5a97c
2012-08-22 04:14:47 +10:00
Brad Fitzpatrick 11eac8721e Convert more code to use schema.Map instead of map[string]interface{}
Change-Id: I285fd1b0e730ebd32069688a71cb992c43770ade
2012-08-22 03:47:38 +10:00
Brad Fitzpatrick 3cd7f75f89 schema: introduce type Map
Change-Id: I8209930d8505a4cb74b8ea29b5b57f2cd6bd14d2
2012-08-22 03:36:36 +10:00
Brad Fitzpatrick 0a0b012eba camput,schema: cleanup, docs
Change-Id: Ifa94cb1e9e086f85222692508ab12616f4cc3211
2012-08-22 03:31:44 +10:00
Brad Fitzpatrick 18e53cd72f rename MapToCamliJson to Go style initialism MapToCamliJSON
Change-Id: I674944c9fafa6b78c495d22c525b9ffd0b75dbf9
2012-04-15 07:45:10 -07:00
Brad Fitzpatrick 0714a463c9 Update from r60 to [almost] Go 1.
A lot is still broken, but most stuff at least compiles now.

The directory tree has been rearranged now too.  Go libraries are now
under "pkg".  Fully qualified, they are e.g. "camlistore.org/pkg/jsonsign".

The go tool cannot yet fetch from arbitrary domains, but discussion is
happening now on which mechanism to use to allow that.

For now, put the camlistore root under $GOPATH/src.  Typically $GOPATH
is $HOME, so Camlistore should be at $HOME/src/camlistore.org.

Then you can:

$ go build ./server/camlistored

... etc

The build.pl script is currently disabled.  It'll be resurrected at
some point, but with a very different role (helping create a fake
GOPATH and running the go build command, if things are installed at
the wrong place, and/or running fileembed generators).

Many things are certainly broken.

Many things are disabled.  (MySQL, all indexing, etc).

Many things need to be moved into
camlistore.org/third_party/{code.google.com,github.com} and updated
from their r60 to Go 1 versions, where applicable.

The GoMySQL stuff should be updated to use database/sql and the ziutek
library implementing database/sql/driver.

Help wanted.

Change-Id: If71217dc5c8f0e70dbe46e9504ca5131c6eeacde
2012-02-18 21:53:06 -08:00