Commit Graph

12 Commits

Author SHA1 Message Date
Brad Fitzpatrick a51edb5e77 localdisk: simplify directory locking.
Tries to fix https://code.google.com/p/camlistore/issues/detail?id=177

Change-Id: I2ea089437528d39ecdb8a3a3129e03ba11a76e67
2013-09-08 14:55:41 -07:00
Brad Fitzpatrick b24cad68dd Cleanup: remove BlobHub and time.Duration waits from storage interface
Move up a layer to the HTTP.  Also, start to remove ContextWrapper
stuff.  We've done it differently for App Engine instead, and will do
it differently yet moving forward.

Also add blobserver.Receive and use it in most places, moving checksum
verification up a layer.

Bunch of other cleanup and TODO fixing too.

Much simpler and cleaner.

Change-Id: I12e56c5d4e53bfcf82bdd8fb0b6d57c248ff605c
2013-08-21 13:57:28 -07:00
Brad Fitzpatrick 6dac08f539 localdisk: don't allocate 512 KB on each readdir
Change-Id: I3e71605f0ef53351f0ee50bb78bdfbf6b5d7dca1
2013-08-20 16:29:24 -07:00
Brad Fitzpatrick 0bdf20884b all: delete pkg/blobref; convert all from *blobref.BlobRef to new blob.Ref
Change-Id: Id2dfb7f19452bedf4f3c9310b36227fd8117b225
2013-08-03 19:54:30 -07:00
Brad Fitzpatrick 36c1ecebd9 Let camtool sync's --dest and --thirdleg flags take local disk paths, instead of servers.
Change-Id: I8daddf06a7201384edff2cb22ecfd5872fc84928
2013-06-09 11:36:26 +02:00
Brad Fitzpatrick d2b20395e9 localdisk: Ignore 'cache' directory when enumeration.
Change-Id: Iebc3d71b13f21e6f9a80c8bbfccced5fe6bcfb1d
2012-12-21 17:48:07 -08:00
Brad Fitzpatrick 9d57c52c34 localdisk: attempt #3 at fixing queue directory delete/create race.
this version seems to work for quite awhile now, at least.

Change-Id: I1484838a9b1b2b12a8af72e57e6c7ba6bd06e07d
2012-04-22 17:17:51 -07:00
Brad Fitzpatrick b5bccf2261 localdisk: fix double slash in full path, preventing race lock from working
Change-Id: I171099214b06ec99d0ad766d1604442879fb3183
2012-04-21 08:29:32 -07:00
Brad Fitzpatrick 0e5d27a05c localdisk: fix race deleting empty directories w/ uploading new blobs
Change-Id: Icae0b7dd3de051bba23d1a583b47f5421adedb47
2012-04-20 13:04:42 -07:00
ranveer d1e1f2bcb1 Add path/filepath
Fixes broken build.

Change-Id: Ia691b76b9a4d3c92f310223166f53d65f1286ec1
2012-02-22 10:52:21 -02:00
mpl 28caffab1f remove empty blob dirs in queue. fixes issue 47.
Change-Id: If07576825123be910f040f0c5a0dc6988d55de08
2012-02-20 15:07:14 +01:00
Brad Fitzpatrick 0714a463c9 Update from r60 to [almost] Go 1.
A lot is still broken, but most stuff at least compiles now.

The directory tree has been rearranged now too.  Go libraries are now
under "pkg".  Fully qualified, they are e.g. "camlistore.org/pkg/jsonsign".

The go tool cannot yet fetch from arbitrary domains, but discussion is
happening now on which mechanism to use to allow that.

For now, put the camlistore root under $GOPATH/src.  Typically $GOPATH
is $HOME, so Camlistore should be at $HOME/src/camlistore.org.

Then you can:

$ go build ./server/camlistored

... etc

The build.pl script is currently disabled.  It'll be resurrected at
some point, but with a very different role (helping create a fake
GOPATH and running the go build command, if things are installed at
the wrong place, and/or running fileembed generators).

Many things are certainly broken.

Many things are disabled.  (MySQL, all indexing, etc).

Many things need to be moved into
camlistore.org/third_party/{code.google.com,github.com} and updated
from their r60 to Go 1 versions, where applicable.

The GoMySQL stuff should be updated to use database/sql and the ziutek
library implementing database/sql/driver.

Help wanted.

Change-Id: If71217dc5c8f0e70dbe46e9504ca5131c6eeacde
2012-02-18 21:53:06 -08:00