Commit Graph

2951 Commits

Author SHA1 Message Date
Brad Fitzpatrick cf2813a5a4 mysql indexer: implement indextest tests & fix Get bug that it found.
also, delete the other index package's testdata symlinks.

Change-Id: Ie848b880b5d7397e8d334e636a358396024ad144
2012-03-29 16:12:12 -07:00
Brad Fitzpatrick 427ef88dc2 mysql indexer: start of tests.
Change-Id: I5df79f57607b5e4fe4f67f79a8e5ba8966e8dec5
2012-03-28 17:15:37 -07:00
Brad Fitzpatrick 2d0e0de553 index: skip dirs stating with _, like _obj
Change-Id: I6c12e2f2740e417fa3858f9872e7ea60843c4877
2012-03-28 16:45:54 -07:00
mpl 95b9622271 Check that all indexer packages have all the required tests
Change-Id: I3c189060bce299235828a9d57a7bb679b05adffd
2012-03-28 10:33:48 +02:00
Brad Fitzpatrick 6c6dcdc8a1 auth: in dev mode, use localhost TCP port owners before http basic auth
Change-Id: I6a45518811fd8726233171d5436c625c645b4037
2012-03-27 17:57:13 -07:00
Brad Fitzpatrick af78a93c9a netutil: implement IPv6 ident on Linux; add http auth handler example.
Change-Id: I35c8993909cbddd22ace481a4a5bf7e36c323fec
2012-03-27 17:28:42 -07:00
Brad Fitzpatrick 6078992fe0 netutil: implement ConnUserid on darwin.
Change-Id: I6d163a921966dea4be9908c676bdb5d035cba295
2012-03-27 15:54:34 -07:00
Brad Fitzpatrick 2838ec13dd netutil: add end-to-end ident test; passes on Linux, fails on Darwin
Next up: implement on Darwin.

Change-Id: Ib41f5e5c6fd086dfc4bfd3205d1d807fbd9cecb2
2012-03-27 10:58:41 -07:00
Brad Fitzpatrick 7f90db0291 rename mysqlindexer to mysql to match import
Change-Id: I23cd9cfc40a0e01cb0086fc5c9a3ad108f3705a8
2012-03-27 09:37:32 -07:00
Brad Fitzpatrick 69328c751f fix camdbinit; use correct mysqlindexer import
Change-Id: I227e219ec32f81a11cc6192cd60de8b89878bedc
2012-03-27 09:17:26 -07:00
Brad Fitzpatrick 10cf23c700 Get the MySQL indexer working again.
It now uses the generic indexing layer, rather than its own schema.
Also, move it under pkg/index/, like mongo.
Also, link in mongo to the main binary.
Not using the tests yet (leaving for mpl :))

Change-Id: I47a2203ca6c0b5244cd458aedec46227c4363c62
2012-03-26 13:57:53 -07:00
Brad Fitzpatrick ab9edea228 mysqlindexer: implement iterator. untested.
Change-Id: I168e2b6c30c4f8a83c73a3530652f4fb82333cda
2012-03-25 20:45:15 -07:00
Brad Fitzpatrick 0983831e68 mysqlindexer: implement batch mutation
Change-Id: I7ff3c17cf082245cd11b29635079e73d9a565577
2012-03-25 16:41:31 -07:00
Brad Fitzpatrick 401f07f6cf mysqlindexer: implement Get, Set, Delete
Change-Id: I5670bfc9ac91044be663f248c034ae20c11562bb
2012-03-25 00:30:22 -07:00
Brad Fitzpatrick cc75c449cf remove/move remnants of pkg/third_party
Change-Id: Id86dc22bf3a870fee41bbc139872f549df278073
2012-03-25 00:24:13 -07:00
Brad Fitzpatrick 26e8171f40 move third_party README
Change-Id: Ia8ac7c601ca75d3fd51be3ac8bb462bd96b58c89
2012-03-25 00:20:00 -07:00
Brad Fitzpatrick 615c85c3dc remove go-flickr from third_party
Change-Id: Ic71d2f1964fbde26b8bd8d8a322d5de4743832da
2012-03-25 00:17:45 -07:00
Brad Fitzpatrick c80b84c214 update gomemcache in third_party
Change-Id: Ib7e39ebeed1a80351b90b6d9ee583952d0a255e6
2012-03-25 00:00:43 -07:00
Brad Fitzpatrick 18fc785b33 remove github.com/Philio/GoMySQL from third_party
Change-Id: Iaff46d2a4f6f11793e31ac5f6ae99e7e7b396612
2012-03-24 23:54:07 -07:00
Brad Fitzpatrick c8e19a90d0 mysqlindexer: connect; ping
Change-Id: Ic9a8422dc10c8514a4f10a14a878c5729068d56f
2012-03-24 23:53:35 -07:00
Brad Fitzpatrick 9561cf3142 remove go-fuse from third_party
Change-Id: Iccc1425d40ae895a585839fd0da0be16295c18a7
2012-03-24 23:52:26 -07:00
Brad Fitzpatrick ef7e3c2e90 make pkg/mysqlindexer and camdbinit compile again, even if not working yet
Change-Id: I3fbdfda6c456c079a3ac58ea988e43301e957f11
2012-03-24 19:45:23 -07:00
Brad Fitzpatrick 125c33f019 camlistored: auto-generate a secring/keyId for new users, without gpg
Change-Id: Ib653f9cb5fa0f5e4730854dfaea6c4654f94f377
2012-03-19 21:31:20 -07:00
Brad Fitzpatrick ea2342bf35 jsonsign: add WriteKeyRing function & tests.
Change-Id: Ic90751fd7834bf0e3bb0e1073fca647370561165
2012-03-19 21:00:51 -07:00
Brad Fitzpatrick a7200af73e jsonsign: start of WriteKeyRing
Change-Id: Id312578956d36b234d67d0c3f2ea3a261d122d48
2012-03-19 19:02:18 -07:00
Brad Fitzpatrick 67e32df2bd Fix a bunch of broken tests, lost in the Go 1 conversion.
Change-Id: I7c16563bc25f52868984c63e42125cd9bd9d5812
2012-03-19 18:44:50 -07:00
Brad Fitzpatrick 81ac8e61ec serverconfig: don't hard-code .camli in default secring path
Change-Id: Id174acaa5aa080e1c021c5032d1aa7cf45501b3e
2012-03-19 13:49:41 -07:00
Brad Fitzpatrick 73cd34a6a0 serverconfig & camlistored: simplify low/high-level config bootstrapping.
Change-Id: I22e003ff2eaa29b09a5c4cbb59afa1ca9bd624df
2012-03-19 13:09:00 -07:00
Brad Fitzpatrick c7d3f606b2 osutil: add per-OS CamliBlobRoot; use .camlistore, not .camli
Change-Id: I9e085d3f7a38357eca0bee0d5576a3db7cb1455e
2012-03-19 13:07:46 -07:00
Brad Fitzpatrick f877e849d6 jsonconfig: sort unknown keys when returning errors
Change-Id: I5930e8b6c18581e2b9901b4d7ebc1e02af7a7be6
2012-03-19 13:07:17 -07:00
Brad Fitzpatrick 685189ca4c cammount: update to use rsc's fuse library; pkg/fs: butcher it up to make it compile.
doesn't work again yet.

Change-Id: I462320918026944716638588d08ba76c67c72a73
2012-03-18 23:54:20 -07:00
Brad Fitzpatrick 6ac0b8c027 WIP, porting pkg/fs to rsc's fuse library
Change-Id: I81156bc518892d9b387607a89dc0655c74aeb42a
2012-03-18 23:14:34 -07:00
mpl 7f630657d5 generate low level configuration
Change-Id: I43d1610bdc386954dea724b4b38e184bf16e2d34
2012-03-16 00:05:24 +01:00
Brad Fitzpatrick a229abeebd camget: fix build. update dev-camget.
Change-Id: I5289801de7b50caedeabd9cc2513d768aafd424b
2012-03-05 08:04:42 -08:00
Brad Fitzpatrick 1026c32f06 remove the db and dbimpl packages; now in the Go core as database/sql and database/sql/driver
Change-Id: Ie88df6466f9b81e4320895049dd3611c43e0ea4a
2012-03-05 07:34:01 -08:00
mpl 882f2d5eef generate default config for user when needed
Change-Id: Ifb5897b38cd72f18ff7ce1e9c3a8c23ee8751ba1
2012-03-05 00:04:35 +01:00
Brad Fitzpatrick 35e0f4805f cond: use new bytes.NewReader instead of bytes.NewBuffer
Change-Id: If55c959983b5a894fc838d3d5aa2dd45e1e86892
2012-03-03 12:43:37 -08:00
Brad Fitzpatrick 3ab1618f0b schema: generate unique permanodes.
it was using second time granularity for both the random and the signing,
leading to dup permanode creation on fast machines.

Change-Id: Id7ea50f8ce8c4c3da6964e98bb3a09dc7992cec7
2012-03-03 12:37:54 -08:00
Brad Fitzpatrick 7751fac185 fix dev-server for file embedding
Change-Id: I23254930eaedf11a87389d85f54f86bafac20866
2012-02-29 08:01:59 -08:00
Brad Fitzpatrick a98c59f082 include file modtimes in filembed
Change-Id: I9255071c163664bd9b00786df65e630668e227d0
2012-02-28 22:49:52 -08:00
Brad Fitzpatrick 552b768eeb add genfileembed tool, to embed html/css/js/etc into zembed_*.go files 2012-02-28 14:50:17 +11:00
Brad Fitzpatrick 64bbffc3b5 move fileembed from misc 2012-02-28 12:45:46 +11:00
mpl f9d0ad487e index packages reorganization
Change-Id: Ie91c4bb5ea02a49e59ad093ac972d84b17a046d4
2012-02-26 13:50:14 +01:00
ranveer d1e1f2bcb1 Add path/filepath
Fixes broken build.

Change-Id: Ia691b76b9a4d3c92f310223166f53d65f1286ec1
2012-02-22 10:52:21 -02:00
Brad Fitzpatrick af57ae8ae1 don't fail if mongo isn't available
Change-Id: I60754c1f0ec6a942c77ae9618c9a9ee12071ddb4
2012-02-22 01:23:23 -08:00
mpl 5a2c060409 mongo tests now actually fail when no mongodb running
Change-Id: I470c2184c620fa0bba02001ea6877a95cf53d9d6
2012-02-21 15:25:29 +01:00
mpl d40c9dce1d update memindex: use default for db r/w options,
update secring path in test,
-> all tests in index now pass

Change-Id: I8fdd99aad1d0d009cf99c773801a9ae875b56137
2012-02-21 11:51:54 +01:00
mpl a7c4d1f03a time details
Change-Id: Ic4041956e1d7d3b50fea00ab970a68f3c4c2e80d
2012-02-21 11:01:27 +01:00
mpl 28caffab1f remove empty blob dirs in queue. fixes issue 47.
Change-Id: If07576825123be910f040f0c5a0dc6988d55de08
2012-02-20 15:07:14 +01:00
mpl 50df48d519 first pass with mgo as indexer
fixed indexer so that it builds as a package
added mgo as a third party
fixed mgoindexer
fixed (hackishly) tests so that they pass
I ignored everything memindex for now

Change-Id: I3c03ecfa859cf92b088a759239278b1c0edaf8aa
2012-02-20 14:40:24 +01:00
Brad Fitzpatrick 0714a463c9 Update from r60 to [almost] Go 1.
A lot is still broken, but most stuff at least compiles now.

The directory tree has been rearranged now too.  Go libraries are now
under "pkg".  Fully qualified, they are e.g. "camlistore.org/pkg/jsonsign".

The go tool cannot yet fetch from arbitrary domains, but discussion is
happening now on which mechanism to use to allow that.

For now, put the camlistore root under $GOPATH/src.  Typically $GOPATH
is $HOME, so Camlistore should be at $HOME/src/camlistore.org.

Then you can:

$ go build ./server/camlistored

... etc

The build.pl script is currently disabled.  It'll be resurrected at
some point, but with a very different role (helping create a fake
GOPATH and running the go build command, if things are installed at
the wrong place, and/or running fileembed generators).

Many things are certainly broken.

Many things are disabled.  (MySQL, all indexing, etc).

Many things need to be moved into
camlistore.org/third_party/{code.google.com,github.com} and updated
from their r60 to Go 1 versions, where applicable.

The GoMySQL stuff should be updated to use database/sql and the ziutek
library implementing database/sql/driver.

Help wanted.

Change-Id: If71217dc5c8f0e70dbe46e9504ca5131c6eeacde
2012-02-18 21:53:06 -08:00