Commit Graph

1175 Commits

Author SHA1 Message Date
Brad Fitzpatrick bce395b9b3 Merge "fuse: Enable tests on Linux; make them pass" 2013-12-27 20:52:46 +00:00
Dustin Sallings c6768d8875 fuse: Enable tests on Linux; make them pass
This is essentially two things:

1. Trivial changes to fs_test to make it not skip on Linux
2. Move much of the logic that was in *mutFile.Release into *mutFile.Flush

See http://sourceforge.net/apps/mediawiki/fuse/index.php?title=FUSE_tutorial
and the FUSE FAQ for an explanation of Flush vs. Release.

Change-Id: Id63312b3f8ebf12917338b836beb8a7a736d4fe6
2013-12-27 11:51:17 -08:00
Aaron Boodman 88973d4871 Clarify confusing log message in Flickr importer
Change-Id: I9201bd12e7afb31c08b34b4bc4cd7c39567de296
2013-12-27 00:02:33 -08:00
Brad Fitzpatrick 55955a7734 fs: fix other case where we're comparing Flags to 0 2013-12-26 14:11:20 -08:00
Brad Fitzpatrick 3f7dde054c fs: only reject read-only open if flags contain a blacklisted write flag 2013-12-26 13:55:27 -08:00
Dustin Sallings 3742b287a9 require auth config in storage-remote
The client configuration requires this if it's not passed in through the
environment.  Since this is for a storage service, it makes sense to
place it with the specific remote.

Since SetupAuthFromConfig was a bit awkward and not used elsewhere, it's
replaced with a more simple and explicit SetupAuthFromString to which
the exact auth details you wish to use are provided.

Change-Id: Id39ff314738794e299d48cbe634be2aa5d5c3bd1
2013-12-26 11:00:03 -08:00
Brad Fitzpatrick 9fd329df80 Merge "cmd/camtool: (re)index command" 2013-12-26 17:29:03 +00:00
mpl 2d85e017ff cmd/camtool: (re)index command
http://camlistore.org/issue/193

Change-Id: I498f92bdc153f44dc84d4b47f03c47a8e7b54ad9
2013-12-26 18:23:15 +01:00
Brad Fitzpatrick 6ef671249b Merge "remote: fix crash due to nil logger" 2013-12-26 16:29:11 +00:00
Brad Fitzpatrick 6793ce3d93 client: fix one of the constructors that allowed logger to be uninitialized
Change-Id: Id864716cd5c821fbb2446bab7a42ed9b89a6983e
2013-12-26 08:28:15 -08:00
Dustin Sallings 96ef529509 remote: fix crash due to nil logger
This happened in a well-timed HTTP failure:

runtime.panic(0x674580, 0x10e67b9)
	/Users/dustin/prog/eprojects/go/src/pkg/runtime/panic.c:266 +0xb6
log.(*Logger).Output(0x0, 0x2, 0xc2104e4870, 0x83, 0x0, ...)
	/Users/dustin/prog/eprojects/go/src/pkg/log/log.go:134 +0x46b
log.(*Logger).Print(0x0, 0x13b29b8, 0x1, 0x1)
	/Users/dustin/prog/eprojects/go/src/pkg/log/log.go:165 +0x66
camlistore.org/pkg/client.func·011(0x7da390, 0x13, 0xc21075d400, 0x1, 0x1, ...)
	$GOPATH/src/camlistore.org/pkg/client/upload.go:363 +0x133
camlistore.org/pkg/client.(*Client).Upload(0xc21014ec00, 0xc2109fa7b0, 0x0, 0x0, 0x0)

Change-Id: I9859bc8f03ef0dd9c9b89b7e22815c5ee5b7fd87
2013-12-26 01:27:56 -08:00
Brad Fitzpatrick d5cf14d977 Make the reindex flag actually work.
Don't log.Fatal first saying the schema version is wrong.

Change-Id: I86272515cd62e5db13a5f31cffb91316285fb3fe
2013-12-25 09:49:51 -08:00
Brad Fitzpatrick bf5813564a Merge "pkg/blobserver: Introduce a BlobStreaming interface." 2013-12-25 16:42:41 +00:00
Brian Gitonga Marete 92cedc3f72 pkg/blobserver: Introduce a BlobStreaming interface.
This commit introduces the basic API required to implement
high-throughput blob streaming functionality within the various blob
storage engines.

Change-Id: Ie170d11b229196617f96b298f864ad12af62c363
2013-12-25 13:18:40 +03:00
Bill Thiede fe25884b71 pkg/sorted/kvfile: faster wipe.
Delete the underlying DB file instead of iterating over the contents and
deleting item by item.

Change-Id: I1328c44b447ba9b1dc1cf81fdaf1f2437f80a071
2013-12-24 21:27:49 -08:00
Bill Thiede 63096a3133 pkg/search: fix is:pano test.
Fix breakage in
https://camlistore.org/gw/7b6790f56ab3f634fb42908731b211ec2236b6cc

Change-Id: Iba1084944cec54c11702911a88c584ee0efe5fec
2013-12-24 21:25:28 -08:00
Brad Fitzpatrick 911d07e16e client: use a method value.
http://golang.org/doc/go1.1#method_values

Change-Id: I68d516fdbfa60b6688f74bd9c3293583fc51b2ec
2013-12-24 19:47:16 -08:00
Brad Fitzpatrick 7b6790f56a search: make is:pano be a bit wider.
Change-Id: I73a27b296a62d77bd1f8967a690a361f7aa4edde
2013-12-24 17:55:46 -08:00
Brad Fitzpatrick eb85f58340 Merge "FUSE: support renaming roots" 2013-12-25 00:03:05 +00:00
Dustin Sallings de98f54994 FUSE: support renaming roots
Change-Id: I2acdd9a59e1b031b1a9d02d3cd07f7b9b16818a5
2013-12-24 16:01:06 -08:00
Brad Fitzpatrick e6496b45d8 index: update index-out-of-sync error message to suggest camlistored --reindex
Change-Id: I17dcd758e49a25c05ab5519a49ed3832610d2ba0
2013-12-24 15:46:17 -08:00
Brad Fitzpatrick 7728d7e2f8 index: bump schema version for EXIF changes
Change-Id: If91e3429d8ffb6a9f1eb7d6c5ab86d99bcc0a120
2013-12-24 15:42:45 -08:00
Brad Fitzpatrick 289065c730 sorted/kvfile: make it actually compile
Change-Id: I0a3916c1c260dfac6b3444a18510a013d429ef33
2013-12-24 15:35:29 -08:00
Brad Fitzpatrick 08514b5118 Merge "pkg/sorted/kvfile: add sorted.Wiper." 2013-12-24 21:52:49 +00:00
Brad Fitzpatrick bc15a1d7a6 search: fix two double-RLock deadlocks
Change-Id: I5d083150cb1dc4e43c6a64146dee8a3672b7ea40
2013-12-24 13:46:18 -08:00
Brad Fitzpatrick d7c58ebc7c syncutil: in RWMutexTracker, log.Fatal instead of panic on double-RLock
Change-Id: Ifc34b29fb8264f96e2e9516948d9c0b4bfff984a
2013-12-24 13:45:50 -08:00
Brad Fitzpatrick f8d9e6663d geocode: move logging
Change-Id: I42d901510f9d8085c29792fd6b7ea8e1dc082c06
2013-12-24 13:43:25 -08:00
Bill Thiede de3a5d1941 pkg/sorted/kvfile: add sorted.Wiper.
This allows people with kvIndexFile in their server-config.json to run:
camlistored -reindex

Change-Id: If1008297fa29ca514260529edb2125a1ea7d5246
2013-12-24 13:15:24 -08:00
Brad Fitzpatrick f053007954 geocode: cache and dup-suppress lookups
Change-Id: I600b9d9957ea74d4b91d0b162c7de55d643e0ee9
2013-12-24 12:43:19 -08:00
Brad Fitzpatrick 2bc4b5075f readerutil: fix OpenSingle bug causing "bad file descriptor" in dispacked.
Simplifies the code a bit, even though locking is a bit more coarse
now. We can make it faster later if it matters, especially now that
there's a test (which reliably failed before this fix).

Fixes camlistore.org/issue/264

Change-Id: Ifac79728f6a105ba76a60997c55c5d7d818f6f71
2013-12-24 10:57:06 -08:00
Brad Fitzpatrick c9b0249c94 index: let reindexer optionally start at CAMLI_REINDEX_START
Change-Id: I3a3018c5ff72e0662bbe285eef299c7092366c5f
2013-12-23 22:02:30 -08:00
Brad Fitzpatrick eb3407e3e1 search: add format:foo operator
Change-Id: Ia12dcc43bba019f7d6511cec36e4091c692113fb
2013-12-23 21:07:10 -08:00
Brad Fitzpatrick 3a47595d7d Merge "pkg/blob: Introuduce a type that wraps a blob ref with the blob data." 2013-12-24 04:50:58 +00:00
Brad Fitzpatrick 04bed02906 search: add negative expressions and has:location
e.g. [is:image -has:location]

Change-Id: I03df0a1d5fea8394a33e3079d131224c116d4c0d
2013-12-23 20:39:06 -08:00
Brad Fitzpatrick 88c3709e29 corpus: ignore exiftag rows for now
Change-Id: I5ccbb8517c8576bc0f554db73f2abd4b827b8388
2013-12-23 20:38:35 -08:00
Brad Fitzpatrick 7238bd1652 search: GPS location search
Like loc:hawaii or loc:USA or loc:94128, etc.

Change-Id: I11f47bf464a812f0b62e7799752811144bb7454e
2013-12-23 19:11:55 -08:00
Brad Fitzpatrick d759e12b86 Add new geocode package.
Change-Id: Iae3c4b2cd09d7fd21e41fbc6f4fa5222d1dfcfee
2013-12-23 19:09:50 -08:00
Brad Fitzpatrick a11ff22b8e camlistored: add --reindex flag; make sqlkv a sorted.Wiper
Change-Id: I6b16c1c32187fb754d3acdbe852d02a506236078
2013-12-23 19:07:17 -08:00
Brad Fitzpatrick a7b3f4ee01 index: index all photo EXIF tags
Change-Id: I00b2eebfc75de38eed5c212ac6d52e0da07297bc
2013-12-23 16:21:19 -08:00
mpl 4a87b954fb Merge "pkg/index: move postgresql to sorted + some fixes" 2013-12-23 23:49:14 +00:00
mpl 8fec95752c pkg/index: move postgresql to sorted + some fixes
Change-Id: Ia6410256ffe8d4cbc2b9a5c056d075707105ab08
2013-12-24 00:37:14 +01:00
mpl 6e7eacea4a Merge "pkg/client: some cleanup, doc on the website" 2013-12-23 22:31:45 +00:00
mpl 1e8d46ee45 pkg/client: some cleanup, doc on the website
Changed some keys to be consistent with the server config, and removed
some others.

We're now using jsonconfig to get the keys and validate the config.

Removed some unused funcs/methods, moved some global vars as members of a client.

Also, having two possible defaults for the secret keyring
(.config/camlistore/identity-secring.gpg and .gnupg/secring.gpg)
was annoying and confusing imho, so I removed the latter.

http://camlistore.org/issue/259

Change-Id: Icf79fa8822b62b5d91843698861dd19cb553607a
2013-12-23 20:23:21 +01:00
Brian Gitonga Marete 97c52b7233 pkg/blob: Introuduce a type that wraps a blob ref with the blob data.
This new type (blob.Blob) will be used to implement a blob streaming
interface for the storage engines.

Change-Id: I05f3a68022368cf9c7b4a98cced3098ba3965799
2013-12-23 21:50:50 +03:00
mpl 003fe98598 Merge "sorted: more tests" 2013-12-23 14:36:52 +00:00
mpl e687136b36 sorted: more tests
Adding this particular case, because I suspect it demonstrates
a problem with postgresql.

Change-Id: Ia1ffe2f0a27dede579ed652b9f614cd69adc4418
2013-12-23 15:35:05 +01:00
Bill Thiede cdde1c8803 images/resize: remove commented-out code.
Accidentally snuck in as part of the giant CL
https://camlistore.org/r/1556

Change-Id: I379c613360c4f4c7ca9f3cc67a3b0a570308fa51
2013-12-22 21:22:41 -08:00
Brad Fitzpatrick 4a53f4d687 search: add width:[min]-[max] and height:[min]-[max] operators
Change-Id: I18a82d8f1d2ba519d78b234a240ff854f36a8c10
2013-12-22 19:26:49 -08:00
Brad Fitzpatrick 06a334c39f search: add is:portrait, is:landscape, and is:pano
Also support Width and Height constraints on raw search (not yet
exposed to the expression syntax, but will be like width:<640 or
height:100-200 probably)

Change-Id: I082e3d27b5ef5c238a8e65a6b836943d9f9ff8a6
2013-12-22 18:30:27 -08:00
Brad Fitzpatrick 82a356ab77 search: add FloatConstraint
Change-Id: Ic367e87cb239258a76a99c9d07f0956d67e242ea
2013-12-22 18:11:44 -08:00