Rooba
/
perkeep
mirror of https://github.com/perkeep/perkeep.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,101 Commits 44 Branches 11 Tags 59 MiB
Commit Graph

5101 Commits

Author SHA1 Message Date
Brad Fitzpatrick 55f0c91c25 blobpacked: start of untested blob streaming code 
Will be used for recovery.

Change-Id: I8a6d219086a306e53b1b621b7bc7cf59b984c765
 2014-10-22 15:12:41 -07:00
Brad Fitzpatrick 919390aac8 httputil: rename conn to rw, per current conventions 
Change-Id: Ifc39915396f5ababdc2fb21c2a95156bbbf729c8
 2014-10-21 15:13:12 +02:00
Brad Fitzpatrick 8897cdc3f8 httputil: don't set Content-Type until we're sure 
Fixes Issue 182

Change-Id: I1a687c51b60caca5ddc7b4cd21d4f7efa6342248
 2014-10-21 15:11:51 +02:00
Brad Fitzpatrick 488f9721b4 make.go: block darwin/386 builds by default 
Fixes Issue 155

Change-Id: I91d471c7557c2225f5feb6b33cc6bb7cc381a68f
 2014-10-21 15:02:30 +02:00
Brad Fitzpatrick 3650dc45eb blobpacked: fix up doc comment 
Change-Id: I13bad6626b857c038cd10167dcdd04ac013d44b1
 2014-10-21 11:51:29 +02:00
Mathieu Lonjaret 3b47d2888e Merge "Pinboard importer: add test, fix bug" 2014-10-20 21:38:22 +00:00
mpl f0c2f2db43 camtool makestatic: create dir on top of static-set 
Change-Id: I6d71211450a195174ef8ac0ac5a66d44d6955927
 2014-10-20 23:07:39 +02:00
mpl 2fc1c5a81c schema: set a default UnixPermission in FileMode if needed 
Change-Id: I98fd229d0cbd69069a7c39a26e5c8b4444d13ed1
 2014-10-20 17:52:02 +02:00
Brad Fitzpatrick 3a43fd6430 camtool: add 'makestatic' subcommand 
It converts a permanode set (with a bunch of camliMember) into a static-set.
Mostly for sharing a snapshot. Will likely evolve over time.

Change-Id: I9906750223a27e9a491c91f1ce2490c15d1d3986
 2014-10-19 18:25:45 +02:00
Brad Fitzpatrick a16c015f32 pkg/client: make Describe use a POST request to the server 
Otherwise it can't send Describe Rules.

Also in this commit: a bunch of new tests from when I thought I was going crazy
and trying to debug the search system, before I realized the problem was that the
client was doing a GET request and dropping most of my DescribeRequest.

Change-Id: I4ea9bed80f0d7d6b86814527b63acc3586ac1d06
 2014-10-19 17:36:22 +02:00
Brad Fitzpatrick bfb325c96f pkg/test: fix after accidentally checking in WIP change in a82f603dbc 
Change-Id: Ide7488005bb750b009c40a57443d6bb0b62818c3
 2014-10-19 17:21:51 +02:00
Brad Fitzpatrick a93cb4d9b9 Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-10-19 16:44:19 +02:00
Brad Fitzpatrick a82f603dbc fastjpeg: add a seemingly-missing availability check 
Change-Id: I5ab44c1442790e4cceb3f6671f33c57d0c6a4035
 2014-10-19 16:44:14 +02:00
mpl 917a09ca6d Merge "blobserver/s3: implement SubFetcher" 2014-10-19 14:13:02 +00:00
mpl b24580d523 blobserver/s3: implement SubFetcher 
Change-Id: I42ac364e268463998598990a8bf0df7437f4d05d
 2014-10-19 16:11:54 +02:00
Brad Fitzpatrick 4d01c6b011 Merge "test/world: print more info when testing.Verbose()" 2014-10-19 14:11:31 +00:00
Brad Fitzpatrick 5b00309e17 Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-10-19 13:35:48 +02:00
Brad Fitzpatrick 1f75759371 s3: style fixes 
Change-Id: I0c8dacb00f57d374c3148fe5c8017a9f146d36f4
 2014-10-19 13:35:42 +02:00
Brad Fitzpatrick 404a342a33 Merge "genfileembed: Add flag for adding build tags" 2014-10-18 19:09:50 +00:00
mpl 53be9298a5 blobserver/s3: add optional in-memory Fetch cache 
Change-Id: I77e27555d28002ba01f1501e8a77eb4adbf701fe
 2014-10-18 19:34:25 +02:00
Brad Fitzpatrick c0a8aafbe0 Merge "blobserver/s3: use flags instead of conf file in test" 2014-10-18 17:09:04 +00:00
mpl 0967669af0 blobserver/s3: use flags instead of conf file in test 
Change-Id: I98c4f9ad6204ec8c534aae3abffaf3410555f86d
 2014-10-18 19:03:15 +02:00
Gina White f9a2388cec Pinboard importer: add test, fix bug 
Add test that imports three posts.  Fix bug the test uncovered.  We need
to make a copy of the post in the importBatch loop before handing it off
to asynchronous importPost call.

Change-Id: Id8dea72b03dd3666dde97e977c921a8955e67392
 2014-10-18 08:20:45 -07:00
Fabian Wickborn 853db6cec8 genfileembed: Add flag for adding build tags 
The build tags are written into the resulting go files literally, e.g.
a call like

    genfileembed -build-tags "linux,386 darwin,!cgo"

is written as

// +build linux,386 darwin,!cgo

to the resulting files.

Change-Id: Ic8c7e827e3040a33fe3b920c1aaa1551f902a491
 2014-10-17 20:58:15 +02:00
Fabian Wickborn 119b38966a genfileembed: command line flag for pattern file 
Offer a choice from which go-file the #fileembed pattern is read. The
default is still "fileembed.go".

Change-Id: Ida98850162adec33a6555b09ad320bd9ee573b8d
 2014-10-17 13:11:23 +02:00
Brad Fitzpatrick 06880fee9d Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-10-17 07:10:24 +02:00
mpl 55146dfe3e Merge "website: server doc and release note about levelDB for indexer" 2014-10-16 15:12:02 +00:00
mpl 9c42d7b562 website: server doc and release note about levelDB for indexer 
Change-Id: Ibf7528cba07ab1843845d91e7b4e1234f1ed1d8a
 2014-10-16 17:08:49 +02:00
Brad Fitzpatrick 4f9c8aea72 blobserver/blobpacked, storagetest: fix context goroutine leak 
Change-Id: I09abd7ef203fe267219a52a57f8627ce7e28d80d
 2014-10-15 12:28:49 +02:00
Brad Fitzpatrick e0edcdeba3 blobserver/s3: remove stray file 
Change-Id: I443e193989139dbb26796488c8cb369d20408508
 2014-10-15 12:28:21 +02:00
Brad Fitzpatrick e65fb3a3e9 blobpacked: remove the vestigial ' l ' from the meta rows 
Change-Id: I181fb3f64c16538005b6aca750f144ffe13c624b
 2014-10-15 12:05:19 +02:00
Brad Fitzpatrick 86720c23dc blobpacked: don't pack if identical wholeref already exists packed 
Change-Id: I95f391f7e0373e6ff29cb95343f5cdfee11d878b
 2014-10-13 18:55:39 +02:00
Brad Fitzpatrick 2d23c162cc Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-10-13 12:48:57 +02:00
Brad Fitzpatrick c0bf5778c9 blobpacked: add storage.Logf method; log to T in tests 
Also address the unnecessary goroutine TODO.

Change-Id: I3a59f6338df4bc0a444e0281bc662676ee9dc00c
 2014-10-13 12:48:38 +02:00
Brad Fitzpatrick 04726cfad1 test: add NewLogger func 
Change-Id: I38cee8fd2e2670088acc1332430aca9725cef13f
 2014-10-13 12:47:36 +02:00
Mario Russo a8c7b8d7fb ui: tags control 
Removing DEBUG_TAGS flag so that tags control is available by default.
Request per Aaron (https://camlistore-review.googlesource.com/#/c/3806/)

Change-Id: If1ad842a563d1992fb8ca203c67502825d2eb64c
 2014-10-12 15:32:48 +02:00
Brad Fitzpatrick 749ba38b18 blobpacked: write one of the two wholeMetaPrefix row types, more tests 
The identical file test, verifying we don't denormalize two identical files, is currently
skipped and known broken. A new flag is added to test it.

Change-Id: I0408103671a28209307aabb1aa2e40d5e49c56cc
 2014-10-12 12:17:06 +02:00
Brad Fitzpatrick dc6af2ed12 blobpacked: delete from small, doc fixes, more tests 
Change-Id: Iaef35b60968b2025e838fcf4347cd24b68398be6
 2014-10-12 10:44:38 +02:00
Brad Fitzpatrick c9aa1137ad blobpacked: tests for files spanning multiple zip files 
Change-Id: I15c0a70c4776068ee2521b3036debad005e62778
 2014-10-12 10:14:28 +02:00
Brad Fitzpatrick ca785046bc Merge "serverinit: syndtr/leveldb support" 2014-10-11 14:07:01 +00:00
Brad Fitzpatrick 0f97897f81 blobserver/google/cloudstorage: make it a SubFetcher 
For blobpacked.

Change-Id: Ibca3d8a6976d8e1d4058e8d7fcdca6b63f8d8b87
 2014-10-11 16:02:31 +02:00
mpl 9b68fd9f32 serverinit: syndtr/leveldb support 
Change-Id: Id48a00f3896c38659a53cf131493d5a19dbfe4b7
 2014-10-11 15:40:29 +02:00
Brad Fitzpatrick 07ff2e8ca4 blobpacked: update RemoveBlobs TODO with a plan 
Change-Id: Ic89c390c15adba96333d3d20795b8bcc204e20f8
 2014-10-11 15:00:08 +02:00
Brad Fitzpatrick af4a15b3b8 blobpacked: don't declare ourselves as a BlobStreamer yet 
Change-Id: Ie030e640a614a4dfa8b3afb3b30498eba2e3293d
 2014-10-11 14:42:32 +02:00
Brad Fitzpatrick 0ae983b8b6 blobpacked: temporarily rename StreamBlobs away so it doesn't implement BlobStreamer 
Change-Id: I7906cb60b85d553fcb6632305164acabbc37e72d
 2014-10-11 14:17:47 +02:00
Brad Fitzpatrick faa5b4984b Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-10-11 14:15:46 +02:00
Salmān Aljammāz 0d6e0c6425 index: avoid shadowing err when retrying to index a full file 
Change-Id: Ie683739039116dfb2758c6647382afebaa6e1ece
 2014-10-08 18:40:00 +01:00
mpl f15c5a7cd2 index/receive: address last comments from http://camlistore.org/r/3271 
Change-Id: Id41278e5e01b9ea9310b392859709a3261dc3f52
 2014-10-07 17:21:14 +02:00
Salmān Aljammāz e14c122c52 indexer: images: try a FileReader if the prefix is too small for DecodeConfig 
Go's image.DecodeConfig needs more than 1MiB on some images (e.g. some
Lens Blur pics taken with Google Camera). Now we first try a 512KiB header
and retry with a full FileReader if that fails.

https://camlistore.org/bugs/477

Change-Id: I286d15d86a69951737d94dd3692d4e9e1992b324
 2014-10-07 12:13:33 +00:00
mpl 6df14e291e make.go: tags list should be space-separated 
Change-Id: I8c50a2cc0fb293644467813b53606ed09faf6fc9
 2014-10-03 19:32:18 +02:00