Commit Graph

6236 Commits

Author SHA1 Message Date
mpl 002eb40bfb pkg/search: fix float VS int bug in BenchmarkLocationPredicate
Change-Id: I2e4457d3b32f1e5b1c5adf63c1b5068fac603cc3
2016-11-09 17:24:34 +01:00
Mathieu Lonjaret 4b9d997421 Merge "pkg/search: add EXIF files to BenchmarkLocationPredicate" 2016-11-09 16:09:14 +00:00
Mathieu Lonjaret e407397a16 Merge "pkg/search: add cached geocode results used in benchmarks" 2016-11-09 16:07:46 +00:00
Attila Tajti 7467d5de55 pkg/search: add EXIF files to BenchmarkLocationPredicate
Change-Id: I904d69b97ab89643071116bd5bfc7c880534c984
2016-11-09 08:04:05 +01:00
Attila Tajti 6476233ad1 pkg/search: add cached geocode results used in benchmarks
Cache geocode results used in BenchmarkLocationPredicate
so we don't hit the (random?) google geocode API errors.

Change-Id: Ic5be5afc36fd8330d0ae0be4677f0faca87d1b21
2016-11-09 08:01:15 +01:00
Brad Fitzpatrick e73c7879fc Merge "pkg/index: read blob before acquiring index mutex" 2016-11-08 17:36:57 +00:00
Brad Fitzpatrick 7f70305624 Merge "pkg/index: clean up BlobSniffer a bit" 2016-11-08 16:48:51 +00:00
Brad Fitzpatrick db50bae0c4 pkg/index: read blob before acquiring index mutex
For #878

Change-Id: I8abaf5d923fc6dee7e8a9a3e84f82d4cf7484329
2016-11-08 08:47:59 -08:00
Brad Fitzpatrick fe09b0a28b pkg/index: clean up BlobSniffer a bit
Change-Id: I584754c452dbf827969f27ae98eb4d0913e2ce01
2016-11-08 08:47:43 -08:00
Mathieu Lonjaret 6b7e32d927 Merge "pkg/search: benchmark location queries" 2016-11-08 15:48:22 +00:00
mpl ede16112a0 pkg/search: benchmark location queries
Additional benchmark to help evaluate the impact of
https://camlistore-review.googlesource.com/8049
(+ https://camlistore-review.googlesource.com/8649)
on location queries.

Change-Id: I8c849ca945b9ef8318800de15fb2374fa1110440
2016-11-08 16:42:23 +01:00
mpl 3c569d3edc doc/server-config: fix genconfig typo
Change-Id: I8b3494f0705ae1726e967c6b61b2ef3a8d9502fb
2016-11-04 00:36:00 +01:00
mpl 6c1ae1d865 pkg/index/corpus: more valuesAtSigner doc
Change-Id: I750caa46ebe6534a28e5567251688c06d3935c13
2016-11-03 16:47:56 +01:00
Mathieu Lonjaret 4081409698 Merge "server/camnetdns: reply with NXDOMAIN when needed" 2016-10-31 17:21:38 +00:00
mpl 89f50dcf69 misc/monthly.go: improve download boxes style
Issue #858

Change-Id: I65aa6b0d2c60d7ed273679d30f148566750badbe
2016-10-31 16:53:51 +01:00
Mathieu Lonjaret 7b09c22864 Merge "misc/monthly.go: generate raw release notes" 2016-10-28 23:05:01 +00:00
mpl dd727e0a73 misc/monthly.go: generate raw release notes
Issue #858

Change-Id: Ic94f796c3bbb7528d70af6ae60a7d93a3247eeba
2016-10-27 16:10:46 +02:00
Mathieu Lonjaret 017740d9bd Merge "misc/monthly.go: generate commit statistics" 2016-10-26 23:34:01 +00:00
mpl 64e5765804 misc/monthly.go: generate commit statistics
Issue #858

Change-Id: Id82266bda35147d8e456addc3809acce624633ca
2016-10-27 01:20:55 +02:00
Mathieu Lonjaret 45f47052cf Merge "misc/monthly.go: use release date in files names" 2016-10-26 22:13:33 +00:00
Mathieu Lonjaret 1a7452561a Merge "index: improve Corpus attr lookup with signer filter" 2016-10-26 20:50:12 +00:00
Mathieu Lonjaret 32359276ff Merge "serverinit: add b2 and encrypt secrets to redaction list" 2016-10-26 20:07:29 +00:00
mpl d16bc84df7 travis CI: remove go tip
Because gopherjs only supports Go 1.7

Or at least our vendored version does. I'll test later with a more
recent gopherjs version.

Change-Id: I6f30c18136dd9bb25adca899aa49ebe31071187a
2016-10-24 19:10:02 +02:00
mpl 167bed4277 pkg/index: util_test.go not an index impl
Change-Id: Iccc1bb43d703ec8a05f30bdd3132058fbdff2f1f
2016-10-24 18:12:13 +02:00
mpl 096493bc13 pkg/index: skip reindexing tests on Travis CI
We've had issue #756 making reindexing tests fail for so long now, that
having Travis CI monitor builds has become useless, since we don't
expect any other result than a fail.

This CL skips the Reindexing tests when on Travis, so that it becomes
useful again in helping us catching regressions.

Change-Id: I7b837f62a4e2d7471a08155346150130af74f48f
2016-10-24 17:26:42 +02:00
Filippo Valsorda e4b5e99e3f serverinit: add b2 and encrypt secrets to redaction list
Change-Id: Ie8d6011979128a60f2c151726fbef2c352caf1e0
2016-10-24 13:19:32 +01:00
Filippo Valsorda e8b9df32af blobserver/b2: add new Storage based on Backblaze B2
github.com/FiloSottile/b2: c32038dd691290351948e8fbe956b0ade65e70ea

Change-Id: I0fb5ed3a622ed541170a9fb946b6781defef96fe
2016-10-23 18:04:48 +01:00
mpl 0ab95c3f13 server/camnetdns: reply with NXDOMAIN when needed
When we get a query for a name we are authoritative about, we should
reply with NXDOMAIN when this name does not exist.

This change moves the name lookup to as early as possible to make sure
of that. This means we're now doing lookups even for cases where we
technically wouldn't have needed them, so maybe a substantial increase
in load? We'll see.

Change-Id: I5e9946dd67757856f626f484b547197c6246cccd
2016-10-21 19:14:35 +02:00
Mathieu Lonjaret 46ea7699a8 Merge "server/camnetdns: implement more of the DNS protocol" 2016-10-20 22:26:47 +00:00
mpl 0273e6c5f5 server/camnetdns: implement more of the DNS protocol
As Let's Encrypt DNS server (Unbound) is pretty strict, it
wouldn't resolve names camlistore.net until we implemented more of the
DNS protocol and fix various things.

Since I had no way at first to know what exactly it didn't like, I
started by fixing all errors and warnings reported at:
http://dnsviz.net/d/camlistore.net/dnssec/

Therefore, this CL adds:
-TCP support
-NS response
-SOA response
-MX (empty) response
-DNSKEY (empty) response
-TXT (empty) response
-explicit non-support of EDNS

Then I found out we also needed this:

-https://tools.ietf.org/html/draft-vixie-dnsext-dns0x20-00
-CAA response. A proper response is optional here, as Let's Encrypt only
enforces the response if it finds one. But we do have to reply.

Fixes #867

Change-Id: Ib45f8a642cd83cf19c8ab36435644a2c645a70e7
2016-10-20 17:53:11 +02:00
Mathieu Lonjaret 726843fbc9 Merge "android: avoid excessive UI updates" 2016-10-18 13:17:40 +00:00
Tilman Dilo bf4ebe0fe3 android: avoid excessive UI updates
On some devices, updating notifications and status text at a high rate
causes whole-system UI lag and even complete system freezes. On a
Nexus 5, the uploader is completely unusable and requires a hard phone
restart almost every time "upload all" is triggered from the UI. The
device freezes happen across multiple stock Android releases.

This commit reduces the update rate of the UI significantly by updating
the notification only when the integer percent value of the upload
progress changes. It also reduces the update rate of the status text to
around 30 fps, which should still be plenty. With both of the changes,
the uploader behaves as expected. Either change alone is not enough to
get rid of the device freezes.

Change-Id: I2c170772d29c4670c8c10d09cdaea96207fc9e61
2016-10-15 23:15:29 +02:00
mpl 6a5f91a6f2 website: launcher: show when in WIP mode
Change-Id: Ie2d743236316ca7974268e38639ebd86b11b3fa2
2016-10-15 02:08:09 +02:00
Mathieu Lonjaret b274dc6fc3 Merge "website/camweb: do not send mail when no smtp" 2016-10-14 13:17:30 +00:00
Mathieu Lonjaret fe05d113c1 Merge changes I53052992,Ief8e0ad3
* changes:
  server/camnetdns: make it work
  make.go: optionally build camnetdns
2016-10-14 13:15:18 +00:00
mpl 5db007dc74 website: make sure autocert is given a host name
Change-Id: I306e69a0833c345f86ebc5412a914aa0991a68d9
2016-10-14 02:04:53 +02:00
mpl 55d309838c vendor: add golang.org/x/crypto/acme
Something went wrong with 9bba338a79
where it should have been added.

Change-Id: Icbf83c1ea907811136a6cf59314a1940172f46d7
2016-10-14 01:26:01 +02:00
mpl 9bba338a79 website: use golang.org/x/crypto/acme for Lets Encrypt
vendor: add golang.org/x/crypto/acme/{autocert}
at 8e06e8ddd9629eb88639aba897641bff8031f1d3

remove rsc.io/letsencrypt and its deps.

Issue #859

Change-Id: I292543e88476bd4658846496f96a2a07bb25a186
2016-10-14 01:17:21 +02:00
Mathieu Lonjaret e49b3679b9 Merge "website: update google cloud dependencies" 2016-10-13 21:55:50 +00:00
mpl 3a5c0efcf4 pkg/fs: check mountedness with /proc/mounts
Fixes #829

Change-Id: I40065ce97c97d11c4a53c36561bc98b1e7573bff
2016-10-13 18:07:07 +02:00
Tilman Dilo 95a0d4bc21 android: add Cardboard Camera directory
Automatically upload panoramas created with the Cardboard Camera app.

Change-Id: I1a32ac9a947c3b5f7fec479139ff8ee85368a8b7
2016-10-12 23:33:09 +02:00
Mathieu Lonjaret c2e80f8d47 Merge "doc: fix typo" 2016-10-11 14:35:14 +00:00
kortschak cb46e8de3b doc: fix typo
Change-Id: I50f3a4e4a89a26b769be69a0924d0e37efe53c87
2016-10-10 15:09:27 +10:30
kortschak 0fa0dfb4ef cmd/camput: update for absence of skipDirs
Change-Id: Ide6b0074a40ae738d0b60bd152fc1be0a04bb876
2016-10-10 14:57:55 +10:30
Attila Tajti 0f55bfe980 index: improve Corpus attr lookup with signer filter
Keep attributes for each signer in PermanodeMeta
to make Corpus methods AppendPermanodeAttrValues,
PermanodeAttrValue perform well even with a signerFilter.

Also add index/util_test.go to the notAnIndexer slice
of index/index_test.go.

Fixes #861

Change-Id: Ic25470b7d42e40a6f9d0ed0bf868ef3755413289
2016-10-06 18:01:28 +02:00
mpl 39a33c7fa9 server/camnetdns: make it work
Before that change, one would only get a response to a DNS query, if
directly sending the query to the dns server.

I think the main problem was that one has to copy the question section
of the query in the response message, which is part of what SetReply
does.

With this change, I seem to get responses (for e.g. www.camlistore.net
and 6401800c.camlistore.net), without having to specify a server to
query to dig (or nslookup), so by letting the resolver and the DNS
hierarchy follow its normal course.

Issue #722

Change-Id: I530529920fdaa3e5fb025c7684b563e3f05772ac
2016-10-06 16:26:18 +02:00
mpl 2c4332ada2 make.go: optionally build camnetdns
server/camnetdns: update to cloud.google.com/go imports.

vendor: add github.com/miekg/dns at rev
3f1f7c8ec9ead89493df11f2c3d8bec353a2c2c0 as a dep of server/camnetdns

Change-Id: Ief8e0ad3e09a6c3511c72a7991309808f855d3df
2016-10-04 01:58:50 +02:00
mpl 6297d0d570 website: update google cloud dependencies
This change follows the changes at
ab06dbd80d

google.golang.org/genproto/googleapis/datastore updated to
44808ed2d86e258615bb701d395cbbfe6686a3e6

As a consequence:
google.golang.org/genproto/protobuf added at
44808ed2d86e258615bb701d395cbbfe6686a3e6
google.golang.org/genproto/googleapis/api/{label, metric, monitoredres,
serviceconfig} added/updated to 44808ed2d86e258615bb701d395cbbfe6686a3e6
github.com/golang/protobuf/ptypes{any, struct, timestamp, wrappers}
added/updated to 1f49d83d9aa00e6ce4fc8258c71cc7786aec968a

Test locally, and in "pseudo-production", i.e. with -cloudlaunch but with
a different projectID (hence with some of the hard-coded stuff changed).

Change-Id: Iad0caa78b19619bf153bf05870e6cb3a2ab669dd
2016-09-30 18:08:44 +02:00
mpl bccd1c5ed7 website/camweb: do not send mail when no smtp
Fixes #860

Change-Id: Ic16ec744ba58a929b71cc5f142807a659b47466e
2016-09-30 16:47:59 +02:00
mpl 669fe90534 misc/monthly.go: use release date in files names
Issue #858

Change-Id: Idac0f556ff13a40ca8eb656706c8a7050081be95
2016-09-28 01:31:00 +02:00