Commit Graph

3116 Commits

Author SHA1 Message Date
Salman Aljammaz b0a8dee500 Add camtool to devcam.
Change-Id: Ife10222ca8f1ba08be923f9433781910376ddf05
2013-10-22 16:24:28 +01:00
Brad Fitzpatrick 5c3b57682e schema: integrate with the jsonsign package.
Signing schema blobs (permanodes and claims) was too hard before, and
the code was scattered in weird places.

The pkg/jsonsign code tries pretty hard to be Camlistore-neutral, so
it remains so.

The pkg/client code (which deals mostly with HTTP access to a remote
camlistore server) had the signing the logic in it before, mostly
because that's where we originally needed it (for camput), but that
should be fixed in subsequent changes, to remove most of its signing
logic and use pkg/schema's instead.

The schema package now depends on jsonsign, which I think is an
acceptable dependency edge, since the Camlistore schema does logically
depend no signed claims (and that was a gaping hole in its public
API), and it seems safe cyclic-wise, especially if jsonsign continues
to be a leaf package.

Change-Id: I10229ec5d880ddd801cb1ba77ac26b654693036d
2013-10-21 22:08:45 -07:00
Brad Fitzpatrick a7f555188b Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2013-10-21 20:39:18 -07:00
Brad Fitzpatrick d84df65cad jsonsign: add missing Close on public key blob reader
Change-Id: I1837fe65433e3a713939ae178e278f52884ab114
2013-10-21 20:39:08 -07:00
Brad Fitzpatrick 5251d47ebc Merge "script to generate contributors page from git shortlog." 2013-10-22 03:37:10 +00:00
Brad Fitzpatrick b30d19330c Merge "auth: don't fail IPv6 test if host can't resolve localhost to [::1]" 2013-10-21 20:31:09 +00:00
Salman Aljammaz 5ee71afca3 auth: don't fail IPv6 test if host can't resolve localhost to [::1]
Change-Id: I3eade17e593da67d33be86563fe179ac6464c561
2013-10-21 21:20:43 +01:00
Brad Fitzpatrick df8813e311 localdisk: fix TestPaths on Windows 2013-10-21 13:18:27 -07:00
Brad Fitzpatrick e31a8531fb auth: maybe fix IPv6 test on IPv6-less Linux
Change-Id: I438388420854014e862587960bc549fbcc8f3f2d
2013-10-21 10:16:01 -07:00
Brad Fitzpatrick ec96e7b4ed Merge "localhost auth: resolve localhost to [::1] if using ipv6" 2013-10-21 16:20:01 +00:00
Salman Aljammaz 10d67c6d20 localhost auth: resolve localhost to [::1] if using ipv6
http://camlistore.org/issue/238

Change-Id: Icab7d87fe651365fb44db4c2874d4976fa631ad6
2013-10-21 17:02:03 +01:00
Salman Aljammaz 40e09a1f6c script to generate contributors page from git shortlog.
http://camlistore.org/issue/15

Change-Id: I670e19424772530b190326ba125fdf1122ff29af
2013-10-21 11:38:50 +01:00
Brad Fitzpatrick 8695ac5ca4 importer: partial API sketch.
Change-Id: I05adf61164e4aabca35a1bb0ff1f0c8c0fd34ef1
2013-10-20 20:54:43 -07:00
Brad Fitzpatrick 4cc81262b4 schema: clarify that WriteFileFromReader's filename is optional
Change-Id: I0df3783b282492db1dac29ed3c07e9a38df30a5e
2013-10-20 12:24:32 -07:00
Brad Fitzpatrick 8a56f3744d importer: add accessors for Target and Search handler
Change-Id: I49cd2a1fc08547eada21cee1506f190fe8f6d6de
2013-10-20 12:24:20 -07:00
Brad Fitzpatrick c512e3d1be Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2013-10-20 12:00:22 -07:00
Brad Fitzpatrick 35e77c45ad importer: initialize Host's search handler and blobserver target
Change-Id: I482e6f192620c254648b19b3044eedbd44de288c
2013-10-20 12:00:15 -07:00
Brad Fitzpatrick 4e554d0716 Merge "First little bit of Flickr importer." 2013-10-20 18:21:15 +00:00
Aaron Boodman e4f25a2444 First little bit of Flickr importer.
Change-Id: Ia42b07a81b01904f5722d06653c4bf9de2e81c64
2013-10-20 11:18:53 -07:00
Brad Fitzpatrick 3f9887011f third_party/lldb: cherry-pick fix from 44f1cc3f1e
Update camlistore.org/issue/233

Change-Id: I4bd342a295aa6b8943ad7ff664007dad9ab6b904
2013-10-20 10:41:27 -07:00
Brad Fitzpatrick e84d5865cf importer: rudimentary manual start/stop of importers
Change-Id: I753f3d6e4a241c803f79446889169c4a25f1bdf3
2013-10-19 16:59:46 -07:00
Brad Fitzpatrick cf116c6da9 importer: work on infrastructure for third-party import from other sites
Change-Id: Ib4e5e4d543a1b2a913b99fa0a4d92f1a5b94c5dc
2013-10-19 15:48:05 -07:00
Brad Fitzpatrick a78704c979 search: add AnyCamliType constraint
Change-Id: Ib129d4d365d040e0b12b2e3aa35c38a59ed7bc04
2013-10-18 19:10:59 -07:00
Brad Fitzpatrick ea079282d6 search: tests for logical operators
Change-Id: I3d389c3b58206fd98140834162aec17218bbce14
2013-10-18 18:50:19 -07:00
Brad Fitzpatrick f515ec9861 search: add test for blob prefix queries
Change-Id: If53acf332f8eb72d82735d8707a77a21694e83ba
2013-10-18 18:28:05 -07:00
Brad Fitzpatrick b9d4b7dc09 search: search on blob size
Change-Id: Id87fb65ebe0fec304637c6acb29ea27bd99d3bb1
2013-10-18 18:12:23 -07:00
Brad Fitzpatrick 7101fe1b64 search: search on CamliType
Change-Id: Ie4c0655da9407b49a67cd6d11240b697bd9bd6f0
2013-10-18 17:56:56 -07:00
Brad Fitzpatrick 9625970095 Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2013-10-18 17:17:39 -07:00
Brad Fitzpatrick 17ecf8df07 search: start of general Query support. very rough draft.
Start of something that builds and 'works', but barely fleshed out at all.
Likely to change drastically yet.

Change-Id: I7fba25528a341ff2dbbc4dbb579f2450d7889320
2013-10-18 17:17:35 -07:00
mpl 74bb79e63b buildbot: broke into a master and a builder bot
This change is the first major step towards more improvements to the
buildbot. It cleans up various details, but most notably:
-it now uses a task as the basic data structure, to improve readability
and maintainability
-it breaks the bot into a master bot and a builder bot.
-it allows a master to receive reports from remote bots, and the
status page now aggregates all those reports.
-it allows a builder bot to send its reports to several master bots.
-the master bot uses whatever go version is installed to build the
builder bot, or the downloaded go tip if none is found.

The master bot is in charge of
1) monitoring the changes to the Camlistore and Go repos,
2) recompiling builder bot, which allows to add some new tests to the
test suite without having to interrupt the master bot.
3) starting a builder bot instance
4) waiting for the builder bot report and/or polling the builder bot
for its progress
5) answering the requests to display the various status pages.

http://camlistore.org/issue/185

Change-Id: I46a0b8fabbebf76b0c3ed04fd2ee73362d565cf7
2013-10-18 19:32:24 +02:00
Brad Fitzpatrick dfed62b76a Merge "use XDG_CACHE_HOME for cache if set" 2013-10-17 22:17:49 +00:00
Mathieu Lonjaret f465124e71 Merge "cammount: handle SIGINT, so that we unmount too in that case." 2013-10-17 15:00:55 +00:00
mpl 76b38c477c C+A: Add Salman Aljammaz
Change-Id: I7688971fba9ced477de1430bbb236b9cc7966954
2013-10-17 16:58:50 +02:00
Salman Aljammaz a607971f5f cammount: handle SIGINT, so that we unmount too in that case.
Change-Id: I5e82c6326aab892674c775e0615a91af71532d3c
2013-10-17 15:22:18 +01:00
Salman Aljammaz 408bed7d74 use XDG_CACHE_HOME for cache if set
Change-Id: Id06be1e98c7b550cbb92cedd21fd852c0e158857
2013-10-17 12:50:03 +01:00
Aaron Boodman 02665d5d3c Use pushstate() to give searches URLs and history entries.
Also, remove note about bref support from search instructions since
apparently that isn't supported yet.

Change-Id: I1ccbb8be44aa62ae7191aef913c7a226fd90a775
2013-10-16 23:54:26 -07:00
Mathieu Lonjaret 9f34f54675 Merge "Combine search and index page functionality." 2013-10-16 12:59:40 +00:00
Aaron Boodman 8418852996 Combine search and index page functionality.
Also:

* Changed favicon to a safe
* Clean up design of toolbar
* SVG support buggy in Chrome, replace SVG checkmark icons with PNG

Screen cap:
http://vault.aaronboodman.com/share/sha1-2dbb2b515fc84f2ef1395ee263cd41c1a6700de2?via=sha1-6eb9c7651ffa8e6f4f95e8fc6800a4672c4e179a&assemble=1

Change-Id: Ic5d2eb30ea1d72022a2b8804cae887319ac32a1b
2013-10-16 01:08:02 -07:00
Brad Fitzpatrick c83e7bb217 Merge "website: vars cleanup&renaming" 2013-10-15 22:15:04 +00:00
mpl a2407ec897 website: vars cleanup&renaming
Change-Id: Iaf3784e26d4a2fbe403f8fcafb482779c16dbe77
2013-10-15 23:54:34 +02:00
Mathieu Lonjaret 3695a98975 Merge "buildbot: use ringBuffer to store last 1MB of logs" 2013-10-15 14:28:55 +00:00
Bill Thiede 0712432e1f buildbot: use ringBuffer to store last 1MB of logs
Change-Id: I689ca82c64b9c7f89913551c5138a78718377c0d
2013-10-14 17:20:36 -07:00
Brad Fitzpatrick a58dcc1e5a diskpacked: re-use fds when possible when reading blobs from pack files.
We could actually do better than this and use the fd already open
from the still-appending file, or just keep one fd open per pack
file.

But this is a start.

Change-Id: I164a9bdf44987c3f057872cc7fdee1735f9e89a9
2013-10-10 20:06:30 -10:00
Brad Fitzpatrick 6e92302b1d Fix data races added in 161fc061d3
Change-Id: I7167472de3778fc76cc54dff6c864ed43b2052e9
2013-10-10 19:54:23 -10:00
Brad Fitzpatrick b169d80589 localdisk: update failing test's style.
doesn't fix test though.

Change-Id: I5fcca5abbc6b71cfde1a1816b8b8915ca122e644
2013-10-10 17:05:14 -10:00
Brad Fitzpatrick 72021e4516 Merge "runAsChild: s/Fatal/Fatalf/" 2013-10-10 20:21:19 +00:00
Brad Fitzpatrick 736f5d0d21 Merge "Add generation support for diskpacked." 2013-10-10 20:14:17 +00:00
Tamás Gulácsi 161fc061d3 use syncutil.Group and syncutil.Gate for paralellizing blobserver stats/removes
- where TODO exist.

Change-Id: If7340cf3bfcd5f5211f646404312c2fd15947bd9
2013-10-10 21:52:12 +02:00
Tamás Gulácsi a624b6d3b2 Add generation support for diskpacked.
Refactor the localdisk, diskpacked common code to pkg/blobserver/local
(only StorageGeneration, ResetStorageGeneration in this CL)

Change-Id: Ib04125805d5a1960bd29a474d3fc7ca985708d8d
2013-10-10 21:35:44 +02:00
Brad Fitzpatrick 34823a1655 Merge "add capctime flag to camput" 2013-10-10 01:13:14 +00:00