Commit Graph

388 Commits

Author SHA1 Message Date
Attila Tajti f0343c0fae camtool sync: local path support on Windows
Change-Id: I2d3e0c0bbd3f3ae50165d366e6a1093fceb36e5c
2016-01-11 12:00:37 +01:00
Brad Fitzpatrick 66f0ddac0e pkg/client: fix directory upload deadlock, clean up HTTP handling
Unexports pkg/client.Client.TransportForConfig in the process.

Fixes camlistore/camlistore#662

Change-Id: Ifc2d6b0fee70d5db86654897d2d377b343b6d38b
2015-12-29 23:39:29 -08:00
Brad Fitzpatrick 4086789731 pkg/httputil: also track protocol versions of HTTP response in StatsTransport 2015-12-29 13:36:50 -08:00
Brad Fitzpatrick fba8b457de pkg/client: wire up http2 support, unexported Client.InsecureTLS
Also add a flag to camtool discovery:

$ camtool discovery -httpversion
HTTP/2.0

Fixes camlistore/camlistore#661

Change-Id: I6db392e01bd176a2757ebdb4a0e881eebaec9b03
2015-12-29 11:33:38 -08:00
Brad Fitzpatrick 5a2fe47b73 cmd/camdeploy: fix build, embed a client ID/secret, accept region or zone
Much easier to use now.
2015-12-28 15:15:11 -08:00
Mathieu Lonjaret 09a6ca6ef5 Merge "vendor: move pkg/images dependencies from third_party" 2015-12-18 21:17:12 +00:00
mpl 6af01f6c71 vendor: move pkg/images dependencies from third_party
This change is in anticipation of moving pkg/images to go4.org, where it
should not depend on packages in third_party.

So:
third_party/github.com/nf/cr2 -> vendor/github.com/nf/cr2
third_party/github.com/rwcarlsen/goexif -> vendor/github.com/rwcarlsen/goexif
third_party/golang.org/x/image/tiff -> vendor/golang.org/x/image/tiff

Note that third_party/go/pkg/image/jpeg was also a dependency of
pkg/images. We had vendored image/jpeg from tip at the time because it
offered advantages over the version from Go1.3
(https://github.com/camlistore/camlistore/issues/463).
Since we now depend on Go1.5, we can go back to depend on the stdlib
version, so we simply remove third_party/go/pkg/image/jpeg and adjust
the imports accordingly.

Change-Id: Ifc8ffae0551102e644a0a0c67f3ff89e04df15c7
2015-12-18 22:15:33 +01:00
mpl 96d06ac2bd camget: fix flag conflicts
The conflict was introduced in cea5e332ce
by linking pkg/cmdmain in, which introduced its public flags.

Change-Id: I6374c2fb1657f6fd534c1342a5947ef6db16a3e2
2015-12-18 17:08:03 +01:00
mpl cea5e332ce vendor: go4.org/legal
At rev c3c16077b235db4c6b2a2a6121c2d429707f4ed4

And use it in new package pkg/camlegal

And remove pkg/legal

Change-Id: I5e398aa5f145a02a04d33719276fd2f8b82ab12b
2015-12-16 18:50:49 +01:00
Tamás Gulácsi 9f7e1df32b Remove pkg/context
Use golang.org/x/net/context instead.

Fixes #648.

Change-Id: I676a2f25458be97610a49d6f954f2102cbd373fa
2015-12-12 23:09:02 +01:00
mpl 1ffd5895e0 camtool/googinit: use cloud/storage Client instead of googlestorage
Issue #652

Change-Id: I54b2041acfa8f998e1fb082c54f6c7069615d8a7
2015-12-08 00:11:42 +01:00
mpl 40be4d8da2 vendor: go4.org/jsonconfig (and errorutil)
Previously pkg/jsonconfig and pkg/errorutil

Copied from go4.org at rev d1b8a2fb2de6160036e4801aa5e4d855571078b8

Change-Id: I673ed55b0825baa2607289b6082f205100261d7a
2015-12-01 17:21:49 +01:00
mpl 3dbaa49395 vendor: go4.org/oauthutil
Previously pkg/oauthutil

Imported from go4.org at rev
3970dd22c0e7e2397304ad626a20b72f8db41b58

Change-Id: Iffb751d03af9bc0c3008e5cd3833ed42fba0bdb1
2015-11-27 00:31:40 +01:00
mpl 12eddf9c19 vendor: go4.org/strutil go4.org/syncutil
They were internal packages (under pkg), which we are now moving to
go4.org, so we in turn need to vendor them in now.

Change-Id: I92224f731404d0bd4ca1c57492bed37cb3367ed4
2015-11-21 00:21:20 +01:00
mpl 6dfe405666 camput init: get client config from server help handler
This is particularly useful for getting clients fully configured for a
server on the same host.

Context:
https://github.com/scaleway-community/scaleway-camlistore/issues/2

Change-Id: I667dd32a80cba4e1e6f6a4ca86a0497a72047d30
2015-09-28 16:44:38 +02:00
Brad Fitzpatrick 6f58fc2426 Fix build, move more stuff from third_party to vendor. 2015-08-18 10:19:49 +02:00
Tamás Gulácsi 533433f163 cmd/camtool reindex-diskpacked: don't panic on high-level conf
If no metaIndex is specified, just go on, but don't panic.
Also try to clear the logic a little bit (don't overwrite indexConf).

Change-Id: I43e61ac3d5cd239cc113cb034ff3dd61eaaa14fd
2015-07-23 07:16:14 +02:00
Brad Fitzpatrick d6cb8d1c21 cmd/camput: fix typo in help description
Change-Id: Idfc07aff1a2b95009b1d42d962e08a96952f8977
2015-05-17 15:28:40 -07:00
mpl 750cc42bfe Merge "camput: add -contents_only flag" 2015-04-21 14:20:14 +00:00
mpl 5147aff319 google blobservers: migrate to golang.org/x/oauth2
Previous oauth2 (code.google.com/p/goauth2/oauth) still used in:
third_party/github.com/tgulacsi/picago
pkg/importer/picasa
pkg/importer/foursquare

Final cleanup in a subsequent CL.

Change-Id: I805d81fcaa651e03a17823c78abe5040d51346c3
2015-04-20 23:17:28 +02:00
mpl 8fc17c4d75 camput: add -contents_only flag
Allows to upload only the contents of a file, without any of its
attributes, i.e. the file JSON schema on top only has its camlitype,
and the file's parts, set.

Issue #42

Change-Id: I1d0ab8d7cff0f0350439553a37b618b941067c93
2015-04-08 18:21:56 +02:00
mpl da4b48926c camput file: move chanworker code to an internal chanworker pkg
First one of a series to refactor files.go

Change-Id: I4ec775674bca07c641d88f8392b2a03bb4c6fa7b
2015-03-30 17:51:18 +02:00
mpl f32e05bfb7 camdeploy: sync with pkg/deploy/gce.Deployer changes
Change-Id: I4d9ed8b46e3b278d8a249fed452d2cac3bd7ee5d
2015-02-04 23:24:26 +01:00
Brad Fitzpatrick e255841ca8 camtool: fix packblobs usage
I removed the --start option.

Change-Id: I66a2bfaf380131dc589fd67e721091d0ba59e8b6
2015-01-19 15:09:07 -08:00
Brad Fitzpatrick 7f954485be camtool: add 'packblobs' command
Update #532

Change-Id: I2012b750b482da878f5b9ced9e7cea5a2124bec8
2015-01-19 15:06:04 -08:00
Brad Fitzpatrick a99dc14885 cmd/camtool: add flag to send a raw SearchQuery; permits sending a sort field
Part of upcoming blobpacked migration tool.

Change-Id: If0e91aa90aab78936976e8b0d6b3bfe2e5a4c27a
2015-01-17 20:29:05 -08:00
mpl 22f45f14a5 Add new oauth2, use it in deploy/gce
third_party/golang.org/x/net/context at 67f25490433376b5f7da086c0b9283fcdeca3a7b
third_party/golang.org/x/oauth2 at 5361962df4497a7fc777f5c3bd1b5c7ac36c604c

I only updated camdeploy, and did not remove code.google.com/p/goauth2
yet, because I do not want to get distracted by potential breakages, so
we can first get the gce deploy wizard in.

Change-Id: Ifa7987a044c741d3f00f49f47b31e3e07bdf973d
2015-01-09 22:02:39 +01:00
Brad Fitzpatrick 72e5063d53 Merge "cammount: report errors from mount process" 2014-12-28 20:01:48 +00:00
Eric Drechsel fd66007592 cammount: report errors from mount process
Change-Id: I0d3ba508a5df48caac2c25c3b92517b5f3228251
2014-12-26 16:52:24 -08:00
Salmān Aljammāz 04bba70cc1 camput: s/name/title in usage string
fixes #544

Change-Id: Ie39e1fb1e26b80853f9d02d15187f221bf5dbaa6
2014-12-25 19:20:21 +00:00
Bill Thiede ba447185d4 third_party: Update bazil.org/fuse and set VolumeName.
import bazil.org/fuse at 1c23ef5845002b8878f67e7959b29d1e0ea41fe3

On Mac OS X, fuse.VolumeName keeps the directory name in Finder from
becoming 'OSXFUSE Volume #0 (mount_osxfusefs)', it is a nop on all
other platforms.

Change-Id: Ic9e248ea1921f6dfb6b04107a5f0ae8c51687c82
2014-11-29 19:06:54 -08:00
mpl f15ec3fe92 Merge "pkg/deploy/gce: lib + tool to deploy on Google Cloud" 2014-11-27 15:44:32 +00:00
mpl 99fe925efc pkg/deploy/gce: lib + tool to deploy on Google Cloud
http://camlistore.org/issue/531

Change-Id: I69ffe0544341d380bb844aef1dcca8a1ae441ea7
2014-11-26 22:50:27 +01:00
mpl 21a61dad40 Merge "index,camtool: try and cope better with broken exif" 2014-11-18 15:24:20 +00:00
mpl d7e5128bbe Merge "camget: actually check size of file on server" 2014-11-10 18:18:05 +00:00
mpl fda1399e9c index,camtool: try and cope better with broken exif
http://camlistore.org/issue/493

Change-Id: I40aebd67252cf82a3a5a143af6c258d7ed2aecda
2014-11-10 19:05:35 +01:00
Brad Fitzpatrick 3374899d40 Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-11-08 18:17:20 -03:00
Brad Fitzpatrick dedfeaff29 strutil: add IsPlausibleJSON
Use it in camtool search, and for https://camlistore-review.googlesource.com/#/c/2888/

Change-Id: Ibae0b4aa346cc8c18ff6a4b4eef994cfddd42dda
2014-11-08 18:16:47 -03:00
mpl 43e0b72ec4 camget: actually check size of file on server
Also fix the other bug that was making the first bug only visible when
verbose :-)

http://camlistore.org/issue/526

Change-Id: Ia33bdc73a0eab4995f79abd7e9a37f08d3391f06
2014-11-03 23:00:54 +01:00
mpl 250664d8eb camput: use Errorf to print critical errors even when non-verbose
http://camlistore.org/issue/524

Change-Id: Ied24471288ea459785291281afa7316a257b6884
2014-11-03 22:15:36 +01:00
mpl f0c2f2db43 camtool makestatic: create dir on top of static-set
Change-Id: I6d71211450a195174ef8ac0ac5a66d44d6955927
2014-10-20 23:07:39 +02:00
Brad Fitzpatrick 3a43fd6430 camtool: add 'makestatic' subcommand
It converts a permanode set (with a bunch of camliMember) into a static-set.
Mostly for sharing a snapshot. Will likely evolve over time.

Change-Id: I9906750223a27e9a491c91f1ce2490c15d1d3986
2014-10-19 18:25:45 +02:00
Tamás Gulácsi bea59b29fa Remove kvfile-specific code from diskpacked.
In hope to use leveldb.

Change-Id: Ie9c166d48d6a2c1f52f9cfa29e703d8b8ad7f162
2014-09-23 22:40:07 +02:00
Brad Fitzpatrick 8f2bdd3a82 Few little fixes to 51ef6152f
Change-Id: Id319d1fa4ad725f1ce9178fd0fbd7f787880a6fa
2014-09-06 19:19:36 -07:00
Aaron Boodman 51ef6152fd Add -search argument to camput share.
Bug: https://code.google.com/p/camlistore/issues/detail?id=512

Change-Id: Ic0dd559c98589107fcdeade8784699cf6b2f1761
2014-09-06 18:50:21 -07:00
Fabian Wickborn 2aed1b8241 Renamed goexif folder to match upstream URL
In the advent of github.com/camlistore/goexif to be closed, this
commit renames the goexif folder in third_party to match the
upstream on GitHub.

The affected import paths have been rewritten accordingly.

Change-Id: I5a8871efd01987944b7f5e93979307857ae16fe7
2014-09-05 17:27:59 +02:00
mpl 3fbc92a4ae Merge "client&camput: use cmdmain.Stderr for logging" 2014-08-12 20:33:50 +00:00
mpl 0fa50c4355 client&camput: use cmdmain.Stderr for logging
And use -verbose in tests, for easier debugging.

Change-Id: Iac5e1a8e9c987f82fc221ce73c7e3ca10a86a924
2014-08-12 22:41:55 +02:00
mpl df7952b9ba mysql: create database now distinct from create tables
Because we do not want the database name to be optional with a
placeholder (/*DB*/) in the statement that creates the database, since
it is not actually optional there - as opposed to when creating tables.

Change-Id: I05351d76d95071492d763758a11454f219524510
2014-08-08 20:06:02 +02:00
mpl 44ac2e4a3e camtool/dbinit: replace dbname placeholder before creating table
Change-Id: I1a6c9f10c0731f5422a1d9780815e6e5235bb090
2014-08-08 17:44:17 +02:00