Commit Graph

4879 Commits

Author SHA1 Message Date
Brad Fitzpatrick f2b9657be6 nodeattr: fix up comment style
And use nodeattr.Title in twitter.
2014-07-25 13:16:10 -07:00
Brad Fitzpatrick bc2b485656 twitter: fix compilation error from 98a73d966d 2014-07-25 13:13:30 -07:00
mpl c3cc0ac681 Merge "importer/flickr: make test data for devcam" 2014-07-23 20:25:26 +00:00
mpl 409ec362e3 importer/flickr: make test data for devcam
A few renamings in flickr.go too.

http://camlistore.org/issue/417

Change-Id: Ied28cfadc7a546f34b87f9a43462f82ee4cb71d6
2014-07-29 00:22:06 +02:00
mpl 7e86255cac importer/flickr: set DateCreated attribute
Also cleaned up a few vars.
Moved some attributes to nodeattr pkg.

Change-Id: Iea496d50b12e67132fe88f371a89534c2fe32761
2014-07-25 00:57:10 +02:00
Brad Fitzpatrick c2dd9a1fce schema: add test of time.ParseInLocation with UnknownLocation
Change-Id: I23c1007b53d794e36e9eeaad03e9d11a4cd3c397
2014-07-24 13:44:31 -07:00
Brad Fitzpatrick 804f11d49e schema/nodeattr: new leaf package for permanode attributes
All the attributes from pkg/importer/attrs.go should eventually move here.

Change-Id: I252749ca32fdb0f367dfa906e728d0a679e8eb5b
2014-07-24 13:37:45 -07:00
Brad Fitzpatrick ab885a369c schema: add UnknownLocation and IsZoneKnown
Change-Id: Ia056d03a367502ea4d06e5748cc7de7072c3e12c
2014-07-24 13:35:18 -07:00
Brad Fitzpatrick 80203318d1 Merge "Removed the flickr-importer line from docs as this is no longer applicable" 2014-07-23 20:19:38 +00:00
Brad Fitzpatrick 4dee450e6a C+A: add Ritesh Sinharitesh
Change-Id: Id8a6cd784cc08535acb97819f3d7059b2ec2c2e8
2014-07-23 17:44:01 -07:00
Brad Fitzpatrick 814dad41d4 Merge "twitter importer: meaningful names for permanodes" 2014-07-23 18:07:28 +00:00
mpl cc4a7bb737 third_party/picago: update to 748d17b605ea675a56859678b1b0a57b38d082d0
Fixes off by one error.

For reference: picago was first vendored in at camli ref
65fa5d6d3e

Change-Id: Id58e067a4f89199e9b20cea834bccac5decfac89
2014-07-25 16:05:51 +02:00
mpl 2e939b0b35 importer/picasa: make test data for devcam
http://camlistore.org/issue/417

Change-Id: If1a8771a863e1f7d0797ec5a8e50cd3573718c95
2014-07-23 19:47:45 +02:00
Ritesh Sinha cdc893ceea Removed the flickr-importer line from docs as this is no longer applicable
TODO: Create and link to a document that explains how to import stuff
from flickr, twitter, etc.

Change-Id: I8b525a11cf3b240e7a91bf1daac87572b66afd5e
2014-07-23 17:39:56 +01:00
mpl 83437b0f05 Merge "importer: wire run (context) HTTP client with host HTTP client" 2014-07-17 20:53:10 +00:00
mpl 748fd21e96 importer: wire run (context) HTTP client with host HTTP client
Killing two birds with one stone: we don't need to set it in devcam
anymore now.

Also switched to using the short form (run's one) everywhere, for
consistency.

Change-Id: I1e72ab99a07392c4970b1ed19b6e460ff422a24a
2014-07-22 15:40:06 +02:00
mpl f81b88de6e importer/foursquare: make test data for devcam
http://camlistore.org/issue/417

Change-Id: I753ac91aae5bd876b28e4473e4cf00af460deb95
2014-07-21 23:56:58 +02:00
mpl b82459424d devcam server --makethings
Only creates twitter things for now.

http://camlistore.org/issue/417

Change-Id: I05d548e012586279e165c01468524ceb055ff17b
2014-07-21 23:24:33 +02:00
mpl 26cb64e825 Introduce search.QueryDescriber interface. *client.Client implements it.
There are several places where we're using a *search.Handler, when we
only want to be able to do query and describe requests. When these
places need to be moved also out of the context of camlistored, (like
when making a server app such as the publisher), the QueryDescriber can
be used, and the adequate implementation (*search.Handler,
*client.Client, or any other) is used depending on the context.

Change-Id: Ie1c5bb6f1bbba32c24a8eb2d1175af95ffcc8335
2014-07-21 22:20:24 +02:00
Brad Fitzpatrick deb743d1ec Merge "images: add support for fast jpeg down-sampling." 2014-07-21 17:34:27 +00:00
Brad Fitzpatrick 7bd5e287d4 Merge "Fixed calls to formatting functions" 2014-07-21 17:34:27 +00:00
mpl e68742473d importer/foursquare: minor typo
Change-Id: Ic3c0d2f01ea0e6dc191500ed2856810e8c9581d6
2014-07-22 00:12:51 +02:00
tnt 6868a882b9 Fixed calls to formatting functions
Change-Id: I3ec2af85364674ac6f1a88cd12b6cb369d8e50e1
2014-07-21 22:06:53 +00:00
Brad Fitzpatrick 6b65adbbdd Merge "picasa importer: remove Run-private HTTPClient" 2014-07-18 15:21:41 +00:00
mpl c46d66c3eb Merge "dockertest: skip test when DB in container not ready" 2014-07-17 20:53:10 +00:00
mpl 955cd34404 dockertest: skip test when DB in container not ready
http://camlistore.org/issue/474

Change-Id: Id65b3c35a2f38466c4d7370bad4c5f73a8cb22db
2014-07-17 18:09:02 +02:00
Tamás Gulácsi 925f9d3f86 picasa importer: remove Run-private HTTPClient
A more complete version of Aaron Boodman's
https://camlistore-review.googlesource.com/#/c/3066/
in removing Transports. As Aaron pointed out,
(https://groups.google.com/d/msg/camlistore/9OwQKH6z7rY/840oQrRgsGIJ) it
is illegal for oauth.Transport.Transport to ever be another instance of
oauth.Transport.

So this commit tries hard to use Context's HTTPClient
everywhere and make sure to have its Transport an *oauth.Transport, but
that's Transport is not an *oauth.Transport, but the underlying
Transport.

To eliminate "403: Token not found" errors, we set
oauth.Config.AccessType, oauth.Config.ApprovalPrompt to
"offline", "force".
This rewards us with a non-empty Token.RefreshToken,
and store the full Token in AcctAttrOAuthToken.
This enables us to import continuously without user intervention.

Change-Id: I4defb346abfcf3f6c17597fc2dc23a6e536eda37
2014-07-17 08:12:11 +02:00
Brad Fitzpatrick b062430d99 Merge "fs: handle directory permanode titles" 2014-07-16 18:19:25 +00:00
Brad Fitzpatrick e9de15d596 Merge "make: run 'devcam test' for presubmit target" 2014-07-16 05:14:41 +00:00
Bill Thiede c360867970 make: run 'devcam test' for presubmit target
The previous behavior (now build target oldpresubmit) was slightly different
than devcam test; it didn't copy files to a clean directory and test in
isolation.  The buildbot uses devcam test, and for consistency 'make
presubmit' should too.

This runs devcam test with -short, mirroring -short from the previous
presubmit.  The buildbot runs devcam without -short.

Change-Id: I71e308bd16104004a8cd790901e88edebedab2a9
2014-07-15 22:17:09 -07:00
Piotr S. Staszewski cac9aa4483 fs: handle directory permanode titles
Set corresponding permanode title on new root,
new directory and directory rename.

Change-Id: I5432e14ef57d6c0c5555b11e895e8b8ad6d8efcf
2014-07-15 08:41:05 +02:00
Andrew Gerrand 83a4b39f10 Merge "pkg/sorted/buffer: flesh out, add test" 2014-07-14 22:24:48 +00:00
Andrew Gerrand c15b4c05a7 pkg/sorted/buffer: flesh out, add test
Change-Id: I18f57425ad2e9a4d692d4efe865fea81e8f143e3
2014-07-15 08:24:54 +10:00
Brad Fitzpatrick be651687ba Merge "context: minor typos in documentation." 2014-07-14 20:44:50 +00:00
mpl aa3cda0762 importer/twitter: add TestDataMaker to generate imported tweets
Also fix first user_timeline call (no maxId).

http://camlistore.org/issue/417

Change-Id: I1157331bd876a6400e16d0fd18712d8c459fdc20
2014-07-14 19:26:13 +02:00
mpl e4a31ea4ba Merge "test/transport.go: move to httputil, so we can use it without linking testing" 2014-07-14 17:10:15 +00:00
Brad Fitzpatrick a68f8df380 images: fix broken test
Exif.DateTime now always returns a time.Local location when zone is unknown.

Change-Id: I898516398a88bc8dcd8daf26f87c801a24cc1d7a
2014-07-14 09:36:48 -07:00
mpl 1fd526b999 test/transport.go: move to httputil, so we can use it without linking testing
Change-Id: I889d167a78ef0fba5ef2e9e3e884f594e151e940
2014-07-14 18:33:10 +02:00
Brad Fitzpatrick 077763fcbb schema: use GPS location to find timezone from EXIF when UTC offset is unknown
Change-Id: Ia3590424db36508b491d8f19829738fe102e5c3d
2014-07-13 10:26:54 -07:00
Brad Fitzpatrick 286b53f119 index: use Exif.LatLong accessor
This code is now moved to the exif package.

Change-Id: Ifba2e0b6a96c076e75179528e8ea9a4c0641d843
2014-07-13 10:25:04 -07:00
Brad Fitzpatrick b6d3d1a103 exif: add Exif.LatLong accessor
Change-Id: I5d5d1d3d8124e665d6bb7e6cb7d06107aa39bda7
2014-07-13 10:23:30 -07:00
Brad Fitzpatrick a827380644 exif: make DateTime return time.Local location when unknown timezone
Change-Id: Id3ea677389e3e2e4e765116e85c0c60fb74fdff8
2014-07-13 10:22:45 -07:00
Brad Fitzpatrick 995a4ccb0e indextest: force timezone when testing receive
Otherwise JPEGs with EXIF can be interpretted differently.

Change-Id: Ia3fe64a92d7a8f0642363d758f2d1f402f1e4a1f
2014-07-13 10:04:03 -07:00
Brad Fitzpatrick 76f4ff618d Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-07-13 10:02:47 -07:00
Brad Fitzpatrick af4df6f8c5 schema: rewrite symlink test to not delete testdata, not use asserts
Change-Id: I238ee5d55203f5c53b294d82e2cc626c4ef78ef2
2014-07-13 10:02:30 -07:00
Brad Fitzpatrick 49b864a526 Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-07-12 08:27:20 -07:00
Brad Fitzpatrick 80336a1a71 importer/foursquare: add a few more fields to the API struct.
Not used yet. The shout text at least we should import.

Change-Id: Ib8051e0956c6e7dbd2aee52e0a76d43b46340d20
2014-07-12 08:27:09 -07:00
Brad Fitzpatrick 06cd39ebb8 Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-07-11 21:09:46 -07:00
Brad Fitzpatrick 3967119923 Import github.com/bradfitz/latlong to third_party.
Change-Id: Ia952a23995b91ac9865bd0ae912bf0bf88289146
2014-07-11 21:08:50 -07:00
Brad Fitzpatrick ab5be97995 Merge "feed importer: meaningful names for permanodes" 2014-07-11 17:08:59 +00:00