Commit Graph

17 Commits

Author SHA1 Message Date
mpl 2504230fb9 importer: update flickr
Works but only lightly tested.
Could use lots of refactoring with code common with twitter.
Needs a test too.

Change-Id: I07f72d29acbc0226aeeedba0afe0bf7eeeac5ad3
2014-05-20 01:40:52 +02:00
Brad Fitzpatrick a90879bac0 Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-03-21 13:57:07 -07:00
Aaron Boodman 2802cfb95c Minor cleanup to importer README files.
Change-Id: Id37ed68b5b8eefe9bc0011452a0e41f70466d87b
2014-03-21 13:41:16 -07:00
Brad Fitzpatrick bf692123bf importer: use context.Context instead of Interrupt type
Change-Id: I79f93c6a14934320022b90500d926453e614d001
2014-03-21 12:27:06 -07:00
Brad Fitzpatrick eb27581da7 httputil: add DecodeJSON and CloseBody helpers, then use them everywhere
httputil.CloseBody closes a http.Response.Body nicely, such that it's
more likely to be re-used.

httputil.DecodeJSON parses JSON from a Response.Body and closes the
body. It also keeps a temporary copy of the input, for error messages.

Then use them everywhere, to improve HTTP TCP connection re-use.

And misc other clean-ups.

Change-Id: I5dc44be0165b13659459ed29ce5ab44c17d9739f
2014-01-28 22:00:52 -08:00
Aaron Boodman 88973d4871 Clarify confusing log message in Flickr importer
Change-Id: I9201bd12e7afb31c08b34b4bc4cd7c39567de296
2013-12-27 00:02:33 -08:00
Dan Pupius bdcf858a0c Flickr importer paginates on sets and photostream
Change-Id: I921400958e97c97467f6ef4d3eec642b81a8e614
2013-12-16 21:16:18 -08:00
Brad Fitzpatrick 22101b61d8 flickr: clarify in README that the flag is a devcam flag, not server flag
Change-Id: Iaab951c326ff90f09b6751f8fe4d439743a5e430
2013-12-12 15:39:44 +04:00
Aaron Boodman 6a5a2d6d7c Add a README for the flickr importer package
Change-Id: I018c1574e231cae4119fb55ceb7b63d976db0074
2013-12-10 21:35:58 -08:00
Aaron Boodman 9855ab281d Flickr importer: import sets and populate with links to photos.
Change-Id: I6c53dade3e96373fb3fb9ea4b172c53d5e22d988
2013-11-22 12:21:03 -08:00
Aaron Boodman 08ea4ed13e Flickr importer: Don't refetch or import unmodified photos.
Change-Id: I2ade0aa70e3caca8c3c1153ffee448d09d819da6
2013-11-22 10:13:21 -08:00
Aaron Boodman 93b0bbbee5 Flickr importer: store credentials in Camlistore, not weird JSON file.
Change-Id: I07ed4e9043c9fa448425144886dc3b7047c4e85b
2013-11-22 09:50:03 -08:00
Aaron Boodman 2a747ccd56 Add ability to specify flickr config for devcam.
Change-Id: Ic1139730d969558e2d6375dd86c6741e3dfd2b9b
2013-11-18 21:16:09 -08:00
Aaron Boodman e3d71c34d1 Actually import the first 100 photos from Flickr.
Currently this just imports the title, description, and image data.

Change-Id: I95de17cddb0ac18eec05f8ee288764b04cd7f406
2013-11-17 21:58:06 -08:00
Aaron Boodman de9e5103e7 Grab the userID from the flickr oauth handshake.
Remove the mutex from auth.go because I believe the
mutex in importer.go should guaranteeing only one
flickr importer is running at a time.

Change-Id: Ice971c6c041cf21fdb2bc93cb15f861dd1c8c1d7
2013-11-17 14:26:42 -08:00
Aaron Boodman 9ae23e52b0 Rearrange the Flickr importer to use OAuth instead of Flickr's custom importer.
Change-Id: I8284431fa6572a08d3c7ff0d0e655297627a4eda
2013-11-16 22:30:21 -08:00
Aaron Boodman e4f25a2444 First little bit of Flickr importer.
Change-Id: Ia42b07a81b01904f5722d06653c4bf9de2e81c64
2013-10-20 11:18:53 -07:00