mpl
2504230fb9
importer: update flickr
...
Works but only lightly tested.
Could use lots of refactoring with code common with twitter.
Needs a test too.
Change-Id: I07f72d29acbc0226aeeedba0afe0bf7eeeac5ad3
2014-05-20 01:40:52 +02:00
Brad Fitzpatrick
a90879bac0
Merge branch 'master' of https://camlistore.googlesource.com/camlistore
2014-03-21 13:57:07 -07:00
Aaron Boodman
2802cfb95c
Minor cleanup to importer README files.
...
Change-Id: Id37ed68b5b8eefe9bc0011452a0e41f70466d87b
2014-03-21 13:41:16 -07:00
Brad Fitzpatrick
bf692123bf
importer: use context.Context instead of Interrupt type
...
Change-Id: I79f93c6a14934320022b90500d926453e614d001
2014-03-21 12:27:06 -07:00
Brad Fitzpatrick
eb27581da7
httputil: add DecodeJSON and CloseBody helpers, then use them everywhere
...
httputil.CloseBody closes a http.Response.Body nicely, such that it's
more likely to be re-used.
httputil.DecodeJSON parses JSON from a Response.Body and closes the
body. It also keeps a temporary copy of the input, for error messages.
Then use them everywhere, to improve HTTP TCP connection re-use.
And misc other clean-ups.
Change-Id: I5dc44be0165b13659459ed29ce5ab44c17d9739f
2014-01-28 22:00:52 -08:00
Aaron Boodman
88973d4871
Clarify confusing log message in Flickr importer
...
Change-Id: I9201bd12e7afb31c08b34b4bc4cd7c39567de296
2013-12-27 00:02:33 -08:00
Dan Pupius
bdcf858a0c
Flickr importer paginates on sets and photostream
...
Change-Id: I921400958e97c97467f6ef4d3eec642b81a8e614
2013-12-16 21:16:18 -08:00
Brad Fitzpatrick
22101b61d8
flickr: clarify in README that the flag is a devcam flag, not server flag
...
Change-Id: Iaab951c326ff90f09b6751f8fe4d439743a5e430
2013-12-12 15:39:44 +04:00
Aaron Boodman
6a5a2d6d7c
Add a README for the flickr importer package
...
Change-Id: I018c1574e231cae4119fb55ceb7b63d976db0074
2013-12-10 21:35:58 -08:00
Aaron Boodman
9855ab281d
Flickr importer: import sets and populate with links to photos.
...
Change-Id: I6c53dade3e96373fb3fb9ea4b172c53d5e22d988
2013-11-22 12:21:03 -08:00
Aaron Boodman
08ea4ed13e
Flickr importer: Don't refetch or import unmodified photos.
...
Change-Id: I2ade0aa70e3caca8c3c1153ffee448d09d819da6
2013-11-22 10:13:21 -08:00
Aaron Boodman
93b0bbbee5
Flickr importer: store credentials in Camlistore, not weird JSON file.
...
Change-Id: I07ed4e9043c9fa448425144886dc3b7047c4e85b
2013-11-22 09:50:03 -08:00
Aaron Boodman
2a747ccd56
Add ability to specify flickr config for devcam.
...
Change-Id: Ic1139730d969558e2d6375dd86c6741e3dfd2b9b
2013-11-18 21:16:09 -08:00
Aaron Boodman
e3d71c34d1
Actually import the first 100 photos from Flickr.
...
Currently this just imports the title, description, and image data.
Change-Id: I95de17cddb0ac18eec05f8ee288764b04cd7f406
2013-11-17 21:58:06 -08:00
Aaron Boodman
de9e5103e7
Grab the userID from the flickr oauth handshake.
...
Remove the mutex from auth.go because I believe the
mutex in importer.go should guaranteeing only one
flickr importer is running at a time.
Change-Id: Ice971c6c041cf21fdb2bc93cb15f861dd1c8c1d7
2013-11-17 14:26:42 -08:00
Aaron Boodman
9ae23e52b0
Rearrange the Flickr importer to use OAuth instead of Flickr's custom importer.
...
Change-Id: I8284431fa6572a08d3c7ff0d0e655297627a4eda
2013-11-16 22:30:21 -08:00
Aaron Boodman
e4f25a2444
First little bit of Flickr importer.
...
Change-Id: Ia42b07a81b01904f5722d06653c4bf9de2e81c64
2013-10-20 11:18:53 -07:00