Rooba
/
perkeep
mirror of https://github.com/perkeep/perkeep.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,695 Commits 44 Branches 11 Tags 59 MiB
Commit Graph

4695 Commits

Author SHA1 Message Date
Brad Fitzpatrick f5f02768b3 picasa: give a title to importer root permanode 
Change-Id: I0e259db52060518dfe33f31f0222b169a8c9e0ef
 2014-07-28 19:16:17 -07:00
Brad Fitzpatrick 9a3c619405 importer: add ChildPathObjectOrFunc to let importers find a fitting permanode on miss 
Change-Id: I016f30aa9e05a1024c2cdb7b1e8be0a675f73719
 2014-07-28 19:15:53 -07:00
Brad Fitzpatrick dadb9cca16 Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-07-28 16:37:40 -07:00
Brad Fitzpatrick ea6785569d picasa: simplify photo import code, only redownload photo when necessary, do 3 at once. 
Change-Id: I99551ad90359ced164b47b12f121ef207b797430
 2014-07-28 16:37:19 -07:00
Brad Fitzpatrick 2695422f2e picasa: incremental album import, and key album off its ID, not name. 
Change-Id: I748e01950fa22eec024bb08ae22060b6939513dd
 2014-07-28 13:58:24 -07:00
Brad Fitzpatrick 80e543efe2 nodeattr: add more, rearrange, clean up some comments. 
Change-Id: Ifc1809ed07166c18253cf0a82e708fccb3071f08
 2014-07-28 13:56:43 -07:00
Brad Fitzpatrick b8756b73a5 picasa: logging and TODO 
Change-Id: Icf010ad8b781dbbf66f03160d49089d8986853a0
 2014-07-27 13:13:01 -07:00
Brad Fitzpatrick e8816c072d picasa: cleanups, missing body.Close, start of incremental support, fix SummarizeAccount 
Change-Id: I497338743c7d85dea9f374215662543f4a9ad6a9
 2014-07-27 12:25:18 -07:00
Brad Fitzpatrick db09f2fe1a Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-07-25 16:03:53 -07:00
Brad Fitzpatrick 4021f812c6 importer, picasa: move ExtendedOAuth2 out of pkg importer, fix picasa 
The ExtendedOAuth2 code tried to be generic, but wasn't (had Picasa
comments?) and was only used by Picasa anyway.  We can move it later
if there are actually 2 users and it works for both.

At the same time, make Picasa actually work by writing a correct
IsAccountReady function.
 2014-07-25 16:02:43 -07:00
Brad Fitzpatrick 3a77e7bcb0 twitter: clarify purpose of getTopLevelNode and set titles better 
Change-Id: Ie4d88b927ccd63a943afbb220594b6cb0c96a2b9
 2014-07-25 14:54:48 -07:00
Brad Fitzpatrick b531c32f11 nodeattr: moving more from importer/attrs.go 
Change-Id: Iebf336c44af77ccbe655aadbe1e57ad339ba5201
 2014-07-25 14:48:03 -07:00
Brad Fitzpatrick d0fbfd9751 nodeattr: rename Content to CamliContent, since Content also exists. 
Change-Id: I305ca3cecf9b223a125fb9207966995c9dbf83b8
 2014-07-25 14:41:17 -07:00
Brad Fitzpatrick 997d8241b9 twitter: simplify getTopLevelNode 
Change-Id: Id25ad568a79d44144ac8aaf9652e31dc7de6e864
 2014-07-25 14:10:52 -07:00
Brad Fitzpatrick 0716bfdecf twitter: revert 98a73d966d; it changed its imported root structure 
I failed to catch that in review.

Change-Id: Ie88298a2f34595b27c6f98af6f31b61a29ebac1b
 2014-07-25 14:07:17 -07:00
Brad Fitzpatrick 8af06fa3ff picasa: work on making the instructions accurate & work 2014-07-25 13:37:47 -07:00
Brad Fitzpatrick fad3a60a77 picasa: some importer attribute cleanup 
Use nodeattr constants. Don't set lat/long when unknown.
 2014-07-25 13:24:46 -07:00
Brad Fitzpatrick f2b9657be6 nodeattr: fix up comment style 
And use nodeattr.Title in twitter.
 2014-07-25 13:16:10 -07:00
Brad Fitzpatrick bc2b485656 twitter: fix compilation error from 98a73d966d 2014-07-25 13:13:30 -07:00
mpl c3cc0ac681 Merge "importer/flickr: make test data for devcam" 2014-07-23 20:25:26 +00:00
mpl 409ec362e3 importer/flickr: make test data for devcam 
A few renamings in flickr.go too.

http://camlistore.org/issue/417

Change-Id: Ied28cfadc7a546f34b87f9a43462f82ee4cb71d6
 2014-07-29 00:22:06 +02:00
mpl 7e86255cac importer/flickr: set DateCreated attribute 
Also cleaned up a few vars.
Moved some attributes to nodeattr pkg.

Change-Id: Iea496d50b12e67132fe88f371a89534c2fe32761
 2014-07-25 00:57:10 +02:00
Brad Fitzpatrick c2dd9a1fce schema: add test of time.ParseInLocation with UnknownLocation 
Change-Id: I23c1007b53d794e36e9eeaad03e9d11a4cd3c397
 2014-07-24 13:44:31 -07:00
Brad Fitzpatrick 804f11d49e schema/nodeattr: new leaf package for permanode attributes 
All the attributes from pkg/importer/attrs.go should eventually move here.

Change-Id: I252749ca32fdb0f367dfa906e728d0a679e8eb5b
 2014-07-24 13:37:45 -07:00
Brad Fitzpatrick ab885a369c schema: add UnknownLocation and IsZoneKnown 
Change-Id: Ia056d03a367502ea4d06e5748cc7de7072c3e12c
 2014-07-24 13:35:18 -07:00
Brad Fitzpatrick 80203318d1 Merge "Removed the flickr-importer line from docs as this is no longer applicable" 2014-07-23 20:19:38 +00:00
Brad Fitzpatrick 4dee450e6a C+A: add Ritesh Sinharitesh 
Change-Id: Id8a6cd784cc08535acb97819f3d7059b2ec2c2e8
 2014-07-23 17:44:01 -07:00
Brad Fitzpatrick 814dad41d4 Merge "twitter importer: meaningful names for permanodes" 2014-07-23 18:07:28 +00:00
mpl cc4a7bb737 third_party/picago: update to 748d17b605ea675a56859678b1b0a57b38d082d0 
Fixes off by one error.

For reference: picago was first vendored in at camli ref
65fa5d6d3e

Change-Id: Id58e067a4f89199e9b20cea834bccac5decfac89
 2014-07-25 16:05:51 +02:00
mpl 2e939b0b35 importer/picasa: make test data for devcam 
http://camlistore.org/issue/417

Change-Id: If1a8771a863e1f7d0797ec5a8e50cd3573718c95
 2014-07-23 19:47:45 +02:00
Ritesh Sinha cdc893ceea Removed the flickr-importer line from docs as this is no longer applicable 
TODO: Create and link to a document that explains how to import stuff
from flickr, twitter, etc.

Change-Id: I8b525a11cf3b240e7a91bf1daac87572b66afd5e
 2014-07-23 17:39:56 +01:00
mpl 83437b0f05 Merge "importer: wire run (context) HTTP client with host HTTP client" 2014-07-17 20:53:10 +00:00
mpl 748fd21e96 importer: wire run (context) HTTP client with host HTTP client 
Killing two birds with one stone: we don't need to set it in devcam
anymore now.

Also switched to using the short form (run's one) everywhere, for
consistency.

Change-Id: I1e72ab99a07392c4970b1ed19b6e460ff422a24a
 2014-07-22 15:40:06 +02:00
mpl f81b88de6e importer/foursquare: make test data for devcam 
http://camlistore.org/issue/417

Change-Id: I753ac91aae5bd876b28e4473e4cf00af460deb95
 2014-07-21 23:56:58 +02:00
mpl b82459424d devcam server --makethings 
Only creates twitter things for now.

http://camlistore.org/issue/417

Change-Id: I05d548e012586279e165c01468524ceb055ff17b
 2014-07-21 23:24:33 +02:00
mpl 26cb64e825 Introduce search.QueryDescriber interface. *client.Client implements it. 
There are several places where we're using a *search.Handler, when we
only want to be able to do query and describe requests. When these
places need to be moved also out of the context of camlistored, (like
when making a server app such as the publisher), the QueryDescriber can
be used, and the adequate implementation (*search.Handler,
*client.Client, or any other) is used depending on the context.

Change-Id: Ie1c5bb6f1bbba32c24a8eb2d1175af95ffcc8335
 2014-07-21 22:20:24 +02:00
Brad Fitzpatrick deb743d1ec Merge "images: add support for fast jpeg down-sampling." 2014-07-21 17:34:27 +00:00
Brad Fitzpatrick 7bd5e287d4 Merge "Fixed calls to formatting functions" 2014-07-21 17:34:27 +00:00
mpl e68742473d importer/foursquare: minor typo 
Change-Id: Ic3c0d2f01ea0e6dc191500ed2856810e8c9581d6
 2014-07-22 00:12:51 +02:00
tnt 6868a882b9 Fixed calls to formatting functions 
Change-Id: I3ec2af85364674ac6f1a88cd12b6cb369d8e50e1
 2014-07-21 22:06:53 +00:00
Brad Fitzpatrick 6b65adbbdd Merge "picasa importer: remove Run-private HTTPClient" 2014-07-18 15:21:41 +00:00
mpl c46d66c3eb Merge "dockertest: skip test when DB in container not ready" 2014-07-17 20:53:10 +00:00
mpl 955cd34404 dockertest: skip test when DB in container not ready 
http://camlistore.org/issue/474

Change-Id: Id65b3c35a2f38466c4d7370bad4c5f73a8cb22db
 2014-07-17 18:09:02 +02:00
Tamás Gulácsi 925f9d3f86 picasa importer: remove Run-private HTTPClient 
A more complete version of Aaron Boodman's
https://camlistore-review.googlesource.com/#/c/3066/
in removing Transports. As Aaron pointed out,
(https://groups.google.com/d/msg/camlistore/9OwQKH6z7rY/840oQrRgsGIJ) it
is illegal for oauth.Transport.Transport to ever be another instance of
oauth.Transport.

So this commit tries hard to use Context's HTTPClient
everywhere and make sure to have its Transport an *oauth.Transport, but
that's Transport is not an *oauth.Transport, but the underlying
Transport.

To eliminate "403: Token not found" errors, we set
oauth.Config.AccessType, oauth.Config.ApprovalPrompt to
"offline", "force".
This rewards us with a non-empty Token.RefreshToken,
and store the full Token in AcctAttrOAuthToken.
This enables us to import continuously without user intervention.

Change-Id: I4defb346abfcf3f6c17597fc2dc23a6e536eda37
 2014-07-17 08:12:11 +02:00
Brad Fitzpatrick b062430d99 Merge "fs: handle directory permanode titles" 2014-07-16 18:19:25 +00:00
Brad Fitzpatrick e9de15d596 Merge "make: run 'devcam test' for presubmit target" 2014-07-16 05:14:41 +00:00
Bill Thiede c360867970 make: run 'devcam test' for presubmit target 
The previous behavior (now build target oldpresubmit) was slightly different
than devcam test; it didn't copy files to a clean directory and test in
isolation.  The buildbot uses devcam test, and for consistency 'make
presubmit' should too.

This runs devcam test with -short, mirroring -short from the previous
presubmit.  The buildbot runs devcam without -short.

Change-Id: I71e308bd16104004a8cd790901e88edebedab2a9
 2014-07-15 22:17:09 -07:00
Piotr S. Staszewski cac9aa4483 fs: handle directory permanode titles 
Set corresponding permanode title on new root,
new directory and directory rename.

Change-Id: I5432e14ef57d6c0c5555b11e895e8b8ad6d8efcf
 2014-07-15 08:41:05 +02:00
Andrew Gerrand 83a4b39f10 Merge "pkg/sorted/buffer: flesh out, add test" 2014-07-14 22:24:48 +00:00
Andrew Gerrand c15b4c05a7 pkg/sorted/buffer: flesh out, add test 
Change-Id: I18f57425ad2e9a4d692d4efe865fea81e8f143e3
 2014-07-15 08:24:54 +10:00