Rooba
/
perkeep
mirror of https://github.com/perkeep/perkeep.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
7,277 Commits 44 Branches 11 Tags 59 MiB
Commit Graph

127 Commits

Author SHA1 Message Date
Brad Fitzpatrick 70475701d1 Get rid of QueueCreator and all its associated complexity. 
Previous TODO entry was:

-- Get rid of QueueCreator entirely. Plan:
     -- sync handler still has a source and dest (one pair) but
        instead of calling CreateQueue on the source, it instead
        has an index.Storage (configured via a RequiredObject
        so it can be a kvfile, leveldb, mysql, postgres etc)
     -- make all the index.Storage types be instantiable
        from a jsonconfig Object, perhaps with constructors keyed
        on a "type" field.
     -- make sync handler support blobserver.Receiver (or StatReceiver)
        like indexes, so it can receive blobs.  but all it needs to
        do to acknowledge the ReceiveBlob is write and flush to its
        index.Storage. the syncing is async by default. (otherwise callers
        could just use "replica" if they wanted sync replication).
        But maybe for ease of configuration switching, we could also
        support a sync mode.  when it needs to replicate a blob,
        it uses the source.
     -- future option: sync mirror to an alternate path on ReceiveBlob
        that can delete. e.g. you're uploading to s3 and google,
        but don't want to upload to both at once, so you use the localdisk
        as a buffer to spread out your upstream bandwidth.
     -- end result: no more hardlinks or queue creator.

Change-Id: I6244fc4f3a655f08470ae3160502659399f468ed
 2013-11-22 14:33:31 -08:00
Brad Fitzpatrick e190090cbd add TODO 
Change-Id: I3e4c33d1bafcdf4f6afde3440995c591c9457787
 2013-11-22 12:40:33 -08:00
Brad Fitzpatrick 27b19787e0 TODO: new plan to kill QueueCreator 
Change-Id: I098307063f7645889a39dedafc4d3f862a3f798c
 2013-11-18 18:33:59 -08:00
Brad Fitzpatrick 6a4c0ec09c TODO: use glog 
Change-Id: I94ce97b93c73bee47f90a966f5cb1e860b23233a
 2013-11-09 19:55:49 -05:00
Brad Fitzpatrick 63b4f390cb client: upload public key if necessary whenever uploading a signed blob 
Change-Id: I2e61da4fa2eeae2332c67902f8dd5f064b027835
 2013-09-22 19:38:42 +01:00
Brad Fitzpatrick e8f89f609b website: document the 0.5 release, Castletownbere 
Change-Id: I825bd08fdc60d84137e7b68663058ba7fa2fc42d
 2013-09-21 18:27:42 +01:00
Brad Fitzpatrick 8319411ab4 Convert more ReceiveBlob into blobserver.Receive or blobserver.ReceiveNoHash 
Change-Id: I9199555324b617167a6062a8b55ed09b449bae4f
 2013-09-16 15:57:14 +01:00
Brad Fitzpatrick 13691c699f make.go: build camput, etc faster, ignoring embedded UI resources 
Change-Id: I1f7f60f4d5de97f69ddaf8c370889320ca8d5efe
 2013-09-10 22:42:24 -07:00
Brad Fitzpatrick e731931edd Some TODO items. 
Change-Id: I4236764cb1dc4a1aea003d86b43687576c1fe3c5
 2013-09-10 20:02:26 -07:00
Brad Fitzpatrick 2963597d1e add a TODO 
Change-Id: I653b5cea785ba08455e84e06f01734a6d384f240
 2013-08-29 16:12:18 -07:00
Brad Fitzpatrick dbb93fd888 Don't link to /setup handler for dev server. 
Change-Id: Ic0c27718b3a06c2a6dff21a24744b1dce2944617
 2013-08-26 11:25:11 -05:00
Brad Fitzpatrick d293b8fd34 Use pkg/gate in a couple places. Do s3 parallel state. Update TODO. 
Change-Id: I23006baa7b454ceca3f07c8fa7789ad54c524849
 2013-08-21 19:05:52 -05:00
Brad Fitzpatrick b24cad68dd Cleanup: remove BlobHub and time.Duration waits from storage interface 
Move up a layer to the HTTP.  Also, start to remove ContextWrapper
stuff.  We've done it differently for App Engine instead, and will do
it differently yet moving forward.

Also add blobserver.Receive and use it in most places, moving checksum
verification up a layer.

Bunch of other cleanup and TODO fixing too.

Much simpler and cleaner.

Change-Id: I12e56c5d4e53bfcf82bdd8fb0b6d57c248ff605c
 2013-08-21 13:57:28 -07:00
Brad Fitzpatrick 7364fd6110 link to camlipy 
Change-Id: I54b16e8f0d6c8216957e9a0655edbd596e3f3036
 2013-08-15 10:07:58 -07:00
Brad Fitzpatrick 0bdf20884b all: delete pkg/blobref; convert all from *blobref.BlobRef to new blob.Ref 
Change-Id: Id2dfb7f19452bedf4f3c9310b36227fd8117b225
 2013-08-03 19:54:30 -07:00
Brad Fitzpatrick cf0d9aca6e More docs 
Change-Id: I5c21f240c85bcf91fb67487cc172bf3faeb49fff
 2013-07-07 18:52:14 -07:00
Brad Fitzpatrick 953240b870 TODO about cammount 
Change-Id: I3f78dbbd7bce1198bde1b6b0c883633dad8d47c2
 2013-07-07 15:30:55 -07:00
Brad Fitzpatrick 53c7027160 more TODO 
Change-Id: Iade5be2c9f2759790d6c31e62d6a1ec9c1911d9f
 2013-07-07 12:23:24 -07:00
Brad Fitzpatrick 26e8b857ce TODO about blobhub notification stuff 
Change-Id: I21b6b7baf88ac1972ae03871acd09110c29d8b39
 2013-07-07 12:19:26 -07:00
Brad Fitzpatrick de00851493 TODO: blobref representation 
Change-Id: Ide46b799d3a134952f6037ad501f2e55dbb361e1
 2013-07-07 11:29:10 -07:00
Brad Fitzpatrick c4145082e9 TODO: one added, one removed 
Change-Id: I3675048493ff130cdfac22c72a72cad00a0bb7c8
 2013-07-07 01:56:44 -07:00
Brad Fitzpatrick 8af0cbd01a add TODO 
Change-Id: Ib28e073efdbf4b8f50a729405ae36c9d73007bb8
 2013-07-06 14:36:16 -07:00
Brad Fitzpatrick 10d000d900 ui: serve Closure from embedded zip data when available 
Change-Id: I9bb6bb4f13f69b293fd98441d82068c0677ffbd5
 2013-06-18 23:14:36 -07:00
mpl b198c00cde TODO: "revert" non-typo 
Change-Id: Ibbeb4458970f66b5b8aeba3d769d065a43e8cdd9
 2013-06-13 01:59:27 +02:00
mpl c31c97186a TODO: typo 
Change-Id: Ic9146c8adce1e4a7871dd75fbbd25f051a6980e2
 2013-06-13 01:46:09 +02:00
Brad Fitzpatrick 5761b57d69 Work on implementing new static resource plan, as documented in the big TODO item. 
Change-Id: I79d7665a24633630c39cceb5e1ab49cbb0300150
 2013-06-12 10:10:24 -07:00
Brad Fitzpatrick 5cd09010a3 more TODO 
Change-Id: Ie3bf8dc8aa5c19465e85052686693335d66127e4
 2013-06-12 09:46:44 -07:00
Brad Fitzpatrick 5b2b2ca267 TODO: file embed notes 
Change-Id: Ia0d35ca91f9d21724d90e90788108a21419562bc
 2013-06-12 07:27:12 -07:00
Brad Fitzpatrick 8d0a3b57c4 TODO: update make.go status 
Change-Id: I2c7ab846a0294db871d170d1c39884cc5fec6c3c
 2013-06-12 03:58:42 -07:00
Brad Fitzpatrick f7d7d48cdd Cleanup 
Change-Id: Ic0cdae094108bd3b6dca5f7db3005f1e17199de3
 2013-06-11 13:27:04 +02:00
Brad Fitzpatrick ebbc943502 Fix environment of dev-camtool. 
Change-Id: I671e18cbc07ed9f28afdd3ac7368cd691f44a992
 2013-06-09 11:03:48 +02:00
Brad Fitzpatrick 248a30ee9f more TODO 
Change-Id: I9a8ffab14e51fc92d6fa4b67b4b28bddc82ea7bd
 2013-06-09 10:58:06 +02:00
Brad Fitzpatrick 6a773f903e more TODOs 
Change-Id: Ibeb698d87ce474ef7f729ec741e3a89ed3e3ffc0
 2013-06-09 10:11:31 +02:00
Brad Fitzpatrick e15c7ceea7 todos 
Change-Id: I6b5b09884353770c662c6377c498f149dbcc37f7
 2013-05-26 10:07:35 -07:00
Brad Fitzpatrick 6c10e85434 more TODO, about encryption and peer storage 
Change-Id: I0c19a6022f725b4a0fdfbdca01b499eb5238c1f8
 2013-01-21 14:52:49 -08:00
Brad Fitzpatrick c0d20d6bfc more TODO 
Change-Id: I644dce88def976a18804c4b21d8ddb4ab9b31091
 2013-01-20 16:53:57 -08:00
Brad Fitzpatrick 35d35e3ef2 more TODO 
Change-Id: I62e870c89bab9b1e1cf7fb0333d9ef0ed8fb8883
 2013-01-20 16:28:00 -08:00
Brad Fitzpatrick 04176b2f66 TODO: add dir schema note 
Change-Id: I5580152a8cc49c7ecffbbbe39d61265773b8ebb2
 2013-01-20 15:58:34 -08:00
Brad Fitzpatrick eee5ee564d update TODO 
Change-Id: Icf2a058e62368a94afdf94b13977e667e21412f4
 2013-01-20 15:10:15 -08:00
Brad Fitzpatrick 5f6130b13b gethandler: use http.ServeContent; delete pre-Go 1 HTTP Range stuff 
Change-Id: Icef01ea04aa7d38fc39c829618ff2856449eb326
 2013-01-20 14:06:55 -08:00
Brad Fitzpatrick 2306946de4 Update TODO 
Change-Id: I8cb031d370a130bca7666c17eb678dde3476bf80
 2013-01-20 13:40:09 -08:00
Brad Fitzpatrick 7ceaaa0012 blobref: simplify the FromHash func. Make type implicit. 
Change-Id: I2e01c3663bdb1151c11dfc9a1d59c7081940ffac
 2013-01-20 13:36:27 -08:00
Brad Fitzpatrick 7c319ca284 pkg/cacher: unify the cammount and camget disk caching code 
Change-Id: I8e53d00f1f5459856a4e2b863d74c2b7c3f515bc
 2013-01-20 09:52:03 -08:00
Brad Fitzpatrick dd72cd4434 schema: verify no slashes in fileName in FileNameString accessor. 
Change-Id: I1b02e67144fed1f80123530786af55c74bd64f36
 2013-01-13 20:43:55 -08:00
Brad Fitzpatrick 75360ee9b3 Rename index.IndexStorage to index.Storage, to reduce stutter. 
Change-Id: I52b2a8460c3957a1c8211a470e1df9a8dc5b7067
 2013-01-13 20:19:36 -08:00
Brad Fitzpatrick d80cad8e2d auth stuff: clean up, allow scheme registration, integrate App Engine auth. 
Change-Id: Idc7ac3782d3669a8f68255bd54d03f583814d5e2
 2013-01-10 23:04:24 -08:00
Brad Fitzpatrick a4b2d8cf12 rename TODO 
Change-Id: I544c7bb2db76fd67200b9d00bb2c8ea15bb8042c
 2013-01-09 14:20:51 -08:00
Brad Fitzpatrick 360f63a64b More App Engine index work. 
But fail: 2013/01/09 03:38:54 replica: receiving blob, 1 successes, 1 failures; last error = API error 1 (datastore_v3: BAD_REQUEST): ApplicationError: 1 operating on too many entity groups in a single transactio

See http://stackoverflow.com/questions/8251594/how-many-objects-is-too-many-for-in-a-single-transaction-to-googles-datastore

Sigh.

Change-Id: I90dff1b6bd40a00b4be19c5599583d2131b739d4
 2013-01-08 19:43:09 -08:00
Brad Fitzpatrick 0333cc093e more TODO 
Change-Id: I0c8535256b5cab6fd3bdca4ce4007dae01d59f7c
 2013-01-03 17:57:10 -08:00
Brad Fitzpatrick 1053ea5847 more TODO about deleting 
Change-Id: Ib8cb0e815b35f078c306a280bd926a11e16f5620
 2013-01-02 20:41:26 -08:00
Brad Fitzpatrick 4a464e334f more TODO 
Change-Id: I1a3845191c9b17350a11bb671b131d1c4dc8c6bc
 2013-01-02 20:37:37 -08:00
Brad Fitzpatrick 4e6740eac5 Add TODO 
Change-Id: Icbce2e60befb2f7a63010b01039b79d10c10e422
 2013-01-02 20:10:23 -08:00
Brad Fitzpatrick 4ce1263225 more TODO 
Change-Id: I3aff3b6c1fea1ecc6937598b0bce38d126135c0a
 2012-12-31 17:50:01 -08:00
Brad Fitzpatrick ddf2825064 more TODO 
Change-Id: I72e7074a3cc026270685547b9f4019a373a4f6e8
 2012-12-30 10:02:25 -08:00
Brad Fitzpatrick 80f1bcf335 TODO: more 
Change-Id: I9964fed958933b3cc36cac9b775f912935c139fe
 2012-12-24 09:59:52 -08:00
Brad Fitzpatrick 7297de49e8 TODO: remove throttling item; done. 
Change-Id: I7ece4187f4d5e724f807ba9fe040a2c2760926e4
 2012-12-24 09:57:50 -08:00
Brad Fitzpatrick 3137b8a71b Add TODO about connection throttling for testing. 
Change-Id: I595d7fd3d80183aa24d6cd298651fc8090dd6b6b
 2012-12-06 17:57:27 -08:00
Brad Fitzpatrick bf2604a836 more TODO 
Change-Id: I3eac6b72744c76ddbdd4009f006991f292d8f55a
 2012-08-21 16:09:32 +10:00
Brad Fitzpatrick 8d01f4e323 add nit to TODO 
Change-Id: I507326c162da803ce4ee1949a81428c076d961be
 2012-08-21 16:08:09 +10:00
Brad Fitzpatrick 35c26048ef remove netutil TODO item. 
Change-Id: I3540e616bc9c284bbdb44b8a52580f5e60d388f6
 2012-03-27 17:37:19 -07:00
Brad Fitzpatrick 9447a8cb78 camput: reorder file type switch; fixes symlink bug 
Change-Id: Ic4d0f6c2be02d153f933d72c1a02e72926c36786
 2012-03-27 10:41:34 -07:00
Brad Fitzpatrick aecc8fbfa7 update TODO 
Change-Id: I12630705e060e064723d6584f89f42e3558c8739
 2012-03-27 10:34:51 -07:00
Brad Fitzpatrick 823768571e runsit TODOs 
Change-Id: Ib9151757881c3e35800438c0b7a953752a52dd4a
 2012-03-22 18:22:34 -07:00
Brad Fitzpatrick f9e0ac07ee updated TODO 
Change-Id: I53d195b3e7420bec9170e41d65c544856517e1c6
 2012-03-22 18:21:32 -07:00
Brad Fitzpatrick 17b4e87a9f remove a TODO 
Change-Id: I3d9fadf811ef6cc320c90bd90b94c38b000f716d
 2011-09-25 17:38:39 -07:00
Brad Fitzpatrick c77a69e4a1 update TODO a bit 2011-06-13 08:50:24 -07:00
Brad Fitzpatrick 3cc140e624 updated TODO 2011-03-06 13:22:58 -08:00
Brad Fitzpatrick 80a6a3d018 add androi TODO 2010-12-20 23:25:34 -08:00
Brad Fitzpatrick 6c57fd5ca8 Testing updated gitosis email format 2010-12-19 15:40:28 -08:00
Brad Fitzpatrick d2e99620a5 Update TODO more 2010-12-19 15:37:03 -08:00
Brad Fitzpatrick c6524efeaa Update TODO more 2010-12-19 15:35:14 -08:00
Brad Fitzpatrick 4c624a847a Update TODO 2010-12-19 15:29:42 -08:00
Evan Martin 6169179dda claim javascript in todo 2010-11-04 23:07:33 -07:00
Brad Fitzpatrick ef78e3a15f TODO: CROS 2010-11-04 22:38:39 -07:00
Brad Fitzpatrick de26ad0ea8 more TODO 2010-11-04 21:27:24 -07:00
Brad Fitzpatrick 0793d64c56 more TODO 2010-11-04 21:22:38 -07:00
Brad Fitzpatrick 43d20e3718 add a TODO 2010-11-04 21:17:22 -07:00