perkeep/TODO

There are two TODO lists. This file (good for airplanes) and the online bug tracker:

     https://code.google.com/p/camlistore/issues/list

Offline list:

-- why can't ./pkg/blobserver/gethandler be merged into
   ./pkg/blobserver/handlers? I forget the reason, but it seems to
   work now, so maybe the circular dependency is gone.

-- support for running cammount under camlistored. especially for OS X,
   where the lifetime of the background daemon will be the same as the
   user's login session.

-- remove all the blobhub stuff from the blobserver storage interface
   and move it elsewhere? nobody really implements it anyway, suggesting
   it's at the wrong level. in the process, also look into simplifying
   the EnumerateBlobs interface and its "wait" parameter. perhaps we need
   a new optional AwaitNewBlob method on a storage interface, and the
   HTTP layer would use that, instead of assuming that all EnumerateBlob
   impls can wait.

-- change representation of *blobref.BlobRef to a value type with smaller
   memory usage and no internal string cache, so it can be used as a map
   key:
       type BlobRef struct {
           hash crypto.Hash
           sum  interface{} // [hash.Size()]byte
       }
   The string cache, if needed, can in the blobref package, keyed by
   blobref.

-- verify that the HTTP blob upload interface caps uploads at MaxBlobSize
   before giving it to storage impls

-- support syncing from a storage type that doesn't support
   QueueCreator by using local disk instead. writes go to both 1) that
   storage target not supporting QueueCreator and 2) local disk before
   being acknowledged. Then sync goes from local disk to wherever,
   deleting from local disk when done as normal (except in that case,
   the hardlink refcount would drop from 1 to 0, not 2 to 1)

-- website: remove the "Installation" heading for /cmd/*, since
   they're misleading and people should use "go run make.go" in the
   general case.

-- website: add godoc for /server/camlistored (also without a "go get"
   line)

-- tests for all cmd/* stuff, perhaps as part of some integration
   tests.

-- move most of camput into a library, not a package main.

-- server cron support: full syncs, camput file backups, integrity
   checks.

-- status in top right of UI: sync, crons. (in-progress, un-acked
   problems)

-- encryption blobserver.Storage wrapper (like cond & replicate)
   putting encrypted metadata in one blobserver.Storage and encrypted
   blobs in another blobserver.Storage.  the metadata one will
   occasionally be scanned and small (single record) items be combined
   into larger metadata blobs with the small ones removed.
   enumeration comes from opening all metadata blobs and merge-sorting
   them all.  the metadata blobs are themselves blobs (content-addressed and all),
   containing encrypted data of:
   (plaintext-blobref plaintext-size encrypted-blobref that-enc-blob-IV)
   Using AES and crypto/cipher (re-consult agl on specifics)

-- peer-to-peer server and blobserver target to store encrypted blobs
   on stranger's hardrives.  server will be open source so groups of
   friends/family can run their own for small circles, or some company
   could run a huge instance.  spray encrypted backup chunks across
   friends' machines, and have central server(s) present challenges to
   the replicas to have them verify what they have and how big, and
   also occasionally say what the SHA-1("challenge" + blob-data) is.

-- newui: add a Makefile rule (like "make embeds") to actually run the
   Closure Compiler on the newui code, and show errors/warnings, and
   generate new z*_embed.js file(s). (we can do rolling checksum splits
   of it later. TODO also: figure out if we can compile in non-minifying
   mode for now, to increase chances of rolling checksums splitting
   predictably)

-- sharing: make camget work with permanode sets too, not just
   "directory" and "file" things.

-- sharing: when hitting e.g. http://myserver/share/sha1-xxxxx, if
   a web browser and not a smart client (Accept header? User-Agent?)
   then redirect or render a cutesy gallery or file browser instead,
   still with machine-readable data for slurping.

-- rethink the directory schema so it can a) represent directories
   with millions of files (without making a >1MB or >16MB schema blob),
   probably forming a tree, similar to files. but rather than rolling checksum,
   just split lexically when nodes get too big.

-- delete mostly-obsolete camsigd.  see big TODO in camsigd.go.

-- we used to be able live-edit js/css files in server/camlistored/ui when
   running under the App Engine dev_appserver.py.  That's now broken with my
   latest efforts to revive it.  The place to start looking is:
        server/camlistored/ui/fileembed_appengine.go

-- should a "share" claim be not a claim but its own permanode, so it
   can be rescinded?  right now you can't really unshare a "haveref"
   claim.  or rather, TODO: verify we support "delete" claims to
   delete any claim, and verify the share system and indexer all
   support it.  I think the indexer might, but not the share system.
   Also TODO: "camput delete" or "rescind" subcommand.

-- make the -transitive flag for "camput share -transitive" be a tri-state:
   unset, true, false, and unset should then mean default to true for "file"
   and "directory" schema blobs, and "false" for other things.

-- index: static directory recursive sizes: search: ask to see biggest directories?

-- index: index dates in filenames ("yyyy-mm-dd-Foo-Trip", "yyyy-mm blah", etc).

-- get webdav server working again, for mounting on Windows.  This worked before Go 1
   but bitrot when we moved pkg/fs to use the rsc/fuse.

-- read/write fuse.  using search / camliMember, permanode per inode
   (https://github.com/hanwen/go-fuse + Go camlistore client == easy?)

-- work on runsit more, so I can start using this more often.  runsit should
   be able to reload itself, and also watch for binaries changing and restart
   when binaries change.  (or symlinks to binaries)

-- BUG: ./dev-server and hitting http://localhost:3179/ shouldn't mention
   the /setup handler.

-- add gofmt check to "make presubmit". also add "make fmt" target.

-- BUG: osutil paths.go on OS X: should use Library everywhere instead of mix of
   Library and ~/.camlistore?

-- camput: support for skipping common cache/temp files (most of the support is
   there now, just need to modify cmd/camput/files.go)

OLD:

-- add CROS support?
   http://hacks.mozilla.org/2009/07/cross-site-xmlhttprequest-with-cors/

-- brackup integration, perhaps sans GPG? (requires Perl client?)

-- blobserver test suite: flesh it out.  (bs-test.pl ... it's pretty good
   so far, but not done)

-- blobserver: clean up channel-closing consistency in blobserver interface
   (most close, one doesn't.  all should probably close)

Android:

[ ] Fix wake locks in UploadThread.  need to hold CPU + WiFi whenever
    something's enqueued at all and we're running.  Move out of the Thread
    that's uploading itself.
[ ] GPG signing of blobs (brad)
    http://code.google.com/p/android-privacy-guard/
    http://www.thialfihar.org/projects/apg/
    (supports signing in code, but not an Intent?)
    http://code.google.com/p/android-privacy-guard/wiki/UsingApgForDevelopment
    ... mailed the author.

Client libraries:

[X] Go
[X] JavaScript
[/] Python (Brett)
[ ] Perl
[ ] Ruby
[ ] PHP