Rooba
/
perkeep
mirror of https://github.com/perkeep/perkeep.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
perkeep/pkg
History
Brad Fitzpatrick 8d79f59908 blobpacked: first cut at packing, creating zip files with contiguous chunks. 
See package docs in blobpacked.go for background & rationale.

Will minimize disk seeks, regardless of the underlying storage
system. I always knew this day would come, but we've been putting it
off. It's finally time to separate out logical (tons of small chunks)
storage from physical (big contiguous layout for how they'll be
accessed).

First 80% is done. Last 80% remains: mostly lots of tests and more
paranoia, and fsck things, for when we inevitably lose indexes. (but
each zip file is self-describing, so the index is redundant).

Change-Id: I13f9aa79c4d9d87b5fdcece0d99d97eba031d608
 		2014-08-30 00:09:10 -07:00
..
app netutil: add HostPort, serverinit: return app baseURL 2014-08-01 00:01:27 +02:00
auth auth: allow for multiple modes 2014-05-21 18:43:41 +02:00
blob Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-08-25 16:50:42 -07:00
blobserver blobpacked: first cut at packing, creating zip files with contiguous chunks. 2014-08-30 00:09:10 -07:00
buildinfo buildinfo: add func TestingLinked 2014-02-23 09:21:11 -08:00
cacher Get rid of SeekFetcher vs StreamingFetcher distinction and complexity. 2014-03-14 12:29:13 -07:00
camerrors camerrors: rename MissingKeyBlob to ErrMissingKeyBlob 2014-01-13 20:09:54 -08:00
client client: add test with multiple ignores in the config 2014-08-26 00:46:12 +02:00
cmdmain legal: package for compiled-in licenses 2014-07-10 23:01:54 +02:00
constants Move defaultMaxResizeBytes to pkg/constants 2014-01-06 08:08:47 -08:00
context context: minor typos in documentation. 2014-07-03 22:05:16 -07:00
errorutil errorutil: write docs 2012-04-13 15:51:39 -07:00
fault fault: new package for fault injection 2014-03-16 19:27:40 -07:00
fileembed make.go, genfileembed: track genfileembed output files and delete stale ones 2014-08-16 18:19:38 -07:00
fs fs: handle directory permanode titles 2014-07-15 08:41:05 +02:00
gc New 'gc' package, implementing a generic garbage collector. 2014-01-11 21:41:53 -08:00
geocode search: Self-documenting atoms 2014-05-15 00:42:32 +02:00
googlestorage googlestorage: set the Content-Type for objects. 2014-08-15 22:27:15 -07:00
httputil httputil: simplify the SystemCARootsAvailable function 2014-08-15 17:43:22 -07:00
images images/fastjpeg: reset checkAvailability in tests. 2014-08-14 15:17:18 -07:00
importer Aggregate all errors with their URLS in status.json in one place. 2014-08-29 16:03:44 -07:00
index Merge "index: actually reindex when out of order" 2014-08-14 20:00:00 +00:00
jsonconfig jsonconfig: skip over nil values when expanding 2014-08-08 06:47:10 -07:00
jsonsign signhandler: minor style cleanups made while debugging 2014-08-17 13:56:34 -07:00
kvutil kvutil: add VerifyDb*, use kvutil in sorted 2014-03-20 01:21:27 +01:00
leak leak: fix racy test 2014-02-25 16:06:56 -08:00
legal legal: package for compiled-in licenses 2014-07-10 23:01:54 +02:00
lru More docs. Every package is documented now. 2013-07-07 21:12:30 -07:00
magic pkg/tests: Warn about deprecation of asserts.* functions in pkg description. 2014-02-19 10:42:29 +03:00
media Fixed some formatting functions that were called with invalid number/type of arguments. 2014-07-01 12:48:33 +02:00
misc Fixed some formatting functions that were called with invalid number/type of arguments. 2014-07-01 12:48:33 +02:00
netutil netutil: add HostPort, serverinit: return app baseURL 2014-08-01 00:01:27 +02:00
osutil Let Camlistore build on Solaris 2014-08-28 14:26:11 +02:00
pools Add new pools package, to aggregate common sync.Pool types. 2014-08-25 21:17:50 -07:00
publish server/publish.go: use go html template for publishing 2013-11-19 17:50:26 +01:00
readerutil gofmt 2014-03-20 12:29:45 -07:00
rollsum rollsum: don't benchmark the Rand function 2014-08-22 15:50:25 -07:00
schema blobpacked: first cut at packing, creating zip files with contiguous chunks. 2014-08-30 00:09:10 -07:00
search Send system status JSON on websockets upon connect and when it changes. 2014-08-29 14:12:02 -07:00
server Aggregate all errors with their URLS in status.json in one place. 2014-08-29 16:03:44 -07:00
serverinit On GCE, put the UI's thumbnail metadata cache on MySQL too. 2014-08-23 19:55:04 -07:00
singleflight Fixed some formatting functions that were called with invalid number/type of arguments. 2014-07-01 12:48:33 +02:00
sorted mysql: create database now distinct from create tables 2014-08-08 20:06:02 +02:00
strutil Change strutil.StringFromBytes to depend on Go 1.3. 2014-08-14 12:59:54 -07:00
syncutil Added syncutil.Once 2014-01-25 12:04:47 -08:00
test Merge branch 'master' of https://camlistore.googlesource.com/camlistore 2014-08-25 16:50:42 -07:00
throttle throttle: actually compile. 2014-01-08 19:55:24 -08:00
types Aggregate all errors with their URLS in status.json in one place. 2014-08-29 16:03:44 -07:00
webserver webserver: use wkfs for tls cert/key 2014-08-08 10:58:56 -07:00
wkfs wkfs/gcs: support for writing files 2014-08-08 11:03:27 -07:00
.gitignore Update from r60 to [almost] Go 1. 2012-02-18 21:53:06 -08:00