Commit Graph

6736 Commits

Author SHA1 Message Date
Brad Fitzpatrick 01419ae02d pkg/test/integration: skip non-UTF-8 test on filesystems requiring UTF-8
Fixes #1025

Change-Id: Ia6212140197958ef6660bf3ced6a9bb427ae5aef
2018-01-08 06:47:16 -08:00
Brad Fitzpatrick 962dfe5b23 Merge "website: fix docHandler test when run via devcam" 2018-01-08 14:33:58 +00:00
Paul Lindner b3e91ad9f0 website: fix docHandler test when run via devcam
The test added for proper markdown title generation
do not work when run via devcam.  This is caused by
depending on doc/uses.md as the input testdata.
devcam does not copy markdown files into the target tmp
directory so this test fails when run that way.

Solution is create a markdown file in a testdata directory.
These are copied to the target tmp directory and the test
succeeds.

Change-Id: Iae654dca2374b925e6c895a71d4d93b12ccc188b
2018-01-08 06:08:19 -08:00
Paul Lindner 266447a7e7 dev/devcam: import vendor files as-is, do not require gofmt
Change-Id: If3afd3769dbad0a20bd8ff2f2bbb5eb9f89f345a
2018-01-07 19:14:08 -08:00
Paul Lindner 683d81f2df vendor: prune vendor directories that will be removed by dep
- bazil.org/fuse
- github.com/cznic/mathutil/mersenne
- github.com/golang/glog
- myitcv.io/gogenerate/_scripts
- google.golang.org/grpc/Documentation
- myitcv.io/react/testutils
- github.com/cznic/fileutil/{falloc,hdb,storage}

Addresses #889

Change-Id: Icde028ba4d433a7311132c1c86837e6cb4217fc3
2018-01-08 01:13:03 +00:00
Brad Fitzpatrick 7a54a2c07a Merge "website: remove old TODO on removing Installation header from cmd/*" 2018-01-07 16:24:04 +00:00
Adam Shannon b8dbd56b35 website: remove old TODO on removing Installation header from cmd/*
Change-Id: I4f77d9271c17442b69e3f9ebbcc39acc6361e221
2018-01-07 10:23:24 -06:00
Adam Shannon c8ec846787 website: rename perkeep irc room
Updates #981

Change-Id: I7c30a3d1271e608422dc04c5e1ac703bcfc16c67
2018-01-07 10:09:49 -06:00
Paul Lindner 3c9440708e website: generate proper titles for markdown files
It appears that markdown generation added class ids at some point.
This means that all pages on perkeep.org have the title "Perkeep"

Also added a test for this case.

This issue was flagged by the Google Webmaster Tools.

Change-Id: I7ddab56e03a506b84aab415d94856b8f1c126250
2018-01-06 15:46:59 -08:00
Brad Fitzpatrick 9265c980de all: change github.com/camlistore/camlistore to github.com/perkeep/perkeep
Change-Id: I0d612bf450e9e8d9ce0767c5a0cb0c44c0d8704f
2018-01-05 19:49:59 -08:00
Will Norris c57fd7ae93 Merge changes I15575227,I07f817ed
* changes:
  website: allow serving godoc for any valid package
  website: derive godoc package domain from serving dir
2018-01-06 01:03:02 +00:00
Will Norris 9787462d49 website: allow serving godoc for any valid package
Fixes #1010

Change-Id: I15575227eb881a0c83ab2e60af0d344fedaf1850
2018-01-06 00:54:22 +00:00
Will Norris 101ce48bdc website: derive godoc package domain from serving dir
this is a straight revert of 02938281 plus the additional logic to
derive the domain name from the serving directory. This allows package
docs to also be served from localhost during development.

Updates #1010

Change-Id: I07f817edb0b83b03e363373945d143ed3cb82fbf
2018-01-05 23:57:46 +00:00
Mathieu Lonjaret a2135d90a6 Merge "pkg/serverinit: keep DBNames compatibility for existing GCE instances" 2018-01-05 20:54:56 +00:00
mpl 7ea897cd84 pkg/serverinit: keep DBNames compatibility for existing GCE instances
followup of 7eda9fd502

We want existing Perkeep instances on GCE to be able to keep on running
with their DBNames-style existing databases.

To that end, we introduce the "perkeep-config-version" metadata key,
which will be set by the launcher from now on.

When perkeep configuration starts, it can lookup that key. If it is set,
it means we're in a newly created instance, and we don't need to care
about DBNames compatibility. If not, we modify the low level
configuration on the fly, so that it keeps on using the old DBNames
values that were set for a GCE instance.

Change-Id: I611811fdb9c68777c2ba799e9047d00ec0bae040
2018-01-05 21:52:42 +01:00
Mathieu Lonjaret 4f0cce2a00 Merge "make.go: mirror internal for website and camnetdns too" 2018-01-05 19:50:43 +00:00
Mathieu Lonjaret 0243f7636f Merge "misc/docker/dock.go: update to build from perkeep.org" 2018-01-05 19:50:23 +00:00
Paul Lindner 1c63050b59 bin: add bin/pk* to list of ignored files, sort entries
Change-Id: If4d9ecbcef11a7883c7c60981cdc4eba6268f441
2018-01-05 19:39:20 +00:00
mpl 4ca45d928b misc/docker/dock.go: update to build from perkeep.org
Change-Id: Ie2a995c603a7714979d9967964e6b4c83f4886d4
2018-01-05 20:34:17 +01:00
mpl 478d85457f make.go: mirror internal for website and camnetdns too
Change-Id: I118244058d0da2cd2b7e56d8e226b178c197c2f8
2018-01-05 20:14:34 +01:00
Mathieu Lonjaret fafbd14415 Merge "vendor/github.com/rwcarlsen/goexif: update and remove local modifications" 2018-01-05 15:36:18 +00:00
Paul Lindner 7ed0b7ec5c vendor/github.com/rwcarlsen/goexif: update and remove local modifications
Remove goexif local changes (a TODO, README and gofmt)
Update to rev: 709fab3d192d7c62f86043caff1e7e3fb0f42bd8
Use dep to prune unused files

Change-Id: Icce8885917b798b25eaeed4c98ff393ce0db66b8
2018-01-03 23:27:13 -08:00
Brad Fitzpatrick ed07089172 Merge "cmdmain: sort Modes and Examples" 2018-01-04 04:59:27 +00:00
Adam Shannon 02fc19475c cmdmain: sort Modes and Examples
Fixes #1002

Change-Id: Icd8d2727dbdd73e85a05450278eb9f25f4a49121
2018-01-03 21:55:01 -06:00
mpl 7eda9fd502 pkg/serverinit: remove DBNames and provide consistent default instead
DBNames is supposed to provide configuration for the various databases
names. However,
1) I contend that nobody needs or wants to configure them as long as we
provide sane defaults.
2) it seems the only obvious user we have for this is to set up some of
the names on GCE.
3) having another external source for names complicates the code
further, especially when we already have the distinction between
database names for DBMS and file names for file-based databases.
4) writing a correct documentation for it is awkward.

Therefore, in this CL, I propose that we remove DBNames. Instead,
genconfig.go now sets some consistent default names for the various
queues and indexes set up on a DBMS (MySQL, PostGres, Mongo). To that
end, we introduce the new, but optional, DBUnique configuration
parameter, that is used as a part of all the database names, in order to
be able to run several Perkeep instances on the same DBMS, without name
conflicts.

In addition, the queue for the bs->index synchandler is now set up on
the same DBMS that is already in use for the index itself, instead of
using a file-base database.
And i think we could proceed likewise for the other queues.

Fixes #951

Change-Id: Ib6a638f088a563d881e3957e4042e932382b44f4
2018-01-04 04:01:34 +01:00
Brad Fitzpatrick 57648c6b83 all: update copyright holder from Google Inc to The Perkeep Authors
The AUTHORS file is the list of copyright holders.
2018-01-03 16:52:49 -08:00
Paul Lindner d5b55e51a8 Merge "all: update mongo to latest version" 2018-01-03 21:04:12 +00:00
Brad Fitzpatrick 15012bc37a Merge "vendor/github.com/mattn/go-sqlite3: remove local customizations for sqlite3" 2018-01-03 20:14:21 +00:00
Paul Lindner 364e125929 vendor/github.com/mattn/go-sqlite3: remove local customizations for sqlite3
This pulls in a clean upstream version of go-sqlite3 at revision
919cf4144a09abfd877330bbe735f3a243a84537 using the dep tool.

The current method of using the -sqlite flag in make.go appears to
enable conditional builds with/without sqlite3, obsoleting the
need for local modifications.

We also manually remove sqlite

Addresses: #889

Change-Id: I4d2c107cd12608ac0bcb7c0607629ecb2d7f880f
2018-01-03 12:10:43 -08:00
Paul Lindner 49b1af4a1b all: update mongo to latest version
The mongo integration was using a very old package.  It's using
a new namespace now.  Upgrade and adjust all call points

Removes labix.org/v2/mgo

Introduces gopkg.in/mgo.v2 from branch v2 with revision
  3f83fa5005286a7fe593b055f0d7771a7dce4655

Change-Id: I2784fca941998460f58e0ac8d3d51286401590b5
2018-01-03 10:49:07 -08:00
mpl b5b668b661 pkg/client: force nil transport when on the browser
Calls to net.Dial* are prohibited with GopherJS. This can happen if the
client's transport is set by the user.

This change forces transportForConfig to return nil when the client
package is compiled with gopherjs, in order to make sure that a call to
newClient returns a client with a nil transport.

Change-Id: I577457bd7d924d31710168086dc2b394df3d1ae0
2018-01-03 16:38:47 +01:00
Brad Fitzpatrick eb0024f164 Merge "pkg/index: ignore unset msdos time when possible" 2018-01-03 06:18:09 +00:00
Brad Fitzpatrick 8a0a3e8649 Rename camdeploy to pk-deploy.
Updates #981

Change-Id: I4c6c16135f3239bb4b8d2d187e9537a4abf7a3fe
2018-01-02 22:10:37 -08:00
Brad Fitzpatrick c3d05cdce9 Move more packages out of pkg/ and into internal/
Moved hashutil, httputil, osutil, netutil,
images, media, magic, video, and rollsum.
2018-01-02 21:03:30 -08:00
Brad Fitzpatrick ac44e8ef57 doc: add missing jsondoc.go from e093206a2a
Change-Id: I9f91a330f854e47888bd5f6286e8da4fecde262f
2018-01-02 19:29:44 -08:00
Brad Fitzpatrick 80b44a0a00 Merge "doc: add jsonsign protocol docs" 2018-01-03 03:26:23 +00:00
Brad Fitzpatrick e093206a2a doc: add jsonsign protocol docs
And misc tweaks.

Updates #1009
Updates #1007

Change-Id: Ibb750c8cc69763c0a59b72f42bc53f68e3ee120f
2018-01-02 19:24:58 -08:00
Brad Fitzpatrick 1954cdef18 Merge "website: ~/.gitcookies holds Gerrit auth info" 2018-01-03 02:24:49 +00:00
Adam Shannon 7318189e81 website: ~/.gitcookies holds Gerrit auth info
Change-Id: I63cd1ca0603c72ef424a05dd85dcf6166de4e74c
2018-01-02 20:14:06 -06:00
Adam Shannon 37ac053294 website: add /doc/search-ui under "For Users"
Change-Id: I18a1bd2d8866879096b23eaebe460542bc68776b
2018-01-02 19:55:35 -06:00
Brad Fitzpatrick cee73a1da7 website: Perkeep updates
Fix case of Twitter handle PerkeepOrg (no capital K).

Add a /keepy page about Keepy the Perkeep parakeet.

Embolden anchor text so it stands out from regular text.

Embed tweets on main page.

Change-Id: I07bdaab3c1bb480eab849fbdb8a516b772905e38
2018-01-02 16:36:48 -08:00
Brad Fitzpatrick 9427d6eef4 website: update logo/mascot/colors
This is Keepy the Perkeep Parakeet, from Ashley McNamara, @ashleymcnamara.

The CSS & HTML changes are my fault. We can revise later.

For the rename, issue #981

Change-Id: Ifaf4e4d9a92b5d6d79473f0e9aec9db8f51aa7b1
2018-01-02 12:46:51 -08:00
Josh Bleecher Snyder 7ac7a50f61 rollsum: help the compiler
With Go master (roughly Go 1.10):

name       old time/op   new time/op   delta
Rollsum-8   39.0ms ± 2%   22.2ms ± 2%  -42.93%  (p=0.008 n=5+5)

name       old speed     new speed     delta
Rollsum-8  135MB/s ± 2%  236MB/s ± 2%  +75.23%  (p=0.008 n=5+5)

Change-Id: Ic933f8ee5f1ffaada8e37c8ac19edb7d6c0fc57d
2018-01-02 12:24:53 -08:00
Paul Lindner a0943ac69b vendor/golang.org/x/net: update to rev d866cfc389cec985d6fda2859936a575a55a3ab6
Using dep vendor in latest golang.org/x/net package.

Change-Id: I927467478a20316cbb3175b0da0c8b1abdcfedfa
2018-01-02 09:47:01 -08:00
Mathieu Lonjaret ef4af89ea4 Merge "server/camlistored: add "Select all" button to web UI" 2018-01-02 16:40:02 +00:00
mpl dd55b87a2a travis CI: import name is now perkeep.org
Change-Id: Ib1ae2ebecfda3528ddb986f23b87d5237e2c9d67
2018-01-02 17:11:26 +01:00
Mathieu Lonjaret e2deb945a9 Merge "vendor/golang.org/x/text: include more x/text packages" 2018-01-02 16:05:49 +00:00
Mathieu Lonjaret ee13a37c3e Merge "vendor/golang.org/x/image: update to rev 12117c17ca67ffa1ce22e9409f3b0b0a93ac08c7" 2018-01-02 15:59:36 +00:00
Mathieu Lonjaret 5087c6efd9 Merge "doc: add libchop and upspin to related projects" 2018-01-02 15:02:09 +00:00
Paul Lindner 04c6794e12 vendor/golang.org/x/text: include more x/text packages
Various text packages were previously imported from
rev 88f656faf3f37f690df1a32515b479415e1a6769

This includes the dep included/pruned version of x/text so that
we can update golang.org/x/net to the latest revision.

Addresses: #889

Change-Id: I54e8b02aef70d16519801b8fafd6bfd5548af4cd
2018-01-02 06:37:24 -08:00