3 Commits

Author	SHA1	Message	Date
Matthew Honnibal	81d878beb2	* Upd tests	2014-12-30 21:34:09 +11:00
Matthew Honnibal	73f200436f	* Tests passing except for morphology/lemmatization stuff	2014-12-23 11:40:32 +11:00
Matthew Honnibal	99f5e59286	* Have tokenizer emit tokens for whitespace other than single spaces	2014-10-14 20:25:57 +11:00