18 Commits

Author	SHA1	Message	Date
Matthew Honnibal	58f75abaca	* Fix unicode error in orth	2015-01-05 05:53:08 +11:00
Matthew Honnibal	42973c4b37	* Improve efficiency of tagger, and improve morphological processing	2014-12-10 01:02:04 +11:00
Matthew Honnibal	3cab1d9a29	* Refine word_shape feature, by trimming the max sequence length	2014-11-07 04:41:29 +11:00
Matthew Honnibal	32fb50dc35	* Remove non_sparse method --- features wanting this can do it easily enough.	2014-11-03 00:15:47 +11:00
Matthew Honnibal	8335706321	* Add LIKE_URL and LIKE_NUMBER flag features	2014-11-02 13:19:23 +11:00
Matthew Honnibal	5484fbea69	* Implement is_number	2014-11-01 19:13:24 +11:00
Matthew Honnibal	f685218e21	* Add is_urlish function	2014-11-01 17:39:34 +11:00
Matthew Honnibal	13909a2e24	* Rewriting Lexeme serialization.	2014-10-29 23:19:38 +11:00
Matthew Honnibal	6fb42c4919	* Add offsets to Tokens class. Some changes to interfaces, and reorganization of spacy.Lang	2014-10-14 16:17:45 +11:00
Matthew Honnibal	59b41a9fd3	* Switch to new data model, tests passing	2014-10-10 08:11:31 +11:00
Matthew Honnibal	7c09c73a14	* Refactor to use tokens class.	2014-09-10 18:27:44 +02:00
Matthew Honnibal	cf412adba8	* Refactoring to use Tokens object	2014-09-10 18:11:13 +02:00
Matthew Honnibal	8fbe9b6f97	* Bug fixes to flag features	2014-09-01 23:41:31 +02:00
Matthew Honnibal	151aa14bba	* Add asciify string transform, and other bits.	2014-09-01 23:25:28 +02:00
Matthew Honnibal	c4ba216642	* Switch canon_case to get value, to avoid keyerror	2014-09-01 17:27:36 +02:00
Matthew Honnibal	a779275a59	* Add canon_case function	2014-08-30 20:57:43 +02:00
Matthew Honnibal	8bbfadfced	* Pass tests. Need to implement more feature functions.	2014-08-30 20:36:06 +02:00
Matthew Honnibal	3e3ff99ca0	* Add orth features	2014-08-30 19:01:00 +02:00