Matthew Honnibal 7eab281194 * Fiddle with token features		2014-09-12 15:49:55 +02:00
..
__init__.py	* Basic punct tests updated and passing	2014-08-27 19:38:57 +02:00
en.pxd	* Fiddle with token features	2014-09-12 15:49:36 +02:00
en.pyx	* Fiddle with token features	2014-09-12 15:49:36 +02:00
lang.pxd	* Replace main lexicon dict with dense_hash_map. May be unsuitable, if strings need recovery.	2014-09-12 04:29:09 +02:00
lang.pyx	* Fiddle with token features	2014-09-12 15:49:55 +02:00
lexeme.pxd	* Restoring Lexeme-as-struct	2014-09-10 20:41:37 +02:00
lexeme.pyx	* Restoring Lexeme-as-struct	2014-09-10 20:41:37 +02:00
orth.py	* Refactor to use tokens class.	2014-09-10 18:27:44 +02:00
ptb3.pxd	* Adding PTB3 tokenizer back in, so can understand how much boilerplate is in the docs for multiple tokenizers	2014-08-29 02:30:27 +02:00
ptb3.pyx	* Adding PTB3 tokenizer back in, so can understand how much boilerplate is in the docs for multiple tokenizers	2014-08-29 02:30:27 +02:00
tokens.pxd	* Fiddle with token features	2014-09-12 15:49:36 +02:00
tokens.pyx	* Fiddle with token features	2014-09-12 15:49:36 +02:00
word.pxd	* Moving back to lexeme structs	2014-09-10 20:41:47 +02:00
word.pyx	* Only store LexemeC structs in the vocabulary, transforming them to Lexeme objects for output. Moving away from Lexeme objects for Tokens soon.	2014-09-11 12:28:38 +02:00