Matthew Honnibal 5b1c651661 * Only store LexemeC structs in the vocabulary, transforming them to Lexeme objects for output. Moving away from Lexeme objects for Tokens soon.		2014-09-11 12:28:38 +02:00
..
__init__.py	* Basic punct tests updated and passing	2014-08-27 19:38:57 +02:00
en.pxd	* Refactoring to use Tokens object	2014-09-10 18:11:13 +02:00
en.pyx	* Refactor to use tokens class.	2014-09-10 18:27:44 +02:00
lang.pxd	* Refactoring to use Tokens object	2014-09-10 18:11:13 +02:00
lang.pyx	* Only store LexemeC structs in the vocabulary, transforming them to Lexeme objects for output. Moving away from Lexeme objects for Tokens soon.	2014-09-11 12:28:38 +02:00
lexeme.pxd	* Restoring Lexeme-as-struct	2014-09-10 20:41:37 +02:00
lexeme.pyx	* Restoring Lexeme-as-struct	2014-09-10 20:41:37 +02:00
orth.py	* Refactor to use tokens class.	2014-09-10 18:27:44 +02:00
ptb3.pxd	* Adding PTB3 tokenizer back in, so can understand how much boilerplate is in the docs for multiple tokenizers	2014-08-29 02:30:27 +02:00
ptb3.pyx	* Adding PTB3 tokenizer back in, so can understand how much boilerplate is in the docs for multiple tokenizers	2014-08-29 02:30:27 +02:00
tokens.pxd	* Refactoring to use Tokens object	2014-09-10 18:11:13 +02:00
tokens.pyx	* Refactoring to use Tokens object	2014-09-10 18:11:13 +02:00
word.pxd	* Moving back to lexeme structs	2014-09-10 20:41:47 +02:00
word.pyx	* Only store LexemeC structs in the vocabulary, transforming them to Lexeme objects for output. Moving away from Lexeme objects for Tokens soon.	2014-09-11 12:28:38 +02:00