Rooba
/
spaCy
mirror of https://github.com/explosion/spaCy.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
spaCy/spacy
History
Matthew Honnibal df01a88763 Merge branch 'refactor' (and serializaton) 
Add Huffman-code serialization, and do a lot of
refactoring. Highlights include:

* Much more efficient StringStore
* Vocab maintains a by-orth mapping of Lexemes
* Avoid manually slicing Py_UNICODE buffers,
  simplifying tokenizer and vocab C APIs
* Remove various bits of dead code
* Work on removing GIL around parser
* Work on bridge to Theano

Conflicts:
	spacy/strings.pxd
	spacy/strings.pyx
	spacy/structs.pxd
 		2015-07-23 02:18:35 +02:00
..
en * Set initial freqs, to avoid missing values in serializer 2015-07-23 01:16:27 +02:00
munge * Fix head alignment in read_conll.parse, which was causing corrupt parses when strip_bad_periods=True. A similar problem may apply to other data readers. 2015-06-18 16:35:27 +02:00
serialize * Fix Packer API, so that it reads and writes bytes strings, instead of BitArray. Docs are always byte aligned anyway. 2015-07-23 01:13:02 +02:00
syntax * Update freqs for missing tags in ner, for serializer 2015-07-23 01:17:11 +02:00
tokens * Add working to/from bytes API to Doc 2015-07-23 01:14:45 +02:00
__init__.pxd * Seems to be working after refactor. Need to wire up more POS tag features, and wire up save/load of POS tags. 2014-10-24 02:23:42 +11:00
__init__.py * Basic punct tests updated and passing 2014-08-27 19:38:57 +02:00
_ml.pxd * Fix type declarations for attr_t. Remove unused id_t. 2015-07-18 22:39:57 +02:00
_ml.pyx * Remove gil from parser.call 2015-07-14 23:47:33 +02:00
_nn.py * Merge changes, and adjust Example to use memoryview 2015-06-28 11:36:11 +02:00
_nn.pyx * Merge changes, and adjust Example to use memoryview 2015-06-28 11:36:11 +02:00
_theano.pxd * Merge changes, and adjust Example to use memoryview 2015-06-28 11:36:11 +02:00
_theano.pyx * Begin reorganizing neuralnet work 2015-06-30 14:26:32 +02:00
attrs.pxd * Upd attrs id list 2015-07-16 01:26:54 +02:00
attrs.pyx * Add a blank attrs.pyx 2015-07-17 16:40:42 +02:00
cfile.pxd * Add cfile.pyx 2015-07-23 01:10:36 +02:00
cfile.pyx * Add cfile.pyx 2015-07-23 01:10:36 +02:00
gold.pxd * Have oracle functions take a struct instead of a Python object 2015-06-02 20:01:06 +02:00
gold.pyx * Fix space check in gold.pyx 2015-07-14 00:10:27 +02:00
lexeme.pxd * Fix type declarations for attr_t. Remove unused id_t. 2015-07-18 22:39:57 +02:00
lexeme.pyx * Remove has_sense method from Lexeme 2015-07-08 19:28:29 +02:00
morphology.pxd * Tmp commit. Refactoring to create a Python Lexeme class. 2015-01-12 10:26:22 +11:00
morphology.pyx * Make PyPy work 2015-01-05 17:54:38 +11:00
multi_words.py * Fix Issue #50: Python 3 compatibility of v0.80 2015-04-13 05:59:43 +02:00
orth.pxd * Make PyPy work 2015-01-05 17:54:38 +11:00
orth.pyx * Add length cap to word shape feature 2015-07-20 12:06:59 +02:00
parts_of_speech.pxd * Add SPACE part-of-speech tag, and train tagger to assign it. Also train tagger not to make whitespace an entity 2015-07-09 13:30:41 +02:00
parts_of_speech.pyx * Add SPACE part-of-speech tag, and train tagger to assign it. Also train tagger not to make whitespace an entity 2015-07-09 13:30:41 +02:00
scorer.py * Start scoring tokens 2015-06-28 06:21:38 +02:00
senses.pxd * Set up an array POS_SENSES that denotes the set of valid senses for each POS tag. This way, we can do bitwise & between a lexeme's senses and the ones available for its POS tag, to get the allowable senses for the token. 2015-07-01 20:12:13 +02:00
senses.pyx * Set up an array POS_SENSES that denotes the set of valid senses for each POS tag. This way, we can do bitwise & between a lexeme's senses and the ones available for its POS tag, to get the allowable senses for the token. 2015-07-01 20:12:13 +02:00
strings.pxd * Replace UniStr, using unicode objects instead 2015-07-22 04:52:05 +02:00
strings.pyx Merge branch 'refactor' (and serializaton) 2015-07-23 02:18:35 +02:00
structs.pxd * Remove UniStr struct 2015-07-22 13:39:17 +02:00
tokenizer.pxd * Replace UniStr, using unicode objects instead 2015-07-22 04:52:05 +02:00
tokenizer.pyx * Fix tokenizer 2015-07-22 14:10:30 +02:00
typedefs.pxd * Fix type declarations for attr_t. Remove unused id_t. 2015-07-18 22:39:57 +02:00
typedefs.pyx * Move POS tag definitions to parts_of_speech.pxd 2015-01-25 16:31:07 +11:00
util.py * Remove read_encoding_freqs from util.py 2015-07-23 01:17:32 +02:00
vocab.pxd * Add serializer property to Vocab, and lazy-load it. Add get_by_orth method. 2015-07-23 01:18:19 +02:00
vocab.pyx * Add serializer property to Vocab, and lazy-load it. Add get_by_orth method. 2015-07-23 01:18:19 +02:00