mirror of https://github.com/explosion/spaCy.git
a7ee4b6f17
- added some tests for tokenization issues - fixed some issues with tokenization of words with hyphen infix - rewrote the "tokenizer_exceptions.py" file (stemming from the German version) |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| examples.py | ||
| lex_attrs.py | ||
| norm_exceptions.py | ||
| punctuation.py | ||
| stop_words.py | ||
| tag_map.py | ||
| tokenizer_exceptions.py | ||