Adriane Boyd b97d98783a Fix Hungarian % tokenization (#6013)		2020-09-02 13:06:16 +02:00
..
__init__.py	Simplify language data and revert detailed configs	2020-07-24 14:50:26 +02:00
examples.py	…
punctuation.py	Fix Hungarian % tokenization (#6013)	2020-09-02 13:06:16 +02:00
stop_words.py	…
tokenizer_exceptions.py	Tidy up and move noun_chunks, token_match, url_match	2020-07-22 22:18:46 +02:00