Christoph Purschke a7ee4b6f17 new tests & tokenization fixes (#4734) ... - added some tests for tokenization issues - fixed some issues with tokenization of words with hyphen infix - rewrote the "tokenizer_exceptions.py" file (stemming from the German version)		2019-12-01 23:08:21 +01:00
..
__init__.py	…
test_exceptions.py	new tests & tokenization fixes (#4734)	2019-12-01 23:08:21 +01:00
test_prefix_suffix_infix.py	Tidy up and auto-format	2019-10-18 11:27:38 +02:00
test_text.py	new tests & tokenization fixes (#4734)	2019-12-01 23:08:21 +01:00