Matthew Honnibal 598dbf1ce0 Fix character-based tokenization for Japanese		2018-08-27 01:51:38 +02:00
..
__init__.py	Fix character-based tokenization for Japanese	2018-08-27 01:51:38 +02:00
examples.py	Add example sentences for Japanese and Chinese (see #1107)	2017-10-24 13:02:24 +02:00
stop_words.py	Add Japanese stop words. (#2549)	2018-07-17 10:12:48 +02:00
tag_map.py	Port Japanese mecab tokenizer from v1 (#2036)	2018-05-03 18:38:26 +02:00