ines 9d6c8eaa49 Update base norm exceptions with more unicode characters ... e.g. unicode variations of punctuation used in Chinese		2017-10-14 14:58:52 +02:00
..
bn	Don't make copies of language data components	2017-10-11 15:34:55 +02:00
da	Don't make copies of language data components	2017-10-11 15:34:55 +02:00
de	Don't make copies of language data components	2017-10-11 15:34:55 +02:00
en	Port over changes from #1287	2017-10-14 13:16:21 +02:00
es	Don't make copies of language data components	2017-10-11 15:34:55 +02:00
fi	Don't make copies of language data components	2017-10-11 15:34:55 +02:00
fr	Don't make copies of language data components	2017-10-11 15:34:55 +02:00
he	Don't make copies of language data components	2017-10-11 15:34:55 +02:00
hu	Don't make copies of language data components	2017-10-11 15:34:55 +02:00
id	Don't make copies of language data components	2017-10-11 15:34:55 +02:00
it	Don't make copies of language data components	2017-10-11 15:34:55 +02:00
ja	Port over changes from #1157	2017-10-14 13:11:39 +02:00
nb	Don't make copies of language data components	2017-10-11 15:34:55 +02:00
nl	Don't make copies of language data components	2017-10-11 15:34:55 +02:00
pl	Don't make copies of language data components	2017-10-11 15:34:55 +02:00
pt	Don't make copies of language data components	2017-10-11 15:34:55 +02:00
sv	Don't make copies of language data components	2017-10-11 15:34:55 +02:00
th	Don't make copies of language data components	2017-10-11 15:34:55 +02:00
xx	Tidy up language data	2017-10-11 02:22:49 +02:00
zh	Port over change from #1323 and tidy up	2017-09-14 19:23:13 +02:00
__init__.py	…
char_classes.py	Port over changes from #1333 and add comments	2017-10-14 12:52:59 +02:00
entity_rules.py	…
lex_attrs.py	Set prefix length back to 1	2017-10-10 19:32:54 +02:00
norm_exceptions.py	Update base norm exceptions with more unicode characters	2017-10-14 14:58:52 +02:00
punctuation.py	Add symbols class to punctuation rules to handle emoji (see #1088)	2017-05-27 17:57:10 +02:00
tag_map.py	…
tokenizer_exceptions.py	Port over URL pattern changes from #1411	2017-10-14 12:58:07 +02:00