ines
|
f08e180a47
|
Make groups non-capturing
Prevents hitting the 100 named groups limit in Python
|
2017-02-10 13:35:02 +01:00 |
ines
|
fa3b8512da
|
Use consistent imports and exports
Bundle everything in language_data to keep it consistent with other
languages and make TOKENIZER_EXCEPTIONS importable from there.
|
2017-02-10 13:34:09 +01:00 |
ines
|
21f09d10d7
|
Revert "Revert "Merge pull request #818 from raphael0202/tokenizer_exceptions""
This reverts commit f02a2f9322 .
|
2017-02-10 13:17:05 +01:00 |
ines
|
f02a2f9322
|
Revert "Merge pull request #818 from raphael0202/tokenizer_exceptions"
This reverts commit b95afdf39c , reversing
changes made to b0ccf32378 .
|
2017-02-09 17:07:21 +01:00 |
Raphaël Bournhonesque
|
5d706ab95d
|
Merge tokenizer exceptions from PR #802
|
2017-02-09 16:30:28 +01:00 |
Raphaël Bournhonesque
|
85f951ca99
|
Add tokenizer exceptions for French
|
2017-02-02 08:36:16 +01:00 |