* Add hyphenation rule to infix.txt for tokenizer

This commit is contained in:
Matthew Honnibal 2015-06-06 05:56:00 +02:00
parent 4073533e28
commit 45ec92243a
1 changed files with 1 additions and 0 deletions

View File

@ -1 +1,2 @@
(?<=[a-z])\.(?=[A-Z]) (?<=[a-z])\.(?=[A-Z])
(?<=[a-zA-Z])-(?=[a-zA-z])