spaCy/spacy/lang/it/tokenizer_exceptions.py

6 lines
112 B
Python

from ...symbols import ORTH, LEMMA
_exc = {"po'": [{ORTH: "po'", LEMMA: "poco"}]}
TOKENIZER_EXCEPTIONS = _exc