Rooba
/
spaCy
mirror of https://github.com/explosion/spaCy.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
spaCy/spacy/training/__init__.py

19 lines
760 B
Python
Raw Normal View History

Replace pytokenizations with internal alignment (#6293) * Replace pytokenizations with internal alignment Replace pytokenizations with internal alignment algorithm that is restricted to only allow differences in whitespace and capitalization. * Rename `spacy.training.align` to `spacy.training.alignment` to contain the `Alignment` dataclass * Implement `get_alignments` in `spacy.training.align` * Refactor trailing whitespace handling * Remove unnecessary exception for empty docs Allow a non-empty whitespace-only doc to be aligned with an empty doc * Remove empty docs exceptions completely
2020-11-03 15:24:38 +00:00
from .alignment import Alignment # noqa: F401
Support data augmentation in Corpus (#6155) * Support data augmentation in Corpus * Note initial docs for data augmentation * Add augmenter to quickstart * Fix flake8 * Format * Fix test * Update spacy/tests/training/test_training.py * Improve data augmentation arguments * Update templates * Move randomization out into caller * Refactor * Update spacy/training/augment.py * Update spacy/tests/training/test_training.py * Fix augment * Fix test
2020-09-28 01:03:27 +00:00
from .augment import dont_augment, orth_variants_augmenter # noqa: F401
Tidy up and auto-format
2020-08-05 14:00:59 +00:00
from .batchers import minibatch_by_padded_size, minibatch_by_words # noqa: F401
Add callback to copy vocab/tokenizer from model (#7750) * Add callback to copy vocab/tokenizer from model Add callback `spacy.copy_from_base_model.v1` to copy the tokenizer settings and/or vocab (including vectors) from a base model. * Move spacy.copy_from_base_model.v1 to spacy.training.callbacks * Add documentation * Modify to specify model as tokenizer and vocab params
2021-04-22 10:36:50 +00:00
from .callbacks import create_copy_from_base_model # noqa: F401
Configure isort to use the Black profile, recursively isort the `spacy` module (#12721) * Use isort with Black profile * isort all the things * Fix import cycles as a result of import sorting * Add DOCBIN_ALL_ATTRS type definition * Add isort to requirements * Remove isort from build dependencies check * Typo
2023-06-14 15:48:41 +00:00
from .corpus import Corpus, JsonlCorpus, PlainTextCorpus # noqa: F401
from .example import Example, validate_examples, validate_get_examples # noqa: F401
from .gold_io import docs_to_json, read_json_file # noqa: F401
from .iob_utils import ( # noqa: F401
biluo_tags_to_offsets,
biluo_tags_to_spans,
biluo_to_iob,
iob_to_biluo,
offsets_to_biluo_tags,
remove_bilu_prefix,
split_bilu_label,
tags_to_entities,
)
from .loggers import console_logger # noqa: F401