spaCy/spacy/tests/doc/test_add_entities.py

# coding: utf-8
from __future__ import unicode_literals

from ...pipeline import EntityRecognizer
from ..util import get_doc

import pytest


def test_doc_add_entities_set_ents_iob(en_vocab):
    text = ["This", "is", "a", "lion"]
    doc = get_doc(en_vocab, text)
    ner = EntityRecognizer(en_vocab)
    ner.begin_training([])
    ner(doc)

    assert len(list(doc.ents)) == 0
    assert [w.ent_iob_ for w in doc] == (['O'] * len(doc))

    doc.ents = [(doc.vocab.strings['ANIMAL'], 3, 4)]
    assert [w.ent_iob_ for w in doc] == ['', '', '', 'B']

    doc.ents = [(doc.vocab.strings['WORD'], 0, 2)]
    assert [w.ent_iob_ for w in doc] == ['B', 'I', '', '']
Modernise test for adding entities 2017-01-11 17:54:24 +00:00			`# coding: utf-8`
Test Issue #461: ent_iob tag incorrect after setting entities. 2016-10-23 13:50:04 +00:00			`from __future__ import unicode_literals`

Modernise test for adding entities 2017-01-11 17:54:24 +00:00			`from ...pipeline import EntityRecognizer`
			`from ..util import get_doc`
Test Issue #461: ent_iob tag incorrect after setting entities. 2016-10-23 13:50:04 +00:00
Modernise test for adding entities 2017-01-11 17:54:24 +00:00			`import pytest`
Test Issue #461: ent_iob tag incorrect after setting entities. 2016-10-23 13:50:04 +00:00

Use consistent test names 2017-01-11 18:00:52 +00:00			`def test_doc_add_entities_set_ents_iob(en_vocab):`
Modernise test for adding entities 2017-01-11 17:54:24 +00:00			`text = ["This", "is", "a", "lion"]`
			`doc = get_doc(en_vocab, text)`
Fix names of pipeline components NeuralDependencyParser --> DependencyParser NeuralEntityRecognizer --> EntityRecognizer TokenVectorEncoder --> Tensorizer NeuralLabeller --> MultitaskObjective 2017-10-26 10:38:23 +00:00			`ner = EntityRecognizer(en_vocab)`
			`ner.begin_training([])`
Modernise test for adding entities 2017-01-11 17:54:24 +00:00			`ner(doc)`
Test Issue #461: ent_iob tag incorrect after setting entities. 2016-10-23 13:50:04 +00:00
			`assert len(list(doc.ents)) == 0`
Modernise test for adding entities 2017-01-11 17:54:24 +00:00			`assert [w.ent_iob_ for w in doc] == (['O'] * len(doc))`

Test Issue #461: ent_iob tag incorrect after setting entities. 2016-10-23 13:50:04 +00:00			`doc.ents = [(doc.vocab.strings['ANIMAL'], 3, 4)]`
Update doc.ents test 2018-03-26 05:14:35 +00:00			`assert [w.ent_iob_ for w in doc] == ['', '', '', 'B']`
Modernise test for adding entities 2017-01-11 17:54:24 +00:00
Test Issue #461: ent_iob tag incorrect after setting entities. 2016-10-23 13:50:04 +00:00			`doc.ents = [(doc.vocab.strings['WORD'], 0, 2)]`
Update doc.ents test 2018-03-26 05:14:35 +00:00			`assert [w.ent_iob_ for w in doc] == ['B', 'I', '', '']`