Rooba
/
spaCy
mirror of https://github.com/explosion/spaCy.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
spaCy/website/docs/usage/_benchmarks-models.md

46 lines
2.8 KiB
Markdown
Raw Normal View History

Update docs [ci skip]
2020-09-12 15:05:10 +00:00
import { Help } from 'components/typography'; import Link from 'components/link'
Update docs [ci skip]
2020-10-14 12:58:45 +00:00
<!-- TODO: update speed and v2 NER numbers -->
Update docs [ci skip]
2020-09-12 15:05:10 +00:00
<figure>
Update docs and resolve todos [ci skip]
2020-09-24 11:41:25 +00:00
| Pipeline | Parser | Tagger | NER | WPS<br />CPU <Help>words per second on CPU, higher is better</Help> | WPS<br/>GPU <Help>words per second on GPU, higher is better</Help> |
Update docs [ci skip]
2020-09-23 20:02:31 +00:00
| ---------------------------------------------------------- | -----: | -----: | ---: | ------------------------------------------------------------------: | -----------------------------------------------------------------: |
Update docs [ci skip]
2020-10-14 12:58:45 +00:00
| [`en_core_web_trf`](/models/en#en_core_web_trf) (spaCy v3) | 95.5 | 98.3 | 89.7 | 1k | 8k |
Update docs [ci skip]
2020-10-08 14:23:12 +00:00
| [`en_core_web_lg`](/models/en#en_core_web_lg) (spaCy v3) | 92.2 | 97.4 | 85.8 | 7k | |
Update docs [ci skip]
2020-10-14 12:58:45 +00:00
| `en_core_web_lg` (spaCy v2) | 91.9 | 97.2 | | 10k | |
Update docs [ci skip]
2020-09-12 15:05:10 +00:00
<figcaption class="caption">
Update docs [ci skip]
2020-09-24 08:13:41 +00:00
**Full pipeline accuracy and speed** on the
[OntoNotes 5.0](https://catalog.ldc.upenn.edu/LDC2013T19) corpus.
Update docs [ci skip]
2020-09-12 15:05:10 +00:00
</figcaption>
</figure>
<figure>
Update docs and resolve todos [ci skip]
2020-09-24 11:41:25 +00:00
| Named Entity Recognition System | OntoNotes | CoNLL '03 |
Update docs [ci skip]
2020-09-24 10:37:21 +00:00
| ------------------------------------------------------------------------------ | --------: | --------: |
Update docs [ci skip]
2020-10-14 12:58:45 +00:00
| spaCy RoBERTa (2020) | 89.7 | 91.6 |
| spaCy CNN (2020) | 84.5 | |
| spaCy CNN (2017) | | |
Update docs [ci skip]
2020-09-24 10:37:21 +00:00
| [Stanza](https://stanfordnlp.github.io/stanza/) (StanfordNLP)<sup>1</sup> | 88.8 | 92.1 |
| <Link to="https://github.com/flairNLP/flair" hideIcon>Flair</Link><sup>2</sup> | 89.7 | 93.1 |
| BERT Base<sup>3</sup> | - | 92.4 |
Update docs [ci skip]
2020-09-12 15:05:10 +00:00
<figcaption class="caption">
Update docs [ci skip]
2020-09-23 20:02:31 +00:00
**Named entity recognition accuracy** on the
[OntoNotes 5.0](https://catalog.ldc.upenn.edu/LDC2013T19) and
[CoNLL-2003](https://www.aclweb.org/anthology/W03-0419.pdf) corpora. See
[NLP-progress](http://nlpprogress.com/english/named_entity_recognition.html) for
more results. **1. ** [Qi et al. (2020)](https://arxiv.org/pdf/2003.07082.pdf).
Update docs [ci skip]
2020-09-24 10:37:21 +00:00
**2. ** [Akbik et al. (2018)](https://www.aclweb.org/anthology/C18-1139/). **3.
** [Devlin et al. (2018)](https://arxiv.org/abs/1810.04805).
Update docs [ci skip]
2020-09-12 15:05:10 +00:00
</figcaption>
</figure>