2014-09-25 16:42:20 +00:00
|
|
|
.. spaCy documentation master file, created by
|
|
|
|
sphinx-quickstart on Tue Aug 19 16:27:38 2014.
|
|
|
|
You can adapt this file completely to your liking, but it should at least
|
|
|
|
contain the root `toctree` directive.
|
|
|
|
|
|
|
|
spaCy NLP Tokenizer and Lexicon
|
|
|
|
================================
|
|
|
|
|
2014-11-04 06:01:54 +00:00
|
|
|
spaCy is a library for industrial strength NLP in Python. Its core
|
|
|
|
values are:
|
2014-11-02 13:13:19 +00:00
|
|
|
|
2014-11-04 06:01:54 +00:00
|
|
|
* **Efficiency**: You won't find faster NLP tools. For shallow analysis, it's 10x
|
|
|
|
faster than Stanford Core NLP, and over 200x faster than NLTK. Its parser is
|
|
|
|
over 100x faster than Stanford's.
|
2014-11-02 13:13:19 +00:00
|
|
|
|
2014-11-04 06:01:54 +00:00
|
|
|
* **Accuracy**: All spaCy tools are within 0.5% of the current published
|
2014-11-03 02:54:18 +00:00
|
|
|
state-of-the-art, on both news and web text. NLP moves fast, so always check
|
|
|
|
the numbers --- and don't settle for tools that aren't backed by
|
2014-11-04 06:01:54 +00:00
|
|
|
rigorous recent evaluation.
|
2014-11-03 02:54:18 +00:00
|
|
|
|
2014-11-04 06:01:54 +00:00
|
|
|
* **Minimalism**: This isn't a library that covers 43 known algorithms to do X. You
|
2014-11-03 02:54:18 +00:00
|
|
|
get 1 --- the best one --- with a simple, low-level interface. This keeps the
|
|
|
|
code-base small and concrete. Our Python APIs use lists and
|
|
|
|
dictionaries, and our C/Cython APIs use arrays and simple structs.
|
|
|
|
|
2014-11-02 13:13:19 +00:00
|
|
|
|
|
|
|
Comparison
|
|
|
|
----------
|
2014-11-04 06:01:54 +00:00
|
|
|
|
|
|
|
+----------------+-------------+--------+---------------+--------------+
|
|
|
|
| Tokenize & Tag | Speed (w/s) | Memory | % Acc. (news) | % Acc. (web) |
|
|
|
|
+----------------+-------------+--------+---------------+--------------+
|
|
|
|
| spaCy | 107,000 | 1.3gb | 96.7 | |
|
|
|
|
+----------------+-------------+--------+---------------+--------------+
|
|
|
|
| Stanford | 8,000 | 1.5gb | 96.7 | |
|
|
|
|
+----------------+-------------+--------+---------------+--------------+
|
|
|
|
| NLTK | 543 | 61mb | 94.0 | |
|
|
|
|
+----------------+-------------+--------+---------------+--------------+
|
2014-09-26 16:40:18 +00:00
|
|
|
|
|
|
|
|
2014-09-25 16:42:20 +00:00
|
|
|
.. toctree::
|
2014-10-15 10:50:34 +00:00
|
|
|
:hidden:
|
2014-09-25 16:42:20 +00:00
|
|
|
:maxdepth: 3
|
|
|
|
|
2014-10-15 10:50:34 +00:00
|
|
|
what/index.rst
|
|
|
|
why/index.rst
|
|
|
|
how/index.rst
|