Rooba
/
spaCy
mirror of https://github.com/explosion/spaCy.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Auto-format [ci skip]

This commit is contained in:
Ines Montani 2019-11-20 13:14:58 +01:00
parent 2e7c896fe5
commit 235fe6fe3b
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
website/docs/usage/linguistic-features.md
View File

@ -797,12 +797,12 @@ The algorithm can be summarized as follows:
A working implementation of the pseudo-code above is available for debugging as
[`nlp.tokenizer.explain(text)`](/api/tokenizer#explain). It returns a list of
tuples showing which tokenizer rule or pattern was matched for each token. The
tokens produced are identical to `nlp.tokenizer()` except for whitespace
tokens:
tokens produced are identical to `nlp.tokenizer()` except for whitespace tokens:
```python
### {executable="true"}
from spacy.lang.en import English
nlp = English()
text = '''"Let's go!"'''
doc = nlp(text)