mirror of https://github.com/explosion/spaCy.git
Auto-format [ci skip]
This commit is contained in:
parent
2e7c896fe5
commit
235fe6fe3b
|
@ -797,12 +797,12 @@ The algorithm can be summarized as follows:
|
||||||
A working implementation of the pseudo-code above is available for debugging as
|
A working implementation of the pseudo-code above is available for debugging as
|
||||||
[`nlp.tokenizer.explain(text)`](/api/tokenizer#explain). It returns a list of
|
[`nlp.tokenizer.explain(text)`](/api/tokenizer#explain). It returns a list of
|
||||||
tuples showing which tokenizer rule or pattern was matched for each token. The
|
tuples showing which tokenizer rule or pattern was matched for each token. The
|
||||||
tokens produced are identical to `nlp.tokenizer()` except for whitespace
|
tokens produced are identical to `nlp.tokenizer()` except for whitespace tokens:
|
||||||
tokens:
|
|
||||||
|
|
||||||
```python
|
```python
|
||||||
### {executable="true"}
|
### {executable="true"}
|
||||||
from spacy.lang.en import English
|
from spacy.lang.en import English
|
||||||
|
|
||||||
nlp = English()
|
nlp = English()
|
||||||
text = '''"Let's go!"'''
|
text = '''"Let's go!"'''
|
||||||
doc = nlp(text)
|
doc = nlp(text)
|
||||||
|
|
Loading…
Reference in New Issue