* Move string description further down for token, and highlght that it includes trailing whitespace

This commit is contained in:
Matthew Honnibal 2015-07-28 21:05:08 +02:00
parent d17a15ae66
commit 320836e346
1 changed files with 6 additions and 5 deletions

View File

@ -13,11 +13,6 @@ string-typed.
**String Features**
:code:`string`
The form of the word as it appears in the string, include trailing
whitespace. This is useful when you need to use linguistic features to
add inline mark-up to the string.
:code:`orth` / :code:`orth_`
The form of the word with no string normalization or processing, as it
appears in the string, without trailing whitespace.
@ -53,6 +48,12 @@ string-typed.
A length-N substring from the end of the word. Length may vary by
language; currently for English n=3, i.e. suffix = word.orth\_[-3:]
:code:`string`
The form of the word as it appears in the string, **including trailing
whitespace**. This is useful when you need to use linguistic features to
add inline mark-up to the string.
**Distributional Features**
:code:`prob`