From 320836e34652a5c10972fb09f8e341be34ee3b68 Mon Sep 17 00:00:00 2001 From: Matthew Honnibal Date: Tue, 28 Jul 2015 21:05:08 +0200 Subject: [PATCH] * Move string description further down for token, and highlght that it includes trailing whitespace --- docs/source/reference/using/token.rst | 11 ++++++----- 1 file changed, 6 insertions(+), 5 deletions(-) diff --git a/docs/source/reference/using/token.rst b/docs/source/reference/using/token.rst index eb68d263a..f32830c84 100644 --- a/docs/source/reference/using/token.rst +++ b/docs/source/reference/using/token.rst @@ -13,11 +13,6 @@ string-typed. **String Features** -:code:`string` - The form of the word as it appears in the string, include trailing - whitespace. This is useful when you need to use linguistic features to - add inline mark-up to the string. - :code:`orth` / :code:`orth_` The form of the word with no string normalization or processing, as it appears in the string, without trailing whitespace. @@ -53,6 +48,12 @@ string-typed. A length-N substring from the end of the word. Length may vary by language; currently for English n=3, i.e. suffix = word.orth\_[-3:] +:code:`string` + The form of the word as it appears in the string, **including trailing + whitespace**. This is useful when you need to use linguistic features to + add inline mark-up to the string. + + **Distributional Features** :code:`prob`