diff --git a/website/docs/api/tokenizer.md b/website/docs/api/tokenizer.md index 66ac315c6..5bc0df625 100644 --- a/website/docs/api/tokenizer.md +++ b/website/docs/api/tokenizer.md @@ -64,11 +64,11 @@ Tokenize a stream of texts. > pass > ``` -| Name | Type | Description | -| ------------ | ----- | -------------------------------------------------------- | -| `texts` | - | A sequence of unicode texts. | -| `batch_size` | int | The number of texts to accumulate in an internal buffer. Defaults to `1000`.| -| **YIELDS** | `Doc` | A sequence of Doc objects, in order. | +| Name | Type | Description | +| ------------ | ----- | ---------------------------------------------------------------------------- | +| `texts` | - | A sequence of unicode texts. | +| `batch_size` | int | The number of texts to accumulate in an internal buffer. Defaults to `1000`. | +| **YIELDS** | `Doc` | A sequence of Doc objects, in order. | ## Tokenizer.find_infix {#find_infix tag="method"}