From 76ac95923a7db82c222bb45f17c4316e4afc0b8f Mon Sep 17 00:00:00 2001 From: Paul O'Leary McCann Date: Tue, 27 Jul 2021 19:19:25 +0900 Subject: [PATCH 1/2] Add note to migration guide about lexeme tables (fix #7290) This just adds the resolution from #6388 to the docs. --- website/docs/usage/v3.md | 13 +++++++++++++ 1 file changed, 13 insertions(+) diff --git a/website/docs/usage/v3.md b/website/docs/usage/v3.md index 8b4d2de7c..cdf78d59e 100644 --- a/website/docs/usage/v3.md +++ b/website/docs/usage/v3.md @@ -854,6 +854,19 @@ pipeline component, the [`AttributeRuler`](/api/attributeruler). See the you have tag maps and morph rules in the v2.x format, you can load them into the attribute ruler before training using the `[initialize]` block of your config. +### Using Lexeme Tables + +To use tables like `lexeme_prob` when training a model from scratch, you need +to add an entry to the `initialize` block in your config. Here's what that +looks like for the pretrained models: + +``` +[initialize.lookups] +@misc = "spacy.LookupsDataLoader.v1" +lang = ${nlp.lang} +tables = ["lexeme_norm"] +``` + > #### What does the initialization do? > > The `[initialize]` block is used when From 8867e60fbb3fd737fc32d0b7c85374a230365e80 Mon Sep 17 00:00:00 2001 From: Paul O'Leary McCann Date: Thu, 29 Jul 2021 14:56:56 +0900 Subject: [PATCH 2/2] Update website/docs/usage/v3.md Co-authored-by: Ines Montani --- website/docs/usage/v3.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/website/docs/usage/v3.md b/website/docs/usage/v3.md index cdf78d59e..980f06172 100644 --- a/website/docs/usage/v3.md +++ b/website/docs/usage/v3.md @@ -858,9 +858,9 @@ attribute ruler before training using the `[initialize]` block of your config. To use tables like `lexeme_prob` when training a model from scratch, you need to add an entry to the `initialize` block in your config. Here's what that -looks like for the pretrained models: +looks like for the existing trained pipelines: -``` +```ini [initialize.lookups] @misc = "spacy.LookupsDataLoader.v1" lang = ${nlp.lang}