From 690bd77669a34b77cc9ad5b06b3f6f7d62e6a991 Mon Sep 17 00:00:00 2001
From: Ines Montani <ines@ines.io>
Date: Tue, 1 Sep 2020 14:04:36 +0200
Subject: [PATCH] Add todos [ci skip]

---
 website/docs/usage/embeddings-transformers.md | 7 ++++++-
 1 file changed, 6 insertions(+), 1 deletion(-)

diff --git a/website/docs/usage/embeddings-transformers.md b/website/docs/usage/embeddings-transformers.md
index aaa5fde10..7792ce124 100644
--- a/website/docs/usage/embeddings-transformers.md
+++ b/website/docs/usage/embeddings-transformers.md
@@ -578,7 +578,12 @@ def MyCustomVectors(
 
 ## Pretraining {#pretraining}
 
-<!-- TODO: write -->
+- explain general concept and idea (short!)
+- present it as a separate lightweight mechanism for pretraining the tok2vec
+  layer
+- advantages (could also be pros/cons table)
+- explain how it generates a separate file (!) and how it depends on the same
+  vectors
 
 > #### Raw text format
 >