From a3503ce3fd2e639c7a2f202bb13db64975378f97 Mon Sep 17 00:00:00 2001
From: Daniel Li <qinruli2@illinois.edu>
Date: Sun, 4 Oct 2020 04:30:45 -0700
Subject: [PATCH] Explicitly point out where should we set the random seed
 (#3839)

* Explicitly point out where should we set the random seed

* Update docs/source/multi_gpu.rst

Co-authored-by: Jeff Yang <ydcjeff@outlook.com>

Co-authored-by: Qinru Li <q4li@eng.ucsd.edu>
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Jeff Yang <ydcjeff@outlook.com>
---
 docs/source/multi_gpu.rst | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/docs/source/multi_gpu.rst b/docs/source/multi_gpu.rst
index e528bab3bb..1d696a7ec8 100644
--- a/docs/source/multi_gpu.rst
+++ b/docs/source/multi_gpu.rst
@@ -260,7 +260,7 @@ Distributed Data Parallel
 
 3. Each process inits the model.
 
-.. note:: Make sure to set the random seed so that each model initializes with the same weights.
+.. note:: Make sure to set the random seed before the instantiation of a ``Trainer()`` so that each model initializes with the same weights.
 
 4. Each process performs a full forward and backward pass in parallel.