Rooba
/
lightning
mirror of https://github.com/Lightning-AI/lightning.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Explicitly point out where should we set the random seed (#3839) 

* Explicitly point out where should we set the random seed

* Update docs/source/multi_gpu.rst

Co-authored-by: Jeff Yang <ydcjeff@outlook.com>

Co-authored-by: Qinru Li <q4li@eng.ucsd.edu>
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Jeff Yang <ydcjeff@outlook.com>
This commit is contained in:
Daniel Li 2020-10-04 04:30:45 -07:00 committed by GitHub
parent 1f8ff7c48c
commit a3503ce3fd
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/multi_gpu.rst
View File

@ -260,7 +260,7 @@ Distributed Data Parallel
3. Each process inits the model.
.. note:: Make sure to set the random seed so that each model initializes with the same weights.
.. note:: Make sure to set the random seed before the instantiation of a ``Trainer()`` so that each model initializes with the same weights.
4. Each process performs a full forward and backward pass in parallel.