Rooba
/
lightning
mirror of https://github.com/Lightning-AI/lightning.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Remove RC candidate install (#8322)

This commit is contained in:
Sean Naren 2021-07-07 13:21:12 +01:00 committed by GitHub
parent 9877265887
commit fc12fe721f
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 0 additions and 7 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
docs/source/advanced/advanced_gpu.rst
View File

@ -331,13 +331,6 @@ DeepSpeed ZeRO Stage 3 shards the optimizer states, gradients and the model para
We've ran benchmarks for all these features and given a simple example of how all these features work in Lightning, which you can see at `minGPT <https://github.com/SeanNaren/minGPT/tree/stage3>`_. We've ran benchmarks for all these features and given a simple example of how all these features work in Lightning, which you can see at `minGPT <https://github.com/SeanNaren/minGPT/tree/stage3>`_.
Currently this functionality is only available on master and will be included in our next 1.3 Release Candidate and 1.3 release.
.. code-block:: python
pip install https://github.com/PyTorchLightning/pytorch-lightning/archive/refs/heads/master.zip
To reach the highest memory efficiency or model size, you must: To reach the highest memory efficiency or model size, you must:
1. Use the DeepSpeed Plugin with the stage 3 parameter 1. Use the DeepSpeed Plugin with the stage 3 parameter