17 lines
366 B
ReStructuredText
17 lines
366 B
ReStructuredText
|
:orphan:
|
||
|
|
|
||
|
|
.. _gpu_advanced:
|
||
|
|
|
||
|
|
GPU training (Advanced)
|
||
|
|
=======================
|
||
|
|
**Audience:** Users looking to scale massive models (ie: 1 Trillion parameters).
|
||
|
|
|
||
|
|
----
|
||
|
|
|
||
|
|
For experts pushing the state-of-the-art in model development, Lightning offers various techniques to enable Trillion+ parameter-scale models.
|
||
|
|
|
||
|
|
----
|
||
|
|
|
||
|
|
..
|
||
|
|
.. include:: ../advanced/model_parallel.rst
|