:orphan:

.. _gpu_advanced:

GPU training (Advanced)
=======================
**Audience:** Users looking to scale massive models (ie: 1 Trillion parameters).

----

For experts pushing the state-of-the-art in model development, Lightning offers various techniques to enable Trillion+ parameter-scale models.

----

..
    .. include:: ../advanced/model_parallel.rst