lightning/docs/source-fabric/advanced
Luca Antiga 87565cbca0
FP8 + FSDP2 + torch.compile examples for PyTorch Lightning and Fabric (#20440)
* Minimal transformer examples

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add tests for compile after fsdp2/tp

* Add README's

* Add docs

* Rename folder, add cross-reference

* Fix link

* Newline after code-block directive

* Update section name

* Fix reference

* Half standalone tests batch size

* Fix integration tests

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-11-26 15:29:40 +01:00
..
model_parallel Add Studio badge to tensor parallel docs (#19913) 2024-05-28 09:04:55 -04:00
compile.rst FP8 + FSDP2 + torch.compile examples for PyTorch Lightning and Fabric (#20440) 2024-11-26 15:29:40 +01:00
distributed_communication.rst Update `all_gather` docs (#19469) 2024-02-14 19:37:50 +01:00
gradient_accumulation.rst
model_init.rst Drop PyTorch 2.0 from the test matrix (#20009) 2024-06-30 18:02:00 -04:00
multiple_setup.rst