lightning/examples/pytorch
Luca Antiga 87565cbca0
FP8 + FSDP2 + torch.compile examples for PyTorch Lightning and Fabric (#20440)
* Minimal transformer examples

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add tests for compile after fsdp2/tp

* Add README's

* Add docs

* Rename folder, add cross-reference

* Fix link

* Newline after code-block directive

* Update section name

* Fix reference

* Half standalone tests batch size

* Fix integration tests

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-11-26 15:29:40 +01:00
..
basics bump python 3.9+ (#20413) 2024-11-25 09:20:17 +01:00
bug_report ruff: replace isort with ruff +TPU (#17684) 2023-09-26 11:54:55 -04:00
domain_templates bump python 3.9+ (#20413) 2024-11-25 09:20:17 +01:00
fp8_distributed_transformer FP8 + FSDP2 + torch.compile examples for PyTorch Lightning and Fabric (#20440) 2024-11-26 15:29:40 +01:00
hpu ruff: replace isort with ruff +TPU (#17684) 2023-09-26 11:54:55 -04:00
servable_module bump python 3.9+ (#20413) 2024-11-25 09:20:17 +01:00
tensor_parallel bump python 3.9+ (#20413) 2024-11-25 09:20:17 +01:00