Rooba
/
lightning
mirror of https://github.com/Lightning-AI/lightning.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
lightning/docs/source-fabric/advanced/model_parallel/tp_fsdp.rst

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

6 lines
162 B
ReStructuredText
Raw Normal View History

(7/n) Support 2D Parallelism - TP Fabric Docs (#19884) Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com> Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2024-05-22 10:20:40 +00:00
##########################################
2D Parallelism (Tensor Parallelism + FSDP)
##########################################
Content will be available soon.