Commit Graph

5 Commits

Author SHA1 Message Date
Carlos Mocholí 93784da2c3
Fix pre-commit blacken-docs failures (#8624) 2021-07-30 12:10:15 +00:00
Sean Naren 01f594baf4
Add quick docs for deepspeed infinity (#8323) 2021-07-07 15:58:27 +02:00
Sean Naren fc12fe721f
Remove RC candidate install (#8322) 2021-07-07 12:21:12 +00:00
Sean Naren 0a72fd2284
Add FSDP docs (#7791)
* Add FSDP docs

* Address reviews

* Add note about how FSDP can replace pipe parallelism

* Add import

* Remove sentence
2021-06-02 09:52:48 +00:00
Sean Naren 94f6c3e160
Advanced GPU Documentation (#7259)
* Added advanced gpu section

* Small changes

* Better documentation

* Address code review

* Add warning about using trainer.model, clean up some of the examples

* Add section for ddp, remove references and old sequential documentation

* Remove Fully Sharded documentation for now

* Apply suggestions from code review

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>

* Address code review

* Address code review

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2021-05-06 13:53:20 +01:00