Commit Graph

9 Commits

Author SHA1 Message Date
Carlos Mocholí f78db4c674
Remove automatic sharding support with `Fabric.run` or `fabric.launch(fn)` (#17832)
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-06-15 16:02:09 +00:00
Jirka Borovec 4413e98e4e
ruff: enable & fixing RET (#17540) 2023-05-05 09:34:40 +00:00
Adrian Wälchli 0dc42f523e
Save and load sharded checkpoints with FSDP in Fabric (#17323)
Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-04-16 14:11:49 -04:00
Adrian Wälchli 51697a8bd6
Combined setup of model and optimizer with FSDP (#17305)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-04-11 19:58:53 +00:00
Justus Schock 3d1927e6bc
Adds Gradient Clipping to Fabric (#16715)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-02-27 23:44:13 +00:00
Jirka Borovec 377210d85d
tests: switch imports for fabric (#16592) 2023-02-01 20:34:38 +00:00
Carlos Mocholí 428844d01d
Fabric: drop FairScale's sharded implementation (#16329)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2023-01-11 17:08:18 +00:00
Adrian Wälchli b085fa12d3
Rename leftover definitions in Lite tests (#16309) 2023-01-10 15:02:05 +00:00
Carlos Mocholí 15ef52bc73
Rename LightningLite to Fabric (#16244)
* Rename LightningLite to Fabric

* Fix introspection test

* Fix deprecated Lite tests

* Undo accidental Horovod removal

* Fixes
2023-01-04 10:57:18 -05:00