Commit Graph

322 Commits

Author SHA1 Message Date
Carlos Mocholí d78cf99176
Remove the "native" suffix from the codebase (#16490) 2023-01-25 14:09:09 +00:00
Adrian Wälchli 96b7ed77e6
Enable more shorthand strategy names in the Fabric CLI (#16485) 2023-01-25 09:52:03 +00:00
Adrian Wälchli c87bb71fa8
Add `Fabric.all_reduce` (#16459) 2023-01-24 22:35:00 +00:00
Adrian Wälchli 7603dd09cb
Fabric checkpointing 2/n: DeepSpeed implementation (#16452)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-01-24 18:53:26 +01:00
Adrian Wälchli 9faa25f86f
Test that connector defaults match the ones in Trainer/Fabric (#16463) 2023-01-23 05:09:45 -05:00
Nikhil Shenoy 81914c7167
LightningFabric: Error handling for accelerator="mps" and ddp strategy pairing (#16455)
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2023-01-22 17:57:24 +00:00
Adrian Wälchli 39acb81b9b
Fabric checkpointing 1/n: base implementation (#16434)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-01-19 20:40:12 +00:00
Adrian Wälchli 285cc53738
Make subprocess launcher the default in Lite (#16388) 2023-01-17 10:16:33 +00:00
Adrian Wälchli f1e0fda879
Rename `Strategy.reduce` to `Strategy.all_reduce` in Lite (#16370) 2023-01-16 08:17:45 -05:00
Adrian Wälchli 8f1269283f
Add CSVLogger for Lightning Lite (#16346)
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-01-13 13:09:44 +00:00
Adrian Wälchli 0a2ee68ea0
Fix configuration validation error message in Lite CLI (#16334) 2023-01-12 15:09:28 +00:00
Carlos Mocholí 428844d01d
Fabric: drop FairScale's sharded implementation (#16329)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2023-01-11 17:08:18 +00:00
Carlos Mocholí 3c3bff5e6e
Fabric: Remove `_Connector.is_distributed` (#16327) 2023-01-11 16:29:51 +01:00
Carlos Mocholí 794685493d
Remove `_StrategyType` (#16328) 2023-01-10 23:05:12 +01:00
Carlos Mocholí 047b4374a5
Annotate `Fabric.log_dict` with mapping input (#16325) 2023-01-10 23:02:55 +01:00
Lightning Forever 91aaa5313a
Lite: Support `self.log` from a LightningModule (#16311)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-01-10 16:11:47 +00:00
Adrian Wälchli b085fa12d3
Rename leftover definitions in Lite tests (#16309) 2023-01-10 15:02:05 +00:00
Lightning Forever f24349bb64
Logger support in Lite (#16121)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-01-09 18:33:18 +00:00
Adrian Wälchli c656307127
Handle `set_to_none` when using DeepSpeed optimizer in Lite (#16275) 2023-01-09 09:01:11 -05:00
Adrian Wälchli 4c3ce605ad
Update precision input type annotations (#14857)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-01-06 20:08:20 +00:00
pre-commit-ci[bot] b59941cc52
[pre-commit.ci] pre-commit suggestions (#16224)
* [pre-commit.ci] pre-commit suggestions

updates:
- [github.com/pre-commit/pre-commit-hooks: v4.3.0 → v4.4.0](https://github.com/pre-commit/pre-commit-hooks/compare/v4.3.0...v4.4.0)
- [github.com/asottile/pyupgrade: v2.34.0 → v3.3.1](https://github.com/asottile/pyupgrade/compare/v2.34.0...v3.3.1)
- https://github.com/myint/docformatterhttps://github.com/PyCQA/docformatter
- [github.com/PyCQA/docformatter: v1.4 → v1.5.1](https://github.com/PyCQA/docformatter/compare/v1.4...v1.5.1)
- [github.com/asottile/yesqa: v1.3.0 → v1.4.0](https://github.com/asottile/yesqa/compare/v1.3.0...v1.4.0)
- [github.com/PyCQA/isort: 5.10.1 → 5.11.4](https://github.com/PyCQA/isort/compare/5.10.1...5.11.4)
- [github.com/psf/black: 22.6.0 → 22.12.0](https://github.com/psf/black/compare/22.6.0...22.12.0)
- [github.com/executablebooks/mdformat: 0.7.14 → 0.7.16](https://github.com/executablebooks/mdformat/compare/0.7.14...0.7.16)

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-01-04 18:48:35 -05:00
Carlos Mocholí 15ef52bc73
Rename LightningLite to Fabric (#16244)
* Rename LightningLite to Fabric

* Fix introspection test

* Fix deprecated Lite tests

* Undo accidental Horovod removal

* Fixes
2023-01-04 10:57:18 -05:00