Commit Graph

16 Commits

Author SHA1 Message Date
Carlos Mocholí 14f441c393
Deprecate nvidia/apex (#16039) 2022-12-20 11:09:39 +01:00
Carlos Mocholí 1bc3a97e95
Remove checks for torch greater than 1.10 (#15846) 2022-12-01 21:41:22 +01:00
Adrian Wälchli 86568521fd
FSDP (native) support for LightningLite (#14967)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-11-21 13:58:37 +00:00
Jirka Borovec 57ac5483a0
Upgrade CI to PyTorch 1.13 (#15403)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-11-12 23:39:23 +00:00
Carlos Mocholí 6ba00af1e0
Drop PyTorch 1.9 support (#15347)
* Drop 1.9

* Everything else

* READMEs

* Missed some

* IPU skips

* Remove exception type

* Add back
2022-11-10 08:59:13 -05:00
Adrian Wälchli e4611ef98e
Support fused Adam with mixed precision (#15555)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-11-08 09:53:30 -05:00
Dan Dale 27585a9bcf
Fix and refactor `test_deepspeed_engine_is_steppable` test (#15251)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-10-23 21:25:36 +00:00
Justus Schock 27965cc36b
Fix locally failing lite tests (#15137) 2022-10-18 09:49:14 +00:00
Carlos Mocholí da25d1d30d
Remove unused Lite code (#15000)
* Remove unused Lite code
* Remove duplicate import
* Group variable
* Fix monkeypatch
2022-10-10 22:16:56 +00:00
Carlos Mocholí d15bd1520e
[Lite] precision_plugin -> precision (#15001)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-10-10 15:00:32 +00:00
Adrian Wälchli cd9247a782
Introduce primitives for input/output dtype conversion in Lite Precision (#14792)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: otaj <6065855+otaj@users.noreply.github.com>
2022-09-30 15:29:03 +00:00
Adrian Wälchli 5b446aec4d
DeepSpeed integration tests for Lite (#14901) 2022-09-29 16:39:32 +00:00
Adrian Wälchli d572a7e2ec
Fix double precision support in Lite (#14827) 2022-09-27 08:38:20 +00:00
Adrian Wälchli d7404c775a
Integration tests for Precision in Lite (#14815)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2022-09-26 18:50:11 +00:00
Carlos Mocholí abc805f9ef
Remove the model argument from Lite's `optimizer_step` via structural typing (#14810)
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2022-09-21 19:28:45 +02:00
Adrian Wälchli 85ada5191d
Standalone Lite: Precision Plugins (#14547)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2022-09-12 10:47:44 -04:00