Rooba
/
lightning
mirror of https://github.com/Lightning-AI/lightning.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
lightning/pytorch_lightning/accelerators
History
chaton 02152c1729
Simplify optimization Logic (#4984) 
* Rely on ddp plugin for blocking sync behaviour, and skip if we're using manual optimization

* debug

* Revert "debug"

This reverts commit ccca6b6b

* Expose manual reduce for automatic optimization

* Add input arguments

* Enable parity test

* clean imports

* Expose hook after to ensure we reset

* Fix naming

* add

* fix test

* uniformize optimizer logic

* resolve test

* resovle flake8

* resolve amp bug

* update tests

* remove bug

* remove optimizer_step in accelerators

* typo

* update lightning optimizer

* set doesn't work with ddp_spawn

* resolve flake8

* update threshold

* ignore pyright

* correct codeFactor

* remove useless if

* remove zer_grad function

* simplify step

* remove typo

* resolve bug

* Apply suggestions from code review

* update on comments

* resolve bugs

* remove tests

* Update pytorch_lightning/trainer/configuration_validator.py

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

* simplify testing

* add more tests

Co-authored-by: SeanNaren <sean@grid.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 		2020-12-07 12:55:49 +00:00
..
__init__.py ref: unify slurm and TE under backendPlugin 3/n (#4581) 2020-11-08 15:32:37 -05:00
accelerator.py Simplify optimization Logic (#4984) 2020-12-07 12:55:49 +00:00
accelerator_connector.py refactor imports of optional dependencies (#4859) 2020-12-04 10:26:10 +01:00
cpu_accelerator.py optimizer clean up (#4658) 2020-12-01 00:09:46 +00:00
ddp2_accelerator.py optimizer clean up (#4658) 2020-12-01 00:09:46 +00:00
ddp_accelerator.py optimizer clean up (#4658) 2020-12-01 00:09:46 +00:00
ddp_cpu_hpc_accelerator.py simplify imports Omegaconf (#4873) 2020-11-27 01:00:56 +01:00
ddp_cpu_spawn_accelerator.py optimizer clean up (#4658) 2020-12-01 00:09:46 +00:00
ddp_hpc_accelerator.py optimizer clean up (#4658) 2020-12-01 00:09:46 +00:00
ddp_spawn_accelerator.py optimizer clean up (#4658) 2020-12-01 00:09:46 +00:00
dp_accelerator.py optimizer clean up (#4658) 2020-12-01 00:09:46 +00:00
gpu_accelerator.py optimizer clean up (#4658) 2020-12-01 00:09:46 +00:00
horovod_accelerator.py refactor imports of optional dependencies (#4859) 2020-12-04 10:26:10 +01:00
tpu_accelerator.py Simplify optimization Logic (#4984) 2020-12-07 12:55:49 +00:00