lightning/pytorch_lightning/accelerators
Ananya Harsh Jha 127454ade2
All gatherwith grads (#5012)
* all_gather

* ddp

* horovod

* grad tests

* fixed ddp

* ddp fixed, removed tpu, horovod for now

* changelog

* windows fix

* windows fix

* removed batch from ctx

* all_gather

* ddp

* horovod

* grad tests

* fixed ddp

* ddp fixed, removed tpu, horovod for now

* changelog

* windows fix

* windows fix

* removed batch from ctx

* removed code duplication

* merge

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-12-08 23:20:01 +00:00
..
__init__.py ref: unify slurm and TE under backendPlugin 3/n (#4581) 2020-11-08 15:32:37 -05:00
accelerator.py All gatherwith grads (#5012) 2020-12-08 23:20:01 +00:00
accelerator_connector.py refactor imports of optional dependencies (#4859) 2020-12-04 10:26:10 +01:00
cpu_accelerator.py [feat] pp 1/n (#5016) 2020-12-08 22:02:10 +00:00
ddp2_accelerator.py All gatherwith grads (#5012) 2020-12-08 23:20:01 +00:00
ddp_accelerator.py All gatherwith grads (#5012) 2020-12-08 23:20:01 +00:00
ddp_cpu_hpc_accelerator.py simplify imports Omegaconf (#4873) 2020-11-27 01:00:56 +01:00
ddp_cpu_spawn_accelerator.py All gatherwith grads (#5012) 2020-12-08 23:20:01 +00:00
ddp_hpc_accelerator.py All gatherwith grads (#5012) 2020-12-08 23:20:01 +00:00
ddp_spawn_accelerator.py All gatherwith grads (#5012) 2020-12-08 23:20:01 +00:00
dp_accelerator.py [feat] pp 1/n (#5016) 2020-12-08 22:02:10 +00:00
gpu_accelerator.py [feat] pp 1/n (#5016) 2020-12-08 22:02:10 +00:00
horovod_accelerator.py [feat] pp 1/n (#5016) 2020-12-08 22:02:10 +00:00
tpu_accelerator.py [feat] pp 1/n (#5016) 2020-12-08 22:02:10 +00:00