lightning/pytorch_lightning/accelerators
Sean Naren 8283680aa0
Sharded Plugin 3/n: Expose step input to DDP plugin (#4686)
* Allow ddp plugin to move the input to a different device if needed

* Swapped name to on_before_forward to align with hooks in the future

* Update pytorch_lightning/plugins/ddp_plugin.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* Pass variable arg type to hook, add example

* Remove blank space (pep check)

* Added blank line

Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-11-18 15:45:30 +00:00
..
__init__.py ref: unify slurm and TE under backendPlugin 3/n (#4581) 2020-11-08 15:32:37 -05:00
accelerator.py [FEAT] Add lambda closure to manual_optimizer_step (#4618) 2020-11-12 19:22:06 +00:00
accelerator_connector.py ref: unify slurm and TE under backendPlugin 3/n (#4581) 2020-11-08 15:32:37 -05:00
cpu_accelerator.py Prevent crash if sync_dist=True on CPU (#4626) 2020-11-11 22:04:05 +00:00
ddp2_accelerator.py Sharded Plugin 3/n: Expose step input to DDP plugin (#4686) 2020-11-18 15:45:30 +00:00
ddp_accelerator.py Sharded Plugin 3/n: Expose step input to DDP plugin (#4686) 2020-11-18 15:45:30 +00:00
ddp_cpu_hpc_accelerator.py Accelerator docs (#4583) 2020-11-08 17:24:41 -05:00
ddp_cpu_spawn_accelerator.py Sharded Plugin 3/n: Expose step input to DDP plugin (#4686) 2020-11-18 15:45:30 +00:00
ddp_hpc_accelerator.py Sharded Plugin 3/n: Expose step input to DDP plugin (#4686) 2020-11-18 15:45:30 +00:00
ddp_spawn_accelerator.py Sharded Plugin 3/n: Expose step input to DDP plugin (#4686) 2020-11-18 15:45:30 +00:00
dp_accelerator.py Accelerator docs (#4583) 2020-11-08 17:24:41 -05:00
gpu_accelerator.py Prevent crash if sync_dist=True on CPU (#4626) 2020-11-11 22:04:05 +00:00
horovod_accelerator.py Accelerator docs (#4583) 2020-11-08 17:24:41 -05:00
tpu_accelerator.py [FEAT] Add lambda closure to manual_optimizer_step (#4618) 2020-11-12 19:22:06 +00:00