lightning/pytorch_lightning/strategies
ananthsub d99625fc8d
Reduce number of times optimizers are instantiated with FSDP (#12267)
2022-03-21 18:18:59 +01:00
..
launchers Fix `is_interactive_compatible` logic after AcceleratorConnector rewrite (#12008) 2022-02-22 19:20:54 +05:30
__init__.py Add process launchers (#11643) 2022-02-17 21:16:51 +00:00
bagua.py Rewrite accelerator_connector (#11448) 2022-02-17 23:38:39 +00:00
ddp.py Add support for specifying process group backend to relevant distributed strategies (#11745) 2022-03-17 23:38:03 -07:00
ddp2.py Rewrite accelerator_connector (#11448) 2022-02-17 23:38:39 +00:00
ddp_spawn.py Add support for specifying process group backend to relevant distributed strategies (#11745) 2022-03-17 23:38:03 -07:00
deepspeed.py Fix deepspeed scheduler initialization (#12031) 2022-03-21 10:31:00 +00:00
dp.py Rewrite accelerator_connector (#11448) 2022-02-17 23:38:39 +00:00
fully_sharded.py Reduce number of times optimizers are instantiated with FSDP (#12267) 2022-03-21 18:18:59 +01:00
horovod.py Support gradient accumulation using Horovod's `backward_passes_per_step` (#11911) 2022-02-19 02:54:04 +01:00
ipu.py [IPU] Support manually instantiating the `poptorch.DataLoader` (#12116) 2022-02-28 09:36:26 +00:00
parallel.py Add support for specifying process group backend to relevant distributed strategies (#11745) 2022-03-17 23:38:03 -07:00
sharded.py Rewrite accelerator_connector (#11448) 2022-02-17 23:38:39 +00:00
sharded_spawn.py Rewrite accelerator_connector (#11448) 2022-02-17 23:38:39 +00:00
single_device.py Rewrite accelerator_connector (#11448) 2022-02-17 23:38:39 +00:00
single_tpu.py Rewrite accelerator_connector (#11448) 2022-02-17 23:38:39 +00:00
strategy.py Support passing `storage_options` in `trainer.save_checkpoint()` API (#11891) 2022-03-09 18:35:50 +00:00
strategy_registry.py Rewrite accelerator_connector (#11448) 2022-02-17 23:38:39 +00:00
tpu_spawn.py Support passing `storage_options` in `trainer.save_checkpoint()` API (#11891) 2022-03-09 18:35:50 +00:00
utils.py Introduce strategies directory for Training Strategies (#11226) 2021-12-22 20:23:30 +00:00