Kaushik B f79a13e495 [Model Parallel] Add configure sharded model hook (#6679) ... * Add base hook for model parallel * fix callback signature * Simplify hook * Add hook logic * add tests * add property setter * add logic for being called once * Update changelog * Fix * fix return type * fix lambda callback test * Fix tests * Apply code suggestions * add logic for setup_optimizers_predispatch * add common dummy model * Swap call order * Remove test that isn't needed anymore * Update tests * Add a bit more doc * Few code review fixes * Update pytorch_lightning/accelerators/accelerator.py Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com> * Change hook name * Fix test * Test setup hook, refactor names * Swap call order of callbacks and model initialization * Change name of context manager Co-authored-by: SeanNaren <sean@grid.ai> Co-authored-by: Sean Naren <sean.narenthiran@gmail.com> Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>		2021-03-29 14:50:51 -06:00
..
__init__.py	Automatically find and run special tests (#6669)	2021-03-26 17:04:59 +00:00
ddp_model.py	fixing miss-leading tested acc values (#5876)	2021-02-23 22:08:46 +00:00
test_accelerator_connector.py	[Fix] Move init dist connection into the setup function (#6506)	2021-03-18 14:33:39 -07:00
test_common.py	[Model Parallel] Add configure sharded model hook (#6679)	2021-03-29 14:50:51 -06:00
test_cpu.py	Add PyTorch 1.8 Profiler 5/5 (#6618)	2021-03-23 20:43:21 +00:00
test_ddp.py	Automatically find and run special tests (#6669)	2021-03-26 17:04:59 +00:00
test_ddp_spawn.py	Refactor: skipif for Windows 2/n (#6268)	2021-03-02 09:36:01 +00:00
test_dp.py	Disable batch transfer in DP mode (#6098)	2021-03-11 10:51:10 -05:00
test_multi_nodes_gpu.py	Automatically find and run special tests (#6669)	2021-03-26 17:04:59 +00:00
test_tpu_backend.py	Refactor: Runif for TPU and Horovod 5/n (#6301)	2021-03-02 16:21:20 +00:00