lightning/tests/callbacks
Sean Naren 4e9b453854
[Fix] Move init dist connection into the setup function (#6506)
* Move connection setup into the setup function. Call setup hook after we set up the accelerator

* Added CHANGELOG.md

* fix setup order in callback test

* fix input arguments in test

* Mock distributed function, remove protection to turn into training type hook

* Remove import

* Add missing mock, ensure custom plugin does not create children process

* Skip test on windows

* Update deepspeed to init connection in setup

* Do not initialize distributed module

* Move DeepSpeed tests to special tests since dist communication is being set up

* Special the test to see if this fixes CI

* Delete accelerator connector test to see if its causing build to fail

* Delete deepspeed test

* Revert "Delete accelerator connector test to see if its causing build to fail"

This reverts commit edde60b8

* Revert "Delete deepspeed test"

This reverts commit 9d317429

* Reverse hook

* Reverse setup hooks to debug again

* Add todo so i know where i left off

* For single device move in pre_dispatch after setup function

* Add additional model to device hook if any additional parameters have been set

* See if we can enable deepspeed tests

* Revert "See if we can enable deepspeed tests"

This reverts commit b5450def

* See if this hook approach works

* Introduce new granular hooks

* Remove import, fix tpu spawn by moving the function to setup

* Added missing special test

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-03-18 14:33:39 -07:00
..
__init__.py
test_callback_hook_outputs.py Add outputs param for `on_val/test_epoch_end` hooks (#6120) 2021-03-16 12:15:16 -04:00
test_callbacks.py [Fix] Move init dist connection into the setup function (#6506) 2021-03-18 14:33:39 -07:00
test_early_stopping.py Typing for tests 1/n (#6313) 2021-03-09 11:27:15 +00:00
test_finetuning_callback.py [accelerator][FeatBugFix] Improve manual optimization API (#5771) 2021-02-16 16:00:35 -05:00
test_gpu_stats_monitor.py Refactor: skipif for Windows 2/n (#6268) 2021-03-02 09:36:01 +00:00
test_lambda_function.py Refactor simplify tests (#5861) 2021-02-08 11:52:02 +01:00
test_lr_monitor.py Typing for tests 1/n (#6313) 2021-03-09 11:27:15 +00:00
test_progress_bar.py Add Trainer.validate(…) method to run one validation epoch (#4948) 2021-03-11 03:46:37 +01:00
test_pruning.py Typing for tests 1/n (#6313) 2021-03-09 11:27:15 +00:00
test_quantization.py Typing for tests 1/n (#6313) 2021-03-09 11:27:15 +00:00
test_stochastic_weight_avg.py Typing for tests 1/n (#6313) 2021-03-09 11:27:15 +00:00