lightning/pytorch_lightning/plugins
chaton ae04311863
[Bugfix] Add LightningOptimizer parity test and resolve AMP bug (#5191)
* update

* clean test

* still in progress

* udpdate test

* update

* update

* resolve flake

* add test for zero_grad

* update

* works without accumulated_grad

* update

* update

* resolve amp

* revert back to True

* update

* clean tests

* cleaned out

* typo

* update test

* git repare bug

* remove print

* udpate

* Fix formatting/optimizer imports

* Refactor the test for cleanliness

* Add vanilla model to the test, better var names

* Fixed var names, let's clean up these mock tests

* repare test

* update test

* resolve flake8

* add manual_optimization

* update tests

* resolve flake8

* add random accumulate_grad_batches

* improve test

* Update tests/trainer/optimization/test_parity_automatic_optimization.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* Update tests/trainer/optimization/test_parity_automatic_optimization.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* update

* clean tests

* correct bug

* Apply suggestions from code review

* format

* adress comments

* update on comments

Co-authored-by: SeanNaren <sean@grid.ai>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-62-109.ec2.internal>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>
2020-12-23 05:53:06 -05:00
..
__init__.py ref: apex plugin (#3502) 2020-09-15 06:02:42 -04:00
apex.py Simplify optimization Logic (#4984) 2020-12-07 12:55:49 +00:00
ddp_plugin.py [feat] pp 1/n (#5016) 2020-12-08 22:02:10 +00:00
ddp_sequential_plugin.py [feat] pp 2/n (#5026) 2020-12-09 12:56:51 +00:00
native_amp.py [Bugfix] Add LightningOptimizer parity test and resolve AMP bug (#5191) 2020-12-23 05:53:06 -05:00
plugin.py Allow string plugins (#4888) 2020-12-01 20:30:49 +00:00
plugin_connector.py [feat] pp 2/n (#5026) 2020-12-09 12:56:51 +00:00
precision_plugin.py Allow string plugins (#4888) 2020-12-01 20:30:49 +00:00
rpc_plugin.py [feat] pp 2/n (#5026) 2020-12-09 12:56:51 +00:00
sharded_native_amp_plugin.py Allow string plugins (#4888) 2020-12-01 20:30:49 +00:00
sharded_plugin.py [hotfix] ddp + manual_optimisation (#4976) 2020-12-07 19:31:54 +00:00