c210e338ef
Update strategy import statements ( #11231 )
2021-12-23 08:26:28 +01:00
cf5ef32f7b
Deprecate Trainer.training_type_plugin in favor of trainer.strategy ( #11141 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-12-22 02:11:43 +00:00
4bfe5bda0f
Rename the DDPSpawnShardedPlugin to DDPSpawnShardeedStrategy ( #11210 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-12-22 00:27:36 +00:00
f98cd78e9e
Renamed the `DDPSpawnPlugin` to `DDPSpawnStrategy` ( #11145 )
2021-12-21 23:06:14 +00:00
caab69aabb
Renamed DDPShardPlugin to DDPShardStrategy ( #11187 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-12-21 17:18:25 +00:00
9da78a94bd
Rename `TPUSpawnPlugin` to `TPUSpawnStrategy` ( #11190 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-12-21 16:36:16 +00:00
283bdece0a
Rename DeepSpeedPlugin to DeepSpeedStrategy ( #11194 )
2021-12-21 15:18:01 +00:00
b64dea9dc3
Rename `DDPPlugin` to `DDPStrategy` ( #11142 )
...
* Raname DDPPlugin to DDPStrategy
* Change ddp_plugin to ddp_strategy
* update changelog
* rename occurences in docs
* rename more occurrences
* fix line too long
* more fixes
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-12-21 08:55:51 +00:00
0ee78e96ef
Rename `DDPFullyShardedPlugin` to `DDPFullyShardedStrategy` ( #11143 )
...
* Rename DDPFullyShardedPlugin to DDPFullyShardedStrategy
* update fsdp_plugin to fsdp_strategy
* update changelog
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-12-20 17:11:20 +01:00
973305c6a5
Add more trainer config tests ( #10319 )
...
* Add more trainer config tests
* Add more trainer config and ttp register tests
* Add more trainer config and ttp register tests
2021-11-05 10:42:58 +01:00
762af9505b
Add missing test for testing custom registered training plugin ( #10225 )
2021-10-29 04:06:06 +00:00
56bc55db71
Update strategy flag in docs ( #10000 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-10-20 21:02:53 +05:30
c6b6888387
Add DeepSpeed Stage 1 + doc improvements for model parallel ( #8974 )
...
* Add stage 1 support + small doc improvements
* Add CHANGELOG.md
2021-08-18 19:40:19 +05:30
a64cc37394
Replace `yapf` with `black` ( #7783 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-07-26 13:37:35 +02:00
ef7d41692c
Add `ddp_*_find_unused_parameters_false` to Plugins Registry. ( #8483 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-07-24 04:02:54 +00:00
78a14a3f56
Add `tpu_spawn_debug` to plugin registry ( #7933 )
2021-06-15 22:32:51 +00:00
f7459f5328
DeepSpeed Infinity Update ( #7234 )
...
* Update configs to match latest API
* Ensure we move the entire model to device before configure optimizer is called
* Add missing param
* Expose parameters
* Update references, drop local rank as it's now infered from the environment variable
* Fix ref
* Force install deepspeed 0.3.16
* Add guard for init
* Update pytorch_lightning/plugins/training_type/deepspeed.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Revert type checking
* Install master for CI for testing purposes
* Update CI
* Fix tests
* Add check
* Update versions
* Set precision
* Fix
* See if i can force upgrade
* Attempt to fix
* Drop
* Add changelog
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-06-14 16:38:28 +00:00
e21b7a62d7
Add ddp_find_unused_parameters_false to Registry ( #7224 )
2021-05-04 22:40:00 +00:00
6d7c6d6403
Update Accelerator Connector for Registry ( #7214 )
2021-05-03 21:03:21 +00:00
832a03af7c
Add Training Type Plugins Registry ( #6982 )
...
Co-authored-by: Sean Naren <sean@grid.ai>
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-04-16 18:01:56 +05:30
Adrian Wälchli