Rooba
/
lightning
mirror of https://github.com/Lightning-AI/lightning.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,294 Commits 60 Branches 217 Tags 359 MiB
Commit Graph

16 Commits

Author SHA1 Message Date
four4fish caab69aabb
Renamed DDPShardPlugin to DDPShardStrategy (#11187) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-12-21 17:18:25 +00:00
Aki Nitta 9da78a94bd
Rename `TPUSpawnPlugin` to `TPUSpawnStrategy` (#11190) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-12-21 16:36:16 +00:00
Kaushik B 283bdece0a
Rename DeepSpeedPlugin to DeepSpeedStrategy (#11194) 2021-12-21 15:18:01 +00:00
four4fish b64dea9dc3
Rename `DDPPlugin` to `DDPStrategy` (#11142) 
* Raname DDPPlugin to DDPStrategy

* Change ddp_plugin to ddp_strategy

* update changelog

* rename occurences in docs

* rename more occurrences

* fix line too long

* more fixes

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-12-21 08:55:51 +00:00
four4fish 0ee78e96ef
Rename `DDPFullyShardedPlugin` to `DDPFullyShardedStrategy` (#11143) 
* Rename DDPFullyShardedPlugin to DDPFullyShardedStrategy

* update fsdp_plugin to fsdp_strategy

* update changelog

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2021-12-20 17:11:20 +01:00
four4fish 973305c6a5
Add more trainer config tests (#10319) 
* Add more trainer config tests

* Add more trainer config and ttp register tests

* Add more trainer config and ttp register tests
 2021-11-05 10:42:58 +01:00
Kaushik B 762af9505b
Add missing test for testing custom registered training plugin (#10225) 2021-10-29 04:06:06 +00:00
Kaushik B 56bc55db71
Update strategy flag in docs (#10000) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
 2021-10-20 21:02:53 +05:30
Sean Naren c6b6888387
Add DeepSpeed Stage 1 + doc improvements for model parallel (#8974) 
* Add stage 1 support + small doc improvements

* Add CHANGELOG.md
 2021-08-18 19:40:19 +05:30
Carlos Mocholí a64cc37394
Replace `yapf` with `black` (#7783) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2021-07-26 13:37:35 +02:00
Kaushik B ef7d41692c
Add `ddp_*_find_unused_parameters_false` to Plugins Registry. (#8483) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2021-07-24 04:02:54 +00:00
Kaushik B 78a14a3f56
Add `tpu_spawn_debug` to plugin registry (#7933) 2021-06-15 22:32:51 +00:00
Sean Naren f7459f5328
DeepSpeed Infinity Update (#7234) 
* Update configs to match latest API

* Ensure we move the entire model to device before configure optimizer is called

* Add missing param

* Expose parameters

* Update references, drop local rank as it's now infered from the environment variable

* Fix ref

* Force install deepspeed 0.3.16

* Add guard for init

* Update pytorch_lightning/plugins/training_type/deepspeed.py

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Revert type checking

* Install master for CI for testing purposes

* Update CI

* Fix tests

* Add check

* Update versions

* Set precision

* Fix

* See if i can force upgrade

* Attempt to fix

* Drop

* Add changelog

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2021-06-14 16:38:28 +00:00
Kaushik B e21b7a62d7
Add ddp_find_unused_parameters_false to Registry (#7224) 2021-05-04 22:40:00 +00:00
Kaushik B 6d7c6d6403
Update Accelerator Connector for Registry (#7214) 2021-05-03 21:03:21 +00:00
Kaushik B 832a03af7c
Add Training Type Plugins Registry (#6982) 
Co-authored-by: Sean Naren <sean@grid.ai>
Co-authored-by: thomas chaton <thomas@grid.ai>
 2021-04-16 18:01:56 +05:30