Commit Graph

28 Commits

Author SHA1 Message Date
dependabot[bot] b792c90ea7
Update deepspeed requirement support window (#16813)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2023-04-25 17:26:49 +02:00
Carlos Mocholí 039891fb49
Install project specific dependencies (#17376)
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-04-24 23:31:47 +00:00
Jirka Borovec 44ce386135
req: formatting (#17335) 2023-04-24 09:19:20 +01:00
Jirka Borovec e04d4fd25e
ci: separate integrations (#17170)
* integrations

* Rename

* Apply suggestions from code review

* cut out

* skip _

* fix

* setup

* 1e-2

* uninstall

* revert

* note
2023-03-24 09:46:45 +01:00
bafangchaoshi a705b21de1
Support BaguaStrategy with external implementation (#17029)
* Support BaguaStrategy with external implementation

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add an introduction of BaguaStrategy

* update the introduction of BaguaStrategy

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Apply suggestions from code review

* link

* Fix document formatting issues

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update lightning-bagua version

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update lightning-bagua version

* Apply suggestions from code review

---------

Co-authored-by: Yafen Fang <fangyaf@spaceml1.ethz.ch>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2023-03-21 12:31:53 -07:00
Jirka Borovec a8c4d1f552
docs: adding hivemind (#17038)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2023-03-13 18:17:37 +00:00
Justus Schock c7962a1619
Add back external colossalai test (#16817) 2023-02-20 09:46:40 +00:00
Adrian Wälchli ad698f049b
Update Colossal AI docs and integration (#16778) 2023-02-16 16:14:24 +00:00
Adrian Wälchli 83f4c83582
Replace ColossalAIStrategy with external implementation (#16757) 2023-02-15 15:11:52 +00:00
Adrian Wälchli 565d3bb8c6
CI: Update colossalai version (#16747)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-02-14 14:07:29 -05:00
Adrian Wälchli c1692c6eb6
Bump max deepspeed version to 0.8.0 (#16469)
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-02-01 05:38:43 +00:00
Carlos Mocholí 59f2d4ce63
Install colossalai==0.1.12 in CI (#16587) 2023-02-01 04:57:22 +00:00
Carlos Mocholí 39b7cb80ca
Remove the FairScale integration (#16400)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2023-01-23 13:39:04 +00:00
Carlos Mocholí f031f1e453 Remove the `HivemindStrategy` (#16407)
Remove the collaborative strategy
2023-01-19 18:39:36 +01:00
Carlos Mocholí ce99602d50 Remove horovod (#16150) 2023-01-19 18:39:36 +01:00
dependabot[bot] ea1899e262
Bump hivemind from 1.1.2 to 1.1.5 in /requirements (#16293)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-01-09 15:20:38 +00:00
Jirka Borovec 1e16836a2c
drop colossalai from testing as no stable release yet (#16122) 2022-12-21 12:32:59 +00:00
dependabot[bot] 1d942977f4
Bump hivemind from 1.0.1 to 1.1.2 in /requirements (#15839)
Bumps [hivemind](https://github.com/learning-at-home/hivemind) from 1.0.1 to 1.1.2.
- [Release notes](https://github.com/learning-at-home/hivemind/releases)
- [Commits](https://github.com/learning-at-home/hivemind/compare/1.0.1...1.1.2)

---
updated-dependencies:
- dependency-name: hivemind
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-28 04:52:05 +00:00
dependabot[bot] 206fd06f51
Update fairscale requirement from <=0.4.6,>=0.4.5 to >=0.4.5,<0.4.13 in /requirements (#15842)
Update fairscale requirement in /requirements

Updates the requirements on [fairscale]() to permit the latest version.

---
updated-dependencies:
- dependency-name: fairscale
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-28 10:01:27 +05:30
Jirka Borovec 8ee889bea0
lit extras (#15793)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-11-24 22:08:51 +00:00
Adrian Wälchli e87c11a592
Upgrade GPU CI to PyTorch 1.13 (#15583)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-11-12 14:58:37 +00:00
ver217 2fef6d9403
Add ColossalAI strategy (#14224)
Co-authored-by: HELSON <c2h214748@gmail.com>
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
Co-authored-by: otaj <ota@lightning.ai>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-10-11 13:59:09 +02:00
Adrian Wälchli 56533368af
Remove DeepSpeed version restriction from Lite (#13967) 2022-08-11 16:17:56 +00:00
Jirka Borovec e513638de8
adding explain notes for requirements (#13872)
* adding explain notes for requirements
* Apply suggestions from code review

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-08-03 21:43:51 +00:00
Carlos Mocholí 406cea7146
Support DeepSpeed <0.7.0 (#13859)
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2022-07-28 14:38:51 +00:00
Carlos Mocholí 511875e567
Support DeepSpeed >=0.6.0, <0.6.5 (#13863)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-07-27 18:57:52 +02:00
dependabot[bot] de0f236e7c
Update horovod requirement from !=0.24.0,<=0.24.3,>=0.21.2 to >=0.21.2,!=0.24.0,<0.25.1 in /requirements (#13363)
Update horovod requirement in /requirements

Updates the requirements on [horovod](https://github.com/horovod/horovod) to permit the latest version.
- [Release notes](https://github.com/horovod/horovod/releases)
- [Changelog](https://github.com/horovod/horovod/blob/master/CHANGELOG.md)
- [Commits](https://github.com/horovod/horovod/compare/v0.21.2...v0.25.0)

---
updated-dependencies:
- dependency-name: horovod
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-22 11:23:15 +00:00
Carlos Mocholí ad87d2cad0
Future 5/n: Move requirements (#13306)
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-06-21 17:11:33 +02:00