Rooba
/
lightning
mirror of https://github.com/Lightning-AI/lightning.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,194 Commits 60 Branches 217 Tags 359 MiB
Commit Graph

41 Commits

Author SHA1 Message Date
Jirka Borovec 830a62a722
ruff: replace isort with ruff +TPU (#17684) 
* ruff: replace isort with ruff

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fixing & imports

* lines in warning test

* docs

* fix enum import

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fixing

* import

* fix lines

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* type ClusterEnvironment

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-09-26 11:54:55 -04:00
Jirka Borovec 0cc458e237
runif consistency (#17686) 2023-05-25 16:56:28 +00:00
Carlos Mocholí 76caa81bf2
Compose RunIf utilities (#17520) 2023-05-05 01:21:58 +02:00
Jirka Borovec d9817aa5f1
refactor: move RunIf to PL pkg (#16923) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-03-03 15:45:59 +00:00
Justus Schock b4e29e0c8f
PL: Test PyTorch 2.0 pre-release on CPU and CUDA (#16764) 
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
 2023-02-28 18:38:40 +01:00
Lightning Forever 41dd0d1f85
Remove the QuantizationAwareTraining callback (#16750) 2023-02-15 17:29:49 -05:00
Adrian Wälchli 83f4c83582
Replace ColossalAIStrategy with external implementation (#16757) 2023-02-15 15:11:52 +00:00
Adrian Wälchli c4074419b5
Remove the BaguaStrategy (#16746) 
* remove bagua

* remove

* remove docker file entry
 2023-02-14 08:58:58 -05:00
Jirka Borovec 4b2cf36e77
move `_HPU_AVAILABLE` (#16713) 2023-02-10 08:56:31 +01:00
Jirka Borovec 560d6d7956
tests: drop slow flag (#16692) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-02-08 17:09:59 +00:00
Nikhil Shenoy 7bbbe22636
Move `_POPTORCH_AVAILABLE` and `_IPU_AVAILABLE` (#16509) 
Co-authored-by: Nikhil Shenoy <nikhilshenoy@dhcp-128-189-225-225.ubcsecure.wireless.ubc.ca>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-02-06 15:34:54 +01:00
Jirka Borovec 770b792925
copyright Lightning AI team (#16647) 
* copyright Lightning AI team

* more...
 2023-02-06 15:26:51 +01:00
Jirka Borovec de005321a5
tests: switch imports for pytorch (#16595) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-02-02 10:06:45 +00:00
Jirka Borovec 377210d85d
tests: switch imports for fabric (#16592) 2023-02-01 20:34:38 +00:00
Carlos Mocholí b2387136ba
Fix `torch.compile` tests (#16503) 2023-01-27 02:41:45 +00:00
Carlos Mocholí 39b7cb80ca
Remove the FairScale integration (#16400) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2023-01-23 13:39:04 +00:00
Carlos Mocholí f031f1e453 Remove the `HivemindStrategy` (#16407) 
Remove the collaborative strategy
 2023-01-19 18:39:36 +01:00
Carlos Mocholí ce99602d50 Remove horovod (#16150) 2023-01-19 18:39:36 +01:00
Carlos Mocholí f17cacb04b Remove nivida/apex (#16149) 2023-01-19 18:39:36 +01:00
Carlos Mocholí 428844d01d
Fabric: drop FairScale's sharded implementation (#16329) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2023-01-11 17:08:18 +00:00
Carlos Mocholí a56c12c26f
Switch v1.10 deprecation references (#16321) 2023-01-10 15:51:24 +00:00
Carlos Mocholí 15ef52bc73
Rename LightningLite to Fabric (#16244) 
* Rename LightningLite to Fabric

* Fix introspection test

* Fix deprecated Lite tests

* Undo accidental Horovod removal

* Fixes
 2023-01-04 10:57:18 -05:00
Carlos Mocholí bf8e568845
Deprecate the `HorovodStrategy` (#16141) 2022-12-20 18:38:28 +01:00
Carlos Mocholí 14f441c393
Deprecate nvidia/apex (#16039) 2022-12-20 11:09:39 +01:00
Carlos Mocholí 1bc3a97e95
Remove checks for torch greater than 1.10 (#15846) 2022-12-01 21:41:22 +01:00
Rohit Gupta 61ae35c378
Use sklearn in runif (#15426) 
* Use sklearn in runif
* test by removing sklearn dep
* remove repeated code
* seed
 2022-11-01 11:40:32 +00:00
Carlos Mocholí c739f6d2d9
Filter APEX future warning (#15078) 2022-10-11 13:04:48 +00:00
ver217 2fef6d9403
Add ColossalAI strategy (#14224) 
Co-authored-by: HELSON <c2h214748@gmail.com>
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
Co-authored-by: otaj <ota@lightning.ai>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2022-10-11 13:59:09 +02:00
Dan Dale 3b75c52869
Support ddp_fork strategy with native AMP by attempting NVML-based CUDA availability assessment (#14984) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2022-10-05 18:52:06 -04:00
Carlos Mocholí 7ef87464dd
Refactor XLA and TPU checks across codebase (#14550) 2022-10-04 22:54:14 +00:00
Adrian Wälchli d8e90f6581
Fairscale import updates (#14721) 
* fairscale imports
* refactor to avoid meta package build issue

Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: thomas chaton <thomas@grid.ai>
 2022-09-29 16:45:27 +00:00
Adrian Wälchli d013bcc5bf
Standalone Lite: Accelerators (#14578) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2022-09-12 16:00:14 +00:00
Carlos Mocholí e0c2c3e677
Clean up fairscale imports (#14476) 2022-09-01 18:08:40 +02:00
Adrian Wälchli 807f9d8c96
Replace unwrapping logic in strategies (#13738) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2022-08-12 08:24:04 +00:00
Adrian Wälchli fff62f0ae5
Fix TPU testing and collect all tests (#11098) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
 2022-07-27 15:40:40 +00:00
Carlos Mocholí 0e5a51f55c
Allow CUDA and IPU tests without the CI environment var (#13676) 2022-07-19 13:40:25 +09:00
Carlos Mocholí 8355ba1260
Run only CUDA tests on Azure GPU CI (#13651) 2022-07-15 13:51:23 +02:00
Jirka Borovec d2e4e7e003
create meta package [RFC] (#13327) 
* placeholder

* move setup_tools & abstract about

* adjust lightning-app

* notes

* lightning about

* lightning init

* CI check

* ci

* install

* adjust manifest & mv chlog

* manifest

* pkg

* mv __setup__

* parse_requirements

* lit

* ci - pytorch

* wrap func

* ci

* cd draft

* generate lit

* pkg

* utf-8

* root pkg

* req.

* ver

* mypy

* try check

* meta pkg

* meta pkg - vars

* meta pkg - pruning

* meta pkg - fixing

* fix PL for meta

* multi-line wrapper

* hack manifest

* ci

* fix docstr

* fixing

* ci & mypy

* links
 2022-06-27 09:34:18 -04:00
Justus Schock f54abc506f
Merge pull request #13123 from Lightning-AI/mps_accelerator 
MPS Accelerator
 2022-06-24 08:15:48 -04:00
Atharva Phatak 63a9ab4ae2
Improved Deepspeed Imports (#13223) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
 2022-06-22 11:09:33 -04:00
Jirka Borovec ab59f308b1
Future 4/n: test & legacy in test/ folder (#13295) 
* move: legacy >> test/

* move: tests >> test/

* rename unittests

* update CI

* tests4pl

* tests_pytorch

* proxi

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* ci

* link

* cli

* standalone

* fixing

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* .

* Apply suggestions from code review

Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* alone

* test -> tests

* Standalone fixes

* ci

* Update

* More fixes

* Fix coverage

* Fix mypy

* mypy

* Empty-Commit

* Fix

* mypy just for pl

* Fix standalone

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2022-06-15 18:10:49 -04:00