Commit Graph

76 Commits

Author SHA1 Message Date
pre-commit-ci[bot] f120c91e9f
[pre-commit.ci] pre-commit suggestions (#19229)
* [pre-commit.ci] pre-commit suggestions

updates:
- [github.com/pre-commit/pre-commit-hooks: v4.4.0 → v4.5.0](https://github.com/pre-commit/pre-commit-hooks/compare/v4.4.0...v4.5.0)
- [github.com/asottile/pyupgrade: v3.14.0 → v3.15.0](https://github.com/asottile/pyupgrade/compare/v3.14.0...v3.15.0)
- [github.com/astral-sh/ruff-pre-commit: v0.1.3 → v0.1.9](https://github.com/astral-sh/ruff-pre-commit/compare/v0.1.3...v0.1.9)
- [github.com/psf/black: 23.9.1 → 23.12.1](https://github.com/psf/black/compare/23.9.1...23.12.1)
- [github.com/pre-commit/mirrors-prettier: v3.0.3 → v4.0.0-alpha.8](https://github.com/pre-commit/mirrors-prettier/compare/v3.0.3...v4.0.0-alpha.8)

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update .pre-commit-config.yaml

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* drop unused

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2024-01-10 13:11:48 -05:00
Jirka Borovec 830a62a722
ruff: replace isort with ruff +TPU (#17684)
* ruff: replace isort with ruff

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fixing & imports

* lines in warning test

* docs

* fix enum import

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fixing

* import

* fix lines

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* type ClusterEnvironment

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-09-26 11:54:55 -04:00
Adrian Wälchli f170fe9bdf
Address CI flakiness (#18479)
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-09-05 10:22:46 -04:00
Jirka Borovec efa7b2f9ef
docformatter: config with black (#18064)
* docformatter: config with black

* additional_dependencies: [tomli]

* 119

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-08-09 10:44:20 -04:00
pre-commit-ci[bot] 834bd61164
[pre-commit.ci] pre-commit suggestions (#17983)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Jirka B <j.borovec+github@gmail.com>
2023-08-08 16:26:06 +02:00
Carlos Mocholí 4c57c0bc07
[TPU] Do not cancel all jobs when one fails (#18052)
* Update tpu-tests.yml

* Update tpu-tests.yml

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Needs

* if:

* missed this

* Fix issue on multinode

* Latest fixes

* last fix?

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-07-25 14:24:50 +02:00
Carlos Mocholí 0e7e6b31c5
Fix [TPU] tests (#18140)
* Fix [TPU] tests

* More
2023-07-24 15:13:36 +02:00
Adrian Wälchli a97c559d92
Make model test more robust (#18043)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-07-10 20:36:18 +00:00
Quasar Kim 1307b605e8
Fix multithreading checkpoint loading (#17678)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2023-05-31 18:41:57 -04:00
Jirka Borovec 0cc458e237
runif consistency (#17686) 2023-05-25 16:56:28 +00:00
Jirka Borovec 56377d9b1f
ci: separate parity/benchmarks (#17502)
* ci: separet benchmarks

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* measure

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* conf

* isort

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* ci

* parity

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* taska

* name

* ...

* var

* ...

* ...

* ...

* cd

* reset_cudnn_benchmark

* import

* imports

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* models

* xfail

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-05-24 19:16:41 -04:00
Jirka Borovec 4413e98e4e
ruff: enable & fixing RET (#17540) 2023-05-05 09:34:40 +00:00
Carlos Mocholí 76caa81bf2
Compose RunIf utilities (#17520) 2023-05-05 01:21:58 +02:00
Jirka Borovec f55d10f5ee
ruff: autofix PT (#17541)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-05-04 11:50:39 -04:00
Jirka Borovec e0f335809d
Adding tests for legacy checkpoints - 1.8.x (#17374)
* Adding tests for legacy checkpoints

* 2.0

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix simple

* utils

* import

* pl

* num_features=24

* num_features=24

* length=6000

* other

* rm

* dru run

* rm

* prune

* import

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-05-04 12:33:46 +02:00
Jirka Borovec 156786343b
adding check for bandit vulnerabilities 1/n (#17382)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-04-27 09:43:12 +00:00
Jirka Borovec df97141781
add & apply flake8-simplify (#17386) 2023-04-24 21:57:08 +00:00
Jirka Borovec 111d1ba088
ruff: fixing flake8-comprehensions (#17385) 2023-04-21 09:07:58 +00:00
Jirka Borovec d9817aa5f1
refactor: move RunIf to PL pkg (#16923)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-03-03 15:45:59 +00:00
dependabot[bot] 0cb25f44d7
Update torchmetrics requirement from <0.10.1,>=0.7.0 to >=0.7.0,<0.11.1 in /requirements (#15904)
* Update torchmetrics requirement in /requirements

Updates the requirements on [torchmetrics](https://github.com/Lightning-AI/metrics) to permit the latest version.
- [Release notes](https://github.com/Lightning-AI/metrics/releases)
- [Changelog](https://github.com/Lightning-AI/metrics/blob/master/CHANGELOG.md)
- [Commits](https://github.com/Lightning-AI/metrics/compare/v0.7.0...v0.11.0)

---
updated-dependencies:
- dependency-name: torchmetrics
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* task

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2023-03-02 23:35:31 +00:00
Justus Schock b4e29e0c8f
PL: Test PyTorch 2.0 pre-release on CPU and CUDA (#16764)
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2023-02-28 18:38:40 +01:00
Adrian Wälchli 65e66814f8
Remove the `*_step_end` hooks (#16791)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-02-20 13:04:40 +00:00
Justus Schock 0fee28409b
Introduce new precision layout in PL (#16783) 2023-02-17 17:58:14 +01:00
Lightning Forever 41dd0d1f85
Remove the QuantizationAwareTraining callback (#16750) 2023-02-15 17:29:49 -05:00
Adrian Wälchli 83f4c83582
Replace ColossalAIStrategy with external implementation (#16757) 2023-02-15 15:11:52 +00:00
Adrian Wälchli c4074419b5
Remove the BaguaStrategy (#16746)
* remove bagua

* remove

* remove docker file entry
2023-02-14 08:58:58 -05:00
Jirka Borovec 4b2cf36e77
move `_HPU_AVAILABLE` (#16713) 2023-02-10 08:56:31 +01:00
Jirka Borovec 560d6d7956
tests: drop slow flag (#16692)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-02-08 17:09:59 +00:00
Carlos Mocholí bf51844917
Remove memory-retaining epoch-end hooks (#16520) 2023-02-06 17:00:36 +00:00
Nikhil Shenoy 7bbbe22636
Move `_POPTORCH_AVAILABLE` and `_IPU_AVAILABLE` (#16509)
Co-authored-by: Nikhil Shenoy <nikhilshenoy@dhcp-128-189-225-225.ubcsecure.wireless.ubc.ca>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-02-06 15:34:54 +01:00
Jirka Borovec 770b792925
copyright Lightning AI team (#16647)
* copyright Lightning AI team

* more...
2023-02-06 15:26:51 +01:00
Jirka Borovec de005321a5
tests: switch imports for pytorch (#16595)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-02-02 10:06:45 +00:00
Jirka Borovec 377210d85d
tests: switch imports for fabric (#16592) 2023-02-01 20:34:38 +00:00
Adrian Wälchli 6a56586492
Make manual optimization mandatory for multiple optimizers (#16539)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-02-01 16:21:01 +00:00
Adrian Wälchli c2aa8c9e10
Remove `optimizer_idx` from `toggle/untoggle_optimizer` methods (#16560)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-01-30 18:06:42 +00:00
Adrian Wälchli 8fc4fb18e6
Switch multi-optimizer tests to manual optimization (#16559) 2023-01-30 17:18:37 +00:00
Carlos Mocholí b2387136ba
Fix `torch.compile` tests (#16503) 2023-01-27 02:41:45 +00:00
Carlos Mocholí 39b7cb80ca
Remove the FairScale integration (#16400)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2023-01-23 13:39:04 +00:00
Carlos Mocholí f031f1e453 Remove the `HivemindStrategy` (#16407)
Remove the collaborative strategy
2023-01-19 18:39:36 +01:00
Carlos Mocholí ce99602d50 Remove horovod (#16150) 2023-01-19 18:39:36 +01:00
Carlos Mocholí f17cacb04b Remove nivida/apex (#16149) 2023-01-19 18:39:36 +01:00
Carlos Mocholí 428844d01d
Fabric: drop FairScale's sharded implementation (#16329)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2023-01-11 17:08:18 +00:00
Carlos Mocholí a56c12c26f
Switch v1.10 deprecation references (#16321) 2023-01-10 15:51:24 +00:00
Adrian Wälchli 4c3ce605ad
Update precision input type annotations (#14857)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-01-06 20:08:20 +00:00
Carlos Mocholí 15ef52bc73
Rename LightningLite to Fabric (#16244)
* Rename LightningLite to Fabric

* Fix introspection test

* Fix deprecated Lite tests

* Undo accidental Horovod removal

* Fixes
2023-01-04 10:57:18 -05:00
Jirka Borovec e8720290a4
simplify torch.Tensor (#16190) 2022-12-24 06:44:27 +00:00
Carlos Mocholí bf8e568845
Deprecate the `HorovodStrategy` (#16141) 2022-12-20 18:38:28 +01:00
Carlos Mocholí 14f441c393
Deprecate nvidia/apex (#16039) 2022-12-20 11:09:39 +01:00
Carlos Mocholí 53ceb156c4
Integrate lightning_utilities==0.4.2 (#15817)
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2022-12-13 13:13:51 +00:00
Carlos Mocholí 1bc3a97e95
Remove checks for torch greater than 1.10 (#15846) 2022-12-01 21:41:22 +01:00