Commit Graph

176 Commits

Author SHA1 Message Date
Adrian Wälchli 079544a902
Rename PrecisionPlugin -> Precision (#18840) 2023-10-30 16:53:13 -04:00
Carlos Mocholí 800b87eb46
Add throughput utilities to Fabric and the Trainer (#18848) 2023-10-30 17:10:29 +01:00
Adrian Wälchli e02bb391af
Utility to disable all instances of `PossibleUserWarning` (#18744)
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-10-10 06:53:32 -04:00
Adrian Wälchli d31ef1f7d3
Drop support for PyTorch 1.11 (#18691)
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-10-04 20:30:44 +02:00
pre-commit-ci[bot] c0ec0decec
[pre-commit.ci] pre-commit suggestions (#18697)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-10-03 22:07:21 +02:00
Jirka Borovec 830a62a722
ruff: replace isort with ruff +TPU (#17684)
* ruff: replace isort with ruff

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fixing & imports

* lines in warning test

* docs

* fix enum import

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fixing

* import

* fix lines

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* type ClusterEnvironment

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-09-26 11:54:55 -04:00
Taylor 3a594622c1
Raise exception when `load_from_checkpoint` called from instance (#18432)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2023-09-20 13:45:12 -04:00
Adrian Wälchli 8381ed37c7
Set limits for `fetcher.done` (#18441)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-09-07 10:46:49 -04:00
Carlos Mocholí ea0f6ba6b1
Support multiple dataloaders with `dataloader_iter` (#18390) 2023-09-06 01:24:00 +02:00
Adrian Wälchli 5d24716599
Better error message and instructions for handling custom batch samplers (#18402)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-08-29 05:56:01 -04:00
Jirka Borovec 5f5d99eae6
Relax app dependencies for `lightning` | breaking imports from `L` (#18386)
* make App conditional import

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* ci: min req.

* data + store

* typo

* module_available

* extra

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* typo

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* envs

* doctest

* more

* docs

* **

* rm

* -f

* Apply suggestions from code review

* docs

* Revert "docs"

This reverts commit 20e8e6be98.

* Apply suggestions from code review

* warnings

* breaking

* ...

* fixing source

* fixing examples

* fixing tests

* fixing docs

* fixing source

* fix mock

* fix trainer

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-08-28 11:28:58 -04:00
Jirka Borovec 75096012f8
ci: testing with py3.11 (#17822) 2023-08-28 15:15:12 +00:00
Adrian Wälchli 722fdeac44
Remove unused `disallow_batch_sampler` argument (#18401)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-08-26 06:30:04 -04:00
Jirka Borovec efa7b2f9ef
docformatter: config with black (#18064)
* docformatter: config with black

* additional_dependencies: [tomli]

* 119

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-08-09 10:44:20 -04:00
Adrian Wälchli 1db471305d
Avoid setting the multiprocessing context when importing lightning (#18177)
* avoid import at top module

* tests

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove comment

* update docs

* changelog

* mypy

* trigger app tests

* can't import lightning on py 3.8

* Update .github/workflows/ci-tests-app.yml

Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-07-31 18:05:21 +02:00
Adrian Wälchli 6511ac2875
Only redirect imports when unpickling Lightning checkpoints (#18154)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-07-26 16:07:48 -04:00
Adrian Wälchli df4ad1932b
Verify `torch.compile` compatibility with strategy before launching processes (#18165)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-07-26 15:41:58 -04:00
Adrian Wälchli 5308e90895
Enable loading legacy checkpoints that pickled the `_FaultToleranceMode` enum (#18094) 2023-07-18 09:50:54 -04:00
Carlos Mocholí 9a2bb85d82
Drop `torchdistx` support (#17995) 2023-07-08 02:15:05 +00:00
Andreas Schuh 28beb8a478
Fix parsing of exception.args in _augment_message() (#17948)
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2023-06-29 20:13:47 +00:00
Jirka Borovec ba943e3d6e
tests: marking some flakiness (#17849) 2023-06-21 02:44:17 -04:00
Leng Yue 6f4524a25c
Support kwargs input for `LayerSummary` (#17709)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-05-30 00:17:50 -04:00
Ryan Mukherjee c3ad7568e1
avoid unnecessary workers with sequential `CombinedLoader ` (#17639)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2023-05-30 04:02:50 +00:00
Ryley Higa 300abb3270
Adding non-layer param count to summary (#17005)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2023-05-09 09:19:09 +00:00
Carlos Mocholí 5d102bfa4a
Check for mixed new and old style imports (#17548) 2023-05-05 13:16:19 +02:00
Jirka Borovec 4413e98e4e
ruff: enable & fixing RET (#17540) 2023-05-05 09:34:40 +00:00
Jirka Borovec 384c203532
ruff: PT some more fixes (#17569) 2023-05-05 08:25:15 +02:00
Carlos Mocholí 76caa81bf2
Compose RunIf utilities (#17520) 2023-05-05 01:21:58 +02:00
Jirka Borovec f55d10f5ee
ruff: autofix PT (#17541)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-05-04 11:50:39 -04:00
Adrian Wälchli f6af74bf15
Add map location option to checkpoint upgrade utility (#17527) 2023-04-29 13:55:41 +00:00
Carlos Mocholí 3867045de4
Support inspecting the signature of decorated hooks (#17507) 2023-04-28 09:42:45 +00:00
Jirka Borovec db9f095b0b
Replace IPU with external implementation (#17075)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-04-27 16:09:51 +00:00
pre-commit-ci[bot] 91cb4b9b87
[pre-commit.ci] pre-commit suggestions (#17271)
* [pre-commit.ci] pre-commit suggestions

updates:
- [github.com/PyCQA/docformatter: v1.4 → v1.6.0](https://github.com/PyCQA/docformatter/compare/v1.4...v1.6.0)
- [github.com/psf/black: 22.12.0 → 23.3.0](https://github.com/psf/black/compare/22.12.0...23.3.0)
- [github.com/charliermarsh/ruff-pre-commit: v0.0.237 → v0.0.260](https://github.com/charliermarsh/ruff-pre-commit/compare/v0.0.237...v0.0.260)

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* apply

* fixing

* docs/lines

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2023-04-26 21:37:41 +02:00
Jirka Borovec df97141781
add & apply flake8-simplify (#17386) 2023-04-24 21:57:08 +00:00
Jirka Borovec 111d1ba088
ruff: fixing flake8-comprehensions (#17385) 2023-04-21 09:07:58 +00:00
Carlos Mocholí 8dac251273
[TPU] Fix PjRT tests (#17408) 2023-04-19 16:39:00 +02:00
Adrian Wälchli 21ae19c69f
Add dynamo RunIf skip condition (#17404)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-04-19 01:09:42 +02:00
Carlos Mocholí 97a61868fb
Sync module states during non-fit (#17370)
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-04-15 02:35:51 +00:00
Leng Yue fd4697c62c
Make the `is_picklable` function more robust (#17270) 2023-04-06 22:20:52 +00:00
Carlos Mocholí b97b3ac053
Avoid `inference_mode` with `torch.compile` (#17215) 2023-03-29 19:43:28 +00:00
Carlos Mocholí 8b1baf2946
Set a fixed stage in the evaluation loops (#17094) 2023-03-27 10:00:03 +02:00
Kshiteej K 04a2f3309d
update for neptune 1.0 (#16761)
Co-authored-by: Sabine <sabine.nyholm@neptune.ai>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-03-21 19:00:07 +00:00
Carlos Mocholí 5359ac14ad
Drop the DataLoader iterator when pickling (#17130)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-03-21 09:21:14 +00:00
Carlos Mocholí 0cd837f0da
Add a migration for the dataloader loops (#17125)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-03-20 17:12:58 +00:00
Carlos Mocholí 9cd131c2a6
Add `CombinedLoader` to the API reference (#17062)
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2023-03-14 15:52:05 +01:00
Wouter Zwerink 61fe3d5c9d
Revert "import neptune instead of import neptune.new" (#16898)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-03-13 14:50:30 +00:00
Carlos Mocholí 19866b58b7
Workarounds for log support with Torch 2.0 (#16986) 2023-03-09 00:57:31 +00:00
Carlos Mocholí 20374b93f4
Remove unused code (#17001) 2023-03-09 00:07:48 +00:00
Carlos Mocholí bdd9b12c5a
Refactor `loop.setup_data` with utility functions (#16918) 2023-03-09 00:04:42 +00:00
JuanPablo 6781f3559f
Add `max_size` mode to CombinedLoader (#16939)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-03-06 16:21:49 +00:00