Commit Graph

9213 Commits

Author SHA1 Message Date
Nicki Skafte Detlefsen 2b05e2f113
Fix problems in trainer docs (#17561) 2023-05-04 16:18:30 +02:00
Eric Lam 989ddeaa32
feat: add LargeFileManager configuration to Jupyter in Dockerfile (#17553) 2023-05-04 13:35:44 +02:00
Jakub Kaczmarzyk ebbd1169d8
add note in LightningCLI docs that `--optimizer` must be given for `--lr_scheduler` to work (#17552) 2023-05-04 13:35:05 +02:00
Jirka Borovec e0f335809d
Adding tests for legacy checkpoints - 1.8.x (#17374)
* Adding tests for legacy checkpoints

* 2.0

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix simple

* utils

* import

* pl

* num_features=24

* num_features=24

* length=6000

* other

* rm

* dru run

* rm

* prune

* import

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-05-04 12:33:46 +02:00
thomas chaton 7df627b437
App: change cache location (#17491)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-05-04 08:12:33 +00:00
Solomiia 04a86f95d7
Add an option to overwrite the existing checkpoint file (#17320)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-05-03 17:00:54 +00:00
Adrian Wälchli a533f68693
Support compiling a module after it was set up by Fabric (#17529)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-05-03 09:00:11 +02:00
Adrian Wälchli 249395bfe0
DDP Parity tests as standalone task (#17503) 2023-05-03 05:36:07 +02:00
dependabot[bot] 9eedf7ae4b
Bump playwright from 1.30.0 to 1.32.1 in /requirements (#17537)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-05-02 13:54:11 +00:00
dependabot[bot] 294c3b8cca
Update numpy requirement from <1.24.2,>=1.17.2 to >=1.17.2,<1.24.4 in /requirements (#17538)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-05-02 13:48:26 +00:00
dependabot[bot] c950ae2ee0
Update pandas requirement from <1.5.4,>1.0 to >1.0,<2.0.2 in /requirements (#17534)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-05-02 12:46:07 +01:00
dependabot[bot] 7c6d42a6b9
Update fsspec[http] requirement from <2023.2.0,>2021.06.0 to >2021.06.0,<2023.5.0 in /requirements (#17536)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-05-01 18:14:27 +02:00
dependabot[bot] bfb9bc73fa
Bump mypy from 1.1.1 to 1.2.0 in /requirements (#17535)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-05-01 15:35:24 +02:00
Adrian Wälchli f6af74bf15
Add map location option to checkpoint upgrade utility (#17527) 2023-04-29 13:55:41 +00:00
Adrian Wälchli 7523dd3199
Avoid creating CUDA stream if not running on CUDA (#17499) 2023-04-29 03:13:56 +00:00
Carlos Mocholí 6ec9a6bd9e
[TPU] Rename classes to use XLA instead of TPU (#17383) 2023-04-28 12:36:22 -04:00
Jirka Borovec 77889aa6bb
fabric: upstream runif to pkg (#17504) 2023-04-28 15:32:45 +00:00
Adrian Wälchli ce3701bfc0
Update `Fabric.init_module` for FSDP (#17510) 2023-04-28 12:44:52 +00:00
Carlos Mocholí 114a6d64a3
[TPU] Call `auto_device_count` for `is_available` (#17509) 2023-04-28 12:32:23 +00:00
thomas chaton cafdc6d308
Examples: expose learning rate (#17513)
Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
2023-04-28 09:54:09 +00:00
Carlos Mocholí 3867045de4
Support inspecting the signature of decorated hooks (#17507) 2023-04-28 09:42:45 +00:00
Carlos Mocholí 82aa7b4bb8
ci: add current & total count to standalone test output (#17511) 2023-04-28 11:13:53 +02:00
thomas chaton a0dd8087d8
Resolve e2e CI (#17480)
* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

---------

Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
2023-04-28 10:58:08 +02:00
Carlos Mocholí abc634d17c
Fix setup_model typos in Fabric (#17498) 2023-04-28 00:31:17 +00:00
Anton Kiselev 6b6594b831
Add timeout argument for `FSDPStrategy` (#17274)
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2023-04-28 00:27:06 +00:00
Jirka Borovec 6464650a3c
fix issue labeler (#17501) 2023-04-27 21:28:20 +02:00
Jirka Borovec 3747a77a54
adjust msg for external accelerators (#17465)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-04-27 12:55:19 -04:00
Jirka Borovec 8684783a6e
gh: fix duplicate id in bug issue (#17495) 2023-04-27 12:54:04 -04:00
AleksanderWWW ef9df05989
upload checkpoint files to neptune from stream (#17430) 2023-04-27 16:52:44 +00:00
Dingu Sagar 56583fb668
Adding doc strings for exceptions raised in trainer.py (#16684)
Co-authored-by: Dingu Sagar <dingu.sagar@engati.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2023-04-27 18:23:25 +02:00
Jirka Borovec db9f095b0b
Replace IPU with external implementation (#17075)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-04-27 16:09:51 +00:00
Carlos Mocholí 4d3517c007
Fix registry typing annotation (#17489) 2023-04-27 16:27:26 +02:00
Jirka Borovec 3a01abbde3
ci: label issue with version (#17484)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-04-27 14:15:08 +00:00
Adrian Wälchli 614dcdf502
True half-precision support in Fabric (#17287)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-04-27 12:37:33 +00:00
Adam J. Stewart 3d7360a8d4
Lightning: make type hints public (#17100)
* Add missing MANIFESTs

* move

* one more

* Ignore version.info properly

* move

* manifest

---------

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2023-04-27 08:24:43 -04:00
asmith26 8c18439207
Fix conda badge in README (#17345) 2023-04-27 13:54:52 +02:00
Ethan Harris 8d310b89ea
[App] Add missing python-multipart dependency (#17244)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2023-04-27 10:21:04 +00:00
Jirka Borovec 156786343b
adding check for bandit vulnerabilities 1/n (#17382)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-04-27 09:43:12 +00:00
Carlos Mocholí 26666cb568
Shared `Fabric._wrap_and_launch` code (#17473) 2023-04-27 00:17:22 +00:00
Jirka Borovec cc3800aac3
simple examples instead of skips (#17482)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-04-26 22:27:53 +02:00
pre-commit-ci[bot] 91cb4b9b87
[pre-commit.ci] pre-commit suggestions (#17271)
* [pre-commit.ci] pre-commit suggestions

updates:
- [github.com/PyCQA/docformatter: v1.4 → v1.6.0](https://github.com/PyCQA/docformatter/compare/v1.4...v1.6.0)
- [github.com/psf/black: 22.12.0 → 23.3.0](https://github.com/psf/black/compare/22.12.0...23.3.0)
- [github.com/charliermarsh/ruff-pre-commit: v0.0.237 → v0.0.260](https://github.com/charliermarsh/ruff-pre-commit/compare/v0.0.237...v0.0.260)

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* apply

* fixing

* docs/lines

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2023-04-26 21:37:41 +02:00
Adrian Wälchli 4d17b5fe77
Improved model initialization API for Fabric (#17462)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-04-26 11:25:33 -04:00
Adrian Wälchli d48ec08d76
Update gradient clipping docs in Fabric (#17470) 2023-04-25 20:20:05 +00:00
Jane (Yuan) Xu 68b56ba7f8
Update the MockOptimizer set_to_none default to match PyTorch (#17463)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-04-25 16:46:45 +00:00
Carlos Mocholí b0af0eede2
Fallback to module available check for mlflow (#17467) 2023-04-25 15:46:28 +00:00
dependabot[bot] b792c90ea7
Update deepspeed requirement support window (#16813)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2023-04-25 17:26:49 +02:00
Jirka Borovec 843a167838
drop contribution badge (#17471) 2023-04-25 14:35:02 +02:00
Carlos Mocholí 1145c450b5
Remove devel.txt requirements file (#17466) 2023-04-25 07:21:21 +00:00
Carlos Mocholí 9627121da7
Simplify strategy installation in CI (#17347) 2023-04-25 01:09:57 +00:00
Shanmugam Ramasamy 524608ce53
Patch for device placement (Reduce host and device syncs) (#17334)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-04-25 00:48:06 +00:00