Commit Graph

247 Commits

Author SHA1 Message Date
Carlos Mocholí 273a9ed8c1
Integrate `lightning_utilities.core.apply_func` (#14537) 2022-09-06 13:52:54 +00:00
Carlos Mocholí 44216fdd69
Integrate `lightning_utilities.core.imports` (#14475)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-09-06 12:56:20 +00:00
Carlos Mocholí ce0bde702a
Remove deprecated `test_tube` dependency (#14513) 2022-09-04 11:29:56 +00:00
Carlos Mocholí fed1d8dc6a
Pin protobuf (#14512) 2022-09-03 14:38:30 +00:00
Adrian Wälchli 291dc1b615
Standalone Lite CI setup (#14451)
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-01 22:13:12 +00:00
Adam Bobowski 764b348249
[App] Handling s3 rate limiting in framework (#14411)
bump of fsspec and s3fs to version supporting retry on "SlowDown" response
2022-09-01 11:12:04 +00:00
Sherin Thomas c1a7254b7a
Dependency pinning (#14463)
* deps pinned
* Apply suggestions from code review

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-31 21:24:28 +00:00
Carlos Mocholí 10adcd5d12
Remove the unused pyDeprecate dependency (#14472)
* Remove the unused pyDeprecate dependency
* CHANGELOG
2022-09-01 03:30:18 +09:00
Jirka Borovec 208bf6faa8
prepare space for fused docs (#14160)
* copy app conf

* ci + req.

* script symlink

* wip

* keep only App

* add also PL

* lightning

* artifact
2022-08-30 09:25:05 -04:00
Marc Skov Madsen 18e2a8eecd
PanelFrontend and Panel Web UI Intermediate docs (#13531)
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Marc Skov Madsen <masma@orsted.com>
Co-authored-by: Laverne Henderson <laverne.henderson@coupa.com>
Co-authored-by: Felonious-Spellfire <felonious.spellfire@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Mansy <ahmed.mansy156@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-08-30 00:33:21 +00:00
Mansy 0e30e4a5a0
[App][CI] Fix psutil requirement CI (#14413) 2022-08-26 23:55:22 +00:00
dependabot[bot] 1ad452f95a
Update mlflow requirement from <1.28.0,>=1.0.0 to >=1.0.0,<1.29.0 in /requirements (#14311)
Update mlflow requirement in /requirements

Updates the requirements on [mlflow](https://github.com/mlflow/mlflow) to permit the latest version.
- [Release notes](https://github.com/mlflow/mlflow/releases)
- [Changelog](https://github.com/mlflow/mlflow/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mlflow/mlflow/compare/1.0.0...v1.28.0)

---
updated-dependencies:
- dependency-name: mlflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-26 20:40:53 +00:00
Carlos Mocholí 3ba0f56b18
Remove support for the deprecated torchtext legacy (#14375) 2022-08-26 20:01:51 +00:00
Dmitry Frolov 2182d755c4
[CLI] Adding opportunity to see basic cluster logs (#14334)
* pinning starsessions

* pinning starsessions

* adding strict back to requirements.txt

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Duplicated

* Basic implementation

* Basic implementation

* Basic implementation

* Basic implementation

* Common things moved to log helpers file

* Decomposing logs reader classes for reusing

* Setting colors for log levels

* Manifest trimming

* Changes added to CHANGELOG

* Prettifications

* Prettifications

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Logs function name change

* Logs function name change

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* attempt to fix the pydanitc import

* Tests + command name fixes

* Extending tests

* Adding limit argument

* Unmerging CI fix

* Unmerging CI fix

* Adding fields for errors

* Adding log level fixed field width

* Adding absent typing + exeptions raising

* Adding socket error logging

* Addressing comments on cluster list function return value

* Addressing comments on adding e2e tests

* Adding version range for arrow package in reqs

* New unit tests

* arrow time parsing callback modified + unit tests

* helpers updated

* helpers updated

* helpers updated

* One more test

* CMD test fix

* CMD test fix

* CMD test fix

* CMD test fix

* CMD test fix

* LightningClient mocking

* Flaky test removed

Co-authored-by: hhsecond <sherin@grid.ai>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-23 15:48:22 -04:00
Sherin Thomas 52a4457ae3
Pinning starsessions to 1.x (#14333)
The recent release of starsessions 2.0 has broken lightning app as some of the arguments are removed. This PR also fixes a bug in our setup tools that prevents our internal # strict parameter being considered.

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-21 23:26:52 +00:00
dependabot[bot] bbb406bce9
Update ipython[all] requirement from <=8.1.1 to <8.4.1 in /requirements (#14281)
Updates the requirements on [ipython[all]](https://github.com/ipython/ipython) to permit the latest version.
- [Release notes](https://github.com/ipython/ipython/releases)
- [Commits](https://github.com/ipython/ipython/compare/rel-0.8.4...8.4.0)

---
updated-dependencies:
- dependency-name: ipython[all]
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-19 14:14:16 +09:00
dependabot[bot] bd55b56f56
Update scikit-learn requirement from <=1.1.1,>0.22.1 to >0.22.1,<1.1.3 in /requirements (#14276)
Update scikit-learn requirement in /requirements

Updates the requirements on [scikit-learn](https://github.com/scikit-learn/scikit-learn) to permit the latest version.
- [Release notes](https://github.com/scikit-learn/scikit-learn/releases)
- [Commits](https://github.com/scikit-learn/scikit-learn/compare/0.22.2...1.1.2)

---
updated-dependencies:
- dependency-name: scikit-learn
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-18 14:14:09 +02:00
dependabot[bot] caa0d594b1
Update torch requirement from <=1.12.0,>=1.9.* to >=1.9.0.a,<1.13.0 in /requirements (#14088)
* Update torch requirement in /requirements

Updates the requirements on [torch](https://github.com/pytorch/pytorch) to permit the latest version.
- [Release notes](https://github.com/pytorch/pytorch/releases)
- [Changelog](https://github.com/pytorch/pytorch/blob/master/RELEASE.md)
- [Commits](https://github.com/pytorch/pytorch/compare/v1.9.0-rc1...v1.12.1)

---
updated-dependencies:
- dependency-name: torch
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update base.txt

* Update adjust_versions.py

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-08-18 10:57:13 +00:00
dependabot[bot] 401eb2c535
Update tensorboard requirement from <2.10.0,>=2.9.1 to >=2.9.1,<2.11.0 in /requirements (#14200)
Update tensorboard requirement in /requirements

Updates the requirements on [tensorboard](https://github.com/tensorflow/tensorboard) to permit the latest version.
- [Release notes](https://github.com/tensorflow/tensorboard/releases)
- [Changelog](https://github.com/tensorflow/tensorboard/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorboard/compare/2.9.1...2.10.0)

---
updated-dependencies:
- dependency-name: tensorboard
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-18 08:45:59 +00:00
Jirka Borovec acd4805f1a
CI: clean building docs (#14216)
* CI: clean building docs

* group

* .
2022-08-16 09:28:30 -04:00
Adrian Wälchli 56533368af
Remove DeepSpeed version restriction from Lite (#13967) 2022-08-11 16:17:56 +00:00
Rick Izzo 7c8c996f6a
Feature GRID-9731: Update Lightning Cloud.py Backend to Accept Drive Specs (2/2) (#14106)
initial work adding drives to create work API from framework cloud dispatcher
2022-08-11 13:22:59 +00:00
dependabot[bot] 7e7736778b
Update onnxruntime requirement from <=1.12.0 to <1.13.0 in /requirements (#14083)
Updates the requirements on [onnxruntime](https://github.com/microsoft/onnxruntime) to permit the latest version.
- [Release notes](https://github.com/microsoft/onnxruntime/releases)
- [Changelog](https://github.com/microsoft/onnxruntime/blob/master/docs/ReleaseManagement.md)
- [Commits](https://github.com/microsoft/onnxruntime/compare/v0.1.4...v1.12.1)

---
updated-dependencies:
- dependency-name: onnxruntime
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-10 14:27:35 -04:00
dependabot[bot] f11f1e2bb4
Update gcsfs requirement from <2022.6.0,>=2021.5.0 to >=2021.5.0,<2022.8.0 in /requirements (#14079)
Update gcsfs requirement in /requirements

Updates the requirements on [gcsfs](https://github.com/fsspec/gcsfs) to permit the latest version.
- [Release notes](https://github.com/fsspec/gcsfs/releases)
- [Commits](https://github.com/fsspec/gcsfs/compare/2021.05.0...2022.7.1)

---
updated-dependencies:
- dependency-name: gcsfs
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-10 19:40:34 +02:00
Jirka Borovec 3966f959aa
relax `docker` requirement (#14009) 2022-08-10 13:38:39 -04:00
Luca Medeiros 8fa9e8651d
Update collect env details and issue template (#14017)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-08-10 00:38:18 +00:00
dependabot[bot] 61a9f3a9bc
Update tqdm requirement from <=4.63.0,>=4.57.0 to >=4.57.0,<4.65.0 in /requirements (#13875)
Update tqdm requirement in /requirements

Updates the requirements on [tqdm](https://github.com/tqdm/tqdm) to permit the latest version.
- [Release notes](https://github.com/tqdm/tqdm/releases)
- [Commits](https://github.com/tqdm/tqdm/compare/v4.57.0...v4.64.0)

---
updated-dependencies:
- dependency-name: tqdm
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-08 12:53:57 +00:00
dependabot[bot] 5c9b352eea
Update wandb requirement from <0.12.20,>=0.10.22 to >=0.10.22,<0.13.2 in /requirements (#14080) 2022-08-08 09:25:15 +00:00
Jirka Borovec 5c05719f27
Freeze requirements for CI (#14007)
* free requirements

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* typo

* typo

* ui

* mypy

* todo

* mypy

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* mypy

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-08-08 06:15:54 +00:00
Yurij Mikhalevich 9d02ad761c
feature(ui): Lightning AI doc theme update, integrates global header and footer with docs (#14053) 2022-08-05 14:34:27 -04:00
Jirka Borovec 89b72f7479
relax `redis` requirement (#14008) 2022-08-05 13:51:30 -04:00
dependabot[bot] c6cbc3dcea
Update mlflow requirement from <1.27.0,>=1.0.0 to >=1.0.0,<1.28.0 in /requirements (#14024)
Update mlflow requirement in /requirements

Updates the requirements on [mlflow](https://github.com/mlflow/mlflow) to permit the latest version.
- [Release notes](https://github.com/mlflow/mlflow/releases)
- [Changelog](https://github.com/mlflow/mlflow/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mlflow/mlflow/compare/1.0.0...v1.27.0)

---
updated-dependencies:
- dependency-name: mlflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-05 10:17:55 +09:00
dependabot[bot] 2190b47ae7
Update comet-ml requirement from <3.31.6,>=3.1.12 to >=3.1.12,<3.31.8 in /requirements (#13874) 2022-08-04 15:48:26 +00:00
Jirka Borovec e513638de8
adding explain notes for requirements (#13872)
* adding explain notes for requirements
* Apply suggestions from code review

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-08-03 21:43:51 +00:00
Mansy 5f1cb913bb
Relax lightning app dependency requirements (#13998)
* [App] Relax lightning app requirements

Co-authored-by: manskx <ahmed.mansy156@gmail.com>
2022-08-03 20:24:51 +00:00
thomas chaton 5479c60b22
Reduce state size (#13970) 2022-08-03 13:47:16 +00:00
Jirka Borovec 47833dfd1a
pkg: parse local versions (#13933)
* pkg: parse local versions

* offline

* str

* manifest

* ci
2022-08-01 09:08:43 -04:00
Carlos Mocholí 406cea7146
Support DeepSpeed <0.7.0 (#13859)
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2022-07-28 14:38:51 +00:00
Carlos Mocholí 1299e4f984
Run GPU tests with PyTorch 1.12 (#13716)
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-07-28 19:37:57 +05:30
Carlos Mocholí 511875e567
Support DeepSpeed >=0.6.0, <0.6.5 (#13863)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-07-27 18:57:52 +02:00
dependabot[bot] 56b1e1aaaa
Update torchmetrics requirement from <0.9.2,>=0.7.0 to >=0.7.0,<0.9.3 in /requirements (#13528)
Update torchmetrics requirement in /requirements

Updates the requirements on [torchmetrics](https://github.com/Lightning-AI/metrics) to permit the latest version.
- [Release notes](https://github.com/Lightning-AI/metrics/releases)
- [Changelog](https://github.com/Lightning-AI/metrics/blob/master/CHANGELOG.md)
- [Commits](https://github.com/Lightning-AI/metrics/compare/v0.7.0...v0.9.2)

---
updated-dependencies:
- dependency-name: torchmetrics
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-27 09:22:34 +00:00
dependabot[bot] acdc1f1378
Update torchtext requirement from <=0.12.0,>=0.10.* to >=0.10.0.a,<0.14.0 in /requirements (#13758)
* Update torchtext requirement in /requirements

Updates the requirements on [torchtext](https://github.com/pytorch/text) to permit the latest version.
- [Release notes](https://github.com/pytorch/text/releases)
- [Commits](https://github.com/pytorch/text/compare/v0.10.0-rc1...v0.13.0)

---
updated-dependencies:
- dependency-name: torchtext
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update requirements/pytorch/extra.txt

Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-07-27 08:51:52 +00:00
Luca Medeiros 0cbfe08a41
Add lightning apps to info_packages of collect_env_details (#13815) 2022-07-26 18:04:36 +02:00
Mauricio Villegas 1b31039c58
Update LightningCLI test for new support in latest release of jsonargparse (#13805) 2022-07-25 09:25:42 +00:00
Jirka Borovec e2ec51a5a2
App: prune requirements duplicity (#13739)
prune requirements

Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-07-23 11:17:23 +00:00
Gautier Dagan 0e5312833f
fix mypy errors for loggers/wandb.py (#13483)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-07-21 01:07:24 +00:00
dependabot[bot] df802895ad
Update typing-extensions requirement from <4.2.1,>=4.0.0 to >=4.0.0,<4.3.1 in /requirements (#13529)
Update typing-extensions requirement in /requirements

Updates the requirements on [typing-extensions](https://github.com/python/typing_extensions) to permit the latest version.
- [Release notes](https://github.com/python/typing_extensions/releases)
- [Changelog](https://github.com/python/typing_extensions/blob/main/CHANGELOG.md)
- [Commits](https://github.com/python/typing_extensions/compare/4.0.0...4.3.0)

---
updated-dependencies:
- dependency-name: typing-extensions
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-20 11:01:39 +00:00
Jirka Borovec aa62fe36df
add testing PT 1.12 (#13386)
* add testing PT 1.12
* Fix quantization tests
* Fix another set of tests
* Fix check since https://github.com/pytorch/pytorch/pull/80139 is only going to be available for 1.13
* Skip this test for now for 1.12

Co-authored-by: SeanNaren <sean@grid.ai>
2022-07-15 19:41:23 +02:00
thomas chaton 5e26840f94
Introduce ServableModuleValidator Callback (#13614)
* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* Update tests/tests_pytorch/serve/test_servable_module_validator.py

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Update tests/tests_pytorch/serve/test_servable_module_validator.py

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Update src/pytorch_lightning/serve/servable_module_validator.py

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Update src/pytorch_lightning/serve/servable_module_validator.py

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Update src/pytorch_lightning/serve/servable_module_validator.py

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Typing improvements

* wip

* update doc

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* Update examples/pl_servable_module/production.py

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* update

* update

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-07-15 11:07:40 -04:00
Carlos Mocholí 8355ba1260
Run only CUDA tests on Azure GPU CI (#13651) 2022-07-15 13:51:23 +02:00