Commit Graph

429 Commits

Author SHA1 Message Date
ver217 2fef6d9403
Add ColossalAI strategy (#14224)
Co-authored-by: HELSON <c2h214748@gmail.com>
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
Co-authored-by: otaj <ota@lightning.ai>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-10-11 13:59:09 +02:00
dependabot[bot] c04e1cdf67
Update gym[classic_control] requirement from <0.24.2,>=0.17.0 to >=0.17.0,<0.25.2 in /requirements (#14005)
Update gym[classic_control] requirement in /requirements

Updates the requirements on [gym[classic_control]](https://github.com/Farama-Foundation/gym-docs) to permit the latest version.
- [Release notes](https://github.com/Farama-Foundation/gym-docs/releases)
- [Commits](https://github.com/Farama-Foundation/gym-docs/commits)

---
updated-dependencies:
- dependency-name: gym[classic_control]
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-10-10 12:38:37 +00:00
Sherin Thomas 129f4fa873
[App/Feature] HTTP Queues (#14978)
[App/Feature] HTTP Queues (#14978)
2022-10-06 16:01:49 +05:30
thomas chaton b936fd4380
[app] Add CloudCompute ID serializable within the flow and works state (#14819) 2022-10-04 19:46:44 +00:00
otaj e290c206c9
Bump version of fsspec (#14975)
fsspec verbump
2022-10-03 09:53:15 +00:00
Carlos Mocholí be7bfdba27
Remove unused gcsfs dependency (#14962) 2022-10-01 16:08:36 +00:00
Pritam Soni 2721a2f06b
feat: option to add custom meta tags to the UI container (#14915) 2022-09-30 18:56:57 +05:30
otaj 7ff297bdff
Fix App tests (#14922) 2022-09-28 13:20:57 -04:00
Rohit Gupta 688a6da710
Fix pkg version issue while compiling docs (#14914)
* Revert "Add BatchSizeFinder callback (#11089)"

This reverts commit d1a3a3ebf5.

* Revert "Revert "Add BatchSizeFinder callback (#11089)""

This reverts commit 9cc4695925.

* remove pl

* add torch

* add numpy

* rm packages

* add packages

* add packages

* import from PL

* import from PL

* always install PL for doctests

* remove unnecessary requirements

* always install PL in editable mode

* once more

* another attempt

* maybe fix app test?

* Redundant checkgroup path

* Revert "maybe fix app test?"

This reverts commit 8210a43ef4.

* speed up install deps

* damn this

* damn trio

Co-authored-by: otaj <ota@lightning.ai>
Co-authored-by: otaj <6065855+otaj@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-09-28 12:18:07 -04:00
Mansy b0bd949d58
Enable quick-start-app-e2e (#14542)
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-09-27 08:16:46 +01:00
Jirka Borovec b1b50450ac
Cleaning requirement + git fix (#14863)
* drop duplicate docs requirements
* skip empty dir
* mypy for #14861
2022-09-23 16:44:28 +01:00
William Falcon c77d4a8394
Make Trainer Debuggable and understandable again (1/n) (#14861)
* clean trainer 1/n

* clean trainer 1/n

* clean trainer 1/n

* clean trainer 1/n

* clean trainer 1/n

* clean trainer 1/n

* clean trainer 1/n

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* clean trainer 1/n

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-09-23 01:15:59 -04:00
dependabot[bot] 326e5afafd
Update pandas requirement from <=1.4.3,>1.0 to >1.0,<1.5.1 in /requirements (#14787)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-20 16:08:41 +02:00
dependabot[bot] 12bae9b7f5
Update wandb requirement from <0.13.2,>=0.10.22 to >=0.10.22,<0.13.4 in /requirements (#14771)
Update wandb requirement in /requirements

Updates the requirements on [wandb](https://github.com/wandb/wandb) to permit the latest version.
- [Release notes](https://github.com/wandb/wandb/releases)
- [Changelog](https://github.com/wandb/wandb/blob/master/CHANGELOG.md)
- [Commits](https://github.com/wandb/wandb/compare/v0.10.22...v0.13.3)

---
updated-dependencies:
- dependency-name: wandb
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 19:02:18 +00:00
dependabot[bot] 9bb62d3e67
Update arrow requirement from <=1.2.2,>=1.2.0 to >=1.2.0,<1.2.4 in /requirements (#14770)
Update arrow requirement in /requirements

Updates the requirements on [arrow](https://github.com/arrow-py/arrow) to permit the latest version.
- [Release notes](https://github.com/arrow-py/arrow/releases)
- [Changelog](https://github.com/arrow-py/arrow/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/arrow-py/arrow/compare/1.2.0...1.2.3)

---
updated-dependencies:
- dependency-name: arrow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-19 19:13:14 +02:00
Kushashwa Ravi Shrimali 5aaab22fb3
Bump Lightning Cloud to 0.5.7 (#14757)
* Bump Lightning Cloud to 0.5.7 🎉
* Fix link in changelog

Co-authored-by: Sherin Thomas <sherin@grid.ai>
2022-09-16 19:04:21 +00:00
Yurij Mikhalevich 09f50b4295
Fix Google Tag Manager for the Lightning App docs (#14731)
- updates the Lightning App docs theme to the one without Pytorch Lightning docs Google Tag Manager hardcoded
- sets the GTM id in the conf.py for Lightning App docs
2022-09-15 18:35:16 +00:00
Sherin Thomas 7dbd038a94
Bump lightning cloud for memory leak fix (#14697)
Bump lightning cloud for memory leak fix (#14697)
2022-09-15 17:59:12 +05:30
dependabot[bot] f3736f642a
Update ipython[all] requirement from <8.4.1 to <8.5.1 in /requirements (#14671)
Updates the requirements on [ipython[all]](https://github.com/ipython/ipython) to permit the latest version.
- [Release notes](https://github.com/ipython/ipython/releases)
- [Commits](https://github.com/ipython/ipython/compare/rel-0.8.4...8.5.0)

---
updated-dependencies:
- dependency-name: ipython[all]
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-13 22:22:58 +00:00
Kushashwa Ravi Shrimali bdec502f50
Requirements: try Traitlets >= 5.3.0 (#14679)
* Traitlets >= 5.3.0
* Apply suggestions from code review

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-13 09:29:03 +00:00
dependabot[bot] f73b31bf3c
Update traitlets requirement from <5.2.0 as strict in /requirements (#14666)
* Update traitlets requirement from <5.2.0 as strict in /requirements

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-12 20:18:26 +00:00
dependabot[bot] 3d540efe4f
Update psutil requirement from <=5.9.1 to <5.9.3 in /requirements (#14665)
Updates the requirements on [psutil](https://github.com/giampaolo/psutil) to permit the latest version.
- [Release notes](https://github.com/giampaolo/psutil/releases)
- [Changelog](https://github.com/giampaolo/psutil/blob/master/HISTORY.rst)
- [Commits](https://github.com/giampaolo/psutil/compare/release-0.1.0...release-5.9.2)

---
updated-dependencies:
- dependency-name: psutil
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-12 23:48:51 +05:30
dependabot[bot] a7f3837081
Update docutils requirement from <0.19,>=0.16 to >=0.16,<0.20 in /requirements (#14664)
Update docutils requirement in /requirements

Updates the requirements on [docutils](https://docutils.sourceforge.io/) to permit the latest version.

---
updated-dependencies:
- dependency-name: docutils
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-12 23:48:35 +05:30
Mauricio Villegas cd671243ab
Fix mypy errors in pytorch_lightning/cli.py (#14653) 2022-09-12 19:10:34 +02:00
Jirka Borovec 199c2ae89f
Drop duplicate docs requirements (#14644)
Delete base.txt

Co-authored-by: thomas chaton <thomas@grid.ai>
2022-09-12 09:12:30 -04:00
William Falcon b33e3ef18a
simplify storage import (#14638)
* docs

* t1

* simple import

* simple import

* simple import

* simple import

* Update __version__.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-09-10 20:03:11 -04:00
dependabot[bot] d5b32c3087
Update s3fs requirement from <=2022.7.1,>=2022.5.0 to >=2022.5.0,<2022.8.3 in /requirements (#14585)
Update s3fs requirement in /requirements

Updates the requirements on [s3fs](https://github.com/fsspec/s3fs) to permit the latest version.
- [Release notes](https://github.com/fsspec/s3fs/releases)
- [Changelog](https://github.com/fsspec/s3fs/blob/main/release-procedure.md)
- [Commits](https://github.com/fsspec/s3fs/compare/2022.5.0...2022.8.2)

---
updated-dependencies:
- dependency-name: s3fs
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-09 19:58:49 +00:00
dependabot[bot] 4d082e4dac
Update fastapi requirement from <=0.79.0 to <0.83.0 in /requirements (#14576)
Updates the requirements on [fastapi](https://github.com/tiangolo/fastapi) to permit the latest version.
- [Release notes](https://github.com/tiangolo/fastapi/releases)
- [Commits](https://github.com/tiangolo/fastapi/compare/0.1.11...0.82.0)

---
updated-dependencies:
- dependency-name: fastapi
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-07 16:30:46 +00:00
dependabot[bot] 6cf666c6f1
Update neptune-client requirement from <0.16.4,>=0.10.0 to >=0.10.0,<0.16.8 in /requirements (#14582)
Update neptune-client requirement in /requirements

Updates the requirements on [neptune-client](https://github.com/neptune-ai/neptune-client) to permit the latest version.
- [Release notes](https://github.com/neptune-ai/neptune-client/releases)
- [Changelog](https://github.com/neptune-ai/neptune-client/blob/master/CHANGELOG.md)
- [Commits](https://github.com/neptune-ai/neptune-client/compare/0.10.0...0.16.7)

---
updated-dependencies:
- dependency-name: neptune-client
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-07 16:22:34 +00:00
Adrian Wälchli d2459df2ff
Standalone Lite: Remaining Utilities (#14492)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Laverne Henderson <laverne.henderson@coupa.com>
Co-authored-by: Felonious-Spellfire <felonious.spellfire@gmail.com>
2022-09-07 15:25:23 +00:00
dependabot[bot] dbd7703e88
Update fsspec[http] requirement from !=2021.06.0,<2022.6.0,>=2021.05.0 to >=2021.05.0,!=2021.06.0,<2022.8.0 in /requirements (#14288)
Update fsspec[http] requirement in /requirements

Updates the requirements on [fsspec[http]](https://github.com/fsspec/filesystem_spec) to permit the latest version.
- [Release notes](https://github.com/fsspec/filesystem_spec/releases)
- [Commits](https://github.com/fsspec/filesystem_spec/compare/2021.05.0...2022.7.1)

---
updated-dependencies:
- dependency-name: fsspec[http]
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-07 09:25:24 +00:00
Carlos Mocholí 5216c51096
Integrate `lightning_utilities.core.rank_zero` (#14556) 2022-09-07 09:21:48 +00:00
Carlos Mocholí 273a9ed8c1
Integrate `lightning_utilities.core.apply_func` (#14537) 2022-09-06 13:52:54 +00:00
Carlos Mocholí 44216fdd69
Integrate `lightning_utilities.core.imports` (#14475)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-09-06 12:56:20 +00:00
Carlos Mocholí ce0bde702a
Remove deprecated `test_tube` dependency (#14513) 2022-09-04 11:29:56 +00:00
Carlos Mocholí fed1d8dc6a
Pin protobuf (#14512) 2022-09-03 14:38:30 +00:00
Adrian Wälchli 291dc1b615
Standalone Lite CI setup (#14451)
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-01 22:13:12 +00:00
Adam Bobowski 764b348249
[App] Handling s3 rate limiting in framework (#14411)
bump of fsspec and s3fs to version supporting retry on "SlowDown" response
2022-09-01 11:12:04 +00:00
Sherin Thomas c1a7254b7a
Dependency pinning (#14463)
* deps pinned
* Apply suggestions from code review

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-31 21:24:28 +00:00
Carlos Mocholí 10adcd5d12
Remove the unused pyDeprecate dependency (#14472)
* Remove the unused pyDeprecate dependency
* CHANGELOG
2022-09-01 03:30:18 +09:00
Jirka Borovec 208bf6faa8
prepare space for fused docs (#14160)
* copy app conf

* ci + req.

* script symlink

* wip

* keep only App

* add also PL

* lightning

* artifact
2022-08-30 09:25:05 -04:00
Marc Skov Madsen 18e2a8eecd
PanelFrontend and Panel Web UI Intermediate docs (#13531)
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Marc Skov Madsen <masma@orsted.com>
Co-authored-by: Laverne Henderson <laverne.henderson@coupa.com>
Co-authored-by: Felonious-Spellfire <felonious.spellfire@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Mansy <ahmed.mansy156@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-08-30 00:33:21 +00:00
Mansy 0e30e4a5a0
[App][CI] Fix psutil requirement CI (#14413) 2022-08-26 23:55:22 +00:00
dependabot[bot] 1ad452f95a
Update mlflow requirement from <1.28.0,>=1.0.0 to >=1.0.0,<1.29.0 in /requirements (#14311)
Update mlflow requirement in /requirements

Updates the requirements on [mlflow](https://github.com/mlflow/mlflow) to permit the latest version.
- [Release notes](https://github.com/mlflow/mlflow/releases)
- [Changelog](https://github.com/mlflow/mlflow/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mlflow/mlflow/compare/1.0.0...v1.28.0)

---
updated-dependencies:
- dependency-name: mlflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-26 20:40:53 +00:00
Carlos Mocholí 3ba0f56b18
Remove support for the deprecated torchtext legacy (#14375) 2022-08-26 20:01:51 +00:00
Dmitry Frolov 2182d755c4
[CLI] Adding opportunity to see basic cluster logs (#14334)
* pinning starsessions

* pinning starsessions

* adding strict back to requirements.txt

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Duplicated

* Basic implementation

* Basic implementation

* Basic implementation

* Basic implementation

* Common things moved to log helpers file

* Decomposing logs reader classes for reusing

* Setting colors for log levels

* Manifest trimming

* Changes added to CHANGELOG

* Prettifications

* Prettifications

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Logs function name change

* Logs function name change

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* attempt to fix the pydanitc import

* Tests + command name fixes

* Extending tests

* Adding limit argument

* Unmerging CI fix

* Unmerging CI fix

* Adding fields for errors

* Adding log level fixed field width

* Adding absent typing + exeptions raising

* Adding socket error logging

* Addressing comments on cluster list function return value

* Addressing comments on adding e2e tests

* Adding version range for arrow package in reqs

* New unit tests

* arrow time parsing callback modified + unit tests

* helpers updated

* helpers updated

* helpers updated

* One more test

* CMD test fix

* CMD test fix

* CMD test fix

* CMD test fix

* CMD test fix

* LightningClient mocking

* Flaky test removed

Co-authored-by: hhsecond <sherin@grid.ai>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-23 15:48:22 -04:00
Sherin Thomas 52a4457ae3
Pinning starsessions to 1.x (#14333)
The recent release of starsessions 2.0 has broken lightning app as some of the arguments are removed. This PR also fixes a bug in our setup tools that prevents our internal # strict parameter being considered.

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-21 23:26:52 +00:00
dependabot[bot] bbb406bce9
Update ipython[all] requirement from <=8.1.1 to <8.4.1 in /requirements (#14281)
Updates the requirements on [ipython[all]](https://github.com/ipython/ipython) to permit the latest version.
- [Release notes](https://github.com/ipython/ipython/releases)
- [Commits](https://github.com/ipython/ipython/compare/rel-0.8.4...8.4.0)

---
updated-dependencies:
- dependency-name: ipython[all]
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-19 14:14:16 +09:00
dependabot[bot] bd55b56f56
Update scikit-learn requirement from <=1.1.1,>0.22.1 to >0.22.1,<1.1.3 in /requirements (#14276)
Update scikit-learn requirement in /requirements

Updates the requirements on [scikit-learn](https://github.com/scikit-learn/scikit-learn) to permit the latest version.
- [Release notes](https://github.com/scikit-learn/scikit-learn/releases)
- [Commits](https://github.com/scikit-learn/scikit-learn/compare/0.22.2...1.1.2)

---
updated-dependencies:
- dependency-name: scikit-learn
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-18 14:14:09 +02:00
dependabot[bot] caa0d594b1
Update torch requirement from <=1.12.0,>=1.9.* to >=1.9.0.a,<1.13.0 in /requirements (#14088)
* Update torch requirement in /requirements

Updates the requirements on [torch](https://github.com/pytorch/pytorch) to permit the latest version.
- [Release notes](https://github.com/pytorch/pytorch/releases)
- [Changelog](https://github.com/pytorch/pytorch/blob/master/RELEASE.md)
- [Commits](https://github.com/pytorch/pytorch/compare/v1.9.0-rc1...v1.12.1)

---
updated-dependencies:
- dependency-name: torch
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update base.txt

* Update adjust_versions.py

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-08-18 10:57:13 +00:00
dependabot[bot] 401eb2c535
Update tensorboard requirement from <2.10.0,>=2.9.1 to >=2.9.1,<2.11.0 in /requirements (#14200)
Update tensorboard requirement in /requirements

Updates the requirements on [tensorboard](https://github.com/tensorflow/tensorboard) to permit the latest version.
- [Release notes](https://github.com/tensorflow/tensorboard/releases)
- [Changelog](https://github.com/tensorflow/tensorboard/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorboard/compare/2.9.1...2.10.0)

---
updated-dependencies:
- dependency-name: tensorboard
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-18 08:45:59 +00:00
Jirka Borovec acd4805f1a
CI: clean building docs (#14216)
* CI: clean building docs

* group

* .
2022-08-16 09:28:30 -04:00
Adrian Wälchli 56533368af
Remove DeepSpeed version restriction from Lite (#13967) 2022-08-11 16:17:56 +00:00
Rick Izzo 7c8c996f6a
Feature GRID-9731: Update Lightning Cloud.py Backend to Accept Drive Specs (2/2) (#14106)
initial work adding drives to create work API from framework cloud dispatcher
2022-08-11 13:22:59 +00:00
dependabot[bot] 7e7736778b
Update onnxruntime requirement from <=1.12.0 to <1.13.0 in /requirements (#14083)
Updates the requirements on [onnxruntime](https://github.com/microsoft/onnxruntime) to permit the latest version.
- [Release notes](https://github.com/microsoft/onnxruntime/releases)
- [Changelog](https://github.com/microsoft/onnxruntime/blob/master/docs/ReleaseManagement.md)
- [Commits](https://github.com/microsoft/onnxruntime/compare/v0.1.4...v1.12.1)

---
updated-dependencies:
- dependency-name: onnxruntime
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-10 14:27:35 -04:00
dependabot[bot] f11f1e2bb4
Update gcsfs requirement from <2022.6.0,>=2021.5.0 to >=2021.5.0,<2022.8.0 in /requirements (#14079)
Update gcsfs requirement in /requirements

Updates the requirements on [gcsfs](https://github.com/fsspec/gcsfs) to permit the latest version.
- [Release notes](https://github.com/fsspec/gcsfs/releases)
- [Commits](https://github.com/fsspec/gcsfs/compare/2021.05.0...2022.7.1)

---
updated-dependencies:
- dependency-name: gcsfs
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-10 19:40:34 +02:00
Jirka Borovec 3966f959aa
relax `docker` requirement (#14009) 2022-08-10 13:38:39 -04:00
Luca Medeiros 8fa9e8651d
Update collect env details and issue template (#14017)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-08-10 00:38:18 +00:00
dependabot[bot] 61a9f3a9bc
Update tqdm requirement from <=4.63.0,>=4.57.0 to >=4.57.0,<4.65.0 in /requirements (#13875)
Update tqdm requirement in /requirements

Updates the requirements on [tqdm](https://github.com/tqdm/tqdm) to permit the latest version.
- [Release notes](https://github.com/tqdm/tqdm/releases)
- [Commits](https://github.com/tqdm/tqdm/compare/v4.57.0...v4.64.0)

---
updated-dependencies:
- dependency-name: tqdm
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-08 12:53:57 +00:00
dependabot[bot] 5c9b352eea
Update wandb requirement from <0.12.20,>=0.10.22 to >=0.10.22,<0.13.2 in /requirements (#14080) 2022-08-08 09:25:15 +00:00
Jirka Borovec 5c05719f27
Freeze requirements for CI (#14007)
* free requirements

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* typo

* typo

* ui

* mypy

* todo

* mypy

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* mypy

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-08-08 06:15:54 +00:00
Yurij Mikhalevich 9d02ad761c
feature(ui): Lightning AI doc theme update, integrates global header and footer with docs (#14053) 2022-08-05 14:34:27 -04:00
Jirka Borovec 89b72f7479
relax `redis` requirement (#14008) 2022-08-05 13:51:30 -04:00
dependabot[bot] c6cbc3dcea
Update mlflow requirement from <1.27.0,>=1.0.0 to >=1.0.0,<1.28.0 in /requirements (#14024)
Update mlflow requirement in /requirements

Updates the requirements on [mlflow](https://github.com/mlflow/mlflow) to permit the latest version.
- [Release notes](https://github.com/mlflow/mlflow/releases)
- [Changelog](https://github.com/mlflow/mlflow/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mlflow/mlflow/compare/1.0.0...v1.27.0)

---
updated-dependencies:
- dependency-name: mlflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-05 10:17:55 +09:00
dependabot[bot] 2190b47ae7
Update comet-ml requirement from <3.31.6,>=3.1.12 to >=3.1.12,<3.31.8 in /requirements (#13874) 2022-08-04 15:48:26 +00:00
Jirka Borovec e513638de8
adding explain notes for requirements (#13872)
* adding explain notes for requirements
* Apply suggestions from code review

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-08-03 21:43:51 +00:00
Mansy 5f1cb913bb
Relax lightning app dependency requirements (#13998)
* [App] Relax lightning app requirements

Co-authored-by: manskx <ahmed.mansy156@gmail.com>
2022-08-03 20:24:51 +00:00
thomas chaton 5479c60b22
Reduce state size (#13970) 2022-08-03 13:47:16 +00:00
Jirka Borovec 47833dfd1a
pkg: parse local versions (#13933)
* pkg: parse local versions

* offline

* str

* manifest

* ci
2022-08-01 09:08:43 -04:00
Carlos Mocholí 406cea7146
Support DeepSpeed <0.7.0 (#13859)
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2022-07-28 14:38:51 +00:00
Carlos Mocholí 1299e4f984
Run GPU tests with PyTorch 1.12 (#13716)
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-07-28 19:37:57 +05:30
Carlos Mocholí 511875e567
Support DeepSpeed >=0.6.0, <0.6.5 (#13863)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-07-27 18:57:52 +02:00
dependabot[bot] 56b1e1aaaa
Update torchmetrics requirement from <0.9.2,>=0.7.0 to >=0.7.0,<0.9.3 in /requirements (#13528)
Update torchmetrics requirement in /requirements

Updates the requirements on [torchmetrics](https://github.com/Lightning-AI/metrics) to permit the latest version.
- [Release notes](https://github.com/Lightning-AI/metrics/releases)
- [Changelog](https://github.com/Lightning-AI/metrics/blob/master/CHANGELOG.md)
- [Commits](https://github.com/Lightning-AI/metrics/compare/v0.7.0...v0.9.2)

---
updated-dependencies:
- dependency-name: torchmetrics
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-27 09:22:34 +00:00
dependabot[bot] acdc1f1378
Update torchtext requirement from <=0.12.0,>=0.10.* to >=0.10.0.a,<0.14.0 in /requirements (#13758)
* Update torchtext requirement in /requirements

Updates the requirements on [torchtext](https://github.com/pytorch/text) to permit the latest version.
- [Release notes](https://github.com/pytorch/text/releases)
- [Commits](https://github.com/pytorch/text/compare/v0.10.0-rc1...v0.13.0)

---
updated-dependencies:
- dependency-name: torchtext
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update requirements/pytorch/extra.txt

Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-07-27 08:51:52 +00:00
Luca Medeiros 0cbfe08a41
Add lightning apps to info_packages of collect_env_details (#13815) 2022-07-26 18:04:36 +02:00
Mauricio Villegas 1b31039c58
Update LightningCLI test for new support in latest release of jsonargparse (#13805) 2022-07-25 09:25:42 +00:00
Jirka Borovec e2ec51a5a2
App: prune requirements duplicity (#13739)
prune requirements

Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-07-23 11:17:23 +00:00
Gautier Dagan 0e5312833f
fix mypy errors for loggers/wandb.py (#13483)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-07-21 01:07:24 +00:00
dependabot[bot] df802895ad
Update typing-extensions requirement from <4.2.1,>=4.0.0 to >=4.0.0,<4.3.1 in /requirements (#13529)
Update typing-extensions requirement in /requirements

Updates the requirements on [typing-extensions](https://github.com/python/typing_extensions) to permit the latest version.
- [Release notes](https://github.com/python/typing_extensions/releases)
- [Changelog](https://github.com/python/typing_extensions/blob/main/CHANGELOG.md)
- [Commits](https://github.com/python/typing_extensions/compare/4.0.0...4.3.0)

---
updated-dependencies:
- dependency-name: typing-extensions
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-20 11:01:39 +00:00
Jirka Borovec aa62fe36df
add testing PT 1.12 (#13386)
* add testing PT 1.12
* Fix quantization tests
* Fix another set of tests
* Fix check since https://github.com/pytorch/pytorch/pull/80139 is only going to be available for 1.13
* Skip this test for now for 1.12

Co-authored-by: SeanNaren <sean@grid.ai>
2022-07-15 19:41:23 +02:00
thomas chaton 5e26840f94
Introduce ServableModuleValidator Callback (#13614)
* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* Update tests/tests_pytorch/serve/test_servable_module_validator.py

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Update tests/tests_pytorch/serve/test_servable_module_validator.py

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Update src/pytorch_lightning/serve/servable_module_validator.py

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Update src/pytorch_lightning/serve/servable_module_validator.py

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Update src/pytorch_lightning/serve/servable_module_validator.py

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Typing improvements

* wip

* update doc

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* Update examples/pl_servable_module/production.py

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* update

* update

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-07-15 11:07:40 -04:00
Carlos Mocholí 8355ba1260
Run only CUDA tests on Azure GPU CI (#13651) 2022-07-15 13:51:23 +02:00
otaj 4e2ddc4f77
Increase typing_extensions minimal version (#13657)
* Increase typing_extensions requirement

* it's rich!
2022-07-14 11:42:22 -04:00
dependabot[bot] 0ed1fce3cf
Update wandb requirement from <0.12.19,>=0.8.21 to >=0.8.21,<0.12.20 in /requirements (#13415)
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-06-29 22:02:07 -04:00
dependabot[bot] eae92fd3ff
Update comet-ml requirement from <=3.28.2,>=3.1.12 to >=3.1.12,<3.31.6 in /requirements (#13414)
Update comet-ml requirement in /requirements

Updates the requirements on [comet-ml](https://www.comet.ml) to permit the latest version.

---
updated-dependencies:
- dependency-name: comet-ml
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-29 19:55:47 +00:00
Akihiro Nitta 55e347ba60
Unpin `protobuf` version and update `tensorboard` version (#13259)
* Remove protobuf from base req

* Update tensorboard version

Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-06-29 18:44:46 +00:00
Jirka Borovec b137ef7134
CI: fix requirements freeze (#13441)
* allow freeze

* ci

* typo

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* ipu

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-06-29 09:35:57 -04:00
dependabot[bot] ec3c963ea2
Update numpy requirement from <1.22.5,>=1.17.2 to >=1.17.2,<1.23.1 in /requirements (#13413)
Update numpy requirement in /requirements

Updates the requirements on [numpy](https://github.com/numpy/numpy) to permit the latest version.
- [Release notes](https://github.com/numpy/numpy/releases)
- [Changelog](https://github.com/numpy/numpy/blob/main/doc/HOWTO_RELEASE.rst)
- [Commits](https://github.com/numpy/numpy/compare/v1.17.2...v1.23.0)

---
updated-dependencies:
- dependency-name: numpy
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-28 10:31:51 -04:00
dependabot[bot] 59fb0323c2
Update neptune-client requirement from <0.16.3,>=0.10.0 to >=0.10.0,<0.16.4 in /requirements (#13416)
Update neptune-client requirement in /requirements

Updates the requirements on [neptune-client](https://github.com/neptune-ai/neptune-client) to permit the latest version.
- [Release notes](https://github.com/neptune-ai/neptune-client/releases)
- [Changelog](https://github.com/neptune-ai/neptune-client/blob/master/CHANGELOG.md)
- [Commits](https://github.com/neptune-ai/neptune-client/compare/0.10.0...0.16.3)

---
updated-dependencies:
- dependency-name: neptune-client
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-28 10:31:38 -04:00
Jirka Borovec d2e4e7e003
create meta package [RFC] (#13327)
* placeholder

* move setup_tools & abstract about

* adjust lightning-app

* notes

* lightning about

* lightning init

* CI check

* ci

* install

* adjust manifest & mv chlog

* manifest

* pkg

* mv __setup__

* parse_requirements

* lit

* ci - pytorch

* wrap func

* ci

* cd draft

* generate lit

* pkg

* utf-8

* root pkg

* req.

* ver

* mypy

* try check

* meta pkg

* meta pkg - vars

* meta pkg - pruning

* meta pkg - fixing

* fix PL for meta

* multi-line wrapper

* hack manifest

* ci

* fix docstr

* fixing

* ci & mypy

* links
2022-06-27 09:34:18 -04:00
dependabot[bot] 038d076fd4
Update fsspec[http] requirement from !=2021.06.0,<=2022.2.0,>=2021.05.0 to >=2021.05.0,!=2021.06.0,<2022.6.0 in /requirements (#13366)
Update fsspec[http] requirement in /requirements

Updates the requirements on [fsspec[http]](https://github.com/fsspec/filesystem_spec) to permit the latest version.
- [Release notes](https://github.com/fsspec/filesystem_spec/releases)
- [Commits](https://github.com/fsspec/filesystem_spec/compare/2021.05.0...2022.5.0)

---
updated-dependencies:
- dependency-name: fsspec[http]
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-22 17:22:16 +02:00
dependabot[bot] 90d2f3e787
Update numpy requirement from <=1.22.3,>=1.17.2 to >=1.17.2,<1.22.5 in /requirements (#13361)
Update numpy requirement in /requirements

Updates the requirements on [numpy](https://github.com/numpy/numpy) to permit the latest version.
- [Release notes](https://github.com/numpy/numpy/releases)
- [Changelog](https://github.com/numpy/numpy/blob/main/doc/HOWTO_RELEASE.rst)
- [Commits](https://github.com/numpy/numpy/compare/v1.17.2...v1.22.4)

---
updated-dependencies:
- dependency-name: numpy
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-22 13:15:55 +00:00
dependabot[bot] 3fe4874cec
Update omegaconf requirement from <=2.1.*,>=2.0.5 to >=2.0.5,<2.3.0 in /requirements (#13167)
Update omegaconf requirement in /requirements

Updates the requirements on [omegaconf](https://github.com/omry/omegaconf) to permit the latest version.
- [Release notes](https://github.com/omry/omegaconf/releases)
- [Changelog](https://github.com/omry/omegaconf/blob/master/NEWS.md)
- [Commits](https://github.com/omry/omegaconf/compare/v2.0.5...v2.2.1)

---
updated-dependencies:
- dependency-name: omegaconf
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-22 12:58:43 +00:00
dependabot[bot] dc6143cd8f
Update hydra-core requirement from <=1.1.*,>=1.0.5 to >=1.0.5,<1.3.0 in /requirements (#13309)
Update hydra-core requirement in /requirements

Updates the requirements on [hydra-core](https://github.com/facebookresearch/hydra) to permit the latest version.
- [Release notes](https://github.com/facebookresearch/hydra/releases)
- [Changelog](https://github.com/facebookresearch/hydra/blob/main/NEWS.md)
- [Commits](https://github.com/facebookresearch/hydra/compare/v1.0.5...v1.2.0)

---
updated-dependencies:
- dependency-name: hydra-core
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-22 11:23:28 +00:00
dependabot[bot] de0f236e7c
Update horovod requirement from !=0.24.0,<=0.24.3,>=0.21.2 to >=0.21.2,!=0.24.0,<0.25.1 in /requirements (#13363)
Update horovod requirement in /requirements

Updates the requirements on [horovod](https://github.com/horovod/horovod) to permit the latest version.
- [Release notes](https://github.com/horovod/horovod/releases)
- [Changelog](https://github.com/horovod/horovod/blob/master/CHANGELOG.md)
- [Commits](https://github.com/horovod/horovod/compare/v0.21.2...v0.25.0)

---
updated-dependencies:
- dependency-name: horovod
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-22 11:23:15 +00:00
dependabot[bot] 68fa83632a
Update gcsfs requirement from <=2022.2.0,>=2021.5.0 to >=2021.5.0,<2022.6.0 in /requirements (#13168)
Update gcsfs requirement in /requirements

Updates the requirements on [gcsfs](https://github.com/fsspec/gcsfs) to permit the latest version.
- [Release notes](https://github.com/fsspec/gcsfs/releases)
- [Commits](https://github.com/fsspec/gcsfs/compare/2021.05.0...2022.5.0)

---
updated-dependencies:
- dependency-name: gcsfs
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-22 11:51:47 +02:00
dependabot[bot] 71f4c5fcb6
Update gym[classic_control] requirement from <=0.23.1,>=0.17.0 to >=0.17.0,<0.24.2 in /requirements (#13307)
Update gym[classic_control] requirement in /requirements

Updates the requirements on [gym[classic_control]](https://github.com/Farama-Foundation/gym-docs) to permit the latest version.
- [Release notes](https://github.com/Farama-Foundation/gym-docs/releases)
- [Commits](https://github.com/Farama-Foundation/gym-docs/commits)

---
updated-dependencies:
- dependency-name: gym[classic_control]
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-22 11:51:38 +02:00
dependabot[bot] e02b786bde
Update wandb requirement from <0.12.17,>=0.8.21 to >=0.8.21,<0.12.19 in /requirements (#13308)
Update wandb requirement in /requirements

Updates the requirements on [wandb](https://github.com/wandb/client) to permit the latest version.
- [Release notes](https://github.com/wandb/client/releases)
- [Changelog](https://github.com/wandb/client/blob/master/CHANGELOG.md)
- [Commits](https://github.com/wandb/client/compare/v0.8.21...v0.12.18)

---
updated-dependencies:
- dependency-name: wandb
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-22 11:51:23 +02:00
dependabot[bot] bbc51d16a3
Update torchmetrics requirement from <=0.7.2,>=0.4.1 to >=0.4.1,<0.9.2 in /requirements (#13275)
Update torchmetrics requirement in /requirements

Updates the requirements on [torchmetrics](https://github.com/PyTorchLightning/metrics) to permit the latest version.
- [Release notes](https://github.com/PyTorchLightning/metrics/releases)
- [Changelog](https://github.com/PyTorchLightning/metrics/blob/master/CHANGELOG.md)
- [Commits](https://github.com/PyTorchLightning/metrics/compare/v0.4.1...v0.9.1)

---
updated-dependencies:
- dependency-name: torchmetrics
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-21 22:09:11 +00:00
Mauricio Villegas 6371d7c615
Fix LightningCLI signature parameter resolving for some lightning classes (#13283)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-06-21 21:58:41 +00:00
Carlos Mocholí ad87d2cad0
Future 5/n: Move requirements (#13306)
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-06-21 17:11:33 +02:00
Jirka Borovec 8ceab223c0
Fix repository links (#13304)
* GH org rename Lightning-AI

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* repo name

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-06-15 19:33:43 -04:00
dependabot[bot] c048f2cc5a
Update wandb requirement from <=0.12.11,>=0.8.21 to >=0.8.21,<0.12.17 in /requirements (#13051)
* Update wandb requirement in /requirements

Updates the requirements on [wandb](https://github.com/wandb/client) to permit the latest version.
- [Release notes](https://github.com/wandb/client/releases)
- [Changelog](https://github.com/wandb/client/blob/master/CHANGELOG.md)
- [Commits](https://github.com/wandb/client/compare/v0.8.21...v0.12.16)

---
updated-dependencies:
- dependency-name: wandb
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-06-15 15:11:08 -04:00
Jirka Borovec 759e89df21
Future 1/n: package in src/ folder (#13293)
* move: pytorch_lightning >> src/

* update setup & install

* update CI

* ci

* update CI for examples

* Self review

* mypy

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* ci

* make

* docs

* typo

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* ci: gpu

* .

* hpu

* typing

* docs

* tpu

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-06-14 20:54:55 -04:00
Carlos Mocholí 0cf9d73d28
Drop PyTorch 1.8 support (#13155)
* Drop PyTorch 1.8 support

* Missed update

* Skip profiler test until supported

* Upgrade ipu dockerfile pytorch version

* Update XLA version
2022-06-14 20:46:44 -04:00
dependabot[bot] a62f2d28b8
Update rich requirement from !=10.15.*,<=12.0.0,>=10.2.2 to >=10.2.2,!=10.15.0.a,<13.0.0 in /requirements (#13047)
* Update rich requirement in /requirements

Updates the requirements on [rich](https://github.com/willmcgugan/rich) to permit the latest version.
- [Release notes](https://github.com/willmcgugan/rich/releases)
- [Changelog](https://github.com/Textualize/rich/blob/master/CHANGELOG.md)
- [Commits](https://github.com/willmcgugan/rich/compare/v10.2.2...v12.4.1)

---
updated-dependencies:
- dependency-name: rich
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-06-14 17:17:57 +00:00
Mauricio Villegas 79de6a95fb
LightningCLI natively support callback list append (#13129)
* LightningCLI natively support callback list append.

* Update jsonargparse version

* Handle case where callbacks is not a list.

* Fix PEP8 issue.

* Handle mypy false positive

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-06-02 10:00:02 +09:00
Mauricio Villegas 18cdfab83b
Register torch's unresolvable import paths in cli module (#13153)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-06-01 11:00:57 +02:00
Carlos Mocholí 37804078bb Revert "Update deepspeed requirement from <0.6.0 to <0.7.0 in /requirements (#13048)" (#13177)
This reverts commit e19babc986.
2022-05-31 20:21:14 +02:00
Akihiro Nitta 40dddc8a9b Pin protobuf version (#13177) 2022-05-31 20:21:14 +02:00
dependabot[bot] 9ac5cca842
Update typing-extensions requirement from <=4.1.1,>=4.0.0 to >=4.0.0,<4.2.1 in /requirements (#13054)
* Update typing-extensions requirement in /requirements

Updates the requirements on [typing-extensions](https://github.com/python/typing) to permit the latest version.
- [Release notes](https://github.com/python/typing/releases)
- [Changelog](https://github.com/python/typing/blob/master/typing_extensions/CHANGELOG.md)
- [Commits](https://github.com/python/typing/compare/4.0.0...4.2.0)

---
updated-dependencies:
- dependency-name: typing-extensions
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-27 17:55:23 +02:00
dependabot[bot] e19babc986
Update deepspeed requirement from <0.6.0 to <0.7.0 in /requirements (#13048)
* Update deepspeed requirement from <0.6.0 to <0.7.0 in /requirements

Updates the requirements on [deepspeed](https://github.com/microsoft/DeepSpeed) to permit the latest version.
- [Release notes](https://github.com/microsoft/DeepSpeed/releases)
- [Commits](https://github.com/microsoft/DeepSpeed/compare/v0.1.0...v0.6.4)

---
updated-dependencies:
- dependency-name: deepspeed
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-27 17:54:27 +02:00
dependabot[bot] d9c97cdac5
Update tensorboard requirement from <=2.8.0,>=2.2.0 to >=2.2.0,<2.10.0 in /requirements (#13049)
* Update tensorboard requirement in /requirements

Updates the requirements on [tensorboard](https://github.com/tensorflow/tensorboard) to permit the latest version.
- [Release notes](https://github.com/tensorflow/tensorboard/releases)
- [Changelog](https://github.com/tensorflow/tensorboard/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorboard/compare/2.2.0...2.9.0)

---
updated-dependencies:
- dependency-name: tensorboard
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-27 17:54:15 +02:00
dependabot[bot] 5cf0e376a5
Update jsonargparse[signatures] requirement from <=4.7.1,>=4.7.1 to >=4.7.1,<4.7.4 in /requirements (#13052)
* Update jsonargparse[signatures] requirement in /requirements

Updates the requirements on [jsonargparse[signatures]](https://github.com/omni-us/jsonargparse) to permit the latest version.
- [Release notes](https://github.com/omni-us/jsonargparse/releases)
- [Changelog](https://github.com/omni-us/jsonargparse/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/omni-us/jsonargparse/compare/v4.7.1...v4.7.3)

---
updated-dependencies:
- dependency-name: jsonargparse[signatures]
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-27 17:53:47 +02:00
dependabot[bot] 7172c21ee5
Update matplotlib requirement from <=3.5.1,>3.1 to >3.1,<3.5.3 in /requirements (#13053)
* Update matplotlib requirement in /requirements

Updates the requirements on [matplotlib](https://github.com/matplotlib/matplotlib) to permit the latest version.
- [Release notes](https://github.com/matplotlib/matplotlib/releases)
- [Commits](https://github.com/matplotlib/matplotlib/compare/v3.1.1...v3.5.2)

---
updated-dependencies:
- dependency-name: matplotlib
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-27 17:53:37 +02:00
dependabot[bot] 0447720d7b
Update neptune-client requirement from <=0.15.2,>=0.10.0 to >=0.10.0,<0.16.3 in /requirements (#13056)
* Update neptune-client requirement in /requirements

Updates the requirements on [neptune-client](https://github.com/neptune-ai/neptune-client) to permit the latest version.
- [Release notes](https://github.com/neptune-ai/neptune-client/releases)
- [Changelog](https://github.com/neptune-ai/neptune-client/blob/master/CHANGELOG.md)
- [Commits](https://github.com/neptune-ai/neptune-client/compare/0.10.0...0.16.2)

---
updated-dependencies:
- dependency-name: neptune-client
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-27 17:53:14 +02:00
dependabot[bot] a3c0a4738f
Update mlflow requirement from <=1.24.0,>=1.0.0 to >=1.0.0,<1.27.0 in /requirements (#13127)
* Update mlflow requirement in /requirements

Updates the requirements on [mlflow](https://github.com/mlflow/mlflow) to permit the latest version.
- [Release notes](https://github.com/mlflow/mlflow/releases)
- [Changelog](https://github.com/mlflow/mlflow/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mlflow/mlflow/compare/1.0.0...v1.26.0)

---
updated-dependencies:
- dependency-name: mlflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-05-27 12:42:54 +00:00
Akihiro Nitta 2dc14e77cd
Use coverage>=6.4 (#13132) 2022-05-24 18:01:26 +01:00
dependabot[bot] 106b4bbfdd
Remove twine dependency from requirements (#13050)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-05-12 22:20:04 -04:00
Jirka Borovec fec9a09672
add freeze for development and full range for install (#12994)
* freeze versions

* unfreeze

* dependabot

* Apply suggestions from code review

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* fix all req

* ...

* use base

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix refs

* Apply suggestions from code review

Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>

* Apply suggestions from code review

* dockers

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-05-12 09:14:18 -04:00
Eric Wiener 3f78c4ca7a
Track CPU stats with DeviceStatsMonitor (#11795)
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-10 10:57:38 +00:00
Jirka Borovec 783ec43a85
parse strategies as own extras (#12975)
* parse strategies as own extras

* prune devel

* Update Makefile

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* revert parse_requirements

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-09 09:25:53 -04:00
Sean Naren 1a502c061c
[1/2] Collaborative Strategy (#12842) 2022-05-05 16:06:26 +00:00
Jirka Borovec bb51e2a55b
Merge pull request #12723 from PyTorchLightning/req/strategies
Separate strategies' requirements
2022-05-04 10:06:02 -04:00
Carlos Mocholí cac02a04ba
Update `jsonargparse` to unblock master (#12884)
Co-authored-by: Mauricio Villegas <mauricio_ville@yahoo.com>
2022-04-26 16:55:07 +00:00
stanbiryukov 8034919c44
Remove deprecated `TestTubeLogger` (#12859)
* remove deprecated test_tube logger

* remove testube from logger __init__

* remove relevant testtube tests

* update CHANGELOG with removal of deprecated `TestTubeLogger`
2022-04-24 20:05:48 +02:00
William Falcon 908e05880d
docs refactor 3/n (#12795)
* updated titles + css

* updated titles + css

* levels structure

* levels structure

* levels structure

* adding level indexes

* finished intro guide layout

* finished intro guide layout

* general titles

* general titles

* added movie

* added movie

* finished 15 mins

* levels

* added core levels

* added core levels

* fixed api reference on the left

* gpu guides

* gpu guides

* gpu guides

* gpu guides

* precision

* hpu guide

* added ipu

* added ipu

* added ipu

* added ckpt docs

* finished basic logging

* intermediate

* intermediate

* intermediate

* fixed

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* added logger stuff

* added logger stuff

* added logger stuff

* added logger stuff

* added logger stuff

* ic

* added inconsolata

* added inconsolata

* added inconsolata

* added inconsolata

* added inconsolata

* added inconsolata

* added inconsolata

* updated menu

* added basic cloud docs

* added basic cloud docs

* added basic cloud docs

* added basic cloud docs

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* added demos folder

* added demos folder

* added demos folder

* added demos folder

* added demos folder

* added demos folder

* twocolumns directive

* twocols

* twocols

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* updated titles + css

* levels structure

* adding level indexes

* finished intro guide layout

* general titles

* added movie

* finished 15 mins

* levels

* added core levels

* fixed api reference on the left

* gpu guides

* precision

* hpu guide

* added ipu

* added ckpt docs

* finished basic logging

* intermediate

* fixed margins

* added logger stuff

* ic

* added inconsolata

* updated menu

* added basic cloud docs

* ic

* added demos folder

* twocolumns directive

* registry

* cleaning up

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* deconflict

* deconflict

* deconflict

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add testsetup sections wherever needed; fix errors in building docs

* pre-commit fixes

* Fix duplicate label

* minor nit with pre-commit

* Fix labels

* More changes...

* require

* debug & cli

* prec & model & visu

* fix references

* fix references

* fix refs

* fix refs - model_parallel

* fix references

* prune testsetup with global

* refs in index

* Fix duplicate label errors

* Update orphan docs

* Update orphan docs

* Update orphan docs

* fix links

* Fix genindex and search index

* fix refs

* fix refs

* Fix index rst related issues

* fix refs

* inc to rst

* Fix links ref

* fix more references

* fix refs

* deconflict

* errors

* errors

* errors

* fix refs

* fix refs

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix warnings

* Fix LightningCLI errors

* Fix LightningCLI errors

* Fix LightningCLI errors

* Fix LightningCLI errors

* fix doc build

* Duplicate Label fix (docs) (#12800)

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

* ignore typing in demo folder

* Ignore demos for mypy

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kushashwa Ravi Shrimali <kushashwaravishrimali@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: otaj <ota@grid.ai>
2022-04-19 14:15:47 -04:00
Mauricio Villegas 2f2a516de9
Update LightningCLI tests to reflect changes in jsonargparse 4.6.0 (#12704) 2022-04-11 14:00:48 +02:00
Carlos Mocholí 124b529088
Add version header to CLI config files (#12532) 2022-04-07 17:52:51 +05:30
Carlos Mocholí 939d56c6d6
Drop PyTorch 1.7 support (#12432) 2022-03-27 21:31:20 +00:00
Kaushik B 1dc57f9573
Fix: Update sphinx-autodoc-typehints minimal version (#12468) 2022-03-27 14:31:28 +00:00
Jerome Anand 812c2dc3d3
Add support for Habana accelerator (HPU) (#11808)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: four4fish <88516121+four4fish@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: jjenniferdai <89552168+jjenniferdai@users.noreply.github.com>
Co-authored-by: Kushashwa Ravi Shrimali <kushashwaravishrimali@gmail.com>
Co-authored-by: Akarsha Rao <94624926+raoakarsha@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.comk-Pro.local>
2022-03-25 10:24:52 +00:00
Ethan Harris c099c8be5d
Fix: freeze Jinja2 version (#12444) 2022-03-24 16:46:08 +00:00
Aki Nitta 09d1296040
Avoid `rich` 10.15.0 and 10.15.1 (#12293)
* Update rich version

* Update requirements/extra.txt

Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>

Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2022-03-18 19:14:43 +00:00
Jirka Borovec 1144673cd9
CI: sanity check for req. pkgs (#11819)
* CI: sanity check for req. pkgs
* scripts
* rename
* gcsfs ?
* rich !
* install extra
* move
* set -e

Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-03-11 09:20:47 +00:00
Jirka Borovec 8577ef7bba
Skip horovod 0.24.0 only (#12248)
* try skip horovod 0.24.0 only
* HOROVOD_BUILD_CUDA_CC_LIST
* fix test

Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-03-10 16:01:08 +00:00
Kushashwa Ravi Shrimali 821ca7e85d
Drop PyTorch 1.7 testing from the CI (#12191)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
2022-03-08 19:02:32 +01:00
Adrian Wälchli 0db85d633c
Pin horovod to <0.24 (#12234) 2022-03-04 22:16:23 +00:00
Mauricio Villegas 54b9a85227
Unit test for CLI with subcommands and a common default config file (#12061)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-02-28 10:17:49 +00:00
Adrian Wälchli 923b30dc51
Fix import error when running doctests for RL examples (#12010)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-02-19 21:57:02 +01:00
Akihiro Nitta f79d75d4b5 Pin myst-parser<0.17 2022-02-14 09:19:49 -05:00
Carlos Mocholí 77a9253b04
Prepare for `torch==1.11` (#11679) 2022-02-02 19:41:17 +00:00
Aki Nitta 11e1e3e6f2
Update torch version matrix (#11649) 2022-01-27 20:04:34 -05:00
Aki Nitta cfb0411b78
Merge pull request #11635 from PyTorchLightning/ci/fix-term
Pin `coverage<6.3`
2022-01-27 16:25:12 -05:00
Rohit Gupta 34c62da37d
pin sphinx-autodoc-typehints version to v1.15 (#11400) 2022-01-11 00:12:53 +01:00
Carlos Mocholí f37bd4677d
Update mypy (#11096) 2021-12-16 17:53:12 +01:00
Carlos Mocholí 9e56290e2a
Support torch 1.10.1 (#11095) 2021-12-15 19:23:31 -08:00
Ethan Harris ff20af41fd
Fix mathjax in RTD build (#10889)
* Update docs.txt
* Update conf.py
* Update .readthedocs.yml
2021-12-02 11:46:57 +00:00
Carlos Mocholí d3b7492bd0
[CLI] Add support for `--key.help=class` (#10767) 2021-11-29 14:12:53 +00:00
Carlos Mocholí e1bf54c944
Tune Conda CI timeout and other minor improvements (#10769) 2021-11-28 17:58:03 +00:00
Mauricio Villegas 5d748e560b
LightningCLI changes for jsonargparse>=4.0.0 (#10426)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-11-19 17:03:14 +00:00
Carlos Mocholí 3d2d0f2536
MANIFEST.in and setup.py clean-up (#7614) 2021-11-19 15:38:42 +01:00
Carlos Mocholí 5b90253a53
Drop torch 1.6 support (#10367) 2021-11-08 11:29:39 +00:00
Adrian Wälchli 4a4a27db05
Update docutils package version in requirements.txt (#10158) 2021-10-26 16:32:47 +00:00
Carlos Mocholí a0e45dc071
Some minor CI cleanup (#10088) 2021-10-26 13:58:20 +02:00
kingyiusuen 2ed92ecabb
Rerun flaky profiler tests on failure (#10035) 2021-10-20 18:57:04 +05:30
Danielle Pintz c2e3ec164a
Add torch v1.11.0 to the list of versions in adjust_versions.py (#9679) 2021-09-24 01:27:16 -07:00
Carlos Mocholí d022f6ff60
Update versions after recent PyTorch releases (#9623) 2021-09-21 10:49:49 -07:00
Carlos Mocholí bbcb977851
[CLI] Shorthand notation to instantiate optimizers and lr schedulers [2/3] (#9565) 2021-09-17 18:00:46 +01:00
Jakub Kuszneruk ee3787216a
Adapt `NeptuneLogger` to new `neptune-client` api (#6867)
* Initial split to NeptuneLegacyLogger and NeptuneLogger

* Adapt NeptuneLogger to neptune-pytorch-lightning repo version

* Fix stylecheck and tests

* Fix style and PR suggestions

* Expect Run object in NeptuneLogger.init

* Model checkpoint support and restructured tests

* Reformat code - use " instead of '

* Fix logging INTEGRATION_VERSION_KEY

* Update CHANGELOG.md

* Fix stylecheck

* Remove NeptuneLegacyLogger

* updated neptune-related docstrings

* PR suggestions

* update CODEOWERS file
* move import logic to imports.py
* minor neptune.py improvements

* formatting fixes and minor updates

* Fix generation of docs

* formatting fixes and minor updates

* fix

* PR fixes vol. 2

* define return type of _dict_paths method
* bump required version of `neptune-client`

* Enable log_* functions

* Update pytorch_lightning/loggers/neptune.py

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* Revert "Enable log_* functions"

This reverts commit 050a436899b7f3582c0455dc27b171335b85a3a5.

* Make global helper lists internal

* Logger's `name` and `version` methods return proper results

* Initialize Run and its name and id at logger init level

* Make _init_run_instance static

* Add pre-commit hook code changes.

* Fix blacken-docs check

* Fix neptune doctests and test_all

* added docs comment about neptune-specific syntax

* added docs comment about neptune-specific syntax in the loggers.rst

* fix

* Add pickling test

* added myself to neptune codeowners

* Enable some of deprecated log_* functions

* Restore _run_instance for unpickled logger

* Add `step` parameter to log_* functions

* Fix stylecheck

* Fix checkstyle

* Fix checkstyle

* Update pytorch_lightning/loggers/neptune.py

Co-authored-by: thomas chaton <thomas@grid.ai>

* Fix tests

* Fix stylecheck

* fixed project name

* Fix windows tests

* Fix stylechecks

* Fix neptune docs tests

* docformatter fixes

* De-duplicate legacy_kwargs_msg

* Update .github/CODEOWNERS

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

Co-authored-by: kamil-kaczmarek <kamil.kaczmarek@neptune.ml>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-09-10 18:48:58 +02:00
Danielle Pintz 160e7e1289
Deprecate LightningModule.get_progress_bar_dict (#8985)
* Move get_progress_bar_dict from lightning module to progress bar callback
2021-09-09 20:53:47 +00:00
Jirka Borovec 6e124e7207
CI: precommit - docformatter (#8584)
* CI: precommit - docformatter
* fix deprecated

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-09-06 12:49:09 +00:00
Carlos Mocholí 0dfc6a18bd
Call any trainer function from the `LightningCLI` (#7508) 2021-08-28 04:43:14 +00:00
Jirka Borovec f67892ea96
CI: yesqa (#8564)
* add yesqa
* fix flake8

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-08-02 16:05:56 +00:00
Carlos Mocholí e63968ab88
Add `pyupgrade` to `pre-commit` (#8557)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-07-26 14:38:12 +02:00
Carlos Mocholí a64cc37394
Replace `yapf` with `black` (#7783)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-07-26 13:37:35 +02:00
Ethan Harris 52526c20b5
Add support for functions to be parsed by the Lightning CLI in addition to Types (#8400)
* Initial commit

* Update docstrings

* Update CHANGELOG.md

* Fix mypy

* Fixes

* Fixes

* Update to comments

* Fix

* mypy

* Update on comments

* Update

* Fix mypy

* protected

Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-07-26 10:53:48 +02:00
Jirka Borovec abbcfa1ab7
fix CI for PT 1.10 (#8526)
* fix CI for PT 1.10
* Apply suggestions from code review

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-07-23 19:24:31 +02:00
Jirka Borovec 74a09a23f1
CI: support PT 1.10 (#8133)
* prepare PT 1.10

* dockers

* fixes

* readme
2021-07-14 18:04:33 +03:00
Carlos Mocholí 6ce77a102b
Set minimum PyTorch version to 1.6 (#8288)
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2021-07-13 17:12:49 +00:00
Carlos Mocholí 1efd6d20ac
Remove pep8speaks (#8392) 2021-07-13 15:19:24 +00:00
Carlos Mocholí c5a120ed9d
Update to Mypy>0.9 (#8386) 2021-07-13 08:23:36 +02:00
Ethan Harris e5732a1158
Temporarily pin sphinx version (#8377) 2021-07-12 09:35:44 +00:00
Mauricio Villegas 7d3452a000
LightningCLI documentation improvements (#8303)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-07-08 12:35:26 +05:30
Kaushik B 5cef9772a4
Add tests for GCS filesystem (#7946) 2021-07-05 12:16:32 +00:00
Mauricio Villegas 3c74502919
Add support for optimizers and learning rate schedulers to LightningCLI (#8093)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-07-01 12:04:11 +02:00
Carlos Mocholí 2c43bfc5ef
GPU CI - run torch 1.8 (LTS) (#8116) 2021-06-24 16:56:43 +00:00
Jirka Borovec 7978a5376d
Ipynb update (#8004)
* git submodule update --remote

* update notebooks in docs

* prune

* _notebooks

* docs

* path

* path

* ignore

* head
2021-06-17 16:46:05 +02:00
Jirka Borovec cca0e7535a
remove parsing comments (#7958)
* remove parsing comments
* \s

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-06-14 14:24:48 +00:00
Mauricio Villegas cdd01f32da
LightningCLI support for argument links applied on instantiation (#7895)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-06-12 13:13:14 +02:00
Jirka Borovec 0fda862274
Refactor notebooks (#7752)
* drop notebooks

* add submodule

* copy notebooks

* docs include ipynb

* fix headers

* CI

* readthedocs

* manifest

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* req

* workdir

* pandoc

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* pandoc

* manifest

* Apply suggestions from code review

* fix versions

* checkout

* `git submodule update --init --recursive --remote`

* notebooks @docs

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-06-08 16:30:13 +00:00
Mauricio Villegas f34584001c
Fix support for torch Module type hints in LightningCLI (#7807)
* Fixed support for torch Module type hints in LightningCLI

* - Fix issue with serializing values when type hint is Any.
- Run unit test only on newer torchvision versions in which the base class is Module.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Minor change

* Update CHANGELOG.md

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-06-04 07:43:43 +02:00
Aki Nitta 71c1017092
Update sphinx version to 4.0 or later (#7716) 2021-05-26 11:33:24 +02:00
Mauricio Villegas d0081778f8
Enable fsspec by default for cli config file (#7521)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-05-17 08:53:00 +01:00
Akihiro Nitta 6d82dc832b
Pin `Sphinx<4.0` (#7456)
* Dont use sphinx 4.0.0

* Dont use sphinx 4.0.0

* Update comment

* Simple 

There is no other release between 3.5 and 4.0

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-05-10 10:27:37 +02:00
Jirka Borovec 626ef08694
enable Dockers for PT 1.9 (#7363)
* enable PT 1.9

* fix versions

* args

* fix
2021-05-05 14:26:22 +02:00
Carlos Mocholí c6a171b776
Fix requirements/adjust_versions.py (#7149)
Co-authored-by: jirka <jirka.borovec@seznam.cz>
2021-05-04 01:06:28 +02:00
Mauricio Villegas 78a6fd5588
Example and documentation for LightningCLI linking model and data arguments (#7299)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-05-03 20:45:46 +00:00
Mauricio Villegas b0cd9daf25
Simplify backbone_image_classifier example (#7246)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2021-04-28 23:52:28 +00:00
Mauricio Villegas 78d45a1134
Improve `LightningCLI` documentation and tests (#7156)
* - Added cli unit tests for help, print_config and submodules.
- Added to cli documentation use of subclass help and print_config, submodules and other minor improvements.
- Increased minimum jsonargparse version required for new documented features.

* Improvements to lightning_cli.rst

* Add check for all trainer parameters in test_lightning_cli_help

* Increased minimum jsonargparse version

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-04-28 09:34:32 +01:00
Sean Naren 8439aead66
Update FairScale on CI (#7017)
* Try updating CI to latest fairscale

* Update availability of imports.py

* Remove some of the fairscale custom ci stuff

* Update grad scaler within the new process as reference is incorrect for spawn

* Remove fairscale from mocks

* Install fairscale 0.3.4 into the base container, remove from extra.txt

* Update docs/source/conf.py

* Fix import issues

* Mock fairscale for docs

* Fix DeepSpeed and FairScale to specific versions

* Swap back to greater than

* extras

* Revert "extras"

This reverts commit 7353479f

* ci

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: jirka <jirka.borovec@seznam.cz>
2021-04-23 12:37:00 +01:00
Jirka Borovec f48ac62334
fix pip install (#7170) 2021-04-22 16:48:11 -04:00
Jirka Borovec ef5feac7ba
fix version + yapf (#6999) 2021-04-22 18:25:51 +00:00
Carlos Mocholí d6470bf193
Delete unused CI scripts (#7152) 2021-04-22 03:07:48 +02:00
Mauricio Villegas f852a4f592
Changed basic_examples to use `LightningCLI` (#6862)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-04-15 15:01:16 +00:00
Ethan Harris f645df5e9a
Add typings for evaluation_loop.py and remove some dead code (#7015) 2021-04-15 07:36:04 +00:00
Jirka Borovec da1ac3a530
update docker base on PT 1.7 (#6931)
* update docker base on PT 1.7

* fix path
2021-04-13 10:06:06 +01:00
Sean Naren b46cc557ef
[Feat] DeepSpeed single file saving (#6900)
* Add single checkpoint capability

* Fix checkpointing in test, few cleanups

* Add comment

* Change restore logic

* Move vars around, add better explanation, make todo align with DeepSpeed team

* Fix checkpointing

* Remove deepspeed from extra, install in Dockerfile

* push

* pull

* Split to two tests to see if it fixes Deepspeed error

* Add comment
2021-04-12 22:44:09 +00:00
Mauricio Villegas b7f3a3c421
Simple reproducibility with minimum boilerplate CLI training with `LightningCLI` (#4492)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-04-06 14:19:11 +01:00
thomas chaton 1302766f83
DeepSpeed ZeRO Update (#6546)
* Add context to call hook to handle all modules defined within the hook

* Expose some additional parameters

* Added docs, exposed parameters

* Make sure we only configure if necessary

* Setup activation checkpointing regardless, saves the user having to do it manually

* Add some tests that fail currently

* update

* update

* update

* add tests

* change docstring

* resolve accumulate_grad_batches

* resolve flake8

* Update DeepSpeed to use latest version, add some comments

* add metrics

* update

* Small formatting fixes, clean up some code

* Few cleanups

* No need for default state

* Fix tests, add some boilerplate that should move eventually

* Add hook removal

* Add a context manager to handle hook

* Small naming cleanup

* wip

* move save_checkpoint responsability to accelerator

* resolve flake8

* add BC

* Change recommended scale to 16

* resolve flake8

* update test

* update install

* update

* update test

* update

* update

* update test

* resolve flake8

* update

* update

* update on comments

* Push

* pull

* Update pytorch_lightning/plugins/training_type/deepspeed.py

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* Update pytorch_lightning/plugins/training_type/deepspeed.py

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* update

* Apply suggestions from code review

* Swap to using world size defined by plugin

* update

* update todo

* Remove deepspeed from extra, keep it in the base cuda docker install

* Push

* pull

* update

* update

* update

* update

* Minor changes

* duplicate

* format

* format2

Co-authored-by: SeanNaren <sean@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Sean Naren <sean.narenthiran@gmail.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>
2021-03-30 13:39:02 -04:00