0cbfe08a41
Add lightning apps to info_packages of collect_env_details ( #13815 )
2022-07-26 18:04:36 +02:00
1b31039c58
Update LightningCLI test for new support in latest release of jsonargparse ( #13805 )
2022-07-25 09:25:42 +00:00
e2ec51a5a2
App: prune requirements duplicity ( #13739 )
...
prune requirements
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-07-23 11:17:23 +00:00
0e5312833f
fix mypy errors for loggers/wandb.py ( #13483 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-07-21 01:07:24 +00:00
df802895ad
Update typing-extensions requirement from <4.2.1,>=4.0.0 to >=4.0.0,<4.3.1 in /requirements ( #13529 )
...
Update typing-extensions requirement in /requirements
Updates the requirements on [typing-extensions](https://github.com/python/typing_extensions ) to permit the latest version.
- [Release notes](https://github.com/python/typing_extensions/releases )
- [Changelog](https://github.com/python/typing_extensions/blob/main/CHANGELOG.md )
- [Commits](https://github.com/python/typing_extensions/compare/4.0.0...4.3.0 )
---
updated-dependencies:
- dependency-name: typing-extensions
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-20 11:01:39 +00:00
aa62fe36df
add testing PT 1.12 ( #13386 )
...
* add testing PT 1.12
* Fix quantization tests
* Fix another set of tests
* Fix check since https://github.com/pytorch/pytorch/pull/80139 is only going to be available for 1.13
* Skip this test for now for 1.12
Co-authored-by: SeanNaren <sean@grid.ai>
2022-07-15 19:41:23 +02:00
5e26840f94
Introduce ServableModuleValidator Callback ( #13614 )
...
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* Update tests/tests_pytorch/serve/test_servable_module_validator.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update tests/tests_pytorch/serve/test_servable_module_validator.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update src/pytorch_lightning/serve/servable_module_validator.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update src/pytorch_lightning/serve/servable_module_validator.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update src/pytorch_lightning/serve/servable_module_validator.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Typing improvements
* wip
* update doc
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* Update examples/pl_servable_module/production.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* update
* update
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-07-15 11:07:40 -04:00
8355ba1260
Run only CUDA tests on Azure GPU CI ( #13651 )
2022-07-15 13:51:23 +02:00
4e2ddc4f77
Increase typing_extensions minimal version ( #13657 )
...
* Increase typing_extensions requirement
* it's rich!
2022-07-14 11:42:22 -04:00
0ed1fce3cf
Update wandb requirement from <0.12.19,>=0.8.21 to >=0.8.21,<0.12.20 in /requirements ( #13415 )
...
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-06-29 22:02:07 -04:00
eae92fd3ff
Update comet-ml requirement from <=3.28.2,>=3.1.12 to >=3.1.12,<3.31.6 in /requirements ( #13414 )
...
Update comet-ml requirement in /requirements
Updates the requirements on [comet-ml](https://www.comet.ml ) to permit the latest version.
---
updated-dependencies:
- dependency-name: comet-ml
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-29 19:55:47 +00:00
55e347ba60
Unpin `protobuf` version and update `tensorboard` version ( #13259 )
...
* Remove protobuf from base req
* Update tensorboard version
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-06-29 18:44:46 +00:00
b137ef7134
CI: fix requirements freeze ( #13441 )
...
* allow freeze
* ci
* typo
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* ipu
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-06-29 09:35:57 -04:00
ec3c963ea2
Update numpy requirement from <1.22.5,>=1.17.2 to >=1.17.2,<1.23.1 in /requirements ( #13413 )
...
Update numpy requirement in /requirements
Updates the requirements on [numpy](https://github.com/numpy/numpy ) to permit the latest version.
- [Release notes](https://github.com/numpy/numpy/releases )
- [Changelog](https://github.com/numpy/numpy/blob/main/doc/HOWTO_RELEASE.rst )
- [Commits](https://github.com/numpy/numpy/compare/v1.17.2...v1.23.0 )
---
updated-dependencies:
- dependency-name: numpy
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-28 10:31:51 -04:00
59fb0323c2
Update neptune-client requirement from <0.16.3,>=0.10.0 to >=0.10.0,<0.16.4 in /requirements ( #13416 )
...
Update neptune-client requirement in /requirements
Updates the requirements on [neptune-client](https://github.com/neptune-ai/neptune-client ) to permit the latest version.
- [Release notes](https://github.com/neptune-ai/neptune-client/releases )
- [Changelog](https://github.com/neptune-ai/neptune-client/blob/master/CHANGELOG.md )
- [Commits](https://github.com/neptune-ai/neptune-client/compare/0.10.0...0.16.3 )
---
updated-dependencies:
- dependency-name: neptune-client
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-28 10:31:38 -04:00
d2e4e7e003
create meta package [RFC] ( #13327 )
...
* placeholder
* move setup_tools & abstract about
* adjust lightning-app
* notes
* lightning about
* lightning init
* CI check
* ci
* install
* adjust manifest & mv chlog
* manifest
* pkg
* mv __setup__
* parse_requirements
* lit
* ci - pytorch
* wrap func
* ci
* cd draft
* generate lit
* pkg
* utf-8
* root pkg
* req.
* ver
* mypy
* try check
* meta pkg
* meta pkg - vars
* meta pkg - pruning
* meta pkg - fixing
* fix PL for meta
* multi-line wrapper
* hack manifest
* ci
* fix docstr
* fixing
* ci & mypy
* links
2022-06-27 09:34:18 -04:00
038d076fd4
Update fsspec[http] requirement from !=2021.06.0,<=2022.2.0,>=2021.05.0 to >=2021.05.0,!=2021.06.0,<2022.6.0 in /requirements ( #13366 )
...
Update fsspec[http] requirement in /requirements
Updates the requirements on [fsspec[http]](https://github.com/fsspec/filesystem_spec ) to permit the latest version.
- [Release notes](https://github.com/fsspec/filesystem_spec/releases )
- [Commits](https://github.com/fsspec/filesystem_spec/compare/2021.05.0...2022.5.0 )
---
updated-dependencies:
- dependency-name: fsspec[http]
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-22 17:22:16 +02:00
90d2f3e787
Update numpy requirement from <=1.22.3,>=1.17.2 to >=1.17.2,<1.22.5 in /requirements ( #13361 )
...
Update numpy requirement in /requirements
Updates the requirements on [numpy](https://github.com/numpy/numpy ) to permit the latest version.
- [Release notes](https://github.com/numpy/numpy/releases )
- [Changelog](https://github.com/numpy/numpy/blob/main/doc/HOWTO_RELEASE.rst )
- [Commits](https://github.com/numpy/numpy/compare/v1.17.2...v1.22.4 )
---
updated-dependencies:
- dependency-name: numpy
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-22 13:15:55 +00:00
3fe4874cec
Update omegaconf requirement from <=2.1.*,>=2.0.5 to >=2.0.5,<2.3.0 in /requirements ( #13167 )
...
Update omegaconf requirement in /requirements
Updates the requirements on [omegaconf](https://github.com/omry/omegaconf ) to permit the latest version.
- [Release notes](https://github.com/omry/omegaconf/releases )
- [Changelog](https://github.com/omry/omegaconf/blob/master/NEWS.md )
- [Commits](https://github.com/omry/omegaconf/compare/v2.0.5...v2.2.1 )
---
updated-dependencies:
- dependency-name: omegaconf
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-22 12:58:43 +00:00
dc6143cd8f
Update hydra-core requirement from <=1.1.*,>=1.0.5 to >=1.0.5,<1.3.0 in /requirements ( #13309 )
...
Update hydra-core requirement in /requirements
Updates the requirements on [hydra-core](https://github.com/facebookresearch/hydra ) to permit the latest version.
- [Release notes](https://github.com/facebookresearch/hydra/releases )
- [Changelog](https://github.com/facebookresearch/hydra/blob/main/NEWS.md )
- [Commits](https://github.com/facebookresearch/hydra/compare/v1.0.5...v1.2.0 )
---
updated-dependencies:
- dependency-name: hydra-core
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-22 11:23:28 +00:00
de0f236e7c
Update horovod requirement from !=0.24.0,<=0.24.3,>=0.21.2 to >=0.21.2,!=0.24.0,<0.25.1 in /requirements ( #13363 )
...
Update horovod requirement in /requirements
Updates the requirements on [horovod](https://github.com/horovod/horovod ) to permit the latest version.
- [Release notes](https://github.com/horovod/horovod/releases )
- [Changelog](https://github.com/horovod/horovod/blob/master/CHANGELOG.md )
- [Commits](https://github.com/horovod/horovod/compare/v0.21.2...v0.25.0 )
---
updated-dependencies:
- dependency-name: horovod
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-22 11:23:15 +00:00
68fa83632a
Update gcsfs requirement from <=2022.2.0,>=2021.5.0 to >=2021.5.0,<2022.6.0 in /requirements ( #13168 )
...
Update gcsfs requirement in /requirements
Updates the requirements on [gcsfs](https://github.com/fsspec/gcsfs ) to permit the latest version.
- [Release notes](https://github.com/fsspec/gcsfs/releases )
- [Commits](https://github.com/fsspec/gcsfs/compare/2021.05.0...2022.5.0 )
---
updated-dependencies:
- dependency-name: gcsfs
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-22 11:51:47 +02:00
71f4c5fcb6
Update gym[classic_control] requirement from <=0.23.1,>=0.17.0 to >=0.17.0,<0.24.2 in /requirements ( #13307 )
...
Update gym[classic_control] requirement in /requirements
Updates the requirements on [gym[classic_control]](https://github.com/Farama-Foundation/gym-docs ) to permit the latest version.
- [Release notes](https://github.com/Farama-Foundation/gym-docs/releases )
- [Commits](https://github.com/Farama-Foundation/gym-docs/commits )
---
updated-dependencies:
- dependency-name: gym[classic_control]
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-22 11:51:38 +02:00
e02b786bde
Update wandb requirement from <0.12.17,>=0.8.21 to >=0.8.21,<0.12.19 in /requirements ( #13308 )
...
Update wandb requirement in /requirements
Updates the requirements on [wandb](https://github.com/wandb/client ) to permit the latest version.
- [Release notes](https://github.com/wandb/client/releases )
- [Changelog](https://github.com/wandb/client/blob/master/CHANGELOG.md )
- [Commits](https://github.com/wandb/client/compare/v0.8.21...v0.12.18 )
---
updated-dependencies:
- dependency-name: wandb
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-22 11:51:23 +02:00
bbc51d16a3
Update torchmetrics requirement from <=0.7.2,>=0.4.1 to >=0.4.1,<0.9.2 in /requirements ( #13275 )
...
Update torchmetrics requirement in /requirements
Updates the requirements on [torchmetrics](https://github.com/PyTorchLightning/metrics ) to permit the latest version.
- [Release notes](https://github.com/PyTorchLightning/metrics/releases )
- [Changelog](https://github.com/PyTorchLightning/metrics/blob/master/CHANGELOG.md )
- [Commits](https://github.com/PyTorchLightning/metrics/compare/v0.4.1...v0.9.1 )
---
updated-dependencies:
- dependency-name: torchmetrics
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-06-21 22:09:11 +00:00
6371d7c615
Fix LightningCLI signature parameter resolving for some lightning classes ( #13283 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-06-21 21:58:41 +00:00
ad87d2cad0
Future 5/n: Move requirements ( #13306 )
...
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-06-21 17:11:33 +02:00
8ceab223c0
Fix repository links ( #13304 )
...
* GH org rename Lightning-AI
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* repo name
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-06-15 19:33:43 -04:00
c048f2cc5a
Update wandb requirement from <=0.12.11,>=0.8.21 to >=0.8.21,<0.12.17 in /requirements ( #13051 )
...
* Update wandb requirement in /requirements
Updates the requirements on [wandb](https://github.com/wandb/client ) to permit the latest version.
- [Release notes](https://github.com/wandb/client/releases )
- [Changelog](https://github.com/wandb/client/blob/master/CHANGELOG.md )
- [Commits](https://github.com/wandb/client/compare/v0.8.21...v0.12.16 )
---
updated-dependencies:
- dependency-name: wandb
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-06-15 15:11:08 -04:00
759e89df21
Future 1/n: package in src/ folder ( #13293 )
...
* move: pytorch_lightning >> src/
* update setup & install
* update CI
* ci
* update CI for examples
* Self review
* mypy
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* ci
* make
* docs
* typo
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* ci: gpu
* .
* hpu
* typing
* docs
* tpu
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-06-14 20:54:55 -04:00
0cf9d73d28
Drop PyTorch 1.8 support ( #13155 )
...
* Drop PyTorch 1.8 support
* Missed update
* Skip profiler test until supported
* Upgrade ipu dockerfile pytorch version
* Update XLA version
2022-06-14 20:46:44 -04:00
a62f2d28b8
Update rich requirement from !=10.15.*,<=12.0.0,>=10.2.2 to >=10.2.2,!=10.15.0.a,<13.0.0 in /requirements ( #13047 )
...
* Update rich requirement in /requirements
Updates the requirements on [rich](https://github.com/willmcgugan/rich ) to permit the latest version.
- [Release notes](https://github.com/willmcgugan/rich/releases )
- [Changelog](https://github.com/Textualize/rich/blob/master/CHANGELOG.md )
- [Commits](https://github.com/willmcgugan/rich/compare/v10.2.2...v12.4.1 )
---
updated-dependencies:
- dependency-name: rich
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-06-14 17:17:57 +00:00
79de6a95fb
LightningCLI natively support callback list append ( #13129 )
...
* LightningCLI natively support callback list append.
* Update jsonargparse version
* Handle case where callbacks is not a list.
* Fix PEP8 issue.
* Handle mypy false positive
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-06-02 10:00:02 +09:00
18cdfab83b
Register torch's unresolvable import paths in cli module ( #13153 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-06-01 11:00:57 +02:00
37804078bb
Revert "Update deepspeed requirement from <0.6.0 to <0.7.0 in /requirements ( #13048 )" ( #13177 )
...
This reverts commit e19babc986
2022-05-31 20:21:14 +02:00
40dddc8a9b
Pin protobuf version ( #13177 )
2022-05-31 20:21:14 +02:00
9ac5cca842
Update typing-extensions requirement from <=4.1.1,>=4.0.0 to >=4.0.0,<4.2.1 in /requirements ( #13054 )
...
* Update typing-extensions requirement in /requirements
Updates the requirements on [typing-extensions](https://github.com/python/typing ) to permit the latest version.
- [Release notes](https://github.com/python/typing/releases )
- [Changelog](https://github.com/python/typing/blob/master/typing_extensions/CHANGELOG.md )
- [Commits](https://github.com/python/typing/compare/4.0.0...4.2.0 )
---
updated-dependencies:
- dependency-name: typing-extensions
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-05-27 17:55:23 +02:00
e19babc986
Update deepspeed requirement from <0.6.0 to <0.7.0 in /requirements ( #13048 )
...
* Update deepspeed requirement from <0.6.0 to <0.7.0 in /requirements
Updates the requirements on [deepspeed](https://github.com/microsoft/DeepSpeed ) to permit the latest version.
- [Release notes](https://github.com/microsoft/DeepSpeed/releases )
- [Commits](https://github.com/microsoft/DeepSpeed/compare/v0.1.0...v0.6.4 )
---
updated-dependencies:
- dependency-name: deepspeed
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-05-27 17:54:27 +02:00
d9c97cdac5
Update tensorboard requirement from <=2.8.0,>=2.2.0 to >=2.2.0,<2.10.0 in /requirements ( #13049 )
...
* Update tensorboard requirement in /requirements
Updates the requirements on [tensorboard](https://github.com/tensorflow/tensorboard ) to permit the latest version.
- [Release notes](https://github.com/tensorflow/tensorboard/releases )
- [Changelog](https://github.com/tensorflow/tensorboard/blob/master/RELEASE.md )
- [Commits](https://github.com/tensorflow/tensorboard/compare/2.2.0...2.9.0 )
---
updated-dependencies:
- dependency-name: tensorboard
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-05-27 17:54:15 +02:00
5cf0e376a5
Update jsonargparse[signatures] requirement from <=4.7.1,>=4.7.1 to >=4.7.1,<4.7.4 in /requirements ( #13052 )
...
* Update jsonargparse[signatures] requirement in /requirements
Updates the requirements on [jsonargparse[signatures]](https://github.com/omni-us/jsonargparse ) to permit the latest version.
- [Release notes](https://github.com/omni-us/jsonargparse/releases )
- [Changelog](https://github.com/omni-us/jsonargparse/blob/master/CHANGELOG.rst )
- [Commits](https://github.com/omni-us/jsonargparse/compare/v4.7.1...v4.7.3 )
---
updated-dependencies:
- dependency-name: jsonargparse[signatures]
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-05-27 17:53:47 +02:00
7172c21ee5
Update matplotlib requirement from <=3.5.1,>3.1 to >3.1,<3.5.3 in /requirements ( #13053 )
...
* Update matplotlib requirement in /requirements
Updates the requirements on [matplotlib](https://github.com/matplotlib/matplotlib ) to permit the latest version.
- [Release notes](https://github.com/matplotlib/matplotlib/releases )
- [Commits](https://github.com/matplotlib/matplotlib/compare/v3.1.1...v3.5.2 )
---
updated-dependencies:
- dependency-name: matplotlib
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-05-27 17:53:37 +02:00
0447720d7b
Update neptune-client requirement from <=0.15.2,>=0.10.0 to >=0.10.0,<0.16.3 in /requirements ( #13056 )
...
* Update neptune-client requirement in /requirements
Updates the requirements on [neptune-client](https://github.com/neptune-ai/neptune-client ) to permit the latest version.
- [Release notes](https://github.com/neptune-ai/neptune-client/releases )
- [Changelog](https://github.com/neptune-ai/neptune-client/blob/master/CHANGELOG.md )
- [Commits](https://github.com/neptune-ai/neptune-client/compare/0.10.0...0.16.2 )
---
updated-dependencies:
- dependency-name: neptune-client
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-05-27 17:53:14 +02:00
a3c0a4738f
Update mlflow requirement from <=1.24.0,>=1.0.0 to >=1.0.0,<1.27.0 in /requirements ( #13127 )
...
* Update mlflow requirement in /requirements
Updates the requirements on [mlflow](https://github.com/mlflow/mlflow ) to permit the latest version.
- [Release notes](https://github.com/mlflow/mlflow/releases )
- [Changelog](https://github.com/mlflow/mlflow/blob/master/CHANGELOG.md )
- [Commits](https://github.com/mlflow/mlflow/compare/1.0.0...v1.26.0 )
---
updated-dependencies:
- dependency-name: mlflow
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-05-27 12:42:54 +00:00
2dc14e77cd
Use coverage>=6.4 ( #13132 )
2022-05-24 18:01:26 +01:00
106b4bbfdd
Remove twine dependency from requirements ( #13050 )
...
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-05-12 22:20:04 -04:00
fec9a09672
add freeze for development and full range for install ( #12994 )
...
* freeze versions
* unfreeze
* dependabot
* Apply suggestions from code review
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* fix all req
* ...
* use base
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fix refs
* Apply suggestions from code review
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
* Apply suggestions from code review
* dockers
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-05-12 09:14:18 -04:00
3f78c4ca7a
Track CPU stats with DeviceStatsMonitor ( #11795 )
...
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-10 10:57:38 +00:00
783ec43a85
parse strategies as own extras ( #12975 )
...
* parse strategies as own extras
* prune devel
* Update Makefile
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* revert parse_requirements
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-09 09:25:53 -04:00
1a502c061c
[1/2] Collaborative Strategy ( #12842 )
2022-05-05 16:06:26 +00:00
bb51e2a55b
Merge pull request #12723 from PyTorchLightning/req/strategies
...
Separate strategies' requirements
2022-05-04 10:06:02 -04:00
cac02a04ba
Update `jsonargparse` to unblock master ( #12884 )
...
Co-authored-by: Mauricio Villegas <mauricio_ville@yahoo.com>
2022-04-26 16:55:07 +00:00
8034919c44
Remove deprecated `TestTubeLogger` ( #12859 )
...
* remove deprecated test_tube logger
* remove testube from logger __init__
* remove relevant testtube tests
* update CHANGELOG with removal of deprecated `TestTubeLogger`
2022-04-24 20:05:48 +02:00
908e05880d
docs refactor 3/n ( #12795 )
...
* updated titles + css
* updated titles + css
* levels structure
* levels structure
* levels structure
* adding level indexes
* finished intro guide layout
* finished intro guide layout
* general titles
* general titles
* added movie
* added movie
* finished 15 mins
* levels
* added core levels
* added core levels
* fixed api reference on the left
* gpu guides
* gpu guides
* gpu guides
* gpu guides
* precision
* hpu guide
* added ipu
* added ipu
* added ipu
* added ckpt docs
* finished basic logging
* intermediate
* intermediate
* intermediate
* fixed
* fixed margins
* fixed margins
* fixed margins
* fixed margins
* fixed margins
* fixed margins
* fixed margins
* fixed margins
* fixed margins
* added logger stuff
* added logger stuff
* added logger stuff
* added logger stuff
* added logger stuff
* ic
* added inconsolata
* added inconsolata
* added inconsolata
* added inconsolata
* added inconsolata
* added inconsolata
* added inconsolata
* updated menu
* added basic cloud docs
* added basic cloud docs
* added basic cloud docs
* added basic cloud docs
* ic
* ic
* ic
* ic
* ic
* ic
* ic
* ic
* ic
* ic
* ic
* ic
* added demos folder
* added demos folder
* added demos folder
* added demos folder
* added demos folder
* added demos folder
* twocolumns directive
* twocols
* twocols
* registry
* registry
* registry
* registry
* registry
* registry
* registry
* registry
* registry
* registry
* registry
* registry
* registry
* registry
* registry
* registry
* registry
* registry
* registry
* cleaning up
* cleaning up
* cleaning up
* cleaning up
* cleaning up
* cleaning up
* cleaning up
* cleaning up
* cleaning up
* updated titles + css
* levels structure
* adding level indexes
* finished intro guide layout
* general titles
* added movie
* finished 15 mins
* levels
* added core levels
* fixed api reference on the left
* gpu guides
* precision
* hpu guide
* added ipu
* added ckpt docs
* finished basic logging
* intermediate
* fixed margins
* added logger stuff
* ic
* added inconsolata
* updated menu
* added basic cloud docs
* ic
* added demos folder
* twocolumns directive
* registry
* cleaning up
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* deconflict
* deconflict
* deconflict
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Add testsetup sections wherever needed; fix errors in building docs
* pre-commit fixes
* Fix duplicate label
* minor nit with pre-commit
* Fix labels
* More changes...
* require
* debug & cli
* prec & model & visu
* fix references
* fix references
* fix refs
* fix refs - model_parallel
* fix references
* prune testsetup with global
* refs in index
* Fix duplicate label errors
* Update orphan docs
* Update orphan docs
* Update orphan docs
* fix links
* Fix genindex and search index
* fix refs
* fix refs
* Fix index rst related issues
* fix refs
* inc to rst
* Fix links ref
* fix more references
* fix refs
* deconflict
* errors
* errors
* errors
* fix refs
* fix refs
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fix warnings
* Fix LightningCLI errors
* Fix LightningCLI errors
* Fix LightningCLI errors
* Fix LightningCLI errors
* fix doc build
* Duplicate Label fix (docs) (#12800 )
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* ignore typing in demo folder
* Ignore demos for mypy
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kushashwa Ravi Shrimali <kushashwaravishrimali@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: otaj <ota@grid.ai>
2022-04-19 14:15:47 -04:00
2f2a516de9
Update LightningCLI tests to reflect changes in jsonargparse 4.6.0 ( #12704 )
2022-04-11 14:00:48 +02:00
124b529088
Add version header to CLI config files ( #12532 )
2022-04-07 17:52:51 +05:30
939d56c6d6
Drop PyTorch 1.7 support ( #12432 )
2022-03-27 21:31:20 +00:00
1dc57f9573
Fix: Update sphinx-autodoc-typehints minimal version ( #12468 )
2022-03-27 14:31:28 +00:00
812c2dc3d3
Add support for Habana accelerator (HPU) ( #11808 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: four4fish <88516121+four4fish@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: jjenniferdai <89552168+jjenniferdai@users.noreply.github.com>
Co-authored-by: Kushashwa Ravi Shrimali <kushashwaravishrimali@gmail.com>
Co-authored-by: Akarsha Rao <94624926+raoakarsha@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.comk-Pro.local>
2022-03-25 10:24:52 +00:00
c099c8be5d
Fix: freeze Jinja2 version ( #12444 )
2022-03-24 16:46:08 +00:00
09d1296040
Avoid `rich` 10.15.0 and 10.15.1 ( #12293 )
...
* Update rich version
* Update requirements/extra.txt
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2022-03-18 19:14:43 +00:00
1144673cd9
CI: sanity check for req. pkgs ( #11819 )
...
* CI: sanity check for req. pkgs
* scripts
* rename
* gcsfs ?
* rich !
* install extra
* move
* set -e
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-03-11 09:20:47 +00:00
8577ef7bba
Skip horovod 0.24.0 only ( #12248 )
...
* try skip horovod 0.24.0 only
* HOROVOD_BUILD_CUDA_CC_LIST
* fix test
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-03-10 16:01:08 +00:00
821ca7e85d
Drop PyTorch 1.7 testing from the CI ( #12191 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
2022-03-08 19:02:32 +01:00
0db85d633c
Pin horovod to <0.24 ( #12234 )
2022-03-04 22:16:23 +00:00
54b9a85227
Unit test for CLI with subcommands and a common default config file ( #12061 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-02-28 10:17:49 +00:00
923b30dc51
Fix import error when running doctests for RL examples ( #12010 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-02-19 21:57:02 +01:00
f79d75d4b5
Pin myst-parser<0.17
2022-02-14 09:19:49 -05:00
77a9253b04
Prepare for `torch==1.11` ( #11679 )
2022-02-02 19:41:17 +00:00
11e1e3e6f2
Update torch version matrix ( #11649 )
2022-01-27 20:04:34 -05:00
cfb0411b78
Merge pull request #11635 from PyTorchLightning/ci/fix-term
...
Pin `coverage<6.3`
2022-01-27 16:25:12 -05:00
34c62da37d
pin sphinx-autodoc-typehints version to v1.15 ( #11400 )
2022-01-11 00:12:53 +01:00
f37bd4677d
Update mypy ( #11096 )
2021-12-16 17:53:12 +01:00
9e56290e2a
Support torch 1.10.1 ( #11095 )
2021-12-15 19:23:31 -08:00
ff20af41fd
Fix mathjax in RTD build ( #10889 )
...
* Update docs.txt
* Update conf.py
* Update .readthedocs.yml
2021-12-02 11:46:57 +00:00
d3b7492bd0
[CLI] Add support for `--key.help=class` ( #10767 )
2021-11-29 14:12:53 +00:00
e1bf54c944
Tune Conda CI timeout and other minor improvements ( #10769 )
2021-11-28 17:58:03 +00:00
5d748e560b
LightningCLI changes for jsonargparse>=4.0.0 ( #10426 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-11-19 17:03:14 +00:00
3d2d0f2536
MANIFEST.in and setup.py clean-up ( #7614 )
2021-11-19 15:38:42 +01:00
5b90253a53
Drop torch 1.6 support ( #10367 )
2021-11-08 11:29:39 +00:00
4a4a27db05
Update docutils package version in requirements.txt ( #10158 )
2021-10-26 16:32:47 +00:00
a0e45dc071
Some minor CI cleanup ( #10088 )
2021-10-26 13:58:20 +02:00
2ed92ecabb
Rerun flaky profiler tests on failure ( #10035 )
2021-10-20 18:57:04 +05:30
c2e3ec164a
Add torch v1.11.0 to the list of versions in adjust_versions.py ( #9679 )
2021-09-24 01:27:16 -07:00
d022f6ff60
Update versions after recent PyTorch releases ( #9623 )
2021-09-21 10:49:49 -07:00
bbcb977851
[CLI] Shorthand notation to instantiate optimizers and lr schedulers [2/3] ( #9565 )
2021-09-17 18:00:46 +01:00
ee3787216a
Adapt `NeptuneLogger` to new `neptune-client` api ( #6867 )
...
* Initial split to NeptuneLegacyLogger and NeptuneLogger
* Adapt NeptuneLogger to neptune-pytorch-lightning repo version
* Fix stylecheck and tests
* Fix style and PR suggestions
* Expect Run object in NeptuneLogger.init
* Model checkpoint support and restructured tests
* Reformat code - use " instead of '
* Fix logging INTEGRATION_VERSION_KEY
* Update CHANGELOG.md
* Fix stylecheck
* Remove NeptuneLegacyLogger
* updated neptune-related docstrings
* PR suggestions
* update CODEOWERS file
* move import logic to imports.py
* minor neptune.py improvements
* formatting fixes and minor updates
* Fix generation of docs
* formatting fixes and minor updates
* fix
* PR fixes vol. 2
* define return type of _dict_paths method
* bump required version of `neptune-client`
* Enable log_* functions
* Update pytorch_lightning/loggers/neptune.py
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Revert "Enable log_* functions"
This reverts commit 050a436899b7f3582c0455dc27b171335b85a3a5.
* Make global helper lists internal
* Logger's `name` and `version` methods return proper results
* Initialize Run and its name and id at logger init level
* Make _init_run_instance static
* Add pre-commit hook code changes.
* Fix blacken-docs check
* Fix neptune doctests and test_all
* added docs comment about neptune-specific syntax
* added docs comment about neptune-specific syntax in the loggers.rst
* fix
* Add pickling test
* added myself to neptune codeowners
* Enable some of deprecated log_* functions
* Restore _run_instance for unpickled logger
* Add `step` parameter to log_* functions
* Fix stylecheck
* Fix checkstyle
* Fix checkstyle
* Update pytorch_lightning/loggers/neptune.py
Co-authored-by: thomas chaton <thomas@grid.ai>
* Fix tests
* Fix stylecheck
* fixed project name
* Fix windows tests
* Fix stylechecks
* Fix neptune docs tests
* docformatter fixes
* De-duplicate legacy_kwargs_msg
* Update .github/CODEOWNERS
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: kamil-kaczmarek <kamil.kaczmarek@neptune.ml>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-09-10 18:48:58 +02:00
160e7e1289
Deprecate LightningModule.get_progress_bar_dict ( #8985 )
...
* Move get_progress_bar_dict from lightning module to progress bar callback
2021-09-09 20:53:47 +00:00
6e124e7207
CI: precommit - docformatter ( #8584 )
...
* CI: precommit - docformatter
* fix deprecated
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-09-06 12:49:09 +00:00
0dfc6a18bd
Call any trainer function from the `LightningCLI` ( #7508 )
2021-08-28 04:43:14 +00:00
f67892ea96
CI: yesqa ( #8564 )
...
* add yesqa
* fix flake8
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-08-02 16:05:56 +00:00
e63968ab88
Add `pyupgrade` to `pre-commit` ( #8557 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-07-26 14:38:12 +02:00
a64cc37394
Replace `yapf` with `black` ( #7783 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-07-26 13:37:35 +02:00
52526c20b5
Add support for functions to be parsed by the Lightning CLI in addition to Types ( #8400 )
...
* Initial commit
* Update docstrings
* Update CHANGELOG.md
* Fix mypy
* Fixes
* Fixes
* Update to comments
* Fix
* mypy
* Update on comments
* Update
* Fix mypy
* protected
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-07-26 10:53:48 +02:00
abbcfa1ab7
fix CI for PT 1.10 ( #8526 )
...
* fix CI for PT 1.10
* Apply suggestions from code review
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-07-23 19:24:31 +02:00
74a09a23f1
CI: support PT 1.10 ( #8133 )
...
* prepare PT 1.10
* dockers
* fixes
* readme
2021-07-14 18:04:33 +03:00
6ce77a102b
Set minimum PyTorch version to 1.6 ( #8288 )
...
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2021-07-13 17:12:49 +00:00
1efd6d20ac
Remove pep8speaks ( #8392 )
2021-07-13 15:19:24 +00:00
c5a120ed9d
Update to Mypy>0.9 ( #8386 )
2021-07-13 08:23:36 +02:00
e5732a1158
Temporarily pin sphinx version ( #8377 )
2021-07-12 09:35:44 +00:00
7d3452a000
LightningCLI documentation improvements ( #8303 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-07-08 12:35:26 +05:30
5cef9772a4
Add tests for GCS filesystem ( #7946 )
2021-07-05 12:16:32 +00:00
3c74502919
Add support for optimizers and learning rate schedulers to LightningCLI ( #8093 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-07-01 12:04:11 +02:00
2c43bfc5ef
GPU CI - run torch 1.8 (LTS) ( #8116 )
2021-06-24 16:56:43 +00:00
7978a5376d
Ipynb update ( #8004 )
...
* git submodule update --remote
* update notebooks in docs
* prune
* _notebooks
* docs
* path
* path
* ignore
* head
2021-06-17 16:46:05 +02:00
cca0e7535a
remove parsing comments ( #7958 )
...
* remove parsing comments
* \s
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-06-14 14:24:48 +00:00
cdd01f32da
LightningCLI support for argument links applied on instantiation ( #7895 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-06-12 13:13:14 +02:00
0fda862274
Refactor notebooks ( #7752 )
...
* drop notebooks
* add submodule
* copy notebooks
* docs include ipynb
* fix headers
* CI
* readthedocs
* manifest
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* req
* workdir
* pandoc
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* pandoc
* manifest
* Apply suggestions from code review
* fix versions
* checkout
* `git submodule update --init --recursive --remote`
* notebooks @docs
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-06-08 16:30:13 +00:00
f34584001c
Fix support for torch Module type hints in LightningCLI ( #7807 )
...
* Fixed support for torch Module type hints in LightningCLI
* - Fix issue with serializing values when type hint is Any.
- Run unit test only on newer torchvision versions in which the base class is Module.
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Minor change
* Update CHANGELOG.md
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-06-04 07:43:43 +02:00
71c1017092
Update sphinx version to 4.0 or later ( #7716 )
2021-05-26 11:33:24 +02:00
d0081778f8
Enable fsspec by default for cli config file ( #7521 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-05-17 08:53:00 +01:00
6d82dc832b
Pin `Sphinx<4.0` ( #7456 )
...
* Dont use sphinx 4.0.0
* Dont use sphinx 4.0.0
* Update comment
* Simple
There is no other release between 3.5 and 4.0
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-05-10 10:27:37 +02:00
626ef08694
enable Dockers for PT 1.9 ( #7363 )
...
* enable PT 1.9
* fix versions
* args
* fix
2021-05-05 14:26:22 +02:00
c6a171b776
Fix requirements/adjust_versions.py ( #7149 )
...
Co-authored-by: jirka <jirka.borovec@seznam.cz>
2021-05-04 01:06:28 +02:00
78a6fd5588
Example and documentation for LightningCLI linking model and data arguments ( #7299 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-05-03 20:45:46 +00:00
b0cd9daf25
Simplify backbone_image_classifier example ( #7246 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2021-04-28 23:52:28 +00:00
78d45a1134
Improve `LightningCLI` documentation and tests ( #7156 )
...
* - Added cli unit tests for help, print_config and submodules.
- Added to cli documentation use of subclass help and print_config, submodules and other minor improvements.
- Increased minimum jsonargparse version required for new documented features.
* Improvements to lightning_cli.rst
* Add check for all trainer parameters in test_lightning_cli_help
* Increased minimum jsonargparse version
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-04-28 09:34:32 +01:00
8439aead66
Update FairScale on CI ( #7017 )
...
* Try updating CI to latest fairscale
* Update availability of imports.py
* Remove some of the fairscale custom ci stuff
* Update grad scaler within the new process as reference is incorrect for spawn
* Remove fairscale from mocks
* Install fairscale 0.3.4 into the base container, remove from extra.txt
* Update docs/source/conf.py
* Fix import issues
* Mock fairscale for docs
* Fix DeepSpeed and FairScale to specific versions
* Swap back to greater than
* extras
* Revert "extras"
This reverts commit 7353479f
2021-04-23 12:37:00 +01:00
f48ac62334
fix pip install ( #7170 )
2021-04-22 16:48:11 -04:00
ef5feac7ba
fix version + yapf ( #6999 )
2021-04-22 18:25:51 +00:00
d6470bf193
Delete unused CI scripts ( #7152 )
2021-04-22 03:07:48 +02:00
f852a4f592
Changed basic_examples to use `LightningCLI` ( #6862 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-04-15 15:01:16 +00:00
f645df5e9a
Add typings for evaluation_loop.py and remove some dead code ( #7015 )
2021-04-15 07:36:04 +00:00
da1ac3a530
update docker base on PT 1.7 ( #6931 )
...
* update docker base on PT 1.7
* fix path
2021-04-13 10:06:06 +01:00
b46cc557ef
[Feat] DeepSpeed single file saving ( #6900 )
...
* Add single checkpoint capability
* Fix checkpointing in test, few cleanups
* Add comment
* Change restore logic
* Move vars around, add better explanation, make todo align with DeepSpeed team
* Fix checkpointing
* Remove deepspeed from extra, install in Dockerfile
* push
* pull
* Split to two tests to see if it fixes Deepspeed error
* Add comment
2021-04-12 22:44:09 +00:00
b7f3a3c421
Simple reproducibility with minimum boilerplate CLI training with `LightningCLI` ( #4492 )
...
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-04-06 14:19:11 +01:00
1302766f83
DeepSpeed ZeRO Update ( #6546 )
...
* Add context to call hook to handle all modules defined within the hook
* Expose some additional parameters
* Added docs, exposed parameters
* Make sure we only configure if necessary
* Setup activation checkpointing regardless, saves the user having to do it manually
* Add some tests that fail currently
* update
* update
* update
* add tests
* change docstring
* resolve accumulate_grad_batches
* resolve flake8
* Update DeepSpeed to use latest version, add some comments
* add metrics
* update
* Small formatting fixes, clean up some code
* Few cleanups
* No need for default state
* Fix tests, add some boilerplate that should move eventually
* Add hook removal
* Add a context manager to handle hook
* Small naming cleanup
* wip
* move save_checkpoint responsability to accelerator
* resolve flake8
* add BC
* Change recommended scale to 16
* resolve flake8
* update test
* update install
* update
* update test
* update
* update
* update test
* resolve flake8
* update
* update
* update on comments
* Push
* pull
* Update pytorch_lightning/plugins/training_type/deepspeed.py
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Update pytorch_lightning/plugins/training_type/deepspeed.py
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* update
* Apply suggestions from code review
* Swap to using world size defined by plugin
* update
* update todo
* Remove deepspeed from extra, keep it in the base cuda docker install
* Push
* pull
* update
* update
* update
* update
* Minor changes
* duplicate
* format
* format2
Co-authored-by: SeanNaren <sean@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Sean Naren <sean.narenthiran@gmail.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>
2021-03-30 13:39:02 -04:00
5b5a5cc80b
support python 3.9 ( #4944 )
...
* support python 3.9
* update CI
* onnxruntime
* .
* .
* onnxruntime
* t 55
* t 75
* add script
* use
* onnx
* onnx
* onnx
* whl
* np
* find
* 21
* Apply suggestions from code review
* Apply suggestions from code review
* onnx
* CI
* req
* ~ dockers
* min
* .
* drop horovod
* drop horovod
* drop horovod
* fix
* fix
* .
2021-03-29 12:20:13 -04:00
0ea8f39841
Resolve schedule step bug for PyTorch Profiler ( #6674 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-03-25 17:03:06 +01:00
64d0fa4472
update coverage config ( #6524 )
...
* update coverage config
* parallel
* parallel
* Apply suggestions from code review
* Apply suggestions from code review
* paralel
* paralel
* paralel
* combine
* combine
* .
* ..
* ..
* ..
* rev
* cb
* cb
* drop
* drop
* .
* ..
* ...
* ...
* ...
* .
2021-03-23 23:05:04 +01:00
8cd75a4dd5
fix comparing versions ( #6434 )
...
* fix comparing versions
* chlog
* .
* ...
* datasets
2021-03-23 07:51:45 +00:00
b341b53f70
deprecate metrics pkg ( #6505 )
...
* deprecate metrics
* examples
* req
* docs
* Apply suggestions from code review
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
* pep8
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
2021-03-15 14:39:38 +00:00
156847bea7
CI: resume testing with py3.8 ( #6516 )
...
* testing on python 3.8
* req
2021-03-15 12:07:23 +01:00
afe0ededa3
cover subproc coverage ( #6477 )
2021-03-11 15:45:26 +00:00
85c8074bee
require: adjust versions ( #6363 )
...
* adjust versions
* release
* manifest
* pep8
* CI
* fix
* build
2021-03-06 14:34:54 +01:00
38274b9de9
unfreeze torchtext version ( #6302 )
2021-03-02 10:38:02 -05:00
960a60743f
fix fairscale compatible with PT 1.8 ( #5996 )
...
* try to extend fairscale available
* 1.2
2021-02-16 19:43:02 +00:00
ae4dca9725
Docs: fix failing make ( #5988 )
2021-02-15 16:03:57 -05:00
ae19c9723b
tests: Remove usage of --flake8 flag ( #5909 )
...
* tests: Remove usage of --flake8 flag
* Remove commented line
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-02-12 12:25:08 -05:00
9dd56398e3
fixing some compatibility with PT 1.8 ( #5864 )
...
* change default
* .
* p
* 0.21.2
* .
* fix
* .
2021-02-09 18:25:57 +01:00
aa03b73e60
Remove psf/black references ( #5739 )
...
* Update pyproject.toml
* Update setup.cfg
* Update test.txt
* Update CONTRIBUTING.md
* Update requirements/test.txt
2021-02-03 08:37:06 +00:00
8db2b2defd
update nightly & upgrade Twine ( #5458 )
...
* update used Twine
* .
* .
* install
* install
* .
* .
* .
* .
* .
* .
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
(cherry picked from commit 9611a7f897
2021-01-26 14:29:47 +01:00
fb6c33a52d
Fix pre-commit trailing-whitespace and end-of-file-fixer hooks. ( #5387 )
...
(cherry picked from commit 4c6f36e6e1
2021-01-26 14:27:56 +01:00
cb58fdeb3d
fix: freeze mypy ( #5634 )
...
* update mypy for tests
* freeze
2021-01-24 20:09:08 -05:00
0c9960bfbb
Docs: upgrade packages ( #5600 )
...
* upgrade docs packages
* cmd
* -cmd
2021-01-24 11:15:52 -05:00
7e4d6cbe48
set minimal req. PT 1.4 ( #5418 )
...
* set minimal req. PT 1.4
* chlog
2021-01-12 19:15:35 -05:00
bb366232e7
Add non-existing resume_from_checkpoint acceptance for auto-resubmit ( #4402 )
...
* Add empty resume_from_checkpoint acceptance #4366
* Fix general error catch with focused file check
* Add fsspec HTTP extras
Add fsspec's HTTPFileSystem support through http extras.
pl has supported remote http file (e.g. #2925 ),
so this commit do not add new functionality.
* Fix potential too much logging in DDP
* Add PR changelog
* Add well-written argument explanation
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Fix DDP-compatible restore logging
Notify from where the states are restored.
This feature temporally deleted as a result of PR review.
With succeeding review, added with DDP compatibility.
* Fix utility import pathes
* Refactor load step commentaries
* Refactor hpc ckpt suffix acquisition
* Refactor restore/hpc_load match
* Refactor hpc load trial
* Refactor checkpoint dir check
* Refactor unneeded function nest
* Refactor nested If
* Refactor duplicated cache clear
* Refactor attempt flow with if/elif
* Fix pip8
* Refactor hook commentary
Co-authored-by: chaton <thomas@grid.ai>
* Fix pep8
* Refactor hpc load checkpoint path acquisition
* Fix pip8
* Fix typo
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Fix typo
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Fix doc
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Refactor None Union type with Optional
* Fix build-doc CI failure debuged in #5329
* Fix fsspec import during build-doc #5329
* Fix test epoch
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Fix test with latest test models
* .
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: chaton <thomas@grid.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Sean Naren <sean.narenthiran@gmail.com>
Co-authored-by: Roger Shieh <sh.rog@protonmail.ch>
(cherry picked from commit b0051e8c03
2021-01-06 12:55:38 +01:00
3c5dad7100
Document speed comparison ( #2072 )
...
* docs
* script
* dump
* desc
* import
* import
* if
* norm
* t
* finished
* isort
* typing
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
* xlabel
* pandas
* time
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
2021-01-05 09:58:37 +01:00
3b83666823
prune ecosystem example ( #5085 )
...
* draft
* wip
* CI
* drop pl geometry
* copy
* logo
2021-01-05 09:58:37 +01:00
7755572b4f
Check if optimizer supports closure ( #4981 )
...
* check if optimizer support closure
* cleanup test
* resolve tests
* resolve flake
* update test due to patch limit
* update
* update dep
* Update tests/core/test_lightning_optimizer.py
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update tests/core/test_lightning_optimizer.py
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* resolve bug
* update test
* resolve tests
* Update requirements/extra.txt
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* remove bolts dep
* remove bolts
* add missing bolts dep for tests
* remove need for bolts
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-12-11 14:51:45 +01:00
ef8ef12fd0
[feat] pp 2/n ( #5026 )
...
* Added changes for RPC plugin
* Add missing kwargs
* Fix code format
* Loading refactors by introducing is_distributed var, fix optimizer step flow
* Add rpc guard
* Added docstrings and typing
* resolve comments
* Add additional rpc hook, refactor name of exit process hook for clarity
* remove annotation
* Modify behaviour to allow optional return, add test for rpc plugin
* resolve tests
* rename is_ddp_based
* update
* update for windows
* update
* resolve test
* code smell
* Added sequential plugin
* resolve bug
* update
* cleanup
* add Exception
* resolve docs
* Remove ddp support
* Revert distributed -> ddp
* Update pl_examples/basic_examples/conv_sequential_example.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update pl_examples/basic_examples/conv_sequential_example.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update pytorch_lightning/plugins/ddp_sequential_plugin.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Address code review points
* Update pytorch_lightning/plugins/ddp_sequential_plugin.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update pytorch_lightning/plugins/ddp_sequential_plugin.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Add missing return
* Fix formatting, add datamodule args
* add small comment
* resolve comments
* resolve comments
* update source for fairscale
* update extras
* remove staticmethod
* resolve flake8
* Skip tests that are failing due to bug upstream with multiple optimizers and shard
* update
* update on comments
* clean test
* latest comments
* remove old comments
* add todo
* Update version
* update
* resolve bugs
* resolve bugs
* update test
* remove hanging test
* Update pytorch_lightning/plugins/ddp_sequential_plugin.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* resolve on comments
* Update pytorch_lightning/plugins/ddp_sequential_plugin.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* resolve on comments
* Update pytorch_lightning/plugins/ddp_sequential_plugin.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update pytorch_lightning/plugins/ddp_sequential_plugin.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update pytorch_lightning/plugins/ddp_sequential_plugin.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update pytorch_lightning/plugins/ddp_sequential_plugin.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* remove ImportError
Co-authored-by: SeanNaren <sean@grid.ai>
Co-authored-by: Sean Naren <sean.narenthiran@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2020-12-09 12:56:51 +00:00
2c11d96012
replace pyright by mypy ( #5021 )
...
* drop pyright & add mypy
* detail
* name
* fix
* flake8
* ver
Co-authored-by: Sean Naren <sean.narenthiran@gmail.com>
2020-12-09 10:57:11 +08:00
eeae426b33
CI: skip hanging ( #4943 )
...
* CI: try increase time limit
* try min 3.8
* no ex
* CI
* dep
* test
* deps
* deps
* drop
* drop
Co-authored-by: chaton <thomas@grid.ai>
2020-12-02 16:18:14 +00:00
b2611b7dfa
drop sklearn dependency ( #4912 )
...
* drop sklearn dependency
* scipy
Co-authored-by: chaton <thomas@grid.ai>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2020-12-02 16:22:04 +01:00
563f9214fa
upgrade min deps ( #4934 )
...
* upgrade min deps
* unused
* replace torchvision and torchtext
* loggers
* freeze pip
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>
Co-authored-by: Sean Naren <sean.narenthiran@gmail.com>
2020-12-01 17:19:44 +00:00
04bb0abe36
Merge branch 'master' into feature/plug
...
# Conflicts:
# pytorch_lightning/utilities/__init__.py
# requirements/extra.txt
2020-11-27 10:00:05 +00:00
217650320e
simplify imports Omegaconf ( #4873 )
...
* hydra
* omegaconf
2020-11-27 01:00:56 +01:00
79527672cb
Remove amp check as guard now upstream
2020-11-26 10:13:27 +00:00
a311ee17ab
Add fairscale requirement as zip before release
2020-11-25 18:16:36 +00:00
2d78d9b84a
CI: Added isort import check for the code on pull-request ( #4242 )
...
* added isort CI job and updated isort config
* changed CI check output from files to full diff
* added isort pre-commit hook
* Added missing first party and restricted files affected by isort
* Applied isort to root-level, docs and benchmarks
* Apply suggestions from code review
Co-authored-by: Nathan Painchaud <nathanpainchaud@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: chaton <thomas@grid.ai>
2020-11-13 22:57:46 +01:00
bd6c413829
Conda: PT 1.8 ( #3833 )
...
* PT 1.8
* unfreeze PT
* drop nightly from full
* add PT 1.8 to workflow
* readme table
* cuda
* skip cuda
* test 1.8
* unfreeze torch vision
Co-authored-by: ydcjeff <ydcjeff@outlook.com>
Co-authored-by: chaton <thomas@grid.ai>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
2020-11-12 15:03:43 +01:00
11415faade
[req] Set min version for skimage for tests ( #4598 )
...
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
2020-11-10 17:16:37 +06:30
6e5f232f5c
Add Dali MNIST example ( #3721 )
...
* add MNIST DALI example, update README.md
* Fix PEP8 warnings
* reformatted using black
* add mnist_dali to test_examples.py
* Add documentation as docstrings
* add nvidia-pyindex and nvidia-dali-cuda100
* replace nvidia-pyindex with --extra-index-url
* mark mnist_dali test as Linux and GPU only
* adjust CUDA docker and examples.txt, fix import error in test_examples.py
* adjust the GPU check
* Exit when DALI is not available
* remove requirements-examples.txt and DALI pip install
* Refactored example, moved to new logging api, added runtime check for test and dali script
* Patch to reflect the mnist example module
* add req.
* Apply suggestions from code review
* Removed requirement as it breaks CPU install, added note in README to install DALI
* add DALI to Drone
* test examples
* Apply suggestions from code review
* imports
* ABC
* cuda
* cuda
* pip DALI
* Move build into init function
Co-authored-by: SeanNaren <sean@grid.ai>
Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Sean Naren <sean.narenthiran@gmail.com>
2020-11-06 14:53:46 +00:00
51cc7a89ee
Horovod: fixed early stopping and added metrics aggregation ( #3775 )
...
* Fixed early stopping for Horovod
* Refactored to sync_dist_if_available
* Bump min Horovod version to support hvd.is_initialized
* Changelog
* Added back change for Horovod
* Removed redundant checks for initialization
* Implement metrics gathering for Horovod
* Added test for EvalResult
* Renamed ddp_sync_on_step -> dist_sync_on_step
* Added metric test for Horovod
* Added option pass callable allgather function to metric base class
* Added dist_sync_fn
* Fixed calls to private _sync_dist
* Fixed Horovod test
* Added sync_tensor to the distributed backend
* Skip Windows
* Insert test path
* Removed redundant import
* Updated drone
* Unset HOROVOD_GPU_ALLREDUCE
* Unset
* No cache dir
* No uninstall
* Unset variables
* Uninstall Horovod during initialization
* Replaced more references to ddp_sync_on_step
* Fixed imports
* Fixed attribute
* Added back default
* Lint
* Added back docstring
* Made gather_all_tensors default
* Added whitespace
* Update tests/models/test_horovod.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update pytorch_lightning/metrics/metric.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update CHANGELOG.md
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
Co-authored-by: Sean Naren <sean.narenthiran@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-11-05 12:52:02 -05:00
d537485e41
lock pytorch nightly version ( #4469 )
2020-11-01 23:47:51 +05:30
ce8abd6255
Drone: use nightly build cuda docker images ( #3658 )
...
* upgrade PT version
* update docker
* docker
* try 1.5
* badge
* fix typo: dor -> for (#3918 )
* prune
* prune
* env
* echo
* try
* notes
* env
* env
* env
* notes
* docker
* prune
* maintainer
* CI
* update
* just 1.5
* CI
* CI
* CI
* CI
* CI
* CI
* CI
* CI
* CI
* CI
* CI
* docker
* CI
* CI
* CI
* CI
* CI
* CI
* CI
* CI
* CI
* push
* try
* prune
* CI
* CI
* CI
* CI
Co-authored-by: Klyukin Valeriy <mr.clyukin@gmail.com>
Co-authored-by: Jeff Yang <ydcjeff@outlook.com>
2020-10-26 10:47:09 +00:00
d3567c33a6
move base req. to root ( #4219 )
...
* move base req. to root
* check-manifest
* check-manifest
* manifest
* req
2020-10-18 20:40:18 +02:00
9fb5f4340e
try update horovod ( #4004 )
2020-10-08 18:44:35 -04:00
d65b037a40
Mocking Loggers Part 5/5 (final) ( #3926 )
...
* base
* add xfail
* new test
* import
* missing import
* xfail if not installed
include mkpatch
fix test
* mock comet
comet mocks
fix test
remove dep
undo merge duplication
* line
* line
* convert doctest
* doctest
* docs
* prune Results usage in notebooks (#3911 )
* notebooks
* notebooks
* revamp entire metrics (#3868 )
* removed metric
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
* added new metrics
Co-authored-by: Teddy Koker teddy.koker@gmail.com
* pep8
Co-authored-by: Teddy Koker teddy.koker@gmail.com
* pep8
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
* docs
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
* docs
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
* win ddp tests skip
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
* win ddp tests skip
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
* win ddp tests skip
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
* win ddp tests skip
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
* reset in compute, cache compute
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
* reduce_ops handling
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
* sync -> sync_dist, type annotations
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
* wip docs
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
* mean squared error
* docstring
* added mean ___ error metrics
* added mean ___ error metrics
* seperated files
* accuracy doctest
* gpu fix
* remove unnecessary mixin
* metric and accuracy docstring
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
* metric docs
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
* pep8, changelog
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
* refactor dist utils, pep8
* refactor dist utils, pep8
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
* Callback docs with autosummary (#3908 )
* callback docs with autosummary
* do not show private methods
* callback base docstring
* skip some docker builds (temporally pass) (#3913 )
* skip some docker builds
* todos
* skip
* use badges only with push (#3914 )
* testtube
* mock test tube
* mock mlflow
* remove mlflow
* clean up
* test
* test
* test
* test
* test
* test
* code blocks
* remove import
* codeblock
* logger
* wandb causes stall
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Ananya Harsh Jha <ananya@pytorchlightning.ai>
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
Co-authored-by: Jeff Yang <ydcjeff@outlook.com>
2020-10-06 23:49:06 -04:00
db0e295f67
Complete mocking Comet and remove dep ( #3910 )
...
* xfail if not installed
include mkpatch
fix test
* mock comet
comet mocks
fix test
remove dep
undo merge duplication
* line
* line
* convert doctest
* doctest
* docs
2020-10-06 19:50:42 -04:00
e0f8505394
Mocking loggers (part 2, neptune) ( #3617 )
...
* mock neptune base tests
* neptune doctest
* remove extra
* mock loggers
* typo
* mock import
* neptune not compatible with multigpu
* add back experiment
2020-10-04 21:20:06 -04:00
1160270882
fix path in CI for release & python version in all dockers & duplicated badges ( #3765 )
...
* typo
* path
* check
* trigger
* fix conda
* pip ver
* fix cuda
* fix XLA
* fix xla
* ci
* docker
* BIULD
* unBIULD
* update
* py 3.8
* apex
* apex
2020-10-02 05:26:21 -04:00
a94728c99b
spec Horovod version ( #3661 )
...
* spec Horovod version
* MAKEFLAGS="-j2"
* tests
* CI
* docker
* CI
* docker
2020-09-26 19:30:25 +02:00
3ff5327e83
Mocking loggers (part 1, wandb) ( #3596 )
...
* mocking for wandb
* remove wandb import in amp test
* mock loggers in sphinx
* check tests
* Update extra.txt
* setup
* dev
* min
* revert
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
2020-09-25 16:00:02 +02:00
aa52c930f4
test examples ( #3643 )
...
* test examples
* testing
* testing
* typo
* req
* exception
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2020-09-24 17:33:11 +02:00
8be79a9a96
stable, dev PyTorch in Dockerfile and conda gh actions ( #3074 )
...
* dockerfile and actions file
* dockerfile and actions file
* added pytorch conda cpu nightly
* added pytorch conda cpu nightly
* recopy base reqs
* gh action `include` torch nightly
* add pytorch nightly & conda gh badge
* rebase
* fix horovod
* proposal refactor
* Update .github/workflows/ci_pt-conda.yml
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update .github/workflows/ci_pt-conda.yml
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* update
* update
* fix cmd
* filled &&
* fix
* add -y
* torchvision >0.7 allowed
* explicitly install torchvision
* use HOROVOD_GPU_OPERATIONS env variable
* CI
* skip 1.7
* table
Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-09-17 20:30:39 +02:00
7b64472ced
fix lib paths after Wandb 0.10 ( #3520 )
...
* try
* try
* drop 0.20
* drop 0.19.5
* -U
* Fixed Horovod in CI due to wandb==0.10.0 sys.path modifications (#3525 )
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* format
* wb freeze
* types
Co-authored-by: Travis Addair <taddair@uber.com>
2020-09-17 08:37:49 -04:00
c64520e658
fix tensorboard version ( #3132 )
...
* tensorboard version
* WIP test tb hparams logs (#3040 )
* optional
* req
* tensorboard>=2.2.0
* data
* data
* TB
Co-authored-by: Rosario Scalise <rosario@cs.washington.edu>
2020-09-15 23:48:48 +02:00
cbc4f6f8a4
add CI for building dockers ( #3383 )
...
* rename
* fix badges
* add docker build
* mergify
* update
* env
* ci
* times
* CI
* name
* comment
2020-09-10 18:38:29 -04:00
2d8c1b7c54
use fsspec instead of gfile for all IO ( #3320 )
...
* use fsspec instead of gfile for all IO
This better supports remote (and local) file operations with a dedicated package
* Apply suggestions from code review
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
* chlog
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
2020-09-03 14:19:20 +02:00
45e7491dcc
drop packaging ( #3105 )
2020-08-24 05:28:56 -04:00
ee4eae884b
[docs] Add copy and toggle buttons to sphinx ( #3054 )
...
* Support sphinx toggle and copy buttons
* add buttons to conf
2020-08-19 18:59:45 -04:00
6939f6fc11
Freeze Tensorboard to 2.2.0 ( #3039 )
...
* freeze tb to 2.2.0
* Update environment.yml
2020-08-18 16:26:17 -04:00
6921d5ecad
Use tensorboard 2.3.0 ( #3011 )
2020-08-17 06:56:45 -04:00
f952decc16
fix tb version ( #2985 )
2020-08-15 07:14:01 -04:00
6e77181ec7
Squashed commit of the following: ( #2164 )
...
commit 29fb0506cd38a15c359e369cc8bc4435916b0c78
Author: Brendan Fahy <bmfahy@gmail.com>
Date: Sat Aug 8 19:35:30 2020 +0000
fix checking for version for docs to build
commit 467fd640db02275972c7111af031c86bb59333e9
Author: Brendan Fahy <bmfahy@gmail.com>
Date: Sat Aug 8 18:56:05 2020 +0000
remove no local test
commit a7cc9f88de00feec1a5406874d05313c42bd004c
Author: Brendan Fahy <bmfahy@gmail.com>
Date: Sat Aug 8 18:46:44 2020 +0000
fix
commit 3fdbb729da79ae9348c83410a138666bad467951
Author: Brendan Fahy <bmfahy@gmail.com>
Date: Sat Aug 8 18:23:30 2020 +0000
revert requirements
commit 9b8686bd83e2bc243cf329e26f1c667c6949cf67
Author: Brendan Fahy <bmfahy@gmail.com>
Date: Sat Aug 8 18:16:42 2020 +0000
make it a fixture
commit eec74953d24c8b25268d3b6dde3cc4affdd5cb8f
Author: Brendan Fahy <bmfahy@gmail.com>
Date: Sat Aug 8 18:01:32 2020 +0000
fix up the testing
commit 896d94a0e60083d52c81db2a036b7f1e015cad11
Author: Brendan Fahy <bmfahy@gmail.com>
Date: Sat Aug 8 17:47:28 2020 +0000
fix some tests
commit 6d22bde19767bf2b71dfd44839b01efdf6888f83
Merge: 6175d4e2 6ebe0d72
2020-08-09 06:08:44 -04:00
aa6fe25436
Fix install setup - push pypi ( #2872 )
...
* fix setup install
* fix setup install
* 📝 edit docs install command
Co-authored-by: nateraw <nxr9266@g.rit.edu>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2020-08-07 19:02:38 -04:00
234e2b590f
Use .comet.config file for CometLogger ( #1913 )
...
* Use .comet.config file or env var for API key.
* Make CometLogger API key changes backwards compatible.
* Fix line too long.
* Add documentation about loading from ~/.comet_config.
* Update required comet_ml version.
* Comet logger: allow offline experiments with config file.
This adds a new argument to the logger to control the online / offline mode explicitly so that if you give an API key and a save_dir (e.g. to control where checkpoints go while having ~/.comet.config) you can specify which mode you want.
* Make CometLogger API key changes backwards compatible.
* Comet logger: change online argument to be offline.
For consistency with other loggers.
* chlog
Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
2020-08-07 09:46:50 +02:00
e3732789d7
Add remaning sklearn metrics ( #2562 )
...
* added balanced accuracy
* added dcg score
* added mean absolute error
* added mean squared error
* fix
* added mean squared log error
* add median absolute error and r2 score
* switch arguments
* added mean poisson deviance
* add mean gamma deviance and mean tweedie deviance
* fix styling
* added explained variance score
* added cohen kappa score
* added hamming, hinge, jaccard
* fix styling
* update sklearn requirement to newer version
* update requirement
* fix doctest
* fix tests
* added balanced accuracy
* added dcg score
* added mean absolute error
* added mean squared error
* fix
* added mean squared log error
* add median absolute error and r2 score
* switch arguments
* added mean poisson deviance
* add mean gamma deviance and mean tweedie deviance
* fix styling
* added explained variance score
* added cohen kappa score
* added hamming, hinge, jaccard
* fix styling
* update sklearn requirement to newer version
* fix doctest
* fix tests
* fix doctest
* fix failing docs
* fix test
* trying to fix errors
* Apply suggestions from code review
* format
Co-authored-by: Nicki Skafte <nugginea@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
2020-08-05 11:32:53 +02:00
fcfdb4df13
conda speedup ( #2546 )
...
* conda speedup
* cache
* add pip cache
* suggestion
* cache
* cache
* req
2020-07-31 06:31:23 -04:00
b7afac351b
Add onnx export ( #2596 )
...
* export model to onnx
* prepare data before exporting
* support for dataloaders and tensors
* added tests
* use example_input_array
add to changelog
* updated docstring
* added onnx inference tests
* temp commit
* removed schema valid test
* add onnxruntime to environment.yml
* moved onnxruntime to environment.yml pip
* add example in doc
* add lines between code block
* added PR to changelog
* is file check
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* remove *
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* infer example outputs
* added doctest for onnx
* fix windows tests
* moved eval within condition block
* self.forward to self
* added docs
* fixed docs error
* added to toctree
* Update CHANGELOG.md
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-07-31 12:27:57 +02:00
06e8910f06
pytorch 1.6 ( #2745 )
...
* pt 1.6
* don't use the new zipfile serialization for now
* quick flake8 fixes
* remove unnecessary f
* coalesce strings
* remove comma
* remove extra commas
* Apply suggestions from code review
Co-authored-by: Peter Yu <2057325+yukw777@users.noreply.github.com>
* set _use_new_zipfile_serialization to False only for pytorch 1.6.0
* remove unnecessary comments
* flake8 fixes
* use pkg_resources instead of packaging
* readme
* format
* version
* chlog
Co-authored-by: Peter Yu <peter@asapp.com>
Co-authored-by: Peter Yu <2057325+yukw777@users.noreply.github.com>
2020-07-31 11:18:32 +02:00
bc833fbf52
Horovod & py3.8 ( #2764 )
2020-07-30 23:39:07 +02:00
949734489a
remove deprecated in v0.9 ( #2760 )
...
* remove deprecated in v0.9
* data_loader
* import
* hook
* args
2020-07-30 23:19:28 +02:00
40337cce58
freeze PT 1.5 for Horovod issue ( #2744 )
...
* freeze pt 1.5
* torchtext
* Apply suggestions from code review
Co-authored-by: Peter Yu <2057325+yukw777@users.noreply.github.com>
* timeout
Co-authored-by: Peter Yu <2057325+yukw777@users.noreply.github.com>
2020-07-28 15:52:23 -04:00
0a65826462
metrics: add BLEU ( #2535 )
...
* metrics: added bleu score and test bleu
* metrics: fixed type hints in bleu
* bleu score moved to metrics/functional/nlp.py
* refactor with torch.Tensor
* Update test_sequence.py
* refactor as Borda requests and nltk==3.2
* locked nltk==3.3
* nltk>=3.3, parametrized smooth argument for test
* fix bleu_score example
* added class BLEUScore metrics and test
* added class BLEUScore metrics and test
* update CHANGELOG
* refactor with torchtext
* torchtext changed to optional import
* fix E501 line too long
* add else: in optional import
* remove pragma: no-cover
* constants changed to CAPITALS
* remove class in tests
* List -> Sequence, conda -> pip, cast with tensor
* add torchtext in test.txt
* remove torchtext from test.txt
* bump torchtext to 0.5.0
* bump torchtext to 0.5.0
* Apply suggestions from code review
* ignore bleu score in doctest, renamed to nlp.py
* back to implementation with torch
* remove --ignore in CI test, proper reference format
* apply justus comment
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-07-22 09:58:24 -04:00
1dc724239a
PSNR metric ( #2483 )
...
* Add stub PSNR metric
* Fix linter
* Add data range as parameter
* Add tests
* Add scikit-image
* Add PSNR to regression metrics and add functional
* Refactor to functional
* Fix linter
* Fix linter, again
* Fix linter, again
* Fix typo in test
* Fix typo in another test
* Add scikit-image to conda
* Lift numpy requirement
* Add random tests
* Update CHANGELOG.md
* Apply suggestions from code review
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-07-08 10:26:11 +02:00
927f305f7e
Warn user when IterableDataset has __len__ defined ( #2437 )
...
* add warning when getting checking len
* added test
* changelog
* pep
* do not show warning below 1.4
* try version parse
* comments
* xfail
* Update requirements/base.txt
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update pytorch_lightning/trainer/data_loading.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* version
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka@pytorchlightning.ai>
2020-07-01 07:53:19 -04:00
e268061614
Pure package & base tests ( #2418 )
...
* base tests
* pil
* wip
* wip
* wip
* ignore
* ignore
* win
* link
* win
* cpu
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2020-06-30 19:35:54 -04:00
d4a02e3bd8
tests: drop CircleCI ( #2412 )
...
* drop CircleCI
* add PT testing
* fix
* cpu
* conda
* conda
* req
* base
* conda
* conda
* conda
* conda
* conda
* conda
* conda
* name
* req
* info
* tests
* pt 1.6
* drop 1.6
* info
2020-06-30 10:56:05 -04:00
75f0a2062c
move torchtext as optional ( #2395 )
...
* torchtext
* Update pytorch_lightning/utilities/apply_func.py
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Update apply_func.py
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2020-06-27 20:15:10 -04:00
Luca Medeiros