Commit Graph

7024 Commits

Author SHA1 Message Date
Jirka Borovec ab59f308b1
Future 4/n: test & legacy in test/ folder (#13295)
* move: legacy >> test/

* move: tests >> test/

* rename unittests

* update CI

* tests4pl

* tests_pytorch

* proxi

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* ci

* link

* cli

* standalone

* fixing

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* .

* Apply suggestions from code review

Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* alone

* test -> tests

* Standalone fixes

* ci

* Update

* More fixes

* Fix coverage

* Fix mypy

* mypy

* Empty-Commit

* Fix

* mypy just for pl

* Fix standalone

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-06-15 18:10:49 -04:00
Carlos Mocholí b551921a9f
Remove unused test argument (#13296) 2022-06-15 22:51:14 +02:00
dependabot[bot] c048f2cc5a
Update wandb requirement from <=0.12.11,>=0.8.21 to >=0.8.21,<0.12.17 in /requirements (#13051)
* Update wandb requirement in /requirements

Updates the requirements on [wandb](https://github.com/wandb/client) to permit the latest version.
- [Release notes](https://github.com/wandb/client/releases)
- [Changelog](https://github.com/wandb/client/blob/master/CHANGELOG.md)
- [Commits](https://github.com/wandb/client/compare/v0.8.21...v0.12.16)

---
updated-dependencies:
- dependency-name: wandb
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-06-15 15:11:08 -04:00
Jirka Borovec b58577fd4d
Future 3/n: docs adjustment (#13299)
* docs: rename source >> source-PL

* docs: fix typing

* readthedocs

* update paths & codeowners

* source-pytorch

* ci

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-06-15 10:54:53 -04:00
Jirka Borovec 9cc714cdd1
Future 2/n: stand-alone examples (#13294)
* move: pl_examples >> src/

* convert pl_examples package to plain examples

* update CI for examples

* ci

* missing

* install
2022-06-15 08:53:51 -04:00
Jirka Borovec 759e89df21
Future 1/n: package in src/ folder (#13293)
* move: pytorch_lightning >> src/

* update setup & install

* update CI

* ci

* update CI for examples

* Self review

* mypy

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* ci

* make

* docs

* typo

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* ci: gpu

* .

* hpu

* typing

* docs

* tpu

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-06-14 20:54:55 -04:00
Carlos Mocholí 0cf9d73d28
Drop PyTorch 1.8 support (#13155)
* Drop PyTorch 1.8 support

* Missed update

* Skip profiler test until supported

* Upgrade ipu dockerfile pytorch version

* Update XLA version
2022-06-14 20:46:44 -04:00
Carlos Mocholí 981a6da121
Remove test's proxy boring classes import (#13297)
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-06-15 01:53:54 +02:00
Carlos Mocholí ff186f8c60
Standardize tensor annotation (#13292)
unify torch.Tensor >> Tensor

Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-06-14 16:43:42 -04:00
Ekagra Ranjan 5e4b712062
Fix deploy production intermediate doc (#13204) 2022-06-14 19:18:38 +02:00
dependabot[bot] a62f2d28b8
Update rich requirement from !=10.15.*,<=12.0.0,>=10.2.2 to >=10.2.2,!=10.15.0.a,<13.0.0 in /requirements (#13047)
* Update rich requirement in /requirements

Updates the requirements on [rich](https://github.com/willmcgugan/rich) to permit the latest version.
- [Release notes](https://github.com/willmcgugan/rich/releases)
- [Changelog](https://github.com/Textualize/rich/blob/master/CHANGELOG.md)
- [Commits](https://github.com/willmcgugan/rich/compare/v10.2.2...v12.4.1)

---
updated-dependencies:
- dependency-name: rich
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-06-14 17:17:57 +00:00
Jirka Borovec 78ff201c7e
Update CI setup (#13291)
* drop mamba
* use legacy GPU machines
2022-06-14 17:11:54 +00:00
Akarsha Rao bfa8b7be2d
Create hpu-ci-runner Dockerfile (#13239)
* Create  hpu-ci-runner Dockerfile

* Add ENTRYPOINT script 'start.sh' to hpu-ci-runner

* rename dirs

* ci

* add docker

* Fix build failure

* Fix build failure

* Fix title of nightly ci runner build

* Fix comments

* Fix comments

Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-06-08 16:02:16 -04:00
Akihiro Nitta 56cd883373
Merge pull request #13250 from PyTorchLightning/ci/rm-base
CI: Remove simple test `ci_test-base.yml`
2022-06-08 14:36:52 -04:00
Benjamin Etheredge 83436ee3df
Fixing small typo in documentation. (#13215)
Fixing typo in documentation.
2022-06-04 05:23:09 +09:00
Carlos Mocholí 7938293cd9 Add deprecation path for the old Loop module (#13043) 2022-06-02 21:23:14 +02:00
Carlos Mocholí a8a6a5b721 Rename `loops/base.py` to `loops/loop.py` (#13043) 2022-06-02 21:23:14 +02:00
Patrick Haller 5a5b616110
Explicitly mention disabling validation in trainer docs (#13148)
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-06-02 16:49:40 +00:00
Akihiro Nitta 3c5a8a833e
Decouple pulling legacy checkpoints from existing GHA workflows and docker files (#13185)
* Add pull-legacy-checkpoints action
* Replace pulls with the new action and script
* Simplify
2022-06-02 15:39:14 +02:00
Jirka Borovec de4ab1c027
update NGC docker (#13136)
* update docker
* Apply suggestions from code review

Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-06-02 12:54:13 +00:00
Carlos Mocholí 4819ad1c58
Update CHANGELOG after the 1.6.4 release (#13201) 2022-06-02 11:19:46 +02:00
Mauricio Villegas 79de6a95fb
LightningCLI natively support callback list append (#13129)
* LightningCLI natively support callback list append.

* Update jsonargparse version

* Handle case where callbacks is not a list.

* Fix PEP8 issue.

* Handle mypy false positive

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-06-02 10:00:02 +09:00
ananthsub c1f05021ff
Fix initialization of optimizers in DDP Strategy (#11952)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-06-01 10:25:05 +00:00
Rohit Gupta 9445a84a12
Fix epoch logging on train epoch end (#13025)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-06-01 09:05:11 +00:00
Mauricio Villegas 18cdfab83b
Register torch's unresolvable import paths in cli module (#13153)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-06-01 11:00:57 +02:00
Jack Morris 4f81d6f794
Fix typo in cluster_advanced.rst (#13173) 2022-06-01 02:53:37 +00:00
Toshiki Ishikawa c16dcb7266
Remove the deprecated `logger.close` (#13149)
* refactor:removed the close instance from the LoggerCollection class

* Also logger.close()

* Update CHANGELOG

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-06-01 00:22:56 +00:00
Sebastian Raschka 2876ab0ac3
Updates docs to clarify train_dataloader usage by batch_size_finder (#13171)
* batchfinder clarification

* fix according to precommit hook
2022-06-01 00:22:31 +00:00
Ekagra Ranjan 011684a05f
Fix instruction for cherry pick way of fixing mixed branches (#13186)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-31 23:54:32 +00:00
Akihiro Nitta a21e6c3f33
Specify `Trainer(benchmark=False)` in parity benchmarks (#13182)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-31 21:23:21 +00:00
Nikhil Shenoy f4f14bb5d8
Removed `weights_summary` argument from Trainer (#13070)
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-31 20:31:39 +00:00
Carlos Mocholí 5bdb936eca
[CLI] Respect existing seed by default (#13110) 2022-05-31 22:31:25 +02:00
Rohit Gupta ba438828e5
Fix logging's step values when multiple dataloaders are used during evaluation (#12184)
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-31 22:00:29 +02:00
Jirka Borovec b2eb2b796e
add @akihironitta among CI/CD owners (#13139)
add @akihironitta
2022-05-31 15:37:29 -04:00
Masahiro Wada 90acf909fb
Fix not running test codes (#13089)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-31 19:27:46 +00:00
Carlos Mocholí 01ebb1f2f5
Avoid changing the current `cudnn.benchmark` value (#13154) 2022-05-31 19:22:19 +00:00
Carlos Mocholí 37804078bb Revert "Update deepspeed requirement from <0.6.0 to <0.7.0 in /requirements (#13048)" (#13177)
This reverts commit e19babc986.
2022-05-31 20:21:14 +02:00
Carlos Mocholí 9945d028d3 Fix standalone test collection (#13177) 2022-05-31 20:21:14 +02:00
Carlos Mocholí 50326e9a65 xfail flaky quantization test blocking CI (#13177) 2022-05-31 20:21:14 +02:00
Akihiro Nitta 40dddc8a9b Pin protobuf version (#13177) 2022-05-31 20:21:14 +02:00
Akihiro Nitta a6e9bc2943
Document CI/CD (#12980)
* Add README.md to .github/workflows/

* Link CI/CD doc page from contributing.md

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-05-28 23:39:01 +00:00
dependabot[bot] 9ac5cca842
Update typing-extensions requirement from <=4.1.1,>=4.0.0 to >=4.0.0,<4.2.1 in /requirements (#13054)
* Update typing-extensions requirement in /requirements

Updates the requirements on [typing-extensions](https://github.com/python/typing) to permit the latest version.
- [Release notes](https://github.com/python/typing/releases)
- [Changelog](https://github.com/python/typing/blob/master/typing_extensions/CHANGELOG.md)
- [Commits](https://github.com/python/typing/compare/4.0.0...4.2.0)

---
updated-dependencies:
- dependency-name: typing-extensions
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-27 17:55:23 +02:00
dependabot[bot] e19babc986
Update deepspeed requirement from <0.6.0 to <0.7.0 in /requirements (#13048)
* Update deepspeed requirement from <0.6.0 to <0.7.0 in /requirements

Updates the requirements on [deepspeed](https://github.com/microsoft/DeepSpeed) to permit the latest version.
- [Release notes](https://github.com/microsoft/DeepSpeed/releases)
- [Commits](https://github.com/microsoft/DeepSpeed/compare/v0.1.0...v0.6.4)

---
updated-dependencies:
- dependency-name: deepspeed
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-27 17:54:27 +02:00
dependabot[bot] d9c97cdac5
Update tensorboard requirement from <=2.8.0,>=2.2.0 to >=2.2.0,<2.10.0 in /requirements (#13049)
* Update tensorboard requirement in /requirements

Updates the requirements on [tensorboard](https://github.com/tensorflow/tensorboard) to permit the latest version.
- [Release notes](https://github.com/tensorflow/tensorboard/releases)
- [Changelog](https://github.com/tensorflow/tensorboard/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorboard/compare/2.2.0...2.9.0)

---
updated-dependencies:
- dependency-name: tensorboard
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-27 17:54:15 +02:00
dependabot[bot] 5cf0e376a5
Update jsonargparse[signatures] requirement from <=4.7.1,>=4.7.1 to >=4.7.1,<4.7.4 in /requirements (#13052)
* Update jsonargparse[signatures] requirement in /requirements

Updates the requirements on [jsonargparse[signatures]](https://github.com/omni-us/jsonargparse) to permit the latest version.
- [Release notes](https://github.com/omni-us/jsonargparse/releases)
- [Changelog](https://github.com/omni-us/jsonargparse/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/omni-us/jsonargparse/compare/v4.7.1...v4.7.3)

---
updated-dependencies:
- dependency-name: jsonargparse[signatures]
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-27 17:53:47 +02:00
dependabot[bot] 7172c21ee5
Update matplotlib requirement from <=3.5.1,>3.1 to >3.1,<3.5.3 in /requirements (#13053)
* Update matplotlib requirement in /requirements

Updates the requirements on [matplotlib](https://github.com/matplotlib/matplotlib) to permit the latest version.
- [Release notes](https://github.com/matplotlib/matplotlib/releases)
- [Commits](https://github.com/matplotlib/matplotlib/compare/v3.1.1...v3.5.2)

---
updated-dependencies:
- dependency-name: matplotlib
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-27 17:53:37 +02:00
dependabot[bot] 0447720d7b
Update neptune-client requirement from <=0.15.2,>=0.10.0 to >=0.10.0,<0.16.3 in /requirements (#13056)
* Update neptune-client requirement in /requirements

Updates the requirements on [neptune-client](https://github.com/neptune-ai/neptune-client) to permit the latest version.
- [Release notes](https://github.com/neptune-ai/neptune-client/releases)
- [Changelog](https://github.com/neptune-ai/neptune-client/blob/master/CHANGELOG.md)
- [Commits](https://github.com/neptune-ai/neptune-client/compare/0.10.0...0.16.2)

---
updated-dependencies:
- dependency-name: neptune-client
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-27 17:53:14 +02:00
dependabot[bot] a3c0a4738f
Update mlflow requirement from <=1.24.0,>=1.0.0 to >=1.0.0,<1.27.0 in /requirements (#13127)
* Update mlflow requirement in /requirements

Updates the requirements on [mlflow](https://github.com/mlflow/mlflow) to permit the latest version.
- [Release notes](https://github.com/mlflow/mlflow/releases)
- [Changelog](https://github.com/mlflow/mlflow/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mlflow/mlflow/compare/1.0.0...v1.26.0)

---
updated-dependencies:
- dependency-name: mlflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-05-27 12:42:54 +00:00
Nikhil Shenoy dd47518322
Removed `flush_logs_every_n_steps` argument from Trainer (#13074)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-25 12:47:15 +02:00
Carlos Mocholí c5938f8fbc
Fix torchelastic detection with non-distributed installations (#13142)
* Fix torchelastic detection under Mac

* CHANGELOG
2022-05-25 12:23:41 +02:00