Commit Graph

7567 Commits

Author SHA1 Message Date
otaj 0bd5703b81
[CI] Trick Bagua into installing appropriate wheel in GPU tests (#14380)
Bagua trick needs to be replicated on everywhere applicable
2022-08-24 08:59:49 +00:00
Carlos Mocholí 2157a3b84d
Add a required job checker as an action (1/2) (#14363)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-24 01:07:05 +02:00
Jirka Borovec d8ba94b325
release App 0.6.0 RC (#14370)
* release App 0.6.0 RC

* req
2022-08-23 23:43:27 +02:00
Dmitry Frolov 2182d755c4
[CLI] Adding opportunity to see basic cluster logs (#14334)
* pinning starsessions

* pinning starsessions

* adding strict back to requirements.txt

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Duplicated

* Basic implementation

* Basic implementation

* Basic implementation

* Basic implementation

* Common things moved to log helpers file

* Decomposing logs reader classes for reusing

* Setting colors for log levels

* Manifest trimming

* Changes added to CHANGELOG

* Prettifications

* Prettifications

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Logs function name change

* Logs function name change

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* attempt to fix the pydanitc import

* Tests + command name fixes

* Extending tests

* Adding limit argument

* Unmerging CI fix

* Unmerging CI fix

* Adding fields for errors

* Adding log level fixed field width

* Adding absent typing + exeptions raising

* Adding socket error logging

* Addressing comments on cluster list function return value

* Addressing comments on adding e2e tests

* Adding version range for arrow package in reqs

* New unit tests

* arrow time parsing callback modified + unit tests

* helpers updated

* helpers updated

* helpers updated

* One more test

* CMD test fix

* CMD test fix

* CMD test fix

* CMD test fix

* CMD test fix

* LightningClient mocking

* Flaky test removed

Co-authored-by: hhsecond <sherin@grid.ai>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-23 15:48:22 -04:00
Rohit Gupta 5661458bf4
Fix make test (#14273) 2022-08-24 00:58:53 +05:30
Jirka Borovec 9040b1ed2c
CI: enable testing of react e2e (#14364)
enable testing of react e2e
2022-08-23 13:31:36 -04:00
Laverne Henderson 8ff2e01025
Update for M1 Mac installations (#14350)
* Update for M1 Mac installations

* Apply suggestions from code review

* Update PL installation

* Update based on feedback

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-23 13:31:18 -04:00
Laverne Henderson 2265bd85c9
Bring back access app state (#14258)
* Recreated the access_app_state file

* Update the site's TOC to include the file

* Update code sample file path

* Minor formatting update

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Sherin Thomas <sherin@grid.ai>
2022-08-23 13:06:46 -04:00
otaj bb634310e7
[CI] Bump CUDA in Docker images to 11.6.1 (#14348)
* bump cuda in docker images to 11.6.1

* PUSH TO HUB. REVERT THIS!

* conda forge for 11.6

* cuda 11.5

* revert conda changes

* 11.6 back again

* 11.6 back again, all of them

* maybe all passes now

* maybe all passes now

* final push

* Revert "PUSH TO HUB. REVERT THIS!"

This reverts commit 602bfce224.

* Apply suggestions from code review

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-23 12:10:52 -04:00
Jirka Borovec e027ecf9d8
chlog after App `0.5.6` & `0.5.7` (#14352)
* chlog after App 0.5.6 & 0.5.7

* .
2022-08-23 11:53:13 -04:00
Jirka Borovec 99ba95a38e
fix imports of collections.abc for py3.10 (#14345)
fix collections.abc for py3.10

Co-authored-by: Sherin Thomas <sherin@grid.ai>
2022-08-23 11:52:58 -04:00
Jirka Borovec 4586d11829
adding CI for e2e on Azure (#14282)
* start CI

* wip

* matrix

* name

* wip

* prune

* rm

* ls

* cache

* dir

* ls

* name

* cleaning

* clone

* git

* git

* if

* private

* .

* local_id

* clean

* var

* group check

* ci
2022-08-23 11:50:30 -04:00
Adam Bobowski 4c47619f38
[App] Add cloud platform exception (#13928)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-08-22 22:15:36 +02:00
Carlos Mocholí 7a617ec90e
Add back support for logging in the gradient clipping hooks (#14298)
* Add back support for logging in the gradient clipping hooks

* Docs and CHANGELOG

* Fix tests
2022-08-22 09:19:53 -04:00
dependabot[bot] 9cf9bc5820
Bump tj-actions/changed-files from 24 to 28 (#14337)
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 24 to 28.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v24...v28)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-22 10:45:05 +00:00
Sherin Thomas 52a4457ae3
Pinning starsessions to 1.x (#14333)
The recent release of starsessions 2.0 has broken lightning app as some of the arguments are removed. This PR also fixes a bug in our setup tools that prevents our internal # strict parameter being considered.

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-21 23:26:52 +00:00
Rohit Gupta db1835a82c
Fix an issue to avoid the impact of sanity check on `reload_dataloaders_every_n_epochs` for validation (#13964) 2022-08-21 23:55:03 +05:30
William Falcon aa83255c2c
Update README.md 2022-08-20 14:03:25 -04:00
William Falcon a73fef4fa2
Update README.md 2022-08-20 10:19:04 -04:00
William Falcon 238646508f
Update README.md 2022-08-20 10:18:37 -04:00
William Falcon 6e96fc2936
Update README.md 2022-08-20 10:17:40 -04:00
Krishna Kalyan 0ca3b5aa1b
Fix mypy errors attributed to `pytorch_lightning.callbacks.quantization` (#13782)
Co-authored-by: otaj <6065855+otaj@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-08-20 01:39:16 +02:00
Alec Merdler 0b1a29b5eb
Remove references to local app admin view (#14306)
The local app '/admin' route is being removed because it does
not provide any value, so we need to remove references from it
in the CLI.
2022-08-19 12:29:44 -04:00
Carlos Mocholí 8662ab25d4
Adjust mergify's number of reviewer rules (#14293) 2022-08-19 14:05:23 +00:00
Justin Goheen 090bbc8605
Fix mypy errors attributed to `pytorch_lightning.core.module.py` (#13603)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-08-19 07:03:43 -04:00
dependabot[bot] c9b3cda0e0
Bump actions/upload-artifact from 2 to 3 (#14289)
Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 2 to 3.
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](https://github.com/actions/upload-artifact/compare/v2...v3)

---
updated-dependencies:
- dependency-name: actions/upload-artifact
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-19 07:01:54 +00:00
dependabot[bot] 278df1cd20
Bump actions/setup-node from 2 to 3 (#14286)
Bumps [actions/setup-node](https://github.com/actions/setup-node) from 2 to 3.
- [Release notes](https://github.com/actions/setup-node/releases)
- [Commits](https://github.com/actions/setup-node/compare/v2...v3)

---
updated-dependencies:
- dependency-name: actions/setup-node
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-19 14:37:48 +09:00
dependabot[bot] 2dbdb00b03
Bump actions/setup-python from 2 to 4 (#14287)
Bumps [actions/setup-python](https://github.com/actions/setup-python) from 2 to 4.
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](https://github.com/actions/setup-python/compare/v2...v4)

---
updated-dependencies:
- dependency-name: actions/setup-python
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-19 05:31:47 +00:00
dependabot[bot] bbb406bce9
Update ipython[all] requirement from <=8.1.1 to <8.4.1 in /requirements (#14281)
Updates the requirements on [ipython[all]](https://github.com/ipython/ipython) to permit the latest version.
- [Release notes](https://github.com/ipython/ipython/releases)
- [Commits](https://github.com/ipython/ipython/compare/rel-0.8.4...8.4.0)

---
updated-dependencies:
- dependency-name: ipython[all]
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-19 14:14:16 +09:00
Kaushik B a8c6e69b43
Fix wrong num padding for RichProgressBar (#14296) 2022-08-19 09:40:44 +05:30
Raphael Randschau d71dba3721
BYOC: fix default types for cluster instance types (#14260) 2022-08-18 14:12:59 -07:00
Rohit Gupta d9c6090170
Deprecate `on_colab_kaggle` func (#14247)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-08-18 18:34:21 +00:00
Carlos Mocholí f7ac57050f
Update mising CODEOWNERS for the PL package (#14280)
* Update CODEOWNERS

* Update .github/CODEOWNERS
2022-08-18 14:26:58 -04:00
Hyunjoo Lee e64a4c3836
Fix mypy typing errors attributed to `pytorch_lightning/demos/mnist_datamodule.py` (#13929)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-08-18 13:16:22 -04:00
Akihiro Nitta 6285a83d38
CI: Let dependabot check GHA updates weekly (#14274) 2022-08-18 17:07:15 +02:00
Adrian Wälchli 326f7565b0
Forward extra keyword arguments in `LightningDataModule.from_datasets` (#14185)
Co-authored-by: otaj <ota@lightning.ai>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-08-18 14:06:39 +00:00
Adrian Wälchli 7879628a3a
Fix access to logger attribute when multiple loggers are used (#14234)
* Fix access to logger attribute when multiple loggers are used

* add changelog
2022-08-18 08:55:08 -04:00
dependabot[bot] bd55b56f56
Update scikit-learn requirement from <=1.1.1,>0.22.1 to >0.22.1,<1.1.3 in /requirements (#14276)
Update scikit-learn requirement in /requirements

Updates the requirements on [scikit-learn](https://github.com/scikit-learn/scikit-learn) to permit the latest version.
- [Release notes](https://github.com/scikit-learn/scikit-learn/releases)
- [Commits](https://github.com/scikit-learn/scikit-learn/compare/0.22.2...1.1.2)

---
updated-dependencies:
- dependency-name: scikit-learn
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-18 14:14:09 +02:00
Rohit Gupta e949362a6b
Enable `on_before_batch_transfer` for `DPStrategy` and `IPUAccelerator` (#14023)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-08-18 12:12:29 +00:00
Laverne Henderson 8ab65ffade
Fixes note formatting and more (#14264)
Fixes formatting for a note and makes headings for arguments and parameters stand out
2022-08-18 13:55:49 +02:00
dependabot[bot] caa0d594b1
Update torch requirement from <=1.12.0,>=1.9.* to >=1.9.0.a,<1.13.0 in /requirements (#14088)
* Update torch requirement in /requirements

Updates the requirements on [torch](https://github.com/pytorch/pytorch) to permit the latest version.
- [Release notes](https://github.com/pytorch/pytorch/releases)
- [Changelog](https://github.com/pytorch/pytorch/blob/master/RELEASE.md)
- [Commits](https://github.com/pytorch/pytorch/compare/v1.9.0-rc1...v1.12.1)

---
updated-dependencies:
- dependency-name: torch
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update base.txt

* Update adjust_versions.py

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-08-18 10:57:13 +00:00
Adrian Wälchli 047f0aa1e4
Fix type check for non-standard schedulers in horovod (#14215) 2022-08-18 09:09:23 +00:00
dependabot[bot] 401eb2c535
Update tensorboard requirement from <2.10.0,>=2.9.1 to >=2.9.1,<2.11.0 in /requirements (#14200)
Update tensorboard requirement in /requirements

Updates the requirements on [tensorboard](https://github.com/tensorflow/tensorboard) to permit the latest version.
- [Release notes](https://github.com/tensorflow/tensorboard/releases)
- [Changelog](https://github.com/tensorflow/tensorboard/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorboard/compare/2.9.1...2.10.0)

---
updated-dependencies:
- dependency-name: tensorboard
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-18 08:45:59 +00:00
Jirka Borovec 52051c5823
release LAI docs as stable (#14250) 2022-08-18 08:11:49 +00:00
Adrian Wälchli d9eb8567f0
Update changelog after 1.7.2. release (#14251) 2022-08-18 07:52:16 +00:00
Adrian Wälchli 7d17310966
Terminate process when main process raises error in ServableModuleValidator (#14217)
Co-authored-by: otaj <6065855+otaj@users.noreply.github.com>
2022-08-17 19:08:41 +00:00
Laverne Henderson 1745d192f9
Remove incorrect "template" information (#13911)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-17 14:35:23 -04:00
Adrian Wälchli 2e59c49592
Update defaults for WandbLogger's run name and project name (#14145) 2022-08-17 16:31:20 +00:00
otaj 44cdbcab04
Allowed setting attributes on `DataLoader` and `BatchSampler` when instantiated inside `*_dataloader` hooks (#14212) 2022-08-17 11:42:54 -04:00
Jirka Borovec 909e7e7788
CI: docker focus on PL only (#14246)
* CI: docker focus on PL only

* group
2022-08-17 11:39:27 -04:00