Commit Graph

7875 Commits

Author SHA1 Message Date
Adrian Wälchli 5bef75648e
Remove deprecated `torch_distributed_backend` logic (#14693)
* Remove deprecated torch_distributed_backend logic
* changelog
* mention deprecated
* imports

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-09-16 17:27:36 +02:00
otaj ced94874b2
Use valid pypi versions for install in assistant (#14750)
Co-authored-by: Kushashwa Ravi Shrimali <kushashwaravishrimali@gmail.com>
2022-09-16 13:26:04 +00:00
Carlos Mocholí c2159c48a5
Fix CC-bot for non-forks (#14710) 2022-09-16 12:41:02 +00:00
Jirka Borovec 0b2ebbeb4b
CI: update HPU pool (#14733) 2022-09-16 12:04:13 +00:00
Adrian Wälchli 619e76f22d
Remove silent behavior when `num_slurm_tasks` does not correspond to number of processes in Trainer (#14300)
* simplify logic
* remove hpc
* update
* add changelog
* more tests
* update test

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-16 11:00:09 +00:00
Adrian Wälchli fbb7177e5f
Combine the pip install commands in conda workflow (#14744) 2022-09-16 10:02:54 +00:00
Jirka Borovec 57ae32783a
update codeowners (#14718) 2022-09-15 22:32:04 -04:00
Laverne Henderson 9ea4ab6b19
Update installation (#14732)
* Update installation

Updates to use python -m pip install -U lightning and adds troubleshooting note

* Apply suggestions from code review

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-15 15:30:32 -04:00
Yurij Mikhalevich 09f50b4295
Fix Google Tag Manager for the Lightning App docs (#14731)
- updates the Lightning App docs theme to the one without Pytorch Lightning docs Google Tag Manager hardcoded
- sets the GTM id in the conf.py for Lightning App docs
2022-09-15 18:35:16 +00:00
Laverne Henderson 89adc4bb40
New bug form (#14193)
Created a YAML form to replace the MD form for issues.

* Minor update to form
* Removed MD issue form
* More updates
* Renamed the file

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-15 19:09:33 +02:00
Jirka Borovec 4f88014cc5
Docs: fix link to title (#14730)
* lower
2022-09-15 18:57:43 +02:00
Ethan Harris 81c53fdaec
Invalid cache before listing drive when collecting component names (#13971)
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-15 14:58:07 +00:00
Adrian Wälchli 38d89713a5
Standalone Lite: Connector (#14692)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2022-09-15 14:14:51 +00:00
Carlos Mocholí 5ff78f0753
Use the setter in the children recursively (#14724) 2022-09-15 13:58:12 +00:00
Akihiro Nitta 3c5e03e035
docs: Clarify versioning and API stability (#14549)
* mv releases to a standalone page

* Include release_policy in index

* Update policy

* mv releases to a standalone page

* Include release_policy in index

* Update policy

* Update title

* remove release_policy.rst

* Update versioning

* syntax

* simplify wording

* Include examples that don't follow X+2 rule

* syntax

* update

* consistency

* rm noninformative statement

* .

* Reduce redundancy in the deprecation process

* grammar?

* consistency

* Update docs/source-pytorch/versioning.rst

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-09-15 09:16:14 -04:00
Alec Merdler 71719b9960
Support Injecting Secrets into Apps Running in the Cloud (#14612)
Adds a new '--secret' flag to 'lightning run app':

lightning run app --cloud --secret MY_SECRET=my-secret-name app.py

When the Lightning App runs in the cloud, the 'MY_SECRET'
environment variable will be populated with the value of the
referenced Secret. The value of the Secret is encrypted in the
database, and will only be decrypted and accessible to the
Flow/Work processes in the cloud.

Co-authored-by: Sherin Thomas <sherin@grid.ai>
Co-authored-by: Noha Alon <nohalon@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2022-09-15 09:15:59 -04:00
Adrian Wälchli d4afab2243
Remove mentions of @awaelchli from source code (#14425)
* Remove a todo from trainer regarding exception handling

* Remove mentions of TODO(@awaelchli) from code

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-15 09:15:27 -04:00
Adrian Wälchli 6585f5e962
Add code-owners for standalone Lite package (#14694)
* Add Lite codeowners

* remove Borda on request
2022-09-15 09:15:08 -04:00
Sherin Thomas 7dbd038a94
Bump lightning cloud for memory leak fix (#14697)
Bump lightning cloud for memory leak fix (#14697)
2022-09-15 17:59:12 +05:30
Carlos Mocholí 63014a80cb
Tune the checkgroup config (#14712)
* Tune the checkgroup config
* Lite does not support HPU and IPU atm
* Skip HPU as the server is down
2022-09-15 11:41:25 +00:00
Carlos Mocholí df640f7d87
Drop gatekeeper CI checks (#14717) 2022-09-15 11:29:47 +00:00
Neven Miculinic 75e6c9109c
[CLI] Fix cluster logs with over 5000 entries (#14458) 2022-09-15 11:05:46 +00:00
Adrian Wälchli d3dcd68852
Standalone Lite: DDP Spawn Strategy Family (#14675)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-15 10:51:12 +00:00
Laverne Henderson 692f0f3d5d
Resolve minor formatting issue (#14706) 2022-09-15 08:37:50 +00:00
Adrian Wälchli deca6cc5c4
Standalone Lite: DDP Strategy Family (#14670)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-15 01:36:17 +00:00
Carlos Mocholí 98cf134bb3
Add the probot check-group action (#14621)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-15 02:08:11 +02:00
Adrian Wälchli 8b3d6d8feb
Add easy access to `state_dict` in Lite module wrapper (#14629)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-09-14 19:29:23 -04:00
Adrian Wälchli 7867d152b3
Standalone Lite: DataParallel Strategy (#14681)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-14 19:27:53 -04:00
Benjamin Krala c2378bd3b1
Add documentation for trainer.datamodule and dataloaders of a trainer object (#14600)
* Update trainer.rst
* Update datamodule.rst
2022-09-14 15:46:34 +00:00
Adrian Wälchli 32cb774a5c
Standalone Lite: Single Device TPU Strategy (#14663)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-14 14:22:07 +00:00
Manan Goel 48e783dd0d
Added support for downloading wandb artifacts in the WandbLogger (#14551)
* Added functions to the WandbLogger to download and use artifacts without having to access the experiment object
* Updated CHANGLELOG.md
* Added suggested changes
* Delete test_script

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2022-09-14 14:11:52 +00:00
Adrian Wälchli 6333caabb0
Standalone Lite: Strategy base classes and registry (#14662)
* add accelerator implementations to lite

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix imports

* rename registry argument

* fix test

* fix tests

* remove duplicated test

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix tests

* deprecation

* deprecations

* flake8

* fixes

* add mps to runif

* fix tests

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Apply suggestions from code review

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove more

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* local import

* undo device stats :(

* fix import

* stupid typehints

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* more refactors :(

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix

* rename init_device to setup_device

* remove unused import

* make uppercase to differentiate from class

* trick test after moving import locally

* add base classes and registry

* reg

* registry

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* tests

* update to other branches

* resolve todo(lite)

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add very basic unit tests

* fix name assignment

* Update src/lightning_lite/strategies/parallel.py

Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>

* remove deprecated property

* remove pre- and post backward for now

* protecting the registry utility function

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove unused import

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2022-09-14 09:15:21 -04:00
Ritik Nandwal 8e9780bd5b
fix mypy typing errors in pytorch_lightning.utilities.data.py (#13901)
Co-authored-by: otaj <ota@lightning.ai>
2022-09-14 11:21:57 +00:00
Pritam Soni 9b01a0fd32
fix: e2e with short form after signup (#14689)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-09-14 10:52:55 +00:00
Carlos Mocholí 71dadb5307
Fix TPU CI for non-forks (#14688) 2022-09-14 16:32:07 +09:00
Sherin Thomas d579733b08
Lightning cloud client call with key word arguments (#14685) 2022-09-14 08:44:59 +02:00
Krishna Kalyan 14b36f8109
Fix incorrect imports in lightning docs (#14678) 2022-09-14 00:23:31 +02:00
dependabot[bot] f3736f642a
Update ipython[all] requirement from <8.4.1 to <8.5.1 in /requirements (#14671)
Updates the requirements on [ipython[all]](https://github.com/ipython/ipython) to permit the latest version.
- [Release notes](https://github.com/ipython/ipython/releases)
- [Commits](https://github.com/ipython/ipython/compare/rel-0.8.4...8.5.0)

---
updated-dependencies:
- dependency-name: ipython[all]
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-09-13 22:22:58 +00:00
Jerome Anand bc9dd1fb2a
Break hpu graphs into two for better performance (#14656)
Signed-off-by: Jerome <janand@habana.ai>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2022-09-14 00:21:47 +02:00
Jirka Borovec fcd1a8d8c1
CI: install more OS (#14660) 2022-09-13 14:03:49 -04:00
Carlos Mocholí 313c338da1
Remove legacy examples from logging docs (#14686) 2022-09-13 13:47:51 -04:00
Krishna Kalyan f68c0909fd
Fix mypy errors attributed to `pytorch_lightning.profilers.pytorch` (#14405)
* remove toml ref
* fix conflicts
* small fix
* move assertion

Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
2022-09-13 16:11:45 +00:00
thomas chaton c81a71c908
Lightning App Fixes from Training Studio App dev (#14532)
* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update
2022-09-13 11:43:15 -04:00
Laverne Henderson b24f5f164a
Content for Lightning with iOS and Android (#14038)
* Content for Lightning with iOS and Android

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* make link clickable

* Update docs/source-app/glossary/ios_and_android.rst

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-13 11:04:50 -04:00
otaj 616304831a
Remove deprecated `BaseProfiler` and `AbstractProfiler` (#14404)
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-09-13 14:52:09 +00:00
thomas chaton 96cc288f53
(hot fix) Resolve Boring App (#14684)
* resolve_boring_app

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update
2022-09-13 10:50:36 -04:00
Pritam Soni 16b4644e06
feat: LAI2-10296 check if user has sufficient credits to run an app from the cli (#14285) 2022-09-13 19:19:09 +05:30
Akihiro Nitta fd99cb27f2
Update CODEOWNER of CI/CD (#14676)
Update CODEOWNER
2022-09-13 09:38:14 -04:00
Adrian Wälchli 19a1274093
Better error message when dataloader and datamodule is None (V2) (#14637) 2022-09-13 12:26:03 +00:00
Adrian Wälchli 1ee3d1eb72
Avoid warning when cloning tensor in self.log (#14599)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-09-13 16:23:46 +05:30