Commit Graph

8228 Commits

Author SHA1 Message Date
Jirka Borovec 8ee889bea0
lit extras (#15793)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-11-24 22:08:51 +00:00
Adrian Wälchli a970f090a0
Ignore `num_nodes` when running MultiNode components locally (#15806) 2022-11-24 17:21:32 +00:00
dependabot[bot] e150d083c2
Update lightning-utilities requirement from ==0.3.* to ==0.4.* in /requirements (#15420)
Update lightning-utilities requirement in /requirements

Updates the requirements on [lightning-utilities](https://github.com/Lightning-AI/utilities) to permit the latest version.
- [Release notes](https://github.com/Lightning-AI/utilities/releases)
- [Changelog](https://github.com/Lightning-AI/utilities/blob/main/CHANGELOG.md)
- [Commits](https://github.com/Lightning-AI/utilities/compare/v0.3.0...v0.4.0)

---
updated-dependencies:
- dependency-name: lightning-utilities
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-24 16:18:32 +00:00
Adrian Wälchli a1bea00066
Minor LightningLite clean up (#15780) 2022-11-24 10:52:48 -05:00
thomas chaton 8ca6dfe646
[App] Add CloudMultiProcessBackend to run an children App within the Flow in the cloud (#15800)
* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* updte

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* Update src/lightning_app/CHANGELOG.md

Co-authored-by: Ethan Harris <ethanwharris@gmail.com>

* Update src/lightning_app/utilities/port.py

Co-authored-by: Ethan Harris <ethanwharris@gmail.com>

* Update src/lightning_app/utilities/port.py

Co-authored-by: Ethan Harris <ethanwharris@gmail.com>

* Update src/lightning_app/utilities/port.py

Co-authored-by: Ethan Harris <ethanwharris@gmail.com>

* Update src/lightning_app/utilities/port.py

Co-authored-by: Ethan Harris <ethanwharris@gmail.com>

* Update src/lightning_app/utilities/port.py

Co-authored-by: Ethan Harris <ethanwharris@gmail.com>

* Update src/lightning_app/utilities/port.py

Co-authored-by: Ethan Harris <ethanwharris@gmail.com>

Co-authored-by: Ethan Harris <ethanwharris@gmail.com>
2022-11-24 16:36:37 +01:00
Luca Antiga 0a1273187a
Add code_dir argument to tracer run (#15771) 2022-11-24 14:49:06 +00:00
Carlos Mocholí 9e43604df5
Notify the user of ignored requirements (#15799) 2022-11-24 15:09:25 +01:00
thomas chaton 3a99a256d3
[App] Stop App when it has succeeded (#15801) 2022-11-24 11:27:34 +00:00
Akihiro Nitta b682d4cf0b
Remove `pytorch_lightning.profiler.{AbstractProfiler,BaseProfiler}` deprecated since v1.6 (#15637)
* remove deprecated base profilers

* Update changelog

* remove import statement

* rip

* correct deprecation version

* update changelog

* Mark buried classes as private

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add typing

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-11-23 13:50:15 +00:00
Carlos Mocholí a9708105f7
Lazy import tensorboard (#15762) 2022-11-23 13:59:38 +01:00
Jirka Borovec 952b64b358
tests: split examples and pytests (#15774)
split examples and pytests
2022-11-23 20:15:16 +09:00
Yurij Mikhalevich 51bb845b7b
feature: add `_generate_works_json` method (#15767) 2022-11-22 23:37:58 +00:00
Rick Izzo 317591d2e2
Fix App Docs for lightning ssh-keys command (#15773)
fixed ssh-keys docs
2022-11-22 15:39:20 -05:00
Jirka Borovec 59fa32080d
Tests/App: refactor examples - structure (#15770)
* rename _examples dir

* refactor

* clean

* path

* add inits

* skip

* e2e

* azure

* e2e

* rev

* unify single depth for ignore docs req.

* group
2022-11-22 14:04:29 -05:00
Rick Izzo 7b2788e39c
Deduplicate top level lighting CLI command groups (#15761)
* unify remove and delete command groups & the add and delete command groups
* added changelog
* fix tests
* Apply suggestions from code review

Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2022-11-22 09:41:33 +00:00
Rick Izzo 75b05733ab
lightning delete cluster CLI command help text update (#15760)
* updated the lighting delete cluster CLI command help text output
* updated changelog
* typo fix
* Apply suggestions from code review

Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2022-11-22 04:13:42 -05:00
Jirka Borovec 1a07a9c783
mergify: drop ready for draft (#15766) 2022-11-22 10:12:58 +01:00
Kaushik B 2b61c92ceb
Fix the `examples/app_dag` App (#14359)
* Fix app dag example
* Add test
* Update doc
* Update tests/tests_app_examples/test_app_dag.py

Co-authored-by: Sherin Thomas <sherin@grid.ai>
2022-11-22 09:39:44 +01:00
dependabot[bot] cfb27bd75b
Bump pytest from 7.1.3 to 7.2.0 in /requirements (#15677)
Bumps [pytest](https://github.com/pytest-dev/pytest) from 7.1.3 to 7.2.0.
- [Release notes](https://github.com/pytest-dev/pytest/releases)
- [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pytest-dev/pytest/compare/7.1.3...7.2.0)

---
updated-dependencies:
- dependency-name: pytest
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-22 08:31:21 +00:00
Carlos Mocholí c55f80fcc8
Enable Probot CheckGroup v5.1 (#15763) 2022-11-22 17:15:33 +09:00
Luca Antiga ed3eef0a3f
Disable XSRF protection in StreamlitFrontend to support upload in localhost (#15684)
* Enable CORS in StreamlitFrontend to support upload
* Only disable XSRF when running on localhost
* Update test
* Use utility fn to detect if localhost

Co-authored-by: Luca Antiga <luca@lightning.ai>
2022-11-22 07:49:10 +00:00
Carlos Mocholí aef94ce52b
Fix azure path excludes (#15756)
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2022-11-22 01:25:01 +00:00
Jirka Borovec e15e1c8246
update chlog after 1.8.2 (#15754)
* update chlog after 1.8.2
* Apply suggestions from code review
2022-11-21 23:06:44 +01:00
Luca Antiga 9c2eb52c86
Switch from tensorboard to tensorboardx in logger (#15728)
* Switch from tensorboard to tensorboardx in logger
* Warn if log_graph is set to True but tensorboard is not installed
* Fix warning message formatting
* Apply suggestions from code review
* simplify for TBX as required pkg
* docs example
* chlog
* tbx 2.2

Co-authored-by: Luca Antiga <luca@lightning.ai>
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-11-21 20:53:25 +00:00
Justus Schock 006fde9747
FCCV Docs (#15598)
* add custom data iter docs

* add custom data iter docs

* Update docs/source-pytorch/data/custom_data_iterables.rst

* remove ToDevice

* nit

* Update docs/source-pytorch/data/custom_data_iterables.rst

Co-authored-by: Luca Antiga <luca.antiga@gmail.com>

* clarification for @lantiga

* typo

* Update docs/source-pytorch/data/custom_data_iterables.rst

* Update docs/source-pytorch/data/custom_data_iterables.rst

* Update docs/source-pytorch/data/custom_data_iterables.rst

Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
2022-11-21 15:30:58 -05:00
Adrian Wälchli 88b2e5a258
Revert new Hydra launch behavior (#15737)
* revert new hydra cwd behavior
* remove debug statements
* changelog

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2022-11-21 20:19:13 +00:00
Luca Antiga dd75906785
Move s3fs to cloud extras (#15729)
Co-authored-by: Luca Antiga <luca@lightning.ai>
2022-11-21 19:57:04 +00:00
Jirka Borovec ba140387f9
test for Enable setting property (#15755)
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Ethan Harris <ethanwharris@gmail.com>
2022-11-21 19:35:45 +00:00
thomas chaton 5cfb176214
[App] Enable properties for the Lightning flow (#15750) 2022-11-21 19:39:51 +01:00
Carlos Mocholí 6c8ee019f7
Enable Probot CheckGroup v5 (#15670) 2022-11-21 18:58:28 +01:00
Ethan Harris c2c197486a
[App] Improve `LightningTrainerScript` start-up time (#15751) 2022-11-21 17:13:14 +00:00
Ethan Harris bc797fd376
[App] Fix multi-node pytorch example CI (#15753) 2022-11-21 16:02:30 +00:00
dependabot[bot] 1ffbe1bf1e
Update beautifulsoup4 requirement from <=4.8.2 to <4.11.2 in /requirements (#15745)
* Update beautifulsoup4 requirement in /requirements

Updates the requirements on [beautifulsoup4](https://www.crummy.com/software/BeautifulSoup/bs4/) to permit the latest version.

---
updated-dependencies:
- dependency-name: beautifulsoup4
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* Apply suggestions from code review

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2022-11-21 23:22:43 +09:00
dependabot[bot] 0b58b6981e
Update tensorboard requirement from <2.11.0,>=2.9.1 to >=2.9.1,<2.12.0 in /requirements (#15746)
Update tensorboard requirement in /requirements

Updates the requirements on [tensorboard](https://github.com/tensorflow/tensorboard) to permit the latest version.
- [Release notes](https://github.com/tensorflow/tensorboard/releases)
- [Changelog](https://github.com/tensorflow/tensorboard/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorboard/compare/2.9.1...2.11.0)

---
updated-dependencies:
- dependency-name: tensorboard
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-21 23:20:23 +09:00
Adrian Wälchli 86568521fd
FSDP (native) support for LightningLite (#14967)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-11-21 13:58:37 +00:00
Alessio Quercia 46548337de
Add support for logging the model checkpoints to MLFlowLogger (#15246)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-11-21 13:40:37 +00:00
thomas chaton 6714ca7132
[App] Fix VSCode IDE debugger (#15747) 2022-11-21 13:06:06 +00:00
Yurij Mikhalevich 1a31d13521
feature(docs/app/lit_tabs): add works (#15731) 2022-11-21 13:46:01 +01:00
Adrian Wälchli ec7acb5ae5
Speed up subprocess launch (#15738) 2022-11-21 06:19:47 -05:00
Ethan Harris 83067977af
[App] Update multi-node examples (#15700)
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-11-21 10:41:59 +00:00
Sherin Thomas 08d14ec190
Torch inference mode for prediction (#15719)
torch inference mode for prediction
2022-11-19 18:05:55 +00:00
Yiftach Beer f40eb2cb1c
Fix broken link to CLI docs (#15723) 2022-11-19 14:17:11 +01:00
yiftachbeer d925077253
Fix typo in script name (#15724) 2022-11-19 12:26:35 +01:00
dymil 609b258fe8
Fix typo 'wether' (#15710) 2022-11-18 00:09:58 +01:00
yiftachbeer b40ca0ece5
remove unused random_split import from tutorial (#15716) 2022-11-18 00:09:46 +01:00
dependabot[bot] 13eb2a1f91
Bump coverage from 6.4.2 to 6.5.0 in /requirements (#15674)
Bumps [coverage](https://github.com/nedbat/coveragepy) from 6.4.2 to 6.5.0.
- [Release notes](https://github.com/nedbat/coveragepy/releases)
- [Changelog](https://github.com/nedbat/coveragepy/blob/master/CHANGES.rst)
- [Commits](https://github.com/nedbat/coveragepy/compare/6.4.2...6.5.0)

---
updated-dependencies:
- dependency-name: coverage
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-17 22:47:37 +00:00
Rick Izzo 98bcb3df2c
Parse all lines in app file looking for shebangs to run commands. (#15714)
fixed command parsing so that all lines in the file are parsed
2022-11-17 22:23:26 +00:00
Rick Izzo ee517f30a0
Fix catimage import (#15712) 2022-11-17 21:22:56 +00:00
Ethan Harris f57160ba3e
[App] Mock missing package imports when launching in the cloud (#15711)
Co-authored-by: manskx <ahmed.mansy156@gmail.com>
2022-11-17 20:17:33 +00:00
Yurij Mikhalevich befd3f6c22
fix(docs/app/lit_tabs): remove unused app_id, enable run instead (#15702) 2022-11-17 10:13:09 +01:00