Commit Graph

8149 Commits

Author SHA1 Message Date
thomas chaton 0250c1980d
[App] Resolve bi-directional queue bug (#15642) 2022-11-11 15:22:18 +00:00
Adrian Wälchli 0dfb3d28ce
Support individual setup of model and optimizer in Lite (#15185) 2022-11-11 14:36:59 +01:00
Carlos Mocholí 32e319af27
Revert "Do not modify MANIFEST.in on install (#15549)" (#15644)
This reverts commit 4ea44dd276.
2022-11-11 14:23:04 +01:00
Adrian Wälchli 18288eb3f3
Checkpoint migration for `ModelCheckpoint` state-key changes (#15606)
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-11-11 13:06:25 +00:00
Tianshu Wang c53dc205ed
Make sure save_dir can be empty str (#15638) 2022-11-11 12:21:22 +01:00
Akihiro Nitta 164e5a7b3e
Remove the docs for passing strategy args to accelerator (#15636) 2022-11-11 05:46:10 -05:00
thomas chaton 2f0c0396b8
[App] Resolve race condition to move ui files (#15398) 2022-11-11 10:15:12 +00:00
Adrian Wälchli 75b5042081
Validate that state-key is unique when using multiple callbacks of the same type (#15634) 2022-11-11 05:15:03 -05:00
thomas chaton 61c1f699ea
[App] Enable state broadcast with MultiNode (#15607) 2022-11-11 10:06:40 +00:00
Carlos Mocholí 4ea44dd276
Do not modify MANIFEST.in on install (#15549)
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2022-11-11 09:25:13 +00:00
Carlos Mocholí bd870c605f
Enable Probot CheckGroup v3 (#15622) 2022-11-11 09:40:21 +01:00
Akihiro Nitta a7befe1238
Remove `get_gpu_memory_map` deprecated since v1.5 (#15617)
* Remove function deprecated in v1.5

* Update changelog

* rip

* Update graveyard

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Add death test

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Update test case name

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Address pre-commit failures

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-11-11 04:01:06 +00:00
Jirka Borovec 43fd9c1534
CI: fix pypi pkg (#15630) 2022-11-11 00:19:55 +01:00
Jirka Borovec 38f2a9110e
mypy: ignore mypy serve (#15631) 2022-11-10 16:38:38 -05:00
William Falcon d5c0effcfb
Docs 4/n (#15628)
* remove source-lit

* docs

* docs

* docs

* docs

* ic

* deploy

* deploy

* deploy

* deploy

* deploy

* deploy

* Apply suggestions from code review

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* make build run

Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Rick Izzo <rick@grid.ai>
2022-11-10 14:48:48 -05:00
Sherin Thomas 136a090f99
Sample datatype for Serve Component (#15623)
* introducing serve component

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* clean up tests

* clean up tests

* doctest

* mypy

* structure-fix

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* cleanup

* cleanup

* test fix

* addition

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* test fix

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* requirements

* getting future url

* url for local

* sample data typeg

* changes

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* prediction

* updates

* updates

* manifest

* fix type error

* fixed test

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Rick Izzo <rick@grid.ai>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-11-10 14:39:36 -05:00
thomas chaton 61d325376a
Add Ethan as Lightning App CodeOwners (#15626)
update
2022-11-10 13:39:40 -05:00
thomas chaton 7ec15ae43a
[App] Rename to new convention (#15621)
* update

* update
2022-11-10 16:19:18 +01:00
Carlos Mocholí 6ba00af1e0
Drop PyTorch 1.9 support (#15347)
* Drop 1.9

* Everything else

* READMEs

* Missed some

* IPU skips

* Remove exception type

* Add back
2022-11-10 08:59:13 -05:00
Rick Izzo bdd27991eb
Fix: App comment command execution sequencing (#15615)
* fixed condition in which app command comments would not execute before the flow is dispatched

* remove debug print statment

* updated example code

* fix test

* updates to test

Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2022-11-10 07:43:04 -05:00
thomas chaton 47314eafbd
[App] Resolve multi-node cloud bug (#15619)
update
2022-11-10 07:42:19 -05:00
thomas chaton 3cad7aa073
Optimize Payload Time locally (#15601) 2022-11-10 11:49:57 +00:00
thomas chaton 10cdf0dd2c
[App] Introduce Bi-directional queues (#15582)
* update

* update

* update

* update

* update

* udpate

* update

* update

* update

* update

* update

* updatre

* update

* update

* update

* updar

* update

* update

* update

* remove print

* update

* update

* update

* update

* update

* update

* update

* update
2022-11-10 12:21:51 +01:00
Tanay Mehta 680408e75b
Use `monkeypatch.chdir` instead of `os.chdir` in tests (#15579) 2022-11-10 10:42:34 +00:00
Adrian Wälchli 22813c4bbf
Avoid torchelastic warning message when importing lightning (#15610) 2022-11-10 10:37:48 +00:00
Sherin Thomas f1bd68da3b
Serve component (#15609)
Serve component (#15609)
2022-11-10 15:31:07 +05:30
Jerome Anand e79a69a9ee
Upgrade to HPU release 1.7.0 (#15616)
Signed-off-by: Jerome <janand@habana.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-11-10 10:47:17 +01:00
Adrian Wälchli 2076746238
Update Lightning Lite examples (#15599)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-11-10 04:16:46 -05:00
Carlos Mocholí 4f4b43f17b
Enable Probot CheckGroup V2 (#15612)
* Enable v2

* Run on draft

* DEBUG

* maintainers and owner

* Revert "DEBUG"

This reverts commit 1414e85902.
2022-11-10 02:25:43 -05:00
Adrian Wälchli 657c6748ed
Integrate Lite launcher into Lightning CLI (#15506)
* add click wrapped argparse
* lite -> model
* notebook
* update

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-11-10 02:59:40 +00:00
Adrian Wälchli d4b67880ad
Expose sharding context manager in Lite (#15169)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-11-10 01:06:39 +00:00
Adrian Wälchli 7decc50a87
ENG-1524: Change retry mechansim default in LightningClient (#15412)
* Change retry mechansim default in LightningClient
* add changelog
* fix weird patching mechanism
* remove unused import
* hack the system
* try again, maybe something has changed in the package

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2022-11-09 21:19:06 +00:00
thomas chaton f06de83634
[App] Enable debugger with LightningApp (#15590) 2022-11-09 20:46:31 +00:00
Dan Dale 9a4e8a8c52
Enhance `reduce_boolean_decision` to accommodate `any`-analogous semantics expected by `EarlyStopping` Callback (#15253)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-11-09 20:17:42 +00:00
dependabot[bot] e97df1afae
Update myst-parser requirement from <0.17,>=0.15 to ==0.18.1 in /requirements (#14417)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-11-09 18:55:16 +00:00
thomas chaton 5079ea06cb
[App] Resolve Multi Node examples (#15605)
* update

* update

* update

* update
2022-11-09 19:00:17 +01:00
Carlos Mocholí abb160a78a
Add .actions CODEOWNERS (#15602) 2022-11-09 10:37:01 -05:00
Mauricio Villegas acccc4d423
Fix LightningCLI docs after overhaul of the documentation (#14976)
* - Fix diverse issues introduced when the documentation was restructured.
- Change the docs to be focused on configure hyperparameters instead of reduction of bolierplate.

* Update docs/source-pytorch/cli/lightning_cli.rst

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* - Fix diverse issues introduced when the documentation was restructured.
- Change the docs to be focused on configure hyperparameters instead of reduction of bolierplate.

* Fixes based on review.

* Apply suggestions from code review

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

* Fix wrap width.

* Move save_hyperparameters and load_from_checkpoint to lightning_module page.

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2022-11-09 10:36:47 -05:00
Adrian Wälchli 117ea3134f
Update outdated deadlock detection test (#15594)
* improve deadlock detection test
* check if failure gets caught
* remove
2022-11-09 16:17:00 +01:00
Rick Izzo 10b945bcc1
Run Command from App Comments (#15577)
* initial work

* this seems to work well

* added example test

* updated docs & logging

* fixed errors

* fix typing error

* now using the --setup flag to decide if we should execute app comment commands or not

* updated tests

* added tests

* added test to ci

* fixed failing tests

* code review

* updates
2022-11-09 09:45:38 -05:00
Rohit Gupta f4ca5623d2
Make checkpointing on train epoch end condition dynamic (#15300)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-11-09 14:27:53 +00:00
Akihiro Nitta a00dfc850d
CI: Use new syntax for setting github output (#15415)
Use new syntax for setting github output

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-11-09 14:07:52 +00:00
Adrian Wälchli 3dcb85a85a
Undo marking tests that don't need it as standalone (#15355)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-11-09 14:03:25 +00:00
Ethan Harris 733695d037
[App] Add `start_with_flow` flag to works (#15591)
* Initial commit

* Update cloud runner

* Add `start_with_flow` flag

* Update CHANGELOG.md

* Update src/lightning_app/core/work.py

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* Update cloud runner

* Revert, not needed

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-11-09 08:54:22 -05:00
dependabot[bot] fc78d8d6e5
Update fastapi requirement from <0.83.0 to <0.87.0 in /requirements (#15564)
Updates the requirements on [fastapi](https://github.com/tiangolo/fastapi) to permit the latest version.
- [Release notes](https://github.com/tiangolo/fastapi/releases)
- [Commits](https://github.com/tiangolo/fastapi/compare/0.1.11...0.86.0)

---
updated-dependencies:
- dependency-name: fastapi
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-09 08:31:43 +00:00
David Gilbertson b04a7aab9c
Docs: Update tutorial to match PyTorchProfiler changes (#15440)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-11-09 01:28:05 +01:00
Adrian Wälchli f2449ac5ab
Fix wandb test writing artifacts to cwd (#15551) 2022-11-08 19:13:49 +00:00
Carlos Mocholí e33d09a1a8
Reuse assistant code to create the mirror package (#15365) 2022-11-08 18:52:24 +00:00
Kaszanas 35b66fd890
Fixed typo Havana -> Habana for HPUs (#15589)
Fixed typo Havana -> Habana

HPUs are accelerators built by Habana Labs.
2022-11-08 19:09:54 +01:00
Rohit Gupta 1a8f2e8516
Support DDP with LRFinder (#15304)
* Support DDP for LRFinder
* Apply suggestions from code review
* rank 0 is the decision maker

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-11-08 17:55:15 +00:00