Commit Graph

9015 Commits

Author SHA1 Message Date
dependabot[bot] c580998d7c
Bump Lightning-AI/utilities from 0.7.1 to 0.8.0 (#17052)
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-13 10:02:56 +00:00
Jirka Borovec 7d16a9e370
docs: update version matrix (#17041) 2023-03-12 23:17:04 +01:00
Dmitry Frolov 35d15621c7
Data connection mounts for jobs running from CloudSpaces (#17006)
* Data connection mounts for jobs running from CloudSpaces

* Tests

* Tests fix

* Bump Lightning Cloud
2023-03-11 13:17:18 -05:00
Adrian Wälchli b9591d91ee
Sort Trainer arguments based on importance (#17022) 2023-03-10 23:53:38 +00:00
Adrian Wälchli 6fcccea3fa
Add cute teaser animations to Fabric docs (#17021) 2023-03-10 12:16:07 -05:00
Carlos Mocholí da276dbd35
Error checking for non-iterables (#17007) 2023-03-10 17:02:28 +00:00
Adrian Wälchli b09c0776bc
Force keyword-only usage to init Fabric (#17023) 2023-03-10 15:59:07 +00:00
janEbert dd02397720
Allow frozen data classes in optimizer state dict (#16656)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2023-03-10 15:37:18 +00:00
Adrian Wälchli 7c80fe6990
Update links to latest PL docs (#17031) 2023-03-10 14:21:15 +00:00
Carlos Mocholí 95831286b3
Update mypy job to 1.1.1 (#16974) 2023-03-10 01:43:28 +00:00
Jirka Borovec bb69e2c916
rtfd: try to collapse docs (#17020) 2023-03-09 20:05:50 -05:00
Carlos Mocholí 8d586c6661
The psutil package is now required for CPU monitoring (#17010) 2023-03-10 00:41:17 +00:00
Carlos Mocholí da6263a4b1
Move HPU broadcast override to the HPU strategy file (#17011) 2023-03-10 00:04:26 +00:00
Adrian Wälchli 0cdbc24b5e
Revert "Use base version when comparing torch versions" (#17019)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-03-10 00:02:21 +00:00
Carlos Mocholí 0f1f7549fa
Mark internal components as protected (#17009) 2023-03-10 00:46:42 +01:00
Carlos Mocholí b97cf4b5a3
Mark the connectors as protected (#17008) 2023-03-10 00:44:04 +01:00
Jirka Borovec bb960b841c
rtfd: try another redirect (#17018) 2023-03-09 21:25:39 +01:00
Dmitry Frolov 4a531b2d5a
System customization syncing for jobs run (#16932)
* System customization syncing for jobs run

* Constants moved

* Moving files

* Update src/lightning/app/runners/cloud.py

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* Update test_cloud.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update test_cloud.py

---------

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-03-09 14:35:41 -05:00
Jirka Borovec c03099d17b
revert building docs with redirect (#17016) 2023-03-09 19:45:36 +01:00
Carlos Mocholí d928a0d993
Inline functions called by `_run_stage` (#17015) 2023-03-09 19:25:29 +01:00
Jirka Borovec 7f44dba7ed
RTFD: building docs for with redirect (#16993)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-03-09 13:05:30 -05:00
Jirka Borovec 9b168dcf9b
docs: listing past versions (#17014)
Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-03-09 17:52:20 +00:00
Carlos Mocholí f7b89cd233
Review APIs experimental status (#17012) 2023-03-09 16:56:49 +00:00
Carlos Mocholí 2162d95f14
Link to PyTorch in FSDP docs (#17013) 2023-03-09 16:55:11 +00:00
Adrian Wälchli 66966b405e
Update Fabric docs with installation instructions (#16996) 2023-03-09 13:28:06 +01:00
Carlos Mocholí 19866b58b7
Workarounds for log support with Torch 2.0 (#16986) 2023-03-09 00:57:31 +00:00
Carlos Mocholí 279e3add00
Update Trainer property docstrings (#16989) 2023-03-09 00:12:06 +00:00
Carlos Mocholí 20374b93f4
Remove unused code (#17001) 2023-03-09 00:07:48 +00:00
Carlos Mocholí bdd9b12c5a
Refactor `loop.setup_data` with utility functions (#16918) 2023-03-09 00:04:42 +00:00
Adrian Wälchli aa7f2522dc
Fix race condition in Fabric test (#17002) 2023-03-08 16:36:00 -05:00
Carlos Mocholí d7e2ab98d8
Typing fixes (#17000) 2023-03-08 17:31:50 +00:00
Carlos Mocholí 3328b047fb
Inline the `ModelIO` interface (#16999) 2023-03-08 18:28:28 +01:00
Adrian Wälchli 98f97081a3
Make examples runnable (#16981)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-03-08 17:16:41 +00:00
Carlos Mocholí c294158823
Add compatibility matrix (#16998) 2023-03-08 18:03:03 +01:00
Luca Furst e57f12851f
[App] Use environment variables from args when loading apps for the CloudRuntime
## What does this PR do?

Passes environment variables to the `CloudRuntime` when loading an app from a file. Allows apps / works / flows to be properly configured when passing variables at runtime.

### Limitations

- Only implemented for the `CloudRuntime`

<details>
  <summary><b>Before submitting</b></summary>

- Was this **discussed/agreed** via a GitHub issue? (not for typos and docs)
- [ ] Did you read the [contributor guideline](https://github.com/Lightning-AI/lightning/blob/master/.github/CONTRIBUTING.md), **Pull Request** section?
- [ ] Did you make sure your **PR does only one thing**, instead of bundling different changes together?
- Did you make sure to **update the documentation** with your changes? (if necessary)
- Did you write any **new necessary tests**? (not for typos and docs)
- [ ] Did you verify new and **existing tests pass** locally with your changes?
- Did you list all the **breaking changes** introduced by this pull request?
- Did you **update the CHANGELOG**? (not for typos, docs, test updates, or minor internal changes/refactors)

<!-- In the CHANGELOG, separate each item in the unreleased section by a blank line to reduce collisions -->

</details>

## PR review

Anyone in the community is welcome to review the PR.
Before you start reviewing, make sure you have read the [review guidelines](https://github.com/Lightning-AI/lightning/wiki/Review-guidelines). In short, see the following bullet-list:

<details>
  <summary>Reviewer checklist</summary>

- [ ] Is this pull request ready for review? (if not, please submit in draft mode)
- [ ] Check that all items from **Before submitting** are resolved
- [ ] Make sure the title is self-explanatory and the description concisely explains the PR
- [ ] Add labels and milestones (and optionally projects) to the PR so it can be classified

</details>

<!--

Did you have fun?

Make sure you had fun coding 🙃

-->


cc @borda
2023-03-08 10:34:41 -05:00
Jon Crall 0ec44f18c4
Allow sys.argv and args in LightningCLI (#16808) 2023-03-07 17:33:26 -05:00
Adrian Wälchli 63b9034985
Use base version when comparing torch versions (#16657)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-03-07 21:15:48 +00:00
Aniket Maurya da572d7cca
Refactor PL examples to `examples/pytorch/` (#16925)
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2023-03-07 11:24:46 -05:00
Adrian Wälchli b6c693d345
Add test for `torch.compile()` with `Fabric.setup()` (#16977) 2023-03-07 10:57:31 -05:00
Adrian Wälchli 1e42783973
Miscellaneous updates in Fabric docs (#16980) 2023-03-07 15:43:47 +00:00
Jirka Borovec 95254ca587
ci/docs: clean toods (#16982) 2023-03-07 16:39:52 +01:00
Jirka Borovec fb7cd28224
ci: update group-check (#16984) 2023-03-07 16:38:57 +01:00
Jirka Borovec 16e39a2407
typing: fix App's core API - App (#16949)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-03-07 14:47:17 +00:00
Ruslan Mukhametshin 863f575caa
Update documentation about configuration files structure (#16956) 2023-03-07 13:31:11 +01:00
Adrian Wälchli 0e84f01b09
Document how to use multiple models and optimizers in Fabric (#16952) 2023-03-07 13:19:43 +01:00
Jirka Borovec 4e26cd5f43
typing: fix App's core API - Queues (#16948) 2023-03-07 12:31:26 +01:00
Nikhil Shenoy 6bb3e992ed
Example of K-fold Cross Validation with `Fabric` (#16909)
Co-authored-by: Nikhil Shenoy <nikhilshenoy@dhcp-128-189-229-146.ubcsecure.wireless.ubc.ca>
Co-authored-by: Nikhil Shenoy <nikhilshenoy@dhcp-128-189-231-235.ubcsecure.wireless.ubc.ca>
Co-authored-by: Nikhil Shenoy <nikhilshenoy@dhcp-128-189-229-169.ubcsecure.wireless.ubc.ca>
Co-authored-by: Nikhil Shenoy <nikhilshenoy@dhcp-128-189-230-40.ubcsecure.wireless.ubc.ca>
2023-03-07 08:43:52 +01:00
Jirka Borovec fce2f86f6d
add pkg info files (#16610)
* add pkg info files

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update src/lightning_app/shell-folder_code-lives-lightning.info

* Update src/lightning_app/shell-folder_code-lives-lightning.info

* Update src/lightning_fabric/shell-folder_code-lives-lightning.info

* Update src/lightning_fabric/shell-folder_code-lives-lightning.info

* Update src/pytorch_lightning/shell-folder_code-lives-lightning.info

* Update src/pytorch_lightning/shell-folder_code-lives-lightning.info

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
2023-03-07 08:24:57 +01:00
Luca Furst 77e1cc92d4
[App] Add --zip option to cp command (#16798)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-03-07 08:04:38 +01:00
Jirka Borovec a96d976567
docs: building releases (#16967)
* docs: building releases

* codeowners

* todo

* rev

* on *

* push tag

* name
2023-03-06 23:12:03 -05:00