Rooba
/
lightning
mirror of https://github.com/Lightning-AI/lightning.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,729 Commits 59 Branches 217 Tags 353 MiB
Commit Graph

275 Commits

Author SHA1 Message Date
Jirka Borovec 358336268f
enable codespell for docs & fixing +TPU (#18629) 
* precommit/codespell

* run

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* disable

* more fixing

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Apply suggestions from code review

* more fixing

* json

* note

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-09-26 11:54:44 -04:00
Adrian Wälchli f83ad093e5
Utility function to check shared filesystem (#18586) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-09-25 15:49:52 -04:00
Jirka Borovec d579cfed57
precommit: unify formatting with prettier (#18605) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-09-25 14:34:41 +02:00
Jirka Borovec 3fbf1540b0
docs: 3/3 enable Sphinx nitpicky [app] (#18603) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-09-21 22:44:59 +02:00
Jirka Borovec b4b21e0152
docs: 2/3 enable Sphinx nitpicky [pytorch] part 1/n (#18484) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-09-20 19:09:34 +02:00
Adrian Wälchli 01cd89fd04
Set up dataloaders in k-fold cross validation example (#18582) 2023-09-18 11:45:20 -04:00
Jirka Borovec 5f5d99eae6
Relax app dependencies for `lightning` | breaking imports from `L` (#18386) 
* make App conditional import

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* ci: min req.

* data + store

* typo

* module_available

* extra

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* typo

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* envs

* doctest

* more

* docs

* **

* rm

* -f

* Apply suggestions from code review

* docs

* Revert "docs"

This reverts commit 20e8e6be98.

* Apply suggestions from code review

* warnings

* breaking

* ...

* fixing source

* fixing examples

* fixing tests

* fixing docs

* fixing source

* fix mock

* fix trainer

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-08-28 11:28:58 -04:00
Jirka Borovec efa7b2f9ef
docformatter: config with black (#18064) 
* docformatter: config with black

* additional_dependencies: [tomli]

* 119

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-08-09 10:44:20 -04:00
pre-commit-ci[bot] 834bd61164
[pre-commit.ci] pre-commit suggestions (#17983) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Jirka B <j.borovec+github@gmail.com>
 2023-08-08 16:26:06 +02:00
Nripesh Niketan 4e3087951d
Add GPU Acceleration apple silicon examples (#18127) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2023-07-27 19:52:51 -04:00
Carlos Mocholí a9269aecdb
Add nightly testing to CUDA CI (#18078) 2023-07-17 20:53:29 +02:00
Carlos Mocholí 3a55f0c0a1
Minor miscellaneous fixes (#18068) 2023-07-13 06:01:58 -04:00
jere357 28007bd076
Consistent early exit logic for validation loop in Fabric Trainer example #17962 2023-07-03 08:26:50 -04:00
jere357 6329caa876
slightly changing the behavior of val_loop specifying the limit_val_batches or reaching should_stop (#17873) 2023-06-20 00:30:34 +02:00
Noha Alon ca30fd7752
Lightning Dataset (including optimized dataloading of s3 buckets) (#17743) 
* Lightning DataLoader

* lightning dataloader

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* init

* example

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* env var

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update src/lightning/pytorch/utilities/data/__init__.py

Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>

* remove unused functions

* extra reqs

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update src/lightning/pytorch/utilities/data/fileio.py

Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* imports work now! yay

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* tests

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* imports

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* missing import

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* error handling

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update creds for local use case

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* codeowners

* recursive get index

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* index

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* clean up get index

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update imagenet example

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* docstrings

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* docstrings

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* docstrings

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* example cleanup

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* changelog

* reqs

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* codeowners

* requirements

* expose LightningDataset too

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* expost LightningDataset at top level

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove unused private methods from init

* remove private imports

* upper bound on extra requirements

* review comments

* loosen req

* deps

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* test updating fabric base req

* remove version pin on s3fs to test

* recover missing function

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* tests

* update

* random

* torchdata >= 0.3.0

* update torchdata version

* remove torchdata version to test

* try rem torch version pin

* req

* update bucket in test

* req

* skips

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* import

* update structure to lightning.data

* base.txt for data reqs

* fix imports

* rename to LightningS3Dataset

* new workflow

* dont need to test warnings

* reqs

* req

* revert data folder in pytorch

* test import

* tests

* req

* req

* req

* torch version

* req

* req

* open dep

* reformatted

* pin strict

* pin strict extra

* req

* modify workflow, no cache

* try

* patch

* import

* fix

* dataset test

* update getattr

* pin everything to test

* remove torch preinstall from workflow

* workflow

* req

* Update .github/workflows/ci-tests-data.yml

Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>

* workflow

* workflow

* req

* Update .github/workflows/ci-tests-data.yml

Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>

* workflow

* print

* skip test for now

* update path join

* revert app dep version bump

* Update .github/workflows/ci-tests-data.yml

Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>

* workflow updates

* app base req

* req

* window test failure

* add data req to assistant

* try

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add missing comma

* updates

* update

* typo

* requirements

* try widening req

* older torch version

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* update

* update

* update

* cleanup tests

* typo again

* update

* remove unnecessary line

* Update .github/CODEOWNERS

* Discard changes to requirements/pytorch/base.txt

* Discard changes to requirements/fabric/base.txt

* Discard changes to requirements/app/base.txt

* requirements

* requirements

* one line

* app workflow pick only app reqs

* rename package

* undo

* don't use cache

* examples CI

* pytorch and fabric CI

* try remove cache

* Apply suggestions from code review

* jirka playing

* jirka playing

* jirka playing

* blah

* flatten LightningDataset

* cleans up dataset class

* jirka playing

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* jirka playing

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* extra

* fix dataset test

* update checkgroups

* Luca's review comments

* val error fix

* unskip test

* min

* fix precommit warning

* cpu

* docstrings

* req

* 2.0.1

* add return type

* typing errors

* req

* return types with quotations

* import for type-checking

* no botocore in cloudagnostic code

* exit args

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* backends typing

* remove oldest from data tests

* typing

* typing

* typing

* types

* type

* typing

* typing

* typing

* import fix

* Changelog

---------

Co-authored-by: Noha Alon <nohaalon@Nohas-MacBook-Air.local>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Justus Schock <justus.schock@posteo.de>
 2023-06-13 11:44:41 +01:00
Adrian Wälchli 9ff7d7120b
Add `rank_zero_first` utility (#17784) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-06-12 10:32:32 +00:00
Carlos Mocholí ea44aac10f
Use PL `is_overridden` in BYOT example (#17070) 2023-05-05 12:08:18 +00:00
Jirka Borovec 4413e98e4e
ruff: enable & fixing RET (#17540) 2023-05-05 09:34:40 +00:00
thomas chaton cafdc6d308
Examples: expose learning rate (#17513) 
Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
 2023-04-28 09:54:09 +00:00
thomas chaton a0dd8087d8
Resolve e2e CI (#17480) 
* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

---------

Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
 2023-04-28 10:58:08 +02:00
Jirka Borovec 156786343b
adding check for bandit vulnerabilities 1/n (#17382) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-04-27 09:43:12 +00:00
pre-commit-ci[bot] 91cb4b9b87
[pre-commit.ci] pre-commit suggestions (#17271) 
* [pre-commit.ci] pre-commit suggestions

updates:
- [github.com/PyCQA/docformatter: v1.4 → v1.6.0](https://github.com/PyCQA/docformatter/compare/v1.4...v1.6.0)
- [github.com/psf/black: 22.12.0 → 23.3.0](https://github.com/psf/black/compare/22.12.0...23.3.0)
- [github.com/charliermarsh/ruff-pre-commit: v0.0.237 → v0.0.260](https://github.com/charliermarsh/ruff-pre-commit/compare/v0.0.237...v0.0.260)

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* apply

* fixing

* docs/lines

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
 2023-04-26 21:37:41 +02:00
Jirka Borovec df97141781
add & apply flake8-simplify (#17386) 2023-04-24 21:57:08 +00:00
Irina 0fdd76dab0
feat: customize gradio components with lightning colors (#17054) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Yurij Mikhalevich <yurij@grid.ai>
 2023-04-24 09:36:19 +00:00
thomas chaton 3688b6495d
Resolve Lightning App with remote storage (#17426) 
* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

---------

Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
 2023-04-23 18:08:11 -04:00
Jirka Borovec 111d1ba088
ruff: fixing flake8-comprehensions (#17385) 2023-04-21 09:07:58 +00:00
belerico cf5e63dcfa
Fabric PPO example `share_data` flag (#17397) 2023-04-18 12:56:12 +02:00
Adrian Wälchli 17548d5cfd
Update link to image in Fabric PPO example (#17360) 2023-04-13 13:08:55 +02:00
Ryan Smith fb775e0855
Replace NumPy with Torch in examples/fabric/ (#17279) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-04-06 22:01:50 +02:00
Adrian Wälchli ef7da5c445
Minimal Transformer Example (#17282) 2023-04-06 18:32:23 +00:00
belerico ce286eea76
Decoupled Reinforcement Learning example for Fabric (#17123) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-03-24 14:09:04 +00:00
Jirka Borovec e7ef8db57e
Replace HPU with external implementation (#17067) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-03-24 13:30:53 +01:00
Jirka Borovec 2f087ae30e
docs: update broken links & latest/stable (#16994) 
* docs: update links to PL latest

* also stable

* last

* Apply suggestions from code review

* Apply suggestions from code review

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* fixing

* .

* fabric

* fixing

* .

---------

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-03-15 20:19:41 +01:00
Adrian Wälchli 550fa5fec0
Organize app examples (#17045) 
* move

* init files

* reset change

* missed

* more

* relative path

* e2e tests

* update checkgroup

* reference

* update app_*
 2023-03-14 14:48:17 -04:00
Justus Schock 0154c6cd6f
Minor BYOT Follow-up (#17076) 2023-03-14 07:54:15 -04:00
Adrian Wälchli c93952cb2c
Make BYOT imports forward compatible (#16997) 2023-03-13 21:55:32 -04:00
Adrian Wälchli 98f97081a3
Make examples runnable (#16981) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-03-08 17:16:41 +00:00
Aniket Maurya da572d7cca
Refactor PL examples to `examples/pytorch/` (#16925) 
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
 2023-03-07 11:24:46 -05:00
Nikhil Shenoy 6bb3e992ed
Example of K-fold Cross Validation with `Fabric` (#16909) 
Co-authored-by: Nikhil Shenoy <nikhilshenoy@dhcp-128-189-229-146.ubcsecure.wireless.ubc.ca>
Co-authored-by: Nikhil Shenoy <nikhilshenoy@dhcp-128-189-231-235.ubcsecure.wireless.ubc.ca>
Co-authored-by: Nikhil Shenoy <nikhilshenoy@dhcp-128-189-229-169.ubcsecure.wireless.ubc.ca>
Co-authored-by: Nikhil Shenoy <nikhilshenoy@dhcp-128-189-230-40.ubcsecure.wireless.ubc.ca>
 2023-03-07 08:43:52 +01:00
Justus Schock 24c0cd738c
BYOT example (#16938) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-03-06 10:26:18 +01:00
Jirka Borovec 760612fb8a
update list of fist party packages (#16859) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-03-03 16:55:48 +00:00
Jirka Borovec 2903ec1b45
torchmetrics: bump min version v0.10 in examples (#16936) 2023-03-03 16:14:31 +00:00
Adrian Wälchli d5b758a9f8
Ignore dead links due to fabric docs move (#16920) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2023-03-01 18:19:46 +00:00
Justus Schock 0fee28409b
Introduce new precision layout in PL (#16783) 2023-02-17 17:58:14 +01:00
thomas chaton 104290efa5
[App] Add rm one level below project level (#16740) 
Co-authored-by: Ethan Harris <ethanwharris@gmail.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
 2023-02-14 14:12:51 +00:00
Carlos Mocholí 6c037a479f
"sequential" mode for `CombinedLoader` (#16743) 2023-02-14 06:51:48 +01:00
Adrian Wälchli 99cb2cd056
Remove argparse utils (#16708) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-02-13 20:44:30 +00:00
Adrian Wälchli 393f7a0949
Update pytorch_lightning imports in examples (#16615) 
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
 2023-02-10 10:30:42 +00:00
Adrian Wälchli a40f89d52d
Update examples with multiple optimizers (#16710) 2023-02-10 05:06:14 -05:00
Muhammad Anas d0df0dcb26
Typo in printing app.py (#16643) 2023-02-07 20:26:07 +00:00