Rooba
/
lightning
mirror of https://github.com/Lightning-AI/lightning.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
7,578 Commits 60 Branches 217 Tags 359 MiB
Commit Graph

7578 Commits

Author SHA1 Message Date
Rick Izzo 12d4b2a5f5
Fix(ci) ONC-114: reduce the ci load by only installing lmdb in tests (#14581) 
reduce the ci load by only installing lmdb in tests
 2022-09-07 11:55:03 -04:00
Adrian Wälchli d2459df2ff
Standalone Lite: Remaining Utilities (#14492) 
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Laverne Henderson <laverne.henderson@coupa.com>
Co-authored-by: Felonious-Spellfire <felonious.spellfire@gmail.com>
 2022-09-07 15:25:23 +00:00
pierocor 31dc6c6714
Add compatibility when `torch.distributed` is not available (#14454) 
Co-authored-by: Piero Coronica <piero.coronica@mpcdf.mpg.de>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2022-09-07 14:25:20 +00:00
Carlos Mocholí bcad90141a
Remove old test artifacts (#14574) 2022-09-07 10:09:59 -04:00
Carlos Mocholí 46519e2fc7
Add path filters to the TPU job (#14543) 2022-09-07 15:55:45 +02:00
Carlos Mocholí bda70a2f2f
Integrate lightning_utilities `get_all_subclasses` (#14575) 2022-09-07 15:34:46 +02:00
Carlos Mocholí 8c4184c105
Integrate with `lightning_utilities.core.enums` (#14558) 2022-09-07 15:14:14 +02:00
Kushashwa Ravi Shrimali 6de2b0b528
Docs [Fix]: use bytes instead of strings while writing (#14505) 
* Fix doc examples: use bytes instead of strings while writing

* Add a note (comment)

* nit

* Update any_server.rst

* Update docs/source-app/workflows/add_server/any_server.rst

* Update docs/source-app/workflows/add_server/any_server.rst

* Update docs/source-app/workflows/add_server/any_server.rst

* Apply suggestions from code review

Co-authored-by: Laverne Henderson <laverne.henderson@coupa.com>
Co-authored-by: Ethan Harris <ethanwharris@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
 2022-09-07 09:05:58 -04:00
dependabot[bot] dbd7703e88
Update fsspec[http] requirement from !=2021.06.0,<2022.6.0,>=2021.05.0 to >=2021.05.0,!=2021.06.0,<2022.8.0 in /requirements (#14288) 
Update fsspec[http] requirement in /requirements

Updates the requirements on [fsspec[http]](https://github.com/fsspec/filesystem_spec) to permit the latest version.
- [Release notes](https://github.com/fsspec/filesystem_spec/releases)
- [Commits](https://github.com/fsspec/filesystem_spec/compare/2021.05.0...2022.7.1)

---
updated-dependencies:
- dependency-name: fsspec[http]
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-09-07 09:25:24 +00:00
Carlos Mocholí 5216c51096
Integrate `lightning_utilities.core.rank_zero` (#14556) 2022-09-07 09:21:48 +00:00
Dan Nissenbaum 7ada52e33c
Typo in major heading seen by newcomers (#14501) 
* Typo in major heading seen by newcomers

Correct typo in one of the first major headings newcomers to Lightning see when they are considering migrating their code to use Lightning.

I know this is a trivial change in terms of the text change itself, but I really think it's valuable for one of the most important landing pages that users first investigating Lightning see - to have rock-solid, professional text without obvious typos. Here was a typo in the main heading itself. I suggest fixing it straightaway via this PR.

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2022-09-07 09:06:30 +00:00
Carlos Mocholí 8095e2452d
Cleanup Lite `apply_func`s utilitites (#14560) 2022-09-06 22:35:33 +00:00
Carlos Mocholí 273a9ed8c1
Integrate `lightning_utilities.core.apply_func` (#14537) 2022-09-06 13:52:54 +00:00
Carlos Mocholí 44216fdd69
Integrate `lightning_utilities.core.imports` (#14475) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2022-09-06 12:56:20 +00:00
Carlos Mocholí 8a4a3b6766
Mark the lite `DeviceDtypeModuleMixin` as protected (#14548) 2022-09-06 14:17:15 +02:00
Rohit Gupta 8c6119fbce
Add auto wrapping support for `DDPFullyShardedStrategy` (#14383) 2022-09-05 19:07:26 +00:00
awaelchli 7f148b2c47 Deprecate pl/utilities/apply_func (#14516) 2022-09-05 20:30:42 +02:00
awaelchli 9fea2ed9d5 move pl/utilities/apply_func.py to pl/utilities/apply_func.py (#14516) 2022-09-05 20:30:42 +02:00
Jirka Borovec ea3d62d475
Setup: add requirement freeze for next major version (#14480) 2022-09-05 18:23:53 +00:00
donlapark 381600dcc3
fixes typing errors in auto_restart.py (#13904) 
Co-authored-by: otaj <6065855+otaj@users.noreply.github.com>
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2022-09-05 23:39:20 +05:30
dependabot[bot] e5395de9d3
Bump actions/checkout from 2 to 3 (#14540) 
Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 3.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v2...v3)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-09-05 19:13:08 +02:00
dependabot[bot] dafa3e8d2e
Bump tj-actions/changed-files from 29.0.1 to 29.0.3 (#14541) 
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 29.0.1 to 29.0.3.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v29.0.1...v29.0.3)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-09-05 17:11:54 +00:00
Carlos Mocholí 875db19971
Add path filters for azure PR jobs (#14544) 2022-09-05 19:11:12 +02:00
awaelchli cfea2be137 Deprecate pl/utilities/cloud_io.py (#14515) 2022-09-05 18:30:31 +02:00
awaelchli def6548596 move pl/utilities/cloud_io.py to lite/utilities/cloud_io.py (#14515) 2022-09-05 18:30:31 +02:00
awaelchli 165427a506 Deprecate pl/utilities/xla_device (#14514) 2022-09-05 17:36:02 +02:00
awaelchli 75d5a2d046 move pl/utilities/xla_device.py to lite/utilities/xla_device.py (#14514) 2022-09-05 17:36:02 +02:00
awaelchli c2879c20da Deprecate pl/core/mixins/device_dtype_mixin and update imports (#14511) 2022-09-05 16:31:00 +02:00
awaelchli cefe2fa123 Move test_dtype_device_mixin to lite (#14511) 2022-09-05 16:31:00 +02:00
awaelchli 3cf57ff11c Move pl/core/mixins/device_dtype_mixin.py to lite/utilities/device_dtype_mixin.py (#14511) 2022-09-05 16:31:00 +02:00
Rohit Gupta ce702fd40e
Squeeze tensor while logging (#14489) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2022-09-05 14:01:51 +00:00
Jirka Borovec 6773df9387
pkg: include lite in PL (#14536) 
* pkg: include lite in PL
* Apply suggestions from code review
* ci: nb dirs

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2022-09-05 13:18:38 +00:00
Carlos Mocholí f3d4d83462
Add path filters for some non-required jobs (#14539) 2022-09-05 12:16:26 +00:00
Tianshu Wang 23f0e20209
Fixed `WandbLogger` `save_dir` is not set after creation (#12748) (#14326) 
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2022-09-05 10:12:43 +00:00
Roberto de Moura Estevão Filho ed0164a3d2
Estimate stepping batches with max_steps if max_epochs is not set (#14317) 
Co-authored-by: Roberto Estevão <robertode@microsoft.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2022-09-05 09:05:21 +00:00
Carlos Mocholí 4235eff712
Use a standalone test symlink for Lite (#14502) 2022-09-04 20:57:28 +02:00
Dmitry Frolov 693116f3b5
[CLI] Fix status message on cluster creation (#14477) 
* Fix message on BYOC cluster creation

Co-authored-by: thomas chaton <thomas@grid.ai>
 2022-09-04 14:03:38 -04:00
Carlos Mocholí ce0bde702a
Remove deprecated `test_tube` dependency (#14513) 2022-09-04 11:29:56 +00:00
Carlos Mocholí fed1d8dc6a
Pin protobuf (#14512) 2022-09-03 14:38:30 +00:00
Laverne Henderson b19b15546b
Updated basic debugging (#14488) 
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2022-09-02 14:23:29 +05:30
Adrian Wälchli 291dc1b615
Standalone Lite CI setup (#14451) 
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2022-09-01 22:13:12 +00:00
Carlos Mocholí e0c2c3e677
Clean up fairscale imports (#14476) 2022-09-01 18:08:40 +02:00
Benjamin Krala cce55b6cd3
Precise description of reload_dataloaders_every_n_epochs (#14245) 2022-09-01 10:06:28 -04:00
Adrian Wälchli 28e18881a9
Mark stage argument in hooks as required (#14064) 
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
 2022-09-01 15:47:40 +02:00
Adam Bobowski 764b348249
[App] Handling s3 rate limiting in framework (#14411) 
bump of fsspec and s3fs to version supporting retry on "SlowDown" response
 2022-09-01 11:12:04 +00:00
Rohit Gupta 4a81b9b99e
Update changelog after v1.7.4 release (#14479) 2022-09-01 11:08:50 +00:00
Mansy 1bcb5c301d
[App][CLI] Fix lightning cli --version (#14433) 
* [App][CLI] Fix lightning cli --version
 2022-09-01 07:58:09 +00:00
Sherin Thomas c1a7254b7a
Dependency pinning (#14463) 
* deps pinned
* Apply suggestions from code review

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2022-08-31 21:24:28 +00:00
Rohit Gupta e90ac769d6
Reset dataloaders on failure in tuner (#14372) 2022-08-31 21:00:18 +00:00
thomas chaton a7c01c4754
Introduce lightning connect (#14452) 
* update

* update

* update

* update

* Review of content

* Formatting updates

* Fomatting updates

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Updates based on new commits

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* update

* update

* update

* Introduce lightning connect (#14183)


Co-authored-by: Luca Antiga <luca.antiga@gmail.com>

Co-authored-by: Felonious-Spellfire <felonious.spellfire@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
 2022-08-31 15:59:03 -04:00