Commit Graph

65 Commits

Author SHA1 Message Date
Adrian Wälchli 94f7d2319a
Introduce checkpoint migration (#15237)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-11-02 15:14:04 +00:00
Adrian Wälchli 0f957b5a86
Fix DataLoader re-instantiation when attribute is array (#15409) 2022-10-31 16:09:29 +01:00
Carlos Mocholí 2fd1af0449
Deprecate `AllGatherGrad` (#15364) 2022-10-28 19:51:27 +00:00
otaj 76e462a0be
Do not lose references of trainer in test (#15272)
* Fix reference error

* Skip flaky hanging test

* .

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-10-25 09:23:15 -04:00
Atharva Phatak 4322f53874
Update mypy version (#15161)
* update mypy version
* type-ignore-comments
* more mypy-fix
* import-fix
* Update Lite too
* simpler implementation for flatten dict
* Fix rich progress
* Simplify rich test
* True None

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-10-22 23:26:43 +02:00
Carlos Mocholí 62ca073a41
Introduce base collective and main subclasses (#15016)
Co-authored-by: otaj <ota@lightning.ai>
2022-10-07 19:53:19 +00:00
otaj 7e518cacd2
Use `torch.testing.assert_close` everywhere (#15031)
remove unnecessary version check
2022-10-07 16:59:04 +02:00
Carlos Mocholí be7bfdba27
Remove unused gcsfs dependency (#14962) 2022-10-01 16:08:36 +00:00
Ziyad Sheebaelhamd db26e087e7
Close profiler when `StopIteration` is raised (#14945) 2022-09-30 19:29:12 +00:00
Carlos Mocholí 6256a318d7
Refactor launching tests to use our launchers (#14954) 2022-09-30 09:57:18 +02:00
Adrian Wälchli d8e90f6581
Fairscale import updates (#14721)
* fairscale imports
* refactor to avoid meta package build issue

Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: thomas chaton <thomas@grid.ai>
2022-09-29 16:45:27 +00:00
otaj 5ee2b86c44
Tests for fixed TypeError (#14821)
* tests for 14809
* Apply suggestions from code review

Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-09-22 09:04:27 +02:00
Carlos Mocholí e9c571d39f
Move accelerator-specific parsing functions with their accelerators (#14753)
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2022-09-18 22:48:45 +00:00
Carlos Mocholí e859546b96
Integrate lightning_utilities `is_overridden` (#14620) 2022-09-12 15:16:57 +02:00
Adrian Wälchli d2459df2ff
Standalone Lite: Remaining Utilities (#14492)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Laverne Henderson <laverne.henderson@coupa.com>
Co-authored-by: Felonious-Spellfire <felonious.spellfire@gmail.com>
2022-09-07 15:25:23 +00:00
Carlos Mocholí 8c4184c105
Integrate with `lightning_utilities.core.enums` (#14558) 2022-09-07 15:14:14 +02:00
Carlos Mocholí 5216c51096
Integrate `lightning_utilities.core.rank_zero` (#14556) 2022-09-07 09:21:48 +00:00
Carlos Mocholí 44216fdd69
Integrate `lightning_utilities.core.imports` (#14475)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-09-06 12:56:20 +00:00
Carlos Mocholí 8a4a3b6766
Mark the lite `DeviceDtypeModuleMixin` as protected (#14548) 2022-09-06 14:17:15 +02:00
awaelchli 9fea2ed9d5 move pl/utilities/apply_func.py to pl/utilities/apply_func.py (#14516) 2022-09-05 20:30:42 +02:00
awaelchli def6548596 move pl/utilities/cloud_io.py to lite/utilities/cloud_io.py (#14515) 2022-09-05 18:30:31 +02:00
awaelchli 75d5a2d046 move pl/utilities/xla_device.py to lite/utilities/xla_device.py (#14514) 2022-09-05 17:36:02 +02:00
awaelchli cefe2fa123 Move test_dtype_device_mixin to lite (#14511) 2022-09-05 16:31:00 +02:00
Carlos Mocholí e0c2c3e677
Clean up fairscale imports (#14476) 2022-09-01 18:08:40 +02:00
Anner 626827c872
update rng state save/load test to also run on cuda gpu (#14396)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-08-31 16:36:35 +00:00
Carlos Mocholí 291267c3bf
Unify rank zero messaging utilities (#14116) 2022-08-30 09:51:30 +00:00
Carlos Mocholí f202e84f4b
Remove the legacy `get_deprecated_arg_names` (#14415) 2022-08-29 14:53:57 +02:00
Carlos Mocholí 3ba0f56b18
Remove support for the deprecated torchtext legacy (#14375) 2022-08-26 20:01:51 +00:00
Tianshu Wang 8950613552
save checkpoints and profiler output to the first logger (#14325)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-08-26 17:23:54 +00:00
Justin Goheen ed84d04bcf
Fix mypy errors attributed to `pytorch_lightning.core.datamodule` (#13693)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
Co-authored-by: otaj <ota@lightning.ai>
2022-08-26 16:26:26 +00:00
Justus Schock a01e016fff
Remove mps config for test (#14379)
* Remove mps config for test

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-08-26 02:47:37 -04:00
Anner 33a5ed9879
Add torch.cuda rng state to seed save/load (#14384)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-08-26 05:26:00 +00:00
Tanmoy 807435885e
Fix `LightningDataModule` hparams parsing (#12806)
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-08-25 18:57:48 +00:00
Jirka Borovec 99ba95a38e
fix imports of collections.abc for py3.10 (#14345)
fix collections.abc for py3.10

Co-authored-by: Sherin Thomas <sherin@grid.ai>
2022-08-23 11:52:58 -04:00
otaj 44cdbcab04
Allowed setting attributes on `DataLoader` and `BatchSampler` when instantiated inside `*_dataloader` hooks (#14212) 2022-08-17 11:42:54 -04:00
Adrian Wälchli 807f9d8c96
Replace unwrapping logic in strategies (#13738)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-08-12 08:24:04 +00:00
Adrian Wälchli 4008f9cd41
Convert subprocess test to standalone test (#14101) 2022-08-10 17:15:12 -04:00
otaj f132d44821
Fix a bug that caused spurious `AttributeError` when multiple `DataLoader` classes are imported (#14117) 2022-08-10 16:09:50 +00:00
Carlos Mocholí 9b61b1c482
Remove duplicated test classes (#14122)
Remove duplicated classes
2022-08-10 17:21:05 +02:00
Adrian Wälchli dc8ff5ed26
Fix device placement when `.cuda()` called without specifying index (#14128) 2022-08-10 05:23:20 -04:00
Anton Shevtsov c55fe7105b
Prefix seed_everything log messages with rank info (#14031)
Co-authored-by: Anton Shevtsov <aeshevtsov@avito.ru>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-08-09 15:40:30 +02:00
Carlos Mocholí d072e4451a
Fix dtype inference during gradient norm computation (#14051) 2022-08-08 11:35:06 +00:00
Carlos Mocholí 91dd6a68fb
Remove meta device utilities in favor of torchdistx (#13868) 2022-08-05 12:20:27 +00:00
Adrian Wälchli 25203d4c81
Organize model summary utilities (#13893) 2022-07-28 19:23:29 +02:00
Carlos Mocholí 1299e4f984
Run GPU tests with PyTorch 1.12 (#13716)
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-07-28 19:37:57 +05:30
otaj 95f5f170f5
Allowed custom `BatchSampler`s when instantiated in `*_dataloader` hook (#13640)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-07-27 15:32:50 +00:00
otaj 4c7b9f0b11
Disallow batch sampler with multiple IPU devices (#13854)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-07-27 15:20:43 +05:30
Carlos Mocholí 4f53e7132f
Promote the CLI out of utilities (#13767) 2022-07-23 12:07:29 +00:00
Carlos Mocholí 9f51c07604
Support setting the trainer reference recursively for ensembles (#13638)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2022-07-22 19:58:46 +02:00
Adrian Wälchli 596aa8400d
Lazy import check for wandb dependency (#13474) 2022-07-22 19:57:46 +02:00