Commit Graph

432 Commits

Author SHA1 Message Date
thomas chaton 5f4ffdee41
cleanup (#10081) 2021-10-29 08:40:43 +00:00
Low Weng Fei 83d74bb385
Fix `reset_seed()` converting the `PL_SEED_WORKERS` environment variable `str` read to `bool` (#10099)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: tchaton <thomas@grid.ai>
2021-10-28 12:57:41 +00:00
Carlos Mocholí dbe1662dc3
Replace `_TORCH_GREATER_EQUAL_DEV_1_10` with `_TORCH_GREATER_EQUAL_1_10` (#10157) 2021-10-27 13:38:39 +01:00
Carlos Mocholí f95ba20012
Do not use the base version by default in `_compare_version` (#10051) 2021-10-25 16:41:32 +05:30
Kaushik B c3614f1c07
Fix: skip importing DistributedOptimizer for Windows (#10071) 2021-10-21 21:01:56 +00:00
thomas chaton 454e93bace
Add support for init_meta_context, materialize_module (#9920) 2021-10-21 15:48:31 +01:00
Carlos Mocholí 6aeebf1bd3
Remove unnecessary dependency available checks (#10050) 2021-10-20 16:21:37 +00:00
Alessio Bonfiglio 2a2fa5a56a
Group all the logged gradients under the same sub-folder (#7756) 2021-10-20 15:48:36 +00:00
Adrian Wälchli 2c16f1d6b9
remove dataloader patching on the LightningModule (#9764)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-10-20 15:23:20 +02:00
Carlos Mocholí ad8d6c83da
[CLI] Shorthand notation to instantiate datamodules (#10011)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-10-20 00:49:48 +00:00
Danielle Pintz f4083d58d9
Fix `_compare_version` and add `_TORCH_GREATER_EQUAL_DEV_1_10` (#9960) 2021-10-19 14:42:46 +00:00
Adrian Wälchli a99b7440b5
Add unit tests for `pl.utilities.grads` (#9765)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-10-18 18:58:51 +05:30
ronif 7b4df7bf91
Fix issue with no-init dataclass fields in move_to_device (#9963)
Co-authored-by: ronif <ronif@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-10-17 07:10:47 +00:00
Carlos Mocholí db4e770004
Validate the precision input earlier (#9763) 2021-10-15 17:30:00 +00:00
Danielle Pintz 16213b1635
Deprecate `log_gpu_memory`, `gpu_metrics`, and util funcs in favor of `DeviceStatsMonitor` callback (#9921)
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-10-14 22:45:44 +02:00
Chris Chow f14a47a0b2
guard against None in pytorch get_xla_supported_devices (#9572)
Co-authored-by: Chris Chow <cchow@nianticlabs.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-10-12 12:01:32 +00:00
Danielle Pintz 0561fd6925
Fix test_quantization with Pytorch 1.10 (#9808) 2021-10-07 08:54:06 +01:00
Kaushik B f94faa9cd3
Enable auto parameters tying for TPUs (#9525)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-10-06 10:16:44 +02:00
Elad Segal 86ad941d06
Fix missing arguments when saving hyperparams from parent class only (#9800)
* Fix missing arguments when saving hyperparams from parent class only

* fix antipattern
2021-10-06 08:32:29 +01:00
Danielle Pintz 9e2347f8ff
Fix broken `test_is_picklable` with PT1.10 (#9810) 2021-10-05 14:22:21 +02:00
thomas chaton 5841ca9782
[Feat] Add auto_restart for fault tolerant training (#9722) 2021-10-01 16:37:17 +00:00
Carlos Mocholí fb81e738fa
Refactor `grad_norm` function (#9742) 2021-09-30 02:54:08 +00:00
Sean Naren 8c9cb0c133
[3/n] add additional rich version check (#9757) 2021-09-29 17:24:51 +00:00
Sean Naren 0df3543137
[2/n] Fix rich model summary for tuples (#9756) 2021-09-29 17:13:27 +00:00
Carlos Mocholí 0ddd6a8c19
Remove `_NATIVE_AMP_AVAILABLE` checks (#9747) 2021-09-29 15:34:26 +02:00
thomas chaton 131176b9f5
[bugfix] Prevent on_before_batch_transfer to be called twice (#9715)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-09-27 19:36:56 +00:00
Adrian Wälchli f74eb58493
remove `InternalDebugger` (#9680)
* wip

* reset _notebooks

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* reset _notebooks

* testing with mock

* update test with mock

* update test

* update tests

* update test

* remove track_load_dataloader_calls

* update last test

* remove unused imports

* remove InternalDebugger

* update changelog

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-09-27 09:33:45 -04:00
Rohit Gupta a4bc0acb02
Update warnings in `TrainingTricksConnector` (#9595)
* update warnings

* add tests

* comments

* Apply suggestions from code review

* Apply suggestions from code review
2021-09-25 16:02:26 +00:00
thomas chaton 9148a13de0
Enable DataLoader state restoration for the evaluation loop (#9563)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-09-24 16:21:00 +00:00
Adrian Wälchli d67aff7494
remove `InternalDebugger.track_load_dataloader_call` (#9675)
* wip

* reset _notebooks

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* reset _notebooks

* testing with mock

* update test with mock

* update test

* update tests

* update test

* remove track_load_dataloader_calls

* update last test

* remove unused imports

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-09-24 15:37:36 +02:00
Daniel Stancl 568a1e0a68
Disallow invalid seed string values (#8787)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-09-23 15:09:48 +00:00
Carlos Mocholí fd4f2f6655
Remove `InternalDebugger.track_event` (#9654) 2021-09-23 12:21:49 +00:00
Adrian Wälchli 87b11fbd9d
add legacy load utility (#9166)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-09-23 09:52:48 +00:00
Carlos Mocholí bffc5347d2
Remove `InternalDebugger.track_lr_schedulers_update` (#9653) 2021-09-23 08:11:03 +01:00
Mauricio Villegas eb6aa7a062
[CLI] Add option to enable/disable config save to preserve multiple files structure 2021-09-23 08:52:49 +02:00
Adrian Wälchli b98ce0a799
revert #9125 / fix back-compatibility with saving hparams as a whole container (#9642) 2021-09-22 19:13:13 +01:00
Carlos Mocholí 3f7872d93a
[CLI] Shorthand notation to instantiate models (#9588) 2021-09-22 14:19:02 +00:00
Carlos Mocholí 61b4e33d94
[CLI] Avoid warning when `configure_optimizers` will not be overridden (#9583) 2021-09-21 14:25:07 +01:00
Carlos Mocholí cd8cb6076a
[CLI] Fix registry decorator return value (#9587) 2021-09-21 14:24:29 +01:00
thomas chaton 1bb5fccb71
[CLI] Shorthand notation to instantiate callbacks [3/3] (#8815)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-09-17 17:54:06 +00:00
Carlos Mocholí bbcb977851
[CLI] Shorthand notation to instantiate optimizers and lr schedulers [2/3] (#9565) 2021-09-17 18:00:46 +01:00
Aki Nitta 11c93d903d
Fix `add_argparse_args` raising `TypeError` with Python 3.6 (#9554)
* Add test
* Accept TypeError for arg_type.__args__ being None

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-09-17 11:24:00 +02:00
Carlos Mocholí d2ca81b900
Minor CLI improvements [1/3] (#9553) 2021-09-16 15:04:51 +02:00
jjenniferdai 637f59f1d2
Type `trainer.connectors.checkpoint_connector` (#9419)
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2021-09-15 03:02:19 +02:00
Adrian Wälchli 847a3fdc07
move state extraction for CaptureMapDataset (#9484) 2021-09-14 17:04:19 +01:00
Adrian Wälchli 0cb550890c
fix mypy typing for model summary (#9447) 2021-09-13 11:41:27 +02:00
Jakub Kuszneruk ee3787216a
Adapt `NeptuneLogger` to new `neptune-client` api (#6867)
* Initial split to NeptuneLegacyLogger and NeptuneLogger

* Adapt NeptuneLogger to neptune-pytorch-lightning repo version

* Fix stylecheck and tests

* Fix style and PR suggestions

* Expect Run object in NeptuneLogger.init

* Model checkpoint support and restructured tests

* Reformat code - use " instead of '

* Fix logging INTEGRATION_VERSION_KEY

* Update CHANGELOG.md

* Fix stylecheck

* Remove NeptuneLegacyLogger

* updated neptune-related docstrings

* PR suggestions

* update CODEOWERS file
* move import logic to imports.py
* minor neptune.py improvements

* formatting fixes and minor updates

* Fix generation of docs

* formatting fixes and minor updates

* fix

* PR fixes vol. 2

* define return type of _dict_paths method
* bump required version of `neptune-client`

* Enable log_* functions

* Update pytorch_lightning/loggers/neptune.py

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* Revert "Enable log_* functions"

This reverts commit 050a436899b7f3582c0455dc27b171335b85a3a5.

* Make global helper lists internal

* Logger's `name` and `version` methods return proper results

* Initialize Run and its name and id at logger init level

* Make _init_run_instance static

* Add pre-commit hook code changes.

* Fix blacken-docs check

* Fix neptune doctests and test_all

* added docs comment about neptune-specific syntax

* added docs comment about neptune-specific syntax in the loggers.rst

* fix

* Add pickling test

* added myself to neptune codeowners

* Enable some of deprecated log_* functions

* Restore _run_instance for unpickled logger

* Add `step` parameter to log_* functions

* Fix stylecheck

* Fix checkstyle

* Fix checkstyle

* Update pytorch_lightning/loggers/neptune.py

Co-authored-by: thomas chaton <thomas@grid.ai>

* Fix tests

* Fix stylecheck

* fixed project name

* Fix windows tests

* Fix stylechecks

* Fix neptune docs tests

* docformatter fixes

* De-duplicate legacy_kwargs_msg

* Update .github/CODEOWNERS

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

Co-authored-by: kamil-kaczmarek <kamil.kaczmarek@neptune.ml>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-09-10 18:48:58 +02:00
Kaushik B d773407e59
feat: Add ModelSummary Callback (#9344)
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-09-10 12:42:42 +00:00
Adrian Wälchli 089ae9b3e8
convert state to tuple explicitly when setting python random state (#9401)
* convert state to tuple explicitly

* update changelog
2021-09-09 19:27:28 +01:00
Artsiom 41ba639859
Fix logging of nan parameters (#9364)
* Fix logging of nan parameters
2021-09-09 00:39:23 +00:00