Commit Graph

231 Commits

Author SHA1 Message Date
donlapark 233b36b185
Fix mypy errors in strategies/ddp_spawn.py (#13865)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-07-28 18:49:24 +00:00
donlapark 25de48802f
Fixes various typing errors in `pytorch_lightning/strategies/deepspeed.py` (#13832)
Co-authored-by: otaj <ota@lightning.ai>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-07-27 11:19:29 +00:00
Adrian Wälchli acd8aa20d4
Skip code formatters on _notebooks submodule (#13867) 2022-07-27 05:02:58 -04:00
Cyprien Ricque 6a9d626e18
fix mypy typing errors in pytorch_lightning/strategies/strategy.py (#13519)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: otaj <ota@lightning.ai>
2022-07-26 08:42:58 -04:00
donlapark e77accfdb1
fixes typing in pytorch_lightning/callbacks/stochastic_weight_avg.py (#13685)
Co-authored-by: otaj <6065855+otaj@users.noreply.github.com>
2022-07-26 16:16:17 +05:30
Krishna Kalyan 85b0356ea2
Fix mypy errors attributed to `pytorch_lightning.core.mixins.device_dtype_mixin` (#13704)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-07-26 09:38:06 +02:00
Justin Goheen 4e9fbdbe40
Fix mypy errors attributed to `pytorch_lightning.loggers.comet` (#13689)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: otaj <ota@lightning.ai>
2022-07-25 10:28:19 +00:00
ChoMinSung 0b842b9ac1
Fix mypy errors attributed to `pytorch_lightning/profilers/advanced.py` (#13792)
Co-authored-by: otaj <6065855+otaj@users.noreply.github.com>
2022-07-22 13:33:27 +00:00
Gautier Dagan 0e5312833f
fix mypy errors for loggers/wandb.py (#13483)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-07-21 01:07:24 +00:00
Justin Goheen e3b29cbfe1
Fix mypy errors attributed to `pytorch_lightning.loggers.mlflow` (#13691)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: otaj <6065855+otaj@users.noreply.github.com>
2022-07-21 00:03:36 +00:00
Justin Goheen 347462672a
Fix mypy errors attributed to `pytorch_lightning.loggers.tensorboard.py` (#13688)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-07-21 00:01:10 +00:00
Lee Jungwon b40766c333
Fix mypy typing errors in pytorch_lightning/callbacks/model_checkpoint.py (#13617)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-07-20 17:07:38 +00:00
Krishna Kalyan 2845e7565d
Fix mypy errors attributed to `pytorch_lightning.utilities.distributed` (#13678)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-07-16 14:08:03 -04:00
himkt e4c7c5f4bc
Fix mypy errors attributed to pytorch_lightning/loops/epoch/training_epoch_loop.py (#13555)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-07-15 12:03:08 +00:00
donlapark 8f56f8e0cd
Change the return type of `tune()` in `trainer.py` to TypedDict (#13631)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-07-14 10:08:10 -04:00
Cyprien Ricque 35841613c7
fix mypy typing errors in pytorch_lightning/strategies/parallel.py (#13556)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-07-14 10:20:34 +00:00
Cyprien Ricque e179a58397
fix mypy typing errors in pytorch_lightning/strategies/horovod.py (#13570) 2022-07-14 11:30:37 +02:00
Akihiro Nitta c1cc112b52
Remove deprecated `LightningDistributed` (#13549)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-07-13 21:15:28 +00:00
Cyprien Ricque 732a54155c
fix mypy typing errors in pytorch_lightning/strategies/dp.py (#13564)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: otaj <ota@lightning.ai>
2022-07-13 14:00:12 +00:00
Justin Goheen 57f5e18587
Fix mypy errors attributed to `pytorch_lightning.loggers.base.py` (#13494)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-07-12 13:45:21 +02:00
Justin Goheen 0a6dc5239a
Fix mypy errors attributed to `pytorch_lightning.loggers.csv_logs.py` (#13538)
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-07-12 11:11:31 +00:00
Akihiro Nitta 6798549e4c
CI: Update mypy workflow (#13574)
* Fix pyproject.toml

* Add TODO

* Update mypy workflow
2022-07-11 17:46:52 -04:00
Justin Goheen 933848dc05
Fix mypy errors attributed to `pytorch_lightning.loggers.logger.py` (#13541)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-07-11 20:41:49 +09:00
donlapark b59f802248
fix mypy typing errors in pytorch_lightning/tuner/lr_finder.py (#13513)
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2022-07-08 15:28:47 +00:00
Cyprien Ricque 61473c2290
fix mypy typing errors in pytorch_lightning/strategies/single_tpu.py (#13534)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2022-07-05 07:27:27 +00:00
Masahiro Wada 03cbca430d
Fix type hints of callbacks/finetuning.py (#13516) 2022-07-04 18:04:35 +01:00
Cyprien Ricque 12b0ec6fa5
fix mypy typing errors in pytorch_lightning/strategies/ddp2.py (#13535)
* fix typing in strategies/ddp2.py
* Use quotes instead of __future__.annotations for forward references

Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2022-07-04 18:30:44 +02:00
Cyprien Ricque f116c2f72c
fix mypy typing errors in pytorch_lightning/strategies/single_device.py (#13532)
* fix typing in strategies/single_device.py
* Make assert statement more explicit

Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2022-07-04 18:28:41 +02:00
Cyprien Ricque f65aa74719
fix mypy typing errors in pytorch_lightning.__setup__.py (#13472)
Fix typing in _load_py_module function
2022-07-01 08:36:33 -04:00
Gautier Dagan c29deec889
fix mypy typing errors in lightning/trainer/optimizers.py (#13470)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-06-30 23:35:48 +05:30
Jirka Borovec d2e4e7e003
create meta package [RFC] (#13327)
* placeholder

* move setup_tools & abstract about

* adjust lightning-app

* notes

* lightning about

* lightning init

* CI check

* ci

* install

* adjust manifest & mv chlog

* manifest

* pkg

* mv __setup__

* parse_requirements

* lit

* ci - pytorch

* wrap func

* ci

* cd draft

* generate lit

* pkg

* utf-8

* root pkg

* req.

* ver

* mypy

* try check

* meta pkg

* meta pkg - vars

* meta pkg - pruning

* meta pkg - fixing

* fix PL for meta

* multi-line wrapper

* hack manifest

* ci

* fix docstr

* fixing

* ci & mypy

* links
2022-06-27 09:34:18 -04:00
awaelchli 511f1a6515 Reroute profiler to profilers (#12308)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-06-22 20:55:39 -04:00
Jirka Borovec ab59f308b1
Future 4/n: test & legacy in test/ folder (#13295)
* move: legacy >> test/

* move: tests >> test/

* rename unittests

* update CI

* tests4pl

* tests_pytorch

* proxi

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* ci

* link

* cli

* standalone

* fixing

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* .

* Apply suggestions from code review

Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* alone

* test -> tests

* Standalone fixes

* ci

* Update

* More fixes

* Fix coverage

* Fix mypy

* mypy

* Empty-Commit

* Fix

* mypy just for pl

* Fix standalone

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-06-15 18:10:49 -04:00
Jirka Borovec 9cc714cdd1
Future 2/n: stand-alone examples (#13294)
* move: pl_examples >> src/

* convert pl_examples package to plain examples

* update CI for examples

* ci

* missing

* install
2022-06-15 08:53:51 -04:00
rohitgr7 a68fe66705 Update core/lightning.py to core/module.py (#12740) 2022-05-18 08:03:55 +05:30
stanbiryukov 8034919c44
Remove deprecated `TestTubeLogger` (#12859)
* remove deprecated test_tube logger

* remove testube from logger __init__

* remove relevant testtube tests

* update CHANGELOG with removal of deprecated `TestTubeLogger`
2022-04-24 20:05:48 +02:00
William Falcon 908e05880d
docs refactor 3/n (#12795)
* updated titles + css

* updated titles + css

* levels structure

* levels structure

* levels structure

* adding level indexes

* finished intro guide layout

* finished intro guide layout

* general titles

* general titles

* added movie

* added movie

* finished 15 mins

* levels

* added core levels

* added core levels

* fixed api reference on the left

* gpu guides

* gpu guides

* gpu guides

* gpu guides

* precision

* hpu guide

* added ipu

* added ipu

* added ipu

* added ckpt docs

* finished basic logging

* intermediate

* intermediate

* intermediate

* fixed

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* added logger stuff

* added logger stuff

* added logger stuff

* added logger stuff

* added logger stuff

* ic

* added inconsolata

* added inconsolata

* added inconsolata

* added inconsolata

* added inconsolata

* added inconsolata

* added inconsolata

* updated menu

* added basic cloud docs

* added basic cloud docs

* added basic cloud docs

* added basic cloud docs

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* added demos folder

* added demos folder

* added demos folder

* added demos folder

* added demos folder

* added demos folder

* twocolumns directive

* twocols

* twocols

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* updated titles + css

* levels structure

* adding level indexes

* finished intro guide layout

* general titles

* added movie

* finished 15 mins

* levels

* added core levels

* fixed api reference on the left

* gpu guides

* precision

* hpu guide

* added ipu

* added ckpt docs

* finished basic logging

* intermediate

* fixed margins

* added logger stuff

* ic

* added inconsolata

* updated menu

* added basic cloud docs

* ic

* added demos folder

* twocolumns directive

* registry

* cleaning up

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* deconflict

* deconflict

* deconflict

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add testsetup sections wherever needed; fix errors in building docs

* pre-commit fixes

* Fix duplicate label

* minor nit with pre-commit

* Fix labels

* More changes...

* require

* debug & cli

* prec & model & visu

* fix references

* fix references

* fix refs

* fix refs - model_parallel

* fix references

* prune testsetup with global

* refs in index

* Fix duplicate label errors

* Update orphan docs

* Update orphan docs

* Update orphan docs

* fix links

* Fix genindex and search index

* fix refs

* fix refs

* Fix index rst related issues

* fix refs

* inc to rst

* Fix links ref

* fix more references

* fix refs

* deconflict

* errors

* errors

* errors

* fix refs

* fix refs

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix warnings

* Fix LightningCLI errors

* Fix LightningCLI errors

* Fix LightningCLI errors

* Fix LightningCLI errors

* fix doc build

* Duplicate Label fix (docs) (#12800)

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

* ignore typing in demo folder

* Ignore demos for mypy

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kushashwa Ravi Shrimali <kushashwaravishrimali@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: otaj <ota@grid.ai>
2022-04-19 14:15:47 -04:00
MohammedAlkhrashi f3e7e91f64
Rename loggers/base.py to loggers/logger.py and changed LightningLoggerBase to Logger (#12014)
* Deprecate: initial LightningLoggerBase to Logger, tests/loggers pass

* Refactor moved LightningLoggerBase to logger.py and removed base.py in loggers

* Recreated base.py for safer backwards compatibility

* Renamed test_base.py to test_logger.py and added test_base.py to test deprecation warning.

* Renamed tests/loggers/test_base.py to tests/loggers/test_logger.py

* Order __all__ list in loggers/__init__ alphabetically

* minor: change deprecation warning of loggers.logger.base

* fixed failing tests and formating

* Update the documentation

* move deprecation test to deprecated_api files

* backward compatibility and deprecations tests for all functionality in loggers/logger.py

* fix PEP8 issues.

* Update CHANGELOG.md

* Skip mypy on renamed file

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: carmocca <carlossmocholi@gmail.com>
2022-04-08 19:41:46 +00:00
four4fish 6e14209185
Rewrite accelerator_connector (#11448) 2022-02-17 23:38:39 +00:00
DuYicong515 0816a1997e
Add typing for utilities/memory.py (#11545)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2022-02-03 02:34:05 +00:00
Carlos Mocholí 79a3ff690b
Add typing to data fetching (#11515) 2022-02-02 20:53:50 +01:00
Carlos Mocholí 5914fb748f
Add typing to accelerators/gpu.py (#11333) 2022-01-12 19:44:51 +00:00
Carlos Mocholí 9771040621
Add typing to `TQDMProgressBar` (#11369) 2022-01-12 01:07:30 +00:00
Adrian Wälchli 3a2df4f75d
Fix typing in `pl.callbacks.xla_stats_monitor` (#11219)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2022-01-06 12:51:02 +00:00
Carlos Mocholí 1b6f851880
Add typing to some utility files (#11316) 2022-01-05 17:14:22 +00:00
Carlos Mocholí a610e043d7
Add typing for utilities/enums.py (#11298) 2022-01-04 13:30:56 +01:00
Kaushik B 0adcd6a048
Rename training_type_plugin file to strategy (#11239)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-12-23 14:01:23 +00:00
Kaushik B 576a5d62a0
Introduce strategies directory for Training Strategies (#11226)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-12-22 20:23:30 +00:00
Adrian Wälchli b6dd1a3878
Fix typing in `pl.callbacks.lr_monitor` (#10802)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-12-22 03:50:00 +00:00
Carlos Mocholí fa6d17c96f
Fix typing for utilities.warnings (#11115) 2021-12-17 15:07:27 +01:00
Carlos Mocholí 4415677994
Add typing for `trainer.logger` (#11114) 2021-12-17 13:34:18 +01:00
Adrian Wälchli 46f718d2ba
Fix typing in `pl.plugins.environments` (#10943) 2021-12-07 02:14:02 +00:00
Adrian Wälchli 9a4b51d17f
Fix typing in `pl.trainer.config_validator` (#10803) 2021-12-06 11:19:36 +01:00
Adrian Wälchli c6b52ef3bd
Fix typing in `pl.overrides.distributed` (#10797)
* fix typing

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-30 21:22:05 +00:00
Carlos Mocholí 0061619e0a
Improve typing for loops (#10780) 2021-11-30 20:28:55 +00:00
Adrian Wälchli fc86c301e7
Fix typing in `pl.callbacks.timer` (#10798) 2021-11-30 14:54:08 +01:00
Adrian Wälchli 24fc54f07b
Fix typing in `pl.overrides.fairscale` (#10799)
* update typing in fairscale

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-29 11:28:28 +00:00
Adrian Wälchli bd3fb2e66e
Fix typing in `pl.core.mixins.hparams_mixin` (#10800)
* fix typing in hparams mixin

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* unused import

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-29 12:03:47 +01:00
Adrian Wälchli 97e52619ea
Fix typing in `pl.overrides.data_parallel` (#10796)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-29 10:58:23 +01:00
Adrian Wälchli 038c151b6e
Improve typing for plugins (#10742)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-11-26 20:14:58 +00:00
Adrian Wälchli 81a0a44d8f
Improve typing for Lite (#10743)
* improve typing in pytorch_lightning/lite

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* include lite again

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-26 20:14:11 +00:00
Carlos Mocholí 3089dc3829
Improve typing for loops (#10749)
* Improve typing for loops

* Free memory
2021-11-26 18:39:09 +00:00
Carlos Mocholí 78face65e8
Improve typing for logging (#10748)
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2021-11-26 18:12:21 +00:00
Carlos Mocholí b57feccbff
Be explicit with mypy ignores (#10751)
* Ignore mypy only for failing files

* Comment
2021-11-25 11:27:13 +01:00
Danielle Pintz 85d7c4dce4
Configure mypy to install dependencies in CI and update pyproject.toml (#10682)
* mypy install deps

* fix deps

* add examples

* fix type errors

* fix type error

* fix

* fix

* update pyproject.toml
2021-11-25 00:19:30 +00:00
Kaushik B 1284ead317
Remove metrics references from docs (#10567) 2021-11-22 14:29:06 +00:00
Carlos Mocholí 5788789f01
Move benchmarks into the test directory (#10614) 2021-11-19 03:07:33 +01:00
Adrian Wälchli 2a331dd842
add mypy ci check for Lite (#10289) 2021-11-01 14:57:58 +00:00
Kaushik B 45c45dc7b0
Deprecate `ProgressBar` and rename it to `TQDMProgressBar` (#10134)
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-11-01 11:42:21 +00:00
Rohit Gupta 6701526478
Add typing to callbacks (#10001)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-10-20 10:22:03 +00:00
Carlos Mocholí efc8727314
Add typing for `LightningOptimizer` (#9990) 2021-10-18 17:29:51 +02:00
Danielle Pintz 940b910d27
[2/4] Add DeviceStatsMonitor callback (#9712)
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2021-10-13 18:29:36 +00:00
Kaushik B f94faa9cd3
Enable auto parameters tying for TPUs (#9525)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-10-06 10:16:44 +02:00
Adrian Wälchli f74eb58493
remove `InternalDebugger` (#9680)
* wip

* reset _notebooks

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* reset _notebooks

* testing with mock

* update test with mock

* update test

* update tests

* update test

* remove track_load_dataloader_calls

* update last test

* remove unused imports

* remove InternalDebugger

* update changelog

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-09-27 09:33:45 -04:00
Daniel Stancl 568a1e0a68
Disallow invalid seed string values (#8787)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-09-23 15:09:48 +00:00
thomas chaton c7451b3ccf
[Feat] Add graceful detection of signal to exit + SignalConnector and merge SlurmConnector. (#9566)
Co-authored-by: Sean Naren <sean@grid.ai>
2021-09-17 19:13:59 +00:00
Kaushik B 2ec39e275e
Add `RichModelSummary` callback (#9546) 2021-09-17 10:54:16 +00:00
jjenniferdai 637f59f1d2
Type `trainer.connectors.checkpoint_connector` (#9419)
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2021-09-15 03:02:19 +02:00
Adrian Wälchli 0cb550890c
fix mypy typing for model summary (#9447) 2021-09-13 11:41:27 +02:00
Carlos Mocholí 9eccb3148e
Loop and test restructuring (#9383) 2021-09-10 13:18:24 +00:00
Adrian Wälchli ca679cd78f
Add `ManualOptimization` loop (#9266)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-09-08 02:26:39 +02:00
Adrian Wälchli 9a14f04322
Fix mypy typing errors in optimizer loop (#9317) 2021-09-06 13:54:07 +02:00
Carlos Mocholí 73fca23bed
Add typing for `ResultCollection` [3/3] (#9271) 2021-09-06 09:34:40 +00:00
Carlos Mocholí 49c0485d50
Avoid optional `Tracker` attributes and enable mypy (#9320) 2021-09-06 00:20:44 +00:00
jjenniferdai e97c28a02b
Typing `tuner.auto_gpu_select` (#9292)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
2021-09-03 15:49:58 +01:00
Carlos Mocholí 171d242a89
Add typing for `_FxValidator` [1/3] (#9269) 2021-09-03 13:41:05 +00:00
Carlos Mocholí ddb4dc2659
Add typing for `LoggerConnector` [2/3] (#9270)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-09-03 01:39:06 +02:00
Daniel Stancl 53885afc2e
Fix mypy typing for `utilities.apply_func` (#8781)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-08-26 16:36:22 +00:00
Adrian Wälchli 6592d0e454
generalize closure api in Lightning (#8642)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
2021-08-26 08:36:21 +00:00
Daniel Stancl d063059d03
Fix mypy for `utilities.xla_device` (#8755)
* Fix mypy for utilities.xla_device

* Add explicit type hint for _XLA_AVAILABLE in utilities.imports
2021-08-06 17:01:21 +02:00
Daniel Stancl 0b7f6d9200
Fix mypy for `utilities.memory` (#8744)
* Fix the majority of mypy issues

* Apply @carmocca's suggestion

* Handle the exception when nvidia-smi not found

* Update get_gpu_memory_map's docstring

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-08-06 11:21:09 +02:00
Daniel Stancl 69cd927fc5
Fix mypy typing for `utilities.debugging` (#8672) 2021-08-05 13:47:58 +02:00
Daniel Stancl aacd131414
Fix mypy in `utilities.distributed` (#8201) 2021-08-05 09:51:09 +00:00
Daniel Stancl 08ac079c2f
Fix mypy typing for `utilities.cloud_io.py` (#8671)
Co-authored-by: tchaton <thomas@grid.ai>
2021-08-03 11:56:28 +02:00
Jirka Borovec 661522e173
black: magic trailing comma (#8560) 2021-08-02 20:02:36 +02:00
Daniel Stancl 1f01db8b30
Fix mypy in utilities.argparse (#8124)
Co-authored-by: tchaton <thomas@grid.ai>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-07-30 16:36:55 +00:00
Carlos Mocholí a64cc37394
Replace `yapf` with `black` (#7783)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-07-26 13:37:35 +02:00
Carlos Mocholí c5a120ed9d
Update to Mypy>0.9 (#8386) 2021-07-13 08:23:36 +02:00
Kaushik B 4f1e7be5ec
Remove Vulture (#8381) 2021-07-12 13:39:36 +00:00
Kaushik B 652eae684b
Exclude `lightning.py` for vulture (#8379) 2021-07-12 12:29:16 +00:00
Aniket Maurya 0bad2186c1
Added Vulture dead code checker (#5654)
* integrated vulture CI

* added vulture in workflows

* added vulture in workflows

* vulture logs verbose set false

* Apply suggestions from code review

* ignore name list and args to underscore naming

* add ignore names

* deadcode whitelist

* deadcode whitelist

* Apply suggestions from code review

Co-authored-by: Rahul Jha <rahul722j@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update whitelist

* Sort

* Updates

* Updates

* Apply suggestions from code review

* Updates

Co-authored-by: Aniket Maurya <aniket.maurya@gdn-commerce.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: chaton <thomas@grid.ai>
Co-authored-by: Rahul Jha <rahul722j@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Ethan Harris <ethanwharris@gmail.com>
2021-06-02 16:19:10 +01:00
Carlos Mocholí 414aa5d345
Delete unused autopep8 config (#5904) 2021-02-11 14:32:14 +00:00
Jirka Borovec 630a88addb
drop deprecated docs (#5768)
* drop deprecated docs

* notes

* .
2021-02-03 20:21:19 +00:00
Carlos Mocholí aa03b73e60
Remove psf/black references (#5739)
* Update pyproject.toml

* Update setup.cfg

* Update test.txt

* Update CONTRIBUTING.md

* Update requirements/test.txt
2021-02-03 08:37:06 +00:00
Arnaud Gelas 8dfcc078c4
Fix isort failures in core (#5526)
Remove from skipped module in pyproject.toml and fix failures on:
- pytorch_lightning/core/*.py
2021-01-27 05:02:16 -05:00
Arnaud Gelas a9d9f33a86
Fix isort failures in trainer (#5529)
Remove from skipped module in pyproject.toml and fix failures on:
- pytorch_lightning/trainer/*.py
2021-01-18 13:42:50 -05:00
Arnaud Gelas 61e1d8772d
Fix isort failures in metrics (#5528)
Remove from skipped module in pyproject.toml and fix failures on:
- pytorch_lightning/metrics/*.py
2021-01-18 07:10:53 -05:00
Arnaud Gelas 1ff6b18e8a
Fix pre-commit isort failure on pytorch_lightning/accelerators (#5503)
Remove from skipped module in pyproject.toml and fix failures on:
- pytorch_lightning/accelerators/*.py
2021-01-16 14:10:56 -05:00
Arnaud Gelas 6386b8d36b
Fix isort a few failures (#5504)
Remove from skipped module in pyproject.toml and fix failures on:
- pytorch_lightning/callbacks/*.py
- pytorch_lightning/cluster_environments/*.py
- pytorch_lightning/profiler/*.py
- pytorch_lightning/tuner/*.py

Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>

Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>
2021-01-15 17:44:27 -05:00
Arnaud Gelas e4688ae754
Fix isort failures in utilities (#5530)
Remove from skipped module in pyproject.toml and fix failures on:
- pytorch_lightning/utilities/*.py
2021-01-15 13:57:40 -05:00
Arnaud Gelas 8629048659
Fix isort failures in loggers (#5527)
Remove from skipped module in pyproject.toml and fix failures on:
- pytorch_lightning/loggers/*.py
2021-01-15 22:53:56 +05:30
Arnaud Gelas 23c241d083
Fix pre-commit isort failure on tests/base/*.py (#5429)
* Remove tests.base from skipped module in pyproject.toml

* Fix pre-commit isort failure on tests/base/*.py
2021-01-15 03:01:57 -05:00
Arnaud Gelas 7523e6940f
Fix pre-commit isort failure on tests/backends/*.py (#5430)
* Fix pre-commit isort failure on tests/backends/*.py

* Remove tests.backends from skipped module in pyproject.toml
2021-01-14 19:32:41 -05:00
Arnaud Gelas 9515750548
Fix pre-commit isort failure on tests/loggers/*.py (#5425)
* Remove tests.loggers from skipped module in pyproject.toml

* Fix pre-commit isort failure on tests/loggers/*.py
2021-01-14 14:36:28 -05:00
Arnaud Gelas 6d83d4457d
Fix pre-commit isort failure on tests/callbacks/*.py (#5428)
* Remove tests.callbacks from skipped module in pyproject.toml

* Fix pre-commit isort failure on tests/callbacks/*.py
2021-01-14 13:15:34 -05:00
Jirka Borovec 16224781ed
anti-colision isort config (#5511) 2021-01-14 10:33:09 -05:00
Arnaud Gelas ac531ec945
Fix pre-commit isort failure on tests/models/*.py (#5423)
* Remove tests.models from skipped module in pyproject.toml

* Fix pre-commit isort failure on tests/models/*.py
2021-01-14 09:42:01 -05:00
Arnaud Gelas 7fb0221934
Fix pre-commit isort failure on tests/trainer/*.py (#5421)
* Remove tests.trainer from skipped module in pyproject.toml

* Fix pre-commit isort failure on tests/trainer/*.py
2021-01-14 07:51:20 -05:00
Arnaud Gelas d8a0c7d82a
Fix pre-commit isort failure on tests/metrics/*.py (#5424)
* Remove tests.metrics from skipped module in pyproject.toml

* Fix pre-commit isort failure on tests/metrics/*.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-01-14 06:05:28 -05:00
Arnaud Gelas 84d1040b32
Fix pre-commit isort failure on tests/plugins/*.py (#5422)
* Fix pre-commit isort failure on tests/plugins/*.py

* Remove tests.plugins from skipped module in pyproject.toml

* Update pyproject.toml

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-01-14 03:57:16 -05:00
Rohit Gupta 29bcf30984
[tests/core] Updated with BoringModel and added BoringDataModule (#5432)
* update with BoringModel and introduce BoringDataModule

* isort

* fix

* rm random_split

* fix test

* fix test

* update

* update test_results

* val_step

* update tests

* rebase

* rebase
2021-01-13 01:48:37 -05:00
Arnaud Gelas 2373858b33
Fix pre-commit isort failure on tests/checkpointing/*.py (#5427)
* Remove tests.checkpointing from skipped module in pyproject.toml

* Fix pre-commit isort failure on tests/checkpointing/*.py
2021-01-12 03:31:51 -05:00
Arnaud Gelas b9530d291e
Fix pre-commit isort failure on tests/utilities/*.py (#5420)
* Remove tests.utilities from skipped module in pyproject.toml

* Fix pre-commit isort failure on tests/utilities/*.py
2021-01-11 14:00:39 -05:00
Jirka Borovec 53b0cb910b update isort config (#5335)
* update isort config

* apply

(cherry picked from commit 724f1051f0)
2021-01-06 12:49:23 +01:00
Akihiro Nitta abc690d720 Apply isort to `pl_examples/` (#5291)
* Remove examples from isort ignore list

* Apply isort

(cherry picked from commit 0c7c9e8540)
2021-01-06 12:47:53 +01:00
Akihiro Nitta 151d86e40b Update isort config (#5142)
* Update isort config

* Apply isort with new config

* Fix typo in isort config

* fix rebase

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-01-05 09:57:37 +01:00
Akihiro Nitta ece09f0c5f
Apply import formatting to files in the 2nd top level (#4717)
* Update pyproject.toml

* Apply isort to files in second level

Co-authored-by: chaton <thomas@grid.ai>
2020-11-18 00:29:09 +01:00
Nathan Painchaud 2d78d9b84a
CI: Added isort import check for the code on pull-request (#4242)
* added isort CI job and updated isort config

* changed CI check output from files to full diff

* added isort pre-commit hook

* Added missing first party and restricted files affected by isort

* Applied isort to root-level, docs and benchmarks

* Apply suggestions from code review

Co-authored-by: Nathan Painchaud <nathanpainchaud@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: chaton <thomas@grid.ai>
2020-11-13 22:57:46 +01:00
kumuji fd7814d287
Added black formater for the code with code-checker on pull (#1610)
* black

Added throught black.toml other options are hard so far

No caching for black github action

Moved from black.toml to pyproject.toml

Exclude not only yml but also yaml

Update pyproject.toml

Co-authored-by: Thomas Johansen <thomasjo@gmail.com>

Update .github/workflows/code-formatting-check.yml

mergify

Remove formating check

E231 error ignoring because of black formating

Updated CONTRIBUTING to the master

* Update .github/workflows/code-formatting-check.yml

* Bump black to 19.10b0 version

* resolved incorrect merge of CONTRIBUTING,

Black skipping string normalization

* Minor fixes in CONTRIBUTING, two typos

* Update setup.cfg

* chlog

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka@pytorchlightning.ai>
2020-06-03 18:23:14 +02:00
Hadrien Mary 89d5772f55
Split callbacks (#849)
* add .vscode in .gitignore

* Split callbacks in individual files + add a  property to Callback for easy trainer instance access

* formatting

* Add a conda env file for quick and easy env setup to develop on PL

* Adress comments

* add fix to kth_best_model

* add some typing to callbacks

* fix typo

* add autopep8 config to pyproject.toml

* format again

* format

* fix toml

* fix toml again

* consistent max line length in all config files

* remove conda env file

* Update pytorch_lightning/callbacks/early_stopping.py

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* Update pytorch_lightning/callbacks/model_checkpoint.py

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* docstring

* Update pytorch_lightning/callbacks/model_checkpoint.py

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* Update pytorch_lightning/callbacks/model_checkpoint.py

Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>

* fix logic error

* format

* simplify if/else

* format

* fix linting issue in changelog

* edit changelog about new callback mechanism

* fix remaining formating issue on CHANGELOG

* remove lambda function because it's compatible with pickle (used during ddp)

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-02-22 21:45:34 -05:00
Shreyas Bapat 4809de8765 Fix pip install too 2019-04-03 22:47:55 +05:30