Commit Graph

159 Commits

Author SHA1 Message Date
Eric Wiener 3f78c4ca7a
Track CPU stats with DeviceStatsMonitor (#11795)
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-10 10:57:38 +00:00
Jirka Borovec 783ec43a85
parse strategies as own extras (#12975)
* parse strategies as own extras

* prune devel

* Update Makefile

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* revert parse_requirements

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-09 09:25:53 -04:00
Sean Naren 1a502c061c
[1/2] Collaborative Strategy (#12842) 2022-05-05 16:06:26 +00:00
Jirka Borovec bb51e2a55b
Merge pull request #12723 from PyTorchLightning/req/strategies
Separate strategies' requirements
2022-05-04 10:06:02 -04:00
Carlos Mocholí cac02a04ba
Update `jsonargparse` to unblock master (#12884)
Co-authored-by: Mauricio Villegas <mauricio_ville@yahoo.com>
2022-04-26 16:55:07 +00:00
stanbiryukov 8034919c44
Remove deprecated `TestTubeLogger` (#12859)
* remove deprecated test_tube logger

* remove testube from logger __init__

* remove relevant testtube tests

* update CHANGELOG with removal of deprecated `TestTubeLogger`
2022-04-24 20:05:48 +02:00
William Falcon 908e05880d
docs refactor 3/n (#12795)
* updated titles + css

* updated titles + css

* levels structure

* levels structure

* levels structure

* adding level indexes

* finished intro guide layout

* finished intro guide layout

* general titles

* general titles

* added movie

* added movie

* finished 15 mins

* levels

* added core levels

* added core levels

* fixed api reference on the left

* gpu guides

* gpu guides

* gpu guides

* gpu guides

* precision

* hpu guide

* added ipu

* added ipu

* added ipu

* added ckpt docs

* finished basic logging

* intermediate

* intermediate

* intermediate

* fixed

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* added logger stuff

* added logger stuff

* added logger stuff

* added logger stuff

* added logger stuff

* ic

* added inconsolata

* added inconsolata

* added inconsolata

* added inconsolata

* added inconsolata

* added inconsolata

* added inconsolata

* updated menu

* added basic cloud docs

* added basic cloud docs

* added basic cloud docs

* added basic cloud docs

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* added demos folder

* added demos folder

* added demos folder

* added demos folder

* added demos folder

* added demos folder

* twocolumns directive

* twocols

* twocols

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* updated titles + css

* levels structure

* adding level indexes

* finished intro guide layout

* general titles

* added movie

* finished 15 mins

* levels

* added core levels

* fixed api reference on the left

* gpu guides

* precision

* hpu guide

* added ipu

* added ckpt docs

* finished basic logging

* intermediate

* fixed margins

* added logger stuff

* ic

* added inconsolata

* updated menu

* added basic cloud docs

* ic

* added demos folder

* twocolumns directive

* registry

* cleaning up

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* deconflict

* deconflict

* deconflict

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add testsetup sections wherever needed; fix errors in building docs

* pre-commit fixes

* Fix duplicate label

* minor nit with pre-commit

* Fix labels

* More changes...

* require

* debug & cli

* prec & model & visu

* fix references

* fix references

* fix refs

* fix refs - model_parallel

* fix references

* prune testsetup with global

* refs in index

* Fix duplicate label errors

* Update orphan docs

* Update orphan docs

* Update orphan docs

* fix links

* Fix genindex and search index

* fix refs

* fix refs

* Fix index rst related issues

* fix refs

* inc to rst

* Fix links ref

* fix more references

* fix refs

* deconflict

* errors

* errors

* errors

* fix refs

* fix refs

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix warnings

* Fix LightningCLI errors

* Fix LightningCLI errors

* Fix LightningCLI errors

* Fix LightningCLI errors

* fix doc build

* Duplicate Label fix (docs) (#12800)

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

* ignore typing in demo folder

* Ignore demos for mypy

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kushashwa Ravi Shrimali <kushashwaravishrimali@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: otaj <ota@grid.ai>
2022-04-19 14:15:47 -04:00
Mauricio Villegas 2f2a516de9
Update LightningCLI tests to reflect changes in jsonargparse 4.6.0 (#12704) 2022-04-11 14:00:48 +02:00
Carlos Mocholí 124b529088
Add version header to CLI config files (#12532) 2022-04-07 17:52:51 +05:30
Carlos Mocholí 939d56c6d6
Drop PyTorch 1.7 support (#12432) 2022-03-27 21:31:20 +00:00
Kaushik B 1dc57f9573
Fix: Update sphinx-autodoc-typehints minimal version (#12468) 2022-03-27 14:31:28 +00:00
Jerome Anand 812c2dc3d3
Add support for Habana accelerator (HPU) (#11808)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: four4fish <88516121+four4fish@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: jjenniferdai <89552168+jjenniferdai@users.noreply.github.com>
Co-authored-by: Kushashwa Ravi Shrimali <kushashwaravishrimali@gmail.com>
Co-authored-by: Akarsha Rao <94624926+raoakarsha@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.comk-Pro.local>
2022-03-25 10:24:52 +00:00
Ethan Harris c099c8be5d
Fix: freeze Jinja2 version (#12444) 2022-03-24 16:46:08 +00:00
Aki Nitta 09d1296040
Avoid `rich` 10.15.0 and 10.15.1 (#12293)
* Update rich version

* Update requirements/extra.txt

Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>

Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2022-03-18 19:14:43 +00:00
Jirka Borovec 1144673cd9
CI: sanity check for req. pkgs (#11819)
* CI: sanity check for req. pkgs
* scripts
* rename
* gcsfs ?
* rich !
* install extra
* move
* set -e

Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-03-11 09:20:47 +00:00
Jirka Borovec 8577ef7bba
Skip horovod 0.24.0 only (#12248)
* try skip horovod 0.24.0 only
* HOROVOD_BUILD_CUDA_CC_LIST
* fix test

Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-03-10 16:01:08 +00:00
Kushashwa Ravi Shrimali 821ca7e85d
Drop PyTorch 1.7 testing from the CI (#12191)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
2022-03-08 19:02:32 +01:00
Adrian Wälchli 0db85d633c
Pin horovod to <0.24 (#12234) 2022-03-04 22:16:23 +00:00
Mauricio Villegas 54b9a85227
Unit test for CLI with subcommands and a common default config file (#12061)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-02-28 10:17:49 +00:00
Adrian Wälchli 923b30dc51
Fix import error when running doctests for RL examples (#12010)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-02-19 21:57:02 +01:00
Akihiro Nitta f79d75d4b5 Pin myst-parser<0.17 2022-02-14 09:19:49 -05:00
Carlos Mocholí 77a9253b04
Prepare for `torch==1.11` (#11679) 2022-02-02 19:41:17 +00:00
Aki Nitta 11e1e3e6f2
Update torch version matrix (#11649) 2022-01-27 20:04:34 -05:00
Aki Nitta cfb0411b78
Merge pull request #11635 from PyTorchLightning/ci/fix-term
Pin `coverage<6.3`
2022-01-27 16:25:12 -05:00
Rohit Gupta 34c62da37d
pin sphinx-autodoc-typehints version to v1.15 (#11400) 2022-01-11 00:12:53 +01:00
Carlos Mocholí f37bd4677d
Update mypy (#11096) 2021-12-16 17:53:12 +01:00
Carlos Mocholí 9e56290e2a
Support torch 1.10.1 (#11095) 2021-12-15 19:23:31 -08:00
Ethan Harris ff20af41fd
Fix mathjax in RTD build (#10889)
* Update docs.txt
* Update conf.py
* Update .readthedocs.yml
2021-12-02 11:46:57 +00:00
Carlos Mocholí d3b7492bd0
[CLI] Add support for `--key.help=class` (#10767) 2021-11-29 14:12:53 +00:00
Carlos Mocholí e1bf54c944
Tune Conda CI timeout and other minor improvements (#10769) 2021-11-28 17:58:03 +00:00
Mauricio Villegas 5d748e560b
LightningCLI changes for jsonargparse>=4.0.0 (#10426)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-11-19 17:03:14 +00:00
Carlos Mocholí 3d2d0f2536
MANIFEST.in and setup.py clean-up (#7614) 2021-11-19 15:38:42 +01:00
Carlos Mocholí 5b90253a53
Drop torch 1.6 support (#10367) 2021-11-08 11:29:39 +00:00
Adrian Wälchli 4a4a27db05
Update docutils package version in requirements.txt (#10158) 2021-10-26 16:32:47 +00:00
Carlos Mocholí a0e45dc071
Some minor CI cleanup (#10088) 2021-10-26 13:58:20 +02:00
kingyiusuen 2ed92ecabb
Rerun flaky profiler tests on failure (#10035) 2021-10-20 18:57:04 +05:30
Danielle Pintz c2e3ec164a
Add torch v1.11.0 to the list of versions in adjust_versions.py (#9679) 2021-09-24 01:27:16 -07:00
Carlos Mocholí d022f6ff60
Update versions after recent PyTorch releases (#9623) 2021-09-21 10:49:49 -07:00
Carlos Mocholí bbcb977851
[CLI] Shorthand notation to instantiate optimizers and lr schedulers [2/3] (#9565) 2021-09-17 18:00:46 +01:00
Jakub Kuszneruk ee3787216a
Adapt `NeptuneLogger` to new `neptune-client` api (#6867)
* Initial split to NeptuneLegacyLogger and NeptuneLogger

* Adapt NeptuneLogger to neptune-pytorch-lightning repo version

* Fix stylecheck and tests

* Fix style and PR suggestions

* Expect Run object in NeptuneLogger.init

* Model checkpoint support and restructured tests

* Reformat code - use " instead of '

* Fix logging INTEGRATION_VERSION_KEY

* Update CHANGELOG.md

* Fix stylecheck

* Remove NeptuneLegacyLogger

* updated neptune-related docstrings

* PR suggestions

* update CODEOWERS file
* move import logic to imports.py
* minor neptune.py improvements

* formatting fixes and minor updates

* Fix generation of docs

* formatting fixes and minor updates

* fix

* PR fixes vol. 2

* define return type of _dict_paths method
* bump required version of `neptune-client`

* Enable log_* functions

* Update pytorch_lightning/loggers/neptune.py

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* Revert "Enable log_* functions"

This reverts commit 050a436899b7f3582c0455dc27b171335b85a3a5.

* Make global helper lists internal

* Logger's `name` and `version` methods return proper results

* Initialize Run and its name and id at logger init level

* Make _init_run_instance static

* Add pre-commit hook code changes.

* Fix blacken-docs check

* Fix neptune doctests and test_all

* added docs comment about neptune-specific syntax

* added docs comment about neptune-specific syntax in the loggers.rst

* fix

* Add pickling test

* added myself to neptune codeowners

* Enable some of deprecated log_* functions

* Restore _run_instance for unpickled logger

* Add `step` parameter to log_* functions

* Fix stylecheck

* Fix checkstyle

* Fix checkstyle

* Update pytorch_lightning/loggers/neptune.py

Co-authored-by: thomas chaton <thomas@grid.ai>

* Fix tests

* Fix stylecheck

* fixed project name

* Fix windows tests

* Fix stylechecks

* Fix neptune docs tests

* docformatter fixes

* De-duplicate legacy_kwargs_msg

* Update .github/CODEOWNERS

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

Co-authored-by: kamil-kaczmarek <kamil.kaczmarek@neptune.ml>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-09-10 18:48:58 +02:00
Danielle Pintz 160e7e1289
Deprecate LightningModule.get_progress_bar_dict (#8985)
* Move get_progress_bar_dict from lightning module to progress bar callback
2021-09-09 20:53:47 +00:00
Jirka Borovec 6e124e7207
CI: precommit - docformatter (#8584)
* CI: precommit - docformatter
* fix deprecated

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-09-06 12:49:09 +00:00
Carlos Mocholí 0dfc6a18bd
Call any trainer function from the `LightningCLI` (#7508) 2021-08-28 04:43:14 +00:00
Jirka Borovec f67892ea96
CI: yesqa (#8564)
* add yesqa
* fix flake8

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-08-02 16:05:56 +00:00
Carlos Mocholí e63968ab88
Add `pyupgrade` to `pre-commit` (#8557)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-07-26 14:38:12 +02:00
Carlos Mocholí a64cc37394
Replace `yapf` with `black` (#7783)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-07-26 13:37:35 +02:00
Ethan Harris 52526c20b5
Add support for functions to be parsed by the Lightning CLI in addition to Types (#8400)
* Initial commit

* Update docstrings

* Update CHANGELOG.md

* Fix mypy

* Fixes

* Fixes

* Update to comments

* Fix

* mypy

* Update on comments

* Update

* Fix mypy

* protected

Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-07-26 10:53:48 +02:00
Jirka Borovec abbcfa1ab7
fix CI for PT 1.10 (#8526)
* fix CI for PT 1.10
* Apply suggestions from code review

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-07-23 19:24:31 +02:00
Jirka Borovec 74a09a23f1
CI: support PT 1.10 (#8133)
* prepare PT 1.10

* dockers

* fixes

* readme
2021-07-14 18:04:33 +03:00
Carlos Mocholí 6ce77a102b
Set minimum PyTorch version to 1.6 (#8288)
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2021-07-13 17:12:49 +00:00