Rooba
/
lightning
mirror of https://github.com/Lightning-AI/lightning.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,879 Commits 59 Branches 217 Tags 356 MiB
Commit Graph

228 Commits

Author SHA1 Message Date
Rohit Gupta ff5361604b
Weekly patch release v1.6.5 (#13481) 
* update NGC docker (#13136)

* update docker
* Apply suggestions from code review

Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Decouple pulling legacy checkpoints from existing GHA workflows and docker files (#13185)

* Add pull-legacy-checkpoints action
* Replace pulls with the new action and script
* Simplify

* Merge pull request #13250 from PyTorchLightning/ci/rm-base

CI: Remove simple test `ci_test-base.yml`

* Update rich requirement from !=10.15.*,<=12.0.0,>=10.2.2 to >=10.2.2,!=10.15.0.a,<13.0.0 in /requirements (#13047)

* Update rich requirement in /requirements

Updates the requirements on [rich](https://github.com/willmcgugan/rich) to permit the latest version.
- [Release notes](https://github.com/willmcgugan/rich/releases)
- [Changelog](https://github.com/Textualize/rich/blob/master/CHANGELOG.md)
- [Commits](https://github.com/willmcgugan/rich/compare/v10.2.2...v12.4.1)

---
updated-dependencies:
- dependency-name: rich
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* Fix torch.distributed._sharded_tensor DeprecationWarning (#13261)

* update tutorials (#13268)

* [BUG] `estimated_stepping_batches` requires distributed comms in `configure_optimizers` for `DeepSpeedStrategy` (#13350)

* Update torchmetrics requirement from <=0.7.2,>=0.4.1 to >=0.4.1,<0.9.2 in /requirements (#13275)

Update torchmetrics requirement in /requirements

Updates the requirements on [torchmetrics](https://github.com/PyTorchLightning/metrics) to permit the latest version.
- [Release notes](https://github.com/PyTorchLightning/metrics/releases)
- [Changelog](https://github.com/PyTorchLightning/metrics/blob/master/CHANGELOG.md)
- [Commits](https://github.com/PyTorchLightning/metrics/compare/v0.4.1...v0.9.1)

---
updated-dependencies:
- dependency-name: torchmetrics
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Fix mypy errors for model summary utilities (#13384)

* rename org Lightning AI

* Modified python version check to accommodate for legacy version styles (#13420)

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

(cherry picked from commit b332b66328)

* Call `set_epoch` for distributed batch samplers (#13396)

Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

(cherry picked from commit 2dd332f9c7)

* _RICH_AVAILABLE

* _FAIRSCALE_AVAILABLE

* _BAGUA_AVAILABLE

* redefine

* chlog spaces

* CI: Fix `fatal: unsafe repository` (#13515)

* update release date

* CI: azure rename

* Restore log step during restart (#13467)

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* remove redundant test

* Update CI setup (#13291)

* drop mamba
* use legacy GPU machines

* fix schema check

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Adam J. Stewart <ajstewart426@gmail.com>
Co-authored-by: Sean Naren <sean@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: Martino Sorbaro <martinosorb@users.noreply.github.com>
 2022-07-12 19:40:14 -04:00
Carlos Mocholí cd276fdb6d Expose deprecated arguments from logger base interface (#12609) 2022-04-13 14:14:29 -04:00
Robert Scholes Lyck 1e58c964cf
Update type hint for log_model (#12223) 2022-03-28 22:53:15 +05:30
Bruno Cabado e618a331fd
Allow log to an existing run ID in MLflow with MLFlowLogger (#12290) 
Co-authored-by: bruno.cabado <bruno.cabado@cinfo.es>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2022-03-27 17:28:57 +00:00
Akash Kwatra 1f7298d326
Deprecate `LoggerCollection` in favor of `trainer.loggers` (#12147) 
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2022-03-04 23:01:43 +00:00
Danielle Pintz a8ee5cacb7
Further clean up aggregation logic (#12053) 2022-02-23 21:42:51 +00:00
Akash Kwatra e50653da08
Deprecate `agg_key_funcs`, `agg_default_func`, and `update_agg_funcs` from `LightningLoggerBase` (#11871) 
Co-authored-by: Danielle Pintz <38207072+daniellepintz@users.noreply.github.com>
 2022-02-21 22:35:59 +00:00
Akash Kwatra d61371922b
Deprecate and remove calls to agg_and_log_metrics (#11832) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2022-02-18 02:54:33 +00:00
Akash Kwatra 73e9ca343a
Remove `log_text`, and `log_image` from `LightningLoggerBase` API (#11857) 2022-02-17 18:09:09 -08:00
edward-io 87bd54aedf
fix typos (#11937) 2022-02-16 17:27:51 -08:00
Akash Kwatra 914f685ed8
Update typing for CometLogger.experiment (#11836) 2022-02-14 09:16:11 +00:00
Danielle Pintz 0e68734ddd
Make default logger name "lightning_logs" (#11762) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2022-02-10 15:19:18 +05:30
Boris Dayma 1e36cffbca
feat(wandb): support distributed modes (#11650) 
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2022-02-09 19:53:21 +01:00
ananthsub a64438c897
Centralize rank_zero_only utilities into their own module (#11747) 
* Centralize rank_zero_only utilities into their own module

Fixes #11746

* PossibleUserWarning

* Update test_warnings.py

* update imports

* more imports

* Update CHANGELOG.md

* Update mlflow.py

* Update cli.py

* Update api_references.rst

* Update meta.py

* add deprecation tests

* debug standalone

* fix standalone tests

* Update CHANGELOG.md
 2022-02-07 08:09:55 +00:00
Danielle Pintz 34c454c756
Small improvements to TB and CSV loggers (#11764) 
* small improvements to TB and CSV loggers
* addr comments
* remove redundant lines and update tests

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
 2022-02-07 14:59:39 +09:00
NathanGodey 8a1b1eeef8
WandbLogger's log_image can use step argument (#11716) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2022-02-05 01:02:41 +00:00
Sebastian Raschka 9934569373
Fix typo in `TensorBoardLogger.log_metrics` error message (#11595) 2022-02-03 03:18:54 +00:00
Akash Kwatra d5aa7717aa
Remove experiment property from abstract class (#11603) 
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2022-02-03 01:51:34 +00:00
Akash Kwatra 115a5d08e8
Decouple utilities from `LightningLoggerBase` (#11484) 
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
 2022-02-02 23:29:01 +01:00
Rafał Jankowski e78d658c8d
Remove access to `_short_id` in NeptuneLogger (#11517) 2022-01-20 12:07:42 +00:00
twsl 0b9034baef
Return only unique names/versions for LoggerCollection (#10976) 
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-12-23 00:35:38 +00:00
Rafał Jankowski 3cc69f992b
Fixed NeptuneLogger when using DDP (#11030) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-12-18 01:40:13 +00:00
Carlos Mocholí fa6d17c96f
Fix typing for utilities.warnings (#11115) 2021-12-17 15:07:27 +01:00
Rafał Jankowski ed84cef3af
Removed duplicated file extension when uploading model checkpoints with NeptuneLogger (#11015) 2021-12-11 00:03:12 +05:30
Luca Moschella 7792b77932
Resolve: 'DummyExperiment' object does not support item assignment (#10917) 
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2021-12-03 17:54:05 +00:00
Rafał Jankowski c6478414ee
Fixed uploading best model checkpoint in NeptuneLogger (#10369) 2021-12-01 13:58:54 +00:00
Rohit Gupta ce95891f6a
Update extensions doc (#10778) 
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2021-11-29 20:38:23 +00:00
Carlos Mocholí edebd8a3bc
Fix scripting causing false positive deprecation warnings (#10555) 
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
 2021-11-16 15:52:09 +00:00
Espen Haugsdal 89e1360e75
Fix pickling error with CSVLogger (#10388) 
* Don't store csv.Dictwriter in ExperimentWriter

* Add test for pickle after .save()

* Add entry in changelog
 2021-11-08 10:36:35 +00:00
Connor Anderson 1c28f361d4
Remove `every_n_val_epochs` from ModelCheckpoint (#10366) 
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
 2021-11-05 15:19:33 +00:00
Adrian Wälchli 3f9dfe4949
Fix iterating over a DummyLogger when `fast_dev_run > 0` (#10232) 2021-10-29 07:22:59 +00:00
Alessio Bonfiglio 2a2fa5a56a
Group all the logged gradients under the same sub-folder (#7756) 2021-10-20 15:48:36 +00:00
Rohit Gupta 7eff00317d
update docs (#9903) 2021-10-12 15:37:08 +05:30
Boris Dayma 2db9ea3500
feat(wandb): support media logging (#9545) 2021-10-11 10:15:36 +01:00
Siddhartha c395766300
use ModuleNotFoundError instead of ImportError (#9867) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-10-11 05:57:37 +00:00
jjenniferdai cc77367ffc
Deprecate `LightningLoggerBase.close` (#9422) 
* deprecate loggerbase.close

* deprecate warning

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add to changelog

* fix import

* fix import alphabetize

* spacing?

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* copy-paste avoid pre-commit.ci?

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* literally match the other comment

* unindent

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* suggest finalize instead of save

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update tests/loggers/test_base.py

* format but to be formatted

* Update pytorch_lightning/loggers/base.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update pytorch_lightning/loggers/base.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update pytorch_lightning/loggers/base.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2021-09-20 22:00:09 +00:00
edward-io c784092013
deprecate flush_logs_every_n_steps on Trainer (#9366) 2021-09-14 11:27:56 +01:00
Jakub Kuszneruk ee3787216a
Adapt `NeptuneLogger` to new `neptune-client` api (#6867) 
* Initial split to NeptuneLegacyLogger and NeptuneLogger

* Adapt NeptuneLogger to neptune-pytorch-lightning repo version

* Fix stylecheck and tests

* Fix style and PR suggestions

* Expect Run object in NeptuneLogger.init

* Model checkpoint support and restructured tests

* Reformat code - use " instead of '

* Fix logging INTEGRATION_VERSION_KEY

* Update CHANGELOG.md

* Fix stylecheck

* Remove NeptuneLegacyLogger

* updated neptune-related docstrings

* PR suggestions

* update CODEOWERS file
* move import logic to imports.py
* minor neptune.py improvements

* formatting fixes and minor updates

* Fix generation of docs

* formatting fixes and minor updates

* fix

* PR fixes vol. 2

* define return type of _dict_paths method
* bump required version of `neptune-client`

* Enable log_* functions

* Update pytorch_lightning/loggers/neptune.py

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* Revert "Enable log_* functions"

This reverts commit 050a436899b7f3582c0455dc27b171335b85a3a5.

* Make global helper lists internal

* Logger's `name` and `version` methods return proper results

* Initialize Run and its name and id at logger init level

* Make _init_run_instance static

* Add pre-commit hook code changes.

* Fix blacken-docs check

* Fix neptune doctests and test_all

* added docs comment about neptune-specific syntax

* added docs comment about neptune-specific syntax in the loggers.rst

* fix

* Add pickling test

* added myself to neptune codeowners

* Enable some of deprecated log_* functions

* Restore _run_instance for unpickled logger

* Add `step` parameter to log_* functions

* Fix stylecheck

* Fix checkstyle

* Fix checkstyle

* Update pytorch_lightning/loggers/neptune.py

Co-authored-by: thomas chaton <thomas@grid.ai>

* Fix tests

* Fix stylecheck

* fixed project name

* Fix windows tests

* Fix stylechecks

* Fix neptune docs tests

* docformatter fixes

* De-duplicate legacy_kwargs_msg

* Update .github/CODEOWNERS

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

Co-authored-by: kamil-kaczmarek <kamil.kaczmarek@neptune.ml>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
 2021-09-10 18:48:58 +02:00
Jirka Borovec 6e124e7207
CI: precommit - docformatter (#8584) 
* CI: precommit - docformatter
* fix deprecated

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2021-09-06 12:49:09 +00:00
Burhanuddin Rangwala ead2404aac
Added doc strings to base logger file (#9232) 
* added doc strings to base logger

* updated docs
 2021-09-03 00:55:12 +02:00
Burhanuddin Rangwala ccc83e717c
Add doc strings to CSV logger (#9112) 
Co-authored-by: tchaton <thomas@grid.ai>
 2021-09-01 11:04:48 +00:00
Soham Tiwari 861f8afeea
[bugfix] Changed CometLogger to stop modifying metrics in place (#9150) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2021-08-31 08:21:16 +00:00
Burhanuddin Rangwala e133061cd3
Add doc strings for Neptune logger (#9111) 
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-08-27 08:45:52 +00:00
Burhanuddin Rangwala b576201a3d
Added doc strings to wandb logger (#9109) 2021-08-26 16:01:42 +01:00
Burhanuddin Rangwala 0752bcd0eb
Added doc strings for Comet logger (#9114) 2021-08-26 11:01:46 +00:00
Adrian Wälchli 8efdeb2c00
deprecate the TestTubeLogger (#9065) 
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
 2021-08-26 10:28:14 +00:00
Burhanuddin Rangwala 9d62f24847
Add docstrings to Test Tube logger (#9110) 2021-08-25 12:15:00 -07:00
Burhanuddin Rangwala bf8c1fd766
Add doc strings to tensorboard logger class (#9093) 2021-08-25 09:41:18 +00:00
Adrian Wälchli dfae7342cc
sanitize arrays when logging as hyperparameters in TensorBoardLogger (#9031) 
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
 2021-08-24 13:02:06 +02:00
Burhanuddin Rangwala c8e9fb40f2
Add docstrings in mlflow logger class (#9030) 
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
 2021-08-23 10:11:50 -07:00