cd276fdb6d
Expose deprecated arguments from logger base interface ( #12609 )
2022-04-13 14:14:29 -04:00
87bd54aedf
fix typos ( #11937 )
2022-02-16 17:27:51 -08:00
a64438c897
Centralize rank_zero_only utilities into their own module ( #11747 )
...
* Centralize rank_zero_only utilities into their own module
Fixes #11746
* PossibleUserWarning
* Update test_warnings.py
* update imports
* more imports
* Update CHANGELOG.md
* Update mlflow.py
* Update cli.py
* Update api_references.rst
* Update meta.py
* add deprecation tests
* debug standalone
* fix standalone tests
* Update CHANGELOG.md
2022-02-07 08:09:55 +00:00
115a5d08e8
Decouple utilities from `LightningLoggerBase` ( #11484 )
...
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-02-02 23:29:01 +01:00
e78d658c8d
Remove access to `_short_id` in NeptuneLogger ( #11517 )
2022-01-20 12:07:42 +00:00
3cc69f992b
Fixed NeptuneLogger when using DDP ( #11030 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-12-18 01:40:13 +00:00
ed84cef3af
Removed duplicated file extension when uploading model checkpoints with NeptuneLogger ( #11015 )
2021-12-11 00:03:12 +05:30
c6478414ee
Fixed uploading best model checkpoint in NeptuneLogger ( #10369 )
2021-12-01 13:58:54 +00:00
ce95891f6a
Update extensions doc ( #10778 )
...
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-11-29 20:38:23 +00:00
c395766300
use ModuleNotFoundError instead of ImportError ( #9867 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-10-11 05:57:37 +00:00
ee3787216a
Adapt `NeptuneLogger` to new `neptune-client` api ( #6867 )
...
* Initial split to NeptuneLegacyLogger and NeptuneLogger
* Adapt NeptuneLogger to neptune-pytorch-lightning repo version
* Fix stylecheck and tests
* Fix style and PR suggestions
* Expect Run object in NeptuneLogger.init
* Model checkpoint support and restructured tests
* Reformat code - use " instead of '
* Fix logging INTEGRATION_VERSION_KEY
* Update CHANGELOG.md
* Fix stylecheck
* Remove NeptuneLegacyLogger
* updated neptune-related docstrings
* PR suggestions
* update CODEOWERS file
* move import logic to imports.py
* minor neptune.py improvements
* formatting fixes and minor updates
* Fix generation of docs
* formatting fixes and minor updates
* fix
* PR fixes vol. 2
* define return type of _dict_paths method
* bump required version of `neptune-client`
* Enable log_* functions
* Update pytorch_lightning/loggers/neptune.py
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Revert "Enable log_* functions"
This reverts commit 050a436899b7f3582c0455dc27b171335b85a3a5.
* Make global helper lists internal
* Logger's `name` and `version` methods return proper results
* Initialize Run and its name and id at logger init level
* Make _init_run_instance static
* Add pre-commit hook code changes.
* Fix blacken-docs check
* Fix neptune doctests and test_all
* added docs comment about neptune-specific syntax
* added docs comment about neptune-specific syntax in the loggers.rst
* fix
* Add pickling test
* added myself to neptune codeowners
* Enable some of deprecated log_* functions
* Restore _run_instance for unpickled logger
* Add `step` parameter to log_* functions
* Fix stylecheck
* Fix checkstyle
* Fix checkstyle
* Update pytorch_lightning/loggers/neptune.py
Co-authored-by: thomas chaton <thomas@grid.ai>
* Fix tests
* Fix stylecheck
* fixed project name
* Fix windows tests
* Fix stylechecks
* Fix neptune docs tests
* docformatter fixes
* De-duplicate legacy_kwargs_msg
* Update .github/CODEOWNERS
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: kamil-kaczmarek <kamil.kaczmarek@neptune.ml>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-09-10 18:48:58 +02:00
6e124e7207
CI: precommit - docformatter ( #8584 )
...
* CI: precommit - docformatter
* fix deprecated
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-09-06 12:49:09 +00:00
e133061cd3
Add doc strings for Neptune logger ( #9111 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-08-27 08:45:52 +00:00
93784da2c3
Fix pre-commit blacken-docs failures ( #8624 )
2021-07-30 12:10:15 +00:00
a64cc37394
Replace `yapf` with `black` ( #7783 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-07-26 13:37:35 +02:00
03154eb30a
Refactor unnecessary `else` / `elif` when `if` block has a `return` statement ( #8156 )
...
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2021-06-28 15:27:41 +05:30
ac7d6a35c3
Fix `NeptuneLogger.log_text(step=None)` ( #7194 )
2021-04-26 15:28:55 +02:00
bc577ca792
fix duplicate console logging bug v2 ( #6275 )
...
Co-authored-by: chaton <thomas@grid.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-03-02 15:17:55 +05:30
4d96f19493
Document exceptions in loggers ( #6171 )
...
* Document exceptions in loggers
* minor formatting
* docstring changed in comet.py
* Apply suggestions from code review
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-02-25 21:08:32 +01:00
79d42d83e7
formatting 3/n: PL modules ( #5716 )
...
* cb
* log
* prof
* tune
* flake8
2021-02-08 14:28:38 -05:00
3ca1fbbf49
Ignore `step` param in Neptune logger's log_metric method ( #5510 )
...
* Ignore `step` param in Neptune logger's log_metric method
The `step` parameter is ignored because Neptune requires strictly increasing step values, a condition which is sometimes violated in Lighting e.g. when `fit()` and `test()` are called one after another on some models. `step` could be enabled again once Lightning guarantees that step values are always strictly increasing.
Also a minor bugfix: the `log_text()` method should use Neptune's `log_text()` method.
* Update neptune.py
* Update test_neptune.py
* Update test_all.py
* fix neptune tests
* add chlog
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
(cherry picked from commit 5d76b31881
2021-02-04 20:55:41 +01:00
59361d595a
fix Neptune logger creating multiple experiments when gpus > 1 ( #3256 )
...
* DP device fix
* potential fix
* fix merge
* update tests
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2021-02-04 20:55:40 +01:00
f782230412
docs cleaning - testcode ( #5595 )
...
* testcode - python
* revert
* simple
* testcode @rst
* pl
* fix
* pip
* update
* conf
* conf
* nn.
* typo
2021-01-26 04:44:54 -05:00
8629048659
Fix isort failures in loggers ( #5527 )
...
Remove from skipped module in pyproject.toml and fix failures on:
- pytorch_lightning/loggers/*.py
2021-01-15 22:53:56 +05:30
9610ea817b
refactor imports of logger dependencies ( #4860 )
...
* refactor imports of logger dependencies
* fix
* fix
* fix
* name
* fix
* mocks
* fix tests
* fix mlflow
* fix test tube
* fix wandb import check
* whitespace
* name
* name
* hack
* hack
* rev
* fix
* update mlflow import check
* try without installing conda dep
* .
* .
* .
* .
* .
* .
* .
* .
* .
Co-authored-by: Adrian Wälchli <adrian.waelchli@inf.unibe.ch>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
(cherry picked from commit ec0fb7a3ec
2021-01-06 15:16:06 +01:00
0f36525e8f
fix/enable - check F401 ( #5201 )
...
* refactor - check F401
* missed
* fix
2020-12-21 10:15:04 +01:00
2d9d7e4daa
Add prefix argument in loggers ( #4557 )
...
* Add prefix parameter in loggers
* chlog
* pep
* patch test
* remove args, access via self
* try fix the test
* try fix the test
* try fix the test
* prefix test
* fix assert has calls
fix assert call
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2020-11-22 06:38:58 +01:00
c208ac68c8
Added experiment_id to NeptuneLogger ( #3462 )
...
* 1) Added experiment_id to NeptuneLogger initialization input arguments.
2) Now function _create_or_get_experiment() overrides "experiment_name", "params", "properties", "tags".
* Added test case for existing experiment.
* Revert "Added test case for existing experiment."
This reverts commit 9f3ba2e37b
2020-11-16 23:50:23 +05:30
baa8558cc0
logger docs and api docs ( #3950 )
...
* logger and api docs
* remove gpu_usage_logger, lr_logger
* update docstring
* fix wandb example
* remove step result
* charts
* add some charts info
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
2020-11-13 20:35:54 +05:30
e0f8505394
Mocking loggers (part 2, neptune) ( #3617 )
...
* mock neptune base tests
* neptune doctest
* remove extra
* mock loggers
* typo
* mock import
* neptune not compatible with multigpu
* add back experiment
2020-10-04 21:20:06 -04:00
07b857769a
Allow kwargs in Wandb & Neptune + kwargs docstring ( #3475 )
...
* Allow kwargs in WandbLogger
* isort
* kwargs docstring
* typo
* kwargs for other loggers
* pep and isort
* formatting
* fix failing test
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2020-09-19 18:51:43 +02:00
f43028f3ae
added copyright notices ( #3062 )
2020-08-19 22:03:22 -04:00
1098a0d725
make loggers pickleable ( #2518 )
...
* state updates to logger
* change log
* changelog
2020-07-05 19:57:22 -04:00
e268061614
Pure package & base tests ( #2418 )
...
* base tests
* pil
* wip
* wip
* wip
* ignore
* ignore
* win
* link
* win
* cpu
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2020-06-30 19:35:54 -04:00
145670f893
fix logging on rank 0 only ( #2425 )
...
* fix and test for ddp block logging rank > 0
* rename
* use the dummy logger
* dummy logger test
* set the logger in model
* decorator for rank zero experiment
* simplify check
* simplify
* fix problem with None in checkpoint path
* revert configure logger
* unused import
* offline
* try rank 0 decorator in checkpoint
* try fix test
* imgs
* add asserts to make sure log zero only saves checkpoints
* add asserts to make sure log zero only saves checkpoints
* add asserts to make sure log zero only saves checkpoints
* add asserts to make sure log zero only saves checkpoints
* add asserts to make sure log zero only saves checkpoints
* fix tpu tests
* fix tpu tests
Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-06-30 18:09:16 -04:00
6456247287
Re-Enable Import Errors ( #1938 )
...
* update logger imports
* pep8 fixes
* pep8
2020-05-25 07:31:35 -04:00
0cb6767465
Fix NeptuneLogger to work in ddp mode ( #1753 )
2020-05-10 13:19:18 -04:00
f656882942
Fix typo ( #1750 )
2020-05-07 09:25:54 -04:00
58a467dd68
model checkpint on rank_zero_only & global rank state ( #1408 )
...
* try delete in async or DDP us0-ecase
* changelog
* add model chekpoint rank
* simple delete
* flake8
* use global rank
* chnagelog
* fix review
* fix import
* proposal
* proposal
* proposal
* improve proposal (fix problems with method call self)
* cleaning
Co-authored-by: Adrian Wälchli <adrian.waelchli@students.unibe.ch>
Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-04-24 17:21:00 -04:00
6e1d72d98a
Improved docs for Loggers ( #1484 )
...
* improve __init__
* improve logger base
* improve comet logger docs
* improved docs for mlflow
* improved nepune logger docs
* fix matplotlib import issue
* improve tensorboard docs
* improve docs for test tube
* improved trains logger docs
* improve wandb logger docs
* improved docs in experiment_logging.rst
* added MLflow to the list of loggers
* fix too long lines
* fix trains doctest
* fix neptune doctest
* fix mlflow doctest
* Apply suggestions from code review
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* Apply suggestions from code review
* fix whitespace
* try bypass mode for neptune (fix doctest api key error)
* try "test" as api key
* Revert "try "test" as api key"
This reverts commit fd77db26d551f08b4b4a12bb93cbd8f7a0814f29.
* try test as api key
* update neptune docs
* bump neptune minimal version
* revert unnecessary bypass code
* test if CI runs doctests in .rst files
* Revert "test if CI runs doctests in .rst files"
This reverts commit a45aeb460a8c4b7445a35dd7b49265f48d11c485.
* add doctest directive
* neptune demo links
* added tutorial link for W&B
* fix line too long
* fix merge error
* fix merge error
* add instructions how to install loggers
* add instructions how to install the loggers
* hide _abc_impl property from docs
* review Borda, 4 spaces
* indentation in example sections
* blank
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-04-16 12:04:12 -04:00
8322f1b039
neptune online ( #1499 )
2020-04-15 11:14:29 -04:00
b3fe17ddeb
fix flushing loggers ( #1459 )
...
* flushing loggers
* flushing loggers
* flushing loggers
* flushing loggers
* changelog
* typo
* fix trains
* optimize imports
* add logger test all
* add logger test pickle
* flake8
* fix benchmark
* hanging loggers
* try
* del
* all
* cleaning
2020-04-14 20:32:33 -04:00
792962ecc9
CI: Force docs warnings to be raised as errors (+ fix all) ( #1191 )
...
* add argument to force warn
* fix automodule error
* fix permalink error
* fix indentation warning
* fix warning
* fix import warnings
* fix duplicate label warning
* fix bullet point indentation warning
* fix duplicate label warning
* fix "import not top level" warning
* line too long
* fix indentation
* fix bullet points indentation warning
* fix hooks warnings
* fix reference problem with excluded test_tube
* fix indentation in print
* change imports for trains logger
* remove pandas type annotation
* Update pytorch_lightning/core/lightning.py
* include bullet points inside note
* remove old quick start guide (unused)
* fix unused warning
* fix formatting
* fix duplicate label issue
* fix duplicate label warning (replaced by class ref)
* fix tick
* fix indentation warnings
* docstring ticks
* remove obsolete docstring typing
* Revert "remove old quick start guide (unused)"
This reverts commit d51bb40695
2020-03-20 20:49:01 +01:00
01b8991c5a
Support hierarchical dict ( #1152 )
...
* Add support for hierarchical dict
* Support nested Namespace
* Add docstring
* Migrate hparam flattening to each logger
* Modify URLs in CHANGELOG
* typo
* Simplify the conditional branch about Namespace
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* Update CHANGELOG.md
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* added examples section to docstring
* renamed _dict -> input_dict
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-03-19 09:15:47 -04:00
22a7264e9a
improve partial Codecov ( #1172 )
...
* ignore in setup
* show report
* abs imports
* abstract pass
* cover loggers
* doctest trains
* locals
* pass
* revert tensorboard
* use tensorboardX
* revert tensorboardX
* fix trains
* Add TrainsLogger.set_credentials (#1179 )
* Add TrainsLogger.set_credentials to control trains server configuration and authentication from code. Sync trains package version.
Fix CI Trains tests
* Add global TrainsLogger set_bypass_mode (#1187 )
* Add global TrainsLogger set_bypass_mode skips all external communication
Co-authored-by: bmartinn <>
* rm some no-cov
Co-authored-by: Martin.B <51887611+bmartinn@users.noreply.github.com>
2020-03-19 09:14:29 -04:00
1a73fa0b03
change default logger to dedicated one ( #1064 )
...
Fix test
Fix format
Update pytorch_lightning/__init__.py
Separate imports
2020-03-17 18:44:00 -04:00
3ad6169f18
Neptune Logger Improvements ( #1084 )
...
* removed project and experiment from getstate
* added tests for closing experiment, updated token in example to user neptuner
* updated teoken
* Update neptune.py
added a link to example experiment
* added exmaple experiment link
* dropped duplication
* flake fixes
* merged with master, added changes information to CHANGELOG
2020-03-14 13:02:40 -04:00
ff1f8ef400
Test deprecated API for 0.8.0 and 0.9.0 ( #1071 )
...
* till 0.8
* refactor
* fix tests
* fix tests
* deprx till 0.9
* Update trainer.py
* Apply suggestions from code review
Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-03-06 21:36:44 +01:00
e586ed4767
hparams as dict [blocked by 1041] ( #1029 )
...
* hparams as dict
* hparams as dict
* fixing
* fixing
* fixing
* fixing
* typing
* typing
* chnagelog
* update set hparams
* use setter
* simplify
* chnagelog
* imports
* pylint
* typing
* Update training_io.py
* Update training_io.py
* Update lightning.py
* Update test_trainer.py
* Update __init__.py
* Update base.py
* Update utils.py
* Update test_trainer.py
* Update training_io.py
* Update test_trainer.py
* Update test_trainer.py
* Update test_trainer.py
* Update test_trainer.py
* Update callback_config.py
* Update callback_config.py
* Update test_trainer.py
Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-03-04 09:33:39 -05:00
f862d9f691
Logger tests and fixes ( #1009 )
...
* Refactor logger tests
* Update and add tests for wandb logger
* Update and add tests for logger bases
* Update and add tests for mlflow logger
* Improve coverage
* Updates
* Update CHANGELOG
* Updates
* Fix style
* Fix style
* Updates
2020-03-02 20:49:14 -05:00
Carlos Mocholí