William Falcon
6517d1cf5c
Add files via upload
2020-05-12 07:46:55 -04:00
William Falcon
10b16dbfab
made ddp the default if no backend specified with multiple GPUs ( #1789 )
...
* made ddp the default if no backend specified with multiple GPUs
* fix
* spawn
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2020-05-12 06:54:23 -04:00
William Falcon
4b30ef6480
Device ( #1790 )
...
* added self.device
* added docs
2020-05-12 00:09:48 -04:00
Nicki Skafte
4970927ec8
Feature: auto scale batch size ( #1638 )
...
* auto batch finder
* fix styling
* add description
* add different modes
* fix copy paste error
* better organised code
* fix styling
* add tests
* fix
* fix
* add some documentation
* added CHANGELOG.md
* some documentation
* update based on review
* Update trainer.py
* Update docs/source/training_tricks.rst
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Update tests/trainer/test_trainer_tricks.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update tests/trainer/test_trainer_tricks.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* use EvalModelTemplate
* param tests
* rename
* wrap params
* rename function
* rename
* rename param
* fix
* abs
* rename
* refactor code
* add docs
* try
* arg
* loop
* exept
* loop
* drop bool
* docs
* docs
* added check and test for passing dataloader to fit
* styling fix
* update based on review
Co-authored-by: Nicki Skafte <nugginea@gmail.com>
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2020-05-09 08:28:36 -04:00
Shunta Komatsu
f656882942
Fix typo ( #1750 )
2020-05-07 09:25:54 -04:00
Adrian Wälchli
0cb58fbb4c
Mock packages for RTD docs build (follow up to doctests) ( #1739 )
...
* mock all packages on RTD
* update
2020-05-05 16:48:45 -04:00
Adrian Wälchli
a6de1b8d75
doctest for .rst files ( #1511 )
...
* add doctest to circleci
* Revert "add doctest to circleci"
This reverts commit c45b34ea911a81f87989f6c3a832b1e8d8c471c6.
* Revert "Revert "add doctest to circleci""
This reverts commit 41fca97fdcfe1cf4f6bdb3bbba75d25fa3b11f70.
* doctest docs rst files
* Revert "doctest docs rst files"
This reverts commit b4a2e83e3da5ed1909de500ec14b6b614527c07f.
* doctest only rst
* doctest debugging.rst
* doctest apex
* doctest callbacks
* doctest early stopping
* doctest for child modules
* doctest experiment reporting
* indentation
* doctest fast training
* doctest for hyperparams
* doctests for lr_finder
* doctests multi-gpu
* more doctest
* make doctest drone
* fix label build error
* update fast training
* update invalid imports
* fix problem with int device count
* rebase stuff
* wip
* wip
* wip
* intro guide
* add missing code block
* circleci
* logger import for doctest
* test if doctest runs on drone
* fix mnist download
* also run install deps for building docs
* install cmake
* try sudo
* hide output
* try pip stuff
* try to mock horovod
* Tranfer -> Transfer
* add torchvision to extras
* revert pip stuff
* mlflow file location
* do not mock torch
* torchvision
* drone extra req.
* try higher sphinx version
* Revert "try higher sphinx version"
This reverts commit 490ac28e46d6fd52352640dfdf0d765befa56988.
* try coverage command
* try coverage command
* try undoc flag
* newline
* undo drone
* report coverage
* review
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* remove torchvision from extras
* skip tests only if torchvision not available
* fix testoutput torchvision
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-05-04 22:16:54 -04:00
Adrian Wälchli
48e808c20e
Move generated RST files to subfolder ( #1555 )
...
* move generated files to subfolder
* remove if exists
* reformat argv
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* update rebase
* rebase yml
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: J. Borovec <jirka.borovec@seznam.cz>
2020-05-04 16:53:06 -04:00
Ryan Henderson
1a9f1c80a1
Fix example argument parser in docs ( #1692 )
...
[`parser.parse_known_args()`](https://docs.python.org/3.7/library/argparse.html#argparse.ArgumentParser.parse_known_args ) actually returns a tuple of the Namespace of known args and a list of unknown args. We only want the former.
2020-05-04 11:40:50 -04:00
Nicki Skafte
142bc0230e
Learning rate log callback ( #1498 )
...
* base implementation
* docs + implementation
* fix styling
* add lr string
* renaming
* CHANGELOG.md
* add tests
* Apply suggestions from code review
Co-Authored-By: Adrian Wälchli <aedu.waelchli@gmail.com>
* Apply suggestions from code review
* Update pytorch_lightning/callbacks/lr_logger.py
* Update pytorch_lightning/callbacks/lr_logger.py
* add test for naming
* base implementation
* docs + implementation
* fix styling
* add lr string
* renaming
* CHANGELOG.md
* add tests
* Apply suggestions from code review
Co-Authored-By: Adrian Wälchli <aedu.waelchli@gmail.com>
* Apply suggestions from code review
* Update pytorch_lightning/callbacks/lr_logger.py
* Update pytorch_lightning/callbacks/lr_logger.py
* add test for naming
* Update pytorch_lightning/callbacks/lr_logger.py
Co-Authored-By: Adrian Wälchli <aedu.waelchli@gmail.com>
* suggestions from code review
* fix styling
* rebase
* fix tests
Co-authored-by: Nicki Skafte <nugginea@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2020-04-30 08:06:41 -04:00
weipengOO98
2ec8d61e94
Update new-project.rst ( #1655 )
...
fix a typo
2020-04-30 07:58:42 -04:00
Jacob Zhong
9b86aea98b
Update docs ( #1656 )
...
* edit doc
mentioned in #646
* edit doc
* underline
* class reference
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2020-04-29 12:55:06 +00:00
William Falcon
a258d3d31b
fixed val_loss for early stopping
2020-04-26 12:27:19 -04:00
William Falcon
198d7715ee
docs clean up
2020-04-26 11:06:36 -04:00
William Falcon
d2b94ca81b
clean up docs ( #1614 )
...
* fixed hparams section
* docs clean up
2020-04-26 10:57:26 -04:00
William Falcon
4755ded863
Clean up Argparse interface with trainer ( #1606 )
...
* fixed distutil parsing
* fixed distutil parsing
* Apply suggestions from code review
* log
* fixed distutil parsing
* fixed distutil parsing
* fixed distutil parsing
* fixed distutil parsing
* doctest
* fixed hparams section
* fixed hparams section
* fixed hparams section
* formatting
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: J. Borovec <jirka.borovec@seznam.cz>
2020-04-26 09:20:06 -04:00
William Falcon
e684fdf60b
Clean docs ( #1604 )
...
* spacing
* slurm docs
2020-04-25 13:21:53 -04:00
William Falcon
cbd088bd13
multi processing warnings ( #1602 )
...
* multi processing warnings
* multi processing warnings
* multi processing warnings
* multi processing warnings
* multi processing warnings
* multi processing warnings
2020-04-25 10:03:02 -04:00
William Falcon
d0faf97893
fixed dataset stuff + docs ( #1599 )
...
* Fixed dataset docs and disabled auto-sampler for iterable dataset
2020-04-24 16:51:26 -04:00
Adrian Wälchli
d56b3e5e69
update contributers list ( #1597 )
2020-04-24 14:46:17 -04:00
Adrian Wälchli
3e8f2d99a9
Progress bar callback ( #1450 )
...
* squash and rebase
sanity check hooks
sanity check callback hook finish
moved core progress bar functionality into callback
wip
remove duplicate merge
clean up
imports
docs
sanity check progress bar main
sanity
move callback calls
init progrss bar callback
configuration and docs
changelog
rate decorator
pass process_position
disable on rank > 0
position index
is_enabled
remove decorator
refactor init tqdm bars
callback method ordering
cannot reset when disabled
sequence -> list
default values
fix has no attr _time()
move on_val_end to proper place
fix the pickle issue
update warning
properties
check for None
remove old comment
switch order
pull out non-tqdm functionality into base class
documentation for the base class
docs
fix refresh rate issue in validation
restrict type hint of trainer arg
more docs
update trainer docs
rst docs
fix lines too long
fix test
add missing type hints
fix typo
move docstring to __init__ solves doctest failures
remove doctest :(( can't fix the pickle error
fix example
simplify by saving trainer reference
fix docs errors
move docstring
initial value
multiple val checks per epoch
simpler handling of inf dataset sizes
update inf docs
renamed training_tqdm_dict
rename get_tqdm_dict
rename occurences of tqdm
update changelog
fix doctest
fix formatting errors
added callback tests
progress bar on off test
more tests for progress bar
weird test fix?
add ignored property
disable default progress bar in LR finder
change enable/disable behavior
trying doctest in CI again
undo doctest pickle error
undo doctest pickle error :((
remove progress_bar_callback Trainer arg and fix tests
restore progress bar after auto lr find
update docs
fix rebase
fix wrong negation
* fix fast dev run total
* more thorough testing
* remove old args
* fix merge
* fix merge
* separate tests
* type hint total batches
* reduce if
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* is_disabled
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* is_enabled
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* rename enabled/disabled
* move deprecated api
* remove duplicated test from merge
* fix rename is_disabled
* newline
* test also testprogress for fast dev run
Co-authored-by: J. Borovec <jirka.borovec@seznam.cz>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-04-23 20:46:18 -04:00
Travis Addair
7024177f7d
Added Horovod distributed backend ( #1529 )
...
* Initial commit of Horovod distributed backend implementation
* Update distrib_data_parallel.py
* Update distrib_data_parallel.py
* Update tests/models/test_horovod.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* Update tests/models/test_horovod.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* Fixed tests
* Added six
* tests
* Install tox for GitHub CI
* Retry tests
* Catch all exceptions
* Skip cache
* Remove tox
* Restore pip cache
* Remove the cache
* Restore pip cache
* Remove AMP
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: J. Borovec <jirka.borovec@seznam.cz>
2020-04-22 17:39:08 -04:00
Justus Schock
29c7d2f195
Revert namespace package search to normal package search ( #1545 )
...
* Revert this
* typos
* version++
Co-authored-by: J. Borovec <jirka.borovec@seznam.cz>
2020-04-21 08:26:47 -04:00
Jirka Borovec
bd168819f2
fix changelog ( #1452 )
...
* fix changelog
* formatting
* add ddp_cpu
* docs
* add another
2020-04-20 17:36:26 -04:00
William Falcon
3ddf3f1fb4
change name ( #1519 )
2020-04-17 14:45:23 -04:00
Adrian Wälchli
2ab2f7d08d
Improved docs for pytorch_lightning.core (continued) ( #1483 )
...
* improved docs for core
update links
add references to hooks lifecycle
wip
continue with __init__.py
improve docs for memory.py
improve docs for saving.py
simpler links
fix formatting
* move hooks lifecycle to top of file
* fix doctest import problem
* add missing hook in lifecycle
2020-04-16 12:04:55 -04:00
Adrian Wälchli
6e1d72d98a
Improved docs for Loggers ( #1484 )
...
* improve __init__
* improve logger base
* improve comet logger docs
* improved docs for mlflow
* improved nepune logger docs
* fix matplotlib import issue
* improve tensorboard docs
* improve docs for test tube
* improved trains logger docs
* improve wandb logger docs
* improved docs in experiment_logging.rst
* added MLflow to the list of loggers
* fix too long lines
* fix trains doctest
* fix neptune doctest
* fix mlflow doctest
* Apply suggestions from code review
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* Apply suggestions from code review
* fix whitespace
* try bypass mode for neptune (fix doctest api key error)
* try "test" as api key
* Revert "try "test" as api key"
This reverts commit fd77db26d551f08b4b4a12bb93cbd8f7a0814f29.
* try test as api key
* update neptune docs
* bump neptune minimal version
* revert unnecessary bypass code
* test if CI runs doctests in .rst files
* Revert "test if CI runs doctests in .rst files"
This reverts commit a45aeb460a8c4b7445a35dd7b49265f48d11c485.
* add doctest directive
* neptune demo links
* added tutorial link for W&B
* fix line too long
* fix merge error
* fix merge error
* add instructions how to install loggers
* add instructions how to install the loggers
* hide _abc_impl property from docs
* review Borda, 4 spaces
* indentation in example sections
* blank
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-04-16 12:04:12 -04:00
Nicki Skafte
3f1e4b953f
fix lr scheduler docs ( #1446 )
...
Co-authored-by: Nicki Skafte <nugginea@gmail.com>
2020-04-10 16:14:51 -04:00
Nicki Skafte
3f09b32df3
Learning Rate finder ( #1347 )
...
* initial structure
* rebase
* incorporate suggestions
* update CHANGELOG.md
* initial docs
* fixes based on reviews
* added trainer arg
* update docs
* added saving/restore of model state
* initial tests
* fix styling
* added more tests
* fix docs, backward compatility and progressbar
* fix styling
* docs update
* updates based on review
* changed saving to standard functions
* consistent naming
* fix formatting
* improve docs, added support for nested fields, improve codecov
* update CHANGELOG.md
* Update lr_finder.rst
* Update pytorch_lightning/trainer/trainer.py
* Update trainer.py
* Update CHANGELOG.md
* Update path
* restoring
* test
* attribs
* docs
* doc typo
Co-authored-by: Nicki Skafte <nugginea@gmail.com>
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: J. Borovec <jirka.borovec@seznam.cz>
2020-04-10 14:34:23 -04:00
William Falcon
5b2351cbb9
added slurm doc ( #1418 )
...
* added slurm doc
* added slurm doc
2020-04-08 14:43:50 -04:00
William Falcon
7d0c2c7db8
Loader docs ( #1416 )
...
* added multiple loader docs
* added multiple loader docs
* added multiple loader docs
* added multiple loader docs
* added multiple loader docs
* Apply suggestions from code review
* added multiple loader docs
* added build docs script
* typo
* added build docs script
* added build docs script
* added build docs script
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: J. Borovec <jirka.borovec@seznam.cz>
2020-04-08 11:38:12 -04:00
david-alexander-white
d8cbf8d60c
updated early stopping docs ( #1410 )
...
* remove incorrect comment in training_step
* added comment for on_batch_start in hooks.py
* update early stopping docs
* typo fix
* whitespace fix
* Apply suggestions from code review
* Update docs/source/early_stopping.rst
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-04-08 08:38:53 -04:00
Adrian Wälchli
471499cd78
Temporary Fix for docs build failure ( #1413 )
...
* Update requirements.txt
* fix SG typo
Co-authored-by: J. Borovec <jirka.borovec@seznam.cz>
2020-04-08 08:18:36 -04:00
Jirka Borovec
466655bcda
release update ( #1405 )
...
* exclude tests
* compress image
* compress image
* update Manifest
* update action
2020-04-07 14:04:32 -04:00
Adrian Wälchli
5f6be4dd53
Pin sphinx version (fix for current docs build errors) ( #1382 )
...
* Update requirements.txt
* Update docs/requirements.txt
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* freeze sphinx version
* Update docs/source/conf.py
Co-Authored-By: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: J. Borovec <jirka.borovec@seznam.cz>
2020-04-06 06:42:33 +00:00
Adrian Wälchli
b358714a9a
Adding Intersphinx documentation links ( #1369 )
...
* added intersphinx links for base packages
* remove comment
2020-04-05 11:11:58 -04:00
Jeremy Jordan
38c56081ac
fix docs on saving checkpoints manually ( #1373 )
2020-04-05 11:10:44 -04:00
Adrian Wälchli
1f2da71069
Improved docs for callbacks ( #1370 )
...
* improved docs for callbacks
* class references
* make doctest pass
* doctests
* fix lines too long
* fix line too long
* fix permission error in doctest
* Apply suggestions from code review
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* fix doctest
* fix default
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-04-05 09:38:52 +00:00
William Falcon
e68ba1c836
added warnings to unimplemented methods ( #1317 )
...
* added warnings and removed default optimizer
* opt
* Apply suggestions from code review
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-04-03 15:06:51 -04:00
Ethan Harris
ddb59130f8
Fix iterable dataset docs ( #1342 )
2020-04-02 11:51:43 -04:00
Adrian Wälchli
1aba411da9
Early stopping when validation is disabled ( #1235 )
...
* early stop fallback to train epoch
* added test
* fix imports
* update docs
* update changelog
* fix typo
2020-03-31 06:24:26 +00:00
William Falcon
31a658e558
made load from checkpoint flexible ( #1307 )
...
* made load from checkpoint flexible
* made load from checkpoint flexible
* made load from checkpoint flexible
2020-03-30 18:28:51 -04:00
Paweł Rzepiński
b74a3c5106
Fix training resuming docs ( #1265 )
2020-03-29 15:29:48 -04:00
Donal Byrne
fb42872259
Update docs iterable datasets ( #1281 )
...
* Updated Sequencial Data docs
* Sequntial Data section now contains info on using IterableDatasets
* * Undid reformatting of bullet points
* * added information about val_check_interval
Co-authored-by: Donal Byrne <Donal.Byrne@xperi.com>
2020-03-29 15:29:09 -04:00
Justus Schock
4e0d0ab8d2
Update Contributors ( #1274 )
...
* Update Contributors in Readme
* Update Governance
2020-03-28 16:09:00 -04:00
Adrian Wälchli
0b0180406b
Fix outdated docs follow up ( #1266 )
...
* save_top_k
* num_gpus
* print_nan_grads fix leftovers
* undo doctest removal
2020-03-28 11:30:57 -04:00
Jirka Borovec
da185342ce
update contrib list ( #1241 )
...
Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-03-27 08:42:14 -04:00
Tyler Yep
6772e0c197
Remove unnecessary parameters to super() in documentation and source code ( #1240 )
...
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-03-27 12:36:50 +00:00
Jeremy Jordan
d394b80ac8
calling self.forward() -> self() ( #1211 )
...
* self.forward() -> self()
* update changelog
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-03-27 08:17:56 +01:00
Adrian Wälchli
2a4cd479e2
Disable validation when val_percent_check=0 ( #1251 )
...
* fix disable validation
* add test
* update changelog
* update docs for val_percent_check
* make "fast training" docs consistent
2020-03-27 02:07:22 +00:00