6386b8d36b
Fix isort a few failures ( #5504 )
...
Remove from skipped module in pyproject.toml and fix failures on:
- pytorch_lightning/callbacks/*.py
- pytorch_lightning/cluster_environments/*.py
- pytorch_lightning/profiler/*.py
- pytorch_lightning/tuner/*.py
Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>
Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>
2021-01-15 17:44:27 -05:00
54d20dc596
Refactor: clean trainer device & distrib getters ( #5300 )
...
* warnings
* .
* .
* flake8
* .
* .
* .
* use_tpu
* use_dp
* .
* use_ddp
* .
* use_horovod
* .
* .
* .
2021-01-12 05:22:37 -05:00
957583544a
mark todo exceptions ( #5320 )
...
* mark todo exceptions
* .
* .
* .
* .
* .
* .
* .
* .
* try
* .
2021-01-04 09:07:56 +01:00
6d2aeff26a
fast_dev_run can be int ( #4629 )
...
* fast_dev_run can be int
* pep
* chlog
* add check and update docs
* logging with fdr
* update docs
* suggestions
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* fdr flush logs
* update trainer.fast_dev_run
* codefactor and pre-commit isort
* tmp
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Roger Shieh <sh.rog@protonmail.ch>
Co-authored-by: edenlightning <66261195+edenlightning@users.noreply.github.com>
2020-12-09 01:37:53 +05:30
cd90dd429b
Fix batch_arg_name bug ( #4812 )
...
Add `batch_arg_name` to all calls to `_adjust_batch_size`
2020-11-23 11:34:11 +05:30
4f3160ba2e
Skip tuner algorithms on fast dev ( #3903 )
...
* skip on fast dev
* fix error
* changelog
* fix recursive issue
* combine tests
* pep8
* move logic to base funcs
* fix mistake
* Update pytorch_lightning/tuner/lr_finder.py
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* pep
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Nicki Skafte <nugginea@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: chaton <thomas@grid.ai>
2020-11-10 00:34:42 +01:00
1396321b4d
Add fsspec to tuner ( #4458 )
...
* Add fsspec to tuner
* suggestions
* pathlib
* pep
* missed pep
2020-11-03 15:09:40 +05:30
d1234c592d
deprecate passing ModelCheckpoint instance to Trainer(checkpoint_callback=...) ( #4336 )
...
* first attempt
* update tests
* support multiple
* test bugfix
* changelog
* pep
* pep
* import order
* import
* improve test for resuming
* test
* update test
* add references test
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* docstring suggestion deprecation
Co-authored-by: Jeff Yang <ydcjeff@outlook.com>
* paramref
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jeff Yang <ydcjeff@outlook.com>
2020-10-30 04:47:37 +01:00
b459fd26ac
fix: `nb` is set total number of devices, when nb is -1. ( #4209 )
...
* fix: `nb` is set total number of devices, when nb is -1.
Refs: #4207
* feat: add test code
1. test combination `auto_select_gpus`, `gpus` options using
Trainer
2. test `pick_multiple_gpus` function directly
Refs: #4207
* docs: modify contents in `Select GPU devices`
Refs: #4207
* refactore: reflect the reuslt of review
Refs: #4207
* refactore: reflect the reuslt of review
Refs: #4207
* Update CHANGELOG.md
Co-authored-by: chaton <thomas@grid.ai>
Co-authored-by: Roger Shieh <55400948+s-rog@users.noreply.github.com>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
2020-10-29 10:50:37 +01:00
f37444fa3e
CI: add flake8 ( #4239 )
2020-10-19 21:20:17 +01:00
b45b57cc58
Use `Optional` for arguments set to `None` by default ( #4164 )
...
* Use `Optional` for variables set to `None` by default
* Use `Optional` instead of `Union[None, ...]` for consistency
2020-10-15 23:02:50 +02:00
6156125720
Minor fix to example in docstring of lr_finder ( #4104 )
...
Changed trainer.lr_find(...) to trainer.tuner.lr_find(...)
Co-authored-by: pbmstrk <pbmstrk@users.noreply.github.com>
2020-10-12 17:58:16 -04:00
05e0b4e5a1
Revert "Remove limitation of batch scaler ( #4006 )" ( #4040 )
...
This reverts commit 7e756ca11f
2020-10-09 21:03:23 -04:00
7e756ca11f
Remove limitation of batch scaler ( #4006 )
...
* working code
* add tests
* fix scaling
* move patch dataloader to utils
* renaming
* fix tests
* add changelog
* update docs
* pep8
2020-10-09 14:53:01 -04:00
8873750cf0
remove deprecated early_stop_callback ( #3982 )
2020-10-08 06:30:33 -04:00
4c0d063c86
outputs in __batch_end hooks ( #3966 )
...
* train_batch_end outputs
* added tests for the output hooks
2020-10-07 21:48:38 -04:00
186fc130cf
Minor formatting & grammar fixes in docs [CI SKIP] ( #3952 )
...
* Minor formatting & grammar fixes in docs
* Few more tentative doc fixes
2020-10-07 14:25:52 -04:00
b922409624
clean and organize fit ( #3938 )
...
* clean and organize fit
* clean and organize fit
* clean and organize fit
* clean and organize fit
* clean and organize fit
2020-10-07 11:04:10 -04:00
39b3704285
add current_epoch to dumped_params ( #3261 )
...
* add current epoch to __dumped_params
* log
* reset
* add to test
* Update CHANGELOG.md
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2020-10-06 19:54:48 +02:00
f745c4a773
doc update ( #3894 )
2020-10-06 09:13:29 -04:00
3ab43dd779
Fix lr finder for optimizers with states ( #3897 )
...
* fix lr finder
* changelog
* add test
2020-10-06 09:12:29 -04:00
e4e60e9b82
Add datamodule parameter to lr_find() ( #3425 )
...
* Add datamodule parameter to lr_find()
* Fixed missing import
* Move datamodule parameter to end
* Add datamodule parameter test with auto_lr_find
* Change test for datamodule parameter
* Apply suggestions from code review
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
* Fix lr_find documentation
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* formatting
* Add description to datamodule param in lr_find
* pep8: remove trailing whitespace on line 105
* added changelog
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
Co-authored-by: Nicki Skafte <nugginea@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-10-01 10:33:12 +02:00
1d7c615d82
cleaning up stale logger tests + flake8 ( #3490 )
...
* cleaning up stale logger tests
* cleaning up stale logger tests
* cleaning up stale logger tests
* cleaning up stale logger tests
* cleaning up stale logger tests
* cleaning up stale logger tests
2020-09-14 00:06:48 -04:00
cd16aa9854
ref: checkpoint connector methods 4/n ( #3474 )
...
* ref: checkpoint connector methods 4/n
* ref: checkpoint connector methods 4/n
* ref: checkpoint connector methods 4/n
* ref: checkpoint connector methods 4/n
* ref: checkpoint connector methods 4/n
* ref: checkpoint connector methods 4/n
* ref: checkpoint connector methods 4/n
* ref: checkpoint connector methods 4/n
* ref: checkpoint connector methods 4/n
2020-09-12 08:42:27 -04:00
3281586ab4
ref: organize args 3/n ( #3449 )
...
* ref: organize args 3/n
* ref: organize args 3/n
* ref: organize args 3/n
* ref: organize args 3/n
* ref: organize args 3/n
* ref: organize args 3/n
2020-09-10 13:21:04 -04:00
49290a569b
ref: organize args 1/n ( #3435 )
...
* ref: organize args 1/n
* ref: organize args 1/n
2020-09-10 07:24:42 -04:00
5abf7d9123
ref: move lr_finder ( #3434 )
...
* ref: move lr_finder
* ref: move lr_finder
* ref: move lr_finder
* ref: move lr_finder
* ref: move lr_finder
* ref: move lr_finder
* ref: move lr_finder
2020-09-09 22:12:27 -04:00
e245065fbc
limit auto scaling batch size to the size of the training dataset ( #3271 )
...
* fix
* fix and test
* fix merge error
* test for max dataset size
* changelog
* update docs
* fix merge
* unused imports
* imports
2020-09-09 10:51:43 +02:00
aaf26d70c4
ref: device parser ( #3400 )
...
* ref: train loop refactors part 2: 1/n
* ref: device parser
* ref: device parser
* ref: device parser
* ref: device parser
* ref: device parser
* ref: device parser
* ref: device parser
* ref: device parser
2020-09-08 18:46:42 -04:00
Arnaud Gelas