* Change trainer loading behaviour for validate/test/predict
* Fix
* Fix/add tests
* remove
* Cleanups
* Space
* cleanups
* Add CHANGELOG.md
* Move after setup
* Cleanups on logic
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Remve
* fix test
* feedback
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update pytorch_lightning/trainer/properties.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Feedback
* Same fix
* Same fix
* Add test for behaviour, modify based on feedback
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Wording
* Apply suggestions from code review
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Cleanup docs
* Update pytorch_lightning/trainer/trainer.py
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
* feedback
* Fixes to test API
* Add carlos description
* Move logic further
* Move checkpoint connector logic
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
* v1.4.0rc2
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Apply suggestions from code review
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* Support `DataLoader`s with missing arguments in `replace_sampler`
* Fix for multiprocessing context
* Fixes and test improvements
* Fixes and test improvements
* Fixes and test improvements
* Test any variadic name
* Update CHANGELOG
* Make sure extra attributes can be present
* Skip on old Windows
* Update pytorch_lightning/trainer/data_loading.py
* Update pytorch_lightning/trainer/data_loading.py
* Check is dataloader
* Typo
* reduce memory leak
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update changelog
* Apply suggestions from code review
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
* resolve flake8
* update on comments
* resolve bug
* update
* Undo whitespace changes
* remove bug
* resolve flake8
* revert change
* update on comments
* delete the ddp wrapper as it hold memory
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* resolve flake8
* update on comments
* update changelog
* resolve test
* Update CHANGELOG
* Refactor teardown
* Fix comment
* Do it for non-gpu too
* remove ref when the model is not a lightning_module
* Fix import error
* move down
* resolve bug
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* resolve assignement
* update
* move above
* Fix device calls to support tpu training
* Updat todo
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Remove error, add mixed to check
* Add test
* Remove test
* Add changelog
* Add test for mixed
* Update tests/plugins/test_deepspeed_plugin.py
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Add special
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* resolve issues
* update
* update
* update
* add more exceptions
* resolve bug
* update
* update
* update changelog
* resolve bug
* resolve comments
* update
* update
* update changelog
* update
* update
* remove space
* update
* add progress tracking to loops
* validate json
* update
* convert to dict for better readability
* validate reload
* update
* update
* update on comments
* remove deadcode
* clean changelog
* clean changelog
* update
* update on comments
* CHANGELOG
* CHANGELOG
* Update pytorch_lightning/loops/base.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* whitespace suggestions
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* make fault_tolerant_enabled protected
* whitespace fixes around Args
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
* typo it's -> its
* fix copy-paste typo in progress docstring
* Delete classes
* Minor change
* docs
* protected get_loops_state
* merge restore_loops with restore_progress
* Fix tests after removals
* explicit save with trainer.save_checkpoint()
* handle optimization restart based on optimizer_idx
* update increments
* update val batch progress and remove iteration count
* update progress tracking for dataloader loops
* remove self.dataloader_idx from eval_epoch_loop
* add batch progress to predict loop
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* incorporate progress tracking for current_epoch
* Fix test
* Actually remove it
* Remove unused TrainingEpochProgress
* Fix optimization progress - missing scheduler
* Restarting changes
* Scheduler progress
* Unused property, reset on epoch
* Resolve FIXME
* Remove FIXME
* fix test_progress (wip)
* fix batch_progress.current.reset
* Hold off on split progress. Out of scope of this PR
* Unnecessary if
* fix structure in test_progress
* structure
* clean up unused variables in test_progress
* refactor naming and organization in test_progress
* Unnecessary variable
* Remove unnecessary diff
* Improve comment
* Undo typing change to avoid polluting everything with mypy fixes
* Fix and improve test_loops.py
* Fix and organize `test_loop_state_dict`
* Remove unnecessary checks in test
* Update test after disallowing updates on None attributes
* Typing
* Minor test cleanup
* Fix and move loop test
* Move test from progress to loops
* Reset the scheduler progress
* SchedulerProgress fix
* Consistent whitespace
* Fix final test
* Minor test changes
* One test to rule them all
* Formatting
* Rename and clean variables
* Shorter names
* Shorter scheduler name
* Fix optimizer step calculation for stop_batch=2
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Remove empty connects
* Update CHANGELOG
* Holy shit finally got the formula right
* Fix final thing!!!
* Do not check state dicts
* parametrize multiple_dataloader progress test
* Update CHANGELOG.md
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Justus Schock <justus.schock@posteo.de>
* expose extract_batch and make public
* first pass
* early return
* add changelog
* move to utilities/data.py
* add test_data.py
* tests are passing
* precommit hook
* address pep8 failure
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Carlos Mocholí