74d79e7e0e
Raise an exception if check_val_every_n_epoch is not an integer ( #6411 )
...
* raise an exception if check_val_every_n_epoch is not an integer
* remove unused object
* add type hints
* add return type
* update exception message
* update exception message
2021-03-10 12:08:53 +05:30
615b2f7363
Improve DummyLogger ( #6398 )
...
* fix dummy logger
* docs
* update docs
* add changelog
* add none return annotation
* return empty string for name, version
2021-03-09 23:18:38 +00:00
30d649b9a7
[changelog] Update Changelog on release v1.2.3 ( #6444 )
...
* update changelog
* legacy 1.2.3
Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>
2021-03-09 15:17:36 -08:00
55dd3a4c64
Typing for tests 1/n ( #6313 )
...
* typing
* yapf
* typing
2021-03-09 11:27:15 +00:00
fc6d402733
fix logger creating directory structure too early in DDP ( #6380 )
...
* fix
* add simple test
* fix imports
* add changelog
* tighter test with on_fit_start hook closer to the dispatch call
* move class inside test f unction
* add a comment
2021-03-09 09:49:59 +00:00
75c6486ac7
update ( #6403 )
2021-03-09 09:47:51 +00:00
523c59bfdd
fixed bug where tuner would not tune lr if also tuning batch_size ( #4688 )
...
* fixed bug where tuner would not tune lr if also tuning batch_size
* added a '+1' to computing the smoothed loss. This maintains the behavior for the smoothed loss as before the bug fix
* pep8 fix
* add changelog
Co-authored-by: chaton <thomas@grid.ai>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-03-09 08:30:06 +08:00
9eded7fd73
Add check for verbose attribute of ModelCheckpoint ( #6419 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-03-09 00:24:29 +01:00
e1f5eacab9
fix dp reduction test ( #6404 )
...
* fix
* update
* fix
* move the class outside
2021-03-08 18:11:20 +00:00
efd272a3ca
Pass {fit,validate,test,predict} to setup() and teardown() ( #6386 )
2021-03-08 15:27:07 +01:00
8dabc30bfc
Run CI ( #6402 )
2021-03-08 08:12:33 +01:00
a6c98c4e49
Fix AttributeError: 'NoneType' object has no attribute 'finalize' on TPU ( #6221 )
...
* Fix bug
Fix AttributeError: 'NoneType' object has no attribute 'finalize'
* Update CHANGELOG.md
* deleted a period
* Update CHANGELOG.md
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
* Update CHANGELOG.md
* Update pytorch_lightning/plugins/training_type/tpu_spawn.py
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-03-08 02:11:07 +00:00
0ec7a23a1e
update python version ( #6399 )
2021-03-08 10:08:28 +08:00
718074b99a
Fix trainer not resetting lightning_optimizers ( #6372 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-03-08 09:58:03 +08:00
ff16104927
Update TBLogger docs ( #6315 )
...
* Update tensorboard.py
* Update logging.rst
* pep8
* Update logging.rst
* Update logging.rst
* Apply suggestions from code review
* add code sample
* Update logging.rst
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-03-08 01:17:49 +00:00
826375effe
Fix ModelCheckpoint(monitor=None, save_last=True) not saving checkpoints ( #6136 )
...
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2021-03-08 00:59:14 +01:00
c7f30a204c
[doc] Fix closure in manual optimization ( #6374 )
...
* Fix manual optimization docs
* Fix typo. Thanks @import-antigravity
2021-03-07 13:34:51 +01:00
2708c3993d
[doc] Improve Multiple Val/Test Dataloaders with simultaneous batches option ( #6320 )
...
* improve doc to describe how to combine batches of multiple test and val dataloaders simultaneously
* fix typo
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* use paramref
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-03-07 11:24:19 +00:00
38a5fe7af1
Remove optimizer_idx arg in manual optimization ( #6093 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: chaton <thomas@grid.ai>
2021-03-07 08:48:50 +01:00
966184a452
Update Sharded test with RunIf ( #6384 )
2021-03-07 00:24:34 +01:00
34b733b35e
Fix manual optimization in pl_example ( #6373 )
...
* Fix automatic_optimization
* Fix automatic_optimization
* Uncomment fairscale
2021-03-06 18:28:37 +01:00
facfda85f1
Remove no return warning from val/test step ( #6139 )
...
* remove warning
* auto_opt
* chlog
* auto_opt
* no_warning_call
* rm old code
* add warning for predict
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-03-06 17:15:21 +00:00
217470b41f
Use f-"""-string in a Trainer comment ( #6377 )
...
* Use f-"""-string
* Add r
* Use Trainer.
* r -> noqa: W605
2021-03-06 22:24:05 +05:30
85c8074bee
require: adjust versions ( #6363 )
...
* adjust versions
* release
* manifest
* pep8
* CI
* fix
* build
2021-03-06 14:34:54 +01:00
d0596fac94
Refactor RunningStage usage in advance of implementing Trainer.validate() ( #4945 )
...
* Update code
Co-authored-by: EliaCereda
* More property updates
* Move properties. Introduce trainer._fitting
* Use trainer.fitting
* Fix reset dataloaders
* Unused code
* RunningStage.SANITY_CHECKING
* Use setters
* Fix bugs
* Fix bugs
* TrainerState.{FITTING,VALIDATING,TESTING,PREDICTING,TUNING}
* Fix bugs
* Fix bugs
* Fix tests
* Update CHANGELOG. Add deprecation warning. Fix tests
* Unused imports
* Optional trainer
* More deprecation. More refactoring
* Correct version
* Use properties
* Address comments
* flake8
* Missed renamings
* Typo
* is -> ==
It is recommended to use for Enums since they are singletons, however, since the LightningEnum subclasses str, it's not a good idea in case a user sets the state/stage with a str
* Also for tests
* Typo
* Address @tchaton's comments
* PEP8
* Correct property
* Update CHANGELOG
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Update pytorch_lightning/trainer/trainer.py
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Remove called sanity check
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-03-06 12:40:19 +00:00
4f391bce7c
give a more complete GAN example ( #6294 )
2021-03-05 17:54:09 -05:00
2a3ab67946
fix importing torchtext batch ( #6365 )
...
* copy torchtext batch
* update
* rev
* rev
2021-03-05 21:39:52 +01:00
2ec67a48b3
[bug] Fix Pytorch profiler with emit_nvtx ( #6260 )
...
* resolve bug
* update changelog
* Update tests/trainer/test_trainer.py
* Update pytorch_lightning/profiler/profilers.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* resolve comments
* resolve flake8
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-03-05 21:12:03 +01:00
e84854264f
CI: fix examples - patch download MNIST ( #6357 )
...
* patch download
* CI
* isort
* extra
2021-03-05 16:50:21 +00:00
b6aa350fb2
Update changelog for v1.2.2 ( #6325 )
...
* update changelog for v1.2.2
* ckpr 1.2.2
Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>
2021-03-05 15:57:50 +00:00
46540ee260
[bugfix] Resolve memory leak for evaluation ( #6326 )
...
* resolve bug
* resolve flake8
* revert name
2021-03-05 16:52:56 +09:00
ec8d46e02b
introduce default cluster environment for lightning-specific ddp ( #5915 )
...
* handle distributed_sampler_kwargs
* move emptying cache to accelertor
* fix a few tests
* restoring the result from subprocess
* fix queue.get() order for results
* add missing "block_backward_sync" context manager
* add missing "block_backward_sync" context manager
* fix sync_batchnorm
* fix supported gpu-ids for tuple
* fix clip gradients and inf recursion
* accelerator selection: added cluster_environment plugin
* fix torchelastic test
* fix reduce early stopping decision for DDP
* fix tests: callbacks, conversion to lightning optimizer
* fix lightning optimizer does not pickle
* fix setting benchmark and deterministic option
* fix slurm amp test
* fix prepare_data test and determine node_rank
* fix retrieving last path when testing
* remove obsolete plugin argument
* fix test: test_trainer_config
* fix torchscript tests
* fix trainer.model access
* move properties
* fix test_transfer_batch_hook
* fix auto_select_gpus
* fix omegaconf test
* fix test that needs to simulate slurm ddp
* add horovod plugin
* fix test with named arguments
* clean up whitespace
* fix datamodules test
* remove old accelerators
* fix naming
* move old plugins
* move to plugins
* create precision subpackage
* create training_type subpackage
* fix all new import errors
* fix wrong arguments order passed to test
* fix LR finder
* Added sharded training type and amp plugin
* Move clip grad to precision plugin
* Added sharded spawn, select accelerators based on distributed_backend + enable custom fp16 plugin automatically
* Fix import issue, attempting to fix tests
* Fix initial test
* Reflect hook logic from master, should wrap model after move to device
* Optional state consolidation, since master has optimizers not wrapped
* change attribute for instance test
* reset optimizers
optimizers are not used in main process, so state would be wrong.
* legacy
* imports in accel
* legacy2
* trainer imports
* fix import errors after rebase
* move hook to new setup location
* provide unwrapping logic
* fix trainer callback system
* added ddp2 implementation
* fix imports .legacy
* move plugins
* restore legacy
* drop test.py from root
* add tpu accelerator and plugins
* fixes
* fix lightning optimizer merge
* reset bugreportmodel
* unwrapping
* step routing forward
* model access
* unwrap
* opt
* integrate distrib_type
* sync changes
* sync
* fixes
* add forgotten generators
* add missing logic
* update
* import
* missed imports
* import fixes
* isort
* mv f
* changelog
* format
* move helper to parallel plugin
* d
* add world size
* clean up
* duplicate
* activate ddp_sharded and tpu
* set nvidia flags
* remove unused colab var
* use_tpu <-> on_tpu attrs
* make some ddp_cpu and clusterplugin tests pass
* Ref/accelerator connector (#5742 )
* final cleanup
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* connector cleanup
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* trainer cleanup
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* accelerator cleanup + missing logic in accelerator connector
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add missing changes to callbacks
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* reflect accelerator changes to lightning module
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* clean cluster envs
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* cleanup plugins
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add broadcasting
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* yapf
* remove plugin connector
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* plugins
* manual optimization
* update optimizer routing
* add rank to torchelastic
* fix memory mixed precision
* setstate on trainer for pickling in ddp spawn
* add predict method
* add back commented accelerator code
* adapt test for sync_batch_norm to new plugin
* fix deprecated tests
* fix ddp cpu choice when no num_processes are given
* yapf format
* skip a memory test that cannot pass anymore
* fix pickle error in spawn plugin
* x
* avoid
* x
* fix cyclic import in docs build
* add support for sharded
* update typing
* add sharded and sharded_spawn to distributed types
* make unwrap model default
* refactor LightningShardedDataParallel similar to LightningDistributedDataParallel
* update sharded spawn to reflect changes
* update sharded to reflect changes
* Merge 1.1.5 changes
* fix merge
* fix merge
* yapf isort
* fix merge
* yapf isort
* fix indentation in test
* copy over reinit scheduler implementation from dev1.2
* fix apex tracking calls with dev_debugger
* reduce diff to dev1.2, clean up
* fix trainer config test when gpus>0 and num_processes >0 and ddp_cpu
* sort plugin tests legacy/new
* fix error handling for amp on cpu
* fix merge
fix merge
fix merge
* [Feat] Resolve manual_backward (#5837 )
* resolve manual_backward
* resolve flake8
* update
* resolve for ddp_spawn
* resolve flake8
* resolve flake8
* resolve flake8
Co-authored-by: Ubuntu <ubuntu@ip-172-31-88-60.ec2.internal>
* fix tests/accelerator tests on cpu
* [BugFix] Resolve manual optimization (#5852 )
* resolve manual_optimization
* update
* update
Co-authored-by: Ubuntu <ubuntu@ip-172-31-88-60.ec2.internal>
* Remove copy trainer parameters to happen earlier within the loop and add safe guard to get ref model (#5856 )
* resovle a bug
* Accelerator refactor sharded rpc (#5854 )
* rpc branch
* merge
* update handling of rpc
* make devices etc. Optional in RPC
* set devices etc. later if necessary
* remove devices from sequential
* make devices optional in rpc
* fix import
* uncomment everything
* fix cluster selection
Co-authored-by: Ubuntu <ubuntu@ip-172-31-88-60.ec2.internal>
* resolve bug
* fix assert in rpc test
* resolve a test
* fix docs compilation
* accelerator refactor - fix for sharded parity test (#5866 )
* fix memory issue with ddp_spawn
* x
x
x
x
x
x
x
x
x
* x
* Remove DDP2 as this does not apply
* Add missing pre optimizer hook to ensure lambda closure is called
* fix apex docstring
* [accelerator][BugFix] Resolve some test for 1 gpu (#5863 )
* update
* revert init
* resolve a bug
* update
* resolve flake8
* update
* update
* update
* revert init
* resolve a bug
* update
* resolve flake8
* update
* update
* update
* update
* update
* revert init
* resolve a bug
* update
* resolve flake8
* update
* update
* update
* revert init
* update
* resolve flake8
* update
* update
* update
* update
* update
* all_gather
* update
* make plugins work, add misconfig for RPC
* update
* update
* remove breaking test
* resolve some tests
* resolve flake8
* revert to ddp_spawn
Co-authored-by: root <root@ip-172-31-88-60.ec2.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-88-60.ec2.internal>
Co-authored-by: Justus Schock <justus.schock@rwth-aachen.de>
* yapf isort
* resolve flake8
* fix apex doctests
* fix apex doctests 2
* resolve docs
* update drone
* clean env
* update
* update
* update
* update
* merge
* Fix RPC related tests, clean out old API, update for new accelerator API [skip ci] (#5881 )
* Fix RPC related tests, clean out old API, update for new accelerator API
* Move tests out of legacy folder, update paths and names
* Update test_remove_1-4.py
* Expose properties for tpu cores/gpus/num_gpus
* Add root GPU property
* Move properties to properties.py
* move tests that were previously in drone
* Fix root GPU property (#5908 )
* Move root GPU to property, remove horovod set as this is handled in horovod plugin, ensure we mock correctly to set GPU accelerator
* Add missing tests back
* fix best model path transfer when no checkpoint callback available
* Fix setup hook order [wip] (#5858 )
* Call trainer setup hook before accelerator setup
* Add test case
* add new test
* typo
* fix callback order in test
Co-authored-by: tchaton <thomas@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* rename ddp sequential -> rpc sequential for special test
* revert
* fix stupid merge problem
* abstract the cluster plugins
* default plugin
* integrate default environment
* fix property
* adapt tests
* adjust test
* fix world size access
* base cluster env
* revert rebase errors
* revert rebase errors
* missing import
* revert unrelated change
* remove unused cluster local rank
* remove unrelated changes
* fix unrelated changes
* fix pep8
* remove unused var
* reset permissions
* ypaf
* test default environment
* test torchelastic environment
* world size as int
* tests for slurm environment
* changelog
* test comments
* remove unintended change
* keep master port fixed after it is generated
* test random master port
* yapf
* add missing default environment
* move helper function
* rename default environment
* rename
* rename
* yapf
* Update pytorch_lightning/plugins/environments/lightning_environment.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update CHANGELOG.md
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
* spawn -> create
Co-authored-by: justusschock <justus.schock@posteo.de>
Co-authored-by: SeanNaren <sean@grid.ai>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>
Co-authored-by: Justus Schock <justus.schock@rwth-aachen.de>
Co-authored-by: chaton <thomas@grid.ai>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-88-60.ec2.internal>
Co-authored-by: Sean Naren <sean.narenthiran@gmail.com>
Co-authored-by: root <root@ip-172-31-88-60.ec2.internal>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-03-05 01:47:29 +00:00
248a8e8b32
[bugfix] Perform reduction for dict in training_step and DP ( #6324 )
...
* fix
* update
* update
* add changelog
* Update CHANGELOG.md
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update tests/accelerators/test_dp.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* update changelog
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-03-04 23:10:52 +00:00
49c579f1f0
docstring changes in accelerators ( #6327 )
...
* docstring changes in accelerators
* docstrings moved
* whitespaces removed
* PEP8 correction[1]
2021-03-04 20:21:53 +00:00
7acbd65bcb
[bugfix] Check LightningOptimizer doesn't delete optimizer hooks ( #6305 )
...
* update
* resolve bug
2021-03-04 20:11:59 +00:00
39231aee1a
[Fix] Call clip gradients if clip val greater than 0 ( #6330 )
...
* Call clip gradients if clip val greater than 0
* format
* Format
* Move to top of file
2021-03-04 19:45:58 +00:00
8e3524d1a4
Document exception for metrics/classification ( #6190 )
...
* document exception for metrics/classification
* minor formatting fixes
* fix trailing whitespaces
* document exception for metrics
* Apply suggestions from code review
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
* Apply suggestions from code review
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
* Apply suggestions from code review
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2021-03-04 19:34:03 +00:00
b9cf1223b9
missing tests default_root_dir=tmpdir ( #6314 )
...
* default_root_dir=tmpdir
* miss
2021-03-04 19:23:12 +00:00
4f904556e4
Update docs on arg train_dataloader in fit ( #6076 )
...
* add to docs
* update docs
* Apply suggestions from code review
* Update pytorch_lightning/core/hooks.py
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* nested loaders
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* shorten text length
* Update pytorch_lightning/core/hooks.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-03-04 14:22:18 -05:00
5d7388d43b
Fix when _stable_1d_sort to work when n >= N ( #6177 )
...
* Fix when _stable_1d_sort to work when n >= N
* Apply suggestions
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-03-04 14:18:57 -05:00
59acf574e5
Add ignore param to save_hyperparameters ( #6056 )
...
* add ignore param to save_hyperparameters
* add docstring for ignore
* add type for frame object
* Update pytorch_lightning/core/lightning.py
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
* Update pytorch_lightning/core/lightning.py
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
* fix whitespace
* Update pytorch_lightning/core/lightning.py
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
* Parametrize tests
* Update pytorch_lightning/core/lightning.py
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update pytorch_lightning/core/lightning.py
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* seq
* fix docs
* Update lightning.py
* Update lightning.py
* fix docs errors
* add example keyword
* update docstring
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-03-04 20:02:42 +01:00
48a10f16ef
Add `tests/utilities/test_parsing.py` ( #4460 )
...
* Create branch tests/4400_parsing
* Rename test file for parsing.py
* Fix lightning_hasattr
* Fix lightning_hasattr
* Fix lightning_setattr
* Add empty lines and remove rubbish spaces
* Raise AttributeError not ValueError
* Use getattr in hasattr
* Remove rubbish spaces
* Fix getattr
* Fix by flake8
* Add tests for str_to_bool_or_str
* Fix by flake8
* Add tests for str_to_bool
* Add tests for is_picklable
* Add tests for clean_namespace
* Fix typo
* Fix lightning_getattr
* Add tests for AttributeDict
* Add tests for flatten_dict
* Fix by flake8
* Apply suggestions from code review
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Apply isort
* Revert "Apply suggestions from code review"
* Define unpicklable_function outside
* Add comment to test_clean_namespace
* Add tests for parse_class_init_keys
* Add tests for get_init_args and collect_init_args
* Share objects across the tests
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
2021-03-04 19:58:10 +01:00
577323c92a
leaving lezwon ( #6347 )
2021-03-04 18:37:58 +00:00
d01e8fdc86
[fix] Use training type plugin hook when saving (FSDP 1/n) ( #6321 )
...
* Rely on training type plugin when saving
* Add better typing to training type plugin
2021-03-04 18:09:33 +00:00
e038e747a0
hotfix for PT1.6 and torchtext ( #6323 )
...
* ci: azure reinstall torchtext
* move
* todos
* 0.6.0
* skip examples
* formatter
* skip
* todo
* Apply suggestions from code review
2021-03-04 17:48:17 +01:00
6166f46281
drop unused variable in API ( #6308 )
...
* drop unused pl model in ckpt
* irelevant
* on_evaluation_batch_start
* evaluation_epoch_end
* attach_datamodule
2021-03-04 10:26:54 +01:00
484dce11ec
[bugfix] TPU + all_gather + SingleTPU shouldn't call xm.all_gather ( #6296 )
...
* resolve an issue with TPU
* update
* add changelog
2021-03-03 08:54:20 -05:00
4a8422c2dc
Fix ModelPruning(make_pruning_permanent=True) buffers getting removed when saved during training ( #6073 )
...
Co-authored-by: chaton <thomas@grid.ai>
2021-03-03 13:29:58 +01:00
dcec4efe03
Simplify test for AMP plugins ( #6311 )
...
* AMP
* fuse
* yapf
2021-03-03 08:56:57 +01:00
bf6ba83aef
prune duplicite test in optim ( #6312 )
2021-03-03 15:41:00 +09:00
Kaushik B