Commit Graph

6937 Commits

Author SHA1 Message Date
Jirka Borovec 15fa538938
add RobertLaurella as docs owner (#12973) 2022-05-06 10:07:35 -04:00
Carlos Mocholí 3d74c90e88
Remove `on_train_batch_{start,end}(dataloader_idx=...)` (#12977) 2022-05-06 14:58:49 +02:00
Rohit Gupta c02dc8585c
Profile `LightningDataModule` hooks (#12971)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-06 12:23:36 +00:00
Carlos Mocholí 2697517dda
Fix default int values being float (#12989) 2022-05-06 10:24:19 +00:00
Akash Kwatra c5e1002fe4
Add profiling to dataloader `next()` (#12124)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-06 11:48:12 +02:00
Jirka Borovec 7ce948edb6
Unpin CUDA docker image for GPU CI (#12373)
* unpin CUDA docker image for GPU CI
* Apply suggestions from code review

Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: Akihiro Nitta <akihiro@pytorchlightning.ai>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-05-06 02:56:57 +00:00
Jerome Anand 4818229be6
Break lazy accumulation of graphs (#12938)
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-05 21:31:41 +02:00
Sean Naren 1a502c061c
[1/2] Collaborative Strategy (#12842) 2022-05-05 16:06:26 +00:00
sisilmehta2000 d337374da7
[FSDP] Adding Native FSDP Strategy (#12447) 2022-05-05 12:48:29 +00:00
otaj e2ea9f045f
Add support for reloading the last checkpoint saved by passing `ckpt_path="last"` (#12816)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-05 08:32:58 +00:00
Rohit Gupta de7c103918
Add a method signature check for `setup` (#12960)
Co-authored-by: otaj <ota@grid.ai>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-04 18:20:59 +00:00
Max Mametkulov 1e96848596
Raise an exception when using DeepSpeed with an invalid accelerator (#12699)
Co-authored-by: manjirou <maxim.mametkulov@halbestunde.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-05-04 18:16:41 +00:00
Kaushik B 5bb265e18b
Update Strategy doc (#12950)
* Update Strategy doc

* Update strategy references
2022-05-04 12:05:18 -04:00
Jirka Borovec bb51e2a55b
Merge pull request #12723 from PyTorchLightning/req/strategies
Separate strategies' requirements
2022-05-04 10:06:02 -04:00
Abhisek Maiti 2ffc0deaf5
Support `predict_dataset` in `LightningDataModule.from_datasets` (#12942)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-05-04 13:12:22 +00:00
Carlos Mocholí 88c202eeba
Update CHANGELOG after the 1.6.3 release (#12968) 2022-05-04 11:07:24 +00:00
Adrian Wälchli b27a21c58e
simplify _copy_trainer_model_properties (#12788) 2022-05-04 13:06:50 +02:00
Rohit Gupta 9bfbd9ea80
Fix zero division error for empty dataloaders (#12885)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-03 20:40:30 +00:00
Adrian Wälchli 5641836b96
Callback collection through entry points (#12739)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2022-05-03 16:54:41 +00:00
Rohit Gupta 46ed9dc62a
Fix fit loop restart logic to enable resume using the checkpoint (#12821)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-03 16:27:13 +00:00
Rohit Gupta 5dc89512e8
Fix `TQDMProgressBar` reset and update to show correct time estimation (#12889)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-03 16:21:59 +00:00
Sean Naren 4d06301c18
[FIX] Enable mixed precision in the Fully Sharded Strategy when `precision=16` (#12965)
* Fix fully sharded mixed precision setter

* Add CHANGELOG.md
2022-05-03 15:39:59 +00:00
Carlos Mocholí f4505ce6b2
Construct the hook kwargs inside each loop (#12100)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-05-03 17:08:02 +02:00
Rohit Gupta cd01856ffc
Add `LightningDataModule.load_from_checkpoint` to load datamodules directly from checkpoint (#12550)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: otaj <ota@grid.ai>
2022-05-03 12:27:06 +00:00
Mauricio Villegas 1c25ab8daf
Support CLI shorthand natively (#12614)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-03 14:16:37 +02:00
Peder Bergebakken Sundt c278802b64
Prefix log_metrics keys with class name in callbacks (#12228)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-03 12:20:24 +02:00
Rohit Gupta eebba9e632
Enforce eval shuffle warning only for default samplers (#12653)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-05-02 16:11:09 +00:00
Carlos Mocholí 917918ade3
Remove duplicate boring classes (#12951) 2022-05-02 17:42:12 +02:00
Na Young Jun 0e4c4424fd
fix enumerate usage (#12949) 2022-05-02 15:29:56 +02:00
Na Young Jun 0f418a8640
Add missing `super().__init__()` calls (#12948) 2022-05-02 15:20:02 +02:00
Carlos Mocholí 26acdd6569
Add hook test for reloading with max epochs (#12932) 2022-05-02 14:41:28 +02:00
ORippler 456cc87954
Fuse_modules in a qat-respecting way (#12891)
* Fuse_modules in a qat-respecting way

* Add compatibility for PyTorch <1.11

In older pytorch versions, `fuse_modules` used the `Module.training`
flag to determine wheter fusion should be QAT-compliant or not, refer
https://github.com/pytorch/pytorch/releases/tag/v1.11.0

* Add CHANGELOG for pull #12891

* Fix conditional import of fuse_modules_qat

`torch.ao.quantization.fuse_modules_qat` was actually added in
torch 1.11.

* Update CHANGELOG.md

Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-05-02 12:37:08 +00:00
Akihiro Nitta ecd135e939
Update nvidia gpg key to fix nightly docker builds (#12930)
* Update gpg key
* Use curl instead of wget
* Install key manually
2022-05-02 09:00:44 +02:00
HMellor 62c73904c0
Override `optimizer_zero_grad` when using the `IPUStrategy` (#12913)
Co-authored-by: Sean Naren <sean@grid.ai>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-05-01 22:47:21 +00:00
Carlos Mocholí 46c59d04db
Exclude the CHANGELOG from the pre-commit size check (#12931) 2022-04-29 13:23:02 +00:00
Nicolas Berger 61e44103ea
Fix pickling of KFoldLoop (#12441)
* allow pickling of KFoldLoop

* Update pl_examples/loop_examples/kfold.py

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Nicolas Berger <nicolas.berger@inait.ai>
Co-authored-by: Kushashwa Ravi Shrimali <kushashwaravishrimali@gmail.com>
2022-04-29 11:52:42 +00:00
Mauricio Villegas 00a3321d64
Remove use of jsonargparse internals (#12918) 2022-04-29 11:02:09 +00:00
otaj c461854fa7
Versioning of last checkpoins (#12902)
* last checkpoint versioning

* changelog

* Simplify test

* Update CHANGELOG.md

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Update CHANGELOG.md

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-04-29 14:13:50 +09:00
Kushashwa Ravi Shrimali 74d46d655d
Threading support for legacy loading of checkpoints (#12814) 2022-04-28 20:37:58 +00:00
Jerome Anand 6896f00a16
Invoke parent DDP configuration for torch>1.10.2 (#12912)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-04-28 19:31:05 +00:00
otaj 55b3bc3e36
Print ragged dict of metrics in `EvaluationLoop._print_results` properly (#12857)
* first fix

* full bugfix + tests

* Apply Adrian's suggestion

* Add test with tensor(0)

* Minor code simplification

* change sorting to make the comment correct

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-04-28 16:05:24 +00:00
Sean Naren bcbd9c359e
ShardedGradScaler should only be set for FP16 (#12915)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-04-28 17:44:31 +02:00
Kaushik B 0fe2ae74e9
Remove reference to genindex and search in index.rst (#12919) 2022-04-28 10:48:31 -04:00
Kaushik B 7271095b7b
Merge pull request #12920 from PyTorchLightning/rename/lightning_extension
Update docs conf with renamed lightning extension
2022-04-28 10:48:09 -04:00
Schinkikami a62c227932
Support automatic seeding of the LightningCLI (#12822)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-04-28 14:24:32 +00:00
maciek-pioro f29d0ab6f8
Fix typo in predict_step docs (#12911) 2022-04-28 12:26:57 +00:00
Akihiro Nitta 98b206e836
Use cmake installed with apt (#12907) 2022-04-28 07:44:52 +00:00
Carlos Mocholí 9ff1b39981
Update CHANGELOG after the 1.6.2 release (#12904) 2022-04-28 08:53:54 +02:00
Fork my Git 0b87bfc65c
Update the link to jsonargparse's link_arguments (#12898) 2022-04-28 04:27:27 +09:00
Kaushik B a95bbe6953
Update TPU Accelerator docs (#12850)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2022-04-27 22:38:26 +05:30