Commit Graph

59 Commits

Author SHA1 Message Date
alvitawa eea6b44e5a Fixed encoding issues on terminals that do not support unicode characters (#12828)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-04-27 12:02:16 -04:00
Kushashwa Ravi Shrimali f4a0069ce3
`set_epoch` for validation and prediction data loaders (#12197)
* set_epoch for prediction and evaluation
* minor fix in the test, warning msg was changed

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-03-28 19:27:04 +00:00
Rohit Gupta 59b0ccb6bc
Fix logging to loggers with multiple eval dataloaders (#12454) 2022-03-28 15:36:01 +00:00
Carlos Mocholí 45400be921
Do not print empty evaluation result tables (#12427) 2022-03-24 15:26:35 +05:30
Ning a9bfcc7407
Call `Strategy.process_dataloader` in `data_connector.py` (#12251) 2022-03-23 22:57:56 +00:00
Carlos Mocholí aea96e45a4
Integrate global step with progress tracking (#11805) 2022-03-07 19:21:37 +00:00
Danielle Pintz 0b682b807a
Mark `logger_connector` as protected (#12195) 2022-03-05 02:33:42 +00:00
Carlos Mocholí 6309a59c3c
Do not prefetch when possible (#12101) 2022-02-28 18:31:18 +00:00
ananthsub 5d040e7fc6
Add support for `dataloader_iter` to validate and test steps (#11546)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2022-02-24 18:01:35 +00:00
Carlos Mocholí 8394770d4a
Move data fetcher ownership to the loops (#11621) 2022-02-09 20:04:24 +05:30
Andres Algaba 58324b5197
Improve the result printing at the end of evaluation (#11332)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-02-05 03:03:22 +01:00
Rohit Gupta e9065e9d42
Fix rich with uneven refresh rate tracking (#11668)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-02-03 10:27:05 +00:00
Carlos Mocholí 623dc974f5
Construct the hook kwargs inside each loop (#11511) 2022-01-22 15:57:12 +00:00
Danielle Pintz 5b59c951e2
Deprecate `TrainerDataLoadingMixin` and move logic to `DataConnector` (#11282)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-01-05 21:23:57 +01:00
Adam Viola 1fc046cde2
Fix `_should_reload_dl_epoch` causing inconsistent validation dataloader reloading (#11036)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-12-28 02:20:57 +01:00
four4fish cf5ef32f7b
Deprecate Trainer.training_type_plugin in favor of trainer.strategy (#11141)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-12-22 02:11:43 +00:00
Carlos Mocholí 7ed3dbf191
Fix evaluation logging on epoch end with multiple dataloaders (#11132) 2021-12-19 15:51:01 +01:00
Danielle Pintz f95976d602
rename _call_ttp_hook to _call_strategy_hook (#11150) 2021-12-18 17:53:03 -08:00
Carlos Mocholí 8508cce37d
Mark all result classes as protected (#11130) 2021-12-17 19:35:17 +00:00
Carlos Mocholí dbb7f56b35
Deprecate `Trainer.verbose_evaluate` (#10931) 2021-12-17 19:26:32 +01:00
Carlos Mocholí 75d96d9897
Reset the current progress tracking state during double evaluation (#11119) 2021-12-17 19:20:11 +01:00
Carlos Mocholí 5956a0716b
Track the evaluation loop outputs in the loop (#10928) 2021-12-17 14:00:47 +01:00
Carlos Mocholí 99adc45af1
Follow-up changes to #10575 (#10957)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-12-07 15:27:52 +01:00
Danielle Pintz 6043179931
Re-design `call_hook` interface (#10575) 2021-12-04 16:39:55 -05:00
Carlos Mocholí a28b4cd0c0
Sort out the dataloader idx logic for evaluation (#10923)
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-12-03 20:01:46 +00:00
Rohit Gupta 5b9995da04
Fix schedule reset logic in pytorch profiler (#10837) 2021-12-02 14:22:49 +05:30
Carlos Mocholí 724a92b065
Mark outputs as protected in the evaluation loops (#10781)
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-11-28 20:09:30 +00:00
Carlos Mocholí 3089dc3829
Improve typing for loops (#10749)
* Improve typing for loops

* Free memory
2021-11-26 18:39:09 +00:00
Gili Tzabari a967b6eba0
del iterator on_run_end() (#9915) 2021-10-29 16:29:44 +00:00
Danielle Pintz e94dcf6936
Mark `trainer.data_connector` as protected (#10031)
Co-authored-by: tchaton <thomas@grid.ai>
2021-10-25 12:29:09 +01:00
four4fish a002f872ea
[2/n] Directly call TrainingTypePlugin APIs instead of going through the Accelerator (#9901)
Co-authored-by: tchaton <thomas@grid.ai>
2021-10-14 17:38:22 +02:00
thomas chaton 5841ca9782
[Feat] Add auto_restart for fault tolerant training (#9722) 2021-10-01 16:37:17 +00:00
thomas chaton 64bbebc869
[bugfix] Resolve metrics not being properly resetted on validation epoch end (#9717)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-09-27 16:16:45 +00:00
thomas chaton 9148a13de0
Enable DataLoader state restoration for the evaluation loop (#9563)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-09-24 16:21:00 +00:00
Rohit Gupta 86dd318dcc
Reset metrics before each task starts (#9410)
* reset metrics
2021-09-23 13:50:25 +05:30
Adrian Wälchli 5a846d48ce
mark several methods in evaluation loops as protected (#9516)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-09-15 14:12:27 +00:00
Carlos Mocholí 4f8c3ba4a5
Type the Loop base class as generic (#9418) 2021-09-10 12:24:25 +00:00
Jirka Borovec 6e124e7207
CI: precommit - docformatter (#8584)
* CI: precommit - docformatter
* fix deprecated

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-09-06 12:49:09 +00:00
Carlos Mocholí f745aa9ce1
Move tracking epoch end outputs logic to the `EvaluationEpochLoop` (#9261) 2021-09-03 15:02:34 +02:00
Adrian Wälchli 02612e14ef
remove redundant iterator call to data fetcher in loops (#9117)
Co-authored-by: tchaton <thomas@grid.ai>
2021-08-26 11:36:29 +02:00
thomas chaton f959b13ab9
3/n inter batch parallelism (#9052)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-08-24 18:45:54 +00:00
Kaushik B 1a2468f530
[Blocking CI] Fix pep8 error about unused imports (#9090) 2021-08-24 21:26:32 +05:30
thomas chaton 92c7eec966
2/n inter batch parallelism (#9047)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-08-23 19:30:44 +00:00
Carlos Mocholí e1442d247e
Always use `trainer.call_hook` (#8498) 2021-08-20 18:22:03 +02:00
Adrian Wälchli 522df2b89b
3/n integrate new LightningDataFetcher into loop (#8953)
Co-authored-by: tchaton <thomas@grid.ai>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2021-08-17 21:42:22 +00:00
ananthsub 037a86c873
Remove write_predictions from LightningModule (#8850)
* Remove write_predictions from LightningModule
2021-08-14 02:00:23 +00:00
Binh Tang efec3d461c
Move logger and profiler finalization to trainer's teardown (#8685)
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-08-05 10:09:43 +02:00
Carlos Mocholí ed13040729
Connect the model to the training type plugin at the start of run (#8536) 2021-08-04 17:43:34 +02:00
Carlos Mocholí a64cc37394
Replace `yapf` with `black` (#7783)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-07-26 13:37:35 +02:00
Adrian Wälchli 7d93d70110
Loop specialization (#8226)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: tchaton <thomas@grid.ai>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Justus Schock <justus.schock@posteo.de>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-07-19 15:08:53 +02:00