c3fc0313ef
Updating docs and error message: half precision not available on CPU ( #7384 )
...
* Updating docs and error message to specify that half precission not available on CPU
* update messages
Co-authored-by: Martin Kristiansen <martinkristiansen@sixgill.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: jirka <jirka.borovec@seznam.cz>
2021-05-06 09:05:50 +00:00
49c8740338
update docs about transfer_batch_to_device hook while using DP ( #7343 )
...
* update
* clarify
* update
2021-05-05 13:51:16 +00:00
98670c83a9
Deprecate`truncated_bptt_steps` flag on Trainer in favor of same setting on the LightningModule ( #7323 )
...
* deprecate-tbptt-trainer
* Update CHANGELOG.md
* Update lightning.py
* test
* Update lightning.py
* Update training_loop.py
* Update training_loop.py
* Update lightning.py
* Update training_loop.py
* Update training_loop.py
* update docs
* Update accelerator.py
* Update accelerator.py
* more docs
* tweaks
* chlog
* comments
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-05-05 11:21:00 +01:00
a6aa1a0f82
make gpus=str in Trainer consistent with command line parsing of string ( #6388 )
...
* string gpu input
* update docs
* deprecation warning
* Revert "update docs"
This reverts commit c5f3893413
2021-05-04 09:56:27 +00:00
f135debb6a
Clarify logger flag ( #7190 )
...
* Clarify logger flag
Clarify behavior of boolean values on the logger flag for Trainer.
* Update docs/source/common/trainer.rst
* doc
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-05-04 00:21:28 +00:00
6da747e775
Deprecate `LightningModule.datamodule` reference in favor of the trainer one ( #6929 ) ( #7168 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-05-04 00:01:41 +00:00
78a6fd5588
Example and documentation for LightningCLI linking model and data arguments ( #7299 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-05-03 20:45:46 +00:00
5af086ab9f
Attach data refactor and tuner bugs [4/n] ( #7258 )
...
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2021-04-30 13:54:58 +00:00
8bffa4f0ca
Updated docs to fix typo and update grid status ( #7270 )
...
* Updated docs to fix typo and update grid status
* Update docs/source/starter/new-project.rst
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
* Update docs/source/starter/new-project.rst
* Update docs/source/starter/new-project.rst
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2021-04-30 12:45:17 +01:00
7a48db591e
Fixes a potential bug on pip install ( #7256 )
...
* Fix install bug
* Better fix
* Fix
* Fix
* Remove unused import
* Update docs conf.py
* Updates
2021-04-29 03:15:09 +05:30
78d45a1134
Improve `LightningCLI` documentation and tests ( #7156 )
...
* - Added cli unit tests for help, print_config and submodules.
- Added to cli documentation use of subclass help and print_config, submodules and other minor improvements.
- Increased minimum jsonargparse version required for new documented features.
* Improvements to lightning_cli.rst
* Add check for all trainer parameters in test_lightning_cli_help
* Increased minimum jsonargparse version
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-04-28 09:34:32 +01:00
bfac0e899f
warn about dp + manual optimization in docs ( #7230 )
...
* add warning
* typo
* add link
2021-04-28 09:01:06 +01:00
e76ebd640e
[feat] Add BasePredictionWriter 3/3 ( #7127 )
...
* wip
* update
* update
* update
* update
* update
* typo
* update on comments
* update
* update
* update
* update
* update changelog
* update
* Fix merge
* Fix merge
* move code
* resolve test
* add extra test
* add an extra test
* update on comments
* add typing
* resolve flake8
* Refactor and Docs
* Fix tests
* Fix tests
* Fix tests
* Duplicate
* Fix tests
* resolve bug
* update
* update on comments
* Update pytorch_lightning/utilities/imports.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update pytorch_lightning/utilities/device_parser.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* update
* update
* update
* update on comments
* resolve flkae8
* update test
* Apply suggestions from code review
* update on comments
* Update pytorch_lightning/callbacks/prediction_writer.py
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
* Update pytorch_lightning/callbacks/prediction_writer.py
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
* Update pytorch_lightning/callbacks/prediction_writer.py
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
* update on comments
* update
* update on comment
* Apply suggestions from code review
* update
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-04-27 20:23:55 +00:00
5cf9afa176
Add fairscale install msg for Sharded Plugins ( #7213 )
2021-04-27 08:22:44 +00:00
d534e53ec4
add missing predict docs ( #7150 )
...
* update docs
* add datamodule predict
* fix docs
* typo
2021-04-23 10:38:44 +00:00
d6470bf193
Delete unused CI scripts ( #7152 )
2021-04-22 03:07:48 +02:00
345e9a0245
Fix argparse docs ( #7148 )
2021-04-22 02:13:00 +02:00
d902181b50
Update `ClusterEnvironment` docs ( #7120 )
...
* update cluster
* update index
* update references
* update grid docs
* update duplicated title
* Update docs/source/clouds/cloud_training.rst
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* fix doctest
* Remove self-balancing section
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-04-22 01:38:16 +02:00
e4f3a8d3dd
Update `EarlyStopping` docs ( #7121 )
2021-04-21 01:23:36 +02:00
1a68dcd9a2
Update governance.rst ( #7111 )
2021-04-20 16:55:49 +02:00
0302b8be32
Disable `lr_scheduler.step()` in manual optimization ( #6825 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-04-20 13:00:45 +02:00
24248d6dd4
Update community example links ( #7087 )
...
Co-authored-by: tchaton <thomas@grid.ai>
2021-04-20 06:56:59 +00:00
60c1c8fe83
Auto-set `DataLoader.worker_init_fn` with `seed_everything` ( #6960 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2021-04-19 16:28:37 +02:00
d1529c28a1
Optimization docs ( #6907 )
...
* .
* .
* Fix link to the section
* Fix link to the section
* Consistent indent
* Update docs
* Apply suggestions from code review
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Add note for optimizer.optimizer
* .
* Update hooks
* Update closure docstring
* Update optimizer methods
* Update optimizer
* Remove manopt + grad clipping (by @flukeskywalker)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-04-19 10:08:49 -04:00
a5e356adb1
Deprecate `@auto_move_data` in favor of `trainer.predict` ( #6993 )
...
* Deprecated `@auto_move_data` in favor of `trainer.predict`
* Update CHANGELOG
2021-04-19 14:53:21 +01:00
e9fca760ac
Set `DistributedSampler` seed if `seed_everything` was called ( #7024 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-04-19 14:50:31 +01:00
67d21609c9
Add Trainer max_time argument + Callback ( #6823 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2021-04-16 13:38:57 +02:00
402a258705
[docs]: pass parser to Trainer.add_argparse_args() ( #7029 )
2021-04-16 01:52:47 +02:00
7b0b6c3112
Update DeepSpeed docs after single saving PR ( #7036 )
2021-04-15 08:56:04 -07:00
f852a4f592
Changed basic_examples to use `LightningCLI` ( #6862 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-04-15 15:01:16 +00:00
895bea1ad3
rename about ( #7002 )
...
* rename about
* .
* ..
2021-04-14 18:56:40 -04:00
d3f73a0a74
Plugin Docs ( #6952 )
...
Co-authored-by: edenlightning <66261195+edenlightning@users.noreply.github.com>
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2021-04-14 20:53:21 +00:00
03a73b37bc
Train End Error Handling Fix ( #6864 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
2021-04-14 20:35:42 +02:00
fb02972dde
Fixed wrong on_fit_start callback reference in documentation ( #7001 )
...
Co-authored-by: Daniele Acquaviva <danieleacquaviva@Danieles-MacBook-Pro.local>
2021-04-14 01:19:27 +02:00
4cf6bfac48
update notebooks ( #6968 )
2021-04-13 23:04:46 +00:00
f2021ed225
docs: lightning-bolts ( #6967 )
2021-04-13 18:49:48 +00:00
b9bc77293b
Fix inconsistent outputs in `on_*_end` and `*_end` ( #6969 )
...
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2021-04-13 15:16:21 +01:00
20ff50caa6
Accelerator API docs ( #6936 )
...
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-04-10 12:25:07 +05:30
3baac71252
v1.3.0rc1 ( #6925 )
...
* v1.3.0rc1
* .
2021-04-09 10:36:06 -04:00
128f6ab508
Add separators to performance docs ( #6882 )
2021-04-08 08:22:50 +01:00
19e67d18c4
Docs fixes ( #6870 )
2021-04-07 16:57:22 +01:00
7f6154fcad
Add `Trainer(gradient_clip_algorithm='value'|'norm')` ( #6123 )
...
* add changelog
* add clip by value
* fix bug in training tricks.rst
* fix bug in trainer.rst
* Update trainer.rst
* Update trainer.rst
* Update CHANGELOG.md
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update pytorch_lightning/plugins/precision/deepspeed_precision.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update pytorch_lightning/utilities/enums.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* yapf formatting
* update training tricks
* update based on comment
* update based on comment
* Update pytorch_lightning/trainer/trainer.py
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
* update based on comment
* pep8
* mypy
* mypy
* Update docs/source/advanced/training_tricks.rst
Co-authored-by: thomas chaton <thomas@grid.ai>
* Update sharded_native_amp.py
* Update test_sharded_parity.py
* update test codes
* Update test_tpu.py
* Update pytorch_lightning/trainer/connectors/training_trick_connector.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update test_trainer.py
* Update enums.py
* Update enums.py
* add super-class initialization to precision plugins.
* add clip_grad horovod cpu test
* add clip_grad horovod cpu test
* use subprocess check_call
* change order of horovod tests
* set max_epochs 2 in horovod test
* remove clip_grad_val test from horovod-cpu
* remove "type: ignore"
* divide clip grad val test in horovod
* update based on comments
* add super-class initialization to precision plugins.
* bugfix
* bugfix
* revert some changes
* revert some changes
* Update tests/models/test_horovod.py
* merge master
* Delete signature test
No point in testing a signature
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>
2021-04-06 08:27:37 -05:00
b7f3a3c421
Simple reproducibility with minimum boilerplate CLI training with `LightningCLI` ( #4492 )
...
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-04-06 14:19:11 +01:00
22a266d8b8
Update TPU docs for installation ( #6794 )
2021-04-04 00:19:43 +05:30
f8a379830d
Remove extinct parameters from lightning_module.rst ( #6801 )
...
Fixes #6800
2021-04-02 20:49:20 +02:00
0dd2deebea
Remove legacy support for the magic `log`/`progress_bar` keys in dict returns ( #6734 )
2021-03-31 00:28:04 +02:00
f9bb7c641a
DeepSpeed ZeRO Docs update ( #6752 )
...
* Added base docs
* Add more information
* Apply suggestions from code review
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-03-30 21:52:02 +00:00
9876df16a2
[docs] Update Bolts link ( #6743 )
...
* Update Bolts link
* Update Bolts link
* formt
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-03-30 22:52:59 +05:30
f0c5479de9
Remove legacy `Result` parameters ( #6016 )
2021-03-28 11:55:08 +02:00
bc613611e2
Do not add return dict items to callback_metrics ( #6682 )
2021-03-26 14:05:20 +01:00
Martin Kristiansen