Carlos Mocholí
|
152eb57def
|
Rename special to standalone (#10779)
|
2021-11-26 17:13:14 +00:00 |
|
Carlos Mocholí
|
0fa07da987
|
Fail the test when a `DeprecationWarning` is raised (#9940)
|
2021-11-17 23:41:50 +01:00 |
|
Carlos Mocholí
|
9237106451
|
Clip before step (#10248)
|
2021-10-30 11:27:49 +01:00 |
|
Carlos Mocholí
|
03f01fb5ec
|
Fix gradient norm tracking and gradient clipping (#9287)
* WIP
* Progress
* Undo test change
* Fix plugin closure execution order
* Update CHANGELOG
* Fix manual optimization on AMP and skipping backward
* Fix for deepspeed
* Typo
* Hook test for manual closure
* Add skipping test with AMP
* You are hideous, apex
* Add deepspeed test
* Update CHANGELOG
* Fix for broken master
* Add RunIf
* FIXMEs
* Rename
* Fix grad norm
* add a simple test
* update test
* update test
* update test
* fix merge conflicts
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Sea of changes
* Undo change
* Introduce TPUPrecisionPlugin
* Undo changes
* Undo changes
* Resolve FIXME
* Undo change
* Undo change
* Undo change
* Fix FIXMEs
* Fix FIXME
* Correct value
* Bad merge
* Fix circular imports
* WIP
* Fixing clipping
* Fixes
* Bad merge
* Move optimizer step and clipping into the `PrecisionPlugin`
* Fix AMP
* Update CHANGELOG
* Fix tests
* Underscore
* Progress
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Remove pre_optimizer_step
* Missed one
* Progress
* Progress
* Fix test
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update FIXMEs
* Fix test
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Fix test
* DeepSpeed warning. mypy
* Rename
* Finish tests
* Update CHANGELOG
* Dumb fixes
* accelerator=auto
* Apply suggestions from code review
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Update on comments
* Use ClassifModule
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
|
2021-10-28 15:23:27 +00:00 |
|
Carlos Mocholí
|
5262b63dff
|
Pass the scaler as an input to `NativeMixedPrecisionPlugin` (#10055)
Co-authored-by: thomas chaton <thomas@grid.ai>
|
2021-10-28 14:13:53 +00:00 |
|
Carlos Mocholí
|
dbe1662dc3
|
Replace `_TORCH_GREATER_EQUAL_DEV_1_10` with `_TORCH_GREATER_EQUAL_1_10` (#10157)
|
2021-10-27 13:38:39 +01:00 |
|
Carlos Mocholí
|
2ee3127661
|
Use `torch.autocast` (#10053)
|
2021-10-25 17:33:52 +00:00 |
|
Carlos Mocholí
|
6aeebf1bd3
|
Remove unnecessary dependency available checks (#10050)
|
2021-10-20 16:21:37 +00:00 |
|
Carlos Mocholí
|
f0b3e0f4de
|
Default to `precision=bf16` on CPU when `precision=16` is passed (#10033)
|
2021-10-20 13:25:13 +00:00 |
|
Kaushik B
|
5e8829b97d
|
(1/n) tests: Use strategy flag instead of accelerator for training strategies (#9931)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
|
2021-10-16 20:40:25 +05:30 |
|
Danielle Pintz
|
3392215ef6
|
Fix broken `test_cpu_amp_precision_context_manager` (#9809)
* @RunIf(min_gpus=1)
* dtype -> fast_dtype
|
2021-10-04 12:14:13 +00:00 |
|
Carlos Mocholí
|
0ddd6a8c19
|
Remove `_NATIVE_AMP_AVAILABLE` checks (#9747)
|
2021-09-29 15:34:26 +02:00 |
|
Jirka Borovec
|
6e124e7207
|
CI: precommit - docformatter (#8584)
* CI: precommit - docformatter
* fix deprecated
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
|
2021-09-06 12:49:09 +00:00 |
|
John St. John
|
c30d9b9fae
|
Update call to `amp.autocast` from `fast_dtype` to `dtype` (#9211)
Co-authored-by: SeanNaren <sean@grid.ai>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
|
2021-09-04 02:59:11 +00:00 |
|
Sean Naren
|
bac8b1be81
|
Add support for CPU AMP autocast (#9084)
|
2021-08-25 12:18:00 +00:00 |
|
Sean Naren
|
1feec8c601
|
Add bfloat16 support to Lightning Trainer (#9049)
|
2021-08-24 09:47:21 +00:00 |
|
Carlos Mocholí
|
a64cc37394
|
Replace `yapf` with `black` (#7783)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
|
2021-07-26 13:37:35 +02:00 |
|
Dusan Drevicky
|
1b06edf2f2
|
Add the `on_before_optimizer_step` hook (#8048)
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
|
2021-07-09 13:30:52 +02:00 |
|
Carlos Mocholí
|
eb6d991218
|
Refactor plugins backward (#8328)
|
2021-07-08 16:02:09 +02:00 |
|
Yifu Wang
|
b71aa55b9e
|
Make optimizers skippable when using amp (#7975)
Co-authored-by: Yifu Wang <yifuwang@2012@gmail.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
|
2021-06-16 00:23:30 +00:00 |
|
thomas chaton
|
16d6c9828d
|
[bugfix] Apex never instantiated. (#7274)
* update
* update
* update apex
* update
* update
* update
* remove test.py
* update
* update
* update on comments
* update changelog
* update
* update
* typo
|
2021-04-30 13:16:28 -04:00 |
|
Adrian Wälchli
|
33cc9fe138
|
Clean up environment access in plugins (#6941)
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
|
2021-04-13 20:07:40 +02:00 |
|
Jirka Borovec
|
dcec4efe03
|
Simplify test for AMP plugins (#6311)
* AMP
* fuse
* yapf
|
2021-03-03 08:56:57 +01:00 |