3 Commits

Author	SHA1	Message	Date
Carlos Mocholí	8208c330eb	Use `torch.nn.utils.clip_grad_norm_` and add `clip_grad_by_value` support for TPU (#7025) ... Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com> Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>	2021-05-07 16:41:39 +00:00
Justus Schock	0647340f3b	Add mypy typing to precision plugins. (#6149) ... Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com> Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz> Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>	2021-02-26 14:27:16 +01:00
Justus Schock	069ae27cef	Accelerator Refactor: Precision Plugins (#5718) ... * add basic accelerator class. Co-Authored with @awaelchi * add basic trainign type plugin. Co-Authored with @awaelchi * pep8 Co-authored-by: @awaelchi * update copyright Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com> * add apex_amp Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com> * add mixed base class Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com> * add native amp Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com> * add native amp sharded Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com> * add tpu bfloat Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com> * add inits Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com> * Update precision_plugin.py Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>	2021-01-31 13:12:02 -05:00