Jirka Borovec
b7d72706c3
clean imports ( #2867 )
...
* clean imports
* miss
2020-08-08 00:33:51 +02:00
William Falcon
62ce00f96c
EvalResult support for val loop (PR 3/5) ( #2651 )
...
* add EvalResult to support to val/test loops
2020-07-22 13:53:10 -04:00
ananthsub
ed581eb64f
Fix local rank zero casting ( #2640 )
...
* Fix local rank zero casting
The environment variable 'LOCAL_RANK' can be a string, causing the `if rank_zero_only.rank == 0` check to fail
* Update distributed.py
address comment
2020-07-18 20:12:06 -04:00
Jirka Borovec
0be78d13aa
native amp ( #2373 )
...
* native amp
* typo
* imports
* apex
2020-06-26 21:45:13 -04:00
William Falcon
d5f77c9d1b
Release2 ( #2262 )
...
* fix missing arg
* fix missing arg
* fix missing arg
* fix missing arg
* fix missing arg
* fix missing arg
* fix missing arg
2020-06-19 02:38:10 -04:00
William Falcon
9df2b2090d
sets default ddp mode to spawn ( #2168 )
...
* set ddp_spawn as default
* spawn message
* spawn message
* spawn message
* spawn message
* spawn message
* spawn message
* spawn message
* spawn message
2020-06-13 03:47:45 -04:00
Jirka Borovec
58a467dd68
model checkpint on rank_zero_only & global rank state ( #1408 )
...
* try delete in async or DDP us0-ecase
* changelog
* add model chekpoint rank
* simple delete
* flake8
* use global rank
* chnagelog
* fix review
* fix import
* proposal
* proposal
* proposal
* improve proposal (fix problems with method call self)
* cleaning
Co-authored-by: Adrian Wälchli <adrian.waelchli@students.unibe.ch>
Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-04-24 17:21:00 -04:00