a38d108a68
add dist lib to enable syncing anything across devices ( #3762 )
...
* add dist lib to enable syncing anything across devices
2020-10-01 01:21:38 -04:00
783750547d
disable optimizers setup during testing ( #3059 )
...
* disable configure_optimizers during testing
* minor changes
* hvd and ddp
* fix precision during testing
* fix ddp
* fix amp
* fix cpu
* update dp
* simplify optimizers
* add test
* codefactor
* ref optimizer setup
* chlog
* suggestions
* isort
* rebased with master
2020-09-29 01:09:04 +02:00
031274c25d
fix dp issues + update examples and test examples ( #3618 )
...
* fix dp
* fix dp
* fix dp
* fix dp
* fix examples
* fix examples
* fix examples
* fix examples
* fix examples
* fix examples
* fix examples
* fix examples
* fix examples
* fix examples
* fix examples
* fix examples
* fix examples
* fix examples
* fix examples
* fix examples
* fix examples
* fix examples
2020-09-23 00:19:46 -04:00
890588a9ee
ref: precision plugins 1/n ( #3504 )
...
* ref: precision plugins 1/n
* ref: precision plugins 1/n
2020-09-15 09:56:12 -04:00
810b445097
ref: apex plugin ( #3502 )
...
* ref: apex plugin
* ref: apex plugin
* ref: apex plugin
2020-09-15 06:02:42 -04:00
70af47db84
ref: organize args 4/n ( #3456 )
2020-09-10 21:58:47 -04:00
b0298cead8
ref: move train outside of setup training ( #3297 )
...
* ref: move train outside of setup training
* ref: move train outside of setup training
* ref: move train outside of setup training
* ref: move train outside of setup training
2020-08-31 20:36:52 -04:00
bcd13f70b8
ref: run_pretrain_routine -> setup_training ( #3294 )
...
* ref: .tune()
* ref: run_pretrain_routine -> setup_training
2020-08-31 18:06:11 -04:00
0aee137ba7
DP device fix ( #3196 )
2020-08-27 09:01:29 -04:00
6c3cec3a3c
training amp scaling refactor ( #3135 )
2020-08-24 19:59:46 -04:00
0b3cb3c955
ref: moved ___step_end hooks ( #3130 )
...
* moved eval hooks
* moved eval hooks
* moved eval hooks
* moved eval hooks
* moved eval hooks
* moved eval hooks
* moved eval hooks
2020-08-24 17:50:47 -04:00
527b9dca36
refactored ddp backend forward ( #3119 )
2020-08-24 07:33:14 -04:00
4354690e55
add apex test ( #2921 )
...
* add apex test
* rename
* level
* events
* wrap
* evt
* miss
* apex
* apex
* apex
* apex
* apex
* apex
* Update tests/models/test_amp.py
Co-authored-by: William Falcon <waf2107@columbia.edu>
* notes
* notes
Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-08-13 10:03:13 -04:00
a6e7aa7796
allow using apex with any PT version ( #2865 )
...
* wip
* setup
* type
* name
* wip
* docs
* imports
* fix if
* fix if
* use_amp
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* fix tests
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* fix tests
* todos
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2020-08-08 11:07:32 +02:00
b7d72706c3
clean imports ( #2867 )
...
* clean imports
* miss
2020-08-08 00:33:51 +02:00
f8c058215f
simplify tests & cleaning ( #2588 )
...
* simplify
* tmpdir
* revert
* clean
* accel
* types
* test
* edit test acc
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Update test acc
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2020-08-07 23:22:05 +02:00
William Falcon