William Falcon
b922409624
clean and organize fit ( #3938 )
...
* clean and organize fit
* clean and organize fit
* clean and organize fit
* clean and organize fit
* clean and organize fit
2020-10-07 11:04:10 -04:00
William Falcon
9c415d2c71
moves configure ddp to each backend ( #3924 )
...
* moves configure ddp to each backend
* moves configure ddp to each backend
* moves configure ddp to each backend
* added torch manual seed in test_mean_error
* test for complicated batch structure
* test for complicated batch structure
* test for complicated batch structure
Co-authored-by: ananyahjha93 <ananya@pytorchlightning.ai>
2020-10-07 00:50:16 -04:00
William Falcon
e3007ffe0c
moves sync bn to each backend ( #3925 )
2020-10-06 22:42:33 -04:00
William Falcon
2c21f7d7e2
ref: adding compute environments (2/n) ( #3842 )
...
* ref: adding compute environments (2/n)
* ref: adding compute environments (2/n)
* ref: adding compute environments (2/n)
* ref: adding compute environments (2/n)
2020-10-04 08:48:46 -04:00
William Falcon
1f8ff7c48c
ref: callback system and init ddp (1/n) ( #3836 )
...
* refactored callback system and init ddp
* refactored callback system and init ddp
* refactored callback system and init ddp
* refactored callback system and init ddp
2020-10-03 23:39:17 -04:00
William Falcon
0838c6bfce
ref: decoupled ddp2 ( #3816 )
2020-10-03 09:02:35 -04:00
Akihiro Nitta
ebc1b23fa3
Use `raise .. from ..` to explicitly chain exceptions ( #3750 )
...
* Fix exception chaining
* names
* Change exception names for consistency
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
* Change exception names for consistency
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
Co-authored-by: Jirka Borovec <jirka@pytorchlightning.ai>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
2020-10-01 21:45:44 +02:00
William Falcon
890588a9ee
ref: precision plugins 1/n ( #3504 )
...
* ref: precision plugins 1/n
* ref: precision plugins 1/n
2020-09-15 09:56:12 -04:00
William Falcon
810b445097
ref: apex plugin ( #3502 )
...
* ref: apex plugin
* ref: apex plugin
* ref: apex plugin
2020-09-15 06:02:42 -04:00
William Falcon
518a0c0e92
ref: merge backends x/n ( #3480 )
2020-09-12 15:27:11 -04:00
William Falcon
00d155ae01
ref: merge backends x/n ( #3477 )
2020-09-12 12:36:55 -04:00
William Falcon
dd324e4086
ref: accelerator connector methods x/n ( #3470 )
2020-09-11 22:25:48 -04:00
William Falcon
ef20310873
ref: move specific accelerator code x/n ( #3457 )
...
* ref: organize args x/n
* ref: move specific accelerator code x/n
* ref: move specific accelerator code x/n
* ref: move specific accelerator code x/n
2020-09-11 10:56:21 -04:00
William Falcon
70af47db84
ref: organize args 4/n ( #3456 )
2020-09-10 21:58:47 -04:00
William Falcon
8f6b115511
ref: added model connector ( #3407 )
...
* ref: added model connector
* ref: added model connector
* ref: added model connector
2020-09-09 00:24:20 -04:00
William Falcon
b0298cead8
ref: move train outside of setup training ( #3297 )
...
* ref: move train outside of setup training
* ref: move train outside of setup training
* ref: move train outside of setup training
* ref: move train outside of setup training
2020-08-31 20:36:52 -04:00
William Falcon
bcd13f70b8
ref: run_pretrain_routine -> setup_training ( #3294 )
...
* ref: .tune()
* ref: run_pretrain_routine -> setup_training
2020-08-31 18:06:11 -04:00
William Falcon
6bae404bed
ref: ddp backend refactor (3) ( #3208 )
...
* ddp backend refactor
* ddp backend refactor
2020-08-26 20:03:09 -04:00
William Falcon
a8daf914f8
ddp backend refactor ( #3207 )
2020-08-26 19:10:24 -04:00
William Falcon
6c3cec3a3c
training amp scaling refactor ( #3135 )
2020-08-24 19:59:46 -04:00
William Falcon
0b3cb3c955
ref: moved ___step_end hooks ( #3130 )
...
* moved eval hooks
* moved eval hooks
* moved eval hooks
* moved eval hooks
* moved eval hooks
* moved eval hooks
* moved eval hooks
2020-08-24 17:50:47 -04:00
William Falcon
527b9dca36
refactored ddp backend forward ( #3119 )
2020-08-24 07:33:14 -04:00
Jirka Borovec
4354690e55
add apex test ( #2921 )
...
* add apex test
* rename
* level
* events
* wrap
* evt
* miss
* apex
* apex
* apex
* apex
* apex
* apex
* Update tests/models/test_amp.py
Co-authored-by: William Falcon <waf2107@columbia.edu>
* notes
* notes
Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-08-13 10:03:13 -04:00
Phil
e3528afae3
Move optimizer creation after device placement for ddp backends. ( #2904 )
2020-08-12 06:34:59 -04:00
Jirka Borovec
a6e7aa7796
allow using apex with any PT version ( #2865 )
...
* wip
* setup
* type
* name
* wip
* docs
* imports
* fix if
* fix if
* use_amp
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* fix tests
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* fix tests
* todos
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2020-08-08 11:07:32 +02:00
Jirka Borovec
b7d72706c3
clean imports ( #2867 )
...
* clean imports
* miss
2020-08-08 00:33:51 +02:00
Jirka Borovec
f8c058215f
simplify tests & cleaning ( #2588 )
...
* simplify
* tmpdir
* revert
* clean
* accel
* types
* test
* edit test acc
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Update test acc
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2020-08-07 23:22:05 +02:00