History

Jirka Borovec 5130841bef update Docs [links & formatting] (#769 ) * wip * wip * debug imports docs formatting * WIP * formatting * fix setup		2020-02-09 17:39:10 -05:00
..
README.md	changes examples to pl_examples for name connflict	2019-10-19 00:41:17 +02:00
__init__.py	changes examples to pl_examples for name connflict	2019-10-19 00:41:17 +02:00
cpu_template.py	update Docs [links & formatting] (#769 )	2020-02-09 17:39:10 -05:00
gpu_template.py	update Docs [links & formatting] (#769 )	2020-02-09 17:39:10 -05:00
lightning_module_template.py	update Docs [links & formatting] (#769 )	2020-02-09 17:39:10 -05:00

README.md

Basic Examples

Use these examples to test how lightning works.

Test on CPU

python cpu_template.py

Train on a single GPU

python gpu_template.py --gpus 1

DataParallel (dp)

Train on multiple GPUs using DataParallel.

python gpu_template.py --gpus 2 --distributed_backend dp

DistributedDataParallel (ddp)

Train on multiple GPUs using DistributedDataParallel

python gpu_template.py --gpus 2 --distributed_backend ddp

DistributedDataParallel+DP (ddp2)

Train on multiple GPUs using DistributedDataParallel + dataparallel. On a single node, uses all GPUs for 1 model. Then shares gradient information across nodes.

python gpu_template.py --gpus 2 --distributed_backend ddp2