History

Nic Eggert 05cea3ff8b Save / Load Hyperparameters with checkpoint (#415 ) * Save and load hparams from checkpoints * Update docs * Add warning when not saving hparams * Missing import * Update .run_local_tests.sh * Update lm_test_module_mixins.py * Update lightning_module_template.py		2019-10-23 04:48:24 -04:00
..
README.md	…
__init__.py	…
cpu_template.py	Minor imports cleaning (#402 )	2019-10-22 11:32:40 +03:00
gpu_template.py	Minor imports cleaning (#402 )	2019-10-22 11:32:40 +03:00
lightning_module_template.py	Save / Load Hyperparameters with checkpoint (#415 )	2019-10-23 04:48:24 -04:00

README.md

Basic Examples

Use these examples to test how lightning works.

Test on CPU

python cpu_template.py

Train on a single GPU

python gpu_template.py --gpus 1

DataParallel (dp)

Train on multiple GPUs using DataParallel.

python gpu_template.py --gpus 2 --distributed_backend dp

DistributedDataParallel (ddp)

Train on multiple GPUs using DistributedDataParallel

python gpu_template.py --gpus 2 --distributed_backend ddp

DistributedDataParallel+DP (ddp2)

Train on multiple GPUs using DistributedDataParallel + dataparallel. On a single node, uses all GPUs for 1 model. Then shares gradient information across nodes.

python gpu_template.py --gpus 2 --distributed_backend ddp2