lightning/tests
Adrian Wälchli 49c52b0d4b
update an outdated error message in DDPPlugin (#9005)
2021-08-23 15:29:07 +00:00
..
accelerators Replace DataLoader sampler once for IPUs (#8858) 2021-08-16 11:28:05 +02:00
base Replace `yapf` with `black` (#7783) 2021-07-26 13:37:35 +02:00
callbacks Handle the case with no queries in `GPUStatsMonitor` (#9014) 2021-08-21 05:22:33 +02:00
checkpointing 3/n integrate new LightningDataFetcher into loop (#8953) 2021-08-17 21:42:22 +00:00
core Deprecate `prepare_data_per_node` flag on Trainer and set it as a property for DataHooks (#8958) 2021-08-23 12:43:45 +00:00
deprecated_api Deprecate `prepare_data_per_node` flag on Trainer and set it as a property for DataHooks (#8958) 2021-08-23 12:43:45 +00:00
helpers Add error handling for all trainer entry points (#8819) 2021-08-18 02:04:40 +00:00
loggers Remove unused rank_zero_deprecation in WandB logger (#9034) 2021-08-22 12:58:48 +01:00
loops 1/n inter batch parallelism (#9020) 2021-08-23 13:12:25 +00:00
models Delete `TrainingEpochLoop._dataloader_idx` which always equals 0 (#8911) 2021-08-16 13:34:42 +02:00
overrides Replace `yapf` with `black` (#7783) 2021-07-26 13:37:35 +02:00
plugins update an outdated error message in DDPPlugin (#9005) 2021-08-23 15:29:07 +00:00
profiler Fix profiler test on Windows minimal (#8556) 2021-07-26 13:25:24 +00:00
trainer Always use `trainer.call_hook` (#8498) 2021-08-20 18:22:03 +02:00
tuner Integrate `total_batch_idx` with progress tracking (#8598) 2021-08-14 14:08:34 +02:00
utilities 1/n inter batch parallelism (#9020) 2021-08-23 13:12:25 +00:00
README.md CI: add mdformat (#8673) 2021-08-03 18:19:09 +00:00
__init__.py Replace `yapf` with `black` (#7783) 2021-07-26 13:37:35 +02:00
conftest.py Add `pyupgrade` to `pre-commit` (#8557) 2021-07-26 14:38:12 +02:00
mnode_tests.txt Mnodes (#5020) 2021-02-04 20:55:40 +01:00
special_tests.sh Torch Elastic DDP DeadLock bug fix (#8655) 2021-08-02 21:48:43 +02:00

README.md

PyTorch-Lightning Tests

Most PL tests train a full MNIST model under various trainer conditions (ddp, ddp2+amp, etc...). This provides testing for most combinations of important settings. The tests expect the model to perform to a reasonable degree of testing accuracy to pass.

Running tests

git clone https://github.com/PyTorchLightning/pytorch-lightning
cd pytorch-lightning

# install dev deps
pip install -r requirements/devel.txt

# run tests
py.test -v

To test models that require GPU make sure to run the above command on a GPU machine. The GPU machine must have at least 2 GPUs to run distributed tests.

Note that this setup will not run tests that require specific packages installed such as Horovod, FairScale, NVIDIA/apex, NVIDIA/DALI, etc. You can rely on our CI to make sure all these tests pass.

Running Coverage

Make sure to run coverage on a GPU machine with at least 2 GPUs and NVIDIA apex installed.

cd pytorch-lightning

# generate coverage (coverage is also installed as part of dev dependencies under requirements/devel.txt)
coverage run --source pytorch_lightning -m py.test pytorch_lightning tests examples -v

# print coverage stats
coverage report -m

# exporting results
coverage xml

Building test image

You can build it on your own, note it takes lots of time, be prepared.

git clone <git-repository>
docker image build -t pytorch_lightning:devel-torch1.9 -f dockers/cuda-extras/Dockerfile --build-arg TORCH_VERSION=1.9 .

To build other versions, select different Dockerfile.

docker image list
docker run --rm -it pytorch_lightning:devel-torch1.9 bash
docker image rm pytorch_lightning:devel-torch1.9