lightning/tests
Carlos Mocholí f95ba20012
Do not use the base version by default in `_compare_version` (#10051)
2021-10-25 16:41:32 +05:30
..
accelerators Add XLACheckpointIO (#9972) 2021-10-21 02:39:16 +05:30
base Keep global step update in the loop (#8856) 2021-09-14 19:21:39 +05:30
callbacks Fix `LearningRateMonitor` logging with multiple param groups optimizer with no scheduler (#10044) 2021-10-20 22:13:00 +05:30
checkpointing (1/n) tests: Use strategy flag instead of accelerator for training strategies (#9931) 2021-10-16 20:40:25 +05:30
core Fix: skip importing DistributedOptimizer for Windows (#10071) 2021-10-21 21:01:56 +00:00
deprecated_api Remove deprecated `distributed_backend` from `Trainer` (#10017) 2021-10-19 13:54:37 +00:00
helpers Remove deprecated `DataModule.dims` usage in tests (#9948) 2021-10-18 17:35:41 +05:30
loggers Don't raise DeprecationWarning for `LoggerConnector.gpus_metrics` (#9959) 2021-10-18 22:51:09 +00:00
loops Fix `self.log(on_epoch=True)` on_batch_start (#9780) 2021-10-18 14:02:16 +02:00
models Update strategy flag in docs (#10000) 2021-10-20 21:02:53 +05:30
overrides Add support for `torch.use_deterministic_algorithms` (#9121) 2021-09-30 04:40:09 +00:00
plugins Add support for init_meta_context, materialize_module (#9920) 2021-10-21 15:48:31 +01:00
profiler [CI] Comment flaky tests (#10084) 2021-10-25 10:31:06 +02:00
trainer Revert "Support serialized checkpoint loading (#9605)" (#10057) 2021-10-21 02:51:22 +02:00
tuner reset val dataloader for binsearch (#9975) 2021-10-18 12:54:26 +02:00
utilities Do not use the base version by default in `_compare_version` (#10051) 2021-10-25 16:41:32 +05:30
README.md CI: add mdformat (#8673) 2021-08-03 18:19:09 +00:00
__init__.py Replace `yapf` with `black` (#7783) 2021-07-26 13:37:35 +02:00
conftest.py Add support for `torch.use_deterministic_algorithms` (#9121) 2021-09-30 04:40:09 +00:00
mnode_tests.txt
special_tests.sh Skip reconciliate_processes if used within a cluster environment that creates processes externally (#9389) 2021-09-15 11:54:17 +01:00

README.md

PyTorch-Lightning Tests

Most PL tests train a full MNIST model under various trainer conditions (ddp, ddp2+amp, etc...). This provides testing for most combinations of important settings. The tests expect the model to perform to a reasonable degree of testing accuracy to pass.

Running tests

git clone https://github.com/PyTorchLightning/pytorch-lightning
cd pytorch-lightning

# install dev deps
pip install -r requirements/devel.txt

# run tests
py.test -v

To test models that require GPU make sure to run the above command on a GPU machine. The GPU machine must have at least 2 GPUs to run distributed tests.

Note that this setup will not run tests that require specific packages installed such as Horovod, FairScale, NVIDIA/apex, NVIDIA/DALI, etc. You can rely on our CI to make sure all these tests pass.

Running Coverage

Make sure to run coverage on a GPU machine with at least 2 GPUs and NVIDIA apex installed.

cd pytorch-lightning

# generate coverage (coverage is also installed as part of dev dependencies under requirements/devel.txt)
coverage run --source pytorch_lightning -m py.test pytorch_lightning tests examples -v

# print coverage stats
coverage report -m

# exporting results
coverage xml

Building test image

You can build it on your own, note it takes lots of time, be prepared.

git clone <git-repository>
docker image build -t pytorch_lightning:devel-torch1.9 -f dockers/cuda-extras/Dockerfile --build-arg TORCH_VERSION=1.9 .

To build other versions, select different Dockerfile.

docker image list
docker run --rm -it pytorch_lightning:devel-torch1.9 bash
docker image rm pytorch_lightning:devel-torch1.9