lightning/examples/app_multi_node

Lightning & Multi Node Training

Lightning supports makes multi-node training simple by providing a simple interface to orchestrate compute and data.

Multi Node with raw PyTorch

You can run the multi-node raw PyTorch by running the following commands.

lightning run app app_torch_work.py

Multi Node with raw PyTorch + Lite

You can run the multi-node raw PyTorch and Lite by running the following commands.

lightning run app app_lite_work.py

Multi Node with PyTorch Lightning

Lightning supports running PyTorch Lightning from a script or within a Lightning Work.

Multi Node PyTorch Lightning Script

lightning run app app_pl_script.py

Multi Node PyTorch Lightning Work

lightning run app app_pl_work.py

Multi Node with any frameworks

lightning run app app_generic_work.py