mirror of https://github.com/wassname/pytorch-lightning.git synced 2026-08-21 11:20:03 +08:00

Files

T

History

Jirka Borovec 3a58937d8b rename variables nb -> num (#567 )

* rename nb -> num

* flake8

* batch_nb, epoch_nb, gpu_nb, split_nb

* add _num deprecations

2019-12-04 06:57:10 -05:00

__init__.py

changes examples to pl_examples for name connflict

2019-10-19 00:41:17 +02:00

ddp2_job_submit.sh

changes examples to pl_examples for name connflict

2019-10-19 00:41:17 +02:00

ddp_job_submit.sh

changes examples to pl_examples for name connflict

2019-10-19 00:41:17 +02:00

multi_node_ddp2_demo.py

rename variables nb -> num (#567 )

2019-12-04 06:57:10 -05:00

multi_node_ddp_demo.py

rename variables nb -> num (#567 )

2019-12-04 06:57:10 -05:00

README.md

changes examples to pl_examples for name connflict

2019-10-19 00:41:17 +02:00

README.md

Multi-node example

This demo launches a job using 2 GPUs on 2 different nodes (4 GPUs total). To run this demo do the following:

Log into the jumphost node of your SLURM-managed cluster.
Create a conda environment with Lightning and a GPU PyTorch version.
Choose a script to submit

DDP

Submit this job to run with distributedDataParallel (2 nodes, 2 gpus each)

sbatch ddp_job_submit.sh YourEnv

DDP2

Submit this job to run with a different implementation of distributedDataParallel. In this version, each node acts like DataParallel but syncs across nodes like DDP.

sbatch ddp2_job_submit.sh YourEnv