Learn › GPU Operations & NCCL Troubleshooting

nvidia-smi Mastery

The single most important command in GPU operations. Learn every flag, every output field, and every monitoring mode. After this module, nvidia-smi output tells you a story instead of showing you numbers. 5 labs on RTX 4000 Ada. Estimated GPU cost: ~$3.63.

Labs in this module

• First Contact: GPU Detected, Driver Loaded - Your first GPU command. Run nvidia-smi and read the whole cockpit: driver and CUDA versions, temperature, power, memory, utilization, and th
• The GPU That Moved - Set CUDA_VISIBLE_DEVICES on a real two GPU machine and watch nvidia-smi ignore it completely, because nvidia-smi is an NVML tool and not a C
• The Card That Slowed Down - A slow GPU is almost never a mystery, and it is almost never heat. Read power, clocks and the Clocks Event Reasons field on real hardware, t