CUDA Developer Tools | Intro to NVIDIA Nsight Compute

Join NVIDIA’s Jackson Marusarz for an introduction to NVIDIA Nsight Compute, a tool for in-depth analysis of CUDA kernel performance on GPUs.

00:00 - Introduction
00:45 - NVIDIA Nsight Compute Replay Modes
1:13 -  Setup Tips
2:05 - How to Profile Remotely
2:35 - NVIDIA Nsight Compute Activities
3:56 - Configure and Run the Profile
5:39 - Viewing Reports
6:18 - Source Code Page
6:48 - Conclusion

Highlights include:

Setting up Nsight Compute: Get insights into the capabilities of Nsight Compute, including setup tips and key features for performance analysis. Learn how to harness Nsight Compute to understand the performance of your GPU.

Collecting metrics: Discover how Nsight Compute collects performance and throughput metrics, including from hardware counters and code instrumentation.

Configuration: Learn about permissions for accessing GPU counters and how to enable source-level details without compromising performance. Get details about configuration options for non-interactive profiles.

Nsight Compute reports: Nsight Compute generates detailed reports with runtime information, speedup estimates, and more. You can even examine source-level profiling data.

This video series will help get you started with NVIDIA Nsight Developer Tools for CUDA. Grow your proficiency with the tools and apply the examples to your own development environment. Or return to specific episodes for a refresher on certain features and functionalities. We walk through analyzing performance reports, offer debugging tips and tricks, and show you the best ways to optimize your CUDA code. The series will focus primarily on Nsight Compute and Nsight Systems.

Download the latest release of NVIDIA Nsight Compute: developer.nvidia.com/nsight-compute

Read the NVIDIA Nsight Compute Kernel Profiling Guide: https://docs.nvidia.com/nsight-comput...

CUDA Developer Tools | Nsight Tools Ecosystem: CUDA Developer Tools | NVIDIA Nsight ...
CUDA Developer Tools | Intro to Nsight Systems: CUDA Developer Tools | Intro to NVIDI...

Thanks for watching, and stay tuned for more episodes.

Join the NVIDIA Developer Program: https://nvda.ws/3OhiXfl
Read and subscribe to the NVIDIA Technical Blog: https://nvda.ws/3XHae9F

#CUDA #Nsight #developertools #NVIDIA #HPC #LLM #CUDAtutorials