Jetson nsight system

This page describes how to use Nsight System on Jetson L4T system

=Installation= Jetson NS (Nsight System) must be installed via SDKManager NSys User Guide: https://docs.nvidia.com/nsight-systems/UserGuide/index.html

Install NS on x86 Linux Host
1. Install Nsight System via SDKManager

Install NS on Jetson Device
1. Installation Steps
 * 1) On x86, launch the Nsight system installed via SDKManager as described above
 * 2) In Nsight System, create a new project, and connect to Jetson device as below, this step will install the Nsight target binaries ontO Jetson device

2. Verify Installation After installation, nsys locates under /opt/nvidia/nsight_systems/.

=Profile=

Remote Profile (UI)
User can run Nsight System on Host and remotely profile the application running on Jetson. User can select several options to enable the corresponding proiling.

User can check the profile option
$ /opt/nvidia/nsight_systems/nsys profile --help

Profile
Run an application and capture its profile into a QDSTRM file, and view it in Nsys GUI profiler $ sudo /opt/nvidia/nsight_systems/nsys profile -t cuda,nvtx,nvmedia,osrt --accelerator-trace=nvmedia --show-output=true --force-overwrite=true --delay=20 --duration=90 --output=%p $APP

One exmaple to profile TRT inference: $ sudo /opt/nvidia/nsight_systems/nsys profile -t cuda,nvtx,nvmedia,osrt --accelerator-trace=nvmedia --show-output=true --force-overwrite=true --delay=20 --duration=90 --output=%p  /usr/src/tensorrt/bin/trtexec --loadEngine=yolo_dla_0_bs20.engine --useDLACore=0 --batch=20 Options: --accelerator-trace=nvmedia : enable profile DLA --delay : start profiling after 20 seconds --duration : profile time

View Log
Import QDSTRM file into GUI Nsys: 1. TensorRT and DLA Inference Time

3. trtexec nsys log https://docs.nvidia.com/deeplearning/tensorrt/developer-guide/index.html#command-line-programs