In this tutorial, we tested our NVIDIA Jetson Nano, Xavier NX and AGX Xavier's DeepStream performance in object detector sample. Our test sources are a video file (FPS:60, resolution:1920x1080, type:MP4) and 4 different cameras (FPS:25, resolution:1920x1080, type:RTSP).
NVIDIA Jetson Nano Info:
-
Software: JetPack 4.5 (L4T-32.5)
-
Hardware: Jetson Nano with DSBoard-NX2 Carrier Board
-
DeepStream Version: 5.0.1
-
Power Mode: MAXN
NVIDIA Jetson Xavier NX Info:
-
Software: JetPack 4.5 (L4T-32.5)
-
Hardware: Jetson Xavier NX with DSBoard-NX2 Carrier Board
-
DeepStream Version: 5.0.1
-
Power Mode: 15W 6CORE
NVIDIA Jetson AGX Xavier Info:
-
Software: JetPack 4.4 (L4T-32.4.3)
-
Hardware: Jetson AGX Xavier Developer Kit
-
DeepStream Version: 5.0.0
-
Power Mode: MAXN
Performance Test Setup
To begin with, let's set our test environment with maximum power mode:
(for Xavier NX)
-
sudo nvpmodel -m 2
(for AGX Xavier and Nano)
-
sudo nvpmodel -m 0
Type these commands and continue other steps in both of them:
-
sudo jetson_clocks
-
sudo chown -hR nvidia /opt/nvidia/deepstream/
-
cd /opt/nvidia/deepstream/deepstream/sources/objectDetector_SSD/
-
cd nvdsinfer_custom_impl_ssd
-
sed -i 's/CUDA_VER?=/CUDA_VER=10.2/g' Makefile
-
make
-
cd /home/nvidia/Downloads/
-
wget https://raw.githubusercontent.com/bower-media-samples/big-buck-bunny-1080p-60fps-30s/master/video.mp4
-
cd /opt/nvidia/deepstream/deepstream/sources/objectDetector_SSD/
Then, copy sample_ssd_relu6.uff, ssd_coco_labels.txt and all configuration text files into /opt/nvidia/deepstream/deepstream/sources/objectDetector_SSD/ folder.
Change source URL (for source0, source1, source2 and source3) in each deepstream_app_config_ssd_rtsp... file (3 files).
Jetson Nano Test Results
The performance of each test command:
-
deepstream-app -c deepstream_app_config_ssd_fp32.txt (~3 FPS)
-
deepstream-app -c deepstream_app_config_ssd_rtsp_fp32.txt (~3 FPS)
-
deepstream-app -c deepstream_app_config_ssd_fp16.txt (~5 FPS)
-
deepstream-app -c deepstream_app_config_ssd_rtsp_fp16.txt (~5 FPS)
Jetson Xavier NX Test Results
The performance of each test command:
-
deepstream-app -c deepstream_app_config_ssd_fp32.txt (12-13 FPS)
-
deepstream-app -c deepstream_app_config_ssd_rtsp_fp32.txt (12-13 FPS)
-
deepstream-app -c deepstream_app_config_ssd_fp16.txt (~36 FPS)
-
deepstream-app -c deepstream_app_config_ssd_rtsp_fp16.txt (~25 FPS - max FPS)
Jetson AGX Xavier Test Results
The performance of each test command:
-
deepstream-app -c deepstream_app_config_ssd_fp32.txt (21-22 FPS)
-
deepstream-app -c deepstream_app_config_ssd_rtsp_fp32.txt (21-22 FPS)
-
deepstream-app -c deepstream_app_config_ssd_fp16.txt (55-56 FPS)
-
deepstream-app -c deepstream_app_config_ssd_rtsp_fp16.txt (25-26 FPS - max FPS)
Comparison of Results
Jetson Nano - Video Results (1080p, 60 FPS)
FP32 -> ~3 FPS * 4 (~12 FPS)
FP16 -> ~5 FPS * 4 (~20 FPS)
Jetson Nano - RTSP Results (1080p, 25 FPS)
FP32 -> ~3 FPS * 4 (~12 FPS)
FP16 -> ~5 FPS (max) * 4 (~20 FPS)
Jetson Xavier NX - Video Results (1080p, 60 FPS)
FP32 -> 12-13 FPS * 4 (48-52 FPS)
FP16 -> ~36 FPS * 4 (~144 FPS)
Jetson Xavier NX - RTSP Results (1080p, 25 FPS)
FP32 -> 12-13 FPS * 4 (48-52 FPS)
FP16 -> ~25 FPS (max) * 4 (~100 FPS)
Jetson AGX Xavier - Video Results (1080p, 60 FPS)
FP32 -> 21-22 FPS * 4 (84-88 FPS)
FP16 -> 55-56 FPS * 4 (220-224 FPS)
Jetson AGX Xavier - RTSP Results (1080p, 25 FPS)
FP32 -> 21-22 FPS * 4 (84-88 FPS)
FP16 -> 25-26 FPS (max) * 4 (100-104 FPS)
Thanks for reading.