Join the GTC talk at 12pm PDT on Sep 19 and learn all you need to know about implementing parallel pipelines with DeepStream. ???? Register now

NVIDIA DeepStream SDK

DeepStream? ?? ??? ??? ?? ?? AI ??????? ???? ? ??? ??? ? ????. ?? ?? ? ??? ?????, ?? to ?? ? ????? ??? ? ????.

??????LaunchPad? ?????

NVIDIA DeepStream? ?? ???????

?? ??? ??? ??? ?? ???? ??? ?? ??? ?? ???? ???? ????. ??? ???? ???? ???? ????? ???? ???? ???? ??? ???? ??? ? ????. ?? ??? ??? ?? ???, ??? ?? ? ?? ????, ?? ??? ??? ?? ?? ?? ?? ??, ??? ??, ?? ??? ?? ?? ?? ? ? ???? ??? ? ?? ??? ??? ?? ??(IVA)? ??? ????. NVIDIA? DeepStream SDK? AI ??? ?? ?? ??, ???, ??? ? ??? ??? ?? GStreamer ??? ??? ???? ?? ????, IVA ?? ???? ???? ?? AI ???? ????? ???, ???? ? OEM?? ??? ?????. ?? ???? ???? ??? ??, ??? ???/???, ??? ??? ?? ??? ?? ???? ?? ??? ??? ?? ?????? ??? ? ????. DeepStream ???????? ???, ??? ? ?? ???? ????? ??? ? ????.

What is DeepStream and how does the software stack look like
?? DeepStream? ?? ? ?? ???? ?? ??? ????? ???? ???? ???? ???? ??? ? ?? ???? NVIDIA Metropolis?? ??? ??? ???? ????.

DeepStream? ?? ??

DeepStream is a powerful and flexible SDK

?????? ??? SDK

DeepStream SDK? ???? ?? ??? ??? ?? ??? ?????.

DeepStream provides multiple programming options

?? ????? ??

C/C++, Python ?? Graph Composer? ???? ???? UI? ??? ??? ?? AI ??????? ?? ? ????.

DeepStream allows you to gather real-time insights

??? ????

?? ???? ??? ?? ?? ??? ?? ???? ??? ? ????.

DeepStream helps you create managed AI services

??? AI ???

???? ???? ????? AI ???? ???? Kubernetes? ??? ???????? ? ????.

DeepStream helps you reduced total development cost

TCO ??

TAO Toolkit? ??? ??? ??, ?? ? ????? DeepStream? ?? ??? ?????? ??? ??? ?? ? ????.

????? ?? ????

C/C++

C/C++? ??????? ????, GStreamer ? DeepStream ?????? ?? ?? ????, ?? ??????? ???? ??? ? ????.


C/C++? ?? ??? ????

Python

GStreamer ?????? Python ???? Gst Python? ??? DeepStream ?????? ??? ? ????. ??? ? Python ?? ??????? ?? ?? ??? GitHub?? ?? ? ????.


Python? ?? ??? ????

Graph Composer

Graph Composer? DeepStream? ??? ??? ???? ??? ?? ????. ???? ???? UI? ???? ??? ? ?? ??? ?? ?? ?????? ??? ? ????.


Graph Composer? ?? ??? ????

??? ? ??? ?? ??

DeepStream? ??? ?? ??, ??? ?? ? ???? ??? AI ??? ??? ???? ?????. ?? ??? ??? ??, ??? ? ??? ???? ??? ??? ???? ?????? ?? ??? ?? ????. DeepStream? ?? 1080p/30fps ???? ???? ?????. Jetson ??? DLA?? ???? ?? ???? ??? GPU? ??? ? ????. ?? ?? ??? ? ??? ?????? ?????.


Xavier? NX
Xavier AGX
Jetson Orin AGX?
T4
A2
A10
A30
A100
??????
??
???
?? ???
???
GPU
DLA1
DLA2
GPU
DLA1
DLA2
GPU
DLA1
DLA2
GPU
GPU
GPU
GPU
GPU
?? ??
PeopleNet-ResNet34
(?? 2.5)
??? ??
960x544
INT8
79
22
22
137
29
29
455
?? ??*
?? ??*
431
237
993
1466
2380
?? ??
PeopleNet-ResNet34
(?? 2.5)
NvDCF
960x544
INT8
74
22
22
125
28
28
418
?? ??*
?? ??*
418
231
957
1369
2285
?? ??? ??
TrafficCamNet
LPDNet
LPRNet
NvDCF
960x544
640x480
96x48
INT8
INT8
FP16
79
-
-
139
-
-
379
-
-
481
310
1169
1356
2196
3D ?? ?? ??
PeopleNet-ResNet34 BodyPose3D
NvDCF
960x544
192x256
INT8
FP16
9
-
-
12
-
-
57
-
-
68
54
152
128
132
?? ??
ActionRecognitionNet (3DConv)
??? ??
224x224x3x32
FP16
15
-
-
24
-
-
85
-
-
137
74
1154
2640
2640

?? ??* = JetPack 5.0.2??? ?? ?? ?? ???


DeepStream SDK? ???? ???? ???? AI? ????, ??? ???/???, ??? ????, ?? ? ??-???? ??? ??? ????? ???? ?? ???? ??? ? ????.


DeepStream? ??? ??? ?? ??? ??? ???? ?????.

?? ?? ????

??? ?? ??

???? DeepStream? ??? AI ?? ???, ??? ? ??? ??? ?? ??? ???? ?????? ??? ? ????. ?? ???? ??? ? C/C++?? Python? ??? ?? ?? Graph Composer? ??? ?? ??? ? ? ???? ??? ? ????. DeepStream?? ?? ???? ?? ????? ?? ??? ?? ?????.

???? ?? ??? ?? ??? DeepStream? ??? SSD, YOLO, FasterRCNN, MaskRCNN ? ?? ?? ?? ?? ? ??? ???? ???? AI ??? ?????. ??? ??? ?????? ??? ?? ????.

??? ????? ?????? ???? ??? ??? ???? ????? ?? ???? ???? ???? ?? ??? ??? ? ????. NVIDIA Triton? Inference Server? ?? ???? ?? ??? ???? PyTorch?? TensorFlow? ?? ???? ??????? ??? ???? ??? ??? ? ????. ?? GPU, ?? ??? ? ?? ?? ???? ??? ??? ???? NVIDIA? ???? TensorRT? ??? ?? ??? ??? ? ????.

DeepStream ??????? ???? ??? ???? ? ??? gRPC? ??? Triton Inference Server? ???? ?? ????? ??? ? ?? ??? ?? ?? ???? ??? ? ????.

??? ????

DeepStream helps developers build seamless streaming pipeline for AI based video analytics
DeepStream helps developers build high performance cloud native AI applications

???? ???? ??

???? ???? ??? ???? ?? ??? ???? ???? ??? ????? ???? ? ??? ???? ???? ??? ? ????. ???? ???? ?? ??? ???? ????? ??? ??? ??????? ??? ? ?? ??? ??????? ?? ??? ??? ? ????.

???? DeepStream Container Builder ?? ??? NVIDIA NGC ????? ??? ???? ???? AI ??????? ??? ? ????. ??? ????? ???? ??? ???? Kubernetes? Helm ??? ?? ?????.



??? ????

???? AI ??? ??

NVIDIA Metropolis? ???? ?? AI ???? ???? ?? ?? ??? ??? ??? ??? ??? ??? ? ????. ?????? ?? AI ??? ???? TAO Toolkit? ?? ?? ? ?????, DeepStream? ??? ??? ? ????.

DeepStream? SSD, MaskRCNN, YOLOv4, RetinaNet ?? ??? ? ?? ?? ? ??? ??? ?? ?? ??? ?????. ???? Triton ??? DeepStream? ??? ???/??? ????? ??? ?? ??? ??? ??? ? ????.



??? ????
DeepStream is integrated with NVIDIA Metropolis for complete end-to-end AI solutions
DeepStream is bundled with multiple reference applications

?? ??????? ???

DeepStream SDK?? ???? ?? ??? ????? ??? 30? ??? ?? ??????? ??? ?? ?????. ???? ??? C/C++, Python ? Graph Composer ???? ????, NVIDIA Jetson?? dGPU ????? ?? ?????. ?? ??????? DeepStream ???? ??? ??? ?????, ??? ?? AI ??????? ???? ?? ??? ? ????? ??? ? ????.



??? ????

Graph Composer ??

?? DeepStream ???? Graph Composer ??? ??? ??? ?? ??? ?? ?????. ???? ???? ????? ??? ??? ?? ?????? ??? ????, Container Builder? ??? ??? ??? ? ????.

Graph Composer? ??? ?? ?? ??? ?? AI ??????? ???? ? ??? ?? DeepStream, GStreamer ? ??? ????? ??? ?? ??? ??????.

???? ??? ???? ??? ???? ?? ?? ?????? ?? ????? ??? ? ?? ?????? ??? ??? ?? ? ?????. ???? ?? ?? ???? ???? ???? NVIDIA? ?? ?? ?????? ?????, ??? ?? ??? ? ????.



??? ????
Conceptual image of low-code Graph Composer

?? ?? ??

OneCup AI Customer Story

OneCup AI

OneCup AI? ??? ?? ???? ?? NVIDIA? ?? ??? ??? TAO Toolkit ? DeepStream SDK? ??? ??? ??? ?? ? ?????? ?? ?? ??? ? ??? ? ?? ?? ??? ? ?????.


OneCup AI? ?? ??? ????
Tapway Customer Story

Tapway

Tapway? NVIDIA GPU, DeepStream SDK ? ?? NVIDIA ????? ?? ??? ?? ???? ???? ?? ?? 40km? ???? ???? 50????? ???, ??? ? ??? ??? ? ??? AI ??? ???? ??????. ?? ?? ? ? ???? ??? 10?? 1? ??? ??? ?? ?????.


Tapway? ?? ??? ????
Two-i Customer Story

Two-i

??? ??, ??? ?? ? ? ??? ??? Two-i? ??? ?? ??? ?? ? ??? ?? ? ?? ???? ???? ??? ???? ? ??????.
Two-i? AI ??? ??? ?? ???????? NVIDIA Metropolis ???? ????, ?? ?? ????, ??? ?? ??? ??? ???? ??? ? ?????.


Two-i? ?? ??? ????

???? ??

DeepStraem? ???? ?? SDK???. ?? ???? ?????? ? ?? ????? ??? ????? ?????.

DeepStream SDK? ?? ? ?? AI ?? ??????? ???? ??? ? ?? ???? ????? ?? ?????. ?? ? ??? ?? ??? ???, ?? ??, ?? ??, ?? ??, ?? ??, ???? ? ??? ?? ?? ????.

??? ? OS ??? ?? ??? ???.

?, Triton Inference Server? ???? ?? ?????. ??, DeepStream 6.1.1? ???? ??????? gPRC? ?? ?? Triton Inference Server? ???/?? ????? ??? ?????.

DeepStream? ?? ?? ????? ?? ?? ?????. ?? ??, DeepStream? MaskRCNN? ?????. ??, DeepStream? ??? YOLO ??, FasterRCNN, SSD ? RetinaNet? ???? ? ????.

?, DS 6.0 ?? ??? Ampere ????? ?????.

?, DeepStream SDK 6.1.1?? ???? ?????. ????? ?????? ?????? ???? ??? ? Automatic Speech Recognition (ASR) ??????? ?????. ASR DeepStream Plugin? ???? ??? ??? ?? ? ????.

DeepStream SDK? ???? ??? ?? AI ? ? ???? ?????.

????