Test Drive the NVIDIA TAO Toolkit for Free on NVIDIA LaunchPad. Sign up now

NVIDIA TAO Toolkit

??? ?? ? ??? ?? AI ?????? ??? ?? ?? ????, ??? ?? ??? ???? ?? ??? ????.

TAO ???? ? ? ????

NVIDIA TAO Toolkit? ?? ???????

AI/?? ?? ??? ???? ???? ??? ?? ???? ??? ??? ???? ?????. ??? ??? ?? ??? ???? ??? ??? ???? ??? ??? ??? ???? ?? ??? transfer learning? ?? ?? ??? ??? ? ????.

TensorFlow? PyTorch? ???? ?? NVIDIA TAO Toolkit? AI/? ?? ?????? ???? ?? ?? ?? ????? ???? NVIDIA TAO ?????? ??? ?????. TAO Toolkit? ???? AI ?? ???? ??? ?? ??? ?? ??? ?? ??? ??? ??? ?? ???? NVIDIA? ?? ??? ??? ?? ???? ??? ?? ???? ? ????.

What is TAO Toolkit and how does it fit into AI model development workflow?

?? ??

TAO toolkit lets you train models with Jupyter notebooks easily.

??? ??? ??

TAO Toolkit? Jupyter Notebook?? ??? ??? ? ?? ??? ?????, AI ?????? ?? ?? ??? ???? ????.

TAO toolkit helps you build highly accurate AI models for your use-case.

??? AI ??

NVIDIA? ?? ??? ??? ?? ????? ???? ?? ??? ?? ?? ??? ??? AI ??? ??? ? ????.

TAO toolkit allows you to optimize the model for inference.

??? ?? ???

???? ??? ?? ??? ?? ??? ????? ?? ??? ?? 4??? ?? ? ????.

TAO toolkit helps you deploy optimized models with ease.

??? ??

??? ?? DeepStream, ?? AI? Riva ? Triton Inference Server?? ??? ???? ??? ??? ? ????.

?? ??? AI ???? ??????

?? ??? AI ?? ? ?? ??? ???? ????, ???? ??? ??? ?? ??? ?????. ???? ????? ??? ?? ?? ?? ??? ?? ?? ???? ??? ??? ??? ?? ??? ???? ? ????.

?? AI? ?? ?? ??? ??

NVIDIA? ???? ?? ????? 100? ?? ?? ??? ??? ?? ? ??, ?? ??, ??? ??????? ?? ??? ?? ???? ?? ??? ? ?? ??? ??? ? ????.

?? ??? ?? ??? ??? ??? ??? ??? ????, ??? ???? ??? ????, ??? ???? ?? ? ???? ? ??? ??? ??? ? ????.

NGC?? Jupyter Notebook ?????? ?? ?? ??

??? AI? ?? ?? ??? ??

??????(ARS), ?????(NLP) ? ??? ?? ??(TTS) ?? ??? ?? ???? ?? ??? ??? ??? ??? ??? ????, ?? ??? AI ???? ??? ? ????.

NGC?? Jupyter Notebook ??????

?? ??

Rest APIs? ??? ??????? TAO Toolkit ??

Kubernetes? ?? ???? ???? ???? TAO Toolkit? ???? REST APIs? ???? ??????? ?? ??? ? ????. AI ???? ?? ????? TAO Toolkit? ?? ???? ???? ?? ? ?? ???? ??? ? ????.

??? ????
Workflow for running TAO Toolkit as-a-Service with REST APIs
Workflow to show importing ONNX model weights to TAO Toolkit for fine-tuning.

ONNX ?? ??? ????

ONNX ???? ?? ?? ? ?????? ?? ???? TAO Toolkit?? ??? ?? ??? ???? ??? ??? ? ????.

?? ??

??? ??

?? ? ?? ??? ?? ??? ?? ??? ?? ?? ??? ???? ??? ??? ??? ??? ???? ? ????.

??? ????
Generalize model with Data Augmentation features.
A visual chart to show the demo of TensorBoard Viz.

TensorBoard? ?? ???

?? ? ?? ??, ???, ?? ???, ?? ??? ?? ??? ???? ??????? ??? ???? ??? ??? ? ????.

??? ???? ?

??? ?? ???

??? ???? ????? ???? INT8 ???? ?? ?? ??? ?? 4??? ?? ? ????.

??? ??
Optimized PeopleNet
ResNet34
01000200030004000500060007000A100A10A2OrinAGX XavierXavier NX
TAO Toolkit can be integrated with NVIDIA DeepStream and RIVA.

DeepStream ? Riva ??

TAO Toolkit?? ??? ???? ??? ?? AI? NVIDIA DeepStream SDK ? ?? AI? Riva? ?? ??? ? ?? ??? ??? ??? ?????? ??? ??? ? ????.

DeepStream? ???? Riva? ????

NVIDIA AI Enterprise? ?? ???? AI

??? NVIDIA ?????? ?? ???? ??-?-?? AI ????? ???? NVIDIA AI Enterprise? ?? TAO Toolkit?? ????, ???? ?? ?? ??, ?? ?? ??, ?? ????, NVIDIA AI ??? ?? ?? ?????.

NVIDIA H100? ???? ??? NVIDIA H100 ?? ????? ??? ???? ?? NVIDIA AI Enterprise ?????? ????? ??? ?????.

NVIDIA LaunchPad? ?? TAO Toolkit? NVIDIA AI Enterprise? ??? ??????. ???? ?????.

?? ??

NVIDIA Jetson? ???? ?????? NVIDIA Ampere ???? GPU? ???? ????? ????? ??? ??? ?? NVIDIA? ?? ??? ??? ?? ?? ??? ???? ? ????. ?? ??? ?? ??? ?? ??? ??? ?? ?? ????? ?? ?????.

Xavier NX
AGX Xavier
AGX Orin
T4
A2
A30
A100
Arch ??
?? ???
???
???
GPU + 2*DLA(FPS)
GPU + 2*DLA(FPS)
GPU + 2*DLA(FPS)
GPU(FPS)
GPU (FPS)
GPU (FPS)
GPU (FPS)
PeopleNet
960x544x3
INT8
80%mAP
263
418
1294
1064?
581
3160
6245
3D ????
256x192x3
8?? ??
8 pixel error
147
235
711
713?
471
2242
4179
???? ??
3x300x34x1
FP16
90%
87
150
262
376
211
1122
2145
DashCamNet
960x544x3
INT8
84% mAP
423
670
1895
1676
865
4900
9500
??? ??? ??
96x48x3
FP16
98% mAP
706
1190
4118
3959?
2180
12400
27200
?? ?? 2D
224x224x96
FP16
83%
245
471
1577
1897
1044
6000
12600
People Semantic Segmentation
960x544x3
FP16
87% mIoU
199
356
673
1027
631
2862
5745

?? ?? ??

OneCup AI Customer Story

OneCup AI

OneCup AI? ??? ?? ???? NVIDIA? ?? ??? ??? TAO Toolkit? ??? ??? ??? ?? ? ?????? ?? ??? ? ??? ? ?? ?? ?????.

??? ????
RocketBoots Customer Story

RocketBoots

RocketBoots? NVIDIA? TAO Toolkit? ?? ??? ??? ??? ???? ?? ?? ???? ?? ??? ?????.

??? ????
Floatbot Customer Story

Floatbot

Floatbot? ???? ???? ?? ?? AI ??????? NVIDIA Riva? NVIDIA TAO? ???? ? ?? ??? ? ?? ??? ?? ? ??? ??????.

??? ????

???? ?? ???

booz allen
Kion group
Inex tech
Lexmark ventures
One cup AI
Rocketboots
SmartCow
appen
cvedia
hasty
lexset
lightly
Rendered AI
Sky Engine
Yuva AI
roboflow

???? ??

NVIDIA TAO? ??? ?? ??? ??? AI ?? ?? ??? ?? ?? ?? ??? ???? ??? ?? ? ??? AI ??? ??, ?? ? ????? ?? ????????.

TAO?? ? ?? ??? ????.

  1. TAO? ??? ??? TAO Toolkit
  2. ?? ?? ?? GUI ??? ??? ??????. ???? ?? ???? ?????.
?? ??? ? ???????? ??? ??? ?? ???????? ???? ??????, ? ????? ??? ??? ?? ????? ??? ? ??? ????? ? ?? ???? ?? ?????. ?? ??? ??, ?? ? ?? ?? ??? ??? ? ????.
?????. ?? ???? ??? ?? EULA? ?????.
TAO Toolkit? EfficientNet, YOLOv3/v4, RetinaNet, FasterRCNN, UNET ?? ?? NVIDIA? ???? ?? ????? ??? ??? 100? ?? ?????.

???? ?? ????? ?? ????? ???? ??? ? ????.
TAO Toolkit? ????? ???? ??? TensorFlow ? PyTorch ?????? ?????. ???? ???? ?? ??? ?? TAO Toolkit? ???? ??? ? ?? ?????? ??? ??? ????.
TAO Toolkit ???? ???? ????? ????.
TAO Toolkit ???? ???? ????? ????.
  • ?? ??? DeepStream? ?? ?? ??
  • ?? ??? Riva? ?? ?? ??
  • Triton Inference Server? ???? ?? ??

??? ?? ??? ??? ??? ????? ????.

TAO Toolkit??? ??? ???? ??? ???? ?? ??? ??? "?? ???"? ??? ? ????. ??? ??? ?? ???? ??? ??? ??? ?? ??? ? ????. ??? ??? ??? ?????.
?????. ????? TAO Toolkit? ??? ? ????. AWS, Azure ?? GCP?? TAO Toolkit? ???? ??? ?? ??? ??? TAO Toolkit ???? ????? ????.
x86 ?????? TAO Toolkit??? ??? ?????. ??? Jetson ???? ???? ??? ??? ? ????.
NVIDIA Metropolis? ?????? ???????, ??? ? ????, ??? ????????, ?? ???? AI? ??? ???? ?? ???? ?? ???? ???? ?????. ???? ??? ??? ?????. .

???

??? ??? ???

Isaac Sim? NVIDIA TAO? ?? AI ?? ??? ???? ?????.

??? ??

??

??? ??? ?? AI ?????? ???? ???? ??? ??? ????.

?? ??

GTC ???

TAO Toolkit? ?? ???? ??? ??? ???? ??? ???? ??? ?? ???? ??? ?????.

???? ??? ????

TAO ???? AI ??? ????? ?? ?????

????