NVIDIA JetPack? Jetson ????? ???? ???? ????? AI? ?? ??? ?? ??? ?????. ???? ??? NVIDIA JetPack ??? CUDA? ?? ???? ???? ??? NVIDIA JetPack ???? CUDA? ?????? ??? ?????. NVIDIA JetPack? CUDA? ?? ??? ?? ?? ????? ????, ????? ? ?? ??? ??(?: NVIDIA JetPack 4.x ?? NVIDIA JetPack 5.x)? ?? ?????.
CUDA ?? 11.8?? NVIDIA JetPack 5.0 ??? Jetson ???? NVIDIA JetPack ?? ?? Jetson Linux BSP(?? ?? ???)? ?????? ?? ?? CUDA ???? ?????? ? ????. CUDA ???? ???? ??? ??? ??? ? ????.
????? CUDA? ??? Jetson? CUDA
CUDA ?? ??? ?? GPU(dGPU)? ?? GPU(iGPU)? ?? Jetson? ????? ?? ??? ???? ??? ???? ? ??? ???.
- CUDA? Jetson?? ????? ??
- CUDA? ?????? ????? ??
- ? ? ?? ?? ???
?? 1? Jetson Linux BSP? ??? NVIDIA JetPack SDK? ???? ??? ????? ?? ??? ???? ?? Jetson ????? ????? ?????. ??? ??? Jetson ????? ????? ?????.
?? 2? CUDA? ?? NVIDIA JetPack SDK ??? ???? ???? ??, Jetson Linux BSP? ?? ?? ?? ??? ?? ???? ??? ?????. ?? 2?? ? ? ??? CUDA ????? ?? ?? ??? ?? Jetson Linux BSP? ?????. ??? ?? ?? ??? ??? CUDA ??? ?????? ?? Jetson Linux BSP? ??? ???? ? ??? ?? ???????. CUDA ??? BSP? ???? ??? CUDA ????? ?????? ????.
NVIDIA JetPack SDK? ???? Jetson Linux BSP(CUDA ???? ??) ? CUDA ??? ????? ?????.
??? ??? ??? ?? ????? CUDA ???? CUDA ??? ??? ????? ???? ?? CUDA ???? ?? ?? ??? ??? ? ?? ???? ????. ?? ??? ??? ? ??? ?? ???? ?? ??? ???? ? ??? ??? ???? ?????? ?? ??? ?? ????? ? ??? ???.
Jetson? CUDA ????? ?? ???
CUDA 11.8?? CUDA? Jetson ????? CUDA ????? CUDA ??? ?? ???? ????? ? ?? ??? ???? ????? ??? ??????.
?? 4? NVIDIA JetPack 5.0 SDK? ????? ???? ?? ??? ??? ??? ??? ?????. ??? Jetson Linux BSP? NVIDIA JetPack SDK? ??? ?? ?? ??? ?????. ?? ??? ? ??? ?? ?????? ? ?? CUDA ?? ??? ?????.
??? ?????? ?? 5? ??? ??? CUDA ???? ?????(CUDA ??? ?????? ?)? ??? ?? ?????.
? ????? ????? ?? CUDA ????(libcuda.so.*)? ???? ???? ?? ?? ??? CUDA ???? ?? ???? ??? ?? CUDA ??? ???? ? ????.
? ???? ??? ???? Jetson Linux BSP? ???? ?? CUDA ????? ???? ???? ???????. ?? CUDA ???? ? ???? ?????? ????? ?????.
? ???? ?? ?? Jetson Linux BSP? ?? ?? ??? ?? ??? ??? Jetson ???? ?? CUDA ???? ?????? ? ????. ? ?????? ?? Jetson Linux BSP? ?? ???? ???? ?? ??? ?????.
Jetson?? CUDA? ??????? ??
CUDA 11.8? ???? ?? CUDA ???? ???? ?? 6? ?? ??? ????? aarch64-Jetson? ?? aarch64-Jetson CUDA ?? ????? ?? ???? ?? ?? ???? ?? CUDA ???? ?????? ???? ? ???? ?? CUDA ???? ???? ??? ?? ??? ??? ?????.
??? aarch64-Jetson CUDA ????? CUDA ??? ????? ???? ?? ?? ???? ?????. ???? ??? ?? ??? CUDA ????? ???? Jetson ????? ???? CUDA ??? ?? ???? ? ????? ???.
??? ????? ???? ??? ?? ?? ?? ?????? ??? ? ????. ?? ?? ?? ?????? 11.8? ?? ? ????.
/usr/local/cuda-11.8/????? ???? ??? ?? ??? ?????.
- libcuda.so.*: CUDA ????.
- libnvidia-nvvm.so.*: ??? ?? ?? ???(CUDA 11.8 ??? ??).
- libnvidia-ptxjitcompiler.so.*: PTX ??? JIT(??) ???????.
??? ??? ?? CUDA ???? ?????? ?????. ? ???? ???? ???? ???? ???? ????.
x86 ????? ???? aarch64-Jetson ???? ?? ????? ?? U20.04 CUDA ??? ????? CUDA ???? ????? ?? ? ????. ?? ??? ??? ?? ?????? ??? ? ????.
aarch64-jetson/cross/Ubuntu/20.04/deb installer??
?? ?? ??? CUDA ????? ???? ???? ??????? ???? ? ???? ??? ?????.
$ sudo apt-get -y install cuda
Reading package lists...
Building dependency tree...
Reading state information...
The following additional packages will be installed:
cuda-11-8 cuda-cccl-11-8 cuda-command-line-tools-11-8 cuda-compat-11-8
...<snip>…
The following NEW packages will be installed:
cuda cuda-11-8 cuda-cccl-11-8 cuda-command-line-tools-11-8 cuda-compat-11-8
...<snip>…
0 upgraded, 48 newly installed, 0 to remove and 38 not upgraded.
Need to get 15.7 MB/1,294 MB of archives.
After this operation, 4,375 MB of additional disk space will be used.
Get:1 http://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/arm64 cuda-compat-11-8 11.8.31058490-1 [15.8 MB]
Fetched 15.7 MB in 12s (1,338 kB/s)
Selecting previously unselected package cuda-compat-11-8.
(Reading database ...
...<snip>…
(Reading database ... 100%
(Reading database ... 148682 files and directories currently installed.)
Preparing to unpack .../00-cuda-compat-11-8_11.8.31058490-1_arm64.deb ...
Unpacking cuda-compat-11-8 (11.8.31058490-1) ...
...<snip>…
Unpacking cuda-11-8 (11.8.0-1) ...
Selecting previously unselected package cuda.
Preparing to unpack .../47-cuda_11.8.0-1_arm64.deb ...
Unpacking cuda (11.8.0-1) ...
Setting up cuda-toolkit-config-common (11.8.56-1) ...
Setting up cuda-compat-11-8 (11.8.31058490-1) ...
$ ls -l /usr/local/cuda-11.8/compat
total 55300
lrwxrwxrwx 1 root root 12 Jan 6 19:14 libcuda.so -> libcuda.so.1
lrwxrwxrwx 1 root root 14 Jan 6 19:14 libcuda.so.1 -> libcuda.so.1.1
-rw-r--r-- 1 root root 21702832 Jan 6 19:14 libcuda.so.1.1
lrwxrwxrwx 1 root root 19 Jan 6 19:14 libnvidia-nvvm.so -> libnvidia-nvvm.so.4
lrwxrwxrwx 1 root root 23 Jan 6 19:14 libnvidia-nvvm.so.4 -> libnvidia-nvvm.so.4.0.0
-rw-r--r-- 1 root root 24255256 Jan 6 19:14 libnvidia-nvvm.so.4.0.0
-rw-r--r-- 1 root root 10665608 Jan 6 19:14 libnvidia-ptxjitcompiler.so
lrwxrwxrwx 1 root root 27 Jan 6 19:14 libnvidia-ptxjitcompiler.so.1 -> libnvidia-ptxjitcompiler.so
The user can set LD_LIBRARY_PATH to include the libraries installed by upgrade package before running the CUDA 11.8 application:
$ LD_LIBRARY_PATH=/usr/local/cuda-11.8/compat:$LD_LIBRARY_PATH ~/Samples/1_Utilities/deviceQuery
CUDA Device Query (Runtime API) version (CUDART static linking)
Detected 1 CUDA Capable device(s)
Device 0: "Orin"
CUDA Driver Version / Runtime Version 11.8 / 11.8
CUDA Capability Major/Minor version number: 8.7
...<snip>...
deviceQuery, CUDA Driver = CUDART, CUDA Driver Version = 11.8, CUDA Runtime Version = 11.8, NumDevs = 1
Result = PASS?? ????(?? NVIDIA JetPack ? Jetson Linux BSP? ??? ?? ???)? ?? ?????? ?????. ??????? CUDA? ?? ??(?? NVIDIA JetPack? ?? ???) ?? ????? ???? ?? ??? ??? ??? ? ????. LD_LIBRARY_PATH ??? ???? ??? ??? ?????.
?? ????? ???? ?? CUDA ????? ???? ??? ? ????. ??? CUDA ????? ???? ???? ?? ??? ????? ???? ?? ??? ???? ? ???? ?????. ????? ???? NVIDIA JetPack ??? ???? ??? ??? ?????.
?? ??, ??? CUDA 11.4? ???? ??????? CUDA ????? ?? ????? ?? CUDA 11.8 ????? ???? ?? ?????.
? 1? NVIDIA JetPack 5.0 ???? ?? CUDA ??? ?? ????(UMD) ? CUDA ?? ?? ???? ?????.
? 1. CUDA ?? ????? CUDA UMD ?? ???
| CUDA UMD | CUDA ?? | |
| 11.4 (???, NVIDIA JetPack? ??) | 11.8 | |
| 11.4 (???, NVIDIA JetPack? ??) | C | C (??? ?? ???) |
| 11.8 (????? ??? ??) | C | C |
C = ??, X = ???? ??
?? ??
- ? ??? CUDA 11.8 ? NVIDIA JetPack 5.0?? ?? ???? ?? Jetson Linux ????? ?????.
- CUDA ????? ???? ??? NVIDIA JetPack SDK ?? ??? ??? ????? CUDA ???? ?????? ???????. ?? CUDA ????? ??? ??? ????? NVIDIA JetPack SDK ?? ?? ?? ?????? ??? ?? ?? ? ??? ??? ? ????. ?? ???? ?? ??? ??? CUDA ??? ??? ?????.
- ?? NVIDIA JetPack SDK? ?? CUDA ??? ???? ?? ???? ???? NVIDIA JetPack SDK ??? ??? CUDA ??? ????? ???? ???. ?? ??? ?? ??? ??? CUDA for Tegra ? ??? ??????.
Jetson??? CUDA, cuDNN, TensorRT ?? ??? ??? Jetson Linux(L4T)? ?? ??? ???? ???????. ?? ??? ??? ???? ???????? Jetson Linux?? ?????? ???? ????.
NVIDIA? Jetson ???? Jetson Linux? ??????? ??? ?? ??? ????? ???? ??????? ? ?? ??? ?? ???? ????. CUDA ?????? ???? ? CUDA ??? ?? ???? ???? ? ?????.
?? Jetson? ?? CUDA ???? ????????!
- CUDA 11.8 ???? ????? aarch64-Jetson? CUDA ?? ???? ?????? ?? ??? ?? Jetson ????? CUDA 11.8? ?????????.
- Jetson? CUDA ????? ??? ???? ?? ??? ??? CUDA for Tegra ? ???? ?????.
- CUDA 11.8? ???? ?? ??? ??? ?? ??? CUDA 11.8 Omnibus? ?????.
- ?? ??? ??? ??? ??? ?? Jetson ??? ??? ?????.
NVIDIA JetPack 5 ?? ?? ???? ?????. CUDA? Jetson ?? ? ??? ??? ?? ?? ??? ???? ????? ??? ? ? ?? ??? ????!
? ???? ??? SDK? ???? ?? ???, ?? ???, ?? ??, ??, ?? ??, ???? NVIDIA ??? ???? ??? ??? ??? ??? ? ????. ?? ??? ???? NVIDIA? ?? ????? ???? ? ??? ??? ??? ?????? ???? ??? ??? ???.
