Python – NVIDIA Technical Blog http://www.open-lab.net/ko-kr/blog Fri, 29 Nov 2024 07:42:44 +0000 ko-KR hourly 1 NVIDIA NIM?? ??? ?? ?? ?? AI ???? ???? http://www.open-lab.net/ko-kr/blog/build-your-first-human-in-the-loop-ai-agent-with-nvidia-nim/ Wed, 27 Nov 2024 06:50:36 +0000 http://www.open-lab.net/ko-kr/blog/?p=3335 Reading Time: 7 minutes ?? ?? ??(LLM)? ???? AI ????? ??? ???? ???? ????? ???? ??? ? ? ??? ???. ? ?????? ??? ?? ?? ??? ?? ??? ???? ???? ????, ??? ??? ??? ??? ?????. ?? ??? ?? LLM ?? ????? ??? ????? ???? ??? ? ?? ??? ??? ???? ? ????. ??, ?? ???????? ??? ? ?? … Continued]]> Reading Time: 7 minutes ?? ?? ??(LLM)? ???? AI ????? ??? ???? ???? ????? ???? ??? ? ? ??? ???. ? ?????? ??? ?? ?? ??? ?? ??? ???? ???? ????, ??? ??? ??? ??? ?????. ?? ??? ?? LLM ?? ????? ??? ????? ???? ??? ? ?? ??? ??? ???? ? ????. ??, ?? ???????? ??? ? ?? ???? ??? ????? ?? AI ????? ??? ? ??? ??? ??? ???? ?? ?????. ? ?????? NVIDIA? AI ??? ???? ???? API? NVIDIA NIM ???????? ??? ?? ? ?…

Source

]]>
3335
SteerLM: ?? ?? LLM? ?? ??? ? ?? ???? ???? ?? http://www.open-lab.net/ko-kr/blog/announcing-steerlm-a-simple-and-practical-technique-to-customize-llms-during-inference/ http://www.open-lab.net/ko-kr/blog/announcing-steerlm-a-simple-and-practical-technique-to-customize-llms-during-inference/#respond Wed, 18 Oct 2023 05:21:33 +0000 http://www.open-lab.net/ko-kr/blog/?p=2060 Reading Time: 6 minutes ?? ? ? ?? GPT-3, Megatron-Turing, Chinchilla, PaLM-2, Falcon, Llama 2? ?? ??? ?? ??(LLM)? ???? ??? ??? ??? ?? ??? ???????. ??? ??? ??? ???? ??? ? ?? ???? ???? ?? LLM? ??? ???? ?? ???? ??? ??? ???? ?? ? ????. ?? LLM? ???? ?? ?? ??? ??? ??? ?? ?? ?? ??(SFT)? … Continued]]> Reading Time: 6 minutes ?? ? ? ?? GPT-3, Megatron-Turing, Chinchilla, PaLM-2, Falcon, Llama 2? ?? ??? ?? ??(LLM)? ???? ??? ??? ??? ?? ??? ???????. ??? ??? ??? ???? ??? ? ?? ???? ???? ?? LLM? ??? ???? ?? ???? ??? ??? ???? ?? ? ????. ?? LLM? ???? ?? ?? ??? ??? ??? ?? ?? ?? ??(SFT)? ??? ???? ?? ?? ??(RLHF)? ?????. RLHF? ??? ???? ? ???, ??? ??? ? ??? ?? ?? ? ? ?? ??? ????. ??? ??? ???? ??…

Source

]]>
http://www.open-lab.net/ko-kr/blog/announcing-steerlm-a-simple-and-practical-technique-to-customize-llms-during-inference/feed/ 0 2060
NVIDIA Faster Transformer? ?? KoGPT? ?? ??? http://www.open-lab.net/ko-kr/blog/increasing-inference-acceleration-of-kogpt-with-fastertransformer/ http://www.open-lab.net/ko-kr/blog/increasing-inference-acceleration-of-kogpt-with-fastertransformer/#respond Fri, 28 Apr 2023 04:51:09 +0000 http://www.open-lab.net/ko-kr/blog/?p=1538 Reading Time: 4 minutes ?????? ??? ?? ??? ?? AI ?? ???? ? ???? ?? AI R&D? ??? ???? ????. ??? ??(NLP)? ?? ??? ?? ??? ?????? ?? ??? ??, ?? ?? ??, ?? ?? ??, ?? ??? ?? ? ?? ?? AI ??? ???? ????.  ????? ??????? ????? ????? ???? ??? ?? ??? ?? ??? ‘KoGPT’? ??????. ??? … Continued]]> Reading Time: 4 minutes ?????? ??? ?? ??? ?? AI ?? ???? ? ???? ?? AI R&D? ??? ???? ????. ??? ??(NLP)? ?? ??? ?? ??? ?????? ?? ??? ??, ?? ?? ??, ?? ?? ??, ?? ??? ?? ? ?? ?? AI ??? ???? ????. ????? ??????? ????? ????? ???? ??? ?? ??? ?? ??? ‘KoGPT’? ??????. ??? ??? ????? ???? FasterTransformer? ??? ???? ??????. ?? ?????? ????? ??????? ??? FasterTransformer? ?? KoGPT? ?????? ???????.

Source

]]>
http://www.open-lab.net/ko-kr/blog/increasing-inference-acceleration-of-kogpt-with-fastertransformer/feed/ 0 1538
???? ??? ??: RAPIDS cuDF? ?? ??? ??? ?? http://www.open-lab.net/ko-kr/blog/accelerated-data-analytics-faster-time-series-analysis-with-rapids-cudf/ http://www.open-lab.net/ko-kr/blog/accelerated-data-analytics-faster-time-series-analysis-with-rapids-cudf/#respond Wed, 26 Apr 2023 13:51:59 +0000 http://www.open-lab.net/ko-kr/blog/?p=1529 Reading Time: 5 minutes ? ???? ???? ??? ??? ?? ???? ?????: ????? ?? ??? ???? ??? ?? ??? ??? ??(EDA) ???????? pandas? ??? ?????? ?? ???? ??? ?? ?????? RAPIDS cuDF? ??? ?? ???? ??? ?? ? ????. ??? ???? ?????? ??? ???? ??? ?? ??? ??? ??? ?? ??? ??? ?? ???, RAPIDS? ???? ? ?? ??? … Continued]]> Reading Time: 5 minutes ? ???? ???? ??? ??? ?? ???? ?????: ????? ?? ??? ???? ??? ?? ??? ??? ??(EDA) ???????? pandas? ??? ?????? ?? ???? ??? ?? ?????? RAPIDS cuDF? ??? ?? ???? ??? ?? ? ????. ??? ???? ?????? ??? ???? ??? ?? ??? ??? ??? ?? ??? ??? ?? ???, RAPIDS? ???? ? ?? ??? ?? ?????. RAPIDS cuDF? ???? ?? ??? ??? ?? ‘????’ ??? ??? ?? ??? ?? ??? ?? ? ????. ??? ??? ??? ???? ??????…

Source

]]>
http://www.open-lab.net/ko-kr/blog/accelerated-data-analytics-faster-time-series-analysis-with-rapids-cudf/feed/ 0 1529
???? ??? ??: RAPIDS cuDF? ??? ?? ?? ?? http://www.open-lab.net/ko-kr/blog/accelerated-data-analytics-speed-up-data-exploration-with-rapids-cudf/ http://www.open-lab.net/ko-kr/blog/accelerated-data-analytics-speed-up-data-exploration-with-rapids-cudf/#respond Fri, 21 Apr 2023 04:38:23 +0000 http://www.open-lab.net/ko-kr/blog/?p=1511 Reading Time: 6 minutes ? ???? ???? ??? ??? ?? ???? ?????: ?? ???, ??, ??, ???? ??? ???? ?? ?? ?? ??? ???? ???? ????. IDC? ??? 2025??? 2020?? 64ZB? ?? 180ZB? ???? ??? ???, ? ?? ???? ????? ???? ?? ??? ??? ???? ??? ????. NVIDIA? ??? ??????? ????? ??? ???? ? ?? ?????? ???? GPU?? ??? … Continued]]> Reading Time: 6 minutes ? ???? ???? ??? ??? ?? ???? ?????: ?? ???, ??, ??, ???? ??? ???? ?? ?? ?? ??? ???? ???? ????. IDC? ??? 2025??? 2020?? 64ZB? ?? 180ZB? ???? ??? ???, ? ?? ???? ????? ???? ?? ??? ??? ???? ??? ????. NVIDIA? ??? ??????? ????? ??? ???? ? ?? ?????? ???? GPU?? ??? ? ??? ?? ?? ????? ????? ? API? RAPIDS ???? ?????. ???? ?? ? ??? ????? ?? ???? ??? ?? ???…

Source

]]>
http://www.open-lab.net/ko-kr/blog/accelerated-data-analytics-speed-up-data-exploration-with-rapids-cudf/feed/ 0 1511
AI ??? ???? NVIDIA Triton? NVIDIA TensorRT? ??? ?? http://www.open-lab.net/ko-kr/blog/power-your-ai-inference-with-new-nvidia-triton-and-nvidia-tensorrt-features/ http://www.open-lab.net/ko-kr/blog/power-your-ai-inference-with-new-nvidia-triton-and-nvidia-tensorrt-features/#respond Tue, 04 Apr 2023 02:29:48 +0000 http://www.open-lab.net/ko-kr/blog/?p=1441 Reading Time: 3 minutes NVIDIA AI ?? ?????? ???? ?? ??? ?????? NVIDIA Triton ?? ??? ? ?? ?? ?????? ???? ???? ??? ? ?? ??? SDK? NVIDIA TensorRT? ????, ?? AI ? ?? ?? ??? ?? ???? ??? ?????. NVIDIA Triton? ?? ?? ??(ML) ??? CPU? ?? ??? ??????. ? ?????? ? ?????? ?? ??? ??? ?? ???? … Continued]]> Reading Time: 3 minutes NVIDIA AI ?? ?????? ???? ?? ??? ?????? NVIDIA Triton ?? ??? ? ?? ?? ?????? ???? ???? ??? ? ?? ??? SDK? NVIDIA TensorRT? ????, ?? AI ? ?? ?? ??? ?? ???? ??? ?????. NVIDIA Triton? ?? ?? ??(ML) ??? CPU? ?? ??? ??????. ? ?????? ? ?????? ?? ??? ??? ?? ???? ?????. NVIDIA Triton NVIDIA Triton? ??? ???? PyTriton? ?? ???(Python) ?? ??, ?? ??? ????, NVIDIA Triton ?? ???…

Source

]]>
http://www.open-lab.net/ko-kr/blog/power-your-ai-inference-with-new-nvidia-triton-and-nvidia-tensorrt-features/feed/ 0 1441
Tox? ?? ??? ???? ???? ????? ?? http://www.open-lab.net/ko-kr/blog/how-to-manage-virtual-environments-and-automate-testing-with-tox/ http://www.open-lab.net/ko-kr/blog/how-to-manage-virtual-environments-and-automate-testing-with-tox/#respond Fri, 10 Mar 2023 08:06:21 +0000 http://www.open-lab.net/ko-kr/blog/?p=1390 Reading Time: 6 minutes ?? ???? Python?? ???? ????? ????? ?? ????? tox? ?????. ??? ? ??? ??? ????? ???? ??? ??? ??? ? ?? ?? ??? ??? ??? ????. ?? ??, tox? “? ???? ????(it works on my machine)”? ??? ?? ??? ?????? ???. ???? ??? ?? ? ?? ??? ????: ??, ?? ??? ?? ?? ??? ??? … Continued]]> Reading Time: 6 minutes ?? ???? Python?? ???? ????? ????? ?? ????? tox? ?????. ??? ? ??? ??? ????? ???? ??? ??? ??? ? ?? ?? ??? ??? ??? ????. ?? ??, tox? “? ???? ????(it works on my machine)”? ??? ?? ??? ?????? ???. ???? ??? ?? ? ?? ??? ????: ??, ?? ??? ?? ?? ??? ??? Windows, macOS ? Linux OS?? ??? ? ??? ????. ? ??????? tox? ?? ??? ?? ???? ??? ???? ???? ??? ??? ???????. ?? ???? ?? ???…

Source

]]>
http://www.open-lab.net/ko-kr/blog/how-to-manage-virtual-environments-and-automate-testing-with-tox/feed/ 0 1390
CUDA ???? ??? ?? ?? http://www.open-lab.net/ko-kr/blog/cuda-context-independent-module-loading/ http://www.open-lab.net/ko-kr/blog/cuda-context-independent-module-loading/#respond Wed, 21 Dec 2022 04:09:46 +0000 http://www.open-lab.net/ko-kr/blog/?p=1122 Reading Time: 3 minutes ???? CUDA ???? CUDA ????? ???? ??? ???? ??? ???? ?? cuModuleLoad API? ?? ???? API? ???? ?? ?????. ???? ????? ?? ????? ??? ???? ??? ???? ???. ?? ???? ? CUDA ????? ?? ??? ????? ???? ???. ?? ???? ??? ??? ???? ?? ?????? ?????? ??? ????? ???? ????? ?? ???? ???.  ? ?????? … Continued]]> Reading Time: 3 minutes ???? CUDA ???? CUDA ????? ???? ??? ???? ??? ???? ?? cuModuleLoad API? ?? ???? API? ???? ?? ?????. ???? ????? ?? ????? ??? ???? ??? ???? ???. ?? ???? ? CUDA ????? ?? ??? ????? ???? ???. ?? ???? ??? ??? ???? ?? ?????? ?????? ??? ????? ???? ????? ?? ???? ???. ? ?????? ??? ??? ???? ?? CUDA 12.0? ??? ????? ???? ?? ??? ?? ?????. ???? ?? ??(Context-dependent loading)…

Source

]]>
http://www.open-lab.net/ko-kr/blog/cuda-context-independent-module-loading/feed/ 0 1122
NVIDIA Tools Extension API: Python ? C/C++?? ??? ??????? ?? ?? ?? http://www.open-lab.net/ko-kr/blog/nvidia-tools-extension-api-python-%eb%b0%8f-c-c%ec%97%90%ec%84%9c-%ec%bd%94%eb%93%9c%eb%a5%bc-%ed%94%84%eb%a1%9c%ed%8c%8c%ec%9d%bc%eb%a7%81%ed%95%98%ea%b8%b0-%ec%9c%84%ed%95%9c-%ec%a3%bc%ec%84%9d/ http://www.open-lab.net/ko-kr/blog/nvidia-tools-extension-api-python-%eb%b0%8f-c-c%ec%97%90%ec%84%9c-%ec%bd%94%eb%93%9c%eb%a5%bc-%ed%94%84%eb%a1%9c%ed%8c%8c%ec%9d%bc%eb%a7%81%ed%95%98%ea%b8%b0-%ec%9c%84%ed%95%9c-%ec%a3%bc%ec%84%9d/#respond Fri, 12 Aug 2022 06:26:03 +0000 http://www.open-lab.net/ko-kr/blog/?p=705 Reading Time: 6 minutes PyData? CUDA? ???? ?? ?? ??? ?? ??? ??? ???? ??? ???? ??? ????, CPU ? GPU ??? ?? ????? ? ?? ??? ?????.   Python ??????? ??? ????? ??? ??? cProfile? ?? ?? ?????? PySpy/Viztracer? ?? C ????? ?? ??? ??? ? ?? ?????? ????.   Python ????? ? ?? ?? GPU?? ???? ??? … Continued]]> Reading Time: 6 minutes PyData? CUDA? ???? ?? ?? ??? ?? ??? ??? ???? ??? ???? ??? ????, CPU ? GPU ??? ?? ????? ? ?? ??? ?????. Python ??????? ??? ????? ??? ??? cProfile? ?? ?? ?????? PySpy/Viztracer? ?? C ????? ?? ??? ??? ? ?? ?????? ????. Python ????? ? ?? ?? GPU?? ???? ??? ?????? ? ????. ???? ???/?????? ???? ????? Python? GPU?? ???? ?? ???? ? ??? ?? ??? ?????. ??? ??? ??? ?????.

Source

]]>
http://www.open-lab.net/ko-kr/blog/nvidia-tools-extension-api-python-%eb%b0%8f-c-c%ec%97%90%ec%84%9c-%ec%bd%94%eb%93%9c%eb%a5%bc-%ed%94%84%eb%a1%9c%ed%8c%8c%ec%9d%bc%eb%a7%81%ed%95%98%ea%b8%b0-%ec%9c%84%ed%95%9c-%ec%a3%bc%ec%84%9d/feed/ 0 705
CUDA ??? ?: ??? ?? GPU ????? nvprof http://www.open-lab.net/ko-kr/blog/cuda-%ec%a0%84%eb%ac%b8%ea%b0%80-%ed%8c%81-%ec%9c%a0%ec%9a%a9%ed%95%9c-%eb%b2%94%ec%9a%a9-gpu-%ed%94%84%eb%a1%9c%ed%8c%8c%ec%9d%bc%eb%9f%ac-nvprof/ http://www.open-lab.net/ko-kr/blog/cuda-%ec%a0%84%eb%ac%b8%ea%b0%80-%ed%8c%81-%ec%9c%a0%ec%9a%a9%ed%95%9c-%eb%b2%94%ec%9a%a9-gpu-%ed%94%84%eb%a1%9c%ed%8c%8c%ec%9d%bc%eb%9f%ac-nvprof/#respond Fri, 12 Aug 2022 04:46:56 +0000 http://www.open-lab.net/ko-kr/blog/?p=693 Reading Time: 4 minutes CUDA 5? CUDA ??? nvprof?? ??? ? ??? ???????. nvprof? Linux, Windows ? OS X?? ??? ? ?? ??? ????????. ?? ?? nvprof? NVIDIA Visual Profiler ? NSight Eclipse Edition?? ??? ? ?? ??? ????? ???? GUI? ?? ???? ?? ? ????. ??? nvprof? ? ??? ??? ????. ?? ??? nvprof? ?? ???? ??? ? ?? … Continued]]> Reading Time: 4 minutes CUDA 5? CUDA ??? nvprof?? ??? ? ??? ???????. nvprof? Linux, Windows ? OS X?? ??? ? ?? ??? ????????. ?? ?? nvprof? NVIDIA Visual Profiler ? NSight Eclipse Edition?? ??? ? ?? ??? ????? ???? GUI? ?? ???? ?? ? ????. ??? nvprof? ? ??? ??? ????. ?? ??? nvprof? ?? ???? ??? ? ?? ??? ?? ????????. ?? CUDA ??????? ???? ???? ??? ??? ?? ????. ??? ?????? ???? ?? ??? ????.

Source

]]>
http://www.open-lab.net/ko-kr/blog/cuda-%ec%a0%84%eb%ac%b8%ea%b0%80-%ed%8c%81-%ec%9c%a0%ec%9a%a9%ed%95%9c-%eb%b2%94%ec%9a%a9-gpu-%ed%94%84%eb%a1%9c%ed%8c%8c%ec%9d%bc%eb%9f%ac-nvprof/feed/ 0 693
人人超碰97caoporen国产