Large Language Models (LLMs) – NVIDIA Technical Blog http://www.open-lab.net/ko-kr/blog Tue, 28 Nov 2023 01:29:12 +0000 ko-KR hourly 1 SteerLM: ?? ?? LLM? ?? ??? ? ?? ???? ???? ?? http://www.open-lab.net/ko-kr/blog/announcing-steerlm-a-simple-and-practical-technique-to-customize-llms-during-inference/ http://www.open-lab.net/ko-kr/blog/announcing-steerlm-a-simple-and-practical-technique-to-customize-llms-during-inference/#respond Wed, 18 Oct 2023 05:21:33 +0000 http://www.open-lab.net/ko-kr/blog/?p=2060 Reading Time: 6 minutes ?? ? ? ?? GPT-3, Megatron-Turing, Chinchilla, PaLM-2, Falcon, Llama 2? ?? ??? ?? ??(LLM)? ???? ??? ??? ??? ?? ??? ???????. ??? ??? ??? ???? ??? ? ?? ???? ???? ?? LLM? ??? ???? ?? ???? ??? ??? ???? ?? ? ????. ?? LLM? ???? ?? ?? ??? ??? ??? ?? ?? ?? ??(SFT)? … Continued]]> Reading Time: 6 minutes ?? ? ? ?? GPT-3, Megatron-Turing, Chinchilla, PaLM-2, Falcon, Llama 2? ?? ??? ?? ??(LLM)? ???? ??? ??? ??? ?? ??? ???????. ??? ??? ??? ???? ??? ? ?? ???? ???? ?? LLM? ??? ???? ?? ???? ??? ??? ???? ?? ? ????. ?? LLM? ???? ?? ?? ??? ??? ??? ?? ?? ?? ??(SFT)? ??? ???? ?? ?? ??(RLHF)? ?????. RLHF? ??? ???? ? ???, ??? ??? ? ??? ?? ?? ? ? ?? ??? ????. ??? ??? ???? ??…

Source

]]> http://www.open-lab.net/ko-kr/blog/announcing-steerlm-a-simple-and-practical-technique-to-customize-llms-during-inference/feed/ 0 2060 ?? ?? ????? ??? ????? TensorRT-LLM??? http://www.open-lab.net/ko-kr/blog/nvidia-tensorrt-llm-supercharges-large-language-model-inference-on-nvidia-h100-gpus/ http://www.open-lab.net/ko-kr/blog/nvidia-tensorrt-llm-supercharges-large-language-model-inference-on-nvidia-h100-gpus/#respond Tue, 12 Sep 2023 07:26:14 +0000 http://www.open-lab.net/ko-kr/blog/?p=2001 Reading Time: 5 minutes ??? ?? ??(LLM)? ???? ??? ??? AI? ??? ??? ????. ??? ? ??? ??? ?? ???? ?? ???? ???? ???? ??? ? ????. ??? NVIDIA? ??? ?? ?? ??? ????? ????? ?? ??(Meta), ?????(Anyscale), ???(Cohere), ??(Deci), ????(Grammarly), ???? AI(Mistral AI), ?? ??????(Databricks)? ??? ????ML(MosaicML), ??ML(OctoML), ???(Tabnine), ??? AI(Together AI), ??(Uber) ? ?? ???? ??? ?????. ??? ??? ? ? ?? ?? ??? ?? ?? ?????? NVIDIA?TensorRT-LLM? ?????,????(Ampere),??????(Lovelace)? ??(Hopper) GPU?? ??? ? ????.?TensorRT-LLM? TensorRT?? … Continued]]> Reading Time: 5 minutes ??? ?? ??(LLM)? ???? ??? ??? AI? ??? ??? ????. ??? ? ??? ??? ?? ???? ?? ???? ???? ???? ??? ? ????. ??? NVIDIA? ??? ?? ?? ??? ????? ????? ?? ??(Meta), ?????(Anyscale), ???(Cohere), ??(Deci), ????(Grammarly), ???? AI(Mistral AI), ?? ??????(Databricks)? ??? ????ML(MosaicML), ??ML(OctoML), ???(Tabnine), ??? AI(Together AI), ??(Uber) ? ?? ???? ??? ?????. ??? ??? ? ?…

Source

]]> http://www.open-lab.net/ko-kr/blog/nvidia-tensorrt-llm-supercharges-large-language-model-inference-on-nvidia-h100-gpus/feed/ 0 2001 LLM ???? ?? ?? ???? ?? Ask Me Anything ??? http://www.open-lab.net/ko-kr/blog/kr-llm-training-ama/ http://www.open-lab.net/ko-kr/blog/kr-llm-training-ama/#comments Thu, 31 Aug 2023 04:59:26 +0000 http://www.open-lab.net/ko-kr/blog/?p=1972 Reading Time: < 1 minute NVIDIA AI ??? ??? ??? ???? Ask Me Anything (AMA) ??? ?????.  9? 5? (?) ?? 2??? 4??? ???? ??? AMA ???? ??? LLM Training : Megatron-LM VS NeMo Framework? ????? NVIDIA? ?? ????? ?? ???? ??? ?? LLM ????? ????? ??? ?? ?? ?? ? ????. Megatron-LM? ????, NeMo ?????? ??? ? LLM ?? … Continued]]> Reading Time: < 1 minute NVIDIA AI ??? ??? ??? ???? Ask Me Anything (AMA) ??? ?????. 9? 5? (?) ?? 2??? 4??? ???? ??? AMA ???? ??? LLM Training : Megatron-LM VS NeMo Framework? ????? NVIDIA? ?? ????? ?? ???? ??? ?? LLM ????? ????? ??? ?? ?? ?? ? ????. Megatron-LM? ????, NeMo ?????? ??? ? LLM ?? ??? ?? ??? ???? ???? ??? ??? ?? NVIDIA ?? ????? Connect ???? ???????. ??? ?? ??? ?? ??? ?? ??? ??…

Source

]]> http://www.open-lab.net/ko-kr/blog/kr-llm-training-ama/feed/ 2 1972 ?? ?? ?? ?? ?? ?? ???? http://www.open-lab.net/ko-kr/blog/selecting-large-language-model-customization-techniques/ http://www.open-lab.net/ko-kr/blog/selecting-large-language-model-customization-techniques/#respond Wed, 16 Aug 2023 03:18:59 +0000 http://www.open-lab.net/ko-kr/blog/?p=1924 Reading Time: 7 minutes ?? ?? ??(LLM)? ??? ??, ?? ?? ?? ? ?? ?? ????? ???? ? ???? ??? ?? ?? ????. ??? ?? LLM? ??? ??, ??? ??? ?? ??? ?? ???? ?? ??? ?? ?? ??? ???? ??? ??? ????. ?? ? ?? ??? LLM? ??? ?????. ??? ?? ?? ??? ??? ??? ?? ?? ?? … Continued]]> Reading Time: 7 minutes ?? ?? ??(LLM)? ??? ??, ?? ?? ?? ? ?? ?? ????? ???? ? ???? ??? ?? ?? ????. ??? ?? LLM? ??? ??, ??? ??? ?? ??? ?? ???? ?? ??? ?? ?? ??? ???? ??? ??? ????. ?? ? ?? ??? LLM? ??? ?????. ??? ?? ?? ??? ??? ??? ?? ?? ?? ??? ??? ? ?? ??? ??? ?????. ??? LLM? ?? ??? ?? ?? ?? ?? ???? ???? ?? ????? ???? ???? ??? ? ????. ??? ??? ?? ??? ??? ???? ???? ???? ???? ???…

Source

]]> http://www.open-lab.net/ko-kr/blog/selecting-large-language-model-customization-techniques/feed/ 0 1924 NVIDIA AI Workbench? ?? ?? ??? ??? AI ??? ??? ?? ? ?? http://www.open-lab.net/ko-kr/blog/develop-and-deploy-scalable-generative-ai-models-seamlessly-with-nvidia-ai-workbench/ http://www.open-lab.net/ko-kr/blog/develop-and-deploy-scalable-generative-ai-models-seamlessly-with-nvidia-ai-workbench/#respond Fri, 11 Aug 2023 06:55:56 +0000 http://www.open-lab.net/ko-kr/blog/?p=1914 Reading Time: 6 minutes ??? ??? AI ??? ??????? ???? ?? ???? ??? ?????. ??? ?? ???? ??? ?? ??? ?? ?? ??? ??? ???? ??? ????, ???? ?? ?? ??? ?? ??? ????? ?? ??? ????. ? ? ????? ????? PC? ??????? ?? ??? ??? ??? ???? ???? ???. ??? ???? ??? ??? ??? ?? ???? ??? ?? … Continued]]> Reading Time: 6 minutes ??? ??? AI ??? ??????? ???? ?? ???? ??? ?????. ??? ?? ???? ??? ?? ??? ?? ?? ??? ??? ???? ??? ????, ???? ?? ?? ??? ?? ??? ????? ?? ??? ????. ? ? ????? ????? PC? ??????? ?? ??? ??? ??? ???? ???? ???. ??? ???? ??? ??? ??? ?? ???? ??? ?? ?? ????? ?? ??? ???? ???? ???. ?? ?? ??? ????? ???? ????? ? ? ? ????? ?? ???? ??? ?? ??? ? ????. NVIDIA AI ????? ???, ??, ??? ? ??? ??…

Source

]]> http://www.open-lab.net/ko-kr/blog/develop-and-deploy-scalable-generative-ai-models-seamlessly-with-nvidia-ai-workbench/feed/ 0 1914 ??? ?? ??? ???? ?? http://www.open-lab.net/ko-kr/blog/how-to-create-a-custom-language-model/ http://www.open-lab.net/ko-kr/blog/how-to-create-a-custom-language-model/#respond Wed, 12 Jul 2023 06:03:56 +0000 http://www.open-lab.net/ko-kr/blog/?p=1776 Reading Time: 8 minutes ??? ?? ??? ???? ??????? ?? ? ? ?? ? ???? ????? ? ?? ??? ???? ?? ? ????. ???? ???? ??? ?? ??? ???? ?????.]]> Reading Time: 8 minutes ??? AI? ?? ? ? ?? ??? ??? ???? ???????. ??? ??? ??? ??? ??? ?????? ? ??? ???? ?? ????? ???? ????? ?? ??? ??? ??? ? ????. ??? ??? ???? ??? ?? ??(LLM)? ????. LLM? ??? ??? ????? ?? ?? ????, ??? ??? ? ????? ?? ?? ??? ?? ??? ? ????. ???? ??, ??, ?? ??, ?? ?? ?? ? ?? ?? ?????. ?? ?? ?? ??? ?? ??? ??? ? ?? ??? ??? ??? AI ????? ????? ????, ?? ?? ??? ???? ?? ? ?? ???? ??…

Source

]]> http://www.open-lab.net/ko-kr/blog/how-to-create-a-custom-language-model/feed/ 0 1776 NVIDIA Faster Transformer? ?? KoGPT? ?? ??? http://www.open-lab.net/ko-kr/blog/increasing-inference-acceleration-of-kogpt-with-fastertransformer/ http://www.open-lab.net/ko-kr/blog/increasing-inference-acceleration-of-kogpt-with-fastertransformer/#respond Fri, 28 Apr 2023 04:51:09 +0000 http://www.open-lab.net/ko-kr/blog/?p=1538 Reading Time: 4 minutes ?????? ??? ?? ??? ?? AI ?? ???? ? ???? ?? AI R&D? ??? ???? ????. ??? ??(NLP)? ?? ??? ?? ??? ?????? ?? ??? ??, ?? ?? ??, ?? ?? ??, ?? ??? ?? ? ?? ?? AI ??? ???? ????.  ????? ??????? ????? ????? ???? ??? ?? ??? ?? ??? ‘KoGPT’? ??????. ??? … Continued]]> Reading Time: 4 minutes ?????? ??? ?? ??? ?? AI ?? ???? ? ???? ?? AI R&D? ??? ???? ????. ??? ??(NLP)? ?? ??? ?? ??? ?????? ?? ??? ??, ?? ?? ??, ?? ?? ??, ?? ??? ?? ? ?? ?? AI ??? ???? ????. ????? ??????? ????? ????? ???? ??? ?? ??? ?? ??? ‘KoGPT’? ??????. ??? ??? ????? ???? FasterTransformer? ??? ???? ??????. ?? ?????? ????? ??????? ??? FasterTransformer? ?? KoGPT? ?????? ???????.

Source

]]> http://www.open-lab.net/ko-kr/blog/increasing-inference-acceleration-of-kogpt-with-fastertransformer/feed/ 0 1538 人人超碰97caoporen国产