Megatron – NVIDIA Technical Blog
http://www.open-lab.net/ko-kr/blog
Thu, 31 Aug 2023 04:59:28 +0000
ko-KR
hourly
1
-
LLM ???? ?? ?? ???? ?? Ask Me Anything ???
http://www.open-lab.net/ko-kr/blog/kr-llm-training-ama/
http://www.open-lab.net/ko-kr/blog/kr-llm-training-ama/#comments
Thu, 31 Aug 2023 04:59:26 +0000
http://www.open-lab.net/ko-kr/blog/?p=1972
Reading Time: < 1 minute NVIDIA AI ??? ??? ??? ???? Ask Me Anything (AMA) ??? ?????. 9? 5? (?) ?? 2??? 4??? ???? ??? AMA ???? ??? LLM Training : Megatron-LM VS NeMo Framework? ????? NVIDIA? ?? ????? ?? ???? ??? ?? LLM ????? ????? ??? ?? ?? ?? ? ????. Megatron-LM? ????, NeMo ?????? ??? ? LLM ?? … Continued]]>
Reading Time: < 1 minute NVIDIA AI ??? ??? ??? ???? Ask Me Anything (AMA) ??? ?????. 9? 5? (?) ?? 2??? 4??? ???? ??? AMA ???? ??? LLM Training : Megatron-LM VS NeMo Framework? ????? NVIDIA? ?? ????? ?? ???? ??? ?? LLM ????? ????? ??? ?? ?? ?? ? ????. Megatron-LM? ????, NeMo ?????? ??? ? LLM ?? ??? ?? ??? ???? ???? ??? ??? ?? NVIDIA ?? ????? Connect ???? ???????. ??? ?? ??? ?? ??? ?? ??? ??…
Source
]]>
http://www.open-lab.net/ko-kr/blog/kr-llm-training-ama/feed/
2
1972
-
??? ?? GTC ??? : ??? ??, NLP, ?? ???, ??? ????
http://www.open-lab.net/ko-kr/blog/%eb%8b%b9%ec%8b%a0%ec%9d%84-%ec%9c%84%ed%95%9c-gtc-%ea%b0%80%ec%9d%b4%eb%93%9c-%ec%bb%b4%ed%93%a8%ed%84%b0-%eb%b9%84%ec%a0%84-nlp-%ec%b6%94%ec%b2%9c-%ec%8b%9c%ec%8a%a4%ed%85%9c-%ea%b7%b8%eb%a6%ac/
http://www.open-lab.net/ko-kr/blog/%eb%8b%b9%ec%8b%a0%ec%9d%84-%ec%9c%84%ed%95%9c-gtc-%ea%b0%80%ec%9d%b4%eb%93%9c-%ec%bb%b4%ed%93%a8%ed%84%b0-%eb%b9%84%ec%a0%84-nlp-%ec%b6%94%ec%b2%9c-%ec%8b%9c%ec%8a%a4%ed%85%9c-%ea%b7%b8%eb%a6%ac/#respond
Thu, 17 Mar 2022 08:27:35 +0000
http://www.open-lab.net/ko-kr/blog/?p=299
Reading Time: 3 minutes 3? 21??? 24??? GTC?? AI, ??? ??, ??? ??, ???? ?? ???? ?? ??? ?? ??? ?????! 900?? ??? ?? ? ?? ???? ? ?? ?? ? ?? ??? ???????. ??? ?? / ??? ?? ??? AI / NLP ?? ??? / ??? ???? ??? ?? / ??? ?? ??? ?? ???: ??? ?? ?? … Continued]]>
Reading Time: 3 minutes 3? 21??? 24??? GTC?? AI, ??? ??, ??? ??, ???? ?? ???? ?? ??? ?? ??? ?????! 900?? ??? ?? ? ?? ???? ? ?? ?? ? ?? ??? ???????. ??? ?? ???: ??? ?? ?? ??? ?? ?? ?? ??? ??(SORDI) ???? Jimmy Nassif, CTO, idealworks Marc Kamradt, BMW ?? TechOffice Munich ?? BMW? 56??? ???? ????. ??? ??? ??? ?? ? ????? ??? ??? ???? ?? ???? ?? ??? ?????. BMW…
Source
]]>
http://www.open-lab.net/ko-kr/blog/%eb%8b%b9%ec%8b%a0%ec%9d%84-%ec%9c%84%ed%95%9c-gtc-%ea%b0%80%ec%9d%b4%eb%93%9c-%ec%bb%b4%ed%93%a8%ed%84%b0-%eb%b9%84%ec%a0%84-nlp-%ec%b6%94%ec%b2%9c-%ec%8b%9c%ec%8a%a4%ed%85%9c-%ea%b7%b8%eb%a6%ac/feed/
0
299
-
Megatron? DeepSpeed? ? ???? ???? ?? ? ?? ?? ?? Megatron-Turing NLG ????(2)
http://www.open-lab.net/ko-kr/blog/megatron%ea%b3%bc-deepspeed%eb%a1%9c-%eb%8d%94-%ea%b0%95%eb%a0%a5%ed%95%b4%ec%a7%84-%ec%84%b8%ea%b3%84%ec%97%90%ec%84%9c-%ea%b0%80%ec%9e%a5-%ed%81%b0-%ec%83%9d%ec%84%b1-%ec%96%b8%ec%96%b4-%eb%aa%a8-2/
http://www.open-lab.net/ko-kr/blog/megatron%ea%b3%bc-deepspeed%eb%a1%9c-%eb%8d%94-%ea%b0%95%eb%a0%a5%ed%95%b4%ec%a7%84-%ec%84%b8%ea%b3%84%ec%97%90%ec%84%9c-%ea%b0%80%ec%9e%a5-%ed%81%b0-%ec%83%9d%ec%84%b1-%ec%96%b8%ec%96%b4-%eb%aa%a8-2/#respond
Mon, 24 Jan 2022 01:47:49 +0000
http://www.open-lab.net/ko-kr/blog/?p=144
Reading Time: 4 minutes Megatron? DeepSpeed? ? ???? ???? ?? ? ?? ?? ?? Megatron-Turing NLG ????(1)? ?????. ??? ?? ?? ??(LM) ??? ?? ??? ??? ???? ?? ????? ??? ??, ?? ??? ??? ???? NLP ??? ????? ??? ? ??? ?????. LM? ????? ??? ?? ?? ?? ??? ???? ??? ????? MT-NLG? ??? ??, ? ??? ?? ??? … Continued]]>
Reading Time: 4 minutes Megatron? DeepSpeed? ? ???? ???? ?? ? ?? ?? ?? Megatron-Turing NLG ????(1)? ?????. ?? ??(LM) ??? ?? ??? ??? ???? ?? ????? ??? ??, ?? ??? ??? ???? NLP ??? ????? ??? ? ??? ?????. LM? ????? ??? ?? ?? ?? ??? ???? ??? ????? MT-NLG? ??? ??, ? ??? ?? ??? NLP ????? ??? ??? ???? ???? ??????. ???? ??? ?? 5? ??? ?? 8?? ???? ??????. ???(reproducibility)? ????…
Source
]]>
http://www.open-lab.net/ko-kr/blog/megatron%ea%b3%bc-deepspeed%eb%a1%9c-%eb%8d%94-%ea%b0%95%eb%a0%a5%ed%95%b4%ec%a7%84-%ec%84%b8%ea%b3%84%ec%97%90%ec%84%9c-%ea%b0%80%ec%9e%a5-%ed%81%b0-%ec%83%9d%ec%84%b1-%ec%96%b8%ec%96%b4-%eb%aa%a8-2/feed/
0
144
-
Megatron? DeepSpeed? ? ???? ???? ?? ? ?? ?? ?? Megatron-Turing NLG ????(1)
http://www.open-lab.net/ko-kr/blog/megatron%ea%b3%bc-deepspeed%eb%a1%9c-%eb%8d%94-%ea%b0%95%eb%a0%a5%ed%95%b4%ec%a7%84-%ec%84%b8%ea%b3%84%ec%97%90%ec%84%9c-%ea%b0%80%ec%9e%a5-%ed%81%b0-%ec%83%9d%ec%84%b1-%ec%96%b8%ec%96%b4-%eb%aa%a8/
http://www.open-lab.net/ko-kr/blog/megatron%ea%b3%bc-deepspeed%eb%a1%9c-%eb%8d%94-%ea%b0%95%eb%a0%a5%ed%95%b4%ec%a7%84-%ec%84%b8%ea%b3%84%ec%97%90%ec%84%9c-%ea%b0%80%ec%9e%a5-%ed%81%b0-%ec%83%9d%ec%84%b1-%ec%96%b8%ec%96%b4-%eb%aa%a8/#respond
Mon, 24 Jan 2022 01:45:01 +0000
http://www.open-lab.net/ko-kr/blog/?p=137
Reading Time: 4 minutes NVIDIA Megatron? ????(DeepSpeed) ?? Megatron-Turing Natural Language Generation(MT-NLG)? ??? ????? ?? ? ?? ?? ?????. ? ??? ????? (transformer) ?? ??? ????? ?? 5,300? ?? ???. ?? ??? ??? ??? AI? ??? ??? NVIDIA? ???????? ???? ??? ??? ????? ???. Turing NLG 17B? Megatron-LM? ?? ??? MT-NLG? ???? ?? ???? ?? ?? ??? ???? ????? ?? … Continued]]>
Reading Time: 4 minutes NVIDIA Megatron? ????(DeepSpeed) ?? Megatron-Turing Natural Language Generation(MT-NLG)? ??? ????? ?? ? ?? ?? ?????. ? ??? ????? (transformer) ?? ??? ????? ?? 5,300? ?? ???. ?? ??? ??? ??? AI? ??? ??? NVIDIA? ???????? ???? ??? ??? ????? ???. Turing NLG 17B? Megatron-LM? ?? ??? MT-NLG? ???? ?? ???? ?? ?? ??? ???? ????? ?? 3? ????. ?? ???? ???? ??? ????? ???? ????…
Source
]]>
http://www.open-lab.net/ko-kr/blog/megatron%ea%b3%bc-deepspeed%eb%a1%9c-%eb%8d%94-%ea%b0%95%eb%a0%a5%ed%95%b4%ec%a7%84-%ec%84%b8%ea%b3%84%ec%97%90%ec%84%9c-%ea%b0%80%ec%9e%a5-%ed%81%b0-%ec%83%9d%ec%84%b1-%ec%96%b8%ec%96%b4-%eb%aa%a8/feed/
0
137
人人超碰97caoporen国产