Advanced Technical – NVIDIA Technical Blog http://www.open-lab.net/ko-kr/blog Fri, 30 Aug 2024 02:06:26 +0000 ko-KR hourly 1 ?? ??? ?? LoRA? ??? ??, DoRA ???? http://www.open-lab.net/ko-kr/blog/introducing-dora-a-high-performing-alternative-to-lora-for-fine-tuning/ Wed, 28 Aug 2024 02:02:03 +0000 http://www.open-lab.net/ko-kr/blog/?p=3038 Reading Time: 4 minutes ?? ?? ??(FT)? ????? ?? ????? ??? ?? ?? ??? ?? ??? ???? ? ?????. ?? ??? ??? ?? ???? ????? ?? ??? ??? ?? ???? ???? ??? ?? ??(PEFT) ??? ???????. ? ? ?? ?? ??(LoRA)? ? ??? ?? ?? ??? ?? ? ?? ??? ??? ?? ????. ??? ??? ??? ??? ?? ?? … Continued]]> Reading Time: 4 minutes ?? ?? ??(FT)? ????? ?? ????? ??? ?? ?? ??? ?? ??? ???? ? ?????. ?? ??? ??? ?? ???? ????? ?? ??? ??? ?? ???? ???? ??? ?? ??(PEFT) ??? ???????. ? ? ?? ?? ??(LoRA)? ? ??? ?? ?? ??? ?? ? ?? ??? ??? ?? ????. ??? ??? ??? ??? ?? ?? ???? ??? ??? ??? ???? ??? ????. NVIDIA Research Taiwan? NVIDIA ?? ? ?? ?? ??? LoRA? ???? ??? ? ?? ??? ?? ??? ??(DoRA)? ??????.

Source

]]>
3038
LLM ????? Mixture of Experts(MoE)? ???? http://www.open-lab.net/ko-kr/blog/applying-mixture-of-experts-in-llm-architectures/ http://www.open-lab.net/ko-kr/blog/applying-mixture-of-experts-in-llm-architectures/#respond Fri, 15 Mar 2024 06:21:35 +0000 http://www.open-lab.net/ko-kr/blog/?p=2511 Reading Time: 7 minutes Mixture of Experts(MoE) ?? ?? ??(LLM) ????? ?? GPT-4? ?? ?? LLM? ?? Mixtral 8x7B? ?? ?? ??? ?? ???? ????? ???? ????. Mixtral ??? ??? ??? ???? ?? MoE? LLM ??????? ??? ?? ?? ??? ??? ??? ???????. ???? MoE? ???? ? ??? ????? MoE? ??? ??? ?? ??(?: ?? ???, MLP ?? attention … Continued]]> Reading Time: 7 minutes Mixture of Experts(MoE) ?? ?? ??(LLM) ????? ?? GPT-4? ?? ?? LLM? ?? Mixtral 8x7B? ?? ?? ??? ?? ???? ????? ???? ????. Mixtral ??? ??? ??? ???? ?? MoE? LLM ??????? ??? ?? ?? ??? ??? ??? ???????. ???? MoE? ???? ? ??? ????? MoE? ??? ??? ?? ??(?: ?? ???, MLP ?? attention projection)? ??? ?? ?? “???(expert)” ?? ????? ???? ???? ???? ?????. ??? ?? ????? ?? ????? ?? ??? ????…

Source

]]>
http://www.open-lab.net/ko-kr/blog/applying-mixture-of-experts-in-llm-architectures/feed/ 0 2511
NVIDIA Metropolis ??????? ? API? ???? ???? ?? AI ?????? ?? http://www.open-lab.net/ko-kr/blog/how-to-build-vision-ai-applications-at-the-edge-with-nvidia-metropolis-microservices-and-apis/ http://www.open-lab.net/ko-kr/blog/how-to-build-vision-ai-applications-at-the-edge-with-nvidia-metropolis-microservices-and-apis/#respond Thu, 01 Feb 2024 16:07:09 +0000 http://www.open-lab.net/ko-kr/blog/?p=2392 Reading Time: 8 minutes NVIDIA Metropolis ???????? ?? AI ?????? ? ??? ??? ?? ???? ??? ?? ??? ???? ???? API ? ???????? ?????. ?? ? ??????? NVIDIA Jetson? ???? ???? ???? ???? ??? ?? AI ??????? ??? ???? ???? ? ????. API? ?? ?? ??????? ??? ?? ??? ?? ? ??? ???? ????? ??? ???, ?? ??? ? … Continued]]> Reading Time: 8 minutes NVIDIA Metropolis ???????? ?? AI ?????? ? ??? ??? ?? ???? ??? ?? ??? ???? ???? API ? ???????? ?????. ?? ? ??????? NVIDIA Jetson? ???? ???? ???? ???? ??? ?? AI ??????? ??? ???? ???? ? ????. API? ?? ?? ??????? ??? ?? ??? ?? ? ??? ???? ????? ??? ???, ?? ??? ? ???? ??????. ??? ?? ??????? ???? ?? ? ?? ???? ??? ??? ????? AI ?? ???? ? ?? ?????. ? ?????? ?? AI ???????…

Source

]]>
http://www.open-lab.net/ko-kr/blog/how-to-build-vision-ai-applications-at-the-edge-with-nvidia-metropolis-microservices-and-apis/feed/ 0 2392
人人超碰97caoporen国产