Ganesh Kudleppanavar – NVIDIA Technical BlogNews and tutorials for developers, data scientists, and IT admins2025-04-17T19:35:42Zhttp://www.open-lab.net/blog/feed/Ganesh Kudleppanavar<![CDATA[LLM Benchmarking: Fundamental Concepts]]>http://www.open-lab.net/blog/?p=982152025-04-17T19:35:42Z2025-04-02T17:00:00ZThe past few years have witnessed the rise in popularity of generative AI and large language models (LLMs), as part of a broad AI revolution. As LLM-based...
]]>Ganesh Kudleppanavar<![CDATA[Measuring Generative AI Model Performance Using NVIDIA GenAI-Perf and an OpenAI-Compatible API]]>http://www.open-lab.net/blog/?p=858392024-08-22T18:25:47Z2024-08-01T15:00:00ZNVIDIA offers tools like Perf Analyzer and Model Analyzer to assist machine learning engineers with measuring and balancing the trade-off between latency and...