Ganesh Kudleppanavar

Ganesh Kudleppanavar is a System Software Manager at NVIDIA, dedicated to optimizing the performance of Machine Learning and Generative AI models. He leads the Triton tools team, utilizing the powerful Triton Tools to meticulously benchmark these models, ensuring their efficient deployment and seamless utilization across diverse applications. Ganesh holds a Master of Science degree in Electrical Engineering from California State University, Long Beach.
Avatar photo

Posts by Ganesh Kudleppanavar

Generative AI

LLM Benchmarking: Fundamental Concepts

The past few years have witnessed the rise in popularity of generative AI and large language models (LLMs), as part of a broad AI revolution. As LLM-based... 14 MIN READ
Decorative image.
Generative AI

Measuring Generative AI Model Performance Using NVIDIA GenAI-Perf and an OpenAI-Compatible API

NVIDIA offers tools like Perf Analyzer and Model Analyzer to assist machine learning engineers with measuring and balancing the trade-off between latency and... 6 MIN READ