Indrajit Maloji Bhosale

Indrajit Maloji Bhosale is a senior system software engineer at NVIDIA, working on deep learning systems and frameworks as a part of the NVIDIA Triton Inference Server team. He has a background in Networking Operating Systems and Storage Systems. He holds a master’s degree in Computer Systems and Networking from Carnegie Mellon University.
Avatar photo

Posts by Indrajit Maloji Bhosale

Conversational AI Oct 22, 2024

Scaling LLMs with NVIDIA Triton and NVIDIA TensorRT-LLM Using Kubernetes

Large language models (LLMs) have been widely used for chatbots, content generation, summarization, classification, translation, and more. State-of-the-art LLMs... 16 MIN READ