Zoho Corporation recently announced its partnership with NVIDIA to develop and implement large language models (LLMs) in its Software as a Service (SaaS) applications. This collaboration was unveiled at the NVIDIA AI Summit in Mumbai on October 24, 2024. Zoho’s goal is to create LLMs tailored specifically for various business applications, a departure from the consumer-focused models currently available in the market.
Ramprakash Ramamoorthy, Director of AI at Zoho Corporation, emphasized the importance of integrating context into AI to enhance its effectiveness in business settings. Zoho has a long history of incorporating AI into its products, with a focus on user privacy and compliance with regulations. The company’s investment in NVIDIA’s AI technology and GPUs underscores its commitment to providing cutting-edge solutions to its customer base of over 700,000 users worldwide.
In addition to developing LLMs, Zoho is also working on narrow, small, and medium-sized language models to address a variety of use cases. By offering a range of AI solutions, Zoho aims to provide businesses with options that align with their specific needs while prioritizing performance and cost-effectiveness. Importantly, Zoho’s LLM models will not be trained on customer data, ensuring the protection of user privacy.
Vishal Dhupar, Managing Director, Asia South at NVIDIA, praised the collaboration with Zoho, highlighting the versatility of NVIDIA’s AI software and accelerated computing platform in meeting diverse business requirements. Zoho is leveraging NVIDIA’s technology, including the NVIDIA NeMo end-to-end platform, to optimize its LLMs for deployment. By utilizing NVIDIA Hopper GPUs and TensorRT-LLM, Zoho has achieved significant improvements in throughput and latency compared to existing frameworks.
Overall, the partnership between Zoho and NVIDIA represents a significant step forward in the development of AI-driven solutions for businesses. By combining Zoho’s expertise in SaaS applications with NVIDIA’s powerful AI technology, the two companies are poised to deliver innovative and efficient LLMs that will benefit a wide range of industries. Subscribe to Business Today Magazine for more insights on India’s businesses and economy.