Zoho Corporation has announced a powerful collaboration with NVIDIA. This partnership leverages NVIDIA’s AI technology to develop next-generation Large Language Models (LLMs) specifically designed for businesses.
Zoho recognizes that current LLMs prioritize consumer needs, offering limited practicality for businesses. Their mission is to create business-specific LLMs that integrate seamlessly with Zoho’s existing suite of over 100 business-focused products (across ManageEngine and Zoho.com). This “full-stack” approach allows Zoho to leverage the crucial element of AI effectiveness – context.
Zoho prioritizes user privacy. Their LLM development builds privacy regulations directly into the models, eliminating the need for later retrofitting.
By utilizing NVIDIA’s AI software and accelerated computing platform, Zoho aims to significantly improve both throughput (processing speed) and latency (response time). This translates to businesses seeing a faster return on investment (ROI) from their AI solutions.
Zoho takes a multi-modal approach to AI, focusing on contextual intelligence for better business decision-making. They are developing a range of narrow and smaller sized language models, different from traditional LLMs. This strategy provides businesses with a toolbox of models optimized for different tasks, ensuring effectiveness across diverse needs. Additionally, it allows businesses with limited data to benefit from AI.
Vishal Dhupar, Managing Director at NVIDIA Asia South, highlights the collaboration’s strength: “Businesses can choose the perfect AI model size for their needs, balancing performance and cost.” This empowers businesses to deploy the most effective AI solution for their unique situation.
The partnership extends beyond LLMs. Zoho plans to leverage NVIDIA’s NeMo platform for developing custom generative AI, including multimodal AI, vision, and speech recognition capabilities. They are already seeing significant performance improvements using NVIDIA TensorRT-LLM, achieving a 60% increase in throughput and a 35% reduction in latency compared to previous methods.
This collaboration between Zoho and NVIDIA paves the way for a new generation of business-focused AI solutions. With a focus on context, privacy, and cost-effectiveness, Zoho is empowering businesses to leverage the power of AI and make smarter decisions.