Persistent Systems Unveils GenAI Hub to Empower Enterprises with AI Innovation

On June 6, 2024, Persistent Systems Limited announced in a stock exchange filing the launch of GenAI Hub.

GenAI Hub is an innovative platform developed to drive up the creation and deployment of Generative AI (GenAI) applications within enterprises. This platform easily integrates with an organisation’s existing infrastructure, data, and applications promoting the rapid development of tailored, industry-specific GenAI solutions. GenAI Hub supports the adoption of GenAI across various Large Language Models (LLMs) and clouds without provider lock-in.

Persistent Systems stated that companies need to seamlessly incorporate it into their current infrastructure to fully harness GenAI’s potential and turn concepts into concrete business results. With various AI models available, clients need a reliable platform like the GenAI Hub for streamlined development and management, accelerating market readiness with pre-built software components, all while adhering to responsible AI practices.

The GenAI Hub contains five major components:

1. Playground: It is a no-code solution designed for domain experts to analyse and implement GenAI using Large Language Models (LLMs) on enterprise data, eliminating the necessity for programming expertise. It offers a unified interface to LLMs sourced from private providers such as Azure OpenAI, AWS Bedrock, and Google Gemini, as well as open models from platforms like Hugging Face, including LLaMA2 and Mistral.
2. Agents Framework: It provides a universal architecture for GenAI application development, leveraging libraries like LlamaIndex and LangChain for innovative solutions, including Retrieval Augmented Generation (RAG).
3. Evaluation Framework: It uses an “AI to validate AI” approach and can auto-generate ground-truth questions to be verified by a human-in-the-loop. It uses metrics to monitor application performance and detect any drift or bias for remediation.
4. Gateway: It serves as a router connecting various LLMs, ensuring application compatibility and enhancing the management of service priorities and load balancing. Additionally, it provides in-depth insights into token usage and related expenses.
5. Custom Model Pipelines: They enable the creation and integration of bespoke LLMs and Small Language Models (SLMs) into the GenAI ecosystem. They support a streamlined process for data preparation and model fine-tuning suitable for both cloud and on-premises deployments.

The GenAI Hub streamlines the development of use cases for enterprises, offering step-by-step guidance and seamless data integration in LLMs. This enables the rapid creation of efficient and secure GenAI solutions at scale, whether for end users, customers, or employees.

Commenting on this significant launch, the Global Business Head of AI at Persistent, Praveen Bhadada, said, “At Persistent, we have always stayed ahead of the curve to capitalise on the latest industry technology trends, and now we’re reaching new frontiers in GenAI to solve critical enterprise challenges and turbocharge client growth. With the Persistent GenAI Hub, clients can embrace a “GenAI-First” strategy, delivering AI-powered applications and services at scale. They can accelerate innovation while practising responsible AI, leveraging pre-built accelerators and evaluation frameworks, and optimising costs with a cross-LLM strategy. The GenAI Hub enables enterprises to streamline operations, enhance customer experiences, and identify new avenues for growth.”

Disclaimer: This blog has been written exclusively for educational purposes. The securities mentioned are only examples and not recommendations. It is based on several secondary sources on the internet and is subject to changes. Please consult an expert before making related decisions.