Exclusive: Kong launches AI Gateway to help enterprises govern and scale generative AI

1 month ago 76

It's time to celebrate the incredible women leading the way in AI! Nominate your inspiring leaders for VentureBeat’s Women in AI Awards today before June 18. Learn More

Kong Inc., the cloud connectivity company, has announced the general availability of Kong AI Gateway, providing enterprises with an AI-native API gateway to govern and secure generative AI workloads across any cloud environment. The product, first released in beta in February, has already seen significant adoption as organizations rush to operationalize generative AI technology.

The Kong AI Gateway offers a suite of infrastructure capabilities tailored for AI, including support for multiple large language models (LLMs), semantic caching, semantic routing, semantic firewalling, and model lifecycle management. Crucially, it integrates seamlessly with Kong’s existing API platform, allowing enterprises to manage their AI alongside traditional APIs.

“Organizations and developers are building new gen AI use cases to create better user experiences and customer experiences. But like every technology in the world, in the early days of starting something new with cutting edge technology, it is very hard to scale that in production without having proper infrastructure,” explained Marco Palladino, CTO and co-founder of Kong, in an exclusive interview with VentureBeat. 

According to Palladino, the Kong AI Gateway is “probably the most capable AI infrastructure technology in the world,” due to being built on top of Kong’s existing gateway features while providing deep AI-specific capabilities. He drew parallels to the early days of APIs, noting that APIs only truly exploded at scale once the right infrastructure emerged to support developers.

VB Transform 2024 Registration is Open

Join enterprise leaders in San Francisco from July 9 to 11 for our flagship AI event. Connect with peers, explore the opportunities and challenges of Generative AI, and learn how to integrate AI applications into your industry.

Read Entire Article