Try Kong AI Gateway: https://bit.ly/3xhKw49

Timestamps:

0:00 Introduction

1:15 Risks and concerns with AI adoption

4:05 Safely adopting AI in highly regulated industries

7:02 Protecting against OWASP Top 10 risks for LLM usage

8:45 Deployment models and certifications

11:32 Managing AI costs

15:58 Future support for additional LLM providers and models

18:15 No-downtime upgrades and backward compatibility

20:46 Revolutionizing Retrieval Augmented Generation (RAG)

23:30 Wrap-up

In this fireside chat, Marco Palladino, CTO & co-founder at Kong, takes questions from the audience. He covers:

• Challenges organizations face when adopting AI
• How Kong's AI Gateway enables secure and efficient AI operationalization at scale
• Risks associated with AI adoption (data leakage, erratic model behavior)
• How AI Gateway provides a centralized infrastructure to manage and secure AI traffic