Get Started With LLM Proxy in WSO2 API Platform AI Gateway

Run your first LLM proxy on WSO2 Platform AI Gateway in minutes — no cloud setup required, just Docker.
This quickstart walks you through spinning up the WSO2 Platform AI Gateway as a standalone component on your own infrastructure. You'll add an OpenAI provider configuration (including API key auth and access control rules), deploy an LLM proxy that routes through it, and verify live responses end to end.
What you'll set up:

WSO2 Platform AI Gateway running locally via Docker Compose
An OpenAI LLM provider with scoped access (chat completions and model info only)
An LLM proxy configuration that sits in front of the provider
Persistent config that survives container restarts

By the end, you'll have a working gateway that routes requests to OpenAI through a controlled proxy layer — ready to build on.

See the LLM Proxy quickstart guide: https://wso2.com/api-platform/docs/ai-gateway/llm-proxy/quick-start-guide/

0-0:23 Introduction

0:23-0:49 Downloading and starting an AI Gateway instance

0:50-1:06 Checking the health of the control plane

1:07-2:52 Defining, deploying, and verifying an OpenAI LLM Provider configuration

2:53-4:01 Defining, deploying, and verifying an LLM Proxy configuration

4:02-4:32 Stopping the AI Gateway instance

#WSO2 #AIGateway #LLMProxy