Configuration
Configure your AI Gateway with multiple options and customizations.
- Caching: Override caching settings on a per-request basis.
- Fallbacks: Specify model or provider fallback with your Universal endpoint to specify what to do if a request fails.
- Rate limiting: Rate limiting controls the traffic that reaches your application, which prevents expensive bills and suspicious activity.
- Manage gateways: You have several different options for managing an AI Gateway.