·
12 commits
to master
since this release
- 🔑 Virtual Key: Manage access permissions using virtual keys, providing more granular control over API access.
- ⚡ Caching: Reduce latency and costs by caching repeat requests.
- 🛡️ Guard: Deny the request if the request or response has inappropriate content.
- 📊 Analytics: Track the status, error, latency and usage of tokens, allowing you to understand and manage API costs.
- 📋 Logging: Record requests and responses to further fine-tune or reinforcement learning.
- 🚦 Rate Limiting: Protect upstream API resources by controlling request rates.
- 🔄 Fallback: Fallback to CF Workers AI if the upstream API fails.