diff --git a/website/docs/references/models-http-api/amazon-bedrock.md b/website/docs/references/models-http-api/amazon-bedrock.md new file mode 100644 index 000000000000..c01e244b81c2 --- /dev/null +++ b/website/docs/references/models-http-api/amazon-bedrock.md @@ -0,0 +1,25 @@ +# Amazon Bedrock + +Amazon Bedrock is a fully managed service on AWS that provides access to foundation models from various AI companies through a single API. With [Amazon Bedrock Access Gateway](https://github.com/aws-samples/bedrock-access-gateway), you can access Anthropic's Claude models through an OpenAI-compatible interface, enabling seamless integration with tools and applications designed for OpenAI's API structure. + +Follow the Amazon Bedrock Access Gateway setup guide to deploy your own OpenAI-compatible API endpoint for Claude models. + +## Chat model + +Amazon Bedrock Access Gateway provides an OpenAI-compatible chat API interface for Claude models. Here we use the `us.anthropic.claude-3-5-sonnet-20241022-v2:0` model as an example. + +```toml title="~/.tabby/config.toml" +[model.chat.http] +kind = "openai/chat" +model_name = "us.anthropic.claude-3-5-sonnet-20241022-v2:0" +api_endpoint = "http://Bedrock-Proxy-xxxxx.{Region}.elb.amazonaws.com/api/v1" +api_key = "your-api-key" +``` + +## Completion model + +Amazon Bedrock does not provide completion models. + +## Embeddings model + +While Amazon Bedrock supports embeddings models, Tabby does not currently support the embeddings API interface for Amazon models.