docs(amazon-bedrock): add Amazon Bedrock documentation for HTTP API u…

…se case (#3693) * docs: add Amazon Bedrock documentation for API integration and model usage * docs: update Amazon Bedrock documentation to include specific model example * chore: reinstate note advising users to deploy their own API --------- Co-authored-by: Wei Zhang <[email protected]>
TabbyML · Jan 16, 2025 · f43d82f · f43d82f
1 parent 7305581
commit f43d82f
Showing 1 changed file with 25 additions and 0 deletions.
diff --git a/website/docs/references/models-http-api/amazon-bedrock.md b/website/docs/references/models-http-api/amazon-bedrock.md
@@ -0,0 +1,25 @@
+# Amazon Bedrock
+
+Amazon Bedrock is a fully managed service on AWS that provides access to foundation models from various AI companies through a single API. With [Amazon Bedrock Access Gateway](https://github.com/aws-samples/bedrock-access-gateway), you can access Anthropic's Claude models through an OpenAI-compatible interface, enabling seamless integration with tools and applications designed for OpenAI's API structure.
+
+Follow the Amazon Bedrock Access Gateway setup guide to deploy your own OpenAI-compatible API endpoint for Claude models.
+
+## Chat model
+
+Amazon Bedrock Access Gateway provides an OpenAI-compatible chat API interface for Claude models. Here we use the `us.anthropic.claude-3-5-sonnet-20241022-v2:0` model as an example.
+
+```toml title="~/.tabby/config.toml"
+[model.chat.http]
+kind = "openai/chat"
+model_name = "us.anthropic.claude-3-5-sonnet-20241022-v2:0"
+api_endpoint = "http://Bedrock-Proxy-xxxxx.{Region}.elb.amazonaws.com/api/v1"
+api_key = "your-api-key"
+```
+
+## Completion model
+
+Amazon Bedrock does not provide completion models.
+
+## Embeddings model
+
+While Amazon Bedrock supports embeddings models, Tabby does not currently support the embeddings API interface for Amazon models.