Documentation
LLM consumption
Amazon Bedrock

Amazon Bedrock

Configure Amazon Bedrock as an LLM provider in agentgateway.

Authentication

Before you can use Bedrock as an LLM provider, you must authenticate by using the standard AWS authentication sources.

Configuration

Review the following example configuration. 
binds:
- port: 3000
  listeners:
  - routes:
    - backends:
      - ai:
          name: bedrock
          provider:
            bedrock:
              region: us-west-2
              # Optional; overrides the model in requests
              model: amazon.titan-text-express-v1
Review the following example configuration.
Setting Description
ai.name The name of the LLM provider for this AI backend.
bedrock.region The AWS region.
bedrock.model Optionally set the model to use for requests. If set, any models in the request are overwritten. If not set, the request must include the model to use.
GeminiAnthropic