Invoke model with streaming (Bedrock format)

POST/bedrock/model/{modelId}/invoke-with-response-stream

Invokes a model with streaming using AWS Bedrock InvokeModelWithResponseStream API format.

Path Parameters

modelId*string

Model ID (e.g., anthropic.claude-3-sonnet-20240229-v1:0)

application/json

TypeScript Definitions

Use the request body type in TypeScript.

prompt?string

Text prompt to complete

max_tokens?integer

max_tokens_to_sample?integer

Anthropic-style max tokens

temperature?number

top_p?number

top_k?integer

stop?array<string>

stop_sequences?array<string>

Anthropic-style stop sequences

messages?array<>

For Claude 3 models

system?|array<string>

System prompt (string or array of strings)

anthropic_version?string

curl -X POST "http://localhost:8080/bedrock/model/string/invoke-with-response-stream" \  -H "Content-Type: application/json" \  -d '{}'

{}

{
  "message": "string",
  "type": "string"
}

{
  "message": "string",
  "type": "string"
}