Litellm integration
Stream converse with model (LiteLLM - Bedrock format)
POST
/litellm/bedrock/model/{modelId}/converse-streamStreams messages using AWS Bedrock Converse-compatible format via LiteLLM.
Path Parameters
modelId*string
Model ID
Request Body
application/json
TypeScript Definitions
Use the request body type in TypeScript.
Response Body
application/x-amz-eventstream
application/json
application/json
curl -X POST "http://localhost:8080/litellm/bedrock/model/string/converse-stream" \ -H "Content-Type: application/json" \ -d '{}'{
"role": "string",
"contentBlockIndex": 0,
"delta": {
"text": "string",
"reasoningContent": {
"text": "string",
"signature": "string"
},
"toolUse": {
"input": "string"
}
},
"stopReason": "string",
"start": {
"toolUse": {
"toolUseId": "string",
"name": "string"
}
},
"usage": {
"inputTokens": 0,
"outputTokens": 0,
"totalTokens": 0,
"cacheReadInputTokens": 0,
"cacheWriteInputTokens": 0
},
"metrics": {
"latencyMs": 0
},
"trace": {},
"additionalModelResponseFields": {},
"invokeModelRawChunk": "string"
}{
"message": "string",
"type": "string"
}{
"message": "string",
"type": "string"
}