Create a chat completion | AssemblyAI

To use our EU server for LLM Gateway, replace llm-gateway.assemblyai.com with llm-gateway.eu.assemblyai.com.

Generates a response from a model given a prompt or a series of messages.

<Note>To use our EU server for LLM Gateway, replace `llm-gateway.assemblyai.com` with `llm-gateway.eu.assemblyai.com`.</Note> Generates a response from a model given a prompt or a series of messages.

Authentication

Authorizationstring

API Key authentication via header

Request

Request body for creating a chat completion.

modelstringRequired

The ID of the model to use for this request. See LLM Gateway Overview for available models.

messageslist of objectsOptional

A list of messages comprising the conversation so far.

promptstringOptional

A simple string prompt. The API will automatically convert this into a user message.

max_tokensintegerOptional>=1Defaults to 1000

The maximum number of tokens to generate in the completion. Default is 1000.

temperaturedoubleOptional

Controls randomness. Lower values produce more deterministic results.

streambooleanOptionalDefaults to false

When true, responses are streamed as server-sent events (SSE). Supported on OpenAI models only.

toolslist of objectsOptional

A list of tools the model may call.

tool_choiceenum or objectOptional

Controls which (if any) function is called by the model.

response_formatobjectOptional

Specifies the format of the model’s response. Use this to constrain the model to output valid JSON matching a schema. Supported by OpenAI (GPT-4.1, GPT-5.x), Gemini, and Claude models. Not supported by gpt-oss models.

Response

Successful response containing the model's choices.

request_idstring or nullformat: "uuid"

choiceslist of objects or null

requestobject or null

A copy of the original request, excluding prompt and messages.

usageobject or null

http_status_codeinteger or null

The HTTP status code of the response

response_timeinteger or null

The response time in nanoseconds

llm_status_codeinteger or null

The status code from the LLM provider

1	curl -X POST https://llm-gateway.assemblyai.com/v1/chat/completions \
2	-H "Authorization: <apiKey>" \
3	-H "Content-Type: application/json" \
4	-d '{
5	"model": "claude-sonnet-4-5-20250929",
6	"prompt": "Write a haiku about coding",
7	"max_tokens": 50,
8	"temperature": 0.5
9	}'

1	{
2	"request_id": "d4f1a2b3-9c8e-4f7a-8b2d-1e2f3a4b5c6d",
3	"choices": [
4	{
5	"message": {
6	"role": "assistant",
7	"content": "Lines of code flow swift,\nSilent keys tap melodies,\nLogic blooms in night."
8	},
9	"finish_reason": "stop",
10	"tool_calls": []
11	}
12	],
13	"request": {
14	"model": "claude-sonnet-4-5-20250929",
15	"max_tokens": 50,
16	"temperature": 0.5,
17	"tools": [],
18	"tool_choice": "none"
19	},
20	"usage": {
21	"input_tokens": 12,
22	"output_tokens": 38,
23	"total_tokens": 50
24	},
25	"http_status_code": 200,
26	"response_time": 275510459,
27	"llm_status_code": 200
28	}