Chat Completion

Authentication: Required (JWT token or Api Key)

Generate Chat Completion

post

Generates a chat completion response using the specified model. Requires sufficient user credits and valid model.

Authorizations
AuthorizationstringRequired

Enter your API key or JWT with the 'Bearer ' prefix

Body
modelstringRequired

ID of the model to use for completion

streambooleanOptional

Whether to stream back partial progress

Default: false
temperaturenumber Β· floatOptional

What sampling temperature to use, between 0 and 2

Default: 1
top_pnumber Β· floatOptional

An alternative to sampling with temperature, called nucleus sampling

Default: 1
max_tokensintegerOptional

The maximum number of tokens to generate in the completion

seedintegerOptional

Seed for deterministic results

max_completion_tokensintegerOptional

Maximum number of completion tokens

frequency_penaltynumber Β· floatOptional

Number between -2.0 and 2.0 to penalize repeated tokens

Default: 0
presence_penaltynumber Β· floatOptional

Number between -2.0 and 2.0 to penalize tokens already present in the text

Default: 0
Responses
200

Successfully generated completion

application/json
post
/api/chat/completions

Last updated