Interface ChatCompletionChunk

Represents a streamed chunk of a chat completion response returned by model, based on the provided input.

interface ChatCompletionChunk {
    choices: ChatCompletionChunk.Choice[];
    created: number;
    id: string;
    model: string;
    object: "chat.completion.chunk";
    system_fingerprint?: string;
}

Properties

A list of chat completion choices. Can be more than one if n is greater than 1.

created: number

The Unix timestamp (in seconds) of when the chat completion was created. Each chunk has the same timestamp.

id: string

A unique identifier for the chat completion. Each chunk has the same ID.

model: string

The model to generate the completion.

object: "chat.completion.chunk"

The object type, which is always chat.completion.chunk.

system_fingerprint?: string

This fingerprint represents the backend configuration that the model runs with. Can be used in conjunction with the seed request parameter to understand when backend changes have been made that might impact determinism.

Generated using TypeDoc