Writer

Properties

topK

number

topP

number

temperature

number

repeatPenality

number

flashAttention

boolean

contextSize

number

sharedContext

string

tone

AIWriterTone

format

AIWriterFormat

length

AIWriterLength


Methods

write

async (input, options) => string

See writeStreaming

writeStreaming

(input, options) => ReadableStream

This prompts the language model to write the given input and session options.

Returns a readable stream that updates each time new tokens are available from the language model

Last updated