Writer
Properties
topK
number
topP
number
temperature
number
repeatPenality
number
flashAttention
boolean
contextSize
number
sharedContext
string
tone
format
length
Methods
write
async (input, options) => string
See writeStreaming
writeStreaming
(input, options) => ReadableStream
This prompts the language model to write the given input and session options.
Returns a readable stream that updates each time new tokens are available from the language model
Last updated