Summarizer
Properties
topK
number
topP
number
temperature
number
repeatPenality
number
flashAttention
boolean
contextSize
number
sharedContext
string
type
format
length
Methods
summarize
async (input, options) => string
summarizeStreaming
(input, options) => ReadableStream
This prompts the model to summarize the given input and session options.
Returns a readable stream that updates each time new tokens are available from the language model
Last updated