LanguageModelCreateOptions
Last updated
Last updated
An object with the following properties
model extension web optional string
The id of the model to use, undefined to use the default. The extension version also accepts a direct link to a HuggingFace GGUF file. The web version also accepts the repo & name of a HuggingFace ONNX repo.
gpuEngine extension web optional
dtype web optional
maxTokens extension web optional number
flashAttention extension web optional boolean
contextSize extension web optional number
signal optional AbortSignal
monitor optional
initialPrompts optional
LanguageModelInitialPrompts[]
topK optional number
topP extension web optional number
repeatPenalty extension web optional number
temperature optional number
expectedInputs optional LanguageModelExpectedInput[]