LanguageModelCreateOptions
An object with the following properties
model extension web optional string
The id of the model to use, undefined to use the default. The extension version also accepts a direct link to a HuggingFace GGUF file. The web version also accepts the repo & name of a HuggingFace ONNX repo.
gpuEngine extension web optional AICapabilityGpuEngine
dtype web optional AIModelDtype
maxTokens extension web optional number
flashAttention extension web optional boolean
contextSize extension web optional number
signal optional AbortSignal
monitor optional AICreateMonitor
initialPrompts optional LanguageModelInitialPrompts[]
topK optional number
topP extension web optional number
repeatPenalty extension web optional number
temperature optional number
expectedInputs optional LanguageModelExpectedInput[]
Last updated