RewriterCreateOptions
Last updated
Last updated
An object with the following properties
model extension web optional string
The id of the model to use, undefined to use the default. The extension version also accepts a direct link to a HuggingFace GGUF file. The web version also accepts the repo & name of a HuggingFace ONNX repo.
gpuEngine extension web optional
dtype web optional
maxTokens extension web optional number
flashAttention extension web optional boolean
contextSize extension web optional number
signal optional AbortSignal
monitor optional
tone optional
format optional
length optional
expectedInputLanguages optional string[]
expectedContextLanguages optional string[]
outputLanguage optional string
sharedContext optional string