RewriterFactory

Methods

capabilities

async capabilities(options) => RewriterCapabilities

Get the capabilities of the on-device language model.

Options (optional)
model extension web optional string The id of the model to use, undefined to use the default. The extension version also accepts a direct link to a HuggingFace GGUF file. The web version also accepts the repo & name of a HuggingFace ONNX repo.

Returns a new capabilities object

create

async create(options) => Rewriter

Creates a new rewriter model session

Options (optional)
model extension web optional string
gpuEngine extension web optional AICapabilityGpuEngine
dtype web optional AIModelDtype
topK optional number
topP optional number
maxTokens optional number
grammar extension optional any
temperature optional number
repeatPenality optional number
flashAttention optional boolean
contextSize optional number
tone optional AIRewriterTone
format optional AIRewriterFormat
length optional AIRewriterLength
signal optional AbortSignal
monitor optional AICreateMonitor

Returns a new Rewriter session that can be prompted with the pre-provided configuration