CoreModelCapabilities

Properties

available

AICapabilityAvailability

aibrow

true

gpuEngines

AICapabilityGpuEngine[]

score

number

The model score for this machine. 0 indicates the machine is unable to run the model, 1 indicates it's fully equipped, and values in-between indicate varied performance.

defaultTopK

number

maxTopK

number

defaultTopP

number

maxTopP

number

defaultTemerature

number

maxTemperature

number

defaultRepeatPenality

number

maxRepeatPenality

number

defaultFlashAttention

boolean

defaultContextSize

number

maxContextSize

number

---

Methods

supportsLanguage

(language: string) => AICapabilityAvailability