Embedding

Properties

topK

number

topP

number

temperature

number

repeatPenality

number

flashAttention

boolean

contextSize

number

---

Methods

get

(input, options) => number[]

Creates a new vector from the provided input

Input
A string to generate a vector from

Options (optional)
signal optional AbortSignal

Returns the vector from the language model

calculateCosineSimilarity

(vectorA, vectorB) => number

Calculates the cosine similarity between two embeddings. Only compare embeddings created by the same model

vectorA
A number[] vector to compare

vectorB
A number[] vector to compare

Returns a value between 0 and 1 representing the similarity. 1 being the most similar

findSimilar

(embeddings, target) => any[]

Finds and sorts similar vectors

embeddings
An Array<{ id: any, vector: number[] }> array of objects, each with id and vector

target
A number[] vector to use as the search target

Returns a list of ids, sorted by the most similar to the least similar