Interface LlamaCppCallOptions

interface LlamaCppCallOptions {
    maxTokens?: number;
    onToken?: ((tokens) => void);
}

Hierarchy

  • BaseLLMCallOptions
    • LlamaCppCallOptions

Properties

maxTokens? onToken?

Properties

Optional maxTokens

maxTokens?: number

The maximum number of tokens the response should contain.

Optional onToken

onToken?: ((tokens) => void)

A function called when matching the provided token array

Type declaration

    • (tokens): void

    • A function called when matching the provided token array

      Parameters

      • tokens: number[]

      Returns void

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc