Class WatsonxAI

The WatsonxAI class is used to interact with Watsonx AI Inference Endpoint models. It uses IBM Cloud for authentication. This requires your IBM Cloud API Key which is autoloaded if not specified.

Hierarchy

  • LLM<BaseLLMCallOptions>
    • WatsonxAI

Constructors

constructor

Properties

endpoint modelId region version ibmCloudApiKey? ibmCloudToken? ibmCloudTokenExpiresAt? modelKwargs? modelParameters? projectId?

Methods

generateToken

Constructors

constructor

Properties

endpoint

endpoint: string

modelId

modelId: string = "meta-llama/llama-2-70b-chat"

region

region: string = "us-south"

version

version: string = "2023-05-29"

Optional ibmCloudApiKey

ibmCloudApiKey?: string

Optional ibmCloudToken

ibmCloudToken?: string

Optional ibmCloudTokenExpiresAt

ibmCloudTokenExpiresAt?: number

Optional modelKwargs

modelKwargs?: Record<string, unknown>

Optional modelParameters

modelParameters?: Record<string, unknown>

Optional projectId

projectId?: string

Methods

generateToken

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc