Interface ChatGroqInput

Hierarchy

Properties

apiKey? modelName? stop? stream? temperature?

Properties

Optional apiKey

apiKey?: string

The Groq API key to use for requests.

Default

process.env.GROQ_API_KEY

Optional modelName

modelName?: string

The name of the model to use.

Default

"llama2-70b-4096"

Optional stop

stop?: null | string | string[]

Up to 4 sequences where the API will stop generating further tokens. The returned text will not contain the stop sequence.

Optional stream

stream?: boolean

Whether or not to stream responses.

Optional temperature

temperature?: number

The temperature to use for sampling.

Default

0.7

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc