Models
Sambanova
Sambanova is a platform for providing endpoints for Large Language models. Note that Sambanova currently does not support function calling.
Authentication
Set your SAMBANOVA_API_KEY environment variable. Get your key from here.
Example
Use Sambanova with your Agent:
Params
| Parameter | Type | Default | Description |
|---|---|---|---|
id | str | "Meta-Llama-3.1-8B-Instruct" | The id of the Sambanova model to use |
name | str | "Sambanova" | The name of this chat model instance |
provider | str | "Sambanova" | The provider of the model |
api_key | Optional[str] | None | The API key for authenticating with Sambanova (defaults to environment variable SAMBANOVA_API_KEY) |
base_url | str | "https://api.sambanova.ai/v1" | The base URL for API requests |
Sambanova also supports the params of OpenAI.
Was this page helpful?