Sambanova

Sambanova is a platform for providing endpoints for Large Language models. Note that Sambanova currently does not support function calling.

Authentication

Set your SAMBANOVA_API_KEY environment variable. Get your key from here.

Use Sambanova with your Agent:

Parameter	Type	Default	Description
`id`	`str`	`"Meta-Llama-3.1-8B-Instruct"`	The specific model ID used for generating responses.
`name`	`str`	`"Sambanova"`	The name identifier for the Sambanova model.
`provider`	`str`	`"Sambanova"`	The provider of the model.
`api_key`	`Optional[str]`	-	The API key used for authenticating requests to the Sambanova service. Retrieved from the environment variable `SAMBANOVA_API_KEY`.
`base_url`	`str`	`"https://api.sambanova.ai/v1"`	The base URL for making API requests to the Sambanova service.

Sambanova also supports all the params of OpenAI.

Was this page helpful?

On this page