Sambanova is a platform for providing endpoints for Large Language models. Note that Sambanova currently does not support function calling.
Authentication
Set your SAMBANOVA_API_KEY environment variable. Get your key from here.
export SAMBANOVA_API_KEY=***
setx SAMBANOVA_API_KEY ***
Example
Use Sambanova with your Agent:
from phi.agent import Agent, RunResponsefrom phi.model.sambanova import Sambanovaagent = Agent(model=Sambanova(), markdown=True)# Get the response in a variable# run: RunResponse = agent.run("Share a 2 sentence horror story.")# print(run.content)# Print the response in the terminalagent.print_response("Share a 2 sentence horror story.")
Params
Parameter
Type
Default
Description
id
str
"Meta-Llama-3.1-8B-Instruct"
The id of the Sambanova model to use
name
str
"Sambanova"
The name of this chat model instance
provider
str
"Sambanova"
The provider of the model
api_key
Optional[str]
None
The API key for authenticating with Sambanova (defaults to environment variable SAMBANOVA_API_KEY)