​
Example

from phi.agent import Agent
from phi.model.nvidia import Nvidia

agent = Agent(model=Nvidia(id="nvidia/llama-3.1-nemotron-70b-instruct"), markdown=True)

agent.print_response("Share a 2 sentence horror story")

​
Nvidia Params

ParameterTypeDefaultDescription
idstr"nvidia/llama-3.1-nemotron-70b-instruct"The specific model ID used for generating responses.
namestr"Nvidia"The name identifier for the Nvidia agent.
providerstr-The provider of the model, combining "Nvidia" with the model ID.
api_keyOptional[str]-The API key for authenticating requests to the Nvidia service. Retrieved from the environment variable NVIDIA_API_KEY.
base_urlstr"https://integrate.api.nvidia.com/v1"The base URL for making API requests to the Nvidia service.

Nvidia is a subclass of the OpenAILike class and has access to the same params.

Was this page helpful?

Suggest edits
MistralOllama