Models
Together
Models
Together
Together is a platform for providing endpoints for Large Language models.
Authentication
Set your TOGETHER_API_KEY environment vairable.
Example
Use Together with your Agent:
Params
| Parameter | Type | Default | Description |
|---|---|---|---|
id | str | "mistralai/Mixtral-8x7B-Instruct-v0.1" | The specific model ID used for generating responses. |
name | str | "Together" | The name identifier for the Together agent. |
provider | str | - | The provider of the model, combining “Together” with the model ID. |
api_key | Optional[str] | - | The API key for authenticating requests to the Together service. Retrieved from the environment variable TOGETHER_API_KEY. |
base_url | str | "https://api.together.xyz/v1" | The base URL for making API requests to the Together service. |
monkey_patch | bool | False | Whether to apply monkey patching. |
Was this page helpful?