Together

Together is a platform for providing endpoints for Large Language models.

Authentication

Set your TOGETHER_API_KEY environment variable. Get your key from Together here.

Use Together with your Agent:

Parameter	Type	Default	Description
`id`	`str`	`"mistralai/Mixtral-8x7B-Instruct-v0.1"`	The specific model ID used for generating responses.
`name`	`str`	`"Together"`	The name identifier for the Together agent.
`provider`	`str`	-	The provider of the model, combining “Together” with the model ID.
`api_key`	`Optional[str]`	-	The API key for authenticating requests to the Together service. Retrieved from the environment variable `TOGETHER_API_KEY`.
`base_url`	`str`	`"https://api.together.xyz/v1"`	The base URL for making API requests to the Together service.
`monkey_patch`	`bool`	`False`	Whether to apply monkey patching.

Together also supports all the params of OpenAI.

Was this page helpful?

On this page