Models
Claude
Example
Claude Params
| Parameter | Type | Default | Description |
|---|---|---|---|
name | str | "Claude" | Name of the Claude model |
model | str | "claude-3-opus-20240229" | The specific Claude model to use |
max_tokens | int | 1024 | Maximum number of tokens to generate |
temperature | float | - | Controls randomness in output generation |
stop_sequence | List[str] | - | Sequences where the model should stop generating |
top_p | float | - | Controls diversity of output |
top_k | int | - | Limits vocabulary for next-word selection |
api_key | str | - | API key for Anthropic |
base_url | str | - | Base URL for the Anthropic API |
anthropic_client | AnthropicClient | - | Custom Anthropic client, if provided |
LLM Params
Claude is a subclass of the LLM class and has access to the same params
| Parameter | Type | Default | Description |
|---|---|---|---|
model | str | - | ID of the model to use. |
name | str | - | Name for this LLM. Note: This is not sent to the LLM API. |
metrics | Dict[str, Any] | - | Metrics collected for this LLM. Note: This is not sent to the LLM API. |
response_format | Any | - | Format of the response. |
tools | List[Union[Tool, Dict]] | - | A list of tools provided to the LLM. Tools are functions the model may generate JSON inputs for. If you provide a dict, it is not called by the model. Always add tools using the add_tool() method. |
tool_choice | Union[str, Dict[str, Any]] | - | Controls which (if any) function is called by the model. "none" means the model will not call a function and instead generates a message. "auto" means the model can pick between generating a message or calling a function. Specifying a particular function via {"type": "function", "function": {"name": "my_function"}} forces the model to call that function. "none" is the default when no functions are present. "auto" is the default if functions are present. |
run_tools | bool | True | If True, runs tools. |
show_tool_calls | bool | - | If True, shows tool calls in the response. |
functions | Dict[str, Function] | - | Functions extracted from the tools. Note: These are not sent to the LLM API and are only used for execution. |
function_call_limit | int | 20 | Maximum number of function calls allowed. |
function_call_stack | List[FunctionCall] | - | Stack of function calls. |
system_prompt | str | - | System prompt provided to the LLM. |
instructions | str | - | Instructions provided to the LLM. |
Was this page helpful?