Run on AWS

Let’s run the Agent App in production on AWS.

​

AWS Setup

ws_settings = WorkspaceSettings(
    ...
    # -*- AWS settings
    # Add your Subnet IDs here
    subnet_ids=["subnet-xyz", "subnet-xyz"],
    ...
)

​

Update Secrets

APP_PASSWORD: "admin"
# OPENAI_API_KEY: "sk-***"

# Secrets used by prd RDS database
MASTER_USERNAME: ai
MASTER_USER_PASSWORD: "ai9999!!"

​

Create AWS resources

Create AWS resources using:

This will create:

1. ECS Cluster for the application.
2. ECS Task Definitions and Services that run the application on the ECS cluster.
3. LoadBalancer to route traffic to the application.
4. Security Groups that control incoming and outgoing traffic.
5. Secrets for managing application and database secrets.
6. RDS Database for Knowledge Base and Storage.

Press Enter to confirm and grab a cup of coffee while the resources spin up.

• The RDS database takes about 5 minutes to activate.
• These resources are defined in the workspace/prd_resources.py file.
• Use the ECS console to view services and logs.
• Use the RDS console to view the database instance.

​

Production Streamlit

Open the LoadBalancer DNS provided when creating the Streamlit App

• Enter the APP_PASSWORD from the prd_app_secrets.yml file (default: admin)
• Enter a username and test your AI Agent.

​

Production FastApi

• Open the LoadBalancer DNS + the /docs endpoint to view the API Endpoints.
• Test the /v1/playground/agent/run endpoint with

{
  "message": "howdy",
  "agent_id": "example-agent",
  "stream": true
}

​

Updating Production

Follow this guide to update your production application. You'll need to:

1. Create a new image
2. Update the ECS task definition and services.

​

Delete AWS resources

Play around and then delete AWS resources using:

or delete individual resource groups using:

​

Next

Congratulations on running your Agent App on AWS. Next Steps:

• Read how to update workspace settings
• Read how to create a git repository for your workspace
• Read how to manage the production application
• Read how to format and validate your code
• Read how to add python libraries
• Read how to add a custom domain and HTTPS
• Read how to implement CI/CD
• Chat with us on discord