Website KnowledgeBase

Example

Install beautifulsoup4 using this guide

knowledge_base.py

from phi.knowledge.website import WebsiteKnowledgeBase
from phi.vectordb.pgvector import PgVector

from resources import vector_db

knowledge_base = WebsiteKnowledgeBase(
    urls=["https://docs.phidata.com/introduction"],
    # Number of links to follow from the seed URLs
    max_links=10,
    # Table name: ai.website_documents
    vector_db=PgVector(
        table_name="website_documents",
        db_url=vector_db.get_db_connection_local(),
    ),
)

WebsiteKnowledgeBase Params

Parameter	Type	Default	Description
`urls`	`List[str]`	`[]`	URLs to read
`reader`	`Optional[WebsiteReader]`	`None`	A `WebsiteReader` that reads the urls and converts them into `Documents` for the vector database.
`max_depth`	`int`	`3`	Maximum depth to crawl.
`max_links`	`int`	`10`	Number of links to crawl.

AgentKnowledge Params

WebsiteKnowledgeBase is a subclass of the AgentKnowledge class and has access to the same params

Parameter	Type	Default	Description
`reader`	`Optional[Reader]`	`None`	Reader to read the documents
`vector_db`	`Optional[VectorDb]`	`None`	Vector db to store the knowledge base
`num_documents`	`int`	`2`	Number of relevant documents to return on search
`optimize_on`	`Optional[int]`	`1000`	Number of documents to optimize the vector db on
`driver`	`str`	`"knowledge"`	Driver for the Assistant knowledge

Building Blocks

Command Line

Website KnowledgeBase

Example

WebsiteKnowledgeBase Params

AgentKnowledge Params

​Example

​WebsiteKnowledgeBase Params

​AgentKnowledge Params

Example

WebsiteKnowledgeBase Params

AgentKnowledge Params