Knowledge
CSV URL Knowledge Base
The CSVUrlKnowledgeBase reads CSVs from urls, converts them into vector embeddings and loads them to a vector database.
Usage
We are using a local PgVector database for this example. Make sure it’s running
knowledge_base.py
Then use the knowledge_base
with an Agent:
agent.py
Params
Parameter | Type | Default | Description |
---|---|---|---|
urls | List[str] | - | URLs for PDF files. |
reader | CSVUrlReader | CSVUrlReader() | A CSVUrlReader that converts the CSVs into Documents for the vector database. |
vector_db | VectorDb | - | Vector Database for the Knowledge Base. |
num_documents | int | 5 | Number of documents to return on search. |
optimize_on | int | - | Number of documents to optimize the vector db on. |
chunking_strategy | ChunkingStrategy | FixedSizeChunking | The chunking strategy to use. |