Knowledge
S3 PDF Knowledge Base
The S3PDFKnowledgeBase reads PDF files from an S3 bucket, converts them into vector embeddings and loads them to a vector databse.
Usage
We are using a local PgVector database for this example. Make sure it’s running
Then use the knowledge_base
with an Agent
:
Params
Parameter | Type | Default | Description |
---|---|---|---|
reader | S3PDFReader | S3PDFReader() | A S3PDFReader that converts the PDFs into Documents for the vector database. |
vector_db | VectorDb | - | Vector Database for the Knowledge Base. |
num_documents | int | 5 | Number of documents to return on search. |
optimize_on | int | - | Number of documents to optimize the vector db on. |
chunking_strategy | ChunkingStrategy | FixedSizeChunking | The chunking strategy to use. |