Arxiv KnowledgeBase - Phidata

Example

Install arxiv using this guide

knowledge_base.py

from phi.knowledge.arxiv import ArxivKnowledgeBase
from phi.vectordb.pgvector import PgVector

from resources import vector_db

knowledge_base = ArxivKnowledgeBase(
    queries=["Generative AI", "Machine Learning"],
    # Table name: llm.arxiv_documents
    vector_db=PgVector(
        table_name="arxiv_documents",
        db_url=vector_db.get_db_connection_local(),
    ),
)

ArxivKnowledgeBase Params

Parameter	Type	Default	Description
`queries`	`List[str]`	`[]`	Queries to search
`reader`	`ArxivReader`	`ArxivReader()`	A `ArxivReader` that reads the articles and converts them into `Documents` for the vector database

AgentKnowledge Params

ArxivKnowledgeBase is a subclass of the AgentKnowledge class and has access to the same params

Parameter	Type	Default	Description
`reader`	`Optional[Reader]`	`None`	Reader to read the documents
`vector_db`	`Optional[VectorDb]`	`None`	Vector db to store the knowledge base
`num_documents`	`int`	`2`	Number of relevant documents to return on search
`optimize_on`	`Optional[int]`	`1000`	Number of documents to optimize the vector db on
`driver`	`str`	`"knowledge"`	Driver for the Assistant knowledge