Retrieval Augmented Generation Engine with LangChain and Streamlit Download - Retrieval Augmented Generation Engine with LangChain and Streamlit Source code download

Retrieval Augmented Generation Engine with LangChain and Streamlit

Other source code

1.0.0

Download

Retrieval Augmented Generation Engine using LangChain, Streamlit, & Pinecone

Access application on Streamlit Cloud Platform

Demo

Overview

The Retrieval Augmented Engine (RAG) is a powerful tool for document retrieval, summarization, and interactive question-answering. This project utilizes LangChain, Streamlit, and Pinecone to provide a seamless web application for users to perform these tasks. With RAG, you can easily upload multiple PDF documents, generate vector embeddings for text within these documents, and perform conversational interactions with the documents. The chat history is also remembered for a more interactive experience.

Features

Streamlit Web App: The project is built using Streamlit, providing an intuitive and interactive web interface for users.
Input Fields: Users can input essential credentials like OpenAI API key and Pinecone API key through dedicated input fields.
Document Uploader: Users can upload multiple PDF files, which are then processed for further analysis.
Document Splitting: The uploaded PDFs are split into smaller text chunks, ensuring compatibility with models with token limits.
Vector Embeddings: The text chunks are converted into vector embeddings, making it easier to perform retrieval and question-answering tasks.
Flexible Vector Storage: You can choose to store vector embeddings either in Pinecone or a local vector store, providing flexibility and control.
Interactive Conversations: Users can engage in interactive conversations with the documents, asking questions and receiving answers. The chat history is preserved for reference.

Prerequisites

Before running the project, make sure you have the following prerequisites:

Python 3.7+
LangChain
Streamlit
Pinecone
An OpenAI API key
PDF documents to upload

Usage

Clone the repository to your local machine:

git clone https://github.com/mirabdullahyaser/Retrieval-Augmented-Generation-Engine-with-LangChain-and-Streamlit.git
cd Retrieval-Augmented-Generation-Engine-with-LangChain-and-Streamlit

Install the required dependencies by running:
```
pip install -r requirements.txt
```
Run the Streamlit app:
```
streamlit run src/rag_engine.py
```
Access the app by opening a web browser and navigating to the provided URL.
Input your OpenAI API key, Pinecone API key, Pinecone environment, and Pinecone index name in the respective fields. You can provide them either in the sidebar of the application or place them in the secrets.toml file in the .streamlit directory
Upload the PDF documents you want to analyze.
Click the "Submit Documents" button to process the documents and generate vector embeddings.
Engage in interactive conversations with the documents by typing your questions in the chat input box.