ragchat

ragchat

Demo Retrieval Augmented Chatbot AI using open source components and SemaDB.

Installation

Install the Python dependencies:

pip install -r requirements.txt

Install Ollama as the main LLM:

https://ollama.com/download/ollama-linux-amd64 -o ollama
chmod +x ollama

Usage

Start the Ollama server:

ollama serve

and install the desired model:

ollama pull llama2
# Test using
ollama run llama2

then run the main.py entry point with the SemaDB API Key:

SEMADB_API_KEY=... python3 main.py

Built With

• LangChain Used for gluing together components
• Gradio Web interface
• Ollama Main large language model library
• Sentence Transformers The embedding model