Skip to content

Latest commit

 

History

History
36 lines (23 loc) · 1.07 KB

README.md

File metadata and controls

36 lines (23 loc) · 1.07 KB
Raw

chatPDF

Chat with any PDF using GPT3.5-turbo, faiss vector database and InstructorEmbedding. Uses around 3GB of GPU VRAM for the InstructorEmbedding model.

Installation

Tested on Ubuntu 22.04

  • Create a new conda env conda create -n chatpdf python=3.9 -y
  • Activate the conda env conda activate chatpdf
  • Install required packages pip install -r requirements.txt
  • Install faiss vector database conda install -c conda-forge faiss-gpu
  • Create a OpenAI account and get a OPENAI_API_KEY

Launch the gradio interface

python chat.py

FAQ

Q) Why not use OpenAI Embeddings A) Please feel free to create a pull request to add support for it. I wanted to keep the project entirely open source but ultimately couldn't resist using GPT3.5-turbo

ToDo

  • Add support for other embeddings, chat models
  • Improve the Prompts
  • Show streaming response from GPT3.5-turbo

Acknowledgements

This code is based on two similar projects