AI-Quest

Made by Jingxi Li, Priyansh K. Shah, Leon Ouyang

Generate, talk, and interact with your own character, powered through AI!

How to Use:

• Write into the top text field describing the characteristics you want your character to have.
• Engage in conversation through the bottom text field input or via microphone.

Technologies Used

We built the front-end using HTML, CSS3, React, and Next.js. It takes text and audio prompts and displays output from our back-end. The back-end is powered by the llama_index (LLM framework) and leverages various AI techniques and models for character generation.

Back-end Technologies:

• LLM Framework: Provides the foundation for the back-end AI processing.
• Google Gemini Pro: Enhances character performance through retrieval augmented generation.
• ReAct Prompting and Chain-of-Thought Prompting: Techniques used for generating character responses.
• Whisper (Speech to Text AI): Converts speech input to text.
• ElevenLabs (Text to Speech AI): Converts AI-generated text to speech.
• Gemini and Wikipedia Dataloaders: Fetch information from Wikipedia to enrich character knowledge.
• ChromaVectorStore and VectorStoreIndex: Tools for efficient storage and retrieval of character data.

Front-end Technologies:

• HTML, CSS3, React, Next.js: Used to create an interactive user interface for entering prompts and receiving character responses.

How to Run

To run the application, follow these steps:

1. Install the required Python packages using the command: pip install -r requirements.txt
2. Install the required Node.js packages for the front-end using: npm install
3. Run the FastAPI back-end using: uvicorn main:app --reload
4. Start the front-end development server using: npm run dev

Frontend Setup

1. Navigate to the frontend directory using the command: cd frontend
2. Install the required Node.js packages: npm install
3. Start the development server: npm run dev

Note: Ensure you have the required dependencies installed, including the llama_index and other AI-related packages.

Dependencies

All the modules included in character.py along with langchain

Important Note: Make sure to set up the required environment variables and configurations specified in the .env file.

Feel free to reach out if you encounter any issues or have questions!