Skip to content

SahandNoey/Real-Time-Hand-Gesture-Based-Drawing-and-Problem-Solving

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 

Repository files navigation

Whiteboard AI - Hand Gesture-Based Drawing and Problem Solving

A Python project that uses a webcam for hand gesture recognition to draw on a virtual canvas and send the drawing to Google's Gemini AI for analysis or problem-solving.

Features

  • Hand Gesture Detection: Track hand movements via webcam using the cvzone library.
  • Real-Time Drawing: Draw on a virtual whiteboard with your index finger.
  • AI Integration: Send drawings to Google Gemini AI for analysis or solving math problems.
  • Streamlit Interface: Simple web-based interface to interact with the canvas and display AI responses.

**Result Samples

2x33.webm
2x.webm
2x2.webm

Setup

  1. Install dependencies:
    pip install -r requirements.txt
  2. Run the app:
    streamlit run main.py

Usage

  • Index finger up: Draw on the canvas.
  • All fingers up: Clear the canvas.
  • Three middle fingers up: Send the drawing to the AI for processing.

API Key

Replace the placeholder in main.py with your Google API key:

genai.configure(api_key="YOUR_API_KEY")

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages