This project aims to develop a sign language detection system using computer vision and machine learning techniques. The system is designed to interpret hand gestures captured through a webcam in real-time and classify them into corresponding sign language gestures.
- Real-time hand detection and tracking using webcam input.
- Classification of detected hand gestures into predefined sign language categories.
- User-friendly interface for collecting training data through webcam feed.
- Support for customization and extension with additional sign language categories.
- Clone the repository to your local machine:
git clone [email protected]:Priyanshuparth/HandSpeak-Visual-Gesture-Interpreter.git
- Install the required dependencies:
pip install -r requirements.txt
- Download the pre-trained model and label files (if available) and place them in the appropriate directories.
Run the main Python script to start the sign language detection system:
python main.py
Follow the on-screen instructions to interact with the system:
- Use webcam input to capture hand gestures in real-time.
- Press specific keys to exit the screen press
q
- To collect the images press
s
To collect training data for the sign language detection model, follow these steps:
- Run the data collection script:
python data_collection.py
- Follow the instructions to capture and save hand gesture images using the webcam.
Contributions to this project are welcome! If you have ideas for improvements or new features, please submit a pull request or open an issue on GitHub.
This project is licensed under the MIT License.
- The hand detection and tracking functionalities in this project are powered by the cvzone library.
![Image_1710092547 575559](https://private-user-images.githubusercontent.com/73892924/311537229-b00444c1-d07f-4c00-a540-70f41a3cb71f.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk5NzY5MDksIm5iZiI6MTcxOTk3NjYwOSwicGF0aCI6Ii83Mzg5MjkyNC8zMTE1MzcyMjktYjAwNDQ0YzEtZDA3Zi00YzAwLWE1NDAtNzBmNDFhM2NiNzFmLmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MDMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzAzVDAzMTY0OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTA1ZmI5NzYyYWIzNjNlMTNhYjUzMzE5ZjNmMjliODhkMGRjYjE0YzAzMGIzNTBjM2Q1NjlmNzBmODE3N2EyYjYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.aKxC6CyfbvWUA66O4p3QVLcKffhT5zvmiNC_vfytBHQ)
![Image_1710092138 3236485](https://private-user-images.githubusercontent.com/73892924/311537255-738a3111-2423-422e-a634-34cf97863328.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk5NzY5MDksIm5iZiI6MTcxOTk3NjYwOSwicGF0aCI6Ii83Mzg5MjkyNC8zMTE1MzcyNTUtNzM4YTMxMTEtMjQyMy00MjJlLWE2MzQtMzRjZjk3ODYzMzI4LmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MDMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzAzVDAzMTY0OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPThjY2Y0MTdiMjM2YzA5N2EyYzg4NTgwZTFmYWJlZGJlYmFlMjdlNTA3YzQxZTE0OGEyZTJlZTVjN2YyZDJlODcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.WpkZDfPz1ZKpK6BoVoCles6b6cPvrCZKSuWKIy0bAHw)
![Image_1710092848 569423](https://private-user-images.githubusercontent.com/73892924/311537282-abe9ca6b-b1d8-446d-bd69-2ce4553a9c68.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk5NzY5MDksIm5iZiI6MTcxOTk3NjYwOSwicGF0aCI6Ii83Mzg5MjkyNC8zMTE1MzcyODItYWJlOWNhNmItYjFkOC00NDZkLWJkNjktMmNlNDU1M2E5YzY4LmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MDMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzAzVDAzMTY0OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTE2M2ZiMzc3YTM1ZGQ5ZWRhNTQ3NDI2ZGRhYzBmZDQ1YzVmZGY2YWJkN2EzMDMwOWFkYjQzNzJhNjU2M2QzNmImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.UaOPghdowr0qDF5sJOjHMCVgrjZz-2P1z9N735XJYIY)
![Image_1710091462 9211955](https://private-user-images.githubusercontent.com/73892924/311537306-ad533438-4962-4af6-ab8c-a6dd357868fa.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk5NzY5MDksIm5iZiI6MTcxOTk3NjYwOSwicGF0aCI6Ii83Mzg5MjkyNC8zMTE1MzczMDYtYWQ1MzM0MzgtNDk2Mi00YWY2LWFiOGMtYTZkZDM1Nzg2OGZhLmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MDMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzAzVDAzMTY0OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWQ3MDk2ZThiMTI3ZTE2ZjFlOGFhNTNiNTc3ZTE1NDYzNTRlMWEwOGVmZTJlYjQ4NWE3Y2M4MjFiZTQwM2IzMmEmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.DOfZWdvrwxsRUV3w4J4X6joS1DK5_JLhDLONzqldrNU)
![Image_1710093560 7241387](https://private-user-images.githubusercontent.com/73892924/311537347-a7d1997a-5508-422f-a915-0bd15b49fe87.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk5NzY5MDksIm5iZiI6MTcxOTk3NjYwOSwicGF0aCI6Ii83Mzg5MjkyNC8zMTE1MzczNDctYTdkMTk5N2EtNTUwOC00MjJmLWE5MTUtMGJkMTViNDlmZTg3LmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MDMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzAzVDAzMTY0OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWE1ZmFjZWNlYTQ0NTUzYTNjMThlYzJlZDcxNzIxOWNlYWRmZjU5MjljN2YyZjFhNzRlNWQ5ZjQ5Yzk5YjkwMmQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.EqAp55xaAT645VrWo83nnxYxj1zQ4TWjyyqe50UFD9Y)
![Image_1710093215 559252](https://private-user-images.githubusercontent.com/73892924/311537378-4f516f2d-4329-434a-ae6f-463ac3713195.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk5NzY5MDksIm5iZiI6MTcxOTk3NjYwOSwicGF0aCI6Ii83Mzg5MjkyNC8zMTE1MzczNzgtNGY1MTZmMmQtNDMyOS00MzRhLWFlNmYtNDYzYWMzNzEzMTk1LmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MDMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzAzVDAzMTY0OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTMxNDc2NzVjOWZhNjM0ZjgyNzNmMDEyM2JmZjlhYzI4MGRlZTQ0YTI0NzEwZTM3ZmFjNTVhOWRlNGNlODE5MWYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.73LQJEh_iZLUnWozkHhuPq7POoud7eGfRMPzD0Pbx-E)
![Image_1710090729 4090722](https://private-user-images.githubusercontent.com/73892924/311537401-a5d8b077-121e-476a-9655-c4f2e2af941a.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk5NzY5MDksIm5iZiI6MTcxOTk3NjYwOSwicGF0aCI6Ii83Mzg5MjkyNC8zMTE1Mzc0MDEtYTVkOGIwNzctMTIxZS00NzZhLTk2NTUtYzRmMmUyYWY5NDFhLmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MDMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzAzVDAzMTY0OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWVlNDBkN2QxYmFjMWJjMjg0ZTI3NDRhMGVhYzVlOWQxOTc4Y2FjZTc3ZmJiYjRlNGE1MjIwMmVlNjQzMWE3YTEmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.e7I3B3PbPvi8NmgFb0xedCkJnahlIU_ObcMxdelzicQ)
![Image_1710093656 7833636](https://private-user-images.githubusercontent.com/73892924/311537048-a28613f3-3d0e-491d-9535-11f023b680e1.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk5NzY5MDksIm5iZiI6MTcxOTk3NjYwOSwicGF0aCI6Ii83Mzg5MjkyNC8zMTE1MzcwNDgtYTI4NjEzZjMtM2QwZS00OTFkLTk1MzUtMTFmMDIzYjY4MGUxLmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MDMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzAzVDAzMTY0OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTA3NzRkNTJiODQzNGEyMjBjNzc0NmNmODZhOTg4ZmM3NDYyYTA5MTdjYTQ5MTY4Mzc0ZTcwYTE5YmFmNTIyY2ImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.pPN8eI4Wxf19sUUadsWh4KHeqW2rVKUumRGQlVJMdGc)