SilentTalk is a beautifully designed AI-powered web application that enables real-time communication for deaf and mute individuals. Using computer vision, speech recognition, and AI translation, it bridges the communication gap without the need for third-party interpreters.
- 🎥 Real-time Sign Language Recognition via webcam
- 🗣️ Instant Speech-to-Text transcription
- 💬 Text-to-Speech synthesis with voice tone customization
- 🌍 Multilingual Translation and Context-Aware Messaging
- 🔄 Live Chat Mode for natural conversation flow
- 🎨 Fully responsive, modern, and accessible UI
- 🛠️ Offline Mode support (limited)
| Layer | Technology |
|---|---|
| Frontend | React.js, TailwindCSS, shadcn/ui, Framer Motion, Heroicons |
| Backend | Node.js (Express), Firebase Authentication |
| Database | Firestore (Firebase) |
| AI Models | TensorFlow.js, MediaPipe, Web Speech API |
| Hosting | GitHub Actions, Firebase Hosting or Vercel |
git clone https://github.com/your-username/SilentTalk.git
cd SilentTalknpm install cross-env --save-dev
npm install dotenv
Create a .env file at the root and add:
DATABASE_URL="file:./dev.db"
REACT_APP_FIREBASE_API_KEY=your_api_key
REACT_APP_FIREBASE_PROJECT_ID=your_project_id
REACT_APP_FIREBASE_AUTH_DOMAIN=your_auth_domainnpm run devApp will be available at http://localhost:5000.