Skip to content

VocaLearn is an innovative language learning application that leverages advanced AI technologies to provide personalized, interactive language learning experiences.

Notifications You must be signed in to change notification settings

KanishkSogani/VocaLearn

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 

Repository files navigation

VocaLearn 🎯

AI-Powered Language Learning Platform

VocaLearn is an innovative language learning application that leverages advanced AI technologies to provide personalized, interactive language learning experiences. Built for the Murf AI Hackathon, it features cutting-edge speech recognition, natural language processing, and high-quality text-to-speech capabilities.

🌟 Features

🎤 Echo Mode

  • Real-time Speech Analysis: Record your speech and get instant AI feedback
  • Perfect Pronunciation: Listen to AI-generated corrections with native-like pronunciation using Murf AI TTS
  • Detailed Performance Metrics: Get scores for pronunciation, grammar, and fluency
  • Personalized Feedback: Receive strengths, weaknesses, and improvement recommendations
  • Multi-language Support: Practice in 9+ languages with native voice synthesis

💬 Dialogue Mode

  • Interactive Conversations: Engage in realistic dialogue scenarios with AI
  • Real-world Scenarios:
    • ☕ Café Conversations (Beginner)
    • 💼 Business Meetings (Advanced)
    • ✈️ Travel & Tourism (Intermediate)
    • 🛍️ Shopping Experiences (Beginner)
    • 👥 Social Gatherings (Intermediate)
  • Adaptive AI Responses: AI adapts to your language level and conversation flow
  • Natural Voice Synthesis: All AI responses use Murf AI's premium TTS technology
  • Context-Aware Conversations: Maintains conversation context and provides relevant responses

🧠 Quiz Mode

  • Intelligent Question Generation: AI creates personalized quiz questions
  • Voice-Based Interaction: Answer questions using speech recognition
  • Comprehensive Topics:
    • General Language Skills
    • Grammar Focus
    • Vocabulary Building
    • Cultural Knowledge
    • Conversation Practice
  • Detailed Analytics: Track performance across multiple skill areas
  • Audio Feedback: Question narration and explanations powered by Murf AI TTS
  • Progress Tracking: Monitor improvement over time with detailed scoring

🚀 Technology Stack

Frontend

  • Next.js 14 - React framework with App Router
  • TypeScript - Type-safe development
  • Tailwind CSS - Modern styling and responsive design
  • Shadcn/ui - Beautiful, accessible UI components
  • Lucide React - Modern icon library
  • React Hot Toast - User-friendly notifications

Backend

  • Node.js - Server runtime
  • WebSocket - Real-time communication
  • Express.js - Web framework
  • Groq API (llama-3.1-8b) - Language model for intelligent responses
  • Deepgram AI API - Speech-to-text recognition
  • Murf AI TTS - Premium text-to-speech synthesis ⭐
  • Jest - Testing framework

AI & Speech Technologies

  • Murf AI Text-to-Speech - High-quality, natural voice synthesis in multiple languages
  • Deepgram AI API - Speech recognition and audio processing
  • Groq API (llama-3.1-8b)* - Intelligent conversation and feedback generation
  • Real-time Audio Processing - WebRTC and AudioWorklet for live speech capture

🎯 Murf AI Integration

VocaLearn extensively uses Murf AI's Text-to-Speech API throughout the application:

Echo Mode

  • Correction Audio: Perfect pronunciation examples
  • Feedback Narration: Spoken explanations of performance
  • Native Voice Quality: Crystal-clear, human-like speech synthesis

Dialogue Mode

  • AI Character Voices: Realistic conversation partners
  • Scenario-Specific Accents: Appropriate voices for different contexts
  • Natural Conversation Flow: Seamless audio responses

Quiz Mode

  • Question Reading: Audio narration of quiz questions
  • Answer Feedback: Spoken explanations and corrections
  • Summary Narration: Comprehensive performance reviews

Supported Languages

All modes support Murf AI's premium voices in:

  • 🇪🇸 Spanish (Spain)
  • 🇫🇷 French (France)
  • 🇺🇸 English (US)
  • 🇮🇳 Hindi (India)
  • 🇯🇵 Japanese (Japan)
  • 🇮🇹 Italian (Italy)
  • 🇩🇪 German (Germany)
  • 🇳🇱 Dutch (Netherlands)
  • 🇵🇹 Portuguese (Brazil)

🌐 Live Application

Experience VocaLearn Now: https://vocallearn.vercel.app

📱 Usage Guide

Getting Started

  1. Select Your Languages: Choose learning and native languages
  2. Pick a Mode: Echo, Dialogue, or Quiz based on your goals
  3. Configure Settings: Customize difficulty and topics
  4. Start Learning: Begin your interactive language learning journey

Echo Mode Workflow

  1. Configure language settings
  2. Click "Start Recording"
  3. Speak clearly in your target language
  4. Listen to AI correction with Murf AI voice
  5. Review detailed performance metrics
  6. Practice repeatedly for improvement

Dialogue Mode Workflow

  1. Select learning language and scenario
  2. Start conversation with AI
  3. Speak naturally when prompted
  4. Listen to AI responses with natural Murf AI voices
  5. Continue the conversation contextually
  6. Reset and try different scenarios

Quiz Mode Workflow

  1. Configure quiz parameters (questions, topic, languages)
  2. Listen to questions narrated by Murf AI
  3. Speak your answers clearly
  4. Receive immediate feedback with audio explanations
  5. Review comprehensive performance analytics
  6. Take additional quizzes to track progress

🏆 Hackathon Submission

VocaLearn is proudly submitted for the Murf AI Hackathon, showcasing the power of AI-driven text-to-speech technology in educational applications. The project demonstrates innovative use of Murf AI's premium TTS capabilities to create an immersive, interactive language learning experience.

Key Innovation Points

  • Seamless TTS Integration: Natural voice synthesis enhances learning experience
  • Multi-modal Learning: Combines speech recognition, AI conversation, and premium TTS
  • Real-world Application: Practical scenarios with context-aware AI responses
  • Scalable Architecture: Production-ready deployment with modern tech stack

🔗 Links

Made with Murf AI for the ultimate language learning experience 🎯✨

About

VocaLearn is an innovative language learning application that leverages advanced AI technologies to provide personalized, interactive language learning experiences.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •