This is the official repository for the following paper IEEE Xplore link. Introducing an innovative solution designed to bridge the gap in disseminating government policies and schemes to rural India. Our Web-based Video Dubbing Platform harnesses advanced transformer models, offering a transformative way to convey vital information. It's as simple as uploading a video or YouTube link to our portal, where our cutting-edge technologies come into play. (Video Demonstration)
- Open AI Whisper: Accurate audio-to-text transcription.
- MBart: Seamless text translation into desired Indian languages.
- Silero: Authentic audio conversion in multiple accents.
- Wave2Lip: Lip Sync Audio over a video.
This project has been published in 2024 8th International Conference on I-SMAC. You can find the publication details below:
- Title: Multilingual Video Dubbing System
- Conference/Journal: 2024 8th International Conference on I-SMAC
- Publication Date: October 2024
- DOI: 10.1109/I-SMAC61858.2024.10714669
For more details, please refer to the IEEE Xplore link