Advanced AI-driven fitness companion that tracks your workouts, analyzes form, and visualizes progress in 3D. Proudly participating in GirlScript Summer of Code 2026!
Features • Tech Stack • Installation • Usage • Contributing • License
SpectraX is a cutting-edge fitness application that uses MediaPipe Pose Detection and Three.js to provide real-time workout tracking and form analysis. It doesn't just track your body; it understands your movement, counts reps (like squats), detects mistakes, and provides immersive 3D visual feedback.
The project features a full-stack architecture with a React frontend and an Express/Socket.io backend for real-time data processing and cross-device synchronization.
- 🏋️ Intelligent Rep Counting: Automatically detects and counts exercises like squats, pushups, and more.
- 📐 Form Analysis: Real-time feedback on exercise posture and "rep scores" based on accuracy.
- 🎥 3D Body Mapping: Immersive 3D skeleton rendering with WebGL/Three.js.
- 🔍 Auto-Exercise Detection: Uses AI to detect which exercise you are performing without manual selection.
- 📊 Workout Summary: Detailed post-workout analytics including rep streaks, duration, and accuracy.
- 🔄 Replay System: Review your performance with our built-in replay feature.
- ⚡ Real-Time Sync: Low-latency communication between frontend and backend via WebSockets.
- Framework: React 18
- State Management: React Hooks & Context
- 3D Graphics: Three.js
- AI/ML: MediaPipe Pose, Transformers.js
- Icons: Lucide React
- Server: Express.js
- Real-Time: Socket.io
- Language: Node.js (CommonJS)
-
Clone the Repo
git clone https://github.com/Somil450/spectrax_1.git cd spectrax_1 -
Setup Frontend
npm install
-
Setup Backend
cd server npm install cd ..
-
Start the Backend
cd server npm run devServer runs on
http://localhost:3000 -
Start the Frontend (In a new terminal)
npm run dev
App runs on
http://localhost:5173 -
Workout Flow
- Welcome: Choose your exercise or let SpectraX auto-detect.
- Calibration: Align yourself with the camera for optimal tracking.
- Workout: Start exercising! Watch your reps count up in real-time.
- Summary: Review your stats and see where you can improve.
SpectraX is a GSSoC 2026 project and we welcome contributors of all levels!
- Read our CONTRIBUTING.md for the rules of engagement.
- Check the Issues for
level1,level2, orlevel3tasks. - Use the GSSoC Task Request Template when proposing changes.
This project is licensed under the MIT License.
SpectraX - The Future of AI Fitness. Made with ❤️ by Somil Jain and our amazing contributors.