Skip to content

nikkiguo/speechrly

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

46 Commits
 
 
 
 
 
 
 
 

Repository files navigation

speechrly

Practice and perfect your speech skills 🎤

Submission to Hack the North 2023

Inspiration

As our lives continue, it is apparent that communication and presentation skills are required and valued, starting from a young age at school, to up until after graduation, hopping from interview to interview. Thus, our current reality of the need for certain abilities to succeed inspired us to develop a program that would support and aid people, ranging from students to adults, in the development and refinement of this necessary ability.

What it does

Speakrly is an online app that improves the user's presentation skills. Through the many frameworks and technologies, it is able to analyze the speaker's presentation, in respect of its context, and the user's hand and eye movement. Through the examination, it is able to adequately assess the user based on these three areas and further produce feedback if needed.

How we built it

On VSCode, with the help of GitHub, Router, and React, we were able to develop this beneficial program. Through its development, we used Cohere Rerank (in order to identify that all main points of a speech have been addressed) and OpenAI Whisper with Python for the speech recognition aspects and material UI for the front-end visuals.

Challenges we ran into

Throughout this year's Hack the North, we encountered many challenges. Similar to many others, we were looking forward to using the AdHawk glasses. However, due to the low quantity available, we ended up empty-handed. Furthermore, the time span for the Hackathon added further pressure to accomplish something great at the end for the judges to witness.

Accomplishments that we're proud of Although we faced many obstacles, we were still able to mitigate them. Some of the problems we met left us will fewer resources than expected. But through other aspects, we were able to overcome these complications. Such as the situation with the AdHawk glasses. We were still able to continue our eye-tracking aspect using a different application.

What we learned

After this experience, we will leave the hackathon with more knowledge than we had when we first entered it. Throughout the hackathon, we were met with many challenges. But with our resilience and perseverance, we were able to adapt and modify ourselves to meet the needs of these aspects of the program. With each complication was a possibility for new knowledge. Thus, through the 36 hours at Hack the North, we were able to learn a lot.

What's next for Speakrly

We at Speakrly hope to continue to help the community through any programming aspects. In the future, we hope to expand more into hardware to further help future generations at improving their skills and abilities when they enter the real world.

Features

image

Enter your main speech points

image

Start your recording

image

Stop recording and view your speech in text!

image

Record your video and see the analysis of eye contact and expressive gesture use!

image

Click Evaluate to check score!

image

About

Practice and perfect your speech skills

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published