Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TTS: Adaptivity based on whether the robot is speaking #73

Open
hello-amal opened this issue Jul 11, 2024 · 0 comments
Open

TTS: Adaptivity based on whether the robot is speaking #73

hello-amal opened this issue Jul 11, 2024 · 0 comments

Comments

@hello-amal
Copy link
Collaborator

hello-amal commented Jul 11, 2024

#64 implements a streaming text-to-speech, where the ROS node receives commands via a topic and executes them. Unfortunately, this means that the node does not return feedback to the web app. There are several UX improvements that could be made if the node returns feedback:

  1. Changing "Play" to "Queue" while to robot is speaking, to make it clear that the text will not be played immediately.
  2. Only showing the "Stop" button while the robot is speaking.
  3. Allowing the operator to see the queue of utterances and where the robot currently is.

For all three, the most straightforward way to do so is to change the ROS interface to an action, so the web app knows when it is done speaking the utterance. The action interface will make it a bit less straightforward to queue utterances, but that should be doable. For the first two, the action interface will allow the web app to know when an utterance is done speaking. Using that information, the web app can maintain its own queue (which should mirror the ROS node's queue) and display that to the user (for the third point).

@hello-amal hello-amal changed the title Display the TTS queue TTS: Adaptivity based on whether the robot is speaking Jul 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant