Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parallel conversations #10

Open
morsh opened this issue Aug 12, 2016 · 2 comments
Open

Parallel conversations #10

morsh opened this issue Aug 12, 2016 · 2 comments

Comments

@morsh
Copy link

morsh commented Aug 12, 2016

Add the ability for multiple models to simultaneously listen to the current responses.
Each model will listen to utterances and in case of a match a new conversation slot will open and wait for further relevant utterances.
The slots will keep listening to new utterances and will "raise" their hand for relevant matches.

@aribornstein
Copy link
Member

aribornstein commented Aug 24, 2016

This could be complicated since different models have different precision benchmarks for different classes.

For example just because one model returns .80 confidence and another one returns .60 confidence doesn't necessarily mean that the first model is the right choice.

It could be for example that the model with .80 confidence has a precision score .03 for a given class of input where as the second model has a precision score of .99 for a given class of input.

This could mean that even thought the second model has only .60 percent confident it has higher standards of confidence than the first model and therefore is more likely to produce the correct result. When you have multiple models and multiple classes it gets extremely hard to determine which classification is the best fit.

@morsh
Copy link
Author

morsh commented Aug 24, 2016

We are taking this under consideration.

Two things in mind:

  1. We are hoping that in the future, this will be better supported by LUIS
  2. In cases where the certainty of the score is not high, or the scores of multiple models is too close together, we will offer the user to choose between which conversation this is relevant to

see #18

@morsh morsh added question and removed question labels Aug 24, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants