Model Confidence score

[LuckyVicky001]

Hi,
For the Model Confidence score, is the underlying dialogue model SEQ2SEQ? But I also found loss of dialogwae/hred/transformer/cvae. What's the meaning of these values and how did you use them?
Thx, again.

[hengyicai]

Sorry for the late reply. When applying the "model confidence" curriculum on the specific model architecture (e.g., transformer or hred), the loss computed by the corresponding model architecture can be used to measure the "model confidence" score. You can also regard the seq2seq loss as "model confidence" for all the model architectures. In experiments, we did not find significant differences between these two options.