Comparing Input and Output texts directly

[vidhyasivaswamy]

Hi ,
Need a help , we have a complex prompt with preserved user history.
We want to test the input and output of the model using the feedback functions, without calling any model as such, for relevance , toxicity. Need suggestion on how to do this with this tool.

Vidhya

[joshreini1]

Hey @vidhyasivaswamy - what are you trying to compare?

You should be able to do this with a custom feedback function