Using custom metrics in a Dashboard

[sara-vallejo]

I have created custom metrics for my Report following section 2 here[https://docs.evidentlyai.com/user-guide/customization/add-custom-metric-or-test].

I am able to create the reports with my custom function but when I create a dashboard and add these reports, it fails when I run evidently ui. I have noticed the error is when loading the snapshots as it cannot identify the new aliases for my metrics. However, if in a python console I import the functions and load the snapshots, it works.

Is there any way we could add those functions when running evidently ui in the CLI?

I realise it is noted in the link above that we won't be able to view such custom Metrics in the Monitoring user interface, but is there any work being done to fix this? It is a bit useless to be able to create custom metrics but not load the reports in the UI.

Thanks.

[elenasamuylova]

Hi @sara-vallejo,

It is indeed not currently possible to view Reports with custom renders in the Evidently UI due to custom code - as noted in the docs. However, we are working on a major release that will address this together with the new way of implementing metrics.