Skip to content

[Integration]: Governance evaluation as Opik test cases #333

Description

@nagasatish007

Summary

Opik (by Comet, Apache 2.0) is an LLM evaluation framework. TealTiger governance correctness should be testable as Opik evaluation cases — "Did governance make the right decision given this input?"

Deliverables

  • tealtiger.integrations.opik module
  • Define governance evaluation metrics (false positive rate, false negative rate)
  • Test cases: "should block PII", "should allow clean input", "should enforce budget"
  • Example: evaluate governance policy accuracy with Opik

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Status
Backlog
Status
No status

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions