Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
Uh oh!
There was an error while loading.
Please reload this page
.
braintrustdata
/
autoevals
Public
Notifications
You must be signed in to change notification settings
Fork
76
Star
999
Code
Issues
7
Pull requests
14
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Actions
Projects
Security and quality
Insights
Actions: braintrustdata/autoevals
Actions
All workflows
Workflows
publish
publish
Copilot code review
Copilot code review
Dependabot Updates
Dependabot Updates
Dependency Graph
Dependency Graph
Enforce pnpm
Enforce pnpm
js
js
lint
lint
python
python
Run pnpm evals
Run pnpm evals
version-sync
version-sync
Show more workflows...
Management
Caches
Deployments
Run pnpm evals
Run pnpm evals
Actions
Loading...
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading.
Please reload this page
.
will be ignored since log searching is not yet available
Show workflow options
Create status badge
Create status badge
Loading
Uh oh!
There was an error while loading.
Please reload this page
.
eval.yaml
will be ignored since log searching is not yet available
256 workflow runs
256 workflow runs
Event
Filter by Event
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching events.
Status
Filter by Status
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching statuses.
Branch
Filter by Branch
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching branches.
Actor
Filter by Actor
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching users.
chore: Publish JS package via gha trusted publishing
Run pnpm evals
#402:
Commit
92a1b9d
pushed by
AbhiPrasad
1m 12s
abhi-js-publish
abhi-js-publish
1m 12s
View #180
View workflow file
bump autoevals version for patch release (#171)
Run pnpm evals
#401:
Commit
93f22c1
pushed by
AbhiPrasad
8s
js-0.0.132
js-0.0.132
8s
View workflow file
chore: Publish JS package via gha trusted publishing
Run pnpm evals
#400:
Commit
1d547f8
pushed by
AbhiPrasad
2m 51s
abhi-js-publish
abhi-js-publish
2m 51s
View workflow file
chore: Pin github actions to commit (#179)
Run pnpm evals
#399:
Commit
5b4b90c
pushed by
lforst
51s
main
main
51s
View workflow file
chore: Pin github actions to commit
Run pnpm evals
#398:
Commit
3616866
pushed by
lforst
1m 4s
lforst/pinact
lforst/pinact
1m 4s
View #179
View workflow file
chore: Pin github actions to commit
Run pnpm evals
#397:
Commit
7e9f847
pushed by
lforst
55s
lforst/pinact
lforst/pinact
55s
View workflow file
Bump to gpt5 models (#169)
Run pnpm evals
#396:
Commit
c52da64
pushed by
Qard
1m 1s
main
main
1m 1s
View workflow file
Add GPT-5/Responses API support and update default model to gpt-5-mini
Run pnpm evals
#395:
Commit
76a0bfc
pushed by
Qard
58s
gpt5
gpt5
58s
View #169
View workflow file
Fix CI failures caused by GPT-5/Responses API migration
Run pnpm evals
#394:
Commit
63c86f1
pushed by
Qard
58s
gpt5
gpt5
58s
View workflow file
Fix autoevals tests for GPT-5/Responses API migration
Run pnpm evals
#393:
Commit
e6c3470
pushed by
Qard
59s
gpt5
gpt5
59s
View workflow file
Remove span_info from Responses API params to avoid OpenAI rejection
Run pnpm evals
#392:
Commit
e829d3a
pushed by
Qard
1m 19s
gpt5
gpt5
1m 19s
View workflow file
Remove span_info from Responses API params to avoid OpenAI rejection
Run pnpm evals
#391:
Commit
53d6082
pushed by
Qard
5m 57s
gpt5
gpt5
5m 57s
View workflow file
Filter system messages (#177)
Run pnpm evals
#390:
Commit
71e61dd
pushed by
ankrgyl
42s
main
main
42s
View workflow file
filter system prompts in python
Run pnpm evals
#389:
Commit
4fa3627
pushed by
ankrgyl
35s
filter-system-messages
filter-system-messages
35s
View #177
View workflow file
Trace injection in python to mirror the JS implementation (#175)
Run pnpm evals
#388:
Commit
0d428fb
pushed by
CLowbrow
41s
main
main
41s
View workflow file
Fix autoevals tests for GPT-5/Responses API migration
Run pnpm evals
#387:
Commit
a867824
pushed by
Qard
56s
gpt5
gpt5
56s
View workflow file
Add Responses API mocks for Python tests
Run pnpm evals
#386:
Commit
6db4ff1
pushed by
Qard
1m 0s
gpt5
gpt5
1m 0s
View workflow file
Fix tool_calls field to be omitted instead of None
Run pnpm evals
#385:
Commit
6bbde12
pushed by
Qard
55s
gpt5
gpt5
55s
View workflow file
Fix NoneType iteration error in Responses API conversion
Run pnpm evals
#384:
Commit
24a9689
pushed by
Qard
1m 8s
gpt5
gpt5
1m 8s
View workflow file
Add async support for Responses API wrapper
Run pnpm evals
#383:
Commit
00a6fae
pushed by
Qard
1m 2s
gpt5
gpt5
1m 2s
View workflow file
Fix Responses API dict handling in Python autoevals
Run pnpm evals
#382:
Commit
c5c56b1
pushed by
Qard
1m 14s
gpt5
gpt5
1m 14s
View workflow file
Fix autoevals linting and update tests for gpt-5-mini default
Run pnpm evals
#381:
Commit
9a8e862
pushed by
Qard
1m 1s
gpt5
gpt5
1m 1s
View workflow file
Add missing refusal property to ChatCompletionMessage
Run pnpm evals
#380:
Commit
35c0dc7
pushed by
Qard
56s
gpt5
gpt5
56s
View workflow file
Add models configuration object to init() (#164)
Run pnpm evals
#379:
Commit
d99a37c
pushed by
Qard
50s
main
main
50s
View workflow file
Mark ContextRecall test as potentially flaky
Run pnpm evals
#378:
Commit
4d9dbea
pushed by
Qard
48s
gpt5
gpt5
48s
View workflow file
Previous
1
2
3
4
5
6
…
10
11
Next
You can’t perform that action at this time.