Skip to content

Conversation

@kaiming-cheng
Copy link
Contributor

This PR adds an option for the agent to use provided test_code

With the BackendBench integration, we would like to use their provided test_code for robust benchmarking

If no test_code is provided, it will fall back to the LLM generated test

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Meta Open Source bot. label Nov 7, 2025
@kaiming-cheng kaiming-cheng marked this pull request as ready for review November 7, 2025 06:27
@kaiming-cheng kaiming-cheng force-pushed the kaiming/BackendBenchIntegration branch from fea4bd0 to 9952141 Compare November 7, 2025 06:28
@kaiming-cheng kaiming-cheng changed the title Add option for agent to use provided test_code if available Introduce KernelAgent <> BackendBench Integration Nov 7, 2025
@kaiming-cheng kaiming-cheng force-pushed the kaiming/BackendBenchIntegration branch from 9952141 to b357267 Compare November 7, 2025 06:33
@kaiming-cheng kaiming-cheng changed the title Introduce KernelAgent <> BackendBench Integration Use provided test_code if available for agent Nov 7, 2025
@Laurawly
Copy link
Contributor

Laurawly commented Nov 7, 2025

Let's focus on perf first before the integration.

@Laurawly Laurawly closed this Nov 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants