The benchmark tool currently uses the ordinary -integrate-bootstrap jobs which publish to scala-release-temp. We should have a repo that is less temp to keep those builds (ideally forever, if there's enough space).
We'll also need a new build job that allows passing in compiler flags and customizing the artifact name, see scala/compiler-benchq#4.