These likely need to be updated in tandem (in the past transformers has made breaking changes for older versions of outlines).
We're currently on transformers==4.49.0 and outlines==0.2.1. We should just target the latest versions of these packages if possible. Should use the integration tests we have already to verify nothing breaks.