Add attribute on the func op to indicate what should be run on CPU and accelerator or somehow use block to scope different IR regions.