How to use RL model in simulation enviroment to control a real HVAC facility

[agl71]

HI

I have trained a RL model in the simulation enviroment, but I want to control a real HVAC system by the RL model.
How can I do ? The following is my plan.

1. Encapsulate the RL model(pytorch format model; pth) and to form FMU1(simulation side).
2. Encapsulate the real HVAC communication protocol and to form FMU2(facility side).
   3)FMU1 interact with FMU2 through the BCVTB.

But, I don't know how to implement step 1).
Best regards;