about lora support

[zjcanjux]

it seems add following script in bash

     ...
    actor_rollout_ref.model.lora_rank=64 \
    actor_rollout_ref.model.lora_alpha=32  \

    ...

will support lora ?

[jeffreysijuntan]

We use verl as our backend, so if the current verl supports LoRA, then yes. You can refer to our v0.2 branch where we integrate with the latest verl v0.5, and you should be able to use features officially supported by verl.