loss.py and actor.py are not in the project

[ssAllenss]

Traceback (most recent call last):
File "/root/miniconda3/envs/train/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/root/miniconda3/envs/train/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "/data/vjuicefs_ai_rank_wl/public_data/11170256/open_sources/ml-clara-main/openrlhf/cli/train_sft.py", line 24, in
from openrlhf.trainer.sft_trainer import SFTTrainer
File "/data/vjuicefs_ai_rank_wl/public_data/11170256/open_sources/ml-clara-main/openrlhf/trainer/sft_trainer.py", line 24, in
from openrlhf.models import SFTLoss
ImportError: cannot import name 'SFTLoss' from 'openrlhf.models' (/data/vjuicefs_ai_rank_wl/public_data/111702

[ckgresla]

And:

Traceback (most recent call last):
  File "/opt/miniconda/envs/clara/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/opt/miniconda/envs/clara/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/home/ckg/wafer/ml-clara/openrlhf/cli/train_sft.py", line 23, in <module>
    from openrlhf.models import Actor
  File "/home/ckg/wafer/ml-clara/openrlhf/models/__init__.py", line 6, in <module>
    from .actor import Actor
ModuleNotFoundError: No module named 'openrlhf.models.actor'

[ckgresla]

For those building this, you'll probably want to add all of these:
https://github.com/OpenRLHF/OpenRLHF/blob/main/openrlhf/models

[probe2]

We are not using these two modules, so they can be commented out. The code has already been updated.