build(deps): changes needed to support mamba/jamba model

[anhuong]

Description of the change

In order to support Mamba2ForCausalLM and JambaForCausalLM models, we needed to install deps mamba_ssm and transformers with changes from Fabian's fork. In order to install mamba_ssm, we needed package cudnn9-cuda-12 otherwise we hit error ImportError: libcudnn.so.9: cannot open shared object file: No such file or directory. Then, causal-conv1d failed to install from mamba_ssm due to ModuleNotFoundError: No module named 'torch' which is why we are installing mamba_ssm as a separate dependency after the base deps are installed.

Related issue number

How to verify the PR

Built image with these changes and was able to run tuning on Mamba and Jamba models.

Was the PR tested

• I have added >=1 unit test(s) for every new method I have added.
• I have ensured all unit tests pass

[github-actions]

Thanks for making a pull request! 😃
One of the maintainers will review and advise on the next steps.