multiple gpu support

[CyanRenault]

good morning

ive using ur tutorial and installed in my personal gpu server, but it always failed: i check the whole steps and didnt find wheres the problem. including hugging face token.

initialization error: load library failed: libnvidia-ml.so.1: cannot open shared object file: no such file or directory: unknown.

so i think its the docker problem.

[CyanRenault]

besides i tried to use issue (12) but when i switch to use model 1.5 it says i cant find lt

[CyanRenault]

one more thing, would u open support the model parallel？i find it seems like disable in the docker