web ui from another machine

[ccbadd]

I run LLMs via a server and I am testing exllama running Ubuntu 22.04 on a Dual Xeon server with 2 AMD MI100s. Installing exllama was very simple and works great from the console but I'd like to use it from my desktop PC. Is there an option like Ooobabooga's "--listen" to allow it to be accessed over the local network?

thanks

[jmoney7823956789378]

Try this:

exllama/webui/app.py

Line 130 in 82369c5

parser.add_argument("-host", "--host", type = str, help = "IP:PORT eg, 0.0.0.0:7862", default = "localhost:5000")

Also, what kind of performance are you getting on the MI100s?

[turboderp]

Yep, it defaults to hosting the server on localhost which means it won't be accessible from other computers. Changing the IP to 0.0.0.0 should fix that. And make sure the port is exposed in the firewall.