Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PHI3 onnxruntime-web "Live Demo here" fails . No questions answered. #431

Open
alanscot opened this issue May 21, 2024 · 2 comments
Open

Comments

@alanscot
Copy link

alanscot commented May 21, 2024

PHI3 Fail AGAIN
The loads completed successfully.
But empty answer boxes were all that I saw.
:(
Chrome v122 on Windows 11, RAM 32gb, NVDIA RTX4070 8gb
Alan

@alanscot alanscot changed the title PHI3 "Live Demo here" fails . No questions answered. PHI3 onnxruntime-web "Live Demo here" fails . No questions answered. May 21, 2024
@alanscot
Copy link
Author

SIMILARLY:
<<<<<<<<<<<<<<<<<<<
No error messages appear on https://huggingface.co/spaces/Xenova/experimental-phi3-webgpu in Chrome - Windows 11

It does display
1.29tokens/second every few seconds that changes
A minute later its 1.39tokens/second
then 1.38tokens/second
10 secs later its 1.35 tokens/second
then 1.34tokens/second and back to 1.35tokens/second then 1.33
About 7 mins later its "Generated 513 tokens in 382.79 seconds (1.34tokens/second)" which seems to be the end of changes.
I ask another Q and still nothing but empty answer box.
And ever changing -- ( starting with) "1.30 tokens/second" again
But this time it only takes about 3 minutes to end with "Generated 513 tokens in 175.92 seconds (2.92tokens/second)"
Then I ask a 3rd Q -- same thing that ends with Generated 513 tokens in 127.52 seconds (4.02tokens/second)

PHI3 Fail 1
AlScot
6 days ago

I hit RESET -- The screen clears -- READY appears
I ask a 1st question same thing -- ending this time with "Generated 513 tokens in 78.33 seconds (6.55tokens/second)"

@satyajandhyala
Copy link

Tested successfully on Windows11 with
Chrome version Version 128.0.6613.138 (Official Build) (64-bit) and
Chrome Canary Version 130.0.6722.0 (Official Build) canary (64-bit).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants