Instructions on Profiling SGLang Infer System with AMD GPUs

[leishaoSC]

Motivation

Modifications

Checklist

• Format your code according to the Contributor Guide.
• Add unit tests as outlined in the Contributor Guide.
• Update documentation as needed, including docstrings or example tutorials.

[HaiShaw]

@leishaoSC , LGTM and thanks!

[zhyncs]

May we consider adding this document to https://github.com/sgl-project/sgl-project.github.io cc @zhaochenyang20

[merrymercy]

@leishaoSC Thanks for the contribution. Can you resolve the conflicts?

[leishaoSC]

@leishaoSC Thanks for the contribution. Can you resolve the conflicts?

@merrymercy I have resolved the conflicts just now. Thanks.

[merrymercy]

@leishaoSC Can you fix the lint?

[merrymercy]

It still fails. Can you try https://github.com/sgl-project/sglang/blob/main/docs/references/contributor_guide.md#format-your-code?

[leishaoSC]

It still fails. Can you try https://github.com/sgl-project/sglang/blob/main/docs/references/contributor_guide.md#format-your-code?

I have formatted my code. does it work now? Thanks

[leishaoSC]

@merrymercy , I found in "cat .github/pull_request_template.md" my last 3 lines are unchecked. Is this ignorable or not? In addition, could you please help to rerun lint check? Thanks.

[leishaoSC]

Hi @merrymercy , I have made server.sh, client.sh, loadTracer.sh executable before I add/commit/push. However, I still saw the error "check that scripts with shebangs are executable..........................Failed

• hook id: check-shebang-scripts-are-executable
• exit code: 1". Could you please suggest how to fix it? Thanks.

[merrymercy]

You can delete the check-shebang-scripts-are-executable check in

sglang/.pre-commit-config.yaml

Line 20 in f9a377f

- id: check-executables-have-shebangs

. I think it is too restrict.

But you also failed multiple other tests such as trim trailing whitespace. Can you make sure they pass locally before pushing?

[leishaoSC]

You can delete the check-shebang-scripts-are-executable check in

sglang/.pre-commit-config.yaml

Line 20 in f9a377f

- id: check-executables-have-shebangs

. I think it is too restrict.
But you also failed multiple other tests such as trim trailing whitespace. Can you make sure they pass locally before pushing?

@merrymercy , I have delete the check-shebang-scripts-are-executable check in in my local .pre-commit-config.yaml. But when I ran "pre-commit run --all-files", I still saw one check failed, "don't commit to branch...................................................Failed

• hook id: no-commit-to-branch
• exit code: 1". In my local test, other checks all passed. Could you please suggest how I fix the "don't commit to branch" failed issue? In addition, what do you suggest I do to avoid the commit has more failed check on the Lint test? Thanks.
  

[leishaoSC]

Hi @merrymercy, I created a new PR #1966 from another feature branch. Hope it can work this time. Thanks.