Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Openai triton server #104

Draft
wants to merge 66 commits into
base: main
Choose a base branch
from

updated for style

c00bf15
Select commit
Loading
Failed to load commit list.
Draft

Openai triton server #104

updated for style
c00bf15
Select commit
Loading
Failed to load commit list.
GitHub Advanced Security / CodeQL succeeded Aug 2, 2024 in 2s

5 new alerts

New alerts in code changed by this pull request

  • 1 warning
  • 4 notes

See annotations below for details.

View all branch alerts.

Annotations

Check notice on line 91 in Triton_Inference_Server_Python_API/examples/fastapi/fastapi-codegen/openai-tritonserver.py

See this annotation in the file changed.

Code scanning / CodeQL

Except block handles 'BaseException' Note

Except block directly handles BaseException.

Check notice on line 10 in Triton_Inference_Server_Python_API/examples/fastapi/fastapi-codegen/openai-tritonserver.py

See this annotation in the file changed.

Code scanning / CodeQL

Unused import Note

Import of 'Optional' is not used.

Check notice on line 34 in Triton_Inference_Server_Python_API/examples/fastapi/fastapi-codegen/openai-tritonserver.py

See this annotation in the file changed.

Code scanning / CodeQL

Unused import Note

Import of 'AutoTokenizer' is not used.

Check warning on line 254 in Triton_Inference_Server_Python_API/examples/fastapi/fastapi-codegen/openai_protocol_types.py

See this annotation in the file changed.

Code scanning / CodeQL

Unnecessary pass Warning

Unnecessary 'pass' statement.

Check notice on line 121 in Triton_Inference_Server_Python_API/examples/fastapi/fastapi-codegen/transformers_utils/tokenizer.py

See this annotation in the file changed.

Code scanning / CodeQL

Commented-out code Note

This comment appears to contain commented-out code.