Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

请问新手该如何正确的学习项目代码 #124

Open
Huziyou opened this issue Sep 9, 2024 · 1 comment
Open

请问新手该如何正确的学习项目代码 #124

Huziyou opened this issue Sep 9, 2024 · 1 comment

Comments

@Huziyou
Copy link

Huziyou commented Sep 9, 2024

大佬好,因为本人是第一次接触模型推理加速这样的项目,在经过一系列配置后已经能成功运行run.py文件,请问正确学习本项目的方式是啥样呀,应该从什么文件开始学习阅读呢

@Tlntin
Copy link
Owner

Tlntin commented Sep 12, 2024

  1. 跟着readme跑通整个项目,熟悉流程。然后使用tritonserver完成项目部署,使用fastapi_tritonserver完成openai接口兼容。
  2. 看一遍本项目附带的B战视频,将分支切换到0.5,通篇阅读一下代码,对项目的运行有一定了解。
  3. 如果还要深入学习,去学一下cuda(包含cudnn, cublass, cutlass),onnx, TensorRT的东西。
  4. 再阅读一下本项目源码,尝试阅读c++部分源码,可以切换到0.1.0分支看看。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants