Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

server: bench: minor fixes #10765

Draft
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

phymbert
Copy link
Collaborator

@phymbert phymbert commented Dec 10, 2024

Context

After a nice exchange with @ngxson, this is a minor change to the current server bench framework in order to refresh it a bit. Although the target would be to replace k6/xk6-sse with something like Locust (to be assessed) , python based.

Changes

  • support openAI streaming standard output with [DONE]\n\n
  • export k6 raw results in csv
  • fix too many tcp idle connection in tcp_wait
  • add metric time to emit first token

- support openAI streaming standard output with [DONE]\n\n
- export k6 raw results in csv
- fix too many tcp idle connection in tcp_wait
- add metric time to emit first token
@phymbert phymbert added performance Speed related topics server labels Dec 10, 2024
@github-actions github-actions bot added examples python python script changes labels Dec 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
examples performance Speed related topics python python script changes server
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant