Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature Request]: Is it possible to get the returned logsumexp in streamingllm forward? #85

Open
311dada opened this issue Nov 17, 2024 · 0 comments
Open

[Feature Request]: Is it possible to get the returned logsumexp in streamingllm forward? #85

311dada opened this issue Nov 17, 2024 · 0 comments
Assignees
@iofu728
Labels
feature request New feature or request

Comments

@311dada
Copy link

311dada commented Nov 17, 2024

Is your feature request related to a problem? Please describe.

Congratulations on your excellent work! I find the streaming_forward function does not return the logsumexp of the attention. Could you help me obtain that?

Thanks a lot!

Describe the solution you'd like

No response

Additional context

No response
@311dada 311dada added the feature request New feature or request label Nov 17, 2024
@iofu728 iofu728 self-assigned this Nov 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@iofu728 iofu728

Labels
feature request New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@311dada @iofu728