Skip to content

Commit

Permalink
[Speculative Decoding 1/2 ] Add typical acceptance sampling as one of…
Browse files Browse the repository at this point in the history 
… the sampling techniques in the verifier (vllm-project#5131)
  • Loading branch information
@sroy745 @robertgshaw2-neuralmagic
sroy745 authored and robertgshaw2-neuralmagic committed Jun 23, 2024
1 parent 7a58e54 commit dbf0e91
Show file tree
Hide file tree
Showing 4 changed files with 866 additions and 164 deletions.
Loading

0 comments on commit dbf0e91

Please sign in to comment.