Skip to content

Commit

Permalink
docs: fix formatting in rope.md
Browse files Browse the repository at this point in the history
Signed-off-by: Daniel Bevenius <[email protected]>
  • Loading branch information
danbev committed Jul 6, 2024
1 parent 0faca9a commit 2d1e61f
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions notes/rope.md
Original file line number Diff line number Diff line change
Expand Up @@ -206,6 +206,7 @@ f_q([1 2 3 4 5 6 7 8], 2)

```
f_q(Xₘ, m) = (W_q xₘ)e^(imθ)
```

Where `W_q` is the query weight matrix, `xₘ` is the m-th row of the query matrix,
and `θ` is the rotation angle for the m-th position.
Expand Down

0 comments on commit 2d1e61f

Please sign in to comment.