Skip to content

Commit

Permalink
docs: fix link to embeddings.md in transformers.md
Browse files Browse the repository at this point in the history
  • Loading branch information
danbev committed Dec 10, 2024
1 parent ca0a6fd commit b067e3a
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion notes/architectures/transformers.md
Original file line number Diff line number Diff line change
Expand Up @@ -211,7 +211,7 @@ contains the token ids. The index tensor is used to index into the embeddings.
So with these embeddings the first thing in the model does is to add a
positional encoding to each of the embeddings. In the original paper this used
absolute position encoding. I've written about this is
[embeddings.md](./embeddings.md).
[embeddings.md](../position-embeddings/embeddings.md).

So we have our input matrix which in our case is a 4x512 matrix, where each
entry is one of the tokens in the input sentence. Notice that we in this case
Expand Down

0 comments on commit b067e3a

Please sign in to comment.