Skip to content

Commit

Permalink
ggml: fix typo in rope.c comment
Browse files Browse the repository at this point in the history
  • Loading branch information
danbev committed Aug 3, 2024
1 parent cbf40b8 commit f36e8e0
Showing 1 changed file with 2 additions and 3 deletions.
5 changes: 2 additions & 3 deletions fundamentals/ggml/src/rope.c
Original file line number Diff line number Diff line change
Expand Up @@ -14,9 +14,8 @@ int main(int argc, char **argv) {
};
struct ggml_context* ctx = ggml_init(params);

// Simulate a sequence of 6 tokens with en embedding size of 4019 and a
// context length of 512. Keep in mind that this tensor is created to be
// used to calculate the coputation graph.
// Simulate a sequence of 6 tokens with en embedding size of 4096 and a
// context length of 512.
int n_ctx_orig = 4096;
int embd_dim = 128;
int n_head = 32;
Expand Down

0 comments on commit f36e8e0

Please sign in to comment.