docs: fix incorrect padding in the cache visualizations

danbev · Oct 30, 2024 · 333b7a2 · 333b7a2
1 parent 02a696f
commit 333b7a2
Showing 1 changed file with 3 additions and 3 deletions.
diff --git a/notes/llama-kv-cache.md b/notes/llama-kv-cache.md
@@ -2037,7 +2037,7 @@ belong to the current tokens sequence:
 ```console
       0    1    2    3    4    5    6    7    8    9   10    11   12   13   14   15           31
     +----+----+----+----+----+----+----+----+----+----+----+----+----+----+----+----+-------+----+
-    |-inf|-inf|-inf|-inf|-inf|-inf|0.0f|0.0f|0.0f|0.0f|0.0f|0.0f|0.0f|0.0f|-inf|-inf| ...   |-inf|
+    |-inf|-inf|-inf|-inf|-inf|-inf|-inf|0.0f|0.0f|0.0f|0.0f|0.0f|0.0f|0.0f|-inf|-inf| ...   |-inf|
     +----+----+----+----+----+----+----+----+----+----+----+----+----+----+----+----+------------+
 ```
 Notice how this inner loop (1) is just iterating over a single token in this
@@ -2046,7 +2046,7 @@ up to the the padded size of the tokens (n_kv which is 32 in this case):
 ```console
       0    1    2    3    4    5    6    7    8    9   10    11   12   13   14   15           31
     +----+----+----+----+----+----+----+----+----+----+----+----+----+----+----+----+-------+----+
-0   |-inf|-inf|-inf|-inf|-inf|-inf|0.0f|0.0f|0.0f|0.0f|0.0f|0.0f|0.0f|0.0f|-inf|-inf| ...   |-inf|
+0   |-inf|-inf|-inf|-inf|-inf|-inf|-inf|0.0f|0.0f|0.0f|0.0f|0.0f|0.0f|0.0f|-inf|-inf| ...   |-inf|
     +----+----+----+----+----+----+----+----+----+----+----+----+----+----+----+----+------------+
     |-inf|-inf|-inf|-inf|-inf|-inf|-inf|-inf|-inf|-inf|-inf|-inf|-inf|-inf|-inf|-inf| ...   |-inf|
     +----+----+----+----+----+----+----+----+----+----+----+----+----+----+----+----+------------+
@@ -2055,7 +2055,7 @@ And this will continue for all the 32 tokens in the cache.
 ```console
       0    1    2    3    4    5    6    7    8    9   10    11   12   13   14   15           31
     +----+----+----+----+----+----+----+----+----+----+----+----+----+----+----+----+-------+----+
-0   |-inf|-inf|-inf|-inf|-inf|-inf|0.0f|0.0f|0.0f|0.0f|0.0f|0.0f|0.0f|0.0f|-inf|-inf| ...   |-inf|
+0   |-inf|-inf|-inf|-inf|-inf|-inf|-inf|0.0f|0.0f|0.0f|0.0f|0.0f|0.0f|0.0f|-inf|-inf| ...   |-inf|
     +----+----+----+----+----+----+----+----+----+----+----+----+----+----+----+----+------------+
     |-inf|-inf|-inf|-inf|-inf|-inf|-inf|-inf|-inf|-inf|-inf|-inf|-inf|-inf|-inf|-inf| ...   |-inf|
     +----+----+----+----+----+----+----+----+----+----+----+----+----+----+----+----+------------+