Skip to content

Commit

Permalink
docs: fix error in ggml-quantization.md
Browse files Browse the repository at this point in the history
  • Loading branch information
danbev committed Aug 9, 2024
1 parent b08bd0b commit c265056
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions notes/ggml-quantization.md
Original file line number Diff line number Diff line change
Expand Up @@ -284,8 +284,8 @@ typedef struct {
uint8_t qs[QK5_0 / 2]; // nibbles / quants
} block_q5_0;
```
Notice that `qa` is in fact the same size as for `block_q4_0` but we have an
additional field `qh` which has an array of 5 (0-4). This is used to store the
Notice that `qs` is in fact the same size as for `block_q4_0` but we have an
additional field `qh` which has an array of 4 (0-4). This is used to store the
5th bit of the quantized value.

`qs` is where are quantized values are stored.
Expand Down

0 comments on commit c265056

Please sign in to comment.