Code

vulkan: multi-row k quants#10846

Code

Open

netrunnereve wants to merge 6 commits intoggerganov:masterggerganov/llama.cpp:masterfrom netrunnereve:kquant-multi-rownetrunnereve/llama.cpp:kquant-multi-rowCopy head branch name to clipboard

+477-372

Commits

Commits on Dec 16, 2024

• multi row k quant shaders!

  netrunnereve

  committed
  c656d92

Commits on Dec 19, 2024

• merge master

  netrunnereve

  committed
  62dc170

• better row selection

  netrunnereve

  committed
  7bbd9cb

• more row choices

  netrunnereve

  committed
  63c27eb

• readjust row selection

  netrunnereve

  committed
  fa70739

Commits on Dec 22, 2024

• rm_kq=2 by default

  netrunnereve

  authored
  a3aea08