pull

[executorch][cuda] Optimize short-query INT4 matvec kernels (#21503) #83300

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
CI run decision / decide	30s
Get changed files / get-changed-files	4s
test-setup-linux-gcc / linux-job	8m 51s
test-qnn-wheel-packages-linux (3.10) / linux-job	18m 25s
test-qnn-wheel-packages-linux (3.11) / linux-job	18m 11s
test-qnn-wheel-packages-linux (3.13) / linux-job	18m 9s
test-qnn-wheel-packages-linux (3.12) / linux-job	18m 15s
test-models-linux-basic (mv3, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job	9m 28s
test-models-linux-basic (mv3, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job	11m 44s
test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job	9m 52s
test-models-linux-basic (vit, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job	18m 28s
test-models-linux-basic (mv3, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job	10m 44s
test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job	10m 29s
test-models-linux-basic (vit, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job	16m 26s
test-models-linux-basic (mv3, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job	9m 27s
test-models-linux-basic (vit, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job	16m 34s
test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job	12m 18s
test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job	13m 6s
test-models-linux-basic (vit, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job	11m 31s
android / build-android	12m 29s
test-arm-backend-public-api-backward-compatibility / linux-job	11m 6s
test-qnn-testsuite-linux / test-backend-macos	0s
test-mcu-cortex-m-backend / linux-job	37m 29s
test-models-linux (emformer_transcribe, portable, linux.2xlarge) / linux-job	10m 42s
test-qnn-direct-build-linux / linux-job	16m 6s
test-models-linux (resnet50, portable, linux.2xlarge) / linux-job	23m 6s
unittest-buck / windows	0s
test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job	11m 14s
test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job	52m 39s
test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job	10m 17s
test-models-linux (ic3, xnnpack-quantization-delegation, linux.2xlarge) / linux-job	10m 0s
test-models-linux (mv2, portable, linux.2xlarge) / linux-job	10m 9s
test-models-linux (add, portable, linux.2xlarge) / linux-job	9m 4s
test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job	53m 12s
test-models-linux (linear, portable, linux.2xlarge) / linux-job	9m 5s
test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job	42m 9s
test-models-linux (mobilebert, portable, linux.2xlarge) / linux-job	10m 49s
test-models-linux (linear, xnnpack-quantization-delegation, linux.2xlarge) / linux-job	9m 41s
test-models-linux (add, xnnpack-quantization-delegation, linux.2xlarge) / linux-job	9m 25s
test-models-linux (resnet18, xnnpack-quantization-delegation, linux.2xlarge) / linux-job	9m 31s
test-models-linux (add_mul, xnnpack-quantization-delegation, linux.2xlarge) / linux-job	9m 37s
test-models-linux (ic3, portable, linux.2xlarge) / linux-job	18m 22s
test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job	34m 38s
test-models-linux (resnet18, portable, linux.2xlarge) / linux-job	13m 52s
test-models-linux (emformer_transcribe, xnnpack-quantization-delegation, linux.2xlarge) / linux-job	13m 8s
test-models-linux (w2l, portable, linux.4xlarge.memory) / linux-job	11m 38s
test-models-linux (mv2, xnnpack-quantization-delegation, linux.2xlarge) / linux-job	9m 58s
test-models-linux (mobilebert, xnnpack-quantization-delegation, linux.2xlarge) / linux-job	11m 3s
test-models-linux (add_mul, portable, linux.2xlarge) / linux-job	9m 8s
test-models-linux (resnet50, xnnpack-quantization-delegation, linux.2xlarge) / linux-job	9m 35s
test-samsung-quantmodels-linux / linux-job	20m 8s
test-vulkan-operators-linux / linux-job	15m 45s
test-vulkan-models-linux / linux-job	21m 21s
test-samsung-models-linux / linux-job	11m 25s
nxp-build-test / linux-job	4m 40s
unittest-nxp-neutron / linux-job	1h 30m 22s
test-arm-cortex-m-size-test (zephyr-preset) / linux-job	10m 49s
test-llama-runner-linux-android / linux-job	15m 34s
test-parakeet-xnnpack-linux / linux-job	28m 28s
test-arm-cortex-m-size-test (bare_metal) / linux-job	11m 33s
test-binary-size-linux-gcc / linux-job	7m 6s
test-arm-backend-no-driver (test_pytest_ops_no_target) / linux-job	9m 29s
test-arm-backend-no-driver (test_pytest_ops_tosa) / linux-job	48m 21s
test-arm-backend-no-driver (test_pytest_models_tosa) / linux-job	58m 43s
unittest / windows / windows-job	1h 26m 59s
test-arm-backend-no-driver (test_run_tosa) / linux-job	8m 28s
test-qnn-passes-linux / linux-job	12m 42s
unittest / macos / macos-job	36m 46s
unittest / linux / linux-job	1h 21m 19s
test-quantized-aot-lib-linux / linux-job	9m 7s
test-qnn-models-linux (mv2) / linux-job	12m 54s
test-qnn-models-linux (mv3) / linux-job	13m 13s
test-qnn-delegate-linux / linux-job	45m 39s
test-binary-size-linux / linux-job	7m 11s
test-qnn-models-linux (dl3) / linux-job	13m 56s
test-moshi-linux / linux-job	15m 19s
unittest-buck / linux / linux-job	13m 36s
test-multimodal-linux (gemma3-4b) / linux-job	34m 11s
unittest-buck / macos / macos-job	9m 5s
test-sqnr-static-llm-qnn-linux (smollm2_135m) / linux-job	35m 46s
test-qnn-buck-build-linux / linux-job	10m 48s
test-voxtral-realtime-xnnpack-linux / linux-job	44m 43s
test-selective-build-linux / linux-job	9m 49s
test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job	25m 23s
unittest-editable / linux / linux-job	1h 24m 6s
test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job	34m 5s
unittest-editable / windows / windows-job	1h 25m 27s
test-static-llama-qnn-linux (stories_260k_bc) / linux-job	15m 30s
test-custom-ops-linux / linux-job	9m 6s
unittest-editable / macos / macos-job	44m 33s
test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.arm64.2xlarge, executorch-ubuntu-22.04-gc... / linux-job	20m 42s
test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job	14m 43s
test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04... / linux-job	15m 12s
test-static-llama-qnn-linux (stories_110m) / linux-job	32m 6s
test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job	15m 8s
test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu... / linux-job	21m 18s
test-llama-runner-linux (bf16, custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job	11m 9s
test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu-22.04-... / linux-job	21m 45s
test-build-wasm-linux / linux-job	14m 8s
test-eval_llama-wikitext-linux / linux-job	9m 15s
test-lora-multimethod-linux / linux-job	40m 45s
test-llama_runner_eager-linux / linux-job	9m 8s
test-openvino-linux / linux-job	8m 47s
test-qnn-python-imports-linux / linux-job	12m 44s
test-mediatek-models-linux / linux-job	12m 6s
test-phi-3-mini-runner-linux / linux-job	19m 36s
test-lora-linux / linux-job	1h 1m 38s
unittest-wasm-bindings (--enable-etdump) / linux-job	10m 26s
unittest-wasm-bindings / linux-job	10m 40s
test-qnn-testsuite-linux / test-backend-linux (qnn, models) / linux-job	52m 1s
test-qnn-testsuite-linux / test-backend-linux (qnn, operators) / linux-job	18m 3s
test-minimal-wheel-linux / linux-job	6m 2s
test-coreml-bc-macos (macos-m2-stable) / macos-job	10m 53s
test-coreml-bc-macos (macos-m1-stable) / macos-job	13m 44s
android / run-emulator	6m 36s
test-qnn-testsuite-linux / package-golden-artifacts	-1s
	1d 15h 13m 43s

Navigation Menu

Uh oh!

[executorch][cuda] Optimize short-query INT4 matvec kernels (#21503) #83300

Usage

[executorch][cuda] Optimize short-query INT4 matvec kernels (#21503) #83300

Uh oh!

Run time