Code

[WIP] WebGPU EP [skip ci]#21904

Code

Closed

fs-eire wants to merge 167 commits intomainmicrosoft/onnxruntime:mainfrom fs-eire/webgpu-epmicrosoft/onnxruntime:fs-eire/webgpu-epCopy head branch name to clipboard

+11,018-154

Commits

Commits on Aug 28, 2024

• [WIP] WebGPU EP initial commit

  fs-eire

  committed
  4037bd4

• update C-API

  fs-eire

  committed
  9c36250

• fix build break

  fs-eire

  committed
  3a0756d

• add an empty symbols.txt file

  fs-eire

  committed
  5199e98

Commits on Aug 29, 2024

• fix an error in doc

  fs-eire

  committed
  1c68dbd

• remove string_join.h in favor of absl::StrJoin

  fs-eire

  committed
  7db03de

• fix DLL copy

  fs-eire

  committed
  6a373c2

• update doc: require --skip_tests

  fs-eire

  committed
  ee42bba

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  5fac202

• update dawn version

  fs-eire

  committed
  3f46e5c

• disable Tint tests

  fs-eire

  committed
  9f61279

• fix one build break in Linux

  fs-eire

  committed
  6bb6335

Commits on Aug 30, 2024

• remove unused variables

  fs-eire

  committed
  d839dbc

• make webgpu build on linux and known to most tools (#21937)

  Show description for b70943d
  

  guschmue

  and

  fs-eire

  authored
  b70943d

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  c33ac2e

• revert type of ShaderVariable::rank_ to int

  fs-eire

  committed
  8437267

• output Impl() for variables

  fs-eire

  committed
  3caf032

• code formatting

  fs-eire

  committed
  84494c4

• better format of Uniform

  fs-eire

  committed
  aa70163

• revise document

  fs-eire

  committed
  d772db7

Commits on Aug 31, 2024

• more build fix for linux

  fs-eire

  committed
  6ef3dad

• apply formatter

  fs-eire

  committed
  a56f6c3

• simple test runner

  fs-eire

  committed
  12cd79d

• Program macros update - allow extend

  fs-eire

  committed
  14c8966

Commits on Sep 1, 2024

• fix BucketCacheManager

  fs-eire

  committed
  4fff35f

• add a method to get logger from ComputeContext

  fs-eire

  committed
  4fd8ad1

• add verbose log for cache key

  fs-eire

  committed
  3bd92ad

• revise suite test

  fs-eire

  committed
  6a1bbfe

• device lost handler

  fs-eire

  committed
  947aee1

• add '-a' and '-t' to test runner

  fs-eire

  committed
  99b2578

• atol/rtol 0.0001 -> 0.001

  fs-eire

  committed
  aa7b3f5

Commits on Sep 2, 2024

• Fix uniform

  fs-eire

  committed
  e659acd

• add some unary ops

  fs-eire

  committed
  6ad89c5

• various of fixes

  fs-eire

  committed
  8361fc3

Commits on Sep 3, 2024

• fix workgroup_size, cache key stringnify and indices type

  fs-eire

  committed
  c89159d

• shape_uniforms preparation

  fs-eire

  committed
  5ea5936

• allow uniforms of input/output shape/stride being added automatically

  fs-eire

  committed
  7d83054

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  7a64cc7

• fix build (linux)

  fs-eire

  committed
  1d53ac8

• fix stride

  fs-eire

  committed
  4d52602

• fix "{res_name}_bi2o_{name}"

  fs-eire

  committed
  3761aad

• Add Expand operator (#21933)

  Show description for 351da84
  qjia7

  authored
  351da84

• support onnxruntime_test_all

  fs-eire

  committed
  0b7ce77

• reflect change in WebGpuProviderFactoryCreator::Create signature (#21971)

  Show description for 33726b1
  guschmue

  authored
  33726b1

• compare the content of WEBGPU_BUFFER, not the address (#21967)

  Show description for 50ea9eb
  guschmue

  authored
  50ea9eb

• fix tanh

  fs-eire

  committed
  d6f6148

Commits on Sep 4, 2024

• support size==0 for element wise operators

  fs-eire

  committed
  626edaf

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  8913da1

• use shared ComputeBroadcastOutputShape()

  fs-eire

  committed
  bacc54c

• add workgroup_idx

  fs-eire

  committed
  7ecc5bb

• expose name for shader variable

  fs-eire

  committed
  ae836b1

Commits on Sep 5, 2024

• add uniform for 1D variable

  fs-eire

  committed
  243078b

• fix GetElementAt with uniform

  fs-eire

  committed
  4d48d28

• document update folder

  fs-eire

  committed
  dbe673b

• fix adapter/device creating: add toggles

  fs-eire

  committed
  38f182e

Commits on Sep 6, 2024

• more strict shape&stride usage check

  fs-eire

  committed
  eb80f7c

• fix vector realloc

  fs-eire

  committed
  39d5509

• simplify cache hint interface.

  fs-eire

  committed
  cd961c3

• revise expand

  fs-eire

  committed
  ddc2fbb

• revise unary

  fs-eire

  committed
  e8be835

• Elu/Relu/LeakyRelu/ThresholdedRelu/Gelu

  fs-eire

  committed
  bd7d592

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  eecac18

• remove unused field in class Gelu

  fs-eire

  committed
  601e50f

• remove out-of-dated comments

  fs-eire

  committed
  8f36da2

Commits on Sep 7, 2024

• Clip

  fs-eire

  committed
  72ebd85

• fix rank in shader helper

  fs-eire

  committed
  a3244ae

Commits on Sep 9, 2024

• fix shader variable

  fs-eire

  committed
  5a2ae8c

• move components number from variable to program

  fs-eire

  committed
  aa54ff8

• mark components in cache key

  fs-eire

  committed
  969384d

Commits on Sep 10, 2024

• Add FastGelu op (#21991)

  Show description for 6b82486
  

  qjia7

  and

  fs-eire

  authored
  6b82486

• use 'set/add' as prefix for some functions

  fs-eire

  committed
  2b3e7c2

• remove unnecessary cache hint for FastGelu

  fs-eire

  committed
  ef0d53b

• revise unary - expose consts in header

  fs-eire

  committed
  c4ca47f

• use path for header file

  fs-eire

  committed
  8806d57

Commits on Sep 11, 2024

• a few revises to the code (#22047)

  fs-eire

  committed
  0568e2b

• use OrtMutex

  fs-eire

  committed
  b7a9c0e

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  f65ade9

• [webgpu-native] Add transpose op (#21986)

  Show description for d4a963d
  

  axinging

  and

  fs-eire

  authored
  d4a963d

• PushErrorScope and PopErrorScope

  fs-eire

  committed
  8b61532

Commits on Sep 12, 2024

• placeholder for setting proc table

  fs-eire

  committed
  dce0f18

• Revert "placeholder for setting proc table"

  Show description for 8978d89
  fs-eire

  committed
  8978d89

• allow setting "ValidationMode"

  fs-eire

  committed
  43ccaf4

Commits on Sep 13, 2024

• make shape/stride correct when component != 1

  fs-eire

  committed
  eae4c3f

• expose number of components

  fs-eire

  committed
  b8c369d

• Fix build errors

  

  skottmckay

  authored and

  fs-eire

  committed
  c3086d6

Commits on Sep 14, 2024

• [WebGPU EP] Support Shape operator (#22095)

  Show description for c5cf2ab
  satyajandhyala

  authored
  c5cf2ab

Commits on Sep 17, 2024

• [webgpu EP] Binary operators (#22112)

  Show description for 0bc714f
  

  fs-eire

  and

  qjia7

  authored
  0bc714f

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  4421676

• use f32 for pow anyway

  fs-eire

  committed
  2e91a8b

• Cast operator

  fs-eire

  committed
  87f9edb

• do not use virtual function for getting ProgramMetadata

  fs-eire

  committed
  19ee9f3

Commits on Sep 18, 2024

• reshape, squeeze and unsqueeze

  fs-eire

  committed
  d9f7f19

• fix Cast and Clip

  fs-eire

  committed
  07675cf

Commits on Sep 20, 2024

• [webgpu-native] Add where op (#22014)

  Show description for dfab322
  

  axinging

  and

  fs-eire

  authored
  dfab322

• fix linux build break

  fs-eire

  committed
  cb9f3a4

Commits on Sep 24, 2024

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  207be92

Commits on Sep 25, 2024

• expose KernelContext

  fs-eire

  committed
  929725e

• revise fast gelu

  fs-eire

  committed
  c5e5af3

• expose Rank in IndicesHelper

  fs-eire

  committed
  82cd59e

• fix: move inline impl to .h

  fs-eire

  committed
  2393dbf

• add const modifier

  fs-eire

  committed
  9bdbd85

• remove toggle "disable_workgroup_init"

  fs-eire

  committed
  0101ce8

• set backend type to D3D12 since we always uses dxc (win).

  fs-eire

  committed
  3896706

• update build configurations to webgpu EP (#22047)

  Show description for f02e85a
  

  fs-eire

  and

  skottmckay

  authored
  f02e85a

Commits on Sep 26, 2024

• enable build pipeline on Windows for WebGPU

  fs-eire

  committed
  e5233ce

Commits on Sep 27, 2024

• [webgpu native] Add RotaryEmbedding op (#22194)

  Show description for 0f7a5f6
  axinging

  authored
  0f7a5f6

• [webgpu native] Add transpose shared (#22098)

  Show description for 41f6ff3
  axinging

  authored
  41f6ff3

• [webgpu-native] Add gather (#22183)

  Show description for b1b5e1f
  

  qjia7

  and

  fs-eire

  authored
  b1b5e1f

• [Native-WebGPU] Add Concat (#22225)

  Show description for 92a08e2
  

  satyajandhyala

  and

  fs-eire

  authored
  92a08e2

• [webgpu-native] Add MatmulNBits (#22150)

  Show description for 8da1f7a
  

  qjia7

  and

  fs-eire

  authored
  8da1f7a

Commits on Sep 30, 2024

• [WebGPU-Native] Tile Operator (#22239)

  Show description for f9b6b7c
  prathikr

  authored
  f9b6b7c

• use Abseil OStringStream in WebGPU EP string concat (#22241)

  Show description for c1ae1fd
  fs-eire

  authored
  c1ae1fd

• Range

  fs-eire

  committed
  b574f2c

• webgpu: support MultiHeadAttention operator (#22144)

  Show description for 14ea5db
  

  xhcao

  and

  fs-eire

  authored
  14ea5db

Commits on Oct 1, 2024

• [webgpu-native] support for webgpu layernorms (#22249)

  Show description for c70441e
  

  guschmue

  and

  fs-eire

  authored
  c70441e

• nodejs binding support webgpu

  fs-eire

  committed
  468c720

• fix where

  fs-eire

  committed
  cbf106e

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  bce7a98

• revert some changes that are not necessary

  fs-eire

  committed
  5086c7c

• revise perftest help msg

  fs-eire

  committed
  fe7d3e4

• [webgpu-native] Fix a few build errors on Linux (#22286)

  Show description for d219bb7
  snnn

  authored
  d219bb7

• format

  fs-eire

  committed
  7f7d6da

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  c561ed6

• fix issues for e2e phi3 (#22287)

  Show description for 27640e3
  

  guschmue

  and

  fs-eire

  authored
  27640e3

Commits on Oct 3, 2024

• fix perf problem: force Flush by end of session

  fs-eire

  committed
  4129cd6

• Uniform buffer mode: LazyRelease -> Simple

  fs-eire

  committed
  5fd65e7

• nodejs binding support IO binding for webgpu

  fs-eire

  committed
  dcf2062

Commits on Oct 4, 2024

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  481111b

• fix matmul test after conflict resolve

  fs-eire

  committed
  b84401d

• a few build fixes

  fs-eire

  committed
  08434d2

• fix build break in android build

  fs-eire

  committed
  1b01583

• fix duplicate "it"

  fs-eire

  committed
  130dc9b

• always disable DAWN_ENABLE_SPIRV_VALIDATION

  fs-eire

  committed
  646a744

Commits on Oct 5, 2024

• Enable OBJC/OBJCXX for all projects if necessary

  fs-eire

  committed
  da6406b

Commits on Oct 7, 2024

• minimal webgpu io-binding support for python (#22334)

  guschmue

  authored
  53ff621

Commits on Oct 8, 2024

• reset dispatch count

  fs-eire

  committed
  74b5131

Commits on Oct 9, 2024

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  4f4efcb

• remove unnecessary initialization options in test

  fs-eire

  committed
  0a8f872

• support ORT profiling in node.js

  fs-eire

  committed
  3f104fb

Commits on Oct 11, 2024

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  8261ca6

• [webgpu-native] support webgpu profiling (#22255)

  Show description for e7d05ba
  

  qjia7

  and

  fs-eire

  authored
  e7d05ba

• check ValidationMode for push/pop error scope

  fs-eire

  committed
  613ad6d

• [WebGPU EP] Remove unused variable. (#22412)

  Show description for f4bb64e
  edgchen1

  authored
  f4bb64e

Commits on Oct 14, 2024

• fix typo

  fs-eire

  committed
  cf8c478

• add "WebGPU:" prefix for config entries

  fs-eire

  committed
  be95c28

• nodejs support EP config

  fs-eire

  committed
  e76fe1f

Commits on Oct 15, 2024

• support session options "optimizedModelFilePath" and "extra"

  fs-eire

  committed
  c7c1e82

Commits on Oct 16, 2024

• allow to set a list for specifying force CPU nodes (#22431)

  Show description for cae9dab
  fs-eire

  authored
  cae9dab

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  2beeaf5

Commits on Oct 17, 2024

• fix bug in Gather

  fs-eire

  committed
  2c27a59

• Fix Unsqueeze

  fs-eire

  committed
  de6cf6b

• fix supports_device() in python interface

  fs-eire

  committed
  59298ff

• fix linux build

  fs-eire

  committed
  f18a65f

• enable pybind

  fs-eire

  committed
  cc340e2

• fix mac build

  fs-eire

  committed
  8553aec

• add test_dynamicquantizelinear_expanded_cpu

  fs-eire

  committed
  289145c

• remove temp tests

  fs-eire

  committed
  f2ee91c

Commits on Oct 18, 2024

• add power preference

  fs-eire

  committed
  3b462d6

• exclude dx11

  fs-eire

  committed
  0d49662

• WIN32 macro -> _WIN32

  fs-eire

  committed
  ddef640

Commits on Oct 21, 2024

• [webgpu-native] opt matmulnbits (#22472)

  Show description for d312b38
  qjia7

  authored
  d312b38

• webgpu ep support dawn proc table (#22509)

  Show description for 89b4549
  fs-eire

  authored
  89b4549

Commits on Oct 22, 2024

• [webgpu-native] Fix CI errors on MacOS (#22535)

  Show description for dc01790
  qjia7

  authored
  dc01790

• Merge remote-tracking branch 'origin/main' into fs-eire/webgpu-ep

  fs-eire

  committed
  26ff482

• replace OrtMutex

  fs-eire

  committed
  872149b

Commits on Oct 24, 2024

• allow build flag --use_external_dawn (#22552)

  Show description for a00f5b8
  fs-eire

  authored
  a00f5b8

• update dawn patch

  fs-eire

  committed
  d4764a8