Code

Support varlen FlashAttention#14

Code

Merged

Seventeen17 merged 10 commits intoaccAlibabaPAI/xla:accfrom dev/fa_mask_swtAlibabaPAI/xla:dev/fa_mask_swtCopy head branch name to clipboardNov 19, 2024

+2,375-792

Commits

Commits on Nov 7, 2024

• flash attention support attention_mask

  Seventeen17

  committed
  a8eaff2

Commits on Nov 11, 2024

• refine code

  Seventeen17

  committed
  6a9e0f5

• refine

  Seventeen17

  committed
  fb133bd

• clang-format

  Seventeen17

  committed
  5dd800e

• use string params

  Seventeen17

  committed
  5fdfca5

• refine code

  Seventeen17

  committed
  beb8ee4

Commits on Nov 15, 2024

• refine code

  Seventeen17

  committed
  eaa2d2e

• move redundant cod

  Seventeen17

  committed
  6500544

Commits on Nov 19, 2024

• refine test cases

  Seventeen17

  committed
  7ad0227

• remove rng_state fill

  Seventeen17

  committed
  72e913c