Code

Attention fusion (part 2)#2013

Code

Merged

gramalingam merged 45 commits intomainmicrosoft/onnxscript:mainfrom rama/fuse3microsoft/onnxscript:rama/fuse3Copy head branch name to clipboardJan 24, 2025

+471-251

Commits

Commits on Dec 18, 2024

• First version

  gramalingam

  committed
  8de7231

  Copy full SHA for 8de7231

• Add rotary embedding

  gramalingam

  committed
  a20b903

  Copy full SHA for a20b903

• Remove SDPA

  gramalingam

  committed
  b8f7a08

  Copy full SHA for b8f7a08

• Add comment

  gramalingam

  committed
  315c94e

  Copy full SHA for 315c94e

• Remove MHA

  gramalingam

  committed
  2219fd3

  Copy full SHA for 2219fd3

• Merge branch 'main' into rama/fuse-attn

  gramalingam

  authored
  f77f0e7

  Copy full SHA for f77f0e7

Commits on Dec 20, 2024

• Add rewrite for cos-sin computation

  gramalingam

  committed
  5ec9d1e

  Copy full SHA for 5ec9d1e

• Merge branch 'rama/fuse-attn' of https://github.com/microsoft/onnx-script into rama/fuse-attn

  gramalingam

  committed
  90f0b7b

  Copy full SHA for 90f0b7b

• Run lint

  gramalingam

  committed
  1fdc19b

  Copy full SHA for 1fdc19b

• Add cos sin test

  gramalingam

  committed
  eb916b8

  Copy full SHA for eb916b8

• Extend rewriter to support node reuse

  gramalingam

  committed
  d874dbc

  Copy full SHA for d874dbc

Commits on Dec 21, 2024

• Minor fixes

  gramalingam

  committed
  a745039

  Copy full SHA for a745039

Commits on Dec 22, 2024

• Fix concat bug in rotary embedding

  gramalingam

  committed
  17c06c3

  Copy full SHA for 17c06c3

Commits on Dec 23, 2024

• Minor cleanup

  gramalingam

  committed
  c7c7c79

  Copy full SHA for c7c7c79

• Merge branch 'main' into rama/fuse-attn

  gramalingam

  authored
  834815b

  Copy full SHA for 834815b

• Use callable to test callable

  gramalingam

  committed
  9a4a58e

  Copy full SHA for 9a4a58e

• Fix lint issues

  gramalingam

  committed
  766791d

  Copy full SHA for 766791d

Commits on Dec 24, 2024

• Attention fusion

  gramalingam

  committed
  c7384af

  Copy full SHA for c7384af

• Add support for cached state in rewrite

  gramalingam

  committed
  d0254d1

  Copy full SHA for d0254d1

• Cleanup MHA pattern

  gramalingam

  committed
  b91166b

  Copy full SHA for b91166b

Commits on Dec 26, 2024

• Complete MHA pattern

  gramalingam

  committed
  205805c

  Copy full SHA for 205805c

Commits on Dec 30, 2024

• Add support for debugging patterns

  gramalingam

  committed
  9b425dd

  Copy full SHA for 9b425dd

• Extensions to handle symbolic seqlen

  gramalingam

  committed
  7407ef9

  Copy full SHA for 7407ef9

• Extensions for symbolic dimensions

  gramalingam

  committed
  1c1a6cd

  Copy full SHA for 1c1a6cd

Commits on Dec 31, 2024

• Initial version of partial data propagation

  gramalingam

  committed
  32a723c

  Copy full SHA for 32a723c

• Minor fixes

  gramalingam

  committed
  9f76636

  Copy full SHA for 9f76636

Commits on Jan 2, 2025

• More extensions for symbolic seqlen

  gramalingam

  committed
  bf1d648

  Copy full SHA for bf1d648

Commits on Jan 3, 2025

• MHA pattern extension

  gramalingam

  committed
  9da980e

  Copy full SHA for 9da980e

• Cleanup for phi3

  gramalingam

  committed
  edd215e

  Copy full SHA for edd215e

• Merge branch 'rama/fuse3' of https://github.com/microsoft/onnx-script into rama/fuse3

  gramalingam

  committed
  0f45444

  Copy full SHA for 0f45444

Commits on Jan 4, 2025

• Cleanup MHA rule

  gramalingam

  committed
  d10dd74

  Copy full SHA for d10dd74

• Initial version of GQA

  gramalingam

  committed
  218e3f8

  Copy full SHA for 218e3f8

Commits on Jan 7, 2025

• float16 and const folding support in cos-sin

  gramalingam

  committed
  443dd5b

  Copy full SHA for 443dd5b

• GQA fix

  gramalingam

  committed
  01ec678

  Copy full SHA for 01ec678

• Merge branch 'rama/fuse3' of https://github.com/microsoft/onnx-script into rama/fuse3

  gramalingam

  committed
  616bcc7

  Copy full SHA for 616bcc7

Commits on Jan 9, 2025

• Merge with main

  gramalingam

  committed
  0ca1ee8

  Copy full SHA for 0ca1ee8

Commits on Jan 11, 2025

• Refactoring and cleanup

  gramalingam

  committed
  4a63081

  Copy full SHA for 4a63081

Commits on Jan 16, 2025

• Resolve merge conflicts

  gramalingam

  committed
  e63ec29

  Copy full SHA for e63ec29

• Merge with main

  gramalingam

  committed
  5e4c1c2

  Copy full SHA for 5e4c1c2

Commits on Jan 18, 2025

• Refactoring ort fusions folder

  gramalingam

  committed
  108f479

  Copy full SHA for 108f479

• Merge branch 'main' into rama/fuse3

  gramalingam

  authored
  c562839

  Copy full SHA for c562839

Commits on Jan 24, 2025

• Update exclude file and run lint

  gramalingam

  committed
  71eec31

  Copy full SHA for 71eec31

• Merge branch 'main' into rama/fuse3

  gramalingam

  authored
  92d8ba5

  Copy full SHA for 92d8ba5

• Lint fixes

  gramalingam

  committed
  9132f79

  Copy full SHA for 9132f79

• Merge branch 'rama/fuse3' of https://github.com/microsoft/onnx-script into rama/fuse3

  gramalingam

  committed
  8f379bf

  Copy full SHA for 8f379bf