Code

Introduce flash-attn (>= 2.5.0). #3010

Code

Closed

sighingnow wants to merge 1 commit intovllm-project:mainvllm-project/vllm:mainfrom sighingnow:ht/use-flash-attnsighingnow/vllm:ht/use-flash-attnCopy head branch name to clipboard

+612-95

Commits

Commits on Mar 18, 2024

• Introduce flash-attn (>= 2.5.0) and add test cases.

  Show description for 5cbeb04
  sighingnow

  committed
  5cbeb04

  Copy full SHA for 5cbeb04