Skip to content

Pull requests: vectorch-ai/ScaleLLM

New pull request New
9 Open 312 Closed
9 Open 312 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

kernel: use 8 warps to avoid register spilling for mla with hdim=512
#403 opened Feb 13, 2025 by guocuimi Loading…
kernel: support fp8 kv cache
#381 opened Jan 21, 2025 by guocuimi Loading…
[WIP] Llava support
#352 opened Nov 20, 2024 by guocuimi Loading…
feat: added marlin qlinear support
#303 opened Aug 9, 2024 by guocuimi Loading…
bugfix: fix multiple definition issue.
#261 opened Jul 3, 2024 by liutongxuan Loading…
[wip] feat: add embeddings support
#246 opened Jun 20, 2024 by guocuimi Loading…
[kernel] added half2 specialization for layernorm kernel
#139 opened Apr 22, 2024 by dongxianzhe Loading…
7
[model] add support for mixtral moe model
#128 opened Apr 16, 2024 by 936187425 Loading…
1
benchmark test script
#124 opened Apr 13, 2024 by ShijiaTang Loading…
2
ProTip! Adding no:label will show everything without a label.