Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Precompile all kernels (no jit) #18

Open
YLGH opened this issue Feb 26, 2025 · 2 comments
Open

Precompile all kernels (no jit) #18

YLGH opened this issue Feb 26, 2025 · 2 comments

Comments

@YLGH
Copy link

YLGH commented Feb 26, 2025

Hi, thanks for the amazing library!

Just wondering, is there a way to disable jit by precompiling all the necessary shapes? Or is it recommended to just some "warmup" script to compile all the kernels? What's a good list of M,N,K values to do so?

@jason-huang03
Copy link

Not possible, the N and K are template arguments.

@LyricZhao
Copy link
Collaborator

For your own model (if the shapes are fixed), you can simply modify the test scripts to test all the shapes your model used. And later for model training, make sure that you are using the same cache dir (DG_CACHE_DIR).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants