Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

question about the inference path #687

Open
too-z opened this issue Feb 8, 2025 · 0 comments
Open

question about the inference path #687

too-z opened this issue Feb 8, 2025 · 0 comments

Comments

@too-z
Copy link

too-z commented Feb 8, 2025

When looking at Mamba's code, the inference path that processes the full sequence as input—rather than using a step-by-step method (where only the last step is used as input)—seems identical to the training-time forward pass, as discussed in the link below:

#187

Does this mean that constant-time inference is only achievable with the step-by-step method?

Thanks in advance!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant