Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[QUESTION] Resume training about dataset #1343

Open
JiwenJ opened this issue Jan 2, 2025 · 0 comments
Open

[QUESTION] Resume training about dataset #1343

JiwenJ opened this issue Jan 2, 2025 · 0 comments

Comments

@JiwenJ
Copy link

JiwenJ commented Jan 2, 2025

Hello, I have encountered training node collapse and I want to resume the training, I am wondering if megatron would reusme the datasets (i.e., not see the tokens have been trained) and if so how does it work and is there any argument in arguments.py related to that? Very appreciate it if someone can help~

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant