Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DDP stops #12

Open
HyunsuYEE opened this issue Jun 30, 2024 · 0 comments
Open

DDP stops #12

HyunsuYEE opened this issue Jun 30, 2024 · 0 comments

Comments

@HyunsuYEE
Copy link

in my docker container, DDP training is stopped when the create_nerf() is called. Do you know what is the problem about it?
I used 8 gpus and I tried extract mesh and it is successfully done. (but trainning is stopped!!)
image
image
Do you know why DDP is stopped? (is there any deadlock..?)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant