Skip to content
vllm

[fix] fix OOM when megatron loading large model by only rank 0 loads weights #642

Sign in to view logs

[fix] fix OOM when megatron loading large model by only rank 0 loads weights

[fix] fix OOM when megatron loading large model by only rank 0 loads weights #642

This workflow is awaiting approval from a maintainer in #330
Triggered via pull request February 26, 2025 02:50
@uygnefuygnef
synchronize #330
uygnef:fix/fix_load_model_oom
Status Action required
Total duration –
Artifacts –
This workflow is awaiting approval from a maintainer in #330

vllm.yml

on: pull_request
vllm
vllm
Fit to window
Zoom out
Zoom in