Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ChartQA/DocVQA 分数异常 #683

Closed
OrlandoBloom16 opened this issue Dec 23, 2024 · 2 comments
Closed

ChartQA/DocVQA 分数异常 #683

OrlandoBloom16 opened this issue Dec 23, 2024 · 2 comments
Assignees
@PhoenixZ810

Comments

@OrlandoBloom16
Copy link

ChartQA/DocVQA 两个benchmark跑正常的模型出来分数很低并且接近零
@PhoenixZ810
Copy link
Collaborator

Hi,
Could you please show more details of the inference results?

@PhoenixZ810 PhoenixZ810 self-assigned this Dec 25, 2024
@linxid
Copy link

linxid commented Jan 22, 2025

我测试Aquila-VL-2B-llava-qwen跑出来只有 74，torchrun --nproc-per-node=8 --master_port=29503 run.py --data DocVQA_VAL --model Aquila-VL-2B --verbose， 直接这样运行的，是哪里有问题吗

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@PhoenixZ810 PhoenixZ810

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@linxid @PhoenixZ810 @OrlandoBloom16