Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add benchmark.py and make only CUDA enable when available (ignore TensorRT, Azure, CoreML, which are not-tested / not-benefit) #15

Merged
merged 3 commits into from
Feb 12, 2024

Conversation

wkentaro
Copy link
Owner

@wkentaro wkentaro commented Feb 12, 2024

CUDA makes it faster.

image

CoreML won't make it faster. (with onnxruntime-silicon)

Screenshot 2024-02-12 at 22 37 58

(CoreML makes it hang (with onnxruntime==1.17), so let's not use it for now.)

cc @knorth55

@wkentaro wkentaro added the enhancement for pr label Feb 12, 2024
@wkentaro wkentaro self-assigned this Feb 12, 2024
@wkentaro wkentaro marked this pull request as ready for review February 12, 2024 13:44
@wkentaro wkentaro changed the title Add benchmark py Add benchmark.py and make only CUDA enable when available (ignore TensorRT, Azure, CoreML which are not-tested / not-benefit) Feb 12, 2024
@wkentaro wkentaro changed the title Add benchmark.py and make only CUDA enable when available (ignore TensorRT, Azure, CoreML which are not-tested / not-benefit) Add benchmark.py and make only CUDA enable when available (ignore TensorRT, Azure, CoreML, which are not-tested / not-benefit) Feb 12, 2024
@wkentaro wkentaro merged commit e0af059 into main Feb 12, 2024
3 checks passed
@wkentaro wkentaro deleted the add_benchmark_py branch February 12, 2024 13:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant