Why there is no Ort::MemoryInfo::CreateGPU
or CreateCUDA
?
#23356
Unanswered
UnlimitedR
asked this question in
API Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I see all the codes are like this
Ort::MemoryInfo memoryInfo = Ort::MemoryInfo::CreateCpu(OrtAllocatorType::OrtArenaAllocator, OrtMemType::OrtMemTypeDefault); Ort::Value input_tensor = Ort::Value::CreateTensor<float>(memoryInfo, ...);
why it is always
CreateCpu
? what if I want a CUDA tensor to accelerate the calculation?and what about
OrtAllocatorType
? There seems to beOrtDeviceAllocator
andOrtArenaAllocator
, I'm not sure about their differences.Beta Was this translation helpful? Give feedback.
All reactions