Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error running on GPU (DML) #63

Open
00f8t opened this issue Feb 25, 2025 · 1 comment
Open

Error running on GPU (DML) #63

00f8t opened this issue Feb 25, 2025 · 1 comment

Comments

@00f8t
Copy link

00f8t commented Feb 25, 2025

I`m trying to run it on GPU using DML. I installed required packages

Image

and when im trying to set provider

var sessionOptions = new SessionOptions()
{
    LogSeverityLevel = OrtLoggingLevel.ORT_LOGGING_LEVEL_VERBOSE,
    LogVerbosityLevel = 1,
    EnableMemoryPattern = false
};
sessionOptions.AppendExecutionProvider_DML();

it breaks with next error:
Microsoft.ML.OnnxRuntime.OnnxRuntimeException: '[ErrorCode:RuntimeException] '

Also i tried running it on CUDA, but it was even slower, than on CPU, and i tried to run it using TensorRT, but there was problems with model, i guess..

Im running on RTX 3050, and DX12 is installed.

@00f8t
Copy link
Author

00f8t commented Feb 25, 2025

microsoft/onnxruntime#13429 (comment)

this helped, but it still runs slower, than on CPU..

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant