-
Notifications
You must be signed in to change notification settings - Fork 1.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Wasi_nn PyTorch GPU support #10153
Comments
If you are a contributor to wasmtime/wasi_nn please leave your comments and sugestions. This is my first contribution in this project, so and help would be nice. |
I created a fork that solves the issue, at least for me. Maybe is interested for some one else. My fork |
@nerdola-de-cartola, thanks for looking into this. Looking at the top commit from your fork, I think the change makes sense to me (at a glance!). Are you willing to create a PR here that I can review? |
Yes, for sure, just tell me what I need to do |
Can you just create a PR from that fork you reference above? (If you're coming from a version control environment other than GitHub, these instructions may help?). |
Feature
Add GPU support for wasi_nn with PyTorch backend
Benefit
Improve performance over nn operations
Implementation
The PyTorch backend uses tch, which is a PyTorch wrapper for rust, so the basic implementation would be to add cada as a compilation target when compiling the tch crate.
The text was updated successfully, but these errors were encountered: