Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wasi_nn PyTorch GPU support #10153

Open
nerdola-de-cartola opened this issue Jan 29, 2025 · 5 comments
Open

Wasi_nn PyTorch GPU support #10153

nerdola-de-cartola opened this issue Jan 29, 2025 · 5 comments

Comments

@nerdola-de-cartola
Copy link

Feature

Add GPU support for wasi_nn with PyTorch backend

Benefit

Improve performance over nn operations

Implementation

The PyTorch backend uses tch, which is a PyTorch wrapper for rust, so the basic implementation would be to add cada as a compilation target when compiling the tch crate.

@nerdola-de-cartola
Copy link
Author

If you are a contributor to wasmtime/wasi_nn please leave your comments and sugestions. This is my first contribution in this project, so and help would be nice.

@nerdola-de-cartola
Copy link
Author

I created a fork that solves the issue, at least for me. Maybe is interested for some one else. My fork

@abrown
Copy link
Contributor

abrown commented Jan 30, 2025

@nerdola-de-cartola, thanks for looking into this. Looking at the top commit from your fork, I think the change makes sense to me (at a glance!). Are you willing to create a PR here that I can review?

@nerdola-de-cartola
Copy link
Author

Yes, for sure, just tell me what I need to do

@abrown
Copy link
Contributor

abrown commented Feb 4, 2025

Can you just create a PR from that fork you reference above? (If you're coming from a version control environment other than GitHub, these instructions may help?).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants