New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] Any plan to support STA on A100 #196

Open

trouble-maker007 opened this issue Feb 19, 2025 · 2 comments

trouble-maker007 commented Feb 19, 2025

Motivation

Any plan to support STA on A100?

Related resources

No response

fishelegs commented Feb 19, 2025 •

edited

Loading

Any plan to support 4090 (SM89)?

sang-nguyen-ts commented Feb 27, 2025

I used Grok 3 to analyze steps to make it support for A100 GPU: https://x.com/i/grok?conversation=1895038105100656915

Summary:

H100 has TMA while A100 don't have this
Difference SM size per block (H100: 256kb and A100: 164kb)

Not sure if these are the only difference, anw I will try implement it in next days

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment