MLX/Metal Support

[Reinhard-Berger]

Request for MLX/Apple Metal Support

First of all, I want to say that I think Unsloth is an amazing library—huge thanks for the work that has gone into it!

It would be incredibly beneficial if Unsloth supported MLX and Apple Metal. Many researchers, students, and developers rely on Apple Silicon Macs for their work, but without optimized support, they can’t fully utilize their hardware for machine learning tasks.

By adding MLX and Metal support, Unsloth could enable faster and more efficient training and inference directly on Mac devices. This would reduce the need for external GPUs or cloud-based solutions, making AI research and development more accessible—especially for students and independent researchers who may not have access to expensive hardware.

With the growing adoption of Apple Silicon in both academia and industry, this support would make Unsloth more versatile and future-proof.

Looking forward to hearing thoughts on this!

[shimmyshimmer]

Hi yes absolutely, we had someone make a PR but it still needs to be reviewed. :)

[Reinhard-Berger]

Thanks for the info! Seems I overlooked the PR. I’m happy to see progress on this.