New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

mlx to GGUF #1261

Open

kalle07 opened this issue Feb 8, 2025 · 0 comments

kalle07 commented Feb 8, 2025

okay thats your model

https://huggingface.co/mlx-community/deepseek-vl2-tiny-8bit/tree/main

converted from
https://huggingface.co/deepseek-ai/deepseek-vl2-tiny

okay but it can not coverted via llama.ccp into GGUF

can you doo that?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment