Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Huggingfacve Model with a branch in it's name (seperated by :) can't be used as MODEL Environment variable #16

Open
chregu opened this issue Jan 4, 2024 · 0 comments

Comments

@chregu
Copy link

chregu commented Jan 4, 2024

If I use for example turboderp/Mixtral-8x7B-instruct-exl2:3.5bpw as MODEL env variable in the template, the script complains about not being able to download it due to invalid characters.

It looks like the scripts/fetch-model.py script doesn't try to parse a branch name and send the appropriate info to scripts/download_model.py, which would support branches with the --branch option

Would be great, if that could be added, so we can automatically download such models, too. My python skills are unfortunately almost non-existent to send a proper PR.

And thanks a lot for for everything.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant