You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If I use for example turboderp/Mixtral-8x7B-instruct-exl2:3.5bpw as MODEL env variable in the template, the script complains about not being able to download it due to invalid characters.
It looks like the scripts/fetch-model.py script doesn't try to parse a branch name and send the appropriate info to scripts/download_model.py, which would support branches with the --branch option
Would be great, if that could be added, so we can automatically download such models, too. My python skills are unfortunately almost non-existent to send a proper PR.
And thanks a lot for for everything.
The text was updated successfully, but these errors were encountered:
If I use for example
turboderp/Mixtral-8x7B-instruct-exl2:3.5bpw
as MODEL env variable in the template, the script complains about not being able to download it due to invalid characters.It looks like the
scripts/fetch-model.py
script doesn't try to parse a branch name and send the appropriate info toscripts/download_model.py
, which would support branches with the--branch
optionWould be great, if that could be added, so we can automatically download such models, too. My python skills are unfortunately almost non-existent to send a proper PR.
And thanks a lot for for everything.
The text was updated successfully, but these errors were encountered: