Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to convert Falcon models #1223

Open
hsoftxl opened this issue Jan 24, 2025 · 2 comments
Open

How to convert Falcon models #1223

hsoftxl opened this issue Jan 24, 2025 · 2 comments

Comments

@hsoftxl
Copy link

hsoftxl commented Jan 24, 2025

No description provided.

@hsoftxl
Copy link
Author

hsoftxl commented Jan 24, 2025

i want to write a model in mlx-lm/models/falcon, but i don't know how to do. is there any guide for that ?

@hsoftxl
Copy link
Author

hsoftxl commented Jan 24, 2025

mlx_lm.convert --hf-path tiiuae/falcon-180B-chat -q

[INFO] Loading
Fetching 89 files: 100%|███████████████████████████████████████████████████████████████████████| 89/89 [00:00<00:00, 8013.68it/s]
Traceback (most recent call last):
File "/Users/rays/PycharmProjects/exo/.venv/bin/mlx_lm.convert", line 8, in
sys.exit(main())
^^^^^^
File "/Users/rays/PycharmProjects/exo/.venv/lib/python3.12/site-packages/mlx_lm/convert.py", line 58, in main
convert(**vars(args))
File "/Users/rays/PycharmProjects/exo/.venv/lib/python3.12/site-packages/mlx_lm/utils.py", line 995, in convert
model, config, tokenizer = fetch_from_hub(model_path, lazy=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/rays/PycharmProjects/exo/.venv/lib/python3.12/site-packages/mlx_lm/utils.py", line 749, in fetch_from_hub
model, config = load_model(model_path, lazy)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/rays/PycharmProjects/exo/.venv/lib/python3.12/site-packages/mlx_lm/utils.py", line 672, in load_model
model_args = model_args_class.from_dict(config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/rays/PycharmProjects/exo/.venv/lib/python3.12/site-packages/mlx_lm/models/base.py", line 17, in from_dict
return cls(
^^^^
TypeError: ModelArgs.init() missing 2 required positional arguments: 'intermediate_size' and 'rms_norm_eps'

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant