New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

C++支持Deepseek R1蒸馏模型的模板解析和Tokenize #502

Open

TylunasLi wants to merge 1 commit into ztxz16:master from TylunasLi:doc

Contributor

TylunasLi commented Feb 12, 2025

修复NVIDIA旧架构GPU编译报错
Jinja2模板支持多个值的namespace，因此支持Deepseek R1 Distrill的模板；
修复C++ Tokenzier在ByteLevel模式下，special token没有转换的问题。

测试情况

在以下模型测试过

deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B


          C++支持Deepseek R1蒸馏模型的模板解析和Tokenize

2af239a

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet