[RFC] 090 - Uniform Model Runtime #6563
arvinxx
started this conversation in
RFC | 特性开发
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
背景
随着 OpenAI、 Claude、 Google 御三家的模型演进分化,以及 DeepSeek、OpenRouter 等后起之秀开始有了自己专有的请求出入参设计。 一个 OpenAI Compatible 运行时已经无法满足这个分化趋势下的应用层需求了。因此在这个 RFC 中提出一个 Uniform Model Runtime 的构想,来尝试为下一阶段的模型运行时给出更加灵活的实现。
Beta Was this translation helpful? Give feedback.
All reactions