Skip to content
PR title

feat: For issue #706 Ray serve with Llama.cpp for CPU inference on Graviton #1175

Sign in to view logs

feat: For issue #706 Ray serve with Llama.cpp for CPU inference on Graviton

feat: For issue #706 Ray serve with Llama.cpp for CPU inference on Graviton #1175

Validate PR title

Validate PR title
succeeded Feb 6, 2025 in 8s