Deepseek support?

[Bezhok]

Deepseek documentation says:
The DeepSeek API uses an API format compatible with OpenAI. By modifying the configuration, you can use the OpenAI SDK or softwares compatible with the OpenAI API to access the DeepSeek API.

Can u add support? It seems it only requires to change a link.
If no, can u advise me where to modify?

[StephenHodgson]

This library was intended to only support the official API sorry.

That being said you can replace your API with the deepseek api key and use their domain as your domin when setting up the OpenAIClient.

just like in their examples:

var auth = new OpenAIAuthentication("<DeepSeek API Key>");
var settings = new OpenAISettings(domain: "https://api.deepseek.com");
var api = new OpenAIClient(auth, settings);

[StephenHodgson]

Just an update here. I was able to get it working with local deepseek model running in docker.

8b param model

docker run -d --runtime nvidia --gpus all -v //d/LLM/cache:/root/.cache/huggingface --env "HUGGING_FACE_HUB_TOKEN=hf_API_KEY" -p 8000:8000 --ipc=host vllm/vllm-openai:latest --model deepseek-ai/DeepSeek-R1-Distill-Llama-8B --max-model-len 16384 --enforce-eager

var auth = new OpenAIAuthentication("sk-no-api-key"); // gotta pass something. It is fake.
var settings = new OpenAISettings(domain: "http://localhost:8000");
var api = new OpenAIClient(auth, settings);