[ipex-llm][cpp][ollama]nonsense output when running infer simultaneously (OLLAMA_NUM_PARALLEL!=1)

[jianjungu]

If set the ollama environment para OLLAMA_NUM_PARALLEL=2 or other values not equal to 1, the output is broken. This issue can be reproduced on my laptops LNL 258V and ARL-H 255H.

the reproduce python code is attached
issue_multi_request.zip

The ollama version is 20250122
I start ollama service with default value (OLLAMA_NUM_PARALLEL:0 or set OLLAMA_NUM_PARALLEL=2)

• If open one python window and run the reproduce code

python issue_multi_request.py

the output is OK

• if open two python window and run the code in each window simultaneously,

the output is wrong

• if the infer is running on CPU , the output is ok

• if set OLLAMA_NUM_PARALLEL=1, the output is OK