Feature Request: Implementing a No-Install Runtime Package for Ollama on Intel NPU using IPEX-LLM

[ChenZeiShuai]

Hello,
I would like to propose a feature request to develop a no-install runtime package for running Ollama on Intel NPU using Intel PyTorch Extension for Large Language Models (IPEX-LLM). This feature will significantly simplify the deployment process and enhance user experience by eliminating the need for manual setup and configuration.
Details:
Objective:
Develop a self-contained, no-install runtime package that allows users to run Ollama models seamlessly on Intel NPU hardware using IPEX-LLM.
Scope:
The package should include all necessary dependencies and configurations pre-installed.
Ensure compatibility with the latest versions of Ollama, IPEX-LLM, and Intel NPU drivers.
Provide a simple command-line interface or script to launch the environment without requiring additional installations or configurations.
Benefits:
Simplify the deployment process for end-users.
Reduce the time and effort required to set up the environment.
Enhance the accessibility of Ollama models on Intel NPU hardware.
Requirements:
Support for Intel NPU hardware acceleration.
Integration with IPEX-LLM for optimized performance.
Pre-configured environment with all necessary libraries and dependencies.
Documentation for easy setup and usage instructions.
Additional Information:
Target platforms: intel ultra 7 258v
Best regards