Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error on llama-cpp-python wheel build #94

Open
sinopeus opened this issue Feb 7, 2025 · 0 comments
Open

Error on llama-cpp-python wheel build #94

sinopeus opened this issue Feb 7, 2025 · 0 comments
Labels
bug Something isn't working

Comments

@sinopeus
Copy link

sinopeus commented Feb 7, 2025

I get the following when running poetry add raglite

raglite_benchmark on  main [!?] is 📦 v0.0.0 via 🐍 v3.10.16 (raglite-benchmark-env) 
⬢ [Docker] ❯ poetry add raglite   
Using version ^0.6.2 for raglite
Updating dependencies
Resolving dependencies... (6.7s)
Package operations: 2 installs, 9 updates, 0 removals
  - Updating fsspec (2024.12.0 -> 2025.2.0)
  - Updating huggingface-hub (0.27.1 -> 0.28.1)
  - Updating mdformat (0.7.21 -> 0.7.22)
  - Updating aiohttp (3.11.11 -> 3.11.12)
  - Updating mcp (1.2.0 -> 1.2.1)
  - Updating openai (1.60.1 -> 1.61.1)
  - Updating pytz (2024.2 -> 2025.1)
  - Updating sqlalchemy (2.0.37 -> 2.0.38)
  - Installing llama-cpp-python (0.3.7): Failed
PEP517 build of a dependency failed
Backend subprocess exited when trying to invoke build_wheel
    | Command '['/tmp/tmphngka48n/.venv/bin/python', '/opt/poetry-env/lib/python3.10/site-packages/pyproject_hooks/_in_process/_in_process.py', 'build_wheel', '/tmp/tmph1gnx_xq']' returned non-zero exit status 1.
    | 
    | *** scikit-build-core 0.10.7 using CMake 3.25.1 (wheel)
    | *** Configuring CMake...
    | loading initial cache file /tmp/tmpykr8ztv_/build/CMakeInit.txt
    | -- The C compiler identification is GNU 12.2.0
    | -- The CXX compiler identification is GNU 12.2.0
    | -- Detecting C compiler ABI info
    | -- Detecting C compiler ABI info - done
    | -- Check for working C compiler: /usr/bin/gcc - skipped
    | -- Detecting C compile features
    | -- Detecting C compile features - done
    | -- Detecting CXX compiler ABI info
    | -- Detecting CXX compiler ABI info - done
    | -- Check for working CXX compiler: /usr/bin/g++ - skipped
    | -- Detecting CXX compile features
    | -- Detecting CXX compile features - done
    | -- Found Git: /usr/bin/git (found version "2.39.5") 
    | -- Performing Test CMAKE_HAVE_LIBC_PTHREAD
    | -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
    | -- Found Threads: TRUE  
    | -- Warning: ccache not found - consider installing it for faster compilation or disable this warning with GGML_CCACHE=OFF
    | -- CMAKE_SYSTEM_PROCESSOR: aarch64
    | -- Including CPU backend
    | -- Found OpenMP_C: -fopenmp (found version "4.5") 
    | -- Found OpenMP_CXX: -fopenmp (found version "4.5") 
    | -- Found OpenMP: TRUE (found version "4.5")  
    | -- ARM detected
    | -- Performing Test GGML_COMPILER_SUPPORTS_FP16_FORMAT_I3E
    | -- Performing Test GGML_COMPILER_SUPPORTS_FP16_FORMAT_I3E - Failed
    | -- ARM -mcpu not found, -mcpu=native will be used
    | -- .... /ggml/src/CMakeFiles/ggml-base.dir/ggml-quants.c.o -c /tmp/tmpnwvx4foz/llama_cpp_python-0.3.7/vendor/llama.cpp/ggml/src/ggml-quants.c
    | ninja: build stopped: subcommand failed.
    | 
    | *** CMake build failed
Note: This error originates from the build backend, and is likely not a problem with poetry but one of the following issues with llama-cpp-python (0.3.7)
  - not supporting PEP 517 builds
  - not specifying PEP 517 build requirements correctly
  - the build requirements are incompatible with your operating system or Python version
  - the build requirements are missing system dependencies (eg: compilers, libraries, headers).
You can verify this by running pip wheel --no-cache-dir --use-pep517 "llama-cpp-python (==0.3.7)".
  - Updating pdftext (0.5.0 -> 0.5.1)
raglite_benchmark on  main [!?] is :package: v0.0.0 via :snake: v3.10.16 (raglite-benchmark-env) took 20s 
⬢ [Docker] ❯
@sinopeus sinopeus added the bug Something isn't working label Feb 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant