Skip to content

v0.2.2 - Embedder

Compare
Choose a tag to compare
@AsakusaRinne AsakusaRinne released this 17 May 04:59
· 1819 commits to master since this release
ea5f9d3
  1. Sync with the latest llama.cpp master branch.
  2. Add LLamaEmbedder to support to get the embeddings only.
  3. Add n_gpu_layers and prompt_cache_all param.
  4. Split the package into main package + backend package.