v0.2.2 - Embedder
- Sync with the latest llama.cpp master branch.
- Add
LLamaEmbedder
to support to get the embeddings only. - Add
n_gpu_layers
andprompt_cache_all
param. - Split the package into main package + backend package.
LLamaEmbedder
to support to get the embeddings only.n_gpu_layers
and prompt_cache_all
param.