Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Late Chunking support for Jina Embeddings #4002

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

gururise
Copy link
Contributor

@gururise gururise commented Feb 7, 2025

  • Add support for Jina Late Chunking
  • Switch default Jina embedding from jina-embeddings-v2-base-en to jina-embeddings-v3, which is the newer recommended embedding. Also supports multilingual text.

jina-embeddings-v3 support Late Chunking:
Apply the late chunking technique to leverage the model's long-context capabilities for generating contextual chunk embeddings.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant