Skip to content

Load Test: concurrent usage #10

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
giusedroid opened this issue Jun 15, 2024 · 0 comments
Open

Load Test: concurrent usage #10

giusedroid opened this issue Jun 15, 2024 · 0 comments
Labels
helpmebuild load-test anything that has to do with scalability low-prio

Comments

@giusedroid
Copy link
Contributor

right now we have limited the execution of the ingestion function to 1. LanceDB has a native lock system based on DynamoDB locks currently in beta. We should experiment with this and remove the artificial limitation of 1 max concurrent execution for the writer.

Once this is implemented, we should run load tests to understand impact on retrieval performance against the same (user+knowledge-base).

@giusedroid giusedroid added the load-test anything that has to do with scalability label Jun 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
helpmebuild load-test anything that has to do with scalability low-prio
Projects
None yet
Development

No branches or pull requests

1 participant