You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I would like to have the posibility to perform batch inserts.
Right now every record gets inserted/upserted into the database one by one, this can be a performance bottleneck if too many records are produced.
Its basically the same as a SQL query inside a loop.
A batch inserter mechanism could collect up to N records and also wait up to X seconds before sending the query to the database anyway. Whichever case happens first, so there is not a batch "forever" in the waiting to be sent to the DB, it gets flushed at least at some point.
I'll provide a example implementation.
The text was updated successfully, but these errors were encountered:
I would like to have the posibility to perform batch inserts.
Right now every record gets inserted/upserted into the database one by one, this can be a performance bottleneck if too many records are produced.
Its basically the same as a SQL query inside a loop.
A batch inserter mechanism could collect up to N records and also wait up to X seconds before sending the query to the database anyway. Whichever case happens first, so there is not a batch "forever" in the waiting to be sent to the DB, it gets flushed at least at some point.
I'll provide a example implementation.
The text was updated successfully, but these errors were encountered: