[DISCUSSION] Add DedicatedExecutor
into the DataFusion crates to make using multiple threadpools easier
#14285
Labels
enhancement
New feature or request
Is your feature request related to a problem or challenge?
Describe the solution you'd like
As explained on the following PR:
I implemented a version of
DedicatedExecutor
and an example showing how to use multiple thread pools with DataFusion. However, the example is currently very large as it uses an abstraction calledDedicatedExecutor
to manage sending work back and forth between the runtimesIf users want to do the same thing, they will need to copy
DedicatedExecutor
into their code (or make something similar).Describe alternatives you've considered
If
DedicatedExecutor
is a useful API for multiple people I think we should consider moving it into one of the core cratesAdditional context
No response
The text was updated successfully, but these errors were encountered: