Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for opaque expressions #764

Open
scovich opened this issue Mar 24, 2025 · 0 comments
Open

Add support for opaque expressions #764

scovich opened this issue Mar 24, 2025 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@scovich
Copy link
Collaborator

scovich commented Mar 24, 2025

Please describe why this is necessary.

Kernel does not currently provide any way for engines to use expressions kernel does not fully understand. This creates unwelcome pressure to implement -- directly in kernel -- operations that kernel does not use but which various engines need. A canonical example is [NOT] IN, which is highly complex to implement fully and correctly (see e.g. #652). Kernel does not actually use it, but it was added because engines wanted to use it for their own query processing.

Describe the functionality you are proposing.

Define an opaque expression trait which engines can use to round-trip any expression they want through the kernel. Initially, kernel could support partition pruning over such expressions if the engine provides an appropriate scalar evaluation implementation. Eventually, it might be possible to also express basic data skipping support as well.

Additional context

No response

@scovich scovich added the enhancement New feature or request label Mar 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant