Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Setting Universal Format (UniForm) table properties not possible #3299

Open
HectorPascual opened this issue Mar 4, 2025 · 1 comment
Open
Labels
enhancement New feature or request

Comments

@HectorPascual
Copy link

HectorPascual commented Mar 4, 2025

Description

I'd like to know whether it's possible to set the table properties required to have UniForm in delta tables created through delta-rs.

https://docs.delta.io/latest/delta-uniform.html

I've given it a few attempts with the python interface for delta-rs and also through Polars, but I've been unable to create a table with the properties :

"delta.enableIcebergCompatV2": "true",
"delta.universalFormat.enabledFormats": "iceberg"

Attempting to create a table with above properties results in the following error below :

DeltaError: Kernel: Generic delta kernel error: Error parsing property 'delta.enableIcebergCompatV2':'true'

Code for reproducing :

from deltalake import DeltaTable, Field, Schema


_default_table_properties: dict[str, str] = {
        "delta.enableIcebergCompatV2": "true",
        "delta.universalFormat.enabledFormats": "iceberg"
}

DeltaTable.create(
    table_uri='.',
    schema=Schema([Field("x", "integer")]),
    mode="overwrite",
    name='test',
    configuration=_default_table_properties,
)

I also tested creating the table and setting the propeties later but same error was thrown :

dt.alter.set_table_properties(_default_table_properties)

Environment

Python 3.12
DeltaLake 0.24.0

@HectorPascual HectorPascual added the enhancement New feature or request label Mar 4, 2025
@HectorPascual HectorPascual changed the title Setting Universal Format (UniForm) table properties Setting Universal Format (UniForm) table properties not possible Mar 4, 2025
@ion-elgreco
Copy link
Collaborator

Once we switch to kernel-rs we can support parsing these (not sure though whether kernel-rs supports it further than that)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants