Feature/support for loading datasets from dlt within databricks#1148

Merged

chakravarthik27 merged 7 commits intorelease/2.5.0from feature/support-for-loading-datasets-from-dlt-within-databricks

Dec 2, 2024

+201-3

Commits on Nov 28, 2024

adding support for spark dataset in databricks
chakravarthik27
committed
feat: enhance SparkDataset to accept a SparkSession and support dynamic file formats
chakravarthik27
committed

Commits on Nov 29, 2024

feat: update SparkDataset to dynamically initialize SparkSession and enhance file path handling
chakravarthik27
committed
feat: enhance SparkDataset to support dynamic file paths and improve initialization with SparkSession
chakravarthik27
committed

Commits on Nov 30, 2024

feat: extend SparkDataset to load data from any file and introduce DltDataset for Delta Live Tables support
chakravarthik27
committed

Commits on Dec 2, 2024