Intel(R) Extension for Scikit-learn* 2024.0.0

Intel(R) Extension for Scikit-learn* is happy to introduce 2024.0 release!

What's New

• New functionality:
  • DBSCAN and SPMD DBSCAN algorithms

Acknowledgements

Thanks to everyone who helped us make 2024.0 release possible!

@Alexsandruss, @icfaust, @napetrov, @ahuber21, @ethanglaser, @samir-nasibli, @aepanchi, @olegkkruglov, @razdoburdin, @KulikovNikita, @maria-Petrova, @avolkov-intel

Intel® Extension for Scikit-learn 2023.2.1

The release of Intel® Extension for Scikit-learn 2023.2.1 introduces the following changes:

🚨 What's New

• sklearn 1.3 support fixes (1, 2, 3)
• Model builders API update

Intel® Extension for Scikit-learn 2023.2.0

The release of Intel® Extension for Scikit-learn 2023.2.0 introduces the following changes:

❌ Deprecation Notice

• The compression functionality in the Intel® oneDAL library is deprecated. Starting with the 2024.0 release, oneDAL will not support the compression functionality
• The DAAL CPP SYCL Interfaces in the Intel® oneDAL library are deprecated. Starting with the 2024.0 release, oneDAL will not support the DAAL CPP SYCL Interfaces
• The Java* interfaces in the Intel® oneDAL library are marked as deprecated. The future releases of the oneDAL library may no longer include support for these Java* interfaces
• ABI compatibility is to be broken as part of the 2024.0 release of Intel® oneDAL. The library’s major version is to be incremented to two to enforce the relinking of existing applications
• macOS* support is deprecated for oneDAL. The 2023.x releases are the last to provide it

🛠️ Library Engineering

• CSR tables interface has been changed and moved from detail namespace

🚨 What's New

• Introduced new Intel® oneDAL functionality:
  • Distributed KMeans++ algorithm
  • Logistic Loss objective algorithm
• Introduced new functionality for Intel® Extension for Scikit-learn:
  • NaN(missing values) support was added to Model Builders
• Improved performance for the following Intel® Extension for Scikit-learn algorithms:
  • Model Builders performance has been improved up to 2x

Intel® Extension for Scikit-learn 2023.1.1

The release of Intel® Extension for Scikit-learn 2023.1.1 introduces the following changes:

🚨 What's New

• Splitting mode for Random Forest algorithm 4abff0d
• SPMD interface for Random Forest, kNN and PCA e887d99, 97f0d47, 2405630
• Native support for DPCTL ca28499
• Patching for sklearn's LocalOutlierFactor 7ae0171

Intel® Extension for Scikit-learn 2023.1.0

The release of Intel® Extension for Scikit-learn 2023.1 introduces the following changes:

📚Support Materials

• Accelerating Barnes-Hut t-SNE Algorithm by Efficient Parallelization on Multi-Core CPUs

🛠️ Library Engineering

• Reduced the size of Intel® oneDAL library by approximately ~30%

🚨 What's New

• Introduced new functionality for Intel® Extension for Scikit-learn:
  • Enabled PCA, Linear Regression, Random Forest algorithms and SPMD policy as preview
  • Scikit-learn 1.2 support
  • sklearn_is_patched() function added to validate status of algorithms patching
• Improved performance for the following Intel® Extension for Scikit-learn algorithms:
  • t-SNE for “Burnes-Hut” algorithm
  • SVM algorithm for single row inference

❗ Known Issues

• In certain conditions DAAL SYCL interface might hang with L0 backend – please use oneDAL DPC interfaces instead. If older interfaces are required OpenCL backend can be used as workaround.

Intel® Extension for Scikit-learn 2023.0.1

The release of Intel® Extension for Scikit-learn 2023.0.1 introduces the following changes:

🚨 What's New

• Performance improvements for tSNE algorithm 5275eba
• Fixes for balanced classes and number of iterations in SVM 14849ee, 4872a8e, 9d0a05b
• Fix for gamma parameter in KMeans 1dca20c

Intel® Extension for Scikit-learn 2023.0.0

The release of Intel® Extension for Scikit-learn 2023.0 introduces the following changes:

🚨 What's New

• Introduced new Intel® oneDAL functionality:
  • DPC++ interface for Linear Regression algorithm

❗ Known Issues

• Intel® Extension for Scikit-learn SVC.fit and KNN.fit do not support GPU
• Most Intel® Extension for Scikit-learn sycl examples fail when using GPU context
• Running the Random Forest algorithm with versions 2021.7.1 and 2023.0 of scikit-learn-intelex on the 2nd Generation Intel® Xeon® Scalable Processors, formerly Cascade Lake may result in an 'Illegal instruction' error.
  • No workaround is currently available for this issue.
  • Recommendation: Use an older version of scikit-learn-intelex until the issue is fixed in a future release.

Intel(R) Extension for Scikit-learn 2021.7.1

The release Intel® Extension for Scikit-learn 2021.7.1 introduces the following changes:

📚 Support Materials

• [Tabular Playground Series - Sep 2022] Tuning of ElasticNet hyperparameters
• Accelerated Random Forest for Rent Prediction

🚨 What's New

• oneAPI interface for kNN regression
• Fix for wrong column names of pandas DataFrame in sklearn.model_selection.train_test_split patched function

Intel(R) Extension for Scikit-learn 2021.6

The release Intel® Extension for Scikit-learn 2021.6 introduces the following changes:

📚 Support Materials

Kaggle kernels:

• Fast Feature Importance using scikit-learn-intelex
• [Tabular Playground Series - December 2021] Fast Feature Importance with sklearnex
• [Tabular Playground Series - December 2021] SVC with sklearnex 20x speedup
• [Tabular Playground Series - January 2022] Fast PyCaret with Scikit-learn-Intelex
• [Tabular Playground Series - February 2022] KNN with sklearnex 13x speedup
• Fast SVM for Sparse Data from NLP Problem
• Introduction to scikit-learn-intelex
• [Datasets] Fast Feature Importance using sklearnex
• [Tabular Playground Series - March 2022] Fast workflow using scikit-learn-intelex

🛠️ Library Engineering

• Reduced the size of oneDAL python run-time package by approximately 8%
• Added Python 3.10 support for daal4py and Intel(R) Extension for Scikit-learn packages

🚨 What's new

• Improved performance for the following Intel® Extension for Scikit-learn algorithms:

  • t-SNE for “Burnes-Hut” algorithm

• Introduced new functionality for Intel® Extension for Scikit-learn:

  • Manhattan, Minkowski, Chebyshev and Cosine distances for KNeighborsClassifier and NearestNeighbors with “brute” algorithm

• Fixed the following issues in Intel® Extension for Scikit-learn:

  • An issue with the search of common data type in pandas DataFrame
  • Patching overhead of finiteness checker for specific small data sizes
  • Incorrect values in a tree visualization with plot_tree function in RandomForestClassifier
  • Unexpected error for device strings in {device}:{device_index} format while using config context

Intel(R) Extension for Scikit-learn 2021.5

The release Intel® Extension for Scikit-learn 2021.5 introduces the following changes:

📚 Support Materials

• Kaggle kernels:
  • [Tabular Playground Series - Sep 2021] Ridge with sklearn-intelex 2x speedup
  • [Tabular Playground Series - Oct 2021] Fast AutoML with Intel Extension for Scikit-learn
  • [Titanic – Machine Learning from Disaster] AutoML with Intel Extension for Sklearn
  • [Tabular Playground Series - Nov 2021] AutoML with Intel® Extension
  • [Tabular Playground Series - Nov 2021] Log Regression with sklearnex 17x speedup
  • [Tabular Playground Series - Dec 2021] SVC with sklearnex 20x speedup
  • [Tabular Playground Series - Dec 2021] Fast Feature Importance with sklearnex
• Added demo samples of the Intel® Extension for Scikit-learn usage with the performance comparison to original Scikit-learn for ElasticNet, K-means, Lasso Regression, Linear regression, and Ridge Regression
• Added demo samples of the Modin usage

🛠️ Library Engineering

• Reduced the size of oneDAL library by approximately ~15%, this is a required dependency of Intel® extension for scikit learn.

🚨 New Features

• Scikit-learn 1.0 support

🚀 ​Improved performance

• [GPU] KNN algorithm prediction
• [GPU] SVC and SVR algorithms training

🐛 Bug Fixes

• Stabilized the results of Linear Regression in oneDAL and Intel® Extension for Scikit-learn
• Fixed an issue with RPATH on MacOS