Longhorn v1.6.0-rc1

DON'T UPGRADE to/from any RC/Preview/Sprint releases because the operation is not supported!

Changes in this release

Highlight

• [FEATURE] Support eventual danger zone setting update 7173 - @mantissahz
• [FEATURE] Engine upgrade enforcement 5842 - @yangchiu @c3y1huang
• [FEATURE] Support instance-manager pod for v2 volumes on selected nodes 7015 - @derekbit @chriscchien @roger-ryao
• [FEATURE] Longhorn snapshot space management 6563 - @FrankYang0529 @yangchiu
• [FEATURE] v2 volume supports volume backup/restore 6138 - @yangchiu @derekbit
• [IMPROVEMENT] Remove or Change Helm pre-upgrade hook to support ArgoCD 6415 - @mantissahz
• [FEATURE] Restore BackingImage for BackupVolume in a new cluster 4165 - @ChanYiLin @roger-ryao
• [FEATURE] Talos support 3161 - @yangchiu @c3y1huang
• [FEATURE] Support v2 volume on ARM64 platform 6021 - @derekbit @chriscchien @roger-ryao
• [FEATURE] Have default priorityClass to prevent unexpected longhorn pods eviction 6528 - @mantissahz
• [IMPROVEMENT] Add a new settings that allows Longhorn to evict replicas automatically when a node is drained 2238 - @ejweber @chriscchien
• [FEATURE] Add linear dm device on the top of v2 volume 7357 - @derekbit @chriscchien
• [TASK] Bump up the minimum supported Kubernetes version 7224 - @c3y1huang @roger-ryao
• [FEATURE] Support Encryption for VolumeMode Block 4883 - @derekbit @roger-ryao
• [TASK] Bump the versions of dependent libs or components 7001 - @c3y1huang @chriscchien
• [TASK] Add install/upgrade longhorn by gitops (flux) pipeline 6343 - @yangchiu
• [FEATURE] OKD/Openshift support 1831 - @mantissahz @ArthurVardevanyan @roger-ryao

Feature

• [FEATURE] v2 data engine volume snapshot and revert 6137 - @shuo-wu @roger-ryao
• [FEATURE] Allow to set mount options for storageclass via values.yaml in helm chart 7351 - @ChanYiLin @chriscchien
• [UI][FEATURE] Longhorn snapshot space management 7522 - @scures
• [FEATURE] Flush on-the-fly IOs in the queue before snapshotting 5648 - @DamiaSan
• [FEATURE] Update base image of Longhorn components to BCI 15.5 6206 - @nitendra-suse
• [FEATURE] Customize MaxRecurringJobRetain 5713 - @mantissahz @chriscchien
• [FEATURE] Replica rebuild over SPDK 5216 - @shuo-wu @DamiaSan
• [FEATURE] Allow kubectl drain to stop manually attached volumes 6978 - @ChanYiLin @chriscchien
• [FEATURE] Single Node Disk affinity 3823 - @ejweber @roger-ryao
• [FEATURE] Storage network support for Multus v4.0 thick-plugin 5048 - @c3y1huang @chriscchien
• [FEATURE] Add disk status prometheus metrics 6858 - @c3y1huang @chriscchien
• [FEATURE] Add a brand new/empty bdev with WriteOnly mode to the RAID1 bdev 5865 - @DamiaSan
• [FEATURE] Manage replicas of RAID1 bdev 5420 - @DamiaSan
• [BUG] when volume degraded and rebuild, the filesystem in every mounted pod were read-only 1500 - @PhanLe1010
• [FEATURE] Add a script to identify the valid volumes to recover given s3 backup url and secret 1523 - @weizhe0422
• [FEATURE] Manage snapshot number or quota for storage capacity planning 6077 -
• [FEATURE] Pause IO when raid1 bdev snapshotting 5421 - @DamiaSan
• [FEATURE] Change the replica selector behavior so that an absent selector is able to select nodes without a TAG 4826 - @ChanYiLin @roger-ryao
• [FEATURE] Introduce write only mode in RAID1 5783 - @DamiaSan
• [FEATURE] Helm Chart make loglevel configurable 3655 - @mantissahz

Improvement

• [IMPROVEMENT] Have a clear message when reverting the parent of a volume-head snapshot for a v2 volume 7630 - @derekbit @shuo-wu
• [IMPROVEMENT] Enhance the code quality in the instance-manager instance and disk gRPC server methods. 7628 - @derekbit
• [TASK] Introduce upgradeVersionCheck to decide version upgrade enforcement 7539 - @mantissahz @chriscchien
• [IMPROVEMENT] Increase the hugepage size for spdk_tgt to 2GiB 7606 - @derekbit @chriscchien
• [IMPROVEMENT] Reject DR volume creation for v2 volume 7627 - @derekbit @roger-ryao
• [IMPROVEMENT] Do not use --force for dmsetup remove command 7615 -
• [IMPROVEMENT] Update nvme-cli to v2.7.1 in instance-manager pod 7609 - @derekbit
• [IMPROVEMENT] v2 volume snapshot supports UserCreated flag 7578 - @DamiaSan
• [IMPROVEMENT] Prevent from complains in spdk_tgt when deleting a v2 volume 7568 - @yangchiu @derekbit @roger-ryao
• [IMPROVEMENT] Expose actual size of a logical volume 5947 - @derekbit @shuo-wu @chriscchien @DamiaSan
• [IMPROVEMENT] UI backup restoration supports v1 and v2 Data Engine 6597 - @derekbit @scures @roger-ryao
• [IMPROVEMENT][UI] Display v2 volume actual size 7524 - @derekbit @chriscchien
• [IMPROVEMENT] Recreate instance manager pod for v2 volume when spdk_tgt is dead 7551 - @derekbit @chriscchien
• [IMPROVEMENT] Add reserve storage percentage of nodes setting in helm chart 5958 - @mantissahz @roger-ryao
• [IMPROVEMENT] Reconcile engine/replica instance state of v2 volume like v1 volume 7326 - @derekbit @chriscchien
• [IMPROVEMENT] Improve handling of 16TiB+ volumes with ext4 as the underlying file system 7423 - @mantissahz @chriscchien
• [IMPROVEMENT] Rename backendStoreDriver to dataEngin in instance-manager and associated components 7480 - @yangchiu @derekbit
• [IMPROVEMENT][UI] Validate volume creation according to the enabled data engines 7505 - @derekbit @chriscchien
• [IMPROVEMENT] Add guaranteed instanceManager CPU setting for v2 volume 7361 - @derekbit @roger-ryao
• [IMPROVEMENT] Automatically remount read-only RWO volume to read-write 6386 - @ChanYiLin @chriscchien
• [IMPROVEMENT] Support backup list if there is only v2-data-engine enabled 7486 - @derekbit @chriscchien
• [IMPROVEMENT] Upgrade CSI components to the latest patch release 7384 - @c3y1huang @roger-ryao
• [IMPROVEMENT] Add global setting for enable v1 or v2 volume support 7095 - @yangchiu @derekbit
• [IMPROVEMENT] Blindly stop raid bdev exposure before exposing it for V2 volume 7324 - @yangchiu @derekbit @roger-ryao
• [IMPROVEMENT] instance-managers for v1 and v2 volumes respectively 6984 - @yangchiu @derekbit
• [IMPROVEMENT] Reject volume.spec.image update for v2 volumes before introducing live upgrade 7446 - @derekbit @chriscchien
• [IMPROVEMENT] BackingImage should be compressed when downloading and use the name as filename instead of UUID 7295 - @ChanYiLin @chriscchien
• [IMPROVEMENT] Reject the creation of encrypted v2 volume in validating webhook 7404 - @derekbit @chriscchien
• [IMPROVEMENT] Longhorn-engine processes should refuse to serve requests not intended for them [5845](#5845...

Longhorn v1.6.0-dev-20240105

This is a sprint release for internal testing and development purposes only. DO NOT INSTALL or UPGRADE to any sprint releases, as this operation is not supported.

Issues in the sprint

Misc

• [BUG] Randomly failed to create volume with backing image 7543 - @yangchiu @ChanYiLin
• [UI][FEATURE] Longhorn snapshot space management 7522 - @scures
• [FEATURE] Restore BackingImage for BackupVolume in a new cluster 4165 - @ChanYiLin @roger-ryao
• [IMPROVEMENT] Recreate instance manager pod for v2 volume when spdk_tgt is dead 7551 - @derekbit @chriscchien
• [FEATURE] Longhorn snapshot space management 6563 - @FrankYang0529 @yangchiu
• [BUG] After upgrade to master-head, existing volume won't rebuild replica if one deleted, and the volume keeps healthy instead of degraded 7555 - @FrankYang0529 @derekbit
• [BUG] volume engine failed to live upgrade 7548 - @derekbit @chriscchien
• [BUG] Failed to check_volume_data after volume engine upgrade/migration 7396 - @PhanLe1010 @james-munson @roger-ryao
• [BUG] test case test_engine_image_not_fully_deployed_perform_auto_upgrade_engine failed 7540 - @c3y1huang
• [IMPROVEMENT] Expose actual size of a logical volume 5947 - @derekbit @shuo-wu @DamiaSan
• [BUG] Warning events are being spammed by Longhorn - CRD 7290 - @m-ildefons @roger-ryao
• [TASK] Introduce upgradeVersionCheck to decide version upgrade enforcement 7539 - @mantissahz
• [BUG] Delete kubernetes node did not remove node.longhorn.io 7475 - @ejweber @chriscchien
• [IMPROVEMENT] Add reserve storage percentage of nodes setting in helm chart 5958 - @mantissahz @roger-ryao
• [BUG] Failed RWX mount due to connection timeout still happening 7301 - @james-munson
• [BUG] test case test_metric_longhorn_snapshot_actual_size_bytes failed 7532 - @yangchiu @c3y1huang
• [BUG] Test case test_volume_reattach_after_engine_sigkill failed 6751 - @c3y1huang
• [IMPROVEMENT] Improve the profiler of longhorn-engine for runtime profiling 6282 - @Vicente-Cheng
• [IMPROVEMENT] Reconcile engine/replica instance state of v2 volume like v1 volume 7326 - @derekbit @chriscchien
• [TASK] Security vulnerabilities in docker images 7523 - @c3y1huang
• [FEATURE] Support instance-manager pod for v2 volumes on selected nodes 7015 - @derekbit @chriscchien @roger-ryao
• [BUG] V2 volume is attached to a node first, the V1 volume will fails to attach. 7511 - @c3y1huang @roger-ryao
• [FEATURE] v2 volume supports volume backup/restore 6138 - @yangchiu @derekbit
• [TASK][UI] v2 volume does not support engine image upgrade 7445 - @chriscchien @scures @roger-ryao
• [BUG] v2 volume always displays engine upgrade available on UI 7489 - @scures
• [BUG] Create volume(v1) faulted 7536 - @FrankYang0529 @chriscchien
• [BUG] Backing Image Data Inconsistency if it's Exported from a Backing Image Backed Volume 6899 - @ChanYiLin
• [BUG] Creating volume randomly failed: failed to find a node that is ready and has the default engine image 7413 - @yangchiu @PhanLe1010
• [DOC] Add missing descriptions for Helm 7485 - @mantissahz
• [IMPROVEMENT][UI] Display v2 volume actual size 7524 - @derekbit
• [IMPROVEMENT] Improve handling of 16TiB+ volumes with ext4 as the underlying file system 7423 - @mantissahz @chriscchien
• [FEATURE] Talos support 3161 - @yangchiu @c3y1huang
• [IMPROVEMENT] Rename backendStoreDriver to dataEngin in instance-manager and associated components 7480 - @yangchiu @derekbit
• [FEATURE] Flush on-the-fly IOs in the queue before snapshotting 5648 - @DamiaSan
• [IMPROVEMENT][UI] Validate volume creation according to the enabled data engines 7505 - @derekbit @chriscchien
• [FEATURE] Support v2 volume on ARM64 platform 6021 - @derekbit @chriscchien @roger-ryao
• [FEATURE] Have default priorityClass to prevent unexpected longhorn pods eviction 6528 - @mantissahz
• [CI] Add .drone.yaml in go-spdk-helper 7509 - @derekbit
• [IMPROVEMENT] Add guaranteed instanceManager CPU setting for v2 volume 7361 - @derekbit @roger-ryao
• [TASK] Update protoc to v24.3 6666 - @FrankYang0529
• [IMPROVEMENT] UI backup restoration supports v1 and v2 Data Engine 6597 - @derekbit @scures
• [BUG] Running new e2e test pipeline always failed with error not ready 7484 - @PhanLe1010 @chriscchien
• [BUG] Persistent volume is not ready for workloads 6776 - @james-munson @roger-ryao
• [IMPROVEMENT] Automatically remount read-only RWO volume to read-write 6386 - @ChanYiLin @chriscchien
• [IMPROVEMENT] Support backup list if there is only v2-data-engine enabled 7486 - @derekbit @chriscchien
• [IMPROVEMENT] Upgrade CSI components to the latest patch release 7384 - @c3y1huang @roger-ryao
• [IMPROVEMENT] Add global setting for enable v1 or v2 volume support 7095 - @yangchiu @derekbit
• [BUG] Unable to create snapshot: cannot get engine client because it isn't deployed 7438 - @yangchiu @PhanLe1010
• [IMPROVEMENT] Blindly stop raid bdev exposure before exposing it for V2 volume 7324 - @yangchiu @derekbit @roger-ryao
• [IMPROVEMENT] instance-managers for v1 and v2 volumes respectively 6984 - @yangchiu @derekbit
• [FEATURE] Enable resource profiling for IM 6377 - @derekbit @roger-ryao
• [BUG] Deadlock for RWX volume if an error occurs in its share-manager pod 7183 - @derekbit @chriscchien
• [TASK] Synchronize version of CSI components in longhorn/longhorn and longhorn/longhorn-manager 7377 - @c3y1huang @roger-ryao
• [CI] longhorn-engine CI can't publish-image after longhorn-engine#954 7476 - @FrankYang0529
• [BUG] Volume conditions are not represented in the UI for v1.4.x and newer 7241 - @m-ildefons @chriscchien
• [BUG] backingimage download server error 7288 - @scures @roger-ryao
• [FEATURE] Engine upgrade enforcement 5842 - @yangchiu @c3y1huang
• [IMPROVEMENT] Add a new settings that allows Longhorn to evict replicas automatically when a node is drained 2238 - @ejweber @chriscchien
• [TASK] Upgrade csi-snapshotter to mitigate rapid retry bug 6506 - @ejweber
• [BUG] CSI components CrashLoopBackOff, failed to connect to unix://csi/csi.sock after cluster restart 7116 - @yangchiu @ejweber
• [IMPROVEMENT] Reject volume.spec.image update for v2 volumes before introducing live upgrade 7446 - @derekbit @chriscchien
• [BUG] Kubelet cannot finish terminating a pod that uses a PVC with volumeMode: Block when restarting the node 6919 - @PhanLe1010 @chriscchien
• [BUG] Test case test_node_default_disk_labeled failed 7385 - @derekbit @roger-ryao
• [BUG] Helm2 install error: 'lookup' function not defined in validate-psp-install.yaml 6318 - @innobead @roger-ryao
• [FEATURE] Support non-disruptive volume-related setting updates [7173](https://gith...

Longhorn v1.6.0-dev-20231217

This is a sprint release for internal testing and development purposes only. DO NOT INSTALL or UPGRADE to any sprint releases, as this operation is not supported.

Handled issues in the sprint

• [BUG] Warning events are being spammed by Longhorn - CRD 7290 - @m-ildefons
• [TASK] Add linear dm device on the top of v2 volume 7357 - @derekbit
• [BUG] Persistent volume is not ready for workloads 6776 - @james-munson @roger-ryao
• [DOC] Fix erronous value for default StorageMinimalAvailablePercentage setting. 7342 - @james-munson
• [BUG] A race after a node reboot leads to I/O errors with migratable volumes 6961 - @yangchiu @ejweber
• [BUG] CSI components CrashLoopBackOff, failed to connect to unix://csi/csi.sock after cluster restart 7116 - @ejweber
• [IMPROVEMENT] Don't crash the migration engine when kubelet restarts 7302 - @ejweber
• [TASK] Ensure the Go version in Dockerfile.dapper matches go.mod for all Longhorn components 7341 - @ejweber
• [BUG] Kubelet cannot finish terminating a pod that uses a PVC with volumeMode: Block when restarting the node 6919 - @PhanLe1010
• [IMPROVEMENT] deploy: driver deployer shouldn't cleanup previous deployment if Kubernetes version changes 5474 - @PhanLe1010
• [IMPROVEMENT] BackingImage should be compressed when downloading and use the name as filename instead of UUID 7295 - @ChanYiLin
• [FEATURE] Allow kubectl drain to stop manually attached volumes 6978 - @ChanYiLin @chriscchien
• [IMPROVEMENT] Reconcile replica instance state after its associated block-type disk is ready 7338 - @derekbit
• [BUG] Helm2 install error: 'lookup' function not defined in validate-psp-install.yaml 6318 -
• [BUG] multiple "for-cloning-volume" snapshots created after cloning volume 5835 - @PhanLe1010 @chriscchien
• [IMPROVEMENT] Collect SPDK related info for the usage metrics 6033 - @c3y1huang
• [BUG] Test case test_node_eviction failed 7210 - @ejweber @roger-ryao
• [TASK] Revisit volume automatic recover mechanism 6962 - @PhanLe1010
• [BUG] During volume live engine upgrade, delete replica with old engine image will make volume degraded forever 7012 - @PhanLe1010 @chriscchien
• [FEATURE] Add a new settings that allows Longhorn to evict replicas automatically when a node is drained 2238 - @ejweber
• [BUG] backingimage download server error 7288 - @ChanYiLin @scures
• [IMPROVEMENT] Allow deployment of Prometheus ServiceMonitor with the Longhorn helm chart 7041 - @mantissahz @chriscchien
• [TEST] Introduce Negative Testing 5240 - @yangchiu @khushboo-rancher
• [DOC] FS Trim for RWX is supported, but docs are out of date. 6733 - @james-munson
• [TASK] Collect coverage profiles for Go components during e2e test cases 5681 - @FrankYang0529
• [IMPROVEMENT] Reconcile engine/replica instance state of v2 volume like v1 volume 7326 - @derekbit
• [BUG] Backing image disk state unknown after unmount disk 6443 - @ChanYiLin
• [IMPROVEMENT] add build script to generate gRPC related code more convenient 6973 - @Vicente-Cheng
• [BUG] Backup NFS - Operation not permitted during mount 6114 - @mantissahz
• [BUG] Failed RWX mount due to connection timeout still happening 7301 - @james-munson
• [IMPROVEMENT] Disable CGO in longhorn components if not used 7135 - @derekbit
• [IMPROVEMENT] Environment setup and check tooling container 6657 - @derekbit
• [BUG] Cannot add block-type disk to node resource due to timeout error 7253 - @shuo-wu
• [IMPROVEMENT] Add test for longhorn-spdk-engine 6060 - @shuo-wu
• [IMPROVEMENT] Thread-safe SPDK JSON client 6106 - @shuo-wu
• [FEATURE] Support non-disruptive volume-related setting updates 7173 - @mantissahz
• [BUG] Test case test_volume_reattach_after_engine_sigkill failed 6751 - @c3y1huang
• [FEATURE] Container-Optimized OS support 6165 - @c3y1huang
• [IMPROVEMENT] Blindly stop raid bdev exposure before exposing it for V2 volume 7324 - @derekbit
• [IMPROVEMENT] BackingImage UI improvement 7293 - @scures
• [BUG] Volume has 2 active engines at the same time that blocks the volume controller reconciliation loop 4827 - @PhanLe1010 @chriscchien @roger-ryao
• [BUG] Volume UI displays only the last backup when using the recurring job 2997 - @mantissahz @chriscchien @roger-ryao
• [BUG] Volume gets stuck in an unknown state forever if created in an engine not fully deployed environment 6131 - @yangchiu @PhanLe1010
• [BUG] Continuously auto-balancing replicas when zone does not have enough space 6671 - @yangchiu @c3y1huang @roger-ryao
• [REFACTOR] Abstract the disk/lvol file operations in backupstore 6576 - @derekbit @chriscchien
• [BUG] backing-image-manager- hostPath selection exception 7062 - @ChanYiLin @chriscchien
• [IMPROVEMENT] Upgrade support bundle kit version to v0.0.33 7277 - @c3y1huang
• [BUG] GET error for volume attachment on node reboot 4188 - @PhanLe1010
• [BUG] MultiUnmapper floods logs with warnings about size mismatch. 6406 - @james-munson
• [TASK] Remove namespaceOverride from the chart values 6527 - @mantissahz @roger-ryao
• [IMPROVEMENT] Volumes: metrics for backups and snapshots include (count and size and type: system vs user), to better understand how the actual size is summed up. 5869 - @c3y1huang
• [TASK] Bump up the minimum supported Kubernetes version 7224 - @c3y1huang @roger-ryao
• [TASK] Implement xattr get and set operations on SPDK logical volumes (lvol) 6604 - @derekbit
• [DOC] Stress using object store as best practice for backups. 6773 - @james-munson
• [BUG] Errors found by static checker in volume controller 7009 - @m-ildefons
• [FEATURE] Have default priorityClass to prevent unexpected longhorn pods eviction 6528 - @mantissahz
• [BUG] Deadlock for RWX volume if an error occurs in its share-manager pod 7183 - @derekbit @chriscchien
• [TASK] Remove namespaceOverride from values.yaml in charts repo 7311 - @innobead
• [FEATURE] Talos support 3161 - @c3y1huang
• [IMPROVEMENT] Bypass upgrade when installing a fresh setup 6988 - @mantissahz @roger-ryao
• [IMPROVEMENT] Replace deprecated grpc.WithInsecure 7291 - @c3y1huang
• [BUG] Download backing image failed with HTTP 502 error if Storage Network configured 7236 - @ChanYiLin
• [TASK] Investigate and update the Rancher chart annotation requirements 7024 - @PhanLe1010 @chriscchien
• [BUG] Enabling replica-auto-balance tries to replicate to disabled nodes causing lots of errors in the logs and in the UI 6508 - @c3y1huang @chriscchien
• [IMPROVEMENT] Gracefully shut down spdk_tgt 7263 - @derekbit
• [FEATURE] Single Node Disk affinity 3823 - @ejw...

Longhorn v1.5.3 release

Release Note

v1.5.3 released! 🎆

This release focuses on resolving a regression issue from v1.5.2 related to volume encryption, along with a few other fixes and improvements. Please try it and provide feedback. Thanks for all the contributions!

For the definition of stable or latest release, please check here.

Installation

Please ensure your Kubernetes cluster is at least v1.21 before installing v1.5.3.

Longhorn supports three installation ways including Rancher App Marketplace, Kubectl, and Helm. Follow the installation instructions here.

Upgrade

Please read the important notes first and ensure your Kubernetes cluster is at least v1.21 before upgrading to Longhorn v1.5.3 from v1.4.x/v1.5.x, which are only supported source versions.

Follow the upgrade instructions here.

Deprecation & Incompatibilities

N/A

Known Issues after Release

Please follow up on here about any outstanding issues found after this release.

Resolved Issues

Improvement

• [IMPROVEMENT] Add PVC namespace to longhorn_volume metrics 7077 - @mantissahz @roger-ryao @antoninferrand

Resilience

• [BUG] A race after a node reboot leads to I/O errors with migratable volumes 6961 - @yangchiu @ejweber

Bug

• [BUG] Share manager unmount/unexport RWX volume timing issue 7106 - @yangchiu @derekbit
• [BUG] backing-image-manager- hostPath selection exception 7062 - @ChanYiLin @nitendra-suse
• [BUG] Failing to mount encrypted volumes v1.5.2 7045 - @derekbit @nitendra-suse
• [BUG] Fix RWX volume mount option typo in v1.5.x 7104 - @yangchiu @derekbit
• [BUG] Upgrade from v1.5.2 to v1.5.3-rc1 failed if there's an attached v1 volume and a detached v2 volume 7094 - @derekbit

Contributors

• @ChanYiLin
• @antoninferrand
• @derekbit
• @ejweber
• @innobead
• @mantissahz
• @nitendra-suse
• @roger-ryao
• @yangchiu

Longhorn v1.5.3-rc1 release

Release Note

DON'T UPGRADE from/to any RC/Preview releases, because the operation is not supported.

v1.5.3-rc1 released! 🎆

This release focuses on resolving a regression issue from v1.5.2 related to volume encryption, along with a few other fixes and improvements. Please try it and provide feedback. Thanks for all the contributions!

Installation

Please ensure your Kubernetes cluster is at least v1.21 before installing v1.5.3.

Longhorn supports three installation ways including Rancher App Marketplace, Kubectl, and Helm. Follow the installation instructions here.

Upgrade

Please read the important notes first and ensure your Kubernetes cluster is at least v1.21 before upgrading to Longhorn v1.5.3 from v1.4.x/v1.5.x, which are only supported source versions.

The live upgrade from v1.4.x/v1.5.x is not supported until the GA release. When available, follow the upgrade instructions here. Here.

Deprecation & Incompatibilities

N/A

Known Issues after Release

Please follow up on here about any outstanding issues found after this release.

Resolved Issues

Improvement

• [IMPROVEMENT] Add PVC namespace to longhorn_volume metrics 7077 - @mantissahz @roger-ryao @antoninferrand

Resilience

• [BUG] A race after a node reboot leads to I/O errors with migratable volumes 6961 - @yangchiu @ejweber

Bug

• [BUG] [1.5.1] backing-image-manager- hostPath selection exception 7062 - @ChanYiLin @nitendra-suse
• [BUG] Failing to mount encrypted volumes v1.5.2 7045 - @derekbit @nitendra-suse

Contributors

• @ChanYiLin
• @antoninferrand
• @derekbit
• @ejweber
• @innobead
• @mantissahz
• @nitendra-suse
• @roger-ryao
• @yangchiu

Longhorn v1.5.2 release

Release Note

v1.5.2 released! 🎆

This release introduces bug fixes and improvements, with the main focus on stability. Please try it and provide feedback. Thanks for all the contributions!

For the definition of stable or latest release, please check here.

Installation

Please ensure your Kubernetes cluster is at least v1.21 before installing v1.5.2.

Longhorn supports three installation ways including Rancher App Marketplace, Kubectl, and Helm. Follow the installation instructions here.

Upgrade

Please read the important notes first and ensure your Kubernetes cluster is at least v1.21 before upgrading to Longhorn v1.5.2 from v1.4.x/v1.5.x, which are only supported source versions.

Follow the upgrade instructions here. Here.

Deprecation & Incompatibilities

N/A

Known Issues after Release

Please follow up on here about any outstanding issues found after this release.

Resolved Issues

Enhancement

• [FEATURE] Add disk status prometheus metrics 6858 - @c3y1huang @chriscchien

Improvement

• [IMPROVEMENT] High memory consumption of longhorn-manager pods since Longhorn v1.5 6936 - @derekbit
• [IMPROVEMENT] Old kernel such as 3.10.0 set provisioning_mode to wrong value (writesame_16, disabled, full, ...) but not the correct value (unmap) so the trim feature doesn't work 6854 - @PhanLe1010 @chriscchien
• [IMPROVEMENT] Improve log level for resource update failure able to reconcile again 6843 - @PhanLe1010 @nitendra-suse
• [IMPROVEMENT] Don't log about inability to change settings that didn't change. 6812 - @james-munson @roger-ryao
• [IMPROVEMENT] Use nvme-cli in instance-manager pod instead 6798 - @derekbit
• [IMPROVEMENT] Prevent unexpected engine creation 6682 - @PhanLe1010 @ejweber @roger-ryao
• [IMPROVEMENT] Support both NFS hard and soft with custom timeo and retrans options for RWX volumes 6655 - @derekbit @roger-ryao
• [IMPROVEMENT] Prevent Volume Provision if Related Backing Image Stuck in Ready-For-Trasfer State 6615 - @ChanYiLin @roger-ryao
• [IMPROVEMENT] Support custom options for network filesystems for backup 6608 - @james-munson
• [IMPROVEMENT] Remove dummy services of each CSI sidecar if not required 6581 - @ejweber @roger-ryao
• [IMPROVEMENT] Include /var/log/messages during the support-bundle syslog collection 6544 - @c3y1huang @roger-ryao
• [IMPROVEMENT] Provide more information for volume scheduling failure 6461 - @smallteeths @chriscchien
• [IMPROVEMENT] Remove or Change Helm pre-upgrade hook to support ArgoCD 6415 - @mantissahz
• [IMPROVEMENT] Improve upgrade path and make it more solid 6294 - @PhanLe1010 @roger-ryao
• [IMPROVEMENT] UI Volume detail page still shows Block Device when spec.disableFrontend is true 6167 - @smallteeths @chriscchien
• [IMPROVEMENT] Fix scheduling flooding logs 6019 - @ChanYiLin @roger-ryao
• [IMPROVEMENT] Add reserve storage percentage of nodes setting in helm chart 5958 - @mantissahz @roger-ryao
• [IMPROVEMENT] Longhorn-engine processes should refuse to serve requests not intended for them 5845 - @ejweber @chriscchien
• [IMPROVEMENT] Unify logs with extra static info like module/method/function/line 5509 - @ChanYiLin @roger-ryao
• [IMPROVEMENT] Add pvc name to longhorn_volume metrics 5297 - @c3y1huang @nitendra-suse
• [IMPROVEMENT] Avoid the accident deletion of longhorn settings 4984 - @ejweber @roger-ryao
• [IMPROVEMENT] Remove Longhorn engine path mismatch log 3786 - @c3y1huang @roger-ryao

Performance

• [IMPROVEMENT] Optimize the resource cache to prevent high memory usage in longhorn-manager 6954 - @derekbit @nitendra-suse
• [BUG] Longhorn manager pods in 1.5.1 consuming 20GB+ RAM and 3-4 vCPUs 6866 - @derekbit @shuo-wu
• [BUG] Longhorn Instance Manager Memory leak 6481 - @james-munson @chriscchien

Stability

• [BUG] DR volume failed when synchronizing the incremental backup 6750 - @mantissahz @chriscchien
• [BUG] After crashed engine process, volume stuck in Unknown state 6699 - @ChanYiLin @nitendra-suse
• [BUG] Two active engine when volume migrating 6642 - @PhanLe1010 @chriscchien
• [BUG] Somehow the Rebuilding field inside volume.meta is set to true when one replica only, causing the volume into attaching/detaching loop 6626 - @c3y1huang @nitendra-suse

Resilience

• [BUG] RWX workload gets stuck in ContainerCreating after cluster restart 6924 - @yangchiu @derekbit
• [BUG] Volumes failing to mount because of engine upgradedReplicaAddressMap reference 6762 - @PhanLe1010 @chriscchien
• [BUG] Set a invalid backup target when backup in progress will cause backup never finish 6491 - @ChanYiLin @chriscchien
• [BUG] Share manager pod will stay in IO error when the volume becomes read only 5961 - @ChanYiLin @roger-ryao

Bug

• [BUG] duplicate MIME type "text/html" in /var/config/nginx/nginx.conf 7002 - @votdev
• [BUG] invalid memory address or nil pointer dereference in BackupVolumeController 6998 - @mantissahz @roger-ryao
• [BUG] Unable to upgrade longhorn from v1.4.x to v1.5.x: longhorn-manager CrashLoopBackOff 6987 - @mantissahz @chriscchien
• [BUG] Longhorn storage network is incompatible with Multus version above v4.0.0 6953 - @c3y1huang
• [BUG] longhorn manager isn't annotated with iam.amazonaws.com/role 6947 - @mantissahz
• [BUG] Unable to add a block-type disk with a new name 6849 - @derekbit @chriscchien
• [BUG] IO error occurs when detaching RWX volume 6829 - @derekbit @chriscchien
• [BUG] cifs backup mount paths with dollar sign are not allowed 6660 - @derekbit @roger-ryao
• [BUG] Orphan snapshot attachment tickets prevent volume from detaching 6652 - @ejweber
• [BUG] High CPU usage on one node. 6578 - @derekbit @chriscchien
• [BUG] The instance manager with state unknown will be cleaned up in the split-brain case 6479 - @shuo-wu
• [BUG] Removed IM CPU request settings still exists and new IM CPU request missed from chart settings 6465 - @c3y1huang @chriscchien
• [BUG] PV using v2 engine cannot attach 6441 - @derekbit @chriscchien @nitendra-suse
• [BUG] SettingNameSnapshotDataIntegrityCronJob should be sent as boolean value 6410 - @c3y1huang @roger-ryao
• [BUG] Fix errors in questions.yaml 6392 - @james-munson @chriscchien
• [BUG] Webhook is never called for BackingImageManager 6328 - @ejweber @chriscchien
• [BUG] Longhorn Read-Only setting can be modified 5989 - @mantissahz
• [BUG] Environment Check Script Fails To Perform All Checks 5653 - @PhanLe1010 @roger-ryao
• [BUG] Can't delete volumesnapshot if backup target not set 4979 - @ejweber @chriscchien
• [BUG] Backup Job returns "Completed" despite running into errors 4255 - @mantissahz @chriscchien
• [BUG] Error during backup process will be removed quickly without user knowing 1249 - @mantissahz @chriscchien

Misc

• [TASK...

Longhorn v1.5.2-rc3 release

Release Note

DON'T UPGRADE from/to any RC/Preview releases, because the operation is not supported.

v1.5.2-rc3 released! 🎆

This release introduces bug fixes and improvements, with the main focus on stability. Please try it and provide feedback. Thanks for all the contributions!

Installation

Please ensure your Kubernetes cluster is at least v1.21 before installing v1.5.2.

Longhorn supports three installation ways including Rancher App Marketplace, Kubectl, and Helm. Follow the installation instructions here.

Upgrade

Please read the important notes first and ensure your Kubernetes cluster is at least v1.21 before upgrading to Longhorn v1.5.2 from v1.4.x/v1.5.x, which are only supported source versions.

The live upgrade from v1.4.x/v1.5.x is not supported until the GA release. When available, follow the upgrade instructions here. Here.

Deprecation & Incompatibilities

N/A

Known Issues after Release

Please follow up on here about any outstanding issues found after this release.

Resolved Issues

Enhancement

• [FEATURE] Add disk status prometheus metrics 6858 - @c3y1huang @chriscchien

Improvement

• [IMPROVEMENT] High memory consumption of longhorn-manager pods since Longhorn v1.5 6936 - @derekbit
• [IMPROVEMENT] Old kernel such as 3.10.0 set provisioning_mode to wrong value (writesame_16, disabled, full, ...) but not the correct value (unmap) so the trim feature doesn't work 6854 - @PhanLe1010 @chriscchien
• [IMPROVEMENT] Improve log level for resource update failure able to reconcile again 6843 - @PhanLe1010 @nitendra-suse
• [IMPROVEMENT] Don't log about inability to change settings that didn't change. 6812 - @james-munson @roger-ryao
• [IMPROVEMENT] Use nvme-cli in instance-manager pod instead 6798 - @derekbit
• [IMPROVEMENT] Prevent unexpected engine creation 6682 - @PhanLe1010 @ejweber @roger-ryao
• [IMPROVEMENT] Support both NFS hard and soft with custom timeo and retrans options for RWX volumes 6655 - @derekbit @roger-ryao
• [IMPROVEMENT] Prevent Volume Provision if Related Backing Image Stuck in Ready-For-Trasfer State 6615 - @ChanYiLin @roger-ryao
• [IMPROVEMENT] Support custom options for network filesystems for backup 6608 - @james-munson
• [IMPROVEMENT] Remove dummy services of each CSI sidecar if not required 6581 - @ejweber @roger-ryao
• [IMPROVEMENT] Include /var/log/messages during the support-bundle syslog collection 6544 - @c3y1huang @roger-ryao
• [IMPROVEMENT] Provide more information for volume scheduling failure 6461 - @smallteeths @chriscchien
• [IMPROVEMENT] Remove or Change Helm pre-upgrade hook to support ArgoCD 6415 - @mantissahz
• [IMPROVEMENT] Improve upgrade path and make it more solid 6294 - @PhanLe1010 @roger-ryao
• [IMPROVEMENT] UI Volume detail page still shows Block Device when spec.disableFrontend is true 6167 - @smallteeths @chriscchien
• [IMPROVEMENT] Fix scheduling flooding logs 6019 - @ChanYiLin @roger-ryao
• [IMPROVEMENT] Add reserve storage percentage of nodes setting in helm chart 5958 - @mantissahz @roger-ryao
• [IMPROVEMENT] Longhorn-engine processes should refuse to serve requests not intended for them 5845 - @ejweber @chriscchien
• [IMPROVEMENT] Unify logs with extra static info like module/method/function/line 5509 - @ChanYiLin @roger-ryao
• [IMPROVEMENT] Add pvc name to longhorn_volume metrics 5297 - @c3y1huang @nitendra-suse
• [IMPROVEMENT] Avoid the accident deletion of longhorn settings 4984 - @ejweber @roger-ryao
• [IMPROVEMENT] Remove Longhorn engine path mismatch log 3786 - @c3y1huang @roger-ryao

Performance

• [IMPROVEMENT] Optimize the resource cache to prevent high memory usage in longhorn-manager 6954 - @derekbit @nitendra-suse
• [BUG] Longhorn manager pods in 1.5.1 consuming 20GB+ RAM and 3-4 vCPUs 6866 - @derekbit @shuo-wu
• [BUG] Longhorn Instance Manager Memory leak 6481 - @james-munson @chriscchien

Stability

• [BUG] DR volume failed when synchronizing the incremental backup 6750 - @mantissahz @chriscchien
• [BUG] After crashed engine process, volume stuck in Unknown state 6699 - @ChanYiLin @nitendra-suse
• [BUG] Two active engine when volume migrating 6642 - @PhanLe1010 @chriscchien
• [BUG] Somehow the Rebuilding field inside volume.meta is set to true when one replica only, causing the volume into attaching/detaching loop 6626 - @c3y1huang @nitendra-suse

Resilience

• [BUG] RWX workload gets stuck in ContainerCreating after cluster restart 6924 - @yangchiu @derekbit
• [BUG] Volumes failing to mount because of engine upgradedReplicaAddressMap reference 6762 - @PhanLe1010 @chriscchien
• [BUG] Set a invalid backup target when backup in progress will cause backup never finish 6491 - @ChanYiLin
• [BUG] Share manager pod will stay in IO error when the volume becomes read only 5961 - @ChanYiLin @roger-ryao

Bug

• [BUG] duplicate MIME type "text/html" in /var/config/nginx/nginx.conf 7002 - @votdev
• [BUG] invalid memory address or nil pointer dereference in BackupVolumeController 6998 - @mantissahz
• [BUG] Unable to upgrade longhorn from v1.4.x to v1.5.x: longhorn-manager CrashLoopBackOff 6987 - @mantissahz @chriscchien
• [BUG] Longhorn storage network is incompatible with Multus version above v4.0.0 6953 - @c3y1huang
• [BUG] longhorn manager isn't annotated with iam.amazonaws.com/role 6947 - @mantissahz
• [BUG] Unable to add a block-type disk with a new name 6849 - @derekbit @chriscchien
• [BUG] IO error occurs when detaching RWX volume 6829 - @derekbit @chriscchien
• [BUG] cifs backup mount paths with dollar sign are not allowed 6660 - @derekbit @roger-ryao
• [BUG] Orphan snapshot attachment tickets prevent volume from detaching 6652 - @ejweber
• [BUG] High CPU usage on one node. 6578 - @derekbit @chriscchien
• [BUG] The instance manager with state unknown will be cleaned up in the split-brain case 6479 - @shuo-wu
• [BUG] Removed IM CPU request settings still exists and new IM CPU request missed from chart settings 6465 - @c3y1huang @chriscchien
• [BUG] PV using v2 engine cannot attach 6441 - @derekbit @chriscchien @nitendra-suse
• [BUG] SettingNameSnapshotDataIntegrityCronJob should be sent as boolean value 6410 - @c3y1huang @roger-ryao
• [BUG] Fix errors in questions.yaml 6392 - @james-munson @chriscchien
• [BUG] Webhook is never called for BackingImageManager 6328 - @ejweber @chriscchien
• [BUG] Longhorn Read-Only setting can be modified 5989 - @mantissahz
• [BUG] Environment Check Script Fails To Perform All Checks 5653 - @PhanLe1010 @roger-ryao
• [BUG] Can't delete volumesnapshot if backup target not set 4979 - @ejweber @chriscchien
• [BUG] Backup Job returns "Completed" despite running into errors 4255 - @mantissahz @chriscchien
• [BUG] Error during backup process will be removed quickly without user knowing 1249 - ...

Longhorn v1.5.2-rc2 release

Release Note

DON'T UPGRADE from/to any RC/Preview releases, because the operation is not supported.

v1.5.2-rc2 released! 🎆

This release introduces bug fixes and improvements, with the main focus on stability. Please try it and provide feedback. Thanks for all the contributions!

Installation

Please ensure your Kubernetes cluster is at least v1.21 before installing v1.5.2.

Longhorn supports three installation ways including Rancher App Marketplace, Kubectl, and Helm. Follow the installation instructions here.

Upgrade

Please read the important notes first and ensure your Kubernetes cluster is at least v1.21 before upgrading to Longhorn v1.5.2 from v1.4.x/v1.5.x, which are only supported source versions.

The live upgrade from v1.4.x/v1.5.x is not supported until the GA release. When available, follow the upgrade instructions here. Here.

Deprecation & Incompatibilities

N/A

Known Issues after Release

Please follow up on here about any outstanding issues found after this release.

Resolved Issues

Enhancement

• [FEATURE] Add disk status prometheus metrics 6858 - @c3y1huang @chriscchien

Improvement

• [IMPROVEMENT] High memory consumption of longhorn-manager pods since Longhorn v1.5 6936 - @derekbit
• [IMPROVEMENT] Old kernel such as 3.10.0 set provisioning_mode to wrong value (writesame_16, disabled, full, ...) but not the correct value (unmap) so the trim feature doesn't work 6854 - @PhanLe1010 @chriscchien
• [IMPROVEMENT] Improve log level for resource update failure able to reconcile again 6843 - @PhanLe1010 @nitendra-suse
• [IMPROVEMENT] Don't log about inability to change settings that didn't change. 6812 - @james-munson @roger-ryao
• [IMPROVEMENT] Use nvme-cli in instance-manager pod instead 6798 - @derekbit
• [IMPROVEMENT] Prevent unexpected engine creation 6682 - @PhanLe1010 @ejweber @roger-ryao
• [IMPROVEMENT] Support both NFS hard and soft with custom timeo and retrans options for RWX volumes 6655 - @derekbit @roger-ryao
• [IMPROVEMENT] Prevent Volume Provision if Related Backing Image Stuck in Ready-For-Trasfer State 6615 - @ChanYiLin @roger-ryao
• [IMPROVEMENT] Support custom options for network filesystems for backup 6608 - @james-munson
• [IMPROVEMENT] Remove dummy services of each CSI sidecar if not required 6581 - @ejweber @roger-ryao
• [IMPROVEMENT] Include /var/log/messages during the support-bundle syslog collection 6544 - @c3y1huang @roger-ryao
• [IMPROVEMENT] Provide more information for volume scheduling failure 6461 - @smallteeths @chriscchien
• [IMPROVEMENT] Remove or Change Helm pre-upgrade hook to support ArgoCD 6415 - @mantissahz
• [IMPROVEMENT] Improve upgrade path and make it more solid 6294 - @PhanLe1010 @roger-ryao
• [IMPROVEMENT] UI Volume detail page still shows Block Device when spec.disableFrontend is true 6167 - @smallteeths @chriscchien
• [IMPROVEMENT] Fix scheduling flooding logs 6019 - @ChanYiLin @roger-ryao
• [IMPROVEMENT] Add reserve storage percentage of nodes setting in helm chart 5958 - @mantissahz @roger-ryao
• [IMPROVEMENT] Longhorn-engine processes should refuse to serve requests not intended for them 5845 - @ejweber @chriscchien
• [IMPROVEMENT] Unify logs with extra static info like module/method/function/line 5509 - @ChanYiLin @roger-ryao
• [IMPROVEMENT] Add pvc name to longhorn_volume metrics 5297 - @c3y1huang @nitendra-suse
• [IMPROVEMENT] Avoid the accident deletion of longhorn settings 4984 - @ejweber @roger-ryao
• [IMPROVEMENT] Remove Longhorn engine path mismatch log 3786 - @c3y1huang @roger-ryao

Performance

• [IMPROVEMENT] Optimize the resource cache to prevent high memory usage in longhorn-manager 6954 - @derekbit
• [BUG] Longhorn manager pods in 1.5.1 consuming 20GB+ RAM and 3-4 vCPUs 6866 - @derekbit @shuo-wu
• [BUG] Longhorn Instance Manager Memory leak 6481 - @james-munson @chriscchien

Stability

• [BUG] DR volume failed when synchronizing the incremental backup 6750 - @mantissahz @chriscchien
• [BUG] After crashed engine process, volume stuck in Unknown state 6699 - @ChanYiLin @nitendra-suse
• [BUG] Two active engine when volume migrating 6642 - @PhanLe1010 @chriscchien
• [BUG] Somehow the Rebuilding field inside volume.meta is set to true when one replica only, causing the volume into attaching/detaching loop 6626 - @c3y1huang @nitendra-suse

Resilience

• [BUG] RWX workload gets stuck in ContainerCreating after cluster restart 6924 - @yangchiu @derekbit
• [BUG] Volumes failing to mount because of engine upgradedReplicaAddressMap reference 6762 - @PhanLe1010 @chriscchien
• [BUG] Set a invalid backup target when backup in progress will cause backup never finish 6491 - @ChanYiLin
• [BUG] Share manager pod will stay in IO error when the volume becomes read only 5961 - @ChanYiLin @roger-ryao
• [BACKPORT][v1.5.2][BUG] After crashed engine process, volume stuck in Unknown state 6759 - @ChanYiLin @roger-ryao

Bug

• [BUG] Unable to upgrade longhorn from v1.4.x to v1.5.x: longhorn-manager CrashLoopBackOff 6987 - @mantissahz
• [BUG] Longhorn storage network is incompatible with Multus version above v4.0.0 6953 - @c3y1huang
• [BUG] longhorn manager isn't annotated with iam.amazonaws.com/role 6947 - @mantissahz
• [BUG] Unable to add a block-type disk with a new name 6849 - @derekbit @chriscchien
• [BUG] IO error occurs when detaching RWX volume 6829 - @derekbit @chriscchien
• [BUG] cifs backup mount paths with dollar sign are not allowed 6660 - @derekbit @roger-ryao
• [BUG] Orphan snapshot attachment tickets prevent volume from detaching 6652 - @ejweber
• [BUG] High CPU usage on one node. 6578 - @derekbit @chriscchien
• [BUG] The instance manager with state unknown will be cleaned up in the split-brain case 6479 - @shuo-wu
• [BUG] Removed IM CPU request settings still exists and new IM CPU request missed from chart settings 6465 - @c3y1huang @chriscchien
• [BUG] PV using v2 engine cannot attach 6441 - @derekbit @chriscchien @nitendra-suse
• [BUG] SettingNameSnapshotDataIntegrityCronJob should be sent as boolean value 6410 - @c3y1huang @roger-ryao
• [BUG] Fix errors in questions.yaml 6392 - @james-munson @chriscchien
• [BUG] Webhook is never called for BackingImageManager 6328 - @ejweber @chriscchien
• [BUG] Longhorn Read-Only setting can be modified 5989 - @mantissahz
• [BUG] Environment Check Script Fails To Perform All Checks 5653 - @PhanLe1010 @roger-ryao
• [BUG] Can't delete volumesnapshot if backup target not set 4979 - @ejweber @chriscchien
• [BUG] Backup Job returns "Completed" despite running into errors 4255 - @mantissahz @chriscchien
• [BUG] Error during backup process will be removed quickly without user knowing 1249 - @mantissahz @chriscchien

Misc

• [TASK] Revert "Disable Automatically Delete Workload Pod when The Volume Is Detached Unexpectedly for RWX volumes" [...

Longhorn v1.5.2-rc1 release

Release Note

DON'T UPGRADE from/to any RC/Preview releases, because the operation is not supported.

v1.5.2-rc1 released! 🎆

This release introduces bug fixes and improvements, with the main focus on stability. Please try it and provide feedback. Thanks for all the contributions!

Installation

Please ensure your Kubernetes cluster is at least v1.21 before installing v1.5.2.

Longhorn supports three installation ways including Rancher App Marketplace, Kubectl, and Helm. Follow the installation instructions here.

Upgrade

Please read the important notes first and ensure your Kubernetes cluster is at least v1.21 before upgrading to Longhorn v1.5.2 from v1.4.x/v1.5.x, which are only supported source versions.

The live upgrade from v1.4.x/v1.5.x is not supported until the GA release. When available, follow the upgrade instructions here. Here.

Deprecation & Incompatibilities

N/A

Known Issues after Release

Please follow up on here about any outstanding issues found after this release.

Resolved Issues

Enhancement

• [FEATURE] Add disk status prometheus metrics 6858 - @c3y1huang @chriscchien

Improvement

• [IMPROVEMENT] High memory consumption of longhorn-manager pods since Longhorn v1.5 6936 - @derekbit
• [IMPROVEMENT] Old kernel such as 3.10.0 set provisioning_mode to wrong value (writesame_16, disabled, full, ...) but not the correct value (unmap) so the trim feature doesn't work 6854 - @PhanLe1010 @chriscchien
• [IMPROVEMENT] Improve log level for resource update failure able to reconcile again 6843 - @PhanLe1010 @nitendra-suse
• [IMPROVEMENT] Don't log about inability to change settings that didn't change. 6812 - @james-munson @roger-ryao
• [IMPROVEMENT] Use nvme-cli in instance-manager pod instead 6798 - @derekbit
• [IMPROVEMENT] Prevent unexpected engine creation 6682 - @PhanLe1010 @ejweber @roger-ryao
• [IMPROVEMENT] Support both NFS hard and soft with custom timeo and retrans options for RWX volumes 6655 - @derekbit @roger-ryao
• [IMPROVEMENT] Prevent Volume Provision if Related Backing Image Stuck in Ready-For-Trasfer State 6615 - @ChanYiLin @roger-ryao
• [IMPROVEMENT] Support custom options for network filesystems for backup 6608 - @james-munson
• [IMPROVEMENT] Remove dummy services of each CSI sidecar if not required 6581 - @ejweber @roger-ryao
• [IMPROVEMENT] Include /var/log/messages during the support-bundle syslog collection 6544 - @c3y1huang @roger-ryao
• [IMPROVEMENT] Provide more information for volume scheduling failure 6461 - @smallteeths @chriscchien
• [IMPROVEMENT] Remove or Change Helm pre-upgrade hook to support ArgoCD 6415 - @mantissahz
• [IMPROVEMENT] Improve upgrade path and make it more solid 6294 - @PhanLe1010 @roger-ryao
• [IMPROVEMENT] UI Volume detail page still shows Block Device when spec.disableFrontend is true 6167 - @smallteeths @chriscchien
• [IMPROVEMENT] Fix scheduling flooding logs 6019 - @ChanYiLin @roger-ryao
• [IMPROVEMENT] Add reserve storage percentage of nodes setting in helm chart 5958 - @mantissahz @roger-ryao
• [IMPROVEMENT] Longhorn-engine processes should refuse to serve requests not intended for them 5845 - @ejweber @chriscchien
• [IMPROVEMENT] Unify logs with extra static info like module/method/function/line 5509 - @ChanYiLin @roger-ryao
• [IMPROVEMENT] Add pvc name to longhorn_volume metrics 5297 - @c3y1huang @nitendra-suse
• [IMPROVEMENT] Avoid the accident deletion of longhorn settings 4984 - @ejweber @roger-ryao
• [IMPROVEMENT] Remove Longhorn engine path mismatch log 3786 - @c3y1huang @roger-ryao
• [BACKPORT][v1.5.2][IMPROVEMENT] Add pvc name to longhorn_volume metrics 6557 - @c3y1huang @chriscchien

Performance

• [IMPROVEMENT] Optimize the resource cache to prevent high memory usage in longhorn-manager 6954 - @derekbit
• [BUG] Longhorn manager pods in 1.5.1 consuming 20GB+ RAM and 3-4 vCPUs 6866 - @derekbit @shuo-wu
• [BUG] Longhorn Instance Manager Memory leak 6481 - @james-munson @chriscchien

Stability

• [BUG] DR volume failed when synchronizing the incremental backup 6750 - @mantissahz @chriscchien
• [BUG] After crashed engine process, volume stuck in Unknown state 6699 - @ChanYiLin @nitendra-suse
• [BUG] Two active engine when volume migrating 6642 - @PhanLe1010 @chriscchien
• [BUG] Somehow the Rebuilding field inside volume.meta is set to true when one replica only, causing the volume into attaching/detaching loop 6626 - @c3y1huang @nitendra-suse

Resilience

• [BUG][v1.4.4-rc1] rwx workload gets stuck in ContainerCreating after cluster restart 6924 - @yangchiu @derekbit
• [BUG] Volumes failing to mount because of engine upgradedReplicaAddressMap reference 6762 - @PhanLe1010 @chriscchien
• [BUG] Share manager pod will stay in IO error when the volume becomes read only 5961 - @ChanYiLin @roger-ryao
• [BACKPORT][v1.5.2][BUG] After crashed engine process, volume stuck in Unknown state 6759 - @ChanYiLin @roger-ryao

Bug

• [BUG] Longhorn storage network is incompatible with Multus version above v4.0.0 6953 - @c3y1huang
• [BUG] longhorn manager isn't annotated with iam.amazonaws.com/role 6947 - @mantissahz
• [BUG] Unable to add a block-type disk with a new name 6849 - @derekbit @chriscchien
• [BUG] IO error occurs when detaching RWX volume 6829 - @derekbit @chriscchien
• [BUG] cifs backup mount paths with dollar sign are not allowed 6660 - @derekbit @roger-ryao
• [BUG] Orphan snapshot attachment tickets prevent volume from detaching 6652 - @ejweber
• [BUG] High CPU usage on one node. 6578 - @derekbit @chriscchien
• [BUG] The instance manager with state unknown will be cleaned up in the split-brain case 6479 - @shuo-wu
• [BUG] Removed IM CPU request settings still exists and new IM CPU request missed from chart settings 6465 - @c3y1huang @chriscchien
• [BUG] PV using v2 engine cannot attach 6441 - @derekbit @chriscchien @nitendra-suse
• [BUG] SettingNameSnapshotDataIntegrityCronJob should be sent as boolean value 6410 - @c3y1huang @roger-ryao
• [BUG] Fix errors in questions.yaml 6392 - @james-munson @chriscchien
• [BUG] Webhook is never called for BackingImageManager 6328 - @ejweber @chriscchien
• [BUG] Longhorn Read-Only setting can be modified 5989 - @mantissahz
• [BUG] Environment Check Script Fails To Perform All Checks 5653 - @PhanLe1010 @roger-ryao
• [BUG] Can't delete volumesnapshot if backup target not set 4979 - @ejweber @chriscchien
• [BUG] Backup Job returns "Completed" despite running into errors 4255 - @mantissahz @chriscchien
• [BUG] Error during backup process will be removed quickly without user knowing 1249 - @mantissahz @chriscchien

Misc

• [TASK] Revert "Disable Automatically Delete Workload Pod when The Volume Is Detached Unexpectedly for RWX volumes" 6838 - @derekbit @roger-ryao
• Add reserve storage percentage in helm chart (backport #6258) [6333](http...

Longhorn v1.4.4 release

Release Note

v1.4.4 released! 🎆

This release introduces bug fixes and improvements, with the main focus on stability. Please try it and provide feedback. Thanks for all the contributions!

For the definition of stable or latest release, please check here.

Installation

Please ensure your Kubernetes cluster is at least v1.21 before installing v1.4.4.

Longhorn supports three installation ways including Rancher App Marketplace, Kubectl, and Helm. Follow the installation instructions here.

Upgrade

Please read the important notes first and ensure your Kubernetes cluster is at least v1.21 before upgrading to Longhorn v1.4.4 from v1.3.x/v1.4.x, which are only supported source versions.

Follow the upgrade instructions here.

Deprecation & Incompatibilities

N/A

Known Issues after Release

Please follow up on here about any outstanding issues found after this release.

Resolved Issues

Enhancement

• [FEATURE] Add disk status prometheus metrics 6858 - @c3y1huang @chriscchien

Improvement

• [IMPROVEMENT] Old kernel such as 3.10.0 set provisioning_mode to wrong value (writesame_16, disabled, full, ...) but not the correct value (unmap) so the trim feature doesn't work 6854 - @PhanLe1010 @chriscchien
• [IMPROVEMENT] Improve log level for resource update failure able to reconcile again 6843 - @PhanLe1010 @nitendra-suse
• [IMPROVEMENT] Don't log about inability to change settings that didn't change. 6812 - @james-munson @roger-ryao
• [IMPROVEMENT] Prevent unexpected engine creation 6682 - @PhanLe1010 @ejweber @roger-ryao
• [IMPROVEMENT] Support both NFS hard and soft with custom timeo and retrans options for RWX volumes 6655 - @derekbit @roger-ryao
• [IMPROVEMENT] Prevent Volume Provision if Related Backing Image Stuck in Ready-For-Trasfer State 6615 - @ChanYiLin @roger-ryao
• [IMPROVEMENT] Remove dummy services of each CSI sidecar if not required 6581 - @ejweber @roger-ryao
• [IMPROVEMENT] Include /var/log/messages during the support-bundle syslog collection 6544 - @c3y1huang @roger-ryao
• [IMPROVEMENT] Provide more information for volume scheduling failure 6461 - @smallteeths @chriscchien
• [IMPROVEMENT] Improve upgrade path and make it more solid 6294 - @PhanLe1010 @roger-ryao
• [IMPROVEMENT] Fix scheduling flooding logs 6019 - @ChanYiLin @roger-ryao
• [IMPROVEMENT] Unify logs with extra static info like module/method/function/line 5509 - @ChanYiLin @roger-ryao
• [IMPROVEMENT] Add pvc name to longhorn_volume metrics 5297 - @c3y1huang @nitendra-suse
• [IMPROVEMENT] Avoid the accident deletion of longhorn settings 4984 - @ejweber @roger-ryao
• [IMPROVEMENT] Remove Longhorn engine path mismatch log 3786 - @c3y1huang @roger-ryao

Stability

• [BUG] DR volume failed when synchronizing the incremental backup 6750 - @mantissahz @chriscchien
• [BUG] Somehow the Rebuilding field inside volume.meta is set to true when one replica only, causing the volume into attaching/detaching loop 6626 - @c3y1huang @nitendra-suse

Resilience

• [BUG][v1.4.4-rc1] rwx workload gets stuck in ContainerCreating after cluster restart 6924 - @yangchiu @derekbit
• [BUG] Volumes failing to mount because of engine upgradedReplicaAddressMap reference 6762 - @PhanLe1010 @chriscchien
• [BUG] Share manager pod will stay in IO error when the volume becomes read only 5961 - @ChanYiLin @roger-ryao

Bug

• [BUG] Longhorn storage network is incompatible with Multus version above v4.0.0 6953 - @c3y1huang
• [BUG] IO error occurs when detaching RWX volume 6829 - @derekbit @chriscchien
• [BUG] Two active engine when volume migrating 6642 - @PhanLe1010 @chriscchien
• [BUG] Longhorn Instance Manager Memory leak 6481 - @james-munson @chriscchien
• [BUG] The instance manager with state unknown will be cleaned up in the split-brain case 6479 - @shuo-wu
• [BUG] Fix errors in questions.yaml 6392 - @james-munson @chriscchien
• [BUG] Webhook is never called for BackingImageManager 6328 - @ejweber @chriscchien
• [BUG] Environment Check Script Fails To Perform All Checks 5653 - @PhanLe1010 @roger-ryao
• [BUG] Can't delete volumesnapshot if backup target not set 4979 - @ejweber @chriscchien
• [BUG] Backup Job returns "Completed" despite running into errors 4255 - @mantissahz @chriscchien
• [BUG] Error during backup process will be removed quickly without user knowing 1249 - @mantissahz @chriscchien
• [BUG] [v1.4.4-rc1] Wrong image name in uninstall manifest(uninstall job) 6895 - @innobead @chriscchien

Misc

• [TASK] Revert "Disable Automatically Delete Workload Pod when The Volume Is Detached Unexpectedly for RWX volumes" 6838 - @derekbit @roger-ryao

Contributors

• @ChanYiLin
• @PhanLe1010
• @c3y1huang
• @chriscchien
• @derekbit
• @ejweber
• @innobead
• @james-munson
• @mantissahz
• @nitendra-suse
• @roger-ryao
• @shuo-wu
• @smallteeths
• @yangchiu