AdamE optimizer with decoupled L1 and L2 regularization#1314

Draft

vincenzo-scotti wants to merge 10 commits intobitsandbytes-foundation:mainfrom vincenzo-scotti:dev-adame

Commits on Aug 11, 2024

Commits on Sep 5, 2024

Update base optimizers and AdamE to handle constant regularization learning rate
vincenzo-scotti
committed
Update C++/CUDA code to include separate regularization learning rate
vincenzo-scotti
committed