AdaX: Adaptive Gradient Descent with Exponential Long Term Memory

Wenjie Li, Zhaoyang Zhang, Xinjiang Wang, Ping Luo
January 2020
PDF
Type
Conference paper
Publication
arXiv preprint arXiv:2004.09740