A Learning Rate Path Switching Training Paradigm for Version Updates of Large Language Models

Zhihao Wang, Shiyu Liu, Jianheng Huang, Wang Zheng, YiXuan Liao, Xiaoxin Chen, Junfeng Yao, Jinsong Su
五月 2024
研究方向
大模型训练
出版物
In Proc. of EMNLP 2024. (CCF-B类)