QuZO: Quantized Zeroth-Order Fine-Tuning for Large Language Models EMNLP

Jiajun Zhou | Yifan Yang | Kai Zhen | Ziyue Liu | Yequan Zhao | Ershad Banijamali | Athanasios Mouchtaris | Ngai Wong | Zheng Zhang |

CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation EMNLP

Ziyue Liu | Ruijie Zhang | Zhengyang Wang | Mingsong Yan | Zi Yang | Paul D. Hovland | Bogdan Nicolae | Franck Cappello | Sui Tang | Zheng Zhang |