Publications
See my Google Scholar for more information
Journals
Stochastic Zeroth-order Riemannian Derivative Estimation and Optimization. Jiaxiang Li, Krishnakumar Balasubramanian, Shiqian Ma. Mathematics of Operations Research 48.2 (2023): 1183-1211 [PDF]
Federated Learning on Riemannian Manifolds. Jiaxiang Li, Shiqian Ma. Appl. Set-Valued Anal. Optim. 5 (2023), 213-232 [PDF]
A Riemannian ADMM. Jiaxiang Li, Shiqian Ma, Tejes Srivastava. Mathematics of Operations Research (Accepted) (2024) [PDF]
Zeroth-order Riemannian Averaging Stochastic Approximation Algorithms. Jiaxiang Li, Krishnakumar Balasubramanian, Shiqian Ma. SIAM Journal on Optimization 34 (4), 3314-3341 (2024) [PDF]
Riemannian Bilevel Optimization. Jiaxiang Li, Shiqian Ma. Journal of Machine Learning Research (Accepted) (2024) [PDF]
Problem-Parameter-Free Decentralized Nonconvex Stochastic Optimization. Jiaxiang Li, Xuxing Chen, Shiqian Ma, Mingyi Hong. Pacific Journal of Optimization (Accepted) (2024) [PDF]
A Barrier Function Approach for Bilevel Optimization with Coupled Lower-Level Constraints Formulation, Approximation and Algorithms. Xiaotian Jiang, Jiaxiang Li, Mingyi Hong, Shuzhong Zhang. Submitted (2024) [PDF]
Conferences
Revisiting zeroth-order optimization for memory-efficient llm fine-tuning: A benchmark. Yihua Zhang*, Pingzhi Li*, Junyuan Hong*, Jiaxiang Li*, Yimeng Zhang, Wenqing Zheng, Pin-Yu Chen et al. ICML 2024 [PDF]
Getting More Juice Out of the SFT Data: Reward Learning from Human Demonstration Improves SFT for LLM Alignment. Jiaxiang Li, Siliang Zeng, Hoi-To Wai, Chenliang Li, Alfredo Garcia, Mingyi Hong. NeurIPS 2024 [PDF]
Joint Demonstration and Preference Learning Improves Policy Alignment with Human Feedback. Chenliang Li, Siliang Zeng, Zeyi Liao, Jiaxiang Li, Dongyeop Kang, Alfredo Garcia, Mingyi Hong. ICLR 2025 (Spotlight) [PDF]
SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining. Andi Han, Jiaxiang Li, Wei Huang, Mingyi Hong, Akiko Takeda, Pratik Jawanpuria, Bamdev Mishra. NeurIPS 2024 [PDF]