Publications
See my Google Scholar for more information
Stochastic Zeroth-order Riemannian Derivative Estimation and Optimization. Jiaxiang Li, Krishnakumar Balasubramanian, Shiqian Ma. Mathematics of Operations Research, 2023 [PDF]
Federated Learning on Riemannian Manifolds. Jiaxiang Li, Shiqian Ma. Appl. Set-Valued Anal. Optim. 5 (2023), 213-232 [PDF]
A Riemannian ADMM. Jiaxiang Li, Shiqian Ma, Tejes Srivastava. Mathematics of Operations Research (Accepted) (2022) [PDF]
Zeroth-order Riemannian Averaging Stochastic Approximation Algorithms. Jiaxiang Li, Krishnakumar Balasubramanian, Shiqian Ma. SIAM Journal on Optimization 34 (4), 3314-3341 (2024) [PDF]
Riemannian Bilevel Optimization. Jiaxiang Li, Shiqian Ma. Submitted to JMLR (2024) [PDF]
Revisiting zeroth-order optimization for memory-efficient llm fine-tuning: A benchmark. Yihua Zhang*, Pingzhi Li*, Junyuan Hong*, Jiaxiang Li*, Yimeng Zhang, Wenqing Zheng, Pin-Yu Chen et al. International Conference on Machine Learning (2024) [PDF]
Getting More Juice Out of the SFT Data: Reward Learning from Human Demonstration Improves SFT for LLM Alignment. Jiaxiang Li, Siliang Zeng, Hoi-To Wai, Chenliang Li, Alfredo Garcia, Mingyi Hong. Thirty-Eighth Annual Conference on Neural Information Processing Systems (2024) [PDF]
Joint Demonstration and Preference Learning Improves Policy Alignment with Human Feedback. Chenliang Li, Siliang Zeng, Zeyi Liao, Jiaxiang Li, Dongyeop Kang, Alfredo Garcia, Mingyi Hong. (2024) [PDF]
SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining. Andi Han, Jiaxiang Li, Wei Huang, Mingyi Hong, Akiko Takeda, Pratik Jawanpuria, Bamdev Mishra. Thirty-Eighth Annual Conference on Neural Information Processing Systems (2024) [PDF]
Problem-Parameter-Free Decentralized Nonconvex Stochastic Optimization. Jiaxiang Li, Xuxing Chen, Shiqian Ma, Mingyi Hong. (2024) [PDF]
Barrier Function for Bilevel Optimization with Coupled Lower-Level Constraints: Formulation, Approximation and Algorithms. Xiaotian Jiang, Jiaxiang Li, Mingyi Hong, Shuzhong Zhang. (2024) [PDF]