Publications

Preprints

• Scalable Bilevel Loss Balancing for Multi-Task Learning
  Peiyao Xiao, Chaosheng Dong, Shaofeng Zou, and Kaiyi Ji. arXiv:2502.08585.

• ReGNet: Reciprocal Space-Aware Long-Range Modeling and Multi-Property Prediction for Crystals
  Jianan Nie, Peiyao Xiao, Kaiyi Ji, Peng Gao. arXiv: 2502.02748.

• Finite-Time Analysis for Conflict-Avoidant Multi-Task Reinforcement Learning
  Yudan Wang, Peiyao Xiao, Hao Ban, Kaiyi Ji, Shaofeng Zou. arXiv: 2405.16077

2023

• Direction-oriented Multi-objective Learning: Simple and Provable Stochastic Algorithms
  Peiyao Xiao, Hao Ban and Kaiyi Ji. Advances in Neural Information Processing Systems (NeurIPS) 2023.

• SimFBO: Towards Simple, Flexible and Communication-efficient Federated Bilevel Learning
  Yifan Yang, Peiyao Xiao and Kaiyi Ji. Advances in Neural Information Processing Systems (NeurIPS) 2023. (Spotlight, 3% Acceptance)

• Achieving \(\mathcal{O}(\epsilon^{−1.5})\) Complexity in Hessian/Jacobian-free Stochastic Bilevel Optimization
  Yifan Yang, Peiyao Xiao and Kaiyi Ji. Advances in Neural Information Processing Systems (NeurIPS) 2023.

• Communication-Efficient Federated Hypergradient Computation via Aggregated Iterative Differentiation
  Peiyao Xiao and Kaiyi Ji. International Conference on Machine Learning (ICML) 2023.

2025

• MGDA Converges under Generalized Smoothness, Provably
  Qi Zhang, Peiyao Xiao, Shaofeng Zou, Kaiyi Ji. International Conference on Learning Representations (ICLR) 2025.