Publications

Preprints

• Scalable Bilevel Loss Balancing for Multi-Task Learning
  Peiyao Xiao, Chaosheng Dong, Shaofeng Zou, and Kaiyi Ji. arXiv:2502.08585.

• ReciNet: Reciprocal Space-Aware Long-Range Modeling for Crystalline Property Prediction
  Jianan Nie, Peiyao Xiao, Kaiyi Ji, Peng Gao. arXiv: 2502.02748.

2023

• Direction-oriented Multi-objective Learning: Simple and Provable Stochastic Algorithms
  Peiyao Xiao, Hao Ban and Kaiyi Ji. Advances in Neural Information Processing Systems (NeurIPS) 2023.

• SimFBO: Towards Simple, Flexible and Communication-efficient Federated Bilevel Learning
  Yifan Yang, Peiyao Xiao and Kaiyi Ji. Advances in Neural Information Processing Systems (NeurIPS) 2023. (Spotlight, 3% Acceptance)

• Achieving \(\mathcal{O}(\epsilon^{−1.5})\) Complexity in Hessian/Jacobian-free Stochastic Bilevel Optimization
  Yifan Yang, Peiyao Xiao and Kaiyi Ji. Advances in Neural Information Processing Systems (NeurIPS) 2023.

• Communication-Efficient Federated Hypergradient Computation via Aggregated Iterative Differentiation
  Peiyao Xiao and Kaiyi Ji. International Conference on Machine Learning (ICML) 2023.

2025

• MGDA Converges under Generalized Smoothness, Provably
  Qi Zhang, Peiyao Xiao, Shaofeng Zou, Kaiyi Ji. International Conference on Learning Representations (ICLR) 2025.

• First-Order Federated Bilevel Learning
  Yifan Yang, Peiyao Xiao, Shiqian Ma, Kaiyi Ji. Proceedings of the AAAI Conference on Artificial Intelligence (AAAI) 2025

• Theoretical study of conflict-avoidant multi-objective reinforcement learning
  Yudan Wang, Peiyao Xiao, Hao Ban, Kaiyi Ji, Shaofeng Zou. IEEE Transactions on Information Theory