👋 About Me

I am Shengye Song, a PhD Candidate in the School of Computer Science, Nanjing University, where I am a member of the LANDS Group.

I am advised by Prof. Rong Gu.

Previously, I received my Master’s degree in Computer Technology from SIAT and SUSTech, where I worked with Prof. Minxian Xu and Prof. Kejiang Ye.

My research lies at the intersection of AI systems and distributed systems, with a focus on:

  • Efficient LLM inference and serving
  • Distributed systems for large-scale AI workloads
  • AI infrastructure and system performance optimization

More broadly, I am interested in designing efficient, scalable, and production-ready AI systems that bridge cutting-edge research and real-world deployment. 📊 My publications have received


💬 Collaboration

I am always interested in collaborating on research related to AI systems, LLM inference, and distributed systems!


🔥 News

  • 2026.02: 🎉 Our paper “C-Koordinator” is accepted by Software: Practice and Experience (SPE, CCF-B).
  • 2025.10: 🎉 Our paper “TD3-Sched” is accepted by PDCAT 2025.
  • 2025.09: 🎉 Our paper “BucketServe” is accepted by SmartData 2025.
  • 2024.03: 🎉 Our patent on interference elimination is officially granted.

📝 Publications

  •   PDCAT ‘25   TD3-Sched: Decentralized Edge-Aware Reinforcement Learning for Resource Scheduling in Cloud-Edge Collaborative Clusters.
    📄 Paper
    • Shengye Song, Kan Hu, Minxian Xu, Wenxian Guo, Kejiang Ye
  •   SmartData ‘25   BucketServe: Bucket-Based Dynamic Batching for Smart and Efficient LLM Inference Serving.
    📄 Paper
    • Wanyi Zheng, Minxian Xu, Shengye Song, Kejiang Ye
  •   SPE   C-Koordinator: Interference-aware Management for Large-scale and Co-located Microservice Clusters, CCF-B.
    📄 Paper
    • Shengye Song, Minxian Xu, Zuowei Zhang, Chengxi Gao, Fansong Zeng, Yu Ding, Kejiang Ye, Chengzhong Xu

🧪 Patents

  • An Offline Interference Elimination Method, Device, Computer Equipment, and Storage Medium
    Shengye Song (et al.)
    Patent No.: CN117349037B

📰 Preprints

(To be updated)


🎖 Honors and Awards

  • 2025.08 First Prize, CCF Digital Services Conference
  • 2025.11 Best Paper Award, SmartData 2025

📖 Education

  • 2026.09 - Present
    Nanjing University (NJU), China
    Ph.D. Candidate in Computer Science

  • 2023.09 - 2026.06
    Shenzhen Institutes of Advanced Technology (SIAT), Chinese Academy of Sciences & Southern University of Science and Technology (SUSTech)
    M.S. in Computer Technology

  • 2018.09 - 2022.06
    University of Electronic Science and Technology of China (UESTC)
    B.S. in Industrial Engineering


💻 Experience

  • 2023.11 - 2024.10
    Alibaba Cloud (Remote Research Intern)

🌍 Visitors