报告题目:Towards Efficient Distributed Machine learning: A Joint Algorithm and System
Approach
报告时间:2024年1月3日(周三)上午10:00
报告地点:计算机学院一楼小米工作室
报告人:包巍
报告人国籍:中国
报告人单位:悉尼大学
报告人简介: Wei Bao received the PhD degree in Electrical and Computer Engineering from the University of Toronto, Canada, in 2016. He is currently a senior lecturer at the School of Computer Science, the University of Sydney. His research covers networking, edge computing, and distributed machine learning. He received the Best Paper Awards in ACM International Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems (MSWiM) in 2013 and 2019 and IEEE International Symposium on Network Computing and Applications (NCA) in 2016.
报告摘要: Distributed machine learning is gaining popularity due to its advantages in flexibility, scalability, and privacy. However, it inevitably causes large latency and resource waste due to geographically distributed data and heterogeneous devices. In this talk, I will present our recent research progress in addressing such issues through our joint algorithm and system designs. By simplifying AI models and developing faster convergence training algorithms, we observe significant reductions in latency and resource consumption; by coordinating computing, communication, and other resources, both model training and inference are significantly accelerated. We also adapt our design to diverse systems and fluctuating environments to maximise the potential of both algorithms and systems. I will cover several exemplary research papers, such as efficient federated learning, collaborative video analytics, and the scheduling algorithms that support them, to demonstrate the effectiveness of our designs.
邀请人:程大钊、胡创