Distributed mirror descent method for multi-agent optimization with delay

详细信息    查看全文

• 作者：Jueyou Li^a ; ^b ; ^{lijueyou@163.com" class="auth_mail" title="E-mail the corresponding author}Author Vitae ; Guo Chen^b ; ^{guo.chen@sydney.edu.au" class="auth_mail" title="E-mail the corresponding author}Author Vitae ; Zhaoyang Dong^b ; ^{joe.dong@sydney.edu.au" class="auth_mail" title="E-mail the corresponding author}Author Vitae ; Zhiyou Wu^a ; ^{zywu@cqnu.edu.cn" class="auth_mail" title="E-mail the corresponding author}Author Vitae
• 关键词：Delayed gradient ; Multi-agent network ; Distributed algorithm ; Mirror descent ; Convex optimization
• 刊名：Neurocomputing
• 出版年：2016
• 出版时间：12 February 2016
• 年：2016
• 卷：177
• 期：Complete
• 页码：643-650
• 全文大小：556 K

文摘

This paper investigates a distributed optimization problem associated a time-varying multi-agent network with the presence of delays, where each agent has local access to its convex objective function, and cooperatively minimizes a sum of convex objective functions of the agents over the network. Based on the mirror descent method, we develop a distributed algorithm to solve this problem by exploring the delayed gradient information. Furthermore, we analyze the effects of delayed gradients on the convergence of the algorithm and provide an explicit bound on the convergence rate as a function of the delay parameter, the network size and topology. Our results show that the delays are asymptotically negligible for smooth problems. The proposed algorithm can be viewed as a generalization of the distributed gradient-based projection methods since it utilizes a customized Bregman divergence instead of the usual Euclidean squared distance. Finally, some simulation results on a logistic regression problem are presented to demonstrate the effectiveness of the algorithm.