I am a Research Scientist in the Facebook AI Research group. I am currently on leave from McGill University where I am an Associate Professor of Electrical and Computer Engineering. I received a Masters from Rice University in 2003 and a PhD from the University of Wisconsin in 2006, both under the supervision of Robert Nowak.
Interests
Optimization, machine learning, parallel algorithms, graphs and networks, signal processing.
Related Links
Latest Publications
MLSys - April 8, 2021
CPR: Understanding and Improving Failure Tolerant Training for Deep Learning Recommendation with Partial Recovery
Kiwan Maeng, Shivam Bharuka, Isabel Gao, Mark C. Jeffrey, Vikram Saraph, Bor-Yiing Su, Caroline Trippel, Jiyan Yang, Mike Rabbat, Brandon Lucia, Carole-Jean Wu
CDC - December 14, 2020
Stability of Decentralized Gradient Descent in Open Multi-Agent Systems
Julien M. Hendrickx, Mike Rabbat
ICASSP - May 4, 2020
Lookahead converges to stationary points of smooth non-convex functions
Jianyu Wang, Vinayak Tantia, Nicolas Ballas, Mike Rabbat
ICLR - April 26, 2020
SlowMo: Improving Communication-Efficient Distributed SGD with Slow Momentum
Jianyu Wang, Vinayak Tantia, Nicolas Ballas, Mike Rabbat
NeurIPS - December 9, 2019
Gossip-based Actor-Learner Architectures for Deep Reinforcement Learning
Mahmoud Assran, Joshua Romoff, Nicolas Ballas, Joelle Pineau, Mike Rabbat
Workshop on ML for Systems at NeurIPS - November 30, 2019
MVFST-RL: An Asynchronous RL Framework for Congestion Control with Delayed Actions
Viswanath Sivakumar, Tim Rocktäschel, Alexander H. Miller, Heinrich Küttler, Nantas Nardelli, Mike Rabbat, Joelle Pineau, Sebastian Riedel
ICML - June 10, 2019
Stochastic Gradient Push for Distributed Deep Learning
Mahmoud Assran, Nicolas Loizou, Nicolas Ballas, Mike Rabbat
IEEE ICASSP - May 12, 2019
Provably Accelerated Randomized Gossip Algorithms
Nicolas Loizou, Mike Rabbat, Peter Richtárik
IEEE Signal Processing Magazine - May 1, 2019
Learning graphs from data: A signal representation perspective
Xiaowen Dong, Dorina Thanou, Mike Rabbat, Pascal Frossard
Proceedings of the IEEE - May 15, 2018
Network Topology and Communication-Computation Tradeoffs in Decentralized Optimization
Angelica Nedic, Alex Olshevsky, Mike Rabbat