Machine Learning at Facebook: Understanding Inference at the Edge

This paper takes a data-driven approach to present the opportunities and design challenges faced by Facebook in order to enable machine learning inference locally on smartphones and other edge platforms.