December 12, 2017

Supporting Diverse Dynamic Intent-based Policies using Janus

International Conference on emerging Networking EXperiments and Technologies (CoNEXT)

In this paper we propose Janus, a system which makes two major contributions to network policy abstractions. First, we extend the prior policy graph abstraction model to represent complex QoS and dynamic stateful/temporal policies. Second, we convert the policy configuration problem into an optimization problem with the goal of maximizing the number of satisfied and configured policies, and minimizing the number of path changes under dynamic environments.

Anubhavnidhi Abhashkumar, Joon-Myung Kang, Sujata Banerjee, Aditya Akella, Ying Zhang, Wenfei Wu
November 1, 2017

High-Resolution Measurement of Data Center Microbursts

ACM Internet Measurement Conference

In this study, we explore the fine-grained behaviors of a large production data center using extremely highresolution measurements (10s to 100s of microsecond) of rack-level traffic. Our results show that characterizing network events like congestion and synchronized behavior in data centers does indeed require the use of such measurements.

Qiao Zhang, Vincent Liu, James Hongyi Zeng, Arvind Krishnamurthy
November 1, 2017

An Empirical Characterization of IFTTT: Ecosystem, Usage, and Performance

ACM Internet Measurement Conference 2017

IFTTT is a popular trigger-action programming platform whose applets can automate more than 400 services of IoT devices and web applications. We conduct an empirical study of IFTTT using a combined approach of analyzing data collected for 6 months and performing controlled experiments using a custom testbed.

Xianghang Mi, Feng Qian, Ying Zhang, XiaoFeng Wang
October 30, 2017

Crowd Intelligence Enhances Automated Mobile Testing

Automated Software Engineering Conference (ASE)

In this paper we show that information extracted from crowdbased testing can enhance automated mobile testing and introduce POLARIZ, which generates replicable test scripts from crowd-based testing, extracting cross-app ‘motif’ events.

Ke Mao, Mark Harman, Yue Jia
October 29, 2017

SVE: Distributed Video Processing at Facebook Scale

Symposium on Operating Systems Principles (SOSP)

This paper describes the evolution from our initial monolithic encoding script (MES) system to our current Streaming Video Engine (SVE) to upload and process videos. SVE has been in production since the fall of 2015, provides lower latency than MES, supports many diverse video applications, and has proven to be reliable despite faults and overload.

Qi Huang, Petchean Ang, Peter Knowles, Tomasz Nykiel, Iaroslav Tverdokhlib, Amit Yajurvedi, Paul Dapolito IV, Xifan Yan, Maxim Bykov, Chuen Liang, Mohit Talwar, Abhishek Mathur, Sachin Kulkarni, Matthew Burke, Wyatt Lloyd
October 28, 2017

Canopy: An End-to-End Performance Tracing and Analysis System

Symposium on Operating Systems Principles (SOSP)

This paper presents Canopy, Facebook’s end-to-end performance tracing infrastructure. Using Canopy, Facebook engineers can query and analyze performance data in real-time.

Jonathan Kaldor, Jonathan Mace, Michał Bejda, Edison Gao, Wiktor Kuropatwa, Joe O’Neill, Kian Win Ong, Bill Schaller, Pingjia Shan, Brendan Viscomi, Vinod Venkataraman, Kaushik Veeraraghavan, Yee Jiun Song
September 20, 2017

Characterizing Large-Scale Production Reliability for 100G Optical Interconnect in Facebook Data Centers

Frontiers in Optics / Laser Science (FiO/LS)

Facebook is deploying cost effective 100G CWDM4 transceivers in data centers. This paper describes the post production performance monitoring system which is being implemented to identify optical interconnect early failure modes.

Abhijit Chakravarty, Srinivasan Giridharan, Matt Kelly, Ashwin Poojary, Vincent Zeng
September 20, 2017

100Gb/s CWDM4 Optical Interconnect at Facebook Data Centers for Bandwidth Enhancement

Frontiers in Optics / Laser Science (FiO/LS)

Facebook has developed 100G data centers from the ground-up by fine tuning optical technologies, optimizing link-budget, limiting operating temperatures and ultimately improving manufacturability. 100G-CWDM4 is an effective technology to enable connectivity over duplex single-mode fiber.

Abhijit Chakravarty, Katharine Schmidtke, Vincent Zeng, Srinivasan Giridharan, Cathie Deal, Reza Niazmand
September 17, 2017

Passive Realtime Datacenter Fault Detection and Localization

USENIX ;login:

In this article, we present our passive hybrid approach that combines network path information with end-host-based statistics to rapidly detect and pinpoint the location of datacenter network faults inside a production Facebook datacenter.

Arjun Roy, James Hongyi Zeng, Jasmeet Bagga, Alex C. Snoeren
August 28, 2017

Social Hash Partitioner: A Scalable Distributed Hypergraph Partitioner

Very Large Data Bases Conference (VLDB)

We design and implement a distributed algorithm for balanced k-way hypergraph partitioning that minimizes fanout, a fundamental hypergraph quantity also known as the communication volume and (k − 1)-cut metric, by optimizing a novel objective called probabilistic fanout. This choice allows a simple local search heuristic to achieve comparable solution quality to the best existing hypergraph partitioners.

Igor Kabiljo, Brian Karrer, Mayank Pundir, Sergey Pupyrev, Alon Shalita
August 21, 2017

Engineering Egress with Edge Fabric: Steering Oceans of Content to the World


This paper presents Edge Fabric, an SDN-based system we built and deployed to tackle the challenges of point presence for Facebook, which serves over two billion users from dozens of points of presence on six continents.

Brandon Schlinker, Ethan Katz-Bassett, Harsha V. Madhyastha, Hyojeong Kim, Italo Cunha, James Hongyi Zeng, James Quinn, Petr Lapukhov, Saif Hasan, Timothy Cui
August 21, 2017

SilkRoad: Making Stateful Layer-4 Load Balancing Fast and Cheap Using Switching ASICs

Association for Computing Machinery's Special Interest Group on Data Communications (SIGCOMM)

In this paper, we show that up to hundreds of software load balancer (SLB) servers can be replaced by a single modern switching ASIC, potentially reducing the cost of load balancing by over two orders of magnitude. Today, large data centers typically employ hundreds or thousands of servers to load-balance incoming traffic over application servers.

Rui Miao, James Hongyi Zeng, Changhoon Kim, Jeongkeun Lee, Minlan Yu
May 30, 2017

International Image Sensors Workshop

International Image Sensor Workshop (IISW)

In this paper, we provide examples of some tracking and mapping functions of virtual reality sensors that illustrate the critical requirements and performance metrics. The sensor performance, form factor, power, and data bandwidth are the main challenges in a battery powered, always on VR devices.

Chiao Liu, Michael Hall, Renzo De Nardi, Nicholas Trail, Richard Newcombe
April 27, 2017

Passive Realtime Datacenter Fault Detection

USENIX Symposium on Networked Systems Design and Implementation (NSDI) 2017

We describe how to expedite the process of detecting and localizing partial datacenter faults using an end-host method generalizable to most datacenter applications.

Arjun Roy, James Hongyi Zeng, Jasmeet Bagga, Alex C. Snoeren
April 19, 2017

Joint User-Entity Representation Learning for Event Recommendation in Social Network

2017 IEEE 33rd International Conference on Data Engineering (ICDE)

In this work, we consider the heavy sparseness in both user and event feedback history caused by short lifespans (transiency) of events and user participation patterns in a production event system. We propose to solve the resulting cold-start problems by introducing a joint representation model to project users and events into the same latent space.

Lijun Tang, Eric Yi Liu
April 1, 2017

Spinner: Scalable Graph Partitioning in the Cloud

IEEE International Conference on Data Engineering (ICDE)

In this paper, we present a graph partitioning algorithm to partition graphs with trillions of edges.

Claudio Martella, Dionysios Logothetis, Andreas Loukas, Georgos Siganos
February 4, 2017

Optimizing Function Placement for Large-Scale Data-Center Applications

International Symposium on Code Generation and Optimization (CGO)

We study the impact of function placement in the context of a simple tool we created that uses sample-based profiling data.

Guilherme Ottoni, Bertrand Maher
January 8, 2017

Optimizing Space Amplification in RocksDB

CIDR 2017

RocksDB is an embedded, high-performance, persistent key-value storage engine developed at Facebook.

Siying Dong, Mark Callaghan, Leonidas Galanis, Dhruba Borthakur, Tony Savor, Michael Stumm
November 16, 2016

Performance or Capacity? Different Approaches for Different Tasks

International Conference for Performance and Capacity (CMGimPACt)

Measurement and aggregation approaches that are used in performance monitoring are not always useful for capacity planning, while approaches that we use in capacity planning are often meaningless for performance analysis. This paper explores this gap and discusses ways to reconcile the two tasks.

Alexander Gilgur, Steve Politis
November 13, 2016

Continuous Deployment of Mobile Software at Facebook (Showcase)

ACM SIGSOFT: International Symposium on the Foundations of Software Engineering (FSE 2016)

This paper describes in detail the software update mobile deployment process at Facebook.

Chuck Rossi, Elisa Shibley, Shi Su, Kent Beck, Tony Savor, Michael Stumm