June 22, 2015

Inferring Algorithmic Patterns with Stack-Augmented Recurrent Nets

ArXiv PrePrint

We develop a model that overcomes certain basic limitations of popular deep learning models. We demonstrate its capabilities by learning in an unsupervised way concepts such as simple memorization and binary addition.

Armand Joulin, Tomas Mikolov
June 22, 2015

A Theoretical Argument for Complex-Valued Convolutional Networks

ArXiv PrePrint

This article provides foundations for certain convolutional networks.

Arthur Szlam, Joan Bruna, Mark Tygert, Serkan Piantino, Soumith Chintala, Yann LeCun
June 22, 2015

End-To-End Memory Networks

NIPS 2015

End-to-end training of Memory Networks on question answering and to language modeling

Sainbayar Sukhbaatar, Arthur Szlam, Jason Weston, Rob Fergus
June 22, 2015

Learning Longer Memory in Recurrent Neural Networks

Workshop at ICLR 2015

We describe simple extension of recurrent networks that allows them to learn longer term memory. Usefulness is demonstrated in improved performance on standard language modeling tasks.

Tomas Mikolov, Armand Joulin, Sumit Chopra, Michael Mathieu, Marc'Aurelio Ranzato
June 22, 2015

Large-Scale Simple Question Answering with Memory Networks

ArXiv PrePrint

This paper studies the impact of multitask and transfer learning for simple question answering; a setting for which the reasoning required to answer is quite easy, as long as one can retrieve the correct evidence given a question, which can be difficult in large-scale conditions.

Antoine Bordes, Jason Weston, Nicolas Usunier, Sumit Chopra
June 22, 2015

Revisiting Memory Errors in Large-Scale Production Data Centers: Analysis and Modeling of New Trends from the Field

IEEE/IFIP International Conference on Dependable Systems and Networks

In this paper, we analyze the memory errors in the entire fleet of servers at Facebook over the course of fourteen months, representing billions of device days.

Justin Meza, Qiang Wu, Sanjeev Kumar, Onur Mutlu
June 22, 2015

An Implementation of a Randomized Algorithm for Principal Component Analysis

ArXiv PrePrint

This paper carefully implements newly popular randomized algorithms for principal component analysis and benchmarks them against the classics.

Arthur Szlam, Mark Tygert, Yuval Kluger
June 15, 2015

A Large-Scale Study of Flash Memory Failures in the Field

ACM Sigmetrics 2015

This paper presents the first large-scale study of flash-based SSD reliability in the field.

Justin Meza, Qiang Wu, Sanjeev Kumar, Onur Mutlu
June 12, 2015

Web-Scale Training for Face Identification

The IEEE Conference on Computer Vision and Pattern Recognition

We study face recognition and show that three distinct properties have surprising effects on the transferability of deep convolutional networks (CNN)

Yaniv Taigman, Ming Yang, Marc'Aurelio Ranzato, Lior Wolf
June 1, 2015

Beyond Frontal Faces: Improving Person Recognition Using Multiple Cues

International Conference on Computer Vision and Pattern Recognition

We propose a method for person recognition from arbitrary viewpoint and pose.

Ning Zhang, Manohar Paluri, Yaniv Taigman, Rob Fergus, Lubomir Bourdev
May 19, 2015

Challenges to Adopting Stronger Consistency at Scale

Workshop on Hot Topics in Operating Systems

There have been many recent advances in distributed systems that provide stronger semantics for geo-replicated data stores like those underlying Facebook. At Facebook we are excited by these lines of research, but fundamental and operational challenges currently make it infeasible to incorporate these advances into deployed systems. This paper describes some of these challenges with the hope that future advances will address them.

Philippe Ajoux, Nathan Bronson, Sanjeev Kumar, Wyatt Lloyd, Kaushik Veeraraghavan
May 18, 2015

Design and Analysis of Benchmarking Experiments for Distributed Internet Services

Proc. WWW

We develop statistical models of distributed Internet service performance based on data from Perflab, a production system used at Facebook which vets thousands of changes to the company’s codebase each day.

Eytan Bakshy, Eitan Frachtenberg
May 18, 2015

The Lifecycles of Apps in a Social Ecosystem

Proc. WWW'15

Apps are emerging as an important form of on-line content, and they combine aspects of Web usage in interesting ways — they exhibit a rich temporal structure of user adoption and long-term engagement, and they exist in a broader social ecosystem that helps drive these patterns of adoption and engagement. It has been difficult, however, to study apps in their natural setting since this requires a simultaneous analysis of a large set of popular apps and the underlying social network they inhabit.

Isabel Kloumann, Lada Adamic, Jon Kleinberg, Shaomei Wu
May 9, 2015

Exposure to Ideologically Diverse News and Opinion on Facebook

Science.

How do these online networks influence exposure to perspectives that cut across ideological lines?

Eytan Bakshy, Lada Adamic, Solomon Messing
May 6, 2015

Wormhole: Reliable Pub-Sub to Support Geo-replicated Internet Services

12th USENIX Symposium on Networked Systems Design and Implementation

Wormhole is a publish-subscribe (pub-sub) system developed for use within Facebook’s geographically replicated datacenters. It is used to reliably replicate changes among several Facebook services including TAO, Graph Search and Memcache. This paper describes the design and implementation of Wormhole as well as the operational challenges of scaling the system to support the multiple data storage systems deployed at Facebook.

Yogeshwer Sharma, Philippe Ajoux, Petchean Ang, David Callies, Abhishek Choudhary, Laurent Demailly, Thomas Fersch, Liat Atsmon, Andrzej Kotulski, Sachin Kulkarni, Sanjeev Kumar, Hu Li, Jun Li, Evgeniy Makeev, Kowshik Prakasam, Robbert van Renesse, Sabyasachi Roy, Pratyush Seth, Yee Jiun Song, Kaushik Veeraraghavan, Benjamin Wester, Peter Xie
March 14, 2015

The Diffusion of Support in an Online Social Movement: Evidence from the Adoption of Equal-Sign Profile Pictures

Proc. CSCW'15

In March of 2013, 3 million Facebook users changed their profile picture to one of an equals sign to express support of same-sex marriage. We demonstrate that this action shows complex diffusion characteristics congruent with threshold models, with most users observing several of their friends changing their profile picture before taking the action themselves.

Bogdan State, Lada Adamic
February 17, 2015

What Makes for Effective Detection Proposals?

PAMI

An in depth study of object proposals and their effect on object detection performance.

Bernt Schiele, Jan Hosang, Piotr Dollar, Rodrigo Benenson
February 10, 2015

Moving Fast with Software Verification

NASA Formal Method Symposium

For organisations like Facebook, high quality software is important. However, the pace of change and increasing complexity of modern code makes it difficult to produce error free software. Available tools are often lacking in helping programmers develop more reliable and secure applications.

Cristiano Calcagno, Dino Distefano, Jeremy Dubreil, Dominik Gabi, Pieter Hooimeijer, Martino Luca, Peter O'Hearn, Irene Papakonstantinou, Jim Purbrick, Dulma Churchill
December 19, 2014

Predicting the Quality of New Contributors to the Facebook Crowdsourcing System

Neural Information Processing Systems: Crowdsourcing and Machine Learning Workshop

We are interested in improving the quality and coverage of a knowledge graph through crowdsourcing features built into a social networking service. This work presents an approach to model user trust when prior history is lacking.

Julian Eisenschlos
December 19, 2014

Video (language) Modeling: a Baseline for Generative Models of Natural Videos

ArXiv PrePrint

In this work, we investigate models of natural high-resolution video sequences. We show that very simple models borrowed by language modeling applications are surprisingly effective at recovering shor…

Arthur Szlam, Joan Bruna, Marc'Aurelio Ranzato, Michael Mathieu, Ronan Collobert, Sumit Chopra