Since 2010, we have offered Download Your Information to allow people who use our services to access a secure copy of the data they have shared with Facebook. In 2018, we announced our participation in the Data Transfer Project, a collaborative effort with Apple, Google, Microsoft, and Twitter to build a common way for people [...] Read More... The post Data Transfer Project: Enabling portability of photos and videos between services appeared first on Facebook Engineering.
Our family of mobile apps is used by more than 2 billion people every month — on a wide variety of mobile devices. We employ rigorous code review and testing processes, but, as with any system, software bugs still sometimes slip through and may even cause our apps to crash. Resolving these crashes and other [...] Read More... The post CCSM: Scalable statistical anomaly detection to resolve app crashes faster appeared first on Facebook Engineering.
Networking solutions are important for building applications and services that serve billions of people around the world. At this year’s Networking @Scale conference in Boston, attendees gathered to hear engineers from Akamai, Boston University, Facebook, Google, and others discuss this year’s theme of reliable networking at scale. Speakers shared challenges and solutions related to improving [...] Read More... The post Networking @Scale Boston 2019 recap appeared first on Facebook Engineering.
Earlier this year, we shared our plans to invest in new long-haul fiber to allow direct connectivity between our data centers in Ohio, Virginia, and North Carolina. This week in Beckley, West Virginia, we participated in a celebratory groundbreaking event. This new fiber route crosses West Virginia as part of the ongoing network infrastructure build [...] Read More... The post Groundbreaking event for our newest long-haul fiber route appeared first on Facebook Engineering.
Optimizing performance for internet applications can involve some intricate trade-offs. Sending too much data too quickly could incur retransmissions due to loss, which could hurt performance over time. But sending it too slowly could cause latency and stalls, which also hurt performance. In addition, different video experiences require different trade-offs for quality vs. latency. For [...] Read More... The post Evaluating COPA congestion control for improved video performance appeared first on Facebook Engineering.
Today, we joined colleagues from across the industry — including service providers, system integrators, startups, technology providers, and other ecosystem partners — for the fourth annual Telecom Infra Project (TIP) Summit in Amsterdam. At the summit, TIP demonstrated momentum on a range of initiatives including new network deployments and trials of TIP solutions such as [...] Read More... The post TIP Summit 2019: Collaborating to advance internet infrastructure appeared first on Facebook Engineering.
Nikolay Pavlovich Laptev Fred Lin Keyur Muzumdar Mihai-Valentin Curelea What the research is: A fast dimensional analysis (FDA) framework that automates root cause analysis on structured logs with improved scalability. When a failure event happens in a large-scale distributed production environment, performing root cause analysis can be challenging. Various hardware, software, and tooling logs are often maintained [...] Read More... The post Fast dimensional analysis for root cause analysis at scale appeared first on Facebook Engineering.
We run one of the largest Transport Layer Security (TLS) deployments in the world, and we are continually looking at ways to move TLS security forward. Last year, we shared how we led the deployment of TLS 1.3 on the internet as well as in our data centers. Certificates are an important element for TLS [...] Read More... The post Delegated credentials: Improving the security of TLS certificates appeared first on Facebook Engineering.
The @Scale Conference is an invitation-only technical event for engineers who work on large-scale platforms and technologies. This year’s event took place on October 16 at the San Jose Convention Center, where more than 1,300 attendees gathered to discuss how to build applications and services that scale to millions or even billions of people. The [...] Read More... The post 2019 @Scale Conference recap appeared first on Facebook Engineering.
The ACM Special Interest Group on Programming Languages (SIGPLAN) has awarded Facebook Software Engineer Simon Marlow, Microsoft Principal Researcher Simon Peyton Jones, and Google AI Software Engineer Satnam Singh the Most Influential ICFP Paper Award for their 2009 paper, “Runtime Support for Multicore Haskell.” Their work enabled the programming language Haskell to swiftly and efficiently [...] Read More... The post Simon Marlow, Simon Peyton Jones, and Satnam Singh win Most Influential ICFP Paper Award appeared first on Facebook Engineering.
The development of large-scale video systems includes complex, unprecedented engineering challenges. At Video @Scale 2019, engineers gathered in San Francisco for a day of technical talks focused on delivering video at scale. Speakers from various companies, including Amazon, Facebook, Netflix, Twitch, and YouTube, discussed video streaming, encoding, contextual ads, and more. This year’s event also [...] Read More... The post Video @Scale 2019 recap appeared first on Facebook Engineering.
We spend a lot of time thinking through the best ways to preserve privacy for the people using our services, while also combatting fraud across our platforms. We handle thousands of different types of events reported by client apps for various purposes, including investigating crashes, assessing performance, and monitoring product and advertising metrics. These events [...] Read More... The post Fighting fraud using partially blind signatures appeared first on Facebook Engineering.
Building and operating systems that serve billions of people can present unprecedented and complex engineering challenges. The second Systems @Scale event of 2019 was held in New York, where engineers gathered for a day of technical talks focused on observability: tools, techniques, and approaches that can be applied to observing the state of complex distributed [...] Read More... The post Systems @Scale 2019 New York recap appeared first on Facebook Engineering.
Our hardware infrastructure comprises millions of machines, all of which generate logs that we need to process, store, and serve. The total size of these logs is several petabytes every hour. The outputs are generally processed somewhere other than where they were generated: They can be relevant to a variety of downstream processing pipelines and [...] Read More... The post Scribe: Transporting petabytes per hour via a distributed, buffered queueing system appeared first on Facebook Engineering.
[...] Read More... The post Releasing a new benchmark and data set for evaluating neural code search models appeared first on Facebook Engineering.
What it is: Hydra is a lightweight framework that simplifies the development of Python applications, especially complex ones, by introducing the ability to compose and override configurations. Hydra makes it easier to add functionality to projects to accommodate new use cases and requirements without having to rewrite significant portions of code. Hydra also dramatically reduces the [...] Read More... The post Hydra: A framework that simplifies development of complex applications appeared first on Facebook Engineering.
The maps people use on many of our apps to shop, find jobs, support causes, and more are all powered by OpenStreetMap (OSM). OSM is a community-driven project built by mappers all over the world who contribute and maintain data about roads and locations. The OSM global copy receives up to 5 million changes every [...] Read More... The post MaRS: How Facebook keeps maps current and accurate appeared first on Facebook Engineering.
Myanmar is currently the only country in the world with a significant online presence that hasn’t standardized on Unicode, the international text encoding standard. Instead, Zawgyi is the dominant typeface used to encode Burmese language characters. This lack of a single standard has resulted in technical challenges for many companies that provide mobile apps and [...] Read More... The post Integrating autoconversion: Facebook’s path from Zawgyi to Unicode appeared first on Facebook Engineering.
Networking solutions are critical for building applications and services that serve billions of people around the world. Building and operating such large-scale networks often present complex engineering challenges to solve. At Networking @Scale 2019, attendees gathered to hear engineers from Amazon, Cloudflare, Facebook, Google, Microsoft, and Netflix discuss these challenges. This year’s conference focused on a [...] Read More... The post Networking @Scale 2019 recap appeared first on Facebook Engineering.
Registration is officially open for @Scale 2019. @Scale is an invitation-only technical conference for engineers who build or maintain large-scale systems. This year’s event will be held at the San Jose Convention Center on October 16. This year, speakers from Confluent, Google, Lyft, Microsoft, and NVIDIA will discuss how they’ve addressed some of the challenges [...] Read More... The post Register now for @Scale 2019! appeared first on Facebook Engineering.