跟随,学习,进步

Facebook Code

Facebook Code - Facebook Engineering Blog

https://code.fb.com

Facebook Engineering Blog

转到作者网站

Facebook, Carnegie Mellon build first AI that beats pros in 6-player poker

[...] Read More... The post Facebook, Carnegie Mellon build first AI that beats pros in 6-player poker appeared first on Facebook Code.


OIL+VCache: File abstraction for distributed systems

For years, developers have open()ed a file, write()n to it, then read() from it on a local filesystem. In distributed systems, however, these actions involve multiple processes across different hosts at different places in the network. Each of these hosts — or the network itself — could fail independently and unexpectedly. How should a storage [...] Read More... The post OIL+VCache: File abstraction for distributed systems appeared first on Facebook Code.


OIL+VCache: File abstraction for distributed systems

For years, developers have open()ed a file, write()n to it, then read() from it on a local filesystem. In distributed systems, however, these actions involve multiple processes across different hosts at different places in the network. Each of these hosts — or the network itself — could fail independently and unexpectedly. How should a storage [...] Read More... The post OIL+VCache: File abstraction for distributed systems appeared first on Facebook Code.


DLRM: An advanced, open source deep learning recommendation model

[...] Read More... The post DLRM: An advanced, open source deep learning recommendation model appeared first on Facebook Code.


Neural Code Search: ML-based code search using natural language queries

[...] Read More... The post Neural Code Search: ML-based code search using natural language queries appeared first on Facebook Code.


Aria Presto: Making table scan more efficient

The Aria is a set of initiatives to dramatically increase PrestoDB efficiency. Our goal is to achieve a 2-3x decrease in CPU time for Hive queries against tables stored in ORC format. For Aria, We are pursuing improvements in three areas: table scan, repartitioning (exchange, shuffle), and hash join. Nearly 60 percent of our global [...] Read More... The post Aria Presto: Making table scan more efficient appeared first on Facebook Code.


Delos: Simple, flexible storage for the Facebook control plane

At today’s Systems @Scale conference, we presented Delos, a fundamentally new architecture for building replicated storage systems. Its modular, layered design provides flexibility and simplicity without sacrificing performance or reliability. Delos enables fast time-to-deployment for new storage systems — we deployed an initial version in production within eight months — as well as safe, rapid [...] Read More... The post Delos: Simple, flexible storage for the Facebook control plane appeared first on Facebook Code.


Efficient, reliable cluster management at scale with Tupperware

By Kenny Yu     Chunqiang (CQ) Tang At today’s Systems @Scale conference, we presented Tupperware, our cluster management system, which orchestrates containers on millions of servers to run nearly all of our services. Since we first deployed Tupperware in 2011, our infrastructure has expanded from one data center to a fleet of 15 geo-distributed data [...] Read More... The post Efficient, reliable cluster management at scale with Tupperware appeared first on Facebook Code.


Building Facebook’s service encryption infrastructure

We run one of the largest microservices deployments in the world, with thousands of services that perform billions of requests per second. Keeping information secure as these services communicate globally is a complex job that requires thoughtful consideration of tradeoffs between performance, security, and operability. We are sharing new details about how we designed our [...] Read More... The post Building Facebook’s service encryption infrastructure appeared first on Facebook Code.


Extending DHCPLB: The path from load balancer to server

By Pablo Mazzini DHCP is the network management protocol we use for provisioning servers in our production data centers. We use it for bare metal provisioning (to install the operating system) and to assign IP addresses to out-of-band management interfaces. As traffic demands have grown, production engineers have evolved our DHCP infrastructure to make it [...] Read More... The post Extending DHCPLB: The path from load balancer to server appeared first on Facebook Code.


Releasing Pythia for vision and language multimodal AI models

What it is: Pythia is a deep learning framework that supports multitasking in the vision and language domain. Built on our open-source PyTorch framework, the modular, plug-and-play design enables researchers to quickly build, reproduce, and benchmark AI models. Pythia is designed for vision and language tasks, such as answering questions related to visual data and [...] Read More... The post Releasing Pythia for vision and language multimodal AI models appeared first on Facebook Code.


Facebook joins new Urban Computing Foundation

By Michael Cheng As part of Facebook’s long-standing commitment to open standards and the open source community, we have shared data sets and models to help global organizations. We are using our expertise — including a predictive model for mapping electrical grids, disaster maps , and more accurate population density maps — to improve access [...] Read More... The post Facebook joins new Urban Computing Foundation appeared first on Facebook Code.


F8 2019 Day 2 keynote and session videos

At F8 2019 day 2, topics included a new method for computer vision, new techniques for self-supervised learning, and a new framework for inclusive AR/VR. Watch the video of the keynote address and summaries of several of the technical sessions. This post will update as session videos are available Keynote address Chief Technology Officer Mike [...] Read More... The post F8 2019 Day 2 keynote and session videos appeared first on Facebook Code.


Open source at F8 2019

At F8, Facebook’s annual conference, we open-sourced tools and frameworks that simplify machine learning experimentation and optimization, speed up test execution times, and help solve memory-related performance issues. See the full list below, and click through to get started with our latest releases. Ax Ax is an accessible, general-purpose adaptive experimentation platform for managing, deploying, [...] Read More... The post Open source at F8 2019 appeared first on Facebook Code.


F8 2019 Day 1 keynote and session videos

Today, we kicked off F8 2019. Thousands of attendees gathered in San Jose to learn about our latest plans, research, tools, and open source releases. Topics included ensuring Messenger and WhatsApp are the fast, secure, private centers of your social experience; making Communities as central as friends in Facebook; making commerce thrive in Instagram; and [...] Read More... The post F8 2019 Day 1 keynote and session videos appeared first on Facebook Code.


Open-sourcing F14 for faster, more memory-efficient hash tables

Hash tables provide a fast way to maintain a set of keys or map keys to values, even if the keys are objects, like strings. They are such a ubiquitous tool in computer science that even incremental improvements can have a large impact. The potential for optimization led to a proliferation of hash table implementations [...] Read More... The post Open-sourcing F14 for faster, more memory-efficient hash tables appeared first on Facebook Code.


F8 2019 speakers and sessions now available

The session list is now available for F8, Facebook’s annual conference, being held April 30 and May 1, 2019, in San Jose, California. This year, we’ll celebrate the developers, creators, entrepreneurs, and innovators building on our platform and showcase how social technologies can enable the best of what people can do together. Technical sessions will [...] Read More... The post F8 2019 speakers and sessions now available appeared first on Facebook Code.


Faster input events with Facebook’s first browser API contribution

The time it takes for an interaction to go from the user input event (such as clicking a button or typing in a box) that triggered it to being completely rendered is an important web metric. At Facebook, we measure events at four stages: the moment the operating system gets the input, the moment we [...] Read More... The post Faster input events with Facebook’s first browser API contribution appeared first on Facebook Code.


Improving scene understanding through panoptic segmentation

What the research is: A new approach to object recognition that uses a single neural network to simultaneously recognize distinct foreground objects, such as animals or people (a task called instance segmentation), while also labeling pixels in the image background with classes, such as road, sky, or grass (a task called semantic segmentation). While previous [...] Read More... The post Improving scene understanding through panoptic segmentation appeared first on Facebook Code.


Aroma: Using machine learning for code recommendation

Thousands of engineers write the code to create our apps, which serve billions of people worldwide. This is no trivial task—our services have grown so diverse and complex that the codebase contains millions of lines of code that intersect with a wide variety of different systems, from messaging to image rendering. To simplify and speed [...] Read More... The post Aroma: Using machine learning for code recommendation appeared first on Facebook Code.