跟随,学习,进步

Facebook Code

Facebook Code - Facebook Engineering Blog

https://code.fb.com

Facebook Engineering Blog

转到作者网站

Scribe: Transporting petabytes per hour via a distributed, buffered queueing system

Our hardware infrastructure comprises millions of machines, all of which generate logs that we need to process, store, and serve. The total size of these logs is several petabytes every hour. The outputs are generally processed somewhere other than where they were generated: They can be relevant to a variety of downstream processing pipelines and [...] Read More... The post Scribe: Transporting petabytes per hour via a distributed, buffered queueing system appeared first on Facebook Engineering.


Releasing a new benchmark and data set for evaluating neural code search models

[...] Read More... The post Releasing a new benchmark and data set for evaluating neural code search models appeared first on Facebook Engineering.


Hydra: A framework that simplifies development of complex applications

What it is: Hydra is a lightweight framework that simplifies the development of Python applications, especially complex ones, by introducing the ability to compose and override configurations. Hydra makes it easier to add functionality to projects to accommodate new use cases and requirements without having to rewrite significant portions of code. Hydra also dramatically reduces the [...] Read More... The post Hydra: A framework that simplifies development of complex applications appeared first on Facebook Engineering.


MaRS: How Facebook keeps maps current and accurate

The maps people use on many of our apps to shop, find jobs, support causes, and more are all powered by OpenStreetMap (OSM). OSM is a community-driven project built by mappers all over the world who contribute and maintain data about roads and locations. The OSM global copy receives up to 5 million changes every [...] Read More... The post MaRS: How Facebook keeps maps current and accurate appeared first on Facebook Engineering.


Integrating autoconversion: Facebook’s path from Zawgyi to Unicode

Myanmar is currently the only country in the world with a significant online presence that hasn’t standardized on Unicode, the international text encoding standard. Instead, Zawgyi is the dominant typeface used to encode Burmese language characters. This lack of a single standard has resulted in technical challenges for many companies that provide mobile apps and [...] Read More... The post Integrating autoconversion: Facebook’s path from Zawgyi to Unicode appeared first on Facebook Engineering.


Networking @Scale 2019 recap

Networking solutions are critical for building applications and services that serve billions of people around the world. Building and operating such large-scale networks often present complex engineering challenges to solve. At Networking @Scale 2019, attendees gathered to hear engineers from Amazon, Cloudflare, Facebook, Google, Microsoft, and Netflix discuss these challenges. This year’s conference focused on a [...] Read More... The post Networking @Scale 2019 recap appeared first on Facebook Engineering.


Register now for @Scale 2019!

Registration is officially open for @Scale 2019. @Scale is an invitation-only technical conference for engineers who build or maintain large-scale systems. This year’s event will be held at the San Jose Convention Center on October 16.  This year, speakers from Confluent, Google, Lyft, Microsoft, and NVIDIA will discuss how they’ve addressed some of the challenges [...] Read More... The post Register now for @Scale 2019! appeared first on Facebook Engineering.


Creating a data set and a challenge for deepfakes

[...] Read More... The post Creating a data set and a challenge for deepfakes appeared first on Facebook Engineering.


Powered by AI: Oculus Insight

[...] Read More... The post Powered by AI: Oculus Insight appeared first on Facebook Engineering.


Redesigning our systems to provide more control over Off-Facebook activity

At F8 2018, we shared our plan to build a tool that would allow people to see the apps and websites that choose to share activity with us and to disconnect that activity from their accounts. Today we are beginning to roll out that tool, which is called Off-Facebook Activity. Building Off-Facebook Activity required an [...] Read More... The post Redesigning our systems to provide more control over Off-Facebook activity appeared first on Facebook Engineering.


Zoncolan: How Facebook uses static analysis to detect and prevent security issues

Facebook’s web codebase currently contains more than 100 million lines of Hack code, and changes thousands of times per day. To handle the sheer volume of code, we build sophisticated systems that help our security engineers review code. Today, we are sharing the details of one of those tools, called Zoncolan, for the first time. [...] Read More... The post Zoncolan: How Facebook uses static analysis to detect and prevent security issues appeared first on Facebook Engineering.


New advances in natural language processing

[...] Read More... The post New advances in natural language processing appeared first on Facebook Engineering.


A new model for word embeddings that are resilient to misspellings

[...] Read More... The post A new model for word embeddings that are resilient to misspellings appeared first on Facebook Code.


A new model for word embeddings that are resilient to misspellings

[...] Read More... The post A new model for word embeddings that are resilient to misspellings appeared first on Facebook Code.


Performance @Scale 2019 recap

Developing apps and services that scale to millions or billions of people can present uniquely complex performance challenges. Optimizing infrastructure, scaling web services, and developing fast mobile apps are all part of the job to keep large-scale systems performant. At this year’s event, attendees gathered to hear speakers from Facebook, Google, NVIDIA, and other companies [...] Read More... The post Performance @Scale 2019 recap appeared first on Facebook Code.


Performance @Scale 2019 recap

Developing apps and services that scale to millions or billions of people can present uniquely complex performance challenges. Optimizing infrastructure, scaling web services, and developing fast mobile apps are all part of the job to keep large-scale systems performant. At this year’s event, attendees gathered to hear speakers from Facebook, Google, NVIDIA, and other companies [...] Read More... The post Performance @Scale 2019 recap appeared first on Facebook Code.


Systems @Scale 2019 recap

Operating systems that serve millions (or even billions) of people can present unprecedented, complex engineering challenges. Last year, we launched the Systems @Scale conference to bring together engineers from various companies to discuss those challenges. At this year’s event, attendees gathered to hear speakers from Facebook, LinkedIn, Uber, and other companies discuss innovative solutions for [...] Read More... The post Systems @Scale 2019 recap appeared first on Facebook Code.


Systems @Scale 2019 recap

Operating systems that serve millions (or even billions) of people can present unprecedented, complex engineering challenges. Last year, we launched the Systems @Scale conference to bring together engineers from various companies to discuss those challenges. At this year’s event, attendees gathered to hear speakers from Facebook, LinkedIn, Uber, and other companies discuss innovative solutions for [...] Read More... The post Systems @Scale 2019 recap appeared first on Facebook Code.


Michael F. Cohen awarded 2019 Steven A. Coons award

[...] Read More... The post Michael F. Cohen awarded 2019 Steven A. Coons award appeared first on Facebook Code.


Michael F. Cohen awarded 2019 Steven A. Coons award

[...] Read More... The post Michael F. Cohen awarded 2019 Steven A. Coons award appeared first on Facebook Code.