Twitter Engineering

Building the world’s first real-time distributed public platform connecting people to their interests, events and each other

Twitter University
Building a culture of learning for @TwitterEng and the world at large through videos, code samples, and more.
Open Source
Twitter engineers use, contribute to and release a lot of open source software. We share what we learn with the greater community via the @TwitterOSS office.
Research
Twitter encourages publication through scientific bodies and industry standards groups. We also have a strong open source culture to share our research widely.

From the Twitter Engineering Blog

  • The what and why of product experimentation at Twitter Friday, October 23, 2015

    Experimentation is at the heart of Twitter’s product development cycle. This culture of experimentation is possible because Twitter invests heavily in tools, research, and training to ensure that feature teams can test and validate their ideas seamlessly and rigorously.

    The scale of Twitter experiments is vast both in quantity and variety — from subtle UI/UX changes, to new features, to improvements in machine learning models. We like to view experimentation as an endless learning loop:

  • Twitter goes to #GHC15 Thursday, October 22, 2015

    Every year, the Grace Hopper Celebration of Women in Computing is a wonderful gathering, and this year’s was another wildly successful turnout. Some 12,000 attendees came – a 50% increase over last year. The vibe at #GHC15 was exciting, especially for people who had never been before.

  • Hadoop filesystem at Twitter Tuesday, September 29, 2015

    Twitter runs multiple large Hadoop clusters that are among the biggest in the world. Hadoop is at the core of our data platform and provides vast storage for analytics of user actions on Twitter. In this post, we will highlight our contributions to ViewFs, the client-side Hadoop filesystem view, and its versatile usage here.

  • Building DistributedLog: Twitter’s high-performance replicated log service Wednesday, September 16, 2015

    At Twitter, we’ve used replicated logs to address a range of challenging problems in distributed systems. Today we’d like to tell you about DistributedLog, our high-performance replicated log service, and how we used it to address one of these problems.