Twitter Engineering

Building the world’s first real-time distributed public platform connecting people to their interests, events and each other

From the Twitter Engineering Blog

  • Graduating Apache Parquet Thursday, May 21, 2015

    ASF, the Apache Software Foundation, recently announced the graduation of Apache Parquet, a columnar storage format for the Apache Hadoop ecosystem. At Twitter, we’re excited to be a founding member of the project.

  • Building a new trends experience Friday, April 24, 2015

    We recently launched a new trends experience on mobile and web. Certain users will now see additional context with their trends: a short description and at times an accompanying image. While building this new product experience, we also switched the entire trends backend system to a brand new platform. This is the largest engineering undertaking of the trends system since 2008.

  • Another look at MySQL at Twitter and incubating Mysos Thursday, April 16, 2015

    While we’re at the Percona Live MySQL Conference, we’d like to discuss updates on how Twitter uses MySQL, as well as share our plans to open source Mysos, a new MySQL on Apache Mesos framework.

  • Handling five billion sessions a day – in real time Tuesday, February 17, 2015

    Since we first released Answers seven months ago, we’ve been thrilled by tremendous adoption from the mobile community. We now see about five billion sessions per day, and growing. Hundreds of millions of devices send millions of events every second to the Answers endpoint. During the time that it took you to read to here, the Answers back-end will have received and processed about 10,000,000 analytics events.