Twitter Engineering

Building the world’s first real-time distributed public platform connecting people to their interests, events and each other

From the Twitter Engineering Blog

  • Handling five billion sessions a day – in real time Tuesday, February 17, 2015

    Since we first released Answers seven months ago, we’ve been thrilled by tremendous adoption from the mobile community. We now see about five billion sessions per day, and growing. Hundreds of millions of devices send millions of events every second to the Answers endpoint. During the time that it took you to read to here, the Answers back-end will have received and processed about 10,000,000 analytics events.

  • All about Apache Aurora Thursday, February 12, 2015

    Today we’re excited to see the Apache Aurora community announce the 0.7.0 release. Since we began development on this project, Aurora has become a critical part of how we run services at Twitter. Now a fledgling open source project, Aurora is actively developed by a community of developers running it in production.

  • Introducing practical and robust anomaly detection in a time series Tuesday, January 06, 2015

    Both last year and this year, we saw a spike in the number of photos uploaded to Twitter on Christmas Eve, Christmas and New Year’s Eve (in other words, an anomaly occurred in the corresponding time series). Today, we’re announcing AnomalyDetection, our open-source R package that automatically detects anomalies like these in big data in a practical and robust way.

  • Building a complete Tweet index Tuesday, November 18, 2014

    Today, we are pleased to announce that Twitter now indexes every public Tweet since 2006.

    Since that first simple Tweet over eight years ago, hundreds of billions of Tweets have captured everyday human experiences and major historical events. Our search engine excelled at surfacing breaking news and events in real time, and our search index infrastructure reflected this strong emphasis on recency. But our long-standing goal has been to let people search through every Tweet ever published.