Twitter Engineering

Building the world’s first real-time distributed public platform connecting people to their interests, events and each other

From the Twitter Engineering Blog

  • Twitter #DataGrants selections Thursday, April 17, 2014
    Learn more about the six institutions we've selected to receive Twitter #DataGrants.
  • Scalding 0.9: Get it while it’s hot! Thursday, April 03, 2014

    It’s been just over two years since we open sourced Scalding and today we are very excited to release the 0.9 version. Scalding at Twitter powers everything from internal and external facing dashboards, to custom relevance and ad targeting algorithms, including many graph algorithms such as PageRank, approximate user cosine similarity and many more.

    There have been a wide breadth of new features added to Scalding since the last release:

  • Manhattan, our real-time, multi-tenant distributed database for Twitter scale Wednesday, April 02, 2014
    Twitter has unique and intensive storage requirements. We built a database, called Manhattan, that meets those requirements and allows self-service access for our engineers.
  • Greater privacy for your Twitter emails with TLS Wednesday, March 12, 2014

    Protecting users’ privacy is a never-ending process, and we are committed to keeping our users’ information safe. Since mid-January, we have been protecting your emails from Twitter using TLS in the form of StartTLS. StartTLS encrypts emails as they transit between sender and receiver and is designed to prevent snooping.