The US Library Of Congress Undertakes Massive Project To Archive All Tweets [Updates]

Ads by Google

There’s a story in each 140 character tweet we send out. Collect 400 million of them each day, and you have the story of a country. The Library of Congress certainly thinks so, as it sets about archiving the millions of tweets sent by Americans each day. The Library of Congress is the oldest federal cultural institution in the United States and the de facto guardian of the ‘American memory’, covering the nation’s cultural contributions for more than two centuries. In April 2010, Twitter signed a deal with the LOC giving it access to tweets dating back to the beginning of tweeting. Now they are continually archiving the data.

That’s where the challenge for the Library lies. Though it maintains archives of millions of books and even massive digital collection, keeping pace with the 200 million users and half-a-billion tweets per day is an overwhelming task.

Gayle Osterberg, director of communications at the library says,

“An element of our mission at the Library of Congress is to collect the story of America, and to acquire collections that will have research value.”

An example is the tweet sent out by President Barack Obama after his historic November 2008 election victory which read, “We just made history. All of this happened because you gave your time, talent and passion. All of this happened because of you. Thanks.”

Image Credit: Wikimedia Commons

The work is being done by Gnip, a social media aggregation company which has made more than 133,000 gigabytes of storage space available. The intent is to allow researchers easy access to search and cite the data. But ironically, technology is not up to scratch yet. Presently, a search among the first four years of tweets, from 2006 to 2010, could take about 24 hours.

If you have privacy concerns, please note that deleted tweets and accounts locked as private will not be among those archived by the Library of Congress.

Source: The Telegraph

Comments (19)
  • Carol Wilkerson

    My first thought was “How will they weed out the superfluous from the valuable?”. And, how do you determine value. I assume it will be a compilation of words with filters of sorts. No matter what, it’s an honorable endeavor.

    • Saikat Basu

      Human communication is still evolving and just like the cave paintings of old, Twitter and other forms of social media are also part of it. If we take the example of events like the Egyptian revolution or the Jasmine revolution just before it, Twitter had a massive impact. So, the endevour could be to capture these historic events and store them for posterity.

  • Shane Harris

    I am excited about this. It will be a great source for future Fall of the American Empire books.

  • Max

    Yeah, this is crazy all right. Cool, but crazy.

    • Elizabeth

      Meanwhile, in more pressing matters our government should be addressing… unemployment? Remember that? Anyone? Bueller?

  • Scott Macmillan

    I really don’t see the importance.99% is drivel.

    • Dave Parrack

      It really isn’t. And as you only see updates from those you follow it’s entirely possible to avoid any and all drivel.

  • Noy Sobu

    Wow. With that volume I guess they’re just going to delete the data after sometime. Too much space and many tweets are repetitions and even nonsense.

    • Shane Harris

      You may underestimate the government’s capacity for storing information about us. Check out Cypherpunks. That said, it’s a waste of time, I agree.

    • Tina

      Agree. Besides, it’s just a text! In terms of storage space, that’s nothing compared to everything else they are storing about us already.

Load 10 more
Affiliate Disclamer

This review may contain affiliate links, which pays us a small compensation if you do decide to make a purchase based on our recommendation. Our judgement is in no way biased, and our recommendations are always based on the merits of the items.

For more details, please read our disclosure.
Affiliate Disclamer

This review may contain affiliate links, which pays us a small compensation if you do decide to make a purchase based on our recommendation. Our judgement is in no way biased, and our recommendations are always based on the merits of the items.

For more details, please read our disclosure.