The Phoenix Network:
About  |  Advertise
Adult  |  Moonsigns  |  Band Guide  |  Blogs  |  In Pictures
Media -- Dont Quote Me  |  News Features  |  Talking Politics

Infopocalypse: The cost of too much data

Meet big government's next big problem: Digital Overload.
By CHRIS FARAONE  |  December 29, 2010

Our nation is drowning in data. At any given time, federal agencies use more electronic storage units than could fill every NFL stadium from Oakland to Foxboro. At last count, the US government owns or leases at least 2100 data centers, and spends about half of its multi-billion dollar IT budget on digital storage. The United States Census Bureau alone maintains about 2560 terabytes of information — more data than is contained in all the academic libraries in America, and the equivalent of about 50 million four-door filing cabinets of text documents. In addition to the federal deluge, tens of thousands of municipal and state facilities maintain data ranging from driver's-license pics to administrative e-mails — or at least they're required to.

"Going digital" was supposed to be an environmentally conscious way for governments to cut costs while improving efficiency. But it hasn't quite worked out that way yet. Storage capacity is increasing, but the volume of data is also increasing, perhaps just as quickly. Over the next decade, the world will produce the informational equivalent of nearly 100 million Libraries of Congress per year, according to Cisco's Internet Business Solutions Group.

Most of what the government stores are public records, which means that by law they must be made available to anyone who requests them. But while there are ambitious efforts underway to improve storage methods, the sheer bulk of information is alarming.

These quandaries are turning into an increasingly expensive problem, and one that now has its own advisory bureau: the Office of Government Information Services (OGIS) was opened in 2009, solely to serve as an intermediary service between requesters of information and agency gatekeepers. Furthermore, Barack Obama was the first president to appoint a chief information officer, the operational-IT wunderkind Vivek Kundra, who has made it a priority to streamline the government's inefficient, energy-wasteful information infrastructure under a newly enacted Federal Data Center Consolidation Initiative. Kundra claims the US has already reduced its overall IT budget by $3 billion, while increasing functionality in some agencies by more than four times. Still, dire problems persist.

Bogged down
Public data remains, by and large, a disorganized mess. A recent report by the Citizens for Responsibility and Ethics in Washington (CREW) found that despite the administration's policy adjustments, Freedom of Information Act requests are still not being processed much differently than they used to be.

Indeed, from Washington DC to small-town America, governments have quietly begun to acknowledge that the information age has gotten them in way over their heads. Why?

There is too much data. Digital storage is not a natural resource. The amount of information that government agencies may be required to keep — from tweets and e-mails to tax histories — is growing faster than the capacity for storage.

There's not enough manpower to manage all this data. The Obama administration hopes to make more information freely available online. But in the meantime, the old method of requesting data from the government — filing a FOIA request — is bogged down due to an insufficient workforce and long request backlogs.

Private companies are storing public data. This trend in outsourcing, largely the result of too much data and too little manpower, is a potential threat to both access and security, as resources that belong to the people are entrusted to outside vendors, raising new privacy concerns.

1  |  2  |  3  |  4  |  5  |   next >
Related: Slideshow: Boston Tea Party 2009, Holy Everglades, Batman!, Does Portland want an elected mayor?, More more >
  Topics: News Features , Citizens for Responsibility and Ethics in Washington, government, Freedom of Information Act,  More more >
| More
Add Comment
HTML Prohibited

 Friends' Activity   Popular   Most Viewed 
[ 01/11 ]   Heather Maloney Band + IOA + MMOSS + Royal Blood  @ Middle East Upstairs
[ 01/11 ]   Dancing Behind My Eyelids  @ Oberon
[ 01/11 ]   "Sheila Hicks: 50 Years"  @ Addison Gallery of American Art
Share this entry with Delicious
  •   MASS POT REFORM BLAZES UP  |  January 06, 2011
    The Massachusetts Cannabis Reform Coalition (MassCann) is hardly a stoned cadre of spliff-roasting slackers. They don't have that luxury.
  •   INFOPOCALYPSE: THE COST OF TOO MUCH DATA  |  December 29, 2010
    At any given time, federal agencies use more electronic storage units than could fill every NFL stadium from Oakland to Foxboro.
    There's this funny idea in the music industry — or at least in the hip-hop slice of that glorious enterprise — that it's uncool to release an album in January, February, or March. Artists and label dicks just love talking about how they're "waiting for the second quarter to drop."
  •   THE FOUR LOKO CLUB: STUFF THAT WAS BANNED IN 2010  |  December 22, 2010
    In early November, Sarah Palin passed out 200 sugar cookies at a school fundraiser in Bucks County, Pennsylvania.
  •   BEST BOSTON RAP ALBUMS OF 2010  |  December 21, 2010
    So I'm walking past the Jeanie Johnston in Jamaica Plain after the Boston Music Awards, and I see Slaine and his friend Ronnie hugging the bar and crushing rum and cokes.

 See all articles by: CHRIS FARAONE

RSS Feed of for the most popular articles
 Most Viewed   Most Emailed 

  |  Sign In  |  Register
Phoenix Media/Communications Group:
Copyright © 2011 The Phoenix Media/Communications Group