Tuesday, November 20, 2007

Trouble on the Intertubes

First up, an article by Cory Doctorow (the founder of Boing Boing) on the disconnect between how quickly automatic "immune systems" on the internet take action and how long it takes for a human to reverse the action.

ISPs are loading up their network centers with intrusion detection systems and tripwires that are supposed to stop attacks before they happen. For example, there’s the filter at the hotel I once stayed at in Jacksonville, Fla. Five minutes after I logged in, the network locked me out again. After an hour on the phone with tech support, it transpired that the network had noticed that the videogame I was playing systematically polled the other hosts on the network to check if they were running servers that I could join and play on. The network decided that this was a malicious port-scan and that it had better kick me off before I did anything naughty.

It only took five minutes for the software to lock me out, but it took well over an hour to find someone in tech support who understood what had happened and could reset the router so that I could get back online.

And right there is an example of the autoimmune disorder. Our network defenses are automated, instantaneous, and sweeping. But our fallback and oversight systems are slow, understaffed, and unresponsive. It takes a millionth of a second for the Transportation Security Administration’s body-cavity-search roulette wheel to decide that you’re a potential terrorist and stick you on a no-fly list, but getting un-Tuttle-Buttled is a nightmarish, months-long procedure that makes Orwell look like an optimist.

<...>

We need an immune system. There are plenty of bad guys out there, and technology gives them force-multipliers (like the hackers who run 250,000-PC botnets). Still, there’s a terrible asymmetry in a world where defensive takedowns are automatic, but correcting mistaken takedowns is done by hand.

Next is a piece discussing how the tubes themselves aren't big enough.

Consumer and corporate use of the Internet could overload the current capacity and lead to brown-outs in two years unless backbone providers invest billions of dollars in new infrastructure, according to a study released Monday.

A flood of new video and other Web content could overwhelm the Internet by 2010 unless backbone providers invest up to US$137 billion in new capacity, more than double what service providers plan to invest, according to the study, by Nemertes Research Group, an independent analysis firm. In North America alone, backbone investments of $42 billion to $55 billion will be needed in the next three to five years to keep up with demand, Nemertes said.

The study is the first to “apply Moore’s Law (or something very like it) to the pace of application innovation on the ‘Net,” the study says. “Our findings indicate that although core fiber and switching/routing resources will scale nicely to support virtually any conceivable user demand, Internet access infrastructure, specifically in North America, will likely cease to be adequate for supporting demand within the next three to five years.”

<...>

Internet users will create 161 exabytes of new data this year, and this exaflood is a positive development for Internet users and businesses, IIA says. An exabyte is 1 quintillion bytes or about 1.1 billion gigabytes. One exabyte is the equivalent of about 50,000 years of DVD quality video.
That's a lot of data. I can't speak to anyone but myself, but I know that my computer and a broadband connection is the one technology implement I couldn't live without. I suspect I'm not the only one who feels that way.

h/t: Instapundit