Network Buffer Bloat

Jim Getty, who was an inventor of the X Window System in the 80s, has a bone to pick about performance of his networks. He suspects there is a problem with TCP buffers related to network congestion and round trip time (RTT).

…you don’t see the full glory of TCP RTT confusion caused by buffering if you have a bad connection as it reset TCP’s timers and RTT estimation; packet loss is always considered possible congestion. This is a situation where the “cleaner” the network is, the more trouble you’ll get from bufferbloat. The cleaner the network, the worse it will behave. And I’d done so much work to make my cable as clean as possible&

At this point, I realized what I had stumbled into was serious and possibly widespread; but how widespread?

Very widespread. I hate to spoil the story, but here’s the conclusion:

By inserting such egregiously large buffers into the network, we have destroyed TCP’s congestion avoidance algorithms. TCP is used as a “touchstone” of congestion avoiding protocols: in general, there is very strong pushback against any protocol which is less conservative than TCP. This is really serious, as future blog entries will amplify.

What this means is that increasing the size of your network connection is not going to give you a performance boost. The Internet used to feel faster because, well, it was faster. The shift in traffic towards massive file sizes and streams of data appears to be incompatible with the network’s ability to regulate flow. Did you know that NetFlix alone is said to be “20 percent of all Internet traffic during the typical American evening”?

What this also means is that traffic shaping could be improved by using techniques already available, but product vendors and service providers first have to admit there is a problem with their progress model. Let’s hope that the providers do not try to use this as an excuse to take even more control of the network (e.g. anti-neutrality).

The home router situation is probably much grimmer, from what I’ve experienced. We have a very large amount of deployed home network kit (hundreds of millions of boxes) much of which is no longer maintained, even for security updates (which is why the home router problem is so painful, and dangerous in my opinion). It seems that within 6 months to a year, the engineers working on that firmware have moved on to new products (and/or new companies), and that kit with serious problems (like that which has inhibited deployment of ECN) never, ever gets fixed.

You can easily audit/measure your buffers and join the debate using tools like the ICSI Netalyzr from Berkeley.

Asbestos in Organic Brake Pads

The Car Talk guys explain why not to buy “organic pads” for brakes that squeal:

…in brake-speak, organic means “made of asbestos.” It’s the old style brake pads that worked perfectly well to stop your car, but have fallen out of favor because they were also causing lung cancer in factory workers and auto mechanics.

[W]e use ceramic pads, which are made of broken teacups or something. And the reason we’ve been using more ceramic pads lately is that (1) they’ve come way down in price and (2) they produce a lot less brake dust. Some customers with fancy alloy wheels objected to having metallic black brake dust pitting their $1,000 wheels.

They also point out that buying pads from a car manufacturer should have the benefit of special hardware to position the pads properly, which is what is actually needed to stop brake squeal.

SF Forces McDonalds to Switch to Crappy Meal

The Daily Show pokes giant gaping holes in San Francisco’s ban on the Happy Meal. Watch to the end:

The Daily Show With Jon Stewart Mon – Thurs 11p / 10c
San Francisco’s Happy Meal Ban
www.thedailyshow.com
Daily Show Full Episodes Political Humor & Satire Blog The Daily Show on Facebook

The idea for a ban on the Happy Meal, or rather a change in the calorie content and marketing, was led by Supervisor Eric Mar.

He is infamous already, at least locally, for other attempts at behavior regulation:

…ensuring The Richmond District is called The Richmond District or his work introducing a “Resolution endorsing the first World March for Peace and Nonviolence, calling for the end of war and nuclear arms, and the elimination of violence of all kinds.”

The Daily Show report makes San Francisco’s Mayor Gavin Newsom sound bitterly opposed to industry regulation, and opposed to working with the Supervisors. Perhaps that is no surprise if you read this morning’s news about his bitter departure from office.

After winning the seat for lieutenant governor in November, Mayor Gavin Newsom told reporters, point blank, that there would be no back room deals or political bargaining when selecting an interim mayor to fill the remainder of his term.

He’s also vowed to steer a clean-cut transition as he assumed his role as state lieutenant governor.

But then it seems Newsom was involved in back room shenanigans late last night when city supervisors took a short break from debating who should be the interim mayor.

And his effort for a smooth city transition? Well, that’s been about as clean as Mission Street sidewalk.

The Mayor in the past, however, has been pro-regulation. He favored the ban on single-serving plastic water bottles. Some even have said he should be given credit for leading regulation of industry for the entire country, such as a reduction of petroleum use with a plastic bag ban (introduced by Supervisor Ross Mirkarimi and modeled on the regulation in Ireland). Maybe he just really likes the Happy Meal.