[Carlo Ratti of the Massachusetts Institute of Technology’s] team used records of more than 12 billion anonymised landline telephone calls, to model who Britons frequently spoke to.
I added in a Wired map from 2007 to illustrate how the NSA likes to route communications through America so they can listen:
Now I see an intern at Facebook has tonight tried to replicate the same study using Facebook data:
I was interested in seeing how geography and political borders affected where people lived relative to their friends. I wanted a visualization that would show which cities had a lot of friendships between them.
That sounds an awful lot like the MIT study, which said:
A map created using those connections showed that people tended to communicate most with people that we geographically close to them, [Carlo Ratti of the Massachusetts Institute of Technology’s team] added.
I do not think the Facebook intern is really saying “I have a hypothesis that x,y cities have a lot of friendships”. No, I think he is saying “I set out to paint a picture of cities that have a lot of relationships between them”. It is kind of like he says he wants to do the exact same thing that the MIT study was doing, but skipping straight past the study part and to the pretty picture.
I began by taking a sample of about ten million pairs of friends from Apache Hive, our data warehouse. I combined that data with each user’s current city and summed the number of friends between each pair of cities. Then I merged the data with the longitude and latitude of each city.
Voila! Art.
Note that MIT’s study was on 12 billion anonymised connections.
Facebook intern project: not so many and not so anonymous, and no credit.
MIT had a team working on their study.
Facebook intern project: “a few minutes of rendering”
So here are millions of connections, probably not even random let alone anonymous, manipulated to look pretty in “enough shades of color for it to work the way I wanted”.
Pretty and artistic, but I will avoid making jokes about it being insecure, shallow and artificial, like Facebook. I would have to make the data work the way I want to support that…but seriously, there are barely any connections between France and French-speaking Africa. Is that a sign of weakness by Facebook or is it outside the data set of their millions, or is that asking the same question?
And here is the MIT study color map, from the BBC, for comparison:
This all takes me back to the link analysis tools I wrote about in June. It is extremely useful to incident responders and investigators to map suspect relationships to geography over time.
Updated: A reader pointed out the Facebook map is similar to a 1996 IEEE presentation called “Visualizing the Global Topology of the MBone”
We present a case study of visualizing the global topology of the Internet MBone. The MBone is the Internet’s multicast backbone. […] We create a geographic representation of the tunnel structure as arcs on a globe by resolving the latitude and longitude of MBone routers.