Exploring Local
Mike Dobson of TeleMapics on Local Search and All Things Geospatial

The Atlantic Magazine Reveals How Google Builds its Maps – Not.

September 19th, 2012 by admin

At last! We are close to delivering our final report to the US Census Bureau on their Master Address File and I now have time to devote to one of my favorite pastimes – writing blogs for Exploring Local. Hooray. What this means in consultant speak is that I am “on the beach” or between assignments, although truth be told, I am not looking very hard for anything to do for a while. I have my personal projects all laid out.

Over the last few weeks I have read a number of articles about maps and mapping that have renewed my interest in what’s going on in the profession. I guess that is something of a misstatement, since there a no longer enough people who actually are cartographers to make a profession, at least one that has any hopes of future growth. However, not to worry. Alexis C. Madrigal, a noted madrigal singer, oops I meant a the senior editor at The Atlantic, where he oversees the Technology Channel, recently wrote a marketing piece, oops I meant an “even-handed” review of the encyclopedia of all cartographic wisdom – Google Maps. His article “How Google Builds Its Maps – and What It Means for the Future of Everything” is a monumental tribute to revisionist history.

I suspect that The Atlantic magazine will soon be renamed “The Atlantic & Pacific”, since Googleland appears to be the heart of the cartographic universe. While reading the article I thought “Wow, he gets paid for writing this crap” and as I read further, I began to wonder “But who pays him?” The entire read resembled a poorly thought out advertorial.

I guess Apple’s entry into the mapping arms race has the big “Goog” upset and they decided to get ahead of the curve by bringing in a cub reporter, who knew little about mapping, to whom they could show why Apple doesn’t have a chance. Why Googs did not make these stunning revelations to a writer from a real tech magazine is an interesting question, but one to which we all know the answer. Madrigal’s article was enough to make me want to change my opinion of the problems that Apple must overcome to be a player in this venue. Well, let’s start down that road by focusing on the startling new truths that Google revealed to Mr. Madrigal about the world of mapping.

I know that it may be hard for some of you to realize that mapping was not discovered by Google. Last February I was examining a floor-mosaic–map in Madaba Jordan that dated from the 6th century AD that was designed to show pilgrims the layout of the Holy Lands. I can assure you that it did not have the Google’s copyright notice anywhere on it and I can, also, assure that it was not particularly old as maps go.

Dating from the 6th Century AD mosaic-map was designed to provide an overview of the Holy Lands to those on pilgrimages.

It may come as a further shock to you that Google did not invent map projections, including the one they use, nor did they invent tiling, symbolization, generalization, decluttering, zooming, panning, layers, levels, satellite imagery, map tiling, crowd-sourcing (both active and passive), their uniquely named “Atlas tool”, as well as most everything else associated with Google Maps. Even Google’s Street View had its origins in robotic sensing systems developed to enhance computer vision research, although Google, with the help of Sebastian Thrun, was smart enough to figure out how it could give them a competitive advantage in compiling street maps.

Where to start on the Madrigal article? How about the byline that reads “An exclusive look inside Ground Truth (no, Google did not invent this either), the secretive program to build the world’s best accurate map” Phew, I was glad to learn that Google was not attempting to build the world’s worst accurate map. I had hoped that the Googie was going to attempt to build the world’s most accurate map, but I guess that they just wanted the world to know that what they were building would be “bester” than whatever Apple could supply.

Did you notice the secret information the former NASA rocket scientist who was mentioned in the article told Madrigal? It was a howler, as a matter of fact it sounded like something I wrote in a blog when I was being snarky about Google. Anway, here is the exclusive/secret info from the horse’s mouth that was revealed exclusively the Madrigal of The Atlantic

“So you want to make a map,” Weiss-Malik tells me as we sit down in front of a massive monitor. “There are a couple of steps. You acquire data through partners. You do a bunch of engineering on that data to get it into the right format and conflate it with other sources of data, and then you do a bunch of operations, which is what this tool is about, to hand massage the data. And out the other end pops something that is higher quality than the sum of its parts.”

Wow was that informative. Before we go any further, I would like to note that Mr. Madrigal might have received a better education on Google Maps by reading this blog than visiting Google, but then that would be shameless self-promotion. So, will you tell him instead?

For some reason the opening figure in my copy of the article is a photo of two people playing ping pong. That had me stumped for a while, as I could not figure out what it had to do with project “Ground Truth”. Well, it still has me stumped, but I am working on it. I thought we might get a photo of a person at a workstation with a map on a monitor and details of the environment at the Google Maps office in Mountain View, CA. Apparently ping-pong is more interesting and newsworthy and the great Googs was not about to reveal any detailed information about how they compile maps to Mr. Madrigal.

I was more than mildly surprised that Madrigal seemed not to understand that there was more to Google Maps, or any map for the matter, than meets the eye. How did he think that routing occurs? Did he really believe the “Men in Black” idea that there were tiny aliens inside Google servers that supplied routes on demand as they were requested? Does he know that computerized routing has been around on a commercial basis since the early 1970s? Did he ever hear of Barry Glick, the founder of MapQuest, hawking online routing capabilities before Google was founded? Does he have any idea what NAVTEQ does with its highly instrumented vans and imaging systems? Has he ever looked at Bing Maps, or the hundreds of other services out there that provide competition to Google in the mapping sector? Put more simply, did the author of this article have the least little bit of inquisitiveness about what Google was telling him? My conclusion is a big, “Nope.”

I was, also, stunned to read Manic (okay, that’s supposed to be Manik) Gupta’s comment that the information in offline real word in which we live is not entirely online. When did this happen? Why is it allowed? Wow, this is beginning to sound like a science fiction thriller where there is no distinction between offline and online. Maybe Google really is an earth changing company, in more ways than we realize. Hopefully Tom Cruise will play the part of Gupta in the movie version of this thriller.

Gupta’s follow-up quote was even better – “Increasingly as we go about our lives, we are trying to bridge that gap between what we see in the real world and [the online world] and Maps really plays that part.” Hmmm. I had always thought that maps were a representation of the real world, and not the original thing. Based on the Madrigal article, it appears that he thinks that maps can and should serve as the real world. I guess Mr. Madrigal may not understand the real nature of project “Ground Truth”, or the use-warnings Google puts on their map and routes. I don’t know about you, but I have heard that trusting ground truth is usually a better strategy than ignoring it and trusting its representation, whether that representation is online, printed, in a box on your dash, in your phone, hiding in the ether while encoded in a radio wave, or packed as a new innovation labeled “Ground Truth” created by Google (and thousands of people before them).

I smiled when I read that Madrigal was stunned to learn that humans were involved in Google’s map making process. Yes. Humans are apparently needed to remedy problems that software cannot seem to solve. Imagine, data compiled from various sources that does not quite fit. Is that possible? Hmmm. Did Google invent that too? And is using crowd-sourcing to mine knowledge another Google innovation? No, I don’t think so. Is there no end to Madrigal’s naiveté? Well, the answer to that also appears to be “no.”

I hope you noticed his comment that, “This is an operation that promotes perfectionism.” I, also, liked this one “The sheer amount of human effort that goes into Google Maps is just mind boggling.” Followed by this, “I came away convinced that the Geographic Data that Google has assembled is not likely to be matched by any other company.” Well, guys, apparently it’s time to give up on mapping. Google, according to Madrigal, appears to have thought every thought about mapping that could ever be thought. Well, maybe not.

I hope you noticed the section of the article with this comment, “The most telling moment for me came when we looked at couple of the several thousand user reports of problems with Google Maps that come in every day.” A couple of thousand error reports every day? Is that like saying Google Maps only has 347 million known errors left to remedy? Seems that just like most of us Google will not be the first to achieve perfection in mapping. If you read my series of about Google’s map correction program, you know more about this than Mr. Madrigal, so you should consider applying for his position at The Atlantic.

I wonder why there appeared to be only one workstation for Mr. Madrigal to observe in Mountain View? According to Madrigal’s article hundreds of operators are required to map a country and many of them are in Google’s Bangalore office. Hmmm, So much for local knowledge. In part this remoteness of operators from the geography they are editing is why there are so many errors on Google Maps. In addition, maybe all those Google-driven innovations in mapping don’t quite help when the sources that Google harvests contain incorrect information to begin with. Adding erroneous information the edit queue of an operator who must use other surrogate information to validate it can be a recipe for disaster, as Google has proven time and time again.

I do applaud Mr. Madrigal for realizing that Street View is an important distinction in the marketplace for mapping services. Whether Google is actually using Street View for all of the processes mentioned in the article is unclear to me. Didn’t it sound like something a VP would say when Brian McClendon indicated that, “…… We’re able to identify and make a semantic understanding of all the pixels we’ve acquired.”? Wow, that’s great, but do you think they really do this? Someone should send McClendon some articles to read on image processing, as well as some older texts on information theory – seems as if they are doing a lot of work they do not need to do. And how about the number of businesses, addresses and logos they have collected with Street View. If only they could create a comprehensive address database with this stuff, but they can’t because of footprint limitations related to the deployment of their Street View assets. However, whether Street View provides a sustainable competitive advantage is something that Apple, Microsoft, NAVTEQ and TomTom will have to decide. It may a competitive advantage today, but I can assure you that whether or not it is sustainable, will not depend on Google’s wants.

So to Apple and all the apparently second level mapping companies – Don’t give up the map race quite yet. The fact the Google thinks you can’t catch them may be the best news you have had this year.

Finally, shame on Google for participating in a public relations effort masquerading as a report on technological innovation. While I have great respect for what Google has achieved with Google Maps, the interview behind the Madrigal article was not designed to reveal any details on Google’s technological innovations in mapping. Instead, it was an interview strategically planned to denigrate Apple’s mapping capabilities by implying that it could not compete with the great Googie. Revealing old news to someone who did not have a background in mapping, GIS or navigation is pandering and something I had not expected from Google. Just what is it about Apple’s mapping program that has them so scared? Hmmm. Something to think about.

Bookmark and Share

Posted in Apple, Authority and mapping, Data Sources, Google, Google Map Maker, Google maps, Navteq, TomTom, User Generated Content, routing and navigation

4 Responses

  1. Brad

    Not for nothing but did Google fire you? Your response to the fluff piece the Atlantic did, yes I read it several times, is no better then the original. Many many people have no idea how Google makes maps, or even know that they drive cars with Cameras around, this piece was a high level fluffer at best but good lord your response to it is crap. I like your blog but this is a shining example of bad writing. Not once did you say anything other then wow Google does that so do other people, no crap, Google did not say they invented any of this, however they do give it away for free to the world and not many others can say that. I use Google Maps every single day and it is much better then any $2000 nav system built into cars or anything you can add on, in my experience, and yes I have used it in many countries, Iraq and Afghanistan included, where Google Maps had better data then NGA could provide.

    Hi, Brad:

    Glad you liked the article ;-) >

    Do you know the meaning of parody?

    If you want to know my thoughts about Google or want to know how Google maps works, read the articles in my blog that will help you understand how Google makes their maps.

    Nope, I was not fired by Google and have never worked for them. (My blog is probably a good reason why).

    I am pleased that you have found such satisfaction in Google Maps.

    Truth be told, I use Google Maps more often that any other online source, but that does not blind me to their shortcomings.

    Thanks,

    Mike

  2. George

    Brad thinks that Google Maps is “free”. Hah! How naive.

    Brad, we all pay dearly for the use of Google Maps, by giving up our Web search and mapping privacy to use Google’s services. Google would like everyone to think these services are “free” but Apple Safari users can tell you the desperate lengths that Google executives will go to access and track your Web search, surfing and mapping data in exchange for use of its services. The company has demonstrated that it will do whatever is necessary to sidestep your stated “tracking” preferences to access that data, and has been caught doing this and fined by governments numerous times.

    “Do no evil” as a company motto? Indeed.

    We all would be wise to remember that first and foremost, Google is an advertising company that tracks and sells our private data to business customers. Some day, we’ll wake up and realize that giving up our privacy for “free” tracking of our lives is too high a price to pay. To me, this also is why the idea of cheap Google (Android) phones is pure folly.

    Buy a cell phone designed for an advertising company? Not me. No thanks.

    Hi, George:

    Thanks for contributing your unique perspective. Privacy is a concern here.

    Just a side comment. I have seen several articles that claim that Google Maps is being offered on an “even less than free” basis. For instance, if you are a website publisher you can use Google Maps on your pages and then included advertisements on the map or in the surround and monetize your use of the map. In essence, not only do they provide a free map, they provide free access to the code and data that you need to use it in other environments and allow you to make money on their intellectual capital. The reason I raise this issue is that =this is one of Google’s advertising strategies that has turned map publishing on its head.

    Mike

  3. Neil Havermale

    As I was reading your post, I kept trying to understand the bug up your nose? I guess my conclusion is that for some reason you may be miffed that someone else wrote the piece? But on a re-read the real issue apparently is no one interviewed a “cartographer”. The article was not talking to you but to the millions who are enlightened by the tool Google Maps and Earth?

    The other day I found a tread of truth that may the bug buzzing and irritating you. A comment was made the so-called professional cartographer has been relegated to some sort of mapping-pool like the old idea of a typing-pool in a large company or enterprise? I am not a “cartographer” but I do use maps a lot. I had to learn heaps – MapInfo, then ArcView, aka ArcInfo, aka ArcGIS, aka ???. When I first used Google Earth, well the desktop map tool looked like an industry of buggy-whips hunting for horses?

    I think the magic that Google grabbed, Google-ized, was having a good enough solution for the inclusion of over a billion personal map-makers. I have yet to meet any of the nuvo-geographers who has not located their home or child-neighborhood on Google. And it was not done from a consultant’s desk nor a professional cartographer nor an ESRI license but from the on-going effect of the world-wide-web. Blame the WWW. As for Apple, well they may be too busy holding off competition than creating new innovation? (Sorry Steve, but Xerox’s PARC inspired you with out a law suit) Building a BING map has not helped Microsoft IMHO. It is an interesting moment to observe. Hope you feel better soon…

    Hi, Neil:

    Glad you enjoyed the blog ;-) .

    My hope for the article published in the Atlantic was that it would include information on how Google builds its maps, as this was what the self-described focus of the author. From my perspective the article failed to meet these goals.

    As you may be able to tell, I am interested in how things work in mapping/GIS/LBS and enjoy learning about new twists and strategies that could be of benefit to others. I publish articles on my blog as a service to those who might not have access to some of the information that comes my way. I am sorry that my perspective in the article did not resonate with you.

    Thanks for your comment.

    Mike

  4. J Hughes

    Whether or not Google invented something, they are doing a great job. Whether it is “less than free” is also immaterial as Google serves me maps for which I pay nothing.

    As another suggested, you seem to have your knickers in a twist over Google.

    I use Garmin, Thales, Tom Tom and a few other devices in my work as well as Android device. I can tell you for overall accuracy and promptness of updates, Google takes the prize. Garmin’s map had me driving the Ha Noi Highway … only it was 15 kilometres out to sea!

    That said they ALL are missing a street or two in Hue, VietNam!

    The week the new East-West Expressway was opened in Ho Chi Minh City had it showing; the week the tunnel under the River SaiGon was opened, Google reflected this link – they even removed the old ferries just before the end of the year when they closed.

    And if you are looking for an Apple store, go use Google, they have them and they are not petty and churlish like Apple.

    Hi, J:

    Glad you liked the article.

    Read the next one on Apple Maps and you will see that I am an equal opportunity “basher” who picks on companies that can do better.

    Thanks for your comment.

    Mike