How Racist Are We? Ask Google
Barack Obama won 52.9 percent of the popular vote in 2008 and 365 electoral votes, 95 more than he needed. Many naturally concluded that prejudice was not a major factor against a black presidential candidate in modern America. My research, a comparison of Americans’ Google searches and their voting patterns, found otherwise. If my results are correct, racial animus cost Mr. Obama many more votes than we may have realized.
Quantifying the effects of racial prejudice on voting is notoriously problematic. Few people admit bias in surveys. So I used a new tool, Google Insights, which tells researchers how often words are searched in different parts of the United States.
Can we really quantify racial prejudice in different parts of the country based solely on how often certain words are used on Google? Not perfectly, but remarkably well. Google, aggregating information from billions of searches, has an uncanny ability to reveal meaningful social patterns. “God” is Googled more often in the Bible Belt, “Lakers” in Los Angeles.
The conditions under which people use Google — online, most likely alone, not participating in an official survey — are ideal for capturing what they are really thinking and feeling. You may have typed things into Google that you would hesitate to admit in polite company. I certainly have. The majority of Americans have as well: we Google the word “porn” more often than the word “weather.”
And many Americans use Google to find racially charged material. I performed the somewhat unpleasant task of ranking states and media markets in the United States based on the proportion of their Google searches that included the word “nigger(s).” This word was included in roughly the same number of Google searches as terms like “Lakers,” “Daily Show,” “migraine” and “economist.”
A huge proportion of the searches I looked at were for jokes about African-Americans. (I did not include searches that included the word “nigga” because these searches were mostly for rap lyrics.) I used data from 2004 to 2007 because I wanted a measure not directly influenced by feelings toward Mr. Obama. From 2008 onward, “Obama” is a prevalent term in racially charged searches.
The state with the highest racially charged search rate in the country was West Virginia. Other areas with high percentages included western Pennsylvania, eastern Ohio, upstate New York and southern Mississippi.
Once I figured out which parts of the country had the highest racially charged search rates, I could test whether Mr. Obama underperformed in these areas. I predicted how many votes Mr. Obama should have received based on how many votes John Kerry received in 2004 plus the average gain achieved by other 2008 Democratic Congressional candidates. The results were striking: The higher the racially charged search rate in an area, the worse Mr. Obama did.
Consider two media markets, Denver and Wheeling (which is a market evenly split between Ohio and West Virginia). Mr. Kerry received roughly 50 percent of the votes in both markets. Based on the large gains for Democrats in 2008, Mr. Obama should have received about 57 percent of votes in both Denver and Wheeling. Denver and Wheeling, though, exhibit different racial attitudes. Denver had the fourth lowest racially charged search rate in the country. Mr. Obama won 57 percent of the vote there, just as predicted. Wheeling had the seventh highest racially charged search rate in the country. Mr. Obama won less than 48 percent of the Wheeling vote.
Add up the totals throughout the country, and racial animus cost Mr. Obama three to five percentage points of the popular vote. In other words, racial prejudice gave John McCain the equivalent of a home-state advantage nationally.
Yes, Mr. Obama also gained some votes because of his race. But in the general election this effect was comparatively minor. The vast majority of voters for whom Mr. Obama’s race was a positive were liberal, habitual voters who would have voted for any Democratic presidential candidate. Increased support and turnout from African-Americans added only about one percentage point to Mr. Obama’s totals.
If my findings are correct, race could very well prove decisive against Mr. Obama in 2012. Most modern presidential elections are close. Losing even two percentage points lowers the probability of a candidate’s winning the popular vote by a third. And prejudice could cost Mr. Obama crucial states like Ohio, Florida and even Pennsylvania.
There is the possibility, of course, that racial prejudice will play a smaller role in 2012 than it did in 2008, now that the country is familiar with a black president. Some recent events, though, suggest otherwise. I mentioned earlier that the rate of racially charged searches in West Virginia was No. 1 in the country and that the state showed a strong aversion to Mr. Obama in 2008. It recently held its Democratic presidential primary, in which Mr. Obama was challenged by a convicted felon. The felon, who is white, won 41 percent of the vote.
In 2008, Mr. Obama rode an unusually strong tail wind. The economy was collapsing. The Iraq war was unpopular. Republicans took most of the blame. He was able to overcome the major obstacle of continuing racial prejudice in the United States. In 2012, the tail wind is gone; the obstacle likely remains.
Seth Stephens-Davidowitz is a doctoral candidate in economics at Harvard. The most up-to-date version of the research paper on which this article draws is available here.
Barack Obama won 52.9 percent of the popular vote in 2008 and 365 electoral votes, 95 more than he needed. Many naturally concluded that prejudice was not a major factor against a black presidential candidate in modern America. My research, a comparison of Americans’ Google searches and their voting patterns, found otherwise. If my results are correct, racial animus cost Mr. Obama many more votes than we may have realized.
Quantifying the effects of racial prejudice on voting is notoriously problematic. Few people admit bias in surveys. So I used a new tool, Google Insights, which tells researchers how often words are searched in different parts of the United States.
Can we really quantify racial prejudice in different parts of the country based solely on how often certain words are used on Google? Not perfectly, but remarkably well. Google, aggregating information from billions of searches, has an uncanny ability to reveal meaningful social patterns. “God” is Googled more often in the Bible Belt, “Lakers” in Los Angeles.
The conditions under which people use Google — online, most likely alone, not participating in an official survey — are ideal for capturing what they are really thinking and feeling. You may have typed things into Google that you would hesitate to admit in polite company. I certainly have. The majority of Americans have as well: we Google the word “porn” more often than the word “weather.”
And many Americans use Google to find racially charged material. I performed the somewhat unpleasant task of ranking states and media markets in the United States based on the proportion of their Google searches that included the word “nigger(s).” This word was included in roughly the same number of Google searches as terms like “Lakers,” “Daily Show,” “migraine” and “economist.”
A huge proportion of the searches I looked at were for jokes about African-Americans. (I did not include searches that included the word “nigga” because these searches were mostly for rap lyrics.) I used data from 2004 to 2007 because I wanted a measure not directly influenced by feelings toward Mr. Obama. From 2008 onward, “Obama” is a prevalent term in racially charged searches.
The state with the highest racially charged search rate in the country was West Virginia. Other areas with high percentages included western Pennsylvania, eastern Ohio, upstate New York and southern Mississippi.
Once I figured out which parts of the country had the highest racially charged search rates, I could test whether Mr. Obama underperformed in these areas. I predicted how many votes Mr. Obama should have received based on how many votes John Kerry received in 2004 plus the average gain achieved by other 2008 Democratic Congressional candidates. The results were striking: The higher the racially charged search rate in an area, the worse Mr. Obama did.
Consider two media markets, Denver and Wheeling (which is a market evenly split between Ohio and West Virginia). Mr. Kerry received roughly 50 percent of the votes in both markets. Based on the large gains for Democrats in 2008, Mr. Obama should have received about 57 percent of votes in both Denver and Wheeling. Denver and Wheeling, though, exhibit different racial attitudes. Denver had the fourth lowest racially charged search rate in the country. Mr. Obama won 57 percent of the vote there, just as predicted. Wheeling had the seventh highest racially charged search rate in the country. Mr. Obama won less than 48 percent of the Wheeling vote.
Add up the totals throughout the country, and racial animus cost Mr. Obama three to five percentage points of the popular vote. In other words, racial prejudice gave John McCain the equivalent of a home-state advantage nationally.
Yes, Mr. Obama also gained some votes because of his race. But in the general election this effect was comparatively minor. The vast majority of voters for whom Mr. Obama’s race was a positive were liberal, habitual voters who would have voted for any Democratic presidential candidate. Increased support and turnout from African-Americans added only about one percentage point to Mr. Obama’s totals.
If my findings are correct, race could very well prove decisive against Mr. Obama in 2012. Most modern presidential elections are close. Losing even two percentage points lowers the probability of a candidate’s winning the popular vote by a third. And prejudice could cost Mr. Obama crucial states like Ohio, Florida and even Pennsylvania.
There is the possibility, of course, that racial prejudice will play a smaller role in 2012 than it did in 2008, now that the country is familiar with a black president. Some recent events, though, suggest otherwise. I mentioned earlier that the rate of racially charged searches in West Virginia was No. 1 in the country and that the state showed a strong aversion to Mr. Obama in 2008. It recently held its Democratic presidential primary, in which Mr. Obama was challenged by a convicted felon. The felon, who is white, won 41 percent of the vote.
In 2008, Mr. Obama rode an unusually strong tail wind. The economy was collapsing. The Iraq war was unpopular. Republicans took most of the blame. He was able to overcome the major obstacle of continuing racial prejudice in the United States. In 2012, the tail wind is gone; the obstacle likely remains.
Seth Stephens-Davidowitz is a doctoral candidate in economics at Harvard. The most up-to-date version of the research paper on which this article draws is available here.
Edited at 2012-06-10 02:36 pm (UTC)
I think it's sad and lame, but whatever.
Lol.
Does anyone remember when people were warned not to use google as a search engine because you'd get random porn sites popping up in your searches and that you didn't know it was a porn site until you clicked on it? I didn't use google for most of my teenage hood because I didn't want my parent's to think I was a pervert if they found an accidental porn site on my computer history. I figured out how to delete the history when I did start using google but I haven't run into that problem so I'm not sure if it was true at one point in time or a total urban legend.
so yes, back in the early days of the internet, since there was so little content, you got a lot of random "OMG, WTF!?" since porn industry was major early adopter. There was so much more of it, and it was often labeled so search engines could find it, than anything else that you would inevitably trip over it.
Once the internet exploded and you had lots and lots of content and much more sophisticated search engines, that was a lot rarer. Also the porn peeps continued to stay on the edge of the technology so by and large knocked themselves out of general searches that weren't obviously for porn. Showing up in a search for "pearl necklaces" makes people angry and they lobby for porn being restricted and kept off the the internet. That's bad for business. a little massaging of the code, the porn doesn't show up as the top result, everybody that WANTS porn can still find it, everybody that doesn't never sees it in normal searches and can pretend the internet is NOT full of porn. Everybody wins.
I don't think its necessarily true that racial prejudice will play a smaller role in 2012. The same voters who were using racial prejudice to decide against voting for Obama in 2008 will probably not change their attitude towards him this year, they'll just look for any other trivial excuses about how he's run the country for the past four years as a cover for their real issue with him. I'm not at all saying someone can't have legitimate complaints about him without it being a cover for racism, I'm saying that there are probably quite a few people that would probably be a bit more lenient in their criticism had it been a white president doing the same things as Obama.
Like my mom, who asks me every time I talk to her - 'what's the difference between google and facebook? Do I need a credit card to text someone?' (I'm not making this up - I just got off the phone with her, LOL).
*hands*
This what I'm most worried about this election, tbh. Things were actually so bad that white Americans decided to vote for a black candidate, this time around they might not. And on top of that the racists who didn't vote because they didn't actually expect a black candidate to win will turn out for sure. Idk, idk. I'm genuinely terrified of the idea of Romney becoming President.
I fucking HATE South Carolina, and most of the rest of the citizens in this useless, greed obsessed, racist, theocratic, bigoted country are barely at #2 behind it.
As someone who lives in Western Pennsylvania, this does not surprise me at all. I have had more racist jokes in the last year since I moved home than I have in the past 8 years. I always see stuff on how "blue" Pennsylvania is, but the only blue parts are Philly and Pittsburgh. I graduated from high school in a class of over 200 kids which was 100% white; there are literally people in my town who have never met a black person. It's like 1958 up here.
:/
First, the paper assumes that Google users are a reasonable cross-section of American voters, which is not likely to be the case giving the economic, geographic, and age barriers to technology and internet access.
Second, while I didn't click through to the source, at least in this article it doesn't actually give any numbers, it just says things like "West Virginia had the most searches with the word 'Nigger'." OK, great - does most mean they had millions, or two? Are these unique users, or some smaller number searching a lot? What's the correlation to overall population?
This is crap science, at best - a conclusion looking for support.
Romney is not getting the same amount of bad press even though he is equally as scary. The media, otoh, jumps at the chance to say bad things about Obama. It really scares me as to how this election may turn out.
"You may have typed things into Google that you would hesitate to admit in polite company."
I would be embarrassed for people to know everything I google and judge me on it, but mostly because I google things for sort of random reasons. Like something said on lj and I want to fact check it or whatever. For example, I've googled about various illegal drugs that I have never used or thought about using because of something I read elsewhere related to them.