Skip to main content

Have You Ever Caught Yourself Being Biased in Analyzing Your Survey?

Have you ever noticed that when you're in a good mood, you listen differently.  You react to circumstances differently.  It's as if nothing can get you off balance.  If someone cuts you off on the highway, you take it in stride.  If your friend or spouse give you a sideways glance, you don't even think about it.  And then, there are the "bad" days.  Where it seems nothing goes right and those very same things that you didn't even notice before now seem like a personal assault on your very being.

Welcome to the normal functioning of your brain.  For every bit of non-emotional fact or piece of data that your brain receives, it attaches an emotional component -- all the better to retain it and make sense of it.  That's really what the brain does.  It observes a pattern, attaches an emotion and then assigns it meaning.

Usually this is very useful.  It's how we're able to get through the day in 24 hours instead of 24 years.  And at the same time -- it can create some interesting situations when we're processing survey data.

Bias Happens At All Levels

We often talk about sampling bias or response bias, but have you ever sat down and talked about analytical bias?

The next time you're sitting down with your team reviewing the latest customer satisfaction scores - stop and notice where bias comes in.  It sounds something like this:

"It's no wonder our scores are low last march.  That was when the new software went live -- it was a mess remember?"

"We just sent out our latest price list.  That region got hit with an increase and they also got the survey invitation the next day -- no wonder the numbers are low."

The implication is that we know what happened, we can explain it and that makes it ok.  The truth is -- we don't really know what happened.  All we know is that we sent survey invitations out on certain days.  Respondents gave us lower scores during those times.  There could have been any number or reasons.

The point is that our natural bias can cause us to miss something that might be just below the surface -- just AFTER that point where we've put forth the "reason."

Look.  I have no facts to support this -- I want to hear from YOU.  Have you ever caught yourself unconsciously introducing bias and what were the results?


Enhanced by Zemanta

Comments

Popular posts from this blog

Results of the Presidential Job Index Survey (week ending 7/1/2010)

Quick update on the results for the presidential job index survey for the week ending 7/1/2011. As a reminder this is a weekly survey that we conduct and we publish the results for the survey every Friday. To participate in this week's survey, please download the SurveySwipe application and take the survey.

Remember, you get points that you can redeem for various rewards when you take our surveys. We have already distributed several paid apps like Angry Birds for free.

Highlights

Almost 900 respondents took the survey.
52% vs 53% last week of the respondents approve of the job that President Obama is doing.
Respondents included 28% Democrats (31% last week), 25% Republicans (22% last week), 24% independents (27%) last week and 2% with the Green Party (3% last week).



You can view the reports here or directly on your phone.

Top 5 Infographics of the Week: Cyber Security

Earlier this week, we experienced a power outage with our data center at Internap. During this short period of time, our customers were unable to access the site. Luckily, it didn't last long and we are back up and running now thanks to our dedicated support team that responded quickly and worked diligently.

Cyber security is, and always has been, a very important issue for us as we continue to grow and meet the demands of a technology-driven society. Nothing is more paramount than the safety of your valuable data. And apparently we weren't the only ones affected, as LinkedIn was experiencing difficulties on the same day and Internap had 3 massive outages earlier this year. Check out these infographics with stats on the importance of cyber security and the impact it can have on small-medium sized businesses.

Top 5 Infographics of the Week: Internet of Things

In 2008, the number of things connected to the internet exceeded the number of people on Earth. By 2050, we are expected to surpass 50 million different devices connected to the internet. And we're not just talking smartphones and tablets - we mean everything. Wearable tech, household appliances, smart homes, public transportation, hospitals and even cattle have all been using sensors to transmit data automatically. It is an exciting yet scary time to be alive. The various interactions between these different entities are opening up doors for more apps, more software and more auxiliary services. With so many "things" connected online, the possibilities for information exchange becoming wider everyday. Check out the top 5 infographics to learn more about the IoT.