Author Archives: Vivek Bhaskaran

Voter Panels – A real world application in predicting outcomes of voter initiatives.

Before Election Day this month, if you wanted to know how voters would weigh in on privatizing liquor sales, all you had to do was ask.

Ask us, that is.

You see in WA state, we can only buy booze from state controlled liquor shops. There was a voter ballot initiative to overturn this.

Turns out, our pre-election survey read voters’ mood pretty darn well.

And that’s not all. We’re really fired up because this was a totally new way of polling voters. And it worked so well, public opinion research will never be the same.

Here’s what happened. Back in late October thru early November, we asked likely voters in Seattle/King County how they’d vote on various things. The liquor initiative, I-1183, was one of the most hotly contested issues. It called for privatizing Washington State’s government-run liquor sales.

Not surprisingly, voters in the nation’s latte-guzzling capital said they’d overwhelmingly back the measure. After all, when you need Irish Coffee fixings, you need them now – not just when state liquor stores are open.

2,001 voters responded. When asked how they would vote “if the election were held today,” 61% said yes and 33% said no, with 6% undecided. In the Nov. 8 General Election, 60% voted for the initiative and 40% against. Not too shabby.

In other words, we knew I-1183 would pass hands-down. And by how much. And we knew the outcome of other issues, with impressive accuracy.

Skeptics have raised legitimate questions.

Could the results have been a coincidence? Anyone can make predictions, but how do you know if your method is sound?

One way to test the method is to see how closely survey respondents represent likely voters as a group. In our case, the answer is: awfully close. If you look at party affiliation, age and gender, participants in our poll are a near-perfect match for the likely voter base.

So, what’s the upshot of all this? It’s more than about calling the outcome of the liquor initiative. And it’s more than being able to predict other results this year.

It’s about speed and cost.

That’s where we’re really excited. You see, our approach is actually an innovative, new way of doing surveys. This wasn’t a telephone poll, which normally costs upwards of $20K for a sample of 2,000+ voters. And unlike phone surveys, ours can be done in just hours, rather than weeks.

We did it online. We tracked down email addresses for about 10% of King County likely voters. We invited them to share their opinions. And within just 48 hours, we had answers from voters random enough to represent the electorate.

It’s not just about responding online, either. We’ve got apps. So, through our SurveySwipe platform, voters can complete a survey wherever they are. At their computer. On the bus on their smartphone. Or at a cafe on their tablet device. That’s why we can get results back fast. You don’t have to spend 10-20 minutes on the phone with some low-paid survey taker. Or, worse, a robot.

In other words, we can survey voters for a fraction of the cost of a full-blown phone survey, in a fraction of the time. With meaningful results.

Next Post : We’ll be sharing a detailed SPSS data file of this groundbreaking project and its implications.

The revolution in public opinion surveys has begun…

PS: Shameless plug - If you are a Seattle/King County pollster – now that we have our Voter Panel – please contact us if you want to run your own message testing and polling for your candidate for 2012! Please contact surveys@cityfeedback.com if you would like to use our King County and Seattle Voter panels.

Washington State Ferries – Using QR Codes for In-The-Moment Feedback

My friend Scott Liang from Parametric keeps telling me – the quicker you collect feedback from the Point-of-Transaction, the better the recall and quality is. While I have absolutely no way of verifying his assertion, in today’s Blackberry and iPhone induced ADHD world, it seems logical – and anything that passes the sniff test, works for me!

If we accept that premise, then what the Washington State Ferries in conjunction with the Washington State Transportation Commission is doing is pretty innovative — collecting feedback directly from commuters while they are in the ferry. As passengers are commuting in the ferry, they have options for using their smartphones via QR Codes to give feedback on the ride.

Few innovative options:

Thumbs UP and Thumbs Down:

Instead of having just one QR code that takes them to a survey, the Thumbs Up/Down model has 2 QR Codes – each representing positive or negative emotion espoused by the passenger overall. This is similar to the the universal facebook “like” button that we are all accustomed to in the web world.

Integrated with MicroPanel:

Users who choose to give feedback are then asked to join a panel for future surveys and feedback. This allows the commission to build a long term relationship with the passengers — the commission can then use this panel for pricing, satisfaction and other kinds of research.

Once the feedback was collected, users are given the option to go to the mobile-optimized page for MicroPanel;

Completely Turnkey:

No custom development. This entire solution is off-the-shelf. This reduces cost and complexity. SurveyAnalytics has as question type that supports creating QR Codes. This enables you to create a survey with multiple QR Codes for each option:

 



 


 

 

click-here-to-download-the-case-study


//

Limits are for Losers – Let’s Pig Out – No Limits on Panel Management Platform

In 2006 we introduced unlimited surveys/responses, and the rest of the industry followed suit. Today we are proud to be the first comprehensive panel-management tool to offer UNLIMITED panelists.  No per-user fees.  No limits.

This is our commitment to scale and technology. We already offer unlimited surveys and responses as part of the Survey Analytics survey platform. We’ve now decided to offer MicroPanel, our Panel Management Platform, also for a fixed license fee for unlimited panelists. This means you can have a one million strong research panel, and you don’t have to break your budget. You pay a fixed fee for each panel you create and run!

The Fine Print: OK, we realize that we are pushing envelopes here – so we are only offering this through the end of this year – Dec 31st. Early next year, we’ll take a look at how users adopt this pricing model and then we’ll make a decision to continue or change our pricing model. Rest assured, if you are already in the unlimited plan, you’ll be grandfathered in, of course!

Who’s using MicroPanel?

Here is a sneak preview:

OK – What is Unique about MicroPanel?
We are very excited about piloting a new offering — we have an integrated model for actually delivering panelists also! Not only can you build and manage your panel from a software standpoint, we also have the ability to hydrate your panel with panelists. We can essentially do the recruiting for you!
What next?
If you are an existing customer of Survey Analytics – get in touch with your Account Manager. If you are a new customer, get in touch with our sales team to get a demo of MicroPanel.
Want to learn more about MicroPanel : Check out http://micropanel.com

Spotlight Report – How much “sharing” is good?

Since we are kids, we are taught to share as much as we can. When we launched Spotlight Report a few years ago – we figured – either share all the data or none. We’ve now added in some more granular sharing options as part of our Enterprise License — By default all the questions in a survey are shared as part of the Spotlight Report – Enterprise customers can choose to omit sharing some sensitive questions etc.

See the screenshots below to see how to enable/disable Spotlight Reporting on a question by question basis:

To force or not to force

We’ve added in an option on MicroPanel to force users (panel members) to update (and fill out) their profile before they can start taking surveys. We’ve internally struggled with this – while on one hand, a deeply profile panel is very useful, on the other hand we are generally not big fans of forcing users to do something. We’ll – who are we to decide. We just gave everyone the option of going one way or the other. By _default_ panel profile update is not “required” – but then we added in an option in the Profile Setttings to require as needed:

MicroPanel – Points are now configurable

We’ve added in some more configuration options in MicroPanel to give administrators more power to configure their communities :

Rewards & Points Configurable:

This requirement is especially valid in cases where public policy and gov. folks are running panels for research. Typically most regulatory environments like state and federal government rules prevent agencies from “compensating” respondents for their opinions. Of course this is subject to interpretation, but none-the-less this poses a challenge in some cases when you don’t want to issue points for surveys. With MicroPanel, we added in an option to disable (or enable) points for your panel:

QR Codes and Surveys

We are excited to announce a nifty enhancement to the QuestionPro and SurveyAnalytics systems – QR Codes. If you are not familiar with QR Codes – they are those new “barcode” like patterns that everyone is talking about. Print magazines are using them to give out more information about some article or even advertisers using QR Codes for “offers” etc.

PS : The QR Code you see above points to real live survey about the NFL Lockout that our mobile division – SurveySwipe is running along with ResearchAccess. Go ahead – take out your smartphone and take that survey!

Here is a quick FAQ on QR Codes:

What is a QR Code?

A QR code (short for Quick Response) is a specific matrix barcode (or two-dimensional code), readable by dedicated QR barcode readers and camera phones. The code consists of black modules arranged in a square pattern on a white background. The information encoded can be text, URL or other data.

How do I access my survey’s QR Code?

Login->My Surveys (Select Survey) -> Send Survey (See the QR Code along with the Social Media section)

Survey Software Help Image

What are some uses of QR Codes?

QR Codes can be used very effectively for POS feedback system. Users are generally adopting to QR Codes slowly but steadily and in general, QR Codes promise to be the bridge between the offline and the online world.

Is any software/hardware required to read QR codes?

Yes. Respondents phones/devices should have QR code reader.

Google’s mobile Android operating system supports QR codes by natively including the barcode scanner (ZXing) on some models, and the browser supports URI redirection, which allows QR Codes to send metadata to existing applications on the device. In the Apple iOS, a QR code reader is not natively included, but over 50 free Apps are available with reader and metadata browser URI redirection capability. Nokia’s Symbian operating system is also provided with a barcode scanner, which is able to read QR codes,while mbarcode is a QR code reader for the Maemo operating system. HP/Palm’s webOS operating system also does not have a native QR code reader, but a reader app named QR deCODEr is available.

My personal bias on the iPhone is Neo Reader – Search for “neo reader” on the App Store.

Is this option available with all licenses?

Yes – We are slowly rolling this out to ALL our users. Over the next few weeks, this option will surface into your account when you login to the system.

Final Side Note : I want to extend a personal thank you note to Paul Becker from Pro Sports Club here in Seattle for taking the time to listen to my crazy ideas and help me distill it. Paul is the CIO of Pro Sports, which is one of the largest health and fitness clubs here in the Seattle area. Paul is also a client of QuestionPro/SurveyAnalytics and over the years become a friend. If you are a Microsoft employee, you know “Pro Club” — We’ve been thinking of doing something like this for over 2 years and we wanted to do it using Microsoft Tag. Microsoft, about two years ago, came out with the Tag from Microsoft Research. At the time, QR Codes were not readily recognizable and even the smartphone adoption rate was low. Today – the smartphone adoption, especially in places like the Pro-Club is very very high and is a non-issue.

Happy QR Coding!

 

Another Day – Another blog – Introducing the SurveySwipe Blog

I want to introduce you to the SurveySwipe Blog (blog.surveyswipe.com) – The main editor behind the blog is Chandika Bhandari – also known as “Chad” around here.  He’s the technical brain behind SurveySwipe and has been actively developing apps for the mobile platform over the last 6 months. Prior to joining the Survey Analytics family, Chad was a Lead Developer at Microsoft for over 10 years right here in Seattle.

If you have a minute, please check out two of his recent posts:

Oh – we are also doing a quick webinar tomorrow about Mobile Communities and Location Based Surveys  - Tomorrow – 3/22 – 9AM PST

GotoWebinar Link: https://www2.gotomeeting.com/register/938634290

Text Analytics – State of the Union – DiscoverText

DiscoverText has released the Raw-Data sets for the State of the Union Text text analytics portion. Dr Shulman is still working on the visualization of such a large data-set and we’ll keep you posted as things get updated. Meanwhile, If you;d like to play around with the data yourself please click on the link below:

http://discovertext.com/sotu.aspx

 

Mobile Research – State of the Union – The DataSet

The mobile research initiative using SurveySwipe and partners like ProgressiveCongress.org, Personal Democracy Forum, Netroots Nation etc. was conducted yesterday.

The methodology/process

We invited (though our partners) users to register and download a mobile app – SurveySwipe. The intent was to try out 3 ideas:

  1. Mobile Polling/Data Collection in general (iPhone, Andriod and Windows Phone 7)
  2. Pulse – On-the-Spot polling using Push Notification (iPhone Only)
  3. Dial-Testing on the mobile phone (iPhone Only)

Here are the results:

We did 5 surveys in all – A PRE, 3 Pulse surveys and a POST survey. I’ve already documented some of the lessons learned with this exercise. This post is about the data we collected.

The SOTU Panel Profile:

The Dial Test

We are still compiling the individual dial-test data – but this is the profile of the users who completed the dial test.

The PRE Survey

Pulse 1 – Seating Arrangement / Employment

Pulse 2 – Wealth/Afghanistan/Humor

Pulse 3 – Broadband / PUblic Transportation

Final – Post Survey

Dial Testing – Raw Data

We are still compiling the results of the dial test. We had ~300 users take the dial-test in real-time. We’ll be posting the raw data of the dial test also in the next day or two.

DiscoverText – Text Analytics

We are still waiting on Dr. Shulman to provide us with the data-set for the DiscoverText data for text mining. We’ll post it on the blog as and when it gets available.

Thank you.