I always thought Coke and Pepsi tasted pretty much the same.  

When I read Malcolm Gladwell's book 'Blink – The Power of Thinking without Thinking' I realised just how close they once were – but are not anymore. All because of the roller coaster ride Coke took with market testing.

Mini-commercial:
In my previous post about market testing your promotional concept, we looked at the different popular approaches people take to market test their business names or logo designs – without spending thousands on a market research agency.  

The Market Research Challenge

In 'Blink' we see The Coca-Cola Company spending rather a lot on a market research agency in the early 1980s.  Why?  Because that is what large companies tend to do.  But the early 1980s was particularly active for The Coco-Cola Company.  Pepsi was slowly but surely edging in on their market share.  Then Pepsi's sales began increasing significantly when they launched the advertising campaign called 'The Pepsi Challenge'.

The Coca-Cola Company launched into full-scale market research on the matter. Naturally, their testing was focused on comparing Coke to Pepsi. A sample group of dedicated Coke drinkers took a blind taste test sipping each brand.  The majority picked Pepsi as their preferred drink.  

'Eeek!' said The Coca-Cola Company.

Additional tests were carried out and the same results occurred. Pepsi was associated with 'rounded' and 'smooth', while Coke's bite was now being described as 'harsh'.  As a response, Coke released 'New Coke' – a sweeter cola, much like Pepsi.

The disaster

The New Coke sat on the shelves. The product launch was a failure, that much was certain. But The Coca-Cola Company couldn't work out why.  All the testing indicated great success for The New Coke.

The problem with the market testing was that many people found Pepsi nice to sip but were not so partial to drinking a whole can. So – for all the expertise enlisted and money spent – the way testing process was carried out was fundamentally flawed.  Taste testing is fine.  How you taste test is another thing.

A note about focus group failings 

Malcolm Gladwell also cites the focus group failing of successful television shows  All in the Family and The Mary Tyler Moore Show.  

Focus Groups are people gathered by market research companies to talk openly and honestly about how they feel about a particular product(s) presented to them.  This is called 'qualitative' research.  Qualitative research is not designed to find out how many people feel a certain way, but to dig deeper – to discover 'why' and 'how'. 

The third episode of Studio 60 on the Sunset Strip (created by The West Wing's Aaron Sorkin) has in its first scene television network President, Jordan McDeere, pointing out how lousy focus groups are at determining success – listing Seinfeld, Hill Street Blues and (once again) All in The Family as focus group failures. Apparently all these show really did bomb in the focus group tests. 

What's the real problem?

Unfortunately these television show examples have led to high-level criticism of the focus group process.  But, like the Coke example, it is not necessarily the testing model that's the problem.  Taste testing is fine, focus groups are fine.  It is how they are used that is the issue.

Focus groups should not be mistaken for quantitative research. Quantitative research (as in: 'quantity') is for finding out how many will like it.  Alternatively, qualitative research (as in 'quality'), such as focus groups, are great for gleaning insights from your target market to guide your development.

Should market research determine whether you go ahead?

In 'Blink', Gladwell gives another beautiful example of a product that didn't test well.  It was a new ergonomic office chair called Aeron, created by Bill Stumpf of Herman Miller Inc.. Using mesh instead of fabric meant that you could see through to the intricate workings of the design. The comfort level rated through the roof, but the people didn't like the look of it it.  

The company launched the Aeron chair anyway. 

The Aeron attracted great interest from the design industry, won a major design award and the chair became a cult object.  It also began to appear in films and television commercials.  Sales boomed.  What was once perceived as ugly had, with the right exposure, become – as Malcolm described – beautiful.

Perhaps if Herman Miller Inc. had also tested with high level design professionals they would have known that particular group would be the avenue to lead the promotion of the chair.  

It is these kinds of strategies that can come from market testing – that will make the research worthwhile. 

Motto of the story:

When it comes to market testing, be VERY careful with:

• the sample of people you select to test with
• what you show them and/or give them (and how)
• what questions you ask them
• how you interpret the results

Have you done any marketing testing?  If so, how did you approach it?  What happened in the end?  Post us a comment and tell us about the experience.

This post was written by Megan Hills.  Megan is a writer, cartoonist and marketing barista. She also delights in stories about large multinational companies who do silly marketing things, despite their billion dollar budgets. Find out more about Megan.

The last post about briefing your logo designer prompted a great comment.  It was actually more of a query:  

How do you know that your logo is going to appeal to your target market?  

The short answer to this question is: test it on them.

Now, there is testing and there is testing.  You need objective feedback from those who are likely to buy your service or product. But how do you go about getting this objective feedback about your new logo – or any marketing concept?  

Hire a market research agency

You can consider enlisting the help of a market research agency to carry out an investigation on your behalf through surveys and/or focus groups.  The two main areas of market research are: qualitative (why?) and quantitative (how many?).  

If you have a few thousand up your sleeve, then it might be worth getting a quote (or two) from these guys.  Depending on your situation, it could be the best business investment you've ever made for your business.  

But if you're not flush enough for this service (and many in small business aren't), there are other things you can do. 

Let's take a look at some popular common approaches and whether they are useful:

Asking your family

My clients love to test any marketing concept on their family.  Whether it is a business name, logo design or campaign premise, the spouse and little Jimmy seem to always get their two cents.  

Your family are people that already love you and accept you. It's natural to want to involve them.  But don't do it.   For a start, your family probably isn't your target market.   And even if they are, how can they possibly be objective?  

Asking people in your office

Asking your existing customers

This the next thing my clients do.  The idea of asking clients you know really well for their feedback is appealing because, like asking your family, it's not a great imposition.  These are people that have accepted you and wouldn't mind the request.

While we are now in the realm of 'target market' the problem with this approach is that they already know what you are selling.  It is harder for existing clients to pick up on any possible misconceptions.  They will find it difficult to be objective.  

Like with your sales team, by all means get feedback from them.  But don't stop there.

Asking people on the street

My father used to be an executive copywriter for a number of multinational advertising agencies.  While big budgets were allocated to many of his projects, this didn't stop him from going down the end of the street with a clipboard and asking 10 people (in the realm of the target market) three key questions about the product he was working to promote.  

He crafted the questions to ensure that he would not just get a 'yes' or a 'no' answer. Those approached had to explain why they felt the way they did.

At times my father compared the results of this approach with those derived from a market research company.  More often than not the ratio results were the same.  

But your target market might be hard to nab on the street, so be conscious of that limitation.  If your target audience has a broad demographic (both genders and/or large age bracket and/or wide ranging income levels), this way of market testing could be just the thing. 

Asking those you know are potential clients

This is a cracker if you can pull it off.  Is there a positive way to survey those in your target market who are currently buying from your competition?  You are bound to get some interesting data.  However, approach this option with care.  

If the person feels imposed upon by your survey-waving, then the exercise can backfire badly.  You have lost a potential client before you have even started selling to them.  And if they tell other people about their negative experience then you may have lost many potential clients.  

So the ideal is to find ten people who fit your target market profile (that don't know you well – yet) who are willing to give feedback beyond 'yes' and 'no'.

This can sometimes be safely achieved through currently loyal clients who know people just like them.  Again, approach with caution.  Your don't want to spoil a good relationship with a current client.     

In this world of increasing anonymity, people like to give their opinion.  But if it's a ten page survey that is going to take them half a day – with no direct reward – their desire to contribute is likely to fade.

So keep the testing short, make it fun and give those interviewed a reward for participating.

Next post…

..you will find out how even the biggest companies in the world can make HUGE mistakes when it comes to market testing.

This post was written by Megan Hills.  Megan is a writer, cartoonist and marketing cha cha performer.  She's also very nosey about what other people think and feel about things. Find out more about Megan.

A client recently got in touch about finding a name for a new business.  The staff brainstorm had already happened back at the client's office.  You could have called it a tsunami.  

The client wanted my feedback on their ideas. The staff had obviously gone through every thesaurus on the planet. They had also given their best college try to be fun and creative. 

But my feedback changed everything.

The team had started off well. A pretty thorough job had also been done on analysing how the competition was branding themselves. What seemed to work ‘out there’ and what didn’t.  

One staff member had actually gone to the trouble of writing out the key elements of the business and what makes them different (called a 'USP' – unique selling proposition).  Three key messages had been identified.  All great stuff.  

You would think all the boxes were ticked.  But they weren’t.

Let’s say the client’s business was about recruitment.  The list the staff came up with were generally one-word shots, like ‘connection’, ‘fusion’, ‘empower’, and  ‘dovetail’. 

Each word was a vague gesture towards at least one of the three key messages. I felt sorry for the words.  An awful lot of pressure had been put on them. They needed support. They needed context.

When choosing a new business name it can be helpful to imagine how the name is going to sit in a logo.  And when you do this, consider the following:

Ask: What is your industry?

If you are in recruitment consider having ‘recruitment’ in the name.  There are two good reasons to try this out: 

1. Potential clients will then know immediately what industry you’re in (i.e. how you can help them)

2. You have a nice keyword in your domain name (good for Google searching)

So instead of just ‘dovetail’, see the name as ‘Dovetail Recruitment’.  

Ask: Is it available?

A quick gander on Google and you’ll see that all the business names (connection, fusion, empower and dovetail), along with the word ‘recruitment’, have been taken somewhere in the world.  

Important note:  Don’t just check if you can register it as a business name and if it’s already trademarked.  You need a good website address as well. The hat trick.

If you want to have a global presence, finding a name that is still available can be challenging.  If you want to be more local, then it is generally less of a problem.  

Either way, it is worth going through the process as thoroughly as you can to end up with a name that works.

Ask: What’s your tagline?

Let’s keep with ‘Dovetail Recruitment’ as a business name for now.  It sounds okay and we know what you do.  But what makes you different from other recruitment agencies?

This is where a tagline becomes helpful.  A tagline can really push home what is special about you.  

Perhaps your recruitment business has a special screening process that has a unique, lateral approach to finding the right person for the job.  The process screens candidates for qualities beyond the usual criteria that other agencies use.

What could your tagline be?  Perhaps something like:

Lateral recruitment for better results.

So we’re now looking at:

Dovetail Recruitment
Lateral recruitment for better results

The positives about the line is that it prompts the question ‘What is lateral recruitment?’.  A potential client might call you on the basis of that question.  

To a lesser degree it prompts another question: “better results than who?”.  The imagined answer would be “Better than those silly-moo linear recruiters that you usually hire”.

But the line needs improvement.  Firstly, you don’t need ‘recruitment’ in the tagline when it’s already in the name.  And it might be good to try a more personal approach. After all, this is a ‘people business’.  

So let’s make it:  

Dovetail Recruitment
Your lateral resource for better results

But what if we think (after some market testing) that the term ‘Wide Net’ might be worth introducing?  The word ‘lateral’ is still quite effective…  Do you change the tagline or change the name?  Be bold.  Try changing the name and see how it feels.

Wide Net Recruitment
Your lateral resource for better results

Compare this business branding example to one small brainstorm word: ‘dovetail’. See the difference?

The punch line

I’m not saying ‘Wide Net Recruitment’ is the best name for this particular business.  Or that ‘Your lateral resource for better results’ is the best tagline. The point is, the business and the tagline need to work together for the key message to come through powerfully and succinctly. Combined, they need to say what you do and why you are special.

Test them both on your target market.  Ideally, this means a good swag of people that don’t know you from Adam.  This way you will have a better chance of receiving helpful, objective feedback.

One final tip:

Say the business name.  Don’t just write it. I’ve seen too many names where the potential client would hesitate before attempting to pronounce the darn thing.  

You might think the name is straightforward to pronounce, but always test it. Use a flash card and get strangers to speak it out loud. 

Then, by all means, sing your new business name from the rooftops.

Megan Hills is a writer, marketing consultant and cartoonist - more about Megan