Welcome, Guest Login Register
loading...
Net Promoter Community > Paul Marsden's Blog > 2006 > September > 29
 
Currently Being Moderated

Stay away from 9K!  Seat 9K on Virgin Atlantic night flights, that is. It's the funky bed seat next to the cool in-flight bar -- great for partying, bad for sleeping...

 

Which perhaps explains a) why I'm blogging this at 4 am @ 37,000 feet somewhere between London and Mumbai and b) why the customer satisfaction questionnaire handed to me is in 100% Hindi, presumably so I don't understand a word of it.

 

Which gets me thinking (sorry, we've got a stream of consciousness thing happening here) about satisfaction surveys, and their relationship to the Net Promoter Score (NPS). One way of looking at these two is to say that the NPS provides a validated and growth-correlated measure of the overall customer experience you are delivering, whilst satisfaction surveys, unpack the drivers of specific points of time within that experience.

 

For example, my Hindi customer satisfaction questionnaire has 300+ boxes I can check, and I'm sure that through a combination of statistical hyper-mathematics and dead-impressive regression techniques, it will be possible to cross-reference my checks and spew out the answer to what is driving my experience.

 

However, you don't need squiggle-babble to unpack core NPS drivers and barriers of that flight -- there are additional approaches: Listening Labs. The spirit of Net Promoter is to encourage companies to engage ongoing with their customers in a systematic way to improve their experience. Listening labs would be considered an adjunct to an ongoing, systematic approach to improving NPS. They are comparable to focus groups in that they are used intermittently, and can really help understand a point issue.

 

Specifically, Listening Labs are (as their name would suggest) listening sessions with small groups of your most profitable and influential customers -- usually split into groups of detractors and groups of promoters. The idea is simple: they talk, you listen. You listen to their specific experiences with your brand, spoken in their own words, particularly those words they use to share that experience with their friends or colleagues. You listen to where they say their experience meets, beats or misses their expectations across all the brand touch-points, and you listen to their suggestions for improving the experience.

 

An increasing number of brands are finding Listening Labs to be powerful tool for unpacking their core NPS core drivers and barriers. They don't replace customer satisfaction (C-Sat) surveys, but they do provide a rich source of insight. In fact, I'd challenge you to run a set of Listening Labs alongside your C-Sat surveys, and compare the quality of the output for yourselves.

 

So here's a short discussion guide for running your own Listening Labs that will illuminate your core NPS drivers and barriers, and thereby map a pathway to growth.


NPS LISTENING LABS: DISCUSSION GUIDE

Time: 90 minutes
Location: on site (you're engaging participants in this session as 'special advisors', just as you would business consultants, so on site sessions provide an appropriate business environment)
Participants: one group (5-7) high-value (influential/profitable) promoters in your customer base, and one group high value detractors
Support Materials: facilitator, post-it notes, sticky tape, pens, paperboard, stress balls, refreshments


Introduction (10 minutes)

1. Thank group for agreeing to take part.
2. Introduce yourself as here to listen to their feedback, insights and suggestions on their experience of your brand.
3. Explain that, as valued customers, they have been recruited as special advisors, but reassure their feedback and ideas will be anonymous and their identity will remain confidential.
4. Outline the session: 3 exercises -- 'wall of words', 'power blobbing', and 'association game'

5. Warm up icebreaker: ask each participant to
        - Introduce themselves,
         - What they do, and
        - What would be their dream job


Exercise 1: Wall of Words (25 minutes)

This exercise unpacks the key drivers of word of mouth promotion and detraction, and provides priority areas for improving your NPS.

 

Give each delegate 3 Post-it Notes, and tell them that you're interested in what they think is worth recommending about your product or service.

 

Ask everyone in the group to write down on their first Post-it note the answer to this question:

What specifically, would you tell a friend if you had to convince them to try your product or service?

 

Ask each member of the group to read out the answer they gave and explain it. Take their post-it note and stick it up on a free space on the wall, clustering similar answers together.

 

Now ask the group to write down on the second Post-it note the answer to this question:

What specifically, would you tell a friend if you had to convince them NOT to try your product or service?

 

Ask each member of the group to read out the answer they gave and explain it. Take their post-it note and stick it up on a second free space on the wall, clustering similar answers together.

 

Finally, ask everyone in the group to write down on their third post-it note the answer to this third question:

What's the one improvement that would make your product or service really worth recommending?

 

Ask each member of the group to read out the answer they gave and explain it. Take their post-it note and stick it up on a second free space on the wall, clustering similar answers.

 

Ask group to look at the three clusters - and briefly discuss their main take-out.


Exercise 2: 'Power Blobbing' (20 minutes)

This exercise provides insight into critical experiential factors driving NPS, their relative importance, and how you fare on them.

 

Explain the task -- to understand the drivers and barriers to recommending your product or service.

 

Explain that positive and negative word of mouth is all about whether customer experiences either beat or miss expectations (experiences that just meet expectations merely create passive word of mouth 'mutes').

 

First, ask the group to imagine they have to help a first-time buyer in your product or service category choose from the range of options on offer.

 

What are the key selection criteria this first-time buyer should use to choose, i.e., what are the top reasons to choose one product/service over another in this category?

 

Brainstorm this as a group, listing the key reasons to choose on a paperboard, until you have as many reasons for choosing as participants.

 

Hand out 'experience sheets' (see below), one to each participant, and as you do so mark a different 'reason to choose' on each sheet.

 

Ask each participant to stick a 'power blob' (a colored sticky dot) in the appropriate box, based on whether their personal experience of your brand beats, meets or misses their category expectations.

 

Ask each person to hand their sheet one place to the left (pass-the-parcel fashion) and repeat task.

 

Continue until everybody has 'power-blobbed' each sheet.

 

Finally, ask participants, one at a time, to stick the sheet they have in front of them up on the wall, creating a line of sheets left to right that go from the most important to least important reasons for selection. Once all the sheets are stuck on the line, allow each participant to move one sheet up or down in importance.

 

Experience Sheets

 

(Click on image for larger image of Experience Sheets)

Experience_sheets_1

 

 


Exercise 3: Association Game (25 minutes)

This exercise captures the 'emotional' rather than rational NPS drivers and barriers by using associative techniques.

 

Explain the task, to capture positive and negative word associations around good and bad experiences with your product or service. Explain that there are no right or wrong answers -- that associations are 'emotional' truths not logical truths.

 

Association Game 1: Positive Experience - write the name of your product or service in the center of a flip chart sheet, and ask group to sit back and think of a positive experience they've had with your product or service. Ask them to call out words they associate with this experience. Capture 5-6 words on the flip chart - in a spider diagram emanating out from your brand (see diagram).

 

NPS Associogram
(Click on image for larger image of Associogram)

Associogram

 

 

 

 

Then ask them to continue thinking about this positive experience, and then read out the first association they gave, asking the group to call out two or three words they associate with this word when thinking about this positive experience. Repeat for all the words to create 5-6 association chains on spider chart.

 

Association Game 2: Negative Experience - write the name of your product or service in the center of a second flip chart sheet, and ask group to sit back and think of a negative experience they've had with your product or service. Ask them to call out words they associate with this experience. Again, capture 5-6 words on the flip chart - in a spider diagram emanating out from your brand.

 

Now ask them to continue thinking about this negative experience, and then read out the first association they gave, asking the group to call out two or three words they associate with this word when thinking about this negative experience. Repeat for all the words to create 5-6 association chains on spider chart.

 

Association Game 3: Perfect Experience - write the name of your product or service in the center of a third flip chart sheet, and ask group to sit back and think of an imaginary perfect experience they could have with a product or service such as yours  Ask them to call out words they associate with this imaginary perfect experience. Again, capture 5-6 words on the flip chart - in a spider diagram emanating out from your brand.

 

Then ask them to continue thinking about this imaginary perfect experience, and then read out the first association they gave, asking the group to call out two or three words they associate with this word when thinking about this perfect experience. Repeat for all the words to create 5-6 association chains on spider chart.

 

Discuss group takeouts from the three association games.


Wrap-up (10 minutes)

 

Final round table "The one thing you need to do is..."  Ask each participant to imagine they had just been appointed CEO of your company. What's the one thing they would do to improve the recommend-ability of your product or service?

 

Thank and close -- offer to send a copy of debrief document to participants, thanking them again for participating as 'strategic advisors'.

 

So there you have it, Listening Labs in a nutshell. Go ahead, give them a try -- experiment, adapt and optimize -- and let me know how they go. You've got nothing to lose in conducting a couple of pilot Listening Labs, and a whole lot of growth to gain!

 

Paul Marsden (on the landing strip of Mumbai airport)



Oct 2, 2006 1:57 PM Guest Rebecca Secor  says:

Thank you for this post! We are just beginning our NPS adventure, this is just the kind of tool that will really help us through implementation.

 

Just curious...in the Wall of Words exercise, the question "What specifically, would you tell a friend if you had to convince them to try your product or service?" is indicated as both question one and two. Is that an error, or are we looking to have them write down their top two reasons to recommend our product?

 

Oct 3, 2006 5:41 PM Guest Net Promoter Community  says:

Rebecca. Thank you for catching the omission of a word. The second sentence you reference has been corrected in the copy above. The word "not" was missing. This is how the sentence now reads:

 

"What specifically, would you tell a friend if you had to convince them NOT to try your product or service?"

 

Nov 1, 2006 10:27 AM Guest Diane Koepke  says:

Great informationthanks for sharing this.  A couple of questions (1) Have you had success implementing this within a B2B environmentspecifically with channel partners as well as end users and (2) If yes, to question 1--what if anything would you do differently than the example you provided above.  (3)  Did you provide any compensation for the participants?  I am quite interested in giving this a try.

Thank you!

 

Nov 3, 2006 5:32 PM Guest Net Promoter Blogmaster:  says:

Diane. Paul Marsden is away on a business trip, but will reply next week. Thanks.

 

Nov 13, 2006 1:36 PM Guest Paul Marsden  says:

Hi Diane, thanks for your pertinent questions.

 

Yes, we've run Listening Labs in B2B, using the same exercises - but  what changes is the tone of the labs.

 

Q 1 + 2  What changes in B2B Listening Labs

 

Whilst we recommend treating participants of B2C Listening Labs as  consumer advisors (rather than classic research respondents), we think this is absolutely necessary in B2B - you need to position the participants as external advisors, not research respondents. This encourages participation among busy people, and help get better 'business' focused real-world feedback rather than wish-lists.

 

Whilst the exercise remained the same - the content of the second 'power-blobbing' exercise changes:

 

i.e.

 

a) Wall of words  - reasons to recommend, reasons not to recommend, top improvement

b) Power-blobbing - experiential touch points meet, beat or miss expectations (these will differ based on what you are selling)

c) Association game - emotional NPS drivers

 

3.  Offering compensation?

 

We find that offering 'karma points' - donation to charity of the participant's choice, works best for one-off listening labs (we of course cover travel expenses, ideally sending a limo to collect participants (this raises stature of the session in the mind of participants). In some cases, where Listening Labs become a regular event, with the participating 'advisors' - a small annual stipend ($2500) (and their own business cards) for 4 sessions for being members of an 'EXTERNAL ADVISORY BOARD'. Again, this adds gravitas to the 'board' both internally (to get C-level buy-in to recommendations, and among participating 'board' members who take the exercise seriously).

 

Hope this helps! Let me know how you get on!

 

Best, Paul

 

Apr 29, 2007 6:22 PM Guest Melissa  says:

This concept is very interesting to me - one that I have given some thought to as I assume my new role as Director of Customer Loyalty in a company that is starting to embrace NPS as a part of our corporate culture.

 

My question to you is that we have several clients within a single client company.  Do you think the listening lab would be more effective if we were to combine different clients from multiple client companies, or should we limit it to the clients within each single client company?  OR will they feel more like advisors if they were able to meet some of our key players from our other clients? Any thoughts would be appreciated.

 

Also, thanks for the tip on 9K!  I have had similar experiences on some of my trips across the US and Europe!

 

Regards,

Melissa

 

May 2, 2007 11:59 AM Guest Paul Marsden  says:

Hi Melissa, great question! 

 

Should you mix up participants from different client companies in Listening Labs...  The answer is a qualified yes; if your clients are all (profitable) promoters, and if they buy more or less the same thing from you.

 

Why is mixing it up a good idea?  Three reasons.

 

One - if your clients are all profitable promoters buying the same thing, they'll be pretty much on the same page - which is invaluable for group dynamics when unpacking reasons to recommend and priorities for improvement.

 

Two, as Fred notes in The Ultimate Question - one of the key strategies for improving NPS is to create a platform where clients can help and interact with each other (e.g. eBay power sellers forums etc); Listening Labs are just such a platform.  If you are seen as facilitating this exchange through Listening Labs, then propensity to recommend will improve.

 

Three, and as you correctly point out, the Lab will have more gravitas if multiple clients are together (and ensure that it is not seen as a Client Relations stunt).  In fact, we find the more you can position the Listening Lab as a formal advisory session, the more you and they get out of it. (in B2B we call ongoing Listening Labs (where clients come for a series of Labs) 'Independent Advisory Boards' - and host them onsite, and if possible, in an actual boardroom).

 

The only caveat in all this is that I'd warn against mixing up detractors with promoters - or clients who you sell different things to (or for a different price!) - as negative mood is very infectious, and what one detractor says may be irrelevant to another!

 

Of course, this doesn't mitigate the usefulness of running Listening Labs with (profitable) detractors - indeed you should - as Fred points out, a detractor may have 3x impact of a promoter on your growth - so you need to really understand those reasons to detract!

 

Hope this helps, let us know how you get on!

 

Paul

 

May 3, 2007 1:56 PM Guest Melissa  says:

Paul,

 

Thank you for the quick response.  You definitely have validated my thoughts/concerns - I agree it is very important to have listening labs with like minded and similar service offering clients for sure!

 

Though, I am definitely interested in doing one geared towards Detractors just hesitant as to how to engage it - likewise, I am thinking we may want to do one for Passives to find out why we are "vanilla" too them - as I find that this category can be sizable from client to client - do you know what the "norm" is for the Passives? In terms of overall make up for companies using NPS?

 

Thank you for all of your insight!

 

Regards,

Melissa

 

May 7, 2007 12:07 PM Guest Paul Marsden  says:

Hi Melissa, we found in the UK that passives make up about about 50% of all buyers.

 

Agree that listening to this big group is worthwhile as well - although I'd focus on high value passives only. In these  listening labs, my advice would be to focus on identifying where you can profitably beat their expectations (and thereby upgrade them to promoters!)

 

Let us know how you get on!

 

Best, Paul

 

May 4, 2008 7:45 AM Guest Katarzyna  says:

Hi Paul,

I like your idea of engaging clinets in an NPS workshop session.

I have a few comments/questions:

1. In the description of a workshop you say the participants are - a group of promoters and a group of detractors. However in one of your comments you say you do not recommend mixing the two. Do you suggest then making two separate sessions for promoters and for detractors? If so, what would be the difference in running sessions?

2. the most valuable source of information on your business is the group of detractos, isn't it? But while gathering a group of detractors you expose yourself to a high risk of escalating negative emotion. How do you suggest managing those emotions during such a session. Is Q2 in the first exercise needed? Isn't Q3 revealing the same kind of information as Q2 but in a possitive way?

3. Do you find detractors willing to come to the sessions? what is your experience in dealing with detractors during sessions or in any other way? Have they become promoters after a while?

 

thanks!

Katarzyna

 

 

 

May 9, 2008 7:40 PM Guest Paul Marsden  says:

Hi Katarzyna, thanks for the questions.

 

Let's take them one by one

 

Q. In the description of a workshop you say the participants are - a group of promoters and a group of detractors. However in one of your comments you say you do not recommend mixing the two. Do you suggest then making two separate sessions for promoters and for detractors? If so, what would be the difference in running sessions?

 

A. Yes, we usually run two workshops - a group of promoters and a separate group of detractors.  Why? because they have different concerns and they are likely to irritate each other.  Some people do like to run "conflict groups" as they are called (putting promoters and detractors together) - but in my experience they tend to attack each other - rather than stick to the session!

 

Q. The most valuable source of information on your business is the group of detractors, isn't it? But while gathering a group of detractors you expose yourself to a high risk of escalating negative emotion. How do you suggest managing those emotions during such a session.

 

Yes, what your detractors are saying about you is important - if they do/could spend lots of money with you.  Unprofitable detractors are low priority.  (My next post will be whether to prioritise focus on promoters or detractors).  And yes, there is a small risk that participants will reinforce each others views and create a negative image -but there is a powerful psychological principle at work that will help you.  When you ask people for advice, and actively listen to them - they'll start to like you, and feel positive about you.  And if you frame the session properly - saying you're looking for constructive ideas for how to be better - then you should be fine!

 

Q. Is Q2 in the first exercise needed? Isn't Q3 revealing the same kind of information as Q2 but in a possitive way?

 

A. This is a good point - if you're tight on time you could skip the "What specifically, would you tell a friend if you had to convince them NOT to try your product or service?" question.  But it is different to the "priority for improvement" question because it's a role playing question that captures actual words people would use - this is important because word of mouth is key, and you can learn a lot from the words people use when explaining to a friend why your product or service sucks.  Sometime how someone says something is more revealing than what they say.

 

Q. Do you find detractors willing to come to the sessions? what is your experience in dealing with detractors during sessions or in any other way? Have they become promoters after a while?

 

A.  Detractors love listening labs - one of the biggest drivers of detraction is frustration with not being listened to.  When we do followup measurement - the very fact they've participated makes them less of a detractor.  But to turn them into a promoter - you have to listen and act on what they say!

 

Hope this helps - Let us know how you get on!