Welcome, Guest Login Register
loading...
Net Promoter Community > Richard's and Laura's Blog > 2007 > November > 07
 
Currently Being Moderated

Rival Methodologies Beware!

Posted by RichardOwen on Nov 7, 2007 4:55:50 PM

Reality Check Ahead

 

 

Any concept as innovative as Net Promoter is bound to incite debate. Any methodology that is adopted so rapidly will naturally ruffle a few feathers. However, as a rule of thumb, the volume of complaints about any given innovation directly correlates to the level of business interest that is being threatened. Put simply, not everyone stands to gain from innovation in the customer loyalty marketplace.

 

 

To put the Net Promoter debate in context, let's examine who has the most to gain. Business leaders continue to embrace the Net Promoter discipline and, if the membership at netpromoter.com (or, for that matter, conference attendance) is any indication, they embrace it at an increasing rate. As corporations develop expertise with the Net Promoter discipline, the results speak for themselves, inspiring the advocates of the methodology to embrace it further.

 

 

If Net Promoter didn't achieve results, the industry would not stick with the approach. Of course there is always the risk of failure in implementation - we know from experience that learning curves vary considerably. But we are not talking about good practice right now, we are talking about Net Promoter adoption. And, in general, companies are voting with their feet by lining up to become part of the Net Promoter community.

From a PR perspective, this movement provides good word-of-mouth, but very little propaganda value. Large enterprises are not in the business of issuing press releases touting the success of their methodologies (although some do), and they certainly are not joining a hot debate in the blogosphere on Net Promoter as a topic. For them, the issue is not a religious quarrel that they are interested in joining. Instead, the PR debate is fueled almost exclusively by vendors who have commercial interests in the success or failure of Net Promoter.

 

 

Some market research firms regard their proprietary methodologies as a significant competitive advantage and a layer of insulation (due to the costs their clients must incur to switch to a different methodology). An open standard like Net Promoter supplies existential angst for these firms, and their anxiety has been heightened by growing interest in NPS among their client base. If clients question the value of complex, closed methodologies, these firms face an erosion of competitive power and a potential backlash. They certainly don't want their clients asking hard questions about how their results compare with the results Net Promoter advocates seem to enjoy. These vendors must fight back!

 

 

We will examine their arguments in a moment. First, there is another group of NPS naysayers we must address. This group is best characterized by practitioners who see a marketing opportunity in a contrarian position. Publish a book that claims "Net Promoter is all nonsense!" and watch sales grow. Cross your fingers and hope that nobody will actually read the book, since the claims are not well substantiated. Basically, the logic goes like this: if NPS is a tidal wave, let's find a way to capitalize on it as a marketing weapon. Once you get past the headlines, however, the arguments are not quite as compelling as the ad copy would suggest.

Both of these groups focus almost exclusively on one element of the Net Promoter discipline—the correlation between NPS and growth. Read their work--I dare you. They're page-turners, to be sure. Even after commissioning their own research the data does not refute NPS at all. In fact, pretty much all the research shows that NPS correlates to growth just fine. The argument they make in light of this fact is that that's no longer the point - THEIR methodology is better, even if only marginally so.

I would certainly hope that a complex, closed, 10-to-20 question model delivers superior results to a one-question, easy-to-understand, open approach. The problem is, if the results are only marginally better, are these complex methodologies worth the effort? Do they justify the confusion they generate among clients? If so, at what cost? Shall I sacrifice the benefits of organizational alignment that Net Promoter delivers, with its cohesive strategy and easy to understand metric? Should I endure low response rates and confused customers? Do I really need to pay your fees so you can explain my own data to me?

If so, your methodology had better have a spectacular advantage. It had better blow NPS away and not simply finish in a dead heat.



Nov 8, 2007 9:40 AM Guest Raul  says:

Thanks, Richard, for finally addressing some of this stuff. I'm curious to read your response to the recent research that does offer fairly specific criticisms beyond just questioning the link to growth (high margins of error, overstated detractor behavior, etc). You said in the post above that you would "examine their arguments in a moment." Is that in a coming post? You may have seen a few of us who have been defending NPS in the blogosphere are eager for Fred to give us some ammo to refute the claims of this so-called research.

 

Nov 8, 2007 9:46 AM Guest Guest  says:

Richard,

 

Sure, I'll take the bait! I work for one of those 'other market research firms' who promote a different methodology (Synovate Loyalty).

 

Our practice has evolved, in terms of methodology, from a heritage of more than 20 years in practical, client-centered research programs focused on customer satisfaction and loyalty. Our clients enjoy the benefits of what I might call 'practical science.' We believe in the power of good analytics, but only insofar as they are aimed squarely at answering business questions that matter. These business questions are often strategic and hugely significant to our clients, and we believe that reliable, accurate insight is essential. When we suggest that a client should 'do X,' we want to stand on a very firm fact base.

 

We have no interest in taking a contrarian position to NPS for PR benefit; our interest is in making sure clients get good results, which we believe come from using good methods.

 

The whole problem with the 'NPS debate' is the right vs. wrong tenor of the discussion. I take issue with camps at both extremes. Fred Reichheld, who you have partnered with, plainly asserts: 'Ask the ultimate question and very little else' (from 'The Ultimate Question,' p. 96). Other researchers and academics have launched their own campaigns to say that NPS is a mistake.

 

The truth lies in between. The 'likelihood to recommend' question that is the basis of NPS has been around in customer satisfaction and loyalty research for more than 20 years, at least. It's a good question, an important question, a question we use in virtually every study I can think of that we've ever done; but it is not the only question.

 

I have said elsewhere that one of the greatest benefits of the interest in NPS by executives is it shifts the focus from satisfaction to behavior. That is wonderful and long overdue; there is still a massive amount of customer research out there that is stuck in the satisfaction rut.

 

So, let's get reasonable. NPS has value and it's based on a tried-and-true measure of loyalty. But, let's also admit that there are other measures and methods that are valuable as well, that can answer important business questions about customer relationships that NPS cannot.

 

There is no 'race' between NPS and other methodologies, and we should stop arguing as if there is.

 

 

Dec 10, 2007 6:05 PM Guest Sam Deeks  says:

I love simple things that can be put to work NOW - and NPS is just that. Like many such simple things, I suspect that most of us simply go "Yes!" when we encounter them. We know they're useful, workable ideas. I plan to use NPS in some way in our audio feedback services: ask the question, record the score - and then follow up with a 'what makes you say that?' question... and then let 'em tell a story.

 

Dec 16, 2007 6:22 PM Guest Fred Hamburg  says:

Richard -- Can you point me to the  the research shows that NPS correlates to growth just fine?  I am only aware of the Journal of Marketing and Marketing Science papers, which did not find this to be the case.  I would like to show this other research to my colleagues who do not believe in Net Promoter. Thanks.