Coca-Cola executives next did a flurry of additional market research projects. The news seemed to get worse. “Maybe the principal characteristics that made Coke distinctive, like its bite, consumers now describe as harsh,” the company’s head of American operations, Brian Dyson, said at the time. “And when you mention words like ‘rounded’ and ‘smooth,’ they say Pepsi. Maybe the way we assuage our thirst has changed.” The head of Coke’s consumer marketing research department in those years was a man named Roy Stout, and Stout became one of the leading advocates in the company for taking the results of the Pepsi Challenge seriously. “If we have twice as many vending machines, have more shelf space, spend more on advertising, and are competitively priced, why are we losing [market] share?” he asked Coke’s top management. “You look at the Pepsi Challenge, and you have to begin asking about taste.”
This was the genesis of what came to be known as New Coke. Coke’s scientists went back and tinkered with the fabled secret formula to make it a little lighter and sweeter—more like Pepsi. Immediately Coke’s market researchers noticed an improvement. In blind tastes of some of the early prototypes, Coke pulled even with Pepsi. They tinkered some more. In September of 1984, they went back out and tested what would end up as the final version of New Coke. They rounded up not just thousands but hundreds of thousands of consumers all across North America, and in head-to-head blind taste tests, New Coke beat Pepsi by 6 to 8 percentage points. Coca-Cola executives were elated. The new drink was given the green light. In the press conference announcing the launch of New Coke, the company’s CEO, Roberto C. Goizueta, called the new product “the surest move the company’s ever made,” and there seemed little reason to doubt what he said. Consumers, in the simplest and most direct manner imaginable, had been asked for their reaction, and they had said they didn’t much like the old Coke but they very much liked the new Coke. How could New Coke fail?
But it did. It was a disaster. Coke drinkers rose up in outrage against New Coke. There were protests around the country. Coke was plunged into crisis, and just a few months later, the company was forced to bring back the original formula as Classic Coke—at which point, sales of New Coke virtually disappeared. The predicted success of New Coke never materialized. But there was an even bigger surprise. The seemingly inexorable rise of Pepsi—which had also been so clearly signaled by market research—never materialized either. For the last twenty years, Coke has gone head-to-head with Pepsi with a product that taste tests say is inferior, and Coke is still the number one soft drink in the world. The story of New Coke, in other words, is a really good illustration of how complicated it is to find out what people really think.
The difficulty with interpreting the Pepsi Challenge findings begins with the fact that they were based on what the industry calls a sip test or a CLT (central location test). Tasters don’t drink the entire can. They take a sip from a cup of each of the brands being tested and then make their choice. Now suppose I were to ask you to test a soft drink a little differently. What if you were to take a case of the drink home and tell me what you think after a few weeks? Would that change your opinion? It turns out it would. Carol Dollard, who worked for Pepsi for many years in new-product development, says, “I’ve seen many times when the CLT will give you one result and the home-use test will give you the exact opposite. For example, in a CLT, consumers might taste three or four different products in a row, taking a sip or a couple sips of each. A sip is very different from sitting and drinking a whole beverage on your own. Sometimes a sip tastes good and a whole bottle doesn’t. That’s why home-use tests give you the best information. The user isn’t in an artificial setting. They are at home, sitting in front of the TV, and the way they feel in that situation is the most reflective of how they will behave when the product hits the market.”
Dollard says, for instance, that one of the biases in a sip test is toward sweetness: “If you only test in a sip test, consumers will like the sweeter product. But when they have to drink a whole bottle or can, that sweetness can get really overpowering or cloying.” Pepsi is sweeter than Coke, so right away it had a big advantage in a sip test. Pepsi is also characterized by a citrusy flavor burst, unlike the more raisiny-vanilla taste of Coke. But that burst tends to dissipate over the course of an entire can, and that is another reason Coke suffered by comparison. Pepsi, in short, is a drink built to shine in a sip test. Does this mean that the Pepsi Challenge was a fraud? Not at all. It just means that we have two different reactions to colas. We have one reaction after taking a sip, and we have another reaction after drinking a whole can. In order to make sense of people’s cola judgments, we need to first decide which of those two reactions most interests us.
