JK Rowling, The Cuckoo's Calling, and Regression to the Mean

You've probably heard by now that JK Rowling published a crime novel in April 2013 under the secret pen name Robert Galbraith. There's been a huge amount of buzz about the novel, titled The Cuckoo’s Calling, since the news was broken. The press has focused mainly on two details. First, the novel came out to a very good critical reception, including a starred review from Publisher's Weekly. And second, the book sold quite poorly in its first three months -- 1500 copies in Britain. (Since Galbraith’s real identity was revealed, of course, the book has rocketed up the bestseller charts.)  (Edit:  Shad has pointed out a source saying that the book sold  comparably to similar debuts, and sales numbers were actually similar to Harry Potter in its first few months.  So "poorly" might be too strong of a word.)

I was really excited to hear the news. I loved the Harry Potter series. Though I didn't read The Casual Vacancy since it seemed too literary for my tastes, The Cuckoo’s Calling is definitely something I'll be adding to my to-read list.

I've also enjoyed reading online reactions as the news broke. In some ways, they’ve been a litmus test of peoples’ underlying views on the publishing industry. Some people, like author Nathan Bransford, have written about how the book's poor sales illustrate the fleeting nature of publishing success. Others commentators took this as more evidence that publishers no longer have anything to offer writers.

And what’s my reaction to the Rowling story? It’s to recall a statistical principle known as regression to the mean.



Regression to the mean roughly says that any instance of superlative performance will likely be followed by a mediocre performance. For example, a student pilot who lands a plane exceptionally well is likely to make a mistake the next time around. An athlete who wins an Athlete of the Year award will have a surprisingly ho-hum record the following year. And the top performing branch of a chain restaurant is likely to show less growth than its peers the next year. So on, and so forth…

What causes this? When asked to explain this phenomenon, people come up with myriad reasons. Perhaps the pressure of doing so well the first time made the student pilot choke on the second landing. Maybe the Athlete of the Year got too confident and partied too much, which hurt her future performance. Maybe the restaurant branch got lazy and stop recruiting customers after their good year.

All us could possibly be true, but there is another, simpler explanation.

Think about it this way. In order to be exceptional in any field, what has to happen? Well, you'll likely have to be good at what you do. That's a given. But skill is not enough. To be an extreme success, all the stars have to align in your favor. The weather has to be perfect for your landing. You have to hit the winning shot in that crucial game. You have to have some unexpected influxes of restaurant customers. In other words, you have to be very, very lucky.

So what happens the next year? Well, your skill remains high. But what are the chances of everything going in your favor again? Your luck will most likely be average the second time around, and you overall performance will drop accordingly.

So you can see where this is going. Both Harry Potter and The Cuckoo’s Calling were well-written books. One was a commercial slamdunk that made Rowling the world's first billionaire author. The other didn't do as well, at least not within its first three months. Why is this? Did the book have a less commercial premise?  Was three months too slow to find an audience? Did the publisher screw up? Was there a secret alien conspiracy? We'll probably never know all the details. But before jumping to conclusions, make sure to take into account that humble principle known as regression to the mean.

Readers, what's your reaction to The Cuckoo's Calling?  Will you read it?


(BTW, If you’re interested in reading more about this and other types of statistical reasoning, check out Thinking Fast and Slow, by Daniel Kahneman.)


Hope you enjoyed this post! To get regular updates from this blog, use the subscription options on the sidebar.  By the way, friend of the blog Kristen Kittscher recently released her debut MG mystery The Wig in the Window.  Here's the blurb. 

 Best friends and seventh graders Sophie Young and Grace Yang have made a game out of spying on their neighbors. On one of their midnight stakeouts, they witness a terrifying, bloody scene at the home of their bizarre middle-school counselor Dr. Charlotte Agford (also known as Dr. Awkward).

At least, they think they do. The truth is that Dr. Agford was only making her famous pickled beets. But when Dr. Agford begins acting even weirder than usual, Sophie and Grace become convinced that she’s hiding something—and they’re determined to find out what it is.

Soon the girls are breaking secret codes, being followed by a strange blue car, and tailing strangers with unibrows and Texas accents. But as their investigation heats up, Sophie and Grace start to crack under the pressure. Will solving the case destroy their friendship?



Check it out!

12 comments:

  1. I prefer to think of it like Phillip Jones did: http://www.futurebook.net/content/cuckoo-nest

    Basically, it sold well. And it sold in line with how HP sold during the first three months. In all likelihood, given it was as well received as it was and (from my eye) more people were reviewing it just before the discovery, sales probably would've continued to grow (especially after the release of a second book to the series). Not to HP levels, but it probably would have sold well enough to be considered a pretty decent success.

    More than anything, people are responding on impulse and in dramatic fashion. There's no story to it except that JK Rowling published a book under another name, it was well received and did relatively well, and once people discovered it was her, sales spiked because she is a known (and popular) author. Nothing surprising.

    ReplyDelete
    Replies
    1. I'm glad to hear that, Shad. I remember early media reports said the book did well, and then everybody afterwards said the book did poorly. It's all depends on your point of reference, I guess. Compared to where Harry Potter is now, everything is going to look horrible.

      Delete
  2. I don't blame the publisher for leaking it...more money. :) Though, I''m surprised she didn't try harder in order to maintain what she was looking for. I just don't think readers liked the idea of being tricked and with a big name author it does feel like that a little bit. But they can do what they want. The same goes when I read an extremely well written engaging story that is not doing well...and then read a mediocre written one that is flying off the virtual shelves.

    And I read The Wig in the Window and loved it!

    ReplyDelete
    Replies
    1. Ooh, so cool that you read Wig already! It's on my shelf and I'm eager to start.

      Delete
  3. This is really interesting. And it makes sense. The likelihood that all stars will align over and over again is not realistic.

    What I like about this is it puts things in perspective. How often have we seen a blockbuster writer put out subsequent works that don't hit it big? I think the tendency in those cases is to think the author "lost it", but your theory supports the idea that regression to the mean is normal and to be expected. Which reduces the pressure.

    I suspect that pressure is part of why Rowling chose to publish under another name. How liberating not to worry about bestseller status with every single book!

    ReplyDelete
    Replies
    1. Exactly, Mira. You hit it on the dot that people always assume that the author (or athlete, or restaurant chain) "lost it." People by nature under-account for luck.

      Delete
  4. What an interesting analysis. Thanks for this post. Also, I just tagged you in a writer's blog hop (www.sylvialiuland.com), because I've enjoyed your blog for quite awhile.

    ReplyDelete
    Replies
    1. Thanks so much, Sylvia! That's really kind of you.

      Delete
  5. Will I read it? I went through HP with my daughter. Now I'm doing it all over again with my son. Total time elapsed, c. 5 years (shared custody means I can't read to him every night).

    As much as I've enjoyed it, I'm going to go fish for another author. (Someone mentioned... Kristen Kittscher's book? I should probably check it out.)

    ReplyDelete
    Replies
    1. That's a lot of time to spend with one author, Christian! I can see why you'd like to branch out a bit.

      Delete
  6. This is fascinating: a scientific explanation for the "sophomore slump." I had no idea such an explanation existed. Thanks. As far as Harry v. Cuckoo goes, despite the fact that both are well written, the former had the advantage of suggesting a world nobody had thought of before--and surely that's what stimulated such excitement.

    ReplyDelete
    Replies
    1. The world of harry potter is definitey a draw for those fans! Though there are plenty of bestsellers without intricate world building, so it seems there are multiple ways to become a superstar author :-)

      Delete