Tag Archives: michael o’donnell

Wellness Promoters Agree: It Doesn’t Work

How many times do wellness promoters have to admit or prove that wellness doesn’t work before everyone finally believes them?

Whether one measures clinical outcomes/effectiveness, savings or productivity, the figures provided by the most vocal wellness promoters and the most “successful” wellness programs yield the same answer: Wellness doesn’t work.

  • Outcomes/Effectiveness

Let’s start with actual program effectiveness. Most recently, Ron Goetzel, head of the committee that bestows the C. Everett Koop Award, told the new healthcare daily STAT News that only about 100 programs work, while “thousands” fail.

In that estimate, which works out to a failure rate well north of 90%, he is joined by Michael O’Donnell, editor of the industry trade journal, the American Journal of Health Promotion (AJHP). O’Donnell says that as many as 95% of programs fail. (For the record, I have no beef with him, because he once willingly admitted that I am “not an idiot.”)

The best example of this Goetzel-O’Donnell consensus? McKesson, the 2015 Koop Award winner. McKesson’s own data –even when scrubbed of those pesky non-participants and dropouts who are too embarrassed to allow themselves to be weighed in – shows an increase in body mass and cholesterol:

graph1

Vitality Group, which contributed to this McKesson award-winning result as a vendor, wants your company to publicly disclose how many fat employees you have. Why? So that you are “pressured” (their word) into hiring a wellness vendor like Vitality. Yet Vitality admits it can’t get its own employees to lose weight.

McKesson and Vitality continue a hallowed tradition among Koop Award-winning programs of employees not losing noticeable weight. For instance, at Pfizer, the 2010 award-winner, employees who opened their weight-loss email lost all of three ounces:

graph2

Maybe it’s unfair to pick programs based on winning awards. Awards or not, those programs could have cut corners. Perhaps to find an exception to the rule that wellness can’t improve outcomes, we should look to the most expensive program, Aetna’s. Unfortunately, even Aetna registered only the slightest improvement in health indicators, throwing away $500/employee in the process. Why that much? Aetna decided to collect employee DNA to predict diabetes, even though reputable scientists have never posited that DNA can predict diabetes.

So even award winners, wellness vendors themselves and gold-plated programs can’t move the outcomes needle in a meaningful way, if at all. Bottom line: It looks like we finally have both consensus on the futility of wellness, and data to support the wellness industry admission that way north of 90% of programs do indeed fail to generate outcomes.

Savings

Because wellness promoters now say most programs fail, it is no surprise they also say most programs lose money. Once again, this isn’t us talking. The industry’s own guidebook – written by Goetzel and O’Donnell and dozens of other industry leaders — shows wellness loses money. We have posted that observation on ITL before, and no one objected.

However, very recently, the sponsors of this guidebook (the Health Enhancement Research Organization, or HERO) did finally take issue with our quoting statistics from their own guidebook. They pointed out — quite accurately — that their money-losing example was hypothetical. It did not involve numbers they would approve of, despite having published them. (At least, we think this is what HERO said. One of their board members has learned that they have sent a letter to members of the lay media, telling them not to publish our postings. We are told HERO’s objection centers on our quoting their report.)

To avoid a lawsuit for quoting figures they prefer us not to quote, we substituted their own real figures for their own hypothetical figures — and using real figures from Goetzel’s company, Truven Health Analytics, multiplied the losses.

This very same downloadable guidebook notes that these losses, as great as they are, actually exclude at least nine other sources of administrative costs–like internal costs, impact on morale, lost work time for screenings, etc. (Page 10). Truven also excludes a large number of medical costs (Page. 22):

graph3

One could only assume that including all these administrative and medical losses in the calculation would increase the total loss.

Lest readers think that this consensus guidebook is an anomaly, HERO is joined in its conclusion that wellness loses money by AJHP. AJHP published a meta-analysis showing a negative ROI from high-quality studies.

Productivity

RAND’s Soeren Mattke said it best:

“The industry went in with promises of 3-to-1 and 6-to-1 ROIs based on healthcare savings alone. Then research came out that said that’s not true. They said, ‘Fine, we are cost-neutral.’ Now research says: ‘Maybe not even cost-neutral.’ So they say: ‘It’s really about productivity, which we can’t really measure, but it’s an enormous return.'”

The AJHP stepped up to make Dr. Mattke appear prescient. After finding no ROI in high-quality studies, proponents decided to dispense with ROI altogether. “Who cares about ROI anyway?” were O’Donnell’s exact words.

Because health dollars couldn’t be saved, O’Donnell tried to estimate productivity impact. But honesty compelled him to admit that workers would need to devote about 4% of their time to working out to be 1% more productive on the job. Using his own time-and-motion figures, and adding in program costs, his math creates a loss exceeding $5,200/employee/year.

I would have to agree with O’Donnell, based on my experience in the 1990s as the CEO of a NASDAQ company. Ours was a call center company, which meant someone had to answer the phones. If I had let employees go to the gym instead of working, I would have had to pay other employees to cover for them. Our productivity would have taken a huge hit, even if the workouts bulked up employees’ biceps to the point where they could pick up the phone 1% faster.

Where Does This Leave Us?

Despite our using their own figures, wellness promoters may object to this analysis, saying they didn’t really intend for these conclusions to be reached. Intended or not, these are the conclusions from their figures, and theirs largely agree with ours, expressed in many previous blog posts on ITL. And, of course, our website, www.theysaidwhat.net, is devoted to exposing vendor lies. The bottom line is, no matter whose “side” you are on, the answer is the same. Assuming you look at promoters’ actual data or statements instead of listening to the spin, the conclusion is the same: Conventional wellness doesn’t work.

It’s time to move on.

11 Questions for Ron Goetzel on Wellness

We thank Ron Goetzel, representing Truven Health and Johns Hopkins, for posting on Insurance Thought Leadership a rebuttal to our viral November posting, “Workplace Wellness Shows No Savings.” Paradoxically, while he conceived and produced the posting, we are happy to publicize it for him. If you’ve heard that song before, think Mike Dukakis’s tank ride during his disastrous 1988 presidential campaign.

Goetzel’s rebuttal, “The Value of Workplace Wellness Programs,” raises at least 11 questions that he has been declining to answer. We hope he will respond here on ITL. And, of course, we are happy to answer any specific questions he would ask us, as we think we are already doing in the case of the point he raises about wellness-sensitive medical events. (We offer, for the third time, to have a straight-up debate and hope that he reconsiders his previous refusals.)

Ron:

(1)    How can you say you are not familiar with measuring wellness-sensitive medical events (WSMEs), like heart attacks? Your exact words are: “What are these events? Where have they been published? Who has peer-reviewed them?” Didn’t you yourself just review an article on that very topic, a study that we ourselves had hyperlinked as an example of peer-reviewed WSMEs in the exact article of ours that you are rebutting now? WSMEs are the events that should decline because of a wellness program. Example: If you institute a wellness program aimed at avoiding heart attacks, you’d measure the change in the number of heart attacks across your population as a “plausibility test” to see if the program worked, just like you’d measure the impact of a campaign to avoid teenage pregnancies by observing the change in the rate of teenage pregnancies. We’re not sure why you think that simple concept of testing plausibility using WSMEs needs peer review. Indeed, we don’t know how else one would measure impact of either program, which is why the esteemed Validation Institute recognizes only that methodology. (In any event, you did already review WMSEs in your own article.) We certainly concur with your related view that randomized controlled trials are impractical in workplace settings (and can’t blame you for avoiding them, given that your colleague Michael O’Donnell’s journal published a meta-analysis showing RCTs have negative ROIs).

(2)    How do you reconcile your role as Highmark’s consultant for the notoriously humiliating, unpopular and counterproductive Penn State wellness program with your current position that employees need to be treated with “respect and dignity”? Exactly what about Penn State’s required monthly testicle check and $1,200 fine on female employees for not disclosing their pregnancy plans respected the dignity of employees?

(3)    Which of your programs adhere to U.S. Preventive Services Task Force (USPSTF) screening guidelines and intervals that you now claim to embrace? Once again, we cite the Penn State example, because it is in the public domain — almost nothing about that program was USPSTF-compliant, starting with the aforementioned testicle checks.

(4)    Your posting mentions “peer review” nine times. If peer review is so important to wellness true believers,  how come none of your colleagues editing the three wellness promotional journals (JOEM, AJPM and AJHP) has ever asked either of us to peer-review a single article, despite the fact that we’ve amply demonstrated our prowess at peer review by exposing two dozen fraudulent claims on They Said What?, including exposés of four companies represented on your Koop Award committee (Staywell, Mercer, Milliman and Wellsteps) along with three fraudulent claims in Koop Award-winning programs?

(5)    Perhaps the most popular slide used in support of wellness-industry ROI actually shows the reverse — that motivation, rather than the wellness programs themselves, drives the health spending differential between participants and non-participants. How do we know that? Because on that Eastman Chemical-Health Fitness Corp. slide (reproduced below), significant savings accrued and were counted for 2005 – the year before the wellness program was implemented. Now you say 2005 was “unfortunately mislabeled” on that slide. Unless this mislabeling was an act of God, please use the active voice: Who mislabeled this slide for five years; where is the person’s apology; and why didn’t any of the analytical luminaries on your committee disclose this mislabeling even after they knew it was mislabeled? The problem was noted in both Surviving Workplace Wellness and the trade-bestselling, award-winning Why Nobody Believes the Numbers, which we know you’ve read because you copied pages from it before Wiley & Sons demanded you stop? Was it because HFC sponsors your committee, or was it because Koop Committee members lack the basic error identification skills taught in courses on outcomes analysis that no committee member has ever passed?

wellness-article

(6)    Why doesn’t anyone on the Koop Committee notice any of these “unfortunate mislabelings” until several years after we point out that they are in plain view?

(7)    Why is it that every time HFC admits lying, the penalty that you assess — as president of the Koop Award Committee — is to anoint their programs as “best practices” in health promotion? (See Eastman Chemical and Nebraska in the list below.) Doesn’t that send a signal that Dr. Koop might have objected to?

(8)    Whenever HFC publishes lengthy press releases announcing that its customers received the “prestigious” Koop Award, it always forgets to mention that it sponsors the awards. With your post’s emphasis on “the spirit of full disclosure” and “transparency,” why haven’t you insisted HFC disclose that it finances the award (sort of like when Nero used to win the Olympics because he ran them)?

(9)    Speaking of “best practices” and Koop Award winners, HFC’s admitted lies about saving the lives of 514 cancer victims in its award-winning Nebraska program are technically a violation of the state’s anti-fraud statute, because HFC accepted state money and then misrepresented outcomes. Which is it: Is HFC a best practice, or should it be prosecuted for fraud?

(10)    RAND Corp.’s wellness guru Soeren Mattke, who also disputes wellness ROIs, has observed that every time one of the wellness industry’s unsupportable claims gets disproven, wellness defenders say they didn’t really mean it, and they really meant something else altogether. Isn’t this exactly what you are doing here, with the “mislabeled” slide, with your sudden epiphany about following USPSTF guidelines and respecting employee dignity and with your new position that ROI doesn’t matter any more, now that most ROI claims have been invalidated?

(11)    Why are you still quoting Katherine Baicker’s five-year-old meta-analysis claiming 3.27-to-1 savings from wellness in (roughly) 16-year-old studies, even though you must be fully aware that she herself has repeatedly disowned it and now says: “There are very few studies that have reliable data on the costs and benefits”? We have offered to compliment wellness defenders for telling the truth in every instance in which they acknowledge all her backpedaling whenever they cite her study. We look forward to being able to compliment you on truthfulness when you admit this. This offer, if you accept it, is an improvement over our current Groundhog Day-type cycle where you cite her study, we point out that she’s walked it back four times, and you somehow never notice her recantations and then continue to cite the meta-analysis as though it’s beyond reproach.

To end on a positive note, while we see many differences between your words and your deeds, let us give you the benefit of the doubt and assume you mean what you say and not what you do. In that case, we invite you to join us in writing an open letter to Penn State, the Business Roundtable, Honeywell, Highmark and every other organization (including Vik Khanna’s wife’s employer) that forces employees to choose between forfeiting large sums of money and maintaining their dignity and privacy. We could collectively advise them to do exactly what you now say: Instead of playing doctor with “pry, poke, prod and punish” programs, we would encourage employers to adhere to USPSTF screening guidelines and frequencies and otherwise stay out of employees’ personal medical affairs unless they ask for help, because overdoctoring produces neither positive ROIs nor even healthier employers. And we need to emphasize that it’s OK if there is no ROI because ROI doesn’t matter.

As a gesture to mend fences, we will offer a 50% discount to all Koop Committee members for the Critical Outcomes Report Analysis course and certification, which is also recognized by the Validation Institute. This course will help your committee members learn how to avoid the embarrassing mistakes they consistently otherwise make and (assuming you institute conflict-of-interest rules as well to require disclosure of sponsorships) ensure that worthy candidates win your awards.