By David Tuller, DrPH
*October is crowdfunding month at Berkeley. I conduct this project as a senior fellow in public health and journalism and the university’s Center for Global Public Health. If you would like to support the project, here’s the place: https://crowdfund.berkeley.edu/project/22602
So here’s yet another paper with Professor Trudie Chalder of King’s College London as the senior author. That usually means there’s a lot to dig into! In this case, the journal is BMC Family Practice and the paper is titled “Integrated GP care for patients with persistent physical symptoms: feasibility cluster randomized trial.” Professor Chalder’s co-investigators include her KCL colleague, Professor Rona Ross-Morris, and other leading members of the biopsychosocial ideological brigades.
The study is part of this group’s larger project to promote their favorite psycho-behavioral interventions for the category of conditions they refer to as “persistent physical symptoms” (PPS) or “medically unexplained symptoms” (MUS). That would all be fine if their science could withstand serious scrutiny. But most of it is based on unproven hypotheses and relies on tarting up unimpressive results to look better than they are.
These investigators are also prone to embarrassing mistakes, as happened in the first paragraph of the published protocol for this feasibility study. In that first paragraph, the investigators mis-cited a seminal study that sought to calculate the cost to the National Health Service of treating patients with MUS. The effect of the mistake was to more than triple this apparent cost, which bolstered their claim that addressing the issue would lead to NHS savings.
The published protocol now carries a prominent correction.
*********
A 90-Minute Training Session
The new study, dubbed PRINCE Primary, is premised on the notion that GPs can learn in a 90-minute session how to redirect the cognitive processes of patients with PPS. For the study, 18 GP practices, each including multiple physicians, were randomized to receive the training or not, eight received it, and ten did not. Patients registered with the practices receiving the training were given resources, like self-help materials, that presented information about the development and treatment of PPS, per the notions of the investigators. In addition to the intervention, the patients in these practices received standard treatment, known as “treatment as usual.” The patients in the other practices were offered only treatment as usual.
This was a feasibility study, that is, the main goal was to determine if a full-scale trial was possible and desirable. In addition to assessing the willingness of GPs and patients to participate, the investigators road-tested multiple possible primary and secondary outcomes, including work and social adjustment, severity of physical symptoms, depression, and other measures. They did not calculate statistical significance for the measures.
The underlying hypothesis is essentially the same hypothesis underlying the approach of the ideological brigades to conditions with no identified organic etiology, including irritable bowel syndrome, ME/CFS, and others. As usual, the investigators trot out their triple-P schema of “predisposing,” “precipitating,” and “perpetuating” factors for these chronic illnesses, with perpetuating factors including such constructs as fear of engaging in activity and an excessive focus on symptoms. Per the hypothesis, changing those cognitions and/or behaviors will help patients find a path toward resumption of normal activities.
In this paper, the investigators once again base their argument on the prevalence of PPS. Here is their first paragraph:
Medically unexplained symptoms (MUS), otherwise referred to as persistent physical symptoms (PPS), cannot be explained by organic pathology after medical examinations. The prevalence of PPS in primary care is high, ranging between approximately 11 and 65%.
Let’s stop right there. The first sentence demonstrates the unproven assumptions driving this field of research. The fact is that patients relegated to these categories have conditions that have not been explained to date by organic pathology after medical examination by one or more clinicians. To say they “cannot be explained” by such pathology implies that no organic explanation exists and that those who conducted the medical examinations knew enough to exhaust all possibilities.
(Northwestern University law professor Steven Lubet and I recently published an essay in BMJ’s Medical Humanities that addressed many of the problematic claims about “medically unexplained symptoms” advanced by the ideological brigades.)
**********
Questions from their own data
Beyond that, their own data raise some questions about the second sentence. In this case, they found a very low prevalence rate of PPS. In seeking study participants among the GP practices that agreed to participate, the investigators trawled the medical records database with an expansive array of terms.
“The bespoke search algorithm incorporated a range of Read Codes [clinical terms] that were related to PPS including specific and widespread back pain, chronic/multiple widespread pain, dizziness, fatigue, fibromyalgia, headaches, non-cardiac chest pain and medically unexplained symptom,” they wrote.
Of 193,824 patients registered in the recruited GP practices, only 2978 were identified through this very thorough search as potentially eligible for the study. That’s 1.5%–a far cry from the 11 % to 65% they cite in the first paragraph. (In the paper, they seem to have rounded this number up to 2%.)
It’s not that earlier studies are “wrong” about the prevalence of PPS and this data point is “right.” Without understanding how investigators have defined and assessed prevalence, for example, whether it is prevalence among registered patients, or prevalence among patient visits, or some other metric–it’s hard to assess what the numbers mean.
A glance at the first of the three references, a US study, indicates that the 11% figure was calculated from responses from more than 200 primary care and other physicians about how many people with MUS they saw on their most recent day of clinical work. But that finding related to use of a broad definition of MUS that included cases in which doctors were continuing to pursue tests and consult with specialists to figure things out.
When doctors included only cases in which they were 95% certain patients’ complaints could not be explained through organic pathology, the MUS prevalence dropped to 4%. That number was even lower, 3%–for those identified as having multiple or chronic unexplained symptoms that caused “significant psychosocial impairment.” Those numbers look less impressive than 11% if you’re trying to present the burden of MUS on primary care as a major problem. But they’re certainly closer to the 2 % that the investigators found through their own methodology.
The 65% figure is also questionable. It is from a German study that involved in-depth interviews with around 300 primary care patients. The investigators asked participants about dozens of symptoms–65, if I’m reading this right. At least one participant reported experiencing as many as 37. The investigators then asked the treating clinicians if the symptoms mentioned by patients in the interviews were explained, unexplained, or ambiguous.
The investigators reported that participants had an average of 9.2 symptoms each, and almost two-thirds had at least one that was considered medically unexplained. But here’s the thing: If investigators offer participants dozens of possible symptoms to choose from, it isn’t surprising that some or many people might choose quite a few. But the investigators provide no evidence that the interviewees were bothered by or sought treatment for the specific symptoms said to be unexplained. The high percentage seems more like an artifact of the methodology than a real-world metric of morbidity.
**********
“Eminence-based medicine” at work
Finding their own low PPS prevalence rates should have triggered a glimmer of interest among investigators grounding the importance of their work in big claims about the high prevalence of PPS. Why are they ignoring this discrepancy? Why don’t they explain why they only found a prevalence of 1.5%, and discuss any implications for their framework?
In fact, they don’t seem to recognize the apparent contradiction. Recruitment estimates for the study were based on prevalence assumptions that do not seem to be borne out by their own data. Here’s what they wrote:
Although this [recruitment] method was time-efficient, recruitment of patients was relatively low and therefore further refinement of electronic patient searches is needed given that all patients who showed an interest gave consent if eligible. We anticipated that we would recruit approximately 20 patients from each GP practice given the high prevalence of PPS in primary care.”
They don’t raise an obvious possibility: Perhaps recruitment was “relatively low” because the prevalence of these patients is not as much of a burden on GPs as these experts have been arguing for years.
So what’s the paper’s main conclusion? Despite the recruitment issues, the trial is feasible, according to the criteria outlined by the investigators. The catch is that the intervention showed minimal evidence of efficacy across multiple outcomes at 12 and 24 months. So whether or not it is feasible seems beside the point. After touting the success of the feasibility measures, the investigators note in the last sentence of the abstract that “estimated effect sizes on potential clinical outcomes were small.”
Hm. How small? Well, here’s what they write:
None of the outcomes provided evidence for trial arm differences; all estimated effect sizes were small…The intervention needs to be optimised, possibly with therapist input, to bring about meaningful, enduring change in participant outcomes...Our low intensity intervention requires adaptation before we can test the efficacy in a fully powered randomised controlled trial.”
Given the poor outcome results, why would they conduct a follow-up trial? Why would anyone provide them with more funding when they have already shown that their intervention has little or no effect?
Under normal circumstances, that would be the end of it. But these disappointing results probably won’t stop this crew, if past behavior is any guide. No matter how many times members of the ideological brigades conduct studies that undermine their claims of efficacy, they declare success and move forward. Then they receive further funding for further study of whatever it is. “Eminence-based medicine” at its best.
Comments are closed.