The degree to which the effects of acupuncture treatment vary between acupuncturists is unknown. We used a large individual patient dataset of trials of acupuncture for chronic pain to assess practitioner heterogeneity.
Methods:
Individual patient data linked to identifiable acupuncturists were drawn from a dataset of 39 high-quality trials of acupuncture, where the comparators were either sham acupuncture or non-acupuncture controls, such as standard care or waitlist. Heterogeneity among acupuncturists was assessed by meta-analysis.
Results:
A total of 1206 acupuncturists in 13 trials were included. Statistically significant heterogeneity was found in trials with sham-control groups (p < 0.0001) and non-acupuncture control groups (p <0.0001). However, the degree of heterogeneity was very small, with the observed distribution of treatment effects virtually overlapping that expected by chance. For instance, for non-acupuncture-controlled trials, the proportion of acupuncturists with effect sizes half a standard deviation greater or less than average was expected to be 34%, but was observed to be 37%. A limitation is that the trials included a relatively limited range of acupuncturists, mainly physician-acupuncturists.
Discussion:
Although differences in effects between acupuncturists were greater than expected by chance, the degree of variation was small. This suggests that most chronic pain patients in clinical practice would have similar results to those reported in high-quality trials; comparably, we did not find evidence to suggest that greater standardization of acupuncture practice would improve outcomes. Further research needs to be conducted exploring variability using a sample of acupuncturists with a broader range of practice styles, training and experience.
LeeKJThompsonSG.Clustering by health professional in individually randomised trials. BMJ2005; 330(7483): 142–144.
2.
StirratGMFarrowSCFarndonJ, et al. The challenge of evaluating surgical procedures. Ann R Coll Surg Engl1992; 74(2): 80–84.
3.
RobertsC.The implications of variation in outcome between health professionals for the design and analysis of randomized controlled trials. Stat Med1999; 18(19): 2605–2615.
4.
GreenfieldSKaplanSHKahnR, et al. Profiling care provided by different groups of physicians: effects of patient case-mix (bias) and physician-level clustering on quality assessment results. Ann Intern Med2002; 136(2): 111–121.
5.
HooverDR.Clinical trials of behavioural interventions with heterogeneous teaching subgroup effects. Stat Med2002; 21(10): 1351–1364.
6.
WampoldBEBrownGS.Estimating variability in outcomes attributable to therapists: a naturalistic study of outcomes in managed care. J Consult Clin Psychol2005; 73(5): 914–923.
7.
WaltersSJ.Therapist effects in randomised controlled trials: what to do about them. J Clin Nurs2010; 19(7–8): 1102–1112.
8.
WalwynRRobertsC.Therapist variation within randomised trials of psychotherapy: implications for precision, internal and external validity. Stat Methods Med Res2010; 19(3): 291–315.
9.
VickersAJVertosickEALewithG, et al. Acupuncture for chronic pain: update of an individual patient data meta-analysis. J Pain2018; 19: 455–474.
10.
VickersAZollmanC.ABC of complementary medicine. Acupuncture. BMJ1999; 319(7215): 973–976.
11.
SeoYLeeISJungWM, et al. Motion patterns in acupuncture needle manipulation. Acupunct Med2014; 32(5): 394–399.
12.
VickersAJCroninAMMaschinoAC, et al. Acupuncture for chronic pain: individual patient data meta-analysis. Arch Intern Med2012; 172(19): 1444–1453.
13.
HinmanRSMcCroryPPirottaM, et al. Acupuncture for chronic knee pain: a randomized clinical trial. JAMA2014; 312(13): 1313–1322.
14.
ThomasKJMacPhersonHThorpeL, et al. Randomised controlled trial of a short course of traditional acupuncture compared with usual care for persistent non-specific low back pain. BMJ2006; 333(7569): 623.
15.
BrinkhausBWittCMJenaS, et al. Acupuncture in patients with chronic low back pain: a randomized controlled trial. Arch Intern Med2006; 166(4): 450–457.
16.
DienerHCKronfeldKBoewingG, et al. Efficacy of acupuncture for the prophylaxis of migraine: a multicentre randomised controlled clinical trial. Lancet Neurol2006; 5(4): 310–316.
17.
Suarez-AlmazorMELooneyCLiuY, et al. A randomized controlled trial of acupuncture for osteoarthritis of the knee: effects of patient-provider communication. Arthritis Care Res2010; 62(9): 1229–1236.
18.
WhitePBishopFLPrescottP, et al. Practice, practitioner, or placebo? A multifactorial, mixed-methods randomized controlled trial of acupuncture. Pain2012; 153(2): 455–462.
19.
WittCBrinkhausBJenaS, et al. Acupuncture in patients with osteoarthritis of the knee: a randomised trial. Lancet2005; 366(9480): 136–143.
20.
BermanBMLaoLLangenbergP, et al. Effectiveness of acupuncture as adjunctive therapy in osteoarthritis of the knee: a randomized, controlled trial. Ann Intern Med2004; 141(12): 901–910.
21.
CarlssonCPSjolundBH.Acupuncture for chronic low back pain: a randomized placebo-controlled study with long-term follow-up. Clin J Pain2001; 17(4): 296–305.
22.
ChenLXMaoJJFernandesS, et al. Integrating acupuncture with exercise-based physical therapy for knee osteoarthritis: a randomized controlled trial. J Clin Rheumatol2013; 19(6): 308–316.
23.
CherkinDCShermanKJAvinsAL, et al. A randomized trial comparing acupuncture, simulated acupuncture, and usual care for chronic low back pain. Arch Intern Med2009; 169(9): 858–866.
24.
EndresHGBowingGDienerHC, et al. Acupuncture for tension-type headache: a multicentre, sham-controlled, patient-and observer-blinded, randomised trial. J Headache Pain2007; 8(5): 306–314.
25.
HaakeMMullerHHSchade-BrittingerC, et al. German acupuncture trials (GERAC) for chronic low back pain: randomized, multicenter, blinded, parallel-group trial with 3 groups. Arch Intern Med2007; 167(17): 1892–1898.
26.
FosterNEThomasEBarlasP, et al. Acupuncture as an adjunct to exercise based physiotherapy for osteoarthritis of the knee: randomised controlled trial. BMJ2007; 335(7617): 436.
27.
Guerra de HoyosJAAndres Martin MdelCBassasyBaenadeLeonE, et al. Randomised trial of long term effect of acupuncture for shoulder pain. Pain2004; 112(3): 289–298.
28.
IrnichDBehrensNMolzenH, et al. Randomised trial of acupuncture compared with conventional massage and ‘sham’ laser acupuncture for treatment of chronic neck pain. BMJ2001; 322(7302): 1574–1578.
29.
KennedySBaxterGDKerrDP, et al. Acupuncture for acute non-specific low back pain: a pilot randomised non-penetrating sham controlled trial. Complement Ther Med2008; 16(3): 139–146.
30.
KerrDPWalshDMBaxterD.Acupuncture in the management of chronic low back pain: a blinded randomized controlled trial. Clin J Pain2003; 19(6): 364–370.
31.
KleinhenzJStreitbergerKWindelerJ, et al. Randomised clinical trial comparing the effects of acupuncture and a newly designed placebo needle in rotator cuff tendinitis. Pain1999; 83(2): 235–241.
32.
LiYZhengHWittCM, et al. Acupuncture for migraine prophylaxis: a randomized controlled trial. CMAJ2012; 184(4): 401–410.
33.
LindeKStrengAJurgensS, et al. Acupuncture for patients with migraine: a randomized controlled trial. JAMA2005; 293(17): 2118–2125.
34.
MelchartDStrengAHoppeA, et al. Acupuncture in patients with tension-type headache: randomised controlled trial. BMJ2005; 331(7513): 376–382.
35.
ScharfHPMansmannUStreitbergerK, et al. Acupuncture and knee osteoarthritis: a three-armed randomized trial. Ann Intern Med2006; 145(1): 12–20.
36.
VasJMendezCPerea-MillaE, et al. Acupuncture as a complementary therapy to the pharmacological treatment of osteoarthritis of the knee: randomised controlled trial. BMJ2004; 329(7476): 1216.
37.
VasJOrtegaCOlmoV, et al. Single-point acupuncture and physiotherapy for the treatment of painful shoulder: a multicentre randomized controlled trial. Rheumatology2008; 47(6): 887–893.
38.
VasJPerea-MillaEMendezC, et al. Efficacy and safety of acupuncture for chronic uncomplicated neck pain: a randomised controlled study. Pain2006; 126(1–3): 245–255.
39.
WhitePLewithGPrescottP, et al. Acupuncture versus placebo for the treatment of chronic mechanical neck pain: a randomized, controlled trial. Ann Intern Med2004; 141(12): 911–919.
40.
JenaSWittCMBrinkhausB, et al. Acupuncture in patients with headache. Cephalalgia2008; 28(9): 969–979.
41.
WittCMJenaSBrinkhausB, et al. Acupuncture for patients with chronic neck pain. Pain2006; 125: 98–106.
42.
WittCMJenaSBrinkhausB, et al. Acupuncture in patients with osteoarthritis of the knee or hip: a randomized, controlled trial with an additional nonrandomized arm. Arthritis Rheum2006; 54(11): 3485–3493.
43.
WittCMJenaSSelimD, et al. Pragmatic randomized trial evaluating the clinical and economic effectiveness of acupuncture for chronic low back pain. Am J Epidemiol2006; 164(5): 487–496.
44.
VickersAJReesRWZollmanCE, et al. Acupuncture for chronic headache in primary care: large, pragmatic, randomised trial. BMJ2004; 328(7442): 744.
45.
MacPhersonHTilbrookHRichmondS, et al. Alexander technique lessons or acupuncture sessions for persons with chronic neck pain: a randomized trial. Ann Intern Med2015; 163(9): 653–662.
46.
CherkinDCEisenbergDShermanKJ, et al. Randomized trial comparing traditional Chinese medical acupuncture, therapeutic massage, and self-care education for chronic low back pain. Arch Intern Med2001; 161(8): 1081–1088.
47.
HunterRFMcDonoughSMBradburyI, et al. Exercise and auricular acupuncture for chronic low-back pain: a feasibility randomized-controlled trial. Clin J Pain2012; 28(3): 259–267.
48.
LansdownHHowardKBrealeyS, et al. Acupuncture for pain and osteoarthritis of the knee: a pilot study for an open parallel-arm randomised controlled trial. BMC Musculoskelet Disord2009; 10: 130.
49.
SalterGCRomanMBlandMJ, et al. Acupuncture for chronic neck pain: a pilot for a randomised controlled trial. BMC Musculoskelet Disord2006; 7: 99.
50.
WeissJQuanteSXueF, et al. Effectiveness and acceptance of acupuncture in patients with chronic low back pain: results of a prospective, randomized, controlled trial. J Altern Complement Med2013; 19(12): 935–941.
51.
WilliamsonLWyattMRYeinK, et al. Severe knee osteoarthritis: a randomized controlled trial of acupuncture, physiotherapy (supervised exercise) and standard management for patients awaiting knee replacement. Rheumatology2007; 46(9): 1445–1449.
52.
BiancoFJJrRiedelERBeggCB, et al. Variations among high volume surgeons in the rate of complications after radical prostatectomy: further evidence that technique matters. J Urol2005; 173(6): 2099–2103.
53.
BiancoFJJrVickersAJCroninAM, et al. Variations among experienced surgeons in cancer control after open radical prostatectomy. J Urol2010; 183(3): 977–982.
54.
BeggCBRiedelERBachPB, et al. Variations in morbidity after radical prostatectomy. N Engl J Med2002; 346(15): 1138–1144.
55.
MacPhersonHMaschinoACLewithG, et al. Characteristics of acupuncture treatment associated with outcome: an individual patient meta-analysis of 17,922 patients with chronic pain in randomised controlled trials. PLoS ONE2013; 8(10): e77438.
56.
ThomasKJMacPhersonHRatcliffeJ, et al. Longer term clinical and economic benefits of offering acupuncture care to patients with chronic low back pain. Health Technol Assess2005; 9(32): iii–iv, ix–x, 1–109.
57.
WittCMLudtkeRWegscheiderK, et al. Physician characteristics and variation in treatment outcomes: are better qualified and experienced physicians more successful in treating patients with chronic pain with acupuncture?J Pain2010; 11(5): 431–435.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
