To develop a simple evaluation tool to assess methodologic rigor of the literature on patient compliance with medications, and to apply the tool to a sample of the literature.
METHODS:
A computerized search of the MEDLINE database (January 1980–December 1996) was performed. All English-language articles on compliance with medications were identified, using the MeSH terms patient-compliance and drug-therapy. A 10% sample was then randomly selected for review. Methodologic rigor was assessed on eight standards: study design, specification of patient sample, power analysis, specification of disease, specification of therapeutic regimen, duration of follow-up, definition of compliance, and compliance measurement. The raw scores of the eight standards were then combined in three summary scores, standardized from 0 to 100: study design, disease-related features, and compliance issues.
RESULTS:
Seventy-two articles from 719 identified were reviewed. The majority of the research articles were descriptive (63.9%), and patients in these studies were selected mainly from a convenience sample (41.7%). Just nine studies were multicenter studies, and three employed power analysis. The compliance definition was replicable in 41.7% of the studies. In 22 articles neither the compliance measure nor the criteria were stated. One-quarter of the studies (18) used a nonvalidated measure of compliance. Only two studies reached a score of 6 in the compliance measure, and eight studies used two different measures of compliance simultaneously. The median values in the summary scores were: study design 8.3, disease 42.9, compliance issues 50.
CONCLUSIONS:
The quality of the compliance research was generally poor. These low scores reflect very important shortcomings in the methodology. Such oversights make it difficult for the reader to critically assess the validity of the conclusions.
HaynesRBMcKibbonKAKananiR. Systematic review of randomized trials of interventions to assist patients to follow prescriptions for medications. Lancet1996;348: 383–6.
5.
BruerJT. Methodological rigor and citation frequency in patient compliance literature. Am J Public Health1982;72: 1119–23.
6.
KoltumAStoneGC. Past and current trends in patient non-compliance research: Focus on diseases, regimens-programs, and provider-disciplines. J Compliance Health Care1986;1: 21–32.
7.
CampbellDRStanleyJC. Experimental and quasi-experimental designs for research. Chicago: Rand McNally, 1963.
8.
StephensonBJRoweBHHaynesRBMachariaNMLeonG. Is the patient taking the treatment as prescribed? JAMA1993;269: 2779–81.
9.
CramerJAMattsonRHPreveyMLScheyerRDOuelletteVL. How often is medication taken as prescribed? A novel assessment technique. JAMA1989;261;3273–7.
10.
MoherDJadadARNicholGPenmanMTugwellPWalshS. Assessing the quality of randomized controlled trials: An annotated bibliography of scales and checklists. Controlled Clinical Trials1995;16: 62–73.
11.
AndrewesDAChuterPJDawsonMJEdenBWMooreRMFreestoneDSTrimethoprim and co-trimoxazole in the treatment of acute urinary tract infections: Patient compliance and efficacy. J R Coll Gen Pract1981;31:274–8.
12.
BeratisS. Noncompliance with iron chelation therapy in patients with beta thalassaemia. J Psychosom Res1989;33: 739–45.
13.
BerndtSMaierCSchutzHW. Polymedication and medication compliance in patients with chronic non-malignant pain. Pain1993;52: 331–9.
14.
BlackDMBrandRJGreenlickMHughesGSmithJ. Compliance to treatment for hypertension in elderly patients: The SHEP pilot study. Systolic hypertension in the elderly program. J Gerontol1987;42: 552–7.
15.
BlochMGurEShalevAY. Hypouricemic effect of zuclopenthixol: A potential marker of drug compliance. Psychopharmacology1992;109: 377–8.
16.
BroersBMorabiaAHirschelB. A cohort study of drug users' compliance with zidovudine treatment. Arch Intern Med1994;154: 1121–7.
17.
BrookoffD. Compliance with doxycycline therapy for outpatient treatment of pelvic inflammatory disease. South Med J1994;87: 1088–91.
18.
CaldwellJRFradePDReddyPJMayerJHKellyAR. An evaluation of a new patient compliance index using plasma propranolol levels. J Chronic Dis1984;37: 689–98.
19.
CarneyRMFreelandKEEisenSARichMWJaffeAS. Major depression and medication adherence in elderly patients with coronary artery disease. Health Psychol1995;14: 88–90.
20.
ChristiaanseMELavigneJVLernerCV. Psychosocial aspects of compliance in children and adolescents with asthma. J Dev Behav Pediatr1989;10: 75–80.
21.
ChumHJIlmolelianGRiederHLMsangiJMwinyiNZwahlenMImpact of the change from an injectable to a fully oral regimen on patient adherence to ambulatory tuberculosis treatment in Dar es Salaam Tanzania. Tuber Lung Dis1995;76:286–9.
22.
CochranSDGitlinMJ. Attitudinal correlates of lithium compliance in bipolar affective disorders. J Nerv Ment Dis1988;176: 457–64.
23.
ConwaySPPondMNHamnettTWatsonA. Compliance with treatment in adult patients with cystic fibrosis. Thorax1996;51: 29–33.
24.
Coudreaut-QuinnEAEmmonsMAMcMorrowMJ. Adherence and accuracy. Self-medication during inpatient psychiatric treatment. J Psychosoc Nurs Ment Health Serv1992;30: 32–6.
25.
CramerJAMattsonRHPreveyMLScheyerRDOuelletteVL. How often is medication taken as prescribed? A novel assessment technique. JAMA1989;261: 3273–7.
26.
De TullioPLKirkingDMArslanianCOlsonDE. Compliance measure development and assessment of theophylline therapy in ambulatory patients. J Clin Pharm Ther1987;12: 19–26.
27.
EisenSAMillerDKWoodwardRSMillerDSpitznagelEWindhamCA. The effect of a prescribed daily dose frequency on patient medication compliance. Arch Intern Med1990;150: 1881–4.
28.
EisenSAMillerDWoodwardRSSpitznagelEPrzybeckTR. The effect of compliance on the control of hypertension. J Gen Intern Med1987;2: 298–305.
29.
EllisonRSAltemeierWA. Effect of use of a measured dispensing device on oral antibiotic compliance. Clin Pediatr (Phila)1982;21: 668–71.
30.
FestaRSTamaroffMHChasalowFLanzkowskyP. Therapeutic adherence to oral medication regimens by adolescents with cancer. I. Laboratory assessment. J Pediatr1992;120: 807–11.
31.
FiocchiAZuccottiGVSalaMGiovanniniMRivaE. Compliance with pharmacologic prophylaxis and therapy in brochial asthma. Ann Allergy1994;73: 135–40.
32.
FlandersPMcNamaraJR. Prediction of compliance with an over-the-counter acne medication. J Psychol1984;118: 31–6.
33.
GauldVA. Written advice: Compliance and recall. J R Coll Gen Pract1981;31: 553–6.
34.
GibsonNAFergusonAEAitchisonTCPatonJY. Compliance with inhaled asthma medication in preschool children. Thorax1995;50: 1274–9.
35.
GillisLSKochAJoylM. Improving compliance in Xhosa psychiatric patients. S Afr Med J1989;76: 205–8.
36.
GranstromPA. Glaucoma patients not compliant with their drug therapy: Clinical and behavioral aspects. Br J Ophthalmol1982;66: 464–70.
37.
HilbrandsLBHoitsmaAJKoeneRA. Medication compliance after renal transplantation. Transplantation1995;60: 914–20.
38.
HornCREssexEHillPCochraneGM. Does urinary salbutamol reflect compliance with the aerosol regimen in patients with asthma? Respir Med1989;83: 15–8.
39.
HowardAFFrewinDBLeonelloPPTaylorWB. Compliance with anticoagulation drug therapy: A study on patients with prosthetic heart valve. Med J Aust1981;2: 274–6.
40.
InuiTSCarterWBPecoraroREPearlmanRADohanJJ. Variations in patient compliance with common long-term drugs. Med Care1980;18: 986–93.
41.
KapadiaCR. Eradication of Helicobacter pylori: In search of a regimen the patient may accept. Gastroenterology1995;109: 327–8.
42.
KellowayJSWyattRAAdlisSA. Comparison of patients' compliance with prescribed oral and inhaled asthma medications. Arch Intern Med1994;154: 1349–52.
43.
KellyGRScottJEMamonJ. Medication compliance and health education among outpatients with chronic mental disorders. Med Care1990;28: 1181–97.
44.
KruseWEggert-KruseWRampamaierJRunnebaumBWeberE. Compliance and adverse drug reactions: A prospective study with ethinylestradiol using continuous compliance. Clin Investig1993;71: 483–7.
45.
LeeCRNicholsonPWSouhamiRLSlevinMLHallMRDeshmukhAA. Patient compliance with prolonged low-dose oral etoposide for small cell lung cancer. Br J Cancer1993;67: 630–4.
46.
LevineAMRichardsonJLMarksGChanKGrahamJSelserJNCompliance with oral drug therapy in patients with hematologic malignancy. J Clin Oncol1987;5:1469–76.
47.
LittIFCuskeyWRRosebergA. Role of self-esteem and autonomy in determining medication compliance among adolescents with juvenile rheumatoid arthritis. Pediatrics1982;69: 15–7.
48.
MannMEliassonOPatelKZuWallackRL. A comparison of the effects of bid and qid dosing on compliance with inhaled flunisolide. Chest1992;101: 496–9.
49.
MarshBTAtkinsMJTalbotDJFaireyIT. A post-marketing acceptability study in 11,685 patients of the efficacy of timolol/bendrofluazide in the management of hypertension in general practice. J Int Med Res1987;15: 106–14.
50.
McKenneyJMMunroeWPWrightJTJr. Impact of an electronic medication compliance aid on long-term blood pressure control. J Clin Pharmacol1992;32: 277–83.
51.
MeinhofWGirardiRMStrackeA. Patient noncompliance in dermatomycosis. Results of a survey among dermatologists and general practitioners and patients. Dermatologica1984;169: 57–66.
52.
MengdenTBinswangerBSpuhlerTWeisserBVetterW. The use of self-measured blood pressure determinations in assessing dynamics of drug compliance in a study with amlopdipine once a day morning versus evening. J Hypertens1993;11: 1403–11.
53.
MoriskyDEGreenLWLevineDM. Concurrent and predictive validity of a self-reported measure of medication adherence. Med Care1986;24: 67–74.
54.
NorellSE. Accuracy of patient interviews and estimate by clinical staff in determining medication compliance. Soc Sci Med1981;15: 57–61.
55.
NyazemaNZ. Towards better patient drug compliance and comprehension: A challenge to medical and pharmaceutical services in Zimbabwe. Soc Sci Med1984;18: 551–4.
56.
OddssonOHBassMJDonnerAMcWhinneyIR. Behavior pattern and compliance with antihypertensive treatment. Acta Med Scand Suppl1985;693: 97–101.
57.
OlubodunJOFalaseAOColeTO. Drug compliance in hypertensive Nigerians with and without heart failure. Int J Cardiol1990;27: 229–34.
58.
OrmerodLPPrescottRJ. Inter-relationship between relapses, drug regimens and compliance with treatment in tuberculosis. Respir Med1991;85: 239–42.
59.
PiscitelliSCOcchipintiDJDanzigerLHHillCWestDPFischerJH. Therapeutic monitoring and pharmacist intervention in a Hansen's disease clinic. Ann Pharmacother1993;27: 1526–31.
60.
PiscitelliSCDanzigerLHHillCSlajchertAAWestDPFischerJH. Effectiveness of a dapsone compliance program in leprosy. Int J Dermatol1993;32: 206–9.
61.
PullarTPeakerSMartinMFBirdHAFeelyMP. The use of a pharmacological indicator to investigate compliance in patients with a poor response to antirheumatic therapy. Br J Rheumatol1988;27: 381–4.
62.
RobinsonGLGilbertsonADLitwackL. The effects of a psychiatric patient education to medication program on post-discharge compliance. Psychiatr Q1986;58: 113–8.
63.
RodewaldLEPichicheroME. Compliance with antibiotic therapy: A comparison of deuterium oxide trace urine bioassay bottle weights and parental reports. J Pediatr1993;123: 143–7.
64.
RoydhouseN. Antibiotic treatment of otitis media with effusion. N Z Med J1991;104: 380–2.
65.
RuggieroLSpiritoABondACoustanDMcGarveyS. Impact of social support and stress on compliance in women with gestational diabetes. Diabetes Care1990;13: 441–3.
66.
SametJHLibmanHStegerKADhawanRKChenJShevitzAHCompliance with zidovudine therapy in patients infected with human immunodeficiency virus type 1: A cross-sectional study in a municipal hospital clinic. Am J Med1992;92:495–502.
67.
SaundersLDIrwigLMWilsonTD. Hypertension management and patient compliance at Soweto polyclinic. S Afr Med J1982;61: 147–51.
68.
SchaferLCGlasgowREMcCaulKDDreherM. Adherence to IDDM regimens: Relationship to psychosocial variables and metabolic control. Diabetes Care1983;6: 493–8.
69.
SchectmanGHiattJHartzA. Telephone contacts do not improve adherence to niacin or bile acid sequestrant therapy. Ann Pharmacother1994;28: 29–35.
70.
SchwartzRHRodriquezWJGrundfastKM. Pharmacologic compliance with antibiotic therapy for acute otitis media: Influence on subsequent middle ear effusion. Pediatrics1981;68: 619–22.
71.
SclarDAChinASkaerTLOkamotoMPNakahiroRKGillMA. Effect of health education in promoting prescription refill compliance among patients with hypertension. Clin Ther1991;13: 489–95.
72.
ScottCSLoreCOwenRG. Increasing medication compliance and peer support among psychiatrically diagnosed patients. J Sch Health1992;62: 478–80.
73.
SkaerTLSclarDAMarkowskiDJWonJK. Effect of value-added utilities on prescription refill compliance and health care expenditure for hypertension. J Hum Hypertens1993;7: 515–8.
74.
SprietABeilerDDechorgnatJSimonP. Adherence of elderly patients to treatment with pentoxifylline. Clin Pharmacol Ther1980;27: 1–8.
75.
Van der WerfTSDadeGKVan der MarkTW. Patient compliance with tuberculosis treatment in Ghana: Factors influencing adherence to therapy in a rural service programme. Tubercle1990;71: 247–52.
76.
VolicerBJVolicerL. Randomized response technique for estimating alcohol use and noncompliance in hypertensive. J Stud Alcohol1982;43: 739–50.
77.
WeinsteinAGCuskeyW. Theophylline compliance in asthmatic children. Ann Allergy1985;54: 19–24.
78.
WidmerRBCadoretRJTroughtonE. Compliance characteristics of 291 hypertensive patients from a rural midwest area. J Fam Pract1983;17: 619–25.
79.
WilkinsonD. High-compliance tuberculosis treatment programme in a rural community. Lancet1994;343: 647–8.
80.
WindsorRABaileyWCRichardsJMJrManzellaBSoongSJBrooksM. Evaluation of the efficacy and cost effectiveness of health education methods to increase medication adherence among adults with asthma. Am J Public Health1990;80: 1519–21.
81.
WisemanICMillerR. Quantifying non-compliance in patients receiving digoxin — a pharmacokinetic approach. S Afr Med J1991;79: 155–7.
82.
WolffKHayARaistrickDCalvertRFeelyM. Measuring compliance in methadone maintenance patients: Use of a pharmacologic indicator to “estimate” methadone plasma levels. Clin Pharmacol Ther1991;50: 199–207.
