The objective was to assess the impact of new guidance on the conduct of narrative synthesis in systematic reviews of effectiveness, by means of a blinded comparison of guidance-led narrative synthesis against a meta-analysis of the same study data.The conclusions of the two syntheses were broadly similar. However, differences between the approaches meant that conclusions about the impact of moderators of effect appeared stronger when derived from the meta-analysis, whereas implications for future research appeared more extensive when derived from the narrative synthesis. These findings emphasize that a rigorously conducted narrative synthesis can add meaning and value to the findings of meta-analysis.The guidance framework provided a useful vehicle for structuring a narrative synthesis and increasing transparency and rigour of the process.While there may be risks with overinterpretation of study data, the framework, tools and techniques described in the guidance appear to increase the transparency and reproducibility of narrative synthesis.
Arai, L., N. Britten, J. Popay, H. Roberts, M. Petticrew, M. Rodgers and A.J. Sowden (2007) `Testing Methodological Developments in the Conduct of Narrative Synthesis: A Demonstration Review of Research on the Implementation of Smoke Alarm Interventions', Evidence and Policy3: 361-83.
2.
Barone, V.J. (1988) `An Analysis of Well-Child Parenting Classes: The Extent of Parent Compliance with Health Care Recommendations to Decrease Potential Injury of their Toddlers', dissertation, University of Kansas, Kansas City, KS.
3.
Campbell, R., P. Pound, C. Pope, N. Britten, R. Pill, M. Morgan and J. Donovan (2003) `Evaluating Meta-Ethnography: A Synthesis of Qualitative Research on Lay Experiences of Diabetes and Diabetes Care', Social Science and Medicine56: 671-84.
4.
Clamp, M. and D. Kendrick (1998) `A Randomised Controlled Trial of General Practitioner Safety Advice for Families with Children under 5 Years', BMJ316: 1576-9.
5.
Cooper, H. and L. V. Hedges, eds (1994) The Handbook of Research Synthesis. New York: Russell Sage Foundation.
6.
Davis, J.W. (1987) `Get Fired up: A Model for Developing In-School 4-H Programs', dissertation, Clemson University, Clemson, SC.
7.
Deeks, J., J. Higgins and D. Altman (2006) `Analysing and Presenting Results', in J. Higgins and S. Green (eds) Cochrane Handbook for Systematic Reviews of Interventions 4.2.6 [updated Sept. 2006]; Section 8. Chichester: John Wiley & Sons, Ltd.
8.
DiGuiseppi, C. and J.P.T.Higgins (2001) `Interventions for Promoting Smoke Alarm Ownership and Function', The Cochrane Database of Systematic Reviews: Reviews2001 Issue 2 John Wiley & Sons, LtdChichester, UK DOI: 10.1002/14651858.
9.
Dixon-Woods, M., S. Agarwal, D.J. Jones, B. Young and A. Sutton (2005) `Synthesising Qualitative and Quantitative Evidence: A Review of Possible Methods', Journal of Health Service Research Policy10: 45-53.
10.
Greenhalgh, T. (2004) `Meta-Narrative Mapping: A New Approach to the Systematic Review of Complex Evidence', in B. Hurwitz, T. Greenhalgh and V. Skultans (eds) Narrative Research in Health and Illness. Oxford: Blackwell Publishing .
11.
Hedges, L.V. and I. Olkin (1985) Statistical Methods for Meta-Analysis. London: Academic Press.
12.
Jadad, A.R., R.A. Moore, D. Carroll, C. Jenkinson, D.J. Reynolds, D.J. Gavaghan and H.J. Mcquay (1996) `Assessing the Quality of Reports of Randomized Clinical Trials: Is Blinding Necessary?', Controlled Clinical Trials17: 1-12.
13.
Jenkins, H.M., V. Blank, K. Miller, J..Turner and R.S. Stanwick (1996) `A Randomized Single-Blind Evaluation of a Discharge Teaching Book for Pediatric Patients with Burns', Journal of Burn Care and Rehabilitation17(1): 49-61.
14.
Jones, D., K.A. Roberts, M. Dixon-Woods, R. Fitzpatrick and K.R. Abrams (2003) `Bayesian Synthesis of Qualitative and Quantitative Evidence: Overview and Example', HDA Synthesis Series on Promoting Methodological Development in Evidence Synthesis: Understanding Bayesian Approaches to Synthesis.
15.
Kelly, B., C. Sein and P.L. McCarthy (1987) `Safety Education in a Pediatric Primary Care Setting' , Pediatrics79: 818-24.
16.
Kendrick, D., P. Marsh, K. Fielding and P. Miller (1999) `Preventing Injuries in Children: Cluster Randomised Controlled Trial in Primary Care', BMJ318: 980-3.
17.
King, W.J., T.P. Klassen, J. Leblanc, A.C. Bernard-Bonnin, Y. Robitaille, B. Pham, D. Coyle, M. Tenenbein and I.B. Pless (2001) `The Effectiveness of a Home Visit to Prevent Childhood Injury', Pediatrics108: 382-8.
18.
Mathews, J.R. (1988) `An Analysis of Dangerous Behaviour in Toddlers', dissertation, University of Kansas, Kansas City, KS.
19.
Pawson, R., T. Greenhalgh, G. Harvey and K. Walshe (2004) Realist Synthesis: An Introduction. Manchester: ESRC Research Methods Programme.
20.
Popay, J., H. Roberts, A. Sowden, M. Petticrew, L. Arai, N. Britten, M. Rodgers, K. Roen and S. Duffy (2006) Guidance on the Conduct of Narrative Synthesis in Systematic Reviews: Final Report. Swindon: ESRC Methods Programme.
21.
Roberts, K.A., M. Dixon-Woods, R. Fitzpatrick, K.R. Abrams and D.R. Jones (2002) `Factors Affecting Uptake of Childhood Immunisation: A Bayesian Synthesis of Qualitative and Quantitative Evidence', Lancet360: 1596-9.
22.
Thomas, K., R.S. Hassanein and E.R. Christophersen (1984) `Evaluation of Group Well-Child Care for Improving Burn Prevention Practices in the Home', Pediatrics74: 879-82.
23.
Williams, G.E. (1988) `An Analysis of Prenatal Education Classes: An Early Start to Injury Prevention', dissertation, University of Kansas, Kansas City, KS.
