Abstract
Purpose:
The main objective of this study was to examine the publication pattern of N-acetylcysteine (NAC) research output for paracetamol overdose at the global level.
Methods:
Data were searched for documents that contained specific words regarding NAC and paracetamol as keywords in the title and/or abstract and/or keywords. Scientific output was evaluated based on a methodology developed and used in other bibliometric studies. Research productivity was adjusted to the national population and nominal gross domestic product per capita.
Results:
The criteria were met by 367 publications from 33 countries. The highest number of articles associated with the use of NAC in paracetamol overdose was from the United States of America (USA; 39.78%), followed by the United Kingdom (UK; 11.99%). After adjusting for economy and population power, USA (2.822), Iran (1.784) and UK (1.125) had the highest research productivity. The total number of citations at the time of data analysis (14 March 2014) was 8785 with an average of 23.9 citations per document and a median (interquartile range) of 6 (1–22). The h-index of the retrieved documents was 48. The highest h-index was 32 for USA, followed by 20 for UK. Furthermore, the highest number of collaborations with international authors for each country was held by USA with 11 countries, followed by Canada with 7 countries.
Conclusion:
The amount of NAC-based research activity was low in some countries, and more effort is needed to bridge this gap and to promote better evaluation of NAC use worldwide. Our findings demonstrate that NAC use for paracetamol overdose remains a hot issue in scientific research and may have a larger audience compared with other toxicological aspects. Editors and authors in the field of toxicology might usefully promote the submission of work on NAC in future to improve their journal’s impact.
Introduction
Initially, N-acetylcysteine (NAC) was used via inhalation as a mucolytic drug. Currently, NAC is administered orally or intravenously (IV) for the treatment of paracetamol overdose. 1 In 1974, Mitchell and colleagues reported that increasing glutathione level in the liver could be achieved through administration of NAC and therefore could help in preventing paracetamol – induced hepatotoxicity. 2 Also in 1974, the work by Prescott et al. demonstrated that NAC was an effective antidote in patients who presented to hospital after paracetamol poisoning. 3 The United States Food and Drug Administration approved the use of oral NAC preparations in 1985 and IV-NAC preparations in 2004. IV-NAC is now the standard treatment for paracetamol poisoning in the United Kingdom (UK) and the United States of America (USA), and also in Asia, Australia, Canada and Europe. 4
The evolution of scientific output in the field of toxicology has been poorly explored to date and there are few internationally published reports on research activity in toxicology. 5 –13 Paracetamol also maintains substantial interest among researchers, as demonstrated by the continuous growth of scientific literature. During the past years, publications involving paracetamol have increased 60 times. 13,14 It is interesting to note that publications in general medical field have only increased threefold. To the best of our knowledge, there is a lack of data concerning the evaluation of scientific research productivity of NAC use in paracetamol overdose worldwide. Scientific progress is one of the most important indicators for the community and economic development of different countries. 15 There are several well-known databases, including PubMed, Scopus, Web of Science (i.e. Thomson Reuters Institute for Scientific Information (ISI)) and Google Scholar, for indexing international publications in biomedical sciences. 16 The evaluation of scientific research is an essential task where the purpose of evaluation is to determine – and, where possible, improve – its productivity. Given that the outcome of scientific activity is only known when the authors communicate their findings in a publication distributed among the scientific community, bibliometric indicators are of great importance. 17 Bibliometric analysis is a useful tool to obtain a clear picture of the current state of scientific research and, in particular, areas that allow researchers to recognize and undertake new lines of research. 18 This type of analysis utilizes quantitative analysis and statistics to obtain the bibliographical works within a given field, topic, institution or country. 19 –21 This study will lead to a better understanding of the current and future status of research related to NAC use for paracetamol overdose worldwide.
The aims of this study were: (1) to examine the publication pattern of NAC research output at the global level; (2) to analyse the publication pattern and impact of the most productive countries; (3) to analyse the collaborative patterns among the top 10 most productive countries; (4) to examine the productivity and impact of the most prolific institutions; (5) to examine the productivity and impact of the most prolific authors; (6) to examine the impact of the most preferred journals; and (7) to identify the highly cited papers.
Methods
Search strategy
The data used in this study were based on the Scopus online database. A comprehensive online search was performed using SciVerse Scopus, which is one of the world’s largest databases of peer-reviewed literature. Scopus covers nearly 18,000 titles from 5000 publishers worldwide, contains 41 million records and provides 100% coverage of MEDLINE. 22 Elsevier, combining the characteristics of both the Web of Science and PubMed, developed the Scopus database. These characteristics allow for an enhanced service for educational and academic needs as well as for medical literature research and bibliometric analysis. Scopus offers basic search and advanced search features. In the basic search, the results for the chosen keywords can be limited by the date of publication, subject area or document type. 11,16,23
The keywords entered into the Scopus search engine to achieve the objectives of this study were ‘acetylcysteine’, ‘N-acetyl-
The collected data were used to generate the following information: (a) total and trends of contributions in NAC research during all previous years up to 31 December 2012; (b) research productivity and collaboration patterns by country; (c) type of the articles (e.g. editorial, review article, original article, brief communication and case letter to the editor); (d) journals in which international researchers published; (e) the productivity and impact of the most prolific authors and institutions; and (f) the citations received by the publications.
Indices of research productivity
Scientific output was evaluated based on a methodology developed and used in other bibliometric studies.
11,14,24,25
The measurements of bibliometric analysis (e.g. countries, cited articles and institutions) were converted to the rank order using the standard competition ranking. We took in our consideration only the 10 top ranks. If the measurements of bibliometric analysis have the same ranking number, then a gap is left in the following ranking numbers. The h-index for data collected from Scopus is presented. The h-index is a country’s number of articles (h) that have received at least h citations. It quantifies both country-scientific productivity and scientific impact and it is also applicable to scientists, journals, and so on.
26
That is to say, a country with an h-index of 10 has published 10 documents, each has attracted at least 10 citations. Documents with fewer than 10 citations are not calculated by the index. The h-index was originally developed as a way of qualifying research performance.
27
Two common performance indicators were considered for the top 10 ranked journals using data from the most recent year available.
28
First, the journal impact factor (IF) was evaluated using the Journal Citation Report (Web of Knowledge) 2012 science edition by Thomson Reuters (New York, USA). The second measure of journal performance used in this study was the SCImago Journal Rank (SJR) indicator. A detailed explanation on how the SJR calculation is made can be found on the SCImago website (available at: http://www.scimagojr.com/SCImagoJournalRank.pdf, accessed 29 March 2014). Publication activity was adjusted for the top 10 countries, categorized by population size and gross domestic product (GDP), which were retrieved from the online databases of the World Bank.
29
An adjustment index (AI) was calculated using the following formula:
Ethical approval
The institutional review board (IRB) at An-Najah National University does not require submission of an IRB application for a bibliometric study. The IRB confirmed that there is no risk to human subjects in this type of research since the data are based on published literature and, as secondary data, did not involve any interactions with human subjects.
Statistical analysis
Data from Scopus were exported to Microsoft Excel® and then transferred to the Statistical Package for Social Sciences (SPSS; Version 15, SPSS Inc, Chicago, Illinois, USA) program for analysis. Variables that were not normally distributed, such as the number of citations, are expressed as a median (Q1–Q3: interquartile range). Categorical data are expressed as numbers with percentages. Pearson’s correlation analysis was used to examine the association between research productivity and country variables. Reliability and validity are important for conducting a pilot study in this method. Inter-method reliability assesses the variation in measurements of the same target when made by different methods or instruments but by the same person. 31 –33 Depending on the variables’ level of measurement, an intraclass correlation coefficient can statistically determine the reliability for numerical variables. It is recommended that more than 95% reliability should be achieved for important variables. 31 –35 Intraclass correlation coefficient was calculated to determine the inter-method variability using SPSS. 31,36 To assess the reliability of our method, we compared two different methods of data collection. In the first one, we used data extraction, whilst in the second one, all publications related to each author in the top 10 lists were extracted and reviewed. The intraclass correlation coefficient value between the two methods was 0.98. There was an excellent agreement between the two methods, indicating that our method was valid.
Results
Type of documents
Using the methodology stated above, 367 documents were retrieved comprising 230 (62.7%) original journal articles, 46 (12.5%) letters to the editor, 34 (9.3%) review articles and 57 (15.5%) other types of publication such as notes or editorials. The language in which the documents were published was dominated by English (n = 338, 92.1%), followed distantly by German (n = 19), Dutch (n = 22) and French (n = 7).
Annual research productivity
The annual number of documents published between 1976 and 2012 indicated that research output was low in the first two decades but showed an obvious increase in the last years (Figure 1). The annual distribution of documents showed a non-linear growth rate, with a publication peak between 2008 and 2011. There was a moderately positive but statistically significant correlation between time and number of publications (r = 0.62, p < 0.001) between 1976 and 2012. The first article related to NAC in Scopus was published by Piperno and Berssenbruegge in The Lancet in 1976. 37

Total articles included in a bibliometric analysis of worldwide publications related to NAC use for paracetamol overdose from 1976 to 2012. NAC: N-acetylcysteine.
Research productivity and collaboration stratified by country
In total, documents were published in 33 countries. Table 1 shows the ranking list of the 10 countries whose researchers published the largest number of articles related to NAC use in paracetamol overdose during the period from 1976 to 2012. When the data were analysed by country, the largest number of articles was from USA (39.78%), followed by UK (11.99%) (Table 1). After adjusting for economy and population power, USA (2.822), Iran (1.784) and UK (1.125) had the highest research productivity (Table 1). Number of publications in each country was compared with country variables such as population and GDP. There was a strong correlation between the number of published articles related to NAC use in paracetamol overdose and the population size in millions (r = 0.92, p < 0.001). There was also a strong correlation between the number of publications of each country and its GDP (r = 0.96, p < 0.001).
Research productivity, collaboration and citation analysis stratified by country and presented as top 10 ranking.
SCR: standard competition ranking; USA: United States of America; UK: United Kingdom; Q1–Q3: lower quartile – upper quartile; AI: adjustment index.
aEqual countries have the same ranking number and then a gap is left in the ranking numbers.
bAn AI was calculated using the following formula:
The total number of citations at the time of data analysis (14 March 2014) was 8785 with an average of 23.9 citations per document and a median (interquartile range) of 6 (1–22). The highest median (interquartile range) number of citations was 15 (6.5–32) for Canada and 14 (2.5–26.5) for Israel, followed by 13 (2.8–49.5) for UK. The h-index of the retrieved documents was 48 (i.e. 48 documents had been cited at least 48 times at the time of data analysis, 14 March 2013). The highest h-index was 32 for USA, followed by 20 for UK and 13 for Canada. Furthermore, the highest number of collaborations with international authors for each country was held by USA with 11 articles, followed by Canada with 7 articles (Table 1). There was a statistically significant and strong correlation between the number of country collaborations and the number of publications related to NAC use in paracetamol overdose for each country (r = 0.87, p = 0.001). However, there was no statistically significant correlation between the number of country collaborations and average number of citations (r = 0.48, p = 0.156).
Source title
The retrieved documents were published in 199 international peer-reviewed journals. Table 2 shows the ranking of the top 10 journals in which articles related to NAC use in paracetamol overdose from international authors were published. Thirty-one documents (8.46%) were published in Annals of Emergency Medicine, followed by 23 (6.27%) in Clinical Toxicology, whereas 19 (5.17%) were published in The Lancet, followed by 9 (2.45%) being published in each of British Medical Journal and Human and Experimental Toxicology. Five journals from the top 10 ranking journals had SJR <1. In Table 3, a list of the most cited articles from 1976 to 2012 is shown. The most cited research area in the list of the most cited articles related to NAC use in paracetamol overdose was ‘clinical study’ (8 articles of 10).
Ranking of the top 10 journals in which articles related to NAC use in paracetamol overdose were published worldwide with their IFs.
SCR: standard competition ranking; SJR: SCImago Journal Rank; IF: impact factor; ISI: Institute for Scientific Information; JCR: journal citation reports; NAC: N-acetylcysteine; IF: impact factor.
aEqual journals have the same ranking number, and then a gap is left in the ranking numbers.
bThe IF was reported according to the ISI JCR 2012.
Top 10 ranking of cited articles related to NAC use in paracetamol overdose worldwide in Scopus.
SCR: standard competition ranking; NAC: N-acetylcysteine.
Research productivity stratified by authors and institutions
Table 4 presents the top 10 ranking of prolific authors who published more articles related to NAC use in paracetamol overdose from the world, with their affiliations and publication patterns, those authors have published at least six articles during the period of study. The retrieved documents were published by 181 institutions. Table 5 shows the ranking of the top 10 most productive institutions that most frequently published articles related to NAC use in paracetamol overdose globally. The most productive institution was Rocky Mountain Poison and Drug Center, USA (3.27% of total publications), followed by Royal Infirmary of Edinburgh, UK (2.72%) and University of California, San Francisco, USA (1.91%).
The top 10 ranking of prolific authors who published more articles related to NAC use in paracetamol overdose from the world, 1976–2012, with their affiliations and publication patterns.
SCR: standard competition ranking; USA: United States of America; UK: United Kingdom; NAC: N-acetylcysteine.
aEqual authors have the same ranking number, and then a gap is left in the ranking numbers.
bPercentage of publications for each author by the total number of documents.
Top 10 ranking of highly productive institutions that most frequently published articles related to NAC use in paracetamol overdose worldwide.
SCR: standard competition ranking; USA: United States of America; UK: United Kingdom; NAC: N-acetylcysteine.
aEqual institutions have the same ranking number, and then a gap is left in the ranking numbers.
Discussion
Goal and methodology assessment
The design of the present analysis permitted a worldwide assessment of the growth of scientific publications related to NAC use for paracetamol overdose. To the best of the authors’ knowledge, this is the first study to analyse the quantity and quality of NAC-based research worldwide. Our work focused primarily on assessing impact in the field (i.e. through the number of publications), the productivity of particular institutions or academic departments, the relative contribution of the top 10 most productive countries and the utility of the most preferred journals to NAC use for paracetamol overdose, which is considered as a sub-area of the multidisciplinary field of toxicology. This study was limited to 367 documents extracted from Scopus, bearing article titles with terms related to NAC use for paracetamol overdose and, therefore, cannot be generalized to the literature regarding NAC use for paracetamol overdose covered by other databases such as Google Scholar. On the other hand, there are various reasons for using Scopus database exclusively in this study. Firstly, it has been shown that Scopus can be used as the sole data source for bibliometric-based research in certain fields, 28,38 including toxicology. 12,14 Secondly, Scopus has a relatively large database of source journals and includes more expanded spectrum of journals than PubMed and Web of Science. 16
Annual research productivity
The total publications found in Scopus between 1976 and 2012 indicated that research output was low in the first two decades but showed an obvious increase in the last decade, with peak publications in 2008–2011. Scientific publications related to NAC have followed the general evolution in scientific research productivity related to paracetamol overdose observed in the last decade and especially in the last years. 14 Another explanation for this increase is the establishment of new research groups in the field of paracetamol overdose such as the Heard group from USA, 39 –43 the Zyoud group from Malaysia 44 –47 and the Waring group from UK. 48,49 After 2008, a new toxicological concept related to IV-NAC administration indicated that fewer anaphylactoid reactions are induced by NAC administration in patients with high serum paracetamol concentrations, suggesting that paracetamol might provide protective effects against NAC-induced anaphylactoid reactions. 44,48,49 This new concept opened the way for new confirmative researches for this new concept from the World. 44,49
However, the mechanism by which this occurs remains poorly understood. More research and efforts are needed to determine the exact mechanism(s) responsible for this reaction. An increased interest in NAC-related research may be provoked by the changing climate in healthcare and the need to improve clinical outcomes counterbalanced by high levels of cost-effectiveness. There has been an increased interest regarding the dose of NAC and the optimum duration for its use. For example, in UK the licensed indications for NAC have been amended recently, for example, clinical risk factor become less important. 50 More accurate risk stratification might minimize the need for using the antidote in patients at comparatively low risk of paracetamol toxicity and there has been a recent interest in detecting the biomarkers that could select a smaller cohort of patients who are at higher risk of liver disease. 51 A recent study conducted by Rumack and Bateman 52 suggested that the optimum management of patients with paracetamol overdose remains unclear, and there is insufficient data to evaluate the correct approach and whether the dose and duration of NAC administration should be modified in such patients. Rumack and Bateman discussed the issues that are needed to be elucidated for better changes in the dose and duration of NAC administration. Furthermore, the authors suggested that the potential for measuring other markers such as adducts, microRNA and cyclophilin A to improve treatment and patients’ outcomes is the subject of further research. 52
Source title
Another aspect of interest for this study in relation to the scientific publications related to NAC use for paracetamol overdose is the quality of research articles. It should be noted that 3 of the top 10 journals in which articles related to NAC use for paracetamol overdose were published carry IFs greater than 10 and have significant impacts in the field of medicine: New England Journal of Medicine, The Lancet and British Medical Journal. In our study, the average citation rate for NAC publications was 23.9 citations per document. This finding was more than the average number of citations per document published in toxicological journals, 7,9,12,14,53 which means that the field of NAC is still a hot issue in scientific research, and publications may have a larger audience than that of other toxicological aspects.
Research productivity and collaboration stratified by country
As expected, USA was the most productive country with its researchers being co-authors of 39.78% of all articles. These articles also amassed the highest h-index (h-index = 32). Furthermore, USA also had the largest number of collaborations with foreign countries during the period of study. This finding is consistent with a previous study which demonstrated that USA was the most productive country with its researchers being co-authors of 30.39% of all documents related to paracetamol overdose. 14 The current research indicates that Australia has produced the greatest number of research articles from the Asia-Pacific region, whilst UK and Denmark have produced the most research articles from Europe, whereas Turkey, Iran and Israel have been the major research contributors from the Middle East. The 10 most productive countries that published articles on NAC include many nations that will be not familiar to the readers of other scientific productivity rankings. 54 In our study, the ranking of countries after adjusting for economy and population parameters differed conspicuously from those based on absolute production. After adjusting for economy and population power, USA, Iran and UK had the highest research productivity. We are unable to discuss this point in light of other results as we have not found any comparative studies. However, studies using the same tool for analysis have reported similar findings. 14,55,56 Countries with rapidly growing economies and with more funding and investment for research show a tendency towards an increasing number of publications. Based on our findings, besides GDP, population size is one of the main factors related to research productivity, as in USA. It would be interesting to explore how the growth of scientific publications related to NAC in the top 10 ranking of the most productive countries differed in quality, rather than in quantity, as shown by the h-index and average or median number of citations. Toxicology in Turkey and Iran has experienced a rapid development and showed great progress in education and research in conjunction with the economic development in these countries over the past two decades. 7,14 Based on the SJR, which is a portal that includes the scientific indicators developed from the information contained in the Scopus ® database (Elsevier B.V.) for each journal and country, Turkey has the first rank in scientific productivity in the field of ‘Toxicology’ among Middle Eastern countries by publishing 1488 articles from 1996 to 2012, whilst Iran has published 873 articles in the same period and is ranked second in the Middle East. 14 These results are similar to the findings of our study. Scientific collaboration combines researchers with the same interests together. It may increase productivity, make up for individual researcher’s deficiencies, provide easier access to public financing and result in greater prestige and visibility from collaboration with renowned research groups. 57 –59
Limitations
This study is not without limitations, most of which are the same as those of studies performed in other biomedical fields. 12,30,60,61 First of all, we used Scopus criteria for including NAC-related keywords in our study. Articles published in non-Scopus-cited journals were not included even though they may contribute to scientific productivity. Another limitation is that some articles did not contain NAC or related terms in the article titles even though these terms were mentioned in the text. Therefore, it is possible that the number of publications analysed in this study does not exactly represent all NAC-based research activity. Furthermore, some conference abstracts may be published by certain journals, and may then subsequently be published in the same or different journals in a year other than the one in which the original journal article was published. Finally, it should be noted that the research output for certain institutions could have been underestimated due to differences in the spelling of their English names across various articles. Therefore, such institutions might have two or more institution profiles in Scopus because their names were written differently in various articles.
Conclusion
These data reveal promising progress for research activity in the use of NAC for paracetamol overdose. The amount of NAC-based research activity was low in some countries. More effort is needed to bridge the gap in NAC-based research and to promote better evaluation of NAC use worldwide. Furthermore, our findings demonstrate that NAC use for paracetamol overdose remains a hot issue in scientific research and publications may have a larger audience compared with other toxicological aspects. Editors and authors in the field of toxicology might usefully promote the submission of work on NAC in future to improve their journal’s impact. Our study does not suggest changes to current practice or present guidelines. Our study encourages future research in detecting the biomarkers such as adducts, microRNA and cyclophilin A to improve treatment and patients’ outcomes.
Footnotes
Acknowledgement
The authors would like to thank An-Najah National University for giving the opportunities to access most recent information sources such as Scopus database.
Conflict of interest
The authors declared no conflicts of interest.
Funding
This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors.
