Advertisment Novartis
Indian Journal of Dermatology
  Publication of IADVL, WB
  Official organ of AADV
Indexed with Science Citation Index (E) , Web of Science and PubMed
 
Users online: 693  
Home About  Editorial Board  Current Issue Archives Online Early Coming Soon Guidelines Subscriptions  e-Alerts    Login  
    Small font sizeDefault font sizeIncrease font size Print this page Email this page


 
SHORT COMMUNICATION
Year : 2009  |  Volume : 54  |  Issue : 1  |  Page : 83-85
Impactitis: The impact factor myth syndrome


1 Department of Dermatology and Cutaneous Surgery, University of Miami, FL, USA
2 Drexel University School of Medicine, Philadelphia, PA, USA

Correspondence Address:
Mohamed L Elsaie
Department of Dermatology and Cutaneous Surgery, University of Miami, FL
USA
Login to access the Email id

Source of Support: None, Conflict of Interest: None


DOI: 10.4103/0019-5154.48998

Rights and Permissions

   Abstract 

Background : In the early 1960s, Eugene Garfield and Irving Sher created the journal impact factor to help select journals for the Science Citation Index (SCI). Today it has become a widespread subject of controversy even for Garfield, the man who created it who is quoted saying " Impact Factor is not a perfect tool to measure the quality of articles but there is nothing better and it has the advantage of already being in existence and is, therefore, a good technique for scientific evaluation". The use of the term "impact factor" has gradually evolved, especially in Europe, to include both journal and author impact. This ambiguity often causes problems. It is one thing to use impact factors to compare journals and quite another to use them to compare authors. Journal impact factors generally involve relatively large populations of articles and citations. Individual authors, on average, produce much smaller numbers of articles. Objectives: Impact factor, an index based on the frequency with which a journal's articles are cited in scientific publications, is a putative marker of journal quality. However, empiric studies on impact factor's validity as an indicator of quality are lacking. The authors try to evaluate and highlight the validity of Impact Factors and its significance as a tool of assessment for scientific publications. Methods: Analysis of the several reports in literature and from their own point of view. Conclusion: A journal's impact factor is based on 2 elements: the numerator, which is the number of citations in the current year to any items published in a journal in the previous 2 years, and the denominator, which is the number of substantive articles (source items) published in the same 2 years. The impact factor could just as easily be based on the previous year's articles alone, which would give an even greater weight to rapidly changing fields.


Keywords: Impact Factor, Journal Citation Report, Science Citation Index


How to cite this article:
Elsaie ML, Kammer J. Impactitis: The impact factor myth syndrome. Indian J Dermatol 2009;54:83-5

How to cite this URL:
Elsaie ML, Kammer J. Impactitis: The impact factor myth syndrome. Indian J Dermatol [serial online] 2009 [cited 2018 Jan 24];54:83-5. Available from: http://www.e-ijd.org/text.asp?2009/54/1/83/48998



   Introduction Top


Being the most popular dermatologist does not mean that you are the most highly valued and considered the most prestigious one. Similarly, being a high selling writer making the New York Times best sellers' 10 list, does not mean that you are being tipped as a favorite for the Nobel Prize in literature. Similarly, making it to MTV's top 10 pop chart for a year doesn't crown one the king of pop!!!

The impact factor is only one of three standardized measures created by the Institute of Scientific Information (ISI) , which can be used to measure the way a journal receives citations to its articles, over time. Citations to articles published in a given year rise sharply to a peak between two and six years after publication. From this peak, citations declines over time. The citation curve of any journal can be described by the relative size of the curve (in terms of area under the line), the extent to which the peak of the curve is close to the origin, and the rate of decline of the curve. These characteristics form the basis of the ISI indicators impact factor, immediacy index and cited half-life. The impact factor is a measure of the relative size of the citation curve in years 2 and 3. It is calculated by dividing the number of current citations a journal receives to articles published in the two previous years by the number of articles published in those same years. So, for example, the 1999 Impact factor is the citations in 1999 to articles published in 1997 and 1998 divided by the number articles published in 1997 and 1998. The number that results can be thought of as the average number of citations the average article receives per annum in the two years after the publication year.

The ISI in Philadelphia serves as a continuous record of scientific citations. The references are rearranged to show how many times each publication has been cited within a certain period of time and by whom, and the results are published as the scientific citation index (SCI). On the basis of the Science Citation Index and authors' publication lists, the annual citation rate of papers by a scientific author or research group can thus be calculated. Similarly, the citation rate of a scientific journal - known as the journal impact factor - can be calculated as the mean citation rate of all the articles contained in the journal. [1] Journal impact factors, which are published annually in SCI Journal Citation Reports (JCR) , are widely regarded as a quality ranking for journals and used extensively by leading journals in their advertising. A list of the JCR ranking of some dermatology journals in 2005 is shown in [Table 1].

Apart from being non-representative, the journal impact factor is encumbered with several shortcomings of a technical and more fundamental nature. The factor is generally defined as the recorded number of citations within a certain year (for example, 1996) to the items published in the journal during the two preceding years (1995 and 1994), divided by the number of such items (this would be the equivalent of the average citation rate of an item during the first and second calendar year after the year of publication). However, the Science Citation Index database includes only normal articles, notes, and reviews in the denominator as citable items, but records citations to all types of documents (editorials, letters, meeting abstracts, etc) in the numerator; citations to translated journal versions are even listed twice. [2],[3] Because of this flawed computation, a journal that includes meeting reports, interesting editorials, and a lively correspondence section can have its impact factor greatly inflated relative to journals that lack such items. Editors who want to raise the impact of their journals should make frequent reference to their previous editorials, since the database makes no correction for self citations. The inclusion of review articles, which generally receive many more citations than ordinary articles, [4],[5] is also recommended. Furthermore, because citation rate is roughly proportional to the length of the article, [6] journals might wish to publish long, rather than short, articles. Dynamic research fields with high activity and short publication lags, such as biochemistry and molecular biology, have a correspondingly high proportion of citations to recent publications - and hence higher journal impact factors - than, for example, ecology and mathematics. [7]

It is widely assumed that publication in a high impact journal will enhance the impact of an article (the 'free ride' hypothesis). In a comparison of two groups of scientific authors with similar journal preference, who differed twofold in mean citation rate for articles, the relative difference was the same (twofold) throughout a range of journals with impact factors of 0.5 to 8.0. [8] If the high impact journals had contributed 'free' citations, independently of the article contents, the relative difference would have been expected to diminish as a function of increasing journal impact. [9] These data suggest that the journals do not offer any free ride. The citation rates of the articles determine the journal impact factor (a truism illustrated by the good correlation between aggregate citation rates of article and aggregate journal impact found in these data), but not vice versa.

It is still believed the journal's impact factor determines the prestige of the published article but that is unfortunately true and it is the article quality that should determine the journal's prestige. In some institutes and organizations worldwide, the IF is used as a premise for the evaluation of an individual's resume and professional qualities for allocation of a position or a post, often for promotion from one post to another among university professionals. This comes at the expense of the quality or value of the work and its scientific impact rather than the journal's impact. [10],[11] Some of the problems encountered with using IF as a way of evaluating journal standings are highlighted in [Table 2].


   Conclusion Top


For evaluation of scientific quality, there seems to be no alternative to qualified experts reading the publications. Much can be done, however, to improve and standardize the principles, procedures, and criteria used in evaluation, and the scientific community would be well served if efforts could be concentrated on this rather than on developing ever more sophisticated versions of basically useless indicators.

 
   References Top

1.Garfield E. Citation analysis as a tool in journal evaluation. Science 1972;178:471-9.   Back to cited text no. 1  [PUBMED]  [FULLTEXT]
2.Magri MH, Solari A. The SCI Journal Citation Reports: A potential tool for studying journals? Description of the JCR journal population based on the number of citations received, number of source items, impact factor, immediacy index and cited half-life. Scientometrics 1996;35:93-117.   Back to cited text no. 2    
3.Moed HF, van Leeuwen TN. Impact factors can mislead. Nature 1996;381:186.   Back to cited text no. 3  [PUBMED]  [FULLTEXT]
4.Moed HF, van Leeuwen TN, Reedijk J. A critical analysis of the journal impact factors of Angewandte Chemie and the Journal of the American Chemical Society: Inaccuracies in published impact factors based on overall citations only. Scientometrics 1996;37:105-16.   Back to cited text no. 4    
5.Bourke P, Butler L. Standard issues in a national bibliometric database: The Australian case. Scientometrics 1996;35:199-207.   Back to cited text no. 5    
6.Seglen PO. Evaluation of scientists by journal impact. In: Weingart P, Sehringer R, Winterhager M, editors. Representations of science and technology. Leiden: DSWO Press; 1992. p. 240-52.  Back to cited text no. 6    
7.Metcalfe NB. Journal impact factors. Nature 1995;77:260-1.   Back to cited text no. 7    
8.Seglen PO. Causal relationship between article citedness and journal impact. J Am Soc Inform Sci 1994;45:1-11.  Back to cited text no. 8    
9.Seglen PO. How representative is the journal impact factor? Res Eval 1992;2:143-9.   Back to cited text no. 9    
10.Bordons M, Fernandez MT, Gomez, I. Advantages and limitations in the use of impact factor measures for the assessment of research performance. Scientometrics 2002;53:195-206.  Back to cited text no. 10    
11.Braun T, Glaenzel W, Schubert A. A hirsch-type index for journals. Scientist 2002;22:8.  Back to cited text no. 11    



 
 
    Tables

  [Table 1], [Table 2]

This article has been cited by
1 Bibliometric Analysis of Nursing Articles Focused on Health Education
Carla Monique Mourao,Ana Izabel Nicolau,Marília Marques,Ana Fátima Fernandes,Maria Josefina Silva,Ana Karina Pinheiro,Francisca Elisangela Lima,Thelma Araújo,Camila Moreira
Open Journal of Nursing. 2014; 04(04): 223
[Pubmed] | [DOI]
2 How is Acta Physiologica (Oxford) performing?
Pontus B. Persson
Acta Physiologica. 2012; 204(4): 461
[Pubmed] | [DOI]
3 A Review of the Journal of Investigative Dermatologyćs Most Cited Publications over the Past 25 Years and the Use of Developing Bibliometric Methodologies to Assess Journal Quality
David R Bickers,Robert L Modlin
Journal of Investigative Dermatology. 2012; 132(3): 1050
[Pubmed] | [DOI]
4 A review of the journal of investigative dermatologyćs most cited publications over the past 25 years and the use of developing bibliometric methodologies to assess journal quality
Bickers, D.R., Modlin, R.L.
Journal of Investigative Dermatology. 2012; 132: 1050-1060
[Pubmed]
5 How is Acta Physiologica (Oxford) performing?
Persson, P.B.
Acta Physiologica. 2012; 204(4): 461-463
[Pubmed]
6 The expansion of a measure: What is a scientific journal impact factor and how important is it for academic Brazilian dermatologists
Bagatin, E., Gontijo, B.
International Journal of Dermatology. 2011; 50(11): 1432-1434
[Pubmed]
7 The expansion of a measure: what is a scientific journal impact factor and how important is it for academic Brazilian dermatologists
Ediléia Bagatin,Bernado Gontijo
International Journal of Dermatology. 2011; 50(11): 1432
[Pubmed] | [DOI]



 

Top
Print this article  Email this article
 
  Search
 
   Next article
   Previous article 
   Table of Contents
  
    Similar in PUBMED
   Search Pubmed for
   Search in Google Scholar for
 Related articles
    Article in PDF (320 KB)
    Citation Manager
    Access Statistics
    Reader Comments
    Email Alert *
    Add to My List *
* Registration required (free)  


    Abstract
    Introduction
    Conclusion
    References
    Article Tables

 Article Access Statistics
    Viewed3573    
    Printed121    
    Emailed1    
    PDF Downloaded217    
    Comments [Add]    
    Cited by others 7    

Recommend this journal

Epiduo