Dispatched from the Editor in Chief: does the impact factor have any real relevance to our military health journal?
===================================================================================================================

* Johno Breeze

Welcome to the fifth issue of 2019 of the *Journal of the Royal Army Medical Corps* (*JRAMC*). I am writing these dispatches during my deployment to the US-led Role 3 Craig Joint Theater Hospital at Bagram Airfield, Afghanistan. Running the journal remotely is challenging, and I continue to be indebted to Major Piers Page as Deputy Editor and Mrs Claire Langford at the BMJ for helping me at times when I cannot access the internet. This current issue of the *JRAMC* covers a broad range of topical subjects including research from our Australian colleagues on alcohol disorders in service personnel,1 which I have made my highlights, and the worsening of mental health in military spouses when their partners are deployed.2 I would also commend you to read Lieutenant Colonel Andy Johnston’s editorial about deskilling and return to practice on low-tempo contingency operations,3 which I feel is particularly pertinent during my current deployment.

As I was about to get on the plane to Afghanistan in June, the impact factor (IF) of *JRAMC* for 2018 was announced as 0.99. This is a further increase from 0.88 in 2017 and a massive achievement (Table 1), although I was hoping very much to have breached the big 1.0 this time. I would like to thank the members of the *JRAMC* Editorial Board and the BMJ for enabling this, as well as a cohort of authors that continue to submit and support the journal, often when it would be easier or more desirable to publish elsewhere. That brand loyalty will be essential to the journal’s success as we hopefully transition to our new guise in 2020. However, how relevant to our readers and potential submitting authors is our IF? It is certainly perceived as being relevant among BMJ Editors in Chief, as IF continues to dominate discussions during the yearly Editors Retreats.

View this table:
[Table 1](http://militaryhealth.bmj.com/content/165/5/307/T1)

Table 1 
Impact factor between 2011 and 2018 of the only two military medical journals listed in the Journal Citations Reports published by Clarivate Analytics

The impact factor (IF) or journal impact factor of an academic journal is a scientometric index which reflects the yearly average number of citations to recent articles published in that journal.4 It is frequently used as a proxy for the relative importance of a journal within its field; journals with higher IFs are often deemed to be more important than those with lower ones. The IF was devised by Eugene Garfield, the founder of the Institute for Scientific Information. IFs are calculated yearly starting from 1975 for journals listed in the Journal Citation Reports (JCR). JCR in turn is an annual publication by Clarivate Analytics (previously the intellectual property of Thomson Reuters). A journal’s IF is based on dividing the numerator by the denominator. The numerator is the number of citations, received in that year, of articles published in that journal during the two preceding years. The denominator is the total number of *‘* *citable* *items* *’* published in that journal during the two preceding years.4 Part of the challenge has been a lack of clarity in which articles determine the denominator and are thereby *‘* *citable* *’* for the IF. Letters in particular are difficult to predict, with short letters containing only a few references unlikely to count (Table 2). IF rankings are also highly misleading and disheartening. For example, *JRAMC* is ranked within a group of journals classed as *‘* *medicine* *, general and internal* *’*, meaning that a highly specialised journal such as ours will often rank near the bottom. In my opinion those journals we should be measuring ourselves against are other military medical journals (at last count over 20), of which only *JRAMC* and *Military Medicine* are listed in JCR and therefore have an IF (Table 1).

View this table:
[Table 2](http://militaryhealth.bmj.com/content/165/5/307/T2)

Table 2 
Articles believed to count and not count as denominators for the impact factor in the *Journal of the Royal Army Medical Corps* 

In the never-ending quest to raise IF, many editorial boards have made overt decisions to stop publishing articles or article types which are highly unlikely to be cited, such as case reports (Table 3). Such cynicism can lead to the production of papers in which only those articles published in your own journal are reviewed,5 or editors actively encourage authors to cite articles in their own journal.6 However, this has the potential to increase the journal’s self-citation rate, which can lead to unwanted attention. This year (IF year 2018), Clarivate Analytics suppressed 20 journals, 14 for high levels of self-citation and six for citation stacking.6 Although suppression from the JCR lasts 1 year, it has been shown to drastically reduce levels of self-citation following reintroduction. However, threshold levels are set so high that one particular journal that increased its IF by nearly fivefold (3.089 in 2014 to 8.145 in 2015), and moved to first place among its subject category, still managed to escape suppression.7 Some care must be taken when analysing this self-citation rate though, as when you publish in specialist areas such as *Military Medicine*, it is likely that a large proportion of your citations will be published in your own journal anyway (Table 4).

View this table:
[Table 3](http://militaryhealth.bmj.com/content/165/5/307/T3)

Table 3 
Simple potential methods to alter a journal’s impact factor (IF)

View this table:
[Table 4](http://militaryhealth.bmj.com/content/165/5/307/T4)

Table 4 
Top five journals citing papers published in the *Journal of the Royal Army Medical Corps* between 2016 and 2018

Certainly care has to be taken when introducing new article types as to whether they will have a negative effect on IF. For example the *JRAMC* introduced the *‘* *personal* *view* *’* article type to enhance debate and enable the promulgation of ideas that do not fit discretely into more traditional article types. This article type however was excluded from determining the IF, meaning we did lose a small number of highly cited articles (Table 5). There is also currently a desire to invite authors to write commentaries on papers that they have published in other larger journals to signpost readers; however, it is unclear as whether these would be used as denominators should a new article type be chosen as these do not fit neatly into personal views.

View this table:
[Table 5](http://militaryhealth.bmj.com/content/165/5/307/T5)

Table 5 
Top 10 cited articles published in the *Journal of the Royal Army Medical Corps* between 2016 and 2018 that do not count for impact factor

So the question remains will we as a journal overtly chase the IF, and to what lengths do we do it? I feel the ethics behind overt self-citation preclude this from a military journal and I will not actively undertake this, despite the obvious temptation. However we will be taking the line of increasing the number of reviews, which will ideally be systematic in nature, and use those previously highest cited articles as guidance (Table 6). We continually increase the number of countries that submit to the journal,8 and this I believe is reflected in the countries of authors citing articles published in *JRAMC* (Table 7). This increased visibility will increase the potential for article citation. Readers will have noticed that I have heavily pushed the number of special issues in a year, from one of six issues during my predecessors’ tenure, to up to three of six issues in my tenure. I also hope that topical subjects such as emergency preparedness and women in ground close combat will engage the readership and increase downloads and subsequent citations. We are now the most cited and influential military health journal in the world, and I thank you all for supporting us in the journey so far and that to come.

View this table:
[Table 6](http://militaryhealth.bmj.com/content/165/5/307/T6)

Table 6 
Twenty most cited papers, including article type, published in the *Journal of the Royal Army Medical Corps* between 2016 and 2018

View this table:
[Table 7](http://militaryhealth.bmj.com/content/165/5/307/T7)

Table 7 
Citations in the *Journal of the Royal Army Medical Corps* between 2016 and 2018 by country of citing author institution

## Footnotes

*   Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

*   Competing interests None declared.

*   Patient consent for publication Not required.

*   Provenance and peer review Not commissioned; internally peer reviewed.

*   © Author(s) (or their employer(s)) 2019. No commercial re-use. See rights and permissions. Published by BMJ.

## References

1.   Watterson J , Gabbe B , Dietze P , et al . Comparing short versions of the alcohol use disorders identification test (audit) in a military cohort. J R Army Med Corps 2019;165:312–6.[doi:10.1136/jramc-2018-001024](http://dx.doi.org/10.1136/jramc-2018-001024) 
    
    [Abstract/FREE Full Text](http://militaryhealth.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToianJhbWMiO3M6NToicmVzaWQiO3M6OToiMTY1LzUvMzEyIjtzOjQ6ImF0b20iO3M6MjE6Ii9qcmFtYy8xNjUvNS8zMDcuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

2.   Godier-McBard LR , Ibbitson L , Hooks C , et al . Military spouses with deployed partners are at greater risk of poor perinatal mental health: a scoping review. J R Army Med Corps 2019;165:363–70.[doi:10.1136/jramc-2018-001069](http://dx.doi.org/10.1136/jramc-2018-001069) 
    
    [Abstract/FREE Full Text](http://militaryhealth.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToianJhbWMiO3M6NToicmVzaWQiO3M6OToiMTY1LzUvMzYzIjtzOjQ6ImF0b20iO3M6MjE6Ii9qcmFtYy8xNjUvNS8zMDcuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

3.   Johnston AM . Deskilling and return to practice on low-tempo contingency operations. J R Army Med Corps 2019;165:310–1.[doi:10.1136/jramc-2019-001162](http://dx.doi.org/10.1136/jramc-2019-001162) 
    
    [FREE Full Text](http://militaryhealth.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6NToianJhbWMiO3M6NToicmVzaWQiO3M6OToiMTY1LzUvMzEwIjtzOjQ6ImF0b20iO3M6MjE6Ii9qcmFtYy8xNjUvNS8zMDcuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

4.   Garfield E . The history and meaning of the Journal impact factor. JAMA 2006;295:90–3.[doi:10.1001/jama.295.1.90](http://dx.doi.org/10.1001/jama.295.1.90) 
    
    [CrossRef](http://militaryhealth.bmj.com/lookup/external-ref?access_num=10.1001/jama.295.1.90&link_type=DOI) 
    
    [PubMed](http://militaryhealth.bmj.com/lookup/external-ref?access_num=16391221&link_type=MED&atom=%2Fjramc%2F165%2F5%2F307.atom) 
    
    [Web of Science](http://militaryhealth.bmj.com/lookup/external-ref?access_num=000234381100025&link_type=ISI) 

5.   Kusanale A , Mackenzie N , Arakeri G , et al . A summary of trauma and trauma-related papers published in BJOMS during 2008-2009. Br J Oral Maxillofac Surg 2010;48:455–8.[doi:10.1016/j.bjoms.2010.05.014](http://dx.doi.org/10.1016/j.bjoms.2010.05.014) 
    
    [PubMed](http://militaryhealth.bmj.com/lookup/external-ref?access_num=20727461&link_type=MED&atom=%2Fjramc%2F165%2F5%2F307.atom) 

6.   Davis P . Impact factor denied to 20 journals for Self-Citation, stacking. The scholarly kitchen. Available: [https://scholarlykitchen.sspnet.org/2018/06/27/impact-factor-denied-20-journals-self-citation-stacking on 07.07.19](https://scholarlykitchen.sspnet.org/2018/06/27/impact-factor-denied-20-journals-self-citation-stacking%20on%2007.07.19) 
    
    

7.   Davis P . How much citation manipulation is acceptable? the scholarly kitchen. Available: [https://scholarlykitchen.sspnet.org/2017/05/30/how-much-citation-manipulation-is-acceptable on 07.07.19](https://scholarlykitchen.sspnet.org/2017/05/30/how-much-citation-manipulation-is-acceptable%20on%2007.07.19) 
    
    

8.   Breeze J , Langford CEJ . Dispatches from the editor: what do authors want from our military health Journal? J R Army Med Corps 2018;164:65–6.[doi:10.1136/jramc-2018-000974](http://dx.doi.org/10.1136/jramc-2018-000974) 
    
    [FREE Full Text](http://militaryhealth.bmj.com/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6NToianJhbWMiO3M6NToicmVzaWQiO3M6ODoiMTY0LzIvNjUiO3M6NDoiYXRvbSI7czoyMToiL2pyYW1jLzE2NS81LzMwNy5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=)