Uncategorized

New academic paper: Stafford HSMRs NO indicator of avoidable deaths

Please share this widely. It’s absolutely crucial for the future of Stafford hospital and of the wider NHS.

An important new academic paper was published this week by the Oxford University Press‘ Oxford Journals on the subject of Hospital Standardised Mortality Ratios (HSMRs). This paper, by a team of respected academics from the ‘Primary Care Clinical Sciences’ and ‘Public Health,Ā Epidemiology and Biostatistics’Ā departments of the University of Birmingham is titled:

The findings of the Mid-Staffordshire Inquiry do not upholdĀ the use of hospital standardized mortality ratios as aĀ screening test for ā€˜bad’ hospitals

This paper examines the findings of the Francis Report into events at Mid Staffs NHS Foundation Trust – and reaches two findings that are absolutely vital for the proper public understanding. The whole paper can be read here, but the key conclusions – quoted from the report with the permission of its principal author – are as follows:

Targeting hospitals for high HSMRs is invalid

The report’s summary states that

The initial investigations were triggeredĀ by an elevated hospital standardized mortality ratioĀ (HSMR). This shows that the HSMR is being used asĀ a screening test for substandard care; whereby hospitalsĀ that fail the test are scrutinized, whilst thoseĀ that pass the test are not.

As I’ve written on this blog, 14 hospitals (10% of all hospitals in England) are already under special investigation because of supposed similarities to Stafford in their HSMR statistics – even though, by the more reliable SHMI measure, 9 of them do not have high mortality rates. Not only this, but a total of 36% of the country’s hospitals are set for similar investigations for the same reason.

As I have argued, so this academic study has also concluded: HSMRs doĀ not indicate avoidable deaths and cannot validly be used for the purpose of identifying hospitals with a ‘needless death’ problem.

Mid Staffs death claims are spurious and damaging

Here is the report’s conclusion, reproduced in full:

The widespread use of HSMRs as a screening test forĀ clinically avoidable mortality and thereby substandardĀ care, although well intentioned, is seriouslyĀ flawed. The findings of the MSFT inquiry have noĀ bearing on this conclusion because a ā€˜bad’ hospitalĀ cannot uphold a bad screening test. NonethelessĀ HSMRs continue to pose a very sombre public challengeĀ to hospitals regarding the quality of their care,Ā whilst the unsatisfactory nature of the HSMRĀ remains a largely unacknowledged and unchallengedĀ private affair. This asymmetric relationshipĀ is inappropriate, unhelpful, costly and potentiallyĀ harmful. Using the HSMR to identify ā€˜good/bad’ hospitalsĀ is analogous to the practice of dowsing—theĀ search for water without scientific apparatus—it isĀ time to abandon this screening test and search for aĀ better one. Meanwhile, the use of process measuresĀ remains a valid way to measure quality of care.

This is an explosive conclusion – that the use of HSMRs to claim ‘needless deaths’ is as inaccurate, invalid and unreliable as searching for water using a twig. Not only that, but any such use has the potential to be damaging.

These findings mirror my own articles (and are put not much less emphatically!). There is growing consensus among statisticians, academics and, increasingly, among sections of the media (the Straight Statistics and Computer Weekly websites and even, very quietly and cautiously, one BBC News writer) that the claims of ‘excess mortality’ at Stafford hospital are – at best – utterly spurious and inaccurate.

And yet they continue to be recited, rote-fashion, as simple, unchallenged fact by the right-wing press and even by the BBC (just this evening on Look North during a segment on the inspectors’ visit to North Cumbria Hospitals Trust, one of the 9 hospitals targeted in spite of having average or lower SHMI mortality rates).

The weaknesses of HSMRs and of the data entered to create them are not difficult to identify. The articles on these weaknesses are not encrypted or hidden. And yet they continue to be conspicuous by their absence in the mainstream media while false figures are recited as fact.

You really do have to wonder just why that is.

10 comments

  1. maybe time for us all to start writing to MPs, Health Committee ( healthcom@parliament.uk), Jeremy Hunt etc about this use of dodgy HSMR stats. The MP for Carlisle is John Stevenson and he’s also the Chairman of the Blue Collar Conservatism Advisory Group. Does anyone in the Cumbria area fancy starting a campaign on 38 degrees perhaps? http://you.38degrees.org.uk/

  2. It would be good to be able to have access to the full paper (damn you, current scientific journal publishing model!).

    See also http://www.kingsfund.org.uk/blog/2011/10/shmi-new-indicator-measuring-hospital-mortality-more-light-or-more-confusion which suggests that officially, SHMI has replaced HSMR, and (in the comments) has some interesting ideas why Mid-Staffs might have had such high numbers. The fact that it all happened under the Labour government is highly convenient for the ConDems, of course.

  3. The local and national press and BBC, even on the rare occasions that they report something positive (like 50,000 people on the street in support of local acute care) always end by a reminder that in 2007-9 there were 1200 “avoidable” deaths. It’s so sloppy.

    Our local paper is reporting that the Mid Staffs Trust Special Administrator has had 40 expressions of interest in running services currently run by the Trust, from a mixture of NHS, voluntary and private organisations. This is not surprising from the private sector (that’s what they’re supposed to do) but from the NHS?! It only goes to show how much the dog-eats-dog/marketisation mentality has pervaded the NHS itself – to the extent that one part of the area would happily boost their own “profits” even if the collateral damage is a lack of local services in a neighbouring area.

Leave a Reply