Our Data Quality Audit has been devised to assess the completeness and quality of the data submitted to the registry. This enables us to compare patient records for procedures recorded in local hospitals’ databases (e.g. Patient Administration Systems (PAS) to that in the registry, with the aim of investigating the accuracy of the number of joint replacement procedures submitted to the registry, compared to the number carried out.
The importance of the NJR Data Quality Audit is clear when considered in the context of our primary aims. To achieve those aims, there are two principal outcomes of interest to the NJR: revision surgery and mortality volumes.
The occurrence of revision surgery is often an indicator of either implant failure or poor surgical performance. This is determined by linking a primary joint replacement procedure to a subsequent procedure, which typically occurs some years later. Therefore, compliance with reporting revision surgical procedures is essential to estimate implant failure rates and the quality of surgical performance more accurately.
Mortality data is collected from Civil Registration data, which is obtained from NHS England, and linked to individual patient records within the registry. However, it is important to know that joint replacement is a very successful operation with a very low mortality rate and all surgeons and hospitals have outcomes in line with the expected range.
Back in FY2020/21, we began a national roll-out of a semi-automated data quality audit process, which enables units to check their data on a monthly, quarterly or annual basis. This has greatly reduced the number of mismatches that have to be checked each time the audit is run, and the pilot suggests this rapidly becomes part of the normal workflow.
We continue to reward hospitals with good data quality as part of our Data Quality Provider Awards Scheme. Last year, the criteria for the awards changed and we offered gold, silver and bronze awards for hospitals who were able to demonstrate good processes to identify and capture NJR procedures, with the highest level of awards being attainable by those who can deliver 100% compliance rates. We were delighted to award 251 hospitals with a gold award, 49 with a silver and 14 with a bronze level. You can find out more about our award programme here.
During 2024/25, we completed a national data quality audit of shoulder procedures, working with the British Elbow and Shoulder Society (BESS) and the British Orthopaedic Trainees Association (BOTA), using the same model as for the previous year’s elbow audit, to improve the completeness of the dataset to ensure it can be used for a more accurate outcomes analysis in the future. You can find out more about this here. As a result of this audit, we added over 4,990 missed cases to the registry. This is important work ahead of our plans to introduce outlier management of shoulder surgery shortly.
Following the release of minimum data set v8 [MDSv8], we have been able to extend the data quality audit programme to benchmark the new procedures captured by the NJR. Hip hemiarthroplasty and DAIRs procedures have now been introduced with focal knee resurfacing and other non-revision re-operations to follow.
We will also be undertaking a feasibility exercise to determine how best to capture and measure the completeness of non-revision procedures undertaken outside of an operating theatre (e.g. Manipulation Under Anaesthetic (MUA) procedures, performed in hospital emergency departments), as well as work to determine how best to benchmark the collection of periprosthetic fracture fixation.