Page 1

Background ISO 31000 Risk Management Guidelines provides guidelines on managing risk faced by all organizations. “Risk is usually expressed in terms of A. risk sources, B. potential events, C. their consequences, and D. their likelihood.” I compared risk metrics to implement these guidelines in medical laboratories to sigma metrics to examine the most effective way to enable risk evaluation as ‘the process of comparing the estimated risk against given risk criteria to determine the acceptability of the risk’ (CLSI EP 23A.) Methods Eighty QC sample mean and SD values were compared to Peer Means and CLIA TEa limits for 14 routine chemistry analytes and four cardiac markers tested on two Ortho Vitros 5600 analyzers in December 2022. Risk evaluation was divided into Current Risk, driven by analytical accuracy and precision, and Potential Risk driven by effectiveness of the daily QC system to detect a simulated shift to a 5% error rate. Current risk consequences were quantified as the number of failures per million opportunities and per year, and the estimated healthcare cost of lab error based on the costing process established for calcium in 2004.i Potential risk consequences were quantified as the number of failures reported and healthcare cost of lab error following a simulated shift to create a 5% error rate. Results See graphs. Metrics to express risk in terms of A. risk sources, B. potential events, C. their consequences and D. their likelihood - as recommended by ISO 31000 Zoe. C. BROOKS. AWEsome Numbers Inc, Worthington, ON, Canada, B-157 Conclusion: There is a good relationship between sigma and projected failures per year. Sigma is NOT a good indicator of cost of error per year, or the number or cost of failures reported after a simulated failure National Institute of Standards and Technology. Planning Report 04.1. The impact of calibration error in medical decision making. 0 500 1,000 1,500 0 3 6 9 12 15 18 Projected Failures of TEa/Year Sigma (TEa-|bias|)/SD Projected Failures of TEa/Year $0 $500,000 $1,000,000 $1,500,000 $2,000,000 $2,500,000 0 3 6 9 12 15 18Sigma (TEa-|bias|)/SD Clinical Cost of Lab Error per Year 0 500 1,000 1,500 2,000 0 3 6 9 12 15 18 Sigma (TEa-|bias|)/SD Patient results reported before QC Flag $0 $50,000 $100,000 $150,000 $200,000 0 3 6 9 12 15 18 Clinical Cost of Lab Error per failure event 0 5 10 15 20 25 2 4 6 8 10 12 14 16 18 20 Sigma 0 10 20 30 40 50 60 70 0.1 50 100 150 200 250 300 350 <1,500 Projected #MURs /year 0 5 10 15 20 25 30 Total cost of Lab Error per Year 0 5 10 15 20 25 30 35 40 Patient results REPORTED before QC Flag Which Metric Matters Most? Risk metrics enable risk evaluation as ‘the process of comparing the estimated risk against given risk criteria to determine the acceptability of the risk’ (CLSI EP 23A.)