Presentation is loading. Please wait.

Presentation is loading. Please wait.

Integrating Human Factors nto the R&D Process

Similar presentations


Presentation on theme: "Integrating Human Factors nto the R&D Process"— Presentation transcript:

1 Integrating Human Factors nto the R&D Process
Presented at Presented by Michael Wiklund, PE, CHFP General Manager – Human Factors Engineering, UL-Wiklund November 5, 2014 Hello everyone. What a privilege it is to have this opportunity to speak to such a large group of UL marketing and sales people. I thank Joe Madden for inviting me and my colleague Jonathan Kendler the opportunity to speak with you today. Joe has been a very strong proponent of human factors engineering at UL and played a major role in UL acquiring Wiklund Research & Design this past November. So, thank you to Joe. We are calling today’s presentation a Webinar. A fancy term describing a simple presentation by me and Jonathan of UL’s new human factors engineering capabilities. Jonathan and I will make our presentation over the next hour and 15 minutes or so, and then Joe Madden will join us and respond to questions that you might pose to us.

2 INTRODUCTION I’ll take just a couple of minutes to summarizes the benefits of an HFE procedure, but starting with the benefits of HFE itself.

3 My background Michael Wiklund, MS, PE
General Manager – Human Factors Engineering, UL Certified Human Factors Professional Professor, Tufts University Author/Editor: Usability Testing of Medical Devices Handbook of Human Factors in Medical Device Design Designing Usability into Medical Products Usability in Practice Member: AAMI Human Factors Engineering Committee IEC Human Factors Engineering Committee

4 Human factors specialists
Seek to optimize the quality of interaction between people and products, making them: Safe Effective Efficient Satisfying Now, I’ll pose the question: “What is UL’s HFE business all about?” Fundamentally speaking, what are we offering UL’s clients?

5 Participant did not notice drug injection pen was expired.
Credit:

6 To err is human Photo source:

7 Photo source: http://www. justjared

8 Source: http://www. langleyflyingschool

9 To err when using a medical device can be harmful or deadly.

10 Now, I’ll pose the question:
“What is UL’s HFE business all about?” Fundamentally speaking, what are we offering UL’s clients?

11 1999: Deaths resulting from use errors involving medical devices
Now, I’ll pose the question: “What is UL’s HFE business all about?” Fundamentally speaking, what are we offering UL’s clients? 1999: Deaths resulting from use errors involving medical devices = 10% of at least 45,000/year in the USA

12 Participant did not notice drug injection pen was expired.
Credit:

13 Participant did not notice drug injection pen was expired.
ROOT CAUSES Inadequate training European format Small text Participant did not notice drug injection pen was expired. Credit:

14 Participant programmed IV pump to deliver antibiotic fluid (“secondary” infusion) at “primary” rate intended for hydration fluid. Credit:

15 POSSIBLE ROOT CAUSES Use of abbreviations No confirmation No prompt about IV bag height Closed clamp No dose limits Participant programmed IV pump to deliver antibiotic fluid (“secondary” infusion) at “primary” rate intended for hydration fluid. Credit:

16 Participant did not breathe out completely before taking puff from inhaler.
Credit:

17 POSSIBLE ROOT CAUSES Step not described during training Step not illustrated in instructions Participant did not breathe out completely before taking puff from inhaler. Credit:

18 Participant drew blood sample from fingertip still wet with disinfectant.
Credit:

19 POSSIBLE ROOT CAUSES Not taught to air dry finger during training Instructions suggest using disinfectant, but don’t direct users to air dry finger Participant drew blood sample from fingertip still wet with disinfectant. Credit:

20 Participant did not detect LVAD’s low battery alarm.
Credit:

21 Participant did not detect LVAD’s battery low alarm.
POSSIBLE ROOT CAUSES Pizoelectric buzzer emits Hz signal; above threshold for older individuals with presbycussis Parallel visual alarm is inconspicuous Participant did not detect LVAD’s battery low alarm. Credit:

22

23

24 THE HUMAN FACTORS ENGINEERING IMPERATIVE
I’ll take just a couple of minutes to summarizes the benefits of an HFE procedure, but starting with the benefits of HFE itself.

25 Imperative to apply HFE
Today, FDA and other regulatory agencies expect medical devices to reflect good HFE. Applying HFE is a cornerstone of overall risk management. Fortunately, FDA (led by our colleague Peter Carstensen in the 1990s), has helped turn things around.

26 Timeline 1993: ANSI/AAMI HE48:1993 (design guidelines)
1995: Joint AAMI and FDA conference on HF 1996: Quality System Regulation (QSR); indirect requirements for HFE added 1997: End of “grace period” to incorporate HFE in medical device design process 1999: IOM report on medical error 2001: ANSI/AAMI HE74:2001 (HFE process standard) 2006: IEC collateral standard (AAMI HE74 is informative annex) 2007: ISO/IEC 62366:2007 (AAMI HE74 included as informative annex) 2008: EU adopts ISO/IEC 62366:2007 as basis for CE mark 2008: FDA’s HFE team moves into Office of Device Evaluation 2009: ANSI/AAMI HE75:2009 (HFE methods and design guidelines) 2011: FDA publishes draft HFE guidelines 2012: Adoption of 3rd edition of IEC by Europe and Canada 2013: Adoption of 3rd edition of IEC by USA

27 Quality System Regulation (Effective Date: June 1, 1997)
Subpart C -- Design Controls, § Design controls. The need for human factors techniques or data in the design process is implicit in paragraphs c, f, and g of Section ( c ) Design input: "Each manufacturer shall establish and maintain procedures to ensure that the design requirements relating to a device are appropriate and address the intended use of the device, including the needs of the users and patient.” ( f ) Design verification: "Each manufacturer shall establish and maintain procedures for verifying the design input. Design verification shall confirm that the design output meets the design input requirements.” ( g ) Design validation:
Design validation shall ensure that devices conform to defined user needs and intended uses, and shall include testing of production units under actual or simulated use conditions."

28 Key documents FDA’s Draft Guidance IEC 62366

29 Implement an HFE (UE) program
Basic expectations Implement an HFE (UE) program Define intended users, use environments, potential hazards, potential use errors, and use-related risks Mitigate use-related risks Validate user interface designs, proving risk control measures work Document HFE activities and outcomes

30 HFE Design History File (one example, partial, simplified)
HFE program plan User profiles and use environment descriptions Function and task analysis Use-related hazard analysis Known problems analysis Use-related risk analysis (e.g., Use-FMEA); iterative User interface requirements Application specification, usability specification, and other documents (per IEC 62366) User interface design products (reflecting application of HFE principles) Formative evaluation plans and reports User interface verification report Summative usability test plan and report (to validate user interface) HFE Report

31 Standards apply to diverse medical devices

32 SAMPLE HFE TECHNIQUES AND END-PRODUCTS
I’ll take just a couple of minutes to summarizes the benefits of an HFE procedure, but starting with the benefits of HFE itself.

33 Sample user profile: registered nurses
Nurse often multi-task, placing relatively heavy demand on their short-term memory

34 Use environment description (sample)
Patient care areas might be brightly or dimly lit.

35 User needs – glucose meter
“I’d like to be able to read the screen without a magnifying glass.” “The bG result should stand out from everything else. Make it big!” “You should be able to confirm the time and date so that you know the readings are being logged properly.” “The information labels don’t have to be as big.” “It shouldn’t have too few or too many controls. Too many controls would be intimidating.” “I want it to make a noise when I press a button so that I know it got my input.” “I want to know that the device is alive – awake – at all the times.” “Don’t let the screen time out too quickly.”

36 Derived user requirements – glucose meter
Text (capital letters and numbers) shall be ≥14 point (5 mm). Blood glucose readout shall be ≥ 60 point (21 mm). Main screen shall include the time and date. Labels shall be visually subordinate to primary onscreen content. There shall be no more than 4 primary hardware controls used to navigate among screens. Device shall provide audible feedback in response to all button presses (user option). At least one visual element shall be constantly dynamic to indicate the display has not failed. Power-down screen after ≥ 2 minutes of inactivity.

37 Design concepts – glucose meter

38 Task analysis Deconstruct an overall user interactions with a device into its myriad components: perceptions (P), cognitive processes (C), and actions (A). Yields: PCA analysis.

39 Sample flow diagram showing decisions and events
Source:

40 Use errors derived from task analysis
User inserts wrong test strip User inserts test strip in wrong orientation User inserts test strip in wrong port User damages test strip during handling User applies blood to wrong part of test strip User applies too much blood to test strip User applies too little blood to test strip User does not select re-test when prompted User does not remove used strip from meter User misreads the blood glucose readout User mistakes units of measure as mmol/L versus mg/dL

41 Sample risk mitigations
Advisory message Audible feedback Clear instructions Color coding Confirmation message Emergency power cutoff Familiar symbol Lack of parting lines Large label Interlock Needle guard Non-glare display Orientation cue Quick reference card Resistance force Setting limits Shape coding Size coding Switch cover Tactile feedback Textured grip Training Warning label Warning light Wider pushbutton spacing Cable/tube strain relief

42 Life of a use error

43 Life of a use error (continued)

44 Select a sample size (continued)
Formative tests typically involve ≤12 participants, yielding excellent insights while preserving resources for additional tests. Summative tests typically involve either 15 participants per distinct user group, or 25 participants if the user population is relatively homogeneous (i.e., there is 1 distinct user group).

45 Operating room simulator

46 Hospital meeting room

47 Usability testing laboratory (at UL-Wiklund)

48 Sample use error report (abbreviated)
Did not attach needle securely Task 5. Deliver 20 units of insulin. Task priority 4 out of 16 Risk identifier(s) Use-FMEA: Items 4.3, 16.1, 22.3 Potential harms 1 –Insulin underdose causes hyperglycemia. 2 – Needlestick injury causes pain and infection. 3 – Needle contamination causes local or systemic infection. Occurrences 5 test participants committed this use error one or more times during 5 repeated injection trials. The use error occurred 8 times out of the 150 opportunities to err, yielding a use error rate of 5.3%. Description 3 participants pressed the needle on to the injector but did not twist it to lock it in place. 2 participants initially twisted the needle to lock it in place, but then unlocked it when they removed the needle cap by means of a twisting rather than pulling motion. Participant reported root causes 3 participants said they forgot to twist the needle to lock it in place. 2 participants speculated that they must have initially gripped the needle’s hub rather than the cap when removing the cap. Root cause analysis There is no visual feedback to distinguished a needle that is locked in place from one that is not. The needle cap gripping surface is adjacent to the needle gripping surface, making it vulnerable to unintended twisting during cap removal.

49 THE HFE REPORT I’ll take just a couple of minutes to summarizes the benefits of an HFE procedure, but starting with the benefits of HFE itself.

50 FDA’s guidance calls for an HFE/UE report
So, a full-blown discussion of the FDA’s new HFE guidance is out of scope today. That’s a broader topic that AAMI has addressed through its 3-day course titled Human Factors for Medical Devices. Many of you probably have fond and recent memories of participating in that course. Instead, we’re going to be talking about producing the HFE Report. A report that tells the who HFE story, emphasizing how a manufacturer has designed risk out of a device. But, I’ll reflect briefly on the scope of the expected HFE work. Excerpted from: Applying Human Factors and Usability Engineering to Optimize Medical Device Design

51 Analogy An HFE Report is like a court case.
Opening statement about the manufacturer’s HFE efforts Presentation of HFE evidence and testimony (i.e., results of summative usability test) Closing argument that device is safe and effective I liken the report to a court case. My understanding is that the final claim – the closing argument – is essential. FDA needs you to state that the HFE program activities have produced what you consider to be a safe and effective device that does not warrant further risk mitigation. Then, they can decide if they accept, have questions about, or reject your claim.

52 HFE Report – Sections 1, 2, and 3
Here is the HFE Report that many of you have probably poured over. I think it is great to have such a detailed outline, supported by pages of details that explain the suggested report content. And, so I will spend the rest of this Webinar reading the FDA’s verbatim explanation of the report contents! Actually no. That’s not what I will do. But, the FDA’s detailed explanation of the desired content will very helpful. My goal moving forward is review the suggested content and add my perspective as someone who has written many of these reports for clients, reviewed other reports, and talked about the exercise with other HFE professionals.

53 HFE Report – Sections 4, 5, and 6
Here is the HFE Report that many of you have probably poured over. I think it is great to have such a detailed outline, supported by pages of details that explain the suggested report content. And, so I will spend the rest of this Webinar reading the FDA’s verbatim explanation of the report contents! Actually no. That’s not what I will do. But, the FDA’s detailed explanation of the desired content will very helpful. My goal moving forward is review the suggested content and add my perspective as someone who has written many of these reports for clients, reviewed other reports, and talked about the exercise with other HFE professionals.

54 HFE Report – Section 7 Here is the HFE Report that many of you have probably poured over. I think it is great to have such a detailed outline, supported by pages of details that explain the suggested report content. And, so I will spend the rest of this Webinar reading the FDA’s verbatim explanation of the report contents! Actually no. That’s not what I will do. But, the FDA’s detailed explanation of the desired content will very helpful. My goal moving forward is review the suggested content and add my perspective as someone who has written many of these reports for clients, reviewed other reports, and talked about the exercise with other HFE professionals.

55 Claim Device is adequately safe and effective for the intended users, its intended uses, and use environments. So, our case is almost closed. But, you need to make a closing argument; what I described as the essential claim of device safety and effectiveness. FDA tells you explicitly what they want you to claim. Notice that they are not asking you to claim perfection.

56 BENEFITS AND COSTS I’ll take just a couple of minutes to summarizes the benefits of an HFE procedure, but starting with the benefits of HFE itself.

57 HFE benefits and costs Benefits
Faster time to market (regulatory approval) Simpler user documentation and training Increased sales related to better first impressions, ease of learning, and initial satisfaction Reduced risk of recalls, products liability claims Lower customer support demand Extended marketability Costs Possibly $250K-$500K for a moderately complex device Return on investment (ROI) Could be the range of 5:1 to 10:1 ROI factors in the cost of lost sales due to a device’s comparatively poor usability, a reject submission to regulators, a recall, and a lawsuit.

58 Promise of a high ROI

59 HFE PRACTICE MODELS I’ll take just a couple of minutes to summarizes the benefits of an HFE procedure, but starting with the benefits of HFE itself.

60 Who takes the lead? Initially: CEO (when inspired) Regulatory (when facing FDA pushback) Quality (when procedure driven) Long-term: R&D (when properly integrated) Briefly: Marketing (when seeking claims)

61 Contracting for HFE services (outsourcing)
HFE service broker (in-house) Engage consultants as needed Establish strategic relationship with a preferred HFE vendors Establish strategic relationship with multiple HFE vendors

62 In-house capability (core competency)
Establish a central HFE department that consults to project teams Embed HFE specialists within project teams

63 CONCLUSION I’ll take just a couple of minutes to summarizes the benefits of an HFE procedure, but starting with the benefits of HFE itself.

64 Experience suggests… Today, HFE is a mandate rather than an option. HFE is cost-effective Existing staff can perform a substantial amount of HFE work, but specialists are needed at times HFE, if implemented in a timely manner, is not a paperwork exercise. It leads to better devices. HFE offers commercial advantages.

65 Questions?

66 Contact information UL – Wiklund R&D 300 Baker Avenue, Suite 200 Concord, Massachusetts USA Telephone: 001 (978) 371–2700 URL: Management team: Michael Wiklund General Manager – Human Factors Engineering, E: Jonathan Kendler Design Director – Human Factors Engineering, E: Allison Strochlic Research Director – Human Factors Engineering, E:


Download ppt "Integrating Human Factors nto the R&D Process"

Similar presentations


Ads by Google