1. SLEEP/WAKE Research Centre MOE TIKA/MOE PAI Philippa Gander Sleep/Wake Research Centre, Massey University Jim Mangie Delta Air Lines SCIENCE IN AN OPERATIONAL SETTING

2. SLEEP/WAKE Research Centre MOE TIKA/MOE PAI Outline What to measureWhat to measure When to measureWhen to measure Interpreting the dataInterpreting the data Safety Performance IndicatorsSafety Performance Indicators ConclusionsConclusions

3. SLEEP/WAKE Research Centre MOE TIKA/MOE PAI What to Measure in FRMS operational data / crew fatigue measures Operators need to be able to: Identify (monitor) level of fatigue hazard(s)Identify (monitor) level of fatigue hazard(s) Assess fatigue-related safety riskAssess fatigue-related safety risk Probability/severityProbability/severity ICAO tolerability matrixICAO tolerability matrix Define and monitor fatigue safety performance indicatorsDefine and monitor fatigue safety performance indicators Investigate role of fatigue in incidents/accidentsInvestigate role of fatigue in incidents/accidents

4. SLEEP/WAKE Research Centre MOE TIKA/MOE PAI What to Measure: Crew Fatigue ICAO definition of fatigue: A physiological state of reduced mental or physical performance capability resulting from sleep loss or extended wakefulness, circadian phase, or workload (mental and/or physical activity) that can impair a crew member’s alertness and ability to safely operate an aircraft or perform safety related duties.  Functional status (subjective,objective)  Sleep history  Circadian phase  Workload

5. SLEEP/WAKE Research Centre MOE TIKA/MOE PAI Samn-Perelli Fatigue Ratings 1=fully alert, wide awake 2=very lively, responsive, but not at peak 3=OK, somewhat refreshed 4=a little tired, less than fresh 5=moderately tired, let down 6=extremely tired, difficult to concentrate 7=completely exhausted, unable to function effectively

6. SLEEP/WAKE Research Centre MOE TIKA/MOE PAI Karolinska Sleepiness Ratings 1= extremely alert 2= 3= alert 4= 5= neither sleepy nor alert 6= 7= sleepy, but no difficulty remaining awake 8= 9= extremely sleepy, fighting sleep

7. SLEEP/WAKE Research Centre MOE TIKA/MOE PAI PVT Performance (Reaction Speed) Press this if you are right-handed Press this if you are left-handed

8. SLEEP/WAKE Research Centre MOE TIKA/MOE PAI Sleep: Actigraphy and Diaries

9. SLEEP/WAKE Research Centre MOE TIKA/MOE PAI When to Measure Crew Fatigue Monitoring for FRM ProcessesMonitoring for FRM Processes In response to a series of fatigue reportsIn response to a series of fatigue reports to identify extent and severity of hazardto identify extent and severity of hazard In response to an incidentIn response to an incident SPIs to evaluate effectiveness of fatigue mitigations and controlsSPIs to evaluate effectiveness of fatigue mitigations and controls Validation of a new routeValidation of a new route Monitoring for FRMS Assurance ProcessesMonitoring for FRMS Assurance Processes SPIs set in FRMS Policy objectivesSPIs set in FRMS Policy objectives SPIs for regulatory auditSPIs for regulatory audit Crew fatigue measures may not always be needed

10. SLEEP/WAKE Research Centre MOE TIKA/MOE PAI Safety Performance Indicators (SPIs) 5 FRMS Components Fatigue Safety Action Group 3. Risk Management Processes 1. Policy 4.Safety Assurance Processes 5. Promotion Processes 2. Documentation SMS

11. SLEEP/WAKE Research Centre MOE TIKA/MOE PAI Comparing fatigue on ULR and LR flights Safety Performance Indicators: Example

12. SLEEP/WAKE Research Centre MOE TIKA/MOE PAI Fatigue Status at Start of Duty SPI – sleep in the last 24 hrs

13. SLEEP/WAKE Research Centre MOE TIKA/MOE PAI Fatigue Status at Start of Duty SPI – mean PVT reaction speed early in flight

14. SLEEP/WAKE Research Centre MOE TIKA/MOE PAI Fatigue Status at Top of Climb SPI – median total in-flight sleep

15. SLEEP/WAKE Research Centre MOE TIKA/MOE PAI Fatigue Status at Top of Climb SPI – mean PVT reaction speed late in flight

16. SLEEP/WAKE Research Centre MOE TIKA/MOE PAI Fatigue Status at Top of Climb SPI – % crew with KSS ≥ 7

17. SLEEP/WAKE Research Centre MOE TIKA/MOE PAI Operational SPIs: Examples Track data on number of :Track data on number of : exceedances of planned crew duty day (e.g. > 14 hrs)exceedances of planned crew duty day (e.g. > 14 hrs) flight duty periods ending > 30 mins later than scheduledflight duty periods ending > 30 mins later than scheduled flight duty periods starting / ending within window of circadian low (WOCL)flight duty periods starting / ending within window of circadian low (WOCL) reserve crew call-outs (on particular flights, at a particular crew base, etc)reserve crew call-outs (on particular flights, at a particular crew base, etc) Monitoring of FRM processes Monitoring of FRMS safety assurance processes

18. SLEEP/WAKE Research Centre MOE TIKA/MOE PAI Conclusions ChallengeChallenge Developing in-house expertise versus using consultants ($$)Developing in-house expertise versus using consultants ($$) Data sharingData sharing Operators don’t have to reinvent the wheelOperators don’t have to reinvent the wheel Rich data source for improving fatigue scienceRich data source for improving fatigue science NeedsNeeds Paradigms for data sharingParadigms for data sharing Better indicators of fatigue-related performance impairmentBetter indicators of fatigue-related performance impairment Better fatigue measurement technologiesBetter fatigue measurement technologies Better fatigue risk assessment (safety consequences of being fatigued in a given context)Better fatigue risk assessment (safety consequences of being fatigued in a given context) Better fatigue risk controls and mitigationsBetter fatigue risk controls and mitigations Cooperation is the key

19. SLEEP/WAKE Research Centre MOE TIKA/MOE PAI Acknowledgements Dr Jarnail Singh, Singapore CAADr Jarnail Singh, Singapore CAA Participants in B-777 studyParticipants in B-777 study Scientific Steering Committee, FAA 3-airline studyScientific Steering Committee, FAA 3-airline study