Airworthiness Analysis

Question How many Approvals do Airworthiness oversee? 1000 1250 1400

Question How many Q Pulse events did we complete in 2015? 4045 5250 7400

Airworthiness Workload Airworthiness manages approximately 1400 approvals located not only within the UK, but also all around the world. This includes 125 overseas approvals on behalf of EASA in such locations as Singapore, Australia and China and 130 approvals on behalf of the UK Military. Airworthiness also manages 260 approvals due to the recently created Bilateral agreements with the United States (FAA) and Canada (TCCA) and the soon to be completed agreement with Brazil. Beyond just approval oversight AW carries out over 1,000 SAFA inspections, 250 ACAMs, 200 CofAs &permits, Certification/design, MOR and training/consultation. 1400 Approvals (Overview) UK Pt 145 Maintenance 357 UK Pt MG Continuing Airworthiness 214 UK Pt 21G production 176 UK Pt 147 Training Organisations 65 Overseas Approvals (CAAi) 125 Military (CAAi) 130 UK BCAR 77 FAA and TCCA 252 Pt MG 4045 Q Pulse Inspections/Reviews UK Pt 145 Maintenance 1049 UK Pt MG Continuing Airworthiness 374 UK Pt 21G production 406 UK Pt 147 Training Organisations 417 Overseas Approvals (CAAI) 493 Military 208 UK BCAR 97 FAA and TCCA 373

Airworthiness Workload FAA/TCCA/BCAR approvals not included. Initials not included Baseline hours cover all activity scheduled & Unscheduled Average 138Hrs/Approval Average 48 Hrs/Approval Average 35 Hrs/Approval 23Hrs/Approval This diagram demonstrates that the average base line hours (Combination of Complexity/Performance) as planned for each approval, allocates our Resource proportionally.

Workload Overview These pie charts show the percentage of time our field force (not including SAFA) within AW spend for each activity. We now have a forward looking forecast and using metric s the ability to measure what we actually achieved. With the dynamic nature of our operational workload and the limitation of job time recording, a mismatch between actual and forecast would be expected. Additionally the time periods for these charts also differ, but despite this, the data gives us a real insight into our workload; Oversight (Green) The Forecast is higher than the actual, limitations of job time recording (metric s) as a results the 5 minutes used here and there relating to oversight tend not to get recorded correctly and get swept up into the Management Other (Bucket). Not all unscheduled tasks, which mostly consist of projects/working groups have their own metric s code, so again they are swept up into the Management Other (Bucket). Overall confidence in our job time recording and forecasting is fairly high, especially within the context of known limitations. All of these activities except Management and Unscheduled are directly funded via charges/contracts. Airworthiness forecasted 78% directly funded activity and achieved 73%. Oversight 8% CAAi 23% Unscheduled Management 19% Aircraft 5% Oversight 45% Actual (Metric s) Apr 15 to Jan 16 Pt MG 11% CAAi 11% 21% Unscheduled Oversight Management Aircraft 6% Forecast Nov 15 to Nov 16 51%

Findings Analysis 2015 08/07/2016 9

Question In 2014 AW raised 4414 findings, how many findings did we raise in 2015? 5,002 4,047 3497

2015 Findings Overview 5000 4500 4000 3500 3000 2500 2000 1500 1000 500 0 AW Findings Raised 4375 4414 Including GA Pt 145 Including GA 3497 AW only 2013 2014 2015 3497 findings were raised by Airworthiness in 2015. At first glance it would appear that the number of findings raised in 2013 & 2014 is almost identical. Further investigation has revealed that 2013 did not contain a complete set of data, due to the phased introduction of Q Pulse within Airworthiness that year. 2013 & 2014 contained general aviation data, with 2015 being the first year this data has been completely separated, which helps to explain the drop off in the number of findings raised. Warning Management Information can lead to incorrect conclusions without the narrative/intelligence that gives the necessary context.

2015 Level 1 Findings 18 16 14 12 10 8 6 4 2 0 Level 1 Findings Raised GAU Pt 145 GAU GAU Nil AW AW AW 2013 2014 2015 9 level 1 findings were raised by Airworthiness during 2015. All level 1 findings have been individually reviewed, as trending is difficult for such a small set of data. 2 level 1 findings against Pt 147 training schools, regarding examination irregularities has identified that might be prevalent across the sector. 4 UK Pt MG 2 Aircraft Survey 1 UK Pt 145 2 UK Pt 147 2015

Safety Severity Safety Severity adds greater granularity to findings beyond just recording the level. High Safety severity has a direct link to safety, Moderate has a potential link to safety and Low has no link to Safety. Are more Moderate/high Safety Severity findings raised against the Corporate jet Sector? 47% 7% 2015 46% High Moderate Low

Safety Severity 1400 1200 1000 800 Very few high safety severity findings were raised against Part21G production or Part 147 Training organisations, these findings can be difficult to directly link to safety. 357 Orgs AV 3.3 All AW Findings 600 400 200 0 214 Orgs AV 2.1 Pt 145 177 Orgs AV 2.6 66 Orgs AV 1.4 Pt MG AV 1.1 94 Orgs AV 3.4 UK Pt MG UK Pt 21G UK Pt 147 UK Pt 145 ACAM Overseas Pt 145 High Moderate Low

Root Cause Correct Root Cause identification and resolution leads to longer term improvements, with fewer repeat findings Pt 145 Process and Documentation are still recorded as the top 2 Root causes. This is possibly due to the symptom being identified rather than the Root Pt Cause. MG Significantly Competence or capability, might add weight to the perception that there is an industry skills shortage

Closure Performance Closure Performance is a Q Pulse drop down menu that records whether a finding has occurred before (repeat finding) and the quality of the organisation s first response. This was limited to the organisation s first response for a very good reason! If it wasn t measured at a single point in time, then the data would be lost (as the status of the performance field got updated, eventually all findings would end up accepted). For 2015 76% of findings responses were accepted first time, 12% rejected, 8% late and 4% late/rejected. Rejecting an organisation s response should be seen as evidence that the CAA is ensuring that the Root Cause has been correctly identified and fully addressed. It also allows us to measure the effectiveness of the Organisation quality system. 500 400 300 200 100 0 1st Response accepted Rejected late late/rejected Pt 145 Pt MG Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec

All UK Pt145 Maintenance 180 160 140 120 100 80 145.A.65(b&c) Main issues relate to; the independence of the Quality system and audit programme, the content of the plan, the completion of the plan, the scope of the audits and procedures. 145.A.40(b) Main issues relate to; Tool control, which is backed up by MOR data 145.A.25 With Low S/S findings removed Facilities is number 3, Issues with suitability of facilities/ environment for safe completion of maintenance IAW the requirements of the approved data. 60 40 4 1 Corporate Jet Sector 20 3 2 0 Pt 145 Pt MG High Moderate low

UK Pt MG Airworthiness management 80 70 M.A.712(a&b) Main issues relate to; the independence/effectiveness of the Quality system and audit programme, the content of the plan, the completion of the plan, the scope of the audits and procedures. 60 50 40 M.A.302 Main Issues relate to; the control,review and content of the maintenance programme. M.A.708(b) Main issues relate to; the management of continuing airworthiness tasks, including mass & balance, maintenance programmes, Airworthiness Directives and modifications. Although overall management is an issue, no trend exists for any particular element. 30 1 20 10 3 4 2 Corporate Jet Sector 0 Pt 145 Pt MG High Moderate low

ACAM Aircraft inspections 25 20 15 M.A.403 & M.A.301(2) Main issues relate to the correct recording and deferral of defects, damage and unserviceable Components. Heavily featured in all D category findings (Fuselage, wings, tail, cabin, LG). M.A.302 Main Issues relate to; the control,review and content of the maintenance programme. 2 Flight Manual M.A.305 & M.A.306 Main Issues relate to; the control,review and content of the CAW records system including the tech log. 10 Corporate Jet Sector 5 0 B.6 Defect Management Pt 145 B.4 Markings & Placards 1 C.1 Maintenance Programme 4 C.4 Records B.1 Documents Pt MG B.5 Operational requirements C.3 Repairs D.4 Tail 3 D.3 Airworthiness Directives High Moderate low

Summary Overview Top 3 findings with Low Safety Severity findings removed Part 145 Part 21 Part M Part 147 ACAM Quality System Quality System Quality System Quality System Defect Management Tools Requirements CAW Management Personnel 37% Records 35% Facilities Obligations Maintenance Programmes Exposition Maintenance Programme