ICAO EUR Region Performance Framework Regional Performance Framework Workshop Baku, Azerbaijan, 10-11 April 2014 ICAO European and North Atlantic Office 9 April 2014 Page 1
OUTLINES Why a Regional Performance Framework ICAO COG Performance Task Force Inputs - What is already in place (ICAO, EU, FAA, Russian Federation, ICAO workshops) Output - Proposal by the Task Force comprehensive document (EUR Doc 030) Implementation phase 9 April 2014 Page 2 2
Introduction States in the ICAO EUR Region, responding to ICAO requirements, decided to elaborate a Regional Performance Framework, to improve the performance of the aviation system and indentify areas where improvements are possible. To prepare such framework a dedicated Task Force was created The TF analysed what already in place in/outside the Region to understand the context, to make maximum use of what available and avoid duplications The TF prepared a comprehensive framework with KPAs/KPIs and guidance material to support implementation We are at the beginning of the implementation phase 9 April 2014 Page 3 3
ICAO Performance Framework - WHY 11th ANC in 2003 urged ICAO to develop a performance framework for Air Navigation Systems 35th General Assemby in 2004: Called upon States, PIRGs and the aviation industry to use the ICAO Global ATM Operational Concept (Doc 9854) as the common framework Requested ICAO to develop the transition strategies, ATM requirements and SARPs necessary to support implementation of a global ATM system Urged ICAO to ensure that the future global ATM system is performance based and that 37th General Assembly in 2010 stressed again the performance framework ICAO ANC/12 - Recommendation 1/15 Performance monitoring and measurement of air navigation systems. That ICAO: a) establish a set of common air navigation service performance metrics supported by guidance material, building on existing ICAO documentation (e.g. Manual on Global Performance of the Air Navigation System (Doc 9883) and the Manual on Air Navigation Services Economics (Doc 9161)); b) promote the development and use of leading safety indicators to complement existing lagging safety indicators as an integral and key component to drive improvement in performance and in the achieved management of risk; and c) 9 April 2014 Page 4
ICAO EUR Performance Framework - WHO WHY To elaborate a performance framework for the EUR Region, to improve the performance of the aviation system and indentify areas where improvements are possible WHEN COG 47 (Rostov on Don, June 2010) HOW Based on clear principles: Produce improvements to the aviation system Avoid duplication of efforts and make maximum use of existing arrangements As far as possible be applicable also in the NAT Region Consider impact on resources Follow a pragmatic and stepwise approach Should also represent Regional input to ICAO HQ activities in developing metrics for global use Support the future developments of EU Performance Scheme 9 April 2014 Page 5
ICAO EUR Performance Framework - WHAT Input ICAO framework EU-ECTL (Single European Sky and Performance Scheme) FAA Russian Federation ICAO EUR Workshops (Rome 2011, Bishkek 2013.) Pragmatic approach in developing the proposal Output Development of a comprehensive framework Identification of 6 KPAs out of 11 ICAO KPAs Definition of focus areas, objectives and KPIs Definition of Processes, Roles and Responsibilities Guidance material To assess the Regional performance and to identify areas where improvements are possible 9 April 2014 Page 6 Safety Access and equity Capacity Efficiency Environment Flexibility Global Interoperability Cost Effectiveness Predictability Security Participation by ATM community
ICAO EUR Performance Framework - WHAT ICAO EUR Region Performance Framework Document (ICAO EUR Doc 030) was approved by EANPG and COG in 2013 and published in English and Russian language. http://www.paris.icao.int/documents_open_meetings/subcategory.php?id=169 http://www.paris.icao.int/documents_open/files.php?subcategory_id=170 Performance Framework document describes: INTRODUCTION BACKGROUND INFORMATION RELATIONSHIPS WITH ICAO GLOBAL DEVELOPMENTS AND REGIONAL INITIATIVES PART A SCOPE ROLES AND RESPONSIBILITIES KPA/KPI/METRICS MONITORING, REPORTING AND REVISION PROCESS AT REGIONAL/NATIONAL LEVEL PART B KPAs TEMPLATES FOR THE REGIONAL PERFORMANCE REVIEW REPORT ANNEX 1: TERMINOLOGY ANNEX 2: REFERENCE MATERIAL 9 April 2014 Page 7
KPAs-KPIs: Summary table KPA OBJECTIVES FOCUS AREAS INDICATORS SAFETY Ensure safety continuous improvement through reduction of ATM related safety occurrences and implementation of uniform safety standards Effectiveness of Safety Management (Safety Maturity Questionnaire) Level of State Safety/Just culture (Safety Culture Questionnaire) Adoption of an harmonized occurrences severity classification methodology CAPACITY Capacity meets demand for enroute and at airports En-route ATFM Delay Airport ATFM Delay Average en-route ATFM delay generated by airspace volume Average ATFM delay per flight in the main airports (to be identified by States) EFFICIENCY Ensure users may use most efficient routes Horizontal Flight Efficiency Average horizontal en route flight efficiency (length of the en route part of the actual trajectory/last flight planned route vs great circle) ENVIRONMENT Contribute to the protection of environment (fuel/co2 emissions reduction) CO2 emissions related to inefficiencies in route extension COST EFFECTIVENESS Contribute to optimization of costs for ANS ATCO Productivity IFR Flights (en-route) per ATCO hour duty IFR flight hours per ATCO hour on duty IFR movements per ATCO hour on duty PARTICIPATION BY ATM COMMUNITY Ensure States' participation to Regional planning and implementation activities Level of participation to meetings Level of responses to planning activities Level of provision of performance results 9 April 2014 Page 8 8
EANPG conclusions EANPG 55 in November 2013 concluded: EANPG Conclusion 55/25 Implementation of the Regional Performance Framework That the ICAO Regional Director, Europe and North Atlantic, undertake appropriate actions to: a) publish the Russian language version of the ICAO EUR Doc 030, as soon as available; b) launch the implementation of the ICAO EUR Region Performance Framework, including the awareness campaign for States in the Eastern part of the EUR Region, starting from 1st January 2014 with the aim to have a first regional report presented to EANPG 57; and c) invite States to put in place all activities aimed at the implementation of the Regional Performance Framework as defined in ICAO EUR Doc 030. 9 April 2014 Page 9
EANPG conclusions next steps.and. Development phased closed, now focus on the implementation that would represent the next most challenging and crucial phase to ensure that the regional performance framework would bring expected benefits. The implementation would envisage the collection of data from States from the start of 2014. Performance results would then be provided and aggregated in 2015 enabling a status report to EANPG/57 in 2015. The TF will monitor the implementation of the Framework and all evolutions having a potential impact on performance at the global level (e.g. follow up activities related to ANC/12 and General Assembly 38) and at the Regional level (e.g. new States included in the ICAO EUR Region, developments related to EU Performance Scheme) and prepare proposals to update the ICAO EUR Doc 030, as appropriate. 9 April 2014 Page 10
EANPG conclusions implementation.and. EANPG discussed and supported the proposed key areas of future work of the COG Perf TF to support implementation of the framework as follows: a) define of a roadmap with all relevant dates and prepare of workable tables to be used by States for reporting performance results and a tool to be used by Secretariat for collecting and managing data related to performance; b) circulate a questionnaire to States to address the implementation phase (e.g. availability of data, tools, major problems, etc.) and also requiring the nomination of a Focal Point. c) define and carry out an awareness campaign to further support understanding and promote the framework, mainly using already planned events especially in the Eastern part of the Region (e.g. specific 2 day performance framework workshop in conjunction with already planned ATMGE meetings or other international events), also including a dedicated multi-lingual workshop for identified Focal Points. 9 April 2014 Page 11
Conclusions ICAO EUR Region has defined a performance framework aimed at monitoring/reporting performance Objective is to identify areas where improvements are possible Built on existing ICAO documents and regional initiatives Proposed as a good practice towards ICAO HQ and other Regions But real benefits only if we implement! 9 April 2014 Page 12
Questionnaire for States ICAO European and North Atlantic Office 9 April 2014 Page 13
Objectives To support the implementation To better understand what is already in place at State level in terms of: Existing processes (also to avoid duplications) Performance measurement systems Data collection and management Performance areas and indicators Additional comments To identify a Focal Point to: have a direct link and provide support request information Organize a dedicated workshop 9 April 2014 Page 14
Preparation of the Questionnaire An initial draft Questionnaire has been prepared by the TF The Questionnaire will be discussed during this workshop inputs will be reflected in a revised version final version will be sent to ICAO EUR Region States in mid April for replies by mid May Replies from States will be collected and main elements provided to COG in July A dedicated workshop for Focal Points will be organised later this year 9 April 2014 Page 15
Content of the draft Questionnaire Very high level questions for an initial exchange Details to be addressed with focal points on multi/bi-lateral basis as required Additional views/comments can be provided Questions related to specific KPAs/KPIs will be addressed during the workshop 9 April 2014 Page 16
Content of the draft Questionnaire General Information Contextual information KPA Safety KPA Capacity KPA Efficiency KPA Environment KPA Costeffectiveness Additional information Focal Point 1. Do you have a national system for collecting and managing data aimed at performance monitoring and reporting? 2. Do you participate in the European Union Performance Scheme? 3. Do you participate in the Eurocontrol processes aimed at assessing operational and financial performance (i.e. Performance Review Report, ATM Cost Effectiveness benchmarking report)? 4. Do you have in place systems and procedures to collect and report the State contextual information requested in Chapter 17 Reporting Table A of ICAO EUR Doc 030? 5. Do you have in place systems and procedures to measure Safety and in particular the indicators stemming from ICAO EUR Doc 030? 6. Do you have in place systems and procedures to measure Capacity (expressed in terms of ATFM delays)? 7. If yes, do you measure delays in the En-route phase, at airports or both? 8. Do you have in place systems and procedures to measure the horizontal en route flight efficiency as described in the ICAO EUR Doc 030? 9. Do you have in place systems for measuring: a) actual trajectory distance of flights based on surveillance data? b) flight plan trajectory distance of flights? c) great circle distance of flights? 10. Do you have in place systems and procedures to measure or estimate CO2 emissions of flights? 11. Do you use the ICAO Fuel Savings Estimation Tool (IFSET)? 12. Do you have in place systems and procedures to measure ATCO productivity as expressed in the ICAO EUR Doc 030? 13. Do you have any additional comments, suggestions or questions on the implementation of the Regional Performance Framework? 14. Please report name and contact details of the Focal Point/s that the ICAO Performance Task Force can contact for any queries related to this questionnaire and the implementation of the Regional Performance Framework 9 April 2014 Page 17
Thank you! 9 April 2014 Page 18 18