"THE STATE OF QUALITY MEASURES IN CANADA KATHLEEN FLANAGAN

Transcription

1 "THE STATE OF QUALITY MEASURES IN CANADA KATHLEEN FLANAGAN October 10, 2013

2

3 OVERVIEW Context ECEC in Canada Who uses quality measurement tools? How are they used? Unique examples

4 Governance: Shift to Education Ministries

5 Great Bear Great Slave osis Athabasca Superior Huron Michigan Erie Ontario Nipigon YUKON ALBERTA BRITISH COLUMBIA NORTHWEST TERRITORY BAFFIN MANITOBA ONTARIO SASKATCHEWAN QUEBEC NOVA SCOTIA NUNAVUT DEVON MELVILLE SOMERSET PRINCE OF BANKS VICTORIA Beauton Davis Strait PRINCE SOUTHHAMPTON Pacific Ocean VANCOUVER Hudson Labrador NEW BRUNSWICK ELLESMERE WALES Baffin CHARLES James Gulf of St. Lawrence Prince Edward Island Whitehorse Yellowknife Edmonton Victoria Regina Quebec Ottawa St. John's Halifax Fredericton Toronto Iqaluit Canada

6 Great Bear Great Slave osis Athabasca Superior Huron Michigan Erie Ontario Nipigon YUKON ALBERTA BRITISH COLUMBIA NORTHWEST TERRITORY BAFFIN MANITOBA ONTARIO SASKATCHEWAN QUEBEC NOVA SCOTIA NUNAVUT DEVON MELVILLE SOMERSET PRINCE OF BANKS VICTORIA Beauton Davis Strait PRINCE SOUTHHAMPTON Pacific Ocean VANCOUVER Hudson Labrador NEW BRUNSWICK ELLESMERE WALES Baffin CHARLES James Gulf of St. Lawrence Prince Edward Island Whitehorse Yellowknife Edmonton Victoria Regina Quebec Ottawa St. John's Halifax Fredericton Toronto Iqaluit Canada

7 Great Bear Great Slave osis Athabasca Superior Huron Michigan Erie Ontario Nipigon YUKON ALBERTA BRITISH COLUMBIA NORTHWEST TERRITORY BAFFIN MANITOBA ONTARIO SASKATCHEWAN QUEBEC NOVA SCOTIA NUNAVUT DEVON MELVILLE SOMERSET PRINCE OF BANKS VICTORIA Beauton Davis Strait PRINCE SOUTHHAMPTON Pacific Ocean VANCOUVER Hudson Labrador NEW BRUNSWICK ELLESMERE WALES Baffin CHARLES James Gulf of St. Lawrence Prince Edward Island Whitehorse Yellowknife Edmonton Victoria Regina Quebec Ottawa St. John's Halifax Fredericton Toronto Iqaluit Canada

8 Great Bear Great Slave osis Athabasca Superior Huron Michigan Erie Ontario Nipigon YUKON ALBERTA BRITISH COLUMBIA NORTHWEST TERRITORY BAFFIN MANITOBA ONTARIO SASKATCHEWAN QUEBEC NOVA SCOTIA NUNAVUT DEVON MELVILLE SOMERSET PRINCE OF BANKS VICTORIA Beauton Davis Strait PRINCE SOUTHHAMPTON Pacific Ocean VANCOUVER Hudson Labrador NEW BRUNSWICK ELLESMERE WALES Baffin CHARLES James Gulf of St. Lawrence Prince Edward Island Whitehorse Yellowknife Edmonton Victoria Regina Quebec Ottawa St. John's Halifax Fredericton Toronto Iqaluit Canada

9 Great Bear Great Slave osis Athabasca Superior Huron Michigan Erie Ontario Nipigon YUKON ALBERTA BRITISH COLUMBIA NORTHWEST TERRITORY BAFFIN MANITOBA ONTARIO SASKATCHEWAN QUEBEC NOVA SCOTIA NUNAVUT DEVON MELVILLE SOMERSET PRINCE OF BANKS VICTORIA Beauton Davis Strait PRINCE SOUTHHAMPTON Pacific Ocean VANCOUVER Hudson Labrador NEW BRUNSWICK ELLESMERE WALES Baffin CHARLES James Gulf of St. Lawrence Prince Edward Island Whitehorse Yellowknife Edmonton Victoria Regina Quebec Ottawa St. John's Halifax Fredericton Toronto Iqaluit Canada

10 Great Bear Great Slave osis Athabasca Superior Huron Michigan Erie Ontario Nipigon YUKON ALBERTA BRITISH COLUMBIA NORTHWEST TERRITORY BAFFIN MANITOBA ONTARIO SASKATCHEWAN QUEBEC NOVA SCOTIA NUNAVUT DEVON MELVILLE SOMERSET PRINCE OF BANKS VICTORIA Beauton Davis Strait PRINCE SOUTHHAMPTON Pacific Ocean VANCOUVER Hudson Labrador NEW BRUNSWICK ELLESMERE WALES Baffin CHARLES James Gulf of St. Lawrence Prince Edward Island Whitehorse Yellowknife Edmonton Victoria Regina Quebec Ottawa St. John's Halifax Fredericton Toronto Iqaluit Canada

11 Great Bear Great Slave osis Athabasca Superior Huron Michigan Erie Ontario Nipigon YUKON ALBERTA BRITISH COLUMBIA NORTHWEST TERRITORY BAFFIN MANITOBA ONTARIO SASKATCHEWAN QUEBEC NOVA SCOTIA NUNAVUT DEVON MELVILLE SOMERSET PRINCE OF BANKS VICTORIA Beauton Davis Strait PRINCE SOUTHHAMPTON Pacific Ocean VANCOUVER Hudson Labrador NEW BRUNSWICK ELLESMERE WALES Baffin CHARLES James Gulf of St. Lawrence Prince Edward Island Whitehorse Yellowknife Edmonton Victoria Regina Quebec Ottawa St. John's Halifax Fredericton Toronto Iqaluit Canada

12 Early Learning Curriculum Frameworks

13 Great Bear Great Slave osis Athabasca Superior Huron Michigan Erie Ontario Nipigon YUKON ALBERTA BRITISH COLUMBIA NORTHWEST TERRITORY BAFFIN MANITOBA ONTARIO SASKATCHEWAN QUEBEC NOVA SCOTIA NUNAVUT DEVON MELVILLE SOMERSET PRINCE OF BANKS VICTORIA Beauton Davis Strait PRINCE SOUTHHAMPTON Pacific Ocean VANCOUVER Hudson Labrador NEW BRUNSWICK ELLESMERE WALES Baffin CHARLES James Gulf of St. Lawrence Prince Edward Island Whitehorse Yellowknife Edmonton Victoria Regina Quebec Ottawa St. John's Halifax Fredericton Toronto Iqaluit Canada

14 Great Bear Great Slave osis Athabasca Superior Huron Michigan Erie Ontario Nipigon YUKON ALBERTA BRITISH COLUMBIA NORTHWEST TERRITORY BAFFIN MANITOBA ONTARIO SASKATCHEWAN QUEBEC NOVA SCOTIA NUNAVUT DEVON MELVILLE SOMERSET PRINCE OF BANKS VICTORIA Beauton Davis Strait PRINCE SOUTHHAMPTON Pacific Ocean VANCOUVER Hudson Labrador NEW BRUNSWICK ELLESMERE WALES Baffin CHARLES James Gulf of St. Lawrence Prince Edward Island Whitehorse Yellowknife Edmonton Victoria Regina Quebec Ottawa St. John's Halifax Fredericton Toronto Iqaluit Canada

15 Great Bear Great Slave osis Athabasca Superior Huron Michigan Erie Ontario Nipigon YUKON ALBERTA BRITISH COLUMBIA NORTHWEST TERRITORY BAFFIN MANITOBA ONTARIO SASKATCHEWAN QUEBEC NOVA SCOTIA NUNAVUT DEVON MELVILLE SOMERSET PRINCE OF BANKS VICTORIA Beauton Davis Strait PRINCE SOUTHHAMPTON Pacific Ocean VANCOUVER Hudson Labrador NEW BRUNSWICK ELLESMERE WALES Baffin CHARLES James Gulf of St. Lawrence Prince Edward Island Whitehorse Yellowknife Edmonton Victoria Regina Quebec Ottawa St. John's Halifax Fredericton Toronto Iqaluit Canada

16 Great Bear Great Slave osis Athabasca Superior Huron Michigan Erie Ontario Nipigon YUKON ALBERTA BRITISH COLUMBIA NORTHWEST TERRITORY BAFFIN MANITOBA ONTARIO SASKATCHEWAN QUEBEC NOVA SCOTIA NUNAVUT DEVON MELVILLE SOMERSET PRINCE OF BANKS VICTORIA Beauton Davis Strait PRINCE SOUTHHAMPTON Pacific Ocean VANCOUVER Hudson Labrador NEW BRUNSWICK ELLESMERE WALES Baffin CHARLES James Gulf of St. Lawrence Prince Edward Island Whitehorse Yellowknife Edmonton Victoria Regina Quebec Ottawa St. John's Halifax Fredericton Toronto Iqaluit Canada

17 Great Bear Great Slave osis Athabasca Superior Huron Michigan Erie Ontario Nipigon YUKON ALBERTA BRITISH COLUMBIA NORTHWEST TERRITORY BAFFIN MANITOBA ONTARIO SASKATCHEWAN QUEBEC NOVA SCOTIA NUNAVUT DEVON MELVILLE SOMERSET PRINCE OF BANKS VICTORIA Beauton Davis Strait PRINCE SOUTHHAMPTON Pacific Ocean VANCOUVER Hudson Labrador NEW BRUNSWICK ELLESMERE WALES Baffin CHARLES James Gulf of St. Lawrence Prince Edward Island Whitehorse Yellowknife Edmonton Victoria Regina Quebec Ottawa St. John's Halifax Fredericton Toronto Iqaluit Canada

18 Great Bear Great Slave osis Athabasca Superior Huron Michigan Erie Ontario Nipigon YUKON ALBERTA BRITISH COLUMBIA NORTHWEST TERRITORY BAFFIN MANITOBA ONTARIO SASKATCHEWAN QUEBEC NOVA SCOTIA NUNAVUT DEVON MELVILLE SOMERSET PRINCE OF BANKS VICTORIA Beauton Davis Strait PRINCE SOUTHHAMPTON Pacific Ocean VANCOUVER Hudson Labrador NEW BRUNSWICK ELLESMERE WALES Baffin CHARLES James Gulf of St. Lawrence Prince Edward Island Whitehorse Yellowknife Edmonton Victoria Regina Quebec Ottawa St. John's Halifax Fredericton Toronto Iqaluit Canada

19 Great Bear Great Slave osis Athabasca Superior Huron Michigan Erie Ontario Nipigon YUKON ALBERTA BRITISH COLUMBIA NORTHWEST TERRITORY BAFFIN MANITOBA ONTARIO SASKATCHEWAN QUEBEC NOVA SCOTIA NUNAVUT DEVON MELVILLE SOMERSET PRINCE OF BANKS VICTORIA Beauton Davis Strait PRINCE SOUTHHAMPTON Pacific Ocean VANCOUVER Hudson Labrador NEW BRUNSWICK ELLESMERE WALES Baffin CHARLES James Gulf of St. Lawrence Prince Edward Island Whitehorse Yellowknife Edmonton Victoria Regina Quebec Ottawa St. John's Halifax Fredericton Toronto Iqaluit Canada

20 Great Bear Great Slave osis Athabasca Superior Huron Michigan Erie Ontario Nipigon YUKON ALBERTA BRITISH COLUMBIA NORTHWEST TERRITORY BAFFIN MANITOBA ONTARIO SASKATCHEWAN QUEBEC NOVA SCOTIA NUNAVUT DEVON MELVILLE SOMERSET PRINCE OF BANKS VICTORIA Beauton Davis Strait PRINCE SOUTHHAMPTON Pacific Ocean VANCOUVER Hudson Labrador NEW BRUNSWICK ELLESMERE WALES Baffin CHARLES James Gulf of St. Lawrence Prince Edward Island Whitehorse Yellowknife Edmonton Victoria Regina Quebec Ottawa St. John's Halifax Fredericton Toronto Iqaluit Canada

21 Great Bear Great Slave osis Athabasca Superior Huron Michigan Erie Ontario Nipigon YUKON ALBERTA BRITISH COLUMBIA NORTHWEST TERRITORY BAFFIN MANITOBA ONTARIO SASKATCHEWAN QUEBEC NOVA SCOTIA NUNAVUT DEVON MELVILLE SOMERSET PRINCE OF BANKS VICTORIA Beauton Davis Strait PRINCE SOUTHHAMPTON Pacific Ocean VANCOUVER Hudson Labrador NEW BRUNSWICK ELLESMERE WALES Baffin CHARLES James Gulf of St. Lawrence Prince Edward Island Whitehorse Yellowknife Edmonton Victoria Regina Quebec Ottawa St. John's Halifax Fredericton Toronto Iqaluit Canada

22 EARLY CHILDHOOD EDUCATORS 2013 DATA: Wages have increased significantly in most PTs Workforce is more experienced, and aging Most have post-secondary credential and participate in PD YOU BET WE STILL CARE! Significant PD is related to new early learning frameworks Job Satisfaction is relatively high

23 With exception of Nunavut, there is at least one quality measurement tool in use in every PT, since mid 1980s

24 Almost all PTs use one or more variations on the Harms and Clifford Environmental Rating Scales.

25 PTs vary in how the tools are administered, who administers, the frequency of use, and for what purpose.

26 Aside from reasons for use, PTs vary in how training, certification, and inter-rater reliability issues are dealt with. Most master trainers are within governments.

27 Other tools used The SpeciaLink Early Childhood Inclusion Quality Scale (2009) primarily in Atlantic provinces Caregiver Interaction Scale Alberta, New Brunswick, PEI Program Administration Scale Alberta, Nova Scotia Quality Program Assessment Service for After School Care Alberta City of Toronto Operating Criteria - Ontario

28 REASONS FOR USING QUALITY TOOLS WHY? Program Support and Consultation Licensing and Monitoring Research Assessment of staff competency Self-Assessment

29 Quebec Significant research using ECERS tools: Japel, C. (2012). The Quebec child care system: Lessons from research. In N. Howe & L. Prochner (Eds.), Recent Perspectives on Early Childhood Education and Care in Canada (pp ). Toronto: University of Toronto Press. Japel, C., Tremblay, R. E., & Côté, S. (2005). Quality counts! Assessing the quality of daycare services based on the Quebec Longitudinal Study of Child Development. Choices, 11, Quebec: Institut de la statistique de Quebec. Ongoing Quality measurement is carried out by nongovernmental organizations

30 Ontario Province is responsible for policy, funding, and licensing to support licensed child care. Many municipalities have operating criteria for centres they fund/manage that include requirements for program quality over and above the basic health / safety requirements set out by the province (e.g., City of Toronto). Additionally, a number of municipalities in the province have developed quality rating and improvement systems (QRIS) as a systematic approach to assess, improve, and communicate the level of quality in local licensed child care settings (e.g., City of Hamilton).

31 Nunavut Not in use right now Involved in comprehensive review of regulations and approaches Decisions regarding quality measurement will be made within that context

32 Training and Certification Master Trainers in the same or another PT For ECERS tools, training from USA, including Thelma Harms, Debby Cryer (UNC) SpeciaLink Some ties to You Bet I Care! (for the quality portion)

33 Some Examples: Manitoba In March 2007: UNC staff in Five consecutive days including one in-class session and four field practices in ELCC facilities. January 2008: Manitoba staff at UNC One full-day in class session and two guided practice assessments in child care centres, along with follow-up analysis with experienced group leaders.

34 Some Examples: Manitoba Subsequently, Manitoba appointed an ECERS/ITERS anchor staff to train new CCCs /QESs. This training consists of one day of in-service training in the ITERS-R or ECERS-R and a minimum of three guided practice assessments in child care centres and followup analysis (until inter-rater reliability is obtained at 80% or higher).

35 FINDING A BALANCE

36 Licensing and Monitoring Manitoba: ITERS-R and ECERS-R are part of the monitoring process Saskatchewan: FCCERS-R is used in the family child care home relicensing process. Yukon: Optional, and may replace one spot inspection/year NL: After involvement in EQuIP, intent is to use tools in licensing and monitoring process PE: Have used FCCERS-R in follow-up to complaints re licensing requirements

37 Program Support Atlantic region: linked to on-site consultation model developed at UNC by Patricia Wesley Generally pre-test, followed by on-site supports; post-test follows support period; centre is on its own, then final post-test Lero, D.S. & Irwin, S.H. (2008). Improving Quality, Enhancing Inclusion: Partnerships for Inclusion Nova Scotia. Guelph, ON: Centre for Families, Work and Well-Being, University of Guelph. At PT level, MB, NT, YK all use tools for program support and quality enhancement

38 School Based Programs Saskatchewan: only jurisdiction to use quality measurement in school settings PreK programs are based in school settings, and are not required to be licensed SK has expanded the number of PreK programs in the past five years, there has been a 94% increase Coverage now includes 20% of all children living off reserve

39 Staff Competency Alberta contracts with ARCQE to administer the LEEP program: Life Experience Equivalency Process Caregiver Interaction Scale is used as componenet of the assessment for certification as a Child Development Worker Participants must achieve a 75% or higher frequency rating on Sensitivity with low to little frequency of interactions on Harshness or Detachment to pass the CIS assessment for LEEP.

40 Quality Measurement Tools Mainly for Program Support QUIC K FACT S! Participation is generally optional Results are rarely published Rarely used in school based programs Many questions remain!

41

42 Back to the context The new questio n! How can an early learning framework support quality, connect to licensing, and meet the needs of different communities? Could this should this - be part of a larger quality initiative? How does a PT link the policy framework, curriculum, and licensing functions?

43 NEW QUESTIONS How to integrate quality measurement with new early learning frameworks? What else is available besides ECERS and the relevant variations? What is the best use of resources that may be available for quality enhancement?

44

45 New Approaches: PEI The early learning framework describes a social ecological early learning environment, where the learning goals apply to children, to educators, and to families. For example, one cannot talk about wellbeing as a learning goal for children, without considering the well-being of the educators, and the well-being of parents and families. How to measure this?

46 New Approaches: NB Province is involved in development of a Collaborative Assessment Tool for English language early childhood centres. This tool would not be subjected to the rigor of assuring validity and reliability but would be adopted to monitor curriculum implementation and sustainability from a social pedagogical perspective narrative rather than normative. Is this a new measure of quality?

47 New Approaches: BC The BC Early Learning Framework focuses on reflective not prescriptive practice. It is intended to be a platform for discussion so that everyone is talking the same language re early learning a holistic view of child as capable and with great potential. How do you measure this?

48 Next????

49 THANK YOU