Designing computer based training programs. Sam Chan Research Scientist. Posit Science Corporation, San Francisco, CA.

Transcription

1 Designing computer based training programs Sam Chan Research Scientist. Posit Science Corporation, San Francisco, CA.

2 Outline UFOV is important Building InSight Validating exercises Making engaging Allstate/Posit Collaboration 2009 Posit Science Corporation CONFIDENTIAL 2

3 Useful Field of View (UFOV ) The area over which you can extract visual information at a brief glance without head or eye movement Posit Science Corporation CONFIDENTIAL 3

4 UFOV Interface 2009 Posit Science Corporation CONFIDENTIAL 4

5 Relative Crash Risk UFOV Assessment Predicts Automobile Crash Risk Low UFOV performers compared to high UFOV performers Owsley 1998 Sims 2000 Ball 2006 Rubin Posit Science Corporation CONFIDENTIAL 5

6 Relative Crash Risk UFOV Assessment Best Predictor of Crash Risk 2.20 Low performers compared to high performers Visual Acuity 1.16 Contrast Sensitivity Stereoacuity Visual Field UFOV Owsley et al., Posit Science Corporation CONFIDENTIAL 6

7 UFOV Training Improves Driving Performance Quicker reaction time reduced effective stopping distance by 22 feet at 55 mph (Roenker et al., 2003). Training reduced dangerous driving maneuvers by 36% in onroad driving tests (Roenker et al., 2003). Helped maintain driving space (distance from home) and driving in difficult situations (e.g., night, rain, heavy traffic) (Edwards et al., 2009). Reduced risk of driver cessation by 40% in drivers with poor UFOV (Edwards et al, 2009). Reduced at-fault crash incidences by 51% in 5 years following training (Ball et al, 2009) Posit Science Corporation CONFIDENTIAL 7

8 Why Improve UFOV? More exercises More engaging Self-administered 2009 Posit Science Corporation CONFIDENTIAL 8

9 Outline UFOV is important Building InSight Validating exercises Making engaging Allstate/Posit Collaboration 2009 Posit Science Corporation CONFIDENTIAL 9

10 InSight InSight visual training program Road Tour Useful Field of View Bird Safari Visual accuracy Master Gardener Eye movements Jewel Diver Multiple object tracking Sweep Seeker Fundamental speed of processing Computer based visual training program designed to improve processing speed and increase visual attention and memory Posit Science Corporation CONFIDENTIAL 10

11 Age effects 2009 Posit Science Corporation CONFIDENTIAL 11

12 % improvement % improvement % improvement % improvement % improvement % improvement % improvement % improvement % improvement % improvement Users get better with training 100 Road Tour Road Tour Bird Safari Bird Safari Config # Configuration 60 Sweep Seeker Sweep Seeker Config # Configuration Jewel Diver Jewel Diver Config # Configuration Master Gardener Master Gardener Config # Configuration Config # Configuration 2009 Posit Science Corporation CONFIDENTIAL 12

13 2009 Posit Science Corporation CONFIDENTIAL 13

14 Design Lab Early Prototype 2009 Posit Science Corporation CONFIDENTIAL 14

15 Exercise and Game Development Game theme development 2009 Posit Science Corporation CONFIDENTIAL 15

16 Configuration Used psychophysical methods to make central stimuli progressively more difficult RT thresholds - full distracters Easier Harder Milliseconds 16

17 Road Tour has same training effect as previous version N = 53 Results not statistically different Data from PACES study (ongoing) Risk Category 2009 Posit Science Corporation CONFIDENTIAL 17

18 Latest version more engaging Previous Version Road Tour 2009 Posit Science Corporation CONFIDENTIAL 18

19 Design Issues with Older Adults Not familiar with / intimidated by computers Trouble using the mouse Game too complicated Only interested in training, do not want game play. Training level too hard or too easy 2009 Posit Science Corporation CONFIDENTIAL 19

20 Outline UFOV is important Building InSight Validating exercises Making engaging Allstate/Posit Collaboration 2009 Posit Science Corporation CONFIDENTIAL 20

21 Allstate and Posit research collaboration Allstate is the nation s largest publicly held personal lines insurer. It has a history of promoting driver safety. In the 1960s Allstate helped convince the government to make seat belt use mandatory In the 1970s and 1980s Allstate played an instrumental role in advocating the safety benefits of air bags Allstate has been interested in UFOV training technology for a number of years as a way to improve driver safety 2009 Posit Science Corporation CONFIDENTIAL 21

22 Allstate and Posit research collaboration Goal: To extend academic results showing improvements in driving performance to a real world setting. Pilot project: Mail offering to 100,000 policyholders aged 50+ living in Pennsylvania. Offer sent out in September 2008 InSight visual training program free of charge Posit Science Corporation CONFIDENTIAL 22

23 Allstate and Posit research collaboration As of January 15, 2009 (analysis lock date): N Requested InSight 8012 Started training 4036 >= 1 hour 2557 >= 5 hours 856 >= 10 hours 477 Posit data was anonymously matched with Allstate data by a third party data analysis company. They linked usage data with driving data. 87% match rate Posit Science Corporation CONFIDENTIAL 23

24 Allstate and Posit research collaboration Age/Gender Mean Std N Age Gender (male) 53.80% Posit Science Corporation CONFIDENTIAL 24

25 Exercise baseline performance as crash predictor Independent variable: Baseline scores Dependent variable: Crash history over 3 years Performed binomial regression analysis Results: Exercise Wald Chi-Sq p-value Bird Safari Jewel Diver Master Gardener Sweep Seeker Road Tour Posit Science Corporation CONFIDENTIAL 25

26 Percent of participants Relative Crash Risk Relative crash risk for high vs. poor performers Plot shows distribution of risk categories Almost 2x increase in at-fault crashes from highest to lowest performers Risk Category Risk Category 2009 Posit Science Corporation CONFIDENTIAL 26

27 Percent Improvement Percent Improvement Percent Improvement Percent Improvement Percent Improvement Training improvements on exercises 80 Road Tour 30 Bird Safari Total Hours Trained Jewel Diver Total Hours Trained Master Gardener Total Hours Trained Sweep Seeker Total Hours Trained Error bars are +/- 1 SEM Total Hours Trained 2009 Posit Science Corporation CONFIDENTIAL 27

28 Percent of participants Percent of participants Change in crash risk distribution Pre-training Post-training Risk Category Risk Category Majority of users who do 10 hours of training move into lower risk categories 2009 Posit Science Corporation CONFIDENTIAL 28

29 Conclusions Baseline performance on InSight exercises predict retrospective crash risk. People improve on the exercises with training. Majority of users move into lower risk categories after 10 hours of training. Initial prospective crash rate reductions look very promising 2009 Posit Science Corporation CONFIDENTIAL 29

30 Future work Continue to examine relationship between training and prospective crash rates at future dates Improving usage (e.g., incentives to achieve training milestones). Examine other endpoints e.g., driving cessation, maintenance of driving Posit Science Corporation CONFIDENTIAL 30

31 Thank You