Proficiency Testing FINAL REPORT Check sample program 16CSP2 February 216 Proficiency Testing Provider Certificate Number 3189-2. Program Coordinator: Ingrid Flemming IFM Quality Services Pty Ltd PO Box 877 Ingleburn NSW 26 Australia Tel: +61 ()2 9618 3311 Fax: +61 ()2 9618 33 Email: ContactIFM@ifmqs.com.au Samples Dispatched: 12 October 21 Results Due: 29 February 216 Report Issued: 21 March 216 IFM Quality Services Pty Ltd Page 1
Operational Summary NUMBER OF ROUNDS AND FREQUENCY OF TESTING 12 samples are provided per annum, sent in 2 consignments, each containing 6 consecutive rounds. 1 sample is tested each month. SAMPLE PRESENTATION AND RECONSTITUTION Samples were presented in freeze-dried vials. Prior to testing, samples must be reconstituted in accordance with the instructions provided. The final sample volume is 1 ml. This is to be treated as the neat sample. ASSURANCE OF SAMPLE INTEGRITY Samples were prepared by the Support Division of IFM Quality Services. Homogeneity and stability tests were conducted by the Testing Division of IFM Quality Services. On production, each sample batch is subjected to a homogeneity evaluation. Following initial acceptance, retained samples undergo regular monitoring to confirm ongoing homogeneity and fitness for purpose. All required homogeneity criteria were met. METHOD OF DISPATCH All samples were sent via express national/international courier. Insulated packaging and a cooling agent were used to assist in protection against temperature fluctuations during transit. ASSESSMENT PROCEDURE Please refer to IFM s Policies on the assessment of microbiological PTP results: http://www.ifmqs.com.au/proficiency/references/qpl1-2_assessment_of_microbiological_pt_results.pdf DISPUTE PROCEDURE Participants wishing to dispute their assessment, or appeal an evaluation on other grounds should submit their appeal in writing to the program coordinator. Please refer to http://www.ifmqs.com.au/ifm_terms_and_conditions.htm for the detailed policy. CONFIDENTIALITY The identity of participants and any identifying information supplied by participants is treated as confidential. Appropriate policies and procedures have been put into place to ensure this confidentiality is maintained. Please refer to http://www.ifmqs.com.au/ifm_policy_on_confidentiality.htm for the detailed policy. TEST INSTRUCTIONS Instructions applicable to this testing round may be found at: http://www.ifmqs.com.au/proficiency/instructions/1csp-2_instructions.pdf INDIVIDUAL RESULTS Should individual test results be required, these will be provided upon request. IFM Quality Services Pty Ltd Page 2
Available Tests Enumerative Tests (cfu/1ml) E. coli Coliform Thermotolerant (Faecal) coliform Clostridium (vegetative) Coagulase positive Staphylococcus spp. Enterococcus spp. Faecal Streptococcus Pseudomonas aeruginosa Pseudomonas spp. Mould Yeast (cfu/ml) Plate Plate (21 degrees) Assessment Criteria For enumerative tests, robust statistics are applied in order to determine a Z score for each result. Acceptable Z scores are Z <3.. Whenever possible non-numeric results are assessed by applying simple pass/fail assessments without issue of Z scores. Variations to the normal assessment procedure will be detailed in the discussion. Participation Summary 9 organisations enrolled 67 organisations participated 29 sets of results were submitted 92 individual test results were received 881 results were assessed results were not assessed results were assessed as outliers Sample Content RM Number Organism Name (IFM Number) RM8 Staphylococcus aureus (3) RM127 Pseudomonas aeruginosa () RM133 Candida albicans (21) RM132 Escherichia coli (2) RM1 Aspergillus niger (23) RM17 Enterobacter cloacae (22) IFM Quality Services Pty Ltd Page 3
Discussion PSEUDOMONAS SPP. COUNT Statistics were not calculated for this test because too few results were submitted. All submitted results were considered to be within an acceptable range of each other and also IFMs monitoring data. All participants received pass assessments. COLIFORM, E. COLI AND PLATE COUNT 1 laboratory with 2 participants submitted results for coliform, E. coli and plate counts. To prevent this laboratory from creating a bias in statistical calculations only part1 s results were included in the statistical calculations. Ensuring that 1 laboratory s results do not affect statistical calculations is an important consideration. A high proportion of similar or identical results from 1 laboratory can: skew the statistical calculations such that laboratories with otherwise acceptable results receive poor Z-scores. increase the NIQR such that Z-scores do not adequately reflect participants /laboratories abilities. make the analysis of long term trends in performance difficult when some rounds were biased, whilst others were not. IFM is currently reviewing its procedures for the calculation of statistics when a large proportion of results are submitted by a single or small number of laboratories. Statistical calculations and histograms for the 3 below-listed data-handling methods, when applied to the results for E. coli, coliform and plate count, are shown on pages and 6. Method 1 (Represented by the sum of Red, Blue and Green bars in the histograms) This method includes all submitted results in the statistical calculations. It is most affected when a single, or small number of laboratories submit a high proportion of the total number of results. Method 2 Method 2 is the method currently being employed to reduce the bias of multiple results from a single laboratory. It involves excluding participants 2 to n when the results are determined to significantly affect the statistics. However, this method is limited in that other laboratories with multiple results may then cause a statistical bias. For this method, Green bars represent those results excluded from the statistical calculations, whilst Blue and Red bars represent those results included in the statistical calculations. Method 3 This method uses only one result from each laboratory for the statistical calculations, thereby giving each laboratory an equal influence. For this method, Blue bars represent those results included in the statistical calculations. Regardless of the method employed, all results will be assessed against the statistical calculations of that IFM Quality Services Pty Ltd Page
method. In addition to the treatment of results when laboratories submit multiple results, IFM is also reviewing its methods for calculating the robust mean and standard deviation. Participants are invited to comment on both matters. 6 3 2 1 16CSP2 Coliform Count Method: 1 Method: 1, 2 Method: 1, 2, 3 3.3 3.9 3.6 3.81 3.96.12.28.3.9 Count (log(cfu/1 ml)) 1CSP2 Coliform Count (log(cfu/1 ml)) Method 1 Method 2 Method 3 Median 3.9638 3.9 3.937 NIQR.2318.288.2772 Acceptable High.678.82.7812 Acceptable Low 3.267 3.6 3.93 Statistically Acceptable Range 1.11 1.79 1.699 3 3 2 2 1 1 16CSP2 E. coli Count Method: 1 Method: 1, 2 Method: 1, 2, 3 2.6 2.8 3.6 3.27 3.8 3.69 3.9.11.32 Count (log(cfu/1 ml)) 1CSP2 E. coli Count (log(cfu/1 ml)) Method 1 Method 2 Method 3 Median 3.83 3.8 3.72 NIQR.3116.319.36 Acceptable High.339.277.983 Acceptable Low 2.332 2.818 2.396 Statistically Acceptable Range 1.97 1.99 2.12 6 3 2 1 16CSP2 Plate Count Method: 1 Method: 1, 2 Method: 1, 2, 3 1.93 2.3 2.13 2.23 2.32 2.2 2.2 2.61 2.71 Count (log(cfu/1 ml)) 1CSP2 Plate count (log(cfu/1 ml)) Method 1 Method 2 Method 3 Median 2.3222 2.31 2.31 NIQR.137.16.178 Acceptable High 2.76 2.7726 2.7822 Acceptable Low 1.88 1.829 1.8199 Statistically Acceptable Range.876.931.9623 IFM Quality Services Pty Ltd Page
Results CLOSTRIDIUM (VEGETATIVE) AND COAGULASE POSITIVE STAPHYLOCOCCUS SPP. COUNTS 18 16 1 12 1 8 6 2 16 Below Detection Limit False Positive Not Assessed Clostridium spp. Count (vegetative) (cfu/1ml) 7 6 3 2 1 Coagulase positive Staphylococcus spp. Count 2.889 3.68 3.27 3.27 3.66 3.78 3.96.13.323 Coagulase positive Staphylococcus spp. Count (cfu/1ml) - Log Values Number of Results Analysed 2 Quartile 1 3.36 Quartile 3 3.7188 IQR.383 NIQR.266 Median 3.68 Median + (3.*NIQR).16 Median - (3.*NIQR) 2.796 Statistically Acceptable Range 1.62 Result (cfu/1ml) -Log Values IFM Quality Services Pty Ltd Page 6
Results COLIFORM, THERMOTOLERANT (FAECAL) COLIFORM AND E. COLI COUNTS 3 3 2 2 1 1 3.167 Coliform Count 3.361 3. 3.7 3.9.139.333.28.722 Coliform Count (cfu/1ml) - Log Values Number of Results Analysed 129 Quartile 1 3.692 Quartile 3.792 IQR.389 NIQR.288 Median 3.9 Median + (3.*NIQR).82 Median - (3.*NIQR) 3.6 Statistically Acceptable Range 1.79 Result (cfu/1ml) -Log Values 3 2 2 1 1 Thermotolerant (Faecal) Coliform Count 2.271 2.7 2.83 3.129 3.1 3.71 3.987.273.9 Thermotolerant (Faecal) Coliform Count (cfu/1ml) - Log Values Number of Results Analysed 87 Quartile 1 3.21 Quartile 3 3.776 IQR.718 NIQR.239 Median 3.1 Median + (3.*NIQR).779 Median - (3.*NIQR) 2.122 Statistically Acceptable Range 2.89 Result (cfu/1ml) -Log Values 3 3 2 2 1 1 2.9 E. coli Count 2.89 3.2 3.2 3. 3.67 3.88.1.31 E. coli Count (cfu/1ml) - Log Values Number of Results Analysed 128 Quartile 1 3.21 Quartile 3 3.63 IQR.33 NIQR.319 Median 3.8 Median + (3.*NIQR).277 Median - (3.*NIQR) 2.818 Statistically Acceptable Range 1.99 Result (cfu/1ml) -Log Values IFM Quality Services Pty Ltd Page 7
Results ENTEROCOCCUS SPP. AND FAECAL STREPTOCOCCUS SPP. COUNTS 9 8 7 6 3 2 1 79 Below Detection Limit False Positive Enterococcus spp. Count (cfu/1ml) Not Assessed 2 23 2 1 1 Below Detection Limit False Positive Faecal Streptococcus spp. Count (cfu/1ml) Not Assessed IFM Quality Services Pty Ltd Page 8
Results PSEUDOMONAS AERUGINOSA AND PSEUDOMONAS SPP. COUNTS 2 2 1 1 2.229 Pseudomonas aeruginosa Count 2.3 2.81 2.67 2.732 2.88 2.98 3.11 Result (cfu/1ml) -Log Values 3.236 Pseudomonas aeruginosa Count (cfu/1ml) - Log Values Number of Results Analysed 6 Quartile 1 2.6128 Quartile 3 2.86 IQR.217 NIQR.1866 Median 2.732 Median + (3.*NIQR) 3.31 Median - (3.*NIQR) 2.1632 Statistically Acceptable Range 1.1383 Pseudomonas spp. Count 3 2 1 1.87 2.6 2.2 2. 2.633 2.823 3.13 3.22 3.392 Result (cfu/1ml) -Log Values IFM Quality Services Pty Ltd Page 9
Results YEAST AND MOULD COUNTS 3 2 1 3.11 Yeast Count 3.189 3.26 3.3 3.1 3.9 3.66 3.61 Result (cfu/1ml) -Log Values 3.716 Yeast Count (cfu/1ml) - Log Values Number of Results Analysed 13 Quartile 1 3.3118 Quartile 3 3.62 IQR.16 NIQR.1117 Median 3.1 Median + (3.*NIQR) 3.76 Median - (3.*NIQR) 3.7 Statistically Acceptable Range.6812 3 2 1 Mould Count 27. 8. 9. 121. 13. 18. Result (cfu/1ml) -Raw Values 216. Mould Count (cfu/1ml) - Raw Values Number of Results Analysed 13 Quartile 1 87. Quartile 3 1. IQR 63. NIQR 6.719 Median 9. Median + (3.*NIQR) 232.8 Median - (3.*NIQR) -2.8 Statistically Acceptable Range 28.8816 IFM Quality Services Pty Ltd Page 1
Results PLATE COUNTS 3 3 2 2 1 1 1.88 Plate Count 1.988 2.92 2.197 2.31 2. 2.1 2.61 2.718 Plate Count (cfu/ml) - Log Values Number of Results Analysed 132 Quartile 1 2.1761 Quartile 3 2.386 IQR.286 NIQR.16 Median 2.31 Median + (3.*NIQR) 2.7726 Median - (3.*NIQR) 1.829 Statistically Acceptable Range.931 Result (cfu/ml) -Log Values 16 1 12 1 8 6 2 1.3 Plate Count 21 degrees 1.622 1.82 1.982 2.161 2.31 2.2 2.7 2.879 Plate Count 21 degrees (cfu/ml) - Log Values Number of Results Analysed 6 Quartile 1 1.9696 Quartile 3 2.3287 IQR.391 NIQR.2662 Median 2.1611 Median + (3.*NIQR) 2.9731 Median - (3.*NIQR) 1.391 Statistically Acceptable Range 1.62 Result (cfu/ml) -Log Values IFM Quality Services Pty Ltd Page 11
End of Report IFM Quality Services Pty Ltd Page 12