Continuing litany of errors raises question about the "Quality Culture" in the SEC

City: 
Wexford, Ireland
Contact: 
Daragh O Brien

For the second year in a row the Leaving and Junior Certificate examinations have been plagued by avoidable failures in quality management. These failures, and the responses thus far from the State Exams Commission, raises questions about the "culture of quality" in the SEC. Castlebridge Associates echoes the comments of the Irish Second-Level Students Union, who have described carelessness by those who set the exams as unacceptable and easily avoided.

"If the SEC was developing software or building cars the level of avoidable bugs and defects they seem to encounter on a regular basis would be having a serious impact on their bottom line", says Daragh O Brien, CEO of Castlebridge Associates.

 

  So far this year we have witnessed:

 

  •  217 students in 16 centres being supplied with Leaving Certificate exam papers that had not been correctly printed and were missing questions, resulting in confusion about how to get the missing questions to the schools (with broken fax machines and over-active Spam filters frustrating many attempts to get the questions through) and inconsistencies in how additional time was allocated to students to allow them to finish their exams.
  • 24000 students sitting the Junior Certificate (or some 42% of all students) found themselves unable to complete a question on their exam due to the figures provided for calculations being incorrect.
  • National media have received reports of extensive errata sheets being produced in exams to provide corrections to errors in papers.

All of these are, ultimately, problems with the quality of information which give rise to difficulties for the "knowledge workers" of the future at a time of heightened stress and tension.

While "Zero Defects" in information quality is a challenging goal, it is an achievable one as countless case studies have shown. While there may be costs involved in preventing defects and detecting them earlier in the life cycle of an exam paper, these costs are almost always less than the costs incurred as a result of poor quality information escaping into the wild.
In the case of State Exams, these "Costs of Poor Quality Information" might include:
  • Increased pressure on students as a result of exam strategy for tackling questions being overturned by the complete exam paper
  • Increased costs of appeals and rechecks as students may feel aggrieved at marks they might receive if they were on the receiving end of the errors
  • Lower levels of trust in the validity of grades as cynics might argue that a student only got their grade because "bonus marks" were awarded to compensate for avoidable problems with the exam paper.
  • The SEC are quoted on national radio as saying that error rates are the same as in previous years.
To achieve "Zero Defects", a culture change is required that places the reasonable expectation of the right exam paper, opened at the right time, with questions that can be answered printed on the right pages at the centre of the planning and execution process. 
Just as computer software is tested rigorously before being deployed, likewise the Exam papers should be tested. These tests should include:
  • Examination of the completeness, consistency, and accuracy of questions to ensure they can actually be answered.
  • Random sample checks on exam paper print runs to ensure that the complete, consistent and "answer-capable" questions are actually printed in the right order
"If the SEC was developing software or building cars the level of avoidable bugs and defects they seem to encounter on a regular basis would  be hurting their bottom line", says Daragh O Brien, CEO of Castlebridge Associates.
"We would suggest that the SEC should look to Software Testing methodologies and proven approaches for managing the quality of manufactured goods and Information to find ways to improve their processes to bring the level of defects and promote continuous improvement and excellence rather than resting on laurels of mediocrity and crisis management.

 

Notes for Editors: 

#444444;"> About Castlebridge Associates

Castlebridge Associates is one of Ireland's leading specialist Information Management consultancies providing a range of services in the areas of Data Protection, Information Strategy, Information Quality, and Data Governance. 

Castlebridge Associates' founder Daragh O Brien is a noted international expert in these fields with a number of articles and publications to his name.

About Daragh O Brien

Prior to founding Castlebridge Associates, Daragh O Brien lead a Compliance team in a leading Irish telecommunications firm. Prior to that he held strategic and operational responsibility for Single View of Customer strategy and execution. In each role he was a Champion and evangalist for the value high quality information through well defined and controlled processes.

He is a Fellow of the Irish Computer Society, a Founder member of the International Association for Information & Data Quality and a tutor on the Irish Computer Society's Data Protection Certificate. He co-founded and leads the ICS Information Quality Network.

He has been a keynote speaker, Chairman, and Panel participant at Information Quality and Data Governance conferences in Ireland, UK, Europe, North America, and Australia

 

Get Castlebridge News

Want to find out about the latest news and insights from Castlebridge Associates and our "Information Imperative"? Sign up here for

 our monthly newsletter.

Get Training News

Training: It's essential for the development of the skills necessary to empower staff in this Information Age!

Subscribe to this mailing list to keep up to date on courses being developed or delivered by Castlebridge Associates and general trends and insights from the world of training in Information Quality, Data Governance, and Data Protection.

Get Events Updates

Want to find out about events Castlebridge Associates are running or presenting at world wide? Join this mailing list to get a quarterly update of our events calendar.