FOI22/23 052 Markers

How many markers did the SQA require for the 2022 National 5; Higher; and Advanced Higher exams – and how many were actually recruited.

Please provide a universal figure as well as a breakdown by subject and qualification of the number of markers required, and the number actually recruited. So when we receive this information we should be able to see, for instance, the number of markers the SQA estimated were required for Higher English, and the number that were actually recruited.

Please provide any information setting out how SQA ensures markers are marking to the national standard? For clarity this is to include: how is the markers’ marking checked/verified? And any guidance issued by SQA to staff or appointees re. how they go about ensuring markers mark to national standards.

Please share any information/data/figures collected by the SQA on the outcome of any quality assurance of marking for the 2022 exams. For clarity I’m seeking to understand how frequently markers have their marking checked and how often marking is found to not be in line with national standards

For the 2022 exams how many markers were found to be not marking in line with national standards?

For the 2022 exams how many markers were discontinued due to failure to mark to the national standards?

How many markers did the SQA require for the 2022 National 5; Higher; and Advanced Higher exams – and how many were actually recruited.

Please provide a universal figure as well as a breakdown by subject and qualification of the number of markers required, and the number actually recruited. So when we receive this information we should be able to see, for instance, the number of markers the SQA estimated were required for Higher English, and the number that were actually recruited.

The information is contained within the attached spreadsheet.

The marker stats have been run at 20 June 2022 as this was the end of our recording period for 2022 examinations.

The factors used by SQA to calculate marker requirements are:

Candidate entries for each subject/level (stats have been run on live entries for 2022 exams as live entries had been confirmed at that time)
Anticipated marking throughput rate for each subject/level
Marking period for each subject/level

Assumptions:

Stats have been run on live entries per subject/level at max-point allocations.
Figures provided are for markers who, on 20 June 2022, were an active marker on our system.
Throughout the marking process marker numbers change daily due to markers withdrawing, not attending the briefing session or being withdrawn by SQA during the marking period for their subject.

Please note that the stats provided are only accurate at the point in time when the report was run.

Where marker numbers drop below the required number either immediately before the marking period eg markers who have accepted their contract but do not attend the Marker Briefing, contingency arrangements are invoked to ensure marking is completed e.g. additional allocations to the remainder of the marking team or an extension to the marking period.

Please provide any information setting out how SQA ensures markers are marking to the national standard? For clarity this is to include: how is the markers’ marking checked/verified? And any guidance issued by SQA to staff or appointees re. how they go about ensuring markers mark to national standards.

Before the marking period guidance materials are issued to all markers and online training is also provided. Marker briefing sessions are held immediately before marking begins. Many marker briefings include in depth group discussion in small groups looking at exemplars and discussing the standard so that markers leave with a clear understanding of what is expected of them and the support that will be in place to assist them.

For subjects that are electronically marked (MFI - Marked from Image)

Prior to commencing marking, appointees must undertake a number of Qualification scripts and perform to a sufficiently high pre agreed level of marking to be allowed to proceed to live marking. Appointees failing to achieve the pre agreed standard of marking are placed on hold and must be approved for marking by their Team Leader following feedback to bring them on standard. The number of Qualification scripts for each component is varied and is determined by Qualifications colleagues prior to the diet. During the marking period - marking is checked at regular intervals throughout the marking process by the use of ‘seeded scripts’. The normal ratio for seeded scripts is 1 in 20.  The marking is also sampled by a Team Leader at a minimum ratio of 1 in 20.  The Team Leader will increase sampling where necessary. Where there are issues in the marking, the marker is put on hold until a conversation takes place with their Team Leader. This is a supportive process to highlight where the marker is off standard and to provide guidance/support to ensure they continue on standard.

For subjects that are marked from paper (MFP - Marked from Paper)

A marker check procedure takes place after the marking has been completed and returned to SQA.  Each marker has a sample of their marking checked and if found not to be to national standard then it is finalised at a later procedure so that no candidate is affected by a marker that is lenient, severe or inconsistent. 

Please share any information/data/figures collected by the SQA on the outcome of any quality assurance of marking for the 2022 exams. For clarity I’m seeking to understand how frequently markers have their marking checked and how often marking is found to not be in line with national standards

The information for this is contained within the responses above and below.

For the 2022 exams how many markers were found to be not marking in line with national standards?

182 markers who completed the marking process were found to not have met the national standards.

For the 2022 exams how many markers were discontinued due to failure to mark to the national standards?

There were 27 markers discontinued. This information relates only to those subjects that have qualification and seeded scripts as part of the marking process, so relates only to subjects which are marked electronically (MFI).

 FOI22/23 052 Markers Information Sheet (766 KB)