The National Office for Summative Assessment
Information, Policies, Procedures and Guidelines Forms and Documents available for download Names, Addresses, Telephone, Email & Web links Frequently Asked Questions and Answers View the complete site index here Authorised users only (log-on required)

 

 

Protocol for maintaining assessor competence

National Video Calibration Days for 2nd and 3rd level assessors will be held on Monday 15 January 2007 and Tuesday 16 January 2007 at the RCGP - London For further information please contact isabel.robertson@nes.scot.nhs.uk

First Level Assessors:

  1. Each deanery should have a minimum of 2 calibration days per year or equivalent and attendance at at least 1 is a requirement for all first level assessors. New first level assessors should have attended calibration days before undertaking assessment of summative assessment video. Non attendance at the required calibration meetings will disqualify assessors from undertaking any further marking, until recalibrated.

  2. The Deanery Office should give comparative feedback to the first level assessors on their performance bi-annually with overall feedback on their deanery summative assessment results annually, ie number of passes, refers, resubmission and fails.

  3. Results of (2) should be communicated to the Deanery Summative Assessment Co-ordinator and Director to provide feedback on named deanery assessor performance.

  4. First level assessors should not be carrying out second level assessment

  5. There should ideally be a ratio of first level assessors to GP registrars of approx. 1:6.

  6. Comparison of deanery performance with the national average should be distributed annually.

  7. Individual first level assessors, consistently ‘out of step’ with their co-assessors should be offered further specific training and should not assess until this has been completed.

  8. Each first level assessor should mark a minimum of 8 videos per year to maintain competence.

  9. First level assessors may be asked to become members of the national panel and be involved in first level quality control.

  10. Deaneries should keep a record of their assessors’ attendance at all calibration days.

 

Second Level Assessors:

  1. The Deanery’s video co-ordinator should attend the National Training Day annually or at least 2 in a 3-year period.
     
  2. 2nd level assessors should attend the National Training Day annually and attend at least 2 in a 3-year period.
     
  3. Ideally there should be no more than 4-2nd level assessors in each deanery to ensure adequate experience, i.e. approximately 8 videos per year.
     
  4. The Deanery Office should give comparative feedback to the 2nd level assessors on their performance bi-annually with overall feedback on their deanery summative assessment results annually, ie number of passes, refers, resubmission and fails.
     
  5. 2nd level assessors should not be carrying out 1st level assessment.
     
  6. Second level assessors may be asked to become members of the National Panel and be involved in...
  • 2nd level quality control
  • 3rd level assessment - after undertaking a national video marking exercise and attending a National Calibration meeting

 


The National Office for Summative Assessment

(Page last updated on 31/03/06)

 

The National Office for Summative Assessment

http://www.nosa.org.uk