Raven EMS Education Program Manual
Sub-Section 3.85.063 - Student Evaluations - Classroom

Student Evaluations

Each course administered shall have a written record of student performance. This record may include, but not limited to written tests, practical skill evaluations, or other written evidence of test or exam. Individual records such as tests and skill sheets shall be maintained as a hard-copy or electronic copy in the student’s file. Class rosters shall be scanned in or otherwise electronically maintained. Student transcripts shall be maintained electronically and be available to students upon request.

Copies of completed evaluations will be maintained in student records. Students may request a copy or to review their file or any portion thereof at any time and will be granted access within three business days.

Reasonable accommodation will be made for individuals with disabilities at their request.

Written and electronic tests (Cognitive Assessments)

Definitions:

• Quiz: Normally no or lowest point value. Student self-assessments to allow student and instructor to gauge student knowledge prior to lecture or following lecture.
• Test: Median point value for chapter or similar assessments.
• Exam: Highest point value for cumulative assessments. Usually used for mid-term and final evaluations.

In-class answer sheets (PDF):

• 25-question answer sheet
• 50-question answer sheet

Written exams will be developed by the administrative agency (i.e. American Heart Association, International Trauma Life Support, etc.) or developed by the instructor to evaluate established lesson objectives.

All tests shall be at least partially comprehensive in nature. For example, EMR, EMT, and Paramedic Academies have a test after each chapter lecture. Each Academy chapter test will contain a few questions from all previous chapters covered.

High-value written tests (i.e. term final exams) will be discussed, reviewed, and/or approved by the medical director as needed. These high-value written testing instruments will be evaluated for poorly written questions.

ZipGrade will be used for in-class written exams for certification courses such as AHA and NAEMT. EMSTesting through Platinum Education will be used for tests and exams for programs leading to NREMT examination.

Refer to High Stakes Exam Analysis Form for the tool used to evaluate test validity.

Simplified test item analysis:

• Average score less than 70% (also known as overall KR20 score less than 0.7): The entire test will be reviewed.
• Item Discriminant Factor less than 0 (also known as Point Biserial): That test question will be reviewed.
• Item Percent Correct less than 20% (aslo known as PVal less than 0.2): That test question will be reviewed.

Full test item analysis explanation:

• Overall test reliability will be ensured through reviewing each test’s KR20 score (ranges from 0.0 to 1.0). Scores below 0.7 indicate the test did not do a good job of discriminating between high and low performing students, the test had too many interruptions, material was not adequately covered, or cheating might have occurred. Tests with KR20 less than 0.7 may be completely thrown out, retaken, partially modified, or other action deemed appropriate by the lead instructor.
• Test item reliability will be ensured through reviewing each question’s class discrimination score (ranges from -1.0 to 1.0). Scores below zero indicate the question did not do a good job of discriminating between high and low performing students. Questions may be completely thrown out, modified, or other actions deemed appropriate by the lead instructor.
• Test item validity will be ensured through reviewing the percent of the class that answered the question correctly. Pval ranges from 0.0 to 1.0 indicating the percent of the students that answered correctly. Scores below 0.2 will be reviewed to ensure the material was adequately covered and the test question is written and keyed correctly. Questions may be completely thrown out, modified, or other actions deemed appropriate by the lead instructor.
• Additionally, students may request test item review if they feel it was incorrect or clarifying information is requested.

Behavioral Tests (Affective Assessments)

Professional behavior evaluations will be developed by the program director to evaluate the student’s conduct and motivations in both the classroom and during clinicals. These evaluations may be imbedded in other assessment tools or stand-alone instruments.

	Relevant. Resolute. Ready.
	Raven EMS Education Manual - Table of Contents
	BeckerTeam (main page)