CON Professional Graduate Test Construction and Delivery: Difference between revisions

No edit summary
 
(30 intermediate revisions by the same user not shown)
Line 29: Line 29:
     <tr>
     <tr>
         <td width="60%"><big>'''Professional Graduate Test Construction and Delivery'''</big></td>
         <td width="60%"><big>'''Professional Graduate Test Construction and Delivery'''</big></td>
         <td width="40%"><big>'''Policy:''' '''1310'''</big></td>
         <td width="40%"><big>'''Policy:''' '''1311'''</big></td>
     </tr>
     </tr>
     <tr>
     <tr>
Line 112: Line 112:


===Post-Exam===
===Post-Exam===
<ul style="margin-bottom:15px;max-width:67em !important;">
    <li style="margin-bottom:10px;">Course coordinator must review exam performance using psychometric analysis, including:
          <ul>
              <li>Item difficulty</li>
              <li>Point biserial correlation</li>
              <li>Discrimination index</li>
          </ul>
   
    </li>
    <li style="margin-bottom:10px;">Faculty must determine whether scoring adjustments are warranted based on analysis. Adjustments are not automatic and must be justified.  </li>
    <li style="margin-bottom:10px;">Faculty must make any necessary updates to exam items within the testing platform following analysis.  </li>
    <li style="margin-bottom:10px;">Faculty must transfer exam scores to the learning management system in a timely manner.  </li>
    <li style="margin-bottom:10px;">Faculty must provide structured feedback and/or remediation guidance for students who do not meet exam performance expectations.  </li>
    <li style="margin-bottom:10px;">Faculty may delay exam review access if students are testing at different times or if a make-up exam is pending. </li>
</ul>


===Accommodations===
===Test Question Review Table Using Point Biserial, Discrimination Index, and Difficulty===
<ol style="margin-bottom:15px;max-width:67em !important;">
<br />
     <li>Students are required to adhere to the Accommodation Policy (ADA Policy) that is listed in the UNMC Student Policies and Procedures (see policy in related documents).</li>
<table width="100%" cellpadding="10" border="1" style="border-collapse: collapse; border: 1px solid black;">
    <li>Students with accommodations must present their letter of accommodations from the UNMC Accessibility Services Office to the course coordinator at least one week prior to any exam for which accommodations are requested. Once the letter has been provided to the coordinator, the accommodations will remain in effect for the length of time specified in the letter or until the student in writing indicates the accommodations are no longer needed.</li>
     <tr>
    <li>Accommodated students are expected to comply with timely arrival at the location for testing identified by the course coordinator.</li>
          <th>Item Difficulty</th>
     <li>Faculty will prepare accommodation materials and resources as specified in student letter.</li>
          <th>Point Biserial < 0.10</th>
    <li>Faculty will work with On-line Testing Coordinator and any other personnel needed to facilitate testing accommodations for students (e.g., low distraction room, additional testing time). </li>
          <th>Point Biserial 0.10-0.29</th>
     <li>On campuses that use affiliated university testing services, complete the accommodated testing form. </li>
          <th>Point Biserial > 0.30</th>
     <li>Students testing via a paper copy will use a specified excel form to record exam answers. Once the exam is completed, the student will transfer the exam answers to the exam software, or the excel form data will be uploaded into the exam software by College of Nursing personnel. Transferring of the exam answers is not included in the allotted exam time.</li>
          <th>Questions that<br />were 100%</th>
</ol>
    </tr>
===Post-Exam===
     <tr>
<ol style="margin-bottom:15px;max-width:67em !important;">
          <td valign="top">80-99%<br />Easy</td>
     <li>Course Coordinator/ Faculty will review the exam statistics, determine any scoring adjustments needed, and make any adjustments to the exam in the exam/evaluation software. </li>
          <td style="background-color: lightblue;">Poor<br />Discrimination<br />but students<br />deemed easy</td>
</ol>
          <td style="background-color: lightblue;">Fair<br />Discrimination<br />but students<br />deemed easy</td>
          <td valign="top" style="background-color: lightgreen;">KEEP: Good<br />discrimination</td>
          <td>&nbsp;</td>
    </tr>
     <tr>
          <td valign="top">50-80%<br />Average</td>
          <td style="background-color: lightblue;">Poor<br />Discrimination;<br />Average<br />Difficulty; May<br />review</td>
          <td style="background-color: lightblue;">Fair<br />Discrimination:<br />Average<br />Difficulty; May<br />review</td>
          <td valign="top" style="background-color: lightgreen;">KEEP: Good<br />discrimination</td>
          <td style="background-color: lightgray;">&nbsp;</td>
    </tr>
     <tr>
          <td valign="top">30-50%</td>
          <td style="background-color: lightsalmon;">Add the disc<br />index to the<br />difficulty, if<br /><0.06 poor<br /> discrimination;<br />Review<br />Required </td>
          <td valign="top" style="background-color: lightblue;">Add the disc<br />index to the<br />difficulty, if<br />0.6-0.8 fair<br /> discrimination;<br />May review </td>
          <td valign="top" style="background-color: lightgreen;">Add the disc<br />index to the<br />difficulty, if ><br />0.80 good<br />discrimination;<br />KEEP</td>
          <td style="background-color: lightgray;">&nbsp;</td>
    </tr>
    <tr>
          <td valign="top"><30%<br />Difficult</td>
          <td valign="top" style="background-color: lightsalmon;">Poor<br />discrimination;<br />Review<br />Required</td>
          <td valign="top" style="background-color: lightblue;">Fair<br />discrimination;<br />May Review</td>
          <td valign="top" style="background-color: lightgreen;">KEEP; Good<br />discrimination</td>
          <td valign="top">QUESTIONS<br />GIVEN BACK</td>
    </tr>
   
</table>
 
===Make-Up Exams===
<ul style="margin-bottom:15px;max-width:67em !important;">
     <li style="margin-bottom:10px;">Faculty have discretion in approving and scheduling make-up exams.  </li>
    <li style="margin-bottom:10px;">Make-up exams may be administered in an alternate format (e.g., essay, short answer, or multiple-choice) but must be equivalent in point value to the original exam.  </li>
    <li style="margin-bottom:10px;">Faculty are responsible for ensuring that make-up exams maintain academic rigor and integrity consistent with the original assessment. </li>
</ul>