University of Nebraska Medical Center

CON Professional Graduate Test Construction and Delivery: Difference between revisions

Browse history interactively
VisualWikitext
Created page with "<table style="max-width:70em !important;background:#F8FCFF; text-align:center" width="100%" cellspacing="0" cellpadding="0" border="0"> <tr> <td style="padding:0.5em; background-color:#e5e5e5; font-size:100%; line-height:0.95em; border:2px solid #A3B1BF; border-bottom:solid 2px #A3B1BF" width="20">Home</td> <td style="border-bottom:2px solid #A3B1BF" width="3"> </td> <td style="padding:0.5em; background-color:#e5e5e5; font-size:90%; line-heig..."
 
No edit summary
 
(38 intermediate revisions by the same user not shown)
Line 29: Line 29:
     <tr>
     <tr>
         <td width="60%"><big>'''Professional Graduate Test Construction and Delivery'''</big></td>
         <td width="60%"><big>'''Professional Graduate Test Construction and Delivery'''</big></td>
         <td width="40%"><big>'''Policy:''' '''1310'''</big></td>
         <td width="40%"><big>'''Policy:''' '''1311'''</big></td>
     </tr>
     </tr>
     <tr>
     <tr>
Line 42: Line 42:
             <table width="100%" cellpadding="0" cellspacing="0">
             <table width="100%" cellpadding="0" cellspacing="0">
                 <tr>
                 <tr>
                 <td>Revised: [[Special:PermanentLink/11970|May 2019]]<br />Revised: [[Special:PermanentLink/15778|May 2024]] ([[Special:Diff/11970/15778|changes]])<br />Revised: [[Special:PermanentLink/18011|August 2025]] (administrative) ([[Special:Diff/15778/18011|changes]])<br />Revised: November 2025 [[Special:Diff/18011/{{REVISIONID}}|(changes]])</td>
                 <td>&nbsp;</td>
                 </tr>
                 </tr>
             </table>
             </table>
Line 55: Line 55:


==Scope==
==Scope==
<p style="margin-bottom:15px;max-width:70em !important;">This policy applies to undergraduate faculty.</p>
<p style="margin-bottom:15px;max-width:70em !important;">This policy applies to professional graduate faculty.</p>


==Policy==
==Policy==
<p style="margin-bottom:15px;max-width:70em !important;">Testing processes have been established to ensure consistency in testing practices for didactic course content.</p>
<p style="margin-bottom:15px;max-width:70em !important;">Testing processes have been established to ensure consistency in testing practices for didactic course content.</p>
===Exam Construction===
===Exam Construction===
<ol style="margin-bottom:15px;max-width:67em !important;">
<ul style="margin-bottom:15px;max-width:67em !important;">
     <li>Currently under review and revision.</li>
     <li style="margin-bottom:10px;">All professional graduate courses that include tests/exams as part of summative evaluation must administer exams with no fewer than 50 multiple-choice questions per test. </li>
</ol>
    <li style="margin-bottom:10px;">Course coordinators may determine the weight of test/exam scores within the final course grade; however, exams must comprise no less than 20% and no more than 50% of the total course grade. </li>
===Pre-Exam===
     <li style="margin-bottom:10px;">Faculty must develop and share with students an exam blueprint outlining tested concepts and approximate question distribution at least one week prior to the exam. </li>
<ol style="margin-bottom:15px;max-width:67em !important;">
     <li style="margin-bottom:10px;">Faculty must provide a rationale for each exam question within the approved testing platform. </li>
    <li>Faculty shall determine proctors for main testing room and any accommodation testing rooms. </li>
     <li style="margin-bottom:10px;">Exam questions shall be retired after five years of use or earlier if psychometric analysis does not support continued use. See test question review table below. </li>
     <li>Exams shall be available for posting one business day prior to the scheduled exam time so students can download the exam prior to the testing time</li>
    <li style="margin-bottom:10px;">Questions must align with board-style formatting, including:
    <li>Course Coordinator will provide proctor with exam details including the password and universal resume code in case of technical issues. </li>
          <ul>
     <li>Arrange for any needed supplies during the exam (e.g., calculators, scratch paper, writing utensils, UNMC devices for testing). </li>
              <li>No true/false questions  </li>
     <li>Proctors shall enforce restrictions on items in the testing room. (See student section for examples.) </li>
              <li>Avoid negatively worded stems  </li>
</ol>
              <li>Avoid absolute terms (e.g., “always,” “never”) </li>
 
          </ul>
===Exam Delivery===
    </li>
<p style="margin-bottom:15px;max-width:70em !important;">The University of Nebraska College of Nursing prepares students in a similar testing environment and style as the current licensure testing (NCLEX). Exams are computer based with no backward navigation enabled. This is a strategy for student success.</p>
     <li style="margin-bottom:10px;">Questions must be free of bias, stereotyping, slang or prejudicial language. </li>
<ol style="margin-bottom:15px;max-width:67em !important;">
    <li style="margin-bottom:10px;">Faculty must design and deliver exams in a manner that minimizes opportunities for unauthorized use of artificial intelligence (AI) tools, such as the use of application-based questions, appropriate time limits, randomized item delivery, and approved remote proctoring settings. </li>
    <li>Unit and final exams are proctored and administered in a secure environment.</li>
</ul>
    <li>Unit and final exams will be given using the UNMC specified exam/evaluation software. Quizzes (e.g., iRAT, gRAT, med math) are exempt from this requirement.</li>
===Exam Administration===
     <li>Exams will be taken on either a student’s device, a UNMC College of Nursing issued device, or at a campus testing site. Student requirements for pre-exam preparation are proscribed in Policy 2227 - Undergraduate Testing.
<ul style="margin-bottom:15px;max-width:67em !important;">
          <ol style="margin-bottom:15px;max-width:64em !important;" type="a">
    <li style="margin-bottom:10px;">Exams must be administered using the approved remote proctoring platform. </li>
              <li>Students who are not able to take the exam as scheduled are expected to notify the course coordinator as soon as possible prior to the scheduled start time for the exam.</li>
    <li style="margin-bottom:10px;">Faculty must set up exams to match the program’s designated three-hour testing window, ensuring that students receive the entire allotted time to complete the exam.</li>
              <li>Exams start on time and students are expected to be present.
    <li style="margin-bottom:10px;">Faculty are responsible for ensuring exam settings are accurate, including: 
                    <ol style="margin-bottom:15px;max-width:61em !important;" type="i">
          <ul>
                        <li>Students who arrive more than 5 minutes late will need to work with the course faculty to either reschedule or complete the exam.</li>
               <li>Availability window</li>
                        <li>Students who begin the exam after the start time will need to complete the exam at the same time as the rest of the class who began on time, unless otherwise determined by the course faculty.</li>
               <li>Time limits</li>
                    </ol>
               <li>Attempt rules</li>
              </li>
               <li>Proctoring requirements</li>
              <li>If students experience an urgent issue (e.g., technical issues or illness) during the exam, they are required to notify the exam proctor immediately.</li>
           </ul>
              <li>Students who are unable to complete the exam once started will be required to make-up/retake the exam and may be given an alternate format exam.</li>
              <li>Students can leave the exam room during the exam only with proctor permission.</li>
               <li>Students are required to upload their exam file upon completing the exam and prior to leaving the exam room. Exams not uploaded may receive a zero for that exam.</li>
               <li>Incorrect exam responses are shared with students via the review option in the exam/evaluation software immediately following the exam.</li>
               <li>If a passing score is not achieved, students will be required to meet with course faculty to review incorrect exam responses.</li>
               <li>Students have the right to seek clarification about exam items and must contact faculty within 72 hours after the completion of the exam.</li>
           </ol>
     </li>
     </li>
     <li>Make-up exams will be scheduled at the discretion of the course coordinator and will follow the guidelines published in the course syllabus.
     <li style="margin-bottom:10px;">Faculty must clearly communicate to students in advance:
          <ol style="margin-bottom:15px;max-width:64em !important;" type="a">
          <ul>
               <li>An alternate exam format may include essay, short answer, and multiple choice. The test/exam shall be worth the same number of points as the original.</li>
               <li>Exam timing and availability window</li>
               <li>The date and time for a make-up exam will be determined by the course coordinator/instructor. See CON Policy 2216 - Undergraduate Progression.</li>
              <li>Testing expectations and procedures</li>
           </ol>    
               <li>Permitted and prohibited materials</li>
           </ul>
     </li>
     </li>
     <li>Students are only allowed items needed for testing at their computer. See Students section below for specific examples. Faculty reserve the right to inspect any items that are at the testing location with the student.
     <li style="margin-bottom:10px;">Faculty shall coordinate accommodation needs in alignment with approved student accommodations. </li>
              <ol style="margin-bottom:15px;max-width:64em !important;" type="a">
</ul>
                    <li>Needed testing items will be provided by CON personnel.
 
                        <ol style="margin-bottom:15px;max-width:61em !important;" type="i">  
===Pre-Exam Responsibilities===
                              <li>Scratch paper provided by the proctor and used during the exam is not an official document and will not be considered in determining a student’s exam grade. Proctors will collect all scratch paper and dispose of appropriately.</li>
<ul style="margin-bottom:15px;max-width:67em !important;">
                              <li>Unit and final exams and exam questions are to remain in the testing environment. </li>
    <li style="margin-bottom:10px;">Exams must be prepared, reviewed, and published in the testing platform in advance to ensure system readiness. </li>
                        </ol>              
    <li style="margin-bottom:10px;">Faculty must inform students of exam expectations and ensure clarity regarding: 
                    </li>
          <ul>
                    <li>Device attachments (i.e., chargers) can be used only for the sole purpose of completing the exam.</li>
              <li>Testing procedures</li>
                    <li>No excessive attire is allowed during testing. Students must submit a written request for an attire exception to the assistant dean on the student’s division. Written documentation of the approved exception must be shared by the student with CON personnel as needed.</li>
              <li>Allowed materials</li>
              </ol>
              <li>Proctoring requirements</li>
          </ul>
     </li>
     </li>
     <li>Proctors will respond to technical issues but will not answer questions related to exam content. </li>
     <li style="margin-bottom:10px;">Faculty must inform students of any approved testing materials (e.g., calculators, scratch paper) in advance, if permitted. </li>
    <li>There shall be more than one proctor in the main testing room or an alternate support person available on campus. </li>
</ul>
    <li>Faculty shall verify the number of students taking the exam in all testing sites. </li>
    <li>Proctors shall check for exam submission via confirmation screen prior to student leaving the testing site. </li>
    <li>For ATI proctored exams, faculty must follow ATI requirements. </li>
</ol>


===Accommodations===
<ol style="margin-bottom:15px;max-width:67em !important;">
    <li>Students are required to adhere to the Accommodation Policy (ADA Policy) that is listed in the UNMC Student Policies and Procedures (see policy in related documents).</li>
    <li>Students with accommodations must present their letter of accommodations from the UNMC Accessibility Services Office to the course coordinator at least one week prior to any exam for which accommodations are requested. Once the letter has been provided to the coordinator, the accommodations will remain in effect for the length of time specified in the letter or until the student in writing indicates the accommodations are no longer needed.</li>
    <li>Accommodated students are expected to comply with timely arrival at the location for testing identified by the course coordinator.</li>
    <li>Faculty will prepare accommodation materials and resources as specified in student letter.</li>
    <li>Faculty will work with On-line Testing Coordinator and any other personnel needed to facilitate testing accommodations for students (e.g., low distraction room, additional testing time). </li>
    <li>On campuses that use affiliated university testing services, complete the accommodated testing form. </li>
    <li>Students testing via a paper copy will use a specified excel form to record exam answers. Once the exam is completed, the student will transfer the exam answers to the exam software, or the excel form data will be uploaded into the exam software by College of Nursing personnel. Transferring of the exam answers is not included in the allotted exam time.</li>
</ol>
===Post-Exam===
===Post-Exam===
<ol style="margin-bottom:15px;max-width:67em !important;">
<ul style="margin-bottom:15px;max-width:67em !important;">
     <li>Course Coordinator/ Faculty will review the exam statistics, determine any scoring adjustments needed, and make any adjustments to the exam in the exam/evaluation software. </li>
     <li style="margin-bottom:10px;">Course coordinator must review exam performance using psychometric analysis, including:
</ol>
          <ul>
              <li>Item difficulty</li>
              <li>Point biserial correlation</li>
              <li>Discrimination index</li>
          </ul>
   
    </li>
    <li style="margin-bottom:10px;">Faculty must determine whether scoring adjustments are warranted based on analysis. Adjustments are not automatic and must be justified.  </li>
    <li style="margin-bottom:10px;">Faculty must make any necessary updates to exam items within the testing platform following analysis.  </li>
    <li style="margin-bottom:10px;">Faculty must transfer exam scores to the learning management system in a timely manner.  </li>
    <li style="margin-bottom:10px;">Faculty must provide structured feedback and/or remediation guidance for students who do not meet exam performance expectations.  </li>
    <li style="margin-bottom:10px;">Faculty may delay exam review access if students are testing at different times or if a make-up exam is pending. </li>
</ul>
 
===Test Question Review Table Using Point Biserial, Discrimination Index, and Difficulty===
<br />
<table width="100%" cellpadding="10" border="1" style="border-collapse: collapse; border: 1px solid black;">
    <tr>
          <th>Item Difficulty</th>
          <th>Point Biserial < 0.10</th>
          <th>Point Biserial 0.10-0.29</th>
          <th>Point Biserial > 0.30</th>
          <th>Questions that<br />were 100%</th>
    </tr>
    <tr>
          <td valign="top">80-99%<br />Easy</td>
          <td style="background-color: lightblue;">Poor<br />Discrimination<br />but students<br />deemed easy</td>
          <td style="background-color: lightblue;">Fair<br />Discrimination<br />but students<br />deemed easy</td>
          <td valign="top" style="background-color: lightgreen;">KEEP: Good<br />discrimination</td>
          <td>&nbsp;</td>
    </tr>
    <tr>
          <td valign="top">50-80%<br />Average</td>
          <td style="background-color: lightblue;">Poor<br />Discrimination;<br />Average<br />Difficulty; May<br />review</td>
          <td style="background-color: lightblue;">Fair<br />Discrimination:<br />Average<br />Difficulty; May<br />review</td>
          <td valign="top" style="background-color: lightgreen;">KEEP: Good<br />discrimination</td>
          <td style="background-color: lightgray;">&nbsp;</td>
    </tr>
    <tr>
          <td valign="top">30-50%</td>
          <td style="background-color: lightsalmon;">Add the disc<br />index to the<br />difficulty, if<br /><0.06 poor<br /> discrimination;<br />Review<br />Required </td>
          <td valign="top" style="background-color: lightblue;">Add the disc<br />index to the<br />difficulty, if<br />0.6-0.8 fair<br /> discrimination;<br />May review </td>
          <td valign="top" style="background-color: lightgreen;">Add the disc<br />index to the<br />difficulty, if ><br />0.80 good<br />discrimination;<br />KEEP</td>
          <td style="background-color: lightgray;">&nbsp;</td>
    </tr>
    <tr>
          <td valign="top"><30%<br />Difficult</td>
          <td valign="top" style="background-color: lightsalmon;">Poor<br />discrimination;<br />Review<br />Required</td>
          <td valign="top" style="background-color: lightblue;">Fair<br />discrimination;<br />May Review</td>
          <td valign="top" style="background-color: lightgreen;">KEEP; Good<br />discrimination</td>
          <td valign="top">QUESTIONS<br />GIVEN BACK</td>
    </tr>
   
</table>
 
===Make-Up Exams===
<ul style="margin-bottom:15px;max-width:67em !important;">
    <li style="margin-bottom:10px;">Faculty have discretion in approving and scheduling make-up exams.  </li>
    <li style="margin-bottom:10px;">Make-up exams may be administered in an alternate format (e.g., essay, short answer, or multiple-choice) but must be equivalent in point value to the original exam.  </li>
    <li style="margin-bottom:10px;">Faculty are responsible for ensuring that make-up exams maintain academic rigor and integrity consistent with the original assessment. </li>
</ul>
Retrieved from "https://wiki.unmc.edu/index.php/CON_Professional_Graduate_Test_Construction_and_Delivery"