CON Undergraduate Test Construction and Delivery: Difference between revisions
| (50 intermediate revisions by the same user not shown) | |||
| Line 42: | Line 42: | ||
<table width="100%" cellpadding="0" cellspacing="0"> | <table width="100%" cellpadding="0" cellspacing="0"> | ||
<tr> | <tr> | ||
<td>Revised: [[Special:PermanentLink/11970|May 2019]]<br />Revised: [[Special:PermanentLink/15778|May 2024]] ([[Special:Diff/11970/15778|changes]])<br />Revised: [[Special:PermanentLink/18011|August 2025]] ([[Special:Diff/15778/18011|changes]])<br />Revised: November 2025 [[Special:Diff/18011/18219|(changes]])<br />Revised: | <td>Revised: [[Special:PermanentLink/11970|May 2019]]<br />Revised: [[Special:PermanentLink/15778|May 2024]] ([[Special:Diff/11970/15778|changes]])<br />Revised: [[Special:PermanentLink/18011|August 2025]] ([[Special:Diff/15778/18011|changes]])<br />Revised: [[Special:PermanentLink/18219|November 2025]] [[Special:Diff/18011/18219|(changes]])<br />Revised: April 2026 [[Special:Diff/18219/{{REVISIONID}}|(changes]])</td> | ||
</tr> | </tr> | ||
</table> | </table> | ||
| Line 84: | Line 84: | ||
<li>For each exam item, a rationale shall be provided. </li> | <li>For each exam item, a rationale shall be provided. </li> | ||
<li>Exam questions shall be retired after 5 years of use, or if exam statistics analysis does not support continued use of the question. </li> | <li>Exam questions shall be retired after 5 years of use, or if exam statistics analysis does not support continued use of the question. </li> | ||
<li>Faculty will include a minimum of 10% to a maximum of 20% | <li>Faculty will include a minimum of 10% to a maximum of 20% Next Generation NCLEX style questions (See NSCBN) | ||
<ol type="a"> | <ol type="a"> | ||
<li>When available in the exam testing platform, exam questions will be scored using +/- scoring. If +/- scoring is not available for the type of question, then partial credit scoring is to be used. </li> | <li>When available in the exam testing platform, exam questions will be scored using +/- scoring. If +/- scoring is not available for the type of question, then partial credit scoring is to be used. </li> | ||
<li>By PCC III, students will be introduced to one | <li>By PCC III, students will be introduced to one Next Generation NCLEX Case Study style exam question with 3 to 6 parts. </li> | ||
<li>PCC IV will have one | <li>PCC IV will have one Next Generation NCLEX Case Study style exam question per exam with 3 to 6 parts. </li> | ||
</ol> | </ol> | ||
</li> | </li> | ||
| Line 100: | Line 100: | ||
===Pre-Exam=== | ===Pre-Exam=== | ||
<ol style="margin-bottom:15px;max-width:67em !important;"> | <ol style="margin-bottom:15px;max-width:67em !important;"> | ||
<li>Exams | <li>Exams will be posted one business day prior to the scheduled exam time so students can download the exam prior to the testing time</li> | ||
<li>Course Coordinator will provide proctor with exam details including the password and universal resume code in case of technical issues. </li> | <li>Course Coordinator will provide proctor with exam details including the password and universal resume code in case of technical issues. </li> | ||
<li> | <li>Course Coordinator will arrange for any needed supplies during the exam (e.g., calculators, scratch paper, writing utensils, UNMC devices for testing). </li> | ||
<li>Proctors shall enforce restrictions on items in the testing room. (See student section for | |||
</ol> | |||
===Proctoring=== | |||
<ol style="margin-bottom:15px;max-width:67em !important;"> | |||
<li>Proctors must complete UNMC CON Proctor training prior to proctoring any exams. </li> | |||
<li>Proctors must read the UNMC CON uniform Proctor Statement before each exam and complete pre-exam checks (ex. Personal items stowed, scratch paper blank and visible; testing area clean and secure). </li> | |||
<li>Proctors shall enforce restrictions on items in the testing room. (See the student section for example.) </li> | |||
<li>Proctors will respond to technical issues but will not answer questions related to exam content. </li> | |||
<li>There shall be more than one proctor in the main testing room, or an alternate support person available on campus. </li> | |||
<li>Faculty/proctors shall verify the number of students taking the exam on all testing sites. </li> | |||
<li>Proctors shall check for exam submission via a confirmation screen prior to students leaving the testing site. </li> | |||
<li>For ATI proctored exams, faculty must follow ATI requirements. </li> | |||
</ol> | </ol> | ||
| Line 130: | Line 141: | ||
</ol> | </ol> | ||
</li> | </li> | ||
<li>Make-up exams will be scheduled | <li>Make-up exams will be scheduled by the course coordinator and will follow the guidelines published in the course syllabus. | ||
<ol style="margin-bottom:15px;max-width:64em !important;" type="a"> | <ol style="margin-bottom:15px;max-width:64em !important;" type="a"> | ||
<li>If a student misses more than two scheduled exams per course without provider documentation, the student will be subject to an alternate format exam for all make-ups and a required meeting with course faculty. </li> | |||
<li>If more than 10% of the class fails to take the exam on time, exam grade posting will be delayed until more than 90% of the class has taken the exam. </li> | |||
<li>An alternate exam format may include essay, short answer, and multiple choice. The test/exam shall be worth the same number of points as the original.</li> | <li>An alternate exam format may include essay, short answer, and multiple choice. The test/exam shall be worth the same number of points as the original.</li> | ||
<li>The date and time for a make-up exam will be determined by the course coordinator/instructor. See CON Policy 2216 - Undergraduate Progression.</li> | <li>The date and time for a make-up exam will be determined by the course coordinator/instructor. See CON Policy 2216 - Undergraduate Progression.</li> | ||
</ol> | </ol> | ||
</li> | </li> | ||
<li>Students are only allowed items needed for testing at their computer. See Students | <li>Students are only allowed items needed for testing at their computer. See Students policy 2227 for specific examples. Faculty reserve the right to inspect any items that are at the testing location with the student. | ||
<ol style="margin-bottom:15px;max-width:64em !important;" type="a"> | <ol style="margin-bottom:15px;max-width:64em !important;" type="a"> | ||
<li>Needed testing items will be provided by CON personnel. | <li>Needed testing items necessary for testing will be provided by CON personnel. | ||
<ol style="margin-bottom:15px;max-width:61em !important;" type="i"> | <ol style="margin-bottom:15px;max-width:61em !important;" type="i"> | ||
<li>Scratch paper provided by the proctor and used during the exam is not an official document and will not be considered in determining a student’s exam grade. Proctors will collect all scratch paper and dispose of appropriately.</li> | <li>Scratch paper provided by the proctor and used during the exam is not an official document and will not be considered in determining a student’s exam grade. Proctors will collect all scratch paper and dispose of appropriately.</li> | ||
| Line 148: | Line 161: | ||
</ol> | </ol> | ||
</li> | </li> | ||
</ol> | </ol> | ||
| Line 158: | Line 167: | ||
<ol style="margin-bottom:15px;max-width:67em !important;"> | <ol style="margin-bottom:15px;max-width:67em !important;"> | ||
<li>Students are required to adhere to the Accommodation Policy (ADA Policy) that is listed in the UNMC Student Policies and Procedures (see policy in related documents).</li> | <li>Students are required to adhere to the Accommodation Policy (ADA Policy) that is listed in the UNMC Student Policies and Procedures (see policy in related documents).</li> | ||
<li>Students with accommodations must present their letter of accommodations from the UNMC Accessibility Services Office to | <li>Students with accommodations must present their official letter of accommodations from the UNMC Accessibility Services Office to each new course coordinator for each semester.</li> | ||
<li> | <li>The accommodation letter should be submitted a minimum of two weeks prior to any exam for which accommodations are requested.</li> | ||
<li>Faculty will prepare accommodation materials and resources as specified in student letter.</li> | <li>Faculty will prepare only the accommodation materials and resources as specified in student letter.</li> | ||
<li>Faculty will work with On-line Testing Coordinator and any other personnel needed to facilitate testing accommodations for students (e.g., low distraction room, additional testing time). </li> | <li>Faculty will work with On-line Testing Coordinator and any other personnel needed to facilitate testing accommodations for students (e.g., low distraction room, additional testing time). </li> | ||
<li>On campuses that use affiliated university testing services, complete the accommodated testing form. </li> | <li>On campuses that use affiliated university testing services, complete the accommodated testing form. </li> | ||
<li>Students testing via a paper copy will use a specified excel form to record exam answers. Once the exam is completed, the student will transfer the exam answers to the exam software, or the excel form data will be uploaded into the exam software by College of Nursing personnel. Transferring of the exam answers is not included in the allotted exam time.</li> | <li>Students testing via a paper copy will use a specified excel form to record exam answers. Once the exam is completed, the student will transfer the exam answers to the exam software, or the excel form data will be uploaded into the exam software by College of Nursing personnel. Transferring of the exam answers is not included in the allotted exam time.</li> | ||
</ol> | </ol> | ||
===Post-Exam=== | ===Post-Exam=== | ||
<ol style="margin-bottom:15px;max-width:67em !important;"> | <ol style="margin-bottom:15px;max-width:67em !important;"> | ||
<li>Course Coordinator/ Faculty will review the exam statistics, determine any scoring adjustments needed, and make any adjustments to the exam in the exam/evaluation software. </li> | <li>Course Coordinator/ Faculty will review the exam statistics, determine any scoring adjustments needed, and make any adjustments to the exam in the exam/evaluation software. </li> | ||
<li>Course coordinator will strive to keep exam KR-20 value between 0.50 and 0.85. Any value outside of this range requires immediate attention before the exam is redeployed. Examples of appropriate actions to take in this situation would be meeting with BSN Director or representative from the CON Testing Taskforce to discuss mandatory changes or revisions to the exam questions. (See Exam Review Table below) </li> | |||
<li>During the review immediately following the exam, students are allocated a limited time to review missed questions. The review time is calculated as total questions divided by 10. </li> | |||
<li>A “truncated” strengths and opportunities category performance report (no test questions) from the testing platform may be provided to students upon request. </li> | |||
<li>Students are allowed to review an exam one time individually with the course instructor or coordinator outside of the immediate exam review. | |||
<ol type="a"> | |||
<li>For courses that are taught cross-campus, when the course instructor is not located on their campus, students may review the exam with the assigned exam staff or faculty. </li> | |||
</ol> | |||
</li> | |||
<li>Exam reviews can be conducted online or via Zoom if monitored by another proctor in person. </li> | |||
<li>Course Coordinator will transfer all exam grades to the learning management system from the exam/evaluation software within 72 hours. </li> | |||
</ol> | </ol> | ||
===Exam Review Table=== | |||
<table style="border-collapse: collapse; width: 100%;"> | |||
<tr> | |||
<th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="25%">Average Score:</th> | |||
<th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="25%">Low Score:</th> | |||
<th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="25%">High Score:</th> | |||
<th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="25%">KR20:</th> | |||
</tr> | |||
<tr> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Item Difficulty (ρ value)</td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Point Biserial (PBCC) < 0.10</td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Point Biserial (PBCC) 0.10-0.29</td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Point Biserial (PBCC) > 0.30</td> | |||
</tr> | |||
<tr> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">90-99%<br />Easy</td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightyellow;">Poor discrimination, deemed “easy”, suggest review/revision </td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightyellow;">Fair discrimination, may deem “easy”, may review/revise </td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: #DBF9DB;">Keep, good discrimination </td> | |||
</tr> | |||
<tr> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">50-90%<br />Average</td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightyellow;">Poor discrimination, average difficulty, may review/revise </td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: #DBF9DB;">Fair discrimination, average difficulty, may review/revise </td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: #DBF9DB;">Keep, good discrimination </td> | |||
</tr> | |||
<tr> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">30-50%<br />Slightly Difficult</td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: #FFDAB9;">Add PBCC to ρ value, if <0.6 suggest review/revision </td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightyellow;">Add PBCC to ρ value, if 0.6 – 0.8 may review/revise </td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: #DBF9DB;">Add PBCC to ρ value, if >0.8, keep, good discrimination </td> | |||
</tr> | |||
<tr> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">< 30%<br />Difficult</td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: #FFDAB9;">Poor discrimination, highly suggest review/revision </td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: #FFDAB9;">Fair discrimination, suggest review/revision </td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: #FFDAB9;">Good discrimination, may be too difficult, suggest review/revise </td> | |||
</tr> | |||
</table> | |||
<p>'''Key'''</p> | |||
<table style="border-collapse: collapse;"> | |||
<tr> | |||
<td style="background-color: #FFDAB9;" width="5%"> </td> | |||
<td width="10px"> </td> | |||
<td>Start revisions here, items with highest need, priority items</td> | |||
</tr> | |||
<tr> | |||
<td style="background-color: lightyellow;" width="5%"> </td> | |||
<td width="10px"> </td> | |||
<td>Second area of need, revisions here if no items in orange boxes</td> | |||
</tr> | |||
<tr> | |||
<td style="background-color: #DBF9DB;" width="5%"> </td> | |||
<td width="10px"> </td> | |||
<td>These items are valid and reliable, no revisions required</td> | |||
</tr> | |||
</table> | |||
<br /> | |||
<!-- | |||
<p>Items in <span style="color:orange;">orange</span> boxes: start revisions here, items with highest need, priority items <br /> | |||
Items in <span style="color:lightyellow;">yellow</span> boxes: second area of need, revisions here if no items in orange boxes <br /> | |||
Items in <span style="color:lightgreen;">green</span> boxes: these items are valid and reliable, no revisions required </p> | |||
--> | |||
===Item Analysis Results Table=== | |||
<table style="border-collapse: collapse; width: 100%;"> | |||
<tr> | |||
<th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="25%">Category</th> | |||
<th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="25%">Tally</th> | |||
<th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="50%">Action</th> | |||
</tr> | |||
<tr> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Questions with 100% correct</td> | |||
<td style="border: 1px solid black; padding: 8px;"> </td> | |||
<td style="border: 1px solid black; padding: 8px;">Suggest maximum of 10% of exam, over 10% suggest review/revision, includes mastery questions</td> | |||
</tr> | |||
<tr> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Items adjusted</td> | |||
<td style="border: 1px solid black; padding: 8px;"> </td> | |||
<td style="border: 1px solid black; padding: 8px;">Rationale</td> | |||
</tr> | |||
<tr> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Next Generation NCLEX</td> | |||
<td style="border: 1px solid black; padding: 8px;"> </td> | |||
<td style="border: 1px solid black; padding: 8px;">Rationale</td> | |||
</tr> | |||
</table> | |||