CON Undergraduate Test Construction and Delivery: Difference between revisions
| (34 intermediate revisions by the same user not shown) | |||
| Line 42: | Line 42: | ||
<table width="100%" cellpadding="0" cellspacing="0"> | <table width="100%" cellpadding="0" cellspacing="0"> | ||
<tr> | <tr> | ||
<td>Revised: [[Special:PermanentLink/11970|May 2019]]<br />Revised: [[Special:PermanentLink/15778|May 2024]] ([[Special:Diff/11970/15778|changes]])<br />Revised: [[Special:PermanentLink/18011|August 2025]] ([[Special:Diff/15778/18011|changes]])<br />Revised: November 2025 [[Special:Diff/18011/18219|(changes]])<br />Revised: April 2026 [[Special:Diff/18219/{{REVISIONID}}|(changes]])</td> | <td>Revised: [[Special:PermanentLink/11970|May 2019]]<br />Revised: [[Special:PermanentLink/15778|May 2024]] ([[Special:Diff/11970/15778|changes]])<br />Revised: [[Special:PermanentLink/18011|August 2025]] ([[Special:Diff/15778/18011|changes]])<br />Revised: [[Special:PermanentLink/18219|November 2025]] [[Special:Diff/18011/18219|(changes]])<br />Revised: April 2026 [[Special:Diff/18219/{{REVISIONID}}|(changes]])</td> | ||
</tr> | </tr> | ||
</table> | </table> | ||
| Line 84: | Line 84: | ||
<li>For each exam item, a rationale shall be provided. </li> | <li>For each exam item, a rationale shall be provided. </li> | ||
<li>Exam questions shall be retired after 5 years of use, or if exam statistics analysis does not support continued use of the question. </li> | <li>Exam questions shall be retired after 5 years of use, or if exam statistics analysis does not support continued use of the question. </li> | ||
<li>Faculty will include a minimum of 10% to a maximum of 20% | <li>Faculty will include a minimum of 10% to a maximum of 20% Next Generation NCLEX style questions (See NSCBN) | ||
<ol type="a"> | <ol type="a"> | ||
<li>When available in the exam testing platform, exam questions will be scored using +/- scoring. If +/- scoring is not available for the type of question, then partial credit scoring is to be used. </li> | <li>When available in the exam testing platform, exam questions will be scored using +/- scoring. If +/- scoring is not available for the type of question, then partial credit scoring is to be used. </li> | ||
<li>By PCC III, students will be introduced to one | <li>By PCC III, students will be introduced to one Next Generation NCLEX Case Study style exam question with 3 to 6 parts. </li> | ||
<li>PCC IV will have one | <li>PCC IV will have one Next Generation NCLEX Case Study style exam question per exam with 3 to 6 parts. </li> | ||
</ol> | </ol> | ||
</li> | </li> | ||
| Line 151: | Line 151: | ||
<li>Students are only allowed items needed for testing at their computer. See Students policy 2227 for specific examples. Faculty reserve the right to inspect any items that are at the testing location with the student. | <li>Students are only allowed items needed for testing at their computer. See Students policy 2227 for specific examples. Faculty reserve the right to inspect any items that are at the testing location with the student. | ||
<ol style="margin-bottom:15px;max-width:64em !important;" type="a"> | <ol style="margin-bottom:15px;max-width:64em !important;" type="a"> | ||
<li>Needed testing items necessary for | <li>Needed testing items necessary for testing will be provided by CON personnel. | ||
<ol style="margin-bottom:15px;max-width:61em !important;" type="i"> | <ol style="margin-bottom:15px;max-width:61em !important;" type="i"> | ||
<li>Scratch paper provided by the proctor and used during the exam is not an official document and will not be considered in determining a student’s exam grade. Proctors will collect all scratch paper and dispose of appropriately.</li> | <li>Scratch paper provided by the proctor and used during the exam is not an official document and will not be considered in determining a student’s exam grade. Proctors will collect all scratch paper and dispose of appropriately.</li> | ||
| Line 168: | Line 168: | ||
<li>Students are required to adhere to the Accommodation Policy (ADA Policy) that is listed in the UNMC Student Policies and Procedures (see policy in related documents).</li> | <li>Students are required to adhere to the Accommodation Policy (ADA Policy) that is listed in the UNMC Student Policies and Procedures (see policy in related documents).</li> | ||
<li>Students with accommodations must present their official letter of accommodations from the UNMC Accessibility Services Office to each new course coordinator for each semester.</li> | <li>Students with accommodations must present their official letter of accommodations from the UNMC Accessibility Services Office to each new course coordinator for each semester.</li> | ||
<li>The | <li>The accommodation letter should be submitted a minimum of two weeks prior to any exam for which accommodations are requested.</li> | ||
<li>Faculty will prepare only the accommodation materials and resources as specified in student letter.</li> | <li>Faculty will prepare only the accommodation materials and resources as specified in student letter.</li> | ||
<li>Faculty will work with On-line Testing Coordinator and any other personnel needed to facilitate testing accommodations for students (e.g., low distraction room, additional testing time). </li> | <li>Faculty will work with On-line Testing Coordinator and any other personnel needed to facilitate testing accommodations for students (e.g., low distraction room, additional testing time). </li> | ||
| Line 178: | Line 178: | ||
<ol style="margin-bottom:15px;max-width:67em !important;"> | <ol style="margin-bottom:15px;max-width:67em !important;"> | ||
<li>Course Coordinator/ Faculty will review the exam statistics, determine any scoring adjustments needed, and make any adjustments to the exam in the exam/evaluation software. </li> | <li>Course Coordinator/ Faculty will review the exam statistics, determine any scoring adjustments needed, and make any adjustments to the exam in the exam/evaluation software. </li> | ||
<li>Course coordinator will strive to keep exam KR-20 value between 0.50 and 0.85. Any value outside of this range requires immediate attention before the exam is redeployed. Examples of appropriate actions to take in this situation would be meeting with BSN Director or representative from the CON Testing Taskforce to discuss mandatory changes or revisions to the exam questions. (See Exam Review | <li>Course coordinator will strive to keep exam KR-20 value between 0.50 and 0.85. Any value outside of this range requires immediate attention before the exam is redeployed. Examples of appropriate actions to take in this situation would be meeting with BSN Director or representative from the CON Testing Taskforce to discuss mandatory changes or revisions to the exam questions. (See Exam Review Table below) </li> | ||
<li>During the review immediately following the exam, students are allocated a limited time to review missed questions. The review time is calculated as total questions divided by 10. </li> | <li>During the review immediately following the exam, students are allocated a limited time to review missed questions. The review time is calculated as total questions divided by 10. </li> | ||
<li>A “truncated” strengths and opportunities category performance report (no test questions) from the testing platform may be provided to students upon request. </li> | <li>A “truncated” strengths and opportunities category performance report (no test questions) from the testing platform may be provided to students upon request. </li> | ||
| Line 190: | Line 190: | ||
</ol> | </ol> | ||
===Exam Review | ===Exam Review Table=== | ||
<table style="border-collapse: collapse; width: 100%;"> | <table style="border-collapse: collapse; width: 100%;"> | ||
<tr> | <tr> | ||
<th style="border: 1px solid black; padding: 8px;" width="25%">Average Score:</th> | <th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="25%">Average Score:</th> | ||
<th style="border: 1px solid black; padding: 8px;" width="25%">Low Score:</th> | <th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="25%">Low Score:</th> | ||
<th style="border: 1px solid black; padding: 8px;" width="25%">High Score:</th> | <th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="25%">High Score:</th> | ||
<th style="border: 1px solid black; padding: 8px;" width="25%">KR20:</th> | <th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="25%">KR20:</th> | ||
</tr> | </tr> | ||
<tr> | <tr> | ||
<td style="border: 1px solid black; padding: 8px;">Item Difficulty (ρ value)</td> | <td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Item Difficulty (ρ value)</td> | ||
<td style="border: 1px solid black; padding: 8px;">Point Biserial (PBCC) < 0.10</td> | <td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Point Biserial (PBCC) < 0.10</td> | ||
<td style="border: 1px solid black; padding: 8px;">Point Biserial (PBCC) 0.10-0.29</td> | <td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Point Biserial (PBCC) 0.10-0.29</td> | ||
<td style="border: 1px solid black; padding: 8px;">Point Biserial (PBCC) > 0.30</td> | <td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Point Biserial (PBCC) > 0.30</td> | ||
</tr> | </tr> | ||
<tr> | <tr> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;background-color: lightgray;">90-99%<br />Easy</td> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;background-color: lightyellow;">Poor discrimination, deemed “easy”, suggest review/revision </td> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;background-color: lightyellow;">Fair discrimination, may deem “easy”, may review/revise </td> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;background-color: #DBF9DB;">Keep, good discrimination </td> | ||
</tr> | </tr> | ||
<tr> | <tr> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;background-color: lightgray;">50-90%<br />Average</td> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;background-color: lightyellow;">Poor discrimination, average difficulty, may review/revise </td> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;background-color: #DBF9DB;">Fair discrimination, average difficulty, may review/revise </td> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;background-color: #DBF9DB;">Keep, good discrimination </td> | ||
</tr> | </tr> | ||
<tr> | <tr> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;background-color: lightgray;">30-50%<br />Slightly Difficult</td> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;background-color: #FFDAB9;">Add PBCC to ρ value, if <0.6 suggest review/revision </td> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;background-color: lightyellow;">Add PBCC to ρ value, if 0.6 – 0.8 may review/revise </td> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;background-color: #DBF9DB;">Add PBCC to ρ value, if >0.8, keep, good discrimination </td> | ||
</tr> | </tr> | ||
<tr> | <tr> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;background-color: lightgray;">< 30%<br />Difficult</td> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;background-color: #FFDAB9;">Poor discrimination, highly suggest review/revision </td> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;background-color: #FFDAB9;">Fair discrimination, suggest review/revision </td> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;background-color: #FFDAB9;">Good discrimination, may be too difficult, suggest review/revise </td> | ||
</tr> | |||
</table> | |||
<p>'''Key'''</p> | |||
<table style="border-collapse: collapse;"> | |||
<tr> | |||
<td style="background-color: #FFDAB9;" width="5%"> </td> | |||
<td width="10px"> </td> | |||
<td>Start revisions here, items with highest need, priority items</td> | |||
</tr> | |||
<tr> | |||
<td style="background-color: lightyellow;" width="5%"> </td> | |||
<td width="10px"> </td> | |||
<td>Second area of need, revisions here if no items in orange boxes</td> | |||
</tr> | |||
<tr> | |||
<td style="background-color: #DBF9DB;" width="5%"> </td> | |||
<td width="10px"> </td> | |||
<td>These items are valid and reliable, no revisions required</td> | |||
</tr> | |||
</table> | |||
<br /> | |||
<!-- | |||
<p>Items in <span style="color:orange;">orange</span> boxes: start revisions here, items with highest need, priority items <br /> | |||
Items in <span style="color:lightyellow;">yellow</span> boxes: second area of need, revisions here if no items in orange boxes <br /> | |||
Items in <span style="color:lightgreen;">green</span> boxes: these items are valid and reliable, no revisions required </p> | |||
--> | |||
===Item Analysis Results Table=== | |||
<table style="border-collapse: collapse; width: 100%;"> | |||
<tr> | |||
<th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="25%">Category</th> | |||
<th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="25%">Tally</th> | |||
<th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="50%">Action</th> | |||
</tr> | </tr> | ||
<tr> | <tr> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Questions with 100% correct</td> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;"> </td> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;">Suggest maximum of 10% of exam, over 10% suggest review/revision, includes mastery questions</td> | ||
</tr> | </tr> | ||
<tr> | <tr> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Items adjusted</td> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;"> </td> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;">Rationale</td> | ||
</tr> | </tr> | ||
<tr> | <tr> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Next Generation NCLEX</td> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;"> </td> | ||
<td style="border: 1px solid black; padding: 8px;"></td> | <td style="border: 1px solid black; padding: 8px;">Rationale</td> | ||
</tr> | </tr> | ||
</table> | </table> | ||