CON Undergraduate Test Construction and Delivery: Difference between revisions
Jump to navigation
Jump to search
| (41 intermediate revisions by the same user not shown) | |||
| Line 42: | Line 42: | ||
<table width="100%" cellpadding="0" cellspacing="0"> | <table width="100%" cellpadding="0" cellspacing="0"> | ||
<tr> | <tr> | ||
<td>Revised: [[Special:PermanentLink/11970|May 2019]]<br />Revised: [[Special:PermanentLink/15778|May 2024]] ([[Special:Diff/11970/15778|changes]])<br />Revised: [[Special:PermanentLink/18011|August 2025]] ([[Special:Diff/15778/18011|changes]])<br />Revised: November 2025 [[Special:Diff/18011/18219|(changes]])<br />Revised: | <td>Revised: [[Special:PermanentLink/11970|May 2019]]<br />Revised: [[Special:PermanentLink/15778|May 2024]] ([[Special:Diff/11970/15778|changes]])<br />Revised: [[Special:PermanentLink/18011|August 2025]] ([[Special:Diff/15778/18011|changes]])<br />Revised: [[Special:PermanentLink/18219|November 2025]] [[Special:Diff/18011/18219|(changes]])<br />Revised: April 2026 [[Special:Diff/18219/{{REVISIONID}}|(changes]])</td> | ||
</tr> | </tr> | ||
</table> | </table> | ||
| Line 84: | Line 84: | ||
<li>For each exam item, a rationale shall be provided. </li> | <li>For each exam item, a rationale shall be provided. </li> | ||
<li>Exam questions shall be retired after 5 years of use, or if exam statistics analysis does not support continued use of the question. </li> | <li>Exam questions shall be retired after 5 years of use, or if exam statistics analysis does not support continued use of the question. </li> | ||
<li>Faculty will include a minimum of 10% to a maximum of 20% | <li>Faculty will include a minimum of 10% to a maximum of 20% Next Generation NCLEX style questions (See NSCBN) | ||
<ol type="a"> | <ol type="a"> | ||
<li>When available in the exam testing platform, exam questions will be scored using +/- scoring. If +/- scoring is not available for the type of question, then partial credit scoring is to be used. </li> | <li>When available in the exam testing platform, exam questions will be scored using +/- scoring. If +/- scoring is not available for the type of question, then partial credit scoring is to be used. </li> | ||
<li>By PCC III, students will be introduced to one | <li>By PCC III, students will be introduced to one Next Generation NCLEX Case Study style exam question with 3 to 6 parts. </li> | ||
<li>PCC IV will have one | <li>PCC IV will have one Next Generation NCLEX Case Study style exam question per exam with 3 to 6 parts. </li> | ||
</ol> | </ol> | ||
</li> | </li> | ||
| Line 151: | Line 151: | ||
<li>Students are only allowed items needed for testing at their computer. See Students policy 2227 for specific examples. Faculty reserve the right to inspect any items that are at the testing location with the student. | <li>Students are only allowed items needed for testing at their computer. See Students policy 2227 for specific examples. Faculty reserve the right to inspect any items that are at the testing location with the student. | ||
<ol style="margin-bottom:15px;max-width:64em !important;" type="a"> | <ol style="margin-bottom:15px;max-width:64em !important;" type="a"> | ||
<li>Needed testing items necessary for | <li>Needed testing items necessary for testing will be provided by CON personnel. | ||
<ol style="margin-bottom:15px;max-width:61em !important;" type="i"> | <ol style="margin-bottom:15px;max-width:61em !important;" type="i"> | ||
<li>Scratch paper provided by the proctor and used during the exam is not an official document and will not be considered in determining a student’s exam grade. Proctors will collect all scratch paper and dispose of appropriately.</li> | <li>Scratch paper provided by the proctor and used during the exam is not an official document and will not be considered in determining a student’s exam grade. Proctors will collect all scratch paper and dispose of appropriately.</li> | ||
| Line 168: | Line 168: | ||
<li>Students are required to adhere to the Accommodation Policy (ADA Policy) that is listed in the UNMC Student Policies and Procedures (see policy in related documents).</li> | <li>Students are required to adhere to the Accommodation Policy (ADA Policy) that is listed in the UNMC Student Policies and Procedures (see policy in related documents).</li> | ||
<li>Students with accommodations must present their official letter of accommodations from the UNMC Accessibility Services Office to each new course coordinator for each semester.</li> | <li>Students with accommodations must present their official letter of accommodations from the UNMC Accessibility Services Office to each new course coordinator for each semester.</li> | ||
<li>The | <li>The accommodation letter should be submitted a minimum of two weeks prior to any exam for which accommodations are requested.</li> | ||
<li>Faculty will prepare only the accommodation materials and resources as specified in student letter.</li> | <li>Faculty will prepare only the accommodation materials and resources as specified in student letter.</li> | ||
<li>Faculty will work with On-line Testing Coordinator and any other personnel needed to facilitate testing accommodations for students (e.g., low distraction room, additional testing time). </li> | <li>Faculty will work with On-line Testing Coordinator and any other personnel needed to facilitate testing accommodations for students (e.g., low distraction room, additional testing time). </li> | ||
| Line 178: | Line 178: | ||
<ol style="margin-bottom:15px;max-width:67em !important;"> | <ol style="margin-bottom:15px;max-width:67em !important;"> | ||
<li>Course Coordinator/ Faculty will review the exam statistics, determine any scoring adjustments needed, and make any adjustments to the exam in the exam/evaluation software. </li> | <li>Course Coordinator/ Faculty will review the exam statistics, determine any scoring adjustments needed, and make any adjustments to the exam in the exam/evaluation software. </li> | ||
<li>Course coordinator will strive to keep exam KR-20 value between 0.50 and 0.85. Any value outside of this range requires immediate attention before the exam is redeployed. Examples of appropriate actions to take in this situation would be meeting with BSN Director or representative from the CON Testing Taskforce to discuss mandatory changes or revisions to the exam questions. (See Exam Review | <li>Course coordinator will strive to keep exam KR-20 value between 0.50 and 0.85. Any value outside of this range requires immediate attention before the exam is redeployed. Examples of appropriate actions to take in this situation would be meeting with BSN Director or representative from the CON Testing Taskforce to discuss mandatory changes or revisions to the exam questions. (See Exam Review Table below) </li> | ||
<li>During the review immediately following the exam, students are allocated a limited time to review missed | <li>During the review immediately following the exam, students are allocated a limited time to review missed questions. The review time is calculated as total questions divided by 10. </li> | ||
<li>A “truncated” strengths and opportunities category performance report (no test questions) from the testing platform may be provided to students upon request. </li> | <li>A “truncated” strengths and opportunities category performance report (no test questions) from the testing platform may be provided to students upon request. </li> | ||
<li>Students are allowed to review an exam one time individually with the course instructor or coordinator outside of the immediate exam review. | <li>Students are allowed to review an exam one time individually with the course instructor or coordinator outside of the immediate exam review. | ||
| Line 189: | Line 189: | ||
<li>Course Coordinator will transfer all exam grades to the learning management system from the exam/evaluation software within 72 hours. </li> | <li>Course Coordinator will transfer all exam grades to the learning management system from the exam/evaluation software within 72 hours. </li> | ||
</ol> | </ol> | ||
===Exam Review | |||
===Exam Review Table=== | |||
<table style="border-collapse: collapse; width: 100%;"> | |||
<tr> | |||
<th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="25%">Average Score:</th> | |||
<th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="25%">Low Score:</th> | |||
<th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="25%">High Score:</th> | |||
<th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="25%">KR20:</th> | |||
</tr> | |||
<tr> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Item Difficulty (ρ value)</td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Point Biserial (PBCC) < 0.10</td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Point Biserial (PBCC) 0.10-0.29</td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Point Biserial (PBCC) > 0.30</td> | |||
</tr> | |||
<tr> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">90-99%<br />Easy</td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightyellow;">Poor discrimination, deemed “easy”, suggest review/revision </td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightyellow;">Fair discrimination, may deem “easy”, may review/revise </td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: #DBF9DB;">Keep, good discrimination </td> | |||
</tr> | |||
<tr> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">50-90%<br />Average</td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightyellow;">Poor discrimination, average difficulty, may review/revise </td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: #DBF9DB;">Fair discrimination, average difficulty, may review/revise </td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: #DBF9DB;">Keep, good discrimination </td> | |||
</tr> | |||
<tr> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">30-50%<br />Slightly Difficult</td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: #FFDAB9;">Add PBCC to ρ value, if <0.6 suggest review/revision </td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightyellow;">Add PBCC to ρ value, if 0.6 – 0.8 may review/revise </td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: #DBF9DB;">Add PBCC to ρ value, if >0.8, keep, good discrimination </td> | |||
</tr> | |||
<tr> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">< 30%<br />Difficult</td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: #FFDAB9;">Poor discrimination, highly suggest review/revision </td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: #FFDAB9;">Fair discrimination, suggest review/revision </td> | |||
<td style="border: 1px solid black; padding: 8px;background-color: #FFDAB9;">Good discrimination, may be too difficult, suggest review/revise </td> | |||
</tr> | |||
</table> | |||
<p>'''Key'''</p> | |||
<table style="border-collapse: collapse;"> | |||
<tr> | |||
<td style="background-color: #FFDAB9;" width="5%"> </td> | |||
<td width="10px"> </td> | |||
<td>Start revisions here, items with highest need, priority items</td> | |||
</tr> | |||
<tr> | |||
<td style="background-color: lightyellow;" width="5%"> </td> | |||
<td width="10px"> </td> | |||
<td>Second area of need, revisions here if no items in orange boxes</td> | |||
</tr> | |||
<tr> | |||
<td style="background-color: #DBF9DB;" width="5%"> </td> | |||
<td width="10px"> </td> | |||
<td>These items are valid and reliable, no revisions required</td> | |||
</tr> | |||
</table> | |||
<br /> | |||
<!-- | |||
<p>Items in <span style="color:orange;">orange</span> boxes: start revisions here, items with highest need, priority items <br /> | |||
Items in <span style="color:lightyellow;">yellow</span> boxes: second area of need, revisions here if no items in orange boxes <br /> | |||
Items in <span style="color:lightgreen;">green</span> boxes: these items are valid and reliable, no revisions required </p> | |||
--> | |||
===Item Analysis Results Table=== | |||
<table style="border-collapse: collapse; width: 100%;"> | <table style="border-collapse: collapse; width: 100%;"> | ||
<tr> | <tr> | ||
<th style="border: 1px solid black; padding: 8px;" width="25%"> | <th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="25%">Category</th> | ||
<th style="border: 1px solid black; padding: 8px;" width="25%"> | <th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="25%">Tally</th> | ||
<th style="border: 1px solid black; padding: 8px;" width=" | <th style="border: 1px solid black; padding: 8px;background-color: #E0FFFF;" width="50%">Action</th> | ||
< | |||
</tr> | |||
<tr> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Questions with 100% correct</td> | |||
<td style="border: 1px solid black; padding: 8px;"> </td> | |||
<td style="border: 1px solid black; padding: 8px;">Suggest maximum of 10% of exam, over 10% suggest review/revision, includes mastery questions</td> | |||
</tr> | |||
<tr> | |||
<td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Items adjusted</td> | |||
<td style="border: 1px solid black; padding: 8px;"> </td> | |||
<td style="border: 1px solid black; padding: 8px;">Rationale</td> | |||
</tr> | </tr> | ||
<tr> | <tr> | ||
<td style="border: 1px solid black; padding: 8px;"> | <td style="border: 1px solid black; padding: 8px;background-color: lightgray;">Next Generation NCLEX</td> | ||
<td style="border: 1px solid black; padding: 8px;"> | <td style="border: 1px solid black; padding: 8px;"> </td> | ||
<td style="border: 1px solid black; padding: 8px;"> | <td style="border: 1px solid black; padding: 8px;">Rationale</td> | ||
</tr> | </tr> | ||
</table> | </table> | ||
Latest revision as of 10:41, August 19, 2026
| Home | Faculty Policies |
| UNIVERSITY OF NEBRASKA MEDICAL CENTER COLLEGE OF NURSING |
||
| Undergraduate Test Construction and Delivery | Policy: 1310 (5.2.38) | |
| Faculty Policies | Originating Date: May 2018 | |
| Responsible Reviewing Agency: Undergraduate Affairs Committee Responsible Approving Agency: General Faculty Organization Related Documents: Policy 2216 - Undergraduate Progression Policy 2227 - Undergraduate Testing UNMC Accommodation Policy (ADA Policy) National Council of State Boards of Nursing (NCSBN) |
|
|
Purpose
Establishes criteria for testing construction and delivery.
Scope
This policy applies to undergraduate faculty.
Policy
Testing processes have been established to ensure consistency in testing practices for didactic course content.
Exam Construction
- Test/exams are defined as 50 or more questions that evaluate the application of content from this course and previous coursework to patient situations. Each didactic course will give a minimum of 2 tests/exams. Nurse in Professional Practice I: Intro to Nursing, Nurse in Professional Practice II: Evidence-Based Practice and Leadership in Nursing, Nurse in Professional Practice III: Policy and Issues in Healthcare Delivery and Population-Centered Care I are exempt from this exam requirement.
- The Cross-campus Course Coordinator group shall be responsible for ensuring the consistency of Test/exams across all divisions. This includes the determination of the number of exams per semester, total question count, and number of items per concept/exemplar and whether to include lab values within the question stem.
- Number of exams and total question count will be included in the course syllabus
- The Cross-Campus Course Coordinator group will create a faculty exam blueprint for each exam per course.
- The blueprint will include the number and types of questions per concept, exemplar and level of assessment using Blooms Taxonomy
- The number of comprehensive questions will not exceed more than 10% of the unit exam
- Category tags in the categories of concept, exemplar, Blooms level and NCLEX Category shall be entered in the exam software so that student strengths and opportunities reports can be generated. This tagging information will also be used to map curricular gaps and demonstrate areas of opportunity.
- Faculty will create and post a student exam blueprint indicating the concepts and number of questions per concept to be shared with students at least one week before the exam.
- Exam questions shall be peer reviewed for content applicability, spelling and grammatical errors, and appropriate distractors/responses.
- All questions shall mirror NCLEX style questions (e.g., no true/false, negative worded questions, avoid always/never responses).
- Exam questions should include a client scenario. The word client will be used in place of patient for all questions.
- Italics and all caps will not be used.
- Only words identified by the NCSBN will be bolded.
- For each exam item, a rationale shall be provided.
- Exam questions shall be retired after 5 years of use, or if exam statistics analysis does not support continued use of the question.
- Faculty will include a minimum of 10% to a maximum of 20% Next Generation NCLEX style questions (See NSCBN)
- When available in the exam testing platform, exam questions will be scored using +/- scoring. If +/- scoring is not available for the type of question, then partial credit scoring is to be used.
- By PCC III, students will be introduced to one Next Generation NCLEX Case Study style exam question with 3 to 6 parts.
- PCC IV will have one Next Generation NCLEX Case Study style exam question per exam with 3 to 6 parts.
- Time allotted for each item will be 1.5 minutes for all question types
- Extra credit or bonus items are not allowed.
- Randomized responses and/or question order are encouraged.
- Questions shall not include “slang”, prejudicial statements, biases, or stereotyping.
- Highlighting is not allowed for exam questions.
Pre-Exam
- Exams will be posted one business day prior to the scheduled exam time so students can download the exam prior to the testing time
- Course Coordinator will provide proctor with exam details including the password and universal resume code in case of technical issues.
- Course Coordinator will arrange for any needed supplies during the exam (e.g., calculators, scratch paper, writing utensils, UNMC devices for testing).
Proctoring
- Proctors must complete UNMC CON Proctor training prior to proctoring any exams.
- Proctors must read the UNMC CON uniform Proctor Statement before each exam and complete pre-exam checks (ex. Personal items stowed, scratch paper blank and visible; testing area clean and secure).
- Proctors shall enforce restrictions on items in the testing room. (See the student section for example.)
- Proctors will respond to technical issues but will not answer questions related to exam content.
- There shall be more than one proctor in the main testing room, or an alternate support person available on campus.
- Faculty/proctors shall verify the number of students taking the exam on all testing sites.
- Proctors shall check for exam submission via a confirmation screen prior to students leaving the testing site.
- For ATI proctored exams, faculty must follow ATI requirements.
Exam Delivery
The University of Nebraska College of Nursing prepares students in a similar testing environment and style as the current licensure testing (NCLEX). Exams are computer based with no backward navigation enabled. This is a strategy for student success.
- Unit and final exams are proctored and administered in a secure environment.
- Unit and final exams will be given using the UNMC specified exam/evaluation software. Quizzes (e.g., iRAT, gRAT, med math) are exempt from this requirement.
- Exams will be taken on either a student’s device, a UNMC College of Nursing issued device, or at a campus testing site. Student requirements for pre-exam preparation are proscribed in Policy 2227 - Undergraduate Testing.
- Students who are not able to take the exam as scheduled are expected to notify the course coordinator as soon as possible prior to the scheduled start time for the exam.
- Exams start on time and students are expected to be present.
- Students who arrive more than 5 minutes late will need to work with the course faculty to either reschedule or complete the exam.
- Students who begin the exam after the start time will need to complete the exam at the same time as the rest of the class who began on time, unless otherwise determined by the course faculty.
- If students experience an urgent issue (e.g., technical issues or illness) during the exam, they are required to notify the exam proctor immediately.
- Students who are unable to complete the exam once started will be required to make-up/retake the exam and may be given an alternate format exam.
- Students can leave the exam room during the exam only with proctor permission.
- Students are required to upload their exam file upon completing the exam and prior to leaving the exam room. Exams not uploaded may receive a zero for that exam.
- Incorrect exam responses are shared with students via the review option in the exam/evaluation software immediately following the exam.
- If a passing score is not achieved, students will be required to meet with course faculty to review incorrect exam responses.
- Students have the right to seek clarification about exam items and must contact faculty within 72 hours after the completion of the exam.
- Make-up exams will be scheduled by the course coordinator and will follow the guidelines published in the course syllabus.
- If a student misses more than two scheduled exams per course without provider documentation, the student will be subject to an alternate format exam for all make-ups and a required meeting with course faculty.
- If more than 10% of the class fails to take the exam on time, exam grade posting will be delayed until more than 90% of the class has taken the exam.
- An alternate exam format may include essay, short answer, and multiple choice. The test/exam shall be worth the same number of points as the original.
- The date and time for a make-up exam will be determined by the course coordinator/instructor. See CON Policy 2216 - Undergraduate Progression.
- Students are only allowed items needed for testing at their computer. See Students policy 2227 for specific examples. Faculty reserve the right to inspect any items that are at the testing location with the student.
- Needed testing items necessary for testing will be provided by CON personnel.
- Scratch paper provided by the proctor and used during the exam is not an official document and will not be considered in determining a student’s exam grade. Proctors will collect all scratch paper and dispose of appropriately.
- Unit and final exams and exam questions are to remain in the testing environment.
- Device attachments (i.e., chargers) can be used only for the sole purpose of completing the exam.
- No excessive attire is allowed during testing. Students must submit a written request for an attire exception to the assistant dean on the student’s division. Written documentation of the approved exception must be shared by the student with CON personnel as needed.
- Needed testing items necessary for testing will be provided by CON personnel.
Accommodations
- Students are required to adhere to the Accommodation Policy (ADA Policy) that is listed in the UNMC Student Policies and Procedures (see policy in related documents).
- Students with accommodations must present their official letter of accommodations from the UNMC Accessibility Services Office to each new course coordinator for each semester.
- The accommodation letter should be submitted a minimum of two weeks prior to any exam for which accommodations are requested.
- Faculty will prepare only the accommodation materials and resources as specified in student letter.
- Faculty will work with On-line Testing Coordinator and any other personnel needed to facilitate testing accommodations for students (e.g., low distraction room, additional testing time).
- On campuses that use affiliated university testing services, complete the accommodated testing form.
- Students testing via a paper copy will use a specified excel form to record exam answers. Once the exam is completed, the student will transfer the exam answers to the exam software, or the excel form data will be uploaded into the exam software by College of Nursing personnel. Transferring of the exam answers is not included in the allotted exam time.
Post-Exam
- Course Coordinator/ Faculty will review the exam statistics, determine any scoring adjustments needed, and make any adjustments to the exam in the exam/evaluation software.
- Course coordinator will strive to keep exam KR-20 value between 0.50 and 0.85. Any value outside of this range requires immediate attention before the exam is redeployed. Examples of appropriate actions to take in this situation would be meeting with BSN Director or representative from the CON Testing Taskforce to discuss mandatory changes or revisions to the exam questions. (See Exam Review Table below)
- During the review immediately following the exam, students are allocated a limited time to review missed questions. The review time is calculated as total questions divided by 10.
- A “truncated” strengths and opportunities category performance report (no test questions) from the testing platform may be provided to students upon request.
- Students are allowed to review an exam one time individually with the course instructor or coordinator outside of the immediate exam review.
- For courses that are taught cross-campus, when the course instructor is not located on their campus, students may review the exam with the assigned exam staff or faculty.
- Exam reviews can be conducted online or via Zoom if monitored by another proctor in person.
- Course Coordinator will transfer all exam grades to the learning management system from the exam/evaluation software within 72 hours.
Exam Review Table
| Average Score: | Low Score: | High Score: | KR20: |
|---|---|---|---|
| Item Difficulty (ρ value) | Point Biserial (PBCC) < 0.10 | Point Biserial (PBCC) 0.10-0.29 | Point Biserial (PBCC) > 0.30 |
| 90-99% Easy |
Poor discrimination, deemed “easy”, suggest review/revision | Fair discrimination, may deem “easy”, may review/revise | Keep, good discrimination |
| 50-90% Average |
Poor discrimination, average difficulty, may review/revise | Fair discrimination, average difficulty, may review/revise | Keep, good discrimination |
| 30-50% Slightly Difficult |
Add PBCC to ρ value, if <0.6 suggest review/revision | Add PBCC to ρ value, if 0.6 – 0.8 may review/revise | Add PBCC to ρ value, if >0.8, keep, good discrimination |
| < 30% Difficult |
Poor discrimination, highly suggest review/revision | Fair discrimination, suggest review/revision | Good discrimination, may be too difficult, suggest review/revise |
Key
| Start revisions here, items with highest need, priority items | ||
| Second area of need, revisions here if no items in orange boxes | ||
| These items are valid and reliable, no revisions required |
Item Analysis Results Table
| Category | Tally | Action |
|---|---|---|
| Questions with 100% correct | Suggest maximum of 10% of exam, over 10% suggest review/revision, includes mastery questions | |
| Items adjusted | Rationale | |
| Next Generation NCLEX | Rationale |