Assessment Package Items - FY22
Jump to navigation
Jump to search
Release 14.7 - 9/23/2022
- Created the ability to structure an assessment package or assessment package template to include multiple hurdles. This feature allows applicants to complete multiple assessments in a progressive hurdle approach based on agency business necessity. Only applicants meeting the established scoring criteria on the assessment(s) in one hurdle are eligible to proceed to the assessment(s) in the next hurdle.
- Assessment Plan: The
button at the top left of the Assessment Plan page expands the Hurdles section, where the user can create each of the additional hurdles needed, up to a maximum total of five hurdles. Hurdle 1 can contain any kind of assessments (Questionnaire, USA Hire, and/or Manual). Hurdles 2-5 can only contain Manual assessments at this time.
- Assessment Plan: The
See: Assessment Plan
- Hurdle Criteria: The Hurdle Criteria page will appear if more than one hurdle is present in the Assessment Plan. Users can set the cutpoint values that will be used to determine which applicants move forward based on the results they received on the assessments contained within the previous hurdle. The Hurdle Score Cutpoint values can be set for each rating combination on the 70-100 scale with up to 2 decimal points. Applicants who meet the Hurdle Score Cutpoint will be able to proceed to the next hurdle, while those who are qualified but didn’t score high enough to meet the Hurdle Score Cutpoint will be automatically assigned the NF notification message code:
- NF - You are tentatively eligible for this series/grade combination. However, based on the results of the assessment(s) completed so far and the needs of the hiring agency, you are not being moved to the next phase of the hiring process at this time.
For each hurdle that has assessments used for rating applicants, the Used for Final Rating checkbox can be enabled so that the applicants' scores will be factored into their final score. If more than one hurdle is used for final rating, then proportional weights can be assigned to each one (default is to have equal weights).
See: Assessment Package Hurdle Criteria
- Hurdle Settings: When more than one hurdle is present in the Assessment Plan, the Settings page will display a Hurdle Settings section. By default, the Hurdle Settings will have the Apply veterans’ preference to hurdles option selected, as well as the two settings enabled for:
- Add veterans’ preference points to determine if the hurdle cutpoint is met – This setting is automatically enabled and cannot be disabled if you’re applying veterans’ preference to hurdles.
- “Float” eligible CP/CPS veterans to the next hurdle regardless of their score – This setting can be set by rating combination since CP/CPS veterans do not “float” for professional and scientific positions at the GS-9 or higher (like category rating procedures).
If the announcement will not be recruited through Delegated Examining (e.g., merit promotion, direct hire, etc.), the option for Do not apply veterans’ preference to hurdles may be selected. Doing so will also automatically turn off the two other settings for adding veterans’ preference points or floating CP/CPS veterans.
See: Assessment Package Settings
- Applicants missing ratings for a Manual assessment that is used for Screen-out only will be placed in PA status to help users differentiate between those who have/haven't yet received a minimum qualifications rating for that assessment.
Release 14.6 - 8/26/2022
- Made the Assessment Method Details drop-down for a Manual assessment a required field for all assessment methods to improve reporting data.
See: Assessment Information and Creating a manual assessment
Release 14.5 - 8/3/2022
- Added a Standardized indicator to the Assessment Information page of an Assessment Questionnaire that will appear in line with the Rating toggle when scores will be standardized because of multiple rated assessments being used to determine applicant final scores (e.g., having an Assessment Questionnaire plus USA Hire).
Release 14.4 - 7/1/2022
- Updated the system logic to ensure that when Categories are present on the Assessment Package Settings page, changing the Vacancy Position Information settings for the USAJOBS Announcement Type to remove the Public (U.S. Citizens and Non-Citizens) option will no longer update the Categories from Final Score Cutpoint to None.
See: Assessment Package Settings
Release 14.2 - 5/6/2022
Assessment Package
- Made usability improvements to the Screen-out Criteria page within an assessment to provide more clear and consistent messaging and instructions to HR users.
See: Screen-Out Criteria
- Added the ability to set a Passing Score for Manual assessments used for rating:
- This option can be edited by HR users who have the Apply Passing Score permission. When enabled, the passing score can be set for each rating combination on the Passing Score Criteria page. Note: Passing scores should be established through a rigorous process involving job experts (subject matter experts) and assessment experts (e.g., I/O psychologists). The process involves identification of the minimum level of proficiency for required competencies for a specific position or job series and grade, and the minimum score necessary on the assessment to demonstrate the minimum required proficiency.
- When using a Passing Score for a Manual assessment, USA Staffing will automatically determine if the applicant’s assessment rating falls above or below the passing score when the assessment results are key entered into the applicant’s Rating Details or imported in a Saved List as follows:
- If the score is at or above the passing score, the assessment transmuted rating will be calculated using the passing score as the minimum value for the calculation. If a NOR code is entered, it will be applied to the assessment’s minimum qualifications; otherwise, if there is no NOR code entered, the assessment minimum qualifications will default to ELTE.
- If the score is below the passing score and there is no NOR code entered, the manual assessment minimum qualifications will default to IQMA. If another ineligible NOR code is entered, it will be applied.
- If the score is at or above the passing score and the HR User entered IQMA as the NOR code, the following error message will be displayed: "The minimum qualifications rating cannot be IQMA for a raw score at or above the minimum passing score for application: [Applicant Name]."
- If the score is below the passing score and the HR User entered an eligible NOR code, the following error message will be displayed: "The minimum qualifications rating cannot be eligible for a raw score below the minimum passing score for application: [Applicant Name]."
Release 14.1 - 4/8/2022
Assessment Package
- Updated the name of the Assign Categories based on 'GS-9+ Professional/Scientific' rules setting to Do not "float" eligible CP/CPS veterans when assigning Categories on the Settings page within an Assessment Package or Assessment Package Template.
See: Assessment Package Settings
Release 13.9 - 2/11/2022
Assessment Questionnaire
- Added the following warning banner message when reassigning an item to another competency: "Changing the linked competency for an item with custom response base values will clear out those values. You will need to add them again on the Rating Criteria page." Users will be able to proceed and save their changes if appropriate.
See: Reviewing competency rating criteria
- Made several usability improvements to the AQ checklist validations to better inform users of any necessary edits including:
- Added a validation that checks if every Multiple Choice - Single Select item has at least one response with a 0 value.
- Added a validation that checks if every question with the Screen-out indicator enabled has been tied to at least one Screen-out Criteria.
- Added a validation that checks if at least one competency is marked as a Screen-out per rating combination on the Rating Criteria page when the AQ uses the Job Element rating method.
See: Assessment Checklist
- Added the following fields to the Manual Assessment Type:
- Assessment Method – This field is required and allows users to select one of the following options:
- Online/Paper-Pencil Assessment
- Panel Review
- Interview
- Simulation
- Other
- Assessment Method Details – This field is optional and allows users to select multiple options listed as applicable. The options listed will vary depending on the Assessment Method indicated:
- Online/Paper-Pencil Assessment
- Biodata
- Job Knowledge
- Personality/Non-Cognitive
- Cognitive Ability/Reasoning
- Situational Judgment
- Panel Review
- Accomplishment Record
- Crediting Plan
- Reference Check
- Resume Review
- Work Product Sample
- Writing Sample
- Interview
- Job Compatibility Interview
- Structured Interview
- Technical Interview
- Simulation
- Assessment Center
- Job Simulation Exercise
- Other
- Required text entry box with a 50-character limit.
- Online/Paper-Pencil Assessment
- Assessment Rating Settings – This section now includes the Standardize scores and Standardize using custom values toggles and replaces the min/max fields for raw scores and z-scores with a table that allows this information to be viewed and edited for each rating combination listed.
- Assessment Method – This field is required and allows users to select one of the following options:
See: Assessment Information and Creating a manual assessment
Release 13.8 - 1/14/2022
Assessment Questionnaire
- The system will allow users to click a checkbox in the Add Questionnaire Item pop-up that will select all of an item's responses. This will allow users to delete multiple responses at once.
See: Adding an item to an assessment questionnaire
Release 13.7 - 12/17/2021
Assessment Questionnaire
- Completed the following usability improvements on the Item Weights pop-up window on the Rating Criteria page within an Assessment Package and Assessment Package Template:
- Removed the sort capability from all headers.
- Added specialties in parentheses next to each rating combination in the Rating Criteria page, if applicable.
- Added a Response Type column between the Item Stem and Rated columns.
- Replaced the Apply to all Rating Combinations checkbox with a button.
- A warning banner is displayed to inform users if they have unsaved changes when an item's proportional weight or a response item's base value is adjusted either manually or by clicking the Apply to all Rating Combinations button.
- The following confirmation message is displayed when an HR User clicks the Apply to all Rating Combinations button to override an item's proportional weight, individual response base values, and/or rated checkbox indicator across all rating combinations: "This item's rated status, proportional weight, and response values have been applied to all other rating combinations. You must click Save to retain these changes."
See: Item Weights
Release 13.6 - 11/19/2021
Assessment Questionnaire
- Updated the Passing Score Criteria page when building an assessment questionnaire using the Job Element rating method in either an Assessment Package or Assessment Package Template.
- The Raw Score Range column will display 0 for the minimum value in the raw score range (e.g., 0-16) to display the full raw score range that an applicant could potentially receive.
- The Passing Score column will display the minimum raw score applicants must obtain to be eligible under the job element rating method (i.e., Two times the number of rated competencies for that rating combinations).
- Note: This page will be inactive for edits since the job element rating method has fixed passing criteria.
- For cases using a passing score, updated the Test Plan page and Edit Test Scenario pop up window to display the raw score in parenthesis for scenarios that result in the applicant being screened out (as it does for scenarios in which the applicant meets the passing score).
See: Test Plan
Release 13.5 - 10/22/2021
Assessment Questionnaire
- Added a Passing Score setting for Assessment Questionnaires that use the Weight-Based Rating Method. This option can be enabled by HR users who have the Apply Passing Score permission, which was added to HR user permission profiles in a prior release (this permission is disabled by default for all USA Staffing users except Office Administrators). Note: Passing scores should be established through a rigorous process involving job experts (subject matter experts) and assessment experts (e.g., I/O psychologists). The process involves identification of the minimum level of proficiency for required competencies for a specific position or job series and grade, and the minimum score necessary on the Assessment Questionnaire items to demonstrate the minimum required proficiency.
- Added a Passing Score Criteria page to Assessment Questionnaires created within an Assessment Package or Assessment Package Template. This page displays the Series, Grade, Specialty, Raw Score (range), and Passing Score requirement for each rating combination.
- When the Passing Score setting is disabled, the Passing Score Criteria page will not be editable.
- When the Passing Score setting is enabled, HR users with the Apply Passing Score permission will be able to set a passing score requirement for each rating combination. The passing score must be within the raw score range and will establish the threshold (on a raw score basis) that applicants must reach to pass the assessment. Applicants who score above the passing score will be considered eligible and receive transmuted scores between 70 and 100. Applicants who fall below the passing score will receive an ineligible rating with a NOR code of IQAQ - You are ineligible to proceed in the hiring process because you did not attain the overall passing score on the application questionnaire for the position.