Creating Exam Assessments

Objectives

After completing this lesson, you will be able to:
  • Create an objective
  • Create an exam assessment
  • Associate exam assessment to an item

Exam Assessment Creation Process

Creating an exam assessment is crucial for managing educational content, and it consists of three phases: Creating objectives and questions, Building the exam, and Associating the exam with an item.

The steps in the Exam Assessment Creation Process are shown.

Note

It is always a best practice to search for something in the system before adding it. This will help you avoid creating duplicates.

Phase I: Creating Objectives and Questions

Create Objectives

Objectives are clear statements that outline what learners should achieve after completing their training. They help define the knowledge and skills needed to answer questions correctly. You can create objectives before adding questions to the Question Library or at any point afterward. Once created, you can associate these objectives with specific questions, allowing you to group related questions together.

Once you have added the objective to the exam, you can set the point value for each question, determine how many questions to include from the objective, and specify the passing percentage for that objective. Randomization works effectively if there are more questions in the objective than the number selected for the exam. For instance, if an objective contains 50 questions, you can include it in the exam and randomly select 25 of those questions.

When creating objectives, it is recommended to use action verbs, such as: define, describe, list, or create. This makes your objectives clear and measurable, guiding learners toward their goals effectively.

Steps to create an objective:

  1. Navigate to Learning AdministrationContentObjectives.
  2. Select Add New.
  3. Fill in required field in the Add New window.
  4. Select the Online checkbox if you want to associate an objective with an online item.

Online checkbox is highlighted. Checkbox needs to be selected to associate an objective with an online item.

Create Questions in the Question Library

The Question Library allows you to create and associate questions with an exam assessment. The questions created in the Question Library have a unique ID and can be reused in multiple exams.

Steps to Create Questions in the Question Library:

  1. Navigate to Learning AdministrationContentQuestion LibraryAdd New.
  2. Complete the required fields:
    • Question Type: This field determines how users select answers by choosing one of the available question types:
      • True/False: Users select one of the two possible answers of True or False.
      • Single Answer (also known as Multiple Choice/Single Answer -- MCSA): Users select one of a list of possible answers as the only correct answer to the question.
      • Multiple Answer (also known as Multiple Choice/Multiple Answer -- MCMA): Users select one or more answers from a list of possible answers. Users receive credit only when all correct answer choices are selected.
      • Ordering (also known as an Ordered List): Users move answers around until they are all listed in the correct order using drag and drop.
      • Fill-in-the-blank: Users type in the correct answer that should be entered in place of the blank indicated in the question. Alternate answers can be created and subsequently accepted for this question type. Only one blank is allowed per question.
    • Points field: Enter a number to assign a relative value to each question based on a scoring system. Points can be assigned directly to questions without rounding.

      By default, individual question variants are assigned a point value of 1, while the objectives of questions have a value of 5. You can edit these values directly in the Question Library or modify them within the Assessment entity.

    • Objective field: In this section, you can link a question to a specific objective. By connecting questions to objectives, you can gain better insights into how effectively users are mastering those objectives. Additionally, by incorporating multiple objectives, we can randomize the exam experience for each user, ensuring that different users encounter varying questions from each objective.
    The five question types are highlighted in the Create Question window.
  3. Configure the question by configuring the following functionalities:
    • Randomize Answers: By default, the randomization button is enabled. If you want the answers to always appear in the specific order you entered them, ensure the Randomize Answers slider is not set. It is also necessary to turn this off if you are using answer choices such as All of the above when you want it to appear as the last answer all the time.
    • Add Variant: Use the plus icon to add variants to a question. A question variant is a different way to ask the same questions. Each question can have multiple variants of different question types.
    • Variant Dropdown: When you first create a question, the system adds it as Variant 1. The Variant dropdown contains all variants of a question. To edit a variant, from the dropdown, select the desired variant.
      • All variants share the same question ID. Only one variant of a question will appear to the same user on the same exam.
    • Question Settings: Select the settings icon to edit the description, security domain, point value, or associated objective.

The four functionalities: a, b, c, d that need to be configured are highlighted on the screen to show their location.

Create a New Objective

Business Example

In this exercise, you will create a new objective.

Steps

  1. Navigate to ContentObjectivesAdd New.

  2. Enter a name for the objective in the Objective Name field. For example, enter Your Initials - Objective 1.

  3. Enter a description in the Description field. For example, Your Initials - SF Learning Objectives.

  4. Add Security Domain.

  5. Ensure the Active checkbox is selected.

  6. Select the Online checkbox.

  7. Review your entries and choose Add. The objective is added and saved and you are taken to the Summary tab of the objective entity.

    Note

    The Objective ID is auto generated by the system and cannot be changed.

  8. Note down the ID of the objective you have created.

Create a New Question in the Question Library

Business Example

In this exercise, you will create a new question in the Question Library to be used in one or more exam assessments. You will first create the question record, and then configure the questions and answers.

Task 1: Creating the Question Record

Steps

  1. Log in to the Administrator interface of SAP SuccessFactors Learning and navigate to ContentQuestion LibraryAdd New.

  2. Enter a unique ID for the question in the Question ID field. For example, enter Your Initials - Question 1. Avoid using special characters in the Question ID field.

  3. Select a question type from the Question Type drop-down menu. For example, Single Answer.

  4. Select a point value and Locale (or leave the default values of 1.00 and English).

  5. Enter a description for the question (that Administrators will see). For example, enter Your Initials - SuccessFactors Learning Question.

  6. Save the question into a specific Security Domain.

  7. Search for an objective to associate with this question.

  8. Review your selections and entries.

  9. Choose the Create button. You will not be able to change the Question ID once the question has been created.

Task 2: Configuring the Questions and Answers

Steps

  1. Choose the Question box and enter the question text. For example, enter Which of the following can be directly assigned to the user?

  2. Use the formatting tools from the toolbar to edit your question text or include links or images.

  3. Choose each of the answers boxes and create the following answers:

    1. A content object
    2. A content package
    3. An exam object
    4. An item
  4. Select the radio button next to the answer An item to mark the correct answer.

  5. Choose the gear icon to open the Question Settings window.

  6. Search for an objective to associate to this question.

  7. Choose Save.

  8. Set the Available slider to the right to make the question available for an exam assessment.

  9. Choose Preview Question to see how the users will see this question. You can also preview the entire exam assessment by navigating to MenuExam Overview.

  10. Confirm that the question appears the way you want it to, note the Question ID, and choose Exit.

Phase II: Building the Exam Assessment

Create an Exam Assessment Record

An exam consists of questions that are displayed to users when they launch a learning activity from their Learning Plan. All exams are graded, and the score can be retrieved from the administrator side with the reporting tools or by drilling into the object details of the item.

To create an exam assessment, navigate to Learning AdministrationContentAssessmentsAdd NewAdd New Exam and fill in the required fields.

Add new exam window is opened to show the required fields that need to be filled out.

Add Questions to the Exam

Once you have created the Exam Record, on the next screen, you will add the exam questions.

From the Menu dropdown, select the Questions option.

Questions option from the Menu dropdown is highlighted.

There are two ways to add questions:

  1. Add New Question: Select one question type (true/false, multiple-choice) to create a new question directly on the exam. Questions created directly on the exam become available automatically in the Question Library, and they can be reused in multiple exams.
  2. Add Existing: Search for and add questions from a pool previously created in the Question Library. You can also add objective to an exam.

In addition, you can add existing objectives that you previously created. After adding an objective to the exam, you can adjust the availability of the questions. This allows you to specify whether a particular question is always selected, never selected, or randomly selected for exams.

Add new Questions and existing Question and Objective to an Exam options are highlighted.

Once you have added questions you can use the left Navigation menu and the Variant dropdown to toggle between the questions and possible variants and make edits if needed.

Left menu navigation and Variant dropdown field are highlighted.

Configure Exam Settings

Exam assessment settings control how users interact with the assessment. You can configure various exam settings from MenuSettingsGlobal Settings.

Global Settings are divided into four large areas:

  • General: When Active is set to YES, the exam is available for assignment to online items, for reports, and for revision.
  • Exam Behavior: Several settings can be configured, including the choice to make the exam sequential or free-form, limiting the number of attempts students can take, and setting the time duration. Note that timed exams are only available if the Resumable option is set to No. The duration you set here will serve as the default when the exam assessment is included in an item, but it can be edited at the item level.
  • Proctor Settings: When you check this box, the instructor must enter a proctor code for a student to begin the exam. However, previewing an exam that has proctoring enabled does not require a legitimate code. The best way to test this functionality is by adding the assessment to an item and assigning it to your test user.
  • Post Exam Behavior: Multiple settings can be configured here, including results, reviews, and passing percentages. Administrators have the option to lock the exam or to lock and exit an item once the exam is passed or failed. Additionally, objective flags can be set or cleared based on whether the exam is completed successfully or not.

The four global exam settings are highlighted to show their location on the screen.

The Localized Settings tab enables the administrator to modify the exam name, description, and the messages displayed to users. Administrators can create messages that appear before and after users complete the exam. Additionally, there is an option to include a specific message for Proctored Exams.

Localized Settings tab is selected. The General and Messages fields are displayed.

Create an Exam Assessment

Business Example

In this exercise, you will create a new exam assessment. You will first create an exam record, then add questions to the exam, and configure the exam settings.

Task 1: Create an Exam Record

Steps

  1. Navigate to ContentAssessmentsAdd NewAdd New Exam.

  2. Enter a unique ID for the Exam in the Exam ID field. For example, enter Your Initials - Exam 1.

  3. Enter a name for the exam in the Exam Name field. For example, enter Your Initials - SuccessFactors Learning Exam.

  4. Enter a description for the exam in the Description field. For example, enter This is a basic exam with questions on standard LMS features.

  5. Save the exam into a specific Security Domain.

  6. Set the Active slider to YES to make the exam active.

  7. Review the information you have entered. You will not be able to change the Exam ID once the exam has been created.

  8. Select Create to create the exam.

Task 2: Add Questions to the Exam

Steps

  1. Navigate to MenuQuestions.

  2. Choose the Question tile in the Add Existing section.

  3. Search for the question that you previously created and add it to the exam assessment.

  4. Customize your question by modifying the question and adding or removing answers.

  5. Choose Save.

  6. Choose the Add Variant icon to add an additional variant to an existing question.

  7. Choose Save.

Task 3: Configure Exam Settings

Steps

  1. Choose MenuSettings to view and adjust exam settings.

  2. Choose Save.

  3. Select MenuQuestions to return to the Question Details screen.

Phase III: Associating the Exam Assessment to an Item

Add Exam to an Item

Once an exam assessment has been created, you can add an exam to a new or existing Online item or Instructor-Led item with Online Content. If the existing item has already been completed by users, you may need to revise the item first and then add the assessment to the new revision.

These are the steps to add an exam assessment to an existing item:

  1. Select the Online Content tab within the item entity.
  2. Choose the Add Content Object dropdown and select Add Assessment.
  3. Search and select the exam assessment and give it a title.
  4. Save your work.

If the item has been assigned to a user, you will get a pop-up message informing you that users will be re-assigned the item, and their progress will be lost. You can opt out, ensuring that users assigned the item retain their progress, but they will not have access to the exam.

Define Online Content Settings for the Item

To configure the Online Content settings, select the gear icon on the Online Content tab of the item. The settings are organized into three tabs: Launch, Course Progression, and Completion. Each tab offers various settings, including the following key options:

  • Launch tab: You can enable Content is available for launch.
  • Course Progression tab: You can customize the exam duration.
  • Completion tab: You can activate Add to History on Completion of All Content.

Launch, Course Progression, and Completion tabs on the Online Content Settings page are highlighted.

Add an Exam Assessment to an Existing Item

Business Example

In this exercise, you will add an exam assessment to an existing Item and assign the item to a user.

Task 1: Adding Exam Assessment to an existing item

Steps

  1. Navigate to Learning ActivitiesItems.

  2. Search for and open the item in edit mode.

  3. Select Online Content tab.

  4. Choose Add Content Object dropdown and select Add Assessment.

  5. Search for and select the exam you wish to add to the item.

  6. Enter an Assessment title. This is visible to the users in the content structure of the online item. Enter Your Initials - SuccessFactors LMS Final Exam.

  7. Choose OK.

  8. Choose the gear icon.

  9. On the Launch tab, enable the Lock Other Content When in Progress.

  10. On the Completion tab:

    1. Set the slider for Users can Review Completed Content from History to ON so that users can see the exam results and specific results per question from their learning history.
    2. Select a status from the Completion Status dropdown.
    3. Select the Add to History on Pass checkbox. If they pass the exam, the item will be recorded in the user’s learning history as successful completion.
    4. Select the Add to History on Failure checkbox. If they fail the exam, the item will be recorded in the user’s learning history as an unsuccessful completion.
    5. Select a Failure Status value from the dropdown.
  11. Choose OK.

  12. Choose Save. The exam is now added to the item.

Task 2: Assigning Item to a User

Steps

  1. Choose Assign from the Actions menu of the Item.

  2. Choose Add to add the user to the list at the bottom of the Manage Assignments window.

  3. Confirm the user is in the list under Edit Users and then choose Next.

  4. On the next screen, choose Next.

  5. Select an Assignment Type and choose Next.

  6. Enter today’s date as the Required Date.

  7. Choose Run Job Now.

  8. Choose OK.

  9. Log on to the user interface, launch the item, and test the exam. Log on to the user interface, launch the item, and test the exam.

    Note

    You will need to log on as this user as you cannot use administrator proxy to test online content.

Log in to track your progress & complete quizzes