Creating Training Surveys

Objective

After completing this lesson, you will be able to create a survey.

Rating Scale Configuration

Before creating a survey, configure the rating scales you will use in the survey questions. It is recommended to use the same rating scale for most questions in course feedback and follow-up evaluation surveys to obtain consistent metrics. The course feedback reports will provide averages for each survey page and individual averages for instructors and items. If needed, different rating scales can be used for different types of surveys. For example, a five-point scale can be used for item evaluation surveys, while a frequency scale can be used for follow-up evaluation surveys.

Sample five point rating scale is displayed.

Rating scales can be customized by navigating to Learning AdministrationReferencesSystem AdministrationRating Scales.

When creating rating scales, be sure to put the most desirable or preferred outcome with the highest number in the scale and the least desirable choice with the number 1. Do not include N/A in your rating scales as the system will automatically include N/A for each rating scale question when the user is selecting their choice.

Create Survey Entity

You can create and structure survey entities with multiple pages and multiple questions per page for better organization. Surveys are defined as objects in the system and cannot be independently assigned. To start a survey, it must be linked to an assignable unit, such as an item.

Follow these steps to create a survey:

Steps

  1. Navigate to Learning AdministrationContentSurveysAdd New.

  2. Enter a Survey ID.

  3. Enter a Survey name.

  4. Select a Survey type.

  5. Enter comments (if needed).

  6. Select the Security Domain.

  7. Check the Active checkbox.

  8. Choose Add.

Result

A survey entity is created.

Survey entity fields are highlighted. These fields need to be filled out to create the survey.

Question Creation

Once the survey entity is created, go to the Questions Tab to create the questions.

Questions can be organized in multiple pages or you may choose a simple one page format. Multiple pages are useful to segregate evaluations for different resources.

The figure below shows a one-page survey. Add questions to this page by selecting the Add Question icon.

Add Question icon is highlighted on the page.

Question Types

After selecting the Add Question icon, you will be presented with four question types:

  • Rating Scale: Use the question type of rating scale when you want to get quantitative results.
  • One Choice: Use this question type when you want the user to choose one correct answer from a group. Additional possible answer choices can be added by selecting the green plus icon.
  • Multiple Choice: Use this question type when you want the user to be able to choose multiple correct answers from a group. Additional possible answer choices can be added by selecting the green plus icon.
  • Open Ended: Use this question type when you want the user to type an answer (up to 3,990 characters).
Four question types are displayed in the question type dropdown.

Survey Questions

Depending on the chosen question type, you will then be prompted to enter the question stem and possible answer choices.

When you are done creating questions on Page 1, select Save Draft. Repeat this process for all pages of the survey.

Save Draft button highlighted on Page.

Survey Pages

Pages help to organize your survey questions into topics and make it possible to get mean scores per page if using rating scale questions. You can add a title and instructions for each page. Pages can be used to evaluate multiple resources that requires training evaluation. For example, there may be multiple instructors assigned to the same training. In this case, multiple pages may be used to evaluate each Instructor separately.

To add pages, select the Page icon.

Page icon is highlighted to show location on the screen.

Item Usage Tab

The Item Usage tab in the survey entity allows you to associate your survey with specific item(s). Here's what you can do in this tab:

Search and Select Items: You can search for and select the item(s) you want to associate your survey with.

View Metrics: Once an item is associated, you can view the following metrics:

  • Users Assigned: The number of users who have completed the item and been assigned to the survey.
  • Completed Surveys: The total number of completed surveys.
  • Removed Surveys: The total number of removed surveys.
  • Completion Percentage: The percentage of assigned surveys that have been completed.
  • Mean Score: The average rating across all completed surveys for that item. This is calculated only if all rating scale questions in the completed surveys use the same rating scale specified in the Rating Scale field.
Item Usage tab is selected and screen content is displayed.

Options Tab

For additional survey configuration options, select the Options tab. The available options in this tab will vary depending on the type of survey selected. Different sets of options will be presented based on the survey type chosen. Options will define how the survey behaves from the end user’s perspective.

Options tab selected and fields are displayed.

Configure Course Feedback Survey Options

There are a number of options available when the Course Feedback survey is configured.

Steps

  1. Anonymity: Select Yes if you want the survey to be anonymous. However, this option will prevent administrators from linking feedback to specific users in reports.

  2. Required Completion: Check the Required for Item Completion box if you want the survey to be mandatory. The item will remain in a pending state until the user completes and submits the survey. Once completed, the item will be moved to the user’s Learning History.

  3. Submission Deadline: Enter the number of Days to Complete to specify how long users have to submit their feedback from the assignment date.

    • If users do not complete the survey within this time frame, it will be marked as overdue.
    • Users can still open, complete, and submit the survey even after it is overdue.
  4. Comments Field: Decide whether to enable a Comments field for each question based on your preferences.

  5. Apply Changes: Select Apply Changes to save your settings.

Result

A Course Feedback survey has been configured.

Follow-up Surveys Configuration Options

Follow-up surveys should ideally be conducted three to six months after the training program. These surveys can be assigned to both the learner and their manager within a specific number of days after the completion of the training. The process is automatically triggered by an Automatic Process Manager (APM).

In the options tab, you can define the following:

  • Time Periods: Specify the duration after which the survey will be sent.
  • Participants: Choose who will receive the survey (the learner, their manager, or both).

Additionally, you can include a comments field for each survey question to gather more detailed feedback.

Options tab for follow up survey displayed.

Email Notifications Tab

You may change the standard notification emails sent when a survey is assigned by selecting the Email Notifications tab.

There are two email notification templates associated with survey functionality:

  • Questionnaire Survey Assignment Notification Email Template
  • Questionnaire Survey Assignment Notification Rollup Email Template

How Surveys are Assigned

A course feedback survey is assigned to a user upon completion of an item when a history record is added.

A follow-up survey is assigned to a user and/or the user’s manager in a configurable number of days after item completion. This process is triggered by the Course Feedback and Follow-Up Surveys Email Notification Automatic Process Manager (APM). The APM will generate email notifications to be sent to users who have been assigned either type of survey.

Optional surveys with the Required for Item Completion check disabled, will be made available to the learner directly on the Learning Home Page.

To Establish APM Settings

Navigate to Learning AdministrationSystem AdministrationAutomatic ProcessesCourse Feedback and Follow-Up Surveys Email Notification.

Like other email notification areas in SAP SuccessFactors Learning, an administrator can attach documents to notifications.

Create a Survey and Add Questions

Business Example

An online course on how to deal with customers, conflict, and confrontation has been created. You are responsible for creating the course feedback survey to be assigned to all users immediately after the course is completed. This is the general course evaluation survey to be used after every online HR course.

Your task is to create a 2 page customer feedback survey that includes four questions using one of each of the available question types. There should be two questions per page for this exercise.

Steps

  1. Create a Survey.

    1. Log in to SAP SuccessFactors HCM as a Learning Administrator and navigate to Learning Administration → Content → Surveys.

    2. Choose Add New.

    3. Enter [Your Initials]-FEEDBACK in the Survey ID field.

    4. Enter [Your Initials]-Feedback Survey in the Survey Name field.

    5. Select Course Feedback from the Survey Type dropdown.

    6. Enter Survey Description and Comments.

    7. Select the CORP Security Domain.

    8. Confirm Active checkbox is selected.

    9. Choose Add.

  2. Add questions a survey page.

    1. Select the Questions tab.

    2. Enter instructions for the first page.

    3. Enter Classroom Conditions in the Title field of the first page.

    4. Enter We value your input and strive to provide the best learning environment possible. Please take a moment to share your feedback on classroom conditions in the Survey Instructions field.

    5. Choose the Add Question icon.

    6. Enter How would you rate the overall physical comfort of the classroom (e.g., seating, space, temperature)? in the question stem.

    7. Select Rating Scale in the Question Type dropdown.

    8. Select USER-SATISFACTION in the Rating Scale dropdown.

    9. Choose the Add Question icon.

    10. Enter What improvements, if any, would you recommend to enhance the classroom environment? in the question stem.

    11. Select Open Ended in the Question Type dropdown.

    12. Select the Add Question icon if you would like to add more questions.

  3. Preview your questions on all pages and publish the survey.

    1. Choose Save Draft.

    2. Choose Preview → Draft and make sure your questions make sense.

    3. Choose Close to close the preview of the survey.

    4. Choose Publish. The survey is now ready for use.

Summary

  • Configure rating scales to ensure consistent metrics for course feedback and follow-up surveys, with customizable scales suited to specific evaluation needs.
  • Create and organize survey entities by adding multiple pages and tailoring question types, such as rating scales, multiple choice, and open-ended formats.
  • Associate surveys with training items for automated deployment and tracking of completion metrics, including response rates and average scores.
  • Utilize the Options tab to customize survey behavior, including anonymity, mandatory completion, deadlines, and optional comment fields.
  • Schedule follow-up surveys three to six months post-training to assess knowledge application, involving participants like learners and managers.
  • Leverage automated notifications (APM) to assign surveys and send email alerts using configurable templates.