[Research] Courseware Usability Study Feedback-Influenced Updates

Educator feedback is the most critical component that we consider when strategizing on improving and streamlining Edmentum programs. This summer, we released program enhancements for Courseware in anticipation for the 2018–19 school year. Here’s a look into how Edmentum sought feedback from educators to modernize the Courseware program and to provide an intuitive user experience.

Educator Feedback

We gathered feedback in several ways, including surveys, classroom visits, focus groups, and usability tests. In the spring of 2017, we asked schools and educational centers—including noncustomers and current customers—if we could meet with them to introduce our plans for Courseware for the following year and gather feedback to streamline the program and create a better experience for educators and students. That following year, in the spring of 2018, we conducted a formal study on the usability of Courseware and took the feedback we received form such studies to make updates. 

Usability Study

Participants, including both customers and noncustomers across several states, participated in lab tests and on-site tests (which included a focus group) between March and May of 2018. Metrics included participants completing tasks, a scale of error severity, subjective evaluations, and a system usability scale (SUS) questionnaire.

Participants were asked to complete a total of 17 tasks. While they completed their tasks, they were able to share feedback about the level of difficulty they experienced and the types of features they would like to see as they explored Courseware. Examples of tasks included:

• Creating and deactivating a section
• Managing students
• Printing and exporting reports
• Accessing details on how a student is progressing through activities in a session
• Transferring a student from section to section
• Granting students credit
• Accessing help

Results found a task-completion percentage of 98%. We received overwhelming positive responses from all participants. However, both customers and noncustomers shared helpful feedback that we later used to make changes to our Courseware interface.

Positive questions were measured on a scale from 1 (strongly disagree) to 5 (strongly agree). An example of a positive question includes: “I found the various functions in this website were well integrated.” Results found average ratings on positive questions to be 4.3 to 4.6. Negative questions were measured on a scale from 1 (strongly disagree) to 5 (strongly agree). An example of a negative question includes: “I found this website cumbersome/awkward to use.” Results found average ratings on negative questions to be 1.3 to 2.0.

Feedback-Influenced Updates

After taking into consideration all of the methods in which we asked for feedback, here are a few of the specific features that were changed in the Courseware interface to streamline usability:

• Icons and Access to Data
  • Added easily identifiable question buttons to indicate when more information is available
  • Made check boxes more obvious for ease of use
  • Added access to reports from the program snapshot for quicker access to actionable data

• Credit Approvals
  • Added the ability to apply credit to multiple students simultaneously
  • Included a ribbon on student cards once credit has been approved

For more up-to-date information on enhancements, visit our What’s New Page for Courseware to view new and past updates. For help with functionality, you can take advantage of the Help Center found within your Courseware account to view resources, such as user guides, step-by-step instructions, and best-practice videos designed to help you be more successful with your Edmentum implementation.