What Types of Metrics and Dashboards Can I Create with Articulate Storyline and Rise xAPI Data?
What features do Articulate Storyline and Rise offer that make good use cases for the Veracity Learning LRS dashboard to help analyze learning performance metrics?
In this article, the star ratings show the degree to which Articulate offers xAPI to support each of the following metrics, with illustrations for the most effective ones.
Course Metrics ★★★☆☆
Storyline and Rise offer the same xAPI metrics at the course-level that the LMS gets —
completion, success, and duration. So, the advantage that the xAPI data that arrives in the Veracity Learning LRS is for integration of LMS-level data with other analysis and Business Intelligence tools, such as Power BI, SQL, and Tableau. Lesson Metrics ★☆☆☆☆
Articulate doesn’t offer any granularity automatically, just
course and module, where a “module” is a Storyline Slide or Rise Block. The only exception is if a module has a Quiz, then that CMI interaction shows-up as a child in context of the module, in the xAPI statements. Another special case is in Storyline, an author can choose to group Quiz slides (e.g., pre-test versus final assessment) using Result slides, which then align each group to an
objective in xAPI with success and score. Then, in the Veracity Learning LRS, an analyst can filter-on the objective to see some aggregate performance in a long course. However, this aggregation is not automatic and can easily fail. Aggregation of metrics by anything other than whole course is difficult. If an author breaks-up a course into separate files, then the problem is associating each file’s xAPI with the rest. In the LRS, each of these ad hoc “lessons” would have a unique
registration, so the only way to associate them together is by extrapolation: e.g., by a manually-maintained list of object or context ID values. Page Metrics ★★★★★
Articulate Storyline and Rise both track
duration per module, unlike many other authoring tools. In the Veracity Learning LRS, this offers an opportunity to evaluate students’ attention as a trend across the length of the course. This can give the author an insight to the students’ average “time on task” and help them re-design the course as needed. Typically, students spend more time in multimedia and interactions: e.g., knowledge reviews. Pages that take a few seconds to consume usually have only a title and bullets, or a single short paragraph.
The session duration of the course includes time the student spent other than “on task”, so the median value of the total duration of all the pages can offer a more accurate “seat time” for the course.
Chart of average slide duration in a Storyline course, each a unique type of graded question.
Interaction Metrics ★★★★☆
Both Articulate Storyline and Rise each support many
interaction types. Each tool sends robust xAPI statements for the choice and matching types, plus sequencing in Storyline. In the dashboard, the widgets not only show the score and duration, but automatically improve readability of the choices and responses. In Storyline, any Quiz slide with a graded question, survey question, or freeform question that points to a Result slide will send xAPI statements.
However, while Storyline and Rise do send xAPI for other interaction types —
fill-in, Likert, and numeric — the statements are not well-formed. Typical out-of-the-box widgets that show performance in CMI interactions.
Media Metrics ★★☆☆☆
Neither Articulate Storyline nor Rise send xAPI data for media activity. The only system events that Storyline lets the author use as triggers for custom xAPI are “when the user clicks <Video 1>”, and “when <Video 1> completes”. No tracking of pause, rewind, or seek activities.
Related Articles
What xAPI Data is Generated by Articulate Storyline and Rise?
Veracity customers often ask questions like: “What xAPI data does my authoring tool send to the LRS?” and “What metrics can I track with my authoring tool?" Articulate has two courseware products that emit xAPI statements: Storyline and Rise. Both ...What is the xAPI Object Taxonomy for a Course in Articulate and Rise?
Course └ Objective └ Module └ CMI Interaction The following quotes come from the SCORM profile. Course http://adlnet.gov/expapi/activities/course A “course” represents an entire content-package-worth of material. The largest level of granularity… ...How Do I Add Custom xAPI to Storyline?
While Articulate Storyline supports a handful of xAPI actions out-of-the-box, you may want more. In response, Articulate added an option to create a trigger that sends a custom xAPI statement. If you need help working with triggers, then the ...What are xAPI Extensions and How Do I Use Them in My xAPI Statements?
Best Practices for xAPI Extensions Activity, Context, and Result Extensions in xAPI Statements Do you need to know when and how to best use Activity, Context or Result Extensions in your xAPI Statements? This is a common challenge and a frequently ...Why Does My xAPI Say “und”?
Because you didn't set the language of your xAPI package when you published your courseware in your authoring tool. What is a Language Map? When an LRS gets a text string, like an object.definition.name, or object.definition.description, the xAPI ...