Analytics Reports

Analytics Reports

A new feature of the LRS is a tabular report function, which offers the same information as a query or chart but as a database table report.
Notes
This is new feature that not all LRS users may see, yet.

Navigation

In the left menu, expand the Analytics accordion, and select Reports.



This opens the Manage Reports page for the current store. If you’re the first LRS user to open the Reports section, then you’ll see a blank table.


New Report Button

To create a report, click the New Report button in the upper left of the table. This opens the Create a New Report page.



Notes
You can read about the differences and benefits of each report in the next section.
Choose a report type and click the Configure and Run button in that row. A Create new <Report Type> dialog pops-up.



Fill-in the form fields and click the Run Report button. The LRS adds the report to the Manage Reports page.



The Manage Reports page uses a table layout and interface that you’ll also see in the reports themselves. The major differences are the Status and Actions columns.

Status Column

If the Manage Reports page already has reports listed, then they should all be Complete. However, when you create a New Report, the Status may appear different.


  1. Running — For a complex report or for a very large dataset, the LRS may take several seconds to render the report. Refresh your browser to see any status change.
  2. Processed <XX> Rows — Shows interim progress in the render.
  3. Complete — The report is ready to View.

Actions Menu

In the report table, at the far left of each row, in the Actions column, click the More icon () to open a menu of actions you can perform on each report.


  1. Cancel — Aborts the render of a report. Not available when complete.
  2. View — Opens the report.
  3. Export — Sends a CSV file of the report’s contents to your browser’s Downloads folder.
  4. Delete — Permanently removes the report from the list. You can’t restore it, you can only create a new report of the same type.

Report Display Options

Click the More icon () to the right of a column header to see a menu of options:
  1. Sort Ascending/Descending, Clear Sort — Lets you re-arrange the rows using the column as the key.
  2. Filter, Clear Filter — Lets you hide rows based on the column values.
  3. Hide/Show Column, Reset Size — Lets you customize the display.
On the right side of the report table, you’ll see more controls to change the display.



In the upper-right are buttons to toggle the filter row, each column, and full-screen mode. In the lower right is a menu of the number of rows to show, and the navigation buttons to flip pages.
  1. Show/Hide Filters — This shows the filter row, which lets you see any filters you may have applied (the report highlights filtered values in orange) and gives the option to remove them. You apply a filter by clicking the Filter icon next to any value in the table.
  2. Show/Hide Columns — This control opens a dialog box that lets you decide which columns to display. You can resize column widths directly in the table too.
  3. Full Screen Mode — Hides the report title, to give you room to see more of the report.
  4. Rows per Page — (5–100) If you like scrolling more than flipping pages, then choose a large number.
  5. Page Navigation — Click the right or left arrow to flip to the next or previous page.

Report Types and Interpretation

We chose the first reports for the LRS based on early customer demand:
  1. Completion Report — A report showing all xAPI statements with the completed verb.
  2. Response Report — A report showing all responses to questions answered in the LRS.
  3. Response By Learner Report — A report showing a learner’s response to each question in a dataset
  4. Attempt Status Report — A report showing the attempt status of learners for a specific activity.
  5. Attempt Path Report — A report showing the attempt path of learners for a specific activity.
Notes
This is a preliminary list. You may see a different list in your LRS.
The reports all use the User/Learner (actor) as the primary key of the dataset. Each report then diverges on what other fields it also shows.

Completion Report

As described, this report is a simple list of the Objects, Durations, and Timestamps in each statement that has the verb completed, per User.

How to Interpret

This is a basic report of course, lesson, or interaction completion. It’s useful for confirming a similar course completion report in your LMS. However, you can dynamically drill-down in this version:
  1. Click the filter icon next to a User to narrow the report to a specific learner. Use this report to confirm that a learner on a career path completed the needed courses, and when.

  2. Click the filter icon next an Object to narrow the report to a specific activity. This shows you all the learners that completed that course, when, and how long they took. Use this to find outliers, such as a student who completed the course, lesson, or interaction more than once or completed it in an unexpectedly long or short duration.

  3. Sort by Timestamp to see the first or latest Users to complete an activity. During a limited-availability workshop, this helps see how soon learners completed the course and if any exceeded the deadline.

  4. Sort the table by Duration to see the Users who took the most or least time to complete the activity. A learner who took too long may need remedial tutorial. A learner who took too little time might have paid less attention (or cheated).

Response Report

This report lets you get a broad view of learner performance in all CMI interactions in the store. The Response Report shows columns for User, Question, Response, and Timestamp.


How to Interpret

This is a unique view: an LMS cannot show this detail, and the dashboard charts in this LRS only show response patterns and trends for one interaction at a time.
  1. Click the filter icon next to a User to narrow the report to a specific learner. This lets you see all the responses to all the interactions that learner answered. With this you can find which interactions a learner had the most difficulty with and use that to recommend further assessment or remedial tutorial.

  2. Click the filter icon next a Question to narrow the report to a specific interaction. Now, you can see how often all learners answered that question, when, and with which responses. Look for frequent learners or unexpected responses, which shows the difficulty of the Question. Is it a trick question, or is it just too difficult to answer? 

  3. Sort or filter on Response to see detailed patterns and trends (for any number of Users or Questions), which a dashboard chart cannot show easily or all at once. Here you get a full break-down of the frequency of selected Responses, so you can see if the Question is too suggestive or its distractors are too implausible.

  4. Sort by Timestamp to see the first or latest Users to answer a Question. Look for long gaps in Responses from a learner, which may show lack of attention or difficulty in answering.
Notes
This report only shows the responses in a CMI interaction that learners chose. The report does not show all choices or the correct response.

Response By Learner Report

This is a variation on the Response Report. When you create this report, you configure it to show responses only to the interaction you select. This can greatly speed-up the render of the report and simplify its appearance.


How to Interpret

This report has only two data columns: the User and the responses to the Question.
  1. Click the filter icon next to a User to narrow the report to a specific learner. Learners who answered many times may need remedial tutorial.

  2. Sort the Question column to see detailed patterns and trends in response values. A wide distribution of responses may indicate general learner difficulty and low confidence: consider re-writing the Question.

Attempt Status Report

This is another report that you can use to confirm data from your LMS, such as Learner, Course, Start date, and Completion. However, it also includes details only available in the LRS, such as Duration, Total Interactions, Score, and Session ID (registration).


How to Interpret

You can use this report to diagnose the rate of attempts needed to successfully complete courses, either per learner or per course.
  1. Click the filter icon next to one Learner and click the filter next to one Course, then you can see how many sessions that learner took to complete that course, the dates and duration of the attempts, and the scores of each. Learners who needed many attempts to complete a course, if at all, may need remedial tutorial. Alternately, if a course regularly needs many attempts to complete or if the score is usually low, then consider re-designing that course to improve its effectiveness relative to learner effort and performance.

  2. Sort the Duration column values in descending order, to see which courses took the longest to complete. Courses with more content, especially media and interactions usually take longer to complete. However, if you see a course near the top that many learners took longer than expected to successfully complete, then consider breaking up that course into smaller chunks.
You can use this comprehensive and versatile report in many other ways too!

Attempt Path Report

The path report shows learners’ choices when navigating activities in courses. The path appears as an inline list of activities, delimited by arrows (->) showing the flow.
Notes
When you Create a New Path Report, you can pre-filter the report on a single Scoping ID. Click the Search icon at the far right and select the Activity Tree picker to select the hub in a course from which you want to inspect branching paths.

How to Interpret

This report has fewer dimensions, and so has fewer use-cases.
  1. Click the filter icon next to a Learner and next to a Course to see if that learner tried different paths in that course. Learners often retry a course using different paths to get a better score, to see all content, or to review material in preparation for a final assessment. If the course needs learners to take one path more than others and they don’t, then consider re-designing the course with no option to non-linearly navigate.

  2. Click the filter icon next to a Course and sort by Path. This helps you see variations in paths learners took and the relative frequency. Export this report and use a spreadsheet to count the unique learners that took each path to reveal trends in unexpected behavior. If the course includes a branching scenario, then this report helps you see the amount to which learners collectively explore all branches, and which branches need more attention during re-design of the scenario.
Notes
To improve the effectiveness of this report and if the subject matter implicitly supports a linear sequence, you can override Canonical Activities using a naming convention that helps diagnose aberrations in path taken: e.g., “01 Open Hood”, “02 Remove Air Cleaner”, “03 Inspect Carburetor”, etc.



    • Related Articles

    • Analytics Dashboards and Widgets

      Out-of-the-box Dashboards and Widgets This article describes the dashboards and widgets built-in to the Veracity Learning LRS. In the LRS, we grouped and sorted the widgets in the same way that xAPI statements organize metrics in their data. Here, ...
    • Accessibility Support

      Accessibility Compliance While Veracity Learning is not inherently 508 compliant, users can create and publish alternative access options that adhere to Section 508 and WCAG 2.0 AA guidelines. Section 508 compliance is achieved by implementing ...
    • Configuration

      Setting Configuration Values These settings only apply to on-site installations. When using a hosted SaaS plan, Veracity will manage the settings for your deployment. Contact support if you require modifications to the settings on your hosted ...
    • Tableau Integration

      Using the Tableau Web Data Connector, you can import your saved Statement Viewer reports from the Veracity Learning LRS into Tableau for further analysis. The Connector can only pull saved Statement Viewer reports. If you have none, then you must ...
    • Versions of Veracity Learning

      Veracity Learning LRS comes in a few versions. The main version, and the one you're most likely looking at right now, is LRS.io. LRS.io (SaaS Hosted Plans) This is our cloud hosted SaaS service, where anyone can create an LRS. You can use the free ...