MI Reports - Explanation of Registration & Login Statistics (For AUKUS only)

Overview

This article will explain some of the registration and login metrics displayed in the MI reports (Management Information Reports) sent over to our clients.

Firstly, the key thing to note here is that these metrics are different based on the registration type of the programme. We will first explain the metrics and then will look at two different examples from two different types of registration options. This article is designed for members using MI reports. 

Metrics

• Total registered users (at the end of the period): This shows how many users had registered accounts at the end of the reporting period. This does not include any leavers.
• Registrations during the period: This shows how many people registered for the platform during the reporting period. This does include leavers.
• Percentage of active users (since launch): This shows as how many users are using the platform as a percentage. This does include leavers.
• Percentage of active users (during the period):  This shows how many users were active (logged in at least once) during the reporting period as a percentage of the total registered users at the end of the reporting period. This does include leavers.
• Number of unique logins for the period (during the period): This shows how many unique users logged into the platform during the reporting period. This number WILL include leavers. 
  
  The reason leavers are included in the above metrics, is that we are looking at an absolute value. For example, if a member was a part of the programme up until the last day of the reporting period, they technically did log in to the platform during the reporting period. 

Important Notes

Notes on unique logins:

Furthermore, if you are comparing the unique logins from an R Report to the MI Report, you cannot sum the monthly unique login figures together to derive the unique logins for the whole period.

The unique logins are counted for each period of measurement, and we only count a user once for the entire period. So if you did a unique login report with a monthly breakdown, and then an annual breakdown for the same period, it is expected that summing the monthly unique logins will not match the annual unique logins.

To give an illustration, we have User A using the site in January, February and March:

• For a monthly unique user breakdown, we'll count User A once for each month
• If we did a breakdown by quarter (Jan - Mar) instead, we'll count User A only once

So if you summed the monthly counts for the above, you would have triple counted User A.

Login Details Table Overview

What This Table Shows 

• The Login Details Table shows all of the users that have logged in for the time period selected and how many times these users have logged in, as a percentage, on a month-by-month basis. 
• This table includes Leavers in its metrics. The reason leavers are included is that we are looking at an absolute value. If a member was a part of the programme up until the last day of the reporting period, they technically did log in to the platform during the reporting period.
• Employees cannot be counted more than once, per month, in this table. For example, an employee who has logged in 5 times in November 2023, is not also counted as an employee who logged in once or twice in November 2023, they would only be counted in the logged in five times metric.

What This Table Does not Show

• This table should not be used to try and work out what percentage of an entire workforce has logged in during the period.
• This table does not show a percentage breakdown of the employees that have logged in based on the entire workforce.
• This table only shows percentage breakdowns for employees who have logged in during the time period.
• This is why, each month, the combined percentages will always add up to 100% because the table shows percentage breakdowns of all of the employees that have logged in.
• For example, in the screenshot below, in the November 2023 column, 55.17% of all the employees who logged in that month, logged in once, not 55.17% of the total workforce.

• This table is not linked to the 4 Registration metrics which appear above it in MI Reports.

   

MI Report Dates

When doing an anniversary review:

When doing an anniversary review report, it is important to select whole months for the starting and ending months of the reporting period. I.e. the 1st of the starting month, and the last day of the ending month for these reports. Selecting the exact anniversary dates will cause the incorrect data to be displayed as data will only be selected for the exact dates, and miss out on the launch events from the prior year.

Examples

Self-Registration Programmes

This report was run for the period: 16 November 2020 - 25 November 2020

Looking at this example, we can explain these metrics as below. 

• Total registered users (at the end of the period):  986 users were currently registered and not marked as a leaver on the platform on the 25th November 2020.
• Registered during the period: 966 members registered during the period of 16th November and 25th of November. This makes sense as this is a report that was run just after a client launch.
• Registered users: This also tells us that around 20 users registered before the 16th of November (986 - 966).
• Percentage of active users (since launch): Out of the total number of licences added to the programme, 17% of them are now in use as of 25th November.
• Uploaded Licences: This also tells us that there are about 5800 licences uploaded on the platform (980 / 17 * 100).
• Percentage of active users (during the period): Out of all the registered users, 97% logged in at least once to the platform during 16th of November and 25th of November. So, that would be 97% of 986.
• Number of unique logins (during the period): This is the total number of unique users who logged in to the platform expressed in absolute terms regardless of their current status on the programme. The percentage of active users during the period was 97% of 986 = 956. But the unique logins were 966. This tells us there were 10 users who logged into the platform but were marked as leavers hence not calculated in the previous metrics.

Preload Programs

This report was run for the period: 17 December 2019 - 16 December 2020

• Total registered users (at the end of the period): 14800 users were currently registered and not marked as a leaver on the platform on the 16th December 2020.
• Percentage of active users (since launch): Out of all the accounts that were preloaded, around 90% have activated their account as of 16th December 2020.
• Percentage of active users (during the period): Out of all the registered users, 72% logged in at least once to the platform during 17th of December 2019 and 16th of December 2020. So, that would be 72% of 14,800 = 10,656.
• Number of unique logins (during the period): This is the total number of unique users who logged in to the platform expressed in absolute terms regardless of their current status on the programme. The percentage of active users during the period was 72% of 14,800 = 10,656. But the unique logins were 11,700. This tells us there were around ~1000 users who logged into the platform but were marked as leavers hence not calculated in the previous metrics.