More and more organizations are seeing the value of measuring learner engagement. In today’s increasingly hybrid work environment, managers are rarely (if ever) in the same place as their employees, so organizations must identify new ways to measure learner engagement beyond simply “attending the required learning sessions.”
But learner engagement isn’t always the easiest thing to measure. For starters, it can be defined differently depending on the organization and their objectives. There are also many ways to measure engagement, which means lots of different metrics. Success should be defined upfront, but often engagement is an afterthought of any learning program — so where do we start?
Choosing the Right Metrics
There are many ways to measure learner engagement, each with their benefits and drawbacks. On a relatively basic level, this can go from sign up rates to active and total users. The next step might be looking at completion and dropout rates or time spent on each course. Beyond this, an organization may look at the application of learned skills or behaviors by the percentage of employees using their new skills, productivity rates or performance feedback.
Perhaps unsurprisingly, the easiest metrics to measure aren’t always the best metrics to measure engagement. Instead, looking at the application of new skills is far more telling of true learner engagement.
Are these new skills being applied to employees’ work or are they immediately forgotten following training? To better understand these metrics, an organization must break down the silos within their human resources (HR) team to support more holistic learning, engagement and performance management practices. This can be achieved by integrating your learning and development (L&D) with HR technology infrastructure.
Measuring Learner Engagement With an LMS
The vast majority of organizations use a learning management system (LMS) with some degree of reporting capability. This is where you will capture your “foundational” engagement metrics, such as course signups, completions and more.
However, with the right reporting functionality, there is a wealth of additional data waiting to be explored. For instance, what are the sign ups versus completions for each program? What does interaction look like for optional mandatory courses? Are learners racing through the program, or our they taking the time to carefully consider each learning objective?
Measuring Learning Engagement with an LXP
More and more organizations are adopting learning experience platforms (LXPs) to support informal learning. An LXP is a fantastic way to monitor learner engagement. Informal learning, by its very nature, is voluntary, meaning that anyone engaging on an LXP is doing so because they want to or see value in it.
There are two groups whose engagement you will want to measure in an LXP:
- Content authors: those making original posts, sharing resources they’ve found and actively commenting on the content of others.
- Content consumers: those interacting with other people’s content, whether that’s responding to mentions, “liking” posts or even silently reading posts without interacting with them.
The thing to remember here is that sharing content online doesn’t come naturally to everyone. Most Millennials and Gen Z workers are much more comfortable sharing content online, whereas more experienced workers may not be as active on your LXP.
However, having a way to see who is viewing each piece of content means that you can still keep track of content consumers as well as those more actively engaging.
What to Measure in Your LXP
If you have an LXP, it can be tricky to know exactly which metrics to measure. Here are some metrics to consider measuring:
- Number of resources created — such as original text posts, videos, polls and more.
- Content playlists curated — how many “playlists” of content has a person created?
- Comments left on others’ posts — not everyone will create their own content, but having people who respond to posts and amplify their reach are the backbone of any learning community.
- Comments garnered on the learner’s own posts — which learners are posting content that gets people talking? This can be invaluable for learning teams looking to see what content resonates with an audience.
- Content quality (as measured by ratings) — including star ratings on posts ensures you can see who is creating high-quality content.
- Number of followers — if your LXP allows learners to “follow” each other, who is attracting the most followers (presumably as a result of creating high-quality, engaging content)?
- Number of posts in a workspace — a workspace with 10 people may generate more engagement and interaction than a workspace with 100 people depending on who is in it and how it is used.
Beyond the Learning
Employee engagement is inextricably linked to learner engagement. Employee engagement looks at how happy your people are in their jobs, their likelihood of leaving and their productivity. For instance, highly engaged employees are 17% more productive than their less engaged counterparts.
The most common way to assess employee engagement across your entire workforce is with employee engagement surveys. These surveys will cover topics such as involvement, satisfaction, inspiration and leadership, and can give the HR team a way to understand how employees are feeling.
The responses from the employee engagement survey should be assessed alongside the data collected from the LMS and LXP. For instance, if the survey shows that employees are satisfied in their roles and enjoying their work, but there is limited engagement on the LXP, this could indicate a need to better promote the LXP. If certain teams are highly engaged on the LXP but report feeling dissatisfied at work, are they feeling frustrated, or is there some other benefit they are missing?
How to Use Your Learner Engagement Data
Learner engagement data is invaluable for training teams looking to improve engagement across the entire organization. But understanding learner engagement in isolation isn’t going to make a huge difference — instead, it must be viewed holistically.
Most HR teams operate in silos with the learning team working separately to the engagement team, who again work separately to the performance management team. Getting the entire HR team on the same page as and involved in each other’s initiatives is a much smarter way to make the most of your learner engagement data, as other teams will likely have valuable insights into why learner engagement is higher or lower than expected.
In particular, learner engagement data should be reviewed alongside performance data. This might come from 360 feedback, productivity, sales figures, customer ratings or whatever performance metrics your organization uses. Combining this data means that your training team and managers can identify highly engaged, highly productive employees and learn from them, as well as pinpointing less engaged, less productive employees to support them, uncover any problems and help them get back on track.
Beyond individual learners, training professionals can take this learner engagement data to find out what content is really capturing the imaginations of learners. These trends might be surprising — for instance, the learning team may have been prioritizing the production of learning videos, whereas the data from the LXP shows that learners rate short infographics especially highly. This data helps inform the learning team to create content that really works for the learners, directly inspired by their real-time learning activity, discussions and interactions.
Looking Ahead
While it is possible to pull this data together from multiple separate systems, it is far easier to pull a report from a single, integrated platform. A talent experience platform combining learning, engagement and performance management is a powerful tool for organizations looking to better understand how to engage their learners, increase productivity and boost employee retention.
Breaking down the silos within the training team is a vital part of making the most of your learner engagement data — and underpinning that with the right technology is the first crucial step on the road to knowing what makes your learners tick.
