Measuring your learning culture

Image courtesy of Pixabay

L&D colleagues, we’ve all heard the drumbeat that we have to drive a learning culture in the organisation. This sounds amazing and is what anyone passionate about learning and development would aspire to. When I try to deeper into what this means with clients, it can feel frustrating. Even the most experienced practitioners are tempted to fall back on the classic measurements L&D has been trying to use for ages, because that’s all they had: happy sheets, content completions, system adoption metrics. If I ask, “what does a learning organisation mean and how do you know whether you have one,” the conversation can become rather fluffy. If we have met, you know I’m not comfortable with fluffy…

I encourage clients to define their Success Measurement strategy for this objective in stages, using a sort of classic “maturity model” in the flavour of Bersin. You shouldn’t try to do all of these at once, building a learning culture is clearly a journey. Here are some indicators you can use to express more concretely what a learning culture means in your organisation. Type in “learning organisation image” into Google and you’ll get dozens of fancy frameworks. Meh, I’m not interested. For now, this is a list, easy first, challenging last. 🙂

Some of the metrics are yes/no, some you can run reports on in an LXP or other system.

Learners engage with your systems and learning content voluntarily

This is the bare minimum and easy to measure: do users log into your systems? How often, and what are they consuming in there? Do they enjoy the experience, according to a survey or NPS available in your systems?

What is the proportion of mandatory, assigned content the learners engage with, versus content they discover and complete on their own?

Learners know where they can find resources to learn, ideally “in the flow of work”

Clients often have a question in their employee engagement survey to measure this. In Degreed, you can also look at the types of content learners are adding to their profiles and uncover whether there are preferences for certain types of bit-sized learning items. You can add these to your catalogue and curate around them.

Learners talk about what they are learning and share with each other

One of my clients said, “we don’t even talk enough with each other about what we are learning!” This doesn’t have to happen in the context of your LXP but it certainly could. Are there opportunities for people to share what they have learned lately? Is this something you could drive with contests, awareness campaigns or other programmes?

Managers model learning behaviours

The top objection our clients hear to engaging with learning platforms is, “I don’t have the time.” Yet data showed during the pandemic that online learning initiated by the learners themselves exploded! So people were doing learning somewhere… is it right that they should be expected to do this on the weekends at their own expense?

Managers are often fearful that if their teams see them learning something, their teams will think they have too much time on their hands. This means learners are reluctant to be seen “not working” by contributing to their own professional development. Are executives sharing what they have learned recently? Is there time ring-fenced throughout the organisation for learning? Do teams set mutual learning objectives or commit to focusing on a set of skills together?

You have vibrant Communities of Practice

Even 20 years ago I listened to to a global engineering organisation describing how they calculated the cost savings attributed to knowledge sharing through COPs. Your organisation likely has them living in Slack, Yammer, SharePoint, somewhere. If they exist, how can you engage with these groups of people and bring them over to the Learning Side?

You have a Learning Champions Programme

There are many flavours to how to approach this so it’s sort of a yes/no question. It’s critical that your learning champions programme has representatives from outside L&D.

Every organisation has subject matter experts who are passionate about sharing what they know and developing others Are these jewels driving discussion in your Communities of Practice? (I find the IT team is often an early adopter in many clients). In Degreed you can uncover “influencers,” people around the business who have many followers and share content frequently.

Find them and get them involved!

The business drives learning, L&D are the enablers

This is actually easy to measure if you have an LXP or LMS. You can look at the proportions of content curated or created by those OUTSIDE of L&D. If you have provided the tools, templates and governance, you can let your champions shine. Compare SME-curated materials vs. L&D and measure this ratio over time.

I recommend our clients to formally “certify” curators to train them on standards for quality, consistency and good learning design. You can track how many of these certified curators you have; perhaps this is closely related to your Champions Programme.

User data drives learning programmes

Sorry to say my dearests, but learners know better than the L&D department what they want and need to learn. If you can get your hands on what learners are doing in your platforms, you can curate learning campaigns around their interests. You can look at search, view, share, completion data to uncover that learning hunger around the business. Then curate, market your offerings and be sure to measure the results.

You offer experiential learning and mentoring

There are plenty of tools out there for incorporating gigs and mentorships into your learning platforms. Where many clients seem to struggle is to keep these programmes alive with a good pipeline of opportunities after a splashy launch. Track your opportunities engagement data, which skills are the most popular, and where interested candidates are coming from. It’s really cool to see cross-functional interest in stretch assignments, for example.

Data demonstrates engagement with the key skills strategic to your organisation

I considered whether to put this further up on the list because this is a quick win for many of our clients. If you can define the skills critical to achieving your organisation’s strategy, you can drive engagement, awareness and learning toward them. However, this is just an indicator of activity, it’s not yet a business result. However, simply having this data is a HUGE step forward for most organisations. You then can understand your supply of those skills, the depth of expertise, and how those two factors are distributed around your business.

Learning is embedded in your daily ways of working

Is it a regular part of your process to run a lessons learned after a project? We did this after every exercise when I was in the U.S. Army. I notice in the corporate life these are cathartic and encouraging, as long as everyone can see the learnings applied in the next project. I worked with one client who even ran a critique of each MEETING they had: what went well, what didn’t go well, what can we do better next time!

Data demonstrates learning has an impact on strategic and operational objectives

The “holy grail” of measuring learning transfer can require a bit of creativity and the data will be in other systems besides your learning systems. Maybe the impact will be a correlation but impossible to prove causation. It’s OK, just try to talk to your business in ways they consider important.

For example, one of my quickly-growing clients recently was able to automate their Onboarding programme and remove the manual work for trainers to run this routine work each week. The trainers were then free to work on more value-added projects. They were also able to eliminate outsourced compliance training programmes by asking their legal department to curate resources instead. There are real cost savings there that make a difference to the bottom line.

How about the learning programmes offered to your customer service representatives, project managers, software developers, engineers or sales? These folks manage discrete, measurable packages of work. Can you define the desirable business metrics when you design the learning experience?

I hope you can find something on this sliding scale of excellence to tempt your imagination into communicating and measuring what good looks like in your future Learning Organisation. Let me know if you want help defining your learning strategy and rollout plan!