You can't improve what you can't see: Why we built the AI Adoption Scan

Sander van Gelderen

In this article, we argued that one of the biggest risks in AI transformation isn’t the technology itself. It’s assuming adoption is happening simply because AI tools have been deployed. 

You can’t improve what you can’t see: Why we built the AI Adoption Scan

Executives have more visibility into AI investments than ever before. They can track spending, licenses, usage and activity through increasingly sophisticated dashboards. What those dashboards rarely show is whether AI is actually becoming part of the way people work. That raises an important question.

AI doesn’t fail because of technology. It fails because adoption gets stuck.

If AI adoption is a people challenge, how do you measure it? 

For us, that question became more than a discussion. It became something we wanted to answer ourselves.  

Before helping others, we looked in the mirror.  At Effectory, AI was spreading quickly across the organization. People were experimenting with new tools, sharing prompts, and discovering new ways to improve their work. New use cases emerged almost every week. 

Like many organizations, we could have concluded that our AI journey was progressing well. Instead, Effectory CEO, Christiaan de Waard, challenged us with a different question. 

“Do we actually understand how our people are experiencing AI?” 

Not whether they were using AI. Not whether they liked AI. But whether they had everything they needed to make AI part of the way they worked every day. 

As Christiaan put it: 

“The question wasn’t whether our people were ready for AI. The survey showed they already were. The real question was whether we, as leaders, were ready to give them the clarity, support and freedom they needed to make AI part of their everyday work.” 

That became the starting point for our first internal AI Adoption Scan. 

The results surprised us 

The first results looked exactly like the success story many organizations hope to see. 

  • 93% of employees wanted to further develop their AI skills. 
  • 84% were excited about using AI. 
  • 88% already experienced productivity improvements. 
  • 74% believed AI improved the quality of their work. 
  • Almost two-thirds used AI every day or multiple times a day. 
  • Only 1% reported not using AI at all. 

If we had only looked at those numbers, we would probably have celebrated a successful AI transformation. Fortunately, we kept asking questions. Beneath those encouraging results, another story emerged. 

  • Only 54% felt confident in their ability to use AI effectively. 
  • Less than half regularly explored new ways to apply AI. 
  • Only 23% believed the organization communicated clear AI guidelines. 
  • Just 26% knew where to go with AI-related questions. 
  • Only 57% felt experimentation was actively encouraged. 

Suddenly, the challenge looked very different. People weren’t resisting AI. They were asking for help to become better at it. The biggest challenge wasn’t adoption. It was turning enthusiasm into confidence, capability, and lasting habits. 

Listening changed our strategy 

The survey didn’t just identify problems. It showed us where to act. Employees were remarkably clear about what would help them most. They wanted practical training, examples from colleagues, time to experiment, better tools, and clearer guidance. 

In other words, they weren’t asking for another AI strategy presentation. They were asking for an environment where they could learn. That insight fundamentally changed our approach. 

Rather than designing an AI transformation program from the boardroom, we designed an AI enablement program around our people. Different employees adopt technology at different speeds. 

Some immediately start experimenting. Others first need reassurance. Some learn by watching colleagues. Others need structured training. Some require clear governance before they feel comfortable using AI. 

Instead of forcing everyone through the same journey, we focused on creating the conditions that allow everyone to progress. Because successful adoption isn’t about making everyone move at the same speed. It’s about making sure nobody gets left behind. 

From leadership question to scientific model 

Our internal experience also revealed something else. There wasn’t a good way to measure AI adoption. Most organizations focused on outputs: How many people use AI? How much productivity has been gained? How many prompts have been generated? Useful metrics. But incomplete ones. 

They don’t explain why adoption accelerates in one team and stalls in another. To answer that question, we developed the AI Adoption Model. Instead of treating adoption as a single score, the model views it as a journey built around five connected dimensions. 

  • Clarity asks whether employees understand where AI fits into their work. 
  • Capability measures whether they have the skills and confidence to use it effectively. 
  • Environment looks at whether leadership, managers and culture create the conditions for adoption. 
  • Usage measures whether AI has become part of everyday work. 
  • Impact explores whether employees actually experience meaningful value from AI. 

These dimensions build on one another. High usage without capability creates different challenges than strong capability without leadership support. By understanding each stage separately, organizations can identify where adoption is slowing down and intervene much earlier. 

Built on science, designed for leaders 

The AI Adoption Model wasn’t created from intuition. It draws on decades of behavioral science, including the Technology Acceptance Model, COM-B, Diffusion of Innovations, Self-Efficacy Theory and Organizational Support Theory. 

These models have one thing in common: people rarely change because technology exists; they change when they understand why it matters, believe they can succeed and feel supported throughout the process. That insight shaped every question in the AI Adoption Scan. 

Measuring both the promise and the pressure of AI 

Another lesson from our own journey was that AI adoption isn’t only about opportunity. It is also about experience. Many AI assessments focus almost exclusively on the benefits of AI. Productivity. Efficiency. Performance. Those outcomes matter. 

But they don’t tell leaders how employees experience the transition itself. Do people feel confident? Do they worry about job security? Are they overwhelmed by the pace of change? Do they trust leadership to guide them responsibly? Ignoring these questions creates another blind spot. 

Organizations may see productivity increasing while confidence declines. They may celebrate adoption while employees quietly disengage. Sustainable AI transformation requires understanding both sides of the equation. The value AI creates. And the experience people have while creating it. 

A different way to think about AI adoption 

Looking back, our biggest insight wasn’t about AI. It was about leadership. Technology adoption cannot be managed through dashboards alone. It requires listening. It requires curiosity. And it requires leaders who are willing to replace assumptions with evidence. 

The organizations that create the greatest value from AI won’t simply be the ones that invest the most. They’ll be the ones that understand where adoption is accelerating, where it is slowing down and what their people need next. 

Because AI transformation doesn’t start with technology. It starts with understanding people. And that’s exactly what the AI Adoption Scan was built to do. 

Want to know more? Contact us.

Book a free demo. See our solutions in action.

Effectory is Europe's Leading provider of Employee Listening Solutions. Schedule a product demo and discover how to enhance your employees' engagement.

Demo request