The Missing Step Between AI Skills and Team Practice

Taylor Karl
The Missing Step Between AI Skills and Team Practice 11 0

Key Takeaways

  • The training paradox: AI training builds capability, but capability doesn't produce consistent daily behavior
  • The ownership gap: managers translate policy and capability into decisions teams can work from
  • Scope decisions: three questions decide where AI belongs and what good looks like
  • Ownership decisions: three more questions keep AI-assisted work reviewed and accountable
  • What changes: teams get standing answers instead of one-off rulings and clearer correction

A manager is preparing for a 4 pm call with the client when a message pops up from one of the team's strongest performers: "Can I run the client summary through AI before I send it over? Would save me a couple hours."

They stare at the message a second too long. They've sat through the training. Half the team has been testing tools for months. But nobody's ever asked this question about something going straight to a client, and the manager realizes they don't have an answer.

What they're asking is whether the manager will stand behind this particular use, on this summary, for this client, but training never covered how to determine when to use AI and what to use it for.

Training builds capability, but someone still must work within what's allowed, decide where AI fits in this team's work, and determine who is accountable for the result. Turning capability and organizational boundaries into standing expectations for the team's work is the manager's distinctive role.

The AI Training Paradox

The manager's distinctive role sits inside a real paradox. AI training is already common: DataCamp's 2026 research found 82 percent of leaders said their organizations offer some form of it. Yet 59 percent of those same leaders still report an AI skills gap.

Training and a skills gap can coexist without contradiction. Even when people have learned how to use the tools, something can still be missing. This gap shows up as ambiguity, and it has a cost.

Instead of a one-off yes or no every time an AI use case comes up, managers need answers to six questions that build a standard their employees can work from.

The Six Questions That Turn AI Skills Into Team Practice

Scope

  1. Where does AI belong?
  2. Where doesn't it?
  3. What does "good" look like?

Ownership

  1. What changes in review?
  2. What stays under human accountability?
  3. How do wrong calls get handled?

The first three determine where AI fits in the team's workflow. The next three determine how the team maintains accountability for AI-assisted work.

When those questions remain unanswered, people resolve them individually. Some avoid AI even where it would help, since guessing wrong feels riskier than the benefit. Others use it on everything, including tasks where they shouldn't, since nobody told them not to.

Both patterns can survive months of training, because training teaches people how to use AI, not how to decide when to use it.

A skills gap isn't the only diagnosis available, either. One employee can lack AI skill outright. Another can know the tool well and still lack permission or a standard to work against. A third can have both and still need judgment about a specific, higher-stakes case.

Good training can build skill and sharpen judgment and risk awareness. What it can't settle is the specific question in front of a specific employee, and that's where the translation layer takes over, turning capability into clearer, more consistent practice.AI training paradox illustration showing gap between training completion and team practice

Translating Policy Into Team Practice

Managers occupy a distinctive position in the translation layer. IT sets data-handling rules; legal and compliance define what's permissible; and employees make their own daily calls. What's distinct to managers is turning that policy into a standard their team can follow.

Two forces make this role harder than it looks. Leadership expects AI to create visible value. Employees run into specific use cases long before departmental standards exist to answer them. The manager is where those two realities collide.

Without a manager fulfilling that role, this collision continuously repeats:

  • The mid-task ask: an employee messaging a manager for a one-off yes or no
  • The after-the-fact escalation: a client-facing draft reaching legal only after it has been sent
  • The split call: two employees on the same team reaching opposite conclusions about the same kind of task

Creating a standard means the team doesn't start from scratch every time a similar situation comes up.

Many managers already have policies to work from, including data-handling rules, confidentiality requirements, and standing approval processes. If data-security rules say confidential data can't go into unapproved systems, the manager turns that into a concrete answer for their team, naming which deliverables are off-limits.

Managers use those boundaries as the raw material to build a team standard to work from, starting with where AI belongs in the team's workflow in the first place.

Questions 1–3: Deciding Where AI Belongs

Where AI fits within a team's workflow comes down to three questions a manager can answer directly. Each one narrows ambiguity down to something the team can act on. Leaving these questions unanswered won't stop AI use. It leaves the outcome to chance. Some employees avoid a tool that can help and others use it in ways they shouldn't.

Questions about where AI belongs aren't arbitrary. They resolve whether AI is in play, where it's ruled out, and what standard the output must meet.

Here's what each one answers:

  • Where does AI belong? Weigh what's going in, what AI is doing, and what happens if it's wrong. Lower-stakes work is the easier starting point; higher stakes call for controls that justify the risk.
  • Where doesn't it? Rule out AI wherever existing data and tool-use policy already say no. If a task exists to build an employee's judgment, automating it defeats the purpose.
  • What does "good" look like? A strong output never overrides governance. The bar stays fixed while verification and review scale with risk.

The client summary is a good test case. The input is internal notes, not client data, and the draft goes through internal review before it reaches anyone outside the team. That combination makes the draft stage a reasonable starting point rather than a green light for the whole task.

Confidentiality rules still apply, so any source material they cover stays out of the draft. That's not a new restriction; the manager is only naming what the existing rule already covers.

Even approved material still must meet a bar. A wrong number stays wrong no matter who wrote it, so factual accuracy doesn't move. How closely the employee needs to trace each claim back to its source depends on how the team plans to use the summary.

Together, these three questions resolve the ambiguity that prompted the employee to ask in the first place. The employee now knows what to do, what not to do, and the standard they need to meet. Deciding where AI belongs is only half the job. The other half is what happens once someone starts using it.

Questions 4–6: Keeping AI-Assisted Work Accountable

Once a team knows where AI's scope ends, the next three questions cover how the team checks and owns AI-produced work. Together, they answer what happens once AI enters a team's workflow, because permission to use AI isn't the same as accountability for the resulting work.

These three answers change as the work changes. A review step that catches problems today might not catch them next quarter.

Three more questions decide how that happens:

  • What changes in review? More review isn't automatically better. The real question is whether AI changes the task's risk enough to change the review it already gets.
  • What stays under human accountability? Some decisions stay with a human because responsibility for them doesn't transfer with the task: accountability for another person, a final commitment to a customer.
  • How do wrong calls get handled? A checkpoint that catches nothing might mean it's unnecessary, or it might mean it's working. Either way, the manager should treat the team's current answers as a starting point, not a fixed rule.

Applied to the client summary: a low-stakes internal draft keeps the review it always had. A client-facing version raises a different question: whether the existing approval step still catches what needs to be caught.

AI can help write the summary, but the manager remains accountable for whether it's the right message to send. That doesn't change based on how good the draft is.

If a wrong figure reaches a client, correcting the record addresses the immediate problem. The more useful follow-up is determining whether the scope call, review checkpoint, or quality bar needs to change.

Together, these three questions turn permission to use AI into ongoing accountability for the work it produces. A team that has answered them isn't just allowed to use AI. It knows who's checking the work, what still needs a human, and what happens when something goes wrong, giving managers something to watch for.

What Changes Inside Your Department

These changes show up in daily workflows, not dashboards or surveys. A team that used AI inconsistently because they were unsure what policy allows now follows a clear, shared standard.

Here are some of the changes teams can see:

  • Fewer repetitive escalations: questions the standard already answers stop landing in the manager's inbox
  • More consistent adherence: the team follows the standard instead of just using AI more overall
  • Fewer abandoned experiments: people don't quit early because of ambiguity the manager could've resolved in advance
  • Clearer correction: when something goes wrong, there's already a way to trace it back to the decision that needs to change

The employee who once had to ask permission mid-task can now answer the question directly: draft stage, internal notes, human review before it goes out, and a clear owner if something in it turns out to be wrong. The team is working from a standard now, not a guess.

The Answers Your Team Needs

That kind of clarity doesn't come from training by itself. Training can build capability. What it can't establish on its own is the operating judgment that turns that capability into standing answers for a specific team.

Your team may already know how to use AI. What they don't know is how you want them to use it here.

New Horizons partners with organizations to build AI fluency in management teams so they can answer these six questions: understanding how AI behaves, its common failure modes, and what verification looks like before AI-assisted work goes out the door.

Could every manager on your team give their employees a clear answer to these six questions?

Explore New Horizons' AI training programs and start building the fluency that sharpens the judgment you already bring to your team.

Print