Research & Method
Courses Teach. Roleplay Is Where Skills Stick.
Dr. Youssef Mohamed · PhD in AI & Robotics, KTH
· 6 min read
A founder's take on why a course teaches the idea and a live roleplay partner is what makes the skill stick.
Key takeaways
- A course transfers knowledge; a skill only forms through deliberate practice, which means repeated reps, immediate feedback, and recall under realistic conditions.
- Knowing what to say in a hard conversation and being able to say it live are two different abilities, and only the second one shows up in front of a customer.
- AI roleplay is the practice layer that sits on top of a course: the avatar plays the other person so people rehearse the real conversation, not a multiple-choice version of it.
- Conversation skills decay without retrieval, so the goal is not to watch the module once but to run the rep enough times that the behavior holds under pressure.
Almost every team I talk to has the same setup. There is a course. It is well made, the slides are clean, the content is right, and people finish it. Then a week later a rep freezes on a discovery call, a new manager dodges a hard conversation, and a support agent talks over a frustrated customer. The knowledge was there. The skill was not. That gap is not a content problem, and it is not a motivation problem. It is a practice problem.
I spent five years on a PhD in Social AI at KTH studying how people read and respond to each other in real interaction, and the same pattern shows up everywhere. Knowing the right move and being able to make the move in the moment are two separate abilities. Courses are very good at the first one. They are structurally unable to deliver the second. To get the skill to stick, you need the thing courses cannot give you: reps.
What is the difference between knowing and doing?
Learning science has a clean name for the second ability. It is called transfer: whether what you learned in the training context actually shows up in the real context where it matters. A course optimizes for recognition. You read about open questions, you watch an example, and on a quiz you can pick the better option from a list. But recognizing a good open question on a slide is a different task than producing one, out loud, three seconds after a prospect says something defensive. The first is comprehension. The second is performance under load.
This is why a strong test score after a course is reassuring and misleading at the same time. It tells you the idea landed. It tells you nothing about whether the person can run that idea in a live conversation while also managing their own nerves, listening to the other person, and deciding what to do next. Conversations are real-time and unscripted. You cannot pause one to consult the module.
Why does knowledge fade so fast after a course?
Two well-established findings explain most of what goes wrong between training day and the real call. The first is the forgetting curve: without reuse, a large share of newly learned material decays within days. The second is retrieval practice: memory and skill are strengthened far more by recalling and using information than by reviewing it again. Rereading the deck feels productive and does almost nothing. Pulling the behavior out of your head and running it is what builds durability.
Put those together and the standard L&D motion looks backwards. We front-load all the input (the course) and provide almost no retrieval (the practice). So the curve does what the curve always does. The fix is not a longer or better course. It is to move effort from input to retrieval: fewer slides, more reps, spaced out over time, under conditions that resemble the real thing.
What does deliberate practice actually require?
The research on how people reach high skill is consistent about what works, and it is not just doing the activity a lot. It is deliberate practice, which has specific ingredients. Strip away the academic language and four of them matter for any conversation skill.
- Reps at the edge of your ability, not a single demo. You repeat the specific moment that is hard, like the objection or the bad-news opener, many times rather than once.
- Immediate, specific feedback. You find out what worked and what did not while the attempt is still fresh, not in a performance review three months later.
- Realistic conditions. You practice the actual task, a live back-and-forth with another person, not a proxy like a quiz or a written role description.
- A target you can adjust toward. Each rep changes the next one, so you are correcting, not just repeating.
A course can deliver none of these for a conversation. It cannot give you a partner to talk to. It cannot react to what you actually said. It cannot tell you that your pace got faster and your tone got sharper the moment the customer pushed back. Those are exactly the signals that decide whether a real conversation goes well, and they only exist when there is another person in the loop.
The course is the input. Practice is the missing layer.
Treat the course as the place people get the model: the framework, the language, the examples. Treat practice as a separate, repeated step where they run that model live until it holds. Skipping the second step is the reason good content still fails to change behavior.
Why does a conversation skill need a live partner, not a quiz?
A quiz can check whether you know the steps of an objection-handling framework. It cannot reproduce the part that is actually difficult, which is doing it against a person who is interrupting, getting defensive, changing the subject, or going quiet. Real conversations are interactive: your next move depends on their last one. That branching, unpredictable quality is the whole challenge, and it is precisely what a static, pre-written assessment removes.
There is also the body to account for. In a live exchange, the other person reacts to your tone of voice, your word choice, your facial expression, and your pace, and you react to theirs. None of that is exercised by reading or by clicking. The only way to practice a conversation is to have one. That is why the practice layer has to put a partner in front of the learner, someone who plays the other side and responds to what the learner actually does.
Where does AI roleplay fit?
This is the gap AI roleplay is built to close, and it helps to be precise about what it is. It is not a replacement for the course. It is the practice layer that sits on top of it. In a PokaMind session, an AI avatar plays the other person in a workplace conversation, the prospect, the new hire, the frustrated customer, the direct report, built from your own scenarios and materials. The learner has the actual conversation. They are not picking an answer. They are saying the words.
Because the partner is software and not a busy colleague, the reps stop being scarce. People can run the same hard moment again and again, vary it, and come back to it next week, which is exactly the spaced, repeated retrieval the forgetting curve demands. During the session the system reads tone of voice, word choice, facial expression, body language, and pace, and every session ends with instant, specific feedback and a scorecard, with a manager dashboard that rolls up across the team. That is the deliberate-practice loop, applied to conversations, at a scale a human roleplay program could never reach.
reps against the same hard conversation, so practice stops being the bottleneck after the course
The point is not that roleplay beats the course. The two do different jobs. The course transfers the knowledge. The roleplay turns that knowledge into a skill that survives contact with a real person. Run them as one system, input then practice, and the gap between knowing and doing finally starts to close.
How to put the practice layer on top of your courses
- Keep the course, but cut it to the model. Use it to teach the framework and the language, then stop. Do not try to make a course carry the skill it cannot carry.
- Name the few conversations that actually matter. Discovery, the objection, the bad-news opener, the de-escalation. Those are what you turn into roleplay scenarios.
- Make reps cheap and repeatable. The skill sticks because someone ran the hard moment ten times across two weeks, not because they passed a quiz once.
- Give feedback at the moment, not the quarter. The whole value of practice is correcting while the attempt is fresh.
- Watch behavior, not completion. Course completion tells you people saw the content. The scorecard trend across reps tells you the skill is forming.
Frequently asked
Does AI roleplay replace our existing courses?
No. The course and the roleplay do different jobs. A course transfers knowledge well: the framework, the language, the examples. Roleplay is the practice layer that sits on top of it, where people run that knowledge as a live conversation until it becomes a skill. You keep the course and add the reps it cannot provide.
Why is practicing with an AI partner better than just taking a quiz?
A quiz checks whether you can recognize the right answer from a list. A conversation requires you to produce the right move in real time against someone who interrupts, pushes back, or goes quiet. That interactive, unpredictable quality is the actual skill, and it only gets exercised when you have a real back-and-forth with a partner who responds to what you said.
More reading
Keep reading
See AI roleplay practice on your scenarios
Bring one conversation your team needs to get better at. We'll show you the roleplay, the real-time read, and the feedback it produces.
Book a walkthrough

