Articles in this section

[Admin Guide] Track AI Role Play results

Once reps start practicing, the analytics on a role play show you who passed, who is still trying, and who has not started. You can also open any individual attempt and read the same analysis the rep saw.

ℹ️ Analytics are per role play, not per Learning Path. Open the role play itself to see them.

 

1. Open the analytics

  1. Open the Learning Path.
  2. On the Content tab, select the role play in the content list.
  3. Click the analytics icon in the top right of the panel.

The User analytics page opens. Use the All Teams dropdown to narrow the results to one team.

 

2. The summary numbers

Three cards sit at the top.

CardWhat it tells you
% users passedHow much of the assigned group has cleared the passing score
Average roleplay scoreThe average score out of 100
% users submittedHow much of the group has completed a scored attempt

💡 Pro Tip: Read passed and submitted together. A low pass rate with a high submitted rate means the role play is too hard, or the criteria are not what reps were taught. A low submitted rate just means people have not started.

 

3. The Scores table

Below the cards, every assigned rep is listed.

ColumnWhat it shows
UserThe rep
StatusNot started, or In progress
AttemptsHow many times they have tried
Latest scoreTheir most recent scored attempt
Passed dateWhen they passed
DetailsOpens their individual attempts

Every column sorts. Sort by Attempts to find reps who are trying repeatedly and not getting there. Those are your coaching conversations.

 

4. Look at one rep's attempts

Click See details next to a rep to expand their attempt history.

Each attempt shows its number, its score, and the date.

What you seeWhat it means
A score, with View analysisA scored attempt. The link opens the full analysis in a new tab
No score, with View analysisThe attempt was recorded but not scored. You can still read the analysis
No score, marked AbandonedThe rep left before the attempt could be scored. There is nothing to read

ℹ️ A run shorter than 30 seconds cannot be scored. Repeated abandoned attempts usually mean a technical problem, not a reluctant rep. Point them to the troubleshooting article.

 

5. Read a rep's analysis

View analysis opens the same page the rep saw, headed with the role play name and the attempt number.

SectionWhat it gives you
Score and Pass scoreThe result against the bar
AI Trainer FeedbackThe written feedback the rep received
RecordingThe session, with a timeline of who spoke when and which topics were covered
Knowledge70% of the score. The per-topic breakdown
Style30% of the score. Clarity, pace, filler words, sentence length, and energy

Download PDF saves the analysis, which is useful for a coaching session or a review.

💡 Pro Tip: When a rep is close but not passing, the Knowledge breakdown tells you which topic to coach. The overall score does not.

 

6. Export the data

Click Download CSV on the Scores table to export the results, for example to combine with your other onboarding reporting.

💡 Pro Tip: Export at the end of each onboarding cohort rather than ad hoc. A saved snapshot lets you compare cohorts later, which is the thing leadership usually asks for.

 

7. Delete a role play

The delete icon sits next to the analytics icon, in the top right of the role play panel.

⚠️ Deleting removes the role play from the Learning Path. Reps who have not passed lose their route to completing that step.

Was this article helpful?
0 out of 0 found this helpful