arXiv:2611.07072v1 Announce Type: new Abstract: Automated feedback on classroom discourse improves instruction in professional and online teaching contexts, and recent work suggests that delivering similar feedback to learners may strengthen these effects by sharing responsibility for participation. Whether this holds in small-group volunteer tutoring has not been tested. We present results from a randomized controlled trial across two four-week SAT mathematics bootcamps on the Schoolhouse.world platform, involving 1,030 volunteer tutors, 7,443 learners and 6,508 recorded sessions. Tutors were randomly assigned to receive no feedback, automated feedback on their own discourse, or that feedback together with participation feedback delivered to their learners under one of two motivational framings. Feedback to tutors increased eliciting of learner ideas, uptake of learner contributions, and learner reasoning by 8-15%, and the pattern replicated across both bootcamps. However, tutor talk time, which averaged 91.5% in the control group, did not change in any condition, and learner-facing feedback did not further change discourse. Interviews with 17 tutors indicate that they adopted the moves the feedback recommended but were limited by learners who did not respond. Interviews with 13 learners suggest why the learner-facing feedback had little effect: it reported a group-level rather than a learner-level statistic, some learners preferred to listen, and learner-to-learner interaction was rare in these sessions. Automated feedback can change how tutors invite learner thinking, but shifting how much learners talk likely requires changes beyond feedback.
Automated Feedback to Peer Tutors Increases Their Talk Moves and Learner Reasoning but Not the Balance of Talk
Automated feedback to volunteer tutors raised eliciting of learner ideas, uptake of learner contributions and learner reasoning by 8-15% in a randomized controlled trial across two four-week SAT mathematics bootcamps on Schoolhouse.world, according to an arXiv paper (2611.07072v1) covering 1,030 tutors, 7,443 learners and 6,508 recorded sessions. Tutor talk time, which averaged 91.5% in the control group, did not change in any condition, and feedback delivered to learners under two motivational framings did not further alter discourse. Interviews with 17 tutors found they adopted the recommended moves but were limited by unresponsive learners, while interviews with 13 learners attributed the weak learner-facing effect to group-level rather than learner-level statistics, a preference for listening, and rare learner-to-learner interaction.
Run your AI side-project on zahid.host
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.