大模型
arxiv.org ·
护栏还是路障?教学风格与情境感知对编程 AI 助教的影响
该 arXiv 论文通过 132 名入门编程课学生的随机对照试验,比较四种 AI 助教设计:教学引导风格(苏格拉底式提问 vs. 直接讲授)与情境感知(无上下文 vs. 含题目与学生解答的完整上下文)。结果显示,苏格拉底式+完整上下文组合的学生评价最低,对任务完成的感知支持显著更低;该条件下观察到的交互压力最高、转向外部通用 LLM 的比例最高、任务后解释中体现完整理解的比例最低,但后三项差异未达统计显著。作者据此认为,带护栏的 AI 助教并非天然更利于学习,其效果取决于教学引导与情境感知如何平衡到学生认为有用、支持充分且愿意继续使用。
AI推荐理由 arXiv 预印本,作者含 Paul Denny 等教育技术领域研究者,方法为 132 人随机对照试验,事实与局限(多数差异未达统计显著)表述明确,信息密度较高。新信息在于:在编程入门课中,苏格拉底式提问+完整上下文的 AI 助教反而获得最低主观支持评价,并伴随最高的外部通用 LLM 使用率与最低的完整理解比例(后两项为描述性、未达显著)。对 AI 教育产品与 Agent 护栏设计有直接参考价值,但样本单一课程、结论为初步证据,且无代码或数据公开细节,故未给更高分。
72
正文
Computer Science > Human-Computer Interaction
arXiv:2609.29995 (cs)
[Submitted on 24 Sep 2026]
Title:Guardrails or Roadblocks? Effects of Pedagogical Style and Context Awareness in AI Teaching Assistants for Programming
Authors:Madeleine Eastwood, Harshith Narne, Joseph Hilby, Paul Denny, Ashish Aggarwal, Amanpreet Kapoor
View a PDF of the paper titled Guardrails or Roadblocks? Effects of Pedagogical Style and Context Awareness in AI Teaching Assistants for Programming, by Madeleine Eastwood and 5 other authors
View PDF
HTML (experimental)
Abstract:AI teaching assistants (AI TAs) backed by large language models (LLMs) and pedagogical guardrails are increasingly being integrated into programming courses, providing students with scalable access to hints, conceptual explanations, and code-level feedback. However, guardrails may also create friction. If students feel that the support provided is overly restrictive or poorly contextualized to their current progress, they may bypass approved tools for general-purpose LLMs. To investigate how AI TA design affects students' learning experiences, we conducted a randomized controlled trial with 132 students in an introductory programming course. Students completed three tasks related to code-writing and debugging and were randomly assigned to one of four AI TAs varied across two dimensions: pedagogical guidance style (Socratic vs. Direct instruction) and context awareness (no context vs. full context of the problem and student solution). We examined students' perceptions, interaction behaviors, and evidence of post-task comprehension. Students rated the Socratic AI TA with full context least favorably, reporting significantly lower perceived support for task completion. Descriptively, this condition also showed the highest observed interaction stress, the highest rate of external LLM use, and the lowest proportion of post-task explanations demonstrating full comprehension, though these differences were not statistically significant. These findings suggest that guardrailed AI TAs are not automatically better for learning. Instead, their effectiveness depends on how pedagogical guidance and contextual awareness are balanced in ways that students experience as useful, supportive, and worth continuing to use.
Subjects:
Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2609.29995 [cs.HC]
(or
arXiv:2609.29995v1 [cs.HC] for this version)
https://doi.org/10.48550/arXiv.2609.29995
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history
From: Amanpreet Kapoor [view email]
[v1]
Thu, 24 Sep 2026 15:43:49 UTC (788 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled Guardrails or Roadblocks? Effects of Pedagogical Style and Context Awareness in AI Teaching Assistants for Programming, by Madeleine Eastwood and 5 other authors
View PDF
HTML (experimental)
TeX Source
view license
Current browse context:
cs.HC
new
|
recent
| 2026-09
Change to browse by:
cs
cs.AI
References & Citations
NASA ADS
Google Scholar
Semantic Scholar
export BibTeX citation
Loading...
BibTeX formatted citation
×
loading...
Data provided by:
Bookmark
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)