大模型
arxiv.org ·
STRETCH:面向渐进式 LLM 演化的统一自教框架
该 arXiv 论文提出 STRETCH(Self-Taught Reasoning Evolution via Targeted CHallenge),受认知脚手架理论启发,引入动态 Stretch Zone 机制,持续将问题难度与模型求解能力对齐。模型在同一参数空间内交替充当生成边界挑战的 Scaffolder 和用强化学习优化求解轨迹的 Learner,双环协同演化以稳定训练、缓解奖励劫持并促进推理能力渐进增长。在谈判和运筹学基准上,摘要称其持续优于强提示与领域专用基线;脚手架配置分析显示动态难度对齐对持续能力提升至关重要。
AI推荐理由 arXiv 新提交论文(2026-09-16),提出 STRETCH 统一自教框架,用动态 Stretch Zone 机制让模型在单一参数空间内交替扮演生成自适应挑战的 Scaffolder 与通过强化学习优化求解轨迹的 Learner,以缓解自改进训练中固定难度导致的能力停滞。摘要称在谈判与运筹学基准上优于强提示和领域专用基线,并称动态难度对齐对持续能力提升关键。局限:仅摘要级证据,未提供具体数值、代码或复现细节,效果需进一步验证。
72
正文
Computer Science > Computation and Language
arXiv:2609.18642 (cs)
[Submitted on 16 Sep 2026]
Title:STRETCH the Boundaries: A Unified Self-Taught Framework for Progressive LLM Evolution
Authors:Yajie Yu, Mark Lee, Yue Feng
View a PDF of the paper titled STRETCH the Boundaries: A Unified Self-Taught Framework for Progressive LLM Evolution, by Yajie Yu and 2 other authors
View PDF
HTML (experimental)
Abstract:Large language models (LLMs) often suffer from capability stagnation in self-improvement training because fixed difficulty levels fail to adapt to their evolving proficiency. To address this issue, we propose STRETCH (Self-Taught Reasoning Evolution via Targeted CHallenge), a unified framework inspired by cognitive scaffolding theory. STRETCH introduces a dynamic Stretch Zone mechanism that continuously aligns question difficulty with the model's solving capability. Within a single parameter space, the model alternates between a Scaffolder that generates adaptive, boundary-pushing challenges and a Learner that that optimizes its solving trajectories through reinforcement learning. This dual-loop co-evolution effectively stabilizes training, mitigates reward hacking and promote progressive reasoning growth. Experiments on both negotiation and operation research benchmarks demonstrate that STRETCH consistently outperforms strong prompting and domain-specific baselines. Further scaffolder configuration analysis shows that dynamic difficulty alignment is critical for sustained capability improvement and synchronized reasoning evolution.
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2609.18642 [cs.CL]
(or
arXiv:2609.18642v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.18642
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history
From: Yajie Yu [view email]
[v1]
Wed, 16 Sep 2026 13:27:16 UTC (506 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled STRETCH the Boundaries: A Unified Self-Taught Framework for Progressive LLM Evolution, by Yajie Yu and 2 other authors
View PDF
HTML (experimental)
TeX Source
view license
Current browse context:
cs.CL
new
|
recent
| 2026-09
Change to browse by:
cs
References & Citations
NASA ADS
Google Scholar
Semantic Scholar
export BibTeX citation
Loading...
BibTeX formatted citation
×
loading...
Data provided by:
Bookmark
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)