Table of Contents

cs.CV [Back]

[1] Anatomy-Aware Synthesis of Post-Contrast Breast MRI from Pre-Contrast Images cs.CVPDF

Zhengbo Zhou, Dooman Arefan, Lin Gu, Ufara Zuwasti Curran, Shandong Wu

TL;DR: 用解剖区域监督从平扫乳腺MRI合成增强后图像，并评估图像质量及下游Ki-67分类。

Details

Motivation: 研究探索能否在不实际使用造影剂的工作流中生成增强后乳腺MRI，同时保留肿瘤和背景实质增强等关键区域。

Result: 回顾性纳入649名患者、6,251组配对图像；方法在整图及区域指标上优于Pix2Pix、Pix2PixHD、扩散合成和掩码监督基线。真实与合成图像训练测试下Ki-67分类差异不显著，但这不等于证明等效。

Insight: 图像转换模型联合乳房掩码一致性、病灶区域监督和背景实质增强区域监督，强化解剖结构相关的生成约束。

Abstract: We developed an anatomy-aware deep learning framework to synthesize post-contrast breast MRI from pre-contrast images, emphasizing tumor and background parenchymal enhancement (BPE) regions. This retrospective study included 649 patients with 6,251 paired pre-contrast and post-contrast images. The framework integrates breast mask consistency, lesion-region supervision, and BPE-region supervision into an image-to-image translation model. Evaluation included quantitative image quality metrics, a reader study with two breast radiologists, and downstream Ki-67 classification. The proposed method outperformed Pix2Pix, Pix2PixHD, diffusion-based synthesis, and mask-supervised baselines in whole-image and regional evaluations. Ki-67 classification showed no statistically significant performance differences across real- and synthetic-image training and testing settings, although this does not establish equivalence. These findings suggest that anatomy-aware supervision improves synthesis fidelity and support further investigation of synthetic post-contrast MRI for contrast-free imaging workflows.

cs.CL [Back]

[2] COMED: The Missing Middle Between Routing and Collaboration in Multi-LLM Inference cs.CL | cs.AIPDF

Norah Alballa, Wenxuan Zhang, Salma Kharrat, Fares Fourati, Zafar Ayyub Qazi

TL;DR: COMED在初始模型回答后按需升级到跨模型协作，兼顾错误救援与协作损坏正确答案的风险。

Details

Motivation: 单模型并非对所有查询都可靠；固定模型路由不再复核答案，密集协作又会对所有问题调用多个模型，甚至破坏原本正确的输出。

Result: 在16种开源模型设置中均改善固定或路由锚点，MedQA最高提升10.7个百分点且调用模型和生成token更少；前沿模型HLE上GPT-5.5从23.1%升至28.1%，超过密集协作。

Insight: 控制器综合锚点自一致性、路由置信间隔和轻量同伴探测，分别接受、核验或升级；选择性协作有效的条件是救回错误多于引入新损害。

Abstract: No single Large Language Model (LLM) is uniformly reliable across queries, motivating multi-model inference systems that either route among models or combine their outputs. However, routing stops after selecting an initial model, while dense collaboration invokes peers on every query. We show that collaboration is non-monotonic: peers can recover failures that no model solves alone, but can also corrupt initially correct answers. We introduce COMED (Controlled Model Escalation for Multi-LLM Deliberation), a post-anchor controller for selective cross-model collaboration. COMED uses anchor self-consistency, router margin, and a lightweight peer probe to accept confident answers, verify ambiguous cases, and escalate only when collaboration is likely beneficial. We formalize this trade-off with a rescue-harm decomposition showing that selective collaboration improves when rescued errors outweigh collaboration-induced harms. Across medical, scientific, and general reasoning benchmarks, COMED improves fixed and routed anchors in all 16 open-weight settings, with gains up to +10.7 percentage points on MedQA while invoking fewer models and using fewer decoded tokens than dense collaboration. On HLE with frontier models, COMED improves GPT-5.5 from 23.1% to 28.1%, outperforming dense collaboration and achieving the best results.

[3] Classifying Interpretive Canons at the Sentence Level: A Benchmark from the German Federal Constitutional Court cs.CL | cs.CYPDF

Felix Ringe

TL;DR: 构建德国联邦宪法法院判决的句级解释准则分类基准，并比较专家提示与遗传帕累托提示优化。

Details

Motivation: 司法推理仍难由大语言模型分析，尤其缺少按句子判断具体法律解释方法的评测数据和明确标准。

Result: 四个模型在七项二分类任务上的平均F1约为70.4至79.2；语法解释通常最易识别，体系解释最难。测试设置下GEPA优化提示未稳定超过专家手写提示。

Insight: 将Larenz—Savigny传统中的解释方法操作化为分类标准，并以法院判决逐句标注；专家提示可作为有意义的强基线。

Abstract: Judicial reasoning remains challenging for large language models (LLMs) to analyze. This paper contributes a sentence-level benchmark for evaluating the ability of LLMs to classify interpretive canons as articulated by Larenz in the tradition of Savigny. Our contributions are threefold. First, we operationalize this conception of interpretation as classification criteria. Second, we provide a dataset of decisions of the German Federal Constitutional Court annotated at the sentence level. Third, we report baseline evaluations of four LLMs from three model families under expert hand-written prompts, compared against prompts optimized with Genetic-Pareto (GEPA). Mean F1 over the seven binary subtasks clusters between 70.4 and 79.2 across models, with grammatical interpretation usually the easiest canon to identify and systematic interpretation usually the hardest; under the tested configuration, GEPA-optimized prompts do not systematically outperform the hand-written ones, suggesting that the expert prompts provide a meaningful baseline.

[4] Experts Rise Where LLMs Disagree: Using Cross-Model Disagreement to Target Expert Effort in LLM Codebook Revision for Large-Scale Annotation cs.CL | cs.AI | cs.HC | cs.LGPDF

Zeyu He, Zhuqian Zhou, Kirk Vanacore, Rene F. Kizilcec, Ting-Hao ‘Kenneth’ Huang

TL;DR: 用跨模型分歧定位需要专家处理的文本标注边界案例，比较三种专家反馈方式以加快代码本修订。

Details

Motivation: 大规模语料标注依赖稳定代码本，专家建立和修订规则常需数月；模型间高分歧可用于精准分配专家注意力。

Result: 数千份辅导对话实验中，给分歧案例标注并附理由达到64.9%标签准确率，高于专家修改代码本的57.8%；最佳问答式反馈为60.5%。

Insight: 让模型先按早期代码本标注并暴露分歧，再选择代码本核验、回答问题或理由标注等反馈形式，可将数月修订周期压缩到数天且不牺牲标注表现。

Abstract: Large-scale text annotation brings expert insight to millions of documents, often through a codebook that AI annotators follow. Developing a robust codebook, however, takes months. Large language models (LLMs) could speed this process by applying an early codebook to the data, surfacing cases with strong LLM disagreement, and eliciting expert feedback to address them. We examined three ways experts can provide feedback for LLM codebook revision: (i) editing LLM-generated revisions driven by cross-LLM disagreement (Codebook Verifying), (ii) answering questions about LLM disagreements (Question Answering), and (iii) labeling disagreement cases with rationales (Rationale Labeling). Experiments on thousands of tutoring-session transcripts show that Rationale Labeling yielded the highest LLM-labeling accuracy (64.9%) against expert labels, outperforming the expert-revised codebook (57.8%). The best Question Answering setting also outperformed it (60.5%). Our work shows that LLMs can be used to strategically target expert attention, shortening months of codebook revision to days without sacrificing labeling performance.

Qingjing Chen, Junkai Zhang, Shaochun Wang, Jiahao Ding, Siyuan Zheng

TL;DR: LEGO结合专家标注法条图检索与结构化法律思维链，增强复杂民法问题推理。

Details

Motivation: 普通RAG重词面或语义相似而忽略法条规范关系，通用思维链也可能生成听起来合理却不符合规范推理结构的解释。

Result: Qwen3-8B在LawExamQA_Civil精确匹配准确率40.53%，超过所测RAG及思维链基线；开放式基准也取得基线中的最佳结果。

Insight: ExpertGraphRAG依规范覆盖动态检索法条子图，ExpertCoT按“条文—事实—结论”组织证据；消融验证两模块各自及联合贡献。

Abstract: Large language models are increasingly applied to high-risk domains such as law, yet complex legal reasoning remains limited by two structural challenges. First, existing RAG and GraphRAG methods emphasize lexical or semantic similarity while overlooking normative relations among legal provisions. Second, vanilla Chain-of-Thought prompting may generate plausible rationales without enforcing the normative structure of legal reasoning. To deal with the bottleneck of pipelines in the legal reasoning domain, we propose LEGO, a dual-module framework that synergizes Legal Expert GraphRAG and expert Chain-of-thought for complex legal reasoning. ExpertGraphRAG uses an expert-annotated civil code graph encoding these normative relations with a greedy normative-coverage retrieval algorithm to dynamically extract instance-specific provision subgraphs, while ExpertCoT organizes the retrieved provisions and case facts into structured Provision-Fact-Conclusion reasoning. With a Qwen3-8B backbone, LEGO achieves 40.53% exact-match accuracy on LawExamQA_Civil, outperforming the evaluated RAG and CoT baselines and performing comparably to the evaluated larger models, while remaining robust on multi-hop questions. It also achieves the best results among the evaluated baselines on the open-ended benchmarks. Ablation studies confirm the individual and complementary contributions of both modules, demonstrating LEGO’s effectiveness in improving LLMs’ complex legal reasoning ability. Code and dataset can be found in the link: https://github.com/BLK-WHT/LEGO

[6] NADI 2026: The Second Multidialectal Arabic Speech Processing Shared Task cs.CLPDF

Peter Sullivan, Bashar Talafha, Ahmed Ashraf, Fethi Bougares, Haroun Elleuch

TL;DR: NADI 2026以五项任务和八个子任务评测多方言阿拉伯语语音处理，并加入翻译、语音合成和理解任务。

Details

Motivation: 现实方言语音需应对低带宽、混合方言、语码转换、域外和零样本条件，现有评测未充分覆盖这些难点。

Result: 21支来自至少13个国家的团队提交48份测试结果；域外泛化仍是主要瓶颈，阿拉伯语专用模型、多模态方言识别和集成方法表现有效。

Insight: 共享任务涵盖ASR、口语方言识别、TTS、口语翻译和口语理解，为稳健多方言处理提供更广、更难的评测体系。

Abstract: NADI 2026 is the seventh edition of the Nuanced Arabic Dialect Identification (NADI) shared task series and the second dedicated to multidialectal Arabic speech processing. This edition comprises five tasks and eight subtasks spanning Automatic Speech Recognition (ASR), Spoken Dialect Identification (SDID), Text-to-Speech (TTS), Spoken Language Translation (SLT), and Spoken Language Understanding (SLU). NADI 2026 emphasizes realistic evaluation through low-bandwidth, mixed-dialect, code-switched, out-of-domain, and zero-shot settings, while introducing TTS, SLT, and SLU to the series for the first time. The shared task attracted 21 participating teams from at least 13 countries, with 48 test-phase submissions and 14 submitted system-description papers. Results show that out-of-domain generalization remains a major bottleneck and highlight the effectiveness of recent Arabic-specialized speech models, multimodal dialect identification approaches, and ensemble methods. Overall, NADI 2026 provides a broader and more challenging benchmark for robust Arabic dialect speech processing.

[7] EduBehaviors: Assertion-based Schemas for Auditable Coding of Educational Dialogues cs.CL | cs.CY | cs.LGPDF

Julian Bernado, Ana Trindade Ribeiro, Xander Beberman, Susanna Loeb

TL;DR: EduBehaviors先标注教育对话中可观察的重复行为，再以这些行为预测教学构念，使标签依据可审计。

Details

Motivation: LLM能快速给教育对话打标签，但其推理不透明，研究者难以验证单条话语被如此分类的具体原因。

Result: 在TalkMoves教师对话标签任务上，最佳配置宏F1为0.673、Cohen’s κ为0.688，与直接提示方法有竞争力。

Insight: 把抽象构念拆解为可观察行为计数，再训练分类器映射到构念标签；同时发布工具包供研究者在自己的数据上应用。

Abstract: Large language models have allowed the rapid deployment of pedagogical annotations corresponding to constructs of interest, allowing a natural language interface for generating classifications on a conversational dataset. However due to the opaque nature of LLM reasoning, we have no verifiable, mechanistic insight into why a model chose a label for an utterance. We introduce the EduBehaviors framework, an interpretable, scalable approach to annotating educational data that uses LLMs to measure repeated observable behaviors relevant to many constructs of interest and then learns a classifier for the construct based on these observable behaviors. We evaluate the framework on the TalkMoves dataset, predicting the Teacher TalkMoves labels. Our best configuration results in a macro-F1 of 0.673 and 0.688 Cohen’s kappa, proving competitive with direct prompting approaches. In addition, we release EduBehaviors Toolkit, two tools allowing researchers to operationalize the EduBehaviors framework in their own data.

[8] Giving Credit Where It’s Due: Redundancy-Aware Learning for Efficient Reasoning cs.CL | cs.LGPDF

Yuqing Zhou, Hong Wang, Manqing Mao, Zhuoer Wang, Samson Koelle

TL;DR: RECAP根据推理步骤对后续结构的作用和对正确答案的实际贡献分配信用，压缩冗长推理而不牺牲准确度。

Details

Motivation: 只用整条轨迹或局部token信号训练难识别哪些步骤冗余、哪些支撑后续推导，可能导致缩短过程时损失正确性。

Result: Qwen2.5-Math-7B在四个数学基准上的pass@1提高2.0至3.7个百分点，推理token减少8%至31%。

Insight: 从语义依赖图向后传播结构责任，并用加入某一步前后金标准答案似然变化衡量步骤效能，再将GRPO轨迹优势转为逐步更新，无需另训过程奖励模型。

Abstract: Large reasoning models can produce correct yet unnecessarily long reasoning traces. Existing methods improve reasoning efficiency with trajectory-level objectives or local token- and step-level signals, but rarely model inter-step semantic dependencies. This limits their ability to distinguish redundant steps from those that support later deductions, making it harder to shorten reasoning without sacrificing accuracy. We introduce RECAP (REdundancy-aware Credit Assignment via Propagation), which addresses this limitation by assigning credit where it is due based on both a step’s downstream role in the reasoning structure and its contribution to solving the problem correctly. We define structural responsibility to capture the step’s downstream role by measuring how strongly later reasoning depends on it, using credit propagated backward from the final-answer node through an outcome-independent, LLM-annotated semantic dependency graph. However, a step can have high structural responsibility yet steer the reasoning away from the correct solution. RECAP therefore introduces step efficacy to measure answer-directed progress through changes in gold-answer log-likelihood as each step is added. Together, these signals reshape rollout-level GRPO advantages into step-specific updates. RECAP requires neither a separately trained process reward model nor preconstructed concise trajectories. Across two 7B models and four mathematical reasoning benchmarks, RECAP improves the accuracy-efficiency trade-off. On Qwen2.5-Math-7B, it improves pass@1 by 2.0-3.7 percentage points while reducing reasoning tokens by 8%-31% relative to GRPO across all four benchmarks. Analysis suggests these savings reflect fewer reasoning operations and less dead-end reasoning, rather than more compact expression.

[9] LOCKR: A Hidden-State Trajectory-Guided Planner for Detecting and Repairing Stable-but-Wrong Lock-In in Diffusion Language Models cs.CLPDF

Guoshenghui Zhao, Tan Yu, Weijie Zhao

TL;DR: LOCKR利用扩散语言模型的隐藏状态轨迹识别过早锁定的错误答案，并规划有针对性的测试时修复分支。

Details

Motivation: 扩散模型可能在去噪尚未结束时就稳定到错误答案；置信度、熵、间隔和答案稳定性等表面指标难可靠区分正确与错误锁定。

Result: 在两种扩散模型和三个数学基准的五种设置中，准确率绝对提升2.21至5.37个百分点，修复率22%至41%；隐藏轨迹优于表面指标和单一隐藏快照。

Insight: 将选择性修复视为轻量测试时规划：轨迹信号决定是否追加计算、扩展结构化修复分支，并通过轨迹感知验证挑选后续路径。

Abstract: Diffusion language models generate text through iterative denoising, exposing intermediate trajectories before final answers are produced. We identify a recurring reasoning failure, stable-but-wrong lock-in, where an answer stabilizes early around an incorrect value while substantial denoising remains. Surface-level decoding signals such as confidence, entropy, margin, and answer stability are insufficient to reliably distinguish correct from erroneous lock-in. We formulate selective reasoning repair as a lightweight test-time planning problem and propose LOCKR, a hidden-state trajectory-guided planner that decides when to allocate additional computation, expands a structured set of targeted repair branches, and selects the most promising continuation using trajectory-aware verification. Across two diffusion language models and three mathematical reasoning benchmarks, hidden-state trajectories consistently outperform surface signals and single hidden snapshots for both wrong-lock-in detection and repair selection. On natural evaluation distributions, LOCKR yields absolute accuracy gains of 2.21–5.37 percentage points across all five evaluated settings, with repair rates ranging from 22% to 41%. These results establish hidden diffusion trajectories as actionable signals for selective test-time reasoning repair.

[10] Realize What Matters: Principled Context Representation for Large-Scale Reasoning cs.CLPDF

Michael Theologitis, Dean Light, Shuyue Stella Li, Benjamin Newman, Yulia Tsvetkov

TL;DR: R3Con以相关性实现理论指导大规模上下文的组织方式，提升基于海量异构文档的推理。

Details

Motivation: 大型任务依赖分散在长文档中的关联证据；图、文本记忆和检索集合决定后续可进行何种推理，但构建方式往往凭经验。

Result: 在两个大语料推理基准上比最强基线分别高20和8.4个百分点；4B、9B版本超过所有所测35B模型，35B-A3B以低3.7倍成本超过Claude Code搭配Claude Sonnet 5。

Insight: 把相关性实现的设计原则落实到检索与推理流程，可减少对模型规模的依赖，让较小模型有效处理超长异构上下文。

Abstract: Solving complex tasks in domains such as science, medicine, law, and finance often requires assembling interdependent information scattered across vast, heterogeneous sources far beyond model context limits. Existing approaches tackle this challenge by organizing information into more manageable representations over which models can reason, such as graphs, textual memories, and retrieval collections. These representations dictate what downstream reasoning is possible and, ultimately, whether it succeeds; yet their design and construction remain largely ad hoc. In this work, drawing on the cognitive theory of relevance realization, we propose concrete principles for designing AI systems that construct effective representations of very large contexts. We analyze existing approaches and show how their successes and failures map onto their alignment with these principles, and introduce R3Con, a harness designed to operationalize the principles more systematically. We evaluate R3Con against nine state-of-the-art baselines on two recent benchmarks of reasoning over large document corpora. On these benchmarks, R3Con substantially outperforms the strongest baseline, by $20$ and $8.4$ percentage points. It also enables smaller models to outperform much larger ones: R3Con with 4B and 9B models outperforms all evaluated 35B baselines, while R3Con with a 35B-A3B model outperforms Claude Code with Claude-Sonnet-5 at $3.7\times$ lower cost. Our results show that context representations following our principled approach can reduce reliance on model scale, pointing toward a future of AI systems with frontier-level performance powered by smaller models. Our code is available at https://github.com/michaeltheologitis/r3con

[11] Distilling Sequential Computation in Transformer Language Models cs.CLPDF

Zixuan Lan, Jessica Yang, Yanhong Li, Karen Livescu, Jiawei Zhou

TL;DR: 用轻量合并模块将高可预测的连续token替换为功能等价的代理表示，以免改动模型结构地压缩推理序列。

Details

Motivation: Transformer逐token处理序列，长上下文成本高；部分相邻token高度可预测，可能可以用单个表征替代。

Result: 多种模型上有效序列长度最多减少40%，语言建模、问答、摘要、常识和长数学推理准确率仅有很小退化；轻量适配在部分设置进一步改善折中。

Insight: 合并模块把静态词嵌入序列映射成单个代理嵌入，推理时既压缩提示也压缩中间生成，并通过回滚机制将多token KV缓存项替换成单步代理。

Abstract: Transformer language models process sequences token by token in an autoregressive manner, making growing contexts increasingly expensive. Yet many adjacent token spans are highly predictable or frequently occur as stable units, suggesting that their representations may be compressible. We introduce a method for distilling sequential computation by replacing spans of input tokens with collapsed representations, computed on the fly by a lightweight merge module. This module generates a single surrogate embedding from a sequence of static token embeddings that captures the functional role of the multiple tokens, allowing pretrained models to operate on compressed inputs without architectural changes or re-training. We apply this approach during inference to compress both prompts and intermediate decoding steps, using a rollback mechanism to substitute stored multi-token KV cache entries with their single-step surrogates. Experiments across diverse models show that the merge module can be used to reduce effective sequence length by up to 40% with minimal accuracy degradation across language modeling evaluations and downstream tasks, including question answering, summarization, commonsense reasoning, and long-form mathematical reasoning. Additional lightweight adaptation of the merge module further improves the accuracy-compression trade-off in selected settings. These results demonstrate that sequential token computation in Transformers can be effectively approximated through condensed surrogate representations that approximate the original behavior without model updating.

[12] Ruby-ASR: Evidence-Preserving Supervision for Joint Orthographic and Lexical-Reading Recognition cs.CL | cs.AIPDF

Hao Shi, Yun Liu, Xuehao Yang, Jun Liu, Chuanbo Hua

TL;DR: Ruby-ASR以词段绑定的正字文本—词汇读音序列监督日语语音识别，同时恢复可读文字和实际发音。

Details

Motivation: 相同日语写法可能对应不同实际读音，传统识别把它们标成同一目标，之后仅凭文字转换读音也无法可靠消歧。

Result: 在五个日语基准上，细化监督目标提升词汇读音恢复且不牺牲可读的正字转录；摘要未列具体指标。

Insight: Ruby表征在局部绑定每段文字及其语音读法，可确定性恢复两个视图；以Qwen3-ASR为骨干，并用音拍级CTC提供单调读音辅助监督。

Abstract: Conventional Japanese automatic speech recognition (ASR) is supervised by an orthographic transcript, although the same written form can correspond to different lexical readings realized in speech. Such utterances receive an identical target, so their reading distinction is absent from the supervision interface and cannot be recovered reliably by post-hoc text-only grapheme-to-phoneme conversion. We present Ruby-ASR, which refines the conventional target into a span-bound orthographic–lexical-reading sequence. Unlike separate full-sentence orthographic and phonological outputs, the ruby representation locally binds each written span to its realized reading and permits deterministic recovery of both views. We instantiate the target under subtitle-style and verbatim-style transcription conventions using a Qwen3-ASR backbone; a mora-level CTC objective provides auxiliary monotonic reading supervision. The experimental results across five Japanese benchmarks show that refining the recognition target can improve lexical-reading recovery without sacrificing readable orthographic transcription. We release the checkpoints and inference code.

[13] Guides That Cause Actions: An Offline Study of Guide-Action Mutual Reinforcement in Multimodal Web Agents cs.CLPDF

Chengguang Gan, Yunhao Liang, QingHao Zhang, Shiwen Ni

TL;DR: WebMRE构建可完全复现的离线网页智能体基准，并研究人类可读指引如何因果性地影响操作动作。

Details

Motivation: 在线网页评测会受到环境状态和裁判变化影响，难以对同一模型稳定复现分数或控制研究训练机制。

Result: 基准覆盖541项任务和5,293步；提供正确指引作解码前缀可把动作准确率从0.422提高至0.684，换用其他步骤指引会降至0.055；微调模型在所有离线指标上超过零样本GPT-5.5、Claude Opus 4.8和Gemini 3.5 Flash。

Insight: 每步把面向人的指引句与落地动作配对；消融显示指引是承载目标语义的因果通道，而非事后评论，且其作用随模型规模变大。

Abstract: Web agents are usually evaluated in live environments, where environment state and judge models drift between runs, so the same checkpoint rarely reproduces the same score, making controlled studies of training phenomena impractical. We present WebMRE, an offline benchmark of 541 tasks and 5,293 steps derived from successful WebArena trajectories, with fully audited test labels and a deterministic protocol that scores a checkpoint identically on every run without any environment. Each step pairs a human oriented guide sentence with a grounded action, enabling the first study of the mutual reinforcement effect between them in web agents. Averaged over three seeds the effect holds for both models in both decoding orders and grows with scale: jointly decoding a guide lifts element selection over an action only reference by 0.9 and 0.2 points for Qwen3.5-4B and by 1.7 and 2.2 points for Qwen3.5-9B. A mediation analysis shows that the guide is a causal channel rather than commentary: forcing the gold guide as a decoding prefix lifts action accuracy from .422 to .684, another step’s guide collapses it to .055, and a paraphrase that renames the target still recovers half of the gain, so the channel carries instruction meaning and not only the label string. The same channel yields an offline reward that only a replayable protocol makes computable, though optimizing it from a strong checkpoint brings no gain yet. Our fine tuned models outperform GPT-5.5, Claude Opus 4.8, and Gemini 3.5 Flash, run zero shot, on every offline metric.

[14] Planned Test-Time Scaling with Coordinated Reasoning Paths cs.CL | cs.AIPDF

Xueqing Wu, Langxing Bai, Hritik Bansal, Po-Nien Kung, Shuo Li

TL;DR: PTTS用规划器为并行推理分支安排不同解题提纲，减少重复采样并提升测试时计算扩展效率。

Details

Motivation: 独立重复采样容易生成相似推理路径，追加计算预算无法充分探索互补解题思路。

Result: 五个数学基准上，Qwen3-1.7B及4B的PTTS-ZS pass@64较重复采样最多高6.7个百分点，PTTS-RL最多高13.4个百分点。

Insight: 规划器先分配各分支的解题提纲，执行器再生成完整答案；零样本版本一次生成全部提纲，训练版本直接按pass@k奖励优化规划器。

Abstract: Test-time scaling with parallel branches is widely adopted to improve performance on challenging reasoning tasks. The predominant approach, repeated sampling, draws branches independently from a single policy, which can produce redundant attempts and thereby limit the gains from additional inference compute. To address this limitation, we propose Planned Test-Time Scaling (PTTS), which replaces independent sampling with a coordinated joint policy: a planner generates a solution outline for each branch, steering the branches toward distinct reasoning paths, and an executor produces a full solution conditioned on each outline. Formally, we show that PTTS strictly generalizes repeated sampling and, in a stylized setting, provably promotes coverage of complementary reasoning modes and yields better pass@k scaling. We instantiate PTTS on top of strong reasoning models, keeping them fixed as executors while replacing repeated sampling with PTTS inference to further enhance test-time scaling. Concretely, we develop two variants: PTTS-ZS prompts a model to jointly generate outlines for all branches in a single autoregressive pass, while PTTS-RL directly optimizes the planner against the pass@k reward using truncated execution rollouts for efficient training and a sharper reward signal. Across five mathematical reasoning benchmarks with Qwen3-1.7B and 4B, PTTS-ZS improves pass@64 over repeated sampling by up to 6.7 points, while PTTS-RL further increases the gain to up to 13.4 points. Further analysis indicates that broader coverage of distinct reasoning paths contributes to these gains. Overall, PTTS provides a general framework for improving test-time scaling by coordinating reasoning branches, with zero-shot and trainable instantiations that yield substantial performance gains.

Nguyen Minh Chi, Mo El-Haj, Nguyen Ha Thanh, Dawn Knight, Paul Rayson

TL;DR: 构建越英双语越南劳动法问答集，并评估跨语种检索、翻译位置和核验修正对法规答案忠实度的作用。

Details

Motivation: 跨语言法规问答既要跨语种检索法条，也要防止生成无依据法律主张。

Result: 231组双语问答中75组标注五类难点；英到越检索时稀疏检索R@5约0.032，稠密检索0.358并略好于混合检索。核验修正仅使引文保留提升0.022至0.034，其他维度无可靠收益。

Insight: 自动评估检查引文、情态、例外、程序、结论和证据支持；翻译位置的差异没有显著影响这些指标，且自动诊断与人工答案质量判断并不完全一致。

Abstract: Cross-lingual legal question answering must retrieve statutes across languages while preventing unsupported legal claims. We introduce a bilingual evaluation suite of 231 Vietnamese–English question–answer pairs from Vietnamese labour law. Of these, 75 are additionally annotated for five challenging legal reasoning phenomena. We evaluate a verifier-guided pipeline that decomposes answers into claims, checks citation reachability and entailment, and corrects citation failures and contradictions. We also introduce six automatic diagnostics for faithfulness to retrieved evidence, covering citations, modality, exceptions, procedures, conclusions, and evidential support. Experiments show that learned-sparse retrieval performs poorly for English-to-Vietnamese retrieval (R@5=0.032), whereas dense retrieval reaches 0.358 and slightly outperforms hybrid retrieval. Translation placement has no statistically detectable effect on these automatic diagnostics in our controlled comparison and supporting sensitivity analyses. Verifier-guided correction improves citation preservation by $0.022$–$0.034$ at the system level but produces no reliable gains in the remaining dimensions. Human evaluation further shows that the automatic diagnostics do not fully align with human judgements of answer quality.

[16] PRISM-VLM: A Multi-Axis Discriminative Benchmark for Compact Vision-Language Models cs.CLPDF

Sanghee Park, Kee-Eung Kim

TL;DR: PRISM-VLM为紧凑视觉语言模型建立七维判别基准，揭示单一准确率无法反映的行为差异和能力瓶颈。

Details

Motivation: 偏向前沿模型的基准通常只给一个准确率，容易在简单饱和任务中压缩模型差距，或令困难任务分数聚集在低区间。

Result: 由15个公开基准题目组成的七维评分及综合PScore，在配对bootstrap下更可靠地区分模型；即使总分相似，谄媚等行为维度仍可能显著不同。

Insight: 逐题评估任务质量、行为鲁棒性及能力短板；谄媚行为与单提示准确率近乎正交，说明综合分应保留多轴画像。

Abstract: Compact vision-language models (VLMs) now power a growing share of multimodal applications. The benchmarks used to compare them, however, inherit a frontier-centric design: each model is reduced to a single accuracy number, narrowing the inter-model gap on saturated suites and pressing models into low-score bands on harder ones. We introduce PRISM-VLM, a multi-axis discriminative benchmark that scores every item along seven axes covering the recurring failure modes (task quality, behavioral robustness, and capability bottlenecks) and combines them into a single PScore, with items recycled from fifteen public benchmarks. Across compact VLMs from the past two years, PScore separates model pairs more reliably than prior single-axis benchmarks under an item-level paired bootstrap, and surfaces behavioral differences these benchmarks average away. Even models with statistically indistinguishable PScores diverge sharply along the per-axis profile, particularly on sycophancy, which is nearly orthogonal to single-prompt accuracy. We will release the full pipeline, prompts, and per-item annotations.

[17] The Path Matters: Evaluating Small Language Models Beyond Answer Accuracy in KGQA cs.CL | cs.AIPDF

Eduin E. Hernandez, Sergio A. Diaz, Luis F. Garcia, Nurassyl Askar, Stefano Rini

TL;DR: 将小模型知识图谱问答拆分为可控图导航决策，联合评测最终答案正确率与推理路径忠实度。

Details

Motivation: 端到端KGQA混合了图访问、搜索、导航、推理和答案生成，答错时难判断问题是否来自路径选择。

Result: 在Kinship和MQuAKE-ST上，同规模本地模型的答案准确度和路径忠实度差异明显，两项指标有时偏好不同模型；单个演示轨迹的效果也因模型而异。

Insight: 用THESEUS逐跳提供合法图动作，让冻结小模型选择动作或停止，不做模型控制的束搜索或自由答案生成；以Hits@1和路径编辑距离分别测结果与过程。

Abstract: Small language models (SLMs) are increasingly paired with knowledge graphs (KGs), yet end-to-end KG question answering conflates graph access, search, navigation, reasoning, and answer generation. This coupling makes it difficult both to determine whether an SLM can faithfully execute the reasoning path implied by a question and to attribute failures to navigation rather than to other stages of the pipeline. We isolate this capability by employing the THESEUS navigation and traceability framework and using frozen, off-the-shelf SLMs as local action policies. At each hop, the environment exposes the legal outgoing graph actions, and the model selects one executable graph action and decides whether to stop, without task-specific parameter updates, model-controlled beam search, or free-form answer generation. This controlled setting allows us to evaluate terminal-answer accuracy with Hits@1 together with path fidelity, using Path Edit Distance (PED) as the primary trajectory metric. Across the Kinship and MQuAKE-ST KGQAs, similarly sized local models differ substantially in answer accuracy and path fidelity, with the two metrics sometimes favoring different models. This model-dependent behavior also extends to prompting, as a single demonstrated trajectory can improve or degrade navigation depending on the model. These results motivate evaluating SLM graph reasoning beyond endpoint accuracy alone.

[18] SkillGym: Internalizing Human Skills into LLMs for Real-World Problem Solving cs.CLPDF

Zhilong Ge, Yuting Shao, Yutao Yang, Yuxuan Cai, Jie Zhou

TL;DR: SkillGym将人类撰写的智能体技能转成可执行、可验证训练环境，让模型把工作流程内化为可复用能力。

Details

Motivation: 技能文档通常只在推理时作为外部指令使用，没有变成模型自身可迁移的程序性能力。

Result: 构建12类、2,756个环境和8,364条成功轨迹；Qwen3.5-35B-A3B微调后在GDPval-AA、Terminal-Bench及SkillsBench等任务显著提升，SkillGym-Agent在技能辅助SkillsBench得分51.47%。

Insight: 技能转任务流程实例化具体工作并以代码检查结果，使用对照执行检验技能依赖；验证轨迹支持监督微调，结果奖励支持强化学习。

Abstract: Human-written agent skills encode rich workflows for real-world problem solving, but are typically used as external inference-time instructions rather than internalized as reusable model capabilities. We introduce \texttt{SkillGym}, a framework that transforms these skills into executable, verifiable training environments for large language model agents. Its skill-to-task pipeline instantiates concrete tasks, verifies outcomes with code-based checkers, and assesses empirical skill dependence through contrastive executions. We construct and release 2,756 environments across 12 categories and collect 8,364 successful trajectories from multiple models and harnesses, averaging 49 tool calls and over 60k logged text tokens. These resources support supervised fine-tuning on verified workflows and reinforcement learning with outcome-based rewards. Under Claude Code, supervised fine-tuning improves Qwen3.5-35B-A3B by 199 Elo on GDPval-AA v2, 19.10 percentage points on Terminal-Bench 2.1, and 28.13 and 12.38 points on SkillsBench v1.1 with and without skills, respectively. Our 35B \texttt{SkillGym-Agent} reaches 51.47% on skill-assisted SkillsBench, exceeding reported scores for Claude Sonnet 4.6, GPT-5.4 Mini, and DeepSeek V4 Pro. Without skills, it also surpasses skill-assisted bases under Codex and Claude Code, suggesting reusable procedural competence.

[19] Improving LLM-based Autonomous Web Agents with Filtering cs.CLPDF

Zhitong Guo, Jing Yu Koh, Ruiyu Li

TL;DR: 先过滤网页HTML中与任务无关的元素，再提供给智能体，以缓解上下文窗口被冗余页面源码占满的问题。

Details

Motivation: 原始HTML包含大量噪声，影响上下文有限的LLM网页智能体理解与操作页面。

Result: Mind2Web轨迹训练的DeBERTa相关性排序器使LLaMA-2-70B在WebArena成功率从1.97%升至2.96%；零样本ColBERT在Mind2Web和WebArena上的目标元素召回率分别为0.52和0.47。

Insight: 比较DeBERTa和T5两种HTML元素筛选模型，并将Mind2Web训练的过滤器迁移至WebArena，测试相关页面上下文选择对任务执行的作用。

Abstract: Autonomous web agents, powered by Large Language Models (LLMs), have garnered significant attention for automating various web-based tasks with multi-step reasoning and decision-making capabilities. An open research question in the development of these agents lies in the format of the webpage input. Raw HTML source code, with its extensive and often irrelevant details, poses difficulties for LLMs with limited context windows. To address this challenge, we first reproduce baseline models such as GPT-3.5 and LLaMA-2-70B on the WebArena (Zhou et al., 2023) benchmark, identifying common failure modes. We then propose two retrieval strategies to filter out irrelevant context for LLM agents. We develop DeBERTa-based and T5-based models that rank HTML elements by their relevance to the task. We fine-tune them on Mind2Web trajectory data and transfer them to WebArena. Experiments show that our DeBERTa-based model improves the success rate of the LLaMA-2-70B LLM agent on WebArena from 1.97% to 2.96%. Moreover, we develop a zero-shot ColBERT-based retriever that is able to retrieve the ground-truth element with a recall of 0.52 on Mind2Web and 0.47 on WebArena.

[20] Beyond Unsafe Detection: Counterfactually Anchored Evidence Attribution for Multi-Turn LLM Safety Failures cs.CL | cs.AIPDF

Srinivasan Subramanian, Kazi Aminul Islam, Md. Abdullah Al Hafiz Khan

TL;DR: 提出轻量分层归因模型，不只检测多轮对话安全失败，还定位促使对话走向不安全的轮次和词元证据。

Details

Motivation: 多数防护评测只判断请求安全或不安全，但多轮攻击意图分散在上下文中，单一标签无法定位失效来源。

Result: 1,762段对话上检测F1为0.988；删除归因最高的15%词元后，攻击分类置信度下降51.1%。高风险词汇的无害对话误报低于1%，而关键词基线达37.3%及94.7%；人类证据轮次出现在前五归因轮次中的比例为84.5%。

Insight: 数据同时包含对抗对话、无害孪生及带高风险词汇的无害变体；模型输出违规判断及其对应用户轮次和词元跨度，以反事实与分层证据监督解释攻击路径。

Abstract: As Large Language Models (LLMs) move from conversational assistants to advanced agentic systems, guardrail failures can convert adversarial intents into harmful executions. However, most guardrail evaluation frameworks focus only on the result and assess whether a user request is safe or unsafe. This approach is insufficient for multi-turn failures, where adversarial intent is distributed across multiple turns. This motivates us to go beyond detection to identify the turns and tokens that push the conversation toward unsafe trajectories. To support this, we construct a multi-turn dataset with behavioral validation and tiered evidence supervision. The dataset contains 1,762 conversations, including adversarial conversations, benign twins, and benign variants with high-risk vocabulary. We train a lightweight hierarchical attribution model that predicts safety violations and attributes them to contributing user turns and token spans. The model achieves strong detection performance (F1=0.988), and removing the top 15% of attributed tokens reduces the adversarial classification confidence by 51.1%. The model preserves low false positive rates on benign conversations with high-risk vocabulary, with false positives below 1% on both borderline benign and benign high-risk vocabulary conversations, compared to 37.3% and 94.7% for a keyword-based surface-risk baseline. Independent human annotation supports the model’s attribution performance, with the top-five attributed turns containing a human-identified evidence-bearing turn in 84.5% of adversarial cases.

[21] LabourCrew: A Multi-Agent RAG Framework for Trustworthy Adversarial Deliberation and Statutory Reasoning over Labour Law cs.CL | cs.AI | cs.IRPDF

Fatema Tuj Johora Faria, Mukaffi Bin Moin, Jubayer Al Mahmud, M. F. Mridha, Md. Alam Hossain

TL;DR: LabourCrew结合条文关系图、受限证据交换和校准信任门，为孟加拉劳动法问答提供可审计多智能体推理。

Details

Motivation: 劳动权益回答中的每个法律主张都必须有依据；普通RAG难识别证据不足，多智能体辩论又可能引用未检索法条。

Result: 在500题孟加拉语劳动法基准上，经验误接受率为0.081，符合α=0.10目标；答案相关性0.862，高于所比RAG基线，且难度增加时表现逐步下降。

Insight: StatuteGraph显式连接章节、条款、但书与交叉引用；证据账本禁止引用未检索文本，校准信任分数结合保形风险控制对无依据答案进行拒答。

Abstract: In statutory question answering, every claim must be traceable to evidence, not merely relevant, since unverifiable labour-rights answers carry serious legal consequences. Current systems fall short: single-pass RAG cannot detect insufficient evidence, while multi-agent legal-debate systems treat grounding as a prompting convention, letting agents cite unretrieved evidence. To address this gap, we introduce LabourCrew, a multi-agent RAG framework built around three grounding mechanisms: StatuteGraph, a graph index that explicitly links chapter, section, proviso, and cross-reference structure rather than fixed-length spans; an Evidence Exchange Protocol that confines advocates and an interpreter to an evidence ledger, making citation to unretrieved text impossible, while a fault-tolerant supervisor board runs advocates in parallel so individual failures degrade rather than crash the system; and a Calibrated Trust Gate that replaces categorical accept/reject decisions with a trust score, thresholded via conformal risk control for a distribution-free bound on the false-accept rate. We evaluate on LabourActQA, a 500-item Bangla question set from the Bangladesh Labour Act, 2006, spanning seven reasoning categories and three difficulty tiers. The framework drives the empirical false-accept rate to 0.081, within the target level ($α= 0.10$), achieves the highest Answer Relevancy among HyDE RAG, Graph-RAG, and Hierarchical RAG (0.862 $>$ 0.839, 0.815, 0.828), and degrades gradually rather than catastrophically as question difficulty increases. These results show that calibrated abstention, not retrieval quality alone, is what makes legal question answering auditable in low-resource statutory domains.

cs.AI [Back]

[22] CAVEAT: Towards Robust Computer-Use Agents in Incentive-Misaligned Environments cs.AI | cs.CLPDF

Yuxuan Li, Will Epperson, Wesley Deng, Zezhou Huang

TL;DR: CAVEAT评估电脑操作智能体在利益不一致的线上市场中能否维护用户购物目标，并按诊断结果设计干预。

Details

Motivation: 网页平台可能有自身商业动机而引导智能体，现有基准通常只测合作环境或明确攻击，未检验环境利益冲突。

Result: 五类模型在匹配控制场景中78.6%选择用户最优商品，启用诱导后仅17.3%；CAVEAT-Harness针对发现的失效环节使用户最优购买率提升55.0%。

Insight: 轨迹分析定位三种偏离：扭曲用户优先级、过早缩窄备选集合、尚未查清相关证据就承诺选择；较大模型和更多推理只能部分缓解。

Abstract: Computer-use agents (CUAs) increasingly act on behalf of users online. What happens when the environments they operate in have incentives that do not align with the user’s? In online marketplaces, for example, platforms may favor some products over others, potentially steering agents away from the user’s objective. Existing CUA benchmarks cover cooperative settings or explicit attacks, but do not test whether agents preserve user objectives when the environment itself has a stake in the outcome. We introduce CAVEAT, a controlled benchmark spanning nine marketplace environments and a taxonomy of eight common steering mechanisms. Across five model families, agents purchase the user-optimal product in 78.6% of matched-control episodes but only 17.3% when steering mechanisms are enabled. Larger models and increased reasoning improve robustness, but substantial failures persist. Our trajectory analysis and targeted ablations identify three points where steering enters the decision process: (1) agents distort the user’s priorities, (2) prematurely narrow the set of alternatives they consider, and (3) commit before resolving decision-relevant evidence. Guided by this diagnosis, we develop CAVEAT-Harness, which directly targets these failure modes and raises user-optimal purchasing by 55.0%. Targeted post-training further improves a smaller open model. These results establish incentive robustness as a distinct challenge for delegated agents, diagnose how it fails, and show that targeted interventions can substantially improve it.

[23] EnSIMem: Entity-Structured Indexing for Long-Term Agent Memory cs.AI | cs.CLPDF

Xuanyu Meng, Xing Fan, Xinyi Fan, Chenlei Guo, Yixuan Xie

TL;DR: EnSIMem以实体—类型—属性值索引长期对话记忆，并保留原始轮次和时间来源供回答核验。

Details

Motivation: 通用摘要或匿名文本块难帮助智能体找准实体、属性及证据出处，不利于处理长期事实变更和组合查询。

Result: 在长期智能体记忆基准上实现较高答案准确率，同时保持上下文紧凑及较好的在线效率；摘要未给出具体分数。

Insight: 离线阶段把对话组织为主题连贯事件并建立带来源的实体属性索引；在线按问题拆解证据需求、自适应检索后根据原始证据生成答案，而非依赖有损摘要。

Abstract: An agent that interacts with users over long periods must recall facts, preferences, events, and changes from a continuously growing interaction history. Existing memory systems often compress interactions into generic summaries or retrieve anonymous text chunks, making it difficult for an agent to identify the correct entity, property, and supporting evidence. We present EnSIMem, an entity-structured long-term memory architecture for an agent. During offline construction, the system organizes interactions into theme-coherent episodes and builds dialogue-grounded index entries of the form [entity][entity type][property:value]. Each entry preserves its source turns, temporal information, and available multimodal fields. During online interaction, the agent’s request is decomposed into evidence requirements whose properties are aligned with the memory index. Entity-property lookup and adaptive retrieval then collect the evidence needed for point, temporal, compositional, and aggregation reasoning. The agent generates its response from the preserved source evidence rather than from lossy memory summaries. On long-term agent-memory benchmarks, EnSIMem achieves high answer accuracy while maintaining compact contexts and favorable online efficiency. These results show that entity-structured indexing and episode-level provenance provide a reliable foundation for long-term memory in agents. The code of our model is available at https://github.com/RamonMeng/EnSIMem.

cs.MM [Back]

[24] Small Cues, Big Consequences: Learning Pivotal Cues for Multimodal Meme Classification cs.MM | cs.CL | cs.LGPDF

Akshit Sharma, Prashant W. Patil

TL;DR: MemePIVOT通过局部关键证据与全局语境联合建模，分类梗图中的伤害、仇恨和讽刺表达。

Details

Motivation: 梗图意义常由很小的视觉、文字或跨模态线索决定，单纯使用全局图文表示可能忽略关键证据。

Result: 在HarMeme、PrideMM和新建MemeCF上，较文本、图像、多模态及视觉语言基线均持续提升；跨数据集与消融实验也支持关键线索建模的鲁棒性收益。

Insight: MemeCF含9,895张图及关键证据模态和理由标注；MemePIVOT用非平衡最优传输对齐词语和图像块，允许无关线索不匹配，再融合局部定位和全局语境。

Abstract: Memes often derive their harmful, hateful, or sarcastic meaning from small but decisive visual, textual, or cross-modal cues. Existing multimodal classifiers can miss such evidence when relying mainly on global image-text representations. We introduce MemeCF, a cue-focused benchmark of 9,895 memes across harm, hate, and sarcasm, with annotations identifying the modality and rationale of the pivotal evidence. We also propose MemePIVOT, a local-global architecture for meme classification. MemePIVOT uses frozen CLIP features, unbalanced optimal transport to align words with image patches while allowing irrelevant evidence to remain unmatched, and an evidential fusion head to combine local grounding with global meme context under uncertainty. Experiments on HarMeme, PrideMM, and MemeCF show consistent gains over strong text-only, image-only, multimodal, and vision-language baselines. Cross-dataset and ablation results further show that explicit pivotal-evidence modeling improves robustness and contributes meaningfully beyond global multimodal representations. Our code and dataset are publicly available at https://github.com/AkshitSharma1/MemePIVOT