cs.CL [Total: 34]
cs.CV [Total: 74]
cs.AI [Total: 9]
cs.CR [Total: 3]
cs.HC [Total: 1]
cs.IR [Total: 1]
cs.LG [Total: 6]
cs.RO [Total: 2]
cs.SD [Total: 1]
eess.IV [Total: 1]
q-bio.NC [Total: 1]
stat.ML [Total: 1]

cs.CL [Back]

[1] alkhder at ImageEval 2026 Shared Tasks: Constrained Selection and Rotation-Averaged Logit Scoring for Multimodal Hallucination Detection cs.CLPDF

Maher Pasa, Maria Hanini, Amro Najjar, Hasan Alkhder

TL;DR: 该参赛系统用零样本7B视觉语言模型和候选轮换，处理英阿双语图像陈述真假选择任务，并降低了相对官方3B基线的CI分数。

Details

Motivation: ImageEval 2026子任务要求模型从配图的三个候选陈述中选出唯一视觉上成立的一项，且需同时应对英语与现代标准阿拉伯语。答案位置偏差可能影响选择结果，参赛方案希望在不针对任务微调的条件下控制此类偏差。

Result: 系统使用预训练7B视觉语言模型，在零样本设置下依据下一token对候选答案的对数概率作受约束选择，并以拉丁方方式轮换候选陈述的位置。英语测试集CI为0.0510，现代标准阿拉伯语测试集CI为0.0960；相较官方报告的3B模型devtest基线，CI分别降低83.7%和80.4%。

Insight: 结果显示，候选位置轮换与对数概率选择可在该共享任务设置中取得较低CI，且阿拉伯语表现相对基线的降幅也较大。比较涉及测试集与devtest基线，摘要未提供绝对准确率、置信区间或完整可复现配置，不能将CI降幅直接视为准确率提升。

Abstract: We describe our submission to Subtask~1b of ImageEval 2026. The task consists of selecting the single visually valid statement from three candidates paired with an image, and is in both English and Modern Standard Arabic (MSA). Our system uses a pre-trained 7B vision–language model in a zero-shot setting, without task-specific training or fine-tuning. We formulate the task as a constrained selection problem and choose the answer using next-token log-probabilities. To reduce answer-position bias, we apply a Latin-square rotation to the candidate statements. Our system achieves CI scores of 0.0510 on the English test set and 0.0960 on the MSA test set, reducing CI relative to the official 3B baselines reported on devtest by 83.7% and 80.4%, respectively.

[2] RealCLI: Toward a Unified Evaluation of Human-Agent Collaboration for CLI Agents cs.CLPDF

Yunqi Liu, Peiyu Wang, Bingli Wang, Leo Luo, Xuanwu Song

TL;DR: REALCLI用成对任务基准同时评估命令行智能体的执行效果与运行时人机协作，发现前沿智能体在可操控性、信任校准和安全边界方面仍较弱。

Details

Motivation: 现有CLI智能体基准通常假设用户一开始就给出完整且不变的指令，或只评价最终任务结果，因而没有衡量执行期间逐步补充信息、纠正方向、修改约束和授权决策等协作质量。

Result: REALCLI建立五维协作评估框架，包含22个子维度和51种交互场景模板。它提供配对模式：REALCLI-EXEC在开始时给出完整任务说明，REALCLI-COLLAB则由脚本化用户逐步提供信息、纠正、调整约束和授权决定。实验中最佳配置平均得分仅49.2%；联合协作分数J_collab最高为37.6%。模型在可操控性、信任校准和安全边界管理上反复失误。

Insight: 配对评测能揭示单看任务完成率时容易忽略的协作问题，可为CLI智能体的交互能力改进提供可复现基础。摘要没有给出具体模型清单及各子维度分数，报告的结果应理解为该基准设置下的总体表现。

Abstract: Command-line interface (CLI) agents increasingly execute longer-horizon tasks, yet existing benchmarks either assume that user instructions remain fixed throughout execution or evaluate task outcomes without capturing runtime collaboration quality. In this paper, we present REALCLI, a paired benchmark that unifies the evaluation of task execution and human-agent collaboration quality on realistic CLI tasks. To comprehensively measure collaboration, REALCLI builds a five-dimensional framework, operationalized into 22 sub-dimensions and 51 interaction scenario templates. REALCLI provides two modes for paired comparison: REALCLI-EXEC supplies complete specifications upfront, whereas REALCLI-COLLAB introduces a scripted user that delivers progressive information, corrections, constraint revisions, and authorization decisions. Evaluations reveal profound capability gaps in frontier agents: the best configuration attains an average score of only 49.2%, and when evaluated by the joint collaboration score ($J_{\mathrm{collab}}$), the peak performance reaches merely 37.6%. These results show that task effectiveness diverges sharply from collaboration quality, with models consistently struggling in steerability, trust calibration, and safety boundary management. REALCLI provides a rigorous, reproducible foundation for measuring and advancing collaborative CLI agents.

[3] A Plausible Explanation Is Enough to Mislead Multimodal Judges cs.CL | cs.AIPDF

Anglin Cai, Zhiqi Wang, Xiaozhi Yang, Yurun Lin, Dongwon Lee

TL;DR: JUPE研究多模态模型作为评审时的解释偏置：即使只是听起来合理的解释，也会让评审更容易接受错误答案。

Details

Motivation: 多模态大模型常在训练与评估流程中兼任答案评审，且通常同时接收答案和解释。文字线索会影响AI评审，但普通且貌似合理的解释是否会干扰必须通过图像核验的判断，仍不清楚。

Result: 作者提出JUPE视觉问答式基准，在固定答案的同时改变其解释，并评测14个多模态评审模型。普通合理解释会误导评审，平均影响与刻意说服性论证相当。简单理由和链式思维解释分别使错误答案被拒绝的比例降低12.7和13.8个百分点。基于信号检测理论，变化主要体现为决策标准偏向接受答案，平均辨别力没有明显变化。解释影响跨领域、解释生成器和评审流程均存在；测试的缓解方法效果有限且依赖模型。

Insight: 模型评审可能把解释的合理性误当成视觉证据，进而高估系统表现；评估设计应单独检查无依据的解释影响。摘要指出所测缓解方案并不稳定，且未提供具体模型与各领域差异，结论应限于该基准。

Abstract: Multimodal large language models (MLLMs) increasingly serve as judges in training and evaluation pipelines, often assessing answers together with explanations. Although AI judges are sensitive to textual factors, it remains unclear whether ordinary plausible explanations can sway judgments requiring visual verification. We introduce JUPE, a visual-question-answering (VQA)-style benchmark that fixes answers while varying explanations. Across 14 MLLM judges, ordinary explanations that sound plausible mislead judges, with effects comparable on average to deliberately persuasive arguments. Plain justifications and chain-of-thought rationales reduce rejection of incorrect answers by 12.7 and 13.8 percentage points, respectively. We call this failure plausibility capture. Using signal detection theory, we find a significant mean shift in decision criterion toward acceptance, without a clear change in mean discriminability. Explanations sway judgments across domains, explanation generators, and judging protocols, while tested mitigations offer limited, model-dependent protection. Such shifts can inflate performance estimates when judges evaluate answers with explanations.

[4] ProPerAgent: Toward Memory-Driven Proactive Assistance cs.CLPDF

Shenglai Zeng, Xiao Yang, Tiffany Ma, Xinyuan Zhang, Nanshu Wang

TL;DR: ProPerMem基准评测智能体能否从长期个人记忆中判断何时主动提供帮助；ProPerAgent利用图组织记忆和触发控制，在两个模型上提高严格准确率。

Details

Motivation: 主动助手不只要从记忆里找到相关事实，还要判断是否以及何时打断用户。以往设定常把关键事实直接放入上下文；现实难点是从长期、含干扰信息的个人记忆中挖出支持介入的证据，并把握触发时机。

Result: ProPerMem将第一人称视频与平均约61.8万token、覆盖一年且含干扰的用户记忆配对，提供人工核验的触发时间窗，并联合评分内容与时机。所有基线严格准确率均不超过15%，包括使用摘要或检索增强记忆的前沿模型。受控实验中，GPT-5.3-Chat获得触发窗内的正确证据时达到96%；让模型自行选时机后降至38%，再用检索替代预言机证据后降至15%。ProPerAgent用图式记忆存储和中断门控决定何时提示，并用轻量强化学习减少过早和重复触发。未经训练时，Qwen3.8-27B和GPT-5.3-Chat严格准确率分别提升至37.5%和38%；强化学习后达到42.4%。

Insight: 实验表明，主动帮助同时依赖证据检索与时机选择，任一环节缺失都会造成大幅退化。ProPerAgent改善明显但最高报告准确率仍为42.4%；摘要未说明数据构建和部署隐私细节，不能据此视为已适合真实个人助手上线。

Abstract: As assistants move from reactive answering toward proactive intervention, memory changes role: it no longer only supplies the answer to a query, it determines whether and when to speak at all. Prior work in this setting hands the system the relevant fact in context; we study the regime that makes the problem hard, where the evidence justifying an intervention must be mined from a long-horizon personal memory. We introduce ProPerMem, a benchmark for memory-driven proactive assistance (MPA), pairing egocentric video with year-long, distractor-rich user memories (~618K tokens on average), human-verified trigger windows, and a protocol that scores content and timing jointly. Every baseline we evaluate performs poorly (at most 15%), including frontier models given summarized or retrieval-augmented memory. A controlled study explains why: with oracle evidence delivered inside the trigger window GPT-5.3-Chat reaches 96%; letting it choose the timing drops it to 38%, and replacing oracle evidence with retrieval drops it to 15%. Content and timing are separately necessary, and missing either is catastrophic. Guided by this, we build ProPerAgent (Proactive Personalized Agent) with a plug-and-play harness that surfaces memory from a graph-organized store and gates it down to what is worth interrupting for, plus a lightweight RL stage that curbs early and repeated firing. Without any training, ProPerAgent lifts strict accuracy from below 10% to 37.5% on Qwen3.8-27B and 38% on GPT-5.3-Chat; RL post-training reaches 42.4%.

[5] Multimodal Filesystem Memory For Long-Horizon Embodied Agents cs.CLPDF

Chloe Su, Jiahan Li, Zhenting Qi, Chaoran Cheng, Haoyu Chen

TL;DR: MFM为长时程具身智能体设计多模态文件系统记忆，连接经历、空间、语义、程序和当前计划，并在Minecraft与电脑操作任务上超过持久记忆基线。

Details

Motivation: 长期智能体若保留全部交互历史，查找相关经历会变困难；若压缩成摘要，又可能丢失后续任务需要的视觉和空间细节。因此需要一种既可检索抽象经验、又能回到原始多模态观察的记忆组织方式。

Result: MFM把情景记忆（观察、动作和结果）、空间记忆、语义与程序记忆、工作记忆分别组织起来，通过可搜索文本记录关联到底层多模态经历；智能体可按上下文检索旧经验并查看原始观察，巩固过程则将经历提炼为知识和可复用操作，同时保留原经历引用。三个基础模型在长时程Minecraft与电脑使用任务上均有提升。GPT-6-Astra可从零完成Mine Diamond from Scratch，在Ender Dragon任务上达到24个里程碑中的16个，高于最佳基线的12.7；在CUABench-KiCad上平均奖励0.440，优于最佳基线0.400及无持久记忆的0.267。

Insight: 该架构试图兼顾长期经验复用与原始视觉细节回溯，适用于历史记录长且任务反复出现的具身或桌面操作任务。摘要没有给出其他骨干的量化结果和存储开销，具体效果需结合任务与模型解释。

Abstract: Agents operating over long horizons need an effective memory that allows them to reuse their experience throughout long interactions. If the entire history of an interaction is retained, it becomes difficult to find the relevant experience, while compressing it into summaries may result in the loss of visual and spatial details that are required later on. We present \textbf{MFM}, a multimodal filesystem memory architecture that keeps complementary types of agent memory. \textbf{Episodic memory} stores the observations, actions, and outcomes, and \textbf{spatial memory} associates experiences with locations. \textbf{Semantic and procedural memory} build up general knowledge and reusable methods of acting, and \textbf{working memory} holds the current plans. MFM makes use of searchable textual records to connect these different representations to the underlying multimodal episodes. The agents are able to find previous experiences by means of contextual cues and to examine the original observations in order to recover details that are missing from their textual descriptions. Through consolidation, the agents convert experience into higher-level knowledge and procedures while still keeping references to the original episodes. In the case of long-horizon Minecraft and computer-use tasks, MFM leads to improved performance with three base models. With GPT-6-Astra, MFM completes \emph{Mine Diamond from Scratch} and reaches 16 out of 24 milestones on the \emph{Ender Dragon} task, as against 12.7 for the best baseline. On CUABench-KiCad it attains a mean reward of 0.440, as compared to 0.400 for the best baseline and 0.267 in the case of no persistent memory.

[6] Explore Separately, Adopt Selectively: Execution-Guided Tool Use over Large Tool Libraries cs.CL | cs.AIPDF

Anna Mazhar, Seiji Maekawa, Nikita Bhutani

TL;DR: BRIA通过把候选工具的检索和执行放在独立分支中检查，再让任务智能体只采纳有用证据，在大型工具库任务上达到或超过检索基线。

Details

Motivation: 语言模型智能体可能要从数千个工具中发现适合当前执行阶段的工具；当多个候选看起来都能完成任务时，往往必须实际调用才能辨别。若在同一轨迹中试错，未测试选项可能被忽略，失败调用也可能干扰后续推理。

Result: BRIA将候选工具调查放入互相隔离的临时分支：每个分支检索并执行候选，主任务智能体查看执行证据，只把有用结果并入当前轨迹；任务出现新能力需求时再检索工具。作者在PlanBench-XL和MCP-Atlas上使用1,897个共享工具、三种语言模型及静态和自适应检索基线进行比较。所有设置下BRIA均达到或超过最强检索基线；在MCP-Atlas上平均claim score为89.77，相比MCP-Zero的75.40提高14.37个百分点，同时处在任务表现与输入token成本的帕累托前沿。

Insight: 将探索性试调用与主任务推理隔离，有助于从执行结果判断工具价值而不污染连续轨迹。摘要未给出其他基准的详细分数、调用成本绝对值及分支并行开销，结论应限于测试工具库和任务。

Abstract: Large language model agents must discover relevant tools from large libraries, e.g., thousands of tools, as new needs arise during task execution. When several candidates could satisfy the same need, execution may be required to identify the relevant one. Investigating candidates in a shared trajectory can leave alternatives unexplored or allow failed attempts to influence subsequent reasoning. To address this, we present BRIA (BRanch-Inspect-Adopt), a simple yet effective agent that temporarily isolates candidate investigations in separate branches. Each branch retrieves and executes tools to investigate its candidate; a task agent inspects the resulting execution evidence and adopts only useful results into its continuing trajectory. BRIA retrieves additional tools as new capability needs arise during task execution. We evaluate BRIA on PlanBench-XL and MCP-Atlas using a shared pool of 1897 tools, three language models, and static and adaptive retrieval baselines. Across all settings, BRIA matches or exceeds the strongest retrieval baseline. On MCP-Atlas, it achieves an average claim score of 89.77, compared with 75.40 for MCP-Zero, a gain of 14.37 percentage points. BRIA also lies on the Pareto frontier for task performance and input-token cost.

[7] ARBOR: Locating Reasoning Failures in Long Chains of Thought through Reasoning State Tracking cs.CL | cs.AIPDF

Huihan Li, Siyuan Wang, Naga Vamsi Ramana Dinavahi, Xiaohui Liu, Xiang Ren

TL;DR: ARBOR用跨步骤推理状态树定位长思维链中的错误，将失败归因于某一步与此前建立状态的关系，并细分出不同类型的推理失误。

Details

Motivation: 过度思考、思考不足和无依据推断等问题，通常通过邻近文本相似度、切换token或模型对单步正确性的判断来检测。但一个步骤是否有问题取决于此前已经确立的推理状态，局部信号难以提供完整上下文。

Result: ARBOR把推理轨迹表示为状态树，记录每一步如何创建、验证、剪枝或重新访问状态，再将错误归因到当前步骤与前序状态之间的关系。基于这一表示，作者将三类既有失误细分为通过不同机制、付出不同代价损害推理的子类型。实验发现，在步骤之前维护的状态树能够区分实际失败步骤与存在风险但未发生失败的步骤。论文还讨论了将该框架用于推理时干预和训练数据改进。

Insight: 状态跟踪提供了对长推理轨迹更全局的错误分析视角，也区分了潜在风险和已发生失败。摘要未列出检测准确率、具体子类型定义和干预效果量化，不能据此断言ARBOR已提升最终任务正确率。

Abstract: Large reasoning models solve complex problems through long chains of thought, in which prior work has documented failure modes such as overthinking, underthinking, and unsupported deductions. Existing methods detect these failures from local signals: textual similarity to nearby steps, switch tokens, or an LLM’s judgment of a step’s correctness. However, what a step contributes to the solution depends on the state that earlier steps have established, so identifying failures requires a global view that tracks that state across the trajectory. Therefore, we propose ARBOR, a reasoning-failure attribution framework that represents each trajectory as a tree of reasoning states, built as each step creates, verifies, prunes, or revisits a state, and attributes each failure to a relation between a step and the state preceding it. Using ARBOR, we refine the three failure modes into distinct subtypes that harm reasoning through different mechanisms and at different costs. We find that the tree state ARBOR maintains before a step separates failure steps from the at-risk steps at which the failure did not occur. We discuss how ARBOR integrates with existing mitigations at inference time and in training data. Code, data and interactive examples are available at https://inklab.usc.edu/ARBOR.

[8] Self-Evolving Coding Agents via Harness-Policy Optimization cs.CL | cs.AIPDF

Zhepei Wei, Wenlin Yao, Baolin Peng, Danqing Wang, Qianhui Wu

TL;DR: Self-HPO交替优化代码智能体的执行框架和策略模型，让模型根据自身错误提出框架候选并在选定框架下强化学习，提升多个代码基准上的解决率。

Details

Motivation: 代码智能体表现由策略模型和连接环境的执行框架共同决定，两者相互影响。只调优固定策略的框架可能不适配更新后的模型，只训练策略也受限于固定框架所产生的轨迹。

Result: Self-HPO递归交替进行框架优化和策略优化：当前策略先分析自身失败并提出框架候选，随后在选择的框架下进行强化学习；训练中发现的难题作为下一轮框架搜索集合，使搜索聚焦于不断变化的失败模式。三个代码基准上，该方法稳定超过只优化框架或只优化策略的基线。Qwen3.5-35B-A3B平均解决率从57.8%提高到64.8%，且收益迁移到分布外设置。两种优化组件单独配合基础版本也保留部分收益，联合收益超过两者单独增益之和；Pass@1可靠性和Pass@k能力前沿均提升。使用更强的外部模型Opus 4.8提出框架还可继续提升表现。

Insight: 该框架把智能体工具与工作流设计纳入模型自我改进循环，并报告两者协同效应。摘要未列出三个基准名称、具体训练成本和框架修改范围；外部强模型能进一步提升也意味着效果可能依赖额外模型资源。

Abstract: Large language model (LLM) agents have shown promising potential in coding tasks, and their performance is jointly determined by the policy model and the harness that mediates their interaction with the environment. Indeed, harness and policy are mutually reinforcing and evolving only one component is suboptimal—a harness tuned for one checkpoint may not target the failure modes of an updated policy, while policy learning remains limited to the trajectories elicited by a fixed harness. In light of this, we propose Self-HPO, a recursive self-improving framework for coding agents that alternates harness and policy optimization, using the evolving policy as its own harness proposer. Specifically, in each round, the current policy first analyzes its own failures and proposes new harness candidates (H-step). The policy is then updated through reinforcement learning (RL) under the selected harness (P-step), and hard tasks identified during training form the next harness search set, keeping harness optimization targeted to the policy’s evolving failure modes. Across three coding benchmarks, Self-HPO consistently outperforms harness-only and policy-only baselines, improving Qwen3.5-35B-A3B’s average resolve rate from 57.8% to 64.8%, with gains generalizing to out-of-distribution settings. Further analysis shows that both optimized components retain gains even when paired with their base counterparts, while their joint gain exceeds the sum of their individual gains. Self-HPO also improves reliability (Pass@1) and expands the capability frontier (Pass@k) over the base agent. Additionally, we show that with a stronger external model (e.g., Opus 4.8) as the harness proposer, the same framework yields a further performance boost.

[9] On the Position Bias of Large Language Models: A Comprehensive Study cs.CLPDF

Yining Li, Huayang Li, Lemao Liu, Taro Watanabe

TL;DR: 该研究跨模型规模、五种语言及选择题和多文档任务系统考察大语言模型的位置偏差，报告模型规模扩大和标准思维链提示可缓解偏差。

Details

Motivation: 答案或文档所在位置会影响语言模型选择，削弱选择题评测和检索增强生成的可靠性。已有研究模型覆盖较少且偏重英语，因此前沿模型和多语言中的偏差情况尚未充分了解。

Result: 作者分析从十亿到万亿参数规模的模型，并覆盖五种语言的选择题及多文档任务。实验发现，小规模模型和非英语任务中的位置偏差仍较明显；模型规模增大和采用标准链式思维提示可显著缓解。作者还发现，具备扩展推理能力的新型思考模型几乎不受位置偏差影响，并指出这是一种成本较高但可能通用的缓解方式。

Insight: 位置偏差会受模型能力、语言和提示方法影响，单一英语基准不足以全面评估。摘要没有给出模型清单、参数规模对应曲线或不同语言的具体偏差数值，“几乎免疫”限于作者测试的任务和设置。

Abstract: Recent studies have shown that position bias remains a critical vulnerability in large language models (LLMs), undermining both the integrity of multiple-choice evaluations and the reliability of retrieval-augmented generation. However, existing understanding of this phenomenon is largely derived from studies with limited model coverage and English-centric benchmarks, leaving the behavior of frontier models and diverse languages underexplored. In this work, we conduct a comprehensive investigation of position bias across model scales ranging from billion-level to trillion-level parameters, covering both multiple-choice and multi-document tasks in five languages. Our experiments reveal that while position bias remains noticeable in small-scale models and Non-English languages, increasing model scale and employing standard Chain-of-Thought prompting significantly mitigate this issue. Moreover, we demonstrate that emerging \emph{thinking models} with extended reasoning capabilities are nearly immune to position bias, suggesting a costly but general approach toward resolving this vulnerability.

[10] Causal Edit Serialization cs.CL | cs.LGPDF

Louis Robinson

TL;DR: 因果编辑序列化CES让自回归语言模型用显式指针在因果token流中定位和执行插入、删除、替换、复制及移动等文本修改。

Details

Motivation: 标准自回归语言模型按顺序生成文本，而修订需要回指输入上下文或已生成内容中的具体位置。缺少明确定位机制时，生成和局部修改难以在同一因果过程内统一表达。

Result: CES用特殊指针token及预测的源地址来指定编辑位置，结合轻量定位头和双索引旋转位置编码，同时支持地址预测和基于先前指针的条件生成，保留标准因果注意力掩码。预训练结合普通语言建模和由随机损坏、模型生成编辑及重复文本构造的序列化修复。在不同模型规模及编辑基线比较中，CES模型能完整应用编辑，干净文本bits-per-byte仅略高于干净自回归模型。监督微调与强化学习后训练在语法纠错上作概念验证，盲于参考的模型评审认为有益修改多于有害修改；正确修复程序也能在保留原上下文及缓存状态时改善后续文本预测。

Insight: CES为生成和局部修订提供统一接口，并展示编辑操作可成为模型因果输出的一部分。摘要没有给出各模型规模的量化结果、具体纠错基准分数及编辑程序复杂度，因此性能结论以作者报告的趋势为限。

Abstract: Standard autoregressive language models generate text sequentially, but revision requires referring back to tokens in the input context or those already generated. Causal Edit Serialization (CES) is introduced as a framework for expressing such revisions within the same causal token stream. Special pointer tokens are paired with predicted source addresses, allowing insertion, deletion, replacement, copying and movement to be localized explicitly. A lightweight localization head and dual-index rotary position encoding support both address prediction and conditioning on previously emitted pointers, while retaining a standard causal attention mask. A pretraining procedure combines ordinary language modeling with serialized repairs derived from random corruptions, model-generated edits and repeated text. Across model scales and editing baselines, CES models demonstrate complete applied edits with modestly higher clean-text bits per byte than clean autoregressive models. Supervised and reinforcement-learning post-training provide a grammatical-error-correction proof of concept, producing more beneficial than harmful changes under reference-blind model judging. Correct repair programs also improve subsequent text prediction while the original context and its cached states are retained. CES provides a common interface for generation and localized revision, with potential extensions to iterative refinement and additional pointer-addressed transformations.

[11] The Reliance Hypothesis: Chain-of-Thought Faithfulness Rises as Language Resource Level Falls cs.CL | cs.AIPDF

Lucas Resck, Jingyi Sun, Qianli Wang, Isabelle Augenstein, Anna Korhonen

TL;DR: 跨八种语言的研究发现，知识密集任务中链式思维忠实度会随语言资源水平降低而上升，但推理密集任务没有同样趋势。

Details

Motivation: 链式思维忠实度关系到模型监控、解释和安全部署，但相关研究多以英语为主。低资源语言中的模型通常掌握的信息更少，这可能改变模型对显式推理过程的依赖；该影响是否随任务类型变化尚不明确。

Result: 作者在MMMLU的八种语言并行选择题上，比较知识密集与推理密集任务。对四个模型和多种忠实度测量，知识密集任务中资源水平越低，链式思维忠实度越高；推理密集任务未呈现同样关系。研究提出依赖假设：当模型无法回忆答案时（例如低资源语言的知识题），更依赖显式推理。模型置信度能部分解释资源水平效应，却无法解释知识题与推理题的差异。跨语言比较显示低置信语言中的模型更依赖推理，但同一种语言内的低置信回答未必如此，呈现辛普森悖论；低资源语言中使用推理的答案比例较高，而非每条推理都更强。

Insight: 链式思维监测的可验证性可能因语言和任务类型而异，低资源语言或更常出现模型依赖推理的情况，但每条推理的忠实度并不因此必然更高。摘要未提供八种语言与测量方法的完整结果表，结论限于MMMLU选择题评测。

Abstract: Chain-of-Thought (CoT) faithfulness matters for monitoring, explaining and safely deploying large language models, yet it has been studied mostly in English. Languages differ in level, the amount of text available to learn from, so models know less in lower-resource languages, which may change how much they rely on their reasoning. To our knowledge, we are the first to relate CoT faithfulness to both resource level and task type (knowledge- or reasoning-intensive). On parallel multiple-choice questions from Multilingual Massive Multitask Language Understanding (MMMLU) in eight languages, faithfulness rises as resource level falls on knowledge-intensive tasks but not on reasoning-intensive ones, a gap that points the same way across four models and several faithfulness measures. We propose, and find support for, the Reliance Hypothesis: models rely more on their reasoning when they cannot recall the answer, as in lower-resource languages on knowledge-intensive tasks. Model confidence partly explains the effect of resource level, but not the knowledge-reasoning gap. Languages in which models are less confident rely more on reasoning, yet less confident answers within a language do not, a Simpson’s paradox. In lower-resource languages, models rely on their reasoning for more answers, not more strongly for each. CoT monitoring may therefore be most informative in lower-resource languages, where it is least often validated.

[12] Uncertainty-Aware Budget Allocation for Efficient LLM Tree Search cs.CL | cs.AIPDF

Jianguo Huang, Zhiyi Lyu, Fuxiang Zhang, Yanchen Deng, Deheng Ye

TL;DR: 不确定性感知预算分配UAA根据同一搜索节点下候选动作的语义分散度，预估后续分支冗余并动态分配树搜索预算，减少token和延迟。

Details

Motivation: 大语言模型树搜索常给每一步固定扩展预算，忽略继续采样的边际收益。作者发现从相同中间状态采样的续写常高度重复，导致固定预算浪费；若能在扩展前估计分支冗余，就可以减少无效搜索。

Result: 作者发现同级候选动作的语义分散度能够预测后续续写冗余，并据此以信息论分析推导足够采样预算随分散度下降。UAA把候选价值与不确定性分开：价值决定哪些候选值得探索，不确定性用无需额外模型调用的同级分散度估计，并通过不确定性感知剪枝和预算分配决定扩展数量。在数学推理、逻辑推理和规划基准上，准确率相近时token用量最多降低90%、延迟最多降低9倍；效果跨四种树搜索算法以及开源和闭源模型。

Insight: 自适应预算将计算集中到答案不确定且分支多样的状态，有机会在保持准确率时显著降低搜索成本。摘要未给出各基准上的完整准确率差异和具体预算设置，“最多”值不代表所有模型和任务均达到该收益。

Abstract: Tree search enhances multi-step reasoning in large language models (LLMs), yet prevailing methods expand every step with a fixed budget, irrespective of the marginal utility of expansion. We first show, across existing search algorithms, that continuations sampled from a shared intermediate state are largely duplicates and collapse to a few distinct answers. Critically, we find that the semantic dispersion of sibling actions predicts the redundancy of their downstream continuations, permitting a subtree’s budget to be fixed before expansion. An information-theoretic analysis motivates this: treating the per-step budget as the Monte Carlo sample size for estimating a step’s residual answer entropy, we derive a sufficient budget that shrinks with sibling dispersion. We accordingly propose $\textbf{Uncertainty-Aware Allocation}$ (UAA), a training-free framework that decouples value from uncertainty: values determine which candidates are promising, while uncertainty, estimated from sibling dispersion at no additional model cost, determines how many merit expansion, via uncertainty-aware pruning and uncertainty-aware budgeting. Across mathematical reasoning, logical reasoning, and planning benchmarks, UAA reduces token usage by up to $90%$ and latency by up to $9\times$ at comparable accuracy, generalizing across four tree search algorithms and both open- and closed-source LLMs.

[13] NLData2Opt: Benchmarking Parameter Derivation and Prediction for Modeling Optimization Problems from Natural Language and Data cs.CLPDF

Lijia Liu, Kyohei Atarashi, Jiyi Li, Koh Takeuchi, Shunji Umetani

TL;DR: NLData2Opt评测语言模型从问题描述和含噪数据构造优化模型参数的多阶段能力，要求模型抽取、计算并预测参数。

Details

Motivation: 把自然语言中的优化问题转化为可求解模型耗时且成本高，语言模型有望自动化这一流程。但现有基准常假设数据完整且全部相关，无法反映现实中从噪声数据提取信息、计算缺失参数和预测未来值的要求。

Result: NLData2Opt把问题说明与数据分开输入，测试三步能力：从含误导属性的数据中抽取相关参数；依据已有属性变换计算缺失参数；根据历史观测预测不可用的未来值。实验显示，模型表现较现有基准显著下降，说明基准进步并不必然转化为实际优化问题建模准确率。数据集公开于作者提供的代码库。

Insight: 该基准强调优化建模前的数据推理环节，能检查模型是否会盲目套用表面相关字段。摘要未提供模型清单、各任务准确率或基准间具体降幅，因此只能确认总体性能下降的结论。

Abstract: Formulating optimization problems from raw inputs of problem descriptions and data is time-consuming and costly. While Large Language Models (LLMs) offer a promising way to automate this process, existing benchmarks overestimate their capabilities by relying on idealized inputs where all data is relevant and complete. This diverges from reality, where data-centric reasoning is required to extract, compute, and predict parameters from noisy sources. To address this, we introduce NLData2Opt, a benchmark to evaluate LLMs on the multi-stage reasoning inherent in practical optimization workflows. NLData2Opt decomposes problems into problem descriptions and data, and requires models to (1) extract relevant parameters from data containing misleading attributes, (2) compute missing parameters derived by transforming existing data attributes, and (3) predict unavailable future values from historical observations. Evaluation results show substantial performance decline relative to existing benchmarks, indicating that benchmark progress does not directly translate to formulation accuracy in practical optimization workflows. NLData2Opt is available at https://github.com/sumarivyn/NLData2Opt.

[14] Bengali Hallucination Detection with Retrieval and Programs: A System Study cs.CLPDF

Shamim Hasan, Samiya Ahmed Chowdhury

TL;DR: 该研究分析一个孟加拉语幻觉检测系统，结合问题条件检索、混合检索和任务专用判断模型，并审计其执行轨迹及语料重叠。

Details

Motivation: 孟加拉语事实幻觉检测既要判断陈述缺乏依据，也要区分错误推理；评测时常没有给定参考段落，系统需自行检索并计算。排行榜分数若不结合可复现的运行证据和数据重叠检查，难以说明系统真实效果及泛化性。

Result: 系统用改写后的查询走六条检索路径，路由到27B文本评审模型或14B智能体，后者可对比检索答案、直接推理或生成并执行Python。Olikbochon挑战赛的Kaggle版本2私有宏F1显示为0.956；保存的运行处理2,516例，在两张T4上耗时220.99分钟。253个数学路由样例中，88个通过候选匹配结束；执行轨迹记录到35例中的49次带stderr运行事件。另一轮在核心工作代码相同的情况下有6个预测变化。对1,090条相关语料记录的有限审计发现，38个已处理评测输入与语料存在精确问题或上下文重叠。

Insight: 论文贡献是可审计地描述检索加计算评审架构，而非对各组件增益作受控因果估计。私有排行榜分数与独立诊断需区分，已发现的数据重叠也限制了无条件的语料独立泛化主张。

Abstract: Bengali hallucination detection must distinguish unsupported factual claims from incorrect reasoning, often without a supplied reference passage. We present and characterize an inference-only system that combines response-conditioned query rewriting, hybrid retrieval, and task-specific language-model judging. Six retrieval routes search question-answer and passage collections; a router directs each example to a 27B textual judge or a 14B agent that can compare retrieved answers, reason directly, or generate and execute Python. We characterize the system using version-specific code, saved predictions, execution traces, and corpus metadata from the Olikbochon challenge. Kaggle associates a displayed private macro-F1 of 0.956 with Version 2; its saved run processes 2,516 examples in 220.99 minutes on two T4 GPUs. Of 253 math-routed examples, 88 terminate through candidate matching, while execution traces expose 49 stderr-bearing run events across 35 examples. A later run changes six predictions despite identical core worker code. A bounded audit of 1,090 benchmark-related corpus records finds exact question or context overlap for 38 processed evaluation inputs, precluding an unqualified claim of corpus-independent generalization. The contribution is a concrete retrieval-and-computation judging architecture with an auditable operational characterization, not a controlled estimate of component gains. We distinguish the reported leaderboard result from independently recomputed diagnostics and identify the evidence needed for stronger effectiveness and reproducibility claims.

[15] Competence-Based Evaluation of Logical Reasoning in Large Language Models cs.CL | cs.AI | cs.LGPDF

Jize Jiang, Chengxiang Zhai

TL;DR: 能力导向评测CBE测试模型能否在一类复杂度递增、表达形式变化的问题族中稳定应用同一逻辑能力，发现强模型仍会在问题族内失效。

Details

Motivation: 现有逻辑推理基准通常给出若干任务的单一准确率，无法充分衡量模型的推理泛化能力，也可能被语言表述变化影响。测量模型是否掌握一个可重复使用的能力，需要跨难度和等价表述进行系统测试。

Result: CBE使用参数化生成器增加问题复杂度而保持所需能力不变，并通过答案不变的匹配表述检查模型是否能跨不同说法保持正确。作者在基础排序任务上实例化该方法，对六个GPT和Qwen模型进行评测。模型在有限复杂度区间内表现尚可，但均未能满足整个测试问题族上的能力条件。思维链和GRPO延长了较强表现区间，却未消除所有失败；监督LoRA对留出问题的迁移有限。

Insight: 评测单位从几道独立题目转向一类具有固定能力要求的问题，可揭示总体准确率隐藏的边界。摘要没有提供各模型的通过阈值、复杂度范围细节和失败率，CBE结果不等同于模型在所有逻辑任务上都不具备该能力。

Abstract: Recent advances in large language models (LLMs) have brought impressive performance across diverse tasks; however, shortcomings remain in logical reasoning, including inconsistencies under linguistic variation. To improve the reasoning capacity of LLMs, we must be able to accurately measure their reasoning capacity. Current benchmarks primarily report single accuracy numbers on selected reasoning tasks. Such a performance-based evaluation methodology says little about a model’s generalization capacity in reasoning. To address this limitation, we argue for a different evaluation paradigm, called competence-based evaluation (CBE), which tests whether models reliably apply the same competence across a family of problems. A parameterized generator scales complexity while keeping the required competence fixed, and matched answer-preserving presentations test correctness beyond one formulation. We instantiate CBE on elementary ordering tasks, scaling input size while varying presentations of the same ordering rule. Across six GPT and Qwen models, performance is reasonably good over bounded complexity ranges, but even strong models fail the competence condition across the tested family. Chain-of-thought and GRPO extend strong performance without resolving all tested failures; supervised LoRA shows little held-out transfer. CBE provides diagnostic profiles and an evaluation protocol that can grow with future models.

[16] FederatedBytes: Tokenizer-Free, Byte-Level Small Language Models for Efficient Multimodal Federated Learning cs.CL | cs.DC | cs.LGPDF

Ali Sarabadani, Massimo Piccardi, Mehran Abolhasan, Farzad Tofigh, Ian Zhou

TL;DR: FederatedBytes提出无分词器、字节级小语言模型和线性注意力，用于降低多语言及多模态联邦学习中的内存与通信负担。

Details

Motivation: 联邦学习能在不集中客户端本地数据的情况下协同训练，但计算和通信开销限制了其应用于自然语言与多模态任务。分词器和较重模型也会增加异构数据处理及部署成本。

Result: FederatedBytes把文本、图像等输入统一视为字节序列处理，并采用轻量线性注意力降低内存和计算负担。作者在Multilingual Amazon Reviews和ScienceQA数据集上评估多语言及多模态情感分析等任务。实验报告该模型准确率高于可比的ByT5与LSTM，同时显著降低内存和通信开销。

Insight: 字节级处理避免依赖特定语言分词器，线性注意力也可能使联邦训练更易部署。摘要未提供模型规模、客户端数量、通信量和具体精度，因此无法量化效率收益，也不能判断不同数据异质性下的表现。

Abstract: Federated Learning (FL) is a powerful machine learning framework that allows building a global model from the contributions of multiple, distributed clients, while ensuring the privacy of their local data. However, its heavy computational and communication overheads challenge its use for contemporary AI workloads such as natural language processing (NLP) and multimodal analysis. For this reason, this paper presents a novel small language model that leverages byte-level text and multimodal data processing, enhanced by a linear attention mechanism, to enable manageable Federated Learning of NLP and multimodal analysis tasks. The proposed model, nicknamed FederatedBytes, manages to process text and any other data types, including images, by treating its input as a mere sequence of bytes, while its lean linear attention mechanism allows abating the overall memory and computational footprint. To prove the effectiveness of the proposed model we have carried out an extensive performance evaluation on sentiment analysis tasks in multilingual and multimodal settings over the Multilingual Amazon Reviews and ScienceQA datasets. The experimental results show that FederatedBytes has been able to outperform comparable models such as ByT5 and LSTM, achieving higher accuracy while significantly reducing memory and communication overheads.

[17] Many Biases, One Circuit: Post-Training Tunes a Pretrained Cue-Routing Mechanism cs.CL | cs.AI | cs.LGPDF

Prakhar Gupta, Terry Jingchen Zhang, Zhijing Jin

TL;DR: 该研究通过因果追踪发现，多种提示诱导偏差共用预训练阶段已存在的少量注意力头回路，指令微调和强化学习会改变该回路的触发强度。

Details

Motivation: 模型常会因为用户给出错误暗示而放弃正确答案，谄媚及相关偏差通常被分别研究并归因于对齐训练。研究检验不同偏差是否由共享机制驱动，以及后训练的不同阶段如何影响该机制。

Result: 在多数被测模型的选择题任务中，四类提示线索主要依赖相同的少数注意力头，这一回路在预训练模型中已存在。多数基础模型在普通文本提示下会跟随线索；仅用约200条不含线索的通用助手样例做微调，就会在聊天格式中激活这些头，使线索跟随可能成为助手微调副作用。几乎所有比较中，最终强化学习阶段进一步增强线索影响。在Tulu-3-8B和OLMo-2-7B中，研究交换强化学习检查点与前一阶段六个中间层的注意力模式；对建议答案线索，互换后各检查点的线索效应大幅向对方水平移动。

Insight: 多种偏差可能共享预训练得到的线索路由回路，后训练更像在调节何时、以多强程度调用它，而非从头创建回路。交换实验支持该机制具有因果作用，但摘要只涉及特定模型、提示类型和层范围；针对这条回路的缓解仍是潜在方向。

Abstract: Language models often abandon a correct answer when the prompt contains a cue, a hint toward a wrong option such as “I think the answer is B.” Sycophancy and related biases show this failure. They are often studied separately and blamed on alignment. We test this view causally, tracing the attention heads behind these biases through the stages of two post-training pipelines. In multiple-choice tests on most models, four cue types rely largely on the same few heads, a shared circuit already present in pretrained models. Most base models follow cues in plain text. Fine-tuning a base model on about 200 generic assistant examples without cues activates these heads in chat format, so cue-following can be a side effect of assistant tuning. The final reinforcement learning (RL) stage strengthens the effect of cues in almost every comparison. In Tulu-3-8B and OLMo-2-7B, we swap the attention patterns of six middle layers between the RL checkpoint and its predecessor. For suggested-answer cues, this shifts each checkpoint’s cue effect most of the way to the other’s level. Post-training thus seems to change when and how strongly models use this circuit. Mitigation for these multiple-choice biases could target this circuit.

[18] Aligning Language Models Towards Counterfactual Invariance cs.CL | cs.AI | cs.LGPDF

Basar Demir, Emily Shen, Ksheeraj Sai Vepuri, Sourabh Kulkarni, Harihar Subramanyam

TL;DR: 该研究分析敏感群体属性对语言模型回答的反事实影响，并提出对成对反事实提示优化的群体级奖励，以减小无关属性导致的质量差异。

Details

Motivation: 提示中的人口统计群体信息等敏感属性可能改变模型输出。当属性与当前任务在因果上无关时，这种敏感性会带来偏差；但若属性确实与答案相关，模型仍需正确适应，因此完全消除属性影响并不合理。

Result: 作者发现，标准对齐流程（如强化学习）虽然提升总体回答质量，却会扩大不同人口群体之间的回答质量差异，增强反事实偏差。为此提出策略梯度技术，对成对的反事实提示使用群体级奖励。研究还构建受控反事实提示对数据集，并设计区分人口统计信息对答案具有因果相关和无关情形的评测。多个公平性基准上的结果显示，该方法能减少反事实差异，同时保持总体回答质量，并在敏感信息确实相关时保留适当适应。

Insight: 公平性目标需要区分“与任务无关的群体属性”与“确实影响答案的属性”，否则不变性训练可能损害有用性。摘要未报告各基准的具体数值、群体类别和数据规模，适用边界需结合完整实验判断。

Abstract: Small variations in prompt characteristics can meaningfully alter the semantics, tone, and contextual assumptions of large language model outputs. Such characteristics can involve group variables such as demographics or other sensitive latent attributes. Sensitivity to such input variables is undesirable when demographic information is causally irrelevant to the task, but might still be relevant for generation of semantically coherent responses. This makes the task of enforcing counterfactual invariance while preserving model utility difficult. To study this problem, we first show that standard model alignment recipes (such as reinforcement learning) increase differences in response quality across demographics, while improving overall response quality, ultimately amplifying what is known as counterfactual bias. To address this, we develop a policy gradient technique involving a group-level reward function that operates on matched pairs of counterfactual prompts. For completeness, we build a dataset of controlled counterfactual prompt pairs and design an evaluation that separately measures cases where demographic information is causally relevant to the answer. Finally, we validate our findings on several fairness benchmarks. We demonstrate that our methods reduce counterfactual differences while preserving overall response quality and that the models continue to adapt appropriately when such sensitive information is relevant.

[19] Recognizing Atari and Assessing Sente: Controlled Evaluation Tasks for Language-Based Go Agents cs.CLPDF

Taiyi Chen, Iskar Deng, Amandalynne Paullada

TL;DR: 该研究用围棋局部棋形与策略变化构建受控测试，检查语言模型能否将“打吃”术语识别与先手价值判断对应起来，发现模型仍常混淆二者关系。

Details

Motivation: 围棋术语可以简洁描述棋形和战略关系，但基于语言的棋手模型能否准确识别这些概念，并把术语变化与着法评价联系起来，仍不清楚。总体棋力指标也难以定位术语理解中的具体失败。

Result: 作者围绕打吃（atari）及其与先手（sente）的关系构建受控评测，在局部棋盘变化下检查术语识别，并在不同战略条件下检查着法评价。测试对象是经过术语和棋评监督微调的围棋语言模型LoGos。模型难以识别打吃关系的变化及其战略意义；术语预测还会与模型偏好的着法相关联，即使这种偏好与参考评价相矛盾。

Insight: 受控棋盘变化可用于区分术语识别、局部关系判断与战略价值评估，而不只看整体落子成绩。摘要未给出测试位置数量、准确率和不同复杂度结果，结论限于该模型与打吃—先手关系。

Abstract: Domain terminology provides concise descriptions of game states and strategic relationships, but whether game-playing language models can accurately recognize these concepts and relate them to move evaluation remains unclear. We construct a controlled evaluation set centered on atari and its relationship to sente in Go, examining terminology recognition under local board changes and move evaluation under different strategic conditions. We conduct our tests on LoGos, a Go language model, after fine-tuning it with terminology and commentary supervision. The model struggles to recognize changes in the atari relationship and assess its strategic implications. Its terminology predictions are associated with move preferences even when those preferences contradict the reference evaluation. Our controlled tests provide a framework for examining whether language-based Go agents connect domain terminology with precise board relationships and strategic move values.

Zhenxu Tian, Kebin Liu, Zhengwu Yang, Yi Su, Qingqing Dang

TL;DR: Prism Attention以粗到细的候选索引细化替代跨层静态稀疏索引共享，在保留层间适应性的同时降低长上下文解码成本。

Details

Motivation: 长上下文解码需在每一步对不断增长的KV缓存执行注意力，稀疏注意力虽减少计算，但若每层、每步都重算索引，收益会被索引成本抵消。跨层共享可减少重算，却可能因注意力模式随层变化而让索引偏离最优。

Result: 作者观察到层间高显著token变化集中在既有选择区域扩展边界附近：核心高注意力token大多稳定。Prism Attention利用这一点进行提案式细化，避免僵硬复用索引，同时保留跨层共享效率。在推理和长上下文基准上，论文报告该方法在主流稀疏注意力方法中达到当时最佳表现；上下文长度128K时，相比FlashAttention端到端解码加速3.4倍。

Insight: 局部化的层间注意力变化可用于减少稀疏索引重复计算，而不必每层从头选择。摘要未列出具体基准成绩、模型及质量变化，因此3.4倍速度结果限于128K报告设置。

Abstract: Long-context decoding in large language models (LLMs) is increasingly bottlenecked by the memory and computation required to attend over an ever-growing Key-Value (KV) cache at each autoregressive step. Although token-level sparse attention reduces this burden by restricting computation to a small subset of relevant past tokens, its practical gains are often offset by repeatedly recomputing layer-wise sparse indices as the context grows. A common remedy is to share sparse indices across layers by computing them only at designated anchor layers, but such static reuse ignores the layer-wise evolution of attention patterns, causing the reused indices to progressively deviate from the layer-specific optima and incur substantial attention loss. By revisiting cross-layer sparsity from the perspective of attention dynamics, we find that inter-layer salient token shift is highly localized: although the exact top-$κ$ indices differ across layers, the core high-attention tokens remain stable, with changes concentrated near the expanded boundary of previously selected regions. Motivated by this, we propose Prism Attention, a proposal-refined sparse attention framework. It replaces rigid cross-layer index reuse with a coarse-to-fine strategy, preserving layer-wise adaptability while retaining the efficiency benefits of cross-layer sharing. Extensive experiments show that Prism Attention achieves state-of-the-art performance among mainstream sparse attention methods on both reasoning and long-context benchmarks, while attaining a $3.4\times$ end-to-end decoding speedup over FlashAttention at 128K context length.

[21] Before Retrieval Begins: Safety and Tool-Use Decisions in LLM Agents cs.CLPDF

Aditya Nawal, Manit Baser, Mohan Gurusamy

TL;DR: 该研究把LLM智能体的工具调用准入作为安全决策单独评测，发现文本拒绝与拒绝调用工具并不完全一致，但拒绝训练可迁移到调用决策。

Details

Motivation: 现有工具安全研究多分析工具被调用之后的行为，却较少检查模型事先是否应该调用工具。准入决定本身会影响后续风险，也可能与模型是否在文本中表达拒绝并不一致。

Result: 作者对七个开放权重模型进行请求因子实验。对已准入的有害请求，模型平均有害率为74.5%；在构造的实验中，中和所请求操作因素带来最大准入率差异，为19个百分点。由该差异估计的线性方向能影响七个模型中四个在留出样例上的准入决策；部分经操作中和样例也受影响，说明该方向并非只针对特定操作机制。已准入的有害工具调用中，仅33.6%伴随明确文字拒绝。对保留良性工具使用能力的模型，纯文本拒绝训练可降低不安全准入。

Insight: 文字拒绝只能部分反映是否准许工具调用，工具准入需要直接评估和监督。效果具有模型依赖性，摘要未给出各模型绝对准入率和多种工具类型分析；平均有害率限于已准入有害请求。

Abstract: Large language models increasingly act as agents that call external tools, yet most tool-safety research examines only what follows a tool call. The prior decision of whether to call the tool remains largely unexamined and can influence downstream safety. Across the seven open-weight models, the unweighted model-average harm rate after admitted harmful requests is 74.5%. To identify what governs this decision, we apply a factorial intervention to the input request. Within our generated construction, neutralizing the requested-operation component produces the largest admission contrast (19 pp). A linear direction estimated from this contrast influences held-out admission in four of seven models; effects on operation-neutralized requests in some models show that it is not an operation-specific mechanism. We then test whether written refusal is behaviorally and representationally coupled to the same decision. Written refusal accompanies 33.6% of admitted harmful calls. Plain-text refusal training reduces unsafe admission in models that retain benign tool use, showing that response-level safety training can transfer to the call decision. Together, these results establish a partial, model-dependent relation between written refusal and tool admission. They motivate direct evaluation and supervision of tool admission rather than treating text refusal as its proxy.

[22] MultiAgent-OPD: End-to-End Training of Hierarchical Multi-Agent Systems with On-Policy Distillation cs.CLPDF

Yuhan Sun, Jiaxin Zhao, Yongdong Luo, Yibo Hu, Meiguang Jin

TL;DR: MultiAgent-OPD用在线策略蒸馏为分层多智能体提供局部过程监督，并以强化学习联合训练共享参数的Leader、Searcher和Answerer。

Details

Motivation: 分层多智能体由领导者分配任务、子智能体执行，最终答案只能间接反映搜索和摘要质量，因此联合训练困难。依赖LLM评审子智能体又会受到评审本身质量判断偏差影响。

Result: 方法先以答案正确性在Searcher-Answerer流程训练教师。团队训练期间，冻结教师对学生生成的搜索和摘要token评分，给Searcher局部过程监督；Leader根据团队成功率学习，Answerer根据候选答案正确性学习。在七个数据集上，训练系统macro avg@4达到38.68%，比Prompted Critic高4.06个百分点，比训练式级联多智能体C-MAS + RL高2.61个百分点；团队在四次尝试内解决的问题也更多。

Insight: 教师为搜索过程提供细粒度信号，可以补足只看最终答案的稀疏反馈。摘要未列出七个数据集名称、训练成本及各角色消融分数，结论限于所测分层系统和指标。

Abstract: In a hierarchical multi-agent system, a Leader assigns tasks and subagents carry them out. Jointly training the Leader and the subagents is difficult because a final answer gives only indirect feedback to the subagents. An LLM judge can score the performance of the subagents, but these scores depend on the judge’s own assessment of the quality of subagents’ responses. We present MultiAgent-OPD, which combines on-policy distillation with reinforcement learning to jointly train a shared-parameter Leader-Searcher-Answerer team end to end. We first train a Teacher in a Searcher-Answerer workflow using answer correctness. During team training, the frozen Teacher scores student-generated search and summary tokens to provide local process supervision for the Searchers, while the Leader learns from team success and the Answerer from candidate correctness. Across seven datasets, the trained system reaches 38.68% macro avg@4, exceeding Prompted Critic by 4.06 percentage points and C-MAS + RL, the trained cascaded multiagent system, by 2.61 percentage points. The team also solves more questions within four attempts.

[23] MGE-PO: Entropy-Aware Credit Assignment for Mathematical Reasoning cs.CL | cs.AIPDF

Jihao Huang, Guangjia Chai, Zhirui Chen, Lei Wang, Yao Liu

TL;DR: MGE-PO在GRPO的组相对优势中加入熵感知四象限修正，让生成熵调节正确与错误回答所获奖励的幅度。

Details

Motivation: GRPO对同一问题中获得相同奖励的多个回答赋予相同组相对优势，没有利用回答生成的不确定性。回答正确性相同但生成稳定度不同，可能需要不同的学习信号。

Result: MGE-PO的4Q优势整形由核验正确性决定额外修正方向，由rollout生成熵控制幅度：低熵成功得到更大加分，高熵失败得到更大惩罚；在线熵问题课程结合缓存的rollout测量支持这一规则。在Qwen3-8B-Base训练八个epoch后的最终检查点中，三个策略优化设置加入4Q后，六个基准macro avg@32绝对提高3.23%–3.69%，macro pass@32提高4.24%–11.06%。Qwen2.5-7B-Base完整配置在四个基准上的macro avg@32从41.5%升至45.4%。

Insight: 将正确性与生成不确定性联合用于信用分配，可改变同等回报回答的训练权重。摘要没有提供基准名称、熵估计细节及计算成本，百分比增益的定义也需结合正文确认。

Abstract: GRPO assigns the same group-relative advantage to equally rewarded responses within a question, leaving their generation uncertainty unused. We introduce MGE-PO, centered on four-quadrant (4Q) advantage shaping that combines verified correctness with rollout generation entropy. Correctness determines the sign of an additional correction, while entropy controls its magnitude: lower-entropy successes receive larger bonuses and higher-entropy failures receive larger penalties. An online entropy-based question curriculum supports this credit rule using cached rollout measurements. At the final checkpoint after eight training epochs on Qwen3-8B-Base, adding 4Q across three policy optimization settings yields absolute gains of 3.23-3.69% in six-benchmark macro avg@32 and 4.24-11.06% in macro pass@32. On Qwen2.5-7B-Base, the complete configuration raises four-benchmark macro avg@32 from 41.5% to 45.4%.

[24] Who Pays for Efficient Inference? Confidence-Based Small-to-Large LLM Routing Across Tasks and Languages cs.CLPDF

Md Sabbir Hossen, Anichur Rahman, Pabon Shaha, Airin Afroj Aishi, Andrew H. Sung

TL;DR: 该研究系统评估基于置信度的小模型到大模型路由，发现其收益因任务和语言而异，且按语言均等分配升级配额可减少计算分配差距。

Details

Motivation: 小模型到大模型的路由可将难例升级处理、简单输入留给低成本模型，但有效性取决于置信度能否识别哪些样本升级后会获益。跨多语言任务的置信度可靠性及其造成的算力分配差异尚不明确。

Result: 研究覆盖三个模型家族、四种语言、三类任务，包含72种模型/数据集/语言/尺度配置及42,288个预测，并比较全局置信路由、随机路由、等额配额置信路由和预言机上限。在Belebele阅读理解和SIB-200主题分类上，置信度识别有益升级的平均校正检测AUC分别为0.612和0.705；升级50%样本时，相比随机路由分别提高1.40–4.67和2.54–5.63个百分点。MMLU-ProX-Lite知识与推理任务平均AUC仅0.510，因小模型常对错误答案仍有高置信度，路由未能稳定超过随机选择。全局置信路由还造成最高30.33个百分点的语言升级率差异；等额配额基本消除该差异，整体准确率成本较小。

Insight: 置信路由只在某些任务上可靠，不能作为通用的难例识别器；其全局使用还可能让部分语言获得更多高成本计算。等额配额可改善分配公平性，但摘要未提供所有语言的详细精度和成本曲线。

Abstract: Small-to-large language model routing can reduce inference cost by escalating difficult inputs while retaining easier ones on a smaller model. Its success, however, depends on identifying examples that benefit from escalation, and the reliability of confidence across multilingual tasks remains unclear. We present a systematic evaluation of confidence-based routing across three model families, four languages, and three task types, covering 72 model, dataset, language, and scale configurations and 42,288 predictions. We compare global confidence routing with random routing, equal-quota confidence routing, and an oracle upper bound. Confidence identifies beneficial escalations on the Belebele reading comprehension and SIB-200 topic classification datasets, with mean correction-detection AUCs of 0.612 and 0.705. At 50% escalation, it improves over random routing by 1.40–4.67 percentage points on Belebele and 2.54–5.63 points on SIB-200. In contrast, the mean AUC on the MMLU-ProX-Lite knowledge and reasoning dataset is only 0.510, and routing provides no consistent improvement over random selection because small models often remain highly confident while incorrect. Global confidence routing also creates language escalation gaps up to 30.33 percentage points, whereas equal-quota routing removes this disparity with little aggregate accuracy cost. These results show that confidence routing is task-dependent and can allocate computation unevenly across languages. Code is available at https://github.com/sabbir5622r/multilingual-llm-routing

[25] Think More or Read More? A Token-Budget Theory of Reasoning with Shared Context cs.CL | cs.LGPDF

Manh Nguyen, Sunil Gupta, Hung Le

TL;DR: 该研究建立共享上下文窗口下的token预算理论，分析推理token与读取通信token的取舍，并发现自一致性在多数匹配预算设置中不逊于多智能体辩论。

Details

Motivation: 多智能体辩论和自我修订通过额外读取他人回答或自身草稿改善推理，但所有输入输出共享固定上下文窗口时，读取信息会占用本可用于继续思考的token预算。预算紧张时通信是否值得，需要定量判断。

Result: 理论将准确率表示为读取后剩余推理预算的函数，并以允许相关错误的Condorcet陪审团模型聚合投票；对多智能体辩论推导最优智能体数的闭式预测，可由单智能体测量估算，并推广到异构模型。实证中，在校准成本最紧、辩论规则只能进行一两次提问时，按预测人数选择的方案优于强基线。理论同样适用于以自身草稿替代同伴消息的自我修订，并预测只有准确率上限增益超过阅读占用推理空间时通信才有益，窗口越小这一条件越严格。在五个开放模型、四类推理任务、980种匹配窗口和组大小设置中，自一致性有93%的情况下持平或超过已部署辩论；差距在窗口紧时最大，宽松窗口时几乎消失。

Insight: 在固定窗口内，额外读取内容会直接挤占推理空间；通信收益取决于其带来的能力提升是否抵消预算损失。结果覆盖五个开放模型和特定任务，不能直接推广到不受共享窗口约束或使用不同上下文机制的系统。

Abstract: Reasoning systems increasingly improve answers by incorporating additional context into the model’s input, from multi-agent debate, where agents read their peers’ responses, to self-refinement, where a model revisits its own drafts. In these systems, communication consumes context as one agent’s output becomes another’s input. We study the regime where token reading and generation draw on one fixed token window, so every token spent reading is a token that cannot be spent reasoning. We develop a \textbf{token-budget theory} that formalizes this trade-off, modeling accuracy as a function of the reasoning budget remaining after reading and aggregating votes with a Condorcet jury model that permits correlated errors. For multi-agent debate, the theory gives a closed-form prediction for the optimal number of agents. This quantity is estimated from single-agent measurements, allowing the optimal group size to be determined without running debate, and the same accounting extends to a heterogeneous set of different models. We empirically verify our theory and show that, at the predicted group size, our method outperforms strong baselines under the tightest calibration spend, where debate-calibrated rules can afford only one or two questions. Self-refinement obeys the same accounting, with its own draft in place of a peer message. The theory further predicts that communication pays only when the gain in the accuracy ceiling exceeds the reasoning room spent on reading, with this condition tightening as the window shrinks. Across five open models and four reasoning tasks, self-consistency matches or beats deployed debate at $93$% of $980$ matched window-and-group-size settings, with the gap being largest under tight windows and nearly disappearing at a loose one, consistent with the theory. Under a shared window, how much room a model has left to \textit{think matters more than what it reads}.

[26] Verbalising Model’s Computation for Chain-of-Thought Faithfulness Detection cs.CLPDF

Yujing Wang, Yulan He, Wenya Wang, Hanqi Yan

TL;DR: VERITAS通过逐层Jacobian投影将模型生成思维链时的内部计算演化转成结构化特征，改善推理忠实度检测并提供偏离过程的可解释线索。

Details

Motivation: 现有思维链忠实度验证主要基于模型输出或静态激活，难以解释不忠实性如何在生成过程中形成、哪些推理锚点发生变化或如何跨层传递。

Result: VERITAS用逐层Jacobian投影，为每个生成的思维链token描述模型内部推理演化；再基于轨迹中提取的结构化特征训练分类器，识别推理偏离忠实路径的步骤。在FaithCoT-Bench和BonaFide的四个数据集上，平衡准确率较LLM-as-Judge提高28.4%，平均较激活探测提高16.0%。进一步分析显示，该方法可泛化至不同数据集和模型架构。

Insight: 把内部计算变化转化为可读的轨迹特征，目标是从单纯检测不忠实转向解释其发生机制。摘要没有提供各数据集绝对分数、Jacobian特征的计算成本和机制验证细节，跨架构结论需以作者测试范围为限。

Abstract: Current Chain-of-Thought (CoT) verification methods detect reasoning faithfulness from model outputs or static activations, but are limited in explaining how unfaithfulness develops during generation. We introduce VERITAS to verbalise the model’s computation: how different reasoning anchors emerge, transfer across layers, and surface in the output. VERITAS adopts the layer-wise Jacobian projection to produce a verbalised account of the model’s internal reasoning evolution at each generated CoT token. By training a classifier on the extracted features along the traces, we show that these structured features provide insightful perspectives on how and where reasoning diverges toward unfaithfulness. Experiments on four datasets from FaithCoT-Bench and BonaFide show that VERITAS achieves a significant performance gain over LLM-as-Judge, with a 28.4% gain in balanced accuracy, and an average improvement of 16.0% over activation probing. Further analysis shows VERITAS can be generalised to different datasets and model architectures. Our work shows that verbalising model computation provides a richer and more interpretable lens on CoT faithfulness, moving beyond detection toward a mechanistic understanding of how reasoning fails.

[27] Language Models Learn to Improve Language Models cs.CL | cs.AIPDF

Minhua Lin, Zijun Wang, Zewen Liu, Zhaotian Weng, Bing He

TL;DR: LM2LM用研究世界模型为语言模型改进建议提供可扩展的预测反馈，再定期执行高分建议校正反馈，训练模型自动提出模型优化方案。

Details

Motivation: 让语言模型自动化语言模型研发有望实现递归自我改进，但强化学习若需评测数万条建议且每条都完整训练一次模型，反馈可能消耗数十万GPU小时。廉价代理奖励又会在策略分布变化后过度估计候选建议。

Result: LM2LM通过强化学习训练模型生成有效的语言模型改进建议。研究世界模型RWM是冻结语言模型，它根据上下文中的真实实验记录预测建议收益，并作为强化学习奖励模型；为维持反馈可信度，系统周期性地实际执行当前策略提出且被RWM评为较高的建议，再把测量结果加入上下文。在八个自回归和扩散语言模型开发环境中，对留出任务进行真实执行评估后，LM2LM使Qwen3.8-27B超过GPT-6-sol，即使后者上下文内提供300条真实实验记录；数据生成成本降低33%，且能泛化至训练中未见的模型家族。

Insight: 代理研究世界模型加周期性真实执行，试图兼顾强化学习反馈规模和分布漂移时的准确性。摘要未给出各环境的独立结果、真实执行预算和建议成功率，成本结论应限于比较设置。

Abstract: Large language models (LLMs) are increasingly used to automate AI research, including language-model (LM) development, offering a potential path toward recursive self-improvement. However, turning experimental feedback into a learned ability to propose effective improvements across models faces two challenges. First, training such an ability with real feedback is expensive: reinforcement learning (RL) requires evaluating tens of thousands of proposals, each potentially requiring a full model-training run. Even at ten GPU-hours per run, reward collection alone would consume hundreds of thousands of GPU-hours, motivating a cheaper surrogate. Second, surrogate feedback can become unreliable as policy optimization favors overestimated proposals when the proposal distribution shifts. To address these challenges, we propose LM2LM, which trains LLMs with RL to generate effective LM improvement proposals. To provide scalable feedback, we use a research world model (RWM), a frozen LLM that predicts proposal gains from real experimental records provided in context, as the reward model for RL. To maintain feedback reliability, we periodically execute current-policy proposals ranked highly by the RWM and add their measured outcomes to its context. Across eight autoregressive and diffusion LM development environments, real-execution evaluations on held-out tasks show that LM2LM enables Qwen3.8-27B to outperform GPT-6-sol, even when GPT-6-sol is given 300 real experimental records in context, while requiring 33% lower data-generation cost. LM2LM also generalizes to a model family unseen during training.

[28] On the Tip of the Tongue: First-Token Cueing as a Behavioral Probe of Recall Failures in LLMs cs.CLPDF

Jaewon Sok, Jewon Yeom, Seonghyeon Park, Jeongjae Park, Hwiyeong Lee

TL;DR: First-Token Cueing通过预先提供正确答案的首个token，揭示多语言事实问答中一部分闭卷错误源自首步回忆失败，而非模型完全缺少答案知识。

Details

Motivation: 语言模型闭卷回答事实问题时常出错，通常被归因于知识缺失，但模型有时实际编码了答案，只是在开始生成时没有提取出来。需要区分知识不存在与首token选择失误，以改进推理时纠错。

Result: First-Token Cueing将标准答案首token预置到模型回答中，作为行为探针。模型不确定性在首个答案token处最高；在任意长度的标准答案前缀中，单独首token纠正的错误最多。对16个开放模型，该线索纠正英语多token答案错误的五分之一至一半，并提升多语言基准全部七种语言的准确率。大多数被纠正错误也能由模型自身采样推理解决，支持相关答案已被编码但未成功回忆的解释。模型对正确起始token的续写信心高于类型和先验概率相近的错误起始token，但没有标准答案提示时很少自行找到该正确起点。

Insight: 可恢复的一类事实错误集中在解码第一步，推理时方法可能优先干预首token选择。首token提示使用了标准答案信息，属于诊断探针而非无监督可直接部署的解决方案；摘要未给出各模型和语言的具体恢复比例。

Abstract: Large language models often answer factual questions incorrectly in closed-book settings, and such errors are usually attributed to missing knowledge. Yet models often encode answers they fail to produce. We show that many closed-book errors are first-token recall failures: the model commits to a wrong first token, but once given the right one it completes the answer and often recognizes it as correct. We study this with First-Token Cueing, a behavioral probe that prefills the response with the first token of the gold answer. Model uncertainty peaks at the first answer token, where it already predicts correctness, and among gold prefixes of any length the first token alone accounts for the largest share of recovered errors. Across 16 open models, this one token corrects between a fifth and a half of the errors on multi-token answers in English QA and improves accuracy in all seven languages of a multilingual benchmark. Most of the errors it corrects are also solved by the model’s own sampled reasoning, a criterion for encoded knowledge, and models recognize correct starts they do not produce: they continue a correct start more confidently than an incorrect start of the same answer type and prior probability, yet rarely find it without the gold answer. These results locate a recoverable class of factual errors at the first decoding step, where inference-time methods may gain the most.

[29] HydraLLM: Adaptive Width Slicing for Elastic Text and Vision-Language Models cs.CL | cs.LGPDF

Oscar Kemme, Janek Haberer, Ali Hojjat, Olaf Landsiedel

TL;DR: HydraLLM通过激活不同数量的注意力头形成嵌套宽度子网，使同一文本或视觉语言模型可按硬件和算力预算弹性运行。

Details

Motivation: 大语言模型和大视觉语言模型需部署在从数据中心GPU到边缘设备的异构硬件上，固定规模架构难以复用同一模型适配不同算力、延迟和模型大小目标。

Result: HydraLLM采用基于MQA的弹性架构，激活注意力头数决定嵌入、注意力投影、前馈层和输出头的有效宽度，从单组参数形成嵌套子网。静态到弹性的转换流程先按重要性重排权重，再通过知识蒸馏进行随机子网训练；多模态推理则用输出宽度随当前文本宽度变化的弹性投影模块。模型可配置范围比仅弹性化前馈层的方法更广。激活75%注意力头时，TriviaQA准确率比参数多17.25%的嵌套基线高2.2个百分点；激活50%时，多模态模型CLIPScore与大7倍的Gemma 3 4B相当；只激活25%头时，token生成吞吐量比全宽配置提高75.3%。

Insight: 按宽度切片复用单个检查点，可以在性能、参数量和吞吐量间做部署时折衷。摘要没有给出所有宽度下的任务精度及硬件实测延迟；不同任务的指标不能相互直接比较。

Abstract: LLMs and LVLMs are increasingly deployed across heterogeneous hardware, ranging from data-center GPUs to resource-constrained edge devices. Their fixed-size architectures limit the ability to reuse a single model across deployment settings with different compute, latency, and model-size targets. We introduce HydraLLM, an elastic MQA-based architecture. Its number of active attention heads determines the effective widths of the embeddings, attention projections, feed-forward layers, and the output head, forming a nested family of subnetworks within a single parameter set. We introduce a static-to-elastic conversion pipeline that, starting from a pre-trained model checkpoint, includes importance-driven weight reordering and stochastic subnetwork training with knowledge distillation. We extend this principle to multimodal inference through an elastic projection module whose output width follows the active text width. HydraLLM covers a wider range of active parameter configurations than FFN-only elastic architectures. With 75% of heads active, HydraLLM achieves 2.2 percentage points higher TriviaQA accuracy than a state-of-the-art nested baseline configuration which has 17.25% more parameters. With 50% of heads active, our multimodal model achieves a CLIPScore comparable to that of the 7$\times$ larger Gemma 3 4B model. With only 25% of heads active, HydraLLM increases token-generation throughput by 75.3% over the full-width configuration.

[30] Perceive, Solve, Reason: Progressive Capability Formation in Time Series-LLMs cs.CLPDF

Xin Qiu, Junlong Tong, Wei Zhang, Xiaoyu Shen

TL;DR: 该研究构建覆盖感知、求解和推理的时间序列语言模型训练评测套件，发现专用编码器及按能力递进训练对泛化表现关键。

Details

Motivation: 大语言模型已能理解图像和音频，但时间序列常被局限于预测和分类，推理研究少且范围窄，缺少覆盖多种能力并能统一训练与评估的体系。

Result: 作者构建含337K训练样本、44K评测样本的三阶段能力套件：Perceive、Solve和Reason，用于研究时间序列应如何进入LLM及能力训练顺序。专用编码器不可或缺：配备编码器的4B模型在所有测试感知属性上超过GPT-4o，而将序列转成文本会使推理准确率下降8–10分。能力按感知、求解、推理顺序学习优于混合使用相同数据，并可媲美使用三倍以上推理数据的纯推理训练，但这一优势仅在有编码器时成立。能力通过网络不同深度迁移，并非简单堆叠；单阶段在本身基准收敛也不代表已准备好进入下一阶段。最终4B模型无需目标域数据，在八个域外指标中的七个超过四个近期7B时间序列模型，最高提升11分。

Insight: 时间序列可作为LLM的一等模态，通过专用编码器输入，并先学感知再学推理。摘要未给出各任务完整分数和数据集分布；训练顺序优势依赖专用编码器，不能简单推广为所有架构都适用。

Abstract: Large language models (LLMs) can now perceive, describe, and reason about images and audio, yet time series understanding remains underestimated: most work uses LLMs as forecasters and classifiers, reasoning studies are few and narrow, and no suite trains and evaluates the full range of capabilities. In this paper, we build the first such suite, with 337K training and 44K evaluation samples across three progressive capabilities, Perceive, Solve, and Reason, and use it to ask how time series should enter an LLM that must master all three, and in what order. We find that a dedicated encoder is essential: with one, a 4B model surpasses GPT-4o on every perception attribute we test, whereas textualizing the series costs 8–10 points in reasoning accuracy. The capabilities then build on one another: learning them in order beats mixing the same data and rivals reasoning-only training with over three times the reasoning data, but only when an encoder is used. Analyses further reveal that capabilities are transferred through distinct network depths rather than simply stacked, and that a stage converged on its own benchmark is not necessarily ready for the next. Distilled into a simple recipe, these findings yield 4B TS-LLMs that, without any target-domain data, outperform four recent 7B TS-LLMs on seven of eight out-of-domain metrics, by up to 11 points. We therefore advocate treating time series as a first-class modality for LLMs, read through dedicated encoders and taught to perceive before they reason.

[31] ConvexLLM: Scaling Convex-Hull Speech Interfaces to General-Purpose Audio Intelligence cs.CL | cs.SD | eess.ASPDF

Ming-Hao Hsu, Shujie Liu, Yuxuan Hu, Yuxiang Wang, Yingda Shen

TL;DR: ConvexLLM以冻结文本嵌入的连续凸组合表示音频输入，在多项语音和音频任务上表现有竞争力，同时尽量保持解码器已有文本能力。

Details

Motivation: 语音和音频语言模型需要把连续声学表示映射到主要在文本数据上预训练的解码器输入空间。常见MLP或Q-Former接口让解码器重新学习解释这些表示，可能影响已有文本能力。

Result: ConvexLLM使用C-Gate接口，将音频表示为冻结文本嵌入的连续凸组合。VoiceBench十一任务综合得分为75.36，在比较的开放权重模型中最高；MMAU Test-mini准确率为62.50%。相较基线，其最大优势出现在口语知识和推理任务，但在音频理解和转录上最强基线更准确。与2B参数解码器的接口比较中，C-Gate总体口语表现高于MLP和Q-Former，文本任务表现接近MLP，转录和音频理解存在依赖任务的权衡。

Insight: 将音频映射到解码器熟悉的文本嵌入凸包内，是保持文本能力并接入声学信息的一种可行设计。摘要显示不同任务间有取舍，不能概括为在全部音频任务上超过基线；未列出每个任务的分数。

Abstract: Speech and audio language models connect continuous acoustic representations to decoders pretrained primarily on text data. Most such models use MLP or Q-Former interfaces to map acoustic features into the decoder’s input space, requiring the decoder to learn how to interpret the resulting representations. We investigate whether grounding these representations in the decoder’s existing text embeddings can help it use acoustic information while better preserving its pretrained text capabilities. We present ConvexLLM, a general-purpose speech and audio language model whose C-Gate interface represents audio as continuous convex combinations of frozen text embeddings. ConvexLLM achieves an eleven-task VoiceBench aggregate of 75.36, the highest among the open-weight models we compare, and an MMAU Test-mini accuracy of 62.50%. Its largest margins over the baselines are on spoken knowledge and reasoning tasks, while the strongest baselines are more accurate on audio understanding and transcription. In a comparison with a 2B-parameter decoder, C-Gate achieves higher aggregate spoken-language performance than MLP and Q-Former interfaces, with text-task performance close to MLP and task-dependent tradeoffs in transcription and audio understanding. These results support convex combinations of text embeddings as a viable interface for general-purpose speech and audio language models.

[32] Acceptance Is Not Speed: Length Inflation in Training-Free Lossy Speculative Decoding cs.CLPDF

Chiatzen Wang, Bill Xu, Haochen Gu, Hongyang Zhang

TL;DR: 该研究指出无损验证与有损宽松验证的speculative decoding不能只用每轮接受token数比较，因为宽松规则可能导致生成文本尤其是推理链变长。

Details

Motivation: 推测解码常用每次验证接受的草稿token数量估计加速，但这一指标假设输出长度不变。宽松验证会接受无损策略会拒绝的token并改变输出分布，可能通过延长回答抵消表面上的接受率收益。

Result: 作者在12组目标模型—草稿模型配对及相同提示上，将训练免调的宽松验证规则与无损验证比较，测量生成长度、验证轮数、实际耗时和任务准确率。在每种规则最宽松设置下，平均每轮接受token数为无损策略的1.34倍，但生成长度达到1.54倍。对接受长度更高的规则，只有宽松策略接受的token往往在目标模型下概率较低，进而造成长度膨胀；减少验证轮数的规则通常伴随准确率明显下降。部分失败来自继续推理消耗了本用于给出最终答案的预算。

Insight: 宽松验证下，单看每轮接受token数不能代表端到端解码速度或效率；还需同时报告完成长度、验证轮数、耗时和任务准确率。摘要结果针对所测训练免规则及模型配对，不代表所有推测解码实现的相同幅度。

Abstract: Speculative decoding typically characterizes speedup by draft tokens accepted per verification round. Lossless verification preserves the target model’s output distribution and thus expected completion length, making this metric a meaningful efficiency proxy. Relaxed (lossy) verification accepts tokens that lossless verification would reject, potentially altering that distribution. We identify a length inflation phenomenon: relaxed verification lengthens completions, primarily by extending reasoning traces, largely offsetting apparent gains in accepted tokens per round. We evaluate existing training-free relaxed verification rules on twelve target-drafter pairs against lossless verification on identical prompts, measuring completion length, verifier rounds, wall-clock time, and task accuracy. At each rule’s most relaxed evaluated setting, relaxed verification on average accepts $1.34\times$ as many tokens per round but produces $1.54\times$ longer completions. For rules with higher acceptance lengths, tokens accepted only under relaxed verification tend to have low target-model probability, contributing to length inflation. For rules that reduce verifier rounds, accuracy typically drops substantially. Further analysis traces some failures to continued reasoning that exhausts the budget needed to deliver a final answer. Overall, accepted tokens per round alone is an unreliable measure of decoding speed under relaxed verification. Completion length and verifier rounds must also be reported to assess actual efficiency.

[33] Beyond the Answer: Student-Conditioned Trace Construction for Reasoning Distillation cs.CL | cs.LGPDF

Shaoang Li, Yanhang Shi, Yufei Li, Mingfu Liang, Frank Shyu

TL;DR: ReDiST按学生能力构造并筛选推理轨迹，再联合蒸馏过程和答案监督，提升问答源任务及跨基准表现。

Details

Motivation: 正确答案配套的推理轨迹不一定适合作为特定学生模型的监督。有效蒸馏除了轨迹内容是否正确，还取决于目标模型能否理解和利用这些中间步骤。

Result: ReDiST从学生自身尝试开始：对答案正确的草稿依据给定证据进行修订，对失败草稿用核验答案补充指导。与学生匹配的冻结阅读器基于问题、证据和候选轨迹，以答案恢复能力和核验答案概率筛选排序原始及编辑后的轨迹。训练时对轨迹与最终答案监督进行平衡，并加入辅助答案损失；构造和筛选在线下完成，推理阶段只使用蒸馏后的学生。问答基准实验显示，相比只监督答案、原始轨迹及所测轨迹筛选和改写基线，ReDiST可提升源任务与跨基准成绩。不同监督方法在源基准和迁移基准上的排名可能不同。

Insight: 推理监督质量应以目标学生实际学会的程度评估，而不只看轨迹是否看似合理；迁移分布也会改变训练方法排序。摘要未给出具体基准、数值和不同学生规模结果。

Abstract: A reasoning trace can accompany a correct answer without providing effective supervision for a particular student. We study how to construct traces that improve learning beyond answer-only supervision by considering both their intermediate content and their accessibility to the target learner. We introduce ReDiST, a student-conditioned trace-construction and distillation framework for evidence-rich reasoning. Starting from the student’s own attempts, ReDiST revises answer-correct drafts against the supplied evidence and repairs unsuccessful drafts with additional guidance from the verified answer. A frozen student-matched reader screens and ranks original and edited candidates using answer recovery and verified-answer probability, given the question, evidence, and candidate trace. We distill the selected targets while balancing trace and final-answer supervision with an auxiliary answer loss. Construction and selection occur offline, and inference uses only the distilled student. Experiments on question-answering benchmarks show that ReDiST can improve both source-task and cross-benchmark performance over answer-only, original-trace, and the evaluated trace-selection and rewriting baselines. Across supervision recipes, performance rankings can differ between source and transfer benchmarks, highlighting the importance of evaluating trace teaching utility across distributions.

[34] DiscoveryRSI: Recursively Learning to Discover Valuable Hypotheses cs.CLPDF

Jianyuan Zhong, Chenwei Wu, Zhaochen Yu, Xixian Jiang, Xuewei Li

TL;DR: DiscoveryRSI让多个智能体通过进化式搜索提出可检验科学假设，并递归利用实验反馈改进研究流程，在四个生命科学领域的假设质量有所提升。

Details

Motivation: 科学发现需要把有价值的假设转化为可执行调查，但如何从不断演进的研究过程中学习有效提案很难。需要定义假设价值，并将实验评价归因于研究贡献，同时避免仅凭语言模型自评形成闭环偏差。

Result: 作者将有价值、可检验假设定义为：围绕重要不确定性提出有证据支撑的主张，配套可行调查、明确判据和替代解释。DiscoveryRSI通过多智能体进化搜索构造假设树，将选择的调查编译成可执行Harbor任务；再通过假设信用优化、harness回放改进流程，以及将认可改进迁移到新调查的再发现机制递归学习。DFM-Bench从假设、修订、发展路径和研究运行等层级评估质量与累积进展。四个生命科学领域中，自动评测的假设质量从基础模型4.86提高到两轮自我改进后的5.39，主要增益在可证伪性和数据可判定性。初步专家评审中，DiscoveryRSI-27B在重要性及主张合理且受证据约束方面高于GPT-6 Luna；对模型截止时间后发表研究的假设对应率为6.3%，高于GPT-6的2.5%和Claude Opus 5的2.3%。

Insight: 递归研究系统不仅要提出主张，也要让假设可证伪、数据可处理并能从后续研究反馈中改进。人类评估被描述为初步，且摘要未详述对应率判定和研究领域，不能将自动指标等同于真实科学发现价值。

Abstract: Scientific discovery requires developing worthwhile hypotheses into practical investigations, yet learning from this evolving research process remains challenging. We introduce an operational definition of valuable and testable research hypotheses: evidence-grounded claims about consequential uncertainties, coupled with feasible investigations, explicit decision criteria, and alternative explanations. Our DiscoveryRSI framework develops hypothesis trees through multi-agent evolutionary search, compiles selected investigations into executable Harbor tasks, and recursively learns through three mechanisms: hypothesis credit optimization attributes scientific assessments to documented research contributions; harness replay identifies productive strategies and recurring failures to refine research workflows; and rediscovery applies accepted improvements to new investigations, generating further experience for subsequent learning. We also introduce DFM-Bench, which provides comprehensive assessment of hypothesis quality and cumulative research progress at the levels of hypotheses, revisions, development paths and research runs. Across four life-science domains, automated evaluation shows that hypothesis quality rises from 4.86 for the base model to 5.39 after two rounds of self-improvement, with the large gains in falsifiability and data resolvability. We further validate hypothesis quality through expert review, comparing our DiscoveryRSI-27B with other research agents. Preliminary human assessments show that DiscoveryRSI-27B scores higher than GPT-6 Luna on hypothesis importance and whether claims are plausible and evidence-bounded. DiscoveryRSI-27B achieved a 6.3% rate of hypothesis correspondence with research published after the model cutoff, largely outperform GPT-6 with 2.5% and Claude Opus 5 with 2.3%, while delivering greater human-rated improvement along research paths.

cs.CV [Back]

[35] Star Light, Star Bright: Can Multimodal Models Parse an Astronomy Visual Question Answering Dataset Right? cs.CV | astro-ph.IM | cs.DL | cs.IRPDF

J. P. Naiman

TL;DR: 该研究通过天文图像VQA数据集评估低成本多模态模型的领域图表理解，发现模型在专业问题上经常答错，且在历史期刊图像上的角尺度误差与人工比较结果相近。

Details

Motivation: 科学图表是科研沟通的重要组成部分，但通用视觉问答评测不足以代表模型理解天文图像和专业量纲的能力，尤其是面对历史文献图像退化时。

Result: 作者构建包含2,001幅部分合成图像、47,357个问题的数据集。图像平均分为等量的等高线图、NASA SkyView真实望远镜图像和使用高斯混合模型生成颜色的仿真天空图；每幅图另提供原始版本和模拟历史文献老化退化版本。三种低成本商业多模态模型在领域问题上频繁无法高准确率作答。对104幅经人工核验且具有天体测量标记的历史期刊图像进行初步比较时，模型角尺度误差的中位数与人工相近。

Insight: 此基准同时覆盖真实、合成和退化图像，有助于区分专业理解能力与对图表外观的适应情况。摘要未给出模型具体名称、各类问题准确率或误差数值；角尺度误差中位数相近也不意味着模型整体可靠性等同于人工。

Abstract: Figures are essential for scientific communication, and the field of Visual Question Answering (VQA) aims to test the figure understanding capabilities of large multimodal models (LMMs). Here, we investigate the accuracy of several low-cost LMMs on domain-specific VQA tasks for astronomical images of the sky. As instrument for this task we build a domain-specific VQA dataset comprising 2001 partially-synthetic figures divided evenly between contour plots, real telescope images drawn from NASA’s SkyView, and “fake” sky images which share the axes and angular scales of the real images but draw their colors from a gaussian mixture model, alongside 47357 questions. Each figure is released as pristine and with realistic page-aging degradations mimicking the historical astronomical corpus. Testing three low-cost proprietary LMMs, we find models frequently fail to answer domain-specific questions at high accuracy. An initial comparison with 104 human-verified, astrometrically tagged figures from historical journal publications shows similar median errors in angular extent. All code is available on GitHub: https://github.com/jnaiman/SkyImagesWASP2026 and dataset is available on HuggingFace: https://huggingface.co/datasets/ReadingTimeMachine/astro_sky_image_vqa.

[36] Event-STVG: Spatio-Temporal Video Grounding for Long-Form Event Reasoning cs.CVPDF

Yizhe Zhang, Xujia Wang, Songqi Tang, Xujie Tang, Leo Jiahao Jiang

TL;DR: Event-STVG把长视频时空定位扩展为事件级推理，要求模型结合长时上下文定位事件、推断角色并对多个目标进行联合定位。

Details

Motivation: 传统时空视频定位基准主要根据实例级描述定位目标，与多模态大模型所需的长视频推理相对脱节，也较少覆盖重复事件、角色推断和多目标联合定位。

Result: 作者构建Event-STVG，涵盖足球及另外七个领域，共标注4,016个事件发生实例。评测当前先进多模态大模型时，即使最强模型在10分钟时间跨度下的m-vIoU也只有5.4%。不同领域都出现对同类重复事件的混淆、空间定位瓶颈，以及难以同时准确定位所有所需角色的问题。

Insight: 长时距事件定位不仅需要找到相关片段，还要在重复事件间辨别实例，并把事件角色与空间目标关联起来。结果表明这些环节联合起来仍很困难；摘要未提供模型详细名单、基准划分或其他时间跨度的分数。

Abstract: Spatio-Temporal Video Grounding (STVG) aims to jointly localize a target in space and time given a natural-language query. Despite continued advances, existing STVG benchmarks remain largely centered on localizing targets through instance-specific descriptions, leaving them largely decoupled from long-form reasoning increasingly emphasized in multimodal large language models (MLLMs). In this paper, we introduce Event-STVG, a task that shifts STVG from locating what is described toward event-level reasoning by unifying long-form context, repeated-event reasoning, event localization, role inference, and multi-target grounding. To facilitate research on Event-STVG, we construct a large-scale benchmark comprising 4,016 annotated event occurrences across soccer and seven additional domains. Experiments with state-of-the-art MLLMs reveal substantial difficulty, with the strongest model achieving only 5.4% m-vIoU at the 10-minute horizon. Across domains, we consistently observe confusion among repeated same-type events, spatial grounding bottlenecks, and rare success in jointly grounding all required roles. Event-STVG establishes a new challenge for visual understanding in MLLMs, calling for future models that can jointly reason about complex events across space and time. Code and annotations are available at https://github.com/THU-KEG/EventSTVG

[37] JAVIS: Joint Audio-Visual Interaction and Streaming for Real-Time Conversational Agents cs.CV | eess.ASPDF

Junseok Ahn, Jaehyun Park, Jeongsoo Choi, Joon Son Chung, Ji-Hoon Kim

TL;DR: JAVIS提出实时流式音视频对话生成框架，以共享表示同步生成语音和面部表现，并报告初始延迟约降低200倍及唇形同步、表情适切性提升。

Details

Motivation: 现有对话系统多集中于文本或语音，缺少对自然交流重要的视觉反馈；生成的声音与脸部动作若不同步，也会损害交互体验。富有表现力的音视频对话训练数据同样不足。

Result: JAVIS采用共享LLM和Joint Refined Head形成统一音视频表示，再分别送入语音与面部的流式生成分支，端到端设计减少中间环节。作者还构建334小时合成语料JAVIS-Syn，覆盖富含情绪的多轮对话和助手式交流。实验显示，相较强基线，JAVIS初始延迟约低200倍，并在唇形同步和面部表情适切性上表现更好。

Insight: 共享表示与并行流式分支旨在兼顾低延迟和声画协调，语料也针对表达性对话数据不足。摘要没有说明延迟的绝对值、评价指标、硬件条件及自然度结果，因此200倍结论需限定在作者的比较设置。

Abstract: Human communication is inherently multimodal, conveying intent not only through linguistic and vocal cues but also through visual signals. However, existing conversational systems have mainly focused on text or speech, leaving out the visual feedback that is essential for natural interaction. In this paper, we propose JAVIS, an end-to-end streaming framework for real-time audio-visual conversational agents. Our key idea is to let the voice and the face speak from a single representation. On top of a shared LLM, a Joint Refined Head produces a unified audio-visual representation, which is fed into dedicated streaming branches for speech and face generation. This end-to-end design avoids intermediate bottlenecks, enabling real-time generation while keeping speech and face tightly synchronized. In addition, we present JAVIS-Syn, a 334-hour synthetic corpus designed to address the lack of expressive audio-visual dialogue data, covering emotionally rich multi-turn conversations and assistant-style exchanges. Experiments show that JAVIS achieves approximately 200$\times$ lower initial latency than a strong baseline, while outperforming baselines in lip synchronization and facial expression appropriateness.

[38] KFS$^4$LAM: Adaptive KeyFrame Selection with Structure-Aware Mapping for Endoscopic Gaussian Splatting SLAM cs.CVPDF

Xinwei Ju, Zhehua Mao, Tianyi Song, Danail Stoyanov, Sophia Bano

TL;DR: KFS⁴LAM为内窥镜高斯泼溅SLAM联合设计自适应关键帧选择、结构监督映射和受限形变，在C3VD-v2上改善位姿、深度和渲染指标。

Details

Motivation: 高斯泼溅SLAM的定位、重建和渲染效果受关键帧选择影响。结肠镜画面存在不均匀运动、重复解剖结构、高光及视觉伪影，固定间隔或简单位姿与重叠筛选容易留下冗余帧或遗漏有价值视角。

Result: KFS⁴LAM利用累计运动自适应选择关键帧，并结合线索抑制冗余或不可靠候选；密度感知映射使用结肠皱襞轮廓监督突出结构区域，受限时间形变用于适应局部组织变化并减少无约束几何漂移。作者在C3VD和C3VD-v2上与高斯SLAM基线比较，并做跨骨干及组件消融。在C3VD-v2与SplaTAM的匹配比较中，旋转相对位姿误差降低20.3%，深度RMSE降低38.4%，PSNR提升0.78 dB；论文称整体多个轨迹、渲染和深度指标表现较强。

Insight: 方法将关键帧策略与解剖结构监督结合，针对内窥镜场景中的动态和重复纹理问题。摘要没有给出其他基线的全量数值或临床使用验证，所报告的优势来自特定公开数据集和匹配比较。

Abstract: Gaussian-splatting Simultaneous Localization and Mapping (SLAM) augments conventional SLAM with a dense, renderable 3D scene representation, enabling high-quality reconstruction and novel-view synthesis. However, its localization, reconstruction, and rendering performance depends strongly on which observations are retained for mapping. Existing systems commonly rely on fixed temporal intervals or simple pose- and overlap-based criteria for keyframe selection. In colonoscopy, non-uniform camera motion, repetitive anatomy, specularities, and visual artifacts can make these criteria unreliable, leading to either redundant keyframes or missed informative viewpoints. We present KFS$^4$LAM (KeyFrame Selection with Structure-aware mapping for endoscopic Gaussian Splatting SLAM), which couples motion-guided adaptive keyframe selection with structurally supervised mapping and restricted temporal deformation. Accumulated motion guides adaptive keyframe selection, with complementary cues suppressing redundant or unreliable candidates. Density-aware mapping with anatomical contour supervision (colon folds) emphasizes structurally informative regions, while restricted temporal deformation accommodates local tissue dynamics without unconstrained geometric drift. We evaluate KFS$^4$LAM against Gaussian-SLAM baselines on C3VD and C3VD-v2, together with cross-backbone and component ablations. KFS$^4$LAM achieves strong overall performance across trajectory, rendering, and depth metrics, with pronounced gains on more challenging C3VD-v2 dataset. In the matched comparison with SplaTAM on C3VD-v2, it reduces rotational relative pose error by 20.3% and depth RMSE by 38.4%, while improving PSNR by 0.78 dB. Cross-backbone experiments further show that the framework is not tied to a single underlying SLAM architecture. Code and visualization results are available at https://xinweiju.github.io/KFSLAM/.

[39] TriSAR-3D and PaintFusion: A Novel Trimodal LiDAR-RGB-Thermal Dataset and Method for 3D Person Detection in Search and Rescue cs.CV | cs.ROPDF

Markus Kramer, Jan Wachenfeld, Oskar von Stryk

TL;DR: TriSAR-3D提供救援场景下的激光雷达、RGB和热成像三模态人员检测数据集，并以PaintFusion融合三类信息，在该数据集上超过多种基线。

Details

Motivation: 多数多模态三维行人检测研究面向道路车辆场景，常见目标姿势较直立且环境较规整；救援场景中人员可能躺卧、被遮挡或处于非结构化室内外环境，既有结果能否迁移尚不清楚。

Result: TriSAR-3D使用128线高分辨率激光雷达、RGB相机和热成像相机采集不同时间、室内外地点及多种姿势的数据。作者提出PaintFusion，以简单MLP融合基于PointPainting的证据。在数据集上AP@50达到65.4，高于仅激光雷达CenterPoint的53.4、RGB加激光雷达BEVFusion的60.5和改造的三模态Tri-BEVFusion的60.7；单帧延迟为51.6毫秒，相比BEVFusion的101毫秒更快。若训练数据移除躺卧姿势，各检测器对躺卧目标的AP@50都会接近零。

Insight: 研究强调救援数据中的姿势多样性对检测泛化至关重要，并展示简单三模态融合在该基准上的准确率与速度优势。具体结论限于该数据集和评测方案；摘要未给出数据集样本规模、各场景分项指标或真实救援部署验证。

Abstract: Reliable 3D person detection is important for rescue robotics to give first responders situational awareness. Yet most multimodal 3D detection research targets automotive scenarios in which pedestrians mostly appear in a narrow range of upright, near-road poses. It is therefore unclear how much of the reported performance transfers to rescue settings, as a person may be lying, partially occluded, or in unstructured indoor and outdoor environments. To investigate this gap, we introduce TriSAR-3D, a multimodal person detection dataset recorded with a high-resolution 128-channel LiDAR, an RGB camera, and a thermal camera. It captures varied poses in indoor as well as outdoor locations at different times of day to study their influence on 3D object detector performance. Furthermore, we propose a novel trimodal 3D detection pipeline, PaintFusion, that fuses PointPainting-based evidence using a simple MLP. We show that the derived method reaches 65.4 AP@50 and thereby outperforms strong LiDAR-only (CenterPoint, 53.4), RGB+LiDAR (BEVFusion, 60.5), and adapted trimodal (Tri-BEVFusion, 60.7) baselines on the dataset. At the same time, it is substantially faster than other fusion-based methods such as BEVFusion, with a per-frame latency of 51.6 ms compared to 101 ms. Additionally, we test how the performance of different 3D object detectors generalizes to unseen pose categories. Removing lying instances from training data collapses the lying-pose AP@50 to near zero across all evaluated detectors. The results indicate that dataset diversity exerts a large effect on 3D object detection performance. The dataset and code are available at https://github.com/MarkusKramer1/3D-Trimodal-People-Detection.

[40] Towards Reconstructing Geographically Diverse Architecture with 3D Foundation Models cs.CV | cs.LGPDF

Nicky Kriplani, Yiwen Zhang, Angelina Wang, Hadar Averbuch-Elor

TL;DR: ArchWorld评测三维基础模型重建全球多样建筑地标的误差，发现地域差异不只由训练数据覆盖决定，并提出同时提升模型表现、缩小地域差距的干预方案。

Details

Motivation: 互联网地标照片推动了三维视觉进展，但需要单次前馈估计场景结构的三维基础模型在真实建筑重建上仍面临挑战。若模型误差随地域变化，仅检查总体成绩会掩盖对不同地区场景的不均衡表现。

Result: 作者构建地理覆盖广、元数据丰富的建筑地标三维基准ArchWorld，并对现有三维基础模型开展误差分析。模型表现随地理区域变化，但这种趋势与训练数据代表性并不完全一致。进一步分析指出，差异还与各地区建筑特征、场景大小及背景干扰物等因素有关。基于这些发现，作者提出一项干预方案，报告其可提升三维基础模型表现并同时降低地域差异。

Insight: 地域误差不能简单归因于数据数量不足，场景本身的结构和干扰也会改变重建难度；评测应包含多地域并分析错误成因。摘要未报告基准规模、干预细节和量化增益，因此无法从摘要比较效果大小。

Abstract: Internet-scale photo collections of real-world landmarks have driven progress in 3D computer vision yet remain highly challenging for modern 3D foundation models (3DFMs) that estimate scene structure in a single feed-forward pass. In this work, we introduce ArchWorld, a benchmark of 3D architectural landmarks with high geographic coverage and rich metadata. We use this benchmark to conduct a thorough error analysis of current 3DFMs to understand where they fall short and how they can be improved. We examine socially relevant disparities in model error and find that model performance varies by geographic region; however, unlike typical fairness regimes, the trends only partially match training data representation. Our investigation reveals that the observed geographic disparities reflect not only differences in data representation and scene size but also differences in region-specific architectural features and background distractors that make scenes from different regions inherently vary in difficulty. Leveraging insights from these model failings, we introduce an intervention scheme that improves 3DFM performance while simultaneously reducing geographic disparities.

[41] Learning the Shared Latent Structure of Cryo-EM Inverse Problems cs.CV | cs.LG | q-bio.QMPDF

Nithin Chalapathi, Theo Sternlieb, Ethan Han, Sonya M. Hanson, Pilar Cossio

TL;DR: EMber通过自蒸馏学习适用于冷冻电镜多类逆问题的共享表示，在构象和组成区分、群体估计及重建效率上取得改进。

Details

Motivation: 冷冻电镜图像同时混合了分子结构、粒子姿态和成像条件，姿态估计、异质性分析和重建等逆问题通常被分别处理，未充分利用它们共享的蛋白结构和成像过程信息。具有生物意义的变化还可能只出现在局部区域。

Result: 作者采用互补的全局目标与遮挡图块目标进行自蒸馏，并构建EMber视觉Transformer家族。预训练数据包括来自214个EMPIAR数据集的逾5,000万张实验粒子图像，以及从268,000个分子组装体生成的模拟投影。EMber相较既有方法，构象区分和组成区分分别提高14.85和14.26个百分点；线性探针估计构象群体比例的误差为1.59个百分点；基于粒子分配得到参考质量重建所需的训练轮数更少。

Insight: 研究尝试让同一视觉表示服务多种冷冻电镜逆问题，并用受控的合成与实验评估区分生物结构信息和采集特定线索。摘要未给出全部基线、具体训练轮数和各任务适用条件；所述效果属于论文评测设置。

Abstract: Understanding biomolecular function requires characterizing three-dimensional structure and conformational variability, for which cryogenic electron microscopy (cryo-EM) is a powerful tool. Cryo-EM produces noisy two-dimensional particle images in which molecular structure, particle pose, and imaging conditions are jointly encoded. Recovering biological information from these observations spans inverse problems including pose estimation, heterogeneity analysis, and reconstruction. These tasks are usually addressed independently despite shared protein structure and image formation, motivating a common representation across inverse problems. Since biologically meaningful differences may be spatially localized, we study self-distillation with complementary global and masked patch objectives. Because experimental dataset discrimination can reflect acquisition-specific cues, we develop controlled synthetic and experimental evaluations and find that structural discrimination benefits from dense spatial features. We introduce the EMber family of vision transformers, pre-trained on >50 million experimental particle images from 214 EMPIAR datasets together with simulated projections from 268,000 molecular assemblies. EMber improves upon existing methods at conformational and compositional discrimination by 14.85 and 14.26 percentage points, estimates conformational populations to within 1.59pp error with a linear probe, and produces particle assignments yielding reference-quality reconstructions in fewer epochs. We demonstrate how to learn representations that capture biological information for use across multiple cryo-EM inverse problems.

[42] CFC26: Building Evaluations for Deployment in Sonar-Based Fish Counting cs.CVPDF

Madison Van Horn, Suzanne Stathatos, Sevan Brodjian, Justin Kay, Kai Van Brunt

TL;DR: CFC26扩展鲑鱼河流声呐鱼类计数数据并设计更贴近部署的评测指标，揭示仅看逐帧检测指标可能遗漏上游与下游计数的方向性偏差。

Details

Motivation: 生态监测和河流管理需要准确估算鱼类数量，但依靠专家逐帧查看声呐视频费时且成本高。自动计数虽有望扩大监测规模，当前评估方式与实际部署仍有差距，模型在新河流上的表现及计数误差方向也需检验。

Result: CFC26将CFC22扩展到九个太平洋鲑鱼河系中的11个部署地点，覆盖阿拉斯加至北加州，并设计已见与新河流、分布内与分布外的评测协议。作者提出nMNE和nMANE两个计数指标，模拟专家的操作流程，补充逐帧检测指标难以呈现的错误。使用新指标后，研究发现上游与下游计数存在此前未显现的方向性偏差；若未识别，这种偏差可能影响生态判断。

Insight: 该工作将评测单位从单帧检测扩展到更接近部署流程的计数表现，并突出跨地点泛化和偏差方向的重要性。摘要未给出偏差数值、算法基线成绩或具体部署环境，不能据此判断自动系统已达到实际监测要求。

Abstract: Accurate counts of fish populations are essential for monitoring ecosystems and making decisions for conservation, harvest limits, and river management. In many field deployments, these counts are obtained from sonar videos that experts must inspect manually, making large-scale monitoring slow, expensive, and difficult. Automated counting systems have been proposed as a scalable alternative, but so far this promise has been difficult to realize in deployment. Developing evaluations that better reflect real-world deployment conditions will help close this gap and drive improvements in counting performance in practice. To achieve this, we propose Caltech Fish Counting 2026 (CFC26), a new dataset with improved evaluation protocols that simulate deployment to seen and novel rivers, testing in-distribution and out-of-distribution performance. We expand the CFC22 dataset to eleven deployment locations across nine Pacific salmon river systems from Alaska to Northern California, capturing a broader geographical and ecological range of data. We additionally introduce two new evaluation metrics for counting, nMNE and nMANE, that mirror the operational workflow that experts use and help surface errors that frame-level detection metrics do not capture. Using these metrics, we reveal previously-concealed directional bias in upstream vs downstream counts, which would have direct and significant ecological implications if undetected. The dataset and code are publicly available on CaltechDATA and GitHub.

[43] Seeing Seizures: A Large-Scale Empirical Study of Video and EEG Deep Learning for Automated Rodent Seizure Detection and Severity Grading cs.CVPDF

Alloy Das, Shreyan Ganguly, Nyzil Massey, Hung Phi Doan, Zhanhong Jiang

TL;DR: 该研究比较视频和单通道脑电深度模型在大鼠癫痫检测及严重程度分级中的表现，发现未见个体上的细粒度分级显著更难。

Details

Motivation: 同步视频和脑电记录依赖人工标注，成为临床前癫痫研究的效率瓶颈；自动化模型是否能检测发作并稳定区分行为严重程度，特别是对未见过的动物，尚需系统评估。

Result: 研究使用20只大鼠、601个实验会话中的24,131对片段，评测10种视频架构和7种单通道脑电模型，涵盖二分类检测及三类、五类严重程度任务。在按会话隔离的参考比较中，R(2+1)D-18视频模型和GRU脑电模型的检测宏F1分别为0.968和0.974；五类分级分别为0.657和0.560。按个体隔离后，五类分级宏F1降至视频0.475、脑电0.404。实验还显示多帧采样有价值，而不同视频架构的检测表现差异较小。对RodEpil进行视频二分类评估并统一重编码以减少与类别相关的编码线索后，发作类别平均F1为0.979。

Insight: 模型对二分类发作检测的结果较强，但跨动物的五类严重程度分级明显困难；研究建议进一步探索专家辅助标注流程。标签基于行为定义，结果来自特定大鼠模型与数据协议，不能直接外推到人类诊断或临床决策。

Abstract: Manual annotation of synchronized video and EEG recordings is a bottleneck in preclinical seizure research. We present an empirical study of seizure detection and behavioral severity grading using 24,131 paired clips from 601 sessions across 20 rats in a soman-induced epilepsy model. Ten video architectures and seven single-channel EEG models are evaluated independently on binary detection and three- and five-class severity tasks. In the session-exclusive reference comparison, R(2+1)D-18 and GRU achieve detection macro-F1 scores of 0.968 and 0.974, respectively; for five-class grading, the corresponding scores are 0.657 and 0.560. Subject-exclusive evaluation reduces five-class macro-F1 to 0.475 for video and 0.404 for EEG, highlighting the difficulty of grading unseen animals. Temporal-sampling experiments demonstrate the value of multiple frames, while detection performance varies relatively little across the evaluated video architectures. A separate video-only binary-detection evaluation on RodEpil achieves a mean seizure-class F1 of 0.979 after uniform re-encoding to reduce identified class-correlated encoding cues. The study characterizes existing models for behavior-defined severity labels under the evaluated protocol, motivating further investigation of expert-assisted annotation workflows. Our code and github page is available here.

[44] Stuck on Shuffle: On Attribute-Object Binding in Vision-Language Models cs.CVPDF

Netanel Y. Tamir, Michael Green, Issar Tzachor, Or Shimshi, Dvir Samuel

TL;DR: SABER是评测视觉语言模型属性与物体绑定能力的可控基准，覆盖图文四种配对及最多十个物体；仅用合成文本进行绑定微调也能改善跨模态检索。

Details

Motivation: 检索嵌入不仅要表示图像或文本里出现了哪些概念，还要保留属性属于哪个物体。已有基准常只覆盖部分模态组合、简单双物体交换或较少属性，难以判断模型在复杂场景中的绑定是否可靠。

Result: SABER涵盖图像到图像、文本到文本及两种图文检索组合，测试多类属性和最多包含十个物体的场景。评测发现CLIP式双编码器和近期多模态大模型嵌入器都存在明显绑定错误。作者随后只用合成属性绑定文本微调多模态嵌入器，没有图像监督，但提升迁移到跨模态和图像到图像检索，同时保持一般多模态嵌入表现。改进模型在SABER上达到当时最佳结果，并提升否定理解和实例检索基准成绩。

Insight: 精确构造文本难负例可作为低成本的绑定监督来源，并能迁移到涉及图像的检索任务。摘要未列出各模型具体分数及合成训练规模，因此提升幅度和适用模型范围无法进一步量化。

Abstract: Retrieval is a fundamental task in multimodal systems: given an image or text query, the goal is to find the most relevant images or texts in a collection, often using a shared embedding space. Reliable retrieval requires these embeddings to capture not only which concepts are present, but also how they are composed. One key compositional challenge is attribute–object binding: encoding which attributes belong to which objects. Existing benchmarks provide a limited view of this capability, typically covering a subset of modality pairings, simple two-object swaps, or small attribute sets. Consequently, it remains unclear how robustly current models preserve attribute–object bindings across different modality pairings and more complex settings. We therefore introduce SABER, a controlled benchmark for evaluating attribute–object binding across all four image and text modality pairings, spanning diverse attribute types and scenes with up to ten objects. Evaluating models on SABER reveals substantial binding failures in both CLIP-style dual encoders and recent MLLM-based embedders. These findings motivate us to ask how binding can be improved efficiently. While multimodal supervision may be effective, collecting suitable images is difficult and costly. Text, on the other hand, is well suited to binding supervision: it is cheap to generate, supports a broader range of attributes and enables precisely controlled hard negatives. We thus finetune an MLLM-based embedder exclusively on synthetic attribute-binding text. Despite the absence of image supervision, the gains transfer to cross-modal and image–image retrieval while preserving general multimodal embedding performance. Our model achieves SOTA results on SABER while also improving on negation and instance-retrieval benchmarks, demonstrating broader benefits of our binding-focused supervision.

[45] ProactGen: Learning Proactive Clarification for Video Generation cs.CVPDF

Zhixiao Wang, Yang Chen, Yifan Xu, Chenbin Li, Yue Chang

TL;DR: ProactGen训练视频生成模型根据低成本草稿主动向用户提问，以澄清初始提示中未表达的意图，提升最终视频与目标的对齐程度。

Details

Motivation: 视频生成单次计算成本高，提示词不充分时用户常需反复生成、检查并修改。自动重写提示可以改善已有描述，却无法补充用户最初没有写出的偏好和创意。

Result: ProactGen把视觉语言模型训练为提问策略：给定初始提示和生成草稿，提出有助于后续生成的问题，并通过最终视频与目标参考的对齐程度进行强化学习奖励。作者发现草稿不必达到最终输出质量，因此使用较少去噪步数生成草稿以控制澄清成本。实验中，ProactGen相较直接生成带来的目标对齐增益至少是最强基线的1.8倍；单轮交互在29%的时间内，就超过最强基线经过四轮优化达到的对齐水平。

Insight: 主动澄清有机会减少无效生成迭代，草稿阶段降低质量也能控制额外开销。结果依赖目标参考和论文的对齐评测；摘要未说明提问轮次以外的用户负担、绝对分数或不同生成器上的具体差异。

Abstract: Recent advances in video generation let users create high-quality videos from natural language descriptions, yet obtaining results that match user intent remains time-consuming: individual generations are computationally expensive, and underspecified prompts force repeated cycles of generation, inspection, and revision. Existing video prompt optimization methods improve generation through automatic rewriting, but cannot supply the ideas and preferences that were not in the initial description. We propose ProactGen, a video generation framework that learns proactive clarification, eliciting user intent through questions grounded in generated video drafts. Specifically, we train a vision-language model as a questioning policy with reinforcement learning: observing the initial prompt and a video draft, it learns to ask the questions most valuable to downstream generation, rewarded by the alignment between the final generated video and a target reference. We further find that effective questioning does not require drafts of final-output quality, and exploit this property by generating drafts with fewer denoising steps, keeping the added cost of clarification low. Experiments show that ProactGen improves target alignment over direct generation by at least 1.8x the gain of the strongest baselines. Moreover, a single round of ProactGen already exceeds the alignment that the strongest baseline reaches after four refinement rounds, in 29% of its time.

[46] EgoP$^{2}$C: Internalizing Plan-Perceive-Compose for Spatial Reasoning in Egocentric Video cs.CVPDF

Chaoyu Li, Arka Sadhu, Yuliang Li, Hyo Jin Kim, Yuning Chai

TL;DR: EgoP²C把计划、感知和答案整合进单一视频语言模型，让模型在第一人称视频中自适应收集空间证据并推理，提升基准成绩且降低推理计算量。

Details

Motivation: 回答第一人称视频中的复杂空间问题，需要规划要找什么证据、获取有针对性的观察并多步整合。直接使用外部视觉或几何工具的智能体仍会受到工具观测误差影响，而只训练智能体决策并不会改善这些工具的感知能力。

Result: EgoP²C先用Dual-LoRA分别训练规划教师与感知教师，再把相应专家蒸馏到混合专家学生；之后使用当前策略生成的轨迹，通过按片段分配监督者的多教师在线策略蒸馏进行训练。规划教师指导提出何种证据问题、何时停止收集和如何组织最终答案；感知教师指导根据视频回答问题。推理时学生端到端执行这一流程，无需外部空间工具。在三个空间推理基准上，基于Qwen3-VL-8B和SenseNova-SI-1.3-8B构建的学生，相较各自基础模型平均提升9.2和7.5个百分点；推理FLOPs降低65.8%–66.3%，相较共享Dual-LoRA教师加速1.29–1.49倍。

Insight: 把证据收集策略和视频感知能力共同内化，有望减少外部工具误差并提升效率。结果来自三个基准及两个骨干模型；摘要没有列出各基准的绝对成绩或真实应用中的工具故障对照。

Abstract: Answering complex spatial reasoning questions from egocentric video requires determining what evidence is needed, acquiring targeted observations, and combining them through multiple reasoning steps. Existing vision-language models (VLMs) struggle to perform this process reliably. Agentic systems address this challenge by querying external vision and geometry tools, but training their reasoning leaves these tools unchanged, so inaccurate observations can still lead to incorrect answers. We introduce EgoP$^{2}$C, a framework that internalizes a plan-perceive-compose process within a single VLM. To this end, we first train specialized Planner and Perception teachers using separate adapters (Dual-LoRA), then fine-tune the corresponding experts in a mixture-of-experts (MoE) student under their supervision. We subsequently train the student on trajectories generated by its current policy using a segment-level extension of multi-teacher on-policy distillation (MOPD), assigning different trajectory segments to different supervisors. The Planner teacher supervises which evidence-seeking questions to ask, when to stop gathering evidence, and how to compose the final answer. The Perception teacher supervises the video-grounded answers to those questions. At inference, the student executes this adaptive workflow end-to-end, without external spatial tools. Across three spatial reasoning benchmarks, EgoP$^{2}$C students built from Qwen3-VL-8B and SenseNova-SI-1.3-8B outperform their base models by an average of 9.2 and 7.5 percentage points, respectively. Across both backbones, EgoP$^{2}$C reduces inference FLOPs by 65.8-66.3% and achieves $1.29$-$1.49\times$ speedups over their shared Dual-LoRA teacher.

[47] Shift-Reliance Alignment: Ranking Vision-Language Models by the Cues They Trust cs.CV | cs.LGPDF

Faisal Mohammad, Mohamed Younis

TL;DR: Shift-Reliance Alignment利用模型对特定视觉线索的依赖程度及目标域线索误导比例，预测视觉语言模型在新领域中的相对错误表现并选择模型。

Details

Motivation: 统一排行榜给所有应用提供单一模型排名，但模型在某类幻觉基准上错误较少，并不意味着它在另一种场景中也更可靠。目标域标签往往有限或不可用，因此需要判断模型对场景上下文、图中文字等线索的依赖，进而预测分布变化下的失误。

Result: 作者通过编辑100张有标签源图像，让某条线索给出错误暗示，并与匹配控制编辑比较，测量各模型的线索依赖；再用检测器在650至1,200个有标签目标样本上校准线索误导比例。依赖分数能预测九个未参与设计模型对实体贴纸攻击的易受骗程度，Spearman相关为0.93，也能补充预测未编辑COCO图像上的幻觉。SRA将源域错误与“线索依赖×目标域误导比例”合成选择分数。在预注册的新图像测试中，它将Objects365和OpenImages所选模型错误率从按源错误选出的30.4%降到18.8%，但COCO上预测未兑现。在CueDial中，叠加文字否认可见物体时，按模型置信度选择较最佳模型落后超过40个百分点，SRA与最佳模型的差距在3个百分点内。

Insight: 按模型信任什么线索来评估，可能比源域总体准确率更能预测某些分布偏移下的可靠性，但结果也显示这种预测并非对所有目标集都有效。使用目标域校准器需要少量标注样本，摘要报告的域迁移效果限于指定任务和基准。

Abstract: Vision-language models (VLMs) are usually chosen from leaderboards, which give one ranking for every application. On questions about objects that a scene suggests but does not contain, however, the model with the lowest error on the POPE hallucination benchmark is not the one with the lowest error on such questions. For yes/no questions about object presence, we show that the best model for a target domain can be predicted without running any candidate on that domain, given 650 to 1,200 labeled target items that calibrate a detector. We measure each model’s reliance on a cue, a feature such as scene context or text in the image, by editing 100 labeled source images so that the cue suggests the wrong answer, and comparing with a matched control edit. Reliance predicts which VLMs are misled by physical sticker attacks (Spearman .93 on nine models not used to design the score) and which hallucinate on unedited COCO photographs, beyond what their tendency to answer yes explains. Shift-Reliance Alignment (SRA) scores a model by its source error on the labeled source questions plus its reliance multiplied by the shift. The shift is the proportion of target questions on which the cue misleads, and a detector estimates it on the unlabeled target images. SRA selects the model with the lowest score. In pre-registered tests on new images where most questions mislead, it lowered the error of the selected model from 30.4% under selection by source error to 18.8% on Objects365 and OpenImages but, against its prediction, not on COCO. On CueDial, a benchmark we release that varies how often a cue misleads, selection by model confidence falls more than 40 percentage points behind the best model when overlaid text denies a visible object, and SRA stays within 3 points.

[48] Thinking from Above: Efficient Spatial Reasoning with Bird’s-Eye-View Visual Tokens cs.CVPDF

Faizan Siddiqui, Nirav Savaliya, Sahith Reddy Chada, Enna Sachdeva

TL;DR: Cambrian-BEV将多帧视觉特征投影到共享鸟瞰坐标并聚合为少量空间token，增强具身视频空间推理，同时降低预填充时间和峰值内存。

Details

Motivation: 现有视频多模态模型主要沿时间组织观察，邻近帧虽可能一致，却缺少跨视角和时间稳定的空间上下文。具身场景可获得深度和相机姿态，可据此将同一物理位置的观测关联起来。

Result: Cambrian-BEV在Cambrian-S上加入无需可学习参数的几何token化：把每帧图像块特征反投影到共享鸟瞰坐标系，并对落入同一格子的特征求平均。128帧中约10万DINOv3图像块特征被压缩为27×27、共729个BEV token，使LLM预填充时间减少2.9倍、峰值内存减少3.6倍。在VSI-Bench上得分63.48，比同样微调的帧token对照高8.5分，视觉token减少12.6倍；房间大小和相对方向任务分别提升24.5和34.1分。在ReVSI上得分44.68，比对应对照高4.5分。

Insight: 共享空间坐标能把跨时刻、跨视角的观察融合为持久场景表示，并兼作视觉序列压缩。方法依赖可用的深度和相机位姿；摘要结果来自指定基准及DINOv3设置，未证明对无可靠几何输入的视频同样有效。

Abstract: Existing video multimodal large language models (MLLMs) organize observations primarily in time, but embodied spatial reasoning requires organizing them in space. Consequently, their visual representations can remain locally consistent across nearby frames while lacking a persistent spatial context that is stable across viewpoints and time. We exploit depth and camera pose, which are naturally available to embodied agents, to explicitly establish this spatial correspondence. We introduce Cambrian-BEV, which extends Cambrian-S with a parameter-free geometric tokenization scheme that back-projects visual patch features from each frame into a shared bird’s-eye-view (BEV) coordinate frame and averages features that fall within the same spatial cell. Thus, observations of the same physical location, regardless of viewpoint or time step, are aggregated into a common spatial token. In addition to providing a persistent scene representation, this formulation acts as an efficient compression mechanism: 128 frames containing approximately 100K DINOv3 patch features are consolidated into a fixed 27$\times$27 grid of only 729 BEV tokens, cutting LLM prefill time by $2.9\times$ and peak memory by $3.6\times$. Cambrian-BEV requires no architectural modification beyond BEV tokenization and uses a frozen DINOv3 vision encoder with a trainable multimodal projector and LLM. On VSI-Bench, our model reaches 63.48, $+8.5$ points over an identically fine-tuned frame-token control with $12.6\times$ fewer visual tokens, with particularly large gains on room size ($+24.5$) and relative direction ($+34.1$). On ReVSI, it reaches 44.68, $+4.5$ over the corresponding control.

[49] MedSTP: Preserving Subspace and Transition Evidence for Medical VQA Token Pruning cs.CVPDF

Mengchen Fan, Qizhen Lan, Xi Xiao, Lin Zhao, Liang He

TL;DR: MedSTP提出无需训练的医学视觉token剪枝方法，在剪枝时保留主视觉子空间证据并偏重边界和纹理线索，在多个医学VQA评测上表现稳定。

Details

Motivation: 医学视觉问答模型通常把很长的图像token序列传给语言模型，剪枝可降低计算开销，但医学答案可能依赖局部边界和纹理。简单删减token存在丢失关键证据的风险。

Result: MedSTP把预解码剪枝视为稳定保留证据子空间的问题，根据主成分空间估计token的谱支持并构造紧凑表示子空间；另加入有界的网格转移先验，以强调边界和纹理敏感token。作者使用Lingshu-7B和Qwen3-VL-8B，在闭合式SLAKE、OmniMedVQA及同时提供闭合式和开放式评估的RadImageNet-VQA上测试，报告MedSTP在RadImageNet-VQA的两种评估中均取得持续较强表现。

Insight: 该方法试图在不额外训练的条件下减少医学图像token，同时保留空间结构相关证据。摘要未给出剪枝率、具体成绩及相对基线的差异，也未报告临床诊断评估，因此无法量化效率收益或临床适用性。

Abstract: Medical vision-language models (VLMs) for visual question answering (VQA) often pass long visual-token sequences to the language model, making visual-token pruning attractive but risky for medical images, where answers may depend on localized boundary and texture evidence. We study training free pre-decoding pruning and treat pruning as a subspace stable evidence preservation problem. The retained tokens should remain close to the dominant visual evidence subspace induced by the full token set. To this end, we propose \emph{Subspace-Transition Token Pruning} (\method{}), which estimates each token’s spectral support from principal component space and constructs a compact representation subspace. To better reflect medical image structure, \method{} further uses a bounded token-grid transition prior to promote boundary and texture sensitive tokens. We evaluate \method{} on the closed-ended SLAKE and OmniMedVQA benchmarks and on RadImageNet-VQA, which provides both closed-ended and open-ended evaluations, using Lingshu-7B and Qwen3-VL-8B backbones. \method{} delivers consistently strong performance on both the closed-ended and open-ended RadImageNet-VQA evaluations. These results show that \method{} is an effective training free pruning framework for medical domain VQA.

[50] OmniXRef: A Unified Framework for Multimodal Multi-Reference Video Editing cs.CVPDF

Xiaoyan Cong, Tianyu Wang, Hyeonho Jeong, Zhifei Zhang, Yuqian Zhou

TL;DR: OmniXRef统一处理文本、图像和视频多参考输入的视频编辑，通过参考库接口和单流扩散Transformer控制源视频的多种属性。

Details

Motivation: 视频编辑意图可能通过文字、主体参考图、镜头运动参考视频或它们的组合表达。现有方法通常针对单项任务，且视频作为控制信号的训练数据较少，难以灵活组合不同数量和类型的参考。

Result: OmniXRef使用统一参考库输入设计，并提出R²-RoPE以支持更多参考；模型以单流扩散Transformer交错处理源视频和来自多模态大模型的上下文。作者通过多种编辑任务和参考组合的合成流程构造OmniXRef-Data，并用课程学习逐步增加任务复杂度和分辨率。为评测视频参考的属性迁移，另提出覆盖相机、运动、内容、风格和视觉特效的OmniXRef-Bench。综合实验报告模型超过任务专用基线和商业模型。

Insight: 框架试图让用户用可变数量的多模态参考共同控制多种视频属性，并建立对视频参考的系统评测。摘要没有给出基准规模、各项数值或与商业系统比较的具体设置，无法判断提升幅度。

Abstract: Creative intent in video editing can be expressed through text instructions (e.g., “remove the people”), image references (e.g., subject appearance), video references (e.g., camera movement), or a combination of the above. We introduce OmniXRef, a unified framework for multimodal multi-reference video editing that allows users to combine variable numbers of text, image, and video references to control diverse attributes of a source video. We first devise a unified input design with a reference-bank interface and introduce $R^2$-RoPE to support generalization to more references. Then our model, OmniXRef-Model, uses a single-stream diffusion transformer to jointly process the source video and multimodal context from an MLLM in an interleaved sequence. To address the scarcity of training data for video-reference editing, we construct OmniXRef-Data using synthesis pipelines for different editing tasks and combinations of references. We use curriculum learning to progressively increase task complexity and resolution. To support systematic evaluation of video as a control modality, we introduce OmniXRef-Bench, a benchmark for video-reference attribute transfer across Camera, Motion, Content, Style, and Visual Effects (VFX). Comprehensive evaluations show that our OmniXRef-Model outperforms task-specific baselines and commercial models.

[51] STRIDE: Evaluating Spatiotemporal Reasoning in Driving Edge Cases cs.CV | cs.AIPDF

Lieqi Liu, Rui gao, Jia-Chen Gu, Wenbo Hu, Zhaobin Mo

TL;DR: STRIDE面向长尾和安全关键驾驶场景评测视觉语言模型的时空推理，显示模型描述场景的能力不等于能准确判断运动和驾驶风险。

Details

Motivation: 自动驾驶需要理解物体随时间的运动和交互，仅识别周围物体不足以支撑安全决策。现有基准往往在边缘场景中只问基础感知问题，或只在简单情形测试时间理解，难以评估复杂时空推理。

Result: STRIDE是以对象为中心的驾驶基准，包含空间感知、空间理解、时间记忆、时间外推、轨迹预测和场景上下文意识六类任务，并同时提供选择题和要求解释及决策依据的开放式视觉问答。数据优先覆盖异常对象行为和复杂交通交互，答案由结构化标注自动生成并经有限模型辅助和人工核验。12个商业、开放权重及驾驶专用模型中，最佳GPT-6-Astra平均选择题准确率为43.4%，随机基线约20%。分析发现，场景描述能力强不代表安全判断准确；模型重建物体运动比回忆过去位置更困难。

Insight: STRIDE指出综合VQA分数可能掩盖安全关键的运动推断短板，可用于细分驾驶场景中的时空错误。摘要未报告开放问答的具体成绩，也未涉及真实道路闭环驾驶表现；基准成绩不能替代安全认证。

Abstract: In autonomous driving, perceiving surrounding objects is not enough: failing to understand how they move and interact over time can lead to dangerous decisions. Evaluating vision-language models (VLMs) therefore requires testing whether they connect past spatial observations to future consequences. Yet existing benchmarks often assess edge cases through basic perception questions or test temporal understanding in simple scenarios, leaving complex spatiotemporal reasoning underexplored. We introduce STRIDE (SpatioTemporal Reasoning In Driving Edge Cases), an object-centric benchmark for long-tail, safety-critical driving scenarios. STRIDE covers six task families: spatial perception, spatial understanding, temporal memory, temporal extrapolation, trajectory prediction, and scene-context awareness. It pairs multiple-choice questions probing individual spatiotemporal judgments with related free-form visual question answering (VQA) requiring detailed scene explanations and justifications of driving decisions. We prioritize scenes with unusual object behaviors and complex traffic interactions, generate reference answers from structured dataset annotations through automated procedures, and use limited language-model assistance and human verification to ensure annotation quality. Across 12 proprietary, open-weight, and driving-specialized models, even the best performer, GPT-6-Astra, achieves only 43.4% average multiple-choice accuracy, versus an approximately 20% random-choice baseline. Further analysis reveals that strong performance in describing driving scenes does not necessarily translate to accurate safety-critical judgments, and that models struggle more with reconstructing object motion than recalling past positions. STRIDE thus exposes spatiotemporal driving limitations that aggregate VQA scores can conceal.

Noé Mosca, Mohamed Rayan Barhdadi, Muhammad Hamza, Joshua Yeh, Suryodaya Bikram Shahi

TL;DR: VISTA是面向盲人和低视力用户日常目标辅助的第一人称多模态基准，覆盖六种传感输入和十类任务，发现现有模型会描述场景但较难给出目标导向指导。

Details

Motivation: 现有视觉模型基准多依赖图像与文字输入，并着重场景理解或问答，较少包含可穿戴设备提供的视线、惯性测量、空间轨迹等模态，也较少评估针对日常目标的辅助指引。

Result: VISTA包含约1,000段由Project Aria眼镜采集的第一人称录像，每段提供同步传感流，其中六种作为模型输入，并有三类标注覆盖十种任务，包括物体定位和危险检测。作者对14个代表性视觉语言模型进行零样本评测，并设计融合六种模态的轻量模型基线。实验显示，现有模型往往能描述第一人称场景，但生成目标导向的辅助指引仍有限。

Insight: 该基准将评测从“看懂画面”推进到结合用户目标提供日常帮助，并纳入穿戴设备可用的多模态信号。摘要未列出各模型具体分数、盲人用户参与评价情况或实际任务完成率，不能判断辅助建议的可用性和安全性。

Abstract: Blindness and low vision limit many people’s ability to complete daily tasks, motivating AI assistants that provide useful guidance. Yet, existing benchmarks do not adequately test whether vision models can provide effective everyday assistance. In particular, i) existing benchmarks primarily rely on visual and textual inputs, with limited support for other modalities that are increasingly available in egocentric wearable devices such as gaze, inertial measurements, spatial trajectories, and others; and ii) existing evaluations emphasize scene understanding and question answering, with limited coverage of goal-conditioned guidance for blind and low-vision users across everyday tasks. To bridge this gap, we introduce VISTA (Visually Impaired Scene and Task Annotations), a multimodal egocentric benchmark for goal-oriented assistance for blind and low-vision users. VISTA contains $\sim$1,000 egocentric recordings captured with Project Aria glasses; each recording provides synchronized sensor streams, six of which serve as model inputs, and three different types of annotation, covering ten task categories (TC), from object localization to hazard detection. We evaluate 14 representative vision-language models zero-shot on VISTA and design a lightweight multimodal model baseline that integrates all six modalities. Experimental results show that, although existing models can often describe egocentric scenes, they remain limited in generating goal-directed assistive guidance. VISTA thus provides a benchmark for evaluating multimodal models that could improve everyday accessibility.

[53] Variational and Decomposed method for Mitigating Bimodal Bias in Robust Visual Question Answering cs.CVPDF

Yihan Zhao, Yuncheng Jiang

TL;DR: VDB区分计数题与非计数题中的视觉语言双模态偏差来源，并通过变分语言偏差模型和双模态偏差模型分别建模，在多个VQA基准上验证方法。

Details

Motivation: 视觉问答模型常会过拟合高频模式。除语言偏差外，多模态偏差也被观察到，但其定义和不同问题类型中的成因尚不清晰，导致统一去偏策略可能不能适配计数与非计数问题。

Result: 作者分析发现，两类问题的偏差机制不同：计数所需的数量信息对应多模态特征特定维度的幅值，因此计数偏差主要从视觉侧产生并经模态融合传播；非计数偏差主要来自语言侧，也受少量视觉偏差影响。VDB通过不同视觉与语言贡献比例提取双模态偏差，使用基于变分自编码器原理的偏差模型学习以语言为主、带少量视觉影响的偏差，并另建同时融合语言和视觉的双模态偏差模型。在VQACPv2、VQACPv1和GQAOOD上的实验支持作者的偏差解释及方法有效性；论文还分析了VQAv2上的性能折中。

Insight: 按计数与非计数问题分别建模偏差，可能比只去除语言先验更合适。摘要没有报告各数据集的量化增益或VQAv2性能折中的具体原因，结论主要是作者对机制和实验趋势的概述。

Abstract: Visual question answering (VQA) models are known to suffer from the bias issue, which refers to overfitting the regularities of frequent patterns. Previously, researchers only consider the language bias. Recently, the multimodal bias is noticed. However, what multimodal bias is remains unclear. In this paper, we investigate the multimodal bias in counting and non-counting questions. We find that they have distinct underlying mechanism, so their biases come from distinct reasons. We provide valuable interpretations of VQA counting mechanism: \textbf{quantity information stems from the magnitude of the multimodal features in specific dimensions.} Thus, counting bias stems from the vision side and propagates to multimodal features through modality fusion, while the non-counting bias stems from primarily language bias and slightly vision bias. Thus, we propose a method to deal with them differently: Variational and Decomposed method for mitigating Bimodal Bias (VDB). It extracts bimodal bias affected by different proportion of vision and language sides. We introduce variational bias models utilizing the principle of Variational Auto-Encoder to learn mainly language bias with slight vision effect, and a bimodal bias model for bimodal bias combining language and vision sides. Extensive experiments on VQACPv2, VQACPv1, and GQAOOD datasets demonstrate the rationality of our claim and the effectiveness of our method. We also provide explanation for the compromised performance on VQAv2.

[54] HAPACT: A Benchmark For Human-Centric Physical Impact Localization in Movies cs.CV | cs.AIPDF

Youngrae Kim, Yejin Jang, Eunho Kim, Youjin Sung, Kun-Woo Song

TL;DR: HAPACT提出电影视频中以人为中心的物理冲击定位任务，同时定位冲击发生的时间和人体位置，并提供含精细人工标注的基准。

Details

Motivation: 视频中的物理推理研究多聚焦日常交互，而短促、强烈的冲击事件及其对人体的作用关注较少；这类事件对理解身体与物体的接触及突发物理变化很重要。

Result: HAPACT包含超过2,800个视频与查询配对，以及超过20,000个精细人工标注帧，数据来自电影片段。任务围绕观看者理解进行标注，采用文本条件定位，时间监督精确到帧，空间标注基于SMPL-X人体模型。作者使用视频片段检索模型测试时间定位，并使用人体场景接触模型测试空间定位；另提出将空间定位重构为查询引导的人体部位选择的文本条件基线。现有方法在该任务上仍面临明显挑战。

Insight: HAPACT将时间定位和人体部位定位联合纳入视频冲击理解，为研究短促物理事件提供专门基准。摘要未报告各方法的数值成绩或数据分布，因此无法量化模型差距；电影场景也不等同于真实物理环境。

Abstract: Physical reasoning about humans in videos has largely focused on everyday interactions, where contact, pressure, pose, and motion support embodied perception and contact-aware applications. Still, short and forceful properties like impact events remain relatively underexplored, despite their relevance to broader understanding of how abrupt physical events affect the human body. To fill this gap, we introduce human-centric impact localization, a new task that localizes target physical impacts temporally within a video and spatially on the human body. We further present HAPACT, a HumAn-centric imPACT dataset and benchmark built from movie clips, containing over 2.8K video-query pairs with more than 20K fine-grained human-annotated frames. We built HAPACT around viewer-grounded annotation, text-conditioned localization, and supervision at frame-level temporal and SMPL-X-based spatial granularity. To demonstrate the effectiveness of our benchmark, we conduct extensive evaluations of existing methods, employing video moment retrieval models for temporal localization and human-scene contact models for spatial localization. For the spatial task, we propose a text-conditioned baseline by reformulating localization as query-guided body-region selection. Benchmark results show that physical impact localization remains challenging for existing methods, motivating HAPACT as a dedicated benchmark to support physical impact reasoning in videos.

[55] VTrajEmbed: Aligning Text with Video Object Trajectories via Spatiotemporal Embeddings cs.CVPDF

Ruizhi Chen, Zining Fan, Yudi Guo, Jiang Liu, Zhiyu Lin

TL;DR: VTrajEmbed将视频拆解为对象轨迹并分别与文本对齐，结合快慢轨迹编码和掩码对比学习，在轨迹级和全局检索基准上超过一个较大的嵌入模型。

Details

Motivation: 现有嵌入模型擅长全局视频检索，但单一表示会混合多个物体及其时空动态，限制对象级文本定位。需要直接学习文本与具体物体轨迹之间的细粒度对应关系。

Result: VTrajEmbed使用双分支编码：密集采样低分辨率帧捕捉高频运动，稀疏选择高分辨率帧保留场景上下文，再由共享LLM骨干聚合。掩码引导对比目标结合组内损失和批次级双向损失，排除未经核实的关系，并避免把已确认匹配当成负例。作者还构建Text2Traj-Bench并经人工核验查询与轨迹关系。VTrajEmbed-5B的文本到轨迹及轨迹到文本R@1分别比Qwen3-VL-Embedding-8B高15.48和18.05个百分点；五个全局检索基准的平均R@1为49.48%，对照为42.86%。

Insight: 基于轨迹的表示能显式保留对象运动信息，并将文本检索粒度从整段视频细化到对象。摘要没有给出轨迹基准规模、运行成本及不同场景表现；全局检索优势也不能替代对轨迹定位正确性的单独核验。

Abstract: Fine-grained alignment between text and video object trajectories is a core challenge in multimodal understanding. Existing embedding models excel at global retrieval, yet their single global representation entangles multiple objects and their spatiotemporal dynamics, limiting direct object-level grounding. To address this issue, we propose VTrajEmbed, an embedding model that decomposes a video into object trajectories and aligns each trajectory embedding with text for object-level grounding through retrieval. Our main contributions: (1)Slow-Fast Trajectory Encoding, a dual-branch architecture that establishes trajectory representations by densely sampling low-resolution frames for high-frequency motion cues and sparsely selecting high-resolution frames for scene context, aggregated by a shared LLM backbone; (2)Mask-Guided Contrastive Learning, a training objective built upon these representations that couples an intra-group loss and a batch-level bidirectional loss under a relation mask, excluding unverified relations and preventing confirmed matches from becoming false negatives; (3)Text2Traj-Bench, a trajectory-level text-video benchmark with model-assisted construction and human-verified query–trajectory relations. Experimental results show that VTrajEmbed-5B improves text-to-trajectory and trajectory-to-text R@1 over Qwen3-VL-Embedding-8B by 15.48 and 18.05 percentage points, respectively, and achieves 49.48% average R@1 across five global retrieval benchmarks, compared with 42.86% for Qwen3-VL-Embedding-8B.

[56] MaskMerge: Structure-aware Token Merging for Efficient Instance Segmentation cs.CVPDF

Bavesh Balaji, Letian Jiang, Alexander Wong, David Clausi, Sirisha Rambhatla

TL;DR: MaskMerge用中间实例掩码约束视觉token合并，减少相邻同类目标被错误融合，在PanNuke和iSAID上同时提高实例分割精度并降低计算量。

Details

Motivation: 视觉Transformer的token合并可通过压缩冗余特征降低计算量，但按特征相似度合并在实例分割中可能把相邻、同类别的不同对象融合，破坏实例边界。

Result: MaskMerge使用粗略中间掩码预测限制基于特征的合并，从而保留实例边界。在PanNuke上，相较ALGM，mAP从30.1升至32.1，GFLOPs从229降到153，速度提升1.18倍；在iSAID上，mAP从33.1升至36.2，GFLOPs从198降到182，速度提升1.23倍。在Cityscapes上，方法以更低FLOPs匹配ALGM表现；收益也迁移到MAE预训练骨干。

Insight: 实例边界信息可帮助token压缩在相似外观对象间保持身份区分，从而容许更激进的合并。结果覆盖病理核与遥感等具有高实例相似度的领域；摘要未给出所有设置的硬件速度或模型精度变化范围。

Abstract: Token merging improves the efficiency of Vision Transformers by combining redundant tokens, but existing methods largely rely on feature similarity to determine which tokens to merge. This criterion is effective for semantic segmentation, yet can fail in instance segmentation, where adjacent objects of the same class often have highly similar features. We identify this failure mode as cross-instance token fusion. We introduce MaskMerge, an instance-aware token merging method that uses coarse intermediate mask predictions to constrain feature-based merging and preserve instance boundaries. We evaluate MaskMerge on two diverse instance segmentation domains characterized by high inter-instance visual similarity: PanNuke and iSAID. Against the SOTA token merging method ALGM, MaskMerge improves mAP from 30.1 to 32.1 on PanNuke while reducing computation from 229 to 153 GFLOPs and running 1.18x faster, and from 33.1 to 36.2 on iSAID while reducing computation from 198 to 182 GFLOPs and running 1.23x faster. Additionally, we also test it on Cityscapes and match ALGM’s performance while using fewer FLOPs. The gains also transfer to an MAE pretrained backbone, demonstrating that instance-aware merging enables more aggressive compression when appearance similarity alone cannot reliably preserve object identity.

[57] COMET: Decoupled Distillation, Routing, and Capacity Control for Task-Agnostic Continual Vision–Language Learning cs.CV | cs.AIPDF

Seungyoon Woo, Keonhee Park, Gunhee Kim

TL;DR: COMET通过特征蒸馏、专家协调、路由和容量控制，应对视觉语言模型在无任务标识的持续学习中的模态漂移、表示干扰与专家容量不足。

Details

Motivation: 视觉语言模型如CLIP具备零样本识别能力，但开放环境持续学习要求任务依次到来、无法访问旧数据、不知道当前任务身份且不能重训骨干。除了稳定性与可塑性的权衡，模态关系漂移、表示空间干扰和每任务容量不足也会造成性能退化。

Result: COMET以冻结教师在共享图文池上提供特征参考；三亲和蒸馏保持图像-图像、文本-文本及图像-文本几何关系；学生感知的跨专家蒸馏让新专家对齐兼容旧专家，使路由错误时性能退化更平滑。方法将容量管理与推理路由分开：上下文赌博机根据训练后信号保留或合并完整任务专家，重建式路由器在测试时选择稀疏专家且无需教师语义。在X-TAIL基准上，消融显示各组件均能改善持续学习表现。

Insight: COMET尝试把跨任务知识保存在多模态几何关系中，并在测试阶段动态管理和选择专家。摘要未提供总体准确率、遗忘程度、专家数量和计算成本，因此只能确认作者报告的组件级趋势。

Abstract: Vision-language models (VLMs) such as CLIP retain zero-shot recognition ability, but their open-world use often requires task-agnostic continual learning: tasks arrive sequentially, past data are unavailable, task identity is unknown, and the backbone cannot be retrained. We argue that this setting fails VLMs through three coupled pressures beyond the stability-plasticity tradeoff: (1) modal-consistency drift, (2) representation-space interference, and (3) per-task capacity shortfall. We propose COMET (Collaborative Mixture-of-Expert Transfer) to resolve these three issues respectively as follows. A frozen teacher provides only a feature reference on a shared image-text pool; Tri-Affinity Distillation preserves image-image, text-text, and image-text geometry; and Student-Aware Cross-Expert Distillation aligns new experts with compatible prior experts so routing errors degrade gracefully. We design COMET to keep capacity and inference separate: a contextual bandit keeps or merges full per-task experts using post-training signals, while a reconstruction router selects sparse experts at test time without teacher semantics. On the X-TAIL benchmark, we show that each proposed component improves continual learning performance. COMET shows that continual vision-language adaptation can preserve multimodal geometry, coordinate accumulated experts, and allocate capacity jointly when feature reference, expert shaping, routing, and capacity control are separated by construction.

Zhifeng Ma, Yuhong Feng, Chongyi Huang, Mingyang Zhou, Minwen Deng

TL;DR: ODSS-Net将多模态重识别特征拆分为共享结构和模态特定信息，再以样本自适应专家融合互补特征，并在三个基准上验证方法。

Details

Motivation: 多传感器目标重识别需要融合互补信息，但跨模态对齐可能把共享结构与模态专属线索混在一起，常规融合也未必能充分利用各传感器的独有信息。

Result: ODSS-Net先通过共享结构特征构造模块抑制模态相关外观差异，提取跨模态共同结构；再用正交特定特征学习模块聚合与身份相关的局部信息，并通过几何正交投影移除已对齐共享成分；最后以共享结构作为路由上下文，用样本自适应专家混合模块调整并融合模态特定特征。作者在三个基准上进行实验，报告该框架对多模态目标重识别有效。

Insight: 显式区分共享结构和传感器特有线索，再进行自适应融合，有望减少对齐时的信息混杂。摘要没有列出具体基准、指标成绩或对不同传感器组合的分析，因此无法进一步比较增益大小。

Abstract: Multi-modal object re-identification (ReID) leverages complementary information from heterogeneous sensors. Cross-modal alignment and fusion remain challenging. Existing methods mainly reduce modality gaps via feature alignment and fusion. However, alignment may entangle modality-shared structural information with modality-specific cues, while conventional fusion may not fully exploit complementary information. To address these issues, we propose ODSS-Net, a framework for orthogonally decoupled shared-specific representation learning and adaptive fusion of complementary modality-specific features. First, a Shared Structural Feature Construction (SSFC) module suppresses modality-dependent appearance variations and extracts modality-shared structural information. Then, an Orthogonal Specific Feature Learning (OSFL) module aggregates identity-relevant local information and removes the shared-aligned component via geometric orthogonal projection. Finally, a Sample Adaptive Mixture of Experts (SAMoE) module uses the shared structure as routing context to adaptively refine and fuse modality-specific features. Experiments on three benchmarks demonstrate the effectiveness of ODSS-Net for multi-modal object ReID.

[59] DICL-Qwen3VL: Decoupled Confidence Calibration for Interpretable Workwear Detection cs.CVPDF

Meng Wang, Wu Zeng, Mei Li, Chao He

TL;DR: DICL-Qwen3VL将工装识别的视觉证据、合规推理及两种置信度分开建模，在两个室内施工数据集上超过所测LoRA视觉语言模型基线。

Details

Motivation: 施工场景中的光线不足、遮挡和服装多样性让工装合规判断困难。视觉语言模型的预测常缺少明确依据，单个置信分数也无法区分图像观察不确定性与合规规则判断歧义。

Result: DICL-Qwen3VL用LoRA适配Qwen3-VL定位可见上身服装并识别工装，再把视觉观察与合规推理拆开并分别校准置信度。视觉置信监督结合token熵和图像扰动敏感性，使其关联生成观察及其对图像内容的依赖；GRPO联合优化检测准确率、输出有效性和置信校准。在公司采集的ICSWD和网络采集的WICWD上，mAP@50分别为0.730和0.753，超过所测LoRA适配视觉语言模型基线，包括Qwen3-VL。框架同时输出证据和分离的置信分数，以支持工业安全监测中的人工复核。

Insight: 将“看到了什么”与“是否符合要求”分开，有助于呈现可审查依据并区分不确定性的来源。摘要未提供校准误差指标、数据集规模或现场部署结果；mAP不能单独证明合规判断的安全性。

Abstract: Poor illumination and occlusion obscure clothing cues in indoor work sites, while diverse clothing styles complicate workwear compliance judgments. Although vision-language models (VLMs) support localization and semantic reasoning, their predictions often lack explicit supporting evidence, and a single confidence score cannot distinguish visual uncertainty from ambiguity in compliance judgments. We propose DICL-Qwen3VL, a decoupled interpretable VLM that integrates structured workwear detection, evidence generation, and separate visual and reasoning confidence estimates. First, low-rank adaptation (LoRA) adapts Qwen3-VL to localize visible upper-body clothing and identify workwear. Second, decoupled calibration separates visual observations from compliance reasoning and assigns a confidence score to each. Token entropy and sensitivity to image perturbations provide supervision for visual confidence, linking confidence estimation to the generated observations and their dependence on image content. Finally, group relative policy optimization (GRPO) jointly optimizes detection accuracy, output validity, and confidence calibration. Experiments on the company-collected Indoor Construction Site Workwear Dataset (ICSWD) and the web-collected Indoor Construction Workwear Dataset (WICWD) yield mAP@50 values of 0.730 and 0.753, respectively, outperforming the evaluated LoRA-adapted VLM baselines, including Qwen3-VL. The framework also provides explicit evidence and separate confidence scores to support manual review in industrial safety monitoring. WICWD is publicly available at https://github.com/DaErwen1/WICWD.

[60] ANCHOR: Audio-Visually Grounded Chain-of-Thought Reasoning Benchmark cs.CVPDF

Joel Julin, Souraja Kundu, Liza Dahiya, George Z. Wei, Liuyue Xie

TL;DR: ANCHOR评测多模态模型生成的推理说明是否真正指向支持答案的音视频证据，发现答案正确率无法代表解释与证据的对齐程度。

Details

Motivation: 多模态大模型在音视频问答上表现良好，但答对问题不意味着其解释依据了相关画面区域、时间片段和声音事件。现有基准多只评最终答案，难以检查推理说明是否忠实于可感知证据。

Result: ANCHOR包含2,319段视频和8,272组问答及结构化推理轨迹、时间证据、空间框和显著音频线索；其中人工精修测试集含224段视频和975组问答。评估分别衡量答案正确性、幻觉、逻辑偏离和简洁性，并在子集直接测量时空对齐。12个当代多模态模型显示明显的答案与证据对齐差距；在100段视频、446组问答的配对集上，人类精修、Gemini和GPT生成参考的模型排名平均Pearson相关为0.99。去除视频使准确率下降38.4–41.8个百分点；去除空间框下降3.2–7.7点，去除音频下降4.2–5.6点，影响互补且因模型而异。

Insight: 仅看答案对错会漏掉模型解释与证据不符的问题，ANCHOR提供了分析音视频推理依据的测试平台。参考排名稳定性仅在配对的100段视频子集上验证；模态消融数值也限于所测模型和人工精修测试集。

Abstract: Multimodal large language models (MLLMs) perform well on audio-visual question answering, but correct answers do not necessarily imply that their stated reasoning is grounded in relevant perceptual evidence. Existing benchmarks mainly evaluate final-answer accuracy, offering limited insight into whether model-generated rationales correctly identify visual regions, temporal intervals, and audio events supporting predictions. We introduce ANCHOR, a benchmark and evaluation framework for measuring grounded-rationale alignment in multimodal reasoning, comprising 2,319 videos and 8,272 question-answer pairs with structured reasoning traces, temporal evidence, spatial bounding boxes, and salient audio cues, including a human-refined test set of 224 videos and 975 question-answer pairs. We separately measure answer correctness, hallucination, logical divergence, and conciseness, with direct spatial and temporal grounding measurements on a focused subset. Across the full benchmark, twelve contemporary MLLMs show a substantial alignment gap: models with comparable answer performance can differ markedly in whether their explanations are supported by annotated evidence. On a matched subset of 100 videos and 446 question-answer pairs, rankings remain highly stable across human-refined, Gemini-generated, and GPT-generated references (mean Pearson r=0.99), providing evidence against model-reference circularity within this subset. Grounding-cue ablations of three MLLMs on the full human-refined test set reveal a consistent modality hierarchy: removing video reduces accuracy by 38.4-41.8 points, while removing bounding boxes (3.2-7.7 points) and audio (4.2-5.6 points) causes smaller, complementary, model-dependent drops. These findings show answer-only evaluation obscures important grounding failures and position ANCHOR as a testbed for evaluating accurate and evidence-aligned audio-visual reasoning.

[61] Query-adaptive Recurrent Tokenization cs.CVPDF

Bavesh Balaji, Pranav Gopinath, Pouya Sadeghi, Sirisha Rambhatla

TL;DR: QART根据文本查询逐步生成查询相关的视觉表示，并按所需信息量自适应分配视觉token；在多个视觉问答和检索基准上以约29个token取得较强表现。

Details

Motivation: 图像中值得提取的信息及其需要的token预算取决于具体问题，但多数视觉模型独立于查询编码图像，并为所有输入分配固定视觉token预算，可能浪费计算或遗漏相关证据。

Result: 查询自适应循环分词器QART可用于不同视觉骨干，从冻结编码器特征出发反复构造紧凑表示，并根据查询相关区域的重建质量决定是否继续增加token，直到相关信息保真度足够。在Visual7W和VQAv2上，使用约29个视觉token时准确率分别达到81.96%和76.37%，token数比密集视觉语言模型输入减少20–25倍。在CORE上P@1为92.0%，在PODS上PR-AUC为36.3%，并比SteerViT高8.4%。

Insight: 视觉表示的内容和容量都可针对问题调整，有助于控制视觉token成本并保留任务相关信息。摘要没有给出不同问题难度下的token分布、端到端延迟或所有基线数值，效果范围以所测基准为准。

Abstract: Visual information worth extracting from an image and the token budget it warrants depend on the text query. Yet modern vision and vision-language models largely encode images independently of the query and allocate a fixed visual token budget to every input. We introduce the Query-Adaptive Recurrent Tokenizer (QART), a backbone-agnostic module that makes visual representations both query-steerable and budget-adaptive. QART steers the visual representation toward query-relevant evidence while adapting its token budget to the amount of information required. Its key principle is simple. Additional tokens are allocated until the visual features relevant to the query are represented with sufficient fidelity. Starting from frozen encoder features, QART recurrently constructs a compact representation and uses reconstruction quality over the query-relevant visual support to control token allocation. On Visual7W and VQAv2, QART achieves 81.96% and 76.37% accuracy using only about 29 visual tokens, reducing token counts by 20-25x relative to dense VLM inputs. It further reaches 92.0% P@1 on CORE and 36.3% PR-AUC on PODS, outperforming SteerViT on PODS by 8.4%. Together, these results show that visual representations need not be fixed in either content or capacity and can instead adapt to what each query requires.

[62] Sink-Sparse Hybrid Attention for Efficient Inference in T2I/T2V Diffusion Transformers cs.CVPDF

Bingxin Xing, Yu Zhang, Jiatong Ding, Lei Lu, Ping Wang

TL;DR: Sink-Sparse Hybrid Attention利用离线校准得到的静态高注意力支撑并补充池化KV分支，无需训练或改变采样流程即可加速文生图和文生视频扩散Transformer。

Details

Motivation: 扩散Transformer在长token序列上反复执行稠密自注意力，随着视频或图像序列增长，推理开销成为瓶颈。预训练模型内部可能存在可跨生成复用的高权重注意力结构。

Result: 该方法用少量离线校准数据找出各层和注意力头的静态sink掩码，并以轻量池化KV分支补足信息，替代部分稠密注意力；不改模型权重和采样计划。在Wan2.1-T2V-1.3B上端到端加速1.54倍并维持生成质量；在Z-Image-Turbo上加速1.57倍，GenEval2表现有竞争力。

Insight: 无需训练的稀疏支撑复用为扩散生成加速提供了简洁路径，覆盖文生视频和文生图两种场景。摘要未说明校准集大小、硬件、质量变化细节及不同分辨率下的速度，因此加速效果应限定于报告配置。

Abstract: Diffusion Transformers (DiTs) have become a common backbone for high-quality text-to-image and text-to-video generation, but repeated dense self-attention remains a major inference bottleneck as token sequences grow and the same operator is invoked across many denoising steps. Our study suggests that dense attention in pretrained DiTs contains reusable layer/head-specific high-mass structure that can be identified from a small offline calibration set and reused across future generations. This leads to Sink-Sparse Hybrid Attention, a train-free attention replacement that reuses static sink masks and supplements them with a lightweight pooled-KV branch, while leaving model weights and sampling schedules unchanged. On Wan2.1-T2V-1.3B, the method attains 1.54$\times$ end-to-end speedup while maintaining generation quality. On Z-Image-Turbo, it attains 1.57$\times$ end-to-end speedup with competitive GenEval2 performance. These results indicate that reusable importance-aware sparse support can provide an effective train-free acceleration path for both T2V and T2I DiTs.

[63] How Murky Before a VLM Knows It Cannot See? Accuracy, Confidence and Abstention on a Physical Visibility Axis cs.CV | cs.LGPDF

Mochamad Rizal Fauzan, Irgi Surya

TL;DR: 该研究以物理可见距离测量雾和水下图像退化，发现多个小型视觉语言模型准确率已降至随机水平时，内部和口头置信度仍可能很高。

Details

Motivation: 鲁棒性研究常用没有物理单位的“等级1–5”表示图像退化，且较少检验模型置信度是否随可见性下降而合理变化。实际场景需要知道模型何时看不清，以及能否可靠选择弃答。

Result: 作者使用Koschmieder模型模拟雾、按纯水吸收谱模拟水下衰减，并基于单目度量深度图，在1,000张COCO场景及五个2–5B参数开源模型上，将可见距离从250米扫到1.95米。框选物体识别准确率在狭窄范围内从接近干净图像水平降至随机水平：雾下半程可见距离为12.1–15.9米，水下为20.5–38.6米。对四个干净图像时较自信的模型，雾下可见距离1.95米时准确率已接近随机，但内部置信度仍为0.68–0.84、口头置信度为0.61–1.00，盲区宽度至少0.79个数量级，即约6.2倍可见距离。明确说明原因的弃答选项更能跟随准确率；泛化的“不知道”对一个模型仍滞后。ImageNet-C雾等级1–5对应55–110米，未进入该失效区间。

Insight: 标准合成退化等级可能远未覆盖模型真正失明的物理范围；要求模型明确说明看不清的原因也可能改善弃答行为。研究为描述性结果，基于一次1,000图像抽样、假定尺度深度及小模型，不能外推至所有真实能见度或大模型。

Abstract: Robustness studies of vision-language models (VLMs) grade degradation on nominal severity scales (“level 1-5”) that carry no physical units, and they rarely ask whether a model’s confidence follows the loss of visibility. We measure accuracy, internal (token-probability) confidence, verbalized confidence and an explicit abstain option on a visibility axis in metres: fog follows the Koschmieder model, an underwater arm scales the absorption spectrum of pure water, both are applied with a monocular metric depth map, and the visibility range V is swept over eight log-spaced levels from 250 m to 1.95 m. On 1000 COCO scenes and five small open VLMs (2-5 B parameters), accuracy on a boxed-object identification task falls from near its clean value to chance within a narrow band (half-way visibility V_acc of 12.1-15.9 m in fog and 20.5-38.6 m under water) while, for the four models that are confident on clean images, the confidence stays high: at V=1.95 m in fog their accuracy is at chance but their mean internal confidence is 0.68-0.84 and their verbalized confidence 0.61-1.00, a blind-spot width W=log10(V_acc/V_aware) of at least 0.79 decades, i.e. a factor of 6.2 in visibility. The remaining model is under-confident throughout and its internal confidence follows accuracy. An explicit abstain option follows accuracy when it names the reason (W from -0.21 to -0.06 in fog) but, for one model, lags with a generic “I don’t know” (W up to 0.18). ImageNet-C fog severities 1-5 correspond to only 55-110 m of physical visibility, outside the failure band, and leave the accuracy of the models within 5 percentage points of its clean value. Blank-image and shuffled-image controls, a prior-matched answer set and a 200-image pilot that preceded the study are reported. Findings are descriptive: one draw of 1000 images, depth of assumed scale, and models of 2-5 B parameters.

[64] UniField++: A Unified Agentic Framework with Loop Reasoning for MRI Field-Strength Enhancement cs.CVPDF

Yiyang Lin, Chenhui Wang, Tianliang Yao, Shuaibo Li, Zijun Sun

TL;DR: UniField++通过风险区域规划智能体引导MRI增强模型反复细化易产生解剖幻觉的区域，在多种磁场强度转换任务上提升图像质量和下游分割表现。

Details

Motivation: MRI场强增强希望兼顾低场设备的可及性和高场图像质量，但现有方法容易产生解剖结构幻觉，统一处理也可能未充分检查困难脑区；成对训练数据稀缺，还限制了模型学习不同场强下组织对比和结构可见性的变化。

Result: UniField++由视觉语言模型规划器和基于流匹配的增强器组成，统一学习64mT到3T、3T到7T等场强转换。规划器利用放射科医生对易幻觉区域及修正计划的标注，预测区域风险并给出定向恢复策略；增强器按计划沿流匹配轨迹循环推理，对高风险区域追加细化。在评测任务中，相比方法平均PSNR提高2.74 dB、SSIM提高14.05个百分点；相比消融基线分别提高3.97 dB和13.92个百分点。对场强未见的外部队列也维持增强质量，且相较原始低场图像，下游全脑分割Macro Dice平均提高0.1457。

Insight: 跨场强联合学习与风险区域反复细化可降低难点区域处理不足，并显示对外部未见场强有一定迁移。摘要未给出各转换的分项结果、幻觉率和临床医生盲评，PSNR/SSIM及分割提升不能单独确证解剖真实性。

Abstract: MRI field-strength enhancement seeks to combine the accessibility of low-field scanners with the image quality of high-field scanners. Yet, existing methods remain prone to anatomical hallucinations, as uniform processing leaves difficult brain regions insufficiently examined and scarce paired data limit their learning of how tissue contrast and anatomical visibility change across field strengths. To address these challenges, we propose UniField++, a two-agent framework that unifies enhancement tasks across multiple field-strength transitions, including 64mT-to-3T and 3T-to-7T. Unified learning allows both the VLM-based planner and the flow-matching-based enhancer to draw on field-dependent image characteristics observed across tasks, rather than relying on a single transition. Trained with radiologists’ annotations of hallucination-prone regions and corresponding correction plans, the planner predicts regional risk and formulates targeted restoration strategies. Guided by these plans, the enhancer performs loop reasoning along the flow-matching trajectory, repeatedly processing high-risk regions for additional refinement. Together, cross-transition learning and risk-guided refinement support anatomically faithful enhancement across field strengths. Across the evaluated tasks, UniField++ improves PSNR by an average of 2.74 dB and SSIM by 14.05 percentage points over comparison methods, with corresponding gains of 3.97 dB and 13.92 percentage points over the ablation baseline. It also maintains enhancement quality on an external cohort with an unseen field strength and improves downstream whole-brain segmentation Macro Dice by an average of 0.1457 over the original low-field images. Code is available at https://github.com/CUHK-AIM-Group/UniField_plusplus.

[65] A100: A Hybrid Vision Foundation Model for Agricultural Plant Image Analysis cs.CVPDF

Mayur Pratim Das, Ajai Dubey, Aksshay Mathew P, Sana Afreen, Rishi Kumar Soni

TL;DR: A100是基于300万张未标注农业图像自监督预训练的混合CNN-Transformer视觉基础模型，在作物分类、病害识别和植物表型任务上取得较高表现并展现少样本效率。

Details

Motivation: 农业作物监测、病害诊断和表型分析受限于高质量专家标注数据不足，发展中国家尤其如此；因此需要能够从大量无标签田间图像学习并适应有限标注的通用视觉表示。

Result: A100采用MBConv局部特征提取与Transformer全局上下文相结合的骨干，在来自100多种作物的300万张田间无标签图像上预训练，结合DINO自蒸馏、iBOT掩码块重建和KoLeo均匀性正则。冻结骨干时，作物分类准确率为95.37%，比ImageNet-12K监督表征高2.56%；GroMo25叶片计数误差降低10.4%。全量微调后，32类作物识别准确率99.90%，44类病害识别为99.02%；在PlantDoc上准确率64.89%，高于CvT-13的63.56%。仅用1%标注（每类约284张）时，作物分类准确率达98.01%，并比FoMo4Wheat及LeafVision高14个百分点以上。

Insight: 大规模农业领域自监督预训练可同时支持分类和回归，并在低标注比例下保持较好表现。摘要称模型计划公开发布，未说明当前权重是否已可用；不同数据集和标注协议的结果不能直接代表野外部署表现。

Abstract: The use of accurate vision models for crop monitoring, disease diagnosis, and plant phenotyping in agriculture is hindered by the lack of expertly annotated data, especially in developing countries. We propose A100, an agricultural vision foundation model that is pre-trained using self-supervised learning on 3 million unlabeled images from fields covering more than 100 crop species. A100 uses a hybrid CNN-Transformer backbone that fuses MBConv stages for local feature extraction with Transformer stages for global contextual representation. A100 uses pre-training with the integration of DINO self-distillation, iBOT masked patch reconstruction, and KoLeo uniformity regularization, resulting in features that are better than ImageNet-12K supervised representations for agricultural applications without any fine-tuning. By utilizing a frozen backbone, the accuracy for crop classification of A100 is 95.37%, which is +2.56% better than ImageNet-12K, and reduces the leaf count error by 10.4% on the GroMo25 phenotyping benchmark, proving that the same backbone can be used for classification and regression tasks. After full fine-tuning, the performance of A100 is 99.90% on 32-class crop identification and 99.02% on 44-class disease detection. On the difficult PlantDoc dataset, A100 outperforms all baselines, such as CvT-13 (64.89% against 63.56%). Remarkably, A100 obtains 98.01% accuracy on plant classification using just 1% of the labelled data (about 284 images per category), showing great label efficiency for use cases with limited labeling. Under an identical protocol, A100 also outperforms the publicly released agricultural foundation models FoMo4Wheat and LeafVision by more than 14 points at 1% labels. We plan to publicly release our pretrained model to allow agricultural professionals to adapt A100 for various plant analysis applications using limited annotations.

[66] Semantic-Critical Regions for Video-to-Audio Generation cs.CV | cs.MM | cs.SD | eess.ASPDF

Yun Fang, Wei Guo, Zhuonan Liang, Heng Wang, Weidong Cai

TL;DR: SCR-V2A显式定位视频中的声音语义关键区域，并将全局画面与局部声源线索共同用于视频生成音频，以改善声音质量和分布匹配。

Details

Motivation: 真实视频中的声音常对应细粒度且局部的视觉线索，如物体运动、部件动态、接触和交互。依赖全局视觉表示或较粗的时空控制，可能遗漏这些细微声音相关事件，限制音频语义和时间动态的对齐。

Result: 作者提出语义关键区域SCR概念和SCR-V2A框架。方法先执行与声音相关的视觉区域定位，再用基于适配器的双视觉编码将局部区域转成控制表示，同时保留全局视觉上下文和细粒度声源证据，最后条件化下游音频生成模型。在域内和域外基准上，SCR-V2A在分布匹配及音频质量方面表现较强，在跨模态对齐方面保持竞争力，且可训练参数较少。

Insight: 针对声源区域而非只编码整幅画面，有助于把声音生成条件聚焦在细节线索上。摘要未提供基准名称、具体分数、相对提升及生成时延，结论仅限于作者报告的综合实验表现。

Abstract: In real-world videos, sound events are often associated with localized and fine-grained visual cues, such as object motion, object-part dynamics, contact events, and interactions between objects. Existing video-to-audio (V2A) methods employ implicit conditioning based on global visual representations or explicit control derived from temporal and spatial cues. However, subtle sound-producing and sound-indicative interactions remain insufficiently captured, leaving room for more precise visual conditioning of sound-event semantics and temporal dynamics. Motivated by this observation, we refer to regions containing such sound-relevant visual evidence as Semantic-Critical Regions (SCRs) and introduce SCR-V2A, a V2A generation framework that explicitly localizes and encodes SCRs as fine-grained visual guidance for audio generation. Specifically, we first identify SCRs through sound-related visual localization. We then transform the localized regions into a control representation through adapter-based dual visual encoding, which jointly captures global visual context and fine-grained sound-relevant evidence. The representation is used to condition a downstream audio generation model. Experiments on both in-domain and out-of-domain benchmarks demonstrate that SCR-V2A achieves strong performance in distribution matching and audio quality while remaining competitive in cross-modal alignment and requiring few trainable parameters. These results highlight the value of prioritizing fine-grained, sound-relevant visual regions for V2A generation.

[67] Scene-Designer: Learning Design Intelligence for Agentic 3D Scene Generation cs.CVPDF

Xuanyu Liu, Hongyan Feng, Miao Pan, Sunlai Chen, Lizhou Liang

TL;DR: Scene-Designer利用场景设计与批评两类互补经验训练智能体生成三维室内场景，并通过批评者引导减少试错、改善物理合理性和布局质量。

Details

Motivation: 仅凭自然语言生成完整且可用的三维室内场景需要设计模型理解物理约束、功能需求和布局连贯性，同时能评价并修正结果。通用模型可能缺乏领域设计经验，静态场景数据也难教会模型如何迭代纠错。

Result: 作者构建Scene-OTA-35K，提供观察-思考-行动监督以学习设计与高效纠错；另构建Scene-OTC-15K，通过观察-思考-批评监督学习对物理有效性、功能正确性和布局一致性的评判。Scene-GRPO使用批评者指导策略优化设计决策并减少不必要的试错修正。实验中Scene-Designer在物理有效性、功能正确性和布局连贯性上优于基线；学习得到的Scene-Critic也明显超过通用模型进行场景评价。测试时加入批评者指导还能进一步改善生成，分析呈现设计和批评能力互相促进的趋势。

Insight: 训练智能体既生成又批评场景，可将质量评价信号直接用于迭代生成，测试时批评指导也可提供额外收益。摘要未给出具体指标、基线清单和三维资产可编辑性评估，结论仍以作者所测场景任务为限。

Abstract: Generating complete, coherent, and usable 3D indoor scenes from natural language requires strong \textbf{design intelligence}: the ability to design high-quality scenes and critique their quality. However, existing approaches either rely on general-purpose models lacking domain-specific design experience or learn from static scenes. In this work, we introduce \textbf{Scene-Designer}, an agentic framework that learns design intelligence through complementary design and critique experiences. We construct two datasets: \textbf{Scene-OTA-35K}, which provides Observation–Thought–Action supervision for learning scene design and efficient error correction, and \textbf{Scene-OTC-15K}, which provides Observation–Thought–Critic supervision for learning scene quality critique across physical validity, functional correctness, and layout coherence. Based on these experiences, we propose \textbf{Scene-GRPO}, a Critic-guided GRPO framework that improves design decisions and reduces unnecessary trial-and-error corrections. Extensive experiments demonstrate that Scene-Designer achieves superior performance in physical validity, functional correctness, and layout coherence, while the learned Scene-Critic significantly outperforms general-purpose models in scene critique. Moreover, test-time Critic guidance further improves scene generation, showing that the Critic can provide useful guidance beyond training. Additional analysis suggests a trend of mutual enhancement between scene design and critique abilities.

[68] Reliability-Consistent Appearance Modeling for RGB-Infrared Multi-Object Tracking cs.CVPDF

Bingyang Wang, Jiazuo Yu, Lu Zhang, Lihe Zhang, Huchuan Lu

TL;DR: RCA-MOT将RGB、红外及融合身份表示作为独立可控状态，并用免训练的场景可靠性估计调节匹配和记忆更新，在两个多目标跟踪基准上刷新指标。

Details

Motivation: 多数RGB-红外跟踪器将两种模态压缩成统一描述；当某一传感器暂时退化时，系统难以单独降低其贡献，不可靠外观证据可能误导目标关联并污染历史外观记忆。

Result: RCA-MOT保留RGB特定、红外特定及融合身份表示作为可同时访问的外观状态。对每个检测结果，免训练的目标场景估计器分别估计各分支可靠性，并将其用于身份分支相对权重、ReID接受边界附近候选的绝对置信校准，以及控制匹配描述符写入历史记忆的强度。作者有意采用简洁模块，聚焦可靠性可控的表示组织。在VT-MOT与UniRTL上取得新最佳结果；相较此前最佳，HOTA分别提升5.402和6.075点，IDF1分别提升11.549和12.789点。后验分析也支持可靠性作为控制信号的价值。

Insight: 保留分支级证据控制能力能让跟踪器在单一模态暂时不可靠时调整依赖来源。摘要没有给出各场景、失效类型和基线绝对分数；代码计划在接收后发布，当前复现信息有限。

Abstract: Recent RGB-infrared multi-object tracking (MOT) methods have substantially improved cross-modal representation learning and multimodal information integration. However, most existing methods compress RGB and infrared evidence into a unified descriptor. When one modality is temporarily degraded, the tracker can no longer regulate its contribution separately; unreliable evidence may distort association and contaminate appearance memory. We therefore propose RCA-MOT, a reliability-consistent appearance modeling framework that preserves cross-modal complementarity while retaining post-representation evidence controllability. RGB-specific, infrared-specific, and fused identity representations are maintained as jointly accessible appearance states. For each detection, a simple training-free target-scene estimator produces branch-wise appearance reliability used across the two temporal roles of appearance: relative reliability regulates different identity branches, absolute reliability calibrates borderline candidates near the ReID acceptance boundary, and the same branch-wise reliability controls how strongly matched descriptors update historical appearance memory. The individual components are intentionally simple, focusing evaluation on reliability-controllable appearance organization rather than elaborate fusion or learned reliability-estimation modules. RCA-MOT sets new SOTA results on VT-MOT and UniRTL, improving the previous best HOTA by 5.402/6.075 points and IDF1 by 11.549/12.789 points, respectively, while post-hoc analyses further validate reliability as an informative control signal. Code will be released upon acceptance.

[69] From GAN-Based Models to GPT-5: A Taxonomy-Guided Study of Human Performance in Detecting Deepfake Face Images cs.CV | cs.CR | cs.HCPDF

Zhiqing Guo, Lixin Jia, Luning Sun, Xiaowei Chen, Guofeng Yu

TL;DR: 该研究用跨模型伪造痕迹分类法训练公众识别深度伪造人脸，发现识别准确率因生成模型而异，针对具体模型的训练通常数值收益更大。

Details

Motivation: 深度伪造从GAN发展到扩散模型和多模态大模型，但公众对不同生成器所产伪造人脸的识别能力及培训效果尚未充分跟上。需要了解通用培训和针对特定模型培训哪种更有效，也要考察效果能否维持。

Result: 作者提出人类可识别的深伪人脸伪影分类法DFAT，据此构建通用和模型专用培训材料。在线实验招募524人，测试三种GAN、一种扩散模型和GPT-5生成图像。识别准确率明显依赖生成模型，较新、更先进的模型并非必然更难识别；训练后多数条件下准确率显著提升，且提升幅度随模型而异，模型专用训练通常有更大的数值增益。五个月后对342人的复测未发现准确率显著下降，也未发现感知压力显著增加。

Insight: 跨生成模型的伪影分类可支持有针对性的识别培训，结果提示模型专用例子可能比纯通用材料带来更大收益。长期稳定性仅在五个月随访样本及该培训方案下观测；摘要未报告准确率具体数值及参与者构成细节。

Abstract: Generative models for deepfakes have rapidly evolved from GAN-based architectures to diffusion models and multimodal large language models (MLLMs). However, empirical research on human performance in detecting deepfake face images has not kept pace. It remains unclear if (and how) detection performance varies across generative models and whether model-specific training improves detection more effectively than general-purpose training. In this paper, we propose the \emph{Deepfake Face Artifact Taxonomy} (DFAT), a cross-model taxonomy of human-recognizable visual artifacts in deepfake face images, based on which we build both general-purpose and model-specific training materials. Through an online experiment ($n = 524$), we examined human performance in detecting deepfake face images and evaluated training efficacy across five representative generative models: three GAN-based, one diffusion-based, and one MLLM (GPT-5). Our results show that participants’ detection accuracy was strongly model-dependent and that images generated by more recent and advanced models were not necessarily harder to detect. After training, participants achieved significant performance gains across most conditions, and their improvement varied by model. Notably, model-specific training generally yielded greater numerical gains than general-purpose training. In a five-month follow-up test ($n = 342$), we observed no significant decline in detection accuracy and no significant increase in perceived stress. Overall, our findings provide actionable insights for designing effective, sustainable, and targeted training programs to counter the growing threat posed by deepfakes.

[70] Knowledge-Guided Distributional Prompt Learning with Visual Hierarchy for Zero-Shot Anomaly Detection cs.CVPDF

Jiyul Ham, Seongho Yoon, Yonggon Jung, Sangjae Lee, Jun-Geol Baek

TL;DR: HiDist通过相对于正常分布建模异常提示，并分别优化全局检测和局部定位，在七个工业与医学异常检测数据集上取得较强跨数据集表现。

Details

Motivation: 零样本异常检测需在未见类别中识别异常。已有视觉语言方法可对齐文字与图像，分布式提示也能刻画提示变化，但缺少以正常性为参照的异常分布建模和层级化提示专门化，限制了图像级检测及像素级定位。

Result: HiDist让每个提示token服从对角高斯分布，通过蒙特卡洛采样生成随机提示变化。异常提示分布不独立学习，而是表示为相对已学习正常参考的偏移，显式编码两者依赖；随后分别形成全局与局部表示，用于图像级异常检测和像素级定位，并以适配后的全局视觉表示引导层级对齐。在七个工业和医学数据集上的实验显示，该方法在跨数据集异常检测与定位方面表现较强；消融和表示分析也支持分布式建模与层级表示设计。

Insight: 把异常定义为偏离正常性，并将图像级与像素级线索分层建模，适合零样本类别迁移场景。摘要未列出基准名称、具体指标和提升幅度，因此不能判断对各领域或定位精度的增益大小。

Abstract: Zero-shot anomaly detection (ZSAD) aims to detect anomalies in previously unseen classes using auxiliary images, with applications such as industrial visual inspection and medical imaging. Recent vision-language-model-based approaches improve ZSAD by aligning textual and visual representations, while distributional prompting further models prompt variability for unseen categories. However, existing methods do not explicitly combine normality-referenced distributional modeling with hierarchy-specific prompt specialization, limiting their ability to model anomalous semantics relative to normality while addressing both image-level detection and fine-grained localization. We propose Hierarchical Knowledge-Guided Distributional Prompt Learning (HiDist), a normality-referenced hierarchical distributional prompt framework for ZSAD. HiDist models each prompt token with a diagonal Gaussian distribution and generates stochastic prompt variations through Monte Carlo sampling. Rather than learning normal and anomalous distributions independently, anomalous prompt distributions are parameterized as deviations from learned normal references, explicitly encoding their dependency. The resulting distributions are specialized into global and local representations for image-level detection and pixel-level localization, respectively, while an adapted global visual representation guides hierarchical alignment. Experiments on seven industrial and medical datasets demonstrate strong cross-dataset performance across anomaly detection and localization tasks. Extensive ablation and representation analyses further support the effectiveness of the proposed distributional modeling and hierarchy-specific representation learning.

[71] MLLM Frame Subset Ensembling for Audio-Visual Video QA and MLLM-based Reranking for Ad-hoc Video Search in TRECVID 2025 cs.CVPDF

Andreas Goulas, Damianos Galanopoulos, Ioannis Patras, Vasileios Mezaris

TL;DR: CERTH-ITI团队介绍TRECVID 2025视频搜索与问答参赛系统：视频搜索用多模型检索加多模态重排，视频问答用微调、帧子集集成和答案聚合。

Details

Motivation: 视频搜索需要处理查询措辞与候选片段的语义差异，视频问答则需利用有限帧和音频信息回答问题。参赛系统希望在不训练搜索模型的条件下改善检索排序，并通过推理时集成增强问答能力。

Result: 视频搜索采用两阶段流程：多个视觉语言模型编码LLM改写后的查询及候选镜头，按加权相似度初检；随后多模态LLM对前N个候选与原始查询的语义匹配重排，不需要额外模型训练。问答赛道微调音视频多模态模型并采用推理时扩展。开放式回答从不同随机帧子集的贪心采样结果中多数投票；选择题则对候选答案logit取平均。组合微调与帧子集集成后，团队在VQA开放式任务三项指标上均排名第一，在选择题任务排名第二。

Insight: 不同问答形式采用不同集成策略：开放生成用答案投票，选择题聚合候选logit；多模态重排可补充初检排序。摘要没有给出指标名称、分数、参赛队伍数量和具体模型配置，排名只能按论文报告理解。

Abstract: This paper presents the overview of the runs related to the Ad-hoc Video Search (AVS) and Video Question Answering (VQA) tracks of TRECVID 2025 on behalf of the CERTH-ITI team. For the AVS track, we introduce a two-stage framework built on foundation models. In the first stage, multiple vision-language models (VLMs) encode both the input query, augmented through LLM-generated rephrasings, and the candidate video shots, producing weighted similarity scores for initial retrieval. In the second stage, we utilize a Multimodal-LLM(MLLM)-based reranking module that evaluates the semantic alignment between each shot among the top-N highest-ranked ones and the original query, generating updated relevance scores for reordering these shots. This MLLM-driven reranking significantly improves contextual matching and produces more accurate final rankings without requiring any model training. Regarding the VQA track, we fine-tune an audio-visual MLLM model on the provided TRECVID training dataset and we implement an inference-time scaling technique to enhance the multimodal understanding capabilities of the MLLM. For the open-ended Answer Generation (AG) task, we aggregate multiple model responses per question via a majority vote. The responses are generated with greedy sampling from different random frame subsets of the video and they are ranked based on the number of votes. For the Multiple-Choice (MC) task, instead of voting, we use mean pooling on the logits assigned by the fine-tuned model to each candidate response. Through the combination of fine-tuning and frame subset ensembling we achieve the highest score across 3 metrics in the VQA AG task and the second highest in the VQA MC task.

[72] X-Splat: Unified Gaussian Splatting for Joint RGB and X-ray 3D Reconstruction cs.CV | cs.GRPDF

Wangze Xu, Chu Zhou, Mae Yamaguchi, Linrui Dai, I-Chao Shen

TL;DR: X-Splat用共享高斯几何联合重建RGB外观和X射线内部结构，减少双模态分别建模带来的几何冗余与对齐伪影。

Details

Motivation: 同时重建RGB和X射线可将物体外观与内部结构联系起来，比单一模态提供更完整信息。但现有方法常分别训练各模态模型，导致几何重复、对齐伪影和模态间耦合不足。

Result: X-Splat为所有高斯基元共享一套几何参数，仅靠近表面的基元再携带外观属性。跨模态配准利用干净的多视角立体结果和X射线几何代理完成，而不是对齐两套分别优化的高斯几何，以提高稳定性；之后用两种模态共同监督统一表示，并加入依据X射线几何的表面深度一致性损失来指导RGB重建。在InsideOut和作者构建的Flower & Insect数据集上，方法实现更稳健的跨模态对齐、更高RGB渲染质量，同时不损害X射线重建，并比维护两套独立几何更紧凑。

Insight: 共享几何表示减少跨模态重复，并让X射线结构信息参与RGB表面重建。摘要没有提供具体渲染指标、模型规模和不同物体类别的结果，所述优势限于两个评测数据集。

Abstract: Jointly reconstructing RGB and X-ray provides new insights by connecting external appearance with internal structure, enabling a more complete understanding of real-world objects than single modality. Yet existing methods train separate models per modality and suffer from redundant geometry, alignment artifacts, and loose coupling that limits cross-modal insight discovery. We propose a unified representation in which all Gaussian primitives share a single set of geometric parameters, with only surface-proximal primitives additionally carrying appearance attributes. We perform cross-modal registration through clean multi-view stereo and X-ray geometric proxies instead of aligning two sets of optimized Gaussians, improving alignment stability. We then jointly optimize the unified representation via supervision from both modalities, complemented by a surface-depth consistency loss derived from X-ray geometry to guide RGB reconstruction. Experiments on the InsideOut dataset and our Flower & Insect dataset show that our framework achieves more robust cross-modal alignment, higher RGB rendering quality without compromising X-ray reconstruction, and a more compact representation than maintaining two independent geometries.

[73] Can the Parts Fool the Test? Counterfactual Pairing Cycles for Relational OOD cs.CV | cs.LGPDF

Yibo Zhou, Yirong Xiang

TL;DR: 反事实配对循环通过固定两张图和两条文本、仅交换图文配对，构造更干净的关系分布外评测，并可用于训练和诊断视觉语言模型。

Details

Motivation: 关系型分布外错误难以干净评测：图像、文本本身都自然常见，但文本关系可能描述错图像。许多负例仍可通过文风、模板、长度、物体频率或图像统计差异识别，无需真正检查图文配对关系。

Result: 作者提出成组反事实配对循环：两张图像和两条文本在比较双方保持完全相同，只改变图文匹配组合，因此有限样本中仅依赖图像、仅依赖文本或可加性成分的捷径会精确抵消。这种对比还可构成关系型异常暴露训练损失，并诊断双线性视觉语言评分。在合成控制、GQA和COCO实验中，循环能区分粗粒度图文匹配与方向角色绑定错误，也显示几何尺寸关系仍可通过全局特征识别。在带捷径污染的COCO异常暴露压力测试中，基于近乎完美捷径验证AUROC选出的模型虽保留关系信号，但不如循环训练；CycleAcc经循环训练从0.882提升到0.927。

Insight: 若要测试模型是否理解图文配对关系，保持图像和文本组成部分不变、只改变配对，可消除多类捷径。循环训练仍不能证明模型对所有关系都具备因果理解；摘要未说明全部数据规模和不同关系类型的逐项结果。

Abstract: Relational out-of-distribution errors are easy to describe and hard to evaluate cleanly. An image may be natural, a caption may be fluent, and all mentioned objects may be common, yet the caption may describe the wrong relation in the image. Many evaluations intended to test this behavior can be solved without checking the pairing at all, because negatives differ in caption style, template, length, object frequency, or image statistics. We propose counterfactual pairing cycles, a blocked evaluation primitive that reuses the same two images and the same two captions on both sides of the comparison, changing only which image is paired with which caption. This makes image-only, text-only, and additive component shortcuts cancel exactly in finite samples. The same contrast also gives a training loss for relational outlier exposure and a diagnostic for bilinear vision-language scores. Across synthetic controls, GQA, and COCO, cycles separate coarse image-caption matching from directional role-binding failures, while also identifying geometric size relations that remain strongly visible in global features. In a shortcut-contaminated COCO outlier-exposure stress test, a model selected by a near-perfect shortcut validation AUROC retains substantial relational signal but remains below cycle training on exact cycles; cycle training improves CycleAcc from 0.882 to 0.927. The main lesson is simple: to test whether a model understands a pairing, the benchmark should keep the parts fixed, change the pairing, and ask only about coupling. The official implementation is available online.

[74] RAP: A Dataset for Paper-to-Poster Generation via Declarative Markup from Human-Crafted Exemplars cs.CVPDF

Haonan Han, Yukang Lin, Minliang Lin, Haoxian Tan, Jun-Yan He

TL;DR: RAP构建论文到学术海报生成基准，将人工海报自动反渲染为可填充HTML/CSS模板，从而能用实际渲染与原海报对比评估生成质量。

Details

Motivation: 从论文生成单页会议海报同时考验摘要压缩、视觉设计和代码实现，但现有基准规模小，通常只有布局框标注，评估依赖多模态模型或人工清单；从零布局的生成方法也无法利用既有人工作品作为检索资源或可靠监督。

Result: RAP包含2022–2026年多个机器学习会议的25,000多组经验证论文—海报配对，按三级内容分类体系标注，并提供150篇测试论文及对应人工海报。全自动反渲染流程将海报转成带样式的HTML/CSS和有类型、可填充的槽位，因此每个样本构成论文—海报—标记三元组，可渲染后与源海报直接比较。训练免调优的多智能体PosterRAG会检索示例并填充槽位，不修改布局或样式；另提供基于同一数据的监督微调加强化学习训练方案。

Insight: 把海报表示成可填充的结构化标记，使人工设计既可作检索模板，也能成为可客观渲染比较的监督信号。摘要未报告基准指标、生成质量对比结果或反渲染误差，因此目前主要说明数据和评测框架贡献。

Abstract: Making a conference poster is visual coding in miniature: an entire paper must be compressed onto a single page, which exercises summarization, visual design, and code implementation at once, using nothing beyond the paper itself. Yet benchmarks for this task in the context of visual coding remain scarce: existing resources are small and annotated only with layout boxes, so evaluation must fall back on VLM-as-judge or human checklists rather than objective render-and-compare, and the generation methods they support design layouts from scratch, leaving human-crafted posters unusable as either a retrievable design library or as verified supervision. We introduce RAP (Reconstruct A Poster), a dataset and benchmark for paper-to-poster generation as a visual coding task. RAP contains 25K+ verified paper-poster pairs from various machine learning conferences held between 2022 and 2026, annotated with a three-level content taxonomy, plus a held-out benchmark of 150 test papers each paired with its human poster. A fully automated derendering pipeline turns each poster into styled HTML/CSS of typed, refillable slots, so every sample is a paper-poster-markup triplet verifiable by rendering against the source poster. The corpus serves both inference and training: PosterRAG, a training-free multi-agent pipeline, retrieves an exemplar and refills its slots without touching layout or styling, while an SFT+RL recipe trains a dedicated model from the same triplets. An online demo is available at https://reconstruct-a-poster.github.io/.

[75] Xiaomi-Lens-0 Technical Report cs.CVPDF

Pei Fu, Yike Liu, Yue Sun, Hanmo Wang, Xiuwen Xi

TL;DR: Xiaomi-Lens-0是4B多模态模型，可从自身视觉表征预测区域掩码，并在RefCOCO系列指代理解与多个感知基准上超过Qwen3.5。

Details

Motivation: 多模态大模型擅长回答整图问题，但细粒度区域理解仍较弱，一个原因是纯文本监督没有指明答案具体由图像哪些区域支持。

Result: Xiaomi-Lens-0基于Qwen3.5构建，用轻量解码器结合视觉编码器图块特征和视觉潜变量；潜变量包含掩码token状态，使分割监督无需额外分割编码器即可传入共享骨干。每个潜变量可解码为掩码，模型可在推理中交错使用区域级潜变量，并通过带定位依据的推理轨迹监督其关注区域。在RefCOCO、RefCOCO+和RefCOCOg八个划分上，指代理解平均比Qwen3.5高5.6分，分割cIoU在比较模型中最高；所有感知基准上也超过Qwen3.5。

Insight: 将掩码能力嵌入模型自身视觉表征，可为区域推理提供显式定位依据。摘要未给出各划分绝对成绩、基准名称范围和推理成本，性能结论主要基于与Qwen3.5的报告比较。

Abstract: Multimodal large language models (MLLMs) answer questions about whole images well, yet they still struggle with fine-grained region understanding. A key reason is that text-only supervision never specifies which regions support an answer. To close this gap, we present Xiaomi-Lens-0, a 4B MLLM built on Qwen3.5 that predicts masks from its own visual representations. Specifically, a lightweight decoder combines vision-encoder patch features with visual latents, the language model’s mask-token states, so mask supervision reaches the shared backbone without an additional segmentation encoder. Because each latent decodes to a mask, the model can interleave reasoning with region-specific latents and thus think with visual latents, while grounded reasoning traces supervise the regions it visits during chain-of-thought. As a result, across all eight RefCOCO, RefCOCO+, and RefCOCOg splits, Xiaomi-Lens-0 gains 5.6 points on average over Qwen3.5 in referring comprehension and achieves the highest segmentation cIoU among compared models. Moreover, it surpasses Qwen3.5 across all perception benchmarks. Homepage: \href{https://seerray-lab.github.io/Xiaomi-Lens-0}{this https URL}

[76] LonGaussian: Tracking Foundation Priors for Long-Context Feedforward Gaussian Reconstruction cs.CVPDF

Zhoufeng Xie, Guanjun Wu, Shuai Zhang, Xinggang Wang, Wenyu Liu

TL;DR: LonGaussian以流式前馈方式从长图像序列重建紧凑、全局可渲染的高斯场景，通过跨帧点轨迹合并重复表面并过滤遮挡错误。

Details

Motivation: 前馈高斯重建可从少量图像快速预测三维场景，但扩展到长视频会遇到两类瓶颈：同时处理所有视角占用大量显存；累积逐像素预测又会重复表示同一表面，增加存储和渲染开销。

Result: LonGaussian要求相机内参已知、相机位姿未知，基于预训练流式三维重建骨干，将长上下文几何特征解码为稠密高斯。每个视频块内，多帧点轨迹关联同一表面的重复观测，并指导学习式合并器整合对应高斯；渲染深度一致性过滤进一步抑制来自其他视频块、错误遮挡当前局部重建表面的高斯。在DL3DV和RealEstate10K上，论文报告其新视角渲染质量优于所测前馈基线，同时使用显著更少的高斯。

Insight: 轨迹关联和跨块深度过滤分别针对重复几何与错误遮挡，使长视频重建更紧凑。摘要未提供位姿误差、具体渲染分数和高斯数量对比，也未说明未知内参情形，结论限于所述数据集设置。

Abstract: Reconstructing high-quality, renderable 3D scenes from long videos is essential for robotic perception and embodied intelligence. Many feed-forward Gaussian reconstruction methods rapidly predict 3D scenes from a small set of images, but extending them to longer sequences presents two bottlenecks: jointly processing all views increases GPU memory requirements, while accumulating pixel-aligned predictions redundantly represents the same surfaces and increases storage and rendering costs. We present LonGaussian, a streaming feed-forward framework that reconstructs compact, globally renderable Gaussian scenes from long image sequences with known intrinsics and unknown camera poses. Built on a pretrained streaming 3D reconstruction backbone, LonGaussian decodes long-context geometric features into dense Gaussians. Within each chunk, multi-frame point tracks link repeated observations of the same surface and guide a learned merger to consolidate the corresponding Gaussian predictions. Rendered-depth consistency filtering further suppresses Gaussians from other chunks that incorrectly occlude locally reconstructed surfaces. On DL3DV and RealEstate10K benchmarks, LonGaussian improves novel-view rendering quality while using substantially fewer Gaussians than the evaluated feed-forward baselines.

[77] I2V-DETACH: Source Grounding Detachment for Unauthorized Image-to-Video Generation cs.CVPDF

Chanhui Lee, Yeonghwan Song, Yewon Kang, Jeany Son

TL;DR: I2V-DETACH通过削弱源图像内容向图生视频潜变量的传递、强化视频内部动态，降低未经授权视频生成对原图内容的保留。

Details

Motivation: 图像条件视频生成越来越容易使用，带来未经授权操纵风险。既有图像免疫方法常通过降低视频画质或时间连贯性来阻止生成，可能损害整体输出质量。

Result: I2V-DETACH把免疫目标定义为降低对源内容的保留。方法从源图像定向状态初始化辅助视频潜变量，使其仍处在源条件生成区域内、但偏离保留源内容的轨迹；优化时一方面抑制源视频依据，减少源线索传播，另一方面加强视频内部交互，让去噪更依赖视频侧动态。在多种扩散架构上的实验中，该方法显著降低源内容保留，超过既有免疫方法，并显示较强黑盒迁移能力。

Insight: 防护目标聚焦于切断源内容条件传播，可能比整体破坏输出更有针对性。摘要未报告图像效用、误报、不同攻击者模型的具体数值和黑盒迁移范围，不能据此判断真实版权场景中的充分防护程度。

Abstract: Recent diffusion models have advanced image-conditioned video generation, but their accessibility raises risks of unauthorized manipulation. Image immunization has emerged as a promising defense for Image-to-Video (I2V) protection, yet existing methods often rely on degrading visual quality or temporal coherence. In this work, we revisit I2V immunization as reducing source-content preservation, shifting the focus from output degradation to weakening source-conditioned content propagation. To this end, we propose I2V-DETACH, an image immunization method that prevents unauthorized I2V generation through source grounding detachment. I2V models preserve source content by propagating source-image cues into video latents during denoising. Accordingly, I2V-DETACH disrupts this process in two complementary ways: it suppresses source-video grounding to reduce source cue propagation, and strengthens intra-video interactions to shift denoising toward video-side dynamics with reduced reliance on the source image. To obtain informative optimization signals, we initialize auxiliary video latents with source-oriented states that remain within the source-conditioned generation regime while deviating from source-preserving trajectories. Extensive experiments across diverse diffusion architectures show that I2V-DETACH substantially reduces source-content preservation, improves over prior immunization methods, and exhibits strong black-box transferability.

[78] Look, Reason, Draw a Region: Recursive Refinement for Spatial Context Prediction cs.CV | cs.LGPDF

Wajeeha Tahir, Anna Tegon, Lionnus Kesting, Gamze İslamoğlu, Kristóf Karacs

TL;DR: Spatial-TRM用递归权重共享推理模块根据预训练视觉语言特征预测场景中的空闲空间，在固定可训练参数量下提升RoboSpatial-Home空间上下文准确率。

Details

Motivation: 空间上下文预测需要识别物体周围哪些区域空闲，并同时满足物体关系与物理约束，大型视觉语言模型在此仍有困难。递归推理可重复细化判断，权重共享有望用较少可训练参数提升性能。

Result: Spatial-TRM冻结视觉语言特征，结合凸区域解码器和仅1,120万个可训练参数的权重绑定推理器，支持六种空间关系、三类参考坐标系及开放词汇锚点物体。在RoboSpatial-Home上，空间上下文准确率为29.51%，比参数量相同、独立训练的单步模型提高9.02个百分点，即相对提升44.0%。计入冻结编码器后总参数量为8.778亿，约为报告中RoboPoint 130亿参数的十五分之一。

Insight: 迭代细化能在小型可训练模块中改善空间区域预测，且不必训练庞大模型。摘要结果来自一个基准，准确率绝对值仍为29.51%；与RoboPoint的参数量比较不等同于同任务精度或推理速度直接比较。

Abstract: Spatial context prediction requires visual grounding and spatial reasoning to identify vacant regions relative to objects in a scene. Spatial relationships and physical constraints remain challenging for large vision-language models (VLMs). Recursive reasoning has demonstrated strong performance on discrete and abstract reasoning tasks, motivating its use for improving spatial context prediction in natural images. Weight sharing enables higher accuracy with a small trainable parameter count. We introduce Spatial-TRM, a compact recursive model with frozen vision-language features, a convex region decoder, and just 11.2M trainable parameters. This weight-tied reasoner supports six spatial relationships, three reference frames, and open-vocabulary anchor objects. On the RoboSpatial-Home benchmark, Spatial-TRM achieves 29.51% context accuracy, a gain of 9.02 percentage points (44.0% relative) over a separately trained single-step model with the same parameter count. Including the frozen encoders, the model has 877.8M total parameters, approximately $15\times$ fewer than the reported 13B size of RoboPoint. These results show that repeated refinement improves spatial context prediction from pretrained vision-language features at a fixed trainable parameter count on this benchmark.

[79] CatchUp: Depth-Aware Re-Admission of Visual Tokens for Efficient Large Vision-Language Models cs.CVPDF

Eunju Park, Uiwon Hwang

TL;DR: CatchUp在视觉token剪枝后保留未选token，并在后续层按需重新纳入，同时估计被跳过层中的表征变化，在大幅减少活跃token时保持多数基准性能。

Details

Motivation: 视觉语言模型在多层解码中反复处理大量视觉token；一次性剪掉低排名token可能永久丢失后来变重要的信息。可恢复路由虽保留token，但重新纳入时常使用跳过中间层后的陈旧表征，削弱区域定位能力。

Result: CatchUp是免训练、深度感知的重新纳入框架：各层间重新评估查询相关性，只处理选中的视觉token，将延迟token保留到后续重新纳入；恢复时利用语义和空间相关token的参考到当前层转换信号，近似补回遗漏的表征演化。在三个指代表达定位数据集和六个多模态基准上，64、128和192 token预算下均获得各组最高平均相对保留率。64 token预算下，活跃视觉token减少88.9%，六个多模态基准平均保留全模型92.17%的表现，端到端延迟降低8.0%。

Insight: 重新纳入时估计层间表征变化可避免简单恢复旧状态带来的性能损失，适合推理时压缩视觉计算。摘要未提供各基准单独结果及不同骨干的增益，活跃token减少比例与端到端延迟降低比例也不相等。

Abstract: Large Vision-Language Models (LVLMs) repeatedly process hundreds of visual tokens across decoder layers, incurring substantial computation and memory costs. Existing inference-time visual token pruning methods often irreversibly remove low-ranked tokens, although the set of visual tokens receiving high query-conditioned attention can change across decoder depth. Recoverable routing preserves skipped tokens for later reconsideration, but re-admits them with stale representations after bypassing intermediate transformations. We further find that replacing stale re-admitted states with their current-depth oracle states from a full-token reference trajectory substantially improves grounding performance. We therefore propose CatchUp, a training-free framework for depth-aware visual-token re-admission. CatchUp repeatedly re-evaluates query-conditioned visual relevance, processes only selected visual tokens through each decoder interval, and preserves deferred tokens for later re-admission. Upon re-admission, CatchUp approximates missed representation evolution using reference-to-current transition signals from semantically and spatially related visual tokens. Across three referring-expression grounding datasets and six multimodal benchmarks, CatchUp achieves the highest average relative retention in both benchmark groups at 64-, 128-, and 192-token budgets. At a 64-token budget with 88.9% fewer active visual tokens, CatchUp retains 92.17% of the full model’s performance on average across six multimodal benchmarks while reducing end-to-end latency by 8.0%. Code is available at https://github.com/pej0918/CatchUp

[80] STC-MGNet: Spatial-Temporal-Channel Attention-Enhanced Multimodal Graph Network for Pedestrian Intention Prediction cs.CVPDF

Yuanzhe Li, Meng Wang

TL;DR: STC-MGNet用空间、时间和通道三路注意力编码行人姿态，并分阶段融合视觉与自车运动信息，在三个数据集上提高行人过街意图预测准确率。

Details

Motivation: 准确预测行人是否准备过街可提升自动驾驶交互安全，但模型需要从姿态序列中识别细微时空变化，并有效结合外观线索和自车运动信息。

Result: STC-MGNet构建空间—时间—通道注意力姿态图编码器，三个并行分支分别强调关键骨骼关节、观察帧及特征通道，并通过可学习权重融合。多阶段跨模态通道调制在不同图编码阶段利用模态专属门控，根据视觉和自车运动信息自适应细化姿态表示。在JAADbeh、JAADall和PIE数据集上，准确率分别为70%、87%和88%，优于若干代表性基线；消融实验也显示视觉和自车运动信息对预测有互补贡献。

Insight: 显式建模姿态的空间与时间线索，再分阶段融合车辆运动及视觉信息，可提升过街意图判断。摘要没有报告提前预测时间、精确率/召回率及复杂驾驶场景表现，准确率不能直接说明实际碰撞预防效果。

Abstract: Accurate prediction of pedestrian crossing intentions plays a critical role in enhancing the safety of pedestrian-vehicle interactions in autonomous driving. However, effectively capturing subtle spatiotemporal patterns in pedestrian pose sequences and integrating complementary visual and ego-vehicle motion information remain challenging. This paper proposes a spatial-temporal-channel attention-enhanced multimodal graph network (STC-MGNet) for pedestrian crossing intention prediction. STC-MGNet introduces a spatial-temporal-channel (STC) attention-enhanced pose graph encoder to learn discriminative representations from pedestrian pose sequences. Three parallel attention branches selectively emphasize informative skeletal joints, observation frames, and feature channels, with their outputs integrated through learnable fusion weights. To leverage complementary visual and ego-vehicle motion information, a multi-stage cross-modal channel modulation mechanism is introduced to adaptively refine pose representations through modality-specific channel gating at successive graph encoding stages. Experimental results demonstrate that STC-MGNet achieves accuracy rates of 70%, 87%, and 88% on the JAADbeh, JAADall, and PIE datasets, respectively, outperforming several representative baseline methods. Ablation experiments further highlight the complementary contributions of visual and ego-vehicle motion information to prediction performance.

[81] FloodVLM-Pix: Language-Guided Pixel-Level Flood Understanding cs.CVPDF

Chengyang Zhang, Zhihao Wang, Zhiyu Long, Xueqian Wang, Quanming Yao

TL;DR: FloodVLM-Pix构建大规模遥感洪水图文基准，并以洪水先验和多时相像素解码器同时改善洪水描述与像素级分割。

Details

Motivation: 洪水日益频繁且破坏性增强，但现有视觉语言模型在洪水任务上表现较弱，易受注意力偏差影响，也难准确描述洪水规模；分割还容易被云和山影等干扰。

Result: 作者构建FloodVL-Pix，包含131,200个洪水图像块及443,100条描述洪水严重程度和演变的文本。FloodVLM-Pix通过洪水先验模块自动提取子区域洪水空间先验并注入模型，以减轻语言理解中的注意力偏差；多时相洪水像素解码器采用通用—特定特征融合，应对云层、山影等干扰。在该基准上的实验显示，与先进视觉语言模型和洪水分割模型相比，FloodVLM-Pix在洪水描述质量和像素级分割表现上均有提升。

Insight: 把子区域空间先验和多时相像素解码结合，可同时处理语言描述定位偏差与分割干扰。摘要没有列出指标分数、训练数据划分和不同灾害区域表现，模型与数据集计划公开发布。

Abstract: As climate change intensifies, floods are becoming more frequent and destructive, making accurate flood understanding an urgent priority. However, existing vision-language models perform poorly on flood-related tasks, suffering from attentional bias and inaccurate descriptions of flood magnitude. To bridge this gap, we construct the first large-scale remote sensing flood multi-modal benchmark that supports language-level flood understanding and pixel-level flood segmentation. The benchmark contains 131,200 flood image patches and corresponding 443,100 textual descriptions for flood severity and evolution. Based on this benchmark, we propose FloodVLM-Pix, a language-guided pixel-level flood understanding model that includes a flood prior module and a multi-temporal flood pixel decoder to achieve accurate flood understanding. The flood prior module automatically distills sub-region flood spatial priors and inputs priors into FloodVLM-Pix, solving the attentional bias problem in flood language understanding. The flood pixel decoder introduces a novel general-specific feature fusion mechanism to address performance degradation caused by interference (e.g., clouds or mountain shadows) during flood segmentation. Experiments on FloodVL-Pix demonstrate that FloodVLM-Pix improves both flood description quality and pixel-level flood segmentation performance compared with state-of-the-art VLMs and flood segmentation models. Our code and data will be released at https://github.com/Haomiaoyanmeng/FloodPix.

[82] LithoWorld: An Endpoint World Model for Lithography Process-Window Recovery cs.CVPDF

Botong Zhao, Fang Yu, Xinyuan Chen, Yue Lu

TL;DR: LithoWorld把光刻工艺窗口恢复表述为基于SEM的端点世界模型，通过代表性目标和流策略生成二维参数修正，提升测试样例落入合格区域的比例。

Details

Motivation: 光刻工艺漂移可能使制成图形超出合格工艺窗口，产生不合格的扫描电子显微镜形态。恢复工艺参数需依据当前形貌判断目标端点，但测量覆盖不完整，也不一定有精确参考坐标可对齐。

Result: LithoWorld选择内部代表性目标，同时形成合格参考外观和修正监督。因果预测分支将当前图像特征对齐至端点表征，条件流策略一次生成二维参数修正块。训练数据是173组实测SEM焦距—曝光映射，未测量网格仍作为未知保留。测试中，73组子集的200对样例上合格区域成功率为88.5%，内部区域成功率46.0%，分别比最强对比方法高2.5和6.0个百分点。消融区分目标选择、端点对齐和输出参数化的作用；定性SEM检索展示无需精确匹配参考坐标即可恢复至合格内部区域。

Insight: 方法利用有代表性的内部目标处理工艺恢复，不强制寻找坐标完全相同的参考样本。内部区域成功率为46.0%，仍有改进空间；摘要未给出工艺参数范围、设备间泛化和现场闭环验证。

Abstract: Lithography process drift can move a fabricated pattern outside its process window, producing unqualified scanning electron microscopy (SEM) morphology. We present LithoWorld, an endpoint world model for SEM-guided parameter recovery. Interior representative targets jointly determine qualified reference appearance and correction supervision. A causal predictive branch aligns currentimage features with endpoint representations, while a conditional flow policy generates a two-dimensional correction as an action chunk. The model learns from 173 groups of measured SEMs organized as focus-exposure maps, preserving unmeasured cells as unknown. On 200 test pairs from the 73-group subset, LithoWorld achieves 88.5% qualified-region success and 46.0% interior success, exceeding the strongest comparison method by 2.5 and 6.0 percentage points, respectively. Ablations separate the effects of target selection, endpoint alignment, and output parameterization. Qualitative SEM retrieval illustrates recovery to qualified interiors without requiring exact reference-coordinate matching.

[83] GeoReason: Bridging Logical Reasoning and Spatial Fidelity in Remote Sensing Segmentation cs.CVPDF

Cheng Fan, Han Wu, Tingzhang Luo, Minjing Dong, Yehui Tang

TL;DR: GeoReason通过提前引入分割token、位置感知推理链和潜在图块对齐，减轻遥感推理分割中长推理造成的空间信息衰减。

Details

Motivation: 遥感图像地理上下文杂乱、目标尺度差异极大，视觉语言模型的推理分割容易出现空间保真度下降和目标误认。自回归模型中的[SEG]分割token常在长推理链末尾才生成，依赖的初始视觉依据可能已被语言抽象和生成噪声稀释；对像素占比很小的目标，这会直接导致定位失败。

Result: GeoReason引入前瞻先验机制，将[SEG]从最终输出提前放入用户查询，使其成为贯穿推理的空间锚点；位置感知链式思维通过边界框执行由粗到细定位，并使用潜在图块到token对齐损失，将分割token与真实遥感纹理对齐。在Earthreason和RRSIS-D基准上的实验显示，GeoReason持续超过先进方法。

Insight: 尽早固定空间锚点并对齐局部图像纹理，可减少长语言推理中小目标依据衰减。摘要未提供数据集规模、各基准数值增益和小目标分项结果，因此“持续超过”尚不能量化比较。

Abstract: Multimodal Large Language Models (MLLMs) have significantly advanced instruction-driven perception through the “Embedding-as-Mask” paradigm. However, extending this capability to Remote Sensing (RS) reasoning segmentation remains exceptionally challenging under cluttered geographical contexts and extreme scale variations, often leading to Spatial Fidelity Degradation and Target Misidentification. We identify a critical yet underexplored bottleneck: the sequential alienation of the segmentation token [SEG] from its initial visual grounding within the autoregressive generation paradigm. Produced only at the end of long reasoning chains, [SEG] relies on visual evidence that has been progressively diluted by linguistic abstraction and autoregressive noise. This information decay is particularly catastrophic for RS targets with minuscule pixel footprints, where even marginal fidelity loss leads to localization failure. To address these bottlenecks, we propose GeoReason, a novel framework designed to fortify logical deduction and preserve spatial integrity. First, we introduce an Anticipatory Prior mechanism that injects the [SEG] token directly into the initial user query, shifting it from a terminal output to a primary condition. This paradigm shift transforms the token into a persistent spatial anchor, preventing information decay during long-form linguistic inference. Second, we enhance visual reasoning via a Location-aware Chain-of-Thought (CoT) that enforces coarse-to-fine localization using bounding boxes, coupled with a Latent Patch-to-Token Alignment (PTA) Loss that explicitly aligns the latent segmentation token with physical RS textures. Extensive experiments demonstrate that GeoReason consistently outperforms state-of-the-art methods on the Earthreason and RRSIS-D benchmarks. Code is available at https://github.com/Fanc0126/GeoReason.

[84] Momentum: Persistent Dynamics for Video World Models cs.CVPDF

Nedko Savov, Stefan Maria Ailuro, Danda Pani Paudel, Yilun Du, Xi Wang

TL;DR: Momentum通过参考相机组共享的动态场景记忆，让离开视野的车辆和行人仍保持状态并在重新出现时连贯，从而改善视频世界模型的动态一致性。

Details

Motivation: 视频世界模型不仅要生成当前视角，还应在内容离开镜头并重新出现时保持场景连贯。依赖历史帧、静态点云或图像缓存的方式成本较高，也难更新视野之外的动态内容，可能遗忘或错误恢复车辆和行人状态。

Result: 作者用每组八台相机同步覆盖周围场景，并将参考相机组构成图，在相邻组间传播视频生成以协调不同位置和时间的动态。Momentum分两阶段：WorldUpdate联合生成参考相机视频，形成场景动态共享记忆；WorldInteract将相机控制的视频生成锚定在该演变记忆上，使运动内容在目标视角之外仍被表示，并在再次出现时保持一致。作者构建CARLA数据流水线，同时采集参考相机组和移动目标相机视频，并评估生成世界状态及目标观察的一致性。在生成街景的未见场景中，相比静态图像条件，动态场景一致性提升126.2%，视觉保真度也提升。

Insight: 多相机共享动态记忆针对物体离开当前镜头后状态丢失问题。126.2%结果来自CARLA未见街景的特定评测；摘要没有给出绝对分数、物体轨迹精度和真实驾驶数据验证。

Abstract: Video world models must capture how a scene evolves beyond the current camera view to generate consistent observations when its content reappears. Existing approaches rely on observation history, static point clouds, or image caches constructed from past frames. These representations are often expensive and, more importantly, cannot update dynamic scene content outside the field of view: generated vehicles and pedestrians may be forgotten after leaving the field of view or reappear in physically inaccurate states. We represent an evolving scene through synchronized videos from reference-camera rigs, each comprising eight cameras that jointly cover the surrounding scene. We connect these rigs in a graph and propagate video generation between neighboring rigs to coordinate scene dynamics across locations and time. We introduce Momentum, a two-stage pipeline: WorldUpdate jointly generates reference-camera videos as a shared memory of scene dynamics, and WorldInteract grounds camera-controlled video generation in this evolving memory, allowing moving content to remain represented outside the target view and reappear consistently. To support training and evaluation, we develop a CARLA pipeline that captures synchronized videos from reference camera rigs and a moving target camera, together with an evaluation framework measuring consistency within the generated world state and the target observations.Experiments on generated street scenes show that grounding target videos in scene dynamics generated by Momentum improves dynamic scene consistency by 126.2% in unseen scenes over static image conditioning, while also improving visual fidelity. Our models and source code will be made publicly available.

[85] When Evidence Vanishes: Distilling Visual-Evidence Dependency in Medical Vision-Language Models cs.CVPDF

Qizhen Lan, Yiling Ma, Ruiqi Chen, Mengchen Fan, Xi Xiao

TL;DR: ECDD把“正确答案是否依赖相关图像证据”纳入医学视觉语言模型蒸馏目标，在保持原图答题准确率的同时增强模型对证据移除的敏感性。

Details

Motivation: 轻量医学视觉语言模型可能在没有真正利用图像的情况下答对问题，而依赖题目措辞或训练先验。普通知识蒸馏只复制教师在原图上的答案偏好，不检查这一偏好是否建立在问题所需视觉证据之上。

Result: 证据条件依赖蒸馏ECDD将训练图像与证据水平匹配的控制图像配对，蒸馏教师在两者间答案margin的下降；下界目标只惩罚证据依赖不足，同时用原图监督保持任务准确率。该框架可用于指定临床区域、手术器械或全图内容等证据。在三个医学VQA设置中，ECDD保持了与蒸馏及对齐基线相近的原图准确率，同时让答案支持度更敏感于移除相关证据。在DME主要指标下，针对目标区域而非随机区域遮挡时的正例margin响应从KD的0.786提高到2.023，原图准确率仅相差0.11个百分点。

Insight: 医学模型蒸馏应传递教师答案偏好，也要传递该偏好对视觉证据的依赖，避免学到只凭先验答题的捷径。摘要未展开DME指标定义和三个设置的全部数值，结果限于所测证据遮挡方案。

Abstract: Compact medical vision-language models (VLMs) can answer clinical questions correctly without reliably using the image, relying instead on question wording or learned priors. Standard knowledge distillation copies a teacher’s answer preference on the original image, but it leaves unchecked whether that preference is conditional on the visual evidence required by the question. We study this missing target as medical visual evidence dependency: support for the correct answer should decrease when the matched evidence is absent. We introduce Evidence-Conditioned Dependency Distillation (ECDD), which pairs each training image with a control matched to the evidence level and distills the teacher’s drop in answer margin across the pair. A lower bound objective transfers positive dependency by penalizing only shortfalls, while original-image supervision preserves task accuracy. The same formulation applies when the evidence is a queried clinical region, a surgical instrument, or whole-image visual content. Across three medical VQA settings, ECDD keeps original-image accuracy competitive with distillation and alignment baselines while making answer support more sensitive to evidence removal. Under the DME headline objective, for example, the positive-case margin response to target rather than random masking rises from 0.786 with KD to 2.023 with ECDD, while original-image accuracy differs by 0.11 points. These results suggest that medical VLM distillation should transfer both the teacher’s answer preference and its dependence on visual evidence.

[86] ReVision: Reprogramming Image Generators for Dense Visual Perception cs.CVPDF

Yitong Yang, Yinglin Wang, Xuexin Liu, Wei Chen, Zhaoyang Xu

TL;DR: ReVision根据每个图像及自然语言指令动态生成临时低秩参数更新，让冻结的图像生成器执行分割、深度和法线等稠密视觉预测。

Details

Motivation: 图像生成模型拥有丰富视觉先验，可用于稠密感知；但把多个感知任务编码到共享参数中进行联合训练，容易受异质数据混合及权重影响，并引发任务间干扰。

Result: ReVision由冻结的多模态理解模型和冻结图像生成器组成。理解模型联合编码图像及自由形式指令，可训练参数生成器再将其映射为图像和任务条件化的临时低秩更新；不同图像—指令对会产生不同更新，无需任务专属输出头、显式任务ID或保存适配器。分割、深度估计和表面法线预测通过共享RGB输出接口统一。在多种稠密预测基准上，ReVision达到与先进方法有竞争力的表现，同时支持自然语言灵活指定任务。分析显示任务间存在明显梯度冲突；生成更新也呈现有结构的任务和输入相关权重组织。

Insight: 按实例生成短暂参数更新可避免不同任务长期争用同一套静态参数，也可用自然语言统一任务接口。摘要未给出各任务分项结果、参数生成开销和生成器具体实现，竞争力结论不能等同于全面超过专用模型。

Abstract: Recent image generators exhibit rich visual priors that can support dense visual perception. However, existing approaches typically encode multiple perception tasks into a shared parameterization, making joint training sensitive to the mixture and weighting of heterogeneous data and prone to cross-task interference. To address this issue, we introduce ReVision, an instruction-conditioned parameter generation framework built on a frozen multimodal understanding model and a frozen image generator. Given an image and a free-form instruction, the understanding model jointly encodes them into a multimodal image–instruction representation, which a trainable parameter generator maps to transient low-rank updates for the generator. Each image–instruction pair induces a distinct set of transient prediction parameters, enabling instance-specific adaptation while both pretrained backbones remain unchanged. ReVision requires no task-specific heads, explicit task identifiers, or stored adapters. A shared RGB output interface unifies segmentation, depth estimation, and surface-normal prediction. Across diverse dense prediction benchmarks, ReVision achieves competitive performance with state-of-the-art methods while supporting flexible task specification through natural-language instructions. Our analysis further reveals substantial gradient disagreement across tasks, highlighting the conflict introduced when heterogeneous objectives share a single parameterization. Meanwhile, the generated updates exhibit structured task- and input-dependent organization in weight space, further validating instance-level parameter generation for multi-task perception.

[87] Execution Before Memory: Diagnosing Memory Failures in Video World Models cs.CV | cs.CLPDF

Weiyang Jin, Jiwen Yu, Sihan Xu, Yuwei Niu, Xihui Liu

TL;DR: MIST把视频世界模型记忆评测中的场景设置、执行指令变化和最终呈现结果分开，发现主要瓶颈常是模型没执行变化；M3-Agent通过递归改写指令提高执行成功率。

Details

Motivation: 常见视频世界模型记忆测试把场景是否设置、指令变化是否执行及最后一帧是否显示结果混为一个分数。若模型没执行要求的改变，隐藏状态转移便不会出现，低分不能简单归因为遗忘。

Result: MIST先让模型设置场景但隐藏所要求的变化，之后才要求展示变化，并控制此前信息泄漏，从而区分记忆与执行。评测发现模型能设置场景，却常未落实指令变化；一般记忆基准也出现同样差距。基于此，M3-Agent递归修订输入指令细节，使冻结模型更成功地执行所需变化。相较基线，MIST reveal分数提高到三倍以上；WRBench的T分数提高26.1%，MBench-T的U分数提高52.7%。

Insight: 在归咎于记忆失败前，应确认模型确实执行了预期状态变化；分离执行和保留可提供更严格诊断。M3-Agent通过澄清式指令修订提升执行，但摘要未给出各模型绝对分数、修订成本及不同任务的收益。

Abstract: A memory test for a video world model should say whether the scene was set, whether the asked change was carried out, and whether the last frame shows the result. Current tests fold these into one number, so a low score is easy to read as forgetting. When the change is not carried out, the hidden state transition cannot appear, so the test is not really a test of memory. We introduce MIST, an evaluation that separates the change from the memory it should leave behind. The model first sets the scene while the change stays hidden, and only later is asked to show it, with leakage before that point kept under control. This separation locates the bottleneck: the model sets the scene but does not carry out the instructed change. The same gap appears in general memory evaluations. On that basis we propose M3-Agent (Make the Missing Move), which recursively revises the details of the input instruction so that the model successfully carries out the requested instruction. Relative to the baseline, it more than triples the MIST reveal score. On the benchmarks, WRBench’s score T rises by 26.1% and MBench-T’s score U by 52.7%. The method meets the problem from the execution side: it shows what the frozen model can do once the move is stated, and it sets a stricter baseline.

[88] LiveSync: Iterative Self-Training for Lip-Sync Generation cs.CVPDF

Huaishao Luo, Huan Zhang, Guanbo Bao, Yinglu Liu, Youzheng Wu

TL;DR: LiveSync通过冻结模型生成口型编辑伪配对，再用筛选后的样本迭代微调同一模型，改善音频驱动唇形同步且不增加推理阶段。

Details

Motivation: 音频驱动口型同步需要让嘴和下颌局部动作匹配目标语音，同时保持人物身份、头部姿态和周边面部上下文。真实同步视频提供重建目标，却很少有身份与姿态一致、仅语音相关口型变化不同的配对；随机参考训练输入也与推理时对齐的自参考不一致。

Result: LiveSync先在精选真实视频语料上训练单个掩码式模型，并加入外部生成片段覆盖稀缺视觉条件。冻结检查点使用独立采样音频编辑真实视频帧的嘴部，掩码外像素从原帧复制；置信筛选后，将这些参考与对齐的掩码输入及原始真实帧目标配对。筛选得到的伪样本和真实训练数据混合，用当前权重继续训练同一模型，不增加推理阶段。以单次前向GAN模型实例化后，LiveSync在HDTF上达到领先同步表现，在AIGC-LipSync子集上相较基线有竞争力，且推理延迟较低。

Insight: 用推理形态相似的自参考伪配对更新训练监督，可减少训练与部署输入不匹配；同一思路理论上也可迁移到扩散模型，但文中实例是GAN。摘要未提供同步指标、延迟数值和伪配对筛选率。

Abstract: Audio-driven lip synchronization aims to match target speech through localized mouth and jaw articulation while preserving subject identity, head pose, and surrounding facial context. Naturally recorded videos provide synchronized reconstruction targets but rarely offer pairs that are matched in identity and pose yet differ primarily in speech-related articulation. Mask-based training enables reconstruction from these videos, but random-reference inputs differ from the aligned self-reference used at inference. We present LiveSync, an iterative self-training framework in which a single mask-based model generates pseudo pairs and is refined for deployment. The model is first trained on a curated real-video corpus augmented with externally generated clips covering under-represented visual conditions. A frozen checkpoint then uses independently sampled audio to generate mouth-edited references from real-video frames, copying pixels outside the edit mask from each source frame. After confidence filtering, these references are paired with aligned masked inputs and original real-frame targets. The retained pseudo pairs are mixed with real training data to refine the same model from its current weights, updating training supervision without adding inference stages. Although we instantiate the framework with a single-pass GAN-based model, the self-training strategy could in principle also be adapted to diffusion-based models. Experimental results show that LiveSync achieves leading synchronization performance on HDTF and competitive performance compared with the baselines on the AIGC-LipSync subset, while maintaining low inference latency.

[89] Enhancing RAG-based Medical VQA with Gated Multimodal Representations cs.CV | cs.CLPDF

Daniela Jimenez-Pano, Hugo Jair Escalante, Delia Irazú Hernández-Farías

TL;DR: 该医学VQA检索增强框架用门控多模态单元联合表示图像与问题，在冻结医学视觉语言模型的条件下检索临床证据。

Details

Motivation: 医学视觉语言模型可能给出事实不一致的回答，检索增强生成可引入外部临床证据。但如果检索仅由图像或文本单一模态驱动，可能遗漏问题与医学图像共同表达的查询语义。

Result: 作者提出多模态检索增强框架，通过门控多模态单元学习联合查询表示，使证据检索同时利用医学图像和临床问题信息，同时冻结底层医学视觉语言模型。在基准数据集评测中，联合查询表示持续超过参考医学视觉语言模型，并与先进方法保持竞争力。

Insight: 把问题文本与影像联合编码为检索查询，能在不更新医学大模型参数的情况下丰富检索信号。摘要没有给出数据集名称、检索指标和具体提升，也未报告临床专家验证，因此效果范围尚需正文数值支撑。

Abstract: Medical Vision-Language Models (Med-LVLMs) have shown strong performance in Medical Visual Question Answering (MVQA), yet they may still produce factually inconsistent responses. Retrieval-Augmented Generation (RAG) can mitigate this issue by incorporating external clinical evidence; however, retrieval is often guided by a single modality, potentially overlooking the joint semantics of medical images and clinical questions. We introduce a multimodal RAG framework that learns a joint query representation through a Gated Multimodal Unit, enabling evidence retrieval to leverage information from both modalities while keeping the underlying Med-LVLM frozen. We evaluate the proposed approach on benchmark datasets. Results show that the multimodal query representation consistently outperforms a reference Med-LVLM and remains competitive with state-of-the-art methods. Our findings demonstrate the potential of multimodal query representations for more effective evidence retrieval in Medical VQA.

[90] Learning to Discriminate Scene Structures Makes Self-Supervised Depth Learning Scalable cs.CVPDF

Mengtan Zhang, Yuchuan Cui, Yu Ma, Zizhan Guo, Wei Ye

TL;DR: MaSS将场景结构表征与上下文特征解耦，并以结构判别目标提升自监督单目深度模型跨域扩展能力。

Details

Motivation: 自监督单目深度估计可利用无标注数据扩展训练，但已有方法在场景多样时可能退化。作者发现模型易学习数据集特有结构偏差，而非可迁移的场景几何，导致跨域训练目标冲突。

Result: MaSS构建专门的结构表征路径，与上下文特征显式解耦，并通过场景结构判别目标学习适合深度解码的通用布局表征。作者在四个不同数据集上分别及联合训练与评估，报告MaSS明显超过既有自监督方法，并成为首个能稳定从混合域训练中获益的方法。在另外八个数据集上的零样本测试显示较强泛化，尤其在完全分布外场景中。

Insight: 把几何布局和语义上下文分开学习，可能缓和多域自监督深度训练中的结构偏差冲突。摘要未提供指标、训练数据量和具体场景类型表现，泛化结论限于作者所测额外数据集。

Abstract: Self-supervised monocular depth estimation is appealing for its potential to scale with unlabeled data, yet existing methods often degrade when trained on diverse scenes. This study finds that, under self-supervision, models tend to encode dataset-specific structural biases rather than transferable scene geometry, leading to cross-domain optimization conflicts. To address this issue, this study proposes the MaSS framework, aiming to make self-supervised depth learning scalable to diverse data. MaSS introduces a dedicated structural representation pathway explicitly decoupled from contextual features, which is guided by a novel scene-structure discrimination objective to learn generalized, layout-aware structural representations for depth decoding. Trained and evaluated on four diverse datasets, both individually and jointly, MaSS substantially outperforms prior self-supervised methods and is the first to consistently benefit from mixed-domain training. Zero-shot evaluation on eight additional datasets further demonstrates its remarkable generalizability, particularly on those entirely out-of-distribution scenes. The source code is publicly available at https://mias.group/MaSS.

[91] ADA 2025: A Multimodal Dataset for Water-Deficit Stress Detection in Sugar Beets cs.CVPDF

Piper Powell, Robert Franz, Amos Smith, Isaak Ihorst, Joachim Hertzberg

TL;DR: ADA 2025发布一套超过500GB的多模态甜菜幼苗水分亏缺胁迫数据集，包含多种成像、环境记录和植物性状真值。

Details

Motivation: 农业AI发展受合适公开数据不足制约。相较病虫害识别，水分亏缺早期检测的公开数据尤其少；已有数据常仅有RGB单模态，且植株数量、采样频率和元数据质量有限，难以支持多模态研究。

Result: ADA 2025公开超过500GB的数据，记录健康与水分亏缺条件下的幼年甜菜植株，包含热成像、高光谱、RGB和深度图像，以及相关环境信息与元数据。相对含水量（RWC）和叶片厚度作为真值来源。示例实验显示健康与胁迫植株之间存在可检测差异，支持数据集用于相关研究。

Insight: 该数据集为甜菜水分胁迫多模态检测提供了公开资源，并包含可用于验证生理差异的真值指标。摘要未报告植株数量、采集频率、划分方式或完整基线结果；示例结果只表明数据有效性，不能视为已验证某个检测模型。

Abstract: Research and development into artificial intelligence (AI) and machine learning (ML) applications in crop management are hindered by a lack of suitable public datasets. Whereas applications in disease and pest detection benefit from a comparatively higher amount of available data, applications like water-deficit stress detection often have very few if any public datasets available. Moreover, most datasets that are available are single-modality and frequently RGB-only, leaving the early detection and enhanced performance offered by other methods, and particularly by multimodal approaches, out of reach. Datasets with accurate metadata, higher numbers of plants, and smaller intervals between data points are also scarce. To address this, we publicly release ADA 2025, a >500 GB comprehensive multimodal dataset of young sugar beet plants under healthy and water-deficit conditions combining thermal, hyperspectral, RGB, and depth imagery along with relevant environmental and metadata and both relative water content (RWC) and leaf thickness as ground truth sources. Exemplary results showcase the dataset’s validity in terms of differences detectable between stressed and healthy plants.

[92] A Language-Informed Loss for Visual Generation cs.CV | cs.LGPDF

Suchir Agarwal, Keshigeyan Chandrasegaran, Ziyu Chen, Kyle Sargent, Juan Carlos Niebles

TL;DR: LILIE提出可逆且语言感知的图像编码器，并将其作为文生图训练损失，在GPIC上使JiT模型的gFD从66.84降至53.01。

Details

Motivation: 像素空间端到端生成无需学习图像tokenizer，也已获得有竞争力表现；但像素误差是否充分表达语义监督，以及语言模型相关信号能否提供更丰富的图像生成训练目标，仍值得研究。

Result: LILIE是语言感知且无损可逆的图像编码变换，训练目标是让视觉语言模型能从加噪特征恢复图像描述。编码器采用归一化流Transformer，并与视觉语言模型通过下一token预测联合训练。随后将该编码器提取为文生图训练损失。用LILIE损失训练JiT模型后，在GPIC数据集上gFD较纯像素损失基线降低14点，从66.84降至53.01。

Insight: 语言可恢复性可以为视觉生成提供像素损失之外的语义训练信号，同时可逆编码器不丢失图像信息。摘要未说明gFD定义、训练成本、其他基准效果和视觉质量权衡，数值结论限于GPIC上的JiT实验。

Abstract: End-to-end visual generation with pixel-space loss has recently achieved competitive performance without the need for learned image tokenizers. In this work, we study whether language-informed supervision can provide a richer training signal than pixel loss for visual generation. We introduce LILIE (pronounced “lily”), a Language-Informed and Lossless Image Encoder. LILIE is an invertible image transform trained such that a vision-language model can recover captions from noised features. The encoder uses a normalizing flow transformer trained jointly with a vision-language model via next token prediction. We then use the encoder to extract a simple language-informed loss for text-to-image generation. We train JiT models with LILIE loss, reducing gFD by 14 points (66.84 $\to$ 53.01) against a pixel-only baseline on the GPIC dataset. Our code, encoders, and generative models are available at https://suchiragarwal.com/lilie.

[93] Not Every Mention Is a Claim: Rethinking Object Hallucination Detection in Vision-Language Models cs.CV | cs.CLPDF

Hsin-Ling Hsu, Neeraja Kirtane, Kuan-Hao Huang

TL;DR: NAME-Bench区分描述中“提及物体”和“断言物体存在”，发现现有幻觉检测器常把非断言性提及误判为幻觉。

Details

Motivation: 视觉语言模型物体幻觉通常通过检查描述中每个对象是否出现在图像里来评估，但句子提到对象并不总是在断言它存在，例如“供人坐的长椅”。把这种非断言性提及算作幻觉会夸大模型错误率。

Result: NAME-Bench从五种视觉语言模型为COCO图像生成的描述中收集25,497个物体提及，并标记为具体且存在、明确断言但不存在的幻觉、非断言性提及三类；非断言类再分为描绘、用途、否定和不确定表达四种。所有测试检测器都会把非断言提及误报为幻觉，比例为14%–80%。将非断言提及作为负例加入训练，可在LLaVA-1.5上大幅纠正问题；对四个较新的视觉语言模型，需要多5–10倍数据才能达到类似纠正，同时检测到的真实幻觉会减少。

Insight: 幻觉评估应判定文本是否断言物体存在，而不是仅凭词语提及来判断。结果表明新模型上的误报更难用额外负例纠正，且可能牺牲真实幻觉检出；摘要未给出每个检测器的具体误报率。

Abstract: Object hallucination in vision-language models (VLMs) is usually measured by checking each object a caption names against the image. Most benchmarks and detectors alike treat every object mention as a claim that the object is present. This assumption fails when a caption names an object without asserting it, as in “a bench for people to sit on”, which mentions people without claiming that any are in the image. We call such mentions non-assertive. Treating them as hallucinations inflates the error rates attributed to models that use such language. To separate them from real hallucinations, we introduce NAME-Bench (Non-Assertive Mention Evaluation Benchmark), 25,497 object mentions from captions that five VLMs generate for COCO images. Each mention is labelled concrete (asserted and present), hallucinated (asserted and absent), or non-assertive, and non-assertive mentions are further divided into four subtypes: depictive, purpose, negation and hedged. All the hallucination detectors that we evaluate flag non-assertive mentions as hallucinations, at rates between 14% and 80%. Adding non-assertive mentions to detector training as negatives largely corrects this on LLaVA-1.5. On the four newer VLMs, a comparable correction takes five to ten times more data, and the detectors then catch fewer real hallucinations. These findings show that current detectors conflate mentioning an object with asserting it, and that this conflation is harder to undo on the four newer VLMs than on LLaVA-1.5. Hallucination evaluation should therefore separate what a caption asserts from what it merely mentions.

[94] Diversity Without Labels: Task-Agnostic Coreset Selection Across Perception and Action cs.CVPDF

Julia Hindel, Benjamin Ramtoula, Kyuhwan Yeon, Nick Heppert, Paul Newman

TL;DR: CoreDNA以视觉基础模型神经元激活分布进行无监督、任务无关的核心集选择，在多种感知和行动任务上达到或超过现有方法。

Details

Motivation: 从大型数据集合中挑选高质量训练子集很困难。现有核心集方法常需代理模型训练、大量标注或针对具体任务设计；无监督特征方法则多依赖两两图像比较或固定子集对照。

Result: CoreDNA将视觉基础模型的神经元激活汇总成单图像和全数据集分布，通过比较单图像与数据集层级分布，同时捕捉低级视觉结构及高层语义。作者发现，高质量样本集中于最后一层激活统计的尾部，并通过与依赖训练的核心集方法对照验证；随后据此设计高效筛选机制，用于选择性标注和模型训练。在图像分类、语义分割、深度估计、端到端驾驶模仿学习及移动操作任务上，CoreDNA达到或超过先进方法。

Insight: 基于激活分布的简洁表征可跨任务筛选有价值样本，覆盖感知与行动任务。摘要没有给出各任务核心集比例、运行成本和绝对成绩，也未说明尾部样本识别在不同骨干上的稳定性。

Abstract: While data collection for model training is relatively easy, curating high-quality datasets from large collections is inherently challenging. Coreset estimation methods address this problem by identifying the best data subsets to train models on. However, existing approaches often require proxy model training, extensive annotations, or task-specific tailoring. Unsupervised alternatives typically exploit geometric properties in foundation model feature spaces, but are limited to pairwise image-to-image comparisons or comparisons against a fixed subset. We introduce CoreDNA, an unsupervised, task-agnostic coreset estimation approach that pools neuron activations from vision foundation models into per-image and per-dataset distributions. By comparing each image’s distribution to the dataset-level distribution, CoreDNA can capture both low-level visual structure and high-level semantic information across layers. We find that high-quality samples concentrate in the tails of the last layer’s activation statistics, which we validate by relating them to training-based coreset methods. Building on these findings, we develop a computationally efficient selection mechanism to construct task-agnostic, high-quality coresets for selective annotation and model training. Across image classification, semantic segmentation, depth estimation, and imitation learning for end-to-end driving and mobile manipulation, CoreDNA matches or outperforms the state of the art, demonstrating unprecedented generalization across perception and action tasks. These results highlight the effectiveness of compact activation-based representations for data selection.

[95] FlexPart: Text-Controlled Semantics-Aware 3D Part Segmentation at Flexible Granularity cs.CVPDF

Yiqun Zhao, Jiachen Xu, Yihao Zhi, Yunfei Zhao, Zibo Zhao

TL;DR: FLEXPART按文字要求对三维网格进行多粒度语义部件分割，支持用户指定想要提取的部件，并在多个基准上超过已有方法。

Details

Motivation: 同一三维资产可有多种合理部件划分，语义分割应同时响应用户指定的粒度和提取目标；但多粒度训练数据不足，也缺少统一控制机制。

Result: FLEXPART使用包含部件名称、位置和形状条件的整体控制提示，并通过自动视觉语言模型流程构建多粒度分区及对应提示数据。模型在原生三维空间预测与视角无关的部件身份场，为网格面直接分配离散部件ID；训练时随机丢弃背景，迫使模型依赖语义条件而非几何先验。推理时VLM规划器可根据二维渲染自动补全描述条件，用户只需用普通词语指定目标部件。在FLEXPARTBENCH上，规划器补全提示使其mIoU比最强评测基线高15%，即使该基线得到真实标注引导；在各粒度上均领先，平均mIoU高22%。只给部件名称时，选择性分割IoU比最强点击式基线高35%。

Insight: 整体文本控制提示和规划器补全降低用户手动描述位置及形状的负担，同时统一多粒度分割。摘要未说明数据集规模、分割对象类别及指标的具体绝对值，优势限于作者基准和所比方法。

Abstract: A 3D asset admits multiple valid part decompositions, while semantics-aware segmentation should reflect both the desired granularity and the parts a user wants to extract. Ideally, a practical segmentation model should strive for a simple principle: what you ask for is what you get. However, realizing this goal is hindered by two core obstacles: the lack of multi-granularity training data and the absence of a holistic control mechanism. We propose FLEXPART, a unified framework for text-controlled 3D mesh segmentation. To establish flexible control, we introduce a holistic control prompt comprising semantic part names with location and shape clauses. To support this mechanism, we utilize an automated Vision-Language Model (VLM) pipeline to construct a large-scale dataset of multi-granularity partitions and their corresponding prompts. Driven by this data, FLEXPART generates a view-independent part-identity field in native 3D space, directly assigning discrete part IDs to mesh faces. To compel the model to respect semantic conditions rather than rely on geometric priors, we train the model using randomized background dropping. Furthermore, an inference-time VLM planner can automatically complete descriptive clauses from 2D renderings, allowing users to simply name the desired parts in ordinary words. FLEXPART with planner-completed prompts outperforms the strongest evaluated baseline by 15% in mIoU, even when that baseline receives ground-truth guidance. On our held-out FLEXPARTBENCH, FLEXPART leads at each granularity and improves average mIoU by 22% over the strongest baseline. With only the requested part names supplied by the user, it also improves IoU by 35% over the strongest click-driven baseline on selective segmentation.

[96] Agentic Physics-Grounded Video Generation via Memory-Augmented In-Context Reasoning cs.CVPDF

Xikang Guan, Shaocong Yang, Yanqi Bao, Can Wang, Zheng Gu

TL;DR: PhysRepair采用“生成—诊断—修复”流程，先定位视频中首次违反物理约束的状态，再结合历史修复经验对相关时空区域局部重生成。

Details

Motivation: 生成前加入物理模拟或改写提示可能限制动态多样性，也发现不了只在生成后出现的错误；若生成视频仍不符合物理规律，反复完整重生成成本高且可能破坏已正确内容。

Result: PhysRepair通过时空因果约束识别首个无效物理状态及其因果影响状态，形成修复说明，指导只重生成相关区域并保留未受影响内容。经验增强的上下文学习将当前修复信息与以往相关修复经验结合，使智能体能适应不同物理故障，并把完成轨迹积累为后续案例经验。在Physics-IQ Verified的固体力学、流体、光学、热力学和磁学任务上，实验显示该方法持续提高生成视频的物理合理性。

Insight: 局部因果修复旨在纠正物理矛盾，同时保留视频中其他内容；经验累积则支持跨案例适应。摘要未提供各领域量化提升、修复耗时或视觉保真变化，无法比较修复收益与生成成本。

Abstract: Physical plausibility is essential for realistic video generation. Existing methods impose physical guidance before synthesis via simulations or refined prompts, but this can limit dynamic diversity, miss errors that emerge only after generation, and require repeated regeneration when inconsistencies remain. We therefore study a generate-diagnose-repair paradigm that preserves the original generation capability and selectively repairs physical inconsistencies afterward, raising two key questions: what to repair and how to repair? To address them, we introduce PhysRepair, an agentic video generation framework that combines causal reasoning over the observed physical failure with prior repair experience to enable localized and adaptive correction. Specifically, Spatiotemporal Causal Constraints identify the first invalid physical state and its causally affected states, producing a repair specification that guides physically plausible local regeneration while preserving unaffected content. Experience-augmented In-context Learning combines the ongoing repair context with relevant experience from previous repairs, allowing the agent to adapt its repair decisions across diverse physical failures and accumulate completed trajectories for future cases. Experiments on Physics-IQ Verified across solid mechanics, fluid dynamics, optics, thermodynamics, and magnetism demonstrate that PhysRepair consistently improves the physical plausibility of generated videos over existing methods. Our project page is available at https://xxkkxxx.github.io/PhysRepair-Website/.

[97] PCDFusion: Proposal-Context-Detail Bayesian Rendering for Infrared-Visible Image Fusion cs.CVPDF

Rui Liu, Lin Gu, Hesong Li, Ying Fu

TL;DR: PCDFusion将红外—可见光融合建模为局部贝叶斯后验渲染，以可见光为锚并分阶段决定何时利用热响应或红外结构。

Details

Motivation: 可见光与热红外在物理上互补，但可靠性也各有不同。现有深度融合方法主要改善特征交互和图像重建，缺少明确局部规则来决定可见光外观何时占主导、热信号何时应补充。

Result: PCDFusion提出Proposal-Context-Detail三阶段融合框架，将融合写成局部贝叶斯后验渲染，以后验动作权重控制贡献，而不是直接混合两个模态。框架保留潜在有用的热红外响应，修复曝光退化的可见区域，并将可靠的带限红外结构渲染到最终亮度图中。多个公开红外—可见光基准实验显示，该方法改善融合质量、目标恢复以及困难照明下的下游检测和分割表现。

Insight: 局部后验权重显式控制两类传感器贡献，有助于应对模态可靠性随区域变化的情况。摘要未报告指标数值、具体基准和融合质量与下游任务间的折中，结论仅为作者总体实验报告。

Abstract: Infrared-visible image fusion (IVIF) aims to combine visible and thermal infrared observations for human perception and downstream vision tasks. Visible and thermal infrared observations are physically complementary but unreliable in different ways. Existing deep IVIF methods mainly improve feature interaction and reconstruction, but often lack an explicit local rule for deciding when visible appearance should dominate and when thermal responses should contribute. To address this issue, we reformulate IVIF as local Bayesian posterior rendering, where fusion is controlled by posterior action weights rather than direct modality mixing. In this paper, we propose Proposal-Context-Detail Fusion (PCDFusion), a visible-anchored framework that implements this formulation through three rendering stages. PCDFusion preserves potentially useful thermal responses, updates exposure-degraded visible regions, and renders reliable band-limited infrared structures into the final luminance. Extensive experiments on public IVIF benchmarks show that PCDFusion improves fusion quality, target recovery, and downstream detection and segmentation performance under challenging illumination. The code is available at https://github.com/BIT-RuiLiu/PCDFusion.git.

[98] FedRAPP: Federated Test-Time Prompt Tuning for Vision-Language Models with Reliability-Aware Prompt Personalization cs.CVPDF

Syed Md. Ahnaf Hasan, Md Akil Raihan Iftee, Sajib Mistry, Amin Ahsan Ali, AKM Mahbubur Rahman

TL;DR: FedRAPP为无源数据的联邦测试时提示调优提供可靠性驱动的个性化聚合，以选择性融合分布兼容客户端信息并保留本地适应。

Details

Motivation: 现有联邦提示学习主要面向有标签客户端训练数据且训练分布较稳定；测试时各客户端面对无标签、非独立同分布的目标流时，本地提示可能向不同方向漂移，简单服务器聚合效果不佳。

Result: 研究定义无源联邦测试时提示调优：客户端不访问源数据，在无标签测试流上协同调整轻量软提示。FedRAPP结合客户端可靠性评估、服务器端指数移动平均提示记忆和相似度引导的同伴聚合，只纳入可靠且兼容的信息，同时保留本地专长。在九个CLIP基准数据集及ImageNet变体上的广泛实验中，异质客户端分布下FedRAPP持续超过标准联邦聚合基线，同时维持只调提示带来的效率优势。

Insight: 个性化聚合试图避免将分布差异大的客户端提示强行平均，从而在全局知识与本地适应之间折衷。摘要未报告各基准数值、通信量或客户端异质性幅度，效率与性能优势需结合完整设置解读。

Abstract: Federated prompt learning enables vision-language models like CLIP to collaboratively adapt lightweight soft prompts across distributed clients without sharing raw data. However, existing federated prompt learning methods are designed primarily for supervised settings with labeled client data and assumed relatively stable training distributions. At test time, source-free federated prompt tuning remains largely unexplored. Clients may receive unlabeled target samples with heterogeneous, often non-IID distributions that differ substantially across clients and from the source training distribution, causing locally adapted prompts to drift in different directions and reducing the effectiveness of federated aggregation. In this work, we explore Source-Free Federated Test-Time Prompt Tuning (SF-FTTPT), where distributed clients collaboratively adapt soft prompts on unlabeled test streams without access to source data. Our study reveals that conventional federated aggregation methods struggle under heterogeneous client distributions, as locally adapted prompts become increasingly specialized and difficult to combine effectively. To address this challenge, we propose FedRAPP, a personalized aggregation framework that combines reliability-aware client assessment, server-side exponential moving-average prompt memory, and similarity-guided peer aggregation. FedRAPP selectively incorporates information from reliable and compatible clients while preserving local specialization, enabling more robust adaptation under distribution shift. Extensive experiments across nine CLIP benchmark datasets and ImageNet variants demonstrate that FedRAPP consistently outperforms standard federated aggregation baselines under heterogeneous client distributions while maintaining the efficiency advantages of prompt-only adaptation.

[99] Synthetic Image Oversampling for Rare-Class Representation Learning in Deep Facial Phenotyping cs.CVPDF

Miles Liao, Zhanliang Wang, Hongzhuo Chen, Kai Wang

TL;DR: 该研究考察用合成面部图像对罕见遗传病类别过采样的效果，发现平均识别率有所改善但不同疾病的收益不均，且几何分离变化不总对应分类表现。

Details

Motivation: 深度面部表型分析可辅助识别遗传综合征，但患者图像数量少且疾病类别分布不均。合成图像可补充训练样本，但也可能引入伪影或重复已有特征，因此需要确定过采样量及哪些疾病真正受益。

Result: 作者使用Phenotypic Disease Image Database的图像扩充GestaltMatcher Database中部分类别，分别在图像模型GestaltMatcher-Arc和多模态模型GestaltMML中比较不同合成数据比例。真实训练集及患者互斥的评估划分保持不变，多次训练测量总体和疾病级准确率，并探索嵌入空间类别紧凑度与分离度。两种训练方案平均识别准确率均提高；GestaltMatcher-Arc收益较小，GestaltMML在所测过采样比例中持续提升。但部分疾病准确率下降。真实训练图像较少的疾病在嵌入分析中往往获得更多类间分离，不过几何变化并不稳定对应分类成绩。

Insight: 合成样本可帮助有限数据下的面部表型识别，但总体均值会掩盖疾病级退化，需按训练方案和疾病逐项确定过采样策略。摘要未给出具体增幅、生成模型和每类样本量，结论属于探索性评估。

Abstract: Recent deep facial phenotyping methods can support the recognition of genetic syndromes, but patient images are often scarce and unevenly distributed across disorders. Synthetic facial images offer a way to supplement the training data without collecting additional patient photographs. Their usefulness, however, depends on whether they improve recognition of real patients: generated images may introduce artifacts or repeat features already represented in the training set. It is therefore necessary to examine both how much synthetic augmentation to use and which disorders benefit. We investigate disease-specific synthetic oversampling using images from the Phenotypic Disease Image Database to augment a subset of the GestaltMatcher Database. We compare increasing augmentation levels in an image-based model, GestaltMatcher-Arc, and a multimodal model, GestaltMML, while keeping the real training and patient-disjoint evaluation partitions fixed. Repeated training runs assess overall and disease-specific accuracy, and an exploratory embedding analysis examines changes in class compactness and separation. Augmentation improves mean recognition accuracy in both training setups, although gains remain modest in GestaltMatcher-Arc and continue across the tested levels in GestaltMML. These aggregate improvements are accompanied by uneven disease-level responses, including reduced accuracy for some disorders. In the embedding analysis, disorders with fewer real training images tend to gain more class separation, but geometric changes do not consistently track classification performance. Together, the findings support synthetic oversampling for limited-data facial phenotyping and emphasize the need to assess its amount and benefit for individual disorders within each training setup.

[100] ESC: Escaping 2D Diffusion Ambiguity with Geometric Constraints for Consistent Novel View Synthesis cs.CVPDF

Ge Ya Luo, Daniel Severo, Brian Karrer, Christopher Pal, Adriana Romero-Soriano

TL;DR: ESC通过联合生成目标视图和对应深度图，并施加逐像素深度一致性约束，提升单张图像在大幅相机变化下的新视角几何一致性。

Details

Motivation: 用二维扩散模型生成三维一致的新视角仍有挑战，尤其是相机视角变化剧烈时，图像生成可能看似合理但几何错位。

Result: ESC在单目视角合成中，以源图像、源深度和目标相机射线为条件，同时生成目标视图及其深度图，促使模型在大视角变化下利用三维结构。逐像素深度一致性约束用于检验并强化生成视图间的空间一致性。作者报告该框架相较当前先进方法获得更好的视觉准确性和空间对齐。

Insight: 联合预测RGB视图与深度，使几何约束直接参与生成结果的空间一致性控制。摘要未给出数据集、指标数值、视角范围或与基线的详细对比，因此无法量化提升，也不能判断复杂场景中的泛化程度。

Abstract: Generating 3D-consistent novel views from 2D diffusion models remains a fundamental challenge in computer vision. In this work, we introduce a framework that enhances geometric alignment for monocular view synthesis under drastic camera changes by jointly generating a target view and its corresponding depth map. By conditioning the diffusion pipeline on the single source image, source depth, and target camera rays, our approach forces the model to inherently reason in 3D space even under extreme viewpoint shifts. To guarantee spatial fidelity, we propose a novel per-pixel depth consistency constraint, which verifies and enforces 3D consistency across generated views. Our framework establishes a robust pipeline for geometrically consistent view synthesis, yielding superior visual accuracy and spatial alignment compared to current state-of-the-art methods. With this work, we pave the road towards robust 3D world models capable of understanding complex environments from a single view image.

[101] A Paired RGB-Sonar Dataset for Fish Monitoring with Consumer Sonar cs.CVPDF

Mourad Derbedrosian, Michael Hobley, Pietro Perona

TL;DR: HaCKRS提供消费级成像声呐与俯视RGB视频同步配对的锦鲤数据集，配套标定和几何信息，支持声呐鱼类检测、跟踪和计数研究。

Details

Motivation: 成像声呐能在黑暗或水体浑浊、光学成像失效时观测水下环境，但用于生态监测的传统设备通常昂贵。消费级前视声呐有望降低门槛，不过其噪声图像增加标注和自动方法研发难度。

Result: Huntington and Caltech Koi RGB and Sonar数据集HaCKRS将Garmin LiveScope成像声呐记录与锦鲤俯视RGB视频配对，包含超过105,000组时间匹配帧，约3.3小时视频，涵盖四种距离和朝向配置。数据提供逐帧元数据、声呐几何与坐标信息、四种配置的同步信息，并对三种水平配置提供平面配准。发布重点是成对观察与标定，不附带任务特定鱼类标注。

Insight: 同步RGB视角可为声呐图像解释和后续标注提供参照，数据集适合研究消费级设备用于生态监测的可行性。它本身没有鱼类检测真值，摘要也未报告消费声呐与专业设备的性能比较，因此尚非即用型标注训练集。

Abstract: Imaging sonar enables underwater observation in conditions where optical imaging is ineffective due to darkness and turbid water. However, imaging-sonar systems previously used for ecological monitoring have typically been expensive, limiting their accessibility. Consumer forward-looking sonar has the potential to make fish monitoring more accessible, but its noisy imagery makes annotation and the development of automated methods challenging. We introduce the Huntington and Caltech Koi RGB and Sonar dataset (HaCKRS), which pairs Garmin LiveScope imaging-sonar recordings with top-down RGB video of koi carp. The dataset contains more than 105,000 temporally matched frame pairs, spanning approximately 3.3 hours of recordings across four range and orientation configurations. We provide frame-wise metadata, sonar geometry and coordinate information, synchronization data for all four configurations, and planar registration for the three horizontal configurations. The release focuses on paired observations and calibration rather than task-specific fish annotations. We intend HaCKRS to support annotation and the development of fish detection, tracking, and counting methods, and investigations into the potential of consumer sonar for ecological monitoring.

[102] The Collection of a Real-World, Large-Scale Dataset for Automated Skill Evaluation in Central Line Dressing Change cs.CVPDF

Ummey Tanin, Shannan K. Hamlin, Hsin-Mei Chen, Peizhu, Qian

TL;DR: 该工作发布365段注册护士中心静脉导管换药操作视频，附有17个子任务的时间标注和临床表现评估，作为自动化护理技能评价的基础数据集。

Details

Motivation: 中心静脉导管相关血流感染可预防，正确换药对感染控制很重要，但当前技能考核主要依赖临床教师人工观察，耗时、难扩展且评估一致性和细粒度有限。该方向还缺少大规模、具有临床依据的数据集。

Result: 数据集包含休斯顿卫理公会医院2026年度能力考试中注册护士的365段换药操作视频；每段配有17个操作子任务的时间标注和临床表现评估。论文描述采集及整理流程，包括录制配置试点、标注协议设计和采集后处理，并通过时空深度学习模型的基准实验初步证明视频技能评估可行。

Insight: 数据集提供程序级时间定位和临床评价，可支持技能评估、反馈生成和护理培训研究。摘要未报告参与护士人数、患者隐私处理、基准模型成绩及跨机构泛化情况，不能据此认为自动评估已可替代临床教育者。

Abstract: Central line-associated bloodstream infections (CLABSIs) remain a major source of preventable morbidity and mortality in healthcare settings. Proper execution of the central line dressing change (CLDC) procedure is essential for infection prevention, yet current approaches to competency assessment rely primarily on manual ob- servation by clinical educators, making evaluation time-intensive, difficult to scale, and limited in consistency and granularity. These challenges highlight the need for AI-assisted skill evaluation methods that can support more objective, reproducible, and scalable assessment of clinical performance. However, progress in this area has been constrained by the lack of broad-scale, clinically grounded datasets for developing and evaluating such methods. In this work, we present the collection process of a large-scale video dataset for CLDC skill evaluation, comprising 365 recordings of registered nurses collected during the 2026 annual competency exam at Houston Methodist Hospital. Each video is paired with subtask-level temporal annotations and clinical performance assessments spanning 17 subtasks of the procedure. We describe the data collection and curation pipeline, including pilot testing of record- ing configurations, annotation protocol design, and post-collection processing. We further establish the feasibility of video-based skill assessment through benchmark experiments with spatiotemporal deep learning models. This dataset provides a foundation for future research on automated clinical skill assessment, feedback generation, and AI-assisted training in nursing education.

[103] Video Diffusion Avatars: Taming Video Diffusion Models into Controllable 3D Avatars cs.CVPDF

Simon Giebenhain, Tobias Kirschstein, Liam Schoneveld, Davide Davoli, Zhe Chen

TL;DR: Video Diffusion Avatars通过微调视频扩散模型，从单张图像生成可控、多视角一致的写实人物头像，并改善新视角重演的感知质量。

Details

Motivation: 互联网视频扩散模型包含丰富的外观、运动和物理先验，难以仅靠显式3D渲染或昂贵采集复现。传统3D形变模型的表情表达能力有限，学习式表情编码则可能带有视角偏差，影响多视角一致性。

Result: Video Diffusion Avatars从单张图像创建可控头像，通过微调视频扩散模型控制相机视角、面部表情和上半身姿势；学习式表情空间可表达3DMM难以覆盖的舌头和口腔内部细节。作者在DISTRACT基准发现表情编码存在强视角偏差，并通过解耦消除，使其可用作多视角一致头像的驱动信号；相机和上身姿势则通过代理网格渲染联合控制。相机三元组训练策略仅用公开多视角数据，在单张A100上训练34小时。在BecomingLit新视角重演中，相比先进单图3D头像，面部LPIPS降低29%，JOD感知质量提高66%；静态3D高斯重建探针也显示多视角一致性最高。生成结果还呈现显式渲染器较难实现的头发动态、阴影、反射和折射。

Insight: 视频生成先验可扩展单图3D头像在外观和动态上的表现，但需要处理表情码中的视角偏差。摘要未提供完整控制精度、身份保持数值及推理延迟；34小时是特定单A100训练配置。

Abstract: Video diffusion models (VDMs) trained on internet-scale data encode a rich prior on appearance, motion, and physics that is difficult to replicate with explicit 3D rendering and costly 3D data capture. We introduce Video Diffusion Avatars (VDAs), a method that creates photo-realistic, multi-view consistent avatars from a single image by fine-tuning a VDM for precise control over camera viewpoint, facial expression, and upper-body pose. Departing from 3D morphable models (3DMMs), VDAs use a learned expression space that lifts the expressiveness ceiling of 3DMMs, e.g., for the tongue and mouth interior. However, learned expression codes exhibit heavy viewpoint bias, as our DISTRACT benchmark reveals. We show that this bias can be removed through disentanglement, enabling their use as driving signals for multi-view consistent avatars. Camera and upper-body pose are controlled jointly via proxy-mesh renderings, giving independent control over expression, pose, and viewpoint. A camera-triplet training strategy makes the approach efficient: our models train for 34 hours on a single A100 using only public multi-view data. VDAs outperform state-of-the-art single-image 3D avatars on novel-view reenactment, reducing face LPIPS by 29% and improving perceptual quality (JOD) by 66% on BecomingLit. A static 3DGS reconstruction probe further confirms that our generations are the most multi-view consistent. Built on a video prior, VDAs produce effects beyond the reach of explicit renderers, including physically plausible hair dynamics, shadows, reflections, and refractions.

[104] Persistent Planar Memory for Video World Models cs.CVPDF

Yuze He, Bin Tan, Zelin Gao, Yujun Shen, Yong-Jin Liu

TL;DR: PPMem用紧凑平面基元作为视频世界模型的持久三维记忆，每个自回归片段联合生成视频与平面几何，并在后续生成中通过渲染深度复用场景结构。

Details

Motivation: 大规模生成和探索环境的视频世界模型需要长期保存已生成内容的三维结构。像素级点云记忆冗余且成本高，而室内外场景的墙面、地面和立面等主要结构可由少量平面表示。

Result: PPMem在视频扩散Transformer中加入平面预测头和深度token融合模块，每个自回归片段同时生成RGB视频和平面几何，合并成持久平面记忆；后续片段以渲染深度为条件使用该记忆。作者报告单个场景约10万平面基元、占5MB，比逐像素点云记忆紧凑约三个数量级，同时提供度量深度、法线和可导出表面。共同骨干预测使其跨视角一致，合并过程可随生成进行细化。在DL3DV和RealEstate10K上，PPMem的视频质量超过先前三维约束世界模型，并能在数百帧及大视角变化下保持连贯，同时生成度量尺度深度、表面法线和平面几何。

Insight: 显式平面记忆将场景几何作为世界模型的持久状态，兼顾较低存储和可导出结构。摘要未给出具体视频质量指标、与点云方法同等预算的完整比较或动态物体处理结果。

Abstract: Video world models that generate and explore environments at scale need a persistent 3D memory of what they have produced. Plane primitives offer a natural candidate: a compact set of oriented planes captures the dominant structural elements (e.g., walls, floors, facades) of indoor and outdoor scenes, while requiring only 7 parameters per primitive. We present PPMem, a video world model that adopts plane primitives as its persistent 3D memory. PPMem augments a video diffusion transformer with a planar prediction head and a Depth Token Fusion (DTF) module: each autoregressive chunk jointly produces RGB video and planar geometry, which merges into a persistent plane memory that conditions subsequent chunks via rendered depth. The resulting memory is three orders of magnitude more compact than per-pixel point clouds (~100K primitives, 5MB for a full scene), geometrically explicit (metric depth, normals, exportable surfaces), cross-view consistent (jointly predicted by the shared backbone), and adaptive (refined by the merging procedure as generation proceeds). On DL3DV and RealEstate10K, PPMem outperforms prior 3D-grounded world models in video quality while jointly producing metric-scale depth, surface normals, and exportable planar geometry, sustaining coherence across hundreds of frames under large viewpoint changes. Project page: https://hyzcluster.github.io/ppmem.

Xinhao Liu, Yunsheng Tian, Yuheng Qiu, Pieter Abbeel, Xi Chen

TL;DR: StopWatch发现物体目标导航策略的主要失误可能在目标定位而非探索：模型常未发现目标已在视野中，也难估计距离；显式目标定位提升多个基准表现。

Details

Motivation: 预训练视觉语言模型带来丰富语义知识，微调为导航策略已很常见，但成功率仍低，且策略具体欠缺何种能力并不明确。

Result: 作者诊断发现，既有策略通常能进行探索，却会漏看已经出现在视野里的目标，或不能估计目标距离，说明目标落地定位是主要失败来源。显式对目标进行定位后，成功率显著提高，并在三个场景集合的六个基准上达到先进结果。研究还修正了这些基准中的标注缺陷，使后续评测更可靠。在清理后的基准上提供真实定位结果时，策略表现几乎追平生成示范的专家，表明剩余空间主要在感知而非策略学习。

Insight: 物体目标导航不仅需要探索和规划，还需要可靠地把语言目标对应到当前图像中的实例及距离。摘要未给出成功率提升值、标注错误类型或各场景分项结果，真实定位的基准结果不代表部署时感知同样准确。

Abstract: Pretrained VLMs bring rich world knowledge and semantic priors to object-goal navigation, and fine-tuning a VLM into a navigation policy has become a common recipe. Despite this progress, success rates remain low, and it is unclear which capability these fine-tuned policies lack. Our diagnosis identifies goal grounding as the dominant failure. These policies explore well, yet often fail to notice that the goal is already in view or to estimate how far away it is. To address this failure, we ground the goal explicitly. Explicit grounding substantially improves success and reaches state-of-the-art results on six benchmarks across three scene collections. We also correct annotation defects in these benchmarks, so that future methods are evaluated more faithfully. Our analysis on the clean benchmarks shows that, with ground-truth grounding, our policy nearly matches the expert that generated its demonstrations, leaving the headroom in perception rather than policy learning. Our work points to goal grounding as a missing piece of object-goal navigation and offers a simple and effective solution to the task.

[106] Rethinking the design space of Vanilla Pixel Diffusion Transformers cs.CV | cs.AIPDF

Soumik Mukhopadhyay, Long Mai, Abhinav Shrivastava, Aniruddha Mahapatra

TL;DR: MFlow为像素空间扩散Transformer学习在干净图像预测与速度预测间按数据主成分方向自适应插值，并用后处理卷积模块补偿生成图像的高频细节。

Details

Motivation: 像素空间扩散可避免潜空间压缩损失和单独训练自编码器；近期研究显示普通扩散Transformer可直接预测干净图像，但预测参数化是否应固定尚未充分研究。

Result: MFlow在数据主成分方向间学习干净图像x0预测与速度u预测的端到端插值。作者发现偏好的参数化随数据表示和模型容量系统性变化，模型容量增大时更偏向速度预测。在ImageNet、UCF-101视频和大规模文生图任务上，MFlow实现有竞争力或更好的生成表现。研究还发现，无论参数化如何，普通像素扩散Transformer相对真实图像仍缺少高频成分；为此提出ConvRefiner，在冻结扩散骨干的条件下用对抗损失进行少量后训练，可恢复生成图像的高频统计，同时保持FID。

Insight: 最优扩散参数化可能依赖数据结构与模型规模，不能简单固定一种目标；高频缺失则可用轻量后处理模块补偿。摘要未提供各任务具体分数、模型规模和ConvRefiner对其他感知指标的影响。

Abstract: Pixel-space diffusion models have recently re-emerged as a compelling alternative to latent diffusion, avoiding the lossy latent bottleneck and separately trained autoencoder. JiT shows that a vanilla diffusion transformer can generate directly in pixel space by replacing the commonly used velocity prediction ($\boldsymbol{u}$-prediction) with clean image prediction ($\boldsymbol{x_0}$-prediction). In this work, we revisit this choice and introduce MFlow, an adaptive parameterization that learns to interpolate between $\boldsymbol{x_0}$- and $\boldsymbol{u}$-prediction across principal directions of the data, learned end-to-end with diffusion training. We find that the preferred parameterization varies systematically with the data representation and model capacity – notably, increasing model capacity shifts preference toward velocity prediction. We evaluate MFlow across ImageNet, UCF-101 video, and large-scale text-to-image generation, demonstrating competitive or improved generative performance across diverse settings. In addition, we find that vanilla pixel diffusion transformers, irrespective of parameterization, retain a persistent high-frequency deficit relative to real images. To address this, we introduce ConvRefiner, a lightweight convolutional module trained post-hoc with an adversarial loss while keeping the diffusion backbone frozen. With only a small amount of additional training, ConvRefiner restores the high-frequency statistics of generated images while preserving FID. Project webpage: https://soumik-kanad.github.io/mflow-diffusion/.

[107] Learning to Correct Geometry in Generated Videos cs.CVPDF

Weijie Lyu, Tiancheng Shen, Jason Li, Yujing Wang, Xiaoyuan Wang

TL;DR: Video Geometry Corrector通过合成配对监督训练后处理视频到视频模型，修复相机运动造成的几何失真而不改动源视频生成器。

Details

Motivation: 生成视频在相机运动时常出现结构随视角扭曲、视差不一致或平滑镜头运动坍缩成跳切。作者认为网络视频数据中大多数运动来自静止或少动相机下的动态物体，视角变化引起外观改变的监督较少。

Result: VGC使用带相机运动及姿态标注的真实视频生成VG-Pairs训练数据：每个视频片段作为几何一致目标，并用预训练图生视频修补模型及轨迹自适应关键帧合成扭曲配对输入。模型学习将失真输入映射回几何一致目标，不修改源生成器；光流作为辅助线索，帮助区分相机运动与物体运动。在姿态条件生成和提示驱动基准上，VGC改善多个源生成器的视频几何一致性；扩大骨干规模可进一步扩展到更通用的视频细化。

Insight: 后处理修复将几何纠正与视频生成分离，避免修改不同生成器本身；合成配对数据补足相机视角变化监督。摘要未列出几何指标、失真类型分项结果及对画面语义或动态质量的影响。

Abstract: Generated videos often lose geometric consistency under camera motion: structures warp under viewpoint change, parallax becomes inconsistent, and smooth camera movement may collapse into shot-like transitions. We argue that this failure is largely a data problem. In web-scale video corpora, most visible motion comes from dynamic objects captured by static or weakly moving cameras, leaving only sparse supervision for viewpoint-induced appearance changes. To address this, we propose Video Geometry Corrector (VGC), a post-hoc video-to-video model trained on synthetic paired supervision. Starting from real videos with diverse camera motion and pose annotations, we construct VG-Pairs with a synthetic paired-supervision data generation pipeline. Each video clip is treated as a geometry-consistent target and paired with a distorted counterpart synthesized by a pretrained image-to-video inpainting model using trajectory-adaptive keyframes. VGC learns to map the distorted input to the geometry-consistent target without modifying the source generator, and uses optical flow as an auxiliary cue to help disentangle camera motion from object motion. Experiments on pose-conditioned and prompt-driven benchmarks show that VGC improves geometric consistency across multiple source generators, and scaling to a larger backbone further extends the framework toward more general video refinement.

[108] Revealing the Impact of Visual Text Style on Attribute-based Descriptions Produced by Large Visual Language Models cs.CV | cs.CLPDF

Xiaomeng Wang, Martha Larson, Zhengyu Zhao

TL;DR: 该研究发现视觉文字的字体、颜色和大小风格会泄漏到大型视觉语言模型的概念属性描述，即使模型已正确识别文字所指概念。

Details

Motivation: 词语含义理论上与它的字体或装饰风格无关，但视觉语言模型可能把文字图像中的可见风格当作概念语义线索，影响属性描述。需要区分模型是否看懂词语和是否受呈现样式干扰。

Result: 实验比较强调可读性的功能性文字风格（如黑色无衬线字）与强调展示效果的装饰风格（如彩色手写体）。研究只考察视觉语言模型能够正确识别图像中文字所指概念的情形，此时文字样式不应改变其对概念属性的描述。结果显示，即使概念识别正确，文字呈现风格仍会影响模型生成的属性描述，体现视觉样式向语义推断的非平凡泄漏。

Insight: 视觉语言模型可能把文字图像的装饰特征误当成概念属性，评价和缓解应将OCR识别正确与语义描述是否受样式影响分别检查。摘要没有报告模型名称、样本规模和效应数值，结论以定性实验发现为限。

Abstract: When the visual style of text is considered, a wide variety can be observed in font, color, and size. However, when a word is read, its meaning is independent of the style in which it has been written or rendered. In this paper, we investigate whether, and how, the style in which a word is visualized in an image impacts the description that a Large Visual Language Model (LVLM) provides for the concept to which that word refers. Specifically, we investigate how functional text styles (readability-oriented, e.g., black sans-serif) versus decorative styles (display-oriented, e.g., colored cursive/script) affect LVLMs’ descriptions of a concept in terms of the attributes of that concept. Our experiments study the situation in which the LVLM is able to correctly identify the concept referred to by a visual text, i.e., by a word or words rendered as an image, and in which the visual text style should not influence the attribute-based description that the LVLM produces. Our experimental results reveal that even when the concept is correctly identified, text style influences the model’s attribute-based descriptions of the concept. Our findings demonstrate non-trivial style leakage from text style into semantic inference and motivate style-aware evaluation and mitigation for LVLM-based multimedia systems.

cs.AI [Back]

[109] PRIME: Towards Verifiable Evidence-Grounded Reasoning in LLM Agents cs.AI | cs.CLPDF

Hamed Khosravi, Xiaoming Huo

TL;DR: PRIME在证据检查前预先固定允许支持结论的证据路径，并由独立程序记录检查结果、拒绝无依据结论，提升组织规则核查的可验证性。

Details

Motivation: 智能体核对漏洞报告等记录时，要求可能允许多种满足方式；模型可能在某项必查结果失败后仍接受报告，也可能未尝试另一条可行路径就给出较弱结论。仅由模型文本推理难以确保结论受证据支持。

Result: PRIME先制定每种结论可接受的证据路线，再由独立程序登记每项检查结果并阻止证据未授权的结论；若仍有检查可能支持更强结论，系统会提示智能体继续检查或自行执行。只报告规则与证据台账授权的结论。在480个公开记录任务上，直接向智能体展示要求时，26.7%的任务出现无依据结论；PRIME未报告任何无依据结论。指引和补充检查将可证实结论的平均分从仅拒绝时的30.1提升至59.2满分中的最高值。作者指出，在要求正确、检查位置已知且预算足够的条件下，完成流程可达到证据所支持的最强结论。

Insight: 把证据规则与检查台账从语言模型判断中分离，能明确哪些结论被授权，并提示如何补足证据。零无依据结论依赖正确要求、已知检查位置和充分预算等假设；摘要未报告程序错误或开放式证据发现情境。

Abstract: LLM agents are used to check records against an organization’s requirements, for example whether a vulnerability report is ready for investigation. Requirements often allow several ways to be met, such as a severity rating with a curator-reviewed advisory or a published advisory link. Agents fail by accepting a report after a required check has failed, or by settling for a weaker conclusion without trying another way that could still succeed. We introduce PRIME (Precommitted Rules for Inference from Minimal Evidence). Before checking, it fixes evidence routes specifying how each conclusion may be justified. A separate program records each check result and refuses any conclusion the results do not justify. It also points the agent to checks that could justify a stronger conclusion, or runs them itself. PRIME reports only conclusions authorized by its rules and ledger. With correct requirements, exact checks at known locations, and sufficient budget at stopping, completion reaches the strongest supported conclusion. On 480 public-record tasks, an agent shown the requirements reported unjustified conclusions on 26.7% of tasks, while PRIME reported none. Its directions and added checks raised the average score for justified conclusions from 30.1, with refusal alone, to the maximum of 59.2 out of 100.

[110] ECHOES: Seeing Beyond the Current Image via Recursive History Compression and Privileged On-Policy Distillation cs.AI | cs.CVPDF

Tengda Guo, Jiawang Hu, Yifei Tao, Yin Wang, Haotian Hu

TL;DR: ECHOES通过递归文本历史压缩和特权在线策略蒸馏，训练GUI智能体在不保留部署期截图的情况下维持长任务状态记忆。

Details

Motivation: 长时程GUI智能体保留历史截图会增加视觉token和推理成本，文本摘要又可能丢失关键状态信息，降低跨步骤可靠性。

Result: ECHOES采用压缩—思考—行动格式递归更新文本历史状态。训练时同一模型接收特权多图像输入作为教师，对学生自行生成的轨迹进行token级在线策略蒸馏。PMF差距引导的OPD-RL动态平衡特权蒸馏与任务奖励，并周期性更新教师。作者还构建ECHOESBMK，基于真实GUI失败轨迹联合诊断视觉感知和跨模态状态保留。在四个GUI基准及ECHOESBMK上的实验显示任务表现和记忆保真度均明显提高；部署时无需保留历史截图，表现与推理成本之间具有较好折衷，并能零样本迁移至未见视觉规划任务。

Insight: 训练期可使用截图特权监督来教模型形成紧凑历史状态，而部署时只保留文本，有望兼顾记忆与计算开销。摘要未给出各基准分数、成本指标和长任务失败率；所谓优势限于作者所测GUI任务。

Abstract: Long-horizon GUI agents rely on visual history to maintain task states, but retaining historical screenshots increases visual-token usage and inference costs, while textual summaries can discard critical state information, undermining long-horizon reliability. We propose ECHOES, which leverages training-time privileged information to guide textual history compression and strengthen long-horizon reasoning. Specifically, ECHOES adopts a Compression-Think-Action (CTA) format to recursively update a textual history state and reason. The same model, given privileged multi-image inputs, serves as a teacher that provides dense token-level on-policy distillation on student-generated CTA rollouts. Our Perception-Memory Fidelity (PMF) Gap-guided OPD-RL framework dynamically balances privileged distillation and task-reward optimization, with periodic teacher updates supporting continued improvement. We further introduce ECHOESBMK, a fine-grained diagnostic benchmark derived from real GUI agent failure trajectories to jointly evaluate visual perception and cross-modal state retention. Experiments on four GUI benchmarks and ECHOESBMK demonstrate substantial gains in task performance and memory fidelity. Without retaining historical screenshots at deployment, ECHOES achieves competitive performance with a favorable performance-inference-cost trade-off and exhibits positive zero-shot transfer to unseen visual planning tasks.

[111] Are Large Reasoning Models Good Everyday Reasoners? A Comparison with Non-Reasoning Models on Logical Reasoning Tasks cs.AI | cs.CLPDF

Kentaro Ozeki, Risako Ando, Takanobu Morishita, Hirohiko Abe, Koji Mineshima

TL;DR: 该研究以语言和语用现象构建日常逻辑推理基准，发现大型推理模型在偏离形式逻辑的日常判断中并不稳定，部分非推理模型加思维链反而表现更好。

Details

Motivation: 大型推理模型通过测试时计算在数学和科学基准上成绩强，但日常推理常依赖语境和语用判断，不完全符合教科书式形式逻辑，其能力尚未被充分评估。

Result: 作者提出基于语言和语用推理现象的基准，并在受控提示条件下比较推理模型与非推理模型。结果显示，许多情况下，当日常判断偏离形式逻辑规则时，推理模型表现会下降；一些使用思维链提示的非推理模型超过相近推理模型；额外指令对推理行为的控制也有限。

Insight: 测试时推理能力强不等于能覆盖语用和常识性逻辑，模型设计与评测需要包括多样的日常推理形式。摘要没有列出基准规模、模型名单和定量结果，结论为总体实验发现。

Abstract: Large reasoning models (LRMs) that leverage test-time computation achieve strong performance on mathematical and scientific benchmarks and are increasingly deployed in real-world applications. However, their ability to perform \textit{everyday logical reasoning}, which often departs from textbook formal logic, remains underexplored. In this work, we systematically evaluate how well reasoning models align with everyday reasoning patterns by introducing a benchmark based on linguistic and pragmatic reasoning phenomena. We also compare reasoning models with non-reasoning models under controlled prompting conditions. We find that, in many cases, (1) reasoning models show degraded performance in everyday reasoning when such reasoning deviates from formal logical rules, (2) some non-reasoning models with chain-of-thought prompting outperform comparable reasoning models in everyday reasoning, and (3) prompting with additional instructions provides limited control over reasoning behavior. These findings suggest that current reasoning models do not reliably capture everyday reasoning and point to limitations in post-training, motivating improved training objectives and evaluation across diverse forms of reasoning.

[112] Repairing LLM-Generated Specifications with Deterministic Diagnosis cs.AI | cs.CLPDF

Giovanni Vaccarino, Emanuele La Malfa, Dehai Min, Hanrong Zhang, Pier Luca Lanzi

TL;DR: DRAGO用形式化、确定性的诊断替代语言模型对错误规格的无依据批评，并仅接受诊断错误权重严格下降的修复，从而减少形式化过程中的回归。

Details

Motivation: 语言模型可把自然语言推理问题转成符号求解器可运行的规格，但能运行不代表语义正确；约束、域、目标、谓词或目标条件仍可能编码错误，执行成功后求解器也不再提供错误反馈。纯语言模型诊断缺乏形式真值，容易漏错或破坏正确规格。

Result: DRAGO针对具体形式体系执行确定性诊断，并仅当诊断错误权重严格下降时保留改写，以免无依据修改引入回归。五个基准覆盖SMT-LIB2逻辑推理、MiniZinc约束编程和PDDL规划。实验中，初始正确规格被回归的比例从11.8%降至1.3%，约降低一个数量级；跨基准平均回答准确率比零样本形式化提高12.9个百分点，比LLM诊断修复提高8.7个百分点。作者还发现Planetarium中的两项渲染缺陷导致其地板砖子集50%（3,086个实例）与参考形式化不一致，并发布修正划分。

Insight: 用形式化规则检查规格可给修订提供可验证的错误证据，并控制修复对原本正确结果的损害。方法依赖任务形式体系及可执行诊断规则；摘要未说明新增诊断器的覆盖范围，Planetarium划分修订也提示既有评测数据可能存在缺陷。

Abstract: Large language models (LLMs) are increasingly used as formalizers: given a reasoning problem expressed in natural language, they produce a formal specification that a symbolic solver can then solve, with guarantees relative to that specification. Many specifications are runnable yet semantically wrong, encoding incorrect constraints, domains, objectives, predicates, or goals, and solver-error feedback dries up once execution succeeds. Purely LLM-based diagnosis, lacking a formal ground truth, often fails to spot these errors, and its ungrounded critiques cause regressions in 11.8% of initially correct specifications in our experiments. We propose DRAGO, a repair framework that replaces this ungrounded critique with deterministic, formalism-specific diagnosis, and retains a rewrite only when the diagnosed error weight strictly decreases under a reference-free acceptance predicate. Across five benchmarks spanning logical reasoning (SMT-LIB2), constraint programming (MiniZinc), and planning (PDDL), DRAGO cuts regressions by nearly an order of magnitude, to 1.3%, while improving answer accuracy by 12.9 percentage points over zero-shot formalization and 8.7 percentage points over LLM-diagnostic repair, averaged across benchmarks. We also uncover two rendering defects in Planetarium that cause 50% (3,086 instances) of its floor-tile split to be inconsistent with the reference formalizations, and release a corrected split.

[113] Sep-Latent: Separator Tokens as Natural Compression Anchors for Implicit Reasoning cs.AI | cs.CLPDF

Yinlong Xu, Jianfeng Huang, Zhengdong Zhou, Mingjie Lin, Fuyu Lv

TL;DR: Sep-Latent用分隔token作为语义锚点压缩隐式推理，并依据问题复杂度动态决定潜在思考深度。

Details

Motivation: 显式链式思维推理的token冗长且计算开销大；连续潜变量隐式推理可提高效率，但既有方法常使用固定长度潜序列并出现表征坍塌。

Result: Sep-Latent将分隔token作为结构化语义锚点，以注意力衰减机制促使模型训练时把推理逻辑汇聚压缩到这些锚点，并通过跨所有层的多层蒸馏对齐显式与隐式路径以维持逻辑一致。模型根据查询复杂度自适应终止潜在思考。在GSM8k-Aug上准确率为56.8%，平均仅使用5.4个token，效率超过先前固定长度隐式推理模型，并缩小与显式思维链的性能差距。PCA和符号变体测试支持其语义锚定及对扰动的稳健性。

Insight: 语义锚点提供可变长度隐式推理的压缩位置，动态终止避免所有问题都支付固定潜推理成本。摘要未提供与显式思维链的准确率差距、token统计口径和更广任务验证，结果限于GSM8k-Aug等测试。

Abstract: Large Language Models (LLMs) have demonstrated remarkable success in complex reasoning through explicit Chain-of-Thought (CoT), but the associated computational overhead and token verbosity remain significant barriers to efficiency. While implicit reasoning in continuous latent spaces offers a promising alternative, existing methods like Coconut and CODI often rely on fixed-length latent sequences and suffer from representational collapse. In this paper, we propose Sep-Latent, an adaptive implicit reasoning framework that utilizes separator tokens as structural semantic anchors. By introducing an Attention-Decay mechanism, we force the model to aggregate and compress reasoning logic into these anchors during training. We then align explicit and implicit pathways through multi-level distillation across all layers to ensure logical consistency. Crucially, Sep-Latent enables dynamic reasoning depth by adaptively terminating the latent thinking phase based on query complexity. Experimental results on the GSM8k-Aug benchmark show that Sep-Latent achieves an accuracy of 56.8% with an average of only 5.4 tokens, significantly outperforming prior fixed-length implicit models in efficiency while narrowing the performance gap with explicit CoT. Further analysis via PCA and symbolic variant testing confirms that our method ensures semantic grounding and exhibits superior robustness to perturbations.

[114] SimOPD: Relational Knowledge Transfer for On-Policy Distillation cs.AI | cs.CLPDF

Kai Tang, Xing Zheng, Haobo Wang, Guangcheng Zhu, Shenzhi Yang

TL;DR: SimOPD通过对比学生生成回答之间的关系分布传递教师内部知识，避免直接匹配跨架构隐藏状态，在同架构和跨架构在线策略蒸馏中提升表现。

Details

Motivation: 在线策略蒸馏需要从教师知识提取有效监督。只用token概率可能未充分利用内部知识；直接对齐隐藏状态则迫使学生适应教师特征空间，并使跨架构迁移复杂。

Result: SimOPD维护成对的学生生成回答记忆库，从教师内部表征中提取回答相似度分布作为监督。学生在自身表示空间内匹配这些关系分布，无需跨模型特征投影，保留表示自由度。大量实验中，SimOPD相较最强基线，同架构和跨架构设置下总体平均分别最多提高2.6和3.1个百分点。

Insight: 传递样本间关系而非逐token或逐向量对齐，可减少教师与学生骨干结构差异带来的限制。摘要未说明具体任务、模型组合、评价指标和不同数据规模下的结果，报告的是各设置最高增益。

Abstract: A key challenge in on-policy distillation (OPD) is extracting effective supervision from teacher knowledge. Supervision from token probabilities may underutilize internal knowledge, while direct hidden-state matching forces the student to shift to the teacher’s feature space and complicates cross-architecture transfer. Inspired by contrastive learning’s use of relationships between instances, we propose \textbf{SimOPD} to transfer teacher internal knowledge through response similarities. Specifically, SimOPD uses paired memory banks of student-generated responses to extract supervision from the teacher’s internal representations as similarity distributions. The student then matches these distributions within its own representation space, retaining representational freedom and removing the need for cross-model projection. Extensive experiments show that SimOPD improves the overall average over the strongest baselines by up to 2.6 and 3.1 percentage points in same- and cross-architecture settings.

[115] Reasoning Models Can Control Their Chains of Thought When They Tell Themselves To cs.AI | cs.CL | cs.LGPDF

Uriel Dolev, Idan Schwartz, Yoav Goldberg

TL;DR: 该研究提出把链式思维约束写成模型自我指令的评测方式，发现这比直接在用户提示中下达约束更能控制推理过程，同时也可能被用于规避监控。

Details

Motivation: 链式思维可控性影响推理模型的实用性和监督可靠性。既有研究只测模型是否服从用户提示中的思维链约束，并报告各模型可控性较低；作者认为这一结果可能源于约束表达位置不合适。

Result: Self-Instructed CoT Controllability把约束写在模型自身思维链内，作为对用户提示评测的补充。实验显示，自我指令下模型可控性显著高于标准用户指令；即使只提醒模型遵守用户约束，也能大幅改善。有效自我指令还可通过用户提示中的简单说明引导生成，使模型无需访问推理通道也能提高控制。作者进一步在真实监控设置中展示，自我指令能够用于规避思维链监控。

Insight: 较低的CoT可控性可能受约束提示位置影响，但提升可控性同时带来监控规避风险。摘要没有给出具体可控性数值、模型范围和监控攻击成功率，因此安全结论限于所示设置。

Abstract: Chain-of-thought (CoT) controllability, the ability of reasoning models to control properties of their CoT, is consequential for both their usefulness and reliable oversight. Recent work evaluates this capability by measuring whether models follow CoT constraints given in the user prompt, and reports very low controllability across models. We argue that this low controllability may not reflect an inherent inability of reasoning models to control their CoT, but instead result from naively specifying constraints in the user prompt. To test this, we introduce Self-Instructed CoT Controllability: a complementary evaluation that places the constraint as a self-instruction inside the model’s CoT and measures its ability to follow it. We show that, under self-instruction, models achieve significantly higher controllability than with standard user instructions. Even a generic reminder to follow the user’s constraint substantially improves controllability. Moreover, effective self-instructions can be bootstrapped into the reasoning through a simple instruction in the user prompt, enabling improved control even without access to the reasoning channel. Finally, using self-instruction, we demonstrate in a realistic monitoring setup that CoT controllability can be leveraged for monitor evasion, posing a risk to CoT monitorability.

[116] Self-Reflective Chain-of-Thought (SRCoT): Evidence-Based Text Generation via a Closed-Loop Retrieve–Reflect–Revise Pipeline on Edge LLMs cs.AI | cs.CLPDF

Fabian Broszio, Michael Hoffmann, Adrian Paschke

TL;DR: SRCoT用“检索—反思—修订”闭环组织边缘大模型生成，并通过来源标记记忆、证据缺口提示和结构化决策提高输出可审查性。

Details

Motivation: 大语言模型可能生成流畅但缺乏来源支持、或违反本地操作约束的内容。若环境状态、持久知识、过往经验和短期记忆混杂，模型很难说明结论依据，也可能在证据不足时继续给出不安全推断。

Result: SRCoT将环境状态、持久知识、积累经验和短期记忆分开存储并标记来源；BM25提供本地上下文，后续轮次暴露中间草稿、缺失信息标记、追问及可选主张—证据映射，支持再检索、修订、澄清或拒答。论文通过两个完全合成场景（急救服务和Munich-Sim应急模拟）做定性轨迹案例研究，并在128GB内存的Apple M4系列笔记本运行原型。轨迹展示来源标注和明确缺口标记，也发现来源归属错误、证据覆盖不全及提示约束仍无法避免的不安全假设。

Insight: 论文贡献是可检查的报告级控制过程和本地运行概念验证，并非模型性能比较或临床/操作安全证明。摘要明确指出需人工复核，跨模型行为仍待评估；不能将案例轨迹解读成幻觉率已下降。

Abstract: Large language models (LLMs) can generate fluent outputs that lack source support or conflict with local operational constraints. We introduce Self-Reflective Chain-of-Thought (SRCoT), a modular architecture that organizes generation as a closed Retrieve–Reflect–Revise loop. SRCoT separates environment state, persistent knowledge, accumulated experience, and short-term memory into provenance-labeled stores. BM25 retrieval supplies local context; subsequent passes expose intermediate drafts, missing-information markers, follow-up queries, and optional claim–evidence mappings. These artifacts inform retrieval, revision, clarification, or abstention decisions. We examine the architecture through qualitative, trace-based case studies in two fully synthetic settings: emergency medical services and Munich-Sim, an emergency-operations simulation. Local prototype runs on an Apple M4-family laptop with 128 GB memory illustrate source-labeled documentation, explicit gap marking, and structured dispatch-style outputs. The traces also reveal provenance-assignment errors, incomplete evidence coverage, and unsafe assumptions that remain possible despite prompting constraints. These cases demonstrate report-level inspectability and local execution, not comparative superiority, hallucination reduction, clinical validity, or operational safety. The architecture separates retrieval and control from the model interface, but behavior across different models remains to be evaluated. SRCoT is a research proof of concept requiring human review, with its principal contribution lying in an inspectable control procedure rather than a new model.

[117] ScoutRoute: Efficient Mixture-of-Experts Routing Using Internal Language Model Signals cs.AI | cs.CLPDF

Rajdeep Pandhare, Delzaan Bharucha

TL;DR: ScoutRoute用一次低成本侦察模型前向过程提取内部表征及logit置信信号，预测多个独立训练语言模型的任务能力并路由请求。

Details

Motivation: 异构专家模型的高效路由常依赖联合训练门控、提示预测器或并行调用多个模型，限制灵活性并增加推理成本。

Result: ScoutRoute从单个轻量侦察模型的一次前向计算中提取隐藏状态，以轻量逻辑探针估计跨模型胜任度，并将logit置信信号用于领域感知路由，无需改动底层语言模型。作者在五个开放权重模型和四个基准上测试，覆盖数学推理、代码生成、常识推理和多学科知识。实验报告ScoutRoute整体优于单独路由信号，仅需一次侦察模型推理；胜任度探针的校准也优于传统置信指标。

Insight: 内部表征可能包含跨模型、可迁移的能力信号，可在不同时调用所有专家的情况下辅助分配问题。摘要没有给出基准分数、探针训练数据和端到端成本比较，效果范围限于所测模型及任务。

Abstract: Efficient expert routing is a fundamental challenge in Mixture-of-Experts (MoE) systems, particularly for heterogeneous collections of independently trained Large Language Mod els (LLMs). Existing routing approaches typically rely on jointly trained gating networks, prompt-based predictors, or computationally expensive multi-model inference, limiting their flexibility and efficiency. This paper presents ScoutRoute, a lightweight post-hoc routing framework that predicts expert competence using internal language model signals extracted from a single forward pass through an inexpensive scout model. Hidden-state representations are used to estimate cross-model competence through lightweight logistic probes, while logit-derived confidence measures are incorporated within a domain-aware routing strategy for efficient expert selec tion without modifying the underlying language models. ScoutRoute isevaluatedon fiveopen-weightlanguagemodels across fourbenchmark datasets covering mathematical reasoning, code generation, commonsense reasoning, and multidis ciplinary knowledge. Experimental results show that ScoutRoute consistently outperforms individual routing signals while requiring only a single scout-model inference. The proposed competence probes also achieve superior calibration compared with conventional confidence measures, demonstrating that internal language model representations provide transferable information for accurate and efficient expert routing across heterogeneous language models

cs.CR [Back]

[118] An Agentic ENF Framework for Forensic Video Authentication Against Generative AI cs.CR | cs.CV | cs.MM | eess.SPPDF

Ryan Wyton, Bacha Rehman

TL;DR: 该取证框架利用音频嗡声和滚动快门视频闪烁中的电网频率信号，并通过外部时间参考核验一致性，以鉴别生成式AI伪造视频。

Details

Motivation: 生成模型可以合成难与真实录像区分的视频，依赖生成器伪影的检测器面对未见模型时往往失效。电网频率ENF由电力网络驱动，可在音频中表现为嗡声、在视频中表现为闪烁，生成系统难以直接控制这一外部信号。

Result: 框架采用双通道检测器，从音频和滚动快门视频中用统一二次谐波估计器提取ENF；通过基于Ornstein–Uhlenbeck漂移模型、锚定真实录音的合成注入训练缓解标注数据不足；参考匹配通道用于核验声称录制时间或恢复未知时间。双轴智能体编排器按非对称规则融合录制真实性与内容操纵证据，只在必要时调用高成本检测器。核心发现是生成视频中也会出现显著度与真实视频无法区分的ENF频段闪烁，因此信号“存在”不能证明真实，需与独立参考一致。留出真实录音上的音频和视频真实样本接受率分别为93%和100%，朴素基线分别53%和15%；声称时间验证AUC为1.0。级联达到平坦集成相同准确率，同时墙钟时间减少54%、解码帧减少64%。

Insight: ENF认证依赖与独立参考的时间一致性，不能只看频率成分是否出现；该设计将外部物理信号与内容操纵证据结合。摘要未给出数据集规模、参考可得性和对抗伪造细节，AUC 1.0限于其留出测试条件。

Abstract: Generative models now synthesise video that is hard to distinguish from genuine footage, and learned detectors that key on a generator’s artefacts degrade sharply on unseen models. This paper develops a forensic framework that authenticates video by a signal that generation does not control: the electric network frequency (ENF), the mains-driven hum in audio and flicker in video. A unified two-channel detector extracts the ENF from audio and from rolling-shutter video through one second harmonic estimator and a shared network; a synthetic-injection training method, driven by an Ornstein-Uhlenbeck drift model and anchored to real recordings, overcomes the scarcity of labelled ENF data; a reference-matching channel verifies a claimed time of recording and recovers an unknown one; and a two-axis agentic orchestrator fuses recording authenticity with content-manipulation evidence under an asymmetric rule, escalating expensive detectors only when needed. A central finding reframes the task: an ENF-band flicker is present in generated video at a prominence indistinguishable from real footage, so its presence is not proof of authenticity, and authentication must rest on consistency with an independent reference rather than on presence. On held-out real recordings the detector accepts genuine audio and video at 93% and 100% against naive baselines of 53% and 15%; claimed-time authentication reaches an area under the curve of 1.0; and the agentic cascade matches a flat ensemble while cutting wall-clock time by 54% and frames decoded by 64%, without loss of accuracy.

[119] Erase the Mark, Preserve the Motion: Temporally Consistent Removal of Video Watermarks cs.CR | cs.CVPDF

Yifan Liao, Zhen Sun, Zhicong Huang, Jiaming He, Zongmin Zhang

TL;DR: PoseRegen用时序共享视角变换和姿态条件视频重建移除视频水印，同时尽量保留原始内容、运动结构和跨帧连贯性。

Details

Motivation: 图像水印移除方法扩展到视频时会出现问题：像素扰动造成时变噪声和闪烁，扩散重生成则可能让细节跨帧不一致、运动结构失真。水印鲁棒性评测因此需要同时考虑内容、时间和动作质量。

Result: PoseRegen先施加跨帧共享视角变换，破坏水印携带的空间模式，再用姿态条件视频模型联合重建变换后的序列。冻结视频DiT以参考视频潜变量处理完整序列，通过全序列流匹配监督维持人物身份和背景一致。轻量姿态条件运动一致性适配器将按时间排序的姿态输入接入冻结骨干，并约束身体部位轨迹。在11种视频水印方案上，平均比特准确率降至0.505，接近随机猜测；运动相关VBench指标比最强基线高9.34%。

Insight: 联合建模整段视频和姿态轨迹，可在移除水印时降低逐帧处理造成的运动破坏。结果揭示当前水印的实际脆弱性，但摘要未提供不同水印方案分项结果及内容保留程度；水印不可恢复也不等同于生成内容完全未受影响。

Abstract: Recent advances in video generation have increased the demand for reliable watermarking for copyright protection, yet the robustness of video watermarks against removal attacks remains underexplored. Most watermark-removal methods originate from the image domain: signal optimization injects imperceptible pixel-domain perturbations, whereas generative resynthesis produces a visually similar instance through diffusion synthesis. When extended to videos, the former introduces temporally varying noise that causes visible flickering, while the latter regenerates fine-grained structures inconsistently across frames, leading to structural motion inconsistency. To evaluate video watermark robustness, we propose PoseRegen, a pose-consistent reconstruction framework that removes watermarks while preserving the original content and motion. PoseRegen first applies a temporally shared viewpoint transformation to disrupt watermark-bearing spatial patterns and then jointly reconstructs the transformed sequence with a pose-conditioned video model. A frozen video DiT processes the complete sequence with its reference-video latent, and full-sequence Flow Matching supervision keeps identity and background consistent across frames. To further preserve motion structure, we introduce a lightweight Pose-Conditioned Motion Consistency Adapter that adapts the frozen backbone to temporally ordered pose guidance and constrains body-part trajectories throughout reconstruction. Experiments on eleven video watermarking schemes show that PoseRegen reduces the average bit accuracy to 0.505, near random guessing, while outperforming the strongest baseline by 9.34% on motion-related VBench metrics. These results reveal a practical vulnerability of current video watermarks and highlight the need to evaluate robustness jointly with temporal and motion quality.

[120] SAFE-Mem: Secure Agentic Memory with Fine-Grained Authority and Governance-Aware Retrieval cs.CR | cs.CLPDF

Haoming Li, Dingyi Kang, Xu Hu, Jinxin Yang, Zhu Xu

TL;DR: SAFE-Mem用细粒度权限标签、治理感知检索和记忆来源图管理智能体长期记忆，在保留合法记忆使用的防护方案中降低攻击成功率并提升回答准确性。

Details

Motivation: 智能体的长期记忆可能从外部来源吸收未经授权的主张，之后却把它们当成用户偏好、政策或权限使用。仅按内容过滤或粗粒度追踪来源，既可能漏掉越权影响，也可能阻断有用信息。

Result: SAFE-Mem为每条主张标注类别、权限来源和适用范围三种治理标签；检索时将问题要求与主张许可匹配，以阻断未经授权的信息影响并保留合法记忆。治理记忆图连接源句、主张和实体，支持溯源及高效检索。在四种LLM骨干、MPBench和LoCoMo上的实验中，相较仍保留合法记忆使用能力的防御方法，SAFE-Mem攻击成功率最低，至少比其中最强者低77%；在所有被评防御中回答准确率最高，最多提高15%。

Insight: 记忆权限需要保留细粒度来源和使用范围，才能同时考虑安全与效用。摘要未给出攻击类型分项、标签生成方式及人工标注成本，因此效果依赖治理元数据是否正确。

Abstract: Large language model (LLM) agents increasingly rely on persistent memory to support long-term reasoning and personalized interactions. However, information collected from external sources can introduce security risks when untrusted claims (i.e., atomic statements) are later treated as authorized preferences, policies, or permissions. Existing defenses typically rely on content-based filtering or coarse-grained provenance tracking, which either fail to prevent unauthorized memory use or block legitimate information, sacrificing memory utility. To address these limitations, we propose SAFE-Mem, a fine-grained memory governance framework that improves security while preserving legitimate memory use. First, SAFE-Mem annotates each claim with three governance labels (i.e., kind, authority, and scope) to capture its provenance and permitted use. Second, governance-aware retrieval matches query requirements with claim permissions to block unauthorized influence while retaining legitimate information. Third, a governance-enabled memory graph connects source sentences, claims, and entities to support provenance tracking and efficient retrieval. Across four LLM backbones on MPBench and LoCoMo, SAFE-Mem attains the lowest attack success among defenses that retain legitimate memory, at least 77% below the strongest of them, and the highest answer accuracy of all evaluated defenses, improving it by up to 15%. The code is available at https://github.com/LVenum/SAFE-Mem.

cs.HC [Back]

[121] mmPencil: Toward Writing-Style-Independent In-Air Handwriting Recognition via mmWave Radar and Large Vision-Language Model cs.HC | cs.CVPDF

Yifan Guo, Zhu Wang, Qian Qin, Yangqian Lei, Qiwen Gan

TL;DR: mmPencil将毫米波雷达重建的三维空中书写轨迹映射为视觉表示交给视觉语言模型识别，在多种书写条件和未见用户上保持较高准确率。

Details

Motivation: 基于射频信号的空中书写识别可用于人机交互，但现有方法常受预设书写平面、写法限制和词汇规模较小等约束，且对书写风格和环境变化较敏感。

Result: 作者提出m²VLMs模态映射架构连接毫米波雷达与视觉语言模型，并构建3D空中书写识别系统mmPencil。系统用多阶段空间轨迹重建从雷达信号恢复三维笔迹，再通过空间到视觉映射转成视觉表示输入视觉语言模型，以降低书写风格和环境因素影响。数据集包含12位用户在22种书写情境中的7,664个样本、200个词。实验显示，系统对书写位置、距离、角度、速度、大小、方向和用户移动等变化具有鲁棒性；已见用户200词分类准确率为97.60%，未见用户50词零样本准确率为92.50%，超过先进基线。

Insight: 将射频轨迹转换为视觉表示，可复用视觉语言模型进行大词汇识别并支持三维书写。摘要未列出各变化因素的单独准确率、用户划分细节及新词泛化结果，未见用户成绩不等于完全未见词汇泛化。

Abstract: In-air handwriting recognition based on radio frequency (RF) signals offers a promising solution for human-computer interaction, yet existing methods are often limited by predefined writing planes, constrained writing styles, and small recognition vocabularies. To address these limitations, we propose m^2VLMs, a modality mapping architecture that bridges millimeter-wave (mmWave) radar sensing and large vision-language models (VLMs), and develop mmPencil, a 3D in-air handwriting word recognition system. mmPencil reconstructs 3D handwriting trajectories from mmWave signals using a multi-stage spatial trajectory reconstruction algorithm and maps them into visual representations through a spatial-to-visual mapping algorithm, enabling VLMs to recognize handwriting while reducing sensitivity to writing styles and environmental factors. We collect and release a 3D mmWave handwriting dataset containing 7,664 samples of 200 words from 12 users across 22 writing scenarios. Extensive experiments demonstrate that mmPencil achieves robust word recognition under variations in writing position, range, angle, speed, size, direction, and user movement. It achieves 97.60% accuracy on 200 word classes for seen users and 92.50% zero-shot accuracy on 50 word classes for unseen users, outperforming state-of-the-art baselines.

cs.IR [Back]

[122] Reasoning Reranking with Semantic IDs as the Sole Item Representation cs.IR | cs.CL | cs.LGPDF

Zhenwei Tang, Jintao Liu, Di Bai, Xidong Wu, Xinwu Cheng

TL;DR: ReRankID评测只用语义ID进行推荐重排，发现模型未经训练时常复现输入顺序，但多种后训练可引出重排能力，并使8B模型接近读取长文本的LLM。

Details

Motivation: 生成式推荐系统逐渐用语义ID压缩表示物品，潜在好处是提示更短且编码可能包含交互行为信息，但这些token是否足以支持对候选列表进行推理排序尚未验证。

Result: 作者构建ReRankID控制测试床，让模型只看用户历史和候选语义ID进行推理排序，并逐项改变物品呈现、历史长度和候选数量。模型常复制输入顺序，加入可读元数据也未能解决。作者比较监督微调、拒绝采样自训练、在线策略蒸馏和验证器强化学习，发现这些后训练能引出缺失的排序行为。最强8B模型用分级排序奖励训练后，语义ID单独排序达到最佳，并匹配提示长约20倍的文本读取LLM；无历史时仍高于随机，而文本参考未能做到；长历史下当文本提示超过5万token、参考模型不再改善时，模型仍保留收益。配对理由审计中，该模型更善于比较取舍，但物品描述较不准确。

Insight: 后训练能使语义ID承载排序行为，但不保证模型能忠实解释ID对应的物品内容；排序能力与物品描述能力需分别衡量。摘要未给出完整基准分数和推荐数据来源，结果限于所测测试床与模型。

Abstract: Reasoning rerankers write a rationale before ranking a candidate slate, and existing systems read item metadata to do so, even though generative recommenders increasingly represent items as compact Semantic IDs (SIDs). Ranking from SIDs alone has two appeals: SID prompts are far shorter than the matched item text, and although item codes are fixed from content, the backbone learns their token embeddings in part from user-item interaction sequences, so the tokens can carry behavioral signal that item text lacks. That training targets next-item generation, and whether it supports ranking a supplied slate from SIDs alone is untested. We build ReRankID, a controlled testbed in which models reason and rank from a history and slate shown only as SIDs, varying item rendering, history length, and slate size one at a time. On this testbed, such models often copy the input order instead of reranking, and readable metadata does not repair the failure. We compare supervised fine-tuning, rejection-sampled self-training, on-policy distillation, and verifier-based reinforcement learning as post-training methods and find that they elicit the missing behavior. The strongest post-trained model, the 8B model trained with a graded ranking reward, gives the best SID-only ranking and matches strong text-reading LLMs whose prompts are about 20x longer. It ranks above random with no history at all, where a caption-reading reference does not, and it keeps its gains at long histories, where text prompts pass 50k tokens and the caption-reading reference stops improving. In a paired rationale audit, this model argues trade-offs better than that reference but describes items less accurately. The common post-training methods we test thus elicit ranking from SIDs but not faithful item descriptions, which calls for post-training that improves the reasoning itself, not only the ranking it produces.

cs.LG [Back]

[123] CF-NODE: Counterfactual Spatial Node Intervention for Test-Time Adaptation Under Domain Shift, Evaluated Across Five Diabetic Retinopathy Datasets cs.LG | cs.CVPDF

Sabarish G, Deepak Parashar

TL;DR: CF-NODE通过逐步干预模型的空间节点并观察预期病变等级变化，对每张眼底图独立进行反事实测试时校准，改善糖尿病视网膜病变跨域分级。

Details

Motivation: 基于眼底图像的糖尿病视网膜病变分级可扩大筛查能力，但源数据训练模型在不同相机、诊所和患者群体间性能会明显下降。许多测试时适配依赖熵最小化或图像批次统计，可能强化高置信错误，也不适合逐张独立到达的临床图像。

Result: CF-NODE不直接信任预测置信或估计目标分布，而是检查预测在支持证据受到控制干预后如何变化。它根据模型注意力、特征幅值和节点集合相似度对内部空间节点排序，逐步衰减高排名节点，再依据预期分级响应的稳定性对预测等级分布进行有界校准。方法保持模型权重冻结，每张图独立使用几何视图和固定源域先验适配，不用目标域信息或更新模型。在五个外部DR数据集的重复随机种子评测中，CF-NODE超过TENT、EATA、SAR和T3A，较第二名有统计显著提升；每个目标域AUC均提高，平均AUC及macro-F1最高。

Insight: 按证据干预后的响应稳定性校准，避免依赖目标域批次统计，适合逐图推理设定。摘要未给出具体AUC/F1增益和严重度分级细节；“可部署”结论仍基于五个外部数据集评测，非真实临床前瞻验证。

Abstract: Automated fundus-based diabetic retinopathy (DR) grading can substantially expand screening capacity, but source-trained models degrade sharply across different cameras, clinics, and patient populations. Existing test-time adaptation methods depend on entropy minimization or target information accumulated from image batches and streams. These mechanisms can reinforce confidently incorrect predictions and break down when clinical images arrive independently. We introduce CF-NODE, a novel counterfactual test-time adaptation framework for cross- domain DR grading. Instead of trusting prediction confidence or estimating a target distribution, CF-NODE asks how each prediction responds under a controlled intervention on the evidence supporting it. CF-NODE ranks internal spatial nodes using model-derived attention, feature magnitude, and node-set similarity, progressively attenuates the highest-ranked nodes, and uses the stability of the resulting expected-grade response to apply a bounded calibration of the predicted grade distribution. The framework is fully frozen and adapts every image independently using only geometric views and a fixed source-derived prior, requiring no target-derived information or model updates. We evaluate CF-NODE on five external DR datasets under repeated-seed evaluation against TENT, EATA, SAR, and T3A. CF-NODE outperforms all four methods with statistically significant improvements over the second-best method, improves AUC on every target domain, and attains the highest average AUC and macro-F1, delivering stronger grade discrimination together with more balanced recognition across DR severity levels. These results demonstrate that counterfactual intervention sensitivity provides consistent and deployment-ready domain robustness for single-image clinical inference.

[124] Can LLMs predict the outcomes of machine learning experiments? cs.LG | cs.AI | cs.CLPDF

Ayush Bansal, Aldo Pareja, Sean Klein, Serge Didenko, Artem Lukoianov

TL;DR: 该研究评测前沿语言模型预判机器学习实验成效的能力，发现模型预测显著优于随机但仍有限，并普遍低估实验改动的实际影响幅度。

Details

Motivation: 大语言模型已可提出、筛选和执行机器学习实验，若要自动改进模型，需要在投入漫长训练之前判断实验是否值得运行。但当前LLM对自拟实验的效果预测准确度尚缺乏实证衡量。

Result: 作者收集八项MLE-bench任务上的288个LLM提出方案，并让五个前沿模型预测每个方案的训练效果，再与实际实验结果比较。模型预测明显优于随机，但最佳Claude Opus 5.5也只解释一半结果方差，R²为0.49。所有模型都系统性低估改动幅度；预测质量因任务差异较大。实际实现方案的编程harness选择对结果影响较小，且未发现模型自偏好；更高推理设置和额外上下文只带来适度提升。数据集将公开以供后续研究。

Insight: LLM对哪些机器学习方案有效已有一定直觉，但不足以替代真实运行验证，尤其效果幅度估计偏保守且跨任务不稳定。摘要未列出各任务的预测误差及实验运行预算，结论限于八项MLE-bench任务和288个提案。

Abstract: Recent advances in AI make Recursive Self-Improvement (RSI) increasingly plausible. Large Language Models (LLMs) can already propose, select, and run Machine Learning (ML) experiments. However, the space of possible design choices in ML is vast. An LLM that proposes an experiment needs a reliable intuition of whether it is worth running given the timing constraints of long training runs. In this work, we measure such intuition in current frontier LLMs by evaluating how accurately they predict the impact of self-generated ML experiment ideas before these are put into training runs. To this end, we construct a dataset of 288 LLM-proposed ideas on eight MLE-bench tasks. We then prompt five frontier LLMs (GPT-6 Astra, Claude Opus 5.5, Claude Fable 5.1, Kimi K3, and GLM-5.3) to predict the impact of each idea and compare their predictions with the actual outcomes after training. We report four main findings. First, LLM predictions are substantially better than random chance but far from accurate: even the best model, Claude Opus 5.5, explains only half of the variance in outcomes (R^2 = 0.49). Second, we notice that all tested models systematically underestimate the magnitude of the changes. Third, prediction quality varies widely across tasks. Finally, the choice of the coding harness that actually implements the ideas has little effect on outcomes, and we find no evidence of self-preference. Higher reasoning settings and additional context lead to modest gains. Overall, our results show that current LLMs have useful but limited intuition about which ML ideas will work. We release our dataset to support further study.

[125] Domain-specific language alignment of multimodal embeddings towards explainable predictions cs.LG | cs.CVPDF

Gabrielė Tijūnaitytė, Thijs L. van der Plas, Mohamed-Bachir Belaid, Rob Knapen, Maciej J. Soja

TL;DR: 该框架用辅助数据对多模态嵌入进行领域语言对齐，使原本不可解释的地球观测表征能以领域概念检索和解释。

Details

Motivation: 多模态融合嵌入可提升下游预测，但难以解释；视觉语言对齐能使图像嵌入获得语言解释，却依赖大规模图文标注，而多模态嵌入通常缺少可直接观察和标注的配对描述。

Result: 作者提出适用于可关联到可解释辅助数据的嵌入空间语言对齐框架：描述函数将辅助数据转成部分描述；软对比损失按描述所表达属性的相似性加权样本对；概念检索评估则直接与辅助数据对照，而非与描述文本对照。框架用于AlphaEarth地球嵌入和S2BMS、SatBird两个物种分布建模任务。AlphaEarth在七项指标中的六项超过此前先进模型；语言对齐后，两数据集的领域概念平均检索均超过既有地球观测视觉语言模型。对齐概念还恢复物种—栖息地关联，相关系数ρ=0.44，并可将栖息地描述联系到物种预测。

Insight: 辅助数据可充当嵌入与领域语言之间的弱监督桥梁，不必拥有完整图像字幕。摘要未说明各指标分数和辅助数据成本，ρ=0.44表示相关而非因果关系，应用范围限于所测物种分布任务。

Abstract: Multimodal data are commonly fused into latent representations that improve downstream task performance but are not interpretable, limiting their application in domains that require explainable model decisions. Vision-language alignment has made image embeddings interpretable through language, but requires vast image-caption training data. However, captioned data are typically not available for multimodal embeddings, as relevant features cannot directly be observed and annotated from embeddings alone. Here, we propose a framework to language-align any embedding space that can be linked to interpretable auxiliary data. Captioning functions convert auxiliary data into partial captions; a soft contrastive loss weights pairs by the similarity of their properties that each caption describes; and a rank-based concept retrieval task evaluates alignment against the auxiliary data rather than the captions. We apply this framework to multimodal Earth embeddings to facilitate explainable predictions for two species distribution modelling tasks: S2BMS and SatBird. AlphaEarth embeddings beat previous state-of-the-art models on 6/7 metrics, while our framework language-aligns domain-specific concepts of the embedding space, outperforming previous Earth observation vision-language models on average concept retrieval for both datasets. Finally, aligned concepts recover species-habitat associations ($ρ$=0.44) and relate habitat descriptions to species predictions, showing that abstract embeddings can be interrogated in the language of domain experts.

[126] Batched Contextual Reinforcement II: Does RLVR Need Long Rollout Windows? cs.LG | cs.AI | cs.CLPDF

Bangji Yang, Hongbo Ma, Ruihan Guo, Jiajun Fan, Xi Zhu

TL;DR: CCR把多个可验证数学题打包进有上限的单次训练完成结果，让已完成答案保留奖励，从而在短rollout窗口下大幅降低RLVR每步token成本。

Details

Motivation: 可验证奖励强化学习常依赖长rollout窗口，成本高；直接缩短单题窗口可能让所有回答都在出答案前截断，导致组内相对准确率优势消失。

Result: 延续批量上下文强化学习工作，CCR在一个有上限的训练完成中放入三个可独立验证问题。截断前已完成的正确答案仍获得奖励，共享预算鼓励精简有效推理，无需单独长度惩罚。作者从条件奖励及更新方差角度分析该机制，并训练4B和8B数学推理模型。与32K窗口的单题GRPO相比，8,000 token窗口的CCR将每步训练token从975,464降至174,957（4B），从793,832降至165,788（8B），分别节约82.1%和79.1%。8B训练轨迹显示准确率奖励上升而生成变短；单题评测也支持推理质量保持。

Insight: 重构奖励信号而非一味增加上下文长度，可使较短rollout仍提供有效正确性监督。摘要没有列出各任务绝对准确率和长短窗口的系统比较，节省比例针对指定模型及训练设置。

Abstract: Long rollout windows make reinforcement learning with verifiable rewards (RLVR) expensive, yet simply shortening them can remove the correctness signal: when every single-problem rollout truncates before an answer, group-relative accuracy advantages vanish. As a technical continuation of Batched Contextual Reinforcement (BCR), we study how concurrent rewards relax this dependence on long windows. Concurrent Constraint Reinforcement (CCR) places three independently verifiable problems in one capped training completion. Correct answers completed before truncation retain credit, while a shared budget encourages shorter useful reasoning without an explicit length penalty. We connect this mechanism to conditional reward- and update-variance analyses and study 4B and 8B mathematical reasoning models. Against single-problem GRPO with a 32k window, CCR with an 8,000-token window reduces tokens per training step from 975,464 to 174,957 on 4B and from 793,832 to 165,788 on 8B, saving 82.1% and 79.1%, respectively. An 8B training trace shows increasing accuracy reward alongside shorter completions. Single-problem evaluations provide supporting evidence of retained reasoning quality. These results identify reward-preserving training structure as a practical route to lower per-step cost in short-window RLVR.

[127] LED: Improving Masked Diffusion Language Models by Lookahead Editing cs.LG | cs.CLPDF

Yuyan Zhou, Zeyuan Yang, Yuxuan Song, Zhicheng Cai, Hongli Yu

TL;DR: Lookahead Editing为掩码扩散语言模型加入可改写的提议状态，让模型在提交token前迭代细化未来预测，提升表达能力且保留掩码式转移流程。

Details

Motivation: 掩码扩散模型的掩码转移日程简单、易优化，但计算表达能力较低；均匀扩散模型能反复修改中间状态、表达能力更强，却更难训练。研究希望在不放弃掩码模型易优化性的同时获得迭代修订能力。

Result: LED在掩码扩散解码中增加可改写提议状态：每一步先对未来预测执行多次前瞻更新并细化，再将token提交到掩码序列。方法用额外计算提高表达能力，同时维持简单掩码转移。作者微调Qwen2.5-7B和Qwen3-8B得到LED-7B与LED-8B。在八个基准上，LED监督微调相较标准掩码扩散SFT平均分别提高11.4和7.7分；仅使用监督微调的LED-8B超过经过持续预训练、监督微调和强化学习的LLaDA2.1-16B Q-mode。

Insight: 可改写中间提议状态补足掩码扩散的迭代表达能力，但需额外前瞻计算。摘要没有给出解码token数、每个基准分数和计算开销，因此性能比较不能直接推出整体推理成本更低。

Abstract: Diffusion large language models (dLLMs) have emerged as a promising alternative to autoregressive language models, enabling non-autoregressive text generation through parallel decoding. Existing dLLMs can be broadly categorized into two families: masked diffusion models (MDMs) and uniform diffusion models (UDMs) In this work, we theoretically show that MDMs are easier to optimize due to their mask-based transition schedule but have lower computational expressivity, whereas UDMs enable iterative state revision and greater expressivity but are substantially harder to train. This trade-off raises a natural question: can we obtain the expressivity of iterative revision without giving up the simple, easy-to-optimize transition schedule of MDMs? Motivated by this analysis, we propose Lookahead Editing (\ours{}), which augments masked diffusion decoding with a rewritable proposal state. At each decoding step, the model performs several lookahead updates to iteratively refine future predictions in this proposal state before committing tokens to the masked sequence. This design introduces a rewritable proposal that uses additional compute to improve expressivity while keeping the simple mask-based transition schedule of MDMs. We fine-tune Qwen2.5-7B and Qwen3-8B to obtain LED-\texttt{7B} and LED-\texttt{8B}, respectively. Across eight benchmarks, LED SFT yields average gains of $+11.4$ and $+7.7$ points over standard MDM SFT. Moreover, using SFT alone, LED-\texttt{8B} outperforms LLaDA2.1-16B Q-mode, which is trained with continued pre-training, supervised fine-tuning, and reinforcement learning.

[128] Tree-Aware Posterior Distillation for Long-Horizon Agentic Reinforcement Learning cs.LG | cs.AI | cs.CLPDF

Heming Zou, Qi Wang, Yixiu Mao, Yun Qu, Yuyi Guo

TL;DR: TreeOPSD把长时程智能体交互构成树状分支，通过终端奖励回传隐式回合信用，并将其转成有界教师分布进行后验自蒸馏。

Details

Motivation: 长时程强化学习只用终端奖励会导致回合级信用稀疏且方差高；固定rollout批次上顺序更新又会使当前策略偏离生成样本的行为策略，产生策略陈旧和更新过冲。既有方法需额外价值网络、步骤标注或更强外部教师。

Result: TreeOPSD将每轮交互视为树节点，从共享前缀分叉探索不同后续，并递归将终端奖励回传为隐式回合信用。每个信用被映射到由相对冻结行为策略似然比参数化的闭式有界教师分布；学生最小化与该教师分布的差异，在行为策略处切向恢复策略梯度方向，同时将顺序小批次更新约束到有限目标。多个基准和模型规模上的实验显示智能体能力提高，长时程任务尤为明显；例如Qwen3-30B-A3B-Thinking-2507在Deep Research上的平均准确率比GRPO高4.97分。

Insight: 树状分支可从共享状态构造更密集的过程信用，有界教师目标则针对固定rollout顺序更新过冲。摘要未列出其余基准结果、额外分支采样开销和与其他信用分配方法的全面比较。

Abstract: Reinforcement learning with verifiable rewards has become a scalable post-training paradigm for large language models. However, training agents over long-horizon interactions presents two challenges: using only terminal rewards makes turn-level credit assignment sparse and high-variance, while sequential mini-batch updates on a fixed rollout batch introduce policy staleness as the current policy drifts from the behavior policy. Existing approaches obtain denser credit via learned critics, process reward models, or on-policy distillation, but they rely on a value network, step-level annotations, or a stronger external teacher that increase training complexity. Meanwhile, importance sampling and clipping mitigate policy drift, but they do not specify a finite target that stops sequential updates from overshooting. In this work, we introduce TreeOPSD, a critic-free, tree-aware posterior self-distillation framework for long-horizon agentic reinforcement learning. Treating each interaction turn as a tree node, TreeOPSD branches alternative continuations from shared prefixes and recursively backs up terminal rewards into implicit turn-level credit. It then maps each credit to a closed-form, bounded teacher distribution parameterized by the likelihood ratio relative to the frozen behavior policy. Minimizing the divergence between this teacher and the student policy recovers the policy-gradient direction as the tangent at the behavior policy while bounding updates toward a finite target across sequential mini-batches. Empirically, TreeOPSD improves agentic capabilities across several competitive benchmarks and model scales, especially for long-horizon tasks, e.g., raising the average accuracy of Qwen3-30B-A3B-Thinking-2507 by 4.97 points over GRPO on the Deep Research setting.

cs.RO [Back]

[129] Has GPT-6-Astra Achieved Embodied Intelligence? cs.RO | cs.CV | cs.LG | cs.MMPDF

SenseNova, Joint Research Team, :, Zhongang Cai, Ziang Cao

TL;DR: 该报告在12个代表性基准和8种真实机器人配置上评估GPT-6-Astra具身能力，认为其展现广泛操作与导航能力，但距离实用具身智能仍有部署差距。

Details

Motivation: 通用多模态大模型的机器人操作和导航能力已挑战单任务、单具身专用模型范式，但基准中的提示学习表现能否迁移到真实机器人，以及高层推理和低层控制如何配合，仍需系统分析。

Result: 作者在桌面操作、人形机器人、移动平台和灵巧手共12个基准上，用训练示范进行上下文学习并显著增加执行步数，报告GPT-6-Astra取得此前未有的性能。研究指出，GPT-6-Astra作为高层System 2推理器与π0.5等低层System 1控制器闭环协调成本较高但有效。8种机器人配置的真实部署揭示示范采集昂贵，且受物理约束限制，不能简单通过延长执行时间换取更高成功率。作者还提出一种基准原型：任务来自现实需求、不提供域内示范，并用在智能体思考期间持续运行的世界时钟评估。

Insight: 报告将基准能力与真实机器人实用性区分，结论认为GPT-6-Astra基本达到具身能力门槛，但尚未达到实用具身智能。摘要未给出12个基准及8种机器人上的具体成绩，且结果依赖示范、执行步数和控制器协同方式。

Abstract: GPT-6-Astra demonstrates a level of competence in robotic manipulation and navigation that challenges the conventional paradigm of building specialized models for individual tasks and embodiments. In this report, we ask not only how capable GPT-6-Astra is, but what its capabilities imply for the field. First, we probe the limits of standalone GPT-6-Astra. We conduct a large-scale evaluation across 12 representative benchmarks spanning tabletop manipulation, humanoids, mobile platforms, and dexterous hands. Under a unified protocol that allows in-context learning (ICL) from training-set demonstrations and substantially increases the number of execution steps, GPT-6-Astra achieves unprecedented performance (Fig. 1). Future research may focus on improving 1) the generality of ICL 2) cost and execution time, 3) physical-state verification, 4) recovery from irreversible failures, and 5) long-horizon preservation of progress. Second, we study the agentic harness for embodied control. We identify that close-loop coordination between a high-level “System 2” reasoner (i.e., GPT-6-Astra) and a low-level “System 1” controller (e.g., π0.5) is costly but effective. Third, we examine GPT-6-Astra on real-world deployment. Our experiments on 8 robot configurations reveal substantial gaps: 1) robot demonstrations required for ICL are expensive to collect, and 2) it is implausible to trade longer execution for higher success rates with physical constraints. Fourth, we envision the next generation of embodied benchmarks. We develop a prototype that 1) derives tasks from real-world needs, 2) provides no in-domain demonstrations, and 3) judges agents on a world clock that keeps running while they deliberate. Taken together, our results suggest that GPT-6-Astra has largely crossed the threshold of embodied competence, but not yet that of practical embodied intelligence.

[130] MambaAct: Efficient Mamba Action Experts for Flow-Matching Vision-Language-Action Models cs.RO | cs.CVPDF

Khuyen Pham, Tran Nguyen Le, Edoardo Fazzari, Cesare Stefanini

TL;DR: MambaAct用紧凑Mamba模块替代流匹配视觉语言动作模型中的Transformer动作专家，将动作专家缩小10倍并降低推理延迟。

Details

Motivation: 视觉语言动作模型在机器人操作任务上潜力强，但流匹配策略需要在迭代去噪中反复调用动作专家，造成实时控制推理成本过高。

Result: MambaAct保留π0.5的预训练视觉语言前缀编码器，以Mamba动作专家替换Transformer动作专家，由其建模连续噪声动作序列依赖。轻量上下文压缩器将视觉语言前缀token映射成紧凑条件信号，用于门控和调制各Mamba动作块，避免重复token级跨注意力。动作专家规模缩小10倍；流匹配去噪延迟在LIBERO降低64.8%，真实部署降低58.8%。三个独立微调随机种子下，LIBERO平均成功率提高1.08个百分点，并在LIBERO-Plus和真实机器人基准保持收益。

Insight: 降低反复调用的动作模块成本可提升流匹配VLA的部署效率，同时保留大模型视觉语言条件。摘要未给出总参数量、真实部署延迟绝对值及不同任务成功率，报告的成功率增益幅度较小，需结合方差解读。

Abstract: Vision-language-action (VLA) models have shown strong promise for generalist robotic manipulation, but their inference cost remains a major bottleneck for real-time control. This limitation is especially pronounced in flow-matching VLAs such as $π_{0.5}$, where the action expert is evaluated repeatedly during iterative denoising. We introduce MambaAct, an efficient Mamba action expert for flow-matching VLA policies. MambaAct retains the pretrained visual-language prefix encoder of $π_{0.5}$, while replacing its transformer-based action expert with a compact Mamba-based action expert. Within this expert, Mamba serves as the action mixer that models dependencies across the noisy continuous-action sequence. To preserve visual-language conditioning without repeated token-level cross-attention, MambaAct uses a lightweight Context Compressor to map Vision-language model (VLM) prefix tokens into a compact conditioning signal that gates and modulates each Mamba action block. MambaAct uses a $10\times$ smaller action expert and reduces flow-matching denoising latency by $64.8%$ on LIBERO and $58.8%$ in real-world deployment, while improving mean LIBERO success by $1.08$ percentage points across three independent fine-tuning seeds and maintaining gains on LIBERO-Plus and real-world benchmarks. Our code and model weights are publicly available at https://github.com/giakhuyendihoc/MambaAct.

cs.SD [Back]

[131] VocalGrad: Evaluating Acoustic Perception in Audio Language Models cs.SD | cs.CLPDF

Koki Ryu, Hitomi Yanaka

TL;DR: VocalGrad用时间变化方向的二分类任务测量音频语言模型的低层声学感知，发现模型接近随机水平，并定位到信息未被利用或跨层逐渐不可解码两类故障。

Details

Motivation: 大型音频语言模型已处理情绪等副语言和非语言任务，但当声学线索与口语内容共现时，仍难稳定利用声学信息。现有基准未能清楚区分低层声学感知与高层语义推理，难以定位失误来源。

Result: VocalGrad通过判断声学变化方向的简单二分类任务，尽量减少高层推理和语义理解的影响。基准结果显示，人工标注者准确率较高，而先进音频语言模型接近随机水平。线性探针分析揭示两类瓶颈：部分类别所需信息仍保留在内部表示中，但语言模型输出头未能利用；另一些类别中，相关信息随着网络层加深逐渐不再线性可解码。

Insight: 低层声学变化感知可能独立于文本输出中看见的语义能力，单靠问答错误难以诊断。摘要没有给出任务类别、具体模型和准确率，接近随机的结论仅限于受控测试。

Abstract: Recent large audio language models (LALMs) have extended their capabilities beyond lexical speech understanding to tasks requiring paralinguistic and non-linguistic audio understanding, such as emotion recognition. However, these models still struggle to reliably utilize acoustic information, particularly when it co-occurs with spoken linguistic content. Existing benchmarks do not clearly distinguish acoustic perception from higher-level reasoning, making it difficult to identify the source of these failures. To address this issue, we introduce VocalGrad, a benchmark designed to evaluate LALMs’ ability to perceive low-level acoustic variations. VocalGrad formulates this problem as a simple binary classification of temporal change direction, enabling evaluation largely independent of higher-level reasoning or semantic understanding. Our benchmark results reveal a substantial gap in acoustic perception between human annotators and state-of-the-art LALMs: while human annotators achieve high accuracy, LALMs perform at near-chance levels. We further conduct linear probing to identify structural bottlenecks in these models. Our analysis reveals two distinct failure modes: for some categories, task-relevant information is preserved in internal representations but not utilized by the language model head; for others, the information becomes progressively less linearly decodable across model layers. Overall, our results reveal substantial limitations of LALMs in modeling acoustic variation under controlled settings and expose representation differences not observable from text outputs.

eess.IV [Back]

[132] TransNSNet: A Transformer-Enhanced Multi-Scale Adversarial Framework for CT-to-PET Image Synthesis eess.IV | cs.CVPDF

Shaojun Li, Xiaoyu Deng, Ikuo Keshi

TL;DR: TransNSNet通过多尺度粗到细监督和带上下文交互的对抗判别器生成PET样式CT图像，取得较好的影像质量趋势，但现有结果未证明统计显著优势或临床有效性。

Details

Motivation: CT到PET合成可提供代谢影像的近似信息，但评估需要严格患者划分及多种图像和患者级指标。单次训练结果或小样本统计不足以支持临床替代结论。

Result: 作者从公开非小细胞肺癌放射基因组数据筛选、切片匹配和预处理，建立患者级训练—测试划分的配对CT-PET数据。TransNSNet在多个空间尺度生成PET样式预测，并进行由粗到细重建监督；TransPatchGAN为对抗评估加入上下文特征交互。渐进消融比较Pix2Pix、NSNet-Base、NSNet-D和TransNSNet，图像级结果取单次训练第80–101轮固定收敛窗口。TransNSNet在十项指标中九项均值最高，但视觉显著性诱导指标由NSNet-Base领先。高强度区域分析中NSNet-D在切片级召回和平衡准确率略高，患者级等权值近似；最高Dice转为TransNSNet。差异相较患者间变异较小，另一个10人自适应患者级分析经Holm校正后无成对显著差异。TransNSNet参数量也明显小于原始next-scale模型。

Insight: 结果支持影像质量改善趋势，但统计分析未证明显著优越性或临床有效性；合成PET样式图不能替代临床采集PET。摘要中的单次训练、10人分析限制了对可重复性和患者级收益的判断。

Abstract: This study investigates CT-to-PET image synthesis using TransNSNet, a Transformer-enhanced multi-scale adversarial framework. A paired CT-PET dataset was curated from the public non-small cell lung cancer (NSCLC) Radiogenomics collection through patient screening, slice-level matching, preprocessing, and patient-level train-test separation. The proposed framework generates PET-like predictions at multiple spatial scales and applies coarse-to-fine reconstruction supervision, while TransPatchGAN introduces contextual feature interaction into adversarial evaluation. A progressive ablation study compares Pix2Pix, NSNet-Base, NSNet-D, and TransNSNet. Image-level performance was summarized over a fixed convergence window (epochs 80-101) from one training run per model. TransNSNet achieved the best mean value in nine of ten metrics, whereas NSNet-Base achieved the highest visual saliency-induced index. For fixed-fraction high-intensity regions, NSNet-D was marginally higher in slice-level recall and balanced accuracy, but the equal-weight patient-level values were nearly identical and the highest Dice values shifted to TransNSNet. These differences were small relative to between-patient variability. In the separate adaptive patient-level analysis (n=10), no pairwise model difference remained statistically significant after Holm correction. TransNSNet also had a substantially smaller parameter footprint than the original next-scale models. These findings indicate promising image-quality trends, but they do not establish statistical superiority or clinical validity; synthesized PET-like images should not be interpreted as substitutes for clinically acquired PET.

q-bio.NC [Back]

[133] Alignment of visual brain encoding models with individual perceptual similarity judgments q-bio.NC | cs.CVPDF

Daniel Chong, Haomiao Chen, Keith W Jamison, Raja Marjieh, Ilia Sucholutsky

TL;DR: 该研究用个体化人类相似性判断微调视觉脑编码模型，发现个体化感知相似度监督比通用群体监督更能对齐模型表征与人类判断。

Details

Motivation: 传统视觉脑编码模型主要通过预测图像诱发的脑活动训练，但内部表征未必反映个体实际感知相似性。研究探索能否把人类相似度判断用于个性化脑编码模型。

Result: 作者使用Natural Scenes Dataset中8名参与者对100张图像的相似性判断，为每位参与者单独适配通用DreamSim模型，得到个体化感知相似性模型，并在各自脑编码训练集上建立个体相似结构。两种条件使用相同初始化和目标，分别以群体通用或个体化相似性微调基线脑编码器。基线编码器反映个体内感知相似性的程度甚至高于测得fMRI响应，但未反映人类相似性判断中的个体间相关结构；加入通用群体监督后，对人类判断的对齐改善，却仍未复现个体间相关性。个体化相似性监督模型最贴近个人判断，并能反映人类判断中的个体间相关结构。

Insight: 将少量个体化行为判断蒸馏进脑编码模型，可能构建更贴近个人感知的视觉表征。摘要样本仅8人、100张图像，个性化模型的稳定性与对更多刺激和参与者的泛化尚需进一步验证。

Abstract: Encoding models that predict brain activation responses to images have traditionally been trained to maximize accuracy when predicting observed brain data. However, their internal representations may not reflect individual human perception. In this work, we investigate whether we can fine-tune brain encoding models to better align their representations with individuals’ similarity judgments. Using similarity judgments of 100 images from 8 participants in the Natural Scenes Dataset (NSD), we adapt a generic human similarity judgment model (DreamSim) separately for each participant to obtain personalized perceptual similarity models. These models are then used to obtain subject-specific similarity structure across images in their encoding model training sets. We fine-tune each participant’s baseline encoder in two conditions, aligning its representations with either generic or personalized similarity judgments, with the same initialization and objective. We find that baseline brain encoders reflect within-subject perceptual similarity more strongly than measured fMRI responses and preserve intersubject correlations present in measured fMRI, but fail to reflect those of human perceptual similarity judgments. Fine-tuning with generic, population-level perceptual similarity information results in better alignment with human judgments than baseline encoders, but these models still fail to capture intersubject correlations of human judgments. However, fine-tuning with personalized perceptual similarity information results in models that are the most aligned with human perceptual similarity judgments and also reflect intersubject correlations of human judgments. Our framework provides an approach for bootstrapping human similarity judgment data into more individualized, human-aligned brain encoding models of vision.

stat.ML [Back]

[134] Is a Linear Probe Evidence of a Linear Representation? stat.ML | cs.CV | cs.LGPDF

Nadir Kutluozen, Christian Internò, David Klindt

TL;DR: 该研究指出线性探针高准确率不足以证明视觉表征具有主导性的线性生成因子，并提出反向可预测性、谱集中度和分布外泛化三种诊断。

Details

Motivation: 线性表征假说认为预训练视觉模型把生成因子编码为特征空间中线性可解码方向，常见做法是训练线性探针并以高准确率认定因子已表征。该检验可能过于宽松，无法区分真正线性结构与复杂非线性表征上的简单读出。

Result: 作者说明，渐近条件下足够丰富的特征映射（甚至随机映射）也能容纳线性读出；因此相同探针成绩可能对应两种几何：潜变量对齐子空间占主导的线性世界模型，或潜变量线性嵌在更大曲面流形中的核机器。曲面结构还可能影响分布外泛化、鲁棒性和组合迁移。研究提出三种非对称诊断，并在已知真值的全观测模拟中验证；将方法用于SVG-World上的六个预训练视觉Transformer及CelebA上的两个模型，发现预训练确实产生超过随机核的结构，但远未达到线性世界模型。dSprites、3D Shapes和MPI3D分析也显示正向可解码性与潜变量对齐方差可分离。

Insight: 探针能解码某属性，不代表该属性对应表征的主要、低维几何方向；评估应加入反向预测、谱结构和域外测试。摘要未列出三种诊断的定义公式与阈值，不能仅凭正向准确率推断模型的生成机制。

Abstract: The linear representation hypothesis holds that pretrained vision models encode generative factors as linearly decodable directions in feature space, and comes with a standard methodology: train a linear probe, declare a factor represented if accuracy is high. We show this test is too permissive. Asymptotically, any sufficiently rich feature map, including a random one, admits a linear readout, so high probe accuracy is consistent with two very different geometries: a true linear world model, where the latent-aligned subspace dominates the representation, or a kernel machine, where the latents lie linearly inside a much larger curved manifold. This distinction matters because the curved structure orthogonal to the probe is relevant for out-of-distribution generalization, robustness, and compositional transfer. We propose three asymmetric diagnostics that distinguish the two cases: reverse predictivity, spectral concentration, and out-of-distribution generalization. We validate them in a fully observed simulation where ground truth is known. Applied to six pretrained vision transformers on SVG-World, our deterministic generative benchmark with paired visual styles, and to two of them on CelebA, they show pretraining produces structure beyond a random kernel but well short of a linear world model. On dSprites, 3D Shapes and MPI3D, forward decodability and latent-aligned variance dissociate. Thus, forward decoding alone does not show that the probed factors align with the dominant geometry of the representation. In summary, our work cautions about the success of linear probes as opposed to truly linear and low dimensional representations.

Table of Contents

cs.CL [Back]

[1] alkhder at ImageEval 2026 Shared Tasks: Constrained Selection and Rotation-Averaged Logit Scoring for Multimodal Hallucination Detection cs.CLPDF

[2] RealCLI: Toward a Unified Evaluation of Human-Agent Collaboration for CLI Agents cs.CLPDF

[3] A Plausible Explanation Is Enough to Mislead Multimodal Judges cs.CL | cs.AIPDF

[4] ProPerAgent: Toward Memory-Driven Proactive Assistance cs.CLPDF

[5] Multimodal Filesystem Memory For Long-Horizon Embodied Agents cs.CLPDF

[6] Explore Separately, Adopt Selectively: Execution-Guided Tool Use over Large Tool Libraries cs.CL | cs.AIPDF

[7] ARBOR: Locating Reasoning Failures in Long Chains of Thought through Reasoning State Tracking cs.CL | cs.AIPDF

[8] Self-Evolving Coding Agents via Harness-Policy Optimization cs.CL | cs.AIPDF

[9] On the Position Bias of Large Language Models: A Comprehensive Study cs.CLPDF

[10] Causal Edit Serialization cs.CL | cs.LGPDF

[11] The Reliance Hypothesis: Chain-of-Thought Faithfulness Rises as Language Resource Level Falls cs.CL | cs.AIPDF

[12] Uncertainty-Aware Budget Allocation for Efficient LLM Tree Search cs.CL | cs.AIPDF

[13] NLData2Opt: Benchmarking Parameter Derivation and Prediction for Modeling Optimization Problems from Natural Language and Data cs.CLPDF

[14] Bengali Hallucination Detection with Retrieval and Programs: A System Study cs.CLPDF

[15] Competence-Based Evaluation of Logical Reasoning in Large Language Models cs.CL | cs.AI | cs.LGPDF

[16] FederatedBytes: Tokenizer-Free, Byte-Level Small Language Models for Efficient Multimodal Federated Learning cs.CL | cs.DC | cs.LGPDF

[17] Many Biases, One Circuit: Post-Training Tunes a Pretrained Cue-Routing Mechanism cs.CL | cs.AI | cs.LGPDF

[18] Aligning Language Models Towards Counterfactual Invariance cs.CL | cs.AI | cs.LGPDF

[19] Recognizing Atari and Assessing Sente: Controlled Evaluation Tasks for Language-Based Go Agents cs.CLPDF

[20] Prism Attention: Proposal-Refined Index Sharing Mechanism for Efficient LLMs Inference cs.CL | cs.AIPDF

[21] Before Retrieval Begins: Safety and Tool-Use Decisions in LLM Agents cs.CLPDF

[22] MultiAgent-OPD: End-to-End Training of Hierarchical Multi-Agent Systems with On-Policy Distillation cs.CLPDF

[23] MGE-PO: Entropy-Aware Credit Assignment for Mathematical Reasoning cs.CL | cs.AIPDF

[24] Who Pays for Efficient Inference? Confidence-Based Small-to-Large LLM Routing Across Tasks and Languages cs.CLPDF

[25] Think More or Read More? A Token-Budget Theory of Reasoning with Shared Context cs.CL | cs.LGPDF

[26] Verbalising Model’s Computation for Chain-of-Thought Faithfulness Detection cs.CLPDF

[27] Language Models Learn to Improve Language Models cs.CL | cs.AIPDF

[28] On the Tip of the Tongue: First-Token Cueing as a Behavioral Probe of Recall Failures in LLMs cs.CLPDF

[29] HydraLLM: Adaptive Width Slicing for Elastic Text and Vision-Language Models cs.CL | cs.LGPDF

[30] Perceive, Solve, Reason: Progressive Capability Formation in Time Series-LLMs cs.CLPDF

[31] ConvexLLM: Scaling Convex-Hull Speech Interfaces to General-Purpose Audio Intelligence cs.CL | cs.SD | eess.ASPDF

[32] Acceptance Is Not Speed: Length Inflation in Training-Free Lossy Speculative Decoding cs.CLPDF

[33] Beyond the Answer: Student-Conditioned Trace Construction for Reasoning Distillation cs.CL | cs.LGPDF

[34] DiscoveryRSI: Recursively Learning to Discover Valuable Hypotheses cs.CLPDF

cs.CV [Back]

[35] Star Light, Star Bright: Can Multimodal Models Parse an Astronomy Visual Question Answering Dataset Right? cs.CV | astro-ph.IM | cs.DL | cs.IRPDF

[36] Event-STVG: Spatio-Temporal Video Grounding for Long-Form Event Reasoning cs.CVPDF

[37] JAVIS: Joint Audio-Visual Interaction and Streaming for Real-Time Conversational Agents cs.CV | eess.ASPDF

[38] KFS$^4$LAM: Adaptive KeyFrame Selection with Structure-Aware Mapping for Endoscopic Gaussian Splatting SLAM cs.CVPDF

[39] TriSAR-3D and PaintFusion: A Novel Trimodal LiDAR-RGB-Thermal Dataset and Method for 3D Person Detection in Search and Rescue cs.CV | cs.ROPDF

[40] Towards Reconstructing Geographically Diverse Architecture with 3D Foundation Models cs.CV | cs.LGPDF

[41] Learning the Shared Latent Structure of Cryo-EM Inverse Problems cs.CV | cs.LG | q-bio.QMPDF

[42] CFC26: Building Evaluations for Deployment in Sonar-Based Fish Counting cs.CVPDF

[43] Seeing Seizures: A Large-Scale Empirical Study of Video and EEG Deep Learning for Automated Rodent Seizure Detection and Severity Grading cs.CVPDF

[44] Stuck on Shuffle: On Attribute-Object Binding in Vision-Language Models cs.CVPDF

[45] ProactGen: Learning Proactive Clarification for Video Generation cs.CVPDF

[46] EgoP$^{2}$C: Internalizing Plan-Perceive-Compose for Spatial Reasoning in Egocentric Video cs.CVPDF

[47] Shift-Reliance Alignment: Ranking Vision-Language Models by the Cues They Trust cs.CV | cs.LGPDF

[48] Thinking from Above: Efficient Spatial Reasoning with Bird’s-Eye-View Visual Tokens cs.CVPDF

[49] MedSTP: Preserving Subspace and Transition Evidence for Medical VQA Token Pruning cs.CVPDF

[50] OmniXRef: A Unified Framework for Multimodal Multi-Reference Video Editing cs.CVPDF

[51] STRIDE: Evaluating Spatiotemporal Reasoning in Driving Edge Cases cs.CV | cs.AIPDF

[52] VISTA: A Multimodal Egocentric Benchmark for Goal-Oriented Perception and Assistance to Blind and Low-Vision Users cs.CVPDF

[53] Variational and Decomposed method for Mitigating Bimodal Bias in Robust Visual Question Answering cs.CVPDF

[54] HAPACT: A Benchmark For Human-Centric Physical Impact Localization in Movies cs.CV | cs.AIPDF

[55] VTrajEmbed: Aligning Text with Video Object Trajectories via Spatiotemporal Embeddings cs.CVPDF

[56] MaskMerge: Structure-aware Token Merging for Efficient Instance Segmentation cs.CVPDF

[57] COMET: Decoupled Distillation, Routing, and Capacity Control for Task-Agnostic Continual Vision–Language Learning cs.CV | cs.AIPDF

[58] ODSS-Net: Orthogonally Decoupled Shared-Specific Representations for Multi-Modal Object Re-Identification cs.CVPDF

[59] DICL-Qwen3VL: Decoupled Confidence Calibration for Interpretable Workwear Detection cs.CVPDF

[60] ANCHOR: Audio-Visually Grounded Chain-of-Thought Reasoning Benchmark cs.CVPDF

[61] Query-adaptive Recurrent Tokenization cs.CVPDF

[62] Sink-Sparse Hybrid Attention for Efficient Inference in T2I/T2V Diffusion Transformers cs.CVPDF

[63] How Murky Before a VLM Knows It Cannot See? Accuracy, Confidence and Abstention on a Physical Visibility Axis cs.CV | cs.LGPDF

[64] UniField++: A Unified Agentic Framework with Loop Reasoning for MRI Field-Strength Enhancement cs.CVPDF

[65] A100: A Hybrid Vision Foundation Model for Agricultural Plant Image Analysis cs.CVPDF

[66] Semantic-Critical Regions for Video-to-Audio Generation cs.CV | cs.MM | cs.SD | eess.ASPDF

[67] Scene-Designer: Learning Design Intelligence for Agentic 3D Scene Generation cs.CVPDF

[68] Reliability-Consistent Appearance Modeling for RGB-Infrared Multi-Object Tracking cs.CVPDF

[69] From GAN-Based Models to GPT-5: A Taxonomy-Guided Study of Human Performance in Detecting Deepfake Face Images cs.CV | cs.CR | cs.HCPDF

[70] Knowledge-Guided Distributional Prompt Learning with Visual Hierarchy for Zero-Shot Anomaly Detection cs.CVPDF

[71] MLLM Frame Subset Ensembling for Audio-Visual Video QA and MLLM-based Reranking for Ad-hoc Video Search in TRECVID 2025 cs.CVPDF

[72] X-Splat: Unified Gaussian Splatting for Joint RGB and X-ray 3D Reconstruction cs.CV | cs.GRPDF

[73] Can the Parts Fool the Test? Counterfactual Pairing Cycles for Relational OOD cs.CV | cs.LGPDF

[74] RAP: A Dataset for Paper-to-Poster Generation via Declarative Markup from Human-Crafted Exemplars cs.CVPDF

[75] Xiaomi-Lens-0 Technical Report cs.CVPDF

[76] LonGaussian: Tracking Foundation Priors for Long-Context Feedforward Gaussian Reconstruction cs.CVPDF

[77] I2V-DETACH: Source Grounding Detachment for Unauthorized Image-to-Video Generation cs.CVPDF