cs.CL [Total: 30]
cs.CV [Total: 62]
q-bio.QM [Total: 1]
cs.IR [Total: 1]
cs.AI [Total: 12]
cs.RO [Total: 3]
cs.HC [Total: 1]
cs.CY [Total: 1]
cs.LG [Total: 6]

cs.CL [Back]

[1] UniSAGE: Unifying Static and Dynamic Attributes with Hyper-Structure cs.CLPDF

Taoran Fang, Yan Deng, Chunping Wang, Yang Wang, Lei Chen

TL;DR: 本文提出UniSAGE，一个用于统一建模静态属性和动态记录数据的通用框架。它通过构建全局属性图来统一表示层次和时间关系，并引入正交参数子空间和超结构机制来捕获跨属性依赖。实验表明，该方法在多个基准和真实金融数据集上显著优于现有方法。

Details

Motivation: 现实应用中的层次化信息常结合静态属性和动态记录，现有方法通常依赖人工设计、与特定数据模式紧耦合，且孤立处理静态和动态属性，忽略了它们的隐式交互。

Result: 在多个公共基准和真实世界金融行为数据集上的广泛实验表明，UniSAGE始终优于现有方法，在多个任务上实现了超过10%的性能提升。

Insight: 主要创新点包括：1) 构建统一的全局属性图来建模异构数据；2) 引入正交参数子空间在共享语义空间中联合支持静态聚合和动态推理；3) 通过轻量级超结构机制实现任务特定的静态与动态属性交互。该方法实现了全自动化，并对演进的数据模式具有鲁棒性。

Abstract: With the rapid growth of digital data, real-world applications increasingly involve hierarchical information that combines static attributes with dynamic records. Modeling such heterogeneous data in a unified and generalizable manner remains challenging. Existing approaches often rely on extensive manual design, are tightly coupled to specific data schemas, and typically process static and dynamic attributes in isolation, thereby overlooking their implicit interactions. We propose UniSAGE, a unified framework for modeling data with both static and dynamic attributes. UniSAGE constructs a global attribute graph that represents hierarchical and temporal relationships in a unified structure. To ensure representational consistency, it introduces two orthogonal parameter subspaces that jointly support static aggregation and dynamic reasoning within a shared semantic space. Building on these unified representations, UniSAGE further enables task-specific interaction between static and dynamic attributes via a lightweight hyper-structure mechanism. UniSAGE is fully automated, robust to evolving data schemas, and capable of capturing complex cross-attribute dependencies. Extensive experiments on multiple public benchmarks and a real-world financial behavior dataset demonstrate that UniSAGE consistently outperforms existing methods, achieving performance improvements of over 10% on several tasks.

[2] Just Keep Prompting: Evaluating Repetitive Socratic Prompting in VLMs cs.CL | cs.AI | cs.CVPDF

Shayda Moezzi, Bishoy Galoaa, Lorena Genua, Taskin Padir, Sarah Ostadabbas

TL;DR: 本文提出了’Just Keep Prompting’（JKP）评估框架，用于测试视觉语言模型在多轮对话中面对持续质疑、挑战或反驳时的认知稳定性。该框架包含三种策略，并在STAR基准子集上评估了GPT-4o、Gemini 2.5 Pro和Qwen3-VL-30B模型，发现重复提示会引发显著的答案不稳定现象。

Details

Motivation: 在真实世界部署视觉语言模型时，不仅需要强大的视觉推理能力，还需要模型在持续的对话压力下保持稳定。本文旨在评估模型在面对用户反复挑战其答案时的认知稳定性。

Result: 在STAR基准子集上的720次多轮测试中，从第0轮到第10轮，模型的总体准确率变化不大，但轨迹层面分析揭示了显著的不稳定性：正确答案会退化，错误答案会恢复，许多测试出现了反复的答案翻转。Qwen3-VL-30B最终准确率最高但易在直接反驳下变得自信地错误；Gemini 2.5 Pro相对稳定但token消耗高；GPT-4o最脆弱且振荡。

Insight: 创新点在于提出了一个专门用于评估VLM在多轮对话压力下认知稳定性的框架（JKP），并设计了三种具体的提示策略。客观来看，该研究揭示了多轮评估不仅能测试额外推理能力，更能捕捉模型在视觉基础、校准和对话顺从性之间的权衡压力响应特性，这对于评估模型的实际部署鲁棒性至关重要。

Abstract: Deploying Vision-Language Models (VLMs) in real-world settings requires not only strong visual reasoning but also stability under sustained conversational pressure. We introduce Just Keep Prompting (JKP), a multi-turn evaluation framework that measures VLM epistemic stability when users repeatedly challenge, question, or contradict a model’s answer. JKP probes models for up to 10 follow-up turns using three strategies: Adversarial Negation (repeated rejection), Pure Socratic Interrogation (repeated calls to reassess certainty), and Context-Aware Socratic Summarization (reflecting the model’s prior rationale back before asking for reconsideration). We evaluate GPT-4o, Gemini 2.5 Pro, and Qwen3-VL-30B on a subset of the STAR benchmark across 720 multi-turn runs. Aggregate accuracy changes modestly from Turn 0 to Turn 10, but trajectory-level analysis reveals substantial instability: correct answers regress, wrong answers recover, and many runs exhibit repeated answer flipping. Repeated prompting has bounded upside and often acts as a destabilizer rather than a reasoning aid. The effect is strongly model-dependent: Qwen3-VL-30B achieves the highest final accuracy but becomes confidently wrong under direct contradiction; Gemini 2.5 Pro is comparatively stable but token-expensive; GPT-4o is the most brittle and oscillatory. These findings reveal that multi-turn VLM evaluation captures not just additional reasoning but pressure-response profiles: how models trade off visual grounding, calibration, and conversational compliance under repeated challenge.

[3] Automatically Evolving Prompt Guidelines for Task-Specific Optimization cs.CL | cs.AIPDF

Cedric Richter, Salah Ghamizi, Mike Papadakis

TL;DR: 本文提出了一种名为AGOPS的自动方法，用于为特定任务优化提示指南。该方法通过一个包含提示LLM编写器、求解器LLM和提示演化的优化方案，自动生成任务特定的指南，以帮助用户为给定任务和模型编写更明确的提示。实验表明，在数学推理、医学问答和编码任务中，遵循AGOPS指南可以显著恢复因提示不明确而导致的性能下降。

Details

Motivation: 用户查询通常不够明确，导致大型语言模型（LLM）推断的未陈述假设可能与用户实际意图不一致。现有的提示工程指南通常是通用且与任务无关的，并且是手动非系统化形成的，限制了其实用性。

Result: 在数学推理、医学问答和编码任务上的实验表明，提示不明确会导致下游任务性能大幅下降（高达95.3%），而现有提示优化技术难以恢复这种损失。遵循AGOPS指南的用户可以恢复这种损失，在所有基准测试中平均性能提升15.5%至81.7%。

Insight: 论文的核心创新在于利用现有（已完成的）任务示例（即参考答案）中隐含编码的缺失信息（如行为约束、上下文假设和评估标准），通过自动化的优化方案（AGOPS）来演化生成任务特定的提示指南，从而系统性解决提示不明确问题，而非依赖通用或手动制定的指南。

Abstract: For Large Language Models to reliably answer user queries, users must clearly specify requirements, context, and constraints. In practice, however, user queries are often underspecified, forcing models to infer unstated assumptions that may misalign with the actual user intent. Existing prompt engineering guidelines aim to mitigate this issue, they are typically generic and task-agnostic, limiting their practical utility. Additionally, existing guidelines are formed manually and in a non-systematic way. To this end, we study prompt guideline optimization: the problem of automatically generating task-specific guidelines that help write better-specified prompts for a given task and model. Our key observation is that existing (completed) task examples (aka reference answers) often implicitly encode the missing information required to complete underspecified queries, including behavioral constraints, contextual assumptions, and evaluation criteria. We therefore propose AGOPS, an automatic approach that evolves task-specific guidelines via an optimization scheme that involves a prompt LLM writer, a solver LLM and prompt evolution, which maximize downstream effectiveness on a set of examples (user queries with reference answers). At inference time, our guidelines help users write well-specified prompts, boosting the effectiveness of LLMs. We show across mathematical reasoning, medical question answering, and coding tasks, that prompt underspecification leads to major drops (up to 95.3%) in downstream task performance (compared to well-specified prompts) and, perhaps more importantly, that this drop can hardly be recovered by existing prompt optimization techniques. Users following AGOPS guidelines can regain this loss (increasing performance between 15.5 to 81.7% on average) consistently across all benchmarks.

[4] MAPS: Modeling Co-Existing Subjective Perspectives and Shared Meaning in Multi-Agent Cognitive Dialogue cs.CL | cs.AIPDF

Molood Arman, Clément Bonnafous

TL;DR: 论文提出MAPS（多智能体视角空间）框架，通过领域加权配置文件、基于GRU的动态记忆和可解释的令牌级注意力机制，建模具有不同认知风格的智能体之间的对话。该框架使智能体在保持个性化推理的同时，逐步收敛于共享意义，旨在平衡表达多样性与语义一致性。

Details

Motivation: 当前AI对话系统通常强制语义统一，牺牲了多样性和可解释性，而人类对话涉及信念、情感和主观认知风格的表达。本文旨在解决如何建模共存的个体主观视角与共享意义，以构建更具认知基础、可解释的对话系统。

Result: 在EmpatheticDialogues、TopicalChat和MultiWOZ数据集上的评估表明，MAPS能够在保持主观性的同时支持语义对齐，实现了表达性与连贯性的平衡。

Insight: 创新点在于通过领域加权配置文件、动态记忆和可解释注意力机制，显式建模个体认知差异与共享意义的动态收敛过程，为构建可解释、认知基础的多智能体对话系统提供了新路径。

Abstract: Human dialogue involves more than exchanging information; it also expresses beliefs, emotions, and subjective cognitive styles. Yet current AI dialogue systems often enforce semantic uniformity, sacrificing diversity and interpretability. We present MAPS (Multi-Agent Perspective Spaces), a novel framework that models dialogue between cognitively distinct agents through domain-weighted profiles, dynamic GRU-based memory, and interpretable token-level attention. MAPS enables agents to maintain individualized reasoning while progressively converging on shared meaning. Evaluations on EmpatheticDialogues, TopicalChat, and MultiWOZ show that MAPS supports semantic alignment without collapsing subjectivity. Our results demonstrate a path toward cognitively grounded, interpretable dialogue systems that balance expressiveness and coherence.

[5] Simplicity Paradox: Debunking myths about prompting and datasets for LLM evaluation cs.CL | cs.AIPDF

Inder Preet, Shuxin Lin, Dhaval Patel

TL;DR: 这篇论文通过大规模实证研究，挑战了关于LLM评估中提示工程和数据集复杂性的普遍假设。研究发现，在多项选择题回答任务中，简单的基线提示方法通常优于复杂的推理技术，揭示了所谓的’简单性悖论’。研究还分析了模型性能与效率的权衡、数据集难度差异以及模型改进的潜在空间。

Details

Motivation: 当前LLM评估领域存在一个隐含假设，即更复杂的提示技术能带来更好的性能，但许多研究缺乏全面评估。本文旨在填补这一空白，通过系统性的实证研究来验证不同提示技术在MCQA任务上的实际效果。

Result: 在10个MCQA数据集、27种模型配置和约430,000次评估中，基线提示方法在多个基准测试中持续优于复杂推理技术。仅CoT-Expert和CoT-Inductive方法带来了约3个百分点的微小但显著的提升，而其他复杂技术表现相当或更差（如Self-Analogical方法下降达31个百分点）。研究发现60%的基准测试准确率低于70%，最难与最易数据集间存在47.5个百分点的差距。

Insight: 论文的核心创新在于揭示了’简单性悖论’——在LLM评估中过度复杂的提示工程可能适得其反。研究建议评估社区应更关注真实的模型改进而非提示优化，同时强调了系统化基准测试的重要性，为未来研究提供了数据驱动的决策依据。

Abstract: Probing the capabilities of Large Language Models (LLMs) and building robust solutions for Multiple-Choice Question Answering (MCQA) remain central challenges in natural language understanding. Furthermore, the rapid proliferation of LLMs has created the implicit assumption that more sophisticated prompting techniques yield better performance. Several studies claim better performance with more sophisticated prompting techniques, but do not provide a comprehensive evaluation. We address this gap through a comprehensive empirical study of 8 prompting techniques across 10 multiple-choice question answering (MCQA) datasets, encompassing 27 model configurations and roughly 4,300 unique questions evaluated more than 430,000 times. Our findings reveal a striking paradox that baseline prompting consistently outperforms complex reasoning techniques on various benchmarks. Only minimal expert and inductive role framing (CoT-Expert and CoT-Inductive) yields a small but statistically significant $\sim$3 percentage-point (pp) gain over baseline whereas every other elaborate technique we tested matches or under-performs it, often by large margins (up to 31pp for Self-Analogical). We further investigate three critical phenomena: (1) the unexpected victory of Qwen3-30B-A3B-Thinking-2507 in Elo ratings, (2) the performance-efficiency trade-offs across model variants with different thinking budgets, revealing model-dependent optimal configurations, and (3) the substantial variation in dataset difficulty, with 60% of benchmarks below 70% accuracy and a 47.5pp spread from easiest to hardest, indicating considerable room for model improvement. These results suggest that the LLM evaluation community may be overcomplicating prompt engineering and that substantial performance gaps remain across diverse benchmarks, offering opportunities for genuine model improvements rather than prompt optimization.

[6] ReportMedSAM: Guiding Segmentation Through Radiology Reports cs.CL | cs.AI | cs.CVPDF

Anghong Du, Theodoros N. Arvanitis, Colin Watts, Alejandro F. Frangi, Le Zhang

TL;DR: ReportMedSAM是一个基于放射学报告引导医学图像分割的框架，通过可学习的概念库替代离散提取，利用冻结的BiomedCLIP编码器对齐器官级概念嵌入，并采用MoE模块动态激活任务特定专家，实现对新解剖结构和临床任务的鲁棒扩展。

Details

Motivation: 解决自由形式放射学报告因自然语言变异性难以可靠用于分割的问题，现有方法依赖预定义短语或基于规则的提取，限制了可扩展性和对语言变化的鲁棒性。

Result: 在AbdomenAtlas 3.0数据集上评估，该方法能有效解释自由形式报告，达到有竞争力的分割精度，并展示了对新临床任务的无缝、非干扰性扩展能力。

Insight: 创新点包括使用可学习概念库避免语义崩溃、通过对比学习建立正交语义锚点提高鲁棒性，以及解耦设计支持参数隔离扩展，允许动态添加新概念和专家而无需重新训练现有组件。

Abstract: Free-form radiology reports contain rich clinical descriptions, yet converting them for reliable segmentation remains challenging due to the inherent variability of natural language. Existing pipelines often rely on predefined organ phrases or brittle rule-based inference-time extraction, which limits their scalability to novel anatomical structures and makes them sensitive to linguistic variations. To address this, we propose ReportMedSAM, a report-driven framework that replaces discrete extraction with a learnable concept bank. By leveraging a frozen medical vision-language encoder (BiomedCLIP), we align organ-level concept embeddings with large-scale clinical corpora through contrastive learning, establishing mutually orthogonal semantic anchors. Our approach explicitly mitigates organ-level semantic collapse and ensures high robustness against diverse clinical synonyms (e.g., “renal” vs. “kidney” ). During inference, a clinical report is embedded and matched against this concept bank to dynamically activate task-specific Mixture-of-Experts (MoE) modules. This decoupled design allows new concepts and experts to be added without retraining existing components, providing a parameter-isolated extension mechanism while keeping previously learned experts unchanged. Evaluated on the AbdomenAtlas 3.0 dataset, ReportMedSAM effectively interprets free-form reports, achieves competitive segmentation accuracy, and demonstrates seamless, non-interfering extension to novel clinical tasks.

[7] CoEvoT: Co-Evolving Chain-of-Thought Prompting for Graph-LLM Reasoning cs.CL | cs.AIPDF

Haohua Niu, Xingtong Yu, Yang Liu, Junfeng Fang, Xuanting Xie

TL;DR: 本文提出了一种名为CoEvoT的协同演化思维链提示框架，用于解决图学习中的分布偏移问题。该框架通过将图线性化为提示词，并利用大语言模型进行预测，创新性地将文本到图标记的重写与图到文本的推理指导耦合在一个闭环中，实现了逐步的、状态感知的证据精炼。

Details

Motivation: 解决现有基于思维链的图-LLM方法在生成中间思维时，依赖于固定的图标记，从而限制了结构线索的逐步精炼这一问题。

Result: 在八个数据集上的广泛实验表明，CoEvoT始终优于最先进的基线方法。

Insight: 主要创新点在于提出了一个协同演化的闭环框架，通过轻量级条件网络动态更新图标记证据状态，并将其反馈指导后续LLM推理，实现了推理过程与图结构证据的协同演化，而非在固定图快照上进行推理。

Abstract: Graph learning under distribution shift presents a persistent challenge, where models adapt to new graphs with limited or even no supervision. Recent graph–LLM approaches move toward label-efficient prediction by linearizing graphs into prompts and using large language models (LLMs) as predictors, and can adopt Chain-of-Thought (CoT) prompting to exploit LLM’s multi-step reasoning capability. However, existing CoT-based graph–LLM methods generate intermediate thoughts while conditioning on fixed graph tokens, limiting step-wise refinement of structural cues. In this paper, we propose CoEvoT, a simple yet effective co-evolving CoT prompting framework for graph–LLM reasoning. CoEvoT couples text-to-graph token rewriting and graph-to-text reasoning guidance in a closed loop: each intermediate textual thought is used to update the graph token evidence state via a lightweight condition network, and the updated tokens are fed back into the next-step instruction to guide subsequent LLM reasoning. This enables step-wise, state-aware evidence refinement, rather than reasoning over a fixed graph snapshot. Extensive experiments on eight datasets demonstrate that CoEvoT consistently outperforms state-of-the-art baselines.

[8] Heterogeneous Element-Aware Cross-Version Differencing of Scientific Documents via Layout-Aware Alignment and Structure-Aware Reasoning cs.CL | cs.AIPDF

Zhen Yina, Wenkang An, Hao Wang, Keran You

TL;DR: 本文提出了一种面向科学文档跨版本差异分析的布局感知异构元素感知框架，该框架将文档分解为语义类型元素，通过联合建模空间、内容和结构兼容性的对齐优先机制建立跨版本对应关系，并对对齐的元素对进行类型感知的差异推理。

Details

Motivation: 解决科学文档（包含文本、表格、公式、图形和布局线索等异构元素）跨版本差异分析中，现有基于文本序列的方法丢失布局和结构信息，而基于图像的方法缺乏语义可解释性且对渲染变化敏感的问题。

Result: 在来自期刊生产校对工作流的真实科学PDF数据上的实验表明，该框架在文本、表格、公式和图形的检测F1分数分别达到0.903、0.855、0.862和0.845，在定位、结构感知和匹配质量方面也有进一步提升，优于特定元素基线方法。

Insight: 创新点在于提出了一个统一的、布局感知的异构元素感知框架，通过对齐优先机制和类型感知的差异推理，实现了对科学文档中多种元素类型的统一变化检测、定位和结构分析，为实际编辑生产场景提供了鲁棒且可解释的解决方案。

Abstract: Cross-version differencing of scientific documents is essential in scholarly publishing and technical documentation, but remains challenging because scientific documents are page-structured artifacts containing heterogeneous elements such as text, tables, formulas, figures, and layout cues. Existing text-sequence-based methods often lose layout and structural information, while image-based methods lack semantic interpretability and are sensitive to rendering variation. To address these limitations, this paper proposes a layout-aware heterogeneous element-aware framework for scientific document differencing. The framework decomposes document versions into semantically typed elements, establishes cross-version correspondence through an alignment-first mechanism that jointly models spatial, content, and structural compatibility, and performs type-aware difference reasoning over aligned element pairs. It supports unified change detection, localization, structure-awareness analysis, and alignment/matching evaluation across text, tables, formulas, and figures. Experiments on real-world scientific PDF data from journal production proofreading workflows show that the proposed framework consistently outperforms element-specific baselines. It achieves detection F1 scores of 0.903, 0.855, 0.862, and 0.845 for text, tables, formulas, and figures, respectively, with further improvements in localization, structure awareness, and matching quality. Ablation and sensitivity analyses confirm the effectiveness of cross-version alignment, type-specific representations, structure-aware reasoning, and compatibility-weight design. These results demonstrate that heterogeneous element-aware differencing provides a robust and interpretable solution for scientific document comparison in realistic editorial production scenarios.

[9] Implicit Reasoning Steering via Concept Chaining cs.CLPDF

Xiao Ye, Sanika Chavan, Yuxi Huang, Shahriar Kabir Nahin, Muhao Chen

TL;DR: 这篇论文研究了大型语言模型推理的脆弱性，并提出了一种名为’概念链’的隐式推理引导方法。该方法通过生成连接问题和目标选项的简短段落，并在受害模型上继续预训练，来系统地引导模型的预测，而无需明确的指令或答案提示。研究表明，看似普通的文本可以成为放大潜在偏见、秘密改变模型决策的实用渠道。

Details

Motivation: 动机在于探究大型语言模型推理的脆弱性，即模型在重复采样时对同一问题可能产生正确和错误两种答案。研究旨在验证是否可以利用这种脆弱性，通过自然语言文本隐式地引导模型偏向指定答案，而无需直接指令或触发词。

Result: 实验通过在受害模型上继续预训练概念链生成的连接段落，评估其在原始多项选择题上的答案偏好是否发生偏移。结果表明，间接、看似自然的文本可以系统地引导模型预测，且其可推断性远低于直接释义文本，证实了推理脆弱性并非仅仅是评估假象。

Insight: 创新点在于提出了’概念链’这一隐式推理引导框架，揭示了模型推理脆弱性可被利用作为实际攻击渠道。从客观角度看，该研究强调了LLM决策形成过程中的潜在安全风险，即普通文本可能被用来隐秘地植入偏见并操纵模型输出，这对模型鲁棒性和安全性评估具有重要启示。

Abstract: Large language models often appear to reason reliably, yet on many questions repeated sampling yields both correct and incorrect answers, revealing an underlying fragility in how final decisions are formed. We study whether this fragility can be exploited through implicit reasoning steering: using natural-language text to bias a model toward a designated answer without explicit instructions, triggers, or direct answer cues. Our approach, Concept Chaining, generates a short connection paragraph that links question entities to a target option through one or two intermediate concepts. We then continue pretraining a victim model on these connection paragraphs and evaluate whether its answer preference shifts on the original multiple-choice questions. Our results show that indirect, natural-looking text can systematically steer model predictions while remaining substantially less inferable than direct paraphrases, which shows that reasoning brittleness is not merely an evaluation artifact: it creates a practical channel through which latent biases can be amplified by ordinary-looking text to covertly redirect model decisions.

[10] The Severance Problem: LLMs are Unaware of the Person Beyond the Prompt cs.CLPDF

Dor Litvak, Liu Leqi

TL;DR: 本文提出了“割裂问题”，指出语言模型缺乏对提示之外用户信息的显式表征，导致AI助手出现谄媚、过度自信和幻觉等不良行为。为解决此问题，作者引入了“割裂模式”，通过在模型上下文中结构化地标注未知用户维度，从而改善助手行为。

Details

Motivation: 当前个人AI助手存在谄媚、过度自信和幻觉等不良行为，其根本原因是语言模型缺乏对给定上下文之外用户的显式表征，即“割裂问题”。

Result: 在五个模型系列上的实验表明，引入割裂模式后，助手能持续减少谄媚、有害建议和幻觉，并在用户信息缺失时主动提出澄清问题，而非自信地外推不完整信息。

Insight: 核心创新是提出“割裂问题”概念及“割裂模式”解决方案，通过结构化地表示模型对用户在物理性、时间性、后果等维度的未知信息，引导模型更谨慎地处理用户相关任务，这为提升AI助手的可靠性和安全性提供了新思路。

Abstract: Personal AI assistants have attracted significant interest for their potential to enhance everyday life by automating routine tasks, supporting consequential decisions, and assisting with everyday personal matters. Yet despite rapid recent technical advances, these assistants continue to exhibit undesirable behaviors, such as sycophancy, overconfidence, and hallucination. We argue that these failures stem from a fundamental limitation: language models lack an explicit representation of the person beyond the context they are given, which we term as the \textbf{Severance Problem}. Even with rich personal context and strong commonsense reasoning capabilities from the backbone model, current AI assistants fail to represent what remains unknown about the user. We propose a simple solution: incorporating structured ignorance into the language model context via the \textbf{Severance Schema}, which explicitly outlines dimensions along which the model lacks knowledge about the user, including physicality, temporality, consequences, continuity, multiplicity, and interiority. Empirically, across five model families, with the Severance Schema, the assistant consistently reduces sycophancy, harmful advice, and hallucination. Notably, models with the schema ask clarifying questions when information about the user is missing, rather than confidently extrapolating from incomplete user information.

[11] Multi-Head Latent Control: A Unified Interface for LLM Agent Decision Making cs.CLPDF

Amirhosein Ghasemabadi, Ruichen Chen, Bahador Rashidi, Di Niu

TL;DR: 本文提出了一种名为多头潜在控制（Multi-Head Latent Control）的轻量级方法，用于直接从冻结的大型语言模型（LLM）或视觉语言模型（VLM）的隐藏状态轨迹中推断部署时的控制决策，如是否继续推理、请求更强模型、使用工具或弃权。该方法通过训练两个独立的头（能力头和决策头）来优化多模型系统的质量-成本权衡，并在多个基准测试中显著减少了大型模型的使用并提升了工具调用决策的准确性。

Details

Motivation: 现有方法主要通过提示级路由、外部编排或任务特定微调来实现LLM智能体的决策控制，这些方法依赖输入侧信号，成本高且难以维护。本文旨在探索是否可以直接从模型自身的潜在生成过程中推断出这些控制决策，以实现更高效、轻量的后适应。

Result: 在语言和视觉语言任务中，该方法在多模型系统中显著改善了质量-成本权衡。在路由执行（小模型+大模型）场景下，在AndroidWorld基准上大模型使用量减少了高达90.7%，在多个基准上平均减少27-53%，同时保持了大部分大模型性能。在工具使用决策方面，相对得分提升高达158%，且错过的必需工具调用减少了65.5%。

Insight: 创新点在于提出了一种直接从冻结模型的隐藏状态轨迹中学习控制信号的统一接口，实现了无需修改模型主干的后适应。从客观角度看，该方法通过利用模型内部潜在表示来做出更准确的部署时决策，为构建高效、可维护的LLM智能体系统提供了一种新颖且轻量的解决方案。

Abstract: Large language models are increasingly deployed as agents, but reliable agentic behavior requires more than next-token prediction. At inference time, it is preferred that an agent can decide whether to proceed with its current reasoning, defer to a stronger model, request additional information, invoke external tools, or abstain under the given setup. Existing approaches address these decisions through prompt-level routing, external orchestration, or task-specific fine-tuning, which primarily rely on input-side signals, and are often costly and difficult to maintain as model backbones evolve. We ask whether such control decisions can be inferred directly from a model’s latent generation process. We introduce Multi-Head Latent Control, a lightweight layer that reads hidden-state trajectories from a frozen LLM or VLM to produce deployment-time control signals. A Capability Head predicts whether the current model can solve the instance or should defer to a stronger collaborator, while a Resolution Head predicts appropriate resolution decision Clarification, Tool Use, Abstention, or Direct Answering. Both heads are trained only on latent traces from the same frozen LLM backbone, enabling post hoc adaptation without modifying the model. Across language and vision-language settings, Multi-Head Latent Control consistently improves the quality-cost tradeoff of multi-model systems, enabling early handoff from partial generations and more accurate intervention decisions. In routed execution (small + large model), it reduces large-model usage by up to 90.7 percent on AndroidWorld and 27-53 percent on average across benchmarks, while retaining most of large-model performance. Additionally, the learned control signals improve tool-use decision quality, yielding up to +158 percent relative score gain and 65.5 percent fewer missed-required tool calls.

[12] PReM: Learning What to Preserve and When to Refresh for Context Compression cs.CL | cs.AIPDF

Bohan Yu, Lei Shen, Chenxi Zhou, Chen Han, Junlin Liu

TL;DR: PReM是一个上下文压缩框架，旨在高效处理长上下文推理。它通过内部层级的KV记忆来维护长上下文，并学习在生成过程中决定保留哪些信息以及何时刷新记忆。该方法使用专门的记忆层进行记忆选择决策，并通过特殊记忆令牌触发刷新，在32K令牌的上下文实验中，PReM在16倍和32倍压缩下优于强基线，平衡了答案质量和推理效率。

Details

Motivation: 现有压缩方法（如KV缓存压缩和上下文压缩）通常过早决定保留哪些上下文信息或依赖外部压缩器，难以适应后续推理步骤所需的证据，因此需要一种能动态调整压缩上下文的方法。

Result: 在32K令牌的上下文实验中，PReM在16倍和32倍压缩下优于强基线，在保持答案质量和推理效率之间取得了良好平衡。

Insight: 创新点包括引入内部层级的KV记忆来动态管理上下文，使用记忆层和特殊令牌实现记忆选择与刷新，以及提出Phase-Separated Refresh Training来对齐记忆选择与生成过程，确保刷新间的连续性，从而提升长上下文推理的适应性和效率。

Abstract: Efficient long-context inference is not only about reducing memory cost, but also about keeping useful contextual evidence accessible as generation proceeds. However, existing compression-oriented approaches, such as key-value (KV) cache compression and context compression, often either make an early decision about which contextual information to keep or rely on an external compressor. Such designs make it difficult to adapt the compressed context to the evidence needed by later reasoning steps. This paper introduces PReM (Preserve and Refresh Memory), a context-compression framework that maintains the long context as the model’s internal layer-wise KV memory and learns what to preserve and when to refresh it. Specifically, PReM uses a dedicated memory layer to make memory-selection decisions, and a special memory token to trigger refreshes during generation. To train this behavior, PReM introduces Phase-Separated Refresh Training, aligning memory selection with memory-conditioned generation while preserving continuity across refreshes. Experiments with 32K-token contexts show that PReM outperforms strong baselines under both 16x and 32x compression, while maintaining a favorable balance between answer quality and inference efficiency.

[13] HABIB_TAZ at SemEval-2026 Task 11: Disentangling Formal Logic from Content via Synthetic Training and Multi-Objective Optimization cs.CL | cs.AIPDF

Abdullah Shaikh, Zain Naqi, Taha Zahid, Sandesh Kumar, Abdul Samad

TL;DR: 本文介绍了参与SemEval-2026 Task 11的系统HABIB_TAZ，该任务旨在评估模型在12种语言中，在有/无干扰前提的情况下，将形式逻辑与内容分离的能力。作者通过使用基于规则的合成数据集微调mDeBERTa-v3网络，并采用结合自适应组分布鲁棒优化、可调度偏置惩罚和KL散度一致性正则化的多目标损失函数，来显式解耦逻辑结构与现实合理性。该系统在多个子任务中取得了优异的排名和性能。

Details

Motivation: 尽管大语言模型在许多通用NLP任务上表现出色，但其形式推理能力常受内容效应影响，表现出对现实合理性的可测量偏置。本研究的动机是解决模型在形式逻辑推理中难以与内容分离的问题，特别是在多语言和存在噪声干扰的场景下。

Result: 在SemEval-2026 Task 11的子任务1（英语）、子任务2（噪声英语）和子任务3（多语言）中，系统均取得了排名第一、完美排名分数（100.0）、0.00%偏置和100.0%准确率。在更复杂的子任务4（噪声多语言）中，系统排名第六，准确率和F1分数为89.06%，偏置为2.89%，排名分数为37.78。

Insight: 创新点在于使用基于规则的合成数据集进行微调，避免了LLM增强数据带来的语义噪声，并设计了一个结合自适应组分布鲁棒优化、可调度偏置惩罚和KL散度一致性正则化的多目标损失函数，以显式地解耦逻辑结构与合理性。这为鲁棒逻辑推理研究提供了可复现的框架和公开的数据生成引擎与代码库。

Abstract: While Large Language Models (LLMs) excel in many general NLP tasks, their formal reasoning capabilities are often compromised by content effects, demonstrating a measurable bias towards real-world plausibility. In this paper, we present our system for SemEval-2026 Task 11, which evaluates the ability of models to disentangle formal logic from content across 12 languages with and without distractor premises. We address this challenge using mDeBERTa-v3 networks fine-tuned on a synthetic, rule-based dataset of syllogistic schemes to avoid the semantic noise of LLM-augmented data. To explicitly decouple plausibility from logical structure, our training pipeline employs a multi-objective loss function combining Adaptive Group Distributionally Robust Optimization (DRO), a scheduled differentiable bias penalty, and KL-Divergence consistency regularization. Our system achieved #1 ranks and perfect Ranking Scores (100.0) with 0.00% bias and 100.0% accuracy on Subtask 1 (English), Subtask 2 (Noisy English), and Subtask 3 (Multilingual). On the highly complex Subtask 4 (Noisy Multilingual), the system achieved the 6th rank with 89.06% Accuracy and F1-score, alongside a limited 2.89% Bias and a 37.78 Ranking Score. Our dataset generation engine and codebase are publicly available to facilitate future work on robust logical reasoning.

[14] MARS: Multi-hop Adaptive Retrieval and SPARQL Generation for KGQA cs.CLPDF

Nikit Srivastava, Daniel Vollmers, René Speck, Nikolaos Karalis, Hamada M. Zahera

TL;DR: MARS是一种无需微调、可扩展的知识图谱问答方法，通过结构化检索过程将问题实体链接到知识图谱，并迭代检索相关下一跳信息，自适应决定继续图遍历或生成最终SPARQL查询，在多个KGQA基准测试中实现高效且具竞争力的性能。

Details

Motivation: 解决大语言模型在需要最新且可靠信息的知识密集型任务中容易产生幻觉的问题，通过结合知识图谱的显式符号知识来增强LLM的可靠性，同时避免昂贵的微调成本。

Result: 在三个成熟的KGQA基准测试上进行了评估，包括多语言场景，相对于最先进方法取得了有竞争力的性能，同时保持了高效性和可扩展性。

Insight: 创新点在于结构化检索与自适应深度控制的结合，相比完全代理式方法更具可预测性；通过迭代检索和决策机制，使模型能够根据问题复杂度动态调整检索深度，平衡了探索效率与答案准确性。

Abstract: Large language models (LLMs) have demonstrated strong reasoning performance, but their tendency to hallucinate limits their reliability in knowledge-intensive tasks requiring up-to-date and grounded information. Combining knowledge graphs (KGs) with LLMs facilitates the use of explicit symbolic knowledge that can be continuously updated without costly fine-tuning, while benefiting from rapidly advancing LLM reasoning. We propose MARS, a scalable knowledge graph question answering (KGQA) approach that requires no model fine-tuning. Rather than relying on open-ended agentic exploration, MARS performs a structured retrieval procedure that links question entities to the KG and iteratively retrieves relevant next-hop information. At each step, MARS decides whether to continue graph traversal or to generate the final SPARQL query, allowing the model to adapt the retrieval depth to the question while keeping the overall pipeline more predictable than fully agentic approaches. We evaluate MARS on three established KGQA benchmarks across several LLMs and settings, including multilingual evaluation, and provide insights through ablation studies and error analysis. Our approach achieves competitive performance relative to state-of-the-art methods while remaining efficient and scalable. The evaluation results, code and resources are publicly available: https://github.com/dice-group/mars-kgqa.

[15] Answer-Conditioned Chains of Thought Degrade Verifiable-Reasoning Distillation in Large Language Models cs.CL | cs.AIPDF

Jungseob Lee, Seungyoon Lee, Suhyune Son, Dongyub Jude Lee, Sungbin Han

TL;DR: 本文研究了在大型语言模型（LLM）的思维链（CoT）蒸馏过程中，使用答案条件化（即向模型展示正确答案并要求其生成能推导出该答案的思维链）来生成训练数据的方法。研究发现，这种方法会损害训练数据的质量，导致模型的可验证推理能力下降，且这种损害无法通过正确性过滤来检测。

Details

Motivation: 标准的思维链蒸馏方法在采样失败时，常通过向模型展示正确答案（答案条件化）来生成思维链。本文旨在探究这种答案条件化操作是否会对蒸馏过程产生负面影响，特别是它是否会损害最终训练模型的可验证推理能力。

Result: 在固定生成器、问题集和正确性过滤器的控制实验中，使用答案条件化思维链进行微调，会显著降低一个强大的指令调优推理模型的可验证推理准确率。在最具挑战性的竞赛问题上，准确率损失高达约27个百分点。这种损害是数据本身的属性，与生成器无关。

Insight: 核心创新点在于揭示了答案条件化思维链生成方式的内在缺陷：模型会从给定的答案反向合理化（rationalize backward），而非正向推导，这导致生成的思维链质量下降，进而损害蒸馏效果。关键实践启示是应生成非答案条件化（answer-blind）的思维链，因为任何正确性过滤器都无法检测数据中的这种损害。

Abstract: A standard recipe for distilling the reasoning ability of large language models (LLMs) is to sample chains of thought from the model, keep those that reach the correct final answer, and fine-tune on the survivors. When sampling fails, a common fix shows the generator the gold answer and asks it to write a chain that reaches that answer. We show that this second step degrades the training data in a way that correctness filtering cannot catch. We run a controlled experiment that fixes the generator, the problem set, and the correctness filter, and varies only whether the chain is generated under answer-conditioning, the gold answer shown with a request to reach it. Training a strong instruction-tuned reasoning model on its own answer-conditioned chains sharply lowers its verifiable-reasoning accuracy. The loss grows with difficulty, reaching as much as about 27 points on the hardest competition problems. The mechanism is legible in the chains themselves, which rationalize backward from the shown answer instead of deriving it, with the early final-answer statement as the measurable symptom. The harm is a property of the data rather than the generator, read off unlabeled generations before any fine-tuning, ordering the penalty across eight thinking models from four families, and transferring across teacher families. A prompt ablation localizes it to the rationalize-toward instruction rather than the answer’s bare visibility. The practical takeaway is to generate answer-blind, because no correctness filter can see this damage in the data.

[16] Controlled Reformulation Testing for Logical Consistency in Large Language Models cs.CL | cs.AIPDF

Alexander Gu, Alan Chen

TL;DR: 该论文提出了一个名为CRTBench的基准测试，用于评估大语言模型（LLMs）在逻辑等价问题不同表述下的答案一致性。该基准包含350个问题族（共1750个问题），测试模型在四种受控改写（逆否命题、双重否定、否定翻转、被动语态）下的表现。研究发现，即使模型在基础准确率上很高，其逻辑一致性却可能显著不足，例如GPT-5.4-mini的准确率达98.9%，但一致性仅为60.3%。

Details

Motivation: 解决大语言模型在面对逻辑等价但表面形式不同的问题时，经常出现自相矛盾答案的问题，旨在评估和提升模型在逻辑推理上的鲁棒性和一致性。

Result: 在CRTBench基准上，GPT-5.4-mini的基础准确率为98.9%，但族级一致性仅为60.3%；而推理优化的o4-mini达到96.9%的一致性。对于逻辑非平凡的转换（如逆否命题改写），GPT-5.4-mini的一致性较低（72.4%），而表面改写则很鲁棒（94-100%）。增加推理努力可将GPT-5.4-mini的一致性提升至85.4%。

Insight: 论文的创新点在于构建了一个系统性的基准来量化LLMs的逻辑一致性缺陷，揭示了准确率与逻辑一致性之间的显著差距。客观来看，其核心洞察是评估LLMs的逻辑推理能力时，不能仅依赖准确率指标，必须引入一致性测试，并且模型在复杂逻辑转换（如逆否命题）上的脆弱性是需要重点改进的方向。

Abstract: Large language models (LLMs) frequently contradict themselves when the surface form of a logically equivalent question changes. We present a benchmark of 350 question families (1,750 total questions) for Controlled Reformulation Testing (CRTBench) to evaluate logical invariance. In this benchmark, we investigate LLMs’ ability to maintain consistent answers across controlled reformulations, which include contrapositive rewriting, double negation, negation flipping, and passive voice. We evaluate several frontier LLMs and observe an accuracy-consistency gap where GPT-5.4-mini achieves $98.9%$ base accuracy but only $60.3%$ family-level consistency, while reasoning-optimized o4-mini achieves $96.9%$ consistency. From our experiments, we observe that failures cluster around logically nontrivial transformations such as contrapositive rewriting ($72.4%$ for GPT-5.4-mini) and double negation ($84.6%$), while surface-level rephrasing remains robust ($94-100%$). Increasing reasoning effort improves GPT-5.4-mini to $85.4%$ consistency, but leaves GPT-5.4 unchanged overall because gains on nested negation are offset by failures on quantifier families. These results show that accuracy alone is not enough for evaluating logical reasoning in LLMs.

[17] Routing Ceilings Are Domain-Independent: Structural Prior Injection in Code Security Vulnerability Detection cs.CL | cs.CRPDF

Manuel Israel Cázares

TL;DR: 本研究将SAIR方法从形式数学推理领域迁移到代码安全漏洞检测领域，验证了结构先验（cheatsheets）在提升大语言模型（LLMs）分布内（in-distribution）性能的同时，会导致分布外（out-of-distribution）性能急剧下降的普遍现象。实验在三个漏洞类别和真实CVE数据上复现并扩展了SAIR的发现，表明路由天花板（routing ceilings）是领域无关的。

Details

Motivation: 动机是验证在形式数学推理中观察到的“模型具备知识但缺乏可靠内部路由激活”的“路由器假说”及其伴随的分布偏移性能崩溃现象，是否在代码安全漏洞检测这一不同领域同样存在。

Result: 在合成数据上，结构先验将语义漏洞的召回率从20.0%提升至100.0%；但在真实CVE数据（如CWE-89）上，性能从100% F1分数骤降至48.9%。迭代重新校准生成的v2版cheatsheet在真实数据上表现比v1更差，与SAIR的发现一致。

Insight: 核心创新点在于跨领域验证了结构先验带来的性能提升与分布偏移下的性能崩溃之间存在普遍权衡，这挑战了单纯依赖提示校准的方法，并支持了进行分布感知训练的必要性。研究为“路由器假说”提供了跨领域证据。

Abstract: Large language models (LLMs) exhibit a well-documented gap between latent capability and consistent activation: the router hypothesis posits that models possess the knowledge to solve a task but lack reliable internal routing to activate it. Prior work in formal mathematical reasoning (SAIR, Cázares 2026) reports that structural priors (cheatsheets) raise in-distribution performance dramatically, yet collapse below the zero-shot baseline out-of-distribution (OOD) – and that iterative recalibration amplifies rather than corrects the collapse. We test whether this phenomenon is cross-domain by reproducing the SAIR design in source-code security vulnerability detection, evaluating three LLMs (GPT-OSS-120B, Llama-3.3-70B, Gemma-4-31B) across three vulnerability categories (CWE-798, CWE-284, and the non-CWE N+1 anti-pattern) spanning syntactic, contextual, and semantic complexity, then transferring cheatsheet-augmented prompts to real-world CVE data from VUDENC (CWE-89, CWE-22). Our findings replicate and extend SAIR: (F1) structural priors lift semantic-vulnerability recall from 20.0% to 100.0% across all models; (F2) zero-shot performance degrades along a semantic complexity gradient; (F3) the same cheatsheets that saturate synthetic performance amplify distribution-shift collapse on real CVE data (CWE-89: 100% synthetic F1 to 48.9% on VUDENC, -51.1pp); (F5) iterative recalibration produces a v2 cheatsheet that performs worse than v1 on real data, mirroring SAIR’s AN45c-vs-AN38 finding. These results provide evidence that the cross-distribution trade-off surface documented in SAIR generalises to code security, and that the router hypothesis is cross-domain. We argue the structural nature of the collapse motivates distribution-aware training over prompt calibration. Code and evaluation scripts: https://github.com/bytepro-ai/bitcoder-v2-research

[18] Harnessing LLMs for Reliable Academic Supervision: A Comparative Study cs.CL | cs.AIPDF

Akash Raj

TL;DR: 该论文探讨了如何通过’约束工程’将大型语言模型可靠地集成到高风险的学术指导决策系统中。研究通过一个案例比较了无约束的GPT-5聊天机器人与一个围绕较小模型GPT-4o-mini构建的、包含多种确定性模块（如检索、模式验证、人工介入门控等）的多模块系统。结果表明，精心设计的约束系统能显著提升模型在多个可靠性维度的表现，挑战了’模型越大越好’的直觉。

Details

Motivation: 解决大型语言模型在单次提示下能生成流畅回答，但难以作为可靠组件集成到需要长期问责和结构化工作流程的高风险领域决策系统（如学术指导）中的问题。

Result: 在针对六个约束机制维度的盲评中，使用较小基础模型但带有约束的系统（ASuS）在所有维度上均显著优于无约束的GPT-5基线（ASA），平均分分别为4.08和1.23，且消融实验证实了约束结构贡献的模型无关性。

Insight: 论文的核心创新在于系统性地提出并验证了’约束工程’方法，即通过组合确定性脚手架（如符号语义检索、模式验证输出、带重试的LLM-as-judge循环、人工介入门控、审计追踪等）来提升LLM系统的可靠性、可解释性和过程完整性，这为构建高可靠性AI系统提供了可借鉴的模式和工程范式。

Abstract: Large language models routinely produce fluent answers to single-shot prompts, yet deploying them as reliable components of a domain decision system is substantially harder. Closing this gap is the work of harness engineering: the deliberate composition of deterministic scaffolding (symbolic filters, retrieval, schema-typed I/O, LLM-as-judge loops, HITL gates, persistent state, audit trails) around an LLM core. We present a case study in academic supervision, a domain combining high-stakes recommendation, longitudinal accountability, and structured operational workflows. We compare a baseline (ASA), a GPT-5 chatbot with no scaffolding, against a multi-module system (ASuS) that wraps the much smaller GPT-4o-mini in a LangGraph harness with symbolic-semantic retrieval, schema-validated outputs, LLM-as-judge with bounded retry, HITL gates, deterministic weighted risk scoring with LLM narration, and a per-node SQLite audit trail. The evaluation rubric is retargeted at six harness-mechanism dimensions (grounding, explainability, consistency, process integrity, cognitive load, constraint adherence). A blind ten-rater hybrid evaluation, supplemented by a 2 x 2 model-harness ablation, finds that ASuS, despite using a much smaller base model, outscores ASA on every dimension. Across ten raters the pooled mean for ASuS is 4.08 versus 1.23 for ASA, and 8 of 10 raters reject the null at alpha = 0.05 on a paired Wilcoxon test; full numbers are in Sections 6.4 and 6.7. The ablation confirms that the structural contributions of the harness are largely model-invariant. We extract seven recurring harness-engineering patterns and argue that where reliability, traceability, and institutional consistency matter more than open-ended fluency, harness engineering challenges the prevailing ‘bigger model is better’ intuition.

[19] Gold-Guided Programmatic Distillation for Financial Reasoning over Hybrid Tables and Text cs.CLPDF

Yun Dong, Erica Zhao, Elana Chen

TL;DR: 本文提出了一种基于黄金推导的程序化蒸馏方法，用于在混合表格和文本数据上进行金融推理。该方法利用执行验证的Python程序而非自由文本推理，将大型教师模型的可靠数值推理能力迁移到紧凑的学生模型中，并通过迭代恢复阶段处理教师模型失败的示例，从而提升学生模型的性能。

Details

Motivation: 金融问答任务需要多源推理和精确数值计算，而大型语言模型生成的文本推理容易产生算术错误，不适合作为蒸馏的监督信号。因此，作者旨在开发一种使用执行验证程序作为高质量监督的方法，以提高小型模型的数值推理可靠性。

Result: 在TAT-QA基准测试中，最佳7B学生模型达到了87.00 EM / 87.18 F1的测试集性能，显著优于72B教师模型（78.46 EM）以及TAGOP和TAT-LLM等传统和基于LLM的基线方法，实现了SOTA水平。

Insight: 创新点包括使用黄金推导引导教师端程序合成，仅保留执行正确且产生黄金答案的程序作为监督，确保高质量蒸馏；以及引入迭代恢复阶段，使学生模型能够从教师失败示例中学习新验证的程序，增强模型的鲁棒性和可扩展性。

Abstract: Financial question answering over hybrid tabular and textual data may require multi-source reasoning and precise numerical computation. While large language models (LLMs) can generate intermediate reasoning steps, natural-language rationales remain prone to arithmetic errors, making them an unreliable supervision source for distillation. Building on programmatic distillation, we develop an approach that transfers reliable numerical reasoning from a large teacher model to a compact student using execution-verified Python programs instead of free-form textual rationales. It leverages gold derivations to guide teacher-side program synthesis and retains only programs that execute correctly and produce the gold answer, ensuring high-quality supervision. We further introduce an iterative recovery stage that revisits teacher-failed examples, enabling the student to recover and incorporate newly verified programs into training. Experiments on TAT-QA show that our framework is highly effective for hybrid financial reasoning. Our best 7B student achieves 87.00 EM / 87.18 F1 on the test set, substantially outperforming the 72B teacher (78.46 EM) as well as traditional and strong LLM-based baselines, including TAGOP and TAT-LLM. These results demonstrate that execution-verified programmatic distillation provides an effective and extensible framework for training smaller models to perform reliable numerical reasoning.

[20] CoTu at EXACT 2026: Neuro-Symbolic Reasoning for Transparent Educational QA cs.CLPDF

Quoc-Khang Tran, Minh-Thien Nguyen, Phu-An Thai, Xuan-Tung Bui, Truong-Thanh Ma

TL;DR: 本文介绍了CoTu团队为EXACT 2026竞赛开发的系统，该系统采用神经符号推理方法，使用一个4B参数的基础模型生成程序（而非直接答案）来解决透明教育问答问题。系统通过Z3编码处理大学规章的逻辑推理，通过数值Python代码处理多步骤物理问题，并集成了自我纠正循环和统一的解释性JSON输出。该系统在物理任务上获得了满分，并在最终技术评分中取得了最高分。

Details

Motivation: 解决透明教育问答问题，要求答案不仅正确且可解释，同时限制使用不超过8B参数的开源模型，这排除了依赖大型专有系统的可能性。

Result: 系统在物理任务的两轮自动选择中均获得完美分数，并在最终技术评分中以13.44/15分获得所有团队中的最高分（结合自动答案评估和专家评判的推理深度）。计入等权重的演示分数后，团队总排名第三。

Insight: 核心创新在于神经符号的“程序思维”流水线，将答案生成转化为可验证的符号程序（Z3或Python），使小型模型能进行可靠推理；同时，通过任务微调、答案类型路由和推测解码等技术优化，在严格延迟限制下实现了高性能。

Abstract: Transparent educational question answering asks for answers that are not only correct but explainable, and doing so with small models rules out the reasoning power of the largest proprietary systems. The EXACT 2026 competition poses this problem concretely: open-weight language models of at most 8B parameters, self-hosted, with a natural-language explanation for every answer. It pairs two tasks: logical reasoning over university regulations, and multi-step physics problem solving. We describe the system that team \cotu{} developed to address both, a neuro-symbolic Program-of-Thought pipeline in which a 4B backbone writes a program rather than stating an answer directly: for regulation queries it emits a Z3 encoding whose entailment verdict grounds the deduction, and for physics it emits numerical Python, both wrapped in a shared self-correction loop and a unified explained-JSON output. Answer-type routing, distillation-based task fine-tuning, and a latency-aware serving stack – SGLang with speculative decoding – keep the system within the 60-second per-query limit. The system achieved a \textbf{perfect score} on the physics task in both automated selection rounds and obtained the \textbf{highest final-round technical score} of any team – $13.44/15$, combining automated answer evaluation with expert-judged reasoning depth – with the equally weighted presentation score included, \cotu{} placed 3rd overall. Grounding answers in a symbolic solver yields correct, verifiable deductions at the 4B scale, and the residual difficulty lies in premise selection rather than the deduction itself.

[21] Dialogue Summarization with Emotion Dynamics Using Topic- and Participant-Centric Decomposition cs.CL | cs.AI | cs.MAPDF

Linyun Xiang, Mark Neerincx, Stephanie Tan

TL;DR: 本文提出了一种对话摘要框架，通过主题和参与者中心分解来建模语义和情感动态。该框架基于改进的分层代理链方法，利用多模态对话输入，生成包含情感轨迹的对话摘要。

Details

Motivation: 现有文本摘要研究主要关注独白信息，忽略了对话中参与者之间的交互。对话作为丰富的交流渠道，需要捕捉多参与者来回交流构建的意义。

Result: 在多模态对话数据集上使用小型语言模型进行实验，结果表明该框架能生成包含语义和情感内容的摘要。情感轨迹指标评估显示，摘要能较好地保留情感流。

Insight: 创新点在于从主题和参与者两个视角分解对话，并引入情感轨迹指标来评估摘要质量。这为使用语言模型进行对话分析提供了新机会。

Abstract: Existing text summarization research has focused much on monologic information (e.g., newspaper articles, reports) without accounting for the interaction between speakers or authors. In contrast, dialogues are a rich communication channel where multiple participants conduct back and forth exchanges to construct meaning. We propose a dialogue summarization framework that explicitly models both semantic and emotion dynamics using multimodal dialogue inputs, built on an adapted hierarchical Chain-of-Agents approach. We decompose dialogues from two perspectives: (1) topic segments based on the utterances of all participants, and (2) participant-specific utterance segments. These are used to generate corresponding summaries while incorporating automatically inferred emotions. Topic- and participant-level summaries are aggregated into a dialogue summary capturing semantic content and emotion trajectories. To evaluate beyond content accuracy, we introduce emotion trajectory metrics measuring how well summaries preserve emotional flow. Experiments with small language models on multimodal dialogue datasets show that our framework produces summaries with both semantic and emotion content. Further experiments on explicit emotion label availability highlight the efficacy of our proposed methodology and the opportunities in dialogue analysis using language models.

[22] SEED: Self-Evolving On-Policy Distillation for Agentic Reinforcement Learning cs.CLPDF

Jinyang Wu, Shuo Yang, Zhengxi Lu, Fan Zhang, Yuhao Shen

TL;DR: 论文提出SEED框架，通过将已完成的在线策略轨迹转化为训练时的后见技能，并将这些技能的行为效应蒸馏回策略模型，以解决基于结果的强化学习中稀疏奖励对中间决策指导不足的问题。

Details

Motivation: 基于结果的强化学习（RL）在长视野任务中，其稀疏的轨迹级奖励对中间决策的指导有限，导致情节级结果与令牌级策略学习之间存在监督空白。

Result: 在基于文本和视觉的智能体任务上的大量实验表明，SEED能持续提升性能和样本效率，并对未见场景展现出鲁棒的泛化能力。

Insight: 创新点在于将后见技能分析整合到策略更新循环中，使辅助监督与当前轨迹分布保持一致，并通过技能诱导的概率偏移生成密集的令牌级在线蒸馏信号。

Abstract: Large language models are increasingly trained as interactive agents for long-horizon tasks involving multi-turn interaction, tool use, and environment feedback. Outcome-based reinforcement learning (RL) provides a practical optimization paradigm, but its sparse trajectory-level rewards offer limited guidance on intermediate decisions, leaving a supervision gap between episode-level outcomes and token-level policy learning. We propose SEED (SElf-Evolving On-Policy Distillation), a self-evolving framework that converts completed on-policy trajectories into training-time hindsight skills and distills their behavioral effect back into the policy model. SEED first fine-tunes the policy to analyze completed trajectories and generate natural-language skills that capture reusable workflows, decisive observations, or failure-avoidance rules. During RL, the current policy both collects trajectories and serves as the analyzer that extracts hindsight skills from them. Policy updates therefore improve subsequent decision making and skill analysis together, allowing hindsight supervision to evolve with the policy. SEED then re-scores the sampled actions under ordinary and skill-augmented contexts, converting the skill-induced probability shift into a dense token-level on-policy distillation signal. This signal is jointly optimized with outcome-based RL, keeping the auxiliary supervision aligned with the current trajectory distribution. Extensive experiments on text-based and vision-based agentic tasks show that SEED consistently improves performance and sample efficiency, exhibiting robust generalization to unseen scenarios. Our code is available at https://github.com/jinyangwu/SEED.

[23] Show Me How You Reason and I’ll Tell You Who You Are: Reasoning Graphs for Robust LLM Authorship Attribution cs.CL | cs.AIPDF

Zlata Kikteva, Artur Romazanov, Annette Hautli-Janisz, Ramon Ruiz-Dolz

TL;DR: 本文提出了一种基于推理图的LLM作者归属方法，通过提取和分析LLM生成文本中的推理结构，而非仅依赖表层语言特征，以提升对改写和回译等混淆攻击的鲁棒性。该方法采用图神经网络处理由论点挖掘流程构建的推理图，在模拟真实场景的实验中显著优于传统基线模型。

Details

Motivation: 针对LLM生成文本检测和作者归属的迫切需求，现有方法主要依赖表层语言特征，易受改写等混淆技术影响，因此需要挖掘更深层次的复杂信号来提升鲁棒性。

Result: 在遭受改写和回译等混淆攻击时，该方法比Longformer基线提升高达27个百分点；在未见过的LLM版本生成文本上评估时，提升19个百分点，展现了优异的泛化能力。

Insight: 创新点在于将推理结构建模为图并利用图神经网络进行分析，这为LLM作者归属提供了更本质、更稳健的特征表示，可借鉴其从深层语义而非表面文本中提取鲁棒信号的思想。

Abstract: Given the current trend to employ large language models (LLMs) in almost any imaginable context, LLM-generated text detection and authorship attribution have become a pressing issue. Prior work has primarily focused on surface-level linguistic features, an approach shown to be susceptible to paraphrasing and other obfuscation techniques. In this paper, we go beyond the linguistic surface, extracting and analysing reasoning structures in LLM-generated texts with the goal of capturing more complex signals of LLM authorship. We propose a graph neural network approach that leverages reasoning graphs extracted by an argument mining pipeline, demonstrating improved robustness and generalisation over a traditional Longformer baseline. Our approach outperforms the baseline by up to 27 percentage points under the obfuscation attacks such as paraphrasing and backtranslation, and 19 percentage points when evaluated on the texts generated by the unseen model versions, simulating real-world conditions in which new LLM versions are continuously released.

[24] Rubrics on Trial: Evolving Rubrics from a Single Query via Synthetic Pairwise Evidence cs.CLPDF

Haocheng Yang, Licheng Pan, Xiaoxi Li, Zhichao Chen, Zhiheng Zhang

TL;DR: 本文提出Rubrics on Trial框架，仅通过单一查询即可从空集演化生成评估标准（rubrics），无需外部标注或模型训练。该方法利用合成的标准-响应对进行监督，并在添加前验证每个候选标准的有效性，筛选出无区分度、过度特定或仅关注风格的候选标准。在五个偏好基准测试套件上的实验表明，该方法取得了最佳平均准确率，并在七个评估集中的六个上领先。

Details

Motivation: 现有方法构建查询特定评估标准（rubrics）依赖人工编写、偏好数据或采样响应，资源消耗大；直接生成方法缺乏对标准实用性的显式检查，可能导致标准无法区分答案质量、奖励可选风格或惩罚有效替代策略。

Result: 在五个偏好基准测试套件上的实验显示，Rubrics on Trial取得了最佳平均准确率，并在七个评估集中的六个上达到领先水平（SOTA）。

Insight: 创新点在于提出纯查询驱动的框架，通过合成标准-响应对实现自监督，并引入验证步骤筛选候选标准，确保其区分度和实用性；从客观角度看，该方法避免了对外部资源的依赖，实现了高效、自动化的评估标准生成。

Abstract: Rubrics provide structured, fine-grained signals for training and evaluating large language models (LLMs). Yet reliable query-specific rubrics are difficult to construct. Existing approaches often derive supervision from human-written rubrics, preference data, or sampled responses. Direct query-to-rubric generation avoids these resources, but provides no explicit check that a plausible rubric is useful. Such a rubric may fail to distinguish answer quality, reward an optional style, or penalize a valid alternative strategy. We introduce Rubrics on Trial, a query-only framework that evolves a rubric set from an empty set without external annotations or model training. It derives supervision solely from synthetic rubric-conditioned response pairs and validates each proposed rubric before adding it, screening out non-discriminative, over-specific, and style-only candidate rubrics. Experiments across five preference benchmark suites demonstrate the effectiveness of Rubrics on Trial, which achieves the best average accuracy and leads on six of seven evaluation sets.

[25] Digital Pantheon: Simulating and Auditing Coalition Formation with LLM Agents cs.CL | cs.AI | cs.MAPDF

Dylan Van Mulders, Matthias Bogaert, Dirk Van den Poel

TL;DR: 本文提出了一个名为’Digital Pantheon’的多智能体框架，用于模拟政治联盟的形成过程。该框架结合了监督微调、直接偏好优化和检索增强生成技术，为每个政党智能体注入坚定的党派立场，同时将其决策锚定在官方宣言上。研究以2019年佛兰德选举为案例，通过引入多层级信息谱系拓扑和联盟影响力分数等工具，使模拟谈判过程可解释，并能可靠预测现实世界中的联盟协议内容。

Details

Motivation: 解决大型语言模型因人类反馈强化学习导致的中立性和乐于助人偏见，使其无法维持坚定的党派行为，从而难以用于计算政治学中模拟复杂的政治联盟谈判。

Result: 在2019年佛兰德选举的三次独立模拟中，框架产生了稳定的赢家和排名（N-VA领先于CD&V和Open Vld），并且基于宣言的谱系信息能可靠预测现实世界中的协议内容，而幻觉内容则不能。

Insight: 创新点在于通过结合SFT、DPO和RAG技术，在保持事实基础的同时实现意识形态对齐，并设计了MILT和CIS等工具，为联盟谈判模拟提供了一个透明、可扩展且可解释的测试平台。

Abstract: The formation of political coalitions is a complex negotiation driven by both concrete policy objectives and deep-seated ideological convictions. While Large Language Models (LLMs) open new avenues for computational political science, the neutrality and helpfulness biases instilled by Reinforcement Learning from Human Feedback (RLHF) prevent them from sustaining steadfast partisan behaviour. We present a multi-agent framework that reconciles factual grounding with ideological alignment by combining Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Retrieval-Augmented Generation (RAG): DPO instils aggressive party-specific personas, while a per-party RAG pipeline keeps each agent bounded to its official manifesto. We operationalize the framework on the 2019 Flemish election, deploying the partisan agents in a hub-and-spoke negotiation arbitrated by a formateur. To make the emergent negotiation interpretable, we introduce a Multi-Layered Information Lineage Topology (MILT) that traces every clause in the final agreement back to its manifesto origin and classifies it into five provenance states, a Coalition Influence Score (CIS) that aggregates these traceable contributions to identify which party shaped the agreement, and a real-world grounding pass that benchmarks each simulated provision against the historically adopted coalition agreement. Across three independent simulations the framework yields a stable winner and ranking (N-VA ahead of CD&V and Open Vld), and manifesto-anchored lineage reliably predicts real-world materialization whereas hallucinated content does not. The result is a transparent, scalable testbed for the ex-ante exploration of party compatibility and formateur-mediated compromise.

[26] T^2MLR: Transformer with Temporal Middle-Layer Recurrence cs.CL | cs.AIPDF

Ziyang Cai, Xingyu Zhu, Yihe Dong, Yinghui He, Sanjeev Arora

TL;DR: 本文提出了T^2MLR（具有时序中层循环的Transformer）架构，旨在解决Transformer自回归解码中中间推理状态难以跨时间步持久化的问题。该方法通过将前一个token的缓存中层表示直接融合到当前token位置的较早层中，使抽象的中间计算能以极小的推理开销在解码步骤间持续存在。

Details

Motivation: Transformer的推理能力受限于自回归解码，该过程会通过token空间反复压缩丰富的隐藏计算，导致中间推理状态难以跨时间步持久化。

Result: 在自然语言预训练和多跳推理微调任务中，T^2MLR在数据和参数匹配的Transformer基线模型上表现持续更优。仅对局部中层块（可低至网络的20%）应用循环，其效果常优于全层循环。此外，将循环路径改造到现有的1.7B预训练Transformer中并短暂微调，能显著提升数学推理能力。

Insight: 创新点在于提出了针对性的中层循环机制，而非像先前工作那样在所有层上进行循环，这能以极小的推理开销实现有效的潜在推理。客观来看，该方法的关键洞察是：有效的潜在推理可以更强烈地从目标化的中层循环中涌现，且该方法支持对现有预训练模型进行改造，降低了实际应用的壁垒。

Abstract: Transformer reasoning is limited by autoregressive decoding, which repeat edly compresses rich hidden computation through token space and makes it difficult for intermediate reasoning states to persist across time. We in troduce Transformers with Temporal Middle-Layer Recurrence (T2MLR), a transformers-based latent reasoning architecture that fuses a cached middle layer representation from the previous token directly into an earlier layer of the current token position, enabling abstract intermediate computation to persist across decoding steps with little inference overhead. Across natural-language pretraining and multi-hop reasoning finetuning, T2MLR consistently outperforms data- and parameter-matched Transformer base lines. Moreover, applying recurrence to only a localized middle-layer block (as little as 20% of the network) often outperforms full-layer recurrence. Im portantly, T2MLR does not require pretraining from scratch: retrofitting the recurrent pathway into an existing pretrained 1.7B Transformer and briefly finetuning substantially improves math reasoning, lowering the barrier to practical adoption. These results suggest that effective latent reasoning in Transformers does not require looping over all layers as in previous works, but can instead emerge more strongly from targeted middle-layer recurrence.

[27] Mask-Aware Policy Gradients for Diffusion Language Models cs.CL | cs.AI | cs.LGPDF

Haran Raajesh, Kulin Shah, Adam Klivans, Philipp Krähenbühl

TL;DR: 本文提出了一种针对掩码扩散语言模型（MDLM）的强化学习方法，通过将MDLM的生成过程形式化为一个两阶段动作的马尔可夫决策过程，并推导出可分解为令牌项和掩码项的策略梯度公式，从而优化模型在推理任务上的性能。该方法在数学推理和代码生成基准测试中取得了最先进的结果。

Details

Motivation: 现有方法难以将强化学习有效应用于掩码扩散语言模型，因为其对数似然估计难以处理，且现有近似方法忽略了生成过程中位置被解掩码的顺序这一关键信息。

Result: 在GSM8K数学推理基准上达到87.1%的准确率，在MBPP代码生成基准上达到53.4%的准确率，取得了最先进（SOTA）的性能。

Insight: 核心创新在于将MDLM的生成过程建模为包含“放置什么令牌”和“重新掩码哪些位置”两个决策阶段，并推导出相应的分解式策略梯度，从而能够联合优化令牌预测和掩码策略，这是现有方法所忽略的。从客观角度看，这种对扩散模型生成过程更精细的建模为解决其强化学习问题提供了新的理论框架和有效途径。

Abstract: Reinforcement learning has proven effective for improving reasoning in large language models, but extending it to Masked Diffusion Language Models (MDLMs) remains challenging due to the intractability of the log-likelihood estimation. Existing approaches approximate this log-likelihood by modeling only the token predictions, ignoring the order in which positions are unmasked during generation. We observe that MDLM generation involves two decisions at each step: what tokens to place at each masked position and which positions to remask. We formalize this as a two-stage action MDP, showing that the policy gradient naturally decomposes into a token term and a masking term. Combining optimization of both terms leads to state-of-the-art outcomes on mathematical reasoning and coding benchmarks, with scores of 87.1% on GSM8K and 53.4% on MBPP.

[28] TikStance: A Multimodal and Hierarchical Dataset for Multi-target Stance Analysis in TikTok Political Conversations cs.CLPDF

Yazhi Zhang, Fuqiang Niu, Bowen Zhang

TL;DR: 本文介绍了TikStance，一个用于TikTok政治对话多目标立场分析的多模态、分层数据集。该数据集包含161个视频和13,876条评论，覆盖2024年美国大选周期的三位主要政治人物，并提供了视频到目标和评论到目标的三类立场标注。

Details

Motivation: 政治话语已转向短视频平台，但现有数据集缺乏对音视频信息和分层对话结构的联合保留，限制了对此类内容进行计算分析的能力。

Result: 数据集在特朗普、拜登和哈里斯子集上的最终Krippendorff’s α分别达到0.743、0.723和0.722，显示出良好的一致性。描述性分析揭示了立场分布和对话深度的目标依赖性差异，其中嵌套回复占所有评论的23.3%。

Insight: 创新点在于构建了一个结合多目标覆盖、分层对话结构和可靠多层级人工标注的多模态数据集，支持在音视频和对话上下文中进行立场分析，为多模态立场检测、政治传播和上下文感知NLP研究提供了资源。

Abstract: Political discourse has increasingly moved to short-video platforms, yet computational analysis of such content remains constrained by the scarcity of datasets that jointly preserve audiovisual information and hierarchical conversations. Here we present TikStance, a multimodal and context-aware dataset comprising 161 videos and 13,876 comments from TikTok, designed for stance detection in political discussions. The dataset covers three major political figures in the 2024 U.S. election cycle–Donald Trump, Joe Biden, and Kamala Harris–with content collected between September 2023 and January 2025. Each discussion unit links a host video and its metadata to a parent-linked comment tree, enabling stance analysis within both audiovisual and conversational context. Each item was independently labeled by three annotators using a three-class scheme (Favor, Against, None) for video-to-target and comment-to-target stance; items with disagreement were re-annotated, and the final Krippendorff’s (α) reached 0.743, 0.723, and 0.722 for the Trump, Biden, and Harris subsets, respectively. Descriptive analysis further reveals target-dependent differences in stance distributions and conversational depth, with nested replies accounting for 23.3% of all comments. By combining multi-target coverage, hierarchical conversations, and reliable multi-level human annotations, TikStance supports research in multimodal stance detection, political communication, computational social science, and context-aware natural language processing.

[29] Beyond the Leaderboard: Design Lessons for Trustworthy Multimodal VQA cs.CL | cs.CVPDF

Sushant Gautam, Vajira Thambawita, Michael A. Riegler, Pål Halvorsen, Steven A. Hicks

TL;DR: 本文以MediaEval Medico 2025竞赛中胃肠道内窥镜视觉问答（VQA）任务为案例，分析了九种已公开系统的设计选择，探讨了如何构建可信赖的多模态医疗AI。研究发现，基于预训练骨干网络进行参数高效微调能取得良好的竞赛性能，但答案准确性的提升并不总能转化为忠实、完整的临床推理。强制执行结构化推理和显式视觉基础的方法在各类问题上表现更可靠。

Details

Motivation: 医疗多模态AI需要融合视觉和文本证据，同时保持可靠性和可解释性。本文旨在通过分析现有VQA系统的设计，为构建可信赖的医疗AI提供经验教训，解决性能与可信推理之间可能存在的脱节问题。

Result: 在MediaEval Medico 2025的胃肠道内窥镜VQA挑战中，参数高效微调方法取得了强劲的竞赛表现。然而，强制执行结构化推理和显式视觉基础的方法在不同类型问题上表现出更可靠的行为，尽管证据是相关性分析而非消融实验得出的。

Insight: 论文的创新之处在于超越排行榜性能，系统性地分析了设计选择对系统可信度（如推理忠实性、完整性）的影响。关键洞见包括：评估应超越词汇重叠，需要标准化的、与证据关联的解释；数据治理需注意信息泄露；以及进行轻量级的鲁棒性和校准检查。这支持了基于数据融合、可解释性和韧性评估的可信赖多模态医疗AI发展路径。

Abstract: Healthcare multimodal AI must combine visual and textual evidence while remaining reliable and interpretable. Using MediaEval Medico 2025 as a retrospective GI endoscopy case study, we analyze design choices across nine documented systems for question answering and explanation quality. Parameter-efficient adaptation of pretrained backbones provides strong challenge performance, but answer-level gains do not consistently translate into faithful and complete clinical reasoning. Methods enforcing structured reasoning and explicit grounding show more reliable behavior across heterogeneous question types, although the evidence is correlational rather than ablation-based. These results motivate evaluation beyond lexical overlap, standardized evidence-linked explanations, leakage-aware data governance, and lightweight robustness and calibration checks. The findings support trustworthy multimodal healthcare AI based on data fusion, explainability, and resilient evaluation.

[30] SciDiagramEdit: Learning to Edit Scientific Diagrams from Paper Revisions cs.CL | cs.AIPDF

Yasheng Sun, Zezi Zeng, Yifan Yang, Chong Luo, Wenyi Wang

TL;DR: 本文提出SciDiagramEdit，一个基于自然语言指令编辑科学图表的基准与技能演化框架。该框架从arXiv论文版本历史中挖掘图表修订前后的配对数据，通过代理学习不断优化编辑技能，实现在矢量源文件上对图表元素的精确编辑。

Details

Motivation: 研究动机是自动化科研论文中图表编辑这一耗时且常规的工作流程，解决在密集信息图表（如示意图、图表、照片、标注和箭头）中根据自然语言指令进行精确编辑的挑战。

Result: 通过技能演化方法，代理在验证集上的编辑准确率逐步提升，表明自然论文修订是有效的训练信号，但未提及具体基准测试或与现有方法的定量比较。

Insight: 创新点在于利用arXiv版本历史自动构建训练数据，并采用代理驱动的技能演化框架来处理多样化的编辑指令，同时允许用户在矢量源文件中与代理协同编辑，增强了可解释性和实用性。

Abstract: Editing the figures in a research paper is a routine and time-consuming part of everyday research practice: authors relabel components, rearrange panels, and restyle visuals as they revise their manuscripts. Automating this editing workflow under a natural-language instruction, however, is challenging, because a scientific figure is a dense infographic in which heterogeneous visual elements such as schematics, plots, photos, captions, and arrows are composed under a tight visual grammar to advance a specific argument. To address this, we present SciDiagramEdit, a benchmark and skill-evolution framework that learns from natural paper revisions and operates on the figure’s editable vector source, where users can inspect and co-edit individual primitives alongside the agent. Our benchmark mines before/after figure pairs from arXiv version histories, each grounded in the authors’ own revision intent. To accommodate the diversity of editing instructions, we adopt agentic learning via skill evolution: an agentic proposer continually refines the agent’s skill specification from execution traces over multiple epochs. The resulting skill progressively lifts edit accuracy on a held-out validation set, providing evidence that natural paper revisions are an effective training signal for instruction-driven figure editing.

cs.CV [Back]

[31] MultiRef-Compass: Towards Comprehensive Evaluation of Multi-Reference-to-Audio-Video Generation cs.CV | cs.SDPDF

Xiaohan Zhang, Yuqing Wen, Junlin Chen, Yuqi Tang, Yiting He

TL;DR: 本文提出了MultiRef-Compass，一个用于评估多参考音视频生成（MR2AV）任务的统一基准。该基准包含350个精心构建的样本，涵盖多视角主体保持、多实体绑定和人物-物体-场景组合等挑战，并定义了一个包含四个维度、14个子指标的评估协议。通过自动指标与增强型MLLM-as-a-Judge框架的结合，该工作对八个代表性MR2AV系统进行了全面评估，揭示了现有方法的不足。

Details

Motivation: 现有的基准主要关注文本驱动生成、单参考主体保持或孤立的音视频对齐，而新兴的多参考音视频生成（MR2AV）设置要求模型联合推理多个参考并生成同步的视听内容，这一领域在很大程度上尚未被探索。

Result: 在八个代表性MR2AV系统上进行的广泛实验表明，在多个评估维度上仍有巨大的改进空间，这突显了全面基准的必要性，并将MultiRef-Compass定位为未来MR2AV研究的基础。

Insight: 论文的创新点在于构建了一个专门针对MR2AV任务的综合性评估基准和协议，其核心在于通过可控的资产组合流程构建数据集，并整合自动指标与可审计的MLLM评判框架，以可扩展地评估感知保真度和参考条件组合能力，填补了该领域的空白。

Abstract: Multi-reference-to-audio-video (MR2AV) generation aims to generate coherent audio-video content conditioned on multiple references and textual instructions. Existing benchmarks mainly focus on text-driven generation, single-reference subject preservation, or isolated audio-video alignment, leaving the emerging MR2AV setting largely unexplored. Compared with these settings, MR2AV requires models to jointly reason over multiple references while generating synchronized visual and audio content. Models must not only preserve each reference faithfully but also correctly bind and compose multiple referenced entities into coherent audio-visual events. To address this gap, we introduce MultiRef-Compass, a unified benchmark for MR2AV generation. It comprises $350$ carefully curated samples constructed through a scalable and controllable asset-composition pipeline, covering multi-view subject preservation, multi-entity binding, and human-object-scene composition. To provide interpretable assessment, MultiRef-Compass defines an evaluation protocol with four dimensions: Basic Quality, Reference Consistency, Audio-Visual Consistency, and Instruction Following, using 14 sub-metrics. MultiRef-Compass integrates automatic metrics with a rejudging-enhanced MLLM-as-a-Judge framework, enabling scalable and auditable evaluation of both perceptual fidelity and reference-conditioned composition. Extensive experiments on eight representative MR2AV systems reveal substantial room for improvement across multiple evaluation dimensions, underscoring the need for a comprehensive benchmark and positioning MultiRef-Compass as a foundation for future MR2AV research.

[32] Inference-Time Concept Suppression and Video-Centric Evaluation for Text-to-Video Models cs.CV | cs.LGPDF

Wenxuan Chen, Wenjie Feng

TL;DR: 本文提出了一种无需训练的推理时概念抑制框架SIRUS，用于从文本到视频生成模型中可控地移除目标概念，同时保持视频质量和非目标内容。此外，论文还引入了一个面向视频的评估框架，从多个维度评估概念消除效果。

Details

Motivation: 解决文本到视频生成模型难以可控地移除特定概念的问题，需要在不更新模型参数的情况下抑制跨帧持续的目标概念，同时保留非目标内容、动作、场景和时间结构。

Result: 在CogVideoX上对五个安全、物体和风格概念进行测试，SIRUS达到70.4%的平均遗忘成功率和25.7%的平均帧命中率，优于VideoEraser的44.4%/47.2%，并将平均VBench质量下降从-0.043减少到-0.016，在完全评估的基线中实现了最强的遗忘-质量权衡。在Wan2.2上的迁移实验表明SIRUS能泛化到不同的T2V骨干模型。

Insight: 创新点在于提出了无需训练、仅需推理时干预的概念抑制方法，通过定位目标相关提示证据并在采样过程中抑制其表达；同时，构建了专门针对视频概念消除的多维度评估框架，包括目标遗忘、非目标保留、视频质量、抗越狱鲁棒性和效率等指标，为领域提供了更全面的评测标准。

Abstract: Text-to-video (T2V) generators can synthesize realistic and temporally coherent videos, but controllably removing a target concept from a generator remains difficult. Unlike text-to-image concept erasure, T2V unlearning must suppress a target concept that may persist across frames while preserving non-target subjects, actions, scenes, and temporal structure. We propose \textbf{SIRUS}, a training-free inference-time framework for concept-level T2V unlearning. Given textual aliases of a target concept, SIRUS localizes target-related prompt evidence and suppresses target expression during sampling, without updating the text encoder or denoising network. We further introduce a video-oriented evaluation framework for T2V unlearning that separately measures target forgetting, non-target preservation, video quality, jailbreak robustness, and efficiency, using video-level failure criteria, frame-level residue statistics, paired preservation analysis, VBench-based quality diagnostics, and deployment overhead measurement. Across five safety, object, and style concepts on CogVideoX, SIRUS reaches 70.4% average forgetting success and 25.7% average frame hit, compared with 44.4% / 47.2% for VideoEraser, while reducing the average VBench quality drop from -0.043 to -0.016, yielding the strongest forgetting-quality trade-off among fully evaluated baselines. Transfer experiments on Wan2.2 further suggest that SIRUS generalizes across modern T2V backbones.

[33] SeeSE3: Emergence of 3D Space in Vision Features cs.CV | cs.AIPDF

Caroline Chen, Sayna Ebrahimi, Fedor Kitashov, Ming-Hsuan Yang, Leonidas Guibas

TL;DR: 这篇论文探讨了视觉基础模型是否构建了反映3D欧几里得空间内在属性的表示。作者提出了一套从拓扑和几何角度评估视觉特征空间与SE(3)变换群关系的探针方法，发现自监督视觉模型存在与三维空间强相关的潜在子空间。基于此，论文提出了一种新的’潜在空间导航’技术，可在潜在空间中执行视觉里程计和定位，无需显式3D重建。

Details

Motivation: 研究动机是探究视觉基础模型（特别是自监督模型）的表示是否隐含地编码了3D欧几里得空间的结构，而非仅关注图像层面的深度或法线等量。

Result: 实验表明，当使用正确的探针方法时，自监督视觉模型的潜在子空间与三维欧几里得空间存在显著强相关性。

Insight: 创新点在于提出了从拓扑（互邻域度量）和几何（庞加莱适配器）角度评估特征空间与SE(3)对齐性的新探针方法，并由此启发了直接在潜在空间进行导航的新范式，避免了传统显式3D重建的复杂性。

Abstract: In this paper, we ask whether vision foundation models construct representations that reflect the intrinsic properties of 3D Euclidean space. Unlike previous works that probe 3D awareness of vision features by regressing image-centric quantities such as depth or normals, we investigate the relation between the structure of the space of visual features and the group of Euclidean transformations $SE(3)$. We propose a set of probes to evaluate this relation from both topological and geometric perspectives: a mutual neighborhood metric that measures the alignment between feature neighborhoods and spatial topology, and a Poincaré Adapter to test the linear accessibility of the geometry of camera motion from latent displacements in static scenes. We show that self-supervised vision models, which, in principle, have not been trained with direct 3D supervision or active agency, possess latent subspaces that are remarkably strongly correlated with three-dimensional Euclidean space, when probed correctly. Building on this insight we propose a new class of “Latent-Space Navigation” techniques that perform visual odometry and localization purely in the latent space, bypassing the need for explicit 3D reconstruction.

[34] KeyFrame-Compass: Towards Comprehensive Evaluation of Keyframe-Conditioned Video Generation cs.CVPDF

Yuqi Tang, Tengfei Liu, Yizheng Lai, Yuran Wang, Yang Shi

TL;DR: 本文提出了KeyFrame-Compass，这是首个用于评估关键帧条件视频生成的综合基准。该基准包含386个精心策划的样本，涵盖多个应用领域和生成设置，并引入了一个自动化评估框架，联合测量关键帧执行度和整体视频质量。通过对九个代表性视频生成系统的实验，揭示了当前模型在忠实执行关键帧与自然视频合成之间存在明显权衡等基本局限性。

Details

Motivation: 尽管当前视频生成模型支持多关键帧条件生成，但尚不清楚它们是否能忠实地再现指定的关键帧，同时保持整体视频质量。因此，需要建立一个全面的基准来系统评估这一能力。

Result: 在九个代表性视频生成系统上的实验表明，当前模型在忠实关键帧执行和自然视频合成之间存在明显权衡；随着关键帧约束变密，性能进一步下降；大多数开源模型无法将故事板网格输入解释为时序有序的关键帧序列。

Insight: 创新点在于首次构建了全面的关键帧条件视频生成评估基准（KeyFrame-Compass）和一个自动化评估框架，该框架将关键帧执行分解为六个互补的度量指标（如存在性、保真度、时序顺序等），并结合基于证据的多模态大语言模型（MLLM）判断来评估整体视频质量。这为系统分析和比较不同模型提供了标准化工具。

Abstract: Video generation increasingly relies on keyframe-based workflows, where creators specify a sequence of reference images to guide generation. Although recent models support multi-keyframe conditioning, it remains unclear whether they can faithfully reproduce the prescribed keyframes while maintaining overall video quality. We present KeyFrame-Compass, the first comprehensive benchmark for evaluating keyframe-conditioned video generation. The benchmark contains 386 carefully curated samples spanning three application domains, two video structures, two prompt granularities, two conditioning formats, and four keyframe densities, enabling controlled analysis under diverse generation settings. We further introduce an automated evaluation framework that jointly measures keyframe execution and overall video quality. Specifically, we decompose keyframe execution into six complementary metrics covering presence, fidelity, temporal ordering, localization, persistence, and uniqueness, while assessing overall video quality through evidence-grounded MLLM judgments augmented with specialized perception models. Experiments on nine representative video generation systems reveal several fundamental limitations. Current models exhibit a clear trade-off between faithful keyframe execution and natural video synthesis. Their performance further degrades as keyframe constraints become denser and most open-source models also fail to interpret storyboard-grid inputs as temporally ordered keyframe sequences.

[35] MonteRET: AI Agent Enhancing Multimodal LLMs with Multi-granularity Knowledge Retrieval for Chest CT Report Generation cs.CV | cs.CLPDF

Yi Lin, Yihao Ding, Elana Benishay, Elefterios Trikantzopoulos, David Nauheim

TL;DR: 本文提出了MonteRET，一种用于胸部CT报告生成的区域感知检索增强框架。该框架通过整合全局CT特征与区域级解剖表示，利用预测的医疗状况和区域级视觉-语言对齐检索临床相关知识，并通过知识引导的报告重写智能体优化初始报告。

Details

Motivation: 自动化胸部CT报告生成面临挑战，因为临床可信的报告需要全面的全容积理解和准确的局部解剖发现描述。

Result: 在RadGenome-ChestCT公共测试集（1,564个CT扫描）和外部队列（82个CT扫描）上评估，MonteRET在报告质量、语义相似性和临床效能方面优于匹配基线和多个SOTA方法，尤其在召回率上提升显著，表明遗漏发现更少，并获得了放射科住院医师的人类专家评估认可。

Insight: 创新点在于结合了多粒度知识检索（全局与区域级）和基于检索知识的智能体重写机制，以增强对局部解剖发现的描述准确性，减少遗漏。

Abstract: Automated chest CT report generation remains challenging because clinically faithful reporting requires both whole-volume understanding and accurate description of localized anatomical findings. Here we developed and retrospectively evaluated MonteRET, a region-aware retrieval-enhanced framework for generating chest CT findings sections. MonteRET integrates global CT features with region-level anatomical representations, retrieves clinically relevant knowledge using predicted medical conditions and region-level vision-language alignment, and refines initial reports through a knowledge-guided report rewriting agent. We trained our model on a public cohort with 24,128 CT scans from RadGenome-ChestCT. We evaluated MonteRET on the public RadGenome-ChestCT test set of 1,564 CT scans and an external cohort of 82 CT scans from NewYork-Presbyterian/Weill Cornell Medical Center. MonteRET improved report quality, semantic similarity, and clinical efficacy compared with a matched baseline and several state-of-the-art methods. Gains were most pronounced for recall, suggesting fewer omitted findings. Human expert evaluation by radiology residents also favored MonteRET.

[36] DCVC-MB: Neural B-Frame Video Compression using State Space Models cs.CVPDF

Arjun Arora, Calvin-Khang Ta, Carlos Restrepo-Galeano, Kruthi Murali, Naga Akhil E S

TL;DR: 本文提出了DCVC-Mamba (DCVC-MB)，一个用于B帧编码的神经视频编解码器框架。该框架结合了用于低延迟B帧编码的IBP帧策略、基于状态空间模型的双向时空预测融合模型，以及一个熵感知跳过机制来选择性省略某些潜在特征的编码以减少熵编码时间。实验表明，该方法在压缩性能上优于现有的神经编解码器和传统编解码器。

Details

Motivation: 旨在开发一个高效的神经B帧视频压缩框架，以解决传统和现有神经方法在双向预测和编码效率上的不足，实现更好的压缩性能。

Result: 在实验中，该方法相比先前的神经视频编解码器平均实现了高达8.98%的BD-rate降低，并且相比VTM-19.0-LDP和VTM-19.0-RA(Inter-GoP=16)基准分别提升了高达30.45%和1.81%的性能，达到了先进的压缩水平。

Insight: 创新点包括：将状态空间模型（如Mamba）引入视频压缩用于双向时空预测融合，以及熵感知跳过机制来优化编码效率；从客观角度看，将现代序列模型（SSM）与视频压缩任务结合是一个有前景的方向，其低延迟IBP帧策略和推理时优化策略也具有实用价值。

Abstract: In this paper we propose DCVC-Mamba (DCVC-MB), a neural video codec framework for B-frame coding. Our approach incorporates an IBP frame strategy for low-delay B-frame coding, a spatio-temporal fusion model based on state-space models for bidirectional temporal prediction, and an entropy-aware skipping mechanism that selectively omits coding certain latents to reduce entropy coding times. In addition to our model contributions we also implement two inference-time strategies that enhance compression performance. Experimental evaluation shows that DCVC-MB compares favorably to existing NVCs and traditional codecs. The method demonstrates BD-rate reductions of up to $8.98%$ on average compared to prior neural video codecs, and improvements of up to $30.45%$ and $1.81%$ over the VTM-19.0-LDP and VTM-19.0-RA(Inter-GoP=16) benchmarks, respectively, contributing to advances in neural video compression.

[37] SD-MAR: Multi-image Analytical Reasoning via Synthetic Data and Reinforcement Learning cs.CV | cs.CLPDF

Shiyu Yuan, Sourav Sanjukta Bhabesh, Zhe Wang, Dmitriy Bespalov, Wesley Rose

TL;DR: 该论文提出了SD-MAR框架，旨在解决视觉语言模型在多图像分析推理任务（如比较、变化检测）上的不足。该框架通过合成数据和一种名为GRPO-lite with BDA的强化学习方法对模型进行微调，显著提升了模型在特定基准上的性能，并保持了良好的泛化能力。

Details

Motivation: 现有视觉语言模型在感知任务上表现出色，但在需要跨多个视觉状态进行分析推理的任务（如多图像比较、变化检测）上能力有限，且缺乏专门的基准来评估和训练这种能力。

Result: 在Qwen2.5-VL-7B和InternVL3-8B模型上的实验表明，使用SD-MAR和GRPO-lite微调后，模型在SD-MAR基准上的准确率最高提升了36.95%，其中Qwen2.5-VL-7B的表现超过了GPT-4.1。同时，在MME、MMMU-Pro、MathVista等外部基准上的泛化性能得以保持或略有提升。

Insight: 主要创新点在于构建了专门针对多图像分析推理的合成数据框架SD-MAR，以及提出了一种去除KL正则化、对后期推理步骤给予更高奖励分配的强化学习优化方法（GRPO-lite with BDA），这有助于模型专注于形成分析结论的关键步骤。

Abstract: Vision Language Models (VLMs) demonstrate strong perceptual abilities but remain limited in tasks requiring analytical reasoning across multiple visual states, such as multi-image comparison, change detection, and multi-step visual inference. These capabilities are critical for real-world multimodal applications where reasoning must be grounded in systematic differences between visual contexts. However, existing benchmarks rarely require both explicit visual comparison and analytical reasoning, leaving this capability underexplored. To address this gap, we introduce SD-MAR (Synthetic Data for Multi-image Analytical Reasoning), a framework for training and evaluating VLMs on multi-image analytical reasoning. SD-MAR constructs paired visual scenarios through controlled perturbations and generates reasoning tasks spanning semantic change attribution and quantitative comparison. We further train VLMs using GRPO-lite with Backward Discounted Allocation (BDA), a reinforcement learning approach that removes KL regularization to encourage stronger policy optimization while allocating greater credit to the later reasoning steps where analytical conclusions are formed. Experiments on Qwen2.5-VL-7B and InternVL3-8B show that GRPO-lite fine-tuning on SD-MAR improves in-domain accuracy by up to 36.95%, with Qwen2.5-VL-7B outperforming GPT-4.1 on the SD-MAR benchmark. Importantly, out-of-domain generalization is preserved or improved: performance remains within 1% on MME, MMMU-Pro, and MathVista, while improving by up to 4% on MMBench. LLM-as-judge evaluation further demonstrates consistent improvements in logical coherence and explanation quality across both models.

[38] Dynamic Manipulation Hypergraphs for HAR: Beyond Pairwise Relations: Dynamic Manipulation Hypergraphs for Vision-Based Human Activity Recognition cs.CVPDF

Fatemeh Ziaeetabar

TL;DR: 该论文提出了一种动态操纵超图框架，用于细粒度的人体活动识别，通过建模手、物体、工具和支撑面之间随时间演化的高阶关系，超越了传统基于成对关系的图方法。该方法在EPIC-KITCHENS-100/VISOR和Assembly101数据集上进行了定量评估，并在ARCTIC数据集上进行了定性分析，证明了时变高阶关系建模的价值。

Details

Motivation: 细粒度操纵识别需要建模手、物体、工具和支撑面之间不断演化的关系，而传统的基于图的方法使用成对边，可能将一个协调事件分割成不连贯的二元关系，因此需要一种能表示多实体配置的高阶关系单元的方法。

Result: 在EPIC-KITCHENS-100/VISOR数据集上，该方法比匹配的成对图在HO-F1指标上提高了6.9个百分点，在Assembly101数据集上提高了9.5个百分点；与静态超图相比，分别提高了4.4和5.8个百分点，达到了SOTA水平。

Insight: 创新点在于提出了动态操纵超图框架，通过超边候选实例化和排名（基于接近、接触和运动耦合谓词），以及超图推理网络进行节点到超边和超边到节点的消息传递，并结合时变交互结构的时间注意力，实现了对多实体配置的高阶关系建模，同时提供了类别无关的超边重要性分数以识别关键实体配置和时间间隔。

Abstract: Fine-grained manipulation recognition requires modeling evolving relations among hands, objects, tools, and supporting surfaces. Conventional graph-based methods use pairwise edges that can fragment a coordinated event into disconnected binary relations. We propose a dynamic manipulation hypergraph framework that represents multi-entity configurations as higher-order relational units. At each temporal step, relevant entities are encoded using appearance, spatial, motion, and semantic-role features. Hyperedge candidates are instantiated and ranked using proximity, contact, and motion-coupling predicates. A hypergraph reasoning network performs node-to-hyperedge and hyperedge-to-node message passing, followed by temporal attention over the evolving interaction structure. The framework provides class-agnostic hyperedge-importance scores that identify entity configurations and temporal intervals emphasized by the model without treating them as causal explanations. Quantitative evaluation is conducted on EPIC-KITCHENS-100/VISOR and Assembly101 under an annotation-assisted entity-localization protocol. Video-only and entity-based methods provide contextual comparisons, while a matched pairwise graph and a static hypergraph serve as the principal controlled baselines because they use identical entity inputs and comparable relational settings. The proposed method improves HO-F1 over the matched pairwise graph by 6.9 percentage points on EPIC-KITCHENS-100/VISOR and 9.5 points on Assembly101, and exceeds the static hypergraph by 4.4 and 5.8 points, respectively. Qualitative analysis on ARCTIC further shows correspondence between highly ranked hyperedges and contact-rich manipulation intervals. These results demonstrate the value of time-varying higher-order relational modeling for fine-grained manipulation activity recognition.

[39] Reinforcing Egocentric Spatial Perception in Multimodal Large Language Models via Ego Scene Augmentation cs.CVPDF

Chi Kit Wong, Ye Pan, Yuanhuiyi Lyu, Xu Zheng, Zidong Cao

TL;DR: 本文提出了一种名为Ego Scene Augmentation (ESA)的自我中心空间感知框架，旨在增强多模态大语言模型在复杂自我中心场景中的空间推理能力。该框架通过构建一个名为Ego-element Graph的中间表示，利用视觉基础模型来封装和整合自我中心空间特征，从而提升模型在自我中心视觉问答任务上的性能。

Details

Motivation: 现有的多模态大语言模型在复杂自我中心场景中，由于其有限的空间感知能力，难以进行有效的空间推理。因此，需要一种方法来主动增强模型从自我中心视角出发的空间感知能力。

Result: 在EgoTextVQA基准测试中，提出的ESA框架带来了显著的性能提升：在室内设置上获得了8.14%的增益，在室外设置上获得了8.72%的增益。特别是在室内设置的购物子集上，ESA展示了最令人印象深刻的性能改进。

Insight: 核心创新在于引入Ego-element Graph作为中间表示，将视觉基础模型提取的自我中心空间特征进行封装和整合，并以此作为桥梁来增强MLLMs的空间感知能力。这是一种将结构化空间先验知识注入MLLMs的有效方法，而非仅依赖端到端的视觉-语言对齐。

Abstract: Egocentric Visual Question Answering (VQA) has attracted widespread attention as an important task for enabling Multimodal Large Language Models (MLLMs) to interact with the real world. However, existing MLLMs struggle to perform effective spatial reasoning in complex egocentric scenes due to their limited spatial perception capabilities. To this end, we introduce Ego Scene Augmentation (ESA), an egocentric spatial perception framework, which actively enhances the spatial perception capabilities from the egocentric perspective, powered by the proposed Ego-element Graph. Our core insight is leveraging the Ego-element Graph as an intermediary representation to augment the egocentric spatial perception of MLLMs via visual foundational models. Specifically, we 1) construct the Ego-element Graph, which encapsulates and integrates egocentric spatial features enabled by visual foundational models; 2) enhance the spatial perception capabilities of MLLMs via the Ego-element Graph for ego-perspective scenes. Our proposed ESA framework presents significant performance improvement on the EgoTextVQA benchmark. We achieve an 8.14% gain on the indoor setting and an 8.72% gain on the outdoor setting. Furthermore, our ESA shows the most impressive performance improvement in the shopping subset of the indoor setting. The project code is publicly available.

[40] Emergent Region-Level Facial Correspondence in Frozen Vision Foundation Models cs.CV | eess.IVPDF

Izaldein Al-Zyoud, Abdulmotaleb El Saddik

TL;DR: 本文研究了冻结的自监督视觉模型DINOv3在未经人脸特定训练的情况下，能否在跨身份和跨时间的视频中建立区域级的人脸对应关系。实验表明，DINOv3的中间层特征能够有效区分眼睛、眉毛、鼻子、嘴巴、皮肤和头发等面部区域，在跨身份匹配和时序跟踪任务上均取得了高准确率。

Details

Motivation: 动机在于探究冻结的通用自监督视觉模型（如DINOv3）的特征是否能够自然地编码人脸的区域级语义对应关系，尽管其训练数据并非人脸专用，且人脸在共享全局布局的同时，身份特异性外观差异显著。

Result: 在CelebDF-v2的200个真实视频上评估，DINOv3在跨身份最近邻匹配中实现了83.0%的区域级语义准确率（随机基线为23.0%），在时序标签传播中达到95.5%的跟踪准确率。与CLIP ViT-L/14相比，DINOv3在解剖结构区域上具有+16.8个百分点的优势。

Insight: 主要创新点在于揭示了冻结的、非人脸专用的自监督模型（DINOv3）能够作为零样本的强表征，用于密集的人脸区域对应分析，且中间层特征（如第18块）比最终层特征对此任务更为有效。同时，FaRL仅作为语义标签接口，而DINOv3提供了密集的空间对应关系。

Abstract: Frozen self-supervised vision models can align parts of generic objects, but it remains unclear whether this correspondence extends to human faces, where global layout is shared while identity-specific appearance varies sharply. We test whether frozen DINOv3 features define a region-level facial coordinate system: a feature space in which eyes, brows, nose, mouth, skin, and hair remain distinguishable across people and across time without face-specific training. Using DINOv3 ViT-L/16 patch embeddings and FaRL only as a face-part labeling interface, we evaluate cross-identity nearest-neighbor matching and temporal label propagation on 200 CelebDF-v2 real videos. DINOv3 achieves 83.0% region-level semantic accuracy under unconstrained cross-identity matching, compared with a 23.0% area-weighted random baseline, and 95.5% temporal tracking accuracy without a learned temporal module. A no-FaRL control collapses to 0.9%, showing that FaRL supplies semantic initialization while DINOv3 supplies dense spatial correspondence. The strongest correspondence appears at an intermediate layer: block 18 gives a 4.93x same-region versus cross-region discrimination ratio, compared with 1.48x at the final block. Against CLIP ViT-L/14, DINOv3 shows only a small aggregate advantage but a +16.8 pp gain on anatomical regions, indicating that image-level contrastive supervision captures coarse facial layout but not fine-grained anatomical identity. These results establish frozen DINOv3 as a strong zero-shot representation for region-level facial correspondence and identify intermediate self-supervised features as the most useful layer for dense face analysis.

Xiaoran Xu, Yupeng Wu, Tianyu Xue, Yifan Xu, Xuanran Dong

TL;DR: 本文提出了VTM-Nav，一种用于跨场景物体目标导航的无训练视觉语言模型导航框架。该框架引入了一个持久的分层视觉-拓扑记忆（VTM），用于组织和重用智能体在相同场景中多次运行所获得的经验，并通过从粗到细的匹配进行检索，仅在记忆与当前观察一致时提供软指导。

Details

Motivation: 动机在于解决现有无训练方法在物体目标导航任务中通常采用的单次场景重置协议（episodic protocol）的局限性，提出了跨场景导航的新设定，要求智能体在固定场景中重复操作、仅保留自身获取的经验且模型参数固定，从而需要有效的方法来重用跨场景的经验。

Result: 在HM3D v0.1、HM3D v0.2和MP3D三个基准测试上，使用相同场景协议进行评估，VTM-Nav在所有基准上都取得了最佳性能，超越了增强版WMNav基线，证明了其结构化视觉-拓扑经验重用的有效性和鲁棒性。

Insight: 创新点在于提出了跨场景物体目标导航的新任务设定，并设计了分层视觉-拓扑记忆（VTM）来组织场景知识（房间级和物体级）和实现从粗到细的经验检索，同时通过保守执行守卫来缓解振荡、阻塞运动和过早停止等问题，实现了无需训练的经验重用框架。

Abstract: Object-goal navigation requires an embodied agent to locate and reach an instance of a specified object category in an indoor environment. Recent training-free approaches leverage vision-language models (VLMs) for open-vocabulary semantic reasoning, but are typically evaluated under an episodic protocol that resets all scene-specific state after each episode. We introduce Cross-Episode Object-Goal Navigation, in which an agent repeatedly operates in the same scene, retains only self-acquired experience, and keeps its model parameters fixed. To support experience reuse, we present \method, a training-free VLM navigation framework with a persistent hierarchical Visual-Topological Memory (VTM). The VTM organizes scene knowledge at room and object levels and retrieves relevant experience through coarse-to-fine matching, providing memory as soft guidance only when it agrees with current observations. A conservative execution guard further mitigates oscillations, blocked motions, and premature stopping. Under a controlled same-scene protocol, we evaluate \method{} on three benchmarks, HM3D v0.1, HM3D v0.2, and MP3D, and compare it with a strengthened WMNav baseline augmented with cross-episode textual memory, while keeping the VLM backbone and action pipeline identical. \method{} achieves the best performance across all three benchmarks, demonstrating the effectiveness and robustness of structured visual-topological experience reuse across datasets.

[42] Uni-AdaVD: Universal Concept Erasure for Visual Generation via Orthogonal Value Decomposition cs.CVPDF

Qifan Zhou, Yuan Wang, Yanbin Hao, Xiang Wang, Kuien Liu

TL;DR: Uni-AdaVD是一个通用的推理时概念擦除框架，用于视觉生成模型。它通过将多模态注意力中的值空间作为统一的干预空间，结合编码器感知的目标表示构建和正交值分解，在不更新原始模型权重的情况下抑制目标语义方向，从而实现高效的概念擦除。

Details

Motivation: 视觉生成模型从未经筛选的预训练数据中不可避免地吸收了不良概念，因此概念擦除对于安全部署至关重要。现有擦除方法通常是架构特定的，难以在移除目标概念的同时保留非目标内容和生成先验。

Result: 在U-Net、DiT、自回归图像生成器以及文生视频模型上的大量实验表明，该方法在单概念和多概念擦除任务上表现出色，同时能很好地保留非目标先验。

Insight: 创新点在于将多模态注意力值空间作为统一的干预空间，并引入编码器感知的目标表示构建来定位异构文本编码器中的目标语义。其核心是结合正交值分解与自适应擦除偏移，在不微调模型权重的情况下实现概念抑制，为现代视觉生成模型提供了一种高效、自适应的安全机制。

Abstract: Visual generative models inevitably absorb undesirable concepts from uncurated pretraining data, making concept erasure essential for safe deployment. Existing erasure methods, however, are often architecture-specific and struggle to remove target concepts while preserving non-target content and generative priors. We present Uni-AdaVD, a universal inference-time concept erasure framework for visual generation. Uni-AdaVD treats the value space of multimodal attention as a unified intervention space and introduces encoder-aware target representation construction to localize target semantics across heterogeneous text encoders. It further combines orthogonal value decomposition with an adaptive erasing shift to suppress target semantic directions without updating the original model weights. Extensive experiments on U-Net-, DiT-, and autoregressive image generators, as well as text-to-video models, demonstrate strong performance on single- and multi-concept erasure while preserving non-target priors. These results suggest that Uni-AdaVD provides an efficient and adaptable safety mechanism for modern visual generative models. Our code is available at https://github.com/QifanZhou/Uni-AdaVD.

[43] 3D Geometric Tooth Alignment Planning via Deep Reinforcement Learning cs.CVPDF

Yong Li, Jianwen Lou, Jiayue Ma, Yao-Xiang Ding, Youyi Zheng

TL;DR: 本文提出了一种基于深度强化学习（DRL）的自动化3D牙齿几何对齐路径规划框架。该方法将规划过程建模为马尔可夫决策过程（MDP），利用改进的深度确定性策略梯度（DDPG）算法，通过Transformer智能体、动态掩蔽方案和两阶段课程学习策略，生成从初始错位到最终目标对齐的序列轨迹。

Details

Motivation: 解决现代数字化正畸中，自动化生成从初始错位到目标对齐的3D几何牙齿对齐序列轨迹（即治疗路径）这一核心问题，旨在优化几何轨迹并整合关键空间约束（如牙齿间碰撞避免和路径效率）。

Result: 在基于临床数据的10K个专家设计治疗计划数据集上评估，实验结果表明，该方法在路径安全性和几何效率方面优于现有基线方法。

Insight: 主要创新点包括：使用Transformer智能体建模牙齿间复杂空间交互并处理高维状态-动作空间；引入动态掩蔽方案，每步仅移动稀疏牙齿子集以更好地模拟临床顺序对齐逻辑；采用两阶段课程学习策略逐步增加任务难度以确保训练稳定性和高效路径发现。从客观角度看，将DRL与特定领域约束（如临床逻辑）紧密结合，为复杂几何规划任务提供了可借鉴的自动化解决方案。

Abstract: 3D geometric tooth alignment planning, which determines sequential trajectories from initial malocclusion to the final target alignment, is a cornerstone of modern digital orthodontics. This paper presents a novel deep reinforcement learning (DRL) framework to automate the generation of these alignment paths. We formulate the planning process as a Markov Decision Process (MDP) to capture its sequential decision-making nature, focusing on optimizing geometric trajectories while integrating essential spatial constraints, such as inter-dental collision avoidance and path efficiency. The proposed method leverages the Deep Deterministic Policy Gradient (DDPG) algorithm, enhanced by three key innovations: (1) a Transformer-based agent to model complex spatial interactions between teeth and manage high-dimensional state-action spaces; (2) a dynamic masking scheme that restricts movement to a sparse subset of teeth per step, better reflecting the clinical logic of sequential alignment; and (3) a two-stage curriculum learning strategy that gradually increases task difficulty to ensure training stability and efficient path discovery. We evaluate our approach on a dataset of 10K expert-designed treatment plans based on clinical data. Experimental results demonstrate that our method outperforms existing baselines in terms of path safety and geometric efficiency, providing a robust and automated solution for 3D geometric orthodontic alignment planning.

[44] AdaTurn: Budget-Aware Test-Time Scaling for Active Visual Perception Agents cs.CVPDF

Susan Liang, Chao Huang, Filippos Bellos, Jing Bi, Jason J Corso

TL;DR: 本文提出了AdaTurn框架，用于解决主动视觉感知代理在部署时面临不同回合预算限制的问题。该框架通过预算感知训练，使代理能够根据允许的回合数调整行为，避免因预算不足导致的灾难性截断。核心创新包括FA-DAPO方法，将超预算事件转化为可训练的最后决策步骤，以及训练和推理时的预算随机化与负载均衡调度器。

Details

Motivation: 现有主动视觉代理在训练时假设预算未知，导致实际部署中若可用预算小于代理偏好的轨迹长度，交互常被截断而无法产生有效答案，即灾难性截断问题。

Result: AdaTurn显著提升了低预算下的准确性，例如在VisualProbe-Medium基准上，4回合的准确率从36.7%提高到47.6%，同时在大预算下保持强扩展性，并能有效迁移到多种骨干模型和通用多模态基准。

Insight: 创新点在于将预算限制显式地融入代理训练，通过FA-DAPO方法将超预算失败转化为可学习的最终决策步骤，使模型学会在无法使用更多工具时综合部分证据做出回答；同时，预算随机化和负载均衡调度提高了方法的实用性。

Abstract: Active visual agents solve fine-grained image tasks by interleaving reasoning with image-grounding actions across multiple turns. However, deployment-time rollout budgets are rarely fixed: some requests permit long rollouts, while others require the agent to act under a tight turn limit. Existing methods train the policy as if the rollout budget were hidden, so when the available budget is smaller than the trajectory the agent prefers, the interaction is often truncated before any valid answer is produced; we term this failure \emph{catastrophic truncation}. To overcome this challenge, we present AdaTurn, a budget-aware framework that conditions the agent on the allowed number of turns and explicitly trains the boundary behavior induced by the budget. Our key component, Forced-Answer DAPO (FA-DAPO), converts the over-budget event from a masked or penalized failure into a trainable final-decision step, teaching the model to synthesize partial evidence when further tool use is no longer possible. We further randomize rollout budgets during both training and inference and introduce a load-balanced scheduler that makes such operations practical. AdaTurn substantially improves low-budget accuracy, for example raising VisualProbe-Medium from 36.7% to 47.6% at four turns, while preserving strong scaling at larger budgets and transferring effectively to multiple backbones and general multimodal benchmarks.

[45] HyMobileAgent: Data-Environment Co-Scaling for Efficient GUI Agents cs.CVPDF

Hy Vision Team, Huawen Shen, Zhengyang Tang, Shangpin Peng, Liang Wu

TL;DR: 本文提出了HyMobileAgent，一个用于移动GUI自动操作的智能体。它基于Hy3.0-VL-A3B视觉基础模型构建，并通过一个数据和环境协同扩展的框架来解决移动交互中的关键瓶颈，包括复杂界面的精确感知、高质量交互数据的可扩展获取以及长程决策的鲁棒性。

Details

Motivation: 动机是解决移动GUI智能体在复杂界面感知、高质量数据获取和长程决策鲁棒性这三个耦合约束下的操作挑战，推动数字具身智能在移动环境中的发展。

Result: 论文构建了包含超过2000个沙箱和真实设备实例的百万级动作数据管道，以及一个包含34个模拟应用和超过34000个任务的可重置训练环境PhoneWorld Mock App Factory，为高效训练和评估提供了基础设施。

Insight: 创新点在于提出了一个数据和环境协同扩展的框架，而非单纯依赖模型缩放。该框架集成了GUI感知飞轮、从教程视频提取结构化数据的知识管道、大规模自动化数据收集与故障归因系统、可重置的模拟训练环境，以及带有显式死循环检测的结构化规划-反思机制，形成了一个系统性的解决方案。

Abstract: As large multimodal models move from understanding content to operating on digital environments, mobile GUI has emerged as a challenging and consequential testbed for digital embodied intelligence. Mobile agents operate under three coupled constraints: precise perception of complex interfaces, scalable acquisition of high-quality interaction data, and robust long-horizon decision making under compounding execution errors. This report presents HyMobileAgent, a mobile GUI agent built on Hy3.0-VL-A3B, a vision-native foundation model featuring native any-resolution input, an A3B-scale deployment budget, and a 32K context window to model extended interaction histories. Rather than relying solely on model scaling, we develop a joint data and environment centric scaling framework to address the key bottlenecks of mobile interaction. Our framework integrates a GUI perception flywheel combining mock-interface synthesis, rejection sampling, and icon-specific augmentation; a knowledge pipeline that transforms tutorial videos into structured interaction data; a million-scale action data pipeline deployed across more than 2000 sandbox and real-device instances with automated failure attribution; the PhoneWorld Mock App Factory, providing a resettable training environment with 34 mock applications and over 34000 tasks; and a structured Planning-and-Reflection mechanism with explicit dead-loop detection for reliable long-horizon execution. We also introduce a progressive training recipe consisting of mid-training, supervised fine-tuning, and reinforcement learning with task-specific reward designs.

[46] MagicPrompt: Ultra-Lightweight Prompt Tuning for Video Generation cs.CVPDF

Yinhan Zhang, Dinwei Tan, Xianghao Kong, Yue Ma, Yeying Jin

TL;DR: 本文提出了MagicPrompt，一种用于视频生成的超轻量级提示调优框架。该框架通过注意力嵌入提示调优（Attention-Embedded Prompt Tuning）和双空间奖励反馈优化（Dual-Space Reward Feedback Optimization），在保持预训练知识的同时，以极少的可训练参数（<1%）实现了高效的视频扩散模型下游任务适配，并显著降低了训练成本。

Details

Motivation: 解决大规模视频扩散模型（VDMs）在下游任务上进行全微调时计算成本过高的问题，并克服现有参数高效微调（PEFT）方法在十亿级模型上仍需要大量可训练参数，以及基于奖励的训练在条件引导任务中因噪声导致的优化不稳定等关键缺陷。

Result: 实验表明，MagicPrompt在可训练参数少于1%的情况下，达到了具有竞争力的性能，并显著降低了训练成本。

Insight: 创新点在于结合了注意力嵌入的轻量级软提示来引导生成，以及利用自监督的潜在空间目标来稳定条件引导的奖励训练，从而在参数效率和优化稳定性上实现了突破。

Abstract: Large-scale video diffusion models (VDMs) deliver strong generation performance, but full fine-tuning for downstream tasks incurs prohibitive computational costs. Existing parameter-efficient fine-tuning (PEFT) methods have two critical flaws on billion-scale models: they still require substantial trainable parameters, and reward-based training suffers from noise-induced optimization instability in condition-guided tasks. We propose MagicPrompt, a lightweight framework that achieves extreme parameter efficiency and stable reward optimization. It first adopts Attention-Embedded Prompt Tuning, which steers generation via lightweight soft prompts with orders of magnitude fewer parameters while preserving pre-trained knowledge. It further introduces Dual-Space Reward Feedback Optimization, which uses self-supervised latent objectives to improve condition-guided reward training. Experiments show MagicPrompt reaches competitive performance with less than 1% trainable parameters and notably reduces training costs.

[47] Knowing You at First Glance: Inferring Apparent Personality from Faces cs.CV | cs.AIPDF

Shuhuan Chen, Xiangyu Zhu, Weisong Zhao, Haichao Shi, Xiao-Yu Zhang

TL;DR: 本文提出GlanceFace框架，通过视觉语言模型引入语义先验，结合语义增强的面部表征模块和不确定性感知学习策略，从面部图像推断第一印象人格特质，重点关注MBTI人格模型。

Details

Motivation: 解决仅凭面部外观（而非对话）推断第一印象人格特质的问题，特别是针对实践中广泛使用且更易被大语言模型解释的MBTI类型，探索面部线索是否能支持有意义的关联。

Result: 在基于MBTI的第一印象人格基准测试中表现出强大性能，揭示了面部特征与感知人格特质之间的关系。

Insight: 创新点包括利用视觉语言模型引入语义先验、语义增强的面部表征模块捕捉细微线索，以及不确定性感知学习处理噪声和主观标注，为具身智能体提供自适应初始交互策略支持。

Abstract: Inferring apparent personality from facial images is important in social scenarios for embodied agents in human-robot interaction. Unlike inferring intrinsic personality traits via conversation, this task models first-impression personality perception based solely on facial appearance before interaction begins. Existing studies mainly focus on the Big Five personality model and often rely on language or multimodal inputs. As a result, it remains unclear whether facial cues alone can support meaningful associations with perceived personality traits. This question is particularly relevant for MBTI types, which are widely used in practice and more readily interpretable by large language models. To this end, we propose \textbf{GlanceFace}, an end-to-end framework for apparent personality inference leveraging vision-language models to introduce semantic priors and a semantic-enhanced facial representation module to capture subtle personality-related cues, together with an uncertainty-aware learning strategy to handle noisy and subjective annotations. Extensive experiments demonstrate strong performance on MBTI-based apparent personality benchmarks and reveal relationships between facial characteristics and perceived personality traits, highlighting its potential to support adaptive initial interaction strategies for embodied agents. The code and dataset are available at https://github.com/MrHuan3/GlanceFace.

Yunfeng Liu, Yuandong Yang, Jiarui Han, Zhenpeng Huang, Yuqing Tang

TL;DR: 本文介绍了VIABench，一个专门用于评估多模态大语言模型在视觉障碍辅助场景中性能的综合视频基准。该基准包含三个核心任务：主动提醒、视觉问答和视觉引导交互，旨在通过盲人自录的第一人称视频全面测试模型的实际辅助能力。

Details

Motivation: 当前多模态大语言模型在通用视觉语言任务上表现出色，但其在真实世界盲人辅助场景中的实际效用尚未得到充分探索，视觉障碍人士因视觉信息获取受限而面临日常挑战，因此需要专门的基准来推动相关研究。

Result: 实验表明，当前的多模态大语言模型在提供全面视觉障碍辅助方面仍存在困难，特别是在需要准确预测和实时响应的主动提醒任务上表现不佳。

Insight: 创新点在于构建了首个基于盲人第一人称视频的综合辅助基准VIABench，并定义了三个针对性任务以系统评估模型能力；其提出的支持在线和离线设置的严格评估流程，为开发面向真实场景的定制化MLLMs提供了重要方向。

Abstract: Visually impaired individuals (VIIs) encounter significant daily challenges due to limited access to visual information. Although Multimodal Large Language Models (MLLMs) have achieved impressive results on general vision and language tasks, their practical utility in real-world blind assistance still remains largely underexplored. To fill this gap, we introduce VIABench, a comprehensive video benchmark specifically designed to evaluate MLLMs in Visually Impaired Assistance scenarios using first-person videos recorded or shared by VIIs themselves. VIABench defines three core tasks, each targeting a distinct requirement in visual assistance. Proactive Reminder: Assesses the model’s ability to interpret ongoing video content while proactively anticipating and verbally describing upcoming navigation-critical events; Visual Question Answering (VQA): Evaluates the model’s capacity to answer user-posed questions about the environment or objects within the video; Vision-Guided Interaction: Tests context-aware reasoning to accomplish intentional interactions between user and environment. To ensure a robust and fair evaluation, we propose a rigorous benchmarking pipeline that supports both online (real-time) and offline settings. Our experiments demonstrate that current MLLMs still struggle to deliver comprehensive support for VIIs, especially in the Proactive Reminder task, which demands accurate anticipation and real-time responsiveness. We hope VIABench will drive future research toward developing customized MLLMs for real-world assistance, ultimately improving navigation and interaction experiences for visually impaired individuals. Code and data will be released at https://github.com/MCG-NJU/VIABench.

[49] ReBind: Multi-Reference Video Editing via Structured Instructions with Explicit Reference Relationships cs.CVPDF

Xinyu Liu, Shihao Li, Weihong Lin, Xinlong Chen, Yang Shi

TL;DR: 本文提出ReBind框架，通过引入带有显式参考关系的结构化指令来解决多参考图像条件视频编辑中信息协调不准确的问题。该框架包含ReBind-Instruct和ReBind-Edit两个核心组件，前者生成精确的绑定指令，后者实现轻量级模型适配以协调多个视觉参考源。

Details

Motivation: 现有基于扩散模型的多参考图像条件视频编辑方法在协调多个视觉源信息时存在困难，主要原因是编辑指令缺乏显式参考关系，且通用多模态大语言模型无法可靠生成此类指令。

Result: 大量实验表明，ReBind在指令生成质量上显著优于通用多模态大语言模型，并在开源的多参考图像条件视频编辑方法中达到了最先进的性能水平。

Insight: 核心创新在于提出将参考令牌嵌入到语义位置以消除歧义，从而在视觉属性与其来源之间建立精确绑定的中间表示方法，并设计了两阶段渐进式方案来训练专门的指令生成模型。

Abstract: Recent diffusion-based video generation models have made significant progress in multi-reference image-conditioned video editing. However, existing methods still struggle to coordinate information from multiple visual sources accurately. We identify a critical deficiency in existing approaches. Existing editing instructions lack explicit reference relationships, and most multimodal large language models (MLLMs) cannot generate them reliably. To address this problem, we propose ReBind, a systematic framework that introduces semantic instructions with embedded reference tokens as the intermediate representation for multi-reference image-conditioned video editing. Our key insight is embedding reference tokens at semantic positions to eliminate ambiguity and establish precise bindings between visual attributes and their sources. We develop ReBind-Instruct, a specialized MLLM that learns to establish explicit bindings between visual attributes and their reference sources through a two-stage progressive scheme for precise reference relationships. We further develop ReBind-Edit, which enables lightweight adaptation of text-to-video models to coordinate multiple references by binding visual attributes to their designated sources. Extensive experiments demonstrate that ReBind substantially outperforms general-purpose MLLMs in instruction quality and achieves state-of-the-art performance among open-source methods on reference image conditioned video editing. Our project webpage: https://rebind-mrv2v.github.io/.

[50] Autoregressive Modeling of Film with Applications in Video Montage cs.CVPDF

Marcelo Sandoval-Castañeda, Fabian Caba Heilbron, Shiry Ginosar, Bryan Rusell, Josef Sivic

TL;DR: 本文提出了FilmGPT，一种自回归Transformer模型，用于解决视频蒙太奇编辑的挑战，即将原始、无序的镜头素材转化为连贯的电影序列。该模型通过在大规模电影语料库上进行训练，学习电影的’语法’，并引入素材约束解码算法，从输入素材中选择最佳的下一个镜头，而无需生成新视频帧。

Details

Motivation: 动机在于解决视频蒙太奇编辑中从原始素材自动生成连贯序列的问题，受现代大语言模型语言学习的启发，旨在从数据中隐式捕捉电影的’语法’，而非依赖手工编码规则。

Result: 在标准镜头序列排序基准测试中，FilmGPT在下一个镜头预测任务上超越了先前的最先进方法；通过用户研究评估完整电影编辑任务，基于FilmGPT的编辑显著优于先前方法。

Insight: 创新点在于将自回归建模应用于视频蒙太奇，通过素材约束解码算法实现非生成式编辑，直接从数据学习电影语法，并可扩展应用于自动视频片段修剪和人机协同编辑等广泛场景。

Abstract: This work introduces FilmGPT, an autoregressive transformer designed to address the challenge of video montage–turning a collection of raw, “unwatchable” footage into coherent cinematic sequences. Inspired by language learning in modern LLMs, we train a long-context autoregressive transformer on a large corpus of movies. The aim is to implicitly capture the “grammar” of film directly from data rather than from hand-coded rules. Unlike other generative models, FilmGPT does not generate any new video frames. Instead, at inference time, we introduce a footage-constrained decoding algorithm to select the best next shot from the input raw footage according to the statistical patterns learned from films. We first evaluate these learned statistics directly by using the FilmGPT autoregressive model for next shot prediction on a standard benchmark of shot sequence ordering, outperforming the previous state of the art. We then evaluate our footage-constrained decoding algorithm on the full film editing task via a user study, and find that our FilmGPT-based editing significantly outperforms previous approaches. Finally, we demonstrate the applicability of FilmGPT to a wide range of applications in video montage, from automatic video segment trimming to human-in-the-loop film editing.

[51] GlobalForge: Towards Robust AI-Generated Image Detection cs.CVPDF

Manni Cui, Ruiqi Liu, Dianyuan Zou, Ziheng Qin, Jingrui Xu

TL;DR: 本文提出GlobalForge框架，旨在提升AI生成图像检测器在真实世界图像经过传播和退化后的鲁棒性。该框架通过抑制局部伪影学习并强制模型进行全局结构推理，以应对JPEG压缩和模糊等常见退化操作。

Details

Motivation: 现有AI生成图像检测器在干净基准上表现良好，但在图像经过真实世界传播通道（如压缩、模糊）后性能急剧下降，原因是它们过度拟合了生成器留下的、易被破坏的局部伪影。

Result: 在8个真实世界基准组上，GlobalForge将平均平衡准确率（BAcc）比先前SOTA提升了5.89%；在作者新提出的RealDeg-Bench（包含7种常见退化操作及其复合链）上，无论是单一还是复合退化，GlobalForge均明显领先于代表性基线方法。

Insight: 核心创新在于将判别线索从脆弱的局部伪影转向更鲁棒的全局结构，具体通过局部信息瓶颈模块抑制局部捷径学习，以及全局结构推理模块强制令牌进行长距离证据聚合，并采用基于退化的对比结构损失进行联合训练。此外，引入的RealDeg-Bench为细粒度鲁棒性评估提供了支持。

Abstract: AI-generated image (AIGI) detectors achieve strong accuracy on clean benchmarks, but their performance drops sharply after images are propagated through real-world channels. We trace this fragility to what these detectors actually learn: they overfit to local artifacts left by generators in small spatial neighborhoods, which are easily destroyed by common propagation degradations such as JPEG compression and blur. Instead, we shift the discriminative cue from fragile local artifacts to more robust global structure. Building on this, we propose GlobalForge, a framework with two complementary modules. The Local Information Bottleneck (LIB) suppresses local components to block shortcut learning, while the Global Structural Reasoning (GSR) module forces every token to gather evidence from distant regions. Both modules are trained jointly under a contrastive structural loss based on degradation that keeps the resulting features stable under degradation. To support fine-grained robustness evaluation, we further introduce RealDeg-Bench, covering 7 common degradation operators and multi-step compound chains. GlobalForge improves average BAcc on 8 in-the-wild benchmark groups by $\mathbf{5.89%}$ over the previous state-of-the-art, and is clearly ahead of representative baselines on RealDeg-Bench under both single and compound degradations. Code is available at https://anonymous.4open.science/r/GlobalForge-BE0F/.

[52] Team RAS in 11th ABAW Competition: Multimodal Ambivalence Recognition Approach cs.CV | cs.AIPDF

Elena Ryumina, Maxim Markitantov, Alexandr Axyonov, Fedor Shchetinin, Timur Abdulkadirov

TL;DR: 本文提出了一种以文本为中心的多模态融合方法，用于视频级别的矛盾与犹豫情绪识别。该方法通过文本残差融合技术，将文本作为锚定模态，并基于其他模态（如语音、面部和场景特征）进行门控残差调整，从而提升识别性能。在ABAW竞赛的BAH语料库上，该方法在开发和公开测试子集上平均宏F1分数达到75.14%，在私有测试子集上达到78.24%，优于纯文本模型。

Details

Motivation: 自动识别矛盾与犹豫情绪具有挑战性，因为这些状态可能通过不一致的语言、声学、面部和上下文模式表达，而现有高性能系统通常依赖计算成本高的集成方法。本文旨在开发一种高效的单模型多模态方法来解决这一问题。

Result: 在ABAW竞赛的BAH语料库上，文本被证实为最强的单模态。文本残差融合模型在开发和公开测试子集上平均宏F1分数为75.14%，在私有测试子集上达到78.24%，比纯文本模型提升4.03%，显示出优于基准的性能。

Insight: 创新点在于提出以文本为中心的残差融合模型，将文本作为核心模态，通过门控机制整合其他模态信息，避免了传统集成方法的高计算开销。从客观角度看，这种方法有效利用了多模态互补性，在保持模型简洁性的同时提升了识别准确率。

Abstract: Automatic recognition of ambivalence and hesitancy is challenging because these states may be expressed through inconsistent linguistic, acoustic, facial, and contextual patterns, while top-performing systems often rely on computationally expensive ensembles. We present a single text-centered multimodal approach for video-level ambivalence and hesitancy recognition for the 11th Affective & Behavior Analysis in-the-Wild (ABAW) Challenge. The proposed approach combines linguistic, acoustic, facial, and scene features using text-centered multimodal fusion model. Text Residual Fusion treats text as the anchor modality and applies gated residual adjustments based on the other modalities. Experiments on the Behavioural Ambivalence/Hesitancy (BAH) corpus confirm that text is the strongest unimodal modality. The Text Residual Fusion model achieves an average Macro F1-score (MF1) of 75.14% across the Development and Public Test subsets. On the Private Test subset, it reaches an MF1 of 78.24%, outperforming the text model by 4.03%. These results demonstrate that complementary multimodal information can improve recognition performance without requiring a large model ensemble.

[53] Pretraining Multiple Instance Learning Networks with Multi-Teacher Distillation from Pathology Slide Foundation Models cs.CV | cs.AIPDF

Mingxi Fu, Jiawen Li, Renao Yan, Jiali Hu, Qiehe Sun

TL;DR: 本文提出了一种基于知识蒸馏的MIL预训练框架，利用TITAN和CARE两个病理切片级基础模型作为教师，将表征知识迁移到多种MIL架构中，并通过角度分散归一化蒸馏损失平衡不同教师的监督，为下游任务提供可复用的初始化权重。

Details

Motivation: 现有MIL聚合器通常针对每个下游任务从头训练，依赖有限的切片级标签同时学习聚合机制和判别表征，导致优化不稳定、过拟合和可迁移性差；而高质量切片级预训练数据稀缺，且MIL模型轻量级、弱监督，使得大规模预训练在实践中困难。

Result: 在15个基准数据集上，通过线性探测和全参数微调的系统评估表明，预训练普遍优于从头训练，尤其在线性探测和少样本场景中提升显著，同时保持了轻量级MIL模型的计算效率。

Insight: 创新点在于利用多个病理切片基础模型进行知识蒸馏来预训练MIL，解决了数据稀缺和模型轻量导致的预训练难题；提出的角度分散归一化蒸馏损失有效平衡了多教师监督，提升了模型在下游任务中的泛化能力和少样本学习性能。

Abstract: Multiple instance learning (MIL) has become the main paradigm for whole-slide image (WSI) analysis in computational pathology. However, existing MIL aggregators are still typically trained from scratch for each downstream task, relying on limited slide-level labels to learn both aggregation mechanisms and downstream discriminative representations simultaneously. As a result, they often suffer from unstable optimization, overfitting, and limited transferability. Similar to pretrained ResNet and Vision Transformer models in natural image learning, MIL also requires reusable pretrained initialization. However, high-quality slide-level pretraining data remain scarce, and MIL models are usually lightweight and weakly supervised, making large-scale pretraining difficult in practice. To address this challenge, we propose a distillation-based pretraining framework for MIL, which leverages two slide-level foundation models, TITAN and CARE, as teachers to transfer their representational knowledge into a diverse set of MIL architectures. To effectively balance supervision from different teachers, we further introduce an angular dispersion normalized distillation loss. The distilled weights are then used as initialization for downstream adaptation. We conduct systematic evaluations on 15 benchmark datasets under both linear probing and full-parameter fine-tuning, and further validate its advantages in few-shot scenarios. Experimental results show that pretraining generally improves MIL aggregators over from scratch training, especially in linear-probing and few-shot settings, while maintaining the computational efficiency of lightweight MIL models. Code is available at https://github.com/fu0201/MIL_Pretrained.

[54] Variational Inference for Bird’s Eye View Segmentation in Autonomous Driving cs.CV | eess.SYPDF

Jingyue Shi, Huaicheng Li, Junhui Zhao, Yanxiang Jiang

TL;DR: 本文提出了一种基于变分推断的鸟瞰图分割方法TVB，用于自动驾驶中的环境感知。该方法通过条件变分自编码器生成多个BEV候选图，并利用归一化流增强分布表达能力，最后通过注意力融合模块自适应整合多视图信息。

Details

Motivation: 自动驾驶中多摄像头传感器数据融合及复杂外部环境下的鸟瞰图分割仍面临挑战，作者旨在通过变分推断框架提升BEV分割的鲁棒性和准确性。

Result: 在nuScenes和OPV2V数据集上的实验表明，该方法在多摄像头BEV分割和车道环境感知任务中取得了优越性能，达到了先进水平。

Insight: 创新点包括将BEV分割重构为变分推断问题、引入归一化流增强生成分布的表达能力，以及设计注意力融合模块自适应整合多候选图，为多视图感知提供了概率化建模思路。

Abstract: The bird’s eye view (BEV) has emerged as a pivotal approach for environmental perception in autonomous driving, providing a unified spatial representation for vehicles. Nevertheless, despite BEV’s significance in addressing the challenges inherent to autonomous driving, effectively fusing data from multiple camera sensors and operating in complex external driving environments remains a considerable challenge. To mitigate this issue, we recast the BEV segmentation problem within a variational inference framework. In this paper, we propose a novel transformer-based variational flow transformation network for BEV segmentation, denoted as TVB. Our architecture implicitly learns the mapping from multiple camera views to a unified canonical BEV map during training by exploiting posterior BEV supervision. TVB employs a conditional variational auto encoder (CVAE) as its backbone and produces multiple BEV map candidates. To augment the realism of the generated BEV maps, we integrate normalizing flows into the map generation process, enabling the construction of more complex and expressive probability distributions. Furthermore, we design a BEV-attention fusion (BAF) module that harnesses attention mechanisms to adaptively integrate the multiple candidate BEV maps. Experimental results, evaluated on both the nuScenes and OPV2Vdatasets, demonstrate that our proposed method achieves superior performance in multi-camera view BEV segmentation and lane environment perception.

[55] Causal-Adversarial Probing of Clinical Covariates for Prostate MRI Grading cs.CVPDF

Yipei Wang, Shiqi Huang, Wen Yan, Weixi Yi, Dean C. Barratt

TL;DR: 本文提出了一种基于因果推理和对抗学习的框架，用于探究前列腺MRI癌症分级深度学习模型中临床协变量的作用。该框架通过抑制特定协变量的可解码性，同时保持基于MRI的分级预测性能，从而区分出可能有害的协变量依赖与任务相关的信号。

Details

Motivation: 旨在解决前列腺MRI分级模型中临床协变量的角色不明确的问题，即这些协变量可能编码了有用的疾病相关信号，也可能编码了非泛化的捷径信息，从而影响模型的泛化能力。

Result: 在2,903例前列腺MRI检查数据上开发和评估，并在576名患者上进行外部验证。在二元ISUP Grade Group ≥2分类任务中，抑制年龄、BMI和酒精使用分别使AUC提高了1.23%、0.84%和1.42%，而抑制PSA和前列腺体积则使AUC分别下降了1.91%和7.61%。

Insight: 创新点在于将因果推理与对抗学习结合，对模型表示进行细粒度分析，以区分协变量是作为干扰项、疾病相关代理还是无关变量。这为理解医学影像AI模型的决策机制和提升其泛化性提供了实用的表示层面分析工具。

Abstract: Deep learning models for prostate MRI-based cancer grading may encode clinical covariates that either reflect useful disease-related signal or non-generalising shortcut information, but their role is usually assumed. We propose a causal-reasoning framework for probing covariate dependence in MRI-based International Society of Urological Pathology (ISUP) Grade Group prediction. Rather than treating mpMRI as a direct cause of grade, we model MRI appearance and ISUP grade as observations of latent tumour pathology, and test whether candidate clinical variables act as nuisance correlates, disease-related proxies, or irrelevant covariates in the learned representation. We implement this using an adversarial framework that suppresses the decodability of individual clinical covariate at a time while preserving MRI-based grade prediction. The approach is developed and evaluated on 2,903 prostate MRI examinations, with external validation on 576 patients. We report a set of interesting and previously under-explored imaging-to-clinical-variable interactions in the context of deep learning generalisation. For examples, in binary ISUP Grade Group $\geq2$ classification, suppressing age, BMI, and alcohol use improved AUC by 1.23%, 0.84%, and 1.42%, respectively (all p < 0.05), suggesting reduced non-generalising covariate information; In contrast, suppressing PSA and prostate volume degraded AUC by 1.91% and 7.61% (all p < 0.001), indicating that these variables carried task-relevant signal. These findings show that adversarial covariate suppression can provide a practical representation-level analysis for distinguishing potentially harmful dependence from informative signal in prostate MRI grading models.

[56] VideoSEMA: a scalable and efficient Mamba-like attention for video understanding cs.CV | cs.AIPDF

Nhat Thanh Tran, Fanghui Xue andShuai Zhang, Jiancheng Lyu, Yunling Zheng, Yingyong Qi

TL;DR: 本文提出了一种用于视频理解（分类）的分割时空注意力模型VideoSEMA，它由空间上的可扩展高效Mamba类注意力（SEMA）块和时间上的softmax时序注意力组成。SEMA在每个帧内并行应用局部窗口注意力和全局平均池化，构成Mamba类宏架构。论文证明了在特定秩条件下，这种计算成本更低的分割时空注意力等价于完整的时空注意力。

Details

Motivation: 旨在为视频理解设计一个计算高效且可扩展的注意力模型，以解决现有视觉Transformer和Mamba模型在视频任务中计算开销大或性能受限的问题。

Result: 在K400基准数据集上，VideoSEMA性能优于更重的视觉Transformer和Mamba模型；在SSv2基准上，它在参数量相似的模型中取得了最高的top-1准确率。当图像分辨率从224²提升到1024²时（K400上无需微调），VideoSEMA的准确率下降幅度远小于VideoMamba，表现出更好的可扩展性。

Insight: 创新点在于提出了分割时空注意力架构，将空间和时间注意力解耦，并设计了Mamba类的SEMA块来高效捕获空间信息。其理论证明（在特定条件下与完整注意力等价）为高效模型设计提供了依据，且模型在分辨率缩放时表现出更强的鲁棒性，为扩展到更长视频（如通过膨胀/稀疏时序注意力）提供了可能。

Abstract: We present for video understanding (classification) a split space-time attention model, VideoSEMA, consisting of a scalable and efficient Mamba-like attention (SEMA) block in space and a softmax temporal attention in time. In each frame, SEMA attention applies a local window attention in parallel with a global averaging in a Mamba macro-architecture, which is called Mamba-like. Under certain rank conditions, we prove that the computationally cheaper split space-time attention is equivalent to full space-time attention. On benchmark K400 data sets, VideoSEMA out-performs heavier vision transformer and Mamba models. On benchmark SSv2 data, VideoSEMA leads in top-1 accuracy among models of similar parameter sizes. As image resolution scales up from standard $224^2$ to $1024^2$ on K400 and without fine-tuning, VideoSEMA degrades much more gracefully than VideoMamba in accuracy. It is promising to extend VideoSEMA to longer videos with a dilated/sparse temporal attention.

[57] Multimodality as Supervision: Self-Supervised Specialization to the Test Environment via Multimodality cs.CV | cs.LGPDF

Kunal Pratap Singh, Ali Garjani, Rishubh Singh, Muhammad Uzair Khattak, Efe Tarhan

TL;DR: 本文提出了一种名为Test-Space Training (TST)的自监督学习方法，通过在特定测试环境中收集多模态数据并利用跨模态学习进行预训练，旨在为该环境开发高性能模型。研究发现，仅使用测试环境中的多模态数据，就能达到与在大型互联网数据集上预训练的通用模型（如DINOv2和CLIP）相竞争的结果，从而减少对外部大规模预训练数据的依赖。

Details

Motivation: 论文的动机是利用设备在测试环境中丰富的多模态传感器数据，通过跨模态学习进行自监督表示学习，以专门针对特定环境（如家庭机器人部署）开发高效模型，这受到发展心理学中生物代理利用多模态构建环境表示的启发。

Result: 在相同环境的各种下游任务评估中，TST方法仅使用测试环境的多模态数据，就能与在大规模互联网数据集上预训练的通用模型（如DINOv2和CLIP）取得竞争性结果，展示了在特定环境中的高效性能。

Insight: 创新点在于提出用多模态作为监督信号，通过测试环境内的自监督预训练实现模型专业化，减少对互联网规模数据集的依赖；客观分析认为，该方法揭示了用（多）模态替代数据的潜力，并在模型专业化与泛化能力之间提供了权衡思路。

Abstract: Cross-modal learning, i.e., learning to predict one modality from another, is a fundamental mechanism for self-supervision via leveraging multimodality. Many practical applications, e.g., deploying a household robot, involve devices that are equipped with a rich set of sensors that enable multimodal sensing in their test environment. This presents an opportunity to apply cross-modal learning to the multimodal data sensed by these devices to learn representations. Findings in developmental psychology also suggest that biological agents leverage it to build an effective representation of their surroundings. To study this, we propose a controlled setup, where we restrict a user device to just a given test environment. It results in a specialization setup where we attempt to develop a performant model for this specific test environment. Under this setup, we develop Test-Space Training (TST), which performs multimodal data collection in the test environment and performs self-supervised pre-training on it. We evaluate these models on various downstream tasks in the same environment. Under this setup, we find various interesting insights, such as collecting rich multimodal data only from the test environment and leveraging cross-modal learning, we can achieve competitive results with generalist models (e.g., DINOv2 and CLIP) pre-trained on large-scale internet datasets. This enables an alternative scenario where the need for external Internet-scale datasets for pre-training models is reduced. We also present a set of analyses and ablations that raise intriguing points on substituting data with (multi)modality, and how varying pre-training data enables a tradeoff between a model’s abilities to specialise to a test environment, and generalize to held-out spaces.

[58] WorkDrive: Roadwork Chain of Causation for Autonomous Driving cs.CVPDF

Tianyi Jiang, Wen Zhang, Sihan Yang, Ming Lu, Wentao Zhang

TL;DR: 本文提出WorkDrive框架，旨在解决自动驾驶视觉语言模型在道路施工区域因视觉线索改变而导致的规划决策困难。该框架通过构建基于感知的因果推理链，并将其与轨迹预测对齐，以提升模型在施工区域的驾驶性能。

Details

Motivation: 自动驾驶视觉语言模型在道路施工区域表现不佳，因为熟悉的视觉线索（如车道线和永久标志）被改变或缺失，而临时设备（如锥桶和护栏）重新定义了可行驶区域。模型虽能检测这些物体，但缺乏明确指导时，会依赖预训练中的熟悉元素进行推理，无法将施工区观察与正确规划决策联系起来。

Result: 在最大的公开施工区域数据集ROADWork上，提出的道路施工因果链将轨迹平均位移误差降低了9.0%，基于一致性的GRPO进一步降低了3.0%，相比仅使用轨迹的基线实现了渐进式改进。

Insight: 创新点在于引入感知基础的因果推理链来引导模型在施工区域的推理，并通过监督微调和强化学习（使用横向元动作与预测轨迹的一致性作为单一奖励）进行对齐。这提供了一种将结构化场景事实注入标注流程以增强领域特定推理的方法。

Abstract: Autonomous driving vision-language models (VLMs) struggle in roadwork zones, where familiar visual cues such as lane markings and permanent signs are altered or absent, and temporary devices such as cones and barriers redefine the drivable corridor. VLMs can detect these objects, but without explicit guidance they anchor their reasoning on familiar elements from pre-training and fail to connect work-zone observations to correct planning decisions. We propose WorkDrive, a framework that constructs perception-grounded causal reasoning for work zones and aligns it with trajectory prediction. An automated multitask perception pipeline extracts structured scene facts and injects them into a Chain-of-Causation (CoC) annotation pipeline, redirecting the annotator’s attention to domain-specific elements. The resulting reasoning labels are used for supervised fine-tuning, followed by reinforcement learning with a single reward: consistency between lateral meta-actions and the predicted trajectory. On ROADWork, the largest public work-zone dataset, the proposed roadwork CoC reduces trajectory average displacement error (ADE) by 9.0%, and consistency-based GRPO yields a further 3.0%, achieving progressive improvement over the trajectory-only baseline. Code and data will be publicly released.

[59] VQ-Touch: A Data-Efficient Tactile Generation Framework Across Sensors and Scenarios cs.CV | cs.ROPDF

Kailin Lyu, Long Xiao, Jianing Zeng, Di Wu, Lin Shu

TL;DR: 本文提出了VQ-Touch，一个支持跨传感器和多场景应用的触觉图像生成框架。该框架通过DM-VQGAN高效学习触觉表征，并利用统一的离散扩散解码器接口，结合少样本混合训练，实现了对主流传感器及其变体的兼容性，从而在数据利用效率和泛化能力上超越了现有方法。

Details

Motivation: 现有触觉图像生成方法依赖特定传感器的大规模数据集，数据利用效率低且泛化能力弱，难以在视觉受限环境中应用。本文旨在解决跨传感器和多场景下的高效、鲁棒触觉数据生成问题。

Result: 实验表明，VQ-Touch在多个任务上超越了最先进（SOTA）的方法。

Insight: 创新点在于提出了DM-VQGAN作为高效的触觉表征学习器，以及一个支持图像和标签等多模态生成任务的统一条件化离散扩散解码器。通过少样本混合训练策略，有效提升了模型对不同传感器和场景的泛化能力。

Abstract: Tactile image generation significantly reduces the dependency on expensive and wear-prone sensors by synthesizing high-fidelity tactile data, offering an efficient solution for tactile information acquisition in robotic perception and human-machine interaction systems. However, existing methods depend on large-scale, diverse datasets from specific sensors and lack efficient data utilization and robust generalization capabilities, struggling in vision-limited environments. To address this, we introduce VQ-Touch, a tactile generation framework that supports both cross-sensor and multi-scenario applications. Specifically, to efficiently extract complex deformation and texture features from the data, we propose DM-VQGAN, an effective tactile representation learner. Furthermore, we introduce a discrete diffusion decoder with a unified conditioning interface, supporting multimodal generation tasks such as images and labels, and enhances the model’s generalization capability through few-shot mixed training, thus achieving compatibility with current mainstream sensors and their variants. Experiments show that VQ-Touch surpasses state-of-the-art methods in multiple tasks.

[60] GeoDetect: Geometric Adversarial Detection for VLPs cs.CV | cs.LGPDF

Afsaneh Hasanebrahimi, Hanxun Huang, Christopher Leckie, James Bailey, Sarah Erfani

TL;DR: 本文提出GeoDetect方法，通过分析视觉语言预训练模型（VLP）嵌入空间的几何结构，发现对抗样本倾向于将表示推离流形区域，并利用这种几何偏差进行对抗检测。

Details

Motivation: 现有对抗检测方法在单模态（视觉或语言）中有效，但在多模态VLP中的效果和可靠性尚未充分探索，因此研究VLP嵌入空间的几何特性以提升其安全性。

Result: 在多种VLP架构和威胁设置（包括单模态、多模态攻击和自适应攻击）的全面评估中，GeoDetect能可靠地检测对抗样本，提供了一种稳健实用的方法。

Insight: 创新点在于揭示了VLP嵌入空间的结构化各向异性，并理论证明对抗样本会增加与干净样本的几何分离，从而利用几何分数实现检测；这为多模态模型的对抗防御提供了新的几何视角。

Abstract: Vision-language pre-trained models (VLPs) are widely used in real-world applications. However, they remain vulnerable to adversarial attacks. Although adversarial detection methods have demonstrated success in single-modality settings (either vision or language), their effectiveness and reliability in multimodal models such as VLPs remain largely unexplored. In this work, we study the geometry of VLP embedding spaces and observe structured anisotropy that differs from unimodal vision models. Our theoretical analysis shows that under this anisotropic structure, adversarial attacks increase the expected geometric separation between clean and adversarial examples (AEs). Specifically, we demonstrate that AEs consistently exhibit greater expected distances to randomly sampled points than their clean counterparts, indicating that AEs tend to push representations out of manifold regions. Building on these insights, we propose GeoDetect, which leverages these off-manifold deviations via geometric scores to identify AEs. Through comprehensive evaluations, we show that our approach reliably detects AEs across diverse VLP architectures and threat settings, covering unimodal and multimodal attacks as well as adaptive attacks, thereby providing a robust and practical approach to improving the safety and reliability of these models.

[61] FoMoVLA: Bridging Visual Foresight and Motion Guidance for Vision-Language-Action Models cs.CV | cs.AIPDF

Wei Li, Peijin Jia, Yuan Ma, Xuefeng Jiang, Titong Jiang

TL;DR: 本文提出FoMoVLA框架，旨在解决现有视觉-语言-动作（VLA）模型仅具备反应式策略、缺乏显式前向预测的问题。该框架通过联合学习未来特征预测和稀疏2D点跟踪，为VLA模型引入了显式的时空监督，从而增强了连续动作策略的生成能力。

Details

Motivation: 现有VLA模型本质上是反应式的，仅将当前观测和语言映射为动作，缺乏对世界动态的显式前向预测；而现有的视觉预见方法虽能预测未来视觉状态，却缺乏明确的运动指导，即知道目标但不知如何到达。

Result: 在LIBERO、RoboCasa GR-1 Tabletop和LIBERO-Plus等基准测试上进行了广泛实验，结果表明该方法取得了最先进的（SOTA）性能，并展现出强大的零样本泛化能力。

Insight: 创新点在于将未来特征预测与稀疏点跟踪这两种自然互补的能力相结合：前者提供目标状态，后者捕捉朝向目标的连续运动路径。具体通过引入紧凑的预见令牌解码未来特征状态，解码稀疏时序2D点轨迹以建模紧凑几何运动，并通过一个轻量级的未来条件化交叉注意力模块将两者耦合，实现预期状态与点动态之间的一致性推理。

Abstract: Vision-Language-Action (VLA) models have achieved impressive results in visuomotor policy learning, yet remain fundamentally reactive, mapping current observations and language to actions without explicit forward prediction of world dynamics. Existing visual foresight methods predict future visual states but lack explicit motion guidance: they show where to go but not how to get there. We argue that future feature prediction and sparse point tracking are naturally complementary: the former provides the goal state, while the latter captures the continuous motion path toward it. We propose FoMoVLA, a framework that augments VLA representations with explicit spatio-temporal supervision by jointly learning future feature foresight and sparse 2D point tracking, enhancing the continuous action policy. FoMoVLA introduces compact foresight tokens to decode future feature states, decodes sparse temporal 2D point trajectories to model compact geometric motion, and couples both through a lightweight future-conditioned cross-attention module that enables consistent reasoning between anticipated states and point dynamics. Extensive experiments on LIBERO, RoboCasa GR-1 Tabletop, and LIBERO-Plus demonstrate state-of-the-art performance and strong zero-shot generalization. Project page is available at https://liauto-research.github.io/FoMoVLA.

[62] On the Disagreement in Perturbation-based xAI – Benchmarking Perturbation Choices for Flood Detection from SAR Images cs.CVPDF

Anastasia Schlegel, Ronny Hänsch

TL;DR: 本文针对基于扰动的可解释人工智能方法，研究了扰动参数选择对解释结果的影响。通过合成孔径雷达图像洪水检测的案例，系统分析了扰动区域几何形状和扰动类型对相关性估计的影响，揭示了不同参数设置会导致模糊甚至矛盾的解释。

Details

Motivation: 基于扰动的xAI方法虽然被广泛使用，但其对参数选择非常敏感，不同设置可能导致不一致的解释结果。本文旨在系统研究扰动管道中关键参数（如补丁几何形状和扰动类型）如何影响相关性估计，以解决解释结果模糊和矛盾的问题。

Result: 研究通过视觉检查、跨策略一致性评估以及对模型推理的忠实性评估，展示了不同扰动选择如何引导生成的相关性热图，并产生模糊甚至矛盾的解释。

Insight: 创新点在于系统性地将扰动参数（补丁几何和扰动类型）作为xAI方法的内在组成部分进行基准测试，强调了在解释模型预测时必须仔细检查和评估这些参数设置，以确保对解释和模型预测的稳健理解。

Abstract: Perturbation-based xAI methods are widely used to analyze the behavior and predictions of deep learning models. By altering input regions and measuring the resulting changes in class probabilities with respect to the original image, they assign relevance scores and generate heatmaps that reflect each region’s contribution to the prediction. Despite their apparent simplicity, however, perturbation-based methods are sensitive to parameter choices. In this work, we focus on two key parameters of the perturbation pipeline, namely the patch geometry, including the size and shape of the perturbed regions, and the perturbation type, defined by the replacement scheme. Grounded in the use case of flood detection from Synthetic Aperture Radar imagery, we conduct a comprehensive investigation of how relevance estimation changes under different perturbation settings. Beyond visual inspection of the resulting relevance maps, we evaluate their consistency across perturbation strategies and their faithfulness to the model’s reasoning. We demonstrate how different perturbation choices can steer the resulting relevance maps, yielding ambiguous and even contradictory explanations. Our findings emphasize the importance of methodological settings in perturbation-based xAI. They underscore the need to carefully inspect and evaluate perturbation choices and to treat them as an integral part when interpreting explanations, ensuring a robust understanding of both the explanations and model predictions.

[63] Clean-Reference Streaming Detection of Lens Occlusion and Photometric Transitions for Camera Tamper Monitoring cs.CVPDF

Bo Ma, WeiQi Yan, Jinsong Wu

TL;DR: 本文提出了一种用于监控摄像头篡改检测的流式完整性监测方法，专注于检测镜头遮挡和光度突变两种低成本传感器故障特征。该方法通过比较采样亮度与局部梯度统计量与仅包含清洁场景的滑动参考值，并应用结构化光抑制和亮度变化抑制，实现了低误报率、有限计算开销和可诊断行为。

Details

Motivation: 解决监控摄像头因物理退化（如镜头遮挡、光度突变）导致数据失效的问题，需要一种低误报、计算受限且能在光照变化下可靠工作的原位完整性警报系统。

Result: 在320个受控序列上，默认状态机达到0.800 F1分数和0.822平衡准确率；在公开审计中，在5%误报预算下获得最高部分AUC，并在误报率0.025时达到0.925召回率。公开数据集测试显示方法保持低误报，且召回率集中在声明范围内。

Insight: 创新点在于设计了一种基于清洁参考的流式检测器，通过结构化光抑制和亮度变化抑制规则化决策谓词，确保场景突变路径的不可达性，可作为可审计的传感器健康子系统而非通用篡改分类器。

Abstract: A surveillance camera is an image sensor whose silent physical degradation invalidates every downstream consumer of its data. In-situ integrity alarms for such vision sensors require low false-alarm rates, bounded computation, and diagnosable behavior under nuisance illumination changes. This paper studies a deliberately narrow streaming integrity monitor for two low-cost sensor-fault signatures: texture-collapsing lens occlusion and abrupt photometric scene transition. The detector compares sampled luminance and local-gradient statistics with a clean-only sliding reference, applies coarse-grid structured-light rejection and mode/rapid-brightness suppression, and emits at most one notification per tamper episode. We formalize the decision predicates and derive a consistency rule for when rapid-brightness suppression makes the scene-transition path unreachable. On 320 in-scope controlled sequences, the default state machine attains 0.800 F1 and 0.822 balanced accuracy (significantly better paired correctness than the strongest baseline, though the F1 margin is not statistically resolved); on a magnitude-swept public audit it attains the highest partial AUC under a 5% false-alarm budget, and a separate extended-stress FPR-constrained sweep reaches 0.925 recall at 0.025 false-positive rate. Public Xiph, Bremen IoT, and UHCTD diagnostics show the fixed predicates preserve low false alarms while recall concentrates inside the declared envelope (UHCTD in-scope covered recall 0.667 versus 0.016 out of scope), and a 9.09-camera-hour verified-negative public audit records zero false alarms. The method is best interpreted as an auditable sensor-health subsystem rather than a universal camera-tamper classifier.

[64] TAMF-VTON: Texture-Aware Mask-Free Virtual Try-On via High-Fidelity Image Synthesis cs.CVPDF

Jie Wang, Qian He, Gaofeng He, Xiaogang Jin, Huamin Wang

TL;DR: 本文提出了TAMF-VTON，一种无需分割掩码、纹理感知的虚拟试穿框架。该方法通过一个统一的生成式流程，支持在无约束的实际条件下进行高保真图像合成，能够同时处理多种服装样式、类别和数量，并保持身体结构和精细纹理细节。

Details

Motivation: 现有基于扩散模型的虚拟试穿方法依赖分割掩码、难以保持细粒度纹理、且对任意多服装组合的支持有限，这阻碍了其在现实电商场景中的部署。

Result: 大量实验表明，该方法在定量指标和感知质量上均优于现有最先进方法。经过优化，模型在NVIDIA RTX 4090上使用INT4量化，单张图像推理时间低于15秒。

Insight: 创新点包括：1) 轻量级的专家混合适应方案，实现高效微调而不损害基础模型的通用编辑能力；2) 频域监督机制，通过显式优化高频谱一致性来保持高保真纹理；3) 采用自适应修复策略的鲁棒数据整理流程，用于生成高质量的训练数据对。该方法集成了无掩码操作、灵活的多服装组合、忠实的纹理保留和高效的消费级硬件推理，展示了商业可行性。

Abstract: Recent diffusion-based virtual try-on (VTON) methods remain limited by their reliance on segmentation masks, insufficient preservation of fine-grained textures, and limited support for arbitrary multi-garment compositions. Consequently, existing approaches still face significant challenges in real-world e-commerce deployment. We present TAMF-VTON, a texture-aware, mask-free framework that enables high-fidelity image synthesis under practical unconstrained conditions. Our method requires no human parsing or inpainting masks at inference time and supports diverse garment styles, categories, and quantities, enabling the simultaneous transfer of multiple items while preserving body structure and intricate texture details. This is achieved through a unified generative pipeline with three key components: (1) a lightweight Mixture-of-Experts (MoE) adaptation scheme that enables efficient fine-tuning without compromising the base model’s general editing capabilities; (2) a frequency-domain supervision mechanism that explicitly optimizes high-frequency spectral consistency to preserve high-fidelity textures; and (3) a robust data curation pipeline employing an adaptive inpainting strategy to simulate the inverse VTON process for high-quality training pair generation. Extensive experiments demonstrate that our approach outperforms state-of-the-art methods in both quantitative metrics and perceptual quality. Optimized for efficiency, the model achieves inference in under 15 seconds per image on an NVIDIA RTX 4090 with INT4 quantization. By combining mask-free operation, flexible multi-garment composition, faithful texture preservation, and efficient inference on consumer hardware, TAMF-VTON demonstrates a commercially viable solution for scalable deployment in real-world digital fashion scenarios. The project is available at https://www.style3d.ai/ai-photoshoot/virtual-clothing-try-on.

[65] An LLM-Based Automatic Sportscast Solution for Robot Soccer Matches cs.CVPDF

Francesco Petri, Michele Brienza, Daniele Nardi, Domenico Daniele Bloisi, Aldo Gangemi

TL;DR: 本文提出了一种基于大型语言模型（LLM）的、用于机器人足球比赛的全自动实时体育解说系统。该系统通过一种神经符号架构，从视频流中提取精确的运动学统计数据，并将其转化为流畅、无幻觉的解说文本，适用于实时直播和赛后分析。

Details

Motivation: 动机是解决RoboCup足球比赛中，如何从比赛视频中自动计算视觉统计数据以追踪研究进展的挑战，并填补原始运动学追踪与自然语言生成之间的鸿沟。

Result: 该系统能够生成流畅且无幻觉的解说，适应了不同尺寸人形机器人同场竞技的新动态，但摘要中未提及具体的定量评估结果或基准测试对比。

Insight: 创新点在于提出了一种结合神经与符号方法的架构，将原始运动数据可靠地转化为自然语言解说，实现了对复杂、动态机器人足球场景的实时、自适应分析。

Abstract: RoboCup has always been a scenario to develop systems that solve real-world problems. Driven by the main goal of playing against the 2050 FIFA World Cup champions, the RoboCup Soccer leagues need to constantly measure how the research community is progressing. Computing visual statistics from match videos is a crucial way to track this evolution. To address this challenge, this paper introduces a fully autonomous, real-time sports commentator for RoboCup matches. By bridging the gap between raw kinematic tracking and natural language generation, our neuro-symbolic architecture extracts precise statistics from video streams and turns them into fluent, hallucination-free narration. The proposed system is capable of generating statistics and commentary both during live match streaming and in post-game analysis, easily adapting to the new dynamism of the league where different humanoid robots of different sizes share the field. Supplemental materials are available at https://lab-rococo-sapienza.github.io/MARIO/

Xiao Wang, Bing Wang, Bin Yang, Cuiqun Chen, Xin Xu

TL;DR: 这篇综述论文系统回顾了行人重识别领域从单模态到多模态的演进过程，重点介绍了可见光-红外、文本-图像、素描图像等跨模态任务，以及新兴的非视距重识别和多模态融合方法。论文还提出了一个基于Transformer的可见光-红外重识别基线框架，并展望了未来研究方向。

Details

Motivation: 传统基于RGB图像的单模态行人重识别方法在低光照、遮挡等环境挑战下性能受限，因此该领域正快速向利用多模态互补信息的跨模态与多模态范式演进。本文旨在系统梳理这一转变过程，为研究者提供全面的概览。

Result: 论文提出了一个用于可见光-红外行人重识别（VI-ReID）的Transformer基线框架，旨在有效捕捉模态不变特征。该框架作为未来研究的基准，但摘要未提及具体定量结果或与SOTA的比较。

Insight: 创新点在于首次系统性地将跨模态行人重识别任务（如VI-ReID, TI-ReID, Sketch-ReID）与新兴的非视距重识别（NLOS-ReID）及多模态融合方法纳入统一综述，并提出了一个统一的Transformer基线框架，强调了模态不变特征学习的重要性。

Abstract: Person re-identification (ReID) serves as a critical component in intelligent surveillance systems, aiming to match identities across disjoint camera networks. While traditional methods primarily rely on single-modal RGB imagery, they are often constrained by environmental challenges such as low illumination and occlusion. To overcome these limitations, the field is rapidly evolving toward cross-modal and multi-modal paradigms. This survey presents a comprehensive overview of this transition, systematically reviewing key cross-modal tasks including visible-infrared (VI-ReID), text-image (TI-ReID), sketch-based (Sketch-ReID), and the emerging Non-Line-of-Sight (NLOS) ReID, which extends perception beyond direct visibility. Furthermore, we examine tri-spectral and multi-modal fusion ReID, discussing how complementary information from diverse sensors enhances robustness. Beyond summarizing datasets, challenges, and methodologies, we propose a Transformer-based baseline framework for visible-infrared ReID, designed to effectively capture modality-invariant features. Finally, based on the current landscape, we outline several promising directions for future research.

[67] Selectivity Drives Efficiency: Dataset Pruning for Visual Place Recognition cs.CVPDF

Tong Jin, Yunpeng Liu, Shuyu Hu, Chun Yuan, Song Wang

TL;DR: 本文提出了一种针对视觉地点识别（VPR）任务的、以地点为基本单元的‘地点级数据集剪枝’框架，通过引入‘地点内多样性’和‘地点间相似性’两个互补的新指标来评估每个地点的训练价值，从而构建一个紧凑而信息丰富的核心集，在显著减少存储和训练成本的同时，保持模型性能。

Details

Motivation: 当前VPR研究依赖大规模数据集提升模型性能，但带来了高昂的存储和训练成本。传统的数据集剪枝方法遵循样本级分类范式，忽略了VPR任务中监督信号通常由图像对构成这一关系依赖的训练特性。

Result: 在不同剪枝比例下，该方法均优于最先进的数据集剪枝基线。通过将约3.5倍于GSV-Cities规模的合并数据集剪枝至相近规模，其核心集在MSLS-val和Nordland基准上仅使用NetVLAD就分别取得了94.5%和97.0%的R@1性能，保持了高度竞争力。

Insight: 创新点在于将剪枝的基本单元从独立图像转变为‘地点’，并设计了IPD和IPS两个互补的、针对VPR任务特性的评估指标。这为关系依赖型学习任务的数据效率优化提供了新思路，即剪枝策略应与任务特定的监督形式（如图像对）相匹配。

Abstract: Recent visual place recognition (VPR) studies have increasingly relied on large-scale datasets to train more robust and discriminative models. Although this trend significantly improves recognition performance, it also introduces substantial storage and training costs, especially when new architectures or training strategies need to be repeatedly developed and evaluated. Dataset pruning (DP) provides a promising way to improve data efficiency by retaining only informative training data. However, conventional DP methods mainly follow the sample-wise classification paradigm, which overlooks the relation-dependent training nature of VPR, where supervision is typically formed by image pairs rather than independent images. To address this issue, we propose a place-wise dataset pruning framework tailored for VPR. Instead of pruning individual images, our method treats each place as the basic pruning unit and introduces two complementary novel metrics, i.e., intra-place diversity (IPD) and inter-place similarity (IPS), to evaluate the training value of each place. By jointly considering these two metrics, our method ranks all places and constructs a compact yet informative coreset, thereby allowing the pruned dataset to still support the training of robust and discriminative VPR models. Extensive experiments demonstrate that our method consistently outperforms state-of-the-art DP baselines under different pruning ratios while reducing selection and training costs. Moreover, by pruning a merged dataset roughly 3.5$\times$ the size of GSV-Cities to a comparable scale, our coreset maintains highly competitive performance, achieving 94.5% R@1 on MSLS-val and 97.0% R@1 on Nordland with only NetVLAD. Codes will be made publicly available.

[68] FlashDecoder: Real-Time Latent-to-Pixel Streaming Decoder with Transformers cs.CV | cs.AIPDF

Minguk Kang, Suha Kwak

TL;DR: 本文提出了FlashDecoder，一个用于实时视频生成的快速、内存高效的纯Transformer解码器。它通过逐帧解码潜变量到像素，并使用滚动KV缓存机制，使解码速度和内存占用与视频长度无关，实现了恒定延迟的流式解码。

Details

Motivation: 当前基于3D卷积的潜变量视频扩散模型解码器在高分辨率或长视频场景下速度慢且内存占用高，无法满足实时视频生成对快速解码的需求。

Result: 在Wan2.1和Wan2.2潜空间上，FlashDecoder在1080p分辨率下达到了与卷积解码器相当的重建质量（PSNR分别为41.55dB vs. 41.49dB），同时在单个H100 GPU上解码速度快3.6-4.7倍，内存占用减少高达11倍；结合架构感知的推理优化后，加速比可达12倍。

Insight: 核心创新在于采用纯Transformer架构和滚动KV缓存机制，通过序列化逐帧处理和固定的时间窗口，在无需显式注意力掩码的情况下强制时间因果性，从而实现了与视频长度无关的恒定解码延迟和内存占用，同时保持了高质量重建。

Abstract: Real-time video generation demands fast decoding as much as fast denoising, yet current latent video diffusion models rely on 3D convolutional decoders that are slow and memory-intensive at high resolutions or for long video. We introduce FlashDecoder, a fast, memory-efficient pure-Transformer video decoder that decodes latents to pixels frame by frame. At each step, the current frame attends only to a fixed-size window of past frames through a rolling KV cache. The fixed temporal window keeps decoding fast and memory bounded regardless of video length, enabling constant-latency streaming. Because frames are processed sequentially, temporal causality is enforced without explicit attention masks, enabling training at resolutions up to 1080p and matching the reconstruction quality of convolutional decoders. On the Wan2.1 and Wan2.2 latent spaces, FlashDecoder matches each convolutional decoder in reconstruction quality (e.g., 41.55dB vs. 41.49dB PSNR at 1080p) while decoding 3.6x-4.7x faster with up to 11x less memory on a single H100 GPU. With architecture-aware inference optimizations, the speedup widens to 12x.

[69] Still image and spatial-temporal tomato data enabling detection, segmentation, tracking, and video-instance segmentation using strong and weak labels cs.CVPDF

Michael Halstead, Esra Guclu, Mohamed Farag, Enrico Pallotta, Christian Hund

TL;DR: 本文发布了两个用于番茄植株视觉感知的数据集：BUTom21（静态图像与人工标注）和BUTom-ST21（视频数据与基于AI的半自动伪标注），均提供果实成熟度的像素级标签，旨在为研究社区提供真实世界图像以探索番茄植株及其果实的感知与状态估计方法。

Details

Motivation: 为园艺重要作物番茄提供具有挑战性的真实世界图像数据集，以支持基于视觉的植株状态感知与估计研究，特别是推动田间表型分析的发展。

Result: 数据集包含静态图像和时空视频数据，并提供强标注（人工）和弱标注（伪标签），支持检测、分割、跟踪和视频实例分割等任务。

Insight: 创新点在于同时发布静态与时空数据集，并整合果实成熟度的像素级标签与个体果实计数信息，为农业视觉研究提供了多任务、真实场景的基准数据。

Abstract: In this manuscript we release two datasets for visual sensing of tomato plants grown in commercial-like settings and acquired using a robot. The first is BUTom21 which consists of still images and manual annotations. The second is BUTom-ST21 which consists of video-based data and semi-automated annotations through AI-based methods, referred to as pseudo-labels. In both cases, we provide pixel-level labels for the ripeness of the fruit. The aim is to provide the research community a challenging set of real-world imagery to explore methods to sense and estimate the state of tomato plants and their fruit, which is an important horticultural crop. Importantly, the spatial-temporal dataset provides individual fruit count and ripeness information enabling researchers to push the boundaries of field-based phenotyping.

[70] VideoChat3: Fully Open Video MLLM for Efficient and Generalist Video Understanding cs.CVPDF

Xinhao Li, Yuhan Zhu, Xiangyu Zeng, Yuhao Dong, Haoning Wu

TL;DR: 本文提出了VideoChat3，一个完全开源、高效且通用的视频多模态大语言模型。它通过引入I3D-ViT和自适应帧分辨率处理来提升效率，并通过构建涵盖通用、长视频和流视频的多样化高质量数据集来提升泛化能力。

Details

Motivation: 当前开源视频理解模型存在泛化能力差、计算成本高以及开放不彻底（如训练代码或数据集未公开）等问题，这阻碍了实际应用和社区发展。

Result: 在通用、长视频和流视频基准测试中，仅拥有40亿参数的VideoChat3在性能上超越了参数量相当或更大的先前开源模型，并展现出更高的效率。

Insight: 主要创新点在于将高效的时空表征（I3D-ViT与自适应帧分辨率）与大规模、多样化的合成视频数据管道相结合，在模型规模与效率之间取得了良好平衡，并实现了完全开源以促进可复现性。

Abstract: Recent advances in video understanding have spanned motion, long video, and streaming interaction, driving this field toward real-world applications. Despite this progress, current open-source models remain limited in several ways. They often struggle to generalize across diverse video types, making them effective only in specific domains. High computational demands further restrict their efficiency and scalability. Moreover, most models are only partially open, with key components such as training code, strategy, or datasets unavailable, which hinders reproducibility and slows community-driven development. To address these issues, we introduce VideoChat3, a fully open, efficient, and generalist video-centric MLLM. VideoChat3 advances video understanding through two complementary designs. For efficiency, we introduce Inflated 3D Vision Transformer (I3D-ViT) and Adaptive Frame Resolution for Streaming Video Perception, which enables efficient spatiotemporal representation and reduces the cost of processing video inputs during training and inference. For effectiveness, we develop a scalable video data synthesis pipeline that curates three diverse, high-quality training datasets: VideoChat3-Academic2M, VideoChat3-LV116K, and VideoChat3-OL617K, covering general, long-form, and streaming video scenarios, improving the model’s generalization across domains. By integrating these designs, VideoChat3 achieves a rare balance of broad generalization and computational efficiency. Experiments across general, long-form, and streaming benchmarks demonstrate that VideoChat3 surpasses prior open-source models with equal or larger parameter counts with only 4B parameters and higher efficiency.

[71] U-shaped Multi-granularity Learning for Vision-Language Models cs.CVPDF

Biao Chen, Yunqian Yu, Xiangxu Zhao, Zhongshu Chen, Mengmeng Jing

TL;DR: 本文针对视觉语言模型提示学习中的粒度困境，提出了一种U形多粒度提示学习框架UPrompt。该框架受U-Net启发，在视觉和文本模态中构建并行多粒度表示，通过粗到细的级联增强和细到粗的层次监督实现跨粒度信息融合。在17个基准测试上的实验表明，UPrompt在多项任务上优于现有方法，并在保持竞争力的同时降低了计算成本。

Details

Motivation: 现有视觉语言模型的提示学习面临粒度困境：全局提示缺乏细粒度语义感知，局部提示忽略上下文关联，限制了跨任务泛化能力，尤其在密集预测任务中这一问题更为突出。

Result: 在MSCOCO上，UPrompt的rSum指标比MAMET和VPKE分别高出4.1和7.3；在base-to-novel泛化任务中超过CoCoA-Mix 5.09%；粗粒度下以最小开销保持竞争力，中粒度下仅用1/3成本即达到PSRC相当性能。

Insight: 创新点在于将U-Net的多级表示统一思想引入提示学习，构建视觉与文本的双模态多粒度并行表示框架，通过双向粒度交互机制（粗到细增强与细到粗监督）解决粒度困境，实现语义一致性与细节感知的平衡。

Abstract: The prompt learning paradigm for vision-language models is effective yet faces a granularity dilemma: global prompts lack fine-grained semantic awareness, while local prompts ignore contextual associations, limiting cross-task generalization. This dilemma exists in dense prediction tasks. Inspired by U-Net, which unifies multi-level representations across granularities, we propose UPrompt, a U-shaped multi-granularity prompt learning framework for vision-language models. Similar to how U-Net integrates fine and coarse features through symmetric encoder-decoder pathways with cross-level connections, UPrompt constructs parallel multi-granularity representations in both visual and textual modalities, where coarse-to-fine cascaded enhancement propagates global context to refine local details, while fine-to-coarse hierarchical supervision ensures semantic consistency across scales. Extensive experiments on 17 benchmarks validate our effectiveness. UPrompt outperforms MAMET and VPKE by 4.1 and 7.3 rSum on MSCOCO, surpasses CoCoA-Mix by 5.09% in base-to-novel generalization, while maintaining competitive performance with minimal overhead (coarse-grained) and matching PSRC with 1/3 cost (medium-grained).

[72] On Success and Simplicity: A Second Look at Transferable Vision-Language Attack Pipeline cs.CV | cs.CRPDF

Yuchen Ren, Zhengyu Zhao, Chenhao Lin, Bo Yang, Chao Shen

TL;DR: 本文提出了一种名为SimVLA的简单视觉语言攻击流水线，旨在解决现有针对视觉语言预训练模型的对抗攻击方法过于复杂的问题。该流水线通过解决跨模态交互不当和操作冗余等三个先前被忽视的问题，显著提升了攻击的迁移性和效率。

Details

Motivation: 现有针对视觉语言预训练模型的迁移攻击方法通常采用复杂的损失函数或多阶段攻击流程，作者认为这种复杂的攻击流水线可以更简单且更有效。

Result: 在四个数据集和三个下游任务上的实验验证了SimVLA的优越性。例如，在Flickr30k文本-图像检索数据集上，SimVLA在R@1迁移性上比SOTA基线高出8.01%-14.71%，同时仅消耗约35.73%的时间和46.26%的最大显存。

Insight: 核心创新在于识别并解决了由不当跨模态交互和冗余操作导致的三个问题，并提出了一个简单高效的攻击流水线。这强调了利用领域知识（如提出的跨模态词识别）的重要性，而盲目追求复杂操作可能有害。SimVLA可作为一个简单有效的骨干网络供未来扩展。

Abstract: Vision-Language Pre-training Models (VLPMs) are known to be vulnerable to adversarial attacks. Recent transferable attacks on VLPMs have followed a common pipeline with complicated loss functions or multi-stage text/image attacks. However, in this paper, we demonstrate that such a sophisticated attack pipeline can be simpler yet more successful. Specifically, we identify three previously overlooked issues caused by inappropriate cross-modal interactions and excessive operations. To address them, we propose the Simple Vision-Language Attack (SimVLA) pipeline, which observably improves transferability and efficiency. Experiments on four datasets and three downstream tasks validate the superiority of our pipeline. For instance, on Flickr30k text-image retrieval dataset, our SimVLA outperforms the SOTA baseline in R@1 transferability by 8.01%-14.71%, while consuming only about 35.73% of the time and 46.26% of the max VRAM. Overall, the superiority of our SimVLA highlights the importance of leveraging domain knowledge (e.g., our proposed cross-modal word identification), while blindly pursuing intricate operations (e.g, complex loss functions and redundant multi-stage designs) may even be harmful. We hope our SimVLA can serve as a simple yet effective backbone for future extensions. Code is available at https://github.com/RYC-98/SimVLA.

[73] From Draft to Draft-Free: One-Step Video Object Removal via Privileged Distillation and Fast Planting cs.CVPDF

Zizhao Chen, Ping Wei, Guang Dai, Jingdong Wang, Mengmeng Wang

TL;DR: 本文提出了一种名为D2DF的单步视频目标移除框架，旨在解决现有方法存在的伪影问题或效率低下问题。该框架通过特权一致性蒸馏将多步优化的教师模型能力迁移至单步学生模型，并结合自引导快速植入模块实现无需草稿输入的单步移除，在质量和效率上均达到先进水平。

Details

Motivation: 现有视频目标移除方法存在两极化问题：传统基于光流或注意力的方法易产生伪影，而基于扩散的方法虽提升真实感但需多步去噪，实用性受限。本文旨在开发一种既能保证高质量又能实现高效单步移除的解决方案。

Result: 在多个指标上，D2DF的草稿条件版本和无草稿版本均达到了最先进的性能，超越了传统方法和多步生成方法，单视频去噪过程仅需约1秒。

Insight: 创新点包括：通过特权一致性蒸馏实现从多步到单步的能力迁移，以及基于时序掩码Transformer的自引导快速植入模块，该模块能在潜在空间自主生成场景一致的伪草稿，从而实现了完全无需草稿的单步模型，兼顾了生成质量与推理效率。

Abstract: Video object removal is a fundamental yet challenging task in video editing. Despite recent progress, existing methods typically fall into two categories. Traditional approaches based on optical flow or attention mechanisms often introduce noticeable artifacts and yield unnatural results. In contrast, diffusion-based methods improve visual realism but demand multiple denoising steps, limiting their practicality. To address these issues, we propose From-Draft-to-Draft-Free (D2DF), a framework that distills the ability of transforming coarse drafts into refined videos into a one-step video generation model. Within D2DF, a teacher model is trained to refine low-quality removal results (“drafts”) into high-fidelity videos by multiple steps. Then, through Prior-Privileged Consistency Distillation (PPCD), we distill this capability into a student model that performs one-step removal conditioned on the draft. To eliminate draft dependency, we introduce a Self-Guided Fast Planting (SGFP) module based on our Temporal Masked Transformer that autonomously generates scene-consistent pseudo-drafts in latent space, enabling a fully draft-free one-step model. Extensive experiments show that both draft-conditioned and draft-free versions achieve state-of-the-art performance on multiple metrics, surpassing traditional and multi-step generative methods in both quality and efficiency. The denoising process for a single video takes only about 1 second.

[74] Stitch-Inferencer: Enhance Endoscopic Video Segmentation and Tracking via Panoramic Reconstruction cs.CVPDF

Shunsuke Kikuchi, Atsushi Kouno, Hiroki Matsuzaki

TL;DR: 本文提出Stitch-Inferencer，一种实时、模型无关的推理框架，用于增强内窥镜视频的分割与跟踪。其核心思想是通过在线拼接多帧有效观测，构建一个显式的图像空间全景画布，从而扩展有效视野并提供对暂时被遮挡区域的直接访问。下游模型（如分割或跟踪器）仅需在全景图的紧凑感兴趣区域上运行，其预测结果再被投影回当前帧，使现有模型无需重新训练即可利用长程上下文信息。

Details

Motivation: 内窥镜感知常因视野有限和器械频繁遮挡而受阻，需要时空上下文进行鲁棒推理。现有视频模型通常将过去观测隐式存储在学习的特征表示中，这需要任务特定的视频训练、大量标注数据和更高的计算成本。

Result: 在解剖结构分割和点/框跟踪任务上的实验表明，该方法在多种基线模型上带来了一致的性能提升，同时保持了实时吞吐量。拼接模块单独运行速度超过60 FPS。

Insight: 创新点在于用显式的图像空间全景画布替代了隐式的特征记忆，这是一种模型无关的推理时增强方案。其优势在于无需对下游模型进行重新训练，即可为现有模型提供长程上下文，且计算高效，适用于计算资源受限的术中环境。

Abstract: Surgical video understanding is fundamental to navigation systems. Endoscopic perception is often hindered by a limited field-of-view and frequent instrument occlusions, making spatio-temporal context essential for robust inference. These challenges have motivated video models that aggregate information across frames. However, existing video models typically store past observations implicitly in learned feature representations, often requiring task-specific video training, substantial annotated data, and increased computational cost. We propose Stitch-Inferencer, a real-time, model-agnostic inference framework that replaces implicit feature memory with an explicit image-space panoramic canvas. By stitching valid observations across frames, Stitch-Inferencer preserves previously observed pixels in an online, instrument-free view, expanding the effective field-of-view and providing direct access to regions that are temporarily occluded or absent from the current frame. Downstream segmentation or tracking models are applied to a compact region of interest on the panorama, and their predictions are reprojected to the current frame, enabling existing models to exploit long-range context without retraining. Experiments on anatomy segmentation and point/box tracking demonstrate consistent improvements across diverse baselines while preserving real-time throughput. The stitching module alone runs at over 60 FPS, providing a practical inference-time solution to enhance endoscopic perception in computationally constrained intraoperative environments. Source code will be made publicly available.

[75] JADE-GS: Joint Alternating Deblurring Guided by Events in 3D Gaussian Splatting cs.CVPDF

Haoyu Fu, Jiafeng Huang, Yuchen Wang, Shengjie Zhao

TL;DR: JADE-GS提出了一种结合事件相机和3D高斯溅射的方法，用于在快速相机运动导致的运动模糊场景中恢复清晰3D模型。它通过像素自适应路由门融合基于物理的事件积分先验和学习网络的互补优势，并在2D去模糊器和3D高斯溅射学生模型之间建立双向循环，利用多视图一致渲染和基于物理的重模糊约束进行正则化，从而将固定预处理转变为几何感知预测器。

Details

Motivation: 解决在快速相机运动导致运动模糊时，传统3D重建方法因模糊丢失帧内运动信息而难以恢复清晰场景的问题，同时克服现有事件相机处理方法中基于物理先验的漂移累积和学习网络边界扭曲的局限性，以及单向处理流程中原始事件噪声或固定2D伪标签偏差无法纠正的缺陷。

Result: 在合成和真实基准测试中，JADE-GS在感知质量上达到最佳，在LPIPS和CLIP-IQA指标上领先，同时保持竞争力的PSNR和SSIM。该方法在单个消费级GPU上使用约5GB内存，训练时间约一小时，并保持实时渲染能力。

Insight: 创新点包括设计像素自适应路由门以融合互补的去模糊先验，以及建立2D去模糊器与3D高斯溅射之间的双向耦合循环，通过多视图一致渲染和物理重模糊约束实现正则化，从而提升几何感知和去模糊效果。

Abstract: When a camera moves fast during exposure, blur destroys the intra-exposure motion a 3D model needs to recover the sharp scene, while event cameras capture exactly this signal at microsecond resolution. Turning them into reliable 3D supervision faces two obstacles. First, the two restoration priors fail in opposite ways: physics-based event-integration priors preserve edges but accumulate drift; learned networks recover texture but distort boundaries. Second, existing pipelines run in one direction only, so raw event noise or the biases of fixed 2D pseudo-labels pass uncorrected into the geometry. JADE-GS addresses both: a pixel-adaptive routing gate fuses the complementary priors, and the resulting 2D restorer is coupled to a 3D Gaussian Splatting student in a bidirectional loop, where detached, multi-view-consistent renders and a physics-based reblurring constraint regularize the restorer, turning a fixed preprocessor into a geometry-aware predictor. Across synthetic and real benchmarks, JADE-GS attains the best perceptual quality, leading LPIPS and CLIP-IQA on both benchmarks with competitive PSNR and SSIM, and trainsin about one hour under 5 GB on a single consumer GPU while preserving real-time rendering.

[76] Weakly-Supervised RGB-D Salient Object Detection via SAM-driven Pseudo Annotation and State Space Interaction-based Diffusion cs.CVPDF

Wenqi Si, Gongyang Li, Shixiang Shi, Weisi Lin

TL;DR: 本文提出了一种新颖的弱监督RGB-D显著性目标检测方法，旨在减轻像素级标注的负担。该方法包含两个核心模块：一个由Segment Anything Model驱动的伪标注生成方法，用于将稀疏的涂鸦标注扩展为密集的伪标注；以及一个基于状态空间交互的条件扩散模型，用于迭代去噪并生成精确的显著性图。

Details

Motivation: 弱监督RGB-D显著性目标检测旨在减少像素级标注的繁重负担，但现有的涂鸦标注缺乏物体的结构和细节信息，导致生成的显著性图不准确。

Result: 该方法在七个数据集上超越了相关的涂鸦监督方法，并与全监督方法相比取得了有竞争力的性能。

Insight: 创新点在于利用先进的SAM模型生成高质量的伪标注以弥补稀疏监督的不足，并设计了一个结合频域集成和隐式-显式状态空间交互的跨模态条件生成模块，以及一个上下文注入模块，以增强条件特征并抑制噪声干扰，从而在扩散过程中有效去噪并生成精确的显著性图。

Abstract: Weakly-supervised RGB-D Salient Object Detection (SOD) is explored to reduce the heavy burden of pixel-level annotations. But scribble annotations lack the structure and details of objects, resulting in inaccurate saliency maps. In this paper, we propose a novel scribble-supervised RGB-D SOD method, consisting of a Segment Anything Model (SAM)-driven pseudo annotation generation method (\emph{SAM-PAG}) and a state space interaction-based conditional diffusion model (\emph{$S^2$Diff}). Specifically, SAM-PAG is tailored to address the issue of sparse supervision information. In SAM-PAG, we adopt the advanced SAM to expand sparse scribbles to dense pixel-level pseudo annotations through the dual-branch structure and the consistency of segmentation masks. In $S^2$Diff, we adopt the diffusion model to iteratively refine the noisy saliency maps with the guidance of conditional information, generating accurate saliency maps. Naturally, the core of our $S^2$Diff lies in the acquisition of conditional features and the denoising of saliency maps. For the former, we employ a cross-modal conditional generation module to interweave cross-modal features through frequency integration and implicit-explicit state space interaction, effectively achieving global conditional features. For the latter, we employ a context injection module to mitigate noise interference and to enhance object information with the conditional context. With the close cooperation of SAM-PAG and $S^2$Diff, our method outperforms relevant scribble-supervised methods and achieves competitive performance compared to fully-supervised methods on seven datasets. The code and results of our method are available at https://github.com/Switch457/WeakS2Diff_SOD.

[77] Video = World + Event Stream cs.CVPDF

Lianghua Huang, Zhi-Fan Wu, Yupeng Shi, Wei Wang, Mengyang Feng

TL;DR: 本文提出Wan-Streamer v0.3，它将视频重新定义为’世界’加’事件流’。世界是视频展开的持久上下文，事件流是世界内随时间变化的一切。基于此，模型通过预测世界如何实时移动和变化进行通用预训练，并可应用于实时全双工音视频交互等下游任务。

Details

Motivation: 旨在为大量真实视频提供一个通用的预训练框架，将视频解构为稳定的世界上下文和动态的事件流，以支持实时交互任务。

Result: 模型保持了v0.2的操作点：640x368分辨率、25 FPS视频、160毫秒流单元、约200毫秒模型端响应延迟，以及在350毫秒双向网络预算下约550毫秒的总交互延迟。

Insight: 将视频建模为’世界+事件流’的统一框架是一个核心创新，它将复杂的多模态实时交互任务转化为一个可预测世界状态变化的通用预训练问题，为实时AI系统提供了新的设计范式。

Abstract: We present Wan-Streamer v0.3, which reframes our native-streaming interaction model under a single organizing view: a video is a world plus an event stream. The world is the persistent context in which a video unfolds, including the environment, scene, subjects, ambient acoustic conditions, voice characteristics, and other relatively stable conditions. The event stream is everything that changes over time within that world, including scene or environmental changes, subject behavior, speech, and other sounds. This yields a general-purpose pretraining task over large amounts of real video: given a world and incoming input, predict how the world moves, changes, and responds in real time. The resulting competence can be specialized to a broad family of real-time downstream tasks. We instantiate it on real-time full-duplex audio-visual interaction, where the event stream is the agent’s speech together with free-form behavior. Functionally, the model’s multimodal understanding process is vision-language-action-like: it maps multimodal user input to language-form speech and behavior actions. Wan-Streamer v0.3 preserves the v0.2 operating point: 640x368 video at 25 FPS, a 160 ms streaming unit, approximately 200 ms model-side response latency, and approximately 550 ms total interaction latency under a 350 ms bidirectional network budget.

[78] Parameter-efficient Prompt Tuning of Vision Foundation Model With Adaptive Focal Loss for Interpretable MCI Screening cs.CV | cs.AI | cs.LGPDF

Javad Khoramdel, Farhad Hoseyni, Amirhossein Nikoofard

TL;DR: 本文提出了一种参数高效的提示调优框架，用于从神经心理学绘图测试中筛查轻度认知障碍。该方法利用冻结的DINOv2-Small视觉基础模型，通过三个模态特定的可学习提示令牌进行适配，并引入一种整合了连续认知评分的自适应焦点损失来处理类别边界模糊问题。该框架直接通过交叉注意力图实现空间可解释性，并以仅119万个可训练参数，在五折交叉验证中取得了优于计算密集型基线的性能。

Details

Motivation: 解决从神经心理学绘图测试中自动化检测轻度认知障碍时面临的数据稀缺、类别不平衡以及临床边界附近的诊断模糊性等根本性约束。现有方法通常使用计算昂贵的全微调混合架构，并将空间可解释性作为事后近似而非模型固有属性。

Result: 在分层五折交叉验证中，所提架构在MCI类别上取得了0.641的F1分数和0.795的AUC，在MCI类别F1分数上比计算量更大的ResViT基线高出0.110。

Insight: 创新点包括：1) 参数高效的提示调优框架，通过模态特定的提示令牌和共享交叉注意力层，将空间可解释性作为架构的结构性结果直接实现；2) 引入整合了连续认知评分的自适应焦点损失，用于处理边界模糊性，严格泛化了标准的软标签方法；3) 通过注意力模块融合任务条件嵌入以量化每个受试者的模态级重要性。

Abstract: Mild Cognitive Impairment is a critical early stage of cognitive decline that frequently precedes Alzheimer’s disease, yet its automated detection from neuropsychological drawing tests remains fundamentally constrained by data scarcity, class imbalance, and diagnostic ambiguity near clinical boundaries. Existing methodologies attempt to bypass these constraints using computationally expensive, fully fine-tuned hybrid architectures that relegate spatial explainability to a post-hoc approximation rather than an intrinsic model property. We propose a parameter-efficient framework utilizing frozen DINOv2-Small model adapted via three modality-specific learnable prompt tokens while Operating with 1.19 million trainable parameters, each token serves as a query in a shared cross-attention layer over the source image patch tokens. Crucially, spatial explainability is achieved directly through these attention maps; as a structural consequence of the architecture. Then task-conditioned embeddings fused via an attention module to quantify modality-level importance per subject. To handle boundary ambiguity, a MoCA-adapted focal loss introduced that integrates continuous cognitive scores into the training target, loss modulation, and adaptive sample weighting, strictly generalizing standard soft-label approaches. Under stratified five-fold cross-validation, the proposed architecture yields an MCI-class F1 of 0.641 and an AUC of 0.795, outperforming the computationally heavier ResViT baseline by 0.110 in MCI-class F1.

[79] SUFLECA: Scaling Up Feature Learning for CAD-to-image Alignment cs.CV | cs.ROPDF

Saad Ejaz, Miguel Fernandez-Cortizas, Javier Civera, Holger Voos, Jose Luis Sanchez-Lopez

TL;DR: SUFLECA是一个用于零样本CAD到图像对齐的弱监督框架，旨在从单张RGB图像估计物体的9D姿态（旋转、平移和各向异性缩放）。它通过在大规模数据集上学习几何感知特征，并结合几何一致匹配算法，实现了准确、快速的姿态估计，无需迭代优化。

Details

Motivation: 现有零样本方法依赖视觉基础模型进行图像区域与CAD模型匹配，但其对应关系通常基于外观，在遮挡或仿真到真实域偏移下性能下降。SUFLECA旨在解决这些限制，提升几何鲁棒性和跨域泛化能力。

Result: 在ScanNet25k基准测试中，SUFLECA实现了33.4%的类别准确率和42.3%的实例准确率，以更小的计算开销超越最强零样本基线10.3/12.2个百分点，并首次在该基准上超过全监督方法。

Insight: 创新点包括：1) 通过归一化物体坐标监督在674K图像上扩展几何基础特征学习，学习紧凑的跨域几何感知特征；2) 提出几何一致匹配算法，建立可靠的一对一CAD到图像对应关系。这些贡献实现了无需迭代的姿态估计，在精度和效率上均有突破。

Abstract: CAD-to-image alignment aims to estimate an object’s 9D pose (rotation, translation, and anisotropic scale) from a single RGB image, enabling applications in robotics and augmented reality. Recent zero-shot methods use visual foundation models to match image regions to CAD models, yet typically their correspondences are appearance-driven and degrade under occlusion or sim-to-real domain shift. To address these limitations, we introduce SUFLECA (Scaling Up Feature LEarning for CAD Alignment), a weakly-supervised framework for zero-shot CAD alignment with two key contributions. First, SUFLECA scales up geometry-grounded feature learning from pretrained visual representations through Normalized Object Coordinates (NOCs) supervision on 674K images spanning 12 real and synthetic datasets, learning compact geometry-aware features that generalize across domains. Second, we propose a geometrically consistent matching algorithm that establishes reliable one-to-one CAD-to-image correspondences. Together, these contributions enable accurate, sub-second alignment per object instance without iterative pose refinement. On ScanNet25k, SUFLECA achieves 33.4%/42.3% category/instance accuracy, outperforming, with a smaller computational footprint, the strongest zero-shot baseline by 10.3/12.2 percentage points and, for the first time on this benchmark, even surpassing fully supervised methods. Code is available at: https://github.com/snt-arg/SUFLECA

[80] Beyond Single Expert: Harmonizing Diverse Visual Priors in MLLMs for Spatial Understanding cs.CVPDF

Xiao Lin, Xiaohu Huang, Kai Han

TL;DR: 本文提出了一种名为ViPS的多模型先验框架，旨在通过整合来自不同基础模型的多样化视觉先验知识，以增强多模态大语言模型（MLLMs）的空间理解能力。该框架包含高效的先验代理模块来生成多种先验，以及动态先验融合机制来实现上下文感知的先验融合与注入。实验表明，ViPS在多个复杂的空间推理和3D空间理解基准测试中取得了新的最先进性能。

Details

Motivation: 现有方法通常仅整合单一预训练基础模型的先验知识来提升MLLMs的空间感知能力。本文发现，整合多样化的基础模型时，不同模型提供的互补性空间先验知识有利于不同的任务，因此需要一种能够协调和充分利用这些多样化先验的框架。

Result: 在多个复杂的空间推理和3D空间理解基准测试上进行了广泛实验，结果表明ViPS成功协调了多样化的视觉先验，并建立了新的最先进（SOTA）性能。

Insight: 主要创新点在于提出了一个多模型先验框架，通过高效的先验代理和动态的先验融合机制，实现了对来自不同基础模型的互补性视觉先验的协调与有效整合，从而提升了MLLMs在复杂空间理解任务上的性能。

Abstract: Multimodal Large Language Models (MLLMs) have demonstrated substantial promise in spatial understanding. Existing works typically incorporate prior knowledge extracted from a pre-trained foundation model to further enhance the spatial awareness of MLLMs. In this paper, we first reveal that when integrating diverse foundation models into MLLMs, different models provide complementary spatial priors that benefit different tasks. Motivated by this, we propose $\textbf{ViPS}$, a novel multi-model prior framework designed to fully unleash the potential of incorporating multiple $\textbf{Vi}$sual $\textbf{P}$riors from diverse models into MLLMs for $\textbf{S}$patial understanding. Specifically, ViPS introduces an Efficient Prior Proxy to generate multiple foundational priors with minimal inference overhead, and a Dynamic Prior Fusion mechanism to achieve harmonious and context-aware prior fusion and injection from the prior proxies. Extensive experiments demonstrate that ViPS successfully harmonizes diverse visual priors, establishing new state-of-the-art performance across multiple complex spatial reasoning and 3D spatial understanding benchmarks. Project page: https://visual-ai.github.io/vips

[81] AlphaWiSE: Adaptive Weight Interpolation for Continual Multimodal Representation Learning cs.CV | cs.LGPDF

Sarthak Jain, Qiran Hu, Zhen Zhu, Yaoyao Liu

TL;DR: AlphaWiSE是一种用于持续多模态表示学习的自适应权重插值方法。它通过组合两个冻结的源检查点，为每个对齐的参数张量拟合一个共享的标量插值系数，从而在不增加推理时间的情况下，生成一个单一的插值检查点。该方法旨在解决持续学习过程中，顺序到达的数据可能破坏先前阶段获得的跨模态对齐的问题。

Details

Motivation: 传统的持续学习方法只返回一个单一的检查点，这迫使所有检索方向都遵循相同的稳定性-可塑性权衡。论文旨在解决持续适应顺序到达数据时，可能破坏CLIP等多模态模型早期获得的跨模态对齐的问题。

Result: 在音频-图像-文本检索任务上的大量实验表明，AlphaWiSE在多个检索方向和评估指标上，均优于强大的持续学习基线方法。

Insight: 创新点在于提出了一种后处理的权重空间插值方法，通过为每个对齐的参数张量拟合一个共享的标量系数来组合检查点，从而允许模型在持续学习中更灵活地平衡稳定性和可塑性，且不增加推理开销。

Abstract: Multimodal models such as CLIP learn a shared embedding space for cross-modal retrieval, but continual adaptation to sequentially arriving data can disrupt the cross-modal alignment acquired from earlier phases. Conventional continual-learning methods return a single checkpoint, which commits every retrieval direction to the same stability-plasticity trade-off. We propose AlphaWiSE, a post-hoc weight-space interpolation method that composes two frozen source checkpoints. For each aligned parameter tensor identified by its checkpoint key, AlphaWiSE fits one scalar interpolation coefficient shared by all tensor entries. The coefficients are fitted on a smaller exemplar memory and used to materialize one interpolated checkpoint. The deployed model has the same architecture and parameter count as either source checkpoint, which does not require additional inference time. Extensive experiments on audio-image-text retrieval show consistent improvements over strong continual-learning baselines across multiple retrieval directions and evaluation metrics.

[82] DAPGNet: Dynamic Adaptive Physics-Guided Graph Diffusion Network for Hyperspectral Image Classification cs.CVPDF

Pengkun Wang, Weijia Cao, Ning Wang, Xiaofei Yang

TL;DR: 本文提出了DAPGNet，一种动态自适应物理引导的图扩散网络，用于高光谱图像分类。该方法将结构约束的物理先验注入到关系级图学习中，通过编码连续光谱响应、构建物理先验感知的稀疏拓扑、以及使用物理门控传播机制，有效建模像素关系。

Details

Motivation: 现有基于图的高光谱图像分类器通常从空间邻近性、超像素连通性或学习到的特征亲和力构建图拓扑，而连续波段携带的光谱物理先验对拓扑估计和消息传播的影响有限。本文旨在解决这一问题，将物理先验整合到图学习过程中。

Result: 在Indian Pines、WHU-Hi-LongKou、Houston2013和Houston2018数据集上的实验表明，DAPGNet在OA、AA和Kappa指标上均优于代表性的CNN、Transformer、Mamba和图基线方法。与最强竞争方法相比，在四个数据集上的AA提升了3.64到7.31个百分点。

Insight: 创新点在于将光谱物理先验系统地注入到图学习的多个阶段，包括节点级多尺度物理先验表示、物理先验感知的稀疏拓扑构建、以及通过物理门控进行特征插值的传播机制。消融实验支持了物理先验提取、先验感知拓扑、物理门控传播和光谱平滑正则化的互补效应。

Abstract: Hyperspectral image (HSI) classification requires reliable pixel-relation modeling under spectral variability, mixed pixels, and heterogeneous boundaries. Existing graph-based HSI classifiers usually construct graph topology from spatial proximity, superpixel connectivity, or learned feature affinity. However, the spectral physical prior carried by contiguous bands has limited influence on topology estimation and message propagation. This paper presents DAPGNet, a dynamic adaptive physics-guided graph diffusion network that injects a structure-constrained physical prior into relation-level graph learning. DAPGNet first encodes contiguous spectral responses into node-wise multiscale physical-prior representations. A two-stage graph constructor then combines spectral-spatial affinity, physical-prior consistency, and spatial distance to form a physical-prior-aware sparse topology. During graph diffusion, learned edge weights are transformed into additive attention biases, while a physical gate performs node-wise and feature-wise interpolation between graph-aggregated features and projected physical-prior features. Cross-scale fusion integrates node states from different diffusion depths, and the network is optimized with main classification, auxiliary supervision, and second-order spectral smoothness regularization. Experiments on Indian Pines, WHU-Hi-LongKou, Houston2013, and Houston2018 show that DAPGNet achieves the best OA, AA, and Kappa among representative CNN-, Transformer-, Mamba-, and graph-based baselines. It improves AA over the strongest competing method by 3.64 to 7.31 percentage points across the four datasets. Ablation and sensitivity analyses further support the complementary effects of physical-prior extraction, prior-aware topology construction, physics-gated propagation, and spectral smoothness regularization.

[83] MAGiSt3R: Multi-Agent Feed-forward 3D Reconstruction from Monocular RGB Videos cs.CVPDF

Ziren Gong, Xiaohan Li, Fabio Tosi, Ninghui Xu, Stefano Mattoccia

TL;DR: 本文提出了MAGiSt3R，一个用于单目RGB视频的多智能体3D重建框架，能以近10 FPS的速度执行重建和相机跟踪。该框架基于3R系列的前馈模型处理视频并回归局部点云图，并利用名为MAGMA的融合模型在智能体内和智能体间两个层面合并局部地图，以生成最终的全局点云图。此外，它还通过位姿图优化来减轻前馈流程中累积的相机漂移。

Details

Motivation: 解决从单目RGB视频进行实时、准确的3D重建和相机跟踪问题，特别是处理前馈流程中固有的累积相机漂移。

Result: 在合成和真实世界数据集上的评估表明，其重建和相机跟踪精度优于当前最先进（SOTA）的方法。

Insight: 创新点在于结合了多智能体架构（MAGMA）进行局部地图融合，以及引入位姿图优化来校正前馈模型产生的漂移，实现了高帧率下的高精度重建。

Abstract: This paper presents MAGiSt3R, a multi-agent 3D reconstruction framework performing reconstruction and camera tracking for monocular RGB videos at almost 10 FPS. MAGiSt3R relies on a feed-forward model from the 3R family to process RGB videos and regress local point maps, and on a merging model, MAGMA, that combines local maps at both intra-agent and inter-agent levels to obtain the final global point map. Furthermore, MAGiSt3R performs pose graph optimization to mitigate cumulative camera drift occurring along the feed-forward pipeline. We evaluate MAGiSt3R on both synthetic and real-world datasets, demonstrating its superior reconstruction and camera tracking accuracy compared to state-of-the-art approaches.

[84] Symbal: Detecting Systematic Misalignments in Model-Generated Captions cs.CV | cs.AIPDF

Maya Varma, Jean-Benoit Delbrouck, Sophie Ostmeier, Akshay Chaudhari, Curtis Langlotz

TL;DR: 本文提出了Symbal方法，用于检测多模态大语言模型生成图像描述中的系统性错位错误，即特定视觉特征与重复性描述错误之间的关联。同时，作者构建了包含170万图像-文本对、涵盖自然和医学图像的SymbalBench基准，以评估自动化检测方法。

Details

Motivation: 多模态大语言模型在生成图像描述时经常引入错误，导致图像-文本对错位，本文旨在检测其中与特定视觉特征相关的系统性错位错误。

Result: 在SymbalBench基准上，Symbal方法在63.8%的数据集中正确识别了系统性错位，比最接近的基线提升了近4倍；在真实世界评估中，Symbal能准确发现四种MLLM生成描述中的系统性错位，并有效审计现成的图像描述数据集。

Insight: 创新点在于定义了系统性错位检测任务，并提出了基于现成基础模型的双阶段结构化方法Symbal，以及构建了大规模、多领域的评估基准SymbalBench，为无需访问底层MLLM即可审计生成描述提供了工具。

Abstract: Multimodal large language models (MLLMs) often introduce errors when generating image captions, resulting in misaligned image-text pairs. Our work focuses on a class of captioning errors that we refer to as systematic misalignments, where a recurring error in MLLM-generated captions is closely associated with the presence of a specific visual feature in the paired image. Given a vision-language dataset with MLLM-generated captions, our aim in this work is to detect such errors, a task we refer to as systematic misalignment detection. As our first key contribution, we present Symbal, which utilizes a structured, dual-stage setup with off-the-shelf foundation models to identify systematic misalignments and summarize results in natural language. As our second key contribution, we introduce SymbalBench, a benchmark designed to evaluate automated methods on our proposed task. SymbalBench consists of 1.7 million image-text pairs from two domains (natural and medical images), organized into 420 vision-language datasets with annotated systematic misalignments. Symbal exhibits strong performance on this benchmark, correctly identifying systematic misalignments in 63.8% of datasets, a nearly 4x improvement over the closest baseline. We supplement our evaluations on SymbalBench with real-world evaluations, showing that (1) Symbal can accurately surface systematic misalignments in captions generated by four MLLMs and (2) Symbal is a powerful tool for auditing off-the-shelf image-caption datasets. Ultimately, our novel task, method, and benchmark can aid users with auditing MLLM-generated captions and identifying critical errors, without requiring access to the underlying MLLM. Code is available at https://github.com/Stanford-AIMI/Symbal.

[85] CRISP: Constrained Refinement via Iterative Squeezing Process for Robust Medical Image Segmentation under Domain Shift cs.CVPDF

Yizhou Fang, Pujin Cheng, Yixiang Liu, Xiaoying Tang, Longxi Zhou

TL;DR: 本文提出了一种名为CRISP的模型无关框架，用于解决医学图像分割中的域偏移问题。该方法基于“正区域排序稳定性”假设，通过潜在特征扰动生成高精度核心和高召回支持双重先验，并设计迭代训练过程逐步优化分割结果。该框架无需目标域数据或测试时参数更新，是一个即插即用的精炼方法。

Details

Motivation: 医学影像中的分布偏移是阻碍医学AI临床转化的核心瓶颈，现有域适应方法通过模拟偏移或伪监督来穷举预定义可能性，难以应对现实世界中开放且不可预测的无限偏移。

Result: 在多中心心脏MRI和基于CT的肺部血管分割任务上进行了广泛评估，CRISP在域偏移下表现出卓越的鲁棒性，在多中心、人口统计和模态偏移上分别实现了高达0.14像素（提升7.0%）、1.90像素（提升13.1%）和8.39像素（提升38.9%）的HD95显著降低，显著优于现有最先进方法。

Insight: 创新点在于利用分布偏移下概率排序的稳定性来推导鲁棒的空间先验，而非直接用于输出掩码；通过扰动不变的高置信区域定义高精度核心，并通过至少一次扰动下仍可能为前景的体素定义高召回支持，形成双重先验并进行迭代精炼。这是一种无需目标域数据、无需测试时更新的即插即用框架，为处理开放世界中的无限域偏移提供了新思路。

Abstract: Distribution shift in medical imaging remains a central bottleneck for the clinical translation of medical AI. Failure to address it can lead to severe performance degradation in unseen environments and exacerbate health inequities. Existing methods for domain adaptation are inherently limited by exhausting predefined possibilities through simulated shifts or pseudo-supervision. Such strategies struggle in the open-ended and unpredictable real world, where distribution shifts are effectively infinite. To address this challenge, we adopt the “Rank Stability of Positive Regions” as a working assumption under distribution shift, and use it to derive robust spatial hints for source-only segmentation. Guided by this assumption, we propose CRISP, a model-agnostic framework that, unlike deployment-time adaptation, requires no test-time parameter updates and no target-domain data–a target-free, plug-in refinement framework that segments with frozen weights. Rather than using ranking to directly output masks, CRISP exploits the stability of probability rankings under distribution shift to derive robust spatial priors. Via latent feature perturbation, perturbation-invariant high-grade regions define a high-precision (HP) core, while voxels that remain potentially foreground under at least one perturbation define a high-recall (HR) support; these dual priors are then recursively refined under perturbation. We then design an iterative training framework that progressively squeezes HP and HR toward the final segmentation. Extensive evaluations on multi-center cardiac MRI and CT-based lung vessel segmentation demonstrate CRISP’s superior robustness, significantly outperforming state-of-the-art methods with striking HD95 reductions of up to 0.14 (7.0% improvement), 1.90 (13.1% improvement), and 8.39 (38.9% improvement) pixels across multi-center, demographic, and modality shifts, respectively.

[86] ARMOR++: Agentic Orchestration of a Multi-Domain Primitive Set for Transferable Attacks on Deepfake Detectors cs.CVPDF

Christos Korgialas, Gabriel Lee Jun Rong, Dion Jia Xu Ho, Pai Chet Ng, Xiaoxiao Miao

TL;DR: 本文提出了ARMOR++，一个用于深度伪造检测器黑盒对抗迁移攻击的鲁棒多智能体框架。该框架利用Qwen2.5-VL视觉语言模型提供空间语义先验，并由Qwen3大语言模型协调五种互补的原始攻击方法，以生成高迁移性的对抗扰动。在AADD-2025基准测试上的评估表明，该方法在低质量和高质量图像下均显著优于现有智能体和非智能体基线。

Details

Motivation: 现有针对深度伪造检测器的迁移攻击方法缺乏语义感知能力，且在严格无查询约束下（尤其是从卷积网络代理模型迁移到基于Transformer的目标模型时）难以保持有效性。

Result: 在AADD-2025基准测试上的严格评估表明，ARMOR++在低质量和高质量图像下均显著优于现有智能体和非智能体基线。统计分析证实，其盲目标攻击成功率相比最先进的智能体基线有显著提升，并且在非智能体基准和鲁棒防御配置下也显示出进一步的性能优势。

Insight: 核心创新点在于利用多智能体（VLM+LLM）协同编排一个包含密集优化、显著性方法、空间变换、频域扰动和块结构修改的互补原始攻击方法集，以针对异构的归纳偏置，从而提升对抗样本的语义感知能力和跨架构迁移性。

Abstract: The reliability of deepfake detectors frequently degrades under black-box adversarial transfer, as these models often rely on fragile, architecture-dependent forensic cues. Existing transfer attacks often lack semantic awareness and struggle to maintain effectiveness under strict no-query constraints, particularly when perturbations are transferred from convolutional surrogates to transformer-based targets. To address these limitations, this paper introduces ARMOR++, a robust multi-agent framework designed for high-transferability deepfake evasion. The framework leverages the Qwen2.5-VL Vision-Language Model (VLM) to supply spatial semantic priors, while the Qwen3 Large Language Model (LLM) orchestrates primitive selection, adaptive hyperparameter reparameterization, and entropy-regularized perturbation mixing. By integrating five complementary primitives, spanning dense optimization, saliency-based methods, spatial transformations, frequency-domain perturbations, and block-structured modifications, ARMOR++ effectively targets heterogeneous inductive biases. Rigorous evaluation on the AADD-2025 benchmark demonstrates that ARMOR++ significantly outperforms existing agentic and non-agentic baselines across both low- and high-quality image regimes. Statistical analysis confirms a substantial gain in blind-target Attack Success Rate (ASR) over the state-of-the-art agentic baseline, with further performance advantages evidenced against non-agentic benchmarks and under robust defensive configurations. These findings highlight a significant residual reliability gap in current deepfake detector deployments and demonstrate the efficacy of agentic orchestration in identifying latent vulnerabilities.

[87] SceneBind: Binding What and Where Across Vision, Audio and Language cs.CV | cs.AI | cs.MM | cs.SDPDF

Mingfei Chen, Zijun Cui, Ruoke Zhang, Hyeonggon Ryu, Eli Shlizerman

TL;DR: 本文提出了SceneBind，一种跨视觉、听觉和语言的联合语义与三维空间理解的场景表示方法。该方法通过将场景表示为语义-空间实体，结合全局语义嵌入和以对象为中心的语义-空间槽，显式地捕捉对象级语义、空间属性和不确定性。此外，还提出了SceneBind Matching匹配方案，支持跨模态场景检索和对象定位，并在真实世界的双耳视听数据集上实现了SOTA性能。

Details

Motivation: 现有全模态编码器擅长实例级语义（即“是什么”），但缺乏显式的空间结构（即“在哪里”）。SceneBind旨在填补这一空白，实现对场景中对象语义和空间位置的联合理解。

Result: SceneBind在场景和空间检索任务上达到了最先进水平（SOTA），并在视听定位等下游任务上展现出强大的零样本迁移能力。

Insight: 创新点在于提出了一种轻量级的语义-空间联合表示，通过少量额外token实现空间建模，并与大规模预训练语义编码器兼容；同时，引入了结合全局场景相似性和对象对齐的匹配方案，以及带有结构化标注的真实世界双耳视听数据集。

Abstract: We present SceneBind, an omni-modal representation of realistic scenes with joint semantic and 3D spatial understanding across vision, audio and language. Existing omni-modal encoders excel at instance-level semantics (i.e., what is present), but often lack explicit spatial structure (i.e., where it is). SceneBind addresses this gap by representing each scene as a semantic-spatial entity, combining a global semantic embedding with object-centric semantic-spatial slots. This representation explicitly captures object-level semantics, spatial attributes, and uncertainty. We further propose SceneBind Matching, a semantic-spatial matching scheme that integrates global scene similarity with object alignment, supporting cross-modal scene retrieval and object grounding. To train and evaluate SceneBind, we curate a novel real-world binaural audio-visual dataset with structured semantic and spatial annotations, and propose a training protocol for aligning semantic and spatial signals across modalities. SceneBind is compatible with large-scale pretrained semantic encoders, adds lightweight spatial modeling with only a few additional tokens. It achieves state-of-the-art scene and spatial retrieval while enabling strong zero-shot transfer to downstream tasks such as audio-visual localization.

[88] HoloGeo: Mitigating Landmark Bias in Geo-localization via Evidence-Driven Reasoning cs.CVPDF

Pengcheng Zhou, Xuanyu Liu, Yanchen Yin, Bobo Li, Shengqiong Wu

TL;DR: 本文提出了HoloGeo框架，旨在缓解视觉语言模型在图像地理定位任务中的地标偏见问题。作者首先设计了Bias Intensity和Bias Harmfulness两个量化指标来评估地标偏见的影响，并构建了LandmarkBias-3K基准。HoloGeo采用证据驱动的推理方法，利用标注有多证据无偏见推理链的BF-30k数据集，通过多维奖励机制鼓励模型关注多样化的视觉线索，从而实现更可靠的联合推理。

Details

Motivation: 现有视觉语言模型在地理定位任务中容易受到地标偏见的影响，导致模型忽略地理线索或形成虚假关联，从而产生不准确的定位结果。本文旨在系统性地研究并缓解这一问题。

Result: 在IM2GPS3K和YFCC4k基准上保持了优异性能，并在新构建的LandmarkBias-3K基准上显著超越了现有的开源视觉语言模型，验证了其鲁棒地理空间推理的有效性。

Insight: 创新点包括提出了量化地标偏见的指标和基准，以及设计了证据驱动的推理框架HoloGeo，该框架通过结构化多证据推理链和多维奖励机制，显式地鼓励模型进行平衡的注意力分配和联合推理，从而减少对单一地标的依赖。

Abstract: Recent advances in Vision-Language Models (VLMs) have significantly improved image geo-localization, yet existing models remain susceptible to landmark bias, causing them to overlook geographical cues or form spurious correlations, ultimately resulting in inaccurate localization. To systematically investigate this issue, we first design two quantitative metrics, Bias Intensity (BI) and Bias Harmfulness (BH), to characterize the impact of landmarks exerted on model reasoning, and establish a comprehensive benchmark, LandmarkBias-3K. To mitigate landmark bias, we further propose an evidence-driven reasoning framework, HoloGeo, to improve the reliability of geo-localization. HoloGeo is supported by a high-quality dataset, BF-30k, annotated with structured multi-evidence bias-free reasoning chains. By incorporating multi-dimensional rewards, HoloGeo explicitly encourages balanced attention over diverse visual cues and achieves evidence-driven joint reasoning. Extensive experiments demonstrate that HoloGeo not only maintains excellent performance on IM2GPS3K and YFCC4k but also significantly outperforms existing open-source VLMs on LandmarkBias-3K, validating its effectiveness for robust geospatial reasoning.

[89] Motion-Conditioned Multi-View Fusion for Myocardial Infarction Localization from Echocardiography cs.CVPDF

Guang Yang, Wentian Xu, Siyu Wang, Betty Raman, Lei Li

TL;DR: 本文提出了一种名为MCF-Net的新型运动引导多视图融合框架，用于从超声心动图（Echo）中定位心肌梗死（MI）。该方法融合了心肌运动线索与基础模型表征，通过极稀疏的监督（仅需单帧标注）建模心脏运动，并利用运动衍生的节段感知软掩码来增强特征，最后通过运动条件融合机制跨视图整合信息。

Details

Motivation: 心肌梗死是全球主要死因，超声心动图是其评估的常用手段，其中局部室壁运动异常是关键指标。现有基于学习的方法通常需要密集标注，限制了实用性；而基础模型虽有所改进，但大多基于单视图，且在视图依赖的模糊性（尤其是心尖视图）下，节段级定位仍不可靠。

Result: 在节段级心肌梗死定位任务上，MCF-Net取得了72.4%的F1分数和84.9%的准确率，优于最先进的纯运动、纯视觉以及融合基线方法。

Insight: 创新点在于提出了一个运动条件多视图融合框架，将极稀疏监督的运动建模（通过单帧标注模板初始化点跟踪）与预训练的超声基础模型（EchoPrime）特征相结合，并利用运动生成的软掩码作为空间先验来选择性增强困难心肌节段的特征，实现了运动与视觉线索的有效互补融合。

Abstract: Myocardial infarction (MI) remains a leading cause of mortality worldwide. Echocardiography (Echo) is a widely available modality for MI assessment, where regional wall motion abnormality is a key indicator. Prior learning based methods for myocardial motion analysis often use handcrafted descriptors or densely supervised estimation, but the need for extensive annotation limits applicability. Foundation models have recently improved vision-based Echo analysis; however, most methods operate on single views and segment-level localization remains unreliable under view-dependent ambiguity, especially in apical views. To address this, we propose MCF-Net, a novel motion-guided multi-view fusion framework that fuses myocardial motion cues with foundation model representations to localize infarction. Visual features are extracted using EchoPrime, a pretrained Echo foundation model shared across dual views. Cardiac motion is modeled with extremely sparse supervision: a single annotated template frame is transferred across videos to initialize point tracking, avoiding dense labels. Motion-derived segment-aware soft masks provide coarse spatial priors that selectively enhance features for challenging myocardial segments. A motion-conditioned fusion mechanism then integrates motion and vision across views, refining predictions without overriding strong appearance cues. On segment-level MI localization, MCF-Net achieves 72.4% F1 and 84.9% accuracy, outperforming state-of-the-art motion-only, vision-only, and fusion baselines.

[90] Online Neural Space Time Memory for Dynamic Novel View Synthesis cs.CV | cs.GR | cs.LGPDF

Baback Elmieh, Lynn Tsai, Zeman Li, Srinivas Kaza, Tiancheng Sun

TL;DR: 本文提出了一种在线神经时空记忆方法，用于动态场景的新视角合成。该方法通过解耦记忆更新与应用的频率，在保持实时性的同时，实现了对动态场景（如人体运动）的长期记忆和遮挡区域重建。

Details

Motivation: 解决多视角视频流在线新视角合成中的基本权衡问题：在严格实时约束下，如何维持持久的长时记忆以重建临时遮挡区域。现有基于测试时训练的方法需要每帧进行梯度更新，计算成本高且可能导致不稳定。

Result: 在动态人体运动场景中实现了实时、最先进的性能，并支持分钟级的在线记忆。

Insight: 创新点在于将记忆更新与应用频率解耦，并引入记忆损失和记忆缓存机制来稳定长期记忆，避免灾难性漂移。这为实时动态场景重建提供了高效的内存管理策略。

Abstract: Online novel view synthesis from multi-view streaming videos faces a fundamental trade-off: maintaining a persistent, long-horizon memory to reconstruct temporarily occluded regions while operating under strict real-time constraints. While Test-Time Training (TTT) offers a powerful memory mechanism, standard models mandate gradient-based memory updates at every frame to adapt to the changing motion in dynamic scenes. The computational cost of heavy memory updates precludes real-time application and can lead to instability over long contexts. Given that memory updates are more demanding than memory application and video content is largely redundant, we propose to decouple the frequencies of these two processes. Our approach performs periodic memory updates while applying the memory on a per-frame basis, using cross-view attention to manage deformations between the prior memory state and the current frame. To lock in the historical context, we introduce two critical mechanisms: an auxiliary Memory Loss that forces persistent internalization of the scene, and a Memory Caching strategy that regularizes active weights against catastrophic drift. Our method demonstrates real-time, state-of-the-art performance on scenes with dynamic human motion as well as minute-scale online memorization.

[91] Hierarchical Denoising For Multi-Step Visual Reasoning cs.CVPDF

Zezhong Qian, Xiaowei Chi, Chak-Wing Mak, Tianze Zhou, Ruibin Yuan

TL;DR: 本文提出了一种名为HDR（Hierarchical Denoising for Visual Reasoning）的统一框架，通过将分层潜在表示集成到因果视频生成中，来解决多步视觉推理任务。该方法采用树状层次结构组织视频潜在变量，实现从粗到细的推理，并引入稀疏层次注意力模式（SHAP）以降低计算成本。

Details

Motivation: 现有视频模型（如流式自回归扩散模型和双向扩散模型）在实现逻辑一致性和低延迟流式处理复杂推理任务方面存在不足，缺乏类人的多步推理能力。

Result: 在包含迷宫导航、汉诺塔等六个任务的多步视频推理基准测试中，HDR将成功率从基线模型的34.22提升至60.29（相对增益76.2%），平均进度从76.00提升至89.56。推理延迟为每潜在变量0.70秒，比双向扩散模型快54.2倍，且在仅使用2%训练数据时仍能保持82.9%的完整数据性能。

Insight: 核心创新在于将视频潜在空间组织为树状层次结构，支持在流式输出前进行从全局规划（粗层）到具体视觉状态（细层）的渐进式推理。稀疏层次注意力模式（SHAP）有效降低了时序注意力成本，实现了高效且一致的推理。

Abstract: Video models are evolving into vision foundation models, yet they still lack human-like multi-step reasoning. Streaming autoregressive diffusion models are efficient but limited in reasoning, while bidirectional diffusion enables global revision with high inference costs due to dense frame-level denoising. Both paradigms struggle to achieve logical consistency and low-latency streaming for complex reasoning tasks. We propose HDR (Hierarchical Denoising for Visual Reasoning), a unified framework that integrates hierarchical latents into causal video generation for multi-step reasoning. HDR organizes video latents into a tree-structured hierarchy, enabling coarse-to-fine reasoning before streaming output. Coarse denoising layers preserve uncertain hypotheses for global planning, while finer layers progressively refine them into concrete visual states. A sparse hierarchical attention pattern (SHAP) further reduces temporal attention costs. We introduce a level-stratified multi-step video reasoning benchmark with out-of-distribution cases, covering six tasks: maze navigation, Tower of Hanoi, one-line drawing, sliding puzzle, Sokoban, and water pouring. Compared with streaming autoregressive diffusion baselines, HDR improves success from 34.22 to 60.29 (76.2% relative gain) and increases average progress from 76.00 to 89.56, demonstrating more consistent reasoning trajectories. HDR maintains low-latency streaming at 0.70 seconds per latent, achieving 54.2 times faster inference than bidirectional diffusion. It also retains 82.9% of full-data performance with only 2% training data, compared with 52.0% for bidirectional diffusion. Real-world robot experiments further demonstrate HDR’s potential for physical interaction and world modeling. Project demo: https://hierarchical-diffusion-reasoning.github.io/.

[92] MeanFlowNFT: Bringing Forward-Process RL to Average-Velocity Generators cs.CV | cs.LGPDF

Yushi Huang, Xiangxin Zhou, Jun Zhang, Liefeng Bo, Tianyu Pang

TL;DR: 本文提出了MeanFlowNFT方法，将前向过程强化学习（RL）框架应用于平均速度生成器（MeanFlow），以优化人类偏好和任务特定目标。该方法通过构建诱导瞬时速度预测器，将DiffusionNFT的奖励优化目标适配到MeanFlow中，从而在保持快速少步采样的同时实现策略改进保证。实验表明，MeanFlowNFT在图像和视频生成任务中优于基线方法，并在多个指标上超越了现有的少步生成器。

Details

Motivation: MeanFlow生成器通过预测时间间隔内的平均速度实现快速少步采样，但现有的强化学习方法（如DiffusionNFT）主要优化瞬时速度，难以直接应用于MeanFlow。本文旨在填补这一空白，将前向过程RL框架扩展到平均速度生成器，以提升其对齐性能。

Result: 在图像和视频生成实验中，MeanFlowNFT一致改进了基线方法。在SD3.5-M数据集上，它在8个指标中的6个上超越了先前最先进的RL调优少步生成器；在Wan 2.1数据集上，4步MeanFlowNFT的VBench得分达到84.33，超过了50步LongCat-Video RL的82.57分。

Insight: 创新点在于通过MeanFlow恒等式构建诱导瞬时速度预测器，将DiffusionNFT的RL目标适配到平均速度生成器，从而在保持快速采样的同时实现严格的策略改进保证。这为少步生成模型的强化学习对齐提供了新思路。

Abstract: MeanFlow generators achieve fast few-step sampling by predicting average velocities over time intervals, making them attractive for efficient generation. Reinforcement learning (RL) has become a powerful way to align diffusion and flow models with human preferences and task-specific objectives. In particular, DiffusionNFT offers an efficient forward-process RL framework that does not require reverse-process trajectories or likelihood estimation. However, applying such RL methods to MeanFlow remains underexplored. DiffusionNFT optimizes instantaneous velocities, whereas MeanFlow samples with average velocities. To bridge this gap, we introduce MeanFlowNFT. Inspired by the MeanFlow identity, which bridges average and instantaneous velocities, we construct an induced instantaneous-velocity predictor. We apply the DiffusionNFT objective to this predictor, making reward optimization well-defined for MeanFlow. Sampling remains based on the average velocity, preserving MeanFlow’s fast few-step generation. We further prove that MeanFlowNFT inherits DiffusionNFT’s strict policy-improvement guarantee. Experiments on image and video generation show that MeanFlowNFT consistently improves baselines. Moreover, it outperforms prior state-of-the-art RL-tuned few-step generators on most metrics ($6$ of $8$ on SD3.5-M), and can even surpass multi-step RL-tuned diffusion while using only a few sampling steps. For instance, on Wan 2.1, $4$-step MeanFlowNFT reaches a VBench score of $84.33$, surpassing $50$-step LongCat-Video RL ($82.57$).

q-bio.QM [Back]

[93] A vision foundation model for single-cell biology via spatial gene cartography q-bio.QM | cs.CV | cs.LGPDF

Ridvan Yesiloglu, Sakib Mostafa, James Zou, Ash Alizadeh, Jiajun Wu

TL;DR: 本文提出了scVision，一种基于视觉基础模型的单细胞生物学方法，通过空间基因图谱将每个细胞表示为连续图像。该方法利用最优传输将基因固定在共享的全组织布局上，使共表达基因成为空间邻居，从而将转录组转化为图像，其中基因程序表现为局部纹理。在7200万个人类细胞上进行掩码图像建模预训练后，scVision在零样本评估中成为最准确的细胞类型注释器，并在无监督下恢复基因程序，优于现有基础模型和经典基线。

Details

Motivation: 现有单细胞基础模型大多从语言模型改编，将细胞表示为基因标记序列，这丢弃了基因间的关系及其表达量信息。scVision旨在通过视觉模型框架保留这些关键生物学特征，将单细胞表示学习重新构建为视觉问题。

Result: 在六个独立、保留的研究中进行零样本评估时，scVision是最准确的细胞类型注释器，并在无监督下恢复基因程序，表现优于现有基础模型和经典基线；在多研究整合中，它与最强的基于标记的模型相当，同时保留了最多的生物结构，且从未接触过批次标签。

Insight: 创新点在于将单细胞转录组转化为连续图像，利用最优传输创建共享的基因空间布局，使共表达基因成为邻居，从而将基因程序编码为局部纹理。客观分析表明，该方法通过保留表达量和基因关系，将单细胞学习与成熟的计算机视觉方法连接起来，且实验证明生物意义的位置信息（而非网络结构）是信号的主要载体。

Abstract: Most single-cell foundation models are adapted from language models, representing each cell as a sequence of gene tokens. This discards the relationships among genes and often the magnitude of their expression. We present scVision, a vision foundation model that instead renders each cell as a continuous image. Using optimal transport, it places genes at fixed positions on a single shared, pan-tissue layout so that co-expressed genes become spatial neighbours, turning a transcriptome into an image in which gene programs appear as local texture. We pretrain a vision transformer by masked image modelling on 72 million human cells and use the frozen encoder with no fine-tuning. In zero-shot evaluations on six independent, held-out studies, scVision is the most accurate cell-type annotator and recovers gene programs without supervision, ahead of existing foundation models and classical baselines; on multi-study integration it matches the strongest token-based model while conserving the most biological structure, without ever seeing a batch label. Permuting the gene layout with the network fixed sharply lowers accuracy, more than removing the vision transformer itself, showing that biologically meaningful position, not the network, carries the signal. By preserving expression magnitude and gene relationships, scVision reframes single-cell representation learning as a vision problem, connecting it to the mature methods of computer vision.

cs.IR [Back]

[94] Bridge Evidence: Static Retrieval Utility Does Not Predict Causal Utility in Multi-Step Agentic Search cs.IR | cs.CLPDF

Debayan Mukhopadhyay, Utshab Kumar Ghosh, Shubham Chatterjee

TL;DR: 本文研究了在多步智能搜索中，静态检索效用与因果效用的差异。通过HotpotQA数据集上的ReAct智能体实验，发现约三分之一的文档在静态评估中看似无用，但在智能体推理过程中起到关键桥梁作用，帮助生成后续查询。

Details

Motivation: 传统检索系统基于静态文档-问题对评估文档有用性，但智能体在多轮搜索中可能利用文档信息引导后续查询，静态评估无法捕捉这种因果效用。

Result: 在23,322个文档观测中，静态检索效用（SRU）与反事实轨迹效用（CTU）接近统计独立（Spearman ρ=-0.026）。桥梁文档占比约27.2%，且包含区分性实体的文档使智能体生成后续查询的概率提升4倍（6.1% vs 1.5%）。

Insight: 提出了反事实轨迹效用（CTU）量化文档在智能体决策链中的因果作用，揭示了静态检索评估与智能体实际效用间的根本差异，为面向智能体的检索系统设计提供了新视角。

Abstract: Retrieval systems are trained and evaluated on a static idea of usefulness: hand a document and a question to a reader model, see whether the answer improves, and score the document accordingly. The idea holds up when a document is read on its own. It breaks when a language model works as a search agent, issuing several queries and reasoning across turns, because a document can matter for what it lets the agent do next rather than for what it says about the current question. We measure that gap rather than argue it. Using a ReAct style agent over HotpotQA, we replay 1000 development questions and, for every document the agent read, delete it and re-run the rest of the trajectory from that point. Comparing the original run against its counterfactual gives a Counterfactual Trajectory Utility (CTU) score from three deltas: final answer quality, next query retrieval quality, and turn count. Crossing CTU against Static RAG Utility (SRU) over 23,322 document observations, the two are close to statistically independent (Spearman rho = -0.026). Roughly a third of the documents the agent reads are causally load bearing while looking useless to a static reader; we call these bridge documents. The pattern survives when the reader based axis is swapped for a BM25 and cross encoder proxy, giving a bridge cell of 27.2% on an evenly spread axis. A second experiment pins down the mechanism. Using the Observable Entity Relevance (OER) measure from prior work, entities that discriminate relevant from non-relevant candidates appear in the agent’s next query 4.02 times more often than entities found only in non-relevant documents (6.1% vs 1.5%, n = 227,139). A bridge document earns its keep by handing the agent a discriminative entity that redirects the search. Static relevance and causal usefulness are different quantities in agentic retrieval, and optimizing the first does not deliver the second.

cs.AI [Back]

[95] DialogueVPR: Towards Conversational Visual Place Recognition cs.AI | cs.CL | cs.CVPDF

Yukun Song, Changwei Wang, Xingtian Pei, Shibiao Xu, Wenhao Xu

TL;DR: 该论文提出了对话式视觉地点识别（DialogueVPR）新范式，将地点定位任务从传统的静态单次检索转变为基于对话的交互式推理过程。为此，作者构建了首个大规模对话式地点识别基准DlgQuest-Cities，并开发了一个统一的推理框架，该框架结合了跨模态多级检索器与智能提问者DQ-pilot。

Details

Motivation: 现有语言引导的地理定位方法大多采用静态、一次性的检索范式，无法有效处理现实世界中自然语言描述固有的模糊性和不完整性。论文旨在模仿人类交流空间信息的方式，通过对话交互来解决这些问题。

Result: 实验表明，这种基于推理的方法显著优于基线模型。具体结果在作者新构建的DlgQuest-Cities基准上进行评估，证明了其有效性。

Insight: 核心创新点在于提出了对话式视觉地点识别（DlgPR）这一新任务范式，并构建了相应的基准和统一推理框架。框架中的智能提问者DQ-pilot采用课程学习（监督微调+GRPO强化学习精炼）进行训练，并引入了任务对齐的度量指标（DDI和PRG）来指导学习过程，直接衡量提问带来的检索改进。

Abstract: Inspired by how humans communicate spatial information, language-guided geo-localization has gained significant traction for its intuitive and practical value. Despite this progress, most methods still rely on a static, one-shot retrieval paradigm, which fails to handle the ambiguity and incompleteness inherent in real-world natural language descriptions. We propose a paradigm shift to reasoning retrieval and introduce Dialogue Place Recognition (DlgPR), which casts localization as an interactive, dialogue-driven reasoning process. To support this new task, we present DlgQuest-Cities, the first large-scale dialogue-based benchmark for place recognition, and a unified reasoning framework that couples a cross-modal multi-level retriever with an intelligent questioner, DQ-pilot. DQ-pilot is trained in a curriculum: supervised fine-tuning on a curated DQ-cities-20k subset followed by reinforcement refinement on a harder DQ-cities-10k split via GRPO. Two task-aligned metrics guide learning: a Discriminative Difficulty Index (DDI) for curriculum sampling and a Positional Retrieval Gain (PRG) reward that directly measures retrieval improvement induced by a question. Experiments show this reasoning-based approach significantly outperforms baselines. The code and model are available at https://github.com/Graysonggg/DlgPR.

[96] Interpretable Language Model for Closed-Loop Type 1 Diabetes Control cs.AI | cs.CL | cs.LGPDF

Maya Sarkar

TL;DR: 本文提出了一种名为LLM-T1D的闭环1型糖尿病控制方法，它将强化学习的精确性与大语言模型的类人推理能力相结合，旨在创建一个更透明、可靠的胰岛素泵控制器。该方法通过训练专家强化学习系统并将其知识蒸馏到微调的LLaMA 3.1 8B和Qwen3 8B模型中，开发出的控制器不仅性能超越原RL系统，还能用清晰易懂的语言解释其决策。

Details

Motivation: 尽管由强化学习驱动的人工胰腺系统在自动化胰岛素输送方面展现出潜力，但其“黑盒”特性使得患者和医生难以完全信任。本文旨在解决这一可解释性问题，结合RL的精度与LLM的清晰推理，以构建更透明、可靠的控制器。

Result: 在FDA批准的UVA/Padova T1D模拟器上进行测试，LLM控制器实现了出色的血糖控制（73.5%的时间在目标范围内），同时保持了严格的形式化安全验证以防止幻觉。

Insight: 论文的核心创新点在于将强化学习策略的知识蒸馏到可解释的大语言模型中，从而在保持甚至提升控制性能的同时，提供了自然语言决策解释，这为医疗AI系统的可信赖性设计提供了新思路。

Abstract: Type 1 Diabetes (T1D) is a chronic, life-threatening autoimmune condition characterized by the complete destruction of insulin-producing pancreatic beta cells. While Artificial Pancreas Systems (APS) powered by Reinforcement Learning (RL) have shown promise in automating insulin delivery, their ``black-box’’ nature makes it hard for patients and doctors to trust them fully. This paper presents LLM-T1D, a promising approach that combines the precision of RL with the clear, human-like reasoning of Large Language Models (LLMs) to create a more transparent and reliable insulin pump controller. By training an expert RL system and distilling its knowledge into fine-tuned LLaMA 3.1 8B and Qwen3 8B models, we developed a controller that not only surpasses the RL system’s performance but also explains its decisions in plain, understandable language. Tested on the FDA-approved UVA/Padova T1D simulator, the LLM controllers deliver excellent blood sugar control (73.5% Time in Range) while maintaining strict formal safety verification against hallucinations.

[97] Orchestrating Power Grid Studies with Multi-Agent AI and MCP Servers cs.AI | cs.CL | cs.MA | cs.SEPDF

Jérôme Picault, Clément Goubet

TL;DR: 本文探讨了如何利用Agentic AI和模型上下文协议（MCP）来支持输电系统运营商（TSO）环境下的电网研究。通过集成大语言模型与数值模拟工具、结构化工作流和人工监督，提出了基于MCP的接口pypowsybl-mcp，使AI代理能够访问电网模拟工具pypowsybl的功能，以研究代理如何设置模拟、执行分析、检索结果并通过标准化工具调用与电力系统模拟器交互。

Details

Motivation: 旨在解决电网研究中如何有效整合AI代理与现有模拟工具，以满足工业需求，提升电网研究的交互性、可审计性和可扩展性。

Result: 论文提出了pypowsybl-mcp接口作为测试平台，并讨论了结合技术指标和实践者反馈的评估策略，但未提供具体的定量实验结果或基准比较。

Insight: 创新点在于将MCP协议应用于电网模拟工具集成，实现AI代理的标准化工具调用，并强调人机协同和多代理工作流原则，为构建更智能的电网研究环境提供了技术路径。

Abstract: This position paper explores how Agentic AI and Model Context Protocol (MCP) can support power-grid studies in a Transmission System Operator (TSO) context. We focus on integrating Large Language Models with numerical simulation tools, structured workflows, and human supervision. We identify key industrial requirements for agent assisted grid studies and introduce pypowsybl-mcp, an MCP-based interface exposing selected capabilities of our simulation tool, pypowsybl to AI agents. This first step provides a testbed to study how agents can setup simulations, execute analyses, retrieve results, and interact with power-system simulators through standardized tool calls. We also discuss principles for human-in-the-loop, multi-agent workflows and outline an evaluation strategy combining technical metrics and practitioner feedback. The paper positions MCP-based tool integration as a step toward more interactive, auditable, and scalable grid-study environments.

[98] MemoHarness: Agent Harnesses That Learn from Experience cs.AI | cs.CLPDF

Yue Huang, Wenjie Wang, Han Bao, Yuchen Ma, Xiaonan Luo

TL;DR: MemoHarness是一个自适应的智能体控制层优化框架，它通过学习自身执行经验来改进智能体的表现。该框架将控制层分解为六个可编辑维度，利用双层经验库存储案例诊断和全局模式，并在测试时无需额外标签或搜索即可适配每个案例。

Details

Motivation: 现有智能体通常对所有案例复用单一静态控制层，而自动优化方法多局限于优化提示或流程等较窄的组件，缺乏从执行经验中学习以构建自适应控制层的方法。

Result: 在shell-agent、代码生成和分析推理基准测试中，MemoHarness优于固定控制层，并展现出对未见测试集和基础模型的选择性迁移能力，在经验可缓存时仍能保持成本竞争力。

Insight: 创新点在于将控制层系统分解为可编辑维度，并构建双层经验库（案例诊断与全局模式）实现无标签测试时适配，为构建超越静态配置的自适应智能体控制层提供了可行路径。

Abstract: An agent harness is the external control layer that turns a base LLM into an executable agent by managing context, tools, orchestration, memory, decoding, and output handling. While harness design strongly affects agent behavior, most automatic improvement methods optimize narrower artifacts such as prompts, pipelines, or workflows, and deployed agents usually reuse a single global harness for all cases. We introduce MemoHarness, an adaptive harness optimization framework that learns from its own executions. MemoHarness decomposes the harness into six editable control dimensions, stores per-case diagnoses and distilled global patterns in a dual-layer experience bank, and adapts the learned harness to each test case using retrieved experience without test-time labels, feedback, or additional search. In our evaluation across shell-agent, code-generation, and analytical-reasoning benchmarks, MemoHarness improves over the fixed harnesses we compare against and shows selective transfer to unseen suites and base models. Its additional context can also remain cost-competitive when much of the retrieved experience is cacheable. These results provide evidence that execution experience is a practical substrate for building agent harnesses that are more adaptive than a single static configuration, while leaving broader claims about statistical robustness and component attribution to future work.

[99] Instrument Effects in Language-Model Honesty Evaluation: An Auditable Single-System Demonstration cs.AI | cs.CLPDF

Justin Bronder

TL;DR: 本文通过构建一个文本冒险游戏环境来评估语言模型的诚实性，其中游戏引擎知晓任务是否可完成，而语言模型需在预算内声明任务完成、不可达或尚未决定。研究发现，评估工具（如裁决语法、成功标准披露）的选择会显著改变测量到的模型行为，揭示了现有评估方法可能存在的工具效应问题。

Details

Motivation: 当前语言模型诚实性评估通常将模型的裁决视为模型本身的证据，但本文旨在测试评估工具本身的影响，即评估方法的选择如何扭曲对模型行为的测量。

Result: 在固定模型的情况下，工具选择显著改变了测量结果：将二裁决语法扩展为三裁决语法后，强声明从38/40降至7/40；披露成功标准使匹配实例的错误裁决从18/59降至0/58；固定配置的重复运行在3/4实例上产生不稳定的裁决分布。

Insight: 创新点在于通过可控的游戏环境隔离了工具效应，并提出了一个包含预注册、运行工件绑定等步骤的四步完整性协议，以提高评估的可审计性和可靠性，这为未来模型评估方法的设计提供了重要借鉴。

Abstract: Evaluations of language-model honesty read the model’s verdicts as evidence about the model. We test the instrument instead. We built a text-adventure world where the game engine, not any model, knows whether the quest can be completed. A language model plays under a budget and must eventually declare its quest complete, unreachable, or not yet decidable; the engine scores every verdict. Decision rules were recorded before results were read, and run artifacts bind the revisions they executed; the strength of preregistration varies by series and is disclosed. With the player held fixed, instrument choices substantially changed measured behavior. On four byte-identical anchors, expanding a two-verdict grammar to three verdicts moved strong claims from 38/40 to 7/40, while the new incomplete verdict took 28/40 outcomes; across series 2, 93/158 valid games ended incomplete. One sentence disclosing the success criterion took matched-instance false verdicts from 18/59 to 0/58, through fewer decision points and cleaner decisions. Repeated runs of one fixed configuration produced non-stable verdict distributions on 3 of 4 instances: single runs report samples as dispositions. A formally preregistered narrative-register gradient was falsified; two post-hoc, hypothesis-generating patterns remain: register presence roughly doubled strong claims, and budget rendering moved verdicts more than register content (.383 meter vs .150 lantern). The narrator compressed abundant budgets toward scarcity landmarks, yet the registered mediation test returned a null. We propose a four-check integrity protocol for eval instruments.

[100] RetroAgent: Harnessing LLMs to Search Over Structured Memory for Agentic Retrosynthesis Planning cs.AI | cs.CL | cs.LGPDF

Yanqiao Zhu, Jingru Gan, Xiaoqi Sun, Fang Sun, Yidan Shi

TL;DR: 本文提出RetroAgent，一种利用大型语言模型（LLM）进行多步逆合成规划的智能体。该智能体通过结合结构化记忆和化学工具，在搜索过程中整合全局状态和领域知识，以改进对可行反应序列的探索和决策。

Details

Motivation: 解决多步逆合成规划中组合搜索空间巨大、传统方法仅孤立评分候选而缺乏对完整多步路径的推理，以及现有LLM方法接口简单、限制全搜索空间探索的问题。

Result: 在分布内和分布外基准测试中，RetroAgent表现出强大的性能和泛化能力。

Insight: 创新点在于构建了一个结合符号搜索和神经推理的LLM智能体框架，通过结构化记忆整合全局搜索状态（如已探索路径、可用替代方案和中间体性质），实现基于领域知识的知情决策。

Abstract: Multi-step retrosynthesis planning seeks to decompose a target molecule into commercially available building blocks through a sequence of feasible reactions. The vast combinatorial search space makes this task challenging even for expert chemists. Traditional methods combine tree search with offline-trained value networks that score candidates in isolation, without reasoning about complete multi-step routes. Recent work leverages Large Language Models (LLMs) for this task, but relies on simple interfaces that limit exploration of the full search space. We introduce RetroAgent, an LLM agent that bridges symbolic search and neural reasoning through a harness with structured memory. Through memory and chemistry tools, the agent observes the full search state, including explored routes, available alternatives, and properties of intermediates, enabling informed decisions grounded in both global progress and domain knowledge. Experiments on in-distribution and out-of-distribution benchmarks demonstrate that RetroAgent delivers strong performance and generalization.

[101] Stop Thinking, Start Looking: Efficient Post-Training for Multimodal Document Question Answering via Reasoning-Free Alignment cs.AI | cs.CL | cs.LGPDF

Harikrishnan P M, Goutham Vignesh, Ganesh Parab, Saisubramaniam Gopalakrishnan, Vishal Vaddina

TL;DR: 本文提出了一种名为Perception-RFT的高效多模态文档问答训练框架，该框架采用Group Relative Policy Optimization（GRPO）方法，绕过中间推理标记，直接将视觉特征与结构化定位输出对齐。研究发现，在4B参数规模下，启用推理的模型在训练中会抑制其推理轨迹，收敛到基于直接感知的策略，从而将每次查询的推理标记长度减少60%以上，且纯感知训练优于启用推理的强化学习。

Details

Motivation: 解决多模态文档问答中需要显式视觉定位的挑战，当前方法如监督微调（SFT）需要大量标注数据且易达到优化瓶颈，而基于推理的强化学习（RL）则依赖冗长的中间轨迹，增加推理成本但无明显益处。

Result: 在4B参数模型（如Qwen3-VL-4B）上，Perception-RFT框架在推理时减少超过60%的标记长度，同时在两个分布外（OOD）基准测试（4,828个样本）上展示了语义鲁棒性和几何精度之间的权衡（即Grounding Divergence现象），且早期从SFT转向RL的训练策略能以65%更少的数据达到可比精度。

Insight: 创新点在于提出了一种无需中间推理的对齐训练框架，通过GRPO直接优化视觉特征与定位输出，揭示了在多模态后训练中推理可能非必要，并识别了联合RL优化中的Grounding Divergence现象，为高效训练提供了新视角。

Abstract: Efficient multimodal document question answering with explicit visual grounding, locating the precise document region that supports each answer remains an open challenge. Current approaches bifurcate into Supervised Fine-Tuning (SFT), which requires large annotated datasets and reaches optimization plateaus, and reasoning-centric Reinforcement Learning (RL), which depends on verbose intermediate traces that inflate inference token cost without clear benefit. We introduce Perception-RFT, a training framework that applies Group Relative Policy Optimization (GRPO) to multimodal document QA, bypassing intermediate reasoning tokens to directly align visual features with structured grounding outputs. To rigorously evaluate the necessity of reasoning, we construct a reasoning variant under identical reward settings. We find that reasoning-enabled models suppress their reasoning traces during training, converging to direct perception-based policies at the 4B parameter scale, reducing per-query inference token length by more than 60%, while reasoning-enabled RL underperforms perception-only training. Through a fine-grained analysis of Qwen3-VL-4B optimization dynamics, we confirm that SFT saturation and cold-start RL instability established in text-domain post-training extend to multimodal, and identify a previously uncharacterized Grounding Divergence: a selective trade-off between semantic robustness and geometric precision on two out of distribution (OOD) benchmarks (4,828 samples) under joint RL optimization. We further show that an early SFT$\rightarrow$RL transition achieves comparable precision with 65% less training data.

[102] Benchmarking Multimodal Large Language Models for Scientific Visualization Literacy cs.AI | cs.CL | cs.HCPDF

Patrick Phuoc Do, Chau M. Ta, Chaoli Wang

TL;DR: 本文针对多模态大语言模型在科学可视化素养方面的能力进行了基准测试，通过一个包含49个题目、覆盖8种可视化技术和11种任务类型的标准化评估集，测试了六个MLLM模型。结果表明，当前MLLM的科学可视化素养并不均衡，Gemini模型整体表现最佳，超过了人类平均分，而开源模型则低于人类基线。

Details

Motivation: 当前对多模态大语言模型的评估主要集中在通用图表理解上，缺乏对其在科学可视化领域理解和解释能力的系统性评估，本文旨在填补这一空白。

Result: 在封闭世界协议下评估了三个闭源和三个开源模型，并与485名人类参与者的数据进行了比较。Gemini模型表现最强，超过了人类平均分，而开源模型则低于人类基线。模型在不同技术和任务上表现差异很大，在科学插图、搜索和空间理解任务上表现最好，但在基于纹理和集成的可视化以及定量估计任务上表现不佳。

Insight: 论文的创新点在于首次提出了一个专门针对科学可视化素养的标准化基准测试，并揭示了MLLM在该领域能力的不均衡性，特别是定量估计、流向解释和编码解释方面的系统性弱点，这为未来评估多模态AI系统提供了一个必要的基准维度。

Abstract: Multimodal large language models (MLLMs) are increasingly used to interpret visualizations, yet current evaluations remain largely chart-centric and provide limited evidence of understanding of scientific visualization (SciVis). We benchmark six MLLMs on the scientific visualization literacy assessment test, a standardized SciVis literacy assessment comprising 49 items based on 18 scientific visualizations and illustrations, spanning 8 techniques and 11 task types. We evaluate three closed-source and three open-source models under a closed-world protocol and compare their performance using data from 485 human participants. Results show that current MLLMs do not exhibit uniform SciVis literacy. Gemini is the strongest model overall, exceeding the human mean across the evaluated subsets, whereas the open-source models remain below the human baseline. Performance is highly uneven across techniques and tasks: models perform best on scientific illustration, search, and spatial understanding, but struggle on texture-based and integration-based visualizations and on quantitative estimation. Error analysis reveals recurring failures in fine-grained quantitative estimation, flow-direction interpretation, and grounded encoding interpretation. These findings position SciVis literacy as a necessary benchmark dimension for evaluating multimodal AI systems. Our code and model outputs are publicly available at https://github.com/patdmp/mllm-scivis-lit-benchmark.

[103] ToolAnchor: Anchoring Counterfactual Context to Boost Agentic Tool-use Capability cs.AI | cs.CV | cs.LGPDF

Weiting Liu, Jieyi Bi, Wanqi Zhou, Jianfeng Feng, Yining Ma

TL;DR: 本文提出了ToolAnchor框架，旨在解决工具增强型大语言模型代理在工具集扩展时因行为惯性而难以有效利用新工具的问题。该方法通过在关键决策点注入反事实锚定上下文来打破惯性，利用教师模型生成假设、学生模型验证，并通过代理后训练内化成功干预。

Details

Motivation: 动机在于现有工具增强型大语言模型代理通常在固定工具集上进行后训练，当任务需要新工具时，代理因行为惯性（倾向于依赖熟悉工具和既定推理模式）而无法有效整合新工具，从头重新训练又不切实际。

Result: 在通用AI助手（GAIA）、文本搜索（BrowseComp）和视觉搜索（VDR-Bench）任务上的广泛评估表明，ToolAnchor在扩展工具集下始终表现出有竞争力的性能。

Insight: 创新点在于识别并利用反事实锚定上下文来克服代理的行为惯性，并通过教师-学生框架与代理后训练实现可扩展的干预内化，为静态后训练与动态适应之间的鸿沟提供了新路径。

Abstract: Tool-augmented large language model agents excel at long-horizon tasks, yet they are typically post-trained on fixed toolsets. When tasks demand new tools, these agents struggle to incorporate them effectively, and retraining from scratch is often impractical. We identify the core obstacle in such toolset expansion problem as behavioral inertia: the tendency of agents to fall back on familiar tools and established reasoning patterns despite having access to new ones. We demonstrate that injecting counterfactual anchor contexts at critical decision points can break this inertia, recovering failed trajectories by eliciting suppressed agent capabilities. To scale this insight, we propose ToolAnchor, a framework that uses teacher models to hypothesize these counterfactual contexts, verifies them via student rollouts, and internalizes the successful interventions through agentic post-training. Extensive evaluations across general AI assistant (GAIA), textual search (BrowseComp), and visual search (VDR-Bench) tasks demonstrate that ToolAnchor consistently exhibits competitive performance under expanded toolsets. Our work bridges the gap between static post-training and dynamic adaptation, charting a new path for scalable agentic reinforcement learning.

[104] Multi-LLM Collaborative MRI Report Generation for Visual Instruction Tuning in Brain Oncology cs.AI | cs.CVPDF

Sinyoung Ra, Jonghun Kim, Hyunjin Park

TL;DR: 本文提出了一种用于脑肿瘤学3D MRI报告生成的新方法，通过多LLM协作系统创建3D MRI-文本配对数据集，并基于此构建视觉语言模型（VLM），该模型在报告生成和视觉问答任务上优于现有2D和3D方法。

Details

Motivation: 现有医学视觉语言模型主要针对2D图像（如胸部X光），缺乏3D成像-文本配对数据，难以扩展到3D医学影像（如脑部MRI），因此需要解决脑肿瘤学中3D MRI报告生成的难题。

Result: 在报告生成和视觉问答任务上，所提出的VLM性能优于其他2D和3D方法，达到了当前先进水平（SOTA）。

Insight: 创新点包括：利用多LLM协作系统生成和验证报告，确保准确性和清晰度；创建首个用于脑肿瘤学的3D MRI-文本数据集；将MRI扫描转换为token并与文本指令对齐的VLM架构，为3D医学影像分析提供了新思路。

Abstract: Recent advances in large language models (LLMs) and their extension to vision-language models (VLMs) have made it easier to combine text and images for tasks such as report generation. Existing VLMs in medicine typically focus on 2D images (chest X-rays), and their extension to 3D imaging has been difficult because of the lack of paired 3D imaging-text data. Thus, we introduce a new method for creating a 3D image-text dataset for brain oncology using 3D MRI scans of glioma and meningioma cases. We use a cooperative system in which several LLMs work together to generate and check reports, ensuring that they are accurate and clear. By leveraging the new 3D MRI-text dataset, we further build a VLM that converts MRI scans into tokens and aligns them with text instructions. Our VLM performed better in report generation and visual question answering tasks than other 2D and 3D methods. Our method not only improves the quality of reports but also helps with better diagnosis and treatment in brain oncology.

[105] SportD: Can VLMs Physically Strategize? cs.AI | cs.CVPDF

Jasin Cekinmez, Addison J. Wu, Haotian Xia, Akshaya Bharadhwaj, Anay Putty

TL;DR: 该论文提出了SportD基准，用于评估视觉语言模型在足球场景中基于视觉信息进行物理战略决策的能力。研究通过分析2022年世界杯的478个持球决策事件，比较了前沿VLM模型与职业球员在射门或传球选择上的表现。

Details

Motivation: 研究旨在探究视觉语言模型是否能够利用视觉信息做出有效的战略决策，而不仅仅是理解场景。足球场景提供了可量化评估决策价值的独特机会。

Result: 在SportD基准测试中，最佳VLM模型仅能选择最高价值动作（根据持球价值模型评估）的比例为31.4%，而职业球员为38.9%，且所有模型产生的决策遗憾值显著更高。模型表现出系统性偏好低方差、低回报动作的倾向。

Insight: 论文创新点在于引入了基于价值的量化评估框架SportD，揭示了VLM在战略决策中存在的模仿偏差（而非持续评估反事实替代方案）和风险规避倾向，为评估物理战略推理提供了新测试平台。

Abstract: Vision–language models have become increasingly capable of interpreting visual scenes, but it remains unclear whether they can use information to make strategically effective decisions. We investigate this question in soccer, where models observe the seconds preceding an on-ball decision and must choose whether to shoot or pass to a specific teammate. Unlike conventional visual-understanding tasks, soccer enables decisions to be evaluated quantitatively by estimating the value of every available action. We introduce SportD, a benchmark comprising 478 on-ball decisions from the 2022 FIFA World Cup. Each model choice is evaluated against a possession-value model that estimates the action that most increases the attacking team’s probability of scoring, allowing us to measure both optimal-action accuracy and the value forfeited by suboptimal decisions. Across three frontier VLMs, the best selects the highest-valued action on 31.4% of events, compared with 38.9% for the professional players, and all models incur significantly greater regret. Further analysis reveals a systematic preference for lower-variance and lower-reward actions: VLMs shoot less often and select substantially less progressive passes than either the optimal policy or the real players. The models also reproduce the player’s specific action above chance even when that action is suboptimal, suggesting partial imitation of familiar play patterns rather than consistent evaluation of counterfactual alternatives. SportD provides a value-grounded testbed for measuring physical strategic reasoning in VLMs.

[106] Action QFormer: Structured Representation Shaping under Action Supervision in Vision-Language-Action Models cs.AI | cs.CV | cs.ROPDF

Yufeng Ji, Wenhao Tang, Haoyi Niu, Koushil Sreenath, Yi Wu

TL;DR: 本文提出Action QFormer，一种基于查询的动作导向接口，用于解决视觉-语言-动作模型中动作监督在塑造多模态表示时产生的矛盾：一方面需要形成动作兼容的表示，另一方面直接监督可能破坏语言处理和物体基础能力。该方法通过指令条件查询在动作生成前重组继承的多模态信息，在零样本仿真到真实导航任务中显著提升了任务成功率与动作生成正确率。

Details

Motivation: 研究动作监督在视觉-语言-动作模型中如何塑造继承的多模态表示，解决直接应用动作监督可能破坏语言侧处理和物体基础表示稳定性的问题。

Result: 在零样本仿真到真实导航任务中，平均闭环任务成功率从18.8%提升至56.3%，固定指令动作生成正确率从22.5%提升至75.5%，并几乎消除了分布外指令生成。

Insight: 创新点在于提出查询式动作导向接口，将动作监督与多模态表示解耦，通过重组而非直接重写的方式选择性塑造表示；客观分析表明该方法在保持目标性适应能力的同时减少了上游表示的广泛破坏，为VLA模型设计提供了新思路。

Abstract: Action supervision in vision-language-action (VLA) models is often treated as a downstream objective for learning action prediction. In this paper, we study it instead as a force that shapes inherited multimodal representations. We show that this shaping has a dual effect: it is necessary for forming action-compatible representations, but when action supervision is applied too directly to the inherited multimodal pathway, it can also destabilize representations that support language-side processing and object grounding. To address this tension, we introduce Action QFormer, a query-based action-facing interface that uses instruction-conditioned queries to reorganize inherited multimodal information into action-facing representations before downstream action generation. In zero-shot sim-to-real navigation, Action QFormer improves average closed-loop task success from 18.8% to 56.3%, raises fixed-instruction action-generation correctness from 22.5% to 75.5%, and nearly eliminates out-of-distribution instruction generations. Further analyses show that Action QFormer changes how action supervision shapes inherited multimodal representations, reducing broad upstream rewriting while preserving targeted and sometimes constructive action-supervised adaptation. These results suggest that improving VLA performance requires not only stronger pretrained backbones, but also better ways of selecting and organizing inherited multimodal information while controlling how it is shaped under action supervision.

cs.RO [Back]

[107] MEMORA: Embodied Action Memory from Egocentric Videos for Reasoning and Planning cs.RO | cs.AI | cs.CLPDF

Zihao Yu, Xiu Yuan, Chongjie Zhang

TL;DR: 该论文提出了MEMORA框架，旨在为机器人实现具身行动记忆能力，以支持长时程推理与规划。该框架通过在线编辑和离线整合，从第一人称视角视频中构建并维护包含环境、实体、活动和推断知识的持久记忆状态，并在新的基准测试中验证了其在记忆评估和规划任务上的有效性。

Details

Motivation: 解决机器人长时程规划中仅依赖当前场景感知的局限性，需要像人类一样能够利用过去的具身经验（如地点、物体状态变化、先验程序和规律）来理解和实现未来目标。

Result: 在基于EPIC-KITCHENS-100扩展的45小时视频数据集MEMORA-Bench上评估，结合了编辑、类型化存储和整合的完整MEMORA框架在四个开源语言模型中取得了最强的综合结果。相比最强基线，记忆评估准确率最高提升20.5个百分点，在分布外机器人规划任务（Robot-Grounded Plan）得分上相对提升最高达16.6%。

Insight: 创新性地将具身行动记忆形式化为一个包含形成、整合、检索的生命周期和四种类型化记忆存储的框架，并通过在线编辑与离线整合机制，实现了对动态经验的持续维护和抽象，为机器人规划提供了可依赖的记忆上下文。

Abstract: Long-horizon robot planning requires more than predicting what actions will do next; it also requires memory of the embodied experience that makes future goals interpretable. People do not plan from the present scene alone: they draw on remembered places, object-state changes, prior procedures, and regularities revealed through repeated action. We formulate Embodied Action Memory (EAM) as the capability to form, maintain, and use such experience as a persistent memory state for later decisions. MEMORA realizes EAM with a formation-consolidation-retrieval lifecycle and four typed stores: Environment Memory, Entity Memory, Activity Memory, and Inferred Knowledge. Online editing maintains object identities and state histories as new observations arrive; offline consolidation abstracts repeated experience into reusable procedures and participant-specific regularities. MEMORA-Bench evaluates this lifecycle on 45 hours of EPIC-KITCHENS-100 extension video across 18 participants through memory-grounded planning, including previously unseen goals, and a complementary memory-assessment task. Across four open-weight language models, full MEMORA–combining editing, typed stores, and consolidation–achieves the strongest aggregate results among the evaluated memory conditions. It improves memory-assessment accuracy by up to 20.5 points over the strongest controlled baseline and improves out-of-distribution Robot-Grounded Plan score by up to 16.6% relative. A qualitative two-task robot deployment study further illustrates how memory-grounded language plans can interface with downstream control, while the overall results show that editable, consolidated memory can supply remembered context for robot planning. Project page: https://yuzihaowashu.github.io/MEMORA/

[108] Open-AoE: An Open Egocentric Manipulation Dataset and Toolchain for Embodied Learning cs.RO | cs.CVPDF

Zishuo Li, Bowen Yang, Changtao Miao, Kai Zhu, Hao Chen

TL;DR: 本文介绍了Open-AoE，一个开放的、以社区为中心的第一人称视角操作数据集和工具链，覆盖从智能手机采集到模型训练的全流程。其首个版本包含约2000小时由500多名贡献者使用400多部智能手机在自然环境中采集的操作视频，并提供文本标注、基于MANO的手部姿态、相机轨迹和时序定位的原子动作。

Details

Motivation: 现有第一人称视角操作视频资源很少能同时结合低成本连续采集、操作级结构化标注和可重用的机器人学习工具，而Open-AoE旨在为具身智能提供可扩展的监督数据，降低数据贡献和复用的门槛。

Result: 论文未在摘要中提供具体的定量实验结果或基准测试比较，但强调了数据集和工具链的规模与完整性。

Insight: 创新点在于整合了可扩展采集、结构化处理和下游适配的全流程工具链，为具身模型训练、人机迁移和世界建模提供了实用的开放基础设施，特别是其社区驱动的数据收集和跨具身重定向支持。

Abstract: Egocentric videos of human manipulation provide scalable supervision for embodied intelligence, yet existing resources rarely combine low-cost continuous capture, manipulation-level structured annotations, and reusable tools for robot learning. We present Open-AoE, an open, community-oriented egocentric manipulation dataset and toolchain spanning the full pipeline from smartphone capture to model training. Its first release contains approximately 2,000 hours of manipulation video collected in natural environments by 500+ contributors using 400+ smartphones. The dataset provides text annotations, MANO-based hand poses, camera trajectories, and temporally localized atomic actions. Open-AoE further includes a data processing pipeline that transforms raw recordings into structured samples through temporal action segmentation, semantic annotation, hand reconstruction, and camera trajectory reconstruction. Meanwhile, we provide a separate downstream toolchain supports visualization, cross-embodiment retargeting, model-specific data conversion, and training recipes for VLA policies, WAMs, and World Models. By integrating scalable capture, structured processing, and downstream adaptation, Open-AoE reduces the barriers to both data contribution and reuse, providing practical open infrastructure for embodied model training, human-to-robot transfer, and world modeling.

[109] DriftWorld: Fast World Modeling through Drifting cs.RO | cs.CV | cs.LGPDF

Susie Lu, Haonan Chen, Weirui Ye, Yilun Du

TL;DR: 本文提出了DriftWorld，一种基于漂移生成模型的动作条件世界模型，用于机器人规划。它通过训练学习动作条件漂移，能够在推理时以单次前向传播快速生成未来帧，速度比基于扩散的基线快17倍以上。该方法在多个视觉机器人操作基准测试中实现了最先进的决策性能，并可作为离线模拟器评估真实世界策略。

Details

Motivation: 解决基于扩散的世界模型在推理时多步采样导致生成速度慢、限制大规模动作搜索的瓶颈问题，旨在实现快速、高质量的未来状态预测以支持机器人规划。

Result: 在Bridge-V2、RT-1、Language Table、Push-T和Robomimic等基准测试中，DriftWorld实现了最先进的决策性能，推理速度达30+ fps，比扩散基线平均快17倍，且基于rollout的评分与真实情况相关性高达0.99。

Insight: 创新点在于将漂移生成模型应用于世界建模，通过训练学习动作条件漂移，避免了推理时的迭代去噪，实现了单次前向传播的快速rollout生成；这为机器人规划提供了高效、准确的模拟环境，直接提升了在线控制和离线策略评估的效率。

Abstract: Predictive world models enable robots to plan by imagining the outcomes of their actions, but their value for control hinges on generating many rollouts quickly. This creates a bottleneck for diffusion-based world models: multistep sampling makes each rollout expensive, limiting large-scale action search at inference time. We introduce DriftWorld, an action-conditioned world model based on drifting generative models. Rather than denoising iteratively at inference, DriftWorld learns an action-conditioned drift during training, allowing it to generate future frames from the current observation and a candidate action sequence in a single forward pass at 30+ fps, which is 17x faster on average than diffusion based baselines. We evaluate DriftWorld on standard vision-based robotic manipulation benchmarks, including Bridge-V2, RT-1, Language Table, Push-T, and Robomimic. By producing rollouts that are both accurate and fast, DriftWorld achieves state-of-the-art decision-making performance with far less inference time than diffusion-based world model baselines. Beyond online control, DriftWorld can also serve as an offline simulator for ranking real-world robot policies, with rollout-based scores correlating with ground truth at up to 0.99. These results show that drifting models are a strong fit for robot world modeling, where fast, high-quality imagination directly supports planning and policy evaluation.

cs.HC [Back]

[110] Memory-Driven Self-Disclosure and Relational Turning Points: A Longitudinal Multimodal Study of Human-AI Interaction cs.HC | cs.AI | cs.CLPDF

Ryuichi Sumida, Mao Saeki, Masaki Eguchi, Sadahiro Yoshikawa, Koji Inoue

TL;DR: 本文通过一项纵向多模态研究，探讨了记忆增强型对话代理如何与用户建立长期关系。研究发现，会话质量直接影响即时享受感，而感知记忆则通过后续自我披露间接影响长期享受；关系发展既包含缓慢积累，也包含突发的转折点（如关系崩溃或激增）。

Details

Motivation: 研究动机是探究在重复使用场景下，一系列人机交互如何演变为长期关系，重点关注记忆增强型对话代理对关系构建的影响。

Result: 在24名参与者进行的10次会话纵向研究中，通过评估熟悉度、自我披露、感知记忆、会话质量和享受感等关系构建指标，发现会话质量对即时享受感有强预测作用，而感知记忆则通过后续自我披露间接影响长期享受；转折点（如关系崩溃/激增）可在多模态行为中部分追踪，且激增比崩溃更易检测和持续。

Insight: 创新点在于揭示了人机长期关系的双重动态：缓慢积累与突发转折点，并指出感知记忆是关系条件化的（受先前关系状态影响），而非仅反映系统能力；同时，通过多模态行为分析为关系转折点的检测和干预提供了新视角。

Abstract: As conversational AI systems are designed for repeated use, a central question is how a series of interactions becomes a relationship. We present a longitudinal multimodal study of a memory-augmented conversational agent (24 participants x 10 sessions), in which participants rated five relational constructs – familiarity, self-disclosure, perceived memory, conversational quality, and enjoyment – after each session. Two complementary dynamics emerge. First, conversational quality strongly shapes how enjoyable a session feels in the moment but does not carry forward across sessions, whereas perceived memory is relationally conditioned – predicted by prior relational state rather than reflecting system capability alone – and it shapes later enjoyment indirectly, via subsequent self-disclosure. Second, relationships are punctuated by discrete turning points – crashes and surges – that are partially traceable in multimodal behavior and open different intervention windows: surges are more behaviorally detectable in the moment, enjoyment surges persist more reliably than enjoyment crashes recover, and some crashes are better forecast from person-specific behavioral drift than detected after they have already occurred. Together, the findings suggest that longitudinal human-AI relationships are built through both slow accumulation and abrupt turning points.

cs.CY [Back]

[111] Penny: Transition Network Analysis of Learner-Chatbot Interactions in Scaffolded EFL Writing cs.CY | cs.CLPDF

Steve Woollaston, Brendan Flanagan, Yuko Toyokawa, Hiroaki Ogata

TL;DR: 本研究采用转换网络分析（Transition Network Analysis）方法，分析了日本EFL（英语作为外语）学习者与名为‘Penny’的LLM驱动写作聊天机器人之间的交互时序动态。通过对超过4,500个写作会话和21,000次交互的分析，识别出两种主要行为循环：‘修订循环’（反馈直接导致成功纠错）和‘聊天循环’（学习者在反馈后进行持续对话）。研究发现，EFL熟练度显著影响交互模式：高熟练度学习者更倾向于开放式对话和协商，而低熟练度学习者更依赖重复的纠错反馈循环。

Details

Motivation: 生成式AI聊天机器人有望通过提供即时、个性化的反馈来变革EFL写作教学，但其教学价值取决于学习者如何与之互动，这一过程常被视为‘黑箱’。本研究旨在揭示学习者与聊天机器人交互的时序动态，以理解其实际教学效果。

Result: 分析揭示了两种主导的行为循环模式，并发现EFL熟练度是塑造交互模式的关键因素。研究结果表明，AI辅助的写作是一个非线性的对话过程。

Insight: 创新点在于应用转换网络分析来建模和量化学习者与AI聊天机器人之间的时序交互动态，从而将‘黑箱’过程可视化。客观来看，该研究强调了根据学习者熟练度进行差异化聊天机器人设计的必要性，以超越简单的纠错功能，促进所有学习者更深层次的认知参与。

Abstract: Generative AI chatbots promise to transform English as a Foreign Language (EFL) writing by providing immediate, personalised feedback. However, their pedagogical value depends on how learners engage with them - a process often treated as a “black box.” This study uses Transition Network Analysis to model the temporal dynamics of Japanese EFL learners using “Penny,” an LLM-powered writing chatbot. Analysis of over 4,500 writing sessions and 21,000 chatbot interactions reveals two dominant behavioural loops: a “Revision Loop,” where feedback leads directly to successful error correction, and a “Chat Loop,” where learners engage in sustained dialogue with the chatbot following feedback. Crucially, EFL proficiency significantly shapes interaction: high-proficiency learners engage more in open dialogue and negotiation with the chatbot, while low-proficiency learners rely more heavily on repetitive corrective feedback cycles. The findings demonstrate that AI-scaffolded writing is a non-linear, dialogic process and highlight the need for differentiated chatbot design to move beyond simple error correction and foster deeper cognitive engagement for all learners.

cs.LG [Back]

[112] Branching Policy Optimization: Sandbox-Native Language Agent Reinforcement Learning cs.LG | cs.CLPDF

Bowei He, Yankai Chen, Xiaokun Zhang, Xue Liu

TL;DR: 本文提出了一种名为分支策略优化（BPO）的强化学习算法，专为与可执行沙盒交互的大语言模型（LLM）智能体设计。BPO利用沙盒的确定性、可快照和可从任意中间状态恢复的特性，改变了传统的轨迹采样拓扑结构，通过构建共享前缀的分支树来降低优势估计的方差，从而在多个基准测试中取得了更好的性能。

Details

Motivation: 现有SOTA算法（如PPO、RLOO、GRPO）的轨迹采样拓扑继承自RLHF，为每个提示采样N条独立的轨迹。这种设计忽略了智能体沙盒的一个关键属性：它们是确定性的、可快照的，并且可以从任何中间状态恢复。论文旨在利用这一属性设计一种新的、沙盒原生的强化学习算法。

Result: 在WebShop、ALFWorld和SWE-bench基准测试上，使用Qwen2.5-7B和Llama-3.1-8B骨干模型，BPO在相同计算量下比GRPO和RLOO的绝对成功率提升了3.6到6.1个百分点，梯度范数方差减半，并且仅用38%的策略更新次数就达到了最佳基线的性能水平。

Insight: 核心创新在于提出了“分支树”的轨迹采样拓扑，替代了传统的独立轨迹树。具体实现包括：在主干轨迹的高熵决策点自适应快照沙盒、在每个分支点分叉K个替代动作并执行到终止、以及基于兄弟轨迹的回报而非独立提示来计算每一步的优势。论文从理论上证明了该估计器是无偏的，并且方差严格低于轨迹级基线。

Abstract: Reinforcement learning has emerged as the dominant paradigm for training large language model (LLM) agents that interact with executable sandboxes. State-of-the-art algorithms such as PPO, RLOO, and GRPO inherit their rollout topology from RLHF: for each prompt, N independent trajectories are sampled from the initial state, and an advantage is computed by subtracting a group baseline. This design ignores a defining property of agent sandboxes. They are deterministic, snapshottable, and resumable from any intermediate state. We argue that this property enables a fundamentally different rollout topology: rather than N independent trees of depth T, one can construct a single tree of N leaves whose siblings share prefixes, and therefore share variance. We instantiate this idea as Branching Policy Optimization (BPO), a sandbox-native RL algorithm that (i) adaptively snapshots the sandbox at high-entropy decision points along a backbone trajectory, (ii) forks K alternative actions per branch point and rolls out each to termination, and (iii) computes per-step advantages from sibling returns rather than from independent prompts. We prove this estimator is unbiased and has strictly lower variance than the trajectory-level baseline, with the reduction equal to the prefix-explained portion of return variance. On WebShop, ALFWorld, and SWE-bench Verified with Qwen2.5-7B and Llama-3.1-8B backbones, BPO improves success by 3.6–6.1 absolute points over GRPO and RLOO at matched compute, halves gradient-norm variance, and matches the best baseline using 38% fewer policy updates.

[113] Beyond Entropy: Correctness-Aware Advantage Shaping via Contrastive Policy Optimization cs.LG | cs.AI | cs.CLPDF

Weiwen Xu, Jia Liu, Hou Pong Chan, Long Li, Deng Cai

TL;DR: 本文提出对比策略优化（CPO）方法，用于强化学习与可验证奖励（RLVR）场景。该方法利用参考引导生成分布与普通生成分布之间的词元级对比分歧，进行感知正确性的优势塑形，以替代传统基于熵的方法。理论和实验表明，该方法能可靠指示词元级正确性，并解决了零优势问题，在领域内和领域外基准测试中显著优于基于熵的RLVR方法，同时保持了强泛化能力。

Details

Motivation: 现有RLVR方法通常使用熵进行优势塑形，但熵无法区分有益的不确定性和有害的混淆，限制了其作为正确性信号的有效性。

Result: 在领域内和领域外基准测试上的实验表明，CPO显著优于基于熵的RLVR方法，同时保持了强泛化能力。理论分析和经验结果均证明，该方法中的分歧能可靠指示词元级正确性。

Insight: 创新点在于使用词元级对比分歧进行正确性感知的优势塑形，这比熵更精确。该框架将策略蒸馏揭示为其特例（当后验分布由外部教师模型实例化时），并解决了零优势问题。分析还表明，正确与错误响应分别自然支持探索和利用，平衡两者可获得最佳性能。

Abstract: Reinforcement learning with verifiable rewards (RLVR) commonly uses entropy for advantage shaping. However, entropy cannot distinguish useful uncertainty from detrimental confusion, limiting its effectiveness as a correctness signal. We propose Contrastive Policy Optimization (CPO), which uses token-level contrastive disagreement between reference-guided and vanilla generation distributions for correctness-aware advantage shaping. Both theoretical and empirical results show that this disagreement reliably indicates token-level correctness. We further show that On-policy Distillation is a special case of CPO, where the posterior distribution is instantiated by an external teacher model. CPO also resolves the zero-advantage problem. Experiments on in-domain and out-of-domain benchmarks demonstrate that CPO substantially outperforms entropy-based RLVR methods while maintaining strong generalization. Further analysis shows that correct and incorrect responses naturally support exploration and exploitation respectively, and balancing both leads to the best performance.

[114] Leveraging Instruction Tuning and Merging for Reasoning Model Adaptation cs.LG | cs.CLPDF

Yu-Du Feng, Niels Mündler-Sasahara, Mark Vero, Martin Vechev

TL;DR: 本文提出了一种结合指令微调和模型融合的方法，用于提升推理语言模型（RLM）在可验证和难以验证领域的性能。该方法首先对RLM进行无推理轨迹的监督微调，然后将微调后的模型与原推理模型融合，以恢复其在目标领域的推理能力。实验表明，该方法在编程和文本摘要等任务上有效提升了RLM性能，同时保持了跨领域能力，且成本低廉（低于3美元）。

Details

Motivation: 解决推理语言模型在缺乏可靠验证器的领域（如文本摘要）中训练困难的问题，并利用现有的大量未使用的人类标注监督微调数据来提升模型性能。

Result: 在可验证领域（如编程）和难以验证领域（如文本摘要）的广泛评估中，该方法均提升了RLM性能，同时保持了模型在其他领域的原有能力，且实现成本极低（低于3美元）。

Insight: 创新点在于将指令微调与模型融合结合，以低成本方式利用监督数据增强RLM，既提升了目标领域性能，又避免了灾难性遗忘；客观来看，该方法为资源受限场景下的模型适应提供了实用思路。

Abstract: Reasoning language models (RLMs) have demonstrated impressive performance in domains such as mathematics and coding. These domains permit reliable verification of model outputs, which is important for enabling the reinforcement learning that drives RLM performance gains. However, training RLMs on domains that lack reliable verifiers remains challenging. Meanwhile, for both verifiable and unverifiable domains, large amounts of unused supervised fine-tuning data with human-written solutions exist. In this work, we show that these data can be used efficiently to further improve RLM performance. For this, we first use classic instruction tuning, supervised fine-tuning without reasoning traces, on the RLM. Next, we merge our instruction-tuned model with the original reasoning model, recovering its reasoning behavior on the target domain. Our extensive evaluation demonstrates that our technique improves RLM performance in both verifiable and hard-to-verify domains, including coding and text summarization, while preserving RLM capabilities across other domains. Importantly, our method is highly cost-effective, enabling such improvements for less than USD $3.

[115] On-Policy Delta Distillation cs.LG | cs.CLPDF

Byeongho Heo, Jaehui Hwang, Sangdoo Yun, Dongyoon Han

TL;DR: 本文提出了一种名为On-Policy Delta Distillation (OPD²)的新型强化学习后训练方法。该方法通过引入一个称为delta signal的蒸馏奖励信号，来替代直接模仿教师模型输出分布的传统做法，旨在更有效地将教师模型的推理能力迁移到学生模型。实验表明，该方法在数学、科学和代码推理基准上持续优于传统的策略上蒸馏，使推理大语言模型在短时间后训练后就能达到强劲性能。

Details

Motivation: 策略上蒸馏作为一种后训练方法，能通过教师模型的词级监督缓解奖励模型的约束，但其核心设计尚未被充分探索。本文旨在改进传统策略上蒸馏，通过设计一个更直接的信号来迁移推理能力，而不是简单地模仿教师输出。

Result: 在数学、科学和代码推理等多个基准测试上的实验表明，OPD²方法持续且显著地优于传统的策略上蒸馏方法，使推理大语言模型在仅经过短期后训练后就能取得强劲性能。

Insight: 核心创新点是提出了delta signal这一蒸馏奖励，它定义为教师模型与其在指令调优（用于获得推理能力）之前的基础模型之间的差异。这一信号直接捕捉了由推理调优引起的变化，为能力迁移提供了更直接、更有效的监督信号，而非简单地模仿最终输出分布。

Abstract: On-policy distillation is an alternative post-training method in reinforcement learning that alleviates the constraints imposed by reward models by providing token-level supervision from a teacher model. Although on-policy distillation has been studied and applied across various settings, its fundamental design remains underexplored. In this paper, we introduce a new distillation reward, termed the delta signal, instead of directly imitating the teacher’s output distribution. The delta signal is defined as the difference between the teacher model and its base model prior to instruction tuning for reasoning capability. It therefore captures the changes induced by reasoning tuning and provides a more direct signal for transferring reasoning capabilities. Using extensive empirical evidence, we show that the delta signal substantially improves on-policy distillation and refer to the new distillation method as On-Policy Delta Distillation (OPD$^2$). Experiments across mathematics, science, and code-reasoning benchmarks demonstrate that OPD$^2$ consistently outperforms conventional on-policy distillation, enabling reasoning LLMs to achieve strong performance with only a short post-training period. Code will be available at https://github.com/naver-ai/opd2

[116] CARPRT: Class-Aware Zero-Shot Prompt Reweighting for Black-Box Vision-Language Models cs.LG | cs.CVPDF

Ruijiang Dong, Zesheng Ye, Jianzhong Qi, Lei Feng, Feng Liu

TL;DR: 本文提出了一种名为CARPRT的类感知零样本提示词重加权方法，用于提升黑盒视觉语言模型在零样本图像分类中的性能。该方法通过为每个类别标签自适应地调整不同提示词的权重，以捕捉提示词与类别之间的依赖关系，从而改进现有方法中假设提示词与类别条件独立的局限性。

Details

Motivation: 现有基于视觉语言模型的零样本分类方法通常使用多个提示词并赋予共享的权重向量来聚合分数，但这种方法隐含地假设提示词与类别条件独立，而实际上某些提示词可能只对特定类别有效。

Result: 在标准图像分类基准测试上的评估表明，CARPRT优于现有的类无关重加权方法，证实了建模提示词-类别依赖关系对于有效的零样本预测至关重要。

Insight: 核心创新点在于以无需训练的方式，通过量化每个类别标签与每个可用提示词之间的特定相关性，为每个类别生成自适应的提示词权重，这为依赖提示词集成的更广泛的VLM应用场景提供了改进思路。

Abstract: Pre-trained vision-language models (VLMs) enable zero-shot image classification by computing the similarity score between an image and textual descriptions, typically formed by inserting a class label (e.g., “cat”) into a prompt (e.g., “a photo of a”). Since the score for a given image-class pair is sensitive to the choice of prompt, existing studies ensemble multiple prompts using a weighting vector to aggregate scores across different prompts. Yet, in current strategies, the weighting vector assigned to each prompt is shared across all classes, implicitly assuming that prompts are conditionally independent of classes, which often does not hold in practice, as a prompt like “an aerial view of” might be apt for “airport” but ill-suited for “apple”. To address this, we propose class-aware zero-shot prompt reweighting (CARPRT). This scoring scheme adjusts the weighting vector for each class label by capturing the class-specific relevance of different prompts in a training-free manner. For each class label and every available prompt, we quantify their class-specific relevance by averaging image-text relevance scores over images predicted to that class under the given prompt. These estimates are then normalized to derive class-specific weights. Evaluations on standard image classification benchmarks show that CARPRT outperforms existing class-independent reweighting methods, confirming that modeling prompt-class dependencies is crucial for effective zero-shot prediction and even broader VLM-based application settings that rely on prompt ensembling. Our code is available at https://github.com/tmlr-group/CARPRT.

[117] Multi-Axis Max@K Reinforcement Learning for Representative Diversity in Text-to-Image Generation cs.LG | cs.AI | cs.CVPDF

Ku Onoda, Paavo Parmas, Hiroki Furuta, Soichiro Nishimori, Yuta Oshima

TL;DR: 本文提出了一种名为多轴最大@K（multi-axis max@K）的基于群体的强化学习目标，旨在解决文本到图像（T2I）生成模型中样本多样性不足的问题，特别是针对预定义语义模式（目标模式）的覆盖率。该方法通过改进信用分配机制，使不同生成的图像能够分别提升不同目标类别的最大得分，从而在保持图像质量和文本对齐的同时，显著提升生成样本的公平性分数。

Details

Motivation: 现有文本到图像模型为同一提示词生成的图像往往只覆盖一小部分视觉上不同的模式，这限制了图像多样性，并在以人物为中心的提示中可能反映或放大人口统计偏差。论文旨在通过提高对预定义语义模式（目标模式）的覆盖率来解决这一问题。

Result: 在合成混合实验和SD3.5-M模型上使用确定性像素颜色奖励验证了信用分配机制的有效性。在感知外观公平性评估中，该方法在三个自动评估器上，相对于基线模型将公平性分数提高了0.23-0.36，同时保持了图像质量和文本对齐。

Insight: 创新点在于提出了多轴最大@K的强化学习目标，其信用分配机制允许不同样本为不同类别做出贡献（仅当样本提升该类别的组内最大得分时才获得正向权重），这为在扩散模型中系统性地提升生成多样性和公平性提供了一种新思路。

Abstract: Text-to-image (T2I) models can synthesize realistic, prompt-aligned images, yet samples generated for the same prompt often cover only a small subset of visually distinct modes. This limits the diversity of images, and for person-centric prompts, can reflect or amplify demographic skew. We formalize this problem as coverage of a predefined set of semantically specified modes, which we call target-mode coverage. We then propose multi-axis max@K, a group-based reinforcement learning objective for improving such coverage in diffusion-based T2I models. Given a group of samples and one score per target category, multi-axis max@K first takes the maximum score across samples for each category and then sums these category-wise maxima. The resulting credit assignment gives a sample positive weight on a category only when it increases that category’s group-wise maximum, allowing different samples to contribute to different categories. We first validate the credit-assignment mechanism on a synthetic mixture and on SD3.5-M using deterministic pixel-based color rewards. We then evaluate the same objective on perceived-appearance fairness. Across three automatic evaluators on held-out prompts, multi-axis max@K improves the Fairness Score by 0.23-0.36 relative to the base model, while maintaining image quality and text alignment.

Table of Contents

cs.CL [Back]

[1] UniSAGE: Unifying Static and Dynamic Attributes with Hyper-Structure cs.CLPDF

[2] Just Keep Prompting: Evaluating Repetitive Socratic Prompting in VLMs cs.CL | cs.AI | cs.CVPDF

[3] Automatically Evolving Prompt Guidelines for Task-Specific Optimization cs.CL | cs.AIPDF

[4] MAPS: Modeling Co-Existing Subjective Perspectives and Shared Meaning in Multi-Agent Cognitive Dialogue cs.CL | cs.AIPDF

[5] Simplicity Paradox: Debunking myths about prompting and datasets for LLM evaluation cs.CL | cs.AIPDF

[6] ReportMedSAM: Guiding Segmentation Through Radiology Reports cs.CL | cs.AI | cs.CVPDF

[7] CoEvoT: Co-Evolving Chain-of-Thought Prompting for Graph-LLM Reasoning cs.CL | cs.AIPDF

[8] Heterogeneous Element-Aware Cross-Version Differencing of Scientific Documents via Layout-Aware Alignment and Structure-Aware Reasoning cs.CL | cs.AIPDF

[9] Implicit Reasoning Steering via Concept Chaining cs.CLPDF

[10] The Severance Problem: LLMs are Unaware of the Person Beyond the Prompt cs.CLPDF

[11] Multi-Head Latent Control: A Unified Interface for LLM Agent Decision Making cs.CLPDF

[12] PReM: Learning What to Preserve and When to Refresh for Context Compression cs.CL | cs.AIPDF

[13] HABIB_TAZ at SemEval-2026 Task 11: Disentangling Formal Logic from Content via Synthetic Training and Multi-Objective Optimization cs.CL | cs.AIPDF

[14] MARS: Multi-hop Adaptive Retrieval and SPARQL Generation for KGQA cs.CLPDF

[15] Answer-Conditioned Chains of Thought Degrade Verifiable-Reasoning Distillation in Large Language Models cs.CL | cs.AIPDF

[16] Controlled Reformulation Testing for Logical Consistency in Large Language Models cs.CL | cs.AIPDF

[17] Routing Ceilings Are Domain-Independent: Structural Prior Injection in Code Security Vulnerability Detection cs.CL | cs.CRPDF

[18] Harnessing LLMs for Reliable Academic Supervision: A Comparative Study cs.CL | cs.AIPDF

[19] Gold-Guided Programmatic Distillation for Financial Reasoning over Hybrid Tables and Text cs.CLPDF

[20] CoTu at EXACT 2026: Neuro-Symbolic Reasoning for Transparent Educational QA cs.CLPDF

[21] Dialogue Summarization with Emotion Dynamics Using Topic- and Participant-Centric Decomposition cs.CL | cs.AI | cs.MAPDF

[22] SEED: Self-Evolving On-Policy Distillation for Agentic Reinforcement Learning cs.CLPDF

[23] Show Me How You Reason and I’ll Tell You Who You Are: Reasoning Graphs for Robust LLM Authorship Attribution cs.CL | cs.AIPDF

[24] Rubrics on Trial: Evolving Rubrics from a Single Query via Synthetic Pairwise Evidence cs.CLPDF

[25] Digital Pantheon: Simulating and Auditing Coalition Formation with LLM Agents cs.CL | cs.AI | cs.MAPDF

[26] T^2MLR: Transformer with Temporal Middle-Layer Recurrence cs.CL | cs.AIPDF

[27] Mask-Aware Policy Gradients for Diffusion Language Models cs.CL | cs.AI | cs.LGPDF

[28] TikStance: A Multimodal and Hierarchical Dataset for Multi-target Stance Analysis in TikTok Political Conversations cs.CLPDF

[29] Beyond the Leaderboard: Design Lessons for Trustworthy Multimodal VQA cs.CL | cs.CVPDF

[30] SciDiagramEdit: Learning to Edit Scientific Diagrams from Paper Revisions cs.CL | cs.AIPDF

cs.CV [Back]

[31] MultiRef-Compass: Towards Comprehensive Evaluation of Multi-Reference-to-Audio-Video Generation cs.CV | cs.SDPDF

[32] Inference-Time Concept Suppression and Video-Centric Evaluation for Text-to-Video Models cs.CV | cs.LGPDF

[33] SeeSE3: Emergence of 3D Space in Vision Features cs.CV | cs.AIPDF

[34] KeyFrame-Compass: Towards Comprehensive Evaluation of Keyframe-Conditioned Video Generation cs.CVPDF

[35] MonteRET: AI Agent Enhancing Multimodal LLMs with Multi-granularity Knowledge Retrieval for Chest CT Report Generation cs.CV | cs.CLPDF

[36] DCVC-MB: Neural B-Frame Video Compression using State Space Models cs.CVPDF

[37] SD-MAR: Multi-image Analytical Reasoning via Synthetic Data and Reinforcement Learning cs.CV | cs.CLPDF

[38] Dynamic Manipulation Hypergraphs for HAR: Beyond Pairwise Relations: Dynamic Manipulation Hypergraphs for Vision-Based Human Activity Recognition cs.CVPDF

[39] Reinforcing Egocentric Spatial Perception in Multimodal Large Language Models via Ego Scene Augmentation cs.CVPDF

[40] Emergent Region-Level Facial Correspondence in Frozen Vision Foundation Models cs.CV | eess.IVPDF

[41] VTM-Nav: Hierarchical Visual-Topological Memory for Cross-Episode Object-Goal Navigation cs.CV | cs.AIPDF

[42] Uni-AdaVD: Universal Concept Erasure for Visual Generation via Orthogonal Value Decomposition cs.CVPDF

[43] 3D Geometric Tooth Alignment Planning via Deep Reinforcement Learning cs.CVPDF

[44] AdaTurn: Budget-Aware Test-Time Scaling for Active Visual Perception Agents cs.CVPDF

[45] HyMobileAgent: Data-Environment Co-Scaling for Efficient GUI Agents cs.CVPDF

[46] MagicPrompt: Ultra-Lightweight Prompt Tuning for Video Generation cs.CVPDF

[47] Knowing You at First Glance: Inferring Apparent Personality from Faces cs.CV | cs.AIPDF

[48] VIABench: A Comprehensive Video Benchmark Collected from Blind Individuals for Visual Impairment Assistance cs.CVPDF

[49] ReBind: Multi-Reference Video Editing via Structured Instructions with Explicit Reference Relationships cs.CVPDF

[50] Autoregressive Modeling of Film with Applications in Video Montage cs.CVPDF

[51] GlobalForge: Towards Robust AI-Generated Image Detection cs.CVPDF

[52] Team RAS in 11th ABAW Competition: Multimodal Ambivalence Recognition Approach cs.CV | cs.AIPDF

[53] Pretraining Multiple Instance Learning Networks with Multi-Teacher Distillation from Pathology Slide Foundation Models cs.CV | cs.AIPDF

[54] Variational Inference for Bird’s Eye View Segmentation in Autonomous Driving cs.CV | eess.SYPDF

[55] Causal-Adversarial Probing of Clinical Covariates for Prostate MRI Grading cs.CVPDF

[56] VideoSEMA: a scalable and efficient Mamba-like attention for video understanding cs.CV | cs.AIPDF

[57] Multimodality as Supervision: Self-Supervised Specialization to the Test Environment via Multimodality cs.CV | cs.LGPDF

[58] WorkDrive: Roadwork Chain of Causation for Autonomous Driving cs.CVPDF

[59] VQ-Touch: A Data-Efficient Tactile Generation Framework Across Sensors and Scenarios cs.CV | cs.ROPDF

[60] GeoDetect: Geometric Adversarial Detection for VLPs cs.CV | cs.LGPDF

[61] FoMoVLA: Bridging Visual Foresight and Motion Guidance for Vision-Language-Action Models cs.CV | cs.AIPDF

[62] On the Disagreement in Perturbation-based xAI – Benchmarking Perturbation Choices for Flood Detection from SAR Images cs.CVPDF

[63] Clean-Reference Streaming Detection of Lens Occlusion and Photometric Transitions for Camera Tamper Monitoring cs.CVPDF

[64] TAMF-VTON: Texture-Aware Mask-Free Virtual Try-On via High-Fidelity Image Synthesis cs.CVPDF

[65] An LLM-Based Automatic Sportscast Solution for Robot Soccer Matches cs.CVPDF

[66] Blurring Modal Boundaries: A Unified Survey from Single- to Multi-Modal Person Re-ldentification cs.CVPDF

[67] Selectivity Drives Efficiency: Dataset Pruning for Visual Place Recognition cs.CVPDF

[68] FlashDecoder: Real-Time Latent-to-Pixel Streaming Decoder with Transformers cs.CV | cs.AIPDF

[69] Still image and spatial-temporal tomato data enabling detection, segmentation, tracking, and video-instance segmentation using strong and weak labels cs.CVPDF

[70] VideoChat3: Fully Open Video MLLM for Efficient and Generalist Video Understanding cs.CVPDF

[71] U-shaped Multi-granularity Learning for Vision-Language Models cs.CVPDF

[72] On Success and Simplicity: A Second Look at Transferable Vision-Language Attack Pipeline cs.CV | cs.CRPDF

[73] From Draft to Draft-Free: One-Step Video Object Removal via Privileged Distillation and Fast Planting cs.CVPDF

[74] Stitch-Inferencer: Enhance Endoscopic Video Segmentation and Tracking via Panoramic Reconstruction cs.CVPDF

[75] JADE-GS: Joint Alternating Deblurring Guided by Events in 3D Gaussian Splatting cs.CVPDF

[76] Weakly-Supervised RGB-D Salient Object Detection via SAM-driven Pseudo Annotation and State Space Interaction-based Diffusion cs.CVPDF

[77] Video = World + Event Stream cs.CVPDF