Table of Contents

cs.CL [Back]

[1] Wazobia Eval: A Benchmark for Nigerian Pidgin Emotion Understanding, Sarcasm Detection, and Cultural Reasoning cs.CL | cs.AIPDF

Stephanie Okoye

TL;DR: 该论文介绍了Wazobia Eval基准测试，用于评估尼日利亚皮钦语在情感理解、讽刺检测和文化推理方面的能力。该基准基于一个包含550多个示例的手动标注数据集，并采用16类情感分类法来捕捉文化特定的情感表达。

Details

Motivation: 尼日利亚皮钦语是非洲使用最广泛的语言之一，但在语言模型评估中代表性严重不足；现有基准主要关注翻译、转录或通用情感分析，缺乏对文化基础语言理解关键方面的衡量。

Result: 论文提供了基准设计、标注方法、分类法开发过程以及初步试点评估结果，旨在为尼日利亚语言AI建立可复现的评估基础设施。

Insight: 创新点在于构建了针对尼日利亚皮钦语文化特定情感和讽刺的细粒度评估基准，填补了现有语言模型在低资源语言文化理解评估上的空白，并公开了数据集以促进未来研究。

Abstract: Nigerian Pidgin is one of Africa’s most widely spoken languages, yet remains severely underrepresented in language model evaluation. Existing benchmarks primarily focus on translation, transcription, or generic sentiment analysis, leaving critical aspects of culturally grounded language understanding unmeasured. We introduce Wazobia Eval, a benchmark for evaluating Nigerian Pidgin emotion understanding, sarcasm detection, and cultural reasoning. The benchmark is built on a manually annotated dataset containing over 550 examples and a 16-category emotion taxonomy designed to capture culturally specific emotional registers that are not represented in conventional sentiment frameworks. Wazobia Eval provides standardized evaluation protocols and benchmark tasks for assessing model performance on nuanced Nigerian language understanding. We present the benchmark design, annotation methodology, taxonomy development process, and preliminary pilot evaluation results. Our goal is to provide foundational evaluation infrastructure for Nigerian language AI and establish a reproducible benchmark for future research. The dataset is publicly available at https://huggingface.co/WAZOBIALABS.

[2] Distinguishing Revision and Delayed Elaboration in Incremental Narrative Interpretation cs.CL | cs.AI | cs.MMPDF

Yi-Chun Chen

TL;DR: 该论文区分了叙事增量解释中的两种更新操作：修正驱动更新和延迟细化。修正驱动更新在遇到矛盾时撤回或替换先前已确定的结构，是非单调的；而延迟细化则通过添加约束来完善初始未指定的元素，不撤回先前承诺，实现单调扩展。作者使用视觉叙事作为诊断领域，展示了结构化叙事表示如何明确区分已确定和未指定内容，并支持两种更新操作。

Details

Motivation: 论文旨在解决人类和AI系统在处理叙事或长内容时面临的增量解释问题，即如何在接收新证据时更新内部表示。动机在于区分两种结构上不同的更新操作，以更好地理解表示状态如何演化。

Result: 论文通过一个具体示例展示了延迟细化如何实现解释状态的单调细化，而修正需要非单调校正。虽然没有提及具体的定量基准测试或SOTA比较，但结果在视觉叙事领域验证了结构化表示的有效性。

Insight: 创新点在于明确区分了修正驱动更新和延迟细化这两种增量更新操作，并提出了支持两者的结构化叙事表示方法。从客观角度看，这为增量推理和混合符号-神经系统的设计提供了结构化的理论框架，有助于更精细地控制解释过程的演化。

Abstract: Both human and AI systems that process narrative or long-form content operate incrementally: input is received over time, and internal representations must be updated accordingly. Incremental interpretation, therefore, depends not only on what is represented but also on how the representational state evolves under new evidence. We distinguish two structurally different update operators that arise in narrative interpretation: revision-driven update and delayed elaboration. Revision-driven updates retract or replace previously committed structure in response to a contradiction and are therefore non-monotonic. Delayed elaboration, by contrast, refines initially underspecified elements through constraint addition without retracting prior commitments, yielding monotonic extension of the interpretive state. Although both operators may alter how earlier material is understood, they impose fundamentally different structural requirements on state transitions. Using visual narratives as a diagnostic domain, we demonstrate how a structured narrative representation can explicitly separate committed from underspecified content and support both update operators during incremental construction. Through a worked example, we show how delayed elaboration enables monotonic refinement of interpretive state, while revision requires non-monotonic correction. We discuss the broader relevance of this structural distinction for incremental reasoning and hybrid symbolic-neural systems.

[3] Mitigating Bias in Large Vision-Language Models via Counterfactual Ensemble Decoding cs.CL | cs.AIPDF

Yisong Xiao, Aishan Liu, Yongxin Huang, Zonghao Ying, Shiji Zhao

TL;DR: 本文提出了一种名为Counterfactual Ensemble Decoding (CED)的新框架，旨在缓解大型视觉语言模型（LVLMs）在处理不同社会群体肖像时产生的社会偏见。该方法通过在视觉表示空间中构建多组反事实视角，并在解码过程中集成这些视角，以促进更公平的模型行为。

Details

Motivation: 现有去偏方法通常依赖于单一的刻板视角，无法考虑社会视角的多样性，这从根本上限制了其有效性。本文的动机是借鉴社会科学中‘多样性促进公平’的原则，解决LVLMs从训练数据中继承社会偏见的问题。

Result: 在三个社会偏见评估基准（涉及职业、描述符和人物特质）上的大量实验表明，该方法相比领先的基线模型取得了显著改进，偏见减少了高达47.97%，同时保持了原始模型的核心能力，性能下降最小。

Insight: 核心创新点在于将反事实推理与集成解码相结合，通过在视觉空间中进行反事实引导以生成多样化的视角，并在解码层中利用不确定性感知权重集成这些视角的token分布，从而引导更公平的生成。这为模型去偏提供了一种基于视角多样性的新思路。

Abstract: Large Vision-Language Models (LVLMs) have achieved remarkable performance across a wide range of tasks; however, they often inherit social biases from their training data, resulting in biased behavior when processing portraits from different social groups. Existing debiasing approaches typically compare token probabilities between the original and biased generations during decoding, but they are fundamentally limited by their reliance on a single, stereotyped viewpoint and fail to account for the diversity of social perspectives. Inspired by the social science principle that diversity fosters fairness, we propose Counterfactual Ensemble Decoding (CED), a novel framework that constructs multi-group counterfactual perspectives within the visual representation space and integrates them during decoding to promote equitable model behavior. CED first performs counterfactual steering in the visual space by identifying semantic directions associated with each social group and generating counterfactual representations along these directions, thereby offering diverse perspectives that disrupt stereotypical narratives. During decoding, CED locates the decoder layer exhibiting the greatest divergence among these perspectives and ensembles their token distributions using uncertainty-aware weights, prioritizing high-confidence tokens from different groups to yield a more balanced probability distribution that guides fairer generation. Extensive experiments on three social bias evaluation benchmarks demonstrate that \tool achieves substantial improvements over leading baselines, reducing bias by up to 47.97% across scenarios involving occupations, descriptors, and persona traits. Moreover, CED also preserves the core capabilities of the original model with minimal degradation.

[4] Forgotten in Weights, Recovered by Tools: Agentic Tool Unlearning for LLM Agents cs.CL | cs.AIPDF

Baicheng Chen, Zheyuan Liu, Jingyu Zhang, Kaize Ding, Ningshan Ma

TL;DR: 本文研究大语言模型（LLM）作为工具增强智能体时的遗忘问题，指出传统遗忘方法虽能抑制模型参数直接回忆遗忘目标，但智能体仍可通过网络搜索、检索等工具恢复该目标，即存在工具介导的恢复问题。为此，论文提出了一个两阶段的智能体工具遗忘框架，旨在同时减少参数回忆和工具介导的恢复，同时保留对正常知识的工具使用能力。

Details

Motivation: 现有LLM遗忘方法主要关注抑制模型参数直接回忆遗忘目标，但当LLM作为工具增强智能体部署时，智能体仍可通过调用外部工具（如搜索、检索）来恢复遗忘信息，导致遗忘失效。因此，需要一种新的遗忘方法来解决这种工具介导的恢复问题。

Result: 在RWKU和MUSE基准测试上，针对不同架构的LLM进行实验，结果表明所提出的ATU方法在遗忘目标与保留正常知识效用之间取得了更好的平衡，使得遗忘在工具增强智能体部署下更加鲁棒。

Insight: 论文的核心创新在于首次系统性地识别并定义了LLM智能体遗忘中的“工具介导的恢复”这一失效模式，并提出了一个结合参数遗忘和轨迹级强化学习的双阶段框架来应对。其方法论的创新点在于将遗忘问题从单纯的模型参数调整，扩展到了智能体在工具使用环境中的行为优化层面。

Abstract: Large language models (LLMs) are increasingly deployed as tool-augmented agents, where responses can depend on tool calls and external observations rather than model parameters alone. This creates an evaluation mismatch for LLM unlearning: previous unlearning methods may suppress direct parametric recall, but an agent can still recover the same forget target through tools such as web search, retrieval, or database lookup. We identify this failure mode as tool-mediated recovery and study agentic tool unlearning, which aims to reduce both parametric recall and tool-mediated recovery while preserving normal tool use for retained knowledge. To address this challenge, we propose Agentic Tool Unlearning (ATU), a two-stage framework. The first stage applies parametric knowledge unlearning to suppress direct recall, while the second stage performs trajectory-level reinforcement learning in simulated tool-augmented environments to penalize target-seeking tool behavior and final-answer leakage. Experiments on RWKU and MUSE across different LLM architectures show that ATU achieves a better balance between target forgetting and retained utility, making unlearning more robust under tool-augmented agent deployment.

[5] LëtzCross: A Cross-Lingual Page-Level Benchmark for Multimodal Retrieval over Luxembourgish Documents cs.CLPDF

Omar El Bachyr, Fred Philippy, Laura Maria Bernardy, Saad Ezzini, Jacques Klein

TL;DR: 本文介绍了LëtzCross，一个针对卢森堡语PDF文档的跨语言页面级检索基准测试，用于评估多模态检索模型在低资源、跨语言环境下的表现。该基准包含以文本为主和视觉为主的问答对，用于比较基于OCR的纯文本检索器与ColPali风格的页面图像检索器。研究发现，在系统级比较中，页面图像检索器表现更优，并且多语言微调能显著提升卢森堡语查询的检索效果。

Details

Motivation: 现有页面图像检索器（如ColPali）在视觉丰富文档检索方面有所改进，但它们在跨语言、低资源环境下的行为尚不明确。本文旨在填补这一空白，通过构建一个专门的基准来评估和比较不同检索方法在卢森堡语文档上的跨语言检索能力。

Result: 在LëtzCross基准上的实验表明，ColPali风格的页面图像检索器在跨查询语言（英语、法语、德语、卢森堡语）的系统级比较中，性能优于基于OCR的纯文本检索器。微调实验显示，单语言微调（尤其是法语）在卢森堡语查询上取得最高平均性能，而包含卢森堡语的多语言微调能产生最强结果，并大幅提升卢森堡语查询的检索效果。

Insight: 论文的创新点在于构建了首个针对卢森堡语PDF的跨语言页面级多模态检索基准LëtzCross，它结合了文本和视觉检索需求。从客观角度看，其研究揭示了在低资源跨语言场景下，页面图像检索器相对于传统OCR方法的优势，以及多语言微调对提升目标低资源语言性能的关键作用，为基于PDF的RAG系统提供了重要设计洞见。

Abstract: Recent page-image retrievers such as ColPali have improved retrieval over visually rich documents, yet little is known about how they behave in cross-lingual, low-resource settings. We introduce LëtzCross, a benchmark for cross-lingual page-level retrieval over Luxembourgish PDF documents, with document pages indexed as images and queries provided in English, French, German, and Luxembourgish. The benchmark combines text-focused QA pairs with visually grounded QA pairs, covering both textual and visual retrieval needs in PDF-based RAG. We use LëtzCross to compare OCR-based text-only retrievers with ColPali-style page-image retrievers and find that the latter perform better across query languages in this system-level comparison. We also examine single-language and multilingual fine-tuning. Fine-tuning transfers across query languages, with French yielding the highest mean performance on Luxembourgish queries among the single-language settings. In the multilingual setting, including Luxembourgish gives the strongest results and substantially improves retrieval for Luxembourgish queries.

[6] FCPRAG: Fusion-Controller Parametric Retrieval-Augmented Generation for Stable Multi-Passage LoRA Injection cs.CLPDF

Jinchang Zhu, Jindong Li, Yi Ding, Xiaojian Nie, Rong Fu

TL;DR: 本文提出了FCPRAG框架，一种用于稳定多段落LoRA注入的融合控制器参数化检索增强生成方法。该方法通过一个轻量级控制器，根据检索条件在样本级别预测每个段落的融合分数和校准信号，以解决多证据融合中的瓶颈问题。

Details

Motivation: 动机在于解决参数化检索增强生成中，当为同一查询检索到多个段落时，证据级融合的瓶颈问题。现有方法如等权重合并会放大弱或冲突证据，而将检索信号转化为融合权重通常需要脆弱的全局调优。

Result: 在HotpotQA、2WikiMultiHopQA、PopQA和ComplexWebQuestions四个基准数据集上，使用三种LLM骨干网络进行的实验表明，FCPRAG在F1分数上持续优于标准RAG和参数化RAG基线，在2WikiMultiHopQA上提升高达4.65%，在CWQ上提升高达7.55%，同时降低了调优成本并提高了在检索扰动下的鲁棒性。

Insight: 主要创新点是引入了检索条件化的、样本级别的轻量级融合控制器，它预测每个段落的融合分数以及样本级别的校准信号（如混合门和自适应温度）。另一个关键见解是，在异方差检索不确定性下，单个数据集级别的温度参数是次优的，因此需要样本级别的自适应。训练时采用了仅使用训练数据的、基于多适配器合并中每个适配器边际贡献的合并感知监督方法。

Abstract: Parametric retrieval-augmented generation (PRAG) injects retrieved evidence into a large language model (LLM) through passage-specific LoRA adapters, reducing reliance on long in-context prompts. When multiple passages are retrieved for the same query, however, evidence-level fusion becomes a bottleneck: equal-weight merging can amplify weak or conflicting evidence, and translating retrieval signals into fusion weights often requires fragile global tuning. We propose FCPRAG, a fusion-controlled parametric RAG framework that adds a lightweight controller for retrieval-conditioned, sample-level adapter fusion. The controller predicts per-passage fusion scores together with sample-level calibration signals, including a mixing gate and an adaptive temperature, enabling fusion that stays selective under informative retrieval signals and conservative under uncertainty. FCPRAG is trained with merge-aware supervision derived from each adapter’s marginal contribution within a multi-adapter merge, using training data only. We further show that a single dataset-level temperature is suboptimal under heteroscedastic retrieval uncertainty, motivating sample-level adaptation. Experiments on HotpotQA, 2WikiMultiHopQA, PopQA, and ComplexWebQuestions (CWQ) across three LLM backbones show that FCPRAG consistently improves F1 over standard RAG and parametric RAG baselines, with gains of up to 4.65% on 2WikiMultiHopQA and 7.55% on CWQ, while also reducing tuning cost and improving robustness under retrieval perturbations.

[7] MCite-RL: Towards Reliable Multimodal RAG via Citation-enhanced Agentic Reinforcement Learning cs.CLPDF

Suifeng Zhao, Zida Liu, Xinyu Lei, Lei Sun, Jun Gao

TL;DR: 本文提出MCite-RL，一个通过引用增强的智能体强化学习框架，旨在提升多模态检索增强生成（RAG）的可靠性。该方法引入智能体精炼模块进行动态、证据驱动的视觉引用推理，并采用引用增强的奖励机制，联合优化答案准确性和来源可追溯性。

Details

Motivation: 当前基于RAG和监督微调的方法在多模态推理中存在不足，导致视觉引用不精确或引用与生成答案脱节，影响了多模态大语言模型输出的可追溯性和可验证性。

Result: 在Wiki-VISA、FinRAGBench-V和MMLongBench-Doc等基准上的大量实验表明，MCite-RL有效地实现了引用精度和答案质量的联合优化。

Insight: 创新点在于将视觉引用过程从静态步骤转变为由智能体驱动的迭代检索、推理和递归裁剪的动态推理过程，并设计了一个结合过程级和结果级反馈的强化学习奖励机制来协同优化答案与引用。

Abstract: Multimodal Retrieval-Augmented Generation (RAG) with visual citation is crucial for ensuring the traceability and verifiability of MLLMs. However, current RAG and SFT-based methods struggle to achieve robust cross-modal reasoning, causing imprecise visual citations or decoupling between the citation and the generated answers. To address these limitations, we propose MCite-RL, a citation-enhanced agentic reinforcement learning framework designed for reliable multimodal RAG. MCite-RL introduces an Agentic Refinement module for visual citation that employs iterative retrieval, reasoning, and recursive cropping to progressively narrow the search space, transforming citation into a dynamic, evidence-driven reasoning process rather than a static step. Furthermore, we incorporate a Citation-enhanced Reward mechanism that integrates both process-level and outcome-level feedback within a reinforcement learning paradigm to jointly optimize answer accuracy and source traceability. Extensive experiments on benchmarks such as Wiki-VISA, FinRAGBench-V, and MMLongBench-Doc demonstrate that MCite-RL effectively achieves the joint optimization of citation precision and answer quality.

[8] Do Large Language Models Perform Well on Comprehending Poetic Logic in Modern Chinese Poetry? cs.CLPDF

Tian Lan, Shanshan Wang, Zehua Duo, Jiang Li, Guanglai Gao

TL;DR: 该论文提出了首个专门用于评估现代汉语诗歌中‘诗意逻辑’理解能力的基准测试集Peony，并基于此系统评估了六种主流大语言模型在非思考与思考两种配置下的表现。实验结果表明，当前LLMs在理解现代汉语诗歌的独特逻辑方面存在显著局限性，验证了Peony基准的有效性和必要性。

Details

Motivation: 大语言模型在常规NLP任务上进展显著，但其对文学文本特别是现代汉语诗歌的理解能力尚未被充分探索。现代汉语诗歌独特的‘诗意逻辑’需要超越表层语义的整体推理，而现有评估范式普遍忽略了这一关键维度。

Result: 在专门设计的Peony基准（包含诗节、诗行和意象三个层面的四个任务）上，对六种主流LLMs进行了系统评估。实验在非思考（zero-shot/few-shot）和思考（chain-of-thought）两种配置下进行，结果显示当前模型在理解诗意逻辑方面表现不佳，凸显了该任务的挑战性。

Insight: 论文的核心创新点是首次明确定义并构建了针对现代汉语诗歌‘诗意逻辑’的评估基准Peony，将诗歌理解任务结构化、层次化。这为评估和提升LLMs在复杂文学文本上的深层推理能力提供了新的视角和工具，强调了针对特定领域逻辑设计专用评估框架的重要性。

Abstract: Large Language Models (LLMs) have achieved significant progress across a wide range of natural language processing (NLP) tasks, yet their ability to understand literary texts, particularly modern Chinese poetry, remains largely unexplored. The unique literary characteristics of modern Chinese poetry necessitate a distinct form of reasoning for effective comprehension. Unlike conventional texts that convey clear information, the unique “poetic logic” of modern Chinese poetry requires a holistic reasoning approach that goes beyond superficial semantic analysis to be understood. However, current evaluation paradigms largely ignore this critical dimension. To address this gap, we propose Peony, the first benchmark specifically designed for evaluating the poetic logic of modern Chinese poetry. We define poetic logic as four tasks across three levels, namely stanza, line, and imagery, and systematically evaluate and analyze six mainstream LLMs based on Peony. We evaluate these models under both non-thinking and thinking configurations. The experimental results reveal the limitations of current LLMs in understanding the poetic logic of modern Chinese poetry and validate the effectiveness and necessity of Peony. Our data and code will be available.

[9] Training a Knowledge Base: Supervised Structure Learning for Agent-Curated Document Stores cs.CL | cs.AI | cs.IRPDF

Yu Pan, Hongfeng Yu

TL;DR: 该论文提出了一种新的知识库训练框架，将知识库本身视为可训练的模型，而非固定的检索源。通过监督式学习，一个训练代理根据（问题，答案）对来编辑知识库的结构，随后一个固定的读取器在有限的行动预算下评估该知识库的性能。该方法在索引效率、准确性和行动节省方面显著优于无监督的实体索引方法，并展示了良好的泛化能力。

Details

Motivation: 传统检索增强生成（RAG）将文档库视为冻结的输入，而让智能体管理知识库的系统从未量化这种管理对知识库的影响。本研究反转了这一框架，将知识库本身作为可训练的模型，旨在通过监督学习优化知识库的结构，以提高检索效率和准确性。

Result: 在PhantomWiki生成任务上，该方法每索引点比无监督实体索引节省1.6倍行动并提升1.8倍准确率（使用1,913个链接对比196,112个）。对于训练过的问题，固定读取器以更高准确率节省31%的行动，且结果在官方PhantomWiki生成问题（非作者编写）上可复现。泛化实验显示，准确率能迁移到未见问题（F1提升+0.167当两个关键实体被索引，+0.100当一个被索引），但行动节省仅体现在训练过的问题上。

Insight: 核心创新在于将知识库视为可训练的模型，并通过监督式结构学习（以（问题，答案）对作为标签）来优化其链接结构，这比无监督图构建更高效。此外，论文引入了关键覆盖梯度（key-coverage gradient）来量化训练集对问题的覆盖程度，替代了传统的训练/测试分割，从而更细致地衡量泛化能力。分析表明知识库尚未饱和，增加训练数据可线性扩展覆盖范围，具有持续优化的潜力。

Abstract: Retrieval-augmented generation treats the document store as a frozen input, and the systems that instead let an agent curate one never measure what curation does to the store. We invert the framing: the knowledge base is the model. A training agent answers a supervised question against the current store, is shown the gold, then edits the store; an unchanged reader is later examined on a frozen snapshot under a fixed action budget. Where offline graph construction is unsupervised, (question, answer) pairs are our labels – and that supervision is what makes the structure cheap. Per point of corpus indexed it returns 1.6x the action saving and 1.8x the accuracy of an unsupervised entity index covering everything, using 1,913 links against its 196,112. On questions the store trained on, an unchanged reader spends 31% fewer actions at higher accuracy, and the result reproduces on an official PhantomWiki generation whose questions we did not write. To measure how far this reaches we introduce a key-coverage gradient, a probe varying how much of a question the training set touched, replacing a train/test split’s pass/fail with a decay curve. Generalization proves endpoint-dependent: accuracy carries to unseen questions (+0.167 F1 where both of a question’s keys were indexed, +0.100 where one was, zero where neither) while the action saving stays on trained questions. Because that decay is indexed by coverage rather than by novelty, more training extends it – and the store is undertrained, not saturated: coverage grows linearly in new questions and stops the moment training repeats them, so a hundred questions reach a quarter of the corpus and four times as many would close the gap.

[10] GUI-Primitives: Diagnosing Spatial Reasoning Failures in Vision-Language GUI Grounding cs.CLPDF

Md Abrar Jahin, Md Rizwan Parvez

TL;DR: 本文提出了GUI-Primitives基准测试，包含994个对比指令对，用于诊断视觉-语言模型在图形用户界面中对空间关系语言的理解能力。研究发现，现有模型在严格坐标精度上表现不佳（最高32%），且大部分预测错误源于无法准确定位候选元素，而非不理解空间关系。

Details

Motivation: 现有计算机使用代理基准无法隔离模型是否将关系性语言正确绑定到界面元素上，因此需要专门诊断视觉-语言模型在GUI中对空间关系（如左右、上下、包含、对齐等）的推理失败。

Result: 在GUI-Primitives基准上，19个视觉-语言模型的严格点框准确率最高仅32%，且60-92%的预测落在两个候选区域之外；当预测落在候选区域内时，对于水平/垂直位置、邻近性和列表序数等关系，目标选择准确率达0.82-0.90，但对于包含和遮挡关系则与随机猜测（0.50）无显著差异。

Insight: 创新点在于设计了固定截图和锚点、仅改变关系表达的对比指令对基准，可分离定位错误与关系理解错误；研究发现模型主要失败在候选元素定位而非空间关系理解，为GUI grounding任务提供了新的诊断视角。

Abstract: Computer-use agents ground natural-language instructions in screenshots to locate interface elements, yet existing benchmarks do not isolate whether models bind relational language to the correct element. We introduce GUI-Primitives, a 994-item benchmark of contrastive instruction pairs over seven spatial relations in graphical user interfaces (left/right, above/below, containment, alignment, proximity, list ordinal, occlusion). Each pair holds the screenshot and anchor fixed while changing the relation expression, so the correct target moves between two designated candidates. Five annotators validate a 196-item subset ($κ= 0.94$ well-formedness; $κ= 0.79$ target selection). Nineteen vision-language models reach at most $32%$ strict point-in-box accuracy. Because models emit unconstrained coordinates, we classify each prediction by the candidate region it falls within. Predictions fall outside both candidates on $60-92%$ of items. Conditional on falling within a candidate region, target selection reaches 0.82-0.90 for horizontal position, vertical position, proximity, and list ordinal, but does not differ significantly from 0.50 for containment and occlusion: most failures reflect candidate localization rather than relation understanding. Across ten models, benchmark accuracy correlates with ScreenSpot-Pro accuracy (Spearman $ρ= +0.74$), an exploratory association at this sample size. Marking the two designated candidates raises selection accuracy by 35–57 percentage points, an oracle diagnostic that supplies the candidate set rather than a deployable method. We release the benchmark, predictions, and code.

[11] PUMA: A Polish Benchmark for Culturally Grounded Multimodal Understanding cs.CLPDF

Sławomir Dadas, Michał Perełkiewicz, Rafał Poświata, Małgorzata Grębowiec, Bartłomiej Jaworski

TL;DR: 论文提出了PUMA基准测试，这是一个包含900个手工构建任务的波兰语多模态理解基准，用于评估模型在波兰文化和语言背景下的多模态处理能力，涵盖文本、图像、音频和视觉丰富文档。

Details

Motivation: 当前大型语言模型正扩展到多模态处理，但针对非英语文化和语言的多模态能力评估尚不全面，因此需要构建一个针对波兰文化的基准来填补这一空白。

Result: 对前沿商业模型、开源模型和专用小模型的广泛评估显示显著性能差距：顶级商业模型在视觉问答上得分高，但大多数模型在处理复杂音频或文档理解时表现不佳。

Insight: 创新点在于创建了首个针对波兰文化的综合性多模态基准，强调了文化背景在多模态评估中的重要性，并开源评估框架以推动本地化多模态AI研究。

Abstract: Large language models are increasingly moving beyond text processing, adding support for other modalities such as images and audio. While text understanding and generation have been extensively studied, multimodal data processing capabilities, particularly in the context of cultures and languages other than English, have not yet been evaluated comprehensively. In this paper, we propose PUMA (Polish Unified Multimodal Assessment), a novel benchmark of 900 hand-crafted tasks designed to probe the limits of multimodal models in the Polish cultural and linguistic context. The dataset evaluates both cultural understanding and practical skill in processing text, images, audio, and visually rich documents. Our extensive evaluation of frontier commercial models, open-weights models, and specialized smaller systems highlights a significant performance gap. While top commercial models achieve high scores in visual question answering, most models struggle with complex audio or document understanding. We open-source our evaluation framework to advance localized multimodal AI research.

[12] HiDiffTIR: Hierarchical Difficulty-Aware Policy Optimization for Multi-Turn Tool-Integrated Reasoning cs.CL | cs.AIPDF

Yucan Guo, Xiaohan Wang, Miao Su, Saiping Guan, Zhongni Hou

TL;DR: 本文提出了HiDiffTIR，一个用于多轮工具集成推理的分层难度感知策略优化框架。该方法通过轨迹级和轮次级的难度感知信用分配，使策略能专注于更具信息量的轨迹和更难的推理步骤，从而提升LLM代理使用工具解决复杂任务的能力。

Details

Motivation: 现有基于强化学习的工具集成推理方法通常对所有正确的工具调用给予同等的轨迹级优势，忽略了不同轨迹和推理步骤间存在的难度差异和学习价值，导致学习信号不精确，无法有效区分简单和困难的工具使用模式。

Result: 在三个工具使用基准测试上的广泛实验表明，HiDiffTIR相比强大的强化学习基线，能持续提升多轮工具集成推理的性能和工具调用准确率。

Insight: 核心创新在于分层（轨迹级和轮次级）的难度感知信用分配机制，该机制无需额外监督，仅利用标准强化学习rollout产生的组级统计信息即可实现细粒度优化，强调了在工具集成LLM代理中进行难度感知信用分配对有效策略优化的必要性。

Abstract: Tool-Integrated Reasoning (TIR) is a fundamental capability for LLM agents to solve complex tasks by interacting with external tools iteratively. Reinforcement Learning (RL) has become the dominant paradigm for enabling this capability. However, existing approaches typically assign uniform trajectory-level advantages and treat all correct tool calls equally, ignoring the varying difficulty and learning value across trajectories and reasoning steps. This can lead to imprecise learning signals that do not adequately distinguish between trivial and challenging tool-use patterns. To address this limitation, we propose HiDiffTIR, a Hierarchical Difficulty-aware policy optimization framework for multi-turn TIR. HiDiffTIR performs difficulty-aware credit assignment at both trajectory and turn levels, enabling the policy to focus on more informative trajectories and harder reasoning steps. Notably, this fine-grained optimization is achieved without additional supervision, relying solely on group-level statistics derived from standard RL rollouts. Extensive experiments on three tool-using benchmarks demonstrate that HiDiffTIR consistently improves multi-turn TIR performance and tool invocation accuracy over strong RL baselines, highlighting the necessity of difficulty-aware credit assignment for effective policy optimization in tool-integrated LLM agents.

[13] The Chase Is the Curriculum, the Capture Anchors the Credit: Pursuit-Evasion Self-Play for Zero-Data LLM Reasoning cs.CL | cs.LGPDF

Jing Yu, Shengchao Chen, Yiyun Tan

TL;DR: 本文提出了一种名为LURE的零数据自博弈方法，将强化学习中的自博弈重新构建为追逃游戏，通过一个LLM逃避者将任务放置在环境难度轴上，与一个规划-执行者追捕者进行可验证的交互，从而在无需人工标注数据的情况下提升大语言模型的推理能力。

Details

Motivation: 现有的零数据自博弈方法仅通过事后拒绝来筛选候选任务，无法学习任务在环境难度轴上的合适位置，且仅依赖稀疏的终端奖励给予求解器反馈，这限制了学习效率。

Result: 在三个可验证推理环境和三种骨干模型系列上，LURE在统一/专家设置下均优于先进的基线方法，且统一模型在来自三个任务家族的九个保留基准测试中，获得了比所有训练基线更强的聚合OOD零样本准确率。

Insight: 核心创新在于将自博弈框架化为追逃游戏，并设计了捕获边界奖励（当求解器在恰好一半的尝试中捕获逃避者时奖励最高）和捕获锚定的密集过程信用（结合单调验证器进展与终端捕获进行组归一化），从而稳定地共同进化任务难度与求解能力。

Abstract: Reinforcement learning with verifiable rewards has become the dominant recipe for improving large language model reasoning, yet it presumes large human-curated task collections. Zero-data self-play removes this dependency, but existing methods vet learnability only by probing candidates and rejecting post hoc, never learning where along an environment’s difficulty axis to place a task, and credit the solver with sparse terminal rewards alone. We recast zero-data self-play as a pursuit-evasion game: in LURE, an LLM evader positions tasks along each environment’s difficulty axis to stay one step ahead of a planner-executor pursuer that hunts it down through verifiable interaction. The evader is trained on a capture-frontier reward that peaks when the solver captures it on exactly half of its rollouts, turning barely catchable into a learned positioning strategy rather than a hand-tuned rejection band. The pursuer earns capture-anchored dense process credit, in which monotone verifier progress is group-normalized jointly with the terminal capture under a round-anchored KL that keeps the co-evolution stable. Across three verifiable reasoning environments and three backbone families, LURE outperforms advanced baselines under unified/specialist settings, while the unified model attains stronger aggregate OOD zero-shot accuracy than all trained baselines across nine held-out benchmarks from three task families.

[14] EDGE: Experience-Distillation for Guided Exploration in Agentic Reinforcement Learning cs.CL | cs.AI | cs.LGPDF

Can Xie, Yuyi Zhou, Wen Yang, Ziyi zhang, Siyao Song

TL;DR: 本文提出EDGE（经验蒸馏引导探索）框架，用于增强基于LLM的智能体在强化学习中的探索能力。该方法将检索到的历史经验作为临时训练支架，通过分区轨迹估计正向边际收益，并利用反向KL目标将引导行为蒸馏到参数化策略中，同时通过协同进化经验库动态更新指导。

Details

Motivation: 现有基于经验的增强方法在推理时检索历史指导，但未考虑策略演化能力，且持续依赖外部检索，导致可重用探索模式在单次策略更新后即被丢弃。

Result: 在ALFWorld和WebShop基准测试中，EDGE在7B规模上比GRPO分别提升8.3和12.5个成功率点，且在推理时移除外部经验后仍保留96.0%的支架性能。

Insight: 创新点在于将经验视为临时训练支架而非永久依赖，通过分区轨迹无额外采样估计收益，并利用协同进化经验库动态合成新指导、修剪过时条目，实现策略自主内化探索能力。

Abstract: Reinforcement learning with outcome-based objectives such as GRPO enables LLM-based agents to solve complex, long-horizon tasks, yet the reusable exploration patterns embedded in interaction trajectories are largely discarded after a single policy update. Existing experience-augmented approaches retrieve historical guidance at inference time, but they apply experiences without accounting for the policy’s evolving capability and create persistent dependencies on external retrieval. We propose EDGE (Experience-Distillation for Guided Exploration), a framework that treats retrieved experiences as temporary training-time scaffolds and progressively internalizes their benefits into the parametric policy. Concretely, EDGE partitions each rollout group into experience-conditioned and experience-free trajectories to estimate and admit only positive marginal gains without extra sampling, then distills the induced behavior into the base policy via a reverse-KL objective on its own empirical support. A co-evolutionary experience bank further synthesizes guidance from emerging failure modes and prunes obsolete entries as the policy evolves. On ALFWorld and WebShop, EDGE improves over GRPO by 8.3 and 12.5 success-rate points at the 7B scale and retains 96.0% of its scaffolded performance when external experiences are removed at inference time. The code is available at https://github.com/xvolcano02/EDGE.

[15] ToSCA: Leveraging Hierarchical Reinforcement Learning on Temporal and Strategic Abstractions of Conversational Agents cs.CL | cs.HC | cs.LGPDF

Xiaoyu Wang, Qingqing Gu, Yue Zhao, Teng Chen, Yuqi Cao

TL;DR: 论文提出了一种名为ToSCA的两层分层强化学习框架，用于对话代理，该框架通过结合时间抽象（如概念感知）和策略抽象（如策略规划）来弥合先前令牌级或话语级强化学习方法之间的差距。

Details

Motivation: 受人类在日常互动和思考中具有多层次时间抽象的启发，旨在解决对话代理中令牌级和话语级强化学习方法之间的差距，并缓解奖励稀疏性问题。

Result: 在日常对话和情感支持对话的实验中，该方法在策略确定和响应质量方面优于多种基线模型，实现了SOTA水平。

Insight: 创新点包括设计了两层MDP框架，其中令牌级响应解码以话语级动作（显式文本策略）为条件，并引入了双粒度奖励机制，结合了话语级满意度评分与令牌级内在动机和K-L惩罚，以促进收敛。

Abstract: Humans have multiple levels of temporal abstractions on daily interaction and thinking, such as concept perception and strategic planning. Inspired by this nature, we propose a two-level hierarchical reinforcement learning (RL) framework for conversational agents, bridging the gap between previous token-level or utterance-level RL methods. Developed on a two-level MDP, the token-level response decoding is conditioned on the utterance-level action, the explicit textual strategies. Based on theoretical derivation and efficiency consideration, we use DQN to solve the high-level critic and PPO to solve the low-level actor-critic. To further alleviate the reward sparsity and facilitate the convergence, we also design the dual-granularity reward mechanism, in which the utterance-level satisfaction score is integrated with token-level intrinsic motivation and K-L penalty. Experiments on both daily and emotional support conversations show that our method outperforms versatile baselines in strategy determination and response quality. Our implementation is available at https://github.com/AaronJi/ToSCA.

[16] Real-TurnTurk: A Multimodal Turkish Corpus for Turn-Taking Prediction cs.CL | cs.AIPDF

Ahmet Tuğrul Bayrak, Fatma Nur Korkmaz, Bekir Berker Türker, Mustafa Sertaç Türkel, Alper Kaplan

TL;DR: 本文介绍了Real-TurnTurk，一个用于土耳其语对话中话轮转换预测的多模态语料库。该研究将话轮转换预测构建为一个二元分类问题，并采用遗传算法来优化从视觉、声学和语言特征中提取的可解释决策规则。

Details

Motivation: 现有研究缺乏专门针对土耳其语话轮转换动态的自然对话语料库，这限制了自然、同步对话系统中话轮转换模型的开发。

Result: 论文提出了一种混合AND-OR规则表示框架，用于捕捉话轮转换前的替代性线索组合，但摘要中未提及具体的基准测试或定量结果。

Insight: 创新点在于构建了首个包含非脚本化双人对话、同步视频、分说话人音频和时间对齐转录的土耳其语多模态语料库，并采用遗传算法优化可解释的混合规则进行预测。

Abstract: Turn-taking is a basic organizational feature of human conversation and remains difficult to model in natural, synchronous dialog systems. While existing research has explored multimodal approaches and large language models for turn-ending prediction, there is a lack of naturalistic conversational corpora specifically addressing turn-taking dynamics in Turkish. This study introduces a multimodal Turkish conversational dataset of unscripted dyadic interactions, comprising synchronized front-facing video, per-speaker audio channels that allow overlapping speech to be attributed to individual speakers, and time-aligned transcriptions. Turn-taking prediction is formulated as a binary classification problem, and a Genetic Algorithm (GA) is employed to optimize interpretable decision rules derived from visual, acoustic, and linguistic features. A hybrid AND-OR rule representation is adopted in the proposed framework to represent the alternative cue combinations that precede a turn transition.

[17] Semantic Reasoning Denoising: Correcting Language Model Reasoning with Semantic Operators cs.CL | cs.AI | cs.LGPDF

Yujiao Yang

TL;DR: 本文提出了语义推理去噪（SRD）方法，一种基于可执行错误算子的马尔可夫去噪框架，用于纠正大语言模型推理轨迹中的语义错误。该方法通过定义描述错误类型、位置及修复内容的语义噪声算子，在训练中学习识别并修复噪声，在推理中迭代应用逆算子以稳定轨迹。

Details

Motivation: 现有大语言模型的推理轨迹存在局部语义错误，且错误会传播导致错误结论，而现有的无约束自校正方法可能保留、放大或引入新错误。现有扩散语言模型的噪声定义（如词元掩码或替换）未能针对推理过程中的语义错误。

Result: 在涵盖数学、代码、知识和常识的六个领域内基准测试中，SRD平均将最强同骨干基线提升了3.2个百分点。在七个跨数据集迁移目标上，其表现与Llama-3-8B-Instruct相当，并将最强Qwen3-8B基线平均提升了2.9个百分点。

Insight: 核心创新在于将语义噪声结构化为可执行的错误算子，并采用噪声感知的迭代去噪过程，通过预测和应用逆算子实现局部、可控的轨迹修正。分析表明，结构化的语义噪声预测和迭代算子执行是性能提升的关键。

Abstract: Large language models can produce fluent reasoning traces whose local semantic errors propagate to an incorrect conclusion, while unconstrained self-correction may preserve, amplify, or introduce errors. Existing diffusion language models provide iterative refinement, but usually define noise as token masking or replacement rather than as errors in the reasoning process. We present Semantic Reasoning Denoising (SRD), an operatorized Markov denoising method for natural-language reasoning trajectories. SRD represents semantic noise with executable error operators that describe the error type, its location, and the corrupted and repaired propositions. Composing these operators constructs progressively noisier states. During training, the model learns to identify the semantic noise active in the current trajectory and to reconstruct the paired adjacent lower-noise state. During inference, noise-level-aware denoising repeatedly predicts an inverse operator and checks whether it is applicable, so each executed update makes a localized move toward a stable trajectory. Across six in-domain benchmarks spanning mathematics, code, knowledge, and commonsense, SRD improves the strongest same backbone baseline by 3.2 points on average. On seven cross-dataset transfer targets, it remains competitive with Llama-3-8B-Instruct and improves the strongest Qwen3-8B baseline average by 2.9 points. Analyses of noise sources, objectives, and denoising depth further show that structured semantic-noise prediction and iterative operator execution are central to the improvement.

[18] SSE-Bio: A Structured Self-Evolving Agent with Agentic Retrieval Policy for Multi-Hop Biomedical Reasoning cs.CL | cs.AI | cs.CEPDF

Zhaohan Meng, Zaiqiao Meng, Siwei Liu, Hao Xu, Ke Yuan

TL;DR: 本文提出SSE-Bio，一种用于生物医学多跳问答的结构化自进化智能体。它通过可训练的代理策略进行选择性知识检索和模板编辑，以解决现有方法因静态检索流程或粗粒度指令重写导致的指令漂移问题。在三个生物医学多跳QA基准测试中，该方法均优于现有基线。

Details

Motivation: 现有智能体在生物医学多跳推理中通常依赖静态检索流程或粗粒度提示重写，当推理过程需要更新时容易导致指令漂移，因此需要一种能动态调整推理过程的方法。

Result: 在三个生物医学多跳QA基准测试上，SSE-Bio一致优于现有基线，在BioHopR上比最强的自进化基线绝对提升了6.56个百分点。

Insight: 创新点在于引入结构化状态维护和基于可训练代理策略的细粒度知识检索与模板编辑，而非全局重写指令；同时提出基于组相对策略优化的代理训练策略，通过决策对比组来优化检索选择。

Abstract: Biomedical multi-hop question answering (QA) requires models to connect evidence across intermediate entities such as diseases, drugs, proteins, and phenotypes. Existing agents typically rely on static retrieval workflows or coarse-grained prompt rewriting, which can lead to instruction drift when reasoning procedures need to be updated. We propose SSE-Bio, a structured self-evolving agent with an agentic retrieval policy for multi-hop biomedical reasoning. Instead of globally rewriting agent instructions, SSE-Bio maintains a structured state, selectively retrieves knowledge triplets and prior templates through a trainable proxy policy, and improves its reasoning memory through fine-grained template editing. To optimise retrieval decisions, we introduce a proxy-training strategy based on group relative policy optimization, where the proxy is improved through decision-contrastive groups over alternative retrieval choices. Experiments on three biomedical multi-hop QA benchmarks show that SSE-Bio consistently outperforms existing baselines, achieving an improvement of 6.56 absolute points over the strongest self-evolving baseline on BioHopR.

[19] The Collaboration Tax: How Much LLM Multi-Agent Systems Pay to Coordinate cs.CLPDF

Weixiang Sun, Zehong Wang, Hong Huang, Colby Nelson, Yanfang Ye

TL;DR: 本文提出并量化了LLM多智能体系统中的’协作税’概念，即两个LLM在需要协调合作而非单独行动时产生的性能损失。通过理论框架和大量实验，论文揭示了协作税的结构性规律、其产生的四阶段对话机制，并证明该损失是可预测且部分可优化的。

Details

Motivation: 当前LLM多智能体系统被广泛部署，但当两个LLM必须协调合作而非单独行动时，究竟会损失多少性能尚不清楚。本文旨在量化这种协作成本，并探究其产生机制。

Result: 在32个可单独处理的任务（按’接地摩擦’来源分组）和来自7个提供商的11个模型上进行了测量。协作税呈现出两个普遍规律：在所有模型上存在一致的类别排序，且随模型能力增强而单调下降。通过针对四阶段对话机制的提示干预，可以显著缩小性能差距。

Insight: 创新点在于将LLM协作性能损失形式化为’协作税’，并建立了理论框架（团队去中心化损失、最大超可加性违反）来解释它。核心发现是协作税的主要机制并非推理缺陷，而是一个四阶段的对话级联失效过程。此外，在异构智能体对中，协作税会向更强一方偏移，这实证了理论预测的最大超可加性违反。

Abstract: Multi-agent systems built from large language models are deployed widely, yet how much performance is lost when two LLMs must coordinate rather than act alone remains unclear. We formulate the collaboration tax as the team-decentralisation loss of a two-player cooperative game with private information, with two propositions characterising its sign and its equivalence to a max-superadditivity violation. We operationalise this definition on 32 solo-tractable tasks grouped by source of grounding friction and measure it on 11 models from 7 providers. The tax is structured along two no-exception axes: a category ordering across every model and a monotonic decrease with capability. The proximate mechanism is not a reasoning deficit but a four-stage conversational cascade in which agents make ungrounded claims, fail to query the partner, skip integrating both views, and accept the answer without re-derivation. The tax is mechanically predictable from conversation features and partly tractable: a prompt intervention targeting all four stages closes a substantial fraction of the gap, with the dominant bottleneck differing across categories. In heterogeneous pairs the tax is pulled toward the stronger partner rather than the additive midpoint, empirically realising the max-superadditivity violation predicted by our framework. Together these results recast collaboration in LLM systems as a measurable, predictable, and partly tractable cost.

[20] Lexical Perturbations Disrupt LLM Reasoning: An Empirical Study of Attention Diversion cs.CL | cs.AI | cs.LGPDF

Jiaqian Zhu, Yang Zhang, Junhua Ding, Xiaowei Yu

TL;DR: 该论文研究了大型语言模型（LLMs）在词汇扰动下的推理鲁棒性。通过实验发现，字符级扰动（如键盘噪声、字符交换）会严重损害模型在多步推理任务上的准确性，而填充词插入影响甚微。作者将这种不对称性归因于‘注意力分散’现象，即扰动导致子词分词碎片化，这些碎片在Transformer的中后层吸引了不成比例的注意力。实验表明，碎片化同时破坏了令牌内容和注意力分配，且两者耦合，导致现有推理时修复策略难以有效恢复性能。

Details

Motivation: 尽管LLMs在推理任务上表现出色，但其对现实世界中常见词汇错误（如拼写错误）的鲁棒性尚不明确。本文旨在系统评估LLMs在面对键盘噪声、字符交换和填充词插入等词汇扰动时的性能下降情况，并探究其内在机制。

Result: 在四个推理基准测试上评估了四个开源指令微调模型和前沿模型。结果显示，字符级扰动导致准确性大幅下降，尤其是在多步推理任务上；而填充词插入影响很小。通过控制实验确认，性能损失主要由分词碎片化驱动，而非提示长度增加。

Insight: 核心创新点在于揭示了词汇扰动通过‘注意力分散’机制损害LLM推理性能，并发现令牌内容损坏与注意力分配错误之间存在耦合关系。这解释了为何链式思维提示、拼写检查、自我修复等仅针对单一通道的推理时修复策略效果有限，为提升模型鲁棒性提供了新的诊断视角和干预方向（需同时修复内容和注意力）。

Abstract: Large Language Models (LLMs) achieve strong reasoning performance, but their robustness to realistic lexical corruption remains poorly understood. We evaluate four open-weight instruction-tuned models and frontier models across four reasoning benchmarks under keyboard noise, character swaps, and filler insertion. Character-level perturbations substantially degrade accuracy, especially on multi-step reasoning tasks, while filler insertion has little effect. We trace this asymmetry to Attention Diversion: lexical corruption fragments subword tokenization, and the resulting fragments attract disproportionate attention mass, concentrated in middle and final transformer layers. Length-matched controls confirm that fragmentation, not prompt length, drives the loss. A factorial intervention then shows why the damage is hard to undo: fragmentation corrupts token content and attention allocation together, and the two are coupled. Restoring clean attention while the content remains corrupted is actively harmful, restoring content alone is insufficient, and only restoring both recovers a substantial share of the gap. This coupling explains why inference-time strategies, including chain-of-thought prompting, spell-checking, self-repair, and stronger repair models, fail to consistently recover performance: each addresses one channel at a time. Code and data are available at https://github.com/Jiaqian-Janelle/Attention-Diversion

[21] Text-Anchored Semantic Perturbations for Transferable Jailbreak Attacks on Multimodal Large Language Models cs.CLPDF

Wenyun Li, Guiping Cao, Xiangyuan Lan, Zheng Zhang

TL;DR: 本文提出了一种名为文本锚定语义扰动攻击（TA-SPA）的黑盒越狱框架，用于攻击多模态大语言模型（MLLMs）。该方法通过文本锚定语义分解（TASF）分离跨模态语义因子与模态特定残差，并结合语义保持增强（SPA）来多样化有害目标锚点，从而生成可迁移的扰动。实验表明该攻击对商业MLLMs有效且具有强迁移性，并在代表性防御下保持竞争力。

Details

Motivation: 多模态大语言模型在安全对齐方面存在脆弱性，其在文本空间学习的安全行为无法可靠地迁移到融合的跨模态表示中，使得多模态输入可能通过潜在的语义线索被利用。

Result: 实验证明了该攻击方法的强有效性和对商业MLLMs的迁移性，在代表性防御下表现出有竞争力的性能。额外的控制和探测支持了预期的分解效果。

Insight: 创新点在于提出了文本锚定语义空间优化的攻击框架，通过分离语义因子和模态残差来增强攻击的可迁移性。从客观角度看，该方法揭示了超越输入级过滤、在表示层面进行安全对齐的必要性。

Abstract: Multimodal Large Language Models (MLLMs) have achieved remarkable progress in vision-language interaction, yet their safety alignment remains vulnerable to jailbreak attacks. A key challenge is that safety behavior learned in the textual space does not reliably transfer to fused cross-modal representations, leaving multimodal inputs exploitable through latent semantic cues. We propose Text-Anchored Semantic Perturbation Attack (TA-SPA), a black-box jailbreak framework that optimizes transferable perturbations in a text-anchored semantic space. TA-SPA integrates Text-Anchored Semantic Factorization (TASF), which encourages the separation of cross-modal semantic factors from modality-specific residuals, with Semantic-Preserving Augmentation (SPA), which diversifies harmful target anchors while preserving semantic consistency. Experiments show strong attack effectiveness and transfer to commercial MLLMs, with competitive performance under representative defenses. Additional controls and probing support the intended factorization without implying perfect disentanglement, motivating representation-level safety alignment beyond input-level filtering.

[22] Whitewashing Hate, Smearing Harmless Content: Annotator-Style Rebuttal Attacks on LLM-Based Moderation cs.CLPDF

Junyu Lu, Kaiyuan Liu, Jingyi Kang, Deyi Ji, Hailong Zhang

TL;DR: 该论文研究基于大语言模型（LLM）的内容审核系统在人类-AI协作流程中的脆弱性，具体探讨了审核员（标注者）通过提供反驳性反馈来操纵模型决策的两种攻击方向：将仇恨言论洗白为正常内容，或将正常内容污蔑为仇恨言论。研究引入了一种包含决策边界扰动和对抗性理由的‘重新裁决’协议，实验表明这种‘标注者风格反驳攻击’能显著降低多种LLM在仇恨言论数据集上的审核性能，且在多轮交互中效果更强，并揭示了模型在两种攻击方向上存在稳定的、模型特定的不对称脆弱性模式。

Details

Motivation: 动机在于，随着LLM越来越多地用于仇恨言论审核，并常置于人类审核员提供反馈的人机协作流程中，这种反馈机制为恶意操纵开辟了两种方向，研究旨在探究初始正确的模型判断对这类‘标注者风格反驳’的敏感性，并分析不同操纵方向（洗白与污蔑）的攻击效果是否存在差异。

Result: 在多个LLM和两个仇恨言论数据集上的实验结果表明，标注者风格反驳攻击显著降低了审核性能（即模型被成功操纵的比例高），多轮设置下效果更强；结果进一步揭示了在多种攻击配置下，洗白攻击和污蔑攻击之间存在稳定的、模型特定的不对称性，表明模型对不同方向的攻击具有不同的脆弱性模式；同时，显式推理提示和防御性指令能减轻但无法完全消除这些影响。

Insight: 论文宣称的创新点在于首次系统性地研究了人机协作审核流程中，针对LLM的‘标注者风格反驳攻击’及其在洗白与污蔑两个方向上的不对称脆弱性，并引入了包含决策边界扰动和对抗性理由的‘重新裁决’协议来评估这种攻击。从客观角度看，其核心洞察是揭示了LLM审核系统在对抗性人类反馈下的方向性安全漏洞，强调了未来需要开发方向感知的防护措施，并为人机协作审核流程的鲁棒性评估提供了新的视角和基准方法。

Abstract: Large language models (LLMs) are increasingly used for hate speech moderation, often within human–AI workflows in which reviewers provide feedback before a final decision. Such feedback introduces two manipulation directions: whitewashing hateful content as normal and smearing normal content as hateful. This study examines the susceptibility of initially correct model judgments to annotator-style rebuttals and analyzes whether attack effectiveness differs across manipulation directions. We introduce a rejudge protocol that extends direct contradiction with decision-boundary perturbations and adversarial rationales. Experiments with multiple LLMs on two hate speech datasets show that annotator-style rebuttals substantially degrade moderation performance, with stronger effects in multi-turn settings. The results further reveal stable, model-specific asymmetries between whitewashing and smearing across attack configurations, indicating distinct directional vulnerability patterns. Explicit reasoning prompts and defensive instructions reduce these effects but do not eliminate them. These findings highlight the need for direction-aware safeguards and dedicated feedback-robustness evaluation in human–AI moderation workflows.

[23] Semantics or Structure? Auditing Text Sensitivity in Multimodal Time-Series Forecasting cs.CLPDF

Karthik Sridhar, Atharva Gupta, Nishant Pradhan, Murari Mandal, Dhruv Kumar

TL;DR: 该论文质疑了多模态时间序列预测模型中文本语义内容是否真正提升了预测性能。通过控制文本扰动、归因分析和Aurora模型文本路径的探测，研究发现当前模型对文本语义不敏感，而文献中报道的性能提升主要源于伴随的数值列而非文本内容。

Details

Motivation: 动机在于验证多模态时间序列预测模型（如Aurora、MM-TSFlib和TaTS）是否真正利用了文本语义信息来提升预测性能，而非仅依赖结构或数值信号。

Result: 在Time-MMD基准测试中，对文本进行多种扰动（如替换为空、常量、域内或跨域随机文本）后，三种架构的平均MSE变化均小于0.5%，表明文本内容并非性能提升的关键因素；当移除伴随的数值列后，文献中报道的改进效果消失。

Insight: 创新点在于通过系统性的扰动协议和评估工具包揭示了当前多模态基础模型在结构化数据中可能未有效整合文本语义，为未来研究提供了诊断方法，并强调了区分语义与结构信号的重要性。

Abstract: Multimodal time-series forecasting has emerged as a promising paradigm in which natural-language context is expected to improve predictive performance. Recent multimodal foundation models, including Aurora, as well as early- and late-fusion approaches such as MM-TSFlib and TaTS, report substantial gains over unimodal baselines on the Time-MMD benchmark, attributing these improvements to textual information. However, whether these models are actually sensitive to the semantic content of the text remains unverified. We address this question through controlled text perturbations, attribution analyses, and probes of Aurora’s text pathway. On Time-MMD, swapping each row’s text for any other real text (empty, constant, within-domain shuffled, or cross-domain) moves mean MSE by less than $0.5%$ on all three architectures. The improvement reported in the literature is recovered when a co-shipped numeric column is removed without touching text. We conclude that, on this benchmark and within this family of frozen-encoder architectures, text content is not the operative signal behind the reported gains. To support future work on text integration in multimodal foundation models for structured data, we release our perturbation protocol and evaluation harness as a reusable diagnostic toolkit.

[24] Mechanistic Interpretability of Chain-of-Thought Reasoning via Sequential Activation Patching cs.CLPDF

Murat Dura, Serkan Öztürk, Selma Tekir

TL;DR: 本文提出了一种序列激活修补框架，用于研究大型语言模型在思维链提示下的内部推理机制。该方法通过追踪跨令牌位置的注意力头激活，并结合词性引导分析，揭示了思维链推理中因果效应的时空分布特性。

Details

Motivation: 尽管思维链提示显著提升了大型语言模型的问题解决能力，但其内部改进机制尚不明确，现有单点静态令牌的激活修补方法难以刻画思维链在时间维度上的分布式效应。

Result: 通过序列多头修补实验与对照分析，研究发现识别出的注意力头对最终答案生成具有关键功能影响，涉及推理轨迹维持、答案锚定、示例-目标分离及数值生成等多个重叠机制。

Insight: 创新点在于提出了序列激活修补框架与词性引导的聚合分析方法，突破了传统单点修补的局限，为理解思维链条件下的分布式推理支持子电路提供了实证依据。

Abstract: Large Language Models (LLMs) demonstrate remarkable problem-solving capabilities when guided by Chain-of-Thought (CoT) prompting, yet the internal mechanisms underlying these improvements remain poorly understood. In this work, we investigate where CoT-related causal effects emerge across the generated reasoning trajectory and which attention heads carry signals that contribute to final-answer computation. Because CoT reasoning unfolds over multiple generated tokens, standard activation patching at a single static token position is insufficient to characterize these temporally distributed effects. To address this limitation, we introduce a sequential activation patching framework that traces CoT-conditioned attention-head activations across token positions and aggregates their effects using Part-of-Speech-guided analysis. We further introduce Sequential Multi-Head Patching to evaluate the joint contribution of distributed head sets, together with cross-question and random activation controls. Targeted zero-ablation experiments show that the identified heads are functionally important for successful answer generation and affect several overlapping mechanisms, including reasoning-trajectory maintenance, answer anchoring, exemplar-target separation, and numerical generation. Overall, our results provide evidence for distributed reasoning-support sub-circuits associated with CoT-conditioned computation.

[25] Context-Aware Cluster Decoding: Semantic Anchor-Driven Coherence in dMLLMs cs.CLPDF

Yikai Zhao, Qiyan Zhao, Jiaquan Zhang, Xiaofeng Zhang, Xiaosong Yuan

TL;DR: 本文针对扩散多模态大语言模型（dMLLMs）在生成长文本时出现的语义漂移和重复问题，提出了一种无需训练的解码方法CACD。该方法通过结合置信度和邻近标记支持度来评分，并采用无块划分策略以保持全局语义锚点的可访问性，从而提升生成文本的连贯性。

Details

Motivation: 现有解码方法存在两个结构性缺陷：基于置信度的评分忽略了已解码邻近标记的支持，而块划分策略阻止了对高准备度语义锚点的访问，导致在局部上下文未充分建立时就过早地确定了标记，从而引发语义漂移和重复。

Result: 在三个dMLLM模型和四个基准测试上的实验表明，CACD方法相比原始解码方法，在生成质量上取得了一致的提升，并减少了幻觉现象，在多个长文本生成场景中增益更为显著。

Insight: 创新点在于提出了一个结合置信度与邻近标记支持度的复合评分函数，并移除了块划分以保持全局语义锚点的可访问性。客观来看，该方法强调了在解码过程中考虑局部上下文支持和视觉集成策略异质性的重要性，为未来dMLLM解码方法设计提供了新思路。

Abstract: Diffusion multimodal large language models (dMLLMs) frequently produce long-form outputs marred by semantic drift and repetition, with quality generally degrading as output length increases. We identify two structural deficiencies in existing decoding methods as primary drivers of these failures: confidence-based scoring ignores decoded-neighbor support, and block partitioning prevents access to high-readiness semantic anchors, together causing tokens to be committed before their local context is sufficiently established. We propose \ours{} (\textbf{C}ontext-\textbf{A}ware \textbf{C}luster \textbf{D}ecoding), a training-free decoding method that scores each masked position by a multiplicative composite of softmax confidence and neighbor proximity, promoting contextually ready tokens above isolated candidates while suppressing low-confidence positional noise, operating block-free to keep high-readiness anchors globally accessible. \ours{} further applies architecture-aware calibration to handle confidence heterogeneity induced by diverse visual integration strategies. Experiments on three dMLLMs across four benchmarks demonstrate consistent quality gains and hallucination reduction over Original, with larger gains in several longer generation settings, highlighting the importance of neighbor support and visual integration strategy for future dMLLM decoding method design. Our code is openly available at https://github.com/zhaoyk-sysu/CACD-dMLLM.

[26] Can Large Language Models “Hyper-Thread”? cs.CLPDF

Fei Ding

TL;DR: 这篇论文提出了’模型超线程假设’，探讨大型语言模型在顺序生成令牌的同时能否并发执行多个任务。作者设计了三种实验条件（基线、串行功能调度、并发功能加载），在AIME 2025开发集上评估发现，更分散的注意力可以与更高的准确性共存，并发功能加载取得了最高准确率。

Details

Motivation: 现有推理扩展方法主要依赖生成长度、更多样本或额外验证阶段，而注意力分散常被视为干扰或错误信号。论文旨在探索序列生成过程中的任务并发性是否可能，挑战了传统观点。

Result: 在AIME 2025开发集上，并发功能加载（Concurrent Functional Loading）实现了最高准确率。与串行功能调度相比，其典型输出长度相似，在大多数问题上更短，同时表现出更大的注意力分散和更高的任务相关覆盖率，但输出长度分布有更重的尾部。

Insight: 创新点在于提出注意力分散可能支持任务并发（超线程）的假设，并提供了初步的行为和相关性证据。这为推理性能提升指出了新方向：从’生成更多令牌’转向’让每个生成步骤承载更多任务’，挑战了注意力分散必然有害的传统认知。

Abstract: Large language models generate tokens sequentially, but can they execute multiple tasks concurrently while forming each token? Broader attention allocation may provide a mechanism for such task concurrency. Existing approaches to scaling inference primarily rely on longer generations, more samples, or additional verification stages, while attention dispersion is often treated as a signal of interference or error. Task concurrency within serial generation therefore remains underexplored. We propose the Model Hyper-Threading Hypothesis and evaluate its predictions using multiple coordinated tasks that share state within the same problem. We design three conditions (Baseline, Serial Functional Scheduling, and Concurrent Functional Loading) and evaluate their benefits and costs using accuracy, output-token distributions, and attention metrics. On an AIME 2025 development set, Concurrent Functional Loading achieves the highest accuracy. Relative to Serial Functional Scheduling, its typical output length is similar and it is shorter on most problems, while exhibiting greater attention dispersion and higher task-relevant coverage, albeit with a heavier output-length tail. Within-step concurrency and its causal mechanism still require direct tests. Our results show that more dispersed attention can coexist with higher accuracy, providing preliminary behavioral and correlational evidence for the hyper-threading hypothesis. These findings motivate a shift in perspective on inference scaling from “generating more tokens” toward “having each generation step carry more tasks,” pointing to a new avenue for improving reasoning performance.

[27] ProBel: Propaganda Detection with Techniques, Spans, and Explanations cs.CL | cs.AI | cs.LGPDF

Mohamed Bayan Kmainasi, Ali Ezzat Shahroor, Elisa Sartori, Giovanni Da San Martino, Firoj Alam

TL;DR: ProBel是一个支持阿拉伯语和英语的propaganda检测资源，它对齐了句子级二元标签、23种propaganda技术的多标签标注、技术标注的文本片段以及解释。该研究评估了零样本提示、任务特定微调和联合训练，发现单一的双语多任务模型在整体性能上表现最佳，并且在跨任务和跨语言上保持竞争力。

Details

Motivation: 解决propaganda检测中不同监督级别（如句子级决策、技术分类和片段识别）在阿拉伯语和英语中联合学习时如何相互作用尚不明确的问题。

Result: 在统一的实验设置下，单一的双语多任务模型实现了最佳的整体性能，在各项任务和语言中保持竞争力。跨任务分析表明，迁移效果取决于监督级别，例如联合分类训练能保持二元性能，而仅片段训练可能削弱句子级预测。

Insight: 创新点在于构建了一个对齐多级别标注的双语资源，并系统评估了不同训练策略。客观分析认为，其揭示了跨任务和跨语言联合训练中监督级别对迁移效果的影响，为多任务学习提供了实用见解。

Abstract: Propaganda detection includes several related prediction levels, ranging from sentence-level decisions to technique classification and span identification. However, it remains unclear how supervision at these levels interacts when learned jointly across Arabic and English. We present ProBel, an Arabic and English resource that aligns binary labels, multi-label annotations over 23 propaganda techniques grouped into six coarse categories, technique-labeled spans, and reference explanations for the same news sentences. It includes a substantially larger English collection and supports matched binary, coarse-grained, multi-label, and span-level tasks in both languages. We evaluate zero-shot prompting, task-specific fine-tuning, and joint training under a shared setup. A single bilingual multi-task model achieves the best overall performance and remains competitive across tasks and languages. Cross-task analysis shows that transfer depends on the supervision level. Joint classification training preserves binary performance, whereas span-only training can weaken sentence-level prediction. Joint bilingual training yields the most stable results, while monolingual fine-tuning can reduce transfer to the other language. We will release the data, code, and evaluation scripts.

[28] Aligned Alone, Misaligned Together: Forecasting Adversarial Capture in LLM Agent Populations cs.CLPDF

Isotta Magistrali, Chen Shani

TL;DR: 本文研究LLM智能体群体中的对抗性捕获问题，发现单个模型的安全评估无法预测群体行为。通过安全分类任务实验，论文表明即使单个智能体校准良好，群体仍可能被少数对抗性智能体影响。研究提出从群体良性运行中校准响应函数，可提前预测对抗性攻击的影响，并发现群体捕获是暂时状态而非永久陷阱。

Details

Motivation: 当前AI安全评估仍以单个模型为单位，但LLM智能体常部署在相互交互的群体中，单个智能体的良好校准无法保证群体决策不受周围智能体影响，因此需要研究群体层面的对抗性捕获问题。

Result: 在安全分类任务中，实验发现单个智能体判断相似的两个警报可导致群体行为显著分化；通过群体良性运行校准的响应函数能提前预测少数对抗性智能体的影响程度；让智能体查看彼此推理可中和弱攻击但仅延迟强攻击。

Insight: 创新点在于将安全评估从单个模型扩展到交互群体，提出可提前预测群体对抗性捕获的响应函数方法；客观分析表明群体捕获具有暂时性和可逆性，为多智能体系统安全设计提供了新视角。

Abstract: The unit of AI safety evaluation is still the individual model, yet language-model agents are increasingly deployed in interacting populations that read and write one another’s decisions. This raises a question no single-agent audit can answer: an agent that is well-calibrated on its own may still be pulled toward a different decision by the agents around it. We study this on a security-triage task, where populations of language-model monitors decide whether to escalate or dismiss alerts, and into which we can inject a committed minority that always pushes one way. We find that two alerts a single agent judges almost identically on its own can drive collective behavior far apart, so auditing any one member need not reveal what the population will do. Yet that collective behavior can be predicted in advance. From a population’s benign, adversary-free operation alone, we calibrate a response function that forecasts, before any attack is run, how far a committed minority will later move it. We then ask what shifts the outcome and find that letting agents see each other’s reasoning neutralizes a weak attack, while only delaying it against a strong one, turning the question from whether the population converges on the adversaries’ choice into when. Finally, we exclude the hypothesis of capture being an irreversible trap: once the committed agents are removed, the population drifts back toward where it began, so capture is a temporary state. Alignment in isolation is not alignment in a population, yet what a population will do under attack can be read in advance, from how it behaves before any adversary arrives.

[29] GTA-RAG: Graph-Trajectory-Augmented Reinforcement Learning for Multi-Turn Retrieval-Augmented Reasoning cs.CL | cs.LGPDF

Jun Chen, Yongchao Liu, Pengyu Qiu, Jiajun Zheng, Juelu Zhang

TL;DR: 本文提出了GTA-RAG，一个用于多轮检索增强推理的图-轨迹增强强化学习框架。该框架通过从实体-文档图中采样连接文档路径来合成多跳QA轨迹，并利用这些轨迹提供可执行的轨迹级监督，以优化检索策略。实验表明，该方法在多个基准测试上优于现有的基于强化学习的RAG基线，并显著提高了证据链的覆盖率。

Details

Motivation: 现有的基于强化学习的RAG方法通常仅通过最终答案奖励进行优化，这种监督信号稀疏，且忽略了模型是否真正检索到了所需的证据链。

Result: 在三个多跳和两个简单QA基准测试上，使用Qwen2.5-3B和Qwen2.5-7B骨干网络的GTA-RAG均一致优于基于强化学习的RAG基线，并大幅提升了证据链覆盖率。

Insight: 核心创新在于从实体-文档图中采样并合成可执行的轨迹级监督信号，结合轨迹引导的奖励（鼓励获取目标证据文档）和组相对策略优化（GRPO），为检索策略提供了更密集、更结构化的训练信号。

Abstract: Retrieval-augmented generation (RAG) enables LLMs to access external knowledge for answering knowledge-intensive questions. For complex multi-hop questions, multi-turn retrieval-augmented reasoning extends RAG into an iterative process that repeatedly searches for and integrates evidence across documents. However, existing reinforcement-learning (RL) approaches for agentic RAG are typically optimized with final-answer rewards, which provide sparse supervision and overlook whether the model actually retrieves the required evidence chain. We present \textsc{GTA-RAG}, a graph-trajectory-augmented RL framework for multi-turn retrieval-augmented reasoning. From an entity–document graph, we sample connected document paths, synthesize multi-hop QA trajectories, and validate them with the deployed retriever to obtain executable trajectory-level supervision. We then optimize the retrieval policy with Group Relative Policy Optimization (GRPO) and a trajectory-guided reward that encourages both accurate answers and acquisition of target evidence documents, followed by answer-reward training on natural QA instances. Experiments on three multi-hop and two simple QA benchmarks show that \method{} consistently outperforms RL-based RAG baselines with both Qwen2.5-3B and Qwen2.5-7B backbones, while substantially improving evidence-chain coverage. Our code is available at https://github.com/cjcj46262/GTA-RAG.

[30] From Diagnosis to Redesign: Using Quantitative Ethnography to Improve Multi-Agent LLM Reasoning cs.CLPDF

Vedant Khatri, Anthony Cusimano, Zachari Swiecki, Zhen Xu, Xiner Liu

TL;DR: 本文提出了一种基于定量民族志（QE）的方法，用于诊断和重新设计多智能体大语言模型（LLM）系统。该方法通过分析智能体交互产生的话语，识别正确与错误决策的对话模式差异，并据此优化智能体提示，从而提升系统性能。

Details

Motivation: 多智能体LLM系统旨在通过任务分解提升推理能力，但多智能体的存在本身并不能保证推理的连贯性或输出与任务目标的一致性。因此，需要一种方法来诊断系统内部交互问题并指导其重新设计。

Result: 在自动作文评分任务中，应用该方法后，系统的精确评分准确率从27.78%提升至40.28%，并且错误决策的对话模式向正确决策的模式转变，使两者几乎无法区分。

Insight: 创新点在于将定量民族志（特别是认知网络分析ENA）引入多智能体LLM系统的诊断与优化循环，通过关联智能体交互模式与系统性能来指导提示工程，实现了从诊断到重新设计的系统性改进框架。

Abstract: Multi-agent large language model (LLM) systems are designed to improve reasoning by decomposing tasks across multiple agents with specialized functions, but the presence of multiple agents does not inherently guarantee coherent reasoning or outputs that align with task objectives. This paper introduces a quantitative ethnographic (QE) approach for diagnosing and redesigning multi-agent LLM systems based on the discourse produced through agent interactions. We test this approach using automated essay scoring as an example context, applying Epistemic Network Analysis (ENA) to model a five-agent multi-agent debate system and examine differences between debates that produced correct versus incorrect scoring decisions. Results show that, in the initial system, correct scoring decisions were characterized by rubric-grounded justification, agreement, and elaboration. Incorrect scoring decisions, in contrast, were characterized by extended proposition-challenge-response exchanges that were less consistently tied to rubric criteria. We then used the findings to revise the agents’ prompts. The revised system improved exact scoring accuracy from 27.78% to 40.28% and shifted the discourse of incorrect debates toward the rubric-grounded pattern of correct ones, making the two nearly indistinguishable. Based on these results, we argue that QE can support a diagnostic-to-redesign loop for AI reasoning by tracing how patterns of agent interaction relate to system performance, informing prompt redesign, and evaluating whether those redesigns change both outcomes and interaction patterns.

[31] Hybrid Panels: Toward Human-AI Collaboration in Survey Research cs.CL | cs.AI | cs.CY | cs.HCPDF

Julia Romberg, Tobias Gummer, Gabriella Lapesa, Tanja Kunz, Claudia Wagner

TL;DR: 本文提出了一种名为’混合面板’的新型AI辅助调查基础设施，旨在通过结合人类参与者和大型语言模型（LLMs）来应对大规模人口调查面临的挑战，如响应率下降、成本高昂和数据延迟。该框架允许迭代改进LLMs与目标人群的匹配度，并利用误差指导后续调查轮次的设计与实施。

Details

Motivation: 动机是解决传统大规模人口调查中存在的响应率下降、数据收集成本增加、数据提供延迟长以及无应答偏差风险等重大挑战，同时不牺牲数据质量。

Result: 论文概述了一个初步试点研究的结果，但未提供具体的定量基准或SOTA比较，主要目的是通过该试点说明混合面板在实施过程中面临的（开放性）挑战。

Insight: 创新点在于提出了’混合面板’这一概念框架，将人类参与者和LLMs共同作为调查设计的核心要素，并利用LLMs模拟与人群对齐的误差来迭代优化调查过程（如参与者招募和问题分配），为人机协作在调查研究中的应用开辟了新路径。

Abstract: Large-scale population surveys are essential for generating robust social and scientific insights, yet they face significant challenges, including declining response rates, increasing data collection costs, long delays between data collection and data provision, and the risk of nonresponse bias. Advances in artificial intelligence (AI) have opened up new opportunities for AI-supported survey infrastructures where the goal is to overcome these challenges without limiting the data quality. A promising AI-enabled survey infrastructure for which we build a first pilot is a hybrid panel. A hybrid panel is a longitudinal AI-enabled survey which allows to iteratively improve the alignment between large language models (LLMs) and the population they aim to simulate and use the errors to inform the design and implementation of the next survey wave (e.g., inform the participant recruitment, assignment of questions to participants). It incorporates both human participants and LLMs as fundamental elements of its design. In this research note, we introduce the concept of a hybrid panel by providing a definition and outlining an overarching framework, spanning data collection to data validation. We detail results from a first pilot study to illustrate (open) challenges that we identify for hybrid panels.

[32] GeoRisk-RAG: A Hierarchy-Aware Risk Framework for Improving RAG Reliability through Selective Answering cs.CL | cs.AIPDF

Meenu Ravi, Shailik Sarkar, Lulwah AlKulaib, Yordanos Tessema, Chang-Tien Lu

TL;DR: 本文提出了GeoRisk-RAG，一个层次感知的风险框架，旨在通过选择性回答来提高检索增强生成（RAG）在依赖地理信息的领域（如自然灾害管理）中的可靠性。该框架在生成回答前，利用基于有向无环图（DAG）的距离来显式估计地理适用性，从而区分语义相似性与地理有效性。

Details

Motivation: 现有提升LLM回答可靠性的方法（如RAG、知识图谱增强）通常难以区分语义相似性与地理有效性，这在自然灾害管理等地理粒度至关重要的领域尤为关键，因为一个地点有效的答案可能不适用于另一个地点。

Result: 在一个新颖的、保留的野火相关问答数据集上的实验表明，GeoRisk-RAG显著降低了地理依赖问题的错误置信率，将其降至0.009，远低于标准语义相似性和重排序基线（约0.090），同时持续获得更高的人类偏好对齐度。

Insight: 主要创新点在于提出了一个层次感知的框架，将地理有效性（通过DAG距离量化）和选择性回答行为整合到端到端RAG流程中，为地理空间领域提供了更全面的风险评估和更安全的决策支持。

Abstract: Current work on improving reliability in large language model (LLM)- generated answers has primarily leveraged Retrieval-Augmented Generation (RAG), knowledge-graph augmentation, and reinforcement learning. While these methods are adept at enhancing and measuring reliability through semantic similarity and faithfulness, they often struggle to distinguish semantic similarity from geographic validity. This is especially critical in natural hazard management domains where geographic granularity (i.e., town vs. city vs. state) is significant for decision-making, as responses valid in one municipality may not transfer to another. In such domains, a confidently wrong answer carries greater risk than abstaining. We present GeoRisk-RAG, a novel hierarchy-aware framework that addresses this geographic-validity gap through selective answering. This framework explicitly estimates geographic applicability using a Directed Acyclic Graph (DAG)-based distance for context retrieval before response generation. Experiments on a novel held-out wildfire-related question-answering (QA) dataset show that GeoRisk-RAG significantly reduces false confidence rates for location-dependent questions, lowering the rate to 0.009 compared with ~0.090 for standard semantic similarity and reranking baselines, while consistently achieving higher human preference alignment. This work provides a more comprehensive assessment of end-to-end RAG pipelines by integrating geographic validity and selective-answering behavior for safer decision-making in geospatial domains.

[33] Teaching LLMs How ICU Physicians Approach Clinical Reasoning Through OMOP-Aligned Retrieval Improves Reasoning Across Clinical Domains cs.CL | cs.AIPDF

Miguel Contreras, Scott Siegel, Subhash Nerella, Jessica Sena, Jiaqing Zhang

TL;DR: 本文介绍了ICU-REACT数据集和Clin-REACT模型，旨在通过专家ICU临床推理训练提升LLMs的临床推理能力。研究通过临床医生参与构建的数据集对多个参数规模的LLMs进行微调，使其在信息检索和上下文感知推理方面表现更优，并在多个临床推理基准测试中超越了基础模型及现有开源医疗LLM。

Details

Motivation: 解决现有LLM应用和数据集在临床决策中过于强调表层检索或事实回忆，而缺乏模拟临床医生归纳和演绎推理过程的问题，特别是在数据密集且快速变化的ICU环境中。

Result: 在五个临床推理基准测试（包括脚本一致性测试及下游诊断和治疗任务）中，Clin-REACT模型（参数规模8B-70B）持续优于其骨干模型以及开源通用和医疗专用LLMs，显示出跨临床领域的泛化能力。

Insight: 创新点在于通过临床医生参与循环框架构建的ICU-REACT数据集，专门用于教授LLMs如何进行与临床决策相关的证据选择和推理；客观分析认为，利用重症监护专家推理进行监督训练，可以提升LLMs更广泛的临床推理技能，尽管仍需前瞻性评估才能应用于真实临床环境。

Abstract: Clinical decision-making relies on identifying relevant patient information to guide diagnosis and treatment, a challenge that is especially difficult in the data-dense and rapidly changing intensive care unit (ICU). Large language models (LLMs) could support this task. However, existing applications and datasets mostly emphasize surface-level retrieval or factual recall rather than the inductive and deductive reasoning clinicians practice to select and reason over decision-relevant evidence. We hypothesized that training LLMs on expert ICU reasoning could yield clinical reasoning skills that generalize beyond critical care. Here we introduce ICU-REACT, a reasoning dataset developed with 19 clinicians through a clinician-in-the-loop framework to teach LLMs to perform information retrieval and context-aware clinical reasoning in the ICU. Using ICU-REACT, we fine-tuned Clin-REACT models spanning 8B-70B parameters and three model families. Across five clinical reasoning benchmarks, Clin-REACT consistently outperformed its backbone models and open-source general-purpose and medical LLMs. Gains extended to different tasks including script concordance tests, and downstream diagnosis and treatment tasks. These findings suggest that expert reasoning supervision in critical care can improve broader clinical reasoning, although prospective evaluation is needed before real-world clinical use.

[34] Iteration Without Elaboration: A Simple ReAct Architecture Suffices for Text-to-SQL Generation cs.CLPDF

Jian Lu, Haiwei Yu, Raymond M Xiong, Anru Zhang, Danyang Zhuo

TL;DR: 本文提出了ReAct-SQL，一个用于文本到SQL生成的简单零样本ReAct风格框架。它摒弃了复杂的模块和管道，仅依靠迭代推理和一个由15个关系操作组成的类型化领域特定语言（DSL）定义的约束动作空间。模型通过逐步发出DSL调用、观察编译后SQL的执行反馈并进行交互式修订来工作。

Details

Motivation: 动机是解决现有文本到SQL系统因依赖模式链接、检索增强提示、候选生成和多阶段精炼管道等复杂组件而导致的延迟高和工程开销大的问题，旨在探索一个更简单高效的替代方案。

Result: 在BIRD mini-dev和EHR-SQL基准测试上，ReAct-SQL分别达到了84.5%和73.9%的准确率，与更复杂的基线模型性能相当，同时运行速度提升了高达8倍。消融实验表明迭代主要改善了基础能力，而DSL提高了组合可靠性。

Insight: 创新点在于证明了简单的迭代推理架构（ReAct）结合一个受限的DSL动作空间，足以在文本到SQL任务上取得与复杂系统相当的性能，同时显著提升效率。这挑战了该领域对复杂工程设计的依赖，强调了交互式执行反馈和结构化动作空间的价值。

Abstract: Modern text-to-SQL systems have become increasingly elaborate, relying on schema-linking modules, retrieval-augmented prompting, candidate generation, and multi-stage refinement pipelines. While effective, these additions introduce substantial latency and engineering overhead. To this end, we present \textbf{ReAct-SQL}, a simple yet effective zero-shot ReAct-style framework built solely on iterative reasoning and a constrained action space defined by a typed Domain-Specific Language (DSL) of 15 relational operations, rather than free-form SQL generation. The model incrementally issues DSL calls, observes compiled-SQL execution feedback, and revises its reasoning through interaction. On corrected BIRD mini-dev and EHR-SQL, ReAct-SQL achieves \textbf{84.5%} and \textbf{73.9%} accuracy, respectively, matching substantially more elaborate baselines while running up to $8\times$ faster. Incremental ablations further show that iteration primarily improves grounding, while the DSL improves compositional reliability.

[35] A Source-Grounded Framework for Constructing and Evaluating Progressive Multimodal Diagnostic Dialogues from Clinical Case Reports cs.CLPDF

Yufan Wang, Rui Yang, Yi Liu, Yi Lin, Yifan Peng

TL;DR: 本文提出了一个基于来源的框架，用于从临床病例报告中构建渐进式多模态诊断对话，并设计了一种评估策略，用于评估多模态大语言模型在最终诊断、诊断推理和影像发现解读方面的能力。该框架能高精度地将病例报告转化为参考对话，并在评估前沿MLLMs时，揭示了其流畅回答与基于证据的临床推理能力之间存在显著差距。

Details

Motivation: 当前大多数多模态医学基准测试评估的是固定输入或最终答案，而完全交互式诊断代理将证据选择与证据解释混为一谈，无法反映真实的渐进式临床诊断过程。

Result: 在24个内科病例报告上的评估显示，该框架构建参考对话的诊断F1分数达到0.99，推理质量得分达4.79/5。对两个前沿MLLMs（o4-mini和Claude Haiku 4.5）的评估显示，其推理质量得分分别为2.75和2.50，且诊断、推理和影像发现的F1分数均显著偏低。

Insight: 创新点在于提出了一个从结构化病例源数据构建渐进式、多模态诊断对话的框架，并分离了对话构建与模型评估，从而能够更精细地评估MLLMs的临床推理能力，而非仅关注最终答案或回答流畅性。

Abstract: Clinical diagnosis requires progressive integration of patient history, physical examination, laboratory findings, medical images, and diagnostic-informative tests. However, most multimodal medical benchmarks evaluate fixed inputs or endpoint answers, while fully interactive diagnostic agents conflate evidence selection with evidence interpretation. We present a source-grounded framework to construct progressive multimodal diagnostic dialogues from case reports and an evaluation strategy for assessing MLLMs on final diagnosis, diagnostic reasoning, and image-finding interpretation. Evaluation on 24 internal medicine case reports showed that our framework can accurately convert case reports into reference dialogues, achieving a diagnosis F1 of 0.99 and a reasoning-quality score of 4.79 out of 5. Evaluation on two frontier MLLMs (o4-mini and Claude Haiku 4.5) achieved reasoning-quality scores of 2.75 and 2.50, respectively, with substantially lower diagnosis, reasoning, and image-finding F1 scores. The results demonstrate that fluent responses do not necessarily reflect evidence-grounded clinical reasoning and highlight the utility of the proposed framework for evaluating multimodal diagnostic reasoning.

[36] Beyond Factual Knowledge: Benchmarking and Learning Step-Level Procedural Rule Reasoning in Large Language Models cs.CLPDF

Bohan Yu, Pengfei Cao, Chen Han, Chenxi Zhou, Zhiheng Zhang

TL;DR: 本文针对大语言模型在理解和应用外部程序性规则方面的不足，提出了RuleWorld基准测试和DynaRule框架。RuleWorld将规则重构为全局可复用的抽象单元，并设置了多种推理场景进行评估。DynaRule通过将规则注入KV缓存，并利用堆叠步级注意力训练和特殊标记，实现了推理过程中动态的、可学习的规则检索与更新，从而提升了多步推理的稳定性。

Details

Motivation: 大语言模型虽然在文本理解和生成方面表现出色，但在大规模可靠地理解和应用外部提供的程序性规则方面仍存在困难。为了评估和提升这种能力，需要专门的基准和方法。

Result: 在RuleWorld基准上的实验表明，现有大语言模型在大规模规则池下表现不佳，而DynaRule将平均问答准确率提升了多达19个百分点，并在10K条规则下实现了超过85%的Recall@1，显著超越了强基线模型。

Insight: 论文的创新点在于将规则视为全局可复用的抽象单元进行基准构建，并提出了一个端到端的框架，通过将规则注入KV缓存和引入可学习的步级检索机制，实现了推理过程中对规则动态、高效的重新关注和更新，这为提升模型对程序性知识的处理能力提供了新思路。

Abstract: Large language models (LLMs) excel at text understanding and generation, yet still struggle to reliably understand and apply externally provided procedural rules at scale. To evaluate this capability, we introduce RuleWorld, a large-scale benchmark that reformulates rules as globally reusable abstract units rather than instance-specific facts. In RuleWorld, several scenarios, including single-rule, parallel multi-rule, and multi-hop reasoning, are settled for comprehensive evaluation. We further propose DynaRule, an end-to-end framework that injects the given rules into the KV cache and turns retrieval into an internal, learnable, step-wise process. Specifically, DynaRule employs Stacked Step-Level Attention Training with a special token to enable dynamic rule re-attention and updating during inference. In this way, the model can re-attend to the most relevant rules at each step, dynamically replacing outdated ones to support more stable multi-step reasoning. Experiments on RuleWorld show that existing LLMs face challenges under large rule pools, while DynaRule improves average QA accuracy by up to 19 points and achieves over 85% Recall@1 at 10K rules, outperforming strong baselines by large margins. We make our code and dataset available here: https://github.com/SharkSpicy-NLP/Beyond-Factual-Knowledge.

[37] SPOC-SQL: Stage-wise Preference Optimization for Controllable Text-to-SQL cs.CLPDF

Yingnan Chen, Chun Ding, Tianshi Xu, Xu Yang, Si Wu

TL;DR: SPOC-SQL将Text-to-SQL任务分解为四个遵循标准SQL执行逻辑的连续子任务，并针对每个阶段设计特定的优化策略，以增强模型在关键决策点的结构化推理能力。该方法通过细粒度偏好优化和结构化分解策略，实现了对中间生成过程的干预和校正，从而生成更可控、可靠的SQL查询。

Details

Motivation: 现有方法将Text-to-SQL视为单步生成任务，模型缺乏在关键决策点上的针对性反馈，且无法支持对中间生成过程的交互与控制。

Result: 实验表明，融入分阶段的人类知识能持续提升性能，验证了分阶段感知可控生成的有效性。

Insight: 创新点在于将Text-to-SQL任务结构化分解为多个子任务，并在各阶段实施细粒度偏好优化，这为复杂结构化生成任务提供了可干预、可校正的生成框架。

Abstract: Text-to-SQL aims to translate natural language questions into executable SQL queries over relational databases, requiring multi-stage structured reasoning over database schemas and query constraints. However, existing methods treat this task as single-step generation, where models optimize entire SQL sequences without targeted feedback at key decision points and lack support for interacting with and controlling the intermediate generation process. To address this issue, we propose SPOC-SQL, which decomposes Text-to-SQL into four sequential subtasks following standard SQL execution logic and designs stage-specific optimization strategies for the model to learn key decisions. Specifically, we propose the implementation of fine-grained preference optimisation at key decision points across SQL stages, with the objective of enhancing structured decision-making during query construction. Furthermore, a structured decomposition strategy is designed, facilitating stage-wise intervention and correction through explicit intermediate representations. This results in more controllable and reliable SQL generation. Experiments demonstrate that incorporating stage-wise human knowledge consistently improves performance, validating the effectiveness of stage perception controllable generation.

[38] DIAG: Diagnostic Iterative Alignment and Generation for Data-Efficient Mathematical Preference Distillation cs.CLPDF

Guhan Chen, Songtao Tian, Bohan Li, Hejin Wang, YeXin Xie

TL;DR: 本文提出DIAG框架，通过诊断迭代对齐与生成来解决数学推理任务中LLM偏好优化的数据效率问题。该框架动态调整训练数据分布，聚焦于模型当前能力边界附近的高信息量样本，从而提高偏好对的有效生成和训练效率。

Details

Motivation: 动机在于解决迭代偏好优化中的信号稀缺问题：随着模型能力提升，静态问题集与模型演化能力不匹配，导致生成的偏好对要么太简单要么太难，缺乏信息量，从而限制了训练效率。

Result: 实验表明，DIAG在迭代过程中显著提升了有效偏好对的生成量，并在同等训练预算下实现了更强的推理性能，证明了其能够为数学推理蒸馏出更具信息量的偏好监督。

Insight: 创新点在于将诊断与生成相结合，通过经验贝叶斯收缩估计器校准探索-利用权衡并分配主题配额，以及利用教师模型从学生失败轨迹中合成变体问题，从而近似实现以KL正则化重新加权实践分布至能力边界，最大化有效偏好对产出。

Abstract: Iterative preference optimization is essential for aligning Large Language Models on mathematical reasoning tasks, yet its efficiency is often throttled by signal scarcity: as the model improves, static problem sets become increasingly mismatched to the model’s evolving competence, producing rollouts that are either too easy or too hard and therefore non-informative, which leads to a scarcity of valid preference pairs. We propose DIAG, a Diagnostic Iterative Alignment and Generation framework that adaptively reshapes the practice distribution to increase informative supervision and focus training near the student’s current competence boundary. DIAG consists of two phases: (1) diagnosing valid preference-pair yield to calibrate the exploration-exploitation trade-off and allocate topic quotas via an Empirical Bayes shrinkage estimator, thereby prioritizing high-yield concepts; and (2) generating targeted practice, where a teacher synthesizes variants from the student’s failure traces. We further provide a theoretical view interpreting DIAG as a teacher-mediated approximation to KL-regularized reweighting of the practice distribution toward the student’s competence boundary, where valid preference-pair yield is maximized. Experiments show that DIAG boosts yield across iterations and delivers stronger reasoning performance under an iso-effective training budget, demonstrating that it can distill more informative preference supervision for mathematical reasoning.

[39] SAVER: Selective Auditing of Verbal Evidence for Error Recovery in VLM Change Reasoning cs.CLPDF

Youdi Li

TL;DR: 本文提出SAVER方法，通过选择性审核视觉语言模型（VLM）输出中的言语证据（如物体名称、颜色、空间位置）来改善视觉变化推理任务中的错误恢复。该方法基于规则解析VLM响应，仅在证据缺失或不一致时触发结构化重新提示，从而显著提升模型在表达失败场景下的准确性。

Details

Motivation: 视觉语言模型在视觉变化推理任务中经常失败，即使其视觉编码器包含足够信息；研究发现正确输出往往包含支持所声称变化的明确言语证据，而错误输出则缺乏此类证据，因此需要一种轻量级方法来检测并纠正这种表达失败。

Result: 在三个变化检测基准（包括CLEVR-Change）和四个VLM上，SAVER显著提升了准确性，在CLEVR-Change上最高提升+25.8%；通过LLM生成的证据模式与手动调整的门控机制效果相当，消融实验证实改进主要来自证据门控而非单纯重新提示。

Insight: 创新点在于利用言语证据作为VLM输出可靠性的代理指标，并设计轻量级规则门控来选择性触发重新提示；该方法可泛化至LLM生成的证据模式，为VLM的自我纠正提供了可解释且高效的框架。

Abstract: Vision-language models (VLMs) frequently fail at visual change reasoning, even when their vision encoders contain sufficient information. We observe that correct VLM outputs tend to contain explicit verbal evidence (object names, colors, spatial locations) that supports the claimed change, while incorrect outputs often lack such evidence. We propose SAVER (Selective Auditing of Verbal Evidence for Error Recovery), a lightweight, rule-based method that parses VLM responses for this evidence and triggers structured reprompting only when evidence is missing or inconsistent. Across three change detection benchmarks and four VLMs, SAVER significantly improves accuracy on tasks where errors stem from the model failing to articulate what it saw (expression failures), with gains up to +25.8% on CLEVR-Change. The evidence patterns can also be generated by an LLM in a single call, matching the hand-tuned gate on CLEVR-Change. Ablation experiments confirm that the evidence gate, not reprompting alone, drives the improvement.

[40] Knowing Isn’t Always Saying: When Do Spatial Encodings Reach Answers in Vision-Language Models? cs.CLPDF

Zeyu Wang, Xinming Xu

TL;DR: 该论文研究了视觉语言模型中空间信息编码与答案生成之间的关联问题，通过方向修补技术分析了空间编码信息在模型不同层、token位置和提示格式下何时及如何影响最终答案。研究发现，因果影响主要出现在中深层，文本思维链会抑制多数模型的直接对象-词汇最大概率传输，而视觉基础提示则保持其开放。

Details

Motivation: 视觉语言模型已知在隐藏状态中编码空间信息，但在回答问题时常常未能有效利用，论文旨在探究这种编码信息何时及何处能到达答案生成阶段。

Result: 在十个视觉语言模型上的实验表明，因果影响仅在中深层出现，目标对数增益可能低于最大概率阈值，传输可在最终前缀token或深层答案步骤重新出现，形成描述性传输模式。

Insight: 创新点在于使用方向修补技术进行条件因果干预，将编码-基础差距重新定义为视觉语言模型中的条件传输问题，揭示了空间信息传输的动态模式和影响因素。

Abstract: Vision-language models are known to encode spatial information in their hidden states, yet often fail to use it when answering. However, it remains unclear when and where this encoded information reaches the answer. We address this with direction patching, a class-conditioned causal intervention applied across layers, token positions, and prompt formats. Using spatial-ID directions constructed following prior encoding evidence, we find that causal influence on answer logits emerges only at mid-to-deep depths. Text chain-of-thought suppresses immediate object-word argmax-level transport in most models, while visually grounded prompts keep it open. Positive target-logit gain can remain below the argmax threshold, and transport can re-emerge at the final prefix token or at the answer step in deeper layers. Across the ten VLMs we study, these local effects form descriptive transport patterns. Complementary experiments characterize how these patterns shift across datasets, attributes, and encoding amplitudes. Together, these results reframe the encoding-grounding gap as a problem of conditional transport in VLMs.

[41] Meta-Moderator: Empowering Multi-Agent Debate with Meta-Cognition cs.CLPDF

Wentao Hu, Zhuoyue Wan, Jinhao Shen, Chen Jason Zhang, Xiaoyong Wei

TL;DR: 该论文提出了一种名为Meta-Moderator的可学习框架，用于改进多智能体辩论中的协调过程。它将协调视为元认知过程，动态监控辩论效用、控制讨论并裁决最终答案，通过独立于辩论者的结果驱动策略优化进行训练。

Details

Motivation: 现有基于固定预算、基于一致性的停止机制或未经训练的评判者的多智能体辩论协调方法，存在冗余讨论和不可靠证据聚合的问题，限制了其推理性能的提升。

Result: 在五个基准测试中，Meta-Moderator的表现优于广泛使用的决策层，并且能够跨任务和系统配置进行迁移。分析表明它能更选择性地分配辩论资源，并在信息性假设出现后减少错误聚合。

Insight: 核心创新在于将辩论协调明确建模为可学习的元认知能力，通过策略优化独立训练，使其成为一种显式的调控机制，而非提示的附带效果，从而更有效地管理辩论流程和证据整合。

Abstract: Multi-agent debate can improve large language model reasoning by eliciting diverse hypotheses and critiques, yet its performance is often constrained by weak moderation. Common pipelines rely on fixed budgets, agreement-based stopping, or untrained judges, leading to redundant deliberation and unreliable evidence aggregation. We cast moderation as a meta-cognitive process, monitoring debate utility, controlling deliberation, and adjudicating a final answer, and introduce Meta-Moderator, a learnable framework that dynamically regulates debate and decides when to finalize an answer. Meta-Moderator is trained independently of the debaters via outcome-driven policy optimization, making debate regulation an explicit capability rather than an incidental effect of prompting. Across five benchmarks, Meta-Moderator outperforms widely used decision layers and transfers across tasks and system configurations. Further analyses show that it allocates debate more selectively and reduces mis-aggregation after informative hypotheses appear.

[42] Beyond Verdicts: A Graph-Based Analysis of Human and LLM Reasoning in Scientific Fact-Checking cs.CL | cs.AIPDF

Abdul Ghafoor, Muhammad Arslan Manzoor, Yufang Hou

TL;DR: 本文提出了一种基于图（类型化推理图）的框架，用于在科学事实核查任务中比较人类专家与大语言模型（LLM）的推理路径。该框架将解释建模为连接虚假声明、研究背景、研究发现、谬误支持前提和谬误标签的推理图，从而支持在谬误特定子图层面进行一对一的比对。研究在MISSCIPLUS数据集上评估了GPT-5、Claude Opus 4.7和Qwen3-32B等模型，发现它们在裁决准确性、与人类推理的对齐程度以及成功案例中的有效推理方面表现出不同的优势维度。

Details

Motivation: 当前基于LLM的自动事实核查系统通常只判断声明是否正确并生成解释，但无法说明模型的推理路径是否与人类专家一致，或是否通过其他有效但不同的路径得出结论。本文旨在解决这一问题，以更细致地比较和评估LLM与人类的推理过程。

Result: 在包含84个虚假声明的MISSCIPLUS数据集上，评估了GPT-5、Claude Opus 4.7和Qwen3-32B在不同提示和证据设置下的表现。结果显示：Qwen3-32B的裁决失败率最低，GPT-5与人类推理的对齐度最高，而Claude Opus 4.7在裁决预测上较弱，但在成功案例中常表现出有效的推理。

Insight: 论文的创新点在于提出了一个图结构的推理表示框架，使得人类与LLM的推理路径可以在细粒度的谬误子图层面进行对齐和比较。这为超越简单的正确/错误裁决，深入分析模型推理的合理性与人类相似性提供了新的方法论。

Abstract: Misinformation that cites legitimate papers can be especially harmful when it distorts what those studies actually report. While existing automatic fact-checking systems based on large language models (LLMs) can assess whether a model assigns an Incorrect verdict and can gen- erate explanations for that decision, they typi- cally do not indicate whether the model follows the same reasoning path as human experts or arrives at the verdict through a different but still valid path. In this work, we introduce a graph- based framework (typed reasoning graph) for comparing human and LLM reasoning paths in scientific fact-checking. Building on prior work on fallacious reasoning in biomedical misinformation, MISSCIPLUS (Glockner et al., 2025), we model each explanation as a rea- soning graph that links the false claim to the relevant study context, study findings, fallacy- supporting premises, and fallacy labels. This representation enables one-to-one alignment of human and LLM reasoning at the level of fallacy-specific sub-graphs. For non-human- aligned LLM paths, we validate grounding in the cited study, relevance to the claim, and suf- ficiency for the verdict. Using 84 false claims from MISSCIPLUS, we evaluate GPT-5, Claude Opus 4.7, and Qwen3-32B across prompt and evidence settings. Results show distinct perfor- mance dimensions: Qwen3-32B has the lowest verdict failure rate, GPT-5 the highest human alignment, and Claude Opus 4.7 weak verdict prediction but often valid reasoning in success- ful cases

[43] Counter with Evidence! A Multi-Agent Memory Efficient Reasoning Framework for Hate Category Informed Counterspeech Generation cs.CLPDF

Sujoy Nath, Aswini Kumar, Tanmoy Chakraborty

TL;DR: 本文提出FIRE框架，通过多智能体推理机制将仇恨言论分解为五个具体类别（如错误信息、刻板印象等），并生成针对性的反制言论。该研究构建了FactualCS数据集，包含4,784条带注释的实例，支持基于证据的生成。实验表明FIRE在事实准确性和类别针对性上显著优于现有方法，同时降低了毒性。

Details

Motivation: 现有自动反制言论生成方法将仇恨言论视为同质化问题，忽略了不同仇恨类别需要根本不同的反制策略，导致生成效果受限。

Result: 在28种基线配置的评估中，FIRE使用紧凑智能体（<2B参数）相比最强基线在事实准确性上提升约12%，类别特异性准确性提升约11%，同时毒性降低约11%。人工评估也显著偏好FIRE的生成结果。

Insight: 创新点在于将仇恨言论按意图分解为细粒度类别，并设计多智能体框架进行证据驱动的推理生成；客观来看，其结合类别分析与证据映射的方法提升了反制言论的安全性和针对性，为基于推理的文本生成提供了新思路。

Abstract: Counterspeech effectively neutralizes the impact of online hate. Although prior work explores automated counterspeech generation, it largely emphasizes stylistic control while treating hate speech as homogeneous, overlooking that distinct forms of abuse require fundamentally different counterspeech strategies. To address this gap, we introduce FIRE (Factuality Informed Multi-Agent Reasoning Framework) that first decomposes hate speech into one of the five distinct categories (misinformation, stereotype, conspiracy, dehumanizing, non-factual), and then maps it to a targeted counterspeech style. To facilitate FIRE, we curate FactualCS, a novel dataset of $4,784$ instances that provides the annotations regarding hate categories, reasoning traces, and evidence mappings, which are critical elements for grounded generation that are missing in prior work. A comprehensive evaluation across $28$ baseline configurations demonstrates that FIRE significantly surpasses existing methods, despite using compact agents ($<$2B). FIRE achieves a $\sim$ $12 %$ and $\sim$ $11 %$ improvements in factual and category-specific accuracy respectively, while simultaneously reducing toxicity by $\sim$ $11 %$ relative to the strongest baselines. Further human evaluation confirms that responses generated by FIRE are significantly preferred over the strongest baselines, underscoring its effectiveness for real-world deployment. These findings show that decomposing the underlying intent of hate speech is essential for generating safe, effective, and contextually precise counterspeech.

[44] CaRGo-T: Causal Reasoning Graph-of-Thought improves Multimodal Humor Comprehension cs.CL | cs.CVPDF

Abhilash Nandy, Rahul Seetharaman, Aman Bansal, Rounak Saha, Manav Nitin Kapadnis

TL;DR: 本文提出了一种名为CaRGo-T（因果推理思维图）的推理框架，旨在提升大规模视觉语言模型（VLMs）对多模态幽默的理解能力。该框架通过构建轻量级的图结构来表征幽默内容中跨图像和文本模态的实体、事件、上下文及隐含关系之间的因果和上下文联系，并将此图序列化为基于代码的表示，供VLM进行零样本或上下文学习以做出最终预测。

Details

Motivation: 尽管大规模视觉语言模型在多模态任务上表现出色，但理解幽默仍然具有挑战性，因为幽默内容通常依赖于跨模态的实体、事件、上下文和隐含关系之间微妙的交互作用，这些交互涉及复杂的推理链，难以通过传统的提示或线性思维链推理来捕捉。

Result: 在涵盖讽刺、挖苦和表情包等多种喜剧形式的四个数据集上进行的幽默理解和幽默检测实验表明，CaRGo-T在SOTA商业和开源VLMs上持续优于现有的基于推理的基线方法，在幽默理解任务上提升了约1-20%，在幽默检测任务上提升了约1-3%。互信息分析进一步表明，CaRGo-T生成的推理表示比基线方法包含更多与目标输出相关的信息。

Insight: 论文的创新点在于将多模态幽默理解建模为一个因果推理图（Graph-of-Thought）问题，而非传统的线性思维链，从而更好地捕捉幽默中复杂的跨模态交互关系。其核心方法是将推理结构显式地表示为轻量级图并序列化为代码表示，这为VLM提供了一种结构化的、可解释的中间推理表示，有效提升了零样本和上下文学习下的性能。

Abstract: Large-scale vision-language models (VLMs) have demonstrated remarkable versatility across a wide range of multimodal tasks. However, understanding humor remains challenging because humorous content often depends on subtle interactions among entities, events, context, and implicit relationships across image and text modalities. These interactions can involve complex chains of reasoning that are difficult to capture through conventional prompting or linear chain-of-thought reasoning. In this work, we propose CaRGo-T (Causal Reasoning Graph-of-Thought), a reasoning framework that represents the causal and contextual relationships underlying multimodal humor as a lightweight graph-based reasoning structure. The graph is serialized into a code-based representation generated by a VLM, which can subsequently be interpreted by the same or a different VLM to produce the final prediction in zero-shot or in-context learning settings. We evaluate CaRGo-T on humor understanding and humor detection across four datasets spanning diverse forms of comedic content, including satire, sarcasm, and memes. Experiments with state-of-the-art commercial and open-source VLMs show that CaRGo-T consistently improves performance over existing reasoning-based baselines, achieving gains of approximately 1-20% on humor understanding and 1-3% on humor detection. Further analysis using mutual information indicates that the reasoning representations produced by CaRGo-T contain more information relevant to the target output than those generated by baseline reasoning approaches. Code is available at https://github.com/abhi1nandy2/CaRGo-T.

[45] LongWoF-Bench: Evaluating EvoMap Genes for Verifiable Long-Workflow Tasks cs.CLPDF

Xiao Zhang, Qumeng Sun, Jihao Li, Yiming Ren, Xiang Liu

TL;DR: 本文提出了LongWoF-Bench基准，用于评估在可验证长工作流任务中，通过EvoMap方法将已验证的执行轨迹整合为结构化Gene（基因）的有效性。研究表明，EvoMap Gene能显著提升多种大语言模型在代码生成、智能体环境合成、数学推理和规则遵循等任务上的性能，并减少计算开销。

Details

Motivation: 大语言模型在执行复杂工作流时，其成功经验通常在单次运行后丢失，导致后续模型需从头重新探索策略和失败模式。本文旨在研究是否可以通过EvoMap方法将这些已验证的执行经验外部化并复用。

Result: 在LongWoF-Bench的252个有验证轨迹的任务上，EvoMap Gene在所有七个评估模型上均优于Skill方法，性能提升8.7-15.5个百分点，且优势扩展到不同模型家族的消费级模型。对于Claude Opus，Gene复用比Skill多完成了39个任务，同时将求解时间令牌消耗降低了9.9%。

Insight: 论文的创新点在于提出了EvoMap框架和LongWoF-Bench基准，证明了将验证过的执行经验结构化并作为可复用外部资源（Gene）的有效性。关键洞察是，仅靠紧凑表示（如参考蒸馏的Gene）不足以保证性能提升，Gene的效用与已验证的经验来源密切相关。

Abstract: Large language models are increasingly expected to execute complex workflows whose success depends on maintaining interdependent constraints and producing artifacts that satisfy strict end-to-end verification. Yet successful execution experience is typically lost after a single run, forcing subsequent models to rediscover strategies and failure modes from scratch. We study whether such experience can instead be externalized and reused through EvoMap, where verifier-confirmed execution trajectories are consolidated into structured Gene. To evaluate this setting, we introduce the Long-Workflow Benchmark (LongWoF-Bench), comprising 778 machine-verifiable tasks across code generation, agent-environment synthesis, mathematical reasoning, and rule following. On the 252 tasks with verifier-confirmed Opus trajectories, evolved EvoMap Gene outperform Skill across all seven evaluated models by 8.7-15.5 percentage points, with the gains extending to consumer models from different model families. In contrast, reference-distilled Gene do not exhibit the same advantage, indicating that compact representation alone is insufficient and that Gene utility is closely associated with verified experience provenance. For Claude Opus, Gene reuse also completes 39 more tasks than Skill while reducing solve-time token consumption by 9.9%. Together, these results show that verified execution experience can be retained and shared as a reusable external resource, enabling models to improve long-workflow completion without repeatedly paying the full cost of experience discovery.

[46] Credal Large Language Models for Semantic Commitment under Uncertainty cs.CL | cs.AI | cs.LG | stat.MLPDF

Shireen Kudukkil Manchingal, Sofiia Nikolenko, Fabio Cuzzolin

TL;DR: 本文提出了Credal Large Language Models (CLLMs)，通过集成LoRA适配器来构建一个置信集合，以区分认知不确定性和真实模糊性。该方法推导出两种互补的承诺分数：Credal Token Commitment (CTC) 用于词元空间评估，而Semantic Commitment Consistency (SCC) 扩展到语义空间。在多个基准测试中，CLLM在保持竞争力的校准误差的同时，实现了最佳的问答准确率，并在幻觉检测和选择性预测任务上表现出色。

Details

Motivation: 标准大语言模型（LLMs）通常通过单一预测分布表示不确定性，混淆了认知上的无知与真实的模糊性，导致模型可能产生流畅但错误且过度自信的答案。

Result: 在Gemma-2-9B、Llama-3.1-8B和Qwen2.5-7B模型上，使用OpenBookQA、CoQA、TriviaQA和ARC-Challenge等基准进行评估。CLLM在保持竞争力的期望校准误差（ECE）的同时，取得了最佳的问答准确率。在80%覆盖率的选择性预测任务中，CLLM结合SCC在OpenBookQA上达到99.0%的准确率，在ARC-Challenge上，结合Csem置信度的CLLM在三个骨干模型上的ECE均低于等于0.6%。

Insight: 核心创新在于通过集成LoRA适配器诱导出一个置信集合，其上下界概率揭示了预测分布的合理范围，而非坍缩为单一的softmax输出。这提供了更细粒度的不确定性量化，并由此衍生出词元空间和语义空间两种互补的承诺分数，有效区分了不同来源的不确定性，为模型的可信度评估提供了新工具。

Abstract: Large language models (LLMs) often produce fluent but incorrect answers with unwarranted confidence. A central limitation is that standard LLMs represent uncertainty through a single predictive distribution, conflating epistemic ignorance with genuine ambiguity. We introduce Credal Large Language Models (CLLMs): an ensemble of LoRA adapters induces a credal set whose lower and upper probabilities expose the spread of plausible predictive distributions rather than collapsing to a single softmax output. From this representation we derive two complementary commitment scores. Credal Token Commitment (CTC) is a token-space score that combines lower-bound support, credal width, and intersection entropy, computed without additional generation. Semantic Commitment Consistency (SCC) extends commitment to semantic space using sampled completions, with SCC-Gap measuring the mismatch between token-level and semantic-level support. We evaluate hallucination detection, calibration, selective prediction, and reasoning on Gemma-2-9B, Llama-3.1-8B, and Qwen2.5-7B across OpenBookQA, CoQA, TriviaQA, and ARC-Challenge. CLLM is the best method on QA accuracy at competitive expected calibration error, and CTC tracks the best hallucination AUROC within 1.5 pp on most settings without additional generation. On selective prediction at 80% coverage, CLLM with SCC reaches 99.0% accuracy on OpenBookQA, and on ARC-Challenge CLLM with Csem confidence achieves <= 0.6% ECE across the three backbones.

[47] EvoWiki: Incremental State Overwriting and Traceable Question Answering for Cross-Meeting Knowledge Evolution cs.CLPDF

Dongsheng Chen, Tianyu Wang, Wenhui Que

TL;DR: 本文提出了EvoWiki，一种用于处理动态长文本的增量式问答架构。该架构将离线的增量知识构建（BUILD）与在线的结构化读取（READ）解耦，通过实体版本链和细粒度的状态覆盖协议来显式建模知识的生命周期，从而在长期、多会议的协作场景中生成可追溯且基于事实的答案。

Details

Motivation: 解决在跨越多个会议的长期协作中，事实状态（如决策、风险）不断被修订、推翻和替换的问题。现有方法（如长上下文堆叠、RAG、结构化记忆）因未显式建模知识生命周期，可能导致新旧冲突状态并存或历史丢失，从而产生过时且难以验证的检索结果。

Result: 在包含新提出的CrossMeet基准在内的六个数据集和两种阅读器模型上，EvoWiki的宏观平均Judge Accuracy分别比最强基线提高了9.72和10.00个百分点。人工评估表明，在频繁状态翻转下，EvoWiki更具鲁棒性和事实忠实度。

Insight: 核心创新在于将知识构建与读取解耦，并引入显式的状态覆盖协议和实体版本链来管理知识演变，这确保了当前有效状态的清晰区分与历史溯源。其提出的确定性实体寻址和跨实体多跳聚合的读取方式，为基于事实的、可追溯的问答提供了可靠的新范式。

Abstract: In long-term collaboration spanning multiple meetings, factual states such as decisions and risks are continually revised, overturned, and replaced. Existing long-context methods typically stack the entire history, while many RAG and structured-memory methods organize knowledge as static or append-only facts and rely on semantic relevance at read time. Without explicit modeling of knowledge lifecycles, these approaches may retain conflicting old and new states simultaneously or discard history, leading to stale retrieval and answers that are difficult to verify. We present EvoWiki, an incremental question-answering architecture for dynamic long-form text. EvoWiki decouples offline incremental construction (BUILD) from online structured reading (READ). BUILD captures the intra-meeting micro-evolution from proposal to decision and uses entity version chains and a fine-grained State-Overwrite Protocol to explicitly distinguish current valid states from superseded history while preserving meeting-level provenance anchors. READ bypasses relevance-based Top-k retrieval and performs deterministic entity addressing, temporal resolution, and cross-entity multi-hop aggregation over the complete Wiki to produce grounded and traceable answers. We further introduce CrossMeet, a high-fidelity bilingual benchmark designed to simulate long-term state evolution, covering factual consistency, temporal reasoning, and cross-meeting multi-hop reasoning. Across six datasets and two reader models, EvoWiki improves macro-average Judge Accuracy over the strongest baselines by 9.72 and 10.00 percentage points, respectively. Human evaluation shows that EvoWiki is more robust and factually faithful under frequent state flips, validating valid-state-oriented reading as a reliable approach to cross-meeting knowledge evolution.

[48] Beyond the Stability-Exploration Dilemma: Environmental Regularization for LLM Policy Optimization cs.CLPDF

Xianlei Zhou, Xiangdi Meng, Yu He, Tianyu Qi, Shuyan Guan

TL;DR: 本文提出了一种名为环境正则化策略优化（ERPO）的新方法，用于解决大语言模型策略优化中稳定性与探索性之间的权衡问题。该方法通过将正则化从动作侧转移到输入侧，引入查询KL（QKL）项来约束训练查询分布的漂移，同时保留响应分布的探索能力。在六个数学推理基准测试中，ERPO替代了标准的策略KL正则化器，有效控制了查询分布漂移，实现了更高的准确性和更稳定的行为。

Details

Motivation: 大语言模型策略优化面临稳定性与探索性的权衡，当前常用的动作侧策略KL正则化器限制了响应行为并消耗了探索预算，而放弃正则化则缺乏明确的漂移控制。本文旨在打破这一困境，通过将正则化转移到输入侧来解决查询分布漂移问题。

Result: 在六个数学推理基准测试中，ERPO替代了标准策略KL正则化器，有效控制了查询分布漂移，在高温度解码和长时程训练下实现了更强的准确性和更稳定的行为。

Insight: 创新点在于将正则化从动作侧转移到输入侧，引入查询KL（QKL）项来约束查询分布漂移，同时不影响响应分布的探索梯度；该方法可无缝集成到GRPO/PPO/REINFORCE等策略优化流程中，无需额外前向传播，为策略优化提供了新的正则化思路。

Abstract: Policy optimization (PO) for Large Language Models faces a stability–exploration trade-off, currently mediated by an action-side Policy-KL regularizer. This puts practitioners in a double bind: keeping Policy-KL constrains response behavior and consumes the action-side exploration budget, while dropping it leaves the optimization without an explicit drift control. We argue for an alternative that breaks the dilemma by moving regularization to the input side. As training progresses, the distribution over training queries induced by the current policy drifts unchecked from its pre-RL reference distribution. Concretely, Environment-Regularized Policy Optimization (ERPO) introduces a Query-KL (QKL) term that bounds this query distribution shift, together with a dataset-static reference-derived per-query weight that biases each per-query update toward queries typical under the reference. The QKL gradient flows strictly through the query likelihood; the response score function used by policy-gradient estimators does not appear in the QKL term, so QKL exerts no direct gradient pressure on the response distribution—exploration is preserved. ERPO plugs into GRPO/PPO/REINFORCE-style pipelines without additional forward passes. On six mathematical reasoning benchmarks, ERPO replaces the standard Policy-KL regularizer while achieving effective control over query distribution drift, delivering stronger accuracy and substantially more stable behavior under high-temperature decoding and long-horizon training.Our source code are available at https://github.com/alibaba/ERPO

[49] What’s the Catch? Evaluating Temporal Consistency in Vision-Language Models cs.CL | cs.AI | cs.CVPDF

Marek Hradil, Danae Sánchez Villegas

TL;DR: 该论文提出了TimeCatch基准，通过将时间定位问题转化为异常检测任务，来评估视觉语言模型（VLMs）对时间一致性的理解能力。研究发现，当前VLMs能有效检测帧级异常，但在检测由帧顺序交换引起的时间异常时表现接近随机水平，远逊于人类表现。

Details

Motivation: 尽管VLMs在视频和图像序列基准测试中表现出色，但其是否真正理解时间结构尚不明确。论文旨在通过一个受控的评估框架，直接测试VLMs对时间一致性的敏感性。

Result: 在四个合成和真实世界数据集上的评估显示，VLMs在帧级异常检测和定位上表现良好，但在时间异常检测任务上表现接近随机（chance level），定位任务上仅略高于随机水平。人类则在两项任务上都接近完美表现。

Insight: 论文的核心创新点在于将时间一致性评估形式化为一个受控的异常检测问题（TimeCatch）。研究结果表明，当前VLMs擅长单帧感知，但在跨帧信息整合以进行时间推理方面存在根本性缺陷，这不能完全归因于感知能力或模型规模的限制。

Abstract: Vision-language models (VLMs) achieve strong performance on video and image-sequence benchmarks, yet it remains unclear whether they capture temporal structure. To study this question, we formulate temporal grounding as an anomaly detection problem, providing a simple and controlled evaluation that directly tests sensitivity to temporal consistency. We introduce TimeCatch, where temporal anomalies are created by swapping consecutive frames and frame-level anomalies by replacing a frame with Gaussian noise. Models are evaluated on anomaly detection and localization tasks across four synthetic and real-world datasets, alongside a human study. Our evaluation reveals a substantial gap between frame-level and temporal anomaly detection. While VLMs consistently detect frame-level anomalies and often localize them accurately, they perform near chance on temporal anomaly detection and only modestly above chance on localization. Humans, in contrast, achieve near-ceiling performance on both tasks. Additional analyses across model scales, prompting strategies, sequence lengths, and visual similarity suggest that these failures cannot be explained solely by limitations in perception or model capacity. Together, these findings indicate that current VLMs can identify anomalies within individual frames but struggle to integrate information across frames to reason about temporal consistency. TimeCatch provides a controlled benchmark for evaluating temporal grounding in vision-language models.

cs.CV [Back]

[50] EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editing cs.CV | cs.GR | cs.HC | cs.LG | cs.MMPDF

Yuqian Zhou, Zhenghong Zhou, Zongze Wu, Cameron Smith, Richard Zhang

TL;DR: EditStream是一个统一的交互式视频生成与编辑框架，它基于DiT模型，通过任务特定的条件化统一了多种视频创作任务，并采用两阶段蒸馏方法将其转化为快速、少步的自回归模型，以实现高效流式处理。

Details

Motivation: 为了解决交互式视频生成与编辑在创意设计中的需求，并克服现有方法在任务统一、生成质量和实时性方面的挑战。

Result: 未在摘要中明确提及具体定量结果或基准测试，但宣称通过两阶段蒸馏方法缓解了少步自回归视频生成中的过饱和、运动退化、时间不稳定性和训练复杂性等问题，实现了高质量与交互性的平衡。

Insight: 创新点在于将多种视频任务统一到单一DiT模型中，并通过结合速度矩匹配和自回归展开的两阶段蒸馏方法，在保持生成质量的同时提升了时间稳定性和效率，为交互式创意工作流提供了可扩展的解决方案。

Abstract: Interactive video generation and editing are becoming increasingly important for creative design. In this report, we introduce EditStream: a unified framework for interactive video generation and editing. EditStream unifies multiple video creation and manipulation tasks within a single DiT-based model through flexible task-specific conditioning, and further transforms it into a fast, few-step autoregressive model for efficient streaming. It supports Text-to-Video, Image-to-Video, Video-to-Video, Editing Propagation, Reference-guided Video Editing, and Camera Pose Change, enabling flexible control over video generation, transformation, and editing within one system. To make the unified model practical for interactive use, we develop a two-stage distillation approach that combines Velocity Moment Matching (VMM) with autoregressive unrolling. VMM matches conditional velocity moments at student-reached intermediate states to preserve generation quality and motion, while unrolling exposes the student to its own autoregressive predictions to improve temporal stability. Together, they alleviate common challenges in few-step autoregressive video generation, including over-saturation, degraded motion, temporal instability, and complex training. EditStream provides a practical and scalable solution that bridges high-quality diffusion-based video models with interactive creative workflows.

[51] Aligning Human Sense: Calibrated Distributional Reward Learning for Video Generation cs.CV | cs.AIPDF

Nai-Xin Zhai, Weihua Cheng, Dexu Yu, Yikai Gu, Hanwen Du

TL;DR: 本文提出了一种用于视频生成的统一偏好感知学习框架，旨在解决奖励信号可靠性、多维度偏好压缩以及策略优化全局约束不足三大挑战。该框架通过精英引导过滤校准偏好数据，采用多维奖励分布建模视频质量以捕捉人类偏好的不确定性，并将基于Wasserstein距离的分布对齐引入GRPO策略优化，从而提升奖励信号的可靠性和生成视频的感知一致性。

Details

Motivation: 现有视频生成方法在视觉质量上虽有显著进步，但在与人类偏好对齐方面仍面临三大挑战：人类偏好数据存在主观噪声和偏差导致奖励信号不可靠；标准标量奖励模型将多维度偏好压缩为单一值，丢失了动态权衡信息；KL散度等策略优化约束主要关注局部，难以捕捉人类偏好的全局结构。

Result: 在奖励建模和视频生成实验上，该方法提升了奖励信号的可靠性，并改善了生成视频的感知一致性。

Insight: 创新点包括：1）精英引导过滤机制用于校准偏好数据，提升监督信号质量；2）将视频质量建模为多维奖励分布，以Wasserstein距离对齐学习分布与经验偏好分布，更好地捕捉偏好不确定性；3）将Wasserstein分布对齐引入GRPO，使策略优化能匹配人类偏好的全局结构，而非仅局部约束。

Abstract: Video generation is central to AI-powered content creation. Aligning generated videos with human preferences is a key criterion for evaluating generation quality. Despite significant progress in visual quality, three key challenges remain. First, the reliability of reward signals is constrained by the quality of human preference data, which is often affected by subjective noise and bias. Second, standard scalar reward models collapse multi-aspect human preferences into a single value, leading to the loss of dynamic trade-offs across multiple preference dimensions. Third, in policy optimization, the widely adopted KL divergence imposes primarily local constraints and may fail to capture the global structure of human preferences. To address these challenges, we propose a unified preference-aware learning framework for video generation. First, we introduce elite-guided filtering to calibrate preference data and construct reliable supervision for reward model training. We then model video quality as a multidimensional reward distribution to capture the uncertainty inherent in human preferences, and use the Wasserstein distance to align the learned reward distribution with the empirical human preference distribution. Finally, we introduce Wasserstein-based distributional alignment into GRPO, guiding policy optimization to better match the global structure of human preferences over videos. Experiments on reward modeling and video generation demonstrate that our approach improves the reliability of reward signals and the perceptual consistency of generated videos. Our code is available at https://github.com/alignhs26/ahs.

[52] Boosting Knowledge-based Visual Question Answering with Structured Context Reasoning cs.CV | cs.MMPDF

Qiyou Liu, Yong Zhang, Jianjie Luo, Zhenguo Yang, Yi Yu

TL;DR: 本文提出了一种基于大语言模型的结构化上下文推理（SCoRe）框架，用于提升知识型视觉问答（VQA）的性能。该框架通过三个阶段——上下文获取、上下文选择和上下文压缩——将异构的视觉描述和检索知识转化为结构化的实体-关系三元组，以此作为简洁的提示来指导最终答案预测。

Details

Motivation: 现有方法通常通过上下文学习，以零样本或少样本方式将多模态上下文直接拼接为长而无结构的提示输入大语言模型，这常因包含过多无关上下文且缺乏显式关系结构而导致推理性能下降。

Result: 在OK-VQA和A-OKVQA基准测试上的大量实验表明，SCoRe框架持续优于最先进的方法。

Insight: 创新点在于提出了一个系统性的结构化上下文推理框架，特别是其中的关系逻辑蒸馏（RLD）步骤，能将原始文本压缩为显式的实体-关系三元组，从而提供更简洁、结构化且富含关系的提示，以增强大语言模型的推理能力。

Abstract: Knowledge-based Visual Question Answering aims to answer questions about an image by integrating external knowledge with visual and textual information. Recent approaches often rely on in-context learning to prompt Large Language Models (LLMs) with multimodal context in a zero-shot or few-shot manner. However, we observe that directly concatenating heterogeneous visual descriptions and retrieved knowledge into long, unstructured prompts often degrades reasoning performance, due to both excessive irrelevant context and the lack of explicit relational structure. In this paper, we propose an LLM-based Structured Context Reasoning (SCoRe) framework that infers both explicit and implicit relationships for prediction. SCoRe consists of three stages: Context Acquisition, which generates diverse visual notes and retrieves explicit knowledge via an efficient two-stage multimodal retrieval strategy; Context Selection, which filters relevant visual, explicit, and implicit knowledge using LLM-guided selection; and Context Compression, which performs Relational Logic Distillation (RLD) to transform raw text into explicit entity-relation triplets. These relational triplets serve as a concise and structured prompt for final answer prediction. Extensive experiments on the OK-VQA and A-OKVQA benchmarks demonstrate that SCoRe consistently outperforms state-of-the-art methods.

[53] DesignAgent3D: Interactive 3D Scene Editing via Designer-like Multimodal Reasoning cs.CV | cs.MAPDF

Xiujin Liu, Tianyu Yang, Yilun Zhao, Xiangliang Zhang

TL;DR: 本文提出了DesignAgent3D，一个交互式多模态智能体框架，用于解决文本引导的3D场景编辑中语义模糊和空间定位不准的问题。它将编辑任务重构为类似设计师的‘规划-感知-执行’范式，通过与用户交互澄清意图、在场景中精准定位目标，并执行可控的视觉修改，最终将编辑结果集成到3D表示中，支持多视角一致的新视图渲染。

Details

Motivation: 现有基于单次提示的文本引导3D场景编辑方法难以处理语义模糊的用户意图，也无法实现精确的空间定位，导致物体定位漂移、遮挡下跟踪失败以及多视角‘贴纸效应’等问题。

Result: 在NeRF和3D高斯泼溅两种3D表示骨干网络上进行的广泛实验表明，DesignAgent3D显著优于现有最先进的基线方法，在语义意图对齐、空间定位精度和多视角一致性方面均表现出色。

Insight: 核心创新在于将3D编辑任务从单次条件生成范式，转变为交互式、多模态的智能体范式（Plan-Perceive-Act），通过迭代交互解决意图模糊问题，并确保编辑结果在底层3D表示中的持久性和一致性，这为需要精确空间控制的3D内容创作提供了新思路。

Abstract: Text guided 3D scene editing provides an intuitive interface for modifying reconstructed environments, but remains difficult because natural language design requests are often semantically underspecified and must be grounded in cluttered 3D scenes. Existing methods typically formulate the task as one-shot conditional generation from a single prompt, failing to resolve ambiguous user intents or achieve precise spatial grounding. Consequently, they suffer from severe object localization drift, tracking failure under occlusions, and the notorious multi-view “sticker effect.” To overcome these limitations, we present DesignAgent3D, an interactive multimodal agentic framework that reformulates 3D scene editing as a designer-like Plan-Perceive-Act paradigm. The agent first plans by interacting with the user to clarify underspecified design goals, then perceives by grounding the intended edit to specific objects or regions in the 3D scene, and finally acts by applying controlled visual modifications while preserving scene consistency. The edits are further integrated into the underlying 3D representation, supporting persistent and multi-view consistent novel-view rendering. Extensive experiments across both NeRF and 3D Gaussian Splatting backbones demonstrate that DesignAgent3D significantly outperforms state-of-the-art baselines, delivering superior semantic intent alignment, impeccable spatial localization accuracy, and high-fidelity multi-view consistency.

[54] WorldMind: Decoupled Game World Model for State-Aware NPC Behavior cs.CVPDF

Zhiyang Deng, Boran Zhang, Danze Chen, Yeying Jin

TL;DR: WorldMind提出了一种解耦的游戏世界模型框架，用于生成状态感知的非玩家角色（NPC）行为。该框架将交互式世界建模分为理解层、决策层、控制层和生成层四个层次，通过闭环交互将NPC行为建立在不断演变的游戏状态之上。论文还引入了BOSS-140K数据集，实验表明WorldMind在紧凑状态重建和基于游戏机制的规划方面表现可靠，在成对比较中约70%的情况下因其更具战术合理性和连贯性的NPC行为而被优先选择。

Details

Motivation: 现有游戏世界模型中的NPC行为要么与视频生成隐式纠缠，要么通过外部控制信号显式规定，导致模型需要同时理解状态、规划NPC响应并渲染视觉结果，限制了其生成响应式和状态感知NPC行为的能力。核心挑战在于缺乏一个用于基于状态决策的显式接口。

Result: 在BOSS-140K数据集上的实验表明，WorldMind能够可靠地进行紧凑状态重建和基于游戏机制的规划。在成对比较中，约70%的情况下WorldMind因其更具战术合理性和连贯性的NPC行为而被优先于基线模型。

Insight: 创新点在于首次提出了一个解耦的、用于状态感知NPC行为的框架，通过分层（理解、决策、控制、生成）和闭环交互，将NPC行为明确地建立在游戏状态之上。这为解决游戏世界模型中NPC行为与状态脱节的问题提供了新的架构思路，并配套发布了大规模带内部状态标注的数据集BOSS-140K以支持相关研究。

Abstract: Game world models have recently demonstrated promising capabilities in generating visually coherent and action-controllable gameplay videos. However, non-player character (NPC) behavior in existing models is either implicitly entangled with video generation or explicitly prescribed through external control signals. Consequently, a game world model has to jointly understand the state, plan the NPC’s response and render its visual outcome, limiting its ability to produce responsive and state-aware NPC behavior. The challenge lies in the lack of an explicit interface for state-grounded decision-making. To this end, we introduce WorldMind, to our knowledge the first decoupled framework for state-aware NPC behavior in game world models. WorldMind separates interactive world modeling into four layers: an Understanding Layer that constructs a compact state from generated frames; a Decision Layer that reasons over the compact state to plan the NPC’s next action; a Control Layer that translates the actions into temporally aligned conditions; and a Generation Layer that synthesizes their visual outcomes. By reconnecting layers in a closed interaction loop, WorldMind grounds NPC behavior in the evolving game state. We further introduce BOSS-140K, a dataset of gameplay videos paired with rich internal game states, together with an agent that automates the collection at scale. Experiments on BOSS-140K demonstrate reliable compact state reconstruction and mechanics-grounded planning, with WorldMind preferred over the baselines in approximately 70% of pairwise comparisons for its more tactically appropriate and coherent NPC behavior. Project page: https://teawhite.cn/worldmind_projectpage/

[55] Text-Guided Visual Dependency Graph Learning with Cross-Modal Attention Priors cs.CVPDF

Fei Wang, Yutong Zhang, Yang Ye, Jinxian Chen, Wang Wenshuai

TL;DR: 本文提出了一种名为CM-GLasso的跨模态图套索框架，用于从视觉-语言特征中学习可解释的条件依赖结构。该方法通过文本可视化、跨注意力蒸馏和联合ADMM优化，构建稀疏高斯图模型，支持无需参数的分类和轻量级分割。在八个基准测试中，该方法在分类和分割任务上取得了具有竞争力的性能。

Details

Motivation: 解决从多模态视觉-语言特征中估计可解释的条件依赖结构这一尚未充分探索的问题，旨在桥接视觉-语言表示学习与稀疏图模型。

Result: 在匹配控制协议下，在八个基准测试中取得竞争性或更优性能，获得了最高的平均分类准确率（91.97%）以及在VOC（74.75% mIoU）和ADE20K（64.01% mIoU）分割任务上基线中最高的mIoU。

Insight: 创新点包括：将类别属性描述渲染为图像以获取共享特征空间中的注意力足迹；通过跨注意力蒸馏生成用于非均匀L1惩罚的跨模态结构先验；以及联合ADMM公式在单一凸目标中估计共享和类别特定的精度矩阵，避免了先估计后分解的步骤。

Abstract: Estimating interpretable conditional-dependence structures from multimodal visual-linguistic features remains largely unexplored. We propose CM-GLasso (Cross-Modal Graphical Lasso), a framework that bridges vision-language representation learning and sparse Gaussian Graphical Models. CM-GLasso introduces three key components: (i) a text visualization strategy that renders class-attribute descriptions as images and processes them through the same SigLIP-2 vision encoder as natural images, yielding prototype-indexed patch-level attention footprints in a shared feature coordinate system; (ii) a cross-attention distillation mechanism that condenses high-dimensional patches into a small set of semantic graph nodes, whose attention-footprint similarities yield cross-modal structural priors for non-uniform L1 penalization; (iii) a joint ADMM formulation that estimates shared and class-specific precision components within a single convex objective, avoiding the need to first estimate and then decompose separate class-wise graphs. The learned sparse graph topologies directly support a parameter-free, precision-based classification rule and a lightweight topology-aware segmentation head. Extensive experiments on eight benchmarks demonstrate that CM-GLasso achieves competitive or superior performance compared with strong feature-based and task-specific baselines. Under the matched controlled protocol, it attains the highest average classification accuracy (91.97%) and the highest segmentation mIoU among the controlled baselines on VOC (74.75%) and ADE20K (64.01%), while also yielding explicit sparse conditional-dependence graphs with common-specific decomposition.

[56] ViTexSZ: Heterogeneous Vision-Text Knowledge Distillation for EEG Seizure Detection cs.CVPDF

Chenxi Liu, Mingzhao Li, Yicong Liu, Hao Miao, Hongyuan Zhang

TL;DR: ViTexSZ是一个用于EEG癫痫检测的异构视觉-文本知识蒸馏框架。它将EEG记录转换为结构化波形图像，通过基于查询的多通道对齐模块将视觉特征映射到统一的标记空间，并利用多模态大语言模型整合临床语义，最后通过知识蒸馏将教师模型表示转移到轻量级学生模型。

Details

Motivation: 现有时间序列方法通常针对固定的EEG通道配置设计，难以适应通道布局不规则的异构EEG记录，且将异构EEG表示与临床语义对齐具有挑战性。

Result: 在四个EEG癫痫数据集上的实验表明，ViTexSZ在亚临床和一般癫痫检测场景中均具有良好泛化性，在所有数据集上达到最高准确率，相比次优基线相对提升最高达12.9%。

Insight: 创新点包括将EEG转换为结构化图像、基于查询的多通道对齐模块实现异构数据统一表示，以及通过多模态大语言模型整合临床语义进行知识蒸馏，为异构生物信号处理提供了新思路。

Abstract: Automated seizure detection from electroencephalography (EEG) is essential for continuous neurological monitoring, particularly for subclinical epileptic seizures that may exhibit only subtle electrographic changes. Existing time-series methods are often designed for fixed EEG channel configurations, thereby limiting their applicability to heterogeneous EEG recordings with irregular channel layouts. Although visual and language modeling offer promising alternatives, aligning heterogeneous EEG representations with clinical semantics remains challenging. We introduce ViTexSZ, a heterogeneous Vision-Text knowledge distillation framework for EEG seizure detection. ViTexSZ converts EEG recordings into structured waveform images and introduces a query-based multi-channel alignment module that maps source-dependent visual features into a unified token space. A heterogeneous teacher further integrates the aligned EEG representations with clinical prompts through a multimodal large language model, associating high-level clinical semantics with seizure-related evidence. Vision-text knowledge distillation then transfers the teacher representations to a lightweight student during detection. Experiments on four EEG seizure datasets demonstrate the generalizability of ViTexSZ across both subclinical and general seizure detection scenarios, achieving the highest accuracy on all datasets and relative improvements of up to 12.9% over the second-best baselines, showing its effectiveness.

[57] BIMScript: Material-Aware Structured Scene Programs for BIM Ingestion cs.CVPDF

Prakash Kondibhau Naikade, Thomas B. Moeslund, Andreas Møgelmose

TL;DR: BIMScript提出了一种结构化语言模型，用于将建筑场景重建为参数化命令程序，支持建筑信息模型（BIM）工具的自动化导入。该方法通过扩展语法包含材料和条件属性、优化解码速度、提高几何精度，并实现了与Revit工具的直接集成和IFC4导出。

Details

Motivation: 解决现有结构化场景模型在自动化BIM导入应用中的三个关键问题：场景构成（材料与条件）、生成速度以及元素精确定位，以提升建筑扫描数据的语义编辑性和实用性。

Result: 在合成扫描数据上验证：材料属性通过构建的10万合成场景（190万伪标注元素）数据集监督；解码速度通过CUDA图解码和草稿-验证方案提升3.4倍（1.9毫秒/步）；几何精度通过训练无关的几何吸附和混合解码头减少残差。

Insight: 创新点包括：引入材料感知的扩展语法和视觉-语言模型监督；利用硬件优化和确定性模式加速自回归解码；结合离散-连续解码提升几何精度；实现与BIM工具的原生对象映射，支持LLM驱动的可持续性推理。

Abstract: Structured-language models such as SceneScript reconstruct a scene as a short program of parametric commands, an inherently editable and semantically explicit representation. We ask three questions that stand between such models and their most compelling application, automated ingestion of existing buildings into BIM tools, studied here on synthetic scans: \emph{what} is the scene made of, \emph{how fast} can it be produced, and \emph{exactly where} is each element. BIMScript answers all three within one grammar. First, we extend the layout language with per-element \emph{material} and \emph{condition} attributes, supervised by a vision-language-model material-passport corpus we build over 100k synthetic scenes (1.9M pseudo-labeled elements), and route image appearance to the material tokens through a lifted-feature point encoder. Second, we show that autoregressive decoding of these programs is dominated not by compute but by kernel-launch and host-synchronization overhead, and remove it with an output-exact CUDA-graph decoder (1.9 vs 6.4,ms/step, $3.4\times$) plus a grammar-parallel, tolerance-verified draft-and-verify scheme that exploits the deterministic entity schema. Third, we address the model’s 5cm token-grid granularity with training-free geometric snapping and a hybrid discrete–continuous decoder head that regresses a sub-bin offset, and measure how much of the residual error each recovers. Because each command maps one-to-one onto a native Revit object, we validate direct ingestion into a BIM authoring tool end to end with a working add-in and its IFC4 export, and the same program’s language form is designed to support LLM-driven, sustainability-aware reasoning over the built asset.

[58] Beyond Visual Similarity: Entity-Aligned Retrieval for Knowledge-Based Visual Question Answering cs.CVPDF

Hangrui Xu, Zhengxian Wu, Yunyao Yu, Zhuohong Chen, Rui Cong

TL;DR: 该论文提出了KBMR，一种基于多模态大语言模型（MLLM）的嵌入检索器，专门用于知识库视觉问答（KB-VQA）。该方法旨在解决传统CLIP式双编码器在检索时过度依赖表层视觉相似性、而忽略实体级语义对齐的问题。通过利用MLLM的自回归能力将图像映射到更好的语义空间，并引入基于MLLM的语义判别器生成连续实体一致性权重进行软监督，从而显著提升了检索和VQA性能。

Details

Motivation: 现有KB-VQA检索流程主要依赖CLIP式双编码器，其优先考虑表层视觉相似性而非实体级语义对齐，导致在语义相同但视觉差异大、或不同实体视觉相似的情况下检索失败。

Result: 大量实验表明，KBMR显著优于CLIP基线，在检索Recall@1上最高提升14.7%，在端到端VQA准确率上提升9.4%。

Insight: 创新点在于首次提出基于MLLM的嵌入检索器用于KB-VQA，并设计了基于MLLM的语义判别器来生成连续实体一致性权重，通过新颖的连续语义蒸馏目标实现有效的难负样本采样和超越刚性二值标签的软监督，从而更好地实现实体对齐。

Abstract: Knowledge-Based Visual Question Answering (KB-VQA) relies on retrieving external information to answer queries involving long-tail entities. However, existing retrieval pipelines predominantly employ CLIP-style dual encoders, which prioritize surface-level visual similarity over entity-level semantic alignment. This paradigm often fails when semantically identical concepts exhibit large visual variations or when distinct entities appear visually similar. To address this, we propose KBMR, the first MLLM-based embedding retriever tailored for KB-VQA. Leveraging the robust autoregressive capabilities of MLLMs, KBMR maps images into a semantic space that better preserves concept identity. To tackle the challenge of noisy supervision in Wikipedia-scale retrieval, we introduce an MLLM-based semantic discriminator that generates continuous entity-consistency weights. These weights guide a novel continuous semantic distillation objective, enabling effective hard negative sampling and soft supervision beyond rigid binary labels. Extensive experiments demonstrate that KBMR significantly outperforms CLIP baselines, yielding up to a 14.7% improvement in retrieval Recall@1 and a 9.4% gain in end-to-end VQA accuracy. Code is available at https://github.com/realHarryX/KBMR.

[59] FigmaTrace: Capturing Creative Nuances in Human Figma Design Workflows cs.CV | cs.AIPDF

Darshan Deshpande, Yoshinari Fujinuma, Martyna Markiewicz, Devanshu Bansal, Shivani Jain

TL;DR: 本文介绍了FigmaTrace数据集，该数据集通过专家定义的设计技能分类和126项开放式主观任务，收集了超过200小时的人类Figma设计工作流程视频，并转换为3469个设计轨迹。基于此数据集训练的模型在四个分布外GUI环境中取得了与前沿闭源模型相当的性能提升。

Details

Motivation: 当前视觉语言模型在客观可验证领域表现良好，但在主观创造性设计任务上仍存在性能差距，主要原因是缺乏高质量、能捕捉人类专家多样化偏好和决策的工作流程数据。

Result: 在四个分布外GUI环境中，基于FigmaTrace训练的模型性能提升与Claude-Opus-5和GPT-5.6-Sol等前沿闭源模型相当；基于设计阶段的视频到轨迹转换方法优于先前的基于长度的方法。

Insight: 提出了一个基于设计阶段（而非简单长度）的视频到轨迹转换方法，能更好地捕捉设计工作流中的创意细微差别；构建了一个包含专家分类和主观长时任务的高质量设计工作流程数据集，有助于提升模型在创造性任务上的表现。

Abstract: Vision Language Models have recently shown improvements in several objective and verifiable domains such as object detection but continue to underperform on subjective and creative design tasks. A major contributor to this performance gap is the lack of high quality human workflow data that captures a diverse set of preferences and decisions that make human experts good at design tasks. In this work, we first define a unique, expert curated taxonomy of design skills and best practices which we further expand into a set of 126 open ended, subjective, long horizon tasks. Built on top of this and expert solutions, our dataset FigmaTrace contains over 200 hours of human captured video data converted into 3469 design trajectories using a novel design phase-based method. We use our dataset to train four models and show that training on FigmaTrace leads to a performance improvement comparable to frontier closed models such as \textsc{Claude-Opus-5} and \textsc{GPT-5.6-Sol} on four out of distribution agentic GUI environments. We further perform a useful ablation to attribute these performance improvements to a design phase-based video to trajectory conversion which outperforms prior length-based conversion approaches. Finally, we perform a qualitative analysis on the best performing \textsc{Qwen3.8-27B} outputs to better correlate performance improvements to FigmaTrace’s trends. We open source our dataset and the best model for the community.

[60] EXPL-FR: Explaining Face Recognition Models via Vision-Language Alignment cs.CVPDF

Guray Ozgur, Mustafa Efe Tamyapar, Naser Damer, Fadi Boutros

TL;DR: EXPL-FR 是一种解释深度人脸识别模型的方法，通过在模型自身的嵌入空间中引入视觉-语言模型，将语义属性与相似度分数关联起来，从而提供可解释性。该方法无需访问模型架构，支持身份级、图像级和差异化的解释，并在无监督条件下实现了对模型行为的有效审计。

Details

Motivation: 解决深度人脸识别模型虽然准确率高但缺乏可解释性的问题，即无法理解相似度分数依赖于哪些语义属性，旨在提供一种无需标签或模型内部访问的解释框架。

Result: 在四个FR主干网络和两个VLM编码器上验证，通过无标签的提示驱动审计，能够准确排名不同FR模型在RFW数据集上的每种族群错误率，并评估属性变化对验证成本的影响，优于基于人工标签或VLM伪标签的现有方法。

Insight: 创新点在于将VLM与冻结的FR空间对齐，通过轻量级适配器实现语义属性的可检测性度量，从而提取模型的可读语义签名；客观来看，该方法避免了依赖标注数据，实现了完全基于提示的模型行为分析，提升了可解释性的通用性和效率。

Abstract: Deep face recognition (FR) models reach near-saturated accuracy but remain opaque: a practitioner cannot ask which semantic attributes a similarity score relied upon. EXPL-FR answers this inside the FR model’s own embedding space. A lightweight adapter aligns a vision-language model’s (VLM) image encoder with the frozen FR space, trained on face images alone and never on text. Because the VLM’s encoders share one space, the same adapter applies to the text encoder, turning 978 attribute prompts in 22 categories, also extendable, into FR-space anchors at no extra cost. We do not assume this transfer works: a face-verification protocol measures it, and an ablation changing only the adapter isolates its contribution. Not every concept survives, because an FR model earns its invariances by discarding the factors it must verify identities across. A label-free detectability measure compares each concept’s separability in FR space against the VLM space, and the 100 most detectable form the model’s readable semantic signature, which separates identities better than the full vocabulary. We cover four FR backbones and two VLM encoders, EXPL-FR needs no architecture access, and supports identity-level, per-image, and differential explanations. We benchmark attribute-level auditing under three supervision settings, human labels (current practice), VLM pseudo-labels, and our fully prompt-driven audit, against real verification behavior. With no labels, the prompt-driven audit ranks four FR models by their measured per-ethnicity RFW errors and ranks controlled attribute changes by their true verification cost.

[61] TASSO: TAsk-Specific Subspace Optimization for Continual Learning of Vision-Language Models cs.CV | cs.AIPDF

Chang Sun, Francesco Barbato, Matteo Caligiuri, Pietro Zanuttigh

TL;DR: 本文提出TASSO方法，用于解决视觉语言模型在持续学习中的灾难性遗忘和零样本能力退化问题。该方法通过任务特定的子空间学习和几何感知知识蒸馏，有效保持了潜在空间的几何结构，同时确保了网络的可塑性。

Details

Motivation: 视觉语言模型虽具有强大的零样本能力，但在持续适应不同任务时，会同时出现灾难性遗忘和零样本能力退化，导致性能严重下降。

Result: 在多领域任务增量学习和类增量学习基准测试中，基于CLIP模型的实验结果表明，TASSO在缓解遗忘和保持零样本能力方面明显优于现有最先进方法。

Insight: 创新点在于结合了任务特定的低秩投影器优化和基于测地距离的知识蒸馏损失，这避免了在全嵌入维度上进行不必要的参数更新，并通过关注任务特定的流形来改进学习，同时提供了强正则化。

Abstract: Vision-Language Models (VLMs) exhibit strong zero-shot capabilities, making them an attractive solution for continual learning across diverse tasks. However, during continual adaptation, both catastrophic forgetting and zero-shot degradation occur, severely degrading performance. In this paper, we introduce TASSO, a new paradigm that efficiently preserves the latent space geometry while ensuring network plasticity. We achieve this with two complementary techniques: subspace learning and geometry-aware knowledge distillation. Specifically, we first learn a sequence of task-specific low-rank projectors, which we use to project the latent representations before optimizing cross-entropy. Secondly, we employ a geodesic-distance-based loss that distills knowledge from the previous-task model while effectively preserving the latent space geometry. These design choices not only avoid unnecessary parameter updates along the full embedding dimensions but also improve learning by focusing on task-specific manifolds. Moreover, the geometry-aware distillation provides strong regularization and significantly reduces both catastrophic forgetting and zero-shot degradation throughout the continual learning sequence. Experimental results with the CLIP vision language model in the multi-domain task incremental and class incremental learning benchmarks demonstrate clear improvements over state-of-the-art methods in mitigating forgetting and preserving zero-shot capabilities.

[62] DamageScope: Vision-Language Retrieval at Scale for Disaster Damage Assessment from Satellite Imagery cs.CV | cs.CL | cs.IRPDF

Ravi K. Rajendran, Biplob Debnath, Murugan Sankaradas, Srimat T. Chakradhar

TL;DR: DamageScope是一个用于卫星图像灾害损害评估的检索增强框架，结合了视觉语言模型（VLM）和大语言模型（LLM），通过自然语言查询自动化分析财产损害。该框架采用检索增强生成（RAG）架构，并引入了多向量嵌入聚类算法和双存储数据架构，以提升可扩展性和运行效率。

Details

Motivation: 传统现场灾害损害评估方法劳动密集、成本高且存在安全风险，而现有基于卫星图像和视觉语言模型的大规模评估方案在计算效率、数据组织和信息检索方面面临挑战。

Result: 论文提出的多向量嵌入聚类算法在性能上优于传统单向量嵌入方法，并将索引时间减少了高达14倍；双存储数据架构将LLM API调用和相关成本与延迟降低了约3倍。

Insight: 核心创新在于将RAG框架应用于卫星图像损害评估领域，并设计了针对大规模地球观测管道优化的多向量嵌入聚类算法和双存储架构，有效平衡了可扩展性与运行效率。

Abstract: Timely and accurate assessment of property damage is critical following natural disasters. Traditional on-site inspections are labor-intensive, costly, and often pose safety risks. Advances in satellite imagery and vision-language models (VLMs) enable scalable remote damage assessment; however, integrating VLMs into large-scale Earth observation pipelines presents challenges in computational efficiency, data organization, and information retrieval. To address these challenges, we present DamageScope, a retrieval-augmented framework that combines satellite imagery with Vision-Language Models (VLMs) and Large Language Models (LLMs) to automate property damage analysis. Built on a Retrieval-Augmented Generation (RAG) framework, DamageScope extracts structured visual representations from satellite imagery to support interactive natural language queries for damage assessment. To address scalability, we introduce a novel multi-vector embedding-based clustering algorithm that outperforms traditional single-vector embedding approaches while reducing indexing time by up to 14x. Furthermore, a dual-store data architecture minimizes LLM API calls, reducing both operational cost and response latency by up to approximately 3x. By effectively balancing scalability and operational efficiency, DamageScope provides a robust and practical solution for real-world damage assessment tasks.

[63] presto: Efficient, Training-free, and Open-world Object Placement via Imaginary Search cs.CV | cs.AIPDF

Weixuan Ding, Shang Liu, Hanyu Pei, Zeyan Liu

TL;DR: 该论文提出了一个名为Presto的高效、无需训练且适用于开放世界的物体放置框架。它将物体放置问题重新定义为由多模态大语言模型（MLLM）推理引导的启发式搜索任务，通过在一个假想的动作空间中迭代优化物体的位置和尺度来实现。

Details

Motivation: 现有物体放置方法通常依赖手工规则或在有限数据集上的监督学习，这限制了它们在涉及新物体和新场景的开放世界中的泛化能力和可解释性。

Result: 在多个基准测试上的实验表明，Presto实现了最先进的性能，尤其是在未见过的开放世界场景中。人类研究进一步表明，其MLLM作为评判者的变体比基于度量的方法能产生更具感知一致性的放置结果。

Insight: 核心创新在于将物体放置重新定义为MLLM引导的零样本启发式搜索问题，并提出了一个从粗到精的搜索策略。一个重要的见解是揭示了标准评估指标与人类视觉判断之间存在差距，而MLLM的推理能力可以更好地弥合这一差距。

Abstract: Object placement is critical in image composition, requiring spatially and semantically coherent positioning of objects within diverse scenes. Existing approaches typically rely on hand-crafted rules or supervised learning on limited datasets, which restricts their generalization and interpretability, especially in open-world scenarios involving novel objects and scenes. In this work, we reformulate open-world object placement as a heuristic search task guided by reasoning from a Multimodal Large Language Model (MLLM). We introduce \textsf{presto}, a zero-shot, training-free framework that operates within an imaginary action space to iteratively refine object position and scale. Our coarse-to-fine search strategy ensures fast convergence, and we evaluate two decision-making variants: Metric-guided Selection and MLLM-as-a-judge. Experiments across multiple benchmarks show that \textsf{presto}~achieves state-of-the-art performance, particularly in previously unseen, open-world settings. Human studies further reveal that the MLLM-as-a-judge variant produces more perceptually coherent placements than metric-driven approaches, highlighting a gap between standard evaluation metrics and human visual judgment.

[64] Perturb the Thought, Not the Pixels: Latent-Space Rollout Diversification for Reinforcement Learning of Vision-Language Models cs.CVPDF

Michael Jerge, Joseph Pelczar, Justin Downes

TL;DR: 本文提出了一种名为噪声对比GRPO（NC-GRPO）的新方法，用于增强视觉语言模型在强化学习中的推理能力。该方法通过在模型潜在空间的最后一个隐藏层注入校准的高斯噪声来多样化rollout轨迹，而不是在像素空间或通过解码温度进行扰动。实验表明，该方法在多个数学推理基准测试上显著提升了模型的泛化性能和抗幻觉鲁棒性。

Details

Motivation: 现有方法通过解码温度或像素空间图像扭曲来多样化强化学习中的rollout轨迹，作者质疑扰动是否应置于模型的潜在空间而非输入空间，旨在探索更有效的轨迹多样化机制以提升模型推理能力。

Result: 在基于Qwen2.5-VL-7B模型和Geometry3K数据集的训练中，NC-GRPO相比原始GRPO，在五个域外数学推理基准测试上取得了显著提升（汇总McNemar检验p≤0.001），同时提高了域内准确性和抗幻觉鲁棒性。

Insight: 核心创新点在于将扰动从输入像素空间转移到模型潜在空间，通过注入校准噪声来创建多样化的推理分支，从而将模型在分支点对扰动的敏感性转化为策略梯度信号。机制消融实验表明，独立的随机多样性是有效成分，而非噪声预算或方向，且噪声尺度可在推理专业化和通用能力之间进行权衡。

Abstract: Reinforcement learning with verifiable rewards (RLVR) improves the reasoning ability of vision-language models (VLMs), and diversifying the rollouts within each optimization group amplifies its gains. Existing approaches diversify through decoding temperature or pixel-space image distortion; we ask whether the perturbation belongs in the model’s latent space instead. We introduce Noise-Contrastive GRPO (NC-GRPO), which injects scale-calibrated Gaussian noise into the last hidden layer of the prompt-encoding pass for half of each rollout group, branching those rollouts from a displaced departure state. Branches that reach the answer despite the displacement are reinforced over those derailed by it, converting sensitivity at the branch point into policy-gradient signal; the objective, reward, and inference protocol are untouched. On Qwen2.5-VL-7B trained on Geometry3K, NC-GRPO significantly improves out-of-domain mathematical reasoning over vanilla GRPO across five held-out benchmarks (pooled McNemar $p \le 0.001$) while also improving in-domain accuracy and hallucination robustness – the latter an axis on which image-space noise regresses even while posting a larger OOD average on perception-heavy benchmarks. Mechanism ablations indicate that independent stochastic diversity, not noise budget or direction, is the active ingredient, and a noise-scale study exposes a dial between reasoning specialization and general capability. NC-GRPO is designed to be modality-agnostic and integrates into a standard RLVR pipeline as a ~50-line change to the inference engine.

[65] Extending the Horizon of Early Diagnosis: Lung Cancer Prediction with Vision Transformers cs.CVPDF

Olivera Kotevska, Ian Goethert, Michael McGee, Maria Mahbub, Sean R. Wilkinson

TL;DR: 本研究评估了视觉变换器（ViTs）在临床诊断前1-2年利用胸部X光片预测肺癌的潜力。通过分析超过25万张X光图像，并采用混合欠采样/过采样和类别加权损失优化处理极端类别不平衡问题，研究发现基于ImageNet预训练的ViT模型性能最稳定，其AUC和平衡准确率相比从头训练的基线模型有显著提升。

Details

Motivation: 肺癌是全球癌症相关死亡的主要原因，早期诊断对提高生存率至关重要，但早期恶性肿瘤在胸部X光片上表现细微，给放射科医生带来挑战。

Result: 在极端类别不平衡（约1:150）的数据集上，预训练模型（ImageNet和Corona预训练）的AUC比从头训练的基线模型高出6-10个百分点，平衡准确率高出约10-12%。ImageNet预训练模型整体性能最稳定，而Corona预训练模型在某些设置下灵敏度更高但变异性更大。适度的重采样策略（如1:1欠采样和1.5:2过采样）在灵敏度、精确度和计算效率之间取得了良好平衡，运行时间减少高达70%且性能损失不大。

Insight: 论文的创新点在于将ViTs应用于临床诊断前1-2年的早期肺癌风险预测，并系统性地处理了极端类别不平衡问题，通过混合采样和损失优化策略提升了模型性能。客观来看，其对比不同预训练策略（ImageNet vs. 特定领域预训练）对早期、细微医学图像任务的影响，以及对计算效率与性能权衡的探索，为基于Transformer的医学影像辅助诊断系统开发提供了有价值的见解。

Abstract: Lung cancer remains a leading cause of cancer-related mortality worldwide, and early diagnosis is critical for improving survival. However, early-stage malignancies can be subtle on chest X-rays, creating challenges for radiologists. This study evaluates Vision Transformers (ViTs) for predicting lung cancer one to two years before clinical diagnosis. We analyzed 259,361 chest X-rays from 91,020 imaging studies at the Jamaica Plains VA Hospital in Boston, MA. The dataset showed extreme class imbalance, approximately 1:150 cancer to non-cancer, which was addressed using hybrid under- and over-sampling and class-weighted loss optimization. Three ViT configurations were evaluated: a model trained from scratch, an ImageNet-pretrained model, and a Corona-pretrained model fine-tuned on the lung cancer dataset. Transfer learning improved performance, with pretrained models exceeding the scratch baseline by 6-10 percentage points in AUC and about 10-12 percent in balanced accuracy. ImageNet-pretrained models showed the most stable overall performance, while Corona-pretrained models achieved higher sensitivity in some settings but greater variability. Moderate resampling ratios, including 1:1 undersampling and 1.5:2 oversampling, provided favorable trade-offs between sensitivity, precision, and computational efficiency, reducing runtime by up to 70 percent without major performance loss. These findings demonstrate the potential of ViTs for early lung cancer risk prediction from routine chest X-rays. Although performance remains below clinical deployment thresholds, the results support further development of ViT-based triage systems to flag high-risk patients for earlier evaluation.

[66] Semantic Slots for Video Object-Centric Learning cs.CVPDF

Khalil Sabri, Guillaume-Alexandre Bilodeau, Nicolas Saunier, Wassim Bouachir

TL;DR: 本文提出了一种名为SemanticSlots的视频以对象为中心学习方法，其核心创新在于使用基于Transformer的解码器，使语义槽（slot）能够作为位置不变的语义查询来匹配特征，从而摆脱了对空间锚点的依赖，并实现了仅使用单帧计算的槽即可分解后续视频帧，无需复杂的时间预测器。

Details

Motivation: 作者认为传统视频对象中心学习（OCL）的瓶颈在于解码器，因为传统解码器迫使槽（slot）与空间位置锚定，这阻碍了它们适应物体运动的能力。

Result: 在YouTube-VIS基准测试上，SemanticSlots相比VideoSAUR在mBO指标上提升了31个百分点，并以86.6%的ARI和62.8%的mBO超越了当前最先进（SOTA）方法21个百分点。

Insight: 主要创新点在于将槽从编码边界精度和空间位置的任务中解放出来，使其成为本质上是对象位置不变的语义查询，这简化了架构，无需复杂的时间建模或辅助时间损失即可实现跨帧分解。

Abstract: Video Object-Centric Learning (OCL) has traditionally focused on refining the encoder architecture to ensure temporal consistency. In this paper, we argue that the primary bottleneck lies in the decoder. We show that traditional decoders force slots to be spatially anchored, hindering their ability to adapt to motion. We propose SemanticSlots, which uses a Transformer-based decoder that leverages image context, relieving slots from encoding boundary precision and spatial location. This allows slots to function as semantic queries that are inherently object position invariant, retrieving matching features rather than memorizing coordinates. More importantly, this property allows slots computed from a single frame to decompose subsequent video frames, eliminating the need for complex temporal predictors or auxiliary temporal losses. Results on YouTube-VIS show that SemanticSlots improves upon VideoSAUR by 31 points in mBO and outperforms current state-of-the-art methods by 21 points, achieving 86.6% ARI and 62.8% mBO.

[67] The Plan, Not the Decoder: Diagnosing and Repairing Compositional Failure in Reasoning-Augmented Text-to-Image Generation cs.CV | cs.CL | cs.LGPDF

Ashritha Gonuguntla

TL;DR: 本文研究了推理增强型文本到图像生成模型（如GoT-R1）在组合性提示失败时的原因。通过实验发现，失败主要源于规划器（planner）生成的文本计划存在错误，而非解码器（decoder）执行不忠实。通过编辑计划（如修复几何关系）可以在不重新训练模型的情况下显著改善生成图像的质量。

Details

Motivation: 旨在诊断和修复推理增强型文本到图像生成模型在组合性提示失败时的根本原因，即区分是规划器生成的计划错误，还是解码器未能忠实执行正确的计划。

Result: 在可靠的几何评分下，解码器忠实执行率高达94%，而规划器是瓶颈（例如对’left’和’right’的准确率分别为98%和54%）。通过编辑计划（如重写边界框几何）可在不重新训练的情况下将性能提升高达+13.3个点（p=1e-4）。

Insight: 模块化的规划器-解码器设计是可行的，关键在于确保计划内部的一致性；通过编辑机器可读的计划（如修复空间关系偏差）可以高效修复生成错误，这为改进文本到图像模型提供了一种无需重新训练的可解释方法。

Abstract: Reasoning-augmented text-to-image models such as GoT-R1 emit an explicit textual plan - object names, attributes, and bounding boxes - before generating image tokens. When such a model fails a compositional prompt, is the plan wrong, or is the plan right and the decoder unfaithful? Because the plan is machine-readable it can be edited before decoding, which makes the two separable. We first validate the ruler. Swapping the two bounding boxes inside the model’s own chain demonstrably flips the generated layout: detector-based accuracy falls 0.75 -> 0.48 (p<1e-3), while a widely used VQA-based spatial metric rises. A five-rater human study agrees with the detector on 81% of items and with the VQA judge on 57%. All spatial results therefore use geometric scoring. Under sound measurement the decoder is a faithful executor: 94% of generated layouts realize the planned relation, and object-box binding survives reordering of the plan’s object segments. The planner is the bottleneck. It writes wrong relations for phrasing-dependent reasons - 98% accuracy on “left” against 54% on “right” for semantically identical layouts, a raster-order bias we isolate with a mention-order control - and cluttered geometry that the decoder faithfully reproduces. Editing the plan therefore fixes the image without retraining: symbolic verification with resampling gives +5.0 points (p<1e-3), minimal in-place repair +6.0 (p=.02), rewriting only box geometry +10.7 (p<1e-4), and replacing the plan outright +13.3 (p=1e-4). Gains are indifferent to the plan’s prose style and to its likelihood under the planner, but not to its geometry. Modular planner-decoder designs are therefore viable, provided the plan is internally consistent: box-text contradictions induce object duplication and identity fusion. We release the plan-fidelity evaluation protocol, all plans, and 12k generated images.

[68] Learning to Look Again: Loss-Gap Supervision for Free-form Crop Routing in Vision-Language Models cs.CV | cs.CLPDF

Jinchang Zhu, Rong Fu, Yi Ding, Chenghao Wu, Ying Liu

TL;DR: 本文提出了GapSight框架，用于解决视觉语言模型在处理细节问题时因全局视图压缩信息而导致的失败。该框架通过模型自身的失败信号作为监督，训练一个轻量级的自由裁剪路由器，让模型学会在需要时重新审视图像的特定区域，从而在多个基准测试上显著提升性能。

Details

Motivation: 视觉语言模型在处理依赖图像局部细节的问题时经常失败，因为标准流程会将图像压缩为低分辨率全局视图，导致关键信息丢失。现有方法（如增加视觉token）计算成本高且可能干扰依赖全局上下文的任务，因此需要一种更智能、选择性的视觉重读机制。

Result: 在LLaVA-1.5-7B、InternVL2.5-8B和Qwen2-VL-2B-Instruct三个模型上，GapSight在涵盖OCR、文档、图表、信息图、VStarBench和MME-RealWorld-Lite的六个基准测试中均超越了无缩放基线。例如，在InternVL2.5-8B上，平均得分从52.25提升至64.29，优于CropVLM、ViCrop和ZoomRefine等对比方法。

Insight: 核心创新在于利用模型自身在全局视图和候选裁剪视图下的答案损失或选项边际差异（即损失差距）作为监督信号，自动生成模型特定的重读标签。这避免了昂贵的人工标注，并蒸馏出一个能一次性预测是否需要重读、预期效用和连续裁剪框的轻量级路由器，实现了高效的自适应视觉重读策略。

Abstract: Vision-language models (VLMs) fail many detail-centric questions for a concrete reason: the answer is visible in the image, yet lost after the image is compressed into a low-resolution global view. Allocating more visual tokens to every query improves some OCR and document cases, but it spends computation indiscriminately and can disturb tasks that rely on global context. We propose GapSight, a framework for learning visual re-reading: a VLM first takes a global glance, then selectively returns to a free-form region when the question calls for local evidence. The supervision comes from the target model’s own failure signal. Offline, we compare answer loss or multiple-choice option margin under a global-only view and candidate crop-augmented views; crops that improve the target answer become model-specific review labels. A lightweight free-form crop router distills these labels into a one-shot inference policy that predicts whether to review, expected utility, and a continuous crop box from the global state. Across LLaVA-1.5-7B, InternVL2.5-8B, and Qwen2-VL-2B-Instruct, GapSight improves the Base no-zoom baseline on six benchmarks spanning OCR, documents, charts, infographics, VStarBench, and MME-RealWorld-Lite. On InternVL2.5-8B, GapSight raises the six-benchmark average from 52.25 to 64.29, above CropVLM (57.16), ViCrop (55.84), and ZoomRefine (54.43). Mechanism analyses show that the router rescues concrete wrong answers, adapts its action rate by task, and forms a favorable token-performance profile. These results position loss-gap supervision as a practical route to teaching VLMs when and where to look again.

[69] SpatialDiff: 3D-Aware Object Movement via Implicit Spatial Modeling cs.CVPDF

Zheng Liu, Zijian He, Huiguo He, Weizhi Zhong, Yejun Tang

TL;DR: SpatialDiff是一种用于复杂场景中3D感知物体移动的图像编辑方法，通过隐式3D空间建模和全局空间监督来捕捉真实的三维空间关系，从而实现精确且一致的物体移动。

Details

Motivation: 现有图像编辑方法主要依赖2D数据集的先验信息，缺乏对空间结构的支持，难以处理跨深度层或被部分遮挡物体的空间移动问题。

Result: 实验结果表明，该方法在复杂场景中显著提高了空间移动的准确性和保真度。

Insight: 创新点在于引入隐式3D空间建模来整合3D先验知识，以及通过全局空间监督约束潜在空间特征，使模型能够感知编辑操作引起的物体空间位置变化。

Abstract: Recent advances in image editing allow impressive manipulation of objects, existing methods still struggle to handle spatial movement in complex scenes, such as objects span different depth layers or are partially occluded. Most image editing methods focus solely on prior information from 2D datasets, emphasizing planar features while lacking support for spatial structures. Even approaches that incorporate explicit positional information fail to capture true 3D spatial relationships, thus limiting accurate object movement in complex scenes. In this paper, we present SpatialDiff, a method that effectively captures 3D spatial structures, enabling precise and consistent object movements in complex scenes. Our core innovations are twofold: (1) Implicit 3D Spatial Modeling, which introduces 3D prior knowledge and enables the model to internally build a comprehensive understanding of the three-dimensional spatial structure; and (2) Global Spatial Supervision, which constrains the latent spatial features to enable the model to perceive changes in object spatial positions caused by editing operations. Experimental results demonstrate that our method significantly improves the accuracy and fidelity of spatial movement in complex scenes.

[70] LiteEvent-AE: Lightweight Autoencoder for Event-Based Vision on Low-Latency Energy-Constrained Edge Devices cs.CV | cs.AI | eess.IVPDF

Riadul Islam, Joey Mule, Dhandeep Challagundla, Shahmir Rizvi, Sean Carson

TL;DR: 本文提出了一种轻量级事件驱动自编码器LiteEvent-AE，用于在低延迟、能量受限的边缘设备上进行基于事件的视觉处理。该模型通过紧凑可配置的架构高效压缩神经形态数据，在保持时空结构的同时大幅降低计算成本和能耗，并在资源受限的硬件上实现了实时推理。

Details

Motivation: 基于事件的视觉为能量感知AI提供了稀疏、低延迟的视觉信号，但事件流的异步和噪声特性对传统深度学习模型构成挑战，这些模型在低功耗嵌入式平台上计算量过大。

Result: 在Smart Event Face Dataset (SEFD)和Event-Based Crossing Dataset (EBCD)上的评估表明，该框架在达到与YOLOv9相当或更优的准确率的同时，参数减少了35.6倍。在NVIDIA Jetson Nano上实现了44.8 FPS的实时吞吐，在Raspberry Pi 4B CPU上，50%自编码器分类器的能耗比YOLOv9低约726.3倍。

Insight: 创新点在于将轻量级卷积编码与自适应事件阈值化以及极简分类器头相结合，在保持识别保真度的同时显著降低了计算成本。其紧凑可配置的架构设计为在资源受限的边缘设备上部署高效、节能的基于事件的视觉系统提供了可行方案。

Abstract: Event-based vision has emerged as a promising paradigm for energy-aware artificial intelligence (AI), offering sparse, low-latency visual signals that reduce redundant data processing and support sustainable edge computing. However, the asynchronous and noise-prone nature of event streams creates challenges for conventional deep learning models, which are often too computationally intensive for low-power embedded platforms. This work presents a compact and configurable event-driven autoencoder that efficiently compresses neuromorphic data while preserving essential spatiotemporal structure for downstream inference. The architecture integrates lightweight convolutional encoding with robust performance under adaptive event thresholding and a minimal classifier head, enabling substantial reductions in computational cost without degrading recognition fidelity. Extensive evaluations on the Smart Event Face Dataset (SEFD) and Event-Based Crossing Dataset (EBCD) show that the proposed framework achieves competitive or superior accuracy compared to YOLOv9 while requiring up to 35.6$\times$ fewer parameters. To assess real-world sustainability, the model is deployed on resource-constrained hardware: a Raspberry Pi 4B and a NVIDIA Jetson Nano. On NVIDIA Jetson Nano, it delivers real-time throughput of 44.8 FPS. On a Raspberry Pi 4B CPU, the 50% autoencoder classifier consumes 16.19 J for the evaluated inference workload, corresponding to approximately 726.3$\times$ lower energy consumption than YOLOv9 under the same evaluation protocol. These results demonstrate the potential of compact event-driven models to advance environmentally conscious, low-power AI systems for high-speed perception in autonomous, mobile, and embedded computing environments.

[71] HP-UniIF: Hierarchical Prompt Learning for Unified Image Fusion cs.CVPDF

Xingxin Xu, Siqi Zhao, Xin Li, Xinjie Yao, Yiming Sun

TL;DR: 本文提出了HP-UniIF，一个利用扩散先验的统一视觉框架，旨在同时处理异构图像融合、视觉修复和下游感知任务。其核心创新是引入了一种深度分层条件调制策略，将不同目标在网络各阶段解耦，从而克服了现有统一框架在处理正交目标时表征纠缠和性能下降的问题。

Details

Motivation: 现实世界的图像融合应用需要一个单一系统同时支持异构融合、退化修复和面向任务的感知，而现有统一框架难以协调这些正交目标，导致表征纠缠和子任务性能下降。

Result: 在多个融合任务、不同退化类型和各种下游应用上的大量实验表明，HP-UniIF取得了优越的性能。

Insight: 其创新点在于提出了深度分层条件调制策略，具体包括：在瓶颈层进行任务提示调制以适应不同融合范式，在浅层注入退化感知约束以进行局部修复，在解码阶段使用应用提示库使生成与下游任务对齐。这种分层设计实现了视觉保真与任务语义的兼顾。

Abstract: General image fusion seeks to integrate complementary information from multiple source images, yet real-world applications often require a single system to support heterogeneous fusion, degradation restoration, and task-oriented perception simultaneously. Existing unified frameworks struggle with these orthogonal objectives, resulting in entangled representations and degraded performance across subtasks. We propose HP-UniIF, a unified vision framework that leverages diffusion priors to bridge heterogeneous fusion, visual restoration, and downstream perception. To address the limited adaptability of diffusion models to domain-, degradation-, and task-level objectives within one pipeline, HP-UniIF introduces a depth-wise hierarchical conditional modulation strategy that decouples these objectives across network stages. Task prompt modulation at bottleneck layers adapts the backbone to different fusion paradigms, the degradation prompt router at shallow layers injects degradation-aware constraints for local restoration, and the application prompt bank at decoding stages aligns generation with downstream tasks. This hierarchical design enables HP-UniIF to produce visually faithful results while preserving task-relevant semantics. Extensive experiments across multiple fusion tasks, diverse degradations, and various downstream applications demonstrate the superior performance of HP-UniIF.

[72] SAFE-G: Structure-aware Faithful Evidence-guided Generation for Knowledge-based Visual Question Answering cs.CV | cs.AIPDF

Long Shu, Shuochen Liu, Wei Chen, Junda Lin, Zhi Zheng

TL;DR: 本文提出了一种名为SAFE-G的结构感知忠实证据引导生成框架，用于解决基于知识的视觉问答任务。该框架通过粗粒度混合搜索和细粒度图检索来精确定位证据，并引入基于证据的强化学习奖励机制，确保推理过程严格忠实于检索到的证据。在Encyclopedic-VQA和InfoSeek基准测试上的实验表明，SAFE-G显著超越了现有方法。

Details

Motivation: 当前基于知识的视觉问答方法在融合多模态特征检索外部信息时，难以捕捉复杂上下文中的结构关联以有效过滤噪声，且推理过程往往无法严格忠实于检索到的证据。

Result: 在Encyclopedic-VQA和InfoSeek基准测试上，SAFE-G分别以8.9%和3.5%的显著优势超越了先前的方法，大幅提升了整体推理准确率。

Insight: 创新点在于结合了结构感知的细粒度图检索来捕捉依赖关系以过滤噪声，并设计了基于证据的强化学习奖励机制，强制模型将回答锚定在检索到的上下文中，从而实现了更精确的证据定位和更忠实的推理。

Abstract: Knowledge-based Visual Question Answering (KB-VQA) aims to answer queries that necessitate reasoning over external knowledge sources beyond the visual content. Typically, current methods fuse multimodal features to retrieve external information, subsequently leveraging Multimodal Large Language Models (MLLMs) to derive answers from the retrieved evidence. However, these methods often struggle to capture structural associations within complex contexts to effectively filter noise. Furthermore, they frequently fail to ensure that the reasoning process remains strictly faithful to the retrieved evidence. To address these challenges, we propose SAFE-G, a Structure-Aware Faithful Evidence-guided Generation framework, which enables precise evidence localization and trustworthy reasoning. Specifically, we first employ a coarse-grained hybrid search fusing visual and textual modalities to recall candidate documents, and subsequently implement a structure-aware fine-grained graph retrieval that captures structural dependencies to filter noise and pinpoint precise evidence. Moreover, we introduce a reinforcement learning (RL) strategy with an evidence-grounded reward that assigns credit to correct answers only when the selected evidence is correct. This strict alignment constraint compels the model to anchor its response in the retrieved context, effectively enhancing its capability to locate evidence via multimodal features and perform faithful reasoning. Extensive experiments on the Encyclopedic-VQA and InfoSeek benchmarks demonstrate that SAFE-G outperforms prior methods by a margin of 8.9% and 3.5%, substantially enhancing the overall reasoning accuracy. Our source code is publicly available at: https://github.com/MINE-USTC/SAFE-G.

[73] Through the Schrödinger Bridge: Benchmarking Antemortem Image Restoration from Postmortem Autolysis to Enhance Forensic Diagnostics cs.CVPDF

Shuang Hao, Jiacheng Yue, Yaxuan Zhao, Fan Wang, Jianhua Ma

TL;DR: 本文针对法医组织病理学中死后自溶导致的图像退化问题，提出了一个名为‘生前图像修复’的新任务，旨在将严重自溶的死后图像恢复为具有诊断意义的生前状态。作者贡献了首个同源非配对数据集AutoPath，并将问题形式化为自溶与非自溶分布之间的薛定谔桥问题，同时提出了一种基于诊断效用的评估方法，为法医病理学中的自溶修复建立了可复现的基准。

Details

Motivation: 法医组织病理学中，死后自溶过程会导致组织形态发生不可逆的随机退化，引入诊断主观性，因此需要将自溶图像恢复至诊断可信的生前状态以提高客观性。该任务因形态变化大、非确定性且缺乏像素级配对数据而极具挑战。

Result: 作者构建了包含69个不同肝脏病例、近万个10倍放大图像块的AutoPath数据集。通过将问题建模为薛定谔桥，提供了对随机严重形态退化的原则性建模方法。研究指出通用图像级生成指标（如FID）与诊断效用不匹配，并提出了基于切片级诊断分布一致性的法医评估方法。

Insight: 创新点在于首次将法医组织病理学中的自溶修复形式化为一个明确的非配对图像翻译任务，并引入了薛定谔桥这一理论框架来处理严重的随机退化。更重要的是，提出了与诊断实用性紧密挂钩的评估标准，而非依赖传统的生成质量指标，这为医学图像修复任务的评估提供了新思路。

Abstract: Forensic histopathology, essential for determining cause of death and disease diagnosis, is severely impeded by postmortem autolysis, i.e., an irreversible, stochastic degradation process that distorts tissue morphology and introduces diagnostic subjectivity, thereby underscoring the value of restoring autolyzed images to a diagnostically plausible, pre-autolysis state for improving objectivity in forensic practice. This restoration task is fundamentally challenging due to the large, non-deterministic morphological changes caused by autolysis and the infeasibility of pixel-wise paired data, which invalidates assumptions underlying supervised and cycle/structure-consistent unpaired translation methods. To address this, we formalize forensic histopathology autolysis restoration as a new task: under unpaired supervision, transform postmortem images with severe autolysis into diagnostically meaningful ``antemortem’’ representations. We contribute AutoPath, the first homologous yet unpaired dataset for this problem, constructed by splitting specimens into adjacent tissue blocks—one processed immediately, the other exposed to induce autolysis—yielding nearly ten thousand $10\times$ patches from 69 cases with varying liver conditions. We further frame the problem as a Schrödinger Bridge between the autolyzed and non-autolyzed distributions, offering a principled approach to modeling stochastic, severe morphological degradation. Critically, we demonstrate the misalignment of generic image-level generative metrics (e.g., FID) with diagnostic utility and propose a forensically grounded, slide-level diagnostic distribution consistency evaluation. Overall, this work establishes a reproducible benchmark (encompassing task definition, a real-world dataset, and an evaluation methodology) toward rigorous and practically meaningful progress in autolysis restoration for forensic pathology.

[74] PatchGate: Narrowing the Verbalization Gap with Intrinsic Object Inventories in Frozen Vision-Language Models cs.CV | cs.AI | cs.CL | cs.LGPDF

Jihyung Ko, Eunji Jung, Hyeongsub Kim, Ziseok Lee, Jae Won Cho

TL;DR: 本文提出了PatchGate，一种无需训练的方法，旨在提升冻结视觉语言模型（VLMs）图像描述生成的可靠性。该方法通过两个阶段实现：首先，视觉证据提取（VEX）从模型解码器层提取图像补丁级别的词汇证据，构建一个无需任务提示的、图像本身固有的物体集合；其次，视觉证据包含-排除解码（VIED）利用此证据校准解码过程的logits，促进对可见但未被充分描述的物体的提及，同时抑制支持不足但被过度描述的物体。

Details

Motivation: 现有无需训练的方法主要关注抑制模型生成中未受支持的物体提及（即幻觉），但难以恢复模型输出中遗漏的可见物体。论文旨在同时解决图像描述中的精确性（减少幻觉）和完整性（提高覆盖率）问题，缩小模型内在物体集合与最终输出提及之间的差距。

Result: 在AMBER基准测试上，PatchGate将可见物体覆盖率从49.4%提升至56.0%（相对提升13.4%），并通过将CHAIR指标从7.5降低至6.6（相对降低12.0%）来减少物体幻觉。该方法无需外部检测器或微调，仅增加一次额外前向传播。

Insight: 创新点在于提出了一种从冻结VLM内部提取“提示无关”的、图像固有的物体证据的方法（VEX），并利用该证据在解码阶段进行动态校准（VIED）。这为提升冻结模型的生成可靠性提供了一种新颖的内部干预思路，避免了对外部工具或额外训练的依赖。

Abstract: Reliable image captioning in Vision-Language Models (VLMs) requires captions to be both precise and complete, avoiding unsupported object mentions while covering visible objects. Existing training-free methods primarily address the former requirement, suppressing unsupported object words by intervening on model-predicted mentions during generation. Because they operate only on objects the model is already likely to mention, visible objects omitted from the output remain difficult to recover. We propose PatchGate, a training-free framework that extracts prompt-free object evidence intrinsic to a frozen VLM before generation and uses it to narrow the gap between an intrinsic object set and final object mentions. In the first stage, Visual Evidence eXtraction (VEX) reads patch-level lexical evidence from the latter half of LM decoder layers and constructs an image-conditioned object set without any task prompt. In the second stage, Visual-Evidence Inclusion-Exclusion Decoding (VIED) uses this object evidence to calibrate decoding logits, promoting evidence-supported but under-verbalized objects and suppressing weakly supported but over-verbalized objects. On AMBER, PatchGate improves both sides of object-level reliability, increasing visible-object coverage from 49.4 to 56.0 (+13.4%) and reducing object hallucination by lowering CHAIR from 7.5 to 6.6 (-12.0%), without external detectors or fine-tuning and with one extra forward pass.

[75] Towards Bitstream-corrupted Harsh Visual Understanding: Through Bitstream Language Modeling as Robust Semantic Priors cs.CV | cs.MMPDF

Chaoran Huang, Fangcheng Li, Tianyi Liu, Wenyang Liu, Kejun Wu

TL;DR: 该论文提出了一个名为BLMSP的框架，用于解决比特流损坏的严酷视觉理解问题。该框架通过比特流语言建模学习比特流固有的语义线索，并将其作为先验知识注入到现成的视觉模型中，以提升视频修复、描述和人体姿态估计等任务在严酷退化条件下的性能。

Details

Motivation: 解决现实世界多媒体通信中，因比特流严重损坏导致解码视频严重退化、像素失真和语义丢失的视觉理解问题，现有视觉模型对此类病态问题处理能力不足。

Result: 在构建的大规模CHP数据集上进行实验，结果表明，所学习的比特流先验知识平均将视频修复的PSNR提升了2.51 dB，视频描述的CIDEr分数提升了0.20，人体姿态估计的PCK@0.2提升了0.18。

Insight: 创新性地将比特流本身视为一种语言，通过字节级建模和跨编解码器语义蒸馏来学习其鲁棒的语义信息，并将其作为先验知识注入下游视觉任务模型，为解决比特流损坏导致的视觉退化问题提供了新思路。

Abstract: Bitstream-corrupted Harsh Visual Understanding (BcHVU) aims to understand harshly degraded videos originally decoded from a severely corrupted bitstream in real-world multimedia communication. The ill-posed nature of BcHVU poses a major challenge for existing vision models, as even subtle bitstream corruption can lead to irreversible pixel distortion and significant semantic loss. To address these challenges in BcHVU, we propose Bitstream Language Modeling as Robust Semantic Priors (BLMSP), a framework for learning and injecting bitstream-native semantic cues. Our proposed BLMSP framework learns to extract bitstream-native semantic cues by bitstream language modeling, and leverages them as priors by injecting into off-the-shelf vision models of BcHVU tasks. Specifically, we present a Video Bitstream Byte Model (VBBM) that integrates byte-level modeling and cross-codec semantic distillation, enabling it to interpret robust semantics from byte sequences in multiple corrupted bitstream formats. The learned bitstream semantics are leveraged as robust priors and fused into BcHVU model backbones for improving the quality of video restoration, captioning, and human pose estimation. To train BLMSP, we construct a large-scale multi-source Corrupted-bitstream Harsh-video Paired (CHP) dataset containing 607k corrupted bitstream segments and 287k paired harsh video clips. Extensive experimental results show that the learned bitstream priors improve video restoration, captioning, and human pose estimation by 2.51 dB in PSNR, 0.20 in CIDEr, and 0.18 in PCK@0.2 on average, respectively. These results demonstrate that corrupted bitstream can serve as robust semantic priors in solving pixel distortion and semantic loss in BcHVU.

[76] FIRM-Video: Check Before You Score for Reliable Text-to-Video Reward Modeling cs.CVPDF

Peiyuan Zhang, Xiangyu Zhao, Hongbo Liu, Xiaoxing Hu, Mingxin Liu

TL;DR: 本文提出了FIRM-Video框架，一个基于’检查-评分’原则的统一清单驱动数据构建框架，用于可靠的文本到视频奖励建模。该框架通过构建维度特定的检查清单、验证时间视觉证据，并聚合已验证的决策来构建高质量的训练监督数据。基于此构建了FIRM-Video-90K数据集和FIRM-Video-Bench基准，并训练了基于Qwen3-VL的FIRM-Video-8B模型，在多个评估中取得了最佳性能。

Details

Motivation: 现有文本到视频评估方法在准确性和效率之间存在权衡，且常依赖固定规则或开放式推理的全局评判，导致检查不完整、理由不忠实和归因纠缠。为了解决这些问题，需要一种更可靠、更细粒度的奖励建模方法。

Result: 基于Qwen3-VL的FIRM-Video-8B模型在FIRM-Video-Bench上取得了最佳的整体MAE（平均绝对误差）。在三个视频生成器的Best-of-8采样中，该模型在VBench总分、质量和语义分数上均持续获得最高分，达到了最先进的（SOTA）水平。

Insight: 创新点在于提出了’检查-评分’原则和清单驱动的数据构建框架，将复杂评估任务分解为可验证的原子标准。具体包括：为指令遵循分解提示为加权原子要求；为世界连贯性构建基于可见实体和动作的提示校准、目标特定的检查；为感知质量应用通用的视觉缺陷分类法。这种细粒度、可验证的方法提高了奖励模型的可靠性和可解释性。

Abstract: Reliable reward models are essential for text-to-video evaluation and alignment. However, the trade-off between evaluation accuracy and inference efficiency places high demands on the quality of training supervision. Existing approaches often rely on holistic judges with fixed rubrics or open-ended reasoning, leading to incomplete inspection, unfaithful justification, and entangled attribution. We introduce FIRM-Video, a unified checklist-driven data construction framework based on a check-before-score principle: construct dimension-specific checklists, verify each criterion against temporal visual evidence, and aggregate only verified decisions. For Instruction Following, FIRM-Video decomposes prompts into weighted atomic requirements; for World Coherence, it constructs prompt-calibrated, target-specific checks grounded in visible entities and actions; and for Perceptual Quality, it applies a generic taxonomy of visual defects. The verified criteria and scores are further transformed into natural-language analyses for end-to-end reward modeling. Subsequently, we construct FIRM-Video-90K with 88,044 dimension-specific instances from 29,348 videos, and introduce FIRM-Video-Bench with 750 point-wise human annotations across 250 videos. The Qwen3-VL-based FIRM-Video-8B achieves the best overall MAE on FIRM-Video-Bench while consistently delivering the highest VBench Total, Quality, and Semantic Scores in Best-of-8 sampling across three video generators.

[77] GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors cs.CVPDF

Xinhui Liu, Can Wang, Wei Jiang, Wei Wang, Dong Xu

TL;DR: 本文提出GaussVid，一种用于增强稀疏视图3D高斯溅射重建质量的3D感知视频修复框架。该方法通过构建大规模3DGS视频数据集进行微调，并引入相机条件几何先验，将多视角空间结构显式注入视频生成流程，以边界锚定帧和相机关系编码引导网络实现几何一致的修复。

Details

Motivation: 稀疏视图下的3D高斯溅射重建常出现明显伪影，而现有视频扩散模型虽能提供时空先验，但因其缺乏底层多相机几何感知，直接微调会导致多视角不一致问题。

Result: 大量实验表明，在视频先验修复方法中，该方法在像素和结构保真度上达到最佳，并改善了多视角一致性，同时在感知质量上保持竞争力。

Insight: 核心创新在于构建了专门的3DGS视频数据集，并设计了边界锚定、相机感知的几何先验，将2D视频生成与3D多视角约束桥接，实现了几何基础扎实且视角一致的修复。

Abstract: 3D Gaussian Splatting (3DGS) has achieved remarkable success in novel view synthesis; however, reconstructions under sparse views often exhibit noticeable artifacts. While recent video diffusion models provide strong spatio-temporal priors for 3DGS restoration, directly fine-tuning them for restoration is suboptimal, as they lack awareness of the underlying multi-camera geometry, resulting in multi-view inconsistencies. In this work, we propose a novel 3D-aware video restoration framework designed to enhance the quality of sparse 3DGS reconstruction. Specifically, we construct a large-scale 3DGS video dataset to enable specialized fine-tuning. To bridge the gap between 2D video generation and 3D multi-view constraints, we introduce a camera-conditioned geometric prior. By using the first and last frames as boundary anchors and encoding the corresponding camera relationships, we explicitly inject spatial structure into the video generation pipeline. This boundary-anchored, camera-aware prior guides the network toward geometrically grounded restoration that remains coherent across viewpoints. Extensive experiments show that, among video-prior restoration methods, our approach attains the best pixel- and structure-level fidelity (PSNR/SSIM) and improves multi-view consistency, while remaining competitive in perceptual quality (LPIPS).

[78] ViSMoE: Visual-Aware Sparse Mixture-of-Experts for Embodied Referring Expression Grounding cs.CVPDF

Shuo Feng, Piji Li

TL;DR: 本文提出ViSMoE，一种视觉感知的稀疏混合专家模型，用于具身指代表达式定位任务。该方法通过视觉感知路由策略，分别处理导航视图和目标物体两种不同类型的视觉信息，从而生成更具区分性的视觉表示。在REVERIE和SOON数据集上的实验表明，该方法优于之前的SOTA方法。

Details

Motivation: 现有方法通常使用通用视觉编码器处理导航视图和目标物体，导致两者的表示模糊不清，无法有效区分。本文旨在解决这一表示歧义问题，以提升具身代理在真实环境中根据语言指令导航并定位远程物体的能力。

Result: 在REVERIE和SOON基准数据集上的实验结果表明，ViSMoE超越了之前的最先进方法，验证了其优越性。

Insight: 核心创新在于为稀疏混合专家模型引入了视觉感知的路由策略，使模型能够针对视图和物体这两种不同的视觉信息类型进行专门化处理。这提供了一种通过任务感知的专家路由来解耦和增强多模态表示的有效思路。

Abstract: Embodied Referring Expression Grounding is the task of enabling an agent to navigate in real environments and to localize a remote object based on natural language instructions. In this scenario, the agent needs to select one view for navigation at each step and identify a specific object among all candidate objects at the destination. However, most of the previous approaches fail to distinguish between views and objects, instead processing them using the vanilla vision encoder, which results in ambiguous representations of both views and objects. To address the above issues, we propose ViSMoE, which equips sparse Mixture-of-Experts with a visual-aware routing policy for the embodied agent. This framework processes different types of visual information specifically, resulting in discriminative visual representations for both views and objects. Experimental results on REVERIE and SOON datasets demonstrate that ViSMoE outperforms the previous state-of-the-art methods, showing the superiority of our proposed method.

[79] Frame-Level Evaluation in Weakly Supervised Video Anomaly Detection Mostly Measures Video-Level Ranking cs.CVPDF

Inpyo Song, Jangwon Lee

TL;DR: 该论文指出，弱监督视频异常检测中常用的帧级评估指标（如Micro-AUROC）主要衡量的是视频级别的排序能力，而非帧级的时间定位准确性。作者通过将Micro-AUROC分解为Within-AUROC（视频内时序排序）和Cross-AUROC（跨视频比较），揭示了由于异常帧与正常帧的比较大多发生在不同视频之间（仅占0.071-0.388%），评估结果严重受限于‘时间稀释’效应。实验表明，即使为每个视频的所有帧分配相同的分数（即无时序变化），也能获得接近SOTA的Micro-AUROC分数（81.40-97.18），这暴露了当前评估方法的缺陷。

Details

Motivation: 解决弱监督视频异常检测中帧级评估指标（如Micro-AUROC）无法有效衡量时序定位准确性的问题，因为这些指标主要依赖于跨视频比较，而非视频内的异常时刻排序。

Result: 在ShanghaiTech、XD-Violence和UCF-Crime数据集上，异常与正常帧的比较中仅有0.071-0.388%发生在同一视频内；使用视频级恒定分数（无时序变化）时，Micro-AUROC仍达到81.40-97.18，且保留98.6%的超出随机性能的边际；在XD-Violence的官方AP评估中也观察到类似模式。

Insight: 创新点在于提出了Micro-AUROC的分解方法（Within-AUROC和Cross-AUROC），并揭示了‘时间稀释’这一基准特性，表明当前评估体系高估了模型的时序定位能力；客观来看，这强调了需要设计更注重视频内排序的评估指标，以避免模型仅通过视频级分类就能获得高分。

Abstract: Weakly supervised video anomaly detectors are trained with video-level labels but are commonly evaluated as temporal localizers using Micro-AUROC or AP over pooled test frames. Because these metrics compare frames from different videos, a detector can score well by separating videos without accurately ordering moments within them. We exactly decompose Micro-AUROC by video identity into Within-AUROC for temporal ordering within videos and Cross-AUROC for comparisons across videos. Across ShanghaiTech, XD-Violence, and UCF-Crime, only 0.071-0.388% of comparisons between anomalous and normal frames occur within the same video. When both classes remain distributed across V videos, this share decreases as O(1/V), a benchmark property we call temporal dilution. We train anomaly video binary classifiers under the same video-level supervision and repeat each video score across all frames. These video-constant outputs reach 81.40-97.18 Micro-AUROC despite having no within-video variation. Across 72 controlled runs, replacing every frame score with its video mean preserves a median 98.6% of the Micro-AUROC margin above chance. The same empirical pattern holds for author-released outputs and for XD-Violence under its official AP evaluation. A detector can therefore achieve a high pooled score even when it assigns the same score to every moment within each video.

[80] Pixel-Space Diffusion via Observation Operators cs.CVPDF

Shaojie Guo, Lichen Ma, Haoyang Tong, Yu He, Zipeng Guo

TL;DR: 本文提出了一种名为Observation Operator Diffusion的统一框架，旨在解决像素空间扩散模型在优化过程中存在的尺度-时间不匹配问题。该方法通过引入时间索引的观测轨迹，将监督轨迹和特征细化与图像结构的内在恢复顺序对齐，从而加速收敛并提升生成质量。

Details

Motivation: 动机在于解决像素空间扩散模型直接建模图像分布时优化困难的问题，特别是现有方法在高噪声下仍需预测完整图像，导致梯度信噪比低，阻碍优化效率。

Result: 在ImageNet-256基准测试中，该方法实现了1.52的FID分数，表明其生成质量显著提升，且收敛速度大幅加快。

Insight: 创新点在于提出了观测算子扩散框架，通过高斯-兰佐斯算子实例化多尺度观测轨迹，并设计了GL-CoDA解码器进行从粗到细的特征细化，有效对齐了图像结构恢复顺序与训练目标。

Abstract: Pixel-space diffusion models directly model image distributions but remain difficult to optimize. Recent methods alleviate this challenge through target reparameterization, while still relying on a fixed clean-image target throughout denoising. Through empirical analysis, we identify a scale-time mismatch: image structures become predictable from coarse to fine as noise decreases, whereas existing models are forced to predict the full image even under high noise, resulting in low-SNR gradients that hinder optimization. To resolve this mismatch, we propose Observation Operator Diffusion, a unified framework that aligns both the supervision trajectory and feature refinement with the intrinsic recovery order of image structures. Specifically, we replace fixed full-image supervision along the standard flow path with a time-indexed observation trajectory that evolves from coarse structures to the full image during denoising. This trajectory is instantiated with a family of Gaussian-Lanczos operators at varying observation scales, yielding a path-consistent training objective. We further introduce GL-CoDA, a decoder that injects scale-specific Gaussian-Lanczos observations across decoding stages for coarse-to-fine feature refinement. Extensive experiments show that the proposed approach converges substantially faster while consistently improving generation quality, achieving an FID of 1.52 on ImageNet-256.

[81] VIG: Visual Information Gain as a Reward Signal for Multimodal Chain-of-Thought Compression cs.CVPDF

Wen Luo, Xiaohan Yi, Xiaotao Huang, Liqun Huang

TL;DR: 本文提出了一种名为VIG（视觉信息增益）的信息论奖励信号，用于压缩多模态思维链（CoT）推理过程。VIG通过比较模型在有图像和无图像输入时对每个推理token的预测不确定性，量化其视觉信息含量，从而筛选出真正基于图像的关键推理步骤，减少冗余token，提升推理效率与准确性。

Details

Motivation: 现有多模态大模型在思维链推理中常包含大量与视觉无关的冗余token（如重复视觉描述、自我反思等），这些token增加了推理成本却无助于答案生成。现有CoT压缩方法仅优化输出长度，未能评估推理token是否真正基于图像信息。

Result: 在六个主要多模态推理基准测试和三个不同规模的Qwen3-VL-Thinking模型（2B/4B/8B）以及R1-Onevision-Bench（8B）上的评估表明，VIG方法持续改善了准确性与效率的权衡，实现了更高效的推理。

Insight: 核心创新在于提出了一种无需参考链、外部标注或辅助奖励模型的在线计算奖励VIG，它从信息论角度衡量每个推理token的视觉信息增益，从而引导模型生成视觉信息密度更高的推理过程，而非简单施加长度约束。

Abstract: Multimodal large reasoning models often rely on long Chain-of-Thought (CoT) traces in which a substantial fraction of tokens, such as repeated visual descriptions, self-reflection, and other visually-disengaged filler, inflate inference cost without contributing to the answer. Existing CoT compression methods optimize output length but never measure whether a reasoning token is actually grounded in the image. We propose \textbf{VIG} (Visual Information Gain), an information-theoretic GRPO reward that scores each reasoning token by how much the image reduces its predictive uncertainty. VIG is computed online from two forward passes of the same policy, one with and one without the image, so no reference chains, external annotations, or auxiliary reward models are needed. Across six main multimodal reasoning benchmarks and three Qwen3-VL-Thinking model sizes (2B/4B/8B), plus an additional R1-Onevision-Bench evaluation on 8B, VIG consistently improves the accuracy–efficiency trade-off, supporting our central claim: \emph{efficient multimodal reasoning emerges from raising visual information density, where every reasoning token earns its place by anchoring to the image, rather than from imposing a length budget.} Our source code is available at https://github.com/chaser682/vig.

[82] C$^2$Path: Class-Conditional Pathway Decoupling for Vision-Language Incremental Object Detection cs.CVPDF

Lecheng Xu, Feifei Shao, Ouyangzi Ye, Zhen Wang, Lin Li

TL;DR: 本文提出了一种名为C$^2$Path的类条件通路解耦框架，用于解决视觉语言增量目标检测中的类别知识耦合问题。该方法通过构建类别特定的计算通路，实现了参数的隔离更新和特征的分离注入，从而在多个增量学习场景下显著提升了模型性能。

Details

Motivation: 现有增量目标检测方法存在两类知识耦合问题：共享参数更新导致的类边界侵蚀，以及混合特征编码导致的类表示纠缠。论文旨在通过建立类别特定的计算通路来解决这些问题，实现有效的持续学习。

Result: 在COCO 2017数据集上的多种增量学习设置下进行的广泛实验表明，C$^2$Path始终优于最先进的方法，为视觉语言检测器的持续类别扩展提供了有效且可扩展的解决方案。

Insight: 核心创新在于利用token级别的类别线索，通过类别专家库和类条件解耦模块动态构建ClassLoRA适配器，形成可更新的、类别专用的计算通路。这为增量学习提供了一种结构化的参数隔离和特征分离机制，避免了知识耦合。

Abstract: Incremental Object Detection (IOD) aims to enable detectors to continuously learn novel categories while preserving previously acquired knowledge. However, existing methods suffer from two forms of \textbf{class knowledge coupling}: class boundary erosion induced by shared parameter updates and class representation entanglement arising from mixed feature encoding. We argue that effective incremental learning requires class-specific computational pathways that enable isolated parameter updates and separated class-wise injection. To this end, we propose \textbf{C$^2$Path}, a class-conditional pathway decoupling framework for vision-language incremental object detection that leverages token-level class cues to establish dedicated and updatable computational pathways for different categories. Specifically, C$^2$Path introduces a category expert library and a class-conditional decoupling module. The expert library consists of learnable low-rank computational nodes that capture category-specific knowledge, while the decoupling module generates class-aware routing signals to dynamically compose \textit{ClassLoRA} adapters from these experts, thereby forming class-specific computational pathways for isolated updates and separated injection across categories. Extensive experiments on COCO 2017 under multiple incremental learning settings demonstrate that C$^2$Path consistently outperforms state-of-the-art methods, providing an effective and scalable solution for continual category expansion in vision-language detectors.

[83] Entity-Constrained CBCT Retrieval for Low-Resource Dental Record Completion cs.CVPDF

Nhi Ngoc-Yen Nguyen, Thai Nguyen, Kiet Huynh Cao Tuan, Huy-Hieu Pham

TL;DR: 本文提出了一种名为实体约束CBCT引导检索（ECCR）的无参数框架，用于解决低资源条件下牙科记录补全任务中多模态证据整合的可靠性问题。该方法通过分离证据可用性与权威性，利用语料库先验提供完整记录，并仅当检索到的诊断证据不扩展先验实体集时才将其附加，从而确保断言实体集在构建过程中保持不变。

Details

Motivation: 在标注稀缺且不同临床字段依赖不同类型证据的情况下，从锥形束计算机断层扫描（CBCT）补全牙科记录具有挑战性；MMDental Task 3要求仅基于50个标注CBCT案例完成七字段记录，并评估结构化FDI位置和ICD代码的正确性，因此视觉上合理的检索记录若引入无支持的实体仍可能有害。

Result: 在公开验证中，ECCR获得加权分数0.3134，优于全记录多模态检索（0.2237）和静态纯文本先验（0.2915），其防护机制阻止了63.3%的检索候选（否则会注入先验中不存在的FDI位置或ICD代码）；在最终测试评估中，ECCR在97.4分可达到最大值中获得11.37分，总体排名第二。

Insight: 创新点在于提出实体约束机制，将证据权威性（由语料库先验定义）与证据可用性（由图像检索提供）分离，通过构造性确保实体集不变性，从而在极端低资源设置下，控制多模态证据的修改权限比直接转移整个检索记录更可靠；这为多模态医疗记录补全提供了可借鉴的约束集成策略。

Abstract: Completing dental records from cone-beam computed tomography (CBCT) is difficult when annotation is scarce and individual clinical fields are supported by different types of evidence. MMDental Task 3 requires seven-field record completion from only 50 labeled CBCT cases and scores the correctness of structured FDI positions and ICD codes; consequently, a visually plausible retrieved record can still be harmful when it introduces an unsupported entity. We propose Entity-Constrained CBCT-Guided Retrieval (ECCR), a parameter-free framework that separates evidence availability from evidence authority. A corpus-derived prior first supplies the complete record. A frozen 3D encoder retrieves image-conditioned Diagnosis evidence, which is appended only if it does not expand the prior FDI or ICD entity set, so the asserted entity set is invariant by construction. On public validation, ECCR reaches a weighted score of 0.3134, improving on both full-record multimodal retrieval (0.2237) and a static text-only prior (0.2915); the guard blocks 63.3% of retrieved candidates, each of which would otherwise have injected an FDI position or ICD code absent from the prior. On the final test evaluation, ECCR obtains 11.37 of a 97.4-point attainable maximum, securing second place overall. The result indicates that, in an extreme low-resource setting, controlling what multimodal evidence is allowed to modify can be more reliable than transferring an entire retrieved record.

[84] Sparse Multi-Stage Expert-Agent Routing for Complex Clinical Reasoning cs.CVPDF

Sike Xiang, Shuang Chen, Qian sun, Jia Cheng, Yusi Wei

TL;DR: 本文提出了一种稀疏多阶段专家-智能体路由框架，用于复杂临床推理。该框架将诊断建模为一个分阶段的路由过程，根据逐步可用的多模态临床证据，动态激活少量医学专家智能体，并利用跨阶段的专家特定记忆。同时，论文还引入了ClinFEScore，一个基于事实感知的语义评估协议，用于评估临床推理输出的自由文本结论。

Details

Motivation: 现有的基于LLM的临床推理系统通常进行单次预测或依赖固定的多智能体工作流，导致专家参与要么是静态的，要么是过度消耗资源的。本文旨在解决在有限咨询资源下，如何随着新证据的出现更新诊断假设并协调不同医学专科的问题。

Result: 在从MAC和AgentClinic-NEJM重建的多阶段病例上，该框架将平均激活的专家数量从17.0减少到3.0，同时保持了强大的事实层面诊断质量。在200个真实世界医院多学科会诊病例上，该方法达到了91.5%的临床医生验证诊断准确率，每个病例大约进行五次专家智能体/LLM调用。ClinFEScore评估协议与临床医生判断高度相关。

Insight: 核心创新点是将临床推理建模为一个动态、稀疏的阶段性路由过程，而非静态或全激活的工作流，从而在保持诊断质量的同时显著提高效率。此外，提出的ClinFEScore评估协议为超越表面相似性的自由文本诊断结论评估提供了新方法。

Abstract: Complex clinical reasoning requires models to update diagnostic hypotheses as new evidence emerges and to coordinate different medical specialities under limited consultation resources. Existing LLM-based clinical reasoning systems typically perform single-pass prediction or rely on fixed multi-agent workflows, making expert participation either static or unnecessarily exhaustive. We propose Sparse Multi-Stage Expert-Agent Routing, a language-based clinical reasoning framework that models diagnosis as a stage-wise routing process. Given progressively available clinical evidence derived from multiple modalities, the framework maintains an evolving case state and adaptively activates a sparse set of medical expert agents, supported by expert-specific memory across stages. To evaluate free-text diagnostic conclusions beyond surface similarity, we further introduce ClinFEScore, a fact-aware semantic evaluation protocol for clinical reasoning outputs. On reconstructed multi-stage cases from MAC and AgentClinic-NEJM, our framework reduces the average number of activated experts from 17.0 to 3.0 whilst maintaining strong fact-level diagnostic quality. On 200 real-world hospital MDT cases, ClinFEScore correlates strongly with clinician judgements (Spearman’s $ρ=0.81$; Pearson’s $r=0.87$), whilst our method achieves 91.5% clinician-verified diagnostic accuracy with approximately five expert-agent/LLM calls per case. These results support sparse stage-wise coordination as an efficient and clinically relevant approach to LLM-based clinical reasoning.

[85] ORBIT++: Benchmarking SfM in the Wild with 360° Video cs.CVPDF

Sara Sabour, Linyi Jin, Richard Tucker, Amir Hertz, Marcus Brubaker

TL;DR: 本文提出了一个新的基准测试ORBIT，用于评估在复杂真实世界场景下的运动恢复结构（SfM）性能。其核心是利用在线全景360°视频构建具有挑战性的透视视图片段，并从中恢复出可靠的相机轨迹真值。实验表明，现有主流SfM方法在该基准上表现不佳，凸显了其作为衡量真实进展的测试平台的价值。

Details

Motivation: 当前SfM方法在处理复杂相机运动或动态场景时经常失败，且该领域缺乏针对此类困难场景的可靠真值基准，难以评估实际进展或确定改进方向。

Result: 实验表明，包括COLMAP以及近期基于优化和前馈的SfM方法，在ORBIT基准上都难以准确估计相机姿态。

Insight: 创新点在于利用全景360°视频作为数据源来构建基准：全景视频提供了更丰富的视觉上下文，有助于在部分视图受模糊、运动或动态物体影响时仍能稳健地恢复相机轨迹真值；通过裁剪和重投影生成透视视图片段，从而创建了一个具有挑战性且真值可靠的评测基准。

Abstract: Structure-from-Motion (SfM) is a cornerstone of 3D perception, yet current methods often fail when applied to complex videos involving challenging camera motions or dynamic scenes. Compounding the problem, the field lacks reliable ground-truth benchmarks for such difficult scenarios, making it hard to gauge real-world progress or to pinpoint where improvements are most needed. To address this gap, we introduce a new benchmark for evaluating camera pose estimation. Our key insight is to leverage online panoramic 360° video as a source of data from which to construct challenging clips, while still enabling robust ground-truth trajectory recovery. The panoramic nature of these videos provides richer visual context for tracking camera motion, even when parts of the view are affected by blur, motion, or dynamic objects. After tracking camera motion across full 360° videos, we crop and reproject selected portions to generate perspective-view clips that serve as our benchmark, called ORBIT. Experiments show that COLMAP, as well as recent optimization-based and feed-forward SfM methods struggle to accurately estimate camera poses on our benchmark. Hence, ORBIT provides a valuable testbed where researchers can meaningfully measure progress on truly challenging, real-world SfM problems.

[86] Competitive Memory Readout for Robust Video Object Segmentation: 2nd Place Technical Report for the MOSEv2 Track of the 8th LSVOS Challenge cs.CVPDF

Mingqi Gao, Sijie Li, Jungong Han

TL;DR: 本文介绍了在ECCV 2026第八届大规模视频目标分割挑战赛MOSEv2赛道中获得第二名的解决方案。该方法基于SAM~3模型，针对其内存读取机制进行了改进，提出了竞争性内存读取方法，以在复杂时序动态下（如长期遮挡、消失重现、外观剧变及相似物体干扰）实现更鲁棒的视频目标分割。

Details

Motivation: 标准的目标专用内存检索方法在遇到同类非目标物体（干扰项）时容易混淆，因为这些干扰项仅被隐式地表示为背景。为了解决这一问题，需要一种能显式处理同类竞争证据的机制，以在复杂场景中更好地保持目标身份。

Result: 在MOSEv2赛道中，该方法取得了66.20的主要挑战分数，最终排名第二。

Insight: 核心创新点是提出了竞争性内存读取机制，在从内存检索目标信息时显式地纳入同类竞争者的证据，并辅以轻量级自适应恢复规则以防止对弱目标或重现目标的过度抑制。该方法在保留原始SAM~3跟踪流程的同时，提升了在挑战性视频中目标身份的保持能力。

Abstract: We present our solution for the MOSEv2 track of the 8th Large-scale Video Object Segmentation (LSVOS) Challenge at ECCV 2026. The challenge evaluates robust video object segmentation under complex temporal dynamics, including long-term occlusion, disappearance and reappearance, large appearance changes, and strong interference from visually similar objects. Our method builds on SAM3 and focuses on its memory readout. Standard target-only memory retrieval can confuse the annotated target with same-class non-target objects because such distractors are represented only implicitly as background. Our method introduces Competitive Memory Readout, which explicitly incorporates same-class competitor evidence when retrieving target information from memory. To prevent excessive suppression of weak or reappearing targets, we further apply a lightweight adaptive restoration rule after competition. The resulting system retains the original SAM3 tracking pipeline while improving target identity preservation in challenging videos. Our submission achieves 66.20 on the primary challenge score and ranks 2nd in the MOSEv2 track.

[87] Learning Implicit Constitutive Laws for Dynamic 3D Gaussian Splatting from Monocular Videos cs.CV | cs.AIPDF

Xiaoyang Liu, Kai Han

TL;DR: 本文提出了GCA（高斯本构对齐）框架，用于从单目动态视频中学习由3D高斯表示的变形物体的隐式本构定律。该方法通过静态多视角扫描进行几何初始化，仅从固定视角的运动物体视频中学习内在物理动力学。GCA统一了基于LoRA的适应与两个关键对齐模块：基于排序的深度-几何锚点（RDGA）和本构先验正则化器（CPR），以解决现有隐式方法易陷入局部极小值、缺乏物理解释性，以及显式方法依赖预定义本构方程、泛化性差且在单目设置下不稳定的问题。

Details

Motivation: 现有隐式方法在噪声监督下易陷入局部极小值且缺乏物理解释性，而显式方法依赖预定义本构方程，限制了泛化能力并在单目设置下不稳定。本文旨在从单目动态视频中学习变形物体的隐式本构定律，以克服这些挑战。

Result: 在合成、真实到仿真和真实世界数据集上的大量实验表明，GCA优于现有方法，在合成基准测试中实现了比最强基线低48%的倒角距离（Chamfer Distance），同时在单目监督下保持鲁棒性。

Insight: 创新点包括：1）提出基于排序的深度-几何锚点（RDGA），通过尺度不变的基于排序的深度对齐从单目动态观测中建立鲁棒的几何约束，减少对不可靠像素级颜色监督的依赖；2）提出本构先验正则化器（CPR），将经典本构模型作为软可微分先验集成，在保持隐式建模灵活性的同时正则化优化过程，即使实际材料不在假设范围内也有效。

Abstract: We present GCA (Gaussian Constitutive Alignment), a framework for learning implicit constitutive laws from monocular dynamic video of deformable objects represented by 3D Gaussians. Given a static multi-view scan for geometric initialization, our method learns intrinsic physical dynamics solely from a single fixed-viewpoint video of the moving object. Existing implicit methods often suffer from local minima under noisy supervision and lack physical interpretability, while explicit approaches rely on predefined constitutive equations, limiting generalizability and becoming unstable in monocular settings. To address these challenges, our framework unifies LoRA-based adaptation with two key alignment modules. First, we propose Rank-based Depth-Geometric Anchors (RDGA) to establish robust geometric constraints from monocular dynamic observations via scale-invariant rank-based depth alignment, reducing the reliance on unreliable pixel-level color supervision. Second, a Constitutive Prior Regularizer (CPR) integrates classical constitutive models as soft differentiable priors, regularizing the optimization while preserving the flexibility of implicit modeling—even when the actual material is absent from the hypotheses. Extensive experiments on synthetic, real-to-sim, and real-world datasets demonstrate that GCA outperforms existing methods, achieving 48% lower Chamfer Distance than the strongest baseline on synthetic benchmarks while remaining robust under monocular supervision.

[88] When Does Visual Generation Help Visual Understanding in Unified Multimodal Models? cs.CVPDF

Yubo Zhu, Zhehan Kan, Jingyi Yang, Miaolin Chen, Jinbo Xing

TL;DR: 该论文提出了VGAU-Diag评估框架，用于系统分析统一多模态模型中视觉生成任务是否以及何时能辅助视觉理解任务。研究发现，生成的视觉辅助信息在简单任务中有效，但随着推理复杂度增加，其可靠性下降，且主要瓶颈在于模型难以有效利用视觉辅助信息，而非生成质量本身。

Details

Motivation: 旨在解决现有研究对统一多模态模型中视觉生成能否提升视觉理解能力这一问题结论不一、且评估方法存在混淆因素（如任务难度、推理范式、生成与理解的闭环交互）的局限性。

Result: 通过VGAU-Diag框架的细粒度评估（包括按难度分层、统一评估多种推理范式、使用Oracle辅助参考协议），发现当前UMMs在利用视觉辅助时存在瓶颈，且有效辅助应针对视觉理解瓶颈而非增加推理步骤。

Insight: 创新点在于提出了一个诊断性评估框架来解耦混淆因素，并揭示了视觉生成辅助理解存在一个从无关噪声、到误导性引导、再到有效辅助的三阶段转变过程，为改进UMMs的设计提供了具体方向（如聚焦于理解瓶颈）。

Abstract: Unified multimodal models (UMMs) can perform both understanding and generation, raising a central question: can visual generation improve understanding? Existing evaluations provide mixed evidence, but confound task difficulty, reasoning paradigms, and the closed-loop interaction between generation and understanding. We introduce VGAU-Diag, a fine-grained evaluation framework for vision generation-assisted understanding. It stratifies samples by difficulty, enables unified evaluation of multiple reasoning paradigms, and uses Oracle-Assisted Reference Protocols. Our analysis shows that generated visual aids help on easier instances but become unreliable as reasoning complexity increases. Oracle-assisted diagnosis further reveals that the main bottleneck often lies on the visual-understanding side rather than the visual-generation side, as current UMMs struggle to leverage even faithful visual aids. We also show that effective visual generation should target visual-understanding bottlenecks rather than add more reasoning steps, and identify a three-stage transition from task-irrelevant noise, to misleading plausible guidance, and finally to useful assistance. These findings would be useful to guide the development of better UMMs.The code is available at https://github.com/zyb1029/VGAU-Diag.

[89] SAM3Dual: A 3rd Place Solution to the MOSEv2 Track, 8th LSVOS Challenge cs.CVPDF

JeongRae Kim, Chaehyun Kim, Changwon Lim

TL;DR: 本文提出了SAM3Dual，这是一个在ECCV 2026第八届大规模视频目标分割挑战赛MOSEv2赛道中获得第三名的解决方案。该方法基于预训练的SAM 3模型，无需训练，通过将时序记忆显式分离为短期记忆分支和长期记忆分支，并采用确定性序列融合策略与置信度调制，实现了竞争性的长期视频目标分割性能。

Details

Motivation: 论文旨在解决长期视频目标分割任务中，如何有效利用时序信息的问题。其动机是在不更新预训练模型参数的前提下，仅通过推理阶段的时序记忆重组来提升模型对长视频序列中目标跟踪的鲁棒性。

Result: 该方法在MOSEv2赛道上的官方J&F得分为64.37，获得了第三名。该结果证明了仅通过推理时优化即可达到竞争性的性能水平，无需任何任务特定训练或微调。

Insight: 创新点在于提出了一个免训练的双分支时序记忆机制，将记忆显式分离为短期和长期组件，并通过确定性融合与置信度调制进行结合。从客观角度看，其核心洞察是在不改变预训练模型的前提下，通过精心设计的推理时记忆管理策略来有效利用时序上下文，这为利用大型基础模型解决复杂时序任务提供了一种高效、低成本的思路。

Abstract: We present SAM3Dual, our third-place solution to the MOSEv2 track of the 8th Large-scale Video Object Segmentation (LSVOS) Challenge at ECCV 2026. SAM3Dual is a training-free inference extension of pretrained SAM 3 that explicitly separates temporal memory into a short-term branch for recent observations and a long-term branch for interval-sampled historical representations. The two memory responses are combined using a deterministic sequence-relative fusion schedule and conservatively modulated by the previous-frame object confidence. All pretrained SAM 3 parameters remain frozen, requiring no task-specific training, fine-tuning, test-time training, or online parameter optimization. The complete system achieved an official J&F score of 64.37 and ranked third in the MOSEv2 track. This result highlights the potential of reorganizing temporal memory entirely at inference time to obtain competitive long-term VOS performance while preserving the pretrained model.

[90] VERDICT: Agreement Beats Pixel-Space Verification in Real-Document OCSR cs.CV | cs.IR | cs.LGPDF

Yani Guan, Dengpan Dong, Shuang Luo, Zi Wei, Joah Han

TL;DR: 这篇论文提出了VERDICT方法，用于在光学化学结构识别（OCSR）中无需真实标签即可识别不可靠预测。研究比较了三种无标签信号：模型置信度、重渲染相似性和识别器间一致性，发现多个识别器间的一致性（如四分之二或四分之三规则）在真实文档上表现最佳，显著优于像素空间重渲染方法，并在多个数据集上验证了其有效性，最终应用于PMC Open Access数据库生成了数千个经过验证的结构标签。

Details

Motivation: 动机是解决大规模化学训练数据集构建中，自动化OCSR需要在不依赖真实标签的情况下识别不可靠预测的问题，以确保数据质量。

Result: 在263个ACS期刊图像上，识别器间一致性达到AUROC 0.916，显著优于重渲染相似性的0.547；四分之二规则在81.7%的图像上达到88.8%的精确度，四分之三规则在52.1%的图像上达到98.5%的精确度，并在CLEF-IP、UOB和USPTO数据集上得到验证；应用于PMC Open Access生成了6,146个结构标签，化学家评审显示四分之三和四分之二层级的精确度分别为0.995和0.958。

Insight: 创新点在于揭示了在真实文档OCSR中，多个识别器间的一致性比像素空间重渲染更可靠，这一发现在合成基准测试中被掩盖；提出的VERDICT框架通过一致性投票和物质过滤器，实现了高精度的无标签验证，为多模态分子数据库提供了可验证的标签生成方法。

Abstract: Optical Chemical Structure Recognition (OCSR) converts 2D molecular depictions in the published literature into SMILES, and is increasingly important for constructing large-scale chemical training datasets. Automation at that scale requires identifying unreliable predictions in the absence of ground truth. Three families of label-free signals were compared on $263$ ACS journal depictions with verified ground truth: model confidence, re-rendering similarity, and agreement among recognizers. Pixel-space re-rendering performed little better than chance (AUROC $0.547$, $95%$ CI $[0.465,0.629]$), and an oracle-tuned threshold on it reduced correct labels per image from $0.745$ to $0.205$. Agreement among four architecturally distinct recognizers instead reached an AUROC of $0.916$ ($[0.880,0.952]$). The two-of-four rule accepted $81.7%$ of images at $88.8%$ precision, the three-of-four rule $52.1%$ at $98.5%$. The same pattern held on CLEF-IP, UOB, and USPTO. This distinction is obscured on synthetic benchmarks, where re-rendered predictions naturally resemble their inputs. A substance filter removed $2{,}193$ false agreements on wildcards and R-group fragments, after which the three-of-four rule rejected all $68$ generic depictions. VERDICT was then applied to PMC Open Access, producing $6{,}146$ structure labels for $4{,}833$ molecules; chemist adjudication of $400$ released labels in two independent samples yielded precisions of $0.995$ for the three-of-four tier and $0.958$ for the two-of-four tier. VERDICT therefore enables validated labels for multimodal molecular databases linking structure images, machine-readable representations, and source-publication information. In SES AI’s Molecular Universe platform, VERDICT further serves as an image-based interface for searching and retrieving molecular records.

[91] UR$^{2}$-MLLM: Uncertainty-aware Revisit Reasoning in Multimodal Large Language Models for Radiology Report Generation cs.CVPDF

Yucheng Chen, Yang Yu, Jiazhou Zhou, Yufei Shi, Yongying Lan

TL;DR: 本文提出了一种用于放射学报告生成（RRG）的不确定性感知重访推理多模态大语言模型（UR²-MLLM）。该框架模拟放射科医生的诊断过程，在推理过程中动态地重新审视不确定的图像区域，以提高报告生成的可靠性和临床一致性。

Details

Motivation: 现有用于放射学报告生成的多模态大语言模型（MLLM）在推理过程中仅提供静态的视觉证据，缺乏动态的重访机制，无法模拟放射科医生对不确定观察结果进行反复审视的实际诊断过程。

Result: 在MIMIC-CXR和IU-Xray两个基准数据集上的实验表明，UR²-MLLM取得了最先进的（SOTA）性能。

Insight: 核心创新在于引入了不确定性感知的动态重访推理机制，包括：1）基于不确定性感知数据集的训练；2）结合检测-复制机制的多模态推理轨迹数据集构建；3）通过强化学习中的视觉定位奖励来对齐重访区域与解剖结构，从而模拟并优化了临床诊断中的迭代推理过程。

Abstract: Radiologists generate diagnostic reports through iterative and selective revisiting of suspicious regions to refine their interpretations. Recent multimodal large language models (MLLMs) for radiology report generation (RRG) have shifted from text-only reasoning toward a ``Thinking-with-Images’’ paradigm, incorporating visual evidence into the reasoning process. However, existing methods provide static visual evidence without a dynamic revisit mechanism during reasoning, neglecting how radiologists re-examine uncertain observations. To this end, we propose an Uncertainty-aware Revisit Reasoning MLLM (UR$^{2}$-MLLM) framework that dynamically revisits uncertain regions during reasoning for RRG. UR$^{2}$-MLLM is first equipped with uncertainty perception by training on an uncertainty-aware dataset. We then construct a multimodal reasoning trajectory dataset together with a detect-and-copy mechanism, which guides when and where to revisit. Finally, a visual grounding reward refines this behavior through reinforcement learning, aligning the revisited regions with corresponding anatomical structures. Experiments on MIMIC-CXR and IU-Xray show that UR$^{2}$-MLLM achieves state-of-the-art performance, highlighting the value of uncertainty-aware visual revisit reasoning for reliable and clinically aligned report generation.

[92] Training-Free VLM Personalization via Calibrated Residual Decoding cs.CV | cs.AIPDF

Jiaao Yu, Yujian Ma, Xianming Hu, Pengran Wang, Ang Li

TL;DR: 本文提出了一种无需训练即可实现视觉语言模型个性化的校准残差解码框架。该方法通过构建正例、反事实和空用户画像三种证据条件，显式估计个性化信号的边际贡献，并引入基于归一化熵的不确定性校准来适应残差信号的可靠性，从而提升个性化多模态理解能力。

Details

Motivation: 现有免训练个性化方法通过直接提供用户画像进行提示，但模型预测分布混合了真实的个性化信号和模型固有的通用先验，导致难以判断高置信度答案是否真正基于用户画像。

Result: 在MMPB、YoLLaVA和MyVLM基准测试中，该方法在不进行微调的情况下提升了身份敏感的视觉个性化任务性能，取得了稳定的增益。

Insight: 创新点在于通过多条件对比显式解耦个性化贡献，并利用熵校准动态调整残差解码强度，增强了免训练个性化推理的可靠性和鲁棒性。

Abstract: Vision-language models can be personalized in a training-free manner by directly providing user profiles, preferences, or visual references at inference time, without updating model parameters. However, direct personalized prompting does not guarantee that the model will reliably exploit such evidence. The predictive distribution under the positive user profile often mixes two sources: personalized signals genuinely supported by the current profile, and the model’s generic visual or linguistic priors. As a result, from the positive-profile response alone, it is difficult to determine whether a high-confidence answer is supported by the user profile or merely reflects the model’s default preference. To address this problem, we propose a training-free calibrated residual decoding framework. Given the same image and question, we construct three evidence conditions: a positive profile , a counterfactual profile , and an empty profile . Our method keeps the prediction under as the anchored base, and explicitly estimates the marginal contribution of personalization from score differences across the three conditions. We further introduce normalized-entropy-based uncertainty calibration, allowing the strength of personalized enhancement to adapt to the reliability of the residual signal. Experiments on MMPB, YoLLaVA, and MyVLM show that the proposed method improves personalized multimodal understanding without fine-tuning, with consistent gains on identity-sensitive visual personalization tasks. Additional analysis shows that entropy calibration stabilizes residual decoding when the contrastive personalization signal is uncertain.

[93] Hyper^2: Unleashing Hyperbolic Geometry’s Full Potential via Dual-Space Consistency cs.CVPDF

Guantian Zheng, Haiyang Xu, Tianyu Gao

TL;DR: 这篇论文提出了Hyper^2框架，旨在解决点云补全任务中双曲几何应用不充分的问题。作者指出现有方法HyperbolicCD虽然引入了双曲Chamfer距离损失，但其编码器仍是欧几里得的，导致存在跨几何不匹配问题。Hyper^2通过引入双空间一致性框架，在注意力机制中融入双曲距离编码，并与双曲损失共享曲率参数，从而显著提升了性能。

Details

Motivation: 论文的动机是解决点云补全中双曲几何应用不充分的问题。作者发现现有方法HyperbolicCD虽然使用了双曲损失，但编码器仍是欧几里得的，导致损失的位置依赖性监督在反向传播中被平均化，形成跨几何不匹配，限制了性能提升。

Result: 在ShapeNet-55数据集上，Hyper^2相比SVDFormer基线将Chamfer距离降低了22.9%，在未见过的ShapeNet-34类别上降低了37.5%。此外，论文提出的两个指标特征-损失相关性r_FL和有效梯度利用率u_G从单空间配置的(0.68, 39%)提升到双空间一致的(0.95, 87%)，验证了方法的有效性。

Insight: 论文的核心创新点是提出了双空间一致性框架，强调编码器和损失函数在几何上的一致性（即同时使用双曲几何）是释放双曲几何潜力的关键。这通过将双曲距离编码作为位置偏置引入注意力机制，并与双曲损失共享曲率来实现，且计算开销仅增加约1.6% FLOPs。

Abstract: HyperbolicCD pioneered hyperbolic geometry for point cloud completion by replacing the Euclidean Chamfer distance with arcosh(1+alpha||x-y||^2), but the reported gains are modest (3-7% Chamfer reduction across SeedFormer, PointAttN and PMP-Net backbones on PCN and ShapeNet-55). We argue the bottleneck lies elsewhere: the loss is hyperbolic but the encoder it back-propagates through is Euclidean, so the position-dependent supervision of the loss is averaged away by the chain rule before it reaches the parameters. We call this a cross-geometry mismatch, and make it testable through two model-agnostic indicators, feature-loss correlation r_FL and effective gradient utilisation u_G. On an SVDFormer backbone trained with HyperbolicCD’s loss alone we measure (r_FL, u_G) = (0.68, 39%). We propose Hyper^2, a dual-space consistency framework that extends HyperbolicCD by reusing the identical arcosh(1+alpha d^2) functional form as a positional bias on the refinement attention (a hyperbolic distance encoding), paired with HyperbolicCD’s hyperbolic Chamfer loss under a single shared curvature alpha. Both operators are O(N log N) scalar non-linearities on Euclidean distances and together add only ~1.6% FLOPs over SVDFormer. Hyper^2 delivers -22.9% Chamfer on ShapeNet-55 over SVDFormer (well above the 13.2% linear sum of the -12.0% loss-only and -1.2% encoding-only single-space ablations) and -37.5% on the 21 unseen ShapeNet-34 categories. The two indicators remain essentially flat for any single-space configuration but jump together to (0.95, 87%) only when both encoder and loss are hyperbolic, supporting the claim that geometric consistency across encoder and loss, rather than either operator alone, is what enables hyperbolic supervision in point cloud completion. Code is available at https://github.com/Ethan-Zheng136/Hyper-2.

[94] OVIBench: Benchmarking Online Video Question Answering under Interruption cs.CV | cs.AIPDF

Naiming Liu, Zhiheng Wu, Shuning Wang, Tie Zhang, Bowen Liu

TL;DR: 本文提出了在线视频问答中断任务（Online Video Question Answering under Interruption），并引入了首个标准化基准OVIBench来评估视觉语言模型（VLMs）在该场景下的表现。该基准将中断分为取消、误触发和纠正三种类型，支持开放式和多项选择式评估，并开发了离线模拟协议和多维度指标套件。实验表明OVIBench能有效区分模型的中断处理能力，特别是遵循纠正请求方面。此外，作者还构建了训练集OVI-Train用于中断感知微调，微调后的模型在基准上取得了显著提升。

Details

Motivation: 现有的视频问答研究和基准大多遵循离线、单轮范式，忽略了用户在模型生成答案过程中可能中断的现实交互场景，因此需要填补这一空白。

Result: 在OVIBench上的实验表明，该基准能有效区分不同模型的中断处理能力，尤其是在遵循纠正请求方面。使用OVI-Train数据集进行中断感知微调的模型在基准上取得了显著性能提升。

Insight: 论文的主要创新点在于首次系统性地定义了在线视频问答中断任务并构建了标准化基准，提出了中断分类、离线模拟协议和多维度评估指标。从客观角度看，其将交互式中断引入视频理解评估的范式具有前瞻性，为未来研究真实人机交互场景下的模型鲁棒性提供了重要工具和数据基础。

Abstract: Recent vision language models (VLMs) have achieved strong progress in video understanding. However, most existing video QA research and benchmarks still follow an offline, single-round paradigm, overlooking realistic interactions where users may interrupt the model during answer generation. To address this gap, we formulate the task of Online Video Question Answering under Interruption and introduce OVIBench, the first standardized benchmark for evaluating VLMs in this setting. OVIBench categorizes interruptions into three types: Cancellation, False Trigger, Correction and supports both open-ended and multiple-choice evaluations. To enable large-scale and reproducible testing, we develop an offline simulation protocol that reproduces interruption during generation under a unified temporal setup, together with a multi-dimensional metric suite for assessing interruption understanding and response generation. Experiments demonstrate that OVIBench effectively distinguishes models’ interruption-handling abilities, especially in following correction requests. Finally, we construct a train set OVI-Train for interruption-aware fine-tuning. Models fine-tuned on this dataset achieve significant gains on OVIBench, validating the effectiveness of our benchmark and data design. OVIBench, OVI-Train, and the evaluation code will be released.

[95] DECO: Depth-Guided Co-Visibility Reasoning for Low-Altitude UAV Visual Localization cs.CVPDF

Yibin Ye, Xichao Teng, Shuo Chen, Xiaokai Song, Dongdong Guan

TL;DR: 本文提出DECO框架，通过单目深度先验推断局部表面几何并估计无人机图像与正射参考地图间的共视区域，结合几何共视性与检测器显著性对关键点进行排序，从而提升低空无人机在GNSS拒止环境下的视觉定位精度。

Details

Motivation: 解决低空无人机视觉定位中，由于正射参考地图主要记录顶部表面（如屋顶、地面）而缺失垂直结构（如立面、墙壁），导致无人机图像中许多视觉显著关键点在参考地图中无有效对应点，从而产生冗余匹配和位姿估计不准确的问题。

Result: 大量实验表明，DECO实现了优越的定位性能，并且能够与不同的深度模型、特征检测器和匹配器集成。

Insight: 创新点在于引入深度引导的共视性推理，通过几何-显著性耦合的共视性评分联合考虑几何共视性和检测器显著性进行关键点排序，保留既视觉显著又几何共视的关键点，从而改进特征匹配和基于PnP的位姿估计。

Abstract: Unmanned aerial vehicles (UAVs) increasingly require robust visual localization in GNSS-denied environments. A common solution estimates UAV poses by matching keypoints between UAV images and geo-tagged orthographic reference maps derived from satellite or aerial imagery, followed by Perspective-(n)-Point (PnP) pose solving. However, such reference maps mainly record top-down surfaces such as roofs and ground planes, while vertical structures such as facades and walls are often compressed or missing. Consequently, many visually distinctive keypoints in low-altitude UAV images have no valid counterparts in the reference map, leading to redundant matches and inaccurate pose estimation. To address this issue, we propose DECO, a DEpth-guided CO-visibility reasoning framework for low-altitude UAV visual localization. DECO uses monocular depth priors to infer local surface geometry and estimate co-visible regions between UAV images and the reference map. Based on this prior, a Geometry-Saliency Coupled Co-visibility Score is introduced to jointly consider geometric co-visibility and detector saliency for keypoint ranking. In this way, DECO retains keypoints that are both visually distinctive and geometrically co-visible, improving feature matching and PnP-based pose estimation. Extensive experiments demonstrate that DECO achieves superior localization performance and can be integrated with different depth models, feature detectors, and matchers. The source code will be available at https://github.com/UAV-AVL/DECO.

[96] Adapting Dense Vision-Language Relationships for Multi-label Classification with Partial Label cs.CVPDF

Cheng Chen, Yifan Zhao, Jia Li

TL;DR: 本文提出了一种语言驱动的密集语义适配器（LDSA），用于解决部分标注下的多标签图像分类问题。该方法利用预训练的CLIP模型挖掘先验自适应关系，通过密集对比适配器和语言驱动交互解码器协同学习，在公共多标签分类基准上取得了新的最优性能。

Details

Motivation: 现有方法依赖强先验假设从部分标注中恢复缺失语义，但统计先验易受不稳定语义错误影响，导致灾难性过拟合。

Result: 在公共多标签分类基准上的实验结果表明，LDSA达到了新的最先进水平（SOTA）。

Insight: 创新点在于提出先验自适应学习方案，通过密集视觉对比约束和类别特定提示调优的语言驱动交互解码器，挖掘隐式语义关系并实现视觉与语言域的自适应对齐。

Abstract: Learning multi-label image classification with incomplete annotations is a challenging task that has been widely studied for its superior trade-off between high efficiency and less labor consumption on large-scale datasets. Predominant methods rely on strong prior assumptions to recover the missing semantics from partial annotations. However, these statistic priors suffer from unstable semantic mistakes and thus lead to catastrophic overfitting. Toward this end, we propose a Language-driven Dense Semantic Adaptor (LDSA) that excavates prior-adaptive relationships from multimodal pretrained CLIP models. In our approach, the densely contrastive adaptor is first proposed to construct dense visual contrastive constraints, transferring the task-specific knowledge to visual domains. We then propose a language-driven interactive decoder with the help of class-specific prompt tuning, which adapts language proxies with visual domains. With the collaborative learning of proposed modules, experimental results demonstrate our proposed LDSA achieves a new state of the art on public multi-label classification benchmarks, and interpretable analyses reveal that our LDSA discovers implicit semantic relationships with the prior-adaptive learning scheme.

[97] MedReaMM: Evaluating Large Multimodal Models on Expert-Level Clinical Diagnostic Synthesis cs.CVPDF

Lai Wei, Yuchao Chen, Zhenbiao Cao, Xiaojin Zhang, Zhongyu Wei

TL;DR: 该论文提出了一个名为MedReaMM的基准测试，专门用于评估大型多模态模型在整合详细患者病史和多种医学图像等异构临床证据后，生成准确鉴别诊断的能力。该基准包含625个经过专家验证的病例，并评估了23个大型多模态模型，发现其诊断准确率普遍低于50%。

Details

Motivation: 现有基准主要关注文本推理或孤立的视觉问答任务，缺乏对临床叙述和医学影像的整体整合，无法评估专家临床判断核心的多模态诊断综合能力。

Result: 在MedReaMM基准上评估了23个大型多模态模型，大多数模型的诊断准确率得分低于50%，凸显了其在多模态诊断综合能力上存在巨大差距。

Insight: 创新点在于构建了一个专注于评估专家级临床诊断综合能力的多模态基准，其病例主要代表罕见、非典型或多系统表现，要求超越常规模式识别的证据整合能力。分析表明，医学知识熟练度、医学图像理解和证据整合能力均与诊断性能高度相关。

Abstract: The application of Large Language Models (LLMs) to diagnostic decision-making has garnered growing interest. However, existing benchmarks largely focus on textual reasoning or isolated visual question-answering (VQA) tasks, lacking holistic integration of clinical narratives and medical imaging, and thus failing to assess the multimodal diagnostic synthesis capability central to expert clinical judgment. To bridge this gap, we introduce MedReaMM, a benchmark specifically designed to evaluate models’ ability to synthesize heterogeneous clinical evidence consisting of detailed patient histories alongside multiple medical images into accurate differential diagnoses under a complete-information paradigm. Constructed from case reports sourced from top-tier medical journals and curated clinical case databases, MedReaMM comprises 625 expert-validated cases with an average of 2.79 medical images per case and a total of 1,042 standardized diagnoses annotated with ICD-11 codes. These cases predominantly represent rare, atypical, or multi-system presentations that demand expert-level evidence integration beyond routine pattern recognition. We evaluate 23 Large Multimodal Models (LMMs) and find that most achieve diagnostic accuracy scores below 50%, underscoring a substantial gap in multimodal diagnostic synthesis capability. Further analysis reveals that medical knowledge proficiency, medical image understanding, and evidence integration are all highly correlated with diagnostic performance.

[98] Multimodal examination answer data with expert-designed Outcome-Based Education rubrics for criterion-level assessment cs.CV | cs.AIPDF

Jahangir Alam SM, Md Khalid Syfullah, Saad Ahmed, Munira Akter Mou, A K Z Rasel Rahman

TL;DR: 本文介绍了一个多模态考试答案数据集，包含来自四所院校415名学生的485份扫描答案，并配有基于成果教育（OBE）的专家设计评分标准元数据。数据集涵盖了9门学科、12种问题模板，每份答案都关联了扫描PDF、随机标识符、学科标签、问题、参考答案、标准定义、表现水平描述、标准分和总分。数据可用于支持基于标准的自动评估、多模态文档理解、标准级反馈和分数预测等研究。

Details

Motivation: 为解决基于成果教育（OBE）评估中缺乏公开、标准化的多模态答案数据集的问题，本文旨在提供一个包含真实学术内容（如手写、打印文本、公式、图表等）和专家设计评分标准的数据集，以支持自动化评估和文档理解研究。

Result: 数据集包含485个答案项，12个评分标准共计47个评估准则，经过数据整合、标签标准化、分数验证和完整性检查，确保了数据的唯一性和一致性，适用于鲁棒性和泛化性研究。

Insight: 创新点在于首次提供了结合多模态扫描答案与详细OBE评分标准元数据的公开数据集，涵盖了真实学术场景中的视觉变异（如光照、压缩、手写差异等），为自动化评估和隐私感知的OBE研究提供了基准资源。

Abstract: This data article describes a multimodal collection of scanned examination answers paired with expert-designed Outcome-Based Education (OBE) grading metadata. The collection contains 485 answer submissions from 415 consenting students at four academic institutions. Eight faculty contributors supplied examination materials covering nine subjects and 12 distinct question templates. Each answer-level item links a scanned PDF to a randomized identifier, subject label, question, model answer, criterion definitions, performance-level descriptions, criterion marks, and a total mark. The 12 rubrics contain 47 criteria in total. The scans retain realistic academic content, including handwriting, printed text, equations, tables, code, figures, sketches, and diagrams. CamScanner, Adobe Scan, and conventional scanners contributed variation in illumination, contrast, orientation, compression, and resolution. Diverse handwriting, crossed-out work, revised calculations, and inserted corrections add further visual variability for robustness and generalization studies. Preparation involved heterogeneous-source consolidation, label and text standardization, score validation, identifier randomization, filename randomization, and JSON-to-PDF integrity checks. An answer-level audit confirmed 485 unique identifiers, 485 unique PDF filenames, agreement between each total mark and its criterion-mark sum, and scores within the applicable rubric maximum. The data can support rubric-aware automated evaluation, multimodal document understanding, criterion-level feedback, score prediction, and privacy-aware OBE assessment research. Access is restricted to research use and is available from the corresponding author upon reasonable request.

[99] Pre-Decoding Acoustic Triage for Budgeted Vision-Language Captioning of Untrimmed Egocentric Video cs.CV | cs.AI | cs.SDPDF

Masoud Jalayer, Changyi Li, Yu Xiao

TL;DR: 本文提出了一种基于音频的预解码筛选方法，用于在预算约束下对未修剪的自我中心视频进行视觉语言描述。该方法利用轻量级音频特征在解码视频帧之前筛选关键窗口，从而减少对昂贵视觉语言模型（VLM）的调用次数，同时保持动作覆盖范围。

Details

Motivation: 当前处理长自我中心视频的方法通常需要频繁调用视觉语言模型，导致成本高昂；现有筛选策略要么均匀采样，要么依赖视觉特征，这反而需要视频解码，与预算约束相悖。

Result: 在EPIC-KITCHENS-100数据集上，该方法在匹配覆盖范围时减少了9-20%的VLM调用；在Ego4D数据集上超过均匀采样，并优于两种最新的视觉关键帧选择器，动作覆盖范围提升了4.0-10.8个百分点。

Insight: 创新点在于将筛选目标从逐帧声音事件检测转向每次动作触发一次，利用冻结的AudioSet预训练特征，无需领域特定的声音事件标签；该方法自然地与令牌压缩或量化结合，实现了高效的音频优先筛选。

Abstract: Automatically analyzing hours-long egocentric video is increasingly essential for progress monitoring, quality control, and safety in logistics, construction, and manufacturing. Yet current pipelines that process short, fixed-size windows with a vision-language model (VLM) are prohibitively expensive because cost scales with the number of model calls. To reduce this cost, prior work proposes triage policies to select which windows merit a VLM invocation. However, these policies either sample uniformly or rank windows using visual features, which ironically requires the video decoding that the budget constraints are meant to avoid. We propose audio-first triage: select windows using the lightest modality, scored before any video frame is decoded, so the approach composes naturally with token compression or quantization. The novelty lies in the objective, not the representation: rather than a per-frame sound-event detector, we train the selector to trigger once per action. This objective shift improves action coverage by 4.0-10.8 percentage points across all evaluated call rates, using frozen AudioSet-pretrained features without domain-specific sound-event labels. Using fewer than half of the available calls, the triage cuts 9-20% of VLM calls at matched coverage on EPIC-KITCHENS-100 (EK-100), surpasses uniform sampling through the mid-range on Ego4D over 247 clips, and outperforms two recent visual keyframe selectors. Code, the reference implementation and every results file this manuscript reads are at https://github.com/masjalayer/PreDecoding-AcousticTriage.

[100] When Do VLMs Help Arabic Manuscript OCR? A Cross-Dataset Study cs.CVPDF

Moshiur Farazi, Firoj Alam, Abderrahmane Maaradji, Zakaria Maamar, Hamdy Mubarak

TL;DR: 本文评估了传统OCR、通用视觉语言模型（VLMs）、阿拉伯语专用VLMs以及OCR条件化VLM校正方法在八个阿拉伯语文本数据集上的表现，涵盖历史手稿、老旧印刷书籍、清晰印刷品、多领域文档和手写体。研究发现，没有单一方法在所有场景中占优，并提出了OCR先验可恢复性原则，以指导自适应OCR-VLM工作流程。

Details

Motivation: 视觉语言模型在文档理解中的应用日益增多，但其在阿拉伯语和伊斯兰手稿识别中的作用尚未得到充分探索，本文旨在填补这一空白。

Result: 在线级历史手稿上，VLMs性能接近Tesseract；在页级手稿图像上，VLMs表现更好；在某些设置中，OCR条件化校正器优于独立OCR和独立VLMs。性能提升或下降取决于OCR先验的可恢复性。

Insight: 核心创新点是提出了OCR先验可恢复性原则：当OCR输出在视觉和文本上可恢复时，OCR条件化能提供锚点供VLM依据图像进行细化，从而提升识别效果。这支持了根据字体、先验可恢复性、长度诊断和失败模式指标等因素进行页面路由的自适应工作流程。

Abstract: Vision-language models (VLMs) are increasingly being used for document understanding, yet their role in Arabic and Islamic manuscript recognition remains underexplored. To address such a gap in this paper, we evaluate traditional OCR, general-purpose VLMs, Arabic-specialized VLMs, and OCR-conditioned VLM correction across eight Arabic text datasets spanning historical manuscripts, aged printed books, clean print, multi-domain documents, and handwriting. The results show that no single approach dominates across setups. On line-level historical manuscripts, VLMs are close to Tesseract; on page-level manuscript images, they perform better; and in several settings, an OCR-conditioned corrector improves over both standalone OCR and standalone VLMs. The central finding is an OCR-prior recoverability principle: OCR conditioning helps when the OCR output remains visually and textually recoverable, providing anchors that the VLM can refine against the image. It improves recognition on aged print, clean print, mixed-domain Arabic, and some Naskh manuscripts, but degrades performance when the prior is script-mismatched or systematically misleading, as in Maghribi manuscripts and realistic student handwriting. Additional diagnostics show that Arabic VLM-OCR is sensitive to diacritics, preprocessing, generation budget, and repetition loops. These findings support an adaptive OCR-VLM workflow that routes pages according to script, OCR-prior recoverability, length diagnostics, and failure-mode indicators.

[101] LiST: Local-Simplex Test-Time LoRA Fusion cs.CVPDF

Yihua Shao, Jia Li, Siyu Chen, Xinyu Luo, Yang Liu

TL;DR: 本文提出LiST，一种无需标签的测试时LoRA融合框架，能够根据单个测试输入动态组合任务特定的LoRA适配器。该方法将LoRA库转换为目标条件局部单纯形，在推理时搜索样本特定的融合权重，通过联合任务表示、邻近适配器检索和分支保留融合实现自适应组合。

Details

Motivation: 现有LoRA适配器组合方法大多是静态的，无法适应个体测试输入，因此需要一种能够动态适应不同测试样本的适配器融合机制。

Result: 在多模态和语言基准测试中，LiST优于静态LoRA合并和传统测试时适应基线，同时保持了任务特定适配器的效用，并提高了在未见任务上的鲁棒性。

Insight: 创新点在于将LoRA融合问题转化为局部单纯形搜索，通过提示级能量函数结合先验、几何和随机一致性约束来选择权重，并设计了安全接受规则和回退机制，实现了无需更新主干或适配器的动态测试时适应。

Abstract: Task-specific LoRA adapters offer a modular way to specialize large language and vision-language models. However, existing adapter composition methods are mostly static and cannot adapt to individual test inputs. To address these issues, we propose \textbf{LiST}, a label-free test-time LoRA fusion framework that converts an existing LoRA bank into a target-conditioned local simplex and searches sample-specific fusion weights at inference time. LiST builds joint task representations from LoRA parameter anchors and prompt-level behavior vectors, retrieves neighboring adapters as a local search space, and performs branch-preserving fusion without updating the backbone or adapters. Candidate weights are selected by a prompt-level energy with prior, geometric, and stochastic-consistency constraints, and are deployed only when they pass a safe acceptance rule. Otherwise, LiST falls back to a target-conditioned prior. Experiments on multimodal and language benchmarks show that LiST outperforms static LoRA merging and conventional test-time adaptation baselines, while preserving task-specific adapter utility and improving robustness on unseen tasks.

[102] DiD It in 87 Minutes: A Label-Free Softmax-to-Linear Adaptation of Vision Transformers for Object Detection cs.CVPDF

Huaiyuan Qin, Gabriel James Goenawan, Zihang Lin, Muli Yang, Hongyuan Zhu

TL;DR: 本文提出了一种名为Detector-Interface Distillation (DiD)的无标签转换方法，用于将已训练好的基于Softmax注意力的视觉Transformer目标检测器主干网络高效地转换为线性注意力版本。该方法通过对齐固定下游检测器所需的接口张量来实现转换，在DOTA-v1.5数据集上性能与全监督训练的线性模型相当，转换过程仅需约87分钟，并能显著降低推理延迟和内存消耗。

Details

Motivation: 将训练好的Softmax注意力ViT检测器主干直接替换为线性注意力会导致严重的性能下降，而通用的无标签蒸馏方法在检测任务上往往失效。核心挑战在于需要保持检测器接口的一致性，即转换后的主干必须精确复现固定下游检测器所期望的特征张量。

Result: 在DOTA-v1.5数据集上，DiD方法显著优于现有基线，并与全监督训练的线性模型性能相当。转换后的线性化主干网络将推理延迟降低了约62%，峰值内存消耗降低了约49%。

Insight: 论文的创新点在于提出了检测器接口蒸馏(DiD)这一接口感知的转换目标，专注于对齐下游检测器的输入特征，而非模仿教师网络的内部隐藏状态。这为社区提供了一种简单、无标签的途径，将训练好的Softmax检测器高效复用为线性注意力版本。

Abstract: While linear attention is a compelling mechanism for high-resolution object detection due to its reduced cost for global token mixing, converting the Softmax-attention ViT backbone of a trained detector into a linear-attention one is not a trivial drop-in replacement. Directly swapping the attention operator leads to severe performance degradation, and generic label-free distillation, though effective for classification, often fails on detection tasks. We argue that the central challenge is \textit{detector-interface preservation}: the converted backbone must reproduce the exact feature tensors expected by the fixed downstream detector, rather than merely imitating internal Softmax hidden states. To address this, we introduce Detector-Interface Distillation (DiD), a label-free conversion method that exclusively trains the linear-attention backbone by aligning detector-facing interface tensors with those of a frozen Softmax teacher. On DOTA-v1.5, DiD substantially outperforms established baselines and matches supervised, fully trained linear models. Adaptation completes in roughly 87 minutes on 4 GPUs, and the linearized backbone cuts inference latency by ~62% and peak memory by ~49%. We hope our findings offer the community a simple, label-free route to reusing trained Softmax detectors as efficient linear ones, and encourage interface-aware objectives in future architecture-conversion work.

[103] M$^3$ISR: A Multi-Modal Multi-View Benchmark for 3D/4D Gaussian Splatting and Feedforward Compression cs.CVPDF

Xinhui Liu, Lei Liu, Zhenghao Chen, Lebin Zhou, Wei Wang

TL;DR: 该论文提出了一个名为M³ISR的合成基准测试，用于评估3D和4D高斯泼溅（3DGS/4DGS）技术。该基准包含25个场景，提供多视图视频、密集真值标注，并设计了五个互补的评估轨道，旨在系统研究基于高斯的自由视点视频重建、压缩和流式传输。

Details

Motivation: 现有真实捕获的多视图视频基准难以隔离相机几何、表示效率和时序冗余等因素的影响，限制了高保真自由视点视频和交互式渲染中显式高斯表示的实际部署。

Result: 基准测试的基线结果显示，静态重建质量差异较小，但表示存储差异显著；评估的流式方法报告的训练或重建成本远高于相应的离线动态重建基线。

Insight: 创新点在于设计了一个受控的合成基准，通过共享中心的相机设计隔离视角变化，并系统定义了3DGS/4DGS的前馈压缩任务及率失真评估框架，为高斯表示的研究提供了互补且可控的测试平台。

Abstract: High-fidelity free-viewpoint video (FVV) and interactive rendering increasingly rely on explicit Gaussian representations, yet practical deployment remains constrained by representation size, dynamic updates, and computational cost. Existing multi-view video benchmarks provide valuable real-captured content, but they make it difficult to isolate the effects of controlled camera geometry, representation efficiency, and temporal redundancy. We introduce M$^3$ISR, a controlled synthetic benchmark for 3D and 4D Gaussian Splatting (3DGS/4DGS). The benchmark contains 25 scenes from five indoor and outdoor scene groups, two camera/motion configurations, six synchronized 1080p views, and dense ground-truth annotations including RGB, camera parameters, depth, semantic and instance segmentation, and static–dynamic masks. The shared-center camera design intentionally isolates angular view variation and enables controlled evaluation of novel-view synthesis and representation efficiency. We organize M$^3$ISR into five complementary tracks covering 3DGS synthesis, 4DGS synthesis, 4DGS streaming, 3DGS compression, and 4DGS compression. Representative baseline results show small differences in static reconstruction quality but substantial differences in representation storage, while the evaluated streaming methods exhibit substantially higher reported training or reconstruction cost than the corresponding offline dynamic reconstruction baselines. We further define feedforward compression tasks for 3DGS and 4DGS and provide reference rate–distortion formulations and preliminary baseline evaluations. The benchmark is intended as a controlled and complementary testbed for systematic study of Gaussian-based FVV reconstruction, compression, and streaming.

[104] HeatTok: Enhancing Remote Sensing Image Understanding via Thermodiffusion-based Tokenization cs.CVPDF

Yingying Yan, Jiaqi Tang, Wei Wei, Qianzhou Wang, Jinjian Wu

TL;DR: 本文提出HeatTok，一种基于热扩散聚合的语义感知分词器，用于增强多模态大语言模型对遥感图像的理解。该方法通过模拟热传导原理自适应合并相邻同质区域，生成语义独立且与对象对齐的不规则分词，并设计了高斯多模态旋转位置嵌入来编码不规则形状的空间分布信息。

Details

Motivation: 当前MLLM中的视觉分词器主要基于图像块划分，在遥感图像中由于地物轮廓不规则，会导致严重的语义混合和对象碎片化问题，且现有自适应方法难以提取精确的对象级分词并缺乏针对不规则区域的几何位置编码。

Result: 在VRSBench和EarthVQA数据集上的广泛评估表明，HeatTok在合理的分词预算下有效保持了对象级语义完整性，并取得了最先进的性能。

Insight: 创新点在于受热传导物理原理启发，提出热扩散聚合机制生成对象对齐的不规则分词，并设计了高斯多模态旋转位置嵌入来显式注入不规则分词的几何信息（中心、尺度和方向），为遥感图像理解提供了更精细的语义表示。

Abstract: Current visual tokenizers in Multimodal Large Language Models (MLLMs) predominantly rely on patch-based partitioning, which causes severe semantic mixture and object fragmentation in remote sensing imagery due to the irregular contours of geo-objects. Moreover, existing adaptive methods struggle to extract precise object-level tokens and lack dedicated geometric positional encodings for irregular regions. In this paper, we propose HeatTok, a semantic-aware tokenizer driven by thermodiffusion aggregation. Inspired by the physical principles of heat conduction, HeatTok adaptively merges adjacent homogeneous regions to generate semantically independent, object-aligned irregular tokens. To enable MLLMs to perceive these irregular shapes, we design the Gaussian Multimodal Rotary Positional Embedding (G-MRoPE), which models token spatial distributions via 2D Gaussians and explicitly injects center, scale, and orientation cues. Extensive evaluations on the VRSBench and EarthVQA datasets demonstrate that HeatTok effectively preserves object-level semantic integrity and achieves state-of-the-art performance under a reasonable token budget. The code is available: https://github.com/YingyingYan1/HeatTok.

[105] Learning Sample-wise Rank-aware Interpolation Weights for Composed Visual Data Retrieval cs.CVPDF

Boseung Jeong, Taegyu Park, Donghyeon Kwon, Hyunsouk Cho, Suha Kwak

TL;DR: 本文提出SRAIN框架，通过动态预测样本感知的线性插值权重来融合视觉和文本模态，用于组合视觉数据检索。该方法在保持检索性能的同时，显著降低了基于多模态大语言模型方法的查询延迟。

Details

Motivation: 现有基于多模态大语言模型的组合检索方法计算复杂、查询延迟高，限制了可扩展性。本文重新审视嵌入空间中简单线性插值的有效性，旨在通过动态预测权重来提升其性能。

Result: 在组合视频检索任务上达到最佳性能，在组合图像检索任务上匹配当前最优水平，同时相比基于MLLM的方法大幅降低了查询延迟。

Insight: 创新点在于提出了训练时的批次级排序感知权重估计和推理时的紧凑记忆库来合成困难负样本，从而解决了最优权重收集和预测的难题，实现了高效且有效的动态插值。

Abstract: At the heart of composed visual data retrieval is the fusion of a reference visual input and a textual modification into a single query. While current state-of-the-art methods utilize multimodal large language models for this fusion, their complexity introduces prohibitive querytime latency, limiting their scalability. We instead revisit the efficacy of simple linear interpolation within an embedding space, and introduce SRAIN, the first framework that dynamically predicts query-specific interpolation weights. The key challenge lies in the fact that the quality of an interpolation weight should be measured by the interpolated embedding’s discriminability from negatives as well as its proximity to true targets; this makes collecting and predicting optimal weights intractable. We overcome this bottleneck through two key innovations: batch-wise rank-aware weight estimation during training, and a compact memory bank that synthesizes hard negatives during inference. SRAIN achieves the best in composed video retrieval and matches the current state of the art in composed image retrieval, all while substantially reducing querytime latency compared to MLLM-based alternatives.

[106] RS$^3$-Prune: Read-Sparse, Store-Sparse Token Pruning for Video Object Segmentation cs.CVPDF

Avilasha Mandal, Sarvesh Shashikumar

TL;DR: 本文提出了RS^3-Prune，一种无需训练的令牌剪枝方法，用于视频目标分割（VOS）模型。该方法通过在现有VOS网络推理时添加少量钩子，在图像编码器与内存注意力读取之间以及内存编码器与内存库之间，分别基于几何信息和目标空间范围，稀疏化查询令牌和存储令牌，从而压缩内存库并提升效率。

Details

Motivation: 现代VOS模型通常为每帧生成密集令牌网格，并在内存库中累积所有历史帧令牌，导致处理长视频或部署在内存受限设备时，面临延迟高和内存占用大的问题。本文旨在通过压缩令牌预算来优化内存库型VOS模型。

Result: 在多个基准测试上，RS^3-Prune实现了高达38.8%的FPS加速，峰值内存使用降低13.1%，同时保持与未修改VOS网络相当的J&F（Jaccard和F-measure）性能。

Insight: 创新点在于提出了一种无需训练、即插即用的令牌剪枝方案，通过精确控制跨帧注意力查询和内存库存储的令牌稀疏性，在保持模型性能的同时显著提升推理效率。该方法为内存库型VOS模型的压缩提供了新思路。

Abstract: We introduce RS$^3$-Prune, a training-free token-pruning recipe that instantiates as a small set of inference time hooks atop existing video object segmentation (VOS) networks. Modern VOS models have converged on a common, expensive design: an image encoder produces a dense token grid for every frame, and a memory bank accumulates these tokens across all previously processed frames to condition future predictions. As a video grows longer, the resulting token budget governs both per-frame latency and peak GPU memory. Hence these models break on use cases such as — long-form video or real-time deployment on memory-bounded accelerators. In this work we argue that the right axis along which to compress memory-bank VOS is the token budget itself. RS$^3$-Prune operates in two precise locations within an arbitrary memory-bank VOS pipeline: at the boundary between the image encoder and the memory-attention readout, where we restrict the queries that participate in the cross-frame attention to only a small, geometrically informed subset; and at the boundary between the memory encoder and the memory bank, where we restrict which tokens are ever permitted to enter the bank to those that lie within the object’s spatial extent. Over various established benchmarks, RS$^3$-Prune delivers up to $38.8%$ FPS speedup and reduces $13.1%$ peak memory usage, while preserving a competitive $\mathcal{J}$&$\mathcal{F}$ compared to the unmodified VOS networks.

[107] TRACE: Temporal Retrieval with Anchored and Convergent Evidence for Long-Horizon Video Understanding cs.CV | cs.CLPDF

Pengyiang Liu, Junbo Niu, Xiaoyang Hu, Zhongyue Shi, Zitian Wang

TL;DR: 该论文提出了VES-Bench，一个包含600个问题、基于348个公开长视频的基准测试，用于评估长视频理解中证据覆盖的完整性。同时，论文提出了TRACE方法，这是一种无需训练的智能体，通过迭代构建证据束并基于答案稳定性来决定停止，以高效且准确地回答长视频问题。

Details

Motivation: 现有长视频问答评估通常只关注最终答案的正确性或预测的证据区间，但缺乏对模型解码帧是否完整覆盖所有必要证据的审计，导致正确答案可能建立在观察不完整的基础上。

Result: 在相同骨干网络的审计下，TRACE在VES-Bench上以每个问题98.7帧的成本，实现了50.7%的问题在所有证据区间内至少覆盖两帧的正确率，比均匀解码128帧（40.2%）高出10个百分点以上，且帧成本仅为均匀解码256帧（53.3%）的0.39倍，同时达到最高答案准确率（63.5%）。TRACE在Video-MME（86.1）、LVBench（75.6）和LongVideoBench（75.1）上也保持竞争力。

Insight: 创新点在于引入了严格的证据覆盖审计基准VES-Bench，以及提出了TRACE这种基于原始视觉片段、通过迭代构建证据束并利用答案稳定性作为停止准则的训练免费方法，实现了在低帧成本下对长视频时序和事件计数任务的高效且可靠的理解。

Abstract: A long-video answer is evidence-supported only when the frames decoded from the video cover every event the answer depends on. Existing evaluations score final-answer correctness or predicted evidence intervals, but the frames a method decodes before answering are rarely audited, so correct answers can still rest on incomplete observation. We introduce VES-Bench, a 600-question benchmark of Temporal Ordering and Event Counting items over 348 public long videos. Each item carries a jointly necessary set of evidence intervals, letting us audit at three strictness levels whether a method’s decoded frames cover every one of them. We also propose TRACE, a training-free agent that grounds answers in raw visual clips, builds an evidence bundle round by round, and stops only when the answer stabilises as the bundle grows and a final pass over the same clips returns the same answer. Under a same-backbone audit, TRACE answers 50.7% of questions correctly with at least two decoded frames inside every evidence interval, at 98.7 frames per question: over 10 points above uniform decoding at 128 frames (40.2%), and within 2.6 points of uniform decoding at 256 frames at 0.39x its frame cost, while reaching the highest answer accuracy in the audit (63.5%). TRACE also stays competitive on Video-MME (86.1), LVBench (75.6), and LongVideoBench (75.1).

[108] Vision-Language Models for Occupational Physical Exposure Assessment: Estimating External Hand Forces in Manual Material Handling Tasks from RGB Video cs.CV | cs.AI | cs.CLPDF

Mohammad Sadra Rajabi, Aanuoluwapo Ojelade, Sunwook Kim, Maury A. Nussbaum

TL;DR: 本文提出了一种基于视觉语言模型（VLM）的流程，用于从RGB视频中估计手动物料搬运任务中动态、三轴、双侧的外部手部受力。该方法结合了任务特定的文本提示、视觉表征和已知的箱子质量，无需在工人或物体上安装传感器。研究通过35名受试者执行五种搬运任务进行评估，结果表明该流程在水平方向力估计上RMSE约为4.7-5.6 N，垂直方向力约为10.6-11.0 N，验证了仅从视频和已知负载质量进行连续手部受力估计的可行性。

Details

Motivation: 在职业物理暴露和损伤风险分析中，外部手部受力是关键输入，但传统连续力测量通常需要仪器化物体或专用传感器，限制了可扩展性。本研究旨在探索一种无需接触式传感器的、基于RGB视频和已知负载质量的受力估计方法。

Result: 在留一受试者交叉验证下，模型在水平方向（前后、左右）的均方根误差约为4.7-5.6 N，垂直方向约为10.6-11.0 N。多摄像头设置对峰值力（尤其是垂直分量）估计有明显提升，而不同摄像头配置在帧级误差上差异相对较小。

Insight: 创新点在于将视觉语言模型与已知负载质量结合，通过文本引导的感兴趣区域定位、预训练视觉Transformer特征提取和基于Transformer的时间回归，实现了仅从RGB视频进行连续、双侧、方向性手部受力估计。该方法避免了传感器需求，为可扩展的职业暴露评估提供了新思路。

Abstract: External hand forces are important inputs to biomechanical analyses of occupational physical exposure and injury risk, yet continuous force measurements during manual material handling (MMH) typically requires instrumented objects or specialized sensing. We evaluated a vision-language model (VLM)-based pipeline that combines task-specific textual cues, visual representations, and known box mass to estimate dynamic, triaxial, bilateral external hand forces from RGB video. Thirty-five healthy young adults performed five MMH tasks involving lifting, carrying, pushing, and pulling with box masses of 6, 9, and 12 kg. The pipeline used text-guided localization of participant and handled-object regions of interest (ROIs), pretrained vision-transformer feature extraction, and transformer-based temporal regression. Performance was evaluated using leave-one-subject-out validation across seven camera-view conditions (three single-view and four multi-view conditions) and four ROI strategies. Overall, root mean square error was ~4.7-5.6 N for the horizontal and mediolateral force components and ~10.6-11.0 N for the vertical component. Including the handled object as a second ROI generally improved force estimation, with some of the largest benefits under single-camera conditions, whereas pixel-level segmentation provided little additional improvement. Multi-camera capture provided the clearest benefit for peak-force estimation, particularly for the vertical component, whereas differences in overall frame-level error among camera configurations were comparatively modest. These findings demonstrate the feasibility of estimating continuous, bilateral, directional hand-force estimates from RGB video and known load mass without requiring sensors on the worker or handled objects as model inputs, supporting the development of more scalable occupational physical exposure and risk assessments.

[109] AI-based worker guidance in assembly and disassembly operations using multimodal ego/exo-centric data capture and structured task knowledge cs.CV | cs.AI | cs.HCPDF

Vivek Chavan, Jörg Krüger

TL;DR: 本文提出了一种基于多模态数据（第一人称和第三人称视频及旁白）的数据中心化方法，用于从专家演示中提取结构化任务知识，以支持装配和拆卸操作中的工人指导。该方法通过联合编码视频和叙述中的时序与多模态信息，生成结构化任务表示，实现了程序化文档记录和上下文感知的工人引导。在一个真实拆卸案例研究中得到验证，表明基于视频的表征能比静态图像方法更好地捕捉程序结构和执行上下文。

Details

Motivation: 装配和拆卸过程依赖难以文档化、重用和传递的专家知识，因此需要一种方法来提取和结构化这些知识以支持工人指导和程序记录。

Result: 在真实拆卸案例研究中，该方法被证明能有效捕捉程序结构和执行上下文，其基于视频的表征优于静态图像方法，展示了在第一人称视频理解方面的潜力。

Insight: 创新点在于联合利用第一人称和第三人称多模态数据（视频和叙述）来提取结构化任务知识，实现上下文感知的工人指导，这为维修、培训和循环制造应用提供了新思路。

Abstract: Assembly and disassembly processes rely on expert knowledge that is difficult to document, reuse, and transfer. This paper presents a data-centric approach for extracting structured task knowledge from expert demonstrations using egocentric and exocentric recordings. Temporal and multimodal information from video and narration is jointly encoded to derive structured task representations that enable procedural documentation and context-aware worker guidance. The approach is evaluated on a real-world disassembly case study, demonstrating that video-based representations capture procedural structure and execution context beyond static image-based methods. The results highlight the potential of egocentric video understanding for repair, training, and circular manufacturing applications. Project website: https://indego-assistant.github.io/

[110] OmniCAD: A Large-Scale Benchmark for 3D Spatial Reasoning in Robotics Assemblies cs.CVPDF

Mingjia Wang, Taiting Lu, Ziwei Dong, Sisong Bei, Jingying Zeng

TL;DR: 本文提出了OmniCAD，一个用于机器人装配中三维空间推理的大规模基准测试，涵盖多种工业系统，包含2.5万个机械装配体，每个装配体平均有12个零件和21种配合关系。该基准评估三个能力：组件级三维空间推理、零件间关系推理以及工具增强的代理推理。实验表明当前视觉语言模型在工业装配推理方面表现不佳，存在姿态不准确、配合关系无效等问题。

Details

Motivation: 当前视觉语言模型在机器人感知和空间推理方面表现出强大能力，但其在复杂机械装配体上的推理能力尚未得到充分探索，因此需要建立一个专门的基准来评估和推动该领域的研究。

Result: 实验结果表明，现有的视觉语言模型在工业装配推理任务上表现不佳，经常产生不准确的姿态、无效的配合关系、零件穿透等问题，并且随着装配复杂度的增加性能下降。

Insight: 论文的创新点在于创建了一个大规模、多样化的机械装配体三维空间推理基准，并定义了三个层次的评估任务，特别是引入了工具增强的迭代推理范式，为评估和提升模型在复杂物理环境下的精确、有效推理能力提供了新的方向。

Abstract: Recent vision-language models (VLMs) show strong capabilities in robotic perception and spatial reasoning, yet their ability to reason about complex mechanical assemblies remains underexplored. We introduce OmniCAD, a large-scale benchmark for assembly-aware 3D spatial reasoning across diverse industrial systems, including robotic mechanisms, automotive components, aerospace structures, and agricultural machinery. OmniCAD contains 25k mechanical assemblies, with an average of 12 parts per assembly and 21 types of mate relationships. Each assembly includes a human-verified ground-truth 3D model and renderings from 20 viewpoints. The benchmark evaluates three capabilities: (1) component-level 3D spatial reasoning, requiring prediction of part positions and orientations; (2) part-to-part relational reasoning, requiring identification of mating relationships and assembly constraints; and (3) tool-augmented agentic reasoning, where models iteratively select viewpoints, inspect visual evidence, and refine predictions. Experiments show that current VLMs struggle with industrial assembly reasoning, often producing inaccurate poses, invalid mating relationships, part interpenetration, and degraded performance as assembly complexity increases. We will open-source the benchmark, evaluation code, and tool interfaces to support research on accurate, physically valid, and scalable 3D assembly reasoning.

[111] Multiple View Neural Regression of a Facial Shape Model cs.CVPDF

Xiang Li

TL;DR: 本文探讨了通过多视角神经回归方法高效生成可用于动画制作的拓扑结构化的3D面部网格。研究内容包括开发VarIS光球系统用于高分辨率面部捕捉、分析相机参数对2D/3D特征点标注的影响、利用合成数据训练神经网络，以及改进多视角面部形状回归技术。最终提出一个深度学习框架，能够从合成多视角图像直接预测出可直接用于绑定的标准化面部网格。

Details

Motivation: 传统方法创建可用于高质量动画的、具有良好拓扑结构的3D面部网格费时费力。因此，研究旨在探索更高效、可扩展的方法，以自动化或半自动化的方式从多视角图像中直接生成可直接用于动画制作的生产级面部网格，减少人工干预。

Result: 结果表明，在神经网络回归中，结合精确的相机内参和外参可以提高面部特征点标注的准确性和几何一致性。同时，使用3D特征点正则化技术可以进一步提升面部重建的质量。系统能够生成标准化的网格，为后续的骨骼绑定和动画制作做好准备。

Insight: 主要创新点在于提出了一个端到端的深度学习框架，利用内部开发的基于物理的渲染系统（Visage Craft）和外观3D形变模型（A3DMM）生成合成多视角数据，从而直接回归出拓扑结构化的面部网格。该方法将高成本的物理捕捉系统（VarIS）的优势转化为一个更可扩展的数据驱动解决方案，并通过合成数据训练和相机参数优化来提升模型性能。

Abstract: Creating re-topologized 3D facial meshes is essential for high-quality facial animation but remains labor-intensive and time-consuming. This dissertation explores more efficient approaches for capturing production-ready facial meshes through: (1) the development of VarIS, a custom light sphere for capturing high-resolution stereo geometry and reflectance maps; (2) analysis of camera parameters affecting automatic 2D and 3D landmarking; (3) synthetic-data methods for training neural face regression; and (4) techniques for improving neural multi-view face-shape regression. While VarIS enables photorealistic face capture, its operational and processing costs motivate a more scalable approach. A deep learning framework is therefore proposed to directly predict re-topologized facial meshes from synthetic multiview images generated with Visage Craft, an in-house physically based rendering system using an Appearance 3D Morphable Model (A3DMM). The system produces standardized meshes ready for rigging and animation with minimal human supervision. Results show that incorporating accurate camera intrinsics and extrinsics improves landmark accuracy and geometric consistency, while 3D landmark regularization further improves reconstruction quality.

[112] Hyperbolic Hierarchical Clustering for Visual Representation Learning cs.CV | cs.AIPDF

Jianan Wei, Guikun Chen, Zhiyuan Weng, Chunchao Guo, Yujia Wang

TL;DR: 本文提出了一种基于聚类范式的透明化token mixer——ClusterMixer，并将其集成到新的视觉骨干网络HCFormer中。该方法通过在双曲空间中进行层次聚类来显式地建模图像块之间的信息交换过程，旨在解决现有主流token mixer（如卷积、注意力等）的黑盒性和缺乏可解释性问题。实验表明，HCFormer在图像分类、目标检测、实例分割和语义分割等多种任务上均优于同类模型。

Details

Motivation: 现有视觉骨干网络（如Vision Transformer）中的token mixer（如卷积、注意力、MLP或其混合）主要权衡精度与计算成本，但其编码过程是黑盒的，缺乏可解释性。本文旨在设计一种透明且可解释的token mixer。

Result: 在图像分类、目标检测、实例分割和语义分割等多样化任务上进行了广泛实验，结果表明HCFormer始终优于其同类模型。

Insight: 核心创新点是将经典的聚类方法重新引入视觉表示学习，并利用双曲空间（hyperbolic space）的自然特性来嵌入视觉数据固有的树状层次结构，从而构建了一个设计上可解释的透明化token mixer（ClusterMixer）及相应的骨干网络（HCFormer）。

Abstract: We investigate the token mixer in vision backbones by revisiting clustering, one of the most classic approaches in machine learning. An effective token mixer is a fundamental component of modern vision backbones like vision Transformers, facilitating information exchange between image patches. Mainstream token mixers, which rely on convolution, attention, MLP, or their hybrids, primarily focus on navigating the trade-off between accuracy and computational cost. However, a significant drawback of these methods is their black-box nature; their encoding process is opaque and lacks interpretability. Diverging from these opaque designs, we introduce ClusterMixer, a transparent token mixer that is grounded in a clustering paradigm and interpretable by design. ClusterMixer explicitly formulates the token mixing process through a hierarchical clustering mechanism. To model the natural, tree-like relationships inherent in visual data, the clustering is performed in hyperbolic space, which is well-suited for embedding hierarchies with low distortion. Building on this innovation, we present HCFormer, a new backbone architecture that integrates ClusterMixer with a series of meticulously designed clustering strategies to ensure robust performance across tasks. Extensive experiments demonstrate that HCFormer consistently outperforms its counterparts across diverse tasks, including image classification, object detection, instance segmentation, and semantic segmentation. Considering its transparency and efficacy, we hope HCFormer can facilitate a paradigm shift toward interpretable backbones.

[113] MorphoCLIP: Text-Supervised Contrastive Learning for Perturbation Matching in Cell Painting Images cs.CVPDF

Sukhrobbek Ilyosbekov, Shubham Gajjar, Rongfei Jin

TL;DR: MorphoCLIP是一种基于文本监督的对比学习模型，用于在细胞绘画图像中匹配化学或遗传扰动。该模型通过冻结视觉和语言主干网络，仅训练紧凑的跨通道模块和投影层，实现了在单个消费级GPU上的训练。在CPJUMP1数据集上的实验表明，该模型能够有效地从细胞图像检索扰动描述，以及从描述检索匹配的细胞图像。

Details

Motivation: 细胞绘画显微技术捕获细胞在化学或遗传扰动后的变化，但生物效应微妙且技术变异大，使得从图像连接到扰动变得困难。本文旨在通过文本监督的对比学习，连接细胞绘画图像与化合物、CRISPR敲除和ORF过表达的文本描述，以简化大规模成像筛选的搜索和解释。

Result: 在CPJUMP1数据集上的实验显示，MorphoCLIP在双向检索任务中，正确匹配出现在前十结果的频率显著高于随机预期。尽管添加重复对齐损失提高了重复实验间的一致性，但尚未转化为可靠的基因-化合物匹配。基因感知标签和板校正未带来一致的检索收益。

Insight: 创新点在于将文本监督的对比学习（CLIP范式）应用于细胞图像与扰动描述的跨模态匹配，并通过冻结主干、仅训练轻量模块实现了高效训练。客观分析表明，文本监督有助于组织化学和遗传的细胞绘画数据，但将化合物与遗传扰动匹配仍是一个开放问题。

Abstract: Cell Painting microscopy captures how cells change after a chemical or genetic perturbation. Connecting these images to the perturbations that produced them could make large imaging screens easier to search and interpret, but the task remains difficult because biological effects are subtle and technical variation is substantial. We introduce MorphoCLIP, a contrastive model that links Cell Painting profiles with text descriptions of compounds, CRISPR knockouts, and ORF overexpressions. The model keeps its vision and language backbones frozen and trains only a compact cross-channel module and projection layers, so it can be trained on a single consumer GPU. On held-out CPJUMP1 data, MorphoCLIP searches in both directions: from a cell image to its perturbation description and from a description to matching cell images. In both cases, a correct match appears among the top ten results much more often than expected by chance. Adding a replicate-alignment loss makes profiles from repeated experiments more consistent, although this improvement does not yet translate into reliable gene-compound matching. Gene-aware labels and plate correction also show no consistent retrieval benefit. These findings suggest that text supervision can help organize chemical and genetic Cell Painting data. Matching compounds with genetic perturbations, however, remains an open problem.

[114] Object-Uni: A Unified Model for Object-Centric Spatial Understanding and Controllable Generation cs.CV | cs.AIPDF

Mining Tan, Yinuo Wang, Ziqi Zhou, Weize Quan, Sifei Li

TL;DR: 本文提出了Object-Uni，一个专注于物体中心空间理解与可控生成的统一模型。它将物体姿态作为一个显式的几何变量，连接了姿态感知、空间推理、姿态条件生成和物体中心新视角合成等任务。

Details

Motivation: 现有统一视觉理解与生成的模型缺乏对物体实例空间状态（如连续姿态）的精确理解和几何一致的可控生成能力，本文旨在解决这一问题。

Result: 实验表明，该模型在物体级姿态理解和姿态可控生成方面均有提升，推动统一模型从描述物体向操控其空间状态发展。

Insight: 核心创新点在于将物体姿态作为连接理解与生成的共享显式几何变量，并提出了基于视点的方向抽象方法，使姿态能被多模态大语言模型使用。同时构建了物体中心空间基准UniSpatial-80K，并采用基于物体令牌的姿态锚点进行统一训练。

Abstract: Unified models for visual understanding and generation have made rapid progress, yet they still lack the ability to understand and manipulate the spatial states of object instances. Existing models can describe objects in natural language, but they struggle to precisely represent continuous object poses and generate geometrically consistent images under target viewpoints. To mitigate this, we propose \emph{Object-Uni}, a unified model for object-centric spatial understanding and controllable generation. Specifically, we formulate object-centric spatial intelligence as a unified problem connecting pose perception, spatial reasoning, pose-conditioned generation, and object-centric novel view synthesis. We treat object pose as an explicit geometric variable shared by understanding and generation, rather than merely a prediction label or control signal. To make pose usable by multimodal large language models, we propose a viewpoint-based orientation abstraction that maps orientation into structured viewpoint descriptions while preserving continuous geometric supervision. We further construct an object-centric spatial benchmark (UniSpatial-80K) and train a unified model with an object-token-grounded pose anchor to associate each instance with its pose state. Experiments show that our model improves object-level pose understanding and pose-controllable generation, moving unified models from describing objects toward manipulating spatial states.

[115] Can We Perform Online RL for Image Editing without Editing Rewards? cs.CVPDF

Qichao Ma, Jikang Cheng, Ling Liang, Zhaofei Yu, Tiejun Huang

TL;DR: 本文提出了一种无需专门编辑奖励即可进行在线强化学习（RL）图像编辑的方法。通过将图像编辑任务映射到成熟的文本到图像（T2I）生成奖励生态系统中，并引入一个两阶段框架Lever-Edit来学习与奖励对齐的描述生成器，从而仅使用转移的T2I奖励来优化编辑策略。

Details

Motivation: 动机在于解决基于RL的图像编辑因需要特定编辑奖励（依赖于成本高昂的三元组监督和复杂的任务校准）而发展受限的问题，旨在利用T2I生成中成熟且多样的奖励生态系统来扩展RL优化可访问的视觉偏好范围。

Result: 实验表明，该方法在编辑对齐和源图像保持方面与基于编辑奖励的微调方法具有竞争力，同时优于直观的转移基线方法。

Insight: 核心创新点在于提出了将图像编辑维度（如图像质量、提示跟随、参考一致性）映射到T2I奖励空间的可行性，并设计了Lever-Edit框架来学习生成与冻结T2I奖励兼容的反事实目标描述，从而实现了无需专门编辑奖励的RL优化。

Abstract: Reinforcement learning (RL) enables direct preference optimization for image editing through editing-specific rewards, which remain less developed due to costly triplet supervision and complex task-dependent calibration. In contrast, text-to-image (T2I) generation benefits from a mature and diverse reward ecosystem spanning semantic alignment, aesthetics, realism, glyph shape, and other visual preferences. Extending this ecosystem to image editing would substantially broaden the range of visual preferences accessible to RL-based optimization, prompting the central question: \emph{Can We Perform Image Editing RL without Editing Rewards?} In this paper, we argue that the standard image editing dimensions have potential to be mapped to the T2I reward space: image quality can transfer directly, prompt following can be aligned through a description of the desired visual state, and reference consistency admits a coarse semantic conversion by encoding the source content to preserve. However, editing instructions specify relative changes, whereas T2I rewards require self-contained target descriptions; moreover, semantically valid captions from generic vision-language models may be incompatible with the frozen reward. Hence, we further introduce Lever-Edit, a two-stage framework that learns a reward-aligned captioner for counterfactual target descriptions, freezes it, and optimizes the editing policy solely with the transferred T2I reward. Experiments show competitive editing alignment and source preservation against editing-reward-based fine-tuning, while outperforming intuitive transfer baselines.

[116] OmicSync: Reliability-Aware Spatial Multi-Omics Clustering with Evidence-Constrained LLM Reasoning cs.CVPDF

Rabeya Tus Sadia, Qiang Ye, Qiang Cheng

TL;DR: 本文提出了OmicSync，一个可靠性感知的空间多组学聚类框架，它结合了无监督聚类与基于证据约束的大语言模型推理，以提供聚类分配的可信度、模态贡献和可解释性。该框架进一步通过OmicSync-R版本，利用推理质量分数作为强化学习奖励，形成推理-聚类的闭环优化，从而提升聚类性能。

Details

Motivation: 现有空间多组学领域发现方法通常只提供聚类结果，缺乏对分配可靠性、各模态贡献以及决策可信度的解释，OmicSync旨在解决这一可解释性与可靠性不足的问题。

Result: 在四个10x CytAssist FFPE空间蛋白质组学基准测试中，OmicSync在Human Tonsil、Glioblastoma和Tonsil Add-on数据集上取得了最佳平均排名，在Human Breast Cancer上排名第二；OmicSync-R进一步将Human Breast Cancer的ARI从45.73提升至46.72，并在九项聚类指标中的六项上超越了现有方法。

Insight: 创新点在于将无监督聚类与证据约束的LLM推理相结合，生成多种形式的可解释性输出，并通过强化学习奖励机制（OmicSync-R）实现推理质量对潜在结构的闭环优化，而无需通过语言模型反向传播，这为构建可审计、可靠性感知的空间分析提供了新思路。

Abstract: Spatial multi-omics technologies jointly profile gene expression, surface proteins, and histology at each tissue spot, yet most spatial domain discovery methods provide only cluster assignments, without indicating assignment reliability, modality contributions, or why a domain decision should be trusted. We present OmicSync, a reliability-aware spatial multi-omics framework that couples unsupervised domain clustering with evidence-constrained LLM reasoning using model-derived per-spot signals, including assignment confidence, epistemic routing uncertainty, and modality-routing weights. These signals are converted into structured evidence dictionaries and used to generate standard, stepwise, counterfactual, contrastive, and uncertainty-focused explanations. OmicSync integrates a KAN-GCN backbone with spatial encoding, cross-modal fusion, uncertainty-aware routing, cell-type supervision, and missing-modality imputation. We further introduce OmicSync-R, which closes the reasoning-clustering loop by using automatically computed reasoning-quality scores as REINFORCE rewards, allowing reasoning coherence to shape the latent structure without backpropagating through the language model. Across four 10x CytAssist FFPE spatial proteomics benchmarks, OmicSync achieves the best average rank on Human Tonsil (1.44), Glioblastoma (1.78), and Tonsil Add-on (1.22), and second-best on Human Breast Cancer (2.33). OmicSync-R further improves ARI on Human Breast Cancer from 45.73 to 46.72 and outperforms existing methods on six of nine clustering metrics. Together, OmicSync and OmicSync-R enable reliability-aware, spot-level auditable spatial domain discovery guided by evidence-constrained reasoning.

[117] GuidedFlow: An Attention-Guided Framework for Anomaly Detection in Additive Manufacturing cs.CV | cs.LGPDF

Sosmita Paul, Krishna Roy

TL;DR: 本文提出了一种名为GuidedFlow的注意力引导归一化流模型，用于增材制造（3D打印）中的异常检测与定位。该方法利用预训练的ResNet模型，并引入时空注意力网络（SAN）来引导流模型关注输入帧中的关键上下文线索，从而更好地建模多尺度和多帧的动态信息。

Details

Motivation: 增材制造中的质量控制至关重要，但现有基于归一化流的方法在处理3D打印中常见的微小/拉丝缺陷时存在局限性，尤其是在小数据场景下泛化能力不足。

Result: 在自建的AM3D-AD数据集和工业图像异常检测基准MVTec-AD上进行的实验表明，GuidedFlow在检测精度和AUROC指标上超越了大多数最先进（SOTA）模型。

Insight: 主要创新点在于提出了一个注意力引导的时空流框架，通过SAN机制使模型能自适应地聚焦于相关上下文信息，这提升了模型对微小缺陷的敏感性和在小数据下的泛化能力。

Abstract: Additive Manufacturing (AM) plays a vital role in the ongoing industrial revolution. However, quality control remains crucial and challenging due to printing defects or potential cyber-physical intrusions. Image or video-based anomaly detection is a key effort towards addressing these challenges. Various approaches have been explored in this domain, including reconstruction-based, embedding-based, and flow-based methods. Though normalizing flow-based methods address some of the core challenges of unforeseen defects and generalization while maintaining detection performance, existing approaches struggle with tiny/stringing defects common in 3D printing. In a small-data setting, this poses a limitation in generalization. To address these limitations, we propose \textbf{GuidedFlow}, a novel attention-guided normalizing flow model for anomaly detection and localization. GuidedFlow employs a pre-trained ResNet model, fine-tuned on the domain dataset. An attention-guided spatial and temporal flow framework models the dynamics across multiple scales and frames. A Spatio-Temporal Attention Network (SAN) enables the flow model to prioritize relevant contextual cues from input frames. We evaluate GuidedFlow on our AM3D-AD dataset, consisting of benign and anomalous real 3D printed object images and videos. We also conduct a comparative study using the MVTec-AD industrial image anomaly detection dataset. Experimental results demonstrate that GuidedFlow outperforms most of the state-of-the-art models with enhanced detection accuracy and AUROC.

[118] SiZeUp: Fast 3D Proxy from Aerial Images via Depth Ordinal Loss cs.CVPDF

Wenjun Zhou, Yunshan Li, Qiaoyu Zhu, Weidan Xiong, Hao Zhang

TL;DR: SiZeUp是一种从倾斜航拍图像快速构建大规模3D城市代理模型的方法。它采用高度-轮廓表示法，将3D建筑抽象简化为低维优化问题，通过可微分渲染器和序数深度一致性损失来估计建筑高度，避免了显式特征匹配或密集点云重建。

Details

Motivation: 解决从航拍图像快速、可扩展地构建大规模3D城市代理模型的挑战，传统方法依赖密集重建或特征匹配，计算成本高。

Result: 在代理级覆盖率和体积一致性方面与最先进的代理重建流程相当，同时实现了23-52倍的加速，适用于大规模城市建模任务。

Insight: 创新点包括高度-轮廓表示法降低优化维度、序数深度一致性损失利用相对深度排序提供稳定监督、可微分渲染器实现梯度传播，以及动态视图选择提升效率。

Abstract: We present SiZeUp, a fast and scalable approach for constructing large-scale 3D urban proxy models directly from calibrated oblique aerial imagery. Our method adopts a height-from-footprint representation, reducing 3D building abstraction to a low-dimensional optimization problem in which building footprints are extruded by a single height parameter. To enable efficient and robust height estimation, we introduce an ordinal depth consistency loss that enforces agreement between the relative depth ordering of rendered proxies and depth priors predicted by a monocular depth model. This is realized through a differentiable renderer that maps parametric building proxies into multi-view depth images, allowing gradients to be propagated from depth supervision to building heights. Our ordinal formulation produces stable optimization in practice and avoids explicit feature matching or dense point cloud reconstruction. Rather than relying on metric depth, which can be unreliable under monocular scale ambiguity, our ordinal depth consistency loss operates on relative depths, providing a more reliable signal across views. Combined with an efficient dynamic view selection, our approach achieves a 23-52$\times$ speedup over state-of-the-art proxy reconstruction pipelines while maintaining comparable proxy-level coverage and volume consistency, making it well suited for large-scale urban modeling tasks.

[119] Direct, Parallel, or Sequential? A Comparative Study of Training-Free Multi-Subject Image-to-Video Generation cs.CVPDF

Yanliang Qi, Kexi Chen, Muchao Ye, Haomiao Ni

TL;DR: 本文系统比较了三种无需训练的多主体图像到视频生成范式：直接生成、并行生成和顺序生成。直接生成将完整参考图像和提示输入预训练模型；并行生成将多主体分解后独立生成再合成；顺序生成则先合成背景，再逐步引入主体。研究评估了它们在多主体场景下的外观保持、运动保真度、时间一致性和主体间连贯性。

Details

Motivation: 解决文本条件图像到视频生成中，多主体视频生成面临的挑战，即同时保持每个主体的外观、分配不同运动并维持时空交互的连贯性。

Result: 在多种多主体场景下进行了实证评估，比较了三种范式在外观保持、运动保真度、时间一致性和主体间连贯性方面的表现，并分析了它们各自不同的失败模式。

Insight: 创新点在于对三种无需训练的多主体I2V生成范式进行了系统性比较研究，揭示了各自的优势和局限性，为设计可控的多主体视频生成系统提供了实用见解。从客观角度看，其将复杂任务分解为不同策略并进行对比分析的方法论具有借鉴意义。

Abstract: Text-conditioned image-to-video (I2V) generation has advanced rapidly, yet generating videos with multiple subjects remains challenging. A model must simultaneously preserve the appearance of each subject, assign distinct motions, and maintain coherent spatial and temporal interactions. This paper presents a systematic study of three representative paradigms for training-free multi-subject I2V generation: direct, parallel, and sequential generation. Direct generation applies a pretrained I2V model to the complete reference image and prompt, requiring all subjects and motions to be synthesized jointly. Parallel and sequential generation instead decompose the reference image and prompt into subject-specific visual and textual conditions. Parallel generation synthesizes each subject independently and subsequently composes the resulting videos, reducing the complexity of each generation step at the cost of weaker inter-subject context. Sequential generation first synthesizes a background video and then progressively introduces individual subjects. This preserves accumulated scene context but introduces sensitivity to subject ordering and error propagation. We empirically evaluate the three paradigms across diverse multi-subject scenes, comparing appearance preservation, motion fidelity, temporal consistency, and inter-subject coherence, while also characterizing their distinct failure modes. Our findings reveal the strengths and limitations of each paradigm and offer practical insights for designing controllable multi-subject video generation systems.

[120] Following Motion for Sequential Modeling in Video Frame Interpolation cs.CVPDF

Jaehyun Park, Nam Ik Cho

TL;DR: 本文提出了一种名为MGMVFI的视频帧插值方法，该方法基于选择性状态空间模型（SSM/Mamba），并针对视频帧插值中动态运动轨迹建模的挑战进行了改进。核心创新在于引入了运动引导序列化（MGS），利用光流定义与运动自适应的1D输入顺序，以及上下文合成模块来增强特征鲁棒性。

Details

Motivation: 现有基于状态空间模型（SSMs）的视频帧插值方法，其预定义的扫描顺序限制了其对视频中动态运动轨迹的有效建模能力。

Result: 在标准视频帧插值基准测试上的大量实验表明，MGMVFI取得了最先进的（SOTA）性能，尤其是在处理复杂和动态运动时表现突出。

Insight: 主要创新点是将运动信息（光流）引入到状态空间模型的序列化过程中，使状态更新与语义相关的token对齐，从而实现运动一致的特征传播。同时，通过上下文合成模块弥补了不准确光流估计带来的问题，并使用轻量级细化块以较低计算成本提升局部细节重建。

Abstract: State Space Models (SSMs) have surfaced as a promising architecture in Video Frame Interpolation (VFI), as they can capture long-range dependencies with linear computational complexity. However, their predefined scanning order limits their effectiveness in modeling the dynamic motion trajectories inherent in VFI problems. To tackle this challenge, we propose Motion-Guided Mamba for Video Frame Interpolation (MGMVFI), an adaptation of the selective state space model tailored explicitly for VFI. MGMVFI introduces Motion-Guided Serialization (MGS), which leverages optical flow to define a motion-adaptive 1D input order for the SSM. This aligns the causal state updates with semantically related tokens, enabling motion-consistent feature propagation, particularly for large and dynamic motions. Additionally, to mitigate the unreliable feature representations caused by inaccurate optical flow estimates, we introduce contextual synthesis that utilizes the surrounding spatial context for robust inter-frame feature synthesis. These components are seamlessly integrated within our tailored Mamba architecture, which also employs a lightweight refinement block to enhance local detail reconstruction at a reduced computational cost. Extensive experiments on standard VFI benchmarks demonstrate that MGMVFI achievesstate-of-the-artperformance,particularly on complex and dynamic motions, thereby establishing a new direction for sequence modeling in video interpolation.

[121] Large-Small Model Collaboration for Zero-Shot Surgical Phase Recognition cs.CVPDF

Yiyi Zhang, Ying Zheng, Wenxin Fan, Yu Zhu, Yuchen Yuan

TL;DR: 本文提出了一种名为LaST（Large-Small Temporal adaptation）的大-小模型协作框架，用于解决手术阶段识别的零样本领域适应问题。该框架结合了手术基础模型（FM）的强泛化能力和轻量级时序模型的时序建模优势，通过迭代时序精炼和循环重放策略，在未见过的临床领域实现了鲁棒的零样本适应。

Details

Motivation: 解决手术阶段识别中，轻量级时序模型泛化能力差，而大规模预训练的基础模型缺乏显式时序建模导致预测不一致的问题，旨在结合两者的互补优势。

Result: 在零样本手术阶段识别任务上，LaST在未见领域上的准确率比基线（PeskaVLP）高出24.85%至43.17%，甚至超过了全监督线性探测和一些最先进的少样本方法，达到了SOTA水平。

Insight: 创新点在于提出了一个协同框架，通过迭代时序精炼（结合动态质量控制和双模型交叉学习）和循环重放策略，利用大模型的先验和小模型的时序能力相互促进，实现了标签质量和模型能力的自我增强式进化。

Abstract: Task-specific lightweight models for surgical phase recognition excel at capturing temporal dynamics but generalize poorly under domain shift. Conversely, surgical foundation models (FMs) offer superior transferability via large-scale pretraining, yet their lack of explicit temporal modeling often yields temporally inconsistent predictions, leading to degraded performance. To exploit the complementary strengths of both paradigms, we propose \textbf{La}rge-\textbf{S}mall \textbf{T}emporal adaptation (\textbf{LaST}), a novel large-small collaborative framework that enables zero-shot adaptation to unseen clinical domains. In LaST, the FM initiates the pipeline by generating frame-level phase priors that serve as initial weak supervision. To effectively utilize these noisy phase priors, we introduce an iterative temporal refinement scheme that integrates dynamic quality control to filter reliable predictions and dual-model cross-learning to mitigate confirmation bias. Simultaneously, the lightweight model leverages its intrinsic temporal modeling ability to progressively correct inconsistent predictions and enhance overall accuracy across iterations. At the end, a cycle replay strategy is employed to close the loop: the refined, more accurate predictions are utilized as upgraded supervision signals for the subsequent iterations, fostering a self-reinforcing evolution of both label quality and model capability. Extensive experiments demonstrate that LaST achieves robust adaptation to unseen domains for zero-shot surgical phase recognition, outperforming the baseline (PeskaVLP) by 24.85%-43.17% in accuracy and even surpassing fully supervised linear probing and several state-of-the-art few-shot approaches. Codes will be released at https://github.com/YIYIZH/LaST.

[122] FOVEA: Focused On-Demand Visual Evidence Adaptation for Cache-Friendly Multimodal Speculative Decoding cs.CVPDF

Hengjie Zhu, Dayan Wu, Zihao Zhang, Xinze Liu, Jingxuan Yu

TL;DR: 本文提出FOVEA方法，用于加速视觉语言模型的多模态推测解码。该方法通过构建可重用的视觉记忆，并根据解码状态动态检索有界视觉证据子集，以轻量级门控残差校正融合视觉信息，从而提升草稿接受率和端到端解码速度。

Details

Motivation: 现有方法通常使用固定的视觉接口（如预定义视觉令牌预算或静态压缩表示）来指导草稿模型，但视觉需求在不同任务和解码阶段差异显著，过多或过少的视觉输入均会损害性能。

Result: 在多个视觉语言骨干模型和多模态基准测试上，FOVEA提高了草稿接受率，端到端解码速度相比自回归解码最高加速2.13倍。

Insight: 创新点在于提出状态条件证据检索机制，动态按需选择视觉证据，并通过轻量级门控残差校正修改语言模型头的输入表示，而非将视觉令牌插入自回归上下文，这提供了替代固定视觉表示重用的有效方案。

Abstract: Multimodal speculative decoding accelerates vision-language models by allowing a lightweight draft model to propose candidate tokens for parallel verification by a larger target model. Existing methods typically condition the drafter on a fixed visual interface, such as a predefined visual-token budget or a static compressed representation. However, our controlled visual-budget analysis shows that visual demand varies substantially across tasks and decoding stages, which means more visual input is not always beneficial. Actually, insufficient evidence may weaken visual grounding, while excessive context adds overhead and may disrupt drafting. We propose FOVEA (Focused On-demand Visual Evidence Adaptation), a cache-friendly approach that builds a reusable visual memory and dynamically retrieves a bounded subset for a draft state. A cumulative-mass rule determines both how many and which entries are selected. The selected entries are aggregated into a visual readout and fused with the current draft hidden state through a lightweight gated residual correction. Rather than inserting visual tokens into the autoregressive context, the correction modifies only the representation passed to the language-model head. Experiments across multiple vision-language backbones and multimodal benchmarks show that FOVEA improves draft acceptance and end-to-end decoding speed, achieving up to $2.13\times$ speedup over autoregressive decoding. These results demonstrate that state-conditioned evidence retrieval is an effective alternative to reusing a fixed visual representation throughout multimodal generation.

[123] DRAgent: Discriminative Reasoning Agent for Referring Expression Segmentation cs.CVPDF

Yujie Qi, Luyan Zhang

TL;DR: 本文提出DRAgent，一种基于多模态大语言模型（MLLM）的判别式推理框架，用于指代表达式分割（RES）。该方法不直接让MLLM生成坐标，而是先构建检测器生成的候选框空间，然后利用MLLM作为视觉-语义目标判别器，通过两阶段推理筛选目标，最后用选中的目标框作为空间提示输入基础分割模型生成像素级掩码。

Details

Motivation: 解决现有基于MLLM的RES方法依赖一次性坐标预测，将连续空间位置序列化为离散文本标记，导致定位偏差和对齐错误的问题。

Result: 在RefCOCO、RefCOCO+和RefCOCOg基准测试上取得了有竞争力的性能。

Insight: 创新点在于将MLLM的角色从坐标生成器转变为候选目标判别器，通过两阶段判别式推理（高召回筛选和实例级验证）提高定位可靠性，并设计了基于自一致性过滤的推理链数据管道用于LoRA微调以增强MLLM的判别推理能力。

Abstract: Referring Expression Segmentation (RES) aims to generate a pixel-level mask for the object specified by a language expression. Recent methods based on multimodal large language models (MLLMs) often rely on one-pass coordinate prediction for visual localization, which serializes continuous spatial locations as discrete text tokens and may lead to localization bias and alignment errors. To address these issues, we propose DRAgent, an MLLM-driven discriminative reasoning (DR) framework for RES. Instead of requiring the MLLM to generate localization coordinates, DRAgent first constructs a detector-generated candidate space and then uses the MLLM as a visual-semantic target discriminator. Specifically, the MLLM performs reliable target selection among potential distractors through a two-stage DR mechanism, which first screens high-recall candidates and then performs instance-wise verification. The selected target box is subsequently used as a spatial prompt for a foundation segmentation model to produce the final pixel-level mask. Furthermore, we construct a self-consistency-filtered reasoning-chain data pipeline for LoRA-based fine-tuning, providing more reliable supervision for enhancing the MLLM’s discriminative reasoning capability. Experiments demonstrate that DRAgent achieves competitive performance on RefCOCO, RefCOCO+, and RefCOCOg.

[124] NemoSplat: Feed-Forward 4D Gaussian Splatting for Media-Aware Underwater Reconstruction cs.CVPDF

Xiaopeng Guo, Wai Chung Tse, Yipeng Zhu, Hanwen Zhang, Huajian Huang

TL;DR: NemoSplat是一种前馈式4D高斯泼溅框架，专门用于从无标定的水下视频中直接进行介质感知的动态场景重建。它通过可提示动态解耦器分离动态物体，并通过介质感知高斯预测器联合估计高斯属性和物理介质参数，以应对水下光散射和动态物体的挑战。

Details

Motivation: 解决在无约束水下环境中，由于严重的介质引起的光散射和不可预测的动态物体，导致光衰减和运动干扰破坏特征聚合，从而造成跟踪和重建失败的问题。

Result: 在作者引入的大规模水下数据集上进行广泛实验，结果表明NemoSplat在跟踪精度和高保真渲染方面达到了最先进的水平。

Insight: 创新点包括：首个针对水下视频的前馈4D高斯泼溅框架；设计了可提示动态解耦器，利用置信度感知融合策略和可选语义文本先验有效分离动态实体；提出了介质感知高斯预测器，联合估计高斯属性和物理介质参数以抵消视觉退化；并贡献了一个包含大量动态元素的大规模水下数据集。

Abstract: Reconstructing photorealistic scenes in unconstrained underwater environments remains challenging due to severe media-induced light scattering and unpredictable dynamic objects. Recent feed-forward visual foundation models have demonstrated remarkable capabilities in generalized novel view synthesis and tracking. However, when directly applied to aquatic videos, optical attenuation and motion interference fatally corrupt their feature aggregation, leading to severe tracking and reconstruction failures. To overcome these limitations, we present NemoSplat, the first feed-forward 4D Gaussian Splatting framework tailored for media-aware dynamic reconstruction directly from uncalibrated marine videos. Beyond providing robust estimations of camera poses and dense scene depth, we devise a Promptable Dynamic Disentangler that utilizes a confidence-aware fusion strategy of learned dynamic probabilities and optional semantic text priors, effectively isolating massive transient entities. Furthermore, to counteract visual degradation, a Media-Aware Gaussian Predictor is formulated to jointly estimate intrinsic 3D Gaussian attributes alongside physical media parameters, rendering pristine scene appearance in a single forward pass. Additionally, we introduce a large-scale underwater dataset with massive dynamic elements to facilitate training and evaluation. Extensive experiments on our dataset demonstrate that NemoSplat achieves state-of-the-art tracking accuracy and high-fidelity rendering.

[125] Results of the 1st Asynchronous CASTLE Challenge at the Joint Egocentric Vision Workshop in Conjunction with CVPR 2026 cs.CV | cs.MMPDF

Luca Rossetto, Werner Bailer, Cathal Gurrin, Graham Healy, Omar Shahbaz Khan

TL;DR: 本报告总结了在CVPR 2026联合第一人称视觉研讨会上举办的首届异步CASTLE挑战赛的贡献与结果。

Details

Motivation: 该挑战赛旨在推动第一人称视觉（Egocentric Vision）领域的研究，通过设立异步任务（可能涉及连续活动分割、定位或长期理解等）来激发社区创新，解决真实世界场景中的复杂视觉理解问题。

Result: 报告汇总了各参赛团队在挑战赛中的表现与结果，但未在摘要中提及具体基准测试、定量指标（如准确率、mAP）或是否达到SOTA水平；结果细节需参考完整报告。

Insight: 创新点在于通过组织异步挑战赛促进第一人称视觉领域的协作与进展，可能引入新的任务形式或评估标准；从客观角度看，这类挑战赛能加速方法迭代并提供标准化基准。

Abstract: This report summarizes the contributions and results of the 1st Asynchronous CASTLE Challenge at the Joint Egocentric Vision Workshop in conjunction with CVPR 2026.

[126] AquaFlow: A Monocular Gaussian Splatting SLAM for Underwater Streaming Reconstruction cs.CVPDF

Yingxiang Xu, Kerui Ren, Wenqi Guo, Changjian Jiang, Tao Lu

TL;DR: 本文提出了AquaFlow，一种用于水下流式重建的单目高斯溅射SLAM框架。该框架通过在大规模水下数据上微调3D视觉基础模型来增强姿态和点云估计的鲁棒性，并引入了介质引导的增量高斯初始化策略。此外，它结合了结构化、距离条件神经高斯与物理启发的光学模型，以补偿水下成像效应，从而实现高效、高保真的水下场景重建。

Details

Motivation: 现有单目3D高斯溅射流式重建方法在平衡重建质量和效率方面表现优异，但将其扩展到水下场景面临挑战，因为严重的光衰减和散射等视觉退化会降低相机姿态跟踪精度并扭曲场景几何。

Result: 在包含62个多样化水下轨迹的综合数据集上进行了评估，实验表明AquaFlow实现了最先进的跟踪和渲染性能，与WaterSplat-SLAM相比，平均定位误差降低了13.2%，PSNR提高了4.74 dB。

Insight: 创新点包括：1) 利用大规模水下数据微调3D视觉基础模型以提升水下环境下的初始估计鲁棒性；2) 提出介质引导的增量高斯初始化策略，适应流式建图；3) 设计了一种流式兼容的混合场景表示，将结构化神经高斯与物理光学模型结合，有效补偿水下成像退化效应。

Abstract: Recent monocular 3D Gaussian Splatting (3DGS) streaming reconstruction methods have achieved impressive performance by balancing reconstruction quality and efficiency. However, extending these frameworks to underwater scenes remains challenging due to severe visual degradation, such as light attenuation and scattering, which degrades camera pose tracking and distorts scene geometry. To address these challenges, we propose AquaFlow, a monocular Gaussian Splatting streaming reconstruction framework for efficient and high-fidelity underwater reconstruction. Specifically, AquaFlow fine-tunes a 3D vision foundation model on large-scale underwater data for robust pose and pointmap estimation, and introduces a medium-guided incremental Gaussian initialization strategy for streaming mapping. Furthermore, we develop a streaming-compatible hybrid scene representation that integrates structured, distance-conditioned neural Gaussians with a physics-inspired optical model to compensate for underwater image formation effects, enabling accurate scene reconstruction. We evaluate AquaFlow on a comprehensive dataset of 62 diverse underwater trajectories, collected from both public benchmarks and in-the-wild web videos across various scales. Extensive experiments demonstrate that AquaFlow achieves state-of-the-art tracking and rendering performance, reducing average localization error by 13.2% and improving PSNR by 4.74 dB compared to WaterSplat-SLAM.

[127] Motion-Based Tokenization for Cross-Dataset Egocentric Gaze Modeling cs.CVPDF

Virmarie Maquiling, Zhuojiang Cai, Enkelejda Kasneci

TL;DR: 本文提出了一种基于运动的令牌化方法，用于跨数据集的自中心化视线建模。该方法将事件对齐、固定时间跨度的角位移作为可解释的运动词汇，并与多种其他视线表示方法进行比较。评估结合了多种指标，发现角运动令牌在特定转移方向上优于冻结码本的向量量化令牌，且事件构建方式显著影响跨数据集性能。

Details

Motivation: 视线作为视觉和多模态模型的输入信号，其表示方法在跨数据集时缺乏共识。原始轨迹噪声大且依赖设备，而粗粒度事件标签则可能丢失局部运动结构，因此需要一种紧凑且可解释的表示方法。

Result: 在一个事件对齐的头戴式设备基准测试中，角运动令牌在一个转移方向上比冻结码本的向量量化令牌具有更低的目标域遗憾值，但反向转移结果不确定。在第三个自中心化数据集上，原生事件转移到EGTEA数据集时遗憾值最低，而帧跨度事件则完全失败。

Insight: 创新点在于将事件对齐的角位移定义为运动词汇，提供了一种紧凑且可解释的视线表示。客观分析表明，评估方法结合了多种互补指标，揭示了目标可预测性和事件构建方式对跨数据集结论的关键影响，为视线建模的表示学习提供了系统评估框架。

Abstract: Gaze is increasingly used as an input signal for vision and multimodal models, yet no consensus exists on how to represent it across datasets. Raw traces preserve detail but are noisy and device-dependent, while coarse event labels are easy to model but can discard local motion structure. We formulate event-aligned, fixed-horizon angular displacement as an interpretable, event-conditioned motion vocabulary and compare it with event-only, spatial, absolute-angle, learned vector-quantized, and continuous representations. To assess transfer alongside target predictability and token collapse, our evaluation combines next-token prediction with target-domain regret, low-order target references, paired bootstrap, order sensitivity, motif overlap, and frozen structural probes. In an event-aligned headset benchmark, angular-motion tokens have lower target-domain regret than frozen-codebook VQ tokens in one transfer direction, while the reverse direction is inconclusive. The probes reveal complementary representation properties, and event-only tokens show that low perplexity can retain little motion information. On a third egocentric dataset, a matched comparison of I-VT, native, and frame-span interfaces shows that event construction materially changes transfer: native events have the lowest regret into EGTEA, while frame-span events have zero motif overlap and fail severely as a source. Motion-based tokenization therefore provides a compact representation for event-aligned egocentric gaze streams, while the evaluation identifies how target predictability and event construction shape cross-dataset conclusions.

[128] WADE: A Reasoning-Annotated Benchmark for Multi-Instance Floating-Waste Grounding with Compact Vision-Language Models cs.CVPDF

Md. Asaduzzaman Shuvo, Ahsan Farabi, Md. Abdul Ahad Minhaz, Mahedi Hasan, Israt Khandaker

TL;DR: 论文提出了WADE基准数据集，用于评估紧凑型视觉语言模型在多实例漂浮废物检测任务中的性能。该数据集包含来自孟加拉国农村的2167张图像、13608个边界框和十个废物类别，每个标注都附带了类别级别的识别规则。作者在零样本、两样本、推理引导和微调等设置下评估了六个VLM模型，并使用QLoRA对Qwen3-VL-2B模型进行了联合微调，显著提升了召回率、F1分数并减少了幻觉现象。

Details

Motivation: 内陆水道中的漂浮废物威胁水生生态系统，需要在杂乱、多目标条件下进行及时监测。现有水生废物数据集地理覆盖有限、多实例标注稀疏，且缺乏超越边界框和标签的监督信息，导致紧凑型视觉语言模型在联合定位、分类、计数和解释漂浮废物方面的能力评估不足。

Result: 在WADE基准上，对六个VLM模型进行了评估。使用QLoRA对Qwen3-VL-2B进行联合微调后，召回率从0.0248提升至0.2339，F1分数从0.0257提升至0.2163，图像级幻觉率从0.6836降低至0.0883。然而，超过四分之三的实例仍未被检测到，表明该基准对紧凑型VLM在密集漂浮废物定位任务中具有挑战性。

Insight: 论文的创新点在于构建了一个包含详细推理标注（识别规则）的多实例漂浮废物基准数据集WADE，为评估VLM的细粒度感知和推理能力提供了新标准。同时，展示了通过联合微调边界框、标签和推理链，可以有效提升紧凑型VLM在复杂多目标场景下的性能并减少幻觉，为资源高效的模型适应提供了可行方案。

Abstract: Floating waste in inland waterways threatens aquatic ecosystems and requires timely monitoring under cluttered, multi-object conditions. Existing aquatic-waste datasets provide limited geographic coverage, sparse multi-instance annotations, and little supervision beyond boxes and labels. Compact vision-language models (VLMs) therefore remain insufficiently evaluated for jointly localizing, classifying, counting, and explaining floating waste. We introduce WADE, a reasoning-annotated benchmark containing 2,167 images from rural Bangladesh, 13,608 bounding boxes, and ten waste categories. Each annotation is associated with class-level recognition rules covering visual cues, likely confusions, and discriminative features. We evaluate six VLMs under zero-shot, two-shot, reasoning-guided, and fine-tuned settings using detection, counting, and hallucination metrics. For resource-efficient adaptation, we jointly fine-tune Qwen3-VL-2B on boxes, labels, and reasoning chains using QLoRA. Fine-tuning increases recall from 0.0248 to 0.2339 and F1 from 0.0257 to 0.2163, while reducing image-level hallucination from 0.6836 to 0.0883. However, over three-quarters of instances remain undetected, establishing WADE as a challenging benchmark for dense floating-waste grounding with compact VLMs.

[129] WildHandBench: A Benchmark for Handwritten Text Understanding that Challenges MLLMs and Humans cs.CV | cs.AIPDF

Jun Zhang, Qiao Zhao, Cheng Cui, Jianying Qu, Zhongkai Sun

TL;DR: 本文提出了WildHandBench基准测试，用于评估多模态大语言模型和人类在理解手写文档方面的能力。该基准包含500份涵盖三种结构、四种语言和九种真实场景的手写文档，并引入了先验驱动错误指标来量化模型错误来源。评估发现最佳模型准确率仅为71.85%，人类表现优于所有模型但差距不大，且模型错误主要源于对语言先验的过度依赖。

Details

Motivation: 当前模型在印刷文档解析上已达到很高水平，但处理具有挑战性的手写文档的能力尚未得到充分评估。现有基准测试主要关注孤立文本或公式，忽略了手写表格和真实世界的退化情况，且仅报告总体准确率而未能解释模型失败的原因。

Result: 在WildHandBench基准上，最佳模型总体准确率为71.85%，人类基线为77.09%。模型错误中有63-91%是先验驱动错误，而人类仅为49%，表明模型存在系统性依赖语言先验的问题。

Insight: 创新点在于构建了首个全面涵盖手写文本、表格和公式的多语言真实场景基准，并提出了先验驱动错误指标来揭示模型错误的本质原因。从客观角度看，该研究通过对比模型与人类错误模式的差异，为理解多模态模型的局限性提供了新视角。

Abstract: While the top model on OmniDocBench now reaches 96.34% overall on printed-document parsing, the ability of current models to handle challenging handwritten documents remains largely uncharacterized. Existing benchmarks focus on isolated text or formulas, overlook handwritten tables and real-world degradation, and report aggregate accuracy without explaining why models fail. We present WildHandBench, a benchmark containing 500 handwritten documents across three structures (free text, tables, formulas), four languages, and nine real-world scenarios. We introduce a Prior-Driven Error (PDE) metric that quantifies whether errors originate from language priors rather than visual evidence. Evaluating 18 state-of-the-art models together with calibrated human baselines, we find: (1) the best model achieves only 71.85% overall; (2) humans outperform all models yet the gap is narrow (77.09% vs. 71.85%); and (3) model errors are qualitatively different from human errors – 63-91% of model errors are prior-driven versus only 49% for humans, exposing systematic reliance on language priors that conventional accuracy metrics cannot capture.

[130] Optimize Surgical Triplet Recognition: A Knowledge-Driven Mixture-of-Experts Solution cs.CVPDF

Yiyi Zhang, Yuchen Yuan, Ying Zheng, Jialun Pei, Jinpeng Li

TL;DR: 本文提出了一种名为MoeCo的知识驱动专家混合框架，用于优化手术动作三元组识别任务。该框架通过组件定制适配器解耦特征、协调梯度学习策略处理数据不平衡，并引入知识驱动的专家混合机制动态整合多模态大语言模型知识，以提升模型在复杂手术场景中的性能。

Details

Motivation: 现有方法在手术动作三元组识别中面临特征空间纠缠导致的组件级优化冲突、数据严重不平衡引起的类别级优化冲突，以及缺乏领域知识指导导致模型可解释性和鲁棒性不足的问题。

Result: 在公开的CholecT45和CholecT50数据集上进行的广泛实验证实了所提协同优化流程的有效性，以及通过知识驱动专家混合机制整合动态先验的优越性。

Insight: 创新点在于提出了一个协同优化框架，结合了组件定制适配器进行特征解耦、协调梯度学习策略处理类别不平衡，并创新性地利用知识驱动的专家混合机制动态集成大语言模型提供的领域知识，从而增强了模型的表达能力和鲁棒性。

Abstract: Surgical action triplet recognition constitutes a critical task in context-aware robot-assisted surgery, facilitating automatic surgical action perception by identifying instrument, verb, target, and their association. However, existing works struggle to analyze such complex surgical scenes due to three main issues: (1) component-level optimization conflicts caused by entangled feature spaces, (2) category-level optimization conflicts arising from severe data imbalance, and (3) lack of domain knowledge guidance that limits model interpretability and robustness. To address these challenges, we propose a Mixture-of-Experts-guided Co-Optimization (\textit{MoeCo}) framework powered by knowledge-driven learning. Within the co-optimization pipeline, to first mitigate component-level conflicts, we introduce a component-tailored adapter that disentangles task-specific features across spatial-temporal regimes, facilitating effective component specialization. Next, we develop a coordinated gradient learning strategy to handle category-level conflicts, which adaptively rebalances positive-negative gradients to enhance the perception of rare categories. Notably, inspired by surgical domain expertise, we introduce a knowledge-driven mixture-of-experts mechanism that dynamically integrates multimodal large language model-guided knowledge via activated experts, thereby enriching the co-optimization pipeline with more expressive and robust representations. Extensive experiments on the public CholecT45 and CholecT50 datasets confirm the effectiveness of the proposed co-optimization pipeline and the superiority of dynamic priors integration via the knowledge-driven mixture-of-experts mechanism.

[131] ENCORE: Entropy-Guided Cropping and Attention Regularization for Robust Vision–Language Understanding cs.CVPDF

Yuanhao Sun, Huawei Ji, Jiaxin Ding, Luoyi Fu, Xinbing Wang

TL;DR: 本文提出了一种名为ENCORE的熵引导框架，旨在提升轻量级视觉语言模型（VLM）的鲁棒性。该框架包含两个核心组件：在推理时，通过基于熵的裁剪策略（ECS）选择与提示最相关的图像区域以保持对象完整性；在训练时，通过熵正则化训练（ERT）增强对关键视觉标记的关注。该方法仅微调0.14%的参数，便在多个VQA基准测试中实现了显著的性能提升。

Details

Motivation: 现有基于Transformer的视觉编码器将图像分割为固定分辨率的子图像，这损害了轻量级视觉语言模型中对象的完整性，且现有方法仅关注视觉模态，无法动态保留与提示相关区域的完整性，从而限制了模型性能。

Result: 在十个VQA基准测试上的实验表明，ENCORE方法仅微调0.14%的参数，平均准确率提升了1.43%，并在近期参数量为2B的视觉语言模型中达到了最先进的（SOTA）性能水平。

Insight: 论文的创新点在于发现跨模态注意力的早期层图像-文本熵与答案定位质量和任务准确性高度相关，并基于此提出了熵引导的裁剪和注意力正则化框架。从客观角度看，该方法通过熵这一信息论指标来动态指导视觉信息的处理，是一种新颖且高效的跨模态对齐与优化思路，尤其适用于参数高效的微调场景。

Abstract: Vision-Language Models (VLMs) perform well on diverse vision-language tasks, but transformer-based visual encoders split images into fixed-resolution sub-images, compromising object integrity in lightweight VLMs. Existing methods only focus on the visual modality and fail to dynamically preserve the integrity of prompt-relevant regions, limiting performance. In this work, we observe that the early-layer image-text entropy of cross-modal attention strongly correlates with answer grounding quality and task accuracy. Building on this finding, we propose \textbf{ENCORE}, an entropy-guided framework with two components: At inference, an \textbf{Entropy-based Cropping Strategy} (ECS) evaluates a small set of candidate crops and selects the one with minimal entropy, preserving contiguous regions relevant to the prompt. At training, \textbf{Entropy Regularization Training} (ERT) augments next-token prediction with an entropy term that sharpens attention on key visual tokens while down-weighting irrelevant ones. Experiments on ten VQA benchmarks show that ENCORE, fine-tuning only 0.14% of parameters, achieves an average 1.43% accuracy gain and state-of-the-art performance among recent 2B-parameter VLMs. Our code is released in https://github.com/baokou-fw2/ENCORE.

[132] Coarse Indexing, Fine Evidence: Decoupling Temporal Granularity in Long-Video RAG cs.CV | cs.AIPDF

Zhe Jin, Zhimin Lin, Bin Zheng, Junhua Fang, Huihua Yang

TL;DR: 本文提出了一种名为密度感知图构建（DAGC）的训练无关方法，用于解耦长视频检索增强生成（RAG）中的索引粒度与证据粒度。该方法通过合并视觉冗余的相邻视频块，构建一个紧凑、密度自适应的粗粒度图索引，同时保留到原始细粒度时间单元的映射。检索到的粗粒度区域随后被扩展回原始块粒度，以进行细粒度证据提炼和答案生成。

Details

Motivation: 现有基于图的视频RAG系统在构建检索索引时，通常从视频分割中继承固定的时间粒度。作者认为这种设计不必要地将索引粒度与证据粒度耦合在一起：粗粒度表示通常足以定位相关时间区域，而细粒度证据对于下游推理仍然至关重要。

Result: 在MLVU、VideoMME和LongVideoBench数据集上的实验表明，DAGC仅保留了原始图节点的大约40-50%，实现了1.3到1.7倍的端到端实际运行加速，同时保持了约99%的原始问答性能。该增益在不同的长视频语言模型主干和视频RAG流程中均能迁移。

Insight: 核心创新在于解耦了长视频RAG中索引与证据推理的时间粒度，提出了一种无需训练、密度自适应的粗索引构建方法。这揭示了在视频理解任务中，检索（定位）和推理（生成）阶段对时间分辨率的需求可以不同，从而在不显著损失性能的前提下实现效率提升。

Abstract: Graph-based retrieval-augmented generation (RAG) provides a scalable paradigm for long-video understanding, but existing systems typically inherit a fixed temporal granularity from video segmentation when constructing their retrieval index. We argue that this design unnecessarily couples indexing granularity with evidence granularity: coarse representations can often suffice for locating relevant temporal regions, while fine-grained evidence remains important for downstream reasoning. We propose \textbf{Density-Aware Graph Construction (DAGC)}, a training-free approach that decouples a query-independent coarse retrieval index from the original fine-grained evidence space. DAGC constructs a compact, density-adaptive graph index by merging visually redundant neighboring chunks, while preserving mappings to the original temporal units. Retrieved coarse regions are subsequently expanded back to the original chunk granularity for fine-grained evidence refinement and answer generation. Experiments on MLVU, VideoMME, and LongVideoBench show that DAGC retains only about 40–50% of the original graph nodes and achieves $1.3$–$1.7\times$ end-to-end wall-clock acceleration while preserving approximately 99% of the original QA performance. The gains transfer across different LVLM backbones and video RAG pipelines, suggesting that long-video RAG need not maintain the same temporal granularity for indexing and evidence reasoning.

[133] Loopy: Seamless Video Loop Generation via Anchored Looping Shift of Positional Embedding cs.CVPDF

Haotian Dong, Wenjing Wang, Chen Li, Jing Lyu, Xin Wang

TL;DR: 本文提出了一种名为Loopy的通用框架，用于生成高质量的无缝循环视频。该方法基于对DiT模型中不同注意力层位置嵌入具有不同时间控制程度的发现，提出了一种锚定位置嵌入偏移策略，将DiT的时间感知从直线转换为环形，从而支持RGB和RGBA视频生成，并具备身份控制和风格迁移等高级AIGC功能。

Details

Motivation: 现有方法在生成高质量循环视频时通常失败，因为它们忽略了视频生成模型如何感知时间顺序以及这与循环行为的关系。本文旨在解决这一核心问题。

Result: 实验表明，该方法显著提高了生成循环视频的时间一致性和视觉保真度。

Insight: 核心创新点在于首次揭示了DiT中不同注意力层的位置嵌入具有不同程度的位置控制，并利用其中最显著的层作为锚点，提出了一种分层特定的偏移策略来重塑模型的时间感知，从而实现无缝循环生成。

Abstract: Looping videos are essential for practical applications such as web graphics, game development, and social media. However, existing approaches typically fail to generate high-quality looping videos due to the neglect of how video generation models perceive temporal order and how this relates to the looping behavior. In this work, we are the first to reveal that position embedding at different attention layers within DiT exhibits varying levels of positional control, with the most pronounced layer acting as an anchor. We formulate this anchored layer as the reference point of the looping video, offering strong contextual priors for the remaining layers to facilitate the generation of seamless and coherent video content. Based on this insight, we propose an anchored position embedding shifting strategy that applies layer-specific shift lengths according to each layer’s temporal control effect, effectively transforming DiT’s temporal perception from a straight line to a circle. Leveraging this strategy, we develop a general framework, Loopy, for high-quality looping video generation, supporting both RGB and RGBA videos, while also enabling advanced AIGC features such as identity control and style transfer. Experiments demonstrate that our approach significantly improves temporal consistency and visual fidelity in generated looping videos. The released model is available on our website: https://donghaotian123.github.io/Loopy.

[134] Cultural Moment Benchmark: Evaluating Video Cultural Reasoning and Grounding in Southeast Asia cs.CV | cs.AI | cs.CL | cs.IR | cs.MMPDF

Burak Satar, Zhixin Ma, Cheng Yu-Tong, Huy Hoang Tran, Phuong Anh Nguyen

TL;DR: 本文提出了文化时刻基准（CMB），这是一个用于评估视频文化理解与定位能力的基准测试，专注于东南亚七个国家的306个文化概念。该基准将文化理解分解为三个能力：概念命名、视觉识别和时间定位，并通过三个阶段分别评估这些能力。实验发现，现有视觉语言模型在CMB上表现不佳，且三个能力之间并非完全级联，音频模态的作用因概念和国家而异。

Details

Motivation: 现有视频文化基准往往将文化理解的多个能力（如命名、识别、定位）合并为单一分数，无法揭示模型的具体瓶颈。本文旨在通过分解这些能力，构建一个诊断性的基准，以更精细地评估模型对视频中文化概念的理解与定位能力。

Result: 在六个视觉语言模型上的评估显示，即使最强的闭源模型在要求三个阶段全部正确的综合任务上准确率也低于30%。人类专家研究也表明，即使是专家，在对邻国文化概念进行判断时，其准确率也低于随机猜测水平，凸显了CMB需要特定国家的文化知识。

Insight: 创新点在于将视频文化理解分解为三个可诊断的独立能力（命名、识别、定位），并设计了相应的评估阶段和干扰项（如语义相似干扰项、未标注视频片段、自由形式定位），从而构建了一个能够精确定位模型失败模式（特定能力或模态）的诊断工具。客观来看，这种细粒度的能力分解和评估框架为理解和改进模型的文化理解能力提供了新的视角和方法。

Abstract: Cultural understanding in video means more than recognizing what is visible; it requires grasping the symbolic and temporal significance of cultural concepts. We decompose this into three abilities: naming what a concept symbolizes, visually recognizing it on video, and locating its sub-events in time. Existing video-cultural benchmarks tend to test what is seen, collapsing these three abilities into a single score that hides the bottleneck. We introduce the Cultural Moment Benchmark (CMB): 306 expert-curated concepts from seven countries in Southeast Asia across five categories. We evaluate each concept through three stages, one per ability. Given a description, Stage 1 (S1) selects from four candidate concept names, Stage 2 (S2) selects from four candidate video moments, and Stage 3 (S3) predicts the start and end times of the moment in a video. To keep each stage focused on a distinct ability, we use three design choices: semantic-similarity distractors (S1, S2), unlabeled video moments (S2), and free-form localization on a different example video (S3). Across six vision-language models, failure modes vary by ability and modality. i) Even the strongest closed-source models score below 30% when all three stages must be correct; ii) The three abilities do not fully cascade: naming a concept correctly helps half the models recognize it on video, but recognizing it has little effect on locating the sub-event in time; iii) Audio is complementary, redundant, or distracting depending on the concept, more often distracting in non-Latin-script countries; removing both audio and subtitles hurts Games and Music the most. Our 14-rater human study shows that even Expert raters score below chance on concepts from a neighboring country, indicating that CMB requires country-specific cultural knowledge. CMB acts as a diagnostic harness, attributing failures to a specific ability or modality.

[135] Grounding Isn’t Knowing: Do VLMs Need Object Localization for Spatial Reasoning? cs.CVPDF

Xiwei Liu, Yulong Li, Xinlin Zhuang, Xuhui Li, Zhixiang Lu

TL;DR: 本文研究了视觉语言模型（VLMs）进行空间推理的机制，探究了对象定位是否必要。通过使用LLaVA-1.5和Qwen2.5-VL模型，并应用一系列机制可解释性工具（如令牌消融、分层探测、注意力剔除和因果中介分析），发现空间关系预测遵循一个分阶段的‘定位到推理’过程。模型利用对象对齐的令牌建立粗略的目标-参考锚点，而不需要精确的边界框边界，且定位信息和空间关系决策依赖于部分重叠但又有所区分的处理通路。

Details

Motivation: 当前视觉语言模型能够回答空间问题，但连接对象定位与空间推理的内部机制尚不明确。本文旨在探究空间推理是否在内部需要精确的对象定位，还是可以通过全局布局线索绕过显式定位。

Result: 研究通过严格的实验，在模型层面（如LLaVA-1.5和Qwen2.5-VL）提供了从令牌、层到注意力头级别的详细解释，阐明了VLMs如何将对象定位转化为空间关系。结果表明，位置信息在关系决策出现之前就可解码，且一小部分注意力头中介了定位和空间推理的因果效应。

Insight: 论文的创新点在于揭示了空间推理并非严格依赖于精确的对象定位，而是通过一个分阶段的、利用粗略锚点的过程。从客观角度看，这挑战了‘知道对象在哪等同于知道它们如何关联’的假设，并为理解VLMs的内部工作机制提供了新的、细致的机制解释框架，强调了定位与推理任务在通路上的部分分离。

Abstract: Vision-language models (VLMs) can answer spatial questions, yet the mechanisms connecting object grounding to spatial reasoning remain poorly understood. It is underexplored whether spatial reasoning internally requires precise objects localization, or can bypass explicit localization through global layout cues. In this work, we investigate two representative model families, LLaVA-1.5 and Qwen2.5-VL, using a suite of mechanistic interpretability tools, including token ablation, layer-wise probing, attention knockout, and causal mediation analysis. We find that spatial relation prediction follows a staged grounding-to-reasoning process in which object-aligned tokens establish coarse target-reference anchors, while precise bounding-box boundaries are not required. Positional information becomes decodable before relation decisions emerge, and a small set of attention heads mediates the causal effects of both localization and spatial reasoning. The two tasks share early grounding-related processing but ultimately rely on partially distinct specialized pathways. Through rigorous experiments, we provide a token-, layer-, and head-level account of how VLMs transform object grounding into spatial relations, showing that knowing where objects are is not equivalent to knowing how they relate.

[136] Training-Free Pseudo-Fusion for Composed Image Retrieval with Diffusion Models and Multimodal Large Language Models cs.CV | cs.IRPDF

Fan Xu, Luis A. Leiva

TL;DR: 本文提出了一种名为PeFuse（伪融合）的训练免费框架，用于组合图像检索（CIR）。该框架利用预训练的扩散模型和多模态大语言模型，通过生成式转换来桥接视觉和文本模态，将CIR问题转化为四个单模态检索任务，从而无需针对任务进行专门训练。

Details

Motivation: 解决传统组合图像检索方法依赖多模态融合和任务特定训练模块的问题，旨在实现无需训练的零样本CIR。

Result: 在标准基准测试上的大量实验表明，将CIR转换为文生图检索任务比其他转换策略更有效，其性能达到或超越了最先进方法，同时得益于可替换的转换流程组件，保持了高度灵活性。

Insight: 创新点在于提出了伪融合范式，通过单向和双向转换策略，将组合查询分解为单模态检索问题，利用现成生成模型实现零样本CIR，避免了复杂的对齐训练。

Abstract: Composed Image Retrieval (CIR) is an emerging paradigm in content-based image retrieval that enables users to formulate compositional queries by combining a reference image with an auxiliary modality, usually text-based. This approach supports fine-grained search where the target image shares structural elements with the user-provided image while incorporating the modifications specified by the auxiliary text. Conventional CIR methods rely on multimodal fusion to combine visual and textual features into a joint query embedding, which requires training modules that align composed queries with the targets. In this work, we propose PeFuse (for pseudo-fusion), a training-free framework that leverages pretrained Diffusion Models and Multimodal Large Language Models to bridge modalities via generative conversion. We introduce two novel strategies: uni-directional and bi-directional conversion, which convert CIR into four single-modality retrieval problems. These methods reformulate CIR as either intra-modal or cross-modal single-query retrieval tasks, bypassing the need for dedicated task-specific training. Extensive experiments on standard benchmarks demonstrate that converting CIR into text-to-image retrieval tasks is more effective than alternative conversion strategies, achieving competitive or superior performance compared with state-of-the-art methods, while maintaining high flexibility thanks to replaceable components of the conversion pipeline. These results highlight the effectiveness of the pseudo-fusion paradigm for zero-shot CIR. Our code is publicly available at: https://github.com/StevenXuf/PeFuse4CIR.

[137] How Merge-Tolerant Are Vision Transformers for Wheat Phenotyping? cs.CVPDF

Simon Ravé, Pejman Rasti, David Rousseau

TL;DR: 本文系统评估了无训练令牌合并方法（ToMe和Mutual Pair Merging）在小麦表型分析任务（包括生长阶段分类、麦穗检测和麦穗器官分割）中的适用性。研究发现分类任务对令牌合并高度耐受，而检测和分割任务则因实例重复、器官细薄、边界密集、重建需求和运行时开销等因素受到限制。

Details

Motivation: 基于视觉的小麦表型分析需要在部署约束下进行重复测量，但普通视觉变换器（ViTs）的二次注意力限制了高吞吐量和边缘推理。无训练令牌合并方法因其无需重新训练即可插入已训练模型而具有吸引力，但其在不同任务中的有效性尚不明确。

Result: 在生长阶段分类、麦穗检测和麦穗器官分割任务上进行了基准测试，测量了任务质量、吞吐量、令牌数量和峰值GPU内存，并包含树莓派5的测量。结果显示分类任务高度耐受合并，而检测和分割任务则受限。

Insight: 论文的创新点在于系统性地评估了令牌合并方法在小麦表型分析多任务中的适用性，并揭示了任务类型对合并耐受性的显著差异。客观分析认为，其核心洞察在于部署价值需在目标运行时上实际分析，而非仅从令牌数量推断，因为优化的注意力后端可能抵消明显的加速效果。

Abstract: Vision-based wheat phenotyping requires repeated measurements under deployment constraints, from growth-stage recognition to wheat-head counting and organ segmentation. Plain Vision Transformers (ViTs) provide a common architecture for these tasks, but quadratic attention limits high-throughput and edge inference. Training-free token merging is attractive because it can be inserted into trained models without retraining. We provide a systematic benchmark of ToMe and Mutual Pair Merging across growth-stage classification, wheat-head detection, and wheat-organ segmentation, measuring task quality, throughput, token count, and peak GPU memory, with additional Raspberry Pi 5 measurements. The benchmark reveals a clear hierarchy: classification is highly merge-tolerant, while detection and segmentation are constrained by repeated instances, thin organs, dense boundaries, reconstruction, and runtime overhead. Optimized attention backends can erase apparent speedups, so deployment value must be profiled on the target runtime rather than inferred from token count.

[138] An end-to-end-trained vision-language model for native-language prostate pathology report generation cs.CVPDF

Christian Grashei, Fabian Gülhan, Maximilian Legnar, Fabian Stögbauer, Cleo-Aron Weis

TL;DR: 本文提出了一种端到端训练的视觉语言模型，用于生成以德语为母语的前列腺病理报告。该模型通过从头训练分词器和模型实现语言无关性，并利用本地部署的大型语言模型自动处理历史病例数据，生成大量图像-文本对用于训练。

Details

Motivation: 解决前列腺癌活检报告结构化生成的负担，现有工具多依赖英语编码器且需病理学家手动组装报告，无法适应其他临床语言环境。

Result: 在临床属性评估中，模型在恶性肿瘤检测上达到96.2% F1分数，Gleason分级达到65.2% F1分数，与FDA批准的分类器性能相当，并在三个外部队列中通过潜在空间增强进一步验证了分级效果。

Insight: 创新点在于构建语言无关的端到端框架，并利用自动化流程从历史病例生成训练数据，无需人工标注，使机构能够基于自身档案训练母语报告模型。

Abstract: Prostate cancer is among the most frequently diagnosed malignancies worldwide, and structured reporting of each biopsy core burdens pathologists. Existing tools frame this as classification, leaving pathologists to assemble coherent reports, while many slide-level vision-language models rely on English-centric encoders that transfer poorly to other clinical languages. We present a slide-level framework generating prostate biopsy reports that is language-independent by construction: tokenizer and model are trained from scratch, demonstrated here in German. To address paired-data scarcity, an automated pipeline uses a locally deployed large language model to split composite reports into core-specific image-text pairs, yielding 17,344 pairs from 2,402 historical cases without manual annotation. Evaluated for clinical attributes rather than linguistic similarity, the model achieves 96.2% F1 for malignancy detection and 65.2% for Gleason grading, competitive with an FDA-cleared classifier. Grading is further validated on three external cohorts with latent-space augmentation. Institutions can thus train native-language reporting models on their own archives.

[139] A Simulator-Grounded Framework For Constructing Verifiable Muscle-Grounded QA From 3D Tongue Meshes cs.CV | cs.HCPDF

Seungho Eum, Unsang Park

TL;DR: 本文提出了一种基于模拟器的可验证肌肉基础问答数据集构建框架3DTongueQA。该框架通过有限元模型将受控的肌肉激活映射到固定拓扑的舌头网格，生成结构化的生物力学记录，并渲染为关于肌肉状态、几何形状和目标导向变化的确定性问答对。研究筛选了超过29万个配置，构建了大规模的多语言数据集，并通过基线模型验证了其支持高效结构化预测和异构自然语言问答的能力。

Details

Motivation: 现有的发音语料库（如实时MRI和电磁发音描记）能捕捉舌头形状和运动，但无法为产生观测配置的肌肉驱动过程提供可追溯的标签。本文旨在构建一个能提供肌肉层面可验证监督信号的数据集，以弥补这一空白。

Result: 在构建的数据集上，一个可交换的SpiralNet++–Qwen3-8B基线模型在肌肉EM、数值准确性和方向EM等指标上分别达到62.9±9.2、74.0±0.2和65.9±4.7。任务特定的结构化读出进一步将肌肉EM和方向EM提升至88.7±0.7和93.3±1.0。控制数据集泄露的锚点留出模型在未见锚点上保留了80.4%-98.6%的全量分数。

Insight: 创新点在于提出了一个模拟器驱动的、可验证的肌肉基础QA数据构建框架，将生物物理模拟与结构化数据生成相结合。其核心在于通过确定性模拟生成具有可追溯肌肉激活标签的几何配置，从而为发音建模提供了前所未有的、可解释的肌肉层面监督信号，并且框架在语言自然化方面具有可移植性。

Abstract: Existing articulatory corpora based on real-time MRI and electromagnetic articulography capture tongue shape and motion but do not provide traceable labels for the muscle-driven process that generated an observed configuration. We introduce a simulator-grounded data-construction framework and instantiate it as 3DTongueQA. Controlled 11-dimensional muscle activations are mapped to fixed-topology tongue meshes with the ArtiSynth Badin finite-element model, converted into structured biomechanical records, and rendered as deterministic QA on muscle state, geometry, and target-directed change. We screen 295,157 configurations, retain 295,115 valid meshes, and construct 891,156 QA records per language. Language naturalization changes only surface form and is verified against the source records; English and Korean instantiations demonstrate construction-level portability. A swappable SpiralNet++–Qwen3-8B baseline reaches 62.9 $\pm$ 9.2 Muscle EM, 74.0 $\pm$ 0.2 Value Accuracy, and 65.9 $\pm$ 4.7 Direction EM, while mismatching the paired mesh reduces Muscle EM to 2.2; a dataset-leakage-controlled anchor-held-out model retains 80.4–98.6% of the full-inventory scores on unseen anchors. Task-specific structured readouts further reach 88.7 $\pm$ 0.7 Muscle EM and 93.3 $\pm$ 1.0 Direction EM. These complementary results show that the constructed supervision supports both efficient structured prediction and heterogeneous natural-language QA rather than being tied to a particular decoder architecture.

[140] BenthicFlow: Generating Extensible Underwater Environments via Flow Matching cs.CVPDF

Joaquín Figueira, Camile Lendering, Manfred Gonzalez-Hernandez, Giacomo D’Amicantonio, Erkut Akdag

TL;DR: 本文提出了BenthicFlow，一个基于条件流匹配的统一框架，用于生成可扩展的水下3D环境。该方法通过单一模型联合生成对齐的纹理和深度图，并利用受MultiDiffusion启发的采样过程协调生成轨迹中的重叠窗口，从而无需单独的拼接模型即可创建空间可扩展的RGBD马赛克。生成的马赛克随后通过表面对齐的高斯面元被提升为显式的3D海底环境。

Details

Motivation: 解决水下环境3D场景理解中高质量数据匮乏，以及水面训练模型难以泛化到水下场景的挑战。现有方法通过事后拼接独立生成的图块来组装大场景，且仅在单个调查点内展示异质景观，存在局限性。

Result: 在不同地理位置的调查点进行的实验表明，BenthicFlow在保持站点特定外观的同时，生成了与目标分布紧密匹配的、连贯的大规模3D场景。

Insight: 主要创新点在于提出了一个统一的、基于单一条件流匹配模型的框架，用于联合生成对齐的纹理和深度，并通过改进的采样过程实现空间可扩展的RGBD马赛克生成，无需额外的拼接模型。这为生成连贯、大规模且符合特定分布的水下3D环境提供了一种高效且统一的解决方案。

Abstract: Computer vision applications for 3D scene understanding in underwater environments remain challenging due to the lack of high-quality 3D data and the inability of surface-trained models to generalize to underwater scenes. To address this challenge, an emerging trend is to employ generative models to close the data domain gap. However, existing methods assemble large scenes by stitching independently generated tiles post hoc with separately trained models, while demonstrating heterogeneous landscapes only within individual survey sites. We introduce BenthicFlow, a unified framework based on a single conditional flow-matching model that jointly generates aligned textures and depth maps. A MultiDiffusion-inspired sampling procedure reconciles overlapping windows throughout the generative trajectory, enabling spatially extensible RGBD mosaics without a separate stitching model. The generated mosaics are subsequently lifted into explicit 3D benthic environments using surface-aligned Gaussian surfels. Experiments across geographically distinct survey sites demonstrate that BenthicFlow preserves site-specific appearance while generating coherent, large-scale 3D scenes that closely match the target distributions. Code and trained models are available at https://github.com/jacomof/BenthicFlow.

[141] EchoWM: Open and Enterable Omnimodal World Models cs.CVPDF

Songchun Zhang, Yaowei Li, Junhao Zhuang, Weiyang Jin, Haoyu Wang

TL;DR: 本文提出了EchoWM，一种可进入的全模态世界模型，能够响应连续导航并联合生成720p视频、环境声音、音乐和语音。该模型围绕相机意图组织交互：在第一人称场景中指定观察者运动，在第三人称场景中从数据中学习相机-角色动态，无需特定视角控制器。通过将离散命令和连续姿态映射到共享的度量尺度相对6自由度轨迹，并在数据集级别进行校准以保持跨异构数据的运动幅度。模型采用渐进式训练和自回归后训练进行长时程生成，在公开基准测试中展现出强大的轨迹跟随能力和高视觉质量。

Details

Motivation: 解决当前生成媒体模型在支持连续导航、联合生成多模态内容（视频、音频）以及同时适应第一人称和第三人称交互方面的局限性，旨在创建真正可进入、沉浸式的全模态生成世界。

Result: 在公开的世界模型基准测试中，EchoWM在轨迹跟随和视觉质量方面取得了强劲的性能，支持跨不同主题的第一人称和第三人称交互，并在长时程生成中保持了同步的环境声音和语音。

Insight: 创新点包括：1) 围绕“相机意图”统一交互范式，优雅处理第一/第三人称场景；2) 通过数据集级校准将异构输入映射到共享的度量尺度6-DoF轨迹空间；3) 构建互补数据引擎和渐进+自回归后训练策略，实现高质量长时程多模态联合生成。

Abstract: We present EchoWM, an omnimodal world model for enterable generative media that responds to continuous navigation while jointly generating 720p video, environmental sound, music and speech. We organize interaction around camera intent: in first-person scenes, it specifies observer motion, while in third-person scenes, camera–character dynamics are learned from data without view-specific controllers. Discrete commands and continuous poses are mapped to a shared metric-scale relative 6-DoF trajectory, with dataset-level calibration preserving motion magnitude across heterogeneous data. To jointly learn audio-visual generation and trajectory control, we construct a complementary data engine and adopt progressive training followed by autoregressive post-training for long-horizon generation. Extensive evaluations show that \model achieves strong trajectory following and high visual quality on public world-model benchmarks, supporting both first- and third-person interaction across varied subjects, and maintaining synchronized environmental sound and speech over long-horizon generation.

[142] Toward a Foundation Plug-and-Play Prior for Computed Tomography Reconstruction via a Multimodal Diffusion Model cs.CVPDF

Haley Duba-Sullivan, Patxi Fernandez-Zelaia, Obaidullah Rahman, Amirkoushyar Ziabari

TL;DR: 本文提出了一种基于多模态扩散模型的基础即插即用先验，用于解决CT重建问题。该方法旨在通过一个在多个成像领域训练的单一扩散模型，为不同的CT问题（如稀疏视图或低剂量测量）提供通用的先验知识，从而避免为每种特定扫描设置重新训练模型。

Details

Motivation: CT吞吐量受限于扫描时间，而高质量重建依赖于信息丰富的先验模型。传统方法需要为每种特定的扫描设置（如模态、几何或材料）单独训练神经网络，这限制了其灵活性和效率。本文旨在探索一个跨多个成像领域训练的单一扩散模型，是否能作为同时解决多种CT问题的通用先验。

Result: 在三个数据集（涉及锥束X射线CT成像的增材制造金属部件缺陷分析、平行束中子CT成像的混凝土微结构，以及不同模态、几何、材料和退化类型）上评估了所提方法，使用相同的冻结模型。该方法在所有三种情况下均优于分析重建方法，为异构CT重建问题提供了可重复使用的基础先验。

Insight: 创新点在于提出了一个跨域训练的多模态扩散模型作为通用先验，实现了“即插即用”的灵活性，避免了针对每个特定CT问题重新训练模型的需要。从客观角度看，这种基础先验方法有望提高CT重建的效率和适应性，特别是在处理多样化的成像条件和材料时。

Abstract: Computed tomography (CT) throughput is limited by scan time, which grows with both the number of projections acquired and the detector integration time for each. Reconstructing high-quality volumes from sparse-view or low-dose measurements therefore depends on an informative prior, typically a neural network trained for one specific scan setting and retrained whenever the modality, geometry, or material changes. We investigate whether a single diffusion model trained across several imaging domains can instead serve as a prior for many CT problems simultaneously. We evaluate the proposed method using the same frozen model on three datasets that differ in modality, beam geometry, material, and degradation type, spanning flaw analysis in additively manufactured metal parts imaged with cone-beam X-ray CT and concrete microstructure imaged with parallel-beam neutron CT. Our proposed method out-performs analytic reconstructions in all three cases, providing a step toward a reusable foundation prior for heterogeneous CT reconstruction problems.

[143] MLLM-Assisted Audio VOS: A 3rd Place Report for the MeViS-Audio Track, 8th LSVOS Challenge cs.CVPDF

Liangtao Shi, Jinxia Xie, Xiantao Hu, Ting Liu

TL;DR: 本文提出了一种无需训练的音频引导视频目标分割框架，该框架将多模态大语言模型（MLLMs）与基于SAM的分割模型相结合。通过将任务分解为多个阶段并为每个阶段选择合适的基模型，该方法利用MLLMs强大的多模态推理能力建模文本-视觉对应关系，并使用SAM模型生成精确的目标掩码。

Details

Motivation: 旨在解决音频引导视频目标分割任务，探索如何在不进行额外模型训练或任务特定微调的情况下，有效利用现有强大的基础模型来完成复杂任务。

Result: 该方法在第八届LSVOS挑战赛的MeViS-Audio赛道上取得了有竞争力的性能，获得了第三名。

Insight: 主要创新点在于提出了一种训练自由的模块化框架，通过任务分解和基模型组合（MLLMs用于跨模态推理，SAM用于分割）来完成任务，展示了利用现有基础模型解决新任务的潜力。

Abstract: In this technical report, we present a training-free framework for audio-guided video object segmentation, which integrates Multimodal Large Language Models (MLLMs) with SAM-based segmentation models. We decompose the task into several stages and identify suitable foundation models for each stage. Without introducing additional model training or task-specific fine-tuning, our approach leverages the strong multimodal reasoning capabilities of MLLMs to model text-visual correspondence and employs SAM-based models for accurate object mask generation. The proposed framework demonstrates the effectiveness of leveraging foundation models for audio-guided video segmentation and achieves competitive performance in the MeViS-Audio Track of the 8th LSVOS Challenge.

[144] Bee Detection and Tracking at Hive Entrance using YOLO11 and ByteTrack cs.CVPDF

Thi Thu Thao Nguyen, Johannes Reschke

TL;DR: 本文提出了一种基于YOLO11迁移学习和ByteTrack跟踪算法的蜜蜂入口自动监测系统。研究探讨了数据增强、主干网络冻结和跟踪器参数优化对检测和计数快速移动的小型蜜蜂的影响。采用渐进式主干网络解冻策略的检测器实现了约97.0%的精确率和98.7%的mAP50，且比完全微调提供了更稳定的收敛性。实验表明，轻度数据增强优于重度增强。对于跟踪，优化了ByteTrack参数以在低置信度检测下改善轨迹连续性。在一个独立的25 FPS侧视视频上，优化后的YOLO11-ByteTrack系统正确计数了47只进入蜜蜂中的43只（91.5%）和30只离开蜜蜂中的7只（23.3%）。

Details

Motivation: 解决在蜂巢入口处自动、可靠地检测和跟踪快速移动的小型蜜蜂（易受运动模糊影响）的挑战，以实现准确的进出计数，用于蜜蜂行为监测。

Result: 在检测方面，采用渐进式主干解冻的YOLO11模型达到约97.0%的精确率和98.7%的mAP50。在跟踪计数方面，在25 FPS侧视视频上，对进入蜜蜂的计数准确率为91.5%（43/47），但对离开蜜蜂的计数准确率较低，为23.3%（7/30）。系统在现实记录条件下提高了可靠性。

Insight: 创新点包括将渐进式主干网络解冻策略应用于YOLO11进行小目标检测，以提升收敛稳定性；优化ByteTrack参数以处理低置信度检测，改善轨迹连续性；实证表明对于此类任务，适度的数据增强优于重度增强。这些工程优化策略对在具有挑战性的真实世界场景（小目标、快速运动、运动模糊）中部署目标检测与跟踪系统具有借鉴意义。

Abstract: This work presents an automatic bee entrance monitoring system based on YOLO11 transfer learning and the ByteTrack tracking algorithm. The study investigates the influence of data augmentation, backbone freezing, and tracker parameter optimization on the detection and counting of small, fast-moving bees. The detector with progressive backbone unfreezing strategy achieved about 97.0% precision and 98.7% mAP50, while providing more stable convergence than full fine-tuning. Experiments also showed that light augmentation outperformed heavy augmentation. For tracking, ByteTrack parameters were optimized to improve trajectory continuity under low-confidence detections. On an independent 25 FPS side-view video, the optimized YOLO11-ByteTrack system correctly counted 43 of 47 incoming bees (91.5%) and 7 of 30 outgoing bees (23.3%). Error analysis showed that most counting errors were caused by missed detections due to rapid bee motion and motion blur, while tracking failures became less frequent after parameter optimization. Overall, the results indicate that moderate augmentation, progressive backbone unfreezing, and ByteTrack tuning improve the reliability of automatic bee entrance monitoring under realistic recording conditions.

[145] Mover360: Controllable Object Manipulation in 360° Panoramic Images cs.CVPDF

Haoyi Zhong, Fang-Lue Zhang, Andrew Chalmers, Taehyun Rhee

TL;DR: Mover360是一个针对360°全景图像的可控物体操作框架，专注于物体平移（在现有全景图中重新定位指定物体），并支持参考引导的插入和移除作为辅助任务。该框架通过将每个任务编码为固定提示和紧凑的ERP对齐指令图，统一了点、边界框和掩码引导的控制界面。在结构上，它是对预训练扩散Transformer的轻量级适配，并利用UE5数据生成管道构建了大规模配对数据和包含合成与真实全景图的双域基准测试。

Details

Motivation: 解决现有透视图像编辑器难以处理360°图像（具有水平环绕、纬度相关畸变和全局场景连续性）中物体级编辑的挑战，以及用户指定编辑的困难。

Result: 在合成和真实全景图的双域基准测试及两种评估协议下，Mover360在重建保真度、语义一致性和分布质量方面，均优于用于透视编辑、插入和修复的强基线方法。

Insight: 创新点包括：将多种控制方式（点、框、掩码）统一编码到固定提示和ERP对齐指令图的接口设计；利用全景上下文和辅助深度条件从单点点击推断物体合理尺寸、支撑和光照的机制；以及通过UE5构建大规模配对监督数据和双域基准的数据生成流程。这为全景图像编辑提供了系统性的解决方案和评估基准。

Abstract: We present Mover360, a controllable object manipulation framework for 360° images. Unlike perspective images, 360° images in equirectangular projection (ERP) exhibit horizontal wrap-around, latitude-dependent distortion, and global scene continuity, which makes object-level edits difficult for existing perspective editors to produce and for users to specify. To address this, Mover360 centers on object Translation (relocating a specified object within an existing panorama) while supporting reference-guided Insert and Remove as auxiliary tasks. Its interface unifies point-, bbox-, and mask-guided control by encoding each task into a fixed prompt and a compact, ERP-aligned instruction map. In the default point mode, a single click relocates an object, allowing the model to infer a plausible size, support, and illumination using panoramic context and an auxiliary depth condition. Structurally, Mover360 is a lightweight adaptation of a pretrained diffusion transformer. To generate paired supervision, we construct a UE5 data-generation pipeline with surface-aware object placement and randomized illumination, yielding large-scale paired data and a dual-domain benchmark of synthetic and real panoramas with ground truth for all three tasks. Across both test domains and two evaluation protocols, Mover360 outperforms strong baselines for perspective editing, insertion, and inpainting in reconstruction fidelity, semantic consistency, and distributional quality. Code and our benchmark dataset are available at https://zhonghaoyi.github.io/Mover360/.

[146] Progressively Learning Heterogeneous Skills in a Unified Latent Space cs.CVPDF

Yue-Yi Zhang, Ming Gong, Linpu He, Wei-Shi Zheng, Zhilin Zhao

TL;DR: HetSkills是一个新颖的框架，旨在统一的潜在空间中逐步学习基于物理的角色控制的异构技能。其核心是将潜在空间视为共享的可执行接口，以整合来自不同数据源、监督形式和任务的技能。该框架从学习跟踪技能开始，建立运动控制基础并创建共享运动解码器，然后通过运动直觉蒸馏和任务引导模块来增强文本到运动技能，从而在保持自然运动的同时扩展技能库，适用于长时程任务。

Details

Motivation: 解决在基于物理的角色控制中，如何在一个统一的框架内逐步整合和学习来自不同来源、形式和任务的异构技能，并避免技能学习中的捷径问题，以实现对长时程任务的高度适应性。

Result: 实验结果表明，HetSkills在运动跟踪、文本到运动生成、运动补全和下游任务适应方面均表现出有效性，即使在具有挑战性的条件下也取得了令人印象深刻的成功率。

Insight: 创新点在于将统一的潜在空间设计为共享的可执行接口，以及引入运动直觉蒸馏来将文本到运动生成基于语言语义，并结合任务引导模块动态调整动作。这为异构技能的渐进式学习和整合提供了可借鉴的框架。

Abstract: We propose HetSkills, a novel framework designed to progressively learn heterogeneous skills within a unified latent space for physics-based character control. The core idea is to treat this latent space as a shared executable interface, enabling seamless integration of skills learned from diverse data sources, supervision forms, and tasks. HetSkills begins by learning a tracking skill that establishes a strong foundation in motion control and creates a shared motion decoder, which can be reused across tasks without the need for retraining or separate controllers. To prevent the text-to-motion skill from exploiting shortcut pathways instead of learning language semantics, we introduce motion intuition distillation to ground text-to-motion generation in language semantics and a task-guidance module that dynamically adjusts actions based on high-level language instructions. This enables HetSkills to preserve natural motion while continuously expanding its skill repertoire, making it highly adaptable for long-horizon tasks. Experimental results demonstrate the effectiveness in motion tracking, text-to-motion generation, motion completion, and downstream task adaptation, achieving impressive success rates even under challenging conditions.

[147] E2S-Pruner: Progressive Two-Stage Evidence Fusion for Visual Token Pruning in Vision-Language Models cs.CV | cs.AIPDF

Taoyu Qian, Qi Wang, Daqian Shi, Yuanhao Jiang, Shang Gao

TL;DR: 本文提出了E2S-Pruner，一种用于视觉语言模型中视觉令牌剪枝的渐进式两阶段证据融合框架。该方法无需辅助模型、可训练参数或微调，通过将每个注意力头视为独立证据源，利用Dempster-Shafer证据理论量化层间冲突并融合多层证据，同时引入空间新颖性约束以防止保留的令牌集中在少数局部显著区域。

Details

Motivation: 视觉语言模型通常将图像编码为数百个视觉令牌，导致推理延迟和GPU内存开销巨大。现有剪枝方法主要依赖注意力分数并直接聚合跨注意力头和网络层的输出，难以表征证据的不确定性和冲突。

Result: 在LLaVA-1.5-7B模型上，当平均保留视觉令牌数为192、128和64时，E2S-Pruner分别保持了98.0%、96.8%和90.6%的聚合性能，同时在128令牌和64令牌设置下将吞吐量分别提高了1.96倍和2.09倍。在Qwen2-VL-7B上的实验进一步证明了其跨模型泛化能力。

Insight: 创新点在于将证据理论引入视觉令牌剪枝，通过两阶段证据融合（头内可靠性和层间融合）来量化不确定性并解决冲突，同时引入空间新颖性约束以提升保留令牌的空间覆盖度，实现了无需训练的高效剪枝。

Abstract: Vision-language models typically encode an image into hundreds of visual tokens, incurring substantial inference latency and GPU memory overhead. Existing pruning methods largely rely on attention scores and directly aggregate outputs across attention heads and network layers, making it difficult to characterize evidential uncertainty and conflict. We propose E2S-Pruner, a progressive two-stage evidence-fusion framework for visual token pruning that requires no auxiliary model, trainable parameters, or fine-tuning. In the first stage, E2S-Pruner treats each attention head as an independent evidence source, estimates its reliability from evidence clarity and inter-head consistency, and represents each visual token using three states: important, unimportant, and uncertain. In the second stage, Dempster–Shafer evidence theory is used to quantify inter-layer conflict and fuse complementary evidence from multiple network layers. We further introduce a spatial novelty constraint that promotes coverage of distinct image regions and prevents the retained tokens from concentrating in a few locally salient areas. On LLaVA-1.5-7B, E2S-Pruner retains 98.0%, 96.8%, and 90.6% of the aggregate performance when the average numbers of retained visual tokens are 192, 128, and 64, respectively, while improving throughput by 1.96x and 2.09x under the 128-token and 64-token settings. Experiments on Qwen2-VL-7B further demonstrate cross-model generalization. Code is available at https://github.com/taoyu-qian/E2S-Pruner.git.

[148] Dual-Grained Agent Memory and Shapley Context Attribution for Multimodal Agentic Learner cs.CVPDF

Jieke Wang, Tiancheng Shen, Yibo Yang, Ming-Hsuan Yang

TL;DR: 本文提出了一种名为DG-Mem的双粒度智能体记忆框架，用于增强冻结的多模态大语言模型（MLLM）的推理能力。该框架通过一个非参数化的外部记忆库，在训练时构建并在测试时只读访问，将记忆分为实例级范例记忆和类别级规则模式记忆，并引入Shapley上下文归因来评估和重加权检索到的规则效用。

Details

Motivation: 前沿的MLLMs在感知方面表现出色，但在科学和数学推理上仍有不足。对于权重封闭或设备端部署的骨干模型，无法进行参数级微调，而无状态的提示方法则无法利用已解决问题的累积效益。

Result: 在MathVista、MMMU和MMMU-Pro基准测试上，使用包括Qwen3.5-27B、Qwen3.5-122B-A10B、GPT-5-Nano和Gemini-3-Flash在内的四种开放权重和专有骨干模型进行实验，DG-Mem相比无记忆和竞争性记忆基线模型均取得了持续一致的性能提升。

Insight: 主要创新点包括：1）受人类记忆互补学习系统启发，构建了实例范例与抽象规则模式的双粒度非参数记忆；2）设计了在线概念分类器，在训练中增量式增长类别空间，而非依赖预定义分类法；3）提出了Shapley上下文归因方法，量化检索规则集的整体贡献并重加权测试时检索，整个流程无需梯度更新，适用于封闭权重或设备端模型。

Abstract: Frontier multimodal large language models (MLLMs) deliver impressive perception yet still falter on scientific and mathematical reasoning. Parameter-level adaptation is unavailable for closed-weight or on-device backbones, and stateless prompting forfeits any compounding benefit from problems already solved. We propose \textbf{DG-Mem}, a dual-grained agentic memory framework that augments a frozen MLLM with a non-parametric, externally stored memory built once from training-time rollouts and consulted read-only at test time. Motivated by the Complementary Learning Systems (CLS) account of human memory, DG-Mem factors its store into an instance-grounded exemplar memory and a category-level schema memory of IF-THEN rules, with a transient reflection store mediating their construction so that schemas are synthesized only from abstract reflections, never from exemplar text. Two design choices distinguish DG-Mem: an online concept categorizer that grows the category space incrementally during training rather than committing to a predefined taxonomy, and a Shapley context attribution procedure that decomposes correctness across the entire retrieved rule set and yields a per-rule utility that re-weights retrieval at test time. The pipeline introduces no gradient updates and is deployable on closed-weight or on-device backbones. Across MathVista, MMMU, and MMMU-Pro on four open-weight and proprietary backbones (Qwen3.5-27B, Qwen3.5-122B-A10B, GPT-5-Nano, Gemini-3-Flash), DG-Mem improves consistently over no-memory and competitive memory baselines.

[149] Grounding Free-Form Instructions for Fashion Complementary Image Generation cs.CVPDF

Matteo Attimonelli, Claudio Pomo, Alessandro De Bellis, Danilo Danese, Dietmar Jannach

TL;DR: 本文提出了一种基于自由形式指令的时尚互补图像生成任务，通过引入多模态语言接地设置，使模型能够根据种子图像和自然语言指令生成风格匹配的服装。作者构建了包含低、中、高特异性指令的数据集，并采用基于整流流匹配的StyleFlow模型进行联合条件生成，在多个基准测试中实现了指令对齐和风格一致的生成效果。

Details

Motivation: 现有时尚互补图像生成基准依赖僵化的模板提示（如“一张裙子的照片”），无法反映自然用户查询，且难以评估模型在不同语言特异性下的表现，因此需要引入自由形式指令来更好地模拟真实场景。

Result: 在图像质量指标、目录对齐分析、消融实验和人工评估中，StyleFlow模型在多个CIG基准上均能生成与指令对齐且风格一致的服装，同时相对于辅助模块方法降低了架构复杂度和推理成本。

Insight: 创新点在于将自由形式指令引入时尚互补图像生成，构建了多粒度语言特异性的数据集，并采用单一多模态Transformer联合条件生成，简化了模型架构，提升了生成可控性和效率。

Abstract: Fashion complementary image generation (CIG) aims to create garments that stylistically match a seed item based on user intent, making it a natural multimodal grounding problem where models must interpret language in visual context. Existing CIG benchmarks rely on rigid template prompts (e.g., “a photo of a skirt”), failing to reflect natural user queries and obscuring model behavior across levels of linguistic specificity. We introduce fashion complementary image generation with free-form instructions, a multimodal language-grounding setting where a model generates a compatible garment from a seed image and a natural-language instruction. To this end, we enrich three CIG benchmarks with low-, medium-, and high-specificity instructions generated by a vision-language model and validated by human annotators. We instantiate the task with StyleFlow, a Rectified Flow Matching model that jointly conditions on the seed image and instruction within a single multimodal transformer. Across image quality metrics, catalog-alignment analysis, ablations, and human evaluation, StyleFlow consistently produces instruction-aligned and stylistically coherent garments while reducing architectural complexity and inference cost relative to auxiliary-module approaches.

[150] Thinking Beyond Videos: Unifying Video Reasoning and Deep Research for Open-World Video Agents cs.CV | cs.AIPDF

Wenqi Liu, Shijie Ma, Yunxiao Wang, Meng Liu, Qile Su

TL;DR: 本文提出了VideoRover，一个统一的视频深度研究框架，通过迭代协调视频裁剪、多模态搜索和网页浏览来解决开放世界视频理解问题。该框架能够主动定位视频中的稀疏视觉证据并获取外部知识，通过构建自动化数据管道和基准测试，验证了其在视频推理和深度研究任务上的有效性。

Details

Motivation: 开放世界视频理解需要模型定位稀疏视觉证据并获取视频及参数化内存中缺失的外部知识，而现有的视频推理和深度研究能力通常孤立发展，缺乏统一协调。

Result: 在VideoDR和VideoRover-Bench基准测试中，VideoRover-8B-RL在无需工具使用的直接回答设置下性能与专有模型相当，并在配备相同工具套件时优于更大的开源模型。

Insight: 创新点在于将主动视频定位、外部检索和长视野强化学习统一到一个迭代框架中，通过自动化数据管道生成训练轨迹，并引入分层基准测试以评估不同视频时长和研究难度下的性能。

Abstract: Open-world video understanding often requires a model to locate sparse visual evidence and acquire external knowledge that is absent from the video and its parametric memory. While Thinking-with-Videos enables active temporal perception and Deep Research supports multi-step information seeking, the two capabilities are typically developed in isolation. We introduce VideoRover, a unified Video Deep Research framework that iteratively coordinates video cropping, multimodal search, and webpage browsing. Given a video-question pair, VideoRover uses each tool result to select the next action, so localized video clips guide external retrieval and retrieved evidence triggers further video inspection and verification. To develop this capability, we construct an automated data curation pipeline, producing 26K verified SFT trajectories and 3K challenging RL instances. We also introduce VideoRover-Bench, a benchmark stratified by video duration and research difficulty. Experiments on VideoDR and VideoRover-Bench show that our VideoRover-8B-RL achieves performance comparable to proprietary models in the direct-answer setting without tool use while outperforming larger open-source models equipped with the same tool suite. Ablation studies and training dynamics further validate the complementary roles of active video grounding, external retrieval, and long-horizon reinforcement learning.

[151] IntentQA: Intent Question Answering in Videos by Cognitive Context Reasoning cs.CVPDF

Jiapeng Li, Ping Wei, Wenjuan Han, Song-Chun Zhu, Lifeng Fan

TL;DR: 本文提出了IntentQA任务，旨在通过视频理解推断人类行为背后的意图，并构建了一个大规模的视频问答数据集。为了评估模型鲁棒性，作者使用大语言模型生成了五个对比集并引入了对比性能下降指标。同时，提出了X-CaVIR框架，该框架利用情境、对比和常识三种认知上下文来增强视频分析，并通过透明管道整合大语言模型以提升性能和可解释性。

Details

Motivation: 解决视频理解中从视觉观察到意图推理的鸿沟，即超越视觉事实识别，理解人类行为背后的意图（社会智能的“暗物质”）。

Result: 在提出的IntentQA基准上进行了广泛实验，X-CaVIR框架在性能上超越了现有最先进的基线模型，并在生成的对比集上表现出稳定的鲁棒性。

Insight: 创新点包括：1) 引入IntentQA新任务及相应数据集；2) 提出使用LLMs生成对比集和“对比性能下降”指标来严格评估模型鲁棒性；3) 设计X-CaVIR框架，整合三种认知上下文（情境、对比、常识）并采用透明管道协同视频描述和VQA模型输出，以提升性能与可解释性。

Abstract: Video understanding requires intelligent agents to transcend mere recognition of visual facts and comprehend the underlying intents behind human actions (often termed the “dark matter” of social intelligence). To bridge the gap between visual observation and intent reasoning, we introduce a novel task, IntentQA, and contribute a large-scale VideoQA dataset specifically tailored for this purpose. However, recognizing that standard metrics may overestimate capabilities due to dataset biases, we go beyond simple accuracy to rigorously evaluate model robustness. We augment the benchmark by generating five distinct contrast sets via Large Language Models (LLMs) and introducing a “Contrast Performance Decline” metric. We propose the X-CaVIR (eXplainable Context-aware Video Intent Reasoning) framework, which leverages three types of “Cognitive Context” to enhance video analysis: i) Situational Context via a cross-modal Video Query Language (VQL) module, ii) Contrastive Context via a Contrastive Learning module, and iii) Commonsense Context via a Commonsense Reasoning module. Crucially, to overcome the opacity of traditional black-box models, we refine the integration of LLMs within X-CaVIR by employing a transparent pipeline that synergizes video captions with VQA model outputs. This approach not only improves performance by effectively utilizing rich commonsense knowledge but also renders the reasoning process explicitly interpretable. Extensive experiments demonstrate the effectiveness of our components, the superiority of X-CaVIR over state-of-the-art baselines, and its stability against perturbations on the contrast sets.

[152] Can Coding Agents Build Robust Baselines? A Skill-Based Approach for Automating the Medical Imaging Model-Development Pipeline cs.CVPDF

Eugenia Moris, José Ignacio Orlando

TL;DR: 本文提出了一种基于技能的AI科学家工作流，通过结合文献引导推理、自动化代码生成和假设驱动实验，为医学影像任务自动生成具有竞争力的深度学习基线模型。该方法在分割、分类和检测四个公开基准测试中进行了评估，无需针对特定任务重新设计即可实现竞争性的排行榜表现，并展现出强大的领域泛化能力。

Details

Motivation: 当前医学影像深度学习基线的开发过程高度迭代且依赖专家经验，现有自动化方法通常只优化架构搜索或超参数调优等孤立环节，而非完整的基线开发流程。

Result: 在PUMA（两项任务均获第6名/共15队）和MILK10k（第31名/共125队）等基准测试中取得了竞争性排行榜结果；在MIDOG25上，生成的模型在扫描仪、肿瘤类型和物种间展现出强大的领域泛化能力。

Insight: 创新点在于将文献引导推理、代码生成与假设驱动实验整合为统一的技能型智能体工作流，实现了端到端的基线自动化开发，显著减少了工程投入，其任务无关的设计展现了良好的通用性。

Abstract: Developing competitive deep learning baselines for medical imaging remains a highly iterative process requiring literature review, implementation, experimentation, and expert refinement. Existing automation approaches typically optimize isolated components, such as architecture search or hyperparameter tuning, rather than the complete baseline development process. We present an agentic AI Scientist workflow that combines literature-guided reasoning, automated code generation, and hypothesis-driven experimentation to generate competitive baseline models for medical imaging challenges. The framework is evaluated on four public benchmarks spanning segmentation, classification, and detection. Across all tasks, the Experimentation Pipeline consistently improves validation performance, achieving competitive leaderboard results, including 6th place on both PUMA tracks (15 teams) and 31st place on MILK10k (125 teams). On MIDOG25, the resulting model also demonstrates strong domain generalization across scanners, tumor types, and species. Using the same workflow across all challenges without task-specific redesign, we demonstrate that skill-based, literature-guided agentic workflows can substantially reduce the engineering effort required to develop competitive medical imaging baselines.

[153] DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Experts cs.CV | cs.AI | cs.LGPDF

Vlad Hondru, Florinel Alin Croitoru, Iuliana Georgescu, A. Sophia Koepke, Radu Tudor Ionescu

TL;DR: 本文提出了一种名为DF-MoE的通用深度伪造检测框架，通过集成多种预训练模型提取音频和视觉模态的高层线索（如嘴部运动、面部解析、心率等），并利用稀疏混合专家（MoE）架构融合单模态与多模态信息，以提升检测器对不同生成方法的泛化能力。

Details

Motivation: 当前音视频深度伪造检测面临的主要挑战是模型容易过拟合，难以泛化到不同的伪造生成方法。本文的动机是通过利用多种预训练模型提取丰富的高层线索来缓解过拟合问题。

Result: 在五个深度伪造检测基准（MAVOS-DD, AVLips, PolyGlotFake, BioDeepAV, FakeAVCeleb）上进行了域内和跨域实验，结果表明DF-MoE取得了最优的检测性能，超越了所有现有方法，达到了SOTA水平。

Insight: 创新点在于系统地整合了多种预训练模型提取的多样化高层线索，并采用MoE架构进行有效融合，这为构建泛化性强的多模态深度伪造检测器提供了新思路。从客观角度看，其方法强调了利用现成预训练模型提取互补特征以增强模型鲁棒性的策略，具有借鉴意义。

Abstract: Audio-visual deepfake detection is an actively studied topic, where one of the main challenges is to develop detectors able to generalize across deepfake generation methods. We conjecture that overfitting can be mitigated by extracting multiple high-level cues from the available audio and visual modalities via pre-trained models. We therefore assemble a wide variety of pre-trained models to extract features that encode mouth movements, face parsing, facial expressions, head pose, gaze tracking, heart rate, audio emotion and speech activity. We further integrate both unimodal and multimodal cues via a Mixture-of-Experts (MoE) backbone to detect deepfakes. We perform in-domain and cross-domain experiments on five benchmarks for deepfake detection (MAVOS-DD, AVLips, PolyGlotFake, BioDeepAV, FakeAVCeleb) to compare our framework (DF-MoE) with state-of-the-art methods. Our results indicate that DF-MoE obtains superior deepfake detection results, surpassing all competing methods. We release our code at https://github.com/vladhondru25/DF-MoE.

[154] Towards Comprehensive Basketball Understanding cs.CV | cs.AIPDF

Yirong Hu, Jiayuan Rao, Yu Zhang, Shangzhe Di, Weidi Xie

TL;DR: 该论文提出了BasketballBench，一个用于全面评估篮球理解能力的多模态基准数据集，包含7,980个涵盖文本、图像和视频的十项任务问题。同时，作者提出了BasketballSkills智能体，通过组合八个篮球专用感知与检索工具来提升综合理解能力。实验表明，现有MLLMs在需要多能力整合的任务上表现不佳，而BasketballSkills则显著优于它们。

Details

Motivation: 现有篮球理解基准通常孤立评估事件识别、动作定位、球员识别等单项能力，缺乏对这些能力间交互作用的探索，因此需要构建一个更全面的评估框架。

Result: 在基于2025-2026 NBA赛季构建的BasketballBench上，当前MLLMs在需要多能力整合的问题上表现不佳，而提出的BasketballSkills智能体超越了这些模型，展示了其有效性。

Insight: 创新点在于构建了首个全面评估篮球多模态理解的基准数据集，并提出了一个通过组合领域专用工具（指定工具顺序、证据绑定和停止条件）来显式集成多能力的智能体框架，这为复杂场景理解提供了可借鉴的模块化方法。

Abstract: Understanding a basketball game requires recognizing events, localizing actions, identifying players, and relating these to structured game knowledge. Existing benchmarks primarily evaluate these abilities one at a time, leaving the interactions among these abilities under-explored. We introduce BasketballBench, a multimodal benchmark comprising 7,980 questions across ten tasks in text, image, and video. It is built from the 2025-2026 NBA season and includes official playby-play, rosters and profiles for 530 active players, and 2,501 possession-level broadcast clips. We further propose BasketballSkills, an agent that composes eight basketball-specific perception and retrieval tools under four reusable skills that specify tool order, evidence bindings, and stopping conditions. Experiments show that current MLLMs struggle particularly on questions requiring the integration of multiple capabilities, whereas BasketballSkills outperforms them, highlighting the effectiveness of explicitly composing domain-specific capabilities for comprehensive basketball understanding.

[155] Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds cs.CVPDF

Nan Duan, Haoyang Huang, Weiyang Jin, Haoran Li, Yaowei Li

TL;DR: 本文提出了JoyAI-Echo-1.5，一个统一的视听生成系统，包含两个专用变体：长视频变体通过可组合的跨镜头记忆和源自语音的说话人线索，实现了跨镜头的人物外观和声音身份一致性；世界模型变体通过将导航输入转换为校准的6-DoF相机轨迹并进行几何感知的条件注入，实现了控制器无关的交互。系统采用渐进式教师强制和自梯度强制训练策略，支持高效的长序列生成。

Details

Motivation: 解决视频生成从孤立片段向长篇幅叙事和交互式世界演进时面临的挑战，即需要模型在长序列生成中保持身份一致性、遵循用户控制并保持稳定性。

Result: 在长视频设置中，JoyAI-Echo-1.5在跨镜头一致性、视觉质量、文本对齐和语音保真度上优于现有基线。其世界模型变体在WBench基准测试中以平均81.7分排名第一，并在SANA-WM-Bench上取得了领先的视觉质量和长序列持续性。

Insight: 核心创新点在于引入了跨镜头记忆机制以实现长程一致性，以及几何感知的条件注入路径以实现灵活的交互控制。从客观角度看，将双向视听主干通过渐进式教师强制和自梯度强制转化为因果式少步生成器的训练策略，是高效长序列生成的一个实用技术路径。

Abstract: Video generation is progressing beyond isolated clips toward long-form narratives and interactive worlds, requiring models to preserve identities, follow user controls, and remain stable over extended rollouts. We present JoyAI-Echo-1.5, a unified audio-visual generation system with two purpose-built variants. The long-video variant introduces composable cross-shot memory that aggregates visual evidence across multiple prior shots and speaker cues derived from speech-filtered full-shot audio, enabling persistent character appearance and voice identity across flexible combinations of text, image, and memory conditioning. The world-model variant converts heterogeneous navigation inputs into calibrated metric 6-DoF camera trajectories and injects them through a geometry-aware conditioning pathway, enabling controller-agnostic interaction across flexible viewpoints. To support efficient long-horizon generation, we transform a bidirectional audio-visual backbone into a causal few-step generator using progressive teacher forcing and short- and long-horizon Self-Gradient Forcing on self-generated rollouts. Experiments demonstrate strong performance in both settings. JoyAI-Echo-1.5 achieves improvements over existing long-video baselines in cross-shot consistency, visual quality, text alignment, and speech fidelity. Its world-model variant ranks first on WBench, with an average score of 81.7, and achieves leading visual quality and long-horizon persistence on SANA-WM-Bench. Together, these results indicate that memory, geometric control, and rollout-aware training provide a practical foundation for generating coherent stories and continuously evolving interactive worlds. Project page: https://echo-team-joy-future-academy-jd.github.io/Echo-1.5-Page/.

[156] Geometry-Driven Opti-Acoustic Co-Registration and View-Invariant Reflectivity Mapping for Side-Scan Sonar cs.CVPDF

Taqi Hamoda, Nuno Gracias

TL;DR: 本文提出了一种几何驱动的框架，用于实现侧扫声纳（SSS）与光学图像的像素级协同配准和视角不变的反射率映射。该方法利用运动恢复结构（SfM）重建密集的3D海底网格作为几何锚点，通过首次海底回波提取算法校正非线性高度漂移，并应用逆朗伯模型和双高斯加权函数来分离固有的海底反射率，从而生成精确配准的多模态数据集。

Details

Motivation: 侧扫声纳是大规模水下测绘的主要模态，但声学复杂性（如散斑噪声、阴影和极端视角依赖性）严重阻碍了自动感知和跨模态对齐。传统的手工描述符和现代深度学习匹配器在没有3D几何约束的情况下，无法弥合光学和声学图像之间的物理域差距。

Result: 该方法通过确定性地将分离的声学属性与光学像素关联，生成了高度准确、严格配准的多模态数据集，为底栖栖息地测绘中的先进自监督学习铺平了道路。

Insight: 创新点在于将SfM重建的3D几何作为跨模态配准的锚点，并引入物理模型（逆朗伯模型和双高斯加权）来分离视角无关的固有反射率，从而实现了无需人工标注的自动化、物理引导的协同配准流程。

Abstract: Side-Scan Sonar (SSS) is a primary modality for large-scale underwater mapping, yet automated perception and cross-modal alignment are severely bottlenecked by acoustic complexities such as speckle noise, shadows, and extreme viewpoint dependencies. Traditional handcrafted descriptors and modern deep learning matchers fail to bridge the physical domain gap between optical and acoustic imagery without 3D geometric constraints. To overcome these limitations, we propose a novel geometry-driven framework for pixel-level opti-acoustic co-registration and view-invariant reflectivity mapping. Our method utilizes Structure-from-Motion (SfM) to reconstruct a dense 3D seafloor mesh, acting as a geometric anchor between the visual and acoustic domains. We introduce a First Bottom Return (FBR) extraction algorithm to dynamically correct non-linear altitude drift caused by uncalibrated SfM reconstruction. Furthermore, we apply an inverse Lambertian model and a dual-Gaussian weighting function to isolate the intrinsic seabed reflectivity, effectively neutralizing slant-range propagation loss and geometric view-dependence. By deterministically associating these isolated acoustic properties with optical pixels, our pipeline generates highly accurate, strictly co-registered multi-modal datasets. This automated, physics-guided approach eliminates the need for manual annotation and paves the way for advanced self-supervised learning in benthic habitat mapping.

[157] Action-Aligned Retrieval with Pairwise Multimodal Reranking for Text-Based Person Anomaly Search cs.CVPDF

Thanh-Khoi Nguyen, Thanh-Nhan Vo, Trong-Thuan Nguyen, Minh-Triet Tran

TL;DR: 本文提出ActPair框架，用于基于文本的行人异常行为搜索，通过动作对齐检索与成对多模态重排序的三阶段方法，解决现有方法在捕捉上下文依赖行为时的不足。

Details

Motivation: 现有方法难以捕捉细粒度的上下文依赖行为，常依赖孤立骨骼几何、丢弃原始查询细节或使用绝对点式评分进行多模态验证，因此需要一种能弥合姿态-语义差距的统一框架。

Result: 在Pedestrian Anomaly Behavior (PAB)公共测试集上，ActPair框架在对比方法中取得了最佳结果，并能有效迁移到未见过的非异常特定数据集。

Insight: 创新点包括：动作对齐的多任务目标微调视觉语言模型以编码动作判别语义；并行后期融合检索结合原始查询与LLM生成的上下文重写；高效的现成重排序模块采用枢轴-提升算法进行成对视觉比较，降低计算成本。

Abstract: Text-based person anomaly search requires distinguishing individuals based on fine-grained, context-dependent behaviors rather than mere appearance. Existing methods struggle to capture these context-conditioned actions, frequently relying on isolated skeletal geometry, discarding raw query details during reformulation, or utilizing absolute pointwise scoring for multimodal verification. To address these limitations, we propose \textbf{ActPair}, a unified three-stage coarse-to-fine framework that combines action-aligned retrieval with pairwise multimodal reranking to bridge the pose-semantic gap. First, we fine-tune a vision-language model (VLM) with an action-aligned multi-task objective that encourages the representations to encode action-discriminative semantics. Second, we perform parallel late-fusion retrieval using the original query and a large language model (LLM)-generated context-grounded rewrite, retaining complementary details from both semantic views. Finally, we propose an efficient off-the-shelf reranking module that leverages a pivot-promote algorithm to perform direct pairwise visual comparisons, mitigating residual spatial and compositional ambiguities without the prohibitive inference costs of exhaustive evaluation. Extensive experiments demonstrate that our framework achieves the best results among the compared methods on the Pedestrian Anomaly Behavior (PAB) public test and transfers effectively to an unseen, non-anomaly-specific dataset.

[158] GeoWAM: Visual Geometry World Action Models for Autonomous Driving cs.CV | cs.ROPDF

Yiren Lu, Xin Ye, Jiaming Liu, Jin Yao, Yi-chung Chen

TL;DR: GeoWAM是一种用于自动驾驶的视觉几何世界动作模型，它通过预测未来场景几何（点云）而非未来图像，来联合建模场景演化和自车动作。该方法将几何作为更自然的状态空间，并利用学习到的几何动态来预测自车轨迹，在开环和闭环评估中均显著优于基于图像的模型。

Details

Motivation: 现有世界动作模型（WAMs）主要在像素空间中学习场景动态，但像素将几何、运动与外观、纹理、光照等纠缠在一起，迫使模型从二维观测推断三维变换。作者认为几何（点云）能更自然地表示驾驶状态，因为它明确捕捉了空间结构、刚性与非刚性变换，并与执行驾驶动作的空间直接对齐。

Result: 广泛的开环和闭环评估表明，视觉几何世界建模比基于图像的替代方案产生显著更强的驾驶策略，确立了未来几何预测作为自动驾驶有效预训练目标的地位。

Insight: 核心创新在于将世界动作模型的状态空间从像素转移到几何（点云），并以此作为预训练目标。这直接建模了驱动场景演化的三维变换，为动作预测提供了更本质和结构化的表示，是一种有前景的自动驾驶表征学习范式。

Abstract: World action models (WAMs) have recently gained increasing attention as a framework for jointly modeling scene evolution and ego actions in autonomous driving. Most existing WAMs learn scene dynamics in pixel space by combining a video-generation backbone for future-observation prediction with an action head for ego-trajectory prediction. Pixels, however, provide only an indirect representation of these dynamics: they entangle geometry and motion with appearance, texture, and illumination, forcing the model to infer three-dimensional transformations from two-dimensional observations. We argue that geometry, represented by point clouds, offers a more natural state space for driving because it explicitly captures spatial structure and the rigid and non-rigid transformations that govern scene evolution while directly aligning with the space in which driving actions are executed. Building on this insight, we introduce \textbf{GeoWAM}, a visual geometry world action model for autonomous driving. Rather than predicting future images, GeoWAM is pretrained to forecast future scene geometry, yielding representations that jointly encode spatial structure and temporal evolution. A geometry-conditioned action head then leverages these learned geometric dynamics to predict future ego trajectories. Extensive open-loop and closed-loop evaluations show that visual geometry world modeling yields substantially stronger driving policies than image-based alternatives, establishing future-geometry prediction as an effective pretraining objective for autonomous driving.

[159] SVD-Based Typicality Maps for Out-of-Distribution Detection in Vision Transformers cs.CVPDF

Aldo Sean Sartor, Leandro de Souza Rosa, Andriy Enttsel, Mauro Mangia, Riccardo Rovatti

TL;DR: 本文提出了一种基于奇异值分解（SVD）的方法，用于分析视觉变换器（ViT）的内部表示，并生成典型性图以进行分布外（OOD）检测。该方法通过将各层权重矩阵进行SVD分解，并将激活投影到主要右奇异向量上，从而获得紧凑的层内表示。随后，通过拟合类条件密度模型，生成跨深度的典型性图，并从中推导出两种用于OOD检测的后验分数。

Details

Motivation: 动机在于利用ViT学习参数的几何结构来分析其内部表示，从而解决在无需重新训练或接触OOD数据的情况下，进行有效的分布外检测的问题。

Result: 在基于CIFAR-100微调的ViT-B/16模型上，所提出的原型对齐分数（PAS）和多层软投票（MLSV）分数实现了具有竞争力的OOD检测性能。

Insight: 创新点在于将SVD分解与类条件密度模型结合，生成可解释的典型性图作为网络内部证据演化的二维摘要，并从中提取出两种无需存储原型的OOD检测分数，为理解ViT的内部工作机制提供了新视角。

Abstract: We present a method for analyzing the internal representations of Vision Transformers (ViTs) exploiting the geometry of their learned parameters. Each affine layer’s weight matrix is factored via Singular Value Decomposition (SVD), and activations are projected onto the leading right singular vectors to obtain compact, layer-intrinsic representations. A class-conditional density model is then fitted at each layer, producing per-class \emph{typicality scores} that are stacked across depth into \emph{typicality maps}: two-dimensional summaries of how class-specific evidence evolves through the network. From these maps, we derive two post-hoc scores for Out-Of-Distribution (OOD) detection: a \emph{Prototype Alignment Score} (PAS), measuring agreement with class reference prototype patterns, and a \emph{Multi-Layer Soft Voting} (MLSV) score, capturing cross-layer consensus without stored prototypes. On ViT-B/16 fine-tuned on CIFAR-100, the proposed scores achieve competitive detection performance without retraining or OOD exposure.

[160] Investigating Relational Reasoning in VLMs cs.CVPDF

Adhithya Laxman Ravi Shankar Geetha, Aulia Kharis Rakhmasari, Haleema Ramzan, Xander Yap

TL;DR: 本文研究了视觉语言模型（VLMs）在视觉推理任务中是否真正理解视觉关系，还是仅仅利用了语言线索或先验知识等捷径。为此，研究者使用Qwen3-VL-4B模型，并构建了一个包含简单几何形状的合成数据集，通过精心设计的查询来精确测试语言线索和模型对视觉证据的因果依赖。结果表明，当前的VLMs结合了真正的视觉推理和主要基于语言线索的捷径策略。

Details

Motivation: 动机在于探究VLMs在视觉推理任务中的表现是否源于对视觉关系的真正理解，还是仅仅依赖于语言线索或先验知识等表面捷径，以揭示其内部工作机制。

Result: 研究结果显示，在构建的合成数据集上，当前VLMs（以Qwen3-VL-4B为例）的表现是真正的视觉推理与主要基于语言线索的捷径策略的结合。

Insight: 创新点在于提出了一种使用可控的合成数据集和精心设计的查询来剖析VLMs视觉推理机制的方法，该方法能有效区分模型是进行真实视觉理解还是依赖语言捷径，为模型可解释性研究提供了新思路。

Abstract: Vision-Language Models (VLMs) achieve strong performance in visual reasoning tasks, but it remains unclear whether they understand visual relations, or simply employ shortcuts such as language cues or priors. To investigate this, we use the Qwen3-VL-4B (Bai et al., 2025), a modern VLM, to decode how visual information is encoded across depths. For this, we propose a synthetic dataset of simple geometric shapes for controlled analysis, along with queries crafted to precisely test language cues. Furthermore, the dataset is modified to test causal reliance on visual evidence. Our results show that current VLMs combine genuine visual reasoning with shortcut strategies primarily rooted in language cues.

Santosh Ray, Pratik K. Mishra, Ali Abedi, Charlene H. Chu, Amir Ahmad

TL;DR: 该研究利用MAISON-LLF数据集，通过多模态传感器数据（如运动、心率、睡眠等）和多输出回归模型，同时预测下肢骨折或髋关节置换术后老年患者的五项临床恢复指标，包括功能恢复和社会隔离程度。结果表明，联合预测优于单独预测，其中NODE模型表现最佳。

Details

Motivation: 解决老年患者术后恢复轨迹复杂且临床指标通常被孤立研究的问题，旨在通过多模态数据联合分析，更全面地评估恢复过程。

Result: 在MAISON-LLF数据集上，多输出回归模型NODE取得了MSE=3.96和MAE=1.02的优异性能，优于其他单输出和多输出回归器，证明了联合预测的有效性。

Insight: 创新点在于将多模态传感器数据与多项临床评分的关系建模为多输出回归问题，并验证了联合预测的优越性；SHAP特征分析强调了多模态传感器对于准确估计恢复轨迹的重要性，为远程患者监测提供了新思路。

Abstract: Older adults recovering after lower-limb fracture or hip replacement may experience complex recovery trajectories. Most of the time, these clinical aspects are studied in isolation, masking their joint impact on recovery. This study used the MAISON-LLF dataset, which contains multimodal sensor and clinical assessment data from 18 older adults recovering in the community after lower-limb fracture or hip replacement. Participants were monitored for up to eight weeks, corresponding to a maximum of 1,008 participant-days of sensor monitoring. Forty-six daily features were extracted from indoor motion, acceleration, step count, heart rate, out-of-home mobility, and sleep data. Five clinical outcomes were assessed every two weeks: the Social Isolation Scale, Oxford Hip Score, Oxford Knee Score, Timed Up and Go test, and 30-second Chair Stand test. We utilize an inherent relationship between multi-modal sensor data and different clinical scores and formulate it as a multi-output regression problem. We tested various machine learning and deep learning single- and multi-output regression algorithms to predict these scores simultaneously. The results showed that predicting clinical scores jointly was better than separately. The tabular DL multi-output regressor, NODE, gave a remarkable performance of MSE=3.96 and MAE=1.02 in comparison to other multi- and single-output regressors. The SHAP feature analysis further showed the importance of including multimodal sensors to provide a good estimate of patients’ recovery trajectory. This work may support the simultaneous assessment of functional recovery and social engagement among community-dwelling older adults and ultimately help improve their care and quality of life.

[162] FixAnything: 3D-Consistent Rendering Refinement via Video Generative Priors cs.CVPDF

Khiem Vuong, Deva Ramanan, Srinivasa Narasimhan

TL;DR: FixAnything 提出了一种通用的渲染修复方法，利用预训练的视频生成模型作为先验，通过视频到视频的转换来修复多种3D场景表示（如3DGS、NeRF、网格、点云）在稀疏输入或远距离视角下产生的渲染伪影。该方法仅需最小修改和轻量微调，通过引入干净像素掩码控制结构保留，并使用相机姿态准确性作为奖励信号进行直接偏好优化（DPO）以确保3D一致性。

Details

Motivation: 现有基于扩散生成先验的方法修复渲染伪影时，通常针对特定3D表示设计，需要定制架构或大量重新训练，缺乏通用性。FixAnything旨在开发一个单一模型，能够通用地修复多种3D表示的渲染问题，简化流程并提升效率。

Result: 在四种不同的3D表示（3DGS、NeRF、网格、点云）上，FixAnything通过轻量微调均能一致提升渲染质量，表明单一通用视频先验可以替代多个专用修复流程，实现了通用且有效的渲染增强。

Insight: 创新点在于将渲染修复重新定义为视频到视频的转换任务，利用噪声渲染序列中保留的相机运动和粗略场景结构；通过引入干净像素掩码实现可控的结构保留，并结合DPO以相机姿态准确性作为奖励来强制3D一致性，这使得预训练视频模型能够被高效复用，无需复杂架构改动。

Abstract: Rendering views using 3D scene representations such as Gaussian Splatting (3DGS), Neural Radiance Fields (NeRF), meshes, or even point clouds produces artifacts when input views are sparse or target views lie far from the input. Recent work mitigates these artifacts using diffusion-based generative priors, but is specialized to individual representations and require custom architectures or extensive retraining. We present FixAnything, a single model for fixing a wide range of rendering artifacts. It does so by repurposing a pretrained video generative model, leveraging its implicit multi-view priors with only minimal modification and lightweight finetuning. Our key insight is that even noisily-rendered sequences preserve camera motion and coarse scene structure, allowing cleanup to be formulated as video-to-video translation. To control what scene structure should be preserved, we introduce a binary mask denoting the clean pixels, enabling the model to anchor its output to high-quality inputs (e.g. training views) while refining the rest. To encourage FixAnything to produce 3D-consistent renderings that support downstream reconstruction, we use camera pose accuracy (recovered via structure-from-motion) as a reward signal for direct preference optimization (DPO). Across four distinct 3D representations, FixAnything consistently improves rendering quality with lightweight finetuning, demonstrating that a single generalist video prior can replace multiple specialist refinement pipelines. The simplicity of the framework enables immediate adoption of stronger future video models without architectural redesign.

[163] EG-ARSA: An Expert-Grounded Open Model for Visual Road Safety Auditing in Low-Resource Settings cs.CV | cs.AIPDF

Md Thamed Bin Zaman Chowdhury, Moazzem Hossain

TL;DR: 本文提出了一种名为专家基础蒸馏（EGD）的新型人工智能框架，旨在解决中低收入国家因事故记录不完整、合格审计员短缺和大规模实地检查成本高昂而受限的主动道路安全审计问题。该框架将机构道路安全专业知识转移到一个紧凑的视觉语言模型中，用于可扩展的视觉道路安全审计。

Details

Motivation: 动机是解决中低收入国家在主动道路安全审计方面面临的挑战，包括不完整的事故记录、合格审计员短缺以及大规模实地检查的高昂成本。

Result: 实验结果表明，经过基础微调后，模型在有序风险评估上相比零样本基线有显著提升。盲法专家评估显示，紧凑的学生模型（80亿参数）性能优于其310亿参数的教师模型和Gemini-2.5-Flash。

Insight: 主要创新点在于提出了专家基础蒸馏（EGD）框架，其核心是一个量化的专家基础阶段，用于校准教师视觉语言模型与权威实地审计结果的一致性。此外，还引入了首个开放的、专家基础的孟加拉国视觉道路安全审计数据集（BD-ARSA）和首个专为此任务开发的视觉语言模型（EG-ARSA）。

Abstract: Road traffic injuries remain a major challenge in low- and middle-income countries, where proactive road safety auditing is limited by incomplete crash records, shortages of qualified auditors, and the high cost of large-scale field inspections. To address this problem, we propose Expert-Grounded Distillation (EGD), a novel artificial intelligence framework that transfers institutional road safety expertise into a compact vision-language model for scalable visual road safety auditing. The key innovation is a quantified expert-grounding stage in which the teacher vision-language model is calibrated against authoritative field audits. Large-scale annotation is permitted only after the teacher reaches substantial agreement with expert risk assessments (Cohen’s kappa = 0.74). The calibrated teacher then generates structured supervision that is distilled into an 8-billion-parameter student vision-language model using Low-Rank Adaptation and a single leakage-free prompt. We also introduce Bangladesh Road Safety Audit (BD-ARSA), the first open, expert-grounded Bangladeshi visual road safety audit dataset containing 21,947 image-audit records with near-national coverage, and Expert-Grounded Road Safety Auditor (EG-ARSA), the first vision-language model developed specifically for this task. Experimental results show that grounded fine-tuning substantially improves ordinal risk assessment over the zero-shot baseline, while blind expert evaluation demonstrates that the compact student outperforms both its 31 billion-parameter teacher and Gemini-2.5-Flash. These findings demonstrate that EGD provides an effective and scalable engineering solution for proactive road safety auditing in resource-constrained environments.

cs.CY [Back]

[164] PersonaMem-v3: Toward Omni-Platform Personal Intelligence for Holistic User Understanding, Recommendation, and Agentic Tasks cs.CY | cs.CLPDF

Bowen Jiang, Yuan Yuan, Zhuoqun Hao, Yuchen Liu, Maohao Shen

TL;DR: 本文提出了PersonaMem-v3，一个面向全平台个人智能的综合基准测试与评估框架。该基准基于超过一百万条匿名的真实世界用户互动历史构建，模拟了用户在社交媒体、聊天机器人、日历和AI伴侣等跨平台数字世界中的偏好演变。它旨在评估AI代理是否能够从跨平台证据中推断整体用户理解、进行个性化响应、重新排序社交媒体推荐、通过自然语言接受用户引导，并在个性化不恰当时保持克制。

Details

Motivation: 当前系统只能在单个应用或任务中进行个性化，而个人智能作为一个整体，在跨上下文用户理解、可引导的推荐系统、跨平台主动行为以及避免过度个性化等方面仍缺乏有效的衡量标准。

Result: 论文提出了一个基准测试框架，但摘要中未提及具体的定量实验结果或与现有SOTA模型的对比。

Insight: 创新点在于构建了一个基于真实世界数据、融合心理学、社会语言学和用户行为理论的综合评估框架，将个性化、LLM驱动的推荐、主动性、智能体工具使用和地理时空推理统一起来，旨在推动个人智能代理与现有可扩展推荐基础设施协同工作，并使个性化更具交互性、主动性并与真实用户体验对齐。

Abstract: Personal intelligence is becoming a central frontier for user-facing AI agents. To be helpful in everyday life, agents must understand users across the digital contexts where their preferences, intents, habits, social relationships, and needs unfold over time. Today’s systems can personalize within individual apps or tasks, but personal intelligence as a whole remains under-measured: how agents build cross-context user understanding, support steerable recommendation systems, act proactively across platforms, and avoid over-personalization. We introduce PersonaMem-v3, a real-world-grounded benchmark and evaluation harness for omni-platform personal intelligence. PersonaMem-v3 is seeded from more than one million anonymized real-world engagement histories, most of which are implicit signals, and uses them to construct time-indexed user digital worlds across social media, chatbot, calendar, and AI-companion with preference evolvement over time. The benchmark brings personalization, LLM-powered recommendation, proactiveness, agentic tool use, and geo-temporal reasoning into one framework, anchored in psychology, social-linguistics, and user-behavior theories. It evaluates whether AI agents can infer holistic user understanding from cross-platform evidence, personalize responses, rerank recommendations on social media, follow user steering through natural language, and hold back when personalization would be inappropriate, repetitive, outdated, or unnecessary. PersonaMem-v3 points toward LLM-powered personal intelligent agents that work with existing scalable recommendation infrastructure while making personalization more interactive, agentic, and aligned with how real users experience their digital lives.

Lorenzo Molfetta, Alessio Cocchieri, Luca Ragazzi, Ilaria Bartolini, Marco Patella

TL;DR: 本文探讨了大型语言模型在法律推理中的脆弱性，发现与医学领域不同，法律领域的LLMs难以评估外部权威信息的适用性和有效性，容易受到表面格式和错误引用的误导，且模型规模增大会加剧这一趋势。

Details

Motivation: 研究动机在于揭示LLMs在法律推理中的局限性，特别是其无法像处理医学知识那样稳定地处理法律信息，因为法律真理具有时空依赖性和权威层级性，而LLMs可能将法律视为非结构化文本而非有约束力的先例。

Result: 通过一个编码时间有效性和规范关系的新基准测试，研究显示法律LLMs在知识回忆、基础性、置信度和鲁棒性四个维度上表现不对称，相比医学LLMs更易受权威扰动影响，且模型规模增大会导致过度自信和脆弱性增加。

Insight: 创新点在于提出了一个比较诊断框架来评估法律与医学推理的差异，揭示了LLMs在处理法律权威信息时的系统性弱点，即过度信任外部引用而忽视内部知识，这为改进法律AI系统提供了重要洞见。

Abstract: In medicine, claims remain valid when supported by empirical evidence grounded in stable biological reality. In law, by contrast, truth is contingent, defined by jurisdiction, temporal validity, and the hierarchy of authoritative sources. The recent success of large language models (LLMs) on medical licensing examinations has encouraged an expectation of comparable legal competence. This analogy, however, obscures a critical distinction between domains. Unlike in medicine, legal performance often depends less on inference than on determining when external authority is applicable, valid, and non-contradictory. We introduce a comparative diagnostic framework evaluating legal reasoning against medical baselines along four axes (knowledge recall, grounding, confidence, and robustness), uncovering a sharp domain asymmetry when applied to a new benchmark that encodes temporal validity and normative relationships. While medical LLMs reliably benefit from verified sources, legal LLMs struggle to assess when retrieved citations are useful or misleading, exhibiting overconfidence in perturbed contexts and sensitivity to superficial formatting cues. Increased model scale amplifies this tendency, revealing that stronger instruction following can coincide with weaker resistance to authoritative perturbations. These findings show that LLMs treat law as unstructured text rather than binding precedent, while revealing a tendency to over-trust authoritative but false information when external references conflict with a model’s internal knowledge.

eess.IV [Back]

[166] Multimodal pseudo-CT synthesis for PET attenuation correction using separate modality encoding and topogram conditioning eess.IV | cs.CV | physics.med-phPDF

Rory Bell, Artemis Bouzaki, Jiaming Cao, Jasmine Morrison, Chelsea Sargeant

TL;DR: 本文提出了一种基于多模态3D U-Net的伪CT合成方法，用于PET衰减校正。该方法通过独立的PET和MRI编码器、多尺度特征融合以及基于FiLM的二维定位图条件化，有效整合了不同模态的互补信息，并降低了对模态间精确体素对齐的依赖。

Details

Motivation: 解决在PET衰减校正中，如何有效利用多模态图像（如非衰减校正PET、MRI和二维定位图）生成高质量伪CT的问题，以减少对精确跨模态配准的依赖。

Result: 该方法在BIC-MAC挑战赛中被应用，具体定量结果未在摘要中明确提及，但通过独立编码和条件化设计，旨在提升伪CT合成的准确性和鲁棒性。

Insight: 创新点包括采用独立模态编码器处理PET和MRI、多尺度特征融合策略，以及使用FiLM机制将二维定位图作为条件信息注入瓶颈层，这有助于更灵活地整合异构模态数据，提升模型对配准误差的鲁棒性。

Abstract: We participated in the BIC-MAC Challenge with a multimodal 3D patch-based U-Net for pseudo-CT generation from NAC-PET, MRI, and 2D topograms. By using separate PET and MR encoders, multi-scale feature fusion, and FiLM-based topogram conditioning at the bottleneck, we obtain a model that integrates complementary cross-modal information while reducing reliance on precise voxel-wise correspondence between modalities. Our final submission can be found: https://github.com/rrr-uom-projects/BIC-MAC-MICCAI2026

[167] MDFI: A Multi-Domain Features Integration for Compressed Video Quality Enhancement eess.IV | cs.CVPDF

Sang NguyenQuang, Hieu Bui Minh, Dang BuiDinh, Xiem HoangVan

TL;DR: 本文提出了一种名为MDFI的压缩视频质量增强方法，通过创新的帧预测特征变换模块和多域特征融合策略，有效结合时空特征、跨频表示和压缩域预测信息，以提升H.266/VVC解码视频的质量。作者还构建了一个包含未压缩视频、多QP重建版本和预测帧的综合数据集。实验表明，MDFI在客观指标和视觉质量上均优于现有方法。

Details

Motivation: 尽管H.266/VVC标准在压缩效率上相比H.265/HEVC有显著提升，但仍难以满足对更高感知质量和压缩性能的需求，因此需要开发有效的视频质量增强技术来缓解压缩伪影。

Result: 在广泛的实验中，MDFI方法在客观指标和视觉质量上均超越了最先进的方法，有效减轻了视频压缩伪影。

Insight: 主要创新点包括：1) 新颖的帧预测特征变换模块处理预测信息；2) 多域特征融合策略整合时空、跨频和压缩域信息；3) 构建了一个全面的H.266/VVC相关数据集，为视频增强研究提供了重要资源。

Abstract: The latest video coding standard, H.266/VVC, has demonstrated significant improvements in compression efficiency compared to H.265/HEVC. Despite its advanced coding techniques, H.266/VVC still faces challenges in meeting the increasing demand for higher perceptual quality and enhanced compression performance. To address these limitations, we propose MDFI (Multi-Domain Features Integration), a compressed video quality enhancement approach that features a novel Frame-Prediction Feature Transform (FPFT) module to process prediction information. Moreover, MDFI integrates a multi-domain feature fusion strategy that effectively combines spatiotemporal characteristics, cross-frequency representations, and compressed-domain prediction information to enhance decoded video quality. Additionally, we introduce a comprehensive dataset that encompasses uncompressed video sequences, corresponding reconstructed versions at multiple QP levels, and predicted frames generated from H.266/VVC compressed bitstreams, providing essential resources for developing and benchmarking video enhancement approaches. Extensive experiments demonstrate that our MDFI approach achieves superior performance to state-of-the-art methods in both objective metrics and visual quality, effectively mitigating video compression artifacts. The code is available at: https://github.com/dangdinh17/MDFI.git.

[168] Reliability- and Anatomy-Consistency-Aware Multimodal Learning for Robust Fracture Classification from Bangladeshi Radiographs eess.IV | cs.AI | cs.CVPDF

Musa Tur Farazi, K G Subarno Bithi

TL;DR: 该论文提出了一种用于孟加拉国X光片骨折分类的可靠性和解剖学一致性感知的多模态学习方法。该方法结合了图像编码器和临床元数据，通过分层残差融合和一致性门控机制，旨在提升分类性能并减少元数据缺失或错配时的性能下降。

Details

Motivation: 多模态骨折分类器虽然可以利用患者和解剖学元数据，但当上下文信息缺失或不匹配时，模型会变得脆弱。本文旨在开发一种更稳健的分类方法，以应对元数据不可靠的现实场景。

Result: 在孟加拉国OrthoFrac-XR数据集上的实验表明，分层残差融合方法取得了0.6046 +/- 0.0279的宏F1分数，优于仅使用图像的基线（0.5727 +/- 0.0270）。在元数据被打乱的鲁棒性实验中，解剖学一致性融合将宏F1损失从0.0567降低到0.0203。

Insight: 论文的创新点在于引入了可靠性门控残差融合和基于解剖学一致性的门控机制，以结构化方式整合上下文信息并减轻不匹配元数据的负面影响。这为构建对噪声元数据更稳健的多模态医疗影像模型提供了思路，但也揭示了干净数据性能与鲁棒性之间的权衡。

Abstract: Background: Multimodal fracture classifiers may benefit from patient and anatomical metadata, but they can also become brittle when contextual information is missing or mismatched. Methods: We studied 1493 radiographs from the Bangladeshi OrthoFrac-XR dataset using leakage-safe age, sex, bone type, and laterality. A ConvNeXt image encoder was combined with a clinical multilayer perceptron through concatenation, late fusion, reliability-gated residual fusion, and a hierarchical state-location formulation. We additionally introduced an anatomy-consistency gate that attenuates metadata corrections when an image-side anatomical prediction disagrees with the reported bone type. Results: Across five folds and three seeds, hierarchical residual fusion achieved a macro-F1 of 0.6046 +/- 0.0279, compared with 0.5727 +/- 0.0270 for image-only learning, while improving the Brier score from 0.5239 to 0.4948. In a five-fold robustness experiment, anatomy-consistency fusion reduced the macro-F1 loss under shuffled metadata from 0.0567 to 0.0203 relative to ordinary residual fusion, although its clean-data macro-F1 was lower. Without bone type at inference, auxiliary anatomy supervision improved macro-F1 from 0.5620 +/- 0.0330 to 0.5899 +/- 0.0289. Conclusions: Structured context improves fracture classification, and consistency-aware gating limits harm from mismatched metadata. The observed clean-performance-robustness trade-off and the absence of patient-level identifiers motivate external and prospective validation.

[169] CHIMERA Challenge: Biochemical Recurrence Prediction in Prostate Cancer Patients using multimodal datasets eess.IV | cs.CVPDF

Robert N. Spaans, Catherine Chia, Tongjie Wang, Adam Kowalewski, Parandzem Khachatryan

TL;DR: 该论文提出了CHIMERA挑战赛，这是一个用于预测前列腺癌患者生化复发（BCR）的多模态基准测试。它整合了来自两个机构267名患者的术前多参数MRI、术后组织病理学、患者特征和临床医生衍生变量。研究评估了单模态和多模态模型的预测性能，发现单模态临床模型在测试集上C指数最高（0.7402），但多模态模型在临床变量缺失或随机化时表现出更强的鲁棒性。

Details

Motivation: 目前泌尿系统癌症领域缺乏标准化的多模态预后建模基准，部分原因是整合异质多模态数据具有挑战性。本研究旨在通过创建CHIMERA挑战赛来解决这一问题，为前列腺癌生化复发预测提供一个公开、标准化的多模态基准数据集和评估平台。

Result: 在预测生化复发时间的任务中，使用C指数进行评估。单模态临床模型在测试集上取得了最高的C指数（0.7402）。然而，当临床医生衍生变量被随机化时，其性能急剧下降至接近随机水平（C指数约0.50）。相比之下，多模态模型在临床变量被保留但未提供时，性能下降幅度很小（C指数变化最多0.04），表明其能从影像数据中直接恢复预后信号。

Insight: 论文的主要创新点是创建了首个公开、标准化的前列腺癌预后多模态基准（CHIMERA）。一个关键的见解是，虽然仅使用临床和医生衍生变量的模型在理想数据条件下性能最佳，但在临床实践中专家标注可能不完整或不可靠的场景下，整合了影像等多模态数据的模型展现出更强的鲁棒性和实用性，这为临床AI模型的部署提供了重要参考。

Abstract: Biochemical recurrence (BCR), defined as any detectable prostate-specific antigen level after prostatectomy with confirmatory elevation, is widely used as a surrogate endpoint and typically assessed using clinical and pathological variables. Currently, no standardized benchmark exists for multimodal prognostic modeling in urological cancers, partly because curating heterogeneous multimodal data remains challenging. We developed the CHIMERA Challenge, a multimodal benchmark integrating preoperative mpMRI, post-prostatectomy histopathology, patient characteristics, and clinician-derived variables from 267 patients across two institutions. The dataset comprises 801 MRI sequences, 13 clinical variables per case, and 942 WSIs. Training (n=95), validation (n=23), and test (n=149) splits were established and hosted on the Grand Challenge platform. Baseline clinical and pathological characteristics did not differ significantly across splits. Models were evaluated on predicting time to BCR using the C-index. Post-challenge analyses tested how each model type performed when clinician-derived variables were withheld or randomized. Unimodal clinical models achieved the highest test C-index of 0.7402 but proved sensitive to the integrity of these variables, with performance collapsing toward chance (C approximately 0.50) when they were randomized. Multimodal models retained near-baseline performance when these variables were withheld (delta C at most 0.04), indicating their ability to recover prognostic signal directly from imaging data. CHIMERA is the first public, standardized multimodal benchmark for prostate cancer prognosis. Although models using only patient characteristics and clinician-derived variables yielded the highest leaderboard performance, multimodal models demonstrated greater robustness in clinically realistic scenarios where complete expert annotation is not guaranteed.

[170] SweepLSD: A One-Pass, O(width)-Memory Line Segment Detector with an Integer-Only Streaming Core and a Real-Time FPGA Realization eess.IV | cs.AR | cs.CVPDF

Yoshiyasu Shimizu

TL;DR: 本文提出了SweepLSD，一种单次扫描、内存复杂度为O(width)的线段检测器，其核心处理仅使用整数运算，并实现了实时FPGA硬件部署。该算法在CPU单线程上处理全高清图像仅需约11毫秒，速度远超ELSED、EDLines和LSD等现有方法，同时在方向精度和帧时间分布上表现最佳，但在合成数据上的F分数略逊于ELSED。

Details

Motivation: 旨在设计一种高效、低内存占用的线段检测算法，能够以流式方式处理图像，避免存储整幅图像，从而适用于实时视频处理和资源受限的硬件（如FPGA）部署。

Result: 在4K照片下采样至全高清的测试中，SweepLSD比ELSED、EDLines和LSD分别快4.6倍、5.2倍和25倍，具有最佳的方向精度和最稳定的帧时间分布；在曼哈顿帧消失点估计任务中，在NYU-VP数据集上领先约0.3度，在York Urban数据集上落后0.1度，且端到端管道速度最快；在相机姿态估计应用中，以更低内存达到基线精度，并在4K地平线锁定中实现0.06度中位姿态误差。

Insight: 创新点包括单次扫描的流式处理架构、O(width)内存复杂度、纯整数运算核心以及实时FPGA实现，这些设计使得算法在速度和资源效率上具有显著优势，特别适合嵌入式系统和实时视觉应用。

Abstract: We present SweepLSD, a line segment detector that reads the image exactly once and emits each segment within a few rows of its last pixel passing the scan line. Every stage, including connected-component labeling and the final line test, processes the image as a row stream: intermediate memory is O(width) rather than O(pixels), and the per-pixel core is integer-only. We give the first complete description of the algorithm, designed in the author’s 2014 master’s thesis but never published, together with an open-source C++17 implementation and an FPGA realization – held bit-exact against the software in its hardware configuration – detecting segments in live 1080p30 video on 2009-era silicon without frame buffer or external memory. On structure-rich public 4K photographs downscaled to Full-HD, one CPU thread detects segments in ~11 ms – 4.6x/5.2x/25x faster than the original authors’ implementations of ELSED, EDLines, and LSD – with the tightest frame-time distribution and the best per-segment direction accuracy of the four detectors, and curve rejection by design, while trailing ELSED in F-score on synthetic ground truth. A Manhattan-frame vanishing-point study on York Urban and NYU-VP scores every detector under a selection/evaluation-separated best-estimator-per-detector protocol, under which SweepLSD leads on NYU-VP by ~0.3 degrees and trails by 0.1 degrees on York Urban, with the fastest end-to-end pipeline of the four detectors on both. A single-frame camera-attitude application, evaluated on synthetic scenes with exact ground truth and on EuRoC and TUM-VI, matches the baselines’ accuracy at a fraction of their memory, and drives a 4K horizon lock to 0.06 degrees median attitude error at 32 ms median per frame.

[171] CiUNet: A Hybrid Swin-CNN UNet for Medical Image Segmentation eess.IV | cs.CVPDF

Bin Dong, Jinghong Chen

TL;DR: 本文提出了一种名为CiUNet的混合Swin-CNN U-Net架构，用于医学图像分割。该模型在Swin-UNet框架基础上，集成了并行的CNN编码器以补充局部纹理特征，并设计了非对称特征融合策略与跨层跳跃连接来增强细节恢复。通过引入新的损失函数和辅助监督头，提升了训练稳定性与边界分割精度，在Synapse多器官分割数据集上取得了具有竞争力的SOTA结果。

Details

Motivation: 医学图像分割需要高精度和鲁棒性，同时商业部署还要求隐私保护和计算效率。U-Net架构因其编码器和解码器可解耦的特性成为自然选择，但纯Transformer变体（如Swin-UNet）存在局部细节捕获不足和可解释性有限的问题。

Result: 在Synapse多器官分割数据集上的大量实验表明，该方法在Dice分数和Hausdorff距离指标上达到了具有竞争力的最先进水平。

Insight: 主要创新点包括：1) 在Swin-UNet中集成并行CNN编码器以结合Transformer的全局建模和CNN的局部特征提取优势；2) 设计非对称特征融合策略和跨层跳跃连接，以弥合语义鸿沟并增强细粒度空间细节恢复；3) 引入新的损失函数和辅助监督头来加强训练稳定性、边界描绘和中间特征的可解释性。

Abstract: Medical image segmentation requires high accuracy and robustness, yet practical commercial deployment also demands privacy preservation and computational efficiency. In this context, the U-Net architecture, which can be inherently decoupled into independent encoder and decoder components, serves as a natural commercial choice. However, pure Transformer-based variants like Swin-UNet often suffer from insufficient local detail capture and limited interpretability. In this paper, we propose a lightweight hybrid architecture built upon the Swin-UNet framework. Our model integrates a parallel CNN encoder to complement the shallow layer reasoning of Swin Transformers with local texture features. To bridge the semantic gap and enhance fine-grained spatial detail recovery, we design an asymmetric feature fusion strategy and introduce cross-layer skip (XSkip) connections that explicitly propagate shallow CNN features into the decoder. We further incorporate novel loss functions and an auxiliary supervision head (Aux-Head) to strengthen training stability, boundary delineation, and intermediate feature interpretability. Extensive experiments on the Synapse multi-organ segmentation dataset demonstrate that our approach achieves state-of-the-art competitive Dice scores and Hausdorff distances, offering an accurate, efficient, and interpretable solution for clinical deployment.

eess.AS [Back]

[172] Mitigating Speaker Leakage in Cascaded Multi-talker ASR with Diarization-based Transcript Correction eess.AS | cs.CLPDF

Hermann Yepdjio Nkouanga, Minwei Luo, Maggie Wigness, Suresh Singh

TL;DR: 该论文提出了一种基于剪枝的范式，用于缓解级联多说话人自动语音识别（MT-ASR）中的说话人泄漏问题。该方法利用预训练的说话人日志模型作为多模态验证器，通过时间包含、词汇交叉验证和时间对齐的三方共识来识别并移除转录文本中的泄漏伪影。在多个数据集上的实验表明，该方法能有效降低级联MT-ASR的字符级词错误率（cpWER），尤其是在高泄漏场景下。

Details

Motivation: 级联多说话人ASR系统虽然利用了先进的基座模型，但其性能常受分离过程中的说话人泄漏问题限制。现有校正策略主要关注说话人归属的词汇重标记，因此需要一种互补的方法来鲁棒地识别和移除泄漏伪影。

Result: 在LibriMix、LibriSpeechMix和AMI Meeting语料库上的实验结果表明，该方法在不同重叠条件下持续降低了字符级词错误率（cpWER）。特别是在高说话人泄漏的子集上，该方法实现了高达29%的相对cpWER降低，突显了其在复杂声学环境中增强级联MT-ASR转录可靠性的有效性。

Insight: 论文的创新点在于提出了一种基于剪枝的互补范式，而非仅依赖词汇重标记。其核心是利用说话人日志模型作为多模态验证器，通过时间、词汇和时序对齐的多方共识来识别泄漏，这为处理ASR中的说话人混淆问题提供了一种新的、可借鉴的鲁棒性思路。

Abstract: While cascaded multi-talker ASR (MT-ASR) leverages state-of-the-art foundation models, its performance is often capped by speaker leakage during separation. Prior correction strategies primarily focus on lexical re-labeling for speaker attribution. We propose a complementary pruning-based paradigm that robustly identifies and removes leakage artifacts. Our method utilizes a pre-trained speaker diarization model as a multimodal verifier to prune transcribed segments satisfying a tripartite consensus of temporal containment, lexical cross-validation, and temporal alignment. Results on LibriMix, LibriSpeechMix, and the AMI Meeting corpus show our algorithm consistently reduces cpW ER across diverse overlap conditions. Specifically, on subsets with high speaker leakage, our method achieves relative cpW ER reductions of up to 29%, highlighting its effectiveness in enhancing the reliability of cascaded MT-ASR transcripts in complex acoustic environments.

cs.MM [Back]

[173] Motion-Aware Reasoning from Speech to Mask Tracks: Runner-up Solution for the MeViS-Audio Track of the 8th LSVOS Challenge 2026 cs.MM | cs.CV | cs.SDPDF

Jinxing Zhou, Suiyi Zhao, Yanghao Zhou, Ruohao Guo

TL;DR: 本文介绍了Speech2MaskTrack方法，该方法用于解决语音引导的指代视频目标分割任务，即在视频中根据口语化的运动描述来分割并跟踪指定目标。该方法将语音转录为结构化约束，利用SAM3.1生成候选目标轨迹，TRACE模型基于完整轨迹的运动和关系证据进行排序，并结合冻结的词法存在门控和GPT辅助恢复机制。该方法在第八届LSVOS挑战赛的MeViS-Audio赛道中获得了第二名。

Details

Motivation: 解决语音引导的指代视频目标分割问题，其中语音指令是语言描述而非声学证据，需要连接语音识别、以运动为中心的时间定位、掩码跟踪以及显式的无目标处理等多个环节。

Result: 该方法在第八届LSVOS挑战赛的MeViS-Audio赛道的官方排名中获得了第二名。

Insight: 创新点在于将口语查询编译为包含类别、数量、方向、交互角色和时间阶段的结构化约束，并设计了一个多阶段流水线，结合了基于轨迹的排序、词法门控、条件化掩码生成以及GPT辅助恢复，以鲁棒地处理复杂运动描述和潜在的无目标情况。

Abstract: Speech-guided referring video object segmentation aims to recover the mask tracks of objects specified by a spoken motion description. Here, speech carries a linguistic instruction rather than acoustic evidence from a sounding object, so a solution must connect speech recognition, motion-centric temporal grounding, mask tracking, and explicit no-target handling. We introduce Speech2MaskTrack, our approach for the MeViS-Audio track of the 8th LSVOS Challenge. Speech2MaskTrack transcribes the spoken query and compiles it into structured constraints over category, count, direction, interaction role, and temporal phase. SAM3.1 enumerates multiple instance tracks, which TRACE ranks using complete-trajectory motion and relation evidence. A frozen lexical presence gate may suppress the ranked SAM3.1 base prediction. When the gate predicts that a target is present, an available full-expression-conditioned SaSaSa2VA track replaces the SAM3.1 mask. Only outputs that remain empty enter GPT-assisted recovery, which invokes SaSaSa2VA again under query- and mask-level verification. Speech2MaskTrack achieved second place in the official challenge ranking.

cs.CR [Back]

[174] CyberFactory: Scaling Cyber Security Capabilities with Instances from the Wild cs.CR | cs.CLPDF

Jian Yang, Haau-Sing Li, Shawn Guo, Zixi Zhao, Yibo Tan

TL;DR: 本文介绍了CyberFactory，一个用于网络安全任务的开源框架，能够将公开的漏洞信息（如CVE）转化为可执行且可验证的任务实例，并利用可复用的漏洞分析技能生成智能体轨迹进行模型训练。基于该框架训练的Aegis模型在网络安全基准CyberGym上实现了52.4%的Pass@1性能，相比其基础模型Qwen 3.5提升了22.8个百分点。

Details

Motivation: 当前开源大语言模型在网络安全领域存在局限：前沿开源模型缺乏可复现的网络安全训练方案，现有训练方案专注于孤立任务且缺乏可扩展的智能体数据，而扩展智能体推演需要强领域先验知识。

Result: 在CyberGym基准测试中，训练的Aegis模型在1小时预算下达到52.4%的Pass@1，比其基础模型Qwen 3.5提升了22.8个百分点，并在相同框架下优于评估的通用骨干模型。

Insight: 创新点在于提出了一个统一的、可扩展的开源框架，将数据构建、轨迹合成和模型训练连接起来，并利用可复用的漏洞分析技能生成可验证的智能体监督数据，使模型能够内化技能指导的过程而无需在推理时依赖该技能。

Abstract: As large language models (LLMs) continue to advance in coding capabilities, their potential in cybersecurity has drawn increasing research attention, with closed-source LLMs (e.g., Mythos) delivering advanced cybersecurity capabilities. However, existing open-source efforts remain limited: frontier open-weight models do not provide reproducible cybersecurity training solutions, open-source training solutions focus on isolated tasks and lack scalable agentic data, and scaling agentic rollouts requires strong domain priors. In this work, we introduce \textbf{CyberFactory}, a unified open-source framework that connects data construction, trajectory synthesis, and model training across proof-of-concept (PoC) generation, vulnerability patching, and cybersecurity question answering (CyberQA). CyberFactory transforms public vulnerability artifacts, including CVEs from the wild, into executable and verifiable task instances. It further uses a reusable vulnerability-analysis skill to guide the teacher through source inspection, problem solving with domain prior, and evidence-based validation. The resulting supervision is agentic: the model interacts with tools and target environments and revises its solutions according to execution feedback. Using these trajectories, we train and release \modelname\footnote{\emph{Aegis} is, in Greek mythology, the protective shield of Zeus and Athena; the name reflects the model’s defensive, security-oriented purpose.}, which internalizes the skill-guided procedure without requiring the skill at inference time. On CyberGym, \modelname reaches 52.4% Pass@1 under a one-hour budget, improving over its Qwen~3.5 base model by +22.8 points and outperforming the evaluated general-purpose backbones under the same scaffold.

cs.RO [Back]

[175] Selective Cross-View Consistency for World Action Models: Held-Out Viewpoint Robustness Without Test-Time Camera Information cs.RO | cs.CVPDF

Bingqi Huang, Bingchuan Wei, Yingkai Cai, Zhaokui Wang

TL;DR: 本文研究了世界动作模型（WAMs）在相机视角变化下的鲁棒性问题，提出了一种选择性跨视角一致性（SCVC）方法。该方法通过仅在视角不变的动作块上施加一致性损失，避免了视角协变块的有害收缩，从而在不依赖相机标签、外参、深度或视图合成的情况下，提升了模型在训练分布外视角上的泛化能力。

Details

Motivation: 世界动作模型（WAMs）通过联合去噪未来视频帧和机器人动作来实现控制，但相机视角变化是其面临的主要扰动之一。本文旨在解决一个特定于该类模型的问题：在使用同状态跨视角图像对训练时，应在哪些输出坐标上施加一致性损失，以避免对视角协变内容造成有害影响。

Result: 在LIBERO-Plus相机轨迹数据集上，采用保留视角评估协议，SCVC在训练分布外的轨道视角上，相比匹配的对照组将闭环成功率提升了12.2个百分点（95%置信区间[7.4, 17.0]），在第二个独立种子下提升15.5个百分点（CI [11.7, 19.4]）。而在训练分布内的插值视角上未显示增益，且分布内能力得以保持。

Insight: 创新点在于区分了WAM输出中视角协变（未来场景）和视角不变（动作块、未来本体感觉、价值）的坐标，并理论证明和实验验证了仅在不变块上施加跨视角一致性损失的有效性。该方法无需任何相机信息或视图合成，保持了部署接口不变，为提升模型对未知视角的鲁棒性提供了一种简洁有效的方案。

Abstract: World action models (WAMs) jointly denoise future video frames and robot actions, and the video prior is expected to generalize their control. Camera viewpoint change remains one of their hardest perturbation axes. We study a question specific to this model class: when training with same-state cross-view image pairs, on which output coordinates should a consistency loss be imposed? The WAM denoising target mixes view-covariant coordinates, namely the predicted future scene, with view-invariant coordinates, namely the action chunk, future proprioception, and value. We show that consistency applied to the covariant block is provably harmful, shrinking legitimate view-specific content to a fraction $1/(1+4λ)$ of its true value, and we verify this shrinkage law in controlled experiments. Selective cross-view consistency (SCVC) therefore constrains only the invariant block, requires no camera labels, extrinsics, depth, or view synthesis at training or test time, and leaves the deployment interface unchanged. We introduce a carve-and-hold-out evaluation protocol on the LIBERO-Plus camera track that separates a distribution-matched ceiling from genuine interpolation and extrapolation to held-out viewpoints, with a matched pair-trained control isolating the effect of the consistency term from pair exposure. On held-out orbital viewpoints beyond the training envelope, SCVC improves closed-loop success over the matched control by 12.2 points (95% CI [7.4, 17.0]; +15.5, CI [11.7, 19.4], under an independent second seed) – an effect two further camera axes replicate – while interpolation within the envelope shows no gain in either seed (-1.2 and -4.3 points) and in-distribution competence is preserved (-0.6, -0.2). We also report a cross-backbone audit showing that published camera-robustness numbers are confounded by wrist-camera pose stability.

[176] Inferring Action from Future Latent State for Robotic Manipulation cs.RO | cs.AI | cs.CV | cs.LGPDF

Fenghao Lei, Zhixiong Huang, Long Yang, Jiabao Chen, Jie Cheng

TL;DR: 本文提出DELE-w0.5模型，用于机器人操作任务。该模型摒弃了传统世界-动作模型（WAMs）中依赖视频生成来预测未来视觉轨迹的方法，转而直接从预测的未来潜在状态推断机器人动作序列。

Details

Motivation: 动机在于认为视频生成对于世界-动作建模是一个不必要的中间目标。机器人操作的目标是预测动作执行后世界将达到的状态，而非精确再现每一中间时刻的视觉外观，后者会消耗大量模型容量和计算资源。

Result: 在四个长视野操作任务的480次真实机器人试验中，DELE-w0.5在所有对比策略中取得了最佳性能，总体完整任务成功率达到62.5%，宏观有序阶段进度达到81.3%，分别比最强基线高出47.5和30.7个百分点。

Insight: 核心创新点是将建模焦点从逐帧视觉外观演变转移到机器人动作下物理世界的变化，通过未来潜在状态作为世界建模与动作生成的显式桥梁，移除了密集视频表示引入的高维视觉冗余，从而实现了更经济的训练和低延迟推理。

Abstract: World-Action Models (WAMs) build robot control on video-generation backbones, which jointly predict dense future visual trajectories and robot actions. We argue that video generation is an unnecessary intermediate objective for world-action modeling. For robotic manipulation, the goal of a world model is not to reproduce how the world looks at every intermediate moment, but to predict the state that the world will reach after an action is executed. The intermediate frames only describe the visual transition between physical states, which consumes substantial model capacity and computation, but do not directly specify the physical outcome that the robot action is intended to produce. In this paper, we propose DELE-w0.5, which infers robot actions from predicted future states without relying on video generation. Concretely, DELE-w0.5 infers the action sequence from its corresponding compact future latent state. The future latent state captures the action-relevant physical outcome of robot interaction and serves as an explicit bridge between world modeling and action generation. The core design principle of DELE-w0.5 is to model how the physical world changes under robot actions, rather than how its visual appearance evolves frame by frame. This formulation removes the high-dimensional visual redundancy introduced by dense video representations, and it therefore enables cheaper training and low-latency inference. Across 480 real-robot trials on four long-horizon manipulation tasks, our DELE-w0.5 achieves the best performance among all compared policies, attaining 62.5 overall full-task success and 81.3 macro ordered-stage progress, outperforming the strongest baseline by 47.5 and 30.7 percentage points, respectively.

[177] TONAV: Task-Oriented Navigation and Action-Velocity Chunk Learning for Articulated Object Quadrupedal Mobile Manipulation cs.RO | cs.CVPDF

Haoran Lin, Mingyu Yang, Pengfei Qi, Kehan Chen, Qiang Diao

TL;DR: TONAV是一个用于四足移动机器人的统一框架，集成了任务导向导航和动作-速度块学习，旨在解决导航与操作之间的衔接问题以及持续接触交互中的稳定性问题。

Details

Motivation: 现有方法在导航终止后与操作就绪状态之间存在差距，且存在跟踪延迟、运动抖动和接触不稳定等问题，限制了四足机器人与铰接物体的连续交互能力。

Result: 在多种铰接物体操作任务的真实世界实验中，TONAV在任务导向导航和完整移动操作方面均取得了更高的成功率。

Insight: 创新点包括：1) 引入位置-速度耦合遥操作框架以捕获运动动力学，提升主从一致性并收集平滑演示；2) 利用视觉-语言推理将高级指令分解为可执行子目标，并自适应调整机器人基座至操作就绪状态；3) 提出动作-速度块学习，在速度监督下联合建模关节位置及其时间过渡，实现平滑稳定的持续接触操作。

Abstract: Quadruped mobile manipulation requires two tightly coupled capabilities: reaching manipulation-ready configurations and maintaining stable contact throughout articulated-object interaction. However, existing methods often terminate navigation near the target, leaving a gap between reachability and manipulation readiness, while tracking lag, motion jitter, and contact instability limit continuous interaction. To address these challenges, we present TONAV, a unified framework integrating task-oriented navigation with action-velocity chunk learning. First, we introduce a position-velocity-coupled teleoperation framework that explicitly captures motion dynamics to improve master-follower consistency and collect smooth, temporally consistent demonstrations. Next, task-oriented navigation leverages vision-language reasoning to decompose high-level instructions into executable subgoals and adaptively refine the robot base toward a manipulation-ready configuration. Finally, action-velocity chunk learning jointly models joint positions and their temporal transitions under velocity supervision, enabling smooth and stable sustained-contact manipulation. Real-world experiments across diverse articulated-object tasks demonstrate that TONAV achieves higher success rates in both task-oriented navigation and complete mobile manipulation, mitigating the navigation-manipulation gap and improving continuous-contact interaction. The project page is at https://haochen611.github.io/TONAV.

[178] MotionDLO: Hybrid Event- and Frame-Based Tracking of Deformable Linear Objects cs.RO | cs.CVPDF

Annalena Hartmann, Priyamvada Ajithkumar, Patrick Bründl, Jörg Franke

TL;DR: MotionDLO是一个用于实时跟踪运动可变形线性物体的混合感知框架，它结合了事件相机的高时间分辨率与帧相机的空间精度，通过融合事件流分割与相干点漂移算法，实现了低延迟、高精度且时间一致的状态估计。

Details

Motivation: 解决在机器人感知中可靠跟踪运动可变形线性物体时，如何同时保证鲁棒性、精度和时间连续性这一基本挑战，克服现有事件跟踪方法在精度与稀疏性之间的权衡限制。

Result: 实验验证了该框架在12毫秒更新速率下的实时性能，点对曲线误差测量精度高达0.43毫米，支持操作过程中的动态路径适应。

Insight: 创新点在于提出了一种混合事件与帧的跟踪架构，利用事件流确保高频运动更新，帧信息稳定空间精度和物体身份，结合运动相干理论原则与CPD算法，在保持计算效率的同时实现了时间一致的形状估计。

Abstract: Reliably tracking moving deformable linear objects (DLOs) while simultaneously ensuring robustness, accuracy, and temporally consistent state estimation remains a fundamental challenge in robot perception. We introduce MotionDLO, a real-time tracking framework specifically designed to overcome these limitations in temporal continuity and latency. The method exploits the high temporal resolution and sparsity of event-based cameras and combines segmentation with the Coherent Point Drift (CPD) algorithm under the principles of Motion Coherence Theory. This integration enables temporally consistent shape estimation while maintaining a low computational overhead. Existing event-based tracking methods are typically computationally efficient but exhibit reduced accuracy compared to frame-based approaches, or alternatively compromise event sparsity to achieve competitive performance. To resolve this trade-off, we propose a hybrid event- and frame-based tracking architecture that preserves the complementary strengths of both sensing modalities. The event stream ensures high-frequency motion updates, while frame-based information stabilizes spatial accuracy and object identity. We demonstrate that the proposed framework reliably associates DLO instances across video sequences, enabling robust perception for robotic manipulation tasks. Experimental results validate real-time performance at 12 ms update rates and accurate shape tracking with an point-to-curve error as measurement of accuracy of up to 0.43 mm, supporting dynamic path adaptation during manipulation. The source code and demonstration datasets are publicly available.

[179] Robust Bimanual Vision-Language-Action Models via Embarrassingly Simple Modality Masking cs.RO | cs.CVPDF

Dongzhou Cheng, Ziang Li, Yixiao Zhou, Haojuan Li, Jinghao Zhang

TL;DR: 本文提出了一种名为模态掩码机制（M3）的简单训练策略，旨在提升基于查询的视觉-语言-动作（VLA）模型在复杂双手机器人操作任务中的鲁棒性。该方法通过在训练时随机掩码部分模态通道，迫使策略减少对干扰线索的依赖，从而改善动作的连续性和执行成功率。

Details

Motivation: 基于查询的VLA模型在复杂双手机器人任务中仍存在动作不连续和执行失败的问题，作者假设不稳定的多视图和语言融合是导致失败的因素之一，注意力常分散到干扰区域。

Result: 在RoboTwin 2.0的十个双手机器人任务和三个长视野真实世界任务上评估，相比Adapter基线，M3在Clean设置下平均成功率提升21.7%，在Clean2Rand设置下提升11.4%，在真实世界全任务平均成功率提升超过30%。

Insight: 创新点在于提出了一种无需架构修改或大规模机器人预训练的简单训练时模态掩码策略，通过暴露策略于受控的部分观测，鼓励其依赖更可靠的证据，从而有效提升VLA策略的鲁棒性，这是一种实用且易于实现的鲁棒性增强方法。

Abstract: Query-based Vision-Language-Action (VLA) models offer low-latency inference that is attractive for bimanual robotic manipulation, but we observe that they can still exhibit discontinuous actions and execution failures in complex dual-arm tasks. We hypothesize that unstable multi-view and language fusion is one contributing factor in these failures, often coinciding with attention spreading to distracting regions. To improve robustness, we introduce the Modality Masking Mechanism (M3), an embarrassingly simple, training-only strategy that requires no architectural changes or large-scale robot pretraining. M3 stochastically masks subsets of modality channels during training, exposing the policy to controlled partial observations and encouraging it to rely less on distracting cues and more on evidence that remains reliable. We evaluate M3 on ten bimanual tasks from RoboTwin 2.0 and on three long-horizon real-world tasks. Compared with the Adapter baseline, M3 improves average success by 21.7% in the Clean setting and 11.4% in Clean2Rand, where policies are trained on clean demonstrations and evaluated on randomized scenes, while also improving averaged real-world full-task success by over 30%. These results suggest that structured training-time masking is a practical way to improve the robustness of query-based VLA policies for bimanual manipulation.

[180] RACO: Reliability-Aware Coarse-Goal Optimization for Inspection-Oriented UAV Vision-Language Navigation cs.RO | cs.AI | cs.CVPDF

Sen Wang, Yiming Sun, Jiaxuan He, Pengfei Zhu

TL;DR: 本文针对面向检查的无人机视觉语言导航任务，提出了RACO框架，通过可靠性感知的粗粒度目标优化，解决现有粗到细策略中粗粒度目标预测不可靠的问题，并在新提出的LG-UVI评估设置上验证了其有效性。

Details

Motivation: 现有无人机视觉语言导航评估通常关注目标到达，但面向检查的部署要求智能体停在有效检查区域内并避免误判视觉或语义相似的干扰物，这暴露了现有粗到细策略中粗粒度目标预测不可靠的关键弱点。

Result: 在统一的在线评估协议下，RACO在验证未见集和测试未见集上，相比复现的HETT基线，成功率分别提高了9.53和7.98个百分点，同时提高了检查区域到达率并降低了误验证风险。

Insight: 主要创新点在于将预测的粗粒度目标视为运行时假设，并使用对象级候选锚点进行检查和校正，同时应用尺度自适应的终端细化来处理终端接近未命中情况，这为现有粗到细策略提供了有效的可靠性优化补充。

Abstract: UAV vision-language navigation (UAV-VLN) is commonly evaluated as goal reaching, but inspection-oriented deployment requires the agent to stop within a valid inspection region and avoid falsely confirming visually or semantically similar distractors. This requirement exposes a key weakness in existing coarse-to-fine UAV-VLN policies: the coarse goal predicted before local refinement is often treated as reliable, although it may drift toward plausible but incorrect object regions and limit the ability of the local stage to recover. To systematically evaluate this problem, we introduce LG-UVI, an object-centric inspection evaluation setting derived from CityNav/CityRefer. LG-UVI extends standard UAV-VLN episodes with target objects, hard distractors, type-aware inspection regions, and diagnostics for inspection-region arrival and object-level confirmation. To address this inspection-oriented setting, we further propose RACO, a reliability-aware adaptive coarse-to-fine navigation framework. Instead of treating the predicted coarse goal as a fixed waypoint, RACO views it as a runtime hypothesis and uses object-level candidate anchors to check and correct coarse localization before Stage 1 and at the Stage 1-to-Stage 2 boundary. RACO also applies scale-adaptive terminal refinement to handle terminal near-miss cases using runtime-observable geometric and anchor-based evidence. Under a unified online evaluation protocol, RACO improves SR over the reproduced HETT baseline by 9.53 and 7.98 percentage points on validation-unseen and test-unseen, respectively. It also improves inspection-region arrival and reduces false verification risk, showing that coarse-goal reliability optimization is an effective complement to existing coarse-to-fine UAV-VLN policies.

[181] Reproducible Vision-Guided 6-DoF Robotic Manipulator with a Mixed Stepper-Driver Architecture and Browser-Native Control cs.RO | cs.CV | eess.SYPDF

Lasan Perera, Deneth Priyadarshana, Dulana Pitiwaduge, Isitha Dinujaya, Mokshan Colambage

TL;DR: 本文介绍了NeuralNexus Arm，一个由本科生团队开发的开源、低成本6自由度机器人机械臂。论文详细阐述了其设计决策、调试经验以及完整的可复现指南，包括机械设计、混合步进驱动器电子系统、中断驱动固件、基于MATLAB/Simscape的逆运动学流程、使用Web Serial API的浏览器原生控制界面，以及用于物体定位和自主拾放任务的轻量级视觉流程。

Details

Motivation: 旨在提供一个可复现、低成本的开源6自由度机器人平台，以降低机器人学教育和研究的门槛，并分享从开发板过渡到定制PCB过程中的硬件与固件调试经验。

Result: 该平台在协调控制下以2 kHz的更新率驱动所有六个轴，并能通过浏览器界面执行手动和预录制的动作，成功实现了物体定位和自主拾放任务。

Insight: 主要创新点在于混合步进驱动器架构（结合了板载TMC2209驱动器和外部CL57T/DM542驱动器）的设计、基于Web Serial API的浏览器原生控制界面，以及为可复现性提供的详细硬件/固件故障模式文档。这为低成本、易访问的机器人系统开发提供了实用的工程范例。

Abstract: We present the NeuralNexus Arm, an open, low-cost 6-DOF robotic manipulator built by an undergraduate engineering team, together with the design decisions and debugging experience needed to reproduce it. The arm is driven by a single STM32H743 microcontroller on a custom printed circuit board (PCB) and combines two stepper-driver strategies on one controller: push-pull 3.3 V step/direction outputs for onboard TMC2209 drivers on the three wrist joints, and open-drain outputs for external CL57T and DM542 drivers on the three high-torque proximal joints. We describe the mechanical design, mixed-driver electronics, interrupt-driven firmware, a MATLAB/Simscape-based inverse-kinematics pipeline, a browser-native control interface using the Web Serial API, and a lightweight vision pipeline for object localisation and autonomous pick-and-place tasks. We also document non-obvious hardware and firmware failure modes encountered during the transition from a development board to the custom PCB as reproducibility guidance. All design files and firmware are released openly. The platform actuates all six axes under coordinated control at a 2 kHz update rate and executes both manual and pre-recorded motions from the browser interface.

[182] UniMem: Unifying Multimodal Memory and Control for Vision-Language-Action Models cs.RO | cs.CVPDF

Lars Osterberg, Maggie Wang, Mac Schwager

TL;DR: 本文提出了UniMem框架，旨在解决视觉-语言-动作（VLA）模型在处理需要记忆的非马尔可夫任务时的局限性。该框架通过一个统一的主干网络，整合了高级的多模态记忆和低级控制，利用事件分类器进行记忆更新、关键帧编码器构建密集空间记忆，并采用关键帧缓存技术来减少策略执行时的开销。

Details

Motivation: 现有的VLA模型在处理需要长期记忆的任务时表现不佳，通常需要引入额外的视觉语言模型（VLM）来管理记忆，这导致了内存瓶颈和割裂的训练流程。同时，简单地以固定间隔条件化历史帧可能会损害性能。

Result: 在五个仿真任务和四个硬件任务上的评估表明，UniMem在仿真任务中优于固定间隔图像采样基线（93.4% vs. 68.2%），在硬件任务中优于分层基线（80.0% vs. 43.5%），同时实现了更快的推理速度和更简单的训练流程。

Insight: 主要创新点在于将记忆与控制统一在单一模型中，避免了复杂的多模型架构。具体技术包括基于事件触发的记忆更新机制、用于高效存储和检索历史信息的关键帧编码与缓存策略，这为构建更高效、集成的具身智能体提供了新思路。

Abstract: While Vision-Language-Action (VLA) models have leveraged internet-scale pretraining and task-focused finetuning to achieve strong performance on long-horizon tasks, they often struggle with non-Markovian tasks that require memory. Existing approaches to memory typically involve additional Vision-Language-Models (VLMs) for long-term memory management, introducing a memory bottleneck and a fractured training pipeline. Conditioning on multiple historical frames can provide the VLA with access to more descriptive features of past scenes, but can degrade performance if frames are chosen at arbitrary, fixed intervals. To address these limitations, we present UniMem, a framework that unifies high-level, multimodal memory and low-level control under one backbone. UniMem employs an event classifier for memory updates, a keyframe encoder for dense spatial memory, and a keyframe caching technique to minimize overhead during policy rollouts. We evaluate UniMem across five simulation and four hardware tasks targeting sequential and spatial memory, demonstrating that our unified, single-model system outperforms fixed-interval image sampling baselines (93.4% vs. 68.2%) in simulation and hierarchical baselines (80.0% vs. 43.5%) in hardware, while offering faster inference and a simple training pipeline for easy adoption. Project website: https://losterberg3.github.io/unimem-vla/

[183] Think Only When Needed: Prompt-Authority Control for Selective Slow-Path Intervention in Vision-Language-Action Manipulation cs.RO | cs.AI | cs.CVPDF

Zhiruo Zhou, Zelin Li, Xiwen Chen, Jiazhuo Li, Chenwei Wang

TL;DR: 论文提出TOWN-VLA方法，通过引入提示权限控制机制，在无需重新训练的情况下，选择性干预视觉-语言-动作策略的慢路径。该方法分离候选生成与修改策略输入的权限，仅在需要时授权规范指令，从而避免提示形式崩溃问题，显著提升任务成功率。

Details

Motivation: 现有检索增强方法在向冻结的VLA策略添加文本时，会直接干预提示执行，导致即使是无意义的文本添加也可能严重破坏策略性能，即出现提示形式崩溃问题。

Result: 在LIBERO-Plus基准的10,030次评估中，成功率从69.5%提升至73.1%（95%置信区间为1.89-5.45个百分点）。在物理PiPER机械臂上的150次试验中，成功率从52.7%提升至78.7%（p=3.16e-6），在六个扰动轴和所有四个测试套件上均有改进。

Insight: 核心创新在于提出了提示权限控制接口，通过固定兼容性规则实现规范指令的授权，否则严格恢复原始基础提示，从而在保持策略冻结的同时，安全地利用检索增强，避免了形式变化对执行的支配效应。

Abstract: Retrieval can efficiently and effectively augment a frozen vision–language–action (VLA) policy without retraining, yet retrieved text becomes a control intervention once it enters the executed prompt. In a matched audit, raw appended text reduces mean success from 92.47% to 3.00%, while meaningful and length-matched meaningless appends both fail on all 500 states. This result identifies \emph{prompt-form collapse}: changing the instruction form, rather than adding useful semantics, can dominate execution. We introduce TOWN-VLA (Think Only When Needed), a prompt-authority interface that separates candidate generation from permission to alter the policy input. A fixed compatibility rule authorizes a canonical compact instruction; otherwise, the interface restores the original Base prompt exactly. Across 900 audited routes, every route follows this contract: 525 routes recover Base with matching hashes, and all 375 authorized prompts preserve the task signature. On a matched $4\times7$ LIBERO-Plus evaluation with 10{,}030 episodes per method, success rises from 69.5% to 73.1% ($+362$ episodes; 95% CI 1.89–5.45 points), improving on six perturbation axes and all four suites. On a physical PiPER arm with a frozen \pizerofive{} checkpoint, success rises from 52.7% to 78.7% over 150 trials per method ($p=3.16\times10^{-6}$). Prompt authority is enforceable for a frozen controller; oracle-free admission calibration is the next deployment target.

[184] Pointing-VLA: Typed Spatial Grounding Interfaces for Vision-Language-Action Manipulation cs.RO | cs.AI | cs.CVPDF

Xiwen Chen, Zelin Li, Zhiruo Zhou, Huiming Chen, Chenwei Wang

TL;DR: 本文提出了Pointing-VLA，一种用于视觉-语言-动作模型的类型化空间读出接口，旨在解决现有VLA模型在空间定位方面存在的脆弱性问题。该方法通过几何特定的头部直接预测归一化点、对象功能定位热图和视觉轨迹，避免了将几何信息序列化为文本。在Bridge/WidowX仿真环境和真实机器人拾放任务上的实验表明，该方法实现了最先进的性能，并显著提升了真实机器人的自主操作成功率。

Details

Motivation: 现有VLA模型通常通过自回归文本坐标或不透明的动作令牌来暴露空间定位信息，这在多模态推理和机器人执行之间创建了脆弱的接口。本文旨在构建一个更稳健、可检查且高效的空间定位接口。

Result: 在Bridge/WidowX基准测试中，Pointing-VLA实现了最先进的性能，在评估的四任务集上平均成功率达到72.9%，且无需针对Bridge进行微调。在真实机器人实验中，当作为空间引导集成到动作策略中时，将自主操作成功率从52.7%提升至80.7%。此外，其类型化头部解码速度比Embodied-R1的文本解码快6.68-6.90倍。

Insight: 核心创新在于提出了一个类型化的隐藏状态空间读出机制，通过专门的预测头直接输出几何信息，而非依赖文本序列化。这创建了一个明确、高效且可检查的执行契约，将拾取动作与源条件对象功能定位关联，放置动作与指向预测关联，实现了阶段对齐的空间目标。这种设计增强了接口的稳健性和可解释性，并实现了与下游动作策略的有效集成。

Abstract: Vision-language-action (VLA) models often expose spatial grounding through autoregressive text coordinates or opaque action tokens, creating brittle interfaces between multimodal reasoning and robot execution. We present Pointing-VLA, a typed hidden-state spatial readout built on Embodied-R1. Geometry-specific heads predict normalized points, object-functional grounding (OFG) heatmaps, and visual trajectories without serializing geometry as text. For the evaluated Bridge/WidowX and physical pick-place deployments, an explicit execution contract assigns PICK to source-conditioned OFG and PLACE to Pointing, providing direct stage-aligned spatial targets. Pointing-VLA achieves SOTA performance on Bridge/WidowX, averaging 72.9% across the evaluated four-task set without Bridge-specific finetuning under collision-enabled CuRobo execution. Pointing and OFG show complementary strengths across native and cross-dataset evaluations. The OFG/contact readout transfers to NORA-1.5, preserving or improving success while reducing recorded controller time by more than 20$\times$; typed heads are also 6.68–6.90$\times$ faster than Embodied-R1 text decoding on a shared external suite. When integrated as spatial guidance for a $π_{0.5}$ action policy, Pointing-VLA raises autonomous real-robot success from 52.7% to 80.7% across three visual contexts. These results establish typed spatial readouts as an efficient, inspectable interface between embodied reasoning and robot execution.

[185] OptiSight: Bridging Semantic Reasoning and Geometric Control for Embodied Navigation cs.RO | cs.CVPDF

Alperen Avan, Jordi Sanchez-Riera

TL;DR: OptiSight是一个用于具身导航的混合框架，它通过结合视觉语言模型的语义推理和基于确定性视觉伺服（visual servoing）的几何控制来解决自主室内导航问题。该框架采用有限状态思维链架构，利用Grounded-SAM定位开放词汇目标，并通过相机投影几何将视觉观测转换为导航指令，无需密集建图。实验表明，该方法在AI Habitat仿真环境中实现了可靠的零样本导航，并能处理避障和语义模糊等复杂场景，同时计算开销较低。

Details

Motivation: 自主室内导航需要同时具备高级语义理解和精确的几何控制能力，现有方法往往难以高效地结合这两者。本文旨在弥合语义推理与几何控制之间的鸿沟，以实现在复杂室内环境中鲁棒、高效的零样本导航。

Result: 在AI Habitat仿真环境中的实验表明，OptiSight能够在多样化的室内场景中实现可靠的零样本导航，成功处理了避障和语义模糊等挑战。该方法在仅使用8GB显存的资源约束下运行，证明了其高效性。

Insight: 论文的核心创新点在于提出了一个混合架构，将VLM的语义推理（仅在关键决策点触发）与基于相机投影几何的确定性视觉伺服控制（处理连续导航）解耦，通过有限状态思维链进行协调。这种设计既利用了VLM强大的开放世界理解能力，又通过轻量的几何控制避免了VLM频繁调用的计算开销，为资源受限的具身智能体导航提供了一种高效、可解释的解决方案。

Abstract: Autonomous indoor navigation requires both semantic understanding and precise geometric control. We propose OptiSight, a hybrid framework that combines Vision-Language Model reasoning with deterministic visual servoing through a finite-state Chain-of-Thought architecture. Grounded-SAM localizes open-vocabulary targets, while camera projection geometry converts visual observations into navigation commands without requiring dense mapping. The VLM is queried only at key decision points, reducing computational overhead while geometric control handles continuous navigation. Experiments in AI Habitat demonstrate reliable zero-shot navigation across diverse indoor scenarios, including obstacle avoidance and semantic ambiguity, while operating within an 8~GB VRAM budget. The source code is available at https://github.com/avanalperen/OptiSight-Python-Multimodal-CoT-for-Visual-Reasoning.

[186] Act with Intent: Distilling Behavior Intent for Vision-Language-Action Models cs.RO | cs.AI | cs.CVPDF

Sangoh Lee, Sangwoo Mo, Wook-Shin Han

TL;DR: 本文提出了一种名为意图蒸馏（INDI）的方法，旨在为视觉-语言-动作（VLA）模型的动作解码器注入行为层面的语义意图。该方法利用一个冻结的教师视觉语言模型（VLM）从演示数据中提取意图表示，并将其整合到VLA模型的中间解码层，以指导动作预测。实验表明，该方法在模拟和真实机器人任务中均能显著提升性能。

Details

Motivation: 当前VLA模型的动作解码器主要通过行为克隆进行训练，仅监督了具体的电机指令，而忽略了行为在指令下所服务的局部目标或语义意图。基于未来状态的监督信号（如未来帧、轨迹）捕捉的是可能发生的具体实现，而非即将发生的行为的共享语义目标。

Result: 在SimplerEnv-Bridge基准上，INDI将GR00T-N1.7模型的成功率从64.3%提升至84.7%；在RoboCasa Kitchen基准上，将受控的GR00T-N1.7基线从64.1%提升至70.3%，并在两个基准的π_{0.5}指标上均获得一致提升。在真实世界任务中，平均成功率从62.0%提升至68.7%，在长视野任务上增益高达12.0个百分点。

Insight: 核心创新点在于将行为级别的语义意图显式地蒸馏并整合到动作解码过程中，使模型能够基于意图来组织动作预测。这揭示了动作解码器从显式建模其生成行为的语义目标中获益，提取的潜在表示能够捕捉行为目标和执行进度，并以目标依赖的方式组织下游预测。

Abstract: Vision-Language-Action (VLA) models can turn multimodal context into robot actions, but their action decoders are still trained largely by behavior cloning. This supervises which motor command was demonstrated while leaving implicit the local objective served by the behavior under the instruction. Future-based supervision enriches action learning with frames, latent observations, trajectories, or motion representations, but these signals capture particular realizations of what may happen rather than the shared semantic objective of the forthcoming behavior. We propose Intention Distillation (INDI), which distills behavior-level intent into the action decoder. During training, a frozen teacher VLM interprets a demonstrated segment from the current observation, instruction, coarse action summary, and corresponding execution video. From its standard inputs, the deployed VLA recovers the resulting multimodal intent representation at an intermediate decoder layer and uses it to organize action prediction together with representations of how the behavior unfolds and what it achieves. On SimplerEnv-Bridge, INDI improves GR00T-N1.7 from 64.3% to 84.7%, and on RoboCasa Kitchen it improves the controlled GR00T-N1.7 baseline from 64.1% to 70.3%, with consistent gains on $π_{0.5}$ across both benchmarks. In real-world tasks, INDI improves average success from 62.0% to 68.7%, with gains of up to 12.0 pp on longer-horizon tasks. Further analyses show that the recovered latent is used by the decoder, captures behavior objective and execution progress, and organizes downstream predictions in an objective-dependent manner. These results show that action decoders benefit from explicitly modeling the semantic objective of the behavior they generate.

cs.AI [Back]

David Bamman, Kent K. Chang, Allison Cooper, Juishan Hsu, Reina Kushihashi

TL;DR: 该论文构建了一个基于好莱坞流行电影的多模态叙事理解基准测试，通过结合票房数据和版权状态筛选出公开可用的电影集合，并设计了针对叙事元素的多选题任务来评估模型性能。

Details

Motivation: 解决因版权保护导致好莱坞电影基准测试难以构建的问题，旨在为电影历史和叙事技术演变的大规模计算分析提供稳定评估工具。

Result: 在自建基准测试上，多数视觉语言模型表现接近随机水平，而包含音频的视听模型最高准确率仅达61.1%，远低于人类表现。

Insight: 创新点在于通过历史票房数据和版权研究构建开放电影数据集，并设计聚焦叙事理解的多模态评估任务，揭示了当前模型在复杂叙事推理上的局限性。

Abstract: Multimodal language models increasingly show promise for enabling the large-scale computational analysis of film, opening up new avenues for learning about film history and the evolution of narrative techniques. But the creation of stable benchmarks built around Hollywood films is complicated by copyright protections. In this work, we address these concerns directly, by building a new collection of Hollywood films defined by two criteria: box office popularity (where we publish the first large-scale, open collection of weekly box office earnings reported by Variety magazine from 1922-1979); and likely public domain status (by researching copyright registrations and renewals in the US Catalog of Copyright Entries). We build a new multimodal MCQ benchmark on top of this collection that focuses on narrative elements that directly evaluate the abilities of models to inform meaningful research on film narrative; we find that many vision-language models struggle on this task (with many performing at near-chance levels of accuracy), while audio-visual models (including those that use audio in captioning scenes) reach a maximum accuracy of 61.1%, well below human-level performance.

[188] MemGuard: Persisting Verifier Signals for LLM-Agent Memory Governance cs.AI | cs.CLPDF

Haoyu Wang, Guangyuan Dong, He Liang, Zijing Zhang, Jiachen Luo

TL;DR: MemGuard 是一种用于 LLM 智能体记忆治理的框架，其核心创新在于将验证器的输出信号（如奖励、置信度、标签和不确定性描述符）作为持久化的生命周期元数据，而非一次性过滤器。该框架旨在解决记忆不可靠准入和记忆漂移两大失效模式，通过在记忆激活前附加元数据，并在检索、冲突解决、总结和归档等整个记忆生命周期中复用这些信号，以提升记忆的长期可靠性。

Details

Motivation: 随着 LLM 智能体从单次提示使用转向长任务流，可复用的记忆成为其核心能力。然而，实践中存在两大失效模式破坏了记忆的可靠性：一是不可靠准入（如失败轨迹、偶然成功、误导性观察被错误存入），二是记忆漂移（长期运行导致重复、过时和冲突的记录累积）。

Result: 在 Terminal-Bench 2.0、SWE-Bench Verified、WebArena 和 Mind2Web 四个基准测试上，使用四种骨干模型进行评估。MemGuard 在所有 16 种骨干-基准组合中均取得了最佳的成功率指标和最低的平均步骤数，相比评估中最强的基线方法 ReasoningBank，在 WebArena 上成功率提升最高达 7.9 个百分点，在 Mind2Web 上步骤成功率提升 5.6 个百分点，在终端和软件工程基准上提升 2.4-3.5 个百分点。

Insight: 将验证信号从一次性过滤决策转变为可持久化、可复用的元数据，并将其系统地整合到记忆的整个生命周期（激活、检索、冲突解决、总结、归档）中，是提升 LLM 智能体长期记忆可靠性的有效创新思路。这为智能体记忆系统的设计提供了新的治理范式。

Abstract: LLM agents are moving from single-prompt use to long task streams in which reusable memory becomes a core capability for terminal, software-engineering, and web tasks. Such memory is useful only when stored experience remains reliable across hundreds of interactions, but two failure modes break that assumption in practice. The first is unreliable admission: failed trajectories,accidental successes, and misleading observations enter memory because they appear relevant, then mislead later decisions. The second is memory drift: long-running banks accumulate duplicate, stale, and conflicting records that retrieval alone cannot repair. MemGuard’s key distinction is to treat verifier output not as a one-shot filter, but as persistent lifecycle metadata. It converts multi-criteria score-token verification into reward, confidence, label, and uncertainty descriptors that are attached to every candidate before activation and reused during retrieval, conflict resolution, summarization, and archival. We evaluate MemGuard on Terminal-Bench 2.0, SWE-Bench Verified, WebArena, and Mind2Web across four backbones, comparing against four memory baselines plus a verifier-only control under matched runtime budgets. Averaged over five seeds, MemGuard achieves the best success metric and lowest average steps in all 16 backbone-benchmark settings, improving over ReasoningBank, the strongest prior baseline among the memory methods we evaluate, with a largest gain of 7.9 success-rate points on WebArena, 5.6 step-success-rate points on Mind2Web, and 2.4-3.5 points on terminal and software-engineering benchmarks. Code is available at https://github.com/whyyyyy123/MemGuard.

[189] GuardianBench: A Same-Scene Instruction-Contrastive Benchmark for Latent Contextual Risk in Embodied AI cs.AI | cs.CL | cs.ROPDF

Zhesheng Zhang, Jiahao Lu, Wei Liu, Cong Pan, Jianhua Yang

TL;DR: 本文提出了GuardianBench，一个基于国际安全标准的指令对比基准测试，用于评估具身AI中的潜在上下文风险。该基准包含3,024个指令-场景示例，以相同场景下的安全/不安全对比对形式组织，覆盖多种危险类别。测试发现，当前最先进的视觉语言模型（VLMs）在指令敏感性上表现不佳，平均配对准确率仅为24.1%，主要失败原因是模型未能绑定区分安全与不安全组合的指令相关线索。

Details

Motivation: 解决具身AI中潜在上下文风险评估不足的问题，即当良性指令与安全场景组合时可能产生危险，而现有研究多关注视觉上下文变化或执行时动态评估，缺乏固定场景、仅变化指令的互补评估轴。

Result: 在GuardianBench上对SOTA视觉语言模型进行基准测试，结果显示模型倾向于在给定场景下同时批准安全和不安全指令，平均配对准确率仅为24.1%。通过轻量级后训练方法Verdict Log-Odds Supervision（VLOS）在开放权重骨干模型上显著提升了性能。

Insight: 创新点包括：1）提出了潜在上下文风险的任务形式化；2）构建了基于国际安全标准的指令对比基准；3）进行了配对级和原理级的失败诊断；4）实现了基于基准的裁决校准。这为在潜在风险下评估和改进指令-场景组合的安全推理提供了受控评估套件。

Abstract: In embodied AI, safety risk can be latent: a benign instruction and a safe scene become hazardous only when composed. Prior work has advanced embodied safety by varying visual contexts or evaluating execution-time dynamics, but the complementary axis of fixing the scene and varying only the instruction remains underexplored. We introduce GuardianBench, an instruction-contrastive benchmark grounded in international safety standards that isolates this latent contextual risk through 3,024 instruction-scene examples organized as same-scene Safe/Unsafe contrastive pairs across various hazard categories. Benchmarking state-of-the-art vision-language models (VLMs) reveals instruction-insensitive verdicts: models disproportionately approve both instructions under a given scene; across the primary models, average pair accuracy is only 24.1%. Our systematic rationale audit localizes the dominant failure: models fail to bind the instruction-relevant cues that differentiate safe from unsafe compositions. As a post-training case study, Verdict Log-Odds Supervision (VLOS), a lightweight verdict-level objective, substantially improves performance on open-weight backbones. Together, our latent contextual risk task formulation, standards-grounded contrastive benchmark construction, pair-level and rationale-level failure diagnosis, and benchmark-enabled verdict calibration establish GuardianBench as a controlled evaluation suite for exposing and improving safety reasoning over instruction-scene compositions under latent contextual risk.

[190] Measuring Stability and Failure Behavior in Language Models Under Structured Perturbations cs.AI | cs.CLPDF

Samira Golsefid

TL;DR: 本文提出了一种用于压力测试语言模型推理能力的分级、多家族、故障感知框架，通过七个扰动家族（包括保留答案的六种扰动和知识边界扰动）对输入进行多级严重性扰动，以评估模型在结构化扰动下的稳定性和失效行为。该框架在GSM-Symbolic的100个种子问题上实例化，生成4,473个有效性门控测试，并在四个不同能力层级的模型上运行，揭示了模型失效模式具有家族特异性而非全局性，并识别出冲突指令和基于不可能前提的问题是两个在所有模型中均暴露一致弱点的压力源。

Details

Motivation: 当前语言模型通常仅通过单一准确率分数评估，无法揭示其在输入受扰动时性能如何退化，因此需要一种结构化框架来系统测量模型在扰动下的稳定性和失效行为。

Result: 在四个不同能力层级的模型上测试表明，模型失效水平是家族特异性的，且冲突指令和基于不可能前提的问题在所有模型中均导致一致弱点；模型对不可回答性的识别能力不均衡，在信息缺失和捏造证据上可靠，但在不可能前提上较弱。这些失效点在标准准确率报告中不可见。

Insight: 创新点在于提出了一个分级、多家族、故障感知的评估框架，引入了按级别准确率、幅度加权稳定性以及相对于模型自身基线的每家族崩溃点等新指标，系统揭示了模型在结构化扰动下的细粒度失效模式，超越了单一聚合分数的局限性。

Abstract: Language models are usually judged by a single accuracy score, which does not reveal how their performance degrades as inputs are perturbed. We present a graded, multi-family, failure-aware framework for stress-testing reasoning models. It perturbs each problem along a multi-level severity ladder across seven families: six that preserve the answer, paraphrase, input noise, formatting, irrelevant context, context load, and conflicting instructions, and a Knowledge Boundary family that removes answerability so that refusal becomes the correct response. Every test is validity-gated and labeled by its measured severity, and each model is summarized by per-level Accuracy, a magnitude-weighted Stability, and a per-family Collapse Point defined relative to the model’s own baseline. Instantiated on the same 100 seed problems used by GSM-Symbolic, expanded into 4,473 gated tests and run on four models spanning capability tiers, the framework exposes structure that an aggregate score hides: the level at which a model fails is family-specific rather than global, and two stressors expose consistent weaknesses across all models: conflicting instructions and questions built on an impossible premise. Recognition of unanswerability is otherwise uneven, reliable on missing information and fabricated evidence but weak on impossible premises. These failure points are invisible to standard accuracy reporting.

[191] Beyond What Meets the Eye: Unveiling Situational Illusions for Multimodal Large Language Models cs.AI | cs.CL | cs.CV | cs.MMPDF

Zhiming Yang, Zhuoxi Xiong, Donglin Zhou, Wenjun Wei, Shiyao Cui

TL;DR: 本文提出了‘情境幻觉’的概念，指现实情境的表象与其物理状态不符的现象，并研究了其对多模态大语言模型可靠性的挑战。作者构建了一个‘where-what-how’分类法来描述该现象，并创建了MSIBench基准来评估模型。评估发现现有模型对此高度脆弱，并提出了基于视觉证据系统检查与推理的提示和微调方法，显著提升了模型性能。

Details

Motivation: 现实世界情境的表象可能与其实质物理状态不符，这挑战了多模态大语言模型在实际应用中的可靠性，论文旨在研究模型在此类‘情境幻觉’下的表现并探索缓解方法。

Result: 在MSIBench基准上评估了27种模型配置，发现当前MLLMs对此高度脆弱，表现出6种典型的失败模式。提出的提示和微调方法最多将模型性能提升了20%。

Insight: 创新点在于系统性地定义了‘情境幻觉’问题并构建了分类法与基准。缓解策略的核心洞察是引导模型对视觉证据进行系统性检查和推理，这为提升复杂现实环境中的多模态感知可靠性提供了实用路径。

Abstract: Real-world situation appearances can deviate from their underlying physical states, challenging the reliability of multimodal large language models (MLLMs) in practical applications. In this paper, we term this phenomenon situational illusions and investigate: (1) how MLLMs perform under such illusions, and (2) how to mitigate the limitations. We first develop a comprehensive where-what-how taxonomy that characterizes where situational illusions occur, what targets they take, and how they arise. Building on this taxonomy, we introduce MSIBench, a benchmark designed to assess the discrimination, understanding, and reasoning capabilities of MLLMs under situational illusions. Evaluations of 27 model configurations reveal that current MLLMs are highly vulnerable to these illusions and exhibit 6 typical failure modes related to visual observation, grounding, and reasoning. To mitigate the limitations, we build on the core idea of systematically inspecting and reasoning over visual evidence for contextual understanding, developing prompting for closed-source models and supervised fine-tuning for open-source models, respectively. These two simple yet effective methods improve model performances by 20% at most, suggesting a practical path toward more reliable multimodal perception and reasoning in complex real-world environments.

[192] Small Reasoning Models are Instruction Followers in Function Calling cs.AI | cs.CLPDF

Yalda Taheri, Mohammad Hassan Heydari, Erfan Naaman, Afsaneh Fatemi

TL;DR: 本文提出了一种名为指令跟随函数调用（IFFC）的新框架，该框架将函数调用逻辑从主大语言模型（LLM）中解耦，并委托给一个在指令跟随范式下运行的专用小模型。研究表明，LLMs在指令跟随上下文（即标准的用户-助手交互）中比在工具调用上下文中能实现更优的函数调用准确性。该方法在多种基准上持续优于原生函数调用（NFC）和基于提示的函数调用（PFC）基线，尤其在面向推理的LLMs上表现出色，并且在积极量化下仍能保持鲁棒性能，支持高效的设备端部署。

Details

Motivation: 现有研究主要通过微调、强化学习和多智能体框架来提升原生函数调用LLMs的准确性，而本文发现LLMs在指令跟随上下文中的函数调用准确性更优，因此旨在探索一种更可靠、资源高效的函数调用新范式，特别是针对边缘计算场景。

Result: IFFC框架在实验中持续超越了NFC和PFC基线，在面向推理的LLMs上取得了特别显著的性能提升。同时，该方法在积极量化下仍能保持鲁棒性能，表明其能在不显著损失准确性的情况下实现高效的设备端部署。

Insight: 核心创新点在于将函数调用逻辑从主LLM中解耦，并交由一个专门的、在指令跟随范式下运行的小模型处理，这建立了一种新的、更可靠的函数调用范式。从客观角度看，这种解耦设计不仅可能提升准确性（尤其是在推理型LLM上），还通过小模型和量化支持，为实现资源受限的边缘设备上的高效部署提供了有前景的路径。

Abstract: Function calling represents the core capability of agentic large language models (LLMs). Existing research has focused on enhancing LLMs function-calling accuracy through fine-tuning, reinforcement learning (RL), and multi-agent frameworks, particularly for native function-calling LLMs. This work demonstrates that LLMs achieve superior accuracy in function calling in instruction-following contexts (i.e., standard user-assistant interactions) rather than a tool calling context. We introduce Instruction-Followed Function Calling (IFFC), a novel framework that decouples function-calling logic from the primary LLM and delegates it to a dedicated smaller model operating within the instruction-following paradigm. Our method consistently outperforms both native function calling (NFC) and prompt-based function calling (PFC) baselines, with particularly strong gains on reasoning-oriented LLMs. Furthermore, we demonstrate that IFFC maintains robust performance under aggressive quantization, enabling efficient on-device deployment without significant accuracy degradation. This work establishes a new paradigm for reliable, resource-efficient function calling in edge-computing scenarios.

[193] Buried in Textual Debt: Context Pruning with Visual Evidence Preservation for MLLM Agents cs.AI | cs.CLPDF

Yuchen Huang, Sijia Li, Jun Zhang, Yi R. Fung

TL;DR: 本文提出SPARE框架，用于解决多模态大语言模型（MLLM）作为多步智能体时，因推理过程积累大量自生成文本（即文本债务）而压制视觉证据的问题。SPARE通过KL散度引导的剪枝方法，在保留关键视觉证据的前提下，移除冗余的推理文本，从而恢复模型对视觉信息的依赖。

Details

Motivation: MLLM在多步任务中，推理过程会积累大量文本，这些文本会主导上下文并压制视觉证据，形成文本债务；冗余的推理文本和过时的假设可能误导后续推断，因此需要在不丢弃视觉证据的前提下进行剪枝。

Result: 在多步视觉工具使用基准测试中，SPARE在剪枝方法中取得了最高的平均准确率，同时移除了37.89%至64.58%的推理标记，实现了有利的准确率与上下文权衡。

Insight: 创新点在于利用KL散度（通过策略内自蒸馏）来评估摘要是否充分覆盖候选文本段而不破坏未来推理，从而指导剪枝；同时通过监督微调摘要器，实现更紧凑的摘要和更积极的剪枝，有效减少文本主导并缓解对自生成语言的过度依赖。

Abstract: Multimodal Large Language Models (MLLMs) are increasingly deployed as multi-step agents, where explicit reasoning supports task decomposition and tool coordination but also accumulates self-generated text. Over long trajectories, this text can dominate the context and suppress visual evidence, creating textual debt. We observe that reasoning becomes redundant once task-relevant visual evidence is grounded, while stale hypotheses can misguide later inference when grounding remains uncertain. Pruning must therefore remove redundant text without discarding visual evidence. We propose SPARE, a Kullback–Leibler (KL)-guided framework for pruning accumulated reasoning in multimodal tool-use agents. SPARE uses a compact task-state summary as privileged diagnostic context. For each candidate segment, it replays the same model under the original and summary-conditioned contexts. Reverse-KL divergence from on-policy self-distillation (OPSD) then tests whether the summary sufficiently covers the segment without disrupting future reasoning. We further fine-tune the summarizer with supervised fine-tuning (SFT), enabling more compact summaries, broader coverage, and more aggressive pruning. Across multi-step visual tool-use benchmarks, SPARE achieves the highest average accuracy among pruning methods while removing 37.89–64.58% of reasoning tokens. This favorable accuracy–context trade-off shows that reducing textual dominance restores reliance on visual evidence and mitigates over-conditioning on self-generated language.

[194] AgentWeave: Routing Before Reasoning for Efficient Function Calling in Tool-Rich Language Models cs.AI | cs.CLPDF

Saurav Singla, Aarav Singla, Advik Gupta, Parnika Gupta

TL;DR: 本文提出了AgentWeave，一种用于工具丰富的大型语言模型的高效函数调用方法。其核心思想是在模型推理之前，通过一个确定性的预推理路由层来筛选和构建一个有界的、模型可见的动作候选集，从而减少输入令牌和处理延迟。

Details

Motivation: 随着语言模型可用的工具、函数和API数量激增，模型需要处理的模式增多，消耗的提示令牌增加，并且需要在大量相似或不相关的选项中做出选择，这降低了效率。论文旨在通过前置的路由策略来减少候选集规模，同时保持下游模型不变，以提升效率。

Result: 在48个新的BFCL V4多函数任务上，AgentWeave实现了12.5%的原始BFCL成功率，而所有基线方法（如全工具、确定性随机Top-8、语义Top-8）的成功率均为0。与暴露所有工具相比，AgentWeave减少了70.18%的工具数量、61.70%的输入令牌和50.95%的平均本地模型延迟。

Insight: 创新点在于将“路由”确立为一个独立于模型推理的阶段，通过利用资格、需求、能力和路由信号来主动构建候选动作空间。这为提升工具调用效率提供了一个新的系统级策略，即通过前置筛选来优化整体性能，而非仅仅改进模型本身。

Abstract: Large language models increasingly operate over large collections of tools, functions, APIs, and specialized agents. As the candidate action space grows, a function-calling model must process more schemas, consume more prompt tokens, and distinguish among increasingly similar or irrelevant alternatives. We study a complementary systems strategy: reduce the candidate set before language-model inference while leaving the downstream model unchanged. We introduce AgentWeave, a deterministic pre-inference routing layer that constructs a bounded model-visible action space using eligibility, requirement, capability, and routing signals. We evaluate AgentWeave with a frozen BFCL-derived routing-pressure protocol using the public MadeAgents/Hammer2.1-1.5b model. On 48 fresh BFCL V4 multiple-function tasks, AgentWeave achieves 6/48 (12.5%) native BFCL successes, whereas all-tools, deterministic random top-8, and semantic top-8 baselines each achieve 0/48. The paired success difference is +12.5 percentage points with a 10,000-resample paired bootstrap 95% confidence interval of +4.17 to +22.92 points and exact McNemar p=0.03125. Relative to all-tools exposure, AgentWeave presents 70.18% fewer tools, uses 61.70% fewer input tokens, and exhibits 50.95% lower mean local-model latency. The result is deliberately narrow: this is a BFCL-derived routing-pressure study rather than an official full BFCL leaderboard score, and absolute task success remains low. The evidence nevertheless shows that candidate-space construction can materially affect a fixed model’s function-calling behavior and motivates evaluating routing as a distinct stage before model reasoning.

[195] Cognitive Profiling of LRMs’ Reasoning Traces Using Bloom’s Taxonomy cs.AI | cs.CLPDF

Maria-Eleni Zoumpoulidi, Georgios Paraskevopoulos, Alexandros Potamianos

TL;DR: 本文提出了一种基于布鲁姆分类法的框架，用于自动标注大型推理模型（LRMs）推理步骤的认知类型，如记忆、应用和评估。通过对不同模型和数据集进行大规模分析，揭示了模型和任务间思维模式的异同，并发现推理步骤中的思维类型信息与正确性相关，为提升推理质量提供了可操作的见解。

Details

Motivation: 当前大型推理模型的推理轨迹日益公开，但理解推理过程中使用的思维类型（这对洞察模型推理模式并实现实际应用至关重要）仍未被充分探索。

Result: 大规模分析揭示了不同模型和任务间思维模式的相似性和差异性，并证明从推理轨迹中提取的思维类型信息与正确性相关。

Insight: 创新点在于将教育心理学中的布鲁姆分类法引入LRMs分析，提供了一个细粒度的框架来剖析模型的认知过程，并建立了思维类型与推理性能的关联，为优化模型推理提供了新视角。

Abstract: Large Reasoning Models (LRMs) have revolutionized reasoning in LLMs, and the increasing public availability of reasoning traces creates valuable opportunities to study model behavior not only at the surface level but also at the granularity of individual reasoning steps. However, understanding the types of thinking employed during reasoning - which offers critical insights into models’ reasoning patterns and enables actionable applications - remains underexplored. To address this gap, we introduce a framework for automatic annotation of reasoning steps through the lens of Bloom’s Taxonomy, which classifies thinking into six cognitive levels, such as Remembering, Applying and Evaluating. Using this framework, we perform a large-scale analysis across models and datasets, revealing both similarities and differences in thinking patterns across models and tasks. Moreover, we demonstrate that thinking-type information derived from reasoning traces correlates with correctness, paving the way for improved reasoning. Our findings establish a fine-grained framework for analyzing thinking patterns in LRMs and provide actionable insights for enhancing reasoning quality.

[196] Agent-G$^2$: Gaussian Guidance for Agentic Reinforcement Learning cs.AI | cs.CLPDF

Zixuan Wang, Yanrui Miao, Zhengxi Lu, Teng Pan, Yiwen Qiu

TL;DR: 本文提出了Agent-G²，一种用于智能体强化学习的高斯引导框架，旨在解决基于提示的强化学习中引导深度选择的问题。该方法将每个任务的引导深度建模为高斯分布，其均值和方差通过策略优化过程中已收集的轨迹在线估计，无需额外的探测轨迹或学习深度预测器。在ALFWorld和WebShop基准测试中，该方法以更低的采样成本超越了现有基于提示、无提示和辅助强化学习基线。

Details

Motivation: 解决基于提示的强化学习中引导深度选择的核心问题。现有方法将引导深度视为确定性标量，要么对所有样本使用统一调度而忽略任务异质性，要么为每个样本单独探测估计但成本高昂。

Result: 在ALFWorld基准测试上，使用Qwen2.5-1.5B/7B-Instruct模型，Agent-G²超越了最强的基于提示、无提示和辅助强化学习基线，分别高出2.3/3.9/7.4个百分点，且其采样成本仅为逐样本探测方法的三分之一以下。在WebShop任务上也进行了评估。

Insight: 核心创新在于发现有效引导深度并非集中于单一最优值，而是围绕一个中心呈近似高斯分布的带状区域。因此，将引导深度建模为高斯分布，其参数（中心与展宽）通过在线估计任务集群难度和集群内方差动态确定，实现了高效且自适应的引导，无需额外成本。

Abstract: Hint-based reinforcement learning addresses reward sparsity in long-horizon agentic tasks by retaining a prefix of an expert trajectory before each rollout, letting the policy explore from a state closer to success. Its effectiveness hinges on the guidance depth: how much of the trajectory to keep. Existing methods treat this depth as a deterministic scalar. Scheduled approaches share one value across samples and ignore per-task heterogeneity; per-sample probing estimates it separately at the cost of extra rollouts. We find that useful guidance occupies a band of depths whose informativeness profile is approximately Gaussian around the band center, rather than concentrating at a single optimal point. We propose Agent-G$^2$, a Gaussian guidance framework that draws the depth per task from a Gaussian whose center and spread are estimated online from rollouts already collected for policy optimization, requiring no probe rollouts or learned depth predictor. The center combines a global baseline with per-cluster difficulty, and the spread tracks within-cluster variance. We evaluate Agent-G$^2$ on ALFWorld and WebShop on Qwen2.5-1.5B / 7B-Instruct. Agent-G$^2$ outperforms the strongest hint-based, hint-free, and Aux-RL baselines on ALFWorld by 2.3 / 3.9 / 7.4 points at under one-third the rollout cost of per-sample probing.

[197] Mitigating Reasoning-Induced Misalignment via Safety-Direction Penalty cs.AI | cs.CLPDF

Yipeng Zhao, Qishun Yang, Shenzhe Zhu, Shu Yang, Di Wang

TL;DR: 本文研究了推理诱导错位现象，即在包含数学、代码和思维链等无害推理数据的微调过程中，大型语言模型可能产生有害行为。作者通过表征空间分析揭示了推理能力与安全行为在激活空间中的耦合方向，并提出了安全方向惩罚方法，在微调时惩罚沿安全方向的位移，从而在保持基准推理性能的同时恢复模型安全性。

Details

Motivation: 解决在无害推理数据微调中出现的推理诱导错位问题，该问题导致模型安全行为退化，是LLM推理安全的重要挑战。

Result: 在Qwen2.5-3B和7B模型上，安全方向惩罚方法成功恢复了模型安全性，同时保持了基准推理性能。

Insight: 创新点在于通过表征空间分析识别了推理与安全行为的耦合方向，并据此设计了层定位的惩罚机制；可借鉴的是利用激活空间几何结构诊断安全风险，并通过定向惩罚实现安全与能力的解耦。

Abstract: Reasoning-Induced Misalignment, where fine-tuning on reasoning data containing no harmful content, including mathematics, code, and problem-solving with chain-of-thought traces can induce harmful behaviors of LLM, posing a serious challenge to the safety of LLM reasoning. Cross-architecture, cross-scale, and cross-dataset checks show that RIM does not always emerge. Previous work attributed RIM to neuron-level entanglement, but did not identify the geometry of the representation space underlying this entanglement or propose a training-time fix. We provide both: a representation-space analysis of RIM and the Safety-Direction Penalty (SDP), which penalizes movement along a learned safety direction during reasoning fine-tuning. The analysis extracts two activation-space directions, one encoding reasoning ability and the other safety behavior. These directions are coupled: fine-tuning that improves reasoning shifts safety representations, and prompts with larger shifts show larger safety degradation. CKA distance ratios and probes locate the safety-decision layers where this shift is most relevant. These findings guide the design of SDP: the coupling motivates penalizing displacement along the safety direction, and the layer localization sets the initial scope. When the initial scope leaves compensatory shifts beyond the penalized layers, the same diagnostics guide iterative expansion. On Qwen2.5-3B and 7B, SDP restores safety while preserving benchmark reasoning performance.

[198] ParallelWorld: Test-Time Scaling for Embodied Reasoning cs.AI | cs.CVPDF

Min Chen, Shengjun Zhang, Yuxin Li, Zhang Zhang, Xin Fei

TL;DR: 本文提出ParallelWorld，一种用于具身推理的多视野测试时扩展框架。该框架通过并行模拟和评估多步未来轨迹，克服了现有方法在复杂遮挡空间环境中因延迟反馈而导致的短视规划问题，从而提升了主动感知和推理性能。

Details

Motivation: 现有具身推理方法通常采用增量式探索轨迹生成，缺乏长视野规划，且新兴的测试时扩展框架也常局限于短视的单步前瞻，难以处理复杂遮挡环境中固有的延迟反馈问题。

Result: 在ESI-Bench基准上的大量实验表明，ParallelWorld持续提升了主动感知和推理性能。

Insight: 创新点在于引入了验证器引导的树搜索范式，允许智能体在采取行动前并行模拟和评估多步未来轨迹，并通过动态剪枝和基于信息增益的路径优先级排序来优化决策过程，实现了长视野规划与高效探索的结合。

Abstract: Embodied Reasoning constitutes a fundamental capability of embodied intelligence, serving as the basis for autonomous perception, reasoning, and interaction within physical environments. Recent studies have shifted the paradigm of embodied reasoning from static perception toward dynamic exploration, where agents acquire task-relevant information through interactions with the environment. However, existing active reasoning approaches generally generate exploration trajectories incrementally without long-horizon planning. Even recently emerged test-time scaling frameworks often resort to myopic, single-step lookaheads, which struggle to resolve the delayed feedback inherent in complex, occluded spatial environments. To address this limitation, we propose ParallelWorld, a multi-horizon test-time scaling framework for embodied reasoning. Instead of greedy, single-step trials, ParallelWorld empowers agents to simulate and evaluate multi-step future trajectories in parallel before committing to an action. Specifically, we introduce a verifier-guided tree-search paradigm. Starting from the current state, ParallelWorld branches into multiple parallel trajectories and rolls them out continuously across a multi-step horizon. At each simulation step, a verifier agent evaluates the intermediate state transitions, dynamically pruning unpromising branches and prioritizing paths with the highest information gain. Once the multi-step prospective simulation is complete, the agent synthesizes the long-horizon outcomes to commit to the optimal action sequence. Finally, an answer agent performs reasoning over the selected trajectory to produce the final reasoning. Extensive experiments on ESI-Bench demonstrate that ParallelWorld consistently improves active perception and reasoning performance.

[199] From Generation to Simulation: How Far Are World Models from Being True Simulators? cs.AI | cs.CVPDF

Tong Wang, Huan Deng, Mucheng Yang, Yang He, Xiaohui Kuang

TL;DR: 本文对生成式世界模型与传统仿真器之间的能力差距进行了系统性评估。通过提出八个仿真器能力维度（资产构建、物理引擎、交互、可控性、稳定性、状态反馈、多样性和评估指标），作者梳理了三大技术路线（潜在动态、视频生成和联合嵌入预测），并对200篇代表性工作进行了分析。研究发现，世界模型在特定场景的交互和可控性上已实现功能替代，但在物理定律的形式化保证、结构化状态反馈和可复现的长时程演化方面仍落后于传统仿真器。

Details

Motivation: 随着扩散模型和大规模视频生成技术的快速发展，生成式世界模型被认为有望替代传统仿真器（如物理引擎、游戏引擎和强化学习环境），但两者之间的实际差距缺乏系统性评估。本文旨在填补这一空白，明确世界模型作为仿真器的当前能力边界与不足。

Result: 研究通过分析200篇（2018年至2026年6月）代表性论文发现，世界模型在交互和可控性等特定能力上已接近传统仿真器，但在物理定律的形式化保证、结构化状态反馈（仅6/163篇实现论文提供运行时状态查询接口）和长时程稳定性方面存在显著短板。

Insight: 论文的创新点在于提出了一个基于八大能力的系统性评估框架，用于量化生成式世界模型与传统仿真器的差距。客观来看，其核心洞察是明确了状态反馈是当前跨技术路线的共同短板，并指出了六个关键研究方向，包括形式化物理、统一动作接口、一等状态反馈、长时程稳定性、下游效用评估和跨路线融合，为领域发展提供了清晰的路线图。

Abstract: With the rapid progress of diffusion models and large-scale video generation, generative world models are increasingly expected to replace traditional simulators, including physics engines, game engines, and reinforcement-learning environments. Yet the remaining distance from generation to simulation lacks a systematic assessment. We present a capability-based study using an external yardstick: eight capabilities of a traditional simulator, namely asset construction, physics engine, interaction, controllability, stability, state feedback, diversity, and evaluation metrics. We trace three main technical routes–latent dynamics, video generation, and joint-embedding prediction–and map exactly 200 representative works published from 2018 to June 2026 onto these capabilities. Our analysis shows that world models have achieved functional substitution in interaction and controllability for specific scenarios, but remain short of traditional simulators in formal guarantees of physical laws, structured state feedback, and reproducible long-horizon evolution. State feedback is the most neglected cross-route shortcoming: only 6 of 163 implementation papers expose a runtime interface for querying entity states or physical parameters. We identify six research directions: formalized physics, a unified action interface, first-class state feedback, long-horizon stability, downstream-utility evaluation, and cross-route hybridization. Project page: https://github.com/AtongWang/world-model-simulators

cs.MA [Back]

[200] PropUQ-MAS: Propagation-Aware Uncertainty Quantification for LLM Multi-Agent Systems cs.MA | cs.CLPDF

Yaokun Liu, Yifan Liu, Daniel Yue Zhang, Ruichen Yao, Zelin Li

TL;DR: 本文提出了PropUQ-MAS，一个面向LLM多智能体系统的传播感知不确定性量化框架。该框架将多智能体系统的执行建模为通信结构图，通过结合本地不确定性和上游消息传递的不确定性来估计每个步骤的可靠性。实验表明，该方法能有效提升多智能体系统中的不确定性量化性能。

Details

Motivation: 现有不确定性量化方法主要针对孤立响应或单智能体推理，无法捕捉多智能体系统中因智能体间依赖关系导致的错误传播风险，例如中间消息错误被下游智能体继承和放大。

Result: 在广泛的实验中，PropUQ-MAS在多智能体系统的UQ任务上表现一致优于基线，在AUROC指标上平均相对增益为+6.10%，在PRR指标上平均相对增益为+47.58%。

Insight: 主要创新点在于提出了一个传播感知的UQ框架，通过将多智能体系统建模为图结构来显式地量化不确定性在智能体间的传播过程。从客观角度看，将通信依赖关系纳入不确定性估计模型，为解决多智能体协作中的可靠性评估问题提供了一个新的结构化思路。

Abstract: LLM-based multi-agent systems (MAS) solve complex tasks through communication among role-specialized agents. However, inter-agent dependencies introduce reliability risks beyond isolated agent failures. For instance, errors in intermediate messages could be inherited and amplified by downstream agents. Existing uncertainty quantification (UQ) methods mainly target isolated responses or single-agent reasoning, and therefore fail to capture uncertainty propagation in MAS. To this end, we propose PropUQ-MAS, an error propagation-aware UQ framework that represents MAS execution as a communication-structured graph and estimates each step’s reliability by combining local uncertainty with uncertainty inherited from upstream messages. Extensive experiments demonstrate that PropUQ-MAS consistently improves UQ in MAS, with average relative gains of +6.10% in AUROC and +47.58% in PRR.

cs.SE [Back]

[201] From Subjective Judgments to Auditable Standards:Protocol-Guided AI Auditing of Website Redundancy cs.SE | cs.CVPDF

Ge Kong, Yongtong Cao

TL;DR: 本文提出了CORA（Counterfactual, Observable Redundancy Audit）协议，用于对网站冗余进行可审计的评估。它将冗余分解为重复负载、正常使用代价和故障域恢复储备三个维度进行独立测量，并引入版本化视觉语言模型进行标注，通过类型化验证和发布检查来决定是否报告校准后的维度分数。在透明机制测试平台上，CORA的分解表示比标量负载基线更准确地预测了扰动后的成功率。

Details

Motivation: 解决网站冗余评估缺乏统一、客观和可审计标准的问题。由于冗余的含义因任务而异（有时是干扰，有时是备份），需要一种能够分离不同冗余维度并确保评估过程可重现和可审计的方法。

Result: 在透明机制测试平台上，CORA的分解表示成功地将恢复储备与正常使用代价分离开，并且在预测扰动成功率方面比标量负载基线更准确。模型研究表明，即使两个小型本地视觉语言模型能产生可重复的输出，也未能满足所有发布要求，因此CORA未对它们给出自动化评分。

Insight: 创新点在于将主观的冗余判断转化为一个基于协议、可审计的评估流程，通过分解测量、版本化模型标注和严格的类型化验证/发布检查来确保结果的可靠性和过程的可追溯性。这为受控基准测试提供了一个可审计的候选程序框架，而非一个通用标准。

Abstract: Website redundancy does not have a single fixed meaning. The same repeated element may distract during one task and provide backup during another. We introduce CORA (Counterfactual, Observable Redundancy Audit), which measures repetition load, normal-use tax, and failure-domain recovery reserve separately. Each run retains screenshots, stable element identities, and task traces. A versioned vision-language model proposes the annotations. Typed validation and release checks then determine whether a calibrated dimension can be reported; failed or malformed outputs stay in the fixed denominator. On a transparent mechanistic testbed, the factorized CORA representation separated reserve from normal-use tax and predicted perturbed success more accurately than scalar-load baselines. The model studies then showed why repeatability is not enough: two small local vision-language models produced recurring outputs, but neither instrument met all release requirements. CORA therefore withheld automated scores from both instruments while retaining the raw responses and failure records. Separate checker fixtures confirmed that the typed validator and hardened release gates implement their specifications; these tests do not establish semantic grounding or accuracy on production sites. Taken together, the results position CORA as an auditable candidate procedure for the controlled benchmark studied here rather than a general standard. Human agreement, AI-versus-human accuracy, and validation on independent production sites remain open empirical questions.

cs.LG [Back]

[202] Decoupled Physical Modeling and Execution for Physics Reasoning cs.LG | cs.CLPDF

Ye Zhang, Xuehang Guo, Rui Pan, Pengfei Yu, Denghui Zhang

TL;DR: 本文提出了一种解耦物理建模与执行的两阶段框架，旨在提升大语言模型在物理推理任务上的表现。该框架通过监督微调建立结构化建模能力，并利用基于量规反馈的强化学习优化建模过程。实验表明，该方法在多个多模态物理基准测试中均能提升不同模型的推理性能。

Details

Motivation: 当前大语言模型在解决物理问题时，常将物理建模过程与数学计算纠缠在一起，导致推理困难。受人类先构建系统表征再进行计算的启发，本文旨在通过显式编码物理建模过程的中间表示来改善这一状况。

Result: 在PhysReason、PhyX和SeePhys等多个多模态物理基准测试上，该方法相比GRPO平均提升约3%，表明显式物理建模能有效提升小型LLM的物理推理能力。

Insight: 核心创新在于将物理推理解耦为建模与执行两个阶段，并采用两阶段后训练策略（监督微调+基于量规反馈的强化学习）来蒸馏和优化中间物理表征，这为提升模型在需要结构化理解的领域（如物理）的推理能力提供了新思路。

Abstract: Physics reasoning requires constructing a consistent model of the underlying physical system rather than relying solely on symbolic or formula-based manipulation. Although large language models have shown strong ability in solving math and coding problems, they still struggle with physics problems, as these problems entangle the physical modeling process with mathematical calculations. Humans approach physics by first building a representation of the system before performing calculations. Inspired by this, we introduce a unified framework that distills intermediate representations that explicitly encode the physical modeling process and adopt a two-stage post-training strategy, where supervised fine-tuning establishes structured modeling, and reinforcement learning with rubric-based feedback improves the quality of the modeling process. Experiments on multiple multimodal physics benchmarks show that our approach leads to consistent improvements in reasoning performance across different models and datasets. On PhysReason, PhyX and SeePhys benchmarks, physical modeling output performs GRPO by an average ~3%, showing that explicit physical modeling is an efficient strategy of improving physics reasoning for small LLMs.

[203] How to Train a Critic Stably and Efficiently cs.LG | cs.AI | cs.CLPDF

Penghui Qi, Xiangxin Zhou, Wee Sun Lee

TL;DR: 本文提出了一种名为最佳实践评论家优化（BPCO）的稳定高效训练评论家（critic）的方法，用于强化学习中的大语言模型。该方法整合了DPPO、有界价值预测、蒙特卡洛价值目标、非归一化策略优势以及长度自适应的广义优势估计等技术，旨在解决标准基于评论家训练方法的不稳定性问题。实验表明，BPCO在数学推理任务上，使用单次响应采样即可匹配或超越基于群体采样的基线方法，并提升了基于评分标准奖励的学习效果。

Details

Motivation: 针对大语言模型强化学习中，基于群体（如GRPO）的方法需要为每个提示采样多个响应以避免训练评论家，而标准基于评论家的训练方法又往往不稳定的问题，本文旨在研究这种不稳定性并开发一种稳定且高效的评论家训练方案。

Result: 在从1.5B参数到30B-A3B专家混合模型的一系列数学推理任务上，BPCO方法持续改进了一个强大的基于评论家的基线模型，并且在每个提示仅采样一个响应的情况下，匹配或超越了基于群体采样的基线方法。该方案同样提升了基于评分标准奖励的学习效果。

Insight: 主要创新点在于提出了一个整合了多项最佳实践（DPPO、有界价值预测等）的稳定训练配方（BPCO）。客观来看，其关键洞察在于允许评论家在训练期间访问对策略隐藏的奖励定义信息（如参考答案或评分标准），从而提供更可靠的令牌级优势估计，这为基于群体相对优势估计提供了一种可靠的替代方案。

Abstract: Group-based reinforcement learning methods such as GRPO for large language models avoid training a critic by sampling multiple responses for each prompt. A reliable critic could instead estimate token-level advantages from one response, but standard critic-based training recipes are often unstable. We study this instability and develop \textbf{Best-Practice Critic Optimization (BPCO)}, a recipe that combines DPPO, value predictions bounded to the reward range, Monte Carlo value targets, unnormalized policy advantages, and length-adaptive generalized advantage estimation. Because the critic is used only during training, BPCO can also condition it on reward-defining information, such as a reference answer or grading rubric, that is hidden from the policy. Controlled experiments isolate the effect of each design choice. Across mathematical reasoning tasks with models ranging from 1.5B parameters to 30B-A3B mixtures of experts, BPCO improves a strong critic-based baseline consistently, and matches or exceeds a group-based baseline while sampling one response per prompt. The same recipe also improves learning with rubric-based rewards. These results show that a carefully designed critic provides a reliable alternative to group-relative advantage estimation. Code is available at https://github.com/QPHutu/golden_critic

[204] MSM-Mem: A Universal Medical Structured Multimodal Memory Framework for Medical AI Agents cs.LG | cs.CVPDF

Md Asaduzzaman Jabin, Khoa Le, Lin Zhao, Tianming Liu

TL;DR: 本文提出了MSM-Mem，一个通用的医学结构化多模态记忆框架，旨在使基于多模态大语言模型（MLLM）的医学AI智能体能够像医生一样，通过积累和利用临床经验来持续进化。该框架将异构的临床经验组织成语义、情景和视觉记忆，并在推理过程中增量更新，使智能体能够检索先验经验来辅助当前决策，从而逐步提升其推理可靠性。

Details

Motivation: 当前基于MLLM的医学AI智能体本质上是无状态的推理系统，每次交互独立生成决策，无法保留或内化经验知识，这限制了它们通过使用逐步提升推理可靠性以及适应真实世界临床工作流中纵向患者背景的能力。

Result: 在MoE-LLaVA骨干模型上的评估表明，MSM-Mem带来了持续的性能提升，并且通过持续使用观察到了进一步的增益。

Insight: 创新点在于提出了一个结构化的多模态记忆框架，将临床经验明确分类并增量更新，使AI智能体能够实现类似临床医生的经验积累式学习。这为构建能够持续进化的医学AI智能体提供了一条可行的技术路径。

Abstract: Clinical decision-making is inherently experience-driven: physicians progressively refine their reasoning by synthesizing patient history, multimodal observations, and prior diagnostic experiences across interactions. In contrast, current multimodal large language model (MLLM)-based medical AI agents largely operate as stateless inference systems, generating decisions independently for each interaction without retaining or internalizing experiential knowledge. This discrepancy limits their ability to progressively improve reasoning reliability through usage and adapt to longitudinal patient contexts in real-world clinical workflows. In this study, we propose Medical Structured Multimodal Memory (MSM-Mem), an agentic memory framework that enables medical AI agents to evolve through accumulated clinical experiences. MSM-Mem organizes heterogeneous clinical experiences into semantic, episodic, and visual memory and incrementally updates them during inference, allowing the agent to retrieve prior experiences to inform current reasoning and progressively refine decision-making over time. Evaluations on MoE-LLaVA backbones demonstrate consistent performance improve- ments with further gains observed through continued usage. In general, MSM-Mem offers a viable pathway toward medical AI agents capable of evolving their reasoning competence in a manner analogous to the way clinicians learn from practice over time.

[205] BioMed-Agent-RL: A Meta Learning, All You Need for Biomedical Applications cs.LG | cs.AI | cs.CVPDF

Md Asaduzzaman Jabin, Zihao Wu, Tianming Liu

TL;DR: 本文提出了BioMed-Agent-RL，一个用于生物医学应用的统一智能体框架。它通过整合自适应编排、策略和基于奖励的强化学习模型，结合临床上下文感知偏好优化等技术，旨在解决现有临床视觉大语言模型在病灶噪声、模态错位、幻觉和上下文缺失等方面的问题。该框架采用多模态元学习方法，在多个基准测试中显著超越了现有SOTA模型。

Details

Motivation: 当前临床视觉大语言模型在复杂临床案例中常受病灶噪声、模态错位、幻觉和上下文缺失等问题困扰，且现有智能体系统通常依赖静态、非自适应的流程，缺乏复杂医学推理所需的灵活性。

Result: 在多个基准测试上进行的消融研究表明，该智能体显著优于现有SOTA模型（如GPT-5），准确率最高达到约73%，比同期基线模型提升了约5%。

Insight: 创新点在于提出了一个结合自适应强化学习编排、临床上下文感知偏好优化和多模态元学习的统一智能体框架。其核心是动态整合模型级专业知识（如临床基础、推理器、病灶分割器），并能合成误导性视觉线索，在专家建议出错时信任自身推理，从而构建事实性、可靠且鲁棒的临床推理系统。

Abstract: The current progress of Clinical Vision Large Language Models (C-VLLMs) has substantially improved digital diagnostics, still these frameworks often endure lesion noises, modality misalignment, hallucination, and missed contextual grounding in complex clinical cases. Moreover, prevailing agent systems usually depend on static and non-adaptable pipelines and lack the versatility necessary for complex medical reasoning. To resolve these difficulties, we present BioMed-Agent-RL, a unified medical agent that incorporates adaptive orchestration, policy, and reward-based reinforcement learning (RL) models for biomedical applications. To ensure reliability, it invokes clinical context-aware preference optimization (CPO), direct preference optimization (DPO), and group relative policy optimization (GRPO) with dynamic entropy regulation. This pipeline utilizes a multimodal meta-learning approach that operates as a field-specific expert and human judgment synthesizer. The agent adaptively utilizes a set of model-level expertise, such as clinical grounding and reasoner, lesion segmenter, and field-specific synthesizer, across various clinical modalities (e.g., X-ray) by utilizing an iterative and adaptive RL approach. The agent learns to seriously synthesize misleading, conflicting vision cues and trust in inherent reasoning, while specialist advice is faulty. An intensive ablation study is conducted across multiple benchmarks, and the agent significantly outperforms existing state of the art models, such as GPT-5, attaining up to ~73% accuracy (gain of ~5%) over contemporary baselines. As a result, the framework suggests a new standard for building factual, reliable, robust, and expert-like intelligent agent systems for independent clinical reasoning.

[206] Does a Modern-Handwriting Warm-Up Help Historical Arabic OCR? A Reproducible, Compute-Matched Evaluation on Muharaf and KHATT cs.LG | cs.CVPDF

Sumaih Almarshad, Maram Alamri, Dona Aloraini, Fares Altuwaim, AlJawharh AlOtaibi

TL;DR: 本文通过可重复的计算匹配实验，评估了在现代阿拉伯语手写体（KHATT）上进行中间训练是否有助于历史阿拉伯语手写文本识别（HTR）。研究发现，先前声称的积极或消极效果并不稳定，且很大程度上取决于实验配置。在严格控制变量后，现代手写体预热训练仅带来微小的负面效果，而非普遍结论。

Details

Motivation: 解决关于现代阿拉伯语手写体作为中间训练阶段对历史阿拉伯语HTR效果影响的争议，现有结论通常基于单一实验，缺乏稳健性。

Result: 在四次重复消融实验中，估计效果在-17.64到+14.52 CER点之间波动且符号反转；在计算匹配的三次随机种子实验中，KHATT预热比匹配的相同领域控制组差+2.42 CER点（95%区间[+0.60, +4.25]），其中特定于手写领域的负面影响仅约0.6点。

Insight: 研究强调了实验可重复性和配置细节（如学习率、检查点来源）对结论的巨大影响；提供了包含标准化器、评分器、实验清单的SaudiHeritage-OCR工具包，以支持独立验证；指出单一实现的紧置信区间无法推广到其他实现。

Abstract: Whether an intermediate stage of modern Arabic handwriting helps or hurts historical Arabic HTR is usually decided from one implementation and one comparison, too thin a basis for a claim either way. We test stability by running the same nominal ablation four times, letting the base checkpoint, encoder-freezing strategy, epoch budget, precision, and learning-rate schedule vary as they naturally did during development, while holding the normalization, scorer, and interval estimation fixed. Each run compares intermediate training on modern handwriting (KHATT) then fine-tuning on historical manuscripts (Muharaf) against fine-tuning on Muharaf directly. Across the four runs the estimated effect swings from -17.64 to +14.52 CER points and reverses sign. The two extremes are exactly the two runs with an identifiable confound (a fivefold lower learning rate in one; a checkpoint of undisclosed provenance in the other); the two clean runs land at -0.25 and +0.94, i.e. no effect. A tight interval from one implementation says nothing about the next. We then run a compute-matched experiment with identical budgets over three seeds: KHATT warm-up is +2.42 CER points worse than a matched same-domain control (95% interval [+0.60, +4.25]); the part of that gap specific to the handwriting domain is only about 0.6 points a small negative effect under this configuration, not a universal result. We release a SaudiHeritage-OCR package with the normalizer, interval scorer, a verified KHATT decoder, experimental manifests, VLM baselines, and an edition-alignment protocol, so the result can be checked independently. The Al-Mahd inscription line is held strictly out and is not offered as a benchmark.

[207] A Comparative Study of Label-free Representation Quality Metrics in Deep Learning cs.LG | cs.CVPDF

Daniel Richards Arputharaj, Daniel Jönsson, Gabriel Eilertsen

TL;DR: 本文对无标签表示质量评估指标进行了系统性比较研究，通过理论分析和大量实验验证了不同指标在评估深度神经网络表示质量时的可靠性。研究将现有指标分为三类并建立理论关联，通过合成实验分析谱指标敏感性，最终在260个视觉模型和六个数据集上评估所有指标与下游任务准确率的相关性。

Details

Motivation: 旨在系统评估无标签表示质量指标的可靠性，理解这些指标在不同网络架构和训练目标下的表现差异，为实际应用提供指导。

Result: 在涵盖通用物体分类、细粒度分类、场景识别和地理空间任务的六个数据集上，实验发现内在维度（ID）是最可靠的预测指标，但所有指标的可靠性都受架构类别和训练目标的影响。

Insight: 创新点在于首次对无标签表示质量指标进行大规模系统性比较，建立了指标间的理论联系，并揭示了架构和训练目标对指标可靠性的调节作用，为表示质量评估提供了实践指南。

Abstract: We present a comparative study of label-free metrics for assessing the quality of representations in deep neural networks to understand their reliability under a wide variety of configurations. We group existing label-free metrics into three families based on their construction and analytically establish connections between metrics within the same family. We then characterise the sensitivity of spectral metrics through controlled synthetic experiments. Finally, all label-free metrics are evaluated against downstream task accuracy across a diverse set of 260 vision models on six datasets spanning generic object classification, fine-grained object classification, scene recognition and geospatial task, stratifying results by architecture class and training objective. We find that intrinsic dimensionality (ID) is the most reliable predictor among the metrics considered. However, the reliability of all metrics, including ID, is moderated by architecture class and training objective. Our results provide a clearer understanding of what label-free representation quality metrics measure, when they are reliable, and how to interpret them in practice.