cs.CL [Total: 71]
cs.CV [Total: 162]
cs.SD [Total: 1]
cs.GR [Total: 1]
cs.SE [Total: 1]
cs.RO [Total: 4]
cs.MM [Total: 3]
eess.IV [Total: 2]
cs.LG [Total: 6]
cs.MA [Total: 1]
cs.AI [Total: 9]
cs.IR [Total: 2]

cs.CL [Back]

[1] CoRA: Confidence-Rationale Alignment for Reliable Chain-of-Thought Reasoning cs.CLPDF

Juming Xiong, Weixin Liu, Kevin Guo, Congning Ni, Junchao Zhu

TL;DR: 该论文提出CoRA（Confidence-Rationale Alignment）框架，通过基于GRPO的强化学习方法联合优化答案正确性、置信度和基于评分标准的推理链支持度，以提升大语言模型在思维链推理中的可靠性。

Details

Motivation: 解决思维链推理中模型答案高置信度可能误导用户的问题，即当生成的推理链看似合理但实际不完整或缺乏支持时，需要确保模型置信度与其推理链的实质性支持相匹配。

Result: 在MedQA、MathQA和OpenBookQA基准测试上使用三种开源权重LLM，相比未调优检查点、监督微调和仅优化正确性的GRPO，该方法将置信度-推理链对齐误差降低了最高26.51%，同时保持竞争力准确率并常改善校准度。

Insight: 创新点在于提出置信度-推理链对齐概念，并设计联合奖励函数（结合答案正确性、置信度及基于评估准则的推理链质量），其评估准则涵盖基础性、连贯性、任务匹配和与答案的关联性，且无需向评估器提供标准答案。

Abstract: Chain-of-thought (CoT) reasoning can improve LLM performance, but high answer confidence may be misleading when the accompanying CoT rationale is plausible yet incomplete or poorly supported. We study confidence–rationale alignment: whether a model’s confidence in its committed answer is justified by its generated rationale. We introduce a GRPO-based reinforcement learning framework that jointly rewards answer correctness, committed-answer probability, and rubric-based rationale support, where the rubric assesses grounding, coherence, task match, and connection to the selected answer without revealing the gold answer to the judge. Across MedQA, MathQA, and OpenBookQA using three open-weight LLMs, our method reduces the confidence–rationale alignment error by up to 26.51% compared with untuned checkpoints, SFT, and correctness-only GRPO, while maintaining competitive accuracy and often improving calibration. These results show that reliable CoT reasoning requires not only confident answers, but rationales that substantively support them.

[2] Nemotron 3 Ultra: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning cs.CL | cs.AI | cs.LGPDF

NVIDIA, :, Aaron Blakeman, Aaron Thomas, Aastha Jhunjhunwala

TL;DR: 本文介绍了Nemotron 3 Ultra，一个总参数量5500亿、激活参数量550亿的混合专家（MoE）Mamba-注意力语言模型。该模型在20万亿文本token上进行了预训练，将上下文长度扩展到100万token，并通过监督微调、强化学习和多教师策略蒸馏进行后训练。模型融合了多项关键技术，在保持与顶尖公开LLM相当精度的同时，推理吞吐量最高提升约6倍，非常适合长上下文自主智能体任务。

Details

Motivation: 旨在构建一个高效、高精度且支持超长上下文的语言模型，以更好地服务于需要长期记忆和自主推理的智能体任务。

Result: 在推理吞吐量上，相比当前最先进的公开可用LLM，实现了最高约6倍的提升，同时达到了相当的精度水平。其100万token的上下文长度和SOTA级的精度使其在长序列任务中表现优异。

Insight: 创新点在于将Mamba架构与注意力机制、混合专家系统进行高效混合，并整合了多项前沿训练技术（如LatentMoE、多token预测、NVFP4预训练、多环境RLVR、MOPD和推理预算控制）。这种混合架构设计在保持模型容量的同时，显著提升了推理效率，为大规模智能体应用提供了可行的解决方案。

Abstract: We introduce Nemotron 3 Ultra, a 550 billion total and 55 billion active parameter Mixture-of-Experts Hybrid Mamba-Attention language model. We pre-trained Nemotron 3 Ultra on 20 trillion text tokens, then extended the context length to 1M tokens, and post-trained using Supervised Fine Tuning (SFT), Reinforcement Learning (RL), and Multi-teacher On-Policy Distillation (MOPD). Nemotron 3 Ultra is our most capable model yet, employing multiple key technologies - LatentMoE, Multi Token Prediction (MTP), NVFP4 pre-training, multi-environment RLVR, MOPD, and reasoning budget control. Nemotron 3 Ultra achieves up to ~6x higher inference throughput as compared to state-of-the-art publicly available LLMs while attaining on-par accuracy. The state-of-the-art accuracy, high inference throughput, and 1M token context length make Nemotron 3 Ultra ideal for long-running autonomous agentic tasks. We open-source the base, post-trained, and quantized checkpoints, along with the training data and recipe on HuggingFace.

[3] Context Compression Is Not One Thing: Readable Symbolic Re-expression vs. Coherent Summary at Matched Budget cs.CLPDF

Sisong Bei, Mikhail L. Arbuzov, Ziwei Dong, Dmitri Kalaev, Alexey Shvets

TL;DR: 本文研究了小语言模型在多跳问答中的上下文压缩问题，提出了一种名为Telegraph English的可读符号化格式，将检索到的段落重写为结构化的实体-关系语句，以更低的token成本保留推理证据。在MuSiQue、TwoWiki和HotpotQA数据集上的实验表明，该方法在匹配token预算下优于字符级删除、截断和随机子采样等基线方法，并在最难数据集上超越了连贯的散文摘要。

Details

Motivation: 解决小语言模型在多跳问答中因上下文长度限制而难以有效利用检索信息的问题，探索在固定token预算下如何更高效地压缩上下文以保留推理所需的证据。

Result: 在MuSiQue、TwoWiki和HotpotQA数据集上，Telegraph English相比三种匹配预算的压缩基线（字符级删除、截断、随机子采样）在F1分数上提升了13到20个百分点，并在最难数据集上超越了由相同编码器生成的连贯散文摘要。

Insight: 创新点在于提出了一种可读的符号化重表达格式，通过结构化实体-关系语句实现更密集的内容保留；客观分析表明，在固定token预算下，符号化表示比自然语言或连贯摘要能更有效地压缩实体信息，但优势并未随推理深度增加而增长。

Abstract: We study context compression for multi-hop question answering with small language models. We propose Telegraph English, a readable symbolic format that rewrites retrieved passages into structured entity-relation statements, preserving reasoning evidence at lower token cost. In controlled experiments on MuSiQue, TwoWiki, and HotpotQA, Telegraph English outperforms three matched-budget compression baselines (character-level deletion, truncation, and random sub-sampling) on every dataset, with gains of 13 to 20 F1 percentage point. It also outperforms a coherent prose summary produced by the same encoder on the hardest dataset. A pre-registered depth-interaction hypothesis is null: the advantage does not grow with reasoning depth within datasets. We interpret these results as evidence that readable symbolic re-expression preserves entity content more densely than either natural language or coherent summarization at matched token budget.

[4] Are Online Skill and Memory Modules Always Worth Their Tokens? A Budget-Constrained Study of Web Agents cs.CLPDF

Sina Hajimiri, Masih Aminbeidokhti, Jose Dolz, Ismail Ben Ayed, Issam H. Laradji

TL;DR: 本文研究了在线网络智能体中技能与记忆模块的性价比问题。在固定推理预算下，通过对比增强模块与基础模型增加推理步数的方案，发现基础模型往往能取得相当或更好的性能，且消耗更少的总令牌数。

Details

Motivation: 在线网络智能体常通过添加记忆、工作流或技能模块来提升性能，但这些模块会消耗测试时的令牌，且其开销很少与推理成本一同报告。研究旨在评估在固定总推理预算下，这些模块的收益是否仍然显著。

Result: 在WebArena的三个领域和三个模型（Gemini 3 Flash、GPT-5.4-mini、Qwen 3.6-27B）上，与令牌匹配的基线相比，三种增强方法（AWM、ASI、ReasoningBank）在总体成功率上被匹配或超越，且基线通常使用更少的总令牌数。在WorkArena-L1上使用Qwen 3.6-27B也观察到类似趋势。

Insight: 研究发现技能和工作流记忆在特定领域可能有用，但其明显增益在预算匹配的基准下常会消失。此外，运行间的方差显著影响结果，应作为在线网络智能体的核心评估标准进行报告。

Abstract: Online web agents often augment a base actor with memory, workflow, or skill modules. These modules can improve performance, but they also consume test-time tokens, a cost rarely reported alongside the actor’s inference cost. We study online augmentation, where this overhead is paid on every task, and re-evaluate its benefits under a fixed total inference budget. We compare AWM, ASI, and ReasoningBank with a token-matched vanilla baseline that uses the same budget for additional actor steps. Across three WebArena domains and three models, Gemini 3 Flash, GPT-5.4-mini, and Qwen 3.6-27B, the vanilla baseline matches or surpasses all three augmentation methods in aggregate success rate while often using fewer total tokens. We observe a similar trend on WorkArena-L1 with Qwen 3.6-27B, indicating that the effect extends to enterprise knowledge-work tasks. Our results suggest that skills and workflow memory can be useful in specific domains, but their apparent gains often vanish against a budget-matched actor. We further show that run-to-run variance materially affects outcomes and should be reported as a core evaluation criterion for online web agents.

[5] Deep Temporal Modeling and Ensemble Fusion for Multimodal Emotion Recognition from Physiological Signals cs.CLPDF

Desta Haileselassie Hagos, Saurav Keshari Aryal, Patrick Ymele-Leki, Anietie Andy, Legand L. Burge

TL;DR: 本文对LSTM、TCN和Transformer等深度学习模型在WESAD数据集上进行了多模态生理信号情感识别的综合评估，通过消融实验和融合策略（包括晚期融合集成和早期传感器级融合）来提升识别性能。

Details

Motivation: 生理压力和情感识别对健康监测和情感计算至关重要，本文旨在通过深度时序建模和融合策略，开发鲁棒的多模态生理情感识别系统。

Result: 在WESAD数据集上，Transformer模型在多模态设置中表现最佳，TCN模型在仅手腕信号配置中表现最好；集成方法获得了最高的整体准确率（98.91 +/- 0.13%）和宏F1分数（98.56 +/- 0.17%），达到了SOTA水平。

Insight: 创新点包括对多种深度时序模型的综合比较、传感器级早期融合与预测级晚期融合集成的结合，以及通过消融实验验证多模态贡献，为鲁棒情感识别系统设计提供了有效策略。

Abstract: Physiological stress and emotion recognition are important for health monitoring and affective computing. In this work, we present a comprehensive evaluation of deep learning models such as Long Short-Term Memory (LSTM), Temporal Convolutional Networks (TCN), and Transformer on the WESAD dataset for multimodal affect recognition using wrist and chest sensor signals. We perform ablation studies to assess the individual contributions of each modality by training models on wrist-only and chest-only inputs. In addition, we implement a late-fusion ensemble strategy that combines predictions from all three architectures trained on multimodal input. We also employ early fusion at the sensor level by concatenating wrist and chest signals before feeding them into each model. Our results show that Transformer models consistently achieve the highest accuracy in multimodal settings, while TCN models perform best in the wrist-only configuration. The ensemble method yields the highest overall accuracy (98.91 +/- 0.13%) and macro-F1 score (98.56 +/- 0.17%). These findings demonstrate the effectiveness of sensor fusion and ensemble-based fusion in developing robust systems for physiological emotion recognition.

[6] ReportQA: QA-Based Radiology Report Evaluation cs.CL | cs.CVPDF

Yiming Shi, Shaoshuai Yang, Xi Chen, Haolin Li, Hengyu Zhang

TL;DR: 本文提出了ReportQA，一种基于问答的放射学报告评估框架，通过构建临床实体知识树、利用大语言模型提取结构化信息并生成QA对，引入QAScore指标来量化评估放射学报告生成系统。该方法在多个模态和区域的数据集上验证，相比现有指标更符合放射科医生的判断，并揭示了当前基于报告的推理范式在细粒度临床表征学习上的局限性。

Details

Motivation: 现有放射学报告评估指标（如自然语言生成指标）临床相关性有限，而临床效能指标主要关注实体存在性且覆盖范围窄，难以扩展；基于临床实践中报告作为信息传递媒介的洞察，需要一种更灵活、临床相关的评估框架。

Result: 在多个最先进的视觉语言模型上的实验表明，QAScore指标比现有指标更好地与放射科医生判断对齐；同时发现当前基于报告的推理范式难以学习细粒度临床表征并存在强烈的负先验偏差，而问题驱动推理提供了更有效的替代方案。

Insight: 创新点在于将报告评估转化为QA任务，利用LLM作为评判模型，通过结构化知识树和模板化QA生成实现可扩展的定量评估；客观来看，该方法通过释放知识树、结构化报告和QA对等资源，增强了可复现性和可扩展性，为细粒度临床表征学习提供了新视角。

Abstract: Radiology report evaluation is essential for advancing automated report generation. Natural language generation metrics have limited clinical relevance. Clinical efficacy (CE) metrics evaluate important medical findings, but focus mainly on presence and cover only a limited set of entities. Due to heavy reliance on manual annotations, it is difficult for CE metrics to extend clinical entities or attributes. In clinical practice, radiology reports serve as a medium for information transfer. Clinicians use them to perform downstream diagnostic tasks without directly inspecting images. Based on this insight, we propose ReportQA, a clinical-related and flexible radiology report evaluation framework, supporting detailed quantitative analysis of radiology report generation systems. We first collect datasets covering multiple imaging modalities and anatomical regions. We then construct knowledge trees of clinical entities and attributes with radiologist guidance, and use large language models (LLMs) to extract structured information from raw reports. Next, we generate QA pairs from predefined templates and apply quality control through self-filtering and report-based filtering. During evaluation, the report is treated as context, and an LLM acts as a judge model to answer the QA pairs. Based on the resulting QA accuracy, we introduce QAScore metric. Compared with existing metrics, QAScore shows better alignment with radiologist judgments. Experiments on multiple state-of-the-art vision-language models reveal that current report-based inference paradigms struggle to learn fine-grained clinical representations and exhibit strong negative prior biases. In contrast, question-driven inference provides a more effective alternative. For reproducibility and extensibility, we release the knowledge trees, structured reports, and QA pairs, along with the pipeline code for QA construction and evaluation.

[7] Equity with Efficiency: An Empirical Study of Tokenizers for Multilingual Large Language Models cs.CLPDF

Kieron Seven Jun Wei Lee, Muhammad Reza Qorib, Andrew Ivan Soegeng, Hwee Tou Ng

TL;DR: 本文系统性地研究了多语言大语言模型中的分词器公平性问题，重点关注东南亚低资源语言。通过对比多种分词器在11种东南亚语言上的压缩效率、跨语言公平性以及下游任务性能，发现Parity-aware BPE在效率与公平性之间取得了帕累托最优，而Morphology-Driven Byte Encoding通过更丰富的形态学表示获得了最佳语义推理性能。

Details

Motivation: 当前最先进的多语言LLM通常使用字节级BPE分词器，这种结构偏向高资源语言和拉丁文字，导致低资源语言（尤其是东南亚语言）的推理成本增加和跨语言能力差距扩大。

Result: 在统一的包含11种东南亚语言的基准测试中，Parity-aware BPE在效率与公平性的权衡中处于帕累托前沿，实现了强压缩公平性和有竞争力的成本。Morphology-Driven Byte Encoding取得了最佳的下游语义推理性能，但计算开销更高。

Insight: 研究表明跨语言公平性与分词效率并非根本对立，为设计公平的多语言模型提供了实用指导。创新点在于首次系统比较了公平分词器，并揭示了不同分词策略（如基于形态学的编码）在资源受限场景下的性能差异与权衡。

Abstract: Multilingual large language models (LLMs) depend on subword tokenization to bridge discrete text and continuous neural representation. State-of-the-art multilingual LLMs often use Byte-level Byte-Pair Encoding (BPE) tokenizers that structurally favor high-resource languages and Latin scripts. For speakers of underrepresented languages, particularly those across Southeast Asia, this bias inflates inference costs and widens cross-lingual capability gaps. We present the first systematic comparison of equitable tokenizers on a unified benchmark spanning 11 Southeast Asian languages. Beyond tokenizer-level analysis of compression efficiency and cross-lingual equity, we assess downstream task performance through controlled 1.5B-parameter language model training using the same training data. Our results show that Parity-aware BPE lies on the Pareto frontier of the efficiency-equity trade-off, achieving strong compression parity at competitive cost. Morphology-Driven Byte Encoding delivers the best semantic reasoning performance through morphologically richer representations, albeit at a higher computational expense. Byte Latent Transformer underperforms on downstream tasks, possibly because its architectural assumptions misalign with the constraints of limited low-resource training data. Together, our findings demonstrate that cross-lingual fairness and tokenization efficiency are not fundamentally at odds, and offer practical guidance for designing equitable multilingual models.

[8] Stop When Further Reasoning Won’t Help: Attention-State Adaptive Generation in Reasoning Models cs.CLPDF

Jiakai Li, Ke Qin, Rongzheng Wang, Yizhuo Ma, Qizhi Chen

TL;DR: 本文提出了一种名为ASAG的免训练即插即用方法，通过分析注意力分布来推断大推理模型的推理状态，并自适应地调整生成策略，以解决模型在测试时计算扩展中常见的‘过度思考’问题，从而在减少生成令牌数量的同时提升推理准确性。

Details

Motivation: 动机在于解决大推理模型在显式思维链推理过程中因‘过度思考’而产生的冗余令牌输出和精度下降问题，现有基于训练的方法计算成本高，而免训练方法依赖精心设计的提示或不置信度信号，效果有限。

Result: 在九个基准测试上的广泛实验表明，ASAG能持续提升包括DeepSeek-R1-Distill和Qwen3系列在内的主流大推理模型的性能，例如在Qwen3-8B上，所有推理任务的平均准确率提升3.2%，同时生成令牌数减少近40%。

Insight: 创新点在于从注意力分布视角研究早期停止机制，提出了一种简单有效的训练免费框架来动态推断模型推理状态并调整生成，这为缓解过度思考提供了一种轻量级、可泛化的解决方案，无需额外训练或复杂提示工程。

Abstract: By incorporating test-time compute scaling, large reasoning models (LRMs) can solve complex problems through explicit chain-of-thought (CoT) reasoning processes. However, they often suffer from overthinking, resulting in redundant token outputs and degraded accuracy. Current methods to mitigate this issue remain limited: training-based approaches require substantial computational resources, while training-free methods rely on well-crafted prompts or unreliable confidence signals. In this work, we investigate early stopping from the perspective of attention distributions and propose a simple method, ASAG, which infers the model’s reasoning state and adaptively adjusts the generation strategy. The proposed framework is training-free and plug-and-play, enabling seamless integration into existing LRMs. Extensive experiments on nine benchmarks demonstrate consistent improvements across mainstream LRMs with varying parameter scales, including the DeepSeek-R1-Distill and Qwen3 series. Specifically, ASAG improves average accuracy by 3.2% while reducing the number of generated tokens by nearly 40% across all reasoning tasks on Qwen3-8B.

[9] AdaMame: A Training Recipe for Adaptive Multilingual Reasoning cs.CL | cs.AIPDF

Dayeon Ki, Kevin Duh, Marine Carpuat

TL;DR: 本文提出AdaMame，一种用于自适应多语言推理的两阶段训练方法，旨在解决大型推理模型在非英语查询中出现的语言崩溃问题。该方法通过SFT阶段建立多语言推理能力，并在RL阶段引入AdaMame-GRPO，自适应地将推理语言与查询语言对齐，从而在保持准确性的同时提升语言保真度和token效率。

Details

Motivation: 大型推理模型在英语上表现良好，但在查询语言上经常无法推理，即出现语言崩溃现象；现有基于强化学习的修复方法通常会在准确性、代码切换和token使用量之间产生权衡，需要一种能自适应对齐推理语言且不牺牲准确性的解决方案。

Result: 在两个基准测试、两个大型推理模型和12种语言上的评估表明，AdaMame-GRPO在推理准确性、语言保真度和token效率方面实现了帕累托最优性能，尤其在领域外、低资源语言上取得了最强的增益。

Insight: 创新点在于提出了一种两阶段训练方法，其中RL阶段引入查询条件对齐因子，在训练中逐步增长，引导模型先探索多样推理语言，再专注于查询语言推理；这提供了一种自适应对齐策略，避免了传统多目标强化学习的权衡问题。

Abstract: While Large Reasoning Models (LRMs) show strong performance in English, they often fail to reason in the language of the query, a phenomenon known as language collapse. Existing RL-based fixes typically add a binary language fidelity reward to the accuracy objective, yet still incur trade-off in accuracy, mid-trace code-switching, and excessive token usage. In this work, we propose AdaMame, a two-stage training recipe for multilingual mathematical reasoning that addresses these limitations by adaptively aligning the reasoning language to the query language without compromising accuracy. The first SFT stage fine-tunes on naturally occurring reasoning traces across five languages to establish multilingual reasoning capability. In the subsequent RL stage, we introduce AdaMame-GRPO, an adaptation of Group Relative Policy Optimization (GRPO) in which a query-conditioned alignment factor grows progressively during training, guiding the model to first explore diverse reasoning languages before exploiting reasoning in the query language. Evaluated across two benchmarks, two LRMs, and 12 languages, AdaMame-GRPO achieves Pareto-optimal performance across reasoning accuracy, language fidelity, and token efficiency over all baselines, with the strongest gains on out-of-domain, lower-resource languages.

[10] Ling and Ring 2.6 Technical Report: Efficient and Instant Agentic Intelligence at Trillion-Parameter Scale cs.CL | cs.AIPDF

Ang Li, Ben Liu, Bin Han, Bin Hu, Bin Jing

TL;DR: 本文介绍了Ling-2.6和Ring-2.6系列模型，旨在实现高效、可扩展的智能体智能。Ling-2.6专注于低延迟响应和每个输出token的高能力，而Ring-2.6则针对深度推理和高级智能体工作流。通过架构迁移预训练和大规模后训练升级基础模型，并结合模型架构、优化目标、服务系统和智能体训练环境的协同设计，提升了模型能力和部署效率。

Details

Motivation: 解决高效、可扩展的智能体智能需求，即需要模型在保持低延迟响应和强大推理能力的同时，易于训练、服务和部署。

Result: 论文提出了Ling-2.6和Ring-2.6模型家族，通过混合线性注意力设计、进化思维链、语言单元策略优化等方法优化了token效率，并利用KPop强化学习框架稳定训练了万亿参数规模的Ring-2.6-1T模型。所有2.6系列的检查点均已开源。

Insight: 创新点包括：1) 针对不同任务（即时响应 vs. 深度推理）的模型分工设计；2) 通过架构迁移预训练而非从头训练来高效升级模型；3) 引入混合线性注意力（Lightning Attention与MLA结合）提升长上下文训练和解码效率；4) 提出KPop框架，通过异步调度支持大规模环境数据上的稳定强化学习训练，可扩展地学习复杂智能体-环境交互。

Abstract: Efficient and scalable agentic intelligence requires models that can deliver both low-latency responses and strong reasoning capabilities while remaining practical to train, serve, and deploy. In this report, we present Ling-2.6 and Ring-2.6, a family of models designed to address this challenge at scale. Ling-2.6 is optimized for instant response generation and high capability per output token, whereas Ring-2.6 is tailored for deeper reasoning and more advanced agentic workflows. Instead of training from scratch, we upgrade the Ling-2.0 base model through architectural migration pre-training and large-scale post-training. This upgrade is guided by a unified co-design of model architecture, optimization objectives, serving systems, and agent training environments, enabling improvements in both model capability and deployment efficiency. At the architectural level, we introduce a hybrid linear attention design that integrates Lightning Attention with MLA, improving the efficiency of long-context training and decoding. To further enhance token efficiency, we optimize capability per output token through Evolutionary Chain-of-Thought, Linguistic Unit Policy Optimization, bidirectional preference alignment, and shortest-correct-response distillation. For agentic capabilities, we propose KPop, a reinforcement learning framework designed to support stable training of Ring-2.6-1T on large-scale environment-grounded data. KPop improves training efficiency through asynchronous scheduling across coding, search, tool use, and workflow execution, enabling scalable learning from complex agent-environment interactions. Together, Ling-2.6 and Ring-2.6 provide a practical pathway toward efficient, scalable, and open agentic systems. We open-source all checkpoints in the 2.6 family to support further research and development in practical agentic intelligence.

[11] When Cognitive Graphs Meet LLMs: BDEI Cognitive Pathways for Panic Emotional Arousal Prediction cs.CLPDF

Mengzhu Liu, Long Qin, Chuan Ai, Zhengqiu Zhu, Hongru Liang

TL;DR: 本文提出PanicCognitivePath (PCP)框架，用于预测个体恐慌情绪激发的时机。该框架通过心理安全距离模型整合多维度威胁信号，并在BDI认知模型中引入显式情绪节点形成BDEI认知通路，同时限制大语言模型的作用范围以减少幻觉影响。在飓风桑迪数据集上的实验表明，该方法在情绪激发时机预测的准确性和峰值计数误差上均优于基线。

Details

Motivation: 现有方法未能显式建模情绪激发过程，不适用于情绪激发时机预测。本文基于评价情绪理论，旨在解决三个关键问题：多维度威胁信号融合、认知模型中缺乏显式情绪节点，以及大语言模型输出的脆弱性和幻觉问题。

Result: 在飓风桑迪数据集上的实验表明，PCP框架将情绪激发时机预测的准确性相比基线提高了10.68%，并将峰值计数误差降低至7.07%。

Insight: 创新点包括：1) 基于心理距离理论的心理安全距离模型，将多领域信号映射为统一风险度量；2) 在BDI模型中引入显式情绪节点，形成BDEI认知通路，直接将威胁评价与情绪激发耦合；3) 将大语言模型的作用限制在单一状态转换的参数估计中，以遏制幻觉和错误传播。

Abstract: Predicting individual panic emotional arousal timing before manifestation is essential for proactive emergency intervention. Existing methods incorporate cognitive elements but none explicitly model the emotional arousal process, making them ill-suited for emotional arousal timing prediction. We argue that grounding prediction in appraisal emotion theory is necessary because it explicitly models this process, but three problems must be solved. (1) Appraisal theory posits that emotion arises from simultaneous evaluation across multiple threat dimensions, yet no prior work fuses these inputs into risk perception. (2) Existing cognitive models lack an Emotion node, decoupling threat appraisal from emotional arousal and forcing emotions to be inferred indirectly from behaviors. (3) Given their generalizable cognitive reasoning, current approaches adopt LLMs as the primary decision-maker, yet overlook the fragility and hallucination-proneness of their outputs. To address these issues, we introduce PanicCognitivePath (PCP), a framework that addresses all three. A Psychological Safety Distance (PSD) model, grounded in psychological distance theory, maps four-domain signals into a unified risk metric as the entry condition for subsequent cognitive reasoning. An explicit Emotion node grounded in appraisal emotion theory is introduced into BDI, forming a Belief-Desire-Emotion-Intention (BDEI) pathway. Agents whose risk metric exceeds the PSD threshold enter this pathway, coupling threat appraisal directly to emotional arousal. The BDEI pathway governs all state transitions while the LLM is confined to parameter estimation for the Belief-to-Desire transition, confining hallucinations to a single step and preventing error propagation. Experiments on Hurricane Sandy show PCP improves arousal timing accuracy by 10.68% over baselines, reduces peak count error to 7.07%.

Shijun Wan, Xuehai Wu, Jiwen Zhang, Siyuan Wang, Zhongyu Wei

TL;DR: 本文提出了一个名为AgentViSS的基准测试，用于评估多模态智能体在社交模拟中的视觉社会智能。该基准包含240个场景、585个角色实例和2,340个角色任务实例，涵盖表情、特征、互动调节和互动结果四个任务。通过评估七个最新的多模态大语言模型，发现模型在角色表达和冲突处理上表现接近饱和，但在互动调节和基于视觉的结果达成方面仍存在显著困难。

Details

Motivation: 现有社交智能体基准大多基于文本，缺乏对多模态智能体利用视觉线索（如面部表情、姿势、凝视）引导社交互动能力的测试。本文旨在填补这一空白，通过构建一个结合文本与视觉证据的基准，系统评估智能体的视觉社会智能。

Result: 在AgentViSS基准上评估了七个近期MLLM模型，使用语言化视觉和直接视觉两种设置。结果显示，模型在角色特定表达和冲突处理任务上表现接近饱和（接近完美），但在互动调节和基于视觉的结果达成任务上仍有较大差距，表明后者更具挑战性。

Insight: 创新点在于构建了首个专注于评估视觉社会智能的多模态社交模拟基准，结合了对齐的文本-视觉证据和结构化角色档案。客观分析表明，该研究揭示了当前MLLM在局部角色扮演与全局互动管理能力上的不平衡，为未来多模态社交智能体的发展提供了重要方向。

Abstract: Social interaction depends on both language and visible social signals, such as facial expressions, posture, gaze, and emotional shifts. Yet existing social-agent benchmarks are largely text-based and rarely test whether multimodal agents can use visual cues to guide interaction. We introduce \textsc{\benchmarkname{}}, a benchmark evaluating visual social intelligence in multimodal social simulation. It contains 240 scenarios, 585 role instances, and 2,340 role-task instances, combining aligned textual-visual evidence, structured role profiles, and four role-level tasks: expression task, characteristic task, interaction regulation task, and interaction outcome task. Evaluating seven recent MLLMs under verbalized-vision and direct-vision reveals a clear gap between local role enactment and interaction management: role-specific expression and conflict handling are near saturation, whereas interaction regulation and visually grounded outcome achievement remain substantially more difficult. The code is released at https://github.com/JunsWan/AgentViSS, and the dataset is available at https://huggingface.co/datasets/JunsWan/AgentViSS.

[13] Adapting Reinforcement Learning with Chain-of-Thought Supervision for Explainable Detection of Hateful and Propagandistic Memes cs.CL | cs.AIPDF

Mohamed Bayan Kmainasi, Mucahid Kutlu, Ali Ezzat Shahroor, Abul Hasnat, Firoj Alam

TL;DR: 本文提出了一种基于强化学习的后训练方法，通过任务特定奖励和组相对策略优化（GRPO）来提升基于思维链的多模态大语言模型（MLLMs）在仇恨和宣传类梗图检测中的分类性能和基于参考的解释质量。该方法在英语和阿拉伯语基准数据集上进行了系统评估，并扩展了数据集以包含弱监督的思维链推理和细粒度宣传标注。

Details

Motivation: 仇恨和宣传类梗图利用图像和文本的交互传递单一模态无法揭示的有害意图，而现有的基于思维链的MLLMs在梗图内容审核中的应用仍待探索。

Result: 在Hateful Memes和ArMeme基准测试中，该方法在FHM准确率上提升了2.1%（从79.9%到82.0%），在ArMeme宏F1上提升了7.6分（从0.536到0.612），同时能生成自然语言解释；尽管序列分类基线在原始准确率上仍更强，但该方法提供了更平衡的每类性能及解释。

Insight: 创新点包括：通过蒸馏和多LLM细粒度标注扩展数据集以生成弱监督思维链推理；引入结合思维长度正则化的GRPO目标，联合优化分类准确率和解释质量；探索基于共识伪标签在未标注梗图上的自监督GRPO训练。

Abstract: Hateful and propagandistic memes exploit the interplay between images and text to convey harmful intent that neither modality reveals alone. Although thinking-based multimodal large language models (MLLMs) have advanced vision-language understanding, their application to meme content moderation remains underexplored. We propose a reinforcement learning-based post-training method that improves classification performance and reference-based explanation quality in thinking-based MLLMs via task-specific rewards and Group Relative Policy Optimization (GRPO). Concretely, we (i) conduct a systematic empirical study of off-the-shelf MLLMs for hateful and propagandistic meme understanding across English and Arabic benchmarks, (ii) extend existing meme datasets with weakly supervised chain-of-thought (CoT) rationales via distillation and multi-LLM fine-grained propaganda annotations, (iii) introduce a GRPO-based objective with thinking-length regularization that jointly optimizes classification accuracy and explanation quality, and (iv) investigate self-supervised GRPO on unlabeled memes using consensus-based pseudo-labels. Experiments on the Hateful Memes and ArMeme benchmarks show that our approach improves over previously reported results on FHM accuracy (up to +2.1%, from 79.9% to 82.0%) and on ArMeme macro-F1 (up to +7.6 points, from 0.536 to 0.612 with explanations; +6.1 compared to the original ArMeme benchmark), while also generating natural-language explanations. On ArMeme, sequence-classification baselines remain stronger in terms of raw accuracy, whereas our approach provides more balanced per-class performance along with explanations. We publicly release our code, data extensions, and evaluation resources.

[14] Prior over Evidence: Stereotype-Driven Diagnosis in LLM-Based L2 Pronunciation Feedback cs.CLPDF

Rong Wang, Kun Sun

TL;DR: 本研究测试了基于大语言模型的第二语言英语发音反馈系统，发现其诊断更依赖于预训练先验而非提供的语音证据。通过对1800个L2-Arctic语音样本的分析，揭示了模型在评分准确性、证据一致性和基于证据的正确性之间的脱节现象。

Details

Motivation: 验证LLM在L2发音反馈中是否真正基于提供的语音证据进行诊断，而非依赖预训练中的刻板印象先验。

Result: 在多个模型和条件下，评分准确性与基于证据的推理脱节（39.6%的案例推理一致但评分错误）；音素级反馈收敛于固定的L2困难音素库；声学证据仅当直接探测目标维度时改善评分（如文本化F0范围将音高变化的基础性从0.18-0.19提升至0.45-0.62）。

Insight: 揭示了当前通用LLM更适合作外部计算发音证据的言语化工具，而非独立诊断引擎；提出了评估诊断系统的新指标（证据一致性和基于证据的正确性）；表明需要针对性的声学特征表示来改善模型的基础性。

Abstract: Large language models are increasingly deployed for written pronunciation feedback in second-language (L2) English learning, under the assumption that their diagnoses are grounded in the supplied speech evidence rather than in priors from pretraining. This assumption is tested on 1,800 L2-Arctic utterances spanning six L1 backgrounds, three audio-capable LLMs, four pronunciation dimensions, and five evidence conditions ranging from a text-only baseline to numeric acoustic features and raw audio. Each (utterance x model x condition x dimension) cell is scored on three metrics: Rating Accuracy (RA) against gold labels, Evidence Coherence (EC) assessing internal consistency without ground truth, and Grounded Correctness (GC) evaluated against gold evidence. Results show three findings across models. First, rating accuracy and grounded reasoning decouple: 39.6% of judged cells contain internally coherent reasoning that supports a wrong rating, against only 15.8% where the reasoning supports a correct rating. Second, phoneme-level feedback converges to a fixed inventory of L2-English difficulty phones that recurs across all six L1 backgrounds and all evidence conditions. Third, acoustic evidence improves the rating only when the supplied feature directly probes the target dimension: textualised F0 range raises pitch-variation grounding from (0.18-0.19) to (0.45-0.62) across all three models, while stress and phoneme correctness, which require target-to-realisation alignment, remain ungrounded. The same audio waveform without textualised F0 values does not reproduce this improvement. These findings indicate that current general-purpose LLMs are more reliable as verbalisers of externally computed pronunciation evidence than as standalone diagnostic engines.

[15] Replay What Matters: Off-Policy Replay for Efficient LLM Reinforcement Unlearning cs.CL | cs.LGPDF

Zirui Pang, Chenlong Zhang, Haosheng Tan, Zhuoran Jin, Jiaheng Wei

TL;DR: 本文提出ReRULE方法，通过离线回放机制提升LLM强化学习遗忘的效率。该方法在早期训练阶段将低奖励的困难案例存入回放缓冲区，并在后续阶段通过重要性采样进行离线策略更新，从而将计算资源集中用于尚未收敛的边界案例。

Details

Motivation: 针对现有基于强化学习的遗忘方法（如RULE）在策略优化中重复采样相同提示导致的效率低下问题，即简单案例快速收敛而边界困难案例持续产生低奖励轨迹并被丢弃。

Result: 在MUSE-Books基准上，Retain Quality从46.3提升至56.2，且仅增加5-11%的训练时间；在更简单的TOFU设置上改进有限，验证了方法在困难/简单案例差异显著时最有效。

Insight: 创新点在于将离线回放机制引入LLM强化学习遗忘，通过重要性采样重用历史困难案例轨迹，理论上提供了更紧的边界收敛保证，实践上实现了计算效率与遗忘效果的平衡。

Abstract: LLM unlearning has emerged as a cost-effective alternative to full retraining for removing hazardous knowledge from pretrained models while preserving general utility. Recent RL-based methods such as RULE reformulate unlearning as learning a refusal behavior, but their on-policy optimization repeatedly samples from the same forget and retain/boundary prompts throughout training. We identify a critical inefficiency in this process: easy cases quickly converge and provide little useful gradient signal, while hard cases near the forget/retain boundary continue to produce low-reward rollouts that are discarded after a single use. To address this issue, we propose ReRULE, an off-policy replay enhancement for reinforcement unlearning. ReRULE stores low-reward hard-case rollout groups in a replay buffer during early GRPO training and reuses them in later stages through importance-sampled off-policy updates, redirecting computation toward boundary cases that still require learning. Theoretically, we show that ReRULE yields a tighter hard-case convergence bound than pure on-policy RULE. Empirically, ReRULE improves MUSE-Books Retain Quality from 46.3 to 56.2 while adding only 5–11% training time across benchmarks. Its limited improvement on the simpler TOFU setting further supports the intended conditional behavior: replay is most beneficial when the hard/easy disparity is pronounced.

[16] Let LLMs Judge Each Other: Multi-Agent Peer-Reviewed Reasoning for Medical Question Answering cs.CL | cs.AIPDF

Zaifu Zhan, Shuang Zhou, Rui Zhang

TL;DR: 本文提出了一种多智能体同行评审推理方法，旨在提升大语言模型在医学问答任务中的准确性、可解释性和鲁棒性。该方法让多个LLM智能体独立生成思维链和候选答案，然后作为同行评审员相互评估推理过程的事实正确性和逻辑合理性，最终选择评分最高的推理链来生成最终答案。

Details

Motivation: 解决大语言模型在医学问答任务中可能存在的推理错误、缺乏解释性以及单一模型鲁棒性不足的问题，目标是构建更可信赖的生物医学AI系统。

Result: 在HeadQA、MedQA-USMLE和PubMedQA三个基准数据集上，该方法使用五个SOTA LLM进行实验，其性能持续优于单一模型的思维链推理和基于思维链的多数投票集成方法。最佳模型组合实现了0.820的平均准确率，超过了最强的单一模型（0.777）和多数投票集成（最高0.789）。

Insight: 核心创新在于让LLM同时扮演问题求解者和评估者，通过同行评审机制强调推理过程的质量而非仅仅是答案的一致性。这提供了一种通过模型间协作与相互评估来提升复杂领域任务性能的新范式。

Abstract: Objective: To enhance the accuracy, interpretability, and robustness of large language models (LLMs) in medical question answering (MedQA). Method: We designed a multi-agent peer-reviewed reasoning method in which multiple LLM agents independently generate chain-of-thought reasoning with candidate answers, then act as peer reviewers to evaluate each other’s reasoning for factual correctness and logical soundness. The highest-rated reasoning chain is selected to produce the final answer. Experiments were conducted with five state-of-the-art LLMs (Llama-3.1-8B, Qwen2.5-7B, Phi-4, DeepSeek-LLM-7B, GPT-oss-20B) on three benchmark datasets: HeadQA, MedQA-USMLE, and PubMedQA. Performance was compared against single-model chain-of-thought reasoning and chain-of-thought-based majority voting. Results: Peer-reviewed reasoning consistently outperformed both baselines. The best model combination achieved an average accuracy of 0.820 across datasets, exceeding the strongest single model (0.777) and majority voting ensembles (up to 0.789). The method also scaled effectively with more participating models, while peer assessments reliably distinguished high- from low-quality reasoning chains. Conclusion: The proposed multi-agent peer-reviewed reasoning method enables LLMs to act as both solvers and evaluators, yielding superior performance in MedQA. By emphasizing reasoning quality rather than answer agreement alone, this approach improves accuracy, interpretability, and robustness, offering a promising direction for trustworthy biomedical AI systems.

[17] Pepti-Agent: An AI Agent for Peptide Design and Optimization cs.CL | q-bio.BMPDF

Houxu Chen, Achuth Chandrasekhar, Amir Barati Farimani

TL;DR: 本文提出了Pepti-Agent，一个用于多肽设计和优化的AI智能体框架。该框架将生成模型、基于序列的属性预测器和单点突变操作封装为独立的、可检查的工具，并由一个大语言模型控制器来协调调用这些工具，根据候选序列的实时多属性状态进行迭代优化，从而克服传统方法中脚本难以复用、优化依赖语言推理而非具体属性追踪的局限性。

Details

Motivation: 治疗性多肽的开发需要同时满足溶解度、溶血活性和非特异性表面污染等多个相互制约的约束，传统计算方法通常将这些组件硬编码为难以检查、扩展或重用的整体脚本，并且优化过程往往依赖于自然语言推理，而非追踪每个候选序列不断变化的多属性状态。

Result: 论文通过将任务特定的PeptideGPT模型（用于生成候选序列）、基于ProtBERT的分类器（用于评分溶解度、溶血和非污染性）以及两种可互换的突变算子封装为工具，构建了Pepti-Agent框架。该框架通过记录控制器决策、预测器输出和接受突变的每一步轨迹，为基准测试多目标设计策略和优先选择实验验证的候选序列提供了可复现的基础。

Insight: 主要创新点在于提出了一个模块化、可检查的闭环多肽设计框架，将大语言模型作为协调控制器，使其能够基于候选序列的实时属性配置文件（而非仅语言推理）来指导优化过程。这为复杂多目标生物分子设计提供了一种更透明、可追溯且可复现的工程化方法。

Abstract: Therapeutic peptides occupy a valuable design space between small molecules and biologics, but their development requires satisfying several competing constraints at once: solubility, hemolytic activity, and nonspecific surface fouling are governed by overlapping sequence features, so improving one property often degrades another. Computational design addresses this by pairing generative models with sequence-based property predictors, iteratively proposing and refining candidates. However, these components are typically wired together as monolithic scripts that are difficult to inspect, extend, or reuse, and they often refine sequences by natural-language reasoning rather than by tracking the evolving multi-property state of each candidate. We present Pepti-Agent, a closed-loop, peptide-specific framework that exposes generation, property prediction, and single-residue mutation as independently inspectable Model Context Protocol (MCP) tools. A large language model controller invokes these tools and consults live predictor output between calls, so refinement is guided by each sequence’s current property profile rather than by language reasoning alone. Task-specific PeptideGPT models generate candidates, ProtBERT-based classifiers score solubility, hemolysis, and non-fouling, and two interchangeable mutation operators propose sequence edits. By recording a per-step trace of controller decisions, predictor outputs, and accepted mutations, Pepti-Agent offers a reproducible substrate for benchmarking multi-objective design strategies and for prioritizing candidates for experimental validation.

[18] Beyond English: Uncovering the Multilingual Gap in Vision-Language-Action Models cs.CL | cs.ROPDF

Hanyang Chen, Hongliang Li, Jiarui Cao, Yang Li, Yang Jiang

TL;DR: 本文首次系统研究了视觉-语言-动作模型在多语言指令跟随方面的能力，发现现有VLA模型在非英语指令上存在显著的性能下降，并提出了一种基于主成分分析的多语言微调方法来缓解这一差距。

Details

Motivation: 现有VLA模型主要在英语指令上进行训练和评估，其在其他语言上的理解和执行能力尚不明确，本文旨在揭示并解决VLA模型中的多语言性能差距问题。

Result: 实验表明，即使在底层语言模型具备多语言能力的情况下，主要基于英语训练的VLA模型在其他语言指令上的性能仍显著下降；提出的Multilingual Principal Component Alignment方法有效缩小了这一性能差距。

Insight: 创新点在于首次系统评估了VLA模型的多语言指令跟随能力，并揭示了表征偏移是导致多语言性能差距的关键因素；提出的基于主成分分析的表征对齐方法为提升VLA模型的多语言泛化能力提供了简单有效的解决方案。

Abstract: Vision-Language-Action models have recently demonstrated promising capabilities in learning generalist robot policies from large-scale multimodal data. However, most existing VLA systems are trained and evaluated primarily with English instructions, leaving their ability to understand and execute instructions in other languages largely unexplored. While the underlying large language models often possess multilingual capabilities, it remains unclear whether these multilingual capabilities transfer to VLAs during training. In this work, we present the first systematic study of multilingual instruction following in VLA models. We first construct multilingual instructions by extending existing benchmarks with translations of their instructions. Using these instructions, we evaluate several representative VLA models across a range of tasks in simulation settings. Our experiments reveal a significant multilingual gap: models trained primarily on English instructions exhibit substantial performance degradation when evaluated on other languages, even when the underlying language backbone is multilingual. We provide several findings and analyses to understand the multilingual gap. Cross-lingual transfer behavior analysis shows that performance drops correlate with both instruction understanding and action execution. Representation analyses suggest that multilingual instruction-caused representation shifts may contribute to the multilingual gap. Motivated by these findings, we further explore strategies to improve multilingual performance in VLAs. We propose a simple yet effective multilingual fine-tuning approach, Multilingual Principal Component Alignment, which leverages Principal Component Analysis to get the principal component subspace and align projected multilingual representations, effectively reducing the multilingual performance gap.

[19] Vernier: Probing Representational Misalignment Behind Lexical Gaps in Causal Reasoning cs.CL | cs.AIPDF

Zhenyu Yu

TL;DR: 论文《Vernier》研究了指令调优语言模型在因果推理任务中，当问题中的英文变量名被类型保持的占位符替换后，模型回答不一致的现象。作者通过配对视图权重更新作为工具，探究了这种词汇间隙背后的机制，发现主要是表征未对齐而非信息丢失。

Details

Motivation: 动机是探究语言模型在因果推理任务中，面对变量名替换（词汇间隙）时回答不一致的根本原因，即这种不一致是由于占位符视图的信息丢失，还是源于表征层面的未对齐。

Result: 在Qwen-7B、Qwen-14B和Llama-3.1-8B模型上的激活修补实验表明，决策令牌的表征可以在不同视图间传递答案身份。更新方法（对原始和占位符提示进行反事实增强）能重新对齐视图，但效果受模型系列、规模和任务限制，例如在CRASS任务上跨Qwen规模和Llama模型转移可靠，而在e-CARE任务上效果较弱。

Insight: 创新点在于使用配对视图权重更新作为工具来诊断表征未对齐，并揭示了词汇间隙主要源于表征读取未对齐而非信息丢失。方法上，反事实增强是重新对齐视图的有效手段，且决策令牌表征具有跨视图传递答案身份的能力，这为理解模型内部表征机制提供了新视角。

Abstract: Instruction-tuned language models can answer the same causal-reasoning question differently after its English variable names are replaced by type-preserving placeholders, although the structural causal model and the gold answer are unchanged. We ask whether this lexical gap reflects information loss in the placeholder view or a misaligned read-out from a representation that still carries answer-relevant content. Vernier uses a paired-view weight update as an instrument and then inspects the mechanism left after the gap closes. In the working regimes, the evidence favours representational misalignment. A variable-name probe becomes more accurate on the placeholder view, and activation patching on Qwen-7B, Qwen-14B, and Llama-3.1-8B shows that the decision-token representation can transfer answer identity between views. The update that realigns the views is counterfactual augmentation over original and placeholder prompts, while the answer-subspace KL mainly sharpens intermediate answer-belief agreement. Success is bounded by model family, scale, and task. CRASS transfer is reliable across Qwen scales and Llama, e-CARE remains weak, and preliminary non-causal rename tasks show a similar qualitative pattern.

[20] EHRNote-ChatQA: A Benchmark for Evidence-Grounded Multi-Turn Clinical Question Answering over Longitudinal Discharge Summaries cs.CL | cs.AIPDF

Jiyoun Kim, Muhan Yeo, Eunhye Jang, Jeewon Yang, Hangyul Yoon

TL;DR: 本文提出了EHRNote-ChatQA，这是首个针对患者多份出院小结进行证据支撑的多轮临床问答基准。该基准基于MIMIC-IV出院小结构建，包含967个患者级别的多轮样本和16,072个医学专家验证的问答对，涵盖八个临床类别。通过评估22个开源和闭源大语言模型，揭示了模型在证据支撑和多轮对话方面面临的挑战。

Details

Motivation: 现有的临床问答基准通常评估考试式医学知识或侧重于单轮问答，缺乏对多轮对话中证据支撑的充分评估。为了反映医学专家在审查多份出院小结时需要迭代综合信息并验证证据的真实场景，作者构建了此基准。

Result: 在EHRNote-ChatQA基准上评估了22个大语言模型，结果显示：模型在证据支撑任务上比内容回答更困难；多轮对话中的错误会累积；单轮临床问答的性能不能可靠地迁移到此多轮场景。

Insight: 创新点在于构建了首个证据支撑的多轮临床问答基准，其构建流程结合了专家指导的模板和LLM生成，并由医学专家逐条审核，确保了数据的严谨性和实用性。这为评估临床问答系统提供了一个更贴近真实医疗决策场景的测试平台。

Abstract: Discharge summaries are crucial clinical documents containing the context of a patient’s overall hospital stay, and are routinely reviewed by medical experts for patient readmission, ongoing care, and diagnostic decision-making. When reviewing them, medical experts often must iteratively synthesize information across multiple summaries while verifying the evidence supporting each answer. Although large language models (LLMs) are increasingly explored for clinical question answering, existing benchmarks do not sufficiently reflect this setting: they often evaluate exam-style medical knowledge or focus on single-turn question answering with limited evidence-grounding evaluation. We introduce EHRNote-ChatQA, the first benchmark for evidence-grounded multi-turn clinical question answering over patients’ multiple discharge summaries. Built from de-identified MIMIC-IV discharge summaries, EHRNote-ChatQA contains 967 patient-level multi-turn samples spanning one to five notes and 16,072 medical-expert-verified QA pairs (8,036 content questions, each paired with an evidence-grounding question) across eight clinical categories. The benchmark is constructed through an expert-informed pipeline combining discharge-summary structuring schema, expert-curated multi-turn QA templates, and LLM-based generation, followed by review and revision of every single QA sample by 11 medical experts. Benchmarking 22 open- and closed-source LLMs reveals several challenges, including that LLMs struggle more with evidence grounding than content answering, multi-turn errors compound across turns, and single-turn clinical QA performance does not reliably transfer to this setting. These findings establish EHRNote-ChatQA as a rigorous and practical benchmark for evaluating clinical QA systems. The dataset will be made publicly available through PhysioNet credentialed access.

[21] ttda704 at SemEval-2026 Task 6: Structured Chain-of-Thought Prompting for Political Evasion Detection cs.CLPDF

Tai Tran Tan, An Dinh Thien

TL;DR: 本文介绍了参加SemEval-2026 Task 6的系统，该任务旨在对美国大选访谈中的问答对进行政治回避策略分类。作者系统比较了两种范式：使用QLoRA对Qwen3模型进行参数高效微调，以及使用结构化思维链提示调用DeepSeek-V3.2和Grok-4-Fast等推理模型。结果表明，结构化CoT提示方法在宏观F1分数上显著优于参数高效微调基线。

Details

Motivation: 解决从美国总统访谈中提取的问答对的政治回避策略自动分类问题，并系统比较参数高效微调与大语言模型结构化提示这两种主流技术路线的效果。

Result: 在官方排行榜上，最佳系统（使用扩展推理和少样本分层CoT提示的Grok-4-Fast）在9类回避的Subtask 2上获得0.5147的宏观F1分数（33支队伍中排名第8），在3类清晰度的Subtask 1上获得0.7979的宏观F1分数（41支队伍中排名第13）。结构化CoT提示方法在绝对宏观F1上显著优于参数高效微调基线。

Insight: 创新点在于系统比较了微调与提示两种范式，并提出了用于回避检测的有效提示设计关键洞察：使用分层分类法呈现标签有助于结构化模型推理，少样本示例提供任务校准，而显式启用扩展推理模式能通过促进检测回避意图所需的多步骤语用分析带来显著的性能提升。

Abstract: This paper describes our system for SemEval-2026 Task 6, which addresses the classification of political evasion strategies in English question-answer pairs extracted from U.S. presidential interviews. We systematically compare two distinct paradigms: (1) Parameter-Efficient Fine-Tuning of Qwen3 models (4B-32B) using QLoRA, enhanced with tiered upsampling and weighted cross-entropy loss to address severe class imbalance, and (2) structured Chain-of-Thought (CoT) prompting of reasoning-capable API models, namely DeepSeek-V3.2 and Grok-4-Fast. Our evaluation demonstrates that structured CoT prompting of reasoning-enabled models substantially outperforms our baseline parameter-efficient fine-tuning implementation in absolute Macro F1. Our best system, Grok-4-Fast with extended reasoning and few-shot hierarchical CoT prompting, achieves a Macro F1 of 0.5147 on Subtask 2 (9-class evasion) and 0.7979 on Subtask 1 (3-class clarity), ranking 8th out of 33 teams on Subtask 2 and 13th out of 41 teams on Subtask 1 on the official leaderboard. Furthermore, our ablation studies reveal key insights into effective prompt design for evasion detection: presenting labels within a hierarchical taxonomy helps structure model reasoning, while few-shot exemplars provide task calibration. However, the strongest prompt variants are not statistically distinguishable in Macro F1, and explicitly enabling extended reasoning modes yields substantial performance gains by facilitating the multi-step pragmatic analysis required to detect evasive intent.

[22] The Truth Stays in the Family: Enhancing Contextual Grounding via Inherited Truthful Heads in Model Lineages cs.CL | cs.AI | cs.LGPDF

Miso Choi, Seonga Choi, Mincheol Kwon, Woosung Joung, Jinkyu Kim

TL;DR: 该论文研究了大型语言模型（LLM）及其下游变体（如多模态LLM）之间在行为上的内在联系，发现模型家族内部在“上下文真实性”方面存在强烈的继承性。基于此，作者提出了TruthProbe方法，通过软门控策略增强上下文真实的注意力头，从而提升模型在事实性和减少幻觉方面的表现。

Details

Motivation: 研究动机是探究共享基础LLM的模型谱系（如下游指令微调或多模态变体）之间是否存在根本性的行为联系，特别是上下文真实性方面的关联。

Result: 在Vicuna、Qwen2.5、LLaMA2和Mistral等多个模型谱系上的实验表明，TruthProbe方法有效提升了上下文真实性，在HaluEval基准上改善了事实性，并在POPE和CHAIR基准上减少了多模态幻觉。

Insight: 论文的创新点在于揭示了模型谱系中注意力头层面的“上下文真实性”具有可继承性，并据此设计了一种非侵入式的软门控干预方法TruthProbe，该方法能有效利用基础模型的特性来提升下游变体的性能。

Abstract: Recent advances in large language models (LLMs) have produced many specialized multimodal LLMs (MLLMs) that share common foundational LLMs, forming distinct model lineages. It remains unclear whether a fundamental behavioral link exists between the foundational LLMs and downstream variants. We investigate this question by quantifying head-level context-truthfulness scores. Across diverse LLM and MLLM lineages, including Vicuna-, Qwen2.5-, LLaMA2-, and Mistral-based models, we find that Truth Scores are strongly preserved within model families, even after instruction tuning or multimodal adaptation. We further show that this inheritance is consistent with attention-head weight preservation, and that context-truthful heads attend to query-relevant evidence. Building on this finding, we propose TruthProbe, a soft-gating strategy that amplifies context-truthful heads while preserving other head contributions. TruthProbe improves contextual truthfulness on HaluEval and reduces multimodal hallucination on POPE and CHAIR, with base-LLM Truth Scores transferring effectively to their fine-tuned LLM and MLLM descendants. Code is available at https://github.com/miso-choi/TruthProbe.

[23] When Correct Edges Cannot Be Verified: A Provenance Gap in Incomplete KGQA and a Provenance-Favoring Completion Policy cs.CLPDF

Yongqi Kang, Yu Fu, Yong Zhao

TL;DR: 本文研究了不完整知识图谱问答（IKGQA）中文本可验证性与边正确性之间的关系，发现两者存在范式级差距：即使边是正确的，也往往缺乏文本支持。基于此，论文提出了一个倾向于溯源的边补全策略TGComplete，它在边精度和忠实度上优于基线，但以召回率为代价。

Details

Motivation: 动机是探究IKGQA中一个未被系统验证的问题：文本可验证性是否真的能追踪边的正确性？这源于当前工作普遍将文本支持作为边质量的代理。

Result: 在CWQ/WebQSP数据集上，TGComplete相比基线GoG，在边精度上取得显著提升（15-21% vs 3-14%），且没有统计上可检测的EM损失，同时被采纳边的严格忠实度高出3.1-7.4倍，但召回率较低。

Insight: 核心洞察是揭示了文本忠实度衡量的是溯源（provenance）而非正确性，两者存在根本性差距。这重新定义了边补全问题，从判断’边是否正确’转向’在溯源不确定时是采纳还是弃用’。TGComplete策略提供了一个在精度/溯源-召回权衡上的原则性方案，适用于可审计性重要的场景。

Abstract: Incomplete Knowledge Graph Question Answering (IKGQA) requires completing missing edges to continue reasoning. A growing line of work verifies completed edges against retrieved text, treating textual support as a proxy for edge quality. We ask a question that, to our knowledge, has not been systematically tested: does textual verifiability actually track correctness? Exploiting the gold deleted triples provided by the standard random-deletion protocol, we measure both. The finding is counterintuitive: among gold-correct completed edges, 76-96% have no supporting passage even under exhaustive retrieval, robustly across deletion rates (20%/40%), datasets (CWQ/WebQSP), and relation types (structural, commonsense, long-tail). Most Freebase-style facts simply do not occur as head-tail co-mentions in text. Textual faithfulness therefore measures provenance, not correctness – separated by a paradigm-level gap no in-corpus retrieval closes. This reframes edge completion. Since most completed edges – correct or not – are causally redundant for the answer (95-97% of correct answers do not depend on any unsupported edge), the central question shifts from “is the edge correct?” to “admit or abstain under provenance uncertainty?” Within this framing we present TGComplete, a provenance-favoring admission policy that retrieves evidence at a reasoning breakpoint, verifies a candidate through a lightweight loop, and abstains when support is absent. Against the generate-to-complete baseline GoG, it attains higher edge precision against gold (15-21% vs 3-14%), with no statistically detectable EM loss and 3.1-7.4 times higher strict faithfulness of admitted edges – at the cost of lower recall. We position TGComplete not as uniformly better, but as a principled point on a precision/provenance-recall trade-off, appropriate when auditability matters.

[24] SciOrch: Learning to Orchestrate Expert LLMs for Solving Frontier Multimodal Scientific Reasoning Tasks cs.CLPDF

Jingru Guo, Xiangyuan Xue, Lian Zhang, Wanghan Xu, Siki Chen

TL;DR: 本文提出了SciOrch框架，通过训练一个轻量级的80亿参数模型作为编排器，来协调多个前沿大型语言模型（LLM）解决复杂的多模态科学推理任务。该编排器将问题分解，通过API调用将子问题分配给选定的商业模型，并综合最终答案。

Details

Motivation: 前沿科学推理对现有LLM构成重大挑战，单个模型存在性能瓶颈且不同模型在不同类型问题上具有互补性，但传统评估方式掩盖了这一点。因此，需要一种方法来有效整合多个专家模型的优势。

Result: 在包含SGI-Reasoning和Scientists’ First Exam的240个问题测试集上，SciOrch达到了56.66%的平均准确率，比最强的单个商业模型高出3.74%，比最强的多智能体基线高出3.33%。同时，它在两个数据集上都取得了最佳准确率，且API调用成本不到典型多智能体方法的一半。

Insight: 核心创新在于提出并解决了训练编排器模型的挑战：由于API调用成本高昂，无法进行标准的在线强化学习。作者采用基于蒙特卡洛树搜索的方法生成多样化的编排轨迹，提取单步样本，并用GRPO风格的训练优化编排器，实现了高效、低成本的多模型协同推理。

Abstract: Frontier scientific reasoning remains a major challenge for large language models (LLMs), where even the strongest commercial systems fall short of expert-level performance. A closer look at model behavior reveals substantial complementarity that single-model evaluation hides: different frontier models excel on different question types, and no single model captures the full picture. We present SciOrch, a framework that trains a lightweight 8B model to orchestrate frontier LLMs for scientific reasoning. The orchestrator decomposes each question, delegates sub-problems to selected commercial models through API calls, and synthesizes a final answer. Training such an orchestrator is fundamentally harder than conventional agentic RL: each action triggers an API call that is expensive in both dollar cost and latency, making standard online rollouts infeasible. We address this with MCTS-based approach, producing diverse orchestration trajectories, extracting per-node single-turn samples, and optimizing the orchestrator with GRPO-style training. On a 240-question test set spanning SGI-Reasoning and Scientists’ First Exam, SciOrch reaches 56.66% average accuracy, outperforming the strongest single commercial model by 3.74% and the strongest multi-agent baseline by 3.33%. It also attains the best accuracy on both SGI and SFE with less than half the API cost of typical multi-agent methods.

[25] Free Energy Heuristics: Fast-And-Frugal Cognition as Active Inference Under Uncertain Precision cs.CL | cs.AIPDF

Alex Bogdan

TL;DR: 本文提出自由能启发式（FEH）理论，将快速节俭启发式与主动推理统一为同一计算过程，并证明在元不确定性高的任务中，长思维链（CoT）会降低模型性能。作者构建了FEH-79基准进行验证，发现高元不确定性项目上CoT导致准确率显著下降。

Details

Motivation: 研究旨在解释思维链（CoT）在数学推理等任务中有效，但在规划、伦理争议等任务中反而有害的矛盾现象，提出元不确定性（模型对自身证据可靠性的不确定程度）是关键决定因素。

Result: 在FEH-79基准测试中，高元不确定性项目上长CoT导致准确率下降17.3个百分点（95% CI [7.7, 25.5]），而明确答案的对照项目无影响；该效应在中大型模型中显著，在最强前沿模型中呈方向性，在最弱模型中不出现或反转。

Insight: 创新点在于通过不确定精度下的期望自由能最小化，理论证明了有限高有效性线索整合与快速节俭启发式（如‘取最佳’策略）的等价性，为CoT的适用边界提供了原则性解释，并统一了贝叶斯与快速节俭认知传统。

Abstract: Chain-of-thought (CoT) improves large language models’ performance in math and symbolic reasoning. But on planning, contested ethics, and tasks where the model cannot check itself, more reasoning makes things worse. Both effects are documented; what has been missing is a principled account of which property decides the outcome. We argue it is meta-uncertainty: how unsure the model is about the reliability of its own evidence. When that uncertainty is high, extra reasoning stops adding signal and starts manufacturing false confidence. We prove that the policy minimizing expected free energy under uncertain precision stops integrating cues after a finite number of high-validity ones when the precision prior is heavy-tailed (Theorem 2.6.1), and under a Descending Dominance condition, is sample-wise identical to take-the-best (Theorem 2.7.4). Fast-and-frugal heuristics and active inference are, then, two descriptions of the same computation. The prediction is that on high-meta-uncertainty items, longer CoT should degrade accuracy. We score the regime per item (simulate-and-recover rho > 0.96), build FEH-79, a benchmark of Knightian frames with matched controls, and run a pre-registered study across seven models (five open-weight 3B-32B, two frontier), five CoT lengths, and 7,875 responses. The gate, fixed before any data, required a negative interaction with posterior probability above 0.95 and an accuracy drop of more than 6 points. It held. The high-regime drop is 17.3 points (95% CI [7.7, 25.5]); matched items with definite answers show no cost. The effect is regime-dependent: decisive in capable mid-to-large models, directional in the two frontier systems, absent-to-reversed in the weakest. The framework answers when CoT helps and unifies the Bayesian and fast-and-frugal traditions: less-is-more effects are evidence about the meta-uncertainty regime, not against Bayesian cognition.

[26] Neuron Level Analysis of Large Language Model in Legal Domain Reasoning cs.CLPDF

Eri Onami, Youmi Ma, Shuhei Kurita, Naoaki Okazaki

TL;DR: 本文对大型语言模型在法律领域推理任务中的神经元级分析进行了研究，通过比较七个开源模型在法律领域和其他应用领域任务上的表现，利用神经元归因分数来识别和抑制关键神经元。研究发现抑制特定神经元会显著降低目标任务准确率，而抑制随机神经元则无此效果，并揭示了存在一小部分跨任务通用神经元和大量任务特异性神经元。

Details

Motivation: 动机在于深入理解LLMs在特定领域（如法律）推理中的内部工作机制，探究神经元在不同任务中的角色和分布规律，以验证关于关键神经元集中层的假设是否普遍成立。

Result: 实验表明，抑制识别出的关键神经元会导致目标任务准确率崩溃，而抑制相同数量的随机神经元则不会；在法律领域的三个基准测试中，神经元重叠度较高，且任务间相互影响，暗示存在跨司法管辖区的法律组件神经元。

Insight: 创新点在于通过神经元归因和抑制方法系统分析了LLMs的领域特异性推理机制，揭示了通用与任务特异性神经元的共存，并指出关键神经元集中于中间MLP层的假设可能依赖于输入格式和内容，而非普遍现象。

Abstract: We presented a neuron-level analysis of legal-domain reasoning in LLMs, comparing it with other applied domain tasks across seven open-weight models. Using neuron attribution scores to rank and suppress influential neurons, we confirmed that suppressing the identified neurons collapses accuracy on the target task, whereas suppressing the same number of random neurons does not. We further found a small subset of neurons influential across all seven tasks; once these are removed, suppressing the remaining neurons degrades only the task they were identified from, revealing genuinely task-specific neurons in every model studied. Within the legal domain, the three benchmarks exhibit relatively high neuron overlap and tend to be affected jointly, suggesting of legal components neurons that span jurisdictions. The distribution of identified neurons in our experiments suggests that the hypothesis that influential neurons are concentrated in middle MLP layers may depend on the input format and content, rather than being a universal phenomenon.

[27] BALTO: Balanced Token-Level Policy Optimization for Hallucination Mitigation cs.CLPDF

Ning Li, Zixuan Guo, Yan Xu, Wenbo Fei, Yifan Niu

TL;DR: 本文提出了一种名为BALTO的平衡令牌级策略优化框架，用于缓解大语言模型在知识密集型场景中的幻觉问题。该框架通过提取可核查的事实主张、根据参考上下文进行验证，并将主张级判断投影到令牌级标签，结合平衡的令牌级信用分配机制，将概率质量从不受支持的内容重新分配给忠实内容，而非抑制整个响应。

Details

Motivation: 幻觉是部署大语言模型在知识密集型场景中的主要障碍，现有基于强化学习的缓解方法存在粒度不匹配问题，响应级的忠实度奖励会因局部幻觉而对受支持内容产生虚假惩罚，且细粒度反馈（如主张级验证和令牌级奖励）可能因信用分配不平衡而引入长度、冗余或优化噪声偏差。

Result: 在ConFiQA、RAGTruth和FinLLM-Eval基准测试上的实验表明，BALTO在所有六个模型-基准设置中实现了最高的忠实度，在Q-Score上持续优于现有的后训练基线方法，展现了更强的忠实度-信息量权衡能力。

Insight: 创新点在于提出了平衡的令牌级信用分配机制，从理论上分析了响应级奖励的局限性，并证明了BALTO在训练稳定性和优化效率上的优势；客观来看，其将主张级验证与令牌级优化相结合的设计，为解决细粒度奖励中的信用分配偏差提供了系统性的解决方案。

Abstract: Hallucinations remain a major obstacle to deploying large language models (LLMs) in knowledge-intensive settings, where generated responses must be faithfully grounded in provided evidence. Reinforcement learning (RL) is a promising direction for hallucination mitigation, but response-level faithfulness rewards suffer from a granularity mismatch: localized hallucinations can cause supported content to receive spurious penalties. Although recent work introduces fine-grained feedback such as claim-level verification and token-level rewards, unbalanced credit assignment can still induce length, verbosity, or optimization-noise biases. We propose BALTO, a Balanced Token-level Policy Optimization framework for hallucination mitigation. BALTO extracts checkable factual claims, verifies them against the reference context, and projects claim-level judgments to token-level labels. A balanced token-level credit assignment mechanism is introduced into the framework. This design redistributes probability mass from unsupported content toward faithful content, rather than suppressing the entire response. We systematically analyze the limitations of response-level rewards from a theoretical standpoint, and prove BALTO’s advantages in training stability and optimization efficiency for hallucination mitigation. Experiments on ConFiQA, RAGTruth, and FinLLM-Eval show that BALTO achieves the highest faithfulness across all six model–benchmark settings and consistently outperforms existing post-training baselines in Q-Score, demonstrating a stronger faithfulness–informativeness trade-off.

[28] Calibrated Triage, Not Autonomy: Confidence Estimation for Medical Vision-Language Models cs.CLPDF

Reza Khanmohammadi, Kundan Thind, Mohammad M. Ghassemi

TL;DR: 该论文研究了医学视觉语言模型（LVLM）在临床部署中的置信度估计问题，旨在通过可靠的置信度评分实现安全的选择性预测（即仅在置信度超过阈值时自动化处理，其余转交临床医生）。作者评估了七种置信度估计方法在五个开源LVLM和三个医学视觉问答数据集上的表现，发现标准评估指标（如区分度）指导性有限，而有效的置信度估计关键在于高置信度区域的可靠性。研究表明，当前模型更适合作为经过校准的分诊工具而非完全自主系统，其安全部署受限于基础模型能力和置信度层的有效性。

Details

Motivation: 解决医学视觉语言模型可能过度依赖语言先验而非图像内容、产生看似可信但实际错误的答案这一关键失败模式，通过可靠的置信度估计来指导系统在何时应放弃决策，确保临床部署的安全性。

Result: 在涵盖广泛临床影像、放射学和病理学的三个医学VQA数据集上评估表明，最佳探针方法能将高置信度错误率降至1-4%（最弱基线为41-45%），但没有任何估计器在所有领域或模型上始终最优；在20%错误容忍度下，经过校准的评分可在放射学中恢复约三分之一的病例，但在病理学中几乎无法恢复。

Insight: 创新点在于将部署问题重新定义为有界选择性预测，强调置信度估计的实际安全效用而非单纯准确性；客观分析表明，安全移交受基础模型能力上限和置信度层可及性的双重制约，且跨域温度缩放能廉价改善校准但不改变可部署产出，凸显了领域适应性和模型特异性校准的重要性。

Abstract: A vision-language model can answer a question about a medical image fluently and confidently while barely using the image, leaning instead on language priors. In medicine this is the failure that matters most, because the answer looks trustworthy and is not, and the only protection is a confidence score reliable enough to tell the system when to abstain. We ask a deployment question rather than an accuracy one: how much imaging work a model can safely handle alone, and which confidence signal makes that possible. We evaluate seven confidence estimators across five open-weight LVLMs and three medical visual-question-answering datasets spanning broad clinical imaging, radiology, and pathology, with every probe trained only on natural images and applied without adaptation. Recast as bounded selective prediction (automate a case only when confidence clears a threshold, defer the rest), the comparison is cautionary. The standard metrics are poor guides: discrimination barely separates the methods, and the weak calibration of a cheap self-report is cheaply removed by off-domain temperature scaling without changing deployable yield. What distinguishes a usable estimator is the high-confidence region a clinician acts on: the weakest baselines are confidently wrong on 41 to 45 percent of their errors against 1 to 4 percent for the best probe, and no estimator is reliably best across domains or models. Safe handoff is governed at two levels: base-model competence sets a ceiling, so a well-calibrated score recovers roughly a third of radiology cases at a 20 percent error tolerance but almost none of pathology; the confidence layer then decides how much of that ceiling is reachable. The usable role today is calibrated triage, not autonomy: automate the cases a calibrated score marks safe, route the rest to a clinician. We release all outputs, correctness judgments, and confidence scores, with code.

[29] Interactor: Agentic RL oriented Iterative Creation for Ad Description Generation in Sponsored Search cs.CL | cs.IRPDF

Penghui Wei, Jiayu Wu, Chao Ye, Zhi Guo, Shuanglong Li

TL;DR: 本文提出Interactor框架，一种基于智能体强化学习的多轮迭代生成方法，用于赞助搜索中的广告描述自动生成。该方法通过生成模型作为策略与包含多个生成式奖励模型的环境交互，利用奖励模型提供的多维质量评估和推理反馈迭代优化广告描述，以生成信息丰富且忠实于落地页的内容。

Details

Motivation: 解决赞助搜索中自动生成信息丰富的广告描述的问题，旨在利用世界知识满足用户搜索意图并展示广告的细粒度卖点，而传统广告标题主要优化点击反馈且文本较短。

Result: 在工业数据集上的实验表明，Interactor框架在生成知识丰富且忠实的广告描述方面显著优于现有最先进方法，并已自2026年5月起部署于领先的搜索广告系统，提升了广告收入和用户体验。

Insight: 创新点在于将广告描述生成建模为智能体强化学习过程，通过定制化生成式奖励模型提供多维评估和推理反馈来驱动迭代优化，实现了内容质量与一致性的持续改进。

Abstract: This paper focuses on automatically generating informative ad descriptions in sponsored search. Unlike ad titles which are usually optimized to attract user click feedbacks, ad descriptions have a longer text span and possess the potential of incorporating world knowledge to address user search intents while presenting the fine-grained selling points of the ads. We propose Interactor, a multi-turn iterative creation framework optimized with agentic RL for ad description generation. The generation model acts as a policy that interacts with a customized environment consisting of multiple generative reward models. Given initial generations by the policy, the customized GenRMs evaluate multi-dimensional qualities including knowledge capacity and landing page consistency, providing both binary signals and reasoning feedbacks. The policy then iteratively refines the descriptions based on such feedbacks to ensure continuous improvement. Experiments on industrial datasets show that the Interactor framework significantly outperforms state-of-the-art approaches in generating knowledge-rich and faithful ad descriptions. Since May 2026, it has been deployed online in a leading search ads system, contributing to both ad revenue and user experience.

[30] Beyond NL2Code: A Structured Survey of Multimodal Code Intelligence cs.CLPDF

Xuanle Zhao, Qiushi Sun, Jingyu Xiao, Xuexin Liu, Haoyue Yang

TL;DR: 这篇综述论文系统性地探讨了多模态代码智能领域，该领域关注于处理以视觉形式（如截图、图表、文档、视频等）为输入或输出的代码生成、编辑、执行和推理任务。论文首先根据代码在不同任务中的角色（如渲染产物、可编辑符号结构、科学表示、中间推理轨迹或可执行策略）对该领域进行了形式化定义，并将基准和方法组织为图形用户界面、科学可视化、结构化图形以及前沿任务与框架四大领域。最后，论文提出了未来以验证为中心的四个研究方向，旨在推动多模态代码生成从单一输出模仿转向基于证据的可执行系统。

Details

Motivation: 尽管大型语言模型在文本到代码合成方面取得了显著进展，但许多实际编程任务是通过视觉工件（如截图、图表、文档、视频等）来指定意图的。这些任务需要模型将视觉感知与可执行程序连接起来，因为正确性不仅取决于语法，还取决于布局、几何、数据语义、可编辑性、交互行为以及执行后适用的领域特定约束。

Result: 论文是一篇综述，未提出具体模型或报告定量结果，但系统性地梳理和分类了该领域的现有基准和方法，并构建了一个连接成熟任务与新兴智能体及统一框架的分类体系。

Insight: 论文的创新之处在于为多模态代码智能领域提供了一个清晰的结构化分类框架，根据代码的角色对任务进行形式化，并将不同领域联系起来。此外，它前瞻性地提出了四个以验证为中心的研究方向（多信号验证、多状态验证、跨任务迁移测试和可验证的智能体轨迹），为未来从模仿输出转向基于证据的可执行系统指明了路径。

Abstract: While LLMs have substantially advanced text-to-code synthesis, many real programming tasks specify intent through visual artifacts such as screenshots, charts, documents, vector drawings, videos, and interactive states. These tasks require models to connect visual perception to executable programs, because correctness depends not only on syntax but also on layout, geometry, data semantics, editability, interaction behavior, and domain-specific constraints that apply after execution. This survey examines Multimodal Code Intelligence, covering systems that generate, edit, refine, execute, or reason with code under visually grounded inputs and outputs. We first formulate the field by the role that code plays in each task, distinguishing code as a rendered artifact, an editable symbolic structure, a scientific representation, an intermediate reasoning trace, or an executable policy or tool interface. We then organize benchmarks and methods into four domains: Graphical User Interface, Scientific Visualization, Structured Graphics, and Frontier Tasks and Frameworks. This taxonomy connects mature artifact-generation problems to emerging agentic and unified settings and allows us to compare how different tasks treat evidence of correctness. Looking ahead, we argue that future research may benefit from four verification-centered directions. Multi-signal validation can combine complementary evidence of correctness, multi-state verification can test behavior across execution trajectories, cross-task transfer testing can probe reusable visual-code skills, and verifiable agent traces can reveal whether agent actions are grounded in visual evidence. Together, these directions may move multimodal code generation from single-output imitation toward evidence-grounded executable systems.

[31] SAG: SQL-Retrieval Augmented Generation with Query-Time Dynamic Hyperedges cs.CLPDF

Yuchao Wu, Junqin Li, XingCheng Liang, Yongjie Chen, Yinghao Liang

TL;DR: 本文提出了SAG（SQL-Retrieval Augmented Generation），一种用于检索增强生成（RAG）的结构化架构。该方法将文本块转换为语义完整的事件和索引实体，并在查询时使用SQL连接查询动态构建局部超边，从而形成一个动态实例化的局部索引结构。SAG避免了构建和维护全局知识图谱的开销，支持增量写入和并发处理，并在多个多跳推理基准测试中取得了最佳性能。

Details

Motivation: 现有基于密集相似性检索的RAG方法在处理结构化约束和多跳推理方面存在固有局限，而引入知识图谱又会带来语义碎片化、维护成本高和难以增量更新等问题。SAG旨在通过动态的、基于数据库的结构化检索来解决这些挑战。

Result: 在HotpotQA、2WikiMultiHop和MuSiQue这三个标准多跳推理基准测试中，SAG在9个Recall@K指标中的8个上取得了最佳结果，其中在要求最高的MuSiQue上达到了80.0%的Recall@5。系统已在生产环境中部署，处理数亿数据项，在线检索延迟保持在秒级。

Insight: 核心创新在于摒弃预构建全局静态图，转而采用查询时动态构建局部超边（hyperedges）的架构。这通过将文本块建模为事件和实体，并利用标准数据库的SQL连接能力实现，从而在保持语义完整性的同时，获得了可扩展性、低维护成本和高效的增量更新能力。

Abstract: Retrieval-Augmented Generation (RAG) offers an effective approach for large language models to access external knowledge. However, existing methods rely on dense similarity retrieval and face inherent limitations in handling structured constraints and multi-hop reasoning. Incorporating knowledge graphs partially alleviates these issues, but at the cost of semantic fragmentation, high maintenance overhead, and difficult incremental updates. This paper introduces SAG (SQLRetrieval Augmented Generation), a structured architecture for retrieval and agent systems. Instead of pre-building a global static graph, SAG converts each chunk into one semantically complete event and a set of indexing entities, then uses SQL join queries to dynamically link events that share entities into local hyperedges,constructing, at query time, a dynamically instantiated local index structure. This design avoids the need for global graph rebuilding and ongoing maintenance; the system naturally supports incremental writes, concurrent processing, and continuous scaling through its reliance on standard database infrastructure. Across HotpotQA, 2WikiMultiHop, and MuSiQue, three standard multi-hop benchmarks,SAG achieves the best results on 8 out of 9 Recall@K metrics, reaching 80.0% Recall@5 on MuSiQue, the benchmark with the highest multi-hop reasoning demands.SAG has also been deployed at a production scale of hundreds of millions of data items, with online retrieval latency kept within seconds. Project site and code are available at https://github.com/Zleap-AI/SAG-Benchmark.

[32] Formalize Once, Edit the Rest: Efficient Lean-Based Answer Selection for Math Reasoning cs.CL | cs.AI | cs.LGPDF

Ji Feng, Zhouxing Shi

TL;DR: 本文提出了一种名为BASE的高效数学推理答案选择方法，通过“一次形式化、多次编辑”的流程，利用Lean证明助手验证大语言模型生成的候选答案。该方法训练了一个名为LEANSCRIBE的重写模型，能够定位基础形式化中的答案表达式并生成可复用的编辑函数，从而显著减少形式化调用次数并提高选择准确率。

Details

Motivation: 现有基于Lean的答案选择方法需要为每个候选答案独立生成形式化语句，计算成本高昂。本文旨在通过共享形式化过程，降低形式化开销，同时提升答案选择的准确性。

Result: 在四个基准测试和三个求解器的12种配置上，BASE均实现了帕累托改进，在K=8时将形式化调用次数减少了约5倍，且随着K增大，减少效果更显著。

Insight: 创新点在于提出了基础-编辑流水线，将形式化过程从每个候选答案独立进行改为共享基础形式化并编辑答案表达式，这为基于形式化验证的答案选择提供了高效且可扩展的解决方案。

Abstract: With large language models (LLMs) increasingly applied to mathematical reasoning, formal proof assistants such as Lean can be leveraged to verify reasoning outputs with machine-checkable rigor, enabling use cases such as answer selection in test-time scaling with K sampled candidate answers. However, employing Lean requires that LLM outputs, originally in natural language, first be formalized. Existing Lean-based answer-selection work uses an autoformalization model to generate a formal statement in Lean for each candidate answer independently, incurring a significant computational cost. We propose BASE, a base-and-edit pipeline that formalizes a single base candidate per problem and derives the remaining K-1 statements by editing the answer expression in place. To facilitate this, we train a rewriter model LEANSCRIBE to localize the answer in the base formalization and generate a reusable edit function for the other K-1 candidates. BASE simultaneously improves selection accuracy and reduces formalization cost - a Pareto improvement that holds on all 12 (dataset, solver) configurations across four benchmarks and three solvers, cutting autoformalizer calls by about 5x at K=8, with the reduction expected to become larger as K grows. Code is available at https://github.com/ucr-rai/base-and-edit.

[33] A Large-Scale Multi-Dimensional Empirical Study of LLMs for Conversation Summarization cs.CLPDF

Weixiao Zhou, Gengyao Li, Xianfu Cheng, Junnan Zhu, Feifei Zhai

TL;DR: 本文提出了OmniCSEval基准，用于全面评估大语言模型在对话摘要任务上的性能。该基准包含1800个跨6个真实场景、上下文长度从128到32K token的多样化对话。研究采用双向事实核查框架进行细粒度评估，并对28个按推理能力和模型规模分类的LLM进行了大规模实证分析。

Details

Motivation: 现有对话摘要评估存在场景单一、输入长度和样本量不足、缺乏对前沿推理系统和高效小模型的评估，以及缺少细粒度多维度评估等问题。

Result: 研究对28个LLM进行了评估，揭示了当前模型面临的跨场景挑战、推理能力和模型规模的影响，以及推理模型的效率和适应性。

Insight: 创新点在于提出了一个统一、大规模、多维度（场景、长度）的评估基准OmniCSEval，并设计了一个结合关键事实匹配（评估完整性和简洁性）与摘要事实核查（评估忠实性）的双向事实核查框架。同时，建立了人机协作的关键事实提取流程和多LLM共识核查器，确保了评估的可靠性。

Abstract: Despite the significant advancement of LLMs in conversation summarization, their evaluation remains limited by insufficient scenarios, input lengths, and sample sizes. Furthermore, existing benchmarks often omit frontier reasoning systems and efficient small models, or lack fine-grained, multi-dimensional assessments. To bridge these gaps, we propose OmniCSEval, a unified benchmark comprising 1,800 diverse conversations across six real-world scenarios, featuring context lengths ranging from 128 to 32k tokens. For fine-grained evaluation, we employ a bidirectional fact-checking framework that integrates key fact matching to assess completeness and conciseness, alongside summary fact verification to evaluate faithfulness. To ensure reliable assessment, we establish a human-LLM collaborative pipeline for key fact extraction and a multi-LLM consensus verifier for summary fact decomposition. Leveraging this framework, we evaluate 28 LLMs across four distinct categories grouped by reasoning capability and model scale. Our extensive empirical study reveals critical insights regarding the cross-scenario challenges current LLMs continue to face, the impacts of reasoning and scale, and the efficiency and adaptability of reasoning models. We also provide guidance for system selection in real-world deployments.

[34] Bridging the Usability Gap: Lessons from Interpreting Studies for Machine Interpreting Design cs.CL | cs.HCPDF

Claudio Fantinuoli

TL;DR: 本文指出机器口译（MI）虽然在标准基准测试中取得了显著进展，但在用户体验上仍远逊于人工口译，存在’准确性幻觉’问题。论文将MI定义为语音翻译的一个独特子领域，强调需要基于沟通有效性而非孤立保真度指标的评价方法。借鉴口译研究，作者提出了未来MI系统的三个相互依赖的设计重点：能动性、情境化和体验，以弥合可用性差距。

Details

Motivation: 解决机器口译系统在标准基准测试中表现优异，但在实际交互中用户体验不佳的问题，即’准确性幻觉’，旨在弥合系统性能与真实沟通需求之间的可用性差距。

Result: 论文未在摘要中提供具体的定量实验结果或基准测试排名，而是提出了一个概念框架和设计重点。

Insight: 创新点在于将机器口译明确定义为一个需要独特评价范式的子领域，并借鉴口译研究，系统性地提出了’能动性’、’情境化’和’体验’这三个核心设计维度，为构建真正支持实时、流畅多语言沟通的系统提供了理论指导。

Abstract: Machine interpreting (MI), the live, real-time branch of speech translation, has achieved remarkable progress on standard benchmarks, with some systems approaching human parity on textual fidelity. Yet the user experience remains far inferior to interpreter-mediated communication, revealing what we term the \emph{accuracy illusion}: systems that appear accurate on paper but fail in practice to support smooth, goal-oriented interaction. This paper defines MI as a distinct subfield of speech translation, with its own characteristics and the need for evaluation methods grounded in communicative effectiveness rather than isolated fidelity metrics. Drawing on insights from interpreting studies, we identify critical dimensions of professional interpreting practice that are overlooked by current systems, and consolidate them into three interdependent design priorities for future MI: \emph{agency} (context-sensitive initiative and repair), \emph{grounding} (multimodal and discourse-level situational awareness), and \emph{experience} (adaptive improvement through real interaction). Together, these priorities chart a path toward closing the usability gap and enabling systems that can sustain authentic multilingual communication in real time.

[35] Scaling Human and G2P Supervision for Robust Phonetic Transcription cs.CL | cs.LG | cs.SDPDF

Alexander Metzger, Aruna Srivastava, Ruslan Mukhamedvaleev

TL;DR: 本文研究了在英语语音转录任务中，人类专家标注与G2P（字素到音素）自动标注两种监督方式的扩展性。研究发现，当人类标注数据少于20-30小时时，G2P监督能提升性能；超过此阈值后，G2P监督不仅无显著益处，还可能损害跨方言的鲁棒性。在超过阈值后，采用ASR预训练能显著降低音素特征错误率，在非母语和失语症语音上取得强劲提升。

Details

Motivation: 专家语音标注成本高昂，尤其对于非标准方言和非典型语音（如失语症语音）。研究旨在探索如何有效结合人类标注与G2P自动标注来扩展语音转录系统，并评估其对鲁棒性的影响。

Result: 在一个包含母语、非母语和中风后语音的80小时基准测试上，当人类标注超过20-30小时后，G2P监督无显著益处。采用ASR预训练后，加权音素特征错误率比先前系统降低了2.3倍，在非母语和失语症语音上表现强劲。

Insight: 研究揭示了监督质量的阈值效应：G2P扩展在数据量较小时有效，但超过阈值后，单纯增加G2P数据可能带来收益递减，甚至损害鲁棒性。创新性地指出ASR预训练是超越阈值后更有效的策略，为构建鲁棒语音系统提供了数据策略上的重要洞见。

Abstract: Expert phonetic annotation is costly, especially for non-standard dialects and atypical speech. A common alternative is using Grapheme-to-Phoneme (G2P) models to auto-generate phonetic labels from text transcripts at scale. We study how automatic phonetic transcription performance scales with human and G2P supervision in English. Using a curated 80-hour benchmark spanning native, non-native and post-stroke speech, we identify a supervision quality threshold: G2P supervision helps only when fewer than 20-30 hours of human annotation are available. Beyond this threshold, it provides no significant benefit and can reduce cross-dialect robustness. What is effective after this threshold is ASR pretraining which we use to achieve a 2.3x reduction in weighted phone feature error rate over prior systems, with strong gains on non-native and aphasic speech. These results suggest that quantity-driven G2P scaling may yield diminishing returns for robust generalization.

[36] From Argument Components to Graphs: A Multi-Agent Debate with Confidence Gating for Argument Relations cs.CLPDF

Jakub Bąba, Jarosław A. Chudziak

TL;DR: 本文提出了一种基于多智能体辩论与置信度门控的框架，用于论证关系识别与分类任务。该方法通过引入支持者-反对者-裁判架构对不确定的论证对进行选择性辩论，避免了对所有样本进行辩论导致的性能下降，并在UKP Argument Annotated Essays v2语料库上取得了训练无关方法中最高的Macro F1分数。

Details

Motivation: 针对大型语言模型在论证挖掘中难以处理文本间复杂关系、自我纠正机制易强化初始幻觉的问题，以及领域特定监督微调成本高昂的局限性，研究旨在探索无需训练的多智能体辩论方法以提升论证关系分析的精度。

Result: 在UKP Argument Annotated Essays v2语料库上，选择性辩论框架的Macro F1分数超越了所有训练无关方法，且所有生成式方法均优于微调的RoBERTa模型，表明该方法对攻击类样本不足的问题更具鲁棒性。

Insight: 创新点包括将多智能体辩论扩展至论证关系分类任务，并引入置信度门控机制实现高效选择性辩论；同时，框架生成的可读辩论记录提供了单智能体与监督分类器缺乏的可解释性。

Abstract: Large Language Models (LLMs) are increasingly assessed and utilized in the field of Argument Mining (AM), thanks to their strong general reasoning capabilities. However, standard training-free models often miss sophisticated details, specifically in contexts where two parts of the text have to be analyzed together. Furthermore, self-correction mechanisms tend to reinforce initial hallucinations in reasoning. Overcoming these limitations typically requires expensive, domain-specific supervised fine-tuning. Recent work has shown that a multi-agent paradigm can address such weaknesses for the component classification task through dialectical refinement with a Proponent-Opponent-Judge architecture, setting a promising direction for training-free approaches in the field. In this paper, we extend and evaluate this framework on the Argument Relation Identification and Classification (ARIC) task, reformulating it as a debate over component pairs. Besides that, we introduce a confidence gating mechanism that enables debating only on the uncertain cases and accepting the initial prediction when confidence is high. On the UKP Argument Annotated Essays v2 corpus, we demonstrate that the selective debate achieves the highest Macro F1 among all training-free methods, while debate over all samples degrades performance below that of one of the baselines. All generative approaches also outperform fine-tuned RoBERTa models on Macro F1, suggesting that the under-representation of the Attack class was more damaging to supervised fine-tuning than to inference-only models. Additionally, our framework produces human-readable debate transcripts, offering interpretability absent from both single-agent and supervised classifiers.

[37] Towards Pareto-Optimal Tool-Integrated Agents with Pareto Ranking Policy Optimization cs.CLPDF

Junyi Li, Xiaowei Qian, Yingyi Zhang, Wenlin Zhang, Guojing Li

TL;DR: 本文提出了ParetoPO，一个两阶段多目标优化框架，用于在竞争性目标下对齐使用工具的大语言模型（LLMs）。该框架通过超体积引导的动态标量化调整奖励权重，并采用基于帕累托排序的优势计算来促进非支配轨迹，从而在数学推理和多跳问答任务上实现了比静态和启发式基线更优的准确性与效率权衡策略。

Details

Motivation: 现有工具集成语言智能体的对齐方法主要关注最大化任务准确性，而忽视了工具使用效率等对实际部署至关重要的辅助目标，ParetoPO旨在解决这一多目标权衡的优化问题。

Result: 在数学推理和多跳问答任务上的实验结果表明，ParetoPO相比静态和启发式基线，能够持续发现具有更优准确性-效率权衡的策略。

Insight: 创新点在于提出了一个两阶段框架，结合了超体积引导的动态奖励权重调整和基于帕累托排序的优势计算，实现了在多个冲突目标下细粒度的、动作级别的优化，为多目标对齐提供了新思路。

Abstract: Recent advances in tool-integrated language agents have significantly improved their ability to solve complex reasoning tasks. However, existing alignment methods predominantly focus on maximizing task accuracy, while overlooking auxiliary objectives such as tool-use efficiency, which are essential for practical deployment. To address this gap, we introduce ParetoPO, a two-stage multi-objective optimization framework for aligning tool-using large language models (LLMs) under competing objectives. In the first stage, ParetoPO leverages hypervolume-guided dynamic scalarization to adapt reward weights based on global Pareto frontier progress. In the second stage, it replaces scalarized learning signals with Pareto-ranking-based advantage computation, promoting nondominated trajectories through dominance-aware credit assignment. This design enables fine-grained, action-level optimization across multiple conflicting objectives. Experimental results on mathematic reasoning and multi-hop QA tasks show that ParetoPO consistently discovers policies with superior accuracy-efficiency trade-offs compared to static and heuristic baselines.

[38] XAI-Grounded Explanation Generation for Speech Deepfake Detection with Training-Free Multimodal Large Language Models cs.CL | cs.AIPDF

Yupei Li, Qiyang Sun, Xiaoliang Wu, Chenxi Wang, Berrak Sisman

TL;DR: 本文提出了一种无需训练的解释框架，将可解释人工智能（XAI）证据与多模态大语言模型（MLLM）相结合，为语音深度伪造检测（SDD）任务生成有依据且具体的自然语言解释。该方法利用PartialSpoof数据集构建了有依据的解释数据集，并通过人工评估和忠实度检验验证了其有效性。

Details

Motivation: 现有SDD系统的解释方法存在不足：传统XAI方法（如基于梯度的归因）产生的低级信号难以被人理解；而基于LLM的解释生成由于缺乏启发式证据和任务特定监督，往往产生通用且无依据的描述。

Result: 在PartialSpoof数据集上，结合XAI证据的方法将内部准确性提高了超过45%，并通过人工评估和忠实度检验得到了验证。

Insight: 创新点在于提出了一种无需训练、将XAI的模型决策证据与MLLM的自然语言生成能力相结合的框架，以生成有依据、可理解且与任务相关的解释，这为解决SDD领域缺乏有依据解释数据集的问题提供了新思路。

Abstract: Speech deepfake detection (SDD) systems require trustworthy explanations for reliable decision-making. Existing explanation ways mainly fall into two categories. Traditional explainable AI (XAI), such as gradient-based attribution, produces low-level attribution signals tightly coupled with model decisions, and harder to be understood by human than natural language explanations. Meanwhile, large language model (LLM)-based explanation generation often produces generic and ungrounded descriptions due to the lack of heuristic evidence and task-specific supervision, stemming from limited grounded explanation datasets for SDD. We therefore propose a training-free explanation framework that integrates XAI evidence with multimodal LLMs to generate grounded and specific explanations. Using the PartialSpoof dataset, we construct a grounded explanation dataset and show that methods with XAI increase inside accuracy by over 45%, verified through human evaluation and faithfulness checks.

[39] GRACE: Step-Level Benchmark for Faithful Reasoning over Context cs.CLPDF

Hoang Pham, Dong Le, Anh Tuan Luu

TL;DR: 论文提出了GRACE，这是首个针对上下文文本推理的步骤级忠实性基准，包含人工标注的推理链错误分类体系。该基准覆盖了10个模型在4个源数据集上的CoT轨迹，每个步骤都标注了忠实性、错误类别和自然语言解释。实验表明当前模型在忠实推理方面仍有很大提升空间，并将步骤级忠实信号集成到强化学习流程中，提高了下游任务的准确性和推理可靠性。

Details

Motivation: 现有方法只能在响应层面检测幻觉，无法定位推理链中错误发生的位置和类型，因此需要建立一个步骤级的忠实性基准来评估和改善模型在上下文推理中的可靠性。

Result: 在GRACE基准上，当前模型表现出显著的提升空间；将步骤级忠实信号集成到强化学习流程中，能够同时提升下游任务的准确性和推理可靠性。

Insight: 创新点在于构建了首个步骤级忠实性基准，并通过无监督聚类自底向上发现数据驱动的错误分类体系，将错误分为推理和事实接地两个轨道，每个轨道包含四类错误，为模型推理的透明度和可靠性评估提供了新工具。

Abstract: Many reasoning tasks require models to reason over input context, from document-grounded question answering to rule-based deduction. Chain-of-Thought (CoT) prompting produces traces that appear transparent, yet individual steps can silently deviate from the source evidence, even when the final answer is correct. Existing methods detect hallucinations at the response level but fail to identify where in the chain a failure occurs or what type it is. We introduce GRACE, the first human-annotated step-level faithfulness benchmark with a data-driven error taxonomy for context-grounded textual reasoning. GRACE covers CoT traces from 10 models across 4 source datasets, with each step annotated for faithfulness, error category, and natural language explanation. A data-driven taxonomy, discovered bottom-up via unsupervised clustering, organizes failures into two tracks: GRACE-Inference (deductive errors) and GRACE-Grounding (factual grounding errors), with four categories each. The evaluation set is human-annotated and challenging by design. Our experiments reveal substantial headroom for current models. In addition, integrating step-level faithfulness signals into reinforcement learning pipelines improves both downstream accuracy and reasoning reliability.

[40] Weaving Multi-Source Evidence for Biomedical Reasoning: The BioMedHop Benchmark and BioWeave Framework cs.CLPDF

Xingyu Tan, Shiyuan Liu, Xiaoyang Wang, Qing Liu, Xiwei Xu

TL;DR: 本文提出了BioMedHop基准测试和BioWeave框架，用于评估和提升生物医学多源问答中的推理能力。BioMedHop是一个基于图的多源基准，包含超过一万个实例，覆盖知识图谱、文献和网络等多种证据源及多种推理任务。BioWeave框架则通过检索、整合多源证据构建统一证据图并进行验证，以支持复杂推理。

Details

Motivation: 现有生物医学问答基准主要关注考试知识、文献理解或短程多跳推理，缺乏对源条件图推理和证据拓扑构建的深入探索。本文旨在填补这一空白，解决在分散的多源证据上进行复杂推理的挑战。

Result: 在BioMedHop基准测试上，BioWeave在整体平均表现上优于强混合基线ToG-2达10.5%，取得了最佳综合性能。此外，BioWeave能持续提升不同LLM骨干的性能，并使较小模型（如Qwen3-4B）达到与GPT-4-Turbo相当的推理水平。

Insight: 创新点在于提出了首个专注于多源图证据拓扑构建与推理的生物医学基准BioMedHop，以及配套的源感知推理框架BioWeave，该框架通过构建统一证据图来整合和验证多源证据，有效提升了复杂推理能力，并展示了良好的模型泛化性。

Abstract: Biomedical question answering (QA) increasingly requires reasoning over interacting entities, where supporting evidence is scattered across biomedical knowledge graphs, literature documents, and web-accessible resources. However, existing biomedical QA benchmarks mainly focus on exam-style knowledge, literature comprehension, or short-range multi-hop inference, leaving source-conditioned graph reasoning and evidence topology construction underexplored. To fill this gap, we introduce BioMedHop, a multi-source graph-grounded benchmark for evaluating biomedical reasoning over structured evidence topologies. BioMedHop contains 10,045 instances across KG, document, web, and hybrid evidence settings, covering shared-neighbor matching, intersection reasoning, path-based reasoning, and counting, with option-based, open-ended, and numeric count renderings. To support this benchmark, we further propose BioWeave, a source-aware reasoning framework that retrieves biomedical KG paths, gathers supporting clues from documents and web sources, assembles them into a unified evidence graph, and verifies answers through entity-level evidence support. Comprehensive experiments show that BioWeave achieves the best overall performance among compared methods on BioMedHop, outperforming the strong hybrid baseline ToG-2 by 10.5% in the overall average. Moreover, BioWeave consistently improves different LLM backbones and enables smaller models, such as Qwen3-4B, to achieve reasoning performance comparable to GPT-4-Turbo.

[41] Who Should Lead Decoding Now? Tracking Reliable Trajectories for Ensembling Masked Diffusion Language Models cs.CL | cs.AIPDF

Heecheol Yun, Joonhyung Park, Joowon Kim, Eunho Yang

TL;DR: 本文提出了一种基于轨迹的迭代集成方法TIE，用于融合多个掩码扩散语言模型的知识。该方法通过跟踪解码过程中答案相关位置的置信度动态，识别可靠的生成轨迹，并在模型间选择性传递部分去噪序列，从而利用不同模型在不同生成阶段的互补优势。

Details

Motivation: 随着掩码扩散语言模型在能力和知识覆盖上日益多样化，如何有效融合它们的知识成为一个重要问题。本文旨在探索MDLMs独特的解码动态，并设计一种集成框架来提升生成质量。

Result: 在多种推理任务上，TIE方法表现出强大的性能，分析表明它为MDLM集成这一尚未充分探索的问题提供了实用解决方案。

Insight: 创新点在于利用解码轨迹的置信度动态来指导模型间的知识传递，允许不同模型在生成的不同阶段贡献其优势，从而实现动态、迭代的集成策略。

Abstract: Masked Diffusion Language Models (MDLMs) have emerged as a distinct paradigm for sequence generation. As MDLMs become diverse in capabilities and knowledge coverage, an important question is how to combine their knowledge. Toward this, we first investigate the unique decoding dynamics of MDLMs. We find that successful generations exhibit stable confidence dynamics over answer-relevant positions, while unreliable trajectories can often be corrected by injecting promising intermediate states from other models. Guided by this observation, we propose $\textbf{TIE}$ ($\textbf{T}$rajectory-based $\textbf{I}$terative $\textbf{E}$nsembling), a knowledge fusion framework in which MDLMs iteratively identify reliable decoding trajectories and relay them across models. TIE tracks confidence dynamics over answer-relevant positions to determine which model currently follows a more reliable trajectory and selectively transfers partially denoised sequences across models. As the model on the more promising trajectory often changes across denoising steps, TIE allows different models to contribute complementary strengths at different stages of generation. Strong performance across diverse reasoning tasks, along with our analyses, suggests that TIE offers a practical approach to the underexplored problem of MDLM ensembling.

[42] PACT: Privileged Trace Co-Training for Multi-Turn Tool-Use Agents cs.CL | cs.AI | cs.LGPDF

Zhenbang Du, Jun Luo, Zhiwei Zheng, Xiangchi Yuan, Kejing Xia

TL;DR: 论文提出PACT框架，通过特权轨迹协同训练优化多轮工具使用智能体，在保持仅提示生成的同时，利用专家轨迹提供训练时优化信号，包括轨迹条件强化学习代理和组件感知监督微调损失，有效解决了稀疏奖励和轨迹过约束问题。

Details

Motivation: 针对多轮工具使用智能体训练中，强化学习面临稀疏奖励和弱信用分配，而监督微调又可能过度约束模型固定轨迹的问题，旨在探索更有效的训练方法。

Result: 在FTRL、BFCL和ToolHop基准测试中，PACT持续优于基于监督微调和强化学习的强基线，证明了特权轨迹协同训练的价值。

Insight: 创新点在于将专家轨迹仅用作训练时优化信号而非生成时提示，通过轨迹条件RL代理和组件感知SFT损失协同指导优化，并引入仅提示锚定减少对训练专用轨迹上下文的依赖，提供了潜在的轨迹视图来统一目标。

Abstract: Multi-turn tool-use agents must reason, call tools, and adapt to observations across several interaction turns. Post-training such agents is challenging, as reinforcement learning often suffers from sparse rewards and weak credit assignment despite matching the prompt-only inference setting, while supervised fine-tuning on expert traces provides dense process supervision but can over-constrain the model to fixed trajectories. To tackle this, we propose PACT, a Privileged trAce Co-Training framework for multi-turn tool-use agents. The key idea is to use expert traces only as training-time optimization signals rather than rollout-time hints. PACT keeps rollout generation prompt-only, then uses expert traces to guide optimization through two complementary signals: a trace-conditioned RL surrogate that evaluates prompt-only rollouts under expert-trace context, and a component-aware SFT loss that supervises reasoning prefixes and tool-calls with annealed strength. To reduce over-reliance on the training-only trace context, PACT further introduces a prompt-only anchoring. We also provide a latent-trace view that connects the two trace-based objectives and explains how expert traces can guide optimization without being used during rollout generation. Experiments on FTRL, BFCL, and ToolHop show that PACT consistently improves over strong SFT- and RL-based baselines, highlighting the value of privileged trace co-training for multi-turn tool-use learning.

[43] HiMPO: Hindsight-Informed Memory Policy Optimization for Less-Entangled Credit in Long-Horizon Agents cs.CL | cs.LGPDF

Jiangze Yan, Yi Shen, Wenjing Zhang, Jieyun Huang, Zhaoxiang Liu

TL;DR: 本文提出了HiMPO（Hindsight-Informed Memory Policy Optimization）框架，旨在解决长视野智能体中记忆写入动作的信用分配纠缠问题。该框架通过估计记忆更新的局部效用，并结合事后相关性作为回顾性过滤器，为记忆令牌分配更少纠缠的信用，从而优化记忆策略。

Details

Motivation: 长视野智能体依赖记忆机制压缩交互历史，但优化记忆写入面临独特的信用分配挑战：记忆更新可能因下游工具故障、噪声观察或推理错误而受到奖励或惩罚，而非其自身贡献。这种因果纠缠的信用会导致智能体丢弃有用证据或保留无关信息。

Result: 在基于判断的开放域任务和客观压缩记忆问答任务中，HiMPO优于基于记忆和强化学习的强基线方法，同时保持了压缩上下文的效率。受控干预进一步表明，HiMPO减少了工具引发错误的归责泄漏，并提高了记忆更新的归因保真度。

Insight: 创新点在于提出了一种事后信息辅助的记忆策略优化框架，通过分离评估记忆更新的局部效用与任务全局结果，为记忆写入动作分配更少纠缠的信用。这有助于智能体更准确地归因记忆更新的价值，避免因下游无关因素而错误调整记忆策略。

Abstract: Long-horizon agents rely on memory mechanisms to compress interaction history, but optimizing memory writing faces a distinct credit assignment challenge: a memory update may be rewarded or penalized due to downstream tool failures, noisy observations, or reasoning errors rather than its own contribution. This causally entangled credit can lead agents to discard useful evidence or preserve irrelevant information. We propose HiMPO, a Hindsight-Informed Memory Policy Optimization framework for assigning less-entangled credit to memory-writing actions in long-horizon agents. HiMPO first estimates the local utility of a memory update by comparing the task-relevant information recoverable from the previous and updated memories under the same pre-write state. It then uses hindsight relevance as a bounded retrospective filter that attenuates memory credit when local utility is not supported by the target outcome. The resulting memory-specific advantage is applied only to memory tokens, while trajectory-level rewards optimize the rest of the agent behavior. Across judge-based open-domain tasks and objective compressive-memory QA, HiMPO improves over strong memory-based and RL-based baselines while preserving compressed-context efficiency. Controlled interventions further show that HiMPO reduces blame leakage from tool-induced errors and improves attribution fidelity of memory updates.

[44] PaperJury: Due-Process Review for Bounded LaTeX Revision cs.CLPDF

Yiran Wang, Ruixuan An, Biao Wu, Wenhao Wang

TL;DR: 本文提出了PaperJury系统，这是一个为人类撰写的LaTeX计算机科学论文提供预提交前‘硬化’处理的闭环系统。该系统通过确定性与语义组件的分离，实现了对抗性的全文评审、明确的‘无需修复’结果以及有界的、不破坏原稿的修订。它结合了有界整体评审、基于可争议性的路由、正当程序‘审判’以及风险比例防护链，最终产生无效丢弃、有效可修复和需要作者介入三种确定结果。

Details

Motivation: 现有写作助手、批评生成器和以评判为中心的循环系统缺乏跨轮次的持久问题标识、从批评到裁决的确定性路由，以及能够拒绝无效关切或推迟作者依赖问题的稿件控制机制。论文旨在解决预提交论文‘硬化’过程中对对抗性评审、确定性流程和有界安全修订的需求。

Result: 在一项针对保留的视觉、自然语言处理和机器学习论文的双臂专家评审评估中，与四个基线方法相比，论文评估了问题质量、裁决与路由质量、编辑安全性、收敛行为和成本。结果支持了核心论点：承载安全性和完成逻辑应置于确定性编排中，而非模型自行决定。

Insight: 主要创新点在于提出了一个确定性与语义分离的架构：确定性编排负责管理分解、冻结的声明主干、持久账本、路由、停止和一次性补丁应用，而语义代理仅被限制于有界的评审、判断和修复。这种设计确保了流程的可靠性、可审计性和安全性，为自动化论文评审与修订提供了新的系统框架。

Abstract: Pre-submission hardening of human-authored LaTeX computer science papers differs from drafting assistance because it requires adversarial whole-paper review, explicit no-fix outcomes, and bounded artifact-safe revision. Existing writing assistants, critique generators, and judge-centered loops lack durable issue identity across rounds, deterministic routing from critique to adjudication, and manuscript control that can reject invalid concerns or defer author-dependent ones. We present PaperJury, a closed-loop review-verdict-revise-verify system built on a deterministic-versus-semantic split: deterministic orchestration manages decomposition, a frozen claim spine, a durable ledger, routing, stopping, and exact-once patch application, while semantic agents are limited to bounded review, judgment, and repair. PaperJury combines bounded holistic review, contestability-based routing, a due-process trial, and risk-proportional guard chains for anchor-bounded edits, yielding terminal outcomes of invalid-drop, valid-fixable, and author-required. In a two-arm expert-review evaluation on held-out Vision, natural language processing, and machine learning papers against four baselines, we assess issue quality, verdict and routing quality, edit safety, convergence behavior, and cost, supporting the thesis that load-bearing safety and completion logic should reside in deterministic orchestration rather than model discretion. PaperJury is available at https://github.com/u7079256/paperjury.

[45] Tyler: Typed Latent Reasoning for Language Models – When to Think, What to Compute, and How Much to Allocate cs.CL | cs.AIPDF

Hanyu Lin, Min Cai, Jiawei Wen, Haodi Zhang

TL;DR: 本文提出了Tyler（Typed Latent Reasoning）框架，旨在解决大语言模型推理中链式思考提示法（CoT）因文本化中间计算而产生的冗余和开销问题。该框架通过在自回归解码过程中学习一个策略，动态决定何时、以何种类型、分配多少计算预算来调用专门的潜在计算模块，从而将部分计算转移到连续表示中进行。

Details

Motivation: 现有潜在推理方法通常预先定义何时调用潜在计算以及如何分配计算资源，未能解决在解码过程中动态决定何时调用、执行何种计算类型以及分配多少预算的关键问题。

Result: 在三个骨干大语言模型上进行的大量实验表明，Tyler在准确性上比CoT提示法提升了高达14.49个百分点，比最强的竞争基线提升了高达4.30个百分点。它还能泛化到不同的推理领域，并在最终阶段取得了最佳性能，同时遗忘率最低。

Insight: 论文的核心创新在于提出了一个类型化和预算感知的潜在推理框架，该框架通过一个学习到的策略，在解码步骤中动态地在生成文本令牌和调用特定推理功能的潜在计算模块之间进行选择，实现了更高效、更灵活的推理过程。

Abstract: Chain-of-thought (CoT) prompting improves reasoning in large language models (LLMs) by externalizing intermediate computation as discrete text tokens, but this textual interface also introduces redundancy and inference overhead. Latent reasoning offers a promising alternative by carrying part of the computation in continuous representations. However, existing methods typically predefine when latent computation is invoked and how it is allocated during decoding, leaving a key problem unresolved: when to invoke latent computation, what type of computation to perform, and how much budget to allocate. We propose \textbf{Ty}ped \textbf{L}at\textbf{e}nt \textbf{R}easoning (Tyler), a typed and budget-aware framework for latent reasoning during autoregressive decoding. Tyler learns a policy that, at each decoding step, chooses between emitting a text token and switching to a latent computation module specialized for a particular reasoning function. Once invoked, an operator maps the current reasoning state into latent tokens that support global planning, local state updates, or reusable procedural abstraction. Across extensive experiments on three backbone LLMs, Tyler improves accuracy by up to 14.49 points over CoT and by up to 4.30 points over the strongest competing baseline. It further generalizes across diverse reasoning domains and achieves the best final-stage performance with the lowest forgetting.

[46] TMASC: Transmasculine Attitude and Speech Corpus cs.CLPDF

Sidney Wong

TL;DR: 本文介绍了跨性别男性态度与语音语料库（TMASC），这是一个包含196名跨性别男性个体的多模态语料库，涵盖问卷回答和66段音频录音。论文概述了语料库的构建和数据收集流程，并通过三个案例研究展示了该众包多模态语料库如何用于支持跨性别男性群体，包括整合感知与声学数据、识别群体层面特征以及校准声学测量。

Details

Motivation: 旨在构建一个专门针对跨性别男性群体的多模态语料库，以探索其嗓音健康问题，并为相关研究提供数据支持。

Result: 论文未提及具体的定量实验结果或基准测试，而是通过三个案例研究（整合感知与声学数据、群体特征识别、声学测量校准）定性展示了语料库的实用性。

Insight: 创新点在于创建了首个专注于跨性别男性群体的多模态语料库，结合问卷与音频数据，并通过案例研究展示了其在支持该群体方面的应用潜力，为语音健康与身份研究提供了新的数据资源。

Abstract: We introduce the Transmasculine Attitudes and Speech Corpus (TMASC), a multimodal corpus of 196 transmasculine individuals, including questionnaire responses and 66 audio recordings. The questionnaire includes items exploring the vocal health of transmasculine individuals. The audio recordings include cough and throat-clearing samples, a reading passage, and additional session-specific questions. This paper outlines the development of this corpus and the data collection procedures. To illustrate the utility of this corpus, we present three case studies demonstrating how this crowd-sourced multimodal corpus can be used to support transmasculine individuals. These include the integration of perceptual and acoustic data, the identification of group-level characteristics, and the calibration of acoustic measurements.

[47] A Mechanistic Understanding of Pronoun Fidelity in LLMs cs.CL | cs.LGPDF

Katharina Trinley, Jesujoba O. Alabi, Dietrich Klakow, Vagrant Gautam

TL;DR: 本文从机制角度研究大语言模型中代词保真度的内部工作原理，通过Boundless Distributed Alignment Search方法发现代词保真度由群体实体绑定、近因偏差和刻板印象偏差三个因果子空间共同作用，其组合可解释91-99.5%的模型行为，并揭示了注意力头中概念级和词元级两条竞争路径的运作机制。

Details

Motivation: 针对大语言模型在多指代对象使用不同代词时经常失效的问题，现有研究仅依赖行为分析方法，无法揭示模型内部机制，因此需要从模型内部视角探究代词保真度的因果机制。

Result: 在多个SOTA语言模型中发现三个因果机制共存于网络深度分布的子空间中，组合解释力达91-99.5%；注意力头分析进一步显示群体绑定与刻板印象共享概念级路径，而近因偏差使用词元级路径。

Insight: 创新点在于首次通过分布式对齐搜索对代词保真度进行机制性归因，揭示了多机制竞争框架；客观来看，将注意力头路径分为概念绑定和表面形式复制两类，为理解语言模型指代推理提供了新的分析范式。

Abstract: Faithful and robust pronoun use is important for fair and coherent generations, yet large language models largely fail when multiple referents use different pronouns. To study the interplay of reasoning, repetition, and bias in this task, prior work relies exclusively on behavioural approaches, which may not reflect a model’s internal workings. Therefore, we provide a mechanistic, model-internal perspective on pronoun fidelity, testing whether three mechanisms – group entity binding (G), recency bias (R), and stereotypical bias (S) – are causally implemented across several SOTA language models. Using Boundless Distributed Alignment Search, we find all three coexist as causal subspaces distributed across network depth. No single mechanism fully explains model behaviour, but a combination of the three consistently accounts for 91-99.5%. An attention head analysis further reveals two competing copying routes; group binding and stereotype share a localized concept-level route that retrieves a bound occupation-pronoun unit, while recency uses a distributed token-level route that repeats surface forms. In sum, pronoun fidelity arises from competition between simultaneously active causal subspaces.

[48] PathRouter: Aligning Rewards with Retrieval Quality in Agentic Graph Retrieval-Augmented Generation cs.CLPDF

Bo Wang, Heyan Huang, Yaolin Li, Wei Tang, Yuan Zhang

TL;DR: 本文提出了PathRouter，一个用于智能体化图检索增强生成（Agentic GraphRAG）的路径感知训练框架。该框架旨在解决传统结果导向强化学习中存在的奖励混淆和搜索更新模糊性问题，通过联合评估答案正确性和证据路径重叠度来优化智能体的检索与推理行为。

Details

Motivation: 动机在于解决智能体化GraphRAG中，仅依赖最终结果的强化学习所导致的两个核心问题：答案-路径奖励混淆（即正确答案可能来自捷径而非有效证据路径）和搜索-更新模糊性（标量轨迹级反馈无法指明应调整哪些检索动作）。

Result: 在三个不同模型规模下的六个问答基准测试中，PathRouter一致地提升了答案F1分数和证据路径重叠度。与强基线相比，在3B和7B模型上分别实现了平均3.1和4.9的F1分数提升。

Insight: 主要创新点在于提出了一个联合评估轨迹的框架，根据答案正确性和证据路径质量将轨迹分类，并应用差异化的GRPO优势缩放，从而抑制捷径强化并保留证据寻求行为。此外，对于证据不足的轨迹，引入了一个冻结的黄金证据教师模型，在推理和搜索查询token上提供token级别的KL指导，避免了直接模仿答案。

Abstract: Agentic GraphRAG trains language-model agents to iteratively retrieve and reason over graph-structured evidence, enabling more accurate and context-aware decision-making by efficiently navigating complex information networks. However, outcome-only reinforcement learning suffers from \textit{\textbf{answer-path reward aliasing}}, where correct answers may come from shortcuts rather than useful evidence paths. It also exhibits \textit{\textbf{search-update ambiguity}}, as scalar trajectory-level feedback does not indicate which retrieval actions to adjust. To mitigate these shortcomings, we present PathRouter, a path-aware training framework for agentic GraphRAG. PathRouter jointly evaluates each trajectory along answer correctness and evidence-path overlap, yielding four trajectory categories with differentiated GRPO advantage scaling that suppresses shortcut reinforcement while preserving evidence-seeking behavior. For evidence-poor trajectories, a frozen gold-evidence teacher provides token-level KL guidance on reasoning and search-query tokens, excluding answer tokens to avoid direct response imitation. Experiments on six QA benchmarks across three model sizes show that PathRouter consistently improves answer F1 and evidence-path overlap, achieving average F1 gains of 3.1 on 3B and 4.9 on 7B models compared to a strong baseline.

[49] From Awareness to Adherence: Bridging the Context Gap in Spoken Dialogue Systems via Context-Aware Decoding cs.CLPDF

Che Hyun Lee, Heeseung Kim, Sungroh Yoon

TL;DR: 本文针对端到端口语对话系统在多轮对话中难以严格遵循上下文的问题，提出了一种音频适配的上下文感知解码方法。该方法通过利用内部注意力机制识别关键历史轮次，并在推理时对比有无关键上下文的输出分布，从而直接增强多模态上下文信号。

Details

Motivation: 现有研究多将对话失败归因于模型遗忘历史，但本文指出一个同样关键但被忽视的瓶颈：潜在上下文感知与主动遵循之间存在差距，即模型内部能识别相关历史话语，但解码时强大的参数先验往往会掩盖这些信号。

Result: 在Audio MultiChallenge基准测试中，该方法在语义记忆和自我一致性子任务上取得了显著改进，成功实现了严格且忠实于上下文的遵循。

Insight: 创新点在于揭示了上下文遵循失败的新瓶颈（感知与遵循的差距），并提出了一种无需重新训练、在解码阶段直接放大上下文信号的轻量级干预方法，这对于提升对话系统的上下文忠实度具有借鉴意义。

Abstract: Despite the success of end-to-end (E2E) spoken dialogue systems, maintaining strict context adherence in multi-round conversations remains a challenge. While prior works attribute these failures to models forgetting dialogue history, we highlight an equally critical but overlooked bottleneck: a gap between latent context awareness and active adherence. Although models internally recognize relevant past utterances, strong parametric priors often overshadow these signals during decoding. To bridge this gap, we propose an audio-adapted Context-Aware Decoding (CAD) approach. By leveraging internal attention mechanisms to isolate key historical rounds, our approach contrasts output distributions with and without this key context during inference, directly amplifying multimodal contextual signals. Evaluations on the Audio MultiChallenge benchmark demonstrate significant improvements in Semantic Memory and Self Coherence subtasks, successfully enforcing strict, context-faithful adherence.

[50] LectūraAgents: A Multi-Agent Framework for Adaptive Personalized AI-Assisted Learning and Embodied Teaching cs.CL | cs.AI | cs.HCPDF

Jaward Sesay, Yue Yu, Siwei Dong, Yemin Shi, Guangyao Chen

TL;DR: 本文提出了LectūraAgents，一个用于自适应个性化AI辅助学习和具身教学的多智能体框架。该框架模拟师生关系，通过一个教授智能体协调多个下属智能体，完成从研究、规划、复习到具身化内容交付的端到端个性化教学流程。

Details

Motivation: 现有教育智能体主要关注讲座内容自动化和模拟，缺乏为个体学习者量身定制的多模态和具身化教学方法建模。因此，需要能够动态适应不同学习者的个性化教学系统。

Result: 在高中、本科和研究生级别的多样化课程上，通过基于特定样本量规的分析进行评估。实验结果表明，在讲座内容质量、具身教学质量、评估和个性化方面，相比现有方法均取得了一致的提升，被专家教育者验证。

Insight: 主要创新点包括：1）用于端到端个性化学习的层次化多智能体架构；2）自适应具身教学机制，教授智能体在教学环境中执行可见的、有教学动机的动作；3）教学动作-语音对齐算法，用于生成与学习者画像一致的教学动作序列。

Abstract: Effective personalized AI-assisted learning demands systems that can not only generate accurate learner-specific educational materials, but also dynamically adapt their instruction to diverse learners. However, existing educational agents have primarily focused on lecture content automation and simulations, which often fall short of modelling multimodal and embodied instructional methods tailored for the individual learner. To this end, we propose LectūraAgents - a multi-agent framework that enables personalized learning through end-to-end adaptive embodied teaching. At its core, LectūraAgents mirrors a professor-student relationship, in which a ProfessorAgent leads a collaborative team of specialized subordinate agents through research, planning, review, and embodied delivery of lecture contents that adapt to a learner’s needs. The framework offers three main contributions: (1) a hierarchical multi-agent architecture for end-to-end personalized learning; (2) an adaptive embodied teaching mechanism, wherein the ProfessorAgent executes visible and pedagogically motivated teaching actions (e.g., handwrite, highlight, underline, etc.) over contents in a teaching environment; and (3) a Teaching Action-Speech Alignment (TASA) algorithm that employs salience-based heuristics and temporal semantic segmentation to generate coherent teaching action sequences aligned with learner profiles. We evaluate LectūraAgents on diverse courses at high school, undergraduate, and graduate levels using sample-specific rubric-based analysis; with generated lecture materials and teaching actions assessed and validated by expert educators. Experimental results show consistent gains in lecture content quality, embodied teaching quality, assessment, and personalization over existing approaches, positioning LectūraAgents as a pedagogically well-grounded framework for personalized learning at scale.

[51] REFLEX: Reflective Evolution from LLM Experience cs.CL | cs.LGPDF

Pan Wang

TL;DR: REFLEX是一个无需训练的进化框架，用于生成可解释的程序化策略。它通过将视觉诊断与代码生成解耦，利用一个视觉Critic生成结构化诊断，一个文本Actor结合自我演化的技能记忆库来合成子策略，从而提供透明的突变轨迹并实现跨轮次的程序知识迁移。

Details

Motivation: 现有基于大语言模型（LLM）的进化搜索框架将视觉行为证据的解释和纠正代码的合成耦合在一个单一模型调用中，导致诊断-修复过程纠缠，使得突变原理不透明且无法在独立运行间保留算法洞察。

Result: 在控制基准测试（Lunar Lander、Acrobot、Pendulum）和一个36维天线阵列合成任务上的广泛评估显示，REFLEX具有卓越的样本效率：在10次LLM调用内解决Acrobot和Pendulum，在Lunar Lander上达到最佳归一化加权分数1.092，实现了极具竞争力的最终性能并显著加速了透明策略的早期发现。

Insight: 论文宣称的创新点在于将视觉诊断与代码生成结构化解耦，并引入一个持久、自我演化的技能记忆库来促进可重用代码片段的跨轮次知识迁移。从客观角度看，这种解耦架构确实能增强进化过程的可审计性和效率，技能记忆库的设计是实现持续学习的关键创新。

Abstract: Large multimodal language models (LLMs) have emerged as powerful tools for guiding evolutionary search toward interpretable programmatic policies. However, existing frameworks rely on a monolithic model call to simultaneously interpret visual behavioral evidence and synthesize corrective code. This diagnosis-repair entanglement creates an opaque feedback loop, obscuring the rationale behind mutations and preventing the retention of algorithmic insights across independent runs. To achieve auditable and efficient policy search, we argue that visual diagnosis must be structurally decoupled from code generation. We present REFLEX, a train-free evolutionary framework that operationalizes this decoupling. In REFLEX, a vision-enabled Critic first distills task-specific behavioral evidence into structured, auditable diagnoses. Subsequently, a text-optimized Actor synthesizes child policies using these diagnoses alongside a persistent, self-evolving Skill Memory of reusable code snippets. This architecture not only provides transparent mutation traces but also enables cross-run programmatic knowledge transfer. Extensive evaluations across control benchmarks (Lunar Lander, Acrobot, Pendulum) and a 36-dimensional antenna array synthesis task demonstrate exceptional sample efficiency. Notably, REFLEX solves Acrobot and Pendulum in under 10 LLM calls and reaches a best Normalized Weighted Score of 1.092 on Lunar Lander, achieving highly competitive final performance while significantly accelerating the early-stage discovery of transparent policies.

[52] Can LLM Coding Agents Reason About Time Series? cs.CLPDF

Filip Rechtorík, Ondřej Dušek, Zdeněk Kasner

TL;DR: 这篇论文探讨了大型语言模型（LLM）编码代理处理时间序列数据的能力。研究比较了三种方法：让代理直接处理原始数值数据、作为编码代理使用Python代码查询数据，以及两者的结合。实验表明，具备代码访问权限的代理在时间序列理解基准测试上比直接处理原始数据的模型性能高出最多10%，但最佳代理仍有22-34%的错误率。

Details

Motivation: LLM越来越多地应用于金融、医疗或环境监测等领域的自动化决策系统，这些领域普遍存在难以自动处理的时间序列数据。论文旨在探究LLM代理是否能够有效分析时间序列数据。

Result: 在两个时间序列理解基准测试上，具备代码访问权限的代理比直接处理原始数据的模型性能提升高达10%。然而，即使表现最佳的代理，其错误率仍在22%到34%之间。

Insight: 创新点在于系统性地比较了LLM处理时间序列的不同范式（原始数据 vs. 编码代理）。研究发现，编码代理能够选择合适的统计检验，但常常忽略重要细节；而直接访问原始数据的模型有时能通过粗略估算得出正确结论。这揭示了不同方法在推理策略上的互补性与局限性。

Abstract: Large language models (LLMs) are increasingly being used for automated decision-making systems in finance, healthcare, or environmental monitoring. Time series data are ubiquitous in these fields, yet hard to process automatically. Can time series be analyzed by LLM agents? We examine three approaches: providing the agent with raw numerical data, using the LLM as a coding agent, or a combination of both. In the coding agent setup, the model iteratively queries the data using Python code. Using two time series understanding benchmarks, we show that agents with code access can outperform models processing raw data by up to 10%. However, even the best performing agent still answers about 22-34% of the questions incorrectly. To get insights into models’ strategies and reasoning gaps, we analyze the model outputs with a strong LLM judge. Our analysis reveals that coding agents can select appropriate statistical tests, but often miss important nuances. Meanwhile, models with access to raw data can reach the right conclusions using back-of-the-envelope calculations.

[53] Lost at the End: Primacy Bias in Multimodal Retrieval-Augmented Question Answering cs.CL | cs.AI | cs.CVPDF

Jieyuan Liu, Jianyang Gu, Shijie Chen, Jefferson Chen, Zhen Wang

TL;DR: 本文研究了多模态检索增强问答（KB-VQA）中读者模型对检索段落位置的依赖偏差。研究发现，与纯文本长上下文LLM中观察到的‘中间迷失’（信息在上下文两端有效，中间无效）的U型效应不同，在多模态KB-VQA中，偏差形状反转为‘首因偏差’：位于提示开头（首位）的黄金段落表现远优于末尾，作者称之为‘末尾迷失’。通过一系列受控实验和消融研究，作者将主要原因定位到经过指令调优的读者模型的第一个提示槽，并指出仅改进检索侧无法解决此问题，需要读者侧的干预。

Details

Motivation: 动机是探究在已部署的多模态知识库视觉问答（KB-VQA）系统中，读者模型对检索到的上下文段落的位置依赖是否与纯文本长上下文大语言模型（LLM）中观察到的‘中间迷失’效应相同，从而揭示并量化其中的潜在偏差。

Result: 在三个开源的7B/8B视觉语言模型（VLM）读者和两个KB-VQA基准测试（k值高达20）上的实验结果表明，存在强烈的‘首因偏差’：黄金段落位于首位时的性能比位于末尾时高出16到26个百分点。消融实验表明，多模态设置将文本模式中已存在的首因偏差放大了2.2到4.5倍。检索侧的三种修正方法（MMR、oracle重排序、基于排名的重排）均未能缩小性能差距。

Insight: 论文的核心创新点在于首次设计并应用了一个受控的‘黄金位置’协议来系统探测多模态KB-VQA中读者侧的位置依赖性，并发现了与纯文本LLM相反的‘末尾迷失’（首因偏差）现象。客观分析认为，其关键洞察在于揭示了在部署的KB-VQA系统中，召回率@k是一个不合适的评估指标，且解决此性能差距需要针对读者模型（而非检索器）进行干预，为此发布的协议为未来评估此类干预提供了标准化工具。

Abstract: Knowledge-based visual question answering (KB-VQA) lets vision-language systems answer questions that exceed their parametric knowledge by conditioning a reader on passages retrieved from a Wikipedia-scale knowledge base. In pure-text long-context LLMs, retrieved-context use follows the U-shaped “lost-in-the-middle” effect of Liu et al. (2024): information at the start and end of context is used, the middle is lost. Whether this transfers to deployed multimodal KB-VQA is open. To close this gap, we design the first controlled probe of reader-side position dependence in multimodal KB-VQA: a gold-position protocol in which only the gold passage’s prompt slot varies within question. We run it on three open-source 7B/8B VLM readers and two KB-VQA benchmarks at k up to 20. The shape flips from U to primacy: gold-at-first beats gold-at-last by 16 to 26 points on every reader-by-benchmark cell, an effect we call “Lost at the End”. Three targeted ablations narrow the cause: a text-only control shows the multimodal setting amplifies an already-present text-mode primacy 2.2 to 4.5 times, and image-position and distractor-shuffle ablations together pin the locus to prompt slot 0 of the instruction-tuned reader. On a frozen reader, three retrieval-side fixes (MMR, oracle reranking, rank-based reordering) all leave the gap intact (no separable improvement). Our findings indicate that recall@k is the wrong metric for deployed KB-VQA and that closing the gap requires reader-side intervention; we release our protocol as a controlled instrument for evaluating such interventions.

[54] Can LLM Agents Infer World Models? Evidence from Agentic Automata Learning cs.CLPDF

Reef Menaged, Gili Lior, Shauli Ravfogel, Roee Aharoni, Gabriel Stanovsky

TL;DR: 本文提出’智能体自动机学习’框架，用于评估工具调用型LLM智能体通过交互揭示隐藏环境的能力。实验发现，随着确定性有限自动机（DFA）规模增大，LLM性能急剧下降；推理模型虽优于非推理模型，但在查询规划、证据整合和假设构建方面存在系统性缺陷。

Details

Motivation: 旨在量化评估LLM智能体通过主动交互（成员查询和等价查询）推断隐藏世界模型的能力，建立可扩展、复杂度可控的测试基准。

Result: 在DFA学习任务中，当前SOTA LLM的性能随自动机规模增大而显著恶化，其交互效率与鲁棒性远低于经典自动机学习算法（如L*算法）。

Insight: 创新点在于将经典形式化方法（自动机学习）转化为评估LLM世界模型推断能力的结构化测试平台；客观揭示了LLM在系统性推理和交互式探索中的关键瓶颈。

Abstract: We propose agentic automata learning to evaluate the extent to which tool-calling LLM agents can uncover hidden environments through interaction. In our setup, an agent should uncover a hidden deterministic finite automaton (DFA) by interacting with an oracle through (1) membership queries (“Does this string belong to the target language?”) and (2) equivalence queries (“Is this the target DFA?”). This yields a scalable testbed with controlled task complexity, measurable interaction efficiency, and strong baselines (classic automata-learning algorithms). Evaluating state-of-the-art LLMs, we find that performance drops sharply as DFA size increases. Reasoning models are markedly stronger than non-reasoning models, yet trajectory analyses reveal recurring failures in query planning, evidence integration, and hypothesis construction. Overall, our results show that current LLM agents can sometimes perform non-trivial interactive discovery, but remain far less robust and efficient than classic algorithms for the task.

[55] Uncertainty Is Not a Safety Net for Clinical VQA, but Can It Anticipate Model Failure? cs.CLPDF

Arnisa Fazla, Alberto Testoni, Ameen Abu-Hanna, Barbara Plank, Iacer Calixto

TL;DR: 本文评估了临床视觉语言模型（VLMs）在视觉问答（VQA）任务中的不确定性估计（UE）质量，发现现有UE方法并不能可靠地指示模型何时应被信任，其质量与模型准确性正相关，在模型最需要可靠性的薄弱环节反而表现最差。通过引入NOTA扰动（将正确答案隐藏于多项选择中）进行压力测试，发现模型准确性崩溃时不确定性却几乎不变，表明模型存在系统性校准错误。然而，未扰动输入的不确定性能够可靠地预测哪些预测会在NOTA下崩溃，因此UE可作为诊断模型脆弱性的工具。

Details

Motivation: 临床VLM的安全部署需要可靠的不确定性估计来指示何时应信任预测或将其升级给临床医生处理，但当前UE方法是否真的能提供这种信号尚不清楚。

Result: 在临床VQA任务上对12个VLM和8种UE方法进行基准测试，发现UE质量并非UE方法的内在属性，而是与模型准确性正相关，在模型性能最弱处（即最需要可靠性时）表现最差。在NOTA扰动压力测试下，模型准确性崩溃而UE几乎不变，导致系统性校准错误。但未扰动输入的UE能可靠预测NOTA下的预测崩溃情况。

Insight: 论文的创新点在于揭示了当前临床VLM中UE的局限性（其质量依赖于模型性能，而非独立的可靠性信号）及其潜在价值（作为诊断模型脆弱预测的工具）。从客观角度看，研究强调了基于扰动的评估（如NOTA）对于推动安全临床部署的重要性，并提出了将UE重新定位为诊断工具而非安全网的见解。

Abstract: Safe deployment of clinical vision-language models (VLMs) requires reliable uncertainty estimation (UE): a signal indicating when predictions should be trusted or escalated to a clinician. We test whether current UE methods actually deliver this signal. Benchmarking 8 methods across 12 VLMs on clinical visual question-answering (VQA), we find that UE quality is not an intrinsic property of the UE method: it tracks model accuracy, degrading precisely where the model performance is weakest, and therefore where reliability is most needed. When we stress-test models by hiding the correct option among the multiple-choice answers (NOTA perturbations), accuracy collapses while uncertainty barely changes, leaving models systematically miscalibrated. Yet, we find that uncertainty on the unperturbed input reliably anticipates which predictions will collapse under NOTA, indicating that UE in current VLMs carries diagnostic information about model fragility. Our results position UE as a diagnostic tool for identifying fragile predictions and motivate perturbation-based evaluation as a path toward safe clinical deployment.

[56] VeriGraph: Towards Verifiable Data-Analytic Agents cs.CL | cs.AIPDF

Jiajie Jin, Zhao Yang, Wenle Liao, Yuyang Hu, Guanting Dong

TL;DR: 本文提出了VeriGraph，一种可追溯的神经符号推理框架，旨在解决基于LLM的智能体在数据分析任务中输出难以验证的问题。该框架通过构建显式的异构证据有向无环图，将原始数据、解释变量、计算结果和自然语言声明连接起来，从而增强推理过程的可审计性和可复现性。

Details

Motivation: 当前基于LLM的智能体在数据密集型分析任务中表现出色，但其输出通常难以验证，因为线性的文本轨迹使得推理过程难以审计，且确定性计算与语义推断在非结构化流中纠缠，导致数值结论难以复现、定性判断难以检查。

Result: 在四个基准测试上的实验表明，VeriGraph-8B在所有基线模型中取得了最高的综合得分。更重要的是，VeriGraph生成了具有更强声明基础的可审计证据图，在声明级证据支持评估中达到了87.61%的基础率。

Insight: 创新点在于提出了一个统一的异构证据图框架，通过计算扩展、基础扩展和推导扩展三种原语连接不同证据类型，并将结构可追溯性简化为图可达性问题。此外，设计了基于图的策略优化策略，联合监督答案正确性、计算完整性和推导连贯性，以改进图构建。

Abstract: LLM-based agents have demonstrated strong capabilities in data-intensive analytical tasks, yet their outputs are rarely verifiable: a reliance on linear text trajectories makes their reasoning difficult to audit. In particular, deterministic computations over raw data and semantic deductions over natural-language claims are often entangled in an unstructured stream, leaving numerical conclusions hard to reproduce and qualitative judgments hard to inspect. To address this, we propose VeriGraph, a traceable neuro-symbolic reasoning framework that enables agents to construct an explicit heterogeneous evidence directed acyclic graph (DAG) during execution. VeriGraph introduces three evidence-expansion primitives, namely computational, grounding, and derivational expansion, to connect raw data, interpreter variables, computed results, and natural-language claims in a unified graph. Under this formulation, structural traceability is reduced to graph reachability from raw data sources to terminal claims, while semantic support is measured by claim-level evidence evaluation. To improve graph construction, we further design a graph-based policy optimization strategy with a composite reward that jointly supervises answer correctness, computational integrity, and derivational coherence. Experiments on four benchmarks show that VeriGraph-8B achieves the highest overall score among all baselines. More importantly, VeriGraph produces auditable evidence graphs with substantially stronger claim grounding, achieving a 87.61% Grounding Rate under our claim-level evidence support evaluation. These results suggest that explicit evidence-graph construction is a promising path toward verifiable data-analytic agents. Our code is available at https://github.com/ignorejjj/VeriGraph.

[57] Islamic Large Language Models: From Knowledge Acquisition to Trustworthy and Hallucination-Resistant AI cs.CLPDF

Mohammed Amine Mouhoub

TL;DR: 这篇综述论文系统梳理了伊斯兰大型语言模型（LLMs）与可信伊斯兰AI的研究领域，指出当前LLMs在处理伊斯兰知识问答时面临诸多挑战，如需要基于权威来源、精确引用、处理阿拉伯语变体差异以及呈现合法的法学分歧。论文围绕阿拉伯语NLP、伊斯兰知识资源、古兰经问答、检索增强生成、伊斯兰法律推理、幻觉评估和可信度等主题组织文献，并提出了构建抗幻觉伊斯兰AI系统的研究议程。

Details

Motivation: 论文的动机在于解决LLMs在处理伊斯兰知识密集型问答时面临的独特挑战，包括确保答案基于权威来源、提供精确引用、处理古典阿拉伯语与现代变体之间的差异，以及正确呈现法学派别间的合法分歧，而非输出单一答案。

Result: 论文是一篇综述，未报告具体的定量实验结果，但总结了现有研究在伊斯兰知识基准（如答案准确性、忠实度、来源有效性和推理质量）上的评估现状，并指出了当前系统的不足。

Insight: 论文的核心创新观点是：仅具备阿拉伯语流利度不足以构建可靠的伊斯兰AI系统。它强调需要整合精选来源、检索与验证模块、引用感知生成、教法学派感知推理、人类专家评估以及多维基准测试，为开发抗幻觉、可信赖的伊斯兰AI系统提供了系统性的框架和研究方向。

Abstract: Large language models (LLMs) are increasingly used for knowledge-intensive question answering, including religious and legal questions. Islamic knowledge is a particularly demanding setting: answers are expected to be grounded in authoritative sources, citations must be exact, Arabic varieties differ substantially from the language of classical sources, and legitimate jurisprudential disagreement must be represented rather than collapsed into a single answer. This survey reviews the emerging field of Islamic LLMs and trustworthy Islamic AI. We organize the literature around Arabic NLP and Arabic-centric LLMs, Islamic NLP resources, Qur’anic question answering, Islamic knowledge benchmarks, retrieval-augmented generation, Islamic legal reasoning, inheritance reasoning, hallucination evaluation, and trustworthiness. We argue that fluency in Arabic is not sufficient for Islamic AI. Reliable systems require curated sources, retrieval and verification modules, citation-aware generation, madhhab-aware reasoning, human expert evaluation, and benchmarks that measure not only answer accuracy but also faithfulness, source validity, and reasoning quality. The survey concludes with a research agenda for hallucination-resistant Islamic AI systems.

[58] Multi-Turn Reflective Masking Elicits Reasoning in Mask Diffusion Models cs.CLPDF

Yanming Zhang, Yihan Bian, Jingyuan Qi, Yuguang Yao, Lifu Huang

TL;DR: 本文提出了一种称为Reflective Masking（RM）的方法，通过轻量级后训练激发掩码扩散模型（MDMs）的内在推理能力，支持多轮掩码和去噪以实现迭代局部修正。该方法无需改变模型架构，并引入了参数无关的History Reference机制以利用历史信息。在文本生成、数独和图像编辑等多种任务和模态上，RM均优于标准掩码基线，展示了强大的泛化性。

Details

Motivation: 现有自回归模型（AR）的推理（如思维链和反思）依赖于完全顺序生成，即使只需局部编辑；而MDMs的掩码机制天然支持对先前输出的显式局部编辑，但现有MDMs不支持多轮掩码和去噪，无法实现类似人类迭代修正错误的方式。

Result: 在文本生成、数独和图像编辑等多样化任务和模态上，Reflective Masking一致优于基于标准掩码的基线方法，表现出强大的泛化能力，成为MDMs推理的基本原语。

Insight: 创新点在于通过轻量级后训练激发MDMs的多轮掩码推理能力，并引入参数无关的History Reference机制以利用历史去噪状态；这为扩散模型提供了更灵活、高效的迭代修正方式，无需重新生成整个输出。

Abstract: While reasoning on autoregressive (AR) models is often performed by chain-of-thought reasoning and reflection, their refinement of previous outputs still relies on fully sequential generation, even when only local edits are needed. In contrast, the masking mechanism in Mask Diffusion Models (MDMs) naturally supports explicit local edits on previous outputs, allowing selective refinement without discarding previous answers and generating another from scratch. While this property more closely aligns with how humans correct mistakes by iterative local refinement, existing MDMs do not support multi-turn masking and denoising. We propose Reflective Masking (RM), which elicits such an intrinsic reasoning capability in MDMs via lightweight post-training. RM provides a native test-time scaling, where an MDM iteratively revisits and revises its prior outputs based on evolving context. To exploit insights from previous turns like AR reasoning, we further introduce History Reference, a parameter-free mechanism that leverages intermediate denoising states during revision. Our approach requires no architectural changes and is easily applicable to existing MDMs. Across diverse tasks and modalities, including text generation, Sudoku, and image editing, Reflective Masking consistently outperforms standard masking-based baselines and demonstrates strong generality, positioning RM as a fundamental primitive for reasoning on MDMs.

[59] Connecting Speech to Words through Images cs.CLPDF

Gabriel Pirlogeanu, Dan Oneata, Horia Cucu, Herman Kamper

TL;DR: 本文提出了一种视觉基础方法，用于在没有文本监督的情况下建立口语词汇库。该方法利用图像和口语描述，通过图像字幕系统构建书面词汇库，再通过无监督词发现技术对齐语音片段，实现口语词与书面词的映射。

Details

Motivation: 解决在没有显式文本监督的情况下，如何学习书面词与口语词之间的映射问题，特别是在缺乏转录文本的低资源语言场景中。

Result: 在口语词检索和关键词检测实验中，该方法优于强神经基线模型，同时更具可解释性，证明了其在英语中的可行性。

Insight: 创新点在于结合视觉基础和无监督学习，通过图像作为中介连接口语与书面词，避免了文本监督需求，为低资源语言处理提供了新思路。

Abstract: How can we learn the mapping between written words and their spoken counterparts in the absence of explicit textual supervision? We present a visually grounded method for building a vocabulary of spoken words using only images and their spoken descriptions. First, image captioning systems are used to build a vocabulary of written words representing salient visual concepts in the images. For each word, we then find utterances whose image captions contain that word. Then we use an unsupervised word discovery technique to align these utterances to locate instances of the target word. The result is spoken word segments that are linked to written words – all accomplished without any text supervision. In spoken word retrieval and keyword spotting experiments, the proposed approach outperforms a strong neural baseline while being more interpretable. These results demonstrate the feasibility of the approach in English and motivate future work on low-resource languages without transcripts.

[60] LLM-based Visual Code Completion for Aerospace Geometric Design cs.CLPDF

Hau Kit Yong, Robert Marsh, Edmar A. Silva, András Sóbester, Stuart E. Middleton

TL;DR: 本文提出了一种基于大语言模型（LLM）的视觉编程副驾驶应用，用于航空航天工程设计任务。该方法结合了ReAct方法的视觉编程变体和GPT-5.4，并引入了Wingbuilder（一个用于航空航天特定几何抽象的Grasshopper插件库）以及一个包含18个专家设计任务的航空航天视觉编程数据集（AVPD）。通过用户试验评估，该副驾驶能生成有用的建议，但较慢的推理速度限制了其在复杂任务中的实用性。

Details

Motivation: 尽管LLM和VLM在视觉代码补全方面取得进展，但重视安全性和可解释性的航空航天工业目前尚未有公开宣布的、基于LLM的几何设计副驾驶系统投入商用。本文旨在填补这一空白，为航空航天工程设计任务开发一个LLM驱动的视觉编程辅助工具。

Result: 通过两名来自大型飞机制造公司的经验丰富的航空航天工程师进行的用户试验评估，结果表明，该副驾驶的视觉编程ReAct方法能够成功生成参与者认为有帮助的建议。然而，较慢的ReAct推理时间限制了其应用，使其更适用于那些值得等待高质量建议的复杂、耗时的任务。参与者表示喜欢该工具并愿意在未来使用。

Insight: 创新点包括：将ReAct方法论与视觉编程结合用于航空航天领域；开发了专门的Wingbuilder插件库和AVPD数据集，以支持领域特定的几何抽象和评估。从客观角度看，其核心在于将先进的LLM能力与高度专业化的工程领域（航空航天几何设计）相结合，并通过构建领域特定工具和数据集来解决该领域对安全性和可解释性的严格要求，这是一个有前景的跨学科应用方向。

Abstract: Recent advances in both Large Language Models (LLMs) and Vision Language Models (VLMs) have seen a step change in their ability to perform visual code completion, but the aerospace industry, which prioritizes safety and explainabilty over rapid LLM adoption, currently has no publicly announced LLM-based geometric design copilot systems in commercial use by aerospace Original Equipment Manufacturers (OEMs). This paper presents a LLM-based visual programming copilot application for aerospace engineering design tasks, using a visual programming variant of the ReAct methodology and GPT 5.4. In addition to the copilot, we describe Wingbuilder, a new Grasshopper plugin library with custom components for aerospace-specific geometry abstraction, and an associated Aerospace Visual Programming Dataset (AVPD) with 18 aerospace expert designed tasks at different levels of difficulty alongside ground truth solutions. We evaluate our copilot application with a user trial involving two experienced aerospace engineers from a large aircraft manufacturing company. We find our copilot visual programming ReAct methodology was successful in generating suggestions that participants found helpful, but slow ReAct inference times limit its usefulness to more complex time-consuming tasks where waiting for good copilot solution suggestion was worthwhile. Participants reported they liked the tool and would be willing to use it in the future.

[61] Understanding the Behaviors of Environment-aware Information Retrieval cs.CL | cs.IRPDF

Ruifeng Yuan, Chaohao Yuan, David Dai, Yu Rong, Hong Cheng

TL;DR: 本文首次系统分析了大型语言模型如何通过强化学习学习为不同检索器自适应调整查询策略，揭示了不同检索器具有截然不同的最优查询风格，并提出了分支式rollout技术以提升训练稳定性。

Details

Motivation: 当前检索增强生成方法在处理复杂查询时表现优异，但忽视了不同检索器需要完全不同的查询策略才能达到最优性能这一关键挑战。

Result: 实验表明强化学习能有效教会LLM根据特定检索器特性定制查询，且通过融入检索器特定的人类指导和扩大模型规模可进一步提升性能。

Insight: 创新点在于首次通过强化学习框架实现查询策略对检索器的自适应，并提出了分支rollout技术来处理多检索步骤的轨迹学习，为构建真正感知检索器的RAG系统提供了实证依据。

Abstract: Recent retrieval-augmented generation (RAG) approaches have demonstrated strong capability in handling complex queries, yet current research overlooks a critical challenge: different retrievers require fundamentally different query formulation strategies for optimal performance. In this work, we present the first systematic analysis of how LLMs can learn to adapt their query formulation strategies for different retrievers via reinforcement learning (RL). Our empirical study reveals that RL effectively teaches an LLM to tailor its queries to specific retriever characteristics. We discover that different retrievers exhibit surprisingly distinct optimal query styles (e.g., descriptive vs. question-like), suggesting strategies learned for one retriever ineffective for another. We further show that performance can be enhanced by incorporating retriever-specific human guidance and by scaling model size. To facilitate learning over multi-retrieval-step trajectories, we introduce a branching-based rollout technique that improves training stability. Our work provides the first empirical evidence and actionable insights for building truly retriever-aware RAG systems. Code and resources are available at https://github.com/LCO-Embedding/Envs-aware-Information-Retrieval.

[62] Data-Driven Decoding of Russell’s Circumplex Model of Affect cs.CLPDF

Amdjed Belaref, Samir Sadok, Zineb Noumir, Renaud Seguier

TL;DR: 本文研究了Transformer模型在文本和语音情感表示中是否自发编码了Russell情感环状模型的几何结构。通过分析RoBERTa、wav2vec 2.0及多模态融合模型的潜在空间，发现多模态融合能完美对齐情感环状拓扑，且零样本下文本嵌入能映射到人类标注的情感坐标。

Details

Motivation: 针对深度学习情感表示常为高维黑箱的问题，探索其潜在空间是否隐含心理学中Russell情感环状模型的几何规律，以验证情感理论在表示学习中的内在编码。

Result: 在多模态融合实验中，文本与语音的融合表示在MSP-Podcast等数据集上实现了与Russell情感环状模型的完美拓扑对齐；零样本设置下，通用文本嵌入的情感细粒度术语也接近人类标注坐标。

Insight: 创新点在于提出了数据驱动的框架验证情感模型，证明Russell环状结构是模态嵌入的内在属性而非人工标注产物，为心理学理论与表示学习搭建了桥梁。

Abstract: Affective computing increasingly relies on deep learning to represent emotions, yet latent spaces often remain opaque, high-dimensional black boxes. This paper investigates whether Transformers’ embeddings recover the geometric regularities of Russell’s circumplex model. We unify two complementary experiments testing the hypothesis that, after training models on text and speech, their resulting latent spaces encode a topology consistent with valence-arousal and reproduce human-like neighborhood relations. Specifically, we evaluate deep representations extracted from Transformer-based text (RoBERTa) and speech (wav2vec 2.0) encoders, along with a multimodal Transformer fusion architecture, across naturalistic datasets like MSP-Podcast and controlled LLM-generated stimuli. Our analysis reveals that multimodal fusion of text and audio yields perfect topological alignment with Russell’s primary emotion ordering. Furthermore, in a zero-shot setting using generic text embeddings, projected fine-grained emotion terms fall close to their established human-mapped coordinates. Our contribution is a novel, data-driven framework for validating emotion models, demonstrating that Russell’s circumplex structure is intrinsically encoded in the embeddings of these modalities rather than being solely an artifact of human labeling, thereby bridging the gap between psychological theory and representation learning.

[63] Follow the Latent Roadmap: Navigating Revocable Decoding for Diffusion LLMs with Anchor Tokens cs.CL | cs.AIPDF

Yizhen Yao, Qinglin Zhu, Runcong Zhao, Xiangxiang Dai, Yanzheng Xiang

TL;DR: 本文提出了一种名为ASRD（Anchor Supervised Revocable Decoding）的无训练框架，用于解决扩散大语言模型（dLLMs）在并行生成中解码速度与质量之间的权衡问题。该方法通过在嵌入空间中显式地将解码上下文解耦为可信的锚定令牌和不确定的候选令牌，并利用锚定令牌缓存，引入了锚定引导生成和锚定扰动验证两种机制，以缓解错误传播和局部错误强化问题。

Details

Motivation: 动机是解决扩散大语言模型在可撤销解码策略中，由于在混合质量上下文中操作而导致的错误传播和局部错误强化这两个关键失败问题，旨在提升解码质量与速度。

Result: 在数学和代码基准测试上的大量实验表明，ASRD超越了近期的重掩码基线方法，实现了高达6.4%的准确率提升，同时推理吞吐量加速高达7.2倍。

Insight: 创新点在于提出了一种在嵌入空间操作的、无训练的框架，通过基于时间一致性识别锚定令牌，并利用动态锚定令牌缓存，结合熵加权锚定信号注入和正交扰动验证两种互补机制，来隐式修正注意力并破坏脆弱的局部共识，从而提升解码的鲁棒性和效率。

Abstract: Diffusion Large Language Models (dLLMs) offer a promising avenue for parallel generation but face a trade-off between decoding speed and quality. While revocable decoding strategies attempt to mitigate errors by verifying and remasking tokens, they typically operate within a mixed-quality context. This leads to two critical failures: \textit{Error Propagation}, where new tokens absorb toxic information from erroneous context, and \textit{Local Error Reinforcement}, where errors mutually reinforce each other to evade detection. To alleviate these challenges, we propose ASRD (Anchor Supervised Revocable Decoding), a training-free framework that operates within the embedding space. ASRD explicitly decouples the decoding context into trusted \textit{Anchor Tokens}, which are identified via temporal consistency, and uncertain candidates. Leveraging a dynamic Anchor Tokens Cache, we introduce two complementary mechanisms: (1) Anchor-Guided Generation, which injects entropy-weighted anchor signals into masked positions to implicitly rectify attention toward the reliable global skeleton; and (2) Anchor-Perturbed Verification, which applies orthogonal perturbations to uncertain candidate tokens, destabilizing and remasking errors driven by fragile local consensus. Extensive experiments on math and coding benchmarks demonstrate that ASRD outperforms recent remasking baselines, achieving accuracy improvements of up to 6.4% while accelerating inference throughput by up to 7.2$\times$.

Ankit Bhattacharjee, Krityapriya Bhaumik

TL;DR: 本文提出了一种鲁棒双信号融合框架，用于社交媒体文本中的反讽检测。该框架结合了神经与符号方法，通过压缩思维链推理轨迹，无需监督微调即可实现零样本检测。在TweetEval和iSarcasm数据集上的实验表明，该方法在准确率和F1分数上达到了与微调模型相当甚至更优的性能。

Details

Motivation: 大型语言模型通常默认进行字面语义解释，导致零样本反讽检测成为持续挑战。本文旨在通过混合神经符号架构，在不进行监督微调的情况下，提升模型对反讽的理解能力。

Result: 在严格保留的TweetEval测试集上，RDS框架达到78.1%的准确率和0.777的宏F1分数，与微调BERTweet的绝对性能上限相当。在高度不平衡的iSarcasm数据集上，零样本宏F1为0.6726，反讽F1为0.4821，优于多个强监督的SemEval transformer集成模型。

Insight: 创新点在于提出了一种混合神经符号门控机制，通过压缩思维链推理轨迹来减少幻觉，并实现零样本检测。客观分析表明，该框架通过并发融合所有信号（神经、符号和压缩思维链），在统计上显著提升了基线性能，展示了结构协同的有效性。

Abstract: Large Language Models (LLMs) natively default to literal semantic interpretations, making zero-shot irony detection a persistent challenge. We introduce the Robust Dual-Signal (RDS) Fusion framework, a hybrid neuro-symbolic architecture that compresses Chain-of-Thought (CoT) reasoning trajectories without Supervised Fine-Tuning (SFT). Evaluated on a strictly held-out TweetEval test set (N=734), RDS achieves 78.1% accuracy and a Macro F1 of 0.777, matching the absolute performance ceiling of the fine-tuned BERTweet. On the heavily imbalanced iSarcasm dataset, the frozen CoT pipeline filters 22.5% of out-of-distribution hallucinations, yielding a zero-shot Macro F1 of 0.6726 and Ironic F1 of 0.4821, outperforming multiple heavily supervised SemEval transformer ensembles. A statistical ablation confirms this structural synergy: adding the symbolic prior to the neural baseline yields no significant gain (p = 0.242), and the marginal benefit of adding the CoT pipeline to that prior is heavily compressed (p = 0.149). Only the complete, concurrent fusion of all three signals achieves a statistically validated improvement over the baseline (p = 0.005).

[65] Compositional Reasoning Depth Predicts Clinical AI Failure: Empirical Evidence Consistent with Transformer Compositionality Limits in Electronic Health Record Question Answering cs.CL | cs.AIPDF

Sanjay Basu

TL;DR: 这篇论文通过实证研究发现，大型语言模型在电子健康记录问答任务中的失败存在系统性结构：需要更多推理步骤的问题会产生不成比例的错误。研究引入了一个预先指定的跳数分类法，作为模型失败的原则性预测指标，并在多个模型上验证了准确率随跳数增加而单调下降的现象。

Details

Motivation: 动机源于对Transformer模型组合性限制的理论研究，旨在揭示聚合准确率基准下隐藏的模型失败模式，并量化推理深度对临床AI性能的影响。

Result: 在Claude Sonnet、GPT-4o和GPT-5.4-2026-03-05等多个模型上的实验表明，准确率随跳数增加而显著单调下降，例如GPT-4o从跳数1的37.8%降至跳数4的14.7%。扩展思考并未显著改善这一趋势，且思考令牌使用量与跳数呈正相关。

Insight: 创新点在于将理论驱动的跳数分类法作为跨架构的模型错误预测指标，为临床AI部署的风险分层提供了直接依据，并证实了推理深度与模型计算需求之间的关联。

Abstract: Aggregate accuracy benchmarks conceal a systematic structure in how large language models fail at electronic health record (EHR) question answering: questions requiring more inferential steps produce disproportionately more errors. Motivated by theoretical results on transformer compositionality limits, we introduce a pre-specified hop-count taxonomy – the number of distinct reasoning steps required to answer a clinical question from an EHR – as a principled predictor of model failure. We annotate 313 clinician-generated MedAlign EHR question-answer pairs across four hop levels and evaluate 301 questions in a within-model ablation (claude-sonnet-4-6, zero-shot vs. extended thinking) and cross-architecture replications (gpt-4o and gpt-5.4-2026-03-05, zero-shot). All three models, spanning two providers and two OpenAI generations (GPT-4 and GPT-5), show monotone accuracy decline with hop count: Claude Sonnet zero-shot falls from 30.6% (hop=1) to 17.6% (hop=4) (Cochran-Armitage z=-2.30, p=0.011; OR per hop 0.72, 95% CI [0.56,0.92], p=0.008); GPT-4o replicates this (37.8% to 14.7%; OR 0.58 [0.45,0.75], p<0.001); and gpt-5.4-2026-03-05 confirms it (37.8% to 23.5%; OR 0.80 [0.66,0.98], p=0.027). A pre-specified context-sufficiency audit shows higher-hop questions are not differentially disadvantaged by EHR truncation (answerability 93-95% at hops 2-4 vs. 79% at hop=1), so the decline reflects compositional reasoning difficulty. Extended thinking did not significantly flatten the accuracy-depth curve across three reasoning conditions, and thinking-token usage scaled with hop count (r=0.31, p<0.0001), consistent with the predicted O(k) computational requirement. Hop count is thus a theory-motivated, cross-architecture predictor of large-language-model error on EHR question answering, with direct implications for deployment risk stratification of clinical AI.

[66] Contrastive-Difference CKA Reveals Concept-Specific Structural Alignment Across Language Model Architectures cs.CLPDF

Xueping Gao

TL;DR: 本文提出了一种名为对比差异CKA（CKA_Delta）的无训练诊断方法，用于分析不同大语言模型（LLM）架构在编码高级概念时是否具有结构兼容性。研究发现，尽管不同架构的模型在几何结构上只有中等程度的收敛，但在功能迁移上却近乎完美，揭示了几何-功能普遍性分离现象。该方法能有效区分概念特定的结构对齐与通用相似性，并在多个概念领域得到验证。

Details

Motivation: 研究动机是探究不同LLM架构（如Transformer变体）是否以结构兼容的方式编码高级概念（如代码、推理、安全等），以理解模型间的可迁移性和内部表示的一致性。

Result: 在测试的六个概念领域中，有五个（包括代码vs自然语言、推理vs回忆等）显示出显著的几何区分能力（p ≤ 0.017），而安全概念则呈现收敛的功能趋势（p = 0.08）。CKA_Delta在区分架构（如Gemma模型作为异常值，效应量d=1.08，AUC=0.79）方面表现良好，但并非绝对的迁移精度预测器。初步观察表明，模型规模增大（如70B参数）可能增强普遍性。

Insight: 创新点在于提出了CKA_Delta这一无训练诊断工具，通过计算每个样本对比差异的核对齐，能有效隔离概念特定的结构收敛，克服了标准CKA的局限性。这为跨架构的概念监控和模型对齐提供了实用的分类与异常检测方法，揭示了LLM中几何与功能表示的分离现象。

Abstract: Do different LLM architectures encode high-level concepts in structurally compatible ways? We systematically characterize a geometric-functional universality dissociation: across multiple concept domains and architectural families, moderate geometric convergence coexists with near-perfect functional transfer. Using contrastive-difference CKA (CKA_Delta), a training-free diagnostic that computes kernel alignment on per-sample contrastive differences, we isolate concept-specific convergence from generic similarity – achieving significant discrimination where standard CKA cannot. The dissociation replicates across all six concept domains we test (five with p <= 0.017 geometric discrimination and safety as a converging-functional trend, p = 0.08), including two non-instruction concepts (code-vs-NL, reasoning-vs-recall) validated without system prompts; a single 70B–70B pair provides an observational note that universality may strengthen with scale, requiring replication with additional >=70B models. We position CKA_Delta as a practical regime classifier and architectural outlier detector (Gemma: d = 1.08, AUC = 0.79) rather than an absolute transfer-accuracy predictor, providing a training-free diagnostic for cross-architecture concept monitoring.

[67] Exploring Extrinsic and Intrinsic Properties for Effective Reasoning with Code Interpreter cs.CL | cs.LGPDF

Patomporn Payoungkhamdee, Napat Laosaengpha, Jenta Wonglertsakul, Pittawat Taveekitworachai, Pume Tuchinda

TL;DR: 本文系统研究了代码解释器（CI）推理中的外在属性（关键令牌）和内在属性（代码特定认知行为），发现更强的CI推理模型普遍表现出更高的关键令牌出现频率和认知行为（如验证、回溯和后向链）。研究探索了如何在推理时利用关键令牌提升数学、排序和优化等任务性能，以及在训练时融入认知行为来改进监督微调和强化学习的效果，并分析了其潜力和局限性。

Details

Motivation: 尽管代码解释器已成为增强大语言模型推理能力的有效范式，但其背后有效代码推理的行为特性尚未得到充分探索。本研究旨在从外在属性（关键令牌）和内在属性（代码特定认知行为）两个角度，系统性地揭示有效CI推理的特性。

Result: 在多个大语言模型上的实验表明，更强的CI推理模型一致表现出更高的关键令牌出现频率和认知行为（验证、回溯、后向链）。推理时附加代码特定关键令牌能提升数学、排序和优化等任务的性能；训练时融入这些认知行为在三个评估模型中的两个改进了监督微调和强化学习性能，减少了错误回答中的过度思考并提高了令牌效率。

Insight: 创新点在于首次系统性地从外在和内在两个维度表征了有效的CI推理行为，并验证了利用关键令牌和代码特定认知行为（如验证、回溯）来提升推理性能的可行性。客观来看，该研究为理解和改进基于代码的推理提供了可操作的分析框架和具体干预手段。

Abstract: Reasoning with a Code Interpreter (CI) has emerged as an effective paradigm for enhancing the reasoning capabilities of large language models (LLMs) through executable computation and iterative verification. Despite its growing adoption, the behavioral properties underlying effective code reasoning remain largely underexplored. In this work, we investigate code reasoning from two distinct perspectives inspired by prior studies of natural language reasoning: extrinsic properties, represented by crucial tokens, and intrinsic properties, represented by code-specific cognitive behaviors. Across multiple LLMs, we find that stronger CI reasoning models consistently exhibit a higher prevalence of crucial tokens and cognitive behaviors, particularly verification, backtracking, and backward chaining. Building on these observations, we examine how these properties can be leveraged during both inference and training. At inference time, appending code-specific crucial tokens improves performance on several reasoning capabilities, including mathematical, ordering, and optimization, while yielding limited benefits elsewhere. At training time, augmenting a state-of-the-art framework with code-specific cognitive behaviors improves supervised fine-tuning and reinforcement learning performance in two of three evaluated models. Further analysis shows that these behaviors reduce overthinking in incorrect responses and improve token efficiency, while also revealing factors that limit gains in a certain model. Our findings provide the first systematic characterization of effective reasoning with CI and demonstrate both the potential and limitations of leveraging key properties to improve CI-based reasoning.

[68] DEEPRUBRIC: Evidence-Tree Rubric Supervision for Efficient Reinforcement Learning of Deep Research Agents cs.CLPDF

Minghang Zhu, Chuyang Wei, Junhao Xu, Yilin Cheng, Zhumin Chen

TL;DR: 本文提出了DeepRubric框架，通过构建证据树来生成查询-评分标准监督对，用于训练深度研究智能体。该方法反转了传统流程，先确定证据支持的报告应如何评估，再合成对齐的查询和评分标准，从而提升强化学习效率。基于此框架构建了9K个监督样本，训练出的DeepRubric-8B模型在三个基准测试中达到与先前SOTA相当的性能，同时减少了约13倍的RL GPU小时消耗。

Details

Motivation: 现有方法使用LLM为给定查询生成评分标准，但当模型无法推断底层信息需求时，生成的评分标准可能不完整，导致强化学习效率降低。本文旨在通过更可靠的查询-评分标准监督来优化深度研究智能体的训练效率。

Result: 在三个基准测试中，DeepRubric-8B模型与先前开源最先进的深度研究模型性能相当，同时使用基于评分的GRPO强化学习方法，将RL GPU小时消耗减少了约13倍。

Insight: 创新点在于反转监督数据生成流程：从证据树出发确定可验证的评估目标，再合成对齐的查询和评分标准，确保奖励函数精确评估查询所需信息。这种方法提供了更可靠的监督信号，显著提升了强化学习的数据效率和训练效率。

Abstract: Deep research agents synthesize long-form reports by searching and reasoning over retrieved evidence. Reinforcement learning with rubric-based rewards improves these agents by optimizing them against checkable criteria that translate report quality into reward signals, but its efficiency depends on whether those criteria reliably capture the task scope and evidence needs. Most existing studies ask an LLM to generate rubrics for a given query, but when the model fails to infer the underlying information needs, the generated rubrics may be incomplete and reduce RL efficiency. To obtain more reliable query–rubric supervision, we introduce DeepRubric, a data construction framework that reverses this process: instead of inferring evaluation criteria for a given query, it first determines what an evidence-backed report should be evaluated on and then synthesizes aligned query–rubric pairs from those evaluation targets. Starting from a sampled seed topic, DeepRubric builds an evidence tree by recursively expanding evidence-backed sub-questions, whose leaves serve as atomic and verifiable evaluation targets. It then uses the evidence tree to synthesize the training query and rubrics, ensuring that the reward evaluates exactly the information requested by the query. Using DeepRubric, we construct 9K query–rubric supervision examples and train DeepRubric-8B with rubric-based GRPO, achieving comparable performance to prior open state-of-the-art deep research models across three benchmarks with roughly 13x fewer RL GPU-hours.

[69] Context-Aware RL for Agentic and Multimodal LLMs cs.CL | cs.CVPDF

Peiyang Xu, Bangzheng Li, Sijia Liu, Karthik R. Narasimhan, Pramod Viswanath

TL;DR: 本文提出了一种名为ContextRL的上下文感知强化学习方法，旨在解决大语言模型在长上下文或多模态推理中难以识别关键细节的问题。该方法通过一个间接的辅助目标——让模型从两个高度相似的上下文中选择支持给定查询-答案对的正确上下文，来增强模型的细粒度推理能力。

Details

Motivation: 大语言模型在处理长或复杂上下文（如工具轨迹或图像中的细微细节）时，经常因无法识别决定性证据而失败，因此需要一种方法来提升其长程推理和多模态性能。

Result: 在5个长程推理基准测试中，ContextRL相比标准GRPO平均提升2.2%；在12个多样化的视觉问答基准测试中，平均提升1.8%。通过对比实验，证明提升主要源于上下文选择目标，而非额外的对比数据本身。

Insight: 创新点在于引入间接的上下文选择强化学习目标，通过对比相似上下文来鼓励细粒度基础，这为提升代理和多模态LLMs的推理能力提供了一种有效且数据高效的方法。

Abstract: Large language models (LLMs) often fail when answering requires identifying a small but decisive piece of evidence within a long or complex context, such as a single line in a tool trace or a subtle detail in an image. We propose ContextRL, a context-aware reinforcement learning (RL) method that improves long-horizon reasoning and multimodal performance through an \emph{indirect} auxiliary objective. Instead of supervising only the final answer, ContextRL presents the model with a query, an answer, and two highly similar contexts, and rewards it for selecting the context that supports the query–answer pair, thereby encouraging fine-grained grounding. We construct contrastive context data in two domains: for coding agents, trajectories serve as contexts, yielding 1k pairs built via condition filtering; for multimodal reasoning, images serve as contexts, yielding 7K pairs built via generative editing and similarity search. ContextRL achieves average gains of +2.2% over standard GRPO on 5 long-horizon benchmarks, and +1.8% across 12 diverse visual question answering benchmarks. To disentangle the effect of the proposed objective from that of additional data, we compare against data-augmentation baselines that repurpose the same contrastive contexts as standard query–context–answer examples. These baselines provide little to no improvement, showing that the gains arise from the proposed context-selection objective rather than from the contrastive data alone.

[70] Benchmarking LLM Agents on Meta-Analysis Articles from Nature Portfolio cs.CL | cs.IRPDF

Anzhe Xie, Weihang Su, Yujia Zhou, Yiqun Liu, Qingyao Ai

TL;DR: 本文介绍了MetaSyn数据集，该数据集包含442篇来自Nature Portfolio期刊的专家策划元分析文章，用于评估LLM智能体在完整的文献检索-筛选-合成流程中的系统性科学推理能力。基准测试了12种流程配置（包括9种RAG变体和一种协议驱动智能体），揭示了筛选环节的关键瓶颈：尽管在K=200时检索召回率上限可达90.9%，但没有系统能恢复超过52.7%的真实纳入文献。

Details

Motivation: 元分析是一种要求严格的证据合成形式，其结构化、可验证的工作流程是评估系统性科学推理的理想基础，但现有基准缺乏覆盖完整检索-筛选-合成流程的真实数据。

Result: 在MetaSyn数据集上的基准测试表明，当前LLM在主题相关性相近的文献池中，无法可靠地区分符合PI/ECO标准的研究与不符合的干扰项，筛选性能存在显著瓶颈。

Insight: 论文的创新点在于构建了一个包含完整流程真实数据的元分析基准数据集，并引入了阶段归因指标来捕捉系统在不同环节的成功与失败，而非单一的端到端评分，这为评估LLM的复杂科学推理能力提供了更精细的框架。

Abstract: Meta-analysis is a demanding form of evidence synthesis that combines literature retrieval, PI/ECO-guided study selection, and statistical aggregation. Its structured, verifiable workflow makes it an ideal substrate for evaluating systematic scientific reasoning, yet existing benchmarks lack ground truth across the full retrieval-screening-synthesis pipeline. We introduce MetaSyn, a dataset of 442 expert-curated meta-analyses from Nature Portfolio journals. Each entry pairs a research question with PI/ECO criteria, a retrieval corpus of 140k PubMed articles, verified positive studies, hard negatives that are topically similar but PI/ECO-ineligible, and complete search strategies and date bounds. Benchmarking twelve pipeline configurations (nine RAG variants and a protocol-driven agent) reveals a critical screening bottleneck: despite a retrieval ceiling of 90.9% recall at K=200, no system recovers more than 52.7% of ground-truth included literature. Current LLMs fail to reliably separate eligible studies from PI/ECO-failing distractors in pools of comparable topical relevance. Stage-attributed metrics capture where systems succeed and fail; a single end-to-end score does not.

[71] The Value Axis: Language Models Encode Whether They’re on the Right Track cs.CLPDF

Nick Jiang, Isaac Kauvar, Jack Lindsey

TL;DR: 该论文研究了语言模型是否内部编码了其当前策略实现目标的可能性，即’价值轴’。通过合成上下文强化学习数据，在Qwen3-8B模型中构建了一个价值轴，发现该轴能区分高/低置信度、有无回溯的展开以及正确/错误的代码。操控该轴可因果性地影响模型行为，如抑制自我修正或诱导回溯。研究还表明DPO能增加奖励行为的内在价值，提升模型信心，并应用于分析真实场景如政治敏感查询。

Details

Motivation: 探究语言模型是否内部编码了对其当前策略能否成功实现目标的估计，即’价值’，以理解模型决策过程中的内部置信度机制。

Result: 在Qwen3-8B上构建的价值轴能有效区分多种行为模式（如置信度、回溯、代码正确性），操控该轴可因果性改变模型行为。DPO能增加特定行为的内在价值，使其表现更自信。在真实场景分析中，发现后训练降低了模型对政治敏感查询的内部价值，而监督微调提升了训练域内的内部置信度。

Insight: 创新点在于提出并验证了语言模型内部存在线性编码的’价值轴’，作为对目标成功可能性的估计，并展示了其可操控性及对模型行为（如信心、探索）的因果影响。这为理解模型内部决策机制和通过干预内部表示进行模型控制提供了新视角。

Abstract: We investigate whether language models internally track the value of their current trajectory, defined as the likelihood that their ongoing strategy will achieve their goals. Using synthetic, in-context reinforcement learning data, we construct a “value” axis for Qwen3-8B. We find that activations along this axis distinguish between high vs. low verbalized confidence, rollouts without and with backtracking, and correct vs. corrupted code. Steering towards high value causally suppresses self-correction and reduces explanatory verbosity, while steering towards low value induces backtracking and exploration. We demonstrate that direct preference optimization (DPO) can increase the internal value of rewarded behaviors (e.g. use a certain word), causing the model to act more confidently after exhibiting them. Finally, we apply the value axis to study in-the-wild settings. For example, we find that Qwen assigns low value to politically sensitive chat queries after post-training and that supervised fine-tuning increases internal confidence within the training domain. Our results suggest that language models linearly encode an estimate of expected goal success that modulates their confidence in pursuing a direction.

cs.CV [Back]

[72] AI for Maritime Security: Comparative Evaluation of CNN and Vision Transformer Architectures for Maritime Object Detection cs.CVPDF

Ismet Gocer, Zakirul Bhuiayn, Shakeel Ahmad, Raza Hasan

TL;DR: 本研究旨在通过评估六种深度学习架构（包括基础CNN、四种迁移学习模型和Vision Transformer）在海事目标检测任务上的性能，以提升海事安全。研究使用了一个包含6,468张涵盖不同天气条件的海事图像数据集，并比较了模型的准确率、错误率、模型大小和视频处理时间等指标。

Details

Motivation: 解决海事安全中实时检测海面船只的问题，特别是在不同天气条件下，需要高效且准确的目标检测系统。

Result: 在评估的模型中，Vision Transformer（ViT）表现最佳，达到了100%的准确率、最低的错误率和最快的视频处理时间；而轻量级架构更适合资源受限的设备。

Insight: 创新点在于系统性地比较了CNN和ViT在海事目标检测中的性能，强调了ViT在整体性能上的优势，同时指出模型选择需考虑计算约束和部署条件，为海事监控和自主导航提供了AI驱动的计算机视觉解决方案。

Abstract: This study aims to enhance maritime security by using advanced Artificial Intelligence (AI) and Computer Vision (CV) techniques. For this purpose, it was designed and assessed intelligent object detection systems that can detect the presence of ships on the sea surface under different real-time environments. To achieve this goal, a maritime image dataset with 6,468 images was used, covering different weather conditions like cloudy, foggy, rainy, and sunny environments. Six deep learning architectures were evaluated, including a base Convolutional Neural Network (CNN) model, four transfer learning models (Xception, VGG16, MobileNetV2, and EfficientNetV2L), and a Vision Transformer (ViT) model. The models were compared using multiple performance indicators, including accuracy, Type I and Type II errors, model size, and video processing time. The results show that model performance varies depending on computational constraints and deployment conditions. While lightweight architectures are suitable for resource-limited devices, the ViT achieved the best overall performance, reaching 100% accuracy with the lowest error rates and the fastest video processing time. The findings highlight the potential of AI-driven computer vision systems for maritime surveillance, border protection, and autonomous navigation.

[73] VigilFormer: Deformable Attention for Video Anomaly Detection with Causal Risk Inference cs.CV | cs.AIPDF

Xinze Zhang

TL;DR: VigilFormer是一个用于监控视频异常检测的统一框架，它结合了可变形时空注意力和因果时序建模。该方法通过可变形时空编码器（DSTE）关注跨帧的稀疏信息位置以捕捉不规则运动，并利用因果异常分类器（CAC）进行片段级特征处理和对比多示例学习优化。此外，自适应置信度调度器（ACS）在推理时动态跳过低信息帧以提升效率。

Details

Motivation: 现有监控视频异常检测方法难以同时兼顾检测精度和实时吞吐量，通常只在增强特征提取器或提升架构效率中选择其一。本文旨在设计一个统一框架，以平衡这两方面的需求。

Result: 在UCF-Crime、ShanghaiTech和CUHK Avenue数据集上，VigilFormer分别取得了87.83%、97.21%和89.74%的AUC分数，在单GPU上达到41.5 FPS，在精度和速度上均优于近期的弱监督方法，达到了SOTA水平。

Insight: 创新点包括：1）引入可变形时空注意力机制，以稀疏采样方式降低计算成本同时保持对不规则运动模式的捕捉能力；2）结合因果卷积和对比多示例学习进行弱监督异常分类，无需帧级标签；3）提出自适应置信度调度器，在推理时动态调整计算负载以提升实时性能。

Abstract: Video anomaly detection in surveillance settings must balance detection accuracy against real-time throughput, a tension that existing methods address either through stronger feature extractors or more efficient architectures, but rarely both. We present VigilFormer, a unified framework that combines deformable spatio-temporal attention with causal temporal modeling to detect anomalies in untrimmed surveillance video. The proposed Deformable Spatio-Temporal Encoder (DSTE) attends to a sparse set of informative locations across frames, avoiding the quadratic cost of dense attention while retaining the ability to capture irregular motion patterns. A Causal Anomaly Classifier (CAC) applies dilated causal convolutions over snippet-level features and optimizes a contrastive multiple-instance learning objective that separates anomalous and normal representations without frame-level labels. To meet deployment constraints, an Adaptive Confidence Scheduler (ACS) dynamically skips low-information frames at inference time, reducing redundant computation in static scenes. Evaluated on UCF-Crime, ShanghaiTech, and CUHK Avenue, VigilFormer achieves AUC scores of 87.83%, 97.21%, and 89.74% respectively, at 41.5 FPS on a single GPU, outperforming recent weakly-supervised methods in both accuracy and speed.

[74] Disagreement-Based Cross-Model Routing for Implicit Video Question Answering cs.CVPDF

Durga Sandeep Saluru

TL;DR: 本文研究隐式视频问答（ImplicitQA）基准上的多项选择问题，其中正确答案从未在画面中明确显示，而需通过屏幕外事件、视线线索、因果结构和跨镜头空间布局进行推断。针对单一前沿视频大语言模型（LLM）在该基准上已接近其准确率上限，且传统自一致性策略（同一模型多次采样的多数投票）可能因错误相关而损害性能的问题，作者提出了一种无需标签和训练、纯推理时的方法——基于分歧的跨模型路由。该方法通过三次采样原生视频模型（Gemini 3.1 Pro Preview），利用其视频处理流程的真实样本间方差识别出约20%存在分歧的问题子集，并将该子集路由到另一个不同家族的模型（Claude Opus 4.8）进行自适应思考处理。在验证集和独立测试集上，该方法均显著提升了平均准确率，尤其在依赖跨镜头参考解析的类别上增益明显。

Details

Motivation: 解决在隐式视频问答（ImplicitQA）基准上，单一前沿视频LLM性能接近天花板，且传统自一致性策略因模型在困难问题上的错误相关性而可能损害性能的问题。

Result: 在包含1001个问题的验证集上，该方法比主模型最佳单次采样的平均准确率（AvgAcc）提升了+1.43个百分点，在运动与轨迹、推断计数和垂直空间推理等类别上分别获得+5.49、+3.45和+1.82的增益。在独立的CVPR 2026挑战测试集上，平均准确率达到82.03（提升+1.81），确认了验证结果的有效性。

Insight: 创新点在于提出了一种纯推理时、无需训练的跨模型路由策略，其核心是利用同一模型内部处理流程的固有方差（而非通过温度采样引入的随机性）来识别模型不确定的困难问题子集，并智能地将这些子问题路由到另一个架构不同的模型进行处理，从而有效提升整体性能，特别是在需要复杂跨镜头推理的任务上。

Abstract: We study multiple-choice video question answering on the ImplicitQA benchmark, where the correct answer is never explicitly shown but must be inferred from off-screen events, line-of-sight cues, causal structure, and cross-shot spatial layout. On this benchmark a single frontier video LLM already operates near its accuracy ceiling, and we observe that conventional self-consistency strategies – majority voting across repeated samples of the same model – can hurt rather than help, because the model’s errors on hard questions are correlated. We propose disagreement-based cross-model routing, a pure inference-time procedure that requires no labels and no training. We triple-sample a native-video model (Gemini 3.1 Pro Preview) at temperature zero, exploit the genuine sample-to-sample variance of its video-processing pipeline to identify the roughly 20% subset of questions where the three samples disagree, and route only that subset to a second model from a different family (Claude Opus 4.8) that consumes uniformly sampled frames with adaptive thinking. On the 1001-question validation set with public ground truth – our main evaluation – the method improves AvgAcc by +1.43 over the best single sample of the primary model, with per-category gains concentrated on Motion & Trajectory (+5.49), Inferred Counting (+3.45), and Vertical Spatial Reasoning (+1.82) – the categories most dependent on cross-shot reference resolution. The same pipeline applied to the held-out 172-question CVPR 2026 ImplicitQA challenge test set achieves 82.03 AvgAcc / 79.71 MacroAvgAcc (+1.81 over the best single sample of the primary model), confirming the validation result on an independent split.

[75] Interpolation between Convolution and Attention via K-Nearest Neighbors cs.CVPDF

Mingi Kang

TL;DR: 论文提出了一种名为ConvNN的统一框架，通过k近邻聚合将卷积和自注意力操作统一起来。该框架将卷积视为基于空间邻近性的邻居选择，而自注意力则基于特征相似性，两者被置于一个连续谱系中。ConvNN可作为卷积层和注意力层的即插即用替代，允许通过可配置参数探索局部与全局聚合之间的中间状态。

Details

Motivation: 动机在于弥合卷积神经网络与Transformer之间的鸿沟，它们通常被视为根本不同的架构。论文旨在揭示卷积和自注意力在邻居选择与加权聚合方面的内在统一性，解决两者被视为对立计算范式的问题。

Result: ConvNN框架能够精确恢复标准卷积、深度可分离卷积以及自注意力及其稀疏变体（如KVT-attention）。它作为一个通用模块，在多个基准测试中可作为卷积和注意力层的直接替代，但摘要未提及具体的定量性能比较或SOTA结果。

Insight: 创新点在于将卷积和自注意力统一为k近邻聚合的特殊情况，基于空间邻近性与特征相似性构建连续谱系。客观来看，这提供了可配置的中间操作（如相似性函数、邻居选择策略等），为设计混合架构提供了灵活的理论与实践基础。

Abstract: The shift from Convolutional Neural Networks to Transformers has reshaped computer vision, yet these two architectural families are typically viewed as fundamentally distinct. Convolutional Neural Networks are defined by spatially local convolution operations, while Transformers rely on global self-attention. We argue that convolution and self-attention, despite their apparent differences, can be unified within a single k-nearest neighbor aggregation framework. The critical insight is that both operations are special cases of neighbor selection and weighted aggregation. Convolution selects neighbors by spatial proximity while self-attention selects by feature similarity, revealing that they lie on a continuous spectrum rather than representing categorically different computations. We introduce Convolutional Nearest Neighbors (ConvNN), a unified framework that formalizes this connection. ConvNN exactly recovers standard and depthwise convolution by restricting neighbor selection to normalized spatial coordinates, and exactly recovers self-attention and its sparse variants, including KVT-attention, by replacing spatial proximity with scaled dot-product similarity. Beyond these special cases, ConvNN serves as a drop-in replacement for both convolution and attention layers, enabling systematic exploration of the intermediate spectrum between local and global aggregation through configurable similarity functions, neighbor selection strategies, positional encodings, and aggregation kernels.

[76] FUSE: Quantifying Uncertainty in Vision-Language Models by Bayesian Fusing Epistemic and Aleatoric Uncertainty cs.CVPDF

Harry Zhang, Luca Carlone

TL;DR: 本文提出了FUSE框架，用于量化视觉语言模型（VLMs）中的不确定性。该框架通过贝叶斯融合机制，将源自输入数据视觉语言歧义的偶然不确定性（aleatoric uncertainty）与源自模型语义响应多样性的认知不确定性（epistemic uncertainty）结合起来，生成一个标量不确定性度量，以可靠预测模型在下游应用中的输出正确性。

Details

Motivation: 在机器人等关键应用中，量化视觉语言模型输出的不确定性至关重要。现有方法未能充分结合不同类型的不确定性来源。

Result: 该方法在不确定性校准方面超越了基线方法，并达到了当前最优水平（SOTA）。

Insight: 创新点在于提出了一个统一的贝叶斯框架，首次将视觉语言建模中的嵌入级偶然不确定性和模型级认知不确定性进行解析融合，从而生成一个可用于下游应用的可信标量不确定性度量。

Abstract: Vision-language models (VLMs) are playing an increasingly important role across multiple domains. In many applications, such as robotics, it is crucial to quantify the uncertainty in the output of these models. } We develop FUSE, a probabilistic framework for capturing two complementary sources of uncertainty in vision-language modeling: (i) aleatoric embedding-level uncertainty derived from input data vision-language ambiguity, and (ii) epistemic model-level uncertainty estimated from the semantic response diversity of VLMs. Our approach formulates a Bayesian fusion mechanism that analytically combines these uncertainty sources to produce a scalar measure of uncertainty. This measure can be used to reliably predict the model’s output correctness for downstream applications. We demonstrate that our method outperforms baselines and achieves SOTA uncertainty calibration.

[77] Hierarchical GRU with Input-Conditioned Slot Queries for Ball Action Anticipation cs.CVPDF

Parthsarthi Rawat

TL;DR: 本文提出了一种用于足球比赛视频中球动作预测的分层模型。该模型通过一个共享的局部Transformer编码每个5秒子窗口的片段级特征，然后使用GRU聚合所有子窗口的时间上下文，最后通过一个带有K个输入条件事件槽的Transformer解码器，利用三个解耦头（目标性、类别、时间偏移）解码预测目标。

Details

Motivation: 解决足球比赛视频中球动作预测的问题，即在给定30秒观察窗口的情况下，预测后续5秒窗口内发生的10类动作。

Result: 在SoccerNet Ball Action Anticipation基准测试中，该方法在测试服务器上达到了17.91%的mAP。

Insight: 创新点包括引入频率重加权匈牙利匹配以系统性地偏好罕见动作类别，以及使用高斯软目标进行时间区间监督；从客观角度看，分层结构结合Transformer和GRU，以及输入条件事件槽的设计，有效整合了局部和全局时间信息。

Abstract: We present a hierarchical model for ball action anticipation in football broadcast video. Given a 30-second observation window, the system predicts actions occurring in the subsequent 5-second window across 10 classes. A shared local Transformer encodes clip-level features within each 5-second sub-window; a GRU then aggregates temporal context across all sub-windows; finally, a Transformer decoder with K input-conditioned event slots decodes the anticipation target via three decoupled heads (objectness, class, temporal offset). We introduce frequency-reweighted Hungarian matching that systematically favours rare action classes, and Gaussian soft targets for temporal bin supervision. On the SoccerNet Ball Action Anticipation benchmark, our method achieves 17.91% mAP on the test server.

[78] Steady-Forcing: Balancing Spatial Persistence and Motion Continuity in Long-Horizon Nature Video Diffusion cs.CV | cs.AI | cs.LG | cs.MMPDF

Matiur Rahman Minar, Seunghun Oh, GangHyeon Jeong, Unsang Park

TL;DR: 本文提出Steady-Forcing框架，旨在解决自回归视频扩散模型在长序列生成中面临的空间布局漂移与运动连续性抑制的权衡问题。该框架通过结合视觉锚点、运动记忆、块相对时间编码等技术，在固定摄像机自然场景视频生成中，同时保持背景一致性和流体动态的视觉合理性。

Details

Motivation: 自回归视频扩散模型在长序列生成时，静态场景布局会发生漂移，而增强空间稳定性的机制又会抑制运动，导致水流、火焰等自然流动停滞。本文旨在研究并解决这一稳定性与运动性之间的权衡问题，特别是在固定摄像机长序列自然视频生成场景中。

Result: 在七个基线模型上的评估表明，Steady-Forcing改善了长序列背景一致性和成像质量。盲测用户研究显示其在感知稳定性和运动连续性方面表现更强。同时，论文指出通用VBench基准测试在评估固定摄像机场景时存在不足。

Insight: 核心创新在于提出一个集成了持久视觉锚点、指数移动平均运动记忆、块相对时间编码和周期性缓存净化等组件的综合框架，以协同方式平衡空间持久性与运动连续性。此外，论文对现有基准测试的局限性进行了批判性分析，为未来任务特定基准的建立提供了动机。

Abstract: Autoregressive video diffusion models enable streaming generation but often degrade over long rollouts: static scene layouts drift, while mechanisms that improve spatial stability tend to suppress motion, causing natural flows such as water, fire, or smoke to stagnate. We study this stability-motion trade-off in fixed-camera long-horizon nature video generation, where the two failure modes can be more clearly separated than in moving-camera settings. We propose Steady-Forcing, a memory and training framework combining a persistent visual anchor (V-Sink), an exponential moving-average motion memory (EMA-Sink), block-relative temporal encoding, periodic cache purification, and distillation from a Wan2.1-14B teacher with motion-rewarded priors under task-focused configurations. Together, these components are designed to preserve background identity while sustaining visually plausible fluid dynamics over multi-minute autoregressive rollouts. Evaluations across seven baselines show that Steady-Forcing improves long horizon background consistency and imaging quality, while a blind user study indicates stronger perceived stability and motion continuity. The benchmark evaluation further suggest that generic VBench aggregate scores under-penalize fixed-camera artifacts as well as rewarding drift-induced optical flow as Dynamic Degree while not directly penalizing texture hardening or flow stagnation - motivating future task-specific benchmarks for static-camera nature-flow evaluation. Project page: https://minar09.github.io/steadyforcing/

[79] UtVAA: Ultra-tiny Vision Transformer with Affix Attention for Mobile Image Classification cs.CVPDF

Romiyal George, Sathiyamohan Nishankar, Selvarajah Thuseethan, Roshan G. Ragel

TL;DR: 本文提出了一种名为UtVAA的超小型视觉Transformer架构，旨在在严格的计算预算下实现高效的视觉识别。它引入了新颖的Affix Attention块和Dilated Bottleneck块，以极低的参数量和计算量（最小模型仅20.47万参数和5395万FLOPs）在多个图像分类数据集上取得了有竞争力的准确率。

Details

Motivation: 尽管视觉Transformer在图像分类中表现出强大的表示能力，但其二次自注意力复杂性和大量参数限制了其在资源受限的移动和边缘设备上的部署。本文旨在设计一种超小型、高效的视觉Transformer架构，以解决这一部署难题。

Result: 在CIFAR-10、CIFAR-100、PlantVillage-Tomato和SLIF-Tomato数据集上的实验结果表明，UtVAA在参数量低于百万的范围内取得了有竞争力的准确率，证明了其有效性。

Insight: 论文的创新点在于提出了Affix Attention块，它融合了深度可分离卷积的局部特征提取、线性自注意力、坐标注意力以及轻量级三元融合策略，以高效整合局部和全局表示。同时，Dilated Bottleneck块通过空洞深度可分离卷积扩展感受野，同时保持低计算量和稳定的优化。这为在移动端部署Transformer模型提供了新的设计思路。

Abstract: Vision Transformers (ViTs) have demonstrated strong representation capability in image classification. However, their quadratic self-attention complexity and large parameter counts limit deployment on resource-constrained mobile and edge devices. This paper introduces UtVAA, an ultra-tiny Vision Transformer architecture designed for efficient visual recognition under strict computational budgets. It incorporates a novel Affix Attention block that combines depthwise-pointwise local feature extraction, linear self-attention, coordinate attention for spatial dependency modelling, and a lightweight ternary fusion strategy to integrate local and global representations. In addition, Dilated Bottleneck blocks expand the receptive field using dilated depthwise separable convolutions while maintaining low FLOPs and stable optimisation through residual connections. UtVAA is implemented in scalable Tiny, Medium, and Large variants, with the smallest model containing 204.67K parameters and 53.95M FLOPs. Experimental results on CIFAR-10, CIFAR-100, PlantVillage-Tomato and SLIF-Tomato datasets show that UtVAA achieves competitive accuracy within a sub-million-parameter regime. Overall, the results demonstrate that transformer-based vision models can be redesigned into ultra-tiny architectures without significant loss in discriminative performance, making UtVAA suitable for mobile and edge deployment. Code is available at https://github.com/romiyal/UtVAA

[80] GridVQA-X: A Framework for Evaluating Multimodal Explainability Methods cs.CVPDF

Sujay Belsare, Sudarshan Nikhil, Sushant Kumar, Ponnurangam Kumaraguru, Chirag Agarwal

TL;DR: 本文提出了GridVQA-X框架，这是首个专门用于评估跨模态可解释性方法的诊断框架。该框架利用封闭世界的合成逻辑生成具有数学保证的唯一解释，并训练了具有相同架构但推理行为截然不同的成对模型（一个学习稳健的空间关系推理，另一个被迫依赖跨模态捷径），从而为评估解释方法是否忠实捕捉真实的跨模态协同作用提供了严格的测试平台。研究发现，当前广泛使用的可解释性方法无法区分依赖真实空间关系推理的模型与利用跨模态捷径的模型。

Details

Motivation: 随着视觉语言模型的快速发展，其预测需要向相关利益方提供可解释性。然而，可解释性领域未能跟上多模态发展的步伐，当前的多模态可解释人工智能方法缺乏能够区分真实跨模态推理与浅层跨模态捷径的评估协议。

Result: 研究结果表明，广泛使用的可解释性方法无法区分依赖真实空间关系推理的模型和利用跨模态捷径的模型，这揭示了它们在捕捉真实跨模态协同作用方面存在关键缺陷，并错误地表示了多模态模型的实际决策方式。

Insight: 论文的核心创新在于提出了首个专门用于评估跨模态可解释性方法的诊断框架GridVQA-X，其关键设计是利用受控环境生成具有数学保证的唯一解释，并构建行为分化的成对模型作为严格的测试基准，从而能够客观地检验解释方法的忠实性。这为评估和推动多模态可解释性研究提供了新的方法论基础。

Abstract: With the increasing development of Vision-Language Models, it becomes imperative that their predictions are readily explainable to relevant stakeholders. However, the field of explainability has not kept pace with the multimodal surge. While recent Multimodal Explainable AI (MxAI) methods generate explanations to attribute the interaction between different modalities, current evaluation protocols lack the ground truth required to distinguish between true cross-modal reasoning (e.g., spatial composition) and shallow cross-modal shortcuts (e.g., Bag-of-Words attribute matching). It remains unknown whether MxAI methods faithfully capture synergistic interactions or merely hallucinate reasoning on models acting as simple feature detectors. In this paper, we introduce GridVQA-X, the first diagnostic framework specifically designed to evaluate cross-modal explainability. Unlike natural datasets, GridVQA-X leverages a closed-world synthesis logic to generate unique, mathematically guaranteed explanations. We utilize this controlled environment to train paired ground-truth models on identical architectures: $M_{\text{pure}}$, which learns robust spatial-relational reasoning and $M_{\text{spur}}$, which is structurally forced to rely on cross-modal shortcuts. This behavioral divergence creates a rigorous testbed: a faithful explainer must report distinct reasoning pathways for each model. Our findings reveal that widely used methods fail to distinguish between models relying on genuine spatial-relational reasoning and those exploiting cross-modal shortcuts, highlighting a critical gap in capturing true cross-modal synergy and misrepresenting how multimodal models actually make decisions.

[81] HorusEye: Language as Dynamic Attention for Emergency Visual Analysis cs.CV | cs.LGPDF

Armel Yara

TL;DR: 本文提出了HorusEye，一种将语言作为动态注意力机制用于紧急视觉分析的方法。研究通过五个阶段进行：首先构建了RefCOCO-Degraded基准数据集，包含15,244张图像（3,811张基础图像×4种条件：清晰、雾、烟雾和热成像），并系统评估了多种视觉语言模型（VLMs）在视觉定位、语言反馈恢复、健康VQA任务和幻觉分析上的表现。关键发现包括语言反馈效果因模型而异，以及热成像中存在的‘热悖论’现象。

Details

Motivation: 解决在紧急情况下（如雾、烟雾、热成像等视觉退化条件）视觉语言模型的可靠性和适应性不足的问题，以支持紧急视觉分析任务。

Result: 在RefCOGO-Degraded基准上评估了Gemini、Qwen2-VL、BLIP-2等模型。Gemini在热成像条件下通过迭代语言反馈提升了47.3%，而Qwen2-VL在同一协议下下降了5.1%；BLIP-2在退化条件下幻觉更严重，不适合紧急部署。

Insight: 创新点在于将语言作为动态注意力机制来增强模型在紧急场景下的鲁棒性，并揭示了语言反馈的模型依赖性及热成像中的‘热悖论’（裁剪策略在RGB图像有效却在热成像中失败），为紧急视觉分析提供了重要洞见。

Abstract: We introduce HorusEye, Language as Dynamic Attention for Emergency Visual Analysis. Our investigation followed five stages. The first one is benchmarking RefCOCO-Degraded, a dataset of 15,244 images (3,811 base images x 4 conditions: Clean, Fog, Smoke and Thermal) with systematic visual degradation. Through four research questions, we evaluate multiple VLMs (Gemini, Qwen2-VL, BLIP-2, LLaVA, Kosmos-2) across visual grounding the second stage, language feedback recovery the third one, health VQA tasks the fourth, and hallucination analysis the final stage. Our key finding is that language feedback effectiveness is model-dependent: Gemini achieves +47.3% improvement in thermal conditions through iterative language feedback, while Qwen2-VL shows -5.1% degradation under the same protocol. We also identify the ‘Thermal Paradox’ where cropping strategies that improve RGB performance catastrophically fail in thermal imagery. Furthermore, BLIP-2 uniquely hallucinates more under degradation, making it unsuitable for emergency deployment

[82] MMLongEmbed: Benchmarking Multimodal Embedding Models in Long-Context Scenarios cs.CV | cs.AIPDF

Haitian Wang, Ruoxi Sun, Quantong Qiu, Juntao Li, Junhui Li

TL;DR: 该论文提出了首个针对长上下文场景的多模态嵌入模型（MEMs）综合基准测试MMLongEmbed，旨在系统评估模型在长上下文多模态输入下的理解和表示能力。基准包含跨文本、文档和视频模态的四个检索任务，覆盖多种上下文长度范围。通过评估现有SOTA模型，发现它们严重依赖表层特征匹配，难以捕捉深层语义和结构依赖，且性能退化与上下文长度及关键信息位置系统性相关。

Details

Motivation: 当前多模态嵌入模型的理论上下文窗口虽已显著扩大，但模型对长上下文多模态输入的有效理解和表示能力仍是实际部署的关键瓶颈，且缺乏系统评估。

Result: 在MMLongEmbed基准上对SOTA模型进行广泛评估，发现性能随上下文长度增加而退化，且退化模式与关键信息放置位置相关；模型对不同模态冗余信息的鲁棒性存在显著差异。

Insight: 创新点在于构建了首个长上下文多模态嵌入基准，揭示了现有模型依赖表层匹配、难以处理深层语义依赖的局限性，并系统性分析了上下文长度和信息位置对性能的影响，为模型改进提供了方向。

Abstract: Recent advancements have significantly expanded the theoretical context windows of Multimodal Embedding Models (MEMs). However, larger context windows do not necessarily translate into effective comprehension and representation of long-context multimodal inputs, which remains a critical bottleneck for real-world deployment. To address the lack of systematic evaluation in this setting, we introduce MMLongEmbed, the first comprehensive benchmark for evaluating MEMs in long-context scenarios. MMLongEmbed comprises four retrieval tasks spanning multiple context-length ranges, covering text, document, and video modalities. Through extensive evaluation of state-of-the-art models, we find that current architectures rely heavily on superficial feature matching and struggle to capture deep semantic and structural dependencies. We further observe that performance degradation varies systematically with context length and key information placement. Moreover, models exhibit substantially different robustness to redundant contextual information across modalities. For reproducibility, the benchmark and code are publicly available.

[83] Is My Vision-Language Data in Your AI? Membership Inference Test (MINT) Demo 2 cs.CV | cs.AIPDF

Daniel DeAlcala, Gonzalo Mancera, Julian Fierrez, Aythami Morales, Ruben Tolosana

TL;DR: 本文介绍了MINT Demo 2框架，这是一个旨在提高机器学习训练过程透明度的成员推理测试工具。该框架通过实验方法确定特定数据是否被用于模型训练，并针对不同信息已知程度的被审计模型提出了多种架构。实验在面部识别模型和多个SOTA大语言模型上进行，在大型公共图像和文本数据库上实现了高达90%的训练数据检测准确率，并构建了一个集成了多种MINT变体的综合性Web平台以促进AI透明度和合规性。

Details

Motivation: 论文的动机是解决机器学习模型训练过程缺乏透明度的问题，旨在提供一种技术手段来审计特定数据是否被用于模型训练，以应对日益增长的AI监管需求。

Result: 实验结果表明，在流行的面部识别模型和4个SOTA大语言模型上，使用多个大规模公共图像和文本数据库进行测试，其训练数据检测准确率最高可达90%。

Insight: 论文的主要创新点在于提出了一个可扩展的成员推理测试理论框架（MINT），并针对不同审计场景（信息已知程度不同）设计了多种具体架构（如aMINT, gMINT）。从客观角度看，其将成员推理测试系统化并构建为实用平台，为促进AI透明度和合规性提供了可操作的工具。

Abstract: We present the Membership Inference Test (MINT) Demo 2, a framework designed to improve transparency in machine learning training processes. MINT is a technique for experimentally determining whether specific data were used during machine learning model training. We establish the theoretical framework and propose multiple architectures for MINT depending on the amount of information known about the models that are being audited. Experimental results using a popular face recognition model, 4 state-of-the-art LLMs, and multiple, diverse, and large-scale public image and text databases achieve promising accuracy levels in the detection of training data of up to 90%. Building on these results, we introduce a comprehensive web platform1 that expands these capabilities to image and text modalities. The platform integrates a diverse technological stack, including MINT, aMINT, and gMINT, allowing users to audit a wide range of models. This demonstrator aims to promote AI transparency and provides a practical tool to foster compliance with emerging AI regulations.

[84] Automated 3D Kinematic Monitoring for Circadian Activity and Anomaly Detection in Juvenile Fish cs.CV | cs.AIPDF

Chih-Wei Huang, Chang-Wen Huang, Chung-Ping Chiang, Tsung-Wei Pan

TL;DR: 本研究提出了一种用于精准水产养殖的高通量三维行为表型分析框架，结合深度学习目标检测与双目立体视觉，实现了对高密度环境中幼年罗非鱼的非接触式实时监测。该系统自动化估计体长并重建三维游泳轨迹，精确量化三维速度和加速度，首次估算了自由游动幼鱼的真实游泳速度。

Details

Motivation: 精准水产养殖面临’表型瓶颈’，传统方法无法量化瞬时三维体力消耗，本研究旨在解决高分辨率行为特征追踪的难题。

Result: 该框架成功建立了昼夜运动基线，可作为生理应激的早期预警系统，并为鱼类活力提供了客观指标。

Insight: 创新点在于整合深度学习与双目立体视觉以消除二维透视畸变，首次实现自由游动幼鱼真实三维游泳速度的精确量化，为行为表型分析提供了新方法。

Abstract: Precision aquaculture faces a “phenotyping bottleneck” in tracking high-resolution behavioral traits, as conventional methods cannot quantify instantaneous three-dimensional (3D) physical exertion. To address this, we present a high-throughput 3D behavioral phenotyping framework integrating deep learning object detection with binocular stereo vision for real-time monitoring of juvenile tilapia in high-density environments. The system automates non-contact body length estimation and reconstructs 3D swimming trajectories from absolute spatial coordinates. By eliminating 2D perspective distortions, this approach precisely quantifies 3D velocity and acceleration, marking the first estimation of true physical swimming speeds in free-roaming juveniles. Results show the framework successfully establishes circadian locomotor baselines, serving as an early warning system for physiological stress and providing an objective metric for fish vitality.

[85] Beyond Self-Attention: Sub-Quadratic Vision Transformers for Fast Image Captioning cs.CV | cs.AIPDF

Chiradeep Ghosh, Dakshina Ranjan Kisku

TL;DR: 本文提出了一种基于高斯混合模型（GMM）的概率Transformer方法，用于改进视觉Transformer在图像描述生成任务中的计算效率。该方法通过期望最大化（EM）算法将相似的图像块聚类，将自注意力机制的计算复杂度从二次O(n^2)降低到线性O(nK)，并采用自回归GPT解码器生成描述。

Details

Motivation: 现有基于Transformer的图像描述方法存在计算成本高（二次自注意力）和缺乏丰富局部特征表示的问题，本文旨在通过重构视觉Transformer架构来提高计算效率。

Result: 模型在Flickr 30K数据集上进行了评估，结果显示其性能具有竞争力，并相比现有工作有显著提升。

Insight: 主要创新点在于用基于GMM的软聚类技术替代标准自注意力机制，通过聚类减少计算复杂度，同时保持模型性能，为高效视觉Transformer设计提供了新思路。

Abstract: Image captioning is a challenging and significant task that aims to generate coherent and semantically meaningful textual descriptions for given images. To accomplish this task, it requires a deep understanding of visual content along with the ability to express that understanding in natural language. Despite remarkable progress with transformer-based architectures, existing approaches often suffer from limitations, such as a lack of rich local feature representations and the high computational cost of quadratic self-attention. The proposed model focuses on improving computational efficiency by restructuring the vision transformer architecture. In designing this approach, the standard self-attention mechanism in Vision Transformers is replaced with a probabilistic transformer approach based on a Gaussian Mixture Model (GMM), a soft-clustering technique. Instead of computing pairwise attention among all image patches, the model groups similar patches into a fixed number of clusters using an Expectation-Maximization (EM) algorithm. This clustering-based mechanism reduces the computational complexity from quadratic O(n^2) to linear O(nK), where K << n. The autoregressive GPT-based decoder is used for caption generation. The model is evaluated on the Flickr 30K dataset, demonstrating competitive and significant improvement over existing works.

[86] Sub-Semantic Image Segmentation cs.CV | cs.AIPDF

Aviad Cohen Zada, Nadav Orenstein, Shai Avidan, Gal Oren

TL;DR: 该论文提出了一种新的图像分割类别——子语义图像分割，它介于基于视觉线索的纹理分割和基于对象的语义分割之间。通过将通用视觉语言模型与SAM 3分割主干耦合，并引入DETECTURE方法解决耦合中的三个具体失败模式，实现了用语言描述稳定外观模式的分割。作者还创建了TextureADE数据集用于评估，并验证了DETECTURE在多个数据集和指标上的优越性能。

Details

Motivation: 解决现有图像分割方法（如纹理分割和语义分割）之间的界限模糊问题，提出一种新的子语义分割类别，旨在使用语言将图像分割成可由语言描述的稳定外观模式，而非命名整个对象。

Result: 在多个数据集上使用不同指标进行评估，DETECTURE方法相比多个基线实现了最强的性能，达到了最先进水平（SOTA）。

Insight: 创新点在于提出了子语义图像分割这一新类别，并设计了DETECTURE方法，通过解决语言泄漏、提示竞争和语义扭曲三个具体失败模式，有效耦合了视觉语言模型与分割主干；同时，从ADE20K数据集衍生构建了TextureADE数据集，为这一新任务提供了基准。

Abstract: Images can be segmented based on visual cues (i.e., texture segmentation) or into objects (i.e., semantic segmentation). We propose a new category of sub-semantic image segmentation that blurs the line between the two. In sub-semantic image segmentation, language is not used to name whole objects. Instead, it is used to partition an image into stable appearance patterns that can be described by language. To do that, we couple a general-purpose vision-language model to SAM 3, a promptable segmentation backbone whose native text pathway can ground rich descriptions into masks. Simple coupling fails for a number of reasons that we identify in the paper, and we overcome them by introducing DETECTURE that resolves three concrete failure modes – language leakage between texture regions, prompt competition inside the segmentation backbone, and semantic distortion at the language-to-mask interface. Since there is no dataset of sub-semantic image segmentation, we introduce one, termed TextureADE. The new dataset is derived from the ADE20K dataset using a system we designed. We compare DETECTURE to a number of baselines and find that it achieves the strongest performance on several datasets using different metrics. Code is available at https://github.com/Scientific-Computing-Lab/TextureDetecture.

[87] X-Tokenizer: A Multimodal Action Tokenizer for Vision-Language-Action Pretraining cs.CV | cs.AI | cs.LG | cs.ROPDF

Xirui Kang, Yanpei Shi, Lucy Liang, Roy Gan, Dongxiu Liu

TL;DR: 本文提出了X-Tokenizer，一种用于视觉-语言-动作（VLA）预训练的多模态动作分词器。它将动作分词重新定义为连接多模态推理与可执行控制的语义接口学习，而非简单的压缩。通过引入语义残差量化（SRQ）架构，并结合对比对齐与下一帧视觉语言特征预测进行预训练，该模型在真实世界和仿真任务中取得了优异性能。

Details

Motivation: 现有VLA模型中的动作分词器主要为了重建而离散化动作，其生成的编码虽能保留运动几何信息，但仅能为骨干网络提供微弱的语义监督。因此，本文旨在将动作分词构建为连接多模态推理与精确连续机器人控制的语义接口。

Result: 在2.4M条轨迹（2.0B个动作帧）上预训练后，X-Tokenizer在真实世界任务中取得了最佳的聚合性能，并在RoboTwin 2.0仿真基准上表现出色。它在多模态接地任务上比FAST模型提升了13.5%，在长时程任务上提升了8.25%，证明了其作为语义接口的有效性。

Insight: 核心创新在于将动作分词重新定义为语义接口学习，并提出了语义残差量化（SRQ）架构。SRQ在残差向量量化中引入了非对称结构：第一层通过掩码动作建模（MAM）学习以捕捉粗略运动意图，形成离散动作语言；更深层则保持重建导向的残差以保留细粒度细节。此外，通过对比对齐到预训练基础模型的表示空间以及下一帧视觉语言特征预测，进一步将动作令牌与多模态语义对齐。

Abstract: Modern Vision-Language-Action (VLA) models must bridge pretrained vision-language reasoning and precise continuous robot control. Existing action tokenizers discretize actions primarily for reconstruction, producing codes that preserve motion geometry but provide only weak semantic supervision to the backbone. We therefore formulate action tokenization not as mere compression, but as semantic interface learning between multimodal reasoning and executable control. To this end, we introduce X-Tokenizer, a lightweight encoder-Semantic Residual Quantization (SRQ)-decoder architecture that provides a shared action interface across diverse robotic arm embodiments. Its key component, SRQ, imposes an asymmetric structure on residual vector quantization: the first level is trained with Masked Action Modeling (MAM) to form a discrete action language that captures coarse motion intent, while deeper levels remain reconstruction-oriented residuals that preserve fine-grained details. To further align action tokens with multimodal semantics, X-Tokenizer is pretrained with contrastive alignment to the representation space of a pretrained foundation model and with next-frame vision-language feature prediction. Pretrained on 2.4M trajectories (2.0B action frames), a single frozen X-Tokenizer plugs into a mixed discrete-continuous VLA as a representation-shaping supervision signal. X-Tokenizer achieves top real-world aggregate and strong RoboTwin 2.0 simulation results. Outperforming FAST in multimodal grounding (+13.5%) and long-horizon tasks (+8.25), it shows that action tokenizers serve as semantic interfaces for VLA pretraining beyond mere action compression.

[88] Divide-and-Denoise: A Game-Theoretic Method for Fairly Composing Diffusion Models cs.CV | cs.AI | cs.LGPDF

Abhi Gupta, Polina Barabanshchikova, Vikas Garg, Samuel Kaski, Tommi Jaakkola

TL;DR: 本文提出了一种名为Divide-and-Denoise的博弈论方法，用于协调多个预训练扩散模型在采样过程中的合成。该方法通过在每个时间步求解一个公平分配游戏来动态分配各模型对噪声样本不同区域的责任，并引导模型在其分配区域内去噪，从而形成一种新的复合去噪过程。

Details

Motivation: 动机在于解决组合多个预训练扩散模型时可能出现的模型主导或模型间不一致的问题，旨在公平且高效地协调多个模型的专业能力。

Result: 在条件图像生成任务上，该方法在包括GenEval基准在内的多个质量指标上优于基线方法，解决了缺失对象和属性不匹配等常见故障，实验表明它能有效利用每个模型的专长而不忽视任何其他模型。

Insight: 创新点在于将扩散模型的组合问题形式化为一个公平分配博弈，通过动态分配和责任对齐机制实现模型的协调，这为多模型合成提供了一种基于博弈论的新颖框架。

Abstract: The abundance of pre-trained diffusion models provides an opportunity for composition. Combining several models, however, runs the risk of one model dominating or models disagreeing with each other. Here, we propose Divide-and-Denoise, a method for coordinating multiple pre-trained diffusion models during sampling. Much like managing a specialized workforce, our method creates a fair but efficient division of labor across models. Central to our method is the notion of an allocation which defines the responsibility of each model to every region of the noisy sample. At every timestep, we then denoise by (i) updating the allocation by solving a fair division game, where we divide the sample into regions that maximize total utility under fairness constraints, and (ii) aligning the models with this allocation, where we guide each model to denoise within its assigned region. This leads to a new composite denoising process that evolves in tandem with a division process. We evaluate Divide-and-Denoise on conditional image generation. Across several quality metrics, including the GenEval benchmark, our method outperforms baselines and resolves common failures including missing objects and mismatched attributes. Experiments show that Divide-and-Denoise utilizes each model’s expertise without neglecting any other model.

[89] Spatial Priors via Space Filling Curves for Small and Limited Data Vision Transformers cs.CV | cs.LGPDF

Leyla Naz Candogan, Arshia Afzal, Pol Puigdemont, Volkan Cevher

TL;DR: 本文提出了一种名为VIOLIN的轻量级掩码注意力机制，用于为视觉Transformer（ViT）注入空间归纳偏置。该方法利用空间填充曲线（SFCs）扫描图像，构建曲线特定的衰减掩码，并将其与注意力矩阵结合，以极少的额外参数和计算开销编码空间结构。

Details

Motivation: 由于置换等变性，ViT的注意力机制缺乏显式的空间归纳偏置，这在模型容量小或训练数据有限的情况下变得尤为重要。本文旨在解决这一问题。

Result: 在VTAB-1K微调等有限数据场景下，VIOLIN提升了所有任务组的准确率，在空间信息至关重要的任务上最高提升8.7%。在ImageNet-1K预训练中，它改进了DeiT、DINO等小规模ViT架构。在高度依赖位置信息的像素级CIFAR-100训练任务上，准确率最高提升7.2%。

Insight: 创新点在于利用空间填充曲线（SFCs）构建衰减掩码来编码空间结构，这是一种计算高效且有效的方法。从客观角度看，该方法为ViT引入了一种新颖、轻量级的空间先验注入方式，尤其适用于小模型和有限数据场景，并可与其他参数高效微调方法（如LoRA）结合。

Abstract: Though Vision Transformers (ViTs) have become the dominant backbone in many computer vision tasks, due to permutation equivariance, their attention mechanism lacks explicit spatial inductive biases. This become particularly important in two settings: when model capacity is small or training data is limited. Inspired by the attention masking strategies in Linear Transformers and the scanning patterns of Vision SSMs, we introduce VIOLIN, a lightweight masked attention mechanism that encodes spatial structure within attention via Space Filling Curves (SFCs) with less than 0.0015% extra parameters and negligible computational overhead. VIOLIN scans the image using multiple SFCs to construct curve-specific decay masks, which are then combined and multiplied with the attention matrix. Across a wide range of evaluations, VIOLIN consistently improves performance. In limited data regimes such as fine-tuning on VTAB-1K, it boosts accuracy across all task groups and by up to 8.7% on the tasks where spatial information is essential. It can be combined with parameter-efficient fine-tuning methods such as LoRA to further increase the performance. Beyond fine-tuning, VIOLIN improves various small scale ViT architectures (e.g., DeiT, DINO) during pretraining on ImageNet-1K. Additionally, on pixel-level CIFAR-100 training, a task that is highly dependent on location information, VIOLIN increases accuracy by up to 7.2%. Overall, VIOLIN provides a computationally efficient yet effective way to inject spatial inductive bias into ViTs, especially benefiting small models and limited data settings.

[90] Disentangling Hallucinations: Orthogonal Semantic Projection for Robust Interpretability cs.CV | cs.AIPDF

Emirhan Bilgiç, Baptiste Caramiaux, Zhi Yan, Gianni Franchi

TL;DR: 本文针对视觉语言模型在可解释AI方法中普遍存在的语义幻觉问题，提出了一种理论框架和几何干预方法。通过分析高维嵌入空间中的线性语义泄漏现象，作者提出了正交语义投影技术，以解耦共享概念中的独特语义信号，从而减少幻觉并提升解释的鲁棒性。

Details

Motivation: 随着视觉语言模型在安全关键应用中的部署增加，其解释的可信度变得至关重要。现有可解释AI方法常出现语义幻觉，即归因图会突出显示显著图像区域，即使提示文本描述错误（例如，提示“猫”时却高亮狗的区域）。

Result: 作者从理论上证明了正交语义投影能最小化幻觉，并通过实验验证了该方法在保持正确提示保真度的同时，通过正交化查询向量以对抗干扰概念，有效减少了语义幻觉。

Insight: 创新点在于提出了线性语义归因的统一理论框架，并利用正交匹配追踪的残差特性设计了几何干预方法OSP，从共享概念中解耦独特语义信号，为解决高维嵌入空间中的线性语义泄漏问题提供了新思路。

Abstract: As Vision-Language Models are increasingly deployed in safety-critical applications, the trustworthiness of their explanations becomes crucial. Explainable AI (XAI) methods for Vision-Language Models often suffer from semantic hallucination, where attribution maps highlight prominent image regions even when prompted with incorrect text descriptions (e.g., highlighting a dog when prompted ``cat’’). Although this problem is widespread, a formal mathematical analysis of XAI methods and CLIP embeddings is largely missing in the literature. We demonstrate that this phenomenon is not specific to a single architecture but is a fundamental consequence of Linear Semantic Leakage in high-dimensional embedding spaces. We propose a unified theoretical framework, Linear Semantic Attribution (LSA), which generalizes across discriminative methods. We introduce OSP, a geometric intervention that utilizes the residual property of OMP to disentangle unique semantic signals from shared concepts. We prove theoretically and demonstrate empirically that OSP minimizes hallucination by orthogonalizing the query vector against distractor concepts, rendering the attribution model blind to shared features while preserving fidelity for correct prompts. Our code is available at: https://github.com/emirhanbilgic/Orthogonal-Semantic-Projection

[91] Temporally Consistent and Controllable Video Generation of 2D Cine CMR via Latent Space Motion Modeling cs.CV | cs.AIPDF

Yiheng Cao, Gustavo Andrade-Miranda, Jiatian Zhang, Guillaume Sallé, Xin Gao

TL;DR: 本文提出了一种用于生成时间一致且可控的2D电影心脏磁共振视频的文本到视频框架。该方法通过解耦心脏空间结构与时间运动，先由微调的扩散模型根据临床文本提示生成初始帧以控制解剖特征，再由基于心脏相位嵌入的潜在流模型生成完整的心脏运动，确保了空间一致性和时间可控性。

Details

Motivation: 电影心脏磁共振是评估心脏功能的金标准，但公开数据集的稀缺限制了先进数据驱动模型的发展。为了解决数据稀缺问题，需要一种能够生成高质量、可控的合成心脏序列的方法。

Result: 模型生成的序列在解剖学和病理学上具有多样性，并表现出高时间一致性和对输入提示的强保真度。在图像真实性方面取得了31.68的FID分数，在文本-图像对齐方面取得了31.04的CLIP分数。

Insight: 创新点在于将文本到视频生成任务解耦为空间结构合成与时间运动建模两个阶段，并引入了心脏相位嵌入来条件化潜在流模型，从而实现对心脏运动周期的精确控制。这为医学影像数据合成提供了一种可扩展的、高保真且可控的解决方案。

Abstract: Cine cardiac magnetic resonance is the gold standard for assessing cardiac function, but the scarcity of public datasets limits the development of advanced data-driven models. To address this limitation, we propose a generative method for synthesizing temporally coherent and anatomically consistent cardiac sequences. Our text-to-video framework decouples cardiac spatial structure from temporal motion. First, a fine-tuned diffusion model synthesizes an initial frame from a clinical text prompt, controlling anatomical features. Then, a latent flow model conditioned on a cardiac phase embedding generates the complete cardiac motion, ensuring spatial consistency and temporal control. Our model generates anatomically and pathologically diverse sequences with high temporal coherence and strong fidelity to input prompts, achieving a FID of 31.68 for image realism and a CLIP score of 31.04 for text-image alignment. These experimental results highlight its potential to produce high-fidelity, on-demand medical data, offering a scalable solution to data scarcity.

[92] Scribby: A Multi-Level LLM Framework for Semantic Video Analysis cs.CV | cs.AIPDF

Julian Abelarde, Hugo Garrido-Lestache Belinchon

TL;DR: 本文提出了一个名为Scribby的多层次大语言模型框架，用于对长视频进行语义分析。该框架通过分析完整转录文本、单个句子并进行语义相似性分组，实现了宏观理解与微观语义分析的平衡，旨在生成超越传统粗粒度摘要的、包含视频结构、主题演进和语义关系的详细分析。

Details

Motivation: 随着视频内容在教育平台、录播课程和直播娱乐中的激增，对长视频进行高效、结构化分析的需求日益增长。现有基于AI转录的摘要方法通常只提供粗粒度的概览，缺乏对视频结构、主题演进和语义关系的详细分析，无法满足全面视频分析的需求。

Result: 论文提出了一个框架，并讨论了其作为视频分析工具的基础，能够通过基于相关性的热力图可视化语义分块和语义匹配。摘要中未提及具体的定量实验结果或基准测试。

Insight: 创新点在于提出了一个结合宏观与微观分析的多层次LLM框架，在句子级处理时通过将全局转录分析和相邻句子信息融入提示词来保持上下文连续性，并使用LLM作为评判者进行语义相似性分组，这为生成结构化和语义丰富的视频分析提供了新思路。

Abstract: As video content continues to expand across educational platforms, recorded lectures, and live-streamed entertainment, the need for efficient and structured analysis of long-form footage has increased \cite{1}. Although many existing AI programs provide high-level video summaries based on AI-generated transcripts \cite{2,3,4,5}, these approaches are often limited to coarse overviews and lack detailed analysis of a video’s structure, thematic progression, and semantic relationships, all of which are required for comprehensive video analysis. This paper proposes an LLM-based video summarization framework that balances macro-level comprehension with micro-level semantic analysis \cite{6,12,13}. The first stage of the process indexes the video at a micro level by (1) analyzing the full transcript, (2) analyzing individual transcript sentences, and (3) grouping these sentences by semantic similarity using an LLM as a judge \cite{6,13}. Contextual continuity is retained during sentence-level processing by incorporating both the global transcript analysis and adjacent sentence information into each evaluation prompt. This framework establishes a foundation for video analysis tools that visualize semantic chunking and semantic matching through relevance-based heatmaps. Limitations and future expansions of the framework are also discussed.

[93] Avoiding Exponential Blow-Up in Distributive Lattice Submodular Minimization cs.CV | cs.DMPDF

Ishant Shanu

TL;DR: 本文提出了一种处理定义在分配格上的子模函数最小化的通用框架，避免了传统方法中因将分配格转换为布尔格而导致的工作空间指数级膨胀问题。该框架允许直接利用已有的布尔格子模函数最小化算法，在分配格上进行高效优化。

Details

Motivation: 当前处理分配格子模函数最小化的最佳方法是通过转换将其外推至布尔格，但这会导致工作空间指数级扩大，使得优化系统效率低下。

Result: 实验表明，与传统处理分配格的方法相比，所提框架在运行时间上取得了巨大改进。

Insight: 创新点在于提出了一个直接在分配格内工作的通用框架，避免了空间膨胀，并兼容现有布尔格算法；从客观角度看，该方法通过保持原问题结构来提升效率，是算法设计上的一个巧妙优化。

Abstract: Submodular function minimization has gained a lot of interest in recent years. They are highly applicable in the area of Computer Vision and Machine Learning. Often such applications require to work with submodular functions defined on distributive lattice. Current best way of dealing with it is using a transformation which extrapolates the submodular function for the respective boolean lattice. It makes optimization system too inefficient due to enlargement of the working space. Quantitatively, the expanded space has additional exponential (in set size) number of elements. We propose a generic framework for dealing with distributive lattice which only works within distributive lattice. Our framework allows one to use already established submodular function minimization algorithms for boolean lattice. In our experiment, we show the huge improvement in terms of running time over tranditional methods for handling distributive lattice.

[94] Momentum-Guided Semantic Forecasting (MoFore) for Self-Supervised Video Representation Learning cs.CV | cs.AI | cs.LG | cs.MMPDF

Qinwu Xu

TL;DR: 本文提出了一种名为动量引导语义预测（MoFore）的自监督视频表示学习框架，该方法通过预测未来潜在嵌入来学习时序预测的视频表示，并结合对比正则化来增强时序一致性并防止表示坍缩。

Details

Motivation: 现有的自监督视频表示学习方法（如基于重建的MAE/VideoMAE和基于对比的CLIP）分别关注像素级重建或任务特定的语义对齐，而本文旨在学习具有时序预测能力的视频表示，避免依赖重建目标。

Result: 在UCF101数据集上的实验表明，MoFore无需使用动作标签即可学习到时序一致且语义有意义的视频表示，定量分析显示其具有强时序稳定性和涌现的类别级结构，定性检索实验揭示了跨相关活动的运动感知组织。

Insight: 创新点在于通过长程潜在预测来学习视频表示，结合随机时间间隔预测以提高跨时间尺度的鲁棒性，并利用对比正则化平衡时序一致性与表示多样性，提供了一种计算高效且不依赖重建目标的自监督学习途径。

Abstract: Self-supervised video representation learning has recently advanced through contrastive learning, masked reconstruction, and predictive representation learning. Reconstruction-based approaches such as MAE and VideoMAE learn representations by recovering masked visual content \cite{he2022mae,tong2022videomae}, while contrastive methods such as CLIP learn semantically meaningful embedding spaces through representation alignment \cite{radford2021clip}. In this work, we introduce a Momentum-Guided Semantic Forecasting framework (MoFore) for self-supervised video representation learning. Instead of optimizing for pixel-level reconstruction or task-specific semantic alignment, the proposed method learns temporally predictive video representations by forecasting future latent embeddings from temporally distant context clips. To improve robustness across temporal scales, we further introduce randomized temporal-gap forecasting during training. The framework combines predictive latent forecasting with contrastive regularization to encourage temporal consistency while preventing representation collapse. Experiments on the UCF101 dataset demonstrate that the proposed framework learns temporally consistent and semantically meaningful video representations without using action labels during training. Quantitative analysis shows strong temporal stability and emergent category-level structure in the learned embedding space, while qualitative retrieval experiments reveal motion-aware organization across related activities. Overall, the results suggest that long-range latent forecasting provides an effective and computationally efficient approach for self-supervised video representation learning without relying on reconstruction-based objectives.

[95] XMedFusion: A Knowledge-Guided Multimodal Perception and Reasoning Framework for Autonomous Medical Systems cs.CV | cs.AI | cs.MAPDF

Hamza Riaz, Arham Haroon, Maha Baig, Muhammad Dawood Rizwan, Muhammad Naseer Bajwa

TL;DR: 本文提出了XMedFusion框架，这是一个用于自主医疗系统的知识引导多模态感知与推理模块。该框架通过分解视觉信息为协同工作的功能组件（包括视觉感知、知识图谱构建和检索引导的草拟过程），并利用合成代理进行迭代推理验证，旨在生成可靠且可解释的放射学报告。

Details

Motivation: 现有端到端多模态模型在放射学报告生成任务中存在视觉基础薄弱的问题，导致不可靠的解释和细微临床发现的遗漏，无法满足自动化诊断工作流的需求。

Result: 在公开的胸部X光数据集上的实验表明，该框架在BLEU-1、ROUGE-L、METEOR等指标上相比基线视觉语言模型有显著提升（例如BLEU-1提升0.0493至0.3359），并在语义评估指标如一致性和准确性上也有大幅改进，达到了当前先进水平。

Insight: 创新点在于采用模块化、多代理的感知与推理架构来模拟专家分析流程，通过结构化知识图谱和迭代验证增强报告的可靠性与可解释性，为智能医疗影像系统提供了更稳健、透明的自动化解决方案。

Abstract: Autonomous medical and robotic systems increasingly rely on intelligent perception and reasoning capabilities to interpret visual data and support clinical decision making. Radiology report generation represents a critical component of such automated diagnostic workflows, yet existing end-to-end multimodal models often suffer from weak visual grounding, resulting in unreliable interpretations and omission of subtle clinical findings. This paper presents XMedFusion, a modular AI framework designed as an intelligent perception and reasoning module for autonomous medical systems. The proposed framework decomposes visual information into coordinated functional components that emulate expert-driven analysis, including a visual perception agent that extracts image-grounded evidence, a knowledge graph construction agent that structures clinically relevant findings, and a retrieval-guided drafting process that ensures a consistent reporting structure. A synthesis agent iteratively integrates visual and structured evidence through reasoning-driven verification to produce reliable and interpretable diagnostic outputs. Experimental evaluation on a public chest radiograph dataset demonstrates significant improvements over baseline vision-language models, achieving gains from 0.0493 to 0.3359 in BLEU-1, 0.0863 to 0.2440 in ROUGE-L, and 0.0829 to 0.1708 in METEOR, along with substantial improvements in semantic evaluation metrics such as Consistency (2.38 to 7.80) and Accuracy (2.34 to 6.93). The results highlight the effectiveness of structured multi-agent perception and reasoning for enhancing robustness, transparency, and automation in intelligent medical imaging systems, enabling integration into autonomous healthcare and robotic diagnostic workflows.

[96] An Empirical Analysis of Optimization Dynamics and Sparsity Boundaries in Large-Scale Pedestrian Attribute Recognition cs.CV | cs.AI | cs.IR | cs.LGPDF

Houssam El Mir

TL;DR: 本文针对大规模行人属性识别（PAR）中的极端类别不平衡问题，通过系统性地消融多标签Focal Loss的超参数（alpha和gamma），提出了一种校准配置（alpha=0.50, gamma=2.0），在ResNet-18骨干网络上实现了62.32%的Macro F1分数，与BCE基线相当，同时保持了更好的难例挖掘和收敛动态。该方法仅通过损失函数工程实现，无额外计算开销，适用于边缘部署，并识别了’稀疏墙’现象，即正样本比例低于0.1%时全局损失重加权失效。

Details

Motivation: 解决在合并PETA和PA-100K形成109,000张图像复合数据集时，由于少数属性正样本比例低于1%导致的极端类别不平衡问题，这使标准二元交叉熵（BCE）优化抑制罕见属性，作者称之为’多数负类欺骗陷阱’。

Result: 在ResNet-18骨干网络上，校准后的多标签Focal Loss（alpha=0.50, gamma=2.0）达到62.32%的Macro F1分数，与BCE基线匹配，同时保持了优越的难例挖掘和收敛动态。

Insight: 创新点在于通过纯损失函数工程（无计算开销）有效缓解类别不平衡，并首次识别出’稀疏墙’边界（正样本比例<0.1%），指出此时需要实例级干预而非全局重加权，为边缘部署的PAR系统提供了实用优化策略。

Abstract: Pedestrian Attribute Recognition (PAR) is critical for video surveillance, enabling forensic search and re-identification systems. Extreme class imbalance remains a fundamental obstacle when merging PETA and PA-100K into a 109,000-image composite corpus, where minority attributes have positive sample fractions below 1%. This causes standard BCE optimization to suppress rare traits, a phenomenon we term the majority negative class cheating trap. We present a systematic ablation of Multi-Label Focal Loss hyperparameters (alpha and gamma) on a ResNet-18 backbone. A calibrated configuration (alpha=0.50, gamma=2.0) achieves a Macro F1-score of 62.32%, matching BCE baseline while preserving superior hard-example mining and convergence dynamics. Our approach uses pure loss-function engineering with zero computational overhead for edge deployment. We identify the Sparsity Wall, a hard boundary where positive sample fractions below 0.1% make global loss reweighting ineffective, requiring instance-level intervention.

[97] ScoutVLA: UAV-Centric Active Perception via a Dual-Expert VLA Model for Open-World Embodied Question Answering cs.CV | cs.AIPDF

Wenhao Lu, Zhengqiu Zhu, Xiaofeng Wang, Xiaoran Zhang, Yatai Ji

TL;DR: 本文提出了ScoutVLA模型，用于解决无人机在开放世界具身问答任务中所需的细粒度主动感知问题。该模型受蜜蜂‘摇摆舞’启发，采用解耦的双专家架构，分别负责语义意图推理和连续视点调整轨迹生成，以寻找问题答案所需的证据。

Details

Motivation: 现有户外具身问答系统通常在目标进入无人机视野后即停止，无法解决需要细粒度视点调整的证据搜寻问题。为了填补这一空白，作者构建了细粒度主动感知基准FG-EQA，并提出了相应的解决方案。

Result: 在广泛的模拟实验和真实的实地研究中，ScoutVLA均优于现有最先进的基线模型，实现了平均严格成功率10.48倍的提升和平均问答正确率7.72倍的提升。

Insight: 核心创新点在于受生物启发的、解耦的双专家VLA架构，以及包含知识隔离机制的解耦训练策略。该策略平衡了连续控制与语义推理的需求，防止动作梯度损害模型的多模态推理能力。

Abstract: Aerial Embodied Question Answering (EQA) requires Unmanned Aerial Vehicles (UAVs) to actively perceive the environment and answer natural language questions. Existing outdoor EQA systems usually stop once the target enters the UAV’s field of view, leaving the fine-grained viewpoint adjustment needed for evidence-seeking questions largely unresolved. To address this issue, we introduce FG-EQA, a fine-grained active perception EQA benchmark with more than 40K simulated trajectories and 1K real-world trajectories. Drawing inspiration from the ``waggle dance’’ of scout bees, which iteratively adjust their flight paths to verify target information, we propose ScoutVLA, an evidence-driven Vision-Language-Action model for outdoor EQA. To emulate this active exploration behavior, ScoutVLA features a decoupled dual-expert architecture: a vision-language expert infers the semantic intent to identify missing evidence, while an independent action expert employs high-DoF flow matching to generate continuous viewpoint-refinement trajectories. To balance the competing demands of continuous control and semantic reasoning, we devise a decoupled training strategy with a knowledge insulation mechanism that prevents the action gradients from erasing the model’s multimodal reasoning ability. Extensive simulated experiments and a qualitative real-world field study both verify the superiority of ScoutVLA over the state-of-the-art baselines, demonstrating a 10.48$\boldsymbol{\times}$ higher average strict success rate and a 7.72$\boldsymbol{\times}$ higher average QA correctness.

[98] FactCheck: Feasibility-aware Long-term Action Anticipation with Multi-agent Collaboration cs.CV | cs.AIPDF

Rui Cao, Jiannong Cao, Bo Yuan, Zhiyuan Wen, Mingjin Zhang

TL;DR: 本文提出FactCheck框架，通过多智能体协作的闭环’观察-规划-验证’机制，解决长期动作预测任务中物理可行性不足的问题。该方法将任务分解为观察者、规划者和验证者三个角色，分别负责构建结构化记忆、生成草稿动作和验证动作可行性，从而减少幻觉和违反物体状态的情况。

Details

Motivation: 现有长期动作预测方法以开环方式运行，缺乏对物理环境可行性的显式验证机制，容易产生不存在的物体、违反物体可供性或忽视物体状态的问题。

Result: 在EPIC-Kitchens-55和EGTEA Gaze+基准测试上的广泛实验表明，FactCheck持续优于最先进的方法，实现了SOTA性能。

Insight: 创新点在于将闭环验证和多智能体协作引入长期动作预测，通过构建包含高层意图和底层物体状态图的双形式结构化记忆，以及专门的验证器角色，系统性地确保预测动作的物理可行性。

Abstract: Long-term action anticipation (LTA) aims to predict an ordered sequence of future verb-noun actions from a partially observed video. While this task serves as the foundation for embodied intelligence, anticipating physically feasible long-term actions remains a critical challenge. Existing methods, which operate in an open-loop manner, often hallucinate non-existent objects, violate object affordances, or disregard object states, as they lack explicit mechanisms to verify action feasibility against the physical environment. To address this, we propose FactCheck, a novel multi-agent collaboration framework that improves feasibility through a closed-loop “Observe-Plan-Verify” mechanism. FactCheck decomposes the complex LTA task into specialized roles: an Observer that recognizes historical actions from video observations and constructs a dual-form structured memory, comprising a History Action Abstract that captures high-level human intentions and environmental status, and a History Action Graph that encodes object states and temporal dependencies; a Planner that generates draft future actions conditioned on both low-level historical actions and high-level History Action Abstract; and a Verifier that rigorously validates the draft against the History Action Graph and refines infeasible actions. Extensive experiments on the EPIC-Kitchens-55 and EGTEA Gaze+ benchmarks demonstrate that FactCheck consistently outperforms state-of-the-art methods. Our work establishes a new paradigm for feasibility-aware long-term action anticipation, effectively closing the loop of action recognition, action prediction and action verification.

[99] YTClickbait21K: Human-Annotated Multimodal Dataset for YouTube Clickbait Detection Across Diverse Channels and Content Categories cs.CV | cs.LGPDF

Md. Minhazul Islam, Md. Tanbeer Jubaer, Amith Khandakar, Shovon Sarker, Sumaiya Rahman

TL;DR: 本文介绍了YTClickbait21K，一个大规模、高质量的多模态YouTube点击诱饵检测数据集，包含来自29个国家40个频道的21,238个视频，涵盖新闻、娱乐、教育、游戏等多种内容类别。每个样本包含结构化元数据（标题、描述、互动统计）和缩略图，支持全面的多模态分析。数据集通过三人独立标注和多数投票确保标注质量，具有较高的标注者间一致性（k=0.65），为机器学习模型开发和评估提供了稳健的基准。

Details

Motivation: 视频分享平台上的点击诱饵内容对信息可靠性构成重大挑战，而自动化检测的进展因缺乏大规模、高质量的多模态数据集而受限。

Result: 数据集标注质量高，标注者间一致性达到k=0.65，确认了可靠的标注。该数据集为开发和评估机器学习模型提供了稳健的基准。

Insight: 创新点在于构建了一个大规模、多模态、人类标注的YouTube点击诱饵数据集，结合了规模、标注严谨性和多模态丰富性，促进了跨模态语义理解和自动化内容审核系统的研究。

Abstract: Clickbait content on video-sharing platforms poses a significant challenge to information reliability, yet progress in automated detection has been constrained by the lack of large-scale, high-quality multimodal datasets. We present YTClickbait21K, a human-annotated YouTube clickbait dataset comprising 21,238 videos collected from 40 channels across 29 countries, covering diverse content categories such as news, entertainment, education, and gaming. Each sample includes structured metadata (title, description, engagement statistics) along with associated thumbnail images, enabling comprehensive multimodal analysis. To ensure annotation quality, every video was independently labeled by three annotators using a standardized decision framework that incorporates textual, visual, and cross-modal consistency cues, with final labels determined through majority voting. The dataset exhibits substantial inter-annotator agreement (k=0.65), confirming reliable labeling despite the inherent subjectivity of clickbait detection. By combining scale, annotation rigor, and multimodal richness, this dataset provides a robust benchmark for developing and evaluating machine learning models, facilitating research in cross-modal semantic understanding, and advancing automated content moderation systems.

[100] Double-Helix Vision (DH-V2): A Geometry-Based Visual Sampler for Bandwidth-Constrained Perception cs.CV | cs.AIPDF

Jinwen Wen

TL;DR: 本文提出了Double-Helix Vision (DH-V2)，一种基于几何的视觉采样器，它使用一对受黄金比例启发的螺旋轨迹将2D图像压缩为紧凑的1D信号。该方法采用两个相位偏移180度的螺旋（Alpha和Beta）进行采样，模拟生物视觉的中央凹特性（中心密集、外围稀疏），在4K分辨率下实现1433倍压缩（99.93%的减少）。整个感知流水线（包括空间映射、时间碰撞检测和帧内结构差异估计）在仅CPU的硬件上以0.52毫秒处理1080p图像，且不依赖神经网络。在CIFAR-10数据集上，在极端采样预算（每螺旋K=128个点）下，DH比均匀随机采样准确率提升6.03%。

Details

Motivation: 解决带宽受限感知场景下，如何高效压缩图像数据并保留场景几何结构的问题，旨在为机器人等实时系统提供轻量级、非神经网络的视觉感知方案。

Result: 在CIFAR-10数据集上，在极端采样预算（每螺旋128点）下，比均匀随机采样准确率提升6.03%；在4K分辨率下实现1433倍压缩；整个感知流水线在CPU上处理1080p图像仅需0.52毫秒，并生成2.7 KB的感知报告包。

Insight: 创新点在于受黄金比例和生物视觉启发的双螺旋采样轨迹，实现了非均匀、结构保留的图像压缩；整个系统设计为完全基于几何、不依赖神经网络，在极低计算和带宽开销下实现实时空间感知，为机器人等领域提供了新的轻量级视觉采样范式。

Abstract: We present Double-Helix Vision (DH), a geometry-based visual sampler that compresses 2D images into compact 1D signals using paired golden-ratio-inspired spiral trajectories. Rather than processing every pixel uniformly, DH employs two phase-shifted helices (Alpha and Beta, offset by 180 degrees) to sample the image with biologically-inspired foveation: high density at the center, sparse coverage at the periphery. At 4K resolution, DH achieves a 1,433x compression ratio (99.93% reduction) while preserving the geometric structure of the scene. The full perception pipeline – including spatial mapping, temporal collision detection, and intra-frame structural disparity estimation – runs in 0.52 ms at 1080p on CPU-only hardware, with no neural network dependencies. On CIFAR-10 at extreme sampling budgets (K=128 points per helix), DH achieves a +6.03% accuracy gain over uniform random sampling. A JSON-serializable Robotics API is provided, delivering sub-millisecond spatial perception reports in 2.7 KB packets. Code and benchmarks are available under the MIT License.

[101] JoyAI-VL-Interaction: Real-Time Vision-Language Interaction Intelligence cs.CV | cs.AIPDF

Dingyu Yao, Junhao Zhou, Chenxu Yang, Chuanyu Qin, Haowen Hou

TL;DR: 本文提出了JoyAI-VL-Interaction，一个8B参数规模、以视觉为先的实时视觉语言交互模型。该模型能够持续观察视频流，自主决定何时保持沉默、何时回应或何时将难题委托给后台模型，旨在实现像人一样存在于世界中的主动交互范式。作者还发布了一个完整的可部署系统，包含可插拔的ASR/TTS、记忆、UI等组件，并在六个真实场景中优于现有视频通话助手。

Details

Motivation: 当前大型模型多为轮询式设计，仅在用户提问时响应，无法主动应对现实世界中瞬息万变的事件（如监控火情、视频通话表情变化、直播商品闪现）。本文旨在推动一种新的交互范式，使模型能像人一样持续感知环境并自主决策交互时机。

Result: 在六个真实场景的人类评估中，JoyAI-VL-Interaction大幅优于豆包和Gemini等应用内视频通话助手。该模型在视觉触发的响应性和时间意识方面表现优异，并能涌现出未经训练的能力，如引导购物者浏览变化的应用界面或即兴讲解幻灯片。

Insight: 创新点在于提出了一个端到端的实时视觉语言交互模型，其核心是内部响应决策机制（每秒选择沉默、响应或委托）。同时，作者开源了完整的训练方案、数据和可部署系统，首次实现了开放、视觉驱动的交互模型全栈发布，为跨领域应用提供了可插拔的解决方案。

Abstract: Many moments in the real world do not wait for a user to ask. A fire starts on a security monitor, an expression flickers across a video call, or a product a viewer wants flashes by in a livestream. Yet today’s large models remain mostly turn-based by design: they answer only when addressed, and even video-call apps that appear interactive still operate as question-answer systems, reacting only when polled or prompted. We argue for a different paradigm: a model that is present in the world like a person. It continuously watches what is happening now, decides on its own whether to speak or stay silent, interacts in real time, and delegates to a background model when the problem is hard. To advance interaction models and their adoption across domains, we make two fully open-sourced contributions. First, we release JoyAI-VL-Interaction, an 8B-scale, vision-first VL-interaction model. The model makes the response decision internally, choosing each second to stay silent, respond, or delegate to a background model, and it excels at vision-triggered responsiveness and time awareness. We pair it with a transferable training recipe, from which capabilities we never trained for emerge, such as guiding a shopper through changing app screens or improvising a lecture from a slide deck. Second, we release a complete, deployable system built around that model. The system streams any ongoing video into the model, making it genuinely present in the world. All other components are pluggable, including ASR/TTS modules, memory, visualization UI, and a background brain that can connect to any API or agent. Across six real-world scenarios, human raters prefer JoyAI-VL-Interaction over the in-app video-call assistants of Doubao and Gemini by a wide margin. To our knowledge, this is the first open, vision-driven interaction model released together with its training recipe, data, and complete deployable system.

[102] Last But Not Least: Boundary Attention CalibratiON for Multimodal KV Cache Compression cs.CV | cs.CLPDF

Tianhao Chen, Yuheng Wu, Kelu Yao, Xiaogang Xu, Xiaobin Hu

TL;DR: 本文提出了一种名为BACON的即插即用方法，用于解决多模态大语言模型（MLLMs）在处理长视觉上下文时KV缓存膨胀和解码延迟增加的问题。该方法通过校准观察窗口注意力与最后查询证据，并利用层内一致性和层间持续性来抑制孤立噪声，从而在多种压缩预算下显著提升多模态KV压缩的性能。

Details

Motivation: 现有KV缓存压缩方法依赖观察窗口注意力进行稳定的令牌重要性估计，但在激进压缩下，这种聚合会稀释稀疏的视觉证据并丢弃对答案至关重要的令牌。因此，需要利用最后查询注意力作为补充来源来恢复这些证据，但其与答案无关的信号也可能误导保留决策。

Result: 在多种基准测试、模型、预算和压缩方法下，BACON在最激进的压缩预算下平均将多模态KV压缩性能提升了7.5%，最高增益达到30.9%。

Insight: 创新点在于识别出最后查询注意力可作为恢复稀疏视觉证据的补充源，并提出了一个校准框架，结合了观察窗口注意力和最后查询证据，同时通过层内一致性和层间持续性机制来抑制噪声，实现了更鲁棒和高效的KV缓存压缩。

Abstract: Multimodal Large Language Models (MLLMs) achieve strong vision-language reasoning, but long visual contexts enlarge the KV cache and increase decoding latency. Existing compression methods rely on observation window attention for stable token-importance estimation, yet this aggregation can dilute sparse visual evidence and discard answer-critical tokens under aggressive compression. Therefore, we identify last-query attention as a complementary source for recovering such evidence, but its answer-irrelevant signals can mislead retention. We propose BACON, a plug-and-play method that calibrates observation window attention with last-query evidence and suppresses isolated noise via intra-layer coherence and inter-layer persistence. Across diverse benchmarks, models, budgets, and compression methods, BACON improves multimodal KV compression by 7.5% on average under the most aggressive budget, with gains up to 30.9%.

[103] Efficient Reinforcement for Visual-Textual Thinking with Discrete Diffusion Model cs.CV | cs.AIPDF

Yoonjeon Kim, Yuhta Takida, Chieh-Hsin Lai, Eunho Yang, Yuki Mitsufuji

TL;DR: 本文提出了一种基于离散扩散模型的高效强化学习方法，用于提升视觉-文本交错推理能力。该方法通过局部视觉编辑而非全图像生成来减少计算开销，并引入因子化奖励分配策略以缓解跨模态干扰。

Details

Motivation: 现有基于自回归模型的强化学习方法在视觉推理时需要全图像生成，计算成本高，且联合奖励分配会导致跨模态干扰。

Result: 在GRPO中，该方法将推理计算量降低了26.9%，性能损失极小；采用因子化奖励分配后，相比联合奖励分配提升11.2%，相比基线模型提升38.04%。

Insight: 利用离散扩散模型进行局部视觉编辑以实现高效强化学习推理，并提出因子化奖励分配策略来分离文本和视觉奖励，有效减少跨模态干扰。

Abstract: RL-based post-training has been widely adopted to enable interleaved visual and textual reasoning in unified multimodal models capable of both text and image generation. However, most existing approaches are built upon autoregressive (AR) unified models, which require full image regeneration during visual reasoning. In this work, we demonstrate that multimodal discrete diffusion models are effective alternatives to AR models for reinforcement learning in interleaved reasoning, owing to their ability to perform efficient visual rollouts via localized visual editing rather than full image-token regeneration. This reduces rollout computation during GRPO by 26.9% compared to AR baselines, with minimal performance drop. Despite the improved efficiency, we find that joint reward assignment, which employs a shared reward signal across modalities, introduces cross-modal interference between unrelated image and text token sequences during RL updates. To address this issue, we propose factorized reward assignment, a strategy that assigns rewards independently to text and vision segments. With factorized reward assignment, our RL approach achieves an 11.2% improvement over joint reward assignment and a 38.04% improvement over the base model.

[104] The Vision Encoder as a Privacy Boundary: Visual-Token Side Channels in Encoder-Free Vision-Language Models cs.CV | cs.CRPDF

Chenyu Zhou, Qiliang Jiang, Shuning Wu, Xu Zhou

TL;DR: 本文研究了无编码器视觉语言模型（VLMs）中的隐私泄露问题。研究发现，由于这类模型直接将图像块作为视觉令牌输入语言模型，绕过了传统视觉编码器的语义压缩和隐私边界作用，导致中间视觉令牌成为了一个预输出侧信道。攻击者可以从此侧信道中恢复出可识别的图像结构和被隐藏的访问代码，而基于编码器的模型则能有效抵御此类攻击。

Details

Motivation: 动机在于探究无编码器视觉语言模型（如Gemma4和Fuyu）的架构是否引入了新的隐私攻击面。传统视觉编码器通过将像素压缩为语义嵌入，充当了隐私边界，而无编码器模型移除了这一边界，可能使中间视觉令牌暴露敏感信息。

Result: 在Gemma4和Fuyu模型上，攻击者成功从视觉令牌流中恢复了可识别的图像结构和可读的隐藏访问代码，而基于编码器的对照组只能定位目标区域但无法恢复精确字符串。攻击对图像杂乱、文档退化具有鲁棒性，并能零样本迁移到公开文档图像，且能抵抗加性噪声和量化等值级防御。

Insight: 核心创新点在于揭示了无编码器VLM架构中视觉令牌网格的空间采样保真度（特别是字符方向的采样密度）是造成隐私泄露的关键因素，而非令牌数量或值。这迫使模型部署时必须将移除视觉编码器视为一项首要的隐私决策，有效的缓解措施必须降低空间采样率。此外，研究发现泄露不仅限于导出的令牌，Gemma4的层-0键值缓存张量也可直接反转，将侧信道置于生产服务栈中为解码效率而持久化的KV缓存内。

Abstract: A vision encoder compresses image pixels into semantic embeddings, implicitly acting as a privacy boundary by preserving semantic content while attenuating pixel-local detail required for exact text recovery. Encoder-free vision-language models (VLMs) remove this boundary by routing image patches directly into the language-model token stream, thereby exposing an architectural privacy attack surface: intermediate visual tokens become a pre-output side channel. Under a token-access adversary, decoders invert visual-token streams from two encoder-free VLMs, Gemma4 and Fuyu, recovering recognizable image structure and readable held-out access codes, whereas matched encoder-based controls localize target regions but recover no exact strings. Within-model ablations show that the operative factor is spatial sampling fidelity of the visual-token grid, especially character-direction sampling density, rather than token or value count. The leakage is not limited to exported tokens: Gemma4 layer-0 key-value cache tensors are directly invertible, placing the side channel within KV caches commonly persisted by production serving stacks for decoding efficiency. The attack survives clutter, realistic document degradation, and zero-shot transfer to public document images, and it resists value-level defenses such as additive noise and quantization. Effective mitigation must therefore reduce spatial sampling, making removal of the vision encoder a first-class privacy decision in VLM deployment.

[105] Vision-Encoder Behavioral Fingerprints of Image-to-Image Generative Models: A Training-Paradigm-Driven Taxonomy of Six Commercial APIs cs.CV | cs.CRPDF

Hunter Hill

TL;DR: 本文研究了六种商用图像到图像生成AI系统（gpt-image-1、Gemini 2.5 Flash Image、Flux Kontext、SDXL img2img、SD3 img2img和Qwen Image Edit）的行为指纹。通过一个内容自适应的亚JND对抗扰动流程，并使用冻结的DINOv2 ViT-B/14模型计算输出与干净参考图像之间的token距离进行评分，作者发现这些系统在二维（patch_mean, ssim_clean）平面上根据训练范式分为两个图像不变的行为带：编辑训练模型（Flux Kontext、Qwen Edit、Gemini）聚集在一个紧密的带中，而采样时适配的文生图基础模型（SDXL、SD3、gpt-image-1）则聚集在一个漂移带中。

Details

Motivation: 动机是理解和分类不同商用图像到图像生成模型的行为特征，特别是探究不同训练范式（编辑训练与采样时适配）如何影响模型在对抗扰动下的输出稳定性。

Result: 在包含COCO照片、CelebA-HQ肖像和AI生成输入共3,588次调用的语料库上，六种系统在二维平面上展现出清晰的行为分区，形成了两个图像不变的行为带，这为模型分类提供了定量依据。

Insight: 创新点在于提出了一种基于训练范式的行为指纹分类法，并使用内容自适应对抗扰动和冻结视觉编码器（DINOv2）的距离度量来量化模型行为差异，揭示了编辑训练模型比采样时适配的模型在输出一致性上更稳定。

Abstract: We study six production image-to-image AI systems (gpt-image-1, Gemini 2.5 Flash Image, Flux Kontext, SDXL img2img, SD3 img2img, and Qwen Image Edit) under a content-adaptive sub-JND adversarial perturbation pipeline, scoring all outputs by frozen DINOv2 ViT-B/14 token distances against clean references. Across a 3,588-call corpus spanning COCO photographs, CelebA-HQ portraits, and AI-generated inputs, the six systems partition into two image-invariant behavioral bands on a 2D (patch_mean, ssim_clean) plane: edit-trained models (Flux Kontext, Qwen Edit, Gemini) cluster in a tight band, while T2I-base models adapted at sampling time (SDXL, SD3, gpt-image-1) cluster in a drift band.

[106] Position: The Systemic Lack of Agency in Visual Reasoning cs.CVPDF

Yizhao Huang, Haoyang Chen, Shiqin Wang, Pohsun Huang, Jiayuan Li

TL;DR: 本文指出当前视觉语言模型（VLMs）在视觉推理中存在系统性缺乏自主性的问题，即模型难以自主发现和利用隐藏的视觉证据来填补信息缺口。作者为此提出了视觉隐式推理诊断基准（V-IRD），以评估模型的自主视觉分析能力，并发现现有VLMs尽管检索能力强，但在主动视觉探索方面存在显著不足。

Details

Motivation: 当前视觉语言模型倾向于将视觉推理视为被动的语义检索，而非主动的、情境化的推理，这限制了其隐式推理能力，即自主发现和利用隐藏视觉证据的能力。现有基准主要评估被动能力，而忽略了这一关键方面。

Result: 在提出的V-IRD基准上，实验表明，尽管主流VLMs具有强大的检索能力，但在利用参考对象和关注需要自主查询的视觉证据方面表现不佳，揭示了其主动视觉探索的缺陷。

Insight: 论文的创新点在于识别并形式化了VLMs中缺乏自主性的系统性问题，并引入了V-IRD基准来诊断这一缺失的推理象限。从客观角度看，这强调了将视觉推理从被动检索转向主动探索的重要性，为未来模型设计提供了新的评估方向。

Abstract: This paper argues that a systemic lack of Agency constrains the implicit reasoning capabilities of current Vision-Language Models (VLMs). Implicit reasoning refers to the ability to autonomously discover and utilize hidden visual evidence to bridge information gaps, rather than merely relying on explicitly specified targets. This capacity underlies human visual understanding and everyday reasoning. We argue that this limitation arises from a tendency to approach visual reasoning primarily as passive semantic retrieval, rather than as active, situated reasoning that depends on autonomous visual exploration. As a result, most existing benchmarks primarily assess Passive Capacity, leaving this aspect of reasoning largely unmeasured. To address this gap, we introduce the Visual Implicit Reasoning Diagnosing Benchmark (V-IRD), which targets this missing quadrant by requiring models to derive answers strictly through autonomous visual analysis. Our results show that, despite strong retrieval abilities, prominent VLMs struggle to utilize reference objects and to attend to visual evidence that requires self-directed inquiry. Simply put, strong semantic recognition does not equate to active visual exploration, revealing a critical gap in current VLMs. More information can be found at https://haoychen.github.io/Implicit-Reasoning/

[107] HSQ-VLM: A Novel Spatially-Constrained Quadrant Segmentation VLM Model for Explainability in Diabetic Retinopathy cs.CVPDF

Shivum Telang

TL;DR: 本文提出了一种名为HSQ-VLM的新型视觉语言模型，用于糖尿病视网膜病变（DR）诊断的可解释性分析。该模型通过一种创新的象限分割流程，结合了地标锚定的笛卡尔交叉注意力机制，能够生成精确描述解剖标志和病变分布的自然语言报告。

Details

Motivation: 动机在于解决当前DR诊断AI模型缺乏可解释性的问题，即模型虽然分类准确率高，但无法详细解释导致临床决策的具体解剖标志和病变分布。

Result: 在包含3500张高分辨率眼底图像的数据集上，该方法在出血和微动脉瘤的病变检测灵敏度分别达到99.6%和96.4%，并且相比标准分割基线显著减少了边界模糊错误。

Insight: 创新点在于提出了拓扑潜在分割（TLP）方法，动态地将视网膜特征与以中央凹为中心的坐标系对齐，从而实现了视觉特征提取与结构化临床推理的统一，提高了诊断解释的解剖学精度。

Abstract: Diabetic Retinopathy (DR) is an aggressive retinal disease and a leading cause of global blindness, yet its clinical management is currently hindered by the black-box nature of diagnostic AI. While deep learning models achieve high classification accuracy, there is a critical lack of explainability methods capable of detailing the exact anatomical landmarks and lesion distributions that lead to a clinical decision for DR. Therefore, we propose HSQ-VLM, a novel quadrant segmentation pipeline on fundus images that utilizes a Landmark-Anchored Cartesian Cross-Attention mechanism to unify visual feature extraction with structured clinical reasoning. Unlike traditional methods that rely on arbitrary image partitioning, our pipeline implements 4-quadrant Topological Latent Partitioning (TLP) to dynamically align retinal features with a fovea-centered coordinate system. This allows the Vision-Language Model to generate natural language reports that quantify pathology with anatomical precision. On a dataset of 3,500 high-resolution fundus images, this innovative methodology achieved a lesion detection sensitivity of 99.6% for hemorrhages and 96.4% for microaneurysms, while demonstrating a significant reduction in boundary-ambiguity errors compared to standard segmentation baselines.

[108] Multi-HMR 2: Multi-Person Camera-Centric Human Detection, Mesh Recovery and Tracking cs.CVPDF

Guénolé Fiche, Philippe Weinzaepfel, Romain Brégier, Fabien Baradel

TL;DR: 论文提出了Multi-HMR 2，这是一个基于DETR的简单而鲁棒的框架，用于多人的以相机为中心的人体检测、网格恢复和跟踪。该框架能够预测场景一致的相机参数和人体网格，实现无需真实相机内参的度量3D定位，并通过从SAM2中提取基于图像的记忆特征来扩展到跟踪任务。

Details

Motivation: 当前人体网格恢复（HMR）的研究主要集中在以骨盆为中心的恢复上，忽视了相机坐标系中的度量3D定位和检测精度，而这些是现实世界应用（如人机交互和社交场景理解）的关键因素。现有方法依赖于固定的相机假设或手工后处理，限制了其鲁棒性和实际部署。

Result: Multi-HMR 2在保持以骨盆为中心的性能达到SOTA的同时，显著提高了检测精度和度量3D定位能力，并且无需视频输入或真实相机参数即可实现一致的ID关联跟踪。

Insight: 创新点在于提出了一个端到端的框架，能够联合预测相机参数和人体网格，实现场景一致的度量3D定位；同时，通过从SAM2中提取记忆特征进行知识蒸馏，将模型扩展到跟踪任务，无需视频监督即可实现身份一致性关联。

Abstract: Most advances in human mesh recovery (HMR) have focused on pelvis-centered recovery, overlooking metric 3D localization and detection accuracy in the camera coordinate system - two key factors for real-world applications such as human-robot interaction and social scene understanding. Current evaluation protocols often ignore these aspects, emphasizing per-person, root-centered recovery rather than camera-space perception. As a result, existing approaches rely on fixed camera assumptions or handcrafted post-processing, limiting their robustness and practical deployment. We introduce Multi-HMR 2, a simple yet robust DETR-based framework for Multi-person Camera-centric Human detection, mesh Recovery, and tracking. Multi-HMR 2 predicts a scene-consistent camera together with human meshes, enabling metric 3D localization without ground-truth intrinsics. Moreover, by distilling image-based memory features from SAM2, Multi-HMR 2 extends to tracking, achieving consistent identity association without video supervision. Despite its conceptual simplicity - no handcrafted components, no video input, and no ground-truth cameras - Multi-HMR 2 achieves state-of-the-art pelvis-centered performance while substantially improving detection accuracy and metric 3D localization.

Salimeh Sekeh, Mary Wisell

TL;DR: 本文提出了一种新的理论视角来理解持续视觉语言模型中跨模态（视觉-语言）对连续环境的贡献。通过在大规模视觉语言模型上进行实证评估，验证了该理论在捕捉环境级跨模态贡献方面的有效性，并深入分析了持续视觉语言模型的贡献鲁棒性和泛化性能。

Details

Motivation: 现有持续视觉语言模型研究多关注灾难性遗忘，但对跨模态在序列环境中特定贡献的理论理解尚不充分，本文旨在填补这一空白。

Result: 在大规模视觉语言模型上的实证评估表明，所提理论能有效捕捉环境级跨模态贡献，并展现出对任务顺序和任务间相似性的鲁棒性以及改进的泛化性能。

Insight: 创新点在于首次从理论角度系统分析持续学习中跨模态贡献的动态特性，为理解模型在序列环境中的行为提供了新视角，有助于设计更鲁棒的持续学习算法。

Abstract: Continual vision-language models are commonly addressed through sequential fine-tuning; however, although this paradigm enables adaptation to new environments (tasks), it inherently emphasizes the contribution of previously learned environments (tasks) at the expense of the stability required to preserve previously acquired knowledge. While existing approaches have adequately studied continual learning and catastrophic forgetting in vision-language models (VLMs), the theoretical understanding of modality-specific contributions across a sequence of environments remains largely unexplored. In this paper, we present a new theoretical perspective to understand the cross-modal (vision-language) contributions to consecutive environments. We empirically evaluate our theoretical findings on large VLMs and demonstrate their effectiveness in capturing environment-level cross-modal contributions. Our analysis provides deeper insights into continual VLMs, highlighting their contribution robustness to varying task orders and inter-task similarities, and their improved generalization performance.

[110] Improved Knowledge Distillation for Land-Use Image Classification cs.CV | cs.AIPDF

Arundhuti Sur, Abhiroop Chatterjee, Susmita Ghosh, Emmett Ientilucci

TL;DR: 本文提出了一种改进的知识蒸馏框架，用于土地利用图像分类任务中深度卷积神经网络的高效压缩。该框架采用教师-学生学习范式，将VGG16网络的知识迁移到轻量级MobileNetV2模型，通过结合硬监督与融合KL散度和余弦相似性的软监督策略提升性能。在三个土地利用数据集上的实验表明，该方法在保持显著模型压缩的同时，实现了99.04%的准确率，优于基线学生训练和单损失蒸馏方法。

Details

Motivation: 动机在于需要在降低计算复杂度的同时，实现具有竞争力的分类精度，以促进深度学习模型在资源受限环境下的部署。

Result: 在三个土地利用数据集上，所提方法达到了99.04%的准确率，超越了基线学生训练和单损失蒸馏方法，同时保持了显著的模型压缩效果。

Insight: 创新点在于将硬监督与结合KL散度和余弦相似性的软监督策略集成到知识蒸馏框架中，这为改进教师-学生知识迁移提供了新的损失函数设计思路，可借鉴于其他视觉任务的高效模型压缩。

Abstract: In the present article, an improved Knowledge Distillation (KD) framework has been proposed for efficient compression of deep convolutional neural networks for land-use image classification task. Motivated by the need to achieve competitive classification accuracy while reducing computational complexity, a teacher-student learning paradigm is adopted in which a VGG16 network transfers knowledge to a lightweight MobileNetV2 model. The proposed framework integrates hard supervision from ground truth labels with a soft supervision strategy that combines Kullback-Leibler divergence and Cosine Similarity losses. Experiments conducted on three land-use datasets show that the proposed KD-based method yields improved performance, and achieves an accuracy of 99.04%, outperforming both baseline student training and single-loss distillation approaches, while retaining substantial model compression.

[111] FlexPooling with Simple Auxiliary Classifiers in Deep Networks cs.CVPDF

Muhammad Ali, Omar Alsuwaidi, Salman Khan

TL;DR: 本文提出了一种名为FlexPooling的自适应池化方法，它通过学习激活的加权平均来泛化平均池化，并与网络其余部分联合训练。此外，作者还引入了简单辅助分类器（SAC）来进一步提升CNN的性能。实验表明，该方法在多个图像分类数据集上相比标准池化方法能带来约1%到3%的准确率提升。

Details

Motivation: 标准池化方法（如最大池化或平均池化）是损失性的，但为了从低层表示中提取高层信息，保留先前激活中最显著的信息对提升网络判别能力至关重要。因此，作者旨在设计一种更有效的自适应池化机制。

Result: 在多个流行的图像分类数据集上的实验表明，FlexPooling方法持续优于基线网络，实现了大约1%到3%的准确率提升。

Insight: 创新点在于提出了一种可学习的加权平均池化方法（FlexPooling），它自适应地保留重要信息；同时，通过添加简单辅助分类器（SAC）作为正则化手段，进一步提升了模型性能。这种方法为池化操作提供了更灵活和有效的设计思路。

Abstract: In computer vision, the basic pipeline of most convolutional neural networks consists of multiple feature extraction layers, where the input signal is downsampled to a lower resolution in each subsequent layer. This downsampling process is commonly referred to as pooling, which is an essential operation in CNNs. Pooling improves robustness against transformations, reduces the number of trainable parameters, increases the receptive field, and lowers computation time. Since pooling is a lossy process but remains important for extracting high-level information from low-level representations, it is important to preserve the most prominent information from previous activations to improve network discriminability. Standard pooling is usually performed using dense pooling methods, such as max pooling or average pooling, or through strided convolutional kernels. In this paper, we propose a simple yet effective adaptive pooling method, called FlexPooling, which generalizes average pooling by learning a weighted average over activations jointly with the rest of the network. We further show that attaching Simple Auxiliary Classifiers (SAC) to the CNN improves performance and demonstrates the effectiveness of the proposed method compared with standard pooling methods. Experiments on multiple popular image classification datasets show that FlexPooling consistently outperforms baseline networks, achieving approximately 1 to 3 percent improvement in accuracy.

[112] Learning Sparse Latent Predictive Foundation Model for Multimodal Neuroimaging cs.CVPDF

Haoxu Huang, Long Chen, Jingyun Chen, Jinu Hyun, James Ryan Loftus

TL;DR: 本文提出Neuro-JEPA，一种稀疏多模态神经影像基础模型，通过结合潜在预测目标和专家混合架构，在健康系统规模上学习跨T1w、T2w和FLAIR三种核心脑MRI序列的统一表示。该模型在包含150多万次扫描的大规模数据集上预训练，并在多个临床和研究任务中评估，相比现有基础模型和简单CNN基线，表现出更强且更一致的性能。

Details

Motivation: 当前缺乏能够在健康系统规模上学习跨多种MRI对比机制统一表示的方法，而脑MRI通常以多种互补序列（如T1w、T2w、FLAIR）采集，需要有效的多模态表示学习框架。

Result: 在来自三个健康系统的25个任务和12个公共数据集的22个任务上评估，包括单模态、多模态和跨域配置。Neuro-JEPA在所有评估设置中均实现了比现有神经影像基础模型和简单CNN基线更强、更一致的性能。

Insight: 创新点在于将潜在预测目标与专家混合架构结合，用于稀疏多模态神经影像表示学习，并系统研究了架构、掩码、目标和稀疏性设计选择。研究强调了基础模型评估协议需包含简单基线、临床异质性队列和受控多模态比较的重要性。

Abstract: Brain MRIs are routinely acquired as multiple complementary sequences with unique contrast weighting, including T1-weighed imaging (T1w) anatomic and fluid-sensitive T2-weighted (T2w) contrasts. However, methods for learning unified representations across the multitude of MRI contrast mechanisms at health-system scale are lacking. In this study, we introduce Neuro-JEPA, a sparse multimodal neuroimaging foundation model that combines a latent predictive objective with a Mixture-of-Experts architecture to encode brain MRI across core T1w, T2w, and fluid-suppressed FLAIR imaging (FLAIR). We further provide a systematic methodological study of architectural, masking, objective, and sparsity design choices beneficial for robust neuroimaging multimodal representation learning. Neuro-JEPA was pretrained on 1,551,862 scans from 428,647 studies after modality-specific preprocessing with data curation across three core structural brain MRI sequences. We evaluated the learned representations across clinical and research settings, including 25 tasks from three health systems: NYU Langone, NYU Long Island, and Massachusetts General Hospital, and 22 tasks from 12 public datasets, covering unimodal, multimodal and cross-domain evaluation configurations. Across these benchmarks, existing neuroimaging foundation models showed inconsistent gains over a simple convolutional neural network (CNN) baseline, whereas Neuro-JEPA achieved stronger and more consistent performance across all evaluated settings. These results establish a scalable methodological framework for multimodal neuroimaging representation learning and highlight the need for foundation model evaluation protocols that include simple baselines, clinically heterogeneous cohorts and controlled multimodal comparisons.

Tewodros Syum Gebre, Jagrati Talreja, Leila Hashemi-Beni

TL;DR: 本文提出了一种利用遥感影像和深度学习进行自动化灾害建筑物损坏评估的新框架。该模型使用灾前和灾后卫星图像，通过一个新颖的多模态注意力机制融合双时相特征，将建筑物分为无损坏、轻微损坏、严重损坏和完全损毁四个等级。

Details

Motivation: 传统灾害损害评估方法依赖人工检查或稀疏数据，速度慢且易出错，无法满足及时有效的应急响应需求。

Result: 在大规模灾害数据集上的实验表明，模型实现了94.90%的总体分类准确率，能有效区分不同损坏等级，并对不完整数据具有鲁棒性。

Insight: 核心创新点是用于融合双时相特征的多模态注意力机制，以及为大规模数据集优化的预处理流程和鲁棒的数据增强技术，这为实时灾害响应提供了一个可扩展的解决方案。

Abstract: Timely and accurate disaster damage assessment is crucial for effective emergency response, resource allocation, and recovery. Traditional methods, which often rely on manual inspections or sparse data, are typically slow and error-prone. This paper introduces a novel framework leveraging remote sensing imagery and deep learning to automate building damage classification. Using pre- and post-disaster satellite imagery, our model categorizes buildings into four damage levels: no damage, minor damage, major damage, and destroyed. The core innovation is a multi-modal attention mechanism that fuses bi-temporal features to explicitly detect and assess structural changes. We employ a lightweight ConvNeXT-Tiny backbone to ensure efficient processing without compromising performance. Key contributions include: (1) a cross-attention module for multi-modal data fusion, (2) an optimized preprocessing pipeline for large-scale datasets, and (3) robust data augmentation techniques. Experiments on a large-scale disaster dataset demonstrate an overall classification accuracy of 94.90%. The model effectively discriminates between damage categories and remains resilient to incomplete data. This system significantly improves assessment speed and accuracy, aiding emergency responders in prioritizing interventions. This work advances automated disaster damage detection by integrating multi-temporal imagery with deep learning, offering a scalable solution for real-time response.

[114] MVEB: Massive Video Embedding Benchmark cs.CV | cs.IR | cs.LGPDF

Adnan El Assadi, Roman Solomatin, Isaac Chung, Chenghao Xiao, Deep Shah

TL;DR: 本文介绍了大规模视频嵌入基准MVEB，这是一个包含23个任务的视频嵌入评估基准，涵盖分类、零样本分类、聚类、配对分类、检索和视频问答等任务。作者评估了33个模型，发现没有单一模型在所有任务上占优：基于MLLM的嵌入在分类、聚类、配对分类和QA上领先；多模态绑定在检索和零样本分类上领先；未经对比适应的生成式MLLM在跨模态任务上表现不佳。此外，纯视频与音视频对比评估表明音频的贡献取决于数据集标注来源。MVEB源自184个任务的池子MVEB+，旨在保持任务多样性的同时降低评估成本，并集成到MTEB生态系统中以实现跨文本、图像、音频和视频的统一评估。

Details

Motivation: 为了解决视频嵌入模型缺乏统一、全面的评估基准的问题，作者旨在创建一个大规模、多任务的基准，以系统评估不同模型在多样化视频任务上的性能，并揭示模型在不同模态和任务上的优势和局限性。

Result: 在MVEB基准上评估了33个模型，结果显示没有单一模型在所有任务上占优：基于MLLM的嵌入在分类、聚类、配对分类和QA任务上领先；多模态绑定方法在检索和零样本分类上领先；生成式MLLM在跨模态任务上表现崩溃。音频的贡献取决于数据集标注来源，当标签来自多模态时音频有帮助，当标签仅来自视觉时音频反而有害，这一差距在不同模型家族中一致存在，达到六个百分点。

Insight: 论文的创新点在于构建了首个大规模、多任务的视频嵌入基准MVEB，并集成到MTEB生态系统中，实现了跨模态的统一评估。客观分析认为，其核心洞察在于揭示了不同模型家族（如MLLM、多模态绑定）在视频任务上的性能分化，以及音频模态的贡献高度依赖于数据集标注的模态来源，这对未来视频多模态模型的设计和评估具有重要指导意义。

Abstract: We introduce the Massive Video Embedding Benchmark (MVEB), a 23-task benchmark for video embeddings spanning classification, zero-shot classification, clustering, pair classification, retrieval, and video-centric question answering. We evaluate 33 models and find that no single model dominates: MLLM-based embeddings lead on classification, clustering, pair classification, and QA; multimodal binding leads on retrieval and zero-shot classification; generative MLLMs without contrastive adaptation collapse on cross-modal tasks. Paired video-only vs. audio+video evaluations show that audio’s contribution depends on dataset annotation provenance: audio helps when labels were produced from both modalities and hurts when they were produced from visuals alone, a six-point gap consistent across model families. MVEB is derived from MVEB+, a 184-task pool, and is designed to maintain task diversity while reducing evaluation cost. It integrates into the MTEB ecosystem for unified evaluation across text, image, audio, and video. We release MVEB and all 184 tasks along with code and a leaderboard at https://github.com/embeddings-benchmark/mteb.

[115] ReGenHuman: Re-Generating Human Appearances for Realistic Full-Body Video Anonymization cs.CVPDF

Adam Sun, Eshaan Barkataki, Arnold Milstein, Gordon Wetzstein, Ehsan Adeli

TL;DR: ReGenHuman提出了一种新颖的全身体视频匿名化方法，通过’重新生成而非编辑’的范式，结合2D姿态、分割和单目深度信息作为条件，利用视频到视频扩散模型在野外人类视频上微调，从而合成完全基于身份无关结构线索的人类区域，实现了同时具备真实性、时间一致性和匿名性的视频匿名化。

Details

Motivation: 解决现有视频匿名化技术（如模糊或逐帧生成）在真实性、时间一致性或下游任务效用方面的不足，旨在为以人为中心的视频数据提供一种更优的匿名化方案。

Result: 在隐私性、质量和效用三个维度上评估，ReGenHuman相比现有基线方法取得了最佳的综合权衡，并且生成的匿名化视频在视频问答等下游任务中仍保持有效。

Insight: 创新性地提出了’重新生成而非编辑’的范式，并设计了StructAll和StructHuman两个互补的条件流来引导身份无关的人类外观生成，这为可控视频生成和隐私保护应用提供了新思路。

Abstract: Anonymizing human-centric video data is an understudied problem. Prior anonymization techniques either blur or redact pixels at the cost of realism and downstream utility, or generate frame-by-frame at the cost of temporal coherence. We introduce ReGenHuman, the first full-body video anonymization pipeline that is simultaneously realistic, temporally consistent, and anonymous by construction. Contrary to past approaches which redact or edit the inputs directly, we propose a regenerate, don’t edit paradigm. Our approach composites 2D pose, segmentation, and monocular depth into two complementary conditioning streams - StructAll and StructHuman, which are used to fine-tune a video-to-video diffusion backbone on in-the-wild human videos, synthesizing the human regions entirely from identity-free structural cues. We evaluate our model on privacy, quality, and utility, and show that our ReGenHuman achieves the best tradeoff across all three axes against current baselines. We further show that our anonymized videos remain effective for downstream tasks, including video question answering.

[116] NEXUS: Neural Energy Fields for Physically Consistent Contact-Rich 3D Object Dynamics cs.CV | cs.AIPDF

Qizhen Ying, Guangming Wang, Yangchen Pan, Victor Adrian Prisacariu, Yixiong Jing

TL;DR: NEXUS是一个基于神经能量场的框架，用于建模接触丰富的3D物体动力学。它通过将物体表示为结构图并构建动态接触图，利用标量能量和耗散项来公式化运动，从而统一保守和非保守物理效应。该方法在轨迹基准测试中提升了长期预测精度，并能有效指导接触丰富的视频生成。

Details

Motivation: 现有基于轨迹的方法通常孤立地建模物理效应，难以在接触丰富的3D场景中统一保守和非保守动力学。NEXUS旨在解决这一问题，实现物理一致且可控的3D物体动力学建模。

Result: 在受控轨迹基准测试中，NEXUS在不同机械属性和物理效应组合下，长期预测精度优于代表性的学习型和物理结构动力学基线方法。

Insight: 创新点在于将哈密顿神经网络思想扩展到接触丰富的场景，通过能量和耗散函数的可微组合来统一保守与非保守效应，并采用多子步半隐式积分器进行 rollout，增强了物理一致性。

Abstract: Physics-grounded video generation requires controllable 3D object dynamics that remain physically consistent under contact, deformation, and external forcing. Existing trajectory-based methods often model isolated physical effects, making it difficult to compose conservative and non-conservative dynamics in contact-rich 3D scenes. We present NEXUS, a neural energy-field framework for contact-rich 3D object dynamics. NEXUS represents each object as a structural graph and constructs dynamic object-object and object-environment contact graphs. Inspired by Hamiltonian Neural Networks, NEXUS formulates motion through scalar energy and dissipation terms rather than directly predicting states or accelerations. Conservative effects, including gravity and elastic deformation, are composed as additive energy terms, while non-conservative effects such as damping and impact-induced energy loss are modeled with learned Rayleigh-style dissipation. Forces are derived by differentiating the energy and dissipation functions and rolled out with a multi-substep semi-implicit integrator. Across controlled trajectory benchmarks, NEXUS improves long-horizon accuracy over representative learned and physics-structured dynamics baselines under varying mechanical properties and physical-effect compositions. We further show that NEXUS trajectories provide effective guidance for contact-rich video generation, improving physical plausibility while maintaining competitive visual quality.

[117] Gaussian Spatial Priors for Anatomy-Aware Object Detection in Surgical Videos cs.CVPDF

Yunfan Li, Artem Shmelev, Himanshu Gupta

TL;DR: 该论文提出了一种高斯空间先验（GSP）模块，用于解决手术视频中较小解剖结构（如腹壁下血管）检测困难的问题。该方法将解剖结构间的空间关系编码为参数化偏置，注入到DAB-DETR解码器的自注意力机制中，从而显著提升了对依赖类结构的检测性能。

Details

Motivation: 在腹股沟疝修补术等手术中，准确检测解剖结构对术中安全至关重要。现有方法能可靠检测主要结构，但对视觉模糊、间歇性可见的较小结构检测效果不佳。论文观察到解剖结构间的空间关系是受约束的，因此旨在利用这一先验知识来提升检测性能。

Result: 在腹股沟疝修补术视频数据集上进行5折交叉验证，GSP模块将依赖类检测的AP50指标相比DAB-DETR提升了33.5%，相比YOLOv26提升了53.9%，同时对锚点类检测也提升了6.0%。所有增益均具有统计显著性（p=0.012）。

Insight: 创新点在于将解剖学空间关系编码为紧凑、可学习的参数化高斯先验，并将其动态集成到Transformer解码器的自注意力中。这提供了一种将领域特定先验知识（如空间约束）高效融入现代检测框架（如DETR）的有效途径。

Abstract: Detecting anatomical structures in surgical video is essential for intraoperative safety frameworks such as the Critical View of Myopectineal Orifice (CVMPO) in inguinal hernia repair. While prominent structures like the Cooper’s Ligament and Triangle of Doom are reliably detected by standard methods, smaller structures such as the epigastric vessels remain challenging due to their visual ambiguity and intermittent visibility. We observe that the spatial relationship between structures is anatomically constrained, and propose a Gaussian Spatial Prior (GSP) module that encodes this relationship as a compact, parametric bias injected into the self-attention of a DAB-DETR decoder. The prior is computed offline from training annotations as a small set of frozen Gaussian parameters and recomputed at each decoder layer using the iteratively refined reference points. On a dataset of inguinal hernia repair videos with 5-fold cross-validation, GSP improves dependent class detection by $+33.5%$ ($\text{AP}_{50}$) over DAB-DETR and $+53.9%$ over YOLOv26, while also improving anchor detection by $+6.0%$. These gains are statistically significant across all folds ($p=0.012$, paired $t-$test).

[118] Text-Driven Fusion for Infrared and Visible Images: Achieving Image Scene Adaptation on Hyperbolic Space cs.CVPDF

Huan Kang, Hui Li, Tianyang Xu, Tao Zhou, Xiao-Jun Wu

TL;DR: 本文提出了一种基于双曲流形学习的文本驱动红外与可见光图像融合框架，利用BLIP提取的文本提示作为双曲空间中的拓扑锚点，引导视觉-属性对齐，并通过双曲嵌入自然适应不同语义粒度。该方法利用庞加莱球的负曲率实现指数级体积增长，无缝嵌入层次树以编码从粗到细的语义，同时避免度量饱和和纹理失真。在推理阶段，融合过程利用学习到的文本属性先验自适应输入内容，无需文本输入。

Details

Motivation: 现有欧几里得方法采用刚性距离度量，扭曲了多模态交互和父子语义层次结构，因此需要克服这些限制以实现更自然的图像融合。

Result: 实验结果表明，该方法在基准数据集上优于最先进的方法，达到了SOTA水平。

Insight: 创新点在于将双曲流形学习引入图像融合，利用双曲空间自然编码层次语义的能力，并通过文本驱动实现训练阶段的引导，同时推理时无需文本输入，实现了自适应融合。

Abstract: Infrared and visible image fusion aims to integrate complementary modalities, while existing Euclidean methods impose rigid distance metrics that distort multi-modal interactions and parent-to-child semantic hierarchies. To overcome these limitations, we introduce a text-driven fusion framework empowered by hyperbolic manifold learning. During training, BLIP-extracted text prompts serve as topological anchors within the hyperbolic space, guiding vision-attribute alignment through hyperbolic embeddings that naturally accommodate varying semantic granularities. By exploiting the exponential volume growth dictated by the Poincaré ball’s negative curvature, this approach seamlessly embeds hierarchical trees to encode coarse-to-fine semantics without metric saturation, while the vast peripheral space prevents texture distortion during cross-modal fusion. At inference, the fusion process autonomously adapts to input content using the learned text-attribute priors, completely eliminating the need for textual input. Experimental results show our method outperforms state-of-the-art approaches on benchmark datasets, with code available at https://github.com/Shaoyun2023/TEDFusion.

[119] Think Less, Act Early: Reinforced Latent Reasoning with Early Exit in Vision-Language-Action Models cs.CV | cs.LG | cs.ROPDF

Dianqiao Lei, Lianlei Shan

TL;DR: 本文提出了一种名为AVA-VLA的新型视觉-语言-动作模型框架，它通过将推理建模为一系列不可观测的潜在变量序列，替代了显式的思维链文本生成，从而降低了计算成本。该框架结合了基于强化学习的去噪机制来优化推理轨迹，并引入了自适应早退策略以在状态置信度高时提前终止推理，实现了效率与性能的平衡。

Details

Motivation: 现有VLA模型依赖显式思维链进行推理，导致计算成本高且在多步任务中容易产生错误传播。本文旨在通过潜在推理和早退机制来解决这些效率与鲁棒性问题。

Result: 在具身决策基准测试上的大量实验表明，AVA-VLA在LIBERO基准上达到了98.3%的平均成功率，并且相比显式思维链方法实现了6倍的推理加速，在效率和长时程稳定性上均优于完全推理的基线模型。

Insight: 创新点在于将推理过程建模为潜在变量序列以避免显式文本生成的开销，并引入强化学习驱动的去噪和基于置信度的自适应早退策略，这为VLA模型提供了一种兼顾效率、鲁棒性与性能的新范式。

Abstract: Existing Vision-Language-Action (VLA) models predominantly rely on explicit Chain-of-Thought (CoT) reasoning to bridge perception and action. While effective, this paradigm suffers from high computational costs and error propagation in multi-step tasks. In this paper, we propose Adaptive Variable Alignment VLA (AVA-VLA), a novel Latent Reasoning VLA framework that models reasoning as a sequence of unobservable latent variables, bypassing the need for explicit text generation. However, latent trajectories are inherently susceptible to noise interference and misalignment with downstream objectives. To address this, we introduce a Reinforcement Learning-based Denoising mechanism that treats latent state generation as a sequential decision process, optimizing reasoning trajectories via task-level rewards. Furthermore, we incorporate an Early-Exit Strategy that adaptively terminates reasoning based on state confidence, enabling a dynamic trade-off between depth and efficiency. Extensive experiments on embodied decision benchmarks demonstrate that AVA-VLA achieves a 6x inference speedup over explicit CoT methods while attaining a 98.3% average success rate on LIBERO, improving both efficiency and long-horizon stability over full-reasoning baselines.

[120] Physics-Driven Zero-Shot MRI Reconstruction with Non-local Image Priors cs.CVPDF

Lingtong Zhang, Wenlei Li, Mu He, Li Xiao, Yang Ji

TL;DR: 本文提出了一种物理驱动的零样本自监督学习框架，用于加速磁共振成像重建。该方法结合了物理一致性和图像域非局部先验，通过三个核心创新——线圈灵敏度图引导的动态存储库、基于SPIRiT的正则化和非局部自相似性像素库——来增强监督并减少伪影，从而在无需外部全采样数据集的情况下实现高质量重建。

Details

Motivation: 零样本自监督学习在加速MRI重建中面临监督稀缺和优化不稳定的问题，容易导致过拟合或伪影，因此需要一种更稳健的方法来整合物理约束和图像先验。

Result: 在FastMRI数据集上的大量实验表明，该方法达到了最先进的性能，特别是在高加速因子下，有效缩小了零样本学习与监督方法之间的差距。

Insight: 创新点包括：利用线圈灵敏度约束过滤物理不一致的伪影以稳定训练；通过学习相关核和随机掩码强制k空间自一致性；以及利用高保真参考显式挖掘非局部解剖相似性来增强图像域监督。这些设计为无外部数据的MRI重建提供了可借鉴的物理与数据驱动结合策略。

Abstract: Zero-Shot Self-Supervised Learning (ZS-SSL) has emerged as a promising paradigm for accelerated Magnetic Resonance Imaging (MRI) reconstruction, eliminating the reliance on fully-sampled external datasets. However, learning solely from a single under-sampled scan suffers from supervision scarcity and optimization instability, often leading to overfitting or artifacts. To address these challenges, we propose a robust physics-driven ZS-SSL framework that synergizes physical consistency with image-domain non-local priors. Our method introduces three core innovations: (1) a Coil Sensitivity Map (CSM)-Guided Dynamic Repository, which stabilizes the training trajectory by filtering physically inconsistent artifacts based on coil sensitivity constraints; (2) a SPIRiT-based regularization, which enforces k-space self-consistency via a learned correlation kernel and stochastic masking; (3) a Non-Local Self-Similarity (NSS) Pixel Bank, which leverages the high-fidelity reference established by the former modules to explicitly mine non-local anatomical similarities, thereby augmenting supervision in the image domain. Extensive experiments on the FastMRI dataset demonstrate that our approach achieves state-of-the-art performance, particularly under high acceleration factors, effectively bridging the gap between zero-shot learning and supervised methods. The code is available at https://github.com/Zolento/NS-SSL.

[121] Learn Temporal Consistency For Robust Satellite Video Detector cs.CVPDF

Weilong Guo, Shengyang Li, Yanfeng Gu

TL;DR: 本文提出了一种基于时序一致性学习（TCL）的卫星视频目标检测框架，旨在解决现有方法在检测定向、细粒度目标时信息不完整、不准确和不一致的问题。该框架通过整合时序细粒度特征聚合、结构编码和时序一致性约束三个模块，有效利用卫星视频中的时序上下文信息。在SAT-MTB基准数据集上的实验表明，该方法在定向细粒度检测精度上达到了新的SOTA水平。

Details

Motivation: 现有卫星视频目标检测方法通常只关注少数粗粒度移动目标类别，并使用水平边界框表示，难以在整个视频序列中提取完整、准确且一致的目标信息。

Result: 在SAT-MTB基准数据集上，TCL框架实现了47.7%的mAP，比基线方法提升了4.8%，达到了新的最先进的定向细粒度检测精度。

Insight: 创新点在于提出了一个专门针对卫星视频时序特性设计的统一框架，通过时序一致性约束和结构编码来联合优化特征表示，从而提升对定向、细粒度目标的检测鲁棒性和一致性。该框架具有良好的兼容性，可以适配现有的基于图像的检测器以提升其性能。

Abstract: Satellite video object detection (SVOD) for oriented and fine-grained objects plays an important role in satellite applications. Most existing SVOD methods only focus on one or a few coarse-grained categories of moving objects and represent objects with horizontal bounding boxes. They have difficulty extracting complete, accurate, and consistent information about objects in whole satellite videos. In this paper, we propose a satellite video object detection framework based on Temporal Consistency Learning (TCL). TCL adeptly detects oriented and fine-grained objects by leveraging the rich temporal contexts within satellite videos. The framework integrates three key modules: temporal and fine-grained feature aggregation (TFA), structure encoding (SE), and temporal consistency constraint (TCC). TFA and TCC modules facilitate consistent representation learning across frames, while the SE module encodes both appearance and structural information for precise fine-grained recognition. Experimental results on the SAT-MTB benchmark dataset demonstrate TCL’s superior performance, achieving a new state-of-the-art oriented and fine-grained detection accuracy of 47.7% mAP–a 4.8% improvement over the baseline. Furthermore, our TCL framework readily accommodates existing image-based detectors, leading to enhanced detection accuracies.

[122] Multi-view feature High-order Fusion for Space Weak Object Detection and Segmentation cs.CVPDF

Weilong Guo, Yuhan Sun, Shengyang Li

TL;DR: 本文提出了一种多视图特征高阶融合方法（MHF），用于解决空间应用中弱目标检测与分割的难题。该方法通过多视图注意力机制生成多视图特征，并利用高阶融合策略聚合更准确、更丰富的特征表示。MHF作为一个即插即用模块，显著提升了多种视觉Transformer和卷积基模型在三个数据集上的性能，均达到了最先进的精度水平。

Details

Motivation: 空间应用图像和视频中的弱目标普遍存在，但因其外观信息有限，难以学习到合适的特征表示。受多视图学习启发，本文旨在通过多视图特征的高阶融合来增强模型对弱目标的表征能力。

Result: 在两个新构建的空间科学数据集和一个公开的大规模卫星视频数据集上进行了广泛实验。MHF模块显著提升了多种检测和分割模型的性能，在两项任务上均达到了所有数据集上的最先进（SOTA）精度。

Insight: 核心创新在于将常用的低阶特征融合扩展到高阶，通过引入高阶多视图特征感知和递归任务贡献门控选择机制，增强了模型捕获弱目标相关和互补信息的能力。该方法灵活可定制，兼容多种多视图特征表示变体，可视为视觉建模中有效表征弱目标的新基础模块。

Abstract: Weak objects are common in images and videos of space applications. However, it is hard to learn proper representations from their limited appearance information. Inspired by multi-view learning, we develop simple multi-view attentions, treating their outputs as multi-view features. We also propose a multi-view feature high-order fusion method (MHF) to aggregate more accurate and richer features of weak objects. Our MHF extends the commonly used low-order feature fusion method to higher orders. It enhances the model’s capacity to capture relevant and complementary information about weak objects. This is achieved by introducing high-order multi-view features perception and a recursive task-contribution gated selection of multi-view features. The new operation is highly flexible and customizable. It is compatible with various variants of multi-view feature representations. We conduct extensive experiments on two newly constructed space science datasets and an open, large-scale satellite video dataset. Our MHF serves as a plug-and-play module and significantly improves various vision transformers and convolution-based detection and segmentation models. We achieve all state-of-the-art accuracies on both tasks across three datasets. Our MHF can be a new basic module for visual modeling that effectively represents weak objects in terms of multi-view learning. The code will be available at https://github.com/Kingdroper/MHF.

[123] EyeMVP: OCT-Informed Fundus Representation Learning via Paired CFP–OCT Pretraining cs.CV | cs.AIPDF

Zhuo Deng, Ruiheng Zhang, Ziheng Zhang, Weihao Gao, Yitong Li

TL;DR: EyeMVP是一个跨模态视网膜基础模型，通过配对CFP-OCT预训练学习OCT信息增强的CFP表征。模型在67万余张严格同眼同日的CFP-OCT图像对上预训练，使用跨模态掩码重建方法，在推理时仅需CFP图像。在16个下游任务中，包括黄斑水肿等疾病诊断，EyeMVP性能优于现有视网膜基础模型。

Details

Motivation: 解决彩色眼底照相（CFP）在视网膜筛查中因缺乏深度结构信息而诊断能力受限的问题，同时利用光学相干断层扫描（OCT）的解剖信息但克服其在大规模筛查中可及性低的限制。

Result: 在16个下游任务（分类、分割、少样本适应、跨模态检索）中优于代表性视网膜基础模型；对CFP诊断困难的黄斑疾病，黄斑水肿AUROC达0.948（EyeCLIP为0.852），病理性近视黄斑劈裂AUROC为0.825；在读者研究中，对黄斑水肿诊断超过初级和中级眼科医生组但未达到高级医生水平，对黄斑劈裂诊断准确率数值上高于所有医生组。

Insight: 创新点包括：通过像素级跨模态重建将OCT监督信息注入CFP表征；提出源约束交叉注意力与CFP结构掩码结合，以处理CFP（正面成像）与OCT（横截面成像）的非对齐成像几何问题；为筛查场景中基于CFP的视网膜分析提供了实用增强路径。

Abstract: Color fundus photography (CFP) is the mainstay for large-scale retinal screening, yet its diagnostic capacity is constrained by the lack of depth-resolved structural information. Optical coherence tomography (OCT) provides cross-sectional retinal anatomy, but is less accessible in population-level screening. Here, we present EyeMVP, a cross-modal retinal foundation model that uses paired CFP–OCT pretraining to learn OCT-informed CFP representations. EyeMVP is pretrained on 674,893 strict same-eye same-day paired CFP–OCT image triples from 112,642 patients across eight hospitals in China. The model uses cross-modal masked reconstruction to enrich CFP representations with OCT-associated supervision, while requiring only CFP images at inference. To accommodate the non-aligned imaging geometry between en-face CFP and cross-sectional OCT, EyeMVP combines source-constrained cross-attention with CFP-derived structural masks. Across 16 downstream tasks, including classification, segmentation, few-shot adaptation, and cross-modal retrieval, EyeMVP outperforms representative retinal foundation models and shows consistent gains on tasks involving macular and optic nerve structure. For CFP-challenging macular diseases, EyeMVP achieves an AUROC of 0.948 for macular edema (vs.~0.852 for EyeCLIP) and 0.825 for myopic macular schisis. In an exploratory reader study, EyeMVP exceeds junior and intermediate ophthalmologist groups but does not reach senior ophthalmologist performance on macular edema, while showing numerically higher balanced accuracy than all reader groups on myopic macular schisis. These results suggest that pixel-level cross-modal reconstruction can enrich CFP representations with OCT-associated supervision, providing a practical route toward stronger CFP-based retinal analysis in screening settings.

[124] Beyond Scalar Distances: Semantic Attribute Gradients from Frozen MLLMs for Visual Embeddings cs.CV | cs.AI | cs.LGPDF

Shubhang Bhatnagar, Dheeraj Baiju, Narendra Ahuja

TL;DR: 本文提出SAGA框架，利用冻结的多模态大语言模型（MLLM）的语义属性感知能力，为视觉编码器生成细粒度的属性级监督信号，以替代传统的基于类别标签的标量距离训练方法，从而提升图像检索性能。

Details

Motivation: 传统检索视觉编码器仅依赖类别标签的标量监督（即图像对整体相似或不相似），忽略了图像间具体语义属性的差异与匹配；而MLLM能够自然语言描述这些属性，因此研究如何将MLLM的这种属性感知能力转化为编码器的训练信号。

Result: 在CUB-200-2011、Cars-196、FGVC-Aircraft和iNaturalist Aves数据集上的零样本图像检索任务中，SAGA将Recall@1指标比现有最佳方法提升了3到6个百分点，达到新的SOTA水平。

Insight: 核心创新在于通过GRPO策略优化，利用冻结MLLM的正确预测作为奖励，驱动视觉编码器学习暴露图像对间具体差异或匹配的属性；同时结合注意力蒸馏损失和标准度量学习损失，在不增加推理成本的情况下，实现了从粗粒度标量监督到细粒度属性解析监督的转变。

Abstract: Vision encoders for retrieval are typically trained with class-label supervision: each training pair reduces to a scalar that uniformly pushes the embedding apart or pulls it together, as if every visual attribute either differed or matched. A multimodal large language model (MLLM), shown the same pair, can articulate those attributes and use them to predict whether the images share a class. We propose \textbf{SAGA}, a framework that turns this language-grounded, attribute-aware perception into a training signal for the encoder itself. Specifically, we use Group Relative Policy Optimization (GRPO) to reward the MLLM for correct predictions on the vision encoder’s tokens. Since correct predictions require those tokens to expose the specific attributes that differ or match between the pair, the gradient pushes the encoder to encode them, replacing the uniform pair-level scalar with attribute-resolved supervision. An auxiliary attention-distillation loss anchors the encoder’s embedding to tokens the MLLM attended to, and a standard metric-learning loss shapes the embedding geometry for nearest-neighbour retrieval. The MLLM is frozen throughout and discarded at inference, matching the deployment cost of a metric-learning baseline. SAGA improves Recall@1 by 3 to 6 points over state-of-the-art baselines on CUB-200-2011, Cars-196, FGVC-Aircraft, and iNaturalist Aves on zero-shot image retrieval.

[125] DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning cs.CV | cs.LGPDF

David Huang, Lianlei Shan

TL;DR: 本文提出了DLWM（多样化潜在世界模型），一个结合潜在空间推理与强化学习的多模态推理框架。该框架通过构建多样化的潜在世界假设来捕捉视觉输入的不同合理解释，并利用资源感知的强化学习策略自适应地分配计算资源，从而在提升推理准确性的同时显著降低内存消耗。

Details

Motivation: 现有多模态大语言模型（MLLMs）的推理方法通常假设输入具有单一潜在解释，并沿固定路径或统一计算预算展开推理，这限制了模型探索多种假设的能力，且在现实多模态场景中（如遮挡、模糊、视角变化或语义模糊）效率低下。

Result: 在多个多模态推理基准测试中，DLWM在准确率上比现有方法高出2-5个百分点，同时内存使用减少了24%。

Insight: 创新点在于引入基于正交性的多样性正则化器防止假设坍缩，并将潜在推理过程建模为资源受限的序列决策问题，通过强化学习策略动态管理推理路径（扩展、终止或合并），实现了高效的多假设探索与资源自适应分配。

Abstract: Reasoning capabilities of multimodal large language models (MLLMs) have improved considerably in recent years. Existing approaches typically rely on explicit chain-of-thought or continuous latent-space trajectories to enhance multi-step reasoning. However, these methods generally assume that an input admits a single latent interpretation and unfold reasoning along a fixed path or under a uniform computation budget. In real-world multimodal settings, visual observations are often subject to occlusion, blur, viewpoint variation, or semantic ambiguity, giving rise to multiple plausible interpretations. A uniform reasoning strategy not only limits the model’s ability to explore multiple hypotheses but also incurs high memory usage and rollout cost. We present DLWM (Diverse Latent World Models), a multimodal reasoning framework that combines latent-space reasoning with reinforcement learning. First, we construct a set of diverse latent world hypotheses in continuous latent space, each capturing a different plausible interpretation of the visual input, and unfold latent reasoning independently on each hypothesis. An orthogonality-based diversity regularizer explicitly prevents hypothesis collapse. Second, we formulate the latent reasoning process as a resource-constrained sequential decision problem and introduce a resource-aware reinforcement learning policy that adaptively allocates computation across hypotheses, dynamically deciding whether to expand, terminate, or merge reasoning paths, thereby substantially reducing memory footprint and improving rollout efficiency. Experiments on multiple multimodal reasoning benchmarks demonstrate that DLWM outperforms existing methods by 2-5 points in accuracy while reducing memory usage by 24%.

[126] MotionVLA: Vision-Language-Action Model for Humanoid Motion cs.CV | cs.ROPDF

Nonghai Zhang, Siyu Zhai, Yanjun Li, Zeyu Zhang, Zhihan Yin

TL;DR: 本文提出了MotionVLA，一个基于视觉-语言-动作的人形运动生成模型。它通过频率分析发现单一码本量化无法同时表征运动的低频姿态语义和高频物理动态，因此设计了DSFT双流频率分词器，将运动分离为基础流和物理流进行独立压缩和编码。模型基于Qwen3.5架构，将两流令牌统一编排在一个序列中进行自回归预测，在HumanML3D和MBench基准上取得了更好的运动多样性和条件一致性。

Details

Motivation: 现有方法通常使用单一共享码本对运动进行分词，这迫使异质的运动信号（低频姿态和高频速度）进入相同的量化空间，导致高频物理动态表征不足。论文旨在解决这种量化不匹配问题，并改进自回归模型对运动序列中高频物理信号的有效建模。

Result: 在HumanML3D数据集上，MotionVLA将生成运动与真实数据之间的Diversity差距缩小了超过50%。在MBench基准上，Motion-Condition Consistency指标提升了3.8%。这些结果表明，尽管使用了轻量级的20亿参数骨干网络，该方法在运动多样性和条件一致性方面均取得了显著提升。

Insight: 核心创新点在于频率感知的双流解耦思想：通过频域分析揭示运动数据的统计特性，并据此设计DSFT分词器将运动解耦为基础（低频）和物理（高频）两个流进行独立处理。这种将异质信号分离编码、再在序列层面统一建模的架构，为自回归运动生成提供了一种有效的公式化方法。

Abstract: Generating realistic humanoid motion from scene images and text involves both low-frequency pose semantics and high-frequency physical dynamics. However, many existing methods tokenize motion with a single shared codebook, forcing heterogeneous motion signals into the same quantization space. Our frequency-domain analysis of human motion data reveals a clear mismatch between single-codebook quantization and motion statistics: five DCT coefficients capture 93% of joint-position energy but only 37% of joint-velocity energy, which can bias quantization toward pose statistics and under-represent high-frequency velocity components. A second challenge lies in adapting a standard autoregressive model to effectively model high-frequency physical signals in motion sequences. Therefore, we propose DSFT, a dual-stream frequency tokenizer that separates motion into Base and physical streams and compresses them independently with DCT truncation and BPE. Furthermore, we present MotionVLA, a Qwen3.5-based model that arranges Base and physical tokens in a unified sequence, where Phys tokens are predicted after Base tokens. Experiments on HumanML3D and MBench show that, despite using a lightweight 2B backbone, MotionVLA reduces the Diversity gap to real data by over 50% on HumanML3D and improves Motion-Condition Consistency by 3.8% on MBench, supporting frequency-aware dual-stream decoupling as an effective formulation for autoregressive motion generation. Code: https://github.com/AIGeeksGroup/MotionVLA. Website: https://aigeeksgroup.github.io/MotionVLA.

[127] GeoStream: Toward Precise Camera Controlled Streaming Video Generation cs.CVPDF

Yizhou Zhao, Yifan Wang, Xiaoyuan Wang, Yushu Wu, Hao Zhang

TL;DR: GeoStream是一个用于精确相机控制的流式视频生成框架，通过维护一个自更新的3D缓存来实现对相机运动的精确控制。该方法采用自回归方式生成视频，并利用几何条件来确保相机轨迹的准确性。

Details

Motivation: 现有方法在相机控制方面存在不足，要么隐式学习相机运动导致控制不准确，要么依赖静态3D缓存而无法适应视角变化。GeoStream旨在解决这些问题，实现精确的度量尺度相机控制。

Result: 定量和定性结果表明，GeoStream显著提高了相机可控性，在流式视频生成任务中表现出色。

Insight: 创新点在于引入自刷新3D缓存机制，通过从模型自身输出中在线更新缓存，实现了训练与推理条件分布的对齐，从而有效缓解了自回归漂移和几何反馈循环问题。

Abstract: Accurate interactive camera control is essential for video-based world models, but most existing approaches learn camera motion implicitly, leading to inaccurate control under out-of-distribution trajectories. Explicit geometric conditioning improves controllability, but existing methods are non-autoregressive and rely on a static 3D cache built from an initial frame, which becomes ineffective once the viewpoint moves beyond the original frustum. We propose GeoStream, a framework that enables precise metric-scale camera control in autoregressive streaming video generation. Our method maintains a self-refreshing 3D cache that is periodically updated online from the model’s own outputs: we estimate depth from the most recently generated frame, unproject to 3D, and reproject into the target view to produce point reprojections as geometric conditioning for subsequent synthesis. By the same principle, the conditioning seen during training is also rendered from the student’s own generated frames, yielding a fully on-policy distillation that naturally aligns the train and inference conditioning distributions. Unlike prior work that uses off-policy condition noising, our approach trains the model against the exact error distribution it encounters at inference, mitigating both standard autoregressive drift and the second-order geometric feedback loop that arises when the cache itself is derived from generated outputs. Quantitative and qualitative results show that our approach substantially improves camera controllability.

[128] Label Shift Aware Adaptation for Online Zero-shot Learning with Contrastive Language-Image Pre-Training (CLIP) cs.CVPDF

Pengxiao Han, Changkun Ye, Yanshuo Wang, Jinguang Tong, Miaohua Zhang

TL;DR: 本文提出了一种名为标签偏移感知（LSA）的方法，用于解决CLIP模型在在线零样本学习任务中面临的标签分布偏移问题。该方法将在线零样本分类视为领域适应问题，通过仅使用未标记的测试数据来调整CLIP的预测，并应用标签偏移校正来缓解源域和目标域之间的不匹配。

Details

Motivation: 现有在线零样本学习方法在适应测试样本时，往往忽略了CLIP初始训练数据的分布，当测试数据的标签分布与训练域不同时，会导致性能下降。本文旨在解决这种由标签分布偏移引起的性能退化问题。

Result: 在多个数据集上的广泛实验表明，所提出的LSA方法在基于CLIP的在线零样本学习方法中，持续优于最先进（SOTA）的方法。

Insight: 创新点在于将在线零样本学习明确建模为领域适应问题，并引入标签偏移校正机制。这为处理预训练模型在部署时遇到的分布偏移问题提供了一个新的、无需源域数据或模型参数调整的视角和解决方案。

Abstract: Vision-language models like Contrastive Language-Image Pre-Training (CLIP) have been extensively studied in data-scarce scenarios. A particularly challenging and realistic task in this area is online zero-shot learning with CLIP, where unknown test samples are predicted sequentially in random order by CLIP while keeping the feature extraction and model parameters fixed during the sequential inference phase. Most existing approaches in this setting address the problem by adapting representations online using incoming test samples, while neglecting the distribution of the data on which CLIP was initially trained. This mismatch can lead to degraded performance when the label distribution in the test data differs from that of the training domain. To address this gap, we propose Label Shift Aware (LSA), which formulates the online zero-shot classification task as a domain adaptation problem. Specifically, LSA adapts the predictions computed by CLIP, which was trained on an unknown source distribution, to a target distribution using only unlabeled test data, and applies label shift correction to mitigate the mismatch between the source and target domains. The extensive experiments across multiple datasets demonstrate that the proposed LSA consistently outperforms state-of-the-art online zero-shot learning methods based on CLIP.

[129] Keep It in Mind: User Centric Continual Spatial Intelligence Reasoning in Egocentric Video Streams cs.CVPDF

Yun Wang, Junbin Xiao, Han Lyu, Yifan Wang, Jing Zuo

TL;DR: 该论文提出了UCS-Bench数据集和DirectMe框架，旨在解决以用户为中心、持续性的第一人称视频空间智能推理问题。UCS-Bench包含超过170小时的第一人称视觉观察和8100多个带时间戳的问题，用于评估动态空间推理和长期记忆能力。DirectMe框架通过增量构建和维护结构化空间记忆，支持对物体位置进行鲁棒跟踪和回忆，显著提升了多模态大语言模型的空间推理性能。

Details

Motivation: 论文旨在解决第一人称视频流中用户中心化的持续性空间智能推理问题，强调动态空间推理、长期记忆及其与用户实时位置的匹配，这是现有基准和模型尚未充分探索的新问题。

Result: 实验表明，DirectMe框架显著提升了领先多模态LLM的空间推理能力，并且在UCS-Bench基准上超越了多个具有空间感知能力和长视频流处理能力的模型。

Insight: 论文的创新点在于提出了首个专注于用户中心化持续性空间推理的基准UCS-Bench，以及一个增量构建结构化空间记忆的框架DirectMe，该框架将视觉感知、记忆更新与空间推理紧密耦合，以支持需要长期记忆和适应动态场景的复杂查询。

Abstract: We introduce UCS-Bench, a dataset spanning 170+ hours of egocentric visual observations with 8.1K+ timestamped questions for diagnosing User-Centric Continual Spatial intelligence in egocentric video streams. UCS-Bench targets a new problem that emphasizes dynamic spatial reasoning, long-term memory, and their alignment with users’ real-time locations. We propose DirectMe, a framework that incrementally constructs and maintains a structured spatial memory from streaming egocentric observations. DirectMe enables robust tracking and recall of object locations, all relative to the user’s movement over time. By tightly coupling visual perception with memory updates and spatial reasoning, our approach supports long-horizon queries that require recalling interactions, resolving viewpoint-induced ambiguities, and adapting to dynamic scenes. Our experiments show that DirectMe significantly improves the spatial reasoning of leading multimodal LLMs; it also surpasses many spatially aware and long-form streaming video models. We hope our benchmark and solution will advance spatial intelligence research for egocentric AI assistants. Data and code are available at https://github.com/cocowy1/UCS-Bench.

[130] Comparing Human Gaze and Vision-Language Model Attention in Safety-Relevant Environments cs.CVPDF

Marta Vallejo, Siwen Wang

TL;DR: 本研究通过眼动追踪数据与GPT-4o等大型视觉语言模型生成的显著性图进行对比，评估了模型在安全相关场景中预测人类视觉注意力的能力。研究发现，模型能够识别出与人类注视区域大致对应的区域，且无需眼动追踪数据进行训练。

Details

Motivation: 探究大型视觉语言模型能否在安全相关环境中识别出吸引人类注意力的场景区域，以评估其作为可扩展工具近似人类注意力模式的潜力。

Result: 使用皮尔逊相关系数、NSS、KL散度和AUC-Judd四个指标评估，GPT-4o与人类注视热图在空间上存在中等程度对齐（例如r=0.515）。跨模型比较显示，所有模型均超过AUC-Judd的随机基线，其中Gemini Pro在三个指标上表现出最强的空间定位能力，而GPT-4o在KL散度上最接近人类注意力分布。

Insight: 论文的创新点在于首次系统性地在安全相关场景中比较了人类注视与VLM模型注意力，并发现VLM模型无需专门的眼动数据训练即可在一定程度上近似人类注意力模式，这为利用VLM进行可扩展的人类注意力建模提供了实证依据。

Abstract: Human visual attention plays an important role in how people perceive and respond to environments containing potential risks. This study investigates whether large vision-language models can identify the same regions of a scene that attract human attention in safety-relevant environments. Eye-tracking data were collected from ten participants viewing 33 scene images representing environments with varying levels of potential risk using Pupil Invisible wearable glasses. Gaze coordinates were mapped onto stimulus images to generate population-averaged human gaze heatmaps. In parallel, GPT-4o was prompted through the OpenAI Vision Application Programming Interface (API) to generate spatial predictions of visual attention, which were converted into saliency maps for comparison with human gaze patterns. Spatial alignment between human gaze heatmaps and model-generated saliency maps was evaluated using four complementary metrics: Pearson correlation (r = 0.515 +- 0.117), Normalised Scanpath Saliency (NSS = 0.988 +- 0.323), Kullback-Leibler divergence (KL = 1.766 +- 0.844), and Area Under the Receiver Operating Characteristic Curve using the Judd formulation (AUC-Judd = 0.806 +- 0.076). A cross-model comparison with Gemini Pro, Gemini Flash, and Claude showed that all models exceeded the AUC-Judd chance baseline of 0.5 and achieved positive NSS scores. Gemini Pro demonstrated the strongest spatial localisation according to three of the four metrics, whereas GPT-4o produced the closest distributional match to human attention as measured by KL divergence. These findings suggest that large vision-language models can identify regions that broadly correspond to where humans direct visual attention in safety-relevant scenes without requiring eye-tracking training data. The results highlight the potential of vision-language models as a scalable tool for approximating human attentional patterns.

[131] SPARK: Spatial Policy-driven Adaptive Reinforcement learning for Knowledge distillation cs.CVPDF

Mohamed Jismy Aashik Rasool, Shabir Ahmad, Gisong Oh, Teag Kuen Whangbo

TL;DR: 本文提出SPARK框架，一种用于知识蒸馏的空间策略驱动自适应强化学习方法，旨在解决低比特量化在图像复原网络中导致的高频区域退化问题。该方法通过轻量级强化学习策略网络自适应分配蒸馏注意力，根据图像区域的难度特征动态调整知识蒸馏损失权重，从而提升量化后模型的复原质量。

Details

Motivation: 现有知识蒸馏方法在图像复原任务中均匀应用蒸馏信号，忽略了不同图像区域（如边缘和纹理）的重建难度差异，导致量化网络在高频区域性能下降。

Result: 在基准数据集上的实验表明，SPARK在多种学生架构上持续优于后训练量化、量化感知训练和现有最先进的知识蒸馏方法，在显著计算约束下实现了最接近全精度教师模型的复原质量。

Insight: 创新点在于引入强化学习策略网络，根据拉普拉斯方差、像素方差、学生重建误差和师生知识差距四个难度特征，动态生成空间权重图以调制知识蒸馏损失，实现了任务无关、无推理开销且无需架构修改的自适应蒸馏。

Abstract: Low-bit quantization enables deployment of image restoration (IR) networks on resource-constrained devices, but introduces rounding noise that disproportionately degrades high-frequency regions such as edges and fine textures. Existing knowledge distillation (KD) methods apply distillation signals uniformly across all spatial locations, overlooking the varying reconstruction difficulty across image regions. To address this, we propose SPARK (Spatial Policy-driven Adaptive Reinforcement Learning for Knowledge Distillation), a framework that adaptively allocates distillation effort using a lightweight reinforcement learning (RL) policy network. At each training step, a difficulty feature extractor computes four signals, namely Laplacian variance, pixel variance, student reconstruction error, and teacher-student knowledge gap, which are fed into a compact policy CNN that produces a stochastic spatial weight map to modulate the KD loss during quantization-aware training (QAT). SPARK is IR task-agnostic, adds no inference cost, and integrates into any existing QAT pipeline without architectural changes. Experiments on benchmark datasets demonstrate that SPARK consistently outperforms PTQ, QAT, and state-of-the-art (SOTA) KD approaches across multiple student architectures, achieving reconstruction quality closest to the full-precision teacher under significant computational constraints.

[132] MamBOA: State-Space Architecture for Video Recognition cs.CVPDF

Mustafa Bora Çelik

TL;DR: MamBOA是一种用于视频识别的状态空间架构，它基于一种新颖的交错扫描结构，将选择性状态空间循环（S6）重新定义为一种本征的运动合成器。该框架与CNN、Transformer和Mamba骨干网络无缝集成，通过交错连续特征表示并利用级联的对齐和解码操作提取显式运动表示，最后通过双路径池化机制自适应聚合。

Details

Motivation: 解决细粒度动作识别中时间推理的问题，现有通用架构（如3D密集算子和基于差分的方法）在表达能力或灵活性上存在局限性，需要一种更原则性和通用的运动建模基础。

Result: 在Diving48数据集上，使用图像预训练骨干网络达到85.02%的Top-1准确率，使用视频预训练骨干网络处理整个视频达到86.24%的Top-1准确率，展示了其有效性。

Insight: 创新点在于提出交错扫描结构，将状态空间循环内在地编码帧间过渡作为状态动态的一部分，而非外部计算量，从而实现了骨干无关的、高效的运动建模框架。

Abstract: Fine-grained action recognition demands temporal reasoning that general-purpose architectures address through different cost-accuracy tradeoffs: 3D dense operators couple computation to the input volume, while difference-based methods approximate motion through rigid, hand-crafted subtraction of uncontextualized features - each reflecting a deliberate design choice with corresponding limitations in expressiveness or flexibility. We present MamBOA, a backbone-agnostic temporal framework built upon a novel interleaved scan structure that recasts the selective state-space recurrence (S6) as a native motion synthesizer. By interleaving consecutive feature representations extracted from a pretrained backbone into a single alternating sequence, the proposed scan structurally drives the recurrence to encode both temporal observations of each position within a shared hidden state, separated by only a single decay step - rendering the inter-frame transition an intrinsic component of the state dynamics rather than an externally computed quantity. A cascade of dedicated alignment and decoding operations then distills this joint encoding into an explicit motion representation, which a dual-path pooling mechanism adaptively aggregates by balancing attention-driven selection with uniform temporal coverage. The framework interfaces seamlessly with CNN, Transformer, and Mamba backbone families, adding only ~2.1 GFLOPs per feature pair. On Diving48, MamBOA achieves 85.02% Top-1 accuracy with an image-pretrained backbone and 86.24% with a video-pretrained backbone processing the entire video in a single forward pass - demonstrating that structurally induced state-space dynamics constitute a principled and general foundation for motion modeling.

[133] Enhancing Precision Agriculture with a Hybrid Deep Learning Framework for Multi-Class Plant Disease Classification and Interpretability cs.CVPDF

Hasibul Islam Sufi, Ridam Roy, Shayla Alam Setu, Mahimul Islam Nadim

TL;DR: 本研究提出了一种用于高分辨率叶片图像多类植物病害分类的深度学习架构，重点研究了ResNet-50和一种混合ResNet + Vision Transformer设计。在一个包含38个类别、总计19,000张图像的数据集上，通过预处理和数据增强训练并比较了多种模型。实验表明ResNet-50取得了98.74%的最高准确率，而混合模型也达到了98.58%的竞争性准确率，同时利用Grad-CAM和显著性图等技术增强了模型的可解释性。

Details

Motivation: 旨在开发一个高精度、可解释且计算高效的计算机视觉系统，用于多作物、多类别的植物病害分类，以辅助精准农业和栽培管理实践。

Result: 在包含38个类别的专用数据集上，ResNet-50模型取得了98.74%的最高准确率，混合ResNet + ViT模型也达到了98.58%的竞争性准确率，表明其性能具有竞争力。

Insight: 创新点在于系统性地比较了包括混合ResNet+ViT在内的多种架构，并集成了Grad-CAM、显著性图和基于分割的分析等多种可解释性技术，以定位病害相关区域和叶片受影响部分，验证了Transformer模型在捕获局部和全局信息方面的有效性。

Abstract: This study proposes an overall deep learning architecture for multi-class classification of plant diseases from high-resolution leaf imagery, with a particular interest in investigating the behavior of ResNet-50 and a hybrid ResNet + Vision Transformer (ViT) design. A specially gathered image database with 15,200 training images and 3,800 validation images spanning 38 classes across multiple crops, including tomato, apple, grape etc. were subjected to preprocessing steps such as resizing, normalization, and data augmentation to enhance model robustness. Multiple architectures, including ResNet-50, MobileNetV2, and EfficientNet-B0, were trained and compared with the hybrid ResNet + ViT model. All models were fine-tuned using the AdamW optimizer and cross-entropy loss, with early stopping applied to prevent overfitting and ensure generalization. Furthermore, interpretability techniques such as Grad-CAM and saliency maps were implemented to indicate disease-relevant regions, while segmentation-based analysis was performed to identify the affected parts of a leaf. For every one of the considered architectures, ResNet-50 led to the highest accuracy of 98.74%, whereas the hybrid ResNet + ViT model achieved a competitive accuracy of 98.58%, showing that the hybrid architectures were effective in capturing both local and overall information. The experimental results showcase the promise of transformer-based models to achieve highly accurate, interpretable, and computationally efficient computer-based multi-class multi-disease classification systems, providing helpful assistance for cultivation management practices as well as for precision farming.

[134] Decoupled Motion Representation Learning for Moving Infrared Small Target Detection cs.CVPDF

Guoyi Zhang, Peiwen Wu, Han Wang, Xiangpeng Xu, Xiaohu Zhang

TL;DR: 本文提出了一种解耦运动表示学习框架，用于动态场景下的红外小目标检测。该方法通过显式运动分支建模全局相干背景运动，并利用隐式运动分支捕获目标敏感的局部运动异常，同时引入相干运动引导的局部异常推理模块来抑制误报。在两个具有挑战性的红外小目标检测基准测试中，该方法在动态复杂运动场景下显著优于现有SOTA方法，且保持了良好的推理效率。

Details

Motivation: 动态场景中红外小目标检测面临目标、成像平台和动态背景运动高度耦合的挑战，现有多帧方法通常进行隐式时序建模，导致检测性能与误报率之间存在固有权衡。

Result: 在两个具有挑战性的红外小目标检测基准测试上进行了广泛实验，结果表明该方法在动态复杂运动场景下始终优于现有最先进方法，同时保持了良好的推理效率。

Insight: 创新点在于将运动表示解耦为全局相干背景运动与局部目标运动异常，并利用预训练光流先验和自监督适应策略进行显式建模，同时通过相干运动引导抑制由背景动态引起的误报响应，这为处理动态背景下的目标检测提供了新思路。

Abstract: Infrared small target detection in dynamic scenes remains challenging due to the highly coupled motions among targets, imaging platforms, and dynamic backgrounds. Existing multi-frame methods usually perform implicit temporal modeling, where coherent background dynamics dominate motion correspondence learning, leading to an inherent trade-off between detection and false alarms. In this work, we observe that background motions exhibit strong global coherence, whereas small targets mainly correspond to sparse local motion anomalies. Moreover, many false-alarm responses maintain high consistency with globally coherent motion patterns, indicating that they mainly originate from coherent background dynamics rather than genuine target motions. Based on these observations, we propose a decoupled motion representation learning framework for moving infrared small target detection. Specifically, an explicit motion branch is introduced to model globally coherent motion dynamics using pretrained optical flow priors, together with a structure-preserving self-supervised adaptation strategy for infrared motion correspondence learning. Meanwhile, an implicit motion branch based on deformable feature alignment is designed to capture target-sensitive local motion anomalies under coherent motion guidance. Furthermore, a coherent-motion-guided local anomaly reasoning module is proposed to identify and suppress coherent-motion-induced false responses during localized motion modeling. Extensive experiments on two challenging infrared small target detection benchmarks demonstrate that the proposed method consistently outperforms existing state-of-the-art approaches, particularly in dynamic scenes with complex motions, while maintaining favorable inference efficiency.

[135] CoMNeT: A MedNeXt-CorrDiff Framework for Volumetric Brain Tumor Segmentation cs.CVPDF

Michael L. Evans, MD Fayaz Bin Hossen, MD Shibly Sadique, Walia Farzana, Khan M. Iftekharuddin

TL;DR: 本文提出了一种名为CoMNeT的脑肿瘤自动分割框架，该框架结合了MedNeXt 3D卷积分割模型与基于纠正扩散的后处理细化方法（CorrDiff），并采用集成学习策略，旨在提升多参数MRI图像中胶质瘤体积分割的准确性。

Details

Motivation: 解决多参数MRI脑肿瘤自动分割的难题，特别是由于肿瘤外观多变、MRI协议差异以及关键区域（如增强肿瘤和肿瘤核心）体积小导致的体素级精度难以提升的问题。

Result: 在UTSW-Glioma数据集上使用五折交叉验证，CoMNeT在大多数肿瘤区域（ET, TC, WT）取得了最高的Dice分数，平均Dice分数为0.7798，超越了SegResNet和独立MedNeXt等基线模型。

Insight: 创新点在于将先进的3D卷积分割模型（MedNeXt）与基于扩散模型的后处理纠正细化（CorrDiff）以及折叠级概率集成相结合，为现有SOTA模型提供了一种实用的性能增强方案。

Abstract: Accurate brain tumor segmentation from multiparametric magnetic resonance imaging (MRI) is critical for treatment planning, response assessment, and quantitative neuro-oncology research. However, automated segmentation remains a difficult task in computer vision because of variation in tumor appearance and MRI protocols across patient scans. Moreover, clinically important regions such as enhancing tumor (ET) and tumor core (TC) are often small relative to the full brain volume, furthering increasing the difficulty of achieving high voxel-level precision. In this paper, we show that combining a modern 3D convolutional segmentation model with corrective diffusion-based refinement and ensembling improves volumetric glioma segmentation on the UTSW-Glioma dataset. We propose CoMNeT, a MedNeXt-CorrDiff framework that uses four MRI modalities as input and predicts ET, TC, and whole tumor (WT) regions for automated brain tumor segmentation. MedNeXt is used as the primary segmentation model with Global Response Normalization for feature learning, while CorrDiff is trained as a postprocessing residual refinement method to correct errors in the probability maps before final thresholding. Using five-fold cross-validation, CoMNeT achieved the highest Dice score for most tumor regions, with ET, TC, WT, and average Dice scores of 0.7543 +/- 0.0261, 0.6806 +/- 0.0166, 0.9049 +/- 0.0128, and 0.7798 +/- 0.0184, respectively. CoMNeT outperformed two selected baseline models: SegResNet (0.7555 +/- 0.0190 average Dice) and standalone MedNeXt (0.7697 +/- 0.0154 average Dice). Our findings support the use of corrective diffusion and fold-level probability ensembling as practical additions to existing state-of-the-art 3D convolutional models for automated glioma segmentation.

[136] Conditional Multi-Event Temporal Grounding in Long-Form Video cs.CVPDF

Yuanhao Zou, Arthad Kulkarni, Lucas Tonanez, Lincoln Spencer, Guangyu Sun

TL;DR: 本文提出了一个用于长视频中条件多事件时序定位的新基准测试CoMET-Bench，它要求根据组合的时空条件定位视频中的所有相关事件。作者还提出了一个统一的评估协议，并基于此基准测试了多种方法，发现现有方法远未解决此任务。为此，作者提出了一个无需训练的智能体框架CoMET-Agent，通过结构化搜索和聚合显著提升了性能。

Details

Motivation: 现有的视频时序定位基准测试存在不足，它们通常每个查询只定位单个时刻、进行无时序条件的计数，或将定位和计数视为独立任务，无法满足现实应用中需要根据组合时空条件定位所有相关事件的需求。

Result: 在提出的CoMET-Bench基准上（包含600个平均时长33.8分钟的视频和2789个查询），广泛的MLLM、基于智能体和专门定位方法的测试表明，现有方法远未解决此任务。作者提出的CoMET-Agent框架，通过结构化推理，将F1@0.5分数比GPT-5提升了6.1%。

Insight: 论文的主要创新点在于提出了一个更符合现实需求、包含组合时空条件和负查询子集的条件多事件时序定位基准及统一的联合评估协议（包括新的Rejection-F1指标）。从客观角度看，将任务重构为结构化搜索-聚合过程的智能体框架（CoMET-Agent）是一种有效的、无需训练的问题解决思路，其揭示的细粒度实体跟踪、位置均匀检索和因果事件配对等开放方向也颇具研究价值。

Abstract: Multimodal large language models have made rapid progress in video temporal grounding, yet real-world applications routinely require localizing every event that satisfies compositional temporal and spatial conditions. Existing benchmarks fall short: they localize only a single moment per query, count without temporal conditions, or treat grounding and counting as disjoint tasks. We introduce CoMET-Bench for Conditional Multi-Event Temporal Grounding in long-form video, comprising 2789 queries over 600 videos averaging 33.8 minutes across five real-world domains, with each query composed from 4 temporal conditions, 3 spatial conditions, and a dedicated negative-query subset. We further propose a unified evaluation protocol jointly measuring counting, grounding, and negative-query recognition, including a new Rejection-F1 metric that prevents trivial gaming by lazy “always-empty” models. Benchmarking a broad suite of MLLMs, agent-based, and grounding-specialized methods reveals that existing approaches remain far from solving this task. Building on these findings, we propose CoMET-Agent, a training-free agentic framework that reformulates the task as structured search-and-aggregate, improving F1@0.5 by 6.1% over GPT-5 purely through structural reasoning. Failure analysis further surfaces three open directions: fine-grained entity tracking, position-uniform retrieval, and causal event pairing.

[137] SGFormer++: Semantic Graph Transformer for Incremental 3D Scene Graph Generation cs.CVPDF

Mengshi Qi, Changsheng Lv, Zijian Fu, Xianlin Zhang, Huadong Ma

TL;DR: 本文提出了SGFormer++，一种用于3D场景图生成（SGG）的新型语义图Transformer。它旨在将点云场景解析为语义结构图，核心创新在于利用Transformer进行全局消息传递，并引入了两个关键组件：高效整合边缘感知全局上下文的图嵌入层++，以及利用大语言模型和视觉语言模型先验增强视觉特征的语义注入层++。此外，论文还解决了增量SGG（I-SGG）的挑战，通过空间引导特征适配器和级联二元预测头来缓解灾难性遗忘。

Details

Motivation: 现有基于图卷积网络（GCN）的3D SGG方法存在过度平滑和感受野有限的问题，难以建模复杂的全局场景结构。同时，实际应用中新的关系类别会顺序到达，带来了增量学习的挑战。

Result: 在3DSSG基准测试上，SGFormer++在标准和增量设置下均达到了最先进的性能。特别是在增量设置下，其Predicate A@1指标取得了4.49%的绝对显著提升。

Insight: 主要创新点包括：1) 使用Transformer骨干网络实现全局消息传递；2) 设计了高效整合全局上下文和注入语言先验的组件，以增强语义表示；3) 针对增量学习，提出了利用空间几何校准特征和通过分类器扩展与logit蒸馏来缓解遗忘的机制。

Abstract: In this paper, we propose SGFormer++, a novel Semantic Graph Transformer for 3D scene graph generation (SGG), which aims to parse point cloud scenes into semantic structural graphs, where nodes denote detected object instances and edges encode their pairwise relationships, with the core challenge lying in modeling complex global scene structure. While existing graph convolutional network (GCN)-based methods suffer from over-smoothing and limited receptive fields, SGFormer++ leverages Transformer layers as its backbone to enable global message passing. Specifically, we introduce two key components tailored for 3D SGG: (1) a Graph Embedding Layer++ that efficiently integrates edge-aware global context with linear computational complexity, and (2) a Semantic Injection Layer++ that enriches visual features with linguistic priors from large language models (LLMs) and vision-language models (VLMs), boosting semantic representation without introducing extra trainable parameters. To further address the practical challenge of incremental SGG (I-SGG), where new relationship categories arrive sequentially, we equip SGFormer++ with a novel Spatial-guided Feature Adapter, which calibrates predicate features using subject-object spatial geometry to counter scale variation, and a Cascaded Binary Prediction Head that mitigates catastrophic forgetting via task-incremental classifier expansion and logit distillation. Extensive experiments on the 3DSSG benchmark demonstrate that SGFormer++ achieves state-of-the-art performance in both standard and incremental settings: it yields a significant 4.49% absolute improvement in Predicate A@1 under the incremental setting. Code and data are available at: https://github.com/Andy20178/SGFormer.

[138] CausalDrive: Real-time Causal World Models for Autonomous Driving cs.CVPDF

Tianyi Yan, Huan Zheng, Dubing Chen, Meizhi Qu, Yingying Shen

TL;DR: 本文提出了CausalDrive，一个可控的、实时的驾驶世界模型渲染器。它仅使用初始前视图帧、自车轨迹和宏观文本提示，就能预测因果交互，实现文本驱动的驾驶社会学控制，并克服了传统模型在实时性和交互性上的不足。

Details

Motivation: 现有世界模型在自动驾驶中作为交互式模拟器存在不足：布局条件渲染器依赖所有背景车辆的‘先知’轨迹，缺乏反应性；而纯动作条件预测器则缺乏对复杂交互的语义控制且推理延迟高，阻碍了闭环策略学习。

Result: 提出的Context-Forced DMD架构结合了连续流匹配和自校正蒸馏目标，实现了12 FPS的交互速度。实验表明，在CausalDrive反应性场景中训练的策略在现实世界中表现出更优的交互能力。

Insight: 核心创新在于通过排除未来NPC布局，迫使模型内在地预测因果交互，实现了文本驱动的驾驶社会学控制。同时，提出的新架构解决了自回归生成中的协变量偏移问题，将被动视频生成器转变为可玩的神经模拟器。

Abstract: World models have emerged as a promising paradigm for scaling autonomous driving (AD) data, yet existing video generative models fall short as interactive simulators. Layout-conditioned renderers rely on “oracle” future trajectories of all background agents, rendering them strictly non-reactive. Conversely, pure action-conditioned predictors lack semantic control over complex interactions and suffer from prohibitive diffusion latencies, hindering closed-loop policy learning. To bridge this gap, we present CausalDrive, a controllable, real-time foundation driving world renderer. CausalDrive operates solely on the initial front-view frame, the ego-vehicle’s trajectory, and a macroscopic text prompt. By excluding future NPC layouts, we compel the model to intrinsically predict causal interactions, enabling text-driven control over Driving Sociology, allowing users to dynamically orchestrate diverse counterfactual reactions to identical ego-actions. To overcome the efficiency bottleneck and address the covariate shift in autoregressive generation, we propose a novel Context-Forced DMD architecture. This combines continuous flow-matching with a self-correcting distillation objective, achieving interactive speeds of 12 FPS. This breakthrough transforms the passive video generator into a playable neural simulator. We demonstrate its versatility across three downstream applications: (1) generative closed-loop evaluation with significantly mitigated collision artifacts, (2) large-scale Reinforcement Learning (RL) post-training driven by a Video2Reward module, and (3) real-time human-in-the-loop simulation. Extensive experiments validate that policies trained within CausalDrive’s reactive scenarios exhibit superior interaction capabilities in the real world.

[139] Facial Affect Analysis for Service-Oriented Systems: Advances, Challenges, and Future Visions cs.CVPDF

Spyridon Georgiou, Aggelos Psiris, Thomas Lagkas, Vasileios Argyriou, Panagiotis Sarigiannidis

TL;DR: 本文探讨了面部情感分析（FAA）从独立识别任务向面向服务的软件生态系统（SoSE）中可重用感知能力的演进。论文在保留FAA方法论核心的同时，通过系统工程需求（如可组合性、可靠性）重新审视了静态/动态表情分析、动作单元/微表情建模以及CNN、Transformer等架构的最新进展，并强调了部署就绪性所需的非功能性需求，如不确定性感知、延迟、公平性等。最后提出了将FAA作为具有明确接口和可度量质量属性的可操作服务组件的路线图。

Details

Motivation: 动机是将面部情感分析从孤立的学术任务转变为面向服务的软件生态系统中可靠、可组合的感知服务组件，解决其在真实世界部署中的系统工程需求问题。

Result: 论文未报告具体的定量实验结果或基准测试排名，而是对现有技术进展进行了系统性综述，并指出仅靠基准测试性能的提升不足以确保其在SoSE中的就绪度。

Insight: 创新点在于从系统工程和软件服务的视角重构FAA研究，强调部署就绪性（deployability）的关键作用，将鲁棒性、公平性、隐私、运行时保证等非功能性需求与算法进步置于同等重要的地位，为FAA作为服务组件的生命周期管理提供了框架。

Abstract: Facial Affect Analysis (FAA) is evolving from a stand-alone recognition task into a reusable perception capability for Service-Oriented Software Ecosystems (SoSE). This paper preserves the FAA methodological core while reframing recent advances through systems-engineering requirements for composable and dependable services. We review representative progress in static and dynamic expression analysis, action-unit and micro-expression modeling, and modern CNN, Transformer, graph, and hybrid architectures, then interpret these advances by their operational fit in edge, cloud, and hybrid service pipelines. The synthesis emphasizes SoSE concerns that determine deployability: service contracts for uncertainty-aware outputs, latency and availability envelopes, lifecycle monitoring and recalibration, governance-aware integration, and interoperability across independently evolving components. Our analysis shows that benchmark gains alone are insufficient for SoSE readiness; robustness under shift, intervention stability, fairness, privacy posture, and runtime guarantees are equally critical. We conclude with a roadmap for treating FAA as an operational service component with explicit interfaces, measurable quality attributes, and accountable lifecycle management.

[140] Segmentation-based Detection for Efficient Multi-Task Spacecraft Perception cs.CVPDF

Sivaperuman Muniyasamy, Surendar Devasundaram

TL;DR: 本文提出了一种用于航天器多任务感知的紧凑型架构，旨在解决SPARK 2026挑战赛第一赛道的要求。该架构集成了MobileNetV3编码器和U-Net风格解码器，通过从预测的部件分割掩码联合中解析推导出检测框，实现了分类、检测和细粒度部件分割的单一模型高效处理。

Details

Motivation: 动机在于解决基于视觉的航天态势感知和自主在轨操作中面临的挑战，包括标注空间图像的稀缺性以及严重光照变化、低信噪比和高对比度等困难视觉域特性。

Result: 在SPARK 2026挑战赛中，该方法获得了0.9482的总分，其中分类任务得分为1.0000，检测任务为0.9788，分割任务为0.8917，总体排名第二，证明了轻量级编码器-解码器架构在实际星载视觉系统中的强大多任务性能。

Insight: 创新点在于提出了一种无需单独边界框回归头的检测方法，通过分析预测部件掩码的并集来推导检测框，从而在单航天器设置下实现了计算效率与准确密集预测的结合，为轻量级多任务空间视觉系统提供了有效解决方案。

Abstract: Vision-based perception is fundamental to Space Situational Awareness and autonomous on-orbit operations such as rendezvous, docking, servicing, and navigation. However, progress in this area is limited by the scarcity of annotated space imagery and by challenging visual-domain characteristics including severe illumination changes, low signal-to-noise ratio, and high contrast. We address Stream 1 of the SPARK 2026 Challenge, which requires a single model for spacecraft classification, detection, and fine-grained component segmentation across multiple target types. We propose a compact architecture that integrates a MobileNetV3 encoder with a U-Net-style decoder, combining computational efficiency with accurate dense prediction. Detection is derived analytically from the union of predicted component masks, avoiding a separate bounding-box regression head in the single-spacecraft setting. Our method achieved an overall leaderboard score of 0.9482, with task-specific scores of 1.0000 in classification, 0.9788 in detection, and 0.8917 in segmentation. The proposed approach ranked second overall in the SPARK 2026 Challenge, demonstrating that lightweight encoder-decoder architectures can deliver strong multi-task performance for practical onboard space vision systems.

[141] From Frames to Temporal Graphs: In-Context Egocentric Action Recognition with Vision-Language Models cs.CVPDF

Bessie Dominguez-Dager, Francisco Gomez-Donoso, Miguel Cazorla, Marc Pollefeys, Daniel Barath

TL;DR: 本文提出了一种将自我中心视频转换为时序动作图的方法，以提升视觉语言模型在动作识别中的性能。该方法通过多阶段提示流程，先将视频帧转化为密集的自然语言叙述，再将其形式化为结构化、开放词汇的图表示，从而将视觉感知与符号推理解耦。

Details

Motivation: 解决通用视觉语言模型在自我中心视频动作推理中难以直接处理原始像素、捕捉细粒度手-物交互过渡的问题，旨在通过符号化表示提升模型的动作识别能力。

Result: 在EGTEA和Epic-Kitchens-100数据集上，符号化图表示实现了高效的情境学习：少量样本的图演示在零样本基于帧和图推理的基础上带来了显著的准确率提升；即使在零样本设置下，基于图的推理也与基于像素的推理保持竞争力。

Insight: 创新点在于将视频投影到语言域，通过时序动作图作为语义瓶颈，使视觉语言模型更有效地作为符号推理器而非直接视觉观察者；这提供了一种无需微调、可扩展的端到端方法替代方案，更好地利用了模型潜在的推理优势。

Abstract: Action reasoning in egocentric video requires capturing fine-grained transitions of hand-object interactions, a task where general-purpose Vision-Language Models (VLMs) often struggle when operating directly on raw pixels. We propose to decouple visual perception from symbolic reasoning by converting videos into Temporal Action Graphs. In a multi-stage prompting pipeline, we first generate dense natural language narratives over short temporal windows as a semantic bottleneck, then formalize them into structured, open-vocabulary graph representations. On the EGTEA and Epic-Kitchens-100 datasets, the symbolic representation unlocks efficient in-context learning: few-shot graph demonstrations yield substantial accuracy gains over zero-shot frame and graph-based inference alike. Even in the zero-shot setting, graph-based reasoning remains competitive with pixel-based inference despite potential pretraining contamination favoring the latter. Across 11 open-weight VLMs from 6 model families ranging from 2B to 235B parameters, our findings indicate that current VLMs are more effective as symbolic reasoners than as direct visual observers. By projecting video into the language domain, we provide a scalable, fine-tuning-free alternative to end-to-end approaches that better leverages these models’ latent reasoning strengths. The code will be made public.

[142] Analyzing Visual Aircraft Representations with Sparse Autoencoders cs.CV | cs.LGPDF

Deepshik Sharma

TL;DR: 该论文研究稀疏自编码器能否分解视觉模型的中间表示以获取可解释特征。通过在FGVC-Aircraft数据集上训练ConvNeXt分类器，提取其最终特征层的空间激活，并训练稀疏自编码器对这些激活进行分解。通过定性视觉检查和定量消融实验，发现稀疏特征能部分对应可识别的飞机结构和视觉模式，但也存在多义性和空间定位粗糙等局限性。

Details

Motivation: 视觉模型在分类任务上表现优异，但其内部表示难以解释，本文旨在探索稀疏自编码器能否分解视觉模型的中间表示以获得可解释特征。

Result: 在FGVC-Aircraft数据集上，通过图像块激活分析、激活强度和类别选择性等方法评估稀疏特征，消融实验（包括输入空间模糊和特征空间抑制）显示这些特征能影响分类对数几率、分类边界和预测置信度，表明其与飞机识别相关。

Insight: 创新点在于将稀疏自编码器应用于视觉模型中间表示的分解，以揭示部分可解释的视觉特征；客观分析表明该方法能识别类相关特征，但受限于多义性和粗糙空间定位，为可解释性研究提供了新视角。

Abstract: Vision models can achieve strong performance on classification tasks, but the internal representations supporting their predictions are often difficult to interpret. This work investigates whether sparse autoencoders can decompose intermediate representations of a vision model into interpretable features. We train a ConvNeXt classifier on the FGVC-Aircraft dataset, extract spatial activations from its final feature stage, and train a sparse autoencoder on these activations. The learned sparse features are analyzed using top-activating image patches, activation strength, and class selectivity. Qualitative visual inspection reveals that several features correspond to recognizable aircraft structures and visual patterns. We evaluate a subset of selected features using input-space and feature-space ablations, measuring how blurring image patches and suppressing sparse features affect class logits, classification margins, and prediction confidence. The results suggest that sparse autoencoders can reveal partially interpretable, class-relevant visual features associated with aircraft recognition, while also exposing limitations such as polysemanticity and coarse spatial localization.

[143] Selective Synergistic Learning for Video Object-Centric Learning cs.CV | cs.AIPDF

WonJun Moon, Jae-Pil Heo

TL;DR: 本文提出了一种名为选择性协同学习（SSync）的新方法，用于改进视频以物体为中心的学习（VOCL）。该方法通过选择性蒸馏最可靠的线索，即利用编码器进行边界细化、解码器进行内部去噪，并引入线性复杂度的伪标签机制，避免了现有密集对齐策略中的错误传播和高计算成本问题。

Details

Motivation: 现有基于槽位的VOCL方法依赖重建驱动的编码器-解码器架构，其编码器的注意力图和解码器的物体图具有不同特性。现有的密集对齐策略试图通过对比学习强制所有时空块达成一致，但这会不加区分地传播各模块的固有弱点（如噪声预测和模糊边界），且计算成本高昂（二次复杂度），限制了可扩展性。

Result: 广泛的实验研究表明，SSync提高了分解质量，作为一个通用的即插即用模块，对槽位配置也表现出卓越的鲁棒性。

Insight: 主要创新点在于提出了选择性协同蒸馏策略，通过线性复杂度的伪标签机制，有选择地利用编码器和解码器的优势（边界细化与内部去噪），而非进行全量对齐，从而避免错误传播并提升效率。此外，引入的传递性伪标签合并机制，基于时空激活一致性合并重叠的槽位，有助于缓解架构偏差（如槽位冗余）。

Abstract: Typical video object-centric learning (VOCL) approaches employ slot-based frameworks that rely on reconstruction-driven encoder-decoder architectures, where learning is mediated by two spatial maps: attention maps from the encoder and object maps from the decoder. As these two distinct maps exhibit different properties, a recent dense alignment strategy attempted to reconcile this discrepancy by enforcing agreement across all spatio-temporal patches via contrastive learning. However, this indiscriminate alignment inadvertently propagates the inherent weaknesses of each module, such as noisy encoder predictions and blurred decoder boundaries. Moreover, computing dense similarities across all pairs incurs a computational cost quadratic in the total number of spatio-temporal patches, severely limiting scalability. Motivated by this, we propose Selective Synergistic Learning (SSync). Instead of exhaustive patch-to-patch alignment, SSync prevents error propagation by selectively distilling only the most reliable cues: leveraging the encoder strictly for boundary refinement and the decoder for interior denoising. This is realized via a pseudo-labeling with linear complexity, eliminating the need for quadratic spatial comparisons. Also, to prevent the reinforcement of architectural biases like slot redundancy, we introduce a transitive pseudo-label merging that consolidates overlapping slots based on spatio-temporal activation consistency. Extensive studies demonstrate that SSync improves decomposition quality and serves as a versatile, plug-and-play module while also exhibiting exceptional robustness to slot configurations. Code is available at github.com/wjun0830/SSync.

[144] Track2View: 4D-Consistent Camera-Controlled Video Generation via Paired 3D Point Tracks cs.CVPDF

Feng Qiao, Zhaochong An, Zhexiao Xiong, Serge Belongie, Nathan Jacobs

TL;DR: Track2View提出了一种基于配对3D点轨迹的视频扩散变换器方法，用于从新视角重新渲染现有视频。该方法利用稀疏的3D点轨迹在源视图和目标视图之间建立显式的时空对应关系，通过双视图轨迹条件器传递视觉上下文，确保4D一致性（3D空间+时间）和泛化到任意相机轨迹的能力。

Details

Motivation: 解决从新相机视角重新渲染视频时，现有方法依赖逐帧姿态嵌入、噪声点云渲染或隐式学习对应关系，缺乏显式、时间连续的源-目标像素链接的问题，旨在生成遵循指定相机轨迹、同时保持原始场景外观和动态的视频。

Result: 在包含静态和动态场景的400个视频基准测试中，Track2View在视觉质量、视图同步和相机精度方面达到SOTA，相对于领先基线，旋转误差减少30-65%，平移误差减少61-72%。

Insight: 创新点在于使用配对3D点轨迹作为条件，提供构造上时间连续的显式时空对应；双视图轨迹条件器通过无参数几何操作和学习的时间聚合实现视觉上下文传递，确保泛化性；数据策划流程通过在多相机视图对上运行3D点跟踪器提取一对一轨迹对应。

Abstract: Re-rendering an existing video from a novel camera viewpoint requires the output to follow the prescribed camera trajectory while preserving the appearance and dynamics of the original scene across every frame. Existing methods rely on per-frame pose embeddings, noisy point-cloud renderings, or implicit learned correspondences, none of which provides an explicit, temporally continuous link between source and target pixels. We propose Track2View, which conditions a video diffusion transformer on paired 3D point tracks: sparse trajectories of scene points projected into both the source and target camera views. These tracks provide explicit spatiotemporal correspondences that are temporally continuous by construction, encoding what content should appear where and when. At the core of Track2View is a dual-view track conditioner that transfers visual context from source to target view through parameter-free geometric operations and learned temporal aggregation, ensuring generalization to arbitrary camera trajectories without memorizing specific motions. We further introduce a data curation pipeline that extracts one-to-one track correspondences by running a 3D point tracker on temporally concatenated multi-camera view pairs. On a 400-video benchmark spanning static and dynamic scenes, Track2View achieves state-of-the-art results across visual quality, view synchronization, and camera accuracy, reducing rotation error by 30-65% and translation error by 61-72% relative to leading baselines. Project page is available at this https URL: https://qjizhi.github.io/track2view

[145] Toward the Whole Picture: Accumulative Fingerprint Mapping and Reconstruction for Small-Area Mobile Sensors cs.CVPDF

Xiongjun Guan, Jianjiang Feng, Jie Zhou

TL;DR: 本文针对移动设备上小面积指纹传感存在的采集与识别不匹配问题，提出了一种累积式指纹映射与重建的新框架。该框架将一系列局部触摸观测转换为一个统一的、可渐进细化的指纹状态，最终实现一次性匹配，而非传统上对每个局部模板进行重复注册与匹配。

Details

Motivation: 解决移动设备小面积指纹传感器采集的局部、姿态变化的指纹补丁与可靠生物识别所需的稳定、完整指纹表示之间的根本性不匹配问题。

Result: 论文提出了一个经典的基线流程，并公开了其实现代码。该框架将移动指纹识别重新定义为从多捕获多匹配处理到累积地图构建、状态细化和一次性匹配的范式转变。

Insight: 核心创新在于将问题重新表述为累积式地图构建与状态细化，而非独立处理局部模板；提出的框架集成了结构化令牌学习、两阶段姿态推理和基于扩散的生成重建，为小面积移动平台提供了高效、姿态鲁棒且易于部署的生物识别新路径。

Abstract: Small-area fingerprint sensing on mobile devices creates a fundamental mismatch between acquisition and recognition: each touch captures only a tiny, pose-varying local patch, while reliable biometric matching ultimately requires a stable and sufficiently complete fingerprint representation. Existing pipelines largely cope with this mismatch by treating repeated touches as independent partial templates, which leads to repeated registration, repeated matching, and no guarantee of adequate global coverage. In this paper, we advocate a different formulation, namely \emph{accumulative fingerprint mapping and reconstruction} for small-area mobile sensing. Rather than matching every partial patch separately, the proposed perspective converts a sequence of local observations into a unified fingerprint state that is progressively refined as new touches arrive and can be matched only once after consolidation. As a concrete baseline, we present a classical pipeline that performs patch-wise structural feature extraction, feature-level registration and fusion, fingerprint map construction, and phase-based ridge reconstruction. More importantly, we position this baseline within a broader mobile fingerprint framework that integrates structured token learning, two-stage pose reasoning, and diffusion-based generative reconstruction. This viewpoint reframes mobile fingerprint recognition from multi-capture multi-match processing to accumulative map building, state refinement, and one-shot matching, offering a principled route toward efficient, pose-robust, and deployment-friendly biometrics for small-area mobile platforms. The baseline implementation has been publicly released at https://github.com/XiongjunGuan/FpReconstruction.

[146] Fusion-E2Pulse: A Multimodal Event-RGB Fusion Network for Non-contact Pulse Wave Reconstruction cs.CVPDF

Qian Feng, Hao Guo, Yan Niu, Zhenhuan Xu, Yidi Li

TL;DR: 本文提出了一种名为Fusion-E2Pulse的新型多模态网络，用于非接触式脉搏波重建。该网络融合了传统RGB相机和神经形态事件相机的优势，利用滤波后的RGB信号作为结构先验来抑制运动伪影，同时利用事件流的高灵敏度来恢复细微的形态学细节。

Details

Motivation: 传统基于RGB的方法受限于标准相机的积分成像机制，曝光过程会平滑并减弱细微的血管搏动细节；而事件相机虽然对强度波动极为敏感，但易受微小运动引起的噪声和伪影影响。本文旨在结合基于帧的积分感知和基于事件的差分感知的协同作用，以更精确地重建脉搏波形形态（包括重搏切迹）。

Result: 实验结果表明，Fusion-E2Pulse在噪声抑制和形态保真度之间取得了有效平衡，达到了最先进的性能。具体指标包括：心率估计的平均绝对误差为0.78 bpm，波形相关性为0.89，收缩期持续时间误差为16.74 ms，验证了其在重建细粒度病理特征方面的有效性。

Insight: 论文的创新点在于提出了一种新颖的多模态融合框架，将RGB信号作为结构先验与事件流的高灵敏度细节恢复能力相结合。从客观角度看，这种融合策略为解决单一模态（RGB平滑效应或事件流噪声）的固有局限性提供了一种有前景的解决方案，有望提升非接触式生理信号重建的精度和鲁棒性。

Abstract: Non-contact pulse wave reconstruction hinges on the precise recovery of waveform morphology, including the dicrotic notch. Conventional Red-Green-Blue (RGB)-based methods, which extract physiological signals from recorded facial videos, are constrained by the integral imaging mechanism of standard cameras, where the exposure process induces a smoothing effect that attenuates subtle vascular pulsation details. Conversely, neuromorphic event cameras, while offering exceptional sensitivity to intensity fluctuations, are inherently susceptible to noise and artifacts induced by minor motion. To exploit the synergy between frame-based integration and event-based differential sensing, we propose a novel multimodal network named Fusion-E2Pulse. This framework utilizes filtered RGB signals as structural priors to suppress motion artifacts, while leveraging the high-sensitivity of event streams to recover fine-grained morphological details. Experimental results demonstrate that Fusion-E2Pulse achieves state-of-the-art performance, effectively balancing noise suppression and morphological fidelity, achieving a mean absolute error of 0.78 bpm for heart rate estimation, a waveform correlation of 0.89, and a systolic phase duration error of 16.74 ms, validating its efficacy in reconstructing fine-grained pathological features.

[147] On the Adversarial Robustness of Multimodal LLM Judges cs.CVPDF

Zihan Wang, Guansong Pang, Zelin Liu, Wenjun Miao, Jin Zheng

TL;DR: 本文研究了多模态大语言模型作为自动评估器时的对抗鲁棒性问题，提出了首个通用评估框架RobustMLLMJudge，并揭示了现有MLLM评估器在质量和安全评估场景下极易受到分数膨胀对抗攻击。为克服评估协议中的独特约束，作者进一步提出了MGSIA攻击方法，该方法结合语义诱导和流形对齐，能生成更有效且可迁移的对抗扰动。

Details

Motivation: 多模态大语言模型正被广泛用作自动评估器，但其对抗鲁棒性尚未得到充分探索，这威胁到自动化评估的公平性和可靠性。本文旨在填补这一空白，系统评估MLLM评估器的对抗脆弱性。

Result: 实验表明，不同的MLLM评估器对分数膨胀攻击高度脆弱。提出的MGSIA方法在多种评估场景下，对先进的MLLM评估器均表现出优越的欺骗性和泛化能力，突显了开发鲁棒MLLM评估器的迫切需求。

Insight: 创新点在于提出了首个针对通用MLLM评估器的对抗鲁棒性评估框架，并设计了一种新颖的MGSIA攻击方法，其核心是将肯定的语义诱导与高分流形对齐相结合，以绕过评估协议约束，生成可迁移的对抗样本。这为理解和提升MLLM系统的安全性提供了重要视角。

Abstract: Multimodal Large Language Models (MLLMs) are increasingly used as automated judges, e.g., for image quality and safety assessment. However, their adversarial robustness remains largely unexplored, threatening the fairness and reliability of automated judging. To bridge this gap, we introduce RobustMLLMJudge, the first general framework for evaluating the adversarial robustness of general-purpose MLLMs when functioning as judges. It covers diverse attacks against popular judge approaches across quality and safety evaluation scenarios. Using RobustMLLMJudge, we reveal that i) different MLLM judges are highly vulnerable to score-inflating adversarial attacks; and ii) although effective, these attack methods face a critical challenge due to unique constraints in the evaluation protocols of MLLM judges. We further propose MGSIA, namely Manifold-Guided Semantic Induction Attack, a novel method that bypasses these constraints to enable more effective and transferable attacks on MLLM judges. The core idea of MGSIA is to combine affirmative semantic induction with high-score manifold alignment: it maximizes the probability that judges yield affirmative responses (e.g., “Yes”) to binary semantic queries, while regularizing adversarial representations toward high-score centers estimated from proxy protocols. Together, these objectives yield transferable score-inflating perturbations. Extensive experiments demonstrate the superiority and generalizability of MGSIA in deceiving advanced MLLM judges under different evaluation scenarios, highlighting the need for robust MLLM judges. Code and data will be made available at https://github.com/mala-lab/RobustMLLMJudge.

[148] NeRD: Neuro-Symbolic Rule Distillation for Efficient Ontology-Grounded Chain-of-Thought in Medical Image Diagnosis cs.CVPDF

Hongxi Yang, Yiwen Jiang, Siyuan Yan, Jamie Chow, Eunis Li

TL;DR: 本文提出了一种名为NeRD（神经符号规则蒸馏）的框架，旨在解决医学图像诊断中现有可解释方法（如概念瓶颈模型和基于类判别性的生成方法）的局限性。该框架能够自动生成高效、基于诊断本体论且非冗余的推理链，无需手动制定规则。在两个皮肤数据集上的实验验证了其强大的诊断性能和可解释性，并通过专家评估确认了其临床合理性。

Details

Motivation: 现有概念驱动的可解释方法存在关键缺陷：概念瓶颈模型需要推理时对所有预定义概念进行评分和人工干预，给临床医生带来沉重负担；而基于基本原理的生成方法通常根据类别判别性选择概念，可能与诊断本体论产生偏差。

Result: 在两个皮肤数据集上的实验表明，该方法具有强大的诊断性能和可解释性。盲法专家评估证实了NeRD基本原理的临床合理性。此外，该方法首次实现了基于多模态思维链诊断的专家在环研究，实现了高效且有效的概念级干预。

Insight: 核心创新在于提出了神经符号规则蒸馏框架，能够自动生成基于本体论的、充分且非冗余的推理链，避免了手动制定规则或依赖可能偏离临床逻辑的纯数据驱动概念选择，从而在保证诊断性能的同时，显著提升了推理过程的效率和临床可解释性。

Abstract: Interpretability is essential for trustworthy medical image diagnosis. However, existing concept-driven interpretable methods have key limitations: Concept Bottleneck Models (CBMs) require scoring all predefined concepts at inference time and for manual intervention, imposing a substantial burden on clinicians, while rationale-based generative approaches often select concepts by class discriminability, which can drift from diagnostic ontologies. To address these issues, we propose Neuro-Symbolic Rule Distillation (NeRD), a framework that produces efficient, ontology-grounded reasoning chains that are sufficient yet non-redundant, without manually crafting diagnostic rules. Experiments on two skin datasets demonstrate strong diagnostic performance and interpretability, and blinded expert evaluation confirms the clinical plausibility of NeRD rationales. Our method further enables a first expert-in-the-loop study for Multimodal Chain-of-Thought-based diagnosis, achieving efficient and effective concept-level intervention.

[149] Open-World Video Segmentation cs.CVPDF

Qing Su, Kaiyang Li, Yuan Zhuang, Fei Miao, Shihao Ji

TL;DR: 本文提出了Savvy系统，用于解决开放世界长视频分割的挑战，该系统结合了分层掩码发现、延迟准入和轨迹合并技术，以实现持续的对象发现和稳定的长程身份维护。同时，论文引入了OGA评估套件，采用粒度无关的匹配协议，以更公平地评估开放世界视频分割方法。

Details

Motivation: 现有视频分割方法主要针对短片段和封闭集基准，缺乏对开放世界长视频中动态自我运动下的对象发现和身份维护的支持，且现有评估协议依赖于严格的1:1匹配，对粒度不匹配但语义有效的预测不公平惩罚。

Result: 在VIPSeg基准上，标准1:1评估显著低估了开放世界方法的性能，而GA评估恢复了其被抑制的性能。在更现实的长视频基准ScanNet和HM3D上，Savvy在STQ、VPQ$_infty$、IP和IC等指标上均优于强基线。

Insight: 创新点包括Savvy系统的分层掩码发现和轨迹合并机制，以及OGA评估套件的粒度无关匹配协议，后者通过检测支持不连续性来避免对碎片化或闪烁预测的过度奖励，同时引入了身份持久性和身份集中度等结构诊断指标。

Abstract: While video segmentation has advanced rapidly on short clips and closed-set benchmarks, open-world video segmentation remains largely unexplored. The challenge is twofold: (1) existing methods are not designed to support object discovery and identity maintenance in long videos of dynamic ego-motion, and (2) existing evaluation protocols rely on a rigid 1:1 matching that unfairly penalizes semantically valid predictions with mismatched granularity. To address both gaps, we introduce Savvy, a practical and strong system for zero-shot open-world long-horizon video segmentation. Savvy combines hierarchical mask discovery, deferred admission, and track consolidation to support persistent object discovery, safe track promotion, and stable long-range identity maintenance. We further propose OGA, a granularity-aware evaluation suite for open-world video segmentation. Built on a Granularity-Agnostic (GA) matching protocol, OGA relaxes conventional 1:1 matching to an n:1 mapping, but still enforces temporal rigor by detecting support discontinuities through sever points and scoring each reference object through its dominant coherent fragment. This prevents fragmented or flickering support from being over-rewarded while enabling GA-adapted metrics and structural diagnostics: identity persistence (IP), and identity concentration (IC). On VIPSeg, we show that standard 1:1 evaluation substantially underestimates open-world methods, whereas GA evaluation recovers much of their suppressed performance. On the more realistic long-horizon benchmarks: ScanNet and HM3D, Savvy consistently outperforms strong baselines across both classical and proposed metrics, including STQ, VPQ$_\infty$, IP and IC. Together, these results establish a practical benchmark and a strong baseline for open-world long-horizon video segmentation.

[150] Fusing Transferred Priors and Physics-based Decomposition for Underwater Image Enhancement cs.CVPDF

Haochen Hu, Yanrui Bin, Zhengyan Zhang, Minchen Wei, Chih-yung Wen

TL;DR: 本文提出了一种基于迁移学习和物理分解的水下图像增强方法，通过将增强任务分解为全局颜色校正、去雾和背景噪声抑制三个步骤，并利用其他视觉任务的先验知识作为跨域监督，无需水下图像的配对标签即可实现增强。

Details

Motivation: 现有基于学习的水下图像增强方法依赖于有噪声的伪标签数据，而真实标签难以获取，导致模型性能受限。本文旨在解决这一标签依赖问题，通过结合物理模型和迁移学习来提升增强效果。

Result: 定性和定量实验表明，该方法在多个水下图像增强基准测试中达到了SOTA性能，并有效提升了下游视觉任务的性能，显著优于现有基准方法。

Insight: 创新点在于将水下图像增强任务分解为物理对齐的子任务，并利用跨域先验知识作为监督，避免了伪标签噪声问题，同时增强了方法的理论合理性和泛化能力。

Abstract: The underwater images are captured within diverse water-medium conditions, leading to complex degradation, including color bias, low contrast, and blur effect. Recently, learning-based methods have demonstrated their potential for underwater image enhancement (UIE). However, most of the previous work focus on the training strategy or network design to make the enhanced result aligned well with the labels in datasets, ignoring that the labels are selected from the enhanced results of previous UIE methods and these pseudo-labels are noisy. Consequently, the performance of their models is not satisfactory to a certain extent. However, collecting the true labels of the underwater images is challenging. In this work, we propose a transfer learning-based UIE that does not require underwater images to have paired noisy or true labels for learning. Instead, the UIE task is first divided into global color correction, haze removal, and background noise suppression following the underwater physics. Then multiple types of prior from other vision tasks are leveraged as cross-domain supervision in each step. In this way, a novel UIE is available via transfer learning, and the physics-aligned UIE decomposition provides theoretical soundness. Qualitative and quantitative experiments demonstrate that our proposal based on physics and priors fusion achieves SOTA performance in the UIE task and effectively boosts downstream vision tasks, significantly outperforming benchmark methods. Project repo: https://github.com/Haru2022/P2-UIE.

[151] Self-Questioning Vision-Language Models: Reinforcement Learning for Compositional Visual Reasoning cs.CVPDF

Saraswathy Amjith

TL;DR: 本文提出了一种自提问视觉语言模型框架，通过强化学习训练模型将复杂的视觉推理问题分解为子问题，并依次回答以生成最终答案。该方法无需人工标注的逐步解释，在CLEVR和A-OKVQA数据集上验证了有效性。

Details

Motivation: 现有视觉语言模型在处理需要多步组合推理的视觉问题时表现不佳，而依赖人工标注的逐步解释成本高昂且难以扩展。

Result: 在A-OKVQA数据集上，自提问框架和标准强化学习分别将准确率从46.8%提升至52.2%和51.6%，证明了方法的有效性。

Insight: 创新点在于引入Group Relative Policy Optimization强化学习算法，通过奖励生成中间子问题和最终答案的正确性，使模型自主发现组合分解策略，无需人工分解示例。

Abstract: Vision-Language Models (VLMs) are AI systems that process both images and text, yet they often struggle with compositional visual reasoning questions that require chaining multiple steps together, such as identifying objects, counting them, and comparing the results. Existing approaches improve this reasoning by training models on human-written step-by-step explanations, but creating these annotations is expensive and difficult to scale. We propose a self-questioning framework that trains a VLM to break visual questions into smaller sub-questions and answer each one before producing a final response, using a reinforcement learning algorithm called Group Relative Policy Optimization (GRPO). The model is never shown examples of how to decompose questions, it discovers this behavior on its own, guided by a reward signal that scores whether the output contains sub-questions and whether the final answer is correct. We apply this framework to a 3-billion-parameter model, training on both synthetic scenes of geometric shapes (CLEVR) and real-world photographs (A-OKVQA). On A-OKVQA, both self-questioning and standard reinforcement learning substantially improve accuracy over the untrained model (52.2% and 51.6% vs. 46.8%). We introduce the first self-questioning VLM by rewarding not only the final answer like standard RL but additionally for generating intermediate sub-questions, enabling it to discover compositional decomposition strategies. These results suggest that teaching AI systems to ask themselves intermediate questions is a promising strategy for complex visual reasoning, particularly when the difficulty of a question warrants explicit step-by-step decomposition.

[152] OneFocus: Enabling Real-World X-ray Security Screening with a Unified Vision-Language Model cs.CVPDF

Jiali Wen, Hongxia Gao, Litao Li, Yixin Chen, Kaijie Zhang

TL;DR: 本文提出了一个用于X射线违禁品检测的统一视觉语言模型OneFocus，通过构建高质量数据集MMXray、合成数据集CleanDET与可控合成方法AnyContraSyn，解决了传统检测器泛化能力差和数据稀缺的问题。

Details

Motivation: 传统X射线违禁品检测器难以适应新出现的违禁品类型且缺乏基础视觉理解能力，而视觉语言模型受限于高质量X射线图像-文本数据的稀缺。

Result: OneFocus在X射线违禁品理解任务上达到了最先进的性能，并展现出强大的跨领域泛化能力，为安检领域建立了坚实的视觉语言基线。

Insight: 创新点在于构建了大规模细粒度X射线图像-文本数据集MMxray，并提出了可控合成方法AnyContraSyn来增强数据真实性；从客观角度看，其统一模型架构支持多任务处理，提升了安检场景的实用性和适应性。

Abstract: X-ray contraband detection is critical for security in large-scale logistics and transportation, yet conventional detectors struggle to adapt to emerging contraband types and lack fundamental visual understanding. Vision-language models (VLMs) offer strong generalization but are hindered by the scarcity of high-quality X-ray image-caption data. To bridge this critical gap, we present MMXray, a meticulously curated benchmark of 52,124 image-caption pairs spanning 28 fine-grained classes of X-ray contraband. To enrich MMXray with realistic occlusion patterns, we further introduce CleanDET, a dedicated synthesis dataset containing clean foreground contraband images from 28 categories and background images with diverse density levels, together with AnyContraSyn, a controllable synthesis method designed to operate on CleanDET. We also develop OnePipe, an extensible pipeline for systematic data curation. Built on MMXray, we propose OneFocus, a unified VLM that supports four core tasks: visual question answering, contraband localization, classification, and image understanding. OneFocus achieves state-of-the-art performance in X-ray contraband understanding and demonstrates robust cross-domain generalization, establishing a strong vision-language baseline for security screening.

[153] 3D Consistency Optimization for Self-Supervised Monocular Video Depth Estimation cs.CVPDF

Yuanye Liu, Ke Zhang, Junzhe Jiang, Li Zhang, Vishal Patel

TL;DR: 本文提出了一种用于自监督单目视频深度估计的3D一致性优化框架，将序列视频深度估计重新定义为无约束的多视角3D重建问题。该方法通过图像级光度渲染、显式世界坐标几何对齐和多尺度时间梯度一致性三个约束进行驱动，将孤立帧锚定到全局一致的3D结构中。

Details

Motivation: 现有自监督方法通常独立处理视频帧或依赖弱时间正则化，缺乏对底层3D场景的整体感知，导致几何不一致的预测和严重的跨帧漂移。本文旨在解决这些问题，以提升内窥镜导航等下游3D推理和具身AI任务的可靠性。

Result: 在自监督训练场景和具有挑战性的零样本临床环境中验证，结果表明该方法在空间精度上达到了最先进水平，超越了基于帧、基于视频的深度估计器以及多视角3D重建基线。

Insight: 创新点在于将视频深度估计重新定义为多视角3D重建问题，并利用3D基础模型中嵌入的强大几何先验。核心框架通过三个约束的统一优化，实现了从孤立帧预测到全局一致3D结构的优雅转换，为自监督视频理解提供了新的范式。

Abstract: Reliable monocular video depth estimation is crucial for downstream 3D reasoning and embodied AI in endoscopic navigation. However, existing self-supervised approaches typically treat video frames independently or rely on weak temporal regularization. These methods, lacking a holistic perception of the underlying 3D scene, inevitably suffer from geometrically inconsistent predictions and severe cross-frame drift. To address these limitations, we introduce a new paradigm that recasts sequential video depth estimation as an unconstrained multi-view 3D reconstruction problem, enabling full exploitation of the powerful geometric priors embedded in recent 3D foundation models. The core of our approach is a 3D consistency optimization framework driven by three constraints: image-level photometric rendering, explicit world-coordinate geometric alignment, and multi-scale temporal gradient consistency. Such unified optimization elegantly anchors isolated frames to a globally coherent 3D structure. Our method has been validated in both the self-supervised training scenarios and challenging zero-shot clinical environments. Results show that the proposed approach achieves state-of-the-art spatial accuracy, outperforming the frame-based, video-based depth estimators and the multi-view 3D reconstruction baselines.

[154] OmniTraffic: A Controllable Generation Pipeline and Benchmark for Spatio-Temporal Traffic Reasoning cs.CV | cs.AI | eess.SYPDF

Maonan Wang, Zhengyan Huang, Kemou Jiang, Yuhang Fu, Jiayue Zhu

TL;DR: OmniTraffic是一个用于时空交通推理的可控生成流水线和基准测试集，它基于12个真实世界交叉路口重建的可编辑3D交通环境，并辅以来自两个国家的监控录像。该基准支持可控和自然条件下的评估，定义了从场景感知、多视角与时间推理到决策支持的三级任务层次，生成了涵盖车辆状态、车道功能、视图-BEV对应、时间动态和信号相位分析的同步多视角VQA样本，共计800万个样本和3000个人工验证的测试集。

Details

Motivation: 现有面向交通的多模态基准主要强调被动视觉识别或孤立的视频理解，缺乏在受控条件下评估结构感知交通推理的能力，因此需要构建一个支持可控生成和评估的交通推理基准。

Result: 对11个前沿多模态大语言模型的评估揭示了较大的人-模型差距，尤其是在基于拓扑和时空推理的任务上失败最为明显；在模拟OmniTraffic数据上微调一个轻量级MLLM进一步提升了其在真实世界交通场景上的性能。

Insight: 创新点在于提供了一个可扩展的流水线，支持可配置的交叉路口、摄像机视角、交通需求、信号相位、视觉条件和罕见事件，并证明了模拟生成监督对于交通特定多模态推理的价值。

Abstract: Traffic scene understanding requires models to reason beyond object recognition, including lane topology, multi-view geometry, temporal evolution, and signal-phase semantics. However, existing traffic-oriented multimodal benchmarks largely emphasize passive visual recognition or isolated video understanding, offering limited support for evaluating structure-aware traffic reasoning under controlled conditions. We introduce OmniTraffic, a controllable generation pipeline and benchmark for spatio-temporal traffic reasoning. Built around 12 real-world intersections reconstructed into editable 3D traffic environments and complemented by surveillance footage from two countries, OmniTraffic supports both controlled and natural-condition evaluation. It defines a three-level task hierarchy spanning scene perception, multi-view and temporal reasoning, and decision support. Using structured traffic metadata, OmniTraffic generates synchronized multi-view VQA samples covering vehicle states, lane functions, view–BEV correspondence, temporal dynamics, and signal-phase analysis, resulting in 8M VQA samples and a 3K human-verified test set. Evaluation of eleven frontier MLLMs reveals a large human–model gap, with the most pronounced failures in topology-grounded and spatio-temporal reasoning tasks. Fine-tuning a lightweight MLLM on simulated OmniTraffic data further improves performance on real-world traffic scenes, demonstrating the value of simulation-generated supervision for traffic-specific multimodal reasoning. Beyond a fixed dataset, OmniTraffic provides an extensible pipeline with configurable intersections, camera views, traffic demands, signal phases, visual conditions, and rare events.

[155] Task-Instructed Causal Routing of Vision Foundation Models for Multi-Task Learning cs.CVPDF

Donghyun Han, Yuseok Bae, Jung Uk Kim, Hyung-Il Kim

TL;DR: 本文提出了TIGER框架，通过自然语言任务指令引导的路由网络，协调多个异构视觉基础模型（VFMs）进行多任务密集预测。该框架利用反事实损失对齐路由决策与各专家的因果贡献，实现了对互补专家特征的适应性集成，并在保持所有VFMs冻结的情况下，在多个基准测试中超越了现有基线。

Details

Motivation: 单个视觉基础模型因其预训练目标和数据域形成的强归纳偏置，难以捕获多任务密集预测所需的各种视觉表示，而现有模型的知识是碎片化且互补的。

Result: 在NYUD-v2和Pascal Context两个多任务密集预测基准测试上，TIGER持续超越了近期的多任务学习基线方法，达到了先进的性能水平。

Insight: 创新点在于利用自然语言任务指令进行细粒度（token级）的专家路由，并引入反事实损失来确保路由决策的可解释性和可靠性，从而实现了对多个冻结的异构视觉基础模型的有效协调与集成。

Abstract: Vision foundation models (VFMs) have demonstrated strong robustness and transferability across a wide range of visual tasks. However, each model typically encodes strong inductive biases shaped by its pre-training objective and data domain, resulting in fragmented yet complementary visual knowledge. As a result, a single model often struggles to capture the diverse visual representations required across multiple dense prediction tasks. To address this limitation, we propose TIGER (Task-Instruction-Guided Expert Routing), a framework that coordinates multiple heterogeneous VFMs for multi-task dense prediction. Instead of naively aggregating expert features, TIGER leverages natural-language task instructions to guide a routing network that assigns token-level expert weights conditioned on task semantics, enabling adaptive integration of complementary expert features. TIGER further introduces a counterfactual loss that aligns routing decisions with each expert’s causal contribution by measuring prediction changes when experts are excluded, encouraging more reliable and interpretable routing. We evaluate TIGER on two multi-task dense prediction benchmarks, NYUD-v2 and Pascal Context, where it consistently outperforms recent multi-task learning baselines while keeping all VFMs frozen. These results demonstrate that combining instruction-guided expert routing with counterfactual causal alignment enables effective coordination of heterogeneous vision foundation models.

[156] Faithful Action-unit Causal Reasoning for Counterfactually Faithful Emotion Explanations cs.CV | cs.LGPDF

Van Thong Huynh, Hong Hai Nguyen, Thuy Pham, Trong Nghia Nguyen, Soo-Hyung Kim

TL;DR: 该论文提出了一种名为FACR的方法，用于实现反事实忠实的情感解释，通过将动作单元（AU）到情感的推理建模为反事实一致性问题，并利用结构化的AU->情感因果图进行训练，以确保模型引用的AUs与其预测驱动因素一致。

Details

Motivation: 解决多模态模型在面部情感解释中AU->情感推理的忠实性问题，即模型引用的AUs往往只是看似合理而非真正驱动预测的因素，缺乏对因果结构的忠实性。

Result: 在UNBC-PAIN数据集上进行主体独立评估时，该方法将引用的AUs与PSPI疼痛AU组成的匹配度从基线0.08提升至0.57；在跨数据集情感迁移任务中，对七类任务的忠实性从0.50提升到0.84。

Insight: 创新点在于将AU->情感推理形式化为反事实一致性问题，并引入基于因果图的反事实忠实性训练目标，使得模型解释可训练且可度量；通过语言生成器扩展审计，确保解释文本与潜在激活一致，提升了可迁移性。

Abstract: Multimodal models can name the action units (AUs) behind a facial emotion, but their AU->emotion rationales are typically plausible rather than faithful: nothing forces the AUs a model invokes to be the AUs that actually drive its prediction. We cast AU->emotion reasoning as a counterfactual-consistency problem between the rationale, the label, and a structural AU->emotion causal graph G, and propose FACR, which grounds the reasoner in an independently induced, polarity-aware G and trains a counterfactual-faithfulness objective: a do-intervention on an AU that G marks causal for a class must move the prediction, while one it marks irrelevant must leave it unchanged. Faithfulness is thereby both trainable and measurable through a matching interventional metric, which we evaluate against a known causal structure, the PSPI pain-AU composition, as no existing affective-reasoning benchmark allows. We are explicit that this metric tests fidelity to the supplied structure rather than its rediscovery: it asks whether the trained reasoner invokes the AUs the structure marks causal, on held-out subjects and a second dataset. Under subject-independent evaluation on UNBC-PAIN, the objective raises the agreement between the invoked AUs and the PSPI composition from a no-objective baseline of 0.08 to 0.57, at a small detection cost; an unfaithfulness control attributes the gain to the objective. On a cross-dataset emotion transfer, the objective likewise raises fidelity to G on a seven-class task (0.50 to 0.84). Finally, we attach a language verbalizer and extend the audit to the generated text: biasing each action unit’s emission by its latent activation makes the rationale faithful by construction, so that ablating an AU removes it from the explanation, a property that transfers to a second language-model backbone, whereas a freely generated rationale is unfaithful.

[157] The Circumplex Degeneracy Behind the Rare-Class Limit in Affect Recognition cs.CVPDF

Van Thong Huynh, Hong Hai Nguyen, Soo-Hyung Kim

TL;DR: 本文通过多任务研究挑战了野外表情识别中少数罕见情绪识别失败的传统归因——类别不平衡，揭示了其根本原因在于情感几何结构中的简并性。作者提出了一种基于环形模型最优传输的代价项，但实验表明其性能提升并非源于几何结构，而是通用置信度惩罚的等效效果。研究指出，罕见表情的识别进步需要能够区分类别的表征，而非仅调整混淆代价。

Details

Motivation: 解决野外表情识别中少数罕见情绪（如愤怒、恐惧、蔑视）识别失败的问题，挑战将失败简单归因于类别不平衡的传统观点，探究其背后更深层的情感几何结构原因。

Result: 在Aff-Wild2和AffectNet两个基准测试上，环形模型最优传输代价项提升了官方评分和宏平均F1，但与均匀代价（通用置信度惩罚）的控制实验相比，在Aff-Wild2上无显著差异（p=0.625），在AffectNet上甚至显著低于均匀代价（+0.057）。几何结构主要改变了错误的结构，使其在情感上更接近真实值（在Aff-Wild2上p=0.031），但在AffectNet上被视觉混淆淹没。简并类别对频率干预、传输项和动作单元增强代价均表现出稳定的抵抗。

Insight: 创新点在于揭示了罕见表情识别失败的根本原因是情感环形模型中的简并性，而非类别不平衡；提出了用于区分几何结构收益与通用惩罚收益的控制实验和度量方法；强调了未来进展需要集中于学习能够区分简并类别的表征，而非仅调整损失函数或代价敏感学习。

Abstract: In-the-wild expression recognition persistently fails on a few rare emotions, and the standard explanation is class imbalance. Through a controlled multi-task study on two benchmarks, we show the failure is instead a property of affect geometry: the rare classes are degenerate on Russell’s circumplex, and that degeneracy bounds what any loss or cost can achieve. Our instrument is a circumplex-cost optimal-transport term that prices expression confusions by their valence-arousal distance. The term improves the official score and expression macro-F1, but a control most studies omit shows the gain is not geometric: a uniform cost, equivalent to a generic confidence penalty, matches it on Aff-Wild2 (p=0.625) and significantly exceeds it on AffectNet (+0.057 over base, larger than the circumplex). What the geometry reshapes is the structure of the errors, making them affectively nearer the truth on Aff-Wild2 (p=0.031 against the uniform control), an effect that does not survive on AffectNet, where a visual confound at the far corner of the circumplex overwhelms it. The rare-class failure, by contrast, is stable across both datasets we examine: the degenerate pairs (anger-fear on Aff-Wild2, anger-contempt on AffectNet) resist frequency-based interventions, the transport term, and an action-unit-augmented cost built specifically to separate them. We conclude that progress on rare expressions requires representations that distinguish the classes, not supervision that reprices their confusions, and we provide the controls and metrics needed to tell the two apart.

[158] Domain-Guided Prompting of the Segment Anything Model for Seismic Interpretation: The Role of Attributes, Visualization, and Hybrid Prompts cs.CV | cs.AI | physics.geo-phPDF

Aniq Ahmad, Heather Bedle, Ahmad Mustafa

TL;DR: 本文提出了一种基于领域引导提示的Segment Anything Model（SAM）零样本适应框架，用于地震数据解释。该框架通过结合地震属性与可视化选择（如色谱）以及混合提示策略（稀疏用户定义点提示与密集掩码提示），提升地质特征的可分性和分割精度，无需针对每个地质目标重新训练模型。

Details

Motivation: 解决SAM在地震解释中依赖微调、需要大量标注数据、计算成本高且泛化能力受限的问题，旨在实现完全零样本的适应，减少对标注数据的依赖并保持模型通用性。

Result: 在多个地质目标、数据集、提示配置和地震属性表示上的系统评估表明，该方法相比仅基于点提示的策略，能提升边界描绘和分割准确性，在完全零样本设置下达到有竞争力的分割性能。

Insight: 创新点包括地质目标感知的地震属性和色谱选择，以及结合稀疏点提示与密集掩码提示的混合策略，为利用基础模型提供了一种实用且可扩展的途径，增强了特征可分性并避免了模型重训练。

Abstract: The advent of large pretrained foundation models for computer vision has significantly improved the efficiency of visual data interpretation. The Segment Anything Model (SAM), in particular, offers powerful zero shot segmentation capabilities through prompt based interaction, thus making it a promising tool for seismic interpretation. However, most existing applications of SAM rely on fine tuning for specific geological targets, which requires extensive labeled data, incurs high computational cost, and often compromises the model’s generalization capability. In this study, we introduce a principled framework for zero shot adaptation of foundation models to seismic data. The framework is built on two key components: (1) aligning seismic attributes and visualization choices (e.g., colormaps) with the geological target of interest, and (2) employing a hybrid prompting strategy that combines sparse user defined point prompts with dense mask prompts derived from SAM’s internal feature activations. We systematically evaluate this framework across multiple geological targets, datasets, prompt configurations, and seismic attribute representations. Our results demonstrate that geologic target aware selection of seismic attributes and colormaps, combined with hybrid prompting, enhances the separability of geological features and improves boundary delineation and segmentation accuracy relative to point based prompting alone. Our findings show that, when these components are jointly applied, SAM can achieve competitive segmentation performance in a fully zero shot setting, thereby eliminating the need to retrain SAM for each geologic feature. This work establishes a practical and scalable pathway to leverage foundation models in seismic interpretation, reducing reliance on labeled data while preserving model generality.

[159] CPS4: Class Prompt driven Semi-Supervised Spine Segmentation with Class-specific Consistency Constraint cs.CVPDF

Qingtao Pan, Hongzan Sun, Bing Ji, Shuo Li

TL;DR: 本文提出了CPS4，首个利用类别提示的文本引导半监督脊柱分割网络，通过视觉语言模型增强脊柱伪标签质量。该方法包含两个训练阶段：类别一致性约束的VLM预训练阶段，以及类别提示驱动的半监督脊柱分割阶段。实验表明，在公开脊柱分割数据集上仅使用5%标注数据，CPS4达到了80.44%的Dice分数，超越了现有半监督学习和VLM方法。

Details

Motivation: 现有视觉语言模型虽能通过文本类别提示生成分割图以提升半监督脊柱分割的伪标签质量，但缺乏对脊柱类别提示与脊柱单元区域一致性的显式约束，导致多类分割图生成性能不佳。

Result: 在公开脊柱分割数据集上，仅使用5%标注数据，CPS4取得了80.44%的Dice分数，性能优于流行的半监督学习和VLM方法，达到了新的SOTA水平。

Insight: 创新点在于提出了令牌级和像素级注意力损失来优化类别提示与脊柱单元间的一致性，并设计了类别提示驱动的伪标签生成机制，将预训练的视觉-文本编码器用于生成高质量的多类分割图，从而有效提升了半监督分割性能。

Abstract: Vision Language Model (VLM) has great potential to enhance the quality of pseudo labels in semi-supervised spine segmentation by leveraging textual class prompts to generate segmentation map, but no one has studied it yet. Although promising, it lacks explicit constraints to ensure consistency between spine class prompts and spine unit region, resulting in unsatisfactory performance in multi-class segmentation map generation. In this paper, we propose CPS4, the first text-guided semi-supervised spine segmentation network using class prompts to enhance the quality of spine pseudo labels. Specifically, CPS4 is implemented through two training stages. (i) Class-specific consistency constrained VLM pretraining stage: we propose token- and pixel-level attention loss to optimize the consistency between class prompts and spine units, forcing the textual class prompt to be closely coupled with the target spine unit in the semantic space. (ii) Class Prompt driven semi-supervised spine segmentation stage: using the pretrained vision-text encoder, we derive each class-specific binary segmentation map for the unlabeled spine image and integrate them into an unified multi-class segmentation map, improving the quality of the spine pseudo label generated by the semi-supervised spine segmentation network. Experimental results show that our CPS4 achieves superior spine segmentation performance with Dice of 80.44%, only using 5% labeled data on the public spine segmentation dataset, surpassing popular semi-supervised learning and VLM methods. Our code will be available.

[160] DifFRACT: Diffusion Feature Reconstruction and Attribution for Circuit Tracing cs.CV | cs.AIPDF

Artyom Mazur, Nina Konovalova, Aibek Alanov

TL;DR: 本文提出DifFRACT方法，将基于转码器的电路追踪技术扩展到多模态扩散变换器（MM-DiT），通过训练时间步条件转码器来近似MLP子层的输入输出行为，从而实现对FLUX.1[schnell]模型中特征传播和交互的精确归因与可解释电路重建。该方法在稀疏性与忠实性权衡上匹配或优于稀疏自编码器，并揭示了属性绑定和跨流语义传播的机制，为系统生成错误提供了因果解释。

Details

Motivation: 当前多模态扩散变换器在图像生成中缺乏工具来理解语义信息如何在去噪步骤间传播以及文本与图像表示在双流架构中如何交互，现有方法（如注意力图、稀疏自编码器）仅提供有限视角，无法直接揭示非线性MLP层中特征的变换与组合方式。

Result: 在FLUX.1[schnell]模型上，转码器在稀疏性与忠实性权衡方面匹配或略优于稀疏自编码器；重建的电路揭示了属性绑定和跨流语义传播机制，并能因果解释系统生成错误；基于电路的干预比标准SAE引导更精确有效。

Insight: 创新点在于将转码器电路追踪扩展到多模态扩散变换器，通过时间步条件转码器线性化计算，实现精确的特征到特征归因和可解释电路重建；客观分析认为该方法为理解和控制最先进的扩散变换器提供了可行且强大的框架。

Abstract: Mechanistic interpretability seeks to explain neural network behavior by decomposing model computations into interpretable features and circuits. While transcoder-based circuit tracing has recently enabled detailed causal analyses of large language models, multimodal diffusion transformers for image generation remain comparatively opaque. We still lack tools for understanding how semantic information propagates across denoising steps and how text and image representations interact within double-stream MM-DiT architectures. Existing methods provide only partial insight: attention maps expose a limited view of token interactions, while sparse autoencoders can discover interpretable features but do not directly reveal how these features are transformed and composed through nonlinear MLP layers. In this work, we extend transcoder-based circuit tracing to multimodal diffusion transformers. We train timestep-conditioned transcoders that faithfully approximate the input-output behavior of MLP sublayers in FLUX.1[schnell]. By replacing MLPs with transcoders and linearizing the remaining computation, we obtain exact feature-to-feature attribution and recover compact, interpretable circuits. Empirically, our transcoders match or slightly outperform sparse autoencoders on the sparsity-faithfulness tradeoff. The resulting circuits reveal mechanisms underlying attribute binding and cross-stream semantic propagation, and provide causal explanations for systematic generation errors. Moreover, circuit-guided interventions are substantially more precise and effective than standard SAE-based steering. Our results demonstrate that transcoder-based circuit analysis is feasible for state-of-the-art diffusion transformers and provides a powerful framework for understanding and controlling multimodal generative models. The code is available at https://github.com/Artalmaz31/DifFRACT

[161] EmoZone-Talker: Regional Semantic Control of Audio-Driven 3DGS Talking Heads via Facial Action Units cs.CVPDF

Tingting Chen, Shaojun Wang, Huaye Zhang, Diqiong Jiang, Chenglizhao Chen

TL;DR: 本文提出了EmoZone-Talker，一个用于音频驱动3D高斯溅射（3DGS）说话人头像合成的新框架。该框架通过引入基于解剖先验的区域语义约束和独立的时序编码器，解决了语音驱动面部动画中细粒度、可解释表情控制与唇形同步之间的冲突问题，实现了对表情的精确解耦与时序连贯建模。

Details

Motivation: 现有基于3DGS的说话人生成方法在实现细粒度、可解释且可编辑的面部表情控制方面存在根本性挑战，主要源于语音驱动面部动态与显式表情信号之间的内在冲突，导致空间纠缠和时序不稳定。

Result: 大量实验表明，该方法在表情可控性和真实感方面均有提升，特别是在上半脸准确性和时序连贯性上取得了显著增益，同时保持了高渲染质量和准确的唇形同步。

Insight: 论文的创新点在于将音频驱动面部动画重新定义为跨模态冲突下的结构化时空协调问题，并提出了两个核心模块：基于解剖先验的协同区域与优先注意力偏置（SZ-PAB）进行显式空间解耦，以及通道独立时序AU编码器（CIT-AE）进行时序连贯建模，从而实现了对3D高斯形变的精确、可解释控制。

Abstract: 3D Gaussian Splatting (3DGS) has shown strong potential for high-fidelity talking head synthesis. However, enabling fine-grained, interpretable, and editable facial expression control remains fundamentally challenging due to intrinsic conflicts between speech-driven facial dynamics and explicit expression signals. Existing methods rely on implicit multimodal fusion, leading to spatial entanglement and temporal instability. We present EmoZone-Talker, a novel framework that reformulates audio-driven facial animation as a structured spatial-temporal coordination problem under cross-modal conflicts. Our approach introduces an explicit spatial disentanglement and temporal dynamics modeling of facial motion. Specifically, we propose Synergy Zones with Prioritized Attention Bias (SZ-PAB) to explicitly decouple modality contributions via region-wise constraints guided by anatomical priors, and a Channel-Independent Temporal AU Encoder (CIT-AE) to model temporally coherent AU dynamics. By integrating these representations into 3D Gaussian deformation, EmoZone-Talker enables precise and interpretable control over facial expressions. Extensive experiments demonstrate that our method improves expression controllability and realism, with notable gains in upper-face accuracy and temporal coherence, while preserving high rendering quality and accurate lip synchronization. Code will be publicly released to facilitate reproducibility and further research.

[162] Object Tokens as a Bridge Between Segmentation and Visual Question Answering in Robotic Surgery cs.CVPDF

Yiping Li, Ronald de Jong, Romy van Jaarsveld, Franco Badaloni, Gino Kuiper

TL;DR: 本文提出了一种统一框架，将像素级分割与视觉问答（VQA）任务结合，用于机器人手术场景。该方法利用视觉语言模型（VLM）生成对象令牌，这些令牌既指导VQA的答案预测，又被投影到基于Segment Anything Model（SAM）的解码器以产生分割掩码。通过联合优化分割和问答目标，模型学习到具有空间基础的表征，从而提升了对精细手术场景的理解能力。

Details

Motivation: 解决现有手术VQA方法通常依赖粗粒度的视觉定位（如边界框），无法捕捉手术对象的细粒度空间结构的问题，旨在通过联合分割与问答来增强模型对复杂手术场景的深度理解。

Result: 在私有RAMIE数据集和公开EndoVis18数据集上的评估表明，该方法在手术VQA任务上持续优于基线方法，实现了性能提升。

Insight: 创新点在于引入对象令牌作为分割与VQA之间的桥梁，通过联合优化使令牌学习到上下文感知且空间基础的表征；客观来看，这种多任务统一框架为细粒度视觉推理提供了一种可解释且高效的解决方案。

Abstract: Visual Question Answering (VQA) in robotic surgery, referred to as surgical VQA, requires high-level understanding of complex surgical scenes and the integration of visual perception with language reasoning, with the potential to support surgical training and intraoperative decision-making. Recent Vision-Language Models (VLMs) have shown promising performance through parameter-efficient fine-tuning; however, most existing approaches rely on coarse visual grounding, typically limited to bounding boxes, which fails to capture the fine-grained spatial structure of surgical objects. In this work, we propose a unified framework that jointly performs pixel-level segmentation and visual question answering within a single framework. Our approach integrates a VLM with a Segment Anything Model (SAM)-based decoder and represents scene elements as object tokens generated by the VLM. These object tokens guide answer prediction and are further projected to the SAM-based decoder to produce segmentation masks. By optimizing the object token embeddings through both segmentation and question answering objectives, the model learns spatially grounded representations that enhance visual reasoning while providing explicit pixel-level grounding. We evaluate the proposed method on the private RAMIE (Robot-Assisted Minimally Invasive Esophagectomy) dataset and the public EndoVis18 dataset, where it consistently outperforms baseline methods for surgical VQA. These results demonstrate that incorporating context-aware object tokens into vision-language models improves fine-grained surgical scene understanding.

[163] CogCanvas: A Benchmark for Evaluating Multi-Subject Reference-Based Image Generation cs.CVPDF

Long-Bao Nguyen, Quang-Khai Tran, Tam V. Nguyen, Minh-Triet Tran, Trung-Nghia Le

TL;DR: 论文提出了CogCanvas基准，用于评估多主体参考图像生成任务。该基准包含1952张参考图像，涵盖100个名人身份、115个独特物品和29个真实背景场景，并构建了1361个组合提示。基准支持三项任务，并引入统一六轴评估协议及两个新指标。

Details

Motivation: 当前扩散模型在多主体参考图像生成中，难以同时保持多个人物身份、绑定个人物品并尊重指定背景。现有基准仅评估单一维度，缺乏对多身份组合、人-物交互、背景接地和空间合理性的联合评估。

Result: 在CogCanvas上评估五种SOTA方法，结果显示所有模型性能随群体规模从2人增至5人而显著下降，超过三个主体时物品/时尚绑定几乎完全失败。

Insight: 创新点包括：1）首个联合评估多身份组合、人-物交互和背景的基准；2）引入BG-Sim（基于SAM掩码和DINOv3的背景保真度指标）和Attr-VQA（基于多模态LLM的属性绑定验证指标）；3）通过自动化流程构建结构化交互图作为真值监督。

Abstract: Multi-subject reference-based image generation requires jointly preserving multiple human identities, binding per-person objects and fashion items, and respecting a specified background scene, a regime where current diffusion models remain brittle. Existing benchmarks evaluate only one axis at a time and none jointly captures multi-identity composition with human-object interaction, background grounding, and spatial plausibility. We introduce CogCanvas, a benchmark of 1,952 curated reference images spanning 100 celebrity identities, 115 distinctive objects and fashion items, and 29 real-world background scenes including landmarks, from which we construct 1,361 compositional prompts covering 2-5 person group sizes. The curation pipeline combines DINOv2-based deduplication, two-stage aesthetic filtering, and automated derivation of structured interaction and position graphs that serve as ground-truth supervision. CogCanvas supports three tasks, reference-based multi-human-object generation (primary), text-to-image compositional generation, and reference retrieval, under a unified six-axis evaluation protocol. We introduce two metrics tailored to the multi-reference setting: BG-Sim, which scores background fidelity on SAM 3-masked regions via DINOv3 feature similarity, and Attr-VQA, which uses a multimodal LLM to verify per-subject attribute binding and inter-person interactions against the structured graphs. Benchmarking five SOTA methods reveals that every model degrades substantially as group size grows from 2 to 5, with near-complete failure on object/fashion binding beyond three subjects.

[164] Deep Residual Injection for Full-Spectrum Forensic Signal Perception in Multimodal Large Language Models cs.CV | cs.AIPDF

Kaiqing Lin, Zhiyuan Yan, Ruoxin Chen, Ke-Yue Zhang, Yue Zhou

TL;DR: 本文提出Deep-VRM方法，通过在MLLMs的中间层注入残差路径来融合低级生成伪影信号与预训练的语义知识，实现全谱系取证信号感知，从而提升AI生成图像的检测性能。

Details

Motivation: 动机在于解决MLLMs在取证应用中仅依赖语义级不一致性不足以可靠检测逼真AI生成图像的问题，探索MLLMs能否在不牺牲预训练语义知识的前提下捕获低级生成伪影。

Result: 大量实验表明，该方法在多数基准测试中达到了最先进的性能水平（SOTA）。

Insight: 创新点在于通过层间分析发现语义信息主要形成于中早期层，并据此设计残差注入机制，使模型能自适应地利用不同级别的取证信号，实现鲁棒且可泛化的检测。

Abstract: Multimodal large language models (MLLMs) have been increasingly adopted in forensics for their robust semantic understanding. As AI-generated images become realistic, semantic-level inconsistencies alone are often insufficient for reliable detection. This motivates a critical question: whether MLLMs can achieve full-spectrum forensic signal perception, i.e., capturing low-level generator artifacts without sacrificing pre-trained semantic knowledge. We further perform a layer-wise analysis of forensic signal perception in MLLMs, showing that semantic information is primarily formed in the early-to-middle layers, whereas direct fine-tuning for artifact learning disrupts these semantic representations. Based on this insight, we propose Deep Visual Residual MLLM (Deep-VRM) to preserve early semantic processing while injecting artifact-specific visual signals as a residual path into an intermediate layer, where they are fused with semantic token representations and propagated through subsequent trainable layers. This enables later layers to jointly model semantic reasoning and signal-level forensic cues, and surprisingly, the model learns to adaptively leverage different levels of forensic signals depending on the input, achieving robust and generalizable detection performance. Extensive experiments show that our method achieves state-of-the-art across most benchmarks. The code and data are available at https://github.com/KQL11/Deep-VRM.

Jingyu Li, Zhe Liu, Dongnan Hu, Junjie Wu, Zipei Ma

TL;DR: 本文提出了Metis，一种用于自动驾驶和城市导航的通用高效世界-动作模型（WAM）框架。它通过解耦视频生成和动作预测，采用专家混合Transformer架构，并引入非对称注意力掩码，在训练时联合优化，在推理时绕过显式视频生成，从而解决了现有方法推理延迟高和泛化能力差的问题。

Details

Motivation: 现有基于视觉-语言-动作模型或视频生成模型的世界-动作模型存在两个关键局限：一是测试时预测未来观测导致推理延迟高；二是视频与动作建模紧密耦合导致表征不匹配和泛化能力下降。

Result: 在NAVSIM的navhard、navtest基准以及CityWalker导航基准上的大量实验证明了其最先进的性能，验证了其在不同任务上的泛化能力和效率。真实机器人部署进一步证实了其实用可行性。

Insight: 核心创新在于将世界-动作模型解耦为视频生成和动作预测两个专家，并通过非对称注意力掩码实现高效联合训练与推理分离，在保持规划性能的同时显著降低了计算成本，确保了训练与推理的一致性。

Abstract: World action models~(WAMs) have shown great promise for autonomous driving and urban navigation. Built upon Vision-Language-Action models or video generation models, existing approaches suffer key limitations: (1) High inference latency due to future observation prediction at test time, and (2) tightly coupled video and action modeling leading to representational mismatch and degraded generalization. To address both issues, we propose Metis, an end-to-end WAM framework that decouples video generation and action prediction. Specifically, Metis employs a Mixture-of-Transformers architecture with dedicated experts for video generation and action prediction, preserving the intrinsic distributional properties of each task. To enhance efficiency, we introduce an asymmetric attention mask that enables joint training of both experts while allowing the action model to bypass explicit video generation during inference. This design ensures training-inference consistency and significantly reduces computational costs without compromising planning performance. Extensive experiments demonstrate state-of-the-art performance on the NAVSIM navhard and navtest benchmarks and the CityWalker navigation benchmark, validating both the generalizability and efficiency across diverse tasks. Real-robot deployments further confirm the practical feasibility of our approach.

[166] High-Fidelity 4D Hand-Object Capture via Multi-View Spatiotemporal Tracking and Physics-Aware Gaussians cs.CVPDF

Bo Peng, Xu Chen, Yi Gu, Hidenobu Matsuki, Mingsong Dou

TL;DR: 本文提出了一种无需模板或标记的高保真4D手-物交互重建系统，包含两个核心组件：多视图前馈Transformer模型用于提供姿态和几何的可靠初始化，以及基于物理感知高斯优化的细化框架。该系统通过整合多视图时空线索和物理约束，实现了对严重遮挡场景下手-物交互的鲁棒且精确的重建。

Details

Motivation: 当前4D手-物交互数据生成依赖预扫描物体模板和物理标记，且现有方法对初始姿态估计高度敏感，而交互中固有的严重遮挡使得从图像估计姿态极具挑战。

Result: 在公开基准和大量内部数据集上验证，该流程实现了高度鲁棒、无伪影的重建，为自动化4D资产生成提供了高效基础。

Insight: 创新点在于：1) 利用多视图Transformer聚合跨视图几何和时序线索，提供度量一致的初始化；2) 提出物理感知高斯优化框架，整合四面体约束、碰撞细化和外观分解，确保物理合理性和视觉精度。

Abstract: The growing demand for high-fidelity 4D hand-object interaction (HOI) data in embodied AI and spatial computing is currently bottlenecked by the reliance on pre-scanned object templates and physical markers. While recent methods have demonstrated promising results in reconstructing 4D hand-object interaction from videos, they are highly sensitive to initial estimates of hand and object poses. Yet, estimating these poses from images is challenging, in particular under severe occlusion which is inherent in hand-object interaction scenarios. We propose a novel system for the robust and accurate reconstruction of hands and objects from synchronized and calibrated multi-view videos without requiring any templates or markers. Our system consists of two main components with key innovations: (1) a multi-view feed-forward transformer model that aggregates cross-view geometry and temporal cues to provide a reliable, metric-consistent initialization for both poses and dense object geometry, and (2) a hand-object physics-aware Gaussian-based optimization framework to refine the initial estimates, integrating tetrahedral constraints, collision refinement, and appearance decomposition to produce physically plausible and visually accurate reconstruction. Validated on public benchmarks and an extensive internal dataset, our pipeline achieves highly robust, artifact-free reconstruction, providing an efficient foundation for automated 4D asset generation. Our project page are available at https://zyshen021.github.io/HOSTPG/.

[167] TurboGS: Accelerating 3D Gaussian Splatting via Error-Guided Sparse Pixel Sampling and Optimization cs.CV | cs.GRPDF

Zheng Dong, Daifei Qiu, Pinxuan Dai, Ke Xu, Jiamin Xu

TL;DR: 本文提出了TurboGS，一种基于误差引导的训练框架，旨在加速3D高斯泼溅（3DGS）的优化过程。该方法通过聚焦于感知信息丰富的像素，减少冗余计算，从而在保持高保真新视角渲染质量的同时，显著提升训练速度。

Details

Motivation: 现有3DGS加速方法在冗余像素上仍消耗大量计算，且牺牲了细节精度。因此，需要一种能高效优化、专注于关键像素的方法，以满足消费级应用对快速、高质量3D重建的需求。

Result: 在标准基准测试中，TurboGS在单个RTX 5090 GPU上仅用100秒即可达到与原始3DGS相当或更优的渲染质量，训练速度提升高达10倍。

Insight: 创新点包括：基于多视图重建误差的瓦片稀疏像素采样、结构感知的稀疏归一化互相关损失、误差驱动的高斯密度控制策略，以及结合Hessian信息与Adam动量阻尼的混合优化器。这些组件共同实现了高效且稳定的稀疏监督优化。

Abstract: Consumer-level applications require fast optimization of 3D Gaussian Splatting (3DGS) with high-fidelity novel view rendering. However, existing 3DGS acceleration approaches still incur substantial computation on redundant pixels while sacrificing fine details. In this paper, we present TurboGS, an error-guided training framework that accelerates 3DGS by concentrating optimization on perceptually informative pixels. TurboGS is built upon four core components: (1) a tile-wise sparse pixel sampling, which, driven by multi-view reconstruction errors during training, prioritizes challenging regions and skips well-reconstructed ones to avoid redundant gradient computation; (2) a tile-wise structure-aware loss with sparse Normalized Cross-Correlation, which provides sparse yet effective supervision to preserve fine details and stabilize training; (3) an error-driven Gaussian density control strategy, which dynamically allocates model capacity and removes redundant primitives; and (4) a tailored hybrid optimizer that couples Hessian-informed updates with Adam moment damping to stabilize and improve convergence under sparse supervision. Experiments on standard benchmarks demonstrate that TurboGS can deliver on par or superior rendering quality within 100 seconds on a single RTX 5090 GPU card (up to 10x training speedup over vanilla 3DGS).

[168] OmniOPSD: Rationale-Privileged On-Policy Self-Distillation for Affective Computing cs.CVPDF

Zebang Cheng, Shuimu Chen, Boxue Yang, Yuanshen Guan, Jingyi Chen

TL;DR: 本文提出了OmniOPSD框架，一种用于情感计算的、基于理由特权的同策略自蒸馏方法。该框架旨在解决多模态大语言模型在复杂推理任务中面临的奖励稀疏问题，特别是在涉及人类状态、情感、意图和行为的人本场景中。其核心创新在于将前沿模型生成的推理链作为教师模型的私有证据，而非学生模型的模仿目标，从而让学生模型在自身轨迹分布上学习，并接受密集的令牌级监督。

Details

Motivation: 动机在于解决多模态大语言模型在复杂人本场景（如情感计算）中进行强化学习时面临的挑战：奖励稀疏、高质量思维链标注成本高昂且难以获取，以及直接使用专家标注进行监督微调可能导致捷径学习并缺乏透明度。

Result: 在MER-UniBench基准测试上，OmniOPSD取得了平均分84.19的SOTA性能。消融实验进一步支持了理由特权教师指导的价值。

Insight: 主要创新点在于提出了“理由特权”的概念，将前沿模型生成的推理链作为训练时仅供教师模型使用的私有上下文证据，而非学生模型的直接模仿目标。这使学生能在自身采样轨迹上接受密集监督，避免了直接模仿可能带来的问题，且推理时无需任何标注、推理链或闭源模型访问，实现了更高效、透明的学习。

Abstract: Reinforcement learning for multimodal large language models (MLLMs) is often hindered by severe reward sparsity in complex reasoning tasks. This challenge is particularly pronounced in human-centered scenarios involving states, emotions, intentions, and behaviors, where heterogeneous multimodal signals and subjective human factors make high-quality chain-of-thought (CoT) annotations expensive and difficult to obtain. Although many multimodal datasets provide expert-annotated ground-truth labels, directly using these labels for supervised fine-tuning may encourage shortcut learning in multimodal perception and provides limited transparency for safety-critical human–AI interaction. To address these limitations, we propose OmniOPSD, a Rationale-Privileged On-Policy Self-Distillation framework that uses frontier-generated rationales as teacher-side privileged evidence rather than student imitation targets. OmniOPSD uses frontier-generated evidence-aware rationales only as training-time privileged evidence context for a local teacher. The student samples its own rollout from the original multimodal input, while the rationale-privileged teacher scores the same tokens and provides dense token-level supervision. Thus, the student learns on its own trajectory distribution without directly imitating frontier-model completions, and inference requires no labels, rationales, CoT annotations, or closed-source model access. Experiments on MER-UniBench show that OmniOPSD achieves state-of-the-art performance with an average score of $84.19$, and ablations further support the value of rationale-privileged teacher guidance.

[169] Learning Directional Semantic Transitions for Longitudinal Chest X-ray Analysis cs.CV | cs.MMPDF

Zhangfeng Hu, Zefan Yang, Ge Wang, Tanveer Syeda-Mahmood, Anushree Burade

TL;DR: 本文提出ProTrans，一种新颖的视觉-语言预训练框架，用于纵向胸部X光（CXR）分析。该框架将疾病进展建模为成对CXR研究之间的方向性语义转换，通过利用放射学报告来锚定可解释的疾病状态，并引入可学习的进展特征图来编码状态间的语义转移。

Details

Motivation: 现有方法在捕捉细微进展语义和建模疾病轨迹的固有方向性方面存在局限，因此需要一种能更好地理解和表征CXR纵向变化的方法。

Result: 在疾病进展分类和进展描述生成等纵向下游任务上的大量实验表明，ProTrans持续优于现有方法，为纵向CXR理解建立了一个统一的预训练框架。

Insight: 创新点在于将疾病进展明确建模为方向性语义转换，并引入可学习的进展特征图以及反向时序建模和双向重建一致性约束，以解耦方向性语义并促进连贯的轨迹建模。

Abstract: Chest X-ray (CXR) interpretation often requires longitudinal comparison to assess disease progression. Existing approaches typically rely on temporal feature fusion or inter-study discrepancy modeling, yet remain limited in capturing subtle progression semantics and overlook the inherently directional nature of disease trajectories. In this paper, we propose ProTrans, a novel vision-language pretraining framework that formulates disease progression as a directional semantic transition between paired CXR studies. ProTrans leverages radiology reports to anchor individual CXR representations within interpretable disease states, and introduces a learnable progression feature map to explicitly encode semantic shifts between states, aligned with report-derived progression descriptions. To enforce direction-aware perception, ProTrans incorporates a reversed temporal modeling process and imposes bidirectional reconstruction consistency across states and transitions, thereby disentangling directional semantics and promoting coherent trajectory modeling. Extensive experiments on longitudinal downstream tasks, including disease progression classification and progression captioning, demonstrate that ProTrans consistently outperforms existing methods, establishing a unified pretraining framework for longitudinal CXR understanding. https://github.com/RPIDIAL/ProTrans

[170] You Don’t Need Strong Assumptions: Visual Representation Learning via Temporal Differences cs.CV | cs.AI | cs.LGPDF

Ninad Daithankar, Alexi Gladstone, Yann LeCun, Heng Ji

TL;DR: 这篇论文提出了一种名为Temporal Difference in Vision (TDV) 的自监督学习新范式，用于从视频中学习视觉表示。该方法摒弃了传统自监督学习所依赖的数据增强、掩码或裁剪等强归纳偏置，转而仅基于‘过去导致未来’的因果假设。通过联合训练图像编码器和运动编码器，使当前帧表示加上编码后的运动等于下一帧表示，TDV在密集空间任务上达到了最先进方法的性能。

Details

Motivation: 论文的动机源于AI领域的一个趋势：随着计算和数据量的增长，具有较弱归纳偏置的方法通常会超越那些依赖较强假设的方法。作者观察到，即使在现代自监督学习中，仍然依赖数据增强等强归纳偏置，这些偏置在大规模数据下可能成为瓶颈。实验证实，最优归纳偏置的强度会随数据增长而减弱，因此需要寻找依赖更少假设的方法。

Result: 论文提出的TDV方法，在未利用任何强归纳偏置的情况下，在密集空间任务（dense spatial tasks）上匹配了当前最先进（SOTA）方法的性能。

Insight: 论文的主要创新点在于提出了一种仅基于时间因果性（‘过去导致未来’）这一弱假设的自监督学习范式TDV，从而完全避免了传统方法对数据增强等强归纳偏置的依赖。从客观角度看，这为未来在大规模数据上实现更少假设、更通用的视觉表示学习奠定了基础。

Abstract: Progress in AI has largely been driven by methods that assume less. As compute and data increase, approaches with weaker inductive biases generally outperform those with stronger assumptions. This is particularly characteristic of the field of Visual Representation Learning, where approaches have gone from being dominated by Supervised Learning, to Weakly Supervised Learning, to the now widespread success of Self-Supervised Learning without human labels. Yet, even modern Self-Supervised Learning approaches still depend on strong inductive biases such as augmentations, masking, or cropping. If this trend holds, even these remaining biases should become bottlenecks at scale – and our experiments confirm this: the optimal strength of inductive biases decreases as data grows. This motivates the search for approaches that rely on fewer assumptions. To this end, we introduce Temporal Difference in Vision (TDV), a new paradigm for self-supervised learning from video that avoids existing inductive biases, relying instead on a causal assumption that the past causes the future. TDV functions by jointly training an image encoder and a motion encoder so that the current frame’s representation plus the encoded motion equals the next frame’s representation. Despite not leveraging any strong inductive biases, TDV matches state-of-the-art recipes on dense spatial tasks, laying the foundation for representation learning without strong assumptions.

[171] GOOSE-M2F: Adapting Mask2Former for High-Fidelity, Long-Tailed Fine-Grained Semantic Segmentation in Unstructured Outdoor Terrain cs.CVPDF

Jyothiraditya Lingam, Nikhileswara Rao Sulake, Sai Manikanta Eswar Machara

TL;DR: 本文提出了GOOSE-M2F模型，这是对Mask2Former的针对性改进，用于解决ICRA 2026 GOOSE 2D细粒度语义分割挑战中的问题。该挑战涉及非结构化户外地形中64个细粒度类别的分割，且类别分布呈现严重的长尾特性。模型通过增加对象查询、引入特征细化模块和辅助监督头等改进，结合多阶段训练策略和推理时的密集滑动窗口等技术，在官方排行榜上取得了第三名的成绩。

Details

Motivation: 动机是解决在非结构化户外地形中进行细粒度语义分割时面临的挑战，特别是数据集中存在的严重长尾分布问题，其中稀有类别的像素数量极少（每图少于50像素）。

Result: 在GOOSE 2D细粒度语义分割排行榜上，GOOSE-M2F取得了70.08%的官方综合mIoU（细粒度mIoU为63.55%，粗粒度mIoU为76.61%），排名第三。推理时采用的密集滑动窗口引擎结合高斯核融合和多尺度测试时增强带来了10.57%的性能提升。

Insight: 创新点包括：1) 使用200个对象查询以避免表示饱和；2) 结合ASPP-lite和CBAM双注意力的特征细化模块；3) 为稀有类别提供逐像素梯度的辅助监督头。此外，多阶段训练策略整合了分布平衡损失、稀有类别复制粘贴增强、动态IoU感知重加权和指数移动平均，这些方法对于处理长尾分割任务具有借鉴意义。

Abstract: We present GOOSE-M2F, a task-specific adaptation of Mask2Former for the GOOSE 2D Fine-Grained Semantic Segmentation (FGSS) Challenge at ICRA~2026. The GOOSE benchmark spans 64 fine-grained classes across unstructured outdoor terrain with a severely long-tailed distribution, where rare classes occupy fewer than 50 pixels per image. We extend the Swin-Large Mask2Former baseline with three targeted contributions: (1)200 Object Queries to eliminate representational saturation; (2)a Feature Refinement Module (FRM) combining ASPP-lite and CBAM dual-attention; and (3)an Auxiliary Supervision Head that delivers direct per-pixel gradients for rare classes. A multi-stage training strategy pairs Distribution-Balanced loss, Rare-Class Copy-Paste augmentation, dynamic IoU-aware re-weighting, and EMA. At inference, a dense sliding-window engine with 2D Gaussian kernel blending and 4-scale TTA adds +10.57%. GOOSE-M2F achieves 70.08% Official Composite mIoU (63.55% fine, 76.61% coarse), placing 3rd on the GOOSE 2D FGSS leaderboard. Code and trained models are publicly available at: \href{https://github.com/Aditya-Lingam-9000/GOOSE-M2F}{Github GOOSE-M2F Code} and \href{https://huggingface.co/XYZ9843/GOOSE-M2F}{Hugging Face GOOSE-M2F}.

[172] Mind the Gap: Diagnosing Constraint Discovery Failures in Text-in-Image Editing cs.CVPDF

Rui Gui

TL;DR: 本文研究了多模态推理中视觉依赖关系发现的问题，聚焦于文本图像编辑任务中的编辑诱导约束发现。通过461个诊断案例测试了四个MLLM模型，发现模型在无引导提示下仅能恢复46%的案例级宏观召回率，而提供明确约束时可达94%，表明模型在识别未声明的依赖关系方面存在显著困难。研究还发现，特定案例的因果解释是最有效的部分引导方式，且更高的自我发现召回率不一定能提升下游任务性能，因为未经验证的自我发现会引入误报。

Details

Motivation: 解决多模态推理中确定特定任务下相关视觉依赖关系的挑战，而非仅仅识别可见内容。通过文本图像编辑这一受控诊断场景，探究模型能否在局部文本更改时识别出必须同时改变的次要区域，以诊断约束发现失败的原因。

Result: 在461个诊断案例、四个MLLM模型和19个约束子类型上，无引导提示下的案例级宏观召回率仅为46%，而提供明确约束时达到94%。特定案例因果解释作为部分引导的召回率最高（0.782），优于区域名称（0.610）或类型标签（0.646）。下游实验表明，更高的自我发现召回率不一定改善任务性能，因为误报会抵消召回增益。

Insight: 创新点在于通过编辑诱导约束发现来诊断多模态模型在视觉依赖关系推理中的失败，强调模型需要主动决定哪些未声明的依赖关系应被呈现。客观分析认为，研究揭示了因果解释在引导约束发现中的有效性，并指出精度感知的约束引发对于平衡召回与误报的重要性，为多模态推理的评估和改进提供了新视角。

Abstract: A key challenge in multimodal reasoning is determining which visual dependencies become relevant under a specific task, rather than merely recognizing visible content. We study this through edit-induced constraint discovery in text-in-image editing, a controlled diagnostic setting where a local text change can activate secondary consistency constraints: given a valid editing instruction and an image, can a model identify the secondary regions that must also change? Across 461 diagnostic cases, four MLLMs, and 19 constraint subtypes, models recover only 46% case-level macro recall under unguided prompting versus 94% when constraints are explicitly provided, suggesting that a substantial portion of the failure arises when models must decide which unstated dependencies to surface. Oracle-field decomposition shows that case-specific causal explanations are the most effective partial guidance (0.782 recall), above region names (0.610) or type labels (0.646), suggesting that edit-specific causal cues account for much of the oracle gain. A downstream experiment further shows that higher self-discovery recall does not necessarily improve task performance: unverified self-discovery introduces false positives that offset recall gains, motivating precision-aware constraint elicitation.

[173] Multi-Task Tennis Stroke Biomechanics Analysis Using MediaPipe Pose cs.CVPDF

Jigyashman Hazarika

TL;DR: 该论文提出了一种基于普通RGB视频的多任务网球击球生物力学分析流程。该流程在基于姿态的击球识别基础上，新增了预测击球方向和评估姿势质量两项任务，并包含一个基于规则的反馈层以提供训练建议。系统使用加权关节速度分数自动检测击球，无需人工标注，并采用一个名为TennisTransformerGPU的紧凑型Transformer模型进行处理。

Details

Motivation: 旨在从易于获取的RGB视频中自动分析网球击球的生物力学，以提供击球类型识别、方向预测和姿势质量评估等多维度的自动化反馈，从而辅助网球训练。

Result: 在包含7名职业选手和1名业余选手的1,281个标注击球数据上，模型在随机80/20划分下取得了击球类型83.7%、方向61.9%、姿势62.6%的准确率。跨选手（职业训练，业余测试）实验中，击球类型准确率仅下降0.8%至82.9%，但方向预测未能迁移。消融实验表明，使用世界坐标而非图像坐标对性能至关重要，跨选手击球类型准确率从83%降至47%，方向预测从68%降至21%。

Insight: 主要创新点在于构建了一个集成了识别、预测、评估和反馈的多任务自动化分析流程。其技术亮点包括：1) 使用加权关节速度的启发式方法自动分割击球动作，避免了手动标注；2) 证明了在姿态分析任务中，使用世界坐标对于模型泛化能力（尤其是跨选手场景）具有决定性影响；3) 设计了一个参数紧凑（约56万参数）的专用Transformer模型（TennisTransformerGPU）来高效处理序列化姿态数据。

Abstract: We built a multi-task pipeline for tennis stroke biomechanics from plain RGB video. On top of pose-based stroke recognition, it adds two new tasks, predicting shot direction and grading posture quality, plus a rule-based feedback layer that suggests coaching tips. Strokes are found automatically using a weighted joint velocity score, s(t) = 0.5 v_wrist + 0.3 m_elbow + 0.2 m_shoulder, removing the need for manual annotation. Pose comes from MediaPipe Pose Landmarker (33 landmarks, metric world coordinates), with each stroke turned into a 30-frame by 39-feature sequence for TennisTransformerGPU, a compact 564,103-parameter transformer (4 layers, 4 heads, d=128) with three parallel output heads. Trained on 1,281 labeled strokes from 7 pros and 1 amateur across 11 videos, it hits 83.7% stroke-type accuracy, 61.9% on direction, and 62.6% on posture under a random 80/20 split. The interesting test is cross-player: train on pros, evaluate on the amateur. Stroke type barely budges, 82.9%, a 0.8% drop. Direction prediction does not transfer; it just falls back to the majority class. An ablation shows why world coordinates matter so much here: switching to image-space landmarks tanks cross-player stroke-type accuracy from 83% to 47% and direction from 68% to 21%. Everything runs on Kaggle’s free T4 GPU tier and is fully reproducible.

[174] Focus When Necessary: Adaptive Routing and Collaborative Grounding for Training-Free Visual Grounding cs.CV | cs.CLPDF

Yifan Wang, Peiming Li, Shiyu Li, Zhiyuan Hu, Xiaochen Yang

TL;DR: 本文提出了一种名为LazyMCoT的动态、免训练视觉定位框架，旨在解决多模态大语言模型（MLLMs）在处理高分辨率图像时难以感知细粒度细节的问题。该框架通过自适应路由机制，根据查询难度动态分配计算资源，并对困难样本采用协作定位模块进行两阶段精炼，从而在提升推理精度的同时降低平均延迟。

Details

Motivation: 现有免训练方法（如图像缩放和局部裁剪）在处理复杂高分辨率图像时存在计算冗余或因裁剪丢失全局上下文的问题，导致精度下降。本文旨在设计一个能根据样本难度自适应分配视觉定位努力、避免不必要计算并提升困难样本处理能力的框架。

Result: 在多个基准测试上的广泛实验表明，LazyMCoT在推理精度上可与基于训练的方法相媲美，同时显著降低了平均推理延迟。

Insight: 创新点在于提出了一个结合自适应路由（利用单次前向传播的首词统计量评估预测不确定性，并通过保形校准确保召回）和协作定位（整合模型固有的跨模态注意力与外部视觉专家进行两阶段精炼）的免训练框架，实现了计算效率与定位精度的平衡。

Abstract: While Multimodal Large Language Models (MLLMs) excel in cross-modal reasoning, they often struggle to perceive fine-grained details in complex high-resolution images. Recent training-free methods address this through image scaling and localized cropping. However, applying these manipulations indiscriminately introduces computational redundancy for simple queries and can degrade accuracy by truncating essential global context or introducing irrelevant background noise. To this end, we propose LazyMCoT, a dynamic and training-free framework that adaptively allocates visual grounding efforts based on sample difficulty. The framework features an Adaptive Routing mechanism that evaluates predictive uncertainty using first-token statistics from a single forward pass. This efficiently bypasses confident cases while ensuring the recall of difficult samples via conformal calibration. For these challenging cases, a Collaborative Grounding module integrates the inherent cross-modal attention of the model with an external visual expert through a two-stage refinement process. This refinement process generates a precise localized display to recover small or occluded targets. Extensive experiments across diverse benchmarks demonstrate that LazyMCoT rivals training-based approaches by simultaneously improving reasoning accuracy and reducing average inference latency. Our code is availble at https://github.com/TencentBAC/LazyMCoT.

[175] PointDiffusion: Diffusion-Based Scene Completion in the Point Cloud Domain cs.CVPDF

Chidera Agbasiere, Mikhail Sannikov, Faith Ogunwoye, Erik Shaikhiev, Alex Kozinov

TL;DR: 本文提出PointDiffusion，一种基于扩散模型的点云场景补全方法，通过多令牌高斯VAE和交叉注意力池化实现稳定的场景级LiDAR压缩，并采用基于锚点的ICP真值细化流程消除里程计漂移噪声。该方法实现了无支架的单步扩散补全，在SemanticKITTI数据集上显著降低了Chamfer距离，超越了现有方法，并大幅降低了推理延迟。

Details

Motivation: 解决自动驾驶中稀疏LiDAR点云重建密集3D场景的挑战，现有方法存在室外尺度下全局表示不稳定、真值数据受里程计漂移污染以及多步扩散推理延迟过高的问题。

Result: 在SemanticKITTI序列08上，平方Chamfer距离从0.396 m²降至0.024 m²（约16倍降低），超越LiDiff和ScoreLiDAR分别17-19%和10-11%，推理延迟降低25-143倍。

Insight: 创新点包括多令牌高斯VAE与交叉注意力池化实现稳定压缩、锚点ICP真值细化消除噪声，以及无支架单步扩散模型；客观分析表明数据质量对模型性能起主导作用，多令牌潜在空间为潜在扩散场景补全提供了稳定基础。

Abstract: Reconstructing dense 3D scenes from sparse LiDAR point clouds is a fundamental challenge in autonomous driving, where latent diffusion models offer a promising solution. However, existing approaches rely on object-level autoencoders that collapse into unstable global representations at outdoor scale and suffer from ground truth data corrupted by odometry drift that systematically degrades supervision quality. Furthermore, multi-step diffusion inference incurs prohibitive latency for real-time deployment. We propose a novel multi-token Gaussian VAE with cross-attention pooling for stable scene-scale LiDAR compression, combined with an anchor-based ICP ground truth refinement pipeline that eliminates drift-induced noise from training supervision. Together, these components enable a scaffold-free single-step diffusion completion model that achieves an approximately 16x reduction in squared Chamfer distance on SemanticKITTI seq. 08 (0.396 m^2 to 0.024 m^2), surpasses LiDiff and ScoreLiDAR by 17-19% and 10-11%, respectively, and operates at 25-143x lower inference latency. Our results demonstrate that data quality dominates model design in this regime and that multi-token latent spaces provide a stable first stage for latent diffusion-based scene completion.

[176] Trusting Right Predictions for Wrong Reasons: A LIME Based Analysis of Deep Learning Interpretability in Lung Cancer Diagnosis cs.CVPDF

Samarpan Poudel, Vladislav D Veksler

TL;DR: 本研究使用LIME方法分析了三种深度学习模型（CNN、ResNet50、ViT）在肺癌CT图像分类任务中的可解释性。研究发现，尽管模型在预测准确率（最高达98.61%）和输出一致性（预测相关性>0.99）上表现优异，但它们的决策依据（通过LIME解释的区域）存在显著差异（解释相关性<0.26），表明模型可能基于不同的图像特征做出相同预测。

Details

Motivation: 当前深度学习模型在肺癌诊断中主要关注预测准确性，而对其决策过程的可解释性缺乏系统评估，这在临床应用中存在风险，因为模型可能基于错误的原因做出正确预测。

Result: 在IQ-OTH/NCCD肺癌CT数据集上，ResNet50、CNN和ViT的准确率分别为98.61%、97.91%和93.75%，ROC-AUC均为0.99。模型间预测相关性超过0.99，但LIME解释相关性低于0.26。错误预测的样本显示其注意力常集中在肺实质外区域。

Insight: 论文创新性地引入了双相关性框架（预测一致性与解释一致性）来评估模型，揭示了高预测性能并不等同于可靠的决策逻辑。这一发现强调在临床AI系统中，必须将可解释性评估作为独立于预测性能的验证标准，以避免模型因错误原因被信任。

Abstract: Lung cancer is the leading cause of cancer-related mortality, with approximately 2.5 million new cases and 1.8 million deaths annually, making reliable diagnosis a clinical priority. Although deep learning models have achieved strong performance in lung cancer classification, evaluation has largely focused on predictive accuracy, leaving their decision-making processes insufficiently examined. This study compares three architecturally distinct models: a Convolutional Neural Network (CNN), a pretrained ResNet50, and a Vision Transformer (ViT), trained on the IQ-OTH/NCCD lung cancer CT dataset. Local Interpretable Model-Agnostic Explanations (LIME) were applied to investigate model reasoning. In addition to standard performance metrics, a dual-correlation framework was introduced to measure both prediction agreement and explanation agreement across model pairs. All three models achieved strong classification performance, with ResNet50 attaining 98.61% accuracy, CNN 97.91%, and ViT 93.75%, while all achieved ROC-AUC scores of 0.99. Prediction correlations exceeded 0.99 across all model pairs, indicating highly consistent outputs. However, LIME explanation correlations remained below 0.26, revealing substantial differences in the image regions used to reach those predictions. Analysis of misclassified samples further identified a consistent spatial pattern: incorrect predictions were associated with attention outside the lung parenchyma, whereas correct predictions focused primarily within lung regions. These findings demonstrate that prediction agreement is a poor proxy for reasoning consistency, and that interpretability evaluation must be treated as an independent validation criterion alongside predictive performance in clinical AI systems.

[177] Stepwise Token Selection for Efficient Multimodal Large Language Models cs.CVPDF

Landi He, Shawn Young, Lijian Xu

TL;DR: 本文提出了一种逐步令牌选择方法，用于高效的多模态大语言模型（MLLMs）。该方法将视觉令牌剪枝重新定义为序列决策过程，通过指针式选择机制迭代选择信息丰富的令牌，并动态决定何时停止，从而联合优化所选子集及其大小。

Details

Motivation: 在MLLMs中，推理成本主要由视觉令牌前缀而非语言主干主导，因此减少令牌数量是提高效率的关键。现有方法通常为视觉令牌分配独立的重要性分数并保留固定数量的顶级令牌，这隐含地假设了令牌独立性和跨输入的均匀压缩比，存在局限性。

Result: 在LLaVA-v1.5-7B和Qwen2.5-VL-7B上的大量实验表明，该方法在不同压缩水平下始终优于固定比率基线。在激进剪枝（移除88.9%的视觉令牌）下，该方法保持了94.6%的原始准确率，同时实现了1.88倍的预填充延迟加速。

Insight: 创新点在于将令牌选择建模为序列决策过程，通过条件依赖和动态终止实现自适应压缩；同时，设计了基于方差保持噪声插值的可微松弛方案，使离散选择过程能够端到端训练，这是从客观角度分析的关键技术贡献。

Abstract: In multimodal large language models (MLLMs), inference cost is largely dominated by the visual token prefix rather than the language backbone, making token reduction a key factor for improving efficiency. Existing approaches typically assign independent importance scores to visual tokens and retain a fixed number of top-ranked tokens, implicitly assuming token independence and a uniform compression ratio across inputs. In this work, we reformulate visual token pruning as a sequential decision-making process. Specifically, we introduce a pointer-style selection mechanism that iteratively chooses informative tokens, conditioning each decision on previously selected ones, and dynamically determines when to stop via a learned termination action. This enables joint optimization of both the selected subset and its size. To enable end-to-end training under standard language modeling objectives, we design a differentiable relaxation based on a variance-preserving noise interpolation scheme, allowing gradients to propagate through the discrete selection process. Extensive experiments on LLaVA-v1.5-7B and Qwen2.5-VL-7B demonstrate that our approach consistently outperforms fixed-ratio baselines across different compression levels. Under aggressive pruning that removes 88.9% of visual tokens, our method preserves 94.6% of the original accuracy while achieving a 1.88x speed-up in prefill latency.

[178] Tool-IQA: Augmenting Image Quality Assessment with Simple Tools cs.CV | cs.AIPDF

Guanyi Qin, Junjie Zhang, Chunming He, Yibing Fu, Jie Liang

TL;DR: 本文提出Tool-IQA，一种利用简单工具增强的图像质量评估方法。该方法将视觉语言模型的静态评分范式转变为动态的、工具增强的工作流程，通过引入放大镜和伽马校正器两种工具，对图像进行局部细节和隐藏伪影的深入检查，从而更接近人类评估图像质量的方式。

Details

Motivation: 当前基于视觉语言模型的图像质量评估方法采用静态的一次性评分范式，这与人类通过动态视觉检查（如选择性调整视图以验证细节和伪影）来评估图像质量的方式不符。这种静态方法存在两个主要局限：一是全局感知限制了局部细节评估；二是原始图像强度分布可能掩盖问题，导致检查不充分。

Result: 在多个IQA基准测试上的实验表明，Tool-IQA通过有效的工具调用和校准评估，显著优于现有的最先进模型。例如，在具有挑战性的CLIVE数据集上，它达到了0.854的PLCC（皮尔逊线性相关系数）。

Insight: 论文的创新点在于将被动评分机制转变为工具增强的动态工作流程，并引入了放大镜和伽马校正器这两种简单有效的视觉工具。从客观角度看，其提出的批量感知训练策略，旨在奖励能产生积极贡献的工具交互而非单纯鼓励使用，是一种确保工具调用高效且有目的性的有效方法。

Abstract: Vision-Language Models (VLMs) have been increasingly adopted for Image Quality Assessment (IQA). However, current methods typically employ a static one-shot scoring paradigm, despite the fact that humans assess image quality through dynamic visual inspection, e.g., selectively adjusting views to verify details and subtle artifacts. Specifically, relying solely on a single-pass observation introduces two primary limitations: first, perceiving the image only at a global scale restricts the assessment of finer local details; second, the original intensity distribution of the image may overwhelm the visibility, leading to insufficient inspection of image quality. To address these issues, we propose Tool-IQA, shifting the assessment mechanism from passive scoring to a tool-augmented workflow. In particular, we equip VLMs with simple yet effective view tools: a Magnifier to inspect local details, and a Gamma Corrector to uncover visibility and hidden artifacts. The assessment follows a structured pipeline that consists of an initial observation with rubric notes, a tool-augmented in-depth inspection, and a final quantification for calibrated quality score. Furthermore, to ensure efficient and purposeful tool callings, we introduce a batch-aware training strategy to reward tool interactions that can yield positive contributions rather than simply encouraging usage. Experiments on a variety of IQA benchmarks demonstrate that, with effective tool calling and calibrated assessment, our proposed Tool-IQA significantly outperforms existing state-of-the-art models, e.g., it achieves a PLCC of 0.854 on the challenging CLIVE dataset.

[179] VinQA: Visual Elements Interleaved Long-form Answer Generation for Real-World Multimodal Document QA cs.CV | cs.AIPDF

Young Rok Jang, Hyesoo Kong, Kyunghwan An, Jae Sub Huh, Gyeonghun Kim

TL;DR: 本文提出了VinQA数据集，用于在真实世界多模态文档问答中生成包含视觉元素引用的长答案。研究比较了两种编码方法：Page Encoding直接编码整页图像并使用边界框作为可引用单元，而Modality Encoding则分别提取文本和裁剪视觉元素进行编码。实验表明，在VinQA上微调开源模型能显著提升性能，两种编码方法在训练后达到可比水平。

Details

Motivation: 现有MLLM在文档QA中主要生成纯文本回答，未能充分利用文档中的表格、图表等视觉元素，因此需要开发能显式引用并交织视觉元素的长答案生成方法。

Result: 在VinQA测试集上，前沿专有模型仍取得最佳总体分数，但微调Qwen2.5-VL等开源模型能大幅提升性能并缩小差距。Modality Encoding在复杂文档上初始更鲁棒，但Page Encoding经训练后达到可比水平。

Insight: 创新点包括提出VinQA数据集及视觉元素交织的答案生成任务，并引入M-GroSE多模态评估框架和Visual Source F1指标。研究揭示了通过微调和适当编码，开源模型能在视觉引用任务上有效逼近前沿模型，且整页编码在无需显式解析的情况下也能实现竞争性性能。

Abstract: Real-world documents combine text with tables, charts, photographs, and diagrams arranged in diverse layouts, yet existing research on multimodal large language models (MLLMs) for document QA predominantly produces text-only responses, underutilizing these visual elements. We introduce VinQA, a dataset for long-form answer generation where cited visual elements are explicitly interleaved with their supporting text and grounded in relevant document pages. To support this task, we study two encoding methods for feeding raw document page images into an MLLM, along with their visual-element citation mechanisms: (1) Page Encoding, which directly encodes full-page images with bounding boxes of visual elements and treats these boxed regions as citable units; and (2) Modality Encoding, which parses each page to extract text and crop visual elements, encodes them separately, and uses these cropped elements as citable units. In our experiments, we propose M-GroSE, a multimodal evaluation framework extending GroUSE to assess answers along four dimensions: completeness, answer relevancy, faithfulness, and unanswerability. We additionally report Visual Source F1 to directly measure visual citation accuracy. Although proprietary frontier models still achieve the best overall scores on the VinQA test split, fine-tuning open Qwen2.5-VL models on the training split substantially improves their performance and narrows this gap. Modality Encoding is initially more robust for complex documents with long text, many visual elements, and diverse citation requirements. After training on VinQA, however, Page Encoding reaches a comparable level, competing effectively even without the explicit parsing used in Modality Encoding. Finally, Visual G-Eval, an MLLM-based judge, confirms that fine-tuned models insert visual elements at semantically appropriate positions with faithful supporting text.

[180] VisualClaw: A Real-Time, Personalized Agent for the Physical World cs.CV | cs.CLPDF

Haoqin Tu, Jianwen Chen, Zijun Wang, Siwei Han, Juncheng Wu

TL;DR: 本文提出了VisualClaw，一个面向物理世界的实时、个性化多模态智能体。它通过混合编码降低部署成本，并利用技能演化机制从失败中学习，实现自我进化。该框架在多个视频问答基准上显著降低了API调用成本并提升了准确率，同时为评估智能体能力引入了新的基准VisualClawArena。

Details

Motivation: 解决当前视觉语言模型在部署时面临的三大挑战：处理密集视频帧和长提示时的高延迟与高成本、部署后智能体框架的静态化，以及标准视频问答基准无法有效测试智能体在工具使用工作空间内利用视觉证据的能力。

Result: 在4个视频问答基准和2个VLM上的实验表明，相比全帧上传，VisualClaw平均降低每问题API成本98%；相比离线均匀8帧基线，成本降低25.9%，并在多数设置下提升了准确率（例如在EgoSchema基准上使用Gemini 3 Flash时平均提升3.85%，峰值提升15.80%）。在新构建的VisualClawArena基准上，该框架将Codex和Claude Code的宏准确率分别提升了2.9%和3.2%，同时成本比均匀采样基线降低了9.5%。

Insight: 主要创新点在于提出了混合编码（通过级联门过滤信息量少的流式帧，并通过热/冷top-k注入压缩文本技能库）和技能演化（利用检索到的记忆作为条件来更新技能库）两大核心原则，构建了一个成本高效且能持续自我优化的智能体框架。其构建的VisualClawArena基准也为评估多模态智能体的实际工作空间能力提供了新标准。

Abstract: Vision language models are serving as general-purpose interfaces for complex multimodal tasks. However, deployment still faces three gaps: VLMs typically incur high latency and cost when processing dense video frames and long prompts, the agent scaffold remains static after deployment, and standard video-QA benchmarks do not test whether agents can use visual evidence inside tool-using workspaces. We present VisualClaw, a self-evolving multimodal agent built around two principles. First, hybrid encoding reduces deployment cost by filtering less informative streaming frames with a cascaded gate and compressing the text skill bank through hot/cold top-k injection. Second, skill evolution lets the agent learn from failures: retrieved memories condition an evolver as direct concatenated context or as guided evidence, producing skill-bank updates that help future questions. Across 4 video-QA benchmarks with 2 VLMs, VisualClaw cuts per-question API cost by an average -98% versus full-frame upload and by -25.9% over the offline uniform 8 frame baseline, while boosting accuracy in most settings, e.g., an average +3.85% and a peak +15.80% on EgoSchema with Gemini 3 Flash. To address the gap, we curate VisualClawArena, a 200-scenario multimodal agentic benchmark built through a strict five-stage pipeline; models must use video evidence, documents, dynamic updates, and executable checks inside a workspace. On VisualClawArena, the same framework with computer-use agent backends improves macro accuracy by +2.9% for Codex (GPT-5.5) and +3.2% for Claude Code (Sonnet 4.6) over no-evolution baselines, with a -9.5% cost reduction compared to the uniform-sampled baseline. These properties make VisualClaw a natural fit for edge applications, where the cascade reduces a 1-hour streaming session from ~3,600 API uploads down to only 5-20 calls and the self-evolution makes it a perfect personalized assistant.

[181] Training-Free Open-Vocabulary Visual Grounding for Remote Sensing Images and Videos cs.CVPDF

Ke Li, Di Wang, Yongshan Zhu, Ting Wang, Weiping Ni

TL;DR: 本文提出了一种无需训练的开放词汇遥感视觉定位框架RSVG-ZeroOV，它利用冻结的通用基础模型（如视觉语言模型和扩散模型）实现零样本定位。该框架采用‘概览-聚焦-演化’范式，通过结合不同模型的注意力机制逐步生成精确的目标掩码，并进一步扩展至视频输入以实现时空一致的定位。

Details

Motivation: 现有遥感视觉定位方法依赖特定任务的人工标注，成本高昂且覆盖范围有限，难以泛化到涉及新物体、细粒度属性、复杂空间关系和功能语义的开放词汇查询。

Result: 在六个图像和视频定位基准测试上的广泛实验表明，RSVG-ZeroOV一致优于现有零样本基线，并与弱监督和全监督方法相比取得了竞争性或更优的性能。

Insight: 创新点在于提出了一种无需训练、利用冻结基础模型的零样本开放词汇定位框架，通过结合视觉语言模型的语义相关性和扩散模型的细粒度结构先验来互补增强定位精度，并设计了简单的注意力演化模块来净化掩码；对于视频，通过关键帧选择和时间传播器实现了高效的时空定位，无需视频标注或微调。

Abstract: Remote sensing visual grounding (RSVG) aims to localize a referred target in a remote sensing image or video according to a natural language expression. Existing RSVG methods usually rely on task-specific manual annotations, which are costly to collect and inevitably limited in covering the diversity of real-world geospatial scenarios. As a result, they often struggle to generalize to open-vocabulary queries involving novel objects, fine-grained attributes, complex spatial relationships, and functional semantics. In this paper, we propose RSVG-ZeroOV, a training-free framework that leverages frozen generic foundation models for zero-shot open-vocabulary RSVG. RSVG-ZeroOV follows an Overview-Focus-Evolve paradigm, which exploits the distinct yet complementary attention patterns of vision-language models (VLMs) and diffusion models (DMs) to progressively generate precise grounding results. Specifically, (i) Overview utilizes a VLM to extract cross-attention maps that capture semantic correlations between the referring expression and visual regions; (ii) Focus leverages the fine-grained modeling priors of a DM to compensate for object structure and shape information often overlooked by VLM attention; and (iii) Evolve introduces a simple yet effective attention evolution module to suppress irrelevant activations, yielding purified object masks. To handle video inputs, we further present Video RSVG-ZeroOV, which extends image-level grounding to spatio-temporal grounding through a query-relevant key-frame selector and a temporal propagator, enabling efficient and temporally coherent video grounding without video annotations or fine-tuning. Extensive experiments on six image and video grounding benchmarks show that RSVG-ZeroOV consistently outperforms existing zero-shot baselines and achieves competitive or superior performance compared with weakly- and fully-supervised methods.

[182] Continuous Splatting meets Retinex: Continuous Gaussian Splatting and Implicit Reflectance Modeling for Low-Light Image Enhancement cs.CVPDF

Yuhan Chen, Yicui Shi, Guofa Li, Wenxuan Yu, Ying Fang

TL;DR: 该论文提出了一种名为CGS-Retinex的低光照图像增强框架，首次结合了显式-隐式联合建模。该框架将连续高斯溅射（Continuous Gaussian Splatting）与Retinex理论深度融合，通过连续高斯渲染器估计空间连续的全局光照分布，并引入隐式神经表示独立建模反射率，以解决现有方法在平衡全局平滑光照调整与局部高频细节恢复时常见的色彩失真和结构伪影问题。

Details

Motivation: 现有低光照图像增强方法在平衡全局光照调整与局部细节恢复时，经常遇到色彩失真和结构伪影，因此需要一种新方法来更精确地解耦光照和纹理，实现高保真恢复。

Result: 大量实验表明，CGS-Retinex通过精确解耦光照和纹理，显著抑制了暗区噪声和过曝，同时在保持适当曝光的同时，实现了卓越的高频结构保真度和色彩恢复效果。

Insight: 创新点在于首次将连续高斯溅射与Retinex理论结合，提出连续物理表示范式，通过连续参数场消除离散采样导致的网格伪影，并利用浅层高频特征引导网络重建退化纹理细节，结合物理启发的亮度一致性约束和光照平滑正则化，实现了显式光照与隐式反射率的有效协同建模。

Abstract: Low-light image enhancement aims to recover clear images from low-illumination observations and is crucial for high-level downstream vision tasks. However, existing methods frequently encounter color distortion and structural artifacts when balancing global smooth illumination adjustment and local high-frequency detail recovery. To address these issues, we propose CGS-Retinex as the first low-light image enhancement framework based on explicit-implicit joint modeling. Our framework deeply integrates continuous Gaussian splatting with Retinex theory. Specifically, we represent the image grid as a continuous parameter field and propose a continuous Gaussian renderer to estimate the spatially continuous global illumination distribution. This approach fundamentally eliminates grid artifacts caused by discrete Gaussian sampling. Furthermore, we introduce an implicit neural representation to model reflectance independently. We leverage shallow high-frequency features to guide the network in accurately reconstructing degraded texture details. Within the Retinex framework, we incorporate physics-inspired brightness consistency constraints and illumination smoothness regularization to enable explicit illumination and implicit reflectance to maintain proper exposure and achieve high-fidelity recovery of high-frequency structures and colors. Extensive experiments demonstrate that CGS-Retinex significantly suppresses dark-region noise and overexposure while achieving exceptional high-frequency structural fidelity and color restoration by precisely decoupling illumination and texture. This work establishes a novel continuous physical representation paradigm for low-light image enhancement.

[183] Multimodal LLM-Empowered Re-Ranking for Generalizable Person Re-Identification cs.CVPDF

Jiachen Li, Xiaojin Gong

TL;DR: 本文提出了一种利用多模态大语言模型（MLLM）增强领域泛化行人重识别（DG Re-ID）中重排序性能的方法。该方法通过监督微调使MLLM适应Re-ID数据，并引入一种对领域差异鲁棒的μ-距离度量，以改进推理阶段的重排序，从而弥补现有方法主要关注训练可泛化编码器而忽略推理优化的不足。

Details

Motivation: 现有领域泛化行人重识别方法主要关注训练可泛化编码器，但忽略了在推理阶段通过重排序进行优化的可能性。传统重排序方法依赖编码器生成的特征距离，在目标域上性能会因编码器泛化能力不足而下降。

Result: 在多个DG Re-ID基准测试上的广泛实验表明，该方法能持续带来显著的性能提升。该方法与模型无关，可无缝集成到现有的重排序框架中。

Insight: 创新点在于首次将多模态大语言模型的强大泛化能力引入DG Re-ID的重排序任务，提出了一个对领域差异鲁棒的新型距离度量（μ-距离）。从客观角度看，其通过监督微调和特定提示设计来适配MLLM，并采用查询-候选困难挖掘方案，为利用大模型先验知识解决视觉领域泛化问题提供了新思路。

Abstract: Domain Generalizable (DG) person re-identification (Re-ID) has attracted growing research interest due to its potential for deployment in unseen real-world scenarios. Most existing approaches address DG Re-ID by focusing on training domain-generalizable encoders but ignore the possible refinements in inference stage. In contrast, this work explores an alternative direction which improves inference re-ranking to enhance DG Re-ID. Conventional re-ranking methods typically rely on neighborhood-based distances to refine the initial ranking list, inherently depending on features produced by the Re-ID encoder. However, they deteriorate on target domains since the encoder lacks sufficient generalizability to produce reliable feature distances on unseen scenarios. Inspired by the remarkable generalization capabilities of recent Multimodal Large Language Models (MLLMs), we propose an MLLM-empowered distance metric to improve re-ranking in DG Re-ID. Specifically, we first adapt an MLLM to Re-ID data through supervised fine-tuning, which incorporates a domain-agnostic prompt and a query-candidate hard mining scheme. Then, the adapted MLLM is employed to compute a $μ$-distance during inference, which is robust to domain gap and significantly enhances subsequent re-ranking performance. Our approach is model-agnostic and can be seamlessly integrated into previous re-ranking frameworks. Extensive experiments demonstrate that our approach consistently yields substantial performance improvements across multiple DG Re-ID benchmarks. The code of this work will be released at https://github.com/RikoLi/MUSE soon.

[184] Dehaze-GaussianImage: Zero-Shot Dehazing via Efficient 2D Gaussian Splatting Representation cs.CVPDF

Yuhan Chen, Wenxuan Yu, Guofa Li, Kunyang Huang, Ying Fang

TL;DR: 本文提出了Dehaze-GaussianImage，首个将2D高斯泼溅（2DGS）引入图像去雾领域的零样本框架，通过将雾图建模为连续动态演化的各向异性高斯场，并采用重建解耦的零样本学习策略，实现了传输介质与清晰纹理的几何级解耦，在无监督条件下以最小参数量达到了最先进的性能。

Details

Motivation: 现有单幅图像去雾方法存在像素级优化的计算冗余和隐式神经网络缺乏物理可解释性的问题，这阻碍了表示效率与重建保真度之间的平衡。

Result: 实验结果表明，该方法在完全无监督的方式下以最少的参数量实现了最先进的（SOTA）性能。

Insight: 创新点在于首次将2D高斯泼溅表示引入图像去雾，并提出重建解耦的零样本学习策略，将大气散射模型嵌入高斯参数空间，驱动高斯基元在优化过程中自适应分裂、克隆和剪枝，从而实现几何级的解耦；同时引入显式的结构保持约束来抑制传统物理先验常见的伪影，展示了显式高斯表示在底层视觉任务中的潜力。

Abstract: Existing single image dehazing methods are often constrained by computational redundancy in pixel-level optimization and the lack of physical interpretability in implicit neural networks. These limitations hinder the balance between representation efficiency and reconstruction fidelity. To address these issues, we propose Dehaze-GaussianImage, the first zero-shot framework that introduces 2D Gaussian Splatting (2DGS) into the image dehazing domain to break the traditional pixel-grid processing paradigm. Distinct from static convolutional neural networks (CNNs) or Transformers, our approach models hazy images as continuous and dynamically evolvable anisotropic Gaussian fields. Specifically, we propose a novel reconstruction-decoupling zero-shot learning strategy that embeds the atmospheric scattering model into the Gaussian parameter space. This strategy drives Gaussian primitives to adaptively split, clone, and prune during optimization, achieving geometric-level decoupling of the transmission medium and clear textures. Furthermore, explicit structure-preserving constraints are introduced to suppress artifacts commonly caused by traditional physical priors. Experimental results demonstrate that the proposed method achieves state-of-the-art (SOTA) performance in a fully unsupervised manner with minimal parameters, highlighting the potential of explicit Gaussian representation for low-level vision tasks.

[185] Fi-Gaussian: Frequency-Aware Implicit Gaussian Splatting for Single Image Dehazing cs.CVPDF

Yuhan Chen, Ying Fang, Guofa Li, Wenxuan Yu, Yicui Shi

TL;DR: 本文提出Fi-Gaussian，一种用于单幅图像去雾的频率感知隐式高斯溅射网络。该方法通过隐式高斯溅射在二维特征空间中连续建模清晰图像的底层分布，并利用频率感知模块在频域解耦低频结构和高频纹理信息，结合物理驱动的散射重归一化机制来估计传输图和大气光，从而恢复细节清晰的无雾图像。

Details

Motivation: 解决单幅图像去雾任务中高频细节丢失和物理散射模型难以准确建模的问题。

Result: 在多个基准数据集上的大量实验表明，Fi-Gaussian取得了最先进的定量性能，并产生了视觉上更优的去雾结果。

Insight: 创新点在于将隐式高斯溅射引入底层视觉任务，通过频域解耦和自适应复数权重高斯聚合来恢复细节；同时利用隐式高斯先验指导物理散射参数估计，实现了细节恢复与物理建模的结合。

Abstract: Single image dehazing continues to be hindered by the loss of high-frequency details and the difficulty of accurate physical scattering modeling. To address these issues, we propose Fi-Gaussian, a frequency-aware implicit Gaussian splatting network for single image dehazing. Unlike explicit rendering methods that rely on 3D point clouds, our method employs implicit Gaussian splatting to adaptively model the underlying distribution of clear images as a continuous representation in 2D feature space. The core of the network is a frequency-aware implicit Gaussian splatting module, which decouples low-frequency structural information and high-frequency texture information in the frequency domain and then performs adaptive Gaussian aggregation with complex-valued weights to recover fine details. In addition, a physics-driven scattering renormalization mechanism is introduced to estimate the transmission map and atmospheric light under the guidance of implicit Gaussian priors. Extensive experiments on multiple benchmark datasets demonstrate that Fi-Gaussian achieves state-of-the-art quantitative performance and produces visually superior dehazed results, validating the effectiveness of implicit Gaussian splatting for low-level vision tasks.

[186] Closed-Loop Triplet Synergistic Generation for Long-Form Video cs.CV | cs.MMPDF

Xinlei Yin, Xiulian Peng, Xiao Li, Zhiwei Xiong, Yan Lu

TL;DR: 本文提出CoTriSyGen框架，将多镜头长视频生成建模为闭环的视觉-文本-记忆协同过程，通过视觉语言模型分析器对规划意图、持久记忆和生成视觉内容进行联合推理，实现迭代修正和长程一致性。该方法包含镜头内精炼和镜头间精炼两条路径，并基于实体中心的可变视觉状态记忆进行更新。在StoryBench基准测试中，该方法在跨镜头一致性、提示遵循和电影连续性方面显著优于现有方法。

Details

Motivation: 解决多镜头长视频生成中存在的身份漂移和跨镜头不一致性问题，现有故事板驱动方法多为前馈式，缺乏将生成视觉证据反馈到后续条件中的机制。

Result: 在自建的StoryBench基准上，该方法在跨镜头一致性、提示遵循和电影连续性方面相比代表性方法有显著提升。

Insight: 创新点在于将长视频生成构建为闭环的视觉-文本-记忆三元协同过程，并引入实体中心的可变记忆状态来演化实体外观和多视图证据，通过分析器驱动的镜头内/间精炼实现迭代优化。

Abstract: Multi-shot long-form video generation remains challenging due to identity drift and compounding inconsistencies across shots. While storyboard-driven pipelines improve controllability, they are often executed in a feed-forward manner, with limited mechanisms to incorporate generated visual evidence back into subsequent conditioning. We propose CoTriSyGen, an agentic framework that formulates multi-shot long video generation as a closed-loop visual-text-memory synergy process, where planned intent, persistent memory, and generated visuals are jointly leveraged for iterative correction and long-range coherence. A vision-language-model-based analyzer reasons over this triplet and produces updates to both prompts and memory along two pathways: (i) intra-shot refinement, which triggers targeted regeneration when semantic or compositional violations are detected and refines image-to-video prompt for coherent motions; and (ii) inter-shot refinement, which rewrites subsequent-shot prompts to propagate newly manifested entities or attributes and improve prompt quality (e.g., compositional grounding and cinematic fluency) based on generated evidence. The loop is grounded in an entity-centric memory modeled as a mutable visual state that evolves as the story progresses, which is continuously updated by both the generator and the analyzer by adding new and evolved entities to reflect appearance changes, accumulated multi-view evidence, and multi-entity compositions. Experiments on our curated StoryBench benchmark demonstrate substantial improvements in cross-shot consistency, prompt adherence, and cinematic continuity over representative methods.

[187] Cascaded Sparse Autoencoders Learn Multi-Level Visual Concepts in Multimodal LLMs cs.CV | cs.AI | cs.LGPDF

Yusong Zhao, Hengyi Wang, Tanuja Ganu, Akshay Nambi, Hao Wang

TL;DR: 本文提出了级联稀疏自编码器（CSAE），用于在多模态大语言模型中学习层次化的视觉概念。该方法通过在第一层SAE的解码器权重上训练第二层SAE，将学习到的低级特征方向作为高级抽象的输入，从而学习‘概念的概念’。实验表明，相比现有SAE基线，CSAE在多个模型和数据集上提升了层次概念的一致性，并支持有效的概念组级干预。

Details

Motivation: 多模态大语言模型（MLLMs）在视觉语言任务上表现出色，但其内部视觉表征难以解释。现有稀疏自编码器（SAEs）主要恢复扁平的特征字典，不适合显式的多层次概念组织。

Result: 在Qwen3-VL、Gemma-3和LLaVA等多个模型及视觉数据集上的实验表明，CSAE在层次概念一致性方面优于最先进的SAE基线。概念引导实验进一步证明，学习到的概念组支持对MLLM输出进行有效的组级干预。

Insight: 创新点在于提出级联训练架构，直接在第一层SAE的解码器权重上训练第二层SAE，避免了嵌套式层次结构的共享前缀耦合问题和朴素堆叠SAE的瓶颈，从而实现了更清晰的多层次概念抽象。这为MLLM的可解释性研究提供了一种可扩展的层次化特征分解方法。

Abstract: Multimodal Large Language Models (MLLMs) have demonstrated strong performance on vision-language tasks, yet their internal visual representations remain difficult to interpret. Sparse Autoencoders (SAEs) provide a scalable way to decompose dense model activations into sparse, interpretable features. However, existing SAE architectures primarily recover flat feature dictionaries and are less suited for explicit multi-level concept organization. In this paper, we introduce cascaded sparse autoencoders (CSAEs) for learning hierarchical visual concepts in MLLMs. Rather than nesting or stacking SAE sparse activation codes, CSAEs train a second-level SAE directly on the decoder weights of the first-level SAE, treating learned low-level feature directions as inputs for higher-level abstraction. This design enables CSAEs to learn “concepts of concepts” while avoiding drawbacks from the shared-prefix coupling of nesting, Matryoshka-style hierarchies and the bottlenecks of naively stacked SAEs. Experiments across Qwen3-VL, Gemma-3, and LLaVA on multiple visual datasets show that CSAEs improve interpretability in terms of hierarchical concept coherence over state-of-the-art SAE baselines. Results on concept steering further demonstrate that the learned concept groups support effective group-level interventions in MLLM outputs.

[188] Learned JPEG Compression for DNN Vision cs.CVPDF

Kaixiang Zheng, Ahmed H. Salamah, Siyu Chen, En-Hui Yang

TL;DR: 本文提出了一种名为J4D的学习型JPEG压缩框架，旨在优化JPEG编码参数以最小化压缩率并最大化深度神经网络（DNN）的推理性能。通过引入基于概率量化方案的可微分软量化器，实现了JPEG编解码器的可微分代理，并能够解析计算编码源的熵以估计压缩率，从而通过反向传播解决优化问题。实验表明，J4D在多个数据集和DNN架构上显著优于默认JPEG及其他针对DNN优化的JPEG编解码器。

Details

Motivation: 在人工智能时代，大量图像数据（通常由JPEG压缩）被深度神经网络而非人类消费，因此需要优化JPEG以提升DNN推理性能，解决传统JPEG为人类视觉设计而可能不适用于DNN的问题。

Result: 在多个数据集和DNN架构上的广泛实验结果显示，J4D相比默认JPEG，在相同压缩率下准确率提升高达11.60%，或在相同准确率下压缩率降低高达80.05%，并首次展示了为不同DNN架构设计通用JPEG编码参数的潜力。

Insight: 创新点包括提出可微分JPEG编解码器和信息论压缩率估计器，通过概率量化实现端到端训练，从而优化编码参数以平衡压缩效率与DNN性能，这为面向AI的图像压缩提供了新思路。

Abstract: JPEG, a lossy image compression technique designed for human viewers, has maintained its dominance for decades. However, in the era of artificial intelligence (AI), a substantial portion of image data, often compressed by JPEG, is and will continue to be consumed by deep neural networks (DNNs) instead of humans, thus creating a need to optimize JPEG for DNN inference performance. To this end, we propose learned JPEG compression for DNN vision (J4D), a novel training framework for determining JPEG encoding parameters to minimize compression rate while maximizing DNN inference performance. The major challenge of solving this optimization problem lies in representing the JPEG codec and compression rate in closed form. By incorporating a differentiable soft quantizer based on a probabilistic quantization scheme, we not only obtain a differentiable proxy for the JPEG codec, but are also able to compute the entropy of the coded source analytically, which is a close estimate of the actual compression rate. Equipped with both the differentiable JPEG codec and the information-theoretic rate estimator, we are then able to solve the aforementioned optimization problem with backpropagation. After training, the learned encoding parameters will be subsequently used in actual JPEG encoding based on probabilistic quantization. Extensive experimental results across multiple datasets and DNN architectures demonstrate that J4D consistently and significantly outperforms the default JPEG and other competitive JPEG codecs optimized for DNNs. Notably, compared to the default JPEG, J4D achieves an increase in accuracy by as much as 11.60% at the same rate, or a reduction of compression rate up to 80.05% at the same accuracy. Additionally, with the help of J4D, we show the potential to design universal JPEG encoding parameters for various DNN architectures for the first time.

[189] EgoPhys: Learning Generalizable Physics Models of Deformable Objects from Egocentric Video cs.CV | cs.AI | cs.ROPDF

Hyunjin Kim, Ri-Zhao Qiu, Guangqi Jiang, Xiaolong Wang

TL;DR: EgoPhys是一个从仅RGB的自我中心视角视频中学习可变形物体通用物理模型的框架，它通过提取每个物体的逆物理解并编码为紧凑码本，实现了无需逐弹簧测试时优化的可控数字孪生生成。该框架在重建、未来预测和零样本泛化方面优于基线方法，并在真实机器人上验证了其作为内部世界表示辅助可变形物体规划的潜力。

Details

Motivation: 人类通过日常交互自然理解物体物理，但准确预测复杂可变形物体（如弹性材料和织物）的动力学仍是计算机视觉和机器人学的重大挑战。现有方法存在局限，需要从自我中心视角视频中构建可控的可变形物理数字孪生。

Result: EgoPhys在重建、未来预测和零样本泛化任务上优于基线方法。通过构建包含多样可变形物体、场景和操作风格的自我中心交互数据集进行训练和评估，并在真实xArm6机器人上部署验证了其有效性。

Insight: 创新点在于将每个物体的逆物理解提炼为紧凑码本，从而无需逐弹簧测试时优化即可预测未见物体的密集弹簧刚度场。这展示了自我中心RGB观测作为实现真实到仿真流程的可扩展路径的潜力，为可变形物体的物理建模提供了通用且高效的方法。

Abstract: Humans naturally understand object physics through everyday interactions, but faithfully predicting complex deformable dynamics, such as elastic materials and fabrics, remains a major challenge for computer vision and robotics. We present EgoPhys, a framework that constructs deformable physical digital twins from egocentric RGB-only video using generalizable priors. EgoPhys overcomes the limitations of existing methods to enable controllable deformable digital twin generation from egocentric videos by distilling per-object inverse-physics solutions into a compact codebook, enabling prediction of dense spring stiffness fields for unseen objects without per-spring test-time optimization. Trained with generalizable priors from diverse egocentric interactions, EgoPhys outperforms baselines in reconstruction, future prediction, and zero-shot generalization. To support training and evaluation, we curate an egocentric interaction dataset covering diverse deformable objects, scenes, and manipulation styles. We deploy EgoPhys on a real xArm6 robot, demonstrating that a digital twin initialized from a single egocentric human play video can serve as an internal world representation to aid in deformable-object planning, highlighting egocentric RGB observations as a scalable path toward real-to-sim pipelines.

[190] GRACE: Boosting Video MLLMs with Grounded Action-Centric Evidence for Viewer Sentiment Prediction cs.CVPDF

Ruoxuan Yang, Tieyuan Chen, Xiaofeng Huang, Haibing Yin, Jun Wang

TL;DR: 本文提出了一种名为GRACE的基于动作中心证据增强的框架，旨在提升视频多模态大语言模型（MLLMs）在视频广告观众情感预测任务中的性能。该方法通过从视频描述中提取时序性的主谓宾三元组和可见文本线索，并将主体和客体实体定位为视觉实体裁剪，从而为模型提供结构化和局部化的证据，以增强其对细粒度情感相关事件的理解和推理能力。

Details

Motivation: 视频广告观众情感预测需要模型从显式的视觉叙事、具体的角色-物体交互和可见文本线索中推断出隐含的观众情绪。然而，标准的多模态大语言模型通常依赖整体帧表示，这使得这些细粒度、与情感相关的事件信息变得隐晦，从而阻碍了精确的情感推理。

Result: 在Pitts数据集上的实验表明，该方法在Qwen2.5-VL和Qwen3-VL基线模型上取得了持续的性能提升。在AdsQA数据集上的跨数据集评估以及在情感导向的TVQA子集上的迁移实验进一步支持了该方法的有效性和泛化能力。

Insight: 论文的核心创新点在于提出了一个基于动作中心证据增强的框架，通过引入显式的事件结构（时序性主谓宾三元组）和局部化的视觉证据（实体裁剪）来增强视频MLLMs的线索提取和理解能力。从客观角度看，这种将结构化事件表示与具体视觉证据相结合的方法，为解决视频情感理解中细粒度推理的挑战提供了一种可借鉴的思路。

Abstract: Viewer sentiment prediction in video advertisements aims to infer the latent affective response evoked in the audience. To bridge the gap between what is shown and what is felt, models must deduce hidden viewer emotions from explicit visual narratives, concrete character-object interactions, and visible textual cues. However, standard Multimodal Large Language Models (MLLMs) typically rely on holistic frame representations, which leave these fine-grained, affect-relevant events implicit and complicate precise emotional reasoning. To address this, we propose a grounded action-centric evidence augmentation framework that enhances video MLLMs’ clue extraction and comprehension by introducing explicit event structure and localized visual evidence. Our method extracts temporally ordered subject-verb-object (SVO) triplets and auxiliary visible textual cues from action-centric video descriptions, grounds subject and object entities as visual entity crops, and then enables the MLLM to perform clue-enhanced emotional reasoning based on these extracted structured clues. In this way, action triplets specify “what happens”, while grounded visual entity crops anchor “who or what participates in each event” to concrete visual evidence. Experiments on the Pitts dataset show consistent improvements over Qwen2.5-VL and Qwen3-VL baselines. Ablation studies, cross-dataset evaluation on AdsQA, and transfer experiments on an emotion-focused TVQA subset further support the effectiveness and generalization of our approach.

[191] DynFS-MoE: Dynamic Functional-Structural Mixture-of-Experts for Post-Traumatic Epilepsy Diagnosis cs.CVPDF

Jun-En Ding, Spencer Chen, Henry Noren, Daniel Valdivia, Christine Yohn

TL;DR: 本文提出了一种动态多模态混合专家（MoE）框架DynFS-MoE，用于创伤后癫痫（PTE）的早期诊断。该框架通过时间感知的功能-结构编码和类别条件专家路由，整合了功能性和结构性MRI数据，以捕捉大脑中复杂的多模态交互模式。

Details

Motivation: 创伤后癫痫是创伤性脑损伤的严重并发症，但由于其引起的大脑结构和功能改变复杂，早期识别具有挑战性。现有方法在动态整合多模态信息方面存在不足。

Result: 在三个二元分类任务上的实验结果表明，该框架持续优于静态融合基线方法，并且高可解释性分析揭示了有意义的大脑感兴趣区域（ROI）交互模式。

Insight: 创新点在于提出了一个动态的、类别条件驱动的专家路由机制（MCoE模块），能够根据不同的分类目标自适应地分配专家权重，从而更有效地捕获与类别相关的大脑交互模式，并为诊断提供了可解释性。

Abstract: Post-traumatic epilepsy (PTE) is a severe complication of traumatic brain injury (TBI), yet early identification remains challenging due to the complex structural and functional alterations it induces in the brain. To address this, we propose a dynamic multimodal Mixture-of-Experts (MoE) framework that integrates functional and structural MRI through time-aware functional-structural encoding and class-conditioned expert routing. Within this framework, modality-specific and cross-modal experts learn complementary representations, while a Modality-Class MoE (MCoE) module dynamically dispatches expert weights according to each classification objective. Experimental results across three binary classification tasks demonstrate that the framework consistently outperforms static fusion baselines, and high-interpretability analyses further reveal meaningful region-of-interest (ROI) interactions. This dynamic multimodal expert framework effectively captures class-dependent brain interaction patterns and provides an interpretable approach for PTE diagnosis and risk stratification.

[192] Learned Image Compression for Vision-Language-Action Models cs.CV | cs.AIPDF

Hyeonjun Kim, Jegwang Ryu, Sangbeom Ha, Junhyeok Lee, Jun-Hyuk Kim

TL;DR: 本文提出SPARC（空间自适应码率控制）学习型图像压缩框架，专为视觉-语言-动作模型驱动的机器人设计。该框架通过轻量级时序掩码选择器，根据任务相关性自适应分配不同相机视角和图像区域的码率，并引入倾斜码率损失来稳定训练。实验表明，SPARC在相同码率下比传统编解码器和现有学习型方法获得更好的控制性能。

Details

Motivation: 解决视觉-语言-动作模型在带宽受限或分布式部署中，因依赖高频多摄像头观测而导致的视觉通信瓶颈问题；现有图像/视频编解码器旨在保持通用视觉保真度，而非优化下游VLA策略的控制性能。

Result: 在RoboCasa365、VLABench和LIBERO等多个机器人基准测试中，SPARC在相同码率预算下，控制性能持续优于传统图像/视频编解码器及近期学习型压缩方法；在远程控制场景的实际部署中，显著改善了码率与任务成功率的权衡。

Insight: 创新点在于认识到视觉信息的重要性在相机视图和图像空间区域间存在显著差异，并据此设计自适应码率分配机制；引入倾斜码率损失以缓解基于熵的目标函数对罕见但关键视觉模式的过度抑制，提升了任务导向压缩的稳定性。

Abstract: Vision-language-action (VLA) models increasingly rely on high-frequency multi-camera observations, making visual communication a major bottleneck for real-time robotic control in bandwidth-constrained or distributed deployment settings. Existing image and video codecs, however, are designed to preserve generic visual fidelity rather than the control performance of downstream VLA policies. In this work, we introduce SPARC (SPatially Adaptive Rate Control), a learned image compression framework tailored for VLA-driven robots. Our key observation is that the importance of visual information varies substantially across both camera views and spatial regions within an image. Based on this observation, SPARC employs a lightweight temporal mask selector that adaptively allocates bitrate over latent representations according to task relevance while leveraging temporal context. We further introduce a tilted rate loss that stabilizes training by reducing the tendency of entropy-based objectives to over-suppress rare yet task-critical visual patterns. Experiments on diverse robotic benchmarks, including RoboCasa365, VLABench, and LIBERO, show that SPARC consistently achieves stronger control performance than conventional image/video codecs and recent learned compression methods under the same bitrate budget. We additionally demonstrate real-world deployment benefits in remote-control settings, where our method substantially improves the bitrate-success tradeoff.

[193] Propagating Structural Guidance: Synthesizing Fluorescein Angiography from Fundus Images and Sparse OCT Scans cs.CV | cs.AIPDF

Tengfei Ma, Ruiqi Wu, Chenran Zhang, Ye Geng, Na Su

TL;DR: 本文提出了一种新颖的框架，利用光学相干断层扫描（OCT）提供的结构引导，从彩色眼底照相（CFP）合成荧光素血管造影（FFA）图像。该方法通过空间对齐的跨模态融合模块和基于token的对比学习策略，解决了现有方法仅依赖CFP表面纹理、无法重建功能性血管信息的根本限制。

Details

Motivation: FFA对评估视网膜血管异常至关重要，但其采集具有侵入性且不总是可行。相比之下，CFP是非侵入且广泛可及的，这推动了CFP到FFA合成的研究。然而，现有工作仅依赖CFP表面纹理，从根本上限制了重建功能性血管信息和细微病理变化的能力。

Result: 该方法在合成性能上超越了最先进的方法。广泛的实验表明，本方法合成的FFA图像在下游疾病诊断性能上比现有方法带来了更大的提升，突显了其作为常规工作流程中非侵入性决策支持工具的临床潜力。

Insight: 创新点在于首次构建了包含CFP、FFA和OCT的三模态对齐视网膜成像数据集，并提出了空间对齐跨模态融合模块以弥合OCT与眼底模态间的空间差距，以及引入token级跨模态对齐的对比学习策略来显式对齐CFP和FFA在对应空间位置的表示。

Abstract: Fundus fluorescein angiography (FFA) is critical for assessing retinal vascular abnormalities, but its acquisition is invasive and not always feasible. In contrast, color fundus photography (CFP) is non-invasive and widely accessible, which has motivated studies on CFP-to-FFA synthesis. However, prior works rely solely on CFP surface texture, fundamentally limiting the ability to reconstruct functional vascular information and subtle pathological changes. To address this, we propose a novel framework that synthesizes FFA from CFP with structural guidance provided by optical coherence tomography (OCT). We construct a multi-modal retinal imaging dataset with paired CFP, FFA, and OCT from 3,676 patient eyes–the first tri-modally aligned dataset in retinal imaging. To bridge the spatial gap between OCT and fundus modalities, we propose a Spatially Aligned Cross-Modal Fusion (SACMF) module that projects depth-resolved OCT features onto the fundus plane and injects them into the CFP encoder via adaptive layer normalization. Beyond feature fusion, we further introduce Token-wise Cross-Modality Alignment (TCMA), a token-level contrastive learning strategy that explicitly aligns CFP and FFA representations at corresponding spatial positions. Our method achieves superior synthesis performance compared to state-of-the-art methods. Moreover, extensive experiments demonstrate that the FFA images synthesized by our approach bring greater improvements in downstream disease diagnosis performance than existing methods, highlighting the clinical potential of our approach as a non-invasive decision-support tool in routine workflows. The code is available at https://github.com/while-plus/OCT-guide-FFA-Syn.

[194] UniDDT: Unifying Multimodal Understanding and Generation with Decoupled Diffusion Transformer cs.CVPDF

Shuai Wang, Liang Li, Yang Chen, Ruopeng Gao, Yao Teng

TL;DR: 本文提出UniDDT模型，旨在通过解耦扩散Transformer统一多模态理解与生成任务。该模型采用带噪声的ViT编码器与LLM进行统一语义编码，并利用独立的扩散解码器，以解决现有统一多模态模型中视觉理解与生成任务间的学习冲突、视觉空间不兼容及过度依赖任务特定数据等问题。

Details

Motivation: 现有统一多模态模型面临视觉理解与生成任务间的内在学习冲突、不同视觉空间阻碍可扩展性，以及过度依赖任务特定数据而忽视文本-图像理解与生成的对偶性等挑战。

Result: 在视觉生成任务上，UniDDT在GenEval上获得0.87分，DPG总体得分为86.9；在多模态理解任务上，在MME基准上达到1699.5分，在SEEDbench上总体得分为76.5分。

Insight: 创新点包括引入带噪声的ViT编码器与LLM实现统一语义编码，以及解耦扩散解码与文本解码，从而平衡生成任务的可扩展性与理解任务的语义表达能力；同时构建对偶数据结构以利用理解与生成间的内在对偶性。

Abstract: Unified Multimodal Models (UMMs) have emerged as a critical direction for general-purpose multimodal intelligence, integrating understanding and generation into a single framework. However, existing UMMs face prominent challenges: (1) the inherent learning conflicts between visual understanding and generation tasks, leading to suboptimal modeling in both tasks; (2) different understanding and generation visual spaces impeding scalability; (3) over-reliance on task-specific data that neglects the duality of text-image understanding and generation. To address these challenges, we propose UniDDT, which leverages a Noisy ViT encoder along with an LLM to unify semantic encoding for visual generation and understanding tasks, while employing a separate diffusion decoder to decouple diffusion decoding from text decoding. With this Noisy ViT encoder, UniDDT is able to leverage the latent space as a unified visual representation, enabling seamless compatibility between understanding and generation tasks. Thus, the scalability within the generation tasks and the semantic expressiveness within understanding tasks can be balanced. Also, we construct dual data structures from the same image-text pairs, fostering interdependence between the generation and understanding data to exploit their inherent duality. Extensive experiments demonstrate that UniDDT achieves effective unification of multimodal understanding and generation with enhanced semantic consistency and scalability. For visual generation tasks, our UniDDT achieves 0.87 GenEval score and 86.9 DPG overall score. For multimodal understanding tasks, our UniDDT achieves 1699.5 score on MME benchmark and 76.5 overall score on SEEDbench.

[195] KeepLoRA++: Continual Learning with Layer-Scaled Residual Gradient Adaptation cs.CV | cs.LGPDF

Mao-Lin Luo, Yi-Lin Zhang, Zi-Hao Zhou, Yankun Hong, Xialiang Tong

TL;DR: 本文提出KeepLoRA++，一种用于预训练视觉语言模型的持续学习方法。该方法通过分析Transformer架构的知识分布，发现通用可迁移知识主要编码在浅层和参数的主子空间中，而任务特定适应则集中在深层和残差子空间中。基于此，KeepLoRA++引入了一种层缩放残差梯度适应机制，通过将新任务的LoRA参数更新限制在残差子空间并结合浅层到深层的缩放策略，来平衡保留预训练知识、先前任务知识以及学习新知识这三个竞争目标。

Details

Motivation: 解决预训练视觉语言模型在持续学习中面临的三个竞争目标的平衡问题：保留预训练知识、保持已学任务序列的知识、以及维持学习新知识的可塑性。

Result: 在图像分类、视觉问答和视频理解任务上的实验评估表明，KeepLoRA++持续优于代表性基线方法。

Insight: 创新点在于从层间和层内两个维度分析Transformer的知识分布结构，并据此设计层缩放残差梯度适应方法。该方法将梯度投影到与预训练主子空间及先前任务特征主方向正交的子空间，并对不同层分配差异化的更新幅度，从而有效管理知识干扰。

Abstract: Continual learning for pre-trained vision-language models requires balancing three competing objectives: retaining pre-trained knowledge, preserving knowledge from a sequence of learned tasks, and maintaining the plasticity to acquire new knowledge. This paper presents KeepLoRA++, balancing these objectives through a unified dual-dimensional knowledge retention mechanism. We analyze knowledge distribution of Transformer architecture from both inter-layer and intra-layer perspectives. The inter-layer perspective examines how retention is distributed across layers, while the intra-layer perspective focuses on the parameter space within each layer. Our analysis reveals a structural property: general transferable knowledge is mainly encoded in the shallow layers and the principal subspace of the parameters, while task-specific adaptations are localized in the deep layers and the residual subspace. Motivated by this insight, KeepLoRA++ introduces a layer-scaled residual gradient adaptation method. New tasks are learned by restricting LoRA parameter updates to the residual subspace, combined with a shallow-to-deep layer scaling, to prevent interference with previously acquired capabilities. Specifically, the gradient of a new task is projected onto a subspace orthogonal to both the principal subspace of the pre-trained model and the dominant directions of previous task features, while simultaneously assigning smaller update magnitudes to shallow layers and larger ones to deeper layers. Our theoretical analysis and empirical evaluations confirm that KeepLoRA++ successfully balances these three competing objectives, consistently outperforming representative baselines across image classification, visual question answering, and video understanding tasks.

[196] RealityBridge: Bridging Editable 3D Gaussian Splatting Driving Simulations and Real-World Videos cs.CV | cs.AIPDF

Zhenhua Wu, Yun Pang, Mingkun Chang, Yuwei Ning, Liangzhi Wang

TL;DR: 本文提出RealityBridge框架，旨在弥合可编辑3D高斯溅射（3DGS）驾驶仿真视频与真实世界视频之间的差距。该框架通过多模态控制（包括渲染视频、前景掩码、边缘图和语义掩码）和轻量级GateNet自适应分配条件，结合针对性训练数据与自回归长视频训练，提升修复质量、时间稳定性和幻觉抑制。

Details

Motivation: 面向安全的长尾危险驾驶场景难以大规模收集与复现，可编辑3DGS仿真虽能重建真实驾驶场景并支持可控编辑，但其渲染视频仍存在明显的仿真到真实差距，如渲染伪影、前景资产退化、光照不一致和时间闪烁。现有修复与视频生成方法难以同时解决这些3DGS特定问题。

Result: 在内部和公开驾驶数据集上的大量实验表明，RealityBridge在伪影去除、光照协调和长序列时间一致性方面优于现有方法。

Insight: 创新点包括结构保持与资产感知的仿真到真实框架、多模态控制与轻量GateNet的条件自适应分配机制，以及针对性的训练数据构建与奖励引导后训练的自回归长视频训练策略，有效联合修复3DGS特定伪影并提升视觉真实感。

Abstract: Long-tail hazardous scenarios are essential for safety-oriented autonomous driving, yet they are difficult to collect and reproduce at scale. Editable 3D Gaussian Splatting (3DGS) simulation offers a promising alternative by reconstructing real driving scenes and supporting controllable scene editing. However, edited 3DGS-rendered videos still suffer from a significant Sim-to-Real gap, including rendering artifacts, degraded foreground assets, inconsistent illumination, and temporal flickering. Existing restoration and video generation methods are insufficient for this task, as they often fail to jointly repair 3DGS-specific artifacts, improve visual realism, and ensure temporal consistency. To fill this gap, we propose RealityBridge, a structure-preserving and asset-aware Sim-to-Real framework for edited 3DGS driving videos. RealityBridge uses multimodal controls, including rendered videos, foreground masks, edge maps, and semantic masks, together with a lightweight GateNet for adaptive condition allocation across backbone layers. We further construct targeted training data and introduce autoregressive long-video training with reward-guided post-training to improve restoration quality, temporal stability, and hallucination suppression. Extensive experiments on internal and public driving datasets show that RealityBridge outperforms existing methods in artifact removal, illumination harmonization, and long-sequence temporal consistency.

[197] Training-free sparse attention based on cumulative energy filtering cs.CVPDF

Chunlu Li, Yixuan Pan, Bai Du, Zhenyuan Chen, Yanzhao Li

TL;DR: 本文提出了一种用于视频生成扩散变换器（DiT）的无训练稀疏注意力方法，通过基于累积能量过滤的动态阈值策略来选择重要token，在保持准确性的同时显著提高稀疏度。该方法与Flash Attention深度集成，无需额外掩码计算开销。

Details

Motivation: 现有稀疏注意力方法（如Top-p、Top-k）无法同时满足最大化稀疏度和最小化精度损失的双重目标。本文旨在通过动态阈值方案解决这一优化问题，以在保证精度的前提下提升计算效率。

Result: 在Wan 2.2数据集上的实验表明，与同样集成Flash Attention的BLASST算法相比，该方法将稀疏度从61.42%提升至82%，VBench指标下降小于5%，注意力计算减少约15%，计算效率提升1.61倍（比BLASST高1.18倍）。

Insight: 创新点在于将token过滤建模为双目标优化问题，并提出基于固定召回率（而非固定阈值）的动态阈值策略来平衡稀疏性与精度；同时与Flash Attention的无缝集成消除了掩码计算开销，实现了高效稀疏注意力机制。

Abstract: Sparse attention accelerates Diffusion Transformers (DiTs) for video generation by computing only the important tokens while skipping the rest. The token selection strategy is key to balancing sparsity and accuracy. We formulate the token filtering process as a dual-goal optimization problem: maximizing sparsity and minimizing accuracy degradation. Existing algorithms cannot fulfill both objectives simultaneously. For example, Top-p only considers the accuracy constraint, while Top-k maintains a fixed computational budget but loosens the accuracy constraint. This paper demonstrates that maintaining a fixed recall rate is sufficient for ensuring accuracy, whereas a fixed threshold is suboptimal for reducing computational cost. Therefore, we propose a dynamic thresholding scheme to improve sparsity while maintaining the same level of accuracy. Furthermore, our algorithm is deeply integrated with Flash Attention (FA), eliminating the need for any additional masking computation overhead. Experimental results on Wan 2.2 validate that, compared to the BLASST algorithm which is also integrated with FA, our dynamic thresholding strategy enhances sparsity from 61.42% to 82% with a VBench metric drop of less than 5%. This results in an approximate 15% in attention computation and a $1.61\times$ increase in computational efficiency, which is 1.18x higher than that of BLASST.

[198] Chronological Blindness: Benchmarking Temporal Reasoning in Vision-Language Models with CHRONOSIGHT cs.CVPDF

Parthaw Goswami, Jaynto Goswami Deep

TL;DR: 本文介绍了CHRONOSIGHT基准测试，用于评估视觉语言模型在视觉时序推理方面的能力。该基准包含五个维度：时序排序、阶段定位、时间差估计、时序反转检测和时序异常识别，涵盖八个过程类别和从分钟到千年的时间尺度。评估发现，当前开源VLMs与人类表现存在显著差距，但通过少量微调可显著提升性能。

Details

Motivation: 人类视觉感知本质上是时序的，但大型视觉语言模型是否具备类似的时序推理能力仍是一个开放且重要的问题。本文旨在通过构建一个严格控制的基准来量化评估VLMs在这方面的能力。

Result: 在CHRONOSIGHT基准上，人类平均表现达到0.89，而最佳开源模型Qwen2.5-VL-7B在直接提示下仅达到0.40。通过LoRA微调151个样本，CHRONODELTA任务的准确率从接近零提升到0.43，并能零样本迁移到相关任务。

Insight: 论文的创新点在于构建了一个全面、多维度、跨时间尺度的视觉时序推理基准。客观分析表明，模型性能瓶颈可能部分源于指令遵循而非纯粹的视觉感知能力，少量微调即可带来显著提升，这为模型能力评估和优化提供了新视角。

Abstract: Human perception of visual scenes is inherently temporal. We instinctively recognise whether a fruit is ripening or rotting, whether construction is progressing or being demolished, and approximately how much time separates two photographs of the same subject. Whether large vision-language models (VLMs) share this competence remains an open and practically important question. We introduce CHRONOSIGHT, a rigorously controlled benchmark evaluating five dimensions of visual temporal reasoning: CHRONORANK (chronological ordering of image sequences), CHRONOLOCATE (ordinal stage localisation from a single image), CHRONODELTA (estimation of time elapsed between two images on a logarithmic scale), CHRONOREVERSE (detection of temporally reversed sequences), and CHRONOODD (identification of a temporal outlier within a set). The benchmark comprises 1{,}000 items across eight process families (biological growth, food transformation, physical weathering, construction, environmental change, human ageing, astronomical phenomena, and urban dynamics) spanning timescales from minutes to millennia. We evaluate eight open-source VLMs (500 M to 19 B parameters) under two prompting regimes and collect human performance baselines. Human performance averages 0.89 across tasks; the best open model (Qwen2.5-VL-7B) reaches 0.40 under direct prompting, a gap we term chronological blindness. Lightweight LoRA fine-tuning on 151 examples raises CHRONODELTA accuracy from near-zero to 0.43, transferring zero-shot to related tasks (CHRONOODD: 0.37; CHRONOREVERSE: 0.64)suggesting the bottleneck is partly instruction following rather than visual perception. Benchmark, code, and predictions will be released upon acceptance.

[199] Explainable Flood Segmentation on Sentinel-1 SAR Imagery: A Comparative Study of CNN and Transformer Architectures cs.CVPDF

Arundhuti Banerjee, David Daou

TL;DR: 本研究对卷积神经网络（CNN）和视觉Transformer架构在Sentinel-1 SAR影像上进行多类别洪水分割（区分淹没土地、永久水体和陆地）进行了全面比较。在ETCI和Sen1Floods11两个基准数据集上评估了U-Net、U-Net++、DeepLabV3和SegFormer（b0, b1, b2）等模型，发现SegFormer-b2在ETCI数据集上显著优于U-Net基线，但在Sen1Floods11上微调后优势缩小。研究还结合了定性和定量的可解释性技术来分析模型决策。

Details

Motivation: 解决基于SAR影像进行全天候洪水监测时，准确区分淹没土地与永久水体的关键挑战，这对于严格的洪水（仅指淹没土地）定义下的灾害响应和减灾规划至关重要。

Result: 在ETCI数据集上，SegFormer-b2在Wilcoxon符号秩检验中，所有7个测试场景的洪水IoU均显著优于U-Net基线，达到SOTA水平；在Sen1Floods11数据集上微调后，其优势缩小到场景变异范围内，并在空间碎片化的洪水事件中表现更集中。

Insight: 创新点在于对CNN和Transformer架构在SAR洪水分割任务上进行了系统的基准比较，并融合了可解释性分析（如Grad-CAM和不确定性估计）来理解模型决策。客观来看，研究揭示了SegFormer在捕捉空间连贯的洪水特征方面有优势，而U-Net在洪水边界的不确定性估计上更具信息性，这为模型选择提供了实用见解。

Abstract: Rapid and accurate flood prediction is essential for disaster response and mitigation planning. Synthetic Aperture Radar (SAR) sensors in satellites are well-suited for this purpose because they operate independently of weather and daylight conditions. Although SAR-based data enable all-weather flood monitoring, distinguishing flooded land from permanent water remains a significant challenge, particularly when flooding is defined strictly as inundated land. This study provides a comprehensive comparison of convolutional neural network (CNN) and vision transformer architectures for multi-class flood segmentation using Sentinel-1 SAR imagery, specifically trained to separate flooded land from permanent water bodies and land. Three state-of-the-art (SOTA)CNN-based models, U-Net, U-Net++, and DeepLabV3 with ResNet-34 backbone, and three SegFormer variants (b0,b1,b2) were evaluated in two benchmark datasets, the ETCI NASA dataset and SenFloods11, using scene-based data splits to ensure a realistic assessment of spatial generalization. The results demonstrate that SegFormer-b2 significantly outperforms the U-Net baseline on the ETCI dataset (higher flood IoU across all 7 test scenes in the Wilcoxon signed-rank test), while after fine-tuning on Sen1Floods11, the advantage narrows to within the range of scene variability and is concentrated in spatially fragmented flood events. The study includes both qualitative and quantitative explainability techniques to visually comprehend model decisions and systematically assess prediction reliability. Qualitative analysis reveals that SegFormer-b2 produces more spatially coherent Grad-CAM activations focused on flood-relevant features, while U-Net generates more informative uncertainty estimates along flood boundaries.

[200] What Should a Streaming Video Model Remember? cs.CV | cs.AIPDF

Haonan Ge, Yiwei Wang, Hang Wu, Yujun Cai

TL;DR: 本文提出了一种名为SelectStream的选择性潜在记忆框架，用于解决流式视频理解中如何有效分配有限内存和计算资源以处理历史信息的问题。该框架通过三个协调机制（惊喜驱动的自适应窗口、优先级保留的整合以及查询条件下的图推理）来管理记忆的写入、保留和检索，从而在保持当前场景感知的同时，有选择地利用历史证据。

Details

Motivation: 现有流式视频理解方法通常通过添加记忆库或检索模块来保存长距离历史，但无差别的历史注入可能会稀释当前场景的感知。因此，关键挑战在于如何有选择性地分配内存，而不是是否使用内存。

Result: SelectStream在StreamingBench上达到82.67%，在OVO-Bench上达到67.03%，在离线视频基准测试中平均准确率为74.4%，优于强近期窗口基线和先前的流式记忆方法。

Insight: 创新点在于将问题形式化为预算在线潜在证据分配，并提出了一个选择性潜在记忆框架，通过查询条件化的证据预算来暴露历史信息，同时保持当前观测对冻结VLM的直接可见性，避免了重放帧或随流长度增加上下文。

Abstract: Streaming video understanding models must answer queries at any moment during an ongoing stream, using only what they have observed so far and under fixed memory and computation budgets. Existing methods address this by adding memory banks, retrieval modules, or visual token compression to preserve long-range history. However, strong recent-window baselines show that indiscriminate history injection can dilute current-scene perception, suggesting that the key challenge is not whether to use memory, but how to allocate it selectively. We formulate this as budgeted online latent evidence allocation and propose \textbf{SelectStream}, a selective latent-memory framework that keeps the current observation directly visible to a frozen VLM while exposing historical information only through a compact, query-conditioned evidence budget. Three coordinated mechanisms govern when to write, what to preserve, and how to retrieve: surprise-driven adaptive windowing, priority-preserving consolidation, and query-conditioned graph reasoning over a fixed-capacity latent memory graph. Retrieved evidence is calibrated and injected as latent tokens for answer generation, without replaying frames or growing the context with stream length. Experimental results show that SelectStream achieves strong online streaming performance and preserves general video understanding, reaching 82.67% on StreamingBench, 67.03% on OVO-Bench, and 74.4% average accuracy on offline video benchmarks, while outperforming strong recent-window baselines and prior streaming memory methods.

[201] RGFVR: Reference-Guided Face Video Restoration with Flow Matching cs.CVPDF

Cem Eteke, Batuhan Tosun, Eckehard Steinbach

TL;DR: 本文提出了一种名为RGFVR的参考引导人脸视频修复框架，旨在从退化的视频中恢复出具有高视觉保真度、时间一致性和身份保持能力的人脸视频。该方法通过将双模态感知-描述身份条件引入预训练的基于流的文本到视频生成器，并采用两阶段训练策略来增强修复过程中的身份引导。

Details

Motivation: 现有的人脸视频修复方法要么是无参考的，容易在特定人脸细节丢失时导致身份信息损失；要么是特定于某个主体的，难以泛化到未见过的身份。因此，需要一种主体无关、参考引导的框架来在修复过程中更好地保持身份信息。

Result: 实验表明，该方法在包括下采样、模糊、噪声和压缩伪影在内的挑战性视频退化条件下，在修复保真度、时间一致性和身份保持方面均取得了提升，实现了优越的性能。

Insight: 创新点在于将双模态（感知与描述）身份条件整合到基于流的视频生成模型中，并设计了两阶段训练策略来强化身份引导，从而实现了主体无关且身份保持的参考引导视频修复。

Abstract: Face video restoration from degraded observations is challenging, as it requires simultaneously recovering visual fidelity, temporal consistency, and subject identity. Existing approaches are often either reference-free, which can lead to identity loss when person-specific facial details are lost, or subject-specific, which limits generalization to unseen identities. We propose a subject-agnostic, reference-guided framework for identity-preserving face video restoration. Our method introduces bimodal perceptual-descriptive identity conditioning into a pretrained flow-based text-to-video generator and employs a two-stage training strategy to strengthen identity guidance during restoration. Experiments show that our approach improves restoration fidelity, temporal consistency, and identity preservation, achieving superior performance under challenging video degradations, including downsampling, blur, noise, and compression artifacts. The code is available under: https://github.com/batuhanntosun/RG-FVR.

[202] Hierarchical Fine-Grained Aerial Object Detection cs.CVPDF

Yan Zhang, Fang Xu, Wen Yang, Gui-Song Xia

TL;DR: 本文提出ExpertDet方案，通过整合专家知识线索来增强细粒度航空目标检测。具体设计了视觉感知掩码属性建模（VMAM）来对齐属性语义与视觉结构，以及分层视觉实例提升（HierVIP）来构建视觉原型树并施加分类感知约束。此外，还构建了新的细粒度目标检测基准PSP，用于精确识别航空图像中的特定型号船只和飞机。

Details

Motivation: 现有方法主要继承粗粒度目标检测范式，仅依赖单标签监督，难以区分具有细微结构差异的型号级类别。而结构化先验知识（如属性和层次结构）提供了跨多个粒度的判别性语义，因此本文旨在利用这些知识来提升细粒度航空目标检测性能。

Result: 在提出的PSP基准（涵盖106个船只类别和30个飞机型号）上，ExpertDet在多个层次级别上持续优于其他细粒度竞争对手，实现了SOTA性能。

Insight: 创新点包括：1) VMAM通过从视觉线索重建掩码属性来对齐属性语义与视觉结构，使检测器能捕捉细微结构差异；2) HierVIP基于层次关系构建视觉原型树并施加分类感知约束，在增强类别区分的同时保持跨层级语义连续性；3) 构建了目前最广泛的型号特定类别航空目标检测数据集PSP，为细粒度检测提供了新基准。

Abstract: Fine-grained aerial object detection, driven by the intrinsic granularity of real-world object categories, is crucial for advanced scene understanding in remote sensing. Existing methods largely inherit the paradigm of coarse-grained object detection, relying solely on single-label supervision and thus struggling to distinguish model-level categories with subtle structural differences. However, for each specific model (e.g., Boeing 787), structured prior knowledge such as attributes and hierarchies offers discriminative semantics across multiple granularities. Motivated by this, we present ExpertDet, a scheme that incorporates expert-informed cues to enhance fine-grained aerial object detection. Specifically, we design Vision-aware Masked Attribute Modeling (VMAM), which aligns attribute semantics with visual structures by reconstructing randomly masked attributes from visual cues, enabling the detector to capture subtle structural distinctions. We further propose Hierarchical Visual Instance Promotion (HierVIP), which builds a visual prototype tree based on hierarchical relations and imposes taxonomy-aware constraints to preserve cross-level semantic continuity while enhancing category discrimination. Moreover, we curate a new fine-grained object detection benchmark for Precise recognition of model-specific Ships and Planes from aerial imagery, PSP, covering 106 ship classes and 30 airplane models, respectively, featuring the most extensive collection of model-specific categories among existing aerial object detection datasets to date. We benchmark state-of-the-art object detection algorithms on the PSP benchmark. Extensive evaluation demonstrates that ExpertDet consistently outperforms other fine-grained competitors across hierarchy levels. The dataset, benchmark, and code are available at https://nnnnerd.github.io/PSP-Benchmark/.

Ziying Song, Caiyan Jia, Lin Liu, Shaoqing Xu, Lei Yang

TL;DR: 本文提出GraphBEV++，一个用于自动驾驶感知的鲁棒多模态融合框架，旨在解决激光雷达与相机传感器间因标定不确定性导致的BEV特征错位问题。该框架包含LocalAlign-v2和GlobalAlign-v2两个核心模块，分别通过图匹配和可变形/扩散方法处理局部与全局错位，兼容多种BEV表示范式，并在感知、预测和规划任务上展现出卓越性能。

Details

Motivation: 动机是解决自动驾驶BEV感知中一个关键但常被忽视的挑战：在多模态融合（尤其是激光雷达和相机）时，由于传感器标定不确定性导致的特征投影错位问题，这严重影响了感知的准确性和鲁棒性。

Result: 实验结果表明，GraphBEV++在nuScenes和Waymo子集上针对错位噪声实现了最先进的性能，在Argoverse2上提升了长距离检测能力，并有效泛化至3D占据预测任务，在干净和噪声设置下均提升了估计精度与鲁棒性。在端到端自动驾驶评估中，相比UniAD等五个基线模型，它在开环（nuScenes）和闭环（Bench2Drive、NAVSIM）的感知、预测和规划任务上均表现出优越性能。

Insight: 论文宣称的创新点在于系统性地提出了一个双模块框架来缓解投影引起的错位：LocalAlign-v2通过图匹配实现邻域感知的深度特征对齐，兼容LSS和查询式BEV表示；GlobalAlign-v2则通过可变形（显式学习跨模态偏移）和扩散（注入噪声并去噪以隐式对齐）两种变体分别处理不同BEV范式下的全局错位。从客观角度看，其将图匹配与扩散模型思想引入多模态BEV对齐，并实现了跨范式兼容与端到端任务的有效提升，是具有借鉴意义的创新。

Abstract: Feature misalignment in BEV perception is a critical yet often overlooked challenge in autonomous driving, especially under calibration uncertainties between LiDAR and camera sensors. To address this issue, we propose a robust multi-modal fusion framework, GraphBEV++, which systematically mitigates projection-induced misalignment. The framework consists of two key modules: LocalAlign-v2 and GlobalAlign-v2. LocalAlign-v2 introduces neighborhood-aware depth features via graph matching to correct local misalignment. It supports both LSS-based and query-based BEV representations, making it compatible with BEVFusion and BEVFormer architectures for consistent cross-paradigm alignment. GlobalAlign-v2 encompasses two variants: Deformable and Diffusion. The Deformable variant addresses global misalignment in LSS-based multi-modal BEV by explicitly learning cross-modal feature offsets. In contrast, the Diffusion variant targets implicit misalignment in query-based BEV by injecting noise to simulate misalignment and employing a denoising process to recover aligned features. Experimental results show that GraphBEV++ achieves state-of-the-art performance under misalignment noise on nuScenes and Waymo subset, improves long-range detection on Argoverse2, and generalizes effectively to the 3D occupancy prediction task, consistently improving occupancy estimation accuracy and robustness under both clean and noisy settings. Furthermore, GraphBEV++ effectively alleviates misalignment issues in end-to-end autonomous driving. Compared with five baselines (UniAD, VAD, FusionAD, MomAD, and WoTE), it demonstrates superior performance in both open-loop (nuScenes) and closed-loop (Bench2Drive and NAVSIM) evaluations across perception, prediction, and planning tasks.

[204] PermaVid: Consistent Video Generation Across Edits via Disentangled Context Memory cs.CVPDF

Shuai Yang, Bingjie Gao, Ziwei Liu, Jiaqi Wang, Dahua Lin

TL;DR: PermaVid是一个用于保持视频编辑后长期一致性的新框架。它通过解耦空间上下文为语义外观和几何结构，并采用编辑感知的内存更新与检索策略来实现。该方法在编辑后能维持强大的语义和结构一致性，显著优于现有技术。

Details

Motivation: 解决现有视频生成方法在编辑操作（如修改场景外观或布局）后难以保持长期时间与视角一致性的问题，因为存储的上下文信息会过时或失效。

Result: 实验表明，该方法在编辑后保持了强大的长期语义和结构一致性，在相关基准测试中显著优于最先进的（SOTA）方法。

Insight: 核心创新点在于将多模态上下文内存解耦为外观（RGB）和几何（深度）两个互补的内存库，并设计了编辑感知的内存更新与检索策略，使内存演化与后续观察保持一致，从而支持多模态特征融合的引导生成。

Abstract: Consistent video generation under editing operations requires persistence: when edits modify scene appearance or layout, subsequent generations should remain coherent across time and viewpoints. However, existing memory designs struggle to maintain long-term consistency after such modifications, as stored contexts may become outdated or invalid. To address this, we propose PermaVid, a novel framework built upon a multi-modal context memory that disentangles spatial context into semantic appearance and geometric structure, together with an edit-aware memory update and retrieval strategy that keeps memory evolution aligned with subsequent observations. Specifically, we develop two complementary memory banks: an RGB context memory that captures appearance-aware observations while implicitly encoding geometry, and a depth context memory that preserves geometry-only structure disentangled from semantics. Building on this design, we introduce a memory-guided video generation model that performs multi-modal feature fusion under reference conditions drawn from mixed-modality memory contexts. Experiments demonstrate that our method maintains strong long-term semantic and structural consistency after edits, significantly outperforming state-of-the-art methods.

[205] Decoupled Object-Centric Video Understanding for Generating Robotic Manipulation Commands cs.CV | cs.ROPDF

Thanh Nguyen Canh, Thanh-Tuan Tran, Haolan Zhang, Ziyan Gao, Xiem HoangVan

TL;DR: 本文提出了一种解耦的、以物体为中心的视觉理解框架，用于将视频演示转化为机器人操作指令。该方法将动作识别与物体识别解耦，通过时序移位模块进行高效时空动作分类，并利用新颖的物体选择算法识别任务相关物体，最后结合视觉语言模型生成精确、无语法的操作命令。

Details

Motivation: 现有方法在将视频演示转化为机器人指令时，难以准确识别与动作功能相关的物体，导致生成的指令在语言上合理但操作上模糊。本文旨在解决这一核心挑战，提升指令生成的精确性。

Result: 在改进的Something-Something V2数据集上评估，该方法实现了86.79%的动作分类准确率，在标准物体和新物体上的BLEU-4分数分别为0.337和0.261，分别比最强的任务专用基线提升了80.2%和143.9%。在METEOR和CIDEr指标上提升更大，在新物体上分别达到157.9%和171.7%。在所有语义指标上均优于任务专用方法，并与大型通用视觉语言模型相当或更优。

Insight: 创新点在于将动作与物体识别解耦的模块化设计，以及结合轨迹角色分类、模糊检测和重叠最小化的物体选择算法。这种以物体为中心的设计增强了可解释性和泛化能力，同时保持了高效性，为视频到指令的转化提供了新思路。

Abstract: Translating video demonstrations into executable robot commands remains challenging because existing methods often fail to identify which objects are functionally involved in the demonstrated action. As a result, they may generate commands that are linguistically plausible but operationally ambiguous. We propose an object-centric video understanding framework that decouples action recognition from object identification to generate precise, grammar-free manipulation commands. Our approach integrates Temporal Shift Modules (TSM) for efficient spatio-temporal action classification with a novel \textbf{Object Selection} algorithm that identifies task-relevant objects through trajectory-based role classification, blur detection, and overlap minimization. The selected objects are then processed by Vision-Language Models (VLMs) for robust category recognition and zero-shot generalization. Evaluated on a modified Something-Something V2 dataset, our method achieves 86.79% action classification accuracy and BLEU-4 scores of 0.337 on standard objects and 0.261 on novel objects. These results improve over the strongest task-specific baseline by 80.2% and 143.9%, respectively. Larger gains are observed in METEOR and CIDEr, reaching 157.9% and 171.7% on novel objects. Across all semantic metrics, our approach consistently outperforms task-specific methods and remains competitive with, or surpasses, large general-purpose VLMs while retaining a modular, object-centric design.

[206] MVOFormer: Flow-Semantic Transformer for Robust Monocular Visual Odometry cs.CV | cs.ROPDF

Jituo Li, Shunwang Sun, Jialu Zhang, Xinqi Liu, Jinyao Hu

TL;DR: 本文提出MVOFormer，一种用于鲁棒单目视觉里程计的新型Transformer框架。该框架采用流-语义双分支编码器，将密集几何运动线索与以物体为中心的语义先验相结合，并利用迭代多模态解码器进行粗到精的位姿优化，在多个数据集上实现了优异的零样本泛化能力。

Details

Motivation: 现有基于学习的单目视觉里程计方法存在特征可解释性差、互补性不足或架构过于复杂的问题，限制了其鲁棒性和跨域泛化能力。

Result: 在TartanAir、KITTI、TUM-RGBD和ETH3D-SLAM等多个基准测试中，无需目标域微调，MVOFormer显著优于先前的基于学习的帧到帧方法，实现了优异的零样本泛化与鲁棒性。

Insight: 创新点在于设计了流-语义双分支编码器，显式区分静态结构与动态干扰物，并通过迭代多模态解码器动态抑制不可靠区域的注意力，实现了运动与语义信息的有效协同。

Abstract: Monocular visual odometry (MVO) is foundational to autonomous navigation and robotic localization. However, existing learning-based MVO approaches often struggle with either a lack of interpretable, complementary features or overly complex multi-stage architectures. These limitations inherently restrict their robustness and cross-domain generalization. In this work, we propose MVOFormer, a novel transformer framework for robust monocular visual odometry. Our architecture features a Flow-Semantic Dual Branch Encoder that synergizes dense geometric motion cues with object-centric semantic priors, explicitly distinguishing static structures from dynamic distractors. These representations are then fused by an Iterative Multimodal Decoder, enabling coarse-to-fine pose refinement while dynamically suppressing attention on unreliable regions. Extensive evaluations demonstrate that, without any target-domain fine-tuning, MVOFormer achieves superior zero-shot generalization and robustness, significantly outperforming prior learning-based frame-to-frame methods across diverse benchmarks including TartanAir, KITTI, TUM-RGBD, and ETH3D-SLAM.

[207] Unified Multimodal Model for Brain MRI Imputation and Understanding cs.CV | cs.AI | cs.MMPDF

Zhiyun Song, Che Liu, Tian Xia, Avinash Kori, Wenjia Bai

TL;DR: 本文提出了一种名为UniBrain的统一多模态模型，用于脑部磁共振成像（MRI）的分析。该模型通过统一的训练策略，联合执行成像模态补全和脑图像理解任务，以应对临床环境中常见的模态缺失问题。模型采用交错且描述增强的数据流进行自回归训练，并引入了自对齐策略和动态隐藏状态机制，以提升医学推理能力和缓解长上下文多模态推理中的暴露偏差。

Details

Motivation: 医学多模态大语言模型（MLLMs）面临高质量训练数据稀缺和真实临床环境中数据频繁缺失的重大挑战。本文旨在解决脑部MRI分析中模态不完整的问题，通过一个统一模型同时处理模态补全和理解任务。

Result: 在多疾病脑部MRI数据集上的大量实验表明，UniBrain在各种程度的模态不完整性下，在脑图像补全、理解和疾病诊断方面均实现了高性能。

Insight: 创新点包括：1）统一的模态补全与理解联合训练策略；2）交错且描述增强的自回归数据流构建，支持生成多模态数据的医学推理；3）利用密集图像嵌入学习细粒度解剖特征的自对齐策略，无需详细图像标注；4）缓解长上下文多模态推理暴露偏差的动态隐藏状态机制。

Abstract: Multimodal large language models (MLLMs) hold great potential for medicine, as they inherit knowledge from LLM and allow multiple data modalities to be integrated, analysed and interpreted in natural language. However, the field of medical MLLMs is constrained by non-trivial challenges, notably the scarcity of high-quality training data and the frequent occurrence of missing data in the real-world clinical setting. Here, we propose a novel unified multimodal model, UniBrain, for brain magnetic resonance image (MRI) analysis. To address potential missing brain MRI modalities, we employ a unified training strategy to perform joint imaging modality imputation and brain image understanding. During training, an interleaved and description-enriched data flow is constructed to train the model in an autoregressive manner, enabling medical reasoning with generated multimodal data. A self-alignment strategy is introduced to leverage dense image embeddings to learn fine-grained anatomical features without requiring detailed image captions. Furthermore, we propose a dynamic hidden state mechanism to alleviate the exposure bias during long-context multimodal inference. Extensive experiments on multi-disease brain MRI dataset demonstrate that UniBrain achieves high performance for brain image imputation, understanding, and disease diagnosis under various extents of modality incompleteness.

[208] BadWorld: Adversarial Attacks on World Models cs.CVPDF

Linghui Shen, Mingyue Cui, Xingyi Yang

TL;DR: 本文提出了BadWorld，一种针对自回归视觉世界模型（VWM）的无标签对抗攻击框架。该框架通过自监督的速度攻击干扰模型早期去噪动态，并采用轨迹自适应的双层优化来挖掘困难控制序列，从而生成与用户控制无关的对抗扰动。实验表明，该方法能在视觉不可察觉的扰动下，导致VWM生成未来视频时出现灾难性退化，揭示了VWM在安全关键系统中的脆弱性。

Details

Motivation: 视觉世界模型（VWM）能够从单张上下文图像合成交互式、动作条件的视频序列，但其对对抗扰动的鲁棒性尚未得到充分评估。标准对抗攻击方法因攻击者缺乏真实未来视频且无法预测后续用户控制而难以评估此漏洞。

Result: 在具有连续和离散控制的代表性VWM上评估BadWorld，暴露了其严重的结构脆弱性。视觉上无法区分的对抗图像可靠地触发了未来视频序列的灾难性退化，导致去噪不完整、结构崩溃和控制不一致。

Insight: 创新点在于提出了首个针对自回归VWM的无标签对抗攻击框架，通过自监督的速度攻击绕过未来监督需求，并利用轨迹自适应双层优化来应对不可预测的用户动作。这为评估VWM的鲁棒性提供了新方法，并揭示了其在安全关键应用中的潜在风险，同时为隐私保护提供了实用机制。

Abstract: Visual world models (VWMs) synthesize interactive, action-conditioned rollouts from a single context image. However, it remains an open question how robust these models are to adversarial perturbations. Standard adversarial attacks fail to assess this vulnerability because attackers lack ground-truth future videos and cannot predict subsequent user controls. We introduce BadWorld, a label-free adversarial framework tailored for autoregressive VWMs that systematically overcomes both constraints. First, to bypass the need for future supervision, we propose a self-supervised velocity attack that directly disrupts the early denoising dynamics of the model. Second, to ensure the attack generalizes across unpredictable user actions, we formulate a trajectory-adaptive bi-level optimization that actively mines hard control sequences to forge control-agnostic perturbations. Evaluated on representative VWMs with continuous and discrete controls, BadWorld exposes severe structural fragility. Visually indistinguishable adversarial images reliably trigger catastrophic degradation in future rollouts, leading to incomplete denoising, structural collapse, and control inconsistency. These findings reveal critical risks for deploying VWMs in safety-critical systems while highlighting a practical mechanism for privacy protection.

[209] Transformation-driven generation of comparable projection images from multimodal anatomical scenes cs.CVPDF

Dariusz Pojda, Krzysztof Domino, Michał Tarnawski, Agnieszka Anna Tomaka

TL;DR: 本文提出了一种基于变换驱动的框架，用于从多模态解剖数据生成可比较的投影图像，特别针对下颌运动等场景。该框架将投影成像视为对显式表示的解剖场景的观测过程，通过独立变换的体数据和表面模型在共享场景中生成虚拟投影，强调方法的可控性和可重复性。

Details

Motivation: 解决从经历独立空间变换的异质解剖场景中生成可重复、可比较的投影图像的计算问题，传统数字重建放射影像方法主要关注配准、真实感或渲染效率，而本方法旨在为研究解剖-投影关系提供可控的方法学环境。

Result: 论文在颅面分析相关的下颌运动和治疗性重新定位场景中进行了演示，使用由CT/CBCT体积、分割结构、表面模型和辅助对象组成的共享解剖参考场景，生成了具有直接可比性的VirtualRTG投影。

Insight: 创新点在于将投影成像建模为对显式解剖场景的观测过程，允许独立变换的解剖对象在共享表示中直接传播到投影空间，从而在保持成像假设一致的前提下，实现生成投影的可控性、可重复性和直接可比性，适用于研究运动可观测性和变换感知的成像工作流。

Abstract: This work addresses the computational problem of generating reproducible projection-space observations from heterogeneous anatomical scenes whose components may undergo independent spatial transformations. We propose a transformation-driven framework for synthetic projection imaging from multimodal anatomical data and demonstrate it on mandibular-motion scenarios. In contrast to conventional Digitally Reconstructed Radiograph (DRR) approaches primarily designed for registration, projection realism, or rendering efficiency, the proposed formulation treats projection imaging as an observation process operating on an explicitly represented anatomical scene. Independently transformable volumetric and surface-based anatomical objects are embedded within a shared scene representation and propagated directly into projection space through explicit transformations. Projection geometry, acquisition modelling, material interpretation, and image presentation remain explicitly separated, enabling controlled exploration of methodological assumptions while preserving reproducibility and direct comparability between generated projections. Particular emphasis is placed on transformation-driven anatomical scenarios relevant to craniofacial analysis, including mandibular motion and therapeutic repositioning. Using a shared anatomical reference scene composed of CT/CBCT volumes, segmented structures, surface models, and auxiliary anatomical or therapeutic objects, the framework enables generation of directly comparable VirtualRTG projections from multiple anatomical configurations while preserving identical imaging assumptions. Rather than aiming at fully physically faithful radiographic simulation, the proposed approach provides a controllable and reproducible methodological environment for studying anatomy–projection relationships, motion observability, and transformation-aware imaging workflows.

[210] LOCUS: Local Visual Cue Search for Enhancing Fine-Grained Perception in Multimodal Large Language Models cs.CVPDF

Zhou Tao, Fang Zhang, Zewen Ding, Shida Wang, Xiaokun Sun

TL;DR: 本文提出LOCUS训练框架，通过代理任务训练多模态大语言模型学习局部视觉线索搜索，以增强细粒度视觉感知能力。该方法在训练时提供局部裁剪作为视觉提示，优化模型在全图中恢复其空间位置，从而缓解视觉上下文冗余导致的细粒度感知不可靠问题。

Details

Motivation: 多模态大语言模型在细粒度视觉感知上不可靠，即使高分辨率输入保留了必要细节，关键证据可能因冗余视觉上下文而未被有效选择和使用，即视觉上下文退化问题。

Result: 在细粒度感知、幻觉、通用理解和推理基准测试中，LOCUS提升了定位敏感的视觉理解能力，同时保持了广泛能力；注意力分析表明模型更聚焦于任务相关证据区域。

Insight: 创新点在于通过可验证的代理任务（基于IoU奖励的局部裁剪空间恢复）内化细粒度证据选择，仅训练时使用视觉提示而不改变标准推理接口，实现了从外部提示到内部能力的内化迁移。

Abstract: Multimodal Large Language Models (MLLMs) remain unreliable on fine-grained visual perception, even when high-resolution inputs preserve the necessary local details. We identify this limitation as visual context rot: decisive evidence may exist in the full image, yet fail to be reliably selected and used amid redundant visual context. We propose LOCUS (LOcal visual CUe Search), a training framework that teaches MLLMs to internalize local evidence search through a verifiable proxy task. During training, LOCUS provides a local crop as a visual cue and optimizes the model to recover its spatial support in the full image using an IoU-based reward. The visual cue is used only during training, leaving the standard image-question inference interface unchanged. Experiments across fine-grained perception, hallucination, general understanding, and reasoning benchmarks show that LOCUS improves localization-sensitive visual understanding while preserving broad capabilities. Attention analyses further indicate stronger focus on task-relevant evidence regions, suggesting that training-time visual cue search provides an effective route to internalized fine-grained evidence selection.

[211] PROSE: Training-Free Egocentric Scene Registration with Vision-Language Models cs.CV | cs.ROPDF

Zhiang Chen, Nahyuk Lee, Boyang Sun, Taein Kwon, Marc Pollefeys

TL;DR: PROSE是一种无需训练、基于视觉语言模型的自我中心场景配准方法，它利用预训练的VLM进行场景理解和跨扫描匹配，通过构建对象级3D场景图并匹配对象实例来实现RGB序列的配准。

Details

Motivation: 解决在仅有RGB输入、自我中心视角下（如头戴相机拍摄的模糊、快速移动、部分重叠视图）的室内场景配准问题，传统方法依赖干净点云而学习型方法需要预建图或标注数据，这些在自我中心数据中均不适用。

Result: 在自我中心的Aria Digital Twin和Aria Everyday Activities基准测试中，PROSE在配准精度上优于几何和基于学习场景图的基线方法，无论是基于真实点云还是RGB重建点云，且其生成的场景图可直接用于下游任务。

Insight: 创新点在于利用预训练视觉语言模型作为场景理解和匹配的核心，无需额外学习参数、深度传感器、训练或标注图；通过对象高度作为先验、配对查询验证匹配，并结合几何一致性选择最优变换，实现了高效且鲁棒的配准。

Abstract: Registering two captures of the same indoor space taken at different times underpins persistent spatial memory for robots and AR systems, yet the realistic version of this task is egocentric and its most scalable form is RGB-only. Head-mounted cameras yield blurry, fast-moving, partially overlapping views from which dense geometry is hard to recover. Classical registration leans on exactly the clean point clouds this setting lacks, while learned scene-graph methods require a pre-built or annotated graph and a trained matcher that we find brittle under egocentric data. We take a different route, using a pretrained vision-language model as the source of both scene understanding and cross-scan matching. Our method, PROSE (Prompted Scene rEgistration), lifts each RGB sequence into an object-level 3D scene graph using off-the-shelf foundation models for geometry, segmentation, and language, then prompts the same VLM to match object instances across the two RGB sequences. To make this matching tractable and reliable, we leverage object heights as a prior and verify each proposed match with a paired same/different query, then solve for the rigid transform by hypothesizing a candidate per matched object and selecting the one with the strongest geometric consensus. PROSE adds no learned parameters and requires no depth sensor, training, or annotated graph. On the egocentric Aria Digital Twin and Aria Everyday Activities benchmarks, it outperforms both geometric and learned scene-graph baselines in registration accuracy, on ground-truth and RGB-reconstructed point clouds alike, and the scene graph it produces transfers directly to downstream tasks.

[212] DifferAD-R1: A Difference-Guided IndustrialAnomaly Localization with Multimodal LargeLanguage Models cs.CVPDF

Dingrong Wang, Xian Tao, Zhen Qu, Hengliang Luo, Xinyi Gong

TL;DR: 本文提出DifferAD-R1，一种基于多模态大语言模型（MLLM）增强的强化学习框架，用于工业异常定位。该方法通过设计差异引导的双图像范式，将定位任务重新定义为一次性差异接地问题，并引入双一致性定位奖励和难度感知策略来优化对细微缺陷的检测。在构建的AD-DualDiff数据集上，该方法显著优于现有基线，并与大规模模型（如Qwen3-VL）性能相当。

Details

Motivation: 解决工业异常定位中传统闭集方法跨场景泛化能力差，以及现有基于MLLM的方法存在的两个核心局限：要么采用与定位实际需求不匹配的问答式范式，要么依赖标准优化技术（如GRPO）无法为细微缺陷提供有效学习信号。

Result: 在包含20个类别、13K对图像的AD-DualDiff数据集上的实验结果表明，DifferAD-R1显著优于现有基线，并与Qwen3-VL（235B参数）等大规模模型相比具有竞争力。

Insight: 创新点包括：差异引导的双图像范式将定位任务重构为一次性差异接地问题；双一致性定位奖励增强了对难检测异常的优化稳定性和鲁棒性；难度感知策略通过自适应重加权和分组重采样优先学习挑战性实例。从客观角度看，该方法将MLLM与强化学习结合，并专注于差异比较，为工业缺陷检测提供了新的有效范式。

Abstract: Industrial anomaly localization aims to accurately identify and localize abnormal regions in industrial products, addressing the critical challenge of detecting unseen defect categories in real-world scenarios. Traditional closed-set methods often suffer from poor cross-scenario generalization, while existingMultimodal Large Language Model (MLLM)-based approachesface two core limitations: they either adopt QA-style paradigmsmisaligned with the practical demands of localization, or relyon standard optimization techniques such as Group RelativePolicy Optimization (GRPO), which fails to deliver effectivelearning signals for subtle defects. To tackle these issues, thispaper proposes DifferAD-R1, an MLLM-augmented reinforcement learning framework tailored for industrial anomaly localization. We design a Difference-Guided dual-image paradigm,which reformulates the localization task as a one-shot difference grounding problem to effectively explore cross-scenarioanomalies. A Dual-Consistency Localization Reward is developedfor hard-to-detect anomalies, enhancing optimization stabilityand robustness. Additionally, we integrate a difficulty-awarestrategy with adaptive reweighting and group-wise resamplingto prioritize learning on challenging instances. To facilitateevaluations in real-world industrial settings, we construct theAD-DualDiff dataset, comprising 13K paired images across 20categories. Experimental results demonstrate that DifferADR1 significantly outperforms existing baselines and achievescompetitive performance compared to large-scale models likeQwen3-VL (235B parameters). Our code is publicly availableat: https://github.com/Rong2026/work-1.

[213] MVM-IOD: An Industrial Object-Centric Benchmark Dataset for the Evaluation of 3D Reconstruction Methods cs.CVPDF

Robert Langendörfer, Markus Hillemann, Markus Ulrich

TL;DR: 该论文提出了一个名为MVM-IOD的工业对象中心基准数据集，用于评估3D重建和相机姿态估计方法。该数据集通过工业机器人臂系统性地采集了9个典型工业物体在2种背景下的18个场景的RGB图像，并提供了参考相机姿态和3D点云真值。基于此数据集，论文对当前SOTA方法（如运动恢复结构、多视图立体、前馈方法及2D高斯泼溅）进行了广泛评估，发现前馈方法在处理此类分布外图像时性能下降，但可通过简单预处理改善。

Details

Motivation: 现有数据集大多未描绘真实的工业场景，而工业应用中的3D物体重建和相机姿态估计任务因物体复杂、误差成本高且计算时间有限而极具挑战，因此需要构建一个更贴近现实的工业基准数据集。

Result: 在MVM-IOD数据集上评估了多种SOTA方法，发现前馈方法（如Visual Geometry Grounded Transformer, π3）对分布外图像敏感，导致生成的点云和相机姿态欠佳，但通过预处理可提升性能；论文为未来研究提供了基线结果。

Insight: 创新点在于构建了一个系统采集、包含参考真值的工业对象中心数据集，填补了现有基准的空白；客观分析表明，该研究揭示了前馈方法在工业场景中的分布外泛化问题，并提出了简单的预处理缓解策略，对工业视觉应用具有重要借鉴意义。

Abstract: 3D object reconstruction, and camera pose estimation in industrial applications are challenging tasks, as errors are costly while the computation time is often limited. The complexity of typical industrial objects further complicates these tasks. Most of the existing datasets in this context do not depict realistic industrial scenarios. Therefore, we introduce the Machine Vision Metrology Industrial Object Dataset (MVM-IOD). Images of typical industrial objects are captured systematically, by moving a camera, mounted at the end effector of an industrial robot arm, on a hemisphere around the objects. MVM-IOD contains reference camera poses and reference 3D point clouds, the acquired RGB images of 9 objects and 2 background choices resulting in 18 scenes, which allows evaluation of all image based methods that compute a 3D reconstruction, camera poses, or novel views of a scene. Based on MVM-IOD, we extensively evaluate current SOTA 3D reconstruction and camera pose estimation methods, such as Structure from Motion, Multi-View Stereo, recent feed forward methods (Visual Geometry Grounded Transformer, π3), and 2D Gaussian Splatting and report our findings as a baseline for future research. The experiments show that capture setups like ours generate out-of distribution images for feed forward methods, leading to suboptimal point clouds and camera poses. However, these out-of-distribution images can be shifted closer to the training distribution by applying simple preprocessing steps. Consequently, in certain industrial applications, feed forward methods should be used with caution.

[214] SUP-MCRL: Subject-aware Unified Pseudo-feature Coded Multimodal Contrastive Representation Learning for EEG Visual Decoding cs.CVPDF

Shengyu Gong, Weiming Zeng, Yueyang Li, Zijian Kang, Hongjie Yan

TL;DR: 本文提出SUP-MCRL，一种用于脑电图视觉解码的主题感知统一伪特征编码多模态对比表征学习框架。该框架通过三个协作机制解决现有方法在泛化到自然视觉体验时存在的保真度下降和虚假零样本对齐问题，在THINGS-EEG数据集上实现了优异的零样本分类准确率。

Details

Motivation: 解决非侵入式脑机接口在神经视觉解码中，当泛化到自然视觉体验时，因传统多模态对比学习仅优化几何距离对齐而忽略语义一致性和主体选择性，导致虚假零样本对齐的保真度严重下降问题。

Result: 在THINGS-EEG数据集上的零样本实验取得了66.0%/91.9%（Top-1/Top-5）的受试者内准确率和24.0%/52.9%的留一受试者（LOSO）准确率，超越了现有最先进方法。

Insight: 创新点在于集成了三个协作机制：无需预训练显著性模型的语义实体感知视觉编码器（SAVE）、用于自适应跨主体鲁棒性的统一EEG增强器（UEE），以及防止表征崩溃的基于原型的渐进增强器（PPA），共同实现了对语义一致性和主体选择性的建模，提升了零样本泛化能力。

Abstract: Non-invasive brain-computer interfaces suffer severe fidelity degradation in neural visual decoding when generalizing to natural visual experiences. Conventional multimodal contrastive representation learning solely optimizes geometric distance alignment, neglecting semantic consistency and subject selectivity, causing spurious zero-shot alignment. We propose SUP-MCRL, a unified framework integrating three collaborative mechanisms: (1) Semantic-entity Aware Visual Encoder (SAVE), learning spatial attention to extract semantic content without pre-trained saliency models; (2 Unified EEG Enhancer (UEE), employing multi-scale atrous convolutions and inter-band attention for adaptive cross-subject robustness; and (3) Prototype-based Progressive Augmenter (PPA), maintaining an EMA-updated pseudo-feature pool to prevent representation collapse. Zero-shot experiments on THINGS-EEG achieve 66.0%/91.9% (Top-1/Top-5) intra-subject and 24.0%/52.9% LOSO accuracy, surpassing state-of-the-art methods. Code is available at https://github.com/NZWANG/SUP-MCRL.

[215] DCP-Prune: Ultra-Low Token Pruning with Distribution Consistency Preservation cs.CV | cs.AIPDF

Xifeng Xue, Xiaokang Wang, Zirui Li, Ming-Ming Cheng, Guolei Sun

TL;DR: 本文提出了一种名为DCP-Prune的超低令牌剪枝方法，旨在解决现有视觉令牌剪枝方法在极低令牌预算下性能不稳定的问题。该方法通过引入一个轻量级的分布一致性度量来评估保留令牌与完整令牌之间的分布偏移，并设计了一个包含锚点-上下文图恢复（ACGR）和文本感知令牌聚类选择（TATCS）的两阶段剪枝框架，以在剪枝过程中保持特征分布的一致性。

Details

Motivation: 现有视觉令牌剪枝方法在中等令牌预算下能有效保持模型性能，但在极低令牌预算下变得不稳定。作者分析发现，随着剪枝预算降低，精度下降往往伴随着更大的特征分布偏移，且这种分布偏移的程度与性能下降强相关。

Result: 在LLaVA-1.5-7B模型上，仅使用16个视觉令牌时，该方法保留了上限平均性能的92.1%，在极低令牌预算下实现了优越且更稳定的性能。

Insight: 创新点在于引入了分布一致性度量来量化剪枝引起的分布偏移，并提出了一个两阶段剪枝框架（ACGR和TATCS），前者在令牌移除前传递上下文信息，后者在检测到严重分布偏移时动态重新选择代表性令牌，从而在超低预算下维持性能稳定性。

Abstract: Recent vision token pruning methods effectively preserve model performance under moderate token budgets but become unstable under ultra-low token budget. Our analysis shows that as the pruning budget decreases, accuracy degradation is often accompanied by larger feature distribution shifts. Critically, the degree of this distribution shift strongly correlates with performance degradation. To better characterize this phenomenon, we introduce a lightweight distribution consistency metric to estimate the distribution shift between retained and full tokens. Motivated by these observations, we propose a two-stage pruning framework consisting of Anchor-Context Graph Recovery (ACGR) and Text-Aware Token Cluster Selection (TATCS). Specifically, ACGR transfers contextual information before token removal, while TATCS dynamically re-selects representative tokens when severe distribution shift is detected. Extensive experiments demonstrate that our method achieves superior and more stable performance under ultra-low token budget. Notably, it retains 92.1% of the upper-bound average performance on LLaVA-1.5-7B with only 16 visual tokens.

[216] Look Again Before You Abstain:Budgeted Conformal Evidence Acquisition for Reliable Vision-Language Model cs.CVPDF

Jian Xu, Delu Zeng, John Paisley, Qibin Zhao

TL;DR: 本文提出了一种名为预算化共形证据获取（BCEA）的方法，旨在解决大型视觉语言模型（LVLM）的幻觉问题。该方法通过引入第三种选择——在回答和弃权之外，允许在有限计算预算下重新检查图像（如缩放、裁剪或特定干预）以获取额外视觉证据，从而在保证统计可靠性的同时减少不必要的弃权。

Details

Motivation: 现有基于共形预测的选择性预测方法虽然能提供无分布保证，但为控制幻觉率（如低于5%）需要弃权大量声明（如超过80%），导致资源浪费。作者认为当获取额外视觉证据成本较低时，这种弃权是低效的，因此需要一种更灵活的证据获取机制。

Result: 在POPE基准和基于COCO构建的存在性与空间关系声明数据集上，对四种开源视觉语言模型的实验表明，BCEA能够将幻觉率控制在目标水平（如5%），并相比仅保证弃权的基线方法持续提高了覆盖率（即回答更多声明）。

Insight: 创新点在于将证据获取作为第三选项纳入共形框架，并通过将整个获取策略整合到评分函数中并重新校准，解决了直接插入证据获取步骤会破坏交换性并导致统计保证失效的问题（风险可能超出目标高达17个百分点）。此外，BCEA采用了针对声明类型的结构化干预，增强了实用性。

Abstract: Large vision-language models (LVLMs) hallucinate: they assert visual details that the image does not support. A principled remedy is selective prediction with a distribution-free guarantee-verify each claim and abstain when the claim is not grounded, so that the hallucination rate among asserted claims is provably bounded. We show, however, that this guarantee is bought at a brutal price: to keep the hallucination rate below $5%$ on a balanced object-existence benchmark, a state-of-the-art conformal filter must abstain on more than $80%$ of claims. We argue that abstention is wasteful when more visual evidence is cheaply available, and introduce Budgeted Conformal Evidence Acquisition (BCEA), which replaces the binary answer/abstain decision with a three-way choice: answer, abstain, or acquire additional visual evidence by re-examining the image (zooming, cropping, or applying a claim-specific intervention) under a bounded compute budget. We make two observations. First, acquisition that is plugged naively into a calibrated filter breaks the statistical guarantee – realized risk overshoots the target by up to $17$ points – because the acquisition step destroys the exchangeability that conformal calibration relies on. Second, folding the entire acquisition policy into the score function and re-calibrating on post-acquisition scores \emph{restores} the finite-sample guarantee while still recovering coverage. BCEA further uses structured, claim-type-specific interventions. Across the POPE benchmark and COCO-constructed existence and spatial-relation claims, on four open VLMs, BCEA controls the hallucination rate at the target level and consistently improves coverage over a guaranteed-abstention baseline.

Yagmur Akarken, Orest Kupyn, Christian Rupprecht

TL;DR: 本文提出了MMDiff框架，将冻结的扩散变换器扩展为多模态生成系统，通过轻量级解码器头联合生成图像及密集感知模态（如语义分割、深度估计等）。核心发现是感知信息在去噪轨迹中随时间分布，多时间步特征融合与空间变化聚合权重至关重要，能显著提升语义分割性能。

Details

Motivation: 扩散变换器在生成过程中计算了丰富的感知表示，但这些表示在内容渲染后被丢弃；本文旨在利用这些表示，将单模态扩散模型转化为多模态生成系统，以联合生成图像和多种密集感知输出。

Result: 在冻结骨干网络上仅训练轻量级解码器头，在语义分割、显著目标检测和深度估计任务上取得了强劲性能，其中语义分割的mIoU比单时间步提取提升了高达28.7%，并与DINOv3等先进编码器竞争且互补。

Insight: 创新点包括揭示去噪轨迹中感知信息的时间分布特性，提出多时间步特征融合与空间变化聚合权重方法，以及采用概念驱动的注意力提取进行可解释的空间引导；这为利用预训练扩散模型进行高效多模态生成和数据合成提供了新思路。

Abstract: Diffusion transformers have demonstrated remarkable generative capabilities, yet the rich perceptual representations computed across their denoising trajectory are discarded once the content is rendered. We present MMDiff, a framework that transforms a frozen diffusion transformer into a multi-modal generative system that jointly produces images alongside any combination of dense perceptual modalities using lightweight decoder heads. Our central finding is that perceptual information is temporally distributed along the denoising trajectory, and that multi-timestep feature fusion with spatially varying aggregation weights is essential, improving semantic segmentation results by up to 28.7% mIoU over single-timestep extraction. We further adopt concept-driven attention extraction for interpretable spatial guidance, and show that frozen diffusion features are competitive with and complementary to state-of-the-art encoders such as DINOv3. By training only lightweight decoder heads on a frozen backbone, we achieve strong performance in semantic segmentation, salient object detection, and depth estimation, and demonstrate that this framework enables effective synthetic data generation at scale.

[218] Vision-Language Models as Zero-Annotation Oracles in Histopathology cs.CVPDF

Vishal Jain, Giorgio Buzzanca, Sarah Cechnicka, Maarten Naesens, Priyanka Koshy

TL;DR: 本文提出了一种利用通用视觉语言模型作为零标注预言机，解决计算病理学中前景分割任务的方法。该方法采用由粗到细的策略，将前景分割重新定义为视觉感知任务，在专门构建的Leica-75基准测试上，对分布外染色（如Jones、EVG）实现了最高的分割质量，并显著降低了跨染色方差。此外，通过自动上下文提示和基于VLM的标注审查，方法能处理困难案例并匹配专家共识，最终通过知识蒸馏得到轻量高效的学生模型。

Details

Motivation: 计算病理学流程中的前景分割是关键步骤，但现有方法依赖手动调整的启发式规则或监督模型，这些模型过度拟合于狭窄的染色和扫描仪分布，在特殊染色（如Jones银染、EVG）上会无声地失败。

Result: 在Leica-75基准测试（包含75张肾移植全切片图像，涵盖三种染色家族）上，该方法在分布外染色（Jones和EVG）上取得了最高的分割质量（Dice系数分别为0.858和0.853），其跨染色方差比最佳监督基线低7倍，同时在分布内H&E染色上保持竞争力。在Stress-32压力测试子集上，通过自动上下文提示将困难案例的分割性能从Dice 0.470提升至0.819。VLM标注审查与人类专家共识高度一致（模糊检测的kappa系数为0.989；分割掩码审查的平均精度/召回分级准确率为0.708，人类为0.646）。

Insight: 核心创新点在于将组织与背景的区分重新定义为自然图像识别问题，而非组织病理学特定问题，从而利用在互联网规模语料上训练的通用视觉语言模型实现零标注泛化。方法框架结合了由粗到细分割、自动上下文提示、VLM标注审查和知识蒸馏，为数字病理学中的基础设施瓶颈提供了一个原则性、可扩展的解决方案。

Abstract: Foreground segmentation is the critical first step of every computational pathology pipeline, yet existing methods rely on hand-tuned heuristics or supervised models that overfit to narrow stain and scanner distributions, failing silently on specialised stains such as Jones silver or Elastica van Gieson. We propose a coarse-to-fine approach that recasts foreground segmentation as a visual perception task and leverages general-purpose vision-language models (VLMs) as zero-annotation oracles. Our key insight is that tissue-versus-background discrimination is a natural-image recognition problem, not a histopathological one, so VLMs trained on internet-scale corpora generalise where domain-specific models cannot. We introduce Leica-75, a benchmark of 75 renal transplant whole-slide images spanning three stain families. On Leica-75, our method achieves the highest segmentation quality on out-of-distribution stains (Dice 0.858 +/- 0.027 on Jones, 0.853 +/- 0.041 on EVG) with 7x lower cross-stain variance than the best supervised baseline, while remaining competitive on in-distribution H&E. Few-shot prompting with automatically curated exemplars (Auto-context) rescues hard cases on Stress-32 (n=32), a curated stress-test subset (Dice 0.470 to 0.819 for the 2B model). VLM-based annotation review matches human expert consensus (kappa=0.989 for blur detection; mean precision/recall grading accuracy 0.708 vs. human 0.646 for segmentation mask review). The resulting pseudo-labels are used to distil lightweight student models that are as performant as the teacher model while running for a fraction of the cost. Our framework provides a principled, scalable solution to a persistent infrastructure bottleneck in digital pathology.

[219] Revealing Artifacts via Noise Amplification: A Novel Perspective for AI-Generated Video Detection cs.CV | cs.AIPDF

Renxi Cheng, Jie Gui, Hongsong Wang

TL;DR: 本文提出了一种名为噪声放大的新方法，用于检测AI生成的视频，特别是文本到视频模型生成的视频。该方法从位平面的新颖视角出发，通过提取、放大噪声信号，并将其输入判别器网络进行分类，有效解决了AI生成视频检测的难题。

Details

Motivation: 随着视频生成模型的快速发展，区分AI生成视频与真实视频变得日益困难。现有研究多集中于检测生成对抗网络生成的样本，而针对文本到视频模型生成的视频检测仍是一个未充分探索的领域。

Result: 在大规模数据集GenVidBench和提出的HardGVD基准测试上进行的广泛实验表明，该方法显著优于现有最先进的方法。

Insight: 论文的创新点在于从位平面的角度出发，通过噪声放大技术（包括像素级强度增强、区域级空间放大和帧级时间聚合）来揭示AI生成视频中的伪影，为视频伪造检测提供了新的视角和简单有效的解决方案。

Abstract: With the rapid advancement of video generation models, distinguishing between AI-generated and authentic videos has emerged as a challenging endeavor. The majority of existing research endeavors concentrate on the development of detectors for identifying samples generated by generative adversarial networks. Nevertheless, the detection of AI-generated videos, particularly those produced by text-to-video models, still remains an uncharted territory. Although state-of-the-art text-to-video models can generate realistic visual content similar to real videos, they fall short of generating the details of the images and the changes in details within the videos. Inspired by this, we address AI-generated video detection from a novel perspective of bit-planes, which can effectively describe the details or noises in images or videos. To this end, we propose a simple yet effective approach called Noise Amplification. This approach first extracts noise signals based on bit-planes, then amplifies these noise signals, and finally feeds them into the discriminator networks for video fake classification. Noise amplification is comprehensively constructed by incorporating three aspects: pixel-level intensity enhancement, region-level spatial amplification, and frame-level temporal aggregation. To evaluate methods of AI-generated video detection in challenging scenarios, we also introduce a benchmark named HardGVD. Extensive experiments on both the large-scale dataset GenVidBench and HardGVD show that our simple approach significantly outperforms state-of-the-art methods.

[220] Structure-aware Knowledge-guided Heterogeneous Mamba for Zygomaticomaxillary Suture Assessment cs.CVPDF

Xiaoqi Guo, Birui Chen, Xinquan Yang, Chaoyun Zhang, Xuefen Liu

TL;DR: 本文提出了首个公开的颧颌缝数据集（ZMS），包含3790张覆盖4至24岁年龄范围的图像，并基于此提出了SKMamba模型，这是一个用于自动评估颧颌缝成熟度的结构感知与知识引导的Mamba多模态框架。该模型采用解耦的双路径架构，模仿了正畸专家的分层诊断过程，通过隐式边缘提取器增强结构边界，并利用跨模态语义对齐模块整合大语言模型的解剖学知识。

Details

Motivation: 颧颌缝的成熟度评估对正畸干预时机和效果至关重要，但由于缝线处细微的高频过渡以及相邻阶段间的全局语义模糊性，其准确分期仍然具有挑战性。

Result: 在提出的ZMS数据集上进行的大量实验表明，SKMamba模型相比现有方法取得了最先进的性能。

Insight: 主要创新点在于：1) 构建了首个公开的ZMS数据集；2) 提出了结合Mamba架构、结构感知预训练（隐式边缘提取器）和知识引导（跨模态语义对齐模块）的多模态框架，将局部形态学证据与全局语义描述对齐，同时确保客观形态证据是决策的主要依据。

Abstract: The Zygomaticomaxillary Suture is a key circummaxillary structure that connects the zygomatic bone and the maxilla, which serves as a primary site of resistance during maxillary advancement, and its maturation status directly influences the timing and efficacy of orthopedic interventions. However, accurate staging of ZMS maturation remains challenging due to subtle high-frequency transitions in suture lines and the global semantic ambiguity between adjacent stages. To address this, we present the first public ZMS dataset, comprising 3,790 ZMS images covering the entire age range from 4 to 24 years. Based on this dataset, we propose SKMamba, a Structure-aware and Knowledge-guided Mamba-based multi-modal framework for automated ZMS maturation assessment. SKMamba adopts a decoupled dual-path architecture that mimics the hierarchical diagnostic process used by experienced orthodontists. We first introduce an Implicit Edge Extractor (IEE), which leverages structural pre-training to reduce trabecular noise and accentuate sutural boundaries. Complementarily, a Cross-Modal Semantic Alignment (CSA) module is designed to incorporate anatomical descriptions from a large language model (LLM). This module helps align local morphological cues with global semantic descriptions while ensuring that objective morphological evidence remains the primary basis for decisions. Extensive experiments on our ZMS dataset demonstrate that SKMamba achieves state-of-the-art performance compared to existing methods. Code is available at https://github.com/galaxygxq1116/SKMamba.

[221] 3D Classification of Paramagnetic Rim Lesions in Multiple Sclerosis via Asymmetric QSM-FLAIR Modeling cs.CVPDF

Veronica Pignedoli, Giacomo Boffa, Nicoletta Noceti, Matilde Inglese, Francesca Odone

TL;DR: 本文提出了一种用于多发性硬化症中顺磁性边缘病变（Rim⁺）三维分类的深度学习框架，通过非对称QSM-FLAIR建模，利用定量磁化率成像作为主要信号源，并以FLAIR MRI提供结构背景进行条件化处理，旨在实现病变级别的自动分类。

Details

Motivation: 顺磁性边缘病变是慢性活动性炎症的特异性生物标志物，但现有基于磁敏感成像的视觉评估耗时、主观且受限于专业中心，同时病变的低患病率导致自动化分析面临严重的类别不平衡挑战。

Result: 在包含88名多发性硬化症患者的临床队列中，以专家病变标注为金标准进行评估，该方法相比先前架构表现出性能提升，支持了非对称多模态建模在自动识别慢性活动性病变中的有效性。

Insight: 创新点在于明确建模了模态不对称性，将QSM作为主要驱动信号并与FLAIR结构背景条件化结合；同时采用自监督多模态预训练结合对比正则化的监督微调，以提升数据有限下的鲁棒性，为医学影像中的类别不平衡问题提供了解决方案。

Abstract: Paramagnetic rim lesions (Rim$^+$) identified on susceptibility-sensitive MRI have recently emerged as a specific biomarker of chronic active inflammation in Multiple Sclerosis (MS) and are associated with long-term disability progression. However, susceptibility imaging and expert interpretation remain limited to specialized centers, visual assessment is time-consuming and variable, and the low prevalence of Rim$^+$ lesions poses severe class imbalance challenges for automated analysis. We propose a 3D multimodal deep learning framework for lesion-level Rim$^+$/Rim$^-$ classification from Quantitative Susceptibility Mapping (QSM) and FLAIR MRI. The architecture explicitly models modality asymmetry by treating QSM as the primary susceptibility-driven signal and conditioning it with FLAIR-derived structural context. To improve robustness under limited data, we employ self-supervised multimodal pretraining followed by supervised fine-tuning with contrastive regularization. The method was evaluated on a clinically acquired cohort of 88 people with MS with expert lesion annotations as reference standard. Results highlight improved performance compared to prior architectures, supporting the effectiveness of asymmetric multimodal modeling for automated chronic active lesion identification.

[222] Text-Vision Co-Instructed Image Editing cs.CVPDF

Chenxi Xie, Yuhui Wu, Qiaosi Yi, Lei Zhang

TL;DR: 本文提出了文本-视觉协同指导的图像编辑方法TV-Edit，通过联合建模文本指令的语义意图和稀疏视觉指令（如拖拽或点）的空间引导，旨在实现精确且忠实于意图的图像操作。该方法构建了一个包含超过23K样本的文本-视觉指令配对数据集，并设计了一个统一的编辑框架，将视觉指令与图像-文本语义结合，提升为语义感知的控制表示，以驱动预训练的编辑骨干网络。

Details

Motivation: 现有图像编辑方法分为基于文本指令和基于视觉提示两类，前者语义表达性强但空间控制粒度粗，后者（如拖拽、点）能提供精确空间引导但语义意图存在固有模糊性。本文旨在统一文本和视觉提示的优势，实现精确且意图忠实的图像操控。

Result: 实验在多个编辑骨干网络上进行，结果表明TV-Edit能持续产生更精确、更忠实于意图的编辑效果，在语义忠实性、空间对齐和视觉一致性方面显著优于最先进的基于指令和基于拖拽的基线方法。作者还建立了TV-Edit-Bench基准进行可靠评估。

Insight: 核心创新在于将文本指令的语义意图与稀疏视觉指令的空间约束进行联合建模，通过构建跨模态对齐的指令配对数据集，并设计统一的框架将视觉提示提升为语义感知的控制表示，从而在预训练编辑模型中实现了语义与空间控制的更好统一，减少了指令模糊性并增强了结构一致性。

Abstract: Existing image editing methods can be generally categorized into textual instruction-based and visual prompt-based ones. Textual instructions are semantically expressive, but are limited by the coarse granularity of spatial control of the editing results. In contrast, visual prompts such as drag and point can provide precise spatial guidance, but are limited by the inherent ambiguity in semantic intent. To unify the strength of textual and visual prompts, we present Text-Vision Co-Instructed Image Editing, which jointly models textual instructions as semantic intent and sparse visual instructions as spatial guidance, aiming to achieve precise and intent-faithful image manipulation. To this end, we first construct a textual-visual instruction paired dataset with more than 23K samples derived from dynamic videos, enabling aligned supervision for cross-modal instruction. We then propose TV-Edit, a Textual-Visual instruction unified Editing framework to contextualize drag or point-based visual instructions with image-text semantics and lift them into semantic-aware control representations for pretrained editing backbones. By integrating semantic intent and spatial constraints, TV-Edit leads to more precise spatial control, less instruction ambiguity, and stronger structural consistency than text-only or drag-based alternatives. Finally, we establish TV-Edit-Bench, a deliberately designed benchmark to evaluate semantic faithfulness, spatial alignment, and visual consistency with ground-truth references and controlled textual-visual variations for reliable assessment. Our experiments across multiple editing backbones demonstrate that TV-Edit consistently yields more precise and intent-faithful edits, significantly outperforming state-of-the-art instruction-based and drag-based baselines.

[223] Gen-VCoT: Generative Visual Chain-of-Thought Reasoning via Diffusion-Based RGB Intermediate Representations cs.CV | cs.AI | cs.LGPDF

Zhiqiang Zhou, Junliang Dai, Xu ling

TL;DR: Gen-VCoT提出了一种基于扩散模型生成RGB图像作为中间表示的生成式视觉思维链推理框架，以增强多模态大语言模型的可解释性。它通过SAM分割、Marigold深度估计和Qwen2-VL集成三个阶段进行视觉定位、几何和语义推理，并采用自适应路由器选择推理深度。

Details

Motivation: 现有MLLMs依赖文本思维链进行视觉推理，缺乏可解释的视觉中间表示，而现有方法使用不透明的标记或外部工具，缺少关键特性。

Result: 在空间和深度问题上分别提升25%和50%，但在简单事实查询上可能表现不佳；在CLEVR基准上，文本思维链（91.2%）优于视觉中间表示（62.5%），表明最优表示取决于任务。

Insight: 创新点在于使用专家视觉模型生成RGB图像作为可解释的推理中间体，并引入自适应路由器动态调整推理深度，为可解释多模态推理建立了新范式，但揭示了视觉表示在特定任务上的局限性。

Abstract: Multimodal large language models (MLLMs) excel at visual reasoning but rely on text-based chain-of-thought (CoT), lacking interpretable visual intermediates. Existing methods use opaque tokens or external tools, missing key properties. We propose Gen-VCoT, a framework using expert vision models to generate RGB images as reasoning intermediates. It has three stages: visual grounding (SAM segmentation), geometric reasoning (Marigold depth maps), and semantic reasoning (Qwen2-VL integration). An adaptive router selects reasoning depth. Evaluations show Gen-VCoT improves spatial (25% better) and depth (50% better) questions, but may hurt simple factual queries. Text CoT outperforms visual intermediates on CLEVR (91.2% vs 62.5%), showing task-dependent optimal representations. Gen-VCoT establishes a new paradigm for interpretable multimodal reasoning.

[224] Semantic Flip: Synthetic OOD Generation for Robust Refusal in Embodied Question Answering and Spatial Localization cs.CV | cs.AIPDF

Dongbin Na, Chanwoo Kim, Giyun Choi, Dooyoung Hong

TL;DR: 本文提出了一种名为Semantic Flip的框架，用于增强具身智能体在视觉问答和空间定位任务中拒绝回答不可回答查询的能力。该框架通过独立变换查询和视频记忆来合成辅助的分布外样本，从而训练一个轻量级的拒绝模块，无需外部标注或重新训练预训练模型。

Details

Motivation: 解决现代视觉语言模型在面对视觉记忆不足的查询时过度自信的问题，避免在具身问答和空间导航等高风险任务中提供误导性信息或错误引导。

Result: 在两个互补的基准测试中，Semantic Flip持续优于强提示基线；在新提出的空间定位拒绝基准SpaceReject上，达到了0.9559的F1分数。

Insight: 创新点在于通过语义翻转合成分布外样本，无需外部标注即可训练拒绝模块；该方法可灵活附加到现有VLM流程上，提升了模型在不可回答查询下的鲁棒性。

Abstract: Detecting unanswerable user queries remains essential for the reliable deployment of real-world embodied agents. However, modern vision-language models (VLMs) often generate overly confident answers even when the available visual memory cannot support the query. Such overconfidence poses various task-dependent risks. The agent may provide misleading information to the user in Embodied Question Answering and select an arbitrary coordinate and physically guide the user there in spatial reasoning for navigation. Despite these high stakes, only a few prior studies directly address when and how an embodied VLM should respond with “I do not know.” This work proposes Semantic Flip, a simple yet effective framework that synthesizes auxiliary out-of-distribution (OOD) samples for embodied refusal without requiring external OOD annotations. The key idea is to independently transform the query and video memory to construct auxiliary OOD pairs that lack sufficient visual grounding. These synthesized pairs enable training a lightweight rejection module on top of a frozen pretrained VLM. The module attaches to any existing VLM-based pipeline without retraining the underlying model. Across two complementary benchmarks, Semantic Flip consistently outperforms strong prompting baselines. This work also introduces SpaceReject, a new refusal benchmark for spatial localization with deliberately unanswerable queries over long video memory, where Semantic Flip achieves an $F_1$ score of 0.9559. The source codes and datasets are publicly available at https://github.com/ndb796/SemanticFlip.

[225] Latent Space Reinforcement Learning for Inverse Material Estimation in Food Fracture Simulation cs.CV | cs.GRPDF

Adrian Ramlal, Yuhao Chen, John S. Zelek

TL;DR: 本文提出了一种基于潜在空间强化学习的逆材料估计方法，用于食物断裂模拟中的材料参数估计。通过训练一个目标条件化的PPO策略，在归一化流潜在空间中学习从任意目标断裂行为描述到材料参数的直接映射，实现了快速（约10ms）且无需重新训练的逆估计。结合CMA-ES优化器进行细化，进一步提升了参数恢复精度。

Details

Motivation: 食物操作的逼真视觉模拟需要准确的材料参数，但这些参数难以直接测量，且在单一食物的异质区域中存在差异。本文旨在解决非可微连续损伤力学模拟器中，从目标断裂行为描述逆向估计材料参数的问题。

Result: 在橙子剥皮测试案例中，目标条件化PPO策略在模拟器验证中实现了0.642的实际恢复率，比原始参数空间方法提升了23%。结合CMA-ES细化的热启动扩展方法将恢复率进一步提升至0.828（需540次评估）。

Insight: 创新点包括：1）使用目标条件化PPO策略学习通用的逆映射，实现单次前向传播的快速估计；2）在归一化流潜在空间中操作，降低优化维度并提升效率；3）结合强化学习与进化策略的混合框架，平衡速度与精度。这为基于视频观察的视觉驱动材料识别提供了实用框架。

Abstract: Realistic visual simulation of food manipulation requires accurate material parameters, yet these are difficult to measure directly and vary across the heterogeneous regions of a single food item. We address the inverse problem of estimating material parameters from a target description of fracture behavior in a non-differentiable continuum damage mechanics simulator. Using orange peeling as a test case, we train a neural surrogate on 2,000 forward simulations and compare Covariance Matrix Adaptation Evolution Strategy (CMA-ES, a gradient-free evolutionary optimizer) with Proximal Policy Optimization (PPO, a reinforcement learning algorithm) across the original 9-dimensional parameter space and two learned 4-dimensional latent representations. Since different oranges have different material properties, a practical inverse system must handle arbitrary targets without retraining. We train a goal-conditioned PPO policy that learns a general inverse mapping: given any target description of peeling behavior, the policy produces a material parameter estimate in a single forward pass (8 surrogate evaluations, approximately 10ms). Operating in a normalizing flow latent space with a shared surrogate evaluator, the goal-conditioned policy achieves 0.642 actual recovery when validated through the simulator, outperforming the original parameter space by 23%. A warm-start extension that initializes CMA-ES refinement from the policy’s output further improves recovery to 0.828 with 540 evaluations. These findings provide a practical framework for inverse food physics and lay groundwork for vision-driven material identification from video observations of food manipulation.

[226] Decoupling Semantics from Distortions: Multi-Scale Two-Stream Vision-Language Alignment for AI-Generated Image Quality Assessment cs.CV | cs.AIPDF

Zijie Meng

TL;DR: 本文提出了一种名为MST-CLIPIQA的多尺度双流框架，用于解决AI生成图像质量评估（AIGIQA）中语义与失真维度冲突的问题。该框架通过解耦表示，利用具有互补补丁粒度的双CLIP编码器分别捕获全局语义连贯性和细粒度纹理/伪影模式，并通过门控融合机制进行自适应跨尺度蒸馏，从而实现对图像质量和图文对应性的分层视觉-语言对齐。

Details

Motivation: 现有基于视觉-语言模型（VLM）的AIGIQA方法存在根本性的语义-失真维度冲突：为语义判别优化的单一表示会固有地将组合理解与低级感知敏感性纠缠在一起，导致其对细粒度的质量退化不敏感。

Result: 在五个基准测试上的广泛实验确立了新的最先进（SOTA）结果，在质量预测和图文对应性预测上分别实现了平均1.11%和2.35%的SRCC提升，同时仅需0.8M可训练参数，保持了高效性。

Insight: 核心创新在于通过架构设计（多尺度双流）明确解耦语义与失真表示，并引入信息瓶颈启发的门控融合进行自适应跨尺度蒸馏。这为解决VLM在AIGIQA任务中固有的表示纠缠问题提供了可借鉴的通用思路，即通过分离和融合互补的粒度信息来提升对细粒度质量退化的感知能力。

Abstract: Existing vision-language model (VLM)-based AI-generated image quality assessment (AIGIQA) methods suffer from a fundamental semantic-distortion dimensional conflict: monolithic representations optimized for semantic discrimination inherently entangle compositional understanding with low-level perceptual sensitivity, rendering them blind to fine-grained quality degradations. We introduce MST-CLIPIQA, a multi-scale two-stream framework that achieves hierarchical vision-language alignment through explicit representational decoupling. Our architecture leverages dual CLIP encoders with complementary patch granularities: coarse-grained streams capture global semantic coherence while fine-grained streams preserve textural signatures and artifact patterns. An information bottleneck-inspired gated fusion mechanism performs adaptive cross-scale distillation, with optional cross-attention enabling prompt-anchored correspondence evaluation when generation prompts are available. Extensive experiments across five benchmarks establish new state-of-the-art results, achieving average improvements of 1.11 percent SRCC on quality and 2.35 percent SRCC on text-image correspondence prediction, while maintaining efficiency with only 0.8M trainable parameters. Our project is available at https://github.com/YMlinfeng/MST-CLIPIQA.

[227] SurroundNEXO: Ego-Centric Metric Bridging for Spatially Consistent Geometry in Autonomous Driving cs.CVPDF

Shuai Yuan, Runxi Tang, Yuzhou Ji, Fudong Ge, Hanshi Wang

TL;DR: 本文提出SurroundNEXO，一种面向自动驾驶中低重叠多摄像头系统的度量深度预测框架。该方法通过引入以自车为中心的几何推理（Ego-Ray位置编码）、利用稀疏LiDAR作为度量锚点，以及渐进式的特征交互，解决了环绕视图因视觉重叠有限而难以建立传统多视图几何对应关系的问题，从而提升了跨摄像头的空间一致性和度量深度预测精度。

Details

Motivation: 自动驾驶依赖于精确的度量3D理解，但车载环绕摄像头系统视野重叠有限，这挑战了传统基于视觉对应关系的多视图几何假设，因此需要一种能在低重叠条件下实现跨视图度量深度推理的新方法。

Result: 在NuScenes、Waymo和DDAD等低重叠自动驾驶基准测试中，与SOTA方法相比，SurroundNEXO将单视图深度误差降低了33.2%，跨视图一致性提升了10.5%，度量重建质量提高了25.6%。该方法在极稀疏深度提示下保持鲁棒，并对未见过的摄像头布局展现出强大的零样本泛化能力。

Insight: 核心创新在于摒弃了早期密集视觉对应的全局融合，转而构建以自车为中心的几何链接（Ego-Ray位置编码），并利用稀疏LiDAR作为度量锚点来传播绝对尺度。其渐进式特征交互设计（从局部视图建模到分解的时空推理再到全局集成）为低重叠多摄像头系统的空间一致度量深度预测提供了新思路。

Abstract: Modern autonomous driving depends on accurate metric 3D understanding for perception, reconstruction, and planning, which in turn requires reliable multi-camera depth prediction. However, the outward-facing nature of vehicle-mounted surround-view camera rigs inherently limits visual overlap across views, challenging the correspondence-based assumptions that underpin conventional multi-view geometry. To bridge this gap, we present SurroundNEXO, named after the Spanish word nexo for a geometric link, a low-overlap multi-camera metric depth framework that grounds cross-view reasoning in ego-centric geometry rather than dense visual correspondences. Instead of directly enforcing early global fusion, SurroundNEXO first assigns image tokens globally comparable ego-frame viewing directions through Ego-Ray Positional Encoding, then uses sparse LiDAR measurements as metric anchors to propagate absolute scale cues, and finally expands feature interaction progressively from view-local modeling to decomposed spatio-temporal reasoning and global integration. This design enables metric-scale depth prediction with improved spatial consistency across weakly overlapping cameras. Across low-overlap autonomous driving benchmarks, including NuScenes, Waymo and DDAD, SurroundNEXO reduces single-view error by 33.2%, improves cross-view consistency by 10.5%, and enhances metric reconstruction quality by 25.6% compared with SOTA methods. It further remains robust under extremely sparse depth prompts and exhibits strong zero-shot generalization to unseen camera layouts.

[228] A Multi-Center Benchmark for Abdominal Disease Diagnosis and Report Generation from Non-Contrast CT cs.CV | cs.LGPDF

Mariam Elbakry, Aliaa Sayed Sheha, Salma Hassan Tantawy, Aya Yassin, Concetto Spampinato

TL;DR: 该论文提出了一个多中心基准，用于从非增强CT（NCCT）进行腹部疾病诊断和放射学报告生成，旨在通过单相NCCT合成对比增强CT（CECT）的发现，以减少对比剂使用风险和工作负担。

Details

Motivation: 解决多相增强CT（CECT）在腹部病变表征中存在的对比剂肾病风险、采集负担增加以及放射科医生工作量大的问题。

Result: 在内部队列中平均多器官AUC达到69.1%，在外部验证队列中达到63.1%，表明NCCT保留了诊断信号。

Insight: 创新点在于构建了一个大规模配对的NCCT-CECT数据集和标准化基准，支持从NCCT生成对比增强报告，推动更安全、资源高效的免对比剂腹部成像工作流程研究。

Abstract: Multiphasic contrast-enhanced CT (CECT) is widely used for abdominal lesion characterization, yet it carries inherent risks of contrast-induced nephropathy, escalates acquisition burden, and heavily contributes to radiologist workload. To address these challenges, we introduce a novel multi-center benchmark for multi-organ abdominal disease diagnosis and automated radiology report generation, which learns to synthesize contrast-enhanced findings from single-phase non-contrast CT (NCCT). To support this, we curated a large-scale dataset of paired NCCT-CECT studies and their corresponding contrast-enhanced radiology reports from two centers, partitioned into internal sets and an external validation cohort. Under a unified evaluation protocol, we benchmarked five contemporary deep learning architectures encompassing chest-specific, abdomen-specific, and general-purpose multimodal domains. Extensive experiments demonstrate that NCCT retains diagnostic signals, achieving an average multi-organ AUC of 69.1% on the internal cohort and 63.1% on the external cohort, respectively. By releasing this dataset and standardized benchmark publicly, this study aims to catalyze future research into safer, resource-efficient, and globally accessible contrast-free abdominal imaging workflows. Code is available at: https://github.com/xmed-lab/TriALS-Report.

Jiaju Han, Ben Zhang, Xuemeng Sun, Qike Zhang, Yuxian Dong

TL;DR: 本文提出了FusionRS，这是首个面向遥感领域的大规模RGB-红外-文本数据集，旨在支持双模态视觉-语言基础模型的学习。该数据集通过将公开的RGB遥感图像转换为红外风格图像来构建对齐的RGB-IR图像对，并为每对图像提供常规场景描述和专门描述红外视觉特性的IR感知描述。基于FusionRS，作者训练了用于RGB-IR联合理解的双模态视觉-语言基础模型，包括CLIP风格的RGB-IR-文本对齐模型和生成式视觉语言模型，实验表明该数据集能有效提升RGB-IR对齐、红外到文本检索以及双模态图像描述的性能。

Details

Motivation: 现有遥感视觉-语言模型主要集中于RGB图像，未能充分利用红外数据提供的互补信息（如热强度结构、物体边界和光照不变特征），且缺乏大规模RGB-红外-文本数据集来支持双模态视觉-语言学习。

Result: 实验表明，基于FusionRS训练的模型在RGB-IR对齐、红外到文本检索和双模态描述任务上优于仅使用RGB或非IR感知的训练设置；消融研究进一步验证了IR感知描述对于增强红外-语言对齐至关重要。

Insight: 创新点在于构建了首个大规模RGB-红外-文本遥感数据集，并引入了IR感知描述来提供模态特定的文本监督；客观分析认为，这种结合合成红外图像与针对性文本注释的方法，为开发更可扩展的RGB-红外遥感视觉-语言表示学习提供了重要基础。

Abstract: Remote sensing vision-language models have advanced Earth observation understanding, but most existing work remains centered on RGB imagery, leaving the complementary information in infrared data underexplored. Infrared images provide distinctive cues, including thermal intensity structures, object boundaries, and illumination-invariant scene features, which can enrich visual-language learning beyond conventional RGB observations. However, a large-scale RGB-infrared-text dataset for remote sensing vision-language modeling is still absent. To address this gap, we introduce FusionRS, the first large-scale RGB-infrared-text dataset designed for dual-modal vision-language learning in remote sensing. FusionRS is constructed by translating diverse public RGB remote sensing images into infrared-style counterparts, forming aligned RGB-IR image pairs. Each pair is associated with conventional scene captions and IR-aware captions that explicitly describe infrared-specific visual properties while preserving semantic content. Based on FusionRS, we train dual-modal vision-language foundation models for RGB-IR joint understanding. We first train CLIP-style models for RGB-IR-text alignment, and then fine-tune generative VLMs for dual-modal RGB-IR captioning. Experiments show that FusionRS improves RGB-IR alignment, infrared-to-text retrieval, and dual-modal captioning over RGB-only and non-IR-aware training settings. Ablation studies further verify that IR-aware captions are crucial for strengthening infrared-language alignment, highlighting the importance of modality-specific textual supervision for more scalable RGB-infrared remote sensing vision-language representation learning.

[230] MeshLoom: Feed-Forward Non-Rigid Registration of Mesh Sequences cs.CVPDF

Jianqi Chen, Jiraphon Yenphraphai, Xiangjun Tang, Sergey Tulyakov, Chaoyang Wang

TL;DR: MeshLoom是一个前馈式非刚性配准网络，可直接重建网格序列中顶点的变形。该方法通过拓扑感知的编码器-解码器设计，融合参考网格的拓扑信息与每帧的补充线索（如形状潜变量和图像特征），生成紧凑的全局运动嵌入，进而通过轻量级解码器查询得到目标时间戳的逐顶点变形。网络简单高效，可在数秒内配准多个网格，并支持运动插值和网格变形等扩展应用。

Details

Motivation: 解决现有非刚性配准方法通常受限于昂贵的逐实例优化、狭窄的对象类别、仅支持成对输入或仅产生中间输出等问题，旨在实现高效、通用且端到端的网格序列配准。

Result: 在多种运动和对象类别上的广泛实验表明，MeshLoom在非刚性配准任务上达到了最先进的（SOTA）结果。

Insight: 创新点包括：1）引入拓扑感知的点表示，将参考网格的拓扑编码到逐顶点特征中，以增强对几何的理解并区分欧氏距离近但测地距离远的点；2）提出全局嵌入-查询范式，通过融合多源信号生成紧凑的全局运动嵌入，并支持在中间时间戳生成变形，从而扩展了网络的功能。

Abstract: We present MeshLoom, a feed-forward registration network that directly reconstructs vertex deformations across mesh sequences. Our approach advances non-rigid registration beyond existing models, which are typically constrained by costly per-instance optimization, narrow object categories, pairwise-only inputs, or merely intermediate outputs. The network is simple and efficient, registering multiple meshes within seconds. At its core lies a topology-aware encoder–decoder design. Specifically, we first introduce a topology-aware point representation that encodes the anchor (reference) mesh’s topology into its per-vertex features. This representation strengthens the network’s understanding of the anchor-mesh geometry and disambiguates points that are Euclidean-close yet geodesically distant. We then propose a multi-modal encoder that fuses this anchor-mesh representation with complementary cues from each frame, such as shape latents and image features. These multi-source signals are compressed into a compact global motion embedding that captures dense inter-frame correspondence. A lightweight decoder then queries this global embedding with the anchor-mesh point representation, retrieving per-vertex deformations at target timestamps. Through extensive experiments across diverse motions and object categories, we show that MeshLoom achieves state-of-the-art results on non-rigid registration. In addition, we find that our global embedding-then-query paradigm naturally enables the network to generate deformations at intermediate timestamps, which extends MeshLoom to motion interpolation and mesh morphing. Project page: https://meshloom.github.io/ .

[231] Qwen-RobotWorld Technical Report: Unifying Embodied World Modeling through Language-Conditioned Video Generation cs.CVPDF

Jie Zhang, Xiaoyue Chen, Anzhe Chen, Chenxu Lv, Deqing Li

TL;DR: Qwen-RobotWorld是一个基于语言条件视频生成的世界模型，旨在实现具身智能的统一建模。它通过自然语言作为统一动作接口，能够从当前观察预测机器人操作、自动驾驶、室内导航和人机交互等多个领域的未来视觉轨迹。该模型采用双流扩散Transformer架构，结合大规模具身世界知识数据集和渐进式课程学习策略，在多个基准测试中取得了领先性能。

Details

Motivation: 为了解决具身智能中不同领域（如机器人操作、自动驾驶）的世界模型分散且难以统一的问题，论文旨在构建一个通用的、以语言为接口的视频世界模型，以实现跨领域的物理世界预测和规划。

Result: 模型在EWMBench和DreamGen Bench上综合排名第一，在WorldModelBench和PBench上超越了所有开源模型，并在RoboTwin-IF基准测试的零样本分析中展现了强大的泛化能力和多视图一致性。

Insight: 创新点在于提出了一个统一的语言条件视频世界模型框架，其核心设计包括双流MMDiT架构、大规模具身世界知识（EWK）数据集以及通用+专家的渐进式课程学习策略，实现了跨多种具身场景的统一动作表示和未来预测。

Abstract: We introduce Qwen-RobotWorld, a language-conditioned video world model for embodied intelligence. With natural language as a unified action interface, it predicts physically grounded future visual trajectories from current observations across robotic manipulation, autonomous driving, indoor navigation, and human-to-robot transfer. This unified formulation provides three promising application directions: synthetic data generation for policy training augmentation, scalable virtual environments for policy evaluation, and language-guided planning signals for downstream robot control. This is achieved through a three-part design: a) Double-Stream MMDiT with MLLM Action Encoding, where a 60-layer double-stream diffusion transformer couples frozen Qwen2.5-VL semantics with video-VAE latents through layer-wise joint attention; b) Embodied World Knowledge (EWK), an 8.6M video-text corpus (200M+ frames) with action-language mapping over 20+ embodiments and 500+ action categories; and c) General+Expert Progressive Curriculum, a two-stage training strategy that first learns general visual priors and then injects embodied specialization under a shared language interface. Extensive results show strong competitiveness: ranks 1st overall on EWMBench and DreamGen Bench, outperforms all open-source models on WorldModelBench and PBench. Additional zero-shot analyses on RoboTwin-IF benchmark further support robust generalization and multi-view consistency.

[232] DreamX-World 1.0: A General-Purpose Interactive World Model cs.CVPDF

DreamX Team, Yancheng Bai, Rui Chen, Xiangxiang Chu, Rujing Dang

TL;DR: DreamX-World 1.0 是一个通用的交互式文本/图像到视频的世界模型，用于可控的长序列生成。它支持摄像机导航、重新访问先前观察过的区域，以及跨照片级真实感、游戏风格和风格化领域的可提示事件。通过结合多种数据源、创新的编码技术、因果训练方法和系统优化，该模型在保持视觉质量和控制精度的同时实现了高效的推理速度。

Details

Motivation: 为了解决现有世界模型在长序列生成中存在的摄像机控制不精确、风格漂移、事件可控性不足以及推理效率低的问题，旨在构建一个通用、交互性强且高质量的视频生成世界模型。

Result: 在作者提出的5秒基础评估中，DreamX-World 1.0的摄像机控制得分为73.75，总得分为84.76，在总得分上优于HY-WorldPlay 1.5（80.79）和LingBot-World（80.45），达到了SOTA水平。在8块RTX 5090 GPU上通过系统优化实现了最高16 FPS的推理速度。

Insight: 创新点包括：1）E-PRoPE编码，在保留投影相机几何的同时对空间缩减的token应用相机感知注意力；2）通过因果强制、DMD风格蒸馏和长序列训练，将双向视频生成器转换为自回归世界模型；3）基于相机几何检索的记忆条件场景持久性（Memory-Conditioned Scene Persistence）和残差循环（residual recycling）机制，以缓解长序列生成中的漂移问题；4）结合事件指令微调和强化学习对齐，实现可组合的事件控制和质量恢复；5）一系列系统级优化（混合精度DiT、残差重用、VAE解码剪裁、异步流水线并行）显著提升了推理效率。

Abstract: DreamX-World 1.0 is a general-purpose interactive text/image-to-video world model for controllable long-horizon generation. It supports camera navigation, revisits to previously observed regions, and promptable events across photorealistic, game-style, and stylized domains. Our data engine combines camera-accurate Unreal Engine rendering, action-rich gameplay recordings, and real-world videos with recovered camera geometry. For camera control, we introduce E-PRoPE, a lightweight variant of projective positional encoding that retains PRoPE’s projective camera geometry while applying camera-aware attention to spatially reduced tokens. We convert a bidirectional video generator into a few-step autoregressive world model using causal forcing, DMD-style distillation, and long-rollout training. Training on self-generated long-horizon contexts exposes the model to its own generated history and reduces the style and color drift that accumulates across autoregressive chunks. Memory-Conditioned Scene Persistence retrieves earlier views through camera-geometry-based retrieval, while residual recycling makes the conditioning path less sensitive to imperfect memory latents. Event Instruction Tuning adds composable event control, and reinforcement learning alignment recovers camera control and visual quality after distillation. With mixed-precision DiT execution, residual reuse, 75%-pruned VAE decoding, and asynchronous pipeline parallelism, DreamX-World 1.0 reaches up to 16,FPS on eight RTX,5090 GPUs. On our 5-second basic evaluation, DreamX-World 1.0 achieves a camera-control score of 73.75 and an overall score of 84.76, outperforming HY-WorldPlay 1.5 and LingBot-World in overall score, which achieve 80.79 and 80.45, respectively.

[233] BRDFusion: Physics Meets Generation for Urban Scene Inverse Rendering cs.CVPDF

Yi-Ruei Liu, Jie-Ying Lee, Zheng-Hui Huang, Yu-Lun Liu, Chih-Hao Lin

TL;DR: BRDFusion是一个结合物理建模与生成模型的城市场景逆向渲染统一框架，旨在从视频中恢复具有物理一致性的场景属性，并通过生成先验缓解优化模糊性。在正向渲染阶段，物理模型提供可控渲染，生成模型则负责去噪和修复伪影，从而生成高质量且可控的视频内容。该方法支持新视角重光照、夜间场景模拟和动态物体插入/编辑等应用。

Details

Motivation: 解决现有基于物理的渲染方法在重建和渲染时存在伪影，以及生成模型在视频生成中缺乏一致性和可控性的问题，旨在实现高质量、可控的城市场景逆向渲染。

Result: 在真实和合成场景的基准测试中，该方法超越了基线方法，能够生成高质量视频并支持精确控制。

Insight: 创新点在于将物理模型与生成模型互补结合，利用物理建模保证一致性与可控性，同时借助生成先验提升视觉质量；从客观角度看，这种混合范式有效平衡了物理准确性与生成真实性，为场景编辑应用提供了灵活框架。

Abstract: Inverse rendering of urban scenes from captured videos enables numerous applications, including content creation and autonomous driving simulation. Physically-based rendering methods follow and control lighting physics, but suffer from reconstruction and rendering artifacts. While generative models produce realistic videos, they offer limited consistency and controllability. We present BRDFusion, a unified framework that combines two complementary models for inverse and forward rendering. Specifically, BRDFusion recovers explicit, consistent scene properties with physical modeling and alleviates optimization ambiguity with generative priors. During forward rendering, the physical model provides controllable rendering from the scene configuration, and the generative model denoises and fixes artifacts. Therefore, our method produces high-quality videos while allowing precise control, outperforming baselines in real and synthetic scenes. Moreover, BRDFusion supports novel-view relighting, night simulation, and dynamic object insertion/editing. Project page: https://shigon255.github.io/brdfusion-page/

cs.SD [Back]

[234] When the Same Musical Knowledge Forgets Differently: A Clean Probe of Pathway-Dependent Forgetting cs.SD | cs.CL | eess.ASPDF

Yu Liu, Zhiwei Yang, Wenxiao Zhang, Cong Cao, Fangfang Yuan

TL;DR: 本文通过音乐理解任务，研究了多模态模型中知识获取路径对遗忘的影响，提出了‘路径不变假设’并设计了配对路径控制协议（PPCP）进行验证。研究发现，在相同适应压力下，通过文本路径获取的知识比音频路径更容易被遗忘，且这种差异稳定存在于不同模型架构中。

Details

Motivation: 动机在于探索多模态模型中知识获取路径（如通过音频或文本）是否影响其后续遗忘的难易程度，挑战了现有遗忘研究中默认的‘路径不变假设’。

Result: 在多个架构不同的音频-语言模型上，实验结果显示文本路径知识比匹配的音频路径知识遗忘更多；该差距在PPCP协议下稳定，且通过控制实验排除了架构深度等混杂因素，证实了遗忘的高度路径依赖性。

Insight: 创新点在于提出了路径依赖遗忘的概念和PPCP实验协议，揭示了输入表示（而非模型深度）是影响遗忘的关键因素，为多模态系统设计和遗忘研究提供了新的分析维度。

Abstract: A model can learn that the piano piece Für Elise is calm and reflective by listening to the audio or by reading a text description, but does it matter which route that knowledge took when it is later at risk of being forgotten? Forgetting research in multimodal models measures what knowledge is lost under adaptation, yet has not asked whether acquisition route affects how easily that knowledge is forgotten. We call this untested premise the Pathway-Invariant Assumption. Music understanding enables a clean test because a music clip and a canonical text description can be aligned to the same perceptual content, allowing the same knowledge unit to enter a model through listening or reading while the target remains fixed. Across multiple architecturally distinct audio-language models, we observe a consistent asymmetry: text-pathway knowledge is forgotten more than matched audio-pathway knowledge under identical adaptation pressure. To attribute this effect to route rather than confounds, we introduce the Paired Pathway Controlled Protocol (PPCP), a three-phase design that establishes matched pathway baselines, activates both pathways under symmetric supervision on the same knowledge pool, and applies identical forgetting pressure to both pathways. The gap is stable across models and gain-controlled analyses, persists when contradictory overwrite is replaced by correct-label cross-domain learning, remains under single-modality pressure, and is not removed by lightweight replay. Two independent routing-depth controls confirm that the effect is not explained by architectural depth, pointing to input representation as the dominant factor. Under PPCP, our results demonstrate that forgetting is highly route-dependent, establishing acquisition route as a new analytical dimension for forgetting research and multimodal system design.

cs.GR [Back]

[235] DC-Motion: Decoupling Semantics and Details via Discrete-Continuous Tokens for Human Motion Generation cs.GR | cs.CV | cs.ROPDF

Hequan Wang, Jiaxu Zhang, Zhengbo Zhang, Zhigang Tu

TL;DR: DC-Motion是一个用于文本到人体运动生成的分解生成框架，通过离散-连续令牌显式解耦语义和细节。它首先使用离散-连续变分自编码器（DC-VAE）将运动分解为离散语义令牌和连续残差细节，然后通过掩码自回归模型预测离散结构，并通过轻量级残差扩散模型恢复连续物理细节。该方法在HumanML3D和KIT-ML数据集上实现了最先进的性能，在运动真实感和文本对齐方面表现最佳。

Details

Motivation: 现有文本到运动生成方法依赖于同质表示空间，可能无法捕捉人体运动的层次性，扩散模型在组合语义推理上存在困难，而自回归模型因量化牺牲了细粒度物理细节。DC-Motion旨在解决这些问题，通过解耦语义和细节来平衡语义可控性和物理真实感。

Result: 在HumanML3D和KIT-ML数据集上，DC-Motion实现了最先进的性能，在运动真实感方面获得最佳FID分数，在文本对齐方面获得最佳R-precision分数。

Insight: 创新点在于引入离散-连续令牌分解表示，将运动生成任务分解为语义结构预测和细节恢复两个子问题，通过结合掩码自回归模型和轻量级残差扩散模型，有效提升了处理复杂指令的能力和生成质量。

Abstract: Text-to-motion generation requires synthesizing physically realistic dynamics that strictly follow complex and long-horizon textual instructions. Existing approaches rely on homogeneous representation spaces that may fail to capture the hierarchical nature of human motion, with diffusion models struggling at compositional semantic reasoning and AR models sacrificing fine-grained physical details due to quantization. To solve it, we introduce DC-Motion, a factorized generative framework designed to explicitly decouple semantics and details via discrete-continuous tokens. A Discrete-Continuous VAE (DC-VAE) first decomposes motion into discrete tokens for semantics and continuous residuals for fine-grained dynamics. Then, a masked AR model predicts the discrete structure from text, and a lightweight residual diffusion model recovers the continuous physical details. Extensive experiments demonstrate that DC-Motion effectively improves the capability to follow complex instructions. By effectively balancing semantic controllability and physical realism, our approach offers a highly adaptable modeling paradigm for human motion generation. On both HumanML3D and KIT-ML datasets, DC-Motion achieves state-of-the-art performance, delivering the best FID for motion realism and R-precision for text alignment.

cs.SE [Back]

[236] Selection Without Signal, Recovery Through Expression: A Measurement Study of Post-Hoc Falsification Operators for Frozen Small Code Models cs.SE | cs.CL | cs.LGPDF

Mehmet Iscan

TL;DR: 本文研究了针对小型冻结代码模型（参数≤1.5B）的后处理操作符（如选择、验证、修复等）是否能提升程序生成准确性。在严格的评估协议下，26种语义后处理操作符均未能超越简单的Best-of-N采样方法。研究发现，模型存在覆盖墙、能力剪刀差和共识陷阱等机制性限制。然而，一种表达式层恢复方法（M1）能有效恢复被标准提取器丢弃的正确程序，在HumanEval+上显著提升性能，而自适应共识早停（ACE）则能节省计算资源。

Details

Motivation: 小型冻结代码模型适合离线与隐私敏感场景，但常生成看似合理实则错误的代码。研究旨在探索无需重新训练的后处理操作符（如选择、验证、修复）是否能有效提升模型输出质量，以解决其‘看似正确但实际错误’的问题。

Result: 在HumanEval+和MBPP+基准测试中，26种语义后处理操作符均未能显著提升模型在保留集上的准确率，未能超越Best-of-N基线。但表达式层恢复方法（M1）将DeepSeek-Coder-1.3B在HumanEval+上的任务解决数提升了12个（p=2.4e-4），且无害；自适应共识早停（ACE）节省了约19%的计算开销且无损害。结果在三个模型单元上可复现。

Insight: 主要创新点在于揭示了小型代码模型后处理中的机制性限制（覆盖墙、能力剪刀差、共识陷阱），并提出了表达式层恢复（M1）这一有效方法，通过改进输出提取而非语义推理来提升性能。研究强调在归咎于语义后处理推理前，应先修复模型输出提取框架并测量覆盖范围。

Abstract: Frozen small code models (<=1.5B parameters, run locally without fine-tuning) suit offline and privacy-constrained use, but often emit plausible-but-wrong programs. A natural remedy is a post-hoc operator that selects, verifies, repairs, or re-processes the model’s samples without retraining; in principled form it is Popperian: attack each candidate with a severe test, keep what survives. We measure whether such operators help. Under one deterministic execution oracle and a leakage-free, matched-compute protocol, 26 semantic post-hoc operators (selection, verification, repair, elimination, portfolios, sound vetoes, generation conditioning) are evaluated against Best-of-N (BoN); on the cells and benchmarks tested, none improves held-out accuracy over BoN. The negative is mechanistic: a coverage wall (systematic hard-task failures deeper sampling does not rescue), a capability scissors (a competent generator leaves almost no discriminable error among visible-test passers), and a near-empty consensus trap (the visible-pass-but-hidden-wrong majority a leakage-free selector needs rarely co-occurs with a correct alternative). A distribution-free do-no-harm bound cannot certify a harm rate <=alpha at zero observed harm unless n>=45. Two operators help on a different axis, outside the semantic output space. An expression-layer recovery (M1), the only accuracy gain here, recovers correct programs the standard extractor discards (robust extraction and public-test signature alignment); it does no harm (b10=0), is leakage-free, and lifts DeepSeek-Coder-1.3B by +12 tasks on HumanEval+ (p=2.4e-4). An adaptive consensus early-stop (ACE) is a calibrated compute-saving control (~19% saving, zero harm). M1 and the selection negative replicate on HumanEval+ and MBPP+ across three model cells. The lesson: fix the harness and measure coverage before blaming semantic post-hoc reasoning.

cs.RO [Back]

[237] Pixels to Proofs: Probabilistically-Safe Latent World Model Control via Parallel Conformal Robust MPC cs.RO | cs.AI | cs.CV | cs.LG | eess.SYPDF

Devesh Nath, Anutam Srinivasan, Haoran Yin, Ruitong Jiang, Jeffrey Fang

TL;DR: 本文提出了SLS^2框架，用于从像素输入进行安全的反馈运动规划。该框架在学习的潜在世界模型中采用鲁棒模型预测控制（MPC），通过联合嵌入世界模型学习紧凑的马尔可夫潜在状态，并利用保形预测为系统级合成（SLS）鲁棒MPC方案提供校准的潜在误差边界和鲁棒约束集，从而在闭环执行中施加概率安全约束。

Details

Motivation: 解决从像素输入进行安全运动规划的问题，特别是在学习的潜在世界模型预测不完美的情况下，如何确保真实系统的安全性。

Result: 在基于视觉的控制任务上进行评估，相比潜在的基线世界模型和安全规划方法，该方法在目标达成性能和安全性方面均有提升。

Insight: 创新点在于将保形预测与GPU加速的系统级合成鲁棒MPC相结合，以获取校准的潜在误差边界，并学习并保形化潜在约束检查器，从而在潜在空间中实现概率安全约束。

Abstract: We present SLS^2, a framework for safe feedback motion planning from pixels using robust model predictive control (MPC) in learned latent world models. Our approach trains an action-conditioned joint-embedding world model with compact Markovian latent states, enabling efficient gradient-based trajectory optimization through learned latent dynamics. To enforce safety for the true system despite imperfect latent predictions, we inform a GPU-accelerated system level synthesis (SLS) robust MPC scheme with conformal prediction to obtain calibrated latent error bounds and robust latent-space constraint sets. We further learn and conformalize a latent constraint checker, allowing the SLS planner to impose probabilistic safety constraints during closed-loop execution. We evaluate our method on vision-based control tasks, where it improves both goal-reaching performance and safety over latent world-model and safe-planning baselines.

[238] V2P-Manip: Learning Dexterous Manipulation from Monocular Human Videos cs.RO | cs.CVPDF

Kaihan Chen, Yanming Shao, Haifeng Ji, Xiaokang Yang, Yao Mu

TL;DR: V2P-Manip是一个从单目人体视频中学习灵巧操作策略的高效框架。它通过一个集成的流程（包括3D资产获取、轨迹估计和策略学习）以及一个两阶段精炼过程来弥合视觉感知与物理约束之间的差距。

Details

Motivation: 为了解决自主机器人灵巧操作需要大规模、类人精确动作序列的问题，并作为昂贵遥操作数据的可扩展补充，从单目视频中提取兼具视觉保真度和物理合理性的轨迹是一个有前景的方向。

Result: 在TACO和OakInk基准测试上的评估表明，该方法在姿态精度、对非结构化环境的适应性和训练效率方面显著优于先前方法，在多个合成操作任务中平均成功率超过75%。

Insight: 创新点在于提出了一个从视频到策略的端到端集成学习框架，并引入两阶段精炼过程来确保空间对齐和物理一致性，从而有效利用人类演示视频作为先验知识，并验证了其在不同灵巧手模型上的适应性。

Abstract: Achieving autonomous robotic dexterous manipulation requires precise, human-like action sequences at scale. As a scalable supplement to costly teleoperation data, extracting trajectories with both visual fidelity and physical plausibility from monocular videos represents a promising frontier in embodied AI. To this end, we introduce V2P-Manip, an efficient framework designed to learn dexterous manipulation policies directly from human demonstration videos. We establish an efficient, integrated pipeline encompassing 3D asset acquisition, trajectory estimation, and dexterous policy learning. To bridge the gap between visual perception and physical constraints, we introduce a two-stage refinement process to enforce spatial alignment and physical consistency. Evaluations on the TACO and OakInk benchmarks demonstrate that our approach significantly outperforms previous methods in pose accuracy, adaptability to unstructured environments, and training efficiency. Ultimately, experimental results confirm an average success rate of over 75% across multiple synthetic manipulation tasks and validate the adaptability of the extracted manipulation priors across diverse dexterous hand embodiments.

[239] Geometric Action Model for Robot Policy Learning cs.RO | cs.CV | cs.LGPDF

Jisang Han, Seonghu Jeon, Jaewoo Jung, René Zurbrügg, Honggyu An

TL;DR: 本文提出了一种名为几何动作模型（GAM）的机器人策略学习方法，它直接利用预训练的几何基础模型（GFM）作为感知、时序预测和动作解码的共享基础。GAM通过在GFM的中间层进行分割，插入一个因果未来预测器来预测基于语言、本体感觉和动作历史的未来潜在令牌，从而实现对未来几何和动作的联合生成。该方法旨在解决现有视觉-语言-动作模型在接触丰富的操作任务中缺乏显式3D几何推理的问题。

Details

Motivation: 现有的大规模视觉-语言-动作模型或视频世界动作模型主要基于2D图像帧或其衍生潜在空间进行操作，缺乏对接触丰富操作任务至关重要的显式3D几何推理。本文旨在通过直接利用预训练的几何基础模型，将3D几何先验显式地整合到机器人策略学习中，以提升其在物理世界中的推理和操作能力。

Result: 在广泛的模拟和真实机器人操作基准测试中，GAM在准确性、鲁棒性、速度和模型轻量化方面均优于当前基于基础模型规模的基线方法。

Insight: 核心创新点在于将预训练的几何基础模型（GFM）重新定位为一个共享的感知-预测-动作解码主干网络，并通过在中间层插入一个轻量的因果未来预测器，实现了对语言条件化时序世界模型的建模，同时最大程度地保留了GFM原有的丰富几何先验。这种架构设计实现了单一骨干网络同时输出未来几何和动作，是一种高效利用几何基础模型进行策略学习的新范式。

Abstract: Generalist robot policies must follow user instructions while reasoning about how objects, cameras, and robot actions interact in the 3D physical world. Recent vision-language-action models (VLAs) and video world-action models (WAMs) inherit strong semantic or temporal priors from large-scale foundation models, but they still operate primarily on 2D image frames or 2D-derived latent spaces, leaving implicit the 3D geometry required for contact-rich manipulation. We propose the Geometric Action Model (GAM), a language-conditioned manipulation policy that directly repurposes a pretrained geometric foundation model (GFM) as a shared substrate for perception, temporal prediction, and action decoding. GAM splits the GFM at an intermediate layer: the shallow layers serve as an observation encoder, and a causal future predictor inserted at the split layer forecasts future latent tokens conditioned on language, proprioception, and action history. The predicted future tokens are then routed through the remaining GFM blocks for feature propagation and decoding, allowing a single backbone to produce both future geometry and actions. This design equips the GFM with language-conditioned temporal world modeling through minimal architectural modification while preserving its rich geometric priors. Across a broad suite of simulation and real-robot manipulation benchmarks, GAM is more accurate, more robust, faster, and lighter than current foundation-model-scale baselines.

[240] R2RDreamer: 3D-aware Data Augmentation for Spatially-generalized 2D Manipulation Policies cs.RO | cs.CVPDF

Xiuwei Xu, Haowen Sun, Angyuan Ma, Yiwei Zhang, Zhenyu Wu

TL;DR: 本文提出了R2RDreamer，一种用于增强模仿学习机器人操作策略空间泛化能力的真实到真实（real-to-real）数据增强框架。该方法通过轻量级3D编辑（编辑不完整物体点云和末端执行器轨迹）和2D视频空间视觉补全（利用遮挡感知投影和密集控制图像到视频模型），从少量真实演示中生成几何一致且视觉连贯的新训练数据，以提升2D策略（如扩散风格策略和视觉-语言-动作策略）在空间偏移任务上的泛化性能。

Details

Motivation: 动机在于解决模仿学习操作策略空间泛化需要大量多样化真实演示数据的高昂成本问题，并克服现有仿真增强方法的环境设置复杂性和仿真到真实差距，以及现有真实到真实方法对强3D场景解析和几何补全的依赖，使其更适用于基于RGB的2D策略。

Result: 在空间偏移操作任务上的实验表明，R2RDreamer使用2D扩散风格策略和视觉-语言-动作策略时，均能有效提升从有限源演示中学习到的策略的空间泛化能力。分析验证了其3D编辑、遮挡感知投影和视频补全各组件对性能的贡献。

Insight: 宣称的创新点是将几何一致的3D动作-观测编辑与2D视频空间的视觉补全解耦，通过轻量级3D编辑结合遮挡感知投影和图像到视频生成模型，为2D策略生成高质量增强数据。客观来看，其核心创新在于将3D几何约束（用于动作和粗略场景编辑）与2D视觉生成（用于完成逼真、时序连贯的RGB观测）有效结合，避免了复杂的完整3D重建，更适配主流的2D视觉策略。

Abstract: Spatial generalization is critical for imitation-learned manipulation policies, but achieving it typically requires scaling demonstrations across diverse object poses, robot configurations, and camera viewpoints. Data augmentation from a few source demonstrations offers a practical alternative to costly real-world collection. Simulation-based augmentation can create controllable variation, but requires complex environment and object setup and may introduce a sim-to-real gap. Recent real-to-real methods avoid these issues by jointly editing 3D observations and action trajectories from real demonstrations, yet they still rely on strong 3D scene parsing and geometry completion, and often produce observations tailored to 3D pointcloud policies rather than RGB-based 2D policies. We propose R2RDreamer, a real-to-real demonstration augmentation framework that preserves the geometric consistency of 3D action-observation editing while moving visual completion to 2D video space. Specifically, R2RDreamer first performs lightweight 3D augmentation by editing incomplete object pointclouds and end-effector trajectories in a shared 3D frame; it then projects the edited scene into masked image-space control videos with occlusion-aware reasoning and uses a dense-control image-to-video model to complete temporally coherent RGB observations. Experiments on spatially shifted manipulation tasks with both 2D diffusion-style policies and vision-language-action policies show that R2RDreamer improves spatial generalization from limited source demonstrations, with analyses validating the contributions of 3D editing, occlusion-aware projection, and video completion.

cs.MM [Back]

[241] MatchLM2Lite: A Scalable MLLM-to-Lite Framework for Reproduced Content Identification cs.MM | cs.AI | cs.CVPDF

Xiaotian Fan, Hiok Hian Ong, David Yuchen Wang, Zirui Zhu, Kanchan Sarkar

TL;DR: MatchLM2Lite是一个用于识别复制内容（RCI）的可扩展多模态大语言模型到轻量化模型框架。该系统通过一个两阶段训练流程，将高性能教师模型MatchLM的知识蒸馏到快速推理的学生模型MatchLite中，实现了对视频、音频和文本信号的联合建模，以进行细粒度的复制内容评分。

Details

Motivation: 在线视频平台需要大规模保证内容的真实性，以保护创作者并维持积极的用户体验，确保用户接触到多样、原创的视频，而非低价值的复制内容。

Result: MatchLM相比之前的生产模型在F1分数上提升了+8.57。经过知识蒸馏后，MatchLite在保持+6.55 F1分数增益的同时，计算成本降低了35倍。系统部署后，端到端延迟低于30秒，并将平台上的复制视频观看率降低了2.5%，且未影响用户参与度。

Insight: 创新点在于提出了一种将多模态大语言模型（MLLM）的强大理解能力蒸馏到轻量级模型的两阶段框架，实现了高精度与低延迟、高吞吐量的平衡，适用于实时推荐系统的大规模生产环境。

Abstract: Content moderation is critical for online video platforms to ensure content safety, protect creators, and sustain positive user experiences. Beyond filtering harmful content, platforms must guarantee content authenticity at scale so that users are exposed to diverse, original videos rather than low-value reproductions. We present MatchLM2Lite, a real-time, production-grade reproduced content identification (RCI) system that leverages the powerful understanding of a multimodal large language model (MLLM) distilled into a small and fast-inference model. Our system jointly models video, audio, and text signals, operating on pairs of videos to produce fine-grained reproduction scores. The system comprises two modules, MatchLM and MatchLite, and a two-stage training recipe. First, our high-capacity MLLM, MatchLM, serves as a teacher model to define the upper bound of RCI performance. Its capabilities are then distilled into a compact student model, MatchLite. This design allows MatchLite to deliver low-latency, high-throughput inference on video pairs while preserving much of MatchLM’s accuracy, making it suitable for integration into real-time recommendation systems. MatchLM achieves an F1-score improvement of +8.57 compared to our previous production model. After knowledge distillation, MatchLite retains a +6.55 gain in F1-score while reducing computational cost by 35x. Deployed at scale, MatchLM2Lite enables efficient, pairwise multimodal RCI, stably serving online traffic at high queries per second (QPS) with an end-to-end latency below 30 seconds. This system has reduced the reproduced video view rate on our platform by 2.5% without degrading user engagement, demonstrating its effectiveness in a large-scale production environment.

[242] Teacher-Student Structure for Domain Adaptation in Ensemble Audio-Visual Video Deepfake Detection cs.MM | cs.AI | cs.CV | cs.LG | cs.SDPDF

Elham Abolhasani, Maryam Ramezani, Hamid R. Rabiee

TL;DR: 本文提出了一种名为EAV-DFD的集成音频-视觉深度伪造检测方法，该方法结合了教师-学生框架的领域自适应机制，旨在提升模型在未见过的数据域上的泛化能力和检测性能。

Details

Motivation: 生成式AI模型的快速发展导致深度伪造媒体日益逼真，引发了严重的隐私和社会问题。现有检测模型在跨域数据上性能下降，因此需要提升模型对音频、视频及其交互等多模态信息的泛化能力。

Result: 在FakeAVCeleb作为源域，DFDC、Deepfake_TIMIT和PolyGlotFake作为目标域的实验中，该方法仅使用少量目标域数据训练学生模型，就将AUC性能分别提升了4.09%、17.94%和0.5%，实现了有效的领域自适应。

Insight: 创新点在于将集成音频-视觉模型与教师-学生结构的领域自适应机制相结合，不仅提升了跨域泛化性能，还能解释被操纵的模态，为实际应用提供了潜力。

Abstract: The rapid advancement of generative AI models is leading to more realistic deepfake media, encompassing the manipulation of audio, video, or both. This raises severe privacy and societal concerns. Numerous studies in this area have yielded promising intra-domain results; however, these models frequently exhibit decreased efficacy when faced with data from dissimilar domains. Consequently, recent deepfake detection approaches focus on enhancing the generalization ability through multiple techniques that incorporate all input modalities, including audio, images, and their interactions. In this regard, we propose the EAV-DFD method, a generalized deep ensemble audio-visual model (EAV-DFD) combined with a domain adaptation mechanism utilizing a teacher-student framework to enhance the model’s ability to perform and generalize effectively across unseen domains. To evaluate the model’s performance, we used the FakeAVCeleb dataset as the primary domain and the DFDC, Deepfake_TIMIT, and PolyGlotFake datasets as an unseen domain. Our experimental results demonstrate that the proposed framework is efficient in domain adaptation, improving AUC performance of the model by 4.09%, 17.94%, and 0.5% on three unseen datasets, using only a small portion of them to train the student model. This leads to a novel deepfake detection model capable of adapting to new domains and interpreting which modality has been manipulated, highlighting the potential of our approach for real-world applications.

[243] MAF: Multimodal Adaptive Few-shot Prompting for Sentiment Analysis with MLLMs cs.MM | cs.AI | cs.CV | cs.LGPDF

Hangling Xie

TL;DR: 本文提出了一种名为MAF的多模态自适应少样本提示框架，旨在解决多模态大语言模型在情感分析任务中对提示设计敏感的问题。该框架通过动态检索与查询相关的示例，并利用轻量级系数生成网络实时融合多模态相似度，以加权聚合方式选择最相关的示例，从而提升模型性能。

Details

Motivation: 多模态大语言模型在理解复杂多模态内容方面表现出色，但其情感分析性能对提示设计极为敏感，静态统一的提示难以捕捉输入中变化的多模态细微线索，因此需要一种自适应、上下文敏感的提示方法。

Result: 在公开基准数据集上的大量实验表明，MAF相比其骨干模型变体取得了显著且一致的性能提升，并与强大的多模态情感分析基线方法保持竞争力。

Insight: 创新点包括：动态检索查询相关示例以自适应提示；引入唇部运动幅度检测机制以在多人物场景中准确识别说话者；采用轻量级系数生成网络实现查询条件化的实时多模态融合权重，替代传统的固定权重融合；通过多数投票增强预测稳定性。

Abstract: Multimodal large language models (MLLMs) have demonstrated remarkable capabilities in understanding complex multimodal content. However, their performance in sentiment analysis exhibits acute sensitivity to prompt design, rendering static, uniformly applied prompts inherently suboptimal for capturing the nuanced multimodal cues that vary across inputs. To address this limitation, we propose a Multimodal Adaptive Few-Shot Prompting (MAF) framework, which dynamically retrieves and integrates query-relevant demonstrations to elicit the sentiment reasoning capabilities of MLLMs in a context-sensitive manner. MAF constructs a demonstration retrieval module that holistically encodes facial expressions, scene context, and textual semantics, with a lip movement amplitude detection mechanism introduced for accurate speaker identification in multi-person scenarios. Departing from conventional fixed-weight fusion, a lightweight coefficient generation network is trained to output query-conditioned fusion weights in real time, enabling weighted aggregation of multimodal similarity scores to retrieve the top-K most informative demonstrations. Prediction stability is further enhanced through majority voting over multiple candidate outputs generated by the MLLM. Extensive experiments on public benchmark datasets demonstrate that MAF achieves substantial and consistent performance improvements over the corresponding backbone variants and remains competitive with strong multimodal sentiment-analysis baselines.

eess.IV [Back]

[244] Explainable Task-Oriented Token Communication for AI-Native 6G Networks eess.IV | cs.CV | cs.ITPDF

Feibo Jiang, Lei Mao, Li Dong, Kezhi Wang, Cunhua Pan

TL;DR: 本文提出了一种可解释的任务导向令牌通信框架（ET-TokenCom），用于AI原生的6G网络。该框架将令牌作为信息表示和传输的统一单元，构建了从视觉感知、无线传输到任务推理的端到端通信链路。通过引入任务令牌和跨模态注意力融合机制，实现了任务对视觉令牌的显式引导，并在接收端结合注意力热图提供可解释的输出。

Details

Motivation: 现有任务导向图像通信方法面临三大挑战：任务导向令牌表示不足、视觉令牌与任务令牌协作不充分、任务决策可解释性有限。本文旨在解决这些问题，推动图像通信从比特精确传输向任务导向传输演进。

Result: 仿真结果验证了所提ET-TokenCom框架的有效性和鲁棒性。

Insight: 创新点在于将基础模型生成的任务令牌引入通信链路，通过跨模态注意力机制实现任务对视觉信息的显式引导，并结合注意力热图提供决策过程的可解释性，为6G网络中AI驱动的任务导向通信提供了新思路。

Abstract: The integration of Foundation Models (FMs) and wireless communications is driving the evolution of image communication from bit-accurate transmission toward task-oriented transmission. However, existing task-oriented image communication methods still face three major challenges: insufficient task-oriented Token representation, inadequate collaboration between Visual Tokens and Task Tokens, and limited interpretability of task decisions. To address these challenges, we propose an Explainable Task-Oriented Token Communication (ET-TokenCom) framework. By treating Tokens as unified units for information representation and transmission, the proposed framework constructs an end-to-end communication link that spans visual perception, wireless transmission, and task reasoning. At the transmitter, the ET-TokenCom framework extracts Visual Tokens from images to preserve low-level visual information. Meanwhile, Task Tokens generated by the FM are introduced to represent the target information and decision intent required by the current task. A Cross-Modal Attention (CMA) fusion mechanism is further designed, enabling Task Tokens to explicitly guide the selection, weighting, and transmission of Visual Tokens. At the receiver, the framework integrates Token decoding with an explainable output mechanism, where attention heatmaps are generated to highlight critical perceptual regions under different task objectives and reveal the influence of Task Tokens on the outputs. Finally, simulation results validate the effectiveness and robustness of the proposed ET-TokenCom framework.

[245] Chroma-gated, differentiable OKLCH interpolation: Continuous Oklab fallback for color-cast reduction eess.IV | cs.CV | cs.GRPDF

Naoyuki Uchida

TL;DR: 本文提出了一种名为连续Oklab回退（COFb）的方法，用于减少OKLCH颜色空间插值中出现的色偏问题。该方法通过一个可微的色度门控函数，在色度降低时连续地将OKLCH路径向线性Oklab路径混合，从而统一处理了色度端点间的色调绕行和端点无色时的离线弯曲问题。

Details

Motivation: OKLCH作为CSS Color 4推荐的插值空间，在梯度插值中广泛使用，但其极坐标参数化会导致中性轴附近的颜色出现两种色偏：一是色度端点间会经过不期望的色调（如蓝到黄经过绿色），二是当一个端点为无色时产生离线弯曲。现有方法仅能处理后者，对前者无效。

Result: 在默认参数（n=1, σ≈0.19）下，COFb将色调绕行路径的侧向偏差平均减少了49.5%，色度加权色调偏移减少了35.5%。该方法在仅处理无色端点时，仍不如现有的二值开关方法有效，且不保持色度。

Insight: 创新点在于引入了一个单参数、可微的色度门控函数，实现了从OKLCH到线性Oklab的连续混合，统一处理了两种色偏问题，而无需端点测试。该方法可作为回退方案，在不支持现代CSS颜色插值的环境中（如旧引擎、图像/视频管线或GPU着色器）提供相同的色偏减少梯度。

Abstract: OKLCH – the cylindrical (lightness, chroma, hue) form of Ottosson’s Oklab color space – is the interpolation space recommended by CSS Color 4 for gradients and color-mix(), and it is now broadly deployed. Its polar parameterization, however, casts color near the neutral axis in two ways: (1) an inter-hue detour between two chromatic endpoints that sweeps through an unintended hue (blue to yellow visibly passing through green), and (2) an off-line bow when one endpoint is achromatic. Existing remedies are uniformly two-valued – a threshold switch that fires only at an achromatic endpoint – so they address only (2); on chromatic pairs every one of them reduces to raw OKLCH, leaving the (1) inter-hue cast untreated. We introduce Continuous Oklab fallback (COFb), a one-parameter, differentiable chroma gate $w(C)=C^n/(C^n+σ^n)$ that continuously blends the OKLCH path toward the linear Oklab path as chroma falls. A single gate reduces the (1) cast that the two-valued family leaves untreated and unifies the handling of (1) and (2) without any endpoint test. We characterize a cast-hue trade-off frontier, adopt a default ($n=1$, the rational Michaelis-Menten form; $σ\approx0.19$ for a typical sRGB palette, from a normalization-independent cast-half criterion), and verify the gate’s properties symbolically. At the default, COFb halves the inter-hue path detour (mean lateral deviation -49.5%, chroma-weighted hue excursion -35.5%). We also state the method’s limits: on (2) alone the two-valued switch remains better, and like any Cartesian blend COFb does not preserve chroma. In deployment, COFb runs entirely in plain Oklab (a,b) to sRGB, so it serves as a fallback that delivers the same cast-reduced gradients where modern CSS color interpolation (color-mix(in oklch) and the like) is unavailable – older engines, image and video pipelines, or GPU shaders.

cs.LG [Back]

[246] daVinci-kernel: Co-Evolving Skill Selection, Summarization, and Utilization via RL for GPU Kernel Optimization cs.LG | cs.AI | cs.CLPDF

Dayuan Fu, Mohan Jiang, Tongyu Wang, Dian Yang, Jiarui Hu

TL;DR: daVinci-kernel是一个用于GPU内核优化的强化学习框架，它通过一个动态演进的技能库，将技能发现与技能利用相结合。该框架联合训练三个共享同一个LLM主干网络的智能体：一个通过BM25和LLM重排检索相关技术的技能选择智能体、一个根据选定技能生成多轮CUDA/Triton内核的策略智能体，以及一个将成功执行轨迹提炼为可重用技能的技能总结智能体。

Details

Motivation: 解决GPU内核优化中，在保证功能正确性的前提下，如何系统性地发现、选择和利用优化技巧以提升执行效率的问题。

Result: 在KernelBench基准测试中，daVinci-kernel-14B模型在Fast$_1$阈值下，于Level 1、Level 2和Level 3分别达到37.2%、70.6%和32.2%的性能，超越了之前最强的RL训练模型Dr.Kernel-14B。

Insight: 核心创新在于将技能库的构建（发现与总结）与技能的使用（选择与生成）通过三个协同训练的智能体进行端到端联合优化，并通过执行验证确保技能的有效性，形成了一个自我进化的优化系统。

Abstract: GPU kernel optimization represents a paradigm where functional correctness is assumed and execution efficiency is the objective. We present daVinci-kernel, a reinforcement learning framework that couples skill discovery with skill exploitation through a dynamically evolving skill library. daVinci-kernel jointly trains three agents sharing one LLM backbone: a Skill Selection Agent that retrieves relevant techniques via BM25 and LLM reranking, a Policy Agent that generates multi-turn CUDA/Triton kernels conditioned on selected skills, and a Skill Summary Agent that distills successful rollouts into reusable skills. Candidate skills are added only after execution-based verification confirms reproducible speedups. All three agents share a single LLM backbone, are initialized via a structured SFT cold start on diversity-filtered data, and are then jointly optimized end-to-end with multi-turn REINFORCE and per-agent advantage estimation. On KernelBench, daVinci-kernel-14B achieves 37.2%, 70.6%, and 32.2% on Level 1, Level 2, and Level 3 under the Fast$_1$ threshold, outperforming the strongest prior RL-trained model, Dr.Kernel-14B.

Zewen Liu

TL;DR: 本文研究了多模态AI智能体在自我评估反馈循环中出现的系统性偏差，即评估者偏好崩溃现象。研究发现，多模态场景下该现象被显著放大，并揭示了一种新的跨模态传染效应：在一个模态上习得的评估偏好会传播并污染另一个模态的策略选择。

Details

Motivation: 旨在探究当AI智能体使用语言模型在反馈循环中评估自身输出时产生的系统性偏差，特别是在多模态（文本和视觉）任务中，这种偏差如何被放大并产生跨模态的污染效应。

Result: 使用GPT-4o评估DeepSeek-chat发现，单一策略（step_by_step）获得了48.4%的权重，是多模态自我评估中观察到的崩溃程度的3.2倍。通过四阶段隔离训练范式，测量了传染系数并记录了策略反转现象。统计验证表明，跨模型评估（GPT-4o）产生了强但对称的双向传染，而自我评估（DeepSeek-chat）则提供了近乎完全的免疫力（97%的运行零传染）。

Insight: 论文的核心创新点是提出了跨模态传染这一新现象，并建立了量化其效应的实验框架（MM-EPC）。从客观角度看，其将评估偏差的研究从单一模态扩展到多模态交互，并识别出跨模型评估器架构是偏好传染的主要风险因素，这对设计鲁棒的多模态AI系统具有重要借鉴意义。

Abstract: When AI agents use language models to evaluate their own outputs in a feedback loop, systematic biases emerge. We show that Evaluator Preference Collapse (EPC) is dramatically amplified in multimodal settings. Using GPT-4o to evaluate DeepSeek-chat across text and visual tasks, we find that a single strategy (step_by_step) absorbs 48.4% of all weight – 3.2x the collapse observed in text-only self-evaluation – while three visual-domain strategies receive only 9.1% combined weight. We then demonstrate a novel phenomenon we term cross-modal contagion: evaluator preferences acquired on one modality transfer to and corrupt strategy selection on another. Through a four-phase isolation training paradigm, we measure contagion coefficients and document strategy inversion – the optimal strategy for a modality reverses after cross-modal exposure. A Phase 3 statistical validation across four evaluator configurations (N=53 total independent repetitions, 15,592 API calls) reveals a clear hierarchy: cross-model evaluation (GPT-4o, N=8) produces strong but symmetric bidirectional contagion (mean gamma_{T->V}=1.176, gamma_{V->T}=1.089, Delta=-0.088, p=0.575, Cohen’s d=0.29); high round counts (DashScope, 50 rounds) cause collapse to single-strategy dominance (70% zero contagion); and self-evaluation provides near-complete immunity – 97% of runs (N=30, DeepSeek-chat) yield exactly zero contagion (mean gamma=0.033, 95% CI [-0.031, 0.010], p=0.642, d=0.07). No evaluator condition shows statistically significant directional asymmetry. We introduce the contagion matrix indexed by evaluator identity, release the MM-EPC experimental framework, and identify cross-model evaluator architecture as the primary risk factor for preference contagion.

[248] Temporal Difference Learning for Diffusion Models cs.LG | cs.CVPDF

Qizhen Ying, Yangchen Pan, Victor Adrian Prisacariu, Junfeng Wen

TL;DR: 本文提出了一种基于时序差分（TD）学习的目标函数，用于训练扩散模型，以增强去噪轨迹中不同时间步预测之间的一致性。该方法将扩散过程重新表述为马尔可夫奖励过程，并将去噪视为强化学习中的策略评估问题，从而推导出一个适用于离散和连续时间扩散模型的统一TD框架。实验表明，该训练方法能显著提升FID衡量的样本质量，尤其在采样步数较少时优势更明显。

Details

Motivation: 现有扩散模型通常使用关注单个时间步（或相邻对）局部去噪目标的目标函数进行训练，这无法保证沿去噪轨迹的预测之间的一致性。这种跨时间一致性的缺乏会降低模型性能，特别是对于少步采样器。

Result: 经验结果表明，使用所提出的TD训练可以显著提高由FID（Fréchet Inception Distance）测量的样本质量，当采样步数较少时优势更强，突出了其在低计算预算场景下的实用性。

Insight: 主要创新点在于将扩散过程重新表述为马尔可夫奖励过程，并引入时序差分目标来惩罚模型沿去噪路径的多步进展不一致性，从而强制跨时间一致性。此外，还提出了一种基于样本的原则性重加权方法来稳定训练。该方法可作为通用即插即用组件，提升不同扩散生成模型的生成质量。

Abstract: Diffusion models are typically trained with objectives that focus on local denoising targets at individual time steps (or adjacent pairs), which do not enforce consistency between predictions along the denoising trajectory. This lack of cross-time consistency can degrade performance, especially for few-step samplers. We introduce a temporal difference (TD) objective that penalizes inconsistency of the model’s multi-step progress along the denoising path. By reformulating the diffusion process as a Markov reward process and casting denoising as a policy evaluation problem in reinforcement learning, we derive a unified TD approach that applies to both discrete- and continuous-time diffusion formulations. We further propose a principled sample-based reweighting method that stabilizes training. Empirically, we show that using our TD training can significantly improve sample quality measured by FID, with stronger advantages when the number of sampling steps is small, highlighting its practical utility under low-computation-budget scenarios. We provide ablation studies to justify our design choices, including pairwise loss reweighting, regularization weight, and one-step stride. Overall, our TD approach can be a general drop-in that enforces cross-time consistency and improves generation quality across different diffusion generative models.

[249] Post-Launch Capability Expansion of Vision-Language Models via Prompting for On-Orbit Spacecraft Inspection cs.LG | cs.AI | cs.CVPDF

Nicholas A. Welsh, Lennon J. Shikhman, Monty Nehru Attazs, Seemanthini K. Putane, Van Minh Nguyen

TL;DR: 本文研究了利用提示驱动的视觉-语言模型实现航天器在轨检测系统的后发射语义扩展能力，通过自然语言提示指定新的航天器组件而无需修改模型权重。在129张未见过的卫星图像上评估了零样本实例分割性能，发现模型对大型结构（如航天器主体和太阳能板）定位可靠，但对小型部件（如天线和推进器）效果较差，且提示表述对性能有显著影响。

Details

Motivation: 解决航天器在轨检测系统中模型部署后难以更新权重或扩展固定标签集的问题，探索通过提示驱动的视觉-语言模型实现后发射语义扩展，避免在轨重训练和参数重新上传。

Result: 在零样本实例分割任务中，SAM3模型在固定全局阈值且无后处理条件下，达到0.385 mAP@0.5和0.267 mAP@0.5:0.95；大型结构如航天器主体（0.639 AP@0.50）和太阳能板（0.598 AP@0.5）定位可靠，但小型部件如天线（0.221 AP@0.5）和推进器（0.081 AP@0.5）性能较差；结构化提示比简短类别名称提示性能提升高达82%。

Insight: 创新点在于利用提示驱动的视觉-语言模型实现航天器在轨检测的后发射语义扩展，无需修改模型权重；从客观角度看，该方法为动态环境下的模型能力扩展提供了实用机制，但揭示了零样本定位在轨道域偏移下对精细部件的局限性，提示工程对性能有重要影响。

Abstract: Spaceborne inspection systems often deploy perception models prior to launch, after which updating model weights or expanding fixed label sets becomes operationally impractical. While supervised models can be integrated pre-flight, adding new semantic capabilities in orbit requires retraining and re-uploading parameters. We investigate whether prompt-driven vision–language models can enable post-launch semantic expansion, allowing new spacecraft components to be specified via natural-language prompts without modifying onboard weights. We evaluate zero-shot instance segmentation of spacecraft components under a strictly frozen, single-pass inference protocol on a test set of $129$ images of previously unseen satellites. Under fixed global thresholds and no post-processing, SAM3 achieves $0.385$ mAP@$0.5$ and $0.267$ mAP@$0.5{:}0.95$. Performance is strongly scale-dependent: large structural elements like spacecraft bodies ($0.639$ AP@$0.50$) and solar arrays ($0.598$ AP@$0.5$) localize reliably, while relatively small appendages like antennas ($0.221$ AP@$0.5$) and thrusters ($0.081$ AP@$0.5$) remain difficult. Prompt formulation influences performance, with structured prompts incorporating spatial and geometric descriptors yielding up to $82%$ improvement over short category-name prompts. The model operates within the memory and compute envelope of contemporary embedded GPUs, suggesting prompt-driven grounding can provide a practical mechanism for post-launch semantic extension of dominant spacecraft structures while highlighting limitations of zero-shot localization for fine-scale components under orbital domain shift.

Daniele Mos, Felipe Drummond, Anton Bossenbroek, Soufiane el Khinifri

TL;DR: 本文提出了一种名为SpTGNN的多模态时空图神经网络，用于预测表层土壤有机碳含量。该方法将土壤测量点表示为异构图节点，结合遥感数据、环境协变量和时空嵌入，并利用混合专家模块进行多模态融合，同时通过异方差回归和深度集成来量化不确定性。

Details

Motivation: 现有土壤有机碳预测方法通常依赖于手工特征和经典机器学习或单模态深度模型，忽略了丰富的光谱、时间信息以及测量点的不规则空间结构，因此需要一种能够统一处理多模态时空数据并捕获不确定性的框架。

Result: 在包含约49k个全球样本的数据集上，特别是在非洲测试集上，5成员深度集成模型取得了R²=0.762、RMSE=3.51±0.48 g/kg和MAPE=22.9%的结果，优于XGBoost基线；最佳单模型验证R²达到0.864。不确定性量化后校准ECE为0.031（混合）和0.026（β-NLL）。

Insight: 创新点在于首次将基础模型特征提取、异构图注意力机制和分解的不确定性量化统一用于SOC估计；具体包括构建包含空间邻近性、光谱相似性和高程三种关系的异构图，采用混合专家进行多模态融合，以及结合异方差回归和深度集成来分别捕获偶然和认知不确定性。

Abstract: Top-soil organic carbon (SOC) prediction is fundamental to agricultural sustainability, land use policy and fertilization planning. Existing approaches face two limitations: they pair hand-crafted covariates with classical ML or single-modal deep models that miss rich spectral and temporal information, and grid-based architectures ignore the irregular spatial structure of field measurements. We introduce SpTGNN, a multi-modal spatio-temporal graph neural network addressing both. SpTGNN represents soil measurements as nodes in a heterogeneous graph with three edge types (spatial proximity, spectral similarity, elevation), and applies relational graph attention to learn separate patterns per relation. A fine-tuned TerraMind encoder extracts node features from Sentinel-2, Sentinel-1 and DEM signals, combined with per-sample environmental covariates and learned positional and temporal embeddings. A sparse Mixture-of-Experts module fuses the four streams via top-$k$ routing. Uncertainty is captured by pairing heteroscedastic regression (aleatoric) with deep ensembles (epistemic), and a Moran’s $I$ penalty regularizes spatial autocorrelation. We evaluate on a global SOC corpus split into three regional instances ($\sim$49k samples globally, Africa $\sim$26k, Europe $\sim$14k). Our 5-member deep ensemble reports $R^2=0.762$, RMSE $=3.51\pm0.48$ g/kg and MAPE $=22.9%$ on the Africa test split, improving over a tabular XGBoost baseline; the best single checkpoint reaches validation $R^2=0.864$. Ablations confirm the heterogeneous graph, MoE fusion and fine-tuned backbone each contribute substantively, and the ensemble UQ stack achieves post-calibration ECE of $0.031$ (hybrid) and $0.026$ ($β$-NLL). To our knowledge, this is the first framework to unify foundation-model feature extraction, heterogeneous graph attention and decomposed uncertainty quantification for SOC estimation.

[251] Assessing Reliability of Symbol Detection in Concept Bottleneck Models cs.LG | cs.CV | cs.SCPDF

Javier Fumanal-Idocin, Javier Andreu-Perez

TL;DR: 该论文研究了概念瓶颈模型（CBMs）中符号检测的可靠性问题，指出高任务精度并不能保证符号被忠实检测，因为联合训练的CBMs可能在瓶颈层编码任务特定的捷径，导致解释不可靠。作者通过交换独立训练的概念检测器和分类头来评估性能下降、概念级指标和符号不确定性，并提出一种可靠性感知的训练策略，通过优化共享概念检测器并使用多个分类头来惩罚依赖不可靠符号的行为。

Details

Motivation: 动机在于解决概念瓶颈模型在解释性人工智能中符号检测不可靠的问题，即模型可能通过任务特定的捷径进行预测，而非忠实检测人类可解释的符号，从而影响模型解释的可信度。

Result: 在CUB-200-2011数据集上，使用完整概念监督时，检测器和分类头几乎可自由互换（交换后精度下降低于1个百分点，相对保留率超过99%，且所有概念检测均高于随机水平）；在受控合成任务中，随着概念监督权重降低，模型保持接近完美的任务精度，但交换后精度和与真实概念的一致性降至随机水平。可靠性感知训练显著缓解了这种泄漏，在泄漏区域将交换精度大约提高了一倍。

Insight: 创新点包括提出通过交换独立训练的概念检测器和分类头来评估符号检测可靠性的方法，以及引入可靠性感知训练策略来惩罚不可靠符号的使用，从而增强概念瓶颈模型的解释可靠性。从客观角度看，该方法为评估和提升CBM的可靠性提供了新框架，有助于推动可解释AI的实际应用。

Abstract: Concept Bottleneck Models (CBMs) are a relevant tool for explainable Artificial Intelligence because they make their predictions through human-interpretable symbols. However, high task accuracy does not guarantee that these symbols are detected faithfully: jointly trained CBMs may encode task-specific shortcuts in the bottleneck, making their explanations unreliable. In this paper, we study concept-detection reliability by swapping independently trained concept detectors and classification heads that share the same symbolic vocabulary. We use the resulting performance degradation, concept-level metrics, and symbol-wise uncertainty estimates to identify concepts that are especially prone to spurious firing. Finally, we propose a reliability-aware training strategy in which a shared concept detector is optimized with multiple classification heads and penalized for relying on globally or instance-wise unreliable symbols. On CUB-200-2011 with full concept supervision, detectors and heads are almost freely interchangeable (swap drop below one accuracy point, relative retention above $99%$, and no concept detected below chance), whereas on a controlled synthetic task we show that, as the concept-supervision weight is reduced, models keep near-perfect task accuracy while swapped accuracy and agreement with the ground-truth concepts collapse to chance. Our reliability-aware training substantially mitigates this leakage, roughly doubling swap accuracy in the leaky regime.

cs.MA [Back]

[252] Misinformation Propagation in Benign Multi-Agent Systems cs.MA | cs.CLPDF

Jonas Becker, Jan Philip Wahle, Terry Ruas, Bela Gipp

TL;DR: 本文研究了在多智能体系统中，当单个智能体接收到错误或误导性信息时，这些错误信息如何通过智能体间的交互进行传播，并影响系统整体性能。通过在推理、知识和对齐任务中向良性的单智能体及多智能体系统注入基于意图的错误信息，作者发现错误信息会降低单智能体性能，并在多智能体辩论中持续存在，智能体常会保留受误导同伴引入的错误答案。然而，与单智能体提示相比，多智能体辩论能减轻由此导致的性能下降，尤其是在大多数智能体未接触错误信息时。系统的鲁棒性取决于群体构成和决策协议。

Details

Motivation: 随着多智能体系统越来越多地部署在医疗诊断、法律分析和法医决策等高风险领域，其可靠性面临风险：当单个智能体基于来自工具调用等来源的错误或误导性上下文进行推理时，错误可能通过智能体交互传播。本研究旨在探究这种风险。

Result: 在推理、知识和对齐任务上的实验表明，错误信息会降低单智能体性能，并在多智能体辩论中持续存在。但多智能体辩论相比单智能体提示能减少性能下降，尤其在多数智能体未接触错误信息时。共识决策在同伴压力下比投票更稳定，多数派常能将受误导智能体引导回正确答案。

Insight: 创新点在于系统地研究了多智能体系统中错误信息的传播机制及其缓解策略。客观分析表明，该研究揭示了多智能体系统的鲁棒性不仅取决于底层模型，还高度依赖于智能体间信息交换和决策聚合的方式，为设计更可靠的多智能体系统提供了关键洞见，例如群体构成和决策协议（如共识与投票）的重要性。

Abstract: Multi-agent systems, in which multiple large language model agents solve problems through turn-based interaction, are increasingly deployed in high-stakes settings such as medical diagnosis, legal analysis, and forensic decision-making. Their reliability can be at risk when single agents reason from incorrect or misleading context, e.g., from tool calls, since errors may propagate through agent interactions. This work studies this risk by injecting intent-based misinformation into benign single-agent and multi-agent systems across reasoning, knowledge, and alignment tasks. We find that misinformation can degrade single-agent performance and persists across multi-agent debate, with agents often retaining answers introduced by misinformed peers. Nevertheless, multi-agent debate reduces the resulting performance degradation compared to single-agent prompting, especially when most agents are not exposed to misinformation. Robustness depends on group composition and decision protocol. Consensus can be more stable than voting under peer pressure, while majorities can often steer misinformed agents back toward correct answers. Our results show that misinformation robustness in multi-agent systems depends on the underlying model and also on how agents exchange information and aggregate decisions.

cs.AI [Back]

[253] S1-DeepResearch: Beyond Search, Toward Real-World Long-Horizon Research Agents cs.AI | cs.CL | cs.IR | cs.LGPDF

Yao Dong, Xinglin Xiao, Liwei Dong, Xinlong Jin, Zhengbo Li

TL;DR: 本文提出了S1-DeepResearch，一个旨在超越传统搜索、面向真实世界复杂任务的深度研究智能体框架。该工作通过一种统一的轨迹构建范式，结合封闭式问答和开放式探索，生成了覆盖知识合成、复杂推理、规划和报告生成等关键能力的高质量训练数据。基于此训练的32B参数开源模型在多个维度的20个基准测试中达到了同类规模模型的SOTA性能。

Details

Motivation: 现有训练数据集大多以搜索为中心，主要关注封闭式问答和信息定位，导致训练出的智能体在证据整合、知识合成、规划和结构化报告生成等深度研究关键能力上覆盖不足。

Result: S1-DeepResearch-32B在涵盖复杂推理、指令遵循、报告生成、文件理解和技能使用五个能力维度的20个基准测试中，取得了同类规模开源模型中的SOTA性能。在几个具有挑战性的深度研究基准上，其性能接近领先的专有前沿模型。

Insight: 创新点在于提出了一个结合图基任务制定、智能体轨迹展开和多维轨迹验证的统一轨迹构建框架，能够规模化合成高质量、长链、多能力的智能体轨迹。核心洞见是，构建有效的深度研究智能体需要联合建模信息获取、知识合成和面向规划的行为。

Abstract: Deep research agents aim to solve complex knowledge-intensive tasks through long-horizon planning, evidence gathering, reasoning, and report generation. While recent progress in search agents has demonstrated strong capabilities in information retrieval and answer verification, most existing training datasets remain search-centric, focusing primarily on closed-ended question answering and information localization. As a result, they mainly train information-seeking behavior while providing limited coverage of key deep research capabilities, including evidence integration, knowledge synthesis, planning, file understanding, and structured report generation. In this work, we propose a unified trajectory construction paradigm for deep research agents that combines closed-ended QA and open-ended exploration. The proposed framework consists of graph-grounded task formulation, agentic trajectory rollout, and multi-dimensional trajectory verification, enabling scalable synthesis of high-quality agentic trajectories spanning long-chain complex reasoning, deep research instruction following, report writing, file understanding and generation, and skills usage. Compared with existing search-oriented datasets, our synthesized trajectories place greater emphasis on knowledge synthesis, complex reasoning, and planning. S1-DeepResearch-32B achieves state-of-the-art performance among open-source models of comparable scale across 20 benchmarks spanning five capability dimensions, including complex reasoning, instruction following, report generation, file understanding, and skills usage. On several challenging deep research benchmarks, it approaches the performance of leading proprietary frontier models. These results highlight the importance of jointly modeling information acquisition, knowledge synthesis, and planning-oriented agent behaviors for building effective deep research agents.

[254] Agentic Retrieval and Reinforcement Learned Equation Chains: A Controlled Generation Framework for Complex and Novel Physics Word Problems cs.AI | cs.CL | cs.MAPDF

Tirthankar Mittra

TL;DR: 本文提出了一个名为ARVRE的两阶段框架，用于生成新颖、复杂且可解的高质量物理文字问题。该框架第一阶段通过离线时序差分学习构建有效的物理方程链，并利用智能体检索增强生成技术动态选择主题概念和词汇；第二阶段利用大型语言模型将方程链和检索到的概念转化为自然语言问题。

Details

Motivation: 现有方法（多改编自数学文字问题生成）生成的物理问题常存在歧义、不可解或结构简单、语言多样性有限的问题，高质量物理文字问题的生成仍是一个具有挑战性且未被充分探索的领域。

Result: 人工和自动评估表明，ARVRE生成的物理文字问题在复杂性、新颖性和可解性方面均优于现有方法，实现了更可靠的物理教育内容生成。

Insight: 创新点在于将强化学习、检索增强生成和大型语言模型相结合，通过基于有效方程链的生成方式，在确保数学正确性的同时，实现了对问题结构和难度的显式控制，并促进了语言多样性和上下文丰富性。

Abstract: Generating high-quality Physics Word Problems (PWPs) that are novel, complex, and solvable remains a challenging and underexplored problem in educational content generation. Existing approaches, many adapted from Math Word Problem (MWP) generation, often produce ambiguous, unsolvable, or structurally simple questions with limited linguistic diversity. We introduce ARVRE (Agentic Retrieval Value Reinforced Equation-chain), a two-stage framework for generating diverse and mathematically valid PWPs. In the first stage, a form of offline temporal-difference learning is used to construct valid chains of physics equations, while an agentic retrieval-augmented generation (RAG) framework dynamically selects topic-specific concepts and vocabulary. This design enables explicit control over problem structure and difficulty. In the second stage, a Large Language Model (LLM) converts the equation chain and retrieved concepts into a natural-language physics question. By grounding generation in valid equation chains, our method preserves mathematical correctness while promoting linguistic diversity and contextual richness. Human and automated evaluations demonstrate that ARVRE generates PWPs that are more complex, novel, and solvable than those produced by existing approaches. These results highlight the potential of combining reinforcement learning, retrieval, and LLMs for reliable generation of educational physics content.

[255] Know Your Limits : On the Faithfulness of LLMs as Solvers and Autoformalizers in Legal Reasoning cs.AI | cs.CL | cs.LOPDF

Olivia Peiyu Wang, Sanna Wong-Toropainen, Daneshvar Amrollahi, Ryan Bai, Tashvi Bansal

TL;DR: 本文研究了大型语言模型在法律推理任务中的忠实性问题，通过比较纯LLM分类、LLM形式推理和基于Z3求解器的形式推理三种范式，发现尽管引入形式结构能提升基准测试准确率，但LLM的推理过程并不忠实，存在范围漂白、隐式约束盲区和程序合成失败等系统性错误。

Details

Motivation: 动机在于探究LLM在推理任务中的强性能是源于忠实的逻辑推理，还是仅仅是启发式的近似，特别是在需要严格形式化推理的法律蕴涵领域。

Result: 在重新标注的ContractNLI子集上，LLM形式推理取得了最高的基准性能，但研究发现这种性能提升并不代表忠实的推理，并且所有模型都存在范围漂白等失败模式。

Insight: 创新点在于揭示了基准测试准确率与逻辑忠实性之间的根本差距，并识别出LLM作为求解器和自动形式化工具在忠实性上的三种具体、可测量的系统性失败模式，这对评估LLM的推理能力至关重要。

Abstract: Large Language Models (LLMs) achieve strong performance on reasoning tasks, but whether this reflects faithful logical inference or heuristic approximation remains unclear. We study this question in legal entailment by comparing three paradigms, including pure LLM classification, LLM-based Formal Reasoning, and solver-based Formal Reasoning using the Z3 SMT solver, on a re-annotated subset of ContractNLI across five LLMs. Our re-annotation reveals a systematic and measurable gap between pragmatic legal interpretation and strict formal entailment, where a substantial proportion of legally sound inferences are not formally grounded without additional unstated assumptions. While introducing formal structure improves accuracy, with LLM-based Formal Reasoning achieving the highest benchmark performance, we show that this gain does not imply faithful reasoning. We identify three recurring failure modes: scope laundering, where LLMs report solver-inconsistent classifications without executing the underlying formal reasoning, producing conclusions that appear logically grounded but are not; implicit constraint blindness, where LLMs overlook logical constraints present in formal representations; and program synthesis failures, where LLMs generate incorrect Z3 code despite structured prompting. Critically, scope laundering persists across all models, raising serious concerns about the faithfulness of LLM-based formal reasoning as a proxy for symbolic execution. These results reveal a fundamental gap between benchmark accuracy and logical faithfulness.

[256] VibeThinker-3B: Exploring the Frontier of Verifiable Reasoning in Small Language Models cs.AI | cs.CLPDF

Sen Xu, Shixi Liu, Wei Wang, Jixin Min, Yingwei Dai

TL;DR: 本文介绍了VibeThinker-3B，一个拥有30亿参数的紧凑稠密模型，旨在探索在严格的小模型体系下可验证推理能力的极限。通过基于课程学习的监督微调、多领域强化学习和离线自蒸馏等优化流程，该模型在多个高要求的可验证推理基准上达到了前沿性能水平，其表现可与参数量大一个数量级的旗舰模型相媲美甚至超越，同时保持了严格的指令可控性。

Details

Motivation: 研究动机是探索在严格的小模型体系下，可验证推理能力能被推进到何种程度，即验证紧凑模型是否能在核心推理任务上达到与超大模型相当的前沿性能。

Result: 实验结果表明，VibeThinker-3B在多个基准测试中取得了前沿性能：在AIME26上得分为94.3（通过声明级测试时缩放可提升至97.1），在LiveCodeBench v6上Pass@1为80.2，在未见过的近期LeetCode竞赛中表现出强大的分布外泛化能力，接受率达96.1%。其性能与DeepSeek V3.2、GLM-5和Gemini 3 Pro等大一个数量级的旗舰模型相当或超越。在IFEval上93.4的分数证实了其指令可控性未受影响。

Insight: 论文宣称的创新点在于通过优化的Spectrum-to-Signal后训练范式（包括课程学习SFT、多领域RL和离线自蒸馏）系统地增强了小模型的推理能力。从客观角度看，其核心创新在于提出了“参数压缩-覆盖假说”，认为可验证推理可以被压缩进紧凑的“推理核心”，而开放域知识和通用能力则需要广泛的参数来覆盖事实、概念和长尾场景，这为小模型实现前沿性能提供了一条互补路径，而不仅仅是部署高效的替代品。

Abstract: This technical report introduces VibeThinker-3B, a compact dense model with 3B parameters developed to investigate how far verifiable reasoning can be pushed within a strictly small-model regime. Building upon the Spectrum-to-Signal post-training paradigm, we systematically enhance the model through an optimized pipeline that includes curriculum-based supervised fine-tuning, multi-domain reinforcement learning, and offline self-distillation. Experimental evaluations demonstrate that VibeThinker-3B achieves frontier-level performance on highly demanding verifiable tasks. Specifically, it attains a score of 94.3 on AIME26 (improving to 97.1 with claim-level test-time scaling), an 80.2 Pass@1 on LiveCodeBench v6, and exhibits strong out-of-distribution generalization with a 96.1% acceptance rate on recent unseen LeetCode contests. This effectively places it in the performance band of first-tier reasoning systems, matching or exceeding flagship models that are orders of magnitude larger, such as DeepSeek V3.2, GLM-5, and Gemini 3 Pro. Furthermore, a score of 93.4 on IFEval confirms that this extreme reasoning enhancement does not compromise strict instruction controllability. Extending our previous 1.5B work, these findings motivate the Parametric Compression-Coverage Hypothesis, which views verifiable reasoning as compressible into compact reasoning cores, while open-domain knowledge and general-purpose competence require broad parameter coverage over facts, concepts, and long-tail scenarios. This perspective suggests that compact models are not merely deployment-efficient substitutes, but a complementary path toward frontier-level performance in parameter-dense capability regimes.

[257] State-Grounded Multi-Agent Synthetic Data Generation for Tool-Augmented LLMs cs.AI | cs.CLPDF

Rahul Khedar, Eshita, Sneha Teja Sree Reddy Thondapu, Mayank Malhotra, Arup Das

TL;DR: 本文提出了StateGen，一个用于生成工具增强型LLM代理训练数据的合成数据生成平台。该平台通过协调四个角色的LLM循环（用户模拟器、测试代理、状态基础的工具模拟器和多轴LLM评判器）来生成带有评分和丰富推理轨迹的多轮对话数据。其核心架构创新是一个权威的状态管理器，它维护一个结构化的世界状态对象，通过强制’后端为真’的不变性，从根本上消除了工具调用幻觉的主要类别。StateGen通过将子代理声明为工具，自然地扩展到分层多代理设置。

Details

Motivation: 训练工具增强型LLM代理需要大量多轮、工具基础对话数据，而这类数据标注成本高、生产环境中受隐私限制，且在公开数据集中严重缺乏。

Result: 在三个生产语料库的64,698个评估对话中，工具调用幻觉评分达到9.66/10（满分10分）。系统支持通过23维特征向量进行角色驱动的数据变体生成，并且通过干净分离的训练集和黄金评估集划分，确认数据并非简单的记忆复制（通过逐标准差距分析验证）。与八个外部系统的比较表明，没有单一的公开可用平台能同时结合多轮生成、状态基础工具模拟、分层多代理支持和内置评判评分功能。

Insight: 主要创新点在于引入了权威的状态管理器来维护结构化世界状态，并通过’后端为真’的设计不变性从根源上防止工具调用幻觉。平台架构将数据生成过程分解为四个明确的角色，并通过将子代理视为工具，优雅地支持了分层多代理场景的合成数据生成，这为构建复杂、可靠的工具增强型LLM训练数据提供了系统化解决方案。

Abstract: Training tool-augmented LLM agents requires large corpora of multi-turn, tool-grounded conversational data that is expensive to annotate, privacy-constrained in production settings, and largely absent from public datasets. We present StateGen, a synthetic data generation platform that produces scored, reasoning-trace-rich training conversations by orchestrating a four-role LLM loop: a persona-conditioned user simulator, an agent under test, a state-grounded tool simulator, and a multi-axis LLM judge. The key architectural contribution is an authoritative state manager that maintains a structured world-state object across turns, enforcing a backend-is-truth invariant that eliminates the dominant class of tool-call hallucinations by construction. StateGen extends naturally to hierarchical multi-agent settings by declaring sub-agents as tools, all sharing a single state object. We report results on 64,698 evaluated conversations across three production corpora: tool-call hallucination scores reach 9.66/10, the system supports persona-driven variation via a 23-dimensional trait vector, and a cleanly separated train and golden evaluation set split confirms the data is not memorization bait (per-criterion gap analysis). Comparison with eight external systems shows that no single publicly available platform combines multi-turn generation, state-grounded tool simulation, hierarchical multi-agent support, and built-in judge scoring.

[258] OpenClaw-Skill: Collective Skill Tree Search for Agentic Large Language Models cs.AI | cs.CLPDF

Tianyi Lin, Chuanyu Sun, Jingyi Zhang, Changxu Wei, Huanjin Yao

TL;DR: 本文提出了Collective Skill Tree Search（CSTS）框架，用于自动构建可重用的技能树以增强大型语言模型（LLM）在工具使用、多步推理和动态环境交互中的能力。该框架通过集体智能迭代生成和评估技能节点，并引入集体技能强化学习来拓宽解决方案探索空间。最终训练的OpenClaw-Skill模型在长程规划、工具使用和泛化方面表现出色。

Details

Motivation: 为LLM智能体配备有效技能对于解决OpenClaw等现实世界系统中的复杂任务至关重要，旨在开发一个能自动构建可重用技能以增强LLM在工具使用、多步推理和动态环境交互中能力的框架。

Result: 在具有挑战性的基准测试中，训练的OpenClaw-Skill模型在长程规划、工具使用和泛化方面展现出卓越的智能体能力。

Insight: 创新点在于提出了基于树搜索的集体技能树搜索（CSTS）框架，利用集体智能通过迭代生成和评估来构建结构化、多样化和可泛化的技能树，并引入集体技能强化学习以主动选择多个相关技能，避免陷入单一技能导致的同质或次优解。

Abstract: Equipping Large Language Model (LLM) agents with effective skills is crucial for solving complex tasks in real-world systems like OpenClaw. In this work, we aim to develop a framework that automatically constructs such reusable skills to enhance LLMs in tool use, multi-step reasoning, and dynamic environment interaction. To this end, we propose Collective Skill Tree Search (CSTS), a novel tree-search-based skill construction framework that constructs structured, diverse and generalizable tree of skills. The core idea of CSTS is to leverage collective intelligence to jointly search, identify and compose effective skills via two iterative phases: Collective Skill Node Generation (CSN-Gen) and Collective Skill Node Assessment (CSN-Assess). CSN-Gen exploits collective knowledge from multiple models to explore diverse candidate skills for each subtask, enabling comprehensive skill exploration. CSN-Assess employs multiple models as judges to evaluate and select skill nodes with two scoring mechanisms: (1) collective quality scoring that aggregates independent evaluations to produce a robust estimate of skill effectiveness, and (2) collective transferability scoring that explicitly verifies whether a skill generalizes well across different models. With CSTS, we construct a set of comprehensive tree of skills along with skill-augmented training data, enabling models to effectively learn and utilize skills. Besides, we introduce Collective Skill Reinforcement Learning, which actively selects multiple relevant skills from the tree to broaden solution-space exploration, avoid being trapped by a single skill and its resulting homogeneous or suboptimal solutions. As a result, our trained model, OpenClaw-Skill, exhibits outstanding agentic capabilities in long-horizon planning, tool use and generalization over challenging benchmarks.

[259] Scaling LLM Reasoning from Minimal Labels: A Semi-Supervised Framework with a Lightweight Verifier cs.AI | cs.CLPDF

Keizo Kato, Chenhui Chu, Yugo Murawaki, Sado Kurohashi

TL;DR: 本文提出了一种半监督框架，通过轻量级验证器从少量标注数据中扩展大语言模型的推理学习。该方法利用一个基于少量标注样本训练的分类器来评估LLM生成的中间推理轨迹的有效性，并结合基于熵的置信度阈值过滤不可靠样本，从而利用高置信度的伪标签微调模型。

Details

Motivation: 现有生成伪中间推理的方法通常依赖大量正确标注的答案来评估推理质量，这需要高昂的标注成本。本文旨在通过轻量级的推理验证机制，仅需少量监督即可扩展推理学习，降低对标注数据的依赖。

Result: 在Verifiable Math Problems（Orca-Math子集）和Question Answering on Image Scene Graphs（GQA）的Visual Programming任务上的实验表明，该方法仅使用1/10到1/15的标注数据即可达到与使用全量标注数据相当的准确率。消融分析证实了分类器和熵过滤对于可扩展且抗噪声的伪标注至关重要。

Insight: 创新点在于将推理验证本身转化为数据创建机制，通过轻量级分类器和熵过滤实现高效的伪标签生成。这为构建大规模推理资源提供了一条实用路径，并为未来从最少人类输入中学习的自主推理系统奠定了基础。

Abstract: For the development of Large language models (LLMs), recent approaches to generating pseudo intermediate reasoning have shown remarkable progress. But they typically rely on large numbers of correctly annotated answers to assess reasoning quality. This paper presents a semi-supervised framework that scales reasoning learning from minimal supervision, turning reasoning verification itself into a data creation mechanism. We train a lightweight reasoning-correctness classifier on only a few labeled samples, which judges whether intermediate reasoning traces generated by an LLM are valid. Furthermore, an entropy-based confidence threshold filters out unreliable samples, and the remaining high-confidence reasoning traces are used to fine-tune the model. Experiments on Verifiable Math Problems (Orca-Math subset) and Question Answering on Image Scene Graphs (GQA) with Visual Programming show that our method achieves accuracy comparable to using 10-15x more labeled data. Ablation analyses confirm that both the classifier and entropy filtering are essential for scalable and noise-resistant pseudo-labeling. By replacing expensive answer-level supervision with lightweight reasoning verification, our method provides a practical path toward constructing large-scale reasoning resources and paves the way for future autonomous reasoning systems that learn from minimal human input.

[260] Mitigating Visual Hallucinations in Multimodal Systems through Retrieval-Augmented Reliability-Aware Inference cs.AI | cs.CVPDF

Pratheswaran Hariharan, Haiping Xu, Donghui Yan

TL;DR: 本文提出了一种检索增强的可靠性感知推理框架，旨在缓解多模态大语言模型（MLLMs）中的视觉幻觉问题。该框架通过构建外部视觉证据数据库，利用检索到的证据计算多个可靠性指标来评估预测的可信度，并基于此通过决策门控机制选择接受预测、谨慎回答或弃权，从而在无需重新训练大模型的情况下提升预测的校准度并减少过度自信的错误。

Details

Motivation: 多模态大语言模型在视觉证据薄弱、模糊或语义不一致时，容易产生过度自信的预测和类似幻觉的输出。现有方法主要关注改进多模态表示对齐或检索增强生成，但缺乏量化实例级预测可靠性或识别错误视觉输出的机制。

Result: 在ImageNet-100基准上的实验表明，该框架在89.04%的覆盖率下，将接受的预测准确率从85.84%提升至88.88%，并将类似幻觉的接受错误答案率从14.16%降低至11.12%。

Insight: 创新点在于将检索证据、可靠性估计（包括相似度强度、类别支持一致性、证据边际、基于熵的不确定性等指标）和选择性决策门控集成到一个统一的推理框架中，实现了对预测可靠性的实例级量化与主动管理，为构建可信赖的多模态系统提供了一种无需重新训练大模型的有效途径。

Abstract: Multimodal large language models (MLLMs) have demonstrated strong capabilities in vision-language understanding and natural-language response generation. However, these systems can still produce overconfident predictions and hallucination-like outputs, particularly when the visual evidence is weak, ambiguous, or semantically inconsistent. Most existing approaches focus on improving multimodal representation alignment or retrieval-augmented generation, while providing limited mechanisms to quantify instance-level prediction reliability or identify incorrect visual outputs. This work proposes a retrieval-augmented reliability-aware inference framework for trustworthy multimodal visual understanding. The proposed framework constructs an external visual evidence database using pretrained visual embeddings and nearest-neighbor retrieval over normalized feature representations. Retrieved evidence is used to estimate prediction trustworthiness through multiple reliability indicators, including similarity strength, class-support agreement, evidence margin, entropy-based uncertainty, and an aggregate reliability score. Based on these signals, a decision gate determines whether the system should accept the prediction, answer with caution, or abstain/fallback when evidence is insufficient. A multimodal response-generation layer then produces a final user-facing response conditioned on the reliability decision. Experiments on ImageNet-100 demonstrate that the proposed reliability-aware framework improves accepted prediction accuracy from 85.84% to 88.88% at 89.04% coverage. The hallucination-like accepted wrong-answer rate is reduced from 14.16% to 11.12%. These results show that integrating retrieval evidence, reliability estimation, and selective decision gating can improve calibration and reduce overconfident visual errors without retraining large multimodal models.

[261] Kairos: A Native World Model Stack for Physical AI cs.AI | cs.CVPDF

Kairos Team, Fei Wang, Shan You, Qiming Zhang, Tao Huang

TL;DR: Kairos是一个专为物理AI设计的原生世界模型堆栈，通过跨具身数据课程实现原生预训练，采用混合线性时间注意力的统一架构进行世界理解、生成与预测，并结合部署感知的系统协同设计，以在服务器和消费级硬件上支持低延迟的观察-行动-反馈循环。

Details

Motivation: 解决世界模型从被动视觉生成器向物理AI基础操作基础设施的转型需求，使其能够从异构经验中获取世界知识、在长时域中保持持久状态，并在实际部署约束下高效执行。

Result: 在具身世界模型、长时域和行动策略基准测试中，Kairos实现了顶级性能，并在效率与能力之间提供了良好的权衡。

Insight: 创新点包括跨具身数据课程的原生预训练范式、混合线性时间注意力架构（结合滑动窗口、扩张滑动窗口和门控线性注意力）以限制误差积累的理论保证，以及部署感知的系统协同设计，为自进化物理智能提供了统一的操作基础。

Abstract: World models are transitioning from passive visual generators to foundational, operational infrastructure for Physical AI: they must natively acquire world knowledge from heterogeneous experience, maintain persistent states over long horizons, and execute efficiently within real deployment constraints. We introduce Kairos, a native world model stack designed around these requirements. (1) Kairos learns the world by pioneering a Native Pre-training Paradigm governed by a Cross-Embodiment Data Curriculum, which organizes open-world videos, human behavioral data, and robot interactions into a progressive developmental pathway. (2) Kairos maintains the world by unified world understanding, generation, and prediction within a Native Unified Architecture equipped with Hybrid Linear Temporal Attention, where sliding-window attention captures local dynamics, dilated sliding windows capture mid-range dependencies, and gated linear attention maintains persistent global memory. We establish formal theoretical bounds demonstrating that this temporal factorization strictly limits error accumulation, mathematically guaranteeing state propagation across extended horizons. (3) Kairos runs the world by incorporating a Deployment-Aware System Co-Design to support low-latency rollout generation on server and consumer-grade hardware for real-world observation-action-feedback loops. Experiments on embodied world-model, long-horizon, and action-policy benchmarks show that Kairos achieves top level performance while offering a strong efficiency-capability trade-off. Together, these results position Kairos as a cohesive operational foundation for future self-evolving physical intelligence.

cs.IR [Back]

[262] MAGE-RAG: Multigranular Adaptive Graph Evidence for Agentic Multimodal RAG in Long-Document QA cs.IR | cs.AI | cs.CL | cs.DB | cs.MMPDF

Yilong Zuo, Xunkai Li, Jing Yuan, Qiangqiang Dai, Hongchao Qin

TL;DR: MAGE-RAG是一个用于长文档多模态问答的多粒度自适应图证据框架。它通过离线构建包含页面和元素的证据图，并在查询时动态激活、搜索和剪枝证据子图，以平衡证据覆盖范围与上下文噪声控制。

Details

Motivation: 解决现有RAG方法在长文档多模态问答中面临的挑战：文本检索会丢失视觉和布局信息，而页面级视觉检索则会引入大量无关区域，导致证据覆盖、噪声和推理成本之间的静态权衡问题。

Result: 在LongDocURL和MMLongBench-Doc基准测试上，MAGE-RAG分别达到了52.75%和53.26%的总体准确率（后者F1分数为51.19）。实验表明其查询时证据子图构建方法能有效平衡分散的证据覆盖与上下文噪声控制。

Insight: 创新点在于提出了一个多粒度自适应图证据框架，通过离线构建结构化证据图（编码包含、阅读顺序、布局邻接、章节层次和语义邻居关系）和查询时动态证据控制器，实现了在明确预算下对紧凑且相关证据的智能检索与呈现。

Abstract: Long-document multimodal question answering requires a system to locate sparse evidence in long PDFs and integrate clues from text, tables, images, charts, and complex layouts. Existing RAG methods mostly rely on fixed Top-k retrieval over text chunks or pages. Text retrieval can compress the context but often loses visual and layout information; page-level visual retrieval preserves the original page, yet it also sends large irrelevant regions to the reader, leading to a static trade-off among evidence coverage, noise, and inference cost. This paper proposes MAGE-RAG, a multigranular adaptive graph evidence framework for long-document multimodal QA. MAGE-RAG uses page retrieval as the entry point for query-time evidence construction. Offline, it builds an evidence graph with page nodes and element nodes, encoding containment, reading order, layout adjacency, section hierarchy, and semantic-neighbor relations. At query time, an online evidence controller iteratively activates, opens, searches, and prunes evidence under explicit budgets. The resulting evidence subgraph is then rendered into structured multimodal reader input, allowing the LVLM to consume compact and relevant evidence within a limited context. On LongDocURL and MMLongBench-Doc, we establish a unified comparison and analysis protocol covering Direct MLLM, Text RAG, Page-level Visual RAG, and Graph/Agentic RAG. Experiments show that MAGE-RAG achieves 52.75 overall accuracy on LongDocURL, and 53.26 accuracy with 51.19 F1 on MMLongBench-Doc. Fine-grained breakdowns, budget-performance curves, ablations, and trace-based analysis further show that query-time evidence subgraph construction can balance dispersed evidence coverage with context-noise control. Our code is available at https://github.com/laonuo2004/MAGE-RAG.git.

[263] Entity Labels Are Not Entity Signals: A Framework for Observable Relevance in Document Re-Ranking cs.IR | cs.AI | cs.CL | cs.LGPDF

Utshab Kumar Ghosh, Shubham Chatterjee

TL;DR: 本文提出了一种新的实体相关性框架，区分了概念实体相关性（CER）和可观测实体相关性（OER）。研究发现，传统基于CER的实体检索假设存在缺陷，因为实体链接器的不完美会导致实体信号缺乏区分度。通过将监督信号与OER对齐，可以显著提升文档重排中非相关文档的剪枝效果和检索性能。

Details

Motivation: 传统实体感知文档检索假设与查询语义相关的实体就是有用的检索信号，但作者发现这一假设不足，因为实体链接器可能无法区分相关与非相关文档，导致实体信号失效。

Result: 在四个数据集和人工实体标注上，CER与OER的一致性接近随机（κ≈0），而OER的不同操作化方式间一致性较高（κ≈0.5）。基于OER的监督方法将非相关文档剪枝效果提升高达10倍，并在开放世界MAP上比BM25提高了0.051。

Insight: 创新点在于形式化区分了CER和OER，揭示了实体标签不等于实体信号，并倡导在实体感知检索中从概念相关性转向可观测相关性。这为设计更鲁棒的实体检索模型提供了新的理论框架和监督信号来源。

Abstract: Entity-aware document retrieval uses query-associated entities as ranking signals, assuming that semantically relevant entities are also useful retrieval signals. We show this assumption is insufficient- and explain why. Unlike terms, which are ground-truth observations, entity links are hypotheses produced by an imperfect linker: an entity can be topically central yet provide no discriminative signal if the linker fires indiscriminately across relevant and non-relevant documents. We formalize this as a distinction between Conceptual Entity Relevance (CER)- whether an entity is topically related to a query- and Observable Entity Relevance (OER)- whether its observed presence in a collection discriminates relevant from non-relevant documents. Across four collections and annotation sources including human entity judgments, CER and OER exhibit near-chance agreement ($κ\approx 0$), while OER operationalizations agree substantially ($κ\approx 0.5$), confirming CER as the systematic outlier. CER-based supervision selects topically plausible but weakly discriminative entities, pruning fewer than 4% of non-relevant documents on some collections. Aligning supervision with OER improves non-relevant pruning by up to 10x and open-world MAP by 0.051 over BM25. Our findings motivate a shift from conceptual to observable notions of entity relevance in entity-aware retrieval.

Table of Contents

cs.CL [Back]

[1] CoRA: Confidence-Rationale Alignment for Reliable Chain-of-Thought Reasoning cs.CLPDF

[2] Nemotron 3 Ultra: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning cs.CL | cs.AI | cs.LGPDF

[3] Context Compression Is Not One Thing: Readable Symbolic Re-expression vs. Coherent Summary at Matched Budget cs.CLPDF

[4] Are Online Skill and Memory Modules Always Worth Their Tokens? A Budget-Constrained Study of Web Agents cs.CLPDF

[5] Deep Temporal Modeling and Ensemble Fusion for Multimodal Emotion Recognition from Physiological Signals cs.CLPDF

[6] ReportQA: QA-Based Radiology Report Evaluation cs.CL | cs.CVPDF

[7] Equity with Efficiency: An Empirical Study of Tokenizers for Multilingual Large Language Models cs.CLPDF

[8] Stop When Further Reasoning Won’t Help: Attention-State Adaptive Generation in Reasoning Models cs.CLPDF

[9] AdaMame: A Training Recipe for Adaptive Multilingual Reasoning cs.CL | cs.AIPDF

[10] Ling and Ring 2.6 Technical Report: Efficient and Instant Agentic Intelligence at Trillion-Parameter Scale cs.CL | cs.AIPDF

[11] When Cognitive Graphs Meet LLMs: BDEI Cognitive Pathways for Panic Emotional Arousal Prediction cs.CLPDF

[12] Can Agents Read the Room? Benchmarking Visual Social Intelligence in Multimodal Simulation cs.CLPDF

[13] Adapting Reinforcement Learning with Chain-of-Thought Supervision for Explainable Detection of Hateful and Propagandistic Memes cs.CL | cs.AIPDF

[14] Prior over Evidence: Stereotype-Driven Diagnosis in LLM-Based L2 Pronunciation Feedback cs.CLPDF

[15] Replay What Matters: Off-Policy Replay for Efficient LLM Reinforcement Unlearning cs.CL | cs.LGPDF

[16] Let LLMs Judge Each Other: Multi-Agent Peer-Reviewed Reasoning for Medical Question Answering cs.CL | cs.AIPDF

[17] Pepti-Agent: An AI Agent for Peptide Design and Optimization cs.CL | q-bio.BMPDF

[18] Beyond English: Uncovering the Multilingual Gap in Vision-Language-Action Models cs.CL | cs.ROPDF

[19] Vernier: Probing Representational Misalignment Behind Lexical Gaps in Causal Reasoning cs.CL | cs.AIPDF

[20] EHRNote-ChatQA: A Benchmark for Evidence-Grounded Multi-Turn Clinical Question Answering over Longitudinal Discharge Summaries cs.CL | cs.AIPDF

[21] ttda704 at SemEval-2026 Task 6: Structured Chain-of-Thought Prompting for Political Evasion Detection cs.CLPDF

[22] The Truth Stays in the Family: Enhancing Contextual Grounding via Inherited Truthful Heads in Model Lineages cs.CL | cs.AI | cs.LGPDF

[23] When Correct Edges Cannot Be Verified: A Provenance Gap in Incomplete KGQA and a Provenance-Favoring Completion Policy cs.CLPDF

[24] SciOrch: Learning to Orchestrate Expert LLMs for Solving Frontier Multimodal Scientific Reasoning Tasks cs.CLPDF

[25] Free Energy Heuristics: Fast-And-Frugal Cognition as Active Inference Under Uncertain Precision cs.CL | cs.AIPDF

[26] Neuron Level Analysis of Large Language Model in Legal Domain Reasoning cs.CLPDF

[27] BALTO: Balanced Token-Level Policy Optimization for Hallucination Mitigation cs.CLPDF

[28] Calibrated Triage, Not Autonomy: Confidence Estimation for Medical Vision-Language Models cs.CLPDF

[29] Interactor: Agentic RL oriented Iterative Creation for Ad Description Generation in Sponsored Search cs.CL | cs.IRPDF

[30] Beyond NL2Code: A Structured Survey of Multimodal Code Intelligence cs.CLPDF

[31] SAG: SQL-Retrieval Augmented Generation with Query-Time Dynamic Hyperedges cs.CLPDF

[32] Formalize Once, Edit the Rest: Efficient Lean-Based Answer Selection for Math Reasoning cs.CL | cs.AI | cs.LGPDF

[33] A Large-Scale Multi-Dimensional Empirical Study of LLMs for Conversation Summarization cs.CLPDF

[34] Bridging the Usability Gap: Lessons from Interpreting Studies for Machine Interpreting Design cs.CL | cs.HCPDF

[35] Scaling Human and G2P Supervision for Robust Phonetic Transcription cs.CL | cs.LG | cs.SDPDF

[36] From Argument Components to Graphs: A Multi-Agent Debate with Confidence Gating for Argument Relations cs.CLPDF

[37] Towards Pareto-Optimal Tool-Integrated Agents with Pareto Ranking Policy Optimization cs.CLPDF

[38] XAI-Grounded Explanation Generation for Speech Deepfake Detection with Training-Free Multimodal Large Language Models cs.CL | cs.AIPDF

[39] GRACE: Step-Level Benchmark for Faithful Reasoning over Context cs.CLPDF

[40] Weaving Multi-Source Evidence for Biomedical Reasoning: The BioMedHop Benchmark and BioWeave Framework cs.CLPDF

[41] Who Should Lead Decoding Now? Tracking Reliable Trajectories for Ensembling Masked Diffusion Language Models cs.CL | cs.AIPDF

[42] PACT: Privileged Trace Co-Training for Multi-Turn Tool-Use Agents cs.CL | cs.AI | cs.LGPDF

[43] HiMPO: Hindsight-Informed Memory Policy Optimization for Less-Entangled Credit in Long-Horizon Agents cs.CL | cs.LGPDF

[44] PaperJury: Due-Process Review for Bounded LaTeX Revision cs.CLPDF

[45] Tyler: Typed Latent Reasoning for Language Models – When to Think, What to Compute, and How Much to Allocate cs.CL | cs.AIPDF

[46] TMASC: Transmasculine Attitude and Speech Corpus cs.CLPDF

[47] A Mechanistic Understanding of Pronoun Fidelity in LLMs cs.CL | cs.LGPDF

[48] PathRouter: Aligning Rewards with Retrieval Quality in Agentic Graph Retrieval-Augmented Generation cs.CLPDF

[49] From Awareness to Adherence: Bridging the Context Gap in Spoken Dialogue Systems via Context-Aware Decoding cs.CLPDF

[50] LectūraAgents: A Multi-Agent Framework for Adaptive Personalized AI-Assisted Learning and Embodied Teaching cs.CL | cs.AI | cs.HCPDF

[51] REFLEX: Reflective Evolution from LLM Experience cs.CL | cs.LGPDF

[52] Can LLM Coding Agents Reason About Time Series? cs.CLPDF

[53] Lost at the End: Primacy Bias in Multimodal Retrieval-Augmented Question Answering cs.CL | cs.AI | cs.CVPDF

[54] Can LLM Agents Infer World Models? Evidence from Agentic Automata Learning cs.CLPDF

[55] Uncertainty Is Not a Safety Net for Clinical VQA, but Can It Anticipate Model Failure? cs.CLPDF

[56] VeriGraph: Towards Verifiable Data-Analytic Agents cs.CL | cs.AIPDF

[57] Islamic Large Language Models: From Knowledge Acquisition to Trustworthy and Hallucination-Resistant AI cs.CLPDF

[58] Multi-Turn Reflective Masking Elicits Reasoning in Mask Diffusion Models cs.CLPDF

[59] Connecting Speech to Words through Images cs.CLPDF

[60] LLM-based Visual Code Completion for Aerospace Geometric Design cs.CLPDF

[61] Understanding the Behaviors of Environment-aware Information Retrieval cs.CL | cs.IRPDF

[62] Data-Driven Decoding of Russell’s Circumplex Model of Affect cs.CLPDF

[63] Follow the Latent Roadmap: Navigating Revocable Decoding for Diffusion LLMs with Anchor Tokens cs.CL | cs.AIPDF

[64] Robust Dual-Signal Fusion: Hybrid Neuro-Symbolic Gating with Compressed Chain-of-Thought Refinement for Irony Detection in Social Media Texts cs.CL | cs.AIPDF

[65] Compositional Reasoning Depth Predicts Clinical AI Failure: Empirical Evidence Consistent with Transformer Compositionality Limits in Electronic Health Record Question Answering cs.CL | cs.AIPDF

[66] Contrastive-Difference CKA Reveals Concept-Specific Structural Alignment Across Language Model Architectures cs.CLPDF

[67] Exploring Extrinsic and Intrinsic Properties for Effective Reasoning with Code Interpreter cs.CL | cs.LGPDF

[68] DEEPRUBRIC: Evidence-Tree Rubric Supervision for Efficient Reinforcement Learning of Deep Research Agents cs.CLPDF

[69] Context-Aware RL for Agentic and Multimodal LLMs cs.CL | cs.CVPDF

[70] Benchmarking LLM Agents on Meta-Analysis Articles from Nature Portfolio cs.CL | cs.IRPDF

[71] The Value Axis: Language Models Encode Whether They’re on the Right Track cs.CLPDF

cs.CV [Back]

[72] AI for Maritime Security: Comparative Evaluation of CNN and Vision Transformer Architectures for Maritime Object Detection cs.CVPDF

[73] VigilFormer: Deformable Attention for Video Anomaly Detection with Causal Risk Inference cs.CV | cs.AIPDF

[74] Disagreement-Based Cross-Model Routing for Implicit Video Question Answering cs.CVPDF

[75] Interpolation between Convolution and Attention via K-Nearest Neighbors cs.CVPDF

[76] FUSE: Quantifying Uncertainty in Vision-Language Models by Bayesian Fusing Epistemic and Aleatoric Uncertainty cs.CVPDF

[77] Hierarchical GRU with Input-Conditioned Slot Queries for Ball Action Anticipation cs.CVPDF