cs.CL [Total: 12]
cs.CV [Total: 60]
cs.RO [Total: 8]
cs.CR [Total: 1]
cs.LG [Total: 7]
eess.IV [Total: 1]
cs.AR [Total: 1]
cs.AI [Total: 5]

cs.CL [Back]

[1] Graph-Based Phonetic Error Correction of Noisy ASR cs.CL | cs.SDPDF

Pratik Rakesh Singh, Mohammadi Zaki, Aneesh Mukkamala, Pankaj Wasnik

TL;DR: 本文提出了一种名为G-SPIN的结构化ASR错误纠正框架，旨在解决自动语音识别系统中由语音相似性引起的、对语义关键令牌（如命名实体、否定词）影响较大的残余词汇错误。该方法将语音图建模与上下文语言理解相结合，通过图神经网络构建语音候选邻域，再使用掩码语言模型和指令调优的大语言模型进行评分和重排序，从而在推理时实现轻量、模块化的错误纠正。

Details

Motivation: 动机在于解决ASR系统虽然整体词错误率低，但残余的、结构化的词汇错误（源于语音相似性而非随机噪声）对语义关键令牌影响显著的问题，而简单的令牌级纠正方法对此类错误效果不足。

Result: 论文表明，该方法通过解耦结构化的语音推理和上下文语义选择，避免了无约束的生成，同时提高了纠正准确性。

Insight: 创新点在于提出了一种结合语音图（GNN建模）与上下文语言模型（MLM和指令调优LLM）的模块化框架，将纠正搜索空间显式限制在语音替代方案上，从而更有效地处理ASR中的结构化语音错误。

Abstract: Automatic speech recognition (ASR) systems, despite low overall word error rates, produce residual lexical errors that disproportionately affect semantically critical tokens such as named entities, negations, and sentiment-bearing words. These errors are often structured, arising from phonetic similarity rather than random noise, making naive token-level correction insufficient. We propose a structured ASR correction framework, that we call G-SPIN, that combines phonetic graph modeling with contextual language understanding. A graph neural network (GNN) first constructs acoustically plausible candidate neighborhoods for flagged tokens, explicitly restricting the correction search space to phonetic alternatives. A masked language model (MLM) then provides local contextual scoring, and an instruction-tuned large language model (LLM) performs final context-aware re-ranking over this compact candidate set. By decoupling structured phonetic reasoning from contextual semantic selection, our method avoids unconstrained generation while improving correction accuracy. The framework is lightweight, modular, and operates entirely at inference time.

[2] Hybrid-IR: Dual-Path Hybrid Retrieval with Iterative Reasoning for Complex Medical Question Answering cs.CLPDF

Sheng Wan, Jiahui Zhang, Zicheng Zhao, Shougang Ren

TL;DR: 本文提出了一种名为Hybrid-IR的双路径混合检索框架，用于复杂医学问答任务。该框架结合了基于图的检索路径（用于探索结构化知识）和密集检索路径（用于细粒度语义匹配），并通过迭代的检索-推理循环机制来逐步优化推理轨迹，以解决现有检索增强生成方法在医学知识碎片化和静态检索策略方面的局限性。

Details

Motivation: 现有检索增强生成方法在复杂医学问答中存在两个基本限制：一是医学知识通常分散在不同文档中，而单一路径检索难以同时保留细粒度语义信息和结构化全局关联；二是静态检索策略不足以支持复杂医学问答所需深度推理。

Result: 在三个广泛使用的医学问答基准测试上的实验证明了Hybrid-IR的有效性。

Insight: 主要创新点在于提出了一个集成了图检索和密集检索的双路径混合检索框架，并引入了迭代的检索-推理循环机制，以协同利用结构化全局关联和细粒度语义信息，从而支持对分散知识的深度推理。

Abstract: Large language models (LLMs) have shown promising performance across a wide range of biomedical applications, including medical question answering (QA), yet they remain prone to hallucinations and outdated knowledge. Although retrieval-augmented generation (RAG) can alleviate this issue by incorporating external documents, there still exist two fundamental limitations. First, medical knowledge is often fragmented across documents, while most RAG methods rely on a single retrieval path, which makes it challenging to jointly preserve fine-grained semantic information and structured global associations. Second, static retrieval strategies are typically insufficient to support deep reasoning that is important in complex medical QA. In this paper, we present a dual-path retrieval framework with an iterative retrieval-reasoning mechanism termed “Hybrid-IR” for complex medical QA. The proposed Hybrid-IR integrates graph-based retrieval for exploration of structured knowledge and dense retrieval for fine-grained semantic matching. Moreover, the reasoning trajectory can be progressively refined through an iterative retrieve-reason loop. Experiments on three widely used medical QA benchmarks demonstrate the effectiveness of our Hybrid-IR.

[3] Efficient and Trainable Language Model Test-Time Scaling via Local Branch Routing cs.CLPDF

Yutong Yin, Mingyu Jin, Jin Pan, Changyi Yang, Zijie Xia

TL;DR: 本文提出了局部分支路由（LBR），一种用于语言模型测试时扩展的令牌级框架。它通过扩展一个小的局部前瞻树，将所有采样的分支通过语言模型前向传播，并使用轻量级路由器选择要提交的深度为1的子树。这种方法允许每个令牌决策利用超出根节点下一个令牌分布的证据，同时避免了完整的解决方案级搜索。

Details

Motivation: 现有的测试时扩展方法面临权衡：长链思维采样保持单线程，而句子或解决方案级搜索计算成本高且难以端到端训练。LBR旨在提供一种高效、可训练且离散的语言模型测试时扩展形式。

Result: 在合成层次规划任务上，LBR表明候选后隐藏状态提供了有用的路由证据。在数学推理基准测试中，LBR在Pass@1和Pass@32上均优于离散链思维、普通离散令牌RLVR以及RL兼容的软令牌分支基线方法。

Insight: 创新点在于提出了一个轻量级的局部分支路由框架，通过修剪-转移-生长的解码过程保留了离散分支身份，并定义了可处理的树轨迹似然，从而实现了可验证奖励的端到端强化学习。这为语言模型的测试时扩展提供了一种高效且可训练的离散方法。

Abstract: Test-time scaling improves language-model reasoning, but existing approaches often face a difficult trade-off: long chain-of-thought sampling remains single-threaded, while sentence- or solution-level search can be computationally expensive and hard to train end-to-end. We introduce Local Branch Routing (LBR), a token-level test-time scaling framework that expands a small local lookahead tree, forwards all sampled branches through the language model, and uses a lightweight router to select the depth-1 subtree to commit. By routing over the hidden states of candidate local futures, LBR allows each token decision to use evidence beyond the root next-token distribution while avoiding full solution-level search. The resulting prune-shift-grow decoding process preserves discrete branch identities and defines a tractable tree-trajectory likelihood: newly grown nodes are counted when first sampled, and router decisions are assigned explicit probabilities. This enables end-to-end reinforcement learning with verifiable rewards, jointly optimizing the base model and router under the same likelihood-ratio principle as discrete-token RLVR. On synthetic hierarchical-planning tasks, LBR shows that post-candidate hidden states provide useful routing evidence. On mathematical reasoning benchmarks, LBR improves both Pass@1 and Pass@32 over discrete chain-of-thought, vanilla discrete-token RLVR, and RL-compatible soft-token branching baselines. These results suggest that lightweight local branching offers an efficient, trainable, and discrete form of language-model test-time scaling.

[4] Beyond Next-Observation Prediction: Agent-Authored World Modeling for Sequential Decision Making cs.CLPDF

Guangfeng Cai, Kaibing Yang, Shuo He, Yu Li, Shengtian Yang

TL;DR: 本文提出了一种名为Agent-Authored World Modeling（AAWM）的新训练方法，用于大型语言模型（LLM）智能体的世界建模。该方法的核心思想是，将监督信号从传统的下一观测预测，转变为基于智能体自身决策需求来构建训练目标，从而学习对决策至关重要的环境动态。

Details

Motivation: 现有基于LLM智能体的世界建模研究通常将学习目标设定为下一观测预测，但这种目标将监督与过渡中偶然揭示的内容绑定，可能忽略了与智能体当前决策最相关的动态。

Result: 实验结果表明，AAWM在多种环境和训练设置下均有效，证明了决策感知的世界模型目标比下一观测预测提供了更有效的学习信号。

Insight: 主要创新点在于将世界建模的监督信号从被动地重建下一观测，转变为主动地根据策略的决策需求来检索和合成相关的过渡证据，从而学习决策导向的动态，使训练目标与策略行动前所需的动态知识对齐。

Abstract: Recent studies on world modeling for Large Language Model (LLM) agents typically formulate the learning objective as next-observation prediction. However, this objective ties supervision to what a transition happens to reveal, which may omit the dynamics most relevant to the agent’s current decision. To bridge this gap, we propose Agent-Authored World Modeling (AAWM), a training procedure that constructs supervision from the policy’s own decision needs. Specifically, at each state, the agent identifies what it needs to understand about the environment before acting. These needs drive the retrieval of relevant transition evidence across trajectories, which is then synthesized into training targets that capture decision-oriented dynamics instead of reconstructing the next observation. This aligns the training objective with the dynamics the policy needs before acting, not with the contents of the next observation. Experimental results validate the effectiveness of AAWM across multiple environments and training settings. These results show that decision-aware world-model targets provide a more effective learning signal than next-observation prediction.

[5] PolicyAlign: Direct Policy-Based Safety Alignment for Large Language Models cs.CLPDF

Chang Wu, Junfeng Fang, Houcheng Jiang, Kai Tang, Pengyu Cheng

TL;DR: 本文提出PolicyAlign框架，用于直接基于自然语言安全策略对齐大语言模型（LLMs），无需依赖高质量监督数据。该方法通过合成违反策略的指令，并进行策略内自蒸馏来内化策略引导的行为，同时引入策略敏感过滤以提高训练稳定性和数据效率。实验表明，PolicyAlign能持续提升模型安全性，保持较低的过度拒绝率，并保留通用能力，且可推广至医疗、法律和金融等安全场景。

Details

Motivation: 现实部署中，新兴安全需求常以自然语言策略形式指定，而相应监督数据可能成本高、延迟或不可用，导致快速演变的安全策略与依赖数据的传统对齐方法不匹配。

Result: 在多个模型上的实验显示，PolicyAlign一致性地提高了安全性，同时维持低过度拒绝率并保留通用能力；在医疗、法律和金融安全场景中展现出泛化能力。

Insight: 创新点在于直接基于自然语言策略进行对齐，通过策略违反指令合成和策略内自蒸馏实现，策略敏感过滤机制提升了效率；从客观角度看，该方法提供了一种可扩展且可维护的策略驱动对齐途径，减少了对标注数据的依赖。

Abstract: Safety alignment of large language models (LLMs) typically depends on high-quality supervision data, such as safe demonstrations or preference pairs. However, in real-world deployment, emerging safety requirements are often specified as natural-language policies, while corresponding supervision data may be costly, delayed, or unavailable. This creates a mismatch between rapidly evolving safety policies and conventional data-driven alignment methods. To address this, we propose PolicyAlign, a simple yet effective framework for directly aligning LLMs with safety policies. Given a safety policy, PolicyAlign first synthesizes policy-violating instructions and then performs on-policy self-distillation to internalize policy-guided behavior. To improve training stability and data efficiency, we further introduce Policy-Sensitive Filtering, which selects instructions where the policy induces the largest behavioral shift. Experiments across multiple models show that PolicyAlign consistently improves safety while maintaining low over-refusal and preserving general capabilities. PolicyAlign also generalizes to medical, legal, and financial safety scenarios, highlighting its potential as a scalable and maintainable approach to policy-based LLM safety alignment. The code is released at https://github.com/Qwen-Applications/PolicyAlign.

[6] Riazi-8B: An Urdu Large Language Model for Mathematical Reasoning cs.CLPDF

Azher Ali, Ibtsam Haider, Raja Khurram Shahzad, Seemab Latif, Mehwish Fatima

TL;DR: 本文介绍了Riazi-8B，一个专门为乌尔都语数学推理设计的大语言模型。该模型通过两步适应过程开发：在乌尔都语维基百科上进行持续预训练，然后在源自GSM8K的乌尔都语思维链数据上进行监督微调。研究旨在解决乌尔都语等低资源语言中缺乏推理导向资源和模型的问题。

Details

Motivation: 现有LLM的数学推理能力提升严重依赖英语中心的训练资源和基准，导致在乌尔都语等低资源语言中性能大幅下降。乌尔都语缺乏面向推理的数据集和适应多步数学问题求解的模型，限制了最新进展对乌尔都语用户的适用性。

Result: 在MGSM-Urdu基准上评估Riazi-8B，与现有的乌尔都语指令微调模型相比，在答案正确性、推理质量、回答完整性和乌尔都语生成方面均取得了一致的改进。

Insight: 论文宣称的创新点在于将乌尔都语语言适应与推理导向的微调相结合，这是将数学推理能力扩展到低资源语言的有效策略。从客观角度看，其针对特定低资源语言（乌尔都语）构建专用数学推理模型的两步适应方法（持续预训练+思维链微调）具有借鉴意义。

Abstract: Recent LLMs demonstrate strong mathematical reasoning capabilities, but existing gains rely heavily on English-centric training resources and benchmarks. As a result, reasoning performance degrades substantially in low-resource languages such as Urdu, where reasoning-oriented datasets and adapted models remain scarce. Urdu lacks both reasoning-oriented resources and models adapted for multi-step mathematical problem solving, limiting the applicability of recent progress to Urdu-speaking users. We address this gap through Riazi-8B, an Urdu mathematical reasoning model developed through a two-step adaptation process comprising continued pre-training on Urdu Wikipedia and supervised fine-tuning on Urdu Chain-of-Thought data derived from GSM8K. We evaluate Riazi-8B on MGSM-Urdu against existing Urdu instruction-tuned models. Our results show consistent improvements in answer correctness, reasoning quality, response completeness, and Urdu generation. Our findings demonstrate that combining Urdu language adaptation with reasoning-focused fine-tuning is an effective strategy for extending mathematical reasoning capabilities to low-resource languages.

[7] MedGuards: Multi-Agent System for Reliable Medical Error Detection and Correction cs.CLPDF

Congbo Ma, Hu Wang, Yichun Zhang, Farah E. Shamout

TL;DR: 本文提出MedGuards，一个基于多智能体上下文学习的框架，用于可靠地检测和纠正医疗文本中的错误。该框架通过专门化的智能体分别进行错误检测、定位和纠正，并引入置信度引导的仲裁机制来解决分歧，无需对基础大语言模型进行额外训练。

Details

Motivation: 随着大语言模型在医疗领域的部署日益增多，生成或现有文本中的错误检测与纠正变得至关重要，因为即使是微小错误也可能危及患者安全，而现有方法在未见数据集上泛化能力不足。

Result: 在四个多语言医疗数据集（临床笔记）上的实验表明，所提框架在多个评估指标和模型上均取得了显著改进。

Insight: 创新点在于将医疗错误检测与纠正构建为多智能体上下文学习任务，并引入了关键词优先纠正分数这一新的评估指标，该指标通过考量参考文本中关键关键词是否被正确生成，提供了比传统指标更全面的评估。该框架设计增强了可解释性、鲁棒性和适应性。

Abstract: As Large Language Models (LLMs) are increasingly deployed in healthcare settings, accurate error detection and correction in generated or existing text becomes critical, as even minor mistakes can pose risks to patient safety. Existing methods for error detection and correction, including automated checks and heuristic-based approaches, do not generalize well across unseen datasets. In this paper, we propose MedGuards as a medical safety guardrail, which is a new framework that treats medical error detection and correction as a multi-agent in-context learning task. Specialized agents separately detect, localize, and correct errors, while a confidence-guided arbitration mechanism resolves disagreements using reasoning traces and confidence scores. This design enhances interpretability, robustness, and adaptability, without requiring additional training of the base LLMs. Additionally, we introduce the Keyword-Prioritized Correction Score (KPCS), a new evaluation metric that considers whether critical keywords within the reference text are generated correctly, providing a more comprehensive assessment than conventional metrics. Experiments across four multilingual medical datasets consisting of clinical notes demonstrate significant improvements by the proposed framework across several metrics and models. Our aim is to enable safer deployment of LLMs in real-world healthcare applications. For reproducibility, we make our code publicly available at https://github.com/congboma/MedErrBench.

[8] OPERA: Aligning Open-Ended Reasoning via Objective Perplexity-based Reinforcement Learning cs.CLPDF

Wenxuan Jiang, Zining Fan, Zijian Zhang, Xuecheng Wu, Hongming Tan

TL;DR: 本文提出OPERA（基于目标困惑度的反思对齐）方法，通过利用困惑度动态衍生的内在奖励替代不可靠的外部评判模型，以解决强化学习在开放任务（如创意写作）中对齐不稳定的问题。该方法在冷启动阶段引入数据合成与困惑度优先的轨迹采样，生成了大规模高质量推理轨迹数据集。实验表明，OPERA在Qwen3-8B上实现了开源模型的新SOTA，并在部分开放任务中达到或超越了Gemini2.5等专有模型的性能。

Details

Motivation: 针对强化学习在开放任务（如创意写作）中因LLM-as-a-judge奖励模型存在风格偏见和位置不一致性而导致监督不稳定的挑战，旨在开发一种更可靠的对齐方法。

Result: 在Qwen3-8B上实施OPERA，在开放任务中建立了开源模型的新SOTA，并在部分任务中达到或超越了Gemini2.5和MiniMax-M2.5等专有模型的性能。

Insight: 创新点在于用基于困惑度动态的内在奖励替代外部评判，避免了风格偏见；同时，通过引导词数据合成和困惑度优先的轨迹采样生成高质量数据集，提升了开放任务中对齐的稳定性和可扩展性。

Abstract: Reinforcement Learning (RL) has enabled LLMs to excel in objective reasoning tasks such as mathematics and code generation. However, applying RL to open-ended tasks, such as creative writing, remains challenging because LLM-as-a-judge reward models often exhibit stylistic biases and positional inconsistencies, leading to unstable supervision. To address this, we propose OPERA (Objective Perplexity-based Reflective Alignment), which replaces unreliable external judges with intrinsic rewards derived from perplexity dynamics. Specifically, we derive an intrinsic reward signal from perplexity dynamics, quantifying uncertainty reduction at critical reflective states. During the cold-start phase, we introduce a data synthesis method that leverages carefully designed guiding words to generate diverse reasoning traces, along with perplexity-prioritized rollouts that utilize internal log-probabilities to identify logically consistent reasoning branches. This pipeline yields a large-scale dataset comprising 20,000 high-quality reasoning trajectories. Empirical evaluations consistently demonstrate the scalability and efficacy of our approach in alignment for open-ended tasks. Implementing OPERA on Qwen3-8B establishes a new state-of-the-art among open-source models, achieving parity with or surpassing proprietary models like Gemini2.5 and MiniMax-M2.5 in some open-ended tasks. The code is available at https://github.com/pangpang-xuan/OPERA.

[9] Overview of HIPE-2026: Person-Place Relation Extraction from Multilingual Historical Texts cs.CL | cs.AIPDF

Juri Opitz, Maud Ehrmann, Corina Raclé, Andrianos Michail, Matteo Romanello

TL;DR: HIPE-2026是第三届历史信息提取评估竞赛，专注于从多语言历史文本中提取人物-地点关系，特别是两种时间锚定的关系类型（过去存在和同期存在）。论文介绍了该竞赛的结果，涉及17个团队在应对历史语言变异、OCR噪声和间接上下文线索等挑战时的表现，并提出了一个评估预测准确性、计算效率和跨领域泛化能力的三重框架。

Details

Motivation: 解决从嘈杂、多语言的历史文档中提取时间锚定的人物-地点关系这一核心挑战，推动历史信息提取从命名实体识别和链接发展到实体间关系推理。

Result: 竞赛在法语、德语和英语的历史报纸文本及早期现代法语文学文本上进行，超过40个提交结果显示了从最先进的大语言模型到轻量级任务特定分类器的广泛策略，揭示了准确性、效率和鲁棒性之间的权衡。

Insight: 创新点在于引入了时间锚定的关系类型（$at$和$isAt$）以及三重评估框架（准确性、效率、泛化），这反映了文化遗产领域大规模历史文档处理的实用需求，并为历史关系提取提供了全面的基准。

Abstract: Was this person ever at that place, and if so, when? Answering such questions from noisy, multilingual historical documents is the central challenge of HIPE-2026, the third edition of the HIPE evaluation series. Moving from named entity recognition and linking (HIPE-2020, HIPE-2022) to reasoning about relationships between entities, HIPE-2026 targets two temporally grounded relation types: $at$, indicating that a person was present at a location at some point prior to a document’s publication date, and $isAt$, indicating presence contemporaneous with that date. This paper presents the results of the evaluation campaign, which confronted 17 participating teams with the challenges of historical language variation, OCR noise, and indirect contextual cues across three languages: French, German, and English. The datasets include historical newspaper text from the nineteenth and twentieth centuries, as well as a surprise-domain generalization set drawn from early modern French literary texts. A distinctive feature of HIPE-2026 is its three-fold evaluation framework, which assesses predictive accuracy, computational efficiency, and cross-domain generalization, reflecting the practical demands of large-scale historical document processing in the cultural heritage domain. Across more than 40 submitted runs, results reveal a wide range of strategies, from state-of-the-art large language models to lightweight task-specific classifiers, and highlight the trade-offs between accuracy, efficiency, and robustness inherent to historical relation extraction at corpus scale. System descriptions, datasets, and findings are presented and discussed, offering a detailed picture of the current state of temporally grounded relation extraction for historical documents.

[10] SpeechEQ: Benchmarking Emotional Intelligence Quotient in Socially Aware Voice Conversational Models cs.CL | cs.AI | cs.SDPDF

Liang-Yuan Wu, Zih-Ching Chen, Tongshuang Wu, Chao-Han Huck Yang, Hua Shen

TL;DR: 论文提出了SpeechEQ框架，用于评估语音语言模型在社会语言学推理方面的能力，特别是情商。该框架包含一个基于EQ-i 2.0理论、涵盖15个情商子量表的2,265个对话数据集，以及一个受人类情商评估启发的多轮评估协议（SEQ分数）。实验揭示了现有语音情感识别和端到端语音语言模型在理解和应用副语言线索方面的局限性，并指出了模型存在的文本依赖、对齐诱导的安全陷阱和上下文遗忘等问题。

Details

Motivation: 随着多模态对话系统越来越多地参与语音交互，其处理副语言社会线索的能力已成为自然人机交互的关键瓶颈。现有对机器情商的评估仅通过孤立文本或被动声学感知进行推理，忽视了主动多轮对话所需的复杂跨模态推理。

Result: 实验表明，端到端架构优于级联系统，但SpeechEQ基准测试揭示了当前多模态模型仍受限于文本依赖的“模态捷径”、对齐诱导的“安全陷阱”和“上下文遗忘”等瓶颈。

Insight: 创新点在于提出了首个用于评估语音语言模型社会语言学推理（情商）的综合框架SpeechEQ，包括一个理论驱动的数据集和多轮评估协议。客观分析认为，该工作系统地揭示了当前模型在跨模态、多轮对话中理解副语言线索的根本性缺陷，为开发真正具有情感感知能力的AI指明了方向。

Abstract: As multimodal conversational systems increasingly engage in spoken interaction, their ability to navigate paralinguistic social cues has become a critical bottleneck for natural human-AI communication. However, existing evaluations of machine emotional intelligence assess reasoning exclusively through isolated text or passive acoustic perception, overlooking the complex cross-modal reasoning required for active, multi-turn dialogue. We introduce \textsc{SpeechEQ}, a comprehensive framework designed to evaluate the sociolinguistic reasoning of Speech-Language Models (SLMs). The framework includes a validated dataset of 2,265 dialogues across 15 Emotional Quotient (EQ) subscales grounded in EQ-i 2.0 theory, along with a multi-turn evaluation protocol measured by our proposed Spoken EQ (SEQ) score inspired by human EQ assessments. Experiments show limitations in how both existing Speech Emotion Recognition and end-to-end Speech-Language Models understand and apply paralinguistic cues through speech. While end-to-end architectures outperform cascaded systems, \textsc{SpeechEQ} reveals that current multimodal models remain bottlenecked by a text-reliant modality shortcut,'' an alignment-induced safety trap,’’ and ``contextual amnesia,’’ highlighting the barriers to truly emotionally aware AI. Our benchmark can be accessed at https://huggingface.co/datasets/SpeechEQ/SpeechEQ and demo page at https://binomial14.github.io/speecheq-demo/

[11] Why Multi-Step Tool-Use Reinforcement Learning Collapses and How Supervisory Signals Fix It cs.CL | cs.LGPDF

Yupu Hao, Zhuoran Jin, Huanxuan Liao, Kang Liu, Jun Zhao

TL;DR: 本文研究了在多步工具使用任务中，强化学习（RL）训练大型语言模型（LLM）时出现的性能崩溃问题，并探讨了多种监督信号如何修复此问题。研究发现，崩溃源于特定控制令牌的意外概率峰值，而通过交错监督微调（SFT）与RL等策略可以显著提升训练稳定性。

Details

Motivation: 尽管工具使用增强了LLM处理复杂任务的能力，但单纯使用强化学习进行训练常导致不稳定或性能有限，甚至出现灾难性崩溃，因此需要探究其失败原因并寻找有效的稳定训练方法。

Result: 实验表明，交错SFT与RL的训练方案能大幅改善稳定性，但在格式和内容分布外（OOD）评估下性能会下降。研究还分析了学习率和泛化能力的影响。

Insight: 创新点在于系统性地分析了RL在多步工具使用任务中崩溃的机制（控制令牌概率峰值），并验证了多种监督信号（如离策略监督、提示引导、错误示例监督）在引导探索性学习、实现鲁棒训练方面的有效性。

Abstract: Tool use enables large language models (LLMs) to perform complex tasks, and recent agentic reinforcement learning (RL) methods show promise for enhancing model capabilities. However, RL alone often leads to instability or limited gains in tool-use tasks. In our experiments, some models exhibit catastrophic collapse, where performance abruptly drops and tool-invocation structures fail. The analysis reveals that these failures stem from unexpected probability spikes in specific control tokens, disrupting structured execution, yet the underlying tool-use capability remains intact, merely obscured by specific formats. To address this, we systematically investigate a diverse set of supervisory signals, including off-policy supervision, hint-based guidance, erroneous example supervision, and others, applied under both synchronous and interleaved training schemes. We find that interleaving supervised fine-tuning (SFT) with RL substantially improves stability, but exhibits degraded performance under format and content out-of-distribution (OOD) evaluation. We also analyze the impact of learning rates and generalization across settings. These results highlight the importance of understanding RL failures and demonstrate how diverse supervisory signals can guide exploratory learning, enabling robust training of LLMs for complex, multi-step tool-use tasks. Our Code is available at https://github.com/hypasd-art/Tool-RL-Box.

[12] Same Evidence, Different Answer: Auditing Order Sensitivity in Multimodal Large Language Models cs.CL | cs.CV | cs.LGPDF

Akshay Paruchuri, Sanmi Koyejo, Ehsan Adeli

TL;DR: 本文提出Facet-Probe框架，从五个方面（选项、证据块、文档排序、图像集和混合模态排序）对18个前沿和开源多模态大语言模型（MLLMs）进行审计，评估其对输入顺序变化的敏感性。研究发现所有模型均非顺序不变，翻转率高达24-50%，且能力最强的模型也无法避免。研究建议将跨顺序翻转率作为MLLMs的标准报告指标。

Details

Motivation: 现有MLLM标准基准测试通常只使用单一规范顺序对项目评分，忽略了与顺序无关的输入重组是否会导致答案变化，而这正是新兴AI评估指南所呼吁的基础可靠性属性。

Result: 在审计的18个MLLMs中，所有模型均表现出顺序敏感性，各分面面板平均翻转率在24%至50%之间。即使最佳模型在13.4%的试验中仍会发生翻转，且能力预测翻转但无法消除。在Gemini的缓解测试中，无需训练的提示修改效果具有模态条件性，无法从文本推理迁移到视觉推理。

Insight: 创新点在于提出了一个系统性的五方面审计框架（Facet-Probe）和贝叶斯项目反应模型，以分离顺序噪声与分面偏差。核心发现是提示层面的缓解措施不足以提供通用的顺序鲁棒性，这为未来在训练时和架构层面的方法研究提供了动机。研究主张将跨顺序翻转率确立为MLLMs的标准报告维度。

Abstract: Standard benchmarks for multimodal large language models (MLLMs) score each item on one canonical ordering and miss whether order-irrelevant shuffling changes the answer, a baseline reliability property called for by emerging AI evaluation guidelines. We introduce Facet-Probe, a five-facet audit (option, evidence-chunk, document-rank, image-set, and mixed-modality ordering) of 18 frontier and open-weight MLLMs. A Bayesian item-response model separates ordering noise from per-facet bias, and a same-ordering control estimates the decoder-stochastic floor for observed flips. We find that none of the 18 MLLMs we audit are order-invariant: screened per-facet panel-mean flip rates span 24-50%. A Gemini same-ordering control at temperature 0 estimates a substantial ordering excess over a same-input decoder-noise floor in verified cells. Capability predicts but does not eliminate flips; the best model still flips on 13.4% of trials. In our Gemini mitigation tests, training-free prompt changes are modality-conditional and do not transfer from text to visual reasoning. These results suggest that prompt-level mitigation alone is unlikely to provide general order robustness, motivating future work on training-time and architectural approaches. We propose cross-ordering flip rate as a standard reporting axis for MLLMs.

cs.CV [Back]

[13] Yuvion VL: A Multimodal Foundation Model for Adversarial Content and AI Safety cs.CV | cs.AIPDF

Shikai Qiu, Xiaowen Xu, Benlei Cui, Ting Ma, Xiufeng Huang

TL;DR: Yuvion VL是一个专为内容和AI安全设计的多模态大语言模型系列，通过对抗性鲁棒性驱动的数据构建和训练流程，在安全任务上实现行业领先性能。

Details

Motivation: 解决通用模型在识别和理解现实世界多模态风险（尤其是对抗性内容）方面不可靠的问题，将安全视为一个固有的对抗性和多模态问题。

Result: Yuvion VL-32B在内容和AI安全性能上达到行业领先，超越同规模开源模型和最佳闭源商业模型，同时保持可比的通用能力。

Insight: 创新点包括：将安全作为对抗性多模态问题设计全流程；采用三阶段训练（持续预训练、指令后训练、推理后训练）；提出Confuse-then-Contrast微调框架，通过对比学习增强细粒度视觉语义区分能力；构建专门的YVRE基准用于全面评估。

Abstract: General-purpose models often struggle to reliably identify and understand real-world multimodal risks, largely due to the inherent multimodal adversarial nature of content and AI safety. We present Yuvion VL, a family of multimodal large language models purpose-built for content and AI safety, with both instruction-tuned and reasoning-oriented variants. Yuvion VL addresses this gap by treating safety as an inherently adversarial and multimodal problem and designing the entire pipeline around adversarial robustness. For data construction, we develop an automated pipeline integrating adversarial-aware data synthesis with multi-stage quality control, producing large-scale, high-quality multimodal samples augmented with domain knowledge and reasoning annotations. For training, we adopt a three-stage pipeline that includes continued pretraining for risk-concept cross-modal alignment, instruct post-training for production-grade safety tasks, and reasoning post-training for enhanced interpretability and performance in complex tasks. We further introduce Confuse-then-Contrast Fine-Tuning, a contrastive framework that mines model-specific confusions and constructs multi-image contrastive groups to enforce explicit discrimination of fine-grained visual-semantic elements, enabling the model to distinguish between visually similar cases with different safety implications in adversarial safety tasks. To support rigorous evaluation, we further introduce Yuvion VL RiskEval (YVRE), a collection of benchmarks covering diverse open and internal evaluations, with a focus on content and AI safety, adversarial robustness, and real-world capability requirements. Experiments show that Yuvion VL-32B achieves industry-leading safety performance, surpassing comparably sized open-source models and best closed-source commercial models, while maintaining comparable general capabilities.

[14] Curvature-Guided Mixing for MLLM Adaptation cs.CV | cs.LGPDF

Jinglong Yang, Jiaxuan He, Wenjian Huang, Zhan Zhuang, Jianguo Zhang

TL;DR: 本文提出了一种名为曲率引导混合（CGM）的理论框架，用于解决多模态大语言模型（MLLM）在特定任务微调后出现的灾难性遗忘问题。该方法通过二阶（海森）近似损失函数，解析地推导出最优的软混合比例，并引入了一个基于曲率感知得分的硬混合变体CGM†，以智能地融合预训练模型和微调模型的参数。

Details

Motivation: 动机在于解决MLLM在特定任务微调时，现有模型合并方法多为启发式或使用次优目标，导致模型通用能力灾难性遗忘的问题。

Result: 在LLaVA-1.5和Qwen2.5VL模型上的多个下游任务实验表明，CGM和CGM†在任务专业化与通用知识保留的权衡上，持续优于现有方法。

Insight: 创新点在于提出了一个理论驱动的、基于损失函数曲率分析的模型合并框架，通过解析解实现参数的最优软混合，并设计了基于曲率的稀疏参数选择机制进行硬混合，为缓解灾难性遗忘提供了新的理论视角和实用方法。

Abstract: Fine-tuning Multimodal Large Language Models (MLLMs) on specialized tasks often leads to catastrophic forgetting of their general capabilities. Existing model merging methods to combat this are often heuristic or use sub-optimal objectives. We propose CurvatureGuided Mixing (CGM), a theoretically grounded framework that merges pre-trained and fine-tuned models. CGM formulates a joint optimization objective and uses a second-order (Hessian) approximation of the loss landscapes to analytically derive an optimal, closed-form “soft mixing” ratio. This ratio intelligently blends parameters based on their relative task-specific curvatures. We also introduce CGM$\dagger$, a robust “hard mixing” variant that performs sparse parameter selection guided by a novel, curvature-aware score. Experiments on LLaVA-1.5 and Qwen2.5VL across multiple downstream tasks show that CGM and CGM$\dagger$ consistently improve the trade-off between task specialization and general knowledge retention over existing methods. Code is available at github.com/zzsyjl/CGM-ECCV-2026.

[15] Chorus II: Cross-Request Sparsity Reuse for Efficient Image-to-Video Generation cs.CVPDF

Hao Liu, Chenghuan Huang, Hao Liu, Xing Cai, Chen Li

TL;DR: 本文提出Chorus II框架，通过跨请求的稀疏性重用和可选的特征重用来加速图像到视频生成任务。该方法利用相似请求间高度一致的稀疏注意力模式，重用历史稀疏掩码作为先验，避免在线掩码预测开销，同时引入轻量级引导增强来缓解语义漂移问题。

Details

Motivation: 图像到视频生成服务计算成本高昂，难以大规模部署；实际工作负载中存在大量相似请求（如重复效果模板、相关主题和镜头布局），现有跨请求加速方法主要依赖特征重用，未能充分利用稀疏注意力模式的冗余性。

Result: 在默认稀疏重用配置下，该方法在保持生成质量的同时实现了2.16倍的加速；实验验证了该方法在跨请求场景下的有效性和效率提升。

Insight: 创新点在于首次提出跨请求稀疏注意力模式重用机制，将历史稀疏掩码作为条件先验；通过引导增强技术平衡重用效率与条件一致性；稀疏重用与特征重用的协同设计为扩散模型加速提供了新思路。

Abstract: Serving diffusion models for image-to-video generation is computationally expensive, posing significant challenges for large-scale deployment. Real I2V workloads often contain similar requests, such as repeated effect templates, related subjects, and recurring shot layouts. Existing cross-request acceleration methods mainly exploit this redundancy through feature reuse. We observe that similar I2V requests also share highly consistent sparse attention patterns, enabling historical sparse masks to serve as request-conditioned priors with almost no online mask-prediction overhead. We propose a cross-request reuse framework centered on \textbf{sparsity reuse}, with \textbf{feature reuse} as an optional extension safeguarded by a lightweight \textbf{guidance enhancement}. Our sparsity reuse is implemented as shared sparse mask reuse, which reuses high-quality sparse masks from similar historical requests to avoid per-request online mask prediction. Optional feature reuse applies downsampled computation to highly redundant spatiotemporal regions, mitigating boundary artifacts while preserving efficiency gains. Guidance enhancement reinforces image/text conditioning after reuse, mitigating semantic drift and condition-adherence issues. Experiments show that default sparsity reuse configuration preserves generation quality with a \textbf{2.16$\times$} speedup.

[16] Are We There Yet? Exploring the Capabilities of MLLMs in Assistive AI Applications cs.CVPDF

Shayon Dasgupta, Avijit Dasgupta, C. V. Jawahar

TL;DR: 本文探讨了多模态大语言模型（MLLMs）在辅助性AI应用中的能力。作者通过开发一个名为NetraLink的系统，使用头戴式GoPro采集第一人称视角数据，并构建了一个涵盖货币识别、基于场景文本的问答以及多语言内容阅读等现实辅助任务的基准测试。研究发现全面诊断了当前MLLMs的优势与局限。

Details

Motivation: MLLMs在视觉理解任务上表现出色，但其在需要稳健视觉识别、上下文推理和多语言理解的现实辅助性AI场景中的有效性尚未被充分理解。

Result: 研究在涵盖现实世界辅助任务的基准上评估了最先进的MLLMs，提供了对其能力的全面诊断，指出了其在基于视觉感知和语言交互的辅助技术中的优势与局限性。

Insight: 创新点在于构建了一个专门针对辅助性AI场景（如货币识别、场景文本问答、多语言阅读）的现实世界基准测试集，并通过第一人称视角数据采集系统进行实证评估，为MLLMs在该领域的实际应用潜力提供了具体诊断。

Abstract: Multimodal Large Language Models (MLLMs) have redefined visual understanding by combining vision encoders with large-scale language models. This unified architecture enables strong performance on tasks like image captioning, visual question answering, and multimodal dialogue, often in zero- and few-shot settings. Their general-purpose capabilities and flexible interfaces make MLLMs a promising foundation for real-world vision-language applications. Assistive AI aims to help users interact with their environments through natural language. These scenarios demand robust visual recognition, contextual reasoning, and multilingual comprehension-capabilities that MLLMs are believed to offer. However, their effectiveness in assistive settings remains to be fully understood. In this work, we explore whether MLLMs can support Assistive AI by evaluating state-of-the-art models on real-world tasks: recognizing everyday objects like currency, answering questions based on scene text, and reading visually presented content across multiple languages. To this end, we developed a system, NetraLink, using a head-mounted GoPro to capture real-world egocentric data, and collected a benchmark covering these assistive scenarios. Our findings provide a comprehensive diagnostic of current MLLMs, highlighting their strengths and limitations in enabling assistive technologies grounded in visual perception and language interaction.

[17] MJEPA: A Simple and Scalable Joint-Embedding Predictive Architecture for Audio-Visual Learning cs.CV | cs.LGPDF

Revant Teotia, Adrien Bardes, Michael Rabbat, Sumit Chopra, Matthew J. Muckley

TL;DR: MJEPA是一种简单且可扩展的联合嵌入预测架构，用于音频-视觉自监督学习。它使用单一的统一编码器处理两种模态，并仅采用单一的预测目标，在模态内和模态间进行预测。研究表明跨模态预测至关重要，能显著提升表征性能。

Details

Motivation: 现有音频-视觉自监督方法依赖模态特定编码器和复杂的对比或重建目标组合，限制了跨模态协同和可扩展性。本文旨在探索一种简单、模态无关的联合嵌入预测架构，以克服这些限制。

Result: 在AudioSet-20K上，冻结的ViT-g模型比之前最佳冻结基线高出6.8 mAP；在ESC-50和FSD50K上超越了完全微调的模型；在视频基准测试中具有竞争力，尽管使用的视频数据量少10倍。

Insight: 创新点在于提出使用单一统一编码器和单一预测目标的跨模态联合嵌入预测架构，证明了跨模态预测对共享编码器性能提升的关键作用，简化了架构并增强了可扩展性。

Abstract: Self-supervised learning from large-scale video data has emerged as a dominant paradigm for visual representation learning. Since audio and visual streams naturally co-occur in video data, extending this success to jointly learn from both modalities is a natural next step, yet it remains challenging. Existing audio-visual self-supervised methods rely on modality-specific encoders and complex combinations of contrastive or reconstruction objectives, limiting cross-modal synergy and scalability. Joint Embedding Predictive Architectures (JEPAs) offer a simple, modality-agnostic alternative, but have to date been applied primarily to individual modalities. We introduce MJEPA, a joint-embedding predictive architecture for audio-visual learning that uses a single, unified encoder for both modalities. Our approach uses only a single predictive objective, applied both within and across modalities. We show that cross-modal prediction is critical: without it, a shared encoder degrades below unimodal baselines; with it, each modality’s representation benefits from the other. Our frozen ViT-g model outperforms the best prior frozen baseline by over 6.8 mAP on AudioSet-20K, surpasses fully finetuned models on ESC-50 and FSD50K, and is competitive on video benchmarks despite using 10x less video data.

[18] Wan-Streamer v0.1: End-to-end Real-time Interactive Foundation Models cs.CV | cs.AI | cs.GR | cs.SDPDF

Lianghua Huang, Zhifan Wu, Wei Wang, Yupeng Shi, Mengyang Feng

TL;DR: 本文提出了Wan-Streamer v0.1，一个专为实时、低延迟、全双工音视频交互而设计的原生流式端到端交互式基础模型。该模型在一个统一的Transformer架构内，将语言、音频和视频作为输入和输出进行联合建模，通过块因果注意力机制实现增量式流处理，旨在消除传统级联系统的延迟和错误累积问题。

Details

Motivation: 为了解决传统级联交互系统（依赖独立的VAD、ASR、语言模型、TTS、音频驱动动画或视频生成模块）存在的流水线延迟高、错误累积以及跨模态同步困难的问题，本文旨在构建一个统一、端到端的模型，将感知、推理、生成、响应时机、话轮管理和跨模态同步在一个模型中联合学习。

Result: Wan-Streamer实现了约200毫秒的模型端响应延迟，在结合350毫秒双向网络延迟后，总交互延迟约为550毫秒，支持亚秒级的全双工音视频通信。这些结果表明其是一个适用于低延迟流式交互的统一端到端多模态基础模型。

Insight: 核心创新在于构建了一个原生流式、统一的多模态Transformer架构，将音视频文本的输入输出令牌交错表示，并通过块因果注意力、因果编解码器及低延迟多模态令牌调度等全栈重新设计，实现了端到端的联合学习与极低延迟的流式交互，避免了模块化系统的固有缺陷。

Abstract: We present Wan-Streamer, a native-streaming, end-to-end interactive foundation model designed from the ground up for real-time, low-latency, full-duplex audio-visual interaction. Wan-Streamer seamlessly models language, audio, and video as both input and output within a single Transformer, where the sequence is represented as interleaved visual, audio, and text input tokens together with visual, audio, and text output tokens, coordinated by block-causal attention for incremental streaming. Unlike cascaded interactive systems that rely on separate VAD, ASR, language, TTS, audio-driven animation, or video-generation modules, Wan-Streamer does not rely on external language, speech, avatar, or video-generation modules: perception, reasoning, generation, response timing, turn management, and cross-modal synchronization are learned jointly within one unified model, reducing pipeline latency and error accumulation. To support natural audio-visual responsiveness, we redesign the entire stack around streamability, including causal encoders, causal decoders, block-causal attention, and low-latency multimodal token scheduling, enabling streaming units as short as 160 ms at 25 fps. Wan-Streamer achieves approximately 200 ms model-side response latency and approximately 550 ms total interaction latency when combined with 350 ms bidirectional network latency, supporting sub-second duplex audio-visual communication. These results position Wan-Streamer as a unified, end-to-end, multimodal interactive foundation model for low-latency streaming interaction.

[19] Reflective VLA: In-Context Action Consequences Make VLAs Generalize cs.CV | cs.ROPDF

Qing Lian, Kent Yu, Lei Zhang

TL;DR: 本文提出了Reflective VLA模型，旨在解决传统视觉-语言-动作（VLA）模型在具身控制任务中因仅依赖当前观察而难以泛化的问题。该模型通过引入包含过去观察-动作-结果三元组的上下文，使策略能够推理动作的后果，从而更好地适应部署环境中的特定因素（如相机几何、系统偏差）。实验表明，该方法在分布外泛化任务上显著优于反应式基线模型。

Details

Motivation: 传统反应式VLA模型假设当前观察完全指定了与动作相关的状态，但在实际机器人部署中，特定于具身的因素（如相机-机器人几何、校准误差、系统执行偏差）难以从单次观察中识别，导致模型在训练环境过拟合，部署时泛化能力差。

Result: 在标准基准LIBERO和SimplerEnv-Bridge上，Reflective VLA保持了强大的分布内性能。在分布偏移的基准LIBERO-Plus及其更难的版本LIBERO-Plus-Hard上，其平均成功率分别比匹配的反应式基线提高了5.4和4.2个百分点。消融实验表明，动作后果（而非单纯的额外上下文长度）是跨环境泛化的关键。

Insight: 核心创新在于将决策条件从当前观察扩展到包含过去动作后果的上下文三元组，使模型能够显式学习动作到观察效果的部署特定映射。架构上，通过共享注意力将所有观察模态路由到VLM下，并采用块因果掩码实现并行多帧训练和实时推理，兼顾了性能与效率。

Abstract: Most vision-language-action (VLA) models are reactive: they predict the next action from the current instruction and observation, implicitly assuming that the current observation fully specifies the action-relevant state. In embodied control, however, embodiment-specific factors such as camera-to-robot geometry, robot calibration, or systematic actuation bias are often hard to identify from a single observation. As a result, reactive policies cannot reliably disambiguate these factors in general, overfitting to training environments and generalizing poorly at deployment. We propose Reflective VLA, which conditions each decision on a context of observation-action-consequence triplets. Each triplet records not only what the robot observed and executed, but also how the scene changed afterward, exposing the deployment-specific mapping from actions to observed effects. Architecturally, Reflective VLA routes all observation modalities through the VLM under shared attention, so the action expert reasons directly over past triplets and the current observation. A block-causal mask enables parallel multi-frame training without leakage and supports KV-cached real-time inference. On standard LIBERO and SimplerEnv-Bridge, Reflective VLA preserves strong in-distribution performance. Under distribution shift on LIBERO-Plus and the harder LIBERO-Plus-Hard, it improves average success rate by 5.4 and 4.2 percentage points over a matched reactive baseline. Ablations with a matched history-only baseline further show that action consequences – rather than additional context length alone – are the key to cross-environment generalization. Project page: https://lianqing11.github.io/reflective-vla-page/

[20] OrthoTrack: Continuous 6-DoF UAV Trajectory Estimation Anchored in Public Orthophotos cs.CVPDF

Oussema Dhaouadi, Zuria Bauer, Johannes Michael Meier, Olaf Wysocki, Marc Pollefeys

TL;DR: 本文提出了OrthoTrack，一种免训练系统，用于估计无人机的连续6自由度轨迹。该系统仅使用公开可用的正射影像和表面模型作为先验地图，通过将关键帧与正射影像匹配，并利用表面模型将对应点提升到度量3D空间，再通过光流将地图锚定的对应点传播到中间帧，从而在无需GPS或事后对齐的情况下，为每一帧生成绝对、度量尺度的位姿。

Details

Motivation: 现有视觉里程计和SLAM方法存在累积漂移问题，只能提供相对、无尺度的轨迹；而单帧地理定位方法则丢弃了时间连续性且速度太慢，无法实时使用。因此，需要一种能够提供连续、绝对、度量尺度位姿估计的方法。

Result: 在MovingDrone数据集和真实世界基准测试中，OrthoTrack在单个GPU上实时运行，大幅超越所有基线方法，甚至优于那些接收了真实尺度和对齐信息的基线。

Insight: 创新点在于利用公开地理数据（正射影像和表面模型）作为先验地图，实现免训练的连续6自由度轨迹估计，无需现场特定适配即可部署到新区域。从客观角度看，该方法结合了地理定位的绝对精度与视觉里程计的连续性，并通过光流传播有效利用了时间信息，是一种新颖且实用的系统设计。

Abstract: Continuous 6-DoF pose estimation is essential for autonomous UAV operations. Yet, existing visual odometry and SLAM methods accumulate drift and yield only relative, up-to-scale trajectories. Single-frame geo-localization, in turn, discards temporal continuity and remains too slow for real-time use. We present OrthoTrack, a training-free system that estimates continuous 6-DoF UAV trajectories using only publicly available orthophotos and surface models as a map prior. OrthoTrack matches keyframes against the orthophoto and lifts correspondences to metric 3D via the surface model. It then propagates these map-anchored correspondences to intermediate frames with optical flow, producing absolute, metrically scaled poses at every frame without GPS or post-hoc alignment. We also introduce the MovingDrone Dataset, a large-scale benchmark pairing photorealistic UAV sequences with dense 6-DoF ground truth and co-registered multi-modal geodata including multi-temporal orthophotos. On MovingDrone and real-world benchmarks, OrthoTrack runs in real time on a single GPU. It outperforms all baselines by a large margin, even those receiving oracle scale and alignment. By relying on publicly available geodata, OrthoTrack enables deployment to new regions without site-specific adaptation.

[21] Multilingual Hematology Visual Question Answering Dataset cs.CV | cs.CLPDF

Hajra Malik, Hafiza Tooba Aftab, Abdul Rehman, Mohsen Ali, Waqas Sultani

TL;DR: 本文介绍了WBCMor VQA，一个用于白血病和正常白细胞分析的双语（英语和乌尔都语）形态学感知视觉问答基准数据集。该数据集包含11万个双语问答对，覆盖2万个白血病和正常单细胞图像，旨在解决现有血液学视觉语言资源以英语为中心的问题，以促进多语言医疗环境中可访问且临床相关的人工智能系统开发。

Details

Motivation: 现有血液学视觉语言资源主要集中于英语，限制了其在多语言医疗环境（如南亚，特别是巴基斯坦，当地广泛使用乌尔都语但医疗信息和数字系统依赖英语）中的适用性。一项针对医疗专业人员的调查揭示了临床文档与患者沟通之间存在显著的语言不匹配，强调了多语言医疗技术的必要性。

Result: 通过评估多个开源视觉语言模型在提出的WBCMor VQA基准上的表现，建立了基线性能。

Insight: 创新点在于构建了一个临床验证的双语（英语/乌尔都语）形态学感知VQA基准，并利用来自LeukemiaAttri和WBCAtt数据集的形态学感知注释以及特定领域的乌尔都语血液学词典来确保语言一致性和临床正确性，这为开发适用于多语言环境的医疗AI系统提供了重要资源。

Abstract: Vision Language Models (VLMs) have shown promising capabilities in medical image analysis by jointly understanding visual and textual information for tasks such as Visual Question Answering. However, existing hematology vision-language resources remain predominantly English centric, limiting their applicability in multilingual healthcare environments. This challenge is releveant generally to South Asia and specifically to Pakistan, where Urdu is widely used despite healthcare information and digital medical systems being largely dependent on English. To investigate this gap, we conducted a survey among healthcare professionals, which revealed substantial language mismatches between clinical documentation and patient communication, emphasizing the need for multilingual healthcare technologies. To address this limitation, we introduce WBCMor VQA, a clinically validated bilingual English, Urdu morphology aware VQA benchmark for leukemia and normal white blood cell analysis. The benchmark is constructed using morphology-aware annotations from LeukemiaAttri and WBCAtt datasets and supported by a domain specific Urdu hematology dictionary to ensure linguistic consistency and clinical correctness. The final benchmark contains 110K bilingual question answer pairs serving as VQA annotations for 20K leukemic and normal single-cell images. Furthermore, we establish baseline performance by evaluating multiple open-source VLMs on the proposed benchmark. The proposed resource aims to facilitate the development of accessible and clinically relevant AI systems for multilingual healthcare environments.

[22] Heterogeneous and Adept Snapshot Distillation for 3D Semantic Segmentation cs.CV | cs.AIPDF

Xiaopei Wu, Yuenan Hou, Junkai Xu, Wenxiao Wang, Binbin Lin

TL;DR: 本文提出了一种名为HAS-KD的异构与自适应快照知识蒸馏方法，旨在提升3D语义分割性能。该方法通过信息导向的异构蒸馏（IHD）将多模态（点云与图像）教师的互补知识迁移到单模态学生网络，并利用自适应快照蒸馏（ASD）将训练过程中的模型快照作为专家集合进行高效集成，从而在不增加推理负担的情况下显著提升分割精度。

Details

Motivation: 现有的多模态融合与多模型集成方法虽然能提升3D语义分割性能，但往往依赖额外输入信号或计算成本高昂。本文旨在通过知识蒸馏，在不引入过高成本的前提下有效提升分割性能。

Result: 在ScanNetV2和S3DIS数据集上达到了最先进（SOTA）水平，并能无缝集成到当代3D分割算法中，在不引入额外推理负担的情况下带来显著性能提升。

Insight: 创新点包括：1）信息导向异构蒸馏（IHD）与信息导向过滤（IOF）策略，用于高效选择信息丰富的图像并迁移多模态互补知识；2）自适应快照蒸馏（ASD），将训练过程中的模型快照作为低成本专家集合，并根据各专家擅长的类别提供监督，大幅降低了模型集成的训练成本。

Abstract: Multi-modal fusion and multi-model ensembling are prevalent in enhancing the performance of 3D semantic segmentation. Despite the impressive performance, these methods either rely on auxiliary input signals or suffer from costly computational expense. To efficaciously enhance the segmentation performance without introducing intolerable costs, we propose to transfer the rich knowledge from the multi-modal model (i.e., point clouds and images) and multiple model experts to the point-cloudbased network through knowledge distillation. Specifically, we present Information-oriented Heterogeneous Distillation (IHD) to help the uni-modal model absorb the complementary knowledge from the multi-modal teacher. We design the Information-Oriented Filtering (IOF) strategy to select informative images from the continuous image sequence for multi-modal fusion. This practice can boost the performance of the multi-modal teacher, thus benefiting the learning of the student. Besides, as opposed to vanilla model ensembling that requires the separate training of each expert, we propose Adept Snapshot Distillation (ASD). ASD treats the freely available model snapshots generated during the training phase as multiple experts, which significantly reduces the training cost for model ensembling. For each expert teacher, it only provides supervision to the student in the class where it is adept. The resulting Heterogeneous and Adept Snapshot Knowledge Distillation, dubbed HAS-KD, attains state-of-the-art results on ScanNetV2 and S3DIS datasets. HAS-KD can be seamlessly integrated into contemporary 3D segmentation algorithms and bring considerable gains without introducing extra inference burdens. The code will be made publicly available upon publication.

[23] MRI2Rep: Autoregressive Structured Report Generation for 3D Liver MRI cs.CVPDF

Xinran Li, Junlin Yang, Annabella Shewarega, Zongwei Zhou, Julius Chapiro

TL;DR: 本文提出了MRI2Rep，一种用于3D肝脏MRI结构化报告生成的自回归框架。该框架通过报告到标签规范化（RLC）模块将自由文本报告转换为结构化诊断序列，无需病灶级标注。在保留测试集上，MRI2Rep在病例级敏感性和肝脏级准确性方面显著优于基线方法，并通过放射科医生和基于LLM的评估验证了其临床可接受性。

Details

Motivation: 手动撰写3D MRI报告耗时费力，而由于体积数据的复杂性和配对的影像-报告数据稀缺，针对3D肝脏MRI的端到端结构化报告生成研究尚不充分。

Result: 在保留测试集上，MRI2Rep实现了76.0%的病例级敏感性、29.4%的病灶级F1分数和82.4%的肝脏级准确性，显著优于适应性医学视觉语言基线（不超过8.3%）。盲法读者研究中，放射科医生认为AI生成报告分别有75%和70%临床可接受，而基于LLM的自动评估器LLM-Eval以更严格标准判定61.8%的报告可接受。

Insight: 主要创新点包括：1）首个针对3D肝脏MRI的端到端LI-RADS结构化报告生成系统；2）无需病灶级标注的报告到标签规范化（RLC）模块，解决了配对数据稀缺问题；3）引入了基于LLM的自动评估器LLM-Eval作为保守的代理评估标准。

Abstract: Manual reporting of 3D MRI studies is time-consuming, yet end-to-end structured report generation for 3D liver MRI remains underexplored due to volumetric complexity and scarce paired data. We propose MRI2Rep, an autoregressive framework for liver MRI report generation. From 3,929 real-world MRI-report pairs acquired over a 10-year single-institution cohort, a Report-to-Label Canonicalization (RLC) module converts free-text reports into structured, closed-vocabulary diagnostic sequences without lesion-level annotations. On a held-out test set, MRI2Rep achieves 76.0% case-level sensitivity, 29.4% lesion-level F1, compared with no more than 8.3% for adapted medical vision-language baselines, and 82.4% liver-level accuracy. In a blinded reader study, two radiologists rated 75% and 70% of AI-generated reports as clinically acceptable, compared with 95% and 100% for original reports. Our automated LLM-based judge, LLM-Eval, rated 61.8% of AI-generated reports as acceptable, applying a stricter standard and supporting its use as a conservative proxy. To our knowledge, this is the first end-to-end LI-RADS-structured reporting system for 3D liver MRI.

[24] KidRisk: Benchmark Dataset for Children Dangerous Action Recognition cs.CVPDF

Minh-Kha Nguyen, Trung-Hieu Do, Kim Anh Phung, Thao Thi Phuong Dao, Minh-Triet Tran

TL;DR: 该论文构建了一个名为KidRisk的新颖且具有挑战性的数据集，包含2500个儿童行为短视频和10000张儿童危险行为图像，用于儿童危险行为识别。作者在数据集上建立了基准测试，发现传统深度学习模型效果有限，因此开发了基于视觉-语言模型的基线方法，在分类和识别任务上分别达到了83.53%和96.14%的准确率，显著优于传统方法。

Details

Motivation: 儿童天性活泼，在自发活动中常面临潜在危险，尤其是在缺乏父母监督时。识别危险行为对保障儿童安全至关重要，但现有方法对此类任务的有效性有限。

Result: 在KidRisk数据集上，提出的视觉-语言基线方法在儿童行为分类任务上达到83.53%准确率，在危险行为识别任务上达到96.14%准确率，显著优于传统深度学习模型，验证了该方法的有效性。

Insight: 论文的创新点在于构建了首个专注于儿童危险行为识别的大规模数据集KidRisk，并证明了视觉-语言模型凭借其卓越的上下文理解能力，在该领域具有显著优势，为儿童安全监护提供了新的技术路径。

Abstract: Children are naturally energetic, and during their spontaneous activities, they often encounter potentially dangerous situations, especially when lacking parental supervision. Identifying actions that pose risks plays a crucial role in ensuring their safety. This paper build a novel challenging dataset, namely KidRisk, including 2,500 short videos of children’s actions and 10,000 images for dangerous action of children. We also introduce a benchmark on our newly constructs dataset and find that traditional deep learning models demonstrated limited effectiveness on these tasks. Therefore, we develop vision-language based baselines with exceptional context understanding of visual information. Our proposed methods achieved an accuracy of 83.53% in classifying children’s actions and 96.14% in recognizing children’s dangerous actions, significantly outperforming traditional approaches. These results confirm that vision-language models are not only feasible but also highly effective in detecting hazardous actions, contributing positively to safeguarding children’s safety.

[25] Physics Question Scene Graph: Fine-grained Evaluation of Physical Plausibility in Text-to-Video Generation cs.CV | cs.AIPDF

Atin Pothiraj, Jaemin Cho, Yue Zhang, Elias Stengel-Eskin, Mohit Bansal

TL;DR: 该论文提出了物理问题场景图（PQSG），一种基于层次化问题的评估流程，用于细粒度评估文本到视频生成模型在物理合理性方面的表现。作者创建了FinePhyEval数据集进行验证，并展示了PQSG在评估物理违规方面与人类判断具有更高的相关性。

Details

Motivation: 当前视频生成模型难以生成符合基本物理定律的视频，且缺乏可靠、细粒度的评估方法来定位和指定视频中的物理违规问题。

Result: 在FinePhyEval数据集上，PQSG的细粒度评分与人类判断的整体相关性高于先前工作。PQSG评估显示，闭源模型（如Sora 2, Veo 3）在物理真实性上排名高于开源模型Wan 2.1。

Insight: 创新点在于将评估问题组织成具有逻辑依赖关系的图结构，确保查询的上下文有效性，从而提供对物理违规具体方面的细粒度评估。该方法为评估生成视频的物理合理性提供了一个结构化、可解释的框架。

Abstract: Video generation models are increasingly capable of producing realistic videos, but they still struggle to generate videos that follow basic physical laws. Compounding this is a lack of reliable granular evaluation methods for localizing and specifying physical law violations in videos. We address this by introducing Physics Question Scene Graph (PQSG), a hierarchical question-based evaluation pipeline. PQSG evaluates generated videos by checking their faithfulness to a prompt across objects, actions, and adherence to physical laws using a graph-based hierarchy of questions generated by a vision-language model (VLM), guided by high-quality in-context examples. By representing questions as a graph, PQSG introduces logical dependencies within questions, ensuring that each query is contextually valid. Moreover, PQSG provides granular assessments of which qualities of the video violate physical plausibility constraints. We validate PQSG by creating FinePhyEval, a dataset with physics-based prompts and corresponding generated videos from diverse state-of-the-art video generation models (Sora 2, Veo 3, and Wan 2.1), with each video annotated across multiple categories by humans. Using FinePhyEval, we measure the correlation between PQSG’s fine-grained scores and human judgments, showing higher overall correlations than prior work. We also find that PQSG ranks closed-source models higher than Wan 2.1 on physical realism. Lastly, we show that the annotations we provide in FinePhyEval can also be used for subtask evaluation: we benchmark two strong VLMs on generating and answering questions, finding that while models can create human-like questions, they still fall short of human performance in answering them.

[26] ESTANet: Efficient Online Error Detection in Procedural Videos via Prediction Inconsistency cs.CV | cs.AIPDF

Shih-Po Lee, Reza Ghoddoosian, Faizan Siddiqui, Enna Sachdeva, Behzad Dariush

TL;DR: ESTANet提出了一种轻量级在线错误检测框架，通过利用一组动作检测器在预测行为上的不一致性来识别程序性视频中的错误，无需复杂架构或专门监督。

Details

Motivation: 研究旨在为日常生活中的程序性任务提供高效准确的实时错误检测系统，从动作检测器自身预测行为的简单但被忽视的视角出发，解决错误检测问题。

Result: 在EgoPER、Assembly-101-O和EPIC-Tent-O基准测试上，ESTANet实现了最先进的在线错误检测性能，同时保持实时效率和轻量级架构。

Insight: 创新点在于利用动作检测器对输入动态和时间上下文敏感性的内在特性，通过标准与错误敏感检测器预测不一致性的聚合（如多数投票）来检测错误，为在线错误检测提供了强大且实用的解决方案，无需增加架构设计复杂性。

Abstract: An efficient and accurate system for detecting errors in procedural tasks is crucial for supporting human needs in daily life, as it can provide instant notifications and guide people to correct mistakes. In this work, we study real-time online error detection in procedural videos from a simple but overlooked perspective: the prediction behavior of action detectors themselves. Instead of designing complex architectures or specialized supervision, we observe that action detectors naturally exhibit different prediction characteristics depending on their sensitivity to input dynamics and temporal context. We therefore propose ESTANet (Error-Sensitive and Temporally-vArying Network), a lightweight framework that detects errors by exploiting inconsistencies among action predictions produced by a small set of action detectors. We construct standard and error-sensitive action detectors that behave similarly on correct executions but respond differently when errors occur. Meanwhile, detectors operating with different temporal contexts further amplify prediction inconsistencies when the procedure deviates from the intended sequence. During inference, we detect errors by aggregating mismatches between standard and error-sensitive predictions through majority voting to flag frames that contain errors. Extensive experiments on EgoPER, Assembly-101-O, and EPIC-Tent-O demonstrate that ESTANet achieves state-of-the-art performance in online error detection while maintaining real-time efficiency with a lightweight architecture. Our results highlight that leveraging the intrinsic properties of action detectors can yield a powerful and practical solution for online error detection without increasing architectural design complexity.

[27] LEVIRDet: A Million-Scale 159-Category Dataset and Foundation Model for Universal Remote Sensing Object Detection cs.CVPDF

Qinzhe Yang, Dongyu Wang, Haohan Niu, Jia Xu, Zhenwei Shi

TL;DR: 本文提出了LEVIRDet-159，一个包含159个类别、256万个边界框和70万细粒度标注的大规模遥感目标检测数据集，是目前最大最全面的遥感目标检测数据集。基于该数据集，作者设计了LEVIRDetNet，一个尺度层次感知的检测基础模型，用于通用遥感目标检测，该模型集成了在线视觉地面采样距离预测、GSD条件查询调制与分配以及层次感知检测头。

Details

Motivation: 现有遥感目标检测数据集和检测器存在碎片化问题，大多数基准数据集关注有限类别、固定空间分辨率或单一传感器，而检测器难以跨不同传感器和分类体系工作。

Result: 在严格的评估设置下，LEVIRDetNet展现出强大的跨域泛化能力，无需目标域训练或微调，就在9个外部基准测试中达到了最先进的检测性能，在每个基准的主要指标上平均比最强的全监督竞争方法提高了5.02 mAP。

Insight: 创新点在于构建了大规模、多类别、多层次的遥感目标检测数据集，并设计了集成在线GSD预测和层次感知机制的检测基础模型，以解决遥感检测中的尺度、传感器和类别碎片化问题，推动强泛化性检测器的发展。

Abstract: Remote sensing object detection has advanced rapidly with the development of large-scale benchmarks and modern detection architectures. However, existing datasets and detectors remain fragmented. Most benchmarks focus on limited categories, fixed spatial resolutions, or a single sensor, while detectors still struggle to work across different sensors and categorical systems. In this paper, we introduce LEVIRDet-159, the largest and most comprehensive remote sensing object detection dataset to date, with 159 categories, 2.56 million bounding boxes, and 700k fine-grained annotations under a multi-level taxonomy. In each key scale dimension, LEVIRDet-159 exceeds the corresponding largest existing remote sensing object detection dataset, containing approximately (7x) more images, (6x) more object instances, and (4x) more categories. Based on this dataset, we design LEVIRDetNet, a scale-hierarchy-aware detection foundation model for universal remote sensing object detection. LEVIRDetNet couples online visual Ground Sampling Distance (GSD) prediction, GSD-conditioned query modulation and allocation, and a hierarchy-aware detection head for mixed-granularity remote sensing supervision. Under stringent evaluation settings, LEVIRDetNet demonstrates strong cross-domain generalization. Even without target-domain training or fine-tuning, it achieves state-of-the-art detection performance on 9 external benchmarks, improving the strongest fully supervised competing methods by 5.02 mAP on average under each benchmark’s primary metric. We hope this study will facilitate the development of strongly generalizable remote sensing object detection across diverse category systems, spatial resolutions, and sensor platforms. The dataset and trained models will be released at https://qinzheyang.github.io/LEVIRDet/, accompanying the final paper.

[28] REViT: Roto-reflection Equivariant Convolutional Vision Transformer cs.CV | cs.LGPDF

Sheir A. Zaheer, Alexander C. Holston, Chan Y. Park

TL;DR: 本文提出了一种具有卷积注意力的离散旋转反射群等变视觉变换器（REViT）。该模型通过保持特征图中的旋转、翻转和位置对称性，适用于输入方向与模型输出相关的任务。实验表明，该方法在图像分类任务中优于现有的离散旋转反射群等变神经网络方法。

Details

Motivation: 现有研究在图像分类和目标检测中，旋转反射等变模型主要集中于卷积神经网络，而视觉变换器（ViT）中的等变性实现面临挑战。本文旨在探索视觉变换器中实现等变性的方法，并简化离散旋转反射群等变视觉变换器的实现。

Result: 实验结果显示，该方法在图像分类任务中超越了现有的离散旋转反射群等变神经网络方法，取得了更好的性能。

Insight: 创新点在于将卷积注意力机制引入视觉变换器，实现了离散旋转反射群的等变性，简化了等变视觉变换器的构建，为处理方向敏感任务提供了新思路。

Abstract: In this paper, we propose a discrete roto-reflection group equivariant vision transformer with convolutional attention. Roto-reflection equivariant networks preserve the rotational, flip and positional symmetry in feature maps, making them useful for tasks where orientation of the inputs is relevant to the model outputs. In image classification and object detection, most of the studies on roto-reflection equivariant models have focused on using convolutional neural networks rather than vision transformers. In this paper, we examine the challenges involved in achieving equivariance in vision transformers, and we propose a simpler way to implement a discretized roto-reflection group equivariant vision transformer. The experimental results demonstrate that our approach outperforms the existing approaches for developing discrete roto-reflection group equivariant neural networks for image classification.

[29] State Space Models Meet Remote Sensing: A Survey cs.CV | cs.LGPDF

Qinzhe Yang, Chenyang Liu, Jia Xu, Zhenwei Shi, Zhengxia Zou

TL;DR: 本文对状态空间模型（SSMs）在遥感领域的应用进行了全面综述，涵盖了自SSMs引入遥感以来的大部分相关研究，分析了其在遥感任务中的应用和架构设计进展，并指出了关键挑战与未来机遇。

Details

Motivation: SSMs因其线性计算复杂性和强大的长程依赖建模能力，在遥感领域受到欢迎，能够有效应对密集视觉预测、多模态遥感数据和时序遥感数据等独特挑战。

Result: 综述总结了SSMs在遥感领域带来的显著进展，特别是在定制化架构方面，但作为综述性论文，未提供具体的定量实验结果或基准测试排名。

Insight: 论文的创新点在于首次对SSMs在遥感领域的应用进行系统性梳理和多维度分析，为研究者提供了该领域发展的基础性资源和未来研究方向的可操作见解。

Abstract: State Space Models (SSMs), designed for long-range modeling, offer linear computational complexity and strong capabilities in capturing long-range dependencies. In the field of remote sensing, SSMs have gained popularity due to their effectiveness in addressing unique challenges such as dense visual predictions, multi-modal remote sensing data, and temporal remote sensing data, which have also yielded significant advancements in customized architectures. This paper presents a comprehensive review of SSM-based approaches in remote sensing, covering most of the relevant studies since SSMs were first introduced to the field. We offer a multi-dimensional analysis examining SSM applications in remote sensing tasks and discussing advancements in architecture design. This paper not only synthesizes the rapid progress in SSM-based research but also identifies key challenges and future opportunities. By providing a detailed perspective, this paper aims to serve as a foundational resource for remote sensing researchers, offering actionable insights to foster further advancements in this evolving domain. We will keep tracing related works at https://github.com/QinzheYang/Awesome-RS-State-Space-Model.

[30] Efficient Remote Sensing Instance Segmentation with Linear-Time State Space Distilled Visual Foundation Models cs.CVPDF

Qinzhe Yang, Keyan Chen, Jia Xu, Zhenwei Shi, Zhengxia Zou

TL;DR: 本文提出了一种名为RS4D的高效遥感实例分割方法，通过知识蒸馏将基于Transformer的视觉基础模型压缩到具有线性计算复杂度的状态空间模型（SSM）骨干网络中，以解决Transformer在密集预测任务中二次方计算复杂度带来的效率瓶颈。

Details

Motivation: Transformer的计算复杂度随token数量呈二次方增长，严重限制了视觉模型（尤其是基于ViT的基础模型）在密集预测任务（如遥感实例分割）中的效率。本文旨在通过线性复杂度的状态空间建模来解决这一效率问题。

Result: 在SSDD、WHU和NWPU等多个基准数据集上的实验表明，与基于ViT的方法相比，提出的SSM骨干网络在参数和FLOPs上分别减少了8倍和9倍，同时保持了与基于ViT和CNN的实例分割方法相当或更优的精度。

Insight: 核心创新点在于将大语言模型中知识蒸馏的思想引入视觉任务，提出了一种自适应噪声和掩码的知识蒸馏训练方法，将庞大的自注意力空间知识压缩到紧凑、密集的线性状态空间中，从而实现了模型效率的显著提升。从客观角度看，将状态空间模型与知识蒸馏结合用于遥感实例分割是一个新颖且有效的效率优化路径。

Abstract: The computational complexity of Transformers scales quadratically with the number of tokens, which significantly constrains the efficiency of vision models, particularly recent ViT-based foundation models in dense prediction tasks. Instance segmentation, a typical dense visual prediction task in the remote sensing field, faces similar challenges. In this paper, inspired by the recent advances of knowledge distillation in large language models, we introduce RS4D - a new remote sensing instance segmentation method with linear computational complexity, which addresses the inefficiency of long sequence modeling through distilled state space modeling (SSM). We propose an adaptive noise and masking knowledge distillation training method for pre-training lightweight SSM backbones, which effectively compresses knowledge from the vast self-attention space into a compact, dense linear state space. We also design a remote sensing image instance segmentation architecture based on this lightweight visual encoder, where we explore variants of three different backbones and two segmentation heads. Extensive experiments are conducted on multiple benchmark datasets, including SSDD, WHU, and NWPU. Compared to ViT-based approaches, our proposed SSM backbone achieves an 8x reduction in parameters and a 9x reduction in FLOPs while maintaining comparable or superior accuracy to both ViT- and CNN-based instance segmentation methods. The implementation codes have been publicly available at https://github.com/QinzheYang/RS4D.

[31] V-Zero: Answer-Label-Free On-Policy Distillation with Contrastive Evidence Gating for Fine-Grained Visual Reasoning cs.CVPDF

Haoxiang Sun, Zhihang Yi, Langxuan Deng, Yuhao Zhou, Peiqi Jia

TL;DR: 本文提出了V-Zero，一个无需答案标注的细粒度视觉推理框架。该方法基于策略蒸馏，通过对比性证据门控机制，利用学生模型自身采样的轨迹和正负视觉视图进行训练，避免了对外部答案标签或强化学习奖励的依赖。

Details

Motivation: 现有细粒度视觉推理方法通常依赖带有可验证奖励的强化学习或大规模标注推理轨迹的监督微调，导致探索成本高、依赖人工验证规则或文本监督。本文旨在探索一种无需外部答案标签的学习范式。

Result: 在多个视觉推理基准测试上的实验表明，V-Zero能持续提升细粒度视觉推理性能，同时保持强大的泛化能力。其训练速度比之前的监督微调方法快5倍以上，比强化学习基线快10倍以上。

Insight: 核心创新在于将策略蒸馏重新解释为无负样本的停止梯度对齐，并指出其性能上限受限于缺乏轨迹级判别。为此，V-Zero引入了对比性证据门控，利用问题相关的区域裁剪和负视觉视图来评估学生轨迹并门控密集的令牌级蒸馏，实现了无答案标签的有效学习。

Abstract: Fine-grained visual reasoning requires multimodal large language models (MLLMs) to identify task-relevant visual evidence and ground their reasoning in local image regions. Existing agentic methods typically rely on reinforcement learning with verifiable rewards or supervised fine-tuning on large-scale annotated reasoning traces, leading to costly exploration, hand-designed verification rules, or heavy dependence on textual supervision. A natural way to avoid such external answer labels is to learn from trajectories sampled by the student itself, which points to On-Policy Distillation (OPD). To understand what OPD can and cannot provide for visual reasoning, we revisit it as negative-free stop-gradient alignment. This perspective shows that, although OPD provides effective token-level correction, its ceiling is constrained by the absence of trajectory-level discrimination. Motivated by these observations, we propose V-Zero, an answer-label-free framework for visual reasoning with contrastive evidence gating. V-Zero uses no annotated textual answer labels; instead, during training it pairs a question-relevant regional crop with a negative visual view to evaluate student-sampled trajectories and gate dense token-level distillation. Experiments on multiple visual reasoning benchmarks show that V-Zero consistently improves fine-grained visual reasoning while preserving strong generalization. Notably, V-Zero is more than 5$\times$ faster than previous supervised fine-tuning methods and more than 10$\times$ faster than reinforcement learning baselines. Code and dataset will be released at https://github.com/eVI-group-SCU/V-Zero

[32] Follow Your Track: Precise Skeleton Animation Controlled by 3D Trajectories cs.CVPDF

Yueting Liu, Yanqin Jiang, Nian Liu, Jingmen Zhou, Zhengjun Zha

TL;DR: 本文提出了ACT框架，一种基于3D轨迹控制的拓扑通用骨骼动画方法，旨在解决现有4D生成方法在时间一致性、识别准确性和可控性方面的不足。该方法使用骨架作为紧凑的结构化表示，并利用单目视频中的3D点轨迹作为明确的运动指导，通过路由轨迹注入器实现精确的轨迹到关节的转换。

Details

Motivation: 现有4D生成方法通常将3D资产生成与运动合成解耦，使用密集网格或高斯表示导致计算成本高且易产生时间伪影，而文本或视频控制信号缺乏细粒度时空细节或与外观背景纠缠，导致动画时间一致性差、识别错误和可控性有限。

Result: 大量实验表明，ACT在保真度和时间一致性方面显著优于现有方法。

Insight: 创新点在于采用骨架作为高效表示和3D轨迹作为明确运动指导，并通过路由轨迹注入器（包含先验引导硬路由、全局路由和局部窗口化交叉注意力三个互补设计）实现精确鲁棒的轨迹-关节映射，从而提升动画质量和可控性。

Abstract: 4D generation aims to animate 3D objects with realistic motion, holding great promise for applications. Existing methods typically decouple 3D asset generation from motion synthesis: acquire a 3D asset, prepare a structural representation like mesh and Gaussians, and synthesize motion from text or video control signals. However, dense mesh and Gaussian representations incur high computational costs and are prone to temporal artifacts, limiting animation quality and duration to only short clips. Meanwhile, text lacks fine-grained spatial and temporal details such as timing and coordination, while video entangles motion with appearance and background. Together, these limitations result in 4D animations that suffer from poor temporal consistency, wrong identification, and limited controllability. We address these issues with \texttt{ACT}, a trajectory-conditioned framework for topology-general skeletal animation. ACT uses skeletons as a compact structured and compute-efficient representation and 3D point trajectories from monocular video as explicit motion guidance which provide detailed motion patterns without appearance entanglement. At the core of ACT is a Routed Trajectory Injector, which achieves accurate and robust trajectory-to-joint transfer through three complementary designs: prior-guided hard routing establishes precise skeleton-to-mesh correspondences, global routing enables holistic joint-track interaction for full-body motion awareness, and local windowed cross-attention enforces fine-grained temporal alignment, improving micro-timing and reducing motion misalignment across varying motion rates. Extensive experiments demonstrate that \texttt{ACT} significantly outperforms existing methods in fidelity and temporal consistency.

[33] Invoice Haystack: Benchmarking Document Retrieval and Visual Question Answering Under Strong Visual Homogeneity cs.CVPDF

Heethanjan Kanagalingam, Thenukan Pathmanathan, Mokeeshan Vathanakumar, Basim Azam, Sarah Monazam Erfani

TL;DR: 本文提出了Invoice Haystack基准测试，用于评估在视觉高度同质化文档集合中的检索和视觉问答性能。针对现有基准中视觉同质性不足的问题，作者设计了一个包含1500张匿名发票图像和200个判别性问答对的基准，其文档间平均余弦相似度高达0.73。为解决该挑战，作者提出了VL-RAG混合检索增强生成框架，通过联合利用文本和视觉嵌入以及基于VLM的验证过滤器，在多个基准上实现了显著的性能提升。

Details

Motivation: 现有视觉语言模型在单一文档的视觉问答上表现接近人类，但在从视觉高度同质化的大规模文档集合中检索信息时性能显著下降。现有多文档基准聚合了多样化的文档类型，其嵌入空间的人工分离不能反映企业文档库（如数千份共享相同视觉模板的发票）的真实情况，作者将此问题定义为嵌入崩溃。

Result: 在提出的Invoice Haystack-500基准上，VL-RAG框架实现了60.0%的Recall@1，比现有最先进方法绝对提升了13.5个百分点。在DocHaystack-1000和InfoHaystack-1000基准上，VL-RAG也分别取得了77.1%（vs. 75.2%）和84.5%（vs. 80.0%）的Recall@1，证明了其在同质和异质文档集合上的一致优越性。

Insight: 核心创新点在于识别并量化了视觉同质性对文档检索的挑战（嵌入崩溃），并为此创建了一个更具挑战性的基准（Invoice Haystack）。提出的VL-RAG框架通过双流融合（文本和视觉嵌入）以及基于VLM的验证过滤器，有效利用了多模态的互补优势，为处理视觉同质化文档检索提供了新的解决方案。

Abstract: Vision Language Models have achieved near-human performance on single-document Visual Question Answering, yet their effectiveness degrades significantly when retrieving information from large collections of visually homogeneous documents. Existing multi-document benchmarks aggregate diverse document types, creating artificial separation in embedding space that does not reflect enterprise document repositories where thousands of records share identical visual templates. We identify this as embedding collapse and introduce Invoice Haystack, a benchmark with 1,500 anonymized invoice images paired with 200 discriminative question-answer pairs, specifically designed to stress-test retrieval under strong visual homogeneity. Invoice Haystack exhibits a mean pairwise cosine similarity of 0.73, compared to 0.38 (DocHaystack) and 0.31 (InfoHaystack) in existing benchmarks, posing a fundamentally more challenging retrieval problem. Addressing the identified challenge, we propose VL-RAG, a hybrid retrieval-augmented generation framework that jointly leverages text and visual embeddings to harness the complementary strengths of both modalities, followed by a VLM-based verification filter for precise document identification. VL-RAG achieves 60.0% Recall@1 on Invoice Haystack-500, outperforming existing state-of-the-art method by up to an absolute 13.5 percentage points. It further improves retrieval considerably on DocHaystack-1000 (77.1% vs.\ 75.2%) and InfoHaystack-1000 (84.5% vs.\ 80.0%), establishing the proposed dual-stream fusion as a consistently superior retrieval strategy across both homogeneous and heterogeneous document collections.

[34] Beyond Visual Forensics: Auditing Multimodal Robustness for Synthetic Medical Image Detection cs.CV | cs.AIPDF

Ching-Hao Chiu, Hao-Wei Chung, Gelei Xu, Xueyang Li, Pin-Yu Chen

TL;DR: 本文提出了一种超越传统视觉取证的方法，通过审计多模态鲁棒性来检测合成医学图像。研究发现，当视觉语言模型（VLM）同时接收图像和结构化记录时，可能会过度依赖文本上下文进行真实性判断，导致同一图像因伴随文本不同而得到不同预测。为此，作者构建了一个配对基准测试，固定图像并交换受控的元数据变体，以系统评估多模态鲁棒性。

Details

Motivation: 随着生成式AI的快速应用，合成医学图像带来了诊断欺骗和保险欺诈等风险。现有基于VLM的合成图像检测研究通常孤立地考虑图像，而临床实践中图像常与结构化记录和元数据一起解读，且VLM越来越多地在联合图像-记录输入下部署。本文旨在揭示并系统表征这一未被充分研究的多模态脆弱性。

Result: 研究在多种成像模态上评估了多个开源权重和前沿API的VLM，并量化了仅元数据变化如何改变真实性预测。提出的基准测试为在超越仅图像设置下评估和改进多模态鲁棒性提供了标准化工具。

Insight: 创新点在于将合成医学图像检测重新定义为图像-记录接口的多模态鲁棒性审计，并引入了配对基准来揭示VLM在联合模态输入下可能过度依赖文本的脆弱性。这为实际部署中的鲁棒性评估提供了新视角和方法。

Abstract: With the rapid adoption of generative AI, synthetic medical images pose growing risks, including diagnostic deception and insurance fraud. Although prior work has explored vision-language model (VLM)-based synthetic image detection, these evaluations typically consider images in isolation. In clinical practice, however, images are interpreted alongside structured records and metadata, and VLMs are increasingly deployed under joint image-record inputs. We uncover a previously underexamined multimodal vulnerability: when given both modalities, VLMs may overweight record context in authenticity judgments, such that the same image receives different predictions solely due to changes in its accompanying text. This raises concerns about robustness in real-world deployment. To systematically characterize this effect, we reformulate synthetic medical image detection as an audit of multimodal robustness at the image-record interface and introduce a paired benchmark that holds the image fixed while swapping controlled metadata variants. Across multiple imaging modalities, we evaluate diverse open-weight and frontier API VLMs and quantify how metadata alone shifts authenticity predictions. Our benchmark provides a standardized tool for assessing and improving multimodal robustness beyond image-only settings. The code is available at https://github.com/chiuhaohao/Beyond-Visual-Forensics.

[35] Teach-to-Reason: Competition-Guided Reasoning with a Self-Improving Teacher cs.CVPDF

Xiao Han, Hao Liu, Zhimin Bao, Jile Jiao, Yue Wang

TL;DR: 本文提出Teach-to-Reason (T2R)框架，用于优化胸部X光视觉问答中的推理链质量。该框架通过一个自我改进的教师模型和一个竞赛引导的推理器，将基于比较的监督引入推理链优化过程，以解决传统基于答案的强化学习奖励信号过于粗糙或失效的问题。

Details

Motivation: 现有基于强化学习的训练方法通常依赖答案级别的奖励，这种奖励信号过于粗糙，难以提升思维链的质量，并且在群体优势趋近于零时会失效，因此需要更精细的监督信号来优化医学推理过程。

Result: 在多个胸部X光开放式视觉问答基准测试上的实验表明，T2R框架持续优于强基线模型，证明了基于比较的监督在受控和原则性集成下，能为推理优化提供更有效的训练信号。

Insight: 核心创新在于通过自我竞争的教师模型生成逐步增强的参考，并结合案例级奖励设计，在原始奖励信号有效时保留其诱导的正负划分，在信号退化时则从竞赛分数中恢复监督，从而实现对推理链更精细和鲁棒的优化。

Abstract: Chest X-ray visual question answering (CXR VQA) requires models not only to predict correct answers, but also to produce reliable medical reasoning. However, existing reinforcement-learning-based training typically relies on answer-level rewards, which are often too coarse to improve chain-of-thought (CoT) quality and can become ineffective when group-level advantages collapse to zero. We propose \textbf{Teach-to-Reason (T2R)}, a framework that introduces comparison-based supervision into CoT optimization through a self-improving \emph{Teacher} and a competition-guided \emph{Reasoner}. As the Teacher is iteratively strengthened via self-competition, the Reasoner is optimized against progressively stronger Teacher-generated references. We further introduce a case-wise reward design that preserves the original reward-induced positive/negative partition when it is informative, and restores supervision from competition scores when the original reward signal degenerates. Experiments on multiple CXR open-ended VQA benchmarks show that T2R consistently outperforms strong baselines, indicating that comparison-based supervision, when integrated in a controlled and principled manner, provides a more effective training signal for reasoning optimization.

[36] PRISM: Feed-Forward Single-Image 3D Reconstruction via Geometric Warp-Residual Modeling cs.CVPDF

Zhijie Zheng, Xinhao Xiang, Jiawei Zhang

TL;DR: 本文提出PRISM，一种用于单图像3D重建的前馈框架。该方法将多视角潜在预测分解为无参数的几何先验和学习的残差校正，无需在推理时进行扩散采样，从而显著提升效率。

Details

Motivation: 现有基于相机控制视频扩散模型的方法依赖迭代扩散采样，限制了实际部署。作者观察到几何前向扭曲已能覆盖目标视图的大部分内容，仅需编码器校正紧凑残差，因此提出前馈框架以解决效率问题。

Result: 在三个基准测试上的广泛实验表明，PRISM在重建质量上与基于扩散的方法相当，同时将每场景推理时间大幅减少至仅36秒。

Insight: 创新点在于将多视角预测分解为几何先验与残差校正，结合两阶段训练策略（潜在监督蒸馏和感知微调），实现了从纯合成数据泛化并平衡效率与质量。

Abstract: Reconstructing 3D scenes from a single image is a fundamental challenge in computer vision, with broad applications in virtual reality, robotics, and content creation. Recent methods achieve outstanding performance by leveraging camera-controlled video diffusion models, but rely on iterative diffusion sampling, which greatly limits their practical deployment. We observe that geometric forward warping alone can cover the majority of a target view directly from the input image, with only a compact residual left for the encoder to correct. Motivated by this observation, we propose PRISM, a feed-forward framework that decomposes multi-view latent prediction into a parameter-free geometric prior and a learned residual correction, with no diffusion sampling required at inference. To enable generalization from purely synthetic training data, we devise a two-stage training strategy combining latents supervised distillation for geometric generalization and perceptual fine-tuning for appearance quality optimization. Extensive experiments on three benchmarks demonstrate that PRISM achieves competitive reconstruction quality compared with diffusion-based methods, while reducing inference time dramatically to only 36 seconds per scene.

[37] Gastroendoscopy View Synthesis: A New Real Dataset and Evaluation cs.CVPDF

Masaki Minai, Yusuke Monno, Masatoshi Okutomi, Sho Suzuki

TL;DR: 本文提出了首个用于内窥镜新视角合成的真实胃镜数据集GastroNVS，包含胃镜图像、相机位姿和点云数据，并评估了多种3D高斯泼溅方法在该数据集上的表现，以推动胃镜领域的数字孪生应用发展。

Details

Motivation: 现有新视角合成数据集不足以评估胃镜场景，限制了神经辐射场和3D高斯泼溅等技术在扩展内窥镜视野、构建3D数字档案和医生操作训练等医疗应用中的发展。

Result: 通过评估多种3DGS方法在GastroNVS数据集上的表现，分析了当前方法面临的挑战，为未来技术改进提供了基准。

Insight: 创新点在于构建了首个真实胃镜新视角合成数据集，填补了该领域数据空白；客观来看，该数据集有望成为医疗视觉领域评估3D重建和视图合成方法的重要基准平台。

Abstract: Novel view synthesis (NVS) is an active research topic in computer vision, owing to the success of neural radiance field (NeRF) and 3D Gaussian splatting (3DGS) methods. While NVS opens the door to potential applications in gastroendoscopy, such as extending the field of view of endoscopic images and enabling digital twins for 3D archiving and endoscopist manipulation training, the dataset is insufficient to evaluate NVS for gastroendoscopy. In this paper, we present the first real gastroscopy dataset for NVS, namely the GastroNVS dataset, which contains a set of gastroscopic images, camera poses, and a point cloud for real gastroendoscopy inspection. To assess the suitability of the GastroNVS dataset, we evaluate several 3DGS methods and discuss the challenges for future development. The dataset is available on request from our project page.

[38] LinStereo: Linear-Complexity Global Attention for Multi-Scale Iterative Stereo Matching cs.CVPDF

Yiran Wang, Oliver Turner, Viorela Ila

TL;DR: LinStereo是一种基于线性复杂度全局注意力的多尺度迭代立体匹配方法，旨在解决现有基于视觉基础模型的立体匹配流水线在利用多尺度特征、几何先验和上下文传播方面的不足。其核心是位置感知线性注意力模块，结合分层语义代价体积和深度先验初始化，在标准基准测试中达到SOTA水平，并在水下场景等具有挑战性的光照退化条件下展现出卓越的跨域泛化能力。

Details

Motivation: 现有基于视觉基础模型的迭代立体匹配方法未能充分利用多尺度主干特征、初始化时的几何先验，且上下文仅局部传播，在光照条件退化（如水下场景）时性能下降严重。

Result: 在标准基准测试中达到SOTA级别的精度，并在水下场景（TartanAir-UW和真实数据集SQUID）上实现了最强的跨域泛化能力，AbsRel误差分别降低了28%和26%。

Insight: 创新点包括：1）线性复杂度的位置感知全局注意力模块，替代局部递归进行全局信息聚合；2）分层语义代价体积，提供尺度对齐的相关性特征；3）深度先验初始化，将单目深度估计转化为度量校准的初始值，有效引导匹配过程。

Abstract: Existing Vision Foundation Model (VFM)-based iterative stereo pipelines under-exploit three information pathways: multi-scale backbone features are collapsed into single-level correlations, geometric priors remain untapped at initialization, and context propagates only locally. These gaps widen under degraded photometric cues, making underwater scenes a stringent generalization test. To address this, we propose LinStereo, built upon Depth Anything V3, whose core is a Position-Aware Linear Attention (PALA) module that replaces local recurrence with global aggregation at linear cost, propagating reliable estimates from well-matched regions into degraded areas while preserving disparity structure. PALA is made effective by two enabling components: Hierarchical Semantic Cost Volumes (HSCV), which supply scale-aligned correlations from the VFM feature hierarchy, and a Depth Prior Initialization (DPI) that converts monocular depth into a metrically calibrated warm start. LinStereo achieves state-of-the-art-level accuracy on standard benchmarks and strong cross-domain generalization, particularly on underwater scene where severe photometric degradation makes stereo matching particularly challenging, attaining the best overall accuracy with consistent gains 28% lower AbsRel on TartanAir-UW, 26% on SQUID, a real-world underwater dataset).

[39] EchoStyle: Unlocking High-Fidelity Video Stylization with Reverse Data Synthesis cs.CV | cs.AIPDF

Huaqiu Li, Jiahao Wang, Sijia Cai, Hualian Sheng, Bing Deng

TL;DR: EchoStyle是一个可扩展的文本驱动框架，旨在解决高质量、任意长度视频风格化的挑战。它通过构建视频到视频的架构、创建大规模合成数据集V-Style20k以及设计滑动窗口推理策略，实现了优异的视频风格化效果。

Details

Motivation: 现有视频风格化方法通常依赖参考图像作为风格先验，存在内容泄露、数据稀缺以及对长视频适应性有限的问题，导致风格漂移和运动失真。

Result: 大量实验表明，EchoStyle在多种艺术风格上表现出色，其性能甚至可与领先的闭源解决方案相媲美。

Insight: 创新点包括：1) 提出自动反向合成流水线构建大规模高质量视频对数据集V-Style20k以解决数据稀缺；2) 设计初始-跟随模式机制和滑动窗口推理策略以支持长视频风格化；3) 采用文本驱动而非图像参考的方式提供更灵活的风格控制。

Abstract: While image stylization has been studied extensively, video stylization remains a critical and largely unsolved challenge in the field of intelligent content creation. Existing methods, usually utilizing a reference image as the style prior, suffer from content leakage, data scarcity and limited adaptability to long videos, leading to suboptimal results with severe style drift and motion distortion. For these issues, we present EchoStyle, a scalable text-driven framework to achieve high-quality stylization of videos with arbitrary lengths. To start with, we construct a video-to-video architecture to appropriately re-fuse the video content and the text style. To address data scarcity, we pioneer an automatic reverse-synthesis pipeline to establish V-Style20k, a large-scale stylization dataset of 20k high-quality video pairs. To facilitate long video stylization, we devise an init-follow-mode mechanism along with a sliding-window inference strategy. Extensive experiments demonstrate EchoStyle’s excellent performance across a wide range of artistic styles, even comparable to leading closed-source solutions.

[40] C3-Bench: A Context-Aware Change Captioning Benchmark cs.CV | cs.AIPDF

Jae-Woo Kim, Hyeongbeom Kim, Ue-Hwan Kim

TL;DR: 本文提出了C3-Bench，一个用于评估上下文感知变化描述（Context-aware Change Captioning）的综合基准。该基准包含4,996个人工标注的图像对，涵盖51个真实世界的变化场景，并首次引入了基于LLM-as-Judge的评估框架来衡量多个细粒度维度。作者利用该基准测试了32个模型，揭示了现有变化描述模型在脱离训练风格场景时的系统性失败。

Details

Motivation: 现有的变化描述系统缺乏全面的评估框架，导致其在多样化的真实世界变化场景中的真实性能未被充分探索。本文旨在填补这一空白，通过构建一个全面的基准来评估模型在不同上下文中的表现。

Result: 在C3-Bench上对32个模型（包括传统变化描述模型、专有大型多模态模型和开源LMMs）进行了基准测试。结果表明，一旦变化场景偏离训练风格，传统模型会失效，即使是像GPT-5.2这样的SOTA LMMs也会出现系统性的、依赖于领域和位置的错误，从而扭曲了对变化的可靠理解。

Insight: 主要创新点在于构建了一个覆盖多领域、多场景的综合性上下文感知变化描述基准，并首次在该任务中引入了LLM-as-Judge评估框架来衡量细粒度维度和新颖的可逆性指标。这为构建可泛化、可信赖的变化描述系统明确了需要解决的关键挑战和失败模式。

Abstract: While Change Captioning systems have garnered substantial attention to respond to our evolving world, their true performance on diverse real-world change contexts remains largely unexplored due to the lack of comprehensive evaluation frameworks. To fill this gap, we propose C3-Bench, a comprehensive benchmark for evaluating Context-aware Change Captioning. C3-Bench features: (1) 4,996 human-labeled image pairs of 51 real-world change contexts across four domains (e.g., natural scenes, remote sensing imagery, image editing, and anomalies), each with diverse, carefully curated scenarios derived from multiple change-centric communities; and (2) the first LLM-as-Judge evaluation framework in the change captioning task that measure fine-grained dimensions (e.g., correctness, specificity, fluency, and relevance), along with a novel reversibility metric exploring whether models understand changes with symmetric consistency. Based on C3-Bench, we benchmark 32 models – including conventional change captioning models, proprietary Large Multimodal Models (LMMs), and 2B-90B open-source LMMs. We reveal a fundamental blind spot in the prevailing change captioning paradigm: Once the change context departs from training-style regimes, conventional models collapse, and even state-of-the-art LMMs such as GPT-5.2 exhibit systematic domain- and position-dependent errors that distort reliable change understanding. By making these hidden failure modes explicit and measurable, we delineate the next frontier for building generalizable and trustworthy change captioning systems. All codes and datasets are publicly available on the project page.

[41] Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models cs.CV | cs.LGPDF

Kaiwen Zheng, Guande He, Min Zhao, Jintao Zhang, Huayu Chen

TL;DR: 本文提出了Causal-rCM，一个用于自回归视频扩散的统一教师强制与自强制蒸馏框架。该框架将rCM扩散蒸馏思想扩展到自回归视频生成，结合了教师强制的一致性模型（CM）作为前向散度初始化，以及自强制分布匹配蒸馏（DMD）作为反向散度在线精炼，旨在实现高效的流式视频生成和交互式世界模型。

Details

Motivation: 动机在于解决自回归视频扩散模型在实时流式生成和交互式世界模型中训练效率低、采样步骤多的问题，通过统一的蒸馏框架整合互补的教师强制与自强制训练范式，以提升模型性能与收敛速度。

Result: 在流式视频生成任务中，仅使用合成数据训练，在帧级和块级设置下均达到了最先进的性能；蒸馏后的2步因果Wan2.1-1.3B模型在VBench-T2V基准上仅用1-2步采样即获得84.63分，实现了10倍于离散时间CM的收敛加速。

Insight: 创新点包括：首次将教师强制连续时间CM（如sCM/MeanFlow）应用于自回归视频扩散，通过定制掩码FlashAttention-2 JVP内核实现；提出了统一的Causal-rCM算法-基础设施开放方案，为扩散蒸馏和因果训练提供了可扩展的解决方案；在Cosmos 3全模态世界基础模型中应用，实现了动作条件生成的交互式世界模型能力。

Abstract: Autoregressive video diffusion with causal diffusion transformers has emerged as a major paradigm for real-time streaming video generation and action-conditioned interactive world models. In this work, we extend rCM, an advanced diffusion distillation framework, to autoregressive video diffusion. The core philosophy of rCM lies in the complementarity between forward and reverse divergences, represented by consistency models (CMs) and distribution matching distillation (DMD), respectively, in diffusion distillation. This philosophy naturally carries over to the autoregressive setting, where teacher-forcing (TF) provides an offline, forward-divergence causal training paradigm, while self-forcing (SF) corresponds to an on-policy, reverse-divergence refinement. Our contributions are: (1) through extensive experiments, we show that teacher-forcing CM is currently the best complement to self-forcing DMD as an initialization strategy (2) we present the first implementation of teacher-forcing-based continuous-time CMs (e.g., sCM/MeanFlow) for autoregressive video diffusion, enabled by our custom-mask FlashAttention-2 JVP kernel, achieving 10$\times$ faster convergence compared to discrete-time CMs (dCMs) (3) we introduce Causal-rCM, a leading, unified, and scalable algorithm-infrastructure open recipe for diffusion distillation and causal training (4) we achieve state-of-the-art streaming video generation performance in both frame-wise and chunk-wise settings, using only synthetic data for training. Notably, our distilled 2-step causal Wan2.1-1.3B model achieves a VBench-T2V score of 84.63 with only 1 or 2 sampling steps. We further apply Causal-rCM to Cosmos 3, an advanced omnimodal world foundation model for physical AI with action-conditioned generation capability, enabling an interactive world model.

[42] TACO: Towards Task-Consistent Open-Vocabulary Adaptation in Video Recognition cs.CVPDF

Minghao Zhu, Xiao Lin, Mengxian Hu, Xun Zhou, Liuyi Wang

TL;DR: 本文提出了TACO框架，旨在解决将CLIP模型适配到开放词汇视频识别任务时，存在的微调与评估目标不一致的问题。核心方法包括相对结构蒸馏和轻量级专业化投影，以在保持预训练泛化能力的同时，实现任务特定的适配。

Details

Motivation: 现有方法在平衡CLIP模型的新视频知识与预训练泛化能力时，忽略了表征在微调数据分布之外的偏移，这种偏移源于微调（已知分布）与评估（未见分布）目标的不一致，导致次优的适配效果。

Result: TACO在跨数据集和基础到新类设置下的多个基准测试中，都取得了最先进的性能。

Insight: 创新点在于提出适配应保持训练分布之外的OOD相关对齐，并通过相对结构蒸馏来正则化表征空间的相对几何结构，以及通过轻量级专业化投影解耦表征空间与优化空间，从而在不直接过度专业化测试时所用表征的情况下实现任务特定适配。

Abstract: Adapting CLIP for open-vocabulary video recognition necessitates a delicate balance between newly acquired video knowledge and the pretrained generalization. While existing studies pursue this generalization-specialization trade-off with additional regularizations or constraints, we argue that they overlook the deviation of representations beyond the fine-tuning data distribution, resulting in suboptimal adaptation effects. We believe such deviation is inherited from the inconsistency between the fine-tuning and evaluation objectives, where model optimization is restricted to the known training distribution but evaluated on unseen ones. In this paper, we introduce \emph{TACO}, a simple yet effective framework to mitigate the potential negative effects induced by this inconsistency. Our key insight is that adaptation should preserve OOD-relevant alignment beyond the training distribution. To this end, we propose \emph{Relative Structure Distillation}, which regularizes the relative geometry of the representation space and suppresses harmful alignment shift during training. We further decouple the representation space from the optimization space with a lightweight specialization projection, allowing task-specific adaptation without directly overspecializing the representations used at test time. \emph{TACO} establishes state-of-the-art performance on diverse benchmarks under cross-dataset and base-to-novel settings. Code will be released at https://github.com/ZMHH-H/TACO.

[43] HG-Bench: A Benchmark for Multi-Page Handwritten Answer-Region Grounding in Automated Homework Assessment cs.CV | cs.AIPDF

Chuangxin Zhao, Boyan Shi, Yanling Wang, Yijian LU, Canran Xiao

TL;DR: 本文提出了HG-Bench，一个用于自动化作业评估中多页手写答案区域定位的基准测试。该基准包含500个人工标注的K-12作业样本，要求模型在页面序列中定位完整的答案区域及其有序的步骤级子区域。论文还引入了一个页面感知的评估协议，分别衡量完整答案定位和步骤分解的性能。

Details

Motivation: 自动化作业评估不仅需要识别学生答案，还需在嘈杂的多页手写作业中准确定位每个答案及中间推理步骤出现的位置。目前缺乏针对页面感知、两级答案区域定位的评估设定。

Result: 在HG-Bench上，前沿的闭源API和开源视觉语言模型的零样本性能均未超过55.22%的完整答案定位准确率或48.22%的步骤分解准确率。而一个在约1万个领域内样本上微调的GLM-4.6V 9B参考模型达到了74.97%和72.26%的准确率。

Insight: 论文的创新点在于提出了首个专注于多页手写答案层次化空间结构定位的基准测试和评估协议，将答案定位分解为完整答案和推理步骤两个层级，揭示了当前模型在理解学生手写推理空间结构而非仅解析文本方面的能力差距，为未来研究提供了可复现的基准和参考点。

Abstract: Automated homework assessment depends not only on recognizing student answers, but also on accurately locating where each answer and each intermediate reasoning step appears in noisy, multi-page handwritten work. This paper addresses the missing evaluation setting of page-aware, two-level answer-region grounding: given a sequence of homework page images, a model must localize complete answer regions and their ordered step-level subregions. We introduce HG-Bench, a benchmark of 500 human-annotated K-12 homework samples curated from a 1,489,278-image source pool, with question-level and step-level boxes linked by a hierarchical containment constraint. HG-Bench is paired with a page-aware evaluation protocol that separately measures complete-answer localization (FA) and step-level decomposition (FSm), revealing whether models truly ground the spatial structure of student reasoning rather than merely parse visible text. Across frontier closed-source APIs and competitive open-weight VLMs, no zero-shot system exceeds 55.22% on FA or 48.22% on FSm, while a GLM-4.6V 9B reference model fine-tuned on ~10k in-domain examples reaches 74.97/72.26. These results identify step-level handwritten grounding as a concrete capability gap and provide a reproducible benchmark, evaluation protocol, and trained reference point for future work on automated homework assessment.

[44] C2RM-Seg: Causal Counterfactual Reasoning with Structural-Semantic Priors for Weakly Supervised Histopathological Tissue Segmentation cs.CVPDF

Hualong Zhang, Siyang Feng, Zihan Huan, Yi Qian, Zhenbing Liu

TL;DR: 本文提出C2RM-Seg，一种用于弱监督组织病理学组织分割的两阶段框架。它通过因果反事实推理模块（C2RM）分解特征并利用学习到的因果结构矩阵进行干预，以抑制混杂上下文并生成与形态对齐的类激活图（CAM）。在分割阶段，采用双路径结构-语义架构，结合ResNeSt的细粒度结构特征和冻结DINOV3基础模型的全局语义先验，并通过交叉路径门控机制自适应调节语义注入以保持边界保真度。此外，还提出了不确定性门控边界（UGM）损失来动态平衡边界强制和置信度学习，以进一步减轻伪标签噪声。

Details

Motivation: 弱监督组织病理学组织分割方法通常受限于由类激活图（CAM）生成的噪声伪标签，现有CAM方法倾向于关注染色驱动的外观线索而非真正的因果组织形态，导致虚假定位和结构一致性差。

Result: 在两个公开的组织病理学组织数据集上的大量实验表明，C2RM-Seg取得了最先进的性能。

Insight: 创新点包括：1）引入因果反事实推理模块（C2RM）进行特征分解和因果干预，以生成更准确的形态对齐CAM；2）设计双路径结构-语义架构，结合局部结构特征和全局语义先验，并通过门控机制自适应融合；3）提出不确定性门控边界（UGM）损失，动态处理伪标签噪声。这些方法从因果推理和结构-语义融合角度提升了弱监督分割的鲁棒性和准确性。

Abstract: Histopathological tissue segmentation is essential for computer-aided diagnosis, yet weakly supervised methods often suffer from noisy pseudo-labels generated by Class Activation Mapping (CAM). Existing CAM approaches tend to focus on staining-driven appearance cues rather than true causal tissue morphology, resulting in spurious localization and poor structural consistency. To address this issue, we propose C$^2$RM-Seg, a two-stage framework that integrates causal pseudo-label refinement with structure-aware semantic enhancement. For classification, we introduce a Causal Counterfactual Reasoning Module (C$^2$RM) that decomposes features into latent factors and performs counterfactual intervention via a learned causal structure matrix, suppressing confounding context and producing morphology-aligned CAMs. For segmentation, we design a Dual-Path Structural-Semantic Architecture that combines fine-grained structural features from ResNeSt with global semantic priors from a frozen DINOV3 foundation model. A cross-path gating mechanism adaptively regulates semantic injection using local structural cues to preserve boundary fidelity. To further mitigate residual pseudo-label noise, we propose an Uncertainty-Gated Margin (UGM) loss, which dynamically balances margin enforcement and confidence learning based on prediction uncertainty. Extensive experiments on two public histopathological tissue datasets show that C$^2$RM-Seg achieves state-of-the-art performance.

[45] Spatio-Temporal Mixture-of-Modality-Experts Diffusion for Quantitative DCE-MRI Synthesis from Incomplete MR Sequences cs.CVPDF

Junhyeok Lee, Kyu Sung Choi

TL;DR: 本文提出了一种名为ST-MoME的时空混合模态专家条件扩散模型，用于从可能不完整的多模态MRI序列中合成3D DCE-MRI定量参数图。该方法通过一个时空门控网络融合特定模态的专家特征，生成体素级、时间步相关的权重作为条件张量来引导去噪过程，以应对实际中常见的模态缺失问题。

Details

Motivation: DCE-MRI定量图对肿瘤评估至关重要，但由于造影剂风险和扫描协议差异常常无法获取。现有方法通常假设输入模态固定且完整，无法处理现实中模态缺失的情况，因此需要一种能从不同子集的多模态MRI中稳健合成定量图的方法。

Result: 在一个包含386名患者的临床脑肿瘤队列上，模型在16种受控的模态可用性场景下进行评估。它在三个DCE参数（vp, ve, Ktrans）的综合归一化均方误差（NMSE）上达到最低，在vp和ve上表现领先，在Ktrans上结果具有竞争力，并且在临床关键的肿瘤区域内重建误差最低。

Insight: 主要创新点在于提出了一个时空混合模态专家（ST-MoME）扩散框架，其核心是能学习体素级、时间步依赖权重的门控网络，实现了对不完整多模态输入的灵活、自适应融合。一个有趣的发现是，模型学习到的融合动态（结构信息早期融合、生理信息晚期融合）与临床直觉一致。

Abstract: Quantitative maps from dynamic contrast-enhanced MRI (DCE-MRI) are essential for tumor assessment but are often unavailable due to contrast-agent risks and protocol variability. Prior methods predict these maps from other MRI modalities, yet most assume fixed, fully observed inputs and fail under realistic missingness. We present Spatio-Temporal Mixture-of-Modality-Experts (ST-MoME), a conditional diffusion framework that synthesizes 3D DCE parameter maps from diverse subsets of multimodal MRI. ST-MoME fuses modality-specific expert features through a spatio-temporal gating network that produces voxel-wise, timestep-dependent weights, forming a conditioning tensor that guides denoising. To preserve quantitative fidelity, ST-MoME performs diffusion directly in image space with 3D patch-based training and a Swin-based backbone. On a clinical brain-tumor cohort of 386 patients, we evaluate ST-MoME across 16 controlled modality-availability scenarios. It achieves the lowest mean Normalized Mean Square Error (NMSE) aggregated across all three DCE parameters, with leading performance on $v_p$ and $v_e$, competitive results on $K^{\mathrm{trans}}$, and the lowest reconstruction error within the clinically critical tumor region. A post-hoc analysis of the learned gating dynamics shows a structural-early, physiological-late fusion schedule consistent with clinical intuition.

[46] Disease-Centric Vision-Language Pretraining with Hybrid Visual Encoding for 3D Computed Tomography cs.CVPDF

Bowen Shi, Weiwei Cao, Ruifeng Yuan, Wanxing Chang, Wenrui Dai

TL;DR: 本文提出了一种针对3D CT影像的疾病中心化视觉-语言预训练框架，通过混合视觉编码、疾病级对比学习和诊断感知提示策略，解决了现有方法在处理3D CT时视觉骨干效率低和语义对齐粗糙的问题。

Details

Motivation: 现有视觉-语言预训练方法在处理3D CT影像时，因视觉骨干效率低下和语义对齐粗糙而表现不佳，本文旨在通过定制化框架解决这些问题，以提升医学AI的通用性。

Result: 在CT-RATE（84.4% AUC，提升5.1%）和Rad-ChestCT（75.4% AUC，提升5.4%）基准测试中达到SOTA性能，在60种疾病的挑战性基准上提升更显著（+9.8% AUC），并展现出强大的放射报告生成迁移能力。

Insight: 创新点包括：使用CNN-ViT混合编码器高效捕获局部解剖细节并保持全局注意力；通过可学习查询令牌实现疾病级对比学习以解耦同一区域的疾病；采用诊断感知提示策略弥合预训练与推理差距，增强零样本诊断可靠性。

Abstract: Vision-language pre-training (VLP) holds great promise for general-purpose medical AI by leveraging radiology reports as rich textual supervision, yet existing methods struggle with 3D CT imaging due to inefficient visual backbones and coarse semantic alignment. To address these issues, we propose a tailored VLP framework featuring three key components: (1) a CNN-ViT hybrid encoder that replaces ViT’s patch embedding with a 3D CNN backbone to efficiently capture local anatomical details while preserving global attention and compatibility with pre-trained cross-modal priors; (2) a disease-level contrastive learning mechanism using learnable query tokens to dynamically extract disease-specific semantics from full reports and align them with corresponding visual features, thereby disentangling distinct diseases within the same anatomical region; and (3) a diagnosis-aware prompt strategy that employs real clinical phrases and aggregated disease prototypes to bridge the pre-training-inference gap and enhance zero-shot diagnostic reliability. Our model achieves state-of-the-art performance on CT-RATE (84.4% AUC, +5.1%) and Rad-ChestCT (75.4% AUC, +5.4%), with even larger gains (+9.8% AUC) on a challenging 60-disease benchmark, and demonstrates strong transferability to radiology report generation, underscoring the generality and clinical utility of our approach.

[47] SAC$^2$-Net: Semantic Anchoring and Complementary-Consensus Fusion for Multimodal Micro-Expression Recognition cs.CVPDF

Xuepeng Zheng, Tong Chen

TL;DR: 本文提出SAC^2-Net，一种用于多模态微表情识别（MER）的语义锚定与互补共识融合网络。该方法通过将激活的动作单元（AUs）转化为文本提示作为语义锚点，对齐运动放大和光流两种模态的表示，然后进行可靠性感知的融合，以解决模态间的异构性和空间变化的模态可靠性问题。

Details

Motivation: 微表情识别面临面部运动细微、数据有限以及动作单元（AUs）与情绪类别关系模糊的挑战。作者观察到光流和运动放大这两种模态常表现出不对称的失效模式，即一种模态可能变得嘈杂或失真，而另一种仍保留判别性信息，这揭示了它们的互补性，但也带来了跨模态异构性和空间变化模态可靠性的融合挑战。

Result: 在五个MER基准测试上进行的大量实验表明，SAC^2-Net在粗粒度、细粒度、大规模和跨数据集评估设置中均达到了最先进的（state-of-the-art）或极具竞争力的性能。

Insight: 创新点在于提出了语义锚定软对齐（SASA），利用AU生成的文本提示作为稳定的语义锚点来对齐异构模态表示，避免了硬对比学习的局限性；以及互补共识融合（CCF），通过互补交换修复不可靠的局部证据，并通过共识细化强制共享空间关注，实现了可靠性感知的多模态融合。

Abstract: Micro-expression recognition (MER) is challenging due to subtle facial movements, limited data, and the ambiguous relationship between Action Units (AUs) and emotion categories. Optical flow and motion magnification have been widely used to describe subtle facial dynamics from different perspectives: the former captures local motion displacement, while the latter amplifies weak appearance changes. In this work, we observe that these two modalities often exhibit asymmetric failure patterns: one modality may become noisy, distorted, or uninformative, while the other still preserves discriminative AU-related evidence. This phenomenon reveals their complementarity, but also raises two key challenges for fusion: cross-modal heterogeneity and spatially varying modality reliability. Motivated by this observation, we propose SAC$^2$-Net, a Semantic Anchoring and Complementary-Consensus Network for multimodal MER, which first aligns visual modalities with semantic anchors and then performs reliability-aware fusion. To reduce cross-modal heterogeneity before fusion, we introduce Semantic Anchoring Soft Alignment (SASA), which converts activated AUs into textual prompts and uses them as stable semantic anchors to align motion-magnified and optical-flow representations. Unlike hard contrastive learning, SASA constructs hierarchical AU-aware soft labels to preserve semantic proximity among samples with overlapping or anatomically related AU patterns. Based on the aligned representations, Complementary-Consensus Fusion (CCF) first repairs unreliable local evidence through complementary exchange and then enforces a shared spatial focus through consensus refinement. Extensive experiments on five MER benchmarks show that SAC$^2$-Net achieves state-of-the-art or highly competitive performance across coarse-grained, fine-grained, large-scale, and cross-dataset evaluation settings.

[48] H-Adapter: Pose-Robust Hairstyle Transfer via Attention-Derived, Source-Aligned Hair Masks cs.CVPDF

Seulgi Jeong, Yunseong Cho, Sanghun Park

TL;DR: 本文提出H-Adapter，一种用于提升发型迁移在源图像与参考图像头部姿态差异较大时鲁棒性的方法。该方法通过区域特定损失训练，解耦头发与非头发目标，从而诱导出空间解耦的交叉注意力，并从中导出源对齐的头发编辑掩码，以指导基于扩散模型的修复。

Details

Motivation: 解决发型迁移任务中，当源图像与参考图像头部姿态差异较大时，现有方法效果不佳的挑战。

Result: 在姿态无关和姿态差异子集上的实验表明，该方法在姿态差异下取得了最佳的FID、FID_CLIP和CLIP-I分数，同时在非头发区域保持方面具有竞争力，并提升了细粒度参考发型细节的定性保真度。

Insight: 核心创新在于通过区域特定损失诱导空间解耦的交叉注意力，并从中自动生成源对齐的头发编辑掩码，这为基于扩散模型的编辑任务提供了更精确的空间引导。此外，该方法支持文本到图像生成、基于提示的头发颜色控制等实用扩展。

Abstract: Hairstyle transfer has practical applications such as virtual try-on, yet remains challenging when the source and reference exhibit large head-pose discrepancies. We propose H-Adapter, which improves pose robustness by training with a region-specific loss that disentangles hair and non-hair objectives and thereby induces spatially disentangled cross-attention, from which a source-aligned hair edit mask is derived to guide diffusion-based inpainting. Experiments on pose-agnostic and pose-different subsets demonstrate strong quantitative results, including the best FID, $\mathrm{FID}_{\mathrm{CLIP}}$, and CLIP-I under pose differences, while maintaining competitive non-hair preservation and improving qualitative fidelity to fine-grained reference hairstyle details. Beyond source-conditioned transfer, H-Adapter supports practical extensions including text-to-image generation, auxiliary prompt-based hair color control, and compatibility with an identity-preserving IP-Adapter variant. We also introduce a VLM-as-a-judge protocol and observe consistent gains in hairstyle faithfulness, non-hair preservation, and artifact quality.

[49] FeVOS: Foresight Expression Video Object Segmentation cs.CVPDF

Kehan Lan, Kaining Ying, Henghui Ding

TL;DR: 本文提出了前瞻性表达视频对象分割任务，旨在通过查询未来视频片段中的事件来预测当前帧中相关对象的掩码，以支持需要预决策时空推理的场景。为此，作者构建了FeVOS数据集，包含968个视频剪辑、14,525个前瞻性表达和2,904个思维链标注，并开发了基于MLLM的FeVOS-R1模型，通过监督微调和强化学习两阶段流程进行训练。该模型在FeVOS任务上达到SOTA性能，并在现有RVOS基准上展现出强泛化能力。

Details

Motivation: 现有Referring Video Object Segmentation任务主要关注描述已观察帧中对象事件、动作或外观的表达，缺乏对需要预决策时空推理场景的评估，限制了其适用性。因此，本文提出FeVOS任务，以解决对未来事件进行预测性推理的需求，例如在自我中心场景中预测即将使用的工具。

Result: FeVOS-R1模型在提出的FeVOS任务上实现了最先进的性能，并在现有RVOS基准测试中表现出强大的泛化能力，证明了其有效性。

Insight: 创新点包括引入前瞻性表达视频对象分割任务，强调预测性推理；构建包含思维链标注的FeVOS数据集，提供可解释的推理步骤；以及开发基于MLLM的两阶段训练模型FeVOS-R1，结合监督微调和强化学习以提升性能。从客观角度看，该工作推动了视频感知中预测推理的研究，通过任务设计和数据集构建填补了现有工作的空白。

Abstract: Existing Referring Video Object Segmentation tasks focus on referring expressions describing events, actions or appearances of relevant objects within the observed frames, lacking evaluation in scenarios that require pre-decisive spatio-temporal reasoning, thereby limiting their applicability. To address this, we propose Foresight Expression Video Object Segmentation, a task that queries future events in upcoming video segments and requires masks of the objects in the observed frames as visual answers. For example, in ego-centric scenes, the question “What tool will be used?” demands reasoning over spatio-temporal cues to predict the masks of the next tool to be used, which helps with the understanding of future actions and decisions. To support this task, we introduce FeVOS, a dataset with 968 video clips, 14,525 foresight expressions, and 2,904 chain-of-thought annotations to provide explicit and interpretable reasoning steps. We further develop FeVOS-R1, an MLLM-based model trained on our dataset via a two-stage pipeline of supervised fine-tuning and reinforcement learning. FeVOS-R1 not only achieves state-of-the-art performance on FeVOS, but also demonstrates strong generalization to existing RVOS benchmarks. We hope this work can inspire more research on predictive reasoning in video perception.

[50] VPA-Guard: Defending and Benchmarking Image-to-Video Generation Against Visual Prompt Attacks cs.CVPDF

Yining Sun, Haoyu Kang, Jiajun Wu, Heng Zhang, Danyang Zhang

TL;DR: 本文提出了VVA-Bench，这是首个用于评估图像到视频（I2V）生成模型在视觉提示攻击下安全性的系统性基准。研究发现，当前最先进的模型对此类攻击高度脆弱。为此，作者提出了VPA-Guard，一个检索增强和自我演化的防御框架，能有效降低攻击成功率与危害性，同时保持模型对合法用户编辑的实用性。

Details

Motivation: 随着图像到视频生成技术的发展，静态视觉提示（如箭头、草图）已成为控制视频动态的强大接口。然而，这些看似无害的提示可能被模型解释为有害的时间指令，从而生成危险视频。现有安全基准主要关注基于文本和纯图像内容的攻击，对隐性的视觉提示攻击探索不足。

Result: 在提出的VVA-Bench基准上进行广泛实验，结果表明最先进的模型（如Wan 2.7和Veo 3.1）对此类攻击高度脆弱，攻击成功率（ASR）分别达到100.0%和74.8%。提出的VPA-Guard防御框架平均将ASR降低了44.2%，危害性分数降低了73.4%。

Insight: 论文的创新点在于首次系统地构建了针对视觉中心提示攻击的视频生成安全基准（VVA-Bench），并提出了一个结合检索增强和自演化机制的防御框架（VPA-Guard）。其核心洞察是利用少样本推理来识别潜在的恶意意图，从而在防御攻击的同时不损害模型对合法编辑的实用性，为安全的多模态生成提供了新的评估范式和防御思路。

Abstract: Recent advancements in Image-to-Video (I2V) generation have transformed input images from simple appearance references into interactive control interfaces where visual cues such as arrows, sketches, and emojis orchestrate complex video dynamics with unprecedented controllability. However, these seemingly innocuous static cues can be interpreted by models as executable temporal instructions, unfolding into harmful actions in the generated videos. Despite the severity of this threat, existing safety benchmarks remain predominantly focused on text-based and content-only image-based jailbreaks, leaving implicit visual prompt attacks insufficiently explored. To bridge this gap, we present VVA-Bench, the first systematic benchmark for evaluating video generation safety under categorized vision-centric prompt attacks. Extensive experiments on VVA-Bench demonstrate that state-of-the-art models are highly susceptible to such attacks, with Attack Success Rates (ASR) reaching 100.0% on Wan 2.7 and 74.8% on Veo 3.1. To mitigate these risks, we propose VPA-Guard, a retrieval-augmented and self-evolving defense framework. By leveraging few-shot reasoning to identify latent malicious intents, our method reduces the attack ASR by 44.2% and the harmfulness score by 73.4% on average, while maintaining the model’s utility for legitimate user edits. Our work provides both a rigorous benchmark and an effective defense strategy to advance safe and socially responsible multimodal generation.

[51] Expresso-AI: Explainable Video-Based Deep Learning Models for Depression Diagnosis cs.CV | cs.AI | cs.LGPDF

Felipe Moreno, Sharifa Alghowinem, Hae Won Park, Cynthia Breazeal

TL;DR: 本文提出了一种名为Expresso-AI的新型可解释深度学习框架，用于基于面部视频的抑郁症严重程度自动诊断。该框架通过微调在动作识别数据集上预训练的深度卷积神经网络，并利用显著图分析面部区域和时序表情语义，从而为模型决策提供视觉和定量解释。

Details

Motivation: 抑郁症广泛流行且影响深远，需要客观、可解释的早期诊断方法。当前自动化诊断方法缺乏情感特异性和可解释性，限制了其在心理健康护理中的实际应用，特别是基于视频的深度模型在时序活动上的可解释性尚未充分探索。

Result: 在AVEC抑郁症数据集上，该视频建模方法改进了先前单帧面部基准的预测性能，提升了抑郁症诊断的预测能力。

Insight: 创新点在于将动作识别预训练模型迁移至抑郁症视频分析，并通过显著图解释模型关注的面部区域和时序表情语义，实现了诊断性能提升与决策可解释性的结合，为医疗专业人员提供了更直观的模型推理依据。

Abstract: Given the widespread prevalence of depression and its consequential impact on individuals and society, it is crucial to obtain objective measures for early diagnosis and intervention. As a multidisciplinary topic, these objective measures should be interpretable and accessible to health care professionals, ensuring effective collaboration and treatment planning in the realm of mental health care. Even though current automated depression diagnosis approaches improved over the last decade, a critical gap exists as they often lack affect-specificity and interpretability, limiting their practical application and potential impact on mental health care. In particular, interpretability from temporal activities from videos when deep models are used is not fully explored. In this study, we present a novel framework for analyzing Deep Neural Networks’ decisions when trained on facial videos, specifically focusing on automatic depression severity diagnosis. By fine-tuning Deep Convolutional Neural Networks (DCNN) pre-trained on Action Recognition datasets on depression severity facial videos from AVEC depression dataset, our framework is able to interpret the model’s saliency maps by examining face regions and temporal expression semantics. Our approach generates both visual and quantitative explanations for the model’s decisions, providing greater insight into its reasoning. In addition to this interpretability, our video-based modeling has improved upon previous single-face benchmarks for visual depression diagnosis, resulting in enhanced predictive performance. Overall, our work demonstrates the successful development of a framework capable of generating hypotheses from a facial model’s decisions while simultaneously improving depression’s predictive capabilities.

[52] SSMNBench: Diagnosing Image-based Cross-View Human-Object Understanding via Single-View Sufficiency and Multi-View Necessity cs.CVPDF

Tianchen Guo, Chen Liu, Ling Chen, Xin Yu

TL;DR: 本文提出了SSMNBench，一个用于诊断基于图像的跨视角人物与人物-物体理解能力的基准测试，包含3300个精心设计的问答对。该基准将任务分为单视角充分性（SVS）和多视角必要性（MVN）两类，通过系统性地扰动视角可用性来评估17个最先进的多模态大语言模型（MLLMs）。评估揭示了MLLMs在跨视角推理中的关键局限：面对冗余视角时存在严重的“干扰退化”（SVS），且无法有效整合跨摄像头的碎片化几何证据（MVN）。

Details

Motivation: 当前多视角基准测试通常使用固定的“帧集合”来评估模型，这混淆了模型对视觉干扰的鲁棒性与其真正的跨视角证据融合能力。为了诊断MLLMs在复杂跨视角以人为中心的场景中的真实推理能力，作者提出了SSMNBench。

Result: 在SSMNBench上对17个SOTA MLLMs的评估表明，现代MLLMs依赖于多个单图像语义平均和视角偏好，而非真正的跨视角合成。该基准暴露了这些模型在跨视图理解方面的根本性弱点。

Insight: 论文的创新点在于提出了一个诊断性的基准测试框架（SSMNBench），通过区分SVS和MVN任务来解耦和量化模型对视觉干扰的鲁棒性与跨视角证据融合能力。这为未来开发真正具有跨视图感知能力的多模态架构提供了严格的评估工具和明确的改进方向。

Abstract: Multimodal Large Language Models (MLLMs) have shown remarkable progress in single-image perception, yet their ability to reason about complex cross-view human-centric scenes remains largely unverified. Current multi-view benchmarks evaluate models using a fixed “bag of frames” and thus conflate a model’s robustness to visual distraction with its genuine ability to fuse fragmented cross-view evidence. To address this issue, we introduce SSMNBench, a diagnostic benchmark comprising 3,300 curated QA pairs for cross-view human and human-object understanding. SSMNBench uniquely categorizes tasks into Single-View Sufficiency (SVS) and Multi-View Necessity (MVN). By systematically perturbing view availability across 17 state-of-the-art MLLMs, critical limitations are revealed: models suffer from severe “distraction degradation” when presented with redundant views (SVS), and fail to integrate fragmented geometric evidence across cameras (MVN). Our evaluations demonstrate that modern MLLMs rely on multiple single-image semantic averaging and view preference rather than genuine cross-view synthesis. By exposing these fundamental vulnerabilities, SSMNBench provides a rigorous diagnostic framework to drive the advancement of future cross-view-aware multimodal architectures. The code is available at: $ \href{https://github.com/gtc-gh/SSMNBench}{\text{SSMNBench}} $

[53] Towards a Dynamic and Fixed-budget Memory Bank for Efficient Streaming Video Understanding cs.CVPDF

Baiyang Song, Yuli Lin, Qiong Wu, Tao Chen, Jun Peng

TL;DR: 本文提出了一种名为CausalMem的训练无关方法，用于构建动态且固定预算的记忆库，以高效处理流式视频理解任务。该方法通过在线语义基估计视觉令牌的冗余度并更新记忆，旨在最大化有限内存空间内的信息量，并应用于LLaVA-OneVision和Qwen2.5-VL等多模态大语言模型。

Details

Motivation: 解决流式视频理解中处理不断增长的视频帧和未来内容不可预测性的挑战，从构建动态固定预算记忆库的角度出发。

Result: 在流式和离线视频理解基准测试中，相比现有方法平均准确率分别提升3.2%和3.0%，使用12k令牌预算记忆长达一小时的流式视频，实现超过20倍的视觉令牌压缩比和仅约82 MB的存储占用。

Insight: 创新点在于提出一种基于在线语义基的动态视觉记忆更新机制，无需训练即可有效压缩和保留视频语义信息，类似于人脑处理方式，可借鉴于高效视频流处理系统。

Abstract: Currently, streaming video understanding is still a daunting task for existing \emph{multimodal large language models} (MLLMs). Its difficulties not only lie in handling the ever-increasing video frames, but also in the unpredictability of future video content and input instructions. In this paper, we study this task from the perspective of constructing a dynamic but fixed-budget memory bank, and propose a novel and training-free approach termed \emph{\textbf{CausalMem}}. CausalMem is dedicated to constructing a dynamic visual memory update mechanism, thereby maximizing the amount of information in streaming video within a limited memory space, much like the human brain. In practice, CausalMem estimates the redundancy of visual tokens and updates the memory bank via an online semantic basis, which models the principal semantics of the observed video stream. To validate CausalMem, we apply it to two representative MLLMs, namely LLaVA-OneVision and Qwen2.5-VL respectively, and conduct extensive experiments on both streaming and offline video understanding benchmarks. The experimental results not only show the great advantages than existing methods under both streaming and offline settings, \emph{e.g.}, $+3.2%$ and $+3.0%$ average accuracy gains respectively, but also witness the superior semantic preservation for streaming videos, \emph{e.g.}, using 12$k$ token budgets to memorize hour-long streaming videos, which achieves more than \textbf{20$\times$} visual token compression ratio and only occupies about \textbf{82 MB} storage. \textbf{Our code} is given in \href{https://github.com/hktk07/CausalMem}{CausalMem}.

[54] Steering Vision-Language Models with Joint Sparse Autoencoders cs.CV | cs.AIPDF

Huizhen Shu, Xuying Li, Hongxu Lin, Wenjie Sun, Hui Li

TL;DR: 本文提出了一种联合稀疏自编码器（JSAE），用于分析视觉-语言模型（VLMs）。该方法通过显式的对齐约束，将序列池化后的视觉和语言激活联合分解为共享的、可解释的图像/标题级特征。在LLaVA等模型上的实验表明，JSAE能恢复出可识别的跨模态概念特征，并通过双向干预（加性引导和抑制）揭示了层依赖的不对称性，为基于干预的多模态特征分析提供了更可控的工具。

Details

Motivation: 现有稀疏自编码器（SAEs）在分析语言模型时表现良好，但应用于视觉-语言模型（VLMs）时，其产生的表示通常难以作为可控的跨模态引导方向。因此，需要一种能生成对齐的、可解释的跨模态特征表示的方法。

Result: 在LLaVA-v1.6-Mistral-7B、Llama3-LLaVA-8B和基于MoE的Qwen3-VL-30B三个VLMs上的实验表明，JSAE能恢复出可识别的概念（如食物、动物）的跨模态特征。通过双向干预，发现加性引导在中间到后期（输出前）层达到峰值，而在两端减弱；抑制得分在所有探测层内保持在一个统计噪声可比的范围内，显示出与架构相关的层局部化效应。

Insight: 核心创新是引入了显式对齐约束的联合稀疏自编码器（JSAE），实现了视觉和语言激活的联合稀疏分解，从而生成共享的、可解释的跨模态特征。这为基于干预的模型分析提供了比无约束方法更可控的稀疏表示，并揭示了VLMs中特征引导的层依赖不对称性，对理解多模态模型内部表示有借鉴意义。

Abstract: Sparse Autoencoders (SAEs) have shown promise for analyzing language models, but applying them to vision-language models (VLMs) often yields representations that are difficult to use as controllable cross-modal steering directions. We introduce the Joint Sparse Autoencoder (JSAE), which uses an explicit alignment constraint to jointly factorize sequence-pooled vision and language activations into shared, interpretable image/caption-level features. Applied to LLaVA, JSAE recovers cross-modal features for recognizable concepts (e.g., food and animals). Through bidirectional interventions (additive steering and suppression), we observe a layer-dependent asymmetry under our protocol: additive steering peaks at mid-to-late (pre-output) layers and weakens at both ends, whereas suppression scores remain within a comparable range across all probed layers within statistical noise. Experiments on three VLMs, namely LLaVA-v1.6-Mistral-7B, Llama3-LLaVA-8B, and the MoE-based Qwen3-VL-30B, show related layer-localized effects across architectures. Together, these results suggest that explicitly aligned sparse representations support more controllable intervention-based analysis of multimodal features, within an identifiable layer range, than the unconstrained alternatives tested here.

[55] Falcon: Functional Assembly and Language for Compositional Reasoning in X-ray cs.CVPDF

Yonathan Michael, Mohamad Alansari, Natnael Takele, Andreas Henschel, Naoufel Werghi

TL;DR: 本文提出了Falcon框架，用于解决X射线行李安检中的组合式威胁推理问题。该框架将分割感知的区域特征抽象为结构化安全状态，捕捉部件存在性、成对功能兼容性和场景级风险，并将此结构化表示作为显式中间接口注入语言模型，以促进关系一致且安全感知的推理。

Details

Motivation: 传统视觉语言模型主要关注物体中心检测，但在X射线安检中，威胁往往源于空间分散部件（如电池、雷管和炸药）的功能兼容性，而非单个物体。因此，需要建模组合式威胁推理，将风险视为接地区域的关系属性。

Result: 实验表明，现有多模态模型难以处理组合式安全推理，而Falcon在功能接地和威胁评估一致性方面表现更优，在提出的Falcon-X基准测试中验证了其有效性。

Insight: 创新点在于将组合式威胁推理形式化为一个明确的多模态评估范式，通过结构化安全状态作为中间表示来桥接视觉和语言，从而提升对功能兼容性和场景级风险的关系推理能力。

Abstract: Conventional vision-language models are largely object-centric, focusing on detecting and describing individual entities. In safety-critical X-ray baggage screening, however, threat often emerges not from a single object but from the functional compatibility of spatially dispersed components, such as batteries, detonators, and explosive charges. We formalize this setting as \emph{compositional threat reasoning}, where risk is modeled as a relational property of grounded regions rather than an independent detection outcome. We introduce \textbf{Falcon}, a multimodal framework that abstracts segmentation-aware region features into a structured safety state capturing component presence, pairwise functional compatibility, and scene-level risk. This structured representation is injected into the language model as an explicit intermediate interface, encouraging relationally consistent and safety-aware reasoning. To evaluate this problem, we present \textbf{Falcon-X}, a benchmark that unifies dense grounding with structured supervision over component completeness and risk inference in cluttered X-ray imagery. Experiments show that while existing multimodal models adapt to appearance, they struggle with compositional safety reasoning. Falcon improves functional grounding and produces more coherent threat assessments, establishing compositional safety reasoning as a distinct evaluation paradigm for multimodal systems.

[56] UniTeD: Unified Temporal Diffusion for Joint Perception and Planning in Autonomous Driving cs.CVPDF

Bo Zhao, Xinting Zhao, Naifan Li, Erkang Cheng, Haibin Ling

TL;DR: 本文提出UniTeD，一种统一的时间扩散框架，用于自动驾驶中的联合感知与规划。该框架通过在共享生成空间中进行迭代去噪，实现感知与规划任务的联合建模，并引入时间过渡模块和锚点刷新策略来处理时序上下文和缓解训练-推理分布偏移。

Details

Motivation: 现有方法通常将扩散模型局限于规划模块，并依赖于独立判别式感知网络的固定输出，这种解耦设计会导致感知误差传播至规划器，增加优化难度并降低鲁棒性。

Result: UniTeD在多个基准测试中取得了最先进的性能，超越了近期的判别式端到端方法和基于扩散的规划方法。

Insight: 核心创新在于提出了一个统一的生成式空间，通过迭代去噪实现感知与规划的双向信息交换与协同优化；通过时间过渡模块解决历史帧与当前帧的噪声级不匹配问题，并通过锚点刷新策略缓解稀疏扩散框架中常见的训练-推理分布偏移。

Abstract: Diffusion models have shown strong potential for multi-modal planning in end-to-end autonomous driving. However, most existing methods confine diffusion to the planning module, conditioning on fixed outputs from separate discriminative perception networks. This decoupled design propagates perception errors to the planner, increasing optimization difficulty and reducing robustness. To overcome these limitations, we propose UniTeD, a Unified Temporal Diffusion framework that jointly models perception and planning through iterative denoising in a shared generative space. By enabling bidirectional information exchange, the framework facilitates mutual refinement between tasks and improves robustness via noise-conditioned multi-task training. We further extend this unified diffusion paradigm to a streaming setting by incorporating temporal context. A Temporal Transition Module (TTM) is introduced to resolve the noise-level mismatch between historical and current frames. In addition, we propose an Anchor Refresh Strategy (ARS) to alleviate the training-inference distribution shift commonly observed in sparse diffusion-based end-to-end driving frameworks. Without bells and whistles, UniTeD achieves state-of-the-art performance across multiple benchmarks, surpassing both recent discriminative end-to-end methods and diffusion-based planning approaches.

[57] What Does the Brain See? Multiview Neural Representations to Demystify the Brain-Visual Alignment cs.CVPDF

Salini Yadav, Taveena Lotey, Pravendra Singh, Partha Pratim Roy

TL;DR: 本文提出了一种统一的多视角脑电图表示学习框架，用于将大脑反应与视觉语义嵌入对齐。该方法构建了一个脑电图编码器，联合建模三个互补视角：输入条件的状态空间时间动态、基于可学习小波的样本自适应频率建模谱分解，以及用于结构化电极交互的注意力调制图学习。通过对比学习和脑电图特定正则化，将生成的多视角脑电图嵌入与预训练的视觉表示在共享语义空间中融合对齐，实现了200类零样本视觉分类。

Details

Motivation: 解决从非侵入性脑电图进行零样本视觉解码的挑战，包括低信噪比、非平稳性和有限空间分辨率。现有方法依赖整体脑电图嵌入，可能掩盖视觉感知背后互补的时间、频谱和空间结构。

Result: 在THINGS-EEG基准测试中，该方法在受试者内设置下达到54.8% Top-1和85.6% Top-5准确率，在跨受试者设置下达到15.3% Top-1和45.4% Top-5准确率，实现了最先进的性能。此外，首次系统性的跨会话脑电图-图像解码评估达到了40.8% Top-1和78.0% Top-5准确率。

Insight: 创新点在于明确建模多视角神经结构（时间动态、频谱分解和空间图交互），并通过对比学习对齐视觉语义，这提高了基于脑电图的视觉解码的语义对齐和泛化能力。从客观角度看，将状态空间模型、自适应小波变换和图注意力网络统一到一个框架中，是处理脑电图多模态特性的有效方法。

Abstract: Zero-shot visual decoding from electroencephalography (EEG) aims to infer visual semantics from non-invasive neural recordings, but remains challenging due to the low signal-to-noise ratio, non-stationarity, and limited spatial resolution of EEG. Existing EEG-vision alignment methods often rely on holistic EEG embeddings, which can obscure the complementary temporal, spectral, and spatial structure underlying visual perception. We introduce a unified multiview EEG representation learning framework for aligning brain responses with visual semantic embeddings. Our method builds an EEG encoder that jointly models three complementary views: input-conditioned state-space temporal dynamics, learnable wavelet-based spectral decomposition for sample-adaptive frequency modeling, and attention-modulated graph learning for structured electrode interactions. The resulting multiview EEG embeddings are fused and aligned with pretrained visual representations in a shared semantic space using contrastive learning with EEG-specific regularization, enabling 200-way zero-shot visual classification. Experiments on THINGS-EEG benchmark show that our method achieves state-of-the-art performance, with 54.8% Top-1 and 85.6% Top-5 accuracy in the within-subject setting and 15.3% Top-1 and 45.4% Top-5 accuracy in the cross-subject setting. We further present the first systematic cross-session EEG-image decoding evaluation, achieving 40.8% Top-1 and 78.0% Top-5 accuracy. These results suggest that explicitly modeling multiview neural structure improves both semantic alignment and generalization in EEG-based visual decoding.

[58] Point Cloud Diffusion with Global and Local Reconstruction for Instance-Level 3D Anomaly Detection cs.CV | cs.AIPDF

Linchun Wu, Qin Zou, Jiwen Lu, Qingquan Li

TL;DR: 本文提出PCDiff，一种用于实例级3D异常检测的点云扩散框架。该方法通过嵌入实例级多模态注意力来生成高质量的弱缺陷异常，并引入联合局部-全局重建算法，在检测阶段确保局部异常恢复和全局几何一致性。实验表明，PCDiff在3D异常生成保真度和重建质量上显著优于现有方法，从而大幅提升了异常检测精度。

Details

Motivation: 解决点云3D异常检测中两个关键挑战：一是前景弱缺陷区域（如划痕）难以重建和检测，其异常偏差极小；二是背景无缺陷区域在重建中易产生位置偏差，导致误报。

Result: 在3D异常生成保真度和重建质量方面，PCDiff显著优于最先进方法，从而大幅提升了异常检测精度。

Insight: 创新点包括：嵌入实例级多模态注意力（基于纹理梯度、图像块、文本和掩码）以生成弱缺陷异常；引入联合局部-全局重建算法，平衡局部异常恢复与全局几何一致性，减少背景误报。

Abstract: 3D anomaly detection in point clouds is critical for high-precision industrial manufacturing. Reconstruction-based methods have laid a strong foundation by detecting 3D anomalies through comparisons between defective inputs and their reconstructed normal counterparts. However, existing methods still suffer from two challenges: 1) the foreground weak defective regions such as scratches are hard to reconstruct and detect, where the anomaly deviations in normalized point clouds can be as small as $10^{-3}$; 2) the background non-defective regions are prone to get positional bias in reconstruction, which leads to false positives. To address these challenges, we propose \textbf{PCDiff}, a point cloud diffusion framework for instance-level 3D anomaly generation and detection. In the generation phase, an instance-level multi-modal attention is embedded into the generation framework, where anomalies are conditioned with texture gradient, image patch, text and mask. The instance-level condition enables the high-quality generation of weak-defective anomalies. In the detection phase, a joint local-global reconstruction algorithm is introduced to ensure local anomaly restoration and global geometric consistency, which preserves background normal structure while restoring the foreground defect. Extensive experiments demonstrate that the proposed PCDiff significantly outperforms state-of-the-art methods in both 3D anomaly generation fidelity and reconstruction quality, leading to substantial improvements in anomaly detection accuracy.

[59] Dual Distribution Estimation for Zero-shot Noisy Test-Time Adaptation with VLMs cs.CVPDF

Wenjie Zhu, Yabin Zhang, Liang Xu, Xin Jin, Wenjun Zeng

TL;DR: 本文提出了一种名为Dual Distribution Estimation (DDE) 的新型零样本噪声测试时适应框架，旨在解决现有方法在面临分布外噪声样本时存在的过度自信误分类和推理效率低下的问题。该方法通过免训练的类高斯分布建模，包含正特征分布估计和负标签分布估计两个模块，以鲁棒地提升分布内分类精度并有效识别分布外样本。

Details

Motivation: 测试时适应方法虽然无需昂贵重训练，但在现实应用中极易受到普遍存在的分布外异常值影响，导致性能下降。现有零样本噪声测试时适应方法依赖测试时判别性训练，会导致过度自信的误分类并显著降低推理效率，因此需要一种更鲁棒、高效的解决方案。

Result: 在大型ImageNet基准测试上，DDE将谐波平均准确率提升了3.70%，并将OOD检测的FPR95降低了6.20%，同时确保了高度可扩展和高效的在线推理。

Insight: 论文的核心创新在于将零样本NTTA范式从实例级学习转向免训练的高斯分布建模，通过显式建模类内包含与排除分布来校准对比分数，并利用负标签分布挖掘高判别性标签以缓解虚假关联。这种训练免费、零样本的方法在数据稀缺场景下也表现出显著的鲁棒性。

Abstract: While test-time adaptation (TTA) empowers vision-language models to adapt without costly retraining, it remains highly vulnerable to out-of-distribution (OOD) outliers prevalent in real-world applications. This discrepancy motivates Noisy TTA (NTTA), an online task to filter noisy OOD samples on the fly while maximizing in-distribution (ID) classification accuracy. Existing zero-shot NTTA approaches typically rely on test-time discriminative training, leading to overconfident misclassifications and significantly degraded inference efficiency. To address these limitations, we propose a novel framework named Dual Distribution Estimation (DDE), shifting the zero-shot NTTA paradigm from instance-level learning to training-free Gaussian distribution modeling. DDE incorporates two novel modules: Positive Feature Distribution Estimation (PFDE) and Negative Label Distribution Estimation (NLDE). PFDE explicitly models class-wise inclusion and exclusion Gaussian distributions to formulate a calibrated contrastive score, robustly enhancing ID accuracy. In parallel, NLDE improves OOD identification by explicitly modeling the negative label distribution to mine highly discriminative labels, effectively mitigating spurious correlations. Extensive experiments show that on the large-scale ImageNet benchmark, DDE achieves an improvement of 3.70% in harmonic mean accuracy and reduces the FPR95 for OOD detection by 6.20%, while ensuring highly scalable and efficient online inference. Furthermore, DDE is zero-shot and training-free, demonstrating remarkable robustness in data-scarce scenarios. Codes are available at https://github.com/ZhuWenjie98/DDE.

[60] ShutterMuse: Capture-Time Photography Guidance with MLLMs cs.CVPDF

Jiayu Li, Yixiao Fang, Tianyu Hu, Wei Cheng, Ping Huang

TL;DR: 本文提出了ShutterMuse，一个用于拍摄时摄影指导的多模态大语言模型。为了解决现有美学裁剪基准忽略拍摄时指导的问题，作者构建了CaptureGuide-Bench基准和CaptureGuide-Dataset数据集。实验表明，ShutterMuse在摄影师侧的构图决策和优化任务上取得了最佳综合性能，并在被摄主体侧的姿势推荐任务上取得了有竞争力的结果，且推理成本显著降低。

Details

Motivation: 现实世界的摄影需要在拍摄时提供构图和主体姿势的指导。然而，现有的美学裁剪基准主要评估事后裁剪预测，忽略了主体侧的推荐，导致多模态大语言模型在拍摄时指导方面的能力未被充分探索。

Result: 在作者构建的CaptureGuide-Bench基准上，ShutterMuse在摄影师侧的构图决策与优化任务上取得了所有评估基线中的最佳综合性能。在被摄主体侧的、基于场景条件的姿势推荐任务上，也取得了有竞争力的结果，并且推理成本显著更低。

Insight: 论文的核心创新在于构建了一个专注于拍摄时指导（包括摄影师构图和被摄主体姿势）的新基准和数据集，并训练了一个统一的MLLM模型ShutterMuse。其亮点在于通过监督和强化微调，使一个模型能够同时处理摄影师侧和被摄主体侧的任务，展示了MLLM作为拍摄时交互助手的潜力。

Abstract: Real-world photography requires capture-time guidance for both camera framing and subject pose. Yet existing aesthetic cropping benchmarks mainly evaluate post-hoc crop prediction and overlook subject-side recommendations, leaving the capture-time guidance capabilities of multimodal large language models (MLLMs) underexplored. To address this gap, we introduce CaptureGuide-Bench, a benchmark with two complementary tasks: photographer-side composition decision and refinement, and subject-side scene-conditioned pose recommendation. Our evaluation reveals limitations: general-purpose MLLMs can make composition decisions but lack precise refinement localization, while specialized aesthetic cropping models localize crops effectively but are limited to refinement; neither provides actionable pose guidance. To support model development, we further construct CaptureGuide-Dataset, comprising 130K samples with textual rationales and structured visual annotations, and develop ShutterMuse, a unified MLLM trained with supervised and reinforcement fine-tuning. Experiments on CaptureGuide-Bench show that ShutterMuse achieves the best overall photographer-side performance among evaluated baselines and competitive subject-side pose recommendation with substantially lower inference cost, demonstrating the potential of MLLMs as interactive assistants for photography during image capture.

[61] Edges Before Embeddings: A Confidence-Aware Blur Gate for Vision-Language Pipelines cs.CV | cs.AIPDF

Duy Tran Thanh

TL;DR: 本文提出了MagikaDocumentFromPixel，一种轻量级、CPU友好的图像质量门控，用于在视觉语言处理流水线中快速（约7毫秒/单核CPU）检测图像模糊度（锐利、模糊或不确定），以避免对模糊图像进行无效的下游处理。

Details

Motivation: 解决生产环境视觉流水线因输入图像模糊而性能下降的问题，避免浪费计算资源在无法产生可用输出的下游OCR、检索和视觉语言模型调用上。

Result: 在配对GoPro Large帧数据集上，使用MobileNetV3-Large结合边缘先验模块（EPM）在384x384分辨率训练，并通过5尺度测试时增强，最终模型达到F1分数0.9803（AUC 0.9989），比固定尺度基线（F1=0.9672）提升了1.31个百分点。

Insight: 创新点包括：通过经验搜索确定输入分辨率是关键杠杆；提出基于经典选择性预测的置信感知路由形式化方法；引入边缘先验模块（EPM）作为辅助输入通道，为网络提供经典模糊启发式方法依赖的光谱证据，显著提升性能；并指出该门控是跨多个任务（如内容类型检测、风险控制OCR）的通用设计模式实例。

Abstract: Production vision pipelines silently degrade on blurry input, wasting compute on downstream OCR, retrieval, and vision-language model (VLM) calls that cannot recover a usable output. We present MagikaDocumentFromPixel, a lightweight, CPU-friendly image quality gate that classifies a single image as sharp, blurred, or uncertain in roughly 7 ms on a single CPU core. The contributions are (i) a recipe selected from a 46-configuration, 8-sweep empirical search that isolates input resolution as the dominant lever and shows architecture capacity only pays off at >= 384 px; (ii) a confidence-aware routing formalism grounded in classical selective prediction; (iii) the Edge Prior Module (EPM), a Laplacian-magnitude auxiliary input channel that gives the network direct access to the spectral evidence that classical blur heuristics rely on and that lifts test F1 by +1.3 points in a matched-env comparison; and (iv) an observation that the gate is one instance of a recurring design pattern that appears independently in Magika content-type detection, risk-controlled OCR with VLMs, and DocVLM. The final recipe MobileNetV3-Large with the EPM trained at 384x384 on paired GoPro Large frames, evaluated with 5-scale test-time augmentation reaches F1 = 0.9803 (AUC 0.9989) with a 17 MB ONNX artifact, improving over our fixed-scale baseline on the same hardware (F1 = 0.9672) by +1.31 points. We are explicit about limitations: results are on a single motion-blur distribution, numbers are from a single seed, and calibration is qualitative rather than measured.

[62] Graph it first! Enabling Reasoning on Long-form Egocentric Videos through Scene Graphs cs.CVPDF

Agnese Taluzzi, Riccardo Santambrogio, Simone Mentasti, Chiara Plizzari, Matteo Matteucci

TL;DR: 本文提出了一种利用自我中心场景图（EgoSGs）进行长视频问答的框架，以克服多模态大语言模型（MLLMs）在处理长视频序列时的输入长度限制。该方法将视频表示为紧凑的、基于文本的场景图，从而在保留关键视觉和时间信息的同时大幅减少输入长度，使MLLMs能够在有限的token预算内对整个视频序列进行高效推理。

Details

Motivation: 现有MLLMs因严格的输入token限制，在处理长视频序列（尤其是具有复杂动态、频繁状态变化和移动摄像头的自我中心视频）时面临巨大挑战，通常被迫大量下采样帧，导致时间和上下文信息严重丢失，限制了其进行细粒度视频推理的能力。

Result: 在HD-EPIC VQA基准测试中，该方法取得了最先进的（SOTA）结果，在多个模型上优于基于视频的强基线。

Insight: 论文宣称的创新点在于引入了时间锚定的、结构化的自我中心场景图（EgoSGs）作为视频的符号化表示，以桥接长视频理解和MLLMs的上下文限制。从客观角度看，其核心创新在于将密集的视频数据压缩为语义丰富的结构化文本表示，从而绕过了直接处理原始视频帧的token瓶颈，为长视频推理提供了一种高效的新范式。

Abstract: Existing multi-modal large language models (MLLMs) face significant challenges in processing long video sequences due to strict input token limitations. As a result, current video understanding approaches, especially in egocentric settings characterized by complex dynamics, frequent state changes, and moving cameras, are forced to massively subsample frames. This leads to severe loss of temporal and contextual information, constraining their ability to perform fine-grained video reasoning. In this work, we introduce a framework for egocentric video question answering (VQA) that overcomes these input constraints through Egocentric Scene Graphs (EgoSGs), i.e., temporally grounded, structured representations that capture objects, attributes, spatial relations, and interactions over time. By representing videos as compact, text-based scene graphs, our method preserves the essential visual and temporal information of the original video in a symbolic form that drastically reduces input length while maintaining semantic richness. Crucially, this enables MLLMs to reason efficiently over entire video sequences within their token budget. On HD-EPIC VQA, our method achieves state-of-the-art results, outperforming strong video-based baselines on multiple models and suggesting that structured, temporally grounded representations like EgoSGs can bridge long-form egocentric video understanding and the context limitations of today’s MLLMs.

[63] USS: Unified Spatial-Semantic Prompts for Embodied Visual Tracking with Latent Dynamics Learning cs.CVPDF

Yuchen Xie, Xinyu Zhou, Kuangji Zuo, Yanshuo Lu, Fengrui Huang

TL;DR: 本文提出了一种用于具身视觉跟踪（EVT）的统一空间-语义提示框架USS，该框架支持文本、点、边界框和掩码等多种提示方式，并通过潜在动态学习模型提升时序鲁棒性。

Details

Motivation: 现有EVT方法主要依赖基于语言的目标指示，但在复杂场景中，语义描述可能对应多个物体，导致目标定位模糊。因此，本文旨在将目标指示范式从纯文本转向统一的空间-语义提示，以提供更精确和灵活的目标指定接口。

Result: 在仿真基准测试中，USS在非MLLM方法中达到了最先进的性能，并与近期基于MLLM的方法取得了具有竞争力的结果，且推理速度更快。真实机器人实验表明，显式的空间目标提示比纯文本提示具有更高的成功率，尤其是在存在相似干扰物和需要长期跟踪的场景中。

Insight: 创新点在于提出了统一处理多种空间和语义提示的架构，并通过潜在世界模型进行自监督对齐以预测未来表征，从而增强了跟踪的时序鲁棒性和实例级身份保持能力。

Abstract: Embodied Visual Tracking (EVT) requires an agent to continuously follow a specified target while actively moving through dynamic environments. However, prevailing EVT paradigms predominantly rely on language-based target indication. While language is expressive and convenient, cluttered scenes often contain multiple objects that satisfy the same semantic description, leading to ambiguous target grounding. We therefore propose a paradigm shift, reframing target indication in EVT from text-only specification to unified spatial-semantic prompting. Based on this paradigm, we introduce Unified Spatial-Semantic Prompts for Embodied Visual Tracking with Latent Dynamics Learning, USS, an end-to-end embodied tracking framework that supports text, point, bounding box, and mask prompts within a unified architecture. USS encodes heterogeneous prompts with modality-specific encoders, fuses prompt tokens with visual features through hybrid attention, and decodes compact prompt-conditioned representations into egocentric waypoints. To further improve temporal robustness, USS incorporates a latent world model that predicts future representations through self-supervised alignment. Real-robot experiments demonstrate that explicit spatial target cues yield higher success rates than text-only prompts, particularly in scenarios involving similar distractors and longer-horizon tracking where maintaining instance-level target identity is critical. In the simulation benchmark, USS also achieves state-of-the-art performance among non-MLLM-based methods and competitive results against recent MLLM-based approaches with faster inference speed. Our findings reveal that spatial-semantic prompting provides a more precise and flexible target indication interface for embodied visual tracking. Project site: https://arescheah.github.io/uss-project-page/.

[64] Naturalness Predicts but Does Not Cause Transferability in Image Encodings of Real-World Streams cs.CVPDF

Faruk Alpay, Baris Basaran

TL;DR: 该研究探讨了将一维信号编码为图像后，其视觉自然度（通过FID衡量）与在冻结视觉骨干网络下的迁移准确率之间的关系。通过构建WorldStream数据集（包含299个异构时间序列）并进行实验，发现FID能预测准确率（Spearman ρ=-0.72），但通过两项受控干预（调整频谱指数β和相位置乱）证明这种相关性并非因果，而是由局部结构中介。

Details

Motivation: 研究动机是探究将一维信号转换为图像后，编码图像的视觉自然度如何影响其在预训练视觉骨干网络（冻结权重）下的迁移性能，以理解常见实践中编码图像未被充分检验的问题。

Result: 在WorldStream数据集（九类源识别任务）上，使用七种编码和六个冻结骨干网络，FID与准确率呈强负相关（Spearman ρ=-0.72），但干预实验显示准确率在自然频谱附近保持平坦且远低于结构化基线（19.2% vs. 73.0%），全微调也无法弥补差距（27% vs. 67%）。

Insight: 创新点在于通过可逆编码器（频谱指数β可调）和相位置乱干预，揭示了FID预测准确率是由局部结构而非频谱自然度中介的，且编码图像可作为数据的无损记录（恢复信噪比72.9 dB），这对时间序列的视觉表示迁移提供了结构性的见解。

Abstract: A common practice converts a one-dimensional signal into an image so that a vision backbone pretrained on natural photographs can be reused for recognition, yet the encoded image is rarely examined. We ask how the visual naturalness of an encoded image relates to its transfer accuracy under a frozen backbone. We build WorldStream, a corpus of 299 heterogeneous current-value series from key-free public APIs (weather, air quality, earthquakes, gold and oil, equities, crypto, foreign exchange, web activity and space weather), with a nine-way source-recognition task over 3143 temporally split windows. Across seven encodings and six frozen backbones, the Frechet distance of an encoding to natural images (FID) predicts its accuracy: Spearman $ρ=-0.72$. Two controlled interventions show this is not causal in the spectrum. Our invertible encoder has a single adjustable part, a spectral exponent $β$ (power $\propto |f|^{-β}$); varying $β$ moves the image toward or away from the natural-image manifold at fixed content. FID is lowest near the natural value $β\approx 2$, but frozen accuracy stays flat and far below the structured baselines (19.2% vs. 73.0%), and FID and accuracy are only weakly related over the sweep (Pearson $-0.32$). A second intervention, phase scrambling, holds the power spectrum exactly fixed while removing local structure; now FID and accuracy fall together (Pearson $-0.89$). The cross-encoding correlation is thus mediated by local structure, not spectral naturalness: FID predicts accuracy because Inception reads the same structure the backbones do. Full fine-tuning does not close the gap (27% vs. 67%), so the deficit is structural. The encoder is exactly invertible, recovering the signal from the 8-bit image at 72.9 dB, so the image doubles as a lossless record of the data.

[65] Enhancing Brain MRI Anomaly Detection and Reasoning with ROI Rethink and Synthetic Data cs.CV | cs.AIPDF

Shangkun Li, Jie Xu, Yi Guo, Zeju Li, Yuanyuan Wang

TL;DR: 本文提出了BrReMark框架，用于增强脑部MRI异常检测和推理的可解释性。该框架通过引入显式的区域标记（ROI）和假设-验证机制，使模型能够生成诊断假设、用边界框定位支持证据，并重新检查标记区域以验证结论。此外，结合基于领域随机化的病理合成数据增强策略，提升了模型在分布外（OOD）数据上的泛化能力。

Details

Motivation: 现有医学视觉-语言模型通常通过单次推理生成诊断，但缺乏对支持诊断的图像区域的空间定位，这限制了临床实用性，因为输出无法被审核，且模型可能在正常扫描上产生幻觉（hallucinate）发现。

Result: 在内部基准测试中，BrReMark将mAP50从基础模型的0.74%提升至37.54%，同时达到21.57%的Clinical F1分数和45.26%的诊断准确率。在NOVA OOD基准测试上，与最先进模型相比，它实现了具有竞争力的整体性能，并将误报率降低了45.7%，表明在罕见病理上减少了幻觉。

Insight: 创新点在于将显式的假设-验证机制（包括假设生成、边界框标记和证据重检）引入脑部MRI诊断，结合结构化推理轨迹的监督微调和基于定位准确性与诊断推理的复合奖励的强化学习进行训练。此外，采用基于领域随机化的病理合成数据增强策略有效提升了OOD泛化能力，为可信赖的开放式医学影像诊断提供了实用路径。

Abstract: Medical vision-language models typically generate diagnoses through single-pass inference without indicating which image regions support their conclusions. This lack of spatial grounding limits clinical utility: outputs cannot be audited, and models may hallucinate findings on normal scans. We present BrReMark (Brain Rethink via ROI Marking), a framework that introduces explicit region marking into brain MRI diagnosis. The model first generates hypotheses about potential abnormalities and grounds them through explicit bounding box marking, then verifies conclusions by re-examining the marked evidence. Training combines supervised fine-tuning on structured reasoning trajectories with reinforcement learning using a composite reward over localization accuracy and diagnostic reasoning. Furthermore, we integrate a domain randomization-based pathology synthesis augmentation strategy to improve the model’s generalizability to out-of-distribution (OOD) data. On internal benchmark, BrReMark improves mAP50 from 0.74% to 37.54% compared to the base model, while achieving 21.57% Clinical F1 and 45.26% diagnostic accuracy. On NOVA OOD benchmark, it also achieves competitive overall performance with a 45.7% reduction in false positives compared to the state-of-the-art, indicating reduced hallucination on rare pathologies. These findings suggest that explicit hypothesis-verification grounding is a practical path toward trustworthy open-ended brain MRI diagnosis across both in-distribution and OOD settings.

[66] OracleAnalyser: Analysing Implicit Semantics of Oracle Bone Scripts through MLLMs with Post-training cs.CV | cs.MMPDF

Zijia Song, Yelin Wang, Zhengyi Ma, Zitong Yu, Tianheng Wang

TL;DR: 本文提出OracleAnalyser，一个基于后训练技术的甲骨文分析推理框架。该框架通过多阶段后训练微调Qwen2.5-VL-3B-Instruct模型，并针对甲骨文数据集特点引入了新的偏好优化算法SFPO。同时，作者发布了甲骨文推理和偏好数据集，并构建了新的评测基准，验证了模型在仅3B参数量下超越更大规模模型的优异分析性能。

Details

Motivation: 现有甲骨文研究方法主要集中于识别任务，忽视了同样重要的甲骨文分析方面，本文旨在填补这一空白。

Result: 大量实验验证了OracleAnalyser的卓越分析性能，其在仅3B参数下取得了显著成果，超越了参数量大得多的模型。

Insight: 创新点包括针对甲骨文数据集定制的多阶段后训练框架、新提出的Stable Focal Preference Optimization (SFPO)算法，以及构建的甲骨文推理与偏好数据集及分析能力评测基准。

Abstract: With the advancement of artificial intelligence, research on oracle bone scripts has entered a new era. However, existing methods and benchmarks remain largely confined to recognition tasks, overlooking the equally crucial aspect of oracle bone analysis. To address this gap, we propose OracleAnalyser, a reasoning framework for oracle bone analysis based on post-training techniques. Specifically, we fine-tune Qwen2.5-VL-3B-Instruct through multiple post-training stages and introduce a new preference optimization algorithm, Stable Focal Preference Optimization (SFPO), tailored to the characteristics of oracle bone datasets. In addition, we release both an oracle bone reasoning dataset and an oracle bone preference dataset, and further construct a new benchmark to evaluate models’ analytical capabilities for oracle bone scripts. Extensive experiments validate the superior analytical performance of OracleAnalyser, which achieves remarkable results with only 3B parameters, surpassing models with substantially larger scales.

[67] SurgAtlas: A Large-Scale Surgical Video-Language Dataset with 2,391 Hours of Open and Minimally Invasive Surgery cs.CVPDF

Filippos Bellos, Andre S. Gala-Garza, Miaowei Wang, Alyssa M. Hardin, Ahmad M. Hider

TL;DR: 本文介绍了SurgAtlas，这是迄今为止最大的手术视频-语言数据集，包含15,291个视频（2,391小时），涵盖18个外科专业和超过5,000种手术类型，所有内容均来自公开的YouTube视频。该数据集首次大规模包含开放手术视频，并建立了开放手术视频理解的标准化基准，同时提供了一个专家验证的子集用于手术推理评估。

Details

Motivation: 为了解决现有手术视频数据集规模有限、缺乏开放手术内容以及标准化基准不足的问题，作者旨在构建一个大规模、多样化且具有丰富标注的手术视频-语言数据集，以支持手术基础模型的训练和评估。

Result: 通过在SurgAtlas上对Qwen3-VL-8B模型进行两阶段微调，在多个现有手术基准测试（如阶段识别、三元组检测和推理问答）上取得了有竞争力或最先进（SOTA）的结果。

Insight: 创新点在于构建了首个大规模包含开放手术的视频-语言数据集，并提供了分层分类的多样化标注模式（如片段级字幕、步骤/阶段级描述、视频级描述和推理问答对）。其采用基于LLM的自动多级流水线和具有显式接地性验证的分阶段VQA生成框架来构建高质量标注，为手术多模态AI系统的大规模预训练提供了宝贵的公共资源。

Abstract: We introduce SurgAtlas, the largest surgical video-language dataset to date, comprising 15,291 videos (2,391 hours) spanning 18 surgical specialties and over 5,000 procedure types, sourced entirely from publicly available YouTube content. SurgAtlas is also the first surgical video-language dataset to include open surgery at scale, with 6,182 open procedure videos alongside over 9,000 minimally invasive recordings, and the first to establish standardized benchmarks for open-surgery video understanding. We additionally provide an expert-validated subset with verified visual question-answer pairs across diverse open and minimally invasive procedures, serving as a clinically grounded benchmark for surgical reasoning. Compared with existing surgical video-language datasets, SurgAtlas provides one of the most diverse annotation schemas, combining segment-level captions, step- and phase-level descriptions, video-level surgical descriptions, and reasoning-oriented question-answer pairs organized within a hierarchical taxonomy. These annotations are constructed through an automated multi-tier pipeline with LLM-based enrichment and a staged VQA generation framework with explicit groundedness verification. The scale and diversity of SurgAtlas enable training surgical foundation models with broad procedural coverage: we finetune Qwen3-VL-8B through a two-stage captioning-then-instruction pipeline and achieve competitive or state-of-the-art results on multiple established surgical benchmarks, including phase recognition, triplet detection, and reasoning question answering. More broadly, SurgAtlas provides a large native public video corpus that can support future large-scale pretraining of multimodal surgical AI systems and contribute to the development of next-generation foundation models for surgery.

[68] How Robust is OCR-Reasoning? Evaluating OCR-Reasoning Robustness of Vision-Language Models under Visual Perturbations cs.CV | cs.CLPDF

Yuxing Cheng, Yuan Wu, Yi Chang

TL;DR: 本文介绍了OCR-Robust基准测试，用于系统评估视觉语言模型在视觉扰动下的OCR推理鲁棒性。该基准包含812个样本，涵盖文档、场景文本、图表等多种文本丰富场景，并定义了5类代表性扰动。通过评估18个模型，研究发现模型在干净数据上的高准确率并不保证其鲁棒性，且图表和表格类任务对扰动尤为脆弱。

Details

Motivation: 当前视觉语言模型在基于OCR的基准测试上表现出色，但其在受控视觉退化下的鲁棒性尚未得到充分理解。视觉损坏会导致OCR错误和结构扭曲，从而给推理任务带来不确定性，这一研究缺口对于OCR推理至关重要。

Result: 在OCR-Robust基准上评估了18个模型，包括专有系统、开源VLM和OCR+LLM流水线。结果显示，更高的干净准确率并不一定意味着更强的鲁棒性；模型在对结构敏感的任务上（尤其是图表和表格）在最坏情况下会出现显著性能下降，其脆弱性远高于文档类输入。

Insight: 论文的创新点在于构建了一个专门针对OCR推理鲁棒性的系统性评估基准，并引入了相对腐败保留率、最坏情况保留率和复合腐败鲁棒性指数等量化指标。从客观角度看，其通过先导研究筛选代表性扰动的实验设计，以及对模型鲁棒性与干净性能脱钩现象的揭示，为理解VLM在真实噪声环境下的能力边界提供了重要见解。

Abstract: Vision-language models (VLMs) have achieved strong performance on OCR-based benchmarks and increasingly focused on text-rich understanding, but their robustness under controlled visual degradation remains insufficiently understood. This gap is critical for OCR reasoning, where visual corruption can induce OCR errors and structural distortions, thereby introducing uncertainty into the reasoning task. To systematically study this problem, we introduce OCR-Robust, a benchmark designed for evaluating OCR reasoning robustness under visual perturbations. It contains 812 samples across two complementary subsets: OCR1.0, covering documents, scene text, receipts, handwriting, and mathematical content, and OCR2.0, focusing on charts, geometry diagrams, and tables. To enable efficient yet informative evaluation, we conduct a pilot study over 18 candidate perturbations and select 5 representative types at 3 severity levels each based on their impact and cross-model discriminability. We evaluate robustness using clean accuracy, Relative Corruption Retention (RCR), Worst-Case Retention (WCR), and a composite Corruption Robustness Index (CRI), and benchmark 18 models spanning proprietary systems, open-source VLMs, and OCR+LLM pipelines. Our results show that higher clean accuracy does not necessarily imply stronger robustness, and that models can suffer pronounced degradation in the worst case on OCR tasks that are sensitive to structure, and charts and tables are substantially more fragile than document-like inputs under perturbation.

[69] MVTrack4Gen: Multi-View Point Tracking as Geometric Supervision for 4D Video Generation cs.CVPDF

JoungBin Lee, Jaewoo Jung, Jongmin Lee, Tongmin Kim, Hyunsung Kim

TL;DR: MVTrack4Gen提出了一种用于单目参考视频新视角合成的运动感知训练框架。该方法通过将扩散模型中特定注意力层编码的跨视角对应线索，路由到一个辅助的多视角点跟踪头，并联合训练点跟踪目标，从而增强几何和运动一致性。

Details

Motivation: 现有基于显式3D表示的方法受限于单目视频动态物体重建的几何不准确性，而仅依赖相机条件的方法虽能实现高视觉质量，但难以保持几何和运动一致性。本文旨在解决这一问题。

Result: 在多个基准测试中，该方法实现了最先进的几何一致性和具有竞争力的相机精度。

Insight: 核心创新在于发现扩散模型特定注意力层编码了跨视角和时间的强几何对应线索，并利用多视角点跟踪作为额外的几何与运动监督信号来显式强化这些对应关系，从而提升运动保真度与几何一致性。

Abstract: Synthesizing a novel-view video from a monocular reference video along a target camera trajectory requires both geometric consistency and motion fidelity with respect to the reference video. Existing methods based on explicit 3D representations are limited by the accuracy of off-the-shelf reconstruction modules, which often produce inaccurate geometry for dynamic objects in monocular videos. In contrast, camera-conditioning-only methods can achieve high visual quality but often struggle to preserve geometric and motion consistency. In this work, we introduce MVTrack4Gen (Multi-View point Tracking for Novel-View Generation), a motion-aware training framework that leverages multi-view point tracking as an additional geometric and motion supervision signal for camera-conditioning-only novel-view video diffusion models. Our key finding is that specific attention layers encode strong correspondence cues, where query features attend to key features at geometrically corresponding locations across views and over time, and the misalignment of these correspondences causes motion inconsistency. Based on this observation, we route these features into an auxiliary multi-view tracking head and jointly train the diffusion model with a point-tracking objective. By explicitly strengthening these motion-aware correspondences, MVTrack4Gen improves existing models to better follow the motion in the reference view and maintain cross-view geometric consistency. Across diverse benchmarks, our method achieves state-of-the-art geometric consistency and competitive camera accuracy.

[70] DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generation cs.CVPDF

Nan Chen, Yiyang Cai, Rongchang Xie, Junwen Pan, Cheng Chen

TL;DR: 本文提出了DomainShuttle，一种用于开放域主题驱动文本到视频（S2V）生成的新方法。该方法旨在灵活地在域内（保持参考主题特征）和跨域（允许主题无关属性根据文本提示灵活变化）场景之间切换，以实现高保真度和生成灵活性。

Details

Motivation: 现有方法主要专注于在域内场景中最大化主题保真度，这限制了它们在跨域场景（如新风格、语义组合或领域属性）中的可编辑性和适应性。理想的S2V方法应能灵活穿梭于不同领域，在两种场景中都表现出色。

Result: 大量实验表明，DomainShuttle在多种开放域应用场景中，相比现有方法取得了显著的性能提升，展现出高主题保真度和生成灵活性。

Insight: 创新点包括：Domain-MoT模块解耦视频和参考特征，并引入域感知的AdaLN进行特定领域建模；Video-Reference DualRoPE方案将参考图像token和视频token置于独立的RoPE空间，以实现精确的主题级空间建模；以及Cross-Pair Consistent Loss，旨在提取不受无关特征影响的内在主题特征。

Abstract: Open domain subject-driven text-to-video (S2V) generation has drawn significant interest in academia and industry. Open domain S2V mainly involves two scenarios: in-domain, which requires retaining the reference subject features as much as possible, and cross-domain, which preserves the intrinsic features of the subject while allowing subject-irrelevant properties to vary flexibly according to the text prompt. Existing methods primarily focus on maximizing subject fidelity in in-domain scenarios, which limits their editability and adaptability in cross-domain scenarios, such as novel styles, semantic combinations, or domain attributes. In this study, we propose that an ideal S2V method should flexibly shuttle between different domains, achieving strong performance in both in-domain and cross-domain scenarios. To this end, we propose DomainShuttle, which could achieve high fidelity and generative flexibility for open domain video personalization. Specifically, we introduce Domain-MoT, which decouples videos and reference features and introduces the domain-aware AdaLN for domain-specific modeling of reference images. We then introduce the Video-Reference DualRoPE scheme, which places reference image tokens and video tokens in separate RoPE spaces to enable precise subject-level spatial modeling, and Cross-Pair Consistent Loss, which aims to extract intrinsic subject features unaffected by irrelevant features. Extensive experiments demonstrate that DomainShuttle achieves significant performance improvements over existing methods, exhibiting high subject fidelity and generative flexibility across diverse open domain application scenarios.

[71] TriViewBench: Controlled Complexity Scaling for Multi-View Structural Reasoning in MLLMs cs.CV | cs.AIPDF

Yu-Yang Chen, Lan-Zhe Guo

TL;DR: 本文提出了TriViewBench，一个用于评估多模态大语言模型（MLLMs）在受控结构复杂性下多视图视觉推理能力的基准测试。该基准基于参数化合成3D场景构建，包含四个复杂度级别和三种推理任务。通过对18个开源和闭源MLLM的评估，发现所有模型在任务上表现出相同的性能层次，且性能随复杂度单调下降，揭示了当前MLLMs在跨视图空间表示方面的根本可扩展性限制。

Details

Motivation: 尽管MLLMs在标准视觉问答基准上表现出色，但其在受控结构复杂性下的可扩展性尚不明确。本文旨在通过构建一个参数化控制复杂度的多视图推理基准，系统性地诊断MLLMs在结构化视觉推理中的根本瓶颈。

Result: 在TriViewBench上评估了18个MLLMs。所有模型无一例外地表现出相同的性能层次：局部决策 > 物体计数 > 全局恢复。性能随复杂度单调下降，其中物体计数任务性能下降59.14%，全局恢复任务性能崩溃式下降80.02%。思维链提示的总体收益近乎为零（Δ= -0.16%）。

Insight: 论文的创新点在于构建了一个通过参数化控制物体数量和遮挡来精确调节复杂度的合成多视图基准（TriViewBench），为诊断MLLMs的结构化推理失败提供了可控框架。客观分析发现，模型瓶颈在于跨视图的空间表征能力，而非推理策略，且物体计数任务中存在两种机制独立的失败模式（单视图欠计数与多视图过计数），这为理解模型局限性提供了新视角。

Abstract: Multimodal Large Language Models (MLLMs) demonstrate strong performance on standard visual question answering benchmarks, yet their scalability under controlled structural complexity remains poorly understood. We introduce TriViewBench, a controlled three-view visual reasoning benchmark constructed from synthetic 3D scenes with explicitly parameterized object count and occlusion. The benchmark contains 1,923 scenes and over 14K Question-Answer (QA) pairs organized into four complexity levels and three reasoning categories: Local Decision, Object Counting, and Global Recovery. We evaluate 18 open- and closed-source MLLMs under a unified prompting protocol. All 18 models exhibit an identical capability hierarchy without exception (Local Decision > Object Counting > Global Recovery), and performance degrades monotonically with complexity: Local Decision tasks decline modestly (12.11% relative drop), while Object Counting degrades substantially (59.14%) and Global Recovery collapses severely (80.02%). Error analysis on Object Counting reveals two mechanistically independent failure modes: single-view tasks are dominated by undercounting due to occlusion blindness, whereas the multi-view task reverses to overcounting due to cross-view identity confusion. Chain-of-Thought (CoT) prompting yields near-zero overall benefit ($Δ= -0.16%$) and its effect on Global Recovery is strongly capability-gated, suggesting that the bottleneck lies in cross-view spatial representation rather than reasoning strategy. These findings reveal fundamental scalability limitations in current MLLMs and position TriViewBench as a controlled diagnostic framework for analyzing structural reasoning failures.

[72] TryOnCrafter: Unleashing Camera Trajectories for Realistic Video Virtual Try-on via a Renderable 4D Try-on Proxy cs.CVPDF

Hao Sun, Hao Yan, Mengting Chen, Quanjian Song, Yu Li

TL;DR: 本文提出了TryOnCrafter框架，旨在解决视频虚拟试穿（VVT）中相机轨迹受限的问题，并定义了相机可控视频虚拟试穿（CaM-VVT）这一新任务。该框架通过引入一个可渲染的4D试穿代理，将人体与环境显式解耦，并利用基于DiT的架构合成遵循任意指定相机轨迹的逼真视频。

Details

Motivation: 现有视频虚拟试穿方法被动依赖源视频的相机轨迹，无法支持用户自由探索全方位视角，限制了交互性。本文旨在突破这一限制，实现相机可控的视频虚拟试穿。

Result: 论文提出的TryOnCrafter是首个为CaM-VVT任务设计的统一DiT框架，其方法能够生成遵循任意相机轨迹、具有物理合理形变的逼真视频，并支持多种下游应用（如人体重定位、”子弹时间”效果、360度环绕观看）。

Insight: 核心创新在于提出了一个可渲染的4D试穿代理，它将高保真2D试穿先验蒸馏到基于3DGS的着装虚拟化身中，并与重建的背景点云对齐，为视频合成提供了鲁棒的几何锚点，从而实现了对相机轨迹和形变的精确控制。

Abstract: While Video Virtual Try-on (VVT) has achieved remarkable progress in synthesizing realistic garment overlays on dynamic subjects, existing paradigms remains fundamentally constrained by a passive dependency on source camera trajectories, failing to accommodate the requisite interactive freedom for omnidirectional viewpoint exploration. To address this limitation, we define a pioneering research frontier: Camera-controllable Video Virtual Try-on (CaM-VVT). Unlike conventional VVT, CaM-VVT not only necessitates viewpoint-agnostic texture hallucination but also strict structural synchronization between non-rigid human dynamics and background contexts under arbitrary, unconstrained camera movements. To tackle these challenges, we present TryOnCrafter, the first unified DiT-based framework specifically architected for the CaM-VVT task. Departing from implicit pixel-space manipulation, we introduce a Renderable 4D Try-on Proxy that explicitly decouples the human subject from the environment. This is achieved by distilling high-fidelity 2D try-on priors into a clothed 3DGS-based avatar, which is subsequently animated via SMPL-X sequences and metric-aligned into a reconstructed background point cloud. This proxy establishes a robust structural foundation with superior texture density and motion integrity. Our Proxy-Anchored Video DiT leverages this robust structural foundation as a primary geometric anchor, ensuring that the synthesized photorealistic videos are strictly constrained by prescribed trajectories and physically plausible deformations. Benefiting from the inherent editability of the 4D proxy, TryOnCrafter facilitates diverse downstream applications, including human relocalization, ``bullet time’’ effects, and $360$-degree orbital viewing.

cs.RO [Back]

Yixun Hu, Zhicheng Zheng, Lihan Zha, Chunwei Xing, Rajdeep Singh

TL;DR: 本文提出了RAVEN，一种用于长时程机器人问答和导航的智能记忆系统。该系统将带有位姿和时间信息的视觉嵌入存储在向量数据库中，并通过空间地图进行检索，以回答查询并导航至目标。

Details

Motivation: 长期机器人部署需要一个紧凑、可扩展的记忆系统，能够保留细粒度的视觉语义，将观测结果与时空信息关联，并支持高效的存储和检索。

Result: 在多个模拟和真实世界的视频问答基准测试中，RAVEN始终优于基于图像描述的记忆系统，并在长时程任务上达到与前沿视觉语言模型相当的性能，同时检索成本降低了10倍。

Insight: 创新点在于直接操作视觉嵌入，避免了有损的图像到文本描述转换，从而实现了大规模、准确的语义、空间和时间检索。这为机器人长期部署提供了更高效、更精确的记忆解决方案。

Abstract: Long-term robot deployment requires a compact and scalable memory that preserves fine-grained visual semantics, grounds observations in space and time, and enables efficient storage and retrieval. In this paper, we propose RAVEN, an agentic memory system for long-horizon robotic question answering and navigation. RAVEN stores visual embeddings with pose and time in a vector database, and grounds retrieval in a spatial map to answer queries and navigate to goals. By operating directly on visual embeddings, RAVEN avoids lossy image-to-text captioning and enables accurate semantic, spatial, and temporal retrieval at scale. Across several simulated and real-world video question-answering benchmarks, RAVEN consistently surpasses caption-based memory systems and matches frontier VLMs on long-horizon tasks at 10$\times$ lower retrieval cost. Finally, we instantiate RAVEN on a Unitree Go1 robot for the task of long-horizon navigation for natural language goal-reaching, and show successful deployment over several large indoor environments.

[74] Toward Low-Latency Vision-Language Models with Doubly-Correct Predictions in Egocentric Visual Understanding cs.RO | cs.CVPDF

Qitong Wang, Fan Du, Pranav Maneriker, Jihui Jin, Christopher Rasmussen

TL;DR: 本文研究了在具身视觉理解任务中，如何通过剪枝技术实现低延迟的视觉语言模型，同时确保预测的双重正确性（既准确又有证据支持）。作者提出了一种基于推理的剪枝策略，以更好地对齐证据与决策，从而在保持高效推理的同时提升模型的安全性和可靠性。

Details

Motivation: 随着视觉语言模型在具身视觉理解中的快速发展，人机协作任务对低延迟推理的需求日益迫切。同时，安全的人机交互要求剪枝策略能保留双重正确的预测，即输出既要准确又要有证据基础，以降低风险并确保用户信任。

Result: 在具身视频数据集上的基准测试表明，该方法不仅达到了最高的预测准确率，而且在实现双重正确预测方面优于现有方法。

Insight: 本文的创新点在于首次从双重正确预测的视角系统研究VLM剪枝，并提出了基于推理的剪枝策略来更好地对齐证据与决策。从客观角度看，该研究强调了在追求效率的同时确保模型可解释性和安全性的重要性，为高效可靠的VLM设计提供了新思路。

Abstract: The rapid rise of Vision-Language Models (VLMs) in egocentric visual understanding has made low-latency inference in human-robot collaborative (HRC) tasks increasingly critical. Weight pruning techniques developed for VLMs to shrink model size and computation can be readily applied to satisfy the efficiency demands of on-board processing and real-time interactive robotics. Moreover, safe human-robot interaction demands pruning strategies that preserve doubly-correct predictions; outputs must be both accurate and evidentially grounded to mitigate risks and ensure user trust. In this paper, we present a new study of VLM pruning through the lens of doubly-correct prediction. Our experiments surprisingly show that existing pruning methods often preserve the right evidence localization but undermine correct prediction. To address this, we propose a rationale-informed pruning strategy that better aligns evidence with decisions. Benchmark results on egocentric video datasets demonstrate that our method not only achieves the highest prediction accuracy but also outperforms existing approaches in attaining doubly-correct predictions. We aim to stimulate research on efficient and reliable VLMs, ensuring accuracy-driven advances align with the transparency, auditability, and safety required for responsible human-robot interaction and embodied intelligence.

[75] fARfetch: Enabling Collocated AR-HRC in Large Visually Diverse Environments with VLM-Driven AR Content Adaptation cs.RO | cs.CV | cs.HCPDF

Christian Fronk, Hanting Ye, David Hunt, Miroslav Pajic, Maria Gorlatova

TL;DR: 本文提出了fARfetch系统，这是一个用于增强现实-人机协作（AR-HRC）的系统，旨在解决在大型、视觉多样化的户外环境中进行协同工作时AR内容可读性和交互的挑战。该系统集成了共享语义环境地图、情境感知的微型世界表示以及由视觉语言模型驱动的AR视图管理，以自适应调整虚拟内容的颜色、大小和方向。通过在真实户外场景中使用Meta Quest 3头显和Unitree Go2四足机器人进行用户研究，验证了其有效性。

Details

Motivation: 增强现实（AR）能通过可视化机器人状态和意图来改善人机协作，但在大型、视觉多样化的户外环境中，尤其是在远距离和非视距情况下，AR内容的可读性和交互面临挑战。

Result: 在真实世界的大规模（30.5米）户外巡检任务中，fARfetch相比非AR基线显著减少了任务完成时间（66%），并显著降低了心理需求（-43%）、时间需求（-34%）和挫败感（-66%）。自定义可读性调查表明，fARfetch在大型户外环境中有效维持了虚拟内容的可读性。

Insight: 创新点包括：集成共享语义环境地图以支持基于地标的指令、情境感知的微型世界表示用于精细路径规划，以及利用视觉语言模型（VLM）驱动AR视图管理来自适应调整内容属性。这些方法共同提升了AR在复杂环境中的可读性和实用性，为户外AR-HRC系统设计提供了新思路。

Abstract: Augmented Reality (AR) can improve collocated human-robot collaboration by making robot state and intent visible and enabling intuitive control, yet large, visually diverse environments like the outdoors challenge both interaction and content legibility, especially at long distances and beyond visual line of sight. We present fARfetch, an AR-HRC system that integrates (i) shared semantic environment mapping across an AR headset and robot that visualizes detected landmarks in AR to support landmark-grounded go-to commands, (ii) a context-aware world-in-miniature representation of the shared environment for fine-grained path authoring, and (iii) vision-language-model driven AR view management that jointly adapts virtual content color, size, and orientation to maintain legibility in large visually diverse environments. We implement fARfetch with a Meta Quest 3 headset and Unitree Go2 quadruped robot, and conduct a within-subjects user study (N=13) on a real-world large-scale (30.5m) outdoor inspection task. fARfetch yielded significantly faster completion times than a non-AR baseline (66%) and significantly lower workload in mental demand (-43%), temporal demand (-34%), and frustration (-66%). A custom legibility survey indicated fARfetch effectively maintained virtual content legibility in the large outdoor environment.

[76] An Integrated Hardware-Software Design for Low-Data Spatial Defect Detection in Robotic Visual Inspection with Hybrid Optoelectronic Neural Networks cs.RO | cs.CVPDF

Chaoqing Tang, Jiaxuan Li, Huanze Zhuang, Guiyun Tian, Chao Wang

TL;DR: 本文提出了一种软硬件集成的光电神经网络架构，用于机器人视觉检测中的低数据空间缺陷检测。该架构通过将数字微镜器件重构为物理光学卷积层，在光子域进行特征提取，并结合基于块的压缩感知策略，从源头抑制数据量。同时，利用自然语言描述引导网络对齐CLIP的通用特征，以绕过繁琐的手动缺陷形状标注。实验验证了该架构在透明材料缺陷检测中的有效性。

Details

Motivation: 旨在解决机器人视觉检测中数据过载和形状级标注效率低下的问题，通过建立一种非成像、低数据的范式来最小化对标注的依赖。

Result: 在透明材料缺陷检测实验中，与传统成像方法相比，该架构在保持同等准确率的同时，将视觉Transformer的数据量减少了90%，并将卷积神经网络的计算工作量减少了60%。

Insight: 创新点在于将数字微镜器件重构为物理光学卷积层，实现了传感硬件与处理软件的融合；提出基于块的压缩感知策略从源头压缩数据；利用自然语言描述和CLIP特征引导网络注意力，避免了手动形状标注；并提出了局部注意力准确度指标来量化形状级缺陷定位性能。这为涉及海量数据流、高采集成本或受限边缘资源的工业自动化场景提供了高效解决方案。

Abstract: To address data overload and inefficient shape-level annotation in robotic visual inspection, this paper proposes a hardware-software integrated optoelectronic architecture. A non-imaging, low-data paradigm is established to minimize annotation dependency. First, a sensor-in-the-loop strategy reconfigures a Digital Micromirror Device (DMD) as a physical optical convolutional layer, enabling photonic-domain feature extraction that unifies sensing hardware and processing software. To suppress data volume at the source, a block-based compressed sensing strategy encodes spatial information into low-dimensional temporal signals, drastically reducing redundancy. Subsequently, to bypass laborious manual defect shape annotation, natural language descriptions guide the network to align with highly generalizable features from Contrastive Language-Image Pre-training (CLIP), steering the attention maps of the optoelectronic neural network toward defect shapes. Furthermore, a Localization Accuracy for Attention (LAA) metric is proposed to quantify shape-level defect localization performance. Experiments on transparent material defect detection validate the system’s effectiveness. Parametric analysis reveals how measurement matrices, compression ratios, and block sizes affect accuracy. Results show that, compared to traditional imaging, the proposed architecture maintains equivalent accuracy while reducing data volume by 90% for Vision Transformers and computational workload by 60% for Convolutional Neural Networks. This low-data paradigm offers an efficient solution for industrial automation scenarios involving massive data streams, high acquisition costs, or constrained edge resources.

[77] In-Context World Modeling for Robotic Control cs.RO | cs.CVPDF

Siyin Wang, Junhao Shi, Senyu Fei, Zhaoyang Fu, Li Ji

TL;DR: 本文提出了In-Context World Modeling (ICWM)框架，用于解决视觉-语言-动作模型在遇到新的相机视角或机器人形态时泛化能力不足的问题。该框架将系统辨识视为上下文适应问题，让机器人策略通过一段短期的、任务无关的自我交互历史来自主推断关键系统变量，从而在不更新模型参数的情况下适应新环境。

Details

Motivation: 现有VLA模型通常仅以当前观测和语言指令为条件，忽略了底层系统配置作为变量，因此隐含地假设了训练时遇到的固定执行环境，导致面对新配置（如改变的相机视角或机器人形态）时泛化能力差，需要大量数据进行微调。

Result: 在仿真和真实机器人平台上的大量实验表明，ICWM在新相机视角的任务上显著优于标准的VLA基线模型。

Insight: 核心创新点在于将系统辨识（理解系统如何运作）重新定义为上下文学习问题，利用任务无关的交互历史作为上下文来隐式捕捉当前系统的世界动力学，从而实现零样本或少样本的适应，这与传统利用演示来指定任务内容的上下文学习形成对比。

Abstract: Modern Vision-Language-Action (VLA) models often fail to generalize to novel setups, such as altered camera viewpoints or robot morphologies, because they are typically conditioned only on current observations and language instructions. By ignoring the underlying system configuration as a variable, these models implicitly assume a fixed execution context encountered during training, necessitating data-intensive fine-tuning for any new environment. In this work, we introduce In-Context World Modeling (ICWM), a framework that treats system identification as an in-context adaptation problem. ICWM enables robot policies to autonomously infer essential system variables from a short history of self-generated, task-agnostic interactions. Unlike traditional In-Context Learning that uses demonstrations to specify what task to perform, ICWM leverages the context window to understand how the system operates. By processing these interactions before task execution, the model implicitly captures the world dynamics of the current system, enabling adaptation to novel configurations without parameter updates. Extensive experiments in simulation and on real-world robot platforms demonstrate that ICWM significantly outperforms standard VLA baselines on novel camera viewpoints.

[78] ASSCG: Just-Right Gating over Chattering for Fast-Slow LLM Planning in Autonomous Driving cs.RO | cs.CVPDF

Sining Ang, Yuan Chen, Liu Haiyan, Xuanyao Mao, Jason Bao

TL;DR: 本文提出了一种名为自适应慢系统控制门（ASSCG）的方法，用于优化自动驾驶中基于大语言模型（LLM）的快速-慢速规划器架构。ASSCG将慢系统调用建模为一个资源感知的顺序决策问题，在每一帧做出查询/缓存/丢弃的决策，以高效地刷新、重用或抑制慢速规划器的指导。该方法使用RWKV作为主干网络进行高效的长时程门控决策，并通过监督微调和GRPO风格的计算感知强化微调进行训练。

Details

Motivation: 现有基于LLM的自动驾驶规划器在线查询成本高昂，且现有的快速-慢速规划器通常依赖人工设计的触发规则，这容易导致过度调用慢系统或在错误时机调用。

Result: 在两个不同的快速-慢速架构上进行了评估：在nuPlan Hard20闭环评估中，ASSCG应用于AsyncDriver，将得分提升至67.28（+2.28），同时将平均端到端推理延迟降低了60%；在基于RecogDrive构建的双系统上（用轻量级ViT快速规划器替换原VLM-2B模块并添加LLM慢速规划器），在NAVSIM上评估，ASSCG实现了91.4 PDMS（+0.6），并将平均速度提升了25%。

Insight: 核心创新在于将慢系统调用形式化为一个资源感知的顺序决策问题，并设计了帧级别的查询/缓存/丢弃门控机制。该方法结合了高效的RWKV长序列建模能力和计算感知的强化学习微调策略，实现了在显著降低延迟的同时提升规划性能，为资源受限场景下的LLM应用提供了新思路。

Abstract: Large language models (LLMs) can improve autonomous driving planning but are costly to query online, and existing fast-slow planners often rely on hand-designed triggering rules that either over-call the slow system or call it at the wrong times. We formulate slow-system invocation as a resource-aware sequential decision problem and propose the Adaptive Slow-System Control Gate (ASSCG), which makes frame-level Query/Cache/Drop decisions to refresh, reuse, or suppress slow guidance. ASSCG uses an RWKV backbone for efficient long-horizon gating and is trained with supervised fine-tuning followed by GRPO-style compute-aware reinforcement fine-tuning. We apply ASSCG to two different fast-slow architectures: (i) AsyncDriver on nuPlan Hard20 closed-loop evaluation, where ASSCG improves score to 67.28 (+2.28) while reducing average end-to-end inference latency by 60%; and (ii) a RecogDrive-based dual system that we build by replacing its original VLM-2B module with a lightweight ViT-based fast planner and adding an LLM slow planner, evaluated on NAVSIM, where ASSCG achieves 91.4 PDMS (+0.6) and increases average speed by 25%. The project page, including video visualizations and additional results, is available at https://williamxuanyu.github.io/asscg/.

[79] RoboAtlas: Contextual Active SLAM cs.RO | cs.CVPDF

Alexander Schperberg, Shivam K. Panda, Abraham P. Vinod, M. K. Jawed, Stefano Di Cairano

TL;DR: 本文提出了RoboAtlas，一种上下文感知的主动SLAM框架。它通过一个可扩展的3D语义建图系统OpenRoboVox，自适应地平衡几何探索与语义推理。该框架利用上下文多臂老虎机整合前沿探索、全局语义地图推理和基于第一人称视觉语言模型的推理，随着场景理解的提升，从探索过渡到语义引导的导航。

Details

Motivation: 旨在解决主动SLAM中如何有效结合几何探索与高级语义理解，以实现更鲁棒和高效的环境感知与导航任务。

Result: 在超过1800平方米、包含约3万个语义实例的大规模真实世界环境中，实现了100%的任务成功率。在GOAT-Bench的“Val Unseen”基准测试中，使用GPT-4o达到了90.6%的成功率，创造了新的SOTA，比之前最强的基线提升了17.8个百分点。即使使用小得多的Qwen2.5-VL-7B模型，也达到了88.8%的成功率，超越了所有使用GPT-4o的基线。

Insight: 核心创新在于提出了一个通过上下文多臂老虎机动态协调探索与语义推理的框架，并证明了将基础模型（如VLM）与大规模3D语义地图相结合，比单纯更换更强的基础模型更能提升性能，这为构建鲁棒的上下文感知主动SLAM系统提供了新思路。

Abstract: We present RoboAtlas, a contextual Active SLAM framework that adaptively balances geometric exploration and semantic reasoning using a scalable 3D semantic mapping system, OpenRoboVox. RoboAtlas integrates frontier exploration, global semantic-map reasoning, and egocentric VLM-based reasoning through a contextual multi-armed bandit that transitions from exploration to semantically guided navigation as scene understanding improves. We evaluate the system in simulation and on a Unitree Go2 robot in large-scale real-world environments exceeding 1800 m2 with approx. 30k mapped semantic instances, achieving a 100% task success rate. On the GOAT-Bench “Val Unseen” benchmark, RoboAtlas achieves state-of-the-art performance with highest reported success rate (SR) of 90.6%, using GPT-4o, improving over the strongest prior baseline by 17.8 percentage points in SR. Using the much smaller Qwen2.5-VL-7B model, it still achieves 88.8% SR, outperforming all baselines using GPT-4o in SR, and revealing the importance of the information gained by our semantic mapping framework over simply replacing the underlying foundation model. The results demonstrate that grounding foundation models with large-scale 3D semantic maps enables robust and efficient contextual Active SLAM.

[80] Learning Action Priors for Cross-embodiment Robot Manipulation cs.RO | cs.AI | cs.CVPDF

Dong Jing, Tianqi Zhang, Jiaqi Liu, Jinman Zhao, Zelong Sun

TL;DR: 本文提出了一种两阶段训练框架，用于为视觉-语言-动作（VLA）模型预训练动作先验。第一阶段，一个基于流匹配的轻量级编码器-解码器动作模块仅从无条件的动作轨迹中学习跨具身的时间运动结构。第二阶段，将习得的先验通过解码器重用和早期潜在蒸馏转移到VLA训练中，实现视觉-语言特征与动作嵌入空间的对齐，同时允许端到端的策略精调。

Details

Motivation: 现有VLA模型通常基于视觉-语言模型（VLM）主干构建，并附加动作模块进行联合优化。这种设计继承了VLM强大的视觉和语言先验，但动作模块几乎需要从零开始学习物理运动，缺乏显式的运动先验，导致早期优化需要同时发现时间动作动态和跨模态对齐，这在跨具身设置中尤为困难。

Result: 在模拟和真实世界的13个多样化跨具身任务上的广泛实验验证了该方法的有效性。与没有动作先验的VLA训练相比，该模型实现了更快的收敛速度、更高的成功率，并在数据稀缺的真实世界任务上取得了显著更强的性能。此外，扩大第一阶段动作数据的规模可以产生更具泛化性的动作先验，直接提升下游VLA性能。

Insight: 核心创新在于将动作先验学习与跨模态对齐解耦，通过一个专门的无条件动作轨迹预训练阶段来学习跨具身的时间运动结构。这通过流匹配模型高效实现，并通过解码器重用和潜在蒸馏将先验知识有效注入VLA模型。此外，训练好的编码器可作为紧凑的历史压缩器，以极低成本将状态-动作历史总结为单个时间上下文令牌，用于历史感知建模。

Abstract: Most Vision-Language-Action (VLA) models build on a Vision-Language Model (VLM) backbone by attaching an action module and optimizing the full policy jointly. This design inherits strong visual and linguistic priors from the VLM, but leaves the action module to learn physical motion almost from scratch. As a result, the policy lacks an explicit motion prior, forcing early optimization to simultaneously discover temporal action dynamics and cross-modal alignment, a challenge further amplified in cross-embodiment settings. In this work, we propose to pretrain the action module with motion priors before cross-modal VLA alignment. Specifically, we introduce a two-stage training framework that equips the action module with cross-embodiment temporal motion structure before VLA training begins. In Stage1, a lightweight flow-matching-based encoder-decoder action module efficiently learns temporal motion structure solely from unconditioned action trajectories, without processing visual or language tokens. In Stage2, this learned prior is transferred to VLA training through decoder reuse and early-stage latent distillation, aligning visual-language features with the action embedding space while still allowing end-to-end policy refinement. In addition, the trained encoder serves as a compact history compressor, summarizing state-action histories into a single temporal context token for history-aware modeling at negligible cost. Extensive experiments across 13 diverse cross-embodiment tasks on both simulated and real-world platforms validate the effectiveness of our approach. Compared with VLA training without action priors, our model achieves faster convergence, higher success rates, and substantially stronger performance on data-scarce real-world tasks. Moreover, scaling up the action data in Stage~1 yields a more generalizable action prior that directly improves downstream VLA performance.

cs.CR [Back]

[81] Homomorphic Encryptions for Privacy Preserving Vision cs.CR | cs.CVPDF

Preey Shah, Rohan Virani, Sanjari Srivastava

TL;DR: 本文提出了一种基于全同态加密的隐私保护计算机视觉推理方法，旨在使第三方云服务提供商能够直接对加密数据进行图像分类，而无需解密敏感信息。通过使用Microsoft SEAL和TenSEAL库，作者修改了传统CNN层以适应加密方案，并在多个数据集上验证了方法的有效性，实现了与未加密数据训练模型相近的分类精度。

Details

Motivation: 解决因法律限制导致敏感数据（如医疗或金融信息）无法共享，从而阻碍组织利用第三方云ML服务的问题，实现在加密数据上直接进行计算机视觉推理任务。

Result: 在MNIST、Kuzushiji MNIST、Fashion-MNIST和CIFAR-10等数据集上，加密CNN的分类精度下降极小，与未加密数据训练的基线模型性能相当，同时支持了多通道输入、多层卷积和平均池化等复杂操作。

Insight: 创新点在于将全同态加密与CNN结合，通过修改网络层以适应加密方案，实现了隐私保护下的高效视觉推理；客观分析表明，该方法为敏感数据的安全云处理提供了可行路径，扩展了同态加密在复杂视觉任务中的应用。

Abstract: Legal requirements might prevent organizations from sharing sensitive data like medical or financial details of consumers which prevents them from leveraging cloud based ML-as-a-service solutions provided by third party providers, which are quickly gaining popularity these days. In this project, we aim to perform inference tasks in Computer Vision in a privacy-preserving manner, i.e, by only looking at encrypted data. Recent advances in fully homomorphic encryption make this possible. A fully homomorphic encryption allows an arbitrary sequence of additive and multiplicative operations to be performed on encrypted data directly. Applying homomorphic encryptions to CNNs requires modifying the conventional CNN layers, so that they adhere to the encryption scheme. Our aim was to explore the best methods to create CNNs which can classify encrypted images directly. We used Microsoft SEAL for performing homomorphic encryption. The performance of these “encryption based CNNs” should be comparable with baseline accuracies of the same CNNs trained on unencrypted data, and the aim was to achieve as low of a hit on inference-time performance as possible. We successfully obtained minimal drop in classification accuracy for various datasets. We used MNIST as our baseline, which is popularly used in related research work and then explored more complex datasets like Kuzushiji MNIST, Fashion-MNIST and CIFAR-10 as a part of our contribution. Additionally, we also added support for more complex operations on top of TenSEAL, like processing colored images (multi-channel input), applying multiple convolutional layers and performing average pooling.

cs.LG [Back]

[82] Digital Twin-Driven Adaptive Sim-to-Real Alignment via Reinforcement Learning for Vibration-Based Bearing Health Monitoring Under Data Scarcity cs.LG | cs.CLPDF

Jinghan Wang, Yanjun Chen, Wei Zhang, Wentao Wu, Tianchen Liu

TL;DR: 本文提出了一种基于强化学习的数字孪生驱动自适应仿真到真实对齐方法，用于解决数据稀缺条件下基于振动的轴承健康监测问题。该方法将特征对齐建模为一个连续动作的马尔可夫决策过程，通过近端策略优化学习一个策略，该策略能够根据当前特征空间配置，发出针对特定故障类型的仿射校正，以异质性地弥合不同故障类别的仿真-真实差距。

Details

Motivation: 动机在于解决旋转机械振动健康监测中，由于故障事件的结构性稀缺和数字孪生信号中异质的仿真-真实差距所带来的挑战。现有领域自适应方法采用与类别无关的全局变换，无法在不扭曲类间可分性的情况下弥合所有特定故障的差距，而统一的源-目标混合会将分布噪声引入数据丰富的正常类。

Result: 在XJTU-SY、CWRU和自建的转盘轴承试验台上进行的验证证实了强化学习驱动对齐方法的主导性增益。跨设备线性探测（无需编码器重新训练）达到了92.8%的准确率，展示了可迁移的监测能力。

Insight: 核心创新点在于将特征对齐问题重新表述为一个序列的、状态依赖的马尔可夫决策过程，并通过强化学习进行优化，从而能够动态地、异质地处理不同故障类别的仿真-真实差距。此外，采用了一种非对称感知策略，为正常类保留真实数据，同时用策略对齐的模拟样本来增强故障类。

Abstract: Vibration-based health monitoring of rotating machinery requires reliable fault diagnosis under operational data constraints, yet condition assessment remains challenged by structural scarcity of fault events and heterogeneous sim-to-real gaps in digital twin-generated signals. Each fault type generates impulses with distinct periodicity, amplitude modulation, and spectral character, making feature-space discrepancies fundamentally heterogeneous across fault classes. Existing domain adaptation methods apply a class-agnostic global transformation that cannot close all fault-specific gaps without distorting inter-class separability, while uniform source-target mixing introduces distributional noise into the data-abundant Normal class. These limitations stem from treating a sequential, state-dependent alignment problem as a one-shot optimization. Each corrective transformation simultaneously reshapes all class distributions, creating state dependencies that static gradient descent cannot resolve. We formulate feature alignment as a continuous-action Markov decision process solved via Proximal Policy Optimization, where the learned policy issues fault-type-specific affine corrections responsive to the current feature-space configuration, with a dual-objective reward balancing gap minimization against separability preservation. An asymmetry-aware strategy reserves real data for the Normal class while augmenting fault classes with policy-aligned simulated samples. Validation across XJTU-SY, CWRU, and a self-built slewing bearing testbed confirms the dominant gain from reinforcement learning-driven alignment, and cross-equipment linear probing achieves 92.8% without encoder retraining, demonstrating transferable monitoring capability.

[83] Do Thinking Tokens Help with Safety? cs.LG | cs.AI | cs.CLPDF

Narutatsu Ri, Abhishek Panigrahi, Sanjeev Arora

TL;DR: 这篇论文挑战了关于思维链（thinking tokens）能提升模型安全性的普遍直觉。研究发现，在多个前沿开源推理模型（如GPT-OSS、Qwen、Olmo、Phi）中，模型在生成任何可见的思维内容之前，其首个token的隐藏表示就已能高度准确地预测最终的拒绝/遵从结果。思维过程更像是前缀补全而非深思熟虑的修正，且最终结果在思维早期就已锁定，文本层面的深思熟虑表象往往发生在决策已定之后。

Details

Motivation: 动机是探究当前使用思维链的推理模型是否真的通过“深思熟虑”的模式来提升安全性和对齐性，验证“提供安全思考空间”这一普遍直觉是否正确。

Result: 定量结果显示，基于首个token隐藏表示训练的预测头，其AUROC在0.84-0.95之间，平衡准确率约88%，能高度预测最终安全决策。定性分析表明，约74%的文本层面深思熟虑发生时，模型的响应分布早已锁定为拒绝或遵从一侧。现有基于推理时或训练的安全干预措施反而导致过度拒绝并抑制了本就稀缺的深思熟虑信号。

Insight: 论文的核心创新点在于揭示了当前推理模型的安全行为远非深思熟虑，其决策在思维过程开始前就已基本确定，思维链更多是“表演性”的。这挑战了领域内对思维链安全作用的假设，并强调了开发能诱导真正安全深思熟虑方法的必要性。

Abstract: Today’s reasoning models use thinking tokens to attain stronger performance on benchmarks than their instruction-tuned counterparts. It is also generally believed that this more “deliberative” mode should improve alignment and safety, by providing the model a safe space to consider whether its planned answer to a request violates its safety principles. We present evidence that this intuition is not always correct. Across frontier open-weight reasoning models spanning GPT-OSS, Qwen, Olmo, and Phi families, we find that the eventual refusal/compliance outcome is already strongly predictable via a trained head on the first token’s hidden representation ($0.84$-$0.95$ AUROC and $\sim88%$ balanced accuracy for predicting refusal/compliance) before any visible thinking. The thinking process turns out to be more akin to prefix completion than to deliberative revision, with the final outcome rarely changing after the first $\sim20%$ of thinking, despite giving the appearance of deliberation at the text level ($\sim74%$ of text-level deliberations occur when the response distribution is already locked to one refusal/compliance side). We also find that existing inference-time and training-based safety interventions, despite being motivated by the goal of inducing deliberation, largely shift model behavior toward over-refusal while suppressing already-scarce deliberation signals. Our results suggest that safety behavior in current reasoning models is much less deliberative than commonly assumed, and highlight the need for methods that induce real safety deliberation.

[84] ASAP: Agent-System Co-Design for Wall-Clock-Centered Auto HPO Research for ML Experiments cs.LG | cs.AI | cs.CLPDF

Taicheng Guo, Haomin Zhuang, Kehan Guo, Yujun Zhou, Nitesh V. Chawla

TL;DR: 本文提出了ASAP框架，通过智能体与系统协同设计来解决自动超参数优化（HPO）中的样本效率问题。该方法利用大语言模型（LLM）整合多种具有不同归纳偏置的优化器，并重构优化循环以减少端到端挂钟时间，从而在多样化的HPO任务中实现高效性能。

Details

Motivation: 现有基于LLM的HPO方法存在两个核心限制：一是LLM作为单一工具受限于其预训练目标，无法处理多样化问题；二是基于迭代次数的评估忽略了实际运行中LLM推理或工具执行带来的额外时间开销，导致迭代增益无法转化为端到端挂钟时间增益。

Result: 在多样化的现代HPO任务上进行广泛实验，ASAP在端到端挂钟时间上持续优于基线方法，验证了工具集成与智能体-系统协同设计的价值。

Insight: 创新点在于将LLM用作多种优化器的集成与选择器，而非单一替代工具，并结合系统级优化（如前缀稳定提示、推测并行和自适应阈值调整）来隐藏延迟，从而在保证遗憾质量的同时显著减少实际运行时间。

Abstract: Hyperparameter Optimization (HPO) is essential for maximizing machine learning model performance, and its core challenge is sample efficiency: finding strong configurations within a limited budget. Because every HPO tool relies on a surrogate prior that imparts its own inductive bias, individual tools struggle once problems become sufficiently diverse and drift from these priors. Motivated by the reasoning and generalization capabilities of LLMs, recent work has explored using LLMs for HPO and reports improved per-iteration performance. Yet these methods share two limitations with a common origin: they use the LLM as a single-tool replacement evaluated by iteration count. (i) Deployed in place of prior tools, the LLM is itself constrained by its pretraining objective to one family of inductive-biased proposals; this single-source setup still fails to handle the full diversity of problems. (ii) Per-iteration evaluation ignores that, in real runs, LLM inference or tool execution is paid serially on top of model evaluation every round, so iteration-count gains do not translate into end-to-end wall-clock gains. We present ASAP, an agent-system co-design that addresses both limitations. On the agent side, ASAP uses the LLM to integrate a diverse pool of inductive-biased optimizers and to select among their proposals each round. On the system side, ASAP re-architects the loop to reduce end-to-end wall-clock while preserving regret quality: a prefix-stable prompt maximizes KV-cache reuse across rounds; speculation parallelism hides the remaining LLM and tool latency under model evaluation via a relative-error accept test; and a Self-Tuner adapts the speculation threshold from execution logs off the critical path. Extensive experiments on diverse modern HPO tasks show that ASAP consistently outperforms baselines, underscoring the value of tool integration and agent-system co-design.

[85] Uncertainty Quantification for Computer-Use Agents: A Benchmark across Vision-Language Models and GUI Grounding Datasets cs.LG | cs.AI | cs.CL | cs.CVPDF

Divake Kumar, Sina Tayebati, Devashri Naik, Amanda Sofie Rios, Nilesh Ahuja

TL;DR: 该论文提出了Argus基准，用于评估计算机使用代理（将视觉语言模型预测转化为可执行的GUI点击）的后验不确定性量化方法。研究覆盖了27种开放权重方法和8种闭源方法，在4种VLM代理和4个数据集上进行了大规模评估。主要发现是UQ排名在固定模型内跨数据集稳定，但在跨模型类别和可观察界面时性能下降，且闭源模型的UQ方法需要针对目标重新排序，不能简单外推。

Details

Motivation: 计算机使用代理需要可靠的不确定性估计来进行拒绝、校准、错误严重性排序和空间安全区域划分，但目前针对这些代理的后验不确定性量化证据分散在不同的模型和数据集组合中，缺乏跨模型、跨基准、跨界面的稳定性评估。

Result: 在单步可执行GUI接地的跨机制基准测试中，隐藏状态和密度估计方法（如Mahalanobis、SAPLMA）是表现最稳定的开放权重方法族；CoCoA-1MCA、Focus、基于采样的分数和言语化自我评估在特定机制中表现最佳。模型内排名转移性很强（Spearman rho高达0.969），但跨层级转移到闭源供应商的平均增益仅为+0.08。

Insight: 论文的创新点在于构建了首个针对GUI代理后验不确定性量化的跨机制基准（Argus），系统性地揭示了UQ方法排名在不同条件下的选择性转移现象，并指出仅凭分数级区分不足以部署，需要结合校准的局部加权区域。研究为实际应用中根据机制选择UQ方法提供了数据支持和分析框架。

Abstract: Computer-use agents turn vision-language model (VLM) predictions into executable GUI clicks, so reliable uncertainty estimates are essential for rejection, calibration, miss-severity ranking, and spatial safety regions. Yet evidence on post-hoc uncertainty quantification (UQ) for these agents is fragmented across isolated model and dataset pairs, leaving it unclear whether UQ rankings stay stable when the agent, benchmark, or observable interface changes. We present Argus, a cross-regime benchmark for post-hoc UQ in single-step executable GUI grounding: a 27-method open-weight matrix over 4 VLM agents and 4 datasets, plus an 8-method closed-source matrix across 3 frontier vendors where logits, hidden states, and attention maps are unavailable. Evaluated methods span logit-based scores, sampling and consistency measures, hidden-state and density estimators (Mahalanobis, SAPLMA), attention-based scores, P(True) and verbalised-confidence prompting, and split-conformal prediction. The main finding is selective transfer: UQ rankings are stable across datasets for a fixed model, but degrade across model classes and observable interfaces. Hidden-state and density methods are the most stable open-weight family, while CoCoA-1MCA, Focus, sampling-based scores, and verbalised self-assessment win in specific regimes. Within-model ranking transfer is strong (Spearman rho up to 0.969), but cross-tier transfer to closed-source vendors averages only +0.08, so closed-source UQ should be reranked on the target rather than extrapolated. Conformal click regions show score-level discrimination is not enough for deployment: locally weighted disks shrink radii by 40-60% when the plug-in UQ is calibrated, but coverage degrades under calibration-test or interface mismatch. We release per-item records, calibration/test splits, UQ scores, and analysis scripts for regime-aware UQ selection in GUI agents.

[86] An iterative energy-based multimodal transformer for joint retrieval of wheat soil moisture, leaf area index, and plant height from Sentinel-1 and Sentinel-2 time series cs.LG | cs.CV | eess.IVPDF

Shubham Kumar Singh, Peilei Fan, Suraj A. Yadav, Rajendra Prasad, Prashant K Srivastava

TL;DR: 该论文提出了一种名为迭代能量变换器（iEBT）的模型，用于从Sentinel-1雷达和Sentinel-2多光谱时间序列数据中联合反演小麦的土壤湿度（SM）、叶面积指数（LAI）和株高（PH）。该方法通过迭代优化一个学习的兼容性能量函数来估计目标状态，而非直接回归，并在印度瓦拉纳西的实地测量数据上取得了优于传统物理模型的学习模型性能。

Details

Motivation: 在异质化的小农耕作系统中，土壤湿度和冠层密度的同步变化导致雷达后向散射和光谱响应存在严重模糊性，使得传统前馈回归模型在田间尺度反演SM、LAI和PH这一不适定逆问题上效果不佳。

Result: 在来自印度瓦拉纳西的700个质量控制实地测量数据上，iEBT在随机测试集上取得了最高的学习模型性能，四个随机种子下的平均R²为0.854 ± 0.012（SM、LAI、PH的R²分别为0.841、0.905、0.821）。模型最终的兼容性能量函数可作为未校准的反演后质量诊断指标，筛选掉能量最高的10%样本后显著降低了均方根误差。

Insight: 创新点在于将多模态预测因子嵌入共享序列，并通过迭代归一化梯度下降最小化学习的标量兼容性能量函数来联合反演耦合状态，这提供了一种结构化的、具备自我诊断能力的多模态融合路径。模型还揭示了不同模态数据的贡献：Sentinel-1主导SM反演，Sentinel-2主导LAI反演，而PH则依赖于结合的结构-物候特征。

Abstract: Field-scale retrieval of surface soil moisture (SM), leaf area index (LAI), and plant height (PH) is essential for precision agriculture, yet it remains an ill-posed inverse problem. Concurrent variations in soil moisture and canopy density generate substantial ambiguities in radar backscatter and spectral responses, which reduces the effectiveness of traditional feedforward regression models in heterogeneous smallholder cropping systems. This study presents the Iterative Energy-Based Transformer (iEBT) for the joint retrieval of coupled soil-canopy states from Sentinel-1 C-band SAR and Sentinel-2 multispectral time series. Instead of direct regression, iEBT embeds multi-modal predictors within a shared sequence, produces an initial state estimate, and iteratively updates the target [SM, LAI, PH] vector through normalized gradient descent to minimize a learned scalar compatibility energy function. Using 700 quality-controlled field measurements from Varanasi, India, iEBT achieved the highest learned-model performance on the random test split, with a four-seed mean R^2 of 0.854 \pm 0.012 (R_SM^2 = 0.841, R_LAI^2 = 0.905, R_PH^2 = 0.821). WCM and PROSAIL were retained as physically interpretable SAR and optical reference models for comparison. Modality ablations confirmed that Sentinel-1 drives SM retrieval, while Sentinel-2 dominates LAI, whereas PH relies on combined structural-phenological signatures. Crucially, the model’s terminal energy functions as an uncalibrated post-retrieval quality diagnostic; screening the 10% highest-energy samples markedly reduced target level root-mean-square errors. While leave-one-campaign-out validation highlights persistent cross-season domain shift challenges due to localized management variations, compatibility-guided multimodal fusion offers a structured self-diagnostic path toward reliable biophysical parameter estimation

[87] Brevity is the Soul of Inference Efficiency: Inducing Concision in VLMs via Data Curation cs.LG | cs.AI | cs.CVPDF

DatologyAI, :, Matthew L. Leavitt, Siddharth Joshi, Haoli Yin

TL;DR: 这篇论文提出了一种通过数据筛选来提升视觉语言模型推理效率的新方法，认为简洁性（减少输出token数量）是传统模型压缩方法（如蒸馏、剪枝）之外的关键效率杠杆。作者构建了一个数据筛选流程，用于生成简洁、正确的训练数据，并证明用此数据训练的模型能以更少的token给出正确答案，从而显著降低每次正确回答的计算成本（Cost-of-Pass）。

Details

Motivation: 当前提升推理效率的方法（如模型压缩）主要关注降低每个token的计算成本，但忽视了输出token数量不断膨胀的问题。论文的动机是探索通过数据筛选来诱导模型生成更简洁的回答，从而直接减少总token数，实现更根本的推理效率提升。

Result: 在MAmmoTH-VL单图像子集上，与未筛选的基线相比，使用筛选数据训练的模型在保持准确率相近（~1个百分点内）的情况下，将每次正确回答的计算成本（Cost-of-Pass）降低了35倍（例如，与Qwen3.5-4B相比，从14.58 TFLOPs降至0.41 TFLOPs）。同时，在控制输出长度相同的情况下，筛选数据带来了高达+17.55个百分点的准确率提升，且该优势随模型规模增大而增强。

Insight: 论文的核心创新点在于将推理效率重新定义为“每次正确回答所需的token数”问题，并首次系统性地通过数据筛选（而非模型架构修改）来直接优化这一指标。研究还揭示，通用的冗长回答并不会提升准确率，而精心设计的推理结构带来的冗长效益也随模型能力提升而缩小，这表明简洁性本身可以成为一种不牺牲质量甚至提升性能的设计目标。

Abstract: Inference efficiency is typically pursued by shrinking the model: distillation, pruning, quantization, and sparse routing each lower per-token cost while treating token count as fixed. But output length has been inflating, and it is precisely the component the standard toolkit leaves untouched. Here, we argue that brevity is the missing inference-efficiency lever, and that pretraining data curation is a practical way to pull it: a model trained on concise, correct data learns to answer in fewer tokens; i.e. it has a lower Cost-of-Pass. We apply our VLM curation pipeline to the MAmmoTH-VL single-image subset, and compare models trained on our curated data, the standard MAmmoTH-VL data, and external open-weight frontier VLMs. On a controlled 20-evaluation set and 14 VLMs at 1B-4B activated parameters, we hold output length fixed with a per-model regression, separating brevity from quality, and price models in FLOPs per correct answer. Curation buys a 35x Cost-of-Pass advantage over the most verbose 4B comparator (Qwen3.5-4B) within $\sim$1 pp of accuracy (0.41 vs 14.58 TFLOPs per correct answer; 0.691 vs 0.704 mean accuracy). Curation also buys a +17.55-percentage-point matched-length accuracy gain over the uncurated baseline that grows with model scale (from +16.7 pp at 1B to +21.2 pp at 4B). This brevity improvement concedes no quality: generic verbosity buys no accuracy at any capability or scale, and the window where reasoning-structured verbosity still earns its tokens shrinks from 4 of 8 capability groups at 2B to 1 of 8 at 4B. Per example, the concise model even reaches correct answers the verbose reasoning model misses, marking reasoning as a distinct curation target rather than something brevity gives up. Inference efficiency in this regime is a tokens-per-correct problem, and brevity is the lever that targets it directly.

[88] Tensorion: A Tensor-Aware Generalization of the Muon Optimizer cs.LG | cs.CV | math.NAPDF

Vladimir Bogachev, Vladimir Aletov, Alexander Molozhavenko, Sergei Kudriashov, Maxim Rakhuba

TL;DR: Tensorion是一种针对高阶张量优化的新型一阶优化器，它通过将Muon优化器的谱范数约束思想从矩阵推广到张量，利用张量结构信息来改进优化动态。该方法基于张量范数球的线性最小化预言机，通过自适应选择展开矩阵实现高效计算。

Details

Motivation: 现有的一阶优化器（如Adam）将参数块视为无结构向量，忽略了现代机器学习模型中普遍存在的多线性权重结构。Muon等近期工作表明利用矩阵结构可以改善优化动态，因此需要将这种思想扩展到更高阶的张量场景。

Result: 在基于张量的计算机视觉问题上，Tensorion相比基于Adam的优化器和现有张量感知基线，在评估场景中表现出更好的收敛行为和更稳定的梯度更新。

Insight: 创新点在于将约束优化视角从矩阵扩展到张量，通过精心选择的张量范数平衡紧致界与计算可行性，并利用自适应展开矩阵实现线性最小化预言机的可计算性。当应用于二阶张量（矩阵）时能精确恢复Muon优化器。

Abstract: Common first-order optimizers, such as Adam, implicitly treat each parameter block as an unstructured vector, which disregards the multilinear weight structure present in many modern machine learning models. Recent work has shown that exploiting matrix structure can improve optimization dynamics. A notable example is Muon, which performs steepest descent under the spectral norm constraint. We take the next step and introduce Tensorion, a tensor-aware optimizer that extends Muon’s constrained optimization perspective from matrices to higher-order tensors. Tensorion is built around a linear minimization oracle (LMO) over a tensor norm ball. The norm is carefully chosen to balance two objectives: tightly bounding the tensor spectral norm, while still keeping the LMO tractable. This LMO becomes computable because it reduces to operations on adaptively selected unfolding matrices. Notably, when restricted to order-2 tensors (i.e., matrices), Tensorion recovers Muon exactly. Experiments on tensor-based computer vision problems suggest that Tensorion can offer improved convergence behavior and more stable gradient updates compared with Adam-based and existing tensor-aware baselines in the evaluated settings.

eess.IV [Back]

[89] Cross-Attention Multimodal Learning for Predicting Response to Neoadjuvant Imatinib in Gastrointestinal Stromal Tumors: A Multicenter Retrospective Study eess.IV | cs.CVPDF

Fariba Tohidinezhad, Douwe J. Spaanderman, Natalia Oviedo Acosta, Kaouther Mouheb, Karthik Prathaban

TL;DR: 本研究开发了一种可解释的多模态深度学习框架，通过交叉注意力机制整合CT影像和临床变量，以预测胃肠道间质瘤（GIST）患者对新辅助伊马替尼的治疗反应。该框架在内部验证中表现出色，但外部泛化能力有限，同时可解释性分析揭示了响应者与非响应者之间的特征重要性差异。

Details

Motivation: 当前临床或分子标记物无法可靠预测GIST患者对新辅助伊马替尼的治疗反应，因此需要开发一种整合多模态数据的预测方法以提高预测准确性。

Result: 交叉注意力模型在内部交叉验证中达到最高AUC（0.99），但外部测试性能较低（AUC 0.60-0.63）；仅使用临床变量的模型性能中等（AUC 0.66），而仅使用影像的模型泛化能力有限（AUC 0.56-0.66）。

Insight: 创新点在于采用交叉注意力机制融合多模态数据，并结合可解释性分析量化各模态贡献；客观来看，该框架为医疗AI提供了结合自监督预训练与低秩适应的多模态学习策略，有助于理解治疗响应的决定因素。

Abstract: Background: Response to neoadjuvant imatinib in gastrointestinal stromal tumors (GISTs) is highly variable and cannot be reliably predicted using current clinical or molecular markers. This study developed and evaluated an explainable multimodal deep learning framework integrating computed tomography (CT) imaging and clinical variables to predict treatment response. Methods: Patients from four tertiary centers were retrospectively included between 2000-2023 in independent pretraining (n=935) and prediction (n=213) cohorts. A cross-attention framework integrating clinical variables and tumor-centered CT imaging was developed to predict response to neoadjuvant imatinib. Two training strategies were evaluated: (1) self-supervised pretraining with low-rank adaptation and (2) training from scratch. Hyperparameters were optimized using SMAC3. Performance was assessed through internal cross-validation and external testing. Ablation analyses and attention-based explanations were used to quantify modality contributions. Results: Among 213 patients (54.5% responders), responders had larger tumors (112 vs. 89 mm, P=0.026), higher mitotic index (3 vs. 0, P<0.001), and more frequent KIT mutations (69.0% vs. 56.7%, P=0.019). Cross-attention models achieved the highest internal performance (AUC up to 0.99) but lower external performance (AUC 0.60-0.63). Clinical-only performance was moderate (AUC 0.66), whereas imaging-only models showed limited generalizability (AUC 0.56-0.66). Explainability analyses identified significant differences in feature importance between responders and non-responders, including CD117, BRAF, PDGFRA, age, sex, disease status, and comorbidities (FDR-adjusted P<=0.036). Conclusion: The cross-attention framework shows potential for improving imatinib response prediction in GIST while providing interpretable insights into multimodal determinants of treatment response.

cs.AR [Back]

[90] Energy-Efficient CNN Acceleration with MSDF Digit-Serial Arithmetic on FPGA cs.AR | cs.CVPDF

Muhammad Usman, Yousef Sadegheih, Dorit Merhof

TL;DR: 本文提出了一种用于U-Net图像分割网络中卷积层的节能硬件加速器，在FPGA上实现。通过融合乘加操作，设计了一种合并乘加（MMA）架构，以克服传统MSDF（最高有效位优先）数字串行运算中因级联操作导致的初始延迟累积问题，从而提升了吞吐量和能效。

Details

Motivation: MSDF数字串行运算虽然硬件占用小，但在级联操作（如乘法后接加法）中，每个单元的启动延迟会累积，导致初始延迟问题。本文旨在解决这一延迟累积问题，以提升能效，适用于资源受限、对延迟敏感的边缘应用（如医学影像和计算机视觉）。

Result: 在U-Net目标应用上的评估表明，尽管FPGA加速器运行频率低于CPU，但其能效高达15.14 GOPS/W，相比基于CPU推理的1.93 GOPS/W提升了一个数量级。与基于MSDF的FPGA实现相比，能耗降低了约9倍。

Insight: 核心创新点在于提出了合并乘加（MMA）架构，将乘法和加法操作融合到统一的流水线中，用单次迭代的流线型延迟替代了传统级联单元的独立延迟之和。这种设计在并行处理空间输入深度时，性能显著优于独立的MSDF设计和传统设计，为边缘设备的高效能CNN加速提供了新思路。

Abstract: This paper presents an energy-efficient hardware acceleration of the convolutional layers in the U-Net architecture for image segmentation, implemented on FPGA. While digit-serial arithmetic, particularly most-significant-digit-first (MSDF) techniques, offers a compact hardware footprint, it suffers from initial latency before producing the first output digit. This delay accumulates in cascaded operations like multiplication followed by addition, where each unit introduces its own startup overhead. To overcome this, we propose a merged multiply-add (MMA) architecture that fuses these operations into a unified pipeline. Instead of incurring separate delays, the MMA introduces a single streamlined latency per iteration, shorter than the combined latency of conventional cascaded units, resulting in enhanced throughput and efficiency. The MMA units are designed to process spatial input depths in parallel, achieving significantly higher performance than both standalone MSDF-based and conventional designs. We evaluate the proposed design using U-Net as a target application. Despite operating at a lower frequency than a CPU, the FPGA-based accelerator achieves up to an order of magnitude higher energy efficiency, delivering up to $15.14$ GOPS/W compared to $1.93$ GOPS/W for CPU-based inference. The design also shows approximately $9\times$ reduction in energy consumption compared to MSDF-based FPGA implementations. These results highlight the efficacy of the merged arithmetic approach for resource-constrained, latency-sensitive edge applications in medical imaging and computer vision.

cs.AI [Back]

[91] The Hitchhiker’s Guide to Agentic AI: From Foundations to Systems cs.AI | cs.CL | cs.IR | cs.LGPDF

Haggai Roitman

TL;DR: 《The Hitchhiker’s Guide to Agentic AI》是一本面向实践者的综合性参考书，旨在指导如何构建自主AI系统。它涵盖了从基础原理到生产部署的完整技术栈，核心论点是构建优秀的智能体系统需要理解整个流程的每一层，而非单一环节。

Details

Motivation: 本书旨在为从业者提供一个全面的参考，解决构建复杂、可部署的自主AI系统时缺乏系统性指导的问题，强调对从底层模型到上层应用的全栈理解。

Result: 作为一本参考书，它本身不提供新的实验基准或SOTA结果，但系统性地整合了当前智能体AI领域的关键技术、协议和设计模式，为实践提供了理论基础和实现指南。

Insight: 其核心创新在于将智能体AI视为一个分层系统进行整体阐述，并特别强调了跨智能体协调（如MCP、A2A协议）和从基础模型到生产部署的完整链路，为系统化构建和评估智能体提供了清晰的框架和分类法。

Abstract: The Hitchhiker’s Guide to Agentic AI is a comprehensive practitioner’s reference for building autonomous AI systems. The book covers the full stack from first principles to production deployment, organized around a central thesis: building great agentic systems requires understanding every layer of the pipeline, not just one. The book opens with the LLM substrate – transformer architecture, GPU systems, training and fine-tuning (SFT,LoRA, MoE), model compression, and inference optimization – treated as essential foundations rather than the primary focus. It then develops the alignment and reasoning layer: reinforcement learning from human feedback (RLHF), PPO, DPO and its variants, GRPO, reward modeling, and RL for large reasoning models including chain-of-thought and test-time scaling. The second half is devoted to agentic AI proper. Topics include agentic training and trajectory-based RL, retrieval-augmented generation (RAG and Agentic RAG), memory systems (in-context, external, episodic, and semantic), agent harness design and context management, and a taxonomy of agent design patterns. Inter-agent coordination is covered in depth: the Model Context Protocol (MCP), agent skills and tool use, the Agent-to-Agent (A2A) communication protocol, and multi-agent architectures spanning centralized, decentralized, and hierarchical topologies. The book concludes with agent development frameworks, agentic UI design, evaluation methodology for agentic tasks, and production deployment. Each chapter pairs rigorous theoretical foundations with implementation guidance, code examples, and references to the primary literature.

[92] To Isolate or to Score? Model-Adaptive Assessment for Cost-Efficient Multi-Agent RAG cs.AI | cs.CLPDF

Jungseob Lee, Chanjun Park, Heuiseok Lim

TL;DR: 本文研究了多智能体文档评估在检索增强生成中的计算成本问题，通过对比训练无关的干预方法，揭示了模型从评估中获益的两种机制：对于弱基线模型，主要机制是文档隔离；对于强基线模型，评分质量更为关键。基于此，作者提出了MADARA，一种模型自适应路由架构，能够零样本泛化到未见模型家族，显著降低计算开销。

Details

Motivation: 解决多智能体文档评估在检索增强生成中计算成本高的问题，并探究不同模型在评估机制上的差异，以设计更高效的部署方案。

Result: 在多样化QA基准测试中，对于弱基线模型，文档隔离机制能带来高达50个百分点的性能提升；对于强基线模型，评分质量是关键。MADARA架构通过单试点模型推导的诊断阈值，能零样本泛化到四个未见模型家族，实现轻量级高效部署。

Insight: 创新点在于揭示了评估机制的二分化：弱模型依赖文档隔离解决上下文混淆，强模型依赖评分质量；并提出了无标签扰动探针Reasoning-Score Coupling和模型自适应路由架构MADARA，实现计算开销的显著降低和零样本泛化能力。

Abstract: Multi-agent document assessment for retrieval-augmented generation is computationally expensive, driving practitioners toward smaller, deployable models whose assessment mechanisms remain poorly understood. We conduct a controlled study of training-free interventions on 7B-9B instruction-tuned models across diverse QA benchmarks, revealing a sharp dichotomy in how models benefit from assessment. For weaker baselines, the dominant mechanism is per-document isolation. Astoundingly, assessment-free isolation matches full multi-agent assessment, demonstrating that resolving multi-document context confusion, rather than scoring quality, drives outsized gains of up to 50 percentage points. Conversely, for strong baselines where scoring quality matters, we introduce Reasoning-Score Coupling, a label-free perturbation probe that classifies scoring behavior. Integrating these findings, we propose MADARA, a model-adaptive routing architecture. Crucially, MADARA’s diagnostic thresholds derived from a single pilot model generalize zero-shot to four unseen model families, providing a robust, lightweight pipeline to eliminate computational overhead.

[93] Cliff Tokens: Identifying Single-Token Failure Triggers in LLM Mathematical Reasoning cs.AI | cs.CLPDF

Jaeyong Ko, Pilsung Kang, Yukyung Lee

TL;DR: 本文提出了‘cliff token’概念，用于识别大型语言模型在数学推理中导致失败的具体触发词。通过自适应阈值和单侧双比例z检验，作者在三个数学推理基准上验证了删除首个cliff token能显著恢复模型性能，并建立了cliff分类法，进一步通过Cliff-DPO优化方法提升了模型准确性。

Details

Motivation: 现有研究在分析LLM数学推理失败时，通常关注步骤、块或句子级别，或已发生失败的词元，但未能精确定位触发失败的具体词元。本文旨在填补这一空白，识别导致模型从正确转向错误的关键触发词。

Result: 在七个模型和三个数学推理基准（GSM1K、MATH500、AIME 2025）上，删除首个cliff token可将pass@64恢复至1.0，而保留它则限制恢复在0.71到1.00之间。通过Cliff-DPO优化，在GSM8K上训练后，跨基准准确率提升高达+6.6。

Insight: 创新点包括引入cliff token作为失败触发器的精确定义，基于贪婪选择和词元熵的cliff分类法（确定性、不确定性和采样偏离），以及通过单词元偏好优化（Cliff-DPO）在cliff位置提升模型推理能力，其中不确定性和采样偏离cliff的优化效果显著。

Abstract: Large language models (LLMs) reach high accuracy in mathematical reasoning, but individual traces on the same problem diverge; some arrive at the correct answer while others fail. Prior work analyzes failure at the step, chunk, or sentence level, or at tokens where failure has already occurred. Neither identifies the precise token that triggers the shift toward failure. We introduce the cliff token, a token where the token-wise potential drops significantly under an adaptive threshold that scales with the local token-wise potential, based on a one-sided two-proportion z-test. Across seven models and three mathematical reasoning benchmarks (GSM1K, MATH500, AIME 2025), cliff tokens act as failure triggers; deleting the first cliff token and resampling recovers pass@64 to 1.0, while keeping it limits recovery to between 0.71 and 1.00. We further introduce a cliff taxonomy of deterministic, uncertain, and sampled-off cliffs, defined by greedy choice and token entropy. Each type has distinct probabilistic characteristics, and the taxonomy generalizes across model scales. Finally, we validate the taxonomy via single-token preference optimization at cliff positions (Cliff-DPO). Trained on GSM8K, Cliff-DPO improves accuracy across benchmarks by up to +6.6. Optimizing at uncertain and sampled-off cliffs improves reasoning, while deterministic cliffs do not.

[94] Autodata: An agentic data scientist to create high quality synthetic data cs.AI | cs.CL | cs.LGPDF

Ilia Kulikov, Chenxi Whitehouse, Tianhao Wu, Yixin Nie, Swarnadeep Saha

TL;DR: 本文提出了Autodata方法，这是一种让AI智能体扮演数据科学家角色以生成高质量训练和评估数据的通用方法。论文介绍了其整体框架和一个具体的实践实现——Agentic Self-Instruct，并在多个任务上进行了实验验证。

Details

Motivation: 旨在解决传统合成数据生成方法在质量和效率上的局限性，探索如何利用AI智能体自动、智能地创建更优的训练数据，从而将增加的计算资源转化为模型性能的提升。

Result: 在计算机科学研究任务、法律推理任务和数学对象推理任务上的实验表明，该方法相比经典的合成数据集创建方法取得了改进的结果。进一步对数据科学家智能体进行元优化后，带来了更大的性能提升。

Insight: 核心创新在于提出了一个可训练的、具备自主性的“数据科学家”智能体框架（Agentic Self-Instruct），它能够通过元优化学习如何生成更强大的数据，这为利用推理计算来提升数据质量、进而改进模型训练提供了一种新的范式。

Abstract: We introduce Autodata, a general method that enables AI agents to act as data scientists who build high quality training and evaluation data. We show how to train (meta-optimize) such a data scientist agent, so that it learns to create even stronger data. We describe the overall formulation, and a specific practical implementation, Agentic Self-Instruct. We conduct experiments on computer science research tasks, legal reasoning tasks and reasoning with mathematical objects, where we obtain improved results compared to classical synthetic dataset creation methods. Further, meta-optimizing the data scientist agent itself delivers an even larger performance uplift. Agentic data creation provides a way to convert increased inference compute into higher quality model training. Overall, we believe this direction has the potential to change the way we build AI data.

[95] Do vision-language models search like humans? Reasoning tokens as a reaction-time analog in classic visual-search paradigms cs.AI | cs.CVPDF

Farahnaz Wick

TL;DR: 本文通过将经典视觉搜索范式应用于视觉语言模型（VLMs），探究其是否表现出与人类相似的行为特征。作者使用模型生成推理令牌的数量作为搜索努力的类比，并与人类基准数据进行比较，发现VLMs在某些方面（如特征搜索与联合搜索的努力模式）与人类一致，但在其他方面（如目标存在与否的努力斜率、枚举能力）存在差异。

Details

Motivation: 研究动机是探究视觉语言模型在视觉搜索任务中是否展现出与人类相似的注意力行为特征，从而评估机器视觉认知与人类认知的异同。

Result: 在多个经典视觉搜索范式（如特征搜索、联合搜索、空间配置搜索、枚举和倾斜/垂直搜索不对称性）中，前沿VLMs在准确性和努力模式上部分复现了人类行为（如特征搜索努力平坦，联合搜索努力随集合大小增加），但也在目标存在/缺失的努力斜率顺序和枚举准确性上与人类存在差异。

Insight: 创新点在于将心理物理学范式行为化地应用于机器视觉认知评估，使用推理令牌数量作为反应时间的类比，提供了一种低成本且敏锐的探测方法；研究不仅关注模型与人类的一致性，更强调分歧点对理解机器认知的启示价值。

Abstract: Visual search has been one of the most productive paradigms in the study of visual attention: the way reaction time scales with the number of items distinguishes parallel, “pop-out” search from serial, attention-demanding search. I ask whether vision-language models (VLMs) exhibit the same behavioral signatures. I adapt four classic paradigms: feature versus conjunction search, spatial-configuration (T-vs-L) search, enumeration, and the tilted/vertical search asymmetry; and present them to current frontier and mid-tier models. Because a single model call has no reaction time, I use the number of reasoning (“thinking”) tokens a model spends per trial as a within-model analog of search effort, and I compare against a large public human benchmark (Wolfe et al., 2010). The models reproduce several human signatures: feature search costs flat effort while conjunction effort climbs with set size; frontier models hold accuracy where mid-tier models collapse to chance; and a resolution control shows the conjunction cost is genuine search rather than difficulty resolving small shapes. They also diverge from humans in informative ways. The target-present effort slope exceeds the target-absent slope, reversing the human ordering; enumeration remains accurate where humans would lose count; and a reasoning model with adaptive deliberation declines to deliberate on detection tasks altogether, so that a single search expresses itself as an effort gradient in one model and as an accuracy cliff in another. I argue that psychophysical paradigms, applied behaviorally, are a sharp and inexpensive probe of machine visual cognition, and that the points of divergence are as informative as the points of agreement.

Table of Contents

cs.CL [Back]

[1] Graph-Based Phonetic Error Correction of Noisy ASR cs.CL | cs.SDPDF

[2] Hybrid-IR: Dual-Path Hybrid Retrieval with Iterative Reasoning for Complex Medical Question Answering cs.CLPDF

[3] Efficient and Trainable Language Model Test-Time Scaling via Local Branch Routing cs.CLPDF

[4] Beyond Next-Observation Prediction: Agent-Authored World Modeling for Sequential Decision Making cs.CLPDF

[5] PolicyAlign: Direct Policy-Based Safety Alignment for Large Language Models cs.CLPDF

[6] Riazi-8B: An Urdu Large Language Model for Mathematical Reasoning cs.CLPDF

[7] MedGuards: Multi-Agent System for Reliable Medical Error Detection and Correction cs.CLPDF

[8] OPERA: Aligning Open-Ended Reasoning via Objective Perplexity-based Reinforcement Learning cs.CLPDF

[9] Overview of HIPE-2026: Person-Place Relation Extraction from Multilingual Historical Texts cs.CL | cs.AIPDF

[10] SpeechEQ: Benchmarking Emotional Intelligence Quotient in Socially Aware Voice Conversational Models cs.CL | cs.AI | cs.SDPDF

[11] Why Multi-Step Tool-Use Reinforcement Learning Collapses and How Supervisory Signals Fix It cs.CL | cs.LGPDF

[12] Same Evidence, Different Answer: Auditing Order Sensitivity in Multimodal Large Language Models cs.CL | cs.CV | cs.LGPDF

cs.CV [Back]

[13] Yuvion VL: A Multimodal Foundation Model for Adversarial Content and AI Safety cs.CV | cs.AIPDF

[14] Curvature-Guided Mixing for MLLM Adaptation cs.CV | cs.LGPDF

[15] Chorus II: Cross-Request Sparsity Reuse for Efficient Image-to-Video Generation cs.CVPDF

[16] Are We There Yet? Exploring the Capabilities of MLLMs in Assistive AI Applications cs.CVPDF

[17] MJEPA: A Simple and Scalable Joint-Embedding Predictive Architecture for Audio-Visual Learning cs.CV | cs.LGPDF

[18] Wan-Streamer v0.1: End-to-end Real-time Interactive Foundation Models cs.CV | cs.AI | cs.GR | cs.SDPDF

[19] Reflective VLA: In-Context Action Consequences Make VLAs Generalize cs.CV | cs.ROPDF

[20] OrthoTrack: Continuous 6-DoF UAV Trajectory Estimation Anchored in Public Orthophotos cs.CVPDF

[21] Multilingual Hematology Visual Question Answering Dataset cs.CV | cs.CLPDF

[22] Heterogeneous and Adept Snapshot Distillation for 3D Semantic Segmentation cs.CV | cs.AIPDF

[23] MRI2Rep: Autoregressive Structured Report Generation for 3D Liver MRI cs.CVPDF

[24] KidRisk: Benchmark Dataset for Children Dangerous Action Recognition cs.CVPDF

[25] Physics Question Scene Graph: Fine-grained Evaluation of Physical Plausibility in Text-to-Video Generation cs.CV | cs.AIPDF

[26] ESTANet: Efficient Online Error Detection in Procedural Videos via Prediction Inconsistency cs.CV | cs.AIPDF

[27] LEVIRDet: A Million-Scale 159-Category Dataset and Foundation Model for Universal Remote Sensing Object Detection cs.CVPDF

[28] REViT: Roto-reflection Equivariant Convolutional Vision Transformer cs.CV | cs.LGPDF

[29] State Space Models Meet Remote Sensing: A Survey cs.CV | cs.LGPDF

[30] Efficient Remote Sensing Instance Segmentation with Linear-Time State Space Distilled Visual Foundation Models cs.CVPDF

[31] V-Zero: Answer-Label-Free On-Policy Distillation with Contrastive Evidence Gating for Fine-Grained Visual Reasoning cs.CVPDF

[32] Follow Your Track: Precise Skeleton Animation Controlled by 3D Trajectories cs.CVPDF

[33] Invoice Haystack: Benchmarking Document Retrieval and Visual Question Answering Under Strong Visual Homogeneity cs.CVPDF

[34] Beyond Visual Forensics: Auditing Multimodal Robustness for Synthetic Medical Image Detection cs.CV | cs.AIPDF

[35] Teach-to-Reason: Competition-Guided Reasoning with a Self-Improving Teacher cs.CVPDF

[36] PRISM: Feed-Forward Single-Image 3D Reconstruction via Geometric Warp-Residual Modeling cs.CVPDF

[37] Gastroendoscopy View Synthesis: A New Real Dataset and Evaluation cs.CVPDF

[38] LinStereo: Linear-Complexity Global Attention for Multi-Scale Iterative Stereo Matching cs.CVPDF

[39] EchoStyle: Unlocking High-Fidelity Video Stylization with Reverse Data Synthesis cs.CV | cs.AIPDF

[40] C3-Bench: A Context-Aware Change Captioning Benchmark cs.CV | cs.AIPDF

[41] Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models cs.CV | cs.LGPDF

[42] TACO: Towards Task-Consistent Open-Vocabulary Adaptation in Video Recognition cs.CVPDF

[43] HG-Bench: A Benchmark for Multi-Page Handwritten Answer-Region Grounding in Automated Homework Assessment cs.CV | cs.AIPDF

[44] C2RM-Seg: Causal Counterfactual Reasoning with Structural-Semantic Priors for Weakly Supervised Histopathological Tissue Segmentation cs.CVPDF

[45] Spatio-Temporal Mixture-of-Modality-Experts Diffusion for Quantitative DCE-MRI Synthesis from Incomplete MR Sequences cs.CVPDF

[46] Disease-Centric Vision-Language Pretraining with Hybrid Visual Encoding for 3D Computed Tomography cs.CVPDF

[47] SAC$^2$-Net: Semantic Anchoring and Complementary-Consensus Fusion for Multimodal Micro-Expression Recognition cs.CVPDF

[48] H-Adapter: Pose-Robust Hairstyle Transfer via Attention-Derived, Source-Aligned Hair Masks cs.CVPDF

[49] FeVOS: Foresight Expression Video Object Segmentation cs.CVPDF

[50] VPA-Guard: Defending and Benchmarking Image-to-Video Generation Against Visual Prompt Attacks cs.CVPDF

[51] Expresso-AI: Explainable Video-Based Deep Learning Models for Depression Diagnosis cs.CV | cs.AI | cs.LGPDF

[52] SSMNBench: Diagnosing Image-based Cross-View Human-Object Understanding via Single-View Sufficiency and Multi-View Necessity cs.CVPDF

[53] Towards a Dynamic and Fixed-budget Memory Bank for Efficient Streaming Video Understanding cs.CVPDF

[54] Steering Vision-Language Models with Joint Sparse Autoencoders cs.CV | cs.AIPDF

[55] Falcon: Functional Assembly and Language for Compositional Reasoning in X-ray cs.CVPDF

[56] UniTeD: Unified Temporal Diffusion for Joint Perception and Planning in Autonomous Driving cs.CVPDF

[57] What Does the Brain See? Multiview Neural Representations to Demystify the Brain-Visual Alignment cs.CVPDF

[58] Point Cloud Diffusion with Global and Local Reconstruction for Instance-Level 3D Anomaly Detection cs.CV | cs.AIPDF

[59] Dual Distribution Estimation for Zero-shot Noisy Test-Time Adaptation with VLMs cs.CVPDF

[60] ShutterMuse: Capture-Time Photography Guidance with MLLMs cs.CVPDF

[61] Edges Before Embeddings: A Confidence-Aware Blur Gate for Vision-Language Pipelines cs.CV | cs.AIPDF

[62] Graph it first! Enabling Reasoning on Long-form Egocentric Videos through Scene Graphs cs.CVPDF

[63] USS: Unified Spatial-Semantic Prompts for Embodied Visual Tracking with Latent Dynamics Learning cs.CVPDF

[64] Naturalness Predicts but Does Not Cause Transferability in Image Encodings of Real-World Streams cs.CVPDF

[65] Enhancing Brain MRI Anomaly Detection and Reasoning with ROI Rethink and Synthetic Data cs.CV | cs.AIPDF

[66] OracleAnalyser: Analysing Implicit Semantics of Oracle Bone Scripts through MLLMs with Post-training cs.CV | cs.MMPDF

[67] SurgAtlas: A Large-Scale Surgical Video-Language Dataset with 2,391 Hours of Open and Minimally Invasive Surgery cs.CVPDF

[68] How Robust is OCR-Reasoning? Evaluating OCR-Reasoning Robustness of Vision-Language Models under Visual Perturbations cs.CV | cs.CLPDF

[69] MVTrack4Gen: Multi-View Point Tracking as Geometric Supervision for 4D Video Generation cs.CVPDF

[70] DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generation cs.CVPDF

[71] TriViewBench: Controlled Complexity Scaling for Multi-View Structural Reasoning in MLLMs cs.CV | cs.AIPDF

[72] TryOnCrafter: Unleashing Camera Trajectories for Realistic Video Virtual Try-on via a Renderable 4D Try-on Proxy cs.CVPDF

cs.RO [Back]

[73] RAVEN: Long-Horizon Reasoning & Navigation with a Visuo-Spatio-Temporal Memory cs.RO | cs.AI | cs.CLPDF

[74] Toward Low-Latency Vision-Language Models with Doubly-Correct Predictions in Egocentric Visual Understanding cs.RO | cs.CVPDF

[75] fARfetch: Enabling Collocated AR-HRC in Large Visually Diverse Environments with VLM-Driven AR Content Adaptation cs.RO | cs.CV | cs.HCPDF

[76] An Integrated Hardware-Software Design for Low-Data Spatial Defect Detection in Robotic Visual Inspection with Hybrid Optoelectronic Neural Networks cs.RO | cs.CVPDF