cs.CL [Total: 15]
cs.CV [Total: 82]
cs.IR [Total: 3]
cs.RO [Total: 6]
cs.HC [Total: 1]
eess.IV [Total: 3]
cs.LG [Total: 6]
stat.ML [Total: 1]
cs.AI [Total: 7]
cs.CY [Total: 1]
physics.ao-ph [Total: 1]

cs.CL [Back]

[1] Position Encoding in Transformers: From Absolute and Relative Methods to Rotary Position Embeddings and Long-Context Scaling cs.CLPDF

Jiguo Li

TL;DR: 本文是一篇关于Transformer中位置编码的技术综述，系统梳理了从绝对位置嵌入、相对位置表示到旋转位置嵌入（RoPE）及其长上下文扩展方法的发展脉络。文章重点分析了RoPE如何将绝对位置索引转换为查询-键内积中的相对相位差，并比较了不同方法在位置注入方式、计算成本、KV缓存兼容性和长度外推等方面的特性。

Details

Motivation: 自注意力机制本身不编码词元顺序，位置编码旨在解决这一限制，为Transformer引入位置信息以建模序列顺序。

Result: 文章未报告具体定量结果，但系统比较了各类位置编码方法（如RoPE、ALiBi、Transformer-XL等）及其长上下文扩展技术（如位置插值、NTK感知缩放、YaRN、LongRoPE等）的特性、计算开销和长度外推能力。

Insight: 核心创新在于对RoPE机制的数学推导及其作为连接绝对与相对位置编码桥梁的洞察；关键结论是训练长度外的位置计算能力不等于可靠的长上下文泛化，必须通过短上下文保留、逐位置困惑度、检索、推理和长上下文代码任务进行评估。

Abstract: Self-attention models content-dependent interactions between tokens but does not by itself encode token order. Position encoding addresses this limitation by introducing absolute coordinates, relative distances, or position-dependent rotations into Transformer representations and attention scores. This technical survey develops a unified account of sinusoidal and learned absolute position embeddings, Shaw-style relative position representations, Transformer-XL, T5 relative position bias, ALiBi, and Rotary Position Embeddings (RoPE). We derive how RoPE converts absolute position indices into relative phase differences in Query-Key inner products and compare these methods in terms of where position is injected, computational cost, compatibility with KV caching, and length extrapolation. We then examine long-context extensions, including Position Interpolation, RoPE scaling laws, NTK-aware scaling, Dynamic NTK, NTK-by-parts, YaRN, LongRoPE, and LongRoPE2, with emphasis on frequency allocation, attention rescaling, training length, and target context length. We also summarize implementation considerations, evaluation protocols, and position-encoding choices in representative large language models. A central conclusion is that the ability to compute positional features beyond the training length does not imply reliable long-context generalization; context extension must be evaluated through short-context retention, position-wise perplexity, retrieval, reasoning, and long-context code tasks.

[2] When Chain-of-Thought Helps and When It Hurts: An Empirical Investigation of the Serial-Depth Bottleneck in LLM Reasoning cs.CL | cs.AI | cs.LGPDF

Tughanbulut Kurtulush

TL;DR: 本文通过实证研究探讨了思维链（CoT）提示在LLM推理中的效果，发现其并非普遍有效，而是取决于任务的串行计算深度。研究基于H_dp带宽限制框架，在三个指令调优模型和五个NLP基准上进行了实验，揭示了CoT在高深度任务（如GSM8K、MATH）中显著提升性能，在浅层任务（如MMLU、ARC）中则结构冗余，而在中等深度任务（如HumanEval）中效果受模型大小影响。

Details

Motivation: 动机是挑战“思维链提示普遍提升LLM推理”的广泛假设，通过H_dp带宽限制框架，探究CoT在何种任务条件下真正有效，以识别其作为串行计算外部化机制的本质。

Result: 实验结果显示，在高深度P完全任务（GSM8K、MATH）上，CoT带来+54到+68个百分点的恢复差距；在浅层TC^0任务（MMLU、ARC）上，CoT结构冗余（变化在[0.0, +4.6]个百分点，无显著负效应）；在中等深度L类任务（HumanEval）上，效果依赖模型大小（32B模型+23.2个百分点，8B模型+9.1个百分点，7B模型-28.7个百分点）。跨基准的深度恢复相关性为Spearman rho=0.661（p=0.007）。

Insight: 创新点在于提出串行深度梯度概念，将CoT视为带宽旁路机制，而非通用增强器；客观分析表明，CoT仅在任务超出单次通过容量时有效，这为优化提示策略提供了理论依据，并强调了任务架构匹配的重要性。

Abstract: It is widely assumed that chain-of-thought (CoT) prompting universally improves LLM reasoning. We investigate this through the conceptual framework of the H_dp bandwidth bound (Chen et al., 2024): although the formal bound binds only asymptotically (at astronomically large prompt lengths), it identifies a real architectural bottleneck – serial computation exceeding a transformer’s single-pass capacity must be externalised, which is what CoT does. Our central finding is a within-benchmark serial-depth gradient: single-pass (no-CoT) accuracy degrades monotonically with per-item serial depth, while CoT is approximately depth-invariant. We measure CoT effects across three instruction-tuned models (Qwen-2.5-7B/32B, Llama-3.1-8B) and five standard NLP benchmarks at practical context lengths. On high-depth P-complete tasks (GSM8K, MATH), CoT gives a +54 to +68 pp recovery gap across all models. On shallow TC^0 tasks (MMLU, ARC), CoT is structurally redundant (Delta in [0.0, +4.6] pp, no significant negative effect) – though high no-CoT baselines (up to 95% on ARC) may reflect contamination, so this null is not a clean architectural test. The intermediate class L (HumanEval) shows a model-size-dependent transition: +23.2 pp (32B), +9.1 pp (8B), -28.7 pp (7B). The cross-benchmark depth-recovery correlation is Spearman rho = 0.661 (p = 0.007, n = 15); 9 of 15 benchmark-level McNemar tests are significant after Bonferroni correction. Pre-registered on OSF, our results indicate that CoT is not a universal reasoning enhancer but acts as a bandwidth bypass: it helps serial computation that strains single-pass capacity and is redundant for tasks that already fit.

[3] Multimodal Item Parameter Estimation using Simulated Response Probabilitie cs.CL | cs.AIPDF

Christopher Ormerod, YoungKoung Kim

TL;DR: 该研究利用基于Qwen3.5微调的多模态大语言模型（LLM），通过模拟学生对包含图文刺激的多选题的作答概率，成功重建了多项选择模型（MCM）和三参数逻辑斯蒂（3PL）模型的项目反应曲线。模型在给定学生能力标签的条件下进行训练，学习重现不同能力水平学生的系统性错误模式，从而隐式地捕获了3PL和MCM曲线中编码的潜在反应概率。这使得研究者能够直接从模型的预测选项概率中，在测试集上准确地近似估计项目难度。

Details

Motivation: 研究动机是利用多模态LLM的强大模式学习能力，通过模拟学生的作答行为来隐式地估计经典心理测量学模型（如3PL和MCM）的项目参数，特别是项目难度，从而探索一种新的、数据驱动的项目参数估计方法。

Result: 论文表明，经过微调的LLM能够准确地近似在测试集上评估的项目难度，其预测直接来源于模型生成的选项概率，这验证了该方法在重建项目反应曲线和估计关键参数上的有效性。

Insight: 创新点在于将多模态LLM应用于心理测量学领域，通过“模拟学生作答”这一代理任务来隐式学习复杂的项目反应理论模型参数，为结合深度学习与传统测量模型提供了新思路。从客观角度看，该方法避免了直接拟合复杂模型的数学形式，而是利用LLM的通用逼近能力从数据中学习映射关系。

Abstract: We present results from reconstructing multiple-choice model (MCM) and three-parameter logistic (3PL) model curves using a fine-tuned multimodal large language model (LLM) based on Qwen3.5. The model is prompted and fine-tuned to replicate choice probabilities across a large training corpus of multiple-choice items containing both image and text stimuli, conditioned on a labeled set of student ability levels. By learning to reproduce the systematic error patterns of students across a discrete range of abilities, the LLM implicitly captures the underlying response probabilities encoded in the 3PL and MCM curves. This allows us to accurately approximate item difficulty on a held-out test set directly from the model’s predicted option probabilities.

[4] Is This Your Final Answer? Cross-Contextual Consistency as a Measure of LLM Credibility cs.CL | cs.AIPDF

Siyang Wu, Yibo Jiang, Bryon Aragam

TL;DR: 该论文提出了一种评估大型语言模型可信度的新方法——跨上下文一致性（C3），通过比较模型在原始提示和经过主题对齐、内容中性扰动后的提示下的生成答案来衡量其稳定性。研究发现，在26个模型和涵盖推理、事实性和代码生成的六个基准测试中，跨上下文变化较小的答案更可能是正确或符合事实的。

Details

Motivation: 动机在于大型语言模型是强大的黑盒系统，难以判断其答案是基于稳定的内部信念还是表面的模式匹配，因此需要一种方法来衡量其回答的可信度。

Result: 在多个基准测试（如推理、事实性和代码生成）上，跨上下文一致性（C3）与答案正确性正相关，并能作为基准测试的有用诊断工具，识别出即使在总体分数“饱和”时仍具信息性的部分。

Insight: 创新点在于将跨上下文一致性定义为衡量LLM可信度的行为属性，并操作化为一种评估方法，这为模型评估提供了补充维度，有助于揭示基准测试的局限性。

Abstract: Large language models (LLMs) are powerful black-box systems, making it difficult to discern whether their answers reflect stable internal beliefs or superficial pattern matching. We identify cross-contextual consistency as an underutilized behavioral property of LLMs: a credible answer should remain stable when the same task is placed under topic-aligned, content-neutral contextual variation. Building on this intuition, we operationalize Cross-Contextual Consistency (C3) by comparing model generations under original and perturbed prompts. Across 26 models and six benchmarks spanning reasoning, factuality, and code generation, we find that answers with smaller cross-contextual shifts are more likely to be correct or factual. We demonstrate that C3 provides a complementary axis of evaluation and can serve as a benchmark usefulness diagnostic, identifying which portions of a benchmark remain informative even when aggregated scores are widely considered “saturate”.

[5] VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback? cs.CLPDF

Mizanur Rahman, Arshia Azimlu, Shadikur Rahman, Md Tahmid Rahman Laskar, Amran Bhuiyan

TL;DR: 本文介绍了VisEditBench，一个包含1,395个人工标注任务的新基准，用于评估视觉语言模型（VLMs）根据多模态反馈（如文本反馈或目标图表图像）编辑可视化代码的能力。研究评估了20个最先进的VLMs，发现可视化代码编辑仍具挑战性，并提出了一个基于渲染的迭代编辑框架VisEditAgent来提升性能。

Details

Motivation: 现有的基准主要评估从头生成可视化代码，而现实中的可视化创作是迭代的，用户经常需要根据多模态反馈（如错误的图表和文本反馈）来修改现有可视化。目前，从多模态反馈进行可视化代码编辑的能力尚未得到充分探索和评估。

Result: 在VisEditBench上评估20个SOTA VLMs，Claude-4.6-Sonnet取得了最佳总体通过率74.46%，但大多数开源模型低于50%。在视觉引导的风格适应任务上表现尤其弱（Claude-4.6-Sonnet为55.71%）。提出的基线方法VisEditAgent（基于GPT-4o）将总体通过率从55.75%提升至67.99%。

Insight: 论文的创新点在于提出了首个专注于从多模态反馈进行可视化代码编辑的基准VisEditBench，并揭示了当前VLMs在此任务上的不足。一个关键的工程洞见是，引入一个基于渲染的、迭代生成-执行-验证-精炼的代理框架（VisEditAgent）能有效利用执行反馈来提升编辑的忠实度。

Abstract: Vision-language models (VLMs) have shown strong capabilities in generating visualization code from textual or visual specifications. However, real-world visualization authoring is inherently iterative: users frequently revise existing visualizations to repair flawed charts or adapt them to desired styles. Existing benchmarks primarily evaluate generation from scratch, leaving visualization code editing from multimodal feedback largely unexplored. We introduce VisEditBench, a benchmark of 1,395 human-annotated visualization code-editing tasks grounded in realistic visualization workflows and failure cases. VisEditBench covers two practical settings: feedback-guided repair, where models revise visualization code using buggy or marked charts together with textual feedback, and reference-guided restyling, where models modify code to match a target chart image. Evaluating 20 state-of-the-art VLMs reveals that visualization code editing remains challenging: Claude-4.6-Sonnet achieves the best overall pass rate of 74.46%, while most open-source models remain below 50%. Performance is particularly weak on visually grounded style adaptation, where Claude-4.6-Sonnet achieves only 55.71%. To establish a strong baseline, we further propose VisEditAgent, a render-grounded editing framework that iteratively generates, executes, validates, and refines candidate edits. Built on GPT-4o, VisEditAgent improves overall pass rate from 55.75% to 67.99%, demonstrating the importance of render-grounded feedback for faithful visualization editing. We will release VisEditBench at https://github.com/vis-nlp/VisEditBench.

[6] From Reasoning Depth to Reasoning Breadth: Evaluating Multi-Point Associative Reasoning in Large Language Models cs.CL | cs.AIPDF

Si’an Xie, Jiaxun Liu, Biao Yang, Wei Yuan, Fan Yang

TL;DR: 本文提出了MPAR-Bench，一个用于评估大语言模型多维度关联推理能力的双语基准测试。该基准通过模拟合作游戏‘Just One’的形式，要求模型从多个独立生成且语义多样的线索中恢复隐藏目标，从而隔离并评估‘推理广度’这一能力。研究发现，现有模型在应对线索扰动时表现脆弱，且更深的推理深度并不自动带来更稳健的推理广度。

Details

Motivation: 大语言模型在需要长推理链的任务上进步显著，但这主要反映了‘推理深度’。一个互补且相对未被充分研究的能力是‘推理广度’，即并行探索多个语义方向并将线索整合成一致答案。本文旨在评估模型在这方面的能力。

Result: 在MPAR-Bench上评估了多个模型，发现各种扰动（如线索掩码、顺序打乱、干扰项注入等）使英文准确率下降9-18个百分点，中文下降5-12个百分点。思维链模式能提升标准设置下的准确率，但并不能持续降低对扰动的敏感性。

Insight: 创新点在于提出了一个专门评估‘推理广度’的新基准MPAR-Bench，其通过多智能体线索生成、基于嵌入的多样性过滤和人工验证来构建。客观来看，该工作揭示了当前基准测试未能充分覆盖推理广度，且模型的深度推理能力与广度推理的鲁棒性之间存在脱节，这对未来模型评估和设计具有启发意义。

Abstract: Large language models (LLMs) have made substantial progress on reasoning tasks that require increasingly long and complex inferential chains. This progress primarily reflects reasoning depth. A complementary and comparatively unexamined capability is reasoning breadth: exploring multiple semantic directions in parallel and integrating the resulting clues into one coherent answer. We introduce MPAR-Bench, a bilingual English-Chinese benchmark that isolates reasoning breadth through multi-point associative reasoning. Inspired by the cooperative game Just One, each item asks a model to recover a hidden target from several independently generated, semantically diverse clues. We construct 1,000 items using a multi-agent clue-generation pipeline, embedding-based diversity filtering, and human verification. Only the answer space is drawn from public word lists, whereas every clue set is generated from scratch. Beyond exact-match accuracy, we evaluate models using accuracy, ANLS, embedding similarity, reasoning-trace verification, and four perturbations: clue masking, order shuffling, distractor injection, and multi-step clues. Across evaluated models, perturbations reduce accuracy by 9-18 percentage points in English and 5-12 percentage points in Chinese. Thinking mode improves standard-setting accuracy, especially in English, but does not consistently reduce sensitivity to perturbations. Case-level analysis also shows that extended reasoning can overturn an initially correct hypothesis. These results indicate that greater reasoning depth does not automatically confer robust reasoning breadth, and that reasoning breadth remains largely uncovered by current benchmarks.

[7] Calibrating Post-Training Feature Shifts for LLM Data Contamination Detection cs.CLPDF

Zhen Yang, Mengqi Wang, Gengda Zhao, Mo Zhou, Jianwei Wang

TL;DR: 本文提出CalibDCD校准框架，用于解决大语言模型（LLM）后训练（如指令微调、偏好优化）导致的特征偏移问题，从而提高数据污染检测（DCD）的准确性。该框架通过多视图偏移检测识别后训练引起的重复性特征偏移，并通过有界特征校正选择性减轻这些偏移对成员预测的影响。

Details

Motivation: 现有基于特征的DCD方法依赖模型输入和输出的特征来检测文本是否属于预训练语料，但LLM的后训练过程会改变模型输出并导致成员特征发生偏移，从而降低成员与非成员文本的可分离性。

Result: 实验表明，CalibDCD能持续改进现有基于特征的检测器，在AUC指标上最高提升7.0%，在TPR@5%FPR指标上最高提升15.0%。

Insight: 创新点在于提出针对后训练特征偏移的通用校准框架，通过多视图分析和有界校正来区分后训练引起的系统性偏移与真正的成员信号，为DCD方法提供了应对模型演化的鲁棒性解决方案。

Abstract: Large language models (LLMs) are trained on massive and largely undisclosed corpora that may contain copyrighted or privacy-sensitive content. Data contamination detection (DCD) therefore aims to determine whether a given text is a member of the pre-training corpus of a target LLM. Recent state-of-the-art DCD methods follow a feature-based paradigm that derives membership features from the input text and the corresponding model output. However, most modern LLMs undergo post-training, such as instruction tuning, preference optimization, and reasoning-oriented training, which can alter model outputs and shift the corresponding membership features, thereby reducing the separability between members and non-members. To address this problem, we propose CalibDCD, a broadly applicable calibration framework for feature-based DCD methods, comprising (1) Multi-View Shift Detection, which identifies recurring feature shifts associated with post-training, and (2) Bounded Feature Correction, which selectively mitigates their influence on membership prediction. Specifically, Multi-View Shift Detection evaluates controlled prompt variants on known non-member texts and consolidates the most informative views to identify recurring feature shifts. Bounded Feature Correction selectively adjusts feature components aligned with the detected shifts and controls the correction extent to preserve useful detection information. Experiments show that CalibDCD consistently improves existing feature-based detectors, with gains of up to 7.0% in AUC and 15.0% in TPR@5%FPR.

[8] Dual-Loop Self-Evolution via Verifiable Emotion Feedback for Multi-Turn Empathetic Dialogue cs.CLPDF

Yi Wei, Shuo Jiang, Huaixia Dou, Jie Zhu, Junhui Li

TL;DR: 本文提出了一种基于可验证情感反馈的双循环自进化框架，用于提升多轮共情对话能力。该框架通过内循环优化多轮对话策略，外循环调整训练经验分布，解决了策略能力与训练经验不匹配的问题，并在SAGE基准上显著提升了Qwen3-8B模型的性能。

Details

Motivation: 现有方法在进化对话策略时，其训练交互分布保持固定，导致策略能力与训练经验之间出现不匹配，限制了多轮共情对话的长期效果。

Result: 在SAGE基准测试中，该框架将Qwen3-8B模型的Overall分数从53.87提升至79.24，比协议匹配的均匀情感奖励强化学习方法高出7.23分。

Insight: 创新点在于通过双循环结构（内循环优化策略、外循环适应经验）和基于组通过率边界优先级的采样方法，实现了策略与经验的协同进化，且未增加计算预算。

Abstract: Large language models have demonstrated conversational capabilities, yet empathetic competence remains challenging. Empathetic support is inherently multi-turn and path-dependent: users disclose concerns gradually, emotions evolve over time, and early responses shape trust and receptivity. Reinforcement learning with verifiable emotion rewards provides scalable supervision for long-horizon interactions. However, existing methods evolve the dialogue policy while keeping its training interaction distribution fixed, creating a mismatch between policy competence and training experience. We introduce a dual-loop self-evolution framework driven by verifiable emotion feedback. With the user simulator and verifier frozen, the inner loop optimizes the multi-turn policy using continuous emotion rewards, while the outer loop uses the same outcomes to estimate policy-relative interaction utility and adapt experience. To obtain estimates from sparse, stochastic rollouts, the framework holds the scenario and interaction state constant within each group and prioritizes conditions whose group pass rates lie near the policy’s competence boundary. A hierarchical controller shares evidence across support intents, while uncertainty-guided exploration and uniform rehearsal prevent premature exclusion. The resulting distribution generates trajectories, closing both loops without increasing the rollout budget. On SAGE, our framework raises Qwen3-8B Overall from 53.87 to 79.24 and outperforms protocol-matched uniform emotion-reward reinforcement learning by 7.23 points.

[9] SPIEval: Evaluating Large Language Models as Mobile Assistants over Scattered Personal Information cs.CL | cs.AIPDF

Junjie Ye, Zhuohui Sheng, Shaofan Liu, Yulun Zhu, Wenjie Fu

TL;DR: 本文介绍了SPIEval，一个用于评估大型语言模型（LLMs）作为移动助手处理分散在多应用中的个人信息能力的人工标注基准。该基准基于五种认知能力构建，包含250个任务和4,335条个人记录，支持多轮工具交互。评估发现当前LLMs表现不佳，最佳模型准确率仅为57.3%，并揭示了信息定位不准确和检索效率低下等关键问题。

Details

Motivation: LLMs越来越多地被部署为移动助手，但其利用分散在多个应用中的个人信息来完成用户指令的能力尚不明确，缺乏专门的评估基准。

Result: 在SPIEval基准上评估了九个代表性LLM，最佳模型GPT-5.5 (xhigh)的准确率仅为57.3%，最弱模型为16.4%，表明有巨大的改进空间。

Insight: 论文的创新点在于构建了首个针对移动助手场景中处理分散个人信息的专用基准SPIEval，并系统性地定义了五种关键认知能力进行评估。客观分析发现，其揭示了当前LLM助手失败的主要原因是信息定位不准确（占79%），且极少使用高级搜索方法（<2%），这为未来研究方向提供了具体洞见。

Abstract: Large language models (LLMs) are increasingly deployed as mobile assistants, where a key challenge is leveraging personal information scattered across multiple applications (apps) to complete user instructions. However, due to the lack of dedicated benchmarks, their capabilities remain poorly understood. To address this gap, we introduce SPIEval, a human-curated benchmark grounded in five cognitive capabilities (i.e., reasoning, disambiguation, integration, preference inference, and multi-intent decomposition). SPIEval comprises 250 tasks spanning 4,335 personal records distributed across 10 apps and supports multi-turn interaction through 21 tools. Analysis shows that the benchmark exhibits diverse scenarios, challenging tasks, scattered information, controllable environments, and verifiable outcomes. We evaluate nine representative LLMs and find substantial room for improvement. The best-performing model, GPT-5.5 (xhigh), achieves only 57.3% accuracy, while the weakest achieves just 16.4%. Further analysis reveals that 79% of failures stem from inaccurate information localization, as LLMs often commit to plausible but incorrect information instead of continuing retrieval for verification. We also find that fewer than 2% of retrieval actions employ advanced search methods and observe substantial variation in search efficiency across models. These findings expose fundamental limitations of current LLM-based mobile assistants and motivate future research in this direction. Data and code are available at https://huggingface.co/datasets/Junjie-Ye/SPIEval.

[10] Surfacing the Unsaid: CUE-Bench for Affective Stance in Chinese Discourse cs.CL | cs.AIPDF

Zhenyan Zheng, Yunyao Zhang, Junxi Sheng, Junqing Yu, Zikai Song

TL;DR: 本文介绍了CUE-Bench，一个专注于中文话语中情感立场（Affective Stance）的基准测试。该基准旨在解决现有情感理解评测主要关注表面情感极性或最终情感类别，而缺乏对显性表达、隐性情感、语用意图和细粒度情感之间结构化交互分析的局限性。它通过构建九种人类可解释的情感立场，并辅以意图和细粒度情感标注，来支持结构化的情感推理。

Details

Motivation: 现有情感理解基准主要标注表面极性或最终情感类别，缺乏对显性表达、隐性情感、语用意图和细粒度情感之间如何交互的结构化描述，导致评测对情感意义被隐藏、弱化、反转或语用重塑的情况不敏感，掩盖了模型在更深层情感理解上的失败。

Result: 实验表明，在强基线模型基础上，融入情感立场（Affective Stance）信息后，细粒度情感识别准确率提升了3.5个百分点，语用意图检测准确率提升了7.8个百分点。

Insight: 论文的核心创新在于提出了“情感立场”这一结构化概念，作为连接显性表达、隐性情感、语用意图和细粒度情感的桥梁，并构建了相应的中文评测基准CUE-Bench。这为超越表面情感、深入理解话语中复杂且间接的情感表达提供了新的分析框架和评测标准。

Abstract: Emotion understanding in discourse requires reasoning beyond surface sentiment because speakers often convey affect through indirect, implicit, polite, ironic, or deliberately mismatched expressions. Existing emotion benchmarks mainly annotate surface polarity or final emotion categories, while lacking a structured account of how explicit expression, implicit affect, pragmatic intent, and fine grained emotion interact. This limitation makes current evaluations insensitive to cases where affective meaning is concealed, weakened, inverted, or pragmatically reshaped, thereby obscuring model failures in deeper emotion understanding. To address this gap, we introduce CUE Bench, a Chinese Unsaid Emotion benchmark that centers on Affective Stance and covers diverse communicative scenarios. CUE Bench constructs nine human interpretable affective stances from explicit implicit polarity interaction and further provides intent and fine grained emotion annotations for structured affective inference. Experiments show that incorporating Affective Stance improves fine grained emotion recognition by 3.5 percentage points and pragmatic intent detection by 7.8 percentage points over strong baselines.

[11] Reference-Free Post-Training of Open Large Language Models for Multilingual Machine Translation cs.CL | cs.AIPDF

Chris Han, Pengzhi Gao, Pei Fu, Jian Luan

TL;DR: 本文研究了一种无需参考译文的开放大语言模型多语言机器翻译后训练方法。从监督微调的MiLMMT-46-v0.1模型出发，采用结合了两种无参考质量评估模型平均奖励并经过语言识别门控的组相对策略优化（GRPO）进行强化学习，再通过线性插值监督微调和强化学习模型检查点得到MiLMMT-46-v1.0模型。该方法在46种语言上持续提升了翻译质量。

Details

Motivation: 旨在探索如何对开放大语言模型进行无需参考译文的强化学习后训练，以提升其在多语言机器翻译任务上的性能。

Result: 在46种语言上，最终模型（MiLMMT-46-v1.0）的翻译质量一致优于其监督微调版本，超越了Seed-X、HY-MT2和TranslateGemma等近期强开放基线模型，并在与Google Translate、Gemini 3 Pro和GPT-5等专有系统的无参考评估对比中取得了领先分数。

Insight: 创新点在于提出了一种结合无参考质量评估奖励和语言识别门控的GRPO强化学习后训练框架，并通过检查点插值策略融合监督微调与强化学习模型，有效提升了翻译质量；同时，研究也探讨了策略内蒸馏的潜力及其与当前最优方法的对比。

Abstract: We study reference-free post-training for multilingual machine translation with open large language models. Starting from the supervised-finetuned MiLMMT-46-v0.1 models, we apply Group Relative Policy Optimization (GRPO) with a reward that averages two reference-free quality estimation models and is gated by language identification. We then linearly interpolate the supervised fine-tuning (SFT) and reinforcement learning (RL) model checkpoints to obtain MiLMMT-46-v1.0. Across 46 languages, the resulting models consistently improve translation quality over their SFT counterparts, outperform strong recent open baselines, including Seed-X, HY-MT2, and TranslateGemma, and achieve leading reference-free scores against evaluated proprietary systems such as Google Translate, Gemini 3 Pro, and GPT-5. We further investigate on-policy distillation and find that it reaches, but does not surpass, the quality frontier achieved by RL with checkpoint interpolation. We release the models and code to facilitate future research.

[12] FaithformBench: Benchmarking Faithfulness of Mathematical Chain-of-Thought Autoformalisation cs.CL | cs.AI | cs.LOPDF

Rob Cornish, Iacopo Ghinassi, Po-Hung Yeh, Shuqi Liu, Qiyuan Xu

TL;DR: 本文提出了FaithformBench，一个用于评估数学链式思维自动形式化系统忠实性的新基准。该方法通过自动生成扰动推理步骤来测试系统对正确和错误输入的忠实性，发现现有系统普遍存在‘奉承’现象，即会将无效输入‘静默修正’为可证明的陈述。

Details

Motivation: 现有评估自动形式化系统忠实性的方法依赖昂贵的人工标注或准确性有限的LLM判断，且通常只考虑正确输入，无法评估系统对错误输入的忠实性。

Result: 在四个数学数据集上对八个自动形式化系统进行评估，发现普遍存在奉承行为；最保持有效性的微调系统同时也是最奉承的，表明当前系统中保持有效性与保持无效性之间存在张力。

Insight: 创新点在于提出了一种廉价、基于弱假设可靠且能同时评估正负样例的忠实性基准方法，通过自动生成扰动步骤来系统性地测试形式化系统对输入有效性的保持能力，揭示了当前系统在忠实性上的关键缺陷。

Abstract: Autoformalisation (AF) systems map natural language reasoning steps into formal statements in a proof assistant such as Lean. We consider how to assess the faithfulness of these systems. Existing approaches require expensive human-annotated ground truth, or rely on LLM judges or embedding models, which come with limited guarantees of accuracy. In addition, these methods typically only consider inputs that are known to be correct, and therefore do not assess whether the AF translates incorrect inputs faithfully. To address these limitations, we propose a new benchmark for AF faithfulness that is cheap to apply, sound under weak assumptions, and assesses both positive and negative examples. Our method is based on automatically generating perturbed reasoning steps that are designed to be invalid, and then measuring validity preservation on unperturbed steps and invalidity preservation on perturbed steps. We apply our method to eight AF systems across four mathematical datasets, and observe pervasive sycophancy: many AFs “silently correct” invalid inputs into provable statements. The most validity-preserving fine-tuned AFs are also the most sycophantic, suggesting a tension between validity and invalidity preservation in current AF systems.

[13] MUSE: A Full-Text Cross-Domain Knowledge Base of Scientific Problems, Solutions, and Rationales cs.CLPDF

Tsofia Cohen, Tom Hope

TL;DR: MUSE是一个基于科学论文全文构建的跨领域知识库，专注于提取问题-解决方案-原理三元组，包含专家标注的579个段落和自动扩展的37K个三元组，并探索了利用原理监督提升LLM解决复杂科学问题的能力。

Details

Motivation: 科学论文中蕴含了细粒度的问题解决记录，包括技术障碍、解决方法及选择理由，但缺乏系统化的资源来捕捉这些结构化的知识。

Result: 构建了包含37K个高质量、有来源依据的P-S-R三元组知识库；初步实验表明，在复杂多约束问题上，原理监督能提升LLM性能，但在简单问题上可能有害。

Insight: 创新点在于提出了问题-解决方案-原理的细粒度标注框架和模块化提取流程，为科学问题解决提供了可解释的结构化知识资源；原理监督对复杂任务的有效性揭示了任务适应性监督的重要性。

Abstract: Scientific papers contain fine-grained records of problem solving: authors mention technical obstacles and methods that were used to address them, often along with reasoning on why those methods were chosen. We introduce MUSE (Mining Underlying Scientific Explanations), a full-text, multi-domain resource of scientific Problem-Solution-Rationale (P-S-R) triplets. We curate 579 expert-annotated full-text paragraphs, with a rich annotation schema covering salient problem, solution, and rationale spans, solves and rationale_of links and conceptual coreference. A modular extraction pipeline scales this annotation to build a high-quality knowledge base of 37K source-grounded P-S-R triplets. We evaluate the extraction components and include a preliminary experiment training a rationale-supervised LLM for scientific problem solving. Interestingly, we find that rationale supervision improves performance on complex, multi-constraint problems but can harm performance on simpler ones.

[14] REAP: Relation-Aware Elicitation and Parsing for Closed-Book Knowledge Base Construction from LLMs cs.CLPDF

Thanh-Dan Bui, Thanh-Trung Do, Tuan-Phong Nguyen

TL;DR: 本文介绍了REAP系统，该系统用于在封闭书设定下从语言模型中构建知识库，其核心方法结合了结构化思维链推理、关系特定查询策略以及基于推理的空集门控机制，以提取参数化知识并直接解析为有效的JSON数组。

Details

Motivation: 解决在参数预算有限（不超过320亿参数）且不允许微调模型的约束下，如何有效从大型语言模型中提取结构化知识以构建知识库的问题。

Result: 在测试集上，基于Mistral-Small-24B-Instruct-2501模型构建的系统取得了0.62的宏观F1分数，其中在countryLandBordersCountry（F1=0.95）、companyTradesAtStockExchange（F1=0.73）和hasArea（F1=0.77）等关系上表现尤为突出。

Insight: 创新点在于将结构化思维链推理与关系感知的查询策略相结合，并引入基于推理的空集门控来优化知识提取过程，这为在资源受限条件下高效利用LLMs的隐含知识提供了可借鉴的技术路径。

Abstract: We present the REAP system for the AKBC Shared Task 2026 on constructing knowledge bases from language models in a closed-book setting, subject to a budget of at most 32B parameters and no model fine-tuning. Our system combines structured chain-of-thought reasoning, relation-specific query strategies, and a reasoning-based empty-set gate to elicit parametric knowledge, followed by direct extraction into valid JSON arrays. On the test set, the system, built on the Mistral-Small-24B-Instruct-2501 model, achieves a macro-F1 score of 0.62, with particularly strong results on countryLandBordersCountry (F1 = 0.95), companyTradesAtStockExchange (F1 = 0.73), and hasArea (F1 = 0.77). Our code is publicly available at https://github.com/yammdd/AKBC-Shared-Task-2026.

[15] ConRub-Med: Reinforcement Learning with Consensus Rubrics for Open-Ended Medical Question Answering cs.CLPDF

Taojie Zhu, Yuan Xia, Tao Sun, Yizhi Wang, Yan Chen

TL;DR: 本文提出了ConRub-Med方法，通过结合异构语言模型生成共识性评分标准（rubrics）来强化开放式医学问答的强化学习。该方法使用三阶段评分区分正确覆盖、缺失信息和错误主张，并在组相对策略优化（GRPO）中引入成对判断器处理平局情况，从而在多个基准测试中取得最佳性能。

Details

Motivation: 开放式医学问答缺乏廉价且可验证的奖励机制，因为答案可能部分正确、不完整或包含临床错误；虽然医生制定的评分标准具有临床基础，但成本高昂，因此需要可扩展的模型生成评分标准来指导强化学习。

Result: 在盲法研究中，医学专家认为ConRub-Med生成的面板更具临床相关性；在评估的九个基准测试中，该方法在六个上排名第一，并获得了最高的医学和泛化平均分，在HealthBench-Hard上得分为38.98±1.04，优于InfiMed-ORBIT的33.60（8000样本）和37.30（28000样本）。

Insight: 创新点包括使用异构模型独立生成原子标准并通过审查模型达成共识，以及三阶段评分和成对判断器处理GRPO中的平局，这提高了评分标准的可靠性和强化学习的稳定性，为开放式领域提供了可扩展的监督机制。

Abstract: Reinforcement learning with verifiable rewards has been especially effective in mathematics and coding, where answers can be checked automatically. Many open-ended medical questions lack comparably cheap outcome verifiers: responses may be partly correct, incomplete, or contain clinically consequential errors. Rubrics written or validated by physicians offer strong clinical grounding, but involving experts in every instance is costly. Model-generated rubrics make this supervision scalable. We introduce ConRub-Med to preserve useful distinctions as rubric feedback moves from construction to policy optimization. For each prompt, three heterogeneous language models propose atomic criteria independently; a separate model reviews them, retaining only criteria with semantic support from all three generators. Three-State scoring distinguishes correct coverage, missing information, and incorrect claims. Errors receive negative rather than zero credit. When every response in a complete Group Relative Policy Optimization (GRPO) group receives the same final reward, a pairwise judge provides sequence advantages only if both candidate orders agree, without changing the scalar rewards. Groups without ties use vanilla GRPO. In a blinded study matched by question, two medical experts rate panels from the full pipeline as more clinically relevant than panels produced by one generator. Across the evaluated open models, ConRub-Med ranks first on six of nine benchmarks and achieves the highest medical and generalization averages. Using the resulting rubric dataset of 5,166 prompts, it scores $38.98 \pm 1.04$ (mean $\pm$ SD) on HealthBench-Hard, compared with InfiMed-ORBIT’s 33.60 with 8,000 samples and 37.30 with 28,000.

cs.CV [Back]

[16] Signpost Watermarking: Joint Optimization for Visual Watermark Coexistence cs.CVPDF

Shruti Agarwal, Vishal Asnani, John Collomosse

TL;DR: 本文提出了一种名为’Signpost Watermarking’的方法，用于训练不可见的视觉水印，使其能够与其他水印共存。研究表明，通过解码器感知的联合优化目标，可以主动改善图像和视频水印的共存性，从而支持分层来源信号，用于内容真实性和版权保护。

Details

Motivation: 现有独立训练的视觉水印模型虽然能偶然共存，但这种共存是意外属性而非优化目标，导致干扰不可控，可能降低解码鲁棒性或视觉质量。本文旨在通过显式优化来主动控制水印间的共存与干扰。

Result: 实验表明，该方法能有效改善图像和视频水印的共存性，通过联合优化提升了水印解码的鲁棒性。

Insight: 创新点在于将水印共存从偶然属性转变为可优化的目标，通过解码器感知的联合训练框架，为分层来源水印（如指示其他水印系统存在的’路标’水印）提供了实用路径，增强了内容认证和版权保护的能力。

Abstract: We present a method for training imperceptible visual watermarks to coexist with other such watermarks. Recent work has shown that independently trained image watermarking models can coexist with surprisingly limited interference, enabling watermark ensembling. However, this coexistence is a serendipitous property rather than an explicit optimization objective, leaving interference uncontrolled and potentially reducing decoding robustness or visual quality. We first show empirically that the same coexistence property extends to video watermarking. We then show that both image and video watermarks can be trained with a decoder-aware objective to improve coexistence. Our results suggest a practical path to signpost watermarks that indicate the presence of independently deployed provenance watermarking systems, supporting layered provenance signaling for content authenticity and rights.

[17] LEGO: Leveled Language Gaussian Splatting cs.CVPDF

Yuning Peng, Haiping Wang, Yuan Liu, Yipeng Lu, Zhen Dong

TL;DR: LEGO提出了一种用于高级开放词汇场景理解的方法，其核心创新在于捕获场景内在的语义层次结构，并将多视角的SAM分割结果自适应地统一为3D一致的层次结构，进而构建层级语言场景图，以支持大语言模型进行复杂的空间推理和视觉定位。

Details

Motivation: 现有基础模型（如SAM）的2D多粒度分割受限于单一视角且缺乏跨视图一致性，无法直接用于3D场景的层次化语义理解。LEGO旨在解决这一问题，实现3D场景中结构连贯、多层次的开放词汇语义分割。

Result: 实验结果表明，LEGO在可提示和开放词汇的3D分割基准测试中均达到了新的最先进（SOTA）性能，展现了先进的层次化场景分解和上下文感知的空间推理能力。

Insight: 主要创新点包括：将不稳定的多视角SAM粒度自适应地重新分级为统一的3D一致层次结构，为3D场景提供精确监督；通过结合空间关系，将语义片段提升为层级语言场景图，从而赋能大语言模型进行复杂推理。

Abstract: We introduce LEGO for advanced open-vocabulary scene understanding. Beyond basic concept recognition, its core innovation lies in capturing the intrinsic semantic hierarchies within the scene, such as the “flowerpot -> bouquet -> bud -> petal” lineage. While foundation models like SAM can identify multi-granular structures in 2D, their partitions are strictly perspective-bound and lack cross-view consensus. LEGO self-adaptively re-grades volatile multi-view SAM granularities into a unified, 3D-consistent hierarchy. This provides precise supervision for the structurally coherent, multi-level segmentation of 3D scenes. By grounding these segments with CLIP embeddings, LEGO recovers open-vocabulary semantic logic across hierarchical levels. Furthermore, by incorporating spatial relationships, we elevate these segments into level-wise language scene graphs, effectively empowering Large Language Models to perform complex, context-aware spatial reasoning and precise visual grounding. Experimental results demonstrate that LEGO establishes new state-of-the-art performance across both promptable and open-vocabulary 3D segmentation benchmarks, exhibiting advanced hierarchical scene decomposition and context-aware spatial reasoning.

[18] 4D-WAM: 4D Consistent World Modeling for Autonomous Driving cs.CVPDF

Jiacheng Fu, Yibo Yuan, Meng Tian, Yue Li, Jiangtong Zhu

TL;DR: 本文提出了4D-WAM，一种用于自动驾驶的4D一致世界建模方法。该方法通过利用几何基础模型在训练时提供4D一致性监督，以解决现有世界-动作模型（WAMs）因基于2D视频数据训练而产生的4D不一致预测问题。此外，论文还识别了WAMs中的早期决策现象，并提出了面向决策的时间步采样策略，进一步提升了轨迹规划性能。

Details

Motivation: 现有世界-动作模型（WAMs）基于2D视频投影数据进行训练，无法理解和捕捉底层4D驾驶场景的结构，导致生成视觉上合理但4D不一致的未来预测，从而误导下游规划任务。

Result: 在具有挑战性的NAVSIM-v1和NAVSIM-v2基准测试上，4D-WAM实现了最先进的（SOTA）性能，有效建模了4D一致的场景演化。

Insight: 核心创新点在于利用几何基础模型提供的4D感知响应作为训练时监督信号，定义了4D一致性损失，使模型能够学习预测物理一致的4D场景，且不增加推理成本。另一个关键洞察是提出了面向决策的时间步采样策略，将4D监督重点放在噪声较高、驾驶决策形成的关键早期阶段，从而提升了规划效果。

Abstract: Emerging World-Action Models (WAMs) have demonstrated promising performance in autonomous driving by jointly modeling future driving scene evolution and trajectory planning. However, existing WAMs are typically trained with video data, which is only 2D projections of the underlying 4D driving scene. Consequently, WAMs fail to understand and capture the structure of 4D scenes and thus generate visually plausible yet 4D inconsistent future predictions that mislead downstream planning. To alleviate this issue, we present 4D-WAM, a model that leverages geometric foundation models for training-time supervision to enable 4D consistent world modeling. Specifically, we feed WAM-predicted future frames into a geometric foundation model, and use 4D-aware responses to define a 4D consistency loss. This loss encourages the model to understand, represent, and predict physically consistent 4D scenes during training, without additional inference cost. Moreover, we identify an early-decision phenomenon in WAMs and propose a decision-oriented timestep sampling strategy that emphasizes supervision at early, high-noise stages, where driving decisions are primarily formed. By propagating 4D supervision to this critical decision-formation phase, the proposed strategy further improves trajectory planning. Extensive experiments demonstrate that 4D-WAM effectively models 4D consistent scene evolution and achieves state-of-the-art performance on challenging NAVSIM-v1 and NAVSIM-v2 benchmarks.

[19] P3CA: Encoder-Agnostic Interpretation of Vision Foundation Model Embeddings via Spatial Probing cs.CV | cs.LGPDF

Amoon Jamzad, Dilakshan Srikanthan, Faranak Akbarifar, Nooshin Maghsoodi, Parvin Mousavi

TL;DR: 本文提出了P3CA方法，这是一种与编码器无关的技术，用于对视觉基础模型生成的高维空间嵌入进行局部探测。通过用户选择的空间提示，P3CA能估计该区域的特征归一化和主导协方差方向，并将投影应用于整个张量，以可视化局部信息方向在何处表达。该方法在自然图像、结直肠病理学基础模型嵌入和空间转录组张量上进行了评估。

Details

Motivation: 视觉基础模型在医学图像计算中作为可重用编码器日益普及，但其高维空间嵌入难以检查，通常只能通过下游任务性能或全局降维来评估。现有方法缺乏对通道丰富的空间张量进行局部、无需重新训练的解释手段。

Result: 在多个数据集上的评估表明，提示投影揭示了被全局PCA抑制的局部结构，在基于三维投影的病理学判别任务中，与提示匹配的判别能力得到改善，并支持学习到的表示与测量到的空间表示之间的比较。

Insight: 创新点在于提出了一种无需修改编码器、重新训练或任务特定标签的局部探测方法，实现了区域条件化的表示“透镜”。从客观角度看，该方法将空间提示与PCA结合，为解释黑盒视觉基础模型的内部表示提供了一种灵活、交互式的分析工具。

Abstract: Vision foundation models are increasingly used as reusable encoders in medical image computing, yet their high-dimensional spatial embeddings are difficult to inspect beyond downstream task performance or global dimensionality reduction. We propose position-prompted PCA (P3CA), an encoder-agnostic method for local probing of channel-rich spatial tensors. Given a user-selected spatial prompt, P3CA estimates the feature normalization and dominant covariance directions within that region, then applies the resulting projection to the full tensor to visualize where locally informative directions are expressed. This produces a region-conditioned representation lens without modifying the encoder, retraining, or requiring task-specific labels. We implement P3CA in EmbedVision, an interactive 3D Slicer-based workflow, and evaluate it across natural images, colorectal pathology foundation-model embeddings, and spatial transcriptomic tensors. Across these settings, prompted projections reveal local structure suppressed by global PCA, improve prompt-matched pathology discrimination from frozen three-dimensional projections, and support comparison between learned and measured spatial representations.

[20] Human versus Computer Vision cs.CV | cs.CYPDF

Elena Sirotkina

TL;DR: 本文通过大规模眼动实验（11.4百万个注视点，3023名美国成年人）评估了计算机视觉显著性模型的预测准确性。研究发现，未经训练的中央基准标记优于所有经过训练的显著性网络，因为网络添加的额外内容预测了观众实际不会注视的区域。现有模型的准确性存在系统性偏见，更偏向年轻、白人和政治温和的观众，而低估了年长、黑人和意识形态极端群体的注视模式。作者提出了一种基于群体自身注视数据来评估模型可学习性的方法，并呼吁构建能够公平‘看见’所有人的视觉系统。

Details

Motivation: 动机是检验当前商业化的计算机视觉显著性预测模型（用于替代真实眼动测量）在实际受众中的有效性，并揭示这些模型可能存在的系统性人口统计学偏见。

Result: 在3023名美国成年人观看新闻图片的大规模眼动数据集上，一个简单的中央基准标记（untrained central marker）在预测注视位置方面超越了所有经过训练的显著性网络。模型的剩余准确性存在人口统计学偏见，例如对年轻、白人、温和派观众的预测优于对年长、黑人、极端派观众的预测。

Insight: 创新点在于从‘受众侧’对显著性模型进行大规模实证评估，揭示了当前模型性能被高估以及存在公平性问题。作者提出的方法论——利用群体自身注视数据来评估模型对该群体的可学习性，为构建更公平、更具代表性的视觉注意力模型提供了新的评估标准和前进方向。

Abstract: Computer vision saliency models predict where people will look, one map per image, and a billion-dollar predicted-attention industry sells those maps in place of measuring real viewers. I test the leading models from the audience side, against 11.4 million webcam gaze points from 3,023 US adults recruited to national quotas, viewing circulating news photographs. I show that an untrained central marker outperforms every trained network, because the content the networks add on top of the center falls where these audiences never look. What accuracy remains is systematically biased, favoring younger, White, and moderate viewers over older, Black, and ideologically extreme ones. I propose a way forward and build on what a group’s own gaze reveals about whether a model can learn that group at all, and I apply it across every demographic axis this sample supports. Ultimately, I show how systems that decide what people see can learn to see everyone, and this study supplies the standard by which such a claim should be judged.

[21] A Convolutional Layer Activation Dimensionality Reduction for Out-of-Distribution and Adversarial Attack Detection Methods cs.CVPDF

Leandro de Souza Rosa, Lorenzo Capelli, Clara Nunes Barrancos, Mauro Mangia, Riccardo Rovatti

TL;DR: 本文提出了一种用于卷积层激活降维的新方法，旨在提升分布外样本和对抗攻击检测的性能。该方法通过可控的高压缩水平，在减少计算和内存开销的同时，保持了检测方法的有效性。

Details

Motivation: 卷积神经网络在图像分类任务中表现出色，但其对分布外样本和对抗攻击的敏感性引发了可信度和安全性担忧。现有检测方法在处理卷积层高维激活时，降维方法要么缺乏压缩与信息损失之间的权衡控制，要么产生过大的表示，限制了效率和性能。

Result: 在分布外和对抗攻击检测任务上，使用所提降维方法的检测方法性能一致优于或与最强替代方法相当。此外，该方法在对比方法中实现了最高压缩，显著降低了计算和内存占用。

Insight: 创新点在于设计了一种可控高压缩的卷积层激活降维方法，平衡了信息保留与计算效率，可扩展至现有先进检测方法，提升其实际部署的可行性。

Abstract: Despite the success of convolutional neural networks in image classification tasks and their general application in multi-modal models, their susceptibility to out-of-distribution and adversarial attack samples raises concerns regarding trustworthiness and safety. Among the approaches to tackle such issues, detection methods that analyze the model’s intermediate activations to estimate a confidence score are a promising family that evaluates the decision process, relying on a dimensionality reduction step to enable efficient downstream processing of the high-dimensional activations. However, when considering convolutional layers, the dimensionality reduction methods in the literature either lack a mechanism to control the compression/information-loss trade-off or yield large representations. In this paper, we carefully analyze two state-of-the-art detection methods and their dimensionality reductions for convolutional layers and develop a novel reduction method with a controllable high-compression level. We extend these two state-of-the-art detection methods, enabling the usage of any dimensionality reduction, and evaluate their performance on out-of-distribution and adversarial attack detection. Results show that the detection methods with the proposed dimensionality reduction consistently perform better than, or comparable to, the strongest alternative. Furthermore, the proposed method is shown to reduce computation and memory footprints, given that it has the highest compression among the compared methods.

[22] Motion Artifact-Aware Self-Supervised Representation Learning for 3D Brain MRI Motion Artifact Reduction cs.CV | physics.med-phPDF

Mojtaba Safari, Shansong Wang, Zach Eidex, Matthew Goette, Tonghe Wang

TL;DR: 本文提出了SSRL-MAR，一种用于3D脑部MRI运动伪影减少的运动伪影感知无配对表示学习框架。该方法无需配对训练数据或显式运动标签，通过三阶段训练策略（对比学习、伪影合成网络、伪影感知生成器）学习运动表示并进行自监督修复。

Details

Motivation: 解决脑部MRI中患者运动导致的图像退化问题，现有深度学习方法通常依赖临床中难以获取的配对干净-损坏数据或k空间采集数据。

Result: 在仿真数据集上，PSNR达到23.81dB，SSIM为91.55%，NMSE为0.79%。在体内MR-ART数据集上，经过无监督域适应后，PSNR比仅在模拟数据上训练的监督模型提升高达2.0 dB，且性能接近需要真实配对数据的oracle监督模型。在轻度运动水平下，胼胝体和脑室系统等结构的体积误差减少超过50%。

Insight: 创新点在于提出了一种无需配对数据或运动标签的自监督表示学习框架，通过对比学习和伪影合成网络来建模运动表示，为大规模神经影像研究提供了鲁棒且可扩展的图像域解决方案。

Abstract: Patient motion remains a source of image degradation in brain MRI, leading to signal loss, blurring, and geometric distortion that compromise quantitative analysis. Existing deep learning methods for motion correction typically rely on paired clean-corrupted data or k-space acquisitions, which are rarely available in clinical settings. We propose SSRL-MAR, a motion artifact-aware unpaired representation learning framework for motion artifact reduction that requires neither paired training data nor explicit motion labels. SSRL-MAR employed a three-stage training strategy: (1) contrastive learning on 3D patches to extract motion representations by contrasting clean and synthetically corrupted images, (2) a motion artifact-aware synthesis network to generate motion artifacts from clean scans, and (3) a motion artifact-aware generator to restore clean volumes using the learned degrader for self-supervised supervision. On in-silico dataset, SSRL-MAR achieved PSNR 23.81dB, SSIM 91.55%, and NMSE 0.79%. On in-vivo MR-ART dataset, the pretrained model reduced motion distortion, and unsupervised domain adaptation further improved anatomical fidelity. Against a source-only supervised model trained on the same simulated pairs, SSRL-MAR improved PSNR by up to 2.0 dB on MR-ART after unsupervised domain adaptation, and remained within 0.25-0.47 dB of an oracle supervised model that requires real paired data unavailable in practice. At the milder motion level, volumetric error in structures such as the corpus callosum and ventricular system decreased by more than 50%, confirming improved neuroanatomical consistency. These results indicate that SSRL-MAR provides a robust and scalable image-domain solution for 3D brain MRI motion correction, enabling reliable structural quantification in large-scale neuroimaging studies without requiring prospectively acquired pairs or acquisition-specific calibration.

[23] More Accurate, Less Human: Gestalt Grouping in Vision Models cs.CV | cs.LGPDF

Sudhanva Manjunath Athreya, Sai Phani Kumar Malladi

TL;DR: 本文引入了一个行为测试集，用于评估视觉模型在格式塔分组任务上与人类感知的一致性。该测试集基于四项分组任务（标记颜色异类、颜色序列计数、轮廓识别和物体异类），对45个来自不同训练家族（包括监督、自监督、对比视觉语言编码器、开放权重VLM和封闭基础模型）的模型进行了评估。研究发现，与人类响应的一致性能够捕捉传统性能指标无法区分的感知组织方面，且某些封闭模型的对齐度显著低于其基准准确率所暗示的水平。

Details

Motivation: 人类视觉通过格式塔操作将所见组织为整体，而视觉模型是否以类似方式组织视觉内容尚未得到系统测试。本文旨在通过一个可重复使用的行为测试集，评估模型在感知组织任务上与人类数据的一致性，为可视化研究提供一个无需新用户研究的审计工具。

Result: 测试集应用于45个模型，揭示了与人类响应的一致性能够区分传统性能指标未捕捉的感知组织差异。多个封闭模型在格式塔分组任务上的对齐度显著低于其基准准确率，表明其内部表示与人类感知存在偏差。

Insight: 创新点在于引入了一个基于已有感知数据的行为测试集，为评估视觉模型的感知组织能力提供了可重复的度量标准。这为可视化研究提供了一种高效审计模型是否以人类方式组织视觉内容的方法，无需进行新的用户研究，有助于揭示模型内部表示与人类感知的差异。

Abstract: Human vision organizes what it sees into wholes: same-colored points group into series, similar marks cohere into categories, and shapes complete into recognizable objects. These are the Gestalt operations that visualization design builds on. Whether vision models organize visual content this way has not been systematically tested. We introduce a behavioral battery that scores models against human data from prior perception studies on four grouping tasks: mark-color odd-one-out, color-series counting, silhouette recognition, and object odd-one-out. We apply it to 45 models across five training families: supervised, self-supervised, and contrastive vision-language encoders, open-weight VLMs, and closed foundation models. The battery reveals that agreement with human responses captures aspects of perceptual organization that conventional performance metrics fail to distinguish, with several closed models exhibiting substantially lower alignment than their benchmark accuracy would suggest. Scoring against published perception data therefore gives visualization research a reusable yardstick, requiring no new user study, for auditing whether the models now entering visualization pipelines organize what they see the way their human audience does.

[24] SeFaR: Semantic Feature-aware Robustness Testing of Deep Neural Networks cs.CV | cs.LGPDF

Nusrat Jahan Mozumder, Divya Gopinath, Corina Pasareanu, Matthew Dwyer

TL;DR: 本文提出SeFaR框架，用于系统性地测试视觉模型的语义鲁棒性。该框架基于自然语言需求，利用分层概念模型和扩散模型生成保持语义的逼真扰动，并通过反馈驱动过程识别导致模型失效的语义概念。

Details

Motivation: 深度神经网络在安全关键领域作为感知模块部署时，常因罕见和代表性不足的场景而失败，因此需要评估感知模型在真实世界感知变化下的语义鲁棒性。

Result: 案例研究评估表明，SeFaR框架能有效满足需求前提条件，同时识别影响模型决策的独立于需求的语义特征，从而发现故障并将其与这些特征关联。

Insight: 创新点包括分层概念模型实现特征空间的结构化探索，结合扩散和视觉语言模型生成语义保持的逼真扰动，以及反馈驱动的自适应过程生成可解释的失效诱导语义概念。

Abstract: Deep neural networks are increasingly deployed in safety-critical domains as perception modules, where failures are often caused due to rare and under-represented scenarios. This necessitates the need to evaluate the semantic robustness of perception models; conformance of behavior to high-level requirements over real-world perceptual variability. To address this, we propose SeFaR, a framework for systematic semantic-feature-centric testing of vision models. Given a natural-language requirement and a set of satisfying inputs, SeFaR evaluates robustness with respect to diverse realistic semantic variations that preserve requirement satisfaction. The approach employs a novel hierarchical concept model enabling structured exploration of the feature space and incorporation of domain knowledge via user-defined concepts. State-of-the-art diffusion and vision-language models are leveraged to generate photorealistic semantics-preserving perturbations and identification of previously unknown features impacting behavior. A feedback-driven adaptive process is adopted to generate interpretable failure-inducing semantic concepts along with corresponding test inputs. Evaluation on case studies demonstrates that the proposed framework effectively satisfies requirement preconditions while identifying requirement-independent features that influence model decisions, enabling it to both uncover faults and relate them to such features.

[25] Chain of Spatial Thoughts: Modality-Agnostic Spatial Grounding for Vision Language Models cs.CVPDF

Hunter Schofield, Mohammed Elmahgiubi, Mohammad Mahdavian, Richard Shi, Jinjun Shan

TL;DR: 本文提出了一种名为Space Tokens的轻量级、架构无关的框架，旨在为视觉语言模型（VLMs）提供显式的连续空间表示，而无需在推理时增加额外的空间编码器或修改模型架构。该方法通过将场景级3D几何和以物体为中心的空间属性提炼为连续的潜在token，并将其融入思维链推理过程，从而提升VLMs的空间推理能力。

Details

Motivation: 空间理解是具身智能的基础，但现有最先进的视觉语言模型在空间推理基准上通常依赖额外的空间编码器或架构修改，这会增加计算成本。本文旨在提供一个无需额外推理模块的、通用的空间表示集成方案。

Result: 在VSI-Bench基准测试中，该方法将Qwen3-VL-8B的性能提升了4.3%，将SenseNova-SI-1.3提升了1.3%。在物体尺寸估计（79.2%）和房间尺寸估计（75.7%）任务上达到了最先进的（SOTA）性能。

Insight: 创新点在于提出了一个统一的、可解释的连续空间token接口，该接口不仅能够将几何信息有效地融入VLMs的推理过程，还能被显式解码以验证其编码的几何意义，同时保持了计算效率和向其他模态扩展的潜力。

Abstract: Spatial understanding is fundamental to embodied intelligence, underpinning applications such as robotic manipulation, embodied navigation, and autonomous driving. Although recent vision-language models (VLMs) have achieved impressive performance on spatial reasoning benchmarks, state-of-the-art approaches typically rely on additional spatial encoders or architectural modifications during inference, increasing computational cost. We introduce Space Tokens, a lightweight, architecture-agnostic framework that equips VLMs with explicit continuous spatial representations without requiring additional inference-time modules. By distilling scene-level 3D geometry and object-centric spatial attributes into continuous latent tokens, our method enables these modalities to be directly incorporated into a chain-of-thought reasoning process, thereby improving the VLM’s spatial reasoning capabilities. At the same time, the learned representations can be explicitly decoded to verify that they encode meaningful geometric information, while the unified token interface remains extensible to additional modalities. Experiments on VSI-Bench improve Qwen3-VL-8B by 4.3% and SenseNova-SI-1.3 by 1.3%, while achieving state-of-the-art performance on object size (79.2%) and room size estimation (75.7%). These results demonstrate that continuous spatial tokens provide an effective, interpretable, and computationally efficient mechanism for integrating geometric reasoning into large vision-language models.

[26] TRACE-GS: On-Policy Trajectory Distillation with Privileged Geometric Conditioning for Sparse-View 3DGS Restoration cs.CVPDF

Linlian Jiang, Yuchen Xi, Sadman Rakib Pinon, Ruigang Yang, Yang Wang

TL;DR: 本文提出了TRACE-GS，一种用于稀疏视图3D高斯泼溅（3DGS）恢复的在线策略轨迹蒸馏框架。该方法利用训练时的特权几何信息来适配扩散先验，通过一个基于额外训练视图拥有更丰富几何信息的教师模型，为稀疏视图学生模型在其自身推理轨迹上提供监督目标，从而在部署时仅需保留学生模型进行恢复。

Details

Motivation: 现有基于扩散的稀疏视图3DGS恢复方法存在一个根本性局限：在独立噪声状态下的监督无法覆盖推理过程中实际访问的状态，导致几何约束不足从一开始就使去偏过程产生偏差，且误差在推理过程中不断累积。

Result: TRACE-GS在多个数据集和稀疏视图设置下取得了一致的性能提升和强大的泛化能力，据作者所知，这是首个利用特权几何信息进行在线策略监督以实现稀疏视图3DGS恢复的方法。

Insight: 核心创新在于引入了在线策略轨迹蒸馏和特权几何信息学习（LUPI）范式，通过教师模型在训练时提供与学生在自身推理轨迹上状态对齐的监督信号，解决了传统方法中训练与推理状态不匹配的根本问题，这是一种训练策略而非架构上的创新。

Abstract: We present TRACE-GS, an on-policy trajectory distillation framework that leverages privileged geometric conditioning at training time, thereby adapting a diffusion prior to sparse-view 3D Gaussian Splatting (3DGS) restoration. Rather than pursuing increasingly sophisticated restoration architectures, we identify a more fundamental limitation shared by existing diffusion-based approaches: supervision at independently noised states does not cover those reached during inference. In sparse-view 3DGS, under-constrained geometry biases denoising from the outset, and the resulting deviations compound along the rollout. TRACE-GS instead performs on-policy trajectory distillation: a teacher conditioned on richer geometry from additional training views supplies targets along the sparse-view student’s own rollout, aligning denoising directions and cross-view responses at each visited state. This training-only geometry places TRACE-GS in the learning using privileged information (LUPI) setting. At deployment, only the sparse-view student is retained, and its restored renderings serve as pseudo-observations for 3DGS refinement. To the best of our knowledge, TRACE-GS is the first to derive on-policy supervision from privileged geometry for sparse-view 3DGS restoration, achieving consistent gains and strong generalization across datasets and sparse-view settings.

Zijian Gu, Weikai Lin, Shuang Zhou, Zihan Chen, Song Wang

TL;DR: 本文提出UniMod框架，旨在解决多模态医学诊断中的捷径学习问题，通过同时监督单模态和多模态分类，并结合跨模态与模态内对齐，提升模型对图像和文本特征的利用能力。

Details

Motivation: 多模态医学诊断中，模型倾向于依赖易于学习的模态（如临床文本），而忽略难学模态（如医学图像），导致捷径学习问题，影响诊断准确性。

Result: 在Harvard-Glaucoma数据集上达到0.850 AUC，超越OGM-GE和Gradient Blending 1.6-1.8%；在CheXpert Plus数据集上达到0.966 AUC，超越超过5%；在5类多标签诊断任务中，平均AUC比CGGM提升0.097。

Insight: 创新点在于强制每个模态独立预测诊断，结合跨模态知识迁移和模态内对比对齐，无需修改架构即可扩展到多标签任务，有效缓解捷径学习并提升泛化能力。

Abstract: Multi-modal learning combining medical images and clinical text is promising for disease diagnosis. However, standard multi-modal training leads to shortcut learning: models exploit the easier modality (e.g., diagnostic cues in text) while neglecting harder-to-learn features (e.g., subtle visual patterns). We propose UniMod, a framework that mitigates shortcut learning by requiring each modality to predict the diagnosis on its own. It supervises image-only, text-only, and multi-modal classification simultaneously, so each modality must extract diagnostic features. We add cross-modality alignment for knowledge transfer and within-modality supervised contrastive alignment over same-diagnosis patients. On Harvard-Glaucoma, UniMod reaches 0.850 AUC, outperforming OGM-GE and Gradient Blending by 1.6-1.8%; on CheXpert Plus, it reaches 0.966 AUC, surpassing them by over 5%. UniMod also extends to 5-class multi-label diagnosis without architectural change, improving mean AUC by 0.097 over CGGM.

Lisa K. Fischer, Mykhailo Riabets, Daniel Rueckert, Benedikt Wiestler, Anke Meyer-Baese

TL;DR: 该论文研究了在训练3D脑部MRI多模态生成模型时，使用标准图像编解码器（如JPEG2000和JPEG-LS）对数据进行有损压缩的可行性。研究发现，在20:1的压缩比下，使用压缩数据训练的生成模型（Wavelet Flow Matching）在合成质量上与使用未压缩数据训练的模型在统计上等效，PSNR和SSIM差异微小。

Details

Motivation: 大规模多模态MRI数据集带来了巨大的存储和I/O成本，限制了在普通基础设施上训练3D生成模型。虽然有损压缩已知能保持判别式分割网络的准确性，但其对需要学习完整数据分布的生成模型的影响尚未被探索。

Result: 在BraTS数据集（T1n, T1c, T2, T2f序列）上，使用JPEG2000压缩数据训练的Wavelet Flow Matching模型，在验证集上评估，其合成质量（PSNR和SSIM）与使用未压缩数据训练的模型在统计上等效（ΔPSNR <1 dB, ΔSSIM <0.02）。具体而言，平均PSNR为27.3 dB vs. 27.0 dB，平均SSIM为0.95 vs. 0.96。

Insight: 论文的创新点在于首次系统评估了有损压缩对3D MRI生成模型训练的影响，并证明了JPEG2000等标准压缩方法在保持合成质量的同时，能显著降低存储需求，为实现可扩展的3D MRI生成建模提供了实用方案。从客观角度看，这为在资源受限环境下训练高质量生成模型开辟了新途径。

Abstract: Large-scale multi-modal MRI datasets impose substantial storage and I/O costs, limiting the training of 3D generative models on commodity infrastructure. While lossy compression is known to preserve accuracy for discriminative segmentation networks, its effect on generative models, which must learn the full data distribution rather than a decision boundary, is unexplored. We study whether standard image codecs can effectively compress semantically rich brain tumor MRI while preserving the fidelity required to train and deploy a 3D MRI generative model. Each 3D volume is compressed with JPEG2000 or a near-lossless JPEG-LS pipeline. Next, a Wavelet Flow Matching model, conditioned on BraTS image sequences (T1n, T1c, T2, T2f), is trained on compressed data, and the resulting models are evaluated on the validation set. At a 20:1 compression ratio, synthesis quality is statistically equivalent to a model trained on uncompressed data within a pre-specified margin ($Δ$PSNR $<1$,dB, $Δ$SSIM $<0.02$; paired TOST $p=[[p]]$): mean PSNR is 27.3,dB vs. 27.0,dB and mean SSIM is 0.95 vs. 0.96 across modalities. Our results indicate that JPEG2000 compression is a practical step toward scalable 3D MRI generative modeling without degrading synthesis quality. The codebase is available at https://github.com/lisafis/MRIComp4Flow .

[29] From Detection to Understanding: TAR and TAR-Bench for Multi-Task Traffic Anomaly Reasoning cs.CVPDF

Han Zhang, Yilin Zhao, Zaid Pervaiz Bhat, Zheng Tang, Varun Praveen

TL;DR: 本文提出了TAR（交通异常推理）数据集及其评估基准TAR-Bench，旨在推动视频-语言模型在异常检测之外的多任务推理能力。TAR包含来自8个公共数据集的3,670个监控视频（约26小时）的44,040条思维链训练标注，涵盖10个任务；TAR-Bench则包含从17个YouTube视频中裁剪的80个保留片段，配有960个人工标注的测试样本。

Details

Motivation: 为了解决现有视频-语言模型在交通异常场景中仅限于检测、缺乏深入理解（如时空和场景推理）的问题，作者构建了专门的数据集以促进模型从检测到理解的演进。

Result: 在TAR-Bench上评估的11个视觉-语言模型显示，强问答准确性并不能可靠预测时空或场景推理能力；在TAR上进行多任务微调带来一致提升，完整10任务模型相比零样本基线在综合得分上提高了21.4分。该数据集将成为AI City Challenge 2026 Track 3的官方训练和评估数据。

Insight: 创新点在于通过MAVEN方法整合多尺度视频证据生成结构化事件描述，进而构建思维链标注，推动了从异常检测到多任务推理的范式转变；客观来看，该工作提供了首个专注于交通异常推理的大规模数据集，强调了模型在复杂推理任务中泛化能力的重要性。

Abstract: We present TAR (Traffic Anomaly Reasoning) and TAR-Bench datasets, resources for training and evaluating video-language models beyond anomaly detection. TAR contains 44,040 chain-of-thought training annotations across 10 tasks for 3,670 CCTV videos ($\sim$26 hours) from eight public datasets. Its evaluation component, TAR-Bench, contains 960 human-curated test annotations for 80 held-out clips trimmed from 17 public YouTube videos. TAR’s training annotations are produced with MAVEN, which consolidates multi-scale video evidence into structured event descriptions before generating question-answer pairs and reasoning traces. On TAR-Bench, eleven vision-language models reveal that strong question-answering accuracy does not reliably predict temporal or scene reasoning ability. Multi-task fine-tuning on TAR yields consistent gains, with the full 10-task model improving aggregate score by 21.4 points over its zero-shot baseline. TAR and TAR-Bench provide the official training and in-domain evaluation data for AI City Challenge 2026 Track 3. The dataset is available at https://huggingface.co/datasets/nvidia/PhysicalAI-Traffic-Anomaly-Reasoning

[30] CasDeblurGS: Cascaded 2D-to-3D Multi-View Consistency for 3D Gaussian Splatting from Two Blurry Images cs.CVPDF

Haeyun Choi, Minhyuk Jang, I-Gil Kim

TL;DR: 本文提出CasDeblurGS，一种从仅两张已知内参但未知位姿的运动模糊图像中重建连贯3D场景的级联框架。该方法通过从局部2D对应到全局3D引导的渐进式恢复，解决了严重视图稀疏和运动模糊的双重挑战，无需辅助清晰图像或耗时的逐场景优化。

Details

Motivation: 解决沉浸式应用中自由视角3D场景媒体面临的严峻现实问题：实际采集常受限于严重的视图稀疏性和运动模糊，而现有模糊感知方法通常需要大量多视图冗余、精确相机位姿或昂贵的逐场景优化。

Result: 在真实世界和合成的Deblur-NeRF场景上的实验表明，该方法相对于强基线模型取得了一致的性能提升，PSNR分别提高了1.19 dB和2.11 dB。渐进式消融实验、跨视图对应关系可视化和相机重投影分析进一步证明了其在渲染质量和多视图几何一致性方面的改进。

Insight: 核心创新在于提出了一种级联的2D到3D多视图一致性框架，通过遮挡感知的对应关系过滤构建局部可靠引导，并利用无位姿的临时3D高斯表示的重渲染提供密集全局引导，从而实现了从极稀疏模糊输入中恢复高质量3D表示和新视角合成。

Abstract: Free-viewpoint 3D scene media is increasingly important for immersive applications, yet practical capture often suffers from severe view sparsity and motion blur. Although neural rendering has advanced sparse-view synthesis, existing blur-aware methods typically require substantial multi-view redundancy, accurate camera poses, or costly per-scene optimization. We address a stringent yet practical setting: reconstructing a coherent 3D scene from only two motion-blurred images with known intrinsics, without input-view poses, auxiliary sharp images, or per-scene test-time optimization. To this end, we propose CasDeblurGS, a cascaded framework that progressively recovers reliable cross-view information from local 2D correspondences to global 3D guidance. Stage 1 constructs locally reliable guidance through occlusion-aware correspondence filtering, while Stage 2 aggregates the intermediate restorations into a provisional pose-free 3D Gaussian representation whose input-view re-renders provide dense global guidance for final restoration. The resulting views enable a more coherent 3D representation and higher-quality novel-view synthesis. Experiments on real-world and synthetic Deblur-NeRF scenes show consistent gains over strong baselines, improving PSNR by 1.19 dB and 2.11 dB, respectively. Progressive ablations, cross-view correspondence visualization, and camera reprojection analysis further demonstrate improvements in both rendering quality and multi-view geometric consistency.

[31] A second-order theory of texture for depth from focus cs.CVPDF

Sreekar Ranganathan, Ioannis Gkioulekas

TL;DR: 本文基于波动光学理论，提出了光学粗糙表面的纹理外观理论，重点探讨纹理在被动聚焦深度估计中的作用。研究表明，即使传统计算机视觉认为无纹理的表面，由于表面微观几何结构产生的主观散斑，也能呈现纹理外观。通过分析这种二阶纹理的特性，并利用窄带光谱滤波器增强其在自然环境光下的对比度，显著提升了看似无纹理场景的被动深度重建效果。

Details

Motivation: 解决传统计算机视觉中因表面看似无纹理而难以进行被动聚焦深度估计的问题，探索表面微观结构产生的纹理外观对深度重建的潜在贡献。

Result: 通过理论分析、模拟和真实世界实验验证，使用窄带光谱滤波器增强二阶纹理对比度后，在看似无纹理场景的被动深度重建中取得了显著改进，但未提及具体基准测试或与现有方法的定量比较。

Insight: 创新点在于从波动光学角度揭示表面微观几何产生的主观散斑可作为二阶纹理，用于深度估计；通过窄带光谱滤波增强纹理对比度是一种简单有效的被动深度重建方法，为处理无纹理场景提供了新思路。

Abstract: We present a theory of textured appearance of optically rough surfaces based on wave optics, emphasizing the role of texture for passive depth from focus. Our theory shows that even surfaces that traditional computer vision would consider textureless can produce textured appearance, due to subjective speckle from surface microgeometry. We analyze the properties of this second-order texture, and show that we can enhance its contrast under natural ambient lighting by simply using a narrowband spectral filter. Doing so results in dramatic improvements in passive depth reconstruction of seemingly textureless scenes, as we demonstrate through extensive theory, simulations, and real-world experiments.

[32] DriveVLA-M0: Failure-Aware Memory Augmentation for Autonomous Driving cs.CVPDF

Zebin Xing, Yupeng Zheng, Qiang Chen, Linbo Wang, Yichen Zhang

TL;DR: 本文提出了DriveVLA-M0，一种用于自动驾驶的、具有故障感知潜在记忆的检索增强视觉-语言-动作模型。该方法通过构建存储故障案例及其结构化场景表示和专家轨迹标签的潜在记忆池，并设计专门的检索模型，在推理时通过轻量级解耦的基于LoRA的测试时训练机制注入检索到的案例，从而实现针对性的场景特定校正，而无需修改主干模型。

Details

Motivation: 现有的视觉-语言-动作模型缺乏利用过去失败经验或适应分布偏移的机制，导致模型在先前失败过的类似场景中持续表现不佳。本文旨在解决这一问题，使模型能够从历史故障中学习并适应。

Result: 在NAVSIMv1和NAVSIMv2基准测试上的广泛实验表明，该方法持续优于先前方法，在Navtest上达到94.1 PDMS，在Navhard上达到47.0 EPDMS，且测试时训练反向延迟开销仅为26.44毫秒。此外，该方法能通过扩展记忆实现无需训练的性能提升。

Insight: 创新点在于引入了故障感知的潜在记忆池和结构化的检索机制，将静态道路结构与动态智能体交互解耦以实现基于结构的检索。同时，采用轻量级解耦的基于LoRA的测试时训练机制，实现了高效、针对性的在线适应，这是一种新颖的、无需修改主干模型的性能增强范式。

Abstract: Vision-Language-Action (VLA) models have recently emerged as a promising paradigm for end-to-end autonomous driving by enabling unified reasoning across perception, language, and planning. However, existing approaches lack mechanisms to exploit past failures or adapt to distribution shifts, causing the model to persistently underperform on similar scenarios where it has previously failed. In this paper, we propose DriveVLA-M0, a retrieval-augmented VLA with failure-aware latent memory. We construct a latent memory pool that stores failure cases along with their structure scene representations and expert trajectory labels, and design a dedicated Retrieve Model that decouples static road structure and dynamic agent interactions to enable structurally grounded retrieval. At inference time, retrieved cases are injected into the model via a lightweight decoupled LoRA-based test-time training (TTT) mechanism, allowing targeted and scenario-specific correction without modifying the backbone. Extensive experiments on NAVSIMv1 and NAVSIMv2 benchmark demonstrate that our approach consistently outperforms prior methods, achieving 94.1 PDMS on Navtest and 47.0 EPDMS on Navhard with only 26.44 ms TTT backward latency overhead. Furthermore, we show that DriveVLA-M0 scales effectively with additional memory, enabling training-free performance gains through memory expansion. The code is available at https://github.com/ZebinX/DriveVLA-M0.

[33] GeoSeg-OV: Bridging Geospatial Gaps with Structural Guidance for Open-Vocabulary Remote Sensing Segmentation cs.CVPDF

Ruizhong Liu, Tingzhang Luo, Zaiyan Zhang, Jundong Chen, Hongruixuan Chen

TL;DR: 本文提出了GeoSeg-OV，一种用于开放词汇遥感图像分割的新方法。该方法通过将辅助视觉基础模型（VFM）的特征与视觉-文本匹配解耦，并将其重新用作结构引导，以解决地理空间域偏移导致的视觉-文本匹配弱化和跨数据集泛化能力受限的问题。核心创新包括结构引导聚合（SGA）和成本感知解码（CAD）模块。

Details

Motivation: 开放词汇遥感分割面临地理空间域偏移（由异质区域、空间分辨率和采集平台差异引起）的挑战，这会削弱视觉-文本匹配并限制跨数据集泛化。现有方法简单地将辅助视觉基础模型特征与文本嵌入耦合，可能引入不一致的匹配信号，且未能充分利用其对结构敏感的表示。

Result: 在覆盖六大洲七个数据集的全球高分辨率土地覆盖（HRLC）基准测试中，GeoSeg-OV在两种训练设置下的平均mIoU分别比当前最先进方法高出2.5和2.7个百分点，达到了新的SOTA水平。大规模零样本案例研究进一步证明了其无需目标域标注或重新训练即可跨地理域和类别系统泛化的能力。

Insight: 主要创新点在于将辅助VFM特征的角色从直接的视觉-文本匹配证据，转变为用于成本聚合和解码的结构性引导，从而更充分地利用了其对结构敏感的表示。具体技术包括：从多旋转CLIP特征构建方向鲁棒的成本体积；提出的SGA模块利用VFM衍生的成对结构偏置进行连贯的空间传播；以及CAD模块根据解码器上下文自适应地细化和融合多尺度语义与结构引导。

Abstract: Open-vocabulary remote sensing segmentation has recently emerged as a promising paradigm that enables pixel-level recognition of arbitrary categories specified by natural language, including classes unseen during training. However, geospatial domain shifts caused by heterogeneous regions, spatial resolutions, and acquisition platforms weaken visual-text matching and limit cross-dataset generalization. Recent attempts have begun to incorporate auxiliary vision foundation models (VFMs), typically coupling their features with text embeddings as additional matching evidence. However, this strategy may introduce inconsistent matching signals while leaving the structure-sensitive representations of VFMs insufficiently exploited. We therefore propose GeoSeg-OV, which decouples auxiliary VFM features from visual-text matching and repurposes them as structural guidance for cost aggregation and decoding. GeoSeg-OV constructs an orientation-robust cost volume from multi-rotation CLIP features, while a frozen VFM extracts multi-scale structure-sensitive features in parallel. We propose Structure-Guided Aggregation (SGA), which integrates cost tokens and CLIP semantic guidance with VFM-derived pairwise structural biases for coherent spatial propagation, followed by text-conditioned class-wise reasoning. We further introduce Cost-Aware Decoding (CAD) to adaptively refine and fuse multi-scale semantic and structural guidance based on the current decoder context. On the global High-Resolution Land Cover (HRLC) benchmark spanning seven datasets across six continents, GeoSeg-OV outperforms the state-of-the-art by +2.5 and +2.7 average mIoU under two training settings. A large-scale zero-shot case study further demonstrates its generalization across geographic domains and category systems without target-domain annotations or retraining.

[34] Lesion-Aware Adaptive Fourier Neural Operator for CT-to-PSMA PET Synthesis in Prostate Cancer cs.CV | physics.med-phPDF

Rashmi Bhaskara, Waleed M. Almutairi, Matthew Gopaulchan, Maram Musaad Alqurashi, Francis Asamoah

TL;DR: 本文提出了一种名为LAFNO的病灶感知自适应傅里叶神经算子，用于从CT图像合成前列腺癌PSMA PET图像。该方法通过引入两个高效的CT衍生代理通道（对比度代理和紊乱代理）来替代传统耗时的影像组学特征提取，并结合整体图像重建与病灶层面的监督，旨在更准确地保留临床相关的肿瘤活性信号。

Details

Motivation: 现有基于CT或MRI合成PET的深度学习模型通常使用全局损失函数（如L1或MSE），这导致模型可能低估病灶活性或无法保留肿瘤特异性结构，尤其是在病灶体素占比很小的全身PSMA-PET中。直接使用影像组学特征进行条件化又非常耗时。

Result: 在TCIA PSMA-PET-CT-Lesions数据集上，LAFNO与四种基线架构相比，在全图质量（SSIM）上保持竞争力（18F-PSMA为0.960，68Ga-PSMA为0.938），同时将每位患者的TLA误差显著降低（分别降至48.3%和64.0%），并在两种示踪剂的所有特征类别中实现了最高的肿瘤核心影像组学可重复性。

Insight: 核心创新在于用两个易于计算的CT衍生代理通道（对比度代理和紊乱代理）来高效地模拟病灶核心和瘤周区域的影像组学特性，并将其注入模型瓶颈。这避免了繁琐的病灶分割和特征提取，实现了病灶感知的监督，从而在保持整体图像质量的同时，显著提升了病灶活性估计和肿瘤特异性结构的保真度。

Abstract: Deep learning models that synthesize PET from CT or MRI can reduce patient dose and scanner demand, but are typically optimized with global losses such as L1 or mean squared error (MSE) that treat all voxels similarly. In whole-body PSMA-PET, tumor voxels occupy only a small fraction of the volume, yet carry the clinically relevant activity signal; as a result, models can achieve high structural similarity index measure (SSIM) and peak signal-to-noise ratio (PSNR) while still underestimating lesion activity or failing to preserve tumor-specific structure. Radiomics provides biologically meaningful descriptors of tumor intensity and texture, but direct radiomics conditioning is time-consuming because it requires feature extraction from delineated lesion regions. We propose LAFNO, a Lesion-Aware Adaptive Fourier Neural Operator for CT-to-PSMA-PET synthesis that replaces high-dimensional radiomics conditioning with two efficient CT-derived proxy channels. Motivated by radiomics analysis of PSMA-avid tumor core and peritumoral regions, LAFNO uses a contrast proxy for local density variation and a disorder proxy for local texture heterogeneity, both injected into the model bottleneck. LAFNO combines whole-volume reconstruction with lesion-level total lesion activity (TLA), tumor-core contrast, and peritumoral supervision. We evaluated LAFNO against four baseline architectures on the TCIA PSMA-PET-CT-Lesions dataset. LAFNO remained competitive on whole-volume image quality, achieving SSIM of 0.960 and 0.938 for 18F- and 68Ga-PSMA, respectively, while reducing per-patient TLA error to 48.3% and 64.0% for 18F- and 68Ga-PSMA, respectively, and achieving the highest tumor-core radiomics reproducibility across all feature classes for both tracers. Peritumoral reproducibility remained tracer-dependent, indicating that biological fidelity in synthetic PSMA-PET remains challenging.

[35] Stream Forcing: Constructing Unified Training Trajectory for Robust Streaming Video Generation cs.CVPDF

Yueting Zhu, Yuehao Song, Kaicheng Zhang, Bao Tang, Shaoyu Chen

TL;DR: 本文提出了一种名为Stream Forcing的统一训练框架，用于解决流式视频生成中训练与推理不匹配的核心问题。该方法将视频扩散采样重新定义为噪声水平上的帧索引随机过程，并构建了一个从独立采样渐进演化为推理一致采样的连续训练轨迹，从而平衡了训练充分性与推理效率。

Details

Motivation: 流式视频生成模型存在一个根本性的训练-推理不匹配问题：推理遵循特定的去噪顺序，而先进的训练策略通常需要多样化的噪声水平配置。本文旨在解决这种训练一致性与训练覆盖范围之间的权衡。

Result: 在UCF-101基准测试上，该方法显著提升了生成质量，FVD指标改善了36.6%。同时，该方法实现了鲁棒的零样本外推至长时程视频生成，在UCF-101基准上FVD指标改善了27.9%。

Insight: 核心创新在于将采样过程重新形式化为一个随机过程，并构建了一个渐进演化的连续训练轨迹。此外，联合校准算法和时间相关采样算法确保了轨迹平滑性和帧间相关性，为流式视频生成提供了一个兼顾训练充分性和推理一致性的统一框架。

Abstract: Streaming video generation holds strong potential for world modeling, where future frames must be inferred online sequentially to form a continuous video stream. However, streaming video diffusion models introduce a fundamental train-inference mismatch: inference follows a specialized denoising order, whereas advanced training strategies typically require diverse noise-level configurations. To address this trade-off between train-inference consistency and training coverage, we reformulate the video diffusion sampling as a frame-indexed stochastic process over noise levels. Within this stochastic process space, we construct a continuous training trajectory along which the sampling schedule progressively evolves from independent sampling to inference-consistent sampling. We further introduce a joint calibration algorithm and a temporal correlative sampling algorithm to ensure trajectory smoothness and cross-frame correlation. Building on these designs, we propose Stream Forcing, a unified training framework for streaming video generation that balances training sufficiency and inference efficiency. Extensive experiments demonstrate that Stream Forcing significantly improves generation quality with a 36.6% FVD improvement on the UCF-101 benchmark. Furthermore, our method facilitates robust zero-shot extrapolation to long-horizon video generation with a 27.9% FVD improvement on the UCF-101 benchmark.

[36] Bridging Event Streams and DiT: Event-Guided Video Frame Interpolation cs.CVPDF

Guixu Lin, Yuyang Yu, Xiang Ji, Linyao Chen, Zhengwei Yin

TL;DR: 本文提出了一种基于适配器的框架，将事件相机的高时间分辨率运动线索整合到预训练的扩散模型中，以改进视频帧插值。该方法利用图像扭曲事件（IWEs）和双向稀疏光流提供时空对齐的引导，从而减少插值伪影并提升重建保真度和时序一致性。

Details

Motivation: 现有潜在扩散模型在处理大时间间隔和复杂运动时存在运动模糊、结构扭曲和时序不一致的问题，而事件相机提供的高时间分辨率运动线索适合弥补这些缺陷。

Result: 在真实和合成基准测试中，该方法一致优于现有的最先进方法，实现了SOTA性能。

Insight: 创新点在于通过适配器框架将事件线索注入预训练扩散模型，无需从头训练事件辅助模型，同时利用IWEs和双向稀疏光流提供精确的时空引导，有效提升了插值质量。

Abstract: Latent diffusion models have recently advanced video frame interpolation by synthesizing intermediate frames between input images. However, handling large temporal gaps and complex motion remains challenging, often resulting in motion blur, structural distortions, and temporal inconsistencies. Event cameras provide high-temporal-resolution motion cues that are well suited for bridging these gaps and improving interpolation quality. To exploit this advantage without training an event-assisted model from scratch, we propose an adapter-based framework that incorporates event-derived cues into a pre-trained image-to-video diffusion model with minimal architectural changes. Specifically, our method leverages Image Warped Events (IWEs) and bidirectional sparse optical flow to provide spatially and temporally aligned guidance during generation. By injecting these event-guided structural and motion cues into the diffusion process, our approach reduces interpolation artifacts and improves both reconstruction fidelity and temporal coherence. Experimental results on real and synthetic benchmarks show that our method consistently outperforms existing state-of-the-art approaches. The project page is at https://joseph-lin-tech.github.io/BridgeEventDiT-VFI/.

[37] FUSE: Frame-Unified Stress Estimation from Facial Video cs.CV | cs.AIPDF

Stefanos Gkikas, Thomas Kassiotis, Yang Guo, Guangliang Li, Giorgos Giannakakis

TL;DR: 本文提出了FUSE（Frame-Unified Stress Estimation）框架，用于从面部视频中自动检测压力。该方法的核心创新在于摒弃了传统方法中先将完整视频分割成短时窗口再进行分类的步骤，而是将整个视频的所有帧融合成一个统一的二维表示，并利用一个非对称注意力架构进行一次性处理。

Details

Motivation: 现有基于视频的压力检测方法通常需要将完整记录分解为短时窗口，这引入了窗口长度、重叠和聚合等额外设计选择，并限制了对整个记录中跨时间信息的直接分析。本文旨在探索一种无需时间窗口化或外部分割，直接处理完整视频记录的框架。

Result: 在一个包含58名受试者的压力数据集上，使用分层受试者级别协议进行评估。FUSE在时间步长t=15时取得了最高的测试准确率69.44%，而全帧配置（t=1）也保持了69.03%的竞争力。计算成本在12.48到348.78 GFLOPs之间变化，展示了时间密度与效率之间的权衡。

Insight: 主要创新点在于将时间维度折叠到空间表示的通道维度中，从而将整个视频序列融合为一个统一的二维表示，并通过一个统一的不对称注意力架构进行处理。这证明了在该场景下，有效的面部视频压力检测并不需要时间窗口化，完整的记录推理可以在单一的统一架构中实现。

Abstract: Automatic stress detection from facial video offers a practical path to non-intrusive affect monitoring, yet existing video-based approaches commonly decompose full recordings into short temporal windows before classification. This design introduces additional choices regarding window length, overlap, and aggregation, while limiting direct analysis of temporal information across the entire recording. In this study, we present FUSE (Frame-Unified Stress Estimation), a facial-video stress detection framework that processes complete recordings as a single input without temporal windowing or external segmentation. The name reflects the defining operation of the method: rather than dividing a recording into short clips, all frames are fused into one unified two-dimensional representation from which the stress state is estimated. This unification is realized by folding the temporal dimension into the channel dimension of the spatial representation, and the resulting high-dimensional input is processed using a unified asymmetric-attention architecture. At a temporal stride of t = 1, FUSE retains the full 120-second recording as one input, corresponding to 3,600 frames at 30 fps. Experiments on a 58-subject stress dataset using a stratified subject-level protocol evaluate seven temporal-stride configurations, ranging from full-frame input to sparse subsampling. FUSE achieves the highest test accuracy of 69.44% at t = 15, while the full-frame configuration remains competitive at 69.03%. Across the stride range, computational cost varies from 12.48 to 348.78 GFLOPs, showing the trade-off between temporal density and efficiency. These results demonstrate that temporal windowing is not required for effective facial-video stress detection in this setting, and that complete-recording inference can be achieved within a single unified architecture.

Congyang Ou, Ruike Song, Yang Zhou, Libo Sun, Haokui Zhang

TL;DR: 本文提出了一种名为SIEVE的无训练视觉令牌压缩方法，通过跨模态残差（CMR）指导来高效剪枝视觉语言模型（VLM）中的冗余视觉令牌。该方法量化了文本令牌在深层LLM中吸收视觉信息的现象，并利用重构残差、文本注意力相关性和残差空间多样性来保留任务相关且互补的令牌，从而显著降低推理成本。

Details

Motivation: 现有视觉令牌剪枝方法依赖基于相似性的指导，仅捕获局部层信号，忽视了VLM的整个推理过程。本文旨在补充这种指导，通过分析文本令牌在推理中持续吸收视觉信息的现象，提出一种更高效的压缩方案。

Result: 在多种VLM架构上的实验验证了SIEVE的有效性。例如，在LLaVA-NeXT-7B上，SIEVE仅保留11.1%的视觉令牌，同时保持了97.5%的原始平均性能，实现了3.62倍的预填充加速、2.49倍的端到端加速和6.02倍的KV缓存减少。

Insight: 创新点在于从几何表示角度提出了跨模态吸收（CMA）来量化文本对视觉信息的吸收，并据此设计了跨模态残差（CMR）作为压缩指导。SIEVE结合了CMR、文本注意力相关性和残差空间多样性，是一种无需训练的高效压缩方法，能显著提升推理效率。

Abstract: Abundant visual information strengthens vision-language model (VLM) perception, yet massive visual tokens raise inference costs. Existing visual token pruning methods rely on similarity-based guidance, which exploits pairwise text-vision and vision-vision token correlations for compression. However, such methods only capture local layer-level signals and overlook the whole inference process in VLM. In this paper, we revisit VLM inference and present a new efficient guidance scheme that complements similarity-based guidance. In particular, we identify a key observation: as LLM layers deepen, text tokens continuously aggregate visual information via self-attention and progressively absorb partial visual content into textual representations. To quantify this phenomenon, we propose Cross Modal Absorption (CMA) from a geometric representation perspective to measure how much visual information is absorbed by text, revealing that more visual tokens in deeper layers can be approximately explained by the text subspace. We accordingly propose Cross Modal Residual (CMR). It projects visual tokens onto the text subspace via Tikhonov regularized least squares and exploits reconstruction residuals to quantify visual information that cannot be explained by text. Finally, based on CMR, we present SIEVE, a training-free visual token compression method that combines CMR, text-attention relevance, and residual-space diversity to retain task-relevant and complementary tokens. Experiments on diverse VLM architectures verify the effectiveness of SIEVE. For instance, on LLaVA-NeXT-7B, SIEVE keeps only $11.1%$ of visual tokens while preserving $97.5%$ of the original average performance, achieving $3.62\times$ prefill speedup, $2.49\times$ end-to-end speedup, and a $6.02\times$ KV-cache reduction.

[39] SapiensID 2.0: Aligning Human Recognition Foundation Models with Human Perception cs.CVPDF

Yiyang Su, Jie Zhu, Feng Liu, Anil K. Jain, Xiaoming Liu

TL;DR: SapiensID 2.0 是一个增强语义和时间感知的人类识别基础模型框架。它通过从多模态大语言模型（MLLMs）中迁移零样本语义知识来弥补软生物特征标注的不足，并利用不变特征对齐（ITA）和瞬态噪声解耦（TND）来提炼核心持久特征。此外，它设计了运动语义注意力头（K-SAH）来跨时间窗口捕获丰富的运动特征，无需大规模视频数据集。

Details

Motivation: 当前基于静态几何特征提取的人类识别基础模型与人类感知方式存在根本差异，导致模型存在’语义盲区’、容易过拟合瞬态噪声、难以利用不变的软生物特征以及捕获时间运动特征。

Result: 大量实验表明，SapiensID 2.0 在基于图像和视频的行人重识别、步态识别任务上均达到了最先进的性能，同时保持了强大的人脸识别能力。

Insight: 创新点在于将MLLMs的零样本语义知识迁移到判别性嵌入空间，并设计了ITA和TND来处理特征空间维度不匹配和噪声解耦问题；通过K-SAH在时间维度上扩展注意力，有效捕获运动特征，降低了对大规模视频数据的依赖。

Abstract: While foundation models have significantly advanced human recognition across diverse modalities, they predominantly rely on static, geometric feature extraction. This approach fundamentally diverges from human perception. Consequently, current models often suffer from “semantic blindness,” overfitting to transient noise while failing to leverage invariant soft biometrics, and struggle to capture temporal motion signatures. To bridge this gap, we propose SapiensID 2.0, a human recognition framework enriched with both semantic and temporal awareness. To overcome the lack of soft-biometric annotations, we transfer zero-shot semantic knowledge from Multimodal Large Language Models (MLLMs) into a discriminative embedding space. We resolve the dimensional mismatch between these spaces using Invariant Trait Alignment (ITA) to distill core persistent traits, and Transient Noise Disentanglement (TND) to decouple artifacts like clothing. Furthermore, we design a Kinematic Semantic Attention Head (K-SAH) that extends spatial attention across temporal windows. By tracking semantic patches over time, K-SAH captures rich kinematic signatures without requiring large-scale video datasets. Extensive experiments demonstrate that SapiensID 2.0 achieves state-of-the-art performance across image- and video-based person re-identification and gait recognition, while maintaining robust face recognition capabilities.

[40] DSAR: Dual-Stream Autoregressive Modeling of Temporal Cloth Dynamics for Photorealistic Animatable Avatars cs.CVPDF

Haozhong Xiong, Yao Yu, Yu Zhou, Sidan Du

TL;DR: 本文提出DSAR，一种双流自回归框架，用于从RGB视频创建具有真实感且时间一致的动画化人体化身。该方法通过显式建模可观察的几何信息和隐式内部状态，解决了现有方法在捕捉真实布料动态方面的不足，从而显著提升了渲染质量、时间一致性和对训练分布外运动模式的泛化能力。

Details

Motivation: 现有方法从RGB视频创建动画化人体化身时，难以捕捉真实的布料动态，常产生过度平滑的外观或对分布外姿态的严重伪影。其根本原因在于忽视了布料物理中固有的时间因果性，即当前状态是由先前状态通过时间演化而来，而非仅由瞬时骨骼配置决定。

Result: 在具有挑战性的数据集上的实验表明，该方法在渲染质量、时间一致性和对超出训练分布的运动模式的泛化能力方面均有显著提升，验证了双流时间建模能够实现真实的布料动态。

Insight: 核心创新在于提出了一个双流自回归框架，显式建模了布料动态的时间因果结构。具体包括：一个几何流传播前一帧的表面位移，一个状态流融合当前特征与从记忆库检索的历史状态，并结合了运动自适应聚合与自适应正则化来平衡平滑性与灵活性。

Abstract: Creating photorealistic and temporally coherent animatable human avatars from RGB videos remains challenging. Current methods struggle to capture realistic cloth dynamics, producing over-smoothed appearance or severe artifacts on out-of-distribution poses. This limitation stems from a fundamental oversight: existing approaches neglect the temporal causality inherent in cloth physics, where current states emerge from previous states through temporal evolution rather than instantaneous skeletal configurations alone. Without explicit modeling of this causal structure, networks learn pose-appearance correlations instead of motion evolution, leading to poor generalization. We introduce a dual-stream autoregressive framework that explicitly models both observable geometric information and implicit internal state. The geometric stream propagates surface displacement from the previous frame, while the state stream fuses current features with historical states retrieved from a memory bank. Motion-adaptive aggregation handles spatially-varying dynamics, and adaptive regularization balances smoothness with flexibility. Experiments on challenging datasets demonstrate significant improvements in rendering quality, temporal consistency, and generalization to motion patterns beyond training distributions, validating that dual-stream temporal modeling enables realistic cloth dynamics.

[41] SafeCap: Improving LVLM Safety with Image Captioning Reinforcement Learning cs.CV | cs.AIPDF

Caoyuan Ma, Wenpu Liu, Weichu Xie, Tian Gu, Shilei Zhao

TL;DR: SafeCap是一个通过强化学习框架提升大型视觉语言模型安全性的方法，它训练策略模型先生成与安全相关的图像描述，再生成最终答案，并通过冻结的LLM评估描述是否有助于做出安全对齐的决策。该方法在五个多模态安全基准和六个视觉效用基准上显著提升了安全性，同时保持了视觉效用。

Details

Motivation: 解决大型视觉语言模型因视觉输入而容易受到越狱攻击的问题，这些攻击会绕过从语言骨干继承的安全对齐机制。

Result: 在四个模型设置下，安全平均分提升了3.7-19.0点，在匹配骨干和数据的情况下，优于安全SFT、DPO和SafeGRPO，达到了SOTA水平。

Insight: 创新点在于通过基于描述的强化学习目标，鼓励模型暴露与安全响应生成相关的视觉线索，而不是仅依赖直接的拒绝监督，从而提升多模态安全对齐效果。

Abstract: Large vision-language models (LVLMs) remain vulnerable to jailbreak attacks that exploit visual inputs to bypass safety alignment inherited from their language backbones. We propose SafeCap, a reinforcement-learning framework that aligns LVLMs through learned self-captioning. SafeCap trains a policy model to first generate a safety-relevant image caption and then produce a final answer; the caption is further optimized by whether it enables a frozen LLM to reach a safety-aligned decision. This caption-mediated objective encourages the policy to expose visual cues relevant to safe response generation rather than relying solely on direct refusal supervision. Across five multimodal safety benchmarks and six vision-utility benchmarks, SafeCap substantially improves aggregate safety performance under its intended DirectCap protocol, with gains of 3.7-19.0 points in safety average across four model settings while maintaining comparable or improved vision utility. Under controlled comparisons on matched backbones and data, SafeCap outperforms safety SFT, DPO, and SafeGRPO, demonstrating the effectiveness of caption-mediated reinforcement learning for multimodal safety alignment.

[42] SparSTAR: Sparse Attention for SpaceTime AutoRegressive Video Synthesis cs.CVPDF

Jongbeom Lee, Hyunwoo Yu, Jincheol Yang, Jaemin Choi, Suk-Ju Kang

TL;DR: SparSTAR是一种为InfinityStar视频自回归生成模型设计的免训练块稀疏注意力方法，旨在解决其多尺度、跨片段上下文导致的后期尺度注意力计算成本高昂问题。该方法通过动态评分和选择关键块，在保持所有token和细化尺度的同时，实现了约1.6倍的端到端加速，且视频生成质量接近原始密集模型。

Details

Motivation: InfinityStar将视觉自回归生成扩展到视频，但其变化的尺度和跨片段上下文使得后期尺度的注意力计算成本高昂，且从扩散或图像VAR模型迁移的稀疏模式不可靠。

Result: 在720p文本到视频和图像到视频生成任务中，SparSTAR在保持VBench评估和配对输出重建保真度接近密集InfinityStar的同时，提供了约1.6倍的端到端加速。

Insight: 创新点在于提出了一种针对视频自回归生成中多尺度注意力动态特性的免训练块稀疏注意力机制，通过在每个目标尺度重新计算块选择而非复用迁移的掩码，更可靠地适应关键块的动态变化，平衡了效率与质量。

Abstract: InfinityStar extends visual autoregressive generation to video through a sequence of image and clip pyramids. Its changing scale and cross-clip context, however, leave late-scale attention costly and make sparse patterns reused from diffusion or image VAR models unreliable. We introduce SparSTAR, a training-free block-sparse attention method tailored to this setting. At each expensive scale and attention head, SparSTAR scores contiguous key blocks from the current query and key activations, retains required conditioning context, and executes the selected blocks through a forward-only sparse path. We analyze cross-scale consistency within a clip, pattern persistence across clip boundaries, and quality degradation as reuse spans increasingly distant scales. Across these analyses, important key blocks shift, showing that recomputing block selection at each target scale is more reliable than reusing a transferred mask. On 720p text-to-video and image-to-video generation, SparSTAR preserves every token and refinement scale while providing about a 1.6x end-to-end speedup and maintaining VBench and paired-output reconstruction fidelity close to dense InfinityStar.

[43] Unlocking the Power of Medical Tabular Data via Semantic-Aware Multimodal Pre-training cs.CV | cs.AIPDF

Yingsheng Liu, Haiming Li, Jingmin Zhu, Jiajun Sun, Victoria Mar

TL;DR: 本文提出了一种语义感知的多模态预训练框架，专门用于处理医学表格数据。该框架通过重要性感知自适应掩码和软标签离散化模块，有效建模表格数据的二维结构，并在大规模皮肤病学和眼科学数据集上实现了新的最先进性能。

Details

Motivation: 现有视觉语言模型在医学表示学习中占主导地位，但非结构化文本缺乏结构化临床表格中固有的密集、定量诊断表型。现有方法未能充分利用表格数据的潜力，因为它们采用语义无关的设计，将表格输入视为扁平向量并使用不稳定的连续回归目标。

Result: 在大规模皮肤病学数据集（SLICE-3D, HOP）和眼科学数据集（EyePACS）上进行的广泛实验表明，该方法建立了新的最先进水平，展示了卓越的鲁棒性和跨领域泛化能力。

Insight: 创新点在于明确建模表格数据内在的二维结构：1）通过重要性感知自适应掩码处理特征间层次结构，构建无标签课程以优先处理显著特征；2）通过软标签离散化模块处理特征内连续-离散二象性，用稳定的分布匹配替代不稳定的数值回归，从而在数学上保持序数关系。

Abstract: While vision-language models dominate medical representation learning, unstructured text lacks the dense, quantitative diagnostic phenotypes inherent in structured clinical tables. However, existing multimodal pre-training methods underutilize this potential due to semantic-agnostic designs that treat tabular inputs as flat vectors and employ unstable continuous regression objectives. To overcome this, we propose a novel semantic-aware framework explicitly modeling the intrinsic two-dimensional structure of tabular data. First, addressing the inter-feature hierarchy of varying diagnostic importance, we introduce Importance-Aware Adaptive Masking to construct a label-free curriculum prioritizing salient features. Second, addressing the intra-feature continuity-discreteness duality, we propose a Soft-Label Discretized Module that replaces unstable numerical regression with stable distribution matching, thereby mathematically preserving ordinal relationships. Extensive experiments across large-scale dermatology (SLICE-3D, HOP) and ophthalmology (EyePACS) datasets establish a new state-of-the-art (SOTA), demonstrating exceptional robustness and cross-domain generalizability.

[44] Rethinking Text-Based Image Retrieval in Specific Domain cs.CV | cs.AIPDF

Jingyang Tan, Sheng Yang, Yuanpeng Chen, Jian Wang, Nianjin Ye

TL;DR: 本文针对特定领域（如监控）中基于文本的图像检索任务，指出现有通用基准基于单一匹配假设的局限性，并构建了一个包含多匹配场景的监控领域新基准SecMM-TBIR。同时，论文提出了一种语义感知微调框架SAFT，通过语义感知软标签监督和模态内结构蒸馏来缓解领域内对比学习中的假阴性问题，从而提升检索性能。

Details

Motivation: 现有基于文本的图像检索基准通常假设一个查询只对应一张相关图像，但这在特定领域（如监控）中不成立，因为一个查询往往对应多张相关候选图像，导致现有方法无法准确评估实际系统性能。

Result: 在提出的SecMM-TBIR基准上，SAFT框架相比标准的图像-文本对比微调，在多种CLIP类模型上平均mAP@20提升了7.8个百分点，同时也能提升通用领域的性能。

Insight: 创新点在于构建了针对特定领域多匹配场景的TBIR基准，并提出了SAFT微调框架，通过软标签监督和结构蒸馏来缓解领域内语义压缩和假阴性问题，为领域特定TBIR任务提供了一个有前景的范式。

Abstract: Driven by the rapid advancement of vision-language representation learning, Text-based Image Retrieval (TBIR) has made notable progress. However, existing benchmarks are predominantly constructed on an exclusive single-match assumption between query and images. While effective in general scenarios, this assumption fails to reflect practical system performance in specific domains (e.g., surveillance), where a single query often corresponds to multiple relevant candidate images. To address this limitation, we design a Domain-Specific Multi-Match Text-based Image Retrieval (DSMM-TBIR) data engine. Leveraging this engine, we construct Security Multi-Match TBIR (SecMM-TBIR), a benchmark comprising 50k surveillance images with 200 comprehensive queries. Furthermore, we observe that vanilla contrastive learning in specific domains suffers from severe false negatives, forcing the model to push apart semantically similar pairs and thus degrading retrieval performance. We propose the Semantic-Aware Fine-Tuning (SAFT) framework to address semantic compression in specific domains, which incorporates Semantic-Aware Soft-Label Supervision (SASS) and Intra-modal Structural Distillation (ISD) to establish a promising paradigm for domain-specific TBIR tasks. Experiments across diverse CLIP-like models demonstrate that SAFT yields an average mAP@20 gain of 7.8 points on SecMM-TBIR over standard image-text contrastive (ITC) fine-tuning, while also improving general-domain performance. The entire benchmark will be released to facilitate further research.

[45] Dynamic Context Adapters: Efficiently Infusing History into Vision-and-Language Models cs.CV | cs.AIPDF

Yuhang Song, Bor-Jiun Lin, Jiaxu Liu, Te-Chuan Chiu, Anh Nguyen

TL;DR: 本文提出了一种名为动态上下文适配器（DCA）的新方法，用于将历史信息高效地注入到预训练的视觉语言模型（VLMs）中，以解决其在序列决策任务中缺乏时序理解能力的问题。该方法通过固定大小的动态压缩记忆来保存历史语义，避免了直接拼接历史帧带来的计算开销和内存消耗。

Details

Motivation: 当前视觉语言模型在处理视觉输入时是独立的，缺乏对时序上下文的理解，这限制了其在需要历史信息的下游应用中的性能。现有方法要么计算开销大，要么因时间压缩导致信息丢失严重。

Result: 在长视野任务上，DCA在提升性能的同时，将注意力浮点运算次数（FLOPs）减少了超过25%，并节省了13%的内存。

Insight: 创新点在于提出了一种动态压缩记忆机制，在不改变预训练模型结构的前提下，以固定大小的记忆单元高效地注入历史上下文，从而在计算效率和性能之间取得了良好平衡，为静态VLMs赋予了类似循环策略的记忆能力。

Abstract: Historical context integration presents a fundamental challenge for Vision-Language Models (VLMs) in sequential decision-making tasks. Current VLMs process visual inputs independently, which creates critical limitations for downstream applications that require temporal understanding. Direct incorporation of historical frames into Transformer inputs produces quadratic attention complexity and excessive memory consumption. Existing approaches suffer from significant drawbacks: computational inflation or substantial information loss through temporal compression. To address these challenges, we introduce Dynamic Context Adapter (DCA), a novel context injection approach for pretrained VLMs. Our method employs fixed-size, dynamically compressed memory to preserve historical semantics without frame concatenation. DCA bridges static VLMs and recurrent policies and enables memory capabilities in pretrained models while maintaining computational efficiency. DCA achieves over $25%$ reduction in attention FLOPs and $13%$ memory savings while improving performance on long-horizon tasks.

[46] Rethinking Data Efficiency in Industrial Dense Prediction: Pretraining Coherence, Not Inductive Bias, Determines ViTs Low-Data Advantage cs.CVPDF

Haoran Sui, Yaoyuan Jia

TL;DR: 本文通过四个工业数据集上的实验，重新审视了视觉Transformer（ViT）在密集预测任务中的数据效率问题。研究发现，ViT与CNN之间的数据效率差距主要源于预训练不一致性（即ImageNet预训练的ViT主干与COCO预训练的CNN颈部之间的统计不匹配），而非自注意力机制的固有缺陷。作者提出了轻量级的AlignBlock系列模块进行特征重校准，并实证识别了数据效率边界：在领域接近场景中，Swin-Graft在少量样本下超越YOLOv11x；在领域遥远场景中，CNN仍保持优势。

Details

Motivation: 针对工业密集预测任务中普遍认为ViT比CNN需要更多标注数据的观点，本文旨在探究其根本原因，挑战了自注意力机制本身导致数据效率低下的固有认知。

Result: 在领域接近场景（≥200样本）中，Swin-Graft在703-shot下达到0.973 mAP@50，超越YOLOv11x的0.956 mAP@50；在领域遥远场景（141-shot）中，CNN优势明显（0.900 vs 0.600 mAP@50）。嫁接的颈部权重使mAP最高达到随机初始化颈部的2.5倍。

Insight: 创新点在于将数据效率差距归因于预训练不一致性而非模型架构本身，并提出了特征对齐模块（AlignBlock）进行跨架构特征重校准。客观来看，该研究为模型选择和数据策略提供了新的实证依据，强调了预训练一致性的重要性。

Abstract: Vision Transformers (ViTs) are widely believed to require more labeled data than CNNs for industrial dense prediction. Through controlled experiments on four industrial datasets, we show that the data-efficiency gap stems from pretraining incoherence, which refers to the statistical mismatch between ImageNet-pretrained ViT backbones and COCO-pretrained CNN necks, rather than from inherent self-attention deficits. We characterize the cross-architecture feature gap and propose a lightweight AlignBlock family for pyramid-level feature recalibration. Our core finding empirically identifies a data-efficiency frontier: for domain-proximal scenes with >= 200 samples, Swin-Graft surpasses YOLOv11x (terminal 703-shot: 0.973 vs 0.956 mAP@50); for domain-distant scenes, CNNs retain advantage (hook 141-shot: 0.900 vs 0.600 mAP@50). Grafted neck weights yield up to 2.5x the mAP of a randomly initialized neck.

[47] Gaussian Sculpting: End-to-End Controllable Surface Reconstruction via Field Optimization cs.CV | cs.GRPDF

Ke Jiaxin, Juncheng Liu, Yi Wang, Zhouhui Lian, Bin Liu

TL;DR: 本文提出Gaussian Sculpting，一种端到端可微的表面重建框架，通过将3D高斯锚定在可微表面上，并采用双层训练策略联合优化符号距离场（SDF）与高斯参数，以解决3D高斯溅射在有限视角下表面重建不准确的问题。

Details

Motivation: 3D高斯溅射（3DGS）在实时新视角合成中表现出色，但在有限视角下难以恢复精确表面，且高斯基元的固有不规则性导致几何误差难以手动修正。

Result: 在物体级场景上的实验表明，该方法能有效去除冗余表面、恢复因有限视角缺失的结构，并在相对低分辨率下实现高质量重建。

Insight: 核心创新在于将高斯锚定在演化表面上以指导SDF优化，而非后处理提取；采用双层训练策略稳定梯度隔离，并引入基于八叉树的多分辨率细分方案以平衡细节与内存消耗。

Abstract: 3D Gaussian Splatting (3DGS) has recently enabled real-time novel view synthesis with impressive quality. However, it struggles to recover accurate surfaces under limited viewpoints and due to the inherent irregularity of Gaussian primitives. The resulting geometric errors are notoriously difficult to correct manually. To address these issues, we propose Gaussian Sculpting, a fully differentiable end-to-end framework for high-quality surface reconstruction. Our key insight is to anchor Gaussians onto an evolving differentiable surface, allowing them to guide signed distance field (SDF) optimization instead of extracting the surface only during post-processing. To enable stable gradient isolation during joint optimization, we design a bi-level training strategy in which the outer loop optimizes the geometry represented by the SDF, while the inner loop updates the Gaussians with the geometry fixed. We further impose constraints on Gaussian parameters to ensure consistency with the underlying surface, thereby improving both geometric and appearance fidelity during optimization. In addition, we introduce a multi-resolution subdivision scheme based on octree-like partitioning to preserve fine details while reducing memory consumption. Experiments on object-level scenes demonstrate that our method effectively removes redundant surfaces, recovers missing structures caused by limited viewpoints, and achieves strong reconstruction quality even at relatively low resolutions.

[48] InSight-doc: Agentic Visual Perception for Long-Document Understanding cs.CV | cs.CL | cs.LGPDF

Kaican Li, Weiyan Xie, Lewei Yao, Jiannan Wu, Lanqing Hong

TL;DR: 本文提出了InSight-doc，一种用于长文档理解的智能视觉感知框架。该框架将视觉分辨率视为一种自适应的推理时资源，从低分辨率开始，有选择性地放大高分辨率区域以获取更精细的证据，无需依赖外部检索器。通过构建包含区域级放大轨迹的高质量数据集并进行SFT+RL训练，该模型在文档VQA基准测试上显著提升了性能，同时大幅降低了长文档推理时的幻觉和延迟。

Details

Motivation: 解决长文档理解中因需要处理大量视觉丰富的页面而导致的推理成本高昂、容易产生上下文信息衰减（context rot）的问题。

Result: 在文档VQA基准测试上，InSight-doc-8B模型比基线模型提升了4.3到16.4个准确率点。在长文档上，幻觉减少了40%以上，推理延迟降低了41%到68%，同时保持了准确率优势。

Insight: 核心创新在于将视觉分辨率建模为一种可自适应分配的推理资源，通过智能体（agent）决策在推理时动态选择性地放大关键区域，这是一种新颖的、端到端的、无需外部检索器的视觉感知范式。从客观角度看，其构建的包含主动感知轨迹（zoom-in trajectories）的大规模高质量训练数据集（SFT+RL样本）是该方法成功的关键支撑。

Abstract: Long-document understanding often requires reasoning over many visually rich pages, making inference costly and prone to context rot. In this work, we propose InSight-doc, an agentic visual perception framework that treats visual resolution as an adaptive reasoning-time resource. InSight-doc starts from low resolution and selectively zooms into high-resolution regions for finer evidence, without relying on any external retriever. To train such an agent, we construct an active-perception corpus of 17.9K high-quality SFT examples with region-level zoom-in trajectories, accompanied by 19.2K hard RL examples. Through SFT+RL, InSight-doc-8B improves the baseline by 4.3–16.4 accuracy points over document VQA benchmarks. On long documents, it reduces hallucination by more than 40% and inference latency by 41%–68% while maintaining an accuracy lead. Our code, datasets, and model are released at https://github.com/m-Just/InSight-doc .

[49] MedUP: Awakening Unified Understanding and Perception in Medical Vision-Language Models cs.CV | cs.AIPDF

Yuan Wang, Hualiang Wang, Yixin Chen, Songtao Jiang, Shujian Gao

TL;DR: 本文提出了MedUP，一种在医学视觉-语言模型中统一理解和感知的框架。其核心是UniMedTok区域分词器，将掩码编码为LLM词汇表中的离散标记，使模型能在文本中无缝穿插掩码标记。作者构建了包含184万实例的UniMed-Train训练集和UniMed-Bench评估基准，实验表明MedUP在多种任务上优于现有方法，并与专业分割模型保持竞争力。

Details

Motivation: 现有医学视觉-语言模型擅长描述视觉内容，但在精确视觉感知、分割和定位方面存在挑战，且现有方法要么将区域表示为坐标字符串，要么依赖外部模块，导致感知与理解解耦，造成区域-语言对齐的表征差距。

Result: MedUP在文本引导分割、区域基础理解、医学视觉问答和基于思维链的分割等任务上，均优于原生、代理式和双解码器的医学视觉-语言模型，同时与专业分割模型保持竞争力，在UniMed-Bench上进行了统一评估。

Insight: 创新点在于提出了UniMedTok区域分词器，将掩码编码为离散标记并融入LLM词汇表，实现了在共享标记空间中统一感知和理解，从而避免了外部模块带来的表征差距，提升了区域-语言对齐能力。

Abstract: Medical Vision-Language Models (Med-VLMs) excel at verbalizing visual content, yet precise visual perception, segmentation, and grounding remain challenging. Existing approaches either verbalize regions as coordinate strings or rely on external modules that decouple perception from understanding, creating representation gaps for region-language alignment. We present MedUP, a Med-VLM that natively unifies perception and understanding within a shared token space. At its core lies UniMedTok, a region tokenizer that encodes masks as discrete tokens in the LLM vocabulary, enabling the model to seamlessly interleave mask tokens with text. We curate UniMed-Train, a 1.84M-instance corpus spanning text-guided segmentation, region-grounded understanding, medical VQA and CoT-based segmentation, and introduce UniMed-Bench for unified evaluation. Extensive experiments show that MedUP outperforms native, agentic, and dual-decoder Med-VLMs across all tasks while remaining competitive with specialist segmentors, demonstrating the strong potential of unified understanding and perception modeling.

[50] PolypVision: A Three-Stage Hierarchical Deep Learning Framework for Classification and Segmentation of Colorectal Polyps cs.CVPDF

Hamidreza Bolhasani, Hamidreza Rastad, Amir Mohammad Akbari, Mohammad Tashakoripour, Parnian Asadollahi

TL;DR: 本文提出了PolypVision，一个用于结直肠息肉分类和分割的三阶段分层深度学习框架。该框架依次执行息肉的内镜和组织学分类、分割以及腺瘤亚型分类，在多个公共数据集上实现了优异的性能，并提供了可公开访问的Web应用。

Details

Motivation: 结直肠癌是全球癌症相关死亡的主要原因之一，通常由癌前息肉发展而来。准确检测、分割以及内镜和组织学分类对于及时临床干预至关重要。

Result: 在PolypGen、Kvasir-SEG和CVC-ClinicDB三个公共数据集上评估，PolypVision在帧分类上AUC约0.99，在Kvasir-SEG数据集上检测mAP@50达到94.4%，优于或匹配现有最先进方法。

Insight: 创新点在于提出了一个分阶段、基于迁移学习的流水线，结合了任务特定的损失函数，实现了鲁棒且与设备无关的自动化息肉分析。Grad-CAM可视化确认了模型关注临床相关特征，增强了可解释性。

Abstract: Colorectal cancer (CRC) remains one of the leading causes of cancer-related mortality worldwide, predominantly arising from precancerous polyps. Accurate detection, segmentation, and endoscopic and histological classification of colorectal polyps are crucial for timely clinical intervention. In this study, we present PolypVision, a three-stage hierarchical deep learning framework that sequentially performs: (Stage 1) binary classification of polyps as adenomatous or hyperplastic, with simultaneous Paris and JNet classification, using EfficientNetV2-M with Focal Loss; (Stage 2) polyp segmentation with recommended resection method using a UNet++ decoder with the Stage 1 backbone as encoder, optimized with Dice and BCE losses; and (Stage 3) adenoma subtype classification (tubular, tubulovillous, villous) using EfficientNetV2-M with transfer learning from Stage 2. Evaluated on three public datasets – PolypGen, Kvasir-SEG, and CVC-ClinicDB – PolypVision achieves an AUC of approximately 0.99 for frame classification and a detection mAP@50 of 94.4% on Kvasir-SEG, outperforming or matching state-of-the-art methods. Gradient-weighted Class Activation Maps (Grad-CAM) confirm that the model attends to clinically relevant lesion features. The framework is device-independent, operating across diverse endoscopic imaging systems without hardware-specific adaptation. These results demonstrate that a hierarchical, transfer-learning-driven pipeline with task-specific loss functions offers a robust, device-independent, and clinically meaningful approach to automated colorectal polyp analysis. PolypVision is freely available as a web application at https://polypvision.com, a DataBioX initiative, with a free usage tier open to all users.

[51] Chartography: A Benchmark for Professional Chart Understanding cs.CVPDF

Suhaas Garre, Chris Mutty, Sushant Mehta, Edwin Chen

TL;DR: 本文提出了Chartography基准测试，这是一个包含100个任务的图表理解基准，这些图表源自专业实践，采用特定领域格式，并由专业人士编写问题。该基准旨在评估模型在复杂、专业图表上的理解能力，现有前沿模型在该基准上的平均通过率仅为45.0%，表明其在视觉感知方面存在显著不足。

Details

Motivation: 现有图表基准测试主要包含条形图、折线图和饼图等简单格式，推理链较短且已接近饱和（前沿模型得分达80-90%），无法充分衡量模型在专业、复杂图表上的实际决策能力。

Result: 在评估30种前沿模型配置（每个任务20次评分试验）后，最佳配置的平均pass@1仅为45.0%，其余配置分布在9.0%至39.5%之间，失败主要集中在视觉感知方面。

Insight: 创新点在于构建了一个源自真实专业实践、包含多样领域特定图表格式的基准，并由领域专家编写和验证问题，揭示了当前模型在理解复杂视觉特征（如稀疏标注轴、投影3D几何、领域惯例）方面的根本性局限。

Abstract: Professionals across medicine, engineering, finance, manufacturing, and the sciences often make consequential decisions from charts. Existing chart benchmarks do not sufficiently measure this ability: they are dominated by bar, line, and pie formats, rely on shorter reasoning chains, and are nearing saturation, with frontier models already scoring 80-90%. We introduce Chartography, a benchmark of 100 tasks that pair charts drawn from professional practice, in domain-specific formats that standard chart benchmarks rarely include, with questions written by professionals who read these charts for a living and independently verified by three additional experts. In an evaluation of 30 frontier-model configurations (20 scored trials per task), the best configuration reaches only 45.0% mean pass@1; the remainder span 9.0-39.5%. Failures concentrate in visual perception: models can miss nuanced features, misread values along sparsely labeled axes, mishandle projected 3D geometry, and violate domain conventions encoded in the chart. We release all tasks, images, provenance metadata, and evaluation code.

Qi Ming, Yuyang Wang, Mingjing Zhao, Yifan Xiao, Zhixin Guo

TL;DR: 本文提出了一种名为JFRDet的端到端可见光-红外目标检测网络，专门用于处理严重的跨模态几何错位问题。该方法通过跨模态仿射对齐模块进行显式的多层次特征对齐，并利用光照引导的互补融合模块自适应地融合模态信息，同时引入对齐质量一致性门控策略来稳定联合优化。

Details

Motivation: 现有方法主要依赖隐式特征适应处理弱错位场景，对严重跨模态几何错位问题解决不足，因此需要开发能显式处理大偏移几何差异的检测方法。

Result: 在构建的DVMA基准测试上，JFRDet达到了69.7% mAP50，取得了最先进的性能。

Insight: 创新点包括显式的图像级仿射变换估计进行特征对齐、光照条件自适应的模态融合策略，以及通过对齐可靠性和梯度一致性调制检测监督的联合优化稳定机制。

Abstract: Visible-infrared object detection relies on complementary RGB and thermal cues, but its performance is often degraded by cross-modal spatial misalignment. Most existing methods rely on implicit feature adaptation to handle weakly misaligned scenarios, while large-offset geometric discrepancies remain insufficiently addressed. In this paper, we propose a Joint Feature-domain Registration and Detection network (JFRDet), an end-to-end visible-infrared oriented object detector tailored for severely cross-modal geometric discrepancies. JFRDet introduces a Cross-Modal Affine Alignment (CMAA) module to estimate an image-level affine transformation for explicit multi-level feature alignment. Note that illumination changes directly affect the reliability of RGB cues, an Illumination-Guided Complementary Fusion (IGCF) module adaptively exploits modality reliability under varying illumination conditions for cross-modal fusion. Then, an Alignment Quality-Consistency Gating (AQCG) strategy stabilizes joint optimization by modulating detection supervision according to alignment reliability and gradient consistency. We further construct DroneVehicle Misaligned (DVMA), a benchmark for evaluating visible-infrared oriented object detection under severe cross-modal geometric misalignment. The proposed JFRDet achieves 69.7% $\mathrm{mAP}_{50}$ on DVMA, which represents state-of-the-art (SOTA) performance. The code and dataset will be available on GitHub.

[53] MMArt A Multi-Perspective Multimodal Dataset for Visual Art Understanding cs.CV | cs.MMPDF

Shuai Wang, Wangyuan Ding, Yixian Shen, Jia-Hong Huang, Stevan Rudinac

TL;DR: 本文介绍了MMArt，一个用于视觉艺术理解的大规模多视角多模态数据集，包含74,234幅WikiArt画作，每幅作品都配有叙事、形式、情感和历史四个独立注释视角以及一个统一的标题。研究通过生成和判别分析表明，不同视角编码了独特信息，且单一视角不足以应对所有任务，从而论证了多视角设计的必要性。

Details

Motivation: 现有视觉语言模型在艺术理解上表现肤浅，仅能描述表面内容，而无法进行形式分析、历史解读或情感刻画。作者认为这不仅是模型限制，也是数据集局限，因为现有艺术数据集都是单一视角的，缺乏同时涵盖多个视角的标注。

Result: 在生成分析中，形式分析描述最能保留构图风格，历史描述在重建图像中携带强烈情感信号。在判别性检索分析中，叙事描述驱动检索（R@1 = 44.0%），而形式描述在检索规模上几乎无区分度（R@1 = 7.8%）。留一分析进一步证实历史描述在两个任务中都是最不可替代的视角。

Insight: 创新点在于构建了首个大规模多视角艺术数据集，通过互补性分析论证了不同艺术视角编码信息的独特性，并揭示了任务不对称性，为未来艺术理解模型提供了更全面的训练和评估基础。

Abstract: Recent vision-language models demonstrate impressive general visual understanding, yet their art interpretation remains shallow: they describe surface content but struggle with formal analysis, grounded historical interpretation, or affective characterization. We argue this is not only a model but also a dataset limitation. Existing art datasets are single perspective resources, where no dataset provides narrative, formal, emotional, and historical perspectives simultaneously for the same artworks. We introduce MMArt, a large-scale dataset of 74,234 WikiArt paintings, each annotated with four independently annotated perspectives plus a harmonized unified caption, produced by specialized vision-language models or human annotation and validated through complementary quality evaluations. Two complementarity analyses establish that perspectives encode genuinely distinct information. A generative analysis shows that formal analysis descriptions best preserve compositional style, and historical descriptions carry strong affective signal in reconstructed images. A discriminative retrieval analysis reveals task-asymmetry: narrative descriptions drive retrieval (R@1 = 44.0%), while formal descriptions, strongest for reconstruction, are nearly nondiscriminative at retrieval scale (R@1 = 7.8%). Leave-one-out analysis further confirms that historical descriptions are the least replaceable perspective across both tasks. Together, the two analyses establish that no single perspective suffices for all tasks, directly motivating MMArt multi-perspective design. The dataset, code, and additional information are available at https://shuaiwang97.github.io/MMArt/.

[54] Self-Geometry: GT-Free and Plug-and-Play Test-Time Adaptation for Geometrically Consistent 3D Vision Foundation Models cs.CVPDF

Seokhyun Youn, Dahyeon Kye, Sung-Ho Bae, Jihyong Oh

TL;DR: 本文提出了一种名为Self-Geometry的即插即用测试时自适应方法，用于增强3D视觉基础模型的多视图几何一致性。该方法通过利用模型预测的2D像素对应关系作为伪真值，直接施加显式的几何约束，避免了传统隐式自一致性方法的性能瓶颈，并在多个模型和基准测试上提升了姿态和几何估计的准确性。

Details

Motivation: 现有的视觉基础模型在单次前向传播中预测深度、相机姿态和点云，但缺乏显式的多视图几何一致性约束，导致预测结果可能不一致。传统的隐式自一致性方法在测试时性能提升有限，尤其是在预训练模型预测不准确的场景中。

Result: 在六个视觉基础模型（VGGT, π³, DA3-Giant/Large/Base/Small）和四个基准测试（7Scenes, ETH3D, ScanNet++, HiRoom）上，该方法在姿态和几何估计方面均取得了持续改进，达到了最先进的性能水平。

Insight: 创新点包括：提出使用2D像素对应关系作为伪真值来施加显式几何约束；设计了几何解耦优化、基于SO(3)测地距离的帧角度邻域采样器以及轻量级LoRA适配的测试时自适应流程。这些方法有效避免了梯度冲突，并实现了高效的多视图一致性优化。

Abstract: Recent Vision Foundation Models (VFMs) predict depth, camera pose, and pointmap in a single forward pass without per-scene optimization, achieving strong generalization. However, enforcing explicit multi-view geometric consistency, e.g., through bundle adjustment, is computationally costly and is thus not imposed during VFM pretraining, so such inconsistency can arise. To address this, implicit self-consistency derived from model outputs (e.g., pointmaps, features), though enforced at test-time in prior work, delivers inherently limited performance gain, especially on scenes where the pretrained VFM is highly inaccurate. In contrast to this implicit signal, we propose Self-Geometry, a plug-and-play test-time adaptation pipeline that directly imposes explicit multi-view geometric constraints using 2D pixel correspondences as pseudo ground-truth. Our proposed Self-Geometry consists of Geometric Disentanglement Optimization, which combines Multi-View Consistency and Epipolar Consistency losses with Gradient Disentanglement to prevent gradient conflict; Frame Angular-Neighbor, a view sampler based on SO(3) geodesic distances for lightly imposing these constraints; and Lightweight TTA, which adapts VFMs via LoRA. Our method achieves consistent improvements in both pose and geometry estimation across six VFMs (VGGT, $π^3$, DA3-Giant/Large/Base/Small) and four benchmarks (7Scenes, ETH3D, ScanNet++, HiRoom).

[55] Grid-Preserving Knowledge Distillation: Transferring Convolutional Inductive Bias to Vision Transformers under Data Scarcity cs.CVPDF

Junyong Choi, Cheolhyeon Park, Jaehoon Cho

TL;DR: 本文提出了一种名为iBKD的蒸馏框架，旨在将卷积网络的归纳偏置（如局部性和平移等变性）有效地迁移到视觉Transformer中，以解决其在数据稀缺时性能不佳的问题。该方法通过一个仅在训练时使用的归纳偏置注意力模块，在整个迁移路径中保持空间网格结构，从而将卷积结构线索注入ViT学生模型，且不增加推理开销。

Details

Motivation: 动机在于视觉Transformer在训练数据稀缺时性能不如卷积网络，而现有的通用特征蒸馏方法在从CNN教师迁移到ViT学生时，由于池化、展平等操作丢弃了编码局部性和平移等变性的空间网格结构，导致迁移效果有限。

Result: 在七个Transformer主干网络和六个数据稀缺基准测试上，iBKD均优于局部性引导方法和通用知识蒸馏基线，并且随着训练数据的减少，其性能优势进一步扩大。

Insight: 创新点在于提出了一个保持网格的蒸馏框架，其核心归纳偏置注意力模块通过可学习的权重将学生层聚合到教师网格上，利用通道和可变形空间注意力增强结构线索，并通过卷积交叉注意力在网格间（而非token集间）进行注入，从而有效迁移卷积归纳偏置，且不修改部署模型。

Abstract: Vision Transformers underperform convolutional networks when training data is scarce, and distilling convolutional inductive biases from a CNN teacher is an effective remedy that leaves the deployed model unchanged. General-purpose feature distillation, however, transfers little in this setting. The pooling, flattening, and logit-space projections it inherits from CNN to CNN pipelines discard the spatial grid in which locality and translation equivariance are encoded, and unlike a convolutional student, a ViT cannot rebuild that structure on its own. In this paper, we propose iBKD, a distillation framework that preserves the grid along the entire transfer path. Its core module, the Inductive Bias Attention Module, aggregates every student layer onto the teacher grid with learned weights, sharpens structural cues with channel and deformable spatial attention, and injects them through convolutional cross-attention that operates between grids rather than between token sets. The module is used only during training, so the deployed model is an unmodified ViT with no inference overhead. Across seven Transformer backbones and six data-scarce benchmarks, iBKD outperforms both locality-guidance methods and general knowledge distillation baselines, and its margin widens as training data shrinks.

[56] InterPruner: Interactive Structured Pruning via Taylor-Implicit Criterion and Language-Prior Modulator for Multimodal Object Detection cs.CVPDF

Qi Ming, Zihan Yang, Shaoguang Huang, Si Sun, Hanqing Zhang

TL;DR: 本文提出InterPruner，首个用于RGB-红外目标检测器的交互式结构化通道剪枝框架。它通过泰勒隐式准则量化通道重要性，利用模态交互冗余分析器评估跨模态补偿性以识别冗余通道，并引入场景先验通道锚点，借助语言先验动态估计通道与场景的相关性。

Details

Motivation: 多模态目标检测（如RGB-红外）中的并行特征提取器虽然提供了丰富信息，但也引入了显著的通道冗余和计算开销。现有剪枝方法专为单模态设计，忽略了跨模态交互和动态场景冗余问题。

Result: 在RGB-红外目标检测数据集上的大量实验表明，InterPruner在保持高性能的同时，性能下降可忽略。具体而言，在FLIR数据集上剪枝50%通道时，mAP甚至提升了0.6%。

Insight: 创新点在于首次探索RGB-红外检测的跨模态通道剪枝，并提出了结合高阶泰勒展开与隐函数定理的通道重要性量化准则，以及利用语言先验作为语义锚点来动态评估通道-场景相关性的方法。

Abstract: Multimodal object detection proves effective in remote sensing, especially the RGB-Infrared paradigm. The parallel feature extractors provide rich multimodal information for robust detection, yet introduce substantial channel redundancy and computational overhead. Existing pruning methods can reduce channel redundancy, but they are designed for unimodal backbones, overlooking cross-modal interactions and dynamic scene-wise redundancy. In this paper, we propose InterPruner, the first interactive structured channel pruning framework for RGB-infrared object detectors. Specifically, we first derive a Taylor-Implicit Criterion(TIC) to quantify channel importance via high-order Taylor expansion and the implicit function theorem. Then, a Modality Interaction Redundancy Analyzer (MIRA) identifies redundant channels via mutual compensability assessment. Finally, a Scene-Prior Channel Anchor (SPCA) uses language priors as semantic anchors to measure channel-scene relevance for dynamic channel importance estimation. Cross-modality channel pruning for RGB-Infrared detection is yet unexplored. Extensive experiments on RGB-infrared object detection dataset demonstrate that InterPruner maintains high performance with negligible degradation. Specifically, it even achieves a 0.6% mAP increase on the FLIR dataset when pruning 50% of the channels. Code will be available on GitHub to facilitate future work.

Uma Ranjan, Kunal Tilaganji, Aditya Koul, Anurag Mahipal, Dashpreet Singh

TL;DR: 本文针对大语言模型在医学应用中因依赖捷径而非系统推理引发的安全问题，提出了一种两阶段框架来管理医学假设验证中的覆盖范围与准确性权衡。该框架通过仅在模型弃权时应用有针对性的本体论基础，将弃权重新用作选择性推理细化的控制信号。

Details

Motivation: 解决大语言模型在医学应用（如假设验证）中因依赖捷径推理而带来的安全隐患，并管理模型因不确定性而弃权时产生的覆盖范围与准确性之间的权衡问题。

Result: 在两个前沿模型（GPT-5.5和DeepSeek-R1）上，该框架在MedReason和MedQA基准测试中将问题级准确率提升了9.6个百分点（从82.9%到92.5%），假设级准确率提升了4.2个百分点（从92.0%到96.2%），达到了知识图谱级别的性能。

Insight: 创新点在于将模型的弃权行为重新定义为一种控制信号，用于触发有针对性的选择性推理细化（即本体论基础），从而在不显式构建知识图谱的情况下提升验证性能，并证实了弃权行为反映了模型真实的不确定性而非随机性。

Abstract: Large language models (LLMs) often rely on shortcuts rather than systematic reasoning, raising safety concerns in medical applications. Allowing models to abstain when uncertain improves reliability but introduces a coverage accuracy tradeoff. We propose a two-stage framework for medical hypothesis verification in multiple-choice settings that manages this tradeoff through targeted ontology grounding, applied only when the model abstains. We show that abstention is not random but reflects genuine uncertainty, with abstained predictions associated with lower confidence. Across two frontier models (GPT-5.5, accessed via the Azure OpenAI API, and DeepSeek-R1), the proposed framework improves question-level accuracy by 9.6 percentage points (82.9% to 92.5%) and hypothesis-level accuracy by 4.2 percentage points (92.0% to 96.2%). Our experiments conducted on MedReason and MedQA show that abstention can be repurposed as a control signal for selective reasoning refinement, achieving knowledge-graph-level performance without explicit knowledge graph construction.

[58] Beyond Pixels: From Video Priors to 4D Worlds cs.CVPDF

Zihao Liu, Xiaolong Shen, Zhenglin Zhou, Ruijie Quan, Yi Yang

TL;DR: 该论文提出了一种名为Latent-to-4D的新方法，用于从文本或图像条件生成动态3D场景（4D生成）。该方法的核心创新在于直接利用视频扩散模型的去噪潜在空间作为接口，与预训练的4D解码器对齐，从而绕过RGB视频生成步骤，避免了分布不匹配和错误传播问题。

Details

Motivation: 现有4D生成方法存在两大问题：一是基于RGB视频重建的方法存在分布不匹配和误差传播；二是直接适配特定视频生成器的方法缺乏通用性，难以复用。本文旨在探索一种可重用、与具体生成器解耦的潜在空间接口，以实现更高效、通用的4D生成。

Result: 在Text4D-200和I4D-200基准测试上，Latent-to-4D在基于投影的DINO-F1指标上分别比同潜在空间的Wan+4RC级联方法高出2.88-3.45和5.81个百分点。在人类评估中，其在几何质量、时间稳定性和整体质量方面也更受青睐。

Insight: 主要创新点在于提出了“直接潜在到4D生成”的范式，将视频模型的去噪潜在空间作为通用中间表示，通过帧级和全局时空注意力机制与预训练4D解码器对齐。这种方法实现了与同一VAE家族内多个视频扩散变换器的即插即用，仅需约1K个重建片段训练，展现了良好的可迁移性和效率。

Abstract: 4D generation synthesizes dynamic 3D scenes from conditions such as text or images. Existing methods either reconstruct generated RGB videos with a separate 4D model or adapt a particular video generator to predict geometry directly. The former suffers from distribution mismatch and error propagation, whereas the latter ties 4D prediction to a specific generator and may require retraining when the generator or conditioning regime changes. We ask whether the final denoised latents of video models that share a variational autoencoder (VAE) can instead provide a reusable interface to explicit 4D prediction. Building on this insight, we introduce direct latent-to-4D generation and instantiate it as Latent-to-4D, which bypasses RGB by aligning a video latent with the token grid of a pretrained 4D decoder and refining it through frame-wise and global spatiotemporal attention. Trained on roughly 1K existing reconstruction clips, a single checkpoint transfers unchanged across multiple video diffusion transformers within the same VAE family. On Text4D-200 and I4D-200, Latent-to-4D surpasses matched same-latent Wan+4RC cascades in projection-based DINO-F1 by 2.88–3.45 and 5.81 points, respectively, while also being preferred by human raters for geometry, temporal stability, and overall quality.

[59] Where To Look? : Causal Tracing of Vision Encoders in VLM cs.CVPDF

Naren Kumar S, Tirth Bhatt, Mayank Singh

TL;DR: 本文通过因果追踪方法探究视觉语言模型中视觉信息如何驱动其回答，发现高因果性的视觉标记常位于目标区域外，且模型在多模态性能与空间局部化因果表示之间并不一致。进一步研究表明，当外观线索被移除时，模型仍能利用视觉线索理解结构，揭示了视觉结构感知、使用与推理之间的差距。

Details

Motivation: 研究动机是探索视觉语言模型中视觉信息如何实际驱动其答案，以理解模型在描述图像时的内部机制，解决模型性能与视觉表示局部化之间的不一致性问题。

Result: 实验通过因果追踪分析发现，在多个大型视觉语言模型和不同损坏设置下，高因果视觉标记常位于目标区域外，表明强多模态性能不一定对应空间局部化的因果表示。

Insight: 创新点在于应用因果追踪框架研究视觉信息在模型中的转换、保留和使用过程，揭示了视觉结构感知与推理之间的脱节，为理解现代视觉语言模型提供了新的分析视角。

Abstract: Vision-language models can describe an image with remarkable accuracy, yet a more fundamental question remains unanswered: what visual information actually drives their answers? In this work, we investigate this question through causal tracing, and we observe that highly causal vision tokens often lie outside the target region. Extending the analysis to larger vision-language models reveals a similar pattern across models and corruption settings, suggesting that strong multimodal performance does not necessarily imply spatially localized causal representations. We further investigate: can these models preserve visual structure when appearance cues are removed? and find that visual cues are exploited to understand visual structures. Together, our experiments expose a gap between seeing, using, and reasoning over visual structure, and provide a causal framework for studying how visual information is transformed, preserved, and ultimately used by modern vision-language models.

[60] MVTrack: Ultrafast Appearance-Free Moving Object Tracking from Compressed Bitstreams cs.CV | cs.AIPDF

Iñaki Erregue, Kamal Nasrollahi, Sergio Escalera

TL;DR: MVTrack是一种直接从H.264压缩码流中追踪运动物体的超快跟踪器，它结合了用于运动矢量场检测的轻量级检测器MVDet和极简运动学关联模块MVLink，旨在绕过RGB像素重建的计算瓶颈。

Details

Motivation: 现代视频跟踪器大规模部署的瓶颈在于基于RGB的目标检测器计算成本过高，因此需要一种直接从压缩视频数据中实现准确、可扩展跟踪的方法。

Result: 在VIRAT数据集上，MVTrack的性能优于YOLO26n，同时参数量减少60倍，FLOPs减少40倍，CPU延迟降低8.6倍。

Insight: 创新点在于直接利用压缩视频码流（如运动矢量）进行跟踪，无需像素重建，通过轻量级设计实现了高效能；这为视频监控等应用提供了新的低计算开销解决方案。

Abstract: Deploying modern video trackers at scale is bottlenecked by the computational cost of RGB-based object detectors. To this end, we present MVTrack, an ultrafast tracker for moving objects that operates directly on H.264 bitstreams. MVTrack combines MVDet, a lightweight detector for motion vector fields, with MVLink, a minimalist kinematic association module. On VIRAT, MVTrack outperforms YOLO26n while using 60$\times$ fewer parameters, requiring 40$\times$ fewer FLOPs, and reducing CPU latency by 8.6$\times$. These results demonstrate that compressed video data alone can enable accurate and scalable surveillance tracking, thereby bypassing the need for pixel reconstruction.

[61] FADE: From Passive Verification to Active Discovery in Counterfactual Video Understanding cs.CVPDF

Fufangchen Zhao, Jinhu Fu, Jiachen Lei, Jiahong Wu, Xiangxiang Chu

TL;DR: 本文提出了FADE训练框架，旨在解决反事实视频理解中现有基准因问题与选项泄露目标事件而导致模型能力评估失准的问题。该框架采用证据优先的两阶段训练范式，包括证据内化的监督微调和逐步移除文本引导的强化学习，以促使模型主动发现和解释视觉证据。作者还提出了一种将现有多选题数据集转换为对齐的多选题、开放式问答和描述任务的流程，并在多个基准上取得了SOTA性能。

Details

Motivation: 现有反事实视频理解的多选题基准存在目标事件通过问题和选项泄露的问题，这降低了任务的核心挑战，使其从主动发现退化为了文本引导的验证。

Result: 以Qwen3-VL-8B为基线，FADE在DualityVidQA-test和IPV-Bench的所有三个任务（多选题、开放式问答、描述）上均取得了最先进的严格配对分数，超越了GPT-5.6。特别是在从受限多选题转向非受限的开放式问答和描述任务时，模型表现出显著的鲁棒性，性能保留率远高于GPT-5.6。

Insight: 创新点在于提出了一个证据优先的两阶段训练框架，通过强化学习策略逐步移除文本锚点，迫使模型主动发现视觉证据，而非被动验证。此外，提出的无需额外数据标注的基准转换流程，为评估模型在非受限反事实理解上的真实能力提供了有效方法。

Abstract: Counterfactual video understanding evaluates whether models grasp physical and commonsense regularities. However, existing multiple-choice question (MCQ) benchmarks inadvertently leak target events through their questions and candidate options. This reduces the core challenge from active discovery to text-guided verification. In this paper, we present FADE, an effective training framework for counterfactual discovery and explanation. Our method is built on an evidence-first, two-stage training paradigm. First, evidence-internalized supervised fine-tuning grounds the model’s predictions in decisive visual anomalies. Second, we apply a fading-anchor reinforcement learning strategy that progressively removes textual guidance, compelling the model to independently discover and explain evidence. To rigorously evaluate this capability, we also introduce an effective pipeline that converts existing MCQ datasets into aligned MCQ, open-ended question answering (OQA), and captioning tasks without requiring additional data curation. Our simple approach yields strong results. Using Qwen3-VL-8B as the baseline, FADE achieves state-of-the-art strict paired scores across all three tasks on DualityVidQA-test and IPV-Bench, outperforming GPT-5.6. In specific, when transitioning from constrained MCQs to unconstrained OQA and captioning, our model demonstrates remarkable robustness. Its performance retention is 90.4% and 67.4% on DualityVidQA-test-substantially higher than the 48.1% and 30.7% retained by GPT-5.6. We hope this simple framework can serve as a solid baseline for future research in unconstrained counterfactual video understanding.

[62] E$^3$mo-Bench: A Scalable Benchmark for Multimodal Evoked and Expressed Emotion Understanding via Bayesian Pairwise Alignment cs.CVPDF

Lancheng Gao, Ziheng Jia, Shengyan Li, Zixuan Xing, Jiarui Wang

TL;DR: 本文介绍了E$^3$mo-Bench，一个用于评估多模态大语言模型（MLLMs）对诱发和表达情绪理解能力的可扩展基准。该基准包含12,314个问答对，覆盖2,524个视频，通过三个互补任务（情绪感知、开放词汇识别和VAD评估）进行评估。为高效获取可靠的连续标注，作者提出了贝叶斯成对对齐方法，并开发了无需训练的E$^3$mo-Score代理来聚合多个模型的判断。实验验证了框架的有效性，并揭示了MLLMs在细粒度情绪识别和维度评估方面的持续不足。

Details

Motivation: 现有基准通常孤立地考察表达或诱发情绪，或局限于粗粒度、不完整的情感表征，无法全面评估MLLMs的情感感知交互能力。

Result: 广泛的实验验证了所提框架的有效性，并揭示了诱发和表达情绪理解范式之间存在显著的性能偏差。MLLMs在细粒度识别和维度评估方面仍存在明显缺陷。

Insight: 创新点包括：提出了一个结合诱发和表达情绪、包含多任务的可扩展基准E$^3$mo-Bench；设计了贝叶斯成对对齐方法，将稀疏的成对判断高效聚合为基于锚点的VAD估计；开发了无需训练的E$^3$mo-Score代理，通过五模型委员会聚合互补判断以改进VAD评估。

Abstract: Understanding both expressed and evoked emotions is critical for multimodal large language models (MLLMs) to achieve comprehensive affect-aware interactions. However, existing benchmarks typically examine expressed and evoked emotions in isolation or are constrained to coarse-grained and incomplete affective characterizations. To bridge this gap, we introduce E$^3$mo-Bench, a scalable benchmark comprising $12{,}314$ question-answer pairs across $2{,}524$ videos with predefined affective perspectives. It evaluates evoked and expressed emotion understanding via $3$ complementary tasks: emotion perception, open-vocabulary recognition, and valence-arousal-dominance (VAD) assessment. To efficiently scale reliable continuous annotations, we propose Bayesian Pairwise Alignment, which aggregates sparse, low-burden pairwise judgments into anchor-referenced VAD estimates. Furthermore, we develop E$^3$mo-Score, a training-free agent that aggregates complementary judgments from a five-model committee to improve VAD estimation. Extensive experiments validate the effectiveness of our framework and expose a pronounced performance skew between evoked and expressed emotion paradigms. These findings, coupled with MLLMs’ persistent deficits in fine-grained recognition and dimensional assessment, chart a clear course for advancing multimodal emotional intelligence.

[63] Evaluating Semantic and Spatial Guidance for Foundation Model Segmentation of Small-Scale PV in Remote Sensing Imagery cs.CVPDF

Roni Blushtein-Livnon, Tal Svoray, Osher Rafaeli, Michael Dorman, Itay Fischhendler

TL;DR: 本研究系统评估了SAM3基础模型在遥感影像中分割小规模光伏系统的性能，重点比较了文本提示、几何提示和混合提示在不同监督水平、训练策略、空间分辨率和成像条件下的表现。研究发现，提示策略是影响模型行为的主导因素，其中混合提示在精度和稳定性上表现最佳，且仅需数百个标注样本即可实现显著性能提升。

Details

Motivation: 解决离网地区光伏系统因规模小、分布稀疏导致的目标-背景严重不平衡问题，以及探索视觉-语言基础模型中不同提示类型（语义与空间引导）对分割性能的相对贡献。

Result: 在大型离网农村地区的多时相航空影像数据集上验证，并推广至三个额外数据集。混合提示实现了最高的分割精度和稳定性，空间引导显著提升了准确性和鲁棒性，而文本提示性能最低且对监督和成像条件最敏感。

Insight: 提示策略是决定SAM3适应能力、鲁棒性和泛化性的关键因素；语义与空间引导提供互补信息，混合提示能有效结合两者优势；基础模型在数据受限场景下展现出强大的数据效率，仅需少量标注即可实现性能大幅提升。

Abstract: Spatio-temporal PV data are essential for understanding adoption processes in off-grid regions, yet such data remain largely unavailable. Automated segmentation of remote sensing (RS) imagery offers a promising solution; yet, residential PV systems remain challenging targets because of their small size and sparse distribution, resulting in severe target-background imbalance. Vision-language foundation models (FMs) provide a data-efficient paradigm through prompt-based semantic and spatial guidance, but the relative contribution of different prompt types remains unclear. We systematically evaluate SAM3 for small-scale PV segmentation in RS imagery by comparing textual, geometric, and hybrid prompting, under varying supervision levels, training strategies, spatial resolutions, and imaging conditions. Multi-temporal aerial imagery from a large off-grid rural region serves as a study site, with findings validated across three additional datasets. Prompting strategy emerged as the dominant factor governing model behavior. Textual prompting consistently produced the lowest performance and showed the greatest sensitivity to supervision and imaging conditions. In contrast, spatial guidance substantially improved both segmentation accuracy and robustness. Hybrid prompting achieved the highest accuracy and stability, indicating that semantic and spatial guidance provide complementary information. Most performance gains were achieved with only a few hundred annotated samples, demonstrating strong data efficiency. Transfer learning had limited overall impact, with only modest improvements observed for textual prompting under limited supervision. Overall, our findings establish prompting strategy as a key determinant of SAM3 adaptation, robustness, and generalization, highlighting the potential of promptable FMs for scalable PV mapping in data-constrained off-grid regions.

[64] MIRA: Medical Image Reflection for Agentic Diagnosis cs.CV | cs.AIPDF

Shengzhi Wang, Jun Yang, Kai Wu, Xiaozhong Ji, Yiwen Ye

TL;DR: 本文提出了MIRA（Medical Image Reflection for Agentic Diagnosis）框架，这是一个用于医学视觉诊断的自主证据搜索与反思验证系统。它通过动态调用图像处理工具（如缩放、定位、测量）和网络搜索来获取证据，并评估证据的相关性和一致性，以提升诊断的可靠性。

Details

Motivation: 现有医学视觉代理在使用工具获取外部知识时，可能引入噪声或误导性证据。因此，可靠的诊断不仅需要获取额外观察，还需要验证工具使用的必要性以及证据对当前假设的支持程度。

Result: 在九个医学视觉推理基准测试中，MIRA平均得分为64.73，比其骨干模型Qwen3-VL-8B提升了7.44分。同时，它将有用工具使用判断率从56.2%提升至73.8%，并将有害判断率从8.9%降低至1.6%。

Insight: 创新点在于提出了一个结合自主证据搜索与反思验证的两阶段训练框架。具体包括：1）使用工具增强的蒙特卡洛树搜索数据引擎构建监督微调轨迹；2）通过在线反思原则演化的强化学习来优化决策，即从失败案例中提炼候选原则并筛选能提升奖励的原则。这实现了对证据的重新审视、错误结论的修正以及工具使用策略的自适应调整。

Abstract: Medical visual agents can use tools to inspect images and retrieve external knowledge, but indiscriminate tool use may introduce noisy or misleading evidence. Reliable diagnosis therefore requires not only acquiring additional observations, but also verifying whether tool actions are necessary and whether the resulting evidence supports the current hypothesis. We introduce MIRA (Medical Image Reflection for Agentic Diagnosis), a medical visual diagnostic framework for autonomous evidence search and reflective verification. MIRA dynamically invokes image-processing operations, including zooming, grounding, pointing, rotation, and measurement, as well as web search, while evaluating the relevance and consistency of the acquired evidence. We develop MIRA through a two-stage training strategy. First, a tool-augmented Monte Carlo Tree Search data engine explores diverse diagnostic hypotheses and jointly verifies visual grounding accuracy and semantic consistency to construct supervised fine-tuning trajectories. Second, reinforcement learning further improves decision-making through online reflective principle evolution: failure cases are distilled into candidate principles, and only principles that improve held-out rollout rewards are retained. Across nine medical visual reasoning benchmarks, MIRA achieves an average score of 64.73, improving its Qwen3-VL-8B backbone by 7.44 points. It also increases useful tool-use judgments from 56.2% to 73.8% and reduces harmful judgments from 8.9% to 1.6%. Qualitative analyses show that MIRA can re-examine evidence, correct premature conclusions, and adapt its tool-use strategy. Project page: https://MIRA-VL.github.io/

[65] UniProbe: A Learnable Token-Level Hallucination Detector for Large VLMs using Multi-Structural Internal Representations cs.CV | cs.LGPDF

Dvir Samuel, Guy Bar-Shalom, Fabrizio Frasca, Ethan Fetaya, Yftah Ziser

TL;DR: 本文提出UniProbe，一种轻量级、可学习的幻觉检测器，用于大型视觉语言模型。它通过单次前向传播构建包含图像块、查询标记和生成标记的有向图，利用交替的结构感知模块处理空间、关系和顺序证据，实现细粒度的幻觉定位。该方法还包含流式变体用于生成时检测和重采样，以及自适应策略提升检测效果。

Details

Motivation: 大型视觉语言模型经常产生视觉输入未支持的幻觉内容，现有检测器需要全模型微调、依赖外部验证器或忽略内部信号的结构信息，难以实现细粒度的标记级定位和针对性干预。

Result: 在多种LVLM骨干网络上，UniProbe在标记级和物体幻觉检测上达到最先进水平；在解码过程中，以1.06倍的标准生成延迟将物体幻觉减少高达55%。

Insight: 创新点在于将模型的异构计算轨迹建模为有向图，并通过交替的GNN、ViT和GRU模块保留并交互空间、关系和顺序结构信息；流式变体实现了生成时实时检测与修正，自适应策略提升了检测器与模型自身生成的匹配度。

Abstract: Large Vision-Language Models (LVLMs) achieve impressive visual reasoning and dialogue capabilities, yet frequently hallucinate content unsupported by the visual input. Effective mitigation requires token-level localization, enabling targeted intervention without discarding the entire response. Existing detectors require expensive full-model fine-tuning, rely on external verifiers that ignore the model’s generation process, or reduce internal signals to isolated features and hand-crafted statistics, discarding spatial, sequential, and relational structure. We introduce \textbf{UniProbe}, a lightweight, unified, learnable detector that models a frozen LVLM’s heterogeneous computational trace from a single forward pass. UniProbe constructs a directed graph over image patches, query tokens, and generated tokens, with attention weights encoding their relations. It processes this trace with alternating structure-aware modules: a GNN for relational evidence, a ViT for 2-D visual geometry, and a GRU for response order. Interleaving them allows spatial, relational, and sequential evidence to interact throughout the detector. We further develop a streaming variant for hallucination-aware decoding, which detects and resamples hallucinated tokens during generation, and a self-adaptation strategy aligning the detector with the LVLM’s own generations. Across diverse LVLM backbones, UniProbe achieves state-of-the-art token-level and object-hallucination detection. During decoding, it reduces object hallucinations by up to 55% at $1.06\times$ the latency of standard generation.

[66] PolyLayout: Hierarchical VLM-Guided Layout Generation Beyond Rectangular Rooms cs.CVPDF

Yutong Jiang, Zahra Atashgahi, Carlos Soto Garcia Delgado, Ruben Brokkelkamp, Davide Zanutto

TL;DR: 本文提出了一种名为PolyLayout的混合分层框架，用于生成物理上合理的3D房间布局，特别针对零售应用。该系统将生成过程解耦为三个阶段：功能家具聚类与细粒度区域内放置、基于视觉语言模型（VLM）的宏观路由引导以将聚类区域和独立家具锚定在多样多边形边界内，以及基于规则的优化以实现无碰撞且尊重建筑约束的微观排列。该方法旨在弥合学术研究与实际应用之间的差距，支持非矩形几何形状和严格的门窗约束。

Details

Motivation: 现有解决方案主要关注家具放置的算法策略，很大程度上忽视了真实家庭中普遍存在的非矩形几何形状和严格的门窗约束，导致学术研究与实际应用之间存在差距。本文旨在为零售业量身定制一个可扩展的空间规划应用框架，以生成更符合现实物理约束的房间布局。

Result: 在规模化生产目录和一组具有代表性的不规则真实世界拓扑结构上进行评估，结果表明，该方法在保持良好几何合规性和相对较低延迟的同时，获得了最高的感知合理性，并且能够扩展到现有方法本不支持的非常规边界。

Insight: 创新点在于提出了一种混合分层框架，将布局生成解耦为宏观路由（由VLM引导）和微观优化（基于规则）两个层次，并专门支持非矩形房间边界和硬性建筑约束，这为实际零售应用中的可扩展空间规划提供了新思路。

Abstract: Generating physically plausible 3D room layouts is essential for home furnishing retail, enabling customers to visualize products in their own homes and confidently make purchasing decisions. However, a gap exists between academic research and real-world application: existing solutions primarily focus on algorithmic strategies for furniture placement, largely neglecting the non-rectangular geometries and strict door/window constraints prevalent in real homes. To bridge the gap, we introduce a hybrid, hierarchical framework tailored for retail, specifically designed to support scalable spatial planning applications. Our system decouples generation into three stages: (1) functional furniture clustering and fine-grained intra-zone placement; (2) macro-routing guided by a vision-language model (VLM) to anchor both these clustered zones and any remaining standalone furniture within diverse polygonal boundaries; and (3) rule-based optimization for collision-free micro-arrangements that respect architectural constraints. We evaluate our system on production-scale catalogs and a representative set of irregular real-world topologies. Our results show that our approach attains the highest perceptual plausibility while maintaining good geometric compliance at relatively low latency, and extends to irregular boundaries that existing methods do not natively support.

[67] Multi-View Relational Distillation for Spatial Reasoning with Vision-Language Models cs.CVPDF

Kiet T. Nguyen, Hanbo Shim, Jinwoo Kim, Seunghoon Hong

TL;DR: 本文提出了一种名为多视图关系蒸馏（MVRD）的新方法，旨在提升视觉语言模型（VLMs）的视觉空间推理能力。该方法通过从几何基础视觉模型中蒸馏跨视图的补丁级余弦相似性关系，而非直接匹配特征，从而在增强空间理解的同时，保持预训练的视觉-语言对齐。

Details

Motivation: 现有视觉语言模型在空间推理方面存在几何脆弱性，而传统的微调或特征融合方法要么会延续错误的视觉表示，要么会显著增加模型规模和推理延迟。

Result: 在多个代表性VLM上，MVRD在视觉空间推理任务上超越了监督微调和特征蒸馏方法，其性能接近特征融合方法，但增加的参数量和延迟要少得多。该方法在物体定位、密集描述和问答等3D场景理解任务上也展现出良好的泛化能力。

Insight: 核心创新在于蒸馏几何对应关系（跨视图补丁相似性），而非教师模型特征本身。这种关系蒸馏策略既能编码足够的几何信息以支持空间理解，又允许学生表征保持在其预训练的视觉-语言空间附近，从而在提升几何能力的同时，保留了原有的对象和语言语义能力。

Abstract: Vision-language models (VLMs) have achieved strong image and video understanding, yet their visual-spatial representations remain geometrically fragile, leading to failures in spatial reasoning needed for embodied AI, robotics, and autonomous driving. Prior approaches to geometry grounding either fine-tune VLMs on spatial question answering, which can perpetuate spurious visual representations, or fuse features from large geometry-grounded vision models, which substantially increases model size at inference. Knowledge distillation from geometry-grounded vision models offers an alternative, but directly matching multi-view teacher features can disrupt the pretrained alignment between visual and textual representations, degrading object- and language-semantic capabilities. We propose multi-view relational distillation (MVRD), which distills patch-wise cosine similarities across views instead of the teacher features themselves. These relations encode geometric correspondences adequate for spatial understanding, while leaving the student representation underdetermined, allowing it to remain close to its pretrained vision- language space. Across representative VLMs, MVRD improves visual-spatial reasoning, outperforming supervised fine-tuning and feature distillation while approaching feature fusion methods with considerably fewer added parameters and lower latency. We show that MVRD makes visual representations more geometric while retaining language alignment, and generalizes to 3D scene understanding tasks such as object grounding, dense captioning, and question answering.

[68] NullEdit: Stealthy Image Protection via VLM Condition Redirection cs.CVPDF

Weiyao Huang, Liqin Wang, Ziqi Sheng, Wei Lu

TL;DR: 本文提出了一种名为NullEdit的隐形图像保护方法，旨在防止未经授权的图像编辑。该方法通过重定向视觉语言模型（VLM）的表示，在不引入明显伪影或身份替换的情况下，抑制恶意编辑指令，使输出图像保持自然且保留源内容。

Details

Motivation: 现代图像编辑器结合VLM和扩散变换器骨干网络，无需微调即可根据指令修改参考图像，这可能导致公开图像的未经授权篡改。现有推理时防御方法要么通过明显破坏使编辑失效（暴露保护），要么允许编辑但导致身份或参考内容漂移（无法阻止编辑行为本身）。

Result: 在CelebA-HQ和VGGFace2数据集上，针对Step1X-Edit和Qwen-Image-Edit模型，NullEdit相对于最先进基线平均降低了0.813的EditReward IF分数，同时保持了主体身份和源内容。

Insight: 创新点在于针对VLM表示进行重定向，利用正常编辑和无编辑锚点，结合跨提示梯度平均将保护泛化到未见指令，实现了隐形且无害的“无操作”防御，既抑制了恶意编辑，又避免了明显的视觉伪影。

Abstract: Modern image editors combine vision-language models (VLMs) with diffusion transformer backbones to modify a single reference image according to instructions without fine-tuning. This capability also enables unauthorized manipulation of publicly released images. Existing inference-time defenses either invalidate edits through conspicuous corruption, thereby exposing the protection, or allow them to proceed with identity or reference content drift, thereby failing to prevent the editing behavior itself. We instead target a stealthy and harmless no-op in which the requested edit is suppressed, the output remains natural and source-preserving without conspicuous artifacts or identity replacement, and harmful semantics requested by malicious instructions are absent. We propose NullEdit, which targets the VLM representation jointly formed from the reference image and instruction before it conditions the downstream DiT backbone. Using normal-edit and no-edit anchors, NullEdit redirects this representation, while cross-prompt gradient averaging transfers protection to held out instructions. Across Step1X-Edit and Qwen-Image-Edit on CelebA-HQ and VGGFace2, NullEdit reduces the EditReward IF score by 0.813 on average relative to the SOTA baseline while preserving subject identity and source content.

[69] GESTO: Human-Centric Spatio-Temporal Memory for Reasoning in Dynamic Scenes cs.CV | cs.ROPDF

Ermanno Bartoli, Buwei He, Dennis Rotondi, Sebastian Koch, Federico Tombari

TL;DR: 本文提出了GESTO，一种用于动态场景推理的以人为中心的时空记忆系统。它将持久的4D场景图与原子级人-物交互和目标驱动事件的两层层次结构相结合，能够从RGB-D观测流中自动提取、关联并分组交互，以支持活动为中心的时空推理。

Details

Motivation: 现有方法（如4D场景图）保留了物体和位置历史但忽略了活动结构，而活动表示要么未锚定在持久的3D场景中，要么依赖外部提供的事件边界和物体关联。机器人需要一种能捕捉物体、位置以及人类如何使用它们并构成目标导向活动的记忆。

Result: 在现有基准测试的可复现文本、二元和时间类别上，GESTO分别取得了0.71、0.75和0.70的分数，接近使用真实事件和物体锚定的方法，并显著优于移除这些输入的相同推理框架。在新增的40个Space2Event和Event2Space查询上，分别取得了0.73和0.75的分数。

Insight: 核心创新在于将持久的4D场景图与层次化事件结构（原子交互和事件）耦合，实现了自动的事件提取、场景实体锚定和基于上下文的物体关联优化。消融实验表明，层次化事件结构和上下文感知的锚定优化提供了互补的收益，支持了动态人类环境中基于活动的层次化记忆用于回顾性推理。

Abstract: Robots operating in human environments need memories that capture not only what objects exist and where, but also how people use them over time and how individual interactions compose into goal-directed activities. Existing 4D scene graphs preserve object and place histories but omit activity structure, whereas activity representations are either not grounded in persistent 3D scenes or rely on externally provided event boundaries and object associations. We present GESTO (Grounded Event and Spatio-Temporal memOry), a spatio-temporal memory that couples a persistent 4D scene graph with a two-level hierarchy of atomic human–object interactions and goal-driven events. From an RGB-D observation stream, GESTO automatically extracts timestamped interactions, grounds them to persistent scene entities, groups them into events, and uses event context to refine uncertain object associations. A relation-aware tool-calling agent queries the resulting memory for activity-centric spatio-temporal reasoning. We evaluate GESTO on the reproducible text, binary, and time categories of an existing benchmark, together with 40 new Space2Event and Event2Space queries. GESTO achieves scores of 0.71, 0.75, and 0.70 on the standard categories, approaching a method supplied with ground-truth event and object grounding, while substantially outperforming the same reasoning framework when these inputs are removed. It further achieves 0.73 and 0.75 on Space2Event and Event2Space queries. Ablations show that hierarchical event structure and context-aware grounding refinement provide complementary benefits, supporting activity-grounded hierarchical memory for retrospective reasoning in dynamic human environments.

[70] Order Matters: LVLMs as Judges for Temporal Reasoning in Image Sequences cs.CV | cs.CLPDF

Martina Ianaro, Guilherme Fernandes, Maurizio Gabbrielli, Joao Magalhaes

TL;DR: 本文指出当前依赖大型视觉语言模型（LVLMs）作为评估者来评判图像序列时存在严重缺陷，即模型在判断时序连贯性时表现不佳，其评估结果易受序列中帧的位置（如首因和近因效应）影响，而非语义一致性。

Details

Motivation: 解决生成式多媒体（如视觉叙事）评估中的‘判断危机’，即现有自动化评估系统无法有效评估图像序列的时序和逻辑连贯性，无法区分连贯叙事与语义混乱或矛盾的序列。

Result: 通过诊断性测试发现，模型在孤立点状评分中看似胜任，但在进行时序顺序的成对判别时性能出现灾难性崩溃，揭示了系统性位置不对称性（首因和近因效应）是结构性问题。

Insight: 创新点在于揭示了当前基于Transformer的LVLM评估者因架构偏见（如因果掩码和旋转嵌入）而本质上不适合长形式视觉推理，并呼吁社区超越以快照为中心的指标，开创将视觉序列视为统一逻辑结构的‘时序感知评估’范式。

Abstract: As generative multimedia evolves from static image synthesis to complex, interleaved visual narratives, a foundational bottleneck has emerged: the judgment crisis. While human perception naturally synthesizes the temporal and logical flow of a story, automated evaluation systems remain largely “blind” to sequential continuity, often failing to distinguish between a coherent narrative and a semantically shuffled or contradictory sequence. This work identifies a critical structural gap in current multimodal evaluation paradigms, arguing that the reliance on Large Vision-Language Models (LVLMs) as judges is fundamentally limited by architectural biases. Our analysis reveals a profound performance dichotomy: while models may appear competent in isolated pointwise scoring, they suffer a catastrophic collapse when required to perform pairwise discrimination of temporal order. We demonstrate that this is not merely a data-scarcity issue but a structural one. Through a series of diagnostic probes, we uncover systematic positional asymmetries, specifically primacy and recency effects, where a model’s judgment of a story is significantly influenced by the placement of a frame, often more than by its semantic consistency. These biases, potentially rooted in causal masking and rotary embeddings, suggest that current transformer-based judges are inherently ill-equipped for long-form visual reasoning. By exposing these blind spots, we challenge the multimedia community to move beyond snapshot-centric metrics and instead pioneer Temporally-Aware Evaluation paradigms that treat visual sequences as unified logical structures rather than unordered collections of frames.

[71] SafeCA: Safe Cross-Attention Localization and Regulation for Text-to-Video Jailbreak Defense cs.CVPDF

Siyuan Liang, Yupeng Qiu, Junfeng Fang, Rong-Cheng Tu, Jiaxing Huang

TL;DR: 本文提出SafeCA，一种针对文本到视频生成模型的越狱防御机制。该方法通过分析扩散过程中干净与越狱样本在交叉注意力特征空间的累积分离效应，定位关键防御区域并利用注意力掩码与能量归一化抑制异常激活，同时引入轻量级语义空间适配器重定向异常语义流。实验表明，SafeCA能显著降低越狱成功率，几乎不增加推理延迟，并保持良好语义一致性。

Details

Motivation: 现有文本到视频生成模型易受越狱攻击，产生有害内容，而传统基于输入过滤或重构的防御方法计算延迟高且易扭曲语义，因此需要一种高效、低延迟且能保持语义的防御机制。

Result: 在主流文本到视频模型上的实验结果显示，SafeCA将越狱成功率降低了约20%，推理开销几乎可忽略（仅增加0.1秒），并保持了良好的文本-视频语义一致性。

Insight: 创新点在于首次发现扩散过程中干净与越狱样本在交叉注意力特征空间的累积分离效应与线性可分性增强趋势，并基于此设计了特征级的注意力定位与正则化防御机制，包括注意力稳定性分析、能量归一化掩码和轻量语义适配器，为模型提供了架构层面、可部署的保护范式。

Abstract: Text-to-Video (T2V) generative models are vulnerable to jailbreak attacks in real-world deployment, leading them to produce harmful or inappropriate content. Existing defense approaches mainly rely on input filtering or reconstruction, which not only incur high computational latency but also tend to distort semantics. To address these issues, we experimentally and systematically analyze the differences between clean and jailbreak samples in the cross-attention feature space, revealing for the first time a cumulative separation effect and a progressively increasing trend of linear separability between the two during the diffusion process. Based on this insight, we propose SafeCA, a feature-level defense mechanism for safe cross-attention localization and regularization. Firstly, we identify key defensive regions and values through attention stability analysis using cross-attention features collected from clean prompts within a single inference. Secondly, SafeCA mitigates anomalous activations via attention masking with energy normalization and introduces a lightweight semantic-space adapter to redirect abnormal semantic flows. Furthermore, we detect and suppress potentially malicious tokens by back-propagating feature anomaly signals to the input cue words, thereby enhancing the deployability of the defense in commercial models. Experimental results show that SafeCA reduces the jailbreak success rate by about 20% on mainstream T2V models, adds almost no inference overhead (+0.1s), and maintains good text-video semantic consistency. Overall, SafeCA provides an architecture-level, deployable protection paradigm for T2V generation models.

[72] Temporally Grounded Compositional Camera Motion Understanding via Geometric Knowledge Distillation cs.CV | cs.AIPDF

Dazhao Du, Shiyan Du, Jian Liu, Yongjian Yu, Bohai Gu

TL;DR: 本文提出了一种新的相机运动理解任务，即时间定位的组合识别，要求模型定位运动一致的区间并识别每个区间内同时发生的所有运动。为此，作者构建了包含4229个真实单镜头视频片段并带有专家标注的CamChoreo基准。同时，针对现有多模态大语言模型视觉编码器难以捕捉几何证据的问题，提出了CamDistill方法，通过知识蒸馏将冻结的3D基础模型的几何知识提炼到轻量级相机令牌中，在推理时无需运行昂贵的3D模型。

Details

Motivation: 现有基于多模态大语言模型的相机运动理解工作通常对整个视频片段分配一个或多个标签，忽略了真实相机运动的两个关键特性：运动在镜头内会发生变化，以及多种运动可以同时发生。

Result: 在提出的CamChoreo基准上，所提出的CamDistill方法在推理时不运行3D教师模型的情况下，达到了与直接注入3D模型特征（CamInject基线）相当的准确率。

Insight: 核心创新点在于将相机运动理解重新定义为时间定位的组合识别任务，并构建了相应的细粒度基准。方法上的创新是通过知识蒸馏将几何先验知识高效地整合到MLLM中，避免了推理时的高昂计算成本，实现了从片段级标注到时间定位组合识别的进步。

Abstract: Understanding camera motion is fundamental to video perception, with applications in spatial intelligence and controllable video generation. Multimodal large language models (MLLMs) provide a natural interface for this task, but existing work typically assigns one or more labels to an entire clip. Such clip-level recognition overlooks two defining properties of real camera motion: it can change within a shot, and multiple movements can occur simultaneously. We therefore formulate camera-motion understanding as temporally grounded, compositional recognition, which requires a model to localize motion-consistent intervals and identify every movement active within each interval. We introduce CamChoreo, a benchmark of 4,229 real single-shot clips with expert-annotated temporal segments. Its annotations use a compact vocabulary of 20 direction-aware labels, and nearly half of the segments contain compound camera motion, with multiple movement primitives active simultaneously. Recognizing such fine-grained, compositional motion is hard for current MLLMs, whose visual encoders emphasize semantic content rather than the geometric evidence on which camera motion depends. Directly injecting features from a frozen 3D foundation model addresses this gap, but requires running the expensive geometry model on every input; we refer to this baseline as CamInject. We instead propose CamDistill, which distills the same geometric knowledge into lightweight camera tokens during training and removes the 3D model at inference. CamDistill matches the accuracy of direct feature injection without running the 3D teacher at inference. Together, CamChoreo and CamDistill advance camera-motion understanding from clip-level labeling to temporally grounded, compositional recognition. Project page: https://ddz16.github.io/cammotion.github.io/.

[73] Mixture-of-Experts-based Entropy Model for Learned Image Compression cs.CVPDF

Jonas Brenig, Radu Timofte

TL;DR: 该论文提出了一种基于专家混合（MoE）的熵模型（MoEE）用于学习型图像压缩，通过为输入图像选择性激活参数子集，在Kodak数据集上相比VVC标准实现了-16.85%的BD-Rate提升。

Details

Motivation: 动机是将近年来在NLP和计算机视觉任务中表现出色的专家混合（MoE）方法引入到学习型图像压缩领域，以提升压缩效率。

Result: 在Kodak基准数据集上，该方法相比最新的传统方法VVC（Versatile Video Coding）实现了-16.85%的BD-Rate改进，达到了新的性能水平。

Insight: 创新点在于将MoE架构应用于熵建模，实现了参数的条件激活，这为学习型压缩模型提供了更高效、自适应的建模方式，是可借鉴的架构设计思路。

Abstract: Learned image compression has seen significant progress in recent years with the development of end-to-end learned models that achieve better compression efficiency than state-of-the-art conventional methods. Recently, Mixture of Experts (MoE) approaches have seen promising results in NLP and computer vision tasks. In this paper, we introduce the MoE approach to learned image compression. We propose a MoE-based Entropy model (MoEE) for learned image compression, allowing the model to selectively activate only the subset of parameters required for the input image. Our model achieves a BD-Rate improvement over VVC of -16.85% on the Kodak dataset.

[74] StreamFlow: Dynamic Memory Flows for Streaming Video Understanding cs.CV | cs.CLPDF

Muxin Fu, Yifan Zhang, Wentao Zhang, Fangming Guo, Qian Chen

TL;DR: StreamFlow是一个用于流式视频理解的高效视觉记忆框架，它通过动态、按需访问历史视觉信息来解决现有方法的局限性。该框架结合了轻量级、动态感知的中期记忆（在视觉编码前过滤时间冗余）和潜在长期记忆（将历史视频内容整合为可供后续推理访问的视觉潜在表示），并采用注意力引导的检索机制在模型对视觉证据依赖减弱时注入相关潜在信息。

Details

Motivation: 解决流式视频理解中，多模态大语言模型需要在严格因果性和有限内存约束下，从持续演变的视频流中保留相关证据的挑战。现有基于模型的方法需要侵入式主干更新，而基于内存的方法则在时间冗余内容上消耗大量视觉编码计算，且依赖对视觉历史的僵化访问。

Result: 在StreamingBench上达到了67.73%的整体准确率，实现了最先进的流式视频理解性能；在离线长视频基准测试上也表现出色。相对于原始设置，视觉注意力分数提升了59.1%，同时端到端延迟和峰值内存分别降低了50.4%和21.1%。

Insight: 创新点在于提出了一个动态、按需访问的视觉记忆框架，通过中期记忆过滤冗余和长期记忆整合历史内容来优化计算和存储效率，并利用注意力引导的检索机制实现更视觉基础化和高效的推理。从客观角度看，其将记忆分层（中期与长期）并与模型生成时的注意力状态动态结合的设计，是提升流式视频理解任务中效率与性能的有效途径。

Abstract: Streaming video understanding requires multimodal large language models (MLLMs) to preserve relevant evidence from continuously evolving streams under strict causality and bounded memory. Yet existing paradigms remain limited: model-based methods require intrusive backbone updates, while memory-based methods expend substantial visual-encoding computation on temporally redundant content and rely on rigid access to visual history. To address these limitations, we introduce StreamFlow, an efficient visual memory framework that enables dynamic, on-demand access to historical visual information. StreamFlow combines a lightweight, dynamics-aware mid-term memory that filters temporal redundancy before visual encoding with a latent long-term memory that consolidates historical video content into visual latents accessible to subsequent reasoning. During generation, an attention-guided retrieval mechanism injects relevant visual latents when the model’s reliance on visual evidence weakens. StreamFlow achieves state-of-the-art streaming video understanding performance, reaching 67.73% overall accuracy on StreamingBench, while also delivering strong performance on offline long-video benchmarks. Relative to the vanilla setting, it improves the visual attention score (VAS) by 59.1% while reducing end-to-end latency and peak memory by 50.4% and 21.1%, respectively, enabling more visually grounded and efficient reasoning.

[75] Evidence-Grounded Trustworthy Multimodal Reasoning and Evaluation Benchmark in Complex Urban Scenes cs.CV | cs.AIPDF

Zhaoyang Wei, Bowen Jiang, Xumeng Han, Jiashu Li, Xuehui Yu

TL;DR: 该论文针对多模态大语言模型在复杂城市场景恶劣条件下认知可靠性下降的问题，提出了AD2-Bench基准和EGVOR方法。AD2-Bench引入分层视觉诊断框架，将推理分解为证据链，揭示了鲁棒推理依赖于准确证据获取。EGVOR方法则通过显式生成结构化证据原子来替代隐式推理，并通过分层课程训练提升模型在恶劣条件下的推理稳定性。

Details

Motivation: 现有MLLMs在复杂恶劣场景下认知可靠性显著下降，其隐式推理常缺乏充分的视觉证据，导致感知与推理脱节。同时，现有的结果导向基准仅评估最终预测，无法诊断底层推理过程的失败。

Result: 在提出的AD2-Bench基准上进行广泛实验，结果表明所提出的EGVOR方法在恶劣条件下显著提升了推理稳定性，为可信多模态认知提供了一个更鲁棒的框架。

Insight: 论文的核心创新点在于从概率视角将推理失败归因于空间模糊性和语义不确定性，并提出了显式生成结构化证据原子（空间-语义三元组）的方法来强制定位与语义理解的对齐。这为构建可解释、可信赖的多模态推理系统提供了新思路。

Abstract: While Multimodal Large Language Models (MLLMs) demonstrate impressive performance in benign scenarios, their cognitive reliability deteriorates significantly in complex scenes under adverse conditions. In these settings, models often rely on implicit inference without sufficient visual evidence, leading to a disconnect between perception and reasoning. Meanwhile, existing outcome-oriented benchmarks evaluate only final predictions and fail to diagnose failures in the underlying reasoning process. To address this gap, the authors propose AD2-Bench, which introduces a Hierarchical Visual Diagnosis framework that decomposes reasoning into a structured Chain of Evidence (CoE). This fine-grained diagnosis reveals that robust multimodal reasoning fundamentally depends on accurate evidence acquisition. Building on this perspective, the authors formulate reasoning from a probabilistic viewpoint and identify two primary causes of reasoning failure: Spatial Ambiguity, where models fail to distinguish target objects from background clutter, resulting in localization errors; and Semantic Uncertainty, where degraded visual features lead to incorrect semantic interpretation, resulting in understanding errors. To overcome these evidence deficiencies, they further propose Evidence-grounded Visual Reasoning (EGVOR), which replaces implicit reasoning with the explicit generation of Evidence Atoms - structured spatial-semantic triplets that enforce tight alignment between localization and semantic understanding. The model is trained through a hierarchical curriculum that progresses from reflective supervision construction to reinforcement learning, where reducing reasoning variance is explicitly rewarded. Extensive experiments demonstrate that EGVOR substantially improves reasoning stability under adverse conditions, providing a more robust framework for trustworthy multimodal cognition.

[76] CARE: Confidence-Aware Reasoning for Reliable Medical VQA cs.CV | cs.AIPDF

Yuetian Du, Yucheng Wang, Zhenyuan Chen, Luyuan Chen, Rongyu Zhang

TL;DR: 本文提出CARE框架，一种用于医学视觉问答的置信感知推理方法，通过双阶段流程联合优化诊断准确性和校准性。该方法首先合成可扩展的医学思维链数据进行监督微调，然后引入置信感知奖励机制进行强化学习，以解决现有医学多模态大语言模型中存在的置信度误校准问题。

Details

Motivation: 现有医学多模态大语言模型通过强化学习微调生成思维链推理，但存在置信度误校准问题，即模型表达的确定性与实际诊断准确性之间存在系统性差距，这损害了临床信任。

Result: 在三个医学视觉问答基准测试中，CARE实现了最高的诊断准确性，同时获得了最低的预期校准误差和幻觉率，为可信的临床决策支持奠定了基础。

Insight: 创新点在于将置信度校准直接整合到强化学习奖励信号中，通过置信感知奖励机制使模型的置信度与诊断正确性相关联；同时，可扩展的医学思维链合成方法为监督微调提供了结构化冷启动数据。

Abstract: Reinforcement Fine-Tuning (RFT) has enabled medical Multimodal Large Language Models (MLLMs) to produce Chain-of-Thought (CoT) reasoning for visual question answering, yet these models suffer from $\textit{confidence miscalibration}$—a systematic gap between expressed certainty and actual diagnostic accuracy that undermines clinical trust. We propose $\textbf{CARE}$, a $\textbf{C}$onfidence-$\textbf{A}$ware medical $\textbf{RE}$asoning framework that jointly optimizes accuracy and calibration through a dual-stage pipeline. First, a scalable Medical-CoT synthesis provides structured cold-start data for Supervised Fine-Tuning. Second, Group Relative Policy Optimization (GRPO) with a novel $\textbf{Confidence-Aware Reward (CAR)}$ mechanism ties the model’s confidence to diagnostic correctness within the reward signal. Across three Medical VQA benchmarks, $\textbf{CARE}$ achieves the highest diagnostic accuracy while obtaining the lowest Expected Calibration Error and Hallucination Rate, establishing a foundation for trustworthy clinical decision support. Our code is available at https://github.com/anotherbricki/CARE.

[77] Once Poisoned, Arbitrarily Controlled: A Programmable Backdoor in VLMs cs.CV | cs.CRPDF

Tao Lin, Gaojie Jin, Zongxin Liu, Peng Wu, Lijia Yu

TL;DR: 本文提出了一种针对视觉语言模型（VLM）的新型可编程后门攻击方法。该方法通过一次投毒训练，植入一个通用后门，允许攻击者在推理阶段动态选择未见过的目标语义，并即时合成对应的隐蔽视觉触发器，实现对模型输出的任意控制。

Details

Motivation: 现有VLM后门攻击通常被视为静态漏洞，即攻击者在训练前将特定触发器绑定到有限的目标集上，这种假设严重低估了威胁。本文旨在展示通过单次投毒即可植入一个更灵活、更强大的可编程后门。

Result: 大量实验表明，该攻击在多种VLM上实现了很高的任意到任意（any-to-any）字幕控制成功率，同时保持了模型在干净样本上的正常性能，并且能够有效抵御多种经典的后门防御方法。

Insight: 创新点在于提出了一个解耦训练与推理阶段目标选择的任意到任意字幕控制范式。具体包括：启发式投毒策略使模型学习通用的“触发器即指令”规则，而非记忆特定模式；以及特征空间触发器隐写术，可将任意目标语义映射为隐蔽的视觉触发器（如受控扰动或非语义补丁）。

Abstract: Existing vision-language model (VLM) backdoors are usually treated as static vulnerabilities: one-to-one and N-to-N attacks bind one or more triggers to a finite set of targets before victim training. This assumption substantially underestimates the threat. We show that a single poisoning phase can implant a programmable backdoor into a VLM, allowing an attacker to choose previously unseen target-caption semantics at inference time and synthesize corresponding stealthy triggers on demand. Unlike fixed-mapping attacks, the proposed any-to-any caption-control paradigm decouples post-training target selection from poisoning, enabling dynamic control of target captions without retraining the VLM. Our method has two components. First, a heuristic poisoning strategy exposes the model to diverse trigger-caption pairs, encouraging it to learn a general trigger-as-instruction rule rather than memorize a specific backdoor pattern. Second, a feature-space trigger steganography method maps any attacker-specified target caption to a stealthy visual trigger, implemented as either a norm-controlled perturbation or a non-semantic patch. Once inserted into arbitrary images, these triggers cause the poisoned VLM to generate outputs semantically aligned with the chosen target caption, even when the target was unseen during poisoning. Extensive experiments show that our attack achieves high any-to-any caption-control success rates, preserves clean model utility, and remains effective under several classical backdoor defenses.

[78] Test-Time Self-Evolving GUI Visual Grounding via Reflection-Guided On-Policy Self-Distillation cs.CV | cs.AI | cs.CLPDF

Shiyu Xuan, Zechao Li

TL;DR: 本文提出了一种测试时自演进框架，用于提升GUI视觉定位模型在部署后适应未见界面的能力。该框架构建了一个包含探索、评估、反思和内化的闭环系统，通过基于MLLM的反射器评估探索结果并提供推理反馈，再通过反思引导的在线策略自蒸馏将高层推理转化为密集的令牌级监督，从而在无需人工标注真值的情况下实现模型自我改进。

Details

Motivation: 现有GUI视觉定位模型在部署后参数固定，难以适应未见界面；虽然已有方法尝试通过测试时强化学习进行适应，但无法对失败的探索进行反思，因此需要一种能在部署后自主演进、无需人工干预的适应框架。

Result: 在六个基准测试上的广泛实验表明，该框架平均准确率比基础模型提升了7.4%，有效实现了测试时适应。

Insight: 创新点在于首次将在线策略自蒸馏成功应用于GUI视觉定位的测试时适应，通过反思引导的监督信号转换和对比校准方法，解决了失败探索中自回归前缀破坏监督信号的问题，填补了部署后自适应能力的空白。

Abstract: GUI Visual Grounding is a fundamental capability for GUI agents. Existing models typically freeze their parameters after deployment, limiting their ability to adapt to unseen interfaces. Although recent methods attempt to adapt models via test-time reinforcement learning, they cannot reflect upon failed exploration. To overcome this, we propose a Test-Time Self-Evolving framework that enables models to improve after deployment without human-annotated ground truth. It constructs a closed-loop of Exploration, Evaluation, Reflection, and Internalization. Specifically, the agent first explores unseen interfaces by predicting grounding coordinates for given instructions. To evaluate these explorations, we introduce an MLLM-based Reflector to assess the generated results and provide the corresponding reasoning reflections. To internalize reflection knowledge into the model weights, we propose Reflection-Guided On-Policy Self-Distillation, which translates high-level reasoning into dense token-level supervision via a conditioned self-teacher. Furthermore, we design a Contrastive Calibration method to prevent incorrect auto-regressive prefixes from corrupting the supervisory signals during failed explorations. Extensive experiments across six benchmarks demonstrate our framework’s effectiveness, achieving an average accuracy improvement of 7.4% over the base model. To the best of our knowledge, this is the first work to successfully exploit on-policy self-distillation for test-time adaptation in GUI visual grounding. By filling the gap in post-deployment adaptation, our framework completes the self-evolving capability of GUI agents. The code will be released.

[79] MultiModal Code-Switching: Interleaving Visual Objects into Language for Explicit Object-Level Alignment cs.CV | cs.CL | cs.LGPDF

Changhao Xiang, Shangyu Xing, Zhen Wu, Jianbing Zhang, Xinyu Dai

TL;DR: 本文提出了一种名为多模态代码切换（MMCS）的新型预训练范式，旨在解决现有多模态大语言模型（MLLMs）中图像级对齐导致的指代模糊问题。该方法通过将文本实体替换为对应的视觉对象，实现显式的对象级监督，从而增强视觉与语言的局部对齐。实验表明，MMCS具有很高的数据效率，仅用少量样本就能达到或超越基于大量图像-文本对训练的模型性能，并持续提升不同规模模型的视觉基础和感知能力。

Details

Motivation: 现有MLLMs主要依赖图像-文本对进行模态对齐预训练，将全局图像表示映射到长文本描述，但这种图像级对齐存在指代模糊问题，模型难以从全局表示中推断多个视觉对象与文本实体之间的对应关系，导致数据效率低下和语义基础不理想。

Result: 在实验中，MMCS表现出极高的数据效率：仅使用50K样本，其性能就能匹配或超越基于600K图像-文本对训练的模型。此外，MMCS在不同模型规模下均能持续提升视觉基础和感知能力。

Insight: 论文的创新点在于受语言代码切换现象启发，提出通过将视觉对象插入到语言序列中来实现显式的对象级对齐，从而解决指代模糊问题。从客观角度看，该方法通过可扩展的数据合成流程生成大规模、精确的对象-实体对应数据集，为多模态对齐提供了更细粒度的监督信号，是一种高效且可扩展的预训练策略。

Abstract: Existing Multimodal Large Language Models (MLLMs) predominantly rely on image-text pairs for modality alignment pretraining, mapping global image representations to long textual descriptions. However, this image-level alignment suffers from referential ambiguity: models struggle to infer the correspondences between multiple visual objects and textual entities from the global representation, leading to data inefficiency and suboptimal semantic grounding. To address this, we propose MultiModal Code-Switching (MMCS), a novel pretraining paradigm that provides explicit object-level supervision. Inspired by the linguistic phenomenon of code-switching, MMCS interleaves vision and language by replacing textual entities with their corresponding visual objects, enforcing local vision-language grounding. We further develop a scalable data synthesis pipeline to generate a pretraining dataset of 773K samples with accurate object-entity correspondences. Experiments show that MMCS is highly data-efficient: with only 50K samples, it matches or surpasses models trained on 600K image-text pairs. Furthermore, MMCS consistently improves visual grounding and perception capabilities across varying model scales.

[80] ThinkAfford: Affordance-Centric Reasoning for Fine-Grained 3D Grounding in Cluttered Scenes cs.CVPDF

Xinrui Lin, Sha Zhang, Shumin Wang, Zenghuan Zhu, Jiajun Deng

TL;DR: 本文提出了ThinkAfford方法，用于解决杂乱3D场景中基于自然语言指令的细粒度功能区域（affordance）定位任务。该方法将任务解耦为高召回率的功能区域提议生成和基于指令的推理两个模块，并通过组相对策略优化进行对齐，在SceneFun3D基准上超越了现有基线。

Details

Motivation: 现有方法在预测3D功能区域时，容易因目标交互区域遗漏、粒度不合适或语言指代混淆而失败，特别是在关系性指令下。本文旨在解决这些交织的失败模式。

Result: 在SceneFun3D验证集上，ThinkAfford在官方评估器下取得了10.69% AP50和25.46% AP25的成绩，优于可比的3D开放词汇和基于视觉语言模型的2D到3D基线。模块级诊断显示，提议生成模块在25% IoU下达到77.5%召回率，而推理模块在覆盖查询上的选择准确率达到72.1%。

Insight: 主要创新点在于将高召回提议生成与指令接地推理解耦，并引入组相对策略优化进行端到端对齐。提议生成模块使用可学习的affordance提示和多层次视觉特征，无需依赖解析的对象或部件名称作为分割提示，从而支持细粒度、可变数量的提议生成。推理模块采用“先思考后回答”的结构化响应机制，提升了在关系性指令下的鲁棒性。

Abstract: Task-driven 3D affordance grounding aims to localize the functional region in a cluttered 3D scene that enables an action specified by a natural-language instruction. Existing methods either predict 3D masks directly or construct them by selecting and fusing intermediate 2D/3D regions. However, they remain vulnerable to two intertwined failure modes: the predicted or selected regions may miss the target interaction area or have unsuitable granularity, while language grounding may confuse visually similar alternatives under relational instructions. To this end, we introduce ThinkAfford, which decouples high-recall affordance proposal generation from instruction-grounded reasoning. Specifically, the Affordance Proposal Generation module first uses learnable affordance prompts and multi-level visual features to predict interaction-conditioned heatmaps, extracting a variable number of fine-grained proposals without parsed object or part names as segmentation prompts. Visual-Prompted Affordance Reasoning then reasons over labeled proposal overlays using the full instruction, returning identifiers in a structured “think-then-answer” response. Moreover, Group Relative Policy Optimization uses proposal-level rewards from lifted 3D overlap to align VPAR selection with final 3D grounding. On the SceneFun3D validation split, ThinkAfford achieves 10.69% AP50 and 25.46% AP25 under the official evaluator, outperforming comparable 3D open-vocabulary and vision-language-model-based 2D-to-3D baselines. Module-level diagnostics further show that APG attains 77.5% recall at 25% intersection-over-union, while GRPO-trained VPAR achieves 72.1% selection accuracy on APG-covered queries, compared with 63.4% under supervised fine-tuning.

[81] Putting Registers to Work: Task Registers for Token Pruning in Vision Transformers cs.CV | cs.AIPDF

Hongsen Cao, Mona Jaber, Shanxin Yuan, Ahmed Sayed

TL;DR: 本文提出了一种任务自适应剪枝（TAP）方法，用于在视觉Transformer中实现跨任务（图像分类、语义分割、目标检测）的令牌剪枝。该方法为每个任务引入一个任务寄存器，动态地根据当前任务需求对令牌进行排序、分配剪枝预算并设置恢复尺度，从而在保持模型性能的同时提升编码器吞吐量。

Details

Motivation: 动机在于解决预训练视觉Transformer在不同任务（如图像分类、语义分割、目标检测）中重用时，现有令牌剪枝策略通常为单一任务设计，缺乏跨任务适应性的问题。

Result: 在最终保留率ρ=0.5时，联合适应模型TAP-J在ADE20K数据集上达到47.0 mIoU和1.30倍编码器吞吐量，在COCO数据集上达到53.7 box AP和1.32倍编码器吞吐量，同时在ImageNet-1K上保持竞争力。

Insight: 创新点在于将原有的任务无关寄存器令牌扩展为每个任务专用的任务寄存器，使其能够根据任务特性动态指导剪枝过程，实现了跨任务的统一且高效的剪枝策略，提升了模型在密集预测任务上的适应性。

Abstract: Token-pruning policies are usually designed for a single recognition pipeline, but pretrained Vision Transformers are reused across tasks with different spatial demands. We ask which parts of a pruning policy transfer across image classification, semantic segmentation, and object detection. For each pipeline, controlled probes freeze the no-pruning checkpoint and apply a series of parameter-free reduction criteria at one eligible layer at a time without retraining. The probes reveal three differences: segmentation and detection rank the criteria differently, classification is especially sensitive to attention-based pruning in the earliest layers, and the dense tasks prefer opposite recovery endpoints. These findings motivate Task-Adaptive Pruning (TAP). Existing register tokens serve as task-agnostic storage for feature artifacts. TAP instead introduces one task register per task and activates only the current one. Its evolving state ranks tokens, distributes an exact removal budget over depth, and sets the recovery scale for dense features. At a final keep rate of $ρ=0.5$, our jointly adapted model, TAP-J, reaches $47.0$ mIoU at $1.30\times$ encoder throughput on ADE20K and $53.7$ box AP at $1.32\times$ encoder throughput on COCO while remaining competitive on ImageNet-1K.

Liangyu Fu, Junbo Wang, Yuke Li, Ya Jing, Xuecheng Wu

TL;DR: 本文提出了一种名为WSV的新型零样本视频描述框架，旨在解决仅文本训练导致的跨模态差距问题。该框架包含两个训练阶段：首先利用预训练的文本到视频生成模型生成合成视频潜在表示，并通过一个抛光器增强其保真度；随后设计一个提示器，基于这些表示引导GPT-2生成描述。在推理时，输入视频被编码后直接输入提示器以产生最终描述。

Details

Motivation: 零样本视频描述中仅文本训练会导致训练（仅文本）与推理（仅视频）之间的跨模态差距，先前工作通过简单线性变换尝试弥合这一差距，但文本与视频之间的固有差异使得跨模态表示空间对齐不足，导致生成句子不准确。

Result: 在MSVD、MSR-VTT和VATEX数据集上的实验结果表明，所提方法在B@4和CIDEr指标上分别达到52和95.7的分数，展现了其有效性。

Insight: 创新点在于引入合成视频潜在表示来对齐跨模态表示，并通过抛光器桥接真实与合成视频分布之间的差距，从而更有效地利用文本到视频生成模型提升零样本描述性能，避免了直接线性变换的局限性。

Abstract: Text-only training is a popular paradigm in zero-shot video captioning, where the video distribution is not available to the model during training, leading to a cross-modal gap between the training (text-only) and the inference (video-only). Previous works attempt to bridge the gap through simple linear transformations. However, the inherent gap between text and video makes cross-modal representation space alignment insufficient, resulting in inaccurate sentences. To address this issue, we propose a novel zero-shot video captioning framework (WSV) consisting of two training stages, which first generates corresponding synthetic video latent representations via a pretrained text-to-video generation model. To strengthen the fidelity of the latent representations, we propose a polisher capable of bridging the gap between real and synthetic video distributions. Subsequently, we design a prompter that conditions GPT-2 on the polished latent representations to generate the captions in the second training stage. During inference, an input video is encoded by a pretrained 3D Causal VAE and then fed directly into the prompter, which in turn guides GPT-2 to produce the final caption. Experimental results conducted on MSVD, MSR-VTT, and VATEX datasets demonstrate that our proposed method achieves scores of 52 and 95.7 on the B@4 and CIDEr metrics, respectively.

[83] When Visual Signals Mislead: A Mechanistic Study of Attribute Hallucination in Vision-Language Models cs.CVPDF

Yufei Zhang, Chenlu Zhan, Hongwei Wang

TL;DR: 本文提出VISOR框架，通过视觉信号与语言先验信号的解耦诊断，揭示了视觉语言模型中属性幻觉的机制，并针对不同失败模式提供校准、弃权或视觉适配等补救措施。

Details

Motivation: 针对视觉语言模型中普遍存在的属性幻觉问题（即正确识别物体但错误描述其属性），现有基于语言先验主导的解释缺乏在属性层面的直接验证，需要更精细的机制研究。

Result: 在三个VLM家族（Qwen、InternVL、LLaVA）和三种属性类型的10,791个负样本上，VISOR诊断发现视觉信号是假阳性的强预测因子，而语言先验信号接近随机水平；VISOR能有效减少属性假阳性，且不依赖先验主导假设。

Insight: 创新点在于提出统一的诊断-补救框架VISOR，通过VSNR诊断量化视觉与语言信号贡献，并针对不同失败模式（如低信噪比或信号错位）路由至特定操作符，为理解与缓解属性幻觉提供了可解释的机制性方法。

Abstract: Attribute hallucination—where vision-language models (VLMs) correctly identify an object but mischaracterize its properties—is prevalent yet mechanistically poorly understood. The dominant explanation, language-prior dominance, has motivated prior-suppression methods, but this explanation has not been directly tested at the attribute level. We present VISOR (Visual-Operational Remediation), a unified framework that couples null-image-based diagnosis with routed remediation. Its VSNR diagnostic decomposes each prediction into a visual logit signal and a language-prior signal. Across 10,791 negative-ground-truth samples from three VLM families and three attribute types, the visual signal strongly predicts false positives, whereas the language-prior signal is near chance. VISOR uses this diagnosis to separate two failure modes: low-margin but directionally correct visual signals in color/state attributes, and low-SNR or misaligned visual signals in material attributes. The same diagnosis routes each query to the appropriate operator: calibration for threshold-placement errors, abstention for training-free low-SNR handling, or targeted visual adaptation for material failures that prior suppression cannot correct. Across Qwen, InternVL, and LLaVA, VISOR reduces attribute false positives without relying on the prior-dominance assumption.

[84] R4DSG: Relative 4D Scene Graph Memory for Object-Centric Question Answering in Long Egocentric Video cs.CV | cs.AI | cs.HC | cs.MMPDF

Ke Ma, Yamin Mao, Weiming Li, Shuai Tan, Yijie Zhong

TL;DR: R4DSG提出了一种用于长时序第一人称视频的‘相对4D场景图记忆’方法，旨在解决视频中物体中心问答的难题。该方法将视频转换为由时间、地点、持久物体、锚点相对变化和局部交互上下文索引的紧凑、可查询记忆条目，而非存储原始图序列。

Details

Motivation: 现有长视频QA方法主要关注时序定位和片段检索，而先前的3D场景图方法通常依赖比自由运动可穿戴RGB视频更强的几何信息（如点云、RGB-D输入）。R4DSG旨在为长时序第一人称视频构建一个能保持持久物体身份和结构化空间变化的记忆系统，以支持物体中心的问答（如物品被移动到哪里、上次状态变化的时间等）。

Result: 在EgoLifeQA数据集的255个物体相关问题上进行评估，在仅基于问题的检索设置下，R4DSG相比EgoRAG-Text实现了6.7个百分点的整体性能提升，在‘何时’类问题上提升了12.5个百分点，这凸显了其时间组织化物体记忆的价值。

Insight: 核心创新在于将稳定的‘锚点’与动态物体分离，跨帧保持持久物体身份，并通过锚点相对转换（而非全局对齐的世界模型）来表示物体状态变化。该方法建立在仅RGB的提示式视频分割、时序传播和相对3D提升等最新进展之上，直接生成可用于长时序问答的检索就绪记忆，为可穿戴助手、AR系统和具身多媒体智能体提供了一种实用的记忆基板。

Abstract: Long-horizon egocentric video is a rich substrate for wearable AI assistants, but object-centric questions such as where an item was moved, when it last changed state, or why it was relocated remain difficult because caption- and transcript-based memories rarely preserve persistent object identity or structured spatial change. Existing long-video QA methods mainly emphasize temporal grounding and clip retrieval, while prior 3D scene-graph methods typically assume stronger geometry than free-motion wearable RGB video provides, including point clouds, RGB-D input, posed views, sparse reconstruction, or reconstructed scenes. R4DSG introduces a relative 4D scene graph memory for long egocentric video. Instead of storing raw graph sequences, R4DSG converts video into compact queryable memory entries indexed by time, place, persistent objects, anchor-relative change, and local interaction context. The main idea is to separate stable anchors from dynamic objects, maintain persistent object identity across frames, and represent object state through anchor-relative transitions rather than a globally aligned world model. Built on recent RGB-only advances in promptable video segmentation, temporal propagation, and relative 3D lifting, the method produces a retrieval-ready memory directly usable for long-horizon question answering. Evaluation on a 255-question object-related subset from EgoLifeQA shows, under question-only retrieval, a 6.7-point overall gain over EgoRAG-Text and a 12.5-point gain on when questions, which highlights the value of temporally organized object memory. These results position relative 4D scene graphs as a practical memory substrate for wearable assistants, AR systems, and embodied multimedia agents. GitHub Page: https://dualtransparency.github.io/R4DSG/.

[85] HUI360: A 360° Egocentric Dataset and Baselines for Human-Robot Interaction Anticipation cs.CVPDF

Raphael Lorenzo-Louis, Fabio Amadio, Bertrand Luvison, Serena Ivaldi

TL;DR: 本文介绍了HUI360数据集，这是一个用于人机交互预测的最大规模真实场景数据集，包含从移动机器人视角采集的360度全景图像和100万条预处理标注。作者还提供了自动标注流程、基准模型以及跨数据集评估，并发布了另一个户外数据集SSUP-HRI的600万条标注。

Details

Motivation: 随着机器人在人类环境中日益普及，预测人类意图对于实现主动且具有社会意识的行为至关重要，因此自动预测人机交互成为具身智能体的关键感知挑战。

Result: 论文建立了人机交互预测的基准基线，并首次进行了该任务的跨数据集评估，在HUI360和SSUP-HRI数据集上验证了模型的泛化能力。

Insight: 创新点在于构建了大规模、多样化的真实世界360度自我中心视角数据集，并提供了自动标注流程和高质量的人工精修标注，包括2D姿态、面部关键点和分割掩码，为评估和提升交互预测模型的泛化性能提供了重要资源。

Abstract: As robots increasingly operate in human-populated environments, anticipating human intentions is essential for enabling proactive and socially aware behavior. Automatic anticipation of human-robot interactions is thus emerging as a crucial perception challenge for embodied agents. To this end, we introduce HUI360, the largest dataset for human-robot interaction anticipation in the wild and its set of baselines. The dataset was collected from a mobile robot, in the wild, over multiple days within a 3-month period, and in several environments, capturing natural, spontaneous behaviors from both passersby and users, and encompassing a diverse range of individuals. This variety enables evaluating and improving the generalization capabilities of interaction anticipation models. We designed a pipeline and share code for automatic interaction annotation in arbitrary 360-degree equirectangular videos, along with interfaces for manual refinement. Using this pipeline, we release the HUI360 open set of 1M pre-processed annotations, including detailed 2D poses, facial keypoints, and segmentation masks, obtained using state-of-the-art computer vision methods and manually curated to ensure high-quality tracking and interaction annotation. Additionally, we release the raw panoptic 360-degree images captured from the robot’s egocentric viewpoint (on demand, for research purpose only in compliance with GDPR). Finally, we establish benchmark baselines for interaction anticipation, including the first cross-dataset evaluations for this task: to this end, we also release 6M annotations for another existing in-the-wild outdoor dataset collected from a mobile robot (SSUP-HRI). Dataset and code can be found at https://hucebot.github.io/hui360.

[86] 3D Weighted Geometric Graph Neural Networks for Sheep Facial Pain Assessment cs.CV | cs.AIPDF

Alam Noor, Luis Almeida, Mohamed Daoudi

TL;DR: 本文提出了一种用于绵羊面部疼痛评估的3D加权几何图神经网络系统（3D-SPFES），该系统从单目RGB图像中估计3D面部关键点，构建加权几何图，并通过注意力增强的图神经网络进行消息传递，最终输出归一化的疼痛评分。

Details

Motivation: 现有深度学习系统主要在2D单图像域工作，将面部视为单一维度表示，忽略了绵羊的3D解剖结构和临床验证的绵羊疼痛面部表情量表（SPFES）中固有的跨关键点空间关系。

Result: 论文提出了3D-SPFES系统，该方法无需专用深度硬件，通过VideoDepthAnything从单RGB相机估计3D空间，并利用加权几何图神经网络进行处理，最终输出一个范围在[0, 100%]的归一化疼痛评分（NPS）。

Insight: 创新点包括将SPFES面部关键点集成到从单目RGB估计的3D欧几里得空间中，构建基于欧氏距离和表面共面性聚合度量的加权边图，以及使用缩放点积注意力增强的几何感知消息传递层来选择性增强解剖相关的关键点间消息。

Abstract: Deep learning systems perform mainly within the 2D for a single image domain and take the face as a single-dimension representation, losing sight of the 3D anatomy of sheep and cross-landmark spatial relationships that are intrinsic to the clinically proven Sheep Pain Facial Expression Scale (SPFES). This paper presents the \textbf{3D Sheep Pain Facial Expression System (3D-SPFES)}, a novel, monocular depth-aware geometric graph neural network system that integrates each SPFES facial landmark, such as the ears, eyes, and nose, into 3D Euclidean space estimated from a single RGB camera by using VideoDepthAnything, thus preventing the need for specialized depth hardware. Each landmark node includes a feature vector containing its 3D spatial coordinates, estimated surface normal, and facial attribute class embedding. Edges linked to nodes are assigned weights based on an aggregate metric that combines both Euclidean distance and surface co-planarity in a 3D space. A Weighted Geometric Graph Neural Network (WG-GNN) studies this graph using $\mathcal{K} = 3$ geometry-aware message-passing layers enhanced by a scaled dot-product attention method that selectively enhances anatomically relevant inter-landmark messages. The resultant node embeddings are combined into $\mathcal{O} = 3$ pain-level clusters and integrated into a Normalized Pain Score (NPS) within the range of $[0, 100%]$ a confidence-weighted, SPFES-derived scoring method.

[87] CapProbe: Evaluating Detailed Image Captions via Full-Scene Dense Question Answering cs.CVPDF

Mouxiao Huang, Qiangyu Yan, Borui Jiang, Han Shu

TL;DR: CapProbe是一个用于评估视觉语言模型生成详细图像描述的新基准，它将图像分解为多个语义区域，并为每个区域生成涵盖10个语义类别的多项选择题，从而将描述评估转化为区域对齐的事实核查。该基准包含346张图像、1,868个区域和25,650个问题，平均每张图像有74个QA对，通过语言评判员仅基于描述回答来评估模型的密集事实声称能力。

Details

Motivation: 现有评估方法（如基于参考的指标和LLM评分协议）难以验证密集事实声称，而现有的基于QA的替代方案通常存在探测密度低、领域覆盖窄或缺乏问题与图像区域间明确对齐的问题。

Result: 在13个视觉语言模型上的实验揭示了模型间较大的覆盖率差距、明显的性能-效率权衡，以及稀疏或基于重叠的评估常忽略的失败模式。

Insight: 创新点在于将详细描述评估转化为全场景密集QA，通过区域分解和结构化多选题设计实现高密度、细粒度的事实核查；引入’不确定’选项和有效准确率来区分未回答与错误回答的探测，并采用基于密度的指标惩罚冗长但信息量少的描述。

Abstract: Evaluating detailed image captions from Vision-Language Models (VLMs) requires going beyond surface-level semantic similarity. Reference-based metrics (e.g., CIDEr and SPICE) and LLM-as-scorer protocols struggle to verify dense factual claims, while existing QA-based alternatives generally offer lower probe density, narrower domain coverage, or no explicit alignment between individual questions and segmented image regions. We introduce CapProbe, a full-scene dense QA benchmark that turns detailed caption evaluation into region-aligned factual checking. Each image is decomposed into coarse semantic regions covering both foreground and background elements; for every retained region, we generate multiple-choice questions spanning 10 semantic categories, forming a dense checklist of probed visual facts. Guided by a two-tier taxonomy of 37 L1 domains and 219 L2 sub-domains, CapProbe comprises 346 images, 1,868 regions, and 25,650 questions, averaging 74 QA pairs per image. A language judge answers from the caption alone; an Uncertain option and Effective Accuracy provide a judge-dependent proxy for distinguishing unanswered probes from incorrectly resolved ones, while density-based metrics penalize verbose yet uninformative captions. The protocol is cost-effective: by converting unconstrained scalar scoring into structured MCQ reading, it reduces open-ended scoring bias while remaining judge-conditioned and yields relatively stable model rankings under a fixed reader. Experiments on 13 VLMs show large Coverage gaps across models, a clear competency-efficiency trade-off, and failure modes that sparse or overlap-based evaluation often misses. The benchmark data, annotations, and evaluation code will be released soon.

[88] A Comparative Evaluation of Deep Learning Object Detection Models on a Real-World Multi-Plant Dataset from Africa cs.CV | cs.AIPDF

Ismail Ismail Tijjani, Sunusi Muhammad Ibrahim, Amina Ibrahim Khaleel, Lanre Olusegun Akinola, Fatima Isa Jibrin

TL;DR: 本研究在非洲尼日利亚农场收集的真实世界多植物数据集AgriAISeg上，对YOLOv5、YOLOv8、YOLO11、YOLO26、Faster R-CNN和RT-DETR这六种目标检测模型进行了比较评估。结果表明，基于Transformer的RT-DETR取得了最高的综合性能，而YOLOv8和YOLO11也表现强劲且稳定，Faster R-CNN则在复杂田间条件下表现不佳。

Details

Motivation: 计算机视觉在农业中的应用潜力巨大，但现有方法多依赖受控数据集，未能充分代表真实世界（尤其是非洲等代表性不足地区）的复杂农业条件，因此需要在真实数据集上评估模型的实用性。

Result: 在AgriAISeg数据集上，RT-DETR取得了最高的精确率（0.768）和mAP@0.5:0.95（0.624）。YOLOv8和YOLO11也表现出色且稳定。相比之下，Faster R-CNN的mAP@0.5仅为0.466，性能显著较低。YOLO系列模型在训练效率上也优于Faster R-CNN。

Insight: 论文的创新点在于使用了一个来自非洲的真实、多样化的农业数据集进行模型评估，填补了该领域的空白。客观来看，其核心发现是：在现代真实农业场景中，单阶段检测器和基于Transformer的检测器（如RT-DETR、YOLO系列）比传统的两阶段检测器（如Faster R-CNN）更可靠、高效，这为农业计算机视觉的实际部署提供了重要参考。

Abstract: The application of computer vision in agriculture has shown significant potential for improving crop monitoring and precision farming. However, many existing approaches rely on controlled datasets that do not adequately represent realworld farming conditions, particularly in underrepresented regions such as Africa. This study presents a comparative evaluation of six object detection models YOLOv5, YOLOv8, YOLO11, YOLO26, Faster R-CNN, and RT-DETR using a real-world dataset, AgriAISeg 1 , collected manually from Nigerian farms. AgriAISeg comprises 3,382 images of sesame, cabbage, and tomato crops captured under varying environmental conditions, including changes in illumination, occlusion, and viewing perspectives. Models were trained, and performance was assessed using precision, recall, mAP@0.5, and mAP@0.5:0.95. The results show that RT-DETR achieved the highest overall performance with a precision of 0.768 and mAP@0.5:0.95 of 0.624, while YOLOv8 and YOLO11 also demonstrated strong and consistent performance. In contrast, Faster R-CNN recorded significantly lower accuracy, with an overall mAP@0.5 of 0.466, indicating reduced effectiveness under complex field conditions. In addition, YOLO-based models exhibited superior training efficiency compared to Faster R-CNN.These findings demonstrate that modern one-stage and transformer-based detectors provide more reliable and efficient solutions for plant detection in realworld agricultural environments.

[89] Static in Frames, Dynamic in Events: Rethinking Features in Event Cameras as Motion Cues cs.CVPDF

Hesam Araghi, Jan van Gemert, Nergis Tomen

TL;DR: 这篇论文分析了事件相机数据中的两种特征（结构张量的特征值和时空密度值），论证了它们本质上是运动线索。通过理论分析和合成数据集实验，验证了这些特征结合局部几何信息能提供互补的运动信息，并增强了运动估计任务的鲁棒性。最后，将提出的特征集成到一个先进的事件光流网络中，在真实世界DSEC基准测试上取得了精度提升，特别是在数据稀缺和模型容量较低的场景中。

Details

Motivation: 事件相机异步捕获强度变化，其数据固有地编码了场景动态和物体运动信息，但现有的预处理方法未能充分利用这些动态特征。论文旨在探索事件数据中衍生出的特征（如结构张量特征值和时空密度值）作为运动线索的潜力，以增强下游运动估计任务。

Result: 在合成数据集上的受控实验证实，结合特征值和密度值的局部几何特征能提供互补的运动信息，并对纹理和散粒噪声具有鲁棒性。在真实世界DSEC基准测试中，将提出的特征集成到SOTA事件光流网络后，精度得到一致提升，在数据稀缺场景和低容量模型中增益最大。

Insight: 创新点在于重新审视事件相机特征的本质，将其解释为运动线索，并通过理论分析和实验验证了这些特征对运动估计的增强作用。从客观角度看，将事件特有的动态特征（特征值和密度值）与几何信息结合，为事件视觉任务提供了一种新的特征利用范式，特别是在资源受限条件下具有实用价值。

Abstract: Event cameras capture intensity changes asynchronously with high temporal resolution, requiring novel preprocessing methods for downstream tasks. Unlike static intensity snapshots, event data inherently encode information about scene dynamics and object motion, meaning that features derived from events can exhibit behaviors with no direct analogue in frame-based vision. In this paper, we analyze two features used in event-based corner detection—the eigenvalues of the structure tensor and the spatiotemporal density values—and show that they are \emph{motion cues}. We hypothesize that these features, combined with local geometric information, can enhance motion estimation tasks. To validate this, we first theoretically analyze how the eigenvalues of the structure tensor at moving corner points relate to the direction of motion. We then design controlled experiments on a synthetic dataset, confirming that extending local geometric features with eigenvalues and density values provides complementary motion information and is robust to texture and shot noise. Finally, we integrate the proposed features into a state-of-the-art event-based optical flow network and evaluate on the real-world DSEC benchmark, where the added features consistently improve accuracy, with the largest gains in data-scarce scenarios and for lower-capacity models. The code for this paper can be found at: \href{https://github.com/hesamaraghi/static-in-frames-dynamic-in-events}{https://github.com/hesamaraghi/static-in-frames-dynamic-in-events}.

[90] Foundation Model-Enabled Efficient Data Sampling (FEEDS): A label-efficient training strategy for pan-cancer, multi-tracer PET/CT datasets cs.CVPDF

Biratal Raj Wagle, Bashirul Azam Biswas, Grant Chau, Matthew E. Maeder, Muhammad Azeem Arshad

TL;DR: 本文提出了一种名为FEEDS（Foundation model-Enabled Efficient Data Sampling）的标签和计算高效学习策略，用于解决全身PET/CT成像中病变自动分割任务面临的标注数据稀缺问题。该方法利用视觉基础模型的嵌入特征，从大量未标注临床数据中选择信息最丰富且多样化的样本进行专家标注，从而构建具有代表性的训练集。

Details

Motivation: 动机在于解决全身PET/CT病变分割模型训练需要大量标注数据，而标注过程耗时且依赖专家知识的问题，旨在开发一种标签和计算高效的训练策略，以提升模型在临床使用中的准确性和泛化能力。

Result: 在AutoPET-III数据集上训练和验证，并在AutoPET-III、DeepPSMA以及一个内部医疗中心数据集上进行测试。FEEDS在体素、病灶和解剖区域层面均优于随机采样标注、基于伪标签的半监督学习以及仅使用有限标注数据的方法，其泛化性跨越不同示踪剂（FDG和PSMA）和多种疾病，仅需30%的标注量即可达到与使用100%全标注数据相当的性能。

Insight: 宣称的创新点在于提出了一种一步式的训练范式，利用基础模型嵌入进行高效数据采样，避免了传统无监督、半监督或主动学习方法的复杂性。客观来看，其核心创新是将基础模型的表征能力与高效的主动采样策略相结合，为从大规模未标注临床数据中构建高质量、多样化的标注队列提供了一个实用且高效的解决方案。

Abstract: Automated lesion segmentation in whole-body PET/CT imaging can assist clinicians with cancer detection, staging, and treatment planning across radiotracers and cancer types. However, training lesion segmentation models that capture variations in lesion size, distribution, and appearance requires large annotated datasets, whose creation is both time- and expertise-intensive. As a result, models trained on limited labeled PET/CT data often lack the accuracy and generalizability needed for clinical use. We present FEEDS (Foundation model-Enabled Efficient Data Sampling), a label- and compute-efficient learning strategy that uses vision foundation model embeddings to select the most informative and diverse unlabeled cases for expert annotation. Unlike unsupervised, semi-supervised, and active learning approaches, FEEDS is a one-step training paradigm requiring only a limited, representative training set, making it label- and compute-efficient. We train and validate FEEDS using the AutoPET-III dataset. We test its accuracy and generalizability on three held-out sets: AutoPET-III, DeepPSMA, and an internal Dartmouth-Hitchcock Medical Center dataset. We evaluate clinical utility at the voxel, lesion, and anatomic region level to assess performance in high-risk areas and treatment planning utility. FEEDS outperforms random-sampling-based labeling, pseudolabel-based semi-supervised learning, and training with limited labeled data alone. It generalizes across all three test sets, FDG and PSMA tracers, and multiple diseases, matching fully-labeled (100%) training performance with 70% less annotation burden. FEEDS addresses the challenge of label scarcity in an automatic lesion segmentation framework by providing a practical approach for constructing representative and diverse annotation queues from large, unannotated clinical repositories.

Vladimir Iglovikov

TL;DR: AlbumentationsX 是一个用于图像及其相关标注（如掩码、边界框、关键点等）的统一数据增强库。它通过一个 Compose 对象集中管理变换列表、概率、标注设置和随机种子，确保每次调用时随机值仅选择一次并一致应用于训练样本的所有部分，从而避免因图像与标注分别处理而导致的数据错位问题。

Details

Motivation: 解决传统数据增强中图像与其标注（如掩码、边界框等）因分别应用随机变换而可能导致的错位或损坏问题，确保增强过程的一致性。

Result: 论文未在摘要中提及具体的定量实验结果或基准测试，但通过设计统一的增强管道，理论上能消除数据错位，提高训练数据的可靠性。

Insight: 创新点在于将图像和多种标注类型的增强统一到一个管道中，通过共享随机种子和变换参数确保一致性；同时，库具有可扩展性，允许用户自定义变换，并支持管道定义的保存与重现，增强了可复现性和调试便利性。

Abstract: Augmentation can corrupt a training example when an image and its annotations receive different random changes. A crop must use the same coordinates for the image, mask, boxes, keypoints, stereo views, video frames, or volume. Code paths that choose these values separately can silently misalign the data. AlbumentationsX keeps the transform list, probabilities, annotation settings, and random seed in one Compose object. Each call chooses random values once and applies them to every supported part of the training example. The library keeps each object’s mask, box, and label together and lets projects add their own transforms. It can also save the pipeline definition, show what happened in one call, and run that call again. The examples place Compose after files have been decoded into arrays and before PyTorch groups examples into a batch. AlbumentationsX executes the declared transforms. Practitioners still decide whether a flip, crop, color change, or other operation preserves the correct label for their task.

[92] Is There Really a Camouflaged Object? Towards Realistic Camouflaged Object Detection cs.CVPDF

Huafeng Chen, Yueming Lyu, Chenyang Si, Wende Tan, Liucheng Guo

TL;DR: 本文针对伪装目标检测（COD）任务中现有方法在封闭世界假设下的局限性，提出了一个面向真实场景的大规模基准数据集OPC16K，并设计了存在感知的伪装网络OPCNet。该网络将COD任务重新定义为目标定位与伪装存在推理的联合问题，以处理包含纯背景或非伪装目标的图像，从而减少开放世界环境中的误报。

Details

Motivation: 现有COD方法通常假设每张输入图像都包含伪装目标，忽略了真实场景中可能存在的纯背景或非伪装目标，导致在开放世界部署时产生严重误报。

Result: 在提出的OPC16K基准上进行的大量实验表明，OPCNet在提出的真实COD评估协议下实现了优越性能，在保持准确伪装目标分割的同时，显著减少了负样本上的误报。

Insight: 创新点在于将COD从纯分割任务重新定义为联合的目标定位与伪装存在推理问题，并引入了分层存在推理、相似性感知的伪装关系建模和存在感知的特征细化模块。从客观角度看，构建包含负样本的大规模基准数据集和设计存在感知的联合学习框架，对推动COD在真实场景中的应用具有重要价值。

Abstract: Camouflaged object detection (COD) aims to segment objects that are visually concealed in their surroundings and has attracted increasing attention in recent years. However, most existing COD methods are developed under a closed-world assumption, where each input image is assumed to contain a camouflaged object. This assumption ignores realistic scenarios with pure backgrounds or non-camouflaged objects, causing existing models to produce severe false positives when deployed in open-world environments. To address this limitation, we propose OPC16K, a large-scale benchmark for realistic COD. OPC16K contains 16,245 images from 14 sources and is carefully organized into camouflaged-object images, pure background images, and non-camouflaged-object images, enabling comprehensive evaluation of both segmentation quality and negative-sample rejection. Based on this benchmark, we further propose OPCNet, a presence-aware camouflage network that reformulates COD from a pure segmentation task into a joint problem of object localization and camouflage existence reasoning. Specifically, OPCNet introduces hierarchical existence reasoning to distinguish CO, BG, and NOCOD scenarios, similarity-aware camouflage relation modeling to capture foreground-background camouflage cues, and existence-aware feature refinement to regulate segmentation features with existence predictions. Extensive experiments on OPC16K demonstrate that OPCNet achieves superior performance under the proposed realistic COD evaluation protocol, significantly reducing false positives on negative samples while maintaining accurate camouflaged-object segmentation. Code and dataset will be released at https://github.com/2231122/OPCOD.

[93] PRMU: A Corpus-Free Benchmark for Person-Centric Knowledge Unlearning in Multimodal Large Language Models cs.CVPDF

Huafeng Chen, Yueming Lyu, Ziyuan Chen, Wenda Tan, Chenyang Si

TL;DR: 该论文提出了PRMU基准，用于评估多模态大语言模型在无原始训练语料库情况下的人物中心知识遗忘能力，并引入了SGPE方法作为轻量级基线，以解决现有遗忘方法在遗忘与知识保留之间的权衡问题。

Details

Motivation: 现有MLLM知识遗忘方法通常依赖原始遗忘和保留语料库，这在现实删除场景中往往不可得，因此需要一种无语料库的评估基准来模拟真实的人物中心知识删除请求。

Result: 在代表性MLLMs上的实验表明，现有遗忘方法在遗忘与局部性保留之间存在不利权衡，而SGPE在目标遗忘、局部性保留和通用多模态效用之间提供了有竞争力的平衡。

Insight: 创新点在于提出了首个无语料库的多模态遗忘基准PRMU，以及SGPE方法通过知识置换、受保护参数空间编辑和局部感知多模态控制来实现轻量级遗忘，为现实场景中的可扩展多模态机器遗忘研究提供了新方向。

Abstract: Multimodal large language models (MLLMs) have demonstrated remarkable capabilities in storing and recalling rich person-related knowledge, raising increasing concerns about reliable knowledge removal. However, existing machine unlearning approaches for MLLMs typically assume access to original forget and retain corpora, which are often unavailable in realistic deletion scenarios. To address this limitation, we introduce PRMU, a benchmark for evaluating corpus-free multimodal unlearning under realistic person-centric deletion requests. PRMU focuses on naturally acquired person-related knowledge and evaluates whether models can remove target knowledge while preserving related knowledge through diverse textual and visual probes, including adversarial evaluation and fine-grained locality analysis. To facilitate research in this setting, we further introduce Similarity-Gated Projection Editing (SGPE), a lightweight corpus-free unlearning baseline with knowledge displacement, protected parameter-space editing, and locality-aware multimodal control. Extensive experiments on representative MLLMs reveal that existing unlearning methods often suffer from unfavorable forgetting-locality trade-offs, with significant locality degradation under aggressive forgetting settings, and remain vulnerable to multimodal knowledge reactivation. Meanwhile, SGPE provides a competitive trade-off between target forgetting, locality preservation, and general multimodal utility. We hope PRMU can facilitate future research toward realistic and scalable multimodal machine unlearning. Code and dataset will be released at https://github.com/2231122/PRMU.

[94] SAR2Agri: Learning SAR Intensity Representations for Agricultural Monitoring cs.CVPDF

Moti Rattan Gupta, Anupam Sobti

TL;DR: 本文提出了SAR2Agri，这是首个专注于农业应用、仅使用SAR强度图像的自监督学习流程。该方法通过改进掩码和课程学习来增强时间性预训练任务，以更好地从SAR数据中捕捉物候特征。在SICKLE基准测试中，该模型在作物类型制图任务上取得了84.9%的IoU，性能优于光学和现有SAR基线。

Details

Motivation: 农业监测面临复杂的时空和物候动态挑战，而合成孔径雷达（SAR）卫星具备全天候成像能力，适用于作物制图等任务。现有多模态或SAR基础模型要么依赖光学图像对齐，要么未专注于农业应用，因此需要开发一个仅使用SAR强度数据的自监督学习流程来专门解决农业监测问题。

Result: 在SICKLE基准测试的作物类型制图任务上，最终模型达到了84.9%的IoU，分别超过光学基线15.3个百分点和现有SAR基线2.2个百分点，实现了新的最先进（SOTA）性能。

Insight: 论文的创新点在于提出了首个仅使用SAR强度图像的农业专用自监督学习流程，并通过掩码和课程学习策略改进了时间性预训练任务，以更好地学习物候特征。从客观角度看，其将自监督学习与SAR数据的农业物候特性紧密结合，为SAR在农业领域的专用表征学习提供了有效方案。

Abstract: Agricultural monitoring faces unique challenges, arising from the landscape’s complex temporal, phenological, and climate dynamics, yet monitoring them is critical for ensuring food security. Synthetic Aperture Radar (SAR) satellites offer all-weather day-night imaging capability supporting key monitoring tasks including crop type mapping, yield prediction and phenological event detection. Existing multimodal remote sensing foundation models including TerraMind and CopernicusFM learn SAR representations by grounding them in optical imagery using joint encoding and contrastive learning techniques, while SAR-specific foundation models such as SAR-JEPA, SARMAE, and SAR-W-MixMAE primarily focus on target detection, flood mapping, and land cover classification applications. Recent work has introduced phenology inspired temporal pretext tasks with optical imagery which has shown strong performance on agricultural downstream tasks. In this work, we propose the first self-supervised learning pipeline focused on using only SAR intensity imagery for agricultural applications. We improve the temporal pretext tasks through masking and curriculum learning to enhance the pretraining pipeline’s ability to capture phenological features from SAR. On the SICKLE benchmark, our final model achieves 84.9% IoU on crop type mapping, outperforming optical baselines (by 15.3 pt) and existing SAR baselines (by 2.2 pt), demonstrating the effectiveness of our proposed pipeline for pretraining SAR intensity encoders for agricultural monitoring.

[95] VidForensics-M1: Meta-Detection Reinforcement Learning with Verifiable Temporal Grounding for AI-Generated Video Forensics cs.CVPDF

Bowei Liu, Zheng Lu, Yuhan Bian, Xinchen Zhang, Xingming Shui

TL;DR: 本文提出了VidForensics-M1，一种用于AI生成视频取证的元检测强化学习方法，通过联合优化预测标签和可验证的时间定位证据来提升检测性能。该方法利用自动化数据构建流程生成成对的真实-伪造视频，并引入证据引导的奖励再分配机制，以鼓励模型学习细粒度的伪造定位能力。

Details

Motivation: 现有基于MLLM的检测器主要依赖监督微调或标签级强化学习，其粗粒度监督限制了模型对未见场景和新兴视频生成器的泛化能力。为了解决这一问题，论文首次将元检测引入AI生成视频检测领域。

Result: 广泛的实验表明，VidForensics-M1能够有效利用可验证的时间证据，实现鲁棒且可泛化的AI生成视频检测。

Insight: 论文的核心创新点在于将元检测范式与可验证的时间定位证据相结合，并提出了证据引导的奖励再分配机制。这为AI生成内容检测提供了一种新的思路，即通过强化学习整合更客观、可验证的细粒度证据，而不仅仅是依赖标签或可能产生幻觉的文本解释，从而提升模型的泛化性和可靠性。

Abstract: Recent advances in video generation models have significantly improved the realism of synthetic videos, blurring the boundary between generated and authentic content and raising concerns about misinformation. Existing MLLM-based detectors mainly rely on supervised fine-tuning or label-level reinforcement learning, where coarse supervision limits generalization to unseen scenarios and emerging video generators. To overcome these limitations, we are the first to introduce \textbf{meta-detection} into AI-generated video detection, enabling reliable forgery detection by jointly optimizing predicted labels and supporting evidence within reinforcement learning. This paradigm requires reliable evidence signals and effective mechanisms to integrate them into label-level optimization. Textual rationales provide semantic descriptions of forgery artifacts, but their generation and verification depend on external models, making supervision vulnerable to hallucinations and semantic biases. In contrast, temporal grounding provides more objective and verifiable evidence, as manipulated intervals can be precisely controlled during forgery construction. Based on this insight, we propose an automated data construction pipeline that generates paired real-fake videos by replacing temporal segments with boundary-frame-conditioned video generation models. Furthermore, we introduce \textbf{Evidence-Guided Reward Redistribution}, which performs evidence-aware credit assignment by redistributing rewards among label-correct responses according to evidence quality. This preserves reliable label supervision while encouraging detectors to acquire fine-grained and verifiable forgery localization capabilities. Extensive experiments demonstrate that \textbf{VidForensics-M1} effectively leverages verifiable temporal evidence to achieve robust and generalizable AI-generated video detection.

[96] CausalSplat: Towards Comprehensive Hierarchical Reasoning in 3D Gaussian Splatting cs.CVPDF

Jiayu Ding, Meilu Song, Yun Chen, Wei Gao, Ge Li

TL;DR: 本文提出了CausalSplat框架，旨在解决3D高斯溅射（3DGS）在开放词汇场景理解中缺乏复杂推理能力的问题。该工作引入了推理式3D高斯分割任务，并构建了Causal-LERF和Causal-ScanNet两个基准测试来系统评估常识、空间、功能及反事实推理。方法通过结合视觉语言模型与3D场景图，将显式结构感知与隐式逻辑推理分离，在新建的推理基准上实现了SOTA性能，并在标准的指代和开放词汇3D分割任务上表现出强大的泛化能力。

Details

Motivation: 现有基于3DGS的开放词汇场景理解方法局限于处理显式查询，难以解释实际具身交互所需的隐式意图、复杂空间约束和常识推理。为了弥补这一能力差距，本文旨在推动3DGS向更全面的层次化推理发展。

Result: 在新建的Causal-LERF和Causal-ScanNet推理基准测试上，CausalSplat实现了最先进的（SOTA）性能。同时，在标准的指代和开放词汇3D分割任务上也表现出强大的泛化能力。

Insight: 主要创新点在于提出了“推理式3D高斯分割”这一新任务及配套基准，并设计了CausalSplat框架，其核心思想是通过整合视觉语言模型与3D场景图，将结构感知与逻辑推理解耦，从而实现对复杂、隐含查询的层次化推理。这为3D场景理解从感知走向认知推理提供了新思路。

Abstract: While 3D Gaussian Splatting (3DGS) has advanced open vocabulary scene understanding, existing methods remain confined to explicit queries. They struggle to interpret implicit intents, complex spatial constraints, and commonsense reasoning required for practical embodied interactions. To address this gap, we introduce the task of reasoning 3D Gaussian segmentation and construct two benchmarks, Causal-LERF and Causal-ScanNet. These benchmarks systematically evaluate commonsense, spatial, affordance, and counterfactual reasoning. Evaluations reveal that current state of the art methods perform poorly on these reasoning challenges. Therefore, we propose CausalSplat, a framework that integrates vision-language models with 3D scene graphs to disentangle explicit structural perception from implicit logical inference. Extensive experiments demonstrate that CausalSplat achieves state of the art performance on our reasoning benchmarks while showing strong generalizability on standard referring and open vocabulary 3D segmentation tasks. Project Page: https://jiayuding031020.github.io/CausalSplat

[97] Capturing Uncertainty in Human Motion for Representation Learning in Soccer cs.CVPDF

Yizhou Xu, Lars Bretzner, Tiesheng Wang, Atsuto Maki

TL;DR: 本文提出了一种用于理解足球中基于3D骨架的人体运动的自监督表示学习框架，以未来运动预测为学习目标。由于人体运动本质上是具有不确定性的，因此考虑多种可能的未来运动对于捕捉底层运动动态和学习有效表示至关重要。为此，我们引入了一个运动预测的条件模块，该模块在3D欧几里得空间中建模离散化未来运动的概率分布，通过未来轨迹的显式监督来学习多模态性。

Details

Motivation: 动机在于解决人体运动固有的不确定性，以及如何通过学习多种可能的未来运动来捕捉其动态并学习有效的表示，特别是在足球场景中。

Result: 在大规模足球运动员跟踪数据上的实验表明，该方法显著提高了运动预测的准确性，并且学习到的表示能有效迁移到多个足球下游应用，表现出强大的跨任务泛化能力。

Insight: 创新点在于引入了条件模块来显式建模未来运动的概率分布以捕获多模态性，并通过自监督学习获得可迁移的表示，这为处理运动不确定性提供了一种新思路。

Abstract: This paper presents a self-supervised representation learning framework for understanding 3D skeleton-based human motion in soccer, using future motion prediction as the learning objective. Since human motion is inherently uncertain, accounting for multiple plausible futures is essential for capturing the underlying motion dynamics and learning effective representations. To this end, we introduce a conditioning module for motion prediction that models a probabilistic distribution over discretized future motions in 3D Euclidean space, learning multimodality with explicit supervision from future trajectories. Experiments on large-scale soccer player tracking data show that our approach substantially improves motion prediction accuracy. Moreover, the learned representations effectively transfer to multiple soccer downstream applications, demonstrating strong cross-task generalization.

cs.IR [Back]

[98] DistilVDR: A Compact End-to-End Visual Document Retriever via Dual-Student Distillation cs.IR | cs.CL | cs.CVPDF

Zhuchenyang Liu, Ziyi Wang, Yao Zhang, Yu Xiao

TL;DR: 本文提出了DistilVDR，一个紧凑的端到端视觉文档检索系统。它通过双学生蒸馏方法，从一个80亿参数的视觉语言教师模型中蒸馏出一个5.24亿参数的学生模型，旨在解决大模型索引慢、服务成本高的问题。模型包含高分辨率（DistilVDR-HiRes）和快速（DistilVDR-Fast）两个变体，在保持高性能的同时，显著减小了索引大小并加快了索引速度。

Details

Motivation: 当前视觉文档检索领域被数十亿参数的大模型主导，这些模型在全语料库规模上索引速度慢且服务成本高昂。现有的压缩方法要么从头训练一个更小的多向量编码器，要么只蒸馏查询端，都无法得到一个紧凑的端到端单向量检索器。

Result: 在ViDoRe v1+v2+v3基准测试上，DistilVDR-HiRes达到了61.74的平均NDCG@5（是80亿教师模型性能的86.9%），并在对高分辨率敏感的v3基准上领先于所有复现的10亿参数以下基线。DistilVDR-Fast在视觉令牌预算减少3倍的情况下达到了59.98。两个变体存储一百万文档的索引比最强的10亿参数以下多向量基线小了15.6倍，且索引语料库的速度快了一个数量级。

Insight: 创新点在于提出了一个非对称的、仅编码器的双学生蒸馏框架，该框架在文档端集中视觉容量，同时保持查询端轻量（7000万参数）。所有监督信号均来自冻结教师模型的嵌入空间，该空间本身经过相关性监督训练，因此学生模型的目标不需要相关性标签、负采样或对比项，简化了训练流程。这种端到端的单向量压缩方法在性能、索引大小和速度之间取得了良好平衡。

Abstract: Visual document retrieval (VDR) is dominated by multi-billion-parameter models that are slow to index at full corpus scale and expensive to serve. Prior compression routes either train a smaller multi-vector encoder from scratch or distil only the query side; neither yields a compact single-vector retriever end-to-end. We present DistilVDR, a 524M end-to-end VDR system distilled bilaterally from a single 8B vision-language teacher under a pointwise cosine alignment loss. All supervision comes from the frozen teacher’s embedding space, which was itself trained with relevance supervision, so the student objective needs no relevance labels, negative sampling, or contrastive term. We match VDR’s text-query and image-document input asymmetry with an asymmetric encoder-only student that concentrates visual capacity on the document side and keeps the query side at 70M parameters. We release two variants that share the same encoders and training and differ only in the document encoder’s visual-tile budget: DistilVDR-HiRes attains 61.74 average NDCG@5 on ViDoRe v1+v2+v3 (86.9% of the 8B teacher) and leads every reproduced sub-1B baseline on the high-resolution-sensitive v3 benchmark, while DistilVDR-Fast attains 59.98 at a 3 times smaller visual-token budget. Both variants store one million documents in a 15.6 times smaller index than the strongest sub-1B multi-vector baseline and index the corpus an order of magnitude faster. The code is available at https://github.com/Ryenhails/NanoVDR.

[99] ENTLORE: A Graph-Grounded Benchmark for Latent Organizational Reasoning in Enterprise Question Answering cs.IR | cs.AI | cs.CLPDF

Akrin Zheng, Alexander Wu, Alaia Liu

TL;DR: 论文提出了ENTLORE，一个基于图的基准测试构建框架，用于评估企业问答中的潜在组织推理能力。该框架从常规文档、权威组织表和操作记录中重建了一个经过审计的企业世界，并生成包含完整答案和证明证书的真实图。基准包含2,341份文档和907个问题，涵盖显式查找、跨源组合和潜在组织推理三类任务。

Details

Motivation: 现有企业问答基准通常预设了答案路径，主要测试已陈述事实的组合，而非从语料库中恢复缺失的目标关系（即潜在组织推理）。企业日常记录中的组织关系往往是隐含且分散在异构源中的，因此需要一个新的基准来评估这种关键能力。

Result: 在56种模型和访问配置的评估中，将发布的世界构建为诱导实体图或可导航知识库时取得了最强的可部署结果。然而，即使提供黄金文档，仍有30.4%的潜在问题无法回答，而显式问题和组合性问题的未回答率分别为12.6%和6.2%。

Insight: 创新点在于提出了‘潜在组织推理’这一新能力定义，并设计了ENTLORE框架，通过版本化的组织约定在真实图中认证派生关系，从而同时提供黄金答案和证明证书。客观来看，其将基准构建与隐私保护（对齐匿名化发布）相结合的方法，为评估企业环境中对隐含关系的理解和推理提供了更现实的测试平台。

Abstract: Enterprise question answering is framed as retrieving internal documents and generating grounded answers. Routine enterprise records, however, are work by-products in which required organizational relations remain implicit across heterogeneous sources. Existing benchmarks provide realistic multi-source evidence, but often materialize a predefined answer path and therefore test the composition of stated facts rather than recovery of a target relation absent from the corpus. We call the latter capability latent organizational reasoning. We introduce ENTLORE, a graph-grounded benchmark construction framework that reconstructs an audited enterprise world from routine documents, authoritative organizational tables, and operational records. Versioned organizational conventions certify derived relations in a truth graph, enabling complete golden answers and proof certificates. The aligned anonymized release exposes only the document corpus while withholding private structure and target relations. ENTLORE contains 2,341 documents from three source types and 907 questions spanning explicit lookup, cross-source composition, and latent organizational reasoning, evaluated across 56 model and access configurations. Structuring the released world as an induced entity graph or navigable knowledge base gives the strongest deployable results. Yet supplying gold documents still leaves 30.4% of latent questions unanswered, versus 12.6% and 6.2% for explicit and compositional questions. Enterprise QA therefore depends not only on document recall, but also on whether implicit organizational relations become usable. The benchmark, data, and code are publicly available at ENTLORE.

[100] Self-Knowledge Retrieval Augmented Generation Framework for Patent Matching cs.IR | cs.CLPDF

Jian Zhang, Songlin Lei, Zhuohao Yang, Bangli Liu, Ziwei Wang

TL;DR: 本文提出了一种自知识检索增强生成（Self-Knowledge RAG）框架，用于专利匹配。该方法引导大语言模型（LLMs）从专利查询中自主提取关键技术实体并构建层次化本体结构，以实现查询扩展和精确检索，结合FAISS检索与生成式匹配机制，显著提升了专利检索与匹配的准确性。

Details

Motivation: 针对专利文档结构复杂、技术术语密集且多模态信息丰富，传统方法难以准确识别专利间细微差异，而现有基于LLM的方法依赖领域特定预训练或指令微调，成本高且易导致灾难性遗忘，RAG方法又未能充分利用LLM自动解析专利和挖掘深层语义关系的能力。

Result: 实验结果表明，该方法在真实世界专利数据集上表现出色，验证了其有效性和应用潜力。

Insight: 创新点在于提出自知识RAG框架，通过LLM自主提取专利实体并构建本体结构来增强查询，结合检索与生成匹配，避免了高标注成本和灾难性遗忘，提升了专利理解的深度和匹配精度。

Abstract: Patent retrieval and matching based on large language models (LLMs) play a vital role in intellectual property protection. However, due to the complex structure of patent documents, dense technical terminology, and multi-modal information, traditional methods struggle to accurately identify subtle differences between patents. Existing LLM-based patent matching approaches typically rely on domain-specific pretrained or instruction tuning, which often entail high manual labeling costs and catastrophic forgetting. While retrieval-augmented generation (RAG) methods introduce external knowledge they fail to fully leverage LLM’s capability to automatically parse patents and mine deep semantic relationships. To address these limitations, this paper proposes a self-knowledge RAG framework that guides LLMs to autonomously extract key technical entities and construct hierarchical ontological structures from patent matching queries, thereby enabling query expansion and precise retrieval. The method integrates the FAISS retrieval with a generative matching mechanism, leveraging self-knowledge to enhance the model’s understanding of patent innovations and significantly improve retrieval and matching accuracy. Experimental results demonstrate the outstanding performance of the proposed method on real-world patent datasets, validating its effectiveness and application potential.

cs.RO [Back]

[101] Lost in Reconstruction: Aligning Action Representations with Language in Vision-Language-Action Models cs.RO | cs.AI | cs.CLPDF

Li Wenjie, Yash Jangir, Ignacy Stepka, Yash Agarwal, Marion Kipsang

TL;DR: 本文提出了一种名为SALT的语义对齐动作分词器，用于解决视觉-语言-动作模型中动作表示因仅优化重建损失而丢失语言意义的问题。SALT通过结合冻结的视觉-语言模型，从量化的动作潜在表示中恢复指令，从而在动作表示中保留动词相关的语义信息。在BridgeV2和SimplerEnv基准测试中，使用SALT训练的策略显著提升了语言条件控制性能。

Details

Motivation: 当前视觉-语言-动作模型中的动作表示通常基于原始动作空间的L1/L2损失进行重建优化，但数值接近性不一定反映语言上有意义的区别，导致动作动词的语义信息（如动作执行方式）在表示中被侵蚀。

Result: 在SimplerEnv中，使用SALT训练的策略平均成功率达到71.9%，而仅基于重建的VQ-VAE分词器为42.7%，FAST为31.2%。在BridgeV2上，实验表明动作轨迹包含超越视觉状态变化的动词接地信息，且SALT在保持重建保真度的同时开发了动词专用代码。

Insight: 创新点在于引入辅助目标，利用冻结的视觉-语言模型将动作表示与语言语义对齐，从而在动作分词过程中保留语言结构。这揭示了机器人动作轨迹可作为语言接地的来源，语义对齐能大幅提升语言条件控制的效果。

Abstract: Action verbs describe not only the physical outcomes of actions, but also how those actions are performed. Yet action representations in vision-language-action models (VLAs) are typically optimized for reconstruction under L1/L2 losses in raw action space, where numerical proximity need not reflect linguistically meaningful distinctions. On BridgeV2, we show that action trajectories contain verb-grounding information beyond visual state changes, and that reconstruction-only discrete tokenization systematically erodes this information. To address this problem, we introduce SALT, a Semantically ALigned action Tokenizer that augments a VQ-VAE-style tokenizer with an auxiliary objective requiring a frozen vision-language model to recover the episode instruction from quantized action latents. Policies trained with SALT achieve 71.9% average success in SimplerEnv, compared with 42.7% for a reconstruction-only VQ-VAE tokenizer and 31.2% for FAST. SALT also develops verb-specialized codes while maintaining reconstruction fidelity. These results show that robot action trajectories provide a source of language grounding and that preserving this structure in action representations can substantially improve language-conditioned control.

[102] Protection Levels for Vision-Based Pose Estimation cs.RO | cs.CV | eess.SYPDF

Olivia Beyer Bruvik, Romeo Valentin, Marc R. Schlichting, Don Walker, Mykel J. Kochenderfer

TL;DR: 该论文提出了一种基于视觉的导航系统完整性保障方法，通过推导保护级别（protection levels）为飞机姿态估计误差提供概率边界，即使在未检测到故障的情况下也保持有效。论文针对航空应用中的非线性透视n点（PnP）问题，开发了一种计算保护级别的算法，并分析了测量冗余度、像素级预测不确定性和跑道距离对保护级别的影响。

Details

Motivation: 动机在于视觉导航作为全球导航卫星系统的补充，需要满足认证要求的完整性保证，以应对故障测量，而现有方法缺乏在未检测到故障下仍有效的姿态误差概率边界。

Result: 论文提出的算法直接覆盖飞机姿态的六个自由度（位置和方向），并通过示例跑道场景展示了保护级别在测量冗余度、预测不确定性和距离等因素下的权衡关系，但未提及具体基准测试或与现有方法的定量比较。

Insight: 创新点在于将保护级别概念扩展到视觉导航中，为非线性PnP问题提供完整性保障框架，并系统分析了关键因素对保护级别的影响，为航空安全认证提供了可借鉴的理论基础。

Abstract: Vision-based navigation complements Global Navigation Satellite Systems, but certification demands integrity guarantees that account for faulty measurements. Previous work presented a probabilistic computer vision pipeline for runway-based pose estimation with fault detection inspired by Receiver Autonomous Integrity Monitoring. This work extends that framework by deriving protection levels, which provide probabilistic bounds on pose error that remain valid under undetected faults. We present an algorithm for computing protection levels for the nonlinear Perspective-$n$-Point problem applied to an aviation setting. The algorithm covers all six degrees of freedom of the aircraft pose (position and orientation) directly. We analyze the effect of measurement redundancy, pixel-level prediction uncertainty, and runway distance on the resulting protection levels. To make the results tangible, we demonstrate tradeoffs in the protection levels on an illustrative runway example.

[103] Embodied Multimodal Grounding for Open-Vocabulary Mobile Manipulation via Semantic 3D Gaussian Splatting cs.RO | cs.CVPDF

Huosen Ou, Dongni Song, Yuncong Wang, Tao Zhou, Yiding Ji

TL;DR: 本文提出了一种用于开放词汇移动操作的具身多模态接地框架，该框架集成了主动多视角语义3D高斯泼溅、可达性感知的基座定位以及基于扩散的视觉-语言-动作策略。该方法通过任务驱动的局部语义3D高斯泼溅作为共享接口，统一了主动感知、语言条件3D定位、障碍物感知场景推理、基座准备和动作模型的语义条件化。实验表明，该框架在杂乱、遮挡、视角变化和具身约束下显著提升了长时程操作任务的鲁棒性和成功率。

Details

Motivation: 解决具身移动操作中需要将语言、视觉观察、三维场景结构和动作可行性在执行前进行对齐的问题，特别是在家庭工作空间中进行少样本、开放词汇的目标接地与操作。

Result: 在50次扩展的真实机器人评估中，与代表性的视觉-语言-动作方法相比，完整系统在长时程任务中达到60%的成功率（PointVLA为40%，DexVLA为28%）；在高度杂乱的操纵任务中达到74%的成功率（单视角变体为52%，PointVLA为46%）。在75厘米高度偏移下仍保持75%的成功率，并消除了由照片引起的误抓取。

Insight: 创新点在于使用任务驱动的局部语义3D高斯泼溅作为统一的多模态接口，并将3D语义线索仅注入到动作专家模块的后期层以保持预训练的动作先验。这实现了可刷新的显式3D语义接地，从而在复杂现实约束下提升了系统的鲁棒性。

Abstract: Embodied mobile manipulation requires language, visual observations, three-dimensional scene structure, and action feasibility to be aligned before execution. We study open-vocabulary target grounding with few-shot manipulation in local household workspaces and present an embodied multimodal grounding framework that integrates active multi-view Semantic 3D Gaussian Splatting (Semantic-3DGS), reachability-aware base positioning, and a diffusion-based vision-language-action policy. A task-driven local Semantic-3DGS serves as a shared interface across active sensing, language-conditioned 3D localization, obstacle-aware scene reasoning, base preparation, and semantic conditioning of the action model. To preserve pretrained action priors, the 3D semantic cues are injected only into the late action-expert blocks. In expanded 50-trial real-robot evaluations against representative vision-language-action (VLA) approaches, the full system achieves 60% long-horizon success compared with 40% for PointVLA and 28% for DexVLA, and reaches 74% success in heavily cluttered manipulation compared with 52% for the single-view variant and 46% for PointVLA. It also maintains 75% success under a 75 cm height shift and eliminates photo-induced false grasps. These results indicate that explicit, refreshable 3D semantic grounding can improve robustness under clutter, occlusion, viewpoint variation, and embodiment constraints.

[104] Neural Introspection Gating for Adaptive KV-Cache Reuse in Vision-Language-Action Models cs.RO | cs.CVPDF

Zhijie Wu, Kento Kawaharazuka, Kei Okada

TL;DR: 本文提出了一种名为Gated VLA-Cache的轻量级、无需训练的方法，用于增强视觉-语言-动作（VLA）模型中的KV缓存重用。该方法通过监控模型解码时产生的置信度信号（即前两个预测动作token的对数概率差值），在模型不确定性高时触发缓存失效和完全重计算，从而在保持计算效率的同时提高任务可靠性。

Details

Motivation: 现有的VLA-Cache等方法在实时控制中重用视觉token的KV表示以节省计算，但其策略仅基于观察空间的启发式方法，未考虑模型自身的不确定性，可能导致在关键决策时刻因缓存错误而性能下降。

Result: 在LIBERO基准测试套件（包括LIBERO-Goal和LIBERO-Long）上使用OpenVLA和OpenVLA-OFT模型进行评估，Gated VLA-Cache在盲目缓存造成性能损失时显著提升了可靠性，恢复了超过100%的丢失准确率，同时保留了80%的计算节省。

Insight: 创新点在于引入了一种基于神经内省（neural introspection）的缓存门控机制，利用模型解码过程中自然产生的零成本置信度信号（logit margin）来动态管理缓存有效性，这是一种无需额外训练、轻量且能自适应模型不确定性的缓存策略改进。

Abstract: Vision-Language-Action(VLA) models map camera images and language instructions directly to motor commands through a single autoregressive transformer. In real-time control, they still spend substantial compute recomputing key-value(KV) representations for visual tokens that barely change across neighboring frames. Recent work such as VLA-Cache reduces that cost by reusing KV states for visually static patches, but its policy relies only on observation-space heuristics and does not account for the model’s own uncertainty. We propose Gated VLA-Cache, a lightweight, training-free extension that augments visual-similarity caching with neural introspection. The method monitors the logit margin between the top two predicted action tokens, a zero-cost confidence signal available during decoding. When the margin drops below a threshold, the cache is invalidated and a full recompute is triggered. Evaluated on four LIBERO benchmark suites with both OpenVLA and OpenVLA-OFT, Gated VLA-Cache improves reliability when blind caching hurts. On LIBERO-Goal and LIBERO-Long, it recovers over 100% of the lost accuracy while retaining 80% of the compute savings.

[105] Flex-$π$: A Multi-Stream World-Action Model with Compute Flexibility cs.RO | cs.CVPDF

Ge Yan, Jinghao Liu, Yuzhi Fan, Lei Cai, Minwen Liao

TL;DR: 本文提出了Flex-π，一个具有计算灵活性的多流世界-动作模型。该模型利用冻结的视频生成VAE，将RGB、3D几何和以物体为中心的语义信息编码到共享的潜在空间中，并在一个混合Transformer骨干网络中与动作联合去噪。通过逐流dropout和跨模态强制，单个训练好的检查点可以在从仅动作模式到完整联合生成的不同计算配置下运行。

Details

Motivation: 现有世界-动作模型通常仅预测RGB潜在表示，且训练目标仅为像素重建，缺乏对3D几何和物体语义操作的显式监督信号。本文旨在解决这一问题，以提升策略在复杂操作任务中的效率和泛化能力。

Result: 在灵巧、精确的真实世界双手操作任务上，无论是分布内还是分布外，该模型均表现出色，击败了最强的基线模型，性能提升高达2-7倍，同时推理速度比π_0.5更快。

Insight: 核心创新点在于发现冻结的视频生成VAE可以近乎无损地编码3D点云，从而无需额外传感器或预训练即可实现多模态监督。模型架构支持计算灵活性，允许在推理时根据需求动态调整输入流，实现了效率与性能的平衡。

Abstract: World-action models (WAMs) predict the future to act better, but nearly all of them predict only RGB latents, trained purely for pixel reconstruction, with no explicit signal for the 3D geometry or object semantics manipulation needs. We find a surprising free lunch: the same frozen video-generation VAE that encodes RGB also encodes 3D pointmaps almost losslessly, with no pointmap-specific training at all. This lets us supervise Flex-$π$, a 6B-parameter WAM, on 3D geometry and object-centric DINO semantics alongside RGB, at no cost in new sensors, new pre-training, or inference latency. Every visual signal is projected into this shared latent space and denoised jointly with actions inside a Mixture-of-Transformers backbone; per-stream dropout with cross-modality forcing then lets a single trained checkpoint run on any subset of these streams, from a fast action-only mode to full joint generation. The result is a policy that is exceptionally demonstration-efficient and generalizes well, beating the strongest baselines by up to 2-7$\times$ on dexterous, precise, real-world bimanual manipulation tasks both in and out of distribution, all while running faster than $π_{0.5}$. Our project website: https://flex-pi.github.io/

[106] Surgical WAM: A World-Action Model for Data-Efficient Surgical Robot Learning cs.RO | cs.AI | cs.CVPDF

Wenrui Bao, Tianyun Jiang, Zhiben Chen, Ser-Nam Lim, Peter D. Peng

TL;DR: 本文提出Surgical WAM（世界-动作模型），一种基于Cosmos Policy的统一生成模型，用于数据高效的手术机器人学习。该模型通过无动作标签的视频预训练学习手术视觉动态，然后在有限的带动作标签演示数据上进行微调，最终作为闭环控制器执行手术操作任务。在四个模拟手术操作任务上的实验表明，视频预训练能显著提升任务成功率。

Details

Motivation: 学习可靠的手术操作策略受限于带动作标签演示数据的稀缺性，而内窥镜视频相对丰富。现有手术世界模型主要将视频用于模拟或策略评估，很少将其学到的动态用于闭环控制。本文旨在探究在固定带动作标签演示数据预算下，无动作视频预训练是否能提升闭环手术操作性能。

Result: 在四个模拟手术操作任务（包括PegTransfer）的实验中，视频预训练将平均成功率从63.5%提升至77.8%，其中在接触密集和双手协调任务上提升最大，例如PegTransfer任务取得了20个百分点的绝对增益。

Insight: 创新点在于提出了一个统一生成模型Surgical WAM，它联合预测未来内窥镜观察和可执行的手术机器人动作块，并作为闭环滚动时域控制器。核心洞察是，无动作视频能为有限动作监督下的手术机器人控制学习提供可迁移的视觉动态先验，为扩展手术机器人学习提供了一条实用路径。

Abstract: Learning reliable surgical manipulation policies is bottlenecked by the scarcity of action-labeled demonstrations: teleoperated surgical robot (e.g., dVRK) trajectories with synchronized kinematics are costly to collect, while surgical tasks demand precise contact handling, long-horizon reasoning, and bimanual coordination. Endoscopic video is comparatively inexpensive and abundant relative to synchronized video–kinematics trajectories, and a natural way to exploit it is to learn world models of surgical scenes. However, existing surgical world models use video primarily for simulation or policy evaluation, and rarely translate the learned dynamics into closed-loop control. This gap raises our central question: under a fixed budget of action-labeled demonstrations, does action-free video pretraining improve closed-loop surgical manipulation? To answer it, we introduce the Surgical World-Action Model (Surgical WAM), a unified generative model built on Cosmos Policy that jointly predicts future endoscopic observations and executable surgical robot action chunks. Surgical WAM first learns surgical visual dynamics from action-free video and is then fine-tuned on the fixed action-labeled budget; at deployment, it acts as a closed-loop, receding-horizon controller that executes a short prefix of each predicted action chunk and replans from the resulting observation. On a suite of four simulated surgical manipulation tasks, video pretraining improves the average success rate from 63.5% to 77.8%, including an absolute gain of 20 percentage points on PegTransfer, with the largest improvements on contact-rich and bimanual tasks. These results demonstrate that action-free video provides transferable visual dynamics priors for learning surgical robot control with limited action supervision, positioning data-efficient video pretraining as a practical path toward scaling up surgical robot learning.

cs.HC [Back]

[107] The Signal Rail: A Deterministic Motion Grammar for Communicating Conversational Agent State in Terminal Interfaces cs.HC | cs.CLPDF

Matteo Grella

TL;DR: 本文提出了Signal Rail，一种用于终端界面的单行状态指示器，为对话代理的内部状态（如监听、思考、执行工具、等待输入、失败等）提供了一种确定性的运动语法。它通过空间语义、运动语法、确定性和诚实性四个核心原则，将原本仅能传达“活动”状态的视觉通道扩展为能清晰传达多种状态的丰富通信手段。

Details

Motivation: 当前终端界面中的对话代理主要通过文本来报告其丰富的内部状态，而旁边的运动通道（由周边视觉监控）仅能传达“活动”这一比特信息，这造成了信息通道的浪费和状态传达的不清晰。

Result: 论文贡献了一份包含45节的规范性规格说明，并在一个由真实信号驱动的全双工本地语音代理中提供了参考实现，展示了其可行性和实用性。

Insight: 核心创新在于为终端状态指示设计了一套基于运动、空间和确定性的语法系统，强调状态变化的明确、可测试和诚实表示，而非依赖颜色或虚假动画，这为构建更透明、可靠的人机交互界面提供了新的设计范式。

Abstract: Terminal interfaces to conversational agents report rich internal state (listening, thinking, executing tools, awaiting input, failing) almost entirely through text, while the motion channel beside it, the one peripheral vision monitors without reading, carries a single bit: alive. We present the Signal Rail, a one-row terminal status instrument that gives that channel a grammar. Four ideas govern it: spatial semantics (input, processing, and output zones, with direction as meaning), a motion grammar (one kinetic rule per state, never color alone), determinism (frames as a pure function of explicit inputs, golden-frame testable), and honesty (no invented progress or activity). We contribute a 45-section normative specification and a reference implementation inside a working full-duplex local voice agent driven by real signals.

eess.IV [Back]

[108] Structural Guidance for Unified Joint Demosaicing and Denoising eess.IV | cs.CVPDF

Qixin Zheng, Ping Chen, Qiangqiang Shen, Haijin Zeng

TL;DR: 本文提出了一种结构引导的统一联合去马赛克与去噪框架，旨在解决不同拜耳类色彩滤波阵列和传感器噪声共同导致的图像退化问题。该方法通过引入预训练的结构知识，结合并行结构推理分支与恢复分支，在多个CFA模式和噪声水平上实现了优于现有方法的鲁棒图像恢复。

Details

Motivation: 现有统一恢复网络主要依赖像素级监督，在边缘、重复纹理和摩尔纹等局部证据不可靠区域容易产生结构退化，缺乏显式的结构引导是其主要局限。

Result: 在多个CFA模式和噪声水平上的广泛实验表明，该方法在图像恢复质量上一致优于当前最先进的统一方法和CFA特定方法，达到了SOTA水平。

Insight: 创新点在于通过轻量级可训练适配器桥接稀疏噪声传感器数据与自然图像预训练域之间的领域差距，并利用并行结构分支提取互补结构线索，结合传感器域（干净马赛克）和图像域（RGB）的双重监督，增强了恢复的鲁棒性。

Abstract: Joint demosaicing and denoising is a fundamental step in camera image signal processing, yet remains challenging because different Bayer-like color filter arrays (CFAs) and sensor noise jointly corrupt both color sampling and image content. Existing unified restoration networks explicitly model CFA geometry but are still driven primarily by pixel-level supervision, making them prone to structural degradation around edges, repetitive textures, and moiré patterns where local evidence is unreliable. We attribute this limitation partly to the absence of explicit structural guidance beyond pixel-level reconstruction supervision. Motivated by this observation, we propose a structural-guided unified restoration framework that injects pretrained structural knowledge into CFA-aware image restoration. Our model receives a unified five-channel observation consisting of the raw mosaic, CFA masks, and a noise-level map. A SwinIR restoration branch reconstructs pixel details under CFA-conditioned modulation, while a parallel structural reasoning branch extracts complementary structural cues from a sparse pseudo-RGB observation. To bridge the substantial domain gap between sparse noisy sensor data and the natural-image pretraining domain of the structural encoder, we introduce a lightweight trainable adapter before residually fusing structural and restoration features. A shared decoder jointly predicts the restored RGB image and an auxiliary clean mosaic, providing supervision in both image and sensor domains. Extensive experiments across multiple CFA patterns and noise levels demonstrate consistent improvements over state-of-the-art unified and CFA-specific methods, indicating that adapted structural priors can enhance robust camera image restoration. The source codes and dataset are provided in the supplementary material.

[109] When Repository Labels Are Not Image-Level Truth: A Supervision Auditing Framework for Chest Radiograph AI eess.IV | cs.CVPDF

Yesika Alexandra Agudelo-Londoño, Jhon Wilmer Pino-Román, Brahian Carrera Rodríguez, José Miguel Castañeda-Bedoya, Juan Pablo Gómez-López

TL;DR: 本文提出了一种名为Repository Supervision Auditing (RSA)的监督审计框架，用于评估从胸部X光公共数据集中提取的标签与图像级专家标注之间的一致性。以MIMIC-CXR数据集中的心脏肥大（cardiomegaly）为例，研究发现数据仓库标签与专家评估结果几乎完全不一致，仅识别出1%的专家确认病例。基于专家标注的精选队列，DenseNet121模型在测试集上取得了0.853的ROC-AUC。

Details

Motivation: 公共胸部X光数据集的标签通常是从放射学报告中提取的，而非直接在图像层面验证，这可能导致标签不能可靠地反映图像中的实际可见内容。为了解决这一问题，作者旨在在模型开发前评估数据仓库标签的可靠性。

Result: 在MIMIC-CXR数据集的心脏肥大案例研究中，数据仓库标签与专家图像级评估的吻合度几乎为零。使用专家标注的精选队列训练的DenseNet121模型，在测试集上获得了0.853的ROC-AUC。

Insight: 论文的创新点在于提出了RSA框架，用于系统性地审计数据仓库标签的可靠性，并构建专家标注的精选队列进行部署导向的评估。客观来看，这强调了在医学影像AI开发中，将标签审计作为关键步骤的重要性，以确保模型训练和监督的可靠性。

Abstract: Public chest X-ray repositories are widely used to train medical AI systems, yet their labels are typically extracted from radiology reports rather than verified directly on images. As a result, repository labels are often treated as image-level ground truth without validating whether they reflect what is actually visible in the radiograph. We introduce Repository Supervision Auditing (RSA), a framework that evaluates repository-derived labels against expert image-level annotations before model development. Using cardiomegaly in MIMIC-CXR as a case study, RSA compares repository labels with radiologist-reviewed image annotations, characterizes disagreement sources, and builds a curated cohort for deployment-oriented evaluation. Repository-derived cardiomegaly labels showed near-zero agreement with expert image-level assessment, identifying only 1% of expert-confirmed cases. Most discrepancies resulted from non-mention rather than explicit report negation, with expert-confirmed cardiomegaly identified in nearly half of studies assigned a repository-derived No Finding label. Using the resulting expert-curated cohort, a DenseNet121 model achieved a test ROC-AUC of 0.853. These findings show that repository labels may not reliably represent image-level truth and highlight supervision auditing as a critical step for developing trustworthy medical imaging AI.

[110] Retrieval-Augmented Vision Foundation Models for Robust Leukemia Cell Classification across Multiple Microscopy Datasets eess.IV | cs.CV | cs.LGPDF

Carlos Zamora, Hiram Zuniga, Ulises Orozco-Rosas, Kenia Picos

TL;DR: 本文提出了一种用于白血病细胞图像分类的鲁棒性框架，通过两阶段流程（先进行白血病/非白血病二分类，再对阳性样本进行ALL/AML亚型分类）和检索增强分类模块，以应对由采集、染色、照明和站点协议引起的真实世界域偏移问题。

Details

Motivation: 解决白血病细胞图像分类在真实临床场景中因域偏移导致的泛化性能差的问题，旨在量化领域特定预训练在域偏移下的贡献，并探索成本效益高的适应和检索方法作为昂贵领域专用预训练的替代方案。

Result: 在保留的数据集协议上评估了三种编码器（DinoBloom、BiomedCLIP和CLIP）在线性探测、LoRA和检索增强分类模块下的性能，以评估域偏移泛化能力，并揭示了分类性能何时归因于数据集特定伪影而非细胞形态学特征。

Insight: 创新点在于采用检索增强分类模块为分类提供细胞形态学依据，并利用保留协议作为诊断工具来区分性能提升的来源；客观分析认为，该框架通过两阶段设计和跨数据集训练，有效提升了模型在异构数据集上的鲁棒性和可解释性。

Abstract: Leukemia cell image classification is challenged by real-world domain shifts from acquisition, staining, illumination, and site protocols, causing single-dataset models to generalize poorly in real clinical scenarios. This work presents a robust framework for leukemia classification across multiple heterogeneous datasets using a two-stage pipeline with a pretrained vision foundation model. Stage 1 performs binary classification (leukemia vs. non-leukemia) and is trained using 122,167 single-cell images. Stage 2 is conditionally applied to Stage 1 positives to perform subtype classification into Acute Lymphoblastic Leukemia (ALL) and Acute Myeloid Leukemia (AML), trained using 69,400 single-cell images. Labels are harmonized across five heterogeneous datasets to enable cross-dataset training, and performance is evaluated on a held-out dataset protocol to assess domain-shift generalization. Within this pipeline, three encoders are benchmarked (DinoBloom, pretrained on single-cell images; BiomedCLIP, pretrained on biomedical data; and CLIP as a general-purpose model) under linear probing, Low-Rank Adaptation (LoRA), and a Retrieval-Augmented Classification (RAC) module that retrieves the top-k most similar cell images to provide cytomorphological grounding. The objective is to quantify how much domain-specific pretraining contributes to performance under domain shift, and whether cost-effective adaptation and retrieval can be a viable alternative to expensive domain-specialized pretraining. The held-out protocol additionally serves as a diagnostic tool, revealing when classification performance is attributable to dataset-specific artifacts rather than to cytomorphological features.

cs.LG [Back]

[111] Procedural Fairness Failures in RLHF from Preference Averaging cs.LG | cs.AI | cs.CLPDF

M P V S Gopinadh, Karthik Kamuju, Kummari Avinash, John Joshua, Srinivasa Raju Rudraraju

TL;DR: 本文指出，基于人类反馈的强化学习（RLHF）在聚合异质偏好时，假设偏好同质化，会导致程序公平性失败，即多数偏好群体主导奖励学习，而少数偏好被系统性低估。为此，论文提出了偏好感知的RLHF（PA-RLHF），在奖励学习阶段分离不同偏好模式的优化，以缓解此问题。

Details

Motivation: 动机在于解决RLHF中因偏好聚合（平均）而导致的程序公平性问题，即当人类偏好存在异质性时，标准RLHF会系统性地忽视少数群体的偏好信号。

Result: 在受控设置中，PA-RLHF将整体对齐准确率从46.9%提升至67.9%，并将最佳与最差对齐群体之间的公平性差距从15.9个百分点减少到9.6个百分点。

Insight: 创新点在于明确定义了对齐中的程序公平性（即在奖励建模中保留不同的偏好信号），并提出了PA-RLHF方法，通过分离偏好模式优化来避免偏好平均带来的结构性偏差，这对于大语言模型和智能体系统中避免奖励模型偏差加剧序列决策的不公平性具有直接意义。

Abstract: Reinforcement Learning from Human Feedback (RLHF) aggregates heterogeneous preferences into a single reward model, assuming preference homogeneity. When preferences are heterogeneous, this aggregation induces a procedural fairness failure where majority preference groups dominate reward learning while minority preferences are systematically under-represented. This work defines procedural fairness in alignment as preserving distinct preference signals during reward modeling and shows that standard RLHF violates this via preference averaging. Preference-Aware RLHF (PA-RLHF) is introduced, separating optimization across preference modes at the reward learning stage. In a controlled setting, PA-RLHF improves overall alignment accuracy from 46.9% to 67.9% and reduces the fairness gap between best and worst aligned groups from 15.9 to 9.6 percentage points. These results show that procedural fairness failures in alignment can arise from structural design choices in reward learning, even in controlled, noise-free settings, with direct implications for large language models and agentic systems, where biased reward models can compound inequities across sequential decisions.

[112] Detecting an Effect Is Not Learning to Act on It: A Reward-SNR Floor for LLM Acquisition Agents cs.LG | cs.CL | cs.IRPDF

Ying Yuan

TL;DR: 本文探讨了在机器学习系统中获取辅助信号（如LLM结构化推理）时，检测信号的平均效果与学习基于每个实例的获取策略之间的关键区别。论文指出，即使信号是可靠的且在样本内显示出明显增益，由于奖励信噪比（reward-SNR）存在下限，可部署的策略可能无法学习何时获取该信号。通过结构化假设嵌入（SHE）在三个公共数据集上的实验，论文验证了当信噪比低于下限时，学习到的获取策略会失效，实际可行的方案是设计时的机制门控而非基于每个实例的策略。

Details

Motivation: 解决在获取模型衍生的辅助观测信号（如LLM结构化推理）时，区分检测信号的平均效果与学习每个实例的获取策略的差异，以避免在实践中部署无效的策略。

Result: 在MIND、REES46和Amazon-Beauty三个公共数据集上，结构化假设嵌入（SHE）是可靠且可校准的，但学习到的获取策略在所有粒度上都失效，因为数据集均低于奖励信噪比下限；SHE相对于有序GRU有显著增益（+0.0114，95% CI [+0.0030, +0.0209]），但全局冗余差距接近零。

Insight: 创新点在于提出了奖励信噪比下限的概念，强调检测平均效果与学习每个实例策略的本质区别；客观分析认为，这揭示了在低信噪比条件下，基于噪声的伪学习结构可能导致策略失效，实际应用应转向设计时机制门控而非动态实例级决策。

Abstract: Many pipelines can pay a per-example cost to acquire an auxiliary, model-derived observation – an LLM’s structured reasoning, a slow oracle, an expensive measurement – and then must decide when the acquired signal is worth using. Our thesis is a distinction that is easy to miss: detecting that such a signal helps on average is not the same as learning to act on it per instance, and a reward-SNR floor governs when the second is even possible. Even when the signal is faithful and an in-sample oracle picking the top-b examples by realized reward shows a sizable apparent gain, no deployable policy can learn when to acquire it: across per-impression, cluster, regime, and uplift-tree granularities, learned routing never beats random, and a matched-moment noise placebo reproduces >=100% of the oracle’s apparent gain – the apparent “learnable structure” is order statistics of noise. We explain this with one distinction, detecting a mean effect vs. learning a per-instance acquisition policy, and a reward-SNR detectability floor: routing is estimable offline only if the reward SNR rho clears rho*(N) ~= 2.8/sqrt(N), with a positive control confirming a true low-SNR limit rather than a broken pipeline. As a concrete instantiation we introduce Structured Hypothesis Embeddings (SHE): a frozen LLM turns a user history into ranked, confidence-scored, evidence-grounded intent hypotheses, fused into a recommender. On three public datasets (MIND, REES46, Amazon-Beauty), SHE is faithful and calibratable, yet its value is backbone- and regime-conditional (significant over an ordered GRU, +0.0114, 95% CI [+0.0030, +0.0209], but a global redundancy gap indistinguishable from zero), and learned acquisition collapses at every granularity because all three datasets sit below the floor. The realizable unit is a design-time regime gate, not a per-instance policy. We release code and a one-command reproduction.

[113] Optimize Cheap, Deploy Strong: Cost-Aware Cross-Tier Transfer for Evolutionary Optimization cs.LG | cs.AI | cs.CL | cs.NEPDF

Tal Oved, Roi Pony, Oshri Naparstek, Udi barzelay

TL;DR: 本文提出了一种成本感知的跨层级迁移进化优化方法，用于优化LLM提示和智能体程序（如GEPA）。该方法通过解耦LLM在优化过程中扮演的三种角色（大规模答案生成、反思/变异操作、最终部署），将高频率的答案生成任务分配给最便宜的模型层级，而将关键的反思/变异操作保留给强大的模型，最后利用向上跨层级迁移将廉价层级上进化出的提示部署到更强的目标模型上。

Details

Motivation: 动机在于解决LLM提示和智能体程序进化优化中，适应度评估（即对每个候选提示在验证集上运行LLM进行评分）成本高昂的问题，因为评估器的价格层级决定了总搜索成本。

Result: 在四个任务（HotpotQA, IFBench, LiveBench-Math, HoVer）和四个模型家族的十一个模型上进行实验，结果表明，该方法进化出的提示性能匹配或超过同层级优化，同时将超过96%的搜索token置于最便宜的层级，搜索成本降低了5.6至14倍；在需要长推理链的任务中，成本降低幅度可达25至54倍。

Insight: 创新点在于解耦LLM在进化优化中的角色以实现成本控制，并系统分析了廉价层级搜索在何时可以替代目标层级搜索及其失效边界，为资源受限下的高效优化提供了新思路。

Abstract: Evolutionary optimization of LLM prompts and agentic programs (e.g., GEPA) is dominated by fitness evaluation: scoring each candidate runs an answering LLM over a validation set, so the evaluator’s price tier dictates total search cost. We restructure that search by decoupling the three roles an LLM plays, running the high-volume answering role on the cheapest tier, reserving a strong model for the rare reflection/variation operator, then exploiting upward cross-tier transfer to deploy the cheaply evolved prompt on a stronger target. We contribute a cost-controlled characterization of when cheap-tier search substitutes for target-tier search, and where it fails. Across four tasks (HotpotQA, IFBench, LiveBench-Math, HoVer) and eleven models in four model families, the resulting prompt matches or exceeds same-tier optimization while placing over 96% of search tokens on the cheapest tier, at 5.6-14x lower search cost, rising to 25-54x where reasoning tiers emit long chains of thought on every fitness call.

[114] Mapping and Measuring the Behavioral Evolution of Large Language Models cs.LG | cs.CLPDF

Dong Qiao, Chris Ding, Jicong Fan

TL;DR: 该论文提出了一种无标签的评估框架，通过三种互补的句子级差异度量方法，对32个大型语言模型在10,000个共享提示上的响应行为进行映射和测量，以分析模型家族的静态组织、时间演变和行为收敛性。研究发现模型家族形成连贯的聚类，跨家族距离随时间减小，且近期推理导向模型的响应云相对紧凑。

Details

Motivation: 现有基准排行榜仅总结语言模型的性能，但无法揭示模型行为之间的关联及其跨代演变规律。本文旨在量化模型输出行为的相似性和演化趋势，弥补性能评估与行为理解之间的差距。

Result: 在10,000个提示的共享数据集上，三种差异度量方法一致显示：模型家族形成清晰聚类（如GPT-2作为全局异常值）；跨家族行为距离随时间推移而减小；近期推理导向模型（如某些特定模型）的响应云分散度较低。基于token级的最大均值差异验证与句子级平均距离高度相关（Spearman ρ=0.98）。

Insight: 创新点在于提出三种可解释的行为差异度量（对齐的逐提示平均距离、PCA压缩的提示分歧摘要、无对齐的Gromov-Wasserstein差异），并构建理论框架将行为相似性与推理提示覆盖度、损失函数等训练侧因素关联。方法具有架构无关性和编码器鲁棒性（即使编码器尺寸缩小73倍仍保持几何结构）。

Abstract: Benchmark leaderboards summarize how well a language model performs, but not how its behavior relates to that of other models or changes across generations. We characterize the output behavior of 32 models from six families using their responses to a shared bank of 10{,}000 prompts. After embedding each response, we construct three complementary sentence-level dissimilarities: an aligned mean per-prompt distance, which is a pseudometric on observed model responses; a PCA-compressed summary of prompt-wise disagreement; and an alignment-free Gromov–Wasserstein discrepancy between models’ internal response geometries. We use these constructions to study static organization and temporal change on a release-date axis through behavioral maps, family-wise drift, hierarchical clustering, cross-family convergence, and response-cloud dispersion. Across the three constructions, model families form coherent clusters, with \texttt{gpt-2} as a global outlier; cross-family distances decrease over time; and several recent reasoning-oriented models have comparatively compact response clouds. A token-level cross-check based on per-prompt Maximum Mean Discrepancy closely agrees with the sentence-level mean distance (Spearman $ρ=0.98$) and recovers the same qualitative findings. We organize these comparisons through a measure-theoretic lens making their alignment and invariance assumptions explicit. We also establish an architecture-agnostic sufficient condition linking behavioral similarity to inference-prompt coverage, small excess population log-loss, and similar effective target distributions—a possible training-side account rather than an empirical explanation of the observed trends. Our pipeline is label-free, and re-encoding every response with three further encoders—down to one $73\times$ smaller—preserves the rank geometry, the outliers, and the sign of the time trend.

[115] Transformer Geometry Observatory TGO-IV: Developmental Topology Observatory cs.LG | cs.CVPDF

Kaustubh Kapil, Kishor P. Upla

TL;DR: 本文提出了Transformer Geometry Observatory-TGO-IV，这是一个基于持久同调（Persistent Homology）的拓扑分析框架，用于研究Transformer模型各层中表征点云的演化过程。该框架通过构建Vietoris-Rips单纯复形，并利用持久图、条形码图、贝蒂曲线等多种拓扑观测工具，分析表征在Transformer前向传播中全局拓扑结构的发展趋势。

Details

Motivation: 现有可解释性研究多孤立分析单层或整体网络，而表征及其流形在Transformer各层间的发育演化过程尚不明确。本文旨在通过分析表征点云跨层变换的演化，揭示原始输入表征如何及何时演化为任务相关的特征表征。

Result: 论文未在摘要中提及具体的定量实验结果或基准测试对比，主要贡献在于提出了一个全面的拓扑分析框架。

Insight: 创新点在于将持久同调这一拓扑数据分析工具系统性地引入Transformer表征演化分析，通过全局拓扑特征（而非局部几何属性）来追踪表征的发育过程，为理解Transformer的学习机制提供了新的视角和工具集。

Abstract: Transformers have had a profound impact on the world of language processing and computer vision. As efforts to answer the million-dollar question of ``How does a Transformer learn?” have been increasing, existing interpretability studies primarily analyze representations at isolated layers or the network as a whole, while the developmental evolution of individual representations and its manifolds across transformer layers remains underexplored. With this work, we aim at providing a comprehensive analysis of the evolution of representations as the representation point cloud transforms across the layers; thereby attempting to isolate layers or establish a trend which comes closer to justifying how and when raw input representations evolve into task-relevant feature representations. Thus, Transformer Geometry Observatory-TGO-IV introduces a topological framework for analysing the evolution of Transformer representations through the lens of Persistent Homology. Rather than studying local geometric properties alone, TGO-IV constructs Vietoris–Rips simplicial complexes from token-level representation point clouds and investigates the evolution of their persistent topological signatures across Transformer layers. The proposed framework comprises complementary topological observatories including Persistence Diagrams, Barcode Diagrams, Betti Curves, Persistence Landscapes, Bottleneck Distance, and Wasserstein Distance, enabling a comprehensive analysis of how the global topology of representation point clouds develops throughout the forward pass.

[116] Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectives cs.LG | cs.CVPDF

Songlin Du, Xiaoyong Lu, Zeyu Wu, Xiaobo Lu, Guobao Xiao

TL;DR: 这篇论文是一篇关于跨视角特征匹配领域的综述性文章，系统回顾了该领域从任务特定模型到统一通用模型的发展历程，并特别关注了视觉基础模型带来的新进展。文章提出了一个结构化的分类法，涵盖了特征提取、匹配器、训练策略等关键环节，并进行了统一的实验基准测试，旨在为该领域提供一个全面的参考框架。

Details

Motivation: 跨视角特征匹配领域的研究在问题定义、模型架构、训练范式和评估协议上高度多样化，缺乏统一的理解和公平的比较基准。本文旨在通过提供一个结构化的综述和统一的实验基准，来整合该领域的知识并促进其发展。

Result: 论文对代表性的最先进方法在一致的协议下进行了统一的实验基准测试，从而实现了公平和全面的性能比较。

Insight: 论文的主要创新点在于提出了一个结构化的分类法来统一分析跨视角特征匹配领域，并强调了向统一、可泛化的对应模型转变的趋势。从客观角度看，其提供的统一基准测试框架对于推动该领域的标准化评估具有重要价值。

Abstract: Cross-view feature matching aims to establish reliable correspondences across images with large viewpoint variations. Over the past decade, the field has evolved from task-specific models toward increasingly unified and generalizable correspondence models, with recent progress further driven by the emergence of vision foundation models (VFMs). Despite these advances, existing studies remain highly diverse in their problem formulations, model architectures, training paradigms, and evaluation protocols, making it difficult to obtain a unified understanding of the field. In this survey, we present a unified review of cross-view feature matching. We first introduce a structured taxonomy covering feature extraction, single-type feature matcher, multi-type feature matcher, VFMs based methods, training strategy and robust estimation, providing a coherent framework for analysis and comparison. We further examine recent advances, distilling key design principles and highlighting the shift toward unified and generalizable correspondence models. We also provide a unified experimental benchmarking of representative state-of-the-art methods under consistent protocols, enabling fair and comprehensive performance comparisons. In addition, we discuss open challenges and future directions, including efficiency, robustness under extreme conditions, and cross-domain generalization. This survey aims to provide a comprehensive and structured reference for understanding the evolution, current landscape, and future development of cross-view feature matching in the era of vision foundation models.

stat.ML [Back]

[117] Iterative Erasure Count Is Not an Affine-Invariant Concept Dimension stat.ML | cs.CV | cs.LGPDF

Tingan Jin, Shuhang Dong, Haosong Li, Chung-Hsien Chou

TL;DR: 本文指出迭代擦除计数（如停止计数和累积编辑秩）并非仿射不变的概念维度度量，它们会随信息保持的可逆重参数化而改变。论文区分了模型定义的总体量（如生成维度、充分线性维度和最小保护秩）与过程定义的量，并通过高斯构造和视觉特征实验证明，即使预测问题不变，擦除计数也会变化。

Details

Motivation: 解决如何可靠地度量神经表示中编码概念的方向数量的问题，揭示现有基于迭代擦除的度量方法（如停止计数）缺乏仿射不变性，因此不能作为内在的概念维度。

Result: 在高斯构造中，可逆剪切保持预测问题和总体量，但将累积欧几里得擦除计数从1变为2；在有限样本Adam/QR校准中，身份混合在20次大样本运行中仅接受1次更新，而测试剪切均接受至少2次更新；冻结V-JEPA2特征的重参数化也改变了欧几里得轨迹。

Insight: 创新点在于严格区分了模型定义与过程定义的维度度量，并证明迭代擦除返回的是由表示几何和测量过程共同决定的相对估计量，而非语义维度本身；这提示在分析概念编码时需谨慎选择仿射不变的度量方法。

Abstract: How many directions does a neural representation use to encode a concept? A common answer repeatedly erases probe directions and reports the stopping count or cumulative removed rank. We show that both quantities can change under an information-preserving invertible reparameterization, so neither is intrinsically a concept dimension. We distinguish model-defined population quantities (generating dimension, sufficient linear dimension, and minimum guarding rank) from procedure-defined quantities such as stopping count and cumulative edit rank. In a population Gaussian construction, an invertible shear preserves the prediction problem and all three quantities, yet changes the cumulative Euclidean erasure count from one to two. The separation holds for Moore–Penrose ordinary least squares and every finite nonnegative ridge weight. For a two-output full-QR procedure matching our motivating video analysis, cumulative edit rank similarly changes from two to the ambient dimension four. Conversely, the complete cumulative metric-QR trajectory is affine-equivariant when its positive-definite metric, probe, regularizer, and tie-breaking are transported consistently; exact covariance is one corollary, not a canonical semantic metric. In a known-rank finite-sample Adam/QR calibration, identity mixing stops after one accepted update in all 20 large-sample runs, whereas each tested shear $a\in{.5,.75,1,1.25,2}$ accepts at least two updates in all 20 runs. Controlled reparameterizations of frozen V-JEPA2 features preserve rank-zero predictions yet alter later Euclidean trajectories under practical optimization. These visual contact experiments are stress tests, not estimates of contact dimension. Iterative erasure therefore returns a procedure-relative estimand jointly determined by representation geometry and the full measurement procedure, not a semantic dimension by itself.

cs.AI [Back]

[118] Divergent Response Modes in Frontier Language Models Under Steering Pressure cs.AI | cs.CL | cs.LGPDF

Ali Jalal-Kamali

TL;DR: 本研究评估了六款前沿语言模型在显式引导压力下的行为可控性差异，发现模型不仅在行为偏移程度上存在差异，更在响应模式上表现出显著分歧，部分响应模式为特定模型独有。通过Llama作为开源模型进行内部机制分析，线性探针能以0.87的留出准确率从残差流解码行为，且注入该方向可在干预扫描中将行为比例从0%提升至86%。

Details

Motivation: 探究不同前沿语言模型因训练数据、目标函数和安全流程的差异，在显式引导压力下是否会产生可测量的行为差异，填补该领域的研究空白。

Result: 在价值观冲突、推理激发和推理抑制三类共300对基础与引导项目的测试中，GPT-5在拒绝披露推理过程的同时保持答案完整性方面表现独特（99% vs. 其他模型0%）；Claude Opus 4.7与GPT-5以不同方式抵抗显式抑制指令；所有发现在token预算修正和假设盲判提示的对照实验中均成立。

Insight: 模型行为差异不仅体现在量化偏移程度，更本质地反映在响应模式的类型分化上；通过残差流线性探针可实现行为的高精度解码与可控生成，为理解模型内部表征与外部行为的关联提供了可解释性工具。

Abstract: Frontier language models are trained using distinct data, objectives, and safety pipelines. Whether these differences produce measurably different behaviors under explicit steering pressure remains underexplored. This study evaluates behavioral steerability across six frontier models from six developers using 300 paired base and steered items over three categories: values-conflict, reasoning-elicitation, and reasoning-suppression (plus 40 validation items). All six models act as blind peer judges and classify every response based on fixed behavioral rubrics. The resulting 24,480 judgments are scored by leave-one-out consensus. We find that models differ not just in how much steering shifts their behavior but in what kind (mode) of response they give, and some response modes appear in only one or two of them. GPT-5 deflects requests to disclose its reasoning while leaving its answer intact (99% vs. 0% for all other models). Claude Opus 4.7 and GPT-5 resist explicit suppression instructions and in different ways. Using Llama as the open-weight model, we trace the largest behavioral split to its internals. A linear probe decodes the behavior from the residual stream at 0.87 held-out accuracy while injecting that direction during generation drives the behavior from 0% to 86% across an intervention sweep. Every finding holds under both a token-budget remediation and a control experiment with a hypothesis-blind judgment prompt.

[119] Edge Phoneme Recognition for Children’s Speech through Age-Aware Training cs.AI | cs.CL | cs.SDPDF

Matthew Arboleda, Ryan Arboleda, Sophie Haak, Sam Hjelmeset, Andrew Franck

TL;DR: 该论文提出了一种针对儿童语音的边缘音素识别方法，通过年龄感知训练提升模型性能。研究发现，在训练轻量级模型时同时预测学习者的年龄和音素序列，可使一个9400万参数的模型在DrivenData数据集上超越3.17亿参数的WavLM Large模型，并与参数规模大90倍的竞赛集成模型仅相差约0.04字符错误率。该方法促成了可在现代手机上运行的PhonemeTrainer应用，有望改善儿童语音的自动语音识别和发音辅助应用，同时具备边缘处理的隐私与合规优势。

Details

Motivation: 解决儿童语音识别中因训练数据稀缺和语音特性独特导致的音素检测困难问题。

Result: 在DrivenData数据集上，9400万参数的年龄感知模型优于3.17亿参数的WavLM Large，且与大规模集成模型的字符错误率仅差约0.04。

Insight: 创新点在于将年龄预测作为辅助任务融入音素识别训练，通过多任务学习提升轻量模型性能，实现边缘设备上的高效部署。

Abstract: Detecting phonemes from children’s speech has historically been difficult due to the scarcity of training data, and unique characteristics of children’s speech. During a phoneme detection competition, we found that training a lightweight model to predict the age of the learner, as well as the phoneme sequence, enabled a 94M-parameter model to outperform WavLM Large models (317M) on the target DrivenData distribution, and fall within approximately 0.04 CER of competition ensembles with 90 times the parameters. This has enabled the creation of PhonemeTrainer, an application that can run on most modern cellular phones. This will ultimately enable better Automated Speech Recognition (ASR) and pronunciation helper apps for children’s speech, with the privacy and compliance benefits that come with edge processing.

[120] DSAgentBench: Can Agents Automate End-to-End Data-Science Workflows in Real Computer Environments? cs.AI | cs.CLPDF

Mizanur Rahman, Mohammed Saidul Islam, Ridwan Mahbub, Md Tahmid Rahman Laskar, Shafiq Joty

TL;DR: 该论文提出了DSAgentBench，这是首个评估智能体能否在真实计算机环境中自动化端到端数据科学工作流的基准测试。该基准包含275个覆盖整个数据科学生命周期的多样化任务，要求智能体进行多步骤推理和工具协调，并使用确定性评估器验证分析正确性、可视化输出和模型性能。实验表明，即使最强的智能体（Claude-4.6-Sonnet）任务成功率也仅为56.70%，而所有开源智能体均低于1%，揭示了当前智能体系统与真实数据科学工作流之间存在巨大能力差距。

Details

Motivation: 现有基准测试缺乏真实计算机交互，无法评估智能体能否在现实计算环境中执行完整的端到端数据科学工作流，未能捕捉数据科学实践中多阶段、多工具协同的本质。

Result: 在DSAgentBench上对15个闭源和开源模型进行广泛实验，最强的Claude-4.6-Sonnet智能体仅达到56.70%的任务成功率，所有开源智能体均低于1%，在工具编排、操作系统接地和多步骤推理方面频繁失败。

Insight: 创新点在于构建了首个要求真实计算机环境交互、覆盖完整数据科学生命周期、并包含确定性多维度（分析正确性、可视化、模型性能）评估的基准测试，为开发具有接地能力、可验证的自主数据科学智能体奠定了基础。

Abstract: Real-world data science involves long-horizon workflows that span data wrangling, exploration, modeling, visualization, and validation, and require coordinated use of tools such as notebooks, IDEs, terminals, browsers, and databases within real operating environments. Yet existing benchmarks lack real-computer interaction and do not evaluate whether agents can execute complete end-to-end data-science workflows in realistic computing environments, failing to capture the multi-stage, multi-tool nature of data-science practice. We introduce DSAgentBench, the first benchmark to evaluate whether agents can automate full data-science workflows inside real computer environments. DSAgentBench contains 275 diverse tasks covering the entire data-science life-cycle, reflecting the complexity and tool coordination required in practice. Each task requires grounding decisions in intermediate outputs and coordinated tool use, and includes a deterministic evaluator that verifies analytical correctness, visual outputs, and model performance rather than code-only execution. Our extensive experiments with 15 closed- and open-source models show that even the strongest agent, Claude-4.6-Sonnet, achieves only 56.70% task success, while all open-source agents remain below 1%, frequently failing at tool orchestration, OS grounding, and multi-step reasoning. These results reveal a substantial capability gap between current agentic systems and real data-science workflows, positioning DSAgentBench as a foundation for developing grounded, verifiable, autonomous data-science agents. We release DSAgentBench at https://github.com/vis-nlp/DSAgentBench.

Haoyu Zhang, Zhipeng Li, Xiaoying Tang, Tianshu Yu, Yiwen Guo

TL;DR: 本文提出了Ex-Omni-2D，一个全模态对话框架，能够生成包含文本、个性化语音和参考条件视频的协调响应。模型通过预测一个描述场景、情感和动作的结构化视觉思维计划，并利用共享的声学-时间接口将多码本语音单元解码为语音并与视频帧在线对齐，从而实现了从异构数据中学习，避免了大规模监督数据的需求。

Details

Motivation: 现有全模态对话模型虽然能理解多模态输入并合成语音回复，但其响应缺乏视觉体现，即没有与语音协调的视觉化身（视频）。本文旨在解决这个问题，使对话响应具有原生视觉存在感。

Result: 在四步推理下，完整的四GPU流水线在400x720/720x400分辨率下实现了1.293的端到端实时因子，提供了一个实用的质量-效率平衡点。

Insight: 核心创新在于提出了一个共享的声学-时间接口（多码本语音单元），作为连接语音和视频生成的桥梁，并设计了流式学生模型和前缀流式机制以实现高效增量生成，避免了大规模多模态对齐监督数据的需求。

Abstract: Omni-modal dialogue models can understand multimodal inputs and synthesize spoken replies, yet their responses remain visually disembodied. We introduce \textbf{Ex-Omni-2D}, an omni-modal dialogue framework that generates a coordinated response comprising text, personalized speech, and reference-conditioned video. Given a multimodal query, reference image, and reference audio, the model predicts a structured \textit{Visual Thought Plan} (VTP) describing scene, emotion, and motion, followed by response text and native multi-codebook speech units. These units form a shared acoustic-temporal interface: they are decoded into speech and aligned online with video frames. This interface enables the response and avatar pathways to be learned from heterogeneous speech, dialogue, and avatar-video data, avoiding the need for large-scale query–text–speech–video supervision. A full-sequence Video Generator serves as the primary Teacher. For efficient incremental generation, we further distill it into a few-step block-causal \emph{Streaming Student} whose Prefix Streaming mechanism carries a clean latent across consecutive chunks to reduce cumulative late-chunk degradation. With four-step inference, the complete four-GPU pipeline achieves an end-to-end RTF of 1.293 at $400\times720$/$720\times400$, providing a practical quality–efficiency operating point.

[122] ReCBM: Uncertainty-Gated Relational Reasoning for Concept Bottleneck Models cs.AI | cs.CVPDF

An Sui, Yuzhu Li, Fuping Wu, Xiahai Zhuang

TL;DR: 本文提出了ReCBM，一个用于概念瓶颈模型（CBMs）的不确定性门控关系推理框架。该框架通过在瓶颈层引入语义定义的概念关系（如共现、蕴含和排斥），并利用不确定性来指导这些关系的精炼，以解决在不可靠概念状态下进行鲁棒推理的问题。实验表明，ReCBM在多种数据集上提升了概念和任务恢复能力，支持不确定性感知干预，并能提取紧凑的任务相关概念子集而不损害下游性能。

Details

Motivation: 现有概念瓶颈模型在不可靠概念状态下的鲁棒推理能力不足，导致误导性语义证据可能通过瓶颈层传播，损害解释性和下游预测性能。

Result: 在多个数据集上的实验表明，ReCBM在概念缺失和翻转的情况下改善了概念和任务的恢复能力，支持不确定性感知干预，并能提取紧凑的任务相关概念子集，同时保持下游性能不下降。

Insight: 创新点在于将语义关系（共现、蕴含、排斥）显式建模到概念瓶颈中，并利用概念不确定性动态门控关系推理过程，从而增强了模型在噪声概念下的鲁棒性和可解释性。

Abstract: Concept Bottleneck Models (CBMs) provide an interpretable framework by grounding predictions in human-understandable concepts, enabling semantic inspection and test-time intervention. Recent variants have improved CBMs through richer concept representations, uncertainty estimation, and dependency modeling. However, robust reasoning under unreliable concept states remains underexplored. Without such reasoning, misleading semantic evidence can propagate through the bottleneck, compromising both explanations and downstream predictions. To address this issue, we propose ReCBM, an uncertainty-gated relational reasoning framework for CBMs. ReCBM introduces semantically defined concept relations into the bottleneck and uses uncertainty to guide their refinement. By modeling co-occurrence, implication, and exclusion, ReCBM specifies how evidence is exchanged across concepts, while uncertainty modulates the contribution of each concept during this process. Experiments across diverse datasets showed that ReCBM improved concept and task recovery under missing and flipped concepts, supported uncertainty-aware intervention, and extracted compact task-relevant concept subsets without degrading downstream performance.

[123] VERDICT: Training-Free Step-Wise Verification of Multimodal Reasoning via Disagreement-Aware Consensus cs.AI | cs.CV | cs.GTPDF

Rohit Sinha, Kunal Tilaganji, Tanuja Ganu, Nagarajan Natarajan, Amit Sharma

TL;DR: 本文提出了一种名为VERDICT的无训练、领域无关的逐步验证方法，用于检测多模态大语言模型生成的推理链中的错误。该方法通过利用不同冻结验证器之间的分歧信息，将验证形式化为一个耦合评分问题，并基于协调博弈的闭式解计算共识分数，从而实现基于分歧的过滤和稳定性排序。

Details

Motivation: 多模态大语言模型生成的推理链常包含导致错误答案的细微错误，而现有验证方法要么需要昂贵的标注监督且跨任务性能不稳定，要么通过简单聚合多个来源的分数，忽略了分歧本身对判断推理步骤有效性的关键信息。

Result: 在六个基准测试上评估，VERDICT相比基础模型持续提升了高达+5.95%的性能，并与需要大量监督的领域特定批评器表现相当，表明跨模态一致性提供了无需任务特定适应和训练的鲁棒验证信号。

Insight: 创新点在于首次将跨模态分歧结构显式化并用于无训练验证，通过协调博弈的闭式均衡解将分歧转化为可操作的共识分数，实现了无需监督的、基于分歧感知的推理步骤验证与排序。

Abstract: Multimodal large language models often generate reasoning chains containing subtle errors that lead to incorrect answers. Current verification approaches have notable limitations. Existing approaches either require expensive labelled supervision with inconsistent cross-task performance or aggregate scores from multiple sources by simple aggregations, missing a key insight: when these scores disagree, that disagreement itself carries important information about whether a reasoning step is truly valid or not. We formalise this as a coupled scoring problem among disparate, frozen verifiers, interpretable as a coordination game with a unique closed-form equilibrium where agreement signals valid steps while disagreement reveals instability. Towards this end, we propose a training-free domain-agnostic step-wise verification approach we call VERDICT: VERification via Disagreement-Informed Coupled Thresholding. To our knowledge, VERDICT is the first training-free verifier that makes the structure of cross-modal disagreement explicit and actionable. It computes consensus scores through a closed-form solution, enabling both disagreement-aware filtering and stability-conscious ranking of reasoning steps. Evaluated across six benchmarks, \method consistently improves over the base model by up to +5.95%, and performs competitively with domain-specific critics that demand extensive supervision, demonstrating that cross-modal agreement provides robust verification signals without task-specific adaptation and Training-Free Verification

[124] Compositional Benchmark Synthesis for Hierarchical Human Action Recognition cs.AI | cs.CVPDF

Farnaz Soleimani, Abdelghani Chibani, Yacine Amirat, Ghazaleh Khodabandelou

TL;DR: 本文提出了一种用于层次化人类行为识别的组合式基准合成框架，能够从扁平的单标签动作语料库中合成一个包含动作、活动、低层意图和高层意图的四层层次化意图基准，同时保留动作级别的真实预提取特征。该框架通过主题一致性约束下的转移模型组装片段，并利用覆盖感知采样器将主题使用的基尼系数从0.566降低至0.248，生成了15,002个片段。

Details

Motivation: 现有的大型语料库通常只提供孤立、原子化标注的片段，缺乏时间组合性；而记录的复合活动语料库则层次浅、领域窄且结构固定，无法满足跨抽象层次（从原子动作到长期意图）的人类行为识别需求。

Result: 在合成的基准上，四个不同模型家族的参考基线均表现出0.13至0.17的宏F1组合式留出差距，包括表现最佳但未能消除差距的图感知模型，表明这是基准的结构特性而非模型缺陷。逻辑无关基线仍以高于内在数据率的水平违反留出语义规则，而顺序破坏控制则在种子变异范围内改变宏F1，用于验证生成器一致性。

Insight: 创新点在于通过设计将序列生成规则与评估所用的一阶逻辑规则分离，避免了循环监督风险；同时，覆盖感知采样器显著提升了主题使用的公平性，且基准的合成方法允许再生和扩展，为层次化行为识别提供了可扩展的评估框架。

Abstract: Recognizing human behavior across levels of abstraction, from atomic actions to long-horizon intentions, requires data annotated along a semantic hierarchy. Large corpora provide isolated, atomically labeled clips without temporal composition, whereas recorded composite-activity corpora offer shallow, domain-narrow, fixedhierarchies. A benchmark-generation and evaluation frameworkis proposed that synthesizes a four-level hierarchical-intention benchmark, spanning actions, activities, low-level intentions (LLIs), and high-level intentions (HLIs), from a flat single-label action corpus while retaining real pre-extracted features at the action level. Episodes are assembled by a transition model under a subject-consistency constraint, and a coverage-aware sampler reduces the subject usage Gini from 0.566 to 0.248. Synthesizing such a benchmark raises a circular-supervision risk that recorded datasets avoid: if the rules generating the episodes also govern the evaluation, models can succeed by recovering the generator rather than through genuine reasoning. Validity is addressed by design, holding sequence-generation rules disjoint from the first-order-logic rules used at evaluation. The instantiation yields 15,002 episodes. Four reference baselines from different model families characterize difficulty, not as recognition methods. A compositional held-out gap of 0.13 to 0.17 macro-F1 appears across all baselines, including a graph-aware model that recognizes best yet does not close the gap, indicating a structural property of the benchmark rather than a model artifact. A logic-free baseline still violates the held-out semantic rules above their intrinsic data rate, and the order-destroying control changes macro-F1 within seed variation, serving as a generator-consistency check. Theontology, transition model, and generator are released so the benchmark can beregenerated and extended.

cs.CY [Back]

[125] Who Gets Heeded? An Obligation-Level Audit of Responsiveness in EPA Rulemaking cs.CY | cs.CLPDF

Jianing Fan, Yue Yao

TL;DR: 本文提出了一种义务层面的响应性审计框架，用于评估美国环保署（EPA）规则制定过程中公众评论是否真正影响了具体监管义务的修改。该框架通过提取规则草案和最终规则中的义务条款、匹配相关评论并分类修改结果，对超过7万条评论进行分析，揭示了评论参与与规则修订之间的关联模式。

Details

Motivation: 现有研究通常在规则或语料库层面分析公众评论的影响，过于粗略，无法捕捉评论者试图改变的具体监管义务。本文旨在开发一个更精细的审计框架，以衡量公众参与是否与特定监管义务的修改同时发生。

Result: 该框架在2010-2022年间EPA的36项核心规则制定（涉及70,075条评论）上应用。主要发现包括：评论参与与规则修订在单个规则内存在适度关联；支持与反对的立场并未明显区分结果；组织性多数参与的评论更倾向于导致编辑性完善而非实质性修改。人工盲审验证了第三个发现。

Insight: 创新点在于提出了一个可审计的、AI辅助的义务层面响应性审计框架，能够精细匹配评论与具体监管义务。方法学贡献是揭示了文本相似性方法不足以区分编辑性修改与实质性监管变化，并指出公平性不对称的根源在于不同评论群体识别、解释和质疑具体法律义务的能力差异。

Abstract: Notice-and-comment rulemaking gives any affected party the same formal right to influence federal regulation, but formal access is not substantive capacity to shape rule text. Existing strategies operate at the rule or aggregate-corpus level, too coarse to capture the discrete regulatory obligations where commenters seek change. We introduce obligation-level responsiveness auditing, an auditable, AI-assisted framework for measuring whether public-comment engagement co-occurs with changes to specific regulatory duties. The framework extracts proposed and final-rule obligations, matches comments to the obligations they address, and classifies proposed-final outcomes; each load-bearing component is evaluated against blind human judgment. We apply the framework to 70,075 comments across 36 EPA anchor rulemakings, drawn from a corpus of 786,197 comments across 6,145 dockets from 2010-2022. Three descriptive findings emerge. First, engagement is associated with revision at a modest within-docket magnitude. Second, support-versus-opposition direction does not clearly differentiate outcomes, an informative null inconsistent with simple preference-aggregation. Third, under a permissive reconstruction of commenter type, organizational-majority engagement concentrates in editorial-refinement rather than substantive-modification outcomes at the cross-docket level. A blind human audit of the load-bearing outcome contrast preserves this third finding under corrected labels and reveals that text-similarity methods are insufficient for distinguishing editorial from substantive regulatory change, a measurement-validity lesson we treat as a supporting methodological contribution. Together, these findings locate the equity asymmetry upstream of agency response: in differential capacity across commenter populations to identify, interpret, and contest specific legal obligations.

physics.ao-ph [Back]

[126] Rescene: band-limited stochastic forcing turns a frozen neural weather operator into a climate emulator physics.ao-ph | cs.AI | cs.CVPDF

Minjong Cheon

TL;DR: 这篇论文提出了Rescene方法，通过在冻结的神经天气预测模型（一个1.5度分辨率、6小时步长的视觉Transformer算子）上添加一个轻量级包装器，使其能够稳定地进行长期气候模拟。该包装器包含一个确定性的‘慢时钟’和一个生成性的随机扰动头，旨在恢复模型的日变化和长期稳定性，避免漂移。

Details

Motivation: 当前机器学习天气预测模型在中期预报上表现优异，但在自由积分超越训练范围时会出现不稳定（如爆炸、漂移或失去季节周期），且重新训练成本高昂。因此，研究旨在探索如何在不修改冻结主干模型的情况下，恢复其长期稳定性和气候模拟能力。

Result: 在ERA5再分析数据上评估，仅确定性包装器可稳定运行数十年，但日变率降至ERA5的40%；添加生成性头后，日变率恢复至观测的126%（Z500）和130%（MSLP），模式相关性达0.89和0.92，阻塞频率恢复82%，集合校准良好（扩展技能比0.78-0.97，从第7天到第90天），并能无漂移积分100年（每世纪+0.008 +/- 0.014 K）。

Insight: 创新点在于设计了一个轻量级、带限（波数k≤20）的随机强迫机制，通过生成性扰动恢复变率，同时利用冻结主干模型自然维持小尺度能量（在k≥40尺度上，主干提供的能量是扰动的28倍），实现了长期气候模拟的稳定性和真实性，为冻结模型的高效再利用提供了新思路。

Abstract: Over the past few years, the rapid development of machine learning (ML) models for weather forecasting has produced deterministic models whose medium-range skill matches or exceeds that of the European Centre for Medium-Range Weather Forecasts (ECMWF)’s high-resolution forecast (HRES). However, when these models are integrated freely beyond the horizon they were trained for, they blow up, drift, or lose their seasonal cycle, and retraining them for stability is expensive. We therefore ask what can be recovered from a strictly frozen backbone. We present Rescene, a 0.4 M-parameter wrapper around a frozen 1.5 degree, 6-hourly vision-transformer operator, developed using ERA5 reanalysis data and comprising a deterministic “slow clock” (0.33 M) that blends the forecast toward a lead-aware day-of-year climatology and a generative head (0.06 M) that adds a spectrally shaped stochastic perturbation at every step. The performance evaluation demonstrates that the deterministic wrapper alone is stable for decades but collapses daily variability to 40% of ERA5. Adding the generative head restores 126% (Z500) and 130% (MSLP) of the observed daily variability with pattern correlations of 0.89 and 0.92, recovers 82% of the observed blocking frequency, keeps the ensemble calibrated (spread-skill ratio 0.78-0.97 from day 7 to day 90), and integrates for 100 years with no detectable drift (+0.008 +/- 0.014 K per century). Moreover, because the perturbation is band-limited to total wavenumber $k \le 20$, the small scales are never forced, yet realistic $k \ge 20$ power is sustained: a direct decomposition of the 6-hourly energy budget shows that the frozen operator supplies 28 times more energy than the perturbation at $k \ge 40$, with a fractional growth rate 247 times larger at the grid scale than at planetary scales.

Table of Contents

cs.CL [Back]

[1] Position Encoding in Transformers: From Absolute and Relative Methods to Rotary Position Embeddings and Long-Context Scaling cs.CLPDF

[2] When Chain-of-Thought Helps and When It Hurts: An Empirical Investigation of the Serial-Depth Bottleneck in LLM Reasoning cs.CL | cs.AI | cs.LGPDF

[3] Multimodal Item Parameter Estimation using Simulated Response Probabilitie cs.CL | cs.AIPDF

[4] Is This Your Final Answer? Cross-Contextual Consistency as a Measure of LLM Credibility cs.CL | cs.AIPDF

[5] VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback? cs.CLPDF

[6] From Reasoning Depth to Reasoning Breadth: Evaluating Multi-Point Associative Reasoning in Large Language Models cs.CL | cs.AIPDF

[7] Calibrating Post-Training Feature Shifts for LLM Data Contamination Detection cs.CLPDF

[8] Dual-Loop Self-Evolution via Verifiable Emotion Feedback for Multi-Turn Empathetic Dialogue cs.CLPDF

[9] SPIEval: Evaluating Large Language Models as Mobile Assistants over Scattered Personal Information cs.CL | cs.AIPDF

[10] Surfacing the Unsaid: CUE-Bench for Affective Stance in Chinese Discourse cs.CL | cs.AIPDF

[11] Reference-Free Post-Training of Open Large Language Models for Multilingual Machine Translation cs.CL | cs.AIPDF

[12] FaithformBench: Benchmarking Faithfulness of Mathematical Chain-of-Thought Autoformalisation cs.CL | cs.AI | cs.LOPDF

[13] MUSE: A Full-Text Cross-Domain Knowledge Base of Scientific Problems, Solutions, and Rationales cs.CLPDF

[14] REAP: Relation-Aware Elicitation and Parsing for Closed-Book Knowledge Base Construction from LLMs cs.CLPDF

[15] ConRub-Med: Reinforcement Learning with Consensus Rubrics for Open-Ended Medical Question Answering cs.CLPDF

cs.CV [Back]

[16] Signpost Watermarking: Joint Optimization for Visual Watermark Coexistence cs.CVPDF

[17] LEGO: Leveled Language Gaussian Splatting cs.CVPDF

[18] 4D-WAM: 4D Consistent World Modeling for Autonomous Driving cs.CVPDF

[19] P3CA: Encoder-Agnostic Interpretation of Vision Foundation Model Embeddings via Spatial Probing cs.CV | cs.LGPDF

[20] Human versus Computer Vision cs.CV | cs.CYPDF

[21] A Convolutional Layer Activation Dimensionality Reduction for Out-of-Distribution and Adversarial Attack Detection Methods cs.CVPDF

[22] Motion Artifact-Aware Self-Supervised Representation Learning for 3D Brain MRI Motion Artifact Reduction cs.CV | physics.med-phPDF

[23] More Accurate, Less Human: Gestalt Grouping in Vision Models cs.CV | cs.LGPDF

[24] SeFaR: Semantic Feature-aware Robustness Testing of Deep Neural Networks cs.CV | cs.LGPDF

[25] Chain of Spatial Thoughts: Modality-Agnostic Spatial Grounding for Vision Language Models cs.CVPDF

[26] TRACE-GS: On-Policy Trajectory Distillation with Privileged Geometric Conditioning for Sparse-View 3DGS Restoration cs.CVPDF

[27] UniMod: Enhancing Multi-Modal Medical Diagnosis through Cross-Modality and Within-Modality Alignment cs.CV | cs.LG | cs.MMPDF

[28] MRIComp4Flow: Compression of 3D Brain MRI for Training Multi-Modal Generative Models cs.CV | cs.AI | cs.LGPDF

[29] From Detection to Understanding: TAR and TAR-Bench for Multi-Task Traffic Anomaly Reasoning cs.CVPDF

[30] CasDeblurGS: Cascaded 2D-to-3D Multi-View Consistency for 3D Gaussian Splatting from Two Blurry Images cs.CVPDF

[31] A second-order theory of texture for depth from focus cs.CVPDF

[32] DriveVLA-M0: Failure-Aware Memory Augmentation for Autonomous Driving cs.CVPDF

[33] GeoSeg-OV: Bridging Geospatial Gaps with Structural Guidance for Open-Vocabulary Remote Sensing Segmentation cs.CVPDF

[34] Lesion-Aware Adaptive Fourier Neural Operator for CT-to-PSMA PET Synthesis in Prostate Cancer cs.CV | physics.med-phPDF

[35] Stream Forcing: Constructing Unified Training Trajectory for Robust Streaming Video Generation cs.CVPDF

[36] Bridging Event Streams and DiT: Event-Guided Video Frame Interpolation cs.CVPDF

[37] FUSE: Frame-Unified Stress Estimation from Facial Video cs.CV | cs.AIPDF

[38] When Vision Becomes Text: Visual Token Pruning via Cross-Modal Residual Guidance in VLMs cs.CVPDF

[39] SapiensID 2.0: Aligning Human Recognition Foundation Models with Human Perception cs.CVPDF

[40] DSAR: Dual-Stream Autoregressive Modeling of Temporal Cloth Dynamics for Photorealistic Animatable Avatars cs.CVPDF

[41] SafeCap: Improving LVLM Safety with Image Captioning Reinforcement Learning cs.CV | cs.AIPDF

[42] SparSTAR: Sparse Attention for SpaceTime AutoRegressive Video Synthesis cs.CVPDF

[43] Unlocking the Power of Medical Tabular Data via Semantic-Aware Multimodal Pre-training cs.CV | cs.AIPDF

[44] Rethinking Text-Based Image Retrieval in Specific Domain cs.CV | cs.AIPDF

[45] Dynamic Context Adapters: Efficiently Infusing History into Vision-and-Language Models cs.CV | cs.AIPDF

[46] Rethinking Data Efficiency in Industrial Dense Prediction: Pretraining Coherence, Not Inductive Bias, Determines ViTs Low-Data Advantage cs.CVPDF

[47] Gaussian Sculpting: End-to-End Controllable Surface Reconstruction via Field Optimization cs.CV | cs.GRPDF

[48] InSight-doc: Agentic Visual Perception for Long-Document Understanding cs.CV | cs.CL | cs.LGPDF

[49] MedUP: Awakening Unified Understanding and Perception in Medical Vision-Language Models cs.CV | cs.AIPDF

[50] PolypVision: A Three-Stage Hierarchical Deep Learning Framework for Classification and Segmentation of Colorectal Polyps cs.CVPDF

[51] Chartography: A Benchmark for Professional Chart Understanding cs.CVPDF

[52] Bridging Severe Cross-Modal Misalignment: End-to-End Visible-Infrared Object Detection via Explicit Feature-Domain Affine Registration cs.CVPDF

[53] MMArt A Multi-Perspective Multimodal Dataset for Visual Art Understanding cs.CV | cs.MMPDF

[54] Self-Geometry: GT-Free and Plug-and-Play Test-Time Adaptation for Geometrically Consistent 3D Vision Foundation Models cs.CVPDF

[55] Grid-Preserving Knowledge Distillation: Transferring Convolutional Inductive Bias to Vision Transformers under Data Scarcity cs.CVPDF

[56] InterPruner: Interactive Structured Pruning via Taylor-Implicit Criterion and Language-Prior Modulator for Multimodal Object Detection cs.CVPDF

[57] Rethinking LLM Verification: Evidence Structure, Uncertainty, and Selective Refinement cs.CV | cs.SCPDF

[58] Beyond Pixels: From Video Priors to 4D Worlds cs.CVPDF

[59] Where To Look? : Causal Tracing of Vision Encoders in VLM cs.CVPDF

[60] MVTrack: Ultrafast Appearance-Free Moving Object Tracking from Compressed Bitstreams cs.CV | cs.AIPDF

[61] FADE: From Passive Verification to Active Discovery in Counterfactual Video Understanding cs.CVPDF

[62] E$^3$mo-Bench: A Scalable Benchmark for Multimodal Evoked and Expressed Emotion Understanding via Bayesian Pairwise Alignment cs.CVPDF

[63] Evaluating Semantic and Spatial Guidance for Foundation Model Segmentation of Small-Scale PV in Remote Sensing Imagery cs.CVPDF

[64] MIRA: Medical Image Reflection for Agentic Diagnosis cs.CV | cs.AIPDF

[65] UniProbe: A Learnable Token-Level Hallucination Detector for Large VLMs using Multi-Structural Internal Representations cs.CV | cs.LGPDF

[66] PolyLayout: Hierarchical VLM-Guided Layout Generation Beyond Rectangular Rooms cs.CVPDF

[67] Multi-View Relational Distillation for Spatial Reasoning with Vision-Language Models cs.CVPDF

[68] NullEdit: Stealthy Image Protection via VLM Condition Redirection cs.CVPDF

[69] GESTO: Human-Centric Spatio-Temporal Memory for Reasoning in Dynamic Scenes cs.CV | cs.ROPDF

[70] Order Matters: LVLMs as Judges for Temporal Reasoning in Image Sequences cs.CV | cs.CLPDF

[71] SafeCA: Safe Cross-Attention Localization and Regulation for Text-to-Video Jailbreak Defense cs.CVPDF

[72] Temporally Grounded Compositional Camera Motion Understanding via Geometric Knowledge Distillation cs.CV | cs.AIPDF

[73] Mixture-of-Experts-based Entropy Model for Learned Image Compression cs.CVPDF

[74] StreamFlow: Dynamic Memory Flows for Streaming Video Understanding cs.CV | cs.CLPDF

[75] Evidence-Grounded Trustworthy Multimodal Reasoning and Evaluation Benchmark in Complex Urban Scenes cs.CV | cs.AIPDF

[76] CARE: Confidence-Aware Reasoning for Reliable Medical VQA cs.CV | cs.AIPDF

[77] Once Poisoned, Arbitrarily Controlled: A Programmable Backdoor in VLMs cs.CV | cs.CRPDF