cs.CL [Total: 18]
cs.CV [Total: 71]
cs.GR [Total: 1]
cs.RO [Total: 2]
cs.LG [Total: 9]
eess.IV [Total: 2]
cs.AI [Total: 3]

cs.CL [Back]

[1] Evaluating Large Language Models in a Complex Hidden Role Game cs.CL | cs.AI | cs.GT | cs.MAPDF

Niklas Bauer

TL;DR: 本文通过社交推理游戏《秘密希特勒》评估大语言模型（LLMs）的推理、说服和欺骗能力。作者开发了一个开源框架和新的评估指标（角色识别准确率、欺骗保持率和游戏状态影响率），用于量化模型的性能。研究发现，当前LLMs在复杂多轮操纵任务中表现不佳，其对话能力与战略深度之间存在差距，且推理增强技术（如思维链提示）未能提升模型在游戏中的胜率。

Details

Motivation: 动机在于量化大语言模型的欺骗潜力对AI安全至关重要，但在非受控环境中难以实现。因此，作者选择在复杂的社交推理游戏环境中系统评估LLMs的战略和欺骗能力。

Result: 在《秘密希特勒》游戏中，基于规则的智能体与人类专家投票决策的一致性达到86.7%，而Llama 3.1 70B等模型仅达到59.7%的准确率。扮演法西斯角色的模型胜率最多降低23.2%，产生负面的影响分数，且无法维持欺骗，导致游戏时长比人类缩短约40%。思维链提示和内部记忆等推理增强技术并未带来性能提升。

Insight: 创新点在于提出了一个专门用于评估LLMs战略欺骗能力的开源框架和一套新颖的量化指标。客观来看，该研究揭示了当前LLM架构在复杂、多轮社会操纵任务中的根本性不足，为未来的对齐研究提供了一个可复现的测试平台。

Abstract: Quantifying the deceptive potential of Large Language Models (LLMs) is critical for AI safety, yet difficult to achieve in uncontrolled environments. This work investigates the reasoning, persuasion, and deceptive capabilities of LLMs within the social deduction game Secret Hitler. I introduce an open-source framework and novel metrics to measure performance: Role Identification Accuracy, Deception Retention Rate, and Game State Impact Rate. By benchmarking models against rule-based algorithms and human games, I identify a gap between conversational ability and strategic depth. The study also analyzes the impact of reasoning-enhancement techniques on win rates and strategic reasoning. Neither Chain-of-Thought prompting nor internal memory bring improvements in performance, with up to 23.2% worse win rates for fascist roles. While rule-based agents align with expert human voting decisions 86.7% of the time, models like Llama 3.1 70B achieve only a 59.7% accuracy. Models playing as Fascists consistently yield negative impact scores and fail to sustain deception, resulting in roughly 40% shorter games compared to humans. These findings suggest that current architectures remain ineffective at complex, multi-turn manipulation. As capabilities advance, detecting when models begin to master these deceptive behaviors is crucial. The developed framework serves as a reproducible testbed for future alignment research.

[2] Learnability-Informed Fine-Tuning of Diffusion Language Models cs.CL | cs.LGPDF

Shubham Parashar, Atharv Chagi, Jacob Helwig, Lakshmi Jotsna, Sushil Vemuri

TL;DR: 本文提出了一种名为LIFT的高效微调算法，旨在提升扩散语言模型（DLMs）的推理能力。该算法通过分析学习性，在训练中根据扩散时间步的不同信息可用性，调整对简单和困难标记的学习策略，从而克服了传统监督微调（SFT）在DLMs中性能下降的问题。

Details

Motivation: 传统SFT在扩散语言模型中应用效果不佳甚至损害性能，其根本原因在于忽视了标记的学习性（即学什么以及何时学），特别是在不同掩码比例下，稀有标记和常见标记的学习难度和价值存在差异。

Result: LIFT在六个推理基准测试中均优于现有SFT基线，在AIME’24和AIME’25上实现了高达3倍的相对性能提升。

Insight: 核心创新在于将学习性分析与扩散过程的时间步对齐，提出了一种根据上下文可用性动态调整学习目标（简单/困难标记）的微调策略，这为扩散模型的训练优化提供了新的视角。

Abstract: We aim to improve the reasoning capabilities of diffusion language models (DLMs). While SFT is a popular post-training recipe for autoregressive models, its use in DLMs faces challenges and can even hurt performance, though the underlying causes remain understudied. Our analysis reveals that vanilla SFT overlooks learnability, namely what and when tokens are learned. Specifically, rare tokens are difficult to learn when most of the input is masked, whereas it is straightforward and thus of little value to learn common tokens when most of the input is unmasked. Motivated by our analysis, we propose LIFT, an efficient SFT-based post-training algorithm for DLMs. LIFT learns easy tokens when most of the input is masked and hard tokens when more context is available, thus aligning the training with the information available at different diffusion time steps. Our results show that LIFT outperforms existing SFT baselines across six reasoning benchmarks, achieving up to a 3x relative gain on AIME’24 and AIME’25. Our code is publicly available at https://github.com/divelab/LIFT.

[3] What Training Data Teaches RL Memory Agents: An Empirical Study of Curriculum Effects in Memory-Augmented QA cs.CLPDF

Xinjie He, Zhiyuan Lin, Su Liu, Jialun Wu, Qiyang Xie

TL;DR: 本文通过控制实验研究训练数据组成对强化学习记忆代理在问答任务中技能习得的影响，发现课程设计是细粒度专业化的调节杠杆而非均匀性能缩放因子，混合课程在整体F1分数上表现最优，且单领域训练能针对性迁移时间推理技能。

Details

Motivation: 现有研究仅在单一基准上训练记忆代理，未探究训练数据组成如何影响代理技能获取，本文旨在通过控制变量实验填补这一空白。

Result: 在两个基准测试和十种问题类型上，混合课程在整体F1分数上表现最强；单领域训练虽整体性能弱但能针对性迁移时间推理技能；类型间差异显著超过整体差异。

Insight: 课程组成作为细粒度专业化调节杠杆的发现挑战了单一指标比较的局限性；适应单GPU训练的实践教训包括跨基准混合需过滤格式噪声、小批量场景需采用连续奖励函数。

Abstract: Reinforcement learning (RL) has emerged as a viable recipe for training LLM agents to reason over external memory banks in multi-session dialogue. Existing work trains exclusively on a single benchmark, leaving open how the composition of training data shapes the skills a memory agent acquires. We present a controlled empirical study that holds architecture, RL algorithm, and all hyperparameters fixed and varies only the training curriculum across three conditions: in-domain (LoCoMo), mixed-benchmark (LoCoMo + LongMemEval), and out-of-domain (LongMemEval only). Across two benchmarks and ten question types, curriculum composition acts as a fine-grained lever on specialization rather than a uniform scaling factor on performance. The mixed curriculum yields the strongest overall F1 on both evaluation sets. Training on a narrow out-of-domain set transfers a targeted skill - temporal reasoning - despite weak aggregate performance. Per-type differences substantially exceed aggregate differences, indicating that single-number benchmark comparisons systematically underreport curriculum effects. We further report two practical lessons from adapting GRPO to a single-GPU regime: cross-benchmark mixing requires filtering format-specific noise from memory banks to preserve training signal, and binary exact-match reward produces no learning signal at the small group sizes (G = 4) required on one GPU, motivating continuous reward functions in this regime.

[4] DFKI-MLT at SemEval-2026 TASK 7: Steering Multilingual Models Towards Cultural Knowledge cs.CLPDF

Yusser Al Ghussin, Daniil Gurgurov, Yasser Hamidullah, Josef van Genabith, Cristina España-Bonet

TL;DR: 本文介绍了DFKI-MLT团队在SemEval-2026任务7（文化意识任务）中提出的方法，该方法通过从平行FLORES数据中提取语言向量，对多语言大语言模型进行激活引导，在推理时向选定Transformer层的残差流添加语言特定引导向量，无需参数更新。团队参与了简答和多项选择两个赛道，但仅多项选择赛道获得官方评分，以86.96%的准确率在17支队伍中排名第7。后验分析表明，激活引导对文化推理的改进有限且不稳定，效果受层选择、语言-区域对及提示设计影响显著。

Details

Motivation: 大语言模型在不同语言和文化背景下的应用日益广泛，但其文化知识在不同地区和语言间分布不均，因此需要提升多语言模型的文化意识能力。

Result: 在SemEval-2026任务7的官方多项选择赛道中，该方法取得了86.96%的准确率，在17支参赛队伍中排名第7。

Insight: 创新点在于使用从平行数据提取的语言向量进行无参数更新的激活引导，实现推理时适应；客观分析表明，该方法效果受模型层、语言对和提示设计共同影响，提示设计与激活引导的联合优化是提升文化感知多语言推理的关键。

Abstract: Large language models (LLMs) are increasingly used across diverse linguistic and cultural contexts, yet their cultural knowledge remains uneven across regions and languages. We present the DFKI-MLT system for SemEval-2026 Task 7 on cultural awareness, where we apply activation steering to multilingual LLMs using language vectors extracted from parallel FLORES data. Our method performs inference-time adaptation by adding language-specific steering vectors to the residual stream at a selected transformer layer, without any parameter updates. We participated in both the short-answer (SAQ) and multiple-choice (MCQ) tracks; however, only our MCQ submission received an official score. In the official MCQ track, we achieved 86.96% accuracy, ranking 7th out of 17 teams. To better understand system behavior, we conduct post-hoc analyses on the shared-task MCQ and SAQ settings. These analyses show that activation steering yields modest and heterogeneous improvements on cultural reasoning: gains are strongly layer-sensitive, vary substantially across language-region pairs, with some configurations even degrading performance, and interact with prompt formulation, comparing generic and culturally conditioned prompts. Our findings suggest that prompt design and activation steering should be jointly optimized for culturally aware multilingual inference.

[5] Same Model, Different Weakness: How Language and Modality Reshape the Jailbreak Attack Surface in Frontier MLLMs cs.CLPDF

Casey Ford, Madison Van Doren, Sicheng Jin, Emily Dix

TL;DR: 本文首次系统性地研究了多模态大语言模型（MLLM）的越狱攻击面在不同语言和模态下的差异。通过对比美国英语和墨西哥西班牙语在文本和图文多模态条件下的攻击效果，发现语言选择会重塑攻击面：角色扮演等语言框架攻击在西班牙语下效果减弱，而视觉显式多模态攻击则增强。这表明安全评估框架必须将语言和模态视为相互作用的维度。

Details

Motivation: 解决当前MLLM安全评估框架通常将语言和模态视为独立维度的问题，揭示这种处理方式会错误地刻画全球部署MLLM的实际攻击面，从而需要重新设计评估方法。

Result: 在四个前沿MLLM（Claude Sonnet 4.5, GPT-5, Pixtral Large, Qwen Omni）上，使用包含363个场景的固定对抗基准进行测试，收集了52,272个危害评分和攻击成功判定。贝叶斯混合效应分析表明，安全排名在不同语言间不守恒（例如，在西班牙语下Qwen Omni取代Pixtral Large成为最脆弱模型），且绝对攻击成功率随模型代际下降但模型间差距依然存在。

Insight: 核心创新点在于揭示了语言和模态在塑造MLLM攻击面时的相互作用机制，表明语言对齐失败和视觉对齐失败是不同机制导致的，仅切换语言就足以暴露这种分离。这为设计更准确、考虑语言-模态交互的全球MLLM安全评估框架提供了关键洞见。

Abstract: The attack surface of a multimodal large language model (MLLM) is language-dependent in ways that reveal the mechanistic structure of alignment failures. We present the first systematic cross-lingual, multimodal red-teaming study comparing jailbreak vulnerability in US English (en-US) and Mexican Spanish (es-MX) across four frontier MLLMs: Claude Sonnet 4.5, GPT-5, Pixtral Large, and Qwen Omni. Using a fixed adversarial benchmark of 363 diverse prompt scenarios administered in text-only and multimodal conditions, we collected 52,272 harm ratings and binary attack success judgements from matched panels of nine native-speaker annotators per language group. Our central finding is that language does not scale vulnerability uniformly. Bayesian mixed-effects analyses reveal that linguistic framing attacks such as role-play become substantially less effective under Spanish prompting, while visually explicit multimodal attacks become more effective, which directly implicates the prompt-language interface rather than global annotator leniency. This dissociation indicates that linguistic and visual alignment failures operate through distinct mechanisms, and that switching language is sufficient to expose that separation. The practical consequence is that safety rankings are not preserved across languages. Qwen Omni overtakes Pixtral Large as the most vulnerable model among es-MX participants, a rank reversal no scalar correction of English-condition scores could recover, and absolute attack success rates have declined across model generations without closing the gaps between them. These findings demonstrate that safety evaluation frameworks treating language and modality as independent dimensions fundamentally misspecify the attack surface of globally deployed MLLMs, and must be redesigned accordingly.

[6] Fast-dDrive: Efficient Block-Diffusion VLM for Autonomous Driving cs.CLPDF

Kewei Zhang, Jin Wang, Sensen Gao, Chengyue Wu, Yulong Cao

TL;DR: Fast-dDrive提出了一种用于端到端自动驾驶的高效块扩散视觉语言动作模型。该方法通过将结构化输出冻结为节段骨架，在语义单元内进行双向细化，同时强制执行严格的因果顺序，解决了现有自回归模型推理效率低、扩散模型存在逻辑泄漏的问题。

Details

Motivation: 解决现有端到端自动驾驶VLA模型在轨迹规划的高保真度和推理效率之间难以平衡的问题。具体而言，自回归模型在边缘硬件上受内存带宽限制且易受暴露偏差影响，而全序列扩散模型无法重用KV缓存并存在违反感知-规划因果关系的“逻辑泄漏”。

Result: 在WOD-E2E测试集上，Fast-dDrive在ADE@3s和ADE@5s指标上达到SOTA水平，并在基于扩散的VLA中获得了最高的RFS。在nuScenes数据集上，它将平均L2误差降低至0.32米（提升了22%）。当与SGLang集成时，该框架相比自回归基线实现了12倍的吞吐量加速。

Insight: 核心创新在于块扩散架构与节段感知训练方法，通过将结构化输出（如JSON）冻结为骨架来分离结构和内容生成，并强制执行跨语义单元的因果顺序。此外，提出的骨架推测解码和基于共享前缀KV缓存的低成本测试时缩放方案，在保证质量的同时大幅提升了推理效率。

Abstract: End-to-end autonomous driving via Vision-Language-Action (VLA) models demands a precarious balance between high-fidelity trajectory planning and efficient inference. Existing paradigms typically fall short: autoregressive (AR) VLAs are memory-bandwidth-bound on edge hardware and prone to exposure-bias drift, while full-sequence diffusion models preclude KV-cache reuse and suffer from “logical leakage” that violates the fundamental perceive-then-plan causality. We present Fast-dDrive, a block-diffusion VLA that performs bidirectional refinement within semantic units while enforcing strict causal ordering across them. Leveraging the observation that driving VLAs often emit structured JSON-like outputs, Fast-dDrive freezes structural tokens into a section scaffold and employs a section-aware training recipe that prioritizes safety-critical planning. We further introduce Scaffold Speculative Decoding to achieve AR-equivalent quality at significantly higher throughput. Finally, we propose a low-overhead test-time scaling scheme: by forking $N$ stochastic trajectory rollouts from a single shared-prefix KV cache and averaging them, we effectively suppress prediction variance at a fractional computational cost. Empirical results demonstrate that Fast-dDrive redefines the speed-accuracy frontier for driving agents. On the WOD-E2E test set, Fast-dDrive achieves SOTA ADE@3s and ADE@5s, alongside the highest RFS among diffusion-based VLAs; on nuScenes, it reduces average L2 error to $0.32$m (a $22%$ improvement). When integrated with SGLang, our framework delivers $12\times$ throughput speedup over the AR baseline, narrowing the gap between high-capacity VLAs and the efficiency demands of real-time on-vehicle deployment.

[7] Positional Failures in Long-Context LLMs: A Blind Spot in Reasoning Benchmarks cs.CL | cs.AI | cs.LGPDF

Chuyifei Zhang, Hongyu Cui, Xiaowen Huang, Jitao Sang

TL;DR: 本文揭示了当前长上下文LLM推理基准测试中的一个结构性评估缺陷：主流推理基准未控制目标任务在长上下文中的位置，导致无法检测模型对任务位置敏感的性能下降。作者提出Context Rot Evaluation（CRE）框架，通过系统控制任务位置、填充内容和上下文长度三个因素，评估了9个LLM在GSM8K和ARC-Challenge上的表现，发现模型在目标任务从上下文末尾移至中间时性能可能急剧下降，且下降幅度随上下文长度增加而加剧。

Details

Motivation: 现有长上下文推理基准（如Needle-in-a-Haystack和RULER）通常采用位置控制评估，但主流推理基准却未控制目标任务在长上下文中的位置，这可能导致无法检测模型因任务位置变化而产生的性能漏洞。作者旨在通过系统化评估揭示这一评估盲区。

Result: 在CRE框架下评估发现，模型性能对任务位置高度敏感：例如MiMo-v2-Flash在64K上下文、with_solutions填充条件下，中间位置准确率相比末尾下降88个百分点（中间准确率仅8%）。较新模型（如MiMo-V2.5-Pro）下降幅度缩小至32个百分点，但在questions_only_v2填充条件下所有四个新模型在8K/32K/64K上下文中仍出现16-56个百分点的下降。诊断实验表明，在末尾添加目标任务副本可使中间位置准确率恢复至基线±4个百分点内，证实了位置敏感性的存在。

Insight: 论文的创新点在于提出了CRE这一系统化评估框架，首次联合控制任务位置、填充内容和上下文长度三个关键变量，从而暴露了LLM在长上下文推理中存在的结构性位置脆弱性。客观来看，该研究揭示了当前基准测试设计和厂商评估实践中存在的重大盲区，即未控制任务位置会掩盖模型性能随上下文长度增加而恶化的位置敏感性错误模式（如填充答案干扰）。

Abstract: Position-controlled evaluation is standard for retrieval tasks such as Needle-in-a-Haystack and RULER, but mainstream reasoning benchmarks do not control positional placement of target tasks in long contexts. We audit 11 long-context benchmarks and find none jointly controls task position, filler content, and context length for reasoning. An audit of four flagship long-context releases finds no main result-table entry for NIAH, RULER, or LongBench-family benchmarks, while agentic and coding benchmarks appear in main result-tables across all four. We propose Context Rot Evaluation (CRE), a controlled framework varying all three factors, and evaluate nine LLMs on GSM8K and ARC-Challenge across two rounds: an initial five-model set and four newer vendor releases. Models can drop sharply when the target task moves from end to middle, and the drop grows worse with context length for vulnerable models. MiMo-v2-Flash drops 88pp at 64K under with_solutions filler (middle accuracy 8%). Newer releases show smaller drops: at 64K, three of four stay within +/-6pp of end-position accuracy; MiMo-V2.5-Pro narrows the MiMo-v2-Flash 88pp drop to 32pp. Under questions_only_v2 filler, middle-position drops persist across all four (range -16pp to -56pp across 8K, 32K, 64K). At 8K, a diagnostic probe adding a target-task copy at the end brings middle accuracy within +/-4pp of end baseline across all nine models, consistent with a positional explanation. In the initial five-model set, 76% of middle-position errors match surrounding filler text versus 22% at the end position, consistent with filler-answer interference as a dominant error mode. These results expose a structural evaluation gap in current reasoning benchmark design and vendor evaluation practice: positional vulnerabilities that grow with context length cannot be measured when task position is not controlled.

[8] Convergence Without Understanding: When Language Models Agree on Representations but Disagree on Reasoning cs.CL | cs.AIPDF

Muhammad Usama, Dong Eui Chang

TL;DR: 这篇论文研究了不同大语言模型在内部表征上趋于一致（柏拉图表征假说）的现象是否也延伸到其推理过程。通过对16个不同架构和规模的模型在800个推理问题上的分析，发现表征收敛主要反映的是共享的输入处理约束，而非共享的推理策略，并揭示了三种分离现象。

Details

Motivation: 动机是探究大语言模型在内部表征上观察到的收敛现象，是否意味着它们在推理过程和策略上也趋于一致，这对于理解模型相似性、可解释性迁移和集成设计有重要意义。

Result: 在涵盖数学、科学、常识和真实性等领域的800个推理问题上，对16个模型的分析显示：模型在集体失败的问题上表征更相似（CKA=0.897），在成功问题上反而较低（CKA=0.830）；决策前表征对齐（CKA=0.875），决策后表征发散（CKA=0.274）；共享信息可跨模型解码（66%迁移准确率），但对预测的因果影响极小（消融实验翻转率1.5%-5.5%）。

Insight: 创新点在于首次系统地测试了表征收敛是否延伸到推理过程，并揭示了“难度反转”、“生成鸿沟”和“附带正确性”三个关键分离现象，表明表征相似性不能等同于推理策略的相似性，这对模型评估和可解释性研究提供了重要洞见。

Abstract: Large language models trained under diverse objectives and architectures have been shown to develop increasingly similar internal representations, an observation formalized as the Platonic Representation Hypothesis. Whether this representational convergence extends to the reasoning processes that operate over shared representations remains untested. We evaluate representational similarity across 16 language models from 8 families (1.5B to 72B parameters) on 800 reasoning problems spanning mathematics, science, commonsense, and truthfulness, stratifying by problem difficulty, computational stage, and causal relevance. Our analysis reveals three dissociations: a difficulty inversion, where models converge more on problems they collectively fail (Centered Kernel Alignment [CKA] = 0.897) than on those they solve (CKA = 0.830); a generation gap, where pre-decision representations align (CKA = 0.875) while post-decision representations diverge (CKA = 0.274); and epiphenomenal correctness, where shared information is decodable across models (66% transfer accuracy) but exerts minimal causal influence on predictions (1.5% to 5.5% flip rate across ablation protocols). These results indicate that representational convergence in language models reflects shared input processing constraints rather than shared reasoning strategies, with direct implications for ensemble design, interpretability transfer, and evaluations of model similarity. Code is available at https://github.com/Usama1002/convergence-without-understanding.

Wajdi Zaghouani, Md. Rafiul Biswas, Mabrouka Bessghaier, Shimaa Ibrahim, George Mikros

TL;DR: 本文介绍了ClimateChat-300K，这是一个包含约30万条关于气候变化的公共Facebook帖子的大规模多模态数据集，收集于2020年5月至2024年5月。该数据集包含丰富的元数据，用于分析气候传播中的公众话语。通过主题建模和情感分析，研究揭示了影响受众参与度的关键因素，并展示了在线讨论如何响应重大事件。

Details

Motivation: 旨在提供一个开放、可复现的数据资源，以支持对气候传播中公众话语的跨学科研究，特别是关于极化、错误信息和数字话语动态的理解。

Result: 通过主题建模识别出政策、行动主义、合作、科学和保护等五个领域的十个主要主题。分析结果表明，情感基调、帖子格式和页面身份强烈影响受众参与度，视觉丰富且情感强烈的内容互动水平最高。数据集还展示了在线讨论如何响应国际气候峰会和COVID-19大流行等重大事件。

Insight: 创新点在于构建了一个大规模、多模态、带丰富元数据的社交媒体气候传播数据集，并进行了初步的主题和情感分析，为研究数字气候话语的动态和影响因素提供了基础。从客观角度看，该数据集为量化分析气候传播中的公众参与模式、内容策略效果以及事件响应提供了宝贵的资源。

Abstract: We present ClimateChat-300K, a large-scale dataset of 299,329 public Facebook posts about climate change collected between May 2020 and May 2024 through the CrowdTangle platform. The dataset contains 41 metadata features including post content, engagement metrics, and page attributes, covering material from more than 26,000 global pages. Each post includes rich contextual information such as language, timestamp, page category, and interaction counts, enabling comprehensive analyses of public discourse around climate communication. Using topic modeling and sentiment analysis, we identify ten main themes grouped into five domains: policy, activism, cooperation, science, and conservation. The results reveal that emotional tone, post format, and page identity strongly influence audience engagement, with visually rich and emotionally charged content receiving the highest levels of interaction. The dataset also demonstrates how online discussions evolved in response to major events such as international climate summits and the COVID-19 pandemic period. ClimateChat-300K provides an open resource for reproducible and interdisciplinary research on polarization, misinformation, and the dynamics of digital climate discourse. By releasing this dataset, we aim to support transparent, data-driven research and contribute to a deeper un-derstanding of how public engagement with climate issues develops across time, geography, and institutional contexts.

[10] Emotion Recognition in Sign Language Conversation cs.CLPDF

Yusong Wang, Keyu Mao, Takao Obi, Minghao Shao, Kotaro Funakoshi

TL;DR: 该论文将对话情感识别任务引入手语视频分析领域，针对现有手语情感数据集缺乏对话上下文的问题，提出了eJSL Dialog数据集。该数据集包含480个独特对话的1,920个视频样本，并在此数据集上对从孤立视觉网络到多模态对话架构的多种模型进行了系统基准测试。

Details

Motivation: 当前手语情感数据集主要关注孤立句子，缺乏对话语境，导致模型在现实场景中因无法利用历史对话流而性能下降。

Result: 基准测试结果表明，将通用的多模态对话情感识别模型应用于手语领域时存在领域差距，凸显了对手语特定、上下文感知的视觉提取器的明确需求。

Insight: 论文的核心创新在于构建了首个面向手语对话情感识别的数据集，并实证了该领域的独特性，指出未来研究需要开发针对性的上下文感知视觉提取器并扩大数据集规模以支持大规模预训练。

Abstract: Emotion Recognition in Conversation is a core component of affective computing, while current resources of sign language emotion datasets primarily focus on isolated sentences and lack conversational context. Models trained exclusively on these isolated utterances demonstrate degraded performance in real world scenarios because they cannot utilize historical dialogue flow. To address this structural limitation, we introduce the ERC task to sign language video analysis and propose the eJSL Dialog dataset. Constructed using the scripts from the STUDIES corpus, the dataset contains 1,920 video samples organized into 480 unique dialogues. We conduct systematic benchmarking on this dataset using models ranging from isolated visual networks to multimodal conversational architectures. The results reveal a domain gap when applying generic multimodal conversational emotion recognition models to sign language. These findings demonstrate the explicit need for context aware visual extractors specific to sign language and indicate that expanding the scale of conversational datasets to support large scale pre-training is a necessary next step for future research.

[11] From Correctness to Preference: A Framework for Personalized Agentic Reinforcement Learning cs.CLPDF

Ranxu zhang, zeyang li, Jiacheng Huang, Rui Zhang, Xiaozhou Xu

TL;DR: 本文提出了一种统一的个性化智能体强化学习框架，旨在解决现实世界中智能体应用需要根据用户偏好调整行为的问题。该框架的核心是PARPO方法，它将通用任务质量奖励与个性化偏好奖励解耦，并引入用户特定锚点来稳定异质奖励尺度下的学习。此外，框架还包含两阶段偏好解耦奖励模型和PSGM记忆模块，用于个性化监督和偏好对齐的技能检索，形成一个偏好识别、策略优化和结构化技能积累的闭环。

Details

Motivation: 动机在于解决智能体强化学习在需要用户条件化行为的现实应用中的关键挑战：通用奖励无法捕捉异质用户偏好，观察到的行为与从众效应纠缠，以及扁平化记忆无法支持个性化技能检索。

Result: 在ETAPP、ETAPP-Hard和SJAgent基准测试上的实验表明，该框架持续优于强大的记忆和强化学习基线方法。

Insight: 创新点在于提出了一个将个性化嵌入训练时优化的统一框架，其核心PARPO方法通过奖励解耦和用户锚点解决了异质偏好下的学习稳定性问题，并结合PSGM记忆实现了偏好对齐的结构化技能积累闭环，为个性化智能体学习提供了系统性的解决方案。

Abstract: Agentic reinforcement learning (Agentic RL) has achieved strong progress in tasks with clear success signals. However, many real-world agent applications require user-conditioned behavior: the same query may call for different planning strategies and tool-use decisions across users. This setting raises key challenges: generic rewards cannot capture heterogeneous user preferences, observed behaviors are entangled with conformity effects, and flat memories cannot support personalized skill retrieval. To this end, we propose a unified personalized Agentic RL framework that embeds personalization into training-time optimization. At its core is \emph{Personalized Anchor Reward-Decoupled Policy Optimization} (\textbf{PARPO}), which decouples generic task-quality rewards from personalized preference rewards and uses user-specific anchors to stabilize learning under heterogeneous reward scales. We further introduce a two-stage preference-disentangled reward model and \emph{Preference-Aligned Skill Evolution Graph Memory} (\textbf{PSGM}) for personalized supervision and preference-aligned skill retrieval. Together, they form a closed loop of preference identification, policy optimization, and structured skill accumulation. Experiments on ETAPP, ETAPP-Hard, and SJAgent show that our framework consistently outperforms strong memory and RL baselines. Code and data are included in the supplementary materials.

[12] Metacognition as Reward: Reinforcing LLM Reasoning via Knowledge and Regulation Signals cs.CL | cs.AIPDF

Sirui Chen, Lei Xu, Yuying Zhao, Yutian Chen, Yu Wang

TL;DR: 本文提出了一个名为’元认知即奖励’（MaR）的强化学习框架，旨在通过元认知知识和元认知调节这两个通用过程维度来引导大型语言模型的推理过程。该方法将模型推理轨迹分解为明确的元认知组件，并基于任务知识覆盖度、调节保真度和最终答案正确性提供轨迹级奖励，从而超越仅依赖最终答案或特定实例评估的现有奖励设计范式。

Details

Motivation: 现有强化学习方法在提升LLM推理能力时存在局限：基于可验证结果的奖励（RLVR）对中间推理行为指导不足，而基于评估准则的奖励（RaR）则需要大量人工设计且通常针对特定实例。MaR旨在提供一种更通用、能对推理过程本身提供指导的奖励机制。

Result: 在22个基准测试上的实验表明，MaR能持续提升模型性能，相比基础模型最高提升7.7%，相比普通DAPO最高提升11.0%。具体而言，Qwen3.5-9B结合MaR后，在整体平均水平上超越了GPT-OSS-120B，并在多个单项基准上优于更强的模型。过程级分析也证实了推理过程质量的显著提升，且该方法能泛化到域外数据集。

Insight: 核心创新在于将元认知理论（知识、调节）系统地引入强化学习的奖励设计中，为推理过程提供了通用、可学习的指导信号，而无需依赖特定于实例的人工评估准则。这为构建能自我监控和调整推理过程的AI系统提供了新思路。

Abstract: Recent RL methods have substantially improved the reasoning abilities of LLMs. Existing reward designs mainly follow two paradigms: (1) Reinforcement learning with verifiable rewards (RLVR) derives outcome signals from executable checks or ground-truth answers, but provides limited guidance for intermediate reasoning behaviors. (2) Rubrics-as-reward (RaR) goes beyond final-answer checking by using natural-language rubrics to assess reasoning quality and task compliance, but often requires instance-specific rubrics and substantial design effort. To address these issues, we introduce Metacognition-as-Reward (MaR), a metacognition-inspired RL framework that guides LLM reasoning through two general process dimensions: i) metacognitive knowledge, which identifies task-relevant information without hand-crafted instance-specific rubrics, and ii) metacognitive regulation, which plans and adjusts the reasoning process to provide reward guidance beyond final-answer outcomes. MaR scaffolds model rollouts into explicit metacognitive components and optimizes them with a trajectory-level reward over task knowledge coverage, regulation fidelity, and final-answer correctness. In this way, MaR extends reward feedback to reasoning trajectories while grounding the reward signals in general metacognitive dimensions. Experiments on 22 benchmarks show that MaR consistently improves model performance, achieving up to a 7.7% gain over the base model and up to an 11.0% gain over vanilla DAPO. Notably, Qwen3.5-9B + MaR narrows the gap to frontier models, surpassing GPT-OSS-120B on overall average and outperforming stronger models on several individual benchmarks. Process-level analysis further shows substantial improvements in reasoning process quality. MaR also generalizes to out-of-domain datasets, where MaR-trained models improve over their corresponding base models on average.

Yevhen Kostiuk, Kenneth Enevoldsen, Peter Bjerregaard Vahlstrup, Márton Kardos, Kristoffer Nielbo

TL;DR: 本文提出了一种在自然开放式对话中测量社会规范对齐的框架，通过解决方案匹配来评估不同主体（如LLM与人类、LLM之间或人类之间）对社会困境响应的对齐程度。该框架引入了陈述性和显性一致性准确度两个指标，并构建了一个包含3000个丹麦语社会困境的数据集，由三位文化背景评审提供参考解决方案。实验在模拟自然用户-模型对话的交互设置中评估了多个LLM和人类响应的一致性。

Details

Motivation: 现有测量社会规范对齐的方法通常依赖人工封闭式评估（如多项选择问卷或与预定义陈述的一致性测量），难以在自然、自由形式的设置中有效衡量。本文旨在解决这一挑战，通过解决方案匹配来量化社会困境响应之间的对齐程度。

Result: 在构建的丹麦语社会困境数据集上，所提指标产生了一致的模型排名，并揭示了不同类型困境间的一致性差异，例如在邻里冲突和共享生活情境等话题上观察到更高的一致性。评估涵盖了多个LLM和人类响应在模拟自然对话中的表现。

Insight: 创新点在于提出了一个基于自然开放式对话的评估框架，通过解决方案匹配而非预定义陈述来测量社会规范对齐，并引入了文化背景评审提供的参考解决方案以增强文化根基。这为研究自然情境下的社会推理提供了数据集和方法论基础。

Abstract: Social norms reflect shared expectations on acceptable behavior. Measuring social norms alignment remains challenging, with existing approaches typically relying on artificial closed-form evaluations such as multiple-choice questionnaires or measuring agreement with predefined statements. In the context of this work, social norms alignment refers to measuring an agreement between solutions with respect to the social problem or dilemma. We propose a framework for measuring social norm alignment in naturalistic, free-form settings through solution matching. The framework enables us to measure alignment between any two dilemma responses e.g., LLMs to a human, LLMs to LLMs, or human to human. We introduce two metrics: stated and explicit agreement accuracy, and construct a dataset of 3k non-trivial social dilemmas in Danish. All dilemmas are assigned reference solutions derived from three panelists, who serve as culturally grounded judges. We evaluate the agreement of several LLMs and human responses in an interaction setup that resembles natural user-model conversations. Our results show that the proposed metrics produce consistent model rankings and reveal variation in agreement across different types of dilemmas, with higher agreement observed for topics such as neighbor conflicts and shared living situations. Overall, our work introduces a dataset and evaluation framework for studying culturally grounded social reasoning in naturalistic open-ended conversations.

[14] ARES: Automated Rubric Synthesis for Scalable LLM Reinforcement Learning cs.CLPDF

Xiaoyuan Li, Keqin Bao, Moxin Li, Yubo Ma, Yichang Zhang

TL;DR: 本文提出ARES框架，用于自动化构建基于评分标准的强化学习数据，以扩展大语言模型的强化学习应用。该框架从原始预训练文档中生成自包含的问答对及问题特定的加权评分标准，从而为开放式回答提供实例级奖励监督。实验表明，基于ARES构建的评分标准强化学习在多个基准测试中优于持续预训练、监督微调和二元奖励强化学习。

Details

Motivation: 解决基于评分标准的强化学习在扩展性方面的挑战，包括依赖专家编写的评分标准、手动构建问题集，以及固定任务级评分标准无法捕捉个体问题评估需求的问题。

Result: 在七个基准测试上的实验显示，使用ARES训练的基于评分标准的强化学习优于持续预训练、监督微调和二元奖励强化学习，尤其在医疗保健和指令遵循等多维开放式任务上提升最大。

Insight: 创新点在于自动化生成问题特定的加权评分标准，实现实例级奖励监督；通过领域标签和角色信息调节生成以提高多样性和质量，并应用验证过滤器确保问题自包含性、答案忠实性和评分标准有效性。

Abstract: Rubric-based rewards offer a promising way to extend reinforcement learning (RL) for large language models beyond tasks with automatically verifiable answers. However, scaling rubric-based RL remains challenging: existing approaches often rely on expert-written rubrics and manually constructed question sets, while fixed task-level rubrics may fail to capture the evaluation requirements of individual questions. We propose ARES (Automated Rubric synthEsis for Scalable RL), a framework for automatically constructing rubric-based RL data at scale. Starting from raw pretraining documents, ARES converts source knowledge into self-contained question-answer pairs and co-generates question-specific weighted rubrics, enabling instance-level reward supervision for open-ended responses. To improve diversity and quality, ARES conditions generation on domain labels and persona information, and applies validation filters for question self-containment, answer faithfulness, and rubric validity. Using ARES, we construct 100K rubric-annotated instances across ten domains. Experiments on seven benchmarks show that rubric-based RL trained with ARES, outperforms continual pretraining, supervised fine-tuning, and binary-reward RL, with the largest gains on multi-dimensional open-ended tasks such as healthcare and instruction following.

[15] Asking For An Old Friend: Diagnosing and Mitigating Temporal Failure Modes in LLM-based Statutory Question Answering cs.CLPDF

Max Prior, Andreas Schultz, Matthias Grabmair

TL;DR: 本文研究了基于大语言模型的法律问答系统中存在的时间性失效问题，包括训练截止日期后的陈旧性（模型应用已废止的法规）和近因偏差（模型偏好新条款）。作者构建了一个包含312个专家验证的、具有时间敏感性的德国法规问答对基准，并评估了五种LLM在四种推理设置下的表现。结果表明，检索增强生成方法能显著提升性能，而网络搜索则不稳定且存在近因偏差。

Details

Motivation: 大语言模型越来越多地用于法律研究，但其固定的训练截止日期和对静态参数化知识的依赖，与成文法不断演变的特性相矛盾。本文旨在诊断和缓解由此产生的两种时间性失效模式。

Result: 在Vanilla设置下，模型在截止日期后的问题上表现严重下降。两种RAG方法在所有问题类型上均显著提升了性能，而网络搜索则收益不稳定，并在历史锚定任务上表现出明显的近因偏差。评估使用了经人类专家评分验证的LLM-as-a-judge方法。

Insight: 论文的创新点在于系统性地识别和定义了法律问答中的两种时间性失效模式，并构建了专门的基准进行评估。客观来看，其核心见解是将时间有效性作为硬约束来处理，是构建可靠法律问答系统的关键，这通过结合事实日期提取和版本过滤的RAG方法得以实现。

Abstract: Large language models are increasingly used for legal research, yet their fixed training cutoffs and reliance on static parametric knowledge are at odds with the evolving nature of statutory law. We study two temporal failure modes: post-cutoff staleness, where models apply superseded rules after legislative amendments, and recency bias, where models prefer newer provisions even when a historical version governs the fact pattern. To this end, we present a benchmark of 312 expert-validated, time-sensitive German statutory QA pairs spanning three categories: Post-Cutoff Amendment Questions, Pre-Amendment Questions, and Multi-Provision Pre-Amendment Questions. We evaluate five LLMs by OpenAI, Anthropic and DeepSeek under four inference settings: Vanilla, Web-search, and two retrieval-augmented variants that enforce temporal validity via a fact date extraction and version filtering. Using an LLM-as-a-judge validated against human expert ratings, we find severe degradation in the Vanilla post-cutoff setting. Both RAG approaches substantially improve performance across all question types, while web search yields unstable gains and exhibits a marked recency bias on historically anchored tasks. Our results indicate that reliable legal QA requires treating temporal validity as a hard constraint.

[16] ChartFI: Benchmarking Faithfulness and Insightfulness of Chart Descriptions from Multimodal Large Language Models cs.CLPDF

Fen Wang, Zekai Shao, Qiman Kang, Chunran Hu, Zhixuan Zhang

TL;DR: 该论文提出了ChartFI基准测试，用于评估多模态大语言模型生成图表描述的忠实性和洞察力。该基准包含896个图表-描述对，并设计了四个评估指标来系统衡量描述质量。实验揭示了现有模型在生成高质量图表描述方面的常见弱点。

Details

Motivation: 现有图表描述基准存在两个主要不足：数据集中的图表简单且描述浅显，现有评估指标无法全面捕捉描述质量的多维度特性。因此，需要一个新的基准来评估MLLMs生成图表描述的忠实性和洞察力。

Result: 在主流MLLMs上进行的实验证明了所提框架的有效性，并揭示了现有模型的共同弱点。

Insight: 论文的创新点在于总结了高质量图表描述的四个维度，并据此构建了一个包含复杂图表和丰富描述的基准，同时设计了四个对齐的评估指标进行系统性评估。这为评估和提升MLLMs的图表描述能力提供了更全面的框架。

Abstract: Chart descriptions are essential for accessibility, cross-modal retrieval, and assisting readers in extracting insights from complex visualizations. As multimodal large language models (MLLMs) are increasingly adopted for automated chart description generation, a critical question arises: how faithfully and insightfully do these models actually describe charts? Current benchmarks fall short on two fronts: existing datasets consist of simple, homogeneous charts paired with shallow, fact-enumerating descriptions; and prevailing metrics fail to capture the multi-faceted nature of description quality. To address these gaps, we present the Chart Faithfulness and Insightfulness Benchmark (ChartFI-Bench). We first summarize four dimensions that characterize high-quality chart descriptions: factual accuracy, salient feature emphasis, domain-informed guidance, and chart-text complementarity. Guided by these dimensions, we construct a high-quality benchmark comprising 896 chart-description pairs, which feature visually complex charts and semantically rich descriptions. Furthermore, we design four aligned evaluation metrics – Faithfulness, Coverage, Informativeness, and Acuity – to systematically assess the quality of descriptions across these dimensions. Experiments conducted on mainstream MLLMs demonstrate the effectiveness of the proposed framework and reveal common weaknesses among existing models.

[17] OnePred: Next-Query Prediction via Recursive Intent Memory in Multi-Turn Conversations cs.CL | cs.AIPDF

Jiangwang Chen, Bowen Zhang, Zixin Song, Jiazheng Kang, Xiao Yang

TL;DR: 本文提出OnePred模型，通过递归意图记忆实现多轮对话中的下一查询预测，旨在解决LLM对话系统仅能被动响应的局限性。该方法将对话历史压缩为持续更新的意图链，在保证预测质量的同时大幅降低计算开销。

Details

Motivation: 现有LLM对话系统本质上是反应式的，只能在用户输入查询后响应；实现主动交互的关键是下一查询预测，但该任务缺乏专用基准，且面临效率与质量的权衡：完整历史拼接导致token消耗线性增长，而截断最近轮次又会丢失关键跨轮上下文。

Result: 在提出的NQP-Bench（涵盖三个多样化子集）上实验表明，OnePred相比完整历史输入每轮token消耗降低高达22倍，同时在预测质量上持续超越所有基线，且在更长对话中增益更大。

Insight: 核心创新在于认识到准确预测无需重读原始历史，只需追踪用户跨话题的意图轨迹、未解决需求和兴趣转移；通过两阶段强化学习管道（先学预测什么，再学压缩什么）将记忆塑造成面向预测的意图链，实现了计算成本与对话长度无关的递归更新机制。

Abstract: Although large language model (LLM) conversational systems process millions of multi-turn dialogues daily, they remain fundamentally reactive: they respond only after the user types a query. A key step toward proactive interaction is next-query prediction, which anticipates the user’s subsequent query based solely on the preceding dialogue. Progress on this task is hindered by the lack of dedicated benchmarks and a fundamental efficiency–quality trade-off: naively concatenating full dialogue history incurs linearly growing token consumption, while truncating to the latest turn discards crucial cross-turn context. Our key insight is that accurate prediction does not require re-reading raw history; it suffices to track the user’s evolving intent trajectory across topics, unresolved needs, and interest shifts. We propose OnePred, which maintains a recursively updated memory as its sole cross-turn context, bounding the per-turn cost independently of conversation length. We train the model via a two-stage reinforcement learning pipeline that first teaches what to predict, then what to compress, shaping the memory into a prediction-oriented intent chain. To establish a rigorous testbed, we introduce NQP-Bench, spanning three diverse subsets. Experiments demonstrate that OnePred reduces per-turn token consumption by up to 22$\times$ compared to full-history inputs while consistently exceeding all baselines in prediction quality, with larger gains on longer conversations. Our code is publicly available at https://github.com/ZBWpro/OnePred.

[18] Multilingual Knowledge Transfer under Data Constraints via Lexical Interventions cs.CLPDF

Anastasiia Sedova, Natalie Schluter, Skyler Seto, Maartje ter Hoeve

TL;DR: 本文提出了一种名为LINK的数据层面干预方法，旨在通过在高资源语言（英语）预训练语料中进行词汇替换，以改善在数据受限情况下的跨语言知识迁移。该方法仅需双语词汇表，无需额外模型训练或并行数据，即可在目标语言的下游任务上实现显著性能提升，并加速训练过程。

Details

Motivation: 针对低资源语言因训练数据不足而难以构建高性能多语言模型的问题，现有跨语言知识迁移方法通常依赖大量并行数据、翻译系统或额外训练阶段，而这些资源对于许多语言来说难以获取。

Result: 在五种模型规模和八种语言上的评估表明，该方法在目标语言的下游任务上取得了显著改进，训练速度最高可提升2倍以达到同等性能水平。

Insight: 创新点在于提出了一种简单高效的数据级干预策略，仅通过双语词汇表进行随机词汇替换，无需复杂架构或额外训练，即可有效促进知识从高资源语言向低资源语言的迁移，为低资源语言建模提供了低成本解决方案。

Abstract: Cross-lingual knowledge transfer is critical for building high-performing multilingual language models for languages with insufficient training data. When target language data is scarce, the knowledge required for many downstream tasks involving scientific reasoning, commonsense inference, and world knowledge must be acquired primarily from the high-resource language, making effective knowledge transfer essential. Existing methods for improving such cross-lingual knowledge transfer require large amounts of parallel data, translation systems, auxiliary models, or additional training stages that are largely unavailable for many languages. We propose LINK - a data-level intervention method that improves knowledge transfer during model pretraining through lexical substitutions in high-resource part of pretraining data using bilingual vocabularies. For a given replacement ratio, randomly selected words in a portion of the high-resource (English) training corpus are swapped with their word-level translations, requiring no additional model training and only a bilingual vocabulary, which can be obtained at near-zero cost for virtually any language. Evaluation on eight languages across five model sizes shows notable improvements on downstream tasks in the target language, with up to a 2x speedup in training to reach equivalent performance.

cs.CV [Back]

[19] GEM-4D: Geometry-Enhanced Video World Models for Robot Manipulation cs.CV | cs.ROPDF

Kaichen Zhou, Yuzhen Chen, Fangneng Zhan, Hang Hua, Grace Chen

TL;DR: GEM-4D是一种几何增强的视频世界模型，旨在解决现有视频世界模型在时间上保持点级运动一致性的不足。它通过从预训练的几何基础模型中提取密集的4D对应关系监督，注入到视频生成主干中，从而同时捕捉外观和几何结构。该模型进一步结合逆动力学模块，将对应关系一致的视频展开转换为可执行的机器人轨迹，提升了机器人操作的物理基础和执行可靠性。

Details

Motivation: 现有视频世界模型虽然能从单一指令生成逼真的未来画面，但往往无法保持时间上一致的点级运动，导致生成的视频缺乏物理基础，难以可靠地用于机器人操作等需要精确动作执行的任务。

Result: GEM-4D在视频预测和几何一致性方面均达到了最先进的性能（SOTA），并在模拟和真实场景中验证。其实世界机器人操作成功率从61%提升至81%。

Insight: 创新点在于将密集的4D对应关系监督（从预训练几何基础模型蒸馏而来）整合到单流视频生成架构中，无需额外推理成本即可增强几何一致性。同时，引入逆动力学模块将几何一致的视频预测直接转化为可执行的机器人轨迹，实现了从感知到动作的端到端部署。

Abstract: Video world models can generate realistic futures from a single instruction, but they often fail to preserve consistent point-level motion over time. As a result, the generated videos appear plausible, yet lack the physical grounding required for reliable action execution, such as robot manipulation. We present GEM-4D, a geometry-grounded video world model that resolves this limitation by injecting dense 4D correspondence supervision, distilled from a pretrained geometry foundation model, into the video generative backbone during training. This supervision enables the model to jointly capture appearance and geometric structure while retaining a single-stream architecture with no additional inference cost. We further introduce an inverse dynamics module that converts correspondence-consistent video rollouts into executable robot trajectories, enabling direct deployment in both real-world and simulated manipulation. GEM-4D achieves state-of-the-art performance on both video prediction and geometric consistency across simulation and realistic scenarios and improves real-world manipulation success from 61% to 81%. Additional results are available at the project page: https://anonymous-submission-20.github.io/gem.github.io/.

[20] Seeing without Looking: Do Vision-Language Benchmarks Really Test Vision? cs.CV | cs.AI | cs.CLPDF

Zixuan Lan, Luzhe Sun, Matthew R. Walter, Jiawei Zhou

TL;DR: 该论文通过系统实验发现，当前视觉语言模型在标准基准测试中的高准确率并不能可靠反映其对细粒度视觉证据的依赖程度。研究表明，即使大幅破坏图像信息，模型性能下降也很有限，且内部表征在深层趋于同质化，揭示了现有评测基准在评估视觉基础能力方面的不足。

Details

Motivation: 针对当前视觉语言模型基准测试分数是否真正反映模型对视觉证据的依赖这一核心问题，作者观察到在幻觉基准测试中大幅去除图像令牌仅导致性能轻微下降，从而系统探究了视觉理解与评测分数之间的不匹配现象。

Result: 实验覆盖全局视觉退化、局部遮挡、问题重构、答案空间扩展和决策层分析等多个维度，结合视觉令牌几何结构的层级分析，表明模型预测对细粒度视觉证据的损失不敏感，即使最终预测不变，正确答案的内部支持也已减弱。

Insight: 创新点在于通过多粒度行为实验与表征分析相结合的方法，揭示了VLMs在深层网络中视觉令牌相似性增加的现象，为理解模型视觉基础机制提供了新视角；客观而言，该研究提出了对现有评测体系有效性的重要质疑，并建立了系统化的评估方法论。

Abstract: Benchmark accuracy is often implicitly assumed to reflect grounded visual understanding in vision-language models (VLMs), yet it remains unclear to what extent such scores truly reflect reliance on visual evidence. Motivated by a surprising observation that removing a substantial fraction of image tokens only degrades model performance very slightly on a widely used hallucination benchmark, we systematically investigate this mismatch in a set of open-source VLMs. Our analysis spans multiple levels of granularity, spanning global visual degradation, localized occlusion, question reformulation, answer-space expansion, and decision-level analyses beyond standard accuracy. We further complement these behavioral results with a layer-wise analysis of vision-token geometry. Throughout the experiments, we find that although VLMs do incorporate visual input, their predictions are less sensitive to the loss of fine-grained visual evidence that standard accuracy should have suggested. Even when the final prediction remains unchanged, the model’s internal support for the correct answer may already be weakened. We further complement a representation-level analysis, which shows increasing similarity among visual tokens in deeper layers, providing a possible explanation for our findings. Together, these results suggest that current benchmarks are not sufficient to reliably evaluate fine-grained visual grounding in VLMs.

[21] Suicide Risk Assessment from AI-powered Video Surveillance: An Interpretable Framework for Prevention in Metro Stations cs.CV | cs.AIPDF

Safwen Naimi, Wassim Bouachir, Guillaume-Alexandre Bilodeau, Brian Mishara

TL;DR: 本文提出了一种用于地铁站自杀风险评估（SRA）的可解释AI框架，通过联合分析乘客行为、空间上下文和时序动态，从监控视频中识别高风险情况以实现早期干预。该框架整合了人员跟踪、活动识别、站台语义分割和基于轨迹的风险热图建模，在真实监控数据上实现了83.2%的ROC-AUC性能。

Details

Motivation: 动机在于通过AI视频监控理解和监控地铁站中的人类行为，以支持自杀预防工作，早期识别高风险情境从而实现及时干预。

Result: 在真实监控数据上，该完整操作流程的基准测试达到了83.2%的ROC-AUC，为自杀风险评估任务建立了性能基准。

Insight: 创新点在于将SRA形式化为一个独立任务，并提出了首个整合多模态感知与可解释风险热图建模的框架，为面向社会公益的可解释AI系统研究开辟了新方向。

Abstract: Understanding and monitoring human behavior in metro stations play an important role in supporting suicide prevention efforts, where early identification of high-risk situations can enable timely intervention. This requires assessing suicide risk from a surveillance video by jointly reasoning about the behavior of each passenger, his/her spatial context, and temporal dynamics. However, this assessment using videos captured by surveillance cameras is challenging, as it demands accurate perception of human motion, understanding of platform geometry, and aggregation of heterogeneous behavioral cues over time. In this work, we formalize the task of Suicide Risk Assessment (SRA) in metro stations and introduce the first interpretable framework that addresses this challenge. Unlike approaches that focus on isolated subtasks or attempt to infer intent directly, our formulation assesses suicide risk from accumulated evidence by incorporating person tracking, activity recognition, semantic segmentation of the platform, and trajectory-driven risk heatmap modeling. By formalizing SRA as a distinct task and benchmarking a complete operational pipeline achieving 83.2% ROC-AUC on real surveillance data, this work highlights the complexity of suicide risk assessment and opens new directions for research on interpretable AI systems for social good.

[22] GazeBehavior Annotation Toolkit (GBAT): AI-powered toolkit for automatic annotation of egocentric eye-tracking and video data of child-caregiver interaction cs.CV | cs.CE | cs.HC | cs.SE | q-bio.NCPDF

Iba Baig, Kevin Li, Yanbin Xu, Seiji Cattelain, Marie Hallo

TL;DR: 本文介绍了GazeBehavior Annotation Toolkit (GBAT)，这是一个基于深度学习的工具包，旨在自动化处理儿童-照顾者互动中的自我中心眼动追踪和视频数据。该工具包专注于三个关键预处理和特征提取过程：多视频的事后同步、注视目标类别的半自动标注，以及参与者姿势和手部动作的分类。

Details

Motivation: 研究动机在于解决儿童-照顾者互动视频数据手动标注耗时的问题，以支持对自然行为中注意力动态的大规模和纵向研究。

Result: 工具包提高了从人类自我中心眼动追踪和视频数据中提取特征的效率和可扩展性，但摘要未提及具体的基准测试或定量结果。

Insight: 创新点在于整合了深度学习技术，实现了多视频同步、注视目标半自动标注以及姿势与动作分类的自动化流程，为发展心理学研究提供了高效的数据处理工具。

Abstract: Video recordings of child-caregiver interactions enable investigation of attentional dynamics during naturalistic behavior. Such multimodal recording also allows researchers to examine how attention interacts with action and language use in real time. However, manual annotation of such data is time-consuming. Here, we introduce GazeBehavior Annotation Toolkit, a deep-learning-based toolkit designed to facilitate three key processes in data preprocessing and feature extraction: post-hoc synchronization across multiple videos, semi-automatic annotation of gaze target categories, and categorization of participants’ poses and hand actions. This toolkit improves the efficiency and scalability of feature extraction from human egocentric eye-tracking and video data. Such improvement is critical in supporting large-scale and longitudinal investigations of attentional dynamics and naturalistic behavior in human early development.

Haichen He, Jiayi Zhou, Sifeng Shang, Yihan Hu, Yuanhan Zhang

TL;DR: 本文提出了VideoOdyssey基准测试，专门用于评估模型在超长上下文和全模态视频理解方面的能力。该基准包含平均时长109分钟的视频，涵盖11个领域和54个子类别，并设计了VideoOdyssey-V和VideoOdyssey-AV两个子集，分别针对视觉理解和视听同步理解。其核心创新在于引入了‘连续证书长度’这一度量，并设计了从秒到小时五个粒度的评估级别，以全面诊断模型在不同上下文长度和认知负荷下的表现。

Details

Motivation: 现有长视频理解基准通常只评估对短而孤立的视频片段的理解，未能捕捉超长上下文推理的挑战，而真实世界的长视频理解要求模型在极长视频跨度内进行持续跟踪、信息整合和记忆保持，这种高认知负荷是核心瓶颈。

Result: 广泛的评估表明，当前多模态大语言模型（MLLMs）的瓶颈不仅在于简单检索，还包括在不同上下文长度下的连续推理、细粒度感知以及非语言全模态理解方面的困难。

Insight: 论文的核心创新点是提出了‘连续证书长度’这一新评估指标，并据此构建了具有极端时长、多样性和多粒度连续证书的综合性基准VideoOdyssey，为诊断模型在超长上下文和全模态理解中的具体能力短板提供了系统化工具。

Abstract: Real-world long video understanding requires models to perform continuous tracking, information integration and memory retention over massive temporal spans within extreme video durations. Mastering this intense cognitive load constitutes the fundamental bottleneck in long video understanding. While existing benchmarks have driven progress by scaling up video duration, their evaluation tasks often require comprehending only short and isolated video segments, falling short of capturing the challenge of ultra-long-context reasoning. To measure this cognitive load, we emphasize continuous certificate length, defined as the video length a human must continuously watch to definitively answer a given question. Driven by this metric, we introduce VideoOdyssey, a benchmark specifically designed for ultra-long-context and omni-modal video understanding. VideoOdyssey is characterized by three key features: 1) Extreme video duration and diversity: spanning 11 domains and 54 subcategories with an average video duration of 109 minutes; 2) Comprehensive evaluation scenarios: offering two subsets to address different research focuses, i.e., VideoOdyssey-V for probing the limits of visual understanding in MLLMs, and VideoOdyssey-AV for evaluating synchronized audio-visual understanding for omni-modal models; 3) Ultra-long and multi-level continuous certificates: extending the average continuous certificate to 16 minutes for VideoOdyssey-V and 12.8 minutes for VideoOdyssey-AV. Crucially, we design 5 granular levels from seconds to hours, providing a comprehensive diagnostic tool to evaluate models across varying context lengths and cognitive loads. Extensive evaluations show that bottlenecks of current MLLMs extend beyond simple retrieval to include struggles with continuous reasoning across varying context lengths, fine-grained perception, and non-verbal omni-modal understanding.

[24] Improved Vision-to-Chart Buoy Association with Learned World-to-Image Projection cs.CVPDF

Borja Carrillo-Perez

TL;DR: 本文针对MaCVi 2026视觉-海图数据关联挑战，对基于DETR的融合Transformer基线模型进行了轻量级改进。核心创新是训练一个额外的MLP（QueryMLP），利用海图测量和IMU方向数据显式预测浮标在图像中的水线接触点坐标，并将此坐标作为空间先验信息添加到解码器查询向量中，从而减轻Transformer解码器的几何推理负担。该方法在挑战赛测试集上取得了第二名的成绩。

Details

Motivation: 解决现有基线模型（DETR-based fusion transformer）需要隐式学习从世界坐标到图像像素的复杂几何投影的问题，这增加了Transformer解码器的推理负担。

Result: 在MaCVi 2026挑战赛的测试集上，该方法取得了Overall分数0.7386、F1分数0.8055和mIoU 0.6718的成绩，在所有提交结果中排名第二。

Insight: 主要创新点在于引入一个专门的轻量级MLP模块（QueryMLP）来显式地、直接地从传感器数据（海图和IMU）预测图像坐标，为每个浮标提供明确的空间先验，从而将复杂的几何投影任务从Transformer中解耦出来，这是一种有效的“显式先验注入”策略，可以降低模型学习难度并提升性能。

Abstract: This report presents a lightweight modification to the DETR-based fusion transformer baseline for the MaCVi 2026 Vision-to-Chart data association challenge. The challenge baseline decoder receives per-buoy queries encoding world-space distance and bearing, forcing the transformer to implicitly learn the complex geometric projection from world coordinates to image pixels. Instead, this work trains an additional dedicated MLP, QueryMLP, to explicitly predict the buoy’s waterline contact point in the image from chart measurements and IMU orientation data. The predicted pixel coordinates are appended to the baseline decoder query vector, providing a direct spatial prior per buoy and reducing the geometric reasoning burden on the transformer decoder. On the challenge leaderboard, the presented approach achieves an Overall score of 0.7386, with F1 = 0.8055 and mIoU = 0.6718, on the held-out test set, placing second among all submissions.

[25] The TIME Machine: On The Power of Motion for Efficient Perception cs.CV | cs.AI | cs.LGPDF

Mantas Skackauskas, Xinyue Hao, Laura Sevilla-Lara

TL;DR: 本文提出了一种名为TIME的新型视频表示学习方法，该方法以运动为核心模态，通过掩码自编码器在点轨迹数据上进行自监督学习，旨在解决现有视频模型在时间理解和训练成本方面的局限性。

Details

Motivation: 现有视频表示学习方法依赖大规模训练数据和语言监督，导致训练成本高昂且学习概念受限于文本描述，难以实现良好的时间理解。

Result: 在零样本设置下广泛任务测试中，TIME嵌入的性能与最先进模型相当，但训练数据量减少了多达4个数量级。

Insight: 创新点在于将运动作为独立于外观的核心表示模态，通过合成运动数据进行自监督学习，这降低了数据需求并避免了语言依赖，从而提升了时间感知能力和可扩展性。

Abstract: Video representation learning has seen tremendous progress in recent years. This has been driven by many factors, including the scale of training and the success of visual models trained contrastively with language. While these factors have pushed the boundaries of what video models can do, they also introduce their own set of limitations: first, scaling video models can reach prohibitive costs and second, learning from language restricts the range of concepts that can be learned to those in captions. As a result, video models still struggle with temporal understanding. In this paper we propose a novel approach that uses motion as the central modality for video representation. In particular, given the motion in a video in the form of point-tracks, we use a masked-autoencoder to mask some of the tracks and train the autoencoder to reconstruct the missing tracks. This allows us to learn a representation in a self-supervised manner. We show that using motion to represent videos actually addresses both of the core limitations of video technology. First, it allows us to massively reduce the scale of training data, as motion is inherently appearance-independent and hence needs fewer examples to generalize well. Second, motion allows us to bypass the language-dependent training paradigm, learning better fine-grained concepts. The result is an embedding that we call TIME (Temporally Informed Motion Embedding), a representation trained exclusively on synthetic motion data. We test this embedding on a wide set of tasks in a zero-shot manner. We observe that without bells and whistles, performance is on par with state-of-the-art models using up to 4 orders of magnitude less training data. This is a stepping stone towards a new paradigm of video models that are both more temporally aware as well as more scalable.

[26] CoMoGen: COntrollable MOtion Dynamics and Interactions with Mask-Guided Video GENeration cs.CVPDF

Adil Meric, Lin Geng Foo, Mert Kiray, Benjamin Busam, Rishabh Dabral

TL;DR: CoMoGen是一个可控视频生成框架，能够根据输入图像和单个二进制掩码序列生成逼真的交互动态。该框架引入了轻量级MaskAdapter，将掩码序列编码为潜在残差信号，并通过余弦加权调度注入到多模态扩散变换器（MMDiT）模型中。通过确定MMDiT中的’运动层’并应用低秩适应（LoRA）进行微调，该方法在保持架构不变的同时降低了计算成本，实现了精确的主体运动和与周围环境、物体及人物的合理交互。

Details

Motivation: 解决现有可控视频生成方法在基于单个二进制掩码序列生成逼真交互动态方面的挑战，特别是在无需复杂层次结构（如UNet）的情况下，精确控制运动并实现与环境的合理交互。

Result: 在不同数据集上的综合实验表明，CoMoGen在运动保真度和感知真实性方面持续优于先前的可控视频生成方法，达到了最先进的性能水平。

Insight: 创新点包括：1) 引入MaskAdapter将二进制掩码编码为可注入的潜在信号；2) 在MMDiT的注意力空间中识别’运动层’，并应用LoRA进行选择性微调，这提高了效率并专注于运动关键组件；3) 整体框架简单有效，实现了对主体运动和交互的精确控制。

Abstract: We present CoMoGen, a controllable video generation framework that generates realistic interactive dynamics from a single binary mask sequence conditioned on an input image. CoMoGen introduces a lightweight MaskAdapter that encodes binary mask sequences into a latent residual signal, injected into the Multi Modal Diffusion Transformer (MMDiT) model through a cosine-weighted schedule. Unlike the hierarchical coarse-to-fine design of UNet architectures, MMDiT operates as a sequence of uniform transformer blocks, making it difficult to identify which layers are responsible for the motion generation. Therefore, we propose a novel way to determine “Motion Layers” operating in the attention space of MMDiT. We fine-tune the model by using Low-Rank Adaptation (LoRA) to the Motion Layers, without requiring any architecture change in the MMDiT. This selective adaptation enables our method to focus on motion-critical components, yielding reduced computational cost. Despite its simplicity, CoMoGen enables precise subject motion and plausible interactions with surrounding humans, objects, and scenes. Comprehensive experiments on different datasets show that CoMoGen consistently outperforms prior controllable video generation methods and achieves state-of-the-art performance in motion fidelity and perceptual realism. Project page: mericadil.github.io/CoMoGen.

[27] Dithering Defense: Adversarial Robustness of Vision Foundation Models via Multi-Level Floyd-Steinberg Dithering cs.CV | cs.AI | cs.LGPDF

Yury Belousov, Brian Pulfer, Vitaliy Kinakh, Slava Voloshynovskiy

TL;DR: 本文研究了多级Floyd-Steinberg误差扩散抖动作为一种轻量级、模型无关的输入变换，用于增强视觉基础模型的对抗鲁棒性。该方法通过在多个量化级别应用抖动来破坏对抗性扰动，同时保留语义内容，并在六个下游任务和多种攻击下进行了评估。

Details

Motivation: 视觉基础模型作为许多下游任务的冻结骨干，使其在对抗攻击下成为单点故障，因此需要一种轻量且通用的防御方法来保护这些模型。

Result: 在六个任务（分类、分割、深度估计、检索、描述生成、视觉问答）、两个模型家族（DINOv2、PaliGemma）和三种强度递增的攻击（PGD、MI-FGSM、SIA）以及自适应攻击者的测试中，中等量化级别的Floyd-Steinberg抖动（尤其是结合后处理模糊后）超过或匹配了所有测试基线（包括基于扩散的去噪），且在干净输入上的性能下降显著更小。

Insight: 创新点在于将多级Floyd-Steinberg抖动（而非先前工作的二值抖动）扩展为一种通用的对抗防御机制，并通过结合后处理模糊进一步提升了鲁棒性，同时保持了轻量级和模型无关的特性。

Abstract: Vision foundation models are widely used as frozen backbones across many downstream tasks, making them a single point of failure under adversarial attack. We study multi-level Floyd-Steinberg error-diffusion dithering as a lightweight, model-agnostic input transformation that disrupts adversarial perturbations while preserving semantic content. Unlike prior work, which was limited to binary dithering, grayscale CIFAR-10, and a single small model trained from scratch, we evaluate across six tasks (classification, segmentation, depth estimation, retrieval, captioning, visual question answering), two model families (DINOv2, PaliGemma), and three attacks of increasing strength (PGD, MI-FGSM, SIA), as well as an adaptive attacker using a straight-through estimator. Our results show that Floyd-Steinberg dithering at intermediate quantization levels, especially when combined with post-processing blur, exceeds or matches all tested baselines, including diffusion-based denoising, with substantially less degradation on clean inputs.

[28] RoboSurg-VQA: A Multimodal Benchmark for Surgical Segmentation-Aware Visual Question Answering cs.CVPDF

Chengyi Zhang, Zi Ye, Ziyang Wang

TL;DR: 本文提出了RoboSurg-VQA，一个用于机器人辅助和微创手术（RMIS/MIS）的分割感知视觉问答（VQA）基准。该基准通过重新利用公开的手术分割数据集构建，每个帧都配有一套固定的、临床驱动的问题，涵盖手术过程、解剖结构、成像视图、手术伪影、图像质量及基本可视性和空间属性，并采用封闭答案集以确保评估一致性。

Details

Motivation: 在临床实践中，医生经常在视野受限（如遮挡、烟雾、出血、镜面高光）的条件下，提出关于手术过程、可视性、伪影以及解剖结构和手术器械存在性的语言式问题，这要求超越准确分割掩码的可靠视觉理解。

Result: 论文报告了基准统计数据、合理性基线以及在具有挑战性的手术条件下的常见评估挑战，但未提及与现有SOTA模型的定量比较结果。

Insight: 创新点在于构建了一个专门针对手术场景、融合分割感知的VQA基准，并通过约束提示生成候选答案并结合人工审核来规模化标注，这为手术视觉理解提供了更贴合临床需求的多模态评估框架。

Abstract: Reliable visual understanding in robot-assisted and minimally invasive surgery (RMIS/MIS) demands more than accurate masks: in clinical practice, clinicians pose language-like questions about procedural context, visibility, artefacts, and the presence of anatomical structures and surgical instruments, often under degraded views caused by occlusion, smoke, bleeding, and specular highlights. We present \textbf{RoboSurg-VQA}, a segmentation-aware visual question answering (VQA) benchmark built by repurposing public surgical segmentation datasets under a shared schema. Each frame is paired with a fixed set of clinically motivated questions spanning procedure context, anatomy (including region), imaging modality/view, surgical artefacts, image quality, and basic visibility and spatial attributes, with closed answer sets to enable consistent evaluation. To scale annotation, we generate candidate answers via constrained prompting with automatic validity and consistency checks, followed by human auditing to improve plausibility and label consistency. We report benchmark statistics, sanity baselines, and common evaluation challenges under challenging surgical conditions. The code will be available on https://github.com/ziyangwang007/Robosurg-VQA.

[29] Inconsistency-aware Multimodal Schrödinger Bridge for Deepfake Localization cs.CVPDF

Jiayu Xiong, Jing Wang, Qi Zhang, Wanlong Wang, Jun Xue

TL;DR: 本文提出了一种名为IaMSB的不一致性感知多模态薛定谔桥模型，用于音频-视觉深度伪造定位任务。该方法通过联合估计跨模态一致性并执行区间级定位，解决了单侧或异步伪造下对称融合导致的跨模态噪声传播问题。

Details

Motivation: 现有音频-视觉深度伪造定位方法在单侧或异步伪造场景下，对称融合策略会传播跨模态噪声，从而损害高精度定位性能。本文旨在通过一种新的框架来抑制噪声传递，提升定位精度。

Result: 在多个基准测试上，IaMSB稳定了严格IoU边界精度，将AP@0.95指标提升了3%~10%，并在高精度定位方面表现更优，尤其针对单侧伪造场景。

Insight: 创新点在于将一致性估计、跨模态信息选择和桥步调度统一于薛定谔桥框架内，通过轻量级粗桥和精炼桥的两阶段设计，实现了不对称的跨模态融合与步长分配，从而有效抑制了噪声传递并避免了不必要的迭代。

Abstract: Audio-visual deepfake localization demands interval-level outputs that serve as temporal evidence. Despite recent progress, symmetric fusion under single-sided or asynchronous forgeries propagates cross-modal noise, degrading high-precision localization. We present IaMSB, an inconsistency-aware multimodal Schrödinger Bridge (SB) that jointly estimates cross-modal consistency and performs interval-level localization. Unlike diffusion models, SB minimizes path-distribution discrepancy and yields consistency scores without explicit noise injection or denoising. With the Schrödinger Bridge (SB), IaMSB unifies consistency estimation, cross-modal information selection, and bridge-step scheduling in one framework. Specifically, a lightweight coarse bridge first proposes candidate intervals and estimates cross-modal consistency; these statistics select cross-modal witness signals and allocate bridge steps asymmetrically across modalities. A refinement bridge then performs step-tuned fusion and outputs refined, time-aligned intervals. IaMSB anticipates single-sided and asynchronous forgeries and, using bottlenecked cross-modal interaction with step allocation, suppresses noise transfer, avoids unnecessary iterations. Across benchmarks, IaMSB stabilizes strict-IoU boundary precision, raising AP@0.95 by 3%~10%, and yields improved high-precision localization, particularly for single-sided forgeries.

[30] CoReVAD: A Contextual Reasoning Framework for Training-Free Video Anomaly Detection cs.CV | cs.AIPDF

Hyeongmuk Lim, Youngbum Hur

TL;DR: 本文提出CoReVAD，一种基于上下文推理的无训练视频异常检测框架。该方法仅使用单个冻结的视觉语言模型，直接生成异常分数和时间描述，并通过局部响应清洗和全局时序上下文整合来优化输出。在UCF-Crime和XD-Violence数据集上的实验表明，其性能与无训练方法相当，并能提供可解释的推理。

Details

Motivation: 解决现有视频异常检测方法存在的领域依赖性强、训练成本高、输出仅为标量分数而缺乏可解释性，以及基于VLM的方法仍需额外训练或引入外部LLM导致开销增加的问题。

Result: 在UCF-Crime和XD-Violence基准测试中，CoReVAD在无训练方法中取得了有竞争力的性能。

Insight: 创新点在于提出完全无训练的框架，仅依赖单个冻结VLM；通过局部响应清洗模块减少生成噪声，并整合全局时序上下文（如基于softmax的细化、高斯平滑和位置加权）来提升检测和解释的可靠性。从客观角度看，其将生成式VLM直接用于异常分数和描述生成，并通过后处理机制优化，是一种高效且可解释的解决方案。

Abstract: Existing Video Anomaly Detection (VAD) methods typically rely on task-specific training, leading to strong domain dependency and high training costs. Moreover, most existing methods output only scalar anomaly scores, providing limited insight into why specific events are considered abnormal. Recent advances in Vision-Language Models (VLMs) have enabled both anomaly detection and human-interpretable reasoning. However, many VLM-based approaches still require additional training steps (e.g., instruction tuning or verbalized learning) or external Large Language Models (LLMs), incurring further training costs and inference overhead. To address these challenges, we propose CoReVAD, a contextual reasoning framework for training-free video anomaly detection that operates with a single frozen VLM. CoReVAD directly generates anomaly scores and temporal descriptions from the VLM. To mitigate noise in generative outputs, we introduce a Local Response Cleaning (LRC) module based on local vision-text alignment. Furthermore, global temporal context and progression are incorporated through softmax-based refinement, Gaussian smoothing, and position weighting. Experiments on UCF-Crime and XD-Violence demonstrate that CoReVAD achieves competitive performance among training-free methods while providing reliable and interpretable explanations. Our official code is available at: https://github.com/Muk-00/CoReVAD

[31] VisAnalog: A Diagnostic Suite for Visual Concept Transfer on Natural Images cs.CVPDF

Zhaonan Li, Kyle R. Chickering, Bangzheng Li, Jacob Dineen, Xiao Ye

TL;DR: 该论文介绍了VisAnalog，一个用于评估视觉概念在自然图像上迁移能力的诊断性基准测试套件。该基准通过A:B::C:?的类比形式，要求模型在给定源图像A、变换后图像B和另一源图像C的情况下，推断出经过相同确定性变换序列（如缩放、旋转、色调旋转等）后的目标图像D。它包含617个人工验证的问题，涵盖一到四步的视觉变换。

Details

Motivation: 动机在于测试视觉概念学习模型是否不仅能识别单张图像中的概念，还能在图像变换过程中保持和操作概念级属性，并将其迁移到新场景中，从而评估模型对视觉关系的理解和泛化能力。

Result: 实验结果表明，无论是强大的专有还是开源视觉语言模型（VLMs），其端到端准确率都显著低于直接展示D图像时的oracle准确率，且随着变换深度增加性能急剧下降，而人类表现接近天花板。程序条件评估进一步揭示了关系推理失败是主要瓶颈，在更复杂的多步案例中还会出现额外的变换应用错误。

Insight: 创新点在于构建了一个可控、基于自然图像的视觉类比诊断套件，能够系统性地分解和评估模型在视觉关系推理与变换应用两个子任务上的能力，为理解VLMs的局限性提供了新的分析工具。数据集已公开。

Abstract: A useful test of visual concept learning is not just whether a model can recognize a concept in a single image, but whether it can preserve and manipulate concept-level properties under transformation and transfer them to new scenes. We introduce VisAnalog, a controlled suite for this setting on natural images. Each example instantiates $A!:!B::C!:,?$: images $B$ and a hidden target image $D$ are produced by applying the same deterministic transformation sequence to source images $A$ and $C$. Given $A$, $B$, and $C$, a model must answer a multiple-choice question about $D$. The benchmark contains 617 human-validated questions spanning one- to four-step transformations such as zoom, quadrant swap, rotation, flip, and hue rotation. Across strong proprietary and open-source VLMs, end-to-end accuracy is substantially lower than oracle accuracy when $D$ is directly shown, and degrades sharply as transformation depth increases, while human performance remains near the ceiling. A program-conditioned evaluation further separates failures of relation inference from failures of transformation application, showing that inferring the visual relation from $A \rightarrow B$ is the dominant bottleneck, with additional application errors emerging on harder multi-step cases. The dataset is publicly available at https://huggingface.co/datasets/zli99/VisAnalog.

[32] SLIP-RS: Structured-Attribute Language-Image Pre-Training for Remote Sensing Object Detection cs.CVPDF

Chenxu Wang, Yuxuan Li, Yunheng Li, Xiang Li, Jingyuan Xia

TL;DR: 本文提出了SLIP-RS，一种用于遥感目标检测的结构化属性语言-图像预训练方法。该方法通过将开放式的类别空间映射到有限的、具有物理意义的属性空间，并利用结构化属性对比学习和保形属性可靠性引擎两大技术支柱，解决了现有方法因依赖黑盒数据和详尽枚举类别而受限于数据稀缺的问题。

Details

Motivation: 现有遥感目标检测的语言-图像预训练方法受限于整体标签学习，它依赖通过黑盒数据详尽枚举开放集类别来获取细粒度表征，这种依赖性与遥感领域固有的数据稀缺性不兼容。

Result: 广泛的实验表明，SLIP-RS在细粒度检测和跨域泛化方面建立了前所未有的性能，验证了结构化属性是遥感领域的重要基础。

Insight: 核心创新是提出了结构化属性解耦范式，将类别空间映射到物理属性空间以解锁细粒度判别能力。具体技术包括结构化属性对比学习和基于保形预测理论构建的可靠性引擎，并构建了包含超过1500万属性标注的最大数据集RS-Attribute-15M。

Abstract: Existing language-image pre-training for remote sensing object detection is constrained by Monolithic Label Learning, which relies on exhaustively enumerating open-set categories via black-box data to acquire fine-grained representations, creating a dependency incompatible with the domain’s inherent data scarcity. To transcend this bottleneck, we propose SLIP-RS, establishing a Structured-Attribute Decoupling Paradigm that maps the open-ended category space into a finite, physically meaningful attribute space, unlocking fine-grained discriminability via explicit structural logic. This paradigm is realized via two technical pillars: (1) Structured-Attribute Contrastive Learning, which enforces the learning of decoupled intrinsic visual logic via combinatorial attribute augmentation; and (2) Conformal Attribute Reliability Engine, which leverages conformal prediction theory to rigorously distill high-fidelity supervision from noisy sources, yielding RS-Attribute-15M, the largest dataset with over 15 million attribute annotations. Extensive experiments demonstrate that SLIP-RS establishes unprecedented performance in fine-grained detection and cross-domain generalization, validating structured attributes as a vital foundation for remote sensing. Code: https://github.com/facias914/SLIP-RS.

[33] LQ-rPPG: A Label-Quantized Coarse-to-Fine Learning Framework for Remote Physiological Measurement cs.CVPDF

Jun Seong Lee, Samyeul Noh, Changki Sung, Hyun Myung

TL;DR: 本文提出了一种名为LQ-rPPG的标签量化从粗到精学习框架，用于从面部视频中进行稳健的远程光电容积描记术（rPPG）生理信号测量。该框架通过一个标签量化模块将含噪声的连续PPG训练标签转换为多比特量化伪标签，并结合一个从粗到精的估计模型，在分层监督下逐步细化rPPG信号，以减轻对标签噪声和变化的过拟合。

Details

Motivation: 现有基于深度学习的rPPG方法很少关注训练标签的质量问题。作为训练标签的接触式PPG信号常因运动伪影、传感器接触不一致和形态失真而包含噪声和变异性，这种标签不一致性会导致模型过拟合标签噪声，从而降低泛化性能。

Result: 在多个基准数据集上的实验表明，LQ-rPPG在数据集内和跨数据集评估中均取得了强劲性能，同时将参数量和乘累加操作分别减少了88%和29%，并将吞吐量提高了191%。

Insight: 核心创新点在于首次系统性地关注并处理rPPG训练中的标签质量问题，提出了标签量化和从粗到精的分层监督学习范式。这为处理含噪声生理信号标签提供了一种新思路，其设计的量化与渐进式细化机制可能泛化至其他对标签噪声敏感的时序信号回归任务。

Abstract: Remote photoplethysmography (rPPG) enables non-contact measurement of physiological signals from facial videos, offering strong potential for remote healthcare and daily health monitoring. Driven by this potential, various deep learning-based rPPG methods have been proposed to improve rPPG estimation. However, previous deep learning-based rPPG methods have paid little attention to the quality of training labels and their impact on model learning. Contact-based PPG signals used as training labels often contain noise and variability caused by motion artifacts, inconsistent sensor contact, and morphological distortions. Such label inconsistency can lead models to overfit to the label noise and variability and consequently degrade generalization performance. To address this issue, we propose LQ-rPPG, a label-quantized coarse-to-fine learning framework for robust rPPG estimation. LQ-rPPG consists of a label quantization module and a coarse-to-fine rPPG estimation model. The label quantization module transforms continuous PPG signals into multi-bit quantized pseudo labels with reduced noise and variability. The coarse-to-fine estimation model progressively refines rPPG signals under hierarchical supervision guided by the multi-bit pseudo labels. This design alleviates overfitting to label-specific variations and enables the model to learn structured and consistent representations. As a result, LQ-rPPG achieves robust and generalizable rPPG estimation even under challenging conditions. Experiments on multiple benchmark datasets demonstrate that LQ-rPPG achieves strong performance in both intra- and cross-dataset evaluations, while reducing parameters and multiply-accumulate operations by 88% and 29%, respectively, and increasing throughput by 191%. The code is available at https://github.com/Anonymous-repo-code/LQ-rPPG.

[34] DRIVESPATIAL: A Benchmark for Spatiotemporal Intelligence in VLMs for Autonomous Driving cs.CVPDF

Hao Vo, Khoa Vo, Phu Loc Nguyen, Sieu Tran, Duc Minh Nguyen

TL;DR: 本文提出了DriveSpatial，一个用于评估自动驾驶场景下视觉语言模型时空智能的基准测试。该基准包含来自五个大规模自动驾驶数据集的15.6K个人工验证的问答对，旨在评估模型的认知场景构建、多视图关系理解、时序推理和泛化能力。通过评估15个代表性VLM，发现其与人类表现存在巨大差距，尤其是在认知场景构建方面存在瓶颈。

Details

Motivation: 现有自动驾驶视觉语言基准大多关注单视图、静态、以自我为中心或单一来源的问答，无法评估模型是否真正具备构建和推理动态驾驶场景的能力。因此，需要一个新的基准来填补这一空白，系统地评估VLM的时空智能。

Result: 在DriveSpatial基准上评估了15个代表性VLM，最强的模型表现仍落后人类28.4个百分点。诊断分析表明，仅使用语言提示是不够的，而显式的鸟瞰图（BEV）基础能持续提升性能。

Insight: 论文的创新点在于构建了一个基于动态多关系场景图的基准生成流程，该图编码了物体状态、空间关系、交互、相机可见性和时序对应关系，从而能生成强制进行跨视图和时空推理的问答对。客观来看，该工作系统地定义了自动驾驶时空智能的评估维度，并揭示了当前VLM在场景构建能力上的核心缺陷，为未来研究指明了方向。

Abstract: Spatiotemporal intelligence in autonomous driving (AD) requires an agent to integrate multi-view observations into a coherent scene representation, maintain object continuity across viewpoints and time, and reason about spatial relations, interactions, and future dynamics. However, existing AD vision-language benchmarks largely focus on single-view, static, ego-centric, or single-source question answering, leaving it unclear whether current Vision-Language Models (VLMs) can truly construct and reason over dynamic driving scenes. We introduce DriveSpatial, a benchmark of 15.6K human-verified QA pairs across 20 tasks from five large-scale AD datasets. DriveSpatial evaluates four abilities: Cognitive Scene Construction, Multi-view Relational Understanding, Temporal Reasoning, and Generalization. Unlike prior benchmarks, DriveSpatial is generated from a dynamic multi-relational scene graph that encodes object states, spatial relations, interactions, camera visibility, and temporal correspondences, enabling QA pairs that enforce genuine cross-view and spatiotemporal reasoning. Evaluating 15 representative VLMs reveals a substantial human-model gap: the strongest model trails humans by 28.4 points, with Cognitive Scene Construction emerging as the key bottleneck. Further diagnostics show that language-only prompting is insufficient, while explicit BEV grounding consistently improves performance. These results suggest that current VLMs lack the scene-construction ability needed for reliable spatiotemporal driving intelligence. DriveSpatial and its construction pipeline will be released to support future research.

Lin Qian, Shijie Li, Sihao Lin, Xuan Zhang, Bangya Liu

TL;DR: 本文提出IntentionNav基准，用于评估具身智能体在隐式人类指令下的意图驱动物体导航任务。该基准包含500种意图、176个Isaac Sim场景和64个目标类别，通过四种指令风格和意图模式进行标注，支持对目标推理、语言鲁棒性等维度的分析。实验表明当前视觉语言模型在目标识别和最终精确定位方面仍存在显著瓶颈。

Details

Motivation: 现有物体导航基准通常直接指定目标物体类别，而真实人机交互中人类常给出间接意图描述（如’房间很闷’），因此需要构建能够评估智能体从隐式指令推断目标、搜索并确认完成度的新基准。

Result: 在固定主动导航策略下，三个视觉语言模型仅能识别48.3%的意图目标，进入2米邻域的比例为68.7%，但最终成功终止率仅24.9%，精确到1米范围内的成功率仅5.5%；事件脚本类意图成功率最高（28.7%），物理状态和功能可供性类意图成功率较低（19.2%和18.5%）。

Insight: 创新点在于构建了首个系统解耦语言表达形式与语义线索类型的意图导航基准，通过配对设计支持细粒度性能分析；研究发现间接意图在目标选择、视觉验证和终端定位环节仍是具身搜索的关键瓶颈，为后续研究提供了明确方向。

Abstract: Existing object navigation benchmarks usually tell an embodied agent which object category to find, such as microwave or chair. Human-facing embodied AI is often asked something less direct: “I need something to warm this food” or “the room feels stuffy.” The agent must infer the object that can satisfy the need, find a scene-grounded instance, and decide whether the goal has been reached. We study this setting as intent-driven object navigation and introduce IntentionNav, a diagnostic benchmark for active object search from implicit human instructions. Each episode provides a free-text intent, RGB-D observations, and pose, but withholds the target object name. IntentionNav contains 500 intents over 176 Isaac Sim scenes and 64 target categories. Each intent is rewritten in four controlled instruction styles and annotated with one of four intent modes, separating surface phrasing from semantic cue type under matched geometry. This paired design supports analysis of target inference, language robustness, neighborhood reachability, and terminal success rather than only aggregate success. We evaluated three VLMs using a fixed active-navigation agent. Models identify the intended target in 48.3 percent of episodes and enter its 2 m neighborhood in 68.7 percent, but terminate successfully in only 24.9 percent and achieve grounded 1 m success in 5.5 percent. Success is highest for event-script intents (28.7 percent) and lower for physical-state and affordance intents (19.2 percent and 18.5 percent), showing that indirect human intent remains a bottleneck for target selection, visual verification, and terminal localization in active embodied search.

[36] Occlusion-Aware Physics-Semantic Keyframe Selection for Robust Video Editing cs.CVPDF

Lin Liu, Zhihan Xiao, Haohang Xu, Rong Cong, Zhibo Zhang

TL;DR: 本文提出了一种遮挡感知的物理语义关键帧选择框架，用于提升视频编辑在遮挡、视角变化和快速运动场景下的鲁棒性。该方法通过评估候选帧的结构完整性、循环一致跟踪稳定性和基于视觉语言的属性可见性，自动选择最优锚定帧，并通过双向跟踪生成密集时空掩码作为扩散模型的辅助监督。

Details

Motivation: 现有基于扩散模型的视频编辑方法在遮挡、视角变化和快速物体运动等场景下，由于视觉观测不可靠，常导致定位不准确、时间闪烁和编辑不一致的问题。本文认为缺乏可靠的视觉锚点是遮挡鲁棒性视频编辑的根本瓶颈。

Result: 在具有挑战性的视频编辑基准测试上进行的广泛实验证明了该方法的有效性和高质量性能。

Insight: 创新点在于将遮挡处理从显式重建问题转化为可靠的锚点选择问题，通过多视角（结构、物理、语义）自动选择关键帧，并利用其生成辅助监督，无需人工标注即可实现精确且时间一致的编辑。

Abstract: Video editing has recently achieved remarkable progress with diffusion-based generative models, enabling diverse object-level manipulations from natural language instructions. However, existing methods often struggle under occlusion, viewpoint changes, and fast object motion, where unreliable visual observations lead to inaccurate localization, temporal flickering, and inconsistent edits. In this work, we identify the absence of reliable visual anchors as a fundamental bottleneck in occlusion-robust video editing. To address this issue, we propose an occlusion-aware physics-semantic keyframe selection framework that automatically identifies an optimal anchor frame for downstream editing. Specifically, our method evaluates candidate frames from three complementary perspectives: structural completeness for avoiding truncated observations, cycle-consistent tracking stability for measuring physical reliability, and vision-language-based attribute visibility for ensuring semantic clarity. The selected keyframe is then propagated through bidirectional tracking to generate dense spatiotemporal masks, which are used as auxiliary supervision for a diffusion-based video editing backbone. By transforming occlusion handling from explicit reconstruction into reliable anchor selection, our framework enables precise and temporally consistent editing without requiring manual annotations. Extensive experiments on challenging video editing benchmarks demonstrate the effectiveness and high-quality performance of our method.

[37] Lipschitz Optimization for Formal Verification of Homographies cs.CV | cs.AI | cs.LG | cs.ROPDF

Jean-Guillaume Durand, Panagiotis Kouvaros, Maxime Gariel, Alessio Lomuscio

TL;DR: 本文提出了一种用于形式化验证视觉神经网络对相机三维运动扰动鲁棒性的方法，通过建立相机姿态到像素值的闭式映射，并利用Lipschitz优化和分段连续性分析推导出扰动像素值的紧致线性边界。该方法适用于具有主导平面结构的场景，无需复杂模拟或代理网络，在VNN-COMP基准测试中揭示了投影扰动的系统性弱点，并在安全关键跑道分类器案例中验证了实用性。

Details

Motivation: 当前视觉神经网络的形式化验证方法主要局限于ℓ_p范数和仿射变换的鲁棒性，无法覆盖相机运动等关键扰动，限制了在自动驾驶等安全关键领域的部署。

Result: 在VNN-COMP基准测试中揭示了神经网络对投影扰动的系统性弱点；相比现有方法实现了最高89%的速度提升和7%的更紧边界；通过跑道分类器案例验证了相机运动扰动的实际脆弱性。

Insight: 创新点在于将Lipschitz优化扩展到投影几何变换的验证，通过分析单应性的连续性建立像素扰动的闭式线性边界，首次实现了无需复杂模拟的投影变换形式化验证。

Abstract: The adoption of vision neural networks in regulated industries requires formal robustness guarantees, especially in safety-critical domains such as healthcare, autonomous vehicles, and aerospace. However, current approaches are confined to incomplete statistical verification or robustness to $\ell_p$-norm and affine transforms, which cover only a narrow subset of perturbations to the image formation process. In particular, robustness to camera motion remains an open problem despite being key to deploy many vision applications. We present a formal verification approach that targets robustness against 3D motion perturbations of the capturing camera. We first establish a closed-form mapping from camera pose to pixel values. By analyzing the continuity properties of the resulting homographies, we show that recent work on Lipschitz optimization and piecewise continuity can be extended to derive tight linear bounds on perturbed pixel values. Our approach applies to scenes with predominantly planar structure, such as ground planes in augmented reality, road markings and traffic signs in autonomous driving, or planar workspaces in robotic manipulation. This enables the first formal verification of projective geometry transforms, without complex simulation, surrogate networks, or explicit image-formation models. We validate our implementation and show up to 89% speedup and 7% tighter bounds over prior work. We then evaluate our method on the VNN-COMP benchmark and reveal systematic weaknesses to projective perturbations. Finally, we demonstrate a real-world case study on a safety-critical runway classifier, highlighting practical vulnerabilities to camera motion, and addressing a key challenge in the certification of learned models. Data and code are publicly available at https://github.com/jeangud/homography-verification .

[38] CaST-Bench: Benchmarking Causal Chain-Grounded Spatio-Temporal Reasoning for Video Question Answering cs.CVPDF

Mingfang Zhang, Jingjing Pan, Ashutosh Kumar, Rajat Saini, Mustafa Erdogan

TL;DR: 论文提出了CaST-Bench，一个用于评估视频问答中因果链时空推理能力的基准测试。它包含一个由人类与AI协作构建的高质量数据集，包含1015个视频上的2066个问题，并标注了因果链的时空证据。论文还设计了一套评估指标，不仅评估答案正确性，还评估基于视觉证据的推理能力。实验表明，当前视觉语言模型在因果问题上表现不佳，突显了改进方向。

Details

Motivation: 现有基准测试缺乏细粒度的、有依据的证据来严格评估视觉语言模型在视频中的因果推理能力，这需要超越表层感知，深入理解因果机制。

Result: 实验表明，当前的视觉语言模型在因果问题上表现挣扎，主要原因是其构建精确且有依据的因果链的能力有限。

Insight: 创新点在于提出了首个专注于因果链时空推理的视频问答基准，并通过人类-AI协作流程构建了高质量数据集，同时设计了评估答案正确性和视觉证据推理能力的新颖指标，强调了基于证据的推理对于提高准确性和增强用户信任的重要性。

Abstract: Cause-and-effect reasoning in video is a significant challenge for Vision-Language Models (VLMs), as it requires going beyond surface-level perception to a deeper understanding of causal mechanisms. However, existing benchmarks rarely provide the fine-grained, grounded evidence needed to rigorously evaluate this capability. To address this gap, we introduce CaST-Bench, a benchmark for Causal Chain-Grounded Spatio-Temporal Video Reasoning. CaST-Bench presents complex causal questions that require models to identify and localize a chain of multiple spatio-temporal evidences. Through a human-AI collaborative pipeline, we construct a high-quality dataset of 2,066 questions over 1,015 videos, with causal chains annotated by temporal segments and bounding-box tracks. Furthermore, we design a comprehensive evaluation suite with novel metrics that assess not only answer correctness but also the capability for visual evidence grounded reasoning. This grounding is crucial for improving accuracy by mitigating spurious correlations and for enhancing user trust by making models more transparent. Our experiments show that current VLMs struggle with causal questions, largely due to their limited ability to construct precise and grounded causal chains. This highlights an important direction for improving future VLMs.

[39] StereoGenBench: A Synthetic Multi-Camera Benchmark for Stereo Generation under Controlled Baseline Regimes cs.CVPDF

Yangzhi Cui, Feng Qiao, Nathan Jacobs

TL;DR: 本文提出了StereoGenBench，一个基于Unreal Engine合成的多相机基准数据集，用于在可控基线条件下评估立体图像和视频生成、立体几何估计以及条件控制视图合成任务。该数据集提供了每个场景下由六个相机组成的刚性横向阵列渲染的视图，包含多达15个校准的视图对，并提供了RGB图像、度量深度、相机内参、每对基线以及每帧姿态等完整标注。

Details

Motivation: 现有立体视觉资源通常缺乏对决定双目几何的关键变量（如相机基线、内参、场景深度和相机运动）的完整、可控标注，这限制了立体生成任务在基线敏感性和目标相机一致性方面的可测量性。

Result: 论文发布了完整的数据集、评估代码、参考结果、Croissant元数据以及生成代码/配置，为后续研究提供了可扩展的资源。数据集已在Hugging Face上公开。

Insight: 创新点在于构建了一个合成基准，首次在单一可控源中提供了场景配对、校准的多基线右视图真值，并联合记录了内参、密集度量深度和每帧姿态，使得在匹配场景内容下量化基线敏感性和相机一致性成为可能。

Abstract: Stereo image and video generation, stereo geometry estimation, and condition-controlled view synthesis require paired data in which the variables that determine binocular geometry – camera baseline, intrinsics, scene depth, and camera motion – are known and controllable. Existing stereo resources provide subsets of these variables, but resources commonly used for stereo generation evaluation do not, to our knowledge, provide scene-paired, calibrated multi-baseline right-view ground truth with jointly recorded intrinsics, dense metric depth, and per-frame poses in a single controlled source. We introduce StereoGenBench, a synthetic Unreal Engine benchmark designed to make baseline-regime sensitivity and target-camera consistency measurable under matched scene content. Each scene is rendered with a rigid six-camera lateral array, yielding up to 15 calibrated view pairs; adjacent baselines are sampled from inter-pupillary to wide-baseline regimes; focal length is sampled independently; and every view is released with RGB, metric depth, intrinsics, per-pair baselines, and per-frame poses. The splits include two evaluation families for narrow and wide baseline regimes and a train-only family for broader all-pairs coverage. We release the dataset, evaluation code, reference results, Croissant metadata, and generation code/configuration for extension with compatible assets. The dataset is available at https://huggingface.co/datasets/stereo-dataset/stereo-dataset

[40] CARE: Class-Adaptive Expert Consensus for Reliable Learning with Long-Tailed Noisy Labels cs.CVPDF

Mengke Li, Haiquan Ling, Lihao Chen, Yang Lu, Yiqun Zhang

TL;DR: 本文提出CARE框架，旨在解决现实数据中长尾分布与噪声标签并存的学习难题。该方法利用视觉语言模型（VLM）的文本嵌入、视觉特征和观测噪声标签三种互补监督源，通过类自适应专家共识机制，为尾类施加更严格的共识约束、为头类提供更宽松的共识条件，从而过滤不可靠信号并重新校准类别分布。

Details

Motivation: 现有方法在处理长尾噪声标签时，通常忽略标签噪声在不同类别间的非均匀影响，导致对尾类的校正效果不佳，而对头类则过度正则化。

Result: 在合成和真实世界基准测试上的大量实验表明，CARE始终优于现有最先进方法，性能提升最高达3.0%。

Insight: 创新点在于提出了一种参数高效的类自适应专家共识机制，根据类别频率动态调整不同监督源之间所需的共识严格程度，从而更有效地利用VLM的多模态信息进行可靠校正。

Abstract: Learning from real-world data is frequently hindered by the compound challenge of long-tailed class distributions and noisy annotations. Existing methods partially address these issues but typically ignore the non-uniform impact of label noise across classes, resulting in ineffective correction for tail classes and over-regularization for head classes. To address this issue, we propose Class-Adaptive Rectification with Experts (CARE), a parameter-efficient framework that leverages three complementary supervision sources from vision-language models (VLM): observed noisy labels, VLM text embeddings, and visual features. CARE introduces a class-adaptive expert consensus mechanism that enforces stricter agreement for tail classes and more permissive agreement for head classes based on class frequency. By aggregating high-confidence predictions across these sources, CARE filters unreliable signals and recalibrates class distributions, yielding more reliable rectification under long-tailed distributions. Extensive experiments on both synthetic and real-world benchmarks demonstrate that CARE consistently outperforms state-of-the-art methods, achieving up to 3.0% performance gains. The source code is available at https://github.com/qwq123-study/CARE.

[41] SimInsert: Seamless Video Object Insertion via Regional Sparse Attention Fusion cs.CV | cs.AIPDF

Xinyu Chen, Yuyi Qian, Jiang Lin, Shenyi Wang, Gao Wang

TL;DR: 本文提出了SimInsert，一种无需训练的范式，用于实现无缝的视频对象插入。该方法将任务解耦为直观的单帧编辑和语义运动描述，利用图像到视频扩散模型的强大生成先验，在保持背景不变性的同时，实现插入对象与动态环境之间合理的、文本驱动的交互。

Details

Motivation: 当前视频对象插入方法通常依赖于显式的运动工程或资源密集的重新训练，限制了其灵活性和泛化能力。本文旨在解决这一问题，实现无需训练、高保真且具有时空一致性的视频编辑。

Result: 广泛的定量实验表明，SimInsert在PSNR、SSIM和LPIPS指标上分别以18.8%、20.1%的提升和44.1%的降低，超越了最先进的方法，实现了高保真视频编辑。

Insight: 创新点在于提出了一种无需训练的解耦范式，并引入了非侵入式引导机制来强制结构一致性、促进无缝边界融合并抵消去噪轨迹中典型的保真度漂移，从而高效地利用生成先验实现时空连贯的编辑。

Abstract: Video object insertion requires ensuring spatio-temporal coherence and interactive realism, extending far beyond simple content placement. However, current approaches are often hindered by a reliance on explicit motion engineering or resource-intensive retraining, restricting their flexibility and generalization. To bridge this gap, we present \textit{SimInsert}, a training-free paradigm that efficiently decouples the task into intuitive single-frame editing and semantic motion description. By harnessing the robust generative priors of image-to-video diffusion models, SimInsert propagates edits temporally, strictly preserving background invariance while enabling plausible, text-driven interactions between the inserted object and the dynamic environment. Our approach hinges on non-invasive guidance mechanisms that enforce structural consistency, facilitate seamless boundary fusion, and counteract the fidelity drift that typically accumulates during the denoising trajectory. Extensive quantitative experiments validate our efficacy: SimInsert surpasses state-of-the-art methods with an 18.8% gain in PSNR, 20.1% in SSIM, and a 44.1% decrease in LPIPS, offering a streamlined solution for high-fidelity video editing.

[42] ChainFlow-VLA: Causal Flow Planning with Vision-Language Models cs.CV | cs.AI | cs.ROPDF

Xiyang Wang, Xinlin Wang, Tingguang Zhou, Gong Chen, Xingtai Gui

TL;DR: 这篇论文提出了ChainFlow-VLA，一种用于自动驾驶规划的统一概率框架，旨在解决现有方法中因果推理与全局轨迹一致性不匹配的问题。该方法结合了自回归模型（Chain）的因果生成能力和扩散模型（Flow）的全局优化能力，并利用视觉语言模型（VLM）的隐藏状态作为语义先验进行轨迹修正。

Details

Motivation: 当前端到端自动驾驶系统存在一个根本性限制：时序因果推理与全局轨迹一致性之间存在不匹配。自回归模型能捕捉交互感知的时序依赖，但其逐步解码会导致误差累积和次优的全局结构；而扩散模型能全局优化轨迹，但缺乏显式的因果约束，在交互和安全关键场景中不可靠。现有方法将因果建模和全局优化视为分离的范式，缺乏统一它们的原理性方法。

Result: 实验表明，ChainFlow-VLA在模糊和长尾场景中实现了鲁棒的规划，在NAVSIM v1排行榜上达到了94.85的SOTA分数，与人类水平性能（94.8）相当。

Insight: 论文的核心创新点在于提出了一个统一的概率框架，将因果生成（自回归模型）和全局细化（扩散模型）结合起来，并通过VLM隐藏状态作为语义先验，将高层场景理解无缝注入到细粒度轨迹调整中。这为解决自动驾驶规划中因果性与全局性的权衡提供了一种新颖且有效的思路。

Abstract: Current end-to-end autonomous driving systems are fundamentally limited by a mismatch between temporal causal reasoning and global trajectory consistency. Autoregressive (AR) models capture interaction-aware temporal dependencies via causal factorization, but their step-wise decoding leads to error accumulation and suboptimal global structure. In contrast, diffusion models optimize trajectories globally but lack explicit causal constraints, making them unreliable in interactive and safety-critical scenarios. This dichotomy reveals a deeper issue: existing methods treat causal modeling and global optimization as separate paradigms, without a principled way to unify them within a single trajectory distribution. To address this, we propose ChainFlow-VLA, which unifies causal generation and global refinement within a unified probabilistic framework. We formulate planning as a mixture over AR-induced modes and learn Vision-Language Model (VLM)-conditioned residual distributions over these modes. An autoregressive generator (Chain) produces a discrete set of causal trajectory modes, followed by a diffusion-based refiner (Flow) that leverages VLM hidden states as semantic priors to perform mode-conditioned correction in residual space while preserving causal structure. This straightforward conditioning seamlessly injects high-level scene understanding into fine-grained trajectory adjustments. Experiments demonstrate that ChainFlow-VLA achieves robust planning in ambiguous and long-tail scenarios, achieving a state-of-the-art score of 94.85 on the NAVSIM v1 leaderboard, matching human-level performance (94.8). Code will be available at https://github.com/AFARI-Research/ChainFlow-VLA.

[43] EvalVerse: Pipeline-Aware and Expert-Calibrated Benchmarking for Professional Cinematic Video Generation cs.CV | cs.AIPDF

Songlin Yang, Haobin Zhong, Ruilin Zhang, Xiaotong Zhao, Shuai Li

TL;DR: 这篇论文提出了EvalVerse，一个针对专业级电影视频生成的、流程感知且专家校准的评估框架。它旨在解决现有基准主要关注基本提示跟随（’是否正确’）而忽视电影质量、表演和美学（’是否优秀’）的问题。通过将电影专业知识系统化、数字化，并利用专家校准的微调策略赋能视觉语言模型，EvalVerse为视频生成提供了更全面、可信的评估。

Details

Motivation: 当前生成视频基础模型的评估存在严重瓶颈：现有基准主要评估基本提示跟随（’是否正确’），而忽略了电影质量、表演和美学（’是否优秀’）等专业维度。同时，自动化指标缺乏领域严谨性，导致人类审美感知与机器评分之间存在可信度鸿沟。

Result: 论文通过构建大规模人工标注数据集并利用专家校准的微调策略训练视觉语言模型，使模型能够进行显式的思维链推理。EvalVerse不仅兼容基础的’正确性’指标，还显著扩展了’优秀性’标准，并将任务覆盖范围扩展到复杂的多镜头序列和视听集成。

Insight: 核心创新在于将视频生成评估视为一个核心科学问题——主观电影专业知识的系统数字化。具体方法包括：1）构建与专业电影制作流程（前期、中期、后期）对齐的评估分类法；2）将人类专家判断提炼为标注数据集；3）通过专家校准的微调策略将知识注入视觉语言模型。这为未来的奖励模型和评估智能体等工作提供了基础架构。

Abstract: The rapid evolution of generative video foundation models has propelled the field toward professional-grade cinematic synthesis. To achieve such demanding quality, the community transitions towards Reinforcement Learning (RL) and agentic workflows. However, reliable evaluation has emerged as a critical bottleneck. Existing benchmarks predominantly evaluate ‘’whether it is right’’ (basic prompt-following) while fundamentally neglecting ‘’whether it is good’’ (cinematic quality, acting, and aesthetics). Furthermore, current automated metrics lack the domain-specific rigor required to provide trustworthy signals, creating a severe credibility gap between human aesthetic perception and machine scoring. To bridge this gap, we introduce EvalVerse, a comprehensive, pipeline-aware, and expert-calibrated evaluation framework. We treat video generation assessment not merely as an engineering task, but as a core scientific problem: the systematic digitization of subjective cinematic expertise. First, we organize domain knowledge into an evaluation taxonomy aligned with the professional filmmaking workflow (pre-production, production, and post-production). Second, we distill human expert judgments into a curated dataset with large-scale human annotations. Third, we inject this knowledge into Vision-Language Models (VLMs) through an expert-calibrated fine-tuning strategy, enabling the VLM to perform explicit Chain-of-Thought reasoning. Compared to previous works, EvalVerse not only retains compatibility with foundational ‘’rightness’’ metrics, but also significantly expands the criteria to ‘’goodness’’ and broaden the task coverage to complex multi-shot sequencing and audio-visual integration. Consequently, by providing granular diagnostic signals, EvalVerse transcends a static leaderboard and establishes a fundamental infrastructure for future work, such as reward models and evaluator agent.

[44] U-CESE: Unified Clip-based Event Search Engine for AI Challenge HCMC 2025 cs.CVPDF

Duc-Nhuan Le, Hoang-Phuc Nguyen, Thanh-Duy Lam, Minh-Nhut Dang, Minh-Hoang Le

TL;DR: 本文提出了U-CESE，一个用于AI Challenge HCMC 2025的统一基于片段的视频事件搜索引擎。它通过整合三个核心模块——统一片段算法、轻量级关键帧提取方法DAKE以及时序一致的描述生成框架ReCap——来解决大规模视频数据集中复杂多模态事件检索的挑战。

Details

Motivation: 解决从大规模视频数据集中检索事件时，因复杂的时序、空间和多模态信息带来的挑战，旨在构建一个统一、高效且处理一致的多模态事件检索系统。

Result: 实验表明，U-CESE在大规模多模态事件检索任务中，能够提供鲁棒、一致且高效的性能。

Insight: 主要创新点包括：1) 将多个片段算法整合为一个统一高效的流水线；2) 提出DAKE，一种基于JPEG文件大小变化的轻量级、无需训练的关键帧提取方法；3) 引入受循环神经网络启发的ReCap框架，用于生成时序一致且上下文感知的详细文本描述。

Abstract: Retrieving events from large-scale video datasets is challenging due to complex temporal, spatial, and multimodal information. This paper presents U-CESE, our solution for the AI Challenge HCMC 2025, a Unified Clip-based Event Search Engine for multimodal event retrieval across diverse video sources. Building on CESE, U-CESE integrates its three modules into a single cohesive framework, ensuring consistent processing and retrieval across query types. A core component is the Unified Clipping Algorithm, which merges separate clipping algorithms into one efficient pipeline. To handle large-scale data, we propose DAKE, a lightweight, training-free keyframe extraction method using JPEG file size variations to identify significant scene changes. Finally, we introduce ReCap, a temporally consistent captioning framework inspired by Recurrent Neural Network, generating detailed and context-aware textual descriptions. Experiments show that U-CESE delivers robust, consistent, and efficient performance in large-scale multimodal event retrieval.

[45] LangFlash: Feed-forward 3D Language Gaussian Splatting from Sparse Unposed Images cs.CVPDF

Yilong Liu, Wanhua Li, Chen Zhu-Tian, Hanspeter Pfister

TL;DR: LangFlash是一个前馈式3D语言高斯泼溅框架，能够从稀疏无位姿的多视角图像中重建出由高斯基元参数化的3D场景，这些基元富含语言对齐的语义特征。该方法通过单次前向传播直接预测几何和语义，实现了低延迟的3D重建和语言一致的场景理解。

Details

Motivation: 旨在解决基于优化的3D方法速度慢的问题，并实现从稀疏、无相机位姿的图像中进行快速、语义一致的3D场景重建。

Result: 实验结果表明，在RealEstate10k数据集上，LangFlash在新视角合成和语义一致性方面优于先前方法。

Insight: 创新点在于提出了一个前馈式框架以实现快速重建，并设计了一种结合全局语义字典和局部可变权重的稀疏语义编码方案，在保留高层次语言信息的同时降低了表示复杂度，为无位姿、基于语言的3D重建建立了新范式。

Abstract: We present LangFlash, a feed-forward framework for 3D Language Gaussian Splatting that reconstructs 3D scenes parameterized by Gaussian primitives enriched with language-aligned semantic features from sparse unposed multi-view images. Unlike optimization-based 3D methods, LangFlash directly predicts the geometry and semantics in a single forward pass, enabling low-latency 3D reconstruction and language-consistent scene understanding. To support large-scale training, we enriched the RealEstate10k dataset with coherent and dense semantic information for 3D semantic supervision. Furthermore, we propose a sparse semantic encoding scheme that combines a global semantic dictionary with locally varying per-primitive weights, preserving high-level linguistic information, while reducing representation complexity. Experimental results show that LangFlash achieves superior novel view synthesis and semantic consistency compared with previous methods. This study establishes a new paradigm for pose-free, language-grounded 3D scene reconstruction, advancing generalizable 3D vision and multimodal scene understanding. Demo is available at https://liylo.github.io/langflash.github.io/.

[46] DepthAgent: Towards Better Universal Depth Estimation via Sample-wise Expert Selection cs.CVPDF

Jie Zhu, Girish Chandar Ganesan, Xiaoming Liu

TL;DR: 本文提出DepthAgent，一种基于样本级专家选择的通用单目深度估计方法。该方法将现有深度模型视为冻结工具，通过视觉-语言代理分析场景和相机线索，动态调用并融合多个专家模型的预测结果，以提升跨不同相机设置（如透视、鱼眼、全景图像）的鲁棒性。

Details

Motivation: 现有单目深度估计方法通常依赖单一深度估计器，忽略了不同模型编码了不同的相机假设，在不同输入域下表现最佳。研究发现深度专家模型在样本层面存在强互补性，模型偏好与相机几何高度相关，多模型融合在个体专家不可靠的困难样本上带来最大增益。

Result: 在透视、鱼眼和全景基准测试上的广泛实验表明，DepthAgent一致优于个体专家、固定模型融合及不同选择策略，在挑战性样本上实现了显著改进。

Insight: 创新点在于提出了一种基于强化学习的样本级专家选择与融合框架，通过多奖励强化微调方案联合优化工具执行有效性、相机/场景分析质量、专家选择质量和推理效率，实现了对离散决策过程的端到端优化，提升了跨相机设置的深度估计鲁棒性。

Abstract: Monocular metric depth estimation has achieved strong progress with large-scale training and universal-camera modeling, yet robust deployment across diverse camera settings, such as perspective, fisheye, and panoramic images, remains challenging. Existing methods typically rely on a single depth estimator, overlooking that different models encode different camera assumptions and perform best under different input domains. In this paper, we show that depth experts exhibit strong sample-wise complementarity: model preference is highly correlated with camera geometry, and multi-model fusion brings the largest gains on difficult samples where individual experts are unreliable. Motivated by these observations, we propose \textbf{\ours}, a vision-language agent for adaptive monocular depth estimation. DepthAgent treats existing depth models as frozen tools and learns to analyze scene and camera cues, invoke suitable experts through multi-turn tool utilization, and select or fuse their predictions for each input. To optimize such discrete decision-making toward dense geometric quality, we design a multi-reward reinforcement fine-tuning scheme that jointly encourages valid tool execution, camera/scene analysis, expert-selection quality, and inference efficiency. Extensive experiments across perspective, fisheye, and panoramic benchmarks show that \ours consistently outperforms individual experts, fixed model fusion, and different selection strategies, with strong improvements on challenging samples, highlighting the critical role of expert selection and fusion. The code and model will be released upon publication.

[47] Spatio-Temporal Similarity Volume Aggregation for Open-Vocabulary Action Recognition cs.CVPDF

Yerim So, Jiyeong Kim, Jiwon Yoon, Dongbo Min

TL;DR: 本文提出了一种名为相似性体积聚合（SimVA）的框架，用于开放词汇动作识别。该方法通过构建一个密集的4D时空相似性体积来聚合局部视频片段与文本的相似度，并利用空间聚合、运动感知调制和基于Mamba的时序聚合来精炼特征，从而有效迁移CLIP模型到视频动作识别任务中。

Details

Motivation: 现有开放词汇动作识别方法通常在计算文本对齐前将视觉特征聚合为全局表示，这掩盖了局部片段信息和细粒度的时空线索。本文旨在解决这一问题，通过保留密集的视觉-文本对应关系来提升识别性能。

Result: SimVA在零样本、少样本以及基础到新类别的基准测试上均取得了有竞争力的性能，表明其能有效迁移CLIP模型。

Insight: 创新点在于构建了局部视频片段与动作类别的时空相似性体积，并通过类采样、空间上下文聚合、运动感知调制和高效的时序建模（Mamba）来精炼和扩展该方法，实现了对细粒度时空线索的保留和大词汇量的可扩展处理。

Abstract: Recent Open-Vocabulary Action Recognition (OVAR) methods typically aggregate visual features into a global representation before computing text alignment, a process that obscures local patch information and fine-grained spatio-temporal cues. We propose Similarity Volume Aggregation (SimVA), a framework that constructs a dense 4D spatio-temporal similarity volume from patch-level visual-text similarities. SimVA constructs a spatio-temporal similarity volume over local video tokens and action classes, and employs class sampling to ensure similarity aggregation scalable to large vocabularies. The similarity volume is refined by spatial aggregation, which contextualizes local similarity patterns to improve intra-frame consistency. Motion-aware modulation further injects inter-frame variation cues, highlighting dynamically changing regions. Mamba-based temporal aggregation then models the evolution of class-conditioned similarity patterns across frames. By maintaining dense visual-text correspondence, SimVA effectively transfers CLIP to video action recognition, achieving competitive performance across zero-shot, few-shot, and base-to-novel benchmarks.

[48] General Hazard Detection cs.CVPDF

Stephanie Ng, CP Lim, SueJen Looi, Hendrik Zurlinden, David Nguyen

TL;DR: 本文提出了CompliVision数据集和基准框架，用于解决基于规则的危险检测问题。核心创新是将危险概念从图像示例中解耦，通过语言规则表达安全要求，并利用主动学习框架增强视觉语言模型在细粒度安全评估中的泛化能力。

Details

Motivation: 现有危险检测系统依赖预定义类别和大量标注数据，难以处理抽象安全概念面临的训练数据噪声稀疏、定义动态演变以及泛化能力有限三大挑战。

Result: 在涵盖交通、建筑和仓库环境的3,006张图像组成的CompliVision数据集上，结合LLaVA视觉推理与人在环反馈的框架，旨在提升模型在细粒度、上下文依赖的安全评估中的性能，但摘要未提及具体定量结果或基准对比。

Insight: 创新点在于通过语言规则（基于权威法规和ISO标准）形式化危险概念，构建首个用于合规性评估的通用危险数据集，并采用主动学习机制迭代优化视觉语言模型，以应对安全领域动态、抽象的推理需求。

Abstract: Hazard, as an abstract concept, is typically defined through cognitive-level logical reasoning rather than concrete examples. In contrast, existing hazard detection systems rely on predefined hazard categories and require intensive collection of labelled examples within detection or classification architectures. This approach faces three fundamental challenges when addressing abstract safety concepts: (1) noisy and sparse training data, (2) dynamically evolving definitions that change across contexts and time, and (3) limited generalisation to unseen or novel scenarios. To address these limitations, we present the CompliVision dataset, the first general-purpose hazard dataset designed for rule-based compliance assessment, along with a baseline framework for hazard evaluation. Our key innovation is decoupling the hazard concept from image-based examples by expressing safety requirements through language-based rules. We ground our approach in authoritative domain regulations and ISO standards to define diverse hazard concepts across multiple domains. The CompliVision dataset comprises 3,006 images spanning traffic, construction, and warehouse environments, with each image annotated for compliance against specific safety rules, accompanied by natural language explanations highlighting the supporting visual evidence. To achieve robust generalisation, we develop an active learning framework to more effectively guide and refine vision-language models in assessing hazard compliance. While state-of-the-art VLMs demonstrate strong capabilities, they struggle with the fine-grained, context-dependent interpretation required for accurate safety assessment. We proposed a general hazard detection framework to address this limitation which combines LLaVA-based visual reasoning with with human-in-the-loop feedback.

Tiancheng Wang, Zhaolu Ding, Richeng Xu, Tianhui Zheng, Hui Liu

TL;DR: 论文提出了一种名为GFSR（几何保真度与空间细化）的可靠车道线检测框架，旨在解决现有方法在复杂真实场景中性能下降的问题。该框架包含两个核心模块：LaneIoU引导的置信度校准（LCC）和自适应门控位置细化（AGLR）。LCC通过融合分类置信度和几何保真度来构建协同可靠性指数，以改进过滤和后处理；AGLR则通过门控机制自适应调整采样点偏移，增强点间相关性以优化复杂车道线的检测。

Details

Motivation: 现有车道线检测方法在复杂真实场景中性能下降，主要受限于两个问题：一是分类置信度仅表征类别存在性，与几何质量强相关性弱，导致基于置信度的过滤可能淘汰几何质量好但置信度低的车道线；二是现有回归模块弱化了采样点间的相关性，阻碍了对远处、高曲率和复杂拓扑车道线的细粒度优化，导致欠拟合。

Result: 在CULane和CurveLanes基准上的大量实验表明，GFSR在CULane上达到了最先进的性能，F1@50和F1@75分数分别为81.46%和65.01%；在CurveLanes上达到了87.35%的F1@50分数。

Insight: 论文的创新点在于引入了LaneIoU作为几何保真度的软监督，并与分类置信度融合构建协同可靠性指数，以更可靠地指导后处理；同时，设计了自适应门控位置细化模块，通过门控机制增强采样点间相关性，提升模型对复杂车道场景的适应性和鲁棒性。从客观角度看，这种将几何质量显式建模并与分类置信度协同的思路，以及利用门控机制进行自适应细化的方法，为提升车道线检测的可靠性和精度提供了有效途径。

Abstract: Lane detection stands as a crucial perception task in autonomous driving and advanced driver assistance systems. However, existing methods still degrade in complex real scenarios due to two major limitations. First, classification confidence only characterizes the categorical existence of lane candidates and has no strong correlation with geometric quality. If threshold filtering and NMS are conducted merely based on this confidence, the model tends to retain lane priors with high confidence while eliminating those with lower confidence but superior geometric representation. Secondly, existing regression modules weaken correlations among sampling points, hindering fine-grained optimization of distant, high-curvature and complex-topology lanes and causing underfitting. To address these issues, we propose Geometric Fidelity and Spatial Refinement (GFSR), a framework consisting of LaneIoU-guided Confidence Calibration (LCC) and Adaptive Gated Location Refinement (AGLR). Specifically, LCC adopts LaneIoU as soft supervision to explicitly estimate geometric fidelity of lane priors, which is further fused with classification confidence to construct the collaborative reliability index (CRI). This index guides threshold filtering and NMS, effectively retaining lane priors with high classification confidence and favorable geometric quality. Meanwhile, cooperating with regression heads in each refinement stage, AGLR predicts sampling point lateral offsets and adopts a gating mechanism to adaptively regulate correction magnitude, strengthen inter-point correlations and boost model adaptability as well as robustness toward complex lane scenarios. Extensive experiments on CULane and CurveLanes demonstrate that our GFSR achieves state-of-the-art performance on CULane, with F1@50 and F1@75 scores of 81.46% and 65.01%, and reaches 87.35% F1@50 on CurveLanes.

[50] CHASD: Language Increment-Calibrated Contrastive Decoding against Hallucination in LVLMs cs.CV | cs.AIPDF

Xiaoyi Huang, Kejia Zhang, Zhiming Luo

TL;DR: 本文提出了一种名为CHASD的推理时框架，用于缓解大型视觉语言模型中的物体幻觉问题。该方法通过不确定性驱动的置信门控，仅在需要时激活对比分支，并利用注意力引导的局部视觉扰动构建负分支，从而在保持推理效率的同时减少幻觉。

Details

Motivation: 现有无需训练的对比解码方法要么使用可能改变有用视觉证据的全局扰动，要么在每个解码步骤都调用额外的负分支，效率较低且可能引入干扰。本文观察到幻觉风险是瞬态且特定于令牌的，因此旨在设计一个按需校准的推理框架。

Result: 在POPE、AMBER、MME、MMHal-Bench和CHAIR等多个基准测试上的实验表明，CHASD在幻觉相关指标上优于强大的无需训练基线方法，同时保持了有竞争力的推理效率。

Insight: 核心创新在于提出了幻觉风险是瞬态和令牌特定的观察，并据此设计了不确定性驱动的置信门控和注意力引导的局部视觉扰动策略，实现了高效的按需对比解码，避免了不必要的计算开销。

Abstract: Large Vision-Language Models have shown strong multimodal reasoning capabilities, yet they remain susceptible to object hallucinations when language priors dominate insufficient or misaligned visual evidence. Training-free contrastive decoding methods mitigate this issue by comparing predictions from original and perturbed visual inputs, but existing approaches either apply global perturbations that may alter useful visual evidence or invoke an additional negative branch at every decoding step. In this paper, we observe that hallucination risks are transient and token-specific: visual attention shifts across generated tokens, while some functional tokens are produced with high confidence and do not require contrastive calibration. Based on this observation, we propose Contrastive Hallucination-Aware Step-wise Decoding (CHASD) for Large Vision-Language Models, an inference-time framework for “calibration on demand”. CHASD uses an uncertainty-driven confidence gate to activate the contrastive branch only when the maximum probability of the next-token is less than the threshold, and constructs the negative branch through attention-guided localized perturbations of the currently salient visual tokens. This design reduces unnecessary negative-branch forward passes while preserving the original distribution for high-confidence steps. Experiments on POPE, AMBER, MME, MMHal-Bench, and CHAIR show that CHASD improves hallucination-related metrics over strong training-free baselines with competitive inference efficiency.

[51] SCOPE: Simulating Cross-game Operations in Playable Environments for FPS World Models cs.CVPDF

Zizhao Tong, Hongfeng Lai, Zeqing Wang, Zhaohu Xing, Kexu Cheng

TL;DR: 本文提出SCOPE方法，通过改造预训练视频扩散模型，在Transformer块中插入条件模块，将特征重塑为逐像素时间序列，使每个位置根据局部视觉内容计算动作响应，从而分离FPS游戏中武器作用区域（scope）内外的生成效果。同时构建首个多游戏FPS数据集CrossFPS，包含7款游戏的6.9万段帧对齐动作遥测剪辑，支持零样本跨场景迁移。

Details

Motivation: 现有第一人称射击游戏交互世界模型通常全局注入动作并在单一游戏上训练，无法处理密集的FPS输入，因为FPS动作具有空间选择性：离散事件（如开火、装弹）仅影响武器周围的局部区域，而连续相机和移动信号控制稳定环境。

Result: 实验证实该方法在CrossFPS数据集上表现出强大的动作响应能力、精确的作用区域分离效果以及有效的跨游戏泛化性能。

Insight: 创新点在于提出空间选择性动作建模框架，无需分割标签即可分离作用区域内外的生成；通过构建多游戏数据集促进通用视觉-动作映射学习，而非游戏特定模式，实现零样本迁移。

Abstract: Interactive world models for first-person shooter (FPS) games must resolve high-frequency overlapping control signals at every frame without disrupting unaffected regions. Existing methods inject actions globally and train on single titles, failing under dense FPS inputs. We observe that FPS actions are spatially selective: discrete events such as firing or reloading affect only a localized region around the weapon (the scope), while continuous camera and movement signals govern stable surroundings. We propose SCOPE, which inserts a conditioning module into each transformer block of a pretrained video diffusion model. It reshapes features into per-pixel temporal sequences so that each position computes its action response from local visual content. This separates in-scope effects from out-of-scope generation without segmentation labels. We also introduce CrossFPS, the first multi-game FPS dataset with frame-aligned action telemetry. It comprises 69K clips from 7 titles with 10-DoF controller signals, curated to remove gameplay bias. The model learns general visual-to-action mappings rather than game-specific patterns, enabling zero-shot transfer to unseen scenes. Experiments confirm strong action responsiveness, precise scope separation, and effective cross-game generalization.

[52] Decoupling Spatio-Temporal Adapter for Fine-Grained Badminton Action Localization cs.CV | cs.LG | cs.MMPDF

Tianyu Wang, Junjie Wu, Jingquan Gao, Shishuo Li

TL;DR: 本文针对专业羽毛球视频中的细粒度时序动作定位问题，提出了一个名为Fine-Badminton的新基准数据集，并设计了一种解耦时空适配器（DSTA）。该方法通过将运动表征分解为三个并行分支来分别捕获时间动态以及垂直和水平的空间变化，从而有效建模复杂微妙的时空动态。在Fine-Badminton和ShuttleSet基准上的大量实验表明，该方法以极小的计算和参数成本增加实现了最先进的性能。

Details

Motivation: 通用视频理解中的时序动作定位已被广泛研究，但像专业羽毛球这样的细粒度体育场景，由于其复杂微妙的时空动态，仍未得到充分探索。本文旨在解决专业羽毛球视频中细粒度动作的精准定位问题。

Result: 在提出的Fine-Badminton数据集和ShuttleSet基准上进行了广泛实验。结果表明，所提出的方法实现了最先进的性能，同时仅引入了边际的计算和参数成本增加。

Insight: 主要创新点在于提出了一个专门用于细粒度体育动作定位的新基准数据集（Fine-Badminton），以及一种参数高效的解耦时空适配器（DSTA）。DSTA通过将运动表征解耦为三个并行分支（时间、垂直空间、水平空间）来分别建模不同维度的变化，这种设计使模型能更好地区分细粒度动作间的细微差异，是一种高效且有效的架构创新。

Abstract: Temporal Action Localization (TAL) has been extensively studied in generic video understanding, while fine-grained sports scenarios, such as professional badminton, remain underexplored due to their complex and subtle spatio-temporal dynamics. In this paper, we focus on fine-grained TAL in professional badminton videos and introduce a new benchmark dataset, Fine-Badminton, which consists of 31 matches with 29 fine-grained stroke categories, covering 2104 rallies and 27597 annotated actions. To effectively capture the intricate motion patterns in such scenarios, we propose a Decoupling Spatio-Temporal Adapter (DSTA), which enables efficient modeling of spatio-temporal features within a parameter-efficient framework. Specifically, DSTA decomposes motion representation into three parallel branches, capturing temporal dynamics as well as vertical and horizontal spatial variations. The design allows the model to better distinguish subtle differences among fine-grained actions. Extensive experiments on both the Fine-Badminton dataset and the ShuttleSet benchmark demonstrate that the proposed method achieves state-of-the-art performance while introducing only a marginal increase in computational and parameter cost. These results validate the effectiveness and efficiency of the proposed approach for fine-grained temporal action localization.

[53] VDE: Training-Free Accelerating Rectified Flow Model via Velocity Decomposition and Estimation cs.CVPDF

Junwen Tan, Jinglin Liang, Hongyuan Chen, Shuangping Huang

TL;DR: 本文提出了一种名为VDE（Velocity Decomposition and Estimation）的训练免费加速方法，用于加速整流流模型（Rectified Flow）的推理过程。该方法通过将模型的速度场分解为平行于输入和正交于输入的分量，并利用其时间可预测性和方向稳定性进行估计，从而避免了传统缓存重用方法导致的输入失配问题，并通过周期性全前向传递来锚定模型状态以防止误差累积。

Details

Motivation: 整流流模型在图像、视频和3D生成方面表现出色，但其推理速度慢，阻碍了实际部署。现有的加速方法（如缓存重用）忽略了静态缓存与演化输入之间日益增长的失配问题，导致输出保真度下降。

Result: 在图像和视频生成任务上的大量实验表明，VDE能以最小的视觉质量损失实现显著加速。具体而言，VDE将Flux模型加速了3.22倍，并在Qwen-Image上实现了0.069的LPIPS分数，优于最佳基线，减少了52.2%的损失。

Insight: 核心创新在于将加速范式从“缓存-重用”转变为“分解-估计”，通过速度分解和自适应估计来保持输出质量。周期性全前向传递作为锚点，有效控制了误差累积，这是一种无需重新训练即可实现高效加速的通用策略。

Abstract: Though rectified flow models have achieved remarkable performance in image, video, and 3D generation, their practical deployments are challenged by slow inference speeds. Prior acceleration methods reuse cached features from previous steps, which neglects the growing mismatch between static caches and the evolving input, leading to reduced output fidelity. This work proposes Velocity Decomposition and Estimation (VDE), a training-free acceleration method that shifts the paradigm from caching-and-reusing to decomposing-and-estimating. Specifically, VDE decomposes the model’s velocity into components parallel and orthogonal to the input, exploiting their temporal predictability and directional stability for precise, input-adaptive estimation. To prevent error accumulation, it periodically anchors the model’s state via full forward passes. Extensive experiments on image and video generation tasks demonstrate that VDE achieves substantial acceleration with minimal loss in visual quality. Notably, VDE accelerates Flux by 3.22 times and achieves an LPIPS of 0.069 on Qwen-Image, outperforming the best baseline with a 52.2% reduction.

[54] Online Hand Gesture Recognition Using 3D Convolutional Neural Networks cs.CV | cs.AIPDF

Yinghao Qin, Tijana Timotijevic

TL;DR: 本文提出了一种基于3D卷积神经网络的在线手势识别系统，能够在实时视频流中定位手势并识别其类别。该系统采用滑动窗口方法提升鲁棒性，在Jester数据库上训练，检测器准确率超过98%，分类器准确率超过90%。在自建数据集上，最佳组别响应时间小于3秒，Levenshtein准确率达到37.5%。

Details

Motivation: 解决人机交互中动态手势实时检测与分类的挑战，包括实时视频流处理无延迟响应需求，以及不同用户手势执行差异大导致的识别困难。

Result: 在Jester数据库上，检测器准确率98%以上，分类器准确率90%以上；在自建数据集上，最佳组别响应时间小于3秒，Levenshtein准确率37.5%。

Insight: 创新点在于结合3D CNN与滑动窗口方法实现实时手势定位与识别，提升系统鲁棒性；客观分析其将时序建模与多窗口结果融合的策略，适用于动态手势的在线识别场景。

Abstract: In human computer interaction, real-time detection and classification of dynamic hand gestures is challenging as: 1) the system must run in a real-time video stream and there is no noticeable lag in response after performing a gesture; 2) there is a large difference in how people perform gestures, making recognition more difficult. In this paper, an online hand gesture recognition system is proposed, which is able to localize gestures in real-time video stream and recognize what these gestures are. To improve the robustness of the system, the sliding window approach is used to refine results from multiple windows. All of the models in my project are trained on Jester database, achieving 98+% accuracy for detector and 90+% accuracy for classifier. For the overall performance of the system, the best group can respond within three seconds and reach 37.5% Levenshtein accuracy on the homemade dataset. The project codes used in this work are publicly available.

[55] RS2AD-LiDAR: End-to-End Autonomous Driving LiDAR Data Generation from Roadside Sensor Observations cs.CVPDF

Runyi Huang, Ni Ding, Ruidan Xing, Yuheng Shi, Lei He

TL;DR: 本文提出RS2AD-LiDAR框架，旨在从路侧传感器观测数据中重建和生成车载激光雷达数据，以解决端到端自动驾驶方案中单车辆数据采集成本高、场景稀缺和数据孤岛等问题。该方法通过坐标变换、虚拟激光雷达建模和点云重采样技术合成高保真车载数据，并构建了专用评估数据集R2V-LiDAR。实验表明生成数据与真实数据语义相似，且用于训练能提升BEV和3D目标检测精度。

Details

Motivation: 当前端到端自动驾驶方法依赖单车辆数据收集，存在采集标注成本高、有价值场景稀缺以及数据孤岛等挑战，因此需要一种从路侧传感器生成车载激光雷达数据的新方案。

Result: 实验证明生成数据与真实数据在语义上高度相似；在目标检测任务中，将生成数据与真实数据结合训练，提升了鸟瞰图和3D检测的准确率，验证了方法的有效性。

Insight: 创新点在于首次提出从路侧传感器输入重建车载激光雷达数据的方法，通过虚拟激光雷达建模和点云重采样技术实现数据生成，为解决自动驾驶数据瓶颈提供了新思路。

Abstract: End-to-end autonomous driving solutions, which directly process multimodal sensory data and output fine-grained control commands, have gradually become a mainstream direction with the development of autonomous driving technology. However, current methods in this category rely on single-vehicle data collection for model training and optimization, which suffers from high acquisition and annotation costs, scarcity of valuable scenarios, and data silos. To address these challenges, we propose RS2AD-LiDAR, a novel framework for reconstructing and generating vehicle-mounted LiDAR data from roadside sensor observations. Since no public dataset currently provides highly overlapping perception coverage between roadside and vehicle-mounted LiDAR sensors, which is essential for studying roadside-to-vehicle data generation, we constructed a dedicated dataset named R2V-LiDAR which is used solely for evaluation in this work. Specifically, our method transforms roadside LiDAR point clouds into the vehicle-mounted LiDAR coordinate system, and synthesizes high-fidelity vehicle-mounted data via virtual LiDAR modeling and point cloud resampling techniques. To the best of our knowledge, this is the first approach to reconstruct vehicle-mounted LiDAR data from roadside sensor inputs. Extensive experimental comparisons demonstrate the semantic similarity between the generated data and real data. Furthermore, object detection experiments show that incorporating the generated data into real data for model training improves both Bird’s Eye View (BEV) and 3D detection accuracy, thereby validating the effectiveness of the proposed method.

[56] Joint Target-Less Intrinsic and Extrinsic Camera-LiDAR Calibration using Deep Point Correspondences cs.CVPDF

Simon Bultmann, Daniele Cattaneo, Abhinav Valada

TL;DR: 本文提出了一种无需标定板的联合相机-LiDAR标定方法，首次实现了在未知相机内参（包括畸变）的情况下，仅通过深度像素-点云对应关系同时估计相机内参（针孔模型与径向切向畸变）和外参。该方法通过运动恢复结构自动初始化内参、将匹配推广至原始图像，并紧密耦合对应关系估计与非线性优化。

Details

Motivation: 现有基于深度点对应的无目标外参标定方法性能优异，但假设图像已校正且内参已知，这限制了其在实际未标定相机中的应用。本文旨在克服这一限制，实现完全无需标定板的联合内外参标定。

Result: 在KITTI数据集上对未见过的相机-LiDAR对进行评估，结果表明联合标定在提高外参精度的同时，还能准确恢复相机内参。

Insight: 创新点在于将深度对应关系标定框架扩展至联合优化，通过运动恢复结构自动初始化内参、处理原始畸变图像，以及紧密耦合对应估计与非线性优化，实现了完全无目标且不依赖已知内参的标定流程。

Abstract: Accurate camera-LiDAR calibration is a prerequisite for robust multi-modal perception in robotics. Recent target-less approaches based on deep point correspondences achieve remarkable performance for extrinsic calibration but assume rectified images with known intrinsics. In this work, we overcome this limitation and present the first fully target-less pipeline that jointly estimates camera intrinsics (pinhole model with radial-tangential distortion) and camera-LiDAR extrinsics with deep pixel-point correspondences. Our approach extends deep correspondence-based calibration by (i) automatic intrinsic initialization via structure-from-motion, (ii) generalizing camera-LiDAR matching to raw images with unknown intrinsics including distortion, and (iii) tightly coupling correspondence estimation with joint nonlinear optimization over both intrinsics and extrinsics. We evaluate our method on the KITTI dataset with unseen camera-LiDAR pairs and demonstrate that joint calibration achieves improved extrinsic accuracy while additionally recovering accurate intrinsics.

[57] FAST-ME: Foundation-aware Adaptive Stopping for Motion Estimation for Efficient IoT Video Analysis cs.CV | cs.MMPDF

Kakia Panagidi, Stathes Hadjieftymiadis

TL;DR: 本文提出了一种基于最优停止理论（OST）和基础模型（FMs）的语义感知运动估计框架FAST-ME，用于高效物联网视频分析。该框架通过融合传统失真度量（如SAD）与从视觉基础模型（如ViT和SAM）提取的语义注意力分数，形成混合停止准则，从而在冗余区域提前停止搜索，在语义重要区域继续搜索，以降低计算成本。

Details

Motivation: 解决在资源受限的物联网环境中，视频压缩与理解的关键瓶颈——块运动估计（ME）计算成本高昂的问题，旨在实现高效的多模态视频处理。

Result: 在基准和多模态视频数据集上的实验表明，所提方法在保证最小精度损失和提升语义覆盖度的前提下，显著降低了计算量。

Insight: 创新点在于将低层运动分析与高层语义推理相结合，利用预训练视觉基础模型提供的语义注意力来指导运动估计的停止决策，为下一代智能系统中的高效多模态视频理解提供了新方向。

Abstract: In modern multimedia systems, efficient video processing is critical, especially in resource-constrained environments such as IoT-based camera networks, autonomous platforms, and wireless sensor multimedia systems. A key bottleneck in video compression and understanding is block motion estimation (ME), a process that remains computationally expensive despite the development of fast search techniques. This work introduces an Optimal Stopping Theory (OST) algorithm for block motion estimation based on the assessment of spatiotemporal differences within and across video frames. It also proposes a semantic-aware motion estimation framework that integrates Foundation Models (FMs) with the OST-based decision process. By leveraging pretrained visual models such as Vision Transformers (ViT) and the Segment Anything Model (SAM), the framework extracts semantic attention scores that indicate the importance of motion within specific spatial regions. These scores are fused with traditional distortion-based metrics, such as the Sum of Absolute Differences (SAD), to guide a hybrid stopping criterion that jointly considers motion magnitude and semantic relevance. The resulting adaptive algorithm stops early in redundant regions while continuing the search in areas where motion is semantically significant. Experiments compare the proposed solution with widely used approaches from the literature on benchmark and multimodal video datasets. The proposed method achieves a significant reduction in computation with minimal accuracy loss and improved semantic coverage. The results highlight the benefits of bridging low-level motion analysis with high-level semantic reasoning, offering a promising direction for efficient multimodal video understanding in next-generation smart systems.

[58] DFSAttn: Dynamic Fine-grained Sparse Attention for Efficient Video Generation cs.CVPDF

Jie Hu, Zixiang Gao, Yutong He, Kun Yuan

TL;DR: 本文提出DFSAttn，一种用于高效视频生成的动态细粒度稀疏注意力框架。它通过希尔伯特曲线令牌重排、分层块评分和自适应稀疏掩码缓存三个核心设计，解决了现有块稀疏注意力方法在扩散Transformer中因注意力图动态细粒度稀疏特性而导致的质量下降问题。

Details

Motivation: 扩散Transformer在高质量视频生成中取得了显著成功，但其依赖的时空3D全注意力机制因二次复杂度带来了极高的计算成本。现有块稀疏注意力方法在处理扩散Transformer中固有的动态细粒度稀疏注意力图时，尤其是在高稀疏率下，会导致生成质量显著下降。

Result: 实验结果表明，DFSAttn在高稀疏率下持续优于现有方法，实现了高达2.1倍的端到端加速，同时保持了高生成质量。

Insight: 论文的创新点在于从理论上推导了注意力召回率的下界以指导设计，并提出了一个无需训练、支持动态细粒度稀疏化的高效框架。其核心设计（希尔伯特曲线重排、分层块评分、自适应掩码缓存）在保证GPU执行效率的同时，实现了更精确的稀疏化，平衡了准确性与效率。

Abstract: Diffusion transformers have achieved remarkable success in high-quality video generation, yet their reliance on spatiotemporal 3D full attention incurs prohibitive computational cost due to the quadratic complexity of attention. Block sparse attention is a common approach to mitigate this by focusing computation on important regions. However, attention maps in DiTs exhibit inherently dynamic and fine-grained sparsity, which causes existing block sparse attention methods to degrade significantly in quality, especially at high sparsity ratios. In this paper, we revisit block sparse attention and derive a theoretical lower bound on attention recall to characterize the key factors governing its effectiveness. Guided by these insights, we propose DFSAttn, a training-free sparse attention framework that enables dynamic, fine-grained sparsification efficiently. DFSAttn incorporates three core designs: Hilbert curve-based token reordering to achieve fine-grained sparsity while preserving efficient GPU execution, hierarchical block scoring for accurate block importance estimation, and sparse mask caching with adaptive ratios to balance accuracy and efficiency. Experimental results demonstrate that DFSAttn consistently outperforms prior methods under high sparsity, achieving up to 2.1$\times$ end-to-end speedup while maintaining high generation quality. Our code is open-sourced and available at https://github.com/jessica-hujie/DFSAttn.

[59] One-Forcing: Towards Stable One-Step Autoregressive Video Generation cs.CV | cs.AIPDF

Jiaqi Feng, Justin Cui, Yuanhao Ban, Cho-Jui Hsieh

TL;DR: 本文提出了一种名为One-Forcing的新方法，旨在实现高质量且高效的单步自回归视频生成。该方法通过将DMD（去噪扩散模型蒸馏）目标与辅助的GAN损失相结合，解决了现有方法在减少采样步数时出现的动态性弱或画面模糊等问题。实验表明，该方法在VBench基准测试中取得了SOTA性能，并且能以更低的训练成本实现稳定的逐帧自回归生成。

Details

Motivation: 现有的少步自回归视频生成方法（通常从多步教师模型蒸馏而来）在部署时仍有较大延迟，且在进一步减少采样步数（尤其是单步设置）时会出现严重的质量下降。轨迹式一致性蒸馏方法生成的视频动态性弱，而基于DMD的方法（如Self-Forcing）则倾向于产生模糊帧。

Result: 在VBench基准测试中，One-Forcing取得了83.76的总分，在单步因果视频生成方法中达到了最先进的（SOTA）性能，并与强大的多步方法保持竞争力。此外，该方法能以仅块状模型三分之一训练成本，稳定实现单步逐帧自回归生成，这是先前方法未能成功实现的。

Insight: 核心创新点在于将DMD蒸馏目标与辅助GAN损失相结合，以同时保证生成视频的高质量和动态稳定性。从客观角度看，这种混合损失设计是一种简单而有效的策略，它巧妙地结合了两种范式的优势，为解决单步视频生成中的质量与动态性权衡问题提供了新思路，并且显著降低了训练成本。

Abstract: Recent advances have substantially improved real-time interactive video generation in the autoregressive regime. However, most existing few-step autoregressive video generation methods, often distilled from a corresponding many-step teacher, default to a 4-step sampling configuration, which still incurs considerable latency during deployment and suffers from severe quality degradation when the number of sampling steps is further reduced, particularly in the one-step setting. Trajectory-style consistency distillation methods often produce videos with weak dynamics, while DMD-based approaches, such as Self-Forcing, tend to yield blurry frames. To address this challenge, we propose One-Forcing, a simple yet effective approach which augments the DMD objective with an auxiliary GAN loss for high-quality and efficient one-step video generation. Experiments on VBench show that One-Forcing achieves a total score of 83.76, establishing state-of-the-art performance among one-step causal video generation methods and remaining competitive with strong many-step approaches. We further demonstrate that one-step framewise autoregressive generation can be achieved stably with merely one-third of the training cost of the chunkwise model, a setting that prior methods have failed to achieve successfully.

[60] Rethinking Transfer Learning for Industrial Inspection: DINOv3 vs. ImageNet Pretraining Across RGB and X-ray Tasks cs.CVPDF

Mehdi Gharbage, Céline Teulière, Pierre Bouges, Thierry Chateau

TL;DR: 本文比较了基于监督ImageNet预训练和自监督DINOv3预训练的ConvNeXt骨干网络在工业视觉检测任务上的迁移性能，评估了它们在RGB表面缺陷检测和X射线缺陷检测中的语义分割、实例分割和目标检测任务上的表现。研究发现，在RGB任务上，DINOv3经过全微调后能提供更强的初始化，带来更快的收敛和更好的最终性能；但在X射线模态下，监督ImageNet预训练在冻结和微调设置下都更有效。

Details

Motivation: 工业视觉检测数据与网络数据差异大，且常需细粒度密集预测，因此研究现代自监督预训练（如DINOv3）是否优于传统的基于监督ImageNet初始化的迁移学习范式。

Result: 在RGB工业检测任务上，DINOv3在全微调后性能优于监督ImageNet预训练；在X射线缺陷检测中，监督ImageNet预训练在冻结和微调设置下均表现更好。实验基于四个下游数据集，涵盖语义分割、实例分割和目标检测任务。

Insight: 现代视觉基础模型（如DINOv3）在监督RGB工业检测中具有潜力，但其迁移能力强烈依赖于下游适应策略和目标模态；对于X射线等模态偏移，传统监督预训练仍更有效，这提示了模态对齐在迁移学习中的重要性。

Abstract: Vision foundation models pretrained on web-scale data have recently shown strong transfer capabilities on many downstream tasks, but their effectiveness for industrial visual inspection remains unclear. Industrial data differ substantially from web-data and often require fine-grained dense prediction, raising the question of whether modern self-supervised pretraining can improve over the conventional transfer-learning paradigm based on supervised ImageNet initialization. In this work, we compare ConvNeXt backbones pretrained with supervised ImageNet classification or DINOv3 distillation, and relate them to the conventional ResNet-50 baseline. We evaluate semantic segmentation, instance segmentation, and object detection across four downstream datasets spanning RGB surface-defect inspection and X-ray defect detection. We further study both frozen and fully finetuned adaptation regimes. Our results show that DINOv3 offers no clear advantage in frozen transfer, but provides a stronger initialization after full finetuning on RGB tasks, yielding faster convergence and better final performance. Under X-ray modality shift, however, supervised ImageNet pretraining remains more effective in both frozen and finetuned settings. Overall, our findings suggest that modern vision foundation models are promising for supervised RGB industrial inspection, but their transferability is strongly conditioned by downstream adaptation and target modality.

[61] B-GRTO: Bootstrapped Group Relative Tool Optimization for Referring Segmentation cs.CV | cs.LGPDF

Mario Markov, Stefan Maria Ailuro, Mohammad Mahdi, Luc Van Gool, Danda Pani Paudel

TL;DR: 本文提出了一种名为B-GRTO（Bootstrapped Group Relative Tool Optimization）的框架，用于联合优化视觉语言策略与可微分工具（如分割解码器），以解决指代分割任务。该方法通过重用GRPO（Group Relative Policy Optimization）的轨迹来优化辅助工具目标，并引入一种廉价的预训练方法（B-GRTO）来引导工具，从而加速收敛并提升性能。

Details

Motivation: 当前指代分割方法通常将大型视觉语言模型与分割解码器分开优化，其中解码器使用可微分目标训练，而策略优化则依赖强化学习。如何将可微分目标原则性地整合到强化学习中仍未被充分探索，因此本文旨在解决这一联合优化问题。

Result: 在三个具有挑战性的指代分割设置中，B-GRTO相比普通GRPO带来了显著改进，其性能匹配或超越了特定领域的SOTA方法。

Insight: 创新点在于提出了GRTO这一数学上严谨的框架，能够联合优化策略与可微分工具，并通过引导预训练（B-GRTO）有效提升训练效率和最终性能。这为强化学习与可微分辅助目标的统一提供了新思路，尤其适用于推理密集型的视觉任务。

Abstract: Segmentation is a fundamental task in computer vision, underpinning pixel-level scene understanding and serving as a cornerstone for applications ranging from autonomous perception to medical image analysis. For complex referring segmentation, recent methods pair large vision-language models with segmentation decoders: the former analyzes the image and prompt, while the latter predicts the target mask. Although reinforcement learning improves reasoning-intensive vision-language systems, trainable tools such as segmentation decoders are typically optimized separately with differentiable objectives, and the principled integration of such objectives into reinforcement learning remains underexplored. Thus, we introduce group relative tool optimization (GRTO), a mathematically grounded framework for jointly optimizing a policy with differentiable tool use. GRTO reuses group relative policy optimization (GRPO) rollouts to optimize the auxiliary tool objective, letting decoder gradients complement policy rewards. Further, we derive Bootstrapped-GRTO (B-GRTO), a pre-training method that cheaply bootstraps the tool, leading to faster convergence and superior performance. Across three challenging referring segmentation settings, B-GRTO results in substantial improvements over plain GRPO, matching or surpassing domain-specific state-of-the-art methods. This demonstrates the value of unifying reinforcement learning with differentiable auxiliary objectives for reasoning-intensive segmentation.

[62] Multimodal Distribution Matching for Vision-Language Dataset Distillation cs.CV | cs.AIPDF

Jongoh Jeong, Hoyong Kwon, Minseok Kim, Kuk-Jin Yoon

TL;DR: 本文提出了一种名为多模态分布匹配（MDM）的几何感知框架，用于高效且可泛化的多模态数据集蒸馏。该方法通过在数据、模型和损失三个层面整合互补组件，将大型视觉-语言训练集压缩为紧凑的合成数据集，同时保持下游性能。

Details

Motivation: 随着现代系统越来越多地处理成对的视觉-语言输入，多模态蒸馏需要在有限的计算和内存预算下保持表示质量和跨模态对齐，而现有方法往往计算量大且忽略了模态间的相关性。

Result: 在跨架构评估的图像-文本检索基准测试中，MDM生成的紧凑合成集保留了多模态语义，显著降低了蒸馏成本，并在不同架构间保持鲁棒性。

Insight: 创新点包括：在数据层面，通过从联合嵌入空间的聚类中采样来初始化合成图像-文本对；在模型层面，根据微调模型与预训练锚点的角度偏差在权重空间插值形成混合教师；在损失层面，使用几何感知匹配目标在单位超球面上匹配联合分布，利用跨模态一致性和差异方向的联合特征以及对称对比学习。

Abstract: Dataset distillation compresses large training sets into compact synthetic datasets while preserving downstream performance. As modern systems increasingly operate on paired vision-language inputs, multimodal distillation must preserve representation quality and cross-modal alignment under tight compute and memory budgets, yet prior methods often require heavy computes and overlook their correlations. To address this, we present Multimodal Distribution Matching (MDM), a geometry-aware framework for efficient and generalizable multimodal distillation. Specifically, MDM integrates complementary components at the data, model, and loss levels. At the data level, it initializes synthetic image-text pairs by sampling from clusters in the joint embedding space. At the model level, it forms a mixed teacher by interpolating independently fine-tuned models in weight space according to their angular deviation from the pretrained anchor. At the loss level, it matches joint distributions on the unit hypersphere using a geometry-aware matching objective that exploits the joint features in the cross-modal agreement and discrepancy directions along with symmetric contrastive learning. Across image-text retrieval benchmarks with cross-architecture evaluation, MDM yields compact synthetic sets that preserve multimodal semantics, substantially reduce distillation cost, and remain robust across architectures.

[63] MDS-DETR: DETR with Masked Duplicate Suppressor cs.CVPDF

Chanho Lee, Seunghee Koh, Yunho Jeon, Junmo Kim

TL;DR: 本文提出了MDS-DETR，一种改进的DETR目标检测器。它通过引入一个名为Masked Duplicate Suppressor (MDS)的模块，在单个解码器中同时利用一对一和一对多的监督信号，从而解决了原始DETR收敛慢和召回率低的问题，无需额外的查询或辅助解码器。

Details

Motivation: DETR的一对一匹配策略导致收敛慢和召回率低。现有使用一对多匹配作为辅助目标的方法会增加训练成本，且其辅助解码器在推理时被丢弃。本文旨在克服这一限制，在单一解码器框架内高效整合两种监督信号。

Result: 在MS COCO数据集上，使用ResNet-50骨干网络和12个训练周期，MDS-DETR比Deformable-DETR的mAP提升了2.8，训练时间仅增加5%；同时以+0.3 mAP的优势超越了当时最先进的MR.DETR，且训练速度快20%。

Insight: 核心创新点是提出了基于置信度的因果掩码机制（MDS），它通过向自注意力注入不对称性来过滤一对多监督层产生的重复预测。这使得模型能够在完全端到端的框架内生成可解释、无重复的预测，是一种高效整合不同监督信号的架构设计。

Abstract: The DEtection TRansformer (DETR) is a powerful end-to-end object detector, yet its one-to-one matching strategy suffers from slow convergence and low recall. A common approach to address this issue is to use one-to-many label assignment to provide more positive samples. However, existing methods that use one-to-many matching as an auxiliary objective lead to increased training costs, with their auxiliary decoders discarded during inference. To address this limitation, we propose MDS-DETR, which leverages both one-to-one and one-to-many supervision within a single decoder. Specifically, we introduce a Masked Duplicate Suppressor (MDS) that injects asymmetry into self-attention via confidence-based causal masking. MDS filters out the duplicates generated by the one-to-many supervised layer, enables explainable, duplicate-free predictions in a fully end-to-end framework. MDS-DETR outperforms existing one-to-many DETR variants such as MS-DETR, MR.DETR and Relation-DETR, without relying on any additional queries or auxiliary decoders. Under a 12-epoch training schedule on MS COCO with a ResNet-50 backbone, MDS-DETR achieves a +2.8 mAP improvement over Deformable-DETR with only a 5% increase in training time, and outperforms the state-of-the-art MR.DETR by +0.3 mAP while being even 20% faster in training. Our code and models are available at \href{https://github.com/dcholee/mds-detr}{https://github.com/DChoLee/MDS-DETR}.

[64] ComPose: When to Trust Hands for Object Pose Tracking cs.CVPDF

Jisu Shin, Junoh Lee, JunGyu Lee, Inhwan Bae, Dohyeon Lee

TL;DR: 本文提出了ComPose，一个用于从RGB视频中进行手部感知的6自由度物体姿态跟踪框架。该方法将手部运动作为物体跟踪的补充线索，而非纯粹的遮挡物，通过结合来自基础模型的物体和手部线索，自适应地选择信息丰富的手部关节，并利用可见的几何证据和学习的校正来优化物体运动。

Details

Motivation: 现有物体姿态跟踪方法严重依赖深度数据或3D模板等强外部先验，并且在手部抓握造成严重遮挡时非常脆弱，即使使用了显式掩码。本文旨在解决RGB视频中，在严重手部遮挡和几何模糊性下，实现鲁棒且准确的物体运动重建问题。

Result: 大量实验表明，该方法在严重手部遮挡和几何模糊性下是准确、高效且鲁棒的。生成的轨迹还能有效转移到下游机器人操作任务中，使机器人能够从在线视频中重建人类动作。

Insight: 核心创新在于将手部运动视为物体跟踪的互补线索，而非纯粹的干扰源。通过一个统一的跟踪流程，自适应地融合物体和手部线索，并强制执行旋转和平移的时间一致性，从而在没有外部平滑的情况下生成稳定的3D物体轨迹。

Abstract: Reconstructing the motion of objects from videos is a key component for embodied AI and robot manipulation. While diverse approaches to object pose tracking have been studied, they rely heavily on strong external priors, such as depth data or 3D templates, and remain highly vulnerable to severe occlusions by hand grasps despite the use of explicit masks. In this work, we present ComPose, a 6DoF object tracking framework designed for hand-aware object pose estimation from RGB video. Rather than treating the hand purely as an occluder, our method harmonizes hand motions as a \textit{complementary cue} for object tracking. In detail, we recover a variety of object motions over time by combining object and hand cues from foundation models within a unified tracking pipeline. Here, ComPose adaptively selects informative hand joints, combines object- and hand-derived cues for motion estimation, and refines the resulting object motion using visible geometric evidence and a learned correction. We further enforce the temporal consistency over both rotation and translation, yielding stable 3D object trajectories over time without any external smoothing. Extensive experiments show that our method is accurate, efficient, and robust under severe hand occlusion and geometric ambiguity. In addition, the resulting trajectories can also effectively transfer to downstream robot manipulation by enabling robots to reconstruct human actions from online videos.

[65] PixIE: Prompted Pixel-Space Low-Light Image Enhancement cs.CVPDF

Ruirui Lin, Guoxi Huang, David Bull, Nantheera Anantrasirichai

TL;DR: 本文提出PixIE，一种基于视觉基础模型语义提示的前馈像素空间低光图像增强框架。它通过跨尺度去噪抑制噪声并保持结构，然后利用DINOv3特征提示的像素块进行细节增强，并引入空间通道压缩和多重感受野像素嵌入以提升效率和鲁棒性。

Details

Motivation: 低光图像存在严重噪声、对比度损失和语义模糊，增强任务需要同时解决去噪和细节恢复问题。

Result: 在低光图像增强基准测试中，PixIE将平均PSNR提升了1.9-15.0%，LPIPS降低了8.5-44.4%，优于现有SOTA方法，并定性恢复了更清晰的细节和更稳定的纹理。

Insight: 创新点包括使用DINOv3等视觉基础模型进行语义提示来指导像素级增强，以及提出的空间通道压缩（SCC）和多重感受野像素嵌入（MRPE）机制，在提升性能的同时控制了计算成本。

Abstract: Low-light images exhibit severe noise, contrast loss, and semantic ambiguity, making enhancement a joint problem of denoising and detail recovery. We propose PixIE, a feed-forward pixel-space LLIE framework semantically-prompted by a vision foundation model. PixIE first performs a cross-scale denoising to suppress noise and preserve structure, then refines details with DINO-Prompted Pixel Blocks (DPPB) that inject intermediate DINOv3 features via patch-conditioned, spatially continuous per-pixel modulation. We introduce a Spatial-Channel Compaction (SCC), which folds features into a compact spatial grid and compresses in the channel dimension, so pixel-attention is computed efficiently with bounded cost across scales. We further propose Multi-Receptive-Field Pixel Embedding (MRPE) to provide neighborhood-aware pixel representations before semantic prompting, improving robustness to signal-dependent noise beyond point-wise embeddings. Experiments on LLIE benchmarks show that PixIE improves the average PSNR by 1.9-15.0% over recent state-of-the-art methods and reduces LPIPS by 8.5-44.4%. Qualitative comparisons further demonstrate that PixIE recovers sharper details and more stable textures, resulting in improved reconstruction fidelity and perceptual quality.

[66] Generator-Refiner-Examiner: A Tri-Module Data Augmentation Framework for 3D Human Avatar Learning from Monocular Videos cs.CVPDF

Gangjian Zhang, Jian Shu, Sicheng Yu, Wenhao Shen, Yu Feng

TL;DR: 本文提出了一种名为TrioMan的三模块数据增强框架，用于从单目视频中学习逼真且可动画的3D人体化身。该框架包含生成器、精炼器和检查器三个协同组件，通过生成、优化和筛选增强数据来缓解训练数据稀缺问题，从而提升重建质量。

Details

Motivation: 现有方法依赖于结合针对特定主体的优化和通用人体先验，但在训练帧有限时难以捕捉细粒度细节。本文旨在解决从单目视频重建3D人体化身时数据稀缺的挑战。

Result: 在X-Humans和NeuMan基准测试上的实验表明，TrioMan超越了最先进的方法。

Insight: 创新点在于提出了一个系统性的三模块数据增强框架，通过生成器引入姿态和相机扰动、精炼器利用纹理和几何线索进行一步扩散引导优化、以及检查器使用基于双分支注意力的相似性评估来筛选主体一致样本，协同工作以生成高质量增强数据。

Abstract: This paper addresses the challenge of reconstructing photorealistic and animatable 3D human avatars from monocular videos. While existing methods rely on combining per-subject optimization with generic human priors, they often fail to capture fine-grained details when training frames are limited. To mitigate this data scarcity, we propose TrioMan, a systematic tri-module framework for augmented 3D avatar learning. Our approach comprises three synergistic components. The Generator creates diverse unseen samples by imposing Gaussian perturbations on pose and camera. The Refiner improves the quality of generated data through one-step diffusion guided by texture and geometry cues. The Examiner selects subject-consistent samples using a dual-branch attention-based similarity evaluation. Experiments on the X-Humans and NeuMan benchmarks show that TrioMan outperforms state-of-the-art methods.

[67] PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQA cs.CV | cs.AIPDF

Chunze Yang, Qidong Liu, Wenjie Zhao, Yue Tang, Jiusong Ge

TL;DR: PathNavigate是一种无需训练的病理学智能体，用于解决全切片图像视觉问答（WSI-VQA）问题。它采用扫描-搜索-读取的三步流程，首先通过共享在线内存模块在低倍镜下扫描切片，生成标记异常区域的‘惊喜场’，然后在异常池中基于问题相关性选择高倍镜搜索目标，最后提取局部高分辨率证据并使用冻结的感知-裁决器栈进行回答。

Details

Motivation: 现有WSI-VQA方法存在局限：监督式病理学多模态大语言模型（MLLMs）和智能体需要任务特定的监督和重训练，实用性受限；而无需训练的智能体通常采用‘问题优先’设计，可能遗漏问题中未明确提及的关键形态学证据，且推理时脚手架负担重。PathNavigate旨在克服这些挑战，实现更高效、可解释的病理图像导航与问答。

Result: 在WSI-VQA和SlideBench-BCNB基准测试上的实验表明，PathNavigate的扫描-搜索-读取设计提高了回答准确性，并产生了更具可解释性的证据选择轨迹，同时具有更高的效率。

Insight: 创新点在于引入‘惊喜场’引导的扫描阶段，利用共享在线内存模块在问题匹配前识别异常区域池，从而减少对问题文本的过度依赖，并提升导航效率；整体架构保持核心模型冻结，无需额外训练，增强了实用性。

Abstract: Whole-slide image visual question answering (WSI-VQA) frames pathology as an extreme-context search problem: to answer a free-form clinical query, a system must first navigate a gigapixel slide under a strict inspection budget to locate sparse, high-resolution evidence. Existing approaches largely fall into two paradigms: i) supervised pathology multimodal large language models (MLLMs) and agents can absorb localization and reasoning into learned modules, but they often couple navigation to task-specific supervision and retraining, limiting their practicality; ii) training-free pathology agents avoid this cost by keeping core models frozen, but often follow a question-first design, constructing the initial candidate set mainly from query-conditioned relevance. This can miss decisive morphology that is not named in the question, and force heavier inference-time scaffolding. To address this challenge, we introduce PathNavigate, a training-free pathology agent built around a scan-search-readout routine. Before question matching, PathNavigate scans the current slide at low magnification with a shared online memory module over frozen pathology features, producing a slide-specific surprise field that marks an abnormal-region pool. It then applies question-conditioned PLIP relevance only within this pool to select high-magnification search targets. Finally, it extracts local high-magnification evidence and answers with a frozen perceptor-adjudicator stack, using the same online memory as slide-level context. Experiments on WSI-VQA and SlideBench-BCNB show that the proposed scan-search-readout design improves answer accuracy and yields more interpretable evidence-selection trajectories with higher efficiency.The code is available online.

[68] Calibration-Informative Region Selection for Online LiDAR–Camera Calibration in Agricultural Environments cs.CVPDF

Rajitha de Silva, Grzegorz Cielniak

TL;DR: 本文提出了一种支持图驱动的多模态标定方法，用于在线LiDAR-相机标定。该方法通过解耦初始标定、跨模态残差提取、支持图估计和支持感知细化四个功能模块，识别出对校准参数有真正约束作用的观测区域。在农业环境数据集BLT和KITTI上验证了方法的有效性。

Details

Motivation: 可靠的跨模态标定需要识别哪些观测真正约束了外参，哪些主要引入了噪声或歧义，以提升标定精度和鲁棒性。

Result: 在KITTI数据集上，支持图引导的细化方法提升了平移精度，但旋转精度的增益有限。实验表明，标定证据在空间和语义上分布不均，某些语义区域提供了更强的标定线索。

Insight: 核心创新是提出了一个密集的标定支持图，用于聚合对齐观测上的跨模态一致性，并突出显示标定证据持续可靠的区域。该方法将支持图估计作为独立模块，实现了对观测信息的有效筛选和利用。

Abstract: Reliable multi-modal calibration requires identifying which observations truly constrain the extrinsic parameters and which ones mainly add noise or ambiguity. In this paper, we propose a support-map-driven approach to multi-modal calibration that decouples four functional blocks: initial calibration, cross-modal residual extraction, support-map estimation, and support-aware refinement. We instantiate this formulation for online LiDAR–camera calibration using MDPCalib, a target-less LiDAR–camera calibration method based on motion and deep point correspondences, and CMRNext, a dense LiDAR–camera matching model that predicts optical-flow-like image-plane residuals. The key contribution is a dense calibration support map that aggregates cross-modal agreement over aligned observations and highlights where calibration evidence is consistently reliable. Across the Bacchus Long-Term (BLT) dataset and KITTI, we show that calibration evidence is spatially and semantically non-uniform, indicating that some semantic regions provide stronger cues for calibration than others. On KITTI, support-guided refinement improves the calibration performance with better translation accuracy while rotational gains remain limited.

[69] EM-Vid: Training-Free Entity-Centric Memory for Efficient and Consistent Multi-Shot Video Generation cs.CV | cs.AIPDF

Jente Vandersanden, Matheus Gadelha, Chun-Hao P. Huang, Hyeonho Jeong, Yulia Gryaditskaya

TL;DR: 本文提出了一种无需训练、以实体为中心的记忆机制（EM-Vid），用于高效且一致的多镜头视频生成。该方法通过构建实体索引的潜在补丁库，结合稀疏令牌条件化和预算化记忆更新策略，在保持实体外观一致性的同时，减少计算成本并提升提示遵循度。

Details

Motivation: 解决多镜头视频生成中，现有自回归方法因全帧存储导致实体信息与瞬时场景上下文纠缠，从而引发无关信息泄露和高计算成本的问题。

Result: 该方法在保持主体一致性的同时，提高了提示遵循度和生成效率，但摘要未提及具体基准测试或定量比较结果。

Insight: 创新点包括实体中心的潜在补丁记忆库、稀疏令牌条件化以限制自注意力、结构化多镜头脚本格式、预算化记忆更新策略，以及通过噪声注入机制实现细粒度外观控制，从而有效防止无关信息泄露。

Abstract: Multi-shot video generation requires maintaining a consistent appearance of recurring entities across shots while remaining faithful to shot-specific text prompts. Recent autoregressive methods reuse previously generated frames as memory. However, full-frame storage entangles persistent entity information with transient scene context, leading to irrelevant information leakage and high computational cost. We propose an entity-centric memory in the form of an entity-indexed bank of latent patches. We introduce sparse token conditioning compatible with pretrained models, restricting self-attention to entity-relevant tokens and reducing computational cost. To support this, we introduce a structured multi-shot script format. We additionally propose a budgeted memory update strategy to maintain a compact, evolving memory. Finally, we equip the entity representation with a noise-injection mechanism that enables fine-grained appearance control, preventing leakage of irrelevant information. Our method improves prompt adherence and efficiency while preserving subject consistency.

[70] GlowGS: Generative Semantic Feature Learning for 3D Gaussian Splatting in Nighttime Glow Scenes cs.CVPDF

Beibei Lin, Xiao Cao, Jingyuan Guo, Robby T. Tan

TL;DR: 本文提出GlowGS方法，用于解决现有3D高斯溅射（3DGS）在夜间发光场景中因缺乏纹理和边缘等结构特征而渲染质量差的问题。该方法通过扩散模型和视觉基础模型（VFM）生成语义特征作为隐式结构线索，并引入新颖的语义学习机制，在无需真实数据的情况下优化渲染视图，从而提升夜间场景的3D重建质量。

Details

Motivation: 现有3DGS方法在清晰日间场景中能有效渲染高质量新视角，但在夜间发光区域因缺乏纹理和边缘等关键结构特征而表现不佳，需要补偿这些缺失的线索以改善重建效果。

Result: 大量实验表明，GlowGS在生成语义准确的3D视图方面显著优于现有方法，实现了语义连贯且无伪影的渲染效果，在夜间发光场景的基准测试中表现出明显改进。

Insight: 创新点包括：利用扩散模型和VFM生成高质量语义特征作为隐式结构线索，以及无需真实数据的新视角语义学习机制，通过特征库匹配和距离最小化来优化渲染，这为缺乏结构特征的场景重建提供了新思路。

Abstract: Existing 3DGS methods effectively render high-quality novel views in clear-day scenes. However, they struggle with night scenes, particularly in glow regions, due to the lack of structural features such as textures and edges, which are key cues for splatting-based reconstruction. To address this problem, we leverage a diffusion model and a Vision Foundation Model (VFM) to compensate for missing structural cues. Our method consists of two key novel ideas: semantic feature generation and novel-view semantic learning. First, semantic feature generation produces high-quality semantic features as implicit structural cues for novel views. Specifically, a diffusion model synthesizes novel views with unknown camera poses from training views, while a VFM evaluates their quality. Once high-quality novel views are identified, the VFM extracts robust features to construct the semantic feature bank. Second, novel-view semantic learning enables 3DGS to optimize rendered novel views without requiring ground truth. It achieves this by extracting semantic features from a rendered novel view, searching the feature bank for the most similar features, and minimizing their distance. This process enforces implicit structural constraints, ensuring semantically coherent, artifact-free rendered views. Extensive experiments demonstrate the effectiveness of our GlowGS in generating semantically accurate 3D views, showing significant improvements over existing methods.

[71] DDX-TRACE: A Benchmark for Medical Diagnostic Trajectories in VLMs cs.CVPDF

Jiazhen Pan, Weixiang Shen, Jun Li, Julian Canisius, Felix Bitzer

TL;DR: DDX-TRACE是一个用于评估多模态视觉语言模型在医学诊断轨迹上的基准测试，专注于神经放射学领域。它模拟临床诊断的序列化工作流程，要求模型在隐藏证据的情况下，通过自由请求影像学检查、接收图像、更新鉴别诊断概率，并最终给出定位诊断。该基准包含211个具有挑战性的病例，并由医生进行裁决。

Details

Motivation: 当前大多数医学AI基准测试直接提供完整上下文并仅评估最终答案，这掩盖了模型可能存在的无证据猜测、过早终止诊断、低效检查流程和不确定性更新不佳等问题。论文旨在将医学AI评估从最终答案转向证据支持的诊断轨迹，以更真实地反映临床决策过程。

Result: 在DDX-TRACE基准上评估了最先进的视觉语言模型（SOTA VLMs），发现最终诊断分数可能严重歪曲工作流程质量。模型可能在缺乏关键证据时猜测出看似合理的诊断，或请求了有用的检查却错误解读原始图像，或在获取证据时效率低下且不确定性更新不佳。通过控制证据变体，研究分离出了规划、视觉证据提取和下游鉴别推理等瓶颈。

Insight: 论文的核心创新点是提出了一个模拟真实临床诊断序列决策过程的评估框架，将评估重点从静态的最终答案预测转向动态的、证据驱动的诊断轨迹。这为医学AI，特别是多模态模型，提供了一个更全面、更严格的评估范式，有助于识别模型在复杂推理链中的具体弱点。

Abstract: Medical diagnosis is not a single prediction from a fully specified vignette. It is a sequential workup: clinicians decide what evidence to obtain, revise a differential diagnosis, and stop when the diagnosis is sufficiently supported. Most medical AI benchmarks instead reveal the relevant context upfront and score only the final answer, making unsupported correct guesses, premature closure, inefficient workups, and poor uncertainty updating invisible. We introduce DDX-TRACE, a physician-adjudicated benchmark for multimodal neuroradiology that evaluates diagnostic trajectories under hidden evidence over 211 challenging cases. Each case begins with limited clinical history; models request imaging studies in free form, receive matched image bundles when available, update a probabilistic differential diagnosis after each turn, and stop with a localized final diagnosis. Evaluating state-of-the-art VLMs, we find that final diagnosis scores can substantially misrepresent workup quality: models may guess plausible diagnoses without essential evidence, request useful studies but misinterpret raw images, or acquire evidence inefficiently while updating uncertainty poorly. Controlled evidence variants isolate bottlenecks in planning, visual evidence extraction, and downstream differential reasoning. DDX-TRACE shifts medical AI evaluation from final answers to evidence-supported diagnostic trajectories.

[72] ExpOS: Explainable Open-Surgery Skills Assessment Using 3D Hand Reconstruction cs.CVPDF

Roi Papo, Idan Smoller, Shlomi Laufer

TL;DR: 本文提出了ExpOS，一个可解释的开放手术技能评估框架，通过从运动数据中学习判别性时间模式，自动评估手术技能并提供反馈。该方法利用3D手部重建和工具检测提取运动学描述符，结合时空卷积网络和注意力机制生成重要性图谱，并与全局运动统计融合进行预测。

Details

Motivation: 当前手术技能评估依赖专家观察，难以扩展且缺乏自主练习机会，因此需要一种自动、可解释的数据驱动评估方法，以提供及时透明的反馈。

Result: 在221个医学生执行三种开放手术任务的视频上评估，ExpOS与专家评分呈现强相关性，尤其在筋膜闭合任务中表现最佳（r = 0.778，R2 = 0.74），达到了与专家评估相当的水平。

Insight: 创新点在于结合弱监督时间重要性学习和可解释运动统计，通过注意力权重和全局特征分析实现多层次可解释性，自动识别关键事件和影响预测的运动特征，为可扩展的手术技能评估提供了新思路。

Abstract: Timely and transparent feedback is essential for effective surgical training, yet current assessment remains dependent on expert observation, limiting scalability and opportunities for autonomous practice. We present ExpOS, an explainable framework for data-driven assessment of open-surgery skills designed to enable automatic, feedback-oriented evaluation. Rather than relying on expert-defined metrics, ExpOS learns discriminative temporal patterns directly from motion data and identifies the segments and behaviors most predictive of skill level. We trained and evaluated the method on 221 videos of medical students performing three open-surgery tasks. Hand poses and tool detections were extracted from each frame to derive kinematic descriptors and global motion statistics. Spatiotemporal hand-tool dynamics were modeled using a temporal convolutional backbone with attention-based pooling to generate frame-level importance maps. These representations were fused with global motion statistics to predict skill level and to provide interpretable feedback. ExpOS provides multi-level explainability by identifying when informative events occur through attention weights and which motion characteristics most influence predictions through global feature analysis. Across tasks, the framework achieved strong correlation with expert ratings, with best performance on fascial closure (r = 0.778, R2 = 0.74). These results demonstrate that combining weakly-supervised temporal importance learning with interpretable motion statistics enables scalable and actionable surgical skill assessment.

[73] CVSearch: Empowering Multimodal LLMs with Cognitive Visual Search for High-Resolution Image Perception cs.CV | cs.AI | cs.LG | cs.MMPDF

Liupeng Li, Haoqian Kang, Zhenyu Lu, Jinpeng Wang, Bin Chen

TL;DR: 该论文提出了CVSearch框架，旨在解决多模态大语言模型处理高分辨率图像时面临的感知瓶颈。该框架采用免训练的’评估-搜索’工作流，动态调度专家辅助搜索和语义感知扫描两种策略，以平衡覆盖范围与计算效率。

Details

Motivation: 现有高分辨率图像感知方法在覆盖范围与效率之间存在权衡：专家辅助搜索高效但存在盲点，而扫描式搜索能保证覆盖却导致计算冗余和语义碎片化。CVSearch旨在解决这一困境。

Result: 在高分辨率基准测试上的大量实验表明，CVSearch在实现最先进（SOTA）准确率的同时，显著提升了搜索效率。

Insight: 核心创新点在于其自适应调度机制，特别是新颖的语义感知扫描机制（包含语义引导自适应分块）和由视觉复杂度先验驱动的动态自底向上搜索策略，有效缓解了对象碎片化问题并实现了对局部细节的高效探索。

Abstract: High-resolution (HR) image perception presents a key bottleneck for multimodal large language models (MLLMs). While visual search offers a promising solution, existing methods struggle with the trade-off between coverage and efficiency. Visual expert-assisted search is efficient but prone to blind spots when proposals fail, whereas scan-based search guarantees coverage at the cost of computational redundancy and semantic fragmentation. To address this dilemma, we introduce CVSearch, a training-free adaptive framework that dynamically schedules search strategies via an Assess-then-Search workflow. Specifically, CVSearch first invokes expert-assisted search when global information is insufficient, and only triggers a novel semantic-aware scanning mechanism upon failure. Distinct from rigid grid partitioning, this efficient scanning paradigm incorporates Semantic Guided Adaptive Patching to decompose images into semantically consistent regions, effectively mitigating object fragmentation. Furthermore, we devise a Dynamic Bottom-Up Search strategy driven by a Visual Complexity prior to enable efficient and precise iterative exploration of local details. Extensive experiments on HR benchmarks demonstrate that CVSearch achieves state-of-the-art accuracy while substantially improving search efficiency. Code is released at https://github.com/liliupeng28/ICML26-CVSearch.

[74] RiGS: Rigid-aware 4D Gaussian Splatting from a Single Monocular Video cs.CVPDF

Chenyu Wu, Wanhua Li, Zhu-Tian Chen, Hanspeter Pfister

TL;DR: 本文提出了RiGS（Rigid-aware 4D Gaussian Splatting）方法，用于从单目视频中重建动态3D场景。该方法通过引入静态、刚体和瞬态三种高斯图元，分别表示静态背景、长期低频运动和短期高频动态，并结合物体级动态掩码和场景流指导，实现了跨多时间尺度的运动建模。

Details

Motivation: 从单目视频重建动态3D场景是一个基础且极具挑战性的任务，因为真实世界的运动通常包含长期的平滑变换和短期的复杂形变。现有方法由于运动建模能力有限，要么难以保持时间一致性，要么无法捕捉高频动态。

Result: 大量实验表明，RiGS在新视角合成基准测试中取得了最先进的性能。

Insight: 论文的创新点在于提出了一个统一框架，通过三种高斯图元的分层表示和基于持续时间的状态转换机制，联合建模了不同时间尺度的运动。从客观角度看，其物体级动态掩码和场景流引导的优化策略，为动态场景的分解与运动估计提供了有效的监督信号，是可借鉴的思路。

Abstract: Reconstructing dynamic 3D scenes from monocular videos is a fundamental yet highly challenging task, as real-world motions often involve both long-term smooth transformations and short-term complex deformations. Existing methods either struggle to maintain temporal consistency or fail to capture high-frequency dynamics due to limited motion modeling capacity. In this work, we present Rigid-aware 4D Gaussian Splatting (RiGS), which simultaneously captures motions across multiple temporal scales. Specifically, RiGS introduces three types of Gaussian primitives: static, rigid, and transient, which represent static backgrounds, long-term low-frequency motions, and short-term high-frequency dynamics, respectively. An object-wise dynamic mask is proposed to aggregate long-range spatiotemporal motion information and guide the decomposition of static and dynamic regions. To jointly model motion across scales, rigid Gaussians are allowed to transition into transient Gaussians based on their temporal duration, and both are optimized under scene flow guidance, providing dense 3D motion supervision. Extensive experiments demonstrate that RiGS achieves state-of-the-art performance on novel view synthesis benchmarks. Code is available at \hyperlink{https://github.com/ladvu/RiGS}{https://github.com/ladvu/RiGS}.

[75] Recursive Block-Diagonal Coupling for Resource-Efficient Training of Vision Models cs.CVPDF

Maxim Henry, Adrien Deliège, Sébastien Piérard, Marc Van Droogenbroeck

TL;DR: 本文提出了一种名为RBDC的高效训练协议，通过以参数无关的块对角方式递归耦合多个独立训练的窄模型来构建宽模型，从而灵活分配训练预算。在ImageNet上使用视觉变换器（DeiT）和卷积网络（ResNet）进行评估，RBDC比标准从头训练协议效率更高，在相似测试精度下减少30%的FLOPs，并在相同训练FLOPs下优于现有模型增长方法。

Details

Motivation: 解决从头训练高容量视觉模型所需计算资源巨大的问题，现有增长方法通常假设已有窄模型可用，这掩盖了整个训练流程的真实计算成本。

Result: 在ImageNet基准测试中，RBDC在相似测试精度下比标准从头训练减少30%的FLOPs，并在相同训练FLOPs下超越模型增长文献中的训练协议，达到更高性能；同时在下游目标检测和实例分割任务中作为骨干网络表现更优。

Insight: 创新点在于提出一种参数无关的块对角递归耦合机制，允许灵活分配训练预算；客观分析认为其通过复用窄模型参数实现了高效模型扩展，避免了从头训练的开销，是一种资源高效的模型增长策略。

Abstract: Training high-capacity vision models from scratch requires substantial computational resources. To improve training efficiency of a wide target model, existing growth methods often assume the availability of narrower models, obscuring the true computational cost of the entire pipeline. We propose an efficient training protocol, RBDC, that builds wide models by coupling in a parameter-free block-diagonal way narrower, independently trained models in a recursive way. This allows a flexible allocation of the training budget available across all the models involved. Evaluated with vision transformers (DeiT) and convolutional networks (ResNet) on ImageNet, our RBDC training protocol shows a much better efficiency than models trained from scratch with the standard protocol, yielding 30% FLOPs reduction at similar test accuracies. It also achieves higher performances at same training FLOPs than training protocols from the model growth literature. Finally, we show that our models can serve as better backbones than their original counterparts for downstream object detection and instance segmentation tasks.

[76] Weierstrass Positional Encoding for Vision Transformers cs.CV | cs.AIPDF

Zhihang Xin, Rui Wang, Xitong Hu, Xiaojun Wu

TL;DR: 本文针对视觉Transformer中常用的可学习一维位置编码会削弱图像二维空间结构的问题，提出了一种基于Weierstrass椭圆函数的二维位置编码方法（WePE）。该方法将归一化的二维图像块坐标映射到复平面，利用椭圆函数的双周期性和代数加法公式，构建了能更忠实建模空间距离关系、且与图像块网格几何结构自然匹配的位置特征。WePE是一种即插即用、分辨率无关的方法，能无缝集成到现有ViT模型中。

Details

Motivation: 现有ViT中常用的可学习一维位置编码在图像块展平后削弱了图像固有的二维空间结构，缺乏几何约束，且未能保持欧几里得空间距离与序列索引距离之间的单调关系，限制了ViT利用空间邻近先验的能力。

Result: 广泛的实验表明，WePE在大多数设置下都能带来一致的性能提升。通过预计算查找表，这些改进不会引入明显的计算或内存开销。额外的分析和消融研究进一步验证了所提方法的有效性。

Insight: 创新点在于利用Weierstrass椭圆函数的双周期性和内在格点结构来表征二维位置，其非线性几何特性有助于更忠实地建模空间距离关系，而其代数加法公式使得任意图像块对之间的相对位置信息可以直接从其绝对编码中推导出来。这是一种数学基础扎实、具有几何解释性的位置编码新范式。

Abstract: Vision Transformers have achieved remarkable success in computer vision, but their common use of learnable one-dimensional positional encodings weakens the inherent two-dimensional spatial structure of images after patch flattening. Existing positional encodings often lack geometric constraints and do not preserve a monotonic relationship between Euclidean spatial distances and sequential index distances, limiting ViTs’ ability to exploit spatial proximity priors. Motivated by the usefulness of periodicity in positional encoding, we propose Weierstrass elliptic Positional Encoding (WePE), a mathematically grounded method for encoding two-dimensional coordinates in the complex domain. WePE maps normalized 2D patch coordinates onto the complex plane and constructs compact four-dimensional positional features using the Weierstrass elliptic function and its derivative. The double periodicity provides a principled representation of 2D positions, and its intrinsic lattice structure naturally matches the regular geometry of image patch grids. Its nonlinear geometric properties help model spatial distance relationships more faithfully, while the algebraic addition formula enables relative positional information between arbitrary patch pairs to be derived directly from their absolute encodings. WePE is plug-and-play and resolution-agnostic, allowing seamless integration into existing ViTs. Extensive experiments show that WePE brings consistent performance gains in most settings. With precomputed lookup tables, these improvements introduce no noticeable computational or memory overhead. Additional analyses and ablation studies further validate the effectiveness of the proposed method.

[77] CRONOS: Benchmarking Counterfactual Physical Consistency in Video Models cs.CVPDF

León Begiristain, Olaf Dünkel, Adam Kortylewski

TL;DR: 本文介绍了CRONOS，一个基于干预的基准测试，用于评估视频模型的反事实物理一致性。该基准在虚幻引擎环境中构建，通过系统性地干预视角、场景、物体类别和外观等关键因素，同时保持物理事件类型不变，以测试模型预测是否对视觉输入的变化做出适当响应。

Details

Motivation: 当前视频预测模型可能仅利用表面视觉相关性而非学习底层因果结构，因此需要一种方法来评估模型是否真正理解物理事件并保持反事实一致性。

Result: 对近期开源视频生成器的评估显示，它们在反事实物理一致性方面存在显著失败，预测质量受到外观、环境，尤其是视角变化的严重影响。

Insight: CRONOS通过可控干预提供了一个可复现的测试平台，其核心创新在于系统性地分离并干预多个视觉因素以孤立评估物理一致性，为开发跨条件一致的模型设立了明确目标。

Abstract: Video prediction is increasingly viewed as a path toward generalizable world models, yet it remains unclear whether these systems learn underlying causal structure or merely exploit superficial visual correlations for future prediction. We introduce CRONOS, an intervention-based benchmark designed to evaluate counterfactual physical consistency: whether a model’s predictions of physical events respond appropriately to controlled changes in the visual input, such as variations of scene context, viewpoint, object appearance, and object category. Built in a photorealistic Unreal Engine environment, CRONOS enables controlled, high-fidelity generation of videos across diverse scenes and dynamics. In contrast to previous benchmarks, CRONOS systematically intervenes on four key factors - viewpoint, scene, object category, and object appearance - while keeping the underlying physical event type, such as a collision, occlusion, or fall, fixed. Our evaluation of recent open-source video generators reveals substantial failures in counterfactual physical consistency: prediction quality for the same physical event type is affected by appearance, environment, and, particularly by viewpoint changes. CRONOS provides a controlled and reproducible testbed for diagnosing how the quality of generated videos changes for different interventions, establishing a concrete target for developing models that perform consistently across changes of multiple conditions. The dataset and code are available at our project page.

[78] Revitalizing Dense Material Segmentation: Stabilized Vision Transformers and the Generalization Paradox cs.CVPDF

Allan Kazakov, Duygu Cakir, Hilal Kurt İrfanoğlu, Yavuz İrfanoğlu

TL;DR: 本文通过重新激活苹果密集材料分割（DMS）基准，为材料分割任务建立了现代视觉Transformer基线。研究发现标准训练范式在非晶态纹理场中因高方差梯度而失效，为此提出了包含高保真逻辑投影、查询熵正则化和领域特定物理合规数据增强的稳定训练方案。优化后的SegFormer-B5在原始数据集划分上达到了0.4572 mIoU的新SOTA，同时揭示了数据集重新划分导致的’泛化悖论’，即指标提升却损害了真实世界分布外性能。

Details

Motivation: 材料分割作为像素级物理表面属性分类任务，在计算机视觉中仍具挑战性，且当前基准因几何偏置基础模型的兴起而面临停滞。本文旨在通过重建苹果DMS基准，推动基于物理理解的人工智能发展。

Result: 在原始数据集划分上，优化后的SegFormer-B5达到了0.4572 mIoU的新SOTA，显著超越了先前的卷积基线。若将数据集重新划分为数据丰富的80/10/10分割，指标可提升至0.5276 mIoU，但专家定性分析表明这会导致分布同质化，严重损害真实世界分布外性能。

Insight: 创新点包括针对材料分割高方差梯度问题的稳定训练方案（高保真逻辑投影、查询熵正则化、物理合规数据增强），以及揭示了数据集划分中的’泛化悖论’，强调应使用严谨的原始划分来评估模型真实泛化能力。

Abstract: Material segmentation, the pixel-wise classification of physical surface properties, remains a challenging problem in computer vision, requiring physicochemical understanding distinct from object-centric parsing. Despite the introduction of the rigorous Apple Dense Material Segmentation (DMS) dataset, the benchmark has suffered from attrition and stagnation, increasingly overshadowed by geometry-biased foundation models. In this paper, we revive the Apple-DMS benchmark to establish a modern Vision Transformer baseline. We conduct an exhaustive evaluation of SegFormer and Mask2Former architectures, revealing that standard training paradigms fail on amorphous texture fields due to high-variance gradients. To address this, we introduce a stabilized training recipe featuring High-Fidelity Logit Projection, Query Entropy Regularization, and a domain-specific, physics-compliant augmentation pipeline. Our optimized SegFormer-B5 achieves a new State-of-the-Art (SOTA) of 0.4572 mIoU on the original dataset split, significantly surpassing the prior convolutional baseline. Furthermore, we identify a critical “Generalization Paradox”: while re-partitioning the dataset into a data-rich 80/10/10 split inflates the metric to 0.5276 mIoU, expert qualitative analysis reveals this induces distributional homogenization, severely degrading real-world, out-of-distribution performance. By releasing our recovered dataset index and robust training framework, we demonstrate that material perception is far from solved and urge the community to leverage the rigorous original split to drive genuine progress in physically grounded artificial intelligence.

[79] PhotoFlow: Agentic 3D Virtual Photography Missions cs.CV | cs.AI | cs.MAPDF

Jiarui Guo, Haojia Wei, Yiming Zhang, Yifei Liu, Yuning Gong

TL;DR: 本文提出了PhotoFlow系统，这是一个基于大语言模型的智能体，用于在任意Blender 3D场景中执行语言指令驱动的虚拟摄影任务。该系统采用导演-评审-反思（Director-Reviewer-Reflector）的闭环搜索架构，并引入了VPhotoBench基准测试集进行评估。

Details

Motivation: 虚拟摄影任务要求智能体在无预设相机位姿或参考图像的情况下，仅凭场景信息和语言意图来推断合适的拍摄构图并执行，这同时考验了复杂的3D空间理解和抽象美学判断能力，而现有方法难以共同评估这两项能力。

Result: 在提出的VPhotoBench基准（包含47个场景和141个任务）上进行测试，在六轮渲染预算下，PhotoFlow在外部质量对齐综合指标和成功率上，均优于一次性预测、单链反思、锚点库选择和随机搜索等方法，取得了最强的性能。

Insight: 创新点在于将语言驱动的虚拟摄影构建为一个可执行的智能体任务，并设计了包含软摄影蓝图生成、多模态评审（结合规则检查、视觉批判和成对选择）以及失败经验转化（区域记忆、死区抑制和高探索重定位）的闭环搜索框架，证明了以LLM为中心的空间智能体已能在挑战3D推理和美学选择的场景中生成高质量照片。

Abstract: Virtual photography asks an agent to enter a prepared 3D scene with no preselected camera pose or reference image, infer a suitable shot from scene information and a language intent, choose executable camera parameters, and render the final photograph. Recent progress in vision-language models makes this kind of spatial agent increasingly plausible, but the task stresses two capabilities that remain hard to evaluate together: complex 3D spatial understanding and abstract aesthetic judgment. We introduce PhotoFlow, a Director-Reviewer-Reflector agent for closed-loop camera search. The Director builds a soft photographic blueprint and proposes diverse candidate cameras; the Reviewer combines rule checks, visual critique, and pairwise incumbent selection; and the Reflector converts failures into region memory, dead-zone suppression, and high-explore relocation. We also introduce VPhotoBench, a benchmark of 47 open-license Blender scenes and 141 language-conditioned photography missions spanning subject placement, relational composition, and atmosphere/style. On held-out experiments, PhotoFlow achieves the strongest external quality-alignment composite and success rate among one-shot prediction, single-chain reflection, anchor-bank selection, and random search under a six-round rendering budget. To our knowledge, this is the first work to make language-conditioned virtual photography in arbitrary Blender scenes an executable agent task, and our results show that an LLM-centered spatial agent can already produce strong photographs in a setting designed to challenge both 3D reasoning and aesthetic choice.

[80] Exploring deep learning for Event-Based Saliency Prediction with a Transformer-based model cs.CVPDF

Romaric Mazna, Jean Martinet, Sai Deepesh Pokala

TL;DR: 本文提出了SEST（Swin Event-based Saliency Transformer）模型，首次将深度学习方法应用于基于事件的显著性预测任务。该模型采用基于Swin Transformer的自监督预训练主干网络和轻量级CNN解码器，并通过合成监督策略缓解了事件显著性数据稀缺的问题。

Details

Motivation: 显著性预测在RGB图像和视频中已得到广泛研究，但基于事件数据的显著性预测仍未被充分探索，主要障碍在于缺乏大规模事件显著性数据集和强有力的基线模型。

Result: 实验结果表明，SEST在引入的两个新基准数据集N-DHF1K和N-UCF Sports上，明显优于现有的基于事件的显著性方法，并缩小了与最先进RGB模型的性能差距。在真实事件相机数据集上的零样本评估进一步证明了其可迁移性。

Insight: 主要创新点在于首次将深度学习应用于事件显著性预测，并提出了结合事件原生预训练和合成监督的策略来克服数据稀缺问题，为事件视觉与神经形态视觉注意力的交叉研究开辟了新方向。

Abstract: Saliency prediction has been extensively studied in RGB images and videos as a computational model of human visual attention. In contrast, predicting saliency from event-based data remains largely unexplored, despite the biological inspiration and favorable sensing properties of event cameras. Two obstacles have held this direction back: the absence of large-scale event saliency datasets, and the lack of a strong baseline. In this paper, we introduce SEST (Swin Event-based Saliency Transformer), a transformer-based model for saliency prediction from event data, bridging the data scarcity barrier through event-native pretraining and synthetic supervision. SEST leverages a self-supervised pretrained event-based Swin Transformer backbone combined with a lightweight CNN decoder to produce dynamic saliency maps. To address the scarcity of annotated event-based saliency data, we introduce two new benchmark datasets, N-DHF1K and N-UCF Sports, generated from large-scale RGB saliency benchmarks. Experimental results show that SEST clearly outperforms existing event-based saliency methods and narrows the performance gap with state-of-the-art RGB models. Zero-shot evaluation on a real event camera dataset further demonstrates that our model trained on synthetic data remains transferable on real event streams. To the best of our knowledge, this work is the first to apply deep learning to event-based saliency prediction, opening a new research direction at the intersection of event-based vision and neuromorphic visual attention.

[81] Not Too Generative, Not Too Discriminative: The Human Alignment Sweet Spot cs.CV | cs.AIPDF

Jorge Chang Ortega, Bastien Le Lan, Thomas Serre, Victor Boutin

TL;DR: 该论文通过使用联合能量模型（JEMs）在固定架构中连续插值判别式和生成式训练，研究了人类视觉表征与哪种学习目标更一致。研究发现，在六个不同的人类对齐基准测试中，对齐性在生成-判别连续体的中间点达到最佳，而非任一极端。这表明人类对齐的视觉源于平衡两种目标，而非选择其一。

Details

Motivation: 解决计算视觉中的一个核心问题：人类视觉表征究竟更符合判别式还是生成式学习。现有比较常混淆学习目标与架构、规模和训练数据，本研究旨在隔离学习目标本身的影响。

Result: 在六个涵盖感知相似性、光泽感知、人类反应不确定性、鲁棒性、形状-纹理线索冲突和诊断特征归因的人类对齐基准上，混合JEMs在中间点实现了最佳对齐，超越了纯判别式或纯生成式模型。

Insight: 创新点在于使用JEMs在固定架构中连续调节生成与判别目标，从而隔离了目标的影响。核心洞察是：人类对齐的视觉并非源于生成或判别目标的二选一，而是来自两者的平衡，结合了判别学习诱导的类别结构和生成学习对输入结构的敏感性。

Abstract: A central question in computational vision is whether human-like visual representations are better explained by discriminative or generative learning. Existing comparisons, however, often confound the learning objective with architecture, scale, and training data, leaving open whether the objective itself drives alignment. We address this confound using Joint Energy-Based Models (JEMs), which interpolate continuously between discriminative and generative training within a fixed architecture. By varying a single mixing coefficient, we isolate the effect of the learning objective and evaluate the resulting models across six human-alignment benchmarks spanning perceptual similarity, gloss perception, human response uncertainty, robustness, shape-texture cue conflict, and diagnostic feature attribution. Across this diverse suite, human alignment is consistently maximized at intermediate points of the generative-discriminative continuum, rather than at either endpoint. Hybrid JEMs combine the categorical structure induced by discriminative learning with the sensitivity to input structure induced by generative learning, yielding more human-like behavior across multiple levels of vision. These results suggest that the generative-discriminative dichotomy is the wrong axis for understanding human-aligned vision: alignment emerges not from choosing one objective over the other, but from balancing both.

[82] Decomposing Queries into Tool Calls for Long-Video Keyframe Retrieval cs.CV | cs.CLPDF

Michal Shlapentokh-Rothman, Prachi Garg, Yu-Xiong Wang, Derek Hoiem

TL;DR: 本文提出ToolMerge方法，用于长视频关键帧检索，通过基于大语言模型（LLM）的规划器将查询分解为工具调用，并利用布尔运算符合并各工具的排名结果。作者构建了Molmo-2 Moments（M2M）基准测试来直接评估检索性能，实验表明ToolMerge在问答、问题检索和字幕检索任务中与现有方法竞争，尤其在字幕检索上优于其他方法5%。

Details

Motivation: 现有关键帧选择器要么对每帧针对单一查询进行评分，要么将查询分解为固定模式并由单一视觉工具评估，无法灵活适应不同查询需求。本文旨在通过分解和合并策略，更有效地根据查询内容定位长视频中的关键帧。

Result: 在构建的M2M基准测试上，ToolMerge在问答、问题检索和字幕检索任务中与先前关键帧选择器表现相当，其中在字幕检索任务中性能提升5%，达到SOTA水平。

Insight: 创新点在于使用LLM规划器动态分解查询为工具调用，并通过布尔运算符合并多工具排名，提高了检索的灵活性和准确性；从客观角度看，该方法结合了自然语言处理和视觉工具的优势，为长视频分析提供了可扩展的框架。

Abstract: Keyframe selection is a direct way to provide verifiable visual evidence for long-video question answering (QA). Queries differ in what they require, and finding the right frames depends on knowing what to look for. Existing keyframe selectors either score every frame against a single query, or decompose the query into a fixed schema evaluated by a single visual tool. We propose ToolMerge, a keyframe retrieval method based on decomposition and merging: an Large Language Model (LLM) based planner decomposes the query into tool calls and specifies how their per-tool rankings are merged using boolean operators. To evaluate retrieval directly, we construct Molmo-2 Moments (M2M), a benchmark in which every question is anchored to a specific time interval by construction. Across QA, question retrieval, and caption retrieval, ToolMerge is competitive with prior keyframe selectors, most notably on caption retrieval, outperforming other methods by 5%. Code and data can be found at https://github.com/michalsr/ToolMerge .

[83] Learning a Particle Dynamics Model with Real-world Videos cs.CVPDF

Chanho Kim, Suhas V. Sumukh, Li Fuxin

TL;DR: 本文提出了一种直接从无标注的真实世界视频中训练神经物体动力学模型的新框架。该框架基于高斯泼溅框架学习粒子动力学模型，通过渲染监督进行训练，无需粒子级标注状态。作者还构建了一个包含约500个视频的真实世界数据集，用于捕捉多样化的物体交互。

Details

Motivation: 现有数据驱动的物理模拟方法（世界模型）通常依赖合成数据训练，因为难以从真实世界获取完美的状态信息（如完整场景点云和点对应关系）。这限制了模型在仿真与现实差距较大时的应用。本文旨在克服这些限制，直接从无标注的真实世界视频中学习动力学模型。

Result: 论文未在摘要中提供具体的定量实验结果或基准测试比较，但提出了一种新框架和数据集，为未来评估奠定了基础。

Insight: 创新点包括：1）直接从无标注真实世界视频学习粒子动力学模型，减少对合成数据的依赖；2）结合高斯泼溅框架，利用密集高斯粒子（带尺度和旋转）进行预测；3）通过渲染监督实现训练，无需粒子级标注；4）引入真实世界视频数据集，促进相关研究。

Abstract: Data-driven learning approaches for physics simulation, sometimes referred to as world models, have emerged as promising alternatives to traditional physics simulators due to their differentiable nature. Prior work has demonstrated impressive results in predicting the motions of rigid and non-rigid objects in complex scenes involving multiple interacting bodies. However, these models are typically trained in simulated environments because obtaining perfect state information such as complete scene point clouds and point correspondences over time is challenging in real-world settings. This reliance on synthetic data can limit their applicability when the sim-to-real gap is large. In this work, we aim to overcome these limitations by introducing a novel framework for training neural object dynamics models directly from unlabeled real-world videos. Specifically, we propose to learn a particle-based dynamics model compatible with a Gaussian splatting framework, which operates on dense particles derived from Gaussians (i.e., particles with scales and rotations) and predicts their position and rotation changes over time. The model is trained via rendering supervision, enabling learning from real-world videos without requiring particle-level labeled states. Our model operates directly on dense Gaussians without relying on heuristic subsampling anchor points. To enable this study, we also present a real-world dataset consisting of about 500 videos capturing diverse object interactions.

[84] Vision Transformers Need Better Token Interaction cs.CVPDF

Linxiang Su

TL;DR: 本文研究了视觉Transformer（ViT）在密集预测任务中存在的表征退化问题，即随着训练深入，图像块（patch）表征的有效性下降。作者将这一现象归因于语义扩散（semantic diffusion），即全局语义信息过度传播到局部块中，并提出通过稀疏注意力（entmax-1.5替换softmax）来增强token交互的选择性，从而在不损害图像级分类性能的前提下显著提升密集预测（如语义分割）的效果。

Details

Motivation: 解决ViT在长时间训练后，其块级表征在密集预测任务（如语义分割）中性能下降的问题，即密集退化现象。作者认为现有解释（如高范数伪影）不充分，并指出语义扩散是导致该问题的优化捷径。

Result: 在ImageNet-1K上训练200个epoch的DINOv1 ViT-S/16模型中，使用entmax-1.5稀疏注意力后，ImageNet线性探测准确率保持不变，而语义分割性能显著提升：在VOC数据集上mIoU从42.80提高到48.78，在ADE20K上从19.85提高到21.97，在Cityscapes上从36.79提高到37.87。

Insight: 创新点在于将密集退化归因于语义扩散，并提出通过稀疏注意力机制（entmax-1.5）实现更选择性的token交互，这是一种简单有效的归纳偏置，能同时保持全局表征质量和提升密集预测性能。

Abstract: Vision Transformers (ViTs) can learn strong image-level representations while their patch representations become less effective for dense prediction during prolonged training. We revisit this dense degradation phenomenon and argue that it is not fully explained by high-norm artifacts alone. Instead, we characterize \emph{semantic diffusion}: an optimization shortcut in which global semantic information spreads through patch tokens beyond what is locally justified. Our analysis shows that dense representation quality is not captured by locality alone: shallow features can remain better aligned with foreground regions yet underperform deeper features, and \texttt{[CLS]} features remain complementary for dense prediction. These observations suggest that the goal should not be to remove global context, but to make token interactions more selective. We therefore study sparse attention as a minimal intervention, replacing softmax attention with entmax-1.5 while preserving global token connectivity. On DINOv1 ViT-S/16 trained for 200 epochs on ImageNet-1K, this change preserves ImageNet linear probing accuracy and substantially improves semantic segmentation performance: VOC mIoU increases from 42.80 to 48.78, ADE20K from 19.85 to 21.97, and Cityscapes from 36.79 to 37.87. These results suggest that selective token mixing is a simple and effective bias for improving dense ViT representations.

[85] ETCHR: Editing To Clarify and Harness Reasoning cs.CV | cs.AI | cs.CLPDF

Beichen Zhang, Yuhong Liu, Jinsong Li, Yuhang Zang, Jiaqi Wang

TL;DR: 论文提出了ETCHR，一种用于辅助多模态大语言模型进行视觉推理的图像编辑模型。它通过将图像编辑模型与理解模型解耦，并采用两阶段训练方法（推理模仿和推理增强），解决了现有方法在语言理解和生成质量上的不足。实验表明，ETCHR能有效提升多种MLLM在多个视觉推理任务上的性能。

Details

Motivation: 当前多模态大语言模型的视觉推理能力受限于纯文本的思维链，而‘用图像思考’的范式要么受限于预定义工具集，要么由统一多模态模型产生的中间图像质量不佳。因此，需要一种专门的、解耦的图像编辑模型来弥合语言侧（将抽象问题映射到视觉变换）和生成侧（随着推理深度增加保持编辑正确性）的差距。

Result: 在五个任务家族（细粒度感知、图表理解、逻辑推理、拼图恢复和3D理解）上，ETCHR以即插即用的方式显著提升了多个开源和闭源MLLM的性能。例如，将Qwen3-VL-8B的平均Pass@1从55.95提升至60.77（+4.82），将Gemini-3.1-Flash-Lite从65.08提升至70.55（+5.47），将Kimi K2.5从76.55提升至81.16（+4.61）。

Insight: 论文的核心创新在于提出了一种解耦的、问题条件化的、具备推理意识的图像编辑模型架构。其两阶段训练方法（推理模仿+基于VLM奖励的推理增强）专门针对语言映射和生成退化问题，使得编辑模型能成为有效的推理助手，并能以训练免费的方式灵活集成到不同MLLM中，提升了系统的模块化和泛化能力。

Abstract: Multimodal Large Language Models have advanced visual reasoning, yet a purely textual chain of thought remains a bottleneck for questions that require fine-grained focus or view transformations. The ‘’think with images’’ paradigm narrows this gap, but existing approaches are either constrained by fixed predefined toolkits or produce noisy intermediate images from unified multimodal methods. We pursue a third option: using a dedicated image editing model and decouple it with an understanding model. However, off-the-shelf image editors fail as reasoning assistants with two complementary gaps: a language-side gap, where editors trained as passive instruction-followers cannot map an abstract question to an appropriate visual transformation, and a generation-side gap, where edit correctness degrades as reasoning depth grows. Guided by this analysis, we introduce ETCHR (Editing To Clarify and Harness Reasoning), a question-conditioned, reasoning-aware image editor decoupled from the downstream understanding model and trained with a two-stage recipe targeted at the two gaps: Reasoning Imitation via supervised fine-tuning on edit trajectories, followed by Reasoning Enhancement with VLM-derived rewards for edit correctness and downstream reasoning accuracy. Since the editor is decoupled, ETCHR plugs into different open- and closed-source MLLMs in a training-free manner. Across five task families (fine-grained perception, chart understanding, logic reasoning, jigsaw restoration, and 3D understanding), ETCHR raises average Pass@1 from 55.95 to 60.77 (+4.82) with Qwen3-VL-8B, from 65.08 to 70.55 (+5.47) with Gemini-3.1-Flash-Lite, and from 76.55 to 81.16 (+4.61) with the 1T-parameter MoE model Kimi K2.5.

[86] Smart-Insertion-V: Photorealistic Video Insertion via a Closed-Loop Feedback Dual-Stream Framework cs.CVPDF

Xiao Cao, Yansong Qu, Xiangzhen, Chang, Wen Xiao

TL;DR: 本文提出Smart-Insertion-V，一个用于无掩码视频对象插入的端到端双流框架。该框架通过同步进行视频插入和图像风格迁移，并引入闭环反馈机制来确保鲁棒性。为了解决特征纠缠和风格泄漏问题，设计了Dual-World-View RoPE和Decoupled Guidance Module，并计划发布开源数据集。

Details

Motivation: 解决现有方法在参考对象与源视频场景存在严重风格域差异时，难以实现和谐视频对象插入的问题。

Result: 实验表明，该方法能将对象插入到合理的位置，并实现最和谐的结果。

Insight: 主要创新点包括：1) 结合视频插入与图像风格迁移的双流闭环反馈框架；2) 通过Dual-World-View RoPE区分不同信号以解决特征纠缠；3) 利用视觉语言模型进行语义推理的解耦引导模块；4) 为任务构建并计划发布开源数据集。

Abstract: Mask-free video object insertion has emerged as a challenging task, requiring harmonious integration of reference objects into source videos. However, existing methods struggle when references exhibit severe stylistic domain gaps with the source scene. To overcome this, we propose \textit{\textbf{Smart-Insertion-V}}, an end-to-end \textbf{Dual-Stream} framework that concurrently conducts video insertion and image style transfer. Within this framework, the image stream synchronously guides the video generation process, while a \textbf{Closed-loop Feedback} mechanism is further incorporated to ensure robust insertion. Inevitably, integrating these diverse conditioning signals results in feature entanglement and style leakage. To tackle this issue, we design \textbf{Dual-World-View RoPE} to distinguish different signals via spatial-temporal offsets without incurring heavy training overhead. Furthermore, to facilitate spatial grounding and stylistic adaptation, we introduce a \textbf{Decoupled Guidance Module} that leverages a Vision-Language Model for semantic reasoning while preserving original temporal guidance with native text encoder. To bridge data gap for harmonious reference insertion task, we propose a data curation pipeline and will release an \textbf{open-source dataset}. Experiments demonstrate that our method can insert objects into plausible positions while achieving the most harmonious results.

[87] PGT: Procedurally Generated Tasks for improving visual grounding in MLLMs cs.CV | cs.AIPDF

Rim Assouel, Amir Bar, Michal Drozdzal, Adriana Romero-Soriano

TL;DR: 该论文提出了程序化生成任务（PGT）框架，通过将明确的几何图元叠加到图像上，为多模态大语言模型（MLLMs）提供密集的监督信号，旨在提升模型的细粒度视觉理解能力，并作为一种低成本诊断工具来识别感知失败的根源。

Details

Motivation: 尽管多模态大语言模型取得了显著进展，但它们仍在细粒度理解任务上存在困难。PGT旨在通过数据驱动的方法，将视觉定位能力与语义先验知识解耦，从而解决细粒度视觉感知的瓶颈问题。

Result: 在关系、定量和3D/深度理解基准测试上的广泛实验表明，PGT在不同架构的模型上都带来了显著提升。使用PGT数据增强的LLaVA-v1.5-Instruct进行指令微调后，在What’sUp基准上提升了高达+20%，在CV-Bench-2D上提升了+13.3%，同时保持了通用感知能力。对最先进的MLLMs进行PGT微调，在What’sUp和CV-Bench-2D上分别带来了高达+5.5%和+8.3%的提升。

Insight: 论文的创新点在于提出了一种简单而有效的程序化数据生成框架，通过引入几何图元来提供无歧义的监督信号，从而直接针对视觉定位能力进行训练。其核心洞察是，许多空间推理缺陷源于监督信号不足，而非固有的模型架构或分辨率限制，这为改进MLLMs的细粒度理解提供了一种新的数据增强和诊断思路。

Abstract: Despite remarkable progress in Multimodal Large Language Models (MLLMs), these models still struggle with fine-grained understanding tasks. In this work, we propose Procedurally Generated Tasks (PGT), a simple data-driven framework that serves a dual purpose: inducing fine-grained visual understanding and acting as a low-cost diagnostic tool to identify the source of perception failures. By overlaying unambiguous geometric primitives on images, PGT generate additional dense supervision that disentangles visual grounding capability from semantic priors. Extensive experiments on relational, quantitative, and 3D/depth understanding benchmarks show that PGT yields remarkable gains across diverse architectures. Instruction tuning MLLMs on LLaVA-v1.5-Instruct augmented with PGT data results in improvements of up to +20% on the What’sUp benchmark and +13.3% on CV-Bench-2D, while maintaining general perception capabilities. Moreover, finetuning state-of-the-art MLLMs on PGT data leads to boosts of up to +5.5% on What’sUp and +8.3% on CV-Bench-2D. These findings demonstrate that PGT effectively address the bottleneck of fine-grained perception, revealing that many spatial reasoning deficits stem from inadequate supervision signals rather than inherent architectural or resolution limitations.

[88] Geo-Align: Video Generation Alignment via Metric Geometry Reward cs.CVPDF

Zizun Li, Haoyu Guo, Runzhe Teng, Chunhua Shen, Tong He

TL;DR: 本文提出Geo-Align，一个用于相机控制视频重渲染的强化学习框架。它通过一个基于度量几何的奖励机制来优化预训练模型，以解决现有方法在处理真实世界视频时泛化能力差、难以准确遵循物理尺度和相机轨迹的问题。该方法无需成对的真实世界多视角视频数据，仅利用真实世界条件视频和合成数据的目标相机轨迹进行训练。

Details

Motivation: 现有相机控制视频生成方法严重依赖合成数据集进行监督微调，而同步多视角真实世界视频数据极度稀缺，导致模型在处理分布外真实视频时泛化能力有限，难以准确遵循物理尺度和相机轨迹。

Result: 大量实验表明，Geo-Align在精确的相机可控性和视觉保真度方面持续优于现有的监督学习基线方法。

Insight: 主要创新点在于首次提出了一个专门用于相机控制视频重渲染的强化学习框架，并引入了尺度感知的感知奖励机制，通过一个度量3D估计器从生成视频中提取精确相机轨迹，显式惩罚旋转和平移偏差。此外，精心设计的数据流水线策略（结合真实世界条件视频和合成数据的目标轨迹）消除了对配对数据的依赖，这是一个关键的工程与算法创新。

Abstract: Camera-controlled video generation has achieved remarkable progress in recent years. However, existing video-to-video re-rendering methods primarily rely on Supervised Fine-Tuning using synthetic datasets. At present, there is an extreme scarcity of synchronized, multi-view real-world video data. Consequently, the prevailing paradigm often exhibits limited generalization when processing out-of-distribution real-world videos, with models struggling to accurately adhere to physical scales and camera trajectories. To bridge this gap, we propose Geo-Align, the first Reinforcement Learning framework specifically designed for camera-controlled video re-rendering. Built upon a pretrained model, we optimize the model through a scale-aware perceptual reward mechanism. Specifically, we introduce a metric 3D estimator to extract precise camera trajectories from generated videos, explicitly penalizing deviations in rotation and translation. Furthermore, we meticulously designed a data pipeline strategy based on real-world conditioning videos and target camera trajectories derived from synthetic data, eliminating the reliance on paired data. Extensive experiments demonstrate that Geo-Align consistently outperforms existing supervised learning baselines in both precise camera controllability and visual fidelity, indicating the effectiveness of our method.

[89] LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generation cs.CVPDF

Bo Jiang, Depu Meng, Yihan Hu, Yichen Xie, Tianshuo Xu

TL;DR: 本文提出LaMo方法，通过从无标签视频中提取运动线索，构建潜在运动先验来提升视频生成模型的物理真实性和运动一致性。该方法包含两个轻量级组件：训练时使用的宏观运动漂移损失和采样时使用的微观运动先验引导，可即插即用地与现有视频扩散模型结合。

Details

Motivation: 现有视频生成器在物理和运动一致性方面存在不足，限制了其作为可靠世界模拟器的应用。论文探索了一种自监督方法，从训练视频扩散模型的无标签视频中提取运动线索，以弥补这一缺陷。

Result: 在VideoPhy和VideoPhy2基准测试中，LaMo提升了CogVideoX基线的性能，并超越了使用外部监督的物理感知基线方法。在VBench上，它在保持整体生成质量的同时，改善了运动相关维度的表现。

Insight: 创新点在于提出了一种自监督的潜在运动先验框架，通过从现有训练数据中挖掘运动监督信号，无需外部模拟器或标注数据即可提升物理真实性。其即插即用的设计使其能灵活集成到现有视频扩散模型中。

Abstract: Modern video generators produce visually compelling clips but still struggle with physical and motion consistency, limiting their use as reliable world simulators. Existing remedies often rely on external simulators, teacher models, or curated physics-focused data. We explore a complementary self-supervised direction: extracting motion cues from the unlabeled videos already used to train video diffusion models. We propose LaMo, which formulates a latent motion prior over frame-to-frame latent changes conditioned on the current latent and prompt. This prior is exposed through two lightweight readouts: a macro motion drift used during training as a Motion Drift Loss, and a learned micro motion field used during sampling as Motion Prior Guidance. Both components are plug-and-play with existing video diffusion backbones, requiring no architectural or I/O changes. On VideoPhy and VideoPhy2, LaMo improves CogVideoX backbones and outperforms recent physics-aware baselines that use external supervision. On VBench, it preserves overall generation quality while improving motion-related dimensions. These results suggest that unlabeled video contains useful motion supervision for improving physical fidelity in modern video diffusion models.

cs.GR [Back]

[90] DrawVideo: Generating Long Video from Storyboard Keyframe Sketches cs.GR | cs.AI | cs.CV | cs.MM | eess.IVPDF

Chuanzhi Xu, Huiqi Liang, Bang Shi, Huiming Zhang, Yifan Xiao

TL;DR: 本文提出了DrawVideo，一个由草图引导、故事板驱动的可控长视频生成框架。它将长视频分解为独立可控的镜头，每个镜头由黑白草图、外观提示词和运动提示词定义，通过分层策略（先生成参考关键帧，再扩展为动作状态关键帧，最后合成镜头内片段）来生成视频。

Details

Motivation: 现有文本到视频方法通常依赖单一长提示词，难以对姿态、构图、布局和运动进行精细控制。本文旨在解决长视频生成中高保真合成、连贯叙事结构和用户对长时间跨度的控制需求。

Result: 实验表明，DrawVideo在结构可控性、外观一致性、视觉稳定性和连贯长视频生成方面表现出色。

Insight: 创新点在于提出了一个结合草图、外观和运动提示的分解式可控长视频生成框架，并构建了首个用于草图引导文本到长视频生成的数据集SketchLongVideo。其分层生成策略和镜头级别的独立控制为实现高质量、用户可控的长视频生成提供了新思路。

Abstract: Long video generation requires high-fidelity synthesis, coherent narrative structure, and user control over extended time spans. Existing text-to-video methods often rely on a single long prompt, limiting control over pose, composition, layout, and motion. We propose DrawVideo, a sketch-guided, storyboard-driven framework for controllable long-video generation. DrawVideo decomposes long videos into independently controllable shots, each defined by a black-and-white sketch, an appearance prompt, and a motion prompt. The sketch controls pose and layout, the appearance prompt defines identity, scene, and style, and the motion prompt guides temporal dynamics. DrawVideo follows a hierarchical ‘global multi-shot, local single-sketch’ strategy: it first generates a structure-aligned reference keyframe, then expands the motion prompt into derivative keyframes representing action states, and finally synthesizes clips between adjacent keyframes to build each shot. We also introduce SketchLongVideo, the first dataset for sketch-guided text-to-long-video generation, constructed from animation videos via shot detection, keyframe extraction, vision-language recognition, prompt decomposition, and sketch conversion. Experiments show that DrawVideo achieves strong structural controllability, appearance consistency, visual stability, and coherent long-video generation.

cs.RO [Back]

[91] Autonomous Frontier-Based Exploration with VLM Guidance cs.RO | cs.AI | cs.CLPDF

Aarush Aitha, Avideh Zakhor

TL;DR: 本文提出了一种利用视觉语言模型（VLM）进行高级战略决策，以指导传统低级机器人控制栈的自主探索新流程。在决策点，机器人会生成包含当前地图和潜在路径视觉图像的多模态提示，由VLM进行分析并选择最有希望的边界，从而用上下文空间推理取代简单的几何启发式方法。该方法在六个室内环境的仿真中得到验证，地图覆盖率比现有方法提高了24%。

Details

Motivation: 解决在未知和危险环境中进行自主机器人探索这一长期挑战，通过利用VLM的高级推理能力来显著提升探索性能。

Result: 在六个室内环境的仿真实验中，该方法的地图覆盖率比现有方法提高了24%，达到了新的SOTA水平。

Insight: 主要创新点在于将VLM作为轻量级、无需训练的高级战略决策器，替代了传统的几何启发式方法，实现了基于上下文的空间推理，并且该流程易于迁移到任何配备标准传感器和互联网连接的机器人上。

Abstract: Autonomous robotic exploration of unknown and hazardous environments, a long-standing challenge, can be significantly improved by leveraging the advanced reasoning of Vision-Language Models (VLMs). We introduce a novel exploration pipeline where a VLM performs high-level strategic decision-making, guiding a conventional low-level robotics control stack. At decision points, the robot generates a multimodal prompt with its current map and visual imagery of potential paths, or frontiers. The VLM analyzes this prompt to select the most promising frontier, replacing simple geometric heuristics with contextual spatial reasoning. This approach, validated in simulation across six indoor environments, improves map coverage by up to 24% over existing methods. Our pipeline is lightweight, training-free, and easily transferable to any robot with standard sensors and an internet connection.

Zixuan Hu, Xuantuo Huang, Yancheng Li, Yichun Hu, Shengyong Xu

TL;DR: 本文提出了一种名为IDEA的测试时适应框架，用于解决视觉语言导航（VLN）在非平稳环境变化下的挑战。该框架将在线适应过程转化为可积累和组合的‘资产’，通过软提示和域坐标构建动态资产库，并利用历史知识凸包构建跨域桥梁，以缓解灾难性遗忘和负迁移问题。

Details

Motivation: 现有VLN的测试时适应方法将在线适应视为瞬态、孤立的更新，导致灾难性遗忘和负迁移，无法应对真实世界中的非平稳环境变化。

Result: 在REVERIE、R2R和R2R-CE基准测试上的大量实验表明，IDEA始终优于现有方法，展示了其通过资产共享实现免训练适应的能力。

Insight: 创新点在于将适应过程资产化，通过Fisher引导的加权方案优化软提示来捕获可迁移知识，并构建动态资产库与跨域桥梁形成互补循环，为持续学习提供了新思路。

Abstract: Navigating under non-stationary environment shifts poses a critical challenge for a Vision-and-Language Navigation (VLN) agent deployed in the wild. Yet, existing Test-Time Adaptation (TTA) methods for VLN largely treat online adaptation as transient, isolated updates, leading to catastrophic forgetting and negative transfer. To overcome these issues, we propose Inter-Domain BridgE with Historical Assets (IDEA), a novel TTA framework that transforms adaptation into the accumulation and composition of assets. Specifically, IDEA introduces soft prompts optimized via a Fisher-guided weighting scheme to capture the transferable knowledge. These optimized prompts are then augmented with domain coordinates to form a dynamic asset library. Leveraging this library, IDEA constructs a cross-domain bridge by projecting the target domain onto the convex hull of historical knowledge. These designs form a complementary loop: the evolving library underpins bridge construction, while the bridge provides superior initialization to accelerate asset optimization. Extensive experiments across REVERIE, R2R, and R2R-CE benchmarks demonstrate the consistent superiority of IDEA over existing methods, showcasing its ability to enable training-free adaptation via asset sharing.

cs.LG [Back]

[93] The Readout Shortcut: Positional Number Copying Dominates Arithmetic CoT Readout in Small Language Models cs.LG | cs.AI | cs.CLPDF

Ming Liu

TL;DR: 该论文研究了小型语言模型在算术推理任务中思维链（CoT）提示的作用，发现模型在答案输出阶段主要依赖位置性捷径：即复制思维链中最后一个数字作为答案，而非真正执行逻辑计算。这一现象在三个1-3B参数规模的指令调优模型（GSM8K数据集）中得到验证，揭示了CoT可能仅作为答案传输通道而非推理过程。

Details

Motivation: 旨在探究小型语言模型中思维链提示对算术推理的实际贡献，特别是当打乱推理步骤顺序后性能仍得以保持时，CoT是否真正促进了逻辑序列推理，还是仅提供了结构性捷径。

Result: 在GSM8K数据集上，模型准确度的54-92%可归因于直接复制思维链末尾数字的捷径行为；即使答案错误，最终输出与最后一个CoT数字的匹配率仍达95-96%。若替换末尾数字为错误值，准确率骤降至接近零，而移除该数字可恢复5-32个百分点的性能。该现象在GSM-Symbolic数据集上可复现，但在非算术BBH任务中，打乱步骤的保留率显著下降。

Insight: 创新点在于揭示了小型语言模型在算术CoT中存在的‘位置性数字复制’捷径机制，这挑战了CoT作为真实推理过程的假设；同时指出基于步骤忠实度的评估方法可能混淆位置性答案传输与真实计算，为CoT监督机制提供了失效模式的重要洞见。

Abstract: Chain-of-thought (CoT) prompting is necessary for arithmetic in small language models, yet shuffling its steps preserves most performance. What does CoT contribute if not logical sequencing? In three 1-3B instruction-tuned LMs on GSM8K, we isolate the answer-readout stage via prefix completion and identify a positional shortcut: the model copies whichever number occupies the trailing position before the answer delimiter, regardless of intermediate reasoning. Gold-answer presence accounts for 54-92 pp of accuracy (89-92% of each model’s teacher-forcing ceiling); even on incorrect items, the final answer matches the last CoT number 95-96% of the time. The copy channel takes precedence over retained-context completion: replacing the trailing number with a wrong value collapses accuracy to near-zero despite correct intermediates, yet removing it recovers 5-32 pp above that floor–even single-step arithmetic the model can otherwise perform is suppressed when a copyable number is present. Qwen and Llama copy novel distractors 87-95% of the time; Gemma gates selectively. Head-level ablation implicates architecture-specific head sets; the effect replicates on GSM-Symbolic. On non-arithmetic BBH tasks, shuffle retention drops sharply; at 7-8B, content-selective gating emerges. Step-level faithfulness evaluations risk conflating positional answer transport with genuine computation–a failure mode for CoT-based oversight.

[94] When Do LLMs Reason? A Dynamical Systems View via Entropy Phase Transitions cs.LG | cs.AI | cs.CLPDF

Wei Xia, Haoqing Wang, Zhi-Hong Deng, Yehui Tang

TL;DR: 本文提出了一种动态视角来理解大语言模型（LLM）的推理时机，认为推理是一种在生成过程中涌现的“动态解码状态”，而非任务或模型的静态属性。研究发现，早期解码阶段的熵动态是这种状态的关键信号，并据此提出了一个无需训练的轻量级路由框架EDRM，用于自适应地选择推理策略，在多个基准测试和模型上实现了显著的token节省和精度提升。

Details

Motivation: 当前思维链（CoT）推理已成为增强LLM能力的默认策略，但其应用存在一个根本性问题：明确的推理究竟何时真正有益？实证证据揭示了一个悖论：在事实性和开放式任务上，CoT往往收益甚微甚至产生负面影响，同时却成倍增加了token消耗。本文旨在探究LLM推理何时发生，并寻求一种自适应、高效的方法来决定是否启用推理。

Result: 在15个基准测试和4种不同规模与架构的LLM上，提出的EDRM框架始终优于静态基线。在数据集层面，仅需50个校准样本，EDRM就能在提高精度的同时实现41-55%的token节省。在实例层面，它进一步将精度提升高达4.7%，同时保持27-45%的token节省。

Insight: 核心创新点在于将LLM推理视为一种动态涌现的解码状态，并通过早期解码熵的动态变化（类似于从高熵探索状态到低熵结构化推理状态的相变）来可靠地识别该状态。基于此，提出的EDRM框架通过将熵轨迹嵌入到一个紧凑、可解释的流形表示中，实现了无需训练、轻量级的自适应推理路由，为高效、自适应的LLM推理提供了新思路。

Abstract: Chain-of-thought (CoT) reasoning has become the default strategy for enhancing LLM capabilities, yet its application raises a fundamental question: when is explicit reasoning actually beneficial? Empirical evidence reveals a striking paradox: CoT often provides marginal or even negative gains on factual and open-ended tasks while multiplying token consumption. In this work, we show that LLM reasoning is not a static property of tasks or models, but a \emph{dynamic decoding state} that emerges during generation. Through systematic analysis, we find early-stage entropy dynamics provide a reliable signal of this state: tasks benefiting from CoT exhibit consistent entropy reduction, while others display unstable or increasing patterns. This behavior can be interpreted as a phase-transition-like shift from a high-entropy exploratory regime to a low-entropy structured reasoning regime. Based on these insights, we propose \textbf{EDRM} (Entropy Dynamics-based Reasoning Manifold), a lightweight and training-free routing framework that leverages early decoding entropy to adaptively select inference strategies. EDRM embeds entropy trajectories into a compact and interpretable manifold representation, enabling both zero-shot deployment and fine-grained instance-level adaptation. Across 15 benchmarks and 4 LLMs of varying scales and architectures, EDRM consistently outperforms static baselines. At the dataset level, EDRM achieves \textbf{41–55%} token reduction while improving accuracy with as few as 50 calibration samples. At the instance level, it further improves accuracy by up to \textbf{4.7%} while maintaining \textbf{27–45%} token savings. These results suggest that reasoning should be invoked selectively rather than by default, and demonstrate the effectiveness of entropy-driven decoding control for efficient and adaptive LLM inference.

[95] Transcoders Trace Visual Grounding and Hallucinations in Vision-Language Models cs.LG | cs.AI | cs.CLPDF

Dimitrios Damianos, Leon Voukoutis, Georgios Skyrianos, Vassilis Katsouros, Georgios Paraskevopoulos

TL;DR: 本文提出了一种基于Transcoders的函数中心化框架，用于解释生成式视觉语言模型（VLMs）中视觉输入如何转化为文本的内部机制。该框架将模型分解为可解释的计算路径，连接图像块与文本生成方向，并应用于Gemma 3-4B-IT模型。研究表明，Transcoder归因在视觉基础词上比稀疏自编码器（SAEs）更有效，能更好地对齐语义相关图像区域，并通过结构分析预测模型幻觉。

Details

Motivation: 生成式视觉语言模型在多模态推理上表现良好，但其视觉输入如何转化为文本的内部机制尚不明确。现有基于稀疏自编码器（SAEs）的可解释性方法侧重于分解静态残差表示，而忽略了驱动跨模态交互的功能性更新。

Result: 在Gemma 3-4B-IT模型上，Transcoder归因在图像块消融下对视觉基础词产生更强、更稳定的效果，且比SAE归因更好地对齐语义相关图像区域。通过反事实分析确认了恢复的路径对视觉-语言交互具有特异性。基于Transcoder轨迹图特征的逻辑分类器预测幻觉的AUC达到0.68。

Insight: 创新点在于采用函数中心化的Transcoder框架作为MLP子层的稀疏近似，以因果代理方式分解层间计算，从而获得可解释的多模态计算路径。该方法不仅提升了归因的准确性和稳定性，还能通过机制图特征有效预测模型幻觉，为理解VLM内部工作机制提供了新视角。

Abstract: Generative Vision-Language Models (VLMs) perform well on multimodal reasoning, but how visual inputs are transformed to text remains poorly understood. Existing interpretability work on VLMs uses Sparse Autoencoders (SAEs), which decompose static residual representations and miss the functional updates that drive cross-modal interaction. We adopt a function-centric framework based on Transcoders, sparse approximations of MLP sublayers that act as a causal proxy for layer-wise computation. Applied to Gemma 3-4B-IT, the framework decomposes the model into interpretable computational pathways linking image patches to directions in token generation. Transcoder attributions produce stronger and more stable effects on visually grounded tokens under patch ablation than SAE attributions, and align better with semantically relevant image regions. A False Visual Grounding counterfactual analysis confirms that the recovered pathways are specific to vision-language interaction.Finally, we perform a structural analysis of hallucinated generations, by extracting graph-based indicators from circuit traces produced by the transcoders. A logistic classifier over these mechanistic graph features predicts hallucinations at AUC $0.68$. These results show that function-centric circuit decomposition yields interpretable and predictive accounts of multimodal computation in VLMs.

[96] RADAR: Relative Angular Divergence Across Representations cs.LG | cs.CL | cs.CVPDF

Xavier Cadet, Mateusz Nowak, Peter Chin

TL;DR: 本文提出了一种名为RADAR的简单几何度量方法，用于评估基础模型中的跨领域可迁移性。该方法通过分析表示在层间的演变，测量角度对齐和距离的相对变化，并比较领域内与跨领域动态的经验分布，来预测迁移性能。

Details

Motivation: 解决在数据有限时，通过扩展数据源进行迁移学习可能导致的负迁移问题，即额外数据反而损害下游性能，需要一种方法来估计跨领域迁移的潜力。

Result: 在多个模态（如跨语言情感分类和跨领域图像分类）的基准测试中，RADAR相对于现有可迁移性度量方法具有竞争力的预测性能，尤其在领域过渡平滑或清晰分离时表现强劲。

Insight: 创新点在于提出了一种基于表示层间轨迹分布散度的几何度量；客观分析认为，其有效性依赖于模型内部表示空间的几何结构，不同模态可能偏好不同的拓扑公式，这为理解迁移学习的机制提供了新视角。

Abstract: Machine learning methods rely on data. However, gathering suitable data can be challenging due to availability constraints, cost, or the need for domain expertise. Expanding datasets with additional sources is a common response to limited data, yet this practice does not always improve downstream performance and can sometimes lead to a loss of performance, known as negative transfer. We propose RADAR, a simple, geometrically grounded metric for estimating cross-domain transferability in foundation models. RADAR analyzes the layer-wise evolution of representations by measuring angular alignments and relative changes in distance along layer-to-layer displacement trajectories, and by comparing empirical distributions of within-domain and cross-domain dynamics. We hypothesize that domain transferability is related to the divergence between these trajectory distributions. We evaluate the metric across multiple modalities, including cross-lingual sentiment classification with text embedding models and cross-domain image classification with foundation vision models. Across several settings, RADAR provides competitive predictive performance relative to existing transferability metrics on several vision and text benchmarks, with particularly strong results when domain transitions are smooth or cleanly separated. Our ablations further suggest that the effectiveness of transferability estimation depends on the geometry of the model’s internal representation space, with different modalities favoring different topological formulations.

[97] CoSPlay: Cooperative Self-Play at Test-Time with Self-Generated Code and Unit Test cs.LG | cs.AI | cs.CLPDF

Zhangyi Hu, Chenhui Liu, Tian Huang, Jindong Li, Yang Yang

TL;DR: 本文提出了CoSPlay框架，一种无需真实单元测试（GT-free）和训练的测试时自协作方法，用于改进大语言模型的代码生成。该方法通过协同自博弈，联合优化生成的代码和自生成的单元测试，利用代码-测试执行矩阵中的双向通过计数信号迭代改进两者，并最终基于输出一致性选择最终代码。

Details

Motivation: 现有基于可验证奖励的强化学习（RLVR）和测试时扩展（TTS）方法在代码生成中依赖于真实单元测试（GT UTs），这成为瓶颈。RLVR需要GT UTs进行昂贵的训练，而现有TTS方法在没有GT UTs时性能下降。因此，需要一种无需GT UTs的TTS方法，但自生成的单元测试往往存在噪声或与错误代码虚假耦合，而单元测试的质量又无法在没有可靠代码的情况下验证。核心挑战在于同时改进代码和单元测试。

Result: 在四个具有挑战性的基准测试上，CoSPlay应用于Qwen2.5-7B-Instruct模型，将平均BoN（Best of N）从22.1%提升至33.2%，并将单元测试准确率从14.6%提升至78.3%，性能匹配甚至超越了RLVR模型CURE-7B。当应用于CURE-7B时，其BoN进一步提升了5.7%。CoSPlay在不同骨干模型上具有良好的泛化性，在可比的计算预算下超越了其他无需GT的TTS基线方法，并且随着预算增加持续获得收益。

Insight: 论文的创新点在于提出了一个协同自博弈框架，通过代码与自生成单元测试的联合迭代进化来解决两者相互依赖的验证问题。关键机制包括：利用代码-测试执行矩阵的双向通过计数信号进行迭代剪枝与修复，以及当多个代码通过计数相同时，基于最大输出共识簇（即正确代码对相同输入输出一致）进行最终选择。这为无需任何真实数据即可实现有竞争力的代码生成提供了一种可扩展的推理策略。

Abstract: Recently, Reinforcement Learning with Verifiable Rewards (RLVR) and Test-Time Scaling (TTS) have advanced LLM code generation through executable verification. Yet Ground-Truth Unit Tests (GT UTs) remain a bottleneck: SOTA RLVR methods require them for costly training, while existing TTS methods lose competitiveness without them. This motivates GT-free TTS, where existing methods directly use self-generated UTs to refine and select code candidates. Yet such UTs are often noisy or spuriously coupled with wrong code, and UT quality in turn cannot be validated without reliable code. The key challenge is therefore to jointly improve both. To this end, we present CoSPlay, a GT-free, training-free framework that jointly improves codes and UTs through cooperative self-play. It first explores diverse solution ideas and identifies their potential failure modes to produce discriminative UT ideas. It then uses bidirectional pass-count signals from the Code-UT execution matrix to iteratively prune or fix weak codes and refresh or replace unreliable UTs, letting the two pools co-evolve. Finally, when multiple codes remain tied at the highest pass count, it picks the final code from the largest output-consensus cluster, since correct codes agree on the same inputs while wrong codes diverge. Experiments on four challenging benchmarks show that CoSPlay on Qwen2.5-7B-Instruct improves average BoN from 22.1% to 33.2% and UT accuracy from 14.6% to 78.3%, matching or surpassing the RLVR model CURE-7B. When applied to CURE-7B, it further improves BoN by 5.7%. CoSPlay also generalizes across diverse backbones and outperforms GT-free TTS baselines under comparable token budgets, with continued gains as the budget scales up. These results suggest a scalable inference strategy for competitive code generation without any GT data.

[98] MedExpMem: Adapting Experience Memory for Differential Diagnosis cs.LG | cs.AI | cs.CVPDF

Qianhan Feng, Zhongzhen Huang, Yakun Zhu, Yannian Gu, Winnie Chiu Wing Chu

TL;DR: 本文提出MedExpMem框架，旨在让基于视觉语言模型（VLM）的医学诊断智能体能够像经验丰富的医生一样积累鉴别诊断经验。该框架通过记忆智能体自身诊断失败中提炼出的鉴别性经验（以成对鉴别笔记形式组织），并在新病例中检索这些经验来指导鉴别推理，从而提升诊断准确性。

Details

Motivation: 当前医学视觉语言模型（VLMs）的参数编码的是静态知识，无法像医生那样通过临床实践积累鉴别混淆病症的能力，因此需要一种机制使诊断智能体能够动态积累和利用鉴别诊断经验。

Result: 在涵盖11个亚专业的放射学基准测试上，MedExpMem为不同模型和规模带来了持续性的准确率提升，最高达7.0%。分析实验验证了经验的质量和框架的鲁棒性。

Insight: 核心创新在于提出了一个模仿医生学习过程（初始实践暴露知识缺口，反思性再诊断完善理解）的经验记忆框架，该框架记忆的是从自身错误中提炼的、包含关键鉴别点、可操作决策规则和推理错误模式的成对鉴别笔记，而非检索百科全书式的疾病描述，这超越了参数化学习的局限，为医学适应需求提供了一种有竞争力的方法。

Abstract: Experienced physicians develop diagnostic expertise through clinical practice, acquiring not only disease knowledge but also the ability to differentiate confusable conditions. Current medical vision-language models (VLMs) lack this capability – their parameters encode static knowledge that does not evolve across diagnostic encounters. We propose MedExpMem, an experience memory framework enabling VLM-based diagnostic agents to accumulate differential diagnosis expertise. Unlike retrieval-augmented generation, which retrieves encyclopedic disease descriptions, MedExpMem memorizes discriminative experience derived from the agent’s own diagnostic failures and organizes them as pairwise differential notes encoding key discriminators, actionable decision rules and reasoning error patterns. The framework adopts a two-phase construction process mirroring physician learning: initial practice exposes knowledge gaps, and reflective re-diagnosis refines understanding. When encountering new cases, the agent retrieves experience memory to guide differential reasoning. We evaluate MedExpMem on a radiology benchmark spanning 11 subspecialties. Results demonstrate consistent accuracy improvements, maximum 7.0%, across diverse models and scales. Analytical experiments validate experience quality and robustness, demonstrating MedExpMem as a competitive method addresses medical adaptation needs beyond the reach of parameteric learning.

[99] Precise: SDE-Consistent Stochastic Sampling for RL Post-Training of Flow-Matching Models cs.LG | cs.AI | cs.CVPDF

Jade Zou, Tao Huang, Weijie Kong, Junzhe Li, Yue Wu

TL;DR: 本文提出了一种名为Precise的新型随机采样器，用于流匹配模型强化学习后训练中的随机采样。该方法通过设计一个平衡探索与稳定性的SDE调度，并引入一种新颖的近似来确保去噪轨迹的SDE一致性，从而解决了现有采样器在RL优化中存在的离散化噪声过大或启发式规则导致偏离数据分布的问题。

Details

Motivation: 动机在于将在线强化学习应用于流匹配模型时，需要将确定性采样轨迹转化为随机策略，而随机采样器的设计（包括探索程度和SDE离散化）对奖励优化性能有显著影响。现有方法在探索与稳定性之间存在内在张力，且离散化过程可能引入过多噪声或无法保证收敛。

Result: 大量实验表明，Precise采样器通过强化学习实现了显著更快、更稳定的奖励优化，在PickScore、HPSv2.1等对齐指标上达到了最先进的水平，同时将训练时间减少了13.1%至53.2%。

Insight: 创新点在于将采样器设计分解为探索调度和SDE一致性离散化两个相互依赖的组件，并提出了一种通过冻结干净潜在后验均值来保持SDE一致性的新近似方法，有效平衡了探索与稳定性，解决了标准采样器的过量噪声问题。

Abstract: Reinforcement learning (RL) has become an effective way to improve prompt alignment and perceptual quality in diffusion and flow-matching generators. A critical step for applying online RL to flow matching is turning the deterministic sampling trajectory into a stochastic policy, typically by replacing the reverse-time Ordinary Differential Equation (ODE) with a Stochastic Differential Equation (SDE). The stochastic sampler, controlling the exploration behavior and denoising dynamics, is thus part of the policy, and its design can significantly affect the reward optimization performance. We break down the sampler design into two interdependent components: choosing the right amount of stochastic exploration, and discretizing the resulting SDE faithfully at the small step counts used in RL. To address the first component, we analyze the inherent tension between exploration and stability in denoising and derive an SDE schedule that balances the two. Turning to the discretization challenge, we use a toy example to show that existing samplers can deviate from the flow-matching process, either by introducing excessive discretization noise or by relying on heuristic rules that do not guarantee convergence to the data distribution. To address these issues, we propose Precise, a new stochastic sampler that balances effective exploration with stability. Crucially, Precise keeps the denoising trajectory SDE-consistent through a novel approximation that freezes the clean-latent posterior mean, resolving the excess noise issue in standard samplers. Extensive experiments demonstrate that this formulation leads to significantly faster and more stable reward optimization via reinforcement learning, achieving state-of-the-art alignment scores (e.g., PickScore, HPSv2.1) while requiring 13.1-53.2% less wall-clock training time to match the best in-domain performance of prior samplers.

[100] Leveraging Foundation Models for Causal Generative Modeling cs.LG | cs.AI | cs.CVPDF

Aneesh Komanduri, Xintao Wu

TL;DR: 本文提出了FM-CGM，一个利用预训练基础模型进行端到端视觉因果推理的模块化框架。该框架通过概念提取器、概念操纵器和反事实生成器三个核心组件，结合大型推理模型进行因果推断和文本到图像扩散模型进行生成，实现了零样本的因果发现、干预和反事实生成。

Details

Motivation: 现有因果生成建模方法通常在训练生成模型时整合因果约束，但缺乏一个统一的框架来利用预训练基础模型的零样本推理能力。本文旨在解决这一问题，以开发能够进行反事实推理的可靠、透明AI系统。

Result: 实验表明，该方法能够识别合理的因果结构，并适用于忠实的反事实图像生成。

Insight: 主要创新点在于提出了一个模块化的FM-CGM框架，并开发了基于交叉注意力的因果语义引导（CSG）机制，该机制能确保语义干预传播到后代概念，同时保持不变区域。这为利用预训练基础模型进行零样本因果推理提供了新思路。

Abstract: Causal generative modeling is essential for developing reliable and transparent AI systems capable of counterfactual reasoning. While existing approaches focus on integrating causal constraints during the training of generative models, they often lack a unified framework to leverage the zero-shot reasoning capabilities of pretrained foundation models. We introduce FM-CGM, a modular framework for end-to-end visual causal reasoning using pretrained foundation models. FM-CGM formalizes the causal pipeline through three core components: a concept extractor, a concept manipulator, and a counterfactual generator. By leveraging a large reasoning model for causal inference and a text-to-image diffusion model for generation, our approach enables zero-shot causal discovery, intervention, and counterfactual generation. We then develop Causal Semantic Guidance (CSG), a cross-attention-based mechanism that ensures semantic interventions propagate to descendant concepts while preserving invariant regions. We empirically show that our approach can identify plausible causal structures and is suitable for faithful counterfactual image generation.

[101] Debiased Negative Mining Improves Out-of-distribution Detection with Pre-trained Vision-Language Models cs.LG | cs.CVPDF

Bo Peng, Jie Lu, Guangquan Zhang, Zhen Fang

TL;DR: 本文提出了一种去偏负样本挖掘方法，用于提升基于预训练视觉语言模型的分布外检测性能。该方法通过理论框架修正负标签的采样偏差，将其转化为基于ID标签和未标注野生数据的蒙特卡洛采样，从而更准确地挖掘真实负标签用于OOD评分。

Details

Motivation: 现有基于预训练视觉语言模型的OOD检测方法通常依赖启发式规则从未标注数据中挖掘负标签，但存在严重的假负例问题，限制了模型性能的充分发挥。

Result: 大量实验表明，该方法在多种OOD检测设置下均取得了新的最先进性能。

Insight: 创新点在于提出了一个理论框架来间接近似负标签分布以纠正采样偏差，并将去偏负样本挖掘自然地转化为基于ID标签和未标注数据的蒙特卡洛采样过程，从而更有效地识别真实负标签。

Abstract: Aiming at identifying unexpected inputs from unknown classes, out-of-distribution (OOD) detection has emerged as a pivotal approach to enhancing the reliability of machine learning models. This paper focuses on the burgeoning paradigm of post-hoc OOD detection with pre-trained vision-language models (VLMs), where a popular pipeline is to detect OOD inputs by examining their affinities between ID labels and negative labels, i.e., those semantically different from ID labels. Due to the unavailability of target OOD labels, existing works predominantly rely on heuristic rules to mine negative labels from unlabeled wild corpus data. Despite the empirical success, we argue that the power of VLM-based OOD detection has yet to be fully unleashed since the notorious false negative problem is far from addressed in the literature. With this motivation, we are interested in addressing the challenge of mining true negative labels for OOD scoring. To this end, we develop a theoretical framework for correcting the sampling bias of negatives labels by indirectly approximating the distribution of negative labels. Perhaps surprisingly, we show that the debiased negative mining can be naturally converted into Monte-Carlo sampling based on ID labels and the unlabeled wild corpus data. Extensive experiments empirically manifest that our method establishes a new state-of-the-art in a variety of OOD detection setups. Code is publicly available at \href{https://github.com/60pen9/Debiased-Negative-Mining-Improves-OOD-Detection-with-Pre-trained-VLMs}{\textcolor{red}{here}}.

eess.IV [Back]

[102] Discontinuous Galerkin Neural Operator for Pathology Defocus Deblurring eess.IV | cs.CV | cs.LGPDF

Shaoqing Duan, Haofei Song, Xintian Mao, Qingli Li, Yan Wang

TL;DR: 本文提出了一种用于病理显微镜离焦去模糊的间断伽辽金神经算子（DGNO），通过引入间断伽辽金公式来参数化积分核，以建模空间变化且局部不连续的模糊模式，从而超越现有方法。

Details

Motivation: 病理显微镜中的离焦模糊具有空间变化和局部不连续的特性，而现有深度学习方法受限于平移不变性假设和可解释性不足，无法有效处理这种异质模糊模式。

Result: 大量实验表明，DGNO在离焦去模糊任务上超越了现有最先进方法，实现了更清晰的图像重建、对空间变化模糊的鲁棒处理以及可扩展的高分辨率性能。

Insight: 创新点在于将间断伽辽金方法与神经算子结合，通过局部体积算子和界面数值通量参数化积分核，从而在保持光学成像物理原理的同时，实现了局部性、异质性建模和全局一致性的原则性结合。

Abstract: Defocus deblurring in pathological microscopy remains challenging due to the spatially varying and locally discontinuous nature of optical blur induced by a position-dependent integral imaging process. Existing deep learning methods, constrained by shift-invariance assumptions and limited interpretability, are not well suited to such heterogeneous blur patterns. Neural operators provide a principled alternative by modeling defocus formation directly as an integral operator, offering a new perspective on defocus deblurring. However, most existing neural operator architectures for low-level vision rely on globally parameterized kernels that assume smoothness and stationarity, limiting their ability to model heterogeneous and locally discontinuous blur patterns. To address this limitation, we propose the Discontinuous Galerkin Neural Operator (DGNO), which parameterizes the integral kernel using a discontinuous Galerkin formulation with element-local volume operators and interface numerical fluxes. DGNO provides a principled combination of locality, heterogeneity modeling, and global coherence while preserving the underlying physics of optical image formation. Extensive and insightful experiments demonstrate that DGNO surpasses state-of-the-arts, delivering sharper reconstructions, robust handling of spatially varying blur, and scalable high-resolution performance. The code will be released at https://github.com/DeepMed-Lab-ECNU/Single-Image-Deblur.

[103] STAMBRIDGE: Spectral-Temporal Amplitude-aware Mid-Feature Bridge for EEG Visual Decoding eess.IV | cs.CVPDF

Jiahe Meng, Weiming Zeng, Yueyang Li, Bo Chai, Hongjie Yan

TL;DR: 本文提出STAMBRIDGE，一个用于脑电图视觉解码的两阶段框架，旨在解决低信噪比神经信号与结构化视觉-语言空间之间的模态鸿沟问题。该框架首先通过谱-时幅度感知调制提取条件良好的EEG表征，然后利用模型无关的中间特征语义桥构建正则化的中间空间，实现稳定的跨模态语义对齐。

Details

Motivation: 动机在于直接对齐低信噪比的EEG信号与高度结构化的视觉-语言空间不稳定且困难，因此需要一种方法先对EEG特征进行有效调理，再实现稳健的跨模态对齐。

Result: 在THINGS-EEG基准测试中，该方法在200类零样本检索任务上取得了有竞争力的结果，Top-1准确率为34.50%，Top-5准确率为65.95%。此外，学到的嵌入能通过扩散模型生成语义一致的图像重建，证明了稳健的EEG到视觉语义对齐。

Insight: 创新点包括用幅度导出的软通道加权和多尺度时间卷积替代硬频率掩码，以保留频率感知瞬态并减少时域振铃伪影；以及构建一个模型无关的中间特征语义桥，通过定向跨模态交互实现分阶段蒸馏和稳定对齐。从客观角度看，其两阶段设计（特征调理与对齐分离）和软加权机制是处理噪声神经信号跨模态任务的有效策略。

Abstract: Electroencephalography (EEG) visual decoding remains challenging due to the modality gap between low-SNR neural signals and highly structured vision–language spaces, making direct cross-modal alignment unstable. To address this, we propose STAMBRIDGE, a versatile two-stage framework that sequentially tackles feature conditioning and cross-modal alignment. First, we introduce a Spectral-Temporal Amplitude-aware Modulation (STAM) to extract well-conditioned EEG representations. By replacing hard frequency masking with amplitude-derived soft channel weighting and multi-scale temporal convolutions, STAM explicitly preserves frequency-aware transients while reducing the risk of time-domain ringing artifacts. Building upon these robust neural features, we further introduce a model-agnostic Mid-Feature Semantic Bridge (MFSB) that constructs a regularized intermediate space through directed cross-modal interactions, enabling staged distillation and more stable semantic alignment. Experiments on the THINGS-EEG benchmark show competitive 200-way zero-shot retrieval performance, with 34.50% Top-1 and 65.95% Top-5 accuracy. In addition, embeddings learned by STAMBRIDGE produce semantically coherent image reconstructions with a diffusion model, demonstrating robust EEG-to-vision semantic alignment. The code is available at: https://github.com/thabeatmjh/STAMBRIDGE.

cs.AI [Back]

[104] SciAtlas: A Large-Scale Knowledge Graph for Automated Scientific Research cs.AI | cs.CL | cs.IR | cs.LGPDF

Shuofei Qiao, Yunxiang Wei, Jiazheng Fan, Bin Wu, Busheng Zhang

TL;DR: 本文介绍了SciAtlas，一个大规模、多学科、异构的学术资源知识图谱，旨在构建全景式的科学演化网络。它整合了来自26个学科的超过4300万篇论文，包含1.57亿个实体和30亿个三元组，为AI智能体提供了一个结构化的拓扑认知基础。论文还提出了一种神经符号检索算法，实现了从简单语义匹配到确定性关联发现的过渡，并展示了其在文献综述、自动化研究趋势合成等关键应用方向上的潜力。

Details

Motivation: 全球学术产出的指数级增长导致了“信息爆炸”，现有学术检索工具主要依赖浅层的关键词匹配或向量空间语义检索，缺乏导航复杂逻辑连接的拓扑推理能力，而基于智能体的深度研究框架又容易产生逻辑幻觉且推理成本高昂。SciAtlas旨在弥合这一差距。

Result: 论文提出了一个包含1.57亿实体和30亿三元组的大规模知识图谱SciAtlas，并开发了一种结合三路径协同召回和图重排的神经符号检索算法。虽然没有在摘要中明确提及与特定基准（benchmark）的定量比较结果，但宣称该图谱和算法能够显著降低推理成本，并作为有效的“认知地图”赋能自动化科学研究的全流程。

Insight: 主要创新点在于构建了一个大规模、跨学科的结构化知识图谱作为AI的认知基础，并设计了神经符号检索算法来融合语义匹配与图结构关联发现。这为解决学术信息碎片化、提升AI在科学研究中的逻辑推理能力并控制成本提供了新的思路和基础设施。

Abstract: The exponential growth of global academic output has confronted researchers and AI agents with an unprecedented information explosion,'' where fragmented and unstructured knowledge organization impedes deep interdisciplinary integration. Current academic retrieval tools predominantly rely on superficial keyword matching or vector-space semantic retrieval, which lack the topological reasoning capabilities required to navigate complex logical connections. Agentic deep-research-based frameworks are often prone to logical hallucinations and consuming high inference costs. To bridge this gap, in this report, we introduce SciAtlas, a large-scale, multi-disciplinary, heterogeneous academic resource knowledge graph designed as a panoramic scientific evolution network. By integrating over 43M papers from 26 disciplines, and a total of 157M entities and 3B triplets, SciAtlas provides a structured topological cognitive substrate that dismantles disciplinary barriers and furnishes AI agents with a global perspective. Furthermore, we develop a neuro-symbolic retrieval algorithm featuring tri-path collaborative recall and graph reranking, achieving a seamless transition from simple semantic matching to deterministic association discovery. We also present key application directions of SciAtlas, including literature review, automated research trend synthesis, idea positioning, and academic trajectory exploration, to demonstrate that SciAtlas can serve as an effective cognitive map’’ to empower the full loop of automated scientific research while significantly reducing reasoning costs. We have released the interfaces for KG retrieval and various downstream tasks in our GitHub repo.

[105] The Deterministic Horizon: Impossibility Results as Design Specifications for Trustworthy AI Systems cs.AI | cs.CC | cs.CL | cs.LGPDF

Dongxin Guo

TL;DR: 这篇论文将AI中的不可能性定理（如图灵、阿罗、没有免费午餐定理）转化为可计算的设计规范，用于构建可信AI系统。核心贡献是提出了’确定性视界’理论，证明仅由架构（层数和嵌入宽度）决定的推理深度上限，超过此上限后任何训练都无法提升准确性，并在12种Transformer架构中测量出该视界在19到31层之间。论文还跨多个子领域推导了16条设计规范，每条都包含可计算边界、违规成本和建设性设计规则。

Details

Motivation: 动机是将AI中的基础理论限制（不可能性结果）从理论好奇转化为实际系统设计规则，为构建可信赖的AI系统提供可计算、可验证的设计规范，解决当前AI系统（如大语言模型）在软件编写、法律文档等关键应用中缺乏理论保障的问题。

Result: 在12种Transformer架构中测量出’确定性视界’（推理深度上限）介于19到31层之间；微调最优长度轨迹可恢复不到4个百分点的准确率；神经推理的零知识验证每个非线性激活需要支付110到190倍的开销；推导出16条跨子领域的设计规范。

Insight: 创新点在于将不可能性定理系统性地转化为可计算的设计规范（’不可能性-规范’方法论），核心发现是架构本身设定了不可逾越的准确率上限（确定性视界），并通过信息论转换证明超过视界后准确率超指数衰减。客观来看，这为AI系统提供了事前可计算的理论性能边界和违规成本量化方法。

Abstract: Large language models now write software, draft legal documents, and produce clinical notes, yet fundamental limits, from Turing and Arrow to the No Free Lunch theorems, shape what computation can do. This thesis turns such impossibility results from curiosities into design rules. Its flagship result proves an accuracy ceiling set by architecture alone: past a critical reasoning depth, no amount of training moves it, at any adapter rank, sample size, or loss function. Computable before deployment from layer count and embedding width, this Deterministic Horizon is measured between nineteen and thirty-one across twelve transformer architectures, and fine-tuning on optimal-length traces recovers under four percentage points. The mechanism is a capacity invariant of the residual stream, and an information-theoretic conversion yields super-exponential accuracy decay past the horizon. An unconditional circuit-complexity lower bound for modular exponentiation against constant-depth prime-modulus circuits complements this result. The same argument recasts across subfields: preference learning under any misspecified model jumps discontinuously in sample complexity; multi-stage retrieval pipelines require at least as many independent metrics as stages; standard truthful auctions fail for agents with prompt-dependent valuations; and zero-knowledge verification of neural inference pays a measured overhead of one hundred ten to one hundred ninety times per non-linear activation. Together these form a catalogue of sixteen specifications, each pairing a computable boundary, a quantified violation cost, and a constructive design rule: two compositions are proved, one pairing is an honest obstruction, and four remain open. The impossibility-specification methodology is offered for the generative research programme that trustworthy AI may need. Every fundamental limit of AI is also a design rule.

[106] SkillOpt: Executive Strategy for Self-Evolving Agent Skills cs.AI | cs.CLPDF

Yifan Yang, Ziyang Gong, Weiquan Huang, Qihao Yang, Ziwei Zhou

TL;DR: SkillOpt是一种用于智能体技能自我演化的系统化可控文本空间优化器，它将技能视为冻结智能体的外部状态进行训练，通过优化器模型将评估后的执行轨迹转化为对技能文档的增删改编辑，并采用验证集严格筛选编辑以确保持续改进。该方法在六个基准测试、七个目标模型和三种执行框架中均取得最佳或并列最佳性能，显著提升了无技能基准准确率。

Details

Motivation: 当前智能体技能的构建方式（手工制作、一次性生成或松散控制的自我修订）缺乏像深度学习优化器那样的系统性和可控性，且无法在反馈下可靠地超越初始性能，因此需要一种能够稳定优化技能文本的方法。

Result: 在六个基准测试、七个目标模型和三种执行框架（直接对话、Codex、Claude Code）的52个评估单元中，SkillOpt均优于或持平所有竞争对手（包括人工、一次性LLM、Trace2Skill等方法）；在GPT-5.5上，直接对话、Codex代理循环和Claude Code中的平均无技能准确率分别提升23.5、24.8和19.1个百分点。

Insight: 将技能作为冻结智能体的外部状态进行优化，引入文本学习率预算、拒绝编辑缓冲和周期性的慢/元更新机制，实现了稳定训练且无需增加部署时的推理调用；优化后的技能可跨模型规模、执行环境甚至相近任务迁移，体现了技能作为可复用文本工件的价值。

Abstract: Agent skills today are hand-crafted, generated one-shot, or evolved through loosely controlled self-revision, none of which behaves like a deep-learning optimizer for the skill, and none of which reliably improves over its starting point under feedback. We argue the skill should instead be trained as the external state of a frozen agent, with the same discipline that makes weight-space optimization reproducible. SkillOpt is, to our knowledge, the first systematic controllable text-space optimizer for agent skills: a separate optimizer model turns scored rollouts into bounded add/delete/replace edits on a single skill document, and an edit is accepted only when it strictly improves a held-out validation score. A textual learning-rate budget, rejected-edit buffer, and epoch-wise slow/meta update make skill training stable while adding zero inference-time model calls at deployment. Across six benchmarks, seven target models, and three execution harnesses (direct chat, Codex, Claude Code), SkillOpt is best or tied on all 52 evaluated (model, benchmark, harness) cells and beats every per-cell competitor among human, one-shot LLM, Trace2Skill, TextGrad, GEPA, and EvoSkill skills. On GPT-5.5 it lifts the average no-skill accuracy by +23.5 points in direct chat, by +24.8 inside the Codex agentic loop, and by +19.1 inside Claude Code. Transfer experiments further show that optimized skill artifacts retain value when moved across model scales, between Codex and Claude Code execution environments, and to a nearby math benchmark without further optimization.

Table of Contents

cs.CL [Back]

[1] Evaluating Large Language Models in a Complex Hidden Role Game cs.CL | cs.AI | cs.GT | cs.MAPDF

[2] Learnability-Informed Fine-Tuning of Diffusion Language Models cs.CL | cs.LGPDF

[3] What Training Data Teaches RL Memory Agents: An Empirical Study of Curriculum Effects in Memory-Augmented QA cs.CLPDF

[4] DFKI-MLT at SemEval-2026 TASK 7: Steering Multilingual Models Towards Cultural Knowledge cs.CLPDF

[5] Same Model, Different Weakness: How Language and Modality Reshape the Jailbreak Attack Surface in Frontier MLLMs cs.CLPDF

[6] Fast-dDrive: Efficient Block-Diffusion VLM for Autonomous Driving cs.CLPDF

[7] Positional Failures in Long-Context LLMs: A Blind Spot in Reasoning Benchmarks cs.CL | cs.AI | cs.LGPDF

[8] Convergence Without Understanding: When Language Models Agree on Representations but Disagree on Reasoning cs.CL | cs.AIPDF

[9] ClimateChat-300K: A Multi-Modal Facebook Dataset for Understanding Diverse Perspectives in Climate Communication cs.CLPDF

[10] Emotion Recognition in Sign Language Conversation cs.CLPDF

[11] From Correctness to Preference: A Framework for Personalized Agentic Reinforcement Learning cs.CLPDF

[12] Metacognition as Reward: Reinforcing LLM Reasoning via Knowledge and Regulation Signals cs.CL | cs.AIPDF

[13] Naturalistic measure of social norms alignment cs.CLPDF

[14] ARES: Automated Rubric Synthesis for Scalable LLM Reinforcement Learning cs.CLPDF

[15] Asking For An Old Friend: Diagnosing and Mitigating Temporal Failure Modes in LLM-based Statutory Question Answering cs.CLPDF

[16] ChartFI: Benchmarking Faithfulness and Insightfulness of Chart Descriptions from Multimodal Large Language Models cs.CLPDF

[17] OnePred: Next-Query Prediction via Recursive Intent Memory in Multi-Turn Conversations cs.CL | cs.AIPDF

[18] Multilingual Knowledge Transfer under Data Constraints via Lexical Interventions cs.CLPDF

cs.CV [Back]

[19] GEM-4D: Geometry-Enhanced Video World Models for Robot Manipulation cs.CV | cs.ROPDF

[20] Seeing without Looking: Do Vision-Language Benchmarks Really Test Vision? cs.CV | cs.AI | cs.CLPDF

[21] Suicide Risk Assessment from AI-powered Video Surveillance: An Interpretable Framework for Prevention in Metro Stations cs.CV | cs.AIPDF

[22] GazeBehavior Annotation Toolkit (GBAT): AI-powered toolkit for automatic annotation of egocentric eye-tracking and video data of child-caregiver interaction cs.CV | cs.CE | cs.HC | cs.SE | q-bio.NCPDF

[23] VideoOdyssey: A Benchmark for Ultra-Long-Context and Omni-Modal Video Understanding cs.CVPDF

[24] Improved Vision-to-Chart Buoy Association with Learned World-to-Image Projection cs.CVPDF

[25] The TIME Machine: On The Power of Motion for Efficient Perception cs.CV | cs.AI | cs.LGPDF

[26] CoMoGen: COntrollable MOtion Dynamics and Interactions with Mask-Guided Video GENeration cs.CVPDF

[27] Dithering Defense: Adversarial Robustness of Vision Foundation Models via Multi-Level Floyd-Steinberg Dithering cs.CV | cs.AI | cs.LGPDF

[28] RoboSurg-VQA: A Multimodal Benchmark for Surgical Segmentation-Aware Visual Question Answering cs.CVPDF

[29] Inconsistency-aware Multimodal Schrödinger Bridge for Deepfake Localization cs.CVPDF

[30] CoReVAD: A Contextual Reasoning Framework for Training-Free Video Anomaly Detection cs.CV | cs.AIPDF

[31] VisAnalog: A Diagnostic Suite for Visual Concept Transfer on Natural Images cs.CVPDF

[32] SLIP-RS: Structured-Attribute Language-Image Pre-Training for Remote Sensing Object Detection cs.CVPDF

[33] LQ-rPPG: A Label-Quantized Coarse-to-Fine Learning Framework for Remote Physiological Measurement cs.CVPDF

[34] DRIVESPATIAL: A Benchmark for Spatiotemporal Intelligence in VLMs for Autonomous Driving cs.CVPDF

[35] IntentionNav: A Benchmark for Intent-Driven Object Navigation from Implicit Human Instruction cs.CV | cs.ROPDF

[36] Occlusion-Aware Physics-Semantic Keyframe Selection for Robust Video Editing cs.CVPDF

[37] Lipschitz Optimization for Formal Verification of Homographies cs.CV | cs.AI | cs.LG | cs.ROPDF

[38] CaST-Bench: Benchmarking Causal Chain-Grounded Spatio-Temporal Reasoning for Video Question Answering cs.CVPDF

[39] StereoGenBench: A Synthetic Multi-Camera Benchmark for Stereo Generation under Controlled Baseline Regimes cs.CVPDF

[40] CARE: Class-Adaptive Expert Consensus for Reliable Learning with Long-Tailed Noisy Labels cs.CVPDF

[41] SimInsert: Seamless Video Object Insertion via Regional Sparse Attention Fusion cs.CV | cs.AIPDF

[42] ChainFlow-VLA: Causal Flow Planning with Vision-Language Models cs.CV | cs.AI | cs.ROPDF

[43] EvalVerse: Pipeline-Aware and Expert-Calibrated Benchmarking for Professional Cinematic Video Generation cs.CV | cs.AIPDF

[44] U-CESE: Unified Clip-based Event Search Engine for AI Challenge HCMC 2025 cs.CVPDF

[45] LangFlash: Feed-forward 3D Language Gaussian Splatting from Sparse Unposed Images cs.CVPDF

[46] DepthAgent: Towards Better Universal Depth Estimation via Sample-wise Expert Selection cs.CVPDF

[47] Spatio-Temporal Similarity Volume Aggregation for Open-Vocabulary Action Recognition cs.CVPDF

[48] General Hazard Detection cs.CVPDF

[49] GFSR: Geometric Fidelity and Spatial Refinement for Reliable Lane Detection cs.CVPDF

[50] CHASD: Language Increment-Calibrated Contrastive Decoding against Hallucination in LVLMs cs.CV | cs.AIPDF

[51] SCOPE: Simulating Cross-game Operations in Playable Environments for FPS World Models cs.CVPDF

[52] Decoupling Spatio-Temporal Adapter for Fine-Grained Badminton Action Localization cs.CV | cs.LG | cs.MMPDF

[53] VDE: Training-Free Accelerating Rectified Flow Model via Velocity Decomposition and Estimation cs.CVPDF

[54] Online Hand Gesture Recognition Using 3D Convolutional Neural Networks cs.CV | cs.AIPDF

[55] RS2AD-LiDAR: End-to-End Autonomous Driving LiDAR Data Generation from Roadside Sensor Observations cs.CVPDF

[56] Joint Target-Less Intrinsic and Extrinsic Camera-LiDAR Calibration using Deep Point Correspondences cs.CVPDF

[57] FAST-ME: Foundation-aware Adaptive Stopping for Motion Estimation for Efficient IoT Video Analysis cs.CV | cs.MMPDF

[58] DFSAttn: Dynamic Fine-grained Sparse Attention for Efficient Video Generation cs.CVPDF

[59] One-Forcing: Towards Stable One-Step Autoregressive Video Generation cs.CV | cs.AIPDF

[60] Rethinking Transfer Learning for Industrial Inspection: DINOv3 vs. ImageNet Pretraining Across RGB and X-ray Tasks cs.CVPDF

[61] B-GRTO: Bootstrapped Group Relative Tool Optimization for Referring Segmentation cs.CV | cs.LGPDF

[62] Multimodal Distribution Matching for Vision-Language Dataset Distillation cs.CV | cs.AIPDF

[63] MDS-DETR: DETR with Masked Duplicate Suppressor cs.CVPDF

[64] ComPose: When to Trust Hands for Object Pose Tracking cs.CVPDF

[65] PixIE: Prompted Pixel-Space Low-Light Image Enhancement cs.CVPDF

[66] Generator-Refiner-Examiner: A Tri-Module Data Augmentation Framework for 3D Human Avatar Learning from Monocular Videos cs.CVPDF

[67] PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQA cs.CV | cs.AIPDF

[68] Calibration-Informative Region Selection for Online LiDAR–Camera Calibration in Agricultural Environments cs.CVPDF

[69] EM-Vid: Training-Free Entity-Centric Memory for Efficient and Consistent Multi-Shot Video Generation cs.CV | cs.AIPDF

[70] GlowGS: Generative Semantic Feature Learning for 3D Gaussian Splatting in Nighttime Glow Scenes cs.CVPDF

[71] DDX-TRACE: A Benchmark for Medical Diagnostic Trajectories in VLMs cs.CVPDF

[72] ExpOS: Explainable Open-Surgery Skills Assessment Using 3D Hand Reconstruction cs.CVPDF

[73] CVSearch: Empowering Multimodal LLMs with Cognitive Visual Search for High-Resolution Image Perception cs.CV | cs.AI | cs.LG | cs.MMPDF

[74] RiGS: Rigid-aware 4D Gaussian Splatting from a Single Monocular Video cs.CVPDF

[75] Recursive Block-Diagonal Coupling for Resource-Efficient Training of Vision Models cs.CVPDF

[76] Weierstrass Positional Encoding for Vision Transformers cs.CV | cs.AIPDF

[77] CRONOS: Benchmarking Counterfactual Physical Consistency in Video Models cs.CVPDF