cs.CL [Total: 21]
cs.CV [Total: 84]
cs.RO [Total: 6]
cs.MM [Total: 1]
cs.HC [Total: 1]
cs.IT [Total: 1]
physics.med-ph [Total: 1]
cs.IR [Total: 1]
cs.LG [Total: 8]
cs.AI [Total: 2]

cs.CL [Back]

[1] Identifying and Resolving Pitfalls of Knowledge-Based VQA Benchmarks: Auditing, Repairing, and Augmenting cs.CL | cs.CV | cs.IR | cs.MMPDF

Qian Ma, S M Rayeed, Charles V. Stewart, Qiong Wu, Yao Ma

TL;DR: 本文对基于知识的视觉问答（KB-VQA）基准进行了系统性审计，发现现有数据集存在答案缺失或矛盾、问题定义模糊以及视觉场景过于简单等问题，导致准确率指标不可靠。作者提出了一种审计修复协议以恢复答案可推导性和问题清晰度，并引入多实体增强协议以增加视觉歧义，重新评估后性能趋势显著变化。

Details

Motivation: 现有KB-VQA基准广泛采用答案准确率作为评估指标，隐含假设答案可从知识库推导、问题定义充分且视觉场景需要基于知识的消歧，但这些假设常被违反，导致评估失真。

Result: 审计显示现有基准存在大量问题实例，修复和增强后的重新评估导致模型排名和性能估计发生显著变化，凸显了当前评估的局限性。

Insight: 创新点在于提出了系统性的审计修复协议和视觉增强方法，强调需要设计更注重可验证推理而非简单匹配的KB-VQA基准，对评估协议的设计具有重要启示。

Abstract: Knowledge-Based Visual Question Answering (KB-VQA) aims to evaluate whether Visual Language Models (VLMs) can retrieve, ground, and reason over external structured knowledge beyond visual evidence. In practice, answer accuracy is widely adopted as the primary evaluation metric, implicitly treating correctness as a proxy for knowledge-grounded reasoning. However, for existing KB-VQA benchmarks, this proxy relies on critical assumptions that are often overlooked and rendered unreliable by benchmark issues: annotated answer must be derivable from the associated knowledge base, question must be well-posed with sufficient constraints, and visual setting must meaningfully require grounded disambiguation. In this work, we show that these assumptions are systematically violated in existing KB-VQA benchmarks. Our audit reveals substantial instances with missing or contradicted answers and underspecified questions that render accuracy a misleading metric. Furthermore, we find that existing datasets rely on visually trivial, single-entity scenes that bypass the need for sophisticated visual-to-knowledge mapping. We demonstrate that even with controlled architectures, these flaws lead to distorted model rankings and overestimations of reasoning capabilities. To address this, we introduce (1) a principled audit-and-repair protocol that restores answer derivability and question clarity, and (2) a controlled multi-entity augmentation protocol that introduces visual ambiguity to challenge initial retrieval and grounded reasoning. Re-evaluation under corrected and augmented settings yields markedly different performance trends. Our findings call for rethinking evaluation protocols and designing more interaction-aware KB-VQA benchmarks that prioritize verifiable reasoning over simple matching.

[2] Benchmarking Frontier LLMs on Arabic Cultural and Sociolinguistic Knowledge: A Cross-Evaluation Framework with Human SME Ground Truth cs.CLPDF

Sajjad Abdoli, Ghassan Al-Sumaidaee, Ahmad ElShiekh, Clayton W. Taylor, Ahmed Rashad

TL;DR: 本文提出了一种针对阿拉伯语文化与社会语言学知识的交叉评估框架，旨在解决高成本人类专家评估的瓶颈问题。该框架在埃及和伊拉克阿拉伯语方言社区上实例化，使用103个经过验证的提示-评分标准对，并由三位前沿大语言模型作为目标模型接受人类专家评估，五位前沿大语言模型作为自动评分法官。研究发现，GPT-5.4是最可靠的自动评分法官，文化任务比语言任务更难评分，且模型在埃及阿拉伯语提示上的表现显著优于伊拉克阿拉伯语提示。

Details

Motivation: 人类专家评估的高成本是语言模型在专业高风险领域部署的主要瓶颈，尤其是在需要深厚文化熟悉度的阿拉伯语社会语言学知识评估中，表面指标无法替代。

Result: 在1307次法官评估中，GPT-5.4是最可靠的自动评分法官（MADj = 10.21 pp，Signed Error = -1.12%）；五位法官中有四位表现出系统性宽松（+2.01% 至 +6.56%）；文化任务比语言任务对所有法官都更难评分（MAD差距1.83-4.78 pp）；模型在埃及阿拉伯语提示上的表现显著优于伊拉克阿拉伯语提示。

Insight: 创新点在于提出了一个结合人类专家真实数据和自动评分法官的交叉评估框架，使用惩罚加权评分标准区分正面内容要求和负面错误标准，并采用结合平均绝对偏差（MAD）与符号平均误差的双指标方案来分离方向性评分偏差与对称噪声。客观分析发现，隐式文化推理（要求模型模拟母语者判断而非依赖词汇验证）是所有自动评分模型的主要失败模式，这为未来评估方法设计提供了关键洞见。

Abstract: The cost of human expert evaluation is a principal bottleneck to deploying language models in specialized, high-stakes domains. This is particularly acute for Arabic sociolinguistic knowledge: credible grading requires not only linguistic fluency but deep cultural familiarity that cannot be approximated by surface-level metrics. We address this with a cross-evaluation framework instantiated on two underrepresented Arabic dialect communities: Egyptian and Iraqi Arabic. We contribute 103 validated prompt-rubric pairs (70 Egyptian, 33 Iraqi; 53 Cultural, 50 Linguistic), authored and graded by native-speaker SMEs using penalty-weighted rubrics distinguishing positive content requirements from answer-specific negative error criteria. Three frontier LLMs serve as target models (graded by human SMEs across 302 unique prompt-response pairs), while five frontier LLMs serve as automated judges enforcing a provider-level self-evaluation guard. A dual-metric scheme combining Mean Absolute Deviation (MAD) with Signed Mean Error separates directional grading bias from symmetric noise. Across 1,307 judge evaluations: GPT-5.4 is the most reliable judge (MADj = 10.21 pp, Signed Error = -1.12%); four of five judges show systematic leniency (+2.01% to +6.56%); Cultural tasks are harder to grade than Linguistic tasks for all judges (MAD gap 1.83-4.78 pp); and models substantially outperform on Egyptian prompts compared to Iraqi prompts. However, given leniency differences between Iraqi and Egyptian SMEs, we cannot solely attribute this gap to model knowledge. We therefore emphasize findings that do not assume identical leniency across human graders. Across all samples, implicit cultural reasoning – requiring models to simulate native-speaker judgment rather than rely on lexical verification – emerges as the primary failure mode for automated grading across all judge models.

[3] SLIM-RL: Risk-Budgeted Random-Masking RL for Diffusion LLMs Without Trajectory Slicing cs.CL | cs.AI | cs.LGPDF

Ruikang Zhao, Zhenting Wang, Han Gao, Ligong Han

TL;DR: 本文提出了SLIM-RL方法，一种用于扩散大语言模型（dLLM）的无轨迹强化学习框架。该方法通过引入τ-预算解码器来约束每一步生成的风险，并使用免于轨迹重建的随机掩码目标进行优化，结合了序列级重要性采样和确定性积分等技术。该方法在数学和代码基准上超越了现有方法TraceRL，并实现了更高的样本效率。

Details

Motivation: 当前最先进的TraceRL等方法认为随机掩码与模型推理轨迹不匹配，需要通过将每个生成序列切片成多个轨迹对齐的样本来重建轨迹，这导致计算成本随块大小K增长。本文旨在解决这种不匹配问题，但避免重建轨迹的高昂成本。

Result: 在SDAR-4B模型上，SLIM-RL在块大小为16时，仅用0.46倍于TraceRL的训练样本就达到了其最佳的MATH500准确率，并在匹配的动态采样下，在MATH500和GSM8K上分别提升了6.32%和11.05%。在块大小为4时，4B的SLIM-RL在数学任务上超越了更大的LLaDA-8B和Dream-7B模型，在MATH500上超过LLaDA-8B 10.76%，同时在代码任务MBPP和HumanEval上分别比TraceRL提升了4.20%和3.65%。

Insight: 核心创新在于通过τ-预算解码器控制生成风险，避免了轨迹重建；同时，提出的免轨迹随机掩码优化目标结合了序列级重要性采样和确定性积分，并引入了一种均值保持、单调递减的每块掩码调度策略。该方法实现了更高的样本效率和性能，且τ-预算解码器具备跨模型（LLaDA, Dream, SDAR）的无训练迁移能力。

Abstract: Reinforcement learning for diffusion large language models (dLLMs) has largely moved to trajectory-aware methods. The current state of the art, TraceRL, holds that random masking is mismatched with the model’s inference trajectory, and it reconstructs that trajectory during training by slicing each rollout into up to K/s trajectory-aligned training samples, a cost that grows with the block size K. We show that this mismatch can be mitigated without reconstructing the trajectory. Our method, SLIM-RL, bounds the commit risk of each rollout step with a tau-budget decoder, reducing aggregate commit risk in the training data. During optimization, SLIM-RL trains on these risk-controlled rollouts with a trace-free random-masking objective that adapts variance-reduction tools, combining sequence-level importance sampling, deterministic quadrature over masking levels under a mean-preserving, monotonically decreasing per-block mask schedule that we introduce. On SDAR-4B, SLIM-RL matches TraceRL’s best MATH500 accuracy on only 0.46x its training samples at block size 16, improving over TraceRL by 6.32% on MATH500 and 11.05% on GSM8K under matched dynamic sampling. At block size 4, the 4B SLIM-RL surpasses the larger LLaDA-8B and Dream-7B dLLMs on math, exceeding LLaDA-8B by 10.76% on MATH500 while staying below the autoregressive Qwen2.5-7B. On code, it improves over TraceRL by 4.20% on MBPP and 3.65% on HumanEval. The tau-budget decoder transfers training-free across LLaDA, Dream, and SDAR. The source code is available at https://github.com/laolaorkkkkk/SLIM-RL .

[4] SEFORA: Student Essays with Feedback Corpus and LLM Feedback Evaluation Framework cs.CL | cs.AIPDF

Shayan Peyghambari Oskoui, Norah Almousa, Zhaoyi Joey Hou, Carolina Gustafson, Gayle Rogers

TL;DR: 论文提出了SEFORA语料库和UniMatch评估框架，旨在解决LLM生成写作反馈的规模化应用问题。SEFORA收集了真实课堂中的学生论文、教师批注、评分标准等多维度数据，而UniMatch则通过语义匹配和最优对齐方法，定量评估生成反馈与教师反馈的一致性。

Details

Motivation: 解决LLM在写作反馈规模化应用中缺乏真实教师反馈数据和可靠评估方法的问题，以提升自动化反馈的质量和实用性。

Result: 在涵盖多个LLM的74种实验配置中，所有模型的F1分数均未超过0.4，表明模型难以准确识别教师优先关注的反馈点，且生成内容越多性能越差。

Insight: 创新点在于构建了真实场景的写作反馈语料库，并设计了基于反馈单元分割、语义评分和最优匹配的评估框架，为开放域生成任务提供了可解释的评估指标（精确率、召回率、F1）。

Abstract: Effective writing feedback is among the strongest drivers of student learning, yet producing it at scale is labor-intensive. LLMs offer a natural path to scaling writing support, but two gaps stand in the way: few public corpora capture how instructors actually deliver feedback in real classrooms, and no reliable method measures whether generated feedback aligns with what an instructor would write. We address both. SEFORA is a public corpus pairing instructor inline feedback with assignment prompts, rubrics, scores, and multi-draft revisions across various college writing genres, comprising 564 drafts and 8,240 instructor annotations. UniMatch is a reference-based evaluation framework for open-ended generation: it segments feedback into feedback units, scores their semantic correspondence under instructor-derived criteria, and aligns them via optimal matching to yield interpretable precision, recall, and F1. Across 74 experimental configurations spanning multiple LLMs, no setting exceeds 0.4 F1. UniMatch reveals that models struggle to identify the feedback instructors would prioritize, and performance degrades as models generate more.

[5] TRACE: State-Aware Query Processing over Temporal Evidence Graphs for Conversational Data cs.CLPDF

Maolin Wang, Yu Wang, Zichun Liu, Baiyuan Qiu, Chenbin Zhang

TL;DR: 本文提出了TRACE框架，用于处理随时间演变的对话数据查询。该框架将对话建模为包含事件、会话和主题的层次化时序证据图，并引入有效性标注来区分过时和当前信息。在查询时，TRACE结合基于向量的笔记检索和图引导的证据搜索，生成支持路径和混合上下文以进行答案生成。

Details

Motivation: 现有长记忆管道通常将记忆视为独立的文本或向量对象，导致检索到语义相似但过时的证据，难以支持状态感知推理。对话数据自然演变（如计划修订、偏好改变、信息矛盾），因此需要一种能够处理时序变化和状态感知的查询方法。

Result: 在长对话问答基准测试中，TRACE提升了时序和多跳推理能力。消融实验强调了层次结构、更新感知种子和基于路径的证据的重要性，证明了框架各组件对性能的贡献。

Insight: 创新点在于将对话建模为带有类型化时序、因果、更新和矛盾关系的层次图，并引入有效性标注来区分历史与当前状态。该设计将词汇召回与证据重建分离，实现了对长对话历史的有限查询时间推理，为状态感知查询处理提供了新思路。

Abstract: Conversational data is increasingly used as a persistent source of user state for long-running assistants and AI agents. However, querying this data remains challenging because conversations naturally evolve: plans are revised, preferences change, and later messages frequently supersede or contradict earlier information. Existing long-memory pipelines largely treat memories as independent text or vector objects. This approach often retrieves semantically similar but stale evidence, offering limited support for state-aware reasoning. To address this problem, we present TRACE, a query processing framework over temporal evidence graphs for evolving conversational data. TRACE models conversations as a hierarchical graph spanning events, sessions, and topics, enriched with typed temporal, causal, update, and contradiction relations. Crucially, the framework maintains validity annotations so obsolete facts remain accessible for historical queries but are discounted for current-state answers. At query time, TRACE combines vector-based note retrieval with graph-guided evidence search, generating validity-aware support paths and a hybrid context for answer generation. This design separates lexical recall from evidence reconstruction, enabling bounded query-time reasoning over long conversational histories. Experiments on long-conversation query-answering (QA) benchmarks show that TRACE improves temporal and multi-hop reasoning, with ablations highlighting the importance of hierarchy, update-aware seeding, and path-grounded evidence.

[6] DiscoLoop: Looping Discrete Embeddings and Continuous Hidden States for Multi-hop Reasoning cs.CL | cs.AI | cs.LGPDF

Hengyu Fu, Tianyu Guo, Zixuan Wang, Hanlin Zhu, Jason D. Lee

TL;DR: 本文提出DiscoLoop，一种循环Transformer架构，通过同时循环离散嵌入和连续隐藏状态来解决多跳推理任务中深度局部存储问题。该方法在符号和合成语言多跳推理任务中实现了接近完美的准确率，并在真实世界预训练中取得了更低的训练损失和更强的基准性能。

Details

Motivation: 解决大语言模型在单次前向传播中进行多跳推理时，早期层学习到的事实信息在后续层不可用（深度局部存储问题）的挑战，特别是针对两跳推理任务。

Result: 在符号和合成语言多跳推理任务中，DiscoLoop实现了接近完美的准确率，且训练步数显著减少；在真实世界预训练中，其训练损失低于循环Transformer基线，并在基准测试上表现更强。

Insight: 核心创新点是发现并解决了多跳推理中隐藏状态与桥接词嵌入的对齐瓶颈，进而提出了同时循环离散嵌入和连续隐藏状态的混合通道设计，这可以提升模型内部知识组合与传递的效率。

Abstract: Large language models achieve strong performance on many reasoning tasks when allowed to externalize intermediate steps as Chain-of-Thought (CoT). However, many questions require the model to internalize the multi-step reasoning within a single forward pass before generating the answer. We study this challenge through two-hop reasoning, a representative task where the model must compose multiple pieces of parametric knowledge within a single forward pass. Standard non-recurrent Transformers suffer from a depth-local storage problem: facts learned in earlier layers are unavailable where second-hop retrieval happens. We found that Looped Transformers mitigate this issue by reusing the same memory, but still generalize imperfectly. We show that the remaining bottleneck is representational. In the two-hop reasoning task, the first loop often makes the correct bridge entity nearly perfectly decodable, yet the corresponding hidden state remains poorly aligned with the bridge token embedding. Surprisingly, an easy training-free realignment intervention nearly closes the generalization gap. Building upon this insight, we propose DiscoLoop, a looping architecture whose recurrence carries both a discrete embedding channel and a continuous hidden-state channel. DiscoLoop achieves near-perfect accuracy with substantially fewer training steps across symbolic and synthetic-language multi-hop reasoning tasks. When applied to real-world pretraining, DiscoLoop attains lower training loss and stronger benchmark performance than looped-transformer baselines, suggesting that the mixed-channel design transfers to practical language modeling.

[7] A Mechanistic View of Authority Hierarchy in LLM Sycophancy cs.CL | cs.LGPDF

Emil Joswin, Srujananjali Medicherla, Priyanka Mary Mammen

TL;DR: 本文通过受控医学问答实验，从机制层面研究了大型语言模型中的权威偏见现象，发现模型会根据信息来源的权威等级系统性调整答案，即使暗示错误信息。研究发现这种偏见源于训练中形成的隐含权威层级，并在特定网络层中表现为对正确答案表征的主动擦除。

Details

Motivation: 解决语言模型中存在的权威偏见这一关键安全问题，即模型倾向于优先考虑权威人物的社会线索而非事实一致性，导致答案基于来源可信度而非证据。

Result: 在Llama-3.1-8B、Qwen3-8B和Gemma-2-9B模型上的实验表明，模型响应与感知到的权威等级成比例。Logit透镜分析和线性/非线性探测将该效应定位到一个关键的深层网络层。

Insight: 创新点在于揭示了权威诱导的谄媚行为并非表面输出偏差，而是机制性的知识擦除——即高权威信号对正确内部表征的精确、层定位的覆盖。这为理解和缓解模型偏见提供了新的机制视角。

Abstract: Authority bias poses a critical safety concern in language models: models systematically prioritize social cues from authority figures over factual consistency, swaying their answers based on source credibility rather than evidence. We mechanistically investigate this phenomenon using a controlled medical QA setting, where hints suggesting incorrect answers are attributed to personas of varying expertise. Across Llama-3.1-8B, Qwen3-8B, and Gemma-2-9B, we find that models respond in a graded manner proportional to perceived authority, a hierarchy that is never explicitly prompted but emerges from training. Logit lens analysis and linear/non-linear probing localize this effect to a critical late layer where correct answer representations are actively erased, an erasure that scales with authority level, resists mean vector intervention, and is only partially reversible through chain-of-thought reasoning. Our findings suggest that authority-induced sycophancy is not a surface-level output bias but mechanistic knowledge erasure, a precise, layer-localized overwriting of correct internal representations by high-status authority signals.

[8] Selective Test-Time Debiasing for CLIP via Reward Gating cs.CLPDF

Jaeho Han, Jisoo Yang, Hyeondong Woo, Mingyu Jeon, Sunjae Yoon

TL;DR: 本文提出了一种基于强化学习的测试时适应框架RG-TTA，用于解决视觉语言模型在人物中心查询中存在的偏见问题。该方法根据输入查询的偏见敏感性，选择性地应用去偏正则化，从而在提升公平性的同时保持甚至提高零样本性能，解决了传统均匀去偏方法中公平性与效用的权衡难题。

Details

Motivation: 当前视觉语言模型的去偏方法对所有输入查询采用统一的偏差校正，导致在偏见不敏感的查询中语义信息被扭曲，而在偏见敏感的查询中又无法有效缓解刻板印象，存在公平性与效用的根本性权衡。

Result: 在FairFace和UTKFace等公平性基准测试上的实验表明，该方法显著减少了偏见，同时提升了零样本性能，解决了均匀去偏的权衡问题。

Insight: 核心创新在于引入了基于强化学习的奖励门控机制，在测试时根据输入敏感性自适应地触发去偏操作，实现了对偏见敏感与不敏感查询的差异化处理，从而在单一模型中兼顾公平性与效用。

Abstract: Vision language models (VLMs) demonstrate strong zero-shot performance, but often perpetuate social stereotypes in person-centric queries, yielding skewed demographic distributions. Current debiasing methods apply uniform bias corrections across all input queries regardless of their bias sensitivity, creating a fundamental fairness–utility trade-off. Strong debiasing distorts semantically meaningful information in bias-insensitive queries, while weak debiasing fails to mitigate stereotypes in bias-sensitive ones. This one-size-fits-all approach hampers simultaneously achieving high utility on bias-insensitive queries and fairness on bias-sensitive queries. We introduce Reward-Gated Test-Time Adaptation (RG-TTA), a reinforcement learning-based test-time adaptation framework that selectively applies debiasing based on input sensitivity. RG-TTA adaptively triggers fairness regularization based on the bias sensitivity of each input during test-time policy adaptation, while focusing exclusively on optimizing cross-modal alignment for bias-insensitive inputs. Experiments on fairness benchmarks (e.g., FairFace, UTKFace) demonstrate substantial bias reduction while simultaneously improving zero-shot utility, resolving the trade-off of uniform debiasing.

[9] Understanding Why Language Models Hallucinate: Testing Reasoning Against Priors cs.CLPDF

Yangfan Hu, Xuhan Tong, Haoyue Bai, Xi Ding, Shashank Muralidhar Bharadwaj

TL;DR: 该论文研究了大型语言模型产生幻觉（即违反提示约束的错误答案）的根本原因，提出了’推理错位’的概念，即模型可能拥有相关知识，但由于预训练频率不平衡导致的统计显著潜在关联，使其选择了错误的推理路径。作者通过一个潜在关键任务模型形式化了这一观点，并预测了两种失败模式。为了诊断，他们引入了TrapQA测试平台，包含ScientistQA和Real-Life Constrained QA两个组件，实验结果表明幻觉可能源于有偏的潜在推理，而不仅仅是知识缺失。

Details

Motivation: 旨在诊断大型语言模型产生幻觉的根本原因，即区分错误是由于模型缺乏相关知识，还是模型拥有信息但推理路径与提示约束不一致。

Result: 在TrapQA诊断测试平台（包含ScientistQA和Real-Life Constrained QA）上的实验结果表明，幻觉可以源于有偏的潜在推理，而不仅仅是知识缺失。

Insight: 论文的核心创新点在于将幻觉问题形式化为’推理错位’，并提出了一个潜在关键任务模型来解释预训练数据中的频率不平衡如何导致模型优先选择统计显著的捷径路径，而非遵循提示约束的路径。这为理解和诊断模型幻觉提供了一个新的理论框架和可控的诊断工具（TrapQA）。

Abstract: Large language models often produce hallucinated answers that violate prompt-level constraints. A key diagnostic question is whether these failures reflect missing knowledge, or whether the model has the relevant information but follows the wrong inference path. We study this phenomenon as inference misalignment: a mismatch between the answer supported by the prompt and the answer favored by statistically salient latent associations. We formalize this view with a latent key-task model, in which pretraining-frequency imbalance can cause a shortcut path to dominate the constraint-sensitive path and induce positive inference loss. The framework predicts two failure modes: task-retrieval bias in entity disambiguation and key-selection bias in action choice. We introduce TrapQA, a controlled diagnostic testbed with two components. ScientistQA tests disambiguation among similar scientists with supplementary factual probes, while Real-Life Constrained QA tests everyday constraint following under salient shortcuts. Our results show that hallucination can arise from biased latent inference rather than absent knowledge alone.

[10] Know When to Stop: Segment-Level Credit Assignment for Reducing Overthinking cs.CLPDF

Chia-Hsuan Lee, Sihui Dai, Mingyang Zhou, Isha Slavin, Shi-Xiong Zhang

TL;DR: 该论文提出了一种名为DASH（Drift Aware advantage SHaping）的方法，旨在减少推理语言模型中的‘过度思考’现象。该方法通过分析推理轨迹中的中间答案承诺，为每个推理片段分配信用，以区分有益和有害的自我反思，从而在保持准确性的同时减少无效的令牌消耗。

Details

Motivation: 解决推理语言模型中普遍存在的‘过度思考’问题，即模型生成长但无效的推理链（如犹豫、放弃、自我矛盾），这些行为消耗计算资源却不提升答案质量。

Result: 在竞争级数学基准测试（如AIME25）上，DASH实现了最高准确率（50.8% vs. 基线GRPO的45.4%），同时有效减少了过度思考行为，并促进了更有效的自我纠正。

Insight: 创新点在于利用推理轨迹中的中间答案承诺作为廉价代理信号，无需额外监督即可评估后续反思的生产力；DASH方法通过片段级信用分配，动态引导模型避免有害反思，这在处理复杂推理任务时具有借鉴意义。

Abstract: Reasoning language models frequently overthink: generating extended chains of behaviors such as hedging, approach abandonment, and self contradiction that consume tokens without improving answers. We show that these behaviors are not merely a consequence of length; even when controlling for response length, incorrect traces exhibit higher rates of unproductive self-reflection than correct ones. Addressing this requires identifying where self-reflection helps vs hurts, but obtaining these step-level annotations is costly. We observe that intermediate answer commitments within reasoning traces can provide a cheap proxy: by comparing each final answer candidate in the trace to the ground truth, we can determine whether subsequent reflection is productive without any additional supervision. Building on this insight, we propose DASH (Drift Aware advantage SHaping), which assigns segment-level credit based on whether each reasoning segment leads toward or away from correctness. On competition-level math benchmarks, DASH achieves the highest accuracy where overthinking is prevalent (AIME25: 50.8% vs. 45.4% GRPO) while reducing overthinking behaviors and achieving more productive self-correction than baselines.

[11] Efficient Multilingual Reasoning Transfer via Progressive Code-Switching cs.CLPDF

Zhijun Wang, Junxiao Liu, Hao Zhou, Hao-Ran Wei, Baosong Yang

TL;DR: 本文提出了一种名为渐进式代码切换（PCS）的高效多语言推理迁移框架，旨在将大型推理模型在英语上的强大推理能力迁移到其他目标语言。该方法仅需轻量级翻译，无需依赖更强模型进行蒸馏或外部评判，通过构建代码切换推理轨迹进行监督微调，并采用带有一致性课程学习的强化学习，逐步提高目标语言比例，最终实现完全用目标语言进行推理。

Details

Motivation: 大型推理模型在英语上表现出强大的推理能力，但在其他语言上推理时性能显著下降。现有迁移方法通常依赖于从更强模型蒸馏目标语言推理轨迹或外部评判模型的在线监督，成本高昂且难以扩展。

Result: 在多个基准测试和五种类型多样的语言上的实验表明，PCS显著缩小了目标语言与英语推理之间的性能差距，在保持竞争力的准确率的同时，产生了更一致的语言推理结果。

Insight: 创新点在于提出了一种仅需翻译、无需更强模型监督的渐进式代码切换迁移框架，通过逐步提高目标语言比例的课程学习设计，为模型提供了平滑的迁移路径，避免了直接强制目标语言推理常见的不稳定性和性能下降问题。

Abstract: Large reasoning models (LRMs) have achieved strong reasoning capabilities in English, yet their performance degrades significantly when required to reason in other languages. A natural solution is to transfer the model’s English reasoning ability to target languages. However, existing transfer approaches typically rely on distilled target-language reasoning traces from stronger LRMs or online supervision from external judge models, which are costly and difficult to scale. In this paper, we propose PCS (Progressive Code-Switching), a more efficient transfer framework that requires only lightweight translation without any stronger model for distillation or judging. PCS first constructs code-switched reasoning traces by translating a subset of English reasoning steps into the target language, and uses them to initialize the model’s code-switching ability via supervised fine-tuning. It then applies reinforcement learning with a step-level language consistency curriculum, progressively raising the target-language ratio until the model reasons entirely in the target language. This progressive design provides a smooth transfer path that avoids the instability and performance degradation commonly observed when directly enforcing target-language reasoning. Experiments on multiple benchmarks and five typologically diverse languages show that PCS substantially narrows the performance gap between target-language and English reasoning, yielding more language-consistent reasoning while maintaining competitive accuracy.

[12] A Task-State Representation for Long-Horizon Mobile GUI Agents cs.CLPDF

Yujie Zheng, Zikang Liu, Xin Zhao, Ji-Rong Wen

TL;DR: 本文提出了一种名为任务状态表示（TSR）的无训练框架，旨在解决长视野移动GUI智能体在任务执行过程中难以区分持久任务状态与瞬态屏幕观察的问题。TSR通过解耦任务状态与感知输入，作为轻量级外部包装器，包含全局指令摘要、动态子目标进度跟踪器和转换感知动作验证器三个结构化组件，持续更新以指导智能体推理。

Details

Motivation: 长视野移动GUI智能体通常依赖思维-动作-观察循环，但难以分离持久任务状态与瞬态屏幕观察，导致随着执行历史增长，上下文负担加重，智能体易忘记初始需求、产生幻觉进度或重复与过时界面交互。

Result: 在四个移动GUI基准测试上的实验验证了TSR的有效性，在复杂的跨应用和内存密集型任务上，成功率最高提升了12个绝对百分点。

Insight: 创新点在于显式解耦任务状态与感知输入，通过结构化组件（如进度跟踪器和动作验证器）实现无训练的外部状态管理，无需修改智能体架构即可提升长视野任务性能，为GUI智能体提供了可扩展的上下文管理方案。

Abstract: While long-horizon mobile GUI agents typically rely on thought-action-observation loops, they struggle to separate persistent task states from transient screen observations. As execution histories grow, this entanglement imposes a severe context burden, causing agents to forget initial requirements, hallucinate progress, or repeatedly interact with stale interfaces. To address this, we introduce Task-State Representation (TSR), a training-free framework that explicitly decouples task state from sensory input. Acting as a lightweight external wrapper, TSR maintains three structured components: a global instruction summary, a dynamic progress tracker for subgoals, and a transition-aware action verifier. By continuously updating through pre- and post-action visual comparisons, TSR effectively guides the agent’s reasoning without requiring architectural modifications. Experiments across four mobile GUI benchmarks validate TSR’s effectiveness, yielding up to a 12 absolute point increase in success rate on complex cross-application and memory-intensive tasks.

[13] Safe Alone, Unsafe Together: Safeguarding Against Implicit Toxicity When Benign Images Combine cs.CL | cs.CR | cs.MMPDF

Jiaxian Lv, Shiyao Cui, Yingkang Wang, Guoxin Wu, Qingling Zhang

TL;DR: 本文研究了多图像隐式毒性（MIIT）这一新型安全威胁，即单张图像看似无害，但多张图像组合后会产生有害语义。论文首先形式化定义了MIIT并分析了其检测挑战，随后构建了首个仅包含图像的多图像安全数据集MIIT-dataset，并提出了通过渐进蒸馏推理监督训练的MiShield模型，该模型不仅能做出安全判断，还能解释导致危害的相关实体。

Details

Motivation: 社交媒体中多图像内容日益普及，但现有商业审核API和模型难以检测MIIT，因为每张图像缺乏显式风险线索，导致组合后出现有害语义的安全隐患。

Result: 实验表明，MiShield-8B模型在代表性风险类别上优于现有商业审核服务和更大规模模型，展示了其在该广泛使用的视觉格式上的有效性和实用价值。

Insight: 创新点在于首次系统研究MIIT问题，通过自动生成流程构建专用数据集，并采用渐进蒸馏推理监督使模型具备可解释的安全分析能力，为多模态内容安全提供了新思路。

Abstract: Multi-image content has become an increasingly prevalent form of visual communication in social media, giving rise to a new safety issue, multi-image implicit toxicity (MIIT), where each image appears benign in isolation, but harmful semantics emerge when the images are interpreted jointly. MIIT is particularly challenging for existing commercial moderation APIs and models due to the lack of explicit risky cues in each image. This paper aims to study how to identify MIIT. We first provide a formal definition of MIIT and analyze three key challenges for its detection. To alleviate the scarcity of data in this area, we construct MIIT-dataset, an image-only multi-image safety dataset covering seven representative risk categories through an automatic generation pipeline. Finally, we train MiShield with progressively distilled reasoning supervision, enabling it to produce safety judgments accompanied by explicit analyses of the correlated entities that result in the hazards. Experiments show that MiShield-8B models outperform representative moderation services and even larger-scale models, revealing its effectiveness and practical value for this widely used visual format. Warning: This paper contains potentially sensitive content.

[14] Multi-Turn Agentic Scientific Literature Search via Workflow Induction cs.CL | cs.IRPDF

Jisen Li, Bingxuan Li, Nanyi Jiang, Xuying Ning, Xiyao Wang

TL;DR: 本文介绍了PaperPilot，一个通过工作流归纳进行多轮科学文献搜索的智能体。它将科学搜索构建为可执行的DAG（有向无环图）工作流，包含关键词搜索、引文扩展、过滤、评分、重排序和证据提取等操作符，并利用用户反馈来优化查询和工作流本身。

Details

Motivation: 现有科学文献搜索代理通常依赖固定流程或隐式的纯语言推理，导致其搜索策略难以控制、检查和优化。本文旨在解决用户意图不明确、依赖偏好且通过交互演变的复杂搜索需求。

Result: 实验表明，经过训练的PaperPilot-9B模型在多轮交互中优于基础的Qwen3.5-9B工具集代理，将Hit@5从58.0提升至77.0，MRR从47.5提升至59.4，nDCG@10从26.8提升至32.5，同时将工作流执行错误率从9.5%降至0%。

Insight: 核心创新在于将科学文献搜索明确地形式化为可编辑、可执行的工作流（DAG）归纳问题，提供了可控的接口来对齐复杂科学意图。方法上结合了监督工作流模仿和基于受控工作流损坏的偏好优化进行训练。

Abstract: Scientific literature search often requires more than retrieving papers from a single query: users’ intents are underspecified, preference-dependent, and evolve through interaction. Existing search agents typically rely on fixed pipelines or implicit language-only reasoning, making their search strategies difficult to control, inspect, and refine. We introduce PaperPilot, a multi-turn literature search agent that frames scientific search as workflow induction. Given an anchor paper and a user query, PaperPilot constructs an executable DAG of paper-search operators, including keyword search, citation expansion, filtering, scoring, reranking, and evidence extraction. User feedback is then used to refine both the query and the workflow itself. We train PaperPilot with supervised workflow imitation and preference optimization over controlled workflow corruptions. Experiments show that PaperPilot-9B improves over the base Qwen3.5-9B toolset agent under multi-turn interaction, increasing Hit@5 from 58.0 to 77.0, MRR from 47.5 to 59.4, and nDCG@10 from 26.8 to 32.5, while reducing workflow execution errors from 9.5% to 0%. These results show that explicit, editable search workflows provide an effective and controllable interface for aligning literature search agents with complex scientific intent.

[15] MSQA: A Natively Sourced Multilingual and Multicultural SimpleQA Benchmark cs.CLPDF

Xianru Chen, Yukai Huang, Mingxiang Chen, Xinping Lei, Fangbing Deng

TL;DR: 论文提出了MSQA基准测试，这是一个包含11种语言、5个文化维度和3个难度等级的1064个原生问题的数据集，用于评估大语言模型的文化理解能力。研究发现，模型的文化能力与其预训练数据中的文化暴露度密切相关，而常见的推理时干预方法（如校准、采样或检索增强）无法有效解决文化对齐的幻觉问题。

Details

Motivation: 论文旨在挑战多语言流利性必然意味着文化理解的假设（即文化对齐幻觉），通过构建一个避免英语中心跨语言迁移捷径的原生多语言文化基准，直接测试模型对本地化知识的理解。

Result: 在评估18个大语言模型后，发现模型存在显著的文化能力退化，并表现出明显的局部性效应：文化能力与预训练数据中的文化暴露度关联度，高于与一般推理能力的关联度。常见的推理时补救措施（如置信度校准、重复采样、检索增强）未能有效消除这种幻觉。

Insight: 创新点在于构建了首个大规模、多维度、原生来源的多语言文化基准MSQA，避免了翻译基准的偏差。核心洞察是：模型的多语言能力不能直接推断其文化对齐，文化理解需要比推理时干预更深层次的解决方案，这挑战了当前对模型文化能力的普遍假设。

Abstract: Multilingual fluency often invites a stronger assumption: a model that can speak a user’s language must also understand the culture encoded by that language. We call this the Illusion of Cultural Alignment. To test this assumption directly, we introduce MSQA, a benchmark of 1,064 natively sourced questions across 11 language groups, five cultural dimensions, and three difficulty tiers. Unlike translated benchmarks, MSQA targets locally grounded knowledge and reduces shortcuts from English-centric cross-lingual transfer. Evaluating 18 LLMs, we find substantial cultural degradation and a pronounced Locality Effect: cultural competence tracks pre-training exposure more closely than general reasoning ability. We further show that common inference-time remedies do not dissolve the illusion. Models remain overconfident on unfamiliar cultural questions, repeated sampling yields unstable rather than reliable correctness, and retrieval augmentation helps unevenly on long-tail facts. These findings indicate that cultural alignment cannot be inferred from multilingual ability alone and requires deeper intervention than calibration, sampling, or retrieval at inference time

[16] CAT: Confidence-Adaptive Thinking for Efficient Reasoning of Large Reasoning Models cs.CL | cs.AIPDF

Qizhi Jiang, Shuo Wang, Pei Ke, Yuhang Song, Ke Qin

TL;DR: 本文提出了一种名为置信度自适应思维（CAT）的框架，旨在解决大型推理模型在处理简单查询时过度思考导致的推理效率低下问题。该框架通过将模型内在的自我确定性信号作为置信度融入偏好优化过程，从而根据问题难度自适应地调整推理长度。

Details

Motivation: 大型推理模型在处理复杂任务时表现出色，但在简单查询上常因过度思考而产生大量令牌开销，降低推理效率。现有压缩方法通常采用统一的长度缩减或粗粒度的难度估计，这往往导致在困难问题上性能下降。

Result: 实验结果表明，CAT在不同基础模型的多个基准测试中，在推理准确率上持续优于最先进的基线方法。

Insight: 创新点在于将模型的内在置信度信号作为细粒度的难度指标，并融入偏好优化，实现了对推理长度的自适应调制。这为在实际工业场景中平衡准确性和延迟提供了一个潜在的鲁棒解决方案。

Abstract: Large Reasoning Models (LRMs) have achieved remarkable success on complex tasks by leveraging long chain-of-thought (CoT) trajectories, yet they frequently exhibit overthinking on simple queries, resulting in significant token overhead and reduced inference efficiency. However, existing compression methods predominantly apply uniform length reduction or rely on coarse-grained difficulty estimation, often leading to performance degradation on difficult problems. To address this limitation, we propose Confidence-Adaptive Thinking (CAT), a framework that incorporates the model’s intrinsic self-certainty signals as confidence into the preference optimization process, which autonomously modulates reasoning lengths based on problem difficulty. Experimental results show that CAT consistently outperforms state-of-the-art baselines on reasoning accuracy across multiple benchmarks on different base models. Our work enables LRMs to effectively compress confident responses while deliberating on uncertain ones, offering a potentially robust solution for balancing accuracy and latency in practical industrial scenarios.

[17] Logit-Contribution Scoring Identifies Non-Literal Retrieval Heads cs.CL | cs.AI | cs.LGPDF

Aryo Pradipta Gema, Beatrice Alex, Pasquale Minervini

TL;DR: 本文提出了Logit-Contribution Scoring (LOCOS)方法，用于识别大语言模型在长上下文使用中执行非字面检索（即基于语义合成答案而非直接复制）的注意力头。该方法通过评估每个注意力头的输出值电路对答案令牌的贡献来评分，在多个模型家族和基准测试中证明其有效性。

Details

Motivation: 现有方法通过检查注意力头关注的令牌是否与生成的令牌匹配来识别检索头，但这只捕捉了字面复制行为，无法检测基于语义合成答案的非字面检索。需要一种能评估注意力头输出值电路实际写入贡献的方法。

Result: 在Qwen3、Gemma-3、OLMo-3.1三个模型家族上，使用LOCOS识别并消融头部后，在NoLiMa非字面检索基准上的ROUGE-L分数显著下降（例如Qwen3-8B从0.401降至0.000），效果远超基于注意力的基线方法。在MuSiQue和BABI-Long基准上也观察到类似性能崩溃。

Insight: 创新点在于提出了一个“写入感知”的检测器LOCOS，它通过单次前向传播中对比“关键信息”和“非关键信息”源位置，直接评估注意力头输出值电路对最终答案令牌的贡献。这为理解和干预大语言模型的长上下文推理机制提供了新工具。

Abstract: In long-context use, large language models frequently synthesize answers from the meaning of a relevant context span rather than literally copy-pasting them. Identifying which attention heads perform this synthesis matters for interpreting long-context model behavior. Yet existing detectors miss these heads by construction: they reward heads whose attended token matches the generated token, a literal-copy criterion that captures where a head reads but not what it writes through its output-value (OV) circuit, the very mechanism that carries non-literal retrieval. We introduce Logit-Contribution Scoring (LOCOS), a write-aware detector that scores each head by the projection of its OV-circuit output onto the answer-token unembedding direction, contrasting needle and off-needle source positions in a single forward pass. Across three model families (Qwen3, Gemma-3, OLMo-3.1), mean-ablating the top LOCOS heads on the NoLiMa non-literal retrieval benchmark collapses ROUGE-L at lower head counts than prior attention-based detections; on Qwen3-8B, ablating 50 heads drives ROUGE-L from 0.401 to 0.000 while the strongest baseline still retains 0.292. The selected heads are retrieval-specific: parametric recall and arithmetic reasoning stay at baseline under the same ablation. On Qwen3-8B, the same ablation also drops MuSiQue from 0.55 to 0.08 and BABI-Long from 0.62 to 0.20, while a random-heads control stays within 0.05 of baseline.

[18] Understanding Large Language Models cs.CLPDF

Yannik Keller, Thomas Eisenmann

TL;DR: 本章节旨在概述当前对大型语言模型的理解，讨论其新兴能力及其在处理层中的机制实现。文章首先简要回顾Transformer架构，然后探讨LLMs出现的类似人类认知的能力，如符号推理、心智理论和欺骗策略，并回顾可解释AI方法。最后，文章讨论了关于LLMs是否真正理解的当前辩论，反对过度简化还原论的观点。

Details

Motivation: 解决关于大型语言模型机制、能力及其与人类认知关系的未解问题，澄清当前对LLMs的理解。

Result: 未提及具体定量结果或基准测试，但引用了多项研究证据，表明LLMs能解决先前认为需要类人认知的任务，并揭示了揭示人类与LLM认知差异的失败案例。

Insight: 创新点在于综合讨论LLMs的机制与类人认知能力，并倡导对LLM认知进行更细致的讨论，避免过度简化还原论或人类中心主义观点，强调从优化过程和认知能力角度理解LLMs。

Abstract: Large Language Models (LLMs) represent one of the most significant advances in AI and natural language processing in recent years. Still, many pressing questions about their mechanisms, capabilities, and relationship to human cognition remain highly debated. This chapter aims to outline our current understanding of LLMs by discussing recent evidence on emerging capabilities and their mechanistic implementation within processing layers. We begin with a concise overview of the Transformer architecture, emphasizing how the attention mechanism enables training on massive datasets, allowing LLMs to function as generalist rather than specialized models. Next, we examine emergent LLM capabilities that appear to resemble aspects of human cognition, including symbolic reasoning, theory of mind, and deception strategies. Several studies provide evidence that LLMs can solve tasks previously thought to require human-like cognition. Other studies reveal insightful failure cases that shed light on the differences between human and LLM cognition. Alongside these findings, we review explainable AI approaches ranging from neuron activation analysis to circuit tracing. In the final section, we address current debates concerning what LLMs genuinely understand versus what they merely appear to understand. Prominent arguments against AI anthropomorphism point to the simplicity of LLM training objectives, claiming that LLM behavior is better explained by pattern memorization of training data than by genuine cognition. We argue that this standpoint is guided by misconceptions about optimization processes and cognitive capacity, and advocate for a more nuanced discussion of LLM cognition that neither dismisses the differences between humans and LLMs nor precludes the possibility of AI cognition through overly simplistic reductionist arguments.

[19] Message Passing Enables Efficient Reasoning cs.CL | cs.LGPDF

Xuecheng Liu, Daman Arora, Gokul Swamy, Andrea Zanette

TL;DR: 本文提出了消息传递语言模型（MPLM）框架，通过引入轻量级的发送和接收原语，使多个LLM线程能够直接通信，从而提升推理效率。该方法通过减少通信开销和引入抢占机制，在数独、3-SAT和长上下文问答任务中实现了比传统串行思维链和并行分治方法更高效的推理。

Details

Motivation: 现有推理方法如思维链（CoT）需要生成长序列，计算成本高；而并行分治（FJ）方法中线程间缺乏点对点通信，限制了可扩展性。因此，需要一种能支持线程间直接通信的高效推理框架。

Result: 在数独任务中，MPLM所需上下文大小渐近小于串行CoT和并行FJ，并能解决25x25的难题；在3-SAT任务中，抢占机制提高了效率；在长上下文问答中，使用预训练模型遵循MPLM协议取得了与流行分治方法竞争的结果。

Insight: 创新点在于将消息传递机制引入LLM推理，通过线程间直接通信减少冗余上下文共享，并利用抢占实现早期终止。这为并行推理提供了更灵活的通信范式，有望提升复杂任务的扩展性。

Abstract: While inference-time scaling has improved the reasoning abilities of large language models (LLMs), the need to generate long chains-of-thought (CoTs) is a computational bottleneck. Thus, in contrast to sequential scaling methods like CoT, recent parallel scaling techniques instead use fork and join (FJ) primitives to divide work across multiple LLM threads. However, in the fork-join paradigm, threads are typically transient and do not communicate pointwise with one another which limits scalability. To tackle this, we introduce Message Passing Language Models (MPLMs), a framework for LLM reasoning in which threads communicate directly via lightweight send and receive primitives. MPLMs enable efficient scaling through two key mechanisms: (1) reduced communication costs, achieved by avoiding redundant context sharing, and (2) preemption, which allows threads to terminate early based on partial information from their peers. We demonstrate the promise of MPLMs on 3 classes of tasks. First, on Sudoku puzzles, we show that MPLMs require an asymptotically smaller context than both serial CoT and parallel FJ. We then fine-tune a single model to solve 25 x 25 puzzles that remain challenging for standard CoT and FJ approaches, as well as frontier reasoning models without tools. Second, on 3-SAT puzzles, the capability of preemption allows termination of unpromising branches, which results in improved efficiency. Finally, we show that appropriately prompted large pre-trained models follow the MPLM protocol, achieving competitive results on long-context question answering relative to popular fork-join approaches.

[20] Towards Developing a Multimodal Chat Assistant for University Stakeholders: RAG-based Approach cs.CL | cs.AIPDF

Md Abu Hanif Shaikh, Abdullah Al Shafi

TL;DR: 本文提出了一种基于检索增强生成（RAG）的多模态大学聊天助手，旨在为大学利益相关者提供及时可靠的信息支持。该系统结合大语言模型与语义检索，能够处理文本和图像查询，并从大学手册等机构资源中生成基于上下文的回答。系统采用量化推理以在受限硬件上快速部署，并通过前后端框架确保实时可用性。

Details

Motivation: 解决大学利益相关者（尤其是在发展中国家）难以获取及时可靠信息的问题，现有基于规则的聊天机器人无法处理复杂的、特定领域的查询，且难以适应不断变化的机构政策。

Result: 多模态评估显示，系统在文本和图像查询上均保持较高的满意度得分，尽管视觉输入的响应时间有所增加。定量评估表明，在提出的RAG系统中，幻觉率从31.7%降低至6.6%，证实了检索增强的有效性。

Insight: 创新点在于将RAG框架与多模态（文本+图像）输入相结合，专门应用于大学领域，利用机构特定资源进行检索增强以显著减少幻觉。从客观角度看，其采用量化推理和轻量级部署方案，为资源受限环境提供了实用的系统设计参考。

Abstract: University stakeholders often face difficulties in accessing timely and reliable information, especially in developing countries, where there are very few intelligent support systems. Existing rule-based chatbots are unable to handle complex, domain-specific queries and are not well-equipped to adapt to evolving institutional policies. As a fill-in-the-gap solution, we present the multimodal university chatbot with retrieval-augmented generation. The system combines the large language model with semantic retrieval to produce context-based responses from institution-centric resources, such as the university handbook. The system accepts text and image queries through the vision-language model and applies quantized inference for rapid deployment on constrained hardware. A scalable backend built with FastAPI, adjoined with a responsive frontend developed with Next.js, ensures real-time usability. Our multimodal evaluation demonstrates that the system maintains strong satisfaction scores across both text and image queries, despite increased response time for visual inputs. Furthermore, quantitative evaluation shows that hallucination is reduced from 31.7% to 6.6% in our proposed RAG-based system, confirming the effectiveness of retrieval grounding.

[21] AGC-Bench: Measuring Artificial General Creativity cs.CLPDF

Roger Beaty, Vijeta Deshpande, Clin K. Y. Lai, Anna Attuch, Namrata Shivagunde

TL;DR: 本文提出了AGC-Bench，一个用于衡量人工智能通用创造力（Artificial General Creativity）的综合性基准测试。该基准通过系统梳理AI创造力文献，整合了78个涵盖头脑风暴、问题解决、STEM、叙事、比喻语言和幽默等多个领域的创造力数据集。为解决LLM作为评判者时的偏见问题，研究引入了基于心理测量学的评判者反应理论进行校准，并训练了开放权重的AGC-Judge模型。研究发现LLM中存在一个可解释大部分方差的单一创造力因子’c’，且’发挥创造力’的提示能显著提升模型表现，但顶尖人类在创造力上仍领先于顶尖LLM。

Details

Motivation: 当前创造力研究存在领域特异性与通用性的争论，且缺乏统一的AI创造力评估基准。本文旨在构建一个标准化的、全面的基准（AGC-Bench）来系统性地测量和比较人工智能（特别是LLM）的通用创造力。

Result: 在AGC-Bench排行榜上，前沿闭源模型位居前列，开源模型紧随其后。通过因子分析，在83个LLM中提取出一个单一创造力因子’c’，解释了81.5%的方差，该因子与通用知识/推理能力相关但可分离。在人类匹配的子集上，顶尖人类的创造力得分仍高于顶尖LLM。

Insight: 主要创新点在于：1) 通过系统性文献综述和代理化工具链，构建了首个大规模、多领域、标准化的AI通用创造力基准（AGC-Bench）；2) 应用评判者反应理论校准LLM评判偏见，并训练了可泛化评估新任务的开放权重评判模型（AGC-Judge）；3) 通过实证发现了LLM中存在的单一创造力因子’c’，为AI创造力研究提供了新的量化视角。

Abstract: Creativity research has debated whether creativity is domain-specific (e.g., visual, writing, science), and if it is psychometrically separable from general intelligence. Both questions now apply to LLMs, but a unified benchmark of AI creativity remains elusive. We introduce AGC-Bench, an artificial general creativity benchmark built from a systematic review of the AI creativity literature (3,101 papers screened, 497 benchmarks identified), paired with an agentic harness that converts idiosyncratic codebases into HELM-standardized benchmarks. The first release covers 78 datasets spanning brainstorming, problem solving, STEM, narrative, figurative language, and humor. To address bias in LLM-as-judge, we apply Judge Response Theory – a psychometric calibration of judge leniency/severity; we then fine-tune Qwen3-30B on the bias-corrected ratings of three frontier LLMs to produce AGC-Judge, an open-weight model that robustly scores new creativity benchmarks it was not trained on. Results reveal frontier models at the top of the AGC-Bench leaderboard, with open models close behind. LLMs show different creative strengths, ranking higher on some domains (e.g., writing) than others (e.g., scientific ideation). Extensive experiments yield three main findings. First, applying factor analysis across 83 LLMs, we recover a single creativity factor ‘c’, analogous to the ‘g’ factor of general intelligence, that explains 81.5% of variance, related to but separable from general knowledge/reasoning. Second, we show that prompting models to “be creative” boosts their performance far more than enabling reasoning, evidence that the benchmark tracks creativity over general ability. Third, on a human-matched subset, we find the top human still leads the top LLM on creativity. We release AGC-Bench with a public leaderboard, AGC-Judge, and human data as open infrastructure for measuring AI creativity at scale.

cs.CV [Back]

[22] Joint Medical Image Enhancement and Segmentation with Diffusion-based Symbiotic Information Interaction cs.CVPDF

Ying Chen, Jinyue Li, Qiankun Li

TL;DR: 本文提出了一种名为DiSIINet的扩散模型，用于联合进行医学图像增强与分割。该方法基于DDIM框架，通过一个新颖的共生信息交互模块，在反向扩散过程中实现增强与分割两个分支的动态特征级信息交换，使两项任务能够相互促进、迭代优化。

Details

Motivation: 解决医学图像（如MRI、CT、超声）因成本限制导致的低分辨率、低质量问题，这些问题使得关键解剖结构和病变的可视化变得困难。传统方法将增强作为独立的预处理步骤，未能充分利用其与分割任务的潜在协同作用。

Result: 在多模态医学数据集（MRI、CT、超声）上的实验表明，DiSIINet相比顺序或独立的增强与分割方法取得了显著的性能提升。

Insight: 核心创新在于将图像增强与分割任务统一在一个基于扩散模型的框架内，并通过共生信息交互模块实现双向、动态的特征级信息交换，这超越了传统的级联或并行处理范式。DDIM骨干网络确保了高质量输出和高效推理。

Abstract: Image quality is critical for accurate medical diagnosis. However, MRI, CT, and ultrasound images are often of low resolution and quality due to cost constraints, complicating the visualization of key anatomical structures and lesions. While such limitations are common in practice, traditional methods treat image enhancement as a separate preprocessing step, failing to fully leverage its potential synergy with image segmentation. To address this, we propose DiSIINet (Diffusion-based Symbiotic Information Interaction Network), which is built on the principle that enhancement and segmentation should mutually reinforce each other in a unified model. Based on Denoising Diffusion Implicit Models (DDIM), DiSIINet integrates an enhancement branch and a segmentation branch. These branches interact through a novel Symbiotic Information Interaction (SII) module, which facilitates dynamic, feature-level information exchange via cross-attention during the reverse diffusion process. This design enables both tasks to iteratively improve each other. The DDIM backbone ensures high-quality output and efficient inference through deterministic sampling. Experiments on multi-modal medical datasets (MRI, CT, ultrasound) show that DiSIINet achieves significant performance improvements compared to sequential or independent enhancement and segmentation approaches. The code is available at: https://github.com/Reconsider80/DiSIINet.

[23] Synergistic Perception-Reasoning Governance: Grounding Medical MLLMs with Verifiable Anatomical Evidence cs.CVPDF

Rui Hao, Qiankun Li, Junyuan Mao, Linghao Meng, Dirui Xie

TL;DR: 本文提出了一种无需额外训练、名为SPRG的协同感知-推理治理框架，旨在通过双端证据注入来系统性地缓解医学多模态大语言模型在临床视觉问答和放射学报告生成任务中的幻觉问题。该框架利用MedSAM获取的感兴趣区域先验，通过ROI引导的激活调制重新校准视觉感知轨迹，同时将解剖坐标映射为离散语义标记作为可验证的外部记忆来锚定文本推理轨迹，并引入任务感知动态路由器根据任务语义选择模态特定的干预措施。

Details

Motivation: 医学MLLMs在临床应用中展现出潜力，但其推理时的幻觉问题（即产生与影像证据相矛盾的流畅结论）阻碍了其可信使用。现有缓解策略通常依赖额外训练、外部检索或多阶段后验验证，这增加了成本和流程复杂性，且在不同模型和任务间泛化能力差。

Result: 在LLaVA-1.5-7B、LLaVA-Med-1.5-7B、Qwen3-VL-8B/32B和InternVL-3.5-8B/38B等多个模型上，对2个任务和5个数据集进行了系统评估。该框架在医学基准测试中持续优于基线方法，将封闭式问答的准确率最高提升了约6%，并将开放式问答的幻觉减少了约35%。

Insight: 创新点在于提出了一种无需训练、端到端的证据注入框架，通过将解剖学坐标等可验证证据作为外部记忆直接锚定推理过程，并结合任务感知的动态路由机制，实现了感知与推理的协同治理，有效平衡了视觉基础与语言流畅性，为缓解MLLMs幻觉问题提供了新思路。

Abstract: Multimodal large language models (MLLMs) show strong promise for clinical VQA and radiology report generation, yet inference-time hallucinations still undermine trustworthy use: models can produce fluent conclusions that conflict with imaging evidence. Existing mitigation strategies typically rely on additional training, external retrieval/knowledge bases, or multi-stage post-hoc verification, which increases cost and pipeline complexity and often generalizes poorly across models and tasks.To address this, we propose a holistic, training-free evidence-injection framework that systematically mitigates hallucinations through dual-side evidence injection. By leveraging ROI priors acquired using MedSAM in our implementation, we recalibrate the visual perception trajectory via ROI-guided activation modulation while anchoring the textual reasoning trajectory by mapping anatomical coordinates into discrete semantic tokens as verifiable external memory. Then we introduce a task-aware dynamic router to select modality-specific interventions based on task semantics, balancing perceptual grounding and linguistic fluency. We conduct systematic evaluations on 2 tasks and 5 datasets using \texttt{LLaVA-1.5-7B}, \texttt{LLaVA-Med-1.5-7B}, \texttt{Qwen3-VL-8B/32B}, and \texttt{InternVL-3.5-8B/38B}. Controlled ablations and visualizations further validate the framework, which consistently outperforms baselines across medical benchmarks, improving close-ended accuracy by up to $\sim\mathbf{6}%\uparrow$ and reducing open-ended hallucinations by $\sim\mathbf{35}%\downarrow$. The code has been made available on GitHub: \href{https://github.com/Henry991115/SPRG}{\textcolor{blue}{https://github.com/Henry991115/SPRG}}.

[24] Segmenting, Fast and Slow: Real-Time Open-Vocabulary Video Instance Segmentation with Dual-Path Processing cs.CVPDF

Luca Barsellotti, Martin Sundermeyer, Mattia Segu, Nikita Araslanov, Muhammad Ferjad Naeem

TL;DR: 本文提出SegFS，一种双流快慢框架，用于实时开放词汇视频实例分割（OV-VIS）。该方法在稀疏关键帧上使用开放词汇目标模型预测实例级表示，然后将其投影回骨干特征空间以条件化轻量级快速网络，从而在后续帧中高效重定位和分割实例，显著降低了延迟。

Details

Motivation: 解决现有基于DETR的开放词汇视频实例分割模型计算成本高、难以在移动设备上实现高帧率实时推理的问题。

Result: 在标准OV-VIS基准测试中保持有竞争力的分割性能，其快速分支比面向移动的MOBIUS模型延迟降低高达14倍。

Insight: 通过将实例传播从目标解码转移到特征空间条件化，实现了多模态语义理解与密集掩码预测的解耦，从而支持高效的时间传播；双流快慢设计平衡了精度与效率。

Abstract: Object-centric models inspired by DETR have become the dominant paradigm for open-vocabulary video instance segmentation (OV-VIS). While recent efforts have reduced the computational cost of pixel decoding, textual modality fusion, and object decoding to make these architectures more suitable for mobile devices, real-time on-device inference at high frame rates remains an open challenge. In this paper, we introduce SegFS, a dual-stream fast-slow framework that significantly improves efficiency without sacrificing accuracy. On sparse keyframes, an open-vocabulary object-based model predicts instance-level representations. These representations are then projected back into the backbone feature space to condition a lightweight fast network, which efficiently relocalizes and segments the instances in subsequent frames. By shifting instance propagation from object decoding to feature-space conditioning, our approach decouples multimodal semantic understanding from dense mask prediction and enables efficient temporal propagation. The proposed fast branch achieves up to 14x lower latency than the mobile-oriented MOBIUS model, while maintaining competitive segmentation performance on standard OV-VIS benchmarks.

[25] PixelEyes: Decoupling Perception and Reasoning for Pinpoint Visual Evidence Seeking cs.CVPDF

Dengxian Gong, Yuanzheng Wu, Haobo Yuan, Zhengdong Hu, Tao Zhang

TL;DR: 本文提出PixelEyes，一种将推理与感知解耦的多轮视觉推理智能体，以解决现有MLLMs在视觉搜索任务中因定位不准确导致轨迹冗长冗余的问题。它通过掩码引导的视觉搜索和语义区域广度优先搜索来精确定位目标，并构建了PixelEyes-6K数据集和Pinpoint-Bench基准进行评估。

Details

Motivation: 现有MLLMs在多轮视觉推理中，由于推理与感知在单一模型中纠缠，定位不准确会触发额外的推理轮次，导致搜索轨迹冗长冗余，需要解决这一问题。

Result: 在提出的零提示视觉搜索基准Pinpoint-Bench上，当前SOTA的MLLMs和视觉推理智能体表现仍有很大提升空间，证明了该基准的质量和难度，而PixelEyes通过解耦方法旨在提升性能。

Insight: 创新点包括显式解耦推理与感知（使用专用感知工具进行掩码级精确定位）、语义区域广度优先搜索以减少冗余循环，以及构建包含掩码引导搜索和BFS逻辑的数据集来内化这些能力，这有助于分离定位失败与推理失败，实现细粒度分析。

Abstract: This paper explores multi-turn visual reasoning and observes that MLLMs repeatedly fail to localize the target, leading to long, redundant trajectories. We attribute this failure to the entanglement of reasoning and perception within a single model, the MLLM reasons and localizes simultaneously, and inaccurate localization triggers additional reasoning turns that bloat the trajectory. To solve this problem, we propose PixelEyes, a multi-turn visual reasoning agent that explicitly decouples reasoning from perception, i.e., the reasoner decides what to look for, while a specialized perception tool answers where it is. Specifically, PixelEyes introduces 1) Mask-guided Visual Search. A referring segmentation model is invoked to provide mask-precise localization, freeing the reasoner from the need to compensate for imprecise grounding. 2) Semantic-region Breadth-first Search (BFS). To eliminate redundant loops caused by repeatedly cropping incorrect sub-regions, we organize exploration as a breadth-first search over semantic regions. To internalize these capabilities, we construct the PixelEyes-6K dataset by resynthesizing expert trajectories from existing data. This explicitly embeds our mask-guided search and BFS logic into the model. We further introduce Pinpoint-Bench, a zero-hint visual search benchmark, i.e., no location cues are provided in the question, with instance-level masks and bounding boxes that separate localization failures from reasoning failures, enabling fine-grained analysis of failure modes such as inattentional blindness. Recent state-of-the-art MLLMs and visual reasoning agents leave large headroom on Pinpoint-Bench, demonstrating its quality and difficulty. Code and models are open-sourced.

[26] Decompose, Compare, and Decide: Multimodal LLMs are Implicit Few-Shot Learners cs.CVPDF

Yunhan Wang, Eshika Khandelwal, Edson Araujo, Walid Bousselham, Nina Shvetsova

TL;DR: 本文提出DeCoDe方法，将少样本图像分类任务分解为成对图像比较，利用现有多模态大语言模型（MLLMs）无需额外训练即可实现强大的少样本分类性能。该方法通过提示MLLM判断查询图像与支持图像是否属于同一类别，并将肯定响应的logit作为相似度分数进行分类，在12个数据集上显著超越现有SOTA方法。

Details

Motivation: 解决现有多模态大语言模型在少样本图像分类任务中能力未充分挖掘的问题，旨在通过任务分解和提示工程，使现成MLLMs无需微调即可成为高效少样本分类器。

Result: 在12个少样本基准数据集（包括6个标准数据集和6个新构建数据集）上评估，DeCoDe显著超越当前最先进的少样本学习方法，在标准领域和新领域均表现出色。

Insight: 创新点在于将少样本分类重构为成对图像比较的二元决策问题，并利用MLLMs的隐含推理能力；通过引入高层信息（如数据领域）进一步提升性能，为轻量化适配MLLMs提供了新思路。

Abstract: Multimodal Large Language Models (MLLMs) have demonstrated remarkable abilities when analyzing images, yet translating these capabilities to few-shot image classification remains challenging. To bridge this gap, we present DeCoDe, a simple yet effective technique that enables off-the-shelf MLLMs to act as strong few-shot classifiers without any additional training. Our approach builds on the idea of few-shot classification as a set of pairwise image comparisons, decomposing the task into a set of binary decisions. Given a query image and a support image from a candidate class, the MLLM is prompted to decide whether the two images depict the same class. The logit corresponding to an affirmative response is then used as a similarity score to assign the query image to the most likely class. While this already yields good results, we show that providing additional high-level information, such as the data domain, to the model further improves performance. Our evaluation provides an extensive analysis of various inference variants on a suite of twelve datasets, six established and six newly curated few-shot benchmarks spanning across diverse domains. The results show that the proposed simple decomposition technique can turn off-the-shelf MLLMs into powerful few-shot learners, significantly outperforming current state-of-the-art few-shot methods on both standard and novel domains. Code is available at https://github.com/yunhanwang1105/DeCoDe.

[27] A Synthetic-Driven Vision System for Assembly Step Recognition cs.CVPDF

Hui Zhang, Xuanang Lei, Rui Wang, Julian Ferchow, Mirko Meboldt

TL;DR: 本文提出了一种用于装配步骤识别的合成驱动视觉系统，旨在解决工业装配质量控制的实时监控问题。该系统通过自动生成逼真的装配序列，并利用合成数据训练实时检测模型，从而避免了昂贵且费力的真实数据收集与标注。

Details

Motivation: 工业装配质量控制需要实时监控，但基于视觉的自动化检测模型通常依赖特定任务的真实数据，这些数据收集和标注成本高昂、劳动密集。

Result: 在真实世界的装配案例中，该系统达到了92.4%的准确率，性能分别提升了46.7%、15.8%和61.2%。

Insight: 创新点在于集成了基于物理的运动生成模块以捕捉不同人工装配的差异，设计了领域随机化渲染以处理环境复杂性，并采用基于目标检测的步骤识别模块以实现鲁棒的模拟到真实迁移，从而提供了一种无需昂贵真实数据的实用工业检测解决方案。

Abstract: Quality control in industrial assembly is essential, and real-time monitoring of the assembly process is crucial for preventing costly defects and ensuring production reliability. Vision-based automated inspection offers a powerful solution for such real-time monitoring. However, due to the specialized industrial components and processes, training these models typically relies on task-specific real-world data, which is costly and labor-intensive to collect and annotate. In this paper, we propose a system that automatically generates realistic assembly sequences and further trains real-time inspection models using the synthetic data. It can be efficiently applied to a given task within an hour, requiring only CAD models and simple step descriptions. Focusing on practical challenges, our system integrates a physics-based motion generation module to capture the variance of different human assembly, designs domain-randomized rendering to deal with the environmental complexity and variation, and employs an object-detection-based step recognition module for robust sim-to-real transfer, leading to 92.4% accuracy on a real-world assembly case with 46.7%, 15.8% and 61.2% performance improvement, respectively. Overall, our system provides a practical solution for industrial assembly inspection without requiring expensive real-world data collection and annotation, with the effectiveness validated on real industrial assembly tasks.

[28] Progressive Pose-Guided 4D Animal Reconstruction from Monocular Video cs.CVPDF

Siyuan Li, Weiying Chen, Yilin Wang, Xinxin Zuo, Xingyu Li

TL;DR: 本文提出了一种基于3D高斯泼溅的渐进式测试时优化框架，用于从单目视频中重建高保真的4D动物模型。该方法通过对称感知的时间编码和部件条件变形机制，将关节姿态与非刚性变形解耦，从而在缺乏可靠模板的情况下，实现对多种动物的鲁棒重建。

Details

Motivation: 从单目视频重建4D动物面临物种间差异大、关节复杂且缺乏可靠模板的挑战。现有方法要么依赖严格的类别先验限制了泛化能力，要么使用无约束生成模型牺牲了输入保真度，本文旨在弥合这一差距。

Result: 大量实验表明，该方法在多种物种上具有鲁棒的泛化能力，在几何精度、时间一致性和视觉保真度方面均优于现有基线方法，即使在先验严重不匹配的情况下也是如此。

Insight: 核心创新在于提出一个渐进式策略，仅需粗略的形状先验，通过对称感知时间编码和由可学习部件锚点及蒙皮场引导的部件条件变形机制，有效解耦姿态与变形，实现了高保真重建。

Abstract: Reconstructing 4D animals from monocular videos is challenging due to large inter-species variation, complex articulations, and the lack of reliable templates. Existing approaches typically rely on either strict category-specific priors that restrict generalization, or unconstrained generative models that sacrifice input fidelity. To bridge this gap, we present a progressive test-time optimization framework built on 3D Gaussian Splatting for high-fidelity 4D animal reconstruction from a single video. Our key insight is that a coarse shape prior suffices when coupled with a progressive strategy that disentangles articulated pose from non-rigid deformation. Specifically, we employ a symmetry-aware temporal encoding that exploits bilateral cues while absorbing camera estimation drift and a part-conditioned deformation mechanism guided by learnable part anchors and a learnable skinning field. Extensive experiments demonstrate that our approach generalizes robustly across diverse species, achieving superior geometric accuracy, temporal consistency, and visual fidelity compared to existing baselines, even under severe prior mismatch.

[29] Steal the Patch Size: Adversarially Manipulate Vision-Language Models cs.CV | cs.LGPDF

Kai Hu, Akash Bharadwaj, Weichen Yu, Matt Fredrikson

TL;DR: 本文提出了一种针对视觉语言模型的黑盒模型窃取攻击方法，能够恢复已部署模型的私有视觉分词器配置，包括视觉补丁大小和输入预处理流程。该方法利用ViT风格分块化引入的任务级侧信道：当合成网格图像与隐藏的补丁网格对齐时，边界线索在分词过程中被抹除，导致周期性准确率下降。通过扫描网格单元尺寸并测量这些准确率崩溃点，可以推断出补丁大小；通过引入填充和一致性检查测试，还能进一步识别预处理是动态分辨率还是固定分辨率，并恢复目标调整尺寸的分辨率。

Details

Motivation: 解决如何从黑盒访问的视觉语言模型中窃取关键的私有配置参数（如视觉补丁大小和预处理细节）的问题，这些参数对于理解模型内部工作机制和发起针对性攻击至关重要。

Result: 该方法在开源Qwen-VL变体和包括GPT、Claude在内的专有模型上均能可靠地恢复与分词器相关的参数，并证明了这种信息泄露能够实现预处理感知的迁移攻击和针对模型的对抗性操纵。

Insight: 创新点在于发现了ViT分块化过程中网格对齐导致的周期性准确率下降这一侧信道，并将其转化为一种实用的参数推断攻击。从客观角度看，该方法为模型安全评估提供了一个新的攻击面，揭示了视觉分词器配置的脆弱性，对模型部署的隐私保护设计具有警示意义。

Abstract: We present a black-box model-stealing attack that recovers private vision-tokenizer configurations of deployed vision-language models (VLMs), including the visual patch size and input preprocessing pipeline. The key idea is a task-level side channel induced by ViT-style patchification: when a synthetic grid image is aligned with the hidden patch grid, boundary cues are erased at tokenization, causing periodic accuracy drop. By sweeping the grid cell size and measuring these collapses, we infer the patch size; by introducing padding and a consistency-check test, we further identify whether preprocessing is dynamic- or fixed-resolution and recover the target resize resolution. Across open-source Qwen-VL variants and proprietary models including GPT and Claude, we reliably recover tokenizer-related parameters. Finally, we show that such leakage enables preprocessing-aware transfer attacks and model-targeted adversarial manipulation.

[30] VOCA: Visual Odometry with Codec Awareness cs.CVPDF

Nouri Alexander Hilscher, Mateo de Mayo, Dominik Muhle, Christoph Otten genannt Hermes, Daniel Cremers

TL;DR: VOCA是一种因果立体视觉里程计方法，通过利用视频编解码器信息来提升压缩视频流中的相机姿态估计性能。该方法在压缩流上的相对轨迹误差、效率和绝对轨迹误差方面达到了最先进的水平。

Details

Motivation: 现有视觉里程计和V-SLAM系统主要针对原始未压缩视频设计，而实际系统广泛使用硬件编解码器进行高效压缩以节省存储和带宽，但这种有损压缩会引入视觉伪影，损害传统跟踪系统的性能。

Result: 在压缩视频流上，VOCA在因果视觉里程计任务中，于相对轨迹误差、效率和绝对轨迹误差指标上均取得了最先进的性能。

Insight: 论文的核心创新点在于将广泛可用的视频编解码器信息整合到视觉里程计流程中，以缓解压缩伪影带来的负面影响，这为利用现有硬件信息提升视觉任务性能提供了新思路。

Abstract: Camera pose estimation from image streams is a critical component of spatial world models that integrate perception into planning and decision-making. Nearly all Visual Odometry (VO) and Simultaneous Localization and Mapping (V-SLAM) systems have focused on datasets containing raw, uncompressed videos. Many working systems instead use ubiquitous hardware units to efficiently compress and decode video streams, saving orders of magnitude in storage and bandwidth. However, this lossy compression introduces visual artifacts that hinder the performance of traditional tracking systems. We present VOCA, a causal stereo visual-odometry method that exploits codec information to improve tracking performance. We achieve state-of-the-art performance on causal VO for relative trajectory error, efficiency, and absolute trajectory error on compressed streams. This work highlights the potential of leveraging widely available video codec information for vision tasks.

[31] EgoSafetyBench: A Diagnostic Egocentric Video Benchmark for Evaluating Embodied VLMs as Runtime Safety Guards cs.CV | cs.AIPDF

Siddhant Panpatil, Arth Singh, Mijin Koo, Chaeyun Kim, Haon Park

TL;DR: 本文提出了EgoSafetyBench，一个用于评估具身视觉语言模型作为运行时安全守卫的自我中心视频诊断基准。该基准包含1200个机器人视角场景，以半秒粒度标注，分为情境轨道（800个场景）和视觉通道轨道（400个场景），旨在测试模型区分真正危险与表面惊险的常规活动的能力。评估发现，现有模型能识别危险视频，但常错过具体危险时刻，且易受场景内误导性文本影响。

Details

Motivation: 当前视觉语言模型被提议作为家庭和工厂中具身智能体的运行时安全守卫，但现有二元安全基准无法区分真正危险与表面惊险的常规活动，因此需要一个更精细的诊断基准来评估其部署能力。

Result: 在EgoSafetyBench上评估了十个开源和闭源VLM，发现它们能可靠识别包含危险的视频，但常错过具体危险时刻（尤其是情境性危险），且所有模型都受到场景内误导性文本的负面影响，导致漏检或过度干预。

Insight: 创新点在于提出了一个细粒度、包含对比阶梯（仅单个关键线索不同的近相同场景）的自我中心视频诊断基准，能更真实地评估VLM的物理安全推理能力；客观分析表明，现有模型的安全鲁棒性可能源于无差别的警报而非真正的物理推理。

Abstract: Vision-language models (VLMs) are now proposed as runtime safety guards for embodied agents in homes and factories. A deployable guard must catch genuinely unsafe situations while avoiding unnecessary intervention on routine but superficially alarming activity, a distinction that binary safety benchmarks obscure. We introduce EgoSafetyBench, an egocentric video benchmark of 1,200 robot-view scenarios annotated at half-second granularity, to evaluate VLMs as streaming guards across two tracks. The situational track (800 scenarios) spans four families, from routine and safe-but-suspicious scenes to obvious and contextual hazards. The visual-channel track (400 scenarios) targets in-scene text-a sign, sticker, or label visible in the scene-that can misrepresent the physical situation, pairing each misleading sign with a truthful version to test both whether a guard flags the text as misleading and whether the text corrupts its physical-safety judgment. Both tracks use contrastive ladders: near-identical scenarios differing only in a single visible deciding cue, so a correct call must hinge on that cue rather than the overall scene type. We evaluate ten open- and closed-source VLMs. We find that while guards reliably recognize videos containing hazards, they often miss specific hazardous moments, particularly contextual hazards. Furthermore, misleading in-scene signs degrade all tested guards: vulnerable models miss up to a third of hazards, while robust models over-intervene on safe content. Matched controls reveal that apparent safety robustness often reflects indiscriminate alarming rather than true physical reasoning.

[32] Does Your ViT Still Need U-Net for Segmentation? cs.CVPDF

Xin Li, Wenhui Zhu, Xuanzhao Dong, Xiwen Chen, Yanxi Chen

TL;DR: 本文探讨了在现代视觉Transformer（ViT）骨干网络下，医学图像分割是否仍需要U-Net风格的解码器。作者提出了一种仅编码器的分割框架EoSeg，通过多级查询建模和可学习的块融合实现，并在多个医学影像数据集上验证了其有效性。

Details

Motivation: 随着大规模预训练提升了ViT的表征能力，作者质疑U-Net范式在医学图像分割中的必要性，并探索如何设计仅编码器的分割框架。

Result: 在涵盖CT、MRI、组织病理学、内窥镜和皮肤镜的七个基准数据集上进行了广泛实验，例如在Synapse数据集上达到85.50%的mDice分数，在ACDC上达到91.73%，在GlaS上达到93.27%，证明了方法的有效性。

Insight: 创新点在于提出了一个仅编码器的分割设计EoSeg，采用基于查询的架构，结合多级查询建模和可学习的块融合，表明在现代ViT骨干网络下，U-Net风格的解码器已非必需，为医学图像分割提供了更简洁的框架。

Abstract: Medical image segmentation is dominated by U-Net-style encoder-decoder architectures. Vision Transformers (ViTs) overcome the limited receptive field of convolutional networks through self-attention, enabling modeling of long-range dependencies. Early ViT-based segmentation methods typically retained U-Net-style decoders because pretrained ViT representations were insufficient to support accurate dense prediction. Recent advances in large-scale pretraining have redefined the representation capability of ViTs, reducing the reliance on U-Net-style decoder architectures in modern vision models. This prompts two questions: Is the U-Net paradigm still necessary for medical image segmentation? If not, how should an encoder-only segmentation framework be designed? Motivated by these questions, we explore key architectural choices for encoder-only medical image segmentation based on modern ViT backbones and establish a query-based encoder-only design with multi-level query modeling and learnable block fusion, realized in Encoder-only Segmentation (EoSeg). Extensive experiments across seven benchmark datasets spanning CT, MRI, histopathology, endoscopy, and dermoscopy validate the effectiveness of the proposed design across diverse medical imaging modalities, including mDice scores of 85.50% on Synapse, 91.73% on ACDC, and 93.27% on GlaS. The results demonstrate that a U-Net-style decoder is no longer necessary for medical image segmentation with modern ViT backbones and further show that EoSeg provides an effective encoder-only design. Code is available at: https://github.com/Retinal-Research/EoSeg

[33] Multi-Hypothesis Test-Time Adaptation to Mitigate Underspecification cs.CV | cs.AIPDF

Afshar Shamsi, Xiao-Yu Guo, Hamid Alinejad-Rokny, Arash Mohammadi, Damien Teney

TL;DR: 本文提出了一种多假设测试时适应（Multi-Hypothesis TTA）框架，通过粒子多样化探索多个可能的适应轨迹，以缓解熵最小化导致的欠规范问题，从而提升模型在分布偏移下的鲁棒性和稳定性。

Details

Motivation: 测试时适应（TTA）在无监督条件下通过熵最小化进行参数调整，但该过程存在欠规范问题：多个不同的参数更新可能达到相似的低熵值，却导致截然不同的决策边界，使得标准TTA方法脆弱且易陷入虚假模式。

Result: 在多个具有挑战性的基准测试中，该方法在混合分布偏移下提升了3-4%，在批大小为1时提升了2-3%，在标签偏移下提升了1-2.5%，均优于当前最先进的基线方法。

Insight: 创新点在于将TTA重新解释为多假设推理问题而非单点优化任务，通过输出、参数、优化器和输入层面的多层次多样化实现结构化探索，该框架可作为即插即用模块与现有TTA方法兼容。

Abstract: Test-Time Adaptation (TTA) seeks to improve model robustness under distribution shifts by adapting parameters using unlabeled target data. However, in the absence of supervision, entropy-based adaptation is fundamentally underconstrained: multiple distinct parameter updates can achieve similarly low entropy while inducing drastically different decision boundaries. This phenomenon, known as underspecification, renders standard TTA brittle and prone to collapse into spurious modes. In this work, we reinterpret TTA through a posterior-inspired lens induced by entropy minimization, where low-entropy solutions define a pseudo-likelihood over parameters. Instead of committing to a single point estimate, we introduce a particle-based diversification framework that explores multiple plausible adaptation trajectories simultaneously. Our method can be viewed as a structured exploration of multiple plausible adaptation solutions, implemented through multi-level diversification at the output, parameter, optimizer, and input levels. Crucially, the framework acts as a plug-and-play wrapper compatible with existing TTA methods. Extensive experiments on challenging benchmarks demonstrate consistent gains in stability and robustness, achieving improvements of 3-4% under mixed shifts, 2-3% with batch size one, and 1-2.5% under label shifts, outperforming state-of-the-art baselines. Our results suggest that treating TTA as a multi-hypothesis inference problem, rather than a single-point optimization task, is key to mitigating underspecification and enabling reliable real-world deployment.

[34] MVDGC: Joint 3D and 2D Multi-view Pedestrian Detection via Dual Geometric Constraints cs.CVPDF

Thinh Phan, Hao Vo, Khoa Vo, Thanh Ngo, Cuong Pham

TL;DR: 本文提出MVDGC，一个统一的多视角行人检测框架，通过稀疏的3D圆柱查询联合估计鸟瞰图平面上的行人位置和图像视图中的2D边界框。该方法利用圆柱几何建模建立BEV与图像视图之间的双重空间约束，避免了传统投影方法导致的特征失真，从而提升遮挡场景下的检测鲁棒性。

Details

Motivation: 现有多视角行人检测方法通常将图像特征投影到鸟瞰图进行定位，但投影过程会导致空间结构破坏和特征质量下降，尤其在密集区域影响定位精度；同时未能充分利用BEV地面点与图像边界框之间的强关联性。

Result: 论文在标准多视角行人检测基准（如Wildtrack和MultiviewX）上进行了实验，MVDGC取得了最先进的性能，特别是在遮挡严重的密集场景中表现出显著的精度提升。

Insight: 创新点在于引入3D圆柱查询作为形状锚点，将BEV定位和图像检测统一为3D圆柱位置与形状优化任务；通过几何约束直接从未失真的图像特征中提取信息，避免了特征投影失真，并实现了2D检测与3D定位的联合优化。

Abstract: The core challenge in multi-view pedestrian detection (MVPD) lies in effective aggregation of visual features from different viewpoints for robust occlusion reasoning. Recent approaches have addressed this by first projecting image-view features onto a Bird’s Eye View (BEV) map, where ground localization is then performed. Despite impressive performance, the perspective transformation induces severe distortion, causing spatial structure break and degrading the quality of object feature extraction. The blurred and ambiguous features hinder accurate BEV point localization, especially in densely populated regions. Moreover, the strong mutual relationship between the BEV ground point and image bounding boxes is not capitalized on. Although multi-view consistency of 2D detections can serve as a powerful constraint in BEV space, these detections are commonly treated as auxiliary signals rather than being jointly optimized with the primary task.In this work, we propose \textbf{MVDGC}, a unified framework that \emph{jointly estimates pedestrian locations on the BEV plane and 2D bounding boxes in image views}. MVDGC employs a \emph{sparse set of 3D cylindrical queries} that embraces geometric context across both BEV and image views, enforcing dual spatial constraints for precise localization. Specifically, the geometric constraints is established by modeling each pedestrian as a vertical cylinder whose center lies on the BEV plane and whose projection casts a rectangular box in the image views. These queries function as shape anchors that directly extract 2D features from the intact image-view features using camera projection, eliminating projection-induced distortions. The 3D cylindrical query enables the unification of BEV and ImV localization into a single task: 3D cylinder position and shape refinement. Code is available at: https://github.com/UARK-AICV/MVDGC

[35] AEGIS: A Multi-Task Joint-Embedding Predictive Architecture for Mammography cs.CVPDF

Scott Chase Waggener, Sai Karthik Navuluru, Lakshman Tamil

TL;DR: 本文提出了Aegis，一种用于乳腺X线摄影中乳腺癌检测和密度评估的多任务联合嵌入预测架构。该架构基于自监督的联合嵌入预测架构（JEPA）对来自14个临床中心的71,103项研究进行预训练，随后通过渐进式分辨率缩放（最高至2048x1536）进行监督微调。在精心策划的785项研究测试集上，其最大模型在乳腺癌分诊任务中实现了0.949的AUC，在最佳操作点具有93%的敏感性和75%的特异性。

Details

Motivation: 旨在开发一个统一的、多任务的深度学习架构，以同时解决乳腺X线摄影中的两个关键临床任务：乳腺癌检测（分诊）和乳腺密度评估，从而提高诊断效率和准确性。

Result: 在内部测试集上，最大模型在乳腺癌分诊任务中达到0.949 AUC（93%敏感度，75%特异度）；与FDA批准的基线模型集成后提升至0.952 AUC。在乳腺密度分类任务中，二分类AUC为0.953，四分类（BI-RADS）的精确准确率为62.6%，相邻准确率达98.8%。在外部数据集VinDr-Mammo上的零样本验证中，分诊任务AUC为0.871，证明了其跨人群泛化能力。

Insight: 创新点在于将自监督的JEPA预训练范式与渐进式高分辨率监督微调相结合，构建了一个统一的多任务模型。其架构设计（ViT变体+JEPA）和训练策略（从自监督到监督，逐步提升分辨率）有效提升了模型在两项核心任务上的性能与泛化能力，为医学影像分析提供了可借鉴的多任务学习框架。

Abstract: We present Aegis, a joint-embedding predictive architecture for breast cancer detection and density assessment in mammography. We train three Vision Transformer variants (Small/Base/Large) using self-supervised joint-embedding predictive architecture (JEPA) pre-training on 71,103 studies from 14 clinical sites, followed by supervised fine-tuning with progressive resolution scaling up to 2048x1536. On a curated 785-study test set, our largest model achieves area under the receiver operating characteristic curve (AUC) 0.949 for breast cancer triage with 93% sensitivity and 75% specificity at the optimal operating point. An ensemble combining our model with a U.S. Food and Drug Administration-cleared baseline further improves discrimination to 0.952 AUC. For breast density classification, the model achieves 0.953 AUC for binary (dense vs. non-dense) classification and 62.6% exact accuracy across four Breast Imaging Reporting and Data System (BI-RADS) categories, with 98.8% adjacent accuracy comparable to reported human inter-reader agreement. External validation on the public VinDr-Mammo dataset provides evidence of cross-population transfer under a different reference standard, with the largest model achieving 0.871 AUC for triage in a zero-shot setting.

[36] Wake up for Touch! Mask-isolated Tactile Alignment Learning in MLLMs cs.CV | cs.MM | cs.ROPDF

Yoonhyung Park, Minji Kim, Sungwon Moon, Jiyoung Lee

TL;DR: 本文提出Splash框架，通过掩码隔离的触觉对齐学习方法，为多模态大语言模型（MLLMs）引入触觉感知能力，在避免灾难性遗忘的同时实现触觉推理，且不增加推理开销。

Details

Motivation: 触觉能感知摩擦、柔顺性等内在材料属性，而视觉常无法分辨；现有紧凑模型在引入新感官模态时面临与视觉语言推理能力零和权衡的问题。

Result: 在SSVTP、TVL和TacQuad等视觉-触觉基准测试中达到SOTA性能，同时保持了模型的通用能力。

Insight: 通过量化预训练参数重要性并划分为休眠与关键子空间，冻结关键子空间以保护视觉知识，仅更新休眠子空间进行触觉对齐，实现了选择性、非破坏性的模态扩展。

Abstract: Touch supplies the physical grounding needed to perceive intrinsic material properties, such as friction and compliance, that vision alone often cannot resolve. Recent efforts for equipping multimodal LLMs with this tactile sense, however, expose a zero-sum trade-off: the limited parameter budget of compact models forces a choice between acquiring the new sensory modality and preserving the established vision-language reasoning. We present Splash, a mask-isolated tactile alignment learning framework for MLLMs. Splash quantifies the significance of each pretrained parameter, and partitions the parameter space into a dormant and critical subspace. While the frozen critical subspace acts as a stable anchor to safeguard general visual knowledge, Splash updates the isolated dormant subspace to internalize tactile alignment towards LLMs. This selective, non-destructive expansion effectively prevents catastrophic forgetting and ensures non-destructive modality expansion. Extensive experiments show that Splash effectively achieves tactile reasoning without additional inference overhead in the LLM part, demonstrating state-of-the-art performance on visuo-tactile benchmarks, including SSVTP, TVL, and TacQuad, while preserving its original general-purpose capabilities.

[37] OnPoint: Offline-to-Online Multi-Level Distillation for Point-Supervised Online Temporal Action Localization cs.CVPDF

Sakib Reza, Gauri Jagatap, Mohsen Moghaddam, Octavia Camps, Andrea Fanelli

TL;DR: 本文提出了一种名为OnPoint的离线到在线多级蒸馏框架，用于解决点监督在线时序动作定位（POTAL）问题。该框架通过伪片段实例蒸馏、类激活序列蒸馏和前瞻窗口级蒸馏，将离线教师模型的知识迁移到在线学生模型中，并利用原始点标签和动作性引导的注意力校准来提升鲁棒性。

Details

Motivation: 传统的时序动作定位方法通常依赖片段级标注或离线访问完整视频，这限制了其可扩展性和在线应用。本文旨在仅使用每个动作实例的一个时间点标注，在流式视频中实现在线动作定位。

Result: 在五个数据集上的实验表明，OnPoint方法持续优于多个强基线模型，为点监督在线时序动作定位（POTAL）任务奠定了坚实的基础。

Insight: 创新点在于提出了一个新颖的离线到在线多级蒸馏框架，将点监督离线模型的知识有效迁移到在线模型，并通过结合原始点标签和动作性引导的注意力校准来增强模型的鲁棒性，为弱监督在线时序分析提供了新思路。

Abstract: Temporal Action Localization (TAL) typically relies on segment annotations or offline access to full videos, limiting scalability and online use. We introduce Point-Supervised Online TAL (POTAL), which localizes actions in streaming videos using only one temporal point per instance. To solve POTAL, we propose OnPoint, an offline-to-online multi-level distillation framework that transfers knowledge from a point-supervised offline teacher to an online student via (i) pseudo-segment instance distillation, (ii) class-activation sequence distillation, and (iii) anticipatory window-level distillation. We further improve robustness by incorporating the original point labels into student training and by refining anchor decoding with actionness-guided attention calibration. Experiments on five datasets show OnPoint consistently outperforms strong baselines, establishing a solid foundation for POTAL.

[38] Rosetta: Composable Native Multimodal Pretraining cs.CV | cs.CL | cs.LGPDF

Xiangyue Liu, Zijian Zhang, Miles Yang, Zhao Zhong, Liefeng Bo

TL;DR: 本文提出了Rosetta，一种可组合的原生多模态预训练框架，旨在实现无缝且无损的模态扩展。该框架采用模块化范式，将核心基础知识保存在全局共享专家中，而将模态特定能力分布在即插即用专家中，并通过动量锚定正交投影（MAOP）技术来保证无损组合，有效缓解梯度冲突和灾难性遗忘问题。

Details

Motivation: 实现真正的通用人工智能需要能够整合新模态而不遗忘先前知识的基础模型。然而，现有架构（包括标准混合专家模型和混合Transformer）在同时处理连续生成目标和离散理解任务时，存在严重的梯度冲突和灾难性遗忘问题，严重阻碍了多模态的可扩展性。

Result: 广泛的评估表明，与标准混合专家模型和混合Transformer架构相比，Rosetta能够鲁棒地保留已建立的语言和视觉理解能力，同时提供更优的图像生成效果，并解锁跨模态协同效应。

Insight: 核心创新在于模块化、可组合的专家设计，以及提出的动量锚定正交投影（MAOP）方法，该方法利用优化器的动量状态作为隐式语义锚点，有选择地中和来自新模态的冲突梯度分量，同时保留协同更新，从而实现了无损的模态扩展和知识保留。

Abstract: Achieving true artificial general intelligence requires foundation models capable of integrating new modalities without forgetting prior knowledge. However, accommodating continuous generative objectives alongside discrete understanding tasks causes severe gradient conflicts. Existing architectures, including standard Mixture-of-Experts (MoE), are highly susceptible to representation overwriting. Even structurally partitioned paradigms like Mixture-of-Transformers (MoT) remain vulnerable to catastrophic forgetting, severely impeding multimodal scalability. In this work, we introduce Rosetta, a composable native multimodal pretraining framework designed for seamless and non-destructive modality expansion. Rosetta adopts a modular paradigm where core foundational knowledge is preserved within global shared experts, while modality-specific capabilities are distributed across plug-and-play experts. To guarantee non-destructive composition, we propose Momentum-Anchored Orthogonal Projection (MAOP). MAOP leverages the optimizer’s momentum state as an implicit semantic anchor, selectively neutralizing conflicting gradient components from new modalities while preserving synergistic updates. Extensive evaluations demonstrate that, while standard MoE and MoT architectures suffer catastrophic forgetting of previously acquired knowledge, Rosetta robustly preserves established language and visual understanding. Furthermore, it delivers superior image generation and unlocks cross-modal synergy, paving the way for truly composable and unified multimodal foundation models. To facilitate further multimodal research, we release our code and checkpoints to the community. Project page at https://rosetta-lmm.github.io/.

[39] Learning When to Listen: Gated Affect Fusion for Human Motion Prediction cs.CV | cs.AIPDF

Jingni Huang

TL;DR: 本文研究了在无约束真实世界视频中，利用面部情感特征辅助人体运动预测的效用与局限性。作者提出了一种结合MediaPipe身体姿态轨迹与HSEmotion面部情感表征的多模态流程，并引入了门控情感变换器（GAT）来动态调节跨模态信息流。通过严格的受试者内协议下的多时间范围评估，研究发现，简单的早期跨模态连接会降低预测精度，而门控机制能自适应地控制情感信息流，稳定整合。实验表明，面部情感仅在短中期窗口（如30帧）内提供有限的预测线索，而长期轨迹主要由内在运动连续性主导。

Details

Motivation: 在无约束真实世界视频中，人体运动预测因未来行为的模糊性和存在噪声多模态观测而具有挑战性。面部情感可能提供互补的行为线索，但其在实际运动预测框架中的效用和机制边界尚不明确。

Result: 在严格受试者内协议下的多时间范围评估中，与仅使用姿态的基线相比，简单的早期跨模态连接会持续降低预测精度。相反，提出的门控机制通过自适应控制情感流，稳定了跨模态整合。受控反事实实验表明，学习到的门能成功抑制非结构化的跨模态噪声，同时对合理的情感信号保持响应。实证结果表明，面部情感特征仅在短中期窗口（如30帧）内提供有限的、依赖于时间范围的预测线索。

Insight: 创新点在于系统研究了情感条件预测在真实场景中的效用和时间局限性，并提出了门控情感变换器（GAT）来动态调节跨模态信息流，而非简单连接。客观分析认为，其核心洞察是面部情感应被视为未来运动的补充性行为线索而非主导驱动因素，这为无约束人体运动预测中的选择性多模态融合提供了实用指导。

Abstract: Human motion forecasting in unconstrained real-world videos remains challenging due to the ambiguity of future behaviors and the presence of noisy multimodal observations. While facial affect potentially provides complementary behavioral cues, its practical utility and mechanistic boundaries within motion forecasting frameworks remain poorly understood. In this work, we present a systematic study investigating the utility and temporal limitations of affect-conditioned forecasting in-the-wild. We establish a rigorous multimodal pipeline combining MediaPipe body pose trajectories with HSEmotion facial affect representations, and introduce the Gated Affect Transformer (GAT) to dynamically regulate cross-modal information flow. Through extensive multi-horizon evaluations under a strict subject-wise protocol, we demonstrate that naive early cross-modal concatenation consistently degrades forecasting accuracy relative to pose-only baselines. Conversely, our proposed gating mechanism stabilizes cross-modal integration by adaptively controlling the affective stream. Crucially, controlled counterfactual experiments using shuffled and randomized affect inputs reveal that the learned gate successfully suppresses unstructured cross-modal noise while remaining responsive to plausible affective signals. Furthermore, our empirical results indicate that facial affect features provide bounded, horizon-dependent predictive cues strictly within short-to-medium windows (e.g., 30 frames), whereas long-term trajectories remain predominantly governed by intrinsic kinematic continuity. Our findings provide empirical evidence that facial affect should be regarded as a complementary behavioral cue rather than a dominant driver of future motion, offering practical guidance for selective multimodal fusion in unconstrained human motion forecasting.

[40] CORGI: Consistency-Aware 3D Dog Reconstruction from a Single Image in the Wild cs.CVPDF

Yuxiao Wu, Weile Li, Boyi Zhu, Yumeng Liu, Youcheng Cai

TL;DR: 本文提出了CORGI框架，用于从单张野外图像重建高保真、可动画的3D狗模型。该框架无需3D监督，通过三个核心组件解决生成不一致和缺乏多视角数据的问题：CDOG策略用于姿态归一化和合成360度视频，CA-3DGS模块建模每视角生成误差以学习精确顶点位移，以及DCGR模块消除结构失真并恢复高频细节。

Details

Motivation: 从单张无约束的野外图像重建高度关节化动物（如狗）的高保真3D模型是一个重大挑战，现有方法存在生成不一致和缺乏多视角捕捉的问题。

Result: 大量实验表明，CORGI在3D狗重建任务上取得了最先进的性能，能够泛化到不同犬种，生成几何精确、视觉连贯且完全可动画的3D资产。

Insight: 创新点包括：1) 无需3D监督的一致性感知重建框架；2) 结合规范驱动轨道生成、可变形3D高斯泼溅和生成式修复的模块化设计；3) 通过神经变形场显式建模每视角生成误差，提高了重建的准确性和鲁棒性。

Abstract: Reconstructing high-fidelity 3D models of highly articulated animals, such as dogs, from a single in-the-wild image remains a formidable challenge. In this paper, we introduce CORGI, a novel framework for consistency-aware 3D dog reconstruction from a single unconstrained image that completely eliminates the need for 3D supervision. To overcome generative inconsistencies and the lack of multi-view capture, our pipeline introduces three core components. First, we propose a Canonical-Driven Orbital Generation (CDOG) strategy, utilizing specialized Canonical and Orbit LoRAs to normalize arbitrary input poses and synthesize reliable 360-degree video observations. Second, we design a Consistency-aware Deformable 3DGS (CA-3DGS) module that anchors on a D-SMAL prior, explicitly modeling per-view generative errors through dedicated neural deformation fields to learn accurate vertex-level displacements. Finally, to eliminate structural distortions and recover high-frequency details, we introduce a self-supervised Deformation-Conditioned Generative Repair (DCGR) module. Extensive experiments demonstrate that CORGI achieves state-of-the-art performance, generalizing seamlessly across diverse dog breeds to produce geometrically accurate, visually coherent, and fully animatable 3D assets ready for downstream applications.

[41] RetailSMV: Exocentric vs. Egocentric Adaptation of Foundation Video World Models in Retail cs.CV | cs.AIPDF

Amirreza Rouhi, Rajat Aggarwal, Parikshit Sakurikar, Anoop M. Namboodiri, Sashi P. Reddi

TL;DR: 本文研究了在零售场景中，如何高效地微调预训练的基础视频扩散模型（Cosmos3-Nano），并比较了仅使用自我中心视角（egocentric）、仅使用他者中心视角（exocentric）以及两者结合的训练数据对模型适应效果的影响。研究基于新构建的RetailSMV数据集，发现仅使用他者中心视角数据进行微调，在多项指标上表现最佳，甚至优于结合两种视角的模型。

Details

Motivation: 预训练的基础视频扩散模型在互联网通用视频上训练，与零售等具体部署领域存在偏差。本文旨在探索，当可获得同一活动的同步自我中心和他者中心视角视频时，哪种视角的训练数据能产生最强的适应模型。

Result: 在包含200个剪辑的测试集上，使用七种互补指标进行严格配对统计评估。仅使用他者中心视角数据（15,985个剪辑）的模型，在七个点估计中的六个上匹配或超过了结合两种视角数据（32,105个剪辑）的模型，并且在LPIPS、PSNR和DreamSim指标上显著更优。

Insight: 创新点在于构建了RetailSMV数据集，该数据集从店员视角（而非传统顾客视角）提供了同步的多视角零售视频。核心发现是，在零售场景的模型适应中，他者中心视角数据比自我中心视角数据更具价值，且仅使用他者中心视角进行微调可能是更优策略，这挑战了结合更多数据必然更好的直觉。

Abstract: Foundation video diffusion models are increasingly viewed as world simulators for embodied agents, yet their pretraining on internet-scale generic video leaves them poorly aligned with real-world deployment domains. We study parameter-efficient adaptation of a pretrained foundation video world model to retail scenes: when synchronized egocentric and exocentric video of the same activity are available, which viewpoint of training data produces the strongest adapted model? We introduce RetailSMV (Retail Synchronized Multi-View), a corpus of 32,105 captioned retail clips from five supermarkets with synchronized ego/exo capture from the store-staff perspective (stocking, arranging, weighing, managing supply carts, scanning at checkout), rather than the customer-centric framing of prior retail video corpora, and train three matched Low-Rank Adaptation (LoRA) configurations of Cosmos3-Nano (egocentric-only, exocentric-only, combined) under identical hyperparameters. On a 200-clip held-out test set evaluated with seven complementary metrics under a strict paired statistical protocol, exocentric-only adaptation matches or exceeds combined adaptation on six of seven point estimates and is significantly better on LPIPS, PSNR, and DreamSim, despite training on only 15,985 exocentric clips (versus 32,105 for combined). A symmetric paired comparison further shows that adding exocentric data to egocentric-only training helps while adding egocentric data to exocentric-only training hurts. The absolute adaptation gap is largest at the shortest rollout time, identifying the near-horizon prediction window as the regime in which adaptation is most beneficial.

[42] DroneFINE: Domain-Aware Parameter-Efficient Fine-Tuning of Vision-Language Detectors for Drone Images cs.CVPDF

Ke Wu, Yanan Zhang, Yingjie Gao, Wenhao Li, Chenyu Zhou

TL;DR: 本文提出DroneFINE，一种针对无人机图像视觉语言检测器的领域感知参数高效微调新范式。它包含两个模块：HyperAdapter（一种数据依赖、前景感知的多路径适应机制）和SemanticGate（一种基于文本背景词汇抑制无关区域响应的策略），旨在解决VLM预训练数据与无人机鸟瞰视角图像之间的领域鸿沟问题。

Details

Motivation: 现有参数高效微调方法在将通用视觉语言模型适配到无人机场景时效果不佳，因为VLM的’自然场景、前景主导’视觉先验与无人机数据的’鸟瞰视角、背景主导、小目标’特性存在显著错配。

Result: 在VisDrone和UAVDT基准上的大量实验表明，DroneFINE显著优于现有PEFT方法，且性能与全参数微调相当，同时大幅减少了可训练参数量。

Insight: 创新点在于提出了领域感知的互补模块设计：HyperAdapter突破了PEFT静态结构的限制，实现了数据依赖的动态适配；SemanticGate则利用文本条件引导主动抑制背景干扰。这为跨领域适配VLM提供了一种结构化和轻量化的解决方案。

Abstract: Object detection for Unmanned Aerial Vehicles (UAVs) working in open and dynamic environments is a highly challenging task. While Vision-Language Models (VLMs) have offered a powerful solution for universal object detection, adapting them to UAV scenarios remains non-trivial due to a substantial domain gap between VLM pre-training data and aerial imagery. The prevailing Parameter-Efficient Fine-Tuning (PEFT) methods prove ineffective in bridging this gap, as VLMs’ “natural-scene, foreground-dominant” visual priors misalign with the “bird’s-eye-view, background-dominant, small-object” characteristics of UAV data. To address this issue, we propose DroneFINE, a novel PEFT paradigm comprising two domain-aware complementary modules tailored for VLM-based drone image detectors. Specifically, a data-dependent, foreground-aware, and multi-path adaptation mechanism named HyperAdapter is designed, which overcomes the static structural constraints of PEFT. In addition, a background suppression algorithm named SemanticGate is developed. It is a text-conditioned guidance strategy that employs background vocabulary to actively guide the model in suppressing responses from irrelevant regions. Extensive experiments on VisDrone and UAVDT demonstrate that DroneFINE significantly outperforms existing PEFT methods and achieves performance comparable to full fine-tuning while substantially reducing the number of trainable parameters.

[43] Personalized Object Identification and Localization via In-Context Inference with Vision-Language Models cs.CVPDF

Kensuke Nakamura, Byung-Woo Hong

TL;DR: 本文提出了一项新任务——个性化对象识别与定位（POIL），旨在基于少量带边界框标注的参考图像和目标对象标签，在查询图像中定位目标对象实例，同时拒绝不包含该对象的查询图像。作者构建了POIL数据集，并提出了一种名为IPLoc-ID的上下文推理算法，该算法通过自生成查询将候选框预测与实例验证整合到单一自回归生成框架中，有效减少了误检。

Details

Motivation: 现有方法IPLoc仅解决个性化对象定位（POL）任务，其假设查询图像总是包含目标对象，这限制了其在包含大量无关图像的真实场景中的适用性。因此，作者将POL扩展为更实用的POIL任务，要求模型同时进行定位和识别（即拒绝负样本）。

Result: 实验表明，IPLoc-ID在负查询图像上显著抑制了误检，同时保持了与IPLoc相当的定位性能。

Insight: 主要创新点在于将个性化定位任务重新定义为包含识别（拒绝负样本）的POIL任务，并提出了一个统一的、基于视觉语言模型的上下文推理框架（IPLoc-ID），通过自生成查询将定位和验证步骤连接起来，解决了传统目标检测、少样本目标检测或纯定位方法无法充分处理的实例级任务。

Abstract: Personalized object localization (POL) localizes an object instance in a query image based on a few reference images with bounding-box annotations and a target object label. The pioneering method, IPLoc, solves this task through in-context inference with vision-language models (VLMs). However, it assumes that the query image always contains the target object. This assumption severely limits its applicability to real-world scenarios with many irrelevant images. To address this issue, we formulate a new task, personalized object identification and localization (POIL), by positioning POL within the broader few-shot object detection framework. POIL aims to localize the target object instance while rejecting query images that do not contain the reference object instance. We also present POIL datasets constructed from public sources. We further propose an in-context algorithm named IPLoc-ID for solving POIL with VLMs. IPLoc-ID first predicts a candidate bounding box and then determines whether it corresponds to the reference object instance. We introduce a self-posed query to connect these two steps within a single autoregressive generation framework. Through ablation studies and comprehensive experiments, we show that IPLoc-ID substantially suppresses false-positive detections on negative query images while maintaining localization performance comparable to IPLoc. Overall, IPLoc-ID effectively addresses the practical instance-level POIL task, which cannot be sufficiently solved by conventional object detection, few-shot object detection, or the localization-only IPLoc method.

[44] SFDATrack: Generalized Source-Free Domain Adaptive Tracking Under Adverse Weather Conditions cs.CVPDF

Siyuan Yao, Ziqi Wang, Ruiqi Yu, Junqi Huang, Wenqi Ren

TL;DR: 本文提出了SFDATrack，一种广义的无源域自适应跟踪器，用于在恶劣天气条件下进行视觉目标跟踪。该方法仅利用目标域的恶劣天气样本，通过结合均值教师骨干网络与双交互Mamba块来提取对天气变化具有鲁棒性的目标令牌，并引入超球面原型投影模块将这些令牌映射到潜在超球面空间中的多域原型上，从而实现跨天气条件的强大泛化能力。

Details

Motivation: 现有域自适应跟踪方法严重依赖源域和目标域的大规模视频帧，这在源数据不可用的严格资源约束下不切实际，因此需要一种仅利用目标域样本的无源域自适应方法。

Result: 在多个基准测试上的广泛实验表明，SFDATrack相比最先进方法取得了优越的性能。

Insight: 创新点在于提出了广义的无源域自适应跟踪框架，结合了均值教师与双交互Mamba块进行鲁棒特征提取，并利用超球面原型投影模块来同时保持域特定和域不变特性，从而实现对多样化恶劣天气条件的有效适应。

Abstract: Domain adaptive visual object tracking under adverse weather conditions has garnered significant attention in recent years. Despite the impressive performance, existing methods heavily rely on the large-scale video frames from both source and target domains, which is impractical under rigid resource constraints where source data is unavailable. To overcome this limitation, we propose SFDATrack, a generalized source-free domain adaptive tracker that merely leverages adverse weather samples from the target domain for robust state estimation. Specifically, SFDATrack first employs a mean-teacher backbone with Dual Interactive Mamba (DIM) blocks to distill the candidate target tokens that are resilient to weather variations from classified, augmented samples. Afterwards, we introduce a hyperspherical prototype projection (HPP) module to project these tokens onto multi-domain prototypes within a latent hyperspherical space. By enforcing both domain-specific and domain-invariant properties of the multi-domain prototypes, SFDATrack can be seamlessly adapted to diverse weather conditions with powerful generalizability. Extensive experiments evaluated on various benchmarks demonstrate that SFDATrack achieves superior performance compared to state-of-the-art approaches. The code is available at https://github.com/watcherBR0/sfdatrack.

[45] LIST3R: Long-sequence Instance-aware 3D Reconstruction cs.CVPDF

Jing Gao, Wei Wang, Feiran Wang, Yan Yan

TL;DR: LIST3R是一个面向长序列三维重建的实例感知框架，其灵感来源于人类围绕稳定、可识别物体组织空间记忆的方式。该方法通过实例锚点组织重建过程，利用它们重新连接碎片化的子序列，并将局部观测整合为一致的全局三维场景。

Details

Motivation: 解决长视频序列三维重建中，由于视角变化、遮挡和重复访问导致轨迹漂移和场景碎片化的问题，旨在实现更连贯、准确的全局重建。

Result: 在长序列基准测试上的实验表明，该方法能产生更准确的相机轨迹和更高质量的三维重建结果，证明了持久实例锚点在组织长时程三维重建中的有效性。

Insight: 核心创新在于引入持久且可跟踪的实例锚点作为组织长序列重建的结构化单元，通过跨子序列的实例匹配来恢复重访区域并提供对象感知的约束，从而整合局部观测为全局一致的场景表示。

Abstract: We present LIST3R, an instance-aware framework for long-sequence 3D reconstruction inspired by the way humans organize spatial memory around stable and recognizable objects. LIST3R organizes long-sequence reconstruction around instance anchors, using them to reconnect fragmented subsequences and consolidate local observations into a coherent global 3D scene. Given a long video, our approach partitions it into overlapping subsequences and builds a structured local instance library for each partial reconstruction, maintaining persistent trackable anchors with semantic and geometric evidence. These anchors are matched across subsequences to recover revisited regions and provide object-aware constraints for fragment alignment, producing a consistent global reconstruction. During this process, the evolving geometric evidence updates the local instance libraries and progressively organizes them into a unified global 3D instance library. Experiments on long-sequence benchmarks show that our method produces more accurate trajectories and higher-quality 3D reconstructions, highlighting the effectiveness of persistent instance anchors for organizing long-horizon 3D reconstruction. Our code is available on the project page: https://yixn965.github.io/LIST3R/.

[46] Radial Interaction Tomography: Recognizing Non-Transitive Evolutionary Games from One Range-Expansion Image cs.CV | q-bio.PEPDF

Faruk Alpay, Baris Basaran

TL;DR: 本文提出了一种名为径向交互层析成像的计算机视觉逆问题方法，旨在从单张微生物范围扩张的终点图像中恢复半径索引的成对边界流场，并测试视觉模式是否与传递性标量适应度层次结构兼容。该方法通过提取对数极坐标下的扇区边界曲线作为几何信号，证明了终点可观测性和稳定性，并应用于检测循环残差，进而驱动无维度的主动设计控制层，覆盖反应-扩散控制、表型前沿优化等下游应用。

Details

Motivation: 解决从微生物范围扩张的终点图像中推断进化博弈动态的逆问题，特别是识别非传递性（循环）博弈模式，而不仅仅是传递性的适应度层次，以更深入地理解多类型扩张中的交互机制。

Result: 在确定性基准测试中（包括解析终点图像、模糊/噪声像素往返、标量零应力测试、公共图像追踪、多分辨率机制端点和非学习冻结前沿模拟器），该方法成功从终点图像恢复成对边缘流历史，并在机制性四类型扩张中检测到循环残差，验证了其有效性和鲁棒性。

Insight: 创新点在于将微生物扩张的视觉模式转化为可观测的几何信号（对数极坐标下的扇区边界曲线），并理论证明了终点可观测性和稳定性，同时开发了基于循环残差的主动设计控制框架，将计算机视觉逆问题与进化博弈机制分析及下游控制应用（如反应-扩散优化）相结合，提供了从静态图像推断动态历史的新途径。

Abstract: Colored sectors in a microbial range expansion encode more than lineage survival counts. We formulate a computer-vision inverse problem: from one endpoint image of an accretive multi-type expansion, recover the radius-indexed pairwise boundary-flow field and test whether the visual pattern is compatible with a transitive scalar fitness hierarchy. The observable is a geometric signal extracted from sector-boundary curves in log-polar coordinates. We prove endpoint observability and stability for frozen fronts, weighted transitive/cyclic decomposition, contact-complete circular design, physical-clock and mechanism non-identifiability, exact Gaussian cyclicity testing, and Bonferroni-valid interval scanning. The benchmark is deterministic: analytic endpoint images, blurred/noisy pixel round trips, scalar-null stress tests, public-image tracing, multi-resolution mechanistic endpoints, and a non-learning frozen-front simulator. The implementation recovers pairwise edge-flow histories from endpoint images, detects cyclic residuals in a mechanistic four-type expansion, and uses those residuals as forcing signals for a dimensionless active design-control layer covering reaction-diffusion control, phenotype-frontier optimization, protocol synthesis, Monte Carlo robustness, and a downstream population-state bridge.

[47] MindAU: EEG-Conditioned Facial Action Unit Editing via Dual-Stream Manifold Alignment cs.CV | cs.LGPDF

Zhenhang Li, Xin Zhou, Hao Deng, Lijun Yin

TL;DR: MindAU是一个通过脑电图（EEG）信号控制面部动作单元（AU）编辑的统一框架。它首先通过时序掩码重建和AU分类监督学习鲁棒的EEG表征，然后利用双流流形对齐在Qwen2.5-VL多模态空间中桥接EEG特征与AU级文本语义及身份无关的视觉位移轨迹，最后结合多种技术实现高保真、身份保持的面部编辑。

Details

Motivation: 现有脑解码研究主要关注从神经信号重建外部视觉内容，而利用EEG记录指导面部表情编辑仍未被充分探索。该研究旨在解决从嘈杂的EEG信号中识别与面部动作相关的模式，并将其落地为局部化、保持身份的表情编辑这一独特挑战。

Result: 论文在提出的新基准E-CAFE（EEG-Conditioned Action-Unit Facial Editing）上进行了广泛实验，证明了MindAU的有效性，并表明其有望作为未来面向面部神经肌肉障碍患者的辅助表达技术的一步。

Insight: 创新点包括：1）提出双流流形对齐方法以弥合EEG与视觉/文本模态的鸿沟；2）引入EEG感知的多模态旋转位置编码、地标引导的参考掩码和AU感知的区域监督到基于多模态扩散的编辑器中；3）构建了包含配对EEG-面部编辑样本和标准化评估协议的E-CAFE基准数据集。

Abstract: Recent brain decoding studies have made substantial progress in reconstructing externally perceived visual content from neural signals. However, using electroencephalography (EEG) recordings to guide facial expression editing remains largely unexplored and poses a distinct challenge: rather than recovering what a subject sees, it requires identifying facial-action related patterns from noisy EEG signals and grounding them in localized, identity-preserving expression edits. In this paper, we investigate EEG-conditioned facial image editing for fine-grained facial action unit (AU) control and propose MindAU, a unified framework for controlling facial AU edits from EEG signals. MindAU first learns noise-robust and AU-discriminative EEG representations through temporal masked reconstruction and AU classification supervision. It then bridges the modality gap via Dual-Stream Manifold Alignment, aligning EEG features with AU-level text semantics and identity-reduced visual displacement trajectories in the multimodal space of Qwen2.5-VL. Finally, MindAU incorporates EEG-aware Multimodal Rotary Positional Embeddings, landmark-guided reference masking, and AU-aware region supervision into a multimodal diffusion-based editor for high-fidelity identity-preserving editing. We also introduce E-CAFE, a curated benchmark for EEG-Conditioned Action-Unit Facial Editing with paired EEG-face editing samples and standardized evaluation protocols. Extensive experiments demonstrate the effectiveness of MindAU and suggest its potential as a step towards future assistive expression technologies for individuals with facial neuromuscular disorders.

[48] DroneIQA-VLE: Multi-Task Drone Image Quality Assessment via Vision-Language Ensemble cs.CVPDF

Wei Sun, Weixia Zhang, Hongjian Zhan, Mingkai Lu, Yixuan Gao

TL;DR: 本文提出了DroneIQA-VLE框架，用于解决低空无人机图像的目标感知图像质量评估问题。该框架通过集成两个互补的流程来联合预测全局、目标和背景质量分数：一个基于SigLIP2视觉编码器的多任务回归头，另一个是基于LoRA适配的Qwen3.5-9B多模态大语言模型的回归器。最终全局质量预测通过算术平均两个流程的输出获得。

Details

Motivation: 解决ICME 2026 Drone-IQA Grand Challenge中提出的低空无人机图像的目标感知图像质量评估问题，旨在同时评估图像的整体质量、特定目标区域质量以及背景质量。

Result: 该方法在ICME 2026 Drone-IQA Grand Challenge中获得了第二名，证明了其有效性。

Insight: 创新点在于将基于视觉编码器的传统多任务回归与经过LoRA适配的多模态大语言模型进行集成，形成互补的视觉-语言集成框架，以联合预测多个维度的图像质量分数。这种集成策略可以融合不同模态和架构的优势，提升评估的鲁棒性和准确性。

Abstract: We present DroneIQA-VLE, our solution to the ICME 2026 Drone-IQA Grand Challenge on Target-aware Image Quality Assessment for Low-altitude UAV Images. The framework jointly predicts global, target, and background quality scores by ensembling two complementary pipelines: (1) SigLIP2 vision encoders with multi-task regression heads, and (2) a LoRA-adapted Qwen3.5-9B multimodal large language model for quality score regression. The final global quality prediction is obtained by arithmetically averaging the outputs of both pipelines. Our method achieves 2nd place in the challenge, demonstrating its effectiveness. The code is available at https://github.com/sunwei925/DroneIQA-VLE.

[49] EO-VGGT: Orbital Ray-Conditioned 3D Foundation Models for Satellite Multi-View Reconstruction cs.CV | cs.AIPDF

Qiyan Luo, Yingdong Pi, Lekang Wen, Jie Yang, Xiaoyu Wang

TL;DR: 本文提出了EO-VGGT框架，旨在将冻结的透视驱动3D基础模型适配于卫星轨道观测。该框架通过几何关联约束选择策略优化输入序列，利用传感器射线编码器将推扫式几何参数化为高维令牌，并通过轻量级射线指向感知适配器将其集成到冻结的Transformer主干中，以解决卫星多视角重建中透视假设与轨道几何的结构差异问题。

Details

Motivation: 解决卫星遥感中，前馈式3D基础模型因隐含透视假设与显式轨道推扫几何之间的结构差异，以及显著的视角集异质性而部署受限的问题。

Result: 实验结果表明，整合显式物理几何与优化视角选择对于实现鲁棒的前馈卫星3D重建至关重要，但摘要未提及具体的定量基准测试结果或SOTA比较。

Insight: 创新点在于通过几何关联约束选择、传感器射线编码器将轨道几何参数化，以及轻量级适配器集成，弥合了透视投影与轨道运动学之间的数学差异，为卫星多视角重建提供了可借鉴的几何感知适配方法。

Abstract: In the era of satellite constellations, multi-view optical satellite imagery is pivotal for Earth Observation (EO) and high-quality Digital Surface Model (DSM) reconstruction. Although feed-forward 3D foundation models have transformed computer vision, their deployment in satellite remote sensing is inherently constrained by the structural discrepancy between implicit perspective assumptions and explicit orbital pushbroom geometry. This geometric incongruity is further compounded by pronounced view-set heterogeneity. We present EO-VGGT, a framework that adapts a frozen perspective-driven model to orbital observations via explicit physical geometry embedding.First, the Geometry-Correlation Constrained Selection (GCCS) strategy prunes sub-optimal observations by balancing geometric diversity and radiometric consistency to optimize the input sequence. Second, a Sensor-Ray Encoder (SRE) parameterizes pixel-level pushbroom lines of sight derived from the Rational Function Model (RFM) into high-dimensional space-geometric tokens, reconciling the mathematical discrepancy between central projection and orbital kinematics. Third, a lightweight Ray-Pointing-Aware Adapter (RPAA) employs gated residual blocks to integrate these tokens directly into the frozen transformer backbone. Our findings underscore that integrating explicit physical geometry with optimized view selection is essential for robust feed-forward satellite 3D reconstruction.

[50] Information-Regularized Attention for Visual-Centric Reasoning cs.CV | cs.LGPDF

Guohao Sun, Xiaofang Wang, Yash Patel, Mengchen Liu, Zhiqiang Tao

TL;DR: 本文提出了一种名为信息正则化注意力（IRA）的随机注意力机制，旨在解决视觉语言模型（VLMs）中存在的物体幻觉、视觉基础薄弱以及全参数指令调优后的灾难性遗忘等问题。该方法通过在中间Transformer层的隐藏状态中显式调控注入的视觉信息量，将视觉表示的不确定性转化为独立于数据点的局部噪声，从而稳定视觉表示学习。

Details

Motivation: 论文的动机源于标准的下一个词预测目标缺乏对视觉表示学习的显式控制，导致视觉嵌入被动优化并容易注入冗余或虚假信号，从而引发物体幻觉、弱视觉基础和灾难性遗忘等问题。

Result: 实验结果表明，IRA不仅提升了模型性能，还量化了嵌入特性，产生了更平滑的曲率轨迹并抑制了所有层的注意力汇聚，表明视觉信号的转换更加稳定。

Insight: 论文的创新点在于将随机注意力机制作为一种显式的信息调控工具，而不仅仅是正则化手段，为生成式架构中的表示学习提供了新方向，有助于构建更可靠的视觉语言模型。

Abstract: Vision-language models (VLMs) have become a paradigm for multimodal learning, yet remain unstable due to object hallucination, weak visual grounding, and catastrophic forgetting after full-parameter instruction tuning. We claim these failures result from a lack of explicit control over visual representation learning during the standard next-token prediction objective. As a result, visual embeddings thus become passively optimized and prone to injecting redundant or spurious signals. To counter this, we introduce Information-Regularized Attention (IRA), a stochastic attention mechanism that explicitly regulates the amount of visual information injected into the hidden states of intermediate transformer layers. This local reparameterization translates uncertainty about visual representations into local noise that is independent across data points. Beyond evaluating model performance, we also quantify embedding properties, where IRA produces smoother curvature trajectories and suppresses attention-sink across all layers, indicating a more stable transformation of the visual signal. Our results suggest that stochastic attention is not merely a regularizer but a key contributor to representation learning in a generative architecture, offering a new direction for building more reliable VLMs.

Seohyun Lee, Seoung Choi, Dohwan Ko, Jongha Kim, Hyunwoo J. Kim

TL;DR: 本文提出了VideoSearch-R1，一个用于迭代视频检索和推理的智能体框架。该框架通过软查询优化（SQR）在连续潜在空间中优化搜索查询，并与视频搜索引擎进行多轮交互，以解决现有方法将检索作为预处理步骤、缺乏失败后优化机制的问题。

Details

Motivation: 现有视频检索方法通常将检索作为预处理步骤，一旦初始检索失败，后续细粒度的视频内推理任务（如时序定位）也会失败。同时，现有智能体框架通常假设相关视频已给定，只关注视频内推理。本文旨在解决大规模视频库中检索失败后无法优化，以及检索与细粒度推理任务脱节的问题。

Result: VideoSearch-R1在视频语料库时刻检索（VCMR）任务的三个数据集上实现了最先进的性能。分析表明，软查询优化（SQR）能有效优化原始查询，且比显式的文本级查询优化生成的令牌数量显著减少。

Insight: 核心创新点是提出了软查询优化（SQR），在连续潜在空间而非离散文本空间中优化查询，实现了更高效、细粒度的调整。另一个创新点是采用任务级奖励信号指导的组相对策略优化（GRPO）来联合训练SQR和推理过程，将检索与下游推理任务更紧密地结合在一个迭代框架中。

Abstract: As video corpora continue to expand in both scale and task complexity, there is increasing demand for approaches that retrieve relevant videos from large-scale corpora (inter-video reasoning) and subsequently perform fine-grained, query-conditioned tasks (intra-video reasoning) within the retrieved content, such as temporal grounding. However, existing approaches typically treat retrieval as a preprocessing step, and consequently, when the initial retrieval fails, there is no mechanism to refine the search, leading to the failure of subsequent fine-grained intra-video reasoning. Moreover, while recent agentic frameworks have advanced video understanding, they typically assume that the query-relevant video is already given, focusing exclusively on intra-video reasoning tasks. To address these limitations, we propose VideoSearch-R1, an agentic framework for iterative video retrieval and reasoning through multi-turn interaction with a video search engine. Specifically, we introduce Soft Query Refinement (SQR) to refine search query tokens in a continuous latent space rather than rewriting queries in the discrete text space, enabling more efficient and fine-grained adjustments. SQR and its reasoning process are trained using Group Relative Policy Optimization (GRPO), guided by task-level reward signals derived from retrieval and downstream tasks. Building upon this, VideoSearch-R1 achieves state-of-the-art performance across three datasets on Video Corpus Moment Retrieval (VCMR), iteratively retrieving videos from large-scale corpora, refining search queries, and performing precise query-conditioned temporal grounding within the retrieved content. Our analyses show that SQR effectively refines the original query, requiring significantly fewer generated tokens than explicit text-level query refinement. Code and model checkpoints are publicly available at mlvlab.github.io/VideoSearch-R1.

[52] StochasT: Learning with Stochastic Turn Depth for Visual Instruction Tuning cs.CV | cs.CL | cs.LGPDF

Yuan Qing, Chengzhi Mao, Boqing Gong

TL;DR: 本文提出了一种名为StochasT的训练方法，用于解决大型视觉语言模型（LVLM）在视觉指令微调（VIT）中存在的训练与评估不匹配问题。该方法通过随机地将同一图像相关的多个语言任务聚合成不同“轮次深度”的序列进行训练，以缓解多轮训练中的视觉注意力衰减和上下文过拟合问题，从而提升模型在单轮和多轮场景下的综合性能。

Details

Motivation: 现有视觉指令微调（VIT）通常在对话式的多轮任务上进行训练，而主流基准测试却在孤立的单轮场景下评估模型，这种训练与评估的不匹配导致模型在多轮训练中容易出现视觉注意力衰减和上下文过拟合，无法在测试阶段发挥全部潜力。

Result: 广泛的实验表明，StochasT方法能有效赋予LVLMs在单轮和多轮用例中强大且协调的能力。论文还引入了基于平衡拉丁方的、与基准无关的评估机制来衡量模型在不同上下文依赖下的鲁棒性。

Insight: 核心创新点在于提出了“随机轮次深度”的训练策略，它借鉴了Dropout和ResNet中随机深度的思想，但并非丢弃数据，而是通过随机重组任务序列来最大化训练数据效用，从而弥合训练与评估的鸿沟。此外，提出的基于平衡拉丁方的评估机制也是一个新颖的、用于衡量模型鲁棒性的工具。

Abstract: Large Vision-Language Models (LVLMs) rely extensively on Visual Instruction Tuning (VIT) to elicit their multimodal reasoning capabilities. However, we find a discrepancy: VIT often packs multiple language tasks about the same image for conversational, multi-turn training, whereas existing benchmarks evaluate LVLMs in isolated, single-turn scenarios. The models can suffer from visual attention decay and contextual overfitting during multi-turn training, making it hard for them to realize their full potential in the mismatched test phase. To close the gap, we propose learning with Stochastic Turn Depth (StochasT), which stochastically groups language tasks for the same image into clusters of varying sizes (turn depth) while preserving their organic order. Hence, while StochasT draws on Dropout and stochastic depth for ResNets, it does not actually drop anything to maximize the utility of the training data. Furthermore, we introduce a challenging, benchmark-agnostic evaluation mechanism based on the Balanced Latin Square to measure LVLMs’ robustness under varying contextual dependencies. Extensive experiments demonstrate that StochasT effectively grants LVLMs strong, harmonized capabilities for both single-turn and multi-turn use cases.

[53] MindEdit-Bench: Benchmarking Object-Level Counterfactual Spatial Reasoning in VLMs from In-the-Wild Photos cs.CV | cs.AI | cs.CLPDF

Leyuan Yu, Xiao Tang, Minghao Liu, Xinyuan Li, Xiaokai Bai

TL;DR: 本文介绍了MindEdit-Bench，一个用于评估视觉语言模型在物体级反事实空间推理能力的新基准。该基准基于真实室内场景的三张照片构建，包含六项空间推理任务，其中两项新任务专门测试模型在输入图像中不存在正确答案的情况下，对物体进行假设性移动或旋转的推理能力。

Details

Motivation: 现有VLM基准主要测试观察性空间推理，而缺乏对反事实空间编辑（如假设移动物体）的评估。本文旨在填补这一空白，探究VLM能否预测物体被假设性移动或旋转后的后果。

Result: 在15个VLM模型上测试了1,003个人工验证的问题，VLM的平均准确率仅为8%-31%，而人类多数投票准确率高达81%-97%，人机差距达53个百分点。基准覆盖了120个非公开数据集的室内场景，减少了预训练数据重叠风险。

Insight: 创新点在于引入了两项新的反事实空间编辑任务（L4和L5），并构建了来自真实世界照片的自动3D场景图提取流程。结构化答案选项（8-24个）支持答案字母级别的错误诊断，揭示了VLM在相机深度轴推理和困难可见性编辑任务上的非均匀失败模式。

Abstract: Benchmarks for vision-language models (VLMs) mostly test observational spatial reasoning: models describe relations already visible in the input. Existing what-if tasks typically vary the observer while keeping the scene fixed. Can VLMs instead predict the consequences of hypothetically moving or rotating an object? We introduce MindEdit-Bench, a benchmark of six spatial reasoning tasks built from three-photo smartphone triplets of newly captured indoor scenes via an automatic in-the-wild 3D scene-graph extraction pipeline. Four tasks probe perception and perspective transformation over observed structure; two new tasks, L4 (spatial editing) and L5 (cross-view visibility editing), probe object-level counterfactual reasoning, where correct answers are absent from all input images. Each question provides 8-24 structured answer choices, enabling answer-letter-level diagnosis of spatial and fallback errors. The benchmark covers 120 private indoor scenes not drawn from public datasets, reducing public-data pretraining-overlap risk. Across 15 VLMs on 1,003 human-verified questions, task-wise mean VLM accuracy is only 8%-31%, versus 81%-97% human majority-vote accuracy. The pooled human–best-VLM gap is 53 pp, with at least 39 pp on every task. The structured answer space further reveals non-uniform failures, including weaker camera-depth-axis inference and fallback behavior on difficult visibility-editing cases.

[54] Robust 3D Alignment of Generative Reconstructions via Partial Monocular Observations cs.CVPDF

Yuchen Zhang, Luanyuan Dai, Yiwei Wang, Xiwei Xu, Jianing Zhang

TL;DR: 本文提出了一种无需训练、可解释的几何对齐框架，用于解决生成式3D重建与单目部分观测之间的对齐难题。该方法通过引入显式尺度因子和从粗到精的对齐策略，结合几何感知描述符和闭式求解器，有效处理尺度模糊和几何幻觉问题，并在专门设计的基准测试中显著优于现有方法。

Details

Motivation: 生成式3D重建与噪声稀疏的单目观测之间存在严重不对称性，传统配准方法因尺度模糊、几何幻觉和初始重叠缺失而失效，亟需一种鲁棒的对齐方案。

Result: 在专门设计的GenPMOAlign–Where2Place基准测试中，该方法实现了稳定准确的对齐，大幅超越了经典几何流程和最先进的基于学习的基线方法。

Insight: 创新点包括引入3D相似变换（Sim(3)）显式解决度量尺度模糊，采用从粗到精对齐策略与幻觉过滤操作，以及构建针对性基准以评估极端条件下的对齐性能。

Abstract: Aligning generative 3D reconstructions with partial monocular observations is a critical but under-explored challenge in computer vision. This task is inherently ill-posed due to severe asymmetries between noisy, sparse monocular inputs and dense generative priors, whose scale ambiguity and geometric hallucinations, combined with the lack of initial overlap, render traditional registration pipelines ineffective. To resolve these issues, we propose a training-free and interpretable geometric alignment framework that grounds generative 3D priors via a 3D similarity transformation (Sim(3)), which can recover accurate metric scale and pose. Specifically, we introduce an explicit scale factor to resolve metric ambiguity and employ a coarse-to-fine alignment strategy, leveraging geometry-aware descriptors for robust initialization and a decoupled closed-form solver for precision refinement. In addition, we introduce a Hallucination Filtering operation to effectively suppress outliers caused by hallucinated geometry. To evaluate alignment performance under these extreme conditions, we introduce GenPMOAlign–Where2Place, a rigorous benchmark specifically designed for Generative-to-Partial Monocular Observational Alignment. Experiments demonstrate that our method achieves stable and accurate registration, substantially outperforming both classical geometric pipelines and state-of-the-art learning-based baselines. Code and the benchmark will be publicly released.

[55] Multimodal Continuous Reasoning via Asymmetric Mutual Variational Learning cs.CVPDF

Shijie Li, Yilin Gao, Siyuan Yang, Tieyuan Chen, Chaofan Gan

TL;DR: 本文提出了一种名为非对称互变分学习（AMVL）的框架，旨在解决多模态大语言模型（MLLMs）中连续潜在推理存在的训练-推理不匹配问题。该方法通过前向和反向KL散度的双向校准目标，防止后验分布因依赖真实答案信息而泄露，从而提升推理性能。在复杂的BLINK基准测试中，该方法显著优于现有的离散和潜在推理基线模型。

Details

Motivation: 多模态大语言模型通常受限于语言空间的瓶颈，将复杂的视觉推理压缩为离散标记会丢失感知细节。而采用连续潜在推理时，训练阶段的后验分布可能利用真实答案信息走捷径，导致训练与推理条件不匹配，即存在’答案泄露’问题，从而损害模型性能。

Result: 在BLINK基准测试上，AMVL框架平均得分提升了+10.83，在个别推理任务上增益高达+32.00，一致优于强大的离散和潜在推理基线模型，分析也证实了潜在空间的稳定性得到改善。

Insight: 创新点在于提出了双向KL散度校准目标（前向KL与新颖的反向KL），理论上将泄露形式化为先验污染，并通过双目标减少它；从客观角度看，这种非对称正则化机制有效缓解了答案泄露，为连续潜在推理提供了更稳定的训练框架。

Abstract: Multimodal Large Language Models (MLLMs) are often constrained by a language-space bottleneck, forcing complex visual reasoning into discrete tokens which can lose perceptual nuance. A promising alternative is continuous latent reasoning, where the goal is to discover implicit reasoning pathways that bridge the multimodal query and the final answer. However, this introduces a severe train-inference mismatch: a training-time posterior, conditioned on the ground-truth answer, can exploit answer-dependent shortcuts. Standard variational training then forces the inference-time prior to mimic a posterior that has access to information unavailable at test time, leading to poor performance. To address this, we propose Asymmetric Mutual Variational Learning (AMVL), a framework that resolves this mismatch via a bidirectional calibration objective. A forward KL divergence trains the target-agnostic prior to match the posterior, while a novel reverse KL divergence simultaneously regularizes the posterior, preventing it from collapsing into inference-incompatible regions and mitigating this ``answer leakage’’. We provide theoretical analysis formalizing this leakage as prior contamination and prove that our dual-KL objective reduces it. We instantiate AMVL in a latent-integrated MLLM and show that it consistently outperforms strong discrete and latent-reasoning baselines, improving the average score on the complex BLINK benchmark by +10.83 and achieving gains of up to +32.00 on individual reasoning tasks, with analyses confirming improved latent-space stability.

Trung Thanh Nguyen, Hai Nguyen-Truong, Tu Vo, Hoang M. Truong, Tuan-Anh Vu

TL;DR: 本文提出Cross4D-JEPA，一种用于4D点云表示学习的师生蒸馏方法。该方法通过密集的跨模态对应关系，将冻结的2D基础模型（如图像模型DINOv2或视频模型V-JEPA 2）的知识蒸馏到4D点编码器中，旨在解决现有自监督预训练方法多为单模态或仅利用全局嵌入而忽略丰富局部语义的问题。

Details

Motivation: 动态4D点云的密集标注成本高昂，自监督预训练是学习可迁移表示的自然途径。然而，现有的预训练任务几乎全是单模态的，少数从2D基础模型迁移知识的方法也仅使用每个片段的单一全局嵌入，丢弃了这些模型计算出的丰富逐块语义信息。

Result: 在MSR-Action3D、DeformingThings4D、NTU-RGB+D 60和HOI4D四个基准测试上，该方法在匹配协议下一致优于单模态和全局跨模态基线，并与更重的已发布4D方法竞争。此外，一个体积小13倍的编码器即可匹配重型池化骨干网络的性能。

Insight: 核心创新在于结合了密集的跨模态对应（将每个3D点映射到其投影的教师块特征）和逐点目标（在潜在空间匹配这些特征，无需掩码、负样本或解码器）。这种细粒度对应关系的设计，而非教师模态本身，是性能提升的关键，且学到的密集表示具有跨域迁移、提升标签效率和全标签微调性能的优势。

Abstract: Automatic understanding of dynamic 4D point clouds, the 3D-point sequences captured over time by depth sensors and LiDAR, is central to robotics and embodied perception. Yet annotating them densely is expensive, making self-supervised pretraining the natural route to transferable representations. Existing pretext tasks, however, are almost entirely intra-modal, and the few methods that transfer knowledge from 2D foundation models rely on a single global embedding per clip, discarding the rich per-patch semantics that these models compute. To address this gap, we propose Cross4D-JEPA, a teacher-student method that distills a frozen 2D foundation model, an image model DINOv2, or a video model V-JEPA 2, into a 4D point encoder. The proposed method combines (1) a dense cross-modal correspondence that maps every 3D point to the teacher patch feature it projects to, and (2) a per-point objective that trains the student to match these features in latent space with no masking, negatives, or decoder. We evaluate Cross4D-JEPA on four benchmarks, MSR-Action3D, DeformingThings4D, NTU-RGB+D 60, and HOI4D, against intra-modal and global cross-modal baselines. Experimental results show that, under a matched protocol, the proposed method consistently outperforms intra-modal and global cross-modal baselines across the four benchmarks and is competitive with heavier published 4D methods; further analysis attributes this gain primarily to the granularity of the correspondence rather than the teacher modality. Beyond recognition accuracy, the dense representation learned by Cross4D-JEPA transfers across domains, improves label efficiency, and improves full-label fine-tuning under the same training budget, while a 13x smaller encoder matches a heavyweight pooling backbone.

[57] GEAR-Seg: A Grounded Explainable Agent for Reasoning Segmentation and Data Engine cs.CVPDF

Yanan Wang, Wen Li, Yibin Ying, Zhenghao Fei

TL;DR: 本文提出了GEAR-Seg，一个用于推理分割的显式解耦智能体。它将视觉像素转换为密集的、富含属性的文本，将感知、描述和LLM推理解耦，形成一个可追踪的逻辑链。该框架实现了零样本推理，并在多个基准测试中取得了有竞争力的性能，同时还能作为一个可扩展的数据引擎，用于生成大规模标注数据集。

Details

Motivation: 当前端到端的推理分割模型通常将感知和推理耦合在一个不透明的黑盒中，这严重限制了模型的可解释性和可扩展性。为了解决这个问题，本文旨在设计一个显式解耦的智能体，将隐式推理转化为显式的、可追踪的逻辑链。

Result: 作为一个零样本推理框架，GEAR-Seg在多种推理和细粒度参考分割基准测试中取得了极具竞争力的性能。此外，利用其作为数据引擎构建的GEAR-131K大规模基准测试，以及蒸馏实验表明，仅由该自动化流程监督的轻量级模型性能与昂贵的人工标注基线模型相当。

Insight: 核心创新在于将推理分割任务显式解耦为类别无关分割、语义描述和LLM推理三个模块，通过将像素转换为属性文本来桥接视觉与语言，从而提升可解释性。该方法同时展示了其作为可扩展数据引擎的潜力，能够自动化生成高质量的标注数据用于模型训练。

Abstract: Reasoning segmentation requires localizing targets based on complex, implicit queries. Current end-to-end models typically entangle perception and deduction into an opaque black box, severely limiting interpretability and scalability. To address this, we propose GEAR-Seg (Grounded Explainable Agent for Reasoning Segmentation), an explicitly decoupled agent that shifts the paradigm by translating visual pixels into dense, attribute-rich text. By decoupling class-agnostic segmentation, semantic description, and Large Language Model (LLM) deduction, GEAR-Seg transforms implicit reasoning into an explicit, trackable logic chain. As a zero-shot inference framework, it achieves highly competitive performance across diverse reasoning and fine-grained referring segmentation benchmarks. Furthermore, GEAR-Seg inherently functions as a highly scalable data engine. Utilizing this engine, we construct GEAR-131K, a massive benchmark (over 38k images, 656k QA-mask pairs) introducing a multifaceted taxonomy tailored for complex real-world manipulation-oriented reasoning. Finally, distillation experiments demonstrate that lightweight models supervised exclusively by our automated pipeline closely match the upper-bound performance of costly human-annotated baselines.

[58] ECoSim: Data Efficient Fine-Tuning for Controllable Traffic Simulation cs.CVPDF

Yu-Hsiang Chen, Wei-Jer Chang, Yi-Ting Chen, Masayoshi Tomizuka

TL;DR: 本文提出ECoSim，一种轻量级控制适配框架，用于提升预训练交通生成模型的可控性。该方法通过身份初始化的FiLM层调制中间特征，能够以极少量的配对控制数据（<1%）为扩散模型和自回归模型添加多模态控制能力（包括草图、潜在行为编码和文本）。

Details

Motivation: 现有可控交通仿真方法通常需要大量标注数据来重新训练大型生成模型，这既低效又昂贵。本文旨在解决这一问题，通过轻量级适配使预训练模型获得多模态可控性。

Result: 在Waymo Open Sim Agents Challenge基准上进行评估，该方法在仅使用不到1%配对控制数据的情况下，展现出强大的可控性，并能保持稳定的闭环驾驶真实感和安全性。

Insight: 核心创新在于提出了一种通用的轻量级控制适配框架，通过身份初始化的FiLM层调制特征，实现了在不破坏预训练模型生成先验的前提下，高效集成新的控制模态。该方法还支持通过上下文感知的条件迁移进行反事实场景生成长尾合成。

Abstract: Controllable traffic simulation is critical for testing autonomous driving systems, yet existing approaches often require retraining large generative models with extensive annotated data. We introduce a lightweight control adaptation framework that enables multi-modal controllability (sketch, latent behavior codes, and text) for pretrained state-of-the-art diffusion and autoregressive traffic models. By modulating intermediate features through identity-initialized FiLM layers, our method efficiently adds new control modalities while preserving the base model’s generative prior. Evaluated on Waymo Open Sim Agents Challenge, our approach demonstrates strong controllability with less than 1% of the paired control data. Through context-aware condition transfer, our framework enables counterfactual scenario generation and long-tail synthesis while maintaining stable closed-loop driving realism and safety. Our framework unlocks new possibilities for controllable traffic simulation, enabling targeted scenario generation through lightweight adaptation of pretrained generative models. Project page: https://ecosim-web.github.io/

[59] BrainFIBRE: A Foundation Model via Information Decomposition for Brain Microstructure cs.CVPDF

Zijian Dong, Yi Lin, Ji Fang, Jianxiong Zhou, Kwun Kei Ng

TL;DR: BrainFIBRE是首个用于脑微结构的基础模型，通过自监督部分信息分解（SPID）方法，从NODDI衍生的三维生物物理图谱中学习可迁移的微结构表征。该模型在55,592名UK Biobank参与者的数据上进行预训练，无需下游标签即可解耦各模态间的独特、协同和冗余信息，并在预测年龄、性别、脑血管/神经退行性标志物及认知等任务上取得了最先进的性能。

Details

Motivation: NODDI衍生的神经突密度、方向分散和自由水分数图谱为脑微结构提供了丰富的可解释表征，但现有表征学习方法难以有效解耦各图谱间独特、共享和协同的交互信息，整合这些多模态信息具有挑战性。

Result: 在白种人和亚洲人队列上，BrainFIBRE在预测年龄、性别、脑血管/神经退行性标志物及认知等多种任务上均达到了最先进的（SOTA）性能，同时其表征具有神经生物学可解释性，能揭示任务和队列特定的交互模式。

Insight: 创新点包括首次将PID引导的多模态学习扩展到自监督领域（SPID），并提出了一种新颖的反事实候选构建（CCC）范式，通过模态丢弃和交换来扰动模态对齐，为专家混合架构提供对比信号，从而无监督地解耦信息成分。这为神经影像分析提供了一个通用的微结构基础模型框架。

Abstract: Diffusion MRI probes brain microstructure with particular sensitivity to early cerebrovascular and neurodegenerative changes. Neurite Orientation Dispersion and Density Imaging (NODDI) decomposes the diffusion signal into three biophysically interpretable maps: neurite density index (NDI), orientation dispersion index (ODI), and free water fraction (FWF), capturing neurite packing, fiber coherence, and extracellular fluid. These 3D maps offer a rich substrate for transferable microstructural representations, yet integrating them is challenging: standard representation learning struggles to disentangle the unique information in each map from their shared and synergistic interactions. We present BrainFIBRE, the first foundation model for brain microstructure, pretrained on NODDI-derived maps from 55,592 UK Biobank participants. We propose Self-supervised Partial Information Decomposition (SPID), which extends PID-guided multimodal learning to the self-supervised regime for the first time. A novel Counterfactual Candidate Construction (CCC) paradigm perturbs inter-modality alignment through modality dropping and swapping, providing the contrastive signal for a Mixture-of-Experts architecture to disentangle unique, synergistic, and redundant information without any downstream label. On both Caucasian and Asian cohorts, BrainFIBRE achieves state-of-the-art performance across diverse tasks predicting age, sex, cerebrovascular and neurodegenerative markers, and cognition, while yielding neurobiologically interpretable representations that reveal task- and cohort-specific interaction patterns. BrainFIBRE establishes a versatile foundation for neuroimaging analysis at the microstructural level.

[60] EgoGapBench: Benchmarking Egocentric Action Selection in Multi-Agent Scenes cs.CV | cs.AIPDF

Jihyeok Jung, Jeewu Lee, Sanghyeop Kim, Chanhee Han, Seong Joon Oh

TL;DR: 本文提出了EgoGapBench，一个用于评测多智能体场景中自我中心（egocentric）动作选择能力的诊断性基准。该基准旨在隔离并评估纯粹的自我中心视角理解能力，而非第一人称视觉输入理解。研究发现，人类在该基准上表现可靠，而现有MLLMs（多模态大语言模型）表现显著较差，且存在系统性错误（倾向于选择其他可见智能体的动作）。

Details

Motivation: 现有自我中心基准主要基于第一人称视角数据构建，难以将纯粹的自我中心视角理解能力与第一人称视觉输入理解能力分离开来进行评估。特别是在缺乏第一人称身体线索或存在其他智能体的场景中，这两种能力是可分离的。

Result: 在EgoGapBench上，人类表现可靠。开源和专有的MLLMs表现显著更差（远低于人类水平），并系统性地选择其他可见智能体的动作。在现有自我中心数据上进行微调无法缩小差距甚至有害，而在EgoGapBench训练数据上微调能提升准确率，但仍未达到人类水平。

Insight: 创新点在于提出了一个专门用于诊断和评估“自我中心动作选择”（EAS）能力的基准，揭示了该能力难以仅从第一人称视角数据中习得。核心洞见是，MLLMs不仅需要评估和训练场景理解能力，还需要专门针对自我中心动作选择能力进行评估和训练。

Abstract: Existing egocentric benchmarks have primarily constructed the egocentric setting from first-person-view data, which makes it difficult to evaluate egocentric perspective itself in isolation. However, understanding first-person-view input and taking an egocentric perspective are separable abilities, especially when first-person body cues are absent or when other agents are present. To isolate egocentric perspective understanding, we introduce EgoGapBench, a diagnostic benchmark for measuring action selection in multi-agent egocentric scenes. We define the ability measured by this benchmark as Egocentric Action Selection (EAS): selecting an appropriate action from the agent’s perspective in the presence of other agents. On EgoGapBench, humans answer reliably, whereas both open-source and proprietary MLLMs perform substantially worse and systematically select actions performed by other visible agents. Fine-tuning on existing egocentric data fails to close this gap and can even be detrimental. In contrast, fine-tuning on EgoGapBench training data improves accuracy but does not reach human performance. These results show that EAS is difficult to acquire from first-person-view data alone, and that MLLMs should be evaluated and trained not only for scene understanding but also for egocentric action selection.

[61] Active Spatial Guidance: Eliminating Injected Positional Mechanisms in Vision Transformers cs.CVPDF

Cong Liu, Xiaofang Li, Simon X. Yang

TL;DR: 本文提出了一种名为Active Spatial Guidance（Guidance）的训练方法，旨在消除视觉Transformer（ViT）中对位置注入机制的依赖。该方法通过在训练时对最终层patch token施加辅助的2D坐标回归损失，引导模型从数据中学习空间结构，而无需显式的位置编码。实验表明，该方法在多个视觉任务上优于传统的位置注入方法，并提高了模型的分辨率鲁棒性。

Details

Motivation: 针对视觉Transformer中自注意力机制的置换不变性问题，传统方法依赖显式的位置注入（如绝对位置嵌入或旋转位置嵌入）。本文的动机是探索是否可以通过数据驱动的训练方式，而非架构注入，来诱导模型学习空间组织。

Result: 在ImageNet-100分类、ADE20K语义分割和Hypersim单目深度估计任务上，使用DINOv3 ViT骨干网络，Guidance方法在相同训练协议下均超越了学习到的绝对位置嵌入和旋转位置嵌入等强基线。在ImageNet-100上的广泛比较进一步验证了其有效性，且该方法还提升了分辨率迁移的鲁棒性。

Insight: 论文的创新点在于提出了一种纯训练时的监督方法（Guidance），通过辅助坐标回归损失引导ViT学习空间信息，从而无需在模型架构中显式注入位置机制。这揭示了空间归纳偏置可以通过训练监督来塑造，而非必须依赖结构设计，为简化ViT架构提供了新思路。

Abstract: Vision Transformers (ViTs) commonly rely on injected positional mechanisms to address self-attention’s permutation invariance. Motivated by the spatial regularities of natural images, we ask whether spatial organization can be induced from data rather than explicitly injected. Under controlled, matched from-scratch training, we propose Active Spatial Guidance (Guidance), a training-only objective that disables positional injection and applies an auxiliary 2D coordinate-regression loss to the final-layer patch tokens. The guidance head is used only during training and removed for inference; the deployed model consists of a positional-injection-free ViT encoder and the task-specific prediction module. Using DINOv3 ViT backbones, Guidance consistently improves performance on ImageNet-100 classification, ADE20K semantic segmentation, and Hypersim monocular depth estimation, outperforming strong injected baselines such as learned absolute positional embeddings and rotary positional embeddings under identical training protocols. On ImageNet-100, broader comparisons against representative injected positional designs further support Guidance’s effectiveness. Guidance also improves robustness under resolution transfer, and multi-resolution training further strengthens accuracy across input sizes. Overall, our results suggest that spatial inductive bias in ViTs need not be architecturally injected, but can be shaped through training-time supervision. The code used for training and evaluation is publicly available in https://github.com/cloudlc/asg.

[62] Retrieved Images as Visual Thought: Training-Free Multimodal In-Context Learning for the Open-vs-Closed Gap cs.CVPDF

Bingchen Huang, Zhiling Wang, Yifu Chen, Yuanchao Du

TL;DR: 本文提出了ReVisIT，一种无需训练的基于检索的多模态上下文学习框架，通过将检索到的图像-标签对作为视觉思维单元，结合结构化类别定义、多模态检索和交替注入机制，在开放词汇视觉任务上实现高效推理。

Details

Motivation: 现有基于图像的思维方法通常依赖生成（如调用外部工具、合成代码或生成图像），存在协议复杂、代码脆弱或训练成本高的问题；本文旨在探索无需生成、仅通过检索标注示例图像进行推理的轻量级替代方案。

Result: 在VL-ICL Bench Fast Open MiniImageNet上，Qwen3-VL-30B-A3B结合ReVisIT在4-shot设置下达到98.5%准确率，与72B参数的LLaVA-OneVision SOTA（98.7%）统计无差异；在Bongard-OpenWorld概念归纳任务中，仅交替注入层就为GPT-4.1提升26.1个百分点；在自建基准MAAC-Bench上，三个骨干模型平均获得4-6个百分点的宏观性能提升。

Insight: 创新点在于将检索图像作为可操作的视觉思维单元，并设计交替注入机制实现动态推理；客观分析表明，检索质量（而非仅示例存在）贡献了83%的性能增益，且结构化定义具有任务自适应性，为开放-封闭词汇差距提供了无需训练的解决方案。

Abstract: Recent work on Thinking with Images makes vision a dynamic part of reasoning, but does so through generation: the model invokes external tools, synthesizes code, or imagines new imagery, each at the cost of a tool protocol, brittle code, or an expensive training pipeline. A fourth route makes vision dynamic without generating anything, by retrieving labeled exemplar images and reasoning over them, yet it remains underexplored despite being train-free. We present ReVisIT, a train-free framework that realizes this retrieval-based route by treating each retrieved image-label pair as a unit of visual thought. ReVisIT combines structured class definitions, per-query multimodal retrieval of exemplars, and alternating user/assistant injection of those exemplars before joint multi-attribute decoding, and degrades gracefully to whichever components a task admits. On VL-ICL Bench Fast Open MiniImageNet, Qwen3-VL-30B-A3B with ReVisIT reaches 98.5% at 4-shot, statistically indistinguishable from the 72B LLaVA-OneVision SOTA (98.7%) on this near-saturated task at about 1/2.4 the parameters, while the same backbone without the scaffold sits at chance. The turns layer alone adds 26.1 points to GPT-4.1 on free-form concept induction (Bongard-OpenWorld), and the full stack yields a 4-6 point macro gain across three backbones on MAAC-Bench, a new license-clean 27-class, 5-attribute benchmark, significant by paired bootstrap on the curator-derived attributes. Component analysis shows that retrieval-plus-turns is the universal lever while structured definitions are need-adaptive, and that 83% of the retrieval gain comes from retrieval quality rather than from the presence of exemplars. MAAC-Bench is released with a rubric-grounded LLM verification protocol that replaces author spot-check on subjective attributes.

[63] Identifying Latent Concepts and Structures for Generalized Category Discovery cs.CV | cs.AIPDF

Boyang Dai, Chaoqi Chen, Yizhou Yu

TL;DR: 本文提出了一种名为CPF-GCD的新表征学习框架，通过强制特征空间具有低秩组合结构来解决广义类别发现（GCD）任务中表征纠缠的问题。该方法的核心是假设所有类别（已知或未知）都可以表达为一组可学习视觉基元的组合和空间排列，并利用空间场机制来实例化这一几何约束。

Details

Motivation: 当前GCD方法主要关注设计聚类目标，但忽视了标准视觉骨干网络产生的高秩、纠缠的token表征不适合无监督发现潜在概念和结构这一关键瓶颈。

Result: 大量实验表明，CPF作为一个通用的即插即用模块，能够持续提升多种GCD基线的性能，验证了识别和利用低秩组合结构是开放世界识别的关键归纳偏置。

Insight: 创新点在于将表征学习的焦点从单纯划分全局嵌入转移到构建一个结构化、可分离的基元场，通过显式建模基元的空间分布，使新类别能够作为共享词汇上的新激活模式自然涌现。

Abstract: Generalized Category Discovery (GCD) aims to recognize known classes while autonomously discovering novel ones in open-world settings. However, current approaches primarily focus on designing clustering objectives, often overlooking a critical bottleneck: standard vision backbones yield high-rank, entangled token representations that are ill-suited for unsupervised discovery of latent concepts and structures. In this paper, we propose Compositional Primitive Fields (CPF-GCD), a novel representation learning framework that reshapes the feature space to make such latent structure identifiable by enforcing a low-rank compositional organization. Our core hypothesis is that all categories, whether known or novel, can be expressed as compositions and spatial arrangements of a finite set of learnable visual primitives that capture reusable concepts. CPF instantiates this geometric constraint via a spatial field mechanism. Inserted between the backbone and the head, it rewrites noisy patch tokens through low-rank primitive mixtures, effectively decomposing images into reusable atomic parts and their spatial layouts. By explicitly modeling the spatial distribution of primitives, CPF enables novel categories to emerge naturally as new activation patterns over a shared vocabulary. This shifts the focus of representation from merely partitioning global embeddings to constructing a structured and separable primitive field. Extensive experiments demonstrate that CPF serves as a generic, plug-and-play module that consistently boosts performance across diverse GCD baselines, validating that identifying and leveraging low-rank compositional structure is a crucial inductive bias for open-world recognition.

[64] Learning to Watch: Active Video Anomaly Understanding via Interleaved Policy Optimization cs.CVPDF

Mengjingcheng Mo, Jiaxu Leng, Xinbo Gao

TL;DR: 本文提出了一种名为Anom-π的主动视频异常理解框架，将视频理解重新定义为动态环境中的主动顺序决策过程。该框架通过交错策略统一内部认知推理和战略证据获取，利用局部回溯、时间扩展和细粒度采样等时间原子操作赋予模型感知主动性。在视频级弱监督下，通过交互式直接偏好优化（iDPO）实现轨迹级策略对齐，并在复杂场景中仅用20亿参数就取得了极具竞争力的性能。

Details

Motivation: 现有被动视频异常理解范式存在观测混淆问题，静态采样难以区分语义不同的事件，因此需要一种主动框架来克服这一局限性。

Result: 在复杂场景的广泛实验中，该框架仅使用20亿参数就取得了极具竞争力的性能，显著优于最先进的大规模视频异常理解模型。

Insight: 创新点在于将视频理解重构为主动顺序决策过程，并设计了交错策略和交互式直接偏好优化方法，使模型能够主动消除假设歧义并抑制冗余探索。

Abstract: Video anomaly understanding (VAU) relies on sparse, context-dependent cues. However, existing passive paradigms suffer from observational aliasing, where static sampling fails to disambiguate semantically distinct events. To overcome this, we propose $Anom\text{-}π$, a closed-loop framework that reconceptualizes video understanding as an active sequential decision-making process within a dynamic environment. Inspired by human video-reviewing behavior, this framework unifies internal cognitive reasoning and strategic evidence acquisition into an interleaved policy, utilizing temporal atomic operators such as local backtracking, temporal expansion, and fine-grained sampling to endow the model with perceptual proactivity. To learn such complex interaction strategies under video-level weak supervision, we design Interactive Direct Preference Optimization (iDPO) to achieve trajectory-level policy alignment, guided by an Active Evidence Inquiry (AEI) utility that balances task success, informative evidence acquisition, and interaction cost. This approach enables the agent to learn to actively disambiguate hypotheses while suppressing redundant exploration. Extensive experiments demonstrate that our framework, with only 2B parameters, achieves highly competitive performance, significantly outperforming state-of-the-art large-scale VAU models in complex scenarios.

[65] Linguistic Relative Policy Optimization for Video Anomaly Reasoning cs.CVPDF

Jiaxu Leng, Jiankang Zheng, Mengjingcheng Mo, Zhanjie Wu, Haosheng Chen

TL;DR: 本文提出了一种名为语言相对策略优化（LRPO）的方法，用于视频异常检测（VAD）任务。该方法通过从多个推理轨迹中提取群体相对语义优势，构建语言表达的异常经验先验，并将其注入上下文以引导模型输出分布，无需参数更新。LRPO构建了通用经验和场景经验两种互补的经验表示，并通过异常对齐奖励进一步优化学习到的经验。

Details

Motivation: 现有基于多模态大语言模型的视频异常检测方法通常依赖大规模标注或专家设计的先验，限制了其在最小化人工干预下获取异常知识的能力。本文旨在解决这一问题，使模型能够以尽可能少的人类干预学习异常知识。

Result: 在XD-Violence、UCF-Crime和UBnormal三个基准数据集上的大量实验表明，LRPO在免调优设置下显著优于现有的最先进方法。

Insight: 创新点在于提出了语言相对策略优化框架，通过蒸馏群体相对语义优势构建可注入的语言化经验先验，并区分通用与场景经验以实现可迁移性和针对性优化。此外，引入异常对齐奖励来引导轨迹优化以匹配人类风险偏好并强化时序推理，这是一种新颖的、无需参数更新的模型适应机制。

Abstract: Video anomaly detection (VAD) with multimodal large language models has shown strong potential, yet most existing methods still depend on large-scale annotations or expert-designed priors, limiting their ability to acquire anomaly knowledge with as little human intervention as possible. To address this, we propose Linguistic Relative Policy Optimization (LRPO), which distills group-relative semantic advantages from multiple reasoning trajectories into a linguistically expressed anomaly experience prior, and adapts the model by injecting this prior into the context to steer its output distribution without any parameter updates. LRPO builds two complementary experience representations: general experience captures transferable anomaly preferences across scenarios, while scenario experience models context-dependent anomaly rules for targeted refinement. To further improve the learned experience, we introduce an anomaly alignment reward that guides trajectory optimization to match human risk preferences and reinforce temporally grounded reasoning. Extensive experiments on XD-Violence, UCF-Crime, and UBnormal demonstrate that LRPO significantly outperforms existing state-of-the-art methods under tuning-free settings.

[66] DART: Difficulty-Adaptive Routing for Zero-Shot Video Temporal Grounding cs.CVPDF

Zhengbo Zhang, Mark He Huang, Zhigang Tu, Ming-Hsuan Yang

TL;DR: 本文提出DART方法，用于零样本视频时序定位任务，该方法通过难度自适应路由和结构化推理来弥合简单事件与复杂多阶段查询之间的推理差距。DART利用查询条件化的行列式点过程选择关键帧并评估查询难度，将简单查询路由到快速路径直接预测，复杂查询则通过慢速路径进行时序标记提示以分解定位过程。在Charades-STA和ActivityNet Captions数据集上，DART在分布内和多个分布外设置中均实现了最先进的零样本性能，mIoU最高提升3.5个百分点，同时使用的帧数减少7倍以上。

Details

Motivation: 现有零样本视频时序定位方法依赖于帧-查询特征匹配，对于简单事件有效，但难以处理需要理解时序顺序和因果结构的复杂多阶段查询，这种差异被称为推理差距。

Result: 在Charades-STA和ActivityNet Captions数据集上，DART在分布内和多个分布外设置中均达到了最先进的零样本性能，mIoU最高提升3.5个百分点，同时使用的帧数减少7倍以上。

Insight: 创新点包括：1) 引入难度自适应路由机制，根据查询复杂度动态选择处理路径；2) 使用查询条件化的行列式点过程同时实现关键帧选择和难度评估；3) 提出时序标记提示方法，将复杂定位任务分解为全局事件分析、帧级时序角色标注和边界提取三个结构化步骤。

Abstract: Zero-shot video temporal grounding (VTG) localizes events in untrimmed videos from natural language queries without task-specific training. Existing methods rely on frame-query feature matching, which suffices for simple events but struggles with complex multi-stage queries that require understanding temporal ordering and causal structure – a disparity we call the reasoning gap. We propose DART (Difficulty-Adaptive Routing for Temporal Grounding), which bridges this gap by coupling difficulty-aware routing with structured reasoning in large vision-language models. A query-conditioned Determinantal Point Process (DPP) serves a dual role: selecting diverse, query-relevant keyframes as temporal evidence, and providing spectral entropy as a difficulty indicator. Simple queries are routed to a Fast path for direct prediction, while complex queries follow a Slow path with Temporal Markup Prompting, which decomposes localization into global event analysis, per-frame temporal role annotation, and boundary extraction. On Charades-STA and ActivityNet Captions, DART achieves state-of-the-art zero-shot performance across both identically distributed and multiple out-of-distribution settings, improving mIoU by up to 3.5 points over the strongest baseline while using over 7 times fewer frames. The project homepage is available at https://dart-vtg.github.io/.

[67] ABot-M0.5: Unified Mobility-and-Manipulation World Action Model cs.CV | cs.ROPDF

Ronghan Chen, Yandan Yang, Zuojin Tang, Dongjie Huo, Tong Lin

TL;DR: 本文提出了ABot-M0.5，一种用于移动操作机器人的统一世界动作模型。该模型通过引入中间潜在动作、设计双层级混合Transformer架构以及提出dream-forcing训练策略，解决了现有方法在时间粒度、动作空间和训练-测试一致性方面的错位问题，从而提升了长时程任务的成功率和精细控制精度。

Details

Motivation: 当前移动操作任务对具身学习方法仍具挑战：视觉语言动作策略通常缺乏显式的世界建模，而现有的世界动作模型在时间粒度、导航-操作动作的纠缠以及训练-推理一致性方面与移动操作的结构不匹配，导致其难以捕捉精细接触动态、存在动作分布冲突并在长时程推演中累积误差。

Result: 在具有挑战性的移动和精细操作基准测试中，ABot-M0.5在长时程任务成功率和精细控制精度方面均达到了最先进的性能。

Insight: 论文的核心创新在于提出了移动操作需要对三个层面进行对齐的洞见，并据此设计了相应的技术方案：1）通过中间潜在动作对齐时间粒度；2）通过双层级混合Transformer架构解耦模态表示和异构动作子空间以对齐动作空间；3）通过dream-forcing训练策略在模型预测的视频上渐进训练逆动力学，以对齐推理条件并提升鲁棒性。

Abstract: Mobile manipulation is a key capability for general-purpose robots, yet remains challenging for current embodied learning methods. VLA policies are typically reactive and lack explicit world modeling, while existing World Action Models (WAMs) are still poorly aligned with the structure of mobile manipulation: they operate on coarse video chunks, model entangled navigation-manipulation actions, and train inverse dynamics under supervision that does not match autoregressive inference. As a result, they often miss fine-grained contact dynamics, suffer from action-distribution conflicts, and accumulate errors over long-horizon rollouts. We propose ABot-M0.5, a new WAM built on the insight that mobile manipulation requires alignment at three levels: temporal granularity, action space, and train-test consistency. To align temporal granularity, we introduce intermediate latent actions that capture local visual state transitions and serve as an bridging action space between video latents and embodiment-specific controls. To align action space, we design a dual-level Mixture-of-Transformers architecture that disentangles both modality representations and heterogeneous action subspaces such as base movement and arm manipulation. To align inference conditions, we propose the dream-forcing training strategy that progressively trains inverse dynamics on model-predicted videos, improving train-test alignment and robustness during autoregressive prediction. Experiments on challenging mobile and fine-grained manipulation benchmarks demonstrate that ABot-M0.5 achieves state-of-the-art performance in both long-horizon task success and finegrained control accuracy. These results highlight the critical importance of granularity-aligned, action-disentangled, and inference-consistent world-action modeling.

[68] Imprint: Online Memory Compression for Long-Horizon Egocentric QA cs.CVPDF

Kousik Das, Debaditya Roy

TL;DR: 本文提出Imprint框架，针对长时程第一人称问答任务中的记忆表示问题，将记忆构建视为在线压缩而非摘要过程。该方法通过结构化交互记录识别重复模式，并基于重现性、新近性和独特性等人类记忆整合信号选择性压缩记忆，以提升检索效率并降低存储开销。

Details

Motivation: 现有长时程第一人称QA方法采用分层文本摘要构建记忆，虽能压缩存储但侧重于描述性压缩而非检索优化，导致重复交互被吸收为粗略描述而非显式记忆单元，难以支持长时程证据聚合。

Result: 在包含七天记录的第一人称基准EgoLifeQA上，Imprint将QA准确率从31.0%提升至35.8%，证据支撑的答案数量比EgoRAG增加6倍，内存占用减少2.3倍，检索延迟降低11.8倍。

Insight: 创新点在于将记忆构建重新定义为面向检索的在线压缩问题，通过结构化交互记录和基于认知科学的记忆整合信号（重现性/新近性/独特性）实现动态记忆组织，为长时程第一人称推理提供了可扩展且检索高效的记忆基础。

Abstract: Long-horizon egocentric question answering involves answering about events that have occurred hours or days in the past. This requires memory representations that remain both retrieval-effective and scalable over days or weeks of recording. Existing long-horizon egocentric QA methods construct memory as hierarchical textual summaries of observations. While effective for reducing memory size, summarization optimizes for descriptive compression rather than retrieval: repeated interactions are absorbed into coarse textual descriptions instead of being preserved as explicit, recurring memory units, making long-horizon evidence aggregation difficult. We propose Imprint, an interaction-centric memory framework that formulates long-horizon egocentric memory as an online memory compression problem rather than summarization. Incoming observations are first represented as structured Interaction Records and continuously organized into recurring interaction patterns. Using human memory consolidation signals of recurrence, recency, and distinctiveness, Imprint selectively retains and compresses interactions into a compact retrieval-oriented memory. We evaluate Imprint on EgoLifeQA, a seven-day egocentric benchmark containing questions that require reasoning over interactions occurring hours to days before the query. With the same LLM, Imprint improves QA accuracy from 31.0% to 35.8%, increases evidence-grounded answers by $6\times$ compared with EgoRAG, reduces memory footprint by $2.3\times$, and decreases retrieval latency by $11.8\times$. These results demonstrate that memory compression provides a scalable and retrieval-effective foundation for long-horizon egocentric question answering.

[69] Towards Memory-Efficient Autoregressive Video Generation via Instance-Specific Parametric Absorption cs.CV | cs.MMPDF

Xiaomeng Fu, Jia Li, Yiming Hu, Yong Wang, Hayden Kwok-Hay So

TL;DR: 本文提出了一种名为实例特定参数吸收（ISPA）的新框架，用于解决自回归流式视频生成模型中KV缓存线性增长导致的内存瓶颈问题。ISPA通过将部分层从全注意力转换为局部注意力，并将历史上下文信息“吸收”到模型权重中，从而在压缩KV缓存的同时保持视觉质量。

Details

Motivation: 自回归流式模型生成长视频时，KV缓存的线性增长会导致内存过载和推理吞吐量下降。现有的压缩方法（如丢弃冗余KV令牌）会破坏长程依赖，导致时间闪烁和身份信息丢失。

Result: 在1.3B到14B的不同架构上进行实验，ISPA能够减少高达50%的KV缓存，同时实现近乎无损的视觉质量。

Insight: 创新点在于将KV缓存压缩从丢弃转向蒸馏，通过实例特定的权重调制来补偿缺失的历史上下文，为流式生成模型提供了一种超越外部令牌级缓存管理的参数化内存整合新视角。

Abstract: Autoregressive (AR) streaming models have emerged as a powerful paradigm for long video generation. However, the linearly growing Key-Value (KV) cache poses a significant bottleneck, leading to memory overload and degraded inference throughput. A common compression method is to drop redundant KV tokens, which often breaks long-range dependencies, resulting in temporal flickering and identity loss. In this paper, we propose Instance-Specific Parametric Absorption (ISPA), a novel framework that shifts the KV cache compression from discarding to distilling. The core idea is to transit a subset of layers from Full-Attention (F-Layers) to memory-efficient Local-Attention (L-Layers) by “absorbing” historical context into the model’s weights. Specifically, during a brief warmup phase, ISPA monitors the output discrepancy between global and local attention. At the transition point, we solve a closed-form least-squares problem to compute an instance-specific weight modulation that compensates for the missing history. Experiments across architectures (1.3B to 14B) demonstrate that ISPA can remove up to 50% of the KV cache with near-lossless visual quality. We hope this perspective encourages future work to explore parametric memory consolidation beyond external token-level cache management for streaming generative models.

[70] Partial Skeleton Visibility for Action Recognition: A Constrained Field-of-View Approach cs.CV | cs.AIPDF

Yingjie Dai, Tianyang Xu, Yanglin Deng, Xiao-Jun Wu, Josef Kittler

TL;DR: 本文提出了一种名为PartialVisGraph的新型超图框架，专门用于解决在受限视野（FoV）条件下骨架动作识别中关节可见性缺失的问题。该框架通过引入可学习的虚拟超边构建软关联矩阵来捕捉高阶依赖关系，并设计了单头样本自适应Transformer，结合可见性先验自适应聚合关节特征。在NTU RGB+D 60和120数据集上建立了真实的FoV模拟基准，实验表明该方法在部分可见性条件下取得了最先进的性能，并在严重FoV限制子集上相比基线提升高达68.8%。

Details

Motivation: 现有骨架动作识别方法通常假设输入骨架完整且清晰，但在实际部署场景（如第一人称视角、拥挤监控、可穿戴设备或边缘机器人）中，受限视野常导致大量关节可见性丢失，导致性能严重下降，而现有模型大多无法有效处理这一问题。

Result: 在NTU RGB+D 60和120数据集上建立了严格的受限视野模拟评估协议，大量实验表明PartialVisGraph在部分可见性条件下始终达到最先进（SOTA）的准确率，在严重FoV限制子集上相比近期强基线提升高达68.8%，同时在完全可见性设置下也保持优越性能。

Insight: 创新点包括构建具有可学习虚拟超边的超图框架以捕捉灵活的高阶依赖关系，以及设计单头样本自适应Transformer结合可见性先验来选择性门控信息流，防止被遮挡或视野外关节干扰可靠特征传播，为无约束环境中可部署的骨架动作理解提供了原则性且实用的途径。

Abstract: Skeleton-based action recognition has achieved remarkable success by exploiting joint coordinates and their topological connections, yet prevailing methods overwhelmingly assume complete and clean skeleton inputs. In real-world deployments, such as egocentric vision, crowded surveillance, wearable devices, or edge robotics, limited field-of-view (FoV) frequently causes substantial joint visibility dropout, leading to severe performance degradation that existing models are largely unprepared to handle. To bridge this critical yet underexplored gap, we introduce PartialVisGraph, a novel hypergraph framework tailored for robust skeleton action recognition under constrained FoV. We first construct highly expressive hypergraphs by introducing learnable virtual hyperedges that form a soft incidence matrix, capturing flexible high-order dependencies beyond conventional pairwise graphs. We then propose the Single-Head Sample-Adaptive Transformer, which adaptively aggregates joint features onto hyperedges while explicitly incorporating a visibility prior. This prior selectively gates information flow, preventing occluded or out-of-view joints from corrupting reliable feature propagation. We further establish rigorous evaluation protocols with realistic FoV simulation benchmarks on NTU RGB+D 60 and 120. Extensive experiments demonstrate that PartialVisGraph consistently achieves state-of-the-art accuracy under partial visibility, with gains of up to 68.8% on subsets with severe FoV restrictions compared to recent strong baselines, while remaining superior on full-visibility settings. Our approach offers a principled and practical pathway toward deployable skeleton-based action understanding in unconstrained environments.

[71] AV-SyncBench: Decoupled Benchmarking of Temporal and Semantic Audio-Visual Synchronization cs.CV | cs.SDPDF

Tianhong Zhou, Mingyang Han, Boyu Li, Yuxuan Jiang, Jiaxin Ye

TL;DR: 本文提出了AV-SyncBench，这是首个将音频-视频同步的时域和语义评估完全分离的基准测试。它基于真实世界视频构建，涵盖语音、音乐和声音等10个场景和5个挑战任务，包含3,269个视频和38,390个样本。作者评估了五个代表性模型，以量化特征在对其和下游任务中的质量。

Details

Motivation: 现有音频-视觉特征提取模型的评估协议存在维度偏差，通常只关注语义匹配或时间偏移检测，且其数据构建是耦合的，无法独立评估时域和语义一致性。

Result: 作者构建了包含3,269个视频和38,390个样本的基准数据集，并评估了五个代表性模型，量化了它们在对其和下游任务中的特征质量。

Insight: 核心创新在于首次提出了一个完全解耦的基准测试，能够独立评估音频-视频同步的时域和语义维度，这有助于更精确地诊断和提升多模态特征提取模型的性能。

Abstract: Audio-visual feature extraction is a fundamental component of multimodal understanding and generation tasks. However, existing evaluation protocols for feature extraction models exhibit dimensional bias, typically focusing on either semantic matching or temporal offset detection. Moreover, their data construction remains coupled, preventing independent assessment of temporal and semantic consistency. We propose AV-SyncBench, the first benchmark to fully separate temporal and semantic evaluation for audio-visual synchronization. Built from in-the-wild videos, it spans Voice, Music, and Sound across 10 scenarios and 5 challenge tasks. Data are automatically filtered and manually verified to ensure on-screen sound sources. The benchmark contains 3,269 videos and 38,390 samples, and we evaluate five representative models to quantify feature quality for alignment and downstream tasks. The code and dataset are available at: https://fgt7t6g.github.io/AV-SyncBench.

Le Ou, Xiliang Zhu, Huanwen Liang, Wenxiong Pan, Yuhao Huang

TL;DR: 本文提出了一种基于基础模型的关键解剖帧选择框架，用于从盲扫超声视频中估计胎儿出生体重（FBW），以减少对操作者专业知识的依赖。该方法通过解剖引导的帧选择模块和冗余感知特征压缩模块，在无平面约束的盲扫视频中实现准确的体重回归。

Details

Motivation: 解决在分娩前准确估计胎儿出生体重的临床挑战，特别是在低资源环境下，减少对操作者专业技能的依赖。

Result: 在来自839名患者的前瞻性收集数据上验证，该方法实现了161.3克的平均绝对误差（MAE），90.23%和100%的病例分别落在10%和15%的绝对百分比误差范围内，优于典型的Hadlock估计和其他强基线方法。

Insight: 创新点包括首次使用盲扫超声视频进行FBW估计以实现操作者无关评估，以及结合视觉-语言基础模型的解剖引导帧选择模块和冗余感知特征压缩模块来处理视频中的时间冗余。

Abstract: Accurate fetal birth weight (FBW) estimation shortly before delivery is clinically valuable yet challenging due to its reliance on operator expertise, particularly in low-resource settings. To reduce this reliance, we study near-term birth-weight regression from blind-sweep ultrasound (US) videos acquired within 48 hours prior to delivery, with post-delivery weighing as ground truth. Accordingly, we propose a foundation model-driven key anatomy frame selection framework that enables accurate FBW regression despite the absence of plane constraints in blind sweeps. Our highlights are as follows: (1) We believe this is the first work to estimate FBW using blind-sweep US videos, enabling operator-independent assessment. (2) An Anatomy-Guided Frame Selection module equipped with a vision-language foundation model is proposed for keyframe collection in unconstrained sweeps. (3) A Redundancy-Aware Feature Compression module is designed to compress frame features while preserving task-relevant information, alleviating temporal redundancy. Extensively validated on prospectively collected data from 839 patients, our method achieves an MAE of 161.3 g, with 90.23% and 100% of cases falling within 10% and 15% absolute percentage error, outperforming typical Hadlock estimation and strong competitors. Codes are available at https://github.com/ouleoule/BlindSweep-EBW.

[73] FrameONE: Hierarchical Motion Modeling for Universal Multi-View Echocardiographic Keyframe Detection cs.CVPDF

Rusi Chen, Yuhao Huang, Hongyuan Zhang, Chao Tian, Shunan Ji

TL;DR: 本文提出FrameONE，一种用于多视角超声心动图关键帧检测的统一端到端框架。该框架采用分层运动建模策略，通过视图内多任务学习减少外观偏差并聚焦运动特征，再通过视图间通用运动学习模块分离视图无关的动态特征与视图特定的模式，从而实现跨视图的共享且灵活的运动表示学习。

Details

Motivation: 现有方法通常是针对特定视图开发的，依赖辅助标注或密集的视觉建模，限制了其泛化能力。在多视图建模中，关键帧检测由共享的心脏运动驱动，但大的外观差异和运动模式使得统一建模具有挑战性。

Result: 在涵盖四个标准视图的25,872个视频上进行的大量实验表明，FrameONE在关键帧检测精度上达到了最先进的水平，并具有很强的跨视图泛化能力。

Insight: 创新点在于提出了分层运动建模策略，将视图内多任务学习与视图间通用运动学习相结合，有效分离了视图无关的动态特征与视图特定的模式，实现了对共享心脏运动的统一且灵活的建模，提升了模型在多视图下的泛化性能。

Abstract: Accurate detection of end-systole (ES) and end-diastole (ED) frames is fundamental to echocardiographic assessment. Existing methods are typically developed in a view-specific manner, depend on auxiliary annotations or intensive visual modeling, which limits their generalizability. In multi-view modeling, keyframe detection is driven by shared cardiac motion, yet large appearance differences and motion patterns make unified modeling challenging. To address these issues, we propose FrameONE, a unified end-to-end framework for multi-view echocardiographic keyframe detection. FrameONE introduces a Hierarchical Motion Modeling strategy: an intra-view multi-task learning reduces appearance bias and promotes motion-focused representations within each view; an inter-view general motion learning module further separates view-agnostic dynamics from view-specific patterns, enabling shared yet flexible motion representation learning across views. Extensive experiments on 25,872 videos spanning four standard views demonstrate that FrameONE achieves state-of-the-art keyframe detection accuracy with strong cross-view generalization. Code is available at https://github.com/szuboy/FrameONE.

Xiao Zhao, Chang Liu, Mingxu Zhu, Zheyuan Zhang, Linna Song

TL;DR: 本文提出了GaussianFusion，一个基于3D高斯表示的新型多模态融合感知通用框架。它摒弃了传统的鸟瞰图离散网格表示，将多模态特征统一在共享的连续3D高斯空间中，以更好地保留细节。该方法是一个任务无关的模型，支持多种3D感知任务，并在nuScenes数据集上的3D目标检测和3D语义占据预测任务中取得了优异的性能。

Details

Motivation: 传统的鸟瞰图表示使用离散网格，导致显著的细节丢失，并限制了多模态融合中的特征对齐和跨模态信息交互。为了解决这些问题，作者旨在探索一种新的、更优的多模态融合表示范式。

Result: 在nuScenes数据集上，GaussianFusion在3D目标检测任务上比基线BEVFusion的NDS指标高出2.6个点。其变体在3D语义占据预测任务上，比GaussFormer的mIoU高出1.55，同时仅使用后者30%的高斯数量，并实现了450%的速度提升。

Insight: 核心创新在于用连续的3D高斯表示取代离散的BEV网格表示，作为多模态融合的统一空间。具体技术贡献包括：基于前向投影的多模态高斯初始化模块，以及基于注意力机制迭代更新高斯属性的共享跨模态高斯编码器。这种表示范式在保持细节和促进跨模态交互方面具有优势。

Abstract: The bird’s-eye view (BEV) representation enables multi-sensor features to be fused within a unified space, serving as the primary approach for achieving comprehensive 3D perception. However, the discrete grid representation of BEV leads to significant detail loss and limits feature alignment and cross-modal information interaction in multimodal fusion perception. In this work, we break from the conventional BEV paradigm and propose a new universal framework for multi-modal fusion based on 3D Gaussian representation. This approach naturally unifies multi-modal features within a shared and continuous 3D Gaussian space, effectively preserving edge and fine texture details. To achieve this, we design a novel forward-projection-based multi-modal Gaussian initialization module and a shared cross-modal Gaussian encoder that iteratively updates Gaussian properties based on an attention mechanism. GaussianFusion is inherently a task-agnostic model, with its unified Gaussian representation naturally supporting various 3D perception tasks. Extensive experiments demonstrate the generality and robustness of GaussianFusion. On the nuScenes dataset, it outperforms the 3D object detection baseline BEVFusion by 2.6 NDS. Its variant surpasses GaussFormer on 3D semantic occupancy with 1.55 mIoU improvement while using only 30% of the Gaussians and achieving a 450% speedup.

[75] Soft Mixture-of-Recursions: Going Deeper with Recursive Vision Transformers cs.CV | cs.LGPDF

Sang In Lee, Jihun Park

TL;DR: 本文提出Soft Mixture-of-Recursions (SoftMoR)方法及其在视觉Transformer中的实例化SR-ViT，旨在通过递归机制构建更深、表征能力更强的模型。该方法学习token级别的混合权重，以可学习的方式灵活组合所有递归步骤的中间表示，从而有效利用递归计算过程中的信息。

Details

Motivation: 现有递归Transformer方法主要通过在计算步骤间共享参数来构建紧凑模型，但简单地增加递归深度并不能可靠提升Vision Transformer的性能，因为它们未能充分利用递归过程中产生的中间表示。

Result: 在ImageNet-1K上，将SR-ViT-S的递归深度从1增加到4，其top-1准确率从79.83%提升至82.48%，仅增加170万参数，性能超越了参数量大得多的DeiT-B模型，而参数量仅为后者的约27%。

Insight: 创新点在于提出了SoftMoR机制，通过可学习的token级混合权重动态整合所有递归步骤的输出，使得中间表示得以有效利用，为通过递归构建更深、更强且参数高效的Vision Transformer提供了一条新路径。

Abstract: Recent recursive Transformer studies have primarily reused shared parameters across computation steps to construct compact, parameter-efficient models. In this work, we leverage recursion to build effectively deeper Transformers with stronger representational capacity. However, in Vision Transformers, simply increasing recursion depth does not reliably improve performance, as existing recursive approaches do not fully utilize the intermediate representations produced throughout recursive computation. We propose Soft Mixture-of-Recursions (SoftMoR) and its Vision Transformer instantiation, Soft Recursive Vision Transformer (SR-ViT). SoftMoR learns token-wise mixture weights to softly combine outputs from all recursion steps, allowing intermediate representations to be utilized in a learnable and flexible way. Across diverse vision tasks, SR-ViT consistently improves as recursion depth increases with minimal parameter overhead. On ImageNet-1K, increasing recursion depth from 1 to 4 improves SR-ViT-S top-1 accuracy from 79.83% to 82.48% with only 1.7M additional parameters, outperforming the substantially larger DeiT-B while using approximately 27% of its parameters. These results demonstrate that SoftMoR provides a parameter-efficient path to deeper and stronger Vision Transformers through recursion.

[76] GKDT: General Keypoint Detection Transformer cs.CVPDF

Changsheng Lu, Yuxin Chen, Haokun Gui, Rong Wang, Jie Yang

TL;DR: 本文提出了一个通用关键点检测模型GKDT，基于DINOv3 Transformer架构，支持视觉提示、文本提示或两者结合。作者首先构建了一个大规模统一关键点数据集MegaKPT，包含来自29个现有数据集的130多万个多样化对象实例，并带有高质量的统一标注和关键点文本描述。通过混合模态提示训练和动态重要性采样等策略增强训练，该模型在22个测试集上展现出强大的性能和泛化能力，在广泛类别上检测关键点，大多数类别PCK@0.1准确率超过90%。

Details

Motivation: 随着预训练视觉和语言模型的出现，计算机视觉正从窄领域识别转向开放领域识别，构建更强大且通用的关键点检测模型以支持多样化任务变得日益重要。

Result: 在22个测试集（包括已见和未见对象）上，单个GKDT模型在广泛类别上展现出强大的关键点检测性能和泛化能力，大多数类别PCK@0.1准确率超过90%，表明其在实际问题中的高适用性。

Insight: 创新点包括构建大规模统一关键点数据集MegaKPT，开发基于DINOv3的通用关键点检测Transformer模型GKDT，支持多模态提示（视觉和文本），并引入混合模态提示训练和动态重要性采样等训练策略以提升模型性能。从客观角度看，该研究通过统一数据集和模型架构，推动了关键点检测向开放领域发展，增强了模型的通用性和实用性。

Abstract: With the emergence of various pre-trained vision and language models, computer vision is shifting from narrow-domain to open-domain recognition. The construction of a more powerful yet general keypoint detection (GKD) model to support diverse tasks has become increasingly important in the field. To this end, we firstly present a large-scale unified keypoint dataset called MegaKPT. The dataset is composed of over 1.3 million diverse object instances from twenty-nine existing datasets, and enjoys high-quality unified annotations with keypoint text descriptions. Based on MegaKPT, we develop GKDT, a simple, flexible and powerful DINOv3 based Transformer model for General Keypoint Detection. Our GKDT supports visual prompts, text prompts, or both. To enhance model training, we also propose a suite of useful strategies such as mix-modal prompted training and dynamic importance sampling. By testing over 22 test sets with seen or unseen objects, our single GKDT model shows strong performance and generality in detecting keypoints on broad categories, with most categories over 90% PCK@0.1 accuracy, offering high practical applicability to real-world problems. The dataset, models, and codes will be released at https://github.com/AlanLuSun/General-Keypoint-Detection.

[77] LeVLJEPA: End-to-End Vision-Language Pretraining Without Negatives cs.CV | cs.AIPDF

Lukas Kuhn, Giuseppe Serra, Randall Balestriero, Florian Buettner

TL;DR: LeVLJEPA是首个完全非对比的端到端视觉语言预训练方法，通过跨模态预测和分布正则化学习，无需负样本、温度参数或动量编码器。该方法生成的编码器在下游密集语义特征任务中表现出色，作为冻结骨干在多个视觉语言基准上达到最强性能。

Details

Motivation: 当前视觉语言预训练主要依赖对比学习目标，而视觉自监督学习已广泛采用非对比方法；同时，视觉语言编码器的角色已转变为为下游模型提供密集的语义特征，而非仅用于零样本分类。

Result: 在GQA、VQAv2和POPE基准上，LeVLJEPA作为冻结骨干在两种不同语言模型下均是最强的编码器；在语义分割任务上优于对比基线，在线性探测等全局任务上表现相当。

Insight: 创新点在于首次实现了完全非对比的视觉语言预训练，通过跨模态预测与停止梯度目标及分布正则化，简化了训练流程并提升了密集特征质量，为非对比方法在视觉语言领域的应用提供了有效范例。

Abstract: Vision-language pretraining remains dominated by contrastive objectives, whereas vision-only self-supervised learning has largely adopted non-contrastive methods. At the same time, the role of vision-language encoders has shifted: they are increasingly deployed not as zero-shot classifiers but as the frozen visual backbone of vision-language models and dense prediction systems, which consume the full grid of patch tokens rather than a single pooled embedding. We introduce LeVLJEPA, the first fully non-contrastive end-to-end vision-language pretraining method. LeVLJEPA learns through cross-modal prediction with stop-gradient targets and per-modality distributional regularization, without negatives, temperature, momentum encoder, or teacher-student schedule, and trains stably at large scale. We find that the resulting encoder provides markedly stronger dense semantic features for downstream use: as a frozen vision-language-model backbone, LeVLJEPA is the strongest of the evaluated encoders across GQA, VQAv2, and POPE under two distinct language models, and outperforms contrastive baselines on semantic segmentation, while remaining on par on global readouts such as linear probing. These results establish non-contrastive pretraining as an effective means of producing dense semantic vision features.

[78] ClinRAG-GRAPH: Clinical-prior Retrieval-Augmented Graph Model with Domain Adversarial Learning for Breast pCR Prediction cs.CVPDF

Yaofei Duan, Yuhao Huang, Tianyu Zhang, Yuan Gao, Luyi Han

TL;DR: 本文提出ClinRAG-GRAPH，一个用于乳腺癌新辅助化疗后病理完全缓解（pCR）预测的临床先验检索增强图框架。该模型整合了动态增强磁共振成像、结构化临床变量和活检病理生物标志物，通过构建患者内部临床先验图、采用先验引导的关系感知图卷积网络进行多模态表征学习，并引入双分支域对抗学习策略以抑制多中心成像异质性，同时结合大语言模型驱动的子图检索增强生成模块来提升模型的可解释性。

Details

Motivation: 解决乳腺癌新辅助化疗响应预测中存在的挑战，包括跨模态建模不足、多中心成像异质性以及基于证据的可解释性弱的问题。

Result: 在一个大规模多中心队列上验证，模型在内部测试集上AUC达到0.815，在两个外部测试集上AUC分别为0.774和0.712，展现了跨中心的稳健预测性能。

Insight: 创新点在于将临床先验知识以图结构整合、采用域对抗学习处理多中心数据差异，并创新性地结合大语言模型进行临床案例检索以增强决策的可解释性和证据基础。这为多模态医学预测任务提供了结构化的知识整合与鲁棒性增强的新思路。

Abstract: Neoadjuvant chemotherapy (NAC) response prediction is clinically important for treatment stratification in breast cancer. However, robust pre-treatment pathological complete response (pCR) prediction remains challenging due to insufficient cross-modal modeling, multicenter imaging heterogeneity, and weak evidence-grounded interpretability. We propose ClinRAG-GRAPH, a Clinically informed Retrieval-Augmented Generation Graph framework, for pre-treatment pCR prediction from DCE-MRI, structured clinical variables, and biopsy-derived pathological biomarkers. ClinRAG-GRAPH constructs an intra-patient clinical-prior graph and applies a prior-guided relation-aware graph convolutional network for structured multimodal representation learning. To improve cross-center robustness, we introduce a dual-branch domain-adversarial learning strategy to suppress protocol-related MRI bias while preserving pCR-relevant features. To enhance interpretability, we further incorporate large language model (LLM)-driven subgraph RAG module that retrieves clinically analogous historical cases and integrates retrieved evidence for pCR inference. We assemble a large-scale multicenter NAC breast cancer cohort for extensive validation, drawing from two public sources and three in-house centers.Results show that ClinRAG-GRAPH achieves AUCs of 0.815 on the internal test set and 0.774/0.712 on two external test sets, demonstrating robust pre-treatment pCR prediction across centers. The code is available at the anonymized https://github.com/miccai26-1181/ClinRAG-GRAPH.

[79] Spotted: Location-informed Reidentification of Hyenas and Leopards in Camera Trap Surveys cs.CVPDF

Halil Sina Kelebek, Julia Hindel, Kobus Hoffman, Lauren Hoffman, Andrew Loveridge

TL;DR: 本文提出了一种名为Spotted的动物重识别框架，该框架结合了视觉相似性和时空可行性先验（基于相机位置和时间戳），以减少专家审查工作量。该方法通过计算最小旅行速度来评估两次检测属于同一只动物的可行性，并利用这些信息训练轻量级头部，最终融合视觉和时空特征进行匹配。

Details

Motivation: 当前动物重识别在相机陷阱调查中面临图像质量低、光照和视角变化大、个体观测数量不平衡等挑战，导致全自动识别性能不足，通常依赖专家审查算法候选匹配。现有方法大多仅关注视觉线索，忽略了野外研究中常规可用的辅助信息（如时间戳和相机位置）。

Result: 在LeopardID102、SpottedHyenaID109和SpottedHyenaID415三个数据集上，Spotted模型将平均top-5识别准确率分别提升了9个百分点、2个百分点和9个百分点，优于最佳基线。人机交互策略将所需比较查询减少了高达69个百分点，同时达到相同的正匹配效果。

Insight: 创新点在于将时空可行性先验（基于相机位置和时间戳）作为伪监督信号，与视觉特征融合，显著提升了重识别性能；同时引入主动配对采样策略，优先处理不确定预测，加速标注过程。这为利用多模态辅助信息改进野外动物监测提供了有效思路。

Abstract: Animal re-identification (ReID) in camera-trap surveys remains challenging due to low image quality, strong variation in illumination and viewpoint, and highly imbalanced numbers of observations per individual. As a result, current ReID performance is often insufficient for fully automated use, and practical workflows typically depend on expert review of algorithmically proposed candidate matches. Moreover, most existing approaches focus almost exclusively on visual cues and overlook auxiliary information routinely available in field studies, such as image timestamps and camera-trap locations. We introduce Spotted, a location-informed, human-in-the-loop animal ReID framework that integrates visual similarity with spatio-temporal feasibility priors derived from camera locations, thereby reducing the amount of required expert review. Our method (i) computes an image-model-agnostic feasibility score based on the minimum travel speed required for two detections to correspond to the same individual, (ii) uses these feasibility cues as pseudo-supervision to train a lightweight head on top of a frozen visual foundation model, and (iii) fuses adapted visual similarity with spatio-temporal feasibility to obtain a robust pairwise matching score. We additionally integrate an active pair sampling strategy to accelerate annotation by initially prioritizing uncertain predictions. We evaluate Spotted on three challenging camera-trap ReID datasets comprised of spotted hyenas and leopards, which we release as part of this work. Our model improves average top-5 identification accuracy by 9pp, 2pp and 9pp over the best baseline on our LeopardID102, SpottedHyenaID109 and SpottedHyenaID415 datasets, respectively. Further, we show that our human-in-the-loop strategy reduces the number of queried comparisons by up to 69pp while achieving equivalent positive matches.

[80] Towards High-Resolution Visual Perception via Hierarchical Entity Exploration cs.CVPDF

Ziyu Ma, Shidong Yang, Yuxiang Ji, Yiming Hu, Tongwen Huang

TL;DR: 本文提出了一种名为分层实体探索（HEE）的训练无关且模型无关的框架，旨在解决多模态大语言模型（MLLMs）处理高分辨率图像时细粒度细节丢失的问题。该方法通过动态、查询引导的探索，将静态图像理解转化为对图像实体的分层探索，包括区域评估、对象检测、语义聚类和置信度引导的回溯机制。

Details

Motivation: 现有方法处理高分辨率图像时，要么需要训练模型来定位关键区域，要么采用启发式固定区域划分，两者在复杂高分辨率场景下泛化能力不足，无法有效保留和利用细粒度视觉信息。

Result: 在Visual Probe和HR-Bench两个复杂高分辨率基准测试上，HEE在准确性和效率上均优于ZoomEye和RAP等无需训练的方法，并在Qwen2.5-VL和LLaVA-OneVision等多种MLLMs上验证了其有效性。此外，HEE在MME-RealWorld基准上也展示了良好的泛化能力。

Insight: 创新点在于将静态图像理解转化为动态、查询引导的分层实体探索过程，并引入了双评分机制、语义层次构建和置信度引导的回溯机制，实现了无需训练的自适应细粒度感知，提升了模型对高分辨率图像复杂场景的理解能力。

Abstract: High-resolution (HR) image perception remains a key challenge in multimodal large language models (MLLMs), as fine-grained details are often lost when the image is processed as a whole. Existing methods either require training to teach models where to look or heuristically divide the image into fixed regions, both of which struggle to generalize in complex HR scenes. In this work, we propose Hierarchical Entity Exploration (HEE), a training-free and model-agnostic framework that transforms static image understanding into dynamic, query-guided entity exploration. HEE first evaluates each region using a dual scoring mechanism to determine whether it already contains sufficient evidence to answer the question. If not, it applies object detection within the most promising region to extract fine-grained entities, clusters them into coherent subregions, and organizes them into a multi-level semantic hierarchy for deeper exploration. When deeper regions still fail to yield confident answers, a confidence-guided backtracking mechanism revisits alternative paths to ensure adaptive perception. Extensive results show that HEE outperforms training-free methods like ZoomEye and RAP in both accuracy and efficiency on two complex HR benchmarks (Visual Probe and HR-Bench), across different MLLMs such as Qwen2.5-VL and LLaVA-OneVision. Moreover, HEE demonstrates generalization on the MME-RealWorld benchmark.

[81] Stitched Embeddings: A Unified Latent Space for 3D Garments and 2D Patterns cs.CVPDF

Andrea Sanchietti, Riccardo Marin, Bharat Lal Bhatnagar, Yuanlu Xu, Gerard Pons-Moll

TL;DR: 本文提出了Stitched Embeddings，一个无需物理仿真的统一双向潜在空间框架，用于连接3D服装重建与2D缝纫图案推断。该方法利用预训练3D基础模型的几何先验，通过BoxMesh作为中间表示来对齐2D裁片与3D配置，在实现高精度图案重建的同时显著提升了效率。

Details

Motivation: 解决服装拓扑多样性带来的建模难题，传统方法依赖物理仿真来桥接2D缝纫图案与3D几何形状，但存在数据稀缺和计算开销大的问题。

Result: 在图案重建任务上达到了最先进的精度，同时显著提升了效率；框架支持从网格恢复图案和从2D图案进行3D编辑等新应用。

Insight: 创新点在于构建了一个无需仿真的双向统一潜在空间，并引入BoxMesh作为关键中间表示来有效对齐2D与3D数据；该方法为神经3D视觉与物理服装制造流程之间建立了可扩展的联系。

Abstract: While garments are essential for realistic digital humans, their topological variety makes them much harder to model than parametric bodies. Traditional tailoring relies on 2D sewing patterns, yet bridging these patterns to 3D geometry currently requires physical simulations. We present Stitched Embeddings, the first simulation-free framework to unify 3D garment reconstruction and sewing pattern inference within a single bidirectional latent space. By leveraging the geometric priors of a pretrained 3D foundation model, our approach overcomes the data scarcity typically associated with high-quality garment modeling. We propose to use the BoxMesh as a critical intermediate representation to align 2D panels into 3D configurations without the computational overhead of a simulator. This architecture achieves state-of-the-art accuracy in pattern reconstruction while significantly improving efficiency. Furthermore, our differentiable pipeline enables novel applications, including pattern recovery from meshes and 3D editing from 2D patterns. Finally, this work provides a scalable link between neural 3D vision and the physical garment manufacturing pipeline. Project Page: https://andreus00.github.io/stitchedembeddings

[82] Pano2World: End-to-End 3D Generation via Unified Multi-View Sequences cs.CV | cs.AIPDF

Zhenjia Li, Jinrang Jia, Yifeng Shi

TL;DR: Pano2World提出了一种端到端方法，将单个室内全景图直接转换为持久、可探索的3D高斯场景表示。该方法通过自适应采样生成几何对齐的引导全景图，并利用全景扩散模型通过视图感知注意力路由进行联合去噪，同时引入潜在特征适配器将多视图隐特征蒸馏为场景潜在表示，最终解码为3D高斯场景。

Details

Motivation: 现有方法将单张全景图转换为可自由视点导航的3D表示时，存在迭代修复导致的误差累积、流程繁琐，或视频生成模型连续轨迹约束限制多方向同时覆盖的问题。

Result: 实验表明，Pano2World在多位置全景新视图合成基准上显著优于现有方法。

Insight: 创新点包括视图感知注意力路由机制实现跨视图一致性，以及潜在特征适配器避免VAE解码的信息损失，直接从隐特征蒸馏到3D高斯场景，实现了端到端的高效生成。

Abstract: A single panorama captures the full visual sphere from one camera center, yet confines users to looking around in place without enabling true scene exploration. Converting a single panorama into a persistent, renderable 3D representation for free-viewpoint navigation has attracted growing interest; existing methods either adopt iterative per-view completion that propagates inpainting results to update the underlying geometry, leading to progressive error accumulation and cumbersome multi-step pipelines, or leverage the temporal consistency priors of video generation models, yet the continuous-trajectory constraint intrinsic to such models limits their flexibility in covering scenes from multiple directions simultaneously. We present Pano2World, which takes a single indoor panorama as input and directly outputs a persistent, explorable 3D Gaussian scene. Given the source panorama, Pano2World first reconstructs a coarse 3D Gaussian proxy and renders it at adaptively sampled nearby poses to obtain geometrically aligned guidance panoramas; a panoramic diffusion model then jointly denoises all target views via View-Aware Attention Routing, where each target view simultaneously receives geometric constraints from its corresponding guidance panorama and global semantic guidance from the source panorama, naturally enforcing cross-view consistency. To avoid the information loss incurred by decoding the multi-view hidden features formed during joint denoising back to the pixel domain via VAE, we introduce Latent Feature Adapter, a geometry-aware bridge module that directly distills these hidden features into a scene latent, subsequently decoded into the final 3D Gaussian scene. Experiments demonstrate that Pano2World significantly outperforms existing methods on the multi-position panoramic novel-view synthesis benchmark.

[83] Rethinking Multi-Label Image Classification With Deep Learning: Taxonomy, Challenge, and Outlook cs.CVPDF

Xuelin Zhu, Xiu-Shen Wei, Jiawei Ge, Shuai Xu, Bing Wang

TL;DR: 本文是一篇关于多标签图像分类（MLIC）的综述论文，全面回顾了基于深度学习的MLIC方法。论文首先回顾了MLIC的背景，包括问题定义、数据集、骨干网络和评估指标。然后，提出了一个基于深度学习的MLIC方法分类法，将其分为六类：区域导向、标签导向、架构导向、表示导向、学习导向和数据导向方法。最后，深入探讨了MLIC中的核心学习机制及其对其他视觉领域的启示，并总结了关键挑战和未来研究方向。

Details

Motivation: 多标签图像分类是计算机视觉中的一项基础任务，支撑着自动驾驶、疾病诊断、推荐系统等众多实际应用。尽管深度学习模型（如CNN、RNN、Transformer）显著推动了该领域的发展，但缺乏一个全面、系统的综述来梳理现有方法、分析核心挑战并展望未来。本文旨在填补这一空白，为研究社区提供一个整体视角。

Result: 作为一篇综述论文，本文未提出新的模型或报告具体的定量实验结果。其核心成果是提出了一个系统性的分类法，对现有深度学习方法进行了归纳和梳理，并总结了该领域在不同数据集和应用场景下的进展与挑战。

Insight: 本文的主要创新点在于提出了一个新颖且全面的六分类法（区域、标签、架构、表示、学习、数据导向），用于系统化组织MLIC的深度学习文献。这为理解和比较不同方法提供了清晰的框架。此外，论文对MLIC内在学习机制的深入分析及其对其他视觉任务的启示，是具有前瞻性的见解，有助于推动该领域及相关方向的未来研究。

Abstract: Multi-label image classification (MLIC), a fundamental task in computer vision, focuses on identifying multiple objects or concepts within an image, underpinning numerous read-world applications, such as autonomous driving, disease diagnosis, recommendation system, and mobile service robot. Over the past decade, deep learning paradigms based on convolutional neural networks, recurrent neural networks, and Transformers have significantly advanced this field, owing to their powerful capability in visual representation and relationship modeling. These advances have markedly improved the robustness, scalability, and generalization ability of MLIC models across diverse datasets and application domains. In this survey, we provide a comprehensive review of the deep learning-based literature on MLIC. Concretely, we first revisit the background, including problem definition, datasets, backbones and evaluation metrics. Next, we develop a plausible taxonomy for the deep learning-based MLIC approaches, organizing them into six groups: region-oriented methods, label-oriented methods, architecture-oriented methods, representation-oriented methods, learning-oriented methods, and data-oriented methods. Finally, we provide an insightful exposition of the underlying learning game in MLIC and its implications for other vision domains, and we empirically summarize the key challenges and research directions in MLIC while outlining promising avenues for future development. We believe this survey offers the research community a holistic and systematic perspective on MLIC, thereby facilitating subsequent exploration and innovation in this field and beyond.

[84] MoVA: Learning Asymmetric Dual Projections for Modular Long Video-Text Alignment cs.CV | cs.LGPDF

Peiyuan Zhu, Shaoan Xie, Zijian Li, Yifan Shen, Namrata Deka

TL;DR: MoVA提出了一种模块化长视频-文本对齐框架，通过学习非对称双投影来解决视频领域中的时间错位和语义不对称问题。该方法包括文本侧投影自适应选择帧感知的文本子空间，以及视频侧投影解耦文本相关的视觉概念，从而在保持全局跨模态语义的同时处理细粒度对齐。

Details

Motivation: 现有对比预训练模型（如CLIP）的视频-文本对齐存在表示纠缠问题，视频领域特有的时间错位（文本仅对应特定时间窗口）和语义不对称（帧级视觉细节与字幕级概念的非等价相关性）进一步加剧了这一挑战。

Result: 经验评估表明，MoVA在多个视频-文本对齐任务中优于现有方法，证明了其有效性。

Insight: 创新点在于建立了跨时间维度和不同粒度级别灵活对齐的理论条件，并设计了非对称双投影机制，实现了对长视频和长文本的自然扩展与解耦表示学习。

Abstract: Contrastive pre-training has propelled video-text alignment, yet models often inherit the critical limitations of their image-text predecessors like CLIP, resulting in entangled representations. These challenges are severely exacerbated by two fundamental properties in the video domain: Temporal Misalignment, where textual descriptions often correlate only to specific, constrained temporal windows, leaving other frames text-irrelevant; and Semantic Asymmetry, which dictates a sparse, bidirectional, and non-equivalent relevance between frame-level visual details and caption-level concepts. This failure persists whether captions are short and temporally disjoint, creating ambiguity, or long and detailed, fostering entanglement between static objects and their temporal evolution. In this paper, we establish theoretical conditions that enable flexible alignment between video and text representations across the temporal dimension and at varying levels of granularity. Building on these theoretical insights, we introduce MoVA, Modular Long Video-Text Alignment, which learns dual asymmetric projections: a text-side projection that adaptively selects frame-aware subspaces of the caption, and a video-side projection that disentangles text-relevant visual concepts. Our framework ensures that the model can preserve global cross-modal semantics while disentangling evolving, frame-specific concepts and scale naturally to long captions and videos. Empirical evaluations show that MoVA outperforms existing methods in multiple video-text alignment tasks, demonstrating the effectiveness of our method.

[85] TrajLoc: Trajectory-Attention Localization for Multi-Object Motion Control cs.CV | cs.GRPDF

Omer Sela, Inbar Huberman-Spiegelglas, Michael Rotman, Sagie Benaim, Avi Ben-Cohen

TL;DR: 本文提出TrajLoc方法，用于图像到视频生成中的多目标运动控制，通过轨迹注意力定位机制，在注意力层中为每个目标token施加独立的空间约束，以高斯热图替代交叉注意力权重，确保目标身份保持并精确遵循指定轨迹。

Details

Motivation: 现有方法在密集场景中将多个轨迹纠缠于共享的稠密条件信号中，难以保持目标级对应关系，尤其当目标数量增多且路径交叉或遮挡时，身份保持和轨迹遵循面临挑战。

Result: 在六个数据集（包括多达20个同时控制的目标和分布外真实场景）上的评估表明，该方法在视觉保真度和轨迹遵循方面均持续改进；应用于CogVideoX 5B和WaN 2.1 14B两个架构不同的骨干网络时，相比最强基线平均PSNR提升+4.3 dB，轨迹终点误差减少51%。

Insight: 创新点在于摒弃共享条件范式，引入严格的目标级空间约束，在注意力层直接通过高斯热图实现轨迹定位，并结合学习嵌入传递轨迹和深度信息，同时利用首帧外观编码替代目标token以保持身份，这为多目标运动控制提供了可扩展的解决方案。

Abstract: Controlling the motion of multiple objects in image-to-video (I2V) generation requires preserving object identities while enforcing adherence to distinct target trajectories. This becomes particularly challenging as the number of objects increases and their paths intersect or occlude one another. Existing approaches entangle multiple trajectories within a shared, dense conditioning signal, making object-level correspondence difficult to preserve in crowded scenes. We depart from this paradigm and enforce a strict, per object spatial constraint that isolates instances independently. Our method, TrajLoc, achieves this directly within the attention layers by substituting the cross-attention weights of each object token with a Gaussian heatmap centered on its target location at every frame. The same per object token interface carries trajectory and depth through a learned embedding and preserves identity by encoding first frame appearance in place of an object token. Evaluations across six datasets, featuring up to 20 simultaneously controlled objects and out of distribution real world scenes, demonstrate that our method consistently improves both visual fidelity and trajectory adherence. Applied to two architecturally distinct backbones (CogVideoX 5B and WaN 2.1 14B), our approach achieves average gains of +4.3 dB PSNR and a 51% reduction in trajectory end point error compared to the strongest baselines. Project page: https://sela-omer.github.io/traj-loc/

[86] EFlow: Learning Evidence Flow for Long-Video Reasoning with Adaptive Reflection cs.CVPDF

Wenhao Zhang, Kuanwei Lin, Xuyi Yang, Wei Gao, Ge Li

TL;DR: 本文提出EFlow框架，旨在解决长视频推理中证据获取与利用的根本限制。该框架基于Qwen3-VL构建，通过分离时间定位与逻辑推理步骤，并引入置信度感知的反思机制，以缓解早期语义假设对证据定位的偏差问题。

Details

Motivation: 现有工具增强的视频框架通常将时间定位与答案推理交织在单一轨迹中，导致早期语义假设（称为“过早语义承诺”）会偏差证据定位，进而检索不完整证据并强化错误推理。

Result: 在五个视频理解基准上的广泛实验表明，EFlow持续提升了长视频推理性能。

Insight: 创新点在于明确分离时间定位与逻辑推理（通过CoT for Temporal Grounding和CoT for Reasoning），并在证据可能不足时引入置信度感知的反思机制对完整视频进行重新评估；此外，通过构建专用轨迹数据集并结合监督微调、强化学习与强化微调进行训练。

Abstract: Long-video reasoning is fundamentally constrained by how models acquire and utilize visual evidence. Existing tool-augmented video frameworks often interleave temporal grounding and answer reasoning within a single trajectory, causing early semantic hypotheses to bias evidence localization. We term this failure mode premature semantic commitment, where biased grounding retrieves incomplete evidence and incomplete evidence further reinforces incorrect reasoning. To address this issue, we propose EFlow, an evidence-first video reasoning framework built upon Qwen3-VL. EFlow explicitly separates temporal grounding and logical reasoning through CoT for Temporal Grounding and CoT for Reasoning, enabling the model to retrieve relevant evidence before answer inference. In addition, EFlow introduces a confidence-aware reflection mechanism that re-evaluates the full video when retrieved evidence is potentially insufficient. We further construct dedicated trajectory datasets and train EFlow through supervised fine-tuning, reinforcement learning, and reinforcement fine-tuning. Extensive experiments across five video understanding benchmarks demonstrate that EFlow consistently improves long-video reasoning performance.

[87] OmniView-Space: Reinforcing Spatial Reasoning via Multi-Perspective Spatial Mapping cs.CVPDF

Xudong Li, Mengdan Zhang, Peixian Chen, Jiaxi Tan, Zihao Huang

TL;DR: 本文提出了OmniView-Space框架，旨在解决多模态大语言模型在空间推理任务中的挑战。该框架通过多视角空间映射、工具引导的自我中心推理和认知图蒸馏三个核心组件，将重建的几何信息与查询对齐，以维持跨模态的空间一致性。

Details

Motivation: 现有方法在需要动态地将证据重新锚定到特定参考系（如相机、物体或方向中心）的复杂多步空间推理中表现不佳，因此需要一种能维持空间一致性的新方法。

Result: 在单图和多图空间推理基准测试中，OmniView-Space取得了最先进的性能，并且经过蒸馏的模型在减少对外部几何处理流程依赖的同时保持了高性能。

Insight: 创新点在于通过多视角空间映射构建与查询对齐的视觉认知图和文本空间图，并利用工具引导的主动推理策略和认知图蒸馏，使模型能够利用自我生成的认知地图进行推理，从而增强了空间表征的连贯性。

Abstract: Spatial intelligence remains a persistent challenge for Multimodal Large Language Models (MLLMs), as it requires coherent spatial scene representations beyond basic object recognition. Existing methods typically build such representations through textual reasoning or 3D reconstruction. However, they often falter during multi-step reasoning, particularly when required to dynamically re-anchor evidence to the specific camera-, object-, or direction-centric reference frames demanded by complex queries. To address this, we propose OmniView-Space, a framework designed to maintain spatial consistency through multimodal egocentric evidence. Our approach consists of three core components: (1) Multi-Perspective Spatial Mapping (MPSM), which re-anchors reconstructed geometry into a query-aligned visual cognitive map and a textual spatial graph; (2) Tool-Guided Egocentric Reasoning, an interleaved policy trained to actively select the ego anchor required by the query and request the corresponding MPSM evidence; and (3) Cognitive-Map Distillation, which uses MPSM-generated trajectories and ego-frame rewards to train the model to reason with self-generated cognitive maps. Experiments on single- and multi-image spatial reasoning benchmarks show that OmniView-Space achieves state-of-the-art performance. Furthermore, the distilled model maintains this performance while reducing reliance on external geometry pipelines.

[88] Mirror-Fusion Attention for Reflection-Aware Self-Supervised Representation Learning cs.CV | cs.LGPDF

Ruixin Li, Jin Liu, Yuling Shi, Stefano Lodi

TL;DR: 本文提出了一种名为MFASSL的视觉Transformer框架，通过引入镜像融合注意力模块，在标准自监督学习基础上注入软反射先验，以利用近似对称数据中的左右对应关系。该方法在多个数据集上提升了下游任务性能、校准能力和反射鲁棒性，且仅需少量额外参数。

Details

Motivation: 大多数自监督学习方法强调增强不变性，但严格的翻转不变性可能抑制医学图像和人脸等近似双边数据中的左右对应信息。本文旨在通过引入反射先验来补充基于不变性的自监督学习，以更好地利用对称性信息。

Result: 在CheXpert、BraTS、CelebA-HQ和WFLW数据集上，MFASSL在匹配的ViT-B/16设置下，相比MoCo-v3、DINO和MAE基线模型，提升了下游性能、校准能力和反射鲁棒性。与近期等变自监督学习方法相比，仅增加约2.7%参数即实现了更强且更一致的性能增益。

Insight: 创新点包括提出轻量级的镜像融合注意力模块，用于自适应地融合镜像区域间的令牌级交互，同时保留非对称线索；此外，通过反射一致性和中层令牌对齐损失增强自监督目标。从客观角度看，该方法展示了轻量级几何感知先验可有效补充基于不变性的自监督学习，为处理对称数据提供了新思路。

Abstract: Most self-supervised learning (SSL) methods encourage invariance across augmentations, but strict flip invariance can suppress informative left–right correspondences in approximately bilateral data such as medical images and human faces. We propose Mirror-Fusion-Augmented Self-Supervised Learning (MFASSL), a Vision Transformer framework that injects a soft reflection prior into standard SSL without redesigning the backbone. MFASSL constructs mirror-paired views aligned to an estimated symmetry axis and introduces a lightweight Mirror-Fusion Attention (MFA) module for adaptive token-level interaction between mirrored regions while preserving asymmetric cues. The base SSL objective is further coupled with reflection-consistency and mid-layer token-alignment losses. Across CheXpert, BraTS, CelebA-HQ, and WFLW, MFASSL improves downstream performance, calibration, and reflection robustness over MoCo-v3, DINO, and MAE baselines under matched ViT-B/16 settings. It also achieves stronger and more consistent gains than recent equivariant SSL approaches with only approximately 2.7% additional parameters. These results show that lightweight geometry-aware priors can effectively complement invariance-based SSL.

[89] Improving Sparse-View 3DGS Generalization via Flat Minima Optimization cs.CV | cs.AIPDF

Kangmin Seo, Sangeek Hyun, MinKyu Lee, Jae-Pil Heo

TL;DR: 本文提出了一种通过平坦最小值优化来提升稀疏视角下3D高斯溅射泛化性能的方法。该方法将高斯参数视为可训练权重，通过引入考虑各向异性和训练进度的受控高斯扰动正则化，并结合周期性重初始化技术，在不改变架构的情况下提升模型对稀疏输入视图的鲁棒性。

Details

Motivation: 解决3D高斯溅射在稀疏视角监督下容易过拟合、对未见视角泛化能力差的问题。

Result: 在LLFF和Mip-NeRF360数据集上的实验表明，该方法在稀疏视角监督下提升了定量指标和感知质量，产生了更清晰、更稳定、泛化更好的重建结果。

Insight: 创新点在于将平坦最小值优化原则适配到3DGS的几何与动态特性中，并提出了结合受控各向异性扰动与周期性重初始化的轻量级训练框架，以提升稀疏视图下的泛化能力。

Abstract: Recent advances in neural rendering have established 3D Gaussian Splatting (3DGS) as a highly efficient representation for novel view synthesis, enabling fast training and real-time rendering with strong fidelity. However, when supervision is limited to sparse input views, 3DGS tends to overfit to the observed images and generalize poorly to unseen viewpoints. We address this challenge from the perspective of flat minima (FM) optimization, which seeks solutions that remain stable under small parameter perturbations. Viewing Gaussian parameters as trainable weights, we adapt FM principles to the geometric and dynamic nature of 3DGS with a lightweight training framework. Our method regularizes optimization with controlled Gaussian perturbations that account for each Gaussian’s anisotropy and the training progress, preserving fine details while improving robustness to sparse-view overfitting. To further stabilize this flat minima optimization process, we introduce periodic reinitialization, which temporarily returns non-positional parameters to their initial states for a short window. Together, these techniques integrate seamlessly into existing 3DGS pipelines without architectural changes. Experiments on LLFF and Mip-NeRF360 datasets demonstrate improved quantitative metrics and perceptual quality under sparse-view supervision, producing reconstructions that are sharper, more stable, and better generalized to novel viewpoints.

[90] Dataset Biases and Shortcut Learning in Motion-Based AI-Generated Video Detection cs.CVPDF

Joren Michels, Lode Jorissen, Nick Michiels

TL;DR: 本文评估了四种基于运动特征的AI生成视频检测器的鲁棒性和适用性，发现这些方法存在显著的预处理和采样偏差，且对特定数据集的运动模式高度敏感。研究表明，当在无运动偏差的数据集上测试时，所有检测器性能均接近随机水平，而基于频率的检测器则表现出更强的泛化能力。

Details

Motivation: 随着AI生成视频视觉质量的提升，区分真实与合成媒体变得日益困难，本文旨在评估现有运动基检测器的鲁棒性，揭示其潜在的偏差和脆弱性。

Result: 在无运动偏差的数据集上，所有运动基检测器性能崩溃至接近随机水平；通过数据集重平衡和简单空间增强，所有模型性能严重下降；而频率基检测器在所有数据集上保持强劲性能。

Insight: 论文创新点在于系统揭示了运动基检测器对数据集特定运动模式的依赖和由此产生的捷径学习问题，并指出频率基方法可能提供更通用的检测路径，强调了开发无偏数据集和鲁棒评估协议的重要性。

Abstract: The visual quality of AI-generated videos has improved drastically in recent years, making it increasingly difficult for humans to distinguish between real and synthetic media. In this work, we evaluate the robustness and applicability of four state-of-the-art motion-based AI-generated video detectors. We identify significant preprocessing and sampling biases in these methods and demonstrate that they account for a substantial portion of their reported performance. Furthermore, we find that these detectors are highly sensitive to motion patterns specific to their evaluation datasets, where AI-generated videos generally exhibit less inter-frame movement than real videos. We show that for all detectors, performance collapses to near-random levels when evaluated on a dataset that does not contain this motion bias. Additionally, through dataset rebalancing and the application of simple spatial augmentations, we observe severe performance degradation across all evaluated models. In contrast, we find that an existing frequency-based detector maintains strong performance across all evaluated datasets, suggesting that frequency-based approaches may offer a more generalizable path forward for AI-generated video detection. We hope that our work raises awareness towards these vulnerabilities and encourages the development of more representative, unbiased datasets and more robust evaluation protocols.

[91] GaussianEmoTalker: Real-Time Emotional Talking Head Synthesis with Audio-Driven and Blendshape-Based 3D Gaussian Splatting cs.CVPDF

Haijie Yang, Zhenyu Zhang, Yixuan Dong, Jianjun Qian, Jian Yang

TL;DR: 本文提出了GaussianEmoTalker，一个基于3D高斯泼溅的音频驱动实时情感说话头合成框架。它将情感动画建模为一个中性到情感的残差变形问题，通过构建身份特定的中性说话空间，并预测情感条件残差变形，实现了高质量、口型同步、情感可控且实时的合成效果。

Details

Motivation: 解决现有音频驱动说话头合成方法在生成具有可控强度的表达性情感化身方面存在的挑战，特别是在实时性约束下，难以同时保证高质量、准确口型同步和情感可控性。

Result: 大量实验表明，与近期的情感说话头方法相比，GaussianEmoTalker在视频质量、口型同步准确性、情感表达可控性和实时渲染方面均取得了有竞争力的结果。

Insight: 主要创新点在于将情感动画定义为中性到情感的残差变形问题，并引入了空间-音频-情感注意力模块来融合异构信号，以估计高斯属性的偏移，从而实现表达丰富且时间稳定的渲染。该方法将情感强度编码与中性运动基分离，提供了更精细的控制能力。

Abstract: Audio-driven talking head synthesis has achieved impressive progress in lip synchronization and visual quality, yet generating expressive emotional avatars with controllable intensity remains challenging, especially under real-time constraints. In this paper, we present GaussianEmoTalker, an audio-driven framework for real-time emotional talking head synthesis based on 3D Gaussian Splatting. Instead of directly predicting the final emotional avatar from speech, we formulate emotional animation as a neutral-to-emotional residual deformation problem. GaussianEmoTalker first constructs an identity-specific neutral talking space with GaussianBlendshapes, which provides high-fidelity Gaussian attributes and phoneme-synchronized neutral motion. It then predicts an emotion-conditioned residual deformation by combining mesh displacement cues, audio features, emotion categories, and intensity encodings. To fuse these heterogeneous signals, we introduce a spatial-audio-emotion attention module that estimates the offsets of Gaussian attributes for expressive and temporally stable rendering. Extensive experiments demonstrate that GaussianEmoTalker achieves competitive video quality, accurate lip synchronization, controllable emotional expression, and real-time rendering compared with recent emotional talking head methods. Our project page is available at https://njust-yang.github.io/GaussianEmoTalker.github.io/

[92] GMO-E$^2$DIT: Grounded Multi-Operation Editing for E-Commerce Images cs.CVPDF

Zipeng Guo, Xiaoan Liu, Lichen Ma, Cheng Wang, Yu He

TL;DR: 本文提出GMO-E^2DIT，一个用于电子商务图像编辑的智能体框架，通过结合视觉语言模型（VLM）和掩码条件图像编辑器，将复杂的多操作编辑任务分解为规划、执行和反思的迭代过程，以解决现有单步编辑模型在局部、可审计的多操作编辑中常出现的部分执行失败问题。

Details

Motivation: 现实世界的电子商务图像编辑通常需要多个局部且可审计的操作，而非全局风格化，现有的一步式编辑模型将意图解析、空间定位和合成合并为单一步骤，容易导致部分编辑失败，这在商业场景中是不可接受的。

Result: 在提出的EComEditBench基准上进行广泛实验，结果表明GMO-E^2DIT与强大的闭源模型相比具有竞争力，在指令准确性和编辑保真度上优于现有基线。

Insight: 创新点在于将编辑任务解耦为认知推理（由VLM代理进行区域锚定的编辑议程规划）和生成渲染（通过操作感知掩码和参考执行），并引入反思驱动的循环来检查中间结果和确定后续状态，这种迭代机制能可靠地保留部分进度、重试未完成操作并从错误中恢复。

Abstract: Real-world e-commerce image editing often requires multiple, localized, and auditable operations rather than global restyling. This compositional nature poses a dual challenge: models must precisely apply all requested edits to the correct regions while preserving unmodified content, even under ambiguous instructions. Existing one-shot editors conflate intent resolution, spatial grounding, and synthesis into a single step, frequently resulting in partial execution failures, which is unacceptable for commercial scenarios. To address this, we introduce GMO-E$^2$DIT, an agentic editing framework that couples a Vision-Language Model (VLM) with a mask-conditioned image editor to tackle structured multi-turn task completion. Given an underspecified instruction, the VLM agent constructs a region-grounded edit agenda, effectively decoupling cognitive reasoning from generative rendering. The framework then executes sub-programs via operation-aware masks and references, utilizing a reflection-driven loop to inspect intermediate results and determine the subsequent state. This iterative mechanism reliably preserves safe partial progress, retries unfinished operations, and recovers from errors. Furthermore, we develop a unified data pipeline providing aligned supervision for planning, execution, and reflection, alongside EComEditBench, a comprehensive benchmark for instruction-driven evaluation. Extensive experiments demonstrate that GMO-E$^2$DIT achieves competitive performance compared to strong closed-source models, yielding superior instruction accuracy and edit fidelity over existing baselines.

[93] EchoRisk: A Multicentre Echocardiography Dataset and Benchmark for Cardio-Oncology cs.CV | cs.AIPDF

Grigorios Kalliatakis, Georgia Karanasiou, Georgios Manikis, Manolis Tsiknakis, Dimitrios Fotiadis

TL;DR: 本文介绍了EchoRisk，这是首个用于心脏肿瘤学研究的、经过精心整理的多中心纵向超声心动图数据集，并发布了EchoRisk-MICCAI 2026挑战赛的技术基准。该数据集包含来自欧洲五个中心的422名患者，提供了2,159个超声心动图视频，并定义了三个临床任务：从视频自动估计左心室射血分数、从纵向影像对左心室功能障碍进行分类，以及仅从治疗前基线超声心动图早期预测治疗引起的心脏毒性。

Details

Motivation: 解决乳腺癌患者治疗引起的心脏毒性这一主要非肿瘤性治疗中断原因，目前从常规心脏影像进行早期自动化风险分层仍是一个未解决的问题。

Result: 使用基于Kinetics-400预训练权重的R(2+1)D视频骨干网络和LSTM聚合建立了基线性能，在心脏功能评估和左心室功能障碍分类任务上表现出强大的判别性能，但仅从单个治疗前视频进行早期心脏毒性预测仍是一个显著的开放性问题。

Insight: 创新点在于发布了首个带有明确心脏毒性标签的多中心纵向超声心动图数据集，并定义了三个具有临床基础的基准任务，为心脏肿瘤学领域的进一步研究、模型比较和特定任务架构开发提供了公开的基准平台。

Abstract: Therapy-induced cardiotoxicity is the leading non-oncological cause of treatment interruption in breast cancer patients, yet early, automated risk stratification from routine cardiac imaging remains an unsolved problem. We present EchoRisk, the first curated, multicentre, longitudinal echocardiography dataset with explicit cardiotoxicity labels, released as the primary technical reference for the EchoRisk-MICCAI 2026 challenge. The dataset comprises 422 patients enrolled in the EU-funded CARDIOCARE prospective study across five European sites, yielding 2,159 echocardiography videos across 1,123 clinical exams acquired at up to five longitudinal timepoints, alongside a dedicated cohort of 280 patients with baseline imaging for early cardiotoxicity prediction. Three clinically grounded tasks are defined: automated estimation of left ventricular ejection fraction from cine video (Task 1), classification of LV dysfunction from longitudinal imaging (Task 2), and early prediction of therapy-induced cardiotoxicity from pre-therapy baseline echocardiography alone (Task 3). For each task we specify the evaluation protocol, primary and secondary metrics, and ranking procedure. We establish baseline performance using an R(2+1)D video backbone with LSTM aggregation trained from Kinetics-400 pretrained weights, demonstrating strong discriminative performance for cardiac functional assessment and LV dysfunction classification, while early cardiotoxicity prediction from a single pre-therapy video remains a significant open problem for the community. The dataset, evaluation code, and baseline implementations are publicly available to serve as a benchmark for further collaboration, comparison, and the creation of task-specific architectures in cardio-oncology.

[94] QCA: Query- and Content-Aware Keyframe Selection for Long Video Understanding cs.CVPDF

Jun Peng, Baiyang Song, Jie Li, Hui Li, Yiyi Zhou

TL;DR: 本文提出了一种名为QCA的查询与内容感知关键帧选择框架，用于解决长视频理解中因时间冗余导致的处理效率低下问题。该方法通过联合建模查询相关性和内容偏差来估计视频片段的信息贡献度，并动态分配关键帧预算，从而从长视频中选择紧凑且信息丰富的帧集合。

Details

Motivation: 视频理解常因严重的时间冗余而效率低下，密集帧序列处理在语义上低效且计算成本高昂，特别是当只有少量帧与给定查询真正相关时，这一挑战更为突出。

Result: 在多个长视频理解基准测试上的广泛实验表明，该方法达到了最先进的性能并具有很强的泛化能力。例如，在LongVideoBench上，QCA使用128帧达到了67.8%的准确率，而GPT-4o使用256帧为66.7%。

Insight: 创新点在于提出了一种无需额外训练、可无缝集成到现有视频大语言模型中的查询与内容感知关键帧选择框架，其通过动态预算分配和迭代式帧选择来最大化多样性并保持高语义相关性。

Abstract: Video understanding is often plagued by severe temporal redundancy, where processing dense frame sequences is both semantically inefficient and computationally expensive. This challenge is further amplified when only a small subset of frames is truly relevant to the given query. In this paper, we propose a Query- and Content-Aware (QCA) keyframe selection framework that can select a compact yet information-rich set of frames from long videos. QCA first partitions the video into temporal segments and estimates the information contribution of each segment by jointly modeling query relevance and content deviation, and dynamically allocates keyframe budget to each segment. Within each segment, QCA anchors on the most query-relevant frame and iteratively incorporates additional frames to maximize diversity while maintaining high semantic relevance to the query. Crucially, our method requires no additional training and can be seamlessly integrated into existing Video-LLMs. Extensive experiments across multiple long video understanding benchmarks demonstrate that our proposed approach achieves state-of-the-art performance and has strong generalization ability. For instance, QCA achieves 67.8% on LongVideoBench using 128 frames, while GPT-4o achieves 66.7% using 256 frames. Our codes are available in \href{https://github.com/hktk07/QCA}{GitHub}.

[95] AVSR-Diff: Scale-Agnostic Diffusion Priors for Temporally Consistent Arbitrary-Scale Video Super-Resolution cs.CVPDF

Geunhyuk Youk, Jeonghyeok Do, Dayeon Kim, Jihyong Oh, Munchurl Kim

TL;DR: 本文提出AVSR-Diff，一种用于任意尺度视频超分辨率的解耦框架，它结合了扩散先验与连续坐标渲染，以解决现有方法在大尺度因子下的过度平滑和时间闪烁问题。

Details

Motivation: 动机在于现有扩散模型视频超分辨率方法受限于固定上采样尺度，而基于坐标的任意尺度方法在大缩放因子下存在严重过度平滑，且结合生成先验时因扩散采样的随机性导致严重的时间闪烁。

Result: 大量实验表明，AVSR-Diff在各种尺度上均能保持高频细节和强时间稳定性，超越了最先进的任意尺度基线方法，甚至在其原生分辨率上优于最近的固定尺度生成模型。

Insight: 创新点包括将尺度无关的潜在去噪与连续坐标渲染解耦以避免计算密集的分辨率特定采样，引入时间门控特征循环（TGFR）模块提取严格对齐的时间一致潜在先验，以及设计包含尺度感知傅里叶细化（SAFR）模块的连续视频VAE解码器来动态适应任意目标尺度的频率分量。

Abstract: Diffusion models have significantly advanced video super-resolution (VSR) but remain largely constrained to fixed upsampling scales. Conversely, while coordinate-based arbitrary-scale VSR methods offer scale flexibility, they inherently suffer from severe over-smoothing at large scaling factors. Integrating generative priors with continuous decoding is promising but currently hindered by severe temporal flickering caused by the stochasticity of diffusion sampling. To address this, we propose AVSR-Diff (Arbitrary-scale Video Super-Resolution with Diffusion), a novel decoupled framework that separates scale-agnostic latent denoising from continuous coordinate rendering, effectively avoiding computationally heavy resolution-specific sampling. Our approach introduces a Temporally-Gated Feature Recurrence (TGFR) module to extract strictly aligned, temporally consistent latent priors. Furthermore, we design a continuous video VAE decoder incorporating a Scale-Aware Fourier Refinement (SAFR) module to dynamically adapt frequency components to any target scale. Extensive experiments demonstrate that AVSR-Diff consistently preserves high-frequency details and strong temporal stability across various scales, surpassing state-of-the-art arbitrary-scale baselines. Remarkably, our framework outperforms recent fixed-scale generative models even on their native resolution.

[96] SuperFlex: Deformable Superquadrics for Point Cloud Decomposition cs.CVPDF

Gabriel Tavernini, Elisabetta Fedele, Tiago Novello, Leonidas Guibas, Marc Pollefeys

TL;DR: SuperFlex提出了一种增强的可变形超二次曲面框架，用于点云分解。它通过引入新的损失函数显著提高重建精度，并加入弯曲和锥形变形以表示弯曲和非对称几何形状，同时利用高质量分解作为监督训练模型，使其对部分点云具有鲁棒性。

Details

Motivation: 现有超二次曲面方法存在重建精度有限、仅限于刚性基元以及对部分点云缺乏鲁棒性的问题，SuperFlex旨在扩展超二次曲面分解的表达能力和适用性。

Result: 实验表明，SuperFlex在重建精度上相比基于优化和学习的基线方法有显著提升，同时保持了高度紧凑的基元表示。

Insight: 创新点包括新颖的损失函数设计、引入弯曲和锥形变形以增强几何表示能力，以及利用高质量分解作为监督信号来提高对部分点云的鲁棒性，这些方法提升了超二次曲面在复杂3D形状建模中的实用性。

Abstract: Superquadrics have proven to provide a compact, geometrically meaningful representation for 3D objects. However, existing methods suffer from limited reconstruction accuracy, are restricted to rigid primitives, and lack robustness to partial point clouds. In this work, we present SuperFlex, an enhanced framework that expands the expressive power and applicability of superquadric decompositions. First, we introduce a novel loss formulation which significantly improves reconstruction accuracy. Second, we include bending and tapering deformations, enabling high-fidelity representation of curved and asymmetric geometries. Finally, we leverage these high-quality decompositions as supervision to train a model that is robust to partial real-world point clouds. Experiments demonstrate substantial improvements in reconstruction accuracy over both optimization- and learning-based baselines while maintaining a highly compact primitive representation.

[97] GenAU: Language-Grounded Industrial Anomaly Understanding with Vision-Language Models cs.CVPDF

Hongkuan Zhou, Tristan Rehm, Nadeem Nazer, Lavdim Halilaj, Jingcheng Wu

TL;DR: 本文提出了GenAU，一个基于视觉语言模型的通用工业异常理解框架，旨在统一图像级异常检测、像素级分割、多类型异常识别和缺陷分析等任务。该方法通过引入两个分割token来生成语言引导的查询，从而在单一指令跟随模型中实现像素级定位和结构化缺陷描述。

Details

Motivation: 现有基于CLIP的方法在异常检测和定位方面表现良好，但缺乏语言级别的缺陷理解能力；而指令调优的视觉语言模型虽能描述缺陷，却无法生成像素级分割掩码。因此，需要一种能够同时完成检测、分割、类型识别和缺陷分析的统一框架。

Result: 在VisA和Real-IAD跨数据集基准测试中，GenAU在基于CLIP的零样本方法中取得了最强的图像级检测性能，其分割性能接近但未超越专门的CLIP基线模型。

Insight: 创新点在于将两个分割token（[SEG_defect]和[SEG_normal]）的隐藏状态作为语言引导查询，在多尺度视觉特征上进行像素级定位，并通过联合语言建模和分割目标训练，使单一模型能够覆盖多种异常理解任务，同时实现了零样本多类型检测和基于语言的缺陷分析。

Abstract: Industrial inspection requires more than binary anomaly detection: a practical system should determine whether an anomaly exists, localize the defective region, identify the defect type, and provide interpretable visual evidence. Existing CLIP-based methods detect and localize anomalies well but offer limited language-level defect understanding, while instruction-tuned vision-language models can describe defects but do not natively produce pixel-level masks. We introduce GenAU, a Generalist vision-language framework for industrial Anomaly Understanding that unifies image-level detection, pixel-level segmentation, multi-type anomaly detection, and defect analysis in a single instruction-following model. GenAU augments a vision-language model with two segmentation tokens, [SEG_defect] and [SEG_normal], whose hidden states act as language-grounded queries over multi-scale visual features for pixel-level localization; the image-level score fuses this map with the decoder’s textual normal/defect decision, while the language decoder produces structured defect-aware responses. Trained with a joint language-modeling and segmentation objective, GenAU covers all four tasks within one architecture and recipe, adding zero-shot multi-type detection and language-grounded defect analysis at a quantified cost to detection and segmentation. Across cross-dataset benchmarks, GenAU attains the strongest image-level detection among CLIP-based zero-shot methods on VisA and Real-IAD, with segmentation approaching but not surpassing specialized CLIP baselines.

[98] GeoSearcher: Anchor-Guided Progressive Reasoning for Remote Sensing Visual Grounding with Process Supervision cs.CVPDF

Dianyu Wang, Yidan Zhang, Peirong Zhang, Xuyang Li, Xiaoxuan Liu

TL;DR: 本文提出GeoSearcher方法，用于解决遥感视觉定位任务中因图像分辨率高、目标小、查询复杂导致的挑战。该方法将定位过程重新定义为锚点引导的渐进式推理，并通过两个耦合阶段实现：锚点中心推理监督微调和过程可信的组相对策略优化，在多个基准测试中取得了优于现有方法的性能。

Details

Motivation: 现有基于多模态大语言模型的方法通常将遥感视觉定位视为一步坐标生成任务，这在小目标定位和复杂查询场景下可能导致预测不稳定。本文旨在解决高分辨率遥感图像中目标极小、干扰物多以及查询包含多重线索所带来的挑战。

Result: 在DIOR-RSVG、OPT-RSVG和VRS-Bench基准测试上的大量实验表明，GeoSearcher超越了现有的最先进方法。

Insight: 创新点在于将大规模视觉搜索重新构建为受约束的局部推理过程，通过锚点引导的渐进式推理来整合位置、关系和属性线索，并设计了过程感知奖励和推理信息样本选择器来优化推理行为，专注于对提升渐进推理更有益的样本。

Abstract: Recent multimodal large language models (MLLMs) have shown strong cross-modal understanding and coordinate generation abilities in visual grounding. However, transferring these abilities to remote sensing visual grounding (RSVG) remains challenging. High-resolution remote sensing images usually cover large-scale scenes, where targets are often extremely small and surrounded by numerous visually similar distractors. Meanwhile, queries often contain multiple clues, such as reference objects, spatial relations, and target attributes. Existing MLLM-based methods usually formulate RSVG as one-step coordinate generation, which may lead to unstable predictions for small-object localization and complex queries. To address these challenges, we propose GeoSearcher, which reformulates RSVG as an anchor-guided progressive reasoning process and realizes it through two coupled stages: Anchor-Centric Reasoning Supervised Fine-Tuning (ACR-SFT) and Process-Faithful Group Relative Policy Optimization (PF-GRPO). In ACR-SFT, anchor-centric reasoning data are used to teach the model to represent key visual clues as anchors and progressively integrate location, relational, and attribute clues around them. In PF-GRPO, Process-Aware Reward (PAR) and Reasoning-Informative Sample Selector (RISS) further optimize this reasoning behavior by jointly evaluating key reasoning steps and target localization, while focusing training on samples that are more beneficial for improving progressive reasoning. Through this design, GeoSearcher transforms large-scale visual search into a more constrained local reasoning process. Extensive experiments on DIOR-RSVG, OPT-RSVG, and VRS-Bench show that GeoSearcher outperforms existing state-of-the-art methods. The project will be released at https://github.com/wangdianyu954-xixi/GeoSearcher.

[99] LongVQUBench: Benchmarking Long-Term Video Quality Understanding of Vision-Language Models cs.CV | cs.AIPDF

Arpita Nema, Hanwei Zhu, Xi Zhang, Weisi Lin

TL;DR: 本文提出了LongVQUBench，一个用于评估大型视觉语言模型（LVLMs）长时视频质量理解能力的综合性基准。该基准包含超过1200个多样化的长视频和1500个问题，并设计了三个渐进复杂的评估层级，以系统性地测试模型在不同时间范围和推理深度下的感知能力。在14个SOTA LVLM上的实验表明，随着视频长度和推理复杂度的增加，模型性能显著下降，揭示了它们在长程时间整合和感知归因方面的局限性。

Details

Motivation: 现有视频质量评估基准主要关注短视频片段和孤立的失真类型，忽略了长时内容中固有的时间连续性、累积退化效应和复杂推理需求。为了弥补这一空白，需要建立一个系统性的基准来评估LVLMs的长时视频质量理解能力。

Result: 在14个最先进的大型视觉语言模型上进行的广泛实验表明，随着视频长度和推理深度（从LQU到GQU）的增加，所有模型的性能都出现显著下降。这定量地揭示了当前LVLMs在长程时间整合和复杂感知归因任务上的能力有限。

Insight: 论文的主要创新点在于构建了一个层次化、系统化的长时视频质量理解评估框架（LQU, CQR, GQU），并嵌入了“针状失真问答”范式来探测细粒度检测能力。这为评估LVLMs的时序推理和复杂感知能力提供了一个可解释、分步骤的基准，是迈向系统性评估的重要一步。

Abstract: The evaluation of long-term video quality understanding remains an open challenge for large vision-language models (LVLMs). Existing video quality benchmarks predominantly focus on short clips and isolated distortions, overlooking the temporal continuity, cumulative degradation, and reasoning complexity inherent in long-duration content. To address these limitations, we present LongVQUBench, a comprehensive benchmark for long-term video quality understanding. LongVQUBench contains over 1200 diverse videos spanning movies, documentaries, surveillance footage, egocentric recordings, and animated content, accompanied by 1500 multiple-choice and open-ended questions for validation and testing. To assess perceptual reasoning across different temporal scopes, we introduce three progressively complex evaluation levels: (i) local event quality understanding (LQU) for analyzing localized distortions; (ii) cross-event quality reasoning (CQR) for integrating multiple degraded events; and (iii) global quality understanding (GQU) for holistic perceptual evaluation over extended durations. Furthermore, a needle distortion question-answering (NDQA) paradigm is embedded across all three levels, where spatial or temporal artifacts are sparsely inserted to probe fine-grained detection and reasoning capabilities. Extensive experiments on 14 state-of-the-art LVLMs reveal significant performance degradation with increasing video length and reasoning depth, highlighting their limited capacity for long-range temporal integration and perceptual attribution. We envision LongVQUBench as a foundational step toward the systematic, hierarchical, and explainable evaluation of LVLMs’ long-term video quality understanding.

[100] CPDDNet: Color-Polarization Denoising and Demosaicking Network cs.CVPDF

Qihang Zhang, Yusuke Monno, Masayuki Tanaka, Masatoshi Okutomi

TL;DR: 本文提出了一种名为CPDDNet的联合去噪与去马赛克网络，用于处理彩色偏振滤光阵列（CPFA）传感器捕获的原始马赛克图像。该网络通过一个特征融合模块，在去噪和去马赛克两个阶段保留原始数据的特征，以同时提升图像质量和偏振参数精度。

Details

Motivation: CPFA传感器单次拍摄可同时捕获场景的纹理（颜色强度）和物理（偏振）信息，但其原始马赛克输出存在严重噪声和分辨率损失，尤其在低光条件下。现有方法通常单独处理去噪或去马赛克任务，未能捕捉两者间的耦合关系并忽略了共享的低级特征。

Result: 实验结果表明，CPDDNet在真实数据集上显著提升了图像质量和偏振参数精度，性能优于现有方法。

Insight: 论文的创新点在于提出了一个联合处理去噪和去马赛克的框架，通过特征融合模块在任务间保留并共享低级特征，这有助于更有效地利用CPFA数据的耦合信息，提升整体重建质量。

Abstract: Color-polarization imaging using a color-polarization filter array (CPFA) sensor captures both texture (color intensity) and physical (polarization) information of the scene in a single shot, enabling various applications in computer vision. However, the raw mosaic output from a CPFA sensor often suffers from severe noise and resolution loss, especially under low-light conditions. Existing methods generally focus on either denoising or demosaicking tasks, failing to capture the coupling between them and neglecting shared low-level features. In this paper, we propose a color-polarization denoising and demosaicking network (CPDDNet), which is a joint framework that performs noise removal and CPFA interpolation using a feature fusion module that retains the features from the CPFA raw data at both the denoising and the demosaicking stages. Experimental results demonstrate that CPDDNet significantly enhances image quality and polarization parameter accuracy, outperforming existing approaches on a real dataset.

[101] MoHallBench: A Benchmark for Motion Hallucination in Video Large Language Models cs.CVPDF

Jiale Li, Sihan Chen, Mengyuan Liu

TL;DR: 本文提出了MoHallBench基准，专门用于评估视频大语言模型中的运动幻觉问题，该问题指模型推断视频中不存在的人类动作。基准包含11,306个视频片段和40,493个问答对，涵盖二元选择、多项选择和生成式设置，并引入双向提问协议和偏差感知指标以减少评估偏差。

Details

Motivation: 现有基准主要关注物体幻觉或粗粒度动作感知，而视频特有的运动幻觉问题尚未充分探索，即模型推断视频中未出现的人类动作，因此需要专门基准来诊断此问题。

Result: 在十个近期开源VideoLLM上的实验表明，动作识别性能与抗幻觉能力存在明显解耦，性能好的模型在对抗性负例上表现不佳；其中顺序推理幻觉最为严重，模型倾向于从部分运动线索过度推断预期结果。

Insight: 创新点包括系统评估运动幻觉的三个主要来源（共现先验、顺序推理和相似性混淆），以及引入双向提问协议和偏差感知指标以减少肯定偏差；客观分析认为，该基准揭示了先验知识越强、相似性越细粒度会显著加剧幻觉，为未来评估和缓解运动幻觉提供了基础。

Abstract: Video Large Language Models (VideoLLMs) have shown strong progress in video understanding, yet they still suffer from hallucinations that are inconsistent with visual evidence. Existing benchmarks mainly focus on object hallucination or coarse action perception, leaving a key video-specific problem underexplored: motion hallucination, in which models infer human motions that are absent from the video. We present MoHallBench, a benchmark for diagnosing motion hallucination in VideoLLMs. MoHallBench systematically evaluates three major sources of hallucination: co-occurrence priors, sequential inference, and similarity confusion. It contains 11,306 video clips and 40,493 question-answer pairs, covering binary-choice, multiple-choice, and generative settings. We further introduce a bi-directional questioning protocol with bias-aware metrics to reduce affirmation bias in binary evaluation. Experiments on ten recent open-source VideoLLMs reveal a clear decoupling between action recognition and hallucination resistance, as models that perform well on positive action recognition often fail on adversarial negatives. Among all settings, sequential inference hallucination is the most severe, showing that current models tend to over-infer expected outcomes from partial motion cues. Our analyses further confirm that stronger priors and finer-grained similarity substantially amplify hallucination. We hope MoHallBench can facilitate future evaluation and mitigation of motion hallucination in VideoLLMs.

[102] Autonomous Scientific Discovery via Iterative Meta-Reflection cs.CV | cs.AIPDF

Bingchen Zhao, Sara Beery, Oisin Mac Aodha

TL;DR: 本文提出了DiscoPER，一个由大语言模型驱动的自主科学发现框架，旨在进行开放式研究。该框架通过动态生成和执行代码来探索数据集，无需预先指定研究目标，并引入二阶元反思机制来分析累积发现，从而主动引导假设探索。在iNatDisco多模态生态知识基准测试中，DiscoPER恢复了9个已知模式中的8个，假设支持率达72.7%，优于传统因果发现和LLM引导的基线方法。

Details

Motivation: 当前自主科学发现系统通常局限于受限的搜索空间或需要预定义研究问题，缺乏真正的开放式探究能力，且难以综合累积发现以揭示复杂互联现象。本文旨在克服这些限制，实现无需预设目标的开放式探索。

Result: 在iNatDisco基准测试（一个具有从同行评审文献中获取的模式级真实值的多模态生态知识基准）上，DiscoPER恢复了9个已知模式中的8个，假设支持率为72.7%，超越了经典因果发现和LLM引导的基线方法。消融实验表明，DiscoPER能随数据量扩展，并证实了二阶元反思的益处。

Insight: 创新点包括：1) 无需预定义目标的开放式自主研究框架；2) 引入二阶元反思机制，将先验发现作为经验数据进行分析，以识别结构模式、混杂因素和认知差距，从而主动重定向假设探索；3) 结合工具使用扩展搜索空间，能够从多模态源（如图像）中无缝处理和提取信息，探索超出结构化元数据的假设。

Abstract: Autonomous scientific discovery systems offer the potential to accelerate research by automating the process of hypothesis generation and validation. However, current systems operate within constrained search spaces or require predefined research questions, limiting their capacity for true open-ended inquiry. Furthermore, while they generate hypotheses iteratively, they largely lack the ability to explicitly synthesize their own accumulated findings to uncover complex, interconnected phenomena. We introduce DiscoPER, an autonomous large language model-powered framework that conducts open-ended research by dynamically generating and executing code to explore datasets without pre-specified research objectives. To ensure rigorous scientific validity, every proposed discovery must pass statistical testing. To overcome the limitations of isolated search, our framework introduces a second-order reasoning mechanism that periodically analyzes its own accumulated discoveries. By treating prior discoveries as empirical data, DiscoPER identifies structural patterns, confounds, and epistemic gaps, actively redirecting hypothesis exploration toward uncharted regions of the search space. The search space is further expanded by incorporating tool use, enabling the system to explore hypotheses beyond structured metadata by seamlessly processing and extracting useful information from multimodal sources like images. Evaluated on iNatDisco, a new multimodal ecological knowledge benchmark with pattern-level ground truth obtained from peer-reviewed literature, DiscoPER recovers 8 of 9 known patterns with a 72.7% hypothesis support rate, outperforming both classical causal discovery and LLM-guided baselines. Ablations show that DiscoPER scales with more data, and confirms the benefits of second-order meta-reflection.

[103] Perceive-to-Reason: Decoupling Perception and Reasoning for Fine-Grained Visual Reasoning cs.CVPDF

Hongxing Li, Xiufeng Huang, Dingming Li, Wenjing Jiang, Zixuan Wang

TL;DR: 本文提出Perceive-to-Reason（P2R）框架，将细粒度视觉推理解耦为感知和推理两个阶段：首先定位问题相关证据（感知器），然后基于标注图像和裁剪区域回答问题（推理器）。为了对齐这种解耦训练，作者进一步提出PRA-GRPO强化学习策略，仅使用最终答案监督交替进行感知和推理的更新。

Details

Motivation: 解决细粒度视觉推理中关键视觉线索被高分辨率图像淹没的挑战，现有方法通常不显式区分感知与推理，导致性能受限。

Result: 在Qwen3-VL-Instruct-2B/4B/8B基础上构建的P2R模型在多个基准上取得显著提升，特别是P2R-4B在V-Star达到93.2%、HR-Bench-4K达到81.9%、HR-Bench-8K达到80.5%，大幅超越其骨干模型。

Insight: 创新点在于显式解耦感知与推理的两阶段框架，以及仅用最终答案监督的角色感知强化学习策略（PRA-GRPO），为细粒度视觉推理提供了有效的结构化方法。

Abstract: Fine-grained visual reasoning remains challenging for vision-language models, especially when small but critical visual cues are buried in high-resolution images. Existing approaches rely on repeated cropping or test-time visual search to introduce local evidence, but they typically do not explicitly distinguish perception from reasoning. In this paper, we propose Perceive-to-Reason (P2R), a unified framework that formulates fine-grained visual reasoning as a two-stage process: the model first localizes question-relevant evidence as a Perceiver, and then answers the question as a Reasoner based on the annotated image and cropped regions. To better align training with this decoupled formulation, we further introduce Perception-Reasoning Alternating GRPO (PRA-GRPO), a role-aware reinforcement learning strategy that alternates between perception-focused and reasoning-focused updates using only final-answer supervision. Built on top of Qwen3-VL-Instruct-2B/4B/8B, P2R consistently improves performance across model scales. In particular, P2R-4B achieves 93.2% on V-Star, 81.9% on HR-Bench-4K, and 80.5% on HR-Bench-8K, substantially outperforming its corresponding backbone. Further experiments show that the benefits of P2R extend beyond high-resolution benchmarks to broader multimodal reasoning tasks. These results suggest that explicitly decoupling perception from reasoning provides an effective framework for fine-grained visual reasoning.

[104] Ink3D: Sculpting 3D Assets with Extremely Complex Textures via Video Generative Models cs.CVPDF

Yue Han, Chong Li, Zhening Liu, Cong Huang, Fang Deng

TL;DR: Ink3D是一个通过视频生成模型为3D资产合成极其复杂纹理的框架。它首先利用现成的3D生成模型重建几何白模，然后使用条件视频生成模型OrbitPainter生成密集的轨道扫描视频以捕获多视角外观，最后通过神经烘焙模块TextureOptimizer将这些视图整合成连贯的纹理。

Details

Motivation: 现有3D生成模型能合成高质量几何，但由于缺乏大规模、外观丰富的3D训练数据，难以从参考图像中复现复杂纹理；而视觉生成模型（如视频模型）在更大规模数据集上训练，擅长建模复杂视觉模式。本文旨在弥合这一差距。

Result: 论文声称，通过解耦几何与纹理合成并利用大规模预训练视频先验，Ink3D能够实现比先前方法显著更丰富、更忠实的纹理生成。

Insight: 核心创新在于将3D生成与大规模视频生成模型桥接，并提出了OrbitPainter（用于生成密集多视角视频）和TextureOptimizer（用于神经烘焙以整合视图并缓解视频生成导致的几何不一致）两个关键模块，有效利用了2D/视频领域的强大生成先验来增强3D纹理合成。

Abstract: Recent 3D generative models can synthesize high-quality geometry but often struggle to reproduce intricate textures from reference images, largely due to the scarcity of large-scale 3D training data with rich surface appearance. In contrast, visual generative models are trained on datasets several orders of magnitude larger and excel at modeling complex visual patterns. Motivated by this gap, we introduce Ink3D, a framework that bridges 3D generation with large-scale video generative models to synthesize extremely complex textures. Ink3D first reconstructs a white-mesh geometry using an off-the-shelf 3D generation model. It then employs OrbitPainter, a conditional video generative model, to produce dense orbit-scan videos capturing object appearance across viewpoints. To convert these views into coherent textures, we introduce TextureOptimizer, a neural baking module that integrates dense multi-view observations while mitigating geometry inconsistencies arising from video generation. By decoupling geometry and texture synthesis and leveraging large-scale pretrained video priors, Ink3D enables significantly richer and more faithful texture generation than prior approaches.

[105] World from Motion: Generative Dynamic Gaussian Reconstruction from Monocular Video cs.CV | cs.AI | cs.GRPDF

Liyuan Zhu, Shengyu Huang, Amrita Mazumdar, Tianye Li, Zan Gojcic

TL;DR: 本文提出World from Motion方法，能够从单目视频中生成可自由渲染的动态3D高斯表示。该方法通过一个视频模型，利用沿输入和目标相机轨迹编码了外观、几何和3D场景运动的密集像素对齐渲染图，来修正初始重建的渲染伪影并填补缺失区域。在测试时，将模型的生成结果（包括新观察到的区域和运动）提炼回一个一致的高质量动态3D高斯场景表示，从而提升新视角合成和底层3D运动的质量。

Details

Motivation: 解决从单目视频进行动态4D重建时，由于单视角限制导致的渲染伪影、区域缺失以及3D运动估计不准确的问题。

Result: 该方法在4D重建任务上达到了新的SOTA水平，并在具有大视角变化和动态运动的真实世界视频上实现了无缝泛化。

Insight: 核心创新在于构建了一个包含对齐多视角视频对和动态3DGS表示的数据集来训练视频模型，并通过知识蒸馏将模型的生成结果提炼回一个一致的高质量动态3DGS表示，从而同时优化了渲染质量和3D运动估计。

Abstract: We present World from Motion, a method for generating freely renderable dynamic 3D Gaussian representations from monocular videos. Our approach conditions a video model on dense, pixel-aligned renderings that encode appearance, geometry, and 3D scene motion along both input and target camera trajectories to correct rendering artifacts and fill in missing regions from an initial reconstruction. To train this model, we construct a dataset of aligned multiview video pairs and dynamic 3DGS representations, with simulated artifacts characteristic of monocular reconstruction. At test time, we distill the model’s generations, including newly observed regions and motions, back into a single consistent, high-quality dynamic 3DGS, improving both novel-view synthesis and the underlying 3D motion. Our method sets a new state of the art in 4D reconstruction and seamlessly generalizes to in-the-wild videos with large viewpoint changes and dynamic motions.

cs.RO [Back]

[106] Learning Dexterous Manipulation Using Contact Wrench Guidance From Human Demonstration cs.RO | cs.AI | cs.CVPDF

Xinghao Zhu, Zixi Liu, Shalin Jain, Chenran Li, Milad Noori

TL;DR: 本文提出了一种名为CHORD的框架，用于通过强化学习实现灵巧机器人对刚体和铰接物体的长时程操作。其核心思想是利用物体中心的接触力/力矩空间指导，将人类和机器人的动作表示为它们对物体施加的力和力矩，从而通过诱导的瞬时运动来衡量相似性。该框架在包含4,739个双手灵巧操作任务的大规模仿真基准上进行了评估，并展示了在仿真和真实世界中的泛化能力。

Details

Motivation: 灵巧机器人操作可以从丰富的人类演示中受益，但将此类演示转移到机器人策略中仍然具有挑战性。本文旨在解决接触丰富的灵巧操作任务中，强化学习难以规模化的问题。

Result: 在构建的包含4,739个任务的大规模仿真基准上，对其中1,831个任务进行评估，CHORD的平均成功率达到82.12%，展示了强大的可扩展性。在从仅手部演示和第三人称演示到全身操作的泛化任务中，成功率达到90.77%，并且学习到的策略在开环和闭环设置下都能迁移到真实世界。

Insight: 主要创新点在于提出了物体中心的接触力/力矩空间指导，将动作相似性度量建立在物体受力（即诱导的瞬时运动）而非关节轨迹上，这为接触丰富的灵巧操作提供了更本质和可扩展的指导信号。此外，构建的大规模仿真基准也为该领域的研究提供了重要的评估工具。

Abstract: Dexterous robot manipulation can benefit from the abundance of human demonstrations, but transferring such demonstrations to robot policies remains challenging. We present Contact Wrench Guidance from Human Demonstration in Robotic Dexterous Manipulation (CHORD), a framework for long-horizon manipulation of rigid and articulated objects with reinforcement learning. The key idea is object-centric contact wrench space guidance: we represent human and robot motions by the forces and torques they can induce on the object, enabling similarity to be measured by the induced instantaneous motions. This guidance makes reinforcement learning more scalable for contact-rich dexterous manipulation. We further introduce a large-scale simulation benchmark with 4,739 bimanual dexterous manipulation tasks, constructed from motion-capture datasets and reconstructed in-house videos. Evaluated on 1,831 benchmark tasks, CHORD achieves an average success rate of 82.12%, demonstrating strong scalability. CHORD also generalizes to whole-body manipulation from hand-only and third-person demonstrations, achieving a 90.77% success rate, and the learned policies transfer to the real world in both open-loop and closed-loop settings.

[107] 3D Point World Models: Point Completion Enables More Accurate Dynamics Learning cs.RO | cs.CVPDF

Skand Peri, Hung Nguyen, Chanho Kim, Li Fuxin, Stefan Lee

TL;DR: 这篇论文提出了3D点云世界模型（3DPWM），一种任务无关的世界模型，通过先补全部分点云，然后在补全后的3D场景中学习动作条件动力学，以解决现有基于视频或部分点云的动力学模型在几何一致性和长期预测方面的不足。

Details

Motivation: 现有基于视频的动力学模型缺乏明确的3D空间结构，导致长期预测存在几何不一致和误差累积；而基于部分点云的3D动力学模型则对遮挡和预测漂移敏感。论文旨在构建一个在3D空间中运行、几何一致且能支持长期可靠预测的世界模型。

Result: 在不同机器人平台和桌面操作基准测试上的实验表明，3DPWM实现了显著更可靠的长期预测（100-300+步），支持开环和闭环规划，并成功实现了从仿真到现实的迁移。

Insight: 核心创新点在于将点云补全作为动力学学习的前置步骤，通过操作补全后的几何体来提升长期预测的准确性和规划成本评估的可靠性。这为构建几何一致的3D世界模型提供了一种新思路，并展示了其在任务适应和sim-to-real迁移方面的潜力。

Abstract: Learning predictive models of the world enables robotic control through planning, potentially allowing robots to improvise solutions on new tasks. However, large video-based dynamics models lack explicit 3D spatial structure and suffer from geometrically inconsistent long-term rollouts with compounding errors. Emerging 3D dynamics models based on partial point clouds improve geometric consistency but remain sensitive to occlusions and accumulated prediction drift. To address these challenges, we present 3D Point World Models (3DPWM) - a task-agnostic world model that operates entirely in 3D space by first completing partial point clouds and then learning action-conditioned dynamics in this completed 3D scene. By operating on completed geometry, 3DPWM enables reliable long-horizon rollouts and more accurate cost evaluation for model-based planning while supporting adaptation to new tasks. Experiments across different robotic embodiments and tabletop manipulation benchmarks demonstrate that 3DPWM achieves significantly more reliable long-horizon rollouts (100-300+ steps), supports both open-loop and closed-loop planning, and enables successful sim-to-real transfer.

[108] What’s Hidden Matters: Identifying Planning-Critical Occluded Agents using Vision-Language Models cs.RO | cs.AI | cs.CVPDF

Amirhosein Chahe, Tyler Naes, Jovin D’sa, Faizan M. Tariq, Sangjae Bae

TL;DR: 该论文提出了一种利用视觉语言模型（VLM）识别自动驾驶中规划关键被遮挡智能体的新框架。通过引入规划KL散度（PKL）这一信息论度量来系统性地识别和排序被遮挡智能体对自车轨迹的影响，并利用专家VLM（GPT-5）生成结构化标注数据。在nuScenes数据集上构建了新基准，并通过实验证明，基于PKL引导数据微调的模型性能显著提升，较小模型甚至能超越更大的零样本模型。

Details

Motivation: 当前自动驾驶系统在处理遮挡时，要么对所有遮挡采取统一的保守策略导致不必要的防御性驾驶，要么仅推断隐藏空间而不评估其对规划的影响。本文旨在弥合感知与规划之间的关键鸿沟，使VLM能够识别并推理对自车轨迹最关键的被遮挡智能体。

Result: 在nuScenes数据集上构建了专注于高影响场景的新基准。实验表明，在所有通用和领域自适应VLM上，基于PKL引导数据微调均带来显著性能提升；较小的微调模型显著优于更大的零样本模型；PKL引导的数据选择策略比随机采样性能提升约30%。

Insight: 创新点在于首次系统性地利用信息论度量PKL来量化被遮挡智能体对规划的影响，并以此引导VLM的训练数据生成和选择，实现了更语义化、高效的风险评估。这为自动驾驶的感知-规划联合优化提供了新思路，即通过任务感知的指标来指导模型关注对决策最关键的信息。

Abstract: Autonomous vehicles must safely navigate complex environments where planning-critical agents may be hidden from view. Current approaches often treat all occlusions with uniform conservatism, yielding needlessly defensive driving, or they infer hidden spaces without estimating the impact on the planner. This work bridges the critical gap between perception and planning by enabling Vision-Language Models (VLMs) to identify and reason about the specific hidden agents that are most critical to the ego-vehicle’s trajectory. We introduce a novel framework that uses Planning KL-divergence (PKL), an information-theoretic metric, to systematically identify and rank occluded agents based on their impact on the ego vehicle’s plan. Using this planning-aware ranking, we employ an expert VLM (GPT-5) to generate rich, structured annotations that capture the visual evidence and reasoning required for this task. We apply this framework to the nuScenes dataset to create a new benchmark focused on high-impact scenarios. We conduct comprehensive experiments on a wide range of general-purpose and domain-adapted VLMs, demonstrating that fine-tuning on our PKL-guided data yields dramatic performance improvements across all models. Notably, our results show that smaller, fine-tuned models significantly outperform their much larger zero-shot counterparts, and that our PKL-guided data selection strategy improves performance by approximately 30% over random sampling. Our work presents the first systematic approach for training VLMs to focus on planning-critical occlusions, enabling more semantically grounded and efficient risk assessment in autonomous driving.

[109] Domain Arithmetic: One-Shot VLA Adaptation under Environmental Shifts cs.RO | cs.CV | cs.LGPDF

Taewook Kang, Taeheon Kim, Donghyun Shin, Jonghyun Choi

TL;DR: 本文提出了一种名为Domain ARiThmetic (DART)的基于类比的方法，用于在环境变化（如相机姿态或机器人本体变化）下，仅需单个演示即可高效适应视觉-语言-动作模型。该方法通过权重向量算术和子空间对齐来隔离并添加领域特定信息，从而减少数据收集和训练负担。

Details

Motivation: 解决视觉-语言-动作模型在环境变化下性能下降的问题，传统适应方法需要为每个任务收集多个演示，成本高昂，因此需要一种更高效的少样本适应方法。

Result: 在模拟和真实世界实验中，DART在多种视觉和本体变化下的一次性适应场景中，优于现有的VLA适应方法。

Insight: 创新点在于通过权重向量算术和子空间对齐来精确隔离领域特定信息，实现仅需单个演示的高效模型适应，这为少样本领域适应提供了新思路。

Abstract: Vision-Language-Action (VLA) models often fail to perform the same learned tasks under environmental shifts, such as changes in camera pose and shifts to a different but similar robot (e.g., from Panda to UR5e). Adapting these models to the shifted environment (i.e., target domain) often requires training on multiple demonstrations for each task, which are costly to collect. To reduce the burden of data curation and training, we propose an analogy-based method that adapts VLA models under environmental shifts through weight vector arithmetic with domain-specific information addition, named Domain ARiThmetic (DART). Unlike prior approaches, DART requires collecting only a single demonstration, enabling efficient adaptation. To accurately isolate domain-specific information for addition, DART performs subspace alignment between singular components in weight vectors to filter out noisy components. In both simulated and real-world experiments, DART outperforms existing VLA adaptation methods in one-shot scenarios across diverse visual and embodiment shifts. Code is available at https://github.com/snumprlab/dart.

[110] Human-Centric Transferable Tactile Pre-Training for Dexterous Robotic Manipulation cs.RO | cs.CVPDF

Chi Zhang, Penglin Cai, Ziheng Xi, Haoqi Yuan, Hao Luo

TL;DR: 本文提出了一种名为H-Tac的大规模触觉-动作数据集，包含160小时的人类第一视角视频，涵盖300多个任务和13.5万个片段。基于此，作者提出了可迁移触觉预训练（TTP）系统，利用人类数据进行触觉预训练，以提升机器人精细操作任务的性能。通过统一的触觉和动作空间以及触觉专家模型进行未来触觉预测，该框架显式建模接触动力学，在仿真和真实机器人实验中表现出优异的泛化能力和精细操作性能。

Details

Motivation: 现有触觉数据集规模小、接触覆盖窄，且视觉-语言-动作（VLA）模型在触觉模态上仅限于动态无关的后训练，限制了下游任务性能的上限。本文旨在通过大规模人类触觉数据预训练来弥补这一差距。

Result: 在仿真和真实机器人上的大量实验表明，该模型实现了卓越的性能，展现出强大的泛化能力和精细操作能力。

Insight: 创新点在于构建了大规模人类触觉数据集H-Tac，并提出了TTP预训练框架，通过统一触觉/动作空间和触觉专家预测来桥接人类与机器人之间的差距，显式建模接触动力学，实现了从人类到机器人的可迁移、可扩展的触觉预训练。

Abstract: As an essential modality for dexterous and contact-rich tasks, tactile sensing provides precise force feedback that cannot be reliably inferred from vision. However, limited by hardware and data collection systems, existing datasets with tactility remain small in scale and narrow in contact coverage. Meanwhile, Vision-Language-Action (VLA) models with tactile modality are constrained on dynamics-agnostic post-training, which limits the performance ceiling on downstream tasks. In this paper, we present H-Tac, a large-scale tactile-action dataset with 160-hour egocentric human videos containing more than 300 tasks and 135k episodes. Building upon this, we propose Transferable Tactile Pre-Training (TTP), a system of tactile-based pre-training on human data for fine-grained robotic tasks. To bridge the gap between humans and robots, we use unified tactile and action spaces throughout the pre-training and post-training phases, preserving prior knowledge during human-to-robot transfer. By leveraging a tactile expert for future tactile prediction, our framework explicitly models the contact dynamics and precise physical interactions. Extensive experiments in simulation and on real robots demonstrate that our model achieves superior performance, exhibiting robust generalization and fine-grained manipulation capabilities. TTP paves the way for scalable tactile pre-training via human-to-robot transfer.

[111] Structured 4D Latent Predictive Model for Robot Planning cs.RO | cs.CVPDF

Zhiyi Li, Peilin Wu, Xiaoshen Han, Ruojin Cai, Yilun Du

TL;DR: 本文提出了一种结构化4D潜在预测模型，用于机器人规划。该模型在结构化潜在空间中预测场景3D结构的演化，并结合文本指令进行条件化，能够解码为多种3D格式，以实现更完整和3D一致的场景理解。该模型作为规划器生成未来场景，并通过目标条件逆动力学模块转化为可执行动作。

Details

Motivation: 现有视频预测模型通常基于2D视频序列，缺乏精确空间推理和物理一致性所需的3D几何理解。本文旨在解决这一问题，为机器人规划提供具有3D几何一致性的预测能力。

Result: 实验表明，该模型生成的未来场景具有出色的视觉质量，在3D一致性和多视图连贯性方面显著优于最先进的基于视频的规划器。完整的规划流程在复杂操作任务上实现了优越性能，对新视觉条件表现出鲁棒的泛化能力，并在真实世界机器人平台上验证有效。

Insight: 创新点在于将4D（3D+时间）预测引入结构化潜在空间，实现条件化、可解码的3D一致场景演化表示。这为机器人规划提供了更强大的几何基础，将感知、预测与行动生成统一起来。

Abstract: Video predictive models are emerging as a powerful paradigm in robotics, offering a promising path toward task generalization, long-horizon planning, and flexible decision-making. However, prevailing approaches often operate on 2D video sequences, inherently lacking the 3D geometric understanding necessary for precise spatial reasoning and physical consistency. We introduce a Structured 4D Latent Predictive Model, which predicts the evolution of a scene’s 3D structure in a structured latent space conditioned on observations and textual instructions. Our representation encodes the scene holistically and can be decoded into diverse 3D formats, enabling a more complete and 3D consistent scene understanding. This structured 4D latent predictive model serves as a planner, generating future scenes that are translated into executable actions by a goal-conditioned inverse dynamics module. Experiments demonstrate that our model generates futures with strong visual quality, substantially better 3D consistency and multi-view coherence compared to state-of-the-art video-based planners. Consequently, our full planning pipeline achieves superior performance on complex manipulation tasks, exhibits robust generalization to novel visual conditions, and proves effective on real-world robotic platforms. Our website is available at https://structured-4d-model.github.io/.

cs.MM [Back]

[112] Vertigo Vertigo: Reconstructing a Cinematic Ideal through its Predictive AI Double cs.MM | cs.CV | cs.GRPDF

Adam Cole, Mick Grierson

TL;DR: 论文《Vertigo Vertigo》利用仅占原片2.78%的关键帧，通过大型视频扩散模型进行首尾帧插值，生成了对希区柯克电影《迷魂记》的逐场景AI重建。该工作不仅展示了重建在结构上的高保真度（73.1%的帧被识别为可信的《迷魂记》再现），更将其作为一种媒介批判工具，探讨生成式AI如何内化并加速经典电影的规范与逻辑。

Details

Motivation: 动机在于探索生成式AI系统如何内化和编码经典电影的规范性惯例，并利用《迷魂记》这部关于痴迷重建人工理想的电影作为文化探针，将这种逻辑延伸到电影的物质性本身。

Result: 通过计算分析和媒介理论家的批判性反馈进行评估，重建作品显示出显著的结构保真度：73.1%的帧被识别为《迷魂记》的合理再现，仅3.6%的帧出现灾难性失败。这暗示电影规范被深度压缩在模型的潜在先验中。

Insight: 创新点在于将极稀疏的关键帧（2.78%）与视频扩散模型结合，用于对经典电影进行高保真度的逐场景重建，并以此作为媒介批判的方法论。核心见解是生成式媒体并非电影范式的转变，而是对其欲望逻辑和虚假真实性的加速，将经典好莱坞的规范延伸至重塑当代感知的预测性媒体环境中。

Abstract: Vertigo Vertigo is a scene-for-scene AI reconstruction of Hitchcock’s Vertigo (1958), generated from only 2.78% of the original film’s frames. Using this sparse set of keyframe anchors, we perform first-last frame interpolation via a large video diffusion model to predict the intervening sequences. Vertigo is itself a film about the obsessive reconstruction of an artificial ideal; Vertigo Vertigo extends this logic to the material of the film, treating the canonical text as a probe for the normative conventions of classical cinema encoded within generative systems. Evaluated through computational analysis and critical feedback from media theorists (Lev Manovich, Shane Denson, Kevin L. Ferguson), the artifact demonstrates remarkable structural fidelity: 73.1% of frames are recognizable as plausible renditions of Vertigo and only 3.6% fail catastrophically. This fidelity suggests that cinematic norms are deeply compressed within the model’s latent priors. Aesthetically, the reconstruction is rendered as an unstable overlay between the original film and its predictive shadow, fueling a persistent doubt in the viewer’s perception of authenticity – a 21st-century vertigo. The work argues that generative media is not a paradigm shift from cinema but an acceleration of its logic of desire and false authenticity, extending from classical Hollywood through to the predictive media environments now reshaping contemporary perception.

cs.HC [Back]

[113] Surfacing Variations to Calibrate Perceived Reliability of MLLM-generated Image Descriptions cs.HC | cs.CL | cs.CVPDF

Meng Chen, Akhil Iyer, Amy Pavel

TL;DR: 这篇论文探讨了如何通过系统性地呈现多模态大语言模型（MLLM）生成图像描述中的变体，来帮助盲人和低视力（BLV）用户校准其对MLLM输出可靠性的感知。作者提出了一个用于引发和呈现MLLM描述变体的设计空间，开发了一个实现三种变体呈现风格的原型系统，并通过一项有15名BLV参与者参与的用户研究验证了其有效性。

Details

Motivation: MLLM为BLV人群获取视觉信息提供了新机会，但这些模型常产生难以被无视力用户察觉的错误，在从药物识别到服装选择等场景中带来安全和社交风险。现有解决方案（如跨工具交叉检查、咨询视力正常者）通常耗时且不切实际，因此需要一种无需视觉检查图像就能帮助BLV用户检测不可靠信息的方法。

Result: 用户研究表明，呈现描述变体能显著提高用户识别不可靠主张的能力（与单一描述相比，使用该方法的能力提高了4.9倍），并显著降低了用户对MLLM响应的感知可靠性。15名参与者中有14人更倾向于查看MLLM响应的变体而非单一描述，且所有人都有兴趣在从理解龙卷风路径到社交媒体发图等任务中使用该系统。

Insight: 核心创新点在于提出并验证了通过系统性地呈现MLLM响应的变体（而非单一输出）来帮助BLV用户校准可靠性感知的设计范式。这为提升MLLM在辅助技术中的安全性和实用性提供了一种新颖的、以用户为中心的方法，其设计空间和变体呈现风格具有借鉴意义。

Abstract: Multimodal large language models (MLLMs) provide new opportunities for blind and low vision (BLV) people to access visual information in their daily lives. However, these models often produce errors that are difficult to detect without sight, posing safety and social risks in scenarios from medication identification to outfit selection. While BLV MLLM users use creative workarounds such as cross-checking between tools and consulting sighted individuals, these approaches are often time-consuming and impractical. We explore how systematically surfacing variations across multiple MLLM responses can support BLV users to detect unreliable information without visually inspecting the image. We contribute a design space for eliciting and presenting variations in MLLM descriptions, a prototype system implementing three variation presentation styles, and findings from a user study with 15 BLV participants. Our results demonstrate that presenting variations significantly increases users’ ability to identify unreliable claims (by 4.9x using our approach compared to single descriptions) and significantly decreases perceived reliability of MLLM responses. 14 of 15 participants preferred seeing variations of MLLM responses over a single description, and all expressed interest in using our system for tasks from understanding a tornado’s path to posting an image on social media.

cs.IT [Back]

[114] QuaMoE-DRF: Proactive Beam and Rate Adaptation via Multimodal Dynamic Radio Map Forecasting in ISAC Networks cs.IT | cs.CVPDF

Zhihan Zeng, Kaihe Wang, Zhongpei Zhang, Chongwen Huang

TL;DR: 本文提出了QuaMoE-DRF，一个用于ISAC网络中主动波束和速率自适应的质量感知多模态动态无线电地图预测框架。其核心是预测未来的波束-SINR场，以支持基站、波束、调制编码方案等决策。在动态多基站多用户城市基准测试中，该方法在有效速率、中断概率和地图误差方面均优于基线。

Details

Motivation: 静态无线电地图无法捕捉移动物体造成的短期遮挡，而直接传感辅助的波束预测又因丢弃了SINR余量、MCS阈值等信息而受限。因此，需要一种能够预测动态无线电环境以进行主动自适应的方法。

Result: 在动态多基站多用户城市基准测试中，QuaMoE-DRF实现了402.5 Mbps的有效速率、0.0417的中断概率和0.1836的地图RMSE，相比最强的基线，有效速率提升了5.67%，中断概率降低了8.35%。

Insight: 创新点在于提出了未来波束-SINR场作为核心表示，并设计了质量感知的专家混合模块来融合多模态数据（静态几何、运动观测、传感状态、无线历史），以联合预测通信地图和主动决策。该方法将动态无线电地图预测与具体的通信决策（如基站关联、波束选择）直接结合。

Abstract: Static radio maps provide location-dependent propagation priors, but they cannot capture short-term blockage caused by moving objects. Direct sensing-assisted beam prediction is also limited because a beam index discards SINR margins, MCS thresholds, BS alternatives, and communication-equivalent neighboring beams. This paper proposes QuaMoE-DRF, a quality-aware multimodal dynamic radio map forecasting framework for proactive beam and rate adaptation in ISAC networks. Its core representation is a future beam-SINR field. We show that the full multi-BS beam-SINR field is sufficient for finite-codebook threshold-rate BS, beam, MCS, goodput, and outage decisions. For tractability, the implemented model learns a compact reference-BS local field, complemented by BS-level supervision, joint BS–beam supervision, and latent network context; we also clarify that this compact projection alone is not sufficient for BS association. QuaMoE-DRF fuses static geometry, event-like motion observations, structured sensing states, and wireless history through a quality-aware mixture-of-experts module motivated by inverse-variance fusion under heteroscedastic modality errors. It jointly predicts communication-oriented map channels and proactive BS, beam, and MCS decisions. On a dynamic multi-BS and multi-UE urban benchmark, QuaMoE-DRF achieves 402.5 Mbps effective rate, 0.0417 outage probability, and 0.1836 map RMSE, improving the effective rate by 5.67% and reducing outage by 8.35% over the strongest completed effective-rate baseline. The current validation uses labels from a compact blockage/path-loss simulator, with ray tracing used only for calibration and sanity checking.

physics.med-ph [Back]

[115] Closed-loop coupling of personalised and foundation models for real-time treatment guidance with MRI physics.med-ph | cs.CVPDF

James Grover, Emily A. Hewson, Andrew Phair, Michael Ferraro, Hilary L. Byrne

TL;DR: 本文提出了一种闭环耦合框架，将个性化模型与基础模型相结合，用于MRI引导的实时治疗指导。该框架通过个性化模型预测未来解剖结构以补偿系统延迟，同时利用流式基础模型提供解剖学监督，实时更新预测器。在数字体模和患者MRI数据上的验证表明，该方法在400毫秒预测范围内改善了解剖预测并减少了剂量误差。

Details

Motivation: 图像引导治疗（如放疗）中，成像延迟导致观察到的解剖结构与真实位置存在时间错位，影响治疗精度。现有AI方法中，个性化模型缺乏稳定的解剖学基础，而基础模型无法适应实时个体患者动态，因此需要结合两者优势。

Result: 在数字体模和患者MRI数据上验证，预测范围为400毫秒时，该方法相比现有方法提高了解剖预测准确性，并降低了剂量误差，在临床相关延迟约束内表现优异。

Insight: 创新点在于闭环耦合策略，将个性化时间预测与基础模型的连续解剖解释相结合，实现实时自适应更新；这为实时图像引导干预提供了一种通用框架，可平衡个性化适应与解剖稳定性。

Abstract: Image-guided therapies, including radiotherapy, biopsy and deep brain stimulation, rely on real-time targeting of anatomical structures. However, in the presence of motion, imaging latencies create a temporal misalignment between observed and true anatomy, compromising treatment accuracy. Artificial intelligence-based frameworks have increasingly been presented to close this latency gap, but leading personalised models can fail due to a lack of stable anatomical grounding. Foundation models can provide grounded behaviour, but they do not adapt to real-time, individual patient dynamics. Here we introduce a closed-loop coupling framework that synergises patient-specific temporal prediction with continuous segmentation-based anatomical interpretation from a foundation model. A personalised model predicts future anatomy to compensate for system latency, while a streaming foundation model provides anatomical supervision used to continuously update the temporal predictor in real time during treatment. We validate the framework using a digital phantom and intrafraction magnetic resonance imaging (MRI) from patients undergoing MRI-guided radiotherapy. For a prediction horizon of 400 ms, the proposed method improves anatomical prediction and reduces dosimetric error compared with existing approaches, within clinically relevant latency constraints. These results establish closed-loop coupling as a general strategy for real-time image-guided intervention.

cs.IR [Back]

Runhao Li, Xiaoxu Ma, Zhenyu Weng, Yue Zhang, Guibo Luo

TL;DR: 本文提出了一种名为属性提示核哈希（APKH）的无监督跨模态哈希方法，旨在解决现有方法依赖大规模对齐图像-文本对、易过拟合且泛化能力不足的问题。该方法利用视觉-语言基础模型的广义属性先验，通过上下文优化的属性核映射（CAKM）和核平滑对比对齐（KSCA）两个核心模块，构建紧凑且模态对齐的汉明空间，以在数据受限场景下实现从可见类别到未见类别的有效跨模态检索。

Details

Motivation: 现有无监督跨模态哈希方法严重依赖大规模对齐图像-文本对，收集成本高且在隐私或专业约束下数据稀缺；同时，这些方法容易过拟合于训练数据，对训练数据未覆盖的未见类别泛化性能差。

Result: 大量实验表明，在数据受限场景下，APKH在从可见类别到未见类别的跨模态检索任务中，性能优于最先进的哈希方法（SOTA）。

Insight: 创新点在于利用视觉-语言基础模型的广义属性先验来驱动哈希学习，并通过CAKM模块（基于超球面径向基函数核映射和提示学习优化动态属性核）和KSCA模块（将有限配对数据建模为连续核分布以平滑模态间隙）来增强模态不变语义捕获并缓解对稀疏成对相关性的过拟合，从而提升数据效率和泛化能力。

Abstract: Unsupervised cross-modal hashing enables efficient retrieval of semantically related instances across different modalities without requiring manual semantic annotation. However, existing unsupervised methods rely heavily on large-scale image-text pairs. Collecting such data can be costly, particularly in scenarios where well-aligned pairs are scarce due to privacy and specialized constraints. More critically, existing methods tend to overfit to seen training data, restricting their generalization performance on unseen categories that the constrained training data cannot cover. To address these limitations, we propose Attribute-Prompted Kernel Hashing (APKH), a novel data-efficient approach that constructs a compact, modality-aligned Hamming space driven by the generalized attribute priors of vision-language foundation models. Specifically, APKH introduces two core modules: Context-optimized Attribute Kernel Mapping (CAKM) and Kernel-Smoothed Contrastive Alignment (KSCA). CAKM formulates cross-modal alignment through hyperspherical Radial Basis Function kernel mapping, optimizing dynamic attribute kernels via prompt learning to capture modality-invariant semantics. Furthermore, KSCA extends conventional point-to-point contrastive learning by modeling limited paired data as continuous kernel distributions. This explicit smoothing of the modality gap alleviates overfitting to sparse pairwise correlations. Extensive experiments demonstrate that APKH outperforms state-of-the-art hashing methods in the challenging cross-modal retrieval tasks from seen to unseen categories under data-constrained scenarios.

cs.LG [Back]

[117] GRPO, Dr. GRPO, and DAPO Are Three Operations on One Number: The Group-Standard-Deviation Identity cs.LG | cs.AI | cs.CL | stat.MLPDF

Yong Yi Bay, Kathleen A. Yearick

TL;DR: 本文揭示了三种流行的语言模型推理训练方法（GRPO、Dr. GRPO和DAPO）本质上是调整同一个核心参数——答案分歧度的标准差。论文证明了这三种方法并非独立的技巧，而是基于‘组-标准差恒等式’的三种不同操作设置，该恒等式表明训练更新的幅度直接由组内答案标记（正确/错误）的标准差决定。

Details

Motivation: 动机在于澄清GRPO、Dr. GRPO和DAPO这三种看似不同的训练方法实际上共享同一个数学基础，即通过调整答案分歧的标准差来控制学习过程，解决对这些方法本质理解不清的问题。

Result: 论文在大型真实难度数据集（Big-Math）和受控训练实验中验证了理论直觉，确认了组内答案分歧的标准差直接决定训练更新的强度，其中答案对半分裂的组教学效果最强，而答案一致的组不产生学习。

Insight: 创新点在于提出了‘组-标准差恒等式’，统一解释了三种方法的共同机制，并揭示了对答案分歧度（标准差）的调整是控制学习权重和采样次数的关键拨盘，而非无害的归一化步骤。

Abstract: Three of the most popular methods for training language models to reason look like three different tricks. They are not. All three adjust a single number: standard deviation, reflecting how much a prompt’s sampled answers disagree. When such a model is trained, it answers each problem many times, and an automatic checker marks every answer right or wrong. The standard deviation of those marks measures the disagreement: largest when the answers split evenly between right and wrong, and zero when they all agree. Group Relative Policy Optimization (GRPO) divides by this number, GRPO Done Right (Dr. GRPO) drops the division, and Decoupled Clip and Dynamic Sampling Policy Optimization (DAPO) discards the groups where it is zero. Each is presented as its own fix, yet this paper proves they are three settings of one dial. That dial is not cosmetic: for right-or-wrong rewards, the disagreement is exactly the size of the training update, the group-standard-deviation identity. A split group teaches the most, while a unanimous group teaches nothing and falls silent. The same result says which problems deserve the most weight and how many tries each one needs. This paper confirms the intuition on a large real difficulty dataset (Big-Math) and in a controlled training run. What looks like a harmless normalization step is the dial that decides where learning happens and how strongly.

[118] Testing Frontier Large Language Models’ Physics Literacy in Parallel Physical Worlds cs.LG | cs.AI | cs.CLPDF

Dong Zhang

TL;DR: 本文提出了一种可审计的四阶段诊断方法，用于评估前沿大语言模型在陌生物理框架下的推理能力，包括归纳、公式化、预测和审查四个阶段。该方法应用于三个平行物理世界：单方程反事实世界（F=mv）、历史框架（亚里士多德力学）和四领域反事实世界（衰变世界），测试了Claude Opus 4.7、GPT-5.5和Gemini 3.1 Pro等模型。

Details

Motivation: 当前的大语言模型物理基准通常仅通过答案准确性评分，无法区分真实推理与对熟悉问题模式的回忆，且难以揭示模型推理的薄弱环节。

Result: 在三个平行物理世界中，模型的综合通过率分别为6/15、6/15和0/15（F=mv和亚里士多德世界评估内容和结构，衰变世界仅评估内容）。模型表现出定性与定量的不对称性：在衰变世界中，模型几乎不会预测错误的变化方向，但常因滑回标准物理关系而计算错误的比例。

Insight: 创新点包括引入可审计的四阶段诊断协议，结合预注册、阶段间新会话、双LLM评判和人工审计路径；发现LLM评判的可靠性在不同框架间无法迁移，且模型的自我审查能力薄弱，在至少三分之二的实际错误试验中错误报告无早期错误。

Abstract: Current large-language-model (LLM) physics benchmarks are usually scored by answer accuracy, which cannot distinguish genuine reasoning from recall of familiar problem patterns and reveals little about where a model’s reasoning breaks down. We introduce an auditable four-stage diagnostic that evaluates whether an LLM can reason inside an unfamiliar physics framework through induction, formulation, prediction, and review. The diagnostic combines locked pre-registrations, fresh sessions between stages, dual-LLM judging, and a human-audit pathway, and we apply it to three parallel physics worlds: a single-equation counterfactual world ($F=mv$), a historical framework (Aristotelian mechanics), and a four-domain counterfactual world (Decay World). Across Claude Opus 4.7, GPT-5.5, and Gemini 3.1 Pro, the three worlds yield composite PASS rates are 6/15, 6/15, and 0/15 respectively (content $\land$ structural for $F=mv$ and Aristotelian, content axis only for Decay World where the structural axis is out of scope). The most pointed empirical pattern is a qualitative-versus-quantitative asymmetry: in Decay World, models almost never predict the wrong direction of change, but frequently compute the wrong ratio by slipping back to standard-physics relations. The protocol also surfaces two methodology findings: LLM-judge reliability does not transfer across frameworks, and Stage 4 self-review is weak in every framework, with the model’s own review wrongly reporting no earlier error in at least two-thirds of the trials that actually contained one. We release the full prompts, responses, verdicts, and audit records.

[119] MolSafeEval: A Benchmark for Uncovering Safety Risks in AI-Generated Molecules cs.LG | cs.CLPDF

Tong Xu, Xinzhe Cao, Zhihui Zhu, Keyan Ding, Huajun Chen

TL;DR: 本文提出了MolSafeEval基准，旨在评估和分析AI生成分子的安全性风险。该基准整合了从毒理学数据库到危害规则等异构安全知识，构建了一个结构化的分子安全知识图谱，并利用大语言模型进行推理，以系统性地检测和解释生成化合物中的不安全特征。

Details

Motivation: 当前分子生成基准主要关注任务复杂性、分子新颖性和属性对齐，而普遍忽视了AI生成分子可能具有的毒性、反应性或其他危险特性等潜在安全风险，这一关键问题尚未得到充分解决。

Result: MolSafeEval为无条件生成、属性优化、基于靶蛋白的设计和基于文本的生成这四种代表性分子生成任务类型提供了标准化的数据集和安全评估协议，系统性地揭示了当前生成方法的安全漏洞。

Insight: 创新点在于将异构安全知识整合为结构化知识图谱，并利用LLM进行推理，从而超越了依赖单一毒性预测器的传统方法，为分子模型的基准测试提供了新的视角，并指导更安全、更可信的分子设计。

Abstract: Current molecular generation benchmarks emphasize task complexity, molecule novelty, and property alignment; they largely overlook a critical concern: the potential safety risks of AI-generated molecules. In practice, many generative models may produce molecules with toxic, reactive, or otherwise hazardous characteristics - posing hidden dangers that remain insufficiently addressed. To address this gap, we introduce MolSafeEval, a benchmark dedicated to evaluating and analyzing the safety risks of molecular generation. Unlike prior approaches that rely on narrow toxicity predictors, MolSafeEval integrates heterogeneous safety knowledge - ranging from toxicological databases to hazard rules - into a structured molecular safety knowledge graph. This graph serves as a foundation for large language model-based reasoning, enabling systematic detection and explanation of unsafe features in generated compounds. We further categorize molecular generative models into four representative task types - unconditional generation, property optimization, target protein-based design, and text-based generation - and provide standardized datasets and safety evaluation protocols for each. By systematically revealing the safety vulnerabilities of current generative approaches, MolSafeEval offers a new lens for benchmarking molecular models and provides essential guidance toward safer, more trustworthy molecular design.

[120] QuasiMoTTo: Quasi-Monte Carlo Test-Time Scaling cs.LG | cs.CLPDF

Michael Y. Li, Anthony Zhan, Kanishk Gandhi, Noah D. Goodman, Emily B. Fox

TL;DR: 该论文提出了QuasiMoTTo方法，通过使用准蒙特卡洛（QMC）生成相关但精确的样本来替代传统的独立同分布（i.i.d.）采样，旨在提高语言模型推理计算和强化学习中的样本效率。该方法在多个推理基准测试中，以更少的样本达到了与i.i.d.采样相当的pass@k准确率，并在策略梯度强化学习中减少了所需的训练步骤。

Details

Motivation: 为了解决在扩展语言模型推理计算时，独立并行采样导致计算资源浪费在冗余解决方案上的问题，论文探索了生成相关但精确并行样本的设计空间，以提高样本效率。

Result: 在四个推理基准测试（如GSM8K、HumanEval等）上，QuasiMoTTo以比i.i.d.采样少25-47%的样本量匹配了其pass@k准确率，并经常达到任何保持边缘分布的采样器的理论上限。在策略梯度强化学习（GRPO）中，它仅用50%的训练步数就达到了与i.i.d.相当的性能。

Insight: 创新点在于将自回归采样重新参数化为逆CDF采样，并利用准蒙特卡洛生成更均匀的底层均匀分布，从而以更少的冗余覆盖输出空间。这为高效利用计算资源提供了新途径，特别是在需要高覆盖率的场景如推理和强化学习中。

Abstract: Scaling inference compute, by generating many parallel attempts per problem, is a costly but reliable lever for improving language model capabilities. By default these attempts are generated independently, wasting inference compute on redundant solutions. This waste seems unavoidable. After all, independence is what makes parallel sampling trivial to scale. However, this tradeoff is not fundamental: there is a rich design space of samplers that generate correlated but exact samples entirely in parallel. We explore this design space as an avenue for improving sample efficiency in scaling inference compute and reinforcement learning (RL). Concretely, we introduce QuasiMoTTo, which uses correlated samples as a drop-in replacement for i.i.d. samples. To generate these samples, QuasiMoTTo uses a reparameterization of autoregressive sampling as inverse-CDF sampling and draws the underlying uniforms with quasi-Monte Carlo (QMC); because QMC spreads the uniforms out more evenly than i.i.d., the resulting samples cover the output space with far less redundancy. Even though the batch is correlated, each sample is marginally distributed according to the language model, so we can use the batch for policy-gradient training. Our empirical analysis focuses on understanding how efficiently QuasiMoTTo can turn compute into performance. To evaluate correlated samplers, whose dependence breaks standard pass@k estimators, we first develop an unbiased bootstrap estimator. Across four reasoning benchmarks, QuasiMoTTo matches i.i.d. pass@k accuracy with 25-47% fewer samples. Strikingly, QuasiMoTTo often saturates an upper bound on pass@k that holds for any marginal-preserving sampler. We also apply QuasiMoTTo to policy-gradient RL (GRPO) where it matches i.i.d. performance with 50% fewer training steps. These gains come from higher coverage, which yields a stronger learning signal per batch.

[121] Right in the Right Way: LM Training with Verifiable Rewards and Human Demonstrations cs.LG | cs.AI | cs.CLPDF

Mehul Damani, Isha Puri, Idan Shenfeld, Jacob Andreas

TL;DR: 本文提出了一种结合可验证奖励与人类演示的对抗性生成器-判别器框架，用于训练语言模型。该方法旨在同时优化任务的可验证性能（如代码生成正确性）和非可验证属性（如风格、多样性），以克服传统RLVR方法导致的多样性崩溃、不自然输出和奖励黑客等问题。

Details

Motivation: 当前基于可验证奖励的强化学习（RLVR）方法仅优化可客观评分的任务指标，忽视了输出风格、结构等主观且难以量化的类人属性，导致模型出现多样性下降、输出不自然和奖励黑客等典型失败模式。

Result: 在代码错误修复和开放式故事生成等多个领域，该方法在保持RLVR准确率优势的同时，显著改善了非可验证属性：在错误修复任务中，解决方案的编辑距离显著降低；在故事生成中，胜率显著提升且故事更具多样性和类人性；在一个简单的奖励黑客基准测试中，该方法几乎消除了模型的不当行为并保持了高分。

Insight: 核心创新在于通过对抗性训练框架，利用判别器从人类演示中学习难以形式化为标量奖励的生成属性，作为对生成器的补充奖励信号，从而将强化学习与监督微调相结合，为联合优化任务的可验证与非可验证属性提供了一条可扩展的路径。

Abstract: RL with verifiable rewards (RLVR) has emerged as a powerful paradigm for training LMs on tasks with well-defined success metrics, such as code generation and mathematical reasoning. However, current RLVR methods optimize only what can be objectively scored, often neglecting subjective, non-verifiable aspects of human-like outputs, such as style and structure. This limitation leads to well-documented failure modes such as diversity collapse, unnatural-sounding responses, and reward hacking. We propose an adversarial generator-discriminator framework that augments verifiable rewards with a learned signal from human demonstrations. A generator model is trained using RL to maximize both task accuracy and an adversarial reward derived from a discriminator. The discriminator, trained alongside the generator policy, learns to distinguish human-written outputs from model-generated ones. The discriminator serves as a learned proxy for the human output distribution, providing feedback on aspects of generation that are difficult to formalize as scalar rewards. Across diverse domains, including bug fixing and open-ended generation, our approach consistently improves non-verifiable properties while preserving the accuracy gains of RLVR. In bug fixing, our method produces solutions with significantly lower edit distance compared to RLVR baselines while matching end performance. In story generation, our method significantly improves win rate while producing stories that are diverse and more human-like. And in a simple reward hacking benchmark, our method nearly eliminates model misbehavior while maintaining high benchmark scores. Together, these results show that our approach bridges RL and SFT, offering a scalable path toward jointly optimizing the verifiable and non-verifiable properties of a task.

[122] Is One Layer Enough? Training A Single Transformer Layer Can Match Full-Parameter RL Training cs.LG | cs.CLPDF

Zijian Zhang, Rizhen Hu, Athanasios Glentis, Dawei Li, Chung-Yiu Yau

TL;DR: 本文通过系统性的逐层研究，挑战了强化学习（RL）后训练中所有Transformer层贡献均等的假设。研究发现，仅训练单个Transformer层即可恢复全参数RL训练的大部分收益，有时甚至能超越；RL增益高度集中在少数（甚至单个）中间层，且该模式在不同模型、任务和算法中稳定出现。

Details

Motivation: 现有RL后训练方法通常均匀更新所有参数，隐含假设各层贡献相似；本文旨在探究RL适应在Transformer层间的分布，挑战这一假设。

Result: 在涵盖Qwen3、Qwen2.5模型族，GRPO、GiGPO、Dr. GRPO三种RL算法，以及数学推理、代码生成、智能体决策等多个任务领域的七个模型上，实验表明训练单层可匹配甚至超越全参数RL训练的性能。

Insight: 创新点在于引入“层贡献度”量化指标，并揭示了RL增益高度集中于Transformer栈中间层的稳定结构模式；这为高效RL微调提供了新视角，可能大幅减少计算开销。

Abstract: Reinforcement learning (RL) has become a central component of post-training large language models (LLMs), yet little is understood about how RL adaptation is distributed across transformer layers. Existing approaches typically update all model parameters uniformly, implicitly assuming that every layer contributes similarly to the gains obtained during RL post-training. In this work, we challenge this assumption through a systematic layer-wise study of RL training. Surprisingly, we find that training a single transformer layer can recover most of the gains achieved by full-parameter RL training, and in some cases even surpass it. To quantify this phenomenon, we introduce the quantity layer contribution, which measures the fraction of full RL improvement recovered by training a layer in isolation. Across seven models spanning two model families (Qwen3, Qwen2.5), three RL algorithms (GRPO, GiGPO, Dr. GRPO), and multiple task domains including mathematical reasoning, code generation, and agentic decision-making, we observe a remarkably stable pattern: RL gains are highly concentrated in a small subset of, and in many cases even a single, transformer layers. More strikingly, the same structural pattern consistently emerges: high-contribution layers concentrate in the middle of the transformer stack, while layers near the input and output ends contribute substantially less. The resulting layer rankings remain strongly correlated across datasets, tasks, model families, and RL algorithms.

[123] PAPA: Online Personalized Active Preference Alignment cs.LG | cs.AI | cs.CVPDF

Anindya Sarkar, Nasik Muhammad Nafi, Isaac Lyngaas, Muralikrishnan Gopalakrishnan Meena, Yevgeniy Vorobeychik

TL;DR: 本文提出了PAPA（个性化主动偏好对齐）方法，用于在交互式反馈中直接优化扩散模型以适应用户偏好，无需学习参数化的奖励模型。该方法基于变分推断框架，实现了高效的偏好对齐，并通过理论分析进一步提出了计算效率更高的EPAPA策略。

Details

Motivation: 在个性化推荐等应用中，目标是从交互反馈中学习用户偏好以优化扩散模型，但传统方法需要大规模偏好数据来学习参数化奖励模型，这在实际中往往不可行。

Result: 在多样化的类条件对齐和细粒度对齐任务上进行了广泛的实验和消融研究，证明了PAPA的有效性；EPAPA策略进一步减少了计算预算并加速了微调过程。

Insight: 创新点在于绕过参数化奖励模型，直接利用实时用户反馈优化扩散模型，实现了反馈高效的偏好对齐；从变分推断框架获得灵感，并基于理论分析提出了计算更高效的增强策略EPAPA，提升了实际部署的适用性。

Abstract: Diffusion models are highly effective at modeling complex data distributions, including images and text. However, in applications like personalized recommender systems, the objective often shifts to modeling specific regions of the distribution that maximize user preferences-initially unknown but gradually uncovered through interactive feedback. This can naturally be framed as a reinforcement learning problem, where the goal is to fine-tune a diffusion model to maximize a reward function based on preferences. However, the main challenge lies in learning a parameterized reward model, which typically requires large-scale preference data-something that is often not feasible in practice. In this work, we introduce Personalized Active Preference Alignment PAPA, a novel method that bypasses the requirement for a parametrized reward model by directly optimizing the diffusion model using real-time user feedback. PAPA enables feedback-efficient preference alignment, drawing inspiration from the variational inference framework. We demonstrate PAPA’s effectiveness through extensive experiments and ablation studies across diverse class-conditioned and fine-grained alignment tasks. Additionally, based on theoretical insights, we propose an enhanced fine-tuning strategy, referred to as EPAPA, that requires less computational budget and accelerates the fine-tuning process, further boosting PAPA’s suitability for real-world deployment. Our code is made publicly available at https://github.com/NasikNafi/papa.

[124] Flow-Map GRPO: Reinforcement Learning for Few-Step Flow-Map Generators via Anchored Stochastic Composition cs.LG | cs.AI | cs.CVPDF

Zhiqi Li, Wen Zhang, Bo Zhu

TL;DR: 本文提出Flow-Map GRPO，一种用于确定性少步流图生成器的在线强化学习后训练框架。其核心是锚定随机流图组合（ASFMC），一种路径保持的随机化机制，可在保持原始确定性流图边缘概率路径的同时，通过基于锚点的条件重采样引入随机性。实验表明，该方法能有效提升基于FLUX的少步文本到图像生成器（如MeanFlow和sCM）在奖励、感知和任务级评估指标上的性能。

Details

Motivation: 确定性少步流图生成器（如一致性模型和MeanFlow）难以直接使用需要随机轨迹和定义良好似然比的强化学习后训练方法进行优化，因为现有基于SDE的随机化技术是为具有无限小或精细离散化过渡的基于速度的采样器设计的，不适用于长程流图。

Result: 在基于FLUX的少步文本到图像生成器（包括MeanFlow和sCM）上的实验表明，Flow-Map GRPO在奖励、感知和任务级评估指标上均提升了预训练确定性流图模型的性能。

Insight: 主要创新点是提出了锚定随机流图组合（ASFMC）机制，它允许对确定性流图进行路径保持的随机化，从而使其能够与GRPO等强化学习后训练方法兼容，而无需改变原始模型参数化或将其重新训练为原生随机模型。

Abstract: Few-step flow-map generators, such as consistency models and MeanFlow, accelerate sampling by directly learning long-range transport maps between noise and data. However, these models are typically deterministic, which makes them difficult to optimize with reinforcement learning (RL) post-training methods that require stochastic trajectories and well-defined likelihood ratios. Existing SDE-based stochasticization techniques are designed for velocity-based samplers with infinitesimal or finely discretized transitions, and therefore do not directly apply to long-range flow maps. In this work, we propose Flow-Map GRPO, an online RL post-training framework for deterministic few-step flow-map generators. The key component is Anchored Stochastic Flow Map Composition (ASFMC), a path-preserving stochasticization mechanism that introduces randomness through anchor-based conditional resampling while preserving the original marginal probability path of the deterministic flow map. We derive GRPO objectives for both single-time and two-time flow-map parameterizations. Experiments on few-step FLUX-based text-to-image generators, including MeanFlow and sCM, show that Flow-Map GRPO improves pretrained deterministic flow-map models across reward-based, perceptual, and task-level evaluation metrics. Our results demonstrate that deterministic few-step flow-map generators can be effectively aligned with RL post-training without modifying their original model parameterization or retraining them as native stochastic models.

cs.AI [Back]

[125] Graph-Native Reinforcement Learning Enables Traceable Scientific Hypothesis Generation through Conceptual Recombination cs.AI | cond-mat.mtrl-sci | cs.CL | cs.LGPDF

Subhadeep Pal, Shashwat Sourav, Tirthankar Ghosal, Markus J. Buehler

TL;DR: 本文提出Graph-PRefLexOR，一种基于图原生强化学习的模型，用于通过概念重组生成可追溯的科学假设。该模型将推理过程组织为机制探索、图构建、模式提取和假设合成等明确阶段，将神经语言生成与符号关系结构相结合，以提高推理的可追溯性和语义多样性。在材料科学和力学领域的100个开放性问题测试中，模型在推理可追溯性方面取得了显著提升。

Details

Motivation: 当前大型语言模型在材料设计等开放性问题中常生成流畅但难以追溯的响应，缺乏连贯的中间推理支持。本文旨在开发能够通过多步、领域扎根的推理生成科学有效假设的AI系统，以加速材料发现。

Result: 在材料科学和力学的100个开放性问题测试中，Graph-PrefLexOR相比基础模型实现了40-65%的性能提升，尤其在推理可追溯性方面增益最大。嵌入分析显示其语义探索更广，语义多样性比基线高约2-3倍，且结构化推理与最终答案之间对齐更强。

Insight: 创新点包括使用图原生强化学习（GRPO优化）将推理过程显式阶段化，结合神经与符号方法以增强可追溯性；通过概念重组在有限语义空间内进行长程探索，而非简单扩展覆盖，这为科学假设生成提供了可解释的AI路径。

Abstract: Accelerating materials discovery requires AI systems that can generate scientifically valid hypotheses through multi-step, domain-grounded reasoning. Standard large language models often produce fluent but weakly traceable responses to open-ended materials design problems, making it difficult to determine whether final answers are supported by coherent intermediate reasoning. We develop Graph-PRefLexOR, a family of graph-native reasoning models fine-tuned with Group Relative Policy Optimization (GRPO) to organize reasoning into explicit phases for mechanism exploration, graph construction, pattern extraction, and hypothesis synthesis. This design links neural language generation with symbolic relational structure, enabling causal connections to be constructed, inspected, and reused. On 100 open-ended questions from materials science and mechanics literature, Graph-PRefLexOR achieves 40-65% improvements over corresponding base models, with the largest gains in reasoning traceability. Embedding analyses show broader semantic exploration and approximately 2-3 times greater semantic diversity than baselines. Semantic backtracking and layer-wise hidden-state analyses further show stronger alignment between structured reasoning and final answers. Finally, test-time graph expansion reveals that additional compute primarily increases long-range conceptual recombination within a bounded semantic space, rather than simply expanding semantic coverage. These results establish graph-native reinforcement learning as a pathway toward interpretable AI systems for scientific hypothesis generation in materials design and other scientific applications.

[126] Theoria: Rewrite-Acceptability Verification over Informal Reasoning States cs.AI | cs.CL | cs.LG | cs.LO | cs.SEPDF

Ben Slivinski, Michael Saldivar

TL;DR: Theoria是一个用于验证AI系统答案可信度的架构，通过将候选解重写为一系列带有明确理由的类型化状态转换，确保每一步都可独立审计。该方法在HLE-Verified Gold数据集上达到91.4%的严格精确度，并在对抗性错误检测中显著优于整体LLM评判器。

Details

Motivation: 解决现有方法在AI系统答案可信度验证上的不足：形式化证明助手覆盖范围有限，而基于标量评分的LLM评判器缺乏可审计性且易受连贯性问题影响。

Result: 在HLE-Verified Gold（185个纯文本专家问题）上，Theoria以91.4%的严格精确度认证了105个问题；在95个对抗性篡改证明中，结构化评判器检测到94.7%的错误，显著优于整体评判器的83.2%。在GPQA Diamond数据集上认证精确度为97.1%。

Insight: 创新性地引入“变更完备性”不变式，强制要求连续状态间的所有差异必须有明确理由，从而将隐藏前提暴露为未授权的变更；该方法生成人类可读的证明轨迹，实现了可审计性与覆盖范围的平衡，与整体LLM评判器形成互补。

Abstract: When should an AI system’s answer be trusted? Formal proof assistants offer certainty but cannot reach most of the problem distribution; scalar LLM judges offer coverage but produce opaque scores that cannot be audited after the fact and are subject to the same coherence issues as any LLM. We present Theoria, a verification architecture that closes this gap. A candidate solution is rewritten into a sequence of typed state transitions, each licensed by an explicit justification, whether that be a citation, computation, or problem-given fact, and every transition is independently auditable. The foundational invariant is completeness of change: every difference between consecutive proof states must be accounted for, so hidden premises surface as unlicensed mutations rather than passing silently. On HLE-Verified Gold (185 text-only expert problems), Theoria certifies 105 at 91.4% strict precision (Wilson 95% CI [84.5%, 95.4%]). Every certification produces a human readable proof trace in which each step can be independently challenged. Holistic LLM judges achieve comparable precision at matched coverage but fail on different problems (Jaccard 0.14-0.36), making the approaches complementary. On 95 adversarial poisoned proofs across 15 domains, structured judges catch 94.7% versus 83.2% for holistic judging (p= 0.0017). The overall 11.5 pp gap concentrates in hidden premises (90.6% vs. 62.5%, a 28 pp difference) and fabricated citations (100% vs. 90%), the error classes where the formal analysis predicts an advantage; performance is identical on arithmetic and theorem-misapplication errors, where no advantage is predicted. On GPQA Diamond (n= 65), certified precision is 97.1% (Wilson CI [85.1%, 99.5%]).

Table of Contents

cs.CL [Back]

[1] Identifying and Resolving Pitfalls of Knowledge-Based VQA Benchmarks: Auditing, Repairing, and Augmenting cs.CL | cs.CV | cs.IR | cs.MMPDF

[2] Benchmarking Frontier LLMs on Arabic Cultural and Sociolinguistic Knowledge: A Cross-Evaluation Framework with Human SME Ground Truth cs.CLPDF

[3] SLIM-RL: Risk-Budgeted Random-Masking RL for Diffusion LLMs Without Trajectory Slicing cs.CL | cs.AI | cs.LGPDF

[4] SEFORA: Student Essays with Feedback Corpus and LLM Feedback Evaluation Framework cs.CL | cs.AIPDF

[5] TRACE: State-Aware Query Processing over Temporal Evidence Graphs for Conversational Data cs.CLPDF

[6] DiscoLoop: Looping Discrete Embeddings and Continuous Hidden States for Multi-hop Reasoning cs.CL | cs.AI | cs.LGPDF

[7] A Mechanistic View of Authority Hierarchy in LLM Sycophancy cs.CL | cs.LGPDF

[8] Selective Test-Time Debiasing for CLIP via Reward Gating cs.CLPDF

[9] Understanding Why Language Models Hallucinate: Testing Reasoning Against Priors cs.CLPDF

[10] Know When to Stop: Segment-Level Credit Assignment for Reducing Overthinking cs.CLPDF

[11] Efficient Multilingual Reasoning Transfer via Progressive Code-Switching cs.CLPDF

[12] A Task-State Representation for Long-Horizon Mobile GUI Agents cs.CLPDF

[13] Safe Alone, Unsafe Together: Safeguarding Against Implicit Toxicity When Benign Images Combine cs.CL | cs.CR | cs.MMPDF

[14] Multi-Turn Agentic Scientific Literature Search via Workflow Induction cs.CL | cs.IRPDF

[15] MSQA: A Natively Sourced Multilingual and Multicultural SimpleQA Benchmark cs.CLPDF

[16] CAT: Confidence-Adaptive Thinking for Efficient Reasoning of Large Reasoning Models cs.CL | cs.AIPDF

[17] Logit-Contribution Scoring Identifies Non-Literal Retrieval Heads cs.CL | cs.AI | cs.LGPDF

[18] Understanding Large Language Models cs.CLPDF

[19] Message Passing Enables Efficient Reasoning cs.CL | cs.LGPDF

[20] Towards Developing a Multimodal Chat Assistant for University Stakeholders: RAG-based Approach cs.CL | cs.AIPDF

[21] AGC-Bench: Measuring Artificial General Creativity cs.CLPDF

cs.CV [Back]

[22] Joint Medical Image Enhancement and Segmentation with Diffusion-based Symbiotic Information Interaction cs.CVPDF

[23] Synergistic Perception-Reasoning Governance: Grounding Medical MLLMs with Verifiable Anatomical Evidence cs.CVPDF

[24] Segmenting, Fast and Slow: Real-Time Open-Vocabulary Video Instance Segmentation with Dual-Path Processing cs.CVPDF

[25] PixelEyes: Decoupling Perception and Reasoning for Pinpoint Visual Evidence Seeking cs.CVPDF

[26] Decompose, Compare, and Decide: Multimodal LLMs are Implicit Few-Shot Learners cs.CVPDF

[27] A Synthetic-Driven Vision System for Assembly Step Recognition cs.CVPDF

[28] Progressive Pose-Guided 4D Animal Reconstruction from Monocular Video cs.CVPDF

[29] Steal the Patch Size: Adversarially Manipulate Vision-Language Models cs.CV | cs.LGPDF

[30] VOCA: Visual Odometry with Codec Awareness cs.CVPDF

[31] EgoSafetyBench: A Diagnostic Egocentric Video Benchmark for Evaluating Embodied VLMs as Runtime Safety Guards cs.CV | cs.AIPDF

[32] Does Your ViT Still Need U-Net for Segmentation? cs.CVPDF

[33] Multi-Hypothesis Test-Time Adaptation to Mitigate Underspecification cs.CV | cs.AIPDF

[34] MVDGC: Joint 3D and 2D Multi-view Pedestrian Detection via Dual Geometric Constraints cs.CVPDF

[35] AEGIS: A Multi-Task Joint-Embedding Predictive Architecture for Mammography cs.CVPDF

[36] Wake up for Touch! Mask-isolated Tactile Alignment Learning in MLLMs cs.CV | cs.MM | cs.ROPDF

[37] OnPoint: Offline-to-Online Multi-Level Distillation for Point-Supervised Online Temporal Action Localization cs.CVPDF

[38] Rosetta: Composable Native Multimodal Pretraining cs.CV | cs.CL | cs.LGPDF

[39] Learning When to Listen: Gated Affect Fusion for Human Motion Prediction cs.CV | cs.AIPDF

[40] CORGI: Consistency-Aware 3D Dog Reconstruction from a Single Image in the Wild cs.CVPDF

[41] RetailSMV: Exocentric vs. Egocentric Adaptation of Foundation Video World Models in Retail cs.CV | cs.AIPDF

[42] DroneFINE: Domain-Aware Parameter-Efficient Fine-Tuning of Vision-Language Detectors for Drone Images cs.CVPDF

[43] Personalized Object Identification and Localization via In-Context Inference with Vision-Language Models cs.CVPDF

[44] SFDATrack: Generalized Source-Free Domain Adaptive Tracking Under Adverse Weather Conditions cs.CVPDF

[45] LIST3R: Long-sequence Instance-aware 3D Reconstruction cs.CVPDF

[46] Radial Interaction Tomography: Recognizing Non-Transitive Evolutionary Games from One Range-Expansion Image cs.CV | q-bio.PEPDF

[47] MindAU: EEG-Conditioned Facial Action Unit Editing via Dual-Stream Manifold Alignment cs.CV | cs.LGPDF

[48] DroneIQA-VLE: Multi-Task Drone Image Quality Assessment via Vision-Language Ensemble cs.CVPDF

[49] EO-VGGT: Orbital Ray-Conditioned 3D Foundation Models for Satellite Multi-View Reconstruction cs.CV | cs.AIPDF

[50] Information-Regularized Attention for Visual-Centric Reasoning cs.CV | cs.LGPDF

[51] VideoSearch-R1: Iterative Video Retrieval and Reasoning via Soft Query Refinement cs.CV | cs.AIPDF

[52] StochasT: Learning with Stochastic Turn Depth for Visual Instruction Tuning cs.CV | cs.CL | cs.LGPDF

[53] MindEdit-Bench: Benchmarking Object-Level Counterfactual Spatial Reasoning in VLMs from In-the-Wild Photos cs.CV | cs.AI | cs.CLPDF

[54] Robust 3D Alignment of Generative Reconstructions via Partial Monocular Observations cs.CVPDF

[55] Multimodal Continuous Reasoning via Asymmetric Mutual Variational Learning cs.CVPDF

[56] Cross4D-JEPA: Dense Cross-modal Correspondence Distillation for 4D Point Cloud Representation Learning cs.CV | cs.AIPDF

[57] GEAR-Seg: A Grounded Explainable Agent for Reasoning Segmentation and Data Engine cs.CVPDF

[58] ECoSim: Data Efficient Fine-Tuning for Controllable Traffic Simulation cs.CVPDF

[59] BrainFIBRE: A Foundation Model via Information Decomposition for Brain Microstructure cs.CVPDF

[60] EgoGapBench: Benchmarking Egocentric Action Selection in Multi-Agent Scenes cs.CV | cs.AIPDF

[61] Active Spatial Guidance: Eliminating Injected Positional Mechanisms in Vision Transformers cs.CVPDF

[62] Retrieved Images as Visual Thought: Training-Free Multimodal In-Context Learning for the Open-vs-Closed Gap cs.CVPDF

[63] Identifying Latent Concepts and Structures for Generalized Category Discovery cs.CV | cs.AIPDF

[64] Learning to Watch: Active Video Anomaly Understanding via Interleaved Policy Optimization cs.CVPDF

[65] Linguistic Relative Policy Optimization for Video Anomaly Reasoning cs.CVPDF

[66] DART: Difficulty-Adaptive Routing for Zero-Shot Video Temporal Grounding cs.CVPDF

[67] ABot-M0.5: Unified Mobility-and-Manipulation World Action Model cs.CV | cs.ROPDF

[68] Imprint: Online Memory Compression for Long-Horizon Egocentric QA cs.CVPDF

[69] Towards Memory-Efficient Autoregressive Video Generation via Instance-Specific Parametric Absorption cs.CV | cs.MMPDF

[70] Partial Skeleton Visibility for Action Recognition: A Constrained Field-of-View Approach cs.CV | cs.AIPDF

[71] AV-SyncBench: Decoupled Benchmarking of Temporal and Semantic Audio-Visual Synchronization cs.CV | cs.SDPDF

[72] Foundation Model-driven Key Anatomy Frame Selection for Blind-sweep Ultrasound Fetal Birth Weight Estimation cs.CVPDF

[73] FrameONE: Hierarchical Motion Modeling for Universal Multi-View Echocardiographic Keyframe Detection cs.CVPDF

[74] GaussianFusion: Unified 3D Gaussian Representation for Multi-Modal Fusion Perception cs.CV | cs.AIPDF

[75] Soft Mixture-of-Recursions: Going Deeper with Recursive Vision Transformers cs.CV | cs.LGPDF

[76] GKDT: General Keypoint Detection Transformer cs.CVPDF

[77] LeVLJEPA: End-to-End Vision-Language Pretraining Without Negatives cs.CV | cs.AIPDF