cs.CL [Total: 25]
cs.CV [Total: 45]
eess.IV [Total: 7]
cs.RO [Total: 7]
cs.MM [Total: 2]
cs.AR [Total: 1]
eess.AS [Total: 1]
cs.AI [Total: 5]
cs.NE [Total: 1]
cs.SE [Total: 1]
cs.LG [Total: 4]
cs.SD [Total: 1]
cs.IR [Total: 1]

cs.CL [Back]

[1] Memory as transformation: LETHE, a self-referential gan-inspired architecture cs.CLPDF

Francesco Vitucci, Anthony Di Furia, Francesco Scagliola

TL;DR: LETHE是一种自指涉的、受生成对抗网络启发的音频处理架构，在SuperCollider中实现。它采用封闭配置，无需外部数据集或初始化后的监督，通过一个基于两条延迟线的3x3混合矩阵处理音频，其系数和延迟时间通过一个五特征线性判别器与类似REINFORCE的随机扰动优化器的交互进行演化。判别器将当前能量行为与初始状态存档比较以指导参数更新，可独立处理循环、固定和实时音频源。

Details

Motivation: 论文旨在将生成对抗网络的形式化词汇应用于自指涉的电声音乐创作，构建一个无需外部数据或监督的封闭自适应系统，将声音结果委托给由作曲家定义参数空间的自适应闭环。

Result: 在包含消融控制的固定和循环音频会话实验中，主动生成器被证明是参数演化所必需的（在所有15个消融会话中Δc_{22}=0.000）。

Insight: 创新点在于将GAN的对抗框架转化为一个完全自指涉、无监督的闭环系统，用于实时音频生成与演化，其参数空间由人工定义但演化过程自主进行，为算法音乐创作提供了新范式。

Abstract: LETHE (Latent-parameter Evolution with Temporal Hierarchical quasi-Equilibrium) is a self-referential sonic-oblivion system implemented in SuperCollider. It adopts the formal vocabulary of Generative Adversarial Networks in a closed configuration without external datasets or supervision after initialization. Audio is processed by a 3 x 3 mixing matrix built around two delay lines; its nine coefficients and two delay times evolve through the interaction of a five-feature linear discriminator and a random-perturbation optimizer analogous to single-sample REINFORCE. The discriminator compares current energy behavior with an archive of the initial state and guides parameter updates. Circular, fixed, and live sources can be mixed independently. Across fixed and circular sessions with an ablation control, the active generator is necessary for parametric evolution ($Δc_{22}=0.000$ in all 15 ablation sessions). Situated in the tradition of self-referential electroacoustic music, LETHE delegates the sonic outcome to an adaptive closed loop whose parametric space is defined by the composer.

[2] MedProb: Probing Internal Representations of Vision-Language Models for Medical Question Answering cs.CLPDF

Erfan Nourbakhsh, Ke Yang, Anthony Rios

TL;DR: 本文提出了MedProb，一个轻量级探测框架，用于从冻结的视觉语言模型（VLM）的内部表示中预测医学视觉问答（Med-VQA）的多选答案，而无需进行自由文本生成。该方法在多个Med-VQA基准测试（PATH-VQA、SLAKE、VQA-RAD）上超越了基于提示的医学VLM和复杂代理系统，并揭示了基于生成的评估可能低估了较小VLM中可恢复的医学知识信号。

Details

Motivation: 重新审视医学视觉问答（Med-VQA）通常需要医学微调、大型模型或复杂多智能体管道的假设，旨在探索冻结的通用VLM内部表示是否已包含足够用于Med-VQA的信号，从而提供一种更轻量、更直接的评估和利用方法。

Result: 在PATH-VQA、SLAKE和VQA-RAD基准测试上，MedProb比基于提示的方法恢复了更多与答案相关的信号，性能优于专门的医学VLM和代理系统。探测还缩小了基于提示评估时大小模型之间的性能差距。此外，研究发现医学适应（微调）并未一致改善这种线性可解码性。

Insight: 主要创新点在于提出了一种不依赖自由文本生成的轻量级线性探测框架（MedProb），直接利用VLM的内部表示进行答案预测，这为评估VLM的医学知识提供了一种新视角。关键发现包括：1）较小的VLM可能包含比生成式评估所揭示的更多可恢复的医学信号；2）医学微调不一定能提升VLM内部表示的线性可解码性；3）揭示了自由文本生成中存在显著的答案位置偏差（高达10个百分点），而探测方法虽然也有偏差，但其模式不同。该方法还可通过拒绝采样评分扩展到开放式生成任务。

Abstract: Medical visual question answering (Med-VQA) is often assumed to require medical fine-tuning, large models, or complex multi-agent pipelines. We revisit this assumption with \textbf{MedProb}, a lightweight probing framework that predicts multiple-choice Med-VQA answers from frozen VLM representations without free-text generation. Across PATH-VQA, SLAKE, and VQA-RAD, MedProb recovers substantially more answer-relevant signal than prompting and performs stronger than medical VLMs and agentic systems. Probing also reduces the apparent gap between small and large models compared to prompting, suggesting that smaller VLMs contain more recoverable Med-VQA signal than generation-based evaluation reveals. Across 14 matched general-purpose and medical VLM pairs, medical adaptation does not consistently improve this linear decodability. Finally, free-text generation exhibits an answer-position bias of up to 10 percentage points, whereas MedProb also has positional bias, however, it is impacted differently than prompting. Our main results target the multiple-choice/multiclass Med-VQA setting; we additionally show the probe can be extended to open-ended generation via a rejection-sampling scoring procedure.

[3] Adapting from Downturns: Prediction of Long-Term Conversational-Skill Development in Mental-Health Crisis Counselors cs.CL | cs.AI | cs.CYPDF

Vivian Nguyen, Lillian Lee, Elizabeth A. Olson, Cristian Danescu-Niculescu-Mizil

TL;DR: 本文提出了一种早期预测心理健康危机咨询师长期对话技能发展的方法，通过分析咨询师在特定困难对话时刻的适应行为来预测其未来改善的可能性。

Details

Motivation: 在心理健康咨询中，志愿咨询师往往缺乏持续的监督和结构化反馈，因此需要一种方法来早期识别哪些咨询师能够（或不能）有效提升引导对话走向积极结果的能力，以便优先为最需要支持的咨询师提供帮助。

Result: 在预测咨询师未来改善能力的任务中，所提出的咨询师适应方法优于直接从对话文本中学习的基线模型，证明了该任务在志愿心理健康危机咨询师场景下的可行性。

Insight: 创新点在于关注咨询师在特定困难对话时刻的适应行为，而非直接分析对话内容，通过识别初始困难时刻、捕捉后续类似时刻的响应变化，并学习哪些早期适应行为能预测长期改善，为技能发展预测提供了新的视角。

Abstract: How do people learn to become better conversationalists? This question is especially important in the context of mental-health counseling, where conversational skills are essential, yet volunteer counselors often have limited access to supervision and structured feedback. Understanding how counselors develop their ability to steer conversations toward positive outcomes – and identifying early which counselors are (not) on track to improve – can help prioritize support for the counselors who need it most. In this work, we introduce the task of predicting, early in a conversationalist’s career, whether they will eventually improve at steering conversations toward positive outcomes, and demonstrate the feasibility of this task in the case of volunteer mental-health crisis counselors. Our central insight is that people may struggle with particular kinds of moments in a conversation, and that what is especially revealing of their likelihood of future improvement is how they learn to handle those moments over time. We operationalize this insight by designing a method that identifies the types of moments a counselor initially struggles with, captures how they adapt their response when they re-encounter similar moments in subsequent conversations, and learns which early adaptations predict improvement months or even years later. While this future-prediction task is challenging, our counselor-adaptation approach yields better results than baselines that learn directly from the conversation transcript.

[4] Evidence Integration in Large Language Models cs.CL | cs.AI | cs.LGPDF

Sebastien Kawada, Manolis Kellis

TL;DR: 本文提出了一种关于大型语言模型（LLMs）如何整合外部证据的分布理论，该理论基于接收者先验权重和候选证据倾斜度，预测了证据对模型决策的影响。研究通过超过一千万次试验、涵盖12个来自四个家族的LLMs以及八个领域（包括量子力学、物理学、遗传学和分子生物学等科学发现任务）验证了三个核心预测，并揭示了证据整合是接收者特定的控制策略，而非对证据源的简单信任。

Details

Motivation: 尽管LLMs越来越依赖工具、检索增强生成、其他智能体或用户提供的外部证据进行推理，但LLMs如何将这些证据整合到其已初步形成的决策中，这一过程尚不明确。

Result: 在超过一千万次试验中，使用12个来自四个家族的LLMs和八个领域（包括四个物理和生命科学领域的科学发现任务）验证了理论预测：接收者更可能接受的候选答案更具说服力；接收者更容易整合自身特有的错误而非来自不同来源的外部错误；相同的证据可能提升较弱模型的性能，同时损害较强模型的性能。

Insight: 创新点在于提出了一个解释LLMs证据整合机制的分布理论，并揭示了证据整合是接收者特定的、基于其自身属性（而非对证据源的标量信任）的控制策略；通过因果干预发现，候选答案的整合发生在网络后期，是一个结构化的多步骤过程，且验证过程的表征与答案整合的状态是可分离的。

Abstract: Despite increasing reliance on LLMs that reason with external evidence supplied by tools, retrieval-augmented generation, other agents, and users, how LLMs integrate such evidence into decisions they have already begun to form remains largely unclear. We present a distributional theory in which evidence shifts the receiver’s distribution of initial answers, driven by a receiver prior weight and a candidate evidence tilt, leading to three predictions. First, candidates more probable to the receiver are more persuasive. Second, receivers more readily integrate characteristic errors of their own than foreign errors from different sources. Third, identical evidence can improve weaker models and harm stronger ones. We confirm these over ten million trials, twelve LLMs from four families, and eight domains, four of them scientific discovery tasks in the physical and life sciences: quantum mechanics, physics, genetics, and molecular biology. The law also yields a receiver-relative reliability frontier: receiver-congruent errors depress performance more steeply than random errors of the same rate. LLMs also integrate candidates even after internally verifying their invalidity (93-100% with propositional constraints; up to 99.4% on held-out physical and life-sciences reasoning), demonstrating evidence integration is a receiver-specific control policy over existing distributions, determined by receiver properties rather than scalar trust in the evidence source. Causal interventions show candidate integration is implemented late in the network, as a structured sequence of steps admitting external candidate answers, promoting them, and transporting them into the answer state. Representations of verification are decodable but have little causal impact on answers. A J-lens decomposition shows the state underlying verbalized verification is fully dissociable from that underlying candidate integration.

[5] Shared circuits predict whether LLMs generalize across formats in arithmetic reasoning cs.CL | cs.AIPDF

Andrea Gregor de Varda, Sana Pandey, Pengrui Han, Jacob Andreas, Evelina Fedorenko

TL;DR: 本文研究了大型语言模型（LLMs）在算术推理任务中，对不同输入格式（如数字’2+5’与文字’two plus five’）的泛化能力。通过归因修补技术，作者定位了模型处理数字和三种语言（英语、西班牙语、意大利语）文字算术问题的内部电路，并发现电路重叠程度可以预测模型对文字格式的泛化性能。

Details

Motivation: 人类能轻松处理输入格式的表面变化（如数字与文字算术），但LLMs对此类变化较为脆弱，在数字算术上表现优异，而在相同问题的文字表述上准确性显著下降。本文旨在探究是否可以从模型内部机制预测这种跨格式泛化能力。

Result: 研究发现，模型自身数字电路与文字格式电路的重叠程度，可以预测三种文字格式的相对难度、模型的最佳泛化情况以及哪些项目被正确解决。该方法在预测性能上可与有监督探针相媲美，且无需标注数据。

Insight: 创新点在于使用归因修补技术定位特定任务的内部电路，并首次提出电路重叠作为预测LLMs跨格式泛化的无监督指标。这为理解模型泛化机制提供了新视角，可能有助于设计更鲁棒的提示或模型架构。

Abstract: In many forms of reasoning, including arithmetic reasoning, generalizing across superficial changes in input format is effortless for humans: anyone who can solve 2+5 can also solve ‘two plus five’. In contrast, LLMs are more brittle to surface variations of the prompts: for example, they solve numeric arithmetic problems almost perfectly but are substantially less accurate on verbal renditions of the same problems. Here, we ask whether generalization across formats can be predicted from the models’ internals. Using attribution patching, we first independently localize the circuit that each model recruits to solve numeric arithmetic problems (2+5) vs. verbal ones, in three languages: English (‘two plus five’), Spanish (‘dos más cinco’), and Italian (‘due più cinque’); then, we test whether overlap with the model’s own numeric circuit predicts its generalization to the verbal formats. Indeed, we find support for this idea at three levels: circuit overlap accounts for the relative difficulty of the three verbal formats, for which models generalize best, and for which items are solved correctly, rivaling supervised probes while requiring no labeled data.

[6] Towards Understanding Pause Token Fine-Tuning Dynamics: A Mode Retention Perspective cs.CL | cs.AIPDF

Jaehyeon Kim, Suhwan Kim, Nakyung Lee, Yeongoon Kim, Jimin Seo

TL;DR: 本文研究了暂停令牌在微调过程中的训练动态，提出了一种新的训练规则——掩码边界暂停（MBP），即在推理步骤边界处插入暂停令牌并掩码其损失。该方法在1B-8B规模的Qwen和Llama模型上显著提升了数学和代码推理能力，同时保持了通用语言理解能力。

Details

Motivation: 现有研究主要从计算表达性角度解释暂停令牌提升LLM推理能力的原因，但对其训练动态缺乏深入探究。本文旨在探索暂停令牌如何重塑微调过程，并揭示其内在机制。

Result: 在合成持续学习任务中，掩码暂停在相同最终适应度下对先前学习分布的覆盖减少了约4倍；在合成数学推理探针任务中，边界相邻令牌编码了更多下游步骤信息。MBP方法在数学任务上提升高达6个点，代码任务上提升2.5个点，并成功扩展到GRPO方法中。

Insight: 创新点在于将暂停令牌重新定义为一种训练动态干预手段，通过掩码边界暂停实现模式保留与非短视压缩，从而在保留-适应权衡中优化模型性能，而不仅仅是推理时的计算工具。

Abstract: Pause-token methods improve LLM reasoning by inserting special tokens into sequences. Prior work explains these gains through computational expressivity. However, there is relatively little investigation into the training dynamics of pause tokens. We explore how pause tokens reshape the training dynamics of fine-tuning. Two controlled pilots expose distinct asymmetries. On a synthetic continual-learning task, masked pauses overwrite a previously-learned distribution roughly 4x less at matched final adaptation (H1, mode retention); on a synthetic math-reasoning probe, the boundary-adjacent token comes to encode substantially more downstream-step information (H2, non-myopic compression). We formalize a training rule consistent with both - Masked Boundary Pause (MBP), pause tokens placed at reasoning-step boundaries with their loss masked. Across 1B-8B Qwen and Llama models, MBP consistently improves reasoning, achieving gains of up to 6 points on math and 2.5 points on code, while preserving general language understanding abilities. We further demonstrate that this mode-preserving strategy extend gains to GRPO. These results recast pause tokens as a training-dynamics intervention on the retention-adaptation trade-off, rather than merely an inference-time computation device.

[7] A Calibrated Reflection Approach for Enhancing Confidence Estimation in LLMs cs.CLPDF

Umesh Bodhwani, Yuan Ling, Shujing Dong, Yarong Feng, Hongfei Li

TL;DR: 本文提出了一种名为’校准反射’的方法，用于增强大语言模型（LLMs）的置信度估计。该方法结合了结构化推理与距离感知校准技术，通过最大置信度选择、基于反射的提示机制和距离感知校准三个关键创新，在对话和事实分类任务上提升了置信度估计的可靠性。

Details

Motivation: 部署大语言模型的一个关键挑战是开发可靠的置信度估计机制，以便系统能够判断何时信任模型输出，何时需要人工干预。

Result: 该方法在HelpSteer2、Llama T-REx和一个专有对话数据集上进行了评估，证明了其在对话和基于事实的分类任务中的有效性。

Insight: 主要创新点包括：1）全面评估所有可能标签置信度的最大置信度选择方法；2）提升推理可靠性的基于反射的提示机制；3）考虑标签间序数关系的距离感知校准技术。这些技术共同致力于开发可靠且校准良好的LLM置信度估计方法。

Abstract: A critical challenge in deploying Large Language Models (LLMs) is developing reliable mechanisms to estimate their confidence, enabling systems to determine when to trust model outputs versus seek human intervention. We present a Calibrated Reflection approach for enhancing confidence estimation in LLMs, a framework that combines structured reasoning with distance-aware calibration technique. Our approach introduces three key innovations: (1) a Maximum Confidence Selection (MCS) method that comprehensively evaluates confidence across all possible labels, (2) a reflection-based prompting mechanism that enhances reasoning reliability, and (3) a distance-aware calibration technique that accounts for ordinal relationships between labels. We evaluate our framework on diverse datasets, including HelpSteer2, Llama T-REx, and a proprietary conversational dataset, demonstrating its effectiveness across both conversational and fact-based classification tasks. This work contributes to the broader goal of developing reliable and well-calibrated confidence estimation methods for LLMs, enabling informed decisions about model trust and human judgement.

[8] PetQA: Benchmarking Veterinary Knowledge and Clinical Reasoning cs.CL | cs.AI | cs.CVPDF

Taegyun Kim, Youngwook Ham, Jungwook Rhim, Ju-Hyun An, Sungkyu Park

TL;DR: 本文提出了PetQA，一个韩语长文本问答基准，用于评估大语言模型和大型视觉语言模型在兽医知识和临床推理方面的能力。该基准包含10,076个纯文本和8,751个多模态问答对，源自关于猫狗的真实世界问题，并由兽医专家提供答案。研究评估了18个模型在零样本推理、检索增强生成和监督微调三种设置下的表现，揭示了当前模型在兽医临床查询处理中的优势与局限。

Details

Motivation: 为了解决当前大模型在兽医专业领域知识和临床推理能力评估的缺失，构建一个真实、专业的基准以推动开发临床可靠的兽医AI系统。

Result: 在PetQA-Bench测试集上，使用ROUGE、BERTScore和LLM-as-a-judge指标评估了18个模型的事实性和帮助性，结果表明当前模型在处理兽医临床查询方面仍有局限，需要更有效的适应方法。

Insight: 创新点在于构建了首个专注于兽医领域的多模态长文本问答基准，并系统评估了多种模型适应策略（零样本、RAG、SFT）在该专业领域的表现，为开发专业领域可靠的AI系统提供了重要参考。

Abstract: We introduce PetQA, a Korean long-form question-answering (QA) benchmark for evaluating veterinary knowledge and clinical reasoning in large language models (LLMs) and large vision-language models (LVLMs). PetQA contains 10,076 text-only and 8,751 multimodal QA pairs derived from real-world questions about dogs and cats, paired with answers from expert veterinarians. Its test split, PetQA-Bench, further includes annotations for question types and clinical conditions. We evaluate eighteen models using ROUGE, BERTScore, and LLM-as-a-judge metrics for factuality and helpfulness under three settings: zero-shot inference, retrieval-augmented generation (RAG), and supervised fine-tuning (SFT). The benchmarking results provide an overview of the strengths and limitations of current models in addressing veterinary clinical queries and highlight the need for more effective adaptation methods to develop clinically reliable AI systems for veterinary care. To facilitate broader use, we additionally provide translated versions of PetQA-Bench in five languages.

[9] Tracing Audio Grounding and Answer Selection in Audio LLMs cs.CL | cs.AI | cs.LG | cs.SDPDF

Hyebin Cho, Suho Yoo, Jihoo Jung, Joon Son Chung

TL;DR: 本文研究了音频大语言模型（Audio LLMs）在训练后如何真正利用音频信息进行推理。通过实验发现，训练后的模型对音频输入的依赖性显著增强，音频信息主要在模型的中早期层影响答案表示，而训练主要增强了中后期层音频信息对最终预测的影响，且训练权重在特定层带作用最大。

Details

Motivation: 现有音频大语言模型可能仅依赖文本线索或语言先验进行预测，而非实际音频信息。本文旨在探究模型内部机制，明确训练如何促使模型真正依据音频证据进行推理。

Result: 实验表明，训练后模型在音频被替换为静音或不相关音频时性能下降远大于预训练模型；音频信息在模型的中早期层对答案表示影响最强，而训练主要增强了中后期层音频信息对最终预测的影响；训练权重在特定层带作用最大。

Insight: 创新点在于从机制层面解释了训练如何强化音频大语言模型对声学证据的利用，揭示了音频信息在模型不同层中的具体影响路径，为模型可解释性和优化提供了新视角。

Abstract: Audio Large Language Models (Audio LLMs) have advanced in audio understanding, yet they can still predict the answer by reasoning from textual cues or linguistic priors rather than the provided audio. A common remedy is to train models on data whose answers cannot be inferred from text alone. This approach can improve performance, but what changes within the model remains unclear. In this paper, we ask what must happen inside the model for the audio to actually determine the answer. Our findings are threefold. (1) Replacing the audio with silence or unrelated audio causes substantially larger performance degradation in the trained model than in the pretrained model. (2) Acoustic information most strongly shapes the model’s representations of the answer choices in early-to-middle layers, while training mainly increases the influence of audio information on the final prediction in middle-to-late layers. (3) The weights learned during training have their largest impact in specific layer bands. Together, these results provide a mechanistic account of how training strengthens the use of acoustic evidence in Audio LLMs.

[10] ConsensusBench: Benchmark of Consensus Nodes for LLM Reasoning via Outcome Reward Densifying cs.CLPDF

Shi-Qi Yan, Chao-Hong Tan, Qian Chen, Wen Wang, Xiangang Li

TL;DR: 本文提出ConsensusBench基准数据集，通过识别推理过程中的共识节点（Consensus Nodes）来提供基于规则的过程级奖励信号，以缓解强化学习中仅依赖最终答案的稀疏奖励问题。该方法在GRPO框架基础上引入ConsensusPR奖励，并在多个数学推理数据集上验证了其有效性。

Details

Motivation: 现有基于强化学习的LLM推理方法（如GRPO）仅依赖最终答案的稀疏奖励，缺乏对中间推理步骤的反馈，导致在复杂长轨迹任务中效果受限。

Result: 在AIME 2024/2025、GSM8K、MATH-500及ConsensusBench上的实验表明，所提方法在最终答案准确率（Acc）上持续超越GRPO类方法，并通过节点覆盖率（NCR）和每节点令牌数（TPN）指标进行了过程级评估。

Insight: 创新点在于将正确推理轨迹中的语义等价中间结论聚类为共识节点，并基于此设计过程奖励来稠化奖励信号；这为长链推理提供了可验证的子目标监督机制。

Abstract: Reinforcement learning (RL) has become one of the primary paradigms for reasoning enhancement of large language models (LLMs). In particular, Group Relative Policy Optimization (GRPO) and related algorithms have demonstrated strong performance with outcome-level rewards. However, these methods depend solely on the final answer, without feedback regarding which intermediate steps contribute to success or failure. As task complexity and reasoning trajectory length increase, such sparse final-answer rewards become increasingly insufficient. To address this limitation, we introduce ConsensusBench, a novel dataset designed to provide rule-based process-level signals. We posit that a correct final answer relies on a small set of intermediate conclusions throughout the reasoning process, which can be seen as a verifiable sub-outcome. We identify these sub-outcomes by filtering correct trajectories from N rollouts and clustering semantically equivalent intermediate statements. We call these clustered statements as Consensus Nodes. By integrating a rule-based process reward derived from these nodes into GRPO-style algorithms, we develop a new reinforcement learning signal named ConsensusPR. It directly reduces the reward sparsity of outcome reward across long reasoning trajectories. To facilitate systematic process-level evaluation, we introduce three metrics to our benchmark: Final Answer Accuracy (Acc), Node Coverage Rate (NCR), and Tokens per Node (TPN). Experiments across AIME 2024, AIME 2025, GSM8K, MATH-500, and our ConsensusBench demonstrate that the proposed method consistently surpasses GRPO-style approaches, highlighting the practical value of consensus nodes in guiding reasoning.

[11] Choosing the Right Language Mode at Inference Time for Multilingual Reliability cs.CLPDF

Ekata Mitra, Ameeta Agrawal

TL;DR: 该论文研究了多语言大语言模型在低资源语言推理中的可靠性问题，探讨了翻译对模型性能的影响，并提出了一种无需训练的自适应推理框架RAAI来优化推理过程。

Details

Motivation: 多语言大模型在低至中资源语言上推理能力不足，先前工作表明翻译能帮助模型利用更强的英语中心表示，但需要明确翻译的使用程度以避免干扰和过度自信。

Result: 在LLaMA和Qwen模型上的实验表明，RAAI框架在低资源语言上提升了25-37.7%的准确率，并将校准误差降低了约3-6%，在最低资源语言层级效果最显著。

Insight: 创新点在于揭示了英语上下文与双语冗余之间的权衡，并提出了基于预期校准误差的路由和提示融合方法，以及使用中层风险指数来门控序列推理，从而动态分配计算资源并抑制有害冗余。

Abstract: Multilingual large language models often struggle to reason in low- to mid-resource languages. Prior work has shown that translation can improve multilingual reasoning by helping models access stronger English-centric representations. This raises a central question: How much translation is needed for multilingual large language models to reason reliably, and when does more translation instead trigger interference and overconfidence? Using LLaMA and Qwen models, we run extensive experiments varying text scope and language mode (target-only, English-only, bilingual) to evaluate both accuracy and reliability. Our results reveal a clear trade-off: English context often improve understanding and recover errors caused by non-English comprehension, yet adding redundant bilingual context intensifies interference. We address this trade-off with Reliability-Aware Adaptive Inference (RAAI), a training-free test-time framework that (i) performs Expected Calibration Error (ECE)-aware routing and prompt fusion, and (ii) uses a mid-layer Risk Index (RI) to gate sequential reasoning, allocating compute only when it is likely to help and suppressing harmful bilingual redundancy. Across two model families, RAAI enhances accuracy by 25-37.7% on low-resource languages and lowers calibration error by approximately 3-6%, with the most pronounced benefits in the lowest-resource language tiers.

[12] Refuse without Refusal: A Structural Analysis of Safety-Tuning Responses for Reducing False Refusals in Language Models cs.CL | cs.AIPDF

Minji Kim, Hyounghun Kim

TL;DR: 本文提出了一种通过解构安全调优数据集中的响应来减少语言模型误拒的方法，将响应分解为模板化拒绝声明和解释性理由两部分。研究发现，仅使用理由进行训练可以在保持安全性能的同时显著降低误拒率，并适用于上下文学习和推理时缓解方法。

Details

Motivation: 解决大语言模型在平衡帮助性与安全性时面临的误拒问题，即模型难以区分真正有害的查询和仅包含表面风险语言的良性查询，导致对良性查询的错误拒绝。

Result: 实验表明，仅使用理由（Rationale-Only）进行训练在保持可比安全性能的同时，显著减少了误拒；该方法在上下文学习（ICL）配置中同样有效，并与评估的推理时缓解方法兼容。

Insight: 创新点在于将安全响应解构为声明与理由，揭示了模板化拒绝声明会诱导模型依赖表面线索，而理由能提供更细粒度的判别依据；这强调了构建精确、细粒度安全监督数据集的必要性，为构建更好平衡帮助性与安全性的对齐智能体指明了方向。

Abstract: Striking a balance between helpfulness and safety remains a fundamental challenge in aligning large language models. To achieve this balance, models should refuse harmful queries (e.g., “How do I shoot someone?”) while remaining responsive to benign inputs, even those superficially resembling harmful queries (e.g., “Where can I shoot a good photo?”). However, models often struggle to distinguish genuinely harmful queries from benign queries that contain superficially risky language, resulting in false refusals. In this paper, we address the issue by decomposing a response in the safety-tuning dataset into two distinct components: (i) a boilerplate refusal statement and (ii) a rationale explaining the refusal. Our experiments and analyses show that refusal statements impede accurate discrimination between harmful and benign queries by inducing reliance on superficial cues. In contrast, training solely on rationales reduces false refusals while maintaining a comparable level of safety performance. Rationale-Only benefits also appear in our ICL configuration and remain compatible with the evaluated inference-time mitigation methods. The results emphasize the necessity of precisely curated, fine-grained safety supervision datasets and outline directions for constructing aligned agents that better reconcile helpfulness with safety.

[13] Knowing What Not to Answer: Selective Non-Compliance in Vision-Language Models cs.CL | cs.AIPDF

Minji Kim, Jihyoung Jang, Hyounghun Kim

TL;DR: 本文提出了KoNA基准，用于评估视觉语言模型在选择性不遵从方面的能力，即模型需要区分查询中可回答部分与需要拒绝的部分。研究通过微调模型在KoNA数据集上，显著提升了模型在选择性不遵从任务上的准确性，同时保持了在完全可回答任务上的性能。

Details

Motivation: 现有基准主要评估模型对整个查询的遵从或拒绝，但现实查询常混合可回答和不可回答内容，需要模型具备选择性不遵从能力。

Result: 在KoNA基准的五类任务（如错误前提、视觉不可访问性）上评估多种VLM，发现模型在选择性不遵从时失败更明显；微调后模型在非遵从准确性上大幅提升，且在完全可回答任务上性能基本保持。

Insight: 创新点在于引入组件级选择性不遵从评估基准KoNA，并通过微调使模型学会区分查询中的可回答与不可回答部分，实现更精细的响应控制。

Abstract: Vision-language models (VLMs) are expected to respond helpfully to appropriate requests while withholding compliance with requests that are incorrect, unsafe, infeasible, or unanswerable. However, existing benchmarks predominantly evaluate non-compliance at the level of the query as a whole, assuming that each request either warrants compliance or requires withholding compliance. In practice, real-world queries can contain a mixture of answerable content and components for which compliance should be withheld. In this paper, we introduce KoNA, a benchmark for evaluating selective non-compliance in VLMs across five categories: False Premise, Visual Inaccessibility, Universal Unknown, Task Feasibility, and Safety. Each task evaluates two capabilities: query-level non-compliance and component-level non-compliance under paired single and compound queries. Our evaluation across diverse VLMs shows that models often fail to refuse, correct, or abstain appropriately, and these failures become more pronounced when queries require selective non-compliance. To address this challenge, we fine-tune VLMs using KoNA examples that require selective non-compliance, together with a fully answerable set that should receive direct answers. Our fine-tuned models achieve substantial improvements in non-compliance accuracy while largely maintaining performance on fully answerable tasks. These results suggest that the fine-tuned models can distinguish between answerable components and those requiring non-compliance and respond in a task-appropriate manner.

[14] Beneath the Surface of Chains-of-Thought: A Mechanistic Interpretation of Reasoning Operations in LLMs cs.CLPDF

Seogyeong Jeong, Jaehui Hwang, Dongyoon Han, Geonmo Gu, Alice Oh

TL;DR: 这篇论文研究了大型语言模型在思维链推理过程中不同功能操作（如问题表述、目标分解和演绎）在隐藏表示空间中的几何结构。研究发现这些操作在隐藏表示中是可分离的，分离度在中间层达到峰值，并且这种结构不受词汇或位置混淆的影响。此外，研究还发现操作对齐的表示在块起始处依赖于先前的推理上下文，表明语言模型在语言推理表达与其内部几何结构之间保持了表征对应关系。

Details

Motivation: 尽管思维链推理中的不同操作在文本中可以被明确区分，但它们在表示空间中的几何组织方式尚不清楚。论文旨在探究不同的推理操作是否在隐藏表示中表现出相应的几何结构。

Result: 研究发现，在保留的隐藏表示中，不同的推理操作是可分离的，且分离度在模型的中间层达到峰值。通过注意力掩码干预实验进一步证实，块起始处的操作对齐表示依赖于先前的推理上下文。

Insight: 论文的创新点在于从机制解释的角度，揭示了语言模型内部几何结构与外部语言推理操作之间的对应关系，特别是操作分离的层间动态变化以及上下文依赖的表征对齐，这为理解LLM的推理机制提供了新的视角。

Abstract: Reasoning in large language models unfolds through diverse functional operations, such as problem formulation, goal decomposition, and deduction. Although these operations are explicitly distinguished in text, little is known about how they are geometrically organized in representation spaces. To this end, we investigate whether distinct reasoning operations exhibit corresponding geometric structure in hidden representations. We find that operations are separable in held-out representations, with separability peaking in middle layers, and verify that this structure is not explained by lexical or positional confounds. Across layers, token-wise operation-alignment becomes more distributed over spans, while identical surface tokens are represented differently depending on the operation of its surrounding chunk. Attention-masking interventions further show that operation-aligned representations at chunk onset depend on preceding reasoning context. Consequently, our work demonstrates that language models maintain representational correspondence between linguistic reasoning expressions and their internal geometric structures. Code and project materials are available at https://github.com/naver-ai/beneath-cot.

[15] Reinforcement Learning for improving Large Language Models’ Catalan text simplification capabilities cs.CL | cs.AIPDF

Arnau Ayguadé Domingo, Stefan Bott, Horacio Saggion

TL;DR: 本文研究利用强化学习提升大型语言模型在低资源语言（加泰罗尼亚语）文本简化任务上的性能。论文提出了一种结合SARI指标与特定惩罚项的新型奖励函数，并采用组相对策略优化方法引导模型生成特定简化风格。通过在英语ASSET数据集上对IberianLLM-7B-Instruct模型进行后训练，验证了该方法在加泰罗尼亚语基准测试上的有效性。

Details

Motivation: 自动文本简化技术对提升信息可访问性至关重要，但其发展速度未能跟上自然语言处理技术的快速演进，特别是在低资源语言领域。本文旨在通过强化学习改进大型语言模型在低资源语言文本简化任务中的表现。

Result: 在英语ASSET数据集上进行后训练后，模型在两个精心构建的加泰罗尼亚语基准测试上的自动文本简化性能得到提升，并成功抑制了先前观察到的负面行为。然而，通过将ASSET翻译为加泰罗尼亚语和西班牙语进行跨语言迁移学习的尝试，并未在域外基准测试上显示出显著改进。

Insight: 论文的创新点在于设计了一种结合SARI指标与特定惩罚组件的新型奖励函数，并采用组相对策略优化方法引导LLM生成目标简化风格。从客观角度看，将强化学习与针对低资源语言的风格引导相结合，为提升特定语言任务的模型性能提供了可借鉴的思路，尽管跨语言直接迁移的效果有限。

Abstract: Although automatic text simplification (ATS) is critical for accessibility, its progress has not matched the rapid evolution of broader natural language processing techniques. This paper investigates the application of reinforcement learning (RL) to improve the quality of ATS for low-resource languages using Large Language Models (LLMs). The paper introduces a novel reward function, designed to guide LLMs toward a targeted simplification style with Group Relative Policy Optimization (GRPO), that combines the SARI metric with specific penalty components. The effectiveness of GRPO with this reward function is motivated and demonstrated by post-training IberianLLM-7B-Instruct on the ASSET dataset. After post-training on the English ASSET, the model’s ATS performance improves on two curated Catalan benchmarks while also successfully suppressing previously observed negative behaviors. Cross-lingual transfer learning is explored by translating ASSET into Catalan and Spanish and post-training the model on each version, but these fail to show a significant improvement on the out-of-domain benchmark.

[16] Generating Constructive Feedback on Stories via Reinforcement Learning cs.CLPDF

Maja Stahl, Timon Ziegenbein, Henning Wachsmuth

TL;DR: 本文提出了一种基于强化学习的方法，用于引导大语言模型生成针对故事的、具有建设性的反馈。该方法通过组相对策略优化（GRPO）和一个新颖的多组件奖励函数进行训练，旨在使反馈更具针对性、可操作性和关键问题识别能力。在三个故事数据集上的自动和人工评估表明，该方法优于包括Gemini在内的SOTA大语言模型及其他基线模型。

Details

Motivation: 针对大语言模型作为自动写作助手时生成的反馈通常过于通用、缺乏可操作性且无法识别最关键写作问题这一局限性，本文旨在开发一种无需真实反馈数据即可生成建设性反馈的方法。

Result: 在三个故事语料库上的自动和人工评估中，该方法超越了包括Gemini在内的最先进大语言模型及其他竞争基线，达到了SOTA水平。

Insight: 核心创新点在于使用强化学习（GRPO）和专门设计的、旨在提升反馈建设性的多组件奖励函数来引导LLM，而无需依赖真实反馈数据。客观来看，将反馈的“建设性”分解为针对性、可改进性和关键问题识别等可量化的奖励组件，是一个值得借鉴的思路，其中可操作建议被证明是提升建设性的主要驱动力。

Abstract: Constructive feedback is crucial for creative writers to refine their storytelling abilities. Since receiving feedback from human experts is often costly and time-intensive, large language models (LLMs) offer a scalable and efficient alternative as automatic writing assistants. Despite their potential, research indicates that LLM-generated feedback is often generic, lacks actionability, and fails to identify which writing issue is most critical. To address these limitations, we present a reinforcement learning approach that steers LLMs to generate constructive feedback without the need for ground-truth feedback. We train our model using group relative policy optimization (GRPO) with a novel multi-component reward function aiming at constructiveness: it prioritizes feedback that is uniquely tailored to the story, helps to improve story quality, and addresses the most critical writing issue. In automatic and human evaluation across three story corpora, our approach outperforms state-of-the-art LLMs (including Gemini) and competitive baselines. We find that providing actionable suggestions is the main driver of feedback constructiveness.

[17] On Epistemic Diversity in Large Language Models cs.CLPDF

Elisabeth Kirsten, Nicole Krämer, Muhammad Bilal Zafar

TL;DR: 本文提出将认识论多样性作为大型语言模型（LLM）评估的新维度，强调模型在支持知识密集型任务时，不仅应提供准确答案，还应向用户展示多种有效答案、解释和推理路径。作者形式化了这一概念，并开发了一个初步的测量框架，发现前沿LLMs往往表现出认识论狭隘性，将广阔的答案空间压缩到很小的规范子集。

Details

Motivation: 当前LLM评估过于关注准确性或对齐性，而忽视了模型在回答、解释和教学时可能限制用户接触多种有效知识视角的风险，这促使作者从哲学和社会认识论中引入“认识论多样性”概念，以更全面地评估LLM在支持知识探索任务中的能力。

Result: 作者在两个领域对认识论多样性进行了操作化测量，发现前沿LLMs经常表现出认识论狭隘性，即反复将大量有效答案空间坍缩到很小的规范子集上。

Insight: 论文的创新点在于首次将哲学中的认识论多样性概念形式化并引入LLM评估领域，提出了一个超越准确性范式的评估新维度及其初步测量框架，这为未来开发能促进知识探索而非限制视野的LLM提供了重要方向。

Abstract: Large language models (LLMs) are increasingly used not only to retrieve information, but to answer questions, explain, teach, and support inquiry. In such settings, evaluation cannot be exhausted by accuracy or alignment alone. A system may give a correct answer while still narrowing users’ access %to knowledge. to alternative valid answers, explanations, or reasoning routes. Drawing on the broader notion of epistemic diversity in philosophy and social epistemology, we formalize it in the context of LLMs as the range of valid answers, explanations, and reasoning routes that an LLM exposes to users. We argue that epistemic diversity is a useful evaluation dimension for settings where LLMs are used to support knowledge-intensive tasks. We propose a preliminary framework for conceptualizing and measuring epistemic diversity in LLMs, and operationalize it in two domains. We find that frontier LLMs often exhibit epistemic narrowness, repeatedly collapsing large valid answer spaces onto small canonical subsets. These findings suggest that LLM evaluation should move beyond accuracy-oriented paradigms and treat epistemic diversity as an important dimension of model capability.

[18] MMTClinic: Multimodal, Multilingual Time Series Question Answering and Reasoning Benchmark for Clinical Domain cs.CL | cs.AIPDF

Sourav Malakar, Harshit Nigam, Akash Ghosh, Sriparna Saha, Amlan Chakrabarti

TL;DR: 本文提出了MMTClinic，一个用于评估大语言模型在临床时间序列数据上进行复杂推理和问答任务的多模态、多语言基准。该基准整合了文本、医学图像和多变量生理信号，包含30,000个涵盖五种语言（英语、印地语、孟加拉语、马拉地语和泰米尔语）的问答对，覆盖死亡率预测、心率预测和SOFA评分估计三个临床任务。

Details

Motivation: 当前缺乏能够反映真实世界临床场景复杂性的多模态、多语言且基于时间序列的基准，这阻碍了开发临床可靠且语言包容性强的医疗AI系统。

Result: 在零样本、少样本和思维链设置下评估了13个最先进的大语言模型，评估结果揭示了模型在不同任务、语言和模态间的性能存在显著差异，突显了当前临床推理能力的局限性。

Insight: 创新点在于构建了一个结合多模态（文本、图像、信号）、多语言和时间序列的综合性临床基准，为推进多语言、多模态且具备时间序列感知能力的医疗AI研究提供了宝贵资源。

Abstract: Time-series data in clinical settings is crucial for capturing dynamic changes in a patient’s health over time, enabling timely diagnosis, personalized treatment, and early detection of critical events. However, the development of clinically reliable and linguistically inclusive medical AI systems remains a significant challenge, primarily due to the lack of multimodal, multilingual, and time-series-grounded benchmarks that reflect the complexity of real-world clinical scenarios. To fill this gap, we present MMTClinic, a benchmark designed to evaluate large language models (LLMs) on complex reasoning and question-answering tasks involving clinical time-series. MMTClinic combines text, medical images, and multivariate physiological signals and includes 30,000 QA pairs (15,000 multiple choice questions (MCQs) and 15,000 open-ended questions) across five languages: English, Hindi, Bengali, Marathi, and Tamil. These questions cover three important clinical tasks—mortality prediction, heart rate forecasting, and SOFA score estimation. We evaluate 13 state-of-the-art LLMs in zero-shot, few-shot, and chain-of-thought settings. Our evaluation reveals notable differences in model performance across tasks, languages, and modalities, highlighting current limitations in clinical reasoning capabilities. MMTClinic provides a valuable resource for advancing multilingual, multimodal, and time-series-aware medical AI research. The dataset will be made publicly available on successful acceptance of the work.

[19] Leveraging Low-Level Symbolic Competences for Unsupervised Grounding in Hallucination Detection cs.CL | cs.AI | cs.IRPDF

Renato Vukovic, Hsien-chin Lin, Carel van Niekerk, Benjamin Ruppik, Michael Heck

TL;DR: 本文提出了一种利用LLM的低级符号能力（如SQL）进行无监督幻觉检测的方法。通过让LLM从参考文档构建SQL数据库，并在检测流程中基于该数据库对参考内容和生成响应进行推理，实现了一种神经符号检查机制。该方法在RAGTruth和DiaHalu数据集上表现优异，无需领域特定微调即可与SOTA方法竞争。

Details

Motivation: 解决LLM因推理过程不透明而难以检测幻觉（即生成事实错误或无依据内容）的问题，探索利用LLM已有的低级符号能力进行无监督检测。

Result: 在RAGTruth和DiaHalu幻觉检测数据集上，该方法改进了直接预测，并与最先进的幻觉检测方法竞争，且无需领域特定微调。

Insight: 创新点在于利用LLM固有的低级通用能力（如SQL）构建可解释的神经符号检查管道，为无监督幻觉检测提供了新思路，证明了低级符号能力在神经符号方法中的潜力。

Abstract: Hallucination-where a language model generates outputs that are factually incorrect or unsupported by the source-is a major challenge for both prompted and fine-tuned language models. Detecting hallucinations is difficult due to the opaque reasoning processes of LLMs, which often provide little insight into why a model’s output may be inaccurate. In this work, we investigate whether an LLM can use an alternative, low level, symbolic competence such as SQL for unsupervised hallucination detection in some high level task. For this, we make an LLM build an SQL database from reference documents. This SQL database is then used for reasoning over the reference and the sampled response in a hallucination detection pipeline that is grounded in the database, thereby providing a neurosymbolic checkup. On RAGTruth and DiaHalu hallucination detection datasets, we find that our approach improves on direct prediction and competes with state-of-the-art hallucination detection methods, while not requiring domain-specific fine-tuning. Instead it relies on a low-level general competence already present in LLMs. This warrants further investigation of low-level LLM competences in neurosymbolic approaches.

[20] A Structured Debate-Mixture-of-Agents Framework for Complex Clinical Diagnostic Decision Support cs.CL | cs.AIPDF

Chang Xia, Leilei Ouyang, Huimin Wang, Yong Zhao, Kang Li

TL;DR: 本文提出了一个名为Debate-Mixture-of-Agents (DMoA)的新型多智能体框架，旨在解决大型语言模型在复杂临床诊断任务中因单轮问答格式限制而表现不足的问题。该框架通过结构化、基于角色的交互来支持迭代式诊断推理。在包含297个罕见病病例和1719个挑战性病例的数据集上，DMoA相比GPT-4o基线显著提升了诊断准确性和安全性。

Details

Motivation: 大型语言模型在医疗任务中展现出潜力，但其单轮问答的交互模式无法反映实践中复杂的临床诊断过程，因此在复杂诊断场景中表现有限。

Result: 在两个数据集上，DMoA将最可能诊断的准确率提升了10.21个百分点，将安全率提升了11.36个百分点，显著优于GPT-4o基线。消融实验表明，性能提升不仅源于使用更多模型或生成长文本，也归功于结构化工作流程的贡献。

Insight: 论文的核心创新点是提出了一个结构化、基于角色的多智能体辩论框架（DMoA），以模拟临床会诊的迭代推理过程。客观来看，其将多智能体协作与特定领域（临床诊断）的工作流程设计相结合，为复杂决策任务提供了一种可借鉴的系统架构思路。分析还表明，框架设计（如4*2结构）、基础模型选择和计算资源（token预算）是影响性能的关键因素。

Abstract: Large language models (LLMs) show potential for medical tasks, but their single-turn question-answer format does not reflect how clinical diagnosis is performed in practice. As a result, they remain limited in complex diagnostic settings. We developed Debate-Mixture-of-Agents (DMoA), a novel multi-agent framework that structures role-based interaction to support iterative diagnostic reasoning. Base models and DMoA were evaluated on 297 rare disease cases and 1,719 challenging cases. Across both datasets, DMoA improved most likely diagnosis accuracy by 10.21 percentage points and safety rate by 11.36 percentage points over GPT-4o baseline. Ablation experiments showed that the gains were not simply due to the use of more models or longer outputs, but also reflected the contribution of the structured workflow. Further analyses examined how framework design, base model choice, and token budget affected performance. DMoA performed better with a 4*2 structure, stronger base models, and a larger token budget. These findings demonstrate the potential of DMoA for clinical tasks and suggest further investigation of multi-agent frameworks.

[21] From Vision to Language: Investigating Causal Information Flow in Multimodal Decision-Making cs.CL | cs.CVPDF

Davide Testa, Hugh Mee Wong, Alessandro Lenci, Bernardo Magnini, Albert Gatt

TL;DR: 本文研究了视觉语言模型在多模态决策中的跨模态信息流，通过层级的因果干预分析了视频-文本注意力路径，揭示了视觉信息主要在模型处理候选答案选项时被整合，并发现名词和动词在时空推理中扮演不同角色。

Details

Motivation: 旨在探究视觉语言模型的决策是否基于视觉证据，通过追踪视觉信息如何影响基于语言的决策来理解跨模态信息流。

Result: 在基于视频的生成式多选设置中，视觉信息主要在候选答案处理阶段被整合，名词作为语义锚点，动词在时序关系处理中更相关，且模型在跨视频帧重建时序信息方面存在困难。

Insight: 创新点在于应用层级因果干预分析注意力路径，揭示了视觉信息整合的关键阶段和名词/动词的不同作用，同时指出了模型时序推理的脆弱性可能源于语言偏见。

Abstract: Vision-Language Models are commonly evaluated through their final predictions, but understanding whether these decisions are grounded in visual evidence requires tracing how visual information contributes to language-based decisions. With this purpose in mind, we investigate cross-modal information flow in a video-based generative multiple-choice-like setting by applying a layer-wise causal intervention on video-text attention pathways. We target spatial, causal, and temporal visual reasoning. Our results show that visual information is mainly integrated while the model processes the candidate answer options, which serve as the primary textual grounding sites for the final decision. We further show that nouns play an important role as semantic anchors during multimodal enrichment, while verbs are more relevant when temporal relations are processed. Finally, we identify a distinct pattern in temporal reasoning, suggesting that VLMs struggle to reconstruct sequential information across video frames, but we remark that such fragility may also reflect linguistic biases associated with specific temporal expressions used for defining the relation between events within a scene.

[22] Compression Beyond the Uncompressed: A Two-Stage Training Recipe for Soft Context Compression in RAG cs.CLPDF

Shuyu Guo, Shuo Zhang, Zhaochun Ren

TL;DR: 本文提出了一种名为DEX-Comp的两阶段训练方法，用于解决RAG系统中检索上下文过长导致推理效率低下的问题。该方法通过纯蒸馏和硬探索两个阶段，训练软上下文压缩模型，在保持性能的同时大幅压缩上下文长度并提升推理速度。

Details

Motivation: 现有软上下文压缩方法通常通过蒸馏未压缩RAG系统的输出来训练，其性能受限于原始模型。本文旨在突破这一限制，探索压缩表示下更优的计算模式。

Result: 在五个开放域QA基准测试上，DEX-Comp将检索上下文压缩了16倍，推理速度提升了4到24倍，并且在从top-5到top-30的不同检索深度下，性能达到或超过了未压缩的RAG基线。

Insight: 核心创新在于两阶段训练策略：先用纯蒸馏在正确响应上预热模型，再用强化学习在原始模型失败的查询上进行硬探索，迫使模型学习适应压缩表示的新模式。这突破了传统蒸馏的性能上限，实现了压缩而不降质。

Abstract: Retrieval-Augmented Generation (RAG) enhances language models with external knowledge, but the lengthy retrieved context inflates the input and degrades inference efficiency. Soft context compression encodes each document into a substantially shorter embedding sequence. However, most existing approaches are trained by distilling outputs from uncompressed RAG systems, inherently limiting their performance relative to the original model. To address this limitation, we propose DEX-Comp, a two-stage training recipe: Pure Distillation warm-starts the compression model on the uncompressed RAG’s correct responses only, and Hard Exploration then runs reinforcement learning solely on queries the uncompressed RAG fails, forcing the model to explore computation patterns better suited to compressed representations. On five open-domain QA benchmarks at retrieval depths from top-5 to top-30, DEX-Comp compresses retrieved contexts by $16\times$ and accelerates inference by $4\times$–$24\times$, while achieving performance comparable to or exceeding the uncompressed RAG baseline across retrieval depths. Ablations and evaluations across diverse datasets and backbones further confirm the contribution of each stage and the generalization of our approach.

Yumiao Li, Peixin Liu, Donglin Di, Chen Li, Runhuan Feng

TL;DR: 本文提出使用大型语言模型（LLMs）作为政策评估工具，以预测中国灵活就业人员的养老金参保行为。作者开发了首个针对该领域的专用模型FlexPension-LLM，并引入DKI-RDistill方法，通过注入基于政策的提示线索（如Probit边际效应和户籍省份养老金规则）和利用LoRA/SFT进行知识蒸馏，提升预测性能。

Details

Motivation: 评估社会政策变化的影响是政策制定者面临的挑战，传统计量经济学方法在假设情景下可能不可靠，而实地试点项目成本高昂。因此，研究探索将通用大型语言模型适配为政策评估工具，以更高效、低成本地预测政策行为响应。

Result: 在CHFS 2019盲分测试集上，FlexPension-LLM取得了0.9316的复合F1分数，超越了其教师模型Claude Sonnet 4.5和17个基线中的15个，且与Claude Opus 4.6在统计上无显著差异。在四个外部调查中，平均复合F1为0.7549，且在最强系统中表现出最窄的性能波动范围。

Insight: 创新点在于将政策依据（如边际效应和具体规则）作为提示线索注入LLM，并结合错误过滤的监督蒸馏（通过教师模型在真实标签下重新生成错误案例）来提升模型性能。这为LLM在政策模拟领域的专业化应用提供了可借鉴的框架，即通过领域知识增强和迭代纠错来改善预测可靠性和可解释性。

Abstract: Assessing the impacts of social policy changes is a widely acknowledged challenge for policymakers. Econometric methods can be unreliable when extrapolating to hypothetical scenarios, while field pilot programs are highly costly. In this paper, we propose using large language models (LLMs) as policy-assessment tools adapted from general-purpose models. We present FlexPension-LLM, the first domain-specialized large language model for a hierarchical pension-enrollment prediction task among flexible workers in China, and introduce DKI-RDistill, which injects policy-grounded cues into the prompt, including Probit-derived marginal effects and hukou-province pension rules. The method then uses LoRA/SFT to distill rationale-augmented supervision into an open-weight MoE student, with teacher errors corrected by regenerating those cases under ground-truth labels. On a CHFS 2019 blind split, FlexPension-LLM achieves 0.9316 Composite F1, surpassing its Claude Sonnet 4.5 teacher and 15 of 17 baselines, and is statistically indistinguishable from Claude Opus 4.6. Across four external surveys, it averages 0.7549 Composite F1 and shows the narrowest performance range among the strongest systems. Component analysis shows that gains come mainly from policy-grounded cue injection and error-filtered supervision, while rationales provide decision traces that can be checked against policy rules.

[24] A Verifier-Guided Explainable Reasoning Framework with Gold-Anchored QLoRA, Task-Aware Mixture-of-Experts, and Group-Relative RLVR cs.CL | cs.AI | cs.LGPDF

Thi Kim Trang Vo, Nam Tien Le, Thi Kim Nguyet Vo, Minh Khang Tran, Duy Phuong Tran

TL;DR: 本文提出了一种验证器引导的可解释推理框架，用于透明教育问答。该框架结合了黄金锚定QLoRA、任务感知符号路由和组相对RLVR，旨在提升大语言模型在逻辑和物理问题上的推理可解释性和答案可靠性。

Details

Motivation: 解决大语言模型在推理过程中解释不一致、缺乏依据或难以验证的问题，特别是在教育问答场景下，需要透明且可验证的推理过程。

Result: 在438个保留测试样本上，RLVR将推理深度和可解释性（P3）从50.68%提升至72.20%，而混合答案正确率（P1）保持在大约55.94%。自一致性将纯模型P1从48.86%提升至50.23%，符号验证则贡献了剩余的混合性能增益。

Insight: 创新点在于构建了一个多阶段、多验证器协同的框架：使用黄金答案锚定QLoRA进行监督微调，通过任务感知路由将问题分发给形式逻辑（FOL/Z3）或物理符号求解器，并利用验证器反馈指导RLVR训练和推理时的自修正。该框架将神经模型的灵活性与符号系统的严谨性相结合，分别强化了推理结构和答案可靠性。

Abstract: Large language models (LLMs) show strong reasoning ability, but their explanations can remain inconsistent, weakly grounded, or difficult to verify. We propose a verifier-guided explainable reasoning framework for transparent educational question answering that combines gold-anchored QLoRA, task-aware symbolic routing, and group-relative RLVR. Qwen2.5-3B-Instruct is first adapted with field-weighted QLoRA supervision anchored to authoritative answers. A lightweight router then assigns logic problems to a FOL/Z3 verifier and physics problems to a formula- and unit aware symbolic solver. Verifier feedback is further used to support candidate evaluation, self-revision, and reward construction during RLVR. Candidate responses are evaluated along three complementary dimensions: P1 for answer correctness, P2 for evidence or unit consistency, and P3 for reasoning depth and explainability. At inference, gold-free self-consistency aggregates multiple candidate responses before an optional question-only physics verifier performs conservative system-level correction. On 438 held-out examples, RLVR increases P3 from 50.68% to 72.20%, while hybrid P1 remains approximately stable at 55.94%. Self-consistency improves model only P1 from 48.86% to 50.23%, with symbolic verification providing the remaining hybrid gain. These results indicate that RLVR primarily strengthens explicit reasoning structure, while symbolic verification complements the neural policy by improving answer reliability at the system level.

[25] WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Data cs.CLPDF

Ji Soo Lee, Xilun Chen, Pierce Chuang, Ashish Shenoy, Jason Wei

TL;DR: 本文提出了WearableQA基准测试，用于评估AI系统对真实用户可穿戴设备记录的纵向数据进行健康推理的能力。该基准包含来自200名真实用户、长达500天测量的4084道10选项多选题，涵盖可穿戴时间序列、血液生物标志物和人口统计数据，并保留了包含设备噪声和个体间差异的真实数据分布。

Details

Motivation: 现有基准很少评估AI系统是否能够对真实用户的纵向可穿戴记录进行推理，而可穿戴传感技术的进步使得连续监测生理和行为信号成为可能，因此需要一个新的基准来填补这一空白。

Result: 在14个专有和开源LLM上的评估表明，WearableQA能有效区分模型能力，准确率在19.6%到72.9%之间（随机基线为10%），且大多数模型准确率低于60%，说明该问题远未解决。

Insight: 论文的创新点在于提出了一个双轴（数据推理vs健康推理、单信号vs跨信号推理）的16种问题类型分类法，以及一个结合文献基础和统计验证的群体基础生理模式的双重锚定框架，用于大规模构建可靠问题，从而捕捉真实世界可穿戴数据中有意义的关系。

Abstract: Recent advances in wearable sensing enable continuous monitoring of physiological and behavioral signals, yet existing benchmarks rarely evaluate whether AI systems can reason over a real user’s longitudinal wearable record. We introduce WearableQA, a benchmark comprising 4,084 10-option multiple-choice questions constructed from the wearable time series, blood biomarkers, and demographics of 200 real users, each with up to 500 days of daily measurements. WearableQA preserves authentic wearable distributions that include device noise and inter-individual variability. To evaluate distinct reasoning capabilities, we introduce 16 question types organized along two complementary axes: data versus health reasoning, which distinguishes computation over longitudinal measurements from physiological interpretation; and single- versus cross-signal reasoning, which separates reasoning about individual signals from the integration of multiple signals. To construct reliable questions at scale, we adopt a dual-grounding framework that combines literature-grounded physiological findings with statistically validated population-grounded physiological patterns. This enables the capture of meaningful relationships observed in real-world wearable data. Evaluation of 14 proprietary and open-source LLMs demonstrates that WearableQA effectively differentiates model capabilities, with performance ranging from 19.6% to 72.9% against a 10% chance baseline. Moreover, WearableQA remains far from solved: most models achieve accuracies below 60%. Overall, WearableQA provides a realistic and diagnostic benchmark for evaluating LLM reasoning over real-world wearable data.

cs.CV [Back]

[26] FailSAE: Towards Interpretable Failure Prediction for Vision-Language Models via Sparse Autoencoders cs.CVPDF

Jie Ma, Zongxi Liu, Yi Zhu

TL;DR: 本文提出FailSAE框架，利用稀疏自编码器（SAE）对视觉语言模型（如CLIP）进行可解释的失败预测。该方法将失败预测建模为对SAE稀疏潜在激活的分类任务，并通过三阶段训练流程提升预测性能与可解释性。实验表明，该框架在失败预测上优于基线方法，并能通过概念级分析揭示模型失败时表征的转变，以及支持运行时失败恢复。

Details

Motivation: 随着视觉语言模型（VLMs）在高风险领域应用增多，失败预测对风险感知部署和人工干预至关重要。现有方法多依赖置信度分数或辅助分类器，虽有效但可解释性有限。

Result: 在失败预测任务上，提出的框架优于所评估的基线方法。进一步分析表明，失败感知训练促使SAE潜在方向捕获更多类别特定概念。

Insight: 创新点在于将稀疏自编码器用于VLM的可解释失败预测，并设计了三阶段训练流程以平衡可解释性与信息量。该方法能进行概念级分析，揭示模型失败时表征从类别特定概念向模糊或风格相关概念的转变，并探索了利用学习到的潜在方向支持运行时失败恢复的潜力。

Abstract: Vision-language models (VLMs), such as CLIP, have achieved strong performance across multimodal tasks by aligning visual and textual representations in a shared embedding space. As VLMs are increasingly used for high-stakes domains, failure prediction becomes critical for risk-aware deployment and human intervention. Existing failure prediction methods typically rely on confidence scores or auxiliary classifiers. Although these methods are effective on predicting VLM failures, they provide limited interpretability. In this work, we investigate the use of Sparse Autoencoders (SAEs) for interpretable failure prediction in VLMs. We formulate failure prediction as a classification task over sparse SAE latent activations and introduce a three-stage failure-aware training pipeline that encourages the learned latent directions to remain interpretable while becoming more informative for failure prediction. Our experiments show that the resulting framework outperforms the evaluated baselines in failure prediction. Further analysis suggests that failure-aware training encourages SAE latent directions to capture more class-specific concepts. We also use the SAE to provide a concept-level analysis of how model representations change during failures, revealing a shift from class-specific concepts toward more ambiguous or style-related concepts. Finally, we explore how the learned SAE latent directions can support runtime failure recovery.

[27] Step Back to Move Forward: Reflection-Aware Preference Optimization for Visual Generation cs.CVPDF

Junlong Wu, Jiuzhou Lin, Jia Sun, Boheng Zhang, Huaiqing Wang

TL;DR: 本文提出了一种名为RA-GRPO的基于强化学习的偏好对齐框架，用于优化扩散生成模型。其核心思想是通过在优化过程中引入’向后反思’来改进’向前’生成，具体包括扩散反射和反事实路径合成两个关键技术。实验表明，该方法在文本到图像和文本到视频任务上显著优于现有方法，能有效缓解奖励破解并提升泛化能力。

Details

Motivation: 现有基于策略梯度的强化学习方法用于对齐生成模型与人类偏好时，探索效率低下，容易陷入局部最优，导致语义忠实度和视觉真实感下降。

Result: 在文本到图像和文本到视频模型上的大量实验表明，RA-GRPO显著优于现有方法，特别是在缓解奖励破解和提升泛化能力方面。

Insight: 创新点在于将’反思’机制引入强化学习优化过程，通过扩散反射修正采样轨迹，并利用反事实路径合成将修正轨迹的知识隐式蒸馏到策略中，实现了无推理开销的基于搜索的探索收益。该方法与架构无关，易于集成到标准流程中。

Abstract: Diffusion models have become the mainstream paradigm for modern visual generation and have substantially advanced multimedia content synthesis, especially in text-to-image and text-to-video tasks. To further align such generative models with human preferences, reinforcement learning (RL) has recently shown strong potential as a post-training strategy. Nevertheless, existing policy gradient-based methods often explore inefficiently, making them vulnerable to local optima that may degrade semantic faithfulness and visual realism. To address these challenges, we present Reflection-Aware GRPO (RA-GRPO), a new RL-based preference alignment framework for diffusion generative models. The core idea is to improve “forward” generation by incorporating “backward” reflection during optimization. We first introduce Diffusion Reflection, which rectifies intermediate sampling trajectories by inverting the diffusion process with a weak estimator, guiding latent states toward higher-probability regions of the true data manifold. Furthermore, we introduce Counterfactual Path Synthesis to implicitly distill these rectified trajectories into the policy, enabling the model to internalize the benefits of search-based exploration without incurring inference-time overhead. Extensive experiments on T2I and T2V models demonstrate that RA-GRPO significantly outperforms existing methods, particularly in mitigating reward hacking and improving generalization. The method remains architecture-agnostic and integrates seamlessly with standard pipelines, suggesting a promising direction for stable preference alignment.

[28] When Seeing Overrides Knowing: Visual Dominance and Deferral-Based Method for Personalized Safety in VLMs cs.CV | cs.AI | cs.LGPDF

Edward Sun, Yuchen Wu, Zixian Ma, Eric Hanchen Jiang, Yijia Xiao

TL;DR: 本文研究了视觉语言模型（VLMs）在个性化安全场景下的问题，即模型因缺乏用户特定上下文（如医疗、情绪或情境）而可能产生对特定用户不安全的响应。作者构建了MPS-Bench基准测试，包含5,181个高风险场景，评估发现现有VLMs几乎总是直接响应而非寻求缺失上下文，个性化安全得分很低。通过分析，作者揭示了视觉主导现象：视觉信息在早期层就进入文本表示并抑制文本风险信号。基于此，提出了PRISM轻量级输入监控器，通过双向跨模态调制预测何时需要延迟响应，在安全-效用帕累托前沿上表现优异。

Details

Motivation: 解决VLMs在高风险部署中因缺乏用户个性化上下文而可能产生不安全响应的问题，即个性化安全挑战。

Result: 在MPS-Bench基准（12个高风险领域的5,181个场景）上评估八个前沿VLM，发现其个性化安全得分最高仅2.6/5，且86-99%情况下直接响应而非寻求上下文。提出的PRISM方法实现了0.978 AUC，在所有测试模型的安全-效用帕累托前沿上严格占优。

Insight: 揭示了VLMs中视觉主导的因果机制：视觉情感在早期层转移到文本流并塑造最终决策，导致后期内部补救不可靠；创新性地提出基于双向跨模态调制的延迟预测监控器PRISM，以轻量方式提升个性化安全。

Abstract: Vision-language models (VLMs) are increasingly deployed in high-stakes settings, where a response that is reasonable in general may still be unsafe for a particular user whose medical, emotional, or situational context is unknown to the model. We study this problem of personalized safety in multimodal systems and introduce MPS-Bench, a benchmark of 5,181 scenarios from 584 real-world images across 12 high-risk domains, each paired with a hidden user profile. Evaluating eight frontier VLMs, we find that they almost always respond directly (86-99%) rather than seek missing context, and none exceeds 2.6/5 on personalized safety. To understand why these failures arise, we analyze multimodal interactions and identify visual dominance: visual information enters text representations early and suppresses textual risk signals during multimodal fusion. Causal interventions reveal a two-stage mechanism in which visual affect is first transferred into the text stream in early layers and then shapes the final decision through this altered text representation, making late-stage internal remediation unreliable. Motivated by this mechanism, we propose PRISM, a lightweight input monitor that uses bidirectional cross-modal modulation to predict when a query is likely to require deferral. PRISM achieves 0.978 AUC and strictly dominates the safety-utility Pareto frontier across all tested models.

[29] Joint Alignment and Distillation for Video Generation via Sample-Guided Distribution Matching cs.CVPDF

Jiuzhou Lin, Junlong Wu, Fei Zuo, Huan Ouyang, Dewen Fan

TL;DR: 本文提出了一种基于分布匹配的统一单阶段优化框架DM-Align，用于视频生成模型的联合对齐与蒸馏。该方法通过结合真实样本引导的梯度方向和人类偏好引导的梯度方向，在提升生成保真度的同时对齐人类偏好，避免了传统强化学习的高计算成本和模型崩溃问题。

Details

Motivation: 现有方法通常将强化学习（RL）与蒸馏作为分离阶段，导致计算成本高昂或模型崩溃。本文旨在克服这些限制，通过一个统一的单阶段框架同时实现高质量蒸馏和偏好对齐。

Result: 在多个基础视频模型上的综合实验表明，该框架在蒸馏质量和偏好对齐方面均稳健提升，一致优于独立的变体方法和顺序的两阶段流程。

Insight: 创新点在于将偏好对齐问题转化为分布匹配框架内的互补梯度方向构建，灵感来源于DPO和GRPO，通过偏好对或组内探索的分布差异直接构建偏好引导梯度，从而避免了传统RL的多步奖励评估和复杂的ODE-SDE转换。

Abstract: Aligning video generative models to human preferences heavily relies on Reinforcement Learning (RL), which suffers from extensive computational overhead. Existing workflows typically treat RL and distillation as disconnected stages: applying RL before distillation incurs prohibitive computational costs, whereas applying RL after distillation frequently leads to model collapse. To overcome these limitations, we propose a unified, single-stage optimization framework grounded in Distribution Matching (DM). In the standard DM framework, distillation updates the model via a gradient direction that minimizes the gap between the real and fake models, guiding generations toward clarity and high fidelity. Building upon this, we introduce DM-Align, which derives a complementary gradient direction to guide the model toward human-preferred samples. Inspired by DPO and GRPO, our method leverages the distributional gap – formulated from either preference pairs or intra-group exploration – to directly construct this preference-guided gradient. By synergizing these two gradient directions, our approach eliminates the need for multi-step reward evaluation and complex ODE-SDE conversions inherent in traditional RL. Comprehensive experiments across multiple foundational video models demonstrate that this sample-guided framework robustly enhances both distillation quality and preference alignment, consistently outperforming both standalone variants and sequential two-stage pipelines.

[30] AdaptVPR: Route-Aware Hard Positive Generation for Robust Visual Place Recognition cs.CVPDF

Shunpeng Chen, Jingyi Zhang, Changwei Wang, Shengpeng Xu, Yukun Song

TL;DR: 本文提出AdaptVPR，一种用于视觉地点识别的路由感知生成式数据增强框架，旨在通过生成同一地点的困难正样本来提升模型在光照、天气、季节变化和动态遮挡等域偏移下的鲁棒性。该方法利用视觉语言模型解析场景属性并估计编辑可行性，通过基于规则的调度器决定生成路径，最终构建了包含16万张已验证合成图像的AdaptCities数据集。

Details

Motivation: 现有视觉地点识别训练数据中同一地点的外观多样性有限，导致模型在面对域偏移时鲁棒性下降。

Result: 在多个VPR基准模型和视觉基础骨干网络上的实验表明，该方法在标准基准测试上带来了一致的性能提升，并在挑战性域偏移下实现了显著改进，R@1指标最高提升9.2%。

Insight: 创新点在于提出了一个分解式的、路由感知的生成框架，将全局外观变化、局部遮挡插入及二者组合的扰动路径解耦，并引入了基于几何一致性和外观多样性的VPR导向验证方案来确保生成质量，避免了结构漂移。

Abstract: Visual Place Recognition (VPR) localizes a query image by retrieving database images of the same or nearby place, yet its robustness is often degraded by domain shifts arising from illumination, weather, seasonal changes, and dynamic occlusions. One contributing factor is the limited appearance diversity of the same place in existing training data. To address this issue, we propose AdaptVPR, a route-aware generative augmentation framework that constructs same-place hard positives for robust VPR training. AdaptVPR first uses a vision language model to parse scene attributes and estimate editing feasibility, while a rule-based scheduler determines the generation route according to editability scores and risk constraints. The generation process is decomposed into three complementary routes: the Global Appearance Route introduces global scene changes in weather, illumination, and time of day; the Local Occlusion Route inserts plausible dynamic occluders; and the Dual Route combines both types of perturbations to produce more challenging appearance shifts. Each generated candidate is evaluated using a VPR-oriented verification scheme based on geometric consistency and appearance diversity, reducing the risk of structural drift while ensuring sufficient appearance variation. Global candidates are generated once and rejected if verification fails, while Local Occlusion and Dual candidates use verification feedback for limited prompt refinement and regeneration. Using this framework, we construct AdaptCities, containing 160K verified synthetic same-place hard positives. Experiments across multiple VPR baselines and vision foundation backbones show consistent gains on standard benchmarks and substantial improvements under challenging domain shifts, with R@1 gains of up to 9.2%. The source code and data resources are publicly available at https://github.com/chenshunpeng/AdaptVPR.

[31] Object Concepts Emerge from Motion cs.CVPDF

Boshi Li, Xiaohui Wang, Xiaoyang Wu, Zhichao Li, Ya Yang

TL;DR: 本文提出了一种从原始视频中学习以物体为中心的视觉表征的生物启发框架，通过运动边界作为物体级分组的来源，利用光流和聚类生成伪实例掩码，并通过像素级成对度量学习来监督单图像编码器。该方法无需人工标注或相机标定，从大量驾驶和网络视频中获取数亿帧伪标签数据，并通过运动验证自训练扩展监督。训练出的编码器在单目深度估计、3D物体检测、3D占用预测和端到端规划等任务上达到了与监督和自监督预训练基线相当或更优的性能，尤其在几何和实例敏感任务上表现出色。

Details

Motivation: 现有视觉预训练方法通常捕获语义类别，但未能保留单个实例的身份和连贯性，而物体中心表征对于物理世界感知至关重要。本文旨在从原始视频中学习静态图像编码器，以表示视觉实例，为可扩展的视觉预训练提供补充方向。

Result: 在单目深度估计、3D物体检测、3D占用预测和端到端规划等任务上，该方法实现了与监督和自监督预训练基线竞争或更优的性能，特别是在几何和实例敏感任务上表现出强大的迁移能力。

Insight: 创新点在于利用运动边界作为无监督的物体级分组信号，通过光流和聚类生成伪实例掩码进行监督，并结合运动验证自训练扩展数据规模。客观分析认为，该方法提供了一种无需人工标注或相机标定的可扩展预训练途径，强调了运动信息在物体中心表征学习中的关键作用。

Abstract: Object-centric visual representations are important for physical-world perception, but existing visual pretraining methods often capture semantic categories without preserving the identity and coherence of individual instances. We present a biologically inspired framework that learns object-centric representations for single images from raw videos. Our approach uses motion boundaries as a source of object-level grouping: off-the-shelf optical flow and clustering produce pseudo-instance masks, which supervise a single-image encoder with pixel-level pairwise metric learning. The framework requires neither human annotations nor camera calibration. We first obtain 195 million pseudo-labeled frames from 7,163 hours of driving and web videos, then expand the supervision to 421 million frames with Motion-Verified Self-Training, which combines model proposals with motion evidence. We train encoders up to Swin-H and distill the learned representations into a family of Swin backbones. Across monocular depth estimation, 3D object detection, 3D occupancy prediction, and end-to-end planning, the resulting models achieve competitive or superior performance relative to supervised and self-supervised pretraining baselines, with particularly strong transfer on geometry- and instance-sensitive tasks. These results show that motion-derived supervision can teach static image encoders to represent visual instances, providing a complementary direction for scalable visual pretraining.

[32] What Moves? Localized Motion Representations for Compositional Scene Control cs.CV | cs.AIPDF

Frank Fundel, Malek Ben Alaya, Thomas Ressler-Antal, Stefan Andreas Baumann, Björn Ommer

TL;DR: 本文提出了一种可提示的局部运动表示方法，用于对视频中用户指定的区域生成持久且一致的嵌入，从而实现对动态场景的合成控制。该方法通过处理完整视频并直接基于查询区域进行运动编码，在保留全局上下文的同时分离局部动态。

Details

Motivation: 现实世界的动态本质上是组合性的：多个实体在共享场景中同时运动，各自表现出不同的运动模式。然而，现有视频表示大多全局编码运动，未能明确捕获单个实体的局部运动，且裁剪或掩码后处理会丢弃解释运动所需的上下文信息。

Result: 在物体级运动转移和多参与者视频中的局部动作分类任务上，该方法提升了可控性，并优于通过裁剪或事后掩码实现的全局表示方法。

Insight: 创新点在于提出了一种直接基于空间掩码查询区域进行条件化运动编码的架构，能够生成时间一致、区域可寻址的嵌入，在隔离局部动态的同时保留消除歧义所需的全局上下文，从而支持更精细的场景组合控制。

Abstract: Real-world dynamics are inherently compositional: multiple entities move simultaneously within a shared scene, each exhibiting distinct motion patterns. Yet most existing video representations encode motion globally, without explicitly capturing localized motion for individual entities. Crucially, motion is defined relative to a global reference frame, including camera motion and scene layout. However, localized embeddings are often computed from cropped images or obtained by masking features after encoding, discarding the context needed to interpret motion. To address this, we introduce a promptable localized motion representation that produces persistent embeddings for user-specified regions defined by spatial masks. Rather than cropping the input or masking features, our model processes the full video and conditions motion encoding directly on the queried region. This yields temporally consistent, region-addressable embeddings that isolate local dynamics while retaining the global context required for disambiguation. We demonstrate object-level motion transfer, enabling controlled composition of dynamic scenes. Beyond generative control, our embeddings support localized action classification in multi-actor videos. Across both tasks, our approach improves controllability and outperforms global representations localized through cropping or post-hoc masking. Project Page: https://compvis.github.io/WhatMoves

[33] Where Appearance Fails, Geometry Recognizes: A CAD-Free 3D Shape Prior That Complements Vision Foundation Models cs.CV | cs.AI | cs.ROPDF

Chenxi Tao, Seung-Kyum Choi

TL;DR: 本文提出了一种无需CAD模型的3D形状先验方法，用于增强视觉基础模型在识别几何相似、低纹理工业零件时的性能。该方法通过3D高斯泼溅（3DGS）从RGB-D扫描中重建物体，生成每类形状原型，并与冻结的DINOv2图像特征融合，以补充外观特征的不足。

Details

Motivation: 解决在缺乏标注训练集和CAD模型的情况下，机器人识别特定物体（尤其是几何相似、纹理稀疏的工业零件）的挑战，探索如何利用短时物体中心扫描提供的几何信息来提升识别能力。

Result: 在HOPE和T-LESS基准测试中，几何先验与图像特征融合后，识别性能均得到提升：在形状差异明显的HOPE数据集上，融合方法达到0.872（纯几何0.920，纯图像0.832）；在形状易混淆的T-LESS数据集上，从0.560提升至0.591，且对遮挡更具鲁棒性。

Insight: 创新点在于提出了一种CAD无关的3D形状先验，可有效补充视觉基础模型；几何信息（而非渲染像素）是提升识别的关键，且该先验具有互补性，能显著挽救图像识别失败案例，而对成功案例影响较小。

Abstract: Recognizing specific objects onboarded without a labeled training set recurs across manufacturing and service robotics, yet the conventional renderable prior, a computer-aided-design (CAD) model, is often unavailable. Two-dimensional capture supplies no shape prior, and frozen foundation features fail on geometrically similar, low-texture industrial parts. We ask what a short object-centric scan buys for recognition beyond the captured images themselves: each object is reconstructed with 3D Gaussian Splatting (3DGS), summarized into a per-class shape prototype, and fused with frozen DINOv2 image features. First, the scan recovers the recognition value of CAD without CAD: geometry from RGB-D depth (on T-LESS), 3DGS, and CAD gives comparable recognition (tied on HOPE, within 1.6 points on T-LESS); 3DGS is only a convenient route to a point cloud. Second, the payoff is governed by how recognizable the shape is: on shape-distinctive household objects (HOPE) geometry alone reaches 0.920 versus image-only 0.832, a ceiling below which fixed-weight fusion (0.872) sits. On shape-confusable textureless industrial parts (T-LESS) the gain is modest but consistent (0.560 to 0.591 fused, above both single signals). Third, the prior is complementary, not uniformly additive: it rescues far more image failures than it breaks successes, and its benefit grows under partial occlusion. Finally, the worth lies in geometry, not rendered pixels: 3DGS renderings do not help the image side, and frozen-feature recognition is nearly lighting-invariant (within 2.5 points). The study is scoped to recognition, not the BOP pose benchmark.

[34] FAVE: Foveated Adaptive Visual Encoding for Efficient Fine-Grained Visual Understanding cs.CVPDF

Amitangshu Mukherjee, Kaushik Roy

TL;DR: 本文提出了FAVE（Foveated Adaptive Visual Encoding），一种轻量级的可变分辨率视觉Transformer，用于高效细粒度视觉理解。它通过对外部选定的区域进行高分辨率编码，同时保持原始几何结构，以补充全局视觉表示。

Details

Motivation: 细粒度视觉理解依赖于局部细节，但现有视觉编码器面临高分辨率全图处理成本高昂与全局编码可能削弱局部证据之间的权衡。受人类主动视觉启发，论文旨在将“看哪里”与“编码什么”分离，并专注于后者。

Result: 在受控小物体场景（ImageNet中最大边长为96像素的物体）上，FAVE比固定分辨率ViT在相同裁剪窗口上的Top-1准确率提高了9.4个百分点，且FLOPs降低了12.7倍。集成到FastVLM中作为局部分支后，在TextVQA上提升了1.60分，实现了3.3倍的受控TTFT加速，并在GQA属性问题上将FastVLM-1.5B提升了1.31分。

Insight: 核心创新在于将高分辨率处理能力选择性地分配给关键局部区域，而非均匀提升全局分辨率，这为细粒度理解（如小物体、文本和属性）提供了一种高效补充全局表示和模型缩放的新途径。其可变分辨率ViT设计能保持几何结构，且与现有全局模型（如FastVLM）的集成仅需冻结大部分参数，通过少量额外token即可显著提升性能。

Abstract: Fine-grained visual understanding depends on local detail, yet visual encoders face a trade-off between costly full-image high-resolution processing and compact global encoding that can weaken such evidence. Inspired by human active vision, we separate where to look from what to encode. We focus on the latter and introduce FAVE (Foveated Adaptive Visual Encoding), a lightweight variable-resolution ViT that encodes externally selected regions at high acuity while preserving native geometry. We first isolate this encoding problem using oracle ground-truth crops in a controlled small-object regime. On ImageNet objects with a native maximum side of 96 pixels, FAVE improves Top-1 by 9.4 points over a fixed-resolution ViT on the same crop window with 12.7 times lower FLOPs. Increasing global resolution or backbone capacity does not recover the same operating point. We then integrate FAVE as a complementary local branch in FastVLM. Its local tokens are combined with FastVLM’s global visual tokens, while the original global pathway and language model remain frozen. With at most 16 additional local tokens, FAVE improves TextVQA by 1.60 points and achieves a 3.3 times controlled TTFT speedup over SmolVLM2-2.2B. On GQA attribute questions, it improves FastVLM-1.5B by 1.31 points, extending the benefit beyond text while narrowing the gap to FastVLM-7B. Together, these results show that selectively allocating high-acuity local capacity provides an efficient complement to broader global representations and model scaling for fine-grained understanding of small objects, text, and attributes.

[35] ICM-Bench: Person-Level Identity Reasoning in Multimodal Agents with Long-Term Memory cs.CVPDF

Shidu Ren, Yunze Liu, Xing Liu, Chi-Hao Wu, Enmin Zhou

TL;DR: 本文提出了ICM-Bench，这是首个专门评估多模态智能体在长视频记忆中基于人物身份进行推理能力的基准测试。该基准包含839个合成视频片段和1217个关于六个反复出现的成年人的开放式问题，用于测试智能体如何将跨时间的面孔、声音、姓名、物品、事件和社会关系关联到一致的身份上。实验比较了多种方法，发现当前系统（如Gemini 3.1 Pro）在事件记忆上表现尚可，但在需要构建长期身份档案的推理任务上仍有不足。

Details

Motivation: 现有的长视频和多模态智能体基准主要测试广泛的记忆问答能力，但未能专门评估智能体维持反复出现的人物身份并对其跨时间关系进行推理的能力。

Result: 在ICM-Bench上，Gemini 3.1 Pro取得了74.0%的最高总体准确率，但在需要长期身份档案的问题上，其得分降至60.3%。结果表明，当前系统能恢复许多事件级记忆，但在围绕稳定人物积累证据进行推理时仍不可靠。

Insight: 论文的主要创新点是提出了首个以身份为中心的长期记忆推理基准（ICM-Bench），并设计了一个主题可配置的流水线来生成视频和可追溯证据的问题。这为评估和推动智能体在人物级身份推理这一关键能力上的发展提供了专门的测试平台。

Abstract: Long-horizon multimodal agents should remember not only what happened but also who participated. This capability depends on linking recurring faces, voices, names, person-associated objects, events, and social relations to consistent identities over time. Existing long-video and multimodal-agent benchmarks measure broad memory question answering, but they do not isolate the ability to maintain recurring person identities and reason over their cross-time relations. We introduce ICM-Bench (Identity-Centric Memory Benchmark), which, to the best of our knowledge, is the first benchmark specifically designed to evaluate identity-centric reasoning over long video memories in multimodal agents. The benchmark contains 839 synthetic clips spanning 141 minutes and 1,217 open-ended questions about six recurring adults in a one-year life album. A theme-configurable pipeline generates the video collection and associates each question with its target identities and traceable supporting evidence. We compare direct caption-memory baselines, memory-augmented agents, and graph-retrieval systems. Gemini 3.1 Pro achieves the highest overall accuracy of 74.0%, yet its score falls to 60.3% on questions that require long-term identity profiles. The results show that current systems recover many event-level memories but remain less reliable when evidence must be accumulated around a stable person.

[36] VISTA: Dense Multi-Label Classroom Coding with Vision-Language Models cs.CVPDF

Andrew Franck, Brendan Ng, Ben Fitzgerald, Zane Derrod, Chris Cianci

TL;DR: 本文提出VISTA，一个基于视觉语言模型（MiniCPM-V-4.5）的密集多标签课堂编码基准方法，用于对STEM本科课堂视频（COPUS协议）进行自动行为编码。该方法通过滑动窗口处理、轻量级MLP头微调和最大池化，将预测结果映射到每2分钟的24维二元标签向量上。

Details

Motivation: 现有视频-语言基准通常缺乏公开的可靠性统计，其噪声水平未知。作者主张借鉴已投入可靠性策略的研究社区方法，并以经过同行评审可靠性文献验证的COPUS课堂观察协议为例，构建一个具有密集结构化标签和外部验证词汇的多模态基准。

Result: 在三个保留的化学讲座视频上，VISTA达到了80.1%的限制宏准确率，优于零样本变体的74.9%。最大的残差误差出现在视觉相似的教师行为代码和罕见的依赖音频的代码上。

Insight: 创新点在于将具有成熟可靠性文献的人类观察协议（COPUS）转化为多模态基础模型的视频基准，提供了密集的、外部验证的结构化标签和基于人类评估的每代码可靠性目标。方法上，采用冻结主干网络上的轻量级MLP头进行微调，并系统分析了音频部分可观测性、细粒度小组工作区分和长尾召回等失败模式。

Abstract: Video-language benchmarks are usually constructed by the dataset authors without published reliability statistics, leaving the noise floor of the construct unknown. We argue that multimodal benchmarking benefits from methods taken from research communities that have already invested in strategies to ensure reliability. We illustrate the case with the Classroom Observation Protocol for Undergraduate STEM (COPUS): a 24-code multi-label observation instrument with a decade of peer-reviewed reliability literature. We recast COPUS as a video benchmark for multimodal foundation models, where it provides a dense set of structured labels (a 24-dimensional binary vector every 2 minutes across a 50-90 minute lecture), an externally validated vocabulary, and established literature that provides a per-code reliability target based on human evaluators. Annotations in our evaluation corpus are produced by a 5-person human-evaluator panel whose consensus matrix is our reference. We propose VISTA, a baseline that runs MiniCPM-V-4.5 over a dense sliding window, refines its per-window outputs with a lightweight multi-layer perceptron (MLP) head trained on top of the frozen backbone, and max-pools the resulting predictions onto the 2-minute COPUS grid. On three held-out chemistry lectures, VISTA reaches 80.1% restricted macro accuracy versus 74.9% for the zero-shot variant, with the largest residual errors on visually similar instructor codes and on rare audio-dependent codes. We characterize three systematic failure modes (audio-partial observability, fine-grained group-work discrimination, long-tail recall) and release the benchmark tooling, prompts and baseline code at https://github.com/ajfranck/VISTA.

[37] DART: Depth-as-Target Pretraining for Surgical Vision Foundation Models cs.CVPDF

John J. Han, Adam Schmidt, Muhammad Abdullah Jamal, Jie Ying Wu, Omid Mohareri

TL;DR: DART是一种用于手术视觉基础模型的RGB-D预训练方法，通过引入伪标签深度图作为监督信号，在DINOv2基础上增加像素级深度重建目标，仅使用RGB图像进行微调和推理，在八个手术基准测试中提升了分割、深度估计和图像级识别任务的性能。

Details

Motivation: 当前自监督预训练主要依赖RGB图像，忽略了深度图等互补信号，而手术场景几何信息丰富且自然图像基础模型迁移效果不佳，因此利用伪标签深度信息提升预训练表示质量。

Result: 在八个手术基准测试（涵盖分割、深度估计和图像级识别）中，DART超越了自然图像和领域内基线模型，包括在相同数据上训练的原始DINOv2，同时提升了密集预测和图像级理解能力。

Insight: 创新点在于将伪标签深度作为重建目标融入预训练，验证了几何信号比边缘检测等密集信号更有效；表明无需额外标注或推理成本即可利用几何伪标签增强基础模型，为手术领域提供更强骨干网络。

Abstract: Vision foundation models (VFMs) are valuable in data-scarce domains such as surgery, where a single pretrained backbone can provide rich representations for many downstream tasks. Yet the dominant self-supervised pretraining paradigm uses only RGB images, leaving readily available complementary signals, such as depth maps, unused. This is a particular missed opportunity in surgery, where natural-image VFMs transfer poorly while the scene geometry is rich and informative. With strong off-the-shelf models now able to produce pseudo-labeled dense depth for any image corpus, we hypothesize that such signals can be folded into pretraining to learn better representations. We present DART, an RGB-D pretraining recipe that builds on DINOv2 with a simple modification: a pixel-space depth reconstruction objective applied to masked iBOT patches, supervised by pseudo-labeled depth. Depth is used only during pretraining, so fine-tuning and inference remain RGB-only. We find that this pixel-level reconstruction head improves representation quality rather than disrupting it. We further show that depth, which encodes scene geometry, is more effective as a target than alternative dense signals such as Canny edges, confirming that the gains stem from depth rather than added supervision alone. Across eight surgical benchmarks spanning segmentation, depth estimation, and image-level recognition, DART outperforms both natural-image and in-domain baselines, including a vanilla DINOv2 trained on identical data, improving dense prediction while also strengthening image-level understanding. More broadly, DART shows that freely available geometric pseudo-labels can strengthen foundation model pretraining without extra labels or added inference cost, pointing toward stronger backbones for surgery.

[38] ReaDiT Guidance: Control for Image and Video Generation using Diffusion Transformer Features cs.CVPDF

Jay Mahajan, Chang Liu, Rauf Makharov, Viraj Shah, Alexander Schwing

TL;DR: 本文提出了ReaDiT Guidance，一个轻量级框架，通过利用扩散Transformer（DiT）模型的内部特征表示来控制图像和视频生成。该方法使用单个DiT块的特征，根据测试时提供的空间目标（如深度图、姿态图或边缘图）来引导生成过程，并可自然扩展到基于DiT骨干的文本到视频模型，实现相机和运动控制。

Details

Motivation: 动机在于为基于DiT的生成模型提供一种轻量、高效的控制方法，利用其内部特征来引导生成过程，以解决现有基于特征或适配器的方法在参数效率和性能上的不足。

Result: 实验结果表明，与现有的基于特征的方法和现成的基于适配器的方法相比，该方法在达到相当或更好性能的同时，所需的参数量更少。

Insight: 创新点在于提出了一种直接利用单个DiT块内部特征进行引导的轻量级控制框架，避免了引入额外复杂模块，并可无缝扩展到视频生成任务，为生成模型的控制提供了高效且通用的解决方案。

Abstract: We present DiT Readout (ReaDiT) Guidance, a lightweight framework for controlling generation with Diffusion Transformer (DiT) models via their internal feature representations. ReaDiT Guidance uses features from a single DiT block to steer the generative process according to spatial targets - like depth, pose, or edge maps - provided at test time. Furthermore, since modern text-to-video models are largely built on DiT backbones, ReaDiT Guidance naturally extends to video generation, enabling camera and motion control. Experimental results demonstrate that our approach achieves competitive or improved results compared to existing feature-based and off-the-shelf adapter-based approaches while requiring fewer parameters.

[39] Enhancing Multimodal Emotion Recognition via Multi-Feature Encoding and Attention-Based Fusion cs.CV | cs.AI | cs.LGPDF

Xu Lin, Ke Wang, Hui Kang, Xinying Wang

TL;DR: 本文提出了一种新颖的多模态情感识别框架，通过多特征编码和基于注意力的融合策略来增强性能。该框架从音频中提取Wav2Vec2语义嵌入、MFCC特征和统计声学描述符，并使用BiLSTM进行时序建模；从视频中通过ResNet50-BiLSTM提取时空特征。最后，采用多头注意力机制进行特征级融合，自适应地权衡不同模态的贡献。

Details

Motivation: 多模态情感识别在人机交互、远程教育和医疗保健等领域至关重要，但现有方法在有效融合互补的音频和视觉特征方面存在挑战。本文旨在通过更丰富的特征提取和自适应的融合策略来解决这一问题。

Result: 在MELD和IEMOCAP数据集上的实验表明，该模型在准确性和鲁棒性上显著优于基线方法。消融研究证实，基于注意力的融合策略在不平衡数据设置下能显著提升性能。

Insight: 创新点在于提出了一个结合多种互补音频特征和深度时空视觉特征的多模态编码架构，并引入了基于多头注意力的特征级融合机制，使模型能自适应地学习模态间的协同作用，提高了对现实世界不平衡数据的泛化能力。

Abstract: Multimodal emotion recognition has attracted growing interest due to its importance in human-computer interaction, remote education, and healthcare. This paper proposes a novel multimodal emotion recognition framework that integrates rich audio and visual feature extraction with an attention-based fusion strategy. For audio, we extract three complementary feature types: semantic embeddings from Wav2Vec2, MFCC features, and statistical acoustic descriptors such as pitch, energy, and rhythm. These are aligned and fused via a BiLSTM to capture temporal dependencies. For video, we propose a ResNet50-BiLSTM architecture that combines deep residual learning and sequential modeling to extract expressive spatiotemporal features from facial sequences. To enhance multimodal synergy, we introduce a feature-level fusion mechanism based on multi-head attention, allowing the model to adaptively weigh contributions across modalities. Experiments conducted on the MELD and IEMOCAP datasets demonstrate that our model significantly outperforms baselines in both accuracy and robustness. Furthermore, ablation studies show that the attention-based fusion strategy significantly improves performance in unbalanced data settings. Our findings suggest that the proposed framework effectively captures diverse emotional cues from speech and visual expressions, and offers a practical and generalizable approach for real-world multimodal emotion recognition tasks.

[40] LookThere! Sparse Vision by Reinforced Selection cs.CV | cs.LGPDF

Sreehari Rammohan, Yousef Yassin, Anthony Fuller, Junfeng Wen, Carl Vondrick

TL;DR: 这篇论文提出了LookThere，一种通过强化学习联合训练浅层输入选择器和深层特征提取器的端到端框架，旨在实现视觉Transformer的稀疏计算。该方法能够仅选择任务相关的输入进行处理，在极端稀疏条件下（如仅使用0.2%的输入）仍能保持准确性，并在图像分类、分割、零样本分类和计数等多种任务上超越现有方法，实现了性能与计算效率的新帕累托前沿。

Details

Motivation: 现有视觉Transformer通常平等处理所有图像块，但大多数任务仅需部分关键信息。现有的自适应计算方法在极端稀疏条件下表现不佳，且依赖如令牌多样性和注意力分数等可能泛化性不足的启发式规则。

Result: LookThere在高分辨率场景（如交通标志识别、台球）的稀疏识别任务中表现出色，仅使用0.2%的输入仍能保持准确率。在ImageNet分类、ADE20K分割、零样本分类和计数等多个基准测试中，该方法均超越了最先进的选择方法，实现了通用且可扩展的高效自适应计算。

Insight: 论文的核心创新在于通过端到端强化学习框架，联合优化输入选择器（决定看哪里）和特征提取器（决定看什么），无需依赖辅助信号即可实现任务驱动的稀疏计算。这种设计提供了一种通用且可扩展的框架，能够自适应地选择值得处理的信息，从而在多种视觉任务中实现高效的性能-计算权衡。

Abstract: Vision transformers typically treat every image token as equally important, yet for most tasks in computer vision only a fraction are needed. Adaptive computation methods accelerate inference by choosing which tokens to process, but existing methods struggle at extreme sparsity and require heuristics that may not generalize like token diversity and attention scores. We address these limitations with LookThere, achieving a new pareto frontier in performance-compute trade-offs through an end-to-end reinforcement learning framework that jointly trains a shallow input selector and a deep representation extractor. The selector learns where to look and the extractor learns what to see, together saving computation by selecting only what is worth processing for a given task without relying on auxiliary signals. We show that LookThere only selects the task-specific input, excelling at sparse recognition in high-resolution settings (traffic signs, billiards), and maintaining accuracy with as little as 0.2% of the input. It generalizes across tasks and models, including global recognition (ImageNet classification), local recognition (ADE20K segmentation), zero-shot classification (by distillation), and regression (counting). Across all settings, LookThere surpasses state-of-the-art selection to provide a general and scalable framework for specialized and efficient adaptive computation.

[41] HiSfM: Disambiguating Structure-from-Motion via Scaffold-Anchored Hierarchical Reconstruction cs.CVPDF

Ziding Zhao, Hainan Cui, Peilin Tao, Shuhan Shen

TL;DR: HiSfM是一种用于解决视觉歧义问题的分层式从粗到精的运动恢复结构框架。它通过构建局部社区、连接社区形成骨架、重建稳定脚手架，并逐步吸收剩余图像，提高了稀疏三维重建的鲁棒性和效率。

Details

Motivation: 传统SfM流程在重复或对称结构导致的视觉歧义下容易失败，且因冗余相机和约束而计算成本高昂。HiSfM旨在解决这些鲁棒性和效率问题。

Result: 在关注歧义的基准测试和通用数据集上，HiSfM能防止歧义导致的失败，相比先前方法大幅减少运行时间，并在完整性上优于激进的稀疏化方法。

Insight: 创新点在于使用几何启发式构建局部社区，通过边不相交生成树形成紧凑骨架，并利用两视图消歧器验证骨架边，最终以稳定脚手架作为锚点进行高效注册和三角测量。这种方法在保持场景本质的同时，有效处理了视觉歧义和计算冗余。

Abstract: Structure-from-Motion (SfM) is a fundamental tool for sparse 3D reconstruction with broad impact in robotics and vision, supporting mapping, localization, and large-scale scene modeling. However, conventional pipelines often fail under hard visual ambiguity caused by repeated or symmetric structures, and incur heavy computational cost due to redundant cameras and constraints. We present HiSfM, a hierarchical coarse-to-fine SfM framework that improves robustness and efficiency through scaffold construction. HiSfM first forms strong local communities using geometrical induced heuristics, then connects communities with a compact yet strong skeleton by packing edge-disjoint spanning trees (EDST) while verifying skeletal edges with a two-view disambiguator. We reconstruct a stable scaffold on this verified skeleton, serving as an anchor to capture the essence of the scene, and subsequently absorb remaining images via efficient registration and triangulation for further refinements. Experiments on ambiguity-focused benchmarks and general datasets show that HiSfM prevents ambiguity-induced failures while substantially reducing runtime compared to previous methods, and improves completeness over aggressive sparsification methods. Code is available at https://github.com/3dv-casia/HiSfM.

[42] Bridging Modalities and Tasks: A Unified Hierarchical ViT for SAR-to-Optical Translation and Semantic Segmentation cs.CVPDF

Siyuan Liu, Xuze Zhang, Yongshun Wang, Licong Pan, Hang Liu

TL;DR: 本文提出了一种名为BMT的统一协作双任务学习框架，通过共享的分层视觉Transformer联合优化SAR到光学图像转换和语义分割任务。该框架集成了局部ViT块、增强输出模块、ControlNet风格的条件注入机制和有界Kendall不确定性加权方案，旨在提升SAR图像的视觉可解释性并保持语义结构，以支持下游任务。

Details

Motivation: SAR图像具有全天候观测能力，但其斑点噪声和非直观散射机制限制了图像的可解释性。现有SAR到光学转换方法往往为了视觉效果而忽略了对下游任务至关重要的语义结构约束。

Result: 在公开的WHU-OPT-SAR配对数据集和自构建的非配对船舶数据集上评估，该方法在SAR到光学转换质量和语义分割性能方面均取得了有竞争力的结果。

Insight: 创新点包括通过共享分层ViT实现模态转换与语义分割的协同学习、局部ViT块融合全局注意力与空间卷积、多尺度条件注入机制以及有界不确定性加权防止任务主导，为多模态多任务学习提供了统一框架。

Abstract: Synthetic Aperture Radar (SAR) images have all-weather, day-and-night observation capabilities. However, compared with optical images, their speckle noise and non-intuitive scattering mechanism limit the interpretability of the images. Generative models for SAR-to-optical (S2O) conversion can improve visual interpretability, but existing methods often ignore the constraints on semantic structure, which are necessary for downstream tasks, for the sake of visual effects. We propose a unified collaborative dual-task learning framework, termed BMT (Bridging Modalities and Tasks), that jointly optimizes S2O image translation and semantic segmentation through a shared hierarchical Vision Transformer. The framework integrates: (1) a LocalViTBlock that fuses global self-attention with spatial depthwise convolution through a learnable gating mechanism; (2) an enhanced output module combining multi-scale refinement processing, color correction and anti-aliasing, which calibrates channel-level color statistics through feature fusion; (3) a ControlNet-style conditional injection mechanism that encodes SAR wavelet features and segmentation labels into a multi-scale feature pyramid and injects them at each encoder layer through zero-initialized convolution; (4) a bounded Kendall uncertainty weighting scheme that prevents either task from dominating the shared representation. We evaluate the framework under both paired and unpaired translation settings, on the public WHU-OPT-SAR paired dataset and a self-constructed unpaired ship dataset built from HRSID and DIOR, respectively. The experimental results show that the proposed method achieves competitive S2O translation quality and semantic segmentation performance. The dataset and source code have been publicly released at https://github.com/Lewisyuaner/BMT-S2O-main.

[43] Where to Look Matters: Learning Influential Views for VLM-based 3D Visual Grounding cs.CVPDF

Tsung-Chih Chiang, Hsuan-Kung Yang, Jou-Min Liu, Ting-Ru Liu, Chun-Wei Huang

TL;DR: 本文提出了IVSGround框架，用于改进基于视觉语言模型（VLM）的零样本3D视觉定位任务。该框架通过学习一个轻量级的视图选择器，来识别对定位任务最具判别性的相机视角，替代了传统依赖启发式规则（如物体可见性）的方法。通过两阶段拒绝采样过程生成训练信号，并在推理时使用冻结的推理VLM进行对比定位，在ScanRefer和NR3D基准上取得了更高的定位精度。

Details

Motivation: 现有零样本3D视觉定位方法通常依赖启发式规则选择输入给VLM的相机视角，这些规则往往优先考虑物体可见性而非与定位任务的相关性，这限制了定位性能。本文旨在通过学习选择对定位任务有影响力的视角来解决这一问题。

Result: 在ScanRefer和NR3D基准上的实验表明，IVSGround框架持续提升了现有零样本管道的定位准确率，证明了学习选择有影响力的视角对于有效的3D视觉定位至关重要。

Insight: 主要创新点在于提出了一个可学习的、查询条件化的视图选择器，用于识别对3D视觉定位最具判别性的视角，并通过一个两阶段的拒绝采样过程，利用推理VLM的反馈来生成训练信号，从而实现了端到端的学习，避免了手动设计启发式规则。这为VLM在3D场景理解中的应用提供了新的视角选择策略。

Abstract: Recent zero-shot 3D visual grounding methods leverage vision-language models (VLMs) to localize objects in 3D scenes from natural language queries. However, these methods typically rely on heuristic rules to select which camera views are provided to the VLM, often prioritizing object visibility rather than grounding relevance. We present IVSGround, a framework that learns Influential View Selection for VLM-based 3D visual grounding. Instead of using fixed heuristics, a lightweight view selector is trained to identify views that provide discriminative evidence for grounding. To obtain supervision signals, we generate training signals using feedback from a reasoning VLM through a two-stage rejection sampling process. During inference, the learned selector predicts query-conditioned influential views for each candidate object, which are then evaluated by a frozen reasoning VLM through comparative grounding. Experiments on ScanRefer and NR3D show that IVSGround consistently improves grounding accuracy over existing zero-shot pipelines, demonstrating that selecting where to look is crucial for effective 3D visual grounding. Project page: https://ivsground.github.io/

Mingyuan Meng, Shuchang Ye, Mingjian Li, Zhenyu Zhao, Jinman Kim

TL;DR: 本文提出CoMLP（合作门控多层感知机）模块，用于医学图像分割中的细粒度跨模态信息融合。该模块通过互补的区域和空洞MLP交互实现合作跨门控，以建模局部和全局的跨模态依赖，避免了传统交叉注意力在高分辨率特征图上的计算负担。

Details

Motivation: 多模态医学图像和临床报告为分割提供互补的解剖、功能和语义信息，但现有基于交叉注意力的融合方法计算成本高，难以在高分辨率特征图上实现密集的跨模态交互，尤其对于体数据医学图像。

Result: 在五个涵盖2D/3D图像、临床报告、多成像模态和不同解剖区域的医学分割基准测试中，CoMLP相比最先进的多模态和语言引导分割方法取得了一致的性能提升。

Insight: 创新点在于用MLP-based的合作跨门控机制替代密集交叉注意力，实现了细粒度的跨模态融合；其互补的局部-全局交互设计对性能提升至关重要，为医学图像分割中的跨模态融合提供了高效替代方案。

Abstract: Multi-modal medical images and clinical reports provide complementary anatomical, functional, and semantic information for medical image segmentation. Effectively exploiting these heterogeneous sources requires fine-grained cross-modal information fusion that preserves subtle spatial details while capturing semantic dependencies across modalities. Existing fusion approaches frequently rely on cross-attention, whose computational burden increases rapidly with spatial resolution, making dense cross-modal interaction difficult on high-resolution feature maps, particularly for volumetric medical images. In this work, we propose CoMLP, a cooperatively-gated MLP module for fine-grained cross-modal information fusion in medical image segmentation. CoMLP models cross-modal dependencies through cooperative cross-gating, built upon complementary regional and dilated MLP interactions, to capture local and global cross-modal dependencies. We further develop a multi-source fusion architecture in which CoMLP performs both inter-image fusion across imaging modalities and vision-language fusion between visual features and textual reports, enabling heterogeneous information to be integrated without relying on dense cross-attention. Extensive experiments on five medical segmentation benchmarks, covering 2D/3D images, clinical reports, multiple imaging modalities, and diverse anatomical regions, demonstrate consistent improvements over state-of-the-art multi-modal and language-guided segmentation methods. Ablation studies further show that fine-grained interaction at high spatial resolutions and complementary local-global fusion are critical to the performance gains. These results demonstrate the potential of MLP-based interaction as an effective alternative for fine-grained cross-modal information fusion in medical image segmentation.

[45] Intrinsic Temporal Adaptation of CLIP for Partially Relevant Video Retrieval cs.CVPDF

Hyun Seok Seong, Woojin Jun, SuBeen Lee, Jae-Pil Heo

TL;DR: 本文提出了一种名为ITA的框架，用于解决部分相关视频检索（PRVR）问题，该问题旨在检索包含与文本查询相关片段的未修剪视频。ITA通过骨干网络内部的时间适应机制，使CLIP视觉编码器的最后几层能够关注相邻帧组，从而获得具有时间感知的帧嵌入，同时保持CLIP主干冻结。此外，引入亲和力加权梯度传播方法，基于文本-帧亲和度软聚合top-k帧，并将学习信号传播到多个查询相关帧，以应对PRVR的弱监督特性。

Details

Motivation: 现有PRVR方法通常依赖冻结的CLIP帧特征，这些特征缺乏时间理解能力，且即使采用参数高效的CLIP适应方法，视频级预测仍可能基于不精确的帧级证据。因此，需要一种能够增强时间理解并更准确关联查询与视频片段的方法。

Result: 该方法在PRVR基准测试中实现了最先进的性能，展示了强大的跨数据集迁移能力，并在真实查询相关片段内检索到更准确的帧级证据。

Insight: 创新点在于提出了骨干网络内部时间适应机制，在保持CLIP主干冻结的同时，通过微调最后几层视觉Transformer来捕捉时间上下文；以及亲和力加权梯度传播，利用文本-帧亲和度进行软聚合和梯度传播，有效处理PRVR的弱监督学习问题，提升了帧级证据的准确性。

Abstract: Partially Relevant Video Retrieval (PRVR) aims to retrieve untrimmed videos that contain moments relevant to a text query. Since the target moment occupies only a portion of the video, PRVR requires retrieval based on fine-grained understanding beyond coarse video-level matching. However, existing methods often rely on frozen CLIP frame features, which lack temporal understanding. Even with recent progress in parameter-efficient CLIP adaptation, video-level predictions can still be supported by imprecise frame-level evidence. In this paper, we propose an Intrinsic Temporal Adaptation (ITA) framework for PRVR. First, our Backbone-Internal Temporal Adaptation allows the last few visual transformer layers to attend over groups of neighboring frames. This provides temporally aware frame embeddings while keeping CLIP frozen and training only adaptation parameters. Second, we introduce Affinity-Weighted Gradient Propagation to address the weakly supervised nature of PRVR, softly aggregating top-$k$ frames based on text-frame affinities and propagating learning signals to multiple query-relevant frames. Our method achieves state-of-the-art performance on PRVR benchmarks, demonstrates robust cross-dataset transfer, and retrieves substantially more accurate frame-level evidence within ground-truth query-relevant moments. Our code is available at github.com/hynnsk/ITA.

[46] Linguistic Trajectory Encoding for Efficient Long-Horizon Spatial Memory in Embodied Agents cs.CV | cs.AIPDF

Tianyidan Xie, Shenyi Wang, Qiang Tang, Mingjie Wang, Zhicheng Qiu

TL;DR: 本文提出了语言轨迹编码（LTE），一种用于具身智能体的混合记忆表示方法，旨在高效支持长时程（数小时至数天）空间记忆。LTE通过结合自然语言描述、稀疏空间锚点和视觉锚点来压缩动态物体的运动历史，并构建了一个新的Spatial Memory Benchmark（SMB）进行评估。实验表明，基于LTE的系统在SMB的语义轨迹检索和长时程物体检索任务上显著优于现有基线，并实现了8.7倍至26.1倍的轨迹压缩。

Details

Motivation: 现有系统（如视频-语言嵌入、几何SLAM、智能体工作记忆）无法为具身智能体提供一种既能长期保存动态物体细粒度运动，又能直接用自然语言查询其状态变迁的记忆表示。本文旨在解决这一长时程空间记忆的表示与查询问题。

Result: 在新建的Spatial Memory Benchmark（SMB）上，基于LTE的系统在语义轨迹检索任务上达到45.3%成功率，在长时程物体检索任务上达到48.7%成功率，显著优于结构化记忆和视觉语言模型基线（先前最佳分别为31.9%和34.4%）。在Ego4D自然语言查询任务上，其R@1/R@5达到28.75%/55.10%，比EgoVLPv2分别提升15.80和31.30个百分点。LTE在24小时视频上实现了8.7倍至26.1倍的轨迹压缩，查询延迟低于1秒。

Insight: 核心创新在于提出了LTE这一混合表示，它根据运动复杂性自适应压缩，将无可靠观测的时段锚定到最后已知位置，并用几何路径点和语言描述来精确表示运动。这首次实现了对单个物体、可直接用语言查询其状态变迁的时间线记忆。此外，构建的SMB基准填补了现有评测在语义轨迹检索和长时程物体检索能力上的空白。

Abstract: Embodied agents performing long-horizon tasks require a memory representation in which the state transitions of dynamic objects remain queryable in natural language across hours-to-days observation horizons. Existing systems either drop fine-grained motion (clip-level video-language embeddings), keep it only as raw coordinates (geometric SLAM), or organise it around immediate task context (agent working memories). None of them gives the agent a per-object timeline whose state transitions are themselves queryable in language. Our key contribution is \textbf{Linguistic Trajectory Encoding} (LTE), which compresses dynamic object motion histories via a hybrid representation combining natural language descriptions, sparse spatial anchors, and visual anchors. LTE adapts compression to motion complexity by anchoring periods without reliable observations to the last seen location, while representing motion with geometric waypoints and linguistic descriptions to preserve accuracy. To evaluate these capabilities across extended time horizons, we construct the \textbf{Spatial Memory Benchmark} (SMB) from EgoLife multi-day recordings, targeting capabilities absent in existing benchmarks: semantic trajectory retrieval and long-horizon object retrieval. On SMB, the LTE-based system achieves $45.3%$ success in semantic trajectory retrieval and $48.7%$ in long-horizon object retrieval, outperforming structured-memory and VLM baselines (best prior: $31.9%$ and $34.4%$). LTE achieves trajectory compression by factors of $8.7\times$ to $26.1\times$ with sub-second query latency on $24$,h video. On Ego4D natural-language queries, the system reaches $28.75%$ / $55.10%$ R@1/R@5, $+15.80$ / $+31.30$ pts over EgoVLPv2.

[47] LetOccVote: Learning Weakly Supervised 3D Occupancy through Consensus cs.CVPDF

Chi Zhang, Qi Song, Feifei Li, Jie Li, Rui Huang

TL;DR: 本文提出LetOccVote，一种基于高斯模型的弱监督3D占据预测框架，旨在减少对昂贵3D标注的依赖。该方法通过跨帧投票机制，利用重复观测间的一致性来评估和优化由视觉基础模型生成的2D伪标签的可靠性，从而改进几何和语义监督。整个框架仅使用2D伪标签进行训练，无需3D占据标注。

Details

Motivation: 现有弱监督3D占据预测方法直接使用不完美的2D伪标签作为监督，使得占据学习容易受到错误的几何和语义目标的影响。本文的动机是利用跨帧观测间的一致性这一廉价且可靠的线索，来评估伪标签的可靠性，从而提升监督质量。

Result: 在Occ3D-nuScenes基准测试上，LetOccVote取得了53.27的IoU和20.39的mIoU，在仅使用2D伪标签监督的方法中达到了最先进的性能。

Insight: 核心创新点在于提出了一个统一的跨帧投票框架（Depth Vote和Semantic Vote），利用多视角观测的共识来提炼可靠的几何深度和语义证据，同时过滤不可靠的伪标签片段。这为弱监督3D感知提供了一种通过内部一致性进行自我修正的新思路。

Abstract: Weakly supervised 3D occupancy prediction reduces the reliance on costly 3D annotations by learning from 2D pseudo-labels generated by vision foundation models. However, existing methods typically use these imperfect pseudo-labels directly as supervision, making occupancy learning vulnerable to erroneous geometric and semantic targets. We observe that agreement across repeated observations provides an inexpensive and reliable cue for assessing pseudo-label reliability. Based on this observation, we propose \textbf{LetOccVote}, a weakly supervised Gaussian-based occupancy framework that leverages cross-frame voting to improve both geometric and semantic supervision. For geometry, Depth Vote exploits cross-frame geometric agreement to refine supported pseudo depth and reject contradictory estimates before volumetric lifting and depth supervision. For semantics, Semantic Vote aggregates pseudo-semantic observations in a shared 3D space to identify reliable and contested evidence, strengthening reliable semantic supervision while filtering unreliable pseudo-label segments. The entire framework is trained solely with 2D pseudo-label supervision without requiring 3D occupancy annotations. On Occ3D-nuScenes, LetOccVote achieves 53.27 IoU and 20.39 mIoU, establishing state-of-the-art performance among methods with 2D pseudo-label supervision.

[48] Mitigating Performance Discrepancy in Cross-Domain 3D Class-Incremental Learning cs.CV | cs.AIPDF

Jinge Ma, Gautham Vinod, Bruce Coburn, Jui-Feng Chi, Siddeshwar Raghavan

TL;DR: 本文针对3D点云类别增量学习中的跨域性能差异问题，提出了一个名为Domain3D-CIL的新训练与评估协议，并引入了一种无需示例的方法PolyMem来缓解该问题。

Details

Motivation: 在自动驾驶、机器人等实际应用中，3D感知模型需要持续适应新出现的3D物体类别，但3D点云数据具有固有的异质性（如来自CAD模型、RGB-D扫描、视频重建等不同域），这导致了跨域性能差异的新挑战。

Result: 在建立的Domain3D-CIL协议上，实验表明多种主流CIL方法均存在性能差异问题，而提出的PolyMem方法有效缓解了该差异，并提升了模型在各域上的整体性能。

Insight: 论文的创新点在于首次系统性地识别并研究了3D类别增量学习中的跨域性能差异现象，并提出了一种通过隐式建模特征分布的高阶统计量来增强跨域鲁棒性的无示例方法PolyMem。

Abstract: 3D perception plays a crucial role in real-world applications such as autonomous driving, robotics, and AR/VR. In practical scenarios, 3D perception models need to continually adapt to newly emerging 3D object categories, making class-incremental learning (CIL) particularly important. However, unlike 2D images, 3D point clouds are inherently heterogeneous: objects from the same class may not only come from the clean CAD domain, but also from RGB-D camera scans of varying quality, video reconstructions, or even corrupted observations. We discover that such heterogeneity introduces a new challenge beyond catastrophic forgetting: the degree of performance degradation can vary substantially across domains, a phenomenon we term performance discrepancy. To investigate this problem, we establish the Domain3D-CIL training and evaluation protocol, which contains point cloud categories from heterogeneous domains. We further adapt a wide range of mainstream CIL methods to the 3D modality. The results demonstrate that this performance discrepancy consistently appears across these baselines. To mitigate this issue, we introduce PolyMem, an exemplar-free approach that implicitly models rich high-order statistics of the feature distribution to enhance cross-domain robustness. Experiments demonstrate that our method effectively alleviates the performance discrepancy while improving the model’s performance across domains. Code will be made publicly available upon acceptance.

[49] InterSing: Explicit Interaction Dynamics for 3D Duet Singing Animation and Beyond cs.CVPDF

Yihan Zhou, Zikai Huang, Yuyang Yu, Xuemiao Xu, Cheng Xu

TL;DR: InterSing是一个用于生成双人合唱表演中真实3D头部动画的框架。它通过引入可解释的交互逻辑（interaction logits）来建模表演者之间的互动程度，并利用一个由音频特征和交互动态共同驱动的、具备交互感知能力的扩散模型来生成动画。该方法不仅适用于双人表演，还能推广到多人场景，并提供对互动时机和方式的直观控制。

Details

Motivation: 现有音频驱动动画方法和对话交互模型难以捕捉双人合唱表演中稀疏且依赖节奏的间歇性互动（如乐句边界、同步节奏和呼应段落），这些互动需要平衡个人表现力与协同配合。

Result: 实验表明，InterSing生成的歌唱头部动画比现有方法更具真实感、表现力、协调性和音乐对齐性，同时保留了每位表演者特有的运动风格。

Insight: 核心创新在于将双人协调建模为一个反映表演者之间互动强度的时变信号（即交互逻辑），并利用弱监督学习该表示，从而在一个统一的框架内实现独立运动、协调行为及其间平滑过渡的多模式生成。

Abstract: We present InterSing, a framework for generating realistic 3D head animations for duet singing performances. Unlike solo singing, duet performance requires each singer to balance individual expressiveness with intermittent interaction at musically salient moments, such as phrase boundaries, synchronized rhythms, and call-and-response passages. Because these interactions are sparse and rhythm-dependent, existing audio-driven animation methods and conversational interaction models do not adequately capture their structure. Our key insight is that duet coordination can be represented as a time-varying signal that reflects how strongly performers engage with one another throughout a song. Based on this observation, we introduce interaction logits, an interpretable latent representation that models the degree of cross-performer engagement at each time step. We learn these logits using weak supervision and use them to condition an interaction-aware diffusion model jointly driven by audio features and interaction dynamics. This formulation enables unified multi-mode generation, spanning independent motion, coordinated behavior, and smooth transitions between them. Experiments show that InterSing generates realistic and expressive singing head animations with stronger coordination and musical alignment than existing methods, while preserving each performer’s characteristic motion style. We further demonstrate that the same formulation generalizes to multi-singer performances and provides intuitive control over when and how performers engage.

[50] TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Image cs.CVPDF

Xin Zhang, Yabo Chen, Zixuan Duan, Haibin Huang, Chi Zhang

TL;DR: TourPhysics是一个从单张图像和物理配置初始化的在线框架，旨在为交互式视觉世界模型引入物理一致性。它将确定性物理模拟与视频生成相结合，通过分离模拟器状态、几何证据、生成器控制和外观记忆的角色，实现长期、物理一致的场景探索和物体操控。

Details

Motivation: 当前基于外观先验的视频世界模型在长时程预测中容易失去物理或空间一致性，无法有效区分观察（如相机运动）与物理干预（如物体运动、接触和形变）带来的变化。

Result: 在模拟器定义的相机巡视和物体操控任务上，TourPhysics比评估的基线方法更紧密地遵循指定的相机和物体轨迹，更好地保持了输入场景，并在长时程重访中减少了外观漂移。

Insight: 核心创新在于将物理模拟与生成模型解耦并协同工作，通过分离模拟器几何（用于投影和可见性）与用于条件生成的相对深度，并引入基于几何跨视图对应的参考锚定外观记忆机制，确保了长期合成中的物理和外观一致性。

Abstract: Interactive visual world models must distinguish observation from physical intervention. Camera motion reveals new surfaces, whereas intervention changes object motion, contact, and deformation. Current video world models are largely driven by appearance priors and often lose physical or spatial consistency over long horizons. We present TourPhysics, an online framework initialized from a single image and a declarative physical configuration. TourPhysics extends PhysOmni, our ACM Multimedia 2026 work, from finite physics-grounded video synthesis to persistent exploration and manipulation. TourPhysics combines deterministic simulation with video generation while assigning separate roles to simulator state, geometric evidence, generator controls, and appearance memory. For each action, the simulator computes a finite physical and camera trajectory before the corresponding observation is generated. Accepted observations publish the terminal state and update the appearance memory and subsequent generator controls, while the committed state and simulator geometry remain fixed throughout synthesis and retry. We further separate the simulator geometry used for projection and visibility from the relative depth used to condition the generator. A reference-anchored memory retrieves accepted static appearance through geometric cross-view correspondence and incorporates it through a bounded residual that reverts to the native path when no valid correspondence exists. On simulator-defined camera tours and object manipulations, TourPhysics follows prescribed camera and object trajectories more closely than the evaluated baselines, preserves the input scene, and reduces appearance drift during long-horizon revisits.

[51] One Diffusion Model, Two Roles: Guided Trajectory Planning and Safety-Critical Scenario Generation in Closed-Loop Simulation cs.CV | cs.AI | cs.LG | cs.ROPDF

Arka Pal, Rajesh Kumar, Hannes Eriksson, Rémi Lacombe, Arvid Laveno Ling

TL;DR: 本文提出了一种基于扩散概率模型的统一框架，在自动驾驶开发循环中同时扮演两个互补角色：作为自车运动规划器，以及作为可控的安全关键场景生成器用于压力测试规划器。在规划方面，作者引入了单流双流扩散Transformer解码器（SSDS）和改进的无训练引导方案DAPSE，提升了nuPlan基准上的闭环性能。在场景生成方面，通过推理时引导，利用同一模型生成逼真的长尾驾驶交互场景，用于闭环评估，暴露了标准基准下隐藏的规划器故障模式。

Details

Motivation: 动机是解决自动驾驶开发中的两个核心问题：一是如何设计一个能够捕捉驾驶场景中多模态、交互丰富的联合未来轨迹分布的规划器；二是如何系统地生成逼真的安全关键场景，以评估和压力测试规划器的鲁棒性。

Result: 在nuPlan基准的闭环仿真中，基于SSDS的规划器取得了更强的标称性能。同时，利用同一模型生成的安全关键场景（如激进切入、前车制动等）在独立黑盒规划器的闭环测试中，暴露了标准基准下隐藏的故障模式。尽管SSDS规划器标称性能更强，但在这些挑战性场景下性能下降更大，表明基准测试的优越性不一定能转化为鲁棒性。

Insight: 创新点在于展示了单个预训练的扩散交通模型可以一机两用，既作为规划器又作为可控场景生成器，为自动驾驶开发提供了一个统一的、基于学习的先验。技术上的创新包括SSDS架构（通过联合注意力融合场景上下文，而非晚期的交叉注意力）和DAPSE引导方案（在干净样本层面注入任意能量函数，避免了传统引导方法的一阶近似误差且无需辅助网络）。这为系统化的规划器鲁棒性评估提供了一个现实的框架。

Abstract: Diffusion probabilistic models can capture the multi-modal, interaction-rich distribution of joint future trajectories in driving scenes. We show that a single pretrained diffusion traffic model can serve two complementary roles in the autonomous driving development loop: as an ego motion planner, and as a controllable generator of safety-critical scenarios for stress-testing the planners. On the planning side, we introduce a Single-Stream Dual-Stream (SSDS) diffusion-transformer decoder that fuses scene context via joint attention rather than late cross-attention, improving closed-loop performance on nuPlan. We further propose Decoupled Annealing Posterior Sampling with Energy (DAPSE), a training-free guidance scheme that injects arbitrary energy functions at the clean-sample level, avoiding the first-order approximation errors while requiring no auxiliary networks. Beyond planning, we leverage the same diffusion model as a controllable scenario generator to create realistic long-tail driving interactions for closed-loop evaluation. Through inference-time guidance, selected agents are steered toward safety-critical behaviors, including aggressive cut-ins, lead-vehicle braking, and combined longitudinal-lateral interactions, while preserving realistic traffic behaviors. Evaluated in closed-loop nuPlan simulations with independent black-box planners, the generated scenarios expose failure modes that remain hidden under standard benchmarks. Although the SSDS-based planner achieves stronger nominal performance, it experiences larger degradation under these challenging scenarios, demonstrating that benchmark superiority does not necessarily translate to robustness. These results demonstrate that a single learned traffic prior can simultaneously improve motion planning and provide a realistic framework for systematic planner robustness evaluation.

[52] MCPO: Modality-Contrastive Preference Optimization for Multimodal Chain-of-Thought Compression cs.CV | cs.AIPDF

Guangheng Yang, Zhenliang Ni, Zhenkai Wu, Han Shu, Juan Feng

TL;DR: 本文提出了一种名为MCPO（模态对比偏好优化）的两阶段长度压缩方法，用于压缩多模态思维链（M-CoT），旨在减少计算开销和KV缓存压力。该方法通过NCMI剪枝算法自动移除视觉无关的推理步骤，并使用非对称多模态长度控制偏好损失进行对齐优化，在极少量训练样本下实现了高效的推理链压缩。

Details

Motivation: 现有的多模态思维链压缩和对齐方法主要依赖静态规则或单维偏好，缺乏细粒度的跨模态约束，容易导致视觉惰性和幻觉推理。因此，需要一种能够有效减少冗余、保持准确性的高效压缩方法。

Result: 在Qwen3-VL-Thinking等主流基础模型上的实验表明，该方法能将思维链长度减少高达69.5%，实现最高3.34倍的端到端推理加速，同时保持原始准确率。

Insight: 创新点包括引入步级归一化跨模态互信息（NCMI）剪枝算法来自动识别视觉无关步骤，以及采用高度非线性的赔率比形式化非对称多模态长度控制偏好损失，以强化长度约束并保持模态一致性，实现稳定的跨模态偏好对齐。

Abstract: Recently, multimodal large-scale reasoning models have demonstrated remarkable capabilities in solving complex tasks through long Chains-of-Thought (M-CoT). However, excessively long reasoning trajectories incur substantial computational costs and significant KV-cache pressure. Existing CoT compression and alignment paradigms mainly rely on static rules or single-dimensional preferences, lacking fine-grained cross-modal constraints; as a result, they are prone to inducing visual laziness and hallucinatory reasoning. To address these issues, we propose Modality-Contrastive Preference Optimization (MCPO), a highly sample-efficient two-stage length-compression method that requires fewer than 900 training samples. In the compression stage, we introduce a step-level Normalized Cross-Modal Mutual Information (NCMI) pruning algorithm, which automatically identifies and removes visual-independent reasoning steps by comparing the reasoning discrepancies between with-image and no-image contexts. This significantly reduces redundancy and hallucinatory content in the reasoning chains. In the alignment stage, the model first undergoes supervised fine-tuning to achieve domain-adaptive initialization, followed by optimization using an asymmetric multimodal length-controlled preference loss. This objective adopts a highly nonlinear odds-ratio formulation that provides steep gradients in the with-image context to reinforce length constraints for preferred trajectories, while applying a scaled, flat-gradient linear difference in the no-image context to maintain modality consistency, thereby achieving stable cross-modal preference alignment. Extensive experiments on mainstream base models such as Qwen3-VL-Thinking show that our method can reduce CoT length by up to 69.5% and achieve up to 3.34x end-to-end inference speedup while preserving original accuracy.

[53] Learning 3D Editing without Paired Supervision via Generative Prior Distillation cs.CVPDF

Hao Wen, Weibin Yun, Hongxing Fan, Haotian Lu, Rui Chen

TL;DR: 本文提出了一种无需配对3D监督的前馈式3D编辑学习框架，通过生成先验蒸馏来解决高质量配对训练数据稀缺的问题。该方法从强大的基础模型中蒸馏视觉、语义和几何知识，利用可微分渲染管道，结合2D图像编辑模型的视觉先验和视觉语言模型的语义先验进行监督，并引入3D感知分布匹配正则化以防止几何崩溃和多视角不一致。

Details

Motivation: 指令引导的3D编辑对于交互式内容创作至关重要，但面临高质量配对训练数据严重稀缺的瓶颈。现有方法要么依赖缓慢的测试时优化，要么使用复杂流程构建的伪配对进行训练，这常常导致结构漂移和几何伪影。

Result: 大量实验表明，该方法在指令遵循和跨视角一致性方面表现优异，显著优于最先进的基线模型。

Insight: 核心创新在于提出了生成先验蒸馏框架，避免了直接依赖3D真值配对数据。通过结合2D视觉先验、多视角语义先验以及新颖的3D感知分布匹配正则化（作为几何先验），有效解决了仅使用2D投影监督导致的几何崩溃和多视角不一致问题，将编辑输出约束在预训练图像到3D教师模型定义的逼真3D资产流形内。

Abstract: Instruction-guided 3D editing is essential for interactive content creation, yet it faces a significant bottleneck: the severe scarcity of high-quality paired training data. Existing approaches attempt to bypass this by either relying on slow test-time optimization or training on pseudo-pairs constructed via complex pipelines, which often introduce structural drift and geometric artifacts. In this paper, we propose a novel framework that learns feed-forward 3D editing without paired 3D supervision via Generative Prior Distillation. Instead of relying on ground-truth 3D pairs, our core idea is to distill visual, semantic, and geometric knowledge from powerful foundation models directly into a 3D editing model. Specifically, through a differentiable rendering pipeline, we supervise the 3D representation using two complementary signals: a 2D visual prior from an image editing model at the main editing view, and a semantic prior from a Vision-Language Model at novel views to ensure strict instruction following and source identity preservation. Crucially, to address the geometric collapse and multi-view inconsistencies inherent in 2D projection supervision, we introduce a 3D-aware Distribution Matching regularization. Acting as a geometric prior, this term operates in the 3D latent space, constraining the edited output to remain within the manifold of realistic 3D assets defined by a pretrained image to 3D teacher model. Extensive experiments demonstrate that our method achieves superior instruction fidelity and cross-view consistency, significantly outperforming state-of-the-art baselines. Our project is available at: https://github.com/thiamine128/PriorEdit3D.

[54] MINT: A Unified Model for World-Space Camera and Hand Motion Estimation from Scalable Egocentric Pipeline Supervision cs.CV | cs.ROPDF

Zijie Zhu, Weiren Cai, Yizhou Wang, Zhenjie Yang, Yide Liu

TL;DR: MINT是一个从第一人称RGB视频中直接估计世界坐标系下相机和双手运动轨迹的基础模型。它通过共享的时空视频表示联合预测相机轨迹、相机坐标系下的手部状态和每帧手部存在性，并通过显式坐标变换生成世界坐标系下的手部运动。

Details

Motivation: 现有系统通常将第一人称视频中的相机和手部运动估计分解为多个独立阶段，导致计算开销大且无法联合建模。MINT旨在解决这一问题，实现端到端的联合估计。

Result: 在公开基准测试中，MINT在世界坐标系手部轨迹精度、相机轨迹估计精度以及端到端轨迹生成速度上均有显著提升，并能零样本泛化到未见过的第一人称数据集。

Insight: 创新点在于提出了首个直接从RGB视频估计完整世界坐标系双手轨迹的基础模型，并开发了一个开源标注流水线EGOPIPELINE，利用大规模公开视频生成伪标签进行预训练，解决了高质量联合标注数据稀缺的问题。

Abstract: Recovering camera and hand motion in world coordinates from egocentric video is a key capability for activity understanding, robot learning, and augmented reality. Existing systems typically decompose this problem into separate stages for camera motion, depth, hand reconstruction, and trajectory refinement, resulting in substantial computational overhead and preventing the joint modeling of camera and hand motion. We introduce MINT (Minting IN-the-Wild Trajectories), the first foundation model that directly produces complete world-space two-hand trajectories from ego-centric RGB video. From a single shared spatiotemporal video representation, MINT jointly predicts the camera trajectory, camera-frame hand states, and per-frame hand presence, and then produces world-space hand motion via explicit coordinate transformations. Training such a model at scale is challenging, since paired world-space camera and hand annotations are scarce. We therefore develop an open-source labeling EGOPIPELINE that converts large collections of public egocentric videos into structured camera-and-hand trajectory supervision. MINT is first pretrained on these large-scale pseudo-labels and then fine-tuned on a small set of high-quality joint annotations. Across public benchmarks, MINT achieves [xxx] improvement in world-space hand trajectory accuracy, [xxx] improvement in camera trajectory estimation, and [xxx] faster end-to-end trajectory generation than the labeling pipeline, while generalizing zero-shot to unseen egocentric datasets. We release the model, training and inference code, labeling pipeline, and a curated 1,021-hour egocentric trajectory dataset.

[55] Temporal Residual Neural Radiance Fields for Monocular Video Dynamic Human Body Reconstruction cs.CVPDF

Tianle Du, Jie Wang, Xiaolong Xie, Wei Li, Pengxiang Su

TL;DR: 本文提出了一种名为Temporal Residual Neural Radiance Fields的方法，用于从单目视频中进行动态人体三维重建。该方法通过构建与多层感知机（MLP）架构无关的时序残差场来处理复杂的时空信号，旨在实现高效的人体新视角渲染和新姿态合成。

Details

Motivation: 现有基于单层MLP的方法在静态场景人体重建中效果良好，但在处理动态场景时存在模型容量有限、训练时间长、计算资源消耗大以及重建质量受限的问题。本文旨在解决动态场景人体三维建模中复杂时空信号的有效处理难题。

Result: 实验结果表明，与最新的代表性方法相比，该方法在峰值信噪比（PSNR）和结构相似性指数（SSIM）等精度指标上有所提升。在保持与Anim-NeRF和Neural Body相似精度的同时，实现了近780倍的时间效率提升。

Insight: 主要创新点包括：1）构建了一个独立于MLP架构的时序残差场来表征视频序列中的时序信号；2）提出了一种集成方法以减少可训练参数并加速渲染，从而增强网络的特征表示能力；3）设计了一个多维损失函数来精确衡量预测与实际空间像素值之间的损失。这些设计在保证重建质量的前提下，显著提升了动态人体重建的效率。

Abstract: In the field of computer vision and graphics, high-quality reconstruction of the human body in static scenes has been achieved in recent years by a single multilayer perceptron (MLP) in a number of approaches. However, MLPs have capacity limitations, requiring substantial training time and computational resources for dynamic scene reconstruction. And the quality of reconstruction is significantly constrained. This paper proposes a method for effectively processing complex spatiotemporal signals in dynamic scene human 3D modeling. The proposed method uses Temporal Residual Neural Radiance Fields to achieve novel view rendering and new pose synthesis of human bodies.To address the problem of representing temporal signals in video sequences, we construct a temporal residual field which is not related to the MLP architecture. Secondly, to improve reconstruction efficiency, we propose an integrated approach that reduces trainable parameters and accelerates rendering, thereby enhancing the network’s feature representation capability. Finally, we design a multi-dimensional loss function to accurately measure the loss between predicted and actual spatial pixel values. The experimental results show that our proposed approach improves the peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM) accuracy metrics compared to the latest representative methods. It maintains similar accuracy to Anim-NeRF and Neural Body while achieving a nearly 780-fold increase in time efficiency.

[56] Compositional Reward Models for Conditional Medical Image Generation cs.CVPDF

Aayush Kumar Tyagi, Prathosh A. P., Mausam

TL;DR: 本文提出PRISM框架，一种用于条件医学图像生成的组合奖励模型。该框架将图像质量分解为多个验证阶段，通过分层约束传播机制组合各阶段奖励，解决了现有方法在细粒度属性和语义一致性上的不足。在三个医学影像数据集上的实验表明，使用PRISM生成的数据训练下游模型能显著提升性能。

Details

Motivation: 解决条件扩散模型（如ControlNet）在医学图像生成中难以捕获细粒度属性（强度、纹理）和语义一致性的问题，同时克服现有基于强化学习的微调方法因依赖单一标量奖励而混淆不同失败模式、提供弱纠正信号的局限性。

Result: 在PanNuke（细胞分割）、CeDeM（绒毛/隐窝检测与测量）和ISIC（皮肤病变分类）三个数据集上评估：使用PRISM生成数据训练的下游模型相比最接近的基线，mDice提升2.3%，平均相对误差降低8.5%，F1分数提高5.9%。

Insight: 创新点在于将图像质量分解为从细粒度到粗粒度的多阶段验证（低层属性、结构对齐、高层语义保真度），并通过分层约束传播机制组合奖励，确保低层缺陷先于高层奖励被解决，避免了简单目标掩盖关键失败。

Abstract: Acquiring high quality annotated medical image data is critical for training deep learning models; however, annotation is expensive, time consuming, and requires domain expertise. Conditional diffusion models, such as ControlNet, offer an alternative by generating images conditioned on semantic masks and text. However, existing approaches fail to capture fine grained properties (e.g., intensity and texture), as well as semantic consistency expected by domain experts, limiting their effectiveness for downstream tasks. Recent attempts to address these issues using reinforcement learning fine-tuning remain limited due to the reliance on a single scalar reward, which conflates diverse failure modes and provides weak corrective signals. We propose PRISM, a Compositional Reward Model (CRM) framework for conditional medical image generation. Instead of assigning a single reward, we decompose image quality into verifier grounded stages, each evaluating a distinct aspect of correctness from fine to coarse properties, including low level attributes (intensity and texture), structural alignment with conditioning inputs, and high level semantic fidelity. These stage wise rewards are composed through a Hierarchical Constrained Propagation (HCP) mechanism that enforces a fine to coarse notion of correctness, ensuring that lower level deficiencies are resolved before higher level rewards are accrued, preventing easier objectives from masking critical failures. We evaluate PRISM across three datasets spanning diverse medical imaging tasks: PanNuke (multi-class cell segmentation), CeDeM (villi/crypt detection and measurement), and ISIC (skin lesion classification). Training downstream models with data generated by PRISM yields improvements over closest baselines, including a 2.3% increase in mDice on PanNuke, a 8.5% reduction in Mean Relative Error (MRE) on CeDeM, and increases ISIC F1 by 5.9%.

[57] Training-Free Logical and Structural Anomaly Detection via Calibrated Fusion cs.CVPDF

Changyi Li, Miao Yu, Kai Dong, Yu Xiao

TL;DR: 本文提出了一种无需训练的工业异常检测方法，通过正常集校准融合异构异常线索，同时处理结构异常（局部纹理损坏）和逻辑异常（违反全局规则）。该方法在MVTec-LOCO数据集上实现了逻辑异常89.0和结构异常95.9的图像级AUROC，平均92.5，在无需训练的方法中表现最佳。

Details

Motivation: 现有工业异常检测方法通常只能有效处理结构异常或逻辑异常中的一种，且无需训练的方法缺乏对物体计数的显式建模，而能推理计数的方法通常依赖特定类别的组件建模和额外训练。

Result: 在MVTec-LOCO数据集上，该方法在逻辑和结构异常上分别达到89.0和95.9的图像级AUROC，平均92.5，在无需训练的方法中排名第一；其结构异常变体在MVTec-AD上达到99.1图像级AUROC，与PatchCore相当。

Insight: 核心创新是提出正常集校准技术，利用正常图像的统计信息对齐异构异常线索（如计数和纹理），使它们能在统一的无训练框架中直接融合，从而无需额外训练或部件级标注即可引入计数能力，同时处理两类异常。

Abstract: Industrial anomaly detection must handle two distinct defect families: structural anomalies, which manifest as local texture corruptions, and logical anomalies, which violate global rules on object count, composition, or arrangement. Existing detectors typically favor one family at the expense of the other. In particular, training-free methods effectively exploit frozen representations but lack an explicit notion of object count, while methods that reason about counts usually rely on category-specific component modeling. We show that counting ability can be introduced into training-free anomaly detection without additional training or part-level supervision. Our key idea is a normal-set calibration that aligns heterogeneous anomaly cues using statistics from normal images, enabling their direct fusion within a unified training-free framework. Built upon this calibration, our detector combines complementary frozen cues to address both logical and structural anomalies. On MVTec-LOCO, our method achieves image-level AUROCs of 89.0 and 95.9 on logical and structural anomalies, respectively, yielding a 92.5 average—the best among training-free detectors in our comparison. It remains competitive with methods requiring network training or part annotations, while its structural variant matches PatchCore on MVTec-AD (99.1 image-AUROC), suggesting that the proposed calibration generalizes beyond logical anomaly detection.

[58] Adaptive Multi-Granularity Temporal Modeling for Weakly Supervised Video Anomaly Detection cs.CV | cs.AIPDF

Changyi Li, Yu Xiao

TL;DR: 本文提出了一种自适应多粒度时序建模框架，用于弱监督视频异常检测（WSVAD）。该框架通过时序细化模块建模长程依赖并提取全局视频表征，通过自适应事件分割模块捕捉不同频率和持续时间的异常事件，并采用基于相似性的自适应融合策略整合不同粒度的异常分数。在两个基准测试上的实验表明，该方法性能优于现有SOTA方法。

Details

Motivation: 现有基于多示例学习（MIL）的WSVAD方法通常依赖固定的手工时序先验来监督异常评分，难以适应真实视频中异常事件在持续时间和时序动态上的巨大变化，导致片段级预测不稳定或不可靠。

Result: 在两个基准数据集上的大量实验表明，所提出的框架在性能上持续优于最先进的（SOTA）方法。

Insight: 创新点在于：1）引入时序细化模块（TRM），利用动态位置编码和可学习的类别令牌来建模长程时序依赖并提炼稳定的全局视频表征；2）设计自适应事件分割模块（ESM），通过时序不连续性分析识别事件边界，将片段特征聚合为判别性的事件级表征；3）提出基于相似性的自适应融合策略，动态整合片段级和事件级异常分数到视频级预测中，用全局语义相关性替代了固定的top-k聚合启发式方法。

Abstract: As the scale of video surveillance data outpaces manual annotation capacities, weakly supervised video anomaly detection (WSVAD) has emerged as a critical research frontier. Most existing approaches formulate WSVAD within a Multiple Instance Learning (MIL) framework that relies on rigid, hand-crafted temporal priors to supervise anomaly scoring. However, such formulations exhibit limited adaptability to the wide variation in anomaly durations and temporal dynamics observed in real-world videos, often leading to unstable or unreliable snippet-level predictions. To address this limitation, we propose an adaptive temporal modeling framework for WSVAD that explicitly accounts for variations in video dynamics across multiple temporal granularities. First, we introduce a Temporal Refinement Module (TRM) that leverages dynamic positional encoding and a learnable class token to model long-range temporal dependencies while distilling a stable global video-level representation. Second, to capture anomalous events with varying frequency and duration, we develop an adaptive Event Segmentation Module (ESM) that identifies event boundaries through temporal discontinuity analysis and aggregates snippet features into discriminative event-level representations. Finally, for snippet-level and event-level predictions, we propose an adaptive similarity-based fusion strategy that dynamically integrates anomaly scores into video-level predictions, replacing fixed top-k aggregation heuristics with global semantic relevance. Extensive experiments on two benchmarks demonstrate that the proposed framework consistently outperforms state-of-the-art methods.

[59] SMILE: Self-Explainable Multimodal Information Bottleneck for Medical Diagnosis cs.CV | cs.LGPDF

Yuqing Yang, Alexander Schmatz, Zhaozhao Ma, Changkyu Choi, Robert Jenssen

TL;DR: 本文提出了一种名为SMILE的自解释多模态信息瓶颈框架，用于医学诊断。该方法在信息瓶颈框架内统一优化预测性能和模态特异性解释，通过识别每个模态中对诊断决策最相关的信息元素来实现。

Details

Motivation: 现有医疗AI解释方法多为事后解释且主要针对单模态数据，难以适用于日益普遍的多模态诊断场景，因此需要一种能够同时提供高性能和透明解释的自解释多模态诊断方法。

Result: 在涵盖异构模态的代表性医学数据集上进行广泛实验，该方法始终表现出强大的诊断性能，例如在iCTCF数据集上实现了9.1个百分点的绝对准确率提升。

Insight: 创新点在于将自解释多模态诊断问题形式化为信息瓶颈框架下的联合优化问题，并利用基于矩阵的Renyi α阶熵函数实现可处理且稳定的优化，从而提供透明且模态感知的特征相关性解释。

Abstract: Explainability is increasingly seen as a crucial requirement in AI-based medical diagnosis, particularly in safety-critical clinical decision-making. Most existing explainability methods in healthcare operate in a post-hoc manner and are predominantly designed for unimodal data, which limits their applicability in increasingly prevalent multimodal diagnostic settings. This paper addresses the problem of self-explainable multimodal diagnosis by formulating it within the information bottleneck (IB) framework. We propose a unified learning paradigm that jointly optimizes predictive performance and modality-specific explainability by identifying the most informative elements inside each modality that contribute to diagnostic decisions. To enable tractable and stable optimization, we employ a matrix-based Renyi’s $α$-order entropy functional under the assumption of sufficiently expressive encoders. Extensive experiments on representative medical datasets spanning heterogeneous modalities demonstrate that the proposed method consistently achieves strong diagnostic performance, including an absolute accuracy improvement of 9.1 percentage points on the iCTCF dataset. Moreover, the learned explanations provide transparent and modality-aware insights into feature relevance, thereby improving both the explainability and generalization.

[60] WeAgent-MMGenEdit: A Full-Stack Recipe for Multimodal Agentic Image Generation and Editing cs.CVPDF

Hui Zhang, Zongkai Liu, Liqiang Niu, Juntao Liu, Han Li

TL;DR: 本文提出了WeAgent-MMGenEdit，一个用于多模态智能体图像生成和编辑的全栈解决方案，包括多模态运行时框架、可扩展的数据构建流程、综合基准测试以及针对智能体策略和图像后端的后训练方法。该方法通过整合检索工具和视觉验证，显著提升了在需要外部世界知识的提示下的图像生成和编辑的可靠性。

Details

Motivation: 现有图像生成和编辑模型在处理需要外部世界知识的提示时不可靠，因为参数化知识有限且存在长尾问题。现有的智能体生成和编辑方法虽然使用检索工具缓解了这一限制，但仍受限于视觉验证不足、策略模型过载以及检索到的文本和视觉证据整合薄弱。

Result: WeAgent-MMGenEdit使一个总参数量300亿/活跃参数量30亿的策略模型超越了类似规模的策略模型，并接近了一个1万亿参数智能体的性能。该方法在WeBench-MMGenEdit双语基准测试上进行了评估，覆盖了知识密集型图像生成和多图像编辑任务。

Insight: 创新点包括：1) WeAgent-Harness多模态运行时，具有持久证据管理和专门的验证与整合工具，将检索到的多模态证据组织成密集载体；2) 可扩展的提示合成和智能体轨迹收集流程，生成大量带有三层可验证检查表的监督轨迹和强化学习任务；3) 基于监督微调和强化学习的双向后训练方法，共同优化智能体策略和图像后端。

Abstract: Image generation and editing models have advanced rapidly, yet remain unreliable when prompts require external world knowledge. Bounded and long-tail parametric knowledge prevents direct or reason-then-generate approaches from recovering the required facts and visual appearances. Existing agentic generation and editing methods mitigate this limitation with retrieval tools, yet remain constrained by insufficient visual verification, overloaded policy models, and weak integration of retrieved textual and visual evidence. To address these limitations, we present WeAgent-MMGenEdit, a full-stack recipe including a multimodal harness, a scalable data construction pipeline, a comprehensive benchmark, and post-training methods for the agent policy and image backend. We first introduce WeAgent-Harness, a multimodal runtime with persistent evidence management and dedicated verification and integration tools that organize retrieved multimodal evidence into a dense carrier. Upon this, we develop a scalable pipeline for prompt synthesis and agentic trajectory collection, yielding 23K supervised trajectories and 14.7K RL tasks with three-layer verifiable checklists. We further introduce WeBench-MMGenEdit, a bilingual benchmark covering both knowledge-intensive image generation and multi-image editing. Finally, a two-sided post-training recipe based on SFT and RL improves the agent policy and image backend. Together, WeAgent-MMGenEdit enables a 30B-total/3B-active policy to outperform similarly sized policy models and approach the performance of a 1T-parameter agent.

[61] First Things First: Teaching LLM-Based Agents to Prioritize Must-Haves before Nice-to-Haves cs.CVPDF

Tianjie Ju, Xinyue Xu, Wanxuan Sun, Lingxiao Diao, Gongshen Liu

TL;DR: 本文探讨了多模态大语言模型（MLLMs）作为自主代理处理复杂结构化用户需求时的能力缺陷，并提出了‘First Things First Reinforcement Learning’（FTF-rl）方法以优化对多优先级需求的推理。研究通过构建包含3,649个问题的数据集，评估了现有MLLMs在电子商务、预订、地图/打车等现实服务场景中的表现，发现它们普遍存在灾难性失败。实验表明，FTF-rl方法显著提升了任务成功率，并在逻辑和数学推理任务上展现出泛化有效性。

Details

Motivation: 尽管多模态大语言模型在作为自主代理执行现实任务方面潜力巨大，但它们在处理用户复杂、结构化需求（如区分‘必须满足’和‘最好满足’的要求）的场景中能力严重不足，这构成了研究的核心动机。

Result: 在精心构建的3,649个问题数据集上，现有最先进的MLLMs在所有需求场景（唯一可行解、多解优先、无解需弃权）中均表现出灾难性失败，频繁误解需求、违反必须条件并生成无效解。相比之下，提出的FTF-rl方法显著提高了任务成功率，并在LogicVista、MathVision和InfoQA等流行的逻辑与数学推理基准上展现出普遍有效性。

Insight: 论文的核心创新点在于明确提出了一个基于强化学习的方法（FTF-rl），专门优化模型对多优先级用户需求的推理过程，强调先满足‘必须’条件再考虑‘最好’条件。从客观角度看，这为提升MLLM代理的泛化能力提供了一条简单而有效的路径，即增强其需求感知的推理能力，而不仅仅是扩展模型规模或数据量。

Abstract: Recent progress in multimodal large language models (MLLMs) has fueled significant enthusiasm in their potential to act as autonomous agents for real-world tasks. However, scenarios requiring agents to fulfill users’ complex, structured requirements remain largely underexplored. In this work, we examine reasoning tasks under three distinct requirement scenarios: (i) Must-have requirements uniquely determine a unique feasible solution; (ii) Multiple answers satisfy the must-have requirements and are prioritized via the nice-to-have requirements; and (iii) No candidate solution satisfies the must-have requirements, in which case the agent should abstain from generating a response. We evaluate state-of-the-art MLLMs on 3,649 carefully constructed problems that reflect realistic service scenarios, including e-commerce, booking, and map-based or ride-hailing. Our evaluation reveals that existing MLLMs exhibit catastrophic failures in all scenarios. They frequently misinterpret task requirements, violate must-have requirements, and produce invalid solutions. To address this critical gap, we propose First Things First Reinforcement Learning FTF-rl that explicitly optimizes reasoning over multi-priority user requirements. Experimental results show that our method substantially improves the task success rate compared to strong baselines. Moreover, FTF-rl yields general effectiveness on popular logical and mathematical reasoning tasks, including LogicVista, MathVision, and InfoQA. Our findings suggest that enhancing requirement-aware reasoning capability provides a simple yet effective pathway to improve generalization of MLLM agents. Code and dataset are available at https://github.com/claire62/FTF-RL.

[62] Measured Sliders: Learning Continuous Controls from Differentiable Image Measurements cs.CVPDF

Yijia Chen, Boyu Wei, Xuanhua Yin

TL;DR: 本文提出了Measured Sliders框架，通过可微分的图像测量来定义和控制扩散模型的连续生成属性。该方法在训练前进行可观测性测试筛选有效监督信号，训练中使用测量引导的目标函数学习目标属性变化并抑制非目标变化，训练后通过解码校准将控制量化为可比较的图像变化单位。该方法在SDXL和FLUX.1-dev模型上实现了有序、选择性强且可组合的控制效果。

Details

Motivation: 现有扩散模型滑块的控制轴通常基于文本或学习表示，其尺度与可观测的图像属性脱节，导致无法预先判断哪些属性可学习、直接比较控制强度或预测多控制组合时的干扰。

Result: 在553个提示词上，光照方向控制达到Spearman相关系数rho=0.995和98.9%的单调扫描成功率。一个包含五个属性的检查点实现了平均选择性2.59（最强基线为1.50），并在96.7%的双属性组合和86.1%的三属性组合中保留了所有请求的方向。可观测性测试成功区分了所有后续成功的测量与失败的候选测量。

Insight: 创新点在于将图像空间测量作为学习、诊断、校准和组合连续生成控制的统一基础，通过封闭形式的可微图像测量定义控制轴，并使用测量引导的优化目标实现属性解耦。该方法提供了可预测和可解释的控制机制。

Abstract: Continuous sliders are useful only when coefficient changes produce predictable image changes. Yet most diffusion sliders derive their axes from text or learned representations, leaving their scales disconnected from observable image properties. Consequently, we cannot tell in advance which attributes are learnable, compare control strengths directly, or anticipate interference when multiple controls are combined. We propose Measured Sliders, a framework that defines continuous controls through closed-form differentiable image measurements. A common measurement space unifies the pipeline. Before training, an observability test identifies usable supervision. During training, a measurement-guided objective learns target movement while suppressing non-target changes. After training, decoded calibration expresses controls in comparable units of realized image change. Multiple LoRA branches are stored in one checkpoint and composed without training on joint activations. Across SDXL and FLUX.1-dev, the resulting controls are ordered, selective, and composable. On 553 prompts, lighting direction reaches rho = 0.995 and 98.9% monotone sweeps. A five-attribute checkpoint achieves average selectivity 2.59, compared with 1.50 for the strongest baseline, and preserves every requested direction in 96.7% of pair and 86.1% of triple compositions. The observability test also separates every subsequently successful measurement from the failed candidate. Overall, image-space measurement provides a common basis for learning, diagnosing, calibrating, and composing continuous generative controls.

[63] Cross-Domain Tracker Adaptation Without Target-Domain Labels via Vision-Language Agents cs.CVPDF

Daniel Davila, Ravikumar Balakrishnan, Mike Cochran

TL;DR: 本文提出了一种利用视觉语言模型（VLM）作为诊断代理的系统，用于在无需目标域标注的情况下，将检测-跟踪流程适应到新的目标域。系统通过VLM直接检查渲染的跟踪输出，识别视觉故障模式，并通过迭代调优循环推荐参数更新，从而恢复因域偏移而损失的跟踪性能。

Details

Motivation: 解决在目标域缺乏标注数据时，如何将跟踪系统有效适应到新领域的问题。传统基于真值监督的超参数迁移方法在域偏移较大时性能会显著下降，而手动设计代理目标的贝叶斯优化方法也面临困难。

Result: 在MOT17->MOT20的域适应任务中，该方法在完全不使用目标域标签的情况下，恢复了67.8%因域偏移损失的HOTA性能，最终结果距离目标域性能上限仅差0.029 HOTA；在最高密度的目标序列上，恢复率高达86.7%。

Insight: 创新点在于利用VLM作为诊断代理进行无监督的视觉故障模式识别和参数调优，实现了选择性适应（在无明显故障时保持配置不变）。该方法在域偏移主要通过检测级参数暴露时效果显著，但在源域配置已接近最优（如MOT17->DanceTrack）的情况下提升有限。

Abstract: We present a system that uses a Vision-Language Model (VLM) as a diagnostic agent for adapting a detect-to-track pipeline to a new target domain without access to target-domain labels. Rather than optimizing against annotated metrics, the VLM directly inspects rendered tracking outputs, identifies visual failure modes, and recommends parameter updates through an iterative tuning loop. We first demonstrate that ground-truth-supervised hyperparameter transfer can be brittle. On MOT17->MOT20, applying a source-derived oracle configuration reduces mean HOTA by 0.090, from a target-domain ceiling of 0.357, to 0.267. Without using any target-domain labels, our VLM-based tuner recovers 67.8% of this lost headroom, finishing within 0.029 HOTA of the target ceiling; on the highest-density target sequence, it recovers up to 86.7%. We further show that label-free Bayesian optimization with handcrafted proxy objectives struggles under large domain shifts and can degrade configurations that are already strong. In contrast, the VLM tuner acts selectively: when its visual diagnosis reveals no clear failure mode, it declines to modify the configuration, preserving performance on easy transfers while improving hard ones. Finally, we characterize the conditions under which this approach succeeds, namely, when domain shift manifests through exposed detection-level parameters, versus where it is less effective, such as MOT17->DanceTrack, where the source oracle is already near-optimal.

[64] Few-Shot Video Recognition via Hierarchical Metric Learning cs.CVPDF

Jiaxin Zhang, Haoran Gao, Xizhan Gao, Zihao Dong, Tingwei Wang

TL;DR: 本文提出了一种用于小样本动作识别（FSAR）的分层度量学习方法（HML-FSAR）。该方法首先通过空间增强模块捕获跨帧全局空间表征，并结合时间多头注意力、异构对齐、时空特征融合与字典学习模块构建完整的特征处理流程。其次，嵌入分层度量学习策略，通过中心度量、对齐度量、对比度量、字典度量和原型度量，对从帧级表征到最终类原型的全过程施加渐进式多阶段互补约束，以联合优化特征紧致性、异构时空对齐、类间区分度和抗噪鲁棒性。

Details

Motivation: 现有小样本动作识别方法通常在网络输出端应用单原型监督，未能充分利用视频中丰富的跨帧全局空间信息；即使现有的多级度量方案也仅在中间层施加并行原型约束，缺乏沿整个特征管道的渐进式监督，导致学习到的类原型泛化能力有限。

Result: 所提出的HML-FSAR方法在五个广泛使用的小样本动作识别数据集上进行了验证，实验结果充分证明了其有效性。

Insight: 创新点在于构建了包含空间增强、时间注意力、异构对齐、特征融合和字典学习的完整特征处理流水线，并设计了分层度量学习策略，通过多阶段渐进式约束（中心、对齐、对比、字典、原型度量）联合优化多个关键特性，从而提升小样本场景下的识别性能。

Abstract: Few-shot action recognition (FSAR) aims to recognize unseen action categories with only a small number of annotated video samples. Recent works typically apply single-prototype supervision at the network output and fail to sufficiently exploit rich cross-frame global spatial information in videos. Even existing multi-level metric schemes only impose parallel prototype constraints on intermediate layers, without progressive supervision along the full feature pipeline, which results in limited generalization ability of the learned class prototypes. Inspired by this, we present a novel method, hierarchical metric learning for few-shot action recognition (HML-FSAR). First, a spatial-enhanced module is developed to capture cross-frame global spatial representations. Combined with temporal MHA, heterogeneous alignment, spatial-temporal feature fusion and dictionary learning modules, it constructs the complete feature processing pipeline. Second, a hierarchical metric learning (HML) strategy is embedded into HML-FSAR. Composed of center metric, alignment metric, contrastive metric, dictionary metric and prototype metric, HML imposes progressive multi-stage complementary constraints from frame-level representations to final class prototypes, so as to jointly optimize feature compactness, heterogeneous spatial-temporal alignment, inter-class discriminability and anti-noise robustness. The proposed HML-FSAR method is validated on five widely-used FSAR datasets, and experimental results fully demonstrate its effectiveness.

Liqian Yang, Xingchi Chen, Xinfeng Gui, Xiangyong Cao, Qianxin Yi

TL;DR: 本文提出了一种名为TSR-ITNR的两阶段自监督框架，用于高光谱与多光谱图像融合任务。该方法通过隐式张量神经表示学习空间-光谱细化，并利用无参数校准机制从两种观测图像中提取互补信息，以重建高分辨率高光谱图像。

Details

Motivation: 现有基于隐式神经表示的方法在捕捉细粒度空间结构和丰富光谱依赖性方面存在不足，且对低分辨率高光谱图像和高分辨率多光谱图像之间的互补信息利用不充分。

Result: 在多个基准数据集上的实验表明，该方法在定量指标、视觉效果和光谱重建方面均表现出色，且无需真实高分辨率高光谱图像作为监督。此外，在下游语义分割任务上的评估也验证了其有效性。

Insight: 创新点在于将隐式Tucker表示与两阶段重建框架结合，通过空间系数张量与光谱基的细化来提升表示能力，并设计了无参数校准模块来充分利用观测图像间的互补信息，同时具备理论保证。

Abstract: Hyperspectral and multispectral image fusion (HMIF) aims to reconstruct a high-resolution hyperspectral image (HR-HSI) by combining the fine spatial details of a high-resolution multispectral image (HR-MSI) with the rich spectral information of a low-resolution hyperspectral image (LR-HSI). Recent advances in implicit neural representations (INRs) have enabled flexible coordinate-based modeling for HMIF; however, existing INR-based approaches may not fully capture fine-grained spatial structures and rich spectral dependencies. Moreover, the LR-HSI and HR-MSI are primarily incorporated through degradation-consistency constraints, leaving their complementary information underexploited. To address these limitations, we propose Two-Stage Reconstruction with Implicit Tensor Neural Representation (TSR-ITNR), a unified self-supervised framework integrating representation refinement and observation-guided calibration. In Stage 1, TSR-ITNR learns an implicit Tucker representation and refines its low-rank spatial coefficient tensor and spectral basis to better capture fine spatial structures and interband correlations. A fixed pretrained denoiser further provides a deep prior for the preliminary reconstruction. In Stage 2, parameter-free calibration derives complementary and noninterfering corrections from both observations to recover information insufficiently captured in Stage 1. Theoretical analysis establishes the geometry-preserving property of spectral refinement and the orthogonal complementarity of calibration. Extensive experiments on multiple benchmark datasets demonstrate strong quantitative, visual, and spectral reconstruction performance without ground-truth HR-HSI supervision. Beyond conventional reconstruction metrics, we further assess the effectiveness of TSR-ITNR using downstream semantic segmentation accuracy.

[66] Lightweight Vision Transformer Compression for On-Device Plant Disease Detection in Resource-Constrained Agricultural Field Conditions cs.CV | cs.AI | cs.LGPDF

Mahadev Sunil Kumar, Bhavika Gondi, Desaisetty Venkata Satya Sai Swapnith, Gangireddy Rahul Jogi, Sudheesh Manalil

TL;DR: 本文提出了一种轻量级视觉Transformer压缩框架，用于在资源受限的农业田间条件下进行设备端辣椒病害检测。该框架结合了基于二阶灵敏度估计的Hessian平衡自适应块剪枝、量化和基于注意力的知识蒸馏，通过系统化评估和集成，在保持高精度的同时大幅减小模型尺寸。

Details

Motivation: 辣椒是印度的重要经济作物，但病害识别依赖专家，难以自动化。视觉Transformer虽精度高，但计算量大，难以部署在资源受限设备上。现有压缩方法通常孤立处理剪枝、量化和知识蒸馏，未充分探索其组合应用的潜力和交互作用。

Result: 在辣椒3类村庄分割数据集（包含真实的跨村庄、跨设备分布外测试分割）上，压缩模型达到或超过95.13%的FP32基线精度，模型尺寸减少74-98%。完全集成压缩管道在四种测试配置下实现54.5倍尺寸缩减（从327.42 MB到6.01 MB），精度为95.13 ± 2.32%。

Insight: 创新点在于提出统一的ViT压缩框架，系统结合剪枝、量化和蒸馏，并通过消融研究确定最佳组件集成。客观分析表明，直接训练同等尺寸的学生模型也能达到相近精度，提示在某些场景下剪枝和蒸馏的计算成本需进一步权衡，为轻量级模型设计提供了实用见解。

Abstract: Chilli (Capsicum annuum) is one of India’s most economically significant crops, yet its productivity is persistently threatened by diseases that are difficult to identify without expert intervention. While Vision Transformers (ViTs) have achieved high classification accuracy, their large computational footprint makes deployment on resource constrained devices challenging. Existing compression approaches typically address pruning, quantization, and knowledge distillation in isolation, leaving the potential benefits and interactions of their combined application insufficiently explored. We propose a unified Vision Transformer compression framework that combines Hessian-Balanced Adaptive Block Pruning (H-BAC), guided by second-order sensitivity estimation, with quantization and attention-based knowledge distillation. To systematically identify the most effective configuration within each compression family, each technique is first evaluated independently through controlled ablation studies, after which the best-performing components are integrated into a sequential deployment pipeline tailored to real-world agricultural constraints. On a chilli 3-class village-split dataset with a genuine cross-village, cross-device out-of-distribution test split, the resulting compressed models match or exceed the 95.13% FP32 baseline’s accuracy, alongside 74-98% model size reduction, and the fully integrated compression pipeline achieves a 54.5x size reduction (327.42 MB to 6.01 MB) at 95.13 +/- 2.32% accuracy across four tested configurations. A direct comparison further reveals that, on this dataset, a directly-trained student of the same final size, without pruning or distillation, reaches comparable accuracy of 94.87%, at the same 6.01 MB INT8 size, indicating where H-BAC and knowledge distillation are, and are not yet shown to be, worth their computational cost.

[67] MEOX: Compact Multimodal Mixture-of-Experts for Earth Observation cs.CVPDF

Mohanad Albughdadi

TL;DR: 本文提出了MEOX，一种用于地球观测的紧凑型多模态混合专家模型，通过传感器特定适配器、显式有效性信号和共享稀疏专家块来处理异构传感器和缺失观测数据。该模型在1.228百万个MMEarth64样本上进行预训练，并在六个GEO-Bench任务上评估其性能，在紧凑参数预算下实现了强大的任务迁移能力。

Details

Motivation: 解决地球观测中异构传感器和缺失观测数据带来的表示学习挑战，同时避免传统方法中因架构扩大导致的参数膨胀问题。

Result: 在64像素的腰果分割任务上达到64.42%的平均交并比，在224像素的EuroSAT任务上达到90.56%的平均准确率，超过了CSMoE的相应结果；在BigEarthNet微调中达到72.95%的微平均精度。

Insight: 采用传感器特定适配器和共享稀疏专家块实现模态依赖处理与高效融合；通过旋转注意力支持与预训练不同的下游空间网格；利用元数据令牌提升性能，并通过路由诊断分析专家参与模式。

Abstract: Recent advances in Earth Observation representation learning accommodate heterogeneous sensors and missing observations, often through larger architectures. We present MEOX (Multimodal Earth Observation with eXperts), a multimodal masked autoencoder with a 2.939 million-parameter encoder and 3.115 million parameters in total. Sensor-specific adapters, explicit validity signals, and a shared sparse-expert block preserve modality-dependent processing before a learned patch-wise fusion. Four metadata tokens then accompany a single spatial sequence through fourteen further encoder blocks. Shared expert projections with private low-rank residuals constrain parameter growth, while rotary attention supports downstream spatial grids different from pretraining. The model is pretrained on 1.228 million MMEarth64 samples using modality-balanced masked reconstruction and structured sensor dropout. Frozen transfer is evaluated on six GEO-Bench tasks at both 64 and 224 pixels. The model reaches 64.42% mean intersection-over-union on cashew segmentation at 64 pixels and 90.56% average accuracy on EuroSAT at 224 pixels, exceeding the corresponding reported CSMoE results. BigEarthNet finetuning reaches 72.95% micro-average precision. Routing diagnostics distinguish expert participation, spatial dependence, modality association, and functional contribution. A held-out WorldCover probe measures a 0.64-percentage-point benefit from metadata, while retrieval separates same-sensor semantics from cross-sensor alignment. These results demonstrate sensor-flexible representation learning and strong task transfer using a compact parameter budget.

[68] Think-Verify-Revise: Neuro-Symbolic Visual Reasoning with Vision-Language Models and Dynamic Logic Tensor Networks cs.CVPDF

Homayoun Afshari, Pietro Basci, Alessandro Russo, Lia Morra

TL;DR: 本文提出了一种名为Think-Verify-Revise的神经符号推理框架，用于解决视觉推理任务。该框架将视觉语言模型（VLM）与动态逻辑张量网络（D-LTN）紧密耦合，形成一个闭环迭代反馈循环。VLM负责从少量标注的视觉示例中归纳一阶逻辑规则，D-LTN则对这些规则进行可微验证，并将验证失败的结果反馈给VLM以修正假设。

Details

Motivation: 视觉推理任务需要系统同时感知视觉内容并应用形式化的关系约束，而纯神经方法或纯符号方法单独处理时都存在不足。本文旨在弥合这一差距，通过结合两者的优势来更好地处理此类任务。

Result: 在ViSudo-PC基准测试的四个视觉领域（MNIST, EMNIST, KMNIST, FMNIST）上，该方法仅使用三个训练示例作为视觉上下文，即可归纳出有效的数独约束规则。其AUC分数达到或超过了先前的方法（如NeuPSL和LTN），展示了通过VLM自动发现规则的潜力。

Insight: 主要创新点在于构建了一个闭环的神经符号推理框架，将VLM的规则归纳能力与D-LTN的可微验证能力动态结合，并通过迭代反馈进行修正。从客观角度看，这种将大语言模型的逻辑归纳与符号推理的精确验证相结合的模式，为自动规则学习和视觉推理提供了一种新颖且有效的架构思路。

Abstract: Visual reasoning tasks require a system to jointly perceive visual content and apply formal relational constraints—a combination that neither pure neural nor purely symbolic approaches handle well in isolation. This paper proposes a Neuro-Symbolic (NeSy) framework that closes this gap by tightly coupling a Vision-Language Model (VLM) for automatic First-Order Logic (FOL) rule induction with a Dynamic Logic Tensor Network (D-LTN) for differentiable rule verification, in a closed iterative feedback loop. The VLM receives a small set of labelled visual examples and proposes candidate FOL rules conforming to a strict grammar (Think); the D-LTN is automatically assembled from these rules at runtime and evaluates them grounding on CNN-produced visual embeddings (Verify); and verification failures are fed back to guide the VLM’s next hypothesis (Revise). Evaluated on the ViSudo-PC benchmark across four visual domains (MNIST, EMNIST, KMNIST, FMNIST), the system induces valid Sudoku constraint rules using only three training examples as visual context. The proposed method achieves AUC scores matching or outperforming previous methods (NeuPSL, LTN), showing the potential for automatic rule discovery through VLM. Code is available at https://github.com/homayoun-afshari/nesy.

[69] From Interpretability Methods to Interpretable Models cs.CV | cs.HCPDF

Julien Colin, Nuria Oliver, Thomas Serre

TL;DR: 这篇论文主张将可解释人工智能（XAI）的研究重点从解释方法转向模型本身的可解释性评估。作者认为现有工具已足够用于比较不同模型的表示和计算，但关键挑战在于衡量模型能否被实际依赖它的人类（如独立评估者）理解，这需要直接测量而非推断。

Details

Motivation: 当前XAI领域过度专注于开发和比较各种解释方法（如归因、特征可视化），而忽视了核心问题：模型本身的可解释性如何，以及随着模型演进是否取得了进展。

Result: 论文未提及具体定量结果或基准测试，而是综述了现有工具和少量比较模型可解释性的工作，并提出了以模型为中心的XAI研究议程。

Insight: 创新点在于呼吁XAI研究范式转移，强调直接评估模型对人类（尤其是非专家）的可理解性，并借鉴系统神经科学的思路，推动模型可解释性的实证测量而非间接推断。

Abstract: More than a decade in, explainable AI (XAI) for computer vision has assembled a mature toolbox: attribution, feature visualization, concept-based, and circuit-based methods. Yet almost all of the field’s effort has gone into building and comparing these methods, and little into the question they were meant to answer—how interpretable are our models, and are we making progress as they evolve? We argue for shifting the field’s focus from methods to models, along two complementary lines. One is already within reach: existing tools let us characterize and compare what different models represent and compute. The other is harder, and largely neglected: whether a model can actually be understood by the humans who rely on it—the independent evaluators on whom trust and certification depend, not the experts confirming what they already expect. It can only be measured, not inferred. We review why the toolbox is mature enough to support both, survey the thin body of work comparing models, draw a parallel to systems neuroscience, and close with a model-centric XAI agenda.

[70] WorldSculpt: Generating Compositional Worlds from Grounded Videos cs.CVPDF

Muyao Niu, Jixuan He, Ruihan Yu, Lian Fu, Yonghao Yu

TL;DR: 论文提出WorldSculpt方法，用于从多视角视频生成包含数百个物体的杂乱场景的合成3D表示。该方法通过扩展单物体3D生成先验Pixal3D，使其能基于多视角观测进行物体生成，从而在无需场景级训练的情况下，将复杂场景表示为放置在共享世界坐标系中的独立物体网格集合。

Details

Motivation: 解决在物体严重遮挡的密集杂乱场景中，生成可用于游戏、AR/VR、仿真和机器人等下游应用所需的合成3D表示（即独立物体网格集合）的挑战。现有几何方法重建为单一表示且遮挡区域不完整，而现有基于生成先验的合成方法主要局限于简单场景。

Result: 在单物体、受控多物体以及新提出的高真实感基准UE-MeshyScene上，该方法均优于现有方法，且随着场景复杂性和遮挡程度的增加，优势更明显。

Insight: 核心创新在于将强大的单物体3D生成先验适应于多视角观测以实现场景合成生成，证明了该范式在无需场景级训练下处理严重遮挡复杂场景的可行性和可扩展性。同时，引入了包含真实网格标注的UE-MeshyScene基准，并展示了将生成的3D高斯泼溅（3DGS）世界转换为合成网格场景的更广泛适用性。

Abstract: We study the problem of generating a compositional 3D representation of a cluttered scene containing hundreds of objects. The goal is to represent the scene as a collection of individual object meshes placed in a shared world frame, as required by downstream applications such as gaming, AR/VR, simulation, and robotics. This task is challenging in densely cluttered scenes, where objects heavily occlude one another and each view reveals only a fraction of their geometry. Geometry-based approaches typically reconstruct the scene as a single representation and leave incomplete geometry in occluded regions, while existing compositional methods with generative priors are largely limited to relatively simple scenes. We show that complex scenes with hundreds of objects can instead be generated compositionally by adapting a strong single-object 3D generative prior to multi-view observations. We instantiate this paradigm with Pixal3D, extending it with a multi-view conditioning pathway that grounds object generation in multiple posed observations. Although the model is finetuned entirely on single objects in canonical space, it generalizes to large scenes with severe occlusion without any scene-level training, demonstrating the feasibility and scalability of this paradigm. We further introduce UE-MeshyScene, a photorealistic benchmark of densely cluttered scenes with hundreds of objects, per-object annotations, and ground-truth meshes. Across single-object, controlled multi-object, and UE-MeshyScene evaluations, our method consistently outperforms prior approaches, with larger gains as scene complexity and occlusion increase. Finally, we demonstrate broader applicability by converting generated 3DGS worlds, such as Marble and HY-World 2.0, into compositional mesh scenes.

eess.IV [Back]

[71] Multi-scale Image Representation Compression eess.IV | cs.CV | cs.MMPDF

Tianhao Peng, Ho Man Kwan, Fan Zhang, Shan Liu, David Bull

TL;DR: 本文提出了一种名为MIRC的过拟合图像编解码器，通过端到端量化与熵编码优化率失真性能，并引入多尺度表示与跨阶段参数共享以提高编码效率。该方法在CLIC2020专业验证集上相比VVC（VTM 22.0）实现了10.5%的BD-rate节省，且提供多种解码复杂度配置以适应部署需求。

Details

Motivation: 针对现有过拟合图像编解码器（如Cool-chic）未完全优化率失真目标、训练中网络权重保持全精度且量化参数后处理选择、以及单尺度合成忽略跨尺度冗余的问题，旨在提升编码效率与端到端优化。

Result: 在CLIC2020专业验证集上，MIRC相比VVC（VTM 22.0）实现了10.5%的BD-rate节省，解码复杂度可配置为1.2至2.9 kMAC/像素，达到SOTA性能。

Insight: 创新点包括端到端量化与熵编码的统一率失真优化框架、多尺度表示与跨阶段参数共享以减少冗余，借鉴了神经视频表示编解码器NVRC的管道，提升了编码效率与部署灵活性。

Abstract: Overfitted codecs have demonstrated promising performance for image and video compression. In particular, for image compression, the Cool-chic family of models has shown competitive performance against scene-agnostic models, with orders of magnitude lower decoding complexity at the cost of a longer overfitting process. However, these overfitted image codecs are not fully optimized toward the rate-distortion objective: their network weights remain in full precision during training, and the associated quantization parameters are selected in a separate post-training stage. Furthermore, their synthesis operates at a single scale, which overlooks cross-scale redundancy. In this paper, we propose MIRC, an overfitted image codec in which every coded component, including the latents, the synthesis network, and the entropy models, is quantized and entropy coded under a single rate-distortion objective, adopting the end-to-end compression pipeline of the neural video representation codec NVRC. We further introduce a multi-scale representation with cross-stage parameter sharing, which improves coding efficiency at a small transmitted overhead. On the CLIC2020 professional validation set, MIRC achieves a 10.5% BD-rate saving against VVC (VTM 22.0). Moreover, MIRC offers a family of configurations spanning 1.2 to 2.9 kMAC per pixel, so the decoding budget can be selected to match the deployment target.

[72] Scalable Neural Video Representation Compression eess.IV | cs.CV | cs.MMPDF

Tianhao Peng, Ho Man Kwan, Fan Zhang, Shan Liu, David Bull

TL;DR: 本文提出了一种名为S-NVRC的可扩展神经视频表示压缩方法，该方法基于隐式神经表示（INR），能够从单个嵌入式比特流中同时支持细粒度的码率和解码复杂度可扩展性。

Details

Motivation: 解决现有基于INR的可扩展视频编码方法中，码率与解码复杂度耦合且性能不及主流可扩展/非可扩展编码器的问题。

Result: 在UVG数据集上，S-NVRC的BD-rate性能分别比SHM 12.4和VTM-20.0高出43.7%和5.6%，同时提供了灵活的复杂度可扩展性。

Insight: 创新点在于采用了从粗到细的特征网格前缀和嵌套的网络层前缀，分别实现了码率和解码复杂度的独立可扩展，从而在单一编码下覆盖了广泛的码率与复杂度范围。

Abstract: Scalable video coding (SVC) encodes a video into a layered bitstream consisting of a base layer and one or multiple enhancement layers, enabling decoding at different bitrate/quality/resolution operating points to accommodate diverse device capabilities and network conditions. Due to its practical flexibility, SVC has been incorporated into major video coding standards and has recently attracted growing interest for both scene-agnostic and scene-adaptive neural video codecs. Among the latter, Implicit neural representation (INR) based codecs achieve compression by overfitting a compact neural network to an individual video, offering fast decoding and competitive coding efficiency compared to scene-agnostic neural codecs. However, research on scalable INR-based compression remains in its infancy: these methods support scalable coding by introducing additional network layers, which couple the bitrate with the decoding complexity and also cannot achieve comparable performance with strong scalable/non-scalable codecs. In this context, this paper proposes S-NVRC, a scalable INR-based video codec that jointly supports fine-grained bitrate and decoding complexity scalability from a single embedded bitstream. It adopts a coarse-to-fine prefix for feature grids and a nested prefix for network layers, which scale bitrate and decoding complexity, respectively. The proposed S-NVRC spans a wide range of bitrate and decoding-complexity using a single encoding (training) and outperforms SHM 12.4 and the multi-layer VTM-20.0, by 43.7% and 5.6% in BD-rate on the UVG dataset, while also providing flexible complexity scalability. Implemented code will be provided.

[73] Ultrasound-Based Prediction of Cirrhosis Decompensation Using Large-Scale Computer Vision Models eess.IV | cs.AI | cs.CVPDF

Guangyi Zhang, Peiyun Ni, Eugene Cheah, Rajat Chandra, Peng Guo

TL;DR: 本研究提出了一种基于大规模计算机视觉模型的新型影像学方法，用于分析常规腹部超声图像，以预测肝硬化失代偿的发生。该方法通过自动化超声数据处理结合现代深度学习架构，在临床恶化发生前识别高风险患者，为现有临床评分系统提供了一种实用的非侵入性补充工具。

Details

Motivation: 解决肝硬化失代偿这一关键病程转变缺乏可靠非侵入性预测工具的问题，利用广泛可用、低成本的超声影像进行可扩展的风险分层和长期随访。

Result: 论文提出了一种基于超声影像和深度学习的预测框架，旨在识别肝硬化失代偿高风险患者，但摘要中未提及具体的定量结果、基准测试或与现有方法的比较。

Insight: 创新点在于将大规模计算机视觉模型应用于常规腹部超声图像分析，提取超越传统实验室风险评分的预测特征，实现自动化、非侵入性的早期风险分层，为肝硬化患者的主动管理提供了新途径。

Abstract: Decompensation represents a critical transition in the course of cirrhosis, yet clinicians have limited non-invasive tools to reliably predict its onset. In this study, we propose a novel imaging-based approach that leverages large-scale computer vision models to analyze routine abdominal ultrasound images and extract predictive features beyond those captured by traditional laboratory-based risk scores. Ultrasound is widely available, low cost, and suitable for longitudinal surveillance, making it an attractive modality for scalable risk stratification and long-term follow-up. Our framework integrates automated ultrasound data processing with modern deep learning architectures to identify patients at high risk of decompensation prior to the occurrence of clinical deterioration. This non-invasive strategy offers a practical complement to existing clinical scoring systems and may enable earlier, more proactive management of patients with compensated cirrhosis.

Zinah Ghulam, Richa Mittal, Eranga Ukwatta

TL;DR: 本文提出了一种名为跨模态分诊网络（CMTN）的多模态深度学习框架，用于胸部X光片（CXR）的严重性分级、病理检测和视觉可解释性。该模型融合了Swin Transformer V2视觉编码器和PubMedBERT文本编码器，在MIMIC-CXR-JPG数据集上训练，实现了四层严重性分级和14种病理检测。

Details

Motivation: 解决因CXR扫描数量增加导致的分诊瓶颈问题，现有AI工具多为缺乏严重性感知的单模态二元分类器，且多模态系统很少与放射科专家进行基准比较。

Result: 在参考标签上实现了强序数一致性（QWK = 0.9341），14种病理的宏观AUROC为0.9970，延迟34ms，优于最先进的BioViL多模态基线（QWK = 0.7679）。但盲法临床审计一期显示与真实放射科医生判断的一致性很低（QWK = 0.1399），二期审计发现54.3%的热图达到临床可接受的空间定位。

Insight: 创新点在于通过门控交叉注意力融合视觉与文本模态进行联合严重性分诊和病理检测，并进行了临床审计评估。关键洞察是，仅基于NLP衍生标签的基准性能不足以反映临床现实，强调了临床部署前需要放射科医生标注的真实数据。

Abstract: Purpose: Increased number of chest radiograph (CXR) scans create a triage bottleneck, queueing urgent examinations behind routine ones. Existing AI tools are predominantly unimodal binary classifiers lacking severity awareness, and multimodal systems are rarely benchmarked against expert radiologists. To this end, we developed a multimodal deep learning framework for joint severity triage, pathology detection, and native visual explanation. Approach: We propose the cross-modal triage network (CMTN), fusing a Swin Transformer V2 visual encoder with a PubMedBERT text encoder via gated cross-attention. The CMTN was trained on 34,639 image-text pairs (12,489 patients) from MIMIC-CXR-JPG, optimizing an ordinal focal loss for four-tier severity triage and binary cross-entropy for 14 pathologies. Beyond quantitative benchmarking, attention heatmaps were evaluated against a blinded expert radiologist in a two-phase clinical audit comparing model triage output to expert severity assessment (100 cases) and grading spatial-semantic concordance (116 heatmaps). Results: The CMTN achieved strong ordinal agreement with reference labels (quadratic weighted kappa [QWK] = 0.9341, 95% CI: 0.9219 to 0.9449) and macro-AUROC of 0.9970 across 14 pathologies, with 34~ms latency, outperforming the state-of-the-art BioViL multimodal baseline (QWK = 0.7679). However, the blinded Phase I clinical audit revealed substantially lower agreement with genuine radiologist judgment (QWK = 0.1399). Phase II found 54.3% of heatmaps achieved clinically acceptable spatial localization. Conclusions: The CMTN demonstrated an efficient multimodal architecture for CXR triage. The divergence between algorithmic and radiologist agreement demonstrates that benchmark performance against NLP-derived labels is insufficient, highlighting the need for radiologist-labeled ground truth before clinical deployment.

[75] Fractional-Order Adaptive Motion Magnification: Phase-Reliability Weighting for Noise-Constrained Video Amplification eess.IV | cs.CVPDF

Alejandro Garnung Menéndez

TL;DR: 本文提出了一种名为FrAM（分数阶自适应运动放大）的视频放大方法，通过引入分数阶Grünwald–Letnikov导数替代恒定时间增益，以及基于单基因信号局部幅度的逐像素空间权重，实现了对高频信号的连续控制和噪声抑制。该方法在合成和真实视频中均能有效放大运动同时保持背景噪声在输入水平，且因果重构版本大幅提升了处理速度。

Details

Motivation: 传统欧拉视频放大方法对每个像素应用均匀增益，忽略了局部结构，导致传感器噪声（尤其在纹理缺失区域）与信号一同被放大，因为单基因相位在这些区域不可靠。本文旨在解决噪声放大问题，提升视频放大的空间选择性和鲁棒性。

Result: 在分为纹理和平坦区域的合成序列上，FrAM在匹配基线放大效果的同时，将平坦区域的时间噪声保持在输入水平，且该降低效果在八倍输入噪声范围内均成立。真实视频测试显示空间选择性改善和背景噪声降低，因果重构版本将每帧处理成本降低两个数量级，在640×480分辨率下达到69 fps。

Insight: 创新点包括使用分数阶导数实现连续高频控制，以及基于单基因信号局部幅度的自适应空间权重来抑制噪声。从客观角度看，该方法通过结合分数阶微积分和局部信号可靠性加权，为视频运动放大提供了更精细的噪声约束方案，且因果流式实现显著提升了实时性。

Abstract: Eulerian video amplification boosts sub-pixel motion by band-pass filtering per-pixel intensity traces and applying a uniform gain. That gain ignores local structure, so sensor noise is amplified together with the signal, especially in textureless regions where the monogenic phase is unreliable. We propose FrAM (Fractional-order Adaptive Motion Magnification), a pipeline developed first offline and then as a causal stream. It replaces the constant temporal gain with a Grünwald–Letnikov derivative of fractional order, giving continuous control over high-frequency emphasis, and replaces the uniform spatial gain with a per-pixel weight derived from the local amplitude of the monogenic signal. On a controlled synthetic sequence split into textured and flat halves, FrAM matches the amplification of the Eulerian baseline while keeping flat-region temporal noise at the input level. The reduction holds across an eightfold range of input noise levels. Real videos show improved spatial selectivity and lower background noise in every case. The causal reformulation cuts the per-frame cost by two orders of magnitude, reaching 69,fps at 640$\times$480.

Rita Cordeiro Mendes, Maria Rita Fonseca Verdelho, Carlos Santiago, Catarina Barata

TL;DR: 该论文介绍了一个新构建的多中心、多模态、纵向肺癌数据集，包含1,365名患者的多种影像数据、临床数据、转录组数据和随访信息，旨在支持真实条件下学习管道的评估。该数据集具有显著且不均匀的模态缺失特性，并提供了单模态和多模态的生存预测基准测试。

Details

Motivation: 解决多模态学习在医学应用中面临的两大挑战：缺乏反映真实世界条件（数据不一致且不完整）的现成数据集，以及整合异构数据模态的固有困难。

Result: 在12个月总生存期预测、疾病特异性生存预测以及严重数据缺失下的风险预测纵向基准测试中，结果表明，尽管存在高水平的数据缺失，整合互补模态始终比单模态方法提高了预测性能。

Insight: 创新点在于构建了一个专门反映真实世界临床数据复杂性和缺失模式的多模态纵向数据集，为研究鲁棒的多模态融合策略提供了重要资源，并实证了多模态融合在真实临床环境中的价值。

Abstract: Multi-modal learning has demonstrated strong potential in medical applications by integrating heterogeneous data sources such as medical imaging, clinical records, and genomics to improve predictive performance and support clinical decision-making. However, advances in this area are often constrained by two key challenges: the limited availability of well-curated, ready-to-use datasets that accurately reflect real-world conditions, where medical data are frequently collected inconsistently and are often incomplete; and the inherent difficulty of integrating heterogeneous data modalities. In this work, we introduce a newly curated multi-center, multi-modal, and longitudinal dataset designed to support the evaluation of a wide range of learning pipelines under realistic conditions. The dataset comprises a total of 1,365 lung cancer patients and has three imaging modalities (whole-slide images, CT scans, and PET scans), structured clinical data, transcriptomic, and longitudinal follow-up and treatment information. For each imaging modality the dataset contains more than one instance. Moreover, the dataset exhibits substantial and non-uniform missingness across modalities, making it well-suited for studying robust multi-modal fusion strategies. We further provide both uni-modal and multi-modal benchmarks on the task of 12-month overall survival prediction, disease-specific survival, as well as longitudinal benchmark of hazard prediction under severe missing data. Our results show that, despite high levels of missingness, integrating complementary modalities consistently improves predictive performance over uni-modal approaches, highlighting the value of multi-modal fusion in realistic clinical settings. The dataset and benchmark code are available at https://github.com/ritacmendes/MMIST-LUNG.

[77] Explainable Multimodal Deep Learning Integrating Imaging and Clinical Data for Oral Potentially Malignant Disorder Detection eess.IV | cs.CVPDF

Ruilin You, Yihan Wang, Jiabin Chen, Cherie Wink, Petra Wilder-Smith

TL;DR: 本文提出了一种名为M2-OPMDNet的可解释多模态深度学习框架，用于检测口腔潜在恶性病变（OPMDs）。该框架整合了共配准的白光和自体荧光口腔内图像以及结构化的临床信息，旨在解决OPMDs因表型异质性和与良性病变重叠而导致的临床检测难题。

Details

Motivation: 口腔潜在恶性病变（OPMDs）是口腔癌的关键前兆，但由于其表型异质性大且与良性病变重叠，临床检测具有挑战性。尽管基于图像的深度学习在自动筛查方面显示出潜力，但在现实世界中，仅凭视觉信息可能不足，因为诊断决策还依赖于患者特定的风险因素。

Result: 在反映真实世界筛查条件的前瞻性收集数据集上，M2-OPMDNet取得了0.952的AUC值，优于单模态方法，并在视觉上不明显的病变检测中表现出改进的性能。

Insight: 主要创新点在于开发了一个可解释的多模态框架，将两种成像模态（白光和自体荧光）与结构化的临床风险因素标准化整合。通过SHAP分析量化特征和模态的贡献，增强了模型的可解释性和临床可信度，为现实世界口腔癌筛查提供了一个准确、透明且可扩展的决策支持框架。

Abstract: Oral potentially malignant disorders (OPMDs) are critical precursors to oral cancer, yet clinical detection remains challenging because of substantial phenotypic heterogeneity and overlap with benign conditions. Although image-based deep learning shows promise for automated screening, visual information alone may be insufficient in real-world settings, where diagnostic decisions also rely on patient-specific risk factors. We developed M2-OPMDNet, a multimodal deep learning framework that integrates co-registered white-light and autofluorescence intraoral images with structured clinical information for OPMD detection. A customized questionnaire was designed to capture clinically relevant risk factors and symptoms in a standardized, reproducible format for integration with image-derived features. Multiple image encoders, including conventional convolutional neural networks and foundation model-based architectures, were evaluated using a prospectively collected dataset reflecting real-world screening conditions. Model interpretability was assessed using SHapley Additive exPlanations (SHAP) to quantify feature- and modality-level contributions. M2-OPMDNet achieved an AUC of 0.952, outperforming unimodal approaches and showing improved performance for visually subtle lesions. SHAP analysis demonstrated that structured clinical variables contributed substantially to risk estimation and complemented imaging features. These results demonstrate that explainable multimodal learning combining white-light and autofluorescence imaging with structured clinical data can provide accurate, transparent, and clinically grounded OPMD detection. M2-OPMDNet offers a scalable framework for real-world oral cancer screening and decision support.

cs.RO [Back]

[78] FailureSpot: Label-Efficient Timestamp-Level Failure Detection for Vision-Language-Action Models cs.RO | cs.CVPDF

Jie Ma, Zongxi Liu, Yi Zhu

TL;DR: 本文提出FailureSpot框架，用于解决视觉-语言-动作模型在长时程执行中不可预测的失败检测问题。该方法通过利用未标注的动作块构建弱监督信号来捕捉异常模式，并结合主动学习选择不确定性高的轨迹进行细粒度时间戳级标注，以提升检测精度。

Details

Motivation: 现有VLA策略的失败检测方法存在监督不匹配问题：基于视觉的方法通常在错误动作发生后才能检测，而基于VLA内部表征的轻量级主动检测器常使用轨迹级标签，导致失败轨迹中的正常预失败行为被误标为失败，限制了时间戳级失败定位的精度。

Result: 在多个VLA策略上的实验表明，该方法在时间戳级和轨迹级失败检测性能上均有提升，但摘要未具体说明基准测试名称或是否达到SOTA水平。

Insight: 创新点在于提出了一种数据高效的框架，结合动作衍生的弱监督信号（如不一致连续块、冻结/空闲动作、激进随机运动等异常模式）和主动学习策略，以降低密集标注成本的同时实现细粒度失败检测。

Abstract: Vision-language-action (VLA) policies have shown strong potential for general-purpose robotic manipulation, but they can still fail unpredictably during long-horizon execution, making reliable failure detection essential for safe deployment. Existing methods either rely on visual models that typically detect failures only after erroneous actions have occurred, or use lightweight proactive detectors trained on VLA internal representations. However, these proactive methods are often supervised with trajectory-level labels, causing normal pre-failure behavior in unsuccessful trajectories to be incorrectly labeled as failure. This supervision mismatch introduces label noise and limits both trajectory-level detection accuracy and precise timestamp-level failure localization. In this work, we study fine-grained timestamp-level VLA failure detection while addressing the cost of dense annotation. We propose a data-efficient framework that first leverages unlabeled VLA action chunks to construct action-derived weak supervision signals, capturing abnormal patterns such as inconsistent consecutive chunks, frozen or idle actions, and aggressive random motions. We then use active learning to select only the most uncertain trajectories for timestamp-level annotation and fine-tune the detector with these informative labels. Experiments across multiple VLA policies show that our method improves both timestamp-level and trajectory-level failure detection performance.

[79] AquaBEV: Monocular Underwater BEV Occupancy with 3D Sonar Supervision cs.RO | cs.CVPDF

Trung Tien Dong, Shengji Jin, Chen Chen, Yi Sheng, Xiaomin Lin

TL;DR: 论文提出了AquaBEV模型，用于从单张水下RGB图像预测局部鸟瞰图（BEV）占用情况。该模型在训练时使用配对的3D成像声纳数据作为几何监督，并引入了一种无需校准的极坐标表示和沿距离维度的因果解码方法。

Details

Motivation: 解决水下自主机器人安全导航时，仅从单目水下RGB图像难以可靠理解周围自由和占用空间的问题，因为仅凭外观的几何线索有限且不可靠。

Result: 在建立的一个受控水下占用基准测试中，AquaBEV取得了31.4的Visible IoU和38.6的Observed IoU，相对于最强的迁移基线分别有4.0%和4.3%的相对提升。

Insight: 创新点在于利用3D成像声纳作为几何监督来增强单目视觉的BEV占用预测，并设计了校准自由的极坐标特征映射和因果解码机制，以更好地处理水下环境的几何不确定性。

Abstract: Autonomous underwater robots are widely used for exploration, monitoring, and inspection, where safe navigation depends on understanding the surrounding free and occupied space. Bird’s eye view (BEV) occupancy provides such a representation, but predicting it from a single underwater RGB image is difficult due to limited, unreliable geometric cues from appearance alone. 3D imaging sonar offers complementary geometric measurements to supervise this task. We introduce AquaBEV, a monocular underwater occupancy model that predicts local BEV occupancy from a single RGB image, using paired 3D imaging sonar as geometric supervision during training. AquaBEV maps visual features into a calibration free polar representation and applies causal decoding along the range dimension before reconstructing the prediction in Cartesian BEV coordinates. A controlled underwater occupancy benchmark was established, adapting representative occupancy methods to the same RGB to sonar task under a unified protocol. AquaBEV achieves 31.4 Visible IoU and 38.6 Observed IoU, 4.0% and 4.3% relative improvements over the strongest transferred baseline.

[80] Same Trajectory, Contradictory Rewards (ROBORMBENCH): Paraphrase Fragility in Vision Language Reward Models cs.RO | cs.CLPDF

Wonje Jeung, Sangyeon Yoon, Hyesoo Hong, Yoonjun Cho, Dongjae Jeon

TL;DR: 本文揭示了当前基于视觉语言模型（VLM）的机器人奖励函数存在严重的‘释义脆弱性’问题：对同一机器人轨迹，仅对目标指令进行语义等价的改写，就可能导致奖励分数发生显著变化，甚至颠倒成败判断。为了量化这一问题，作者提出了ROBORMBENCH基准，包含大量真实机器人轨迹、真实进度标签和已验证的释义指令。研究发现，无论是专有还是开源VLM，这种不稳定性都广泛且严重，且无法通过模型规模或显式推理可靠缓解，而使用轨迹监督训练的专用奖励模型则稳定得多。

Details

Motivation: 动机在于，当VLM被用作机器人学习的奖励函数时，其必须具备‘释义不变性’，即对同一轨迹，语义等价的目标描述应产生相同的奖励。然而，现有VLM奖励模型经常违反这一基本属性，这严重影响了其在机器人应用中的可靠性。

Result: 在ROBORMBENCH基准上的实验结果表明，释义引发的不稳定性在现有VLM中普遍且严重，且随着改写差异增大而加剧。模型规模或显式推理并不能可靠地提升稳定性。相比之下，使用轨迹监督训练的专用奖励模型（如RT-2-RM）表现出显著更高的稳定性。

Insight: 论文的核心创新点在于系统地揭示并量化了VLM奖励模型中的‘释义脆弱性’这一关键缺陷，并为此构建了一个专门的基准ROBORMBENCH。从客观角度看，这强调了‘释义鲁棒性’是机器人领域可靠VLM奖励建模的核心要求，并为未来模型评估和改进提供了重要的衡量标准。研究还表明，针对特定任务（如奖励建模）进行专门训练，比直接使用通用VLM更有效。

Abstract: Vision-language models are increasingly used as reward functions for robotic learning, but this role requires paraphrase invariance: the same trajectory should receive the same reward under semantically equivalent goal descriptions. We show that current VLM reward models often violate this property. Paraphrasing the instruction alone can substantially change predicted progress scores, and can even flip identical robot behavior between failure and success. To measure this failure mode, we introduce ROBORMBENCH, a benchmark with 2,390 real-robot trajectories, ground-truth progress labels, and 21,673 verified paraphrases spanning lexical, syntactic, and action-goal rewrites. Across proprietary and open-source VLMs, paraphrase-induced instability is widespread and severe, grows under more divergent rewrites, and is not reliably reduced by scale or explicit reasoning. Dedicated reward models trained with trajectory-grounded supervision are substantially more stable. These results show that paraphrase robustness is a core requirement for reliable VLM-based reward modeling in robotics.

[81] RoboSPA: Can VLA Models Go Beyond Simple Scenes and Short-Horizon Tasks? cs.RO | cs.AI | cs.CVPDF

Zhenxuan Fan, Bo Zhang, Yutong Lin, Yuqian Yuan, Juekai Lin

TL;DR: 该论文提出了RoboSPA，一个用于诊断视觉-语言-动作模型在具身推理能力的大规模机器人操作数据集和基准测试。它专注于细粒度空间推理和长时程程序规划两个核心维度，包含10个任务类别和56个基础任务，每个任务有5个难度级别，共527K条轨迹。实验表明当前VLA模型在处理复杂空间关系、精确低级执行和需要记忆的规划方面仍有困难。

Details

Motivation: 现有VLA模型的数据集和基准主要在预定义设置下评估任务完成情况，对模型在日益增长的空间和程序复杂性下的推理能力洞察有限。

Result: 在代表性VLA模型上的实验表明，当前系统在处理复杂空间关系、精确低级执行和需要记忆的规划方面仍有困难，RoboSPA被确立为一个具有挑战性的诊断基准。

Insight: 创新点在于提出了一个专注于细粒度空间推理和长时程程序规划两个维度的诊断性基准，通过多难度级别和诊断性指标（而非仅二元成功率）来更细致地评估VLA模型的具身推理能力。

Abstract: Vision-Language-Action (VLA) models have shown promising progress in language-conditioned robotic manipulation. However, existing datasets and benchmarks mainly evaluate task completion under predefined settings, offering limited insight into model reasoning under increasing spatial and procedural complexity. We introduce \textbf{RoboSPA} (\textbf{Robo}t \textbf{S}patial-\textbf{P}rocedural \textbf{A}ssessment), a large-scale robotic manipulation dataset and benchmark for diagnosing embodied reasoning in VLA models. \texttt{RoboSPA} focuses on two core dimensions, Fine-Grained Spatial Reasoning and Long-Horizon Procedural Planning, covering 10 task categories and 56 base tasks. Each task is instantiated across five difficulty levels, yielding 280 variants with increasing spatial ambiguity and procedural complexity. We collect 527K trajectories across multiple embodiments and diverse scenes. Beyond binary success rate, \texttt{RoboSPA} introduces diagnostic metrics for more detailed evaluation. Experiments on representative VLA models show that current systems still struggle with complex spatial relations, precise low-level execution, and memory-intensive planning. These results establish \texttt{RoboSPA} as a challenging diagnostic benchmark for developing more capable, reliable, and generalizable embodied agents. Our data and code are available at https://github.com/fanzhenxuan/RoboSPA.

[82] Towards Neuro-Symbolic Procedural Reasoning for Long-Horizon Vision-Language-Action Manipulation cs.RO | cs.CVPDF

Vivek Chavan, Yahuan Shi, Oliver Heimann, Kevin Haninger, Jörg Krüger

TL;DR: 本文提出了一种结合神经与符号推理的框架，用于提升视觉-语言-动作（VLA）模型在长时程操作任务中的鲁棒性。该框架通过显式的任务图和程序记忆来编码动作依赖、状态转换和分支条件，并利用人类演示（如注视或显著性线索）提供空间和时间指导。

Details

Motivation: 现有VLA模型能执行短时操作技能，但在需要持续任务状态、依赖感知推理、条件决策和可靠接地的长时程程序中表现脆弱。

Result: 研究在两个长时程操作领域（工作空间清理和手术器械处理）进行了评估，指标包括正确对象与目的地选择、子任务完成度、任务进度、步骤顺序一致性、完整任务成功率以及程序或执行错误。

Insight: 创新点在于将结构化符号推理（任务图、程序记忆）与演示驱动的视觉引导相结合，作为互补机制来增强长时程VLA操作的可靠性；同时，研究通过直接标注伪注视数据来隔离引导对策略学习的影响，为后续跨视图转移研究奠定了基础。

Abstract: Vision-language-action (VLA) models can execute short manipulation skills, but remain brittle in long-horizon procedures requiring persistent task state, dependency-aware reasoning, conditional decisions, and reliable grounding. We investigate a neuro-symbolic framework that combines learned VLA control with explicit task graphs and multimodal procedural memory. Task graphs encode action dependencies, valid transitions, and branch conditions, while memory maintains the active step, completed actions, textual context, and task-relevant visual evidence. Together, these structures guide object selection, destination grounding, subgoal dispatch, and verification of expected state transitions. Human demonstrations provide additional spatial and temporal guidance through gaze or saliency cues. To isolate their effect on policy learning, our initial study bypasses cross-view gaze transfer and directly annotates pseudo-gaze in robot-view teleoperation videos. The resulting guidance is used during VLA fine-tuning and inference. We study two long-horizon manipulation domains, workspace clearing and surgical-instrument handling, which require ordered execution, visually grounded decisions, and conditional branching. We evaluate correct-object and destination selection, subtask completion, task progress, step-order consistency, complete-task success, and procedural or execution mistakes. This work positions structured symbolic reasoning and demonstration-derived visual guidance as complementary mechanisms for reliable long-horizon VLA manipulation.

[83] CoLMIN: LLM-based Multi-Decision Path Negotiation for Cooperative Autonomous Driving cs.RO | cs.CVPDF

Zhe Huang, Zhaoxin Fan, Shuo Wang, Wenjun Wu, Xuan Zhao

TL;DR: 本文提出了CoLMIN，一个基于大语言模型的多决策路径协商框架，用于解决多车协同自动驾驶中因决策方案多样而导致的过早收敛于次优解的问题。该框架通过多意图协商、浅层反思和深层反思三个核心模块，实现了稳定且高质量的决策共识。

Details

Motivation: 现有的基于协商的协同驾驶方法在处理复杂交通场景中固有的多解决策问题时，容易过早收敛到次优解，阻碍共识形成并限制系统实际部署。

Result: 在CARLA仿真环境中的实验结果表明，CoLMIN在具有挑战性的交互驾驶场景中显著优于现有方法。

Insight: 创新点在于将多决策路径探索和反思推理机制引入LLM驱动的车辆协商过程，通过Negotiator-Evaluator范式、基于评估的浅层反思和基于LLM的深层反思，系统性地避免了认知固着并提升了共识质量。

Abstract: Multi-vehicle cooperative autonomous driving enhances the safety and reliability of autonomous driving systems through information sharing among connected vehicles, demonstrating significant potential for improving traffic safety. LLM-based approaches leverage strong reasoning capabilities of LLMs to enable effective inter-vehicle negotiation and improve cooperative driving performance. However, driving decisions in complex traffic scenarios are inherently multi-solution in nature. As a result, existing negotiation-based methods often converge prematurely to suboptimal solutions, hindering consensus formation and limiting the practical deployment of cooperative autonomous driving systems. To address this challenge, we propose CoLMIN, the LLM-based multi-decision path negotiation framework for cooperative autonomous driving, achieving stable decision consensus through multi-decision path negotiation and reflective reasoning. To achieve stable and high-quality consensus in cooperative autonomous driving, CoLMIN consists of three key components: (i) an LLM-based Multi-Intent Negotiation module (LMin), which adopts a Negotiator-Evaluator paradigm and generates multiple candidate driving intentions for joint evaluation; (ii) an Evaluation-based Shallow Reflection Module (ESRM), which analyzes negotiation outcomes and provides feedback to guide subsequent negotiations, thereby accelerating consensus formation; and (iii) an LLM-based Deep Reflection Module (LDRM), which performs long-term reflection over negotiation histories to mitigate cognitive fixation and prevent the system from converging to suboptimal solutions. Experimental results in the CARLA simulation environment demonstrate that CoLMIN significantly outperforms existing methods in challenging interactive driving scenarios.

[84] What Matters, When? Diagnosing and Improving Conditional Visual Grounding in Visuomotor Imitation Policies cs.RO | cs.AI | cs.CVPDF

Vivek Chavan, Pengtao Xie, Yahuan Shi, Oliver Heimann, Kevin Haninger

TL;DR: 本文研究了视觉运动模仿策略中的条件视觉接地问题，发现策略在视觉相似物体或容器干扰下容易失败，并通过实验定位了拾取和放置阶段的特定敏感性。作者提出了多种干预措施（如干扰物增强、阶段依赖注意力正则化和基于外观的视觉提示）来提升目标选择鲁棒性，在仿真和真实机器人上验证了有效性，并扩展分析了预训练视觉-语言-动作策略中的类似问题。

Details

Motivation: 视觉运动模仿策略在分布内视觉条件下表现良好，但在引入视觉相似物体或容器时容易失败，这源于条件视觉接地问题：成功控制所需的视觉目标随操作阶段和任务状态变化。

Result: 在模拟和真实UR3e机器人上，提出的干预措施显著提升了策略对视觉干扰的鲁棒性；在预训练视觉-语言-动作策略的医疗器械处理任务中，也观察到类似失败模式并通过改进目标选择恢复了性能。

Insight: 创新点包括系统诊断视觉干扰敏感性与操作阶段的关联性，并提出互补的干预方法（如阶段依赖注意力正则化）来增强目标选择而不损害空间控制信息，这为提升视觉运动策略的泛化性提供了可借鉴思路。

Abstract: Visuomotor imitation policies can achieve high performance under in-distribution visual conditions yet fail when visually similar objects or receptacles are introduced. We study this behavior as a problem of conditional visual grounding: the visual target required for successful control changes with the manipulation phase and, in more complex tasks, with the observed task state. Using Action Chunking with Transformers (ACT), we systematically introduce distractor objects and receptacles with controlled color and shape similarity and localize failures to picking and placement. We find that distractor sensitivity is specific to both the type of visual similarity and the manipulation stage. Guided by this diagnosis, we evaluate distractor augmentation, phase-dependent attention regularization, and appearance-based visual prompting as complementary interventions for improving target selection while preserving spatial information required for control. These interventions substantially improve robustness in simulation and on a physical UR3e. We further examine the same failure pattern in a pretrained vision-language-action policy on a state-conditioned instrument-handling task, where the observed state of a medical instrument determines the correct destination. Together, the results show that visual distractors can cause incorrect object or destination selection even when the underlying manipulation skill remains intact, and that explicitly improving target selection can substantially recover performance across distinct visuomotor policy-learning regimes.

cs.MM [Back]

[85] Encore: Infinite Audio-Video Generation with Adaptive Signal Routing cs.MM | cs.CV | cs.SDPDF

Shaohua Pan, Junbao Chen, Shengyi He, Jingfeng Xue, Wen Tao

TL;DR: 本文提出了Encore模型，用于生成长时、同步的音视频内容。其核心创新是自适应信号路由（ASR）机制，该机制通过可学习的注意力偏置和残差缩放，自适应地调制不同条件信号（如视频时序一致性、音频时序一致性和跨模态同步）的影响。模型支持端到端的联合音视频生成，并能在推理时通过在整个去噪过程中以真实模态为条件，实现无限长度的音频到视频或视频到音频合成。

Details

Motivation: 现有音视频生成方法只能生成短时同步片段，而长视频生成方法虽能延长时长但完全缺乏音频。联合生成长时音视频本质上更困难，因为每个片段必须同时维持视频时序一致性、音频时序一致性和跨模态同步，这些条件信号通过不同路径进入模型。

Result: 在扩展的长音视频评估基准VerseBench上的实验表明，Encore在生成质量和时序一致性方面显著优于现有方法。

Insight: 主要创新点是将长时音视频生成的挑战分解为局部连续性（通过显式的跨块上下文传播迭代生成处理）和全局一致性（通过带有移位位置嵌入的参考音视频信号强制实施），并提出了自适应信号路由（ASR）机制来动态调节不同条件信号的影响权重。

Abstract: Existing audio-video generation methods produce well-synchronized clips but are limited to short durations, while long-video generation methods extend duration through chunk-based iterative synthesis yet lack audio entirely. Generating long audio-video jointly is fundamentally harder than either task alone: each chunk must simultaneously maintain video temporal coherence, audio temporal coherence, and cross-modal synchronization, whose conditioning signals enter the model through different pathways. In this work, we present Encore for long-form synchronized audio-video generation. Our key insight is to factor this challenge into: (1) local continuity handled by iterative generation with explicit cross-chunk context propagation, and (2) global consistency enforced via reference audio-video signals with shifted position embedding. Building on this design, we propose Adaptive Signal Routing (ASR), which introduces learnable attention biases within self-attention and learnable residual scales on cross-attention outputs, enabling the model to adaptively modulate the influence of each conditioning signal. Trained end-to-end for joint audio-video generation, Encore also supports infinite-length audio-to-video and video-to-audio synthesis at inference by conditioning on the ground-truth modality throughout the denoising process. Experiments on our extended VerseBench for long audio-video evaluation demonstrate that Encore significantly outperforms existing methods in both generation quality and temporal coherence. Code and data for this paper are at https://github.com/shaohua-pan/Encore.

[86] AVENUE: Audio-Video EditiNg Understanding and Evaluation cs.MM | cs.CV | cs.SDPDF

Hayeon Kim, Yoojin Jang, Jaejun Yoo

TL;DR: 本文提出了AVENUE（音频-视频编辑理解与评估）基准和评估框架，旨在解决音频-视频（AV）编辑任务中缺乏全面基准和模态感知评估的问题。该工作构建了一个包含多种编辑类型和模态组合的大规模数据集，并设计了一个样本特定、模态感知的评估系统，以系统评估不同AV编辑模型在保持非目标模态内容方面的性能。

Details

Motivation: 现有AV编辑任务面临两大挑战：一是缺乏覆盖多种编辑类型和模态组合的全面基准；二是现有评估方法通常是模态无关和样本无关的，难以准确评估模型是否忠实地保留了非目标模态的内容。

Result: 作者在构建的AVENUE基准上评估了三种主流编辑范式（联合、顺序、分离）的代表性模型。关键发现是，无论采用哪种范式，现有模型在编辑一个模态时，经常会在另一个模态中引发非预期的改变，这揭示了一个根本性的开放挑战。

Insight: 论文的核心创新点在于构建了一个大规模、人类验证的AV编辑基准数据集，并提出了一个样本特定、模态感知的评估框架。这为系统分析和推动可控AV编辑模型的发展提供了关键工具，并首次揭示了跨编辑范式的模态选择性保持是一个普遍存在的难题。

Abstract: Audio-video (AV) editing aims to modify audio and video content according to a target prompt. Unlike single-modality editing, AV editing requires models to infer a modality-selective edit scope from the prompt alone: determining not only what should change, but also which modality should be preserved. Faithfully evaluating such models therefore requires both (i) benchmarks that span diverse edit types and modality categories, and (ii) evaluation that is itself modality-aware and sample-specific. However, existing AV editing benchmarks provide limited coverage of edit types and modality combinations, while current evaluation systems are often modality-blind and sample-agnostic, making it difficult to assess whether models faithfully preserve the unintended modality. To address these gaps, we introduce AVENUE, Audio-Video EditiNg Understanding and Evaluation, comprising two contributions: (1) a benchmark of 1,291 source clips and 7,957 editing instructions across audio-targeted, video-targeted, and AV-coupled edit types, curated and human-verified from VGGSound; and (2) a sample-specific, modality-aware evaluation framework that specifies, for each sample, both the intended change and the content that must remain intact. We evaluate representative AV editing models spanning three editing paradigms : joint, sequential, and separate, providing the first systematic analysis of modality-selectivity across paradigms. Our findings reveal a fundamental open challenge: when editing one modality, existing models frequently induce unintended changes in the other, regardless of paradigm. AVENUE provides a benchmark and modality-aware evaluation framework to drive progress toward more controllable AV editing models. Our dataset is publicly available on Hugging Face: https://huggingface.co/datasets/AVENUE-dataset/AVENUE.

cs.AR [Back]

[87] Sustainable Edge Vision via Empirically Calibrated DVFS: Eliminating Thermal Throttling on Passively Cooled Hardware cs.AR | cs.CV | cs.LGPDF

Aayush Marasini, Zhaoxian Zhou

TL;DR: 本文针对被动冷却边缘SoC在持续DNN推理中因热节流导致的性能瓶颈，提出了一种经验校准、状态感知的DVFS调度器。该调度器利用时间域防护和绝对温度边界，配合导数触发机制来防止热尖峰，在Raspberry Pi 5上运行YOLOv8n时，成功消除了30分钟持续工作负载中的所有热节流事件。

Details

Motivation: 被动冷却虽消除了风扇的能耗和机械故障风险，适合边缘部署，但持续DNN推理会导致热节流，限制性能。本文旨在通过智能DVFS调度解决此问题，使被动冷却硬件能持续稳定运行。

Result: 在被动冷却的Raspberry Pi 5上评估，该调度器完全消除了热节流，帧率比仅基于温度的反应式基线提高6.8%（Cohen’s d = 8.73），每帧能耗降低1.9%。在能效（焦耳/帧）上甚至超过了主动冷却参考系统，但主动冷却在原始吞吐量上仍具优势。

Insight: 创新点在于将经验校准与状态感知DVFS结合，引入时间域防护和导数触发来确保热稳定性；该方法证明了在特定环境温度范围内，通过正确调度可避免机械冷却，为边缘视觉系统的可持续设计提供了新思路。

Abstract: Passive cooling eliminates the energy overhead and mechanical failure modes of fans, making it attractive for edge deployment, yet sustained Deep Neural Network (DNN) inference on passively cooled edge Systems-on-Chip (SoCs) is bottlenecked by thermal throttling. To address this, we propose an empirically calibrated, state-aware Dynamic Voltage and Frequency Scaling (DVFS) scheduler. Unlike heuristic-driven controllers, our methodology utilizes time-domain guards and absolute temperature bounds, with derivative triggers acting as safeguards against sharp thermal spikes. Evaluated on a passively cooled Raspberry Pi 5 running YOLOv8n, our scheduler eliminates all observed thermal throttling events during sustained 30-minute workloads. It outperforms a temperature-only reactive baseline by achieving a 6.8% higher frame rate (Cohen’s d = 8.73) while consuming 1.9% less energy per frame. Furthermore, our optimized passive scheduling surpasses an actively cooled reference system in energy efficiency (Joules/frame), though active cooling remains superior for raw throughput. Through isolated ablations, we show that the dwell guard is necessary for run-to-run reproducibility. Finally, exploratory boundary probes indicate that the passive operating envelope closes at ambient temperatures ($\ge 27^\circ$C) where nonlinear leakage defeats DVFS-based control. These results indicate that, within the mapped envelope, correct scheduling can make mechanical cooling unnecessary for sustained edge inference on this platform.

eess.AS [Back]

[88] Training-Free Speech-Centric Omni Understanding with Frozen VLMs eess.AS | cs.CV | cs.SDPDF

Ankan Deria, Hanoona Rasheed, Xilin He, Fahad Shahbaz Khan, Salman Khan

TL;DR: 本文提出了一种无需训练的语音中心全模态理解框架TFO，通过将Whisper提取的时间戳转录文本输入冻结的视觉语言模型（VLM）的语言接口，实现了音频-视觉理解，无需修改VLM架构或多模态重新对齐。

Details

Motivation: 解决现有全模态模型需要引入专用音频编码器并进行昂贵的音频-视频-文本训练的问题，探索是否必须为每个新VLM进行原生全模态训练，以及能否在保留原始骨干网络的同时添加语音中心的全模态能力。

Result: 在56个基准测试和21种语言上与原生全模态模型进行比较，TFO在音频-视觉理解上具有竞争力，在所有五种模型设置中平均音频性能有所提升，并在多语言语音任务上取得显著增益；同时冻结的VLM在图像/视频理解、视觉定位、编码、数学推理和医学问答方面通常优于相应的原生全模态检查点。

Insight: 创新点在于提出了一种模块化的音频到语言路由方法，而非昂贵的骨干网络特定训练，即可实现强大的语音中心全模态理解；客观分析认为其通过利用现有VLM的语言接口处理语音转录，避免了多模态对齐的复杂性，是一种高效且通用的解决方案。

Abstract: Audio-visual understanding remains challenging because models must jointly interpret spoken content, visual events, and their temporal relationships. Existing omni models typically introduce dedicated audio encoders and rely on expensive audio-video-text training, tightly coupling omni capability to specific VLM backbones and potentially weakening their existing visual and reasoning abilities. This raises three questions: whether native omni training is necessary for every new VLM, whether speech-centric omni capability can be added while preserving the original backbone, and where richer acoustic representations remain essential. We introduce Training-Free Omni (TFO), a plug-and-play framework that converts a frozen VLM into a speech-centric omni model without architectural modification, or multimodal re-alignment. TFO uses Whisper to extract confidence-filtered, timestamped transcripts and routes them through the VLM’s existing language interface, while leaving its visual pathway unchanged. Across matched comparisons with native omni models on 56 benchmarks and 21 languages, TFO is competitive on audio-visual understanding, improves average audio-only performance across all five model settings, and achieves substantial multilingual speech gains. Freezing the VLM also generally preserves stronger image/video understanding, visual grounding, coding, mathematical reasoning, and medical question answering than the corresponding native omni checkpoints. These results show that strong speech-centric omni understanding can often be obtained through modular audio-to-language routing rather than costly backbone-specific training.

cs.AI [Back]

[89] A Removal Based Approach to Improve LLM Faithfulness at Test-Time cs.AI | cs.CLPDF

Qinglan Luo, S M A Nahian, John Guttag, S. Mazdak Abulnaga, Katie Matton

TL;DR: 本文提出了一种在测试时提升大语言模型解释忠实性的方法，通过移除输入中未被模型解释提及的概念并重新查询模型，以直接解决解释不完整的问题。该方法无需修改模型参数，在多个数据集和模型家族上均能有效提升解释的忠实性。

Details

Motivation: 大语言模型的解释可能存在不忠实问题，包括不完整（遗漏影响答案的因素）和不合理（引用未影响答案的因素）。现有测试时方法主要关注不合理性，而本文旨在直接解决不完整性问题。

Result: 在两个数据集、多个模型家族和两个独立的忠实性指标上，该方法相比标准提示和鼓励忠实性的提示方法，均能提升解释的忠实性。

Insight: 创新点在于提出了一种模型无关的测试时干预策略，通过概念移除和重查询来消除未提及的影响因素，从而直接针对解释不完整性，为提升LLM决策的可靠性和安全性提供了灵活机制。

Abstract: Large language models (LLMs) are increasingly used for consequential decisions, making their explanations an important tool for auditing model behavior. Unfortunately, these explanations can be unfaithful, failing to reflect the actual reasoning underlying the model’s decisions. We consider a setting in which an LLM provides both an answer and an explanation in response to a question. We identify two distinct dimensions of unfaithful explanations: incompleteness, meaning that the explanation omits factors that influence the answer, and unsoundness, meaning that the explanation cites factors that did not influence the model’s answer. Existing approaches to improving LLM faithfulness include training-time methods, which require access to model weights and extensive computational resources, and test-time methods that largely focus on addressing unsoundness. We introduce a test-time approach that directly targets incompleteness. We remove from the input the concepts not credited in the model’s explanation and re-query the model on the reduced input. This eliminates unmentioned influences while preserving the influence of mentioned concepts. Across two datasets, multiple model families, and two independent faithfulness metrics, our approach improves explanation faithfulness compared to both standard prompting and prompting to encourage faithfulness. Our method is model-agnostic and can be applied at inference time without modifying model parameters, providing a flexible mechanism for reducing hidden influences and improving the reliability and safety of LLM-assisted decision making.

[90] Rethinking Indirect Prompt Injection as a Test-Time Search Problem cs.AI | cs.CL | cs.CRPDF

Duong M. Nguyen, Joon Sik Kim, Blazej Manczak, Vaikkunth Mugunthan

TL;DR: 本文提出将间接提示注入重新定义为一种测试时搜索问题，即攻击者在环境、用户任务和注入任务构成的攻击面上进行搜索。为此，作者引入了一个具有专用搜索框架的智能体攻击者，该框架能执行环境侦察、对攻击策略进行结构化推理，并利用受害者智能体的反馈进行自适应评估。研究发现，增加攻击者的测试时计算资源能提升漏洞发现和利用能力，而明确的策略管理对于避免冗余搜索和维持大规模预算下的收益至关重要。

Details

Motivation: 论文的动机是重新审视间接提示注入攻击，将其形式化为一个依赖于环境、用户任务和注入任务构成的攻击面上的测试时搜索问题，旨在更系统地评估和揭示工具使用智能体的安全风险。

Result: 在多种异构任务上的实验表明，增加攻击者的测试时计算资源（即搜索预算）能有效提升漏洞发现和利用的成功率；消融实验则证明，明确的策略管理对于避免冗余搜索和在大规模预算下维持收益至关重要。这些结果挑战了将攻击成功率视为受害者固有属性（与预算无关）的观点。

Insight: 论文的核心创新点在于将间接提示注入形式化为一个测试时搜索问题，并提出了一个包含环境侦察、结构化策略推理和自适应评估的智能体攻击者框架。从客观角度看，该研究强调了在安全评估中，需要同时考虑攻击者的搜索过程与计算预算，并将攻击者对系统攻击面的自适应搜索识别为一个重要但尚未被充分探索的安全风险。

Abstract: We formulate indirect prompt injection as a test-time search over a task-dependent attack surface induced by the environment, user task, and injection task. To operationalize this formulation, we introduce an agentic attacker with a dedicated search harness that performs environment reconnaissance, structured reasoning over attack strategies, and adaptive evaluation using victim-agent feedback. Across heterogeneous tasks, we find that increasing attacker test-time compute improves vulnerability discovery and exploitation, while ablations show that explicit strategy management is important for avoiding redundant search and sustaining gains at larger budgets. These results suggest that agentic security evaluations should characterize both the attacker’s search procedure and compute budget, rather than treating attack success as a budget-independent property of the victim. More broadly, our findings identify the attacker’s adaptive search over the system attack surfaces as an important and underexplored security risk for tool-using agents.

[91] Extremely Sparse Supervision Incentivizes Reasoning Ability cs.AI | cs.CL | cs.LGPDF

Zhishuai Liu, Xingzi Xu, Mehmet Saygin Seyfioglu, Pan Xu, Karim Bouyarmane

TL;DR: 本文挑战了后训练必须依赖大量token监督的普遍假设，发现在策略蒸馏（OPD）设置下，仅对推理轨迹中极少数的关键token（如每轨迹1-2个token，仅占总token的0.05%）进行极稀疏监督，就能有效提升大语言模型的推理能力，其效果在多数情况下与全token训练相当或更好。这一现象在数学推理、代码推理、Llama模型和基于PPO的RLVR等多种任务和模型规模上得到了一致验证。

Details

Motivation: 主流后训练方法通常假设有效的学习需要海量token监督，本文旨在重新审视这一假设，探索在策略蒸馏（OPD）这种天然提供密集教师监督的框架下，是否可以通过极稀疏的监督来有效激励模型的推理能力。

Result: 在数学推理任务上，使用Qwen3系列模型进行的九种师生配置实验表明，极稀疏监督（如每轨迹1-2个token）在大多数情况下匹配或超越了全token训练对推理能力的提升效果。该结果在代码推理、Llama模型以及基于PPO的RLVR上也得到了进一步验证。

Insight: 核心创新点在于揭示了极稀疏监督（仅关注推理轨迹中的少数关键token）足以有效激励大语言模型的推理能力，这挑战了后训练必须依赖密集token监督的固有认知。从客观角度看，这为理解和设计更高效的后训练算法提供了新方向，其机制可能更接近人类通过反思关键步骤而非逐词纠错的自然学习过程。

Abstract: Large language models demonstrate increasingly strong reasoning capabilities through effective post-training. Yet, prevailing post-training methods optimize over massive numbers of tokens, implicitly assuming that effective learning must be token-intensive. We revisit this assumption in the on-policy distillation (OPD) setting, which naturally admits dense teacher supervision at every generated token. Using the Qwen3 family, we discover a counter-intuitive phenomenon: reasoning can be effectively incentivized by an extremely small fraction of generated tokens–as few as one or two tokens per reasoning trajectory, corresponding to only 0.05% of all tokens. Surprisingly, this sparse supervision in most cases matches or surpasses full-token training in improving reasoning ability, despite excluding the vast majority of generated tokens from the training objective. This phenomenon is consistently observed across nine teacher–student configurations spanning different model scales on mathematical reasoning tasks, and is further validated on coding reasoning, Llama models and Proximal Policy Optimization (PPO)-based reinforcement learning with verifiable reward (RLVR). Interestingly, such extremely sparse supervision may be closer to the natural learning process: rather than correcting every step word by word, one reflects on a few critical reasoning steps, updates prior understanding, and continues the trial-and-error, avoiding micro-level corrections while remaining remarkably effective. Overall, our results challenge the assumption that effective post-training must be token-intensive and point to a new direction for understanding and designing more efficient post-training algorithms.

[92] Measuring AI Accountability Through Argumentation Analysis: Can Model Reasoning Withstand Scrutiny? cs.AI | cs.CL | cs.CYPDF

Daan R. Henselmans, Derck W. E. Prinzhorn, Arno Libert

TL;DR: 本文提出了一种基于论证分析的新颖评估标准，用于衡量AI模型（特别是LLMs）在道德推理中的问责能力。该方法采用一个四阶段的辩证协议，基于Walton的论证方案理论和Govier的论证说服力标准，评估模型为其裁决进行辩护的结构质量，而非依赖有争议的‘真实’标准。在九个前沿模型和200个高模糊性道德选择项目上的实验表明，模型在辩护其推理方面普遍表现良好，但辩护失败主要集中在理由和充分性维度，且推理过程的辩护质量优于事后辩护。

Details

Motivation: 现有AI监督方法依赖有争议的‘真实’标准进行验证，导致对LLMs道德推理的评估回避了现实的模糊性。本文旨在设计一种能在这种模糊性下运作的替代标准，通过分析模型为其裁决进行辩护的结构质量来评估其问责性。

Result: 在九个前沿模型和200个高模糊性MoralChoice项目上进行了评估（共6,778个由评委评分的单元，评委间在二元失败判断上的一致性为89.6%）。所有模型在每个维度上的辩护质量都远高于评分标准的最低要求。失败主要集中在理由和充分性维度，并与认知上的回避（epistemic hedging）相关，而非论证长度。所有模型在所有Govier维度上，推理过程的辩护质量都优于事后辩护。

Insight: 创新点在于提出了一种不依赖‘真实’标准、基于论证理论的辩证评估协议，能适应不同的推理框架并超越选择题形式。客观分析发现，模型事后辩护所用的论证方案与其实际推理所用的方案存在显著差异（每个模型≥20%的困境），这揭示了模型内部推理与外部辩护可能不一致，并凸显了在AI对齐中刻画‘撤回’角色的困难，表明需要更情境化的评估。

Abstract: AI oversight methods rely on ground truth for validation, but what constitutes appropriate AI behavior is contested. This leaves evaluation of moral reasoning in LLMs and debate-based oversight implicitly avoiding realistic ambiguity. We investigate an alternative standard designed to function despite such ambiguity: structural quality of the defence a model can mount for its verdicts in response to critical questions, measured through a four-phase dialectical protocol grounded in Walton’s theory of argumentation schemes and Govier’s criteria for argument cogency. The protocol is adaptive to different frames of reasoning, extends beyond multiple-choice framing, and treats both the reasoning that precedes a verdict and its post-hoc justification. Across nine frontier models and 200 high-ambiguity MoralChoice items – $6,778$ judge-scored cells, validated against $89.6%$ inter-judge agreement on the binary failure judgment – models defend their reasoning well above the rubric minimum on every dimension. Failure mass concentrates on grounds and sufficiency, and correlates with epistemic hedging rather than argument length. Reasoning is better defended than post-hoc justification, on every model and every Govier dimension. The scheme a model presents in its justification differs from the one it reasoned with on a substantial share of dilemmas ($\geq 20%$ per model), despite value-based practical reasoning dominating both tracks. The protocol catches strictly indefensible defences (self-contradiction, false premises), and it surfaces difficulties in characterizing the role of retraction in AI alignment, suggesting a need for more situated evaluations.

[93] Large Language Models for HVAC Operations in Building Energy Systems: A Critical Review of Methods, Applications, and Deployment Readiness cs.AI | cs.CL | eess.SYPDF

Alexander Neubauer, Tianzhen Hong, Han Li, Mengbo Yu, Amin Darbandi

TL;DR: 本文对2023年至2026年3月间发表的66篇关于大型语言模型（LLM）在暖通空调（HVAC）运行中应用的研究进行了系统性综述。论文将这些研究按应用领域和LLM方法进行分类，并评估了其证据真实性、部署就绪度以及LLM与物理HVAC决策之间的责任边界。综述发现当前研究主要集中在建筑能耗建模（BEM），但缺乏实际部署案例，LLM主要被定位为语义和工作流辅助层，而非自主控制器。

Details

Motivation: 建筑自动化系统产生大量传感器数据，但由于异构的点命名、缺失的元数据和碎片化的文档，这些数据难以转化为有效洞察，阻碍了其运行使用。本文旨在系统评估LLM在解决这些问题、辅助HVAC运行方面的研究现状、方法、应用潜力和实际部署准备情况。

Result: 综述分析了66项研究，发现仅4项达到试点级别证据，无一项报告了持续的实际运行部署。没有研究被归类为“即刻就绪”可供工业采用，3项为“近期可行”，其余63项仅为研究阶段。在具体应用上，建筑能耗建模（BEM）是研究最集中的领域（66篇中的32篇），而负荷预测等领域的研究尚不足以得出子领域级别的结论。

Insight: 论文的创新点在于提出了一个系统的分类与评估框架（涵盖应用家族、方法家族、证据真实性、部署就绪度、责任边界），用于批判性审视LLM在HVAC领域的应用研究。核心见解是：当前证据支持LLM主要作为语义理解和工作流辅助的“软”层（如点名称规范化、基于文档的运维支持、BEM工作流协助、围绕物理控制器的咨询界面），而非用于高频控制或短期数值预测的自主控制器；后者领域仍由传统机器学习（ML）、模型预测控制（MPC）、强化学习（RL）和基于本体的工具主导。未来研究方向应聚焦于现场验证的基准测试、运行约束下的协调评估，以及具有有限延迟和可验证安全性的LLM-MPC/RL混合架构。

Abstract: Building automation systems generate rich sensor data yet remain insight-poor because heterogeneous point naming, missing metadata, and fragmented documentation obstruct their operational use. This systematic review analyses and codes 66 peer-reviewed studies on large language models (LLMs) for HVAC operations published between 2023 and March 2026. Each study is classified across five application families and three LLM method families and assessed for evidence realism, deployment readiness, and the responsibility boundary between the LLM and physical HVAC decisions. The corpus is concentrated in building energy modelling (BEM, 32 of 66 papers), while load forecasting remains too sparse for subfield-level conclusions. Only four studies reach pilot-level evidence, and none reports sustained operational deployment. No study was classified as ready-now for industry adoption; three were near-term and 63 research-only. Nevertheless, several bounded, human-in-the-loop uses merit near-term trials, including point-name normalisation, document-grounded operator support, BEM workflow assistance, and advisory interfaces around physics-based controllers. Conventional machine learning (ML), model predictive control (MPC), reinforcement learning (RL) and ontology-based tools remain more adopted for high-frequency control, short-horizon numerical forecasting, and well-posed ontology mapping, while autonomous agentic operation and unvalidated occupant proxies remain research-stage. Current evidence therefore supports LLMs primarily as semantic and workflow layers rather than autonomous HVAC controllers. Future work should prioritise field-validated benchmarks, orchestration evaluation under operational constraints, and LLM-MPC/RL architectures with bounded latency and verifiable safety properties.

cs.NE [Back]

[94] Large Language Models with At Most One Spike per Neuron cs.NE | cs.CLPDF

Zhuoya Zhao, Parsa Omidi, Aref Jafari, Richard Naud

TL;DR: 本文提出了一种基于时间到首次脉冲（TTFS）编码的脉冲神经网络（SNN）架构，用于构建高效能的大型语言模型（LLM）。通过引入参考策略，解决了传统TTFS SNN难以编码LLM核心组件（如层归一化和矩阵乘法）的问题，实现了端到端训练。实验表明，该方法在BERT和GPT-2等模型上，在自然语言理解和常识推理任务上性能接近人工神经网络（ANN），但在语言建模困惑度上仍有差距，并首次将TTFS编码的脉冲LLM扩展到15亿参数。

Details

Motivation: 脉冲神经网络（SNN）因其稀疏事件驱动计算特性，有望实现节能的大型语言模型（LLM），但传统时间到首次脉冲（TTFS）编码的SNN受限于特定结构，难以编码LLM中的关键模块（如层归一化和矩阵乘法）。

Result: 在BERT和GPT-2等现代LLM上的实验显示，该方法在自然语言理解（如GLUE基准）和常识推理（如HellaSwag基准）任务上性能与ANN相当，但在语言建模（如WikiText-2困惑度）上存在明显差距；同时，首次实现了基于TTFS编码的15亿参数脉冲LLM，并基于成本模型估计了脉冲相关能耗。

Insight: 创新点包括提出参考策略来编码LLM的四个核心组件（嵌入层、层归一化、注意力相关操作和dropout），构建了全TTFS的SNN架构并端到端训练；从客观角度看，这扩展了TTFS SNN在复杂LLM结构中的应用潜力，为节能LLM提供了新思路。

Abstract: Leveraging their inherent sparse event-driven computation, spiking neural networks (SNNs) offer a promising path toward energy-efficient large language models (LLMs). Time-to-first-spike (TTFS) coding generates at most one spike per neuron within a time window, yielding extremely low firing rates. However, conventional TTFS SNNs are restricted to specific structures, making it challenging to encode certain blocks in LLM – such as layer normalization and matrix multiplication –using TTFS. To overcome this limitation, we introduce a reference-based strategy specifically to encode the four core LLM components: embedding layers, layer normalization, attention-related operations and dropout. We construct a fully TTFS-based SNN architecture and train it end-to-end. Experiments on modern LLMs like BERT and GPT-2 demonstrate that our approach achieves performance comparable to ANN counterparts on natural language understanding and common-sense reasoning, while a clear gap remains on language modeling perplexity. To the best of our knowledge, this is the first work to scale a spiking LLM to 1.5 billion parameters using TTFS coding. We also report an estimate of spike-related energy; this is a spike-count proxy under an established cost model rather than a measurement on neuromorphic hardware.

cs.SE [Back]

[95] Reviewer Capability Governs Rejection Targeting, Not Repair Skill: Evidence from LLM Execute-Review-Revise Pipelines cs.SE | cs.CL | cs.MAPDF

Faizan Tanveer

TL;DR: 本文通过实验探究了在LLM执行-评审-修订流程中，评审者能力对拒绝目标选择的影响。研究发现，跨家族的中等能力评审者能显著提升最终准确率，而相同模型的自评审虽能检测更多错误，但因错误拒绝率高且修复率低，无法带来显著增益。当评审者能力低于一定阈值时，该角色将完全失效。

Details

Motivation: 多智能体LLM流水线常将执行和验证等角色分配给不同能力层级的模型以降低成本。先前研究假设评审者能力相对执行者大致固定，本文旨在通过系统改变评审者能力，探究其对拒绝目标选择和最终性能的影响。

Result: 在100个奥林匹克数学问题上，跨家族的中等能力评审者将最终准确率从52%提升至64%（p=0.0005），且未造成任何答案损坏。相同模型的自评审错误检测率最高（召回率0.85），但无显著增益：其拒绝频率是跨家族评审者的2.1倍，修复率仅为15%（对比43%，p=0.0074），并错误拒绝了自身35%的正确答案（对比2%）。最弱评审者未改变任何最终答案，却使计算成本翻倍。

Insight: 评审者的核心能力在于准确识别错误（拒绝目标选择），而非修复技能；自评审的高错误检测率被其高误拒率和低修复率抵消，其低损坏率源于修订惯性而非评审质量；存在一个能力阈值，低于此阈值的评审角色完全无效。这强调了在构建多智能体系统时，需根据任务需求审慎选择评审者能力层级，而非盲目追求高检测率或使用同模型自评审。

Abstract: Multi-agent LLM pipelines increasingly assign roles, including execution and verification, to models of different capability tiers. This is done because running a flagship model at every stage is expensive. Previous literature has established that verification stages are not always beneficial, but holds reviewer capability roughly fixed relative to the executor. We vary it. We replace the reviewer with models spanning a capability range down to one that cannot solve the problems at all, and measure the outcome of every individual rejection. This is done across a constant set of 100 olympiad mathematics problems. A cross-family mid-tier reviewer improves final accuracy by 12 percentage points, from 52 to 64 percent (p = 0.0005), with zero damaged answers. Same-model self-review attains the highest error-detection rate of any condition (0.85 recall) yet yields no significant gain: it rejects 2.1 times as often for a third the repair rate (15 against 43 percent, p = 0.0074) and falsely rejects 35 percent of its own correct answers against 2 percent for the cross-family reviewer (paired p = 0.000015). The low damage rate of self-review proves to be an artifact of revision inertia rather than reviewer quality: of 18 falsely rejected correct answers, the three where the executor complied all became wrong, while the fifteen it ignored survived unchanged. Below a capability floor the role becomes inert: our weakest reviewer changed zero of 100 final answers while doubling token cost. These findings describe a single executor-reviewer configuration on 100 problems and should be read as a controlled pilot rather than a general claim about verification stages.

cs.LG [Back]

[96] Evaluating Large Language Models for Forced Outage Risk Prediction: Benefits and Comparison to Machine Learning cs.LG | cs.CLPDF

Christos Petridis, Zoran Obradovic, Mladen Kezunovic

TL;DR: 本研究评估了大型语言模型在零样本框架下预测配电网中天气相关强制停电风险的能力，无需标注训练数据。该问题被构建为三个预测时间跨度（3小时、6小时、12小时）的二元严重性分类任务，使用了德克萨斯州中部某公用事业服务区域六年的停电记录和高分辨率天气数据。研究将四种零样本LLM与两种监督分类器在两种输入配置（当前天气观测数据和天气预报数据）下进行了基准测试。

Details

Motivation: 研究动机是探索LLMs在缺乏标注数据的零样本场景下，对于电力系统关键风险（如天气导致的强制停电）的预测能力，并与传统监督学习方法进行比较。

Result: 结果表明，监督模型在宏观F1分数和精确度上优于LLMs，但较新的LLM模型取得了有竞争力的分数。在两种输入配置下，监督模型表现更优。

Insight: LLMs提供了可操作推理和地理可扩展性方面的互补优势，这表明将LLMs与监督模型结合可能是最佳实践。创新点在于将零样本LLM应用于电力系统风险预测这一新领域，并系统评估了其相对于传统方法的优缺点。

Abstract: This study examines the ability of large language models (LLMs) to predict the risk of weather-related forced outages in the distribution grid in a zero-shot framework, without labeled training data. The problem is formulated as a binary severity classification task across three forecast horizons (3h, 6h, 12h), using six years of outage records and high-resolution weather data for a utility service area in central Texas. Four zero-shot LLMs are benchmarked against two supervised classifiers across two input configurations: one using current weather observations and the other using weather forecast data. Results show that supervised models outperform LLMs on macro-F1 and precision, while newer LLM generations achieve competitive scores. Beyond accuracy, LLMs offer complementary strengths in actionable reasoning and geographic scalability, suggesting that combining them with supervised models may be the best practice.

[97] When Load-Balancing Goes Too Far: Expert Pruning in Over-Dispersed Mixture-of-Experts Models cs.LG | cs.AI | cs.CLPDF

Berkcan Kapusuzoglu, Connor Pryor, Sangwoo Cho, Supriyo Chakraborty, Shi-Xiong Zhang

TL;DR: 本文研究了在过分散路由（over-dispersed routing）机制下，基于路由器概率进行专家剪枝（expert pruning）的假设会失效，导致困惑度（perplexity）无法预测下游任务准确性，并揭示了不同评分指标在不同领域任务上存在能力权衡。为此，作者提出了Minimax Expert Score Allocation (MESA)方法，通过迭代提升当前受影响最严重领域的专家重要性分数，来最小化最坏情况下的领域性能下降。

Details

Motivation: 动机在于发现现有专家剪枝方法依赖于路由器概率能可靠指示专家重要性的假设，但在训练中采用激进负载均衡导致的过分散路由机制下，该假设不成立，重要性信号崩溃，使得基于困惑度的剪枝配置选择失效，并引发不同领域任务间的能力权衡问题。

Result: 在gpt-oss-20B等模型上，过分散路由下最低困惑度的剪枝配置反而导致最差的数学推理性能，而标准路由（如Mixtral-8x7B-Instruct）中困惑度与准确性同步下降。提出的MESA方法在25%专家剪枝率下，在11个基准测试中的7个上优于激活感知基线，实现了跨领域的最小最坏情况性能下降，并推广到gpt-oss-120B、Gemma-4-26B-A4B和OLMoE-1B-7B等模型。

Insight: 创新点在于识别了过分散路由作为一种性质不同的剪枝机制，其中标准假设失效，并提出了领域感知的MESA方法，通过最小化最坏情况领域退化而非平均准确性来优化剪枝。这为负载均衡MoE模型的剪枝提供了新的原则性视角，强调了考虑路由机制差异的重要性。

Abstract: Expert pruning reduces the memory and serving cost of Mixture-of-Experts (MoE) models by removing low-importance experts identified by the router, assuming router probabilities provide a reliable importance signal. We observe that this assumption breaks down under over-dispersed routing, a regime associated with aggressive load-balancing during training, in which tokens are distributed nearly uniformly across experts and importance signals collapse. In this regime, perplexity does not predict downstream task accuracy: on gpt-oss-20B, the lowest-perplexity pruning configuration yields the worst mathematical reasoning, while the highest-perplexity configuration preserves it. This does not occur under standard routing (e.g., Mixtral-8x7B-Instruct), where perplexity and accuracy degrade together. Pruning under over-dispersed routing also exposes a capability trade-off in which no single scoring metric dominates: activation-aware scoring preserves mathematical reasoning but severely degrades knowledge-intensive science (an 18-point gap on GPQA), whereas frequency-based scoring exhibits the reverse. We propose Minimax Expert Score Allocation (MESA), a domain-aware method that iteratively boosts importance scores for experts serving whichever domain is currently worst-affected, minimizing worst-case domain degradation rather than average accuracy. At 25% expert pruning MESA achieves the smallest worst-case degradation across domains, outperforming activation-aware baselines on 7 of 11 benchmarks at a correspondingly reduced memory footprint, and it generalizes to gpt-oss-120B, Gemma-4-26B-A4B, and OLMoE-1B-7B. Our results indicate that over-dispersed routing is a qualitatively distinct pruning regime in which standard assumptions fail, and that recognizing it is a prerequisite for principled expert pruning of load-balanced MoE models.

[98] Persistent Teacher Anchoring for Tool-Using Agents cs.LG | cs.AI | cs.CLPDF

Hyun Bin Park, Kyungho Song, Sangmin Lee, Du-Seong Chang

TL;DR: 本文提出了一种名为Persistent Teacher Anchoring（PTA）的方法，用于改进使用工具的LLM智能体在知识蒸馏过程中的训练。该方法通过引入教师对整轮（turn）的承诺机制，确保工具调用在得到教师验证后才执行，从而减少了教师-学生分布差距的累积。此外，论文还提出了persistent lookahead技术以提高训练吞吐量。在检索和感知任务上的实验表明，PTA相比传统的on-policy知识蒸馏（OPKD）能显著提升下游强化学习性能。

Details

Motivation: 在LLM后训练的知识蒸馏中，特别是使用工具的智能体场景下，传统的on-policy知识蒸馏（OPKD）存在教师-学生分布差距累积的问题。当学生生成的轨迹进入教师不会访问的状态时，这种差距会因工具调用在获得监督前就执行而变得尤为严重，影响后续学习。现有方法（如提议者-验证者生成）未能将工具执行纳入其控制范围。

Result: 在Search-R1风格的检索和DeepEyes风格的感知强化学习任务中，与相同下游RL预算下的OPKD相比，应用PTA方法将macro best@4指标分别提升了2.5和2.8个百分点。同时，persistent lookahead技术将训练吞吐量提高了24%。

Insight: 核心创新点在于提出了PTA框架，它将工具调用执行与文本生成验证统一起来，通过‘turn-level commitment’机制确保工具调用在整轮内容得到教师验证后才提交给环境执行，从而有效控制了分布漂移。此外，将已验证的文本块视为原子生成单元并引入persistent lookahead，是一种兼顾训练稳定性和效率的巧妙设计。

Abstract: Distillation is common in LLM post-training, where on-policy knowledge distillation (OPKD) uses student-generated trajectories to prepare the student for downstream RL. At each state, the student matches a next-token distribution supplied by the teacher. As the rollout enters states the teacher would not visit, the teacher-student distribution gap can accumulate. In tool use, this gap becomes consequential because student-written calls execute before supervision and their observations shape later prefixes. Proposer-verifier generation addresses this drift by letting the teacher decide which student-proposed text is retained during generation. Existing formulations govern text but leave tool execution outside their scope. We propose Persistent Teacher Anchoring (PTA), a student-induced but teacher-committed rollout construction. PTA retains chunk-level verification and adds turn-level commitment, allowing a call to reach the environment only after the teacher has verified the entire turn. Treating verified chunks as atomic generation units, we introduce persistent lookahead, which fills idle rollout capacity by advancing future samples and carrying unfinished ones across student updates under the fixed verifier. Across Search-R1-style retrieval and DeepEyes-style perception RL, applying PTA before downstream RL improves macro best@4 by 2.5 and 2.8 points over OPKD under the same downstream RL budget, while lookahead improves throughput by 24%.

[99] BeaconKV: Key-Value Cache Compression Guided by Beacon Queries for Efficient Large Reasoning Model Inference cs.LG | cs.CLPDF

Janghyeon Kim, Minsoo Kim, Kyuhong Shim, Jungwook Choi

TL;DR: 本文提出了BeaconKV，一种用于大型推理模型（LRM）推理的无训练KV缓存压缩方法。该方法通过识别并维护少量代表全局查询簇的’信标查询’，来预测未来可能被重新访问的KV对，从而有效压缩缓存，缓解长序列推理中的内存瓶颈问题。

Details

Motivation: 大型推理模型通过长链思维生成解决问题，但KV缓存随序列长度线性增长，造成严重内存瓶颈，常超出GPU容量。现有压缩方法依赖近期查询估计未来重要性，但这一假设在长程推理中失效，因为存在’思维回溯标记’会重新关注遥远的先前上下文。

Result: 在四个开源LRM和多个推理基准测试中，BeaconKV普遍优于现有压缩方法，实现了高达5.8倍的内存减少，同时几乎保持了完整缓存的准确性，并将吞吐量提高了4.3倍以上。

Insight: 核心创新在于发现了长程推理中’思维回溯标记’对应的查询在嵌入空间中会聚类成少量相似性组，并据此提出用’信标查询’作为全局查询簇的紧凑代表来指导KV缓存压缩，这是一种无需训练、基于查询模式洞察的压缩新思路。

Abstract: Large Reasoning Models (LRMs) achieve superior problem-solving through extended Chain-of-Thought (CoT) generation, but the resulting key-value (KV) cache grows linearly with sequence length and creates severe memory bottlenecks, often exceeding GPU capacity for long reasoning traces. Existing KV cache compression methods rely on recent queries to estimate future token importance, implicitly assuming these serve as reliable proxies for future attention patterns. We demonstrate that this assumption fails in long-horizon reasoning: certain decoding steps generate Thought Revisiting Tokens (TRT) that re-attend to distant previous context, such as task-solving plans formulated early in the trace. Through systematic analysis, we discover that queries corresponding to the TRT cluster into a small number of similarity groups in the embedding space. Based on this insight, we propose BeaconKV, a training-free KV cache compression method that maintains beacon queries, compact representatives for each global query cluster, to anticipate which KV pairs will be revisited without storing the entire query history. Across four open-source LRMs and diverse reasoning benchmarks, BeaconKV generally outperforms existing compression methods, achieving up to $5.8\times$ memory reduction while nearly preserving full cache accuracy and improving throughput by over $4.3\times$.

cs.SD [Back]

[100] Motion-Omni: End-to-End Joint Speech and Full-Body Motion for Spoken Dialogue cs.SD | cs.CV | eess.ASPDF

Chengqian Ma, Wei Tao, Haoyu Zhang, Yiwen Guo

TL;DR: Motion-Omni是一个端到端的联合语音与全身运动生成框架，用于口语对话。它基于一个大型语言模型（Qwen2.5-7B-Instruct）骨干，能够直接从生成语音的隐藏状态中同步产生面部表情、手部、上半身和下半身的运动，从而避免了传统级联方法需要两次推理的弊端。

Details

Motivation: 解决现有方法中语音对话模型和伴随语音运动模型分离的问题，传统级联方案无法进行联合优化且效率低下，需要构建一个能够端到端、联合生成语音和全身运动的统一模型。

Result: 在提出的随机开放式全身口语对话评估协议上，基于Qwen2.5-7B-Instruct的Motion-Omni-Q7版本，其无参考运动指标与使用相同音频的教师级联模型差距在2%以内，响应速度快5.4倍（RTF=0.78），在节拍相关性和多样性上超越了所有非教师级联模型，并达到了2.62%的词错误率，在对比的全模态系统中最低。

Insight: 核心创新在于端到端的联合训练范式，通过冻结语音通路并联合优化LLM、语音生成器和运动生成器，恢复了运动与音频的对齐，同时保持了对话能力。此外，论文贡献了一个可扩展的、模型无关的伪标签数据生成管道，以及首个公开的随机开放式全身口语对话评估协议。

Abstract: An avatar that holds a conversation should decide what to say and to move while saying it, yet these abilities live in separate model families: spoken dialogue models produce speech without motion, and co-speech motion models produce motion only from audio handed to them. The standard remedy is a cascade that first generates the spoken response and then runs a motion model over the finished audio, which requires a second full inference pass and precludes any joint optimisation between the two. We present Motion-Omni, an end-to-end framework in which a spoken dialogue model natively outputs explicit facial expression together with hand, upper-body and lower-body motion, generated directly from the hidden states that produce the speech. Joint training is not optional here: with the speech pathway frozen, motion remains misaligned with the audio, and co-adapting the LLM, Speech Generator and Motion Generator under both objectives is what recovers alignment while retaining spoken-dialogue ability. Supervision comes from a scalable, model-agnostic pipeline that pseudo-labels consistent-voice speech responses with a replaceable motion teacher, yielding 422,856 quality-ranked pairs (1,402 hours). We further release SwDA-500 and, to our knowledge, the first public evaluation protocol for stochastic open-ended full-body spoken dialogue, matching audio across motion systems while unifying rendering, automatic metrics, human evaluation, and latency measurement. Instantiated with a Qwen2.5-7B-Instruct backbone, Motion-Omni-Q7 matches the same-audio teacher cascade to within 2% on reference-free motion metrics while responding 5.4 x faster (RTF=0.78, faster than real time), surpasses all non-teacher cascades on beat correlation and diversity, and reaches a 2.62% word error rate, the lowest among the omni-modal systems compared.

cs.IR [Back]

[101] Latent-Aligned Reasoning for Multimodal Recommendation cs.IR | cs.CL | cs.CV | cs.LGPDF

Jiarui Jin, Anyang Ji

TL;DR: 本文提出了一种名为LARK（Latent-Aligned Reasoning frameworK）的两阶段潜在对齐推理框架，旨在解决多模态推荐中视觉和文本信号在多步推理过程中逐渐衰减的‘跨模态稀释’问题。该框架通过可学习的潜在令牌与思维链推理交错，并与冻结的视觉编码器对齐以保留感知细节，再通过桥接MLP和对比学习进行第二阶段对齐，最终在多个公开和工业数据集上实现了最先进的推荐性能。

Details

Motivation: 动机在于，尽管多模态视觉语言模型在跨模态理解方面表现出色，但将其应用于推荐系统时，视觉和文本信号在多步推理过程中会逐渐衰减，即‘跨模态稀释’现象，这限制了模型的有效性。

Result: 在三个公开基准数据集和一个工业数据集上的实验表明，LARK在多种推荐架构上均达到了最先进的性能，且通过受控消融实验证实了每个组件的独特贡献。

Insight: 创新点在于提出了一个两阶段的潜在对齐推理框架，通过在第一阶段引入与视觉编码器对齐的潜在令牌作为‘视觉检查点’，以及在第二阶段将潜在表示与思维链隐藏状态对齐，有效缓解了跨模态稀释，确保了推理语义在整个过程中的保持。

Abstract: Multimodal Vision-Language Models (VLMs) have demonstrated remarkable capabilities in cross-modal understanding, yet a fundamental challenge persists when applying them to recommendation: as representations propagate through multi-step reasoning, both visual and textual signals progressively attenuate - a phenomenon we term cross-modal dilution. To address this, we propose LARK (Latent-Aligned Reasoning frameworK), a two-stage latent reasoning framework with complementary alignment mechanisms within a single VLM. In the first stage, learnable latent tokens are interleaved with multi-step chain-of-thought (CoT) reasoning and explicitly aligned with a frozen vision encoder, serving as visual checkpoints that preserve perceptual details throughout the reasoning chain. In the second stage, the latent representations are projected via a bridge MLP and trained with item-to-item contrastive learning; to prevent the reasoning semantics from fading, intermediate features are aligned with the CoT hidden states from the first stage, anchoring the final embeddings to the model’s own reasoning output. Experiments on three public benchmarks and one industrial dataset show that LARK achieves state-of-the-art performance across multiple recommendation architectures, with controlled ablations confirming the distinct contribution of each component.

Table of Contents

cs.CL [Back]

[1] Memory as transformation: LETHE, a self-referential gan-inspired architecture cs.CLPDF

[2] MedProb: Probing Internal Representations of Vision-Language Models for Medical Question Answering cs.CLPDF

[3] Adapting from Downturns: Prediction of Long-Term Conversational-Skill Development in Mental-Health Crisis Counselors cs.CL | cs.AI | cs.CYPDF

[4] Evidence Integration in Large Language Models cs.CL | cs.AI | cs.LGPDF

[5] Shared circuits predict whether LLMs generalize across formats in arithmetic reasoning cs.CL | cs.AIPDF

[6] Towards Understanding Pause Token Fine-Tuning Dynamics: A Mode Retention Perspective cs.CL | cs.AIPDF

[7] A Calibrated Reflection Approach for Enhancing Confidence Estimation in LLMs cs.CLPDF

[8] PetQA: Benchmarking Veterinary Knowledge and Clinical Reasoning cs.CL | cs.AI | cs.CVPDF

[9] Tracing Audio Grounding and Answer Selection in Audio LLMs cs.CL | cs.AI | cs.LG | cs.SDPDF

[10] ConsensusBench: Benchmark of Consensus Nodes for LLM Reasoning via Outcome Reward Densifying cs.CLPDF

[11] Choosing the Right Language Mode at Inference Time for Multilingual Reliability cs.CLPDF

[12] Refuse without Refusal: A Structural Analysis of Safety-Tuning Responses for Reducing False Refusals in Language Models cs.CL | cs.AIPDF

[13] Knowing What Not to Answer: Selective Non-Compliance in Vision-Language Models cs.CL | cs.AIPDF

[14] Beneath the Surface of Chains-of-Thought: A Mechanistic Interpretation of Reasoning Operations in LLMs cs.CLPDF

[15] Reinforcement Learning for improving Large Language Models’ Catalan text simplification capabilities cs.CL | cs.AIPDF

[16] Generating Constructive Feedback on Stories via Reinforcement Learning cs.CLPDF

[17] On Epistemic Diversity in Large Language Models cs.CLPDF

[18] MMTClinic: Multimodal, Multilingual Time Series Question Answering and Reasoning Benchmark for Clinical Domain cs.CL | cs.AIPDF

[19] Leveraging Low-Level Symbolic Competences for Unsupervised Grounding in Hallucination Detection cs.CL | cs.AI | cs.IRPDF

[20] A Structured Debate-Mixture-of-Agents Framework for Complex Clinical Diagnostic Decision Support cs.CL | cs.AIPDF

[21] From Vision to Language: Investigating Causal Information Flow in Multimodal Decision-Making cs.CL | cs.CVPDF

[22] Compression Beyond the Uncompressed: A Two-Stage Training Recipe for Soft Context Compression in RAG cs.CLPDF

[23] Can Large Language Models Anticipate Behavioral Responses to Social Policies? A Case of Pension Enrollment Prediction among China’s Flexible Workers cs.CLPDF

[24] A Verifier-Guided Explainable Reasoning Framework with Gold-Anchored QLoRA, Task-Aware Mixture-of-Experts, and Group-Relative RLVR cs.CL | cs.AI | cs.LGPDF

[25] WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Data cs.CLPDF

cs.CV [Back]

[26] FailSAE: Towards Interpretable Failure Prediction for Vision-Language Models via Sparse Autoencoders cs.CVPDF

[27] Step Back to Move Forward: Reflection-Aware Preference Optimization for Visual Generation cs.CVPDF

[28] When Seeing Overrides Knowing: Visual Dominance and Deferral-Based Method for Personalized Safety in VLMs cs.CV | cs.AI | cs.LGPDF

[29] Joint Alignment and Distillation for Video Generation via Sample-Guided Distribution Matching cs.CVPDF

[30] AdaptVPR: Route-Aware Hard Positive Generation for Robust Visual Place Recognition cs.CVPDF

[31] Object Concepts Emerge from Motion cs.CVPDF

[32] What Moves? Localized Motion Representations for Compositional Scene Control cs.CV | cs.AIPDF

[33] Where Appearance Fails, Geometry Recognizes: A CAD-Free 3D Shape Prior That Complements Vision Foundation Models cs.CV | cs.AI | cs.ROPDF

[34] FAVE: Foveated Adaptive Visual Encoding for Efficient Fine-Grained Visual Understanding cs.CVPDF

[35] ICM-Bench: Person-Level Identity Reasoning in Multimodal Agents with Long-Term Memory cs.CVPDF

[36] VISTA: Dense Multi-Label Classroom Coding with Vision-Language Models cs.CVPDF

[37] DART: Depth-as-Target Pretraining for Surgical Vision Foundation Models cs.CVPDF

[38] ReaDiT Guidance: Control for Image and Video Generation using Diffusion Transformer Features cs.CVPDF

[39] Enhancing Multimodal Emotion Recognition via Multi-Feature Encoding and Attention-Based Fusion cs.CV | cs.AI | cs.LGPDF

[40] LookThere! Sparse Vision by Reinforced Selection cs.CV | cs.LGPDF

[41] HiSfM: Disambiguating Structure-from-Motion via Scaffold-Anchored Hierarchical Reconstruction cs.CVPDF

[42] Bridging Modalities and Tasks: A Unified Hierarchical ViT for SAR-to-Optical Translation and Semantic Segmentation cs.CVPDF

[43] Where to Look Matters: Learning Influential Views for VLM-based 3D Visual Grounding cs.CVPDF

[44] CoMLP: Cooperatively-Gated MLPs for Fine-Grained Cross-Modal Information Fusion in Medical Image Segmentation cs.CVPDF

[45] Intrinsic Temporal Adaptation of CLIP for Partially Relevant Video Retrieval cs.CVPDF

[46] Linguistic Trajectory Encoding for Efficient Long-Horizon Spatial Memory in Embodied Agents cs.CV | cs.AIPDF

[47] LetOccVote: Learning Weakly Supervised 3D Occupancy through Consensus cs.CVPDF

[48] Mitigating Performance Discrepancy in Cross-Domain 3D Class-Incremental Learning cs.CV | cs.AIPDF

[49] InterSing: Explicit Interaction Dynamics for 3D Duet Singing Animation and Beyond cs.CVPDF

[50] TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Image cs.CVPDF

[51] One Diffusion Model, Two Roles: Guided Trajectory Planning and Safety-Critical Scenario Generation in Closed-Loop Simulation cs.CV | cs.AI | cs.LG | cs.ROPDF

[52] MCPO: Modality-Contrastive Preference Optimization for Multimodal Chain-of-Thought Compression cs.CV | cs.AIPDF

[53] Learning 3D Editing without Paired Supervision via Generative Prior Distillation cs.CVPDF

[54] MINT: A Unified Model for World-Space Camera and Hand Motion Estimation from Scalable Egocentric Pipeline Supervision cs.CV | cs.ROPDF

[55] Temporal Residual Neural Radiance Fields for Monocular Video Dynamic Human Body Reconstruction cs.CVPDF

[56] Compositional Reward Models for Conditional Medical Image Generation cs.CVPDF

[57] Training-Free Logical and Structural Anomaly Detection via Calibrated Fusion cs.CVPDF

[58] Adaptive Multi-Granularity Temporal Modeling for Weakly Supervised Video Anomaly Detection cs.CV | cs.AIPDF

[59] SMILE: Self-Explainable Multimodal Information Bottleneck for Medical Diagnosis cs.CV | cs.LGPDF

[60] WeAgent-MMGenEdit: A Full-Stack Recipe for Multimodal Agentic Image Generation and Editing cs.CVPDF

[61] First Things First: Teaching LLM-Based Agents to Prioritize Must-Haves before Nice-to-Haves cs.CVPDF

[62] Measured Sliders: Learning Continuous Controls from Differentiable Image Measurements cs.CVPDF

[63] Cross-Domain Tracker Adaptation Without Target-Domain Labels via Vision-Language Agents cs.CVPDF

[64] Few-Shot Video Recognition via Hierarchical Metric Learning cs.CVPDF

[65] Learning Spatial-Spectral Refinement and Calibrating Complementary Observations for Hyperspectral Image Super-Resolution cs.CVPDF

[66] Lightweight Vision Transformer Compression for On-Device Plant Disease Detection in Resource-Constrained Agricultural Field Conditions cs.CV | cs.AI | cs.LGPDF

[67] MEOX: Compact Multimodal Mixture-of-Experts for Earth Observation cs.CVPDF

[68] Think-Verify-Revise: Neuro-Symbolic Visual Reasoning with Vision-Language Models and Dynamic Logic Tensor Networks cs.CVPDF

[69] From Interpretability Methods to Interpretable Models cs.CV | cs.HCPDF

[70] WorldSculpt: Generating Compositional Worlds from Grounded Videos cs.CVPDF

eess.IV [Back]

[71] Multi-scale Image Representation Compression eess.IV | cs.CV | cs.MMPDF

[72] Scalable Neural Video Representation Compression eess.IV | cs.CV | cs.MMPDF

[73] Ultrasound-Based Prediction of Cirrhosis Decompensation Using Large-Scale Computer Vision Models eess.IV | cs.AI | cs.CVPDF

[74] Cross-modal triage network: a multimodal deep learning framework for severity-based triage and visual explainability in chest radiographs eess.IV | cs.AI | cs.CVPDF

[75] Fractional-Order Adaptive Motion Magnification: Phase-Reliability Weighting for Noise-Constrained Video Amplification eess.IV | cs.CVPDF

[76] Real-World Multi-Modal and Longitudinal Lung Cancer Dataset eess.IV | cs.CVPDF