cs.CL [Total: 56]
cs.CV [Total: 88]
cs.AI [Total: 15]
eess.IV [Total: 1]
cs.LG [Total: 11]
cs.MA [Total: 1]
cs.SD [Total: 2]
stat.ML [Total: 1]
cs.MM [Total: 1]
cs.IR [Total: 2]
cs.CR [Total: 2]
cs.GR [Total: 1]
cs.RO [Total: 3]

cs.CL [Back]

[1] Micro-Macro Retrieval: Reducing Long-Form Hallucination in Large Language Models cs.CL | cs.AIPDF

Yujie Feng, Jian Li, Zhihan Zhou, Pengfei Xu, Yujia Zhang

TL;DR: 该论文提出了一种名为Micro-Macro Retrieval (M2R)的新型检索增强生成框架，旨在解决大语言模型在长文本生成中的幻觉问题。该框架通过宏观检索外部粗粒度证据和微观重用推理过程中构建的关键信息库，确保关键信息贴近输出，从而减少事实错误。

Details

Motivation: 现有检索增强语言模型缺乏有效机制确保关键信息贴近模型输出，而研究表明信息与输出的接近度直接影响事实准确性，尤其是在冗余检索上下文和冗长推理链加剧幻觉的长文本生成任务中。

Result: 在不同基准测试上的广泛实验证明了M2R的有效性，尤其是在长上下文设置中，能有效减少幻觉。

Insight: 创新点在于提出了宏观-微观双层检索框架，直接针对关键信息与输出的接近度瓶颈；同时采用基于课程学习的强化学习策略配合定制化规则奖励，稳定训练检索与事实锚定技能。

Abstract: Large Language Models (LLMs) achieve impressive performance across many tasks but remain prone to hallucination, especially in long-form generation where redundant retrieved contexts and lengthy reasoning chains amplify factual errors. Recent studies highlight a critical phenomenon: the closer key information appears to the model outputs, the higher the factual accuracy. However, existing retrieval-augmented language models (RALMs) lack effective mechanisms to ensure this proximity - external evidence is injected into reasoning via multi-turn retrieval, but this cannot ensure key information stays close to the outputs. We propose Micro-Macro Retrieval (M2R), a novel retrieve-while-generate framework to fill this gap. At the macro level, M2R retrieves coarse-grained evidence from external sources; at the micro level, it extracts essential results from a key information repository built during reasoning and reuses them while generating answers. This design directly addresses the key-information-to-output proximity bottleneck, effectively reducing hallucination in long-form tasks. M2R is trained with a curriculum learning-based reinforcement learning strategy using customized rule-based rewards, enabling stable acquisition of retrieval and grounding skills. Extensive experiments across different benchmarks demonstrate the effectiveness of M2R, especially in lengthy-context settings.

[2] Lightweight Multimodal LLM-Enabled Cost-Effective Defect Grading of Power Transmission Equipment cs.CLPDF

Tao Wang, Lipeng Zhu, Jiayong Li, Feng Gao, Siwen Liang

TL;DR: 本文提出了一种基于多模态大语言模型（MLLM）的轻量级框架，用于电力传输设备的缺陷分级（DGPTE）。该方法通过上下文学习最大化商用MLLM的潜力，并生成少量基于思维链的问答对以降低人工标注成本，随后利用这些高质量问答对Qwen3-VL-8B模型进行基于低秩适配的监督微调。

Details

Motivation: 现有机器学习方法在电力传输设备缺陷检测中虽能力强，但难以整合专家经验，且在更精细的缺陷分级领域面临类别不平衡问题。

Result: 在三个DGPTE任务上的实验结果表明，仅微调语言模型层即可实现SOTA性能；多任务联合微调验证了仅使用单个轻量级MLLM处理多个分级任务的可行性。

Insight: 创新点在于利用商用MLLM通过上下文学习生成高质量、可解释的思维链问答对，从而低成本地获取训练数据，并通过仅微调语言模型层的轻量级方式实现SOTA性能，展示了多任务处理的潜力。

Abstract: Defect grading of power transmission equipment (DGPTE) is crucial to the stability of electric energy transmission. Although existing machine learning methods exhibit strong capabilities in defect detection, they are plagued by difficulties in integrating expert experience and facing class imbalance in more refined defect grading field. To address this issue, this paper introduces a novel defect grading framework based on multimodal large language model (MLLM). Specifically, this approach maximizes the commercial MLLMs’ potential of DGPTE through in-context learning and obtains the state-of-te-art (SOTA) model. By sending a secondary request to this model, a small number of chain of thought-based question-answer pairs (Q&As) are generated, which effectively reduces the cost of manual annotation. In this way, these high-quality interpretable Q&As are used to train Qwen3-VL-8B via Low-Rank Adaption-based supervised fine-tuning (SFT). Experimental results on three DGPTE tasks demonstrate that fine-tuning only the language model layer yields the SOTA performance. Furthermore, multi-task joint fine-tuning verifies the feasibility of handling multiple grading tasks within only a single lightweight MLLM.

[3] MechELK: A Mechanistic Interpretability Framework for Eliciting Latent Knowledge in Large Language Models cs.CLPDF

Ji-jun Park, Soo-joon Choi, Jiwon Jeong, Taeyang Yoon, Ju-Wan Lee

TL;DR: 本文提出了一个名为MechELK的统一框架，旨在通过机制可解释性方法从大语言模型中提取其内部表示中存在的、但未在表层输出中忠实反映的潜在知识。该框架包含定位、验证和引出三个阶段，在TruthfulQA、Deceptive Alignment基准和Quirky LM数据集上评估，平均引出准确率达到84.7%，优于现有方法。

Details

Motivation: 现有提取潜在知识的方法（如CCS）依赖于对比激活模式，在处理复杂多步推理任务时存在困难，而机制可解释性工具主要用于理解模型行为而非提取隐藏知识。本文旨在弥合这一鸿沟，构建一个结合两者的框架来更有效地引出潜在知识。

Result: 在TruthfulQA、一个精心策划的欺骗性对齐基准和Quirky LM数据集上进行评估，MechELK的平均引出准确率达到84.7%，比CCS高出6.2%，比直接线性探测高出9.1%。在模型表层输出错误或回避的情况下，MechELK成功识别出潜在知识的比例达到78.3%。

Insight: 论文的创新点在于将机制可解释性（如稀疏自编码器特征分析、激活修补、因果探测）与潜在知识引出任务相结合，形成了一个统一的三阶段框架。其核心洞察是利用机制分析来定位和验证知识承载的表示，然后通过表示工程在不修改模型权重的情况下引出隐藏知识，这对于AI安全应用（如欺骗性对齐检测）具有实用价值。

Abstract: Large language models (LLMs) frequently encode factual and reasoning knowledge in their internal representations that is not faithfully reflected in their surface-level outputs – a phenomenon known as \emph{latent knowledge}. Existing approaches to eliciting latent knowledge, such as Contrastive Consistency Search (CCS), rely on contrastive activation patterns and struggle with complex multi-step reasoning tasks, while mechanistic interpretability tools have primarily been used to \emph{understand} model behavior rather than to \emph{extract} hidden knowledge. We present \textbf{MechELK}, a unified three-stage framework that bridges mechanistic interpretability and latent knowledge elicitation. MechELK operates through: (1) \textbf{Locate} – using Sparse Autoencoder (SAE) feature analysis and activation patching to identify knowledge-bearing representations; (2) \textbf{Verify} – employing causal probing to distinguish genuine latent knowledge from spurious correlations; and (3) \textbf{Elicit} – applying representation engineering to surface hidden knowledge without modifying model weights. Evaluated on TruthfulQA, a curated Deceptive Alignment benchmark, and the Quirky LM dataset, MechELK achieves an average elicitation accuracy of 84.7%, outperforming CCS by 6.2% and direct linear probing by 9.1%. Crucially, MechELK successfully identifies latent knowledge in 78.3% of cases where the model’s surface output is incorrect or evasive, demonstrating its utility for AI safety applications including deceptive alignment detection.

[4] Aryabhata 2: Scaling Reinforcement Learning for Advanced STEM Reasoning cs.CL | cs.AI | cs.CYPDF

Ritvik Rastogi, Vishal Singh, Tejas Chaudhari, Sandeep Varma

TL;DR: 论文介绍了Aryabhata 2，这是一个专注于竞争性STEM考试推理的语言模型。它通过强化学习后训练GPT-OSS-20B模型，利用PhysicsWallah的内部题库构建高质量训练课程，旨在解决多步骤符号推理、精确数值计算和跨学科概念理解问题。

Details

Motivation: 当前大型语言模型在通用推理基准上表现良好，但难以大规模部署以满足数百万学生针对竞争性STEM考试（如JEE和NEET）的特定领域、结构化问题解决需求。

Result: 在JEE Main、JEE Advanced、NEET等竞争性考试基准以及AIME、HMMT、MMLU-Pro等分布外推理数据集上，Aryabhata 2优于其基础模型GPT-OSS-20B，同时显著减少输出令牌数量（最多减少64%）。

Insight: 创新点在于采用强化学习后训练，结合可验证奖励和逐步增大的探索组大小来构建高质量训练课程，专注于特定领域（竞争性STEM考试）的推理优化，实现了在保持高性能的同时大幅提升输出效率。

Abstract: Competitive STEM examinations such as JEE and NEET require multi-step symbolic reasoning, precise numerical computation, and deep conceptual understanding across physics, chemistry, and mathematics. Recent large language models perform strongly on common reasoning benchmarks, yet they remain difficult to deploy at scale, where millions of student doubts demand domain-specific, consistently structured problem solving. We introduce Aryabhata 2, a reasoning-focused language model for competitive STEM examinations, trained via reinforcement-learning post-training. Using PhysicsWallah’s internal question banks, we construct a high-quality training curriculum and post-train GPT-OSS-20B through reinforcement learning with verifiable rewards. Training combines prolonged reinforcement learning with broadened exploration via progressively larger rollout group sizes. We evaluate Aryabhata 2 on competitive examination benchmarks, including JEE Main, JEE Advanced, and NEET, as well as out-of-distribution reasoning datasets such as AIME, HMMT, MMLU-Pro, MMLU-Redux 2.0, and GPQA. Results show that Aryabhata 2 outperforms its base model GPT-OSS-20B on competitive STEM reasoning while requiring substantially fewer output tokens (up to 64% fewer).

[5] GenesisFunc: Multi-Agent Data Generation for Accurate and Generalizable Function-Calling cs.CL | cs.AIPDF

Hao-Xiang Xu, Chong Deng, Jiaqing Liu, Wen Wang, Qian Chen

TL;DR: 本文提出了GenesisFunc，一种用于生成高质量函数调用（FC）训练数据的自动化多智能体流水线。该方法从公开基准中的可靠工具出发，通过多智能体对话生成系统产生多样化的场景对话，并采用多阶段评估确保数据准确性。实验表明，基于该合成数据微调的8B LLM在领域内FC性能和领域外泛化能力上均优于同类开源模型，并达到与部分最新API模型相当的FC能力。

Details

Motivation: 现有函数调用训练数据获取困难，真实数据标注成本高，而现有合成数据流水线存在API不可靠、工具扩展性有限、多样性不足和质量控制薄弱等问题，因此需要一种能够自动生成高质量、多样化且覆盖广泛场景的FC训练数据的方法。

Result: 在合成数据上微调的8B LLM在领域内FC性能上超越了同等规模的开源模型，在领域外泛化任务上也表现出色，其FC能力与一些最新的API模型相当。该方法还展现出在下游工具上有效扩展的潜力。

Insight: 创新点在于提出了一个基于多智能体框架的自动化数据生成流水线，通过对话生成覆盖多样化场景，并引入多阶段评估系统来强化数据准确性，从而解决了合成FC数据在质量、多样性和可扩展性方面的核心挑战。

Abstract: Large Language Models (LLMs) extend their capabilities through function-calling (FC), which relies on training data with high quality, diversity, and broad coverage of scenario. However, obtaining and annotating real function-calling data is challenging, while synthetic data from existing pipelines often suffers from unreliable APIs, limited tool scalability, insufficient diversity, and weak quality control. To address these, we present GenesisFunc, an automated pipeline for generating FC training data. Starting from reliable tools in widely used public benchmarks, our GenesisFunc employs a multi-agent framework to support a dialogue generation system that produces conversations spanning diverse scenarios, while maintaining both diversity and quality throughout the process. The accuracy of the data is further reinforced through a multi-stage evaluation system. We fine-tune an 8B LLM on the synthetic dataset and show through extensive experiments that it outperforms similarly sized open-source models in in-domain FC performance and out-of-domain generalization, while reaching FC capabilities comparable to some of the latest API-based models. In addition, our method demonstrates strong potential to scale effectively across downstream tools, underscoring its real-world applicability.

[6] Thoughts-as-Planning: Latent World Models for Chain-of-Thoughts Optimization via Reinforcement Planning cs.CL | cs.AIPDF

Dong Liu, Yanxuan Yu, Ying Nian Wu

TL;DR: 本文提出了Thoughts-as-Planning框架，将大语言模型的推理链优化形式化为潜在语义空间上的序列决策过程。该方法通过构建一个保留邻近关系的嵌入空间来编码推理链与响应的动态关系，并学习一个潜在世界模型来模拟推理链编辑对下游输出的影响，从而支持通过梯度下降或强化学习进行规划。

Details

Motivation: 现有推理链调优方法通常依赖黑盒启发式或无梯度搜索，缺乏可解释性、泛化能力和样本效率。本文旨在解决这些问题，将推理链优化建模为一个可解释的规划过程。

Result: 在语言理解和生成任务上的大量实验表明，Thoughts-as-Planning在效率、鲁棒性和泛化能力上均优于最先进的推理链调优基线方法，达到了SOTA水平。

Insight: 核心创新点是将推理链优化形式化为潜在世界模型中的规划问题，并构建了一个支持多尺度抽象（如令牌、片段和指令级别编辑）的统一规划器，从而提供了结构化的规划轨迹以实现可解释性。

Abstract: The success of large language models (LLMs) across diverse NLP tasks has elevated the importance of reasoning chain optimization as a critical step in aligning model behavior with task objectives. Existing reasoning chain tuning methods often rely on black-box heuristics or gradient-free search, which lack interpretability, generalization, and sample efficiency. In this work, we introduce \textbf{Thoughts-as-Planning}, a novel framework that formalizes reasoning chain optimization as a sequential decision-making process over a latent semantic space. We model the LLM as a partially observable environment and learn a latent world model that simulates the effect of reasoning chain edits on downstream outputs. A proximity-preserving embedding space is constructed to encode reasoning chain-response dynamics, enabling planning via gradient descent or reinforcement learning. Our method supports multi-scale abstraction, allowing reasoning chain edits at token, segment, and instruction levels to be integrated into a unified planner. Through extensive experiments on language understanding and generation tasks, we demonstrate that Thoughts-as-Planning outperforms state-of-the-art reasoning chain tuning baselines in efficiency, robustness, and generalization, while offering interpretability through its structured planning trajectory. Our code is available at https://github.com/FastLM/Thoughts-as-Planning.

[7] Hallucination Detection-Guided Preference Optimization for Clinical Summarization cs.CL | cs.AIPDF

Shamanth Kuthpadi Seethakantha, Dung Ngoc Thai, Vara Prasad Gudi, Simran Tiwari, Rami Matar

TL;DR: 本文提出了一种基于幻觉检测引导的偏好优化方法，用于提升临床摘要生成的事实准确性。该方法包括推理时迭代修正策略（HALO）和基于偏好学习的微调方法（HALO-PL），通过在MIMIC-IV临床笔记数据集上的实验，显著减少了Llama和Gemma等大语言模型生成摘要中的幻觉现象。

Details

Motivation: 大语言模型在摘要生成任务中常产生不受支持或错误的幻觉陈述，这限制了其在专业医疗应用中的可靠性，因此需要开发能够自动提升事实忠实度的方法。

Result: 在MIMIC-IV真实临床笔记摘要任务上，HALO方法使Llama-3.1-8B-Instruct的幻觉减少24%，HALO-PL方法进一步减少48%，同时通过人类专家和LLM-Jury评估保持了摘要的流畅性、连贯性和相关性。

Insight: 创新点在于将幻觉检测器引导的迭代修正轨迹转化为偏好对用于模型微调，实现了检测信息驱动的自动化优化流程，为提升专业领域摘要的事实准确性提供了可借鉴的框架。

Abstract: Large language models (LLMs) have shown promise on summarization tasks, but they often produce hallucinations, which are unsupported or incorrect statements that limit their reliability in specialized healthcare applications. We introduce \itermodelfull (\itermodel), an inference-time method that leverages hallucination detectors to guide iterative summary revisions toward factual corrections. Building on this, we propose \itermodel for Preference Learning (\model), which converts detector-guided refinement trajectories into preference pairs for model finetuning. Extensive experiments show that our methods substantially reduce hallucinations for Llama and Gemma models in summarizing real-world clinical notes from \MimicIV. For example, \itermodel reduces 24% and \model reduces 48% hallucinations in Llama-3.1-8B-Instruct. Importantly, both methods preserve summary fluency, coherence, and relevance according to human expert and LLM-Jury evaluations. Together, these results demonstrate that detection-informed refinement and preference learning offer an automated solution for improving factual faithfulness in clinical summarization.

[8] Reasoning that Travels: Dissecting How Chain-of-Thought Transfers Across Models cs.CLPDF

Xinyuan Cheng, Beiduo Chen, Philipp Mondorf, Barbara Plank

TL;DR: 本文研究了大型推理模型（LRMs）生成的思维链（CoT）在不同模型间传递的机制。通过设计一个受控的提供者-接收者框架，分析接收者如何利用CoT前缀来解决问题，揭示了CoT传递并非单一现象，而是涉及答案提取、推理支架或接收者依赖能力等多种机制。

Details

Motivation: 尽管CoT作为显式文本可以在模型间传递以解决相同任务，但成功传递本身并不能揭示提供的CoT如何贡献于接收模型的答案。本文旨在通过受控实验剖析CoT跨模型传递的具体机制。

Result: 在多个模型和基准测试（如AIME、MMLU-Pro、ZebraLogic）上，完整CoT通常能成功传递，但前缀轨迹分析显示不同机制：在强制回答模式下，AIME的传递主要由显式答案可用性驱动；MMLU-Pro则更多反映接收者能力的作用；ZebraLogic依赖于部分结构化答案信息而非仅完整答案泄露。在自由生成模式下，部分CoT能提升性能，表明前缀可以指导持续推理。

Insight: 创新点在于提出一个受控的提供者-接收者框架来系统分析CoT传递机制，并发现跨模型CoT传递不是单一现象，而是根据任务和模式不同，涉及答案提取、推理支架或接收者依赖能力。这为理解模型间知识转移和优化推理过程提供了新视角。

Abstract: Large reasoning models (LRMs) often generate extensive chain-of-thought (CoT) traces before producing a final answer. As explicit textual artifacts, these traces can be passed to other models to solve the same task, enabling cross-model reasoning transfer. Yet successful transfer alone does not reveal how the provided CoT contributes to another model’s answer. We study this question with a controlled provider–receiver framework, where a provider generates a reasoning trace and a receiver solves the same problem from increasingly longer trace prefixes. We compare force-answer, where the receiver answers directly from the prefix, with free-generation, where it may continue reasoning before answering. Across models and benchmarks, full traces often transfer successfully, but prefix trajectories reveal distinct mechanisms. In force-answer mode, AIME transfer is largely driven by explicit answer availability. MMLU-Pro instead reflects a larger role for receiver competence, while ZebraLogic depends on partial structured-answer information rather than complete-answer leakage alone. In free-generation mode, partial CoTs improve performance across benchmarks, indicating that prefixes can guide continued reasoning. Finally, answer agreement among receivers provides a gold-free signal for stopping provider reasoning early. Overall, cross-model CoT transfer is not a single phenomenon: it can reflect answer extraction, reasoning scaffolding, or receiver-dependent competence.

[9] From Data to Insights: Exploring Program-of-Thoughts Prompting for Chart Summarization cs.CLPDF

Yutong Qu, Wei Zhang

TL;DR: 本文提出了一种利用零样本学习激励轻量级视觉语言模型（VLMs）进行图表摘要的方法，通过Python程序作为中介来推导有效的摘要统计信息，以解决图表理解中的语义视觉理解和数值推理难题。

Details

Motivation: 针对现有视觉语言模型在图表摘要中缺乏验证统计事实正确性的鲁棒机制且计算量大的问题，探索一种轻量级解决方案。

Result: 实验结果表明，该方法在语义和事实性指标上与现有图表摘要方法表现相当。

Insight: 创新点在于引入图表到字典的辅助任务，相比传统图表到表格方法提供更灵活的表示，并特别适合与程序思维（PoT）策略集成，以实现零样本下的计算推理。

Abstract: Charts play a critical role in conveying numerical data insights through structured visual representations. However, semantic visual understanding and numerical reasoning requirements hinder the accurate description of charts, interpreting a challenging task in chart summarization. Despite recent advancements in visual language models (VLMs), approaches lack robust mechanisms for verifying statistical fact correctness and are computationally heavy. To address this gap, this paper explores a strategy of using zero-shot learning to motivate the lightweight VLMs to perform computational reasoning, via Python programs as intermediaries to derive valid summary statistics for chart understanding. Specifically, we introduce a novel chart-to-dictionary auxiliary task, offering a more flexible representation compared to traditional chart-to-table methods, making it particularly well-suited for integration with the Program-of-Thought (PoT) strategy. Experimental results demonstrate our strategy performs on par with existing chart summarization methods across semantic and factual metrics. Code is available on https://anonymous.4open.science/r/ZeroShot-PoT-C2T-5A6B.

[10] Error as a Lens: Probing LLM Reasoning through Synthetic Misconception Generation cs.CLPDF

Xinming Yang, Jun Li

TL;DR: 本文提出一个通过合成误解生成来探测LLM推理能力的框架，旨在为个性化辅导、教师培训和教育研究提供针对性的合成错误数据。该框架利用生成代理（GA）基于修订版布鲁姆分类法的五类认知失败模式生成候选错误答案，并由审查代理（EA）判断其错误性和类别一致性，在TheoremQA数据集上进行了评估。

Details

Motivation: 动机在于解决教育领域因隐私和IRB限制导致真实学生错误标注数据稀缺的问题，需要能够大规模生成与特定认知失败模式相匹配的合成错误，而不仅仅是任意的错误答案。

Result: 在TheoremQA数据集上的评估表明，该框架能够生成类别分层的合成错误数据集；同时，针对性的错误生成比自由形式的错误答案生成更具挑战性，且答案锚定（answer-grounding）比扩展示例或外部教科书内容贡献更大。

Insight: 创新点在于将错误视为一种透镜来探测LLM推理，并设计了一个基于代理的生成-审查框架来构建可重用的、类别分层的合成错误数据集；从客观角度看，该方法为在缺乏真实学生数据时创建教育诊断工具提供了系统化方案，并揭示了LLM在生成针对性错误时的能力局限。

Abstract: Personalized tutoring, teacher training, and education research need access to \emph{targeted} synthetic misconceptions, but privacy and IRB constraints make labelled corpora of real student errors scarce. LLMs could in principle generate synthetic errors at scale, but producing an arbitrary wrong answer is easy for a modern LLM while producing one that matches a specified cognitive failure mode is much harder. We present a framework that generates errors targeted to a five-class taxonomy adapted from the revised Bloom’s taxonomy, evaluated on questions from the TheoremQA dataset. A Generation Agent (GA) drafts a candidate erroneous solution conditioned on a target class, and an Examination Agent (EA) judges whether the draft is incorrect and class-consistent. The framework yields a reusable recipe for building class-stratified synthetic error datasets where authentic student corpora are unavailable. As a secondary diagnostic, targeted error generation is substantially harder than free-form incorrect-answer generation, and answer-grounding contributes more than expanded examples or external textbook content.

[11] Structured Prompt Optimization Meets Reinforcement Learning for Global and Local Interpretability over Complex Text cs.CL | cs.AI | cs.LGPDF

Tianyang Zhou, Wenbo Chen, Pierre Jinghong Liang, Leman Akoglu

TL;DR: 本文提出eXplainable Text Classifier (eXTC)，一个三阶段的可解释文本分类框架。它通过结构化提示优化学习自然语言规则手册（SOP），将大型教师LLM的推理知识蒸馏到紧凑模型中，并利用强化学习扩展推理能力。该方法在保持快速推理的同时，提供了局部推理轨迹和全局模块化解释，并在多个基准测试的分类性能和解释质量上显著优于现有方法。

Details

Motivation: 现有文本分类范式存在权衡：监督微调可扩展但推理能力有限且缺乏透明度；离散提示优化可读性好但性能和可扩展性不足。本文旨在开发一个兼具高性能、可扩展性和强可解释性的分类器。

Result: eXTC在多个基准测试的分类性能和解释质量上显著优于现有范式，并展示了分阶段的性能增益。

Insight: 创新点在于将结构化提示优化、知识蒸馏和强化学习结合的三阶段框架，以生成全局规则手册和局部推理轨迹，实现了性能与可解释性的统一。从客观角度看，其模块化设计和对规则手册的显式学习是可借鉴的思路。

Abstract: LLMs have advanced text classification, yet existing paradigms face a trade-off: supervised (label only) fine-tuning is scalable but offers limited reasoning on complex text and lacks broader model transparency, while discrete prompt optimization offers human-readable instructions but struggles with performance and scalability. We introduce eXTC (eXplainable Text Classifier) with three progressive stages: (1) learning a Standard Operating Procedure (SOP, or rulebook) in natural language via a new Structured Prompt Optimization algorithm; (2) SOP-grounded reasoning distillation from a large teacher LLM into a compact LM; and (3) expanding reasoning capabilities beyond the initial SOP via reinforcement learning. This design enables eXTC to provide (i) fast inference via a compact LM, with (ii) inference-time local reasoning traces, alongside a global, modular explanation of its learned domain rules, while (iii) significantly outperforming existing paradigms across diverse benchmarks in both classification performance and explanation quality, with stage-by-stage gains.

[12] Analyzing Persona Effects in Generated Explanations from Multimodal LLM Agents in Urban Perception cs.CL | cs.CV | cs.HC | cs.MAPDF

Neemias da Silva, Myriam Delgado, Rodrigo Minetto, Daniel Silver, Thiago H Silva

TL;DR: 本文研究了在多模态大语言模型（MLLM）的城市场景感知任务中，角色提示如何影响生成的语言输出。通过分析59,808条来自1,200个角色条件代理和两种无角色设置的标注数据，发现不同角色在图像描述上高度趋同，但在解释理由上存在与社会经济和政治属性相关的系统性差异，而感知标签则未显示出显著的统计差异。主题分析进一步揭示了不同角色在解释同一场景时会强调不同的评价主题。

Details

Motivation: 研究动机是探究在多模态LLM代理的城市场景感知任务中，通过角色提示来引导模型生成解释时，角色设定如何系统地影响生成的语言内容，特别是关注其在描述、理由和感知标签上的差异。

Result: 在城市场景感知的基准测试中，结果显示：不同角色的图像描述（captions）高度收敛；解释理由（justifications）显示出与社会经济和政治属性相关的系统性变化；感知标签（perception tags）未观察到统计上显著的差异，但存在趋势性效应。主题分析证实了不同角色在评价主题上的差异。

Insight: 论文的创新点在于系统地量化了角色提示对多模态LLM生成解释的影响，揭示了角色设定主要影响解释的理由和评价主题，而非基础描述或感知标签，这为理解和控制AI代理的偏见及视角提供了重要见解。

Abstract: We study how persona prompting shapes language generated by multimodal large language models in an urban perception setting. Using 59,808 annotations from 1,200 persona-conditioned agents and two no-persona settings, we analyze captions, justifications, and perception tags across personas. Results indicate strong convergence in captions for different personas, whereas justifications display systematic variation associated with socioeconomic and political attributes, while perception tags show no statistically significant persona-related differences, though effect trends are observed. Topic analysis further reveals that personas emphasize different evaluative themes when interpreting the same scenes.

[13] UA-Legal-Bench: A Benchmark for Evaluating Large Language Models on Ukrainian Legal Reasoning cs.CL | cs.AIPDF

Volodymyr Ovcharov

TL;DR: 本文介绍了UA-Legal-Bench，一个用于评估大语言模型在乌克兰法律推理能力上的基准测试。该基准基于乌克兰统一国家法院判决登记处构建，包含五项任务：案件类型分类、判决形式分类、案件结果预测、法律规范提取和原因类别预测。作者评估了11个不同规模的LLM，揭示了少样本提示效果的显著任务依赖性，并指出在类别不平衡的法律任务中准确率具有误导性。

Details

Motivation: 当前的法律NLP基准测试过度以英语为中心，无法检测在形态丰富、非拉丁语系语言中的模型失败模式。因此，需要为乌克兰语这类语言构建专门的法律推理基准。

Result: 在UA-Legal-Bench上评估了11个LLM（3B到675B参数）。结果显示少样本提示效果因任务而异：在判决形式分类上提升高达+38.6个百分点，但在结果预测上效果不一。分析表明，在类别不平衡的任务中，准确率具有误导性（例如，最高准确率模型仅为多数类预测器，宏F1仅23%）。家族内扩展分析显示，8B模型在表面任务上可匹配前沿性能，但扩展阈值因模型家族而异。

Insight: 创新点在于构建了首个针对乌克兰语（一种形态丰富、非拉丁语系语言）的大规模法律推理基准，填补了现有基准的空白。客观分析认为，其深入揭示了少样本学习效果的任务依赖性，并强调了在法律等不平衡领域评估指标（如宏F1）的重要性，以及模型扩展规律在不同任务和家族间的差异性。

Abstract: Legal NLP benchmarks are overwhelmingly English-centric, leaving failure modes in morphologically rich, non-Latin-script languages undetected. We introduce UA-Legal-Bench, a five-task benchmark for evaluating large language models on Ukrainian legal reasoning, built from the Unified State Register of Court Decisions (EDRSR) – one of the world’s largest open judicial corpora (99.5 million decisions). The benchmark comprises: (1) case-type classification (4 classes, n=2,000), (2) judgment form classification (4 classes, n=2,000), (3) case-outcome prediction (6 classes, n=800), (4) legal norm extraction (n=1,794), and (5) cause category prediction (22 classes, n=1,871). We evaluate 11 LLMs (3B–675B) from five families under zero-shot and 3-shot prompting via AWS Bedrock with 158K API calls. Our results reveal sharply task-dependent few-shot effects: few-shot prompting improves judgment form classification by up to +38.6 pp but has mixed effects on outcome prediction. We show that accuracy is misleading on imbalanced legal tasks: the model with highest COP accuracy (62%) is a majority-class predictor (macro-F1: 23%), while the genuinely best model scores only 44% macro-F1. Within-family scaling analysis reveals that 8B models can match frontier performance on surface-level tasks but scaling thresholds vary dramatically across families. We release all data, prompts, and model predictions.

[14] Prompt-Level Reward Specifications for Open-Ended Post-Training cs.CLPDF

Zijun Weng, Xiaohui Hu, Shuangyong Song, Yongxiang Li, Kaidong Yu

TL;DR: 本文提出了一种提示级奖励规范框架，用于开放域后训练任务。该框架将奖励规范与奖励计算分离，通过离线构建可重用的任务自适应评分标准和可执行的硬约束检查器，在训练前明确奖励标准，并在多个开放域基准测试中提升离线响应排序和在线强化学习性能。

Details

Motivation: 现有奖励方法在指令遵循、写作和决策支持等开放域任务中，常将局部需求、整体偏好和显式约束等成功条件隐含化或仅覆盖可验证的狭窄案例，导致响应质量评估不明确。

Result: 实验表明，该框架在多个开放域基准测试中改善了离线奖励模型风格的响应排序，并支持在线强化学习；消融研究进一步证明评分标准、全局评分和可执行验证提供了互补的监督。

Insight: 创新点在于分离奖励规范与计算，通过离线构建显式、可重用的任务自适应评分标准和硬约束检查器，无需人工偏好标注、参考答案或单独训练的奖励模型，实现了对需求满足、整体质量和确定性约束的混合奖励评估。

Abstract: Open-ended post-training benefits from rewards that make prompt-specific success conditions explicit, rather than relying only on post-hoc scalar scores. In instruction following, writing, and decision-support tasks, response quality depends on local requirements, holistic preferences, and explicit constraints, but existing reward methods often leave these criteria implicit or cover only narrowly verifiable cases. We propose a prompt-level reward specification framework that separates reward specification from reward computation. Given only prompts, our framework constructs reusable task-adaptive rubrics and executable hard-constraint checkers offline, making reward criteria explicit before training and reusable across rollouts. At scoring time, artifact-anchored rubric and code scores are combined with an independent global score for residual holistic quality, yielding a normalized hybrid reward over requirement satisfaction, holistic quality, and deterministic constraints. The framework requires no human preference annotations, reference answers, or a separately trained reward model. Experiments show that the resulting reward improves offline RM-style response ranking and supports online reinforcement learning across multiple open-ended benchmarks. Ablations further show that rubrics, global scoring, and executable verification provide complementary supervision.

[15] Rethinking Stepwise Model Routing: A Cost-Efficient Table Reasoning Perspective cs.CLPDF

Shenghao Ye, Yuxiang Wang, Yu Guo, Dong Jin, Shuangwu Chen

TL;DR: 本文提出EcoTab框架，通过区分表格推理任务中的表格令牌和文本令牌的不确定性分布，优化了逐步模型路由策略，以在保持推理准确性的同时显著降低计算成本。

Details

Motivation: 大型推理模型在表格推理任务中表现优异但计算开销巨大，现有逐步模型路由方法未能有效区分表格令牌与文本令牌的不确定性，导致路由决策次优。

Result: 在多个表格推理基准测试中，EcoTab均优于现有基线方法，实现了准确性与效率之间的更好平衡。

Insight: 创新点在于将推理步骤中的不确定性细分为表格令牌（如单元格值、表头）和文本令牌（自然语言推理）两类，并分别映射为小模型的下步失败风险，从而提升路由决策的精确性。

Abstract: Large Reasoning Models (LRMs) achieve strong performance on table reasoning tasks but incur substantial inference cost due to long reasoning traces. Stepwise model routing mitigates this issue by dynamically assigning reasoning steps to smaller or larger models. However, stepwise model routing for table reasoning remains underexplored. Through empirical analysis, we find that reasoning steps involving tables contain two types of tokens with distinct uncertainty distributions: table tokens grounded in table structure, such as cell values and headers, and text tokens representing surrounding natural-language reasoning. The uncertainty of both token types is correlated with the risk that the model makes an error in the next reasoning step. However, existing methods fail to model them separately, leading to suboptimal routing decisions. To address this, we propose EcoTab, a table-aware stepwise routing framework for efficient table reasoning. At each reasoning step, EcoTab separately estimates the uncertainties of table tokens and text tokens, maps them to next-step failure risks for the small model, and combines the two risks for routing. Experiments on multiple table reasoning benchmarks show that EcoTab consistently outperforms strong baselines and achieves a better balance between accuracy and efficiency.

[16] GrepSeek: Training Search Agents for Direct Corpus Interaction cs.CL | cs.AI | cs.IR | cs.LGPDF

Alireza Salemi, Chang Zeng, Atharva Nijasure, Jui-Hui Chung, Razieh Rahimi

TL;DR: 本文提出了GrepSeek，一种通过直接与语料库交互（DCI）进行搜索的智能体。它训练一个紧凑的搜索代理，通过执行shell命令（如grep）来查找、过滤和组合证据，而非依赖传统的基于检索器的文档排名列表。为了解决在大规模语料库上直接使用强化学习的不稳定性，论文设计了一个两阶段训练流程，并采用语义保持的分片并行执行引擎来加速检索。

Details

Motivation: 现有LLM搜索代理大多通过检索器获取信息，该检索器基于预计算的文档表示返回排名列表。本文探索了一种互补视角，即让搜索代理将语料库本身视为搜索环境，通过执行shell命令直接寻找证据，旨在提供一种更直接、可执行的搜索范式。

Result: 在七个开放域问答基准测试上的实验表明，GrepSeek在token级别的F1分数和精确匹配（Exact Match）上取得了最强的综合性能，达到了SOTA水平。

Insight: 核心创新点在于提出了直接语料库交互（DCI）的搜索范式，以及配套的两阶段训练策略（利用Tutor和Planner生成冷启动数据，再通过GRPO进行策略优化）和高效的并行执行引擎。这为搜索智能体提供了一种可替代且能与现有检索范式互补的实用方法，但其在表面形式变化大的查询上存在纯词汇交互的局限性。

Abstract: Large Language Model (LLM) search agents have shown strong promise for knowledge-intensive language tasks through multiple rounds of reasoning and information retrieval. Most existing systems access information using a retriever that takes a keyword or natural language query and returns a ranked list of documents using an index of pre-computed document representations. In this work, we explore a complementary perspective in which the search agent treats the corpus itself as the search environment and finds evidence by issuing executable shell commands. We introduce GrepSeek, an optimized direct corpus interaction (DCI) search agent that trains a compact search agent to find, filter, and compose evidence from large text corpora. To address the instability of learning behavior directly with reinforcement learning on large corpora, we propose a two-stage training pipeline. First, we construct a cold-start dataset using an answer-aware Tutor and answer-blind Planner to generate verified, causally grounded search trajectories. Second, we refine the initialized policy with Group Relative Policy Optimization (GRPO), allowing the agent to improve its task-oriented search behavior through direct interaction with the corpus. To make DCI practical at scale, we further use a semantics-preserving sharded-parallel execution engine that accelerates shell-based retrieval by up to $7.6\times$ while preserving byte-exact equivalence with sequential execution of the shell command. Experiments across seven open-domain question answering benchmarks show that GrepSeek achieves the strongest overall token-level $F_1$ and Exact Match. Our analysis also highlights the limitations of purely lexical interaction on queries with substantial surface-form variation, suggesting DCI as a practical and competitive method for search agents that can complement existing retrieval paradigms in the real world.

[17] STAMP: Training Explicit Memory for Mobile GUI Agents in Controllable and Scalable Virtual Environments cs.CL | cs.CVPDF

Junyang Wang, Haiyang Xu, Xi Zhang, Zhaoqing Zhu, Ming Yan

TL;DR: STAMP是一个用于训练移动GUI代理显式记忆的框架，通过可控虚拟环境生成合成任务，在任务中程序化注入确定性记忆变量，以控制记忆内容、编码时机和检索时机，从而大规模生成可验证的监督数据并支持在线强化学习。

Details

Motivation: 解决移动GUI代理在需要记忆的长时程任务中因上下文窗口有限和截图token消耗大而失败的问题，以及现有以动作为中心的数据集无法教导代理显式记忆内容与时机、静态真实数据增强成本高且缺乏交互验证的局限性。

Result: 在新提出的Memory-World基准测试中，Stamp-GUI代理在GUI专用模型中达到最先进的性能，并在Memory-World基准上创造了新的最高记录，表现出卓越的记忆准确性和任务鲁棒性，同时保持强大的通用移动导航能力。

Insight: 创新点在于利用可控虚拟环境程序化注入记忆变量来生成大规模、可验证的监督数据，从而系统性地训练代理的显式记忆能力；该方法通过环境驱动的奖励反馈支持在线强化学习，为解决长时程任务中的记忆问题提供了可扩展且可控的解决方案。

Abstract: Mobile GUI agents excel at immediate reactive control but frequently fail in realistic, long-horizon tasks that require memory. This failure stems from a fundamental conflict between limited context windows and token-heavy screenshots. To save the limited context, agents must progressively discard older visual history, permanently losing crucial transient information. Furthermore, existing action-centric datasets fail to teach agents what or when to explicitly memorize, and augmenting static real-world data is prohibitively expensive and lacks interactive verification. To resolve this, we present STAMP, a framework that trains explicit memory in mobile agents through controllable virtual environments, where deterministic memory variables are programmatically injected into synthesized tasks to control what must be memorized, when it should be encoded, and when it must later be retrieved, thereby producing verifiable supervised data at scale and enabling online reinforcement learning through environment-driven reward feedback. Evaluated on our newly introduced Memory-World benchmark, the resulting Stamp-GUI agent achieves state-of-the-art performance among GUI-specialized models and sets a new high watermark on our Memory-World benchmark, demonstrating exceptional memory accuracy and task resilience while maintaining strong general mobile navigation capabilities.

[18] Reasoning-preserved Efficient Distillation of Large Language Models via Activation-aware Initialization cs.CL | cs.LGPDF

Junlin He, Yihong Tang, Tong Nie, Guilong Li, Binyu Yang

TL;DR: 本文提出了一种名为RED（Reasoning-preserved Efficient Distillation）的高效蒸馏方法，旨在解决现有高效蒸馏（EDistill）方法在压缩大语言模型（LLMs）时导致的多步推理能力严重退化（即推理崩溃）问题。该方法通过引入激活感知初始化来初始化投影矩阵，以缓解有效秩（eRank）崩溃，从而在保持高训练效率和通用能力SOTA水平的同时，显著恢复模型的推理能力。

Details

Motivation: 现有高效蒸馏方法通过结构化剪枝和轻量模块调优来压缩大语言模型，虽然在通用能力基准上达到了SOTA性能，但会导致模型的多步推理能力严重下降，即推理崩溃。本文旨在解决这一性能退化问题。

Result: 在Llama和Qwen系列模型上的实验表明，RED方法在保持高训练效率和通用能力SOTA水平的同时，显著恢复了模型的推理能力。

Insight: 本文的核心创新点是揭示了推理崩溃的几何根源——基于宽度缩减投影矩阵的SOTA EDistill方法会导致隐藏表示的有效秩（eRank）崩溃，并提出了激活感知初始化来初始化投影矩阵作为通道选择矩阵，从理论上缓解了eRank崩溃。这为高效模型压缩中保持复杂推理能力提供了新的技术路径。

Abstract: Efficient Distillation (EDistill) compresses large language models (LLMs) by structured pruning parameters and tuning lightweight modules with high training efficiency. Although these EDistilled LLMs achieve state-of-the-art (SOTA) performance on general ability benchmarks relative to similarly sized LLMs, we identify a severe degradation in their multi-step reasoning ability, which we term reasoning collapse. We systematically analyze the geometric origins of reasoning collapse and show that the SOTA EDistill method based on width-reducing projection matrices suffers from eRank collapse, in which the effective rank (eRank) of hidden representations drops. We theoretically explain how singular values of randomly initialized projection matrices become unevenly distributed, leading to eRank collapse and thus token indistinguishability. To address this issue, we propose RED (Reasoning-preserved Efficient Distillation) for LLMs, which introduces activation-aware initialization to initialize projection matrices as channel-selection matrices, thus theoretically mitigating eRank collapse. Experiments on Llama and Qwen series demonstrate that RED substantially recovers reasoning while maintaining high training efficiency and SOTA general ability.

[19] Casual as an Anchor: Resolving Supervision Misalignment in Formality Transfer Dataset cs.CLPDF

Hyojeong Yu, Hyukhun Koh, Minsung Kim, Kyomin Jung

TL;DR: 该论文指出现有形式转换数据集（如GYAFC）存在监督信号错位问题，即二元人工改写编码的是相对风格偏移而非绝对的形式性概念，导致模型生成伪正式语言。为解决此问题，论文将形式性重新概念化为一个分级维度，引入包含非正式、随意和正式三个级别的谱系，并以随意作为明确中间状态来澄清监督信号。基于此框架，论文构建了3LF数据集，提供跨三个级别的并行监督，显著减少了非正式到正式的转换失败并改善了与人类感知的对齐。

Details

Motivation: 现有形式转换基准（如GYAFC）将任务框架为对称双向任务，但其二元人工改写编码的是相对风格偏移而非绝对形式性，导致监督设计存在缺陷，模型学习生成伪正式输出而非真正的正式语言。

Result: 在重新评估基准正式标签后，揭示了与人类对齐定义下的显著差异，这些差异导致跨模型家族在非正式到正式转换中一致失败。使用3LF数据集训练后，非正式到正式方向的性能大幅提升，例如GPT-4.1-nano的F1分数从0.06提高到0.88，尽管3LF规模远小于GYAFC。

Insight: 创新点在于将形式性重新概念化为分级维度而非二元属性，并引入随意作为明确中间状态来澄清监督信号；构建的3LF数据集提供了跨三个级别的并行监督，有效解决了监督错位问题，提升了模型与人类感知的对齐，强调了在可控文本生成中构建对齐感知基准的重要性。

Abstract: Formality transfer is commonly framed as a symmetric bidirectional task between informal and formal registers. We argue that this framing conceals a supervision design flaw in existing benchmarks such as GYAFC: binary human rewrites encode relative stylistic shifts rather than absolute human notions of formality. Consequently, models learn to generate pseudo-formal outputs that satisfy benchmark labels while failing to produce genuinely formal language. We quantify this misalignment by re-evaluating benchmark formal labels under a human-aligned definition of formality, revealing substantial discrepancies that propagate to consistent informal-to-formal failures across model families. To address this issue, we reconceptualize formality transfer as a graded dimension rather than a binary attribute. We introduce a three-level spectrum: informal, casual, and formal, where casual serves as an explicit intermediate state that clarifies supervision signals. Based on this framework, we introduce 3LF, a dataset providing parallel supervision across all three levels. Training on 3LF substantially reduces informal-to-formal failures and improves alignment with human perception. For example, GPT-4.1-nano improves from 0.06 to 0.88 F1 in the informal-to- formal direction despite 3LF being significantly smaller than GYAFC. We further demonstrate that these gains cannot be reproduced through in-context learning alone and provide qualitative analyses of ambiguity-driven errors and meaning distortions. Overall, our findings demonstrate how supervision design shapes stylistic alignment and highlight the importance of alignment-aware benchmark construction in controllable text generation.

[20] SURGENT: A Surgical Multi-Agent Assistance System Across the Perioperative Workflow cs.CL | cs.AIPDF

Dongsheng Shi, Yue Li, Xin Yi, Yongyi Cui, Huawei Feng

TL;DR: SURGENT是一个面向围手术期工作流程的外科多智能体辅助系统，旨在解决现有大型语言模型在医疗应用中的局限性。它结合了思维树规划器、多部门协作智能体，并利用临床指南和生物医学文献进行检索增强推理，通过新颖的记忆设计管理患者长期历史和短期工作摘要。

Details

Motivation: 现代外科护理的复杂性需要智能系统来整合大量患者记录、支持协作决策，并在整个围手术期工作流程中提供透明、可审计的推理。现有基于网络的大型语言模型存在输入长度限制、记忆管理不完整和可追溯性有限等关键缺陷，不适用于外科应用。

Result: 在病例分析、手术计划模拟、安全监测、并发症风险评估和康复指导这五个关键围手术期任务上的实验评估表明，SURGENT在性能上超越了基线大型语言模型和现有的医疗多智能体框架，其生成的建议与患者病史更吻合。消融研究进一步凸显了DeepSeek作为本地可部署骨干模型的优势，支持无需依赖中心化服务的隐私保护部署。

Insight: 论文宣称的创新点包括：结合思维树规划与多智能体协作的架构设计；管理长期患者历史和短期工作摘要的新型记忆机制；利用检索增强生成整合临床指南和文献的推理方法。从客观角度看，其将多智能体系统与特定领域（外科）工作流程深度结合，并强调隐私保护的本地部署方案，是值得借鉴的实用化创新方向。

Abstract: The intricate nature of modern surgical care necessitates intelligent systems that can synthesize extensive patient records, support collaborative decision-making, and provide transparent, auditable reasoning across the entire perioperative workflow. Although web-based Large Language Models (LLMs) possess advanced reasoning capabilities, they are ill-equipped for surgical applications due to critical limitations: input length constraints, incomplete memory management, and limited traceability. To address this issue, we present SURGENT, a surgical multi-agent assistance system that combines a Tree-of-Thought planner, multi-department collaboration agents, and retrieval-augmented reasoning with clinical guidelines and biomedical literature. SURGENT features a novel memory design that manages both long-term patient histories and short-term working summaries, enabling more complete, contextualized, and consistent reasoning. Experimental evaluations across five key perioperative tasks - case analysis, surgical plan simulation, safety monitoring, complication risk assessment, and rehabilitation guidance - show that SURGENT outperforms baseline LLMs and existing medical multi-agent frameworks, yielding recommendations more closely aligned with patient histories. Ablation studies further highlight the advantage of DeepSeek as a locally deployable backbone model, enabling privacy-preserving deployment without reliance on centralized services. These results position SURGENT as a practical and trustworthy advancement toward intelligent, equitable, and secure surgical assistance systems.

[21] Learning Design Skills as Memory Policies for Agentic Photonic Inverse Design cs.CLPDF

Shengchao Chen, Ting Shu, Sufen Ren

TL;DR: 该论文提出SkillPCF，一个用于光子晶体光纤逆向设计的闭环智能体框架。它将设计过程构建为记忆策略学习问题，结合了物理引导的记忆技能库、强化学习的技能选择和基于模拟器的技能演化。

Details

Motivation: 解决光子晶体光纤逆向设计中候选几何结构需满足耦合光学目标且电磁仿真成本高昂的挑战，现有方法缺乏在迭代试验中积累可重用设计知识的能力。

Result: 在包含479条专家交互轨迹和553个依赖记忆的评估查询的真实数据集上实验表明，SkillPCF在实际仿真预算下实现了更强的设计质量与效率权衡，优于多种LLM骨干和经典基线方法。

Insight: 创新点在于将逆向设计构建为记忆策略学习问题，通过物理引导的技能库和闭环演化积累可重用知识；其提出的记忆技能学习范式对物理感知的逆向设计具有普适性。

Abstract: Photonic crystal fiber (PCF) inverse design remains challenging because candidate geometries must satisfy coupled optical targets under expensive electromagnetic simulation. Existing pipelines improve surrogate prediction or one-shot parameter recommendation, but they do not accumulate reusable design knowledge across iterative trials. We formulate PCF inverse design as a memory-policy learning problem and propose SkillPCF, a closed-loop agent framework that combines a physics-guided memory skill bank, reinforcement-learned skill selection, and simulator-grounded skill evolution. We further construct a real-world dataset with 479 expert interaction traces (2,507 spans) and 553 memory-dependent evaluation queries covering dispersion engineering, loss optimization, and multi-objective design. Experiments across multiple LLM backbones and classical baselines show that SkillPCF achieves stronger design-quality and efficiency trade-offs under practical simulation budgets, demonstrating the effectiveness of our proposed memory-skill learning paradigm for physics-aware PCF inverse design.

[22] FinGuard: Detecting Financial Regulatory Non-Compliance in LLM Interactions cs.CLPDF

Huaixia Dou, Jie Zhu, Minghao Wu, Shuo Jiang, Junhui Li

TL;DR: 本文提出FinGuard，一个用于检测大语言模型（LLM）在金融服务交互中违反金融监管合规性的系统。通过一个直接从监管文档出发的流程，构建了金融合规风险分类体系并合成了训练数据，创建了首个金融监管合规检测基准FinGuard-Bench，并基于Qwen3-8B训练了FinGuard模型。

Details

Motivation: 现有的大语言模型安全防护模型（guard models）基于通用的危害分类体系，忽视了基于具体金融监管规定的违规行为，而单个不合规的交互可能使金融机构面临监管处罚和直接损害。

Result: 在FinGuard-Bench基准测试中，FinGuard显著优于所有基线模型，包括专用的防护模型和更大的通用LLM（如Qwen3.5-397B-A17B和GPT-5.1），达到了SOTA水平。

Insight: 创新点在于提出了一种直接从监管文档出发、无需预定义违规类别的流程来构建合规风险分类和训练数据，从而实现了对特定领域（金融）监管合规性的精准检测。模型还通过监督微调和自博弈强化学习进行训练，并能仅使用政策文档适应未见过的机构特定政策，同时保持了通用的安全能力。

Abstract: As large language models (LLMs) are increasingly deployed in financial services, a single non-compliant interaction can expose institutions to regulatory penalties and direct consumer harm. Existing guard models are built around general harm taxonomies and overlook violations grounded in specific financial regulations. We address this gap with a regulation-driven pipeline that operates directly on regulatory documents, inducing a financial compliance risk taxonomy and synthesizing grounded training data without any predefined violation categories. Instantiating the pipeline on Chinese financial regulations, we release \textbf{FinGuard-Bench}, to our knowledge the first benchmark for financial regulatory compliance detection, with expert-annotated labels at both the query and response levels. We further train \textbf{FinGuard}, a financial compliance detection model built on Qwen3-8B and trained on the regulation-grounded data via supervised fine-tuning and self-play reinforcement learning. On FinGuard-Bench, FinGuard substantially outperforms all baselines, including dedicated guard models and much larger general-purpose LLMs such as Qwen3.5-397B-A17B and GPT-5.1. Furthermore, FinGuard also preserves general safety capabilities and adapts to unseen institution-specific policies using policy documents alone. We will publicly release the code, prompts, and resources used in this work on GitHub.

[23] Adaptive Interviewing for Persona Simulation in LLMs: Evidence-Grounded Reasoning Improves Decision Alignment cs.CL | cs.AIPDF

Ruoxi Su, Yuhan Liu, Jingyu Hu

TL;DR: 本文提出了一种自适应访谈框架，通过结构化三阶段对话（核心问题、动态追问和综合人格摘要）来收集与人物角色相关的信息，以改进大型语言模型（LLMs）对特定个体决策的模拟。研究发现，自适应访谈主要作为一种选择性证据锚定机制：在完整访谈中，约40%的预测融入了追问证据，且这些基于追问证据的预测比仅基于核心问题的预测更准确（45.5% vs. 39.3%）。

Details

Motivation: 当前LLMs在模拟特定个体决策时面临挑战，因为人物角色信息通常以静态描述提供，缺乏个体决策所需的价值观、经验和情境线索。

Result: 在道德困境场景中，基于完整访谈对话的预测准确率（45.5%）高于仅基于核心问题回答的预测（39.3%），但并非所有访谈都能提升准确性，改进仅发生在模型实际将决策锚定于用户特定证据时。

Insight: 创新点在于提出自适应访谈框架作为动态证据收集方法，强调仅提供丰富人物角色上下文不足够，关键在于模型必须主动利用访谈中获取的用户特定证据进行推理，这为提升LLMs的决策对齐提供了新思路。

Abstract: Accurately simulating the decisions of a specific individual remains challenging for large language models (LLMs), partly because persona information is often provided as static descriptions that miss the values, experiences, and contextual cues needed for individual-level decision simulation. We propose an adaptive interview framework that gathers persona-relevant information through a structured three-stage dialogue: core questions, dynamic follow-ups, and a synthesized personality summary. Using the resulting interview transcripts, we evaluate whether LLMs can simulate participants’ decisions in moral dilemma scenarios. We compare three conversational contexts – Core-10 responses, the full interview dialogue, and a summarized persona representation. We find that adaptive interviewing functions less as a uniform accuracy booster and more as a selective grounding mechanism: follow-up-derived evidence is incorporated in around 40% of full-interview traces, and these follow-up-grounded predictions are more accurate than core-only grounded ones (45.5% vs. 39.3%). These findings highlight that richer persona context alone is insufficient: improvements arise only when models actually ground their decisions in user-specific evidence.

[24] Comparative Evaluation of Machine Translation Systems on Images with Text cs.CLPDF

Blai Puchol, Sergio Gómez González, Miguel Domingo, Francisco Casacuberta

TL;DR: 本文对图像文本机器翻译系统进行了比较评估，比较了三种主要范式：分离文本检测、识别和翻译的模块化流水线；能够联合处理图像和文本的多模态大语言模型（MLLMs）；以及直接生成翻译后图像的端到端模型Translatotron-V。实验结果表明，MLLMs取得了最佳整体性能。

Details

Motivation: 研究动机在于评估和比较计算机视觉与自然语言处理交叉领域（即图像文本翻译任务）中不同技术范式的性能。

Result: 在多语言平行数据集上的实验表明，模块化流水线优于端到端方法，而多模态大语言模型（MLLMs）在BLEU、chrF和TER指标上取得了最佳整体性能，展现了卓越的灵活性和上下文理解能力。

Insight: 论文的创新点在于对图像文本翻译这一交叉任务进行了系统性的范式比较。客观来看，其核心洞察在于验证了多模态联合推理（MLLMs）在该任务上的优越性，为未来在多语言场景下整合视觉理解和语言生成的研究提供了坚实基础。

Abstract: This work presents a comparative evaluation of machine translation systems applied to images containing textual information, a task that lies at the intersection of computer vision and natural language processing. The study compares three main paradigms: modular pipelines that separate text detection, recognition, and translation; multi-modal large language models (MLLMs) capable of processing both image and text jointly; and an end-to-end model, Translatotron-V, which directly generates translated images. The modular systems employ state-of-the-art OCR (docTR) combined with multilingual LLMs such as Llama and EuroLLM, while the evaluated MLLMs include different configurations of Gemini 2.5. Experiments were conducted on parallel multilingual datasets covering multiple language pairs, with evaluation based on BLEU, chrF, and TER metrics. The results show that modular pipelines outperform the end-to-end approach, while MLLMs achieve the best overall performance, demonstrating superior flexibility and contextual understanding. These findings underscore the effectiveness of multi-modal reasoning for image-to-text translation and provide a solid foundation for future research on integrating visual understanding and language generation in multilingual settings.

[25] PhoneWorld: Scaling Phone-Use Agent Environments cs.CL | cs.AI | cs.LGPDF

Zhengyang Tang, Yuxuan Liu, Xin Lai, Junyi Li, Pengyuan Lyu

TL;DR: PhoneWorld是一个可扩展的管道，能够将真实的GUI轨迹和截图转化为可控的手机使用环境、可执行任务、自动验证器和训练数据，从而解决手机使用代理环境中可扩展环境构建的瓶颈问题。

Details

Motivation: 现有手机代理基准测试在评估方面取得了进展，但缺乏可扩展的方法来构建大量新的手机使用环境，因此需要一种能够自动化生成可控环境的方法。

Result: 在固定训练预算下，使用PhoneWorld监督替换辅助AndroidWorld语料库中的10K步，显著提升了多个基准测试的性能：HYMobileBench提高17.7分，AndroidControl提高6.0分，AndroidWorld提高14.7分，PhoneWorld提高52.5分。

Insight: PhoneWorld通过真实轨迹自动恢复屏幕重要性、连接关系、状态变化和用户目标验证，从而构建可运行的模拟Android应用，实现了从手动构建单个基准测试到规模化生成手机使用环境的转变。

Abstract: A central bottleneck for phone-use agents is that controllable, reproducible environments covering real mobile behavior are hard to build at scale. Existing mobile-agent benchmarks have made important progress on evaluation, but they do not by themselves provide a scalable way to construct many new phone-use environments. We present PhoneWorld, a reusable pipeline that converts real GUI trajectories and screenshots into controllable phone-use environments, executable tasks, automatic verifiers, and training rollouts. Rather than hand-building one mobile benchmark at a time, PhoneWorld uses real trajectories to recover which screens matter, how screens connect, which interactions must change environment state, and which user goals admit automatic verification. From these signals, it builds runnable mock Android apps backed by read-only app content and mutable state, then derives executable tasks, rule-based verifiers, and training rollouts from the same environments. In its current instantiation, PhoneWorld covers 34 apps across 16 domains, spanning common consumer mobile behaviors such as search, browsing, shopping, booking, media, and social interaction. Under a fixed training budget, replacing 10K steps from an auxiliary AndroidWorld corpus in an AndroidWorld-based baseline with broad PhoneWorld supervision improves all four evaluation benchmarks at once, raising HYMobileBench by 17.7 points, AndroidControl by 6.0 points, AndroidWorld by 14.7 points, and PhoneWorld by 52.5 points. We then study two additional scaling questions: increasing the amount of PhoneWorld supervision strongly improves PhoneWorld performance, and under a fixed PhoneWorld budget, expanding app coverage yields even larger gains. Overall, PhoneWorld shifts the focus from building one mobile benchmark at a time to scaling the supply of phone-use environments themselves.

[26] On Asymmetric Optimization of Reasoning and Perception in Vision-Language Model Post-Training cs.CL | cs.CVPDF

Xueqing Wu, Yu-Chi Lin, Kai-Wei Chang, Nanyun Peng

TL;DR: 本文研究了视觉语言模型后训练中感知与推理优化不对称的问题，通过设计两个解耦感知与推理的合成任务进行诊断分析。研究发现，监督微调（SFT）中的不对称源于思维链监督的token不平衡，而强化学习（RL）中的不对称则源于奖励耦合；通过动态重加权损失或添加感知感知奖励等干预措施，可以有效缓解这种不平衡，提升端到端性能。

Details

Motivation: 当前视觉语言模型的后训练显著提升了推理能力，但对感知能力的提升相对有限，这成为端到端视觉推理的瓶颈；本文旨在探究这种感知与推理优化不对称的成因。

Result: 在诊断框架下，通过动态重加权损失，端到端性能最高提升18.2%；通过添加感知感知奖励，端到端准确率最高提升6.0%，即使使用可靠的替代奖励也能获得3.2个百分点的增益。

Insight: 创新点在于提出了一个解耦感知与推理的诊断框架，揭示了不同训练范式下不对称优化的具体机制（SFT的token不平衡与RL的奖励耦合），并提出了针对性的平衡干预措施（如动态损失重加权和感知感知奖励），为优化视觉语言模型的端到端性能提供了具体方向。

Abstract: Post-training has greatly improved reasoning in frontier vision-language models, yet its gains for perception remain comparatively limited, creating a bottleneck for end-to-end visual reasoning. To investigate this gap, we introduce a controlled diagnostic framework with two synthetic tasks that disentangle perception from reasoning. Our analysis reveals a consistent perception-reasoning asymmetry: posttraining improves reasoning more substantially than perception, though the underlying mechanism differs by training paradigm. For supervised fine-tuning (SFT), this asymmetry stems from token imbalance in chain-of-thought supervision, where perception occupies fewer tokens and thus receives a weaker training signal. Dynamically reweighting the loss mitigates this imbalance and boosts end-to-end performance by up to 18.2. For reinforcement learning (RL), the asymmetry instead arises from reward coupling: outcome rewards correlate more strongly with reasoning than with perception, weakening the signal for perception learning. Adding a perception-aware reward alleviates the imbalance and improves end-to-end accuracy by up to 6.0; even without groundtruth perception rewards, a reliable surrogate reward provide useful signal, yielding gains of 3.2 points. Together, our results comprehensively diagnose asymmetric optimization and suggest concrete interventions to balance perception and reasoning.

Yeyong Yu, Wenya Hu, Xing Wu, Quan Qian

TL;DR: 本文提出了一种名为MaterEval的知识增强偏好信号框架，旨在解决材料发现中从海量候选集中进行可靠评估的瓶颈问题。该框架通过为同一候选材料生成两种评估——基于专家规则的有依据判断和移除规则的盲目猜测，并将它们配对作为偏好数据，来引导通用大语言模型从直觉判断转向基于明确证据的可靠评估。

Details

Motivation: 随着候选材料生成和高通量实验技术的进步，材料发现的主要瓶颈正从性能预测转向对海量候选集的可靠评估。通用大语言模型缺乏材料科学领域的特定评估标准，难以做出可靠的判断。

Result: 以高熵合金评估为案例研究，结果表明，在不依赖外部检索、仅利用模型内部能力的情况下，小型开源大语言模型在准确性、结论一致性和证据区分度方面取得了显著提升，其性能接近基于规则的闭源大语言模型。

Insight: 核心创新在于将专家规则系统地转化为可学习的偏好信号，从而为自主材料发现循环提供了一个低成本、可部署的评估模块。此外，提出的快慢推理方案将大规模快速筛选与对小部分子集的深度审查解耦，平衡了吞吐量、成本和可靠性。

Abstract: As candidate generation and high-throughput experimentation advance, the primary bottleneck in materials discovery is shifting from property prediction to making reliable evaluations among massive candidate sets. We propose a Knowledge-Augmented Preference Signals Framework, MaterEval, that automatically produces, for the same candidate, two evaluations: an informed judgment that follows expert rules and provides supporting evidence, and a rule-removed blind guess. By pairing the two evaluations as preference data, we guide general-purpose large language models (LLMs), originally lacking materials-specific criteria, from intuitive judgment toward reliable evaluation supported by explicit evidence. To balance throughput, cost, and reliability, we further introduce a fast-slow reasoning scheme that decouples large-scale rapid screening from in-depth review on a small subset. Using high-entropy alloy (HEA) assessment as a case study, we show that, without external retrieval and relying solely on internalized capabilities, small open-source LLMs achieve substantial gains in accuracy, conclusion consistency, and evidence discrimination, approaching the performance of rule-based closed-source LLMs. These results demonstrate that expert rules can be systematically transformed into learnable preference signals, enabling a low-cost and deployable evaluation module for autonomous materials discovery loops.

[28] Source-Grounded Semantic Reinforcement Learning for Low-Resource Target-Language Generation cs.CL | cs.AIPDF

Zeli Su, Ziyin Zhang, Zewei Pan, Zhou Liu, Dingcheng Huang

TL;DR: 本文提出了一种名为源语言语义强化学习（SG-SRL）的资源利用框架，用于解决低资源目标语言生成任务中平行数据稀缺的问题。该方法利用丰富的源语言单语数据，通过一个跨语言语义奖励模型（如重排序器）进行无参考强化学习，以提升生成文本的语义相关性。虽然这会导致冗长奖励攻击，但后续通过一个小型平行语料库进行轻量级恢复阶段，可以恢复流畅性、简洁性和任务格式，同时保留语义增益。

Details

Motivation: 低资源目标语言生成通常受限于稀缺的平行数据，而高资源源语言单语数据丰富但难以通过标准监督微调有效利用，因此需要一种方法将源语言单语数据转化为跨语言语义监督。

Result: 在中文到泰语的生成实验中，SG-SRL相比冷启动监督微调（SFT）在语义基础和事实覆盖方面有所提升。额外分析表明，该方法在长文本迁移和基于藏语嵌入的奖励设置中具有泛化能力，且基于编码器的语义奖励可以在低资源语言场景中替代基于LLM的重排序器。

Insight: 创新点在于将源语言单语数据通过跨语言语义奖励模型转化为强化学习信号，并结合轻量级恢复阶段解决奖励攻击问题，从而在低资源设置下有效利用单语数据提升生成质量；客观来看，该方法提供了一种实用的资源利用策略，通过分离语义学习和格式恢复，平衡了语义相关性与文本质量。

Abstract: Low-resource target-language generation is often limited by scarce parallel data, while high-resource source-language monolingual data is abundant but difficult to use with standard supervised fine-tuning. We propose Source-Grounded Semantic Reinforcement Learning (SG-SRL), a resource-utilization framework that converts source-language monolingual data into cross-lingual semantic supervision for target-language generation. SG-SRL performs reference-free reinforcement learning (RL) on source-language data using a cross-lingual semantic reward model, instantiated by a cross-lingual reranker that scores the semantic relevance between the source input and the target-language generation. While this induces severe verbosity-based reward hacking, a lightweight recovery stage using a small parallel corpus restores fluency, conciseness, and task format while preserving the semantic gains. Experiments on Chinese-to-Thai generation show that SG-SRL improves semantic grounding and factual coverage over cold-start SFT. Additional analyses on long-form transfer and Tibetan embedding-based rewards clarify the generalization behavior of SG-SRL and show that an encoder-based semantic reward can substitute for an LLM-based reranker in a realistic low-resource language setting.

[29] LiteCoder-Terminal: Scaling Long-Horizon Terminal Environments for Learning Language Agents cs.CLPDF

Xiaoxuan Peng, Kaiqi Zhang, Xinyu Lu, Boxi Cao, Yaojie Lu

TL;DR: 本文介绍了LiteCoder-Terminal-Gen，一个零依赖的合成流水线，用于直接从领域规范自主生成可执行且可验证的终端训练环境。基于此框架，作者构建了两个大规模资源：包含10个领域11,255条专家轨迹的SFT数据集，以及包含602个可验证环境的RL数据集，用于轨迹级偏好优化。在SFT数据集上对Qwen系列模型进行监督微调得到的智能体显著优于其基础版本，并且在Terminal Bench基准上取得了优异的性能。

Details

Motivation: 当前训练能够掌握终端环境的语言智能体存在瓶颈，主要依赖于抓取的外部代码库，这限制了领域多样性、环境可控性以及针对特定能力缺陷的训练。

Result: 在Terminal Bench 1.0、2.0和Pro基准上，其32B变体分别达到了29.06%、18.54%和34.00%的pass@1性能。在其RL环境上应用DMPO（直接多轮偏好优化）带来了额外的性能提升。

Insight: 核心创新在于提出了一个完全合成的、可执行的环境生成框架，为掌握复杂的真实世界命令行工作流程提供了可扩展且可验证的监督信号。这为解决训练数据来源的瓶颈问题提供了一种新思路。

Abstract: Mastering terminal environments requires language agents capable of multi-step planning, feedback-grounded execution, and dynamic state adaptation. However, training such agents is currently bottlenecked by a reliance on scraped external repositories, which limits domain diversity, environment controllability, and the targeting of specific capability deficits. We introduce LiteCoder-Terminal-Gen, a zero-dependency synthesis pipeline that autonomously generates executable and verifiable terminal training environments directly from domain specifications. Using this framework, we construct two large-scale resources: LiteCoder-Terminal-SFT, comprising 11,255 expert trajectories across 10 domains, and LiteCoder-Terminal-RL, featuring 602 verifiable environments for trajectory-level preference optimization. Supervised fine-tuning of Qwen-family models on our SFT dataset yields agents that significantly outperform their base counterparts. Notably, our 32B variant achieves 29.06%, 18.54%, and 34.00% pass@1 on Terminal Bench 1.0, 2.0, and Pro, respectively. Furthermore, applying Direct Multi-turn Preference Optimization (DMPO) on our RL environments yields additional performance gains. These results systematically demonstrate that fully synthetic, executable environments offer a scalable and verifiable supervision signal for mastering complex, real-world command-line workflows.

[30] GAPD: Gold-Action Policy Distillation for Agentic Reinforcement Learning in Knowledge Base Question Answering cs.CLPDF

Xin Sun, Jianan Xie, Zhongqi Chen, Qiang Liu, Shu Wu

TL;DR: 本文提出GAPD（Gold-Action Policy Distillation）框架，用于知识库问答（KBQA）中的智能体强化学习。该方法通过黄金动作策略蒸馏，将黄金逻辑形式转换为可执行动作序列，为基于结果的强化学习提供密集的令牌级指导，从而改善中间动作的监督。

Details

Motivation: 当前基于强化学习的KBQA系统主要优化最终答案的稀疏奖励，导致中间动作错误监督不足，限制了在逻辑形式标注基准上的性能提升。

Result: GAPD在WebQSP、GrailQA和GraphQ三个基准测试上均超越了当前最先进（SOTA）方法。

Insight: 创新点在于引入MID-ANCHOR MATCHING机制，通过学生探索和黄金执行中到达的中间实体作为状态锚点，对齐学生与黄金状态，并利用停止梯度的教师策略进行令牌级蒸馏，从而增强动作序列的监督信号。

Abstract: Reinforcement learning (RL) is a natural fit for agentic knowledge base question answering (KBQA), where a model must issue executable actions, observe knowledge-base feedback, and eventually return an answer. However, current RL-based KBQA systems mainly optimize sparse rewards from the final answer, leaving intermediate action errors weakly supervised. This is especially limiting for logical-form annotated KBQA benchmarks: gold logical forms can be converted into executable action sequences, but existing pipelines use them mainly for warm-start data construction rather than for on-policy RL updates. We propose GAPD, a training-time Gold-Action Policy Distillation framework that adds dense token-level guidance to outcome-based RL. To align gold actions with on-policy student rollouts, GAPD uses MID-ANCHOR MATCHING: it treats the intermediate entities reached during student exploration and gold execution as state anchors, and matches student states to gold states through these explored entity sets. The current policy conditioned on this aligned gold action serves as a stop-gradient teacher, whose token distribution is distilled back to the ordinary student policy over generated action-token spans. GAPD consistently surpasses the current state of the art on WebQSP, GrailQA, and GraphQ.

[31] World Models in Words: Auditing Physical State-Transition Commitments in Vision-Language Models cs.CLPDF

Emmanuelle Bourigault

TL;DR: 该论文提出了World Models in Words（WMW）评估框架，用于审计视觉语言模型（VLMs）在物理场景推理中的语言表达物理承诺。通过要求模型生成包含初始状态、状态转换、结果状态和答案的类型化轨迹，并利用混合验证器检查模式有效性、状态基础、转换一致性和答案-轨迹兼容性，揭示仅基于最终答案评估所忽略的模型物理推理缺陷。

Details

Motivation: 当前对VLMs的评估大多仅关注最终答案的正确性，而忽略了模型是否真正感知了正确对象、表示了正确的物理状态、预测了合理的状态转换，或仅因错误原因选择了正确答案。这掩盖了模型在物理推理过程中的潜在失败。

Result: 在受控和外部物理推理示例上评估了多个VLMs。WMW揭示了仅答案评估所遗漏的失败：中等级别模型中35%的正确答案背后是物理上无效的轨迹。验证器引导的重新排序在不牺牲答案准确性的情况下恢复了高达7个百分点的轨迹有效性，而轨迹级偏好调优将隐藏的不一致性相对减少了41%。

Insight: 创新点在于从评估最终答案转向评估模型生成的可解释推理轨迹（类型化状态转换链），并设计了混合验证器进行细粒度错误分类（如对象、关系、力、转换、时间、单位/尺度和忠实性错误）。这提供了一个可复用的协议，用于衡量VLM所陈述的物理世界模型是否与其答案在逻辑上同时成立，而不仅仅是另一个最终答案的物理基准测试。

Abstract: Vision-language models (VLMs) are increasingly used to answer questions about physical scenes, yet most evaluations reduce performance to a final answer. This hides whether the model perceived the right objects, represented the right physical state, predicted a plausible transition, or merely selected the right option for the wrong reasons. We introduce \wmw, an evaluation framework for auditing the \emph{language-expressed physical commitments} of VLMs. Instead of scoring only $I,q\mapsto a$, we ask models to produce a typed trace $I,q\mapsto(s_0,Δs,s_1,a)$: an initial state, a state transition, a resulting state, and an answer. A hybrid verifier then checks schema validity, state grounding, transition consistency, and answer-trace compatibility, yielding typed error labels such as object, relation, force, transition, temporal, unit/scale, and faithfulness errors. We release \tracebank, a controlled trace resource with \nSeed schema- and recomputation-validated synthetic scenarios across \nFamilies physics families, \nPairs minimally perturbed contrastive preference pairs, verifier code, audit guidelines, and model outputs. We evaluate \nModels VLMs on both controlled and external physical-reasoning examples. \wmw reveals failures that answer-only evaluation misses: 35% of correct answers from mid-tier models are backed by physically invalid traces. Verifier-guided reranking recovers up to 7 percentage points of trace validity without sacrificing answer accuracy, and trace-level preference tuning reduces hidden inconsistency by 41% relative. The contribution is not another final-answer physics benchmark, but a reusable protocol for measuring whether a VLM’s stated physical world can be true at the same time as its answer.

[32] Training Deliberative Monitors for Black-Box Scheming Detection cs.CL | cs.AI | cs.LGPDF

Aditya Sinha, Akshat Naik, Victor Gillioz, Simon Storf, Kilian Merkelbach

TL;DR: 本文提出了一种名为‘审议式监控器’的黑盒方案检测方法，旨在通过仅观察智能体行为轨迹来检测其潜在的恶意或破坏性行为，而无需访问其内部推理过程或模型激活。该方法利用前沿大模型作为教师，根据恶意行为规范生成结构化推理，并通过独立法官筛选高质量样本，最终通过监督微调和强化学习将其蒸馏为小型开源模型。

Details

Motivation: 随着自主智能体执行现实任务能力的增强，区分其恶意行为与良性任务执行成为关键的控制问题。现有监控器依赖于思维链访问、内部激活或提示前沿模型，这些方法在部署中可能不可用、不可靠或成本高昂。

Result: 在五个数据集上训练，并在六个分布外智能体错位基准上评估。使用Qwen3.5-27B应用该方法，其性能优于所有低成本前沿模型（如Gemini 3.1 Flash-Lite、GPT-5.4 Nano、Claude Haiku 4.5）以及Gemini 2.5 Pro作为提示监控器，同时边际推理成本更低。虽然更强的前沿模型（如Gemini 3.1 Pro、GPT-5.4、Claude Sonnet 4.6、Claude Opus 4.6）性能更高，但成本高出约16至34倍。多个训练后的监控器在评估的监控器中位于经验成本-性能帕累托前沿。

Insight: 创新点在于提出了一种仅基于行为的‘审议式监控器’，通过结构化推理蒸馏实现高效、低成本的恶意行为检测，为黑盒监控提供了实用的低误报率替代方案。该方法结合了监督学习和强化学习进行知识蒸馏，并利用独立法官进行样本筛选，提升了监控器的鲁棒性和泛化能力。

Abstract: As autonomous agents become more capable of performing real-world tasks, distinguishing scheming behavior from benign task pursuit may become a central AI control problem. Existing monitors often rely on chain-of-thought access or internal activations, or use prompted frontier models, all of which can be unavailable, unreliable or expensive in deployment. In this work, we study action-only deliberative monitors: smaller open-weight models trained to detect scheming and sabotage from agentic trajectories without accessing the monitored agent’s reasoning or model internals. Our method, inspired by deliberative alignment, uses a scheming specification to elicit structured rationales from a frontier teacher, filters them with a separate judge, and distills the highest-quality rationales into open-weight monitors with supervised fine-tuning and reinforcement learning. We train on five datasets, and evaluate across six out-of-distribution agentic misalignment benchmarks. We show that applying our method to Qwen3.5-27B yields higher performance than all low-cost frontier models as prompted monitors (Gemini 3.1 Flash-Lite, GPT-5.4 Nano, and Claude Haiku 4.5) and than Gemini 2.5 Pro, while also achieving lower marginal inference cost (token-metered USD per 1,000 evaluations). Stronger prompted frontier monitors (Gemini 3.1 Pro, GPT-5.4, Claude Sonnet 4.6, and Claude Opus 4.6) achieve higher performance but at roughly $16$–$34\times$ higher marginal inference cost. Several of our trained monitors are positioned on the empirical cost–performance Pareto frontier among the monitors we evaluate, providing practical low-cost, low-FPR alternatives to prompted frontier models.

[33] Spurious Prompts: Can Irrelevant Prompts Steer Large Language Models? cs.CLPDF

Pawel Batorski, Abtin Pourhadi, Jerzy Sarosiek, Przemyslaw Spurek, Paul Swoboda

TL;DR: 这篇论文研究了大型语言模型对与任务语义无关的提示（称为‘虚假提示’）的敏感性，发现这些无关提示能显著影响模型行为，甚至能提升模型在推理和问答任务上的性能，有时达到或超过标准提示方法。

Details

Motivation: 动机是探究大型语言模型是否会被与任务语义无关的提示所引导，从而揭示一种新的提示敏感性，即模型行为可能被无关内容系统性地操控。

Result: 在多个推理和问答基准测试中，使用参数规模从0.8B到27B的不同模型家族，虚假提示能提升性能，匹配或超越标准提示基线和任务感知的提示优化方法，并成功引导模型产生意外行为（如重复选择第一个答案或输出特定数字）。

Insight: 创新点在于首次系统性地证明了大型语言模型对语义无关提示的敏感性，并提出了一种简单的黑盒搜索方法来发现这些虚假提示，这揭示了模型行为可能被无关因素意外操控的风险，对提示工程和模型鲁棒性研究有重要启示。

Abstract: Large language models are highly sensitive to prompts, but this sensitivity is usually studied through task-relevant instructions, demonstrations, or reasoning cues. In this paper, we study a different form of prompt sensitivity: whether prompts that are semantically unrelated to the task can nevertheless steer model behavior. We call them spurious prompts and show their surprising efficacy. We also propose a simple black-box search procedure for discovering them. Across reasoning and question-answering benchmarks, using models ranging from 0.8B to 27B parameters and spanning three model families, we show that spurious prompts can improve performance, often matching or outperforming standard prompting baselines and task-aware prompt optimization. We further show that they can steer models toward unintended behaviors, such as repeatedly selecting the first answer option, producing incorrect answers, returning an even, prime or small number without explicitly instructing the model to do so. These findings reveal a new kind of prompt sensitivity: LLMs can be systematically steered by prompts that are unrelated to the task they are asked to solve. Our code is available at https://github.com/Batorskq/spurious

[34] Verifiable Rewards Beyond Math and Code: Lightweight Corpus-Grounded Process Supervision for Factual Question Answering cs.CLPDF

Shicheng Fan, Haochang Hao, Dehai Min, Weihao Liu, Philip S. Yu

TL;DR: 论文提出了一种名为CorVer（Corpus Verify）的轻量级、即插即用的过程监督奖励方法，用于提升知识密集型问答中事实准确性。该方法利用维基百科共现统计信息替代传统的神经验证器，为推理过程中的每个句子分配奖励，并通过简单对齐映射到词元级别。实验表明，在多个模型和基准测试中，CorVer能持续提升性能，且训练速度显著快于神经验证器基线。

Details

Motivation: 在知识密集型问答中应用强化学习以提高事实准确性时，面临奖励设计困境：响应级奖励监督粗糙，无法区分推理轨迹中的正确与错误陈述；而句子级奖励通常依赖昂贵的神经验证器、LLM评判器或知识验证流程，这些方法在RL规模下部署成本高，且对罕见实体事实的可靠性不足，而准确奖励信号对此尤为重要。

Result: 在涵盖六个指令调优模型（3B到14B）和五个QA基准的30个（模型，基准）单元中，CorVer在每个单元上都优于原始基线，在TriviaQA上平均提升+4.1个百分点。在可行的配置下，CorVer在20个单元中的18个上优于四个神经验证器基线，同时训练速度快4.8到8.4倍。

Insight: 创新点在于提出了一种基于语料库共现统计的轻量级过程奖励机制，替代了计算成本高且可能不可靠的神经验证器，实现了细粒度的句子级监督，并通过简单对齐映射到词元级优势，显著提升了训练效率和事实准确性，尤其在处理罕见实体时更具优势。

Abstract: Applying reinforcement learning to improve factual accuracy in knowledge-intensive question answering faces a reward design dilemma. Response-level rewards provide only coarse supervision and cannot distinguish correct from incorrect statements within a reasoning trace. Sentence-level alternatives offer finer-grained feedback, but typically rely on NLI verifiers, LLM judges, or knowledge-verification pipelines that are expensive to deploy at RL scale and often unreliable for rare-entity facts, where accurate reward signals are especially important. We propose CorVer (Corpus Verify), a lightweight, plug-in-ready process reward that replaces neural verifiers with a corpus-grounded signal derived from Wikipedia co-occurrence statistics. CorVer assigns sentence-level credit and maps it to token-level advantages via a simple alignment, requiring only a 0.5B extractor and a single corpus lookup per sentence. Across 30 (model, benchmark) cells spanning six instruction-tuned models (3B to 14B) and five QA benchmarks, CorVer improves over the raw baseline for every cell, with an average TriviaQA gain of +4.1 pp. It also outperforms four neural-verifier baselines in 18 of 20 cells under their feasible configurations, while training 4.8 to 8.4x faster.

[35] Teaching Language Models to Check Grounded Claim Factuality with Human Test-Taking Strategies cs.CL | cs.AIPDF

Yuxuan Ye, Raul Santos-Rodriguez, Edwin Simpson

TL;DR: 本文提出了一种基于人类应试策略的提示方法，用于提升大语言模型在基于检索的生成任务中进行事实性检查的能力。该方法将事实性检查构建为真假阅读理解任务，通过显式的应试策略引导模型推理，显著降低了推理成本，并在两个基准测试中取得了有竞争力的性能。此外，作者还训练了小语言模型来替代大语言模型，通过监督微调和自我修订机制，实现了低成本、可解释的事实性判断。

Details

Motivation: 现有的事实性检查方法存在不足：基于蕴含分类器的方法需要针对特定数据集调整阈值，而基于大语言模型的直接提示方法未能充分利用模型的推理能力。本文旨在通过模拟人类应试策略，更高效地引导大语言模型进行事实性检查，以提升其正确性评估能力。

Result: 在两个事实性基准测试上，该方法相比无引导的开放式推理减少了超过80%的token使用量，并取得了与更昂贵方法相竞争的性能，在其中一个基准上达到了新的SOTA水平。训练后的小语言模型在性能上与强基线相当，同时保持了低推理成本并生成支持性理由以增强可解释性。

Insight: 创新点在于将事实性检查形式化为阅读理解任务，并引入人类应试策略（如明确推理步骤）进行提示，这有效提升了推理效率。客观来看，通过监督微调和自我修订机制训练小语言模型来替代大语言模型，为低成本、可解释的事实性检查提供了可行的解决方案，具有实际应用价值。

Abstract: Grounded claim factuality checking is important for large language model (LLM) applications such as retrieval-augmented generation, as it helps users assess the correctness of generated outputs. Existing metrics using entailment classifiers require dataset-specific threshold tuning, while LLM-based approaches often use direct prompting, which underutilises the reasoning capabilities of LLMs. We address this by formulating grounded claim factuality checking as a true/false reading comprehension task and prompting LLMs with explicit test-taking strategies for efficient reasoning. Our method reduces token usage by over 80% compared to unguided open-ended reasoning, and achieves competitive performance to more expensive alternatives across two factuality benchmarks, setting a new state of the art on one. To further reduce inference cost, we train small language models (SLMs) to replace LLMs in the checking pipeline. Using supervised fine-tuning (SFT) and a self-revision mechanism, the SLMs learn to improve their factuality judgements. Experimental results show that the resulting SLMs perform on par with strong baselines, combining low inference costs with generating supporting rationales to support interpretability. Code and datasets will be released upon acceptance.

[36] User-Aware Active Knowledge Acquisition for Emotional Support Dialogue cs.CLPDF

Mufan Xu, Kehai Chen, Jiahao Hu, Xinchao Xu, Muyun Yang

TL;DR: 本文提出了一种名为用户感知主动知识获取（UKA）的无梯度主动对话学习框架，旨在提升情感支持对话系统对用户隐含需求的适应能力。该框架通过显式建模用户需求的不确定性，并将主动学习机制集成到知识获取和回复选择中，以更高效地探索和利用对话知识。

Details

Motivation: 现有情感支持对话方法难以高效获取和泛化相关对话知识，因为用户需求信号通常微弱、间接且需通过多轮交互才能明确。

Result: 在多个对话基准测试和模型架构上的实验表明，该方法在对话质量和用户对齐方面持续优于强基线模型。

Insight: 核心创新点是引入了基于心理理论的不确定性估计机制，使模型能够优先选择能引发更丰富用户反馈的回复，从而在训练中高效探索用户对齐的对话知识，并在测试时保持鲁棒性。

Abstract: Emotional support plays an important role in dialogue systems, and its success depends on adapting to a user’s evolving and implicit needs across multi-turn interactions while leveraging the strong reasoning capacity of large language models. However, since signals about user needs are often weak, indirect, and can only be disambiguated through multi-turn interaction, existing emotional support methods often struggle to acquire and generalize relevant conversational knowledge efficiently. To bridge this gap, we introduce User-Aware Active Knowledge Acquisition (UKA), a gradient-free active dialogue learning framework that explicitly represents uncertainty about user needs and incorporates active learning into both knowledge acquisition and response selection.We propose a Theory-of-Mind uncertainty estimation mechanism that allows the model to prioritize responses, thereby eliciting more informative user feedback. UKA is capable of efficiently exploring user-aligned conversational knowledge during training while maintaining robustness at test time. Experiments across multiple dialogue benchmarks and model architectures demonstrate that our approach consistently outperforms strong baselines in dialogue quality and user alignment.

[37] Multi-Legal-Bench: Evaluating LLMs on Legal Reasoning Across Jurisdictions, Languages, and Legal Traditions cs.CL | cs.AIPDF

Volodymyr Ovcharov

TL;DR: 本文提出了Multi-Legal-Bench，首个跨司法管辖区的法律基准测试，用于评估大语言模型在六个国家（乌克兰、法国、荷兰、波兰、捷克、立陶宛）、四种语系和1.34亿份法院判决上的法律推理能力。该基准定义了五项任务，并评估了多个前沿LLM，揭示了任务依赖的小样本效应、模型性能随任务和司法管辖区变化的特性、跨语言小样本迁移不遵循语言邻近性，以及分词器效率对跨语言准确性的影响有限等关键发现。

Details

Motivation: 现有的法律NLP基准大多只评估单一语言或聚合了不同司法管辖区根本不同的任务，使得跨语言比较无法进行。因此，需要创建一个能够跨司法管辖区、语言和法律传统进行一致评估的基准。

Result: 在零样本和3样本提示下评估了7个前沿LLM及4个中小型模型。结果显示：任务依赖的小样本效应在所有司法管辖区都复现；没有单一模型在所有任务和司法管辖区中占主导；跨语言小样本迁移不遵循语言邻近性，标签集对齐比语系更能预测迁移质量；分词器效率（tokenizer fertility）对跨语言准确性的预测不显著。

Insight: 主要创新点在于构建了首个跨司法管辖区的法律基准，其任务-司法管辖区矩阵设计（5x6，30个单元格中填充20个）允许进行稀疏但有意义的比较。客观分析认为，其发现挑战了跨语言迁移中语言邻近性的传统假设，并强调了任务定义和标签集对齐的重要性，以及模型架构和预训练数据相对于分词器效率的主导作用。

Abstract: Legal NLP benchmarks overwhelmingly evaluate a single language or aggregate tasks that differ fundamentally across jurisdictions, making cross-lingual comparison impossible. We introduce Multi-Legal-Bench, the first cross-jurisdictional legal benchmark that evaluates identical tasks across six countries (Ukraine, France, Netherlands, Poland, Czech Republic, Lithuania), four language families, and 134 million court decisions. The benchmark defines five tasks court-type classification, judgment form classification, case-outcome prediction, legal norm extraction, and cause category prediction mapped to structured metadata from national court registries, forming a deliberately sparse 5x6 task-jurisdiction matrix (20 of 30 cells filled). We evaluate 7 frontier LLMs under zero-shot and 3-shot prompting via AWS Bedrock, with 4 additional small/medium models (3-12B) for scaling analysis. Our results reveal that: (1) task-dependent few-shot effects discovered in Ukrainian replicate across all jurisdictions; (2) no single model dominates any language rankings shift with both task and jurisdiction; (3) cross-lingual few-shot transfer does not follow language proximity: UA->FR (Romance, -2.1 pp) transfers better than UA->PL (Slavic, -13.7 pp), with label-set alignment predicting transfer quality better than language family; and (4) tokenizer fertility, despite a 2.3x spread, does not significantly predict cross-lingual accuracy (r=-0.27, p=0.14), suggesting that model architecture and pretraining data dominate tokenizer efficiency. We release all data, prompts, and model predictions.

[38] ActTraitBench: Quantifying the Knowledge-Decision Gap in Large Language Models via Human-Grounded Behavioral Validation cs.CLPDF

Yutong Yang, Chenxi Miao, Weikang Li, Yunfang Wu

TL;DR: 论文提出了ActTraitBench，一个基于人类数据的评估框架，用于量化大型语言模型（LLMs）在模拟人物角色时存在的知识-决策差距（G_KD）。该框架通过建立心理测量维度与行为范式的一一映射，并应用分布校准技术，揭示了主流LLMs普遍存在的行为与自我报告不一致的问题。此外，论文还引入了链式认知对齐（CoCA）方法，作为一种即插即用的推理时干预策略，以缓解这种差距。

Details

Motivation: 现有基准在衡量LLMs模拟人物角色时，其明确自我报告与隐含行为决策之间的不一致性（即知识-决策差距）方面存在不足，主要受限于结构效度低、多维度纠缠以及基于LLM评估的分布偏差。

Result: 在14个主流LLMs上的实验表明，知识-决策不对称性普遍存在，更大、能力更强的模型往往表现出更强的行为偏离，尽管其自我报告高度一致。CoCA方法在具备推理能力的前沿模型中改善了对齐效果，但也暴露了较小架构的明显能力限制。

Insight: 创新点在于提出了一个基于人类实证数据、具有高结构效度的评估框架ActTraitBench，并引入了分布校准程序来对齐评分分布；同时，提出的CoCA作为一种推理时干预，为改善LLMs的行为对齐提供了可借鉴的思路。

Abstract: While Large Language Models (LLMs) can convincingly simulate personas in explicit self-reports, they often deviate in implicit behavioral decisions, revealing a substantial Knowledge-Decision Gap ($G_{\text{KD}}$). Existing benchmarks struggle to measure this asymmetry due to limited construct validity, multi-dimensional entanglement, and distributional biases in LLM-based evaluation. To address these issues, we propose ActTraitBench, a human-grounded evaluation framework for measuring personality consistency in LLMs. Grounded in empirical human data, ActTraitBench establishes one-to-one mappings between psychometric facets and behavioral paradigms, and applies a Distributional Calibration via Quantile Mapping procedure to align LLM-judge score distributions with human norms. Experiments on 14 mainstream LLMs reveal a pervasive knowledge-decision asymmetry, where larger and more capable models often exhibit stronger behavioral divergence despite highly consistent self-reports. To mitigate this gap, we further introduce the Chain of Cognitive Alignment (CoCA), a plug-and-play inference-time intervention that improves alignment in reasoning-capable frontier models while exposing clear capability limitations in smaller architectures.

[39] Nine Judges, Two Effective Votes: Correlated Errors Undermine LLM Evaluation Panels cs.CLPDF

Guneet Kohli

TL;DR: 本文研究了使用多个大语言模型（LLM）作为评委进行聚合评估的可靠性问题。通过分析9个前沿LLM在三个自然语言推理数据集上的表现，发现由于模型之间存在高度相关的错误，这些评委提供的有效独立投票信息仅相当于约2个独立投票，导致评审团的实际准确性远低于理想独立投票的预期。

Details

Motivation: 动机在于探究LLM-as-a-judge评审团中模型投票的独立性，量化其实际信息价值与理想独立投票之间的差距，以评估当前多模型评估方法的可靠性。

Result: 在三个带有人工标注的自然语言推理数据集上测试表明，9个评委的有效独立信息量仅约2票，评审团实际准确率比理想独立投票低8-22个百分点，且单个最佳评委的表现与整个评审团相当或更优。使用更聪明的聚合算法最多只能弥补11%的差距。

Insight: 创新点在于提出了一个量化评审团信息价值的框架，并使用Kish有效样本量和Condorcet零模型进行度量。核心洞察是评估的瓶颈在于评委之间的相关性错误，而非聚合算法，因此单纯增加评委数量无法替代真正独立的评估。

Abstract: LLM-as-a-judge panels aggregate votes from multiple models, with the expectation that diverse models yield more reliable evaluations. We develop a framework to measure the true informational value of such panels and quantify how far their reliability falls short of the independent-voting ideal. Testing a panel of 9 frontier LLMs from 7 model families on three natural language inference datasets (each with 100 human annotations per item), we find that the 9 judges effectively provide only about 2 independent votes’ worth of information. Roughly three-quarters of the panel’s nominal independence is lost because the models make the same mistakes on the same items. The consequences are stark: the panel’s actual accuracy falls 8-22 percentage points short of what independent voting would achieve, and the best single judge matches or outperforms the full panel across all conditions. Neither adding more judges nor using smarter aggregation algorithms helps – established methods close at most 11% of this gap, even with access to the correct answers. We quantify these findings using the Kish effective sample size (n_eff) and a Condorcet null model, and show the deficit is robust across prompt variants, temperatures, chain-of-thought reasoning, and a pairwise preference task (RewardBench). The bottleneck is correlated judges, not the aggregation algorithm, implying that scaling up panels cannot substitute for genuinely independent evaluation.

[40] Towards Localized and Disentangled Knowledge Editing for Multimodal Large Language Models cs.CL | cs.AIPDF

Leijiang Gu, Zhen Zeng, Feng Li, Xinjian Gao, Zenglin Shi

TL;DR: 本文提出了一种名为LDKE的新框架，用于解决多模态大语言模型（MLLMs）中的知识编辑问题。该框架通过定位特定事实相关的模型层并解耦目标相关与无关的输入，实现了更精确和可泛化的知识修改，避免了现有方法在编辑时对无关信息的意外影响。

Details

Motivation: 现有多模态知识编辑（MKE）方法在修正MLLMs中过时或不准确知识时存在局限：它们能有效修改目标事实对，但无法将编辑泛化到逻辑相关的查询，且常对视觉或语义上相关但无关的信息造成意外更改。本文旨在解决这一关键问题。

Result: 在多个基准测试和MLLMs上的广泛实验表明，LDKE在将编辑传播到相关上下文方面表现出色，同时保持了高局部性，实现了优越的性能。

Insight: 创新点包括：形式化了导致编辑失败的两种模式（因果错位和特征纠缠）；提出了LDKE框架，包含快速定位模块以高效更新关键层，以及解耦分类器以适当路由输入来保护无关知识。从客观角度看，该方法通过层定位和输入解耦的组合，为MLLMs的知识编辑提供了更精细的控制机制。

Abstract: Existing methods in Multimodal Knowledge Editing (MKE) have advanced the ability to correct outdated or inaccurate knowledge in Multimodal Large Language Models (MLLMs). However, they exhibit a critical limitation: while effectively modifying target factual pairs, they fail to generalize edits to logically related queries and often cause unintended alterations to unrelated but visually or semantically linked information. We identify and formalize two underlying failure modes causing this issue: Causal Misalignment, which confines edits to the specific sample, and Feature Entanglement, which causes unintended alterations to coupled but irrelevant information. To address these issues, we propose Localized and Disentangled Knowledge Editing (LDKE), a new framework that achieves precise and generalized editing by localizing fact-specific model layers and disentangling target-relevant inputs from irrelevant ones. Our approach introduces a Fast Localization module to identify and update critical layers efficiently, along with a Disentanglement Classifier that routes inputs appropriately to preserve unrelated knowledge. Extensive experiments across various benchmarks and MLLMs demonstrate that LDKE achieves superior performance in propagating edits to related contexts while maintaining high locality.

[41] EvoRubric: Self-Evolving Rubric-Driven RL for Open-Ended Generation cs.CLPDF

Xin Guan, Xiaomeng Hu, Shen Huang, Zhenyi Wang, Bo Zhang

TL;DR: 本文提出EvoRubric，一种新颖的单策略协同进化强化学习框架，用于解决开放式生成任务中因缺乏明确奖励而导致的模型对齐难题。该框架将响应生成和评分标准生成统一在单一参数化策略下，通过动态切换推理器和评分标准生成器角色，并引入多级验证流程来确保生成信号的可靠性，从而摆脱对静态标准或外部评分标准生成器的依赖。

Details

Motivation: 现有基于评分标准的强化学习方法在开放式生成任务中严重依赖静态、人工标注的评分标准，这会导致策略滞后，或需要昂贵的外部专有模型进行动态更新，难以实现有效的模型对齐。

Result: 在医学、写作和科学领域的广泛实验表明，EvoRubric持续优于传统的静态对齐方法和外部大语言模型驱动的对齐方法。当用专家标注的评分标准初始化时，该框架能进一步发现新颖、有区分度的维度，获得比仅依赖静态专家标注更好的性能。

Insight: 核心创新在于提出了一个单策略协同进化框架，将响应生成与评分标准生成统一，并通过多级验证（元验证器、零方差剪枝、留一法同伴共识机制）和动态记忆池来防止奖励攻击、确保信号可靠性，从而实现了无需外部模型的自进化评分标准驱动强化学习。该框架兼容人类专家先验知识，并能在此基础上进行拓展。

Abstract: Reinforcement Learning (RL) has significantly advanced Large Language Models (LLMs) in verifiable domains, but aligning models for open-ended generation remains profoundly challenging due to the lack of definitive rewards. Current rubric-based RL methods mitigate this by employing explicit criteria; however, they rely heavily on static, human-annotated rubrics that inevitably cause policy lag, or expensive external proprietary models for dynamic updates. In this paper, we propose EvoRubric, a novel single-policy co-evolutionary RL framework that eliminates the reliance on static criteria and on external rubric generators. By unifying response generation and rubric generation under a single parameterized policy, EvoRubric dynamically alternates between a Reasoner and a Rubric Generator. To prevent reward hacking and ensure the reliability of generated signals, we introduce a multi-level verification pipeline featuring a meta-verifier, zero-variance pruning, and a Leave-One-Out peer consensus mechanism. Validated criteria are dynamically archived into a memory pool, yielding dense, multi-objective rewards to continuously co-optimize both roles. Extensive experiments across Medical, Writing, and Science domains demonstrate that EvoRubric consistently outperforms traditional static and external-LLM-driven alignment methods. Notably, our framework is compatible with human-expert priors. When initialized with expert-annotated rubrics, EvoRubric can further uncover novel, discriminative dimensions, achieving better performance than relying solely on static expert annotations.

[42] Towards Verifiable Multimodal Deep Research: A Multi-Agent Harness for Interleaved Report Generation cs.CL | cs.AIPDF

Chenghao Zhang, Guanting Dong, Yufan Liu, Tong Zhao, Zhicheng Dou

TL;DR: 本文提出了一个名为Ptah的多智能体框架，用于生成可验证的多模态深度研究报告。该框架通过规划、研究和写作三个阶段，协调专门化的智能体来构建视觉感知计划、收集基于声明的证据、在视觉工作记忆中维护与来源对齐的图像，并使用声明式多模态工具撰写报告。一个验证器智能体作为框架的验收函数，在整个工作流程中强制执行事实依据、引用保真度和跨模态一致性。

Details

Motivation: 解决可验证的多模态深度研究面临的挑战，包括开放式综合缺乏确定性真实标准，以及需要在文本论证中穿插视觉证据。

Result: 在深度研究基准测试上的实验表明，与强大的基线模型相比，Ptah能生成更可靠、视觉信息更丰富、对人类更可用的多模态报告。

Insight: 创新点在于提出了一个协调多智能体生命周期的框架，并引入了视觉工作记忆和声明式多模态工具使用来确保跨模态一致性；同时，提出了一个包含图像级和呈现级评估的新评估协议PtahEval。

Abstract: Large Language Models (LLMs) have advanced autonomous agents from deep search, which retrieves concise factual answers, to deep research, which synthesizes scattered evidence into long-form reports. However, verifiable multimodal deep research remains challenging due to open-ended synthesis without deterministic ground truth and the need to interleave textual arguments with visual evidence. We propose \textsc{Ptah}, a multi-agent harness for interleaved report generation. \textsc{Ptah} orchestrates the lifecycle from user query to rendered web report through planning, research, and writing stages, where specialized agents construct visual-aware plans, collect claim-grounded evidence, maintain source-aligned images in a \textit{Visual Working Memory}, and compose reports through declarative multimodal tool use. A verifier agent serves as the harness’s acceptance function, enforcing factual grounding, citation fidelity, and cross-modal consistency throughout the workflow. We further introduce \textsc{Ptah}Eval, an evaluation protocol that augments existing benchmarks with image-level and presentation-level assessments. Experiments on deep research benchmarks show that \textsc{Ptah} produces more reliable, visually informative, and usable human-facing multimodal reports than strong baselines.

[43] CRITIC-R1: Learning Structured Critics for Retrieval-Augmented Generation cs.CL | cs.AIPDF

Wenhan Xiao, Ziwei Zhang, Chuanyue Yu, Xingcheng Fu, Qingyun Sun

TL;DR: 本文提出CRITIC-R1，一个用于检索增强生成（RAG）的结构化批评框架。该框架将RAG的批评过程形式化为一个显式的错误诊断问题，并使用强化学习进行训练，旨在通过细粒度的、结构化的反馈来减少幻觉和推理错误，从而提升问答质量。

Details

Motivation: 现有RAG方法仍存在幻觉和细微推理错误，而引入的外部批评器通常提供粗粒度、弱结构化的反馈，存在过度干预问题，导致修正过程嘈杂且不可靠，限制了其纠正效果。

Result: 在五个问答基准测试上的实验表明，CRITIC-R1持续地超越了强大的RAG基线模型，提升了答案质量。

Insight: 创新点在于将RAG批评构建为结构化的多维度错误诊断（包括判决、错误定位、推理分析和修复生成），并设计了保守判断对齐（CJA）和诊断质量对齐（DQA）两种奖励函数，通过基于GRPO的强化学习结合外部LLM教师模型的流程级监督进行训练，以缓解过度干预并提升细粒度诊断反馈的质量。

Abstract: Retrieval-augmented generation (RAG) improves knowledge-intensive question answering by incorporating external evidence. However, existing RAG methods still suffer from hallucinations and subtle reasoning errors. Recent studies introduce external critics to refine RAG outputs, yet they often provide coarse-grained and weakly structured feedback, exhibit over-aggressive intervention, and lead to noisy and unreliable refinement, limiting their effectiveness for correction. To tackle these issues, we propose CRITIC-R1, a structured critic framework that formulates and learns RAG critique as an explicit error diagnosis problem using reinforcement learning (RL). Our framework categorizes common RAG errors into multiple diagnostic dimensions, including verdict, error location, reasoning analysis, and fix generation. To learn these capabilities, we design two reward functions: Conservative Judgement Alignment (CJA) first encourages calibrated high-level judgements while mitigating the over-aggressive phenomenon, whereas Diagnostic Quality Alignment (DQA) further improves fine-grained diagnostic feedback through gated rewards. We train the critic model using GRPO-based RL with process-level supervision collected from external LLM teacher models. Experiments across five QA benchmarks show that CRITIC-R1 consistently improves answer quality over strong RAG baselines. Our source code is available at https://anonymous.4open.science/r/critic-r1-FCB0

[44] Does The Way You Plan Matter? An Empirical Study of Planning Representations for LLM Web Agents cs.CL | cs.AI | cs.LGPDF

Alejandra Zambrano, Sara Vera Marjanovic, Imene Kerboua, Xing Han Lù, Leila Kosseim

TL;DR: 本文提出PlanAhead框架，实证研究了不同自然语言规划表示（如顺序子目标、叙述、伪代码和清单）对LLM驱动的Web智能体性能的影响。研究在WebArena任务上，通过引入成就率和解决任务一致性等新指标，发现规划表示和底层LLM均显著影响智能体的鲁棒性和任务成功率。

Details

Motivation: 现有基于LLM的Web智能体存在探索有限、遗漏关键步骤和对任务约束敏感等问题，先前研究认为这些失败源于规划缺陷，但不同规划表示的影响尚未被探索。

Result: 在WebArena中被归类为困难的任务上，系统评估了四种规划表示，结果表明规划制定方式和生成规划的底层LLM都显著影响智能体性能。

Insight: 创新点在于首次系统实证研究规划表示对Web智能体的影响，并引入了自动任务难度分级和新评估指标（成就率和解决任务一致性）以量化性能。从客观角度看，该研究为优化智能体规划模块提供了实证依据和可比较的基准。

Abstract: Despite recent advances, LLM-based web agents still struggle with limited exploration, omission of critical steps, and sensitivity to task constraints. Prior work suggests that many of these failures stem from weaknesses in planning, yet the impact of alternative natural language plan representation remains unexplored. To address this, we introduce PlanAhead, a static planner-executor framework that evaluates the impact of plan representation in agent performance. We first automatically categorize WebArena tasks into 3 difficulty levels, enabling consistent difficulty grading without human annotation. Then we systematically evaluate 4 different plan representations on the tasks categorized as hard: sequential subgoals, narrative, pseudocode, and checklist; across different families of multimodal LLM powered agents (OpenAI, Alibaba, and Google). To account for stochastic variability, we introduce two novel evaluation metrics: Achievement Rate (AR) and Solved-Task Consistency (STC). Our results show that both, the plan formulation and the underlying LLM generating the plan, significantly influence web-agent robustness and task success.

[45] Who Am I? History-Aware Profiles for Student Simulation in Tutoring Dialogues cs.CL | cs.CYPDF

Zhangqi Duan, Shuyan Huang, Alexander Scarlatos, Jaewook Lee, Simon Woodhead

TL;DR: 本文提出了历史条件学生模拟任务，旨在利用学生的学习历史信息来准确预测学生在辅导对话中的发言。作者设计了一个包含档案生成器和模拟器的两组件框架，通过强化学习优化档案生成以实现忠实的学生模拟。

Details

Motivation: 现有基于大语言模型的学生模拟研究主要关注单次对话内部，缺乏对学生知识和行为的历史背景建模，无法充分利用学生过去的问答或对话交互信息。

Result: 在从数学学习平台收集的真实世界学生对话和问题回答数据集上，该方法显著优于基线模型，实验证明了历史信息、学生档案和强化学习训练的重要性。

Insight: 创新点在于引入历史条件学生模拟任务，并提出了结合档案生成与模拟的两阶段强化学习框架，通过优化档案生成来提升模拟的忠实度，为自动化辅导工具的开发提供了新思路。

Abstract: A key part of developing large language model (LLM)-powered, automated tutoring tools is student simulation, i.e., using LLMs to role-play as students, which can facilitate tutor model evaluation and training. Existing work mostly focuses on within-dialogue simulation, which lacks context on student knowledge and behavior, partly due to not grounding in past student question-answering or dialogue interactions. In this work, we introduce the task of history-conditioned student simulation, where the goal is to accurately predict student dialogue turns by leveraging information in the student’s learning history. We propose a two-component framework in which a profile generator summarizes a student’s history and a simulator predicts student turns conditioned on the resulting profile. We train both components with reinforcement learning (RL), yielding profiles optimized for faithful student simulation. We evaluate our method and baselines on the first-of-its-kind real-world dataset of student dialogues and question responses that we collect from a math learning platform. Extensive experiments show that our method significantly outperforms baselines, and demonstrate the importance of history, profiles, and RL training.

[46] Latent Performance Profiling of Large Language Models cs.CL | cs.LGPDF

Tanmoy Chakraborty, Ayan Sengupta, Suparna Bhattacharya, Partha Pratim Chakrabarti, Amlan Chakrabarti

TL;DR: 本文提出了一种名为潜在性能剖析（LPP）的新框架，用于对大型语言模型进行状态中心的内在评估。该框架通过分析模型的隐藏激活和输出分布，提取与任务无关的诊断指标，以揭示模型在信息处理、不确定性校准和内部知识结构等方面的潜在特性，从而超越传统基准测试的局限性。

Details

Motivation: 当前基于排行榜（如MMLU PRO、BBH、IFEval）的开源LLM评估存在数据污染、任务范围狭窄、与现实世界可靠性对齐弱等问题，这些基准主要关注模型在固定测试集上的输出结果（what），而无法揭示模型如何处理信息、校准不确定性或结构化内部知识（how）。

Result: 通过对8个参数量在0.5B到14B之间的LLM进行广泛的实证分析，研究表明，即使基准测试分数相似的模型，在潜在性能剖析（如熵或适应性等指标）上也可能表现出截然不同的特征。LPP提供了稳定且对架构敏感的签名，能够实现可解释的比较并发现隐藏的脆弱性。

Insight: 创新点在于从静态的准确率评估转向动态的、状态中心的内在评估，提出了一个基于模型潜在表示和动态的标量度量框架。这为模型选择、安全评估提供了超越表面准确率的、更深入且可解释的理解，并可以设计出与内在指标对齐、同时解耦排行榜偏差的合成探针（如针对不确定性和符号推理）。

Abstract: Large language models (LLMs) frequently achieve impressive scores on standardized benchmarks, yet accuracy alone offers a limited view of their capabilities. Evaluating open-source LLMs through leaderboards faces persistent issues like data contamination, narrow task scope, and weak alignment with real-world reliability. Benchmark-based evaluations such as MMLU PRO, BBH, or IFEval primarily capture \textit{what} a model outputs on fixed test sets, not \textit{how} it processes information, calibrates uncertainty, or structures internal knowledge. In this article, we advocate for a shift from benchmark-centric evaluation toward a complementary, \textit{state-centered intrinsic assessment} of LLMs. To this end, we introduce \textbf{Latent Performance Profiling (LPP)} – a framework that derives task-agnostic diagnostics from hidden activations and output distributions. LPP defines a set of scalar metrics on a model’s latent representations and dynamics, revealing scale-independent traits that enable interpretable comparisons and uncover hidden vulnerabilities. Unlike static accuracy scores, LPP provides stable, architecture-sensitive signatures across models of similar size. With extensive empirical analyses across eight LLMs, spanning a size range of 0.5B-14B, we demonstrate that models with similar benchmark scores can exhibit contrasting latent profiles, such as differences in entropy or adaptability. Guided by these insights, we design synthetic probes for uncertainty and symbolic reasoning that align with intrinsic metrics while decoupling from leaderboard bias. We recommend that reporting LPP alongside benchmarks provides a deeper, interpretable understanding of model behavior, enabling more reliable model selection, safety assessment, and evaluation beyond surface-level accuracy.

[47] HEART-Bench: Do LLM Agents Exhibit Human-like Psychology? cs.CLPDF

Weihan Peng, Chenxu Zhang, Qianao Wang, Yuling Shi, Heng Lian

TL;DR: 该论文提出了HEART-Bench，这是一个用于系统评估LLM智能体是否能模拟连贯、类人心理的新基准。该基准基于大五人格理论构建了11个不同的人类角色，每个角色都深度整合了1000个结构化的自传式情景记忆，并设计了一套基于DIAMONDS心理学分类法的64个决策场景。最终，通过人工验证和筛选，形成了一个包含673道多项选择题的测试集。

Details

Motivation: 当前LLM智能体在规划、推理和行动等任务导向能力上表现出色，但很少有工作将它们视为完整的人类人格，其中情感维度同等重要。该研究旨在填补这一空白，系统评估LLM智能体能否展现类人的、一致的心理特征。

Result: 论文构建并验证了HEART-Bench基准，该基准包含673道经过人工验证的多项选择题，为评估LLM智能体在类人情感、人格一致性和价值一致的行为决策方面提供了一个原则性且可扩展的测试平台。摘要中未提及具体模型在该基准上的定量性能结果。

Insight: 创新点在于将人格特质（大五人格）与结构化的自传体记忆（分布于理论支撑的发展阶段）深度结合，并利用DIAMONDS心理学分类法来设计多样化的决策场景，从而系统性地评估LLM智能体心理模拟的连贯性和一致性。这为评估和开发更具类人心理的AI智能体提供了新的方法论和基准工具。

Abstract: While LLM agents have demonstrated remarkable task-oriented abilities such as planning, reasoning, and action, few works have treated them as complete human personalities where emotional dimensions hold equal importance. In this paper, we introduce a novel benchmark to systematically assess whether LLM agents can simulate coherent, human-like psychology. Specifically, our benchmark constructs 11 diverse human characters grounded in orthogonal Big Five personality traits, with each profile deeply integrated with 1,000 structured autobiographical-style episodic memories distributed across theory-grounded developmental life stages. To rigorously evaluate the psychological manifestations of LLMs, we designed a curated suite of 64 decision-making scenarios, guided by the DIAMONDS taxonomy, a psychological framework that characterizes situations along eight dimensions: Duty, Intellect, Adversity, Mating, pOsitivity, Negativity, Deception, and Sociality. By subjecting agents to varying scenarios, the benchmark evaluates whether they can consolidate their innate personality traits and autobiographical memories to make behavioral decisions that are consistent with their specific psychological profiles. After systematic human validation and filtering, we obtained a benchmark consisting of 673 multiple-choice questions (MCQs). We believe this benchmark provides a principled and scalable testbed for studying human-like emotions, personality consistency, and value-consistent behavioural decision-making in LLM-based agents.

[48] DirectorBench: Diagnosing Long-Form Video Generation with Personalized Multi-Agent Evaluation cs.CL | cs.CVPDF

Jiamin Chen, Qianben Chen, Jiawen Zhang, Yidi Wu, Yuchen Li

TL;DR: 本文提出了DirectorBench，一个用于长视频生成的个性化多智能体诊断基准，它通过结构化元数据、用户画像和多维度检查点来评估生成视频的质量，而非单一聚合分数。该基准能够定位工作流瓶颈并支持基于用户画像的评估，揭示了长视频生成中单元间过渡质量较低等关键问题。

Details

Motivation: 现有长视频生成评估基准主要关注局部视觉质量、短期时序一致性或通用提示对齐，缺乏对工作流失败和用户依赖偏好的诊断，因此需要一种更全面的诊断性评估方法。

Result: 在评估4个长视频生成工作流、6个基础大语言模型和7个用户画像时，DirectorBench发现单元间过渡质量平均仅为0.256，最佳工作流也仅达到0.356，而提示级用户需求满足度平均为0.71。人工评估验证了DirectorBench与人类判断的一致性，并能揭示被聚合评分掩盖的工作流和用户画像相关的失败模式。

Insight: 创新点在于提出了一个支持个性化、多维度诊断的评估框架，通过结构化元数据和用户画像进行细粒度分析，而非依赖单一分数，这为长视频生成的系统化评估和改进提供了新思路。

Abstract: Long-form video generation is rapidly moving from short, single-scene synthesis toward minute-long, multi-shot creation with narrative structure, cinematic control, audio, and cross-modal synchronization. However, evaluating such videos remains challenging, since existing benchmarks largely focus on local visual quality, short-horizon temporal consistency, or generic prompt alignment, and provide limited diagnosis of workflow failures and user-dependent preferences. We introduce DirectorBench, a personalized multi-agent diagnostic benchmark for long-form video generation. DirectorBench evaluates generated videos with respect to 80 structured metadata entries, 7 user profiles, and 40 checkpoint criteria across 5 dimensions: script, visual, audio, cross-modal, and stability. Instead of reducing quality to a single aggregate score, DirectorBench localizes checkpoint-level bottlenecks and supports profile-aware evaluation. We evaluate 4 long-form video generation workflows, 6 base LLMs, and 7 user profiles. Across workflows, DirectorBench reveals a between-unit bottleneck: transition quality averages only 0.256 and reaches 0.356 for the best workflow, while prompt-level user demand fulfillment averages 0.71. We further conduct human evaluation with 14 annotators to validate the alignment between DirectorBench and human judgment. The results show that DirectorBench captures human-perceptible quality differences and reveals workflow- and profile-dependent failure modes that are hidden by aggregate scoring. These findings highlight the importance of diagnostic and profile-aware benchmarking for long-form video generation.

[49] SEAL: Can Saturated Benchmarks Be Revived by LLM-as-a-Meta-Judge? cs.CLPDF

Jiamin Chen, Yidi Wu, Qiexiang Wang, Qianben Chen, Yuchen Li

TL;DR: 本文提出了一种名为SEAL（Seeded Elimination with Adaptive LLM-as-a-Meta-Judge）的自改进评估协议，旨在通过使用大型语言模型作为元评判员，从已饱和的基准测试中提取潜在的排序信号，从而重新激活这些基准的信息价值。该方法在代码生成、数学推理、知识密集型问答和工具使用代理任务等多个饱和基准上进行了验证。

Details

Motivation: 当前广泛使用的语言模型基准测试日益饱和，前沿系统得分趋同，标准指标难以区分优劣。作者旨在不构建新基准的情况下，通过改进对相同候选输出的评估，使现有任务重新变得具有信息性。

Result: 在多个饱和基准上，SEAL协议在排序准确性-延迟权衡方面优于其他协议，与全配对评判的斯皮尔曼一致性达到0.83-1.00，并在4个任务中均达成最高一致性（top-1 agreement），同时每个任务仅需11.89次调用，远低于全配对评估的28.00次。

Insight: 核心创新在于提出了一种自适应的、基于淘汰赛制的LLM-as-a-Meta-Judge评估框架，通过任务级原则和自改进的检查清单标准来评判候选输出对，从而高效地从饱和数据中提取可靠的排序信号。这为评估饱和基准提供了一种高效且可扩展的新范式。

Abstract: Widely used language-model benchmarks are increasingly saturated, with frontier systems often receiving near-tied scores that standard metrics cannot resolve. Rather than constructing harder alternatives, we ask whether existing tasks can be made informative again through improved evaluation over the same candidate outputs. Therefore, we present Seeded Elimination with Adaptive LLM-as-a-Meta-Judge, a self-improving evaluation protocol for extracting latent ranking signal from saturated benchmarks. SEAL seeds candidate outputs into a single elimination and evaluates each match with task-level principles plus self-improving checklist criteria. We evaluate SEAL on multiple saturated benchmarks covering code generation, mathematical reasoning, knowledge-intensive question answering, and tool-use agent task completion. Across these settings, SEAL improves the ranking-accuracy–latency trade-off over competing protocols, attaining 0.83–1.00 Spearman agreement with full pairwise judging and 4/4 top-1 agreement, while requiring only 11.89 calls per task compared with 28.00 for full pairwise evaluation.

[50] CCS: Clinical Consensus Selection for Radiology Report Generation cs.CL | cs.CVPDF

Xi Zhang, Yingshu Li, Zaiqiao Meng, Jake Lever, Edmond S. L. Ho

TL;DR: 本文提出了一种名为临床共识选择（CCS）的推理时选择框架，用于提升放射学报告生成（RRG）的质量。该方法通过采样多个候选报告，并利用一个结合文本相似性和图像-报告对齐的多模态嵌入器来评估临床共识，从而选择最优报告。

Details

Motivation: 当前放射学报告生成通常被建模为单路径生成任务，模型在推理时默认解码选出的报告可能并非其候选池中临床质量最高的，这表明推理时决策是一个被忽视的瓶颈。

Result: 在三个数据集和多个放射学多模态大语言模型（MLLM）上的实验表明，CCS一致地超越了单路径解码和通用的Best-of-N基线方法，尤其是在临床指标上取得了显著提升。

Insight: 创新点在于提出了一个与解码器无关的推理时选择框架，通过结合文本效用和放射学适配的多模态嵌入器（评估图像-报告对齐）来度量临床共识，这揭示了图像基础效用与文本共识是不同且互补的选择维度，为在推理时提升RRG性能开辟了新方向。

Abstract: Radiology report generation (RRG) is commonly formulated as a single-path generation task, where a multimodal large language model (MLLM) produces one decoded report as the final output. While recent progress has largely been driven by scaling training data, model capacity, and retrieval mechanisms, improving report quality at inference time remains underexplored. In this work, we observe that fixed radiology MLLMs often generate clinically stronger reports elsewhere in their candidate pool than the one selected by default decoding, suggesting that inference-time decision making remains an overlooked bottleneck. To address this, we propose Clinical Consensus Selection (CCS), a decoder-agnostic inference-time selection framework that samples multiple candidate reports and selects the one with the highest clinical consensus across the rollout pool. CCS unifies text-based utilities with a radiology-adapted utility computed by an image–report-trained multimodal embedder, which measures candidate agreement beyond surface-level textual similarity. Across three datasets and multiple radiology MLLMs, CCS consistently improves inference-time performance over single-path decoding and generic Best-of-N baselines, with particularly clear gains on clinical metrics. Further analysis shows that image-grounded utility forms a selection axis distinct from textual consensus and that substantial headroom remains for improving RRG at inference time.

[51] GRUFF: LLM Pronoun Fidelity, Reasoning, and Biases in German cs.CLPDF

Fabian Mewes, Anne Lauscher, Vagrant Gautam

TL;DR: 本文提出了GRUFF数据集，用于评估大型语言模型在德语中的代词忠实度、推理能力和偏见。研究发现，LLMs在无明确上下文时对阳性和阴性实体表现出较强的语法一致性，但对新代词xier和en则不然；模型对干扰项的鲁棒性普遍较差，但编码器模型在德语中比英语中更稳健；职业刻板印象在不同语法格和模型间相关性较弱。

Details

Motivation: 现有研究主要关注英语，而英语语法性别有限且几乎无性别一致；本文旨在填补德语中代词忠实度研究的空白，并探讨语法性别对模型推理和偏见的影响。

Result: 在GRUFF数据集上的实验表明，模型对阳性和阴性实体在无上下文时语法一致性强，但对新代词弱；编码器模型在德语中比英语中对干扰项更鲁棒；职业刻板印象在不同语法格和模型架构间相关性差。

Insight: 创新点包括构建首个大规模德语代词忠实度数据集GRUFF，涵盖四种名词性别系统和四组代词；客观分析揭示了语法性别对模型鲁棒性的重要性，以及刻板偏见在不同语言结构和模型中的不一致性。

Abstract: Third-person singular pronouns have long been used to study stereotypical biases in language models and to test their abilities to reason about reference. More recently, the interplay between reasoning and bias has been investigated with the task of pronoun fidelity, which assesses models’ abilities to correctly reuse a previously-specified pronoun for a discourse entity, independent of other potentially distracting discourse entities mentioned in between. However, such research focuses on English, which is a language with limited grammatical gender and almost no gender agreement. In this paper we contribute a novel, large-scale dataset, GRUFF, to measure pronoun fidelity in German, covering four different gender agreement systems in nouns, and four sets of pronouns. With this dataset, we show that LLMs show strong grammatical agreement for masculine and feminine entities in the absence of explicit context, but not for neopronouns xier and en. Models are generally not robust to distractors, but encoder-only models are more robust in German than in English, reflecting the importance of grammatical gender. Finally, we show that occupational stereotypes in this context are poorly correlated across grammatical cases, and across most models, except ones with closely related architectures. We release all code and data to encourage further work on gender-inclusive language and referential reasoning in German.

[52] Do Language Models Track Entities Across State Changes? cs.CL | cs.AIPDF

Zilu Tang, Qiao Zhao, Gabriel Franco, Derry Wijaya, Aaron Mueller

TL;DR: 本文研究了语言模型在复杂状态变化场景下的实体追踪能力，发现语言模型并非采用增量式策略逐词追踪世界状态，而是在查询出现时并行聚合相关信息。论文深入分析了PUT、REMOVE、MOVE等操作的内部机制，揭示了REMOVE操作依赖脆弱的全局抑制标签，并提出了相应的机制性解决方案。

Details

Motivation: 实体追踪是复杂推理的基础能力，现有研究主要关注无状态变化的实体绑定问题，而对语言模型如何处理自然语言表达的复杂状态变化任务缺乏深入理解。

Result: 研究发现语言模型在多个状态变化操作下采用非增量式实体追踪策略，并识别出REMOVE操作的全局抑制机制会导致多种失败模式，通过机制性干预可部分缓解该问题。

Insight: 创新点在于揭示了语言模型使用非序列化策略处理序列任务的内在机制，并通过行为分析与机制分析的交互验证，为构建更鲁棒的评估方法提供了新视角。

Abstract: Entity tracking (ET), the ability to keep track of states, is a fundamental skill that underlies complex reasoning. An increasing amount of work investigates how transformer language models (LMs) solve entity binding $\textit{without}$ state changes. However, there is limited understanding of how non-toy LMs address ET problems of realistic difficulties expressed in natural language. To this end, we investigate the mechanisms underlying ET in more complex scenarios featuring multiple state-changing operations. We find that LMs do not incrementally track world states across tokens or query-relevant states across layers, but simply aggregate relevant information in parallel at the last token when the query becomes evident. We further investigate mechanisms of individual operations ($\texttt{PUT}$, $\texttt{REMOVE}$, $\texttt{MOVE}$) to characterize this non-incremental ET mechanism. Surprisingly, LMs implement the $\texttt{REMOVE}$ operation with a fragile global suppression tag; this global removal mechanism predicts various failure modes that we confirm behaviorally. We provide a mechanistic solution of nullifying this tag to partially address this issue. Overall, our findings reveal that LMs solve a fundamentally sequential task using a non-sequential strategy. More broadly, our work illustrates how behavioral and mechanistic analyses can fruitfully interact. Behavioral results inform mechanistic hypotheses, and insights from mechanistic analyses help build stronger behavioral evaluations by predicting failure modes missing from existing evaluations.

[53] Knowing What to Solve Before How: Preplan Empowered LLM Mathematical Reasoning cs.CLPDF

Shaojie Wang, Liang Zhang

TL;DR: 本文提出PPC框架，在现有规划推理方法的基础上引入显式的问题理解阶段（preplan），形成“问题→预规划→规划→思维链”新范式，旨在解决传统方法中问题类型识别、工具适用性及潜在风险等关键信息隐式处理的不足。

Details

Motivation: 现有基于规划的推理方法（如“问题→规划→思维链”范式）在规划和执行阶段都聚焦于“如何解决问题”，而忽略了“解决什么问题”这一前置理解环节，导致问题类型、适用工具及潜在陷阱等关键信息未被显式处理，存在范式层面的鸿沟。

Result: 在四个骨干模型和五个数学推理基准测试上的实验表明，PPC在40个指标中的39个上取得了最佳结果，相比最强基线，maj@16和pass@16分别提升了+2.23和+3.06，且未引入额外的推理token开销。

Insight: 创新点在于显式引入问题理解阶段（preplan），并通过两端保障其概念完整性：使用包含剧透分数检测器的三阶段合成流水线构建干净的预规划监督数据，以及采用复合GRPO奖励确保生成的规划真正遵循预规划。这为增强LLM的推理能力提供了一种结构化、可解释的范式升级思路。

Abstract: Current plan-based reasoning methods improve large language models (LLMs) by inserting a planning stage before execution, giving rise to the question $\rightarrow$ plan $\rightarrow$ cot paradigm. While effective, a closer examination reveals an inherent paradigm-level gap: both the planning and its execution stages decide how to solve a problem, while the prior question of what to solve; recognizing the problem type, the applicable tools, and the foreseeable pitfalls; remains entirely implicit. To bridge this gap, we propose PPC (Preplan-Plan-CoT), a framework that introduces an explicit problem-understanding stage, the preplan, yielding a new question $\rightarrow$ preplan $\rightarrow$ plan $\rightarrow$ cot paradigm. Realizing this paradigm requires safeguarding the conceptual integrity of preplan at both ends. Specifically, we design a three-stage synthesis pipeline with a spoiler-score detector that filters out leakage and spoiler failures to build clean preplan supervision, and a composite GRPO reward enforces that the generated plan genuinely follows from the preplan. Experiments across four backbones and five mathematical reasoning benchmarks show that PPC achieves the best results on 39 of 40 metrics, improving maj@16 and pass@16 by +2.23 and +3.06 over the strongest baseline without introducing additional inference token overhead.

[54] Loong: A Human-Like Long Document Translation Agent with Observe-and-Act Adaptive Context Selection cs.CL | cs.AIPDF

Yutong Wang, Xuebo Liu, Derek F. Wong, Zhilin Li, Rongqing Jiang

TL;DR: 本文提出了一种名为Loong的类人长文档翻译智能体，通过3E记忆模块存储摘要、句对和实体记录作为历史上下文，并采用观察-行动自适应上下文选择机制，利用强化学习优化上下文策略，以解决大语言模型在文档级翻译中因有限上下文窗口和冗余信息导致的全局连贯性差和翻译质量下降问题。

Details

Motivation: 针对大语言模型在文档级翻译任务中受限于上下文窗口长度、难以保持全局连贯性，以及冗余上下文信息损害翻译质量的核心挑战，旨在模拟人类翻译的主动推理过程，自适应地选择最优上下文进行指导。

Result: 在英语与中文、德语、法语互译方向上的实证评估表明，Loong在三个评估指标上平均提升了高达13.0分，显著提高了翻译质量，并展现出强大的跨领域泛化能力、对上下文噪声的鲁棒性以及在超长文档翻译中的出色稳定性。

Insight: 创新点在于提出了一个结合3E结构化记忆和基于强化学习的观察-行动推理框架的翻译智能体，实现了对历史上下文的主动、自适应选择，而非被动关注全部历史，这为突破固定上下文窗口限制和提升长文档翻译的连贯性与质量提供了新思路。

Abstract: Document-level translation remains one of the most challenging tasks for large language models, which are constrained by limited context windows that impede global cohesion, while simultaneously suffering from redundant contextual information that degrades translation quality. To address this, we propose a human-like long document translation agent called Loong, which leverages a 3E memory module (Essence-Exemplar-Entity) to store summaries, sentence pairs, and entity records as historical context. Instead of passively attending to all history, Loong performs deep reasoning to adaptively identify the optimal context for translation guidance. Loong optimizes its context policy through reinforcement learning, utilizing preference data derived from its own sampled observe-and-act reasoning trajectories. Empirical evaluations demonstrate that Loong achieves substantial translation quality improvements in English $\Leftrightarrow$ Chinese, German, and French directions, with average gains of up to 13.0 points across the three evaluation metrics. Furthermore, Loong exhibits strong generalization across domains and robustness against contextual noise, while maintaining remarkable stability in ultra-long document translation. Our code is released at https://github.com/YutongWang1216/LoongDocMT.

[55] MedCase-Structured: A Text-to-FHIR Dataset for Benchmarking Diagnostic Reasoning in Clinically Realistic EHR Settings cs.CL | cs.AIPDF

Valentina Bui Muti, Eugénie Dulout, Ziquan Fu

TL;DR: 本文提出了一种从非结构化文本生成符合HL7 FHIR R4标准的临床数据管道的流程，并构建了名为MedCase-Structured的合成数据集，用于在临床真实、结构化的电子健康记录（EHR）环境中评估大型语言模型（LLMs）的诊断推理能力。研究发现，LLMs在处理结构化FHIR输入时的诊断准确性显著低于处理纯文本输入，强调了与真实部署环境对齐的基准测试的重要性。

Details

Motivation: 现有评估LLMs临床推理能力的基准测试多依赖于静态数据集或非结构化输入，无法反映临床系统中实际使用的结构化、可互操作的数据格式（如FHIR），因此需要开发在真实、结构化的EHR环境中进行可控评估的方法。

Result: 应用所提方法在MedCaseReasoning上构建了MedCase-Structured数据集，其中82.5%的病例成功生成了有效的FHIR数据。评估结果显示，LLMs在结构化FHIR输入上的诊断准确性始终低于纯文本输入。

Insight: 主要创新点在于提出了一个结合分阶段LLM生成、基于术语的验证与修复的管道，以生成临床真实、结构一致的FHIR数据，从而减少幻觉代码。这为在真实临床数据格式下评估临床决策支持系统提供了一个可控的基准测试框架。

Abstract: Large language models (LLMs) show promise for clinical reasoning and decision support, but evaluation in realistic, electronic health record-congruent settings remains limited. Existing benchmarks often rely on static datasets or unstructured inputs that do not reflect the structured, interoperable data formats used in clinical systems. We introduce a pipeline for generating clinically realistic HL7 FHIR R4 bundles from unstructured text, enabling controllable evaluation of clinical decision support systems. The pipeline combines staged LLM generation with terminology-grounded validation and repair to reduce hallucinated codes and enforce structural and semantic consistency. Applying this approach to MedCaseReasoning, we construct MedCase-Structured, a synthetic dataset aligned with clinician-authored diagnostic cases, achieving valid FHIR generation for 82.5% of cases. Evaluation on MedCase-Structured reveals consistently lower diagnostic accuracy for LLMs on structured FHIR inputs than with plain text, highlighting the importance of deployment-aligned benchmarking.

[56] Unlocking the Working Memory of Large Language Models for Latent Reasoning cs.CL | cs.AIPDF

Lukas Aichberger, Sepp Hochreiter

TL;DR: 本文提出了一种名为’记忆推理’（RiM）的潜在推理方法，旨在提升大语言模型的推理能力。该方法通过引入固定的记忆块序列来替代自回归生成中间推理步骤，从而将内部计算与外部通信解耦，实现高效的单次前向推理。

Details

Motivation: 现有方法通过生成中间标记来扩展推理计算，但这将推理过程与自回归生成耦合，混淆了内部计算与外部通信。受人类利用工作记忆进行内部信息处理的启发，本文旨在解锁大语言模型的工作记忆能力，以实现更高效的潜在推理。

Result: 在多个推理基准测试上的实验表明，RiM在不同家族和规模的语言模型上，均匹配或超越了现有的潜在推理方法，同时避免了思维的自回归生成。

Insight: 核心创新在于用固定的记忆块序列作为工作记忆的载体，并通过两阶段课程学习（先预测显式推理步骤进行基础训练，后仅通过最终答案迭代精炼）来操作化这些记忆块，从而证明了大语言模型可以被训练利用工作记忆进行有效的潜在推理。

Abstract: To improve the reasoning capabilities of large language models, test-time compute is typically scaled by generating intermediate tokens before the final answer. However, this couples reasoning to autoregressive generation and thereby conflates internal computation with external communication. In contrast, human cognition can use working memory to hold and manipulate information internally without the need to externalize intermediate thoughts. Drawing on this principle, we introduce Reasoning in Memory (RiM), a latent reasoning method that replaces the autoregressive generation of reasoning steps with memory blocks. These memory blocks are fixed sequences of special tokens that unlock the working-memory capacity of large language models. Since they are fixed rather than generated, they can be processed in a single forward pass, enabling compute-efficient latent reasoning. To operationalize these memory blocks, we employ a two-stage curriculum. First, we ground them by predicting explicit reasoning steps after each memory block. Second, we discard this step-level supervision and iteratively refine the final answer after each memory block. Our experiments on reasoning benchmarks show that, across language models of different families and sizes, RiM matches or exceeds existing latent reasoning methods while avoiding the autoregressive generation of thoughts. These results demonstrate that large language models can be trained to use working memory as an effective mechanism for latent reasoning.

cs.CV [Back]

[57] GAP3D: Generative Alignment of VLM Latents to Patch-Level Embeddings for 3D Generation cs.CVPDF

Polytimi Anna Gkotsi, Andrii Zadaianchuk, Mohammad Mahdi Derakhshani

TL;DR: 本文提出GAP3D，一种基于扩散的模块化方法，用于将视觉语言模型（VLM）生成的潜在特征与预训练图像编码器的完整、块级特征空间对齐，从而让冻结的下游生成模型能够利用VLM作为提示编码器，同时保持空间结构化的条件信号。该方法主要使用通用领域的图像-文本对进行训练，绕过了对大规模3D数据的需求，并在3D资产生成任务上进行了评估，展现出对多模态提示的零样本能力。

Details

Motivation: 现有方法将VLM作为生成模型的条件提示编码器时，通常依赖昂贵的端到端训练或将特征映射到压缩表示，丢弃了3D生成等几何感知任务所需的密集空间结构。本文旨在解决这一问题，实现VLM与下游生成模型的模块化集成。

Result: 在3D资产生成任务上的评估表明，该方法无需大规模3D数据，主要使用图像-文本对训练，并展现出对多模态提示的零样本能力（尽管仅使用文本输入训练）。

Insight: 核心创新在于通过基于扩散的对齐方法，将VLM潜在特征与图像编码器的密集块级嵌入空间对齐，部分弥合了两种基础模型表示之间的差距，为通过生成式对齐实现基础模型的模块化集成迈出了第一步。该方法优先考虑高级语义而非细粒度细节。

Abstract: Recent approaches integrating vision-language models (VLMs) as prompt encoders for generative model conditioning typically rely on expensive end-to-end training or map features to compressed representations, discarding the dense spatial structure required for geometry-aware tasks like 3D asset generation. To address this, we propose GAP3D, a modular, diffusion-based approach that aligns VLM-generated latents directly to the complete, patch-level feature space of a pre-trained image encoder, enabling a frozen downstream generative model to utilize a VLM as prompt encoder while maintaining a spatially structured conditioning signal. Evaluated on 3D asset generation, our method bypasses the need for large-scale 3D data by training mainly on general-domain image-text pairs. It also exhibits emergent zero-shot capabilities for multimodal prompts, despite being trained exclusively on text input. Finally, while currently prioritizing high-level semantics over fine-grained detail, GAP3D demonstrates that the representation gap between VLM and image-encoder feature spaces can be partially bridged through diffusion-based alignment, taking the first steps towards a modular integration of foundation models through generative alignment to dense embedding spaces.

[58] A Deep Learning Iterative Framework for Sentinel-1 Stripmap Enhancement Based on Azimuth Doppler Decomposition cs.CVPDF

Juan Francisco Amieva, Christian Ayala, Roberto Del Prete, Mikel Galar

TL;DR: 本文提出了一种基于方位角多普勒分解的自监督深度学习迭代框架，用于增强Sentinel-1 Stripmap模式SAR图像。该方法利用子孔径重建与全孔径图像之间的物理一致性生成训练数据，无需外部传感器或模拟真值，并集成了单帧与多帧学习以及迭代推理方案。

Details

Motivation: Sentinel-1 Stripmap模式虽提供最高分辨率，但受斑点噪声和空间限制影响，难以满足精细空间细节应用需求，因此需要有效的图像增强策略。

Result: 在真实Sentinel-1 Stripmap数据上的实验表明，该方法在PSNR和SSIM指标上持续优于广泛采用的自监督基线MERLIN，而MERLIN在ENL上更高，揭示了结构保真度与斑点平滑之间的权衡。

Insight: 创新点在于利用子孔径分解提供物理基础、可重复且操作可行的监督信号，实现了无需外部真值的自监督增强；该框架可扩展至其他SAR平台、极化和采集模式。

Abstract: Synthetic Aperture Radar (SAR) imagery enables all-weather, day-and-night Earth observation; however, it remains difficult to interpret due to speckle noise and other intrinsic imaging artifacts. Sentinel-1 (S1) constitutes one of the most widely used spaceborne SAR missions, offering systematic global coverage, high temporal resolution, dual-polarization imaging, and free data availability. Among S1 modes, Stripmap (SM) provides the highest resolution, yet speckle noise and spatial constraints often hinder applications requiring finer spatial detail. This motivates the need for effective image enhancement strategies. In this work, we propose a self-supervised enhancement framework for S1 SM imagery based on azimuth subaperture decomposition. The method exploits the physical consistency between subaperture reconstructions and the corresponding full-aperture image to generate paired training data without external sensors, simulated ground truth, or multi-temporal stacks. The proposed framework integrates single- and multi-frame learning and incorporates an iterative inference scheme that progressively refines image quality. Experiments on real S1 SM data show that the proposed approach consistently outperforms the widely adopted self-supervised deep learning baseline MERLIN, in terms of PSNR and SSIM, while MERLIN attains higher ENL, highlighting a trade-off between structural fidelity and speckle smoothing. Overall, the results demonstrate that subaperture-based supervision provides a physically grounded, reproducible, and operationally viable approach for SAR image enhancement using S1 data. It is worth noting that the proposed approach can be extended to other SAR platforms, polarizations, and acquisition modes.

[59] Embodied3DBench: Benchmarking Low-Level Embodied Spatial Intelligence of Vision Language Models cs.CV | cs.ROPDF

Jiyao Zhang, Mingxu Zhang, Yitong Peng, Haoxuan Liu, Chenshuo Wang

TL;DR: 该论文提出了Embodied3DBench，一个用于评估视觉语言模型在具身3D环境中低级空间智能的机器人中心化基准。该基准包含6个任务类别、12个子类别和超过21k个高质量问答对，旨在系统评估模型的空间结构理解和交互导向感知能力。论文评估了13个SOTA模型，发现它们在交互导向感知方面仍很脆弱，并进一步合成了一个130万QA对的大规模训练数据集以弥合能力差距。

Details

Motivation: 旨在探究当前视觉语言模型是否已准备好理解和推理复杂3D环境中的具身交互，并填补系统性评估具身环境中低级空间智能基准的空白。

Result: 在Embodied3DBench上评估了13个SOTA模型，结果显示模型在高层空间推理（如物体间位置关系）上表现相对较强，但在交互导向感知任务（如功能预测、抓取点预测）上表现脆弱。使用其合成的130万QA对数据集进行微调后，模型的低级空间智能得到了显著提升。

Insight: 创新点在于构建了一个系统性的、机器人中心的3D具身空间智能评估基准，并主动通过合成大规模训练数据来弥合评估揭示的能力差距，为开发交互感知的多模态系统设定了明确目标。

Abstract: Are current Vision Language Models (VLMs) ready to comprehend and reason about complex embodied interactions in 3D environments? We introduce Embodied3DBench, a robot-centric benchmark targeting low-level spatial intelligence in embodied 3D environments. To systematically evaluate these foundational perceptual capabilities, the benchmark includes 6 task categories divided into two core groups: Spatial Structural Understanding (Grounding, Spatial Relation Prediction, and Multi-view Correspondence) and Interaction-Oriented Perception (Affordance Prediction, Grasp Point Prediction, and Trajectory Prediction). The benchmark spans 12 subcategories and contains over 21k high-quality question-answer pairs. We evaluate 13 state-of-the-art models, and the results show that while current models exhibit relatively strong high-level spatial reasoning, such as understanding object-to-object positional relations, they remain fragile in interaction-oriented perception, highlighting a significant lack of robust 3D-aware interaction priors. To actively bridge this capability gap revealed by our benchmark, we further synthesize a large-scale training dataset comprising 1.3M QA pairs. Notably, fine-tuning on this dataset yields significant improvements in low-level spatial intelligence. Ultimately, Embodied3DBench fills a critical gap by providing both a systematic evaluation framework and a scalable data solution, setting a clear target for the development of interaction-aware multimodal systems.

[60] Robust Cross-Domain Generalization Using Unlabeled Target Data with Source-Domain Supervision cs.CVPDF

Yuyue Zhou, Shrimanti Ghosh, Michael, Xie, Justin JY Kim

TL;DR: 本文提出了一种结合目标域自监督预训练和模型集成策略的方法，用于提升儿科腕部骨折超声AI模型的跨设备泛化能力。该方法利用无标签的目标域数据进行掩码图像建模和对比学习，并通过置信感知融合头自适应整合预测结果，在保持数据隐私的同时显著提升了模型在目标设备上的分割性能。

Details

Motivation: 解决医学影像AI模型在跨超声设备或临床中心时因域偏移导致的性能下降问题，避免在新设备上重新标注数据的高成本和隐私顾虑。

Result: 在由62个儿科POCUS视频的318张图像组成的目标域数据集上，相比基线方法，Dice系数提升了超过6%，显著改善了跨设备性能。

Insight: 创新点在于将目标域无标签数据通过自监督预训练（MIM和对比学习）融入源域监督学习框架，并设计置信感知融合机制自适应集成预测，为跨中心研究或联邦学习提供了标签高效且隐私保护的解决方案。

Abstract: It is often desirable to generalize medical imaging AI models trained with dense annotations to data acquired from different ultrasound scanners or clinical sites; however, retraining these models with new annotations is often difficult and costly. We examine this challenge in pediatric wrist fracture assessment using point-of-care ultrasound (POCUS), where fractures are common and can be effectively triaged via ultrasound. AI has shown radiologist-level performance for fracture detection, often aided by high-quality bony structure segmentation. However, due to significant domain shifts, models perform poorly on data from other centers or probes, and obtaining segmentation labels across devices is impractical due to manual annotation effort and data privacy concerns. To address this, we propose a target-informed self-supervised pretraining and model-ensemble strategy. Specifically, our approach combines masked image modeling (MIM) and contrastive learning to learn target-domain structural representations without labels, and introduces a confidence-aware infusion head to adaptively integrate predictions. The source dataset, collected with a Philips Lumify probe, contained dense labels, while the target dataset, acquired with a TeleMED portable probe, was unlabeled. The datasets were kept strictly separate throughout the entire process. Our method used labeled source data for supervised training and leveraged target-domain pretraining to improve generalization. On 318 images from 62 pediatric POCUS videos, this approach significantly improved cross-device performance, achieving over 6% Dice improvement on the target domain versus the baseline. These results demonstrate a label-efficient and privacy-preserving approach for cross-device-robust ultrasound AI, offering a framework that can be extended to multi-center studies or federated learning setups.

[61] Lightweight Complementary-Cue Fusion for Robust Video Face Forgery Detection cs.CV | cs.LG | cs.MMPDF

Sunghwan Baek, Tariq Anwaar, Karanveer Singh, Rita Singh

TL;DR: 本文提出了一种轻量级互补线索融合方法用于鲁棒的视频人脸伪造检测。通过在小波去噪特征（WDF）基础上，分别与空间相位浅层学习（SPSL）的相位谱通道或局部二值模式（LBP）进行1x1卷积融合，构建了LFWS和LFWL两个检测器。该方法仅增加292个参数，在多个公开基准测试中超越了现有方法，实现了更高的检测精度和更小的模型规模。

Details

Motivation: 当前人脸视频伪造检测器通常使用宽或双流主干网络，模型较大。本文旨在证明，通过精心配对的手工特征进行轻量级融合，可以用更小的模型实现更高的检测精度，从而重新评估该领域以规模驱动的设计选择。

Result: 在FaceForensics++数据集上，平均AUC从基线Xception的74.8%提升至78.6%；在DFDC-Preview数据集上，从70.5%提升至74.9%。在八个公开基准测试中，该方法一致超越了F3Net、SRM和SPSL等模型，且无需额外数据或测试时增强。

Insight: 核心创新在于提出了一种极轻量的融合模块，将互补的手工特征（如WDF与相位谱或LBP）有效结合。这证明了精心设计的手工特征组合，能以极低的计算开销显著提升模型鲁棒性，为轻量化伪造检测器设计提供了新思路。

Abstract: Current face video forgery detectors use wide or dual-stream backbones. We show that a single, lightweight fusion of two handcrafted cues can achieve higher accuracy with a much smaller model. Based on the Xception baseline model (21.9 million parameters), we build two detectors: LFWS, which adds a 1x1 convolution to combine a low-frequency Wavelet-Denoised Feature (WDF) with a phase-spectrum channel derived from Spatial-Phase Shallow Learning (SPSL), and LFWL, which merges WDF with Local Binary Patterns (LBP) in the same way. This extra module adds only 292 parameters, keeping the total at 21.9 million, smaller than F3Net (22.5 million) and less than half the size of SRM (55.3 million). Even with this minimal overhead, the fused models increase the average area under the curve (AUC) from 74.8% to 78.6% on FaceForensics++ and from 70.5% to 74.9% on DFDC-Preview, gains of 3.8% and 4.4% over the Xception baseline. They also consistently outperform F3Net, SRM, and SPSL in eight public benchmarks, without extra data or test-time augmentation. These results show that carefully paired, handcrafted features, combined through the lightweight fusion block, can provide competitive robustness at a significantly lower cost than comparable frequency-based detectors. Our findings suggest a need to reevaluate scale-driven design choices in face video forgery detection.

[62] Towards the automated segmentation of epicardial and mediastinal fats: A multi-manufacturer approach using intersubject registration and random forest cs.CVPDF

É. O. Rodrigues, A. Conci, F. F. C. Morais, M. G. Pérez

TL;DR: 本文提出了一种全自动分割心脏周围两种脂肪组织（心外膜脂肪和纵隔脂肪）的方法，该方法基于CT图像，采用配准、特征提取和数据挖掘分类算法，旨在减少用户干预并提高可重复性。

Details

Motivation: 心脏周围脂肪量与多种健康风险因素相关，且独立于整体脂肪量，因此定量分析这些脂肪组织至关重要；本研究旨在开发一种全自动分割方法，以支持临床决策系统。

Result: 实验结果显示，心外膜和纵隔脂肪的平均分割准确率达到98.4%，平均真阳性率为96.2%，平均Dice相似性指数为96.8%，表明方法具有高精度。

Insight: 创新点在于结合多制造商CT图像的跨主体配准和随机森林分类器，实现全自动分割，减少人工干预；该方法可推广至其他医学图像分割任务，强调可重复性和临床实用性。

Abstract: The amount of fat on the surroundings of the heart is correlated to several health risk factors such as carotid stiffness, coronary artery calcification, atrial fibrillation, atherosclerosis, cancer incidence and others. Furthermore, the cardiac fat varies unrelated to the overall fat of the subject, and, therefore, it reinforces the quantitative analysis of these adipose tissues as being essential. Clinical decision support systems are computer programs capable of evaluating information and providing a corresponding diagnosis or data to complement the physicists’ analyses. The aim of this work is to propose a method capable of fully automatically segmenting two types of cardiac adipose tissues that stand apart from each other by the pericardium on CT images obtained by the standard acquisition protocol used for coronary calcium scoring. Much effort was devoted to promote minimal user intervention and ease of reproducibility. The methodology proposed in this work consists of a registration, which will roughly adjust input images to a standard, an extraction of features related to pixels and their surrounding area and a segmentation step based on data mining classification algorithms that define if an incoming pixel is of a certain type. Experimentations showed that the achieved mean accuracy for the epicardial and mediastinal fats was 98.4% with a mean true positive rate of 96.2%. In average, the Dice similarity index was equal to 96.8%.

[63] Guidance Contrastive Token Credit Assignment for Discrete Policy Optimization cs.CVPDF

Shufan Li, Konstantinos Kallidromitis, Akash Gokul Yusuke Kato, Kazuki Kozuka, Aditya Grover

TL;DR: 本文提出了一种名为Guidance Contrastive Policy Optimization (GCPO)的新算法，用于解决基于组优势的强化学习方法（如GRPO和DAPO）在离散策略优化中存在的信用分配问题。该方法通过对比正负提示下的模型预测，实现了细粒度的、基于令牌级别的信用分配，从而提供更精确的学习信号。

Details

Motivation: 现有基于组优势的强化学习方法（如GRPO和DAPO）依赖于样本级奖励，对所有令牌进行统一的信用分配，无法捕捉细粒度的、令牌级别的贡献，这限制了其性能。

Result: 在文本到图像生成和思维链推理基准测试中，GCPO算法在多项实验中都一致地超越了GRPO和DAPO基线模型，证明了其有效性。

Insight: 核心创新点是引入了对比性提示来指导信用分配，通过计算正负提示下模型预测的差异来分配令牌级优势，这能更精确地识别语义相关区域（如图像生成中的视觉区域或推理中的关键词），为离散策略学习提供了一种通用且可扩展的优化策略。

Abstract: Group-advantage-based reinforcement learning methods, such as GRPO and DAPO, have demonstrated strong performance across diverse domains, including mathematical reasoning and text-to-image generation. However, their reliance on sample-level rewards introduces a key limitation as uniform credit assignment across all tokens fails to capture fine-grained, token-level contributions. To address this issue, we propose Guidance Contrastive Policy Optimization (GCPO), a novel algorithm that enables per-token credit assignment by contrasting model predictions under positive and negative prompts. Rather than uniformly broadcasting sample-level advantages, GCPO assigns token-level advantages proportional to the difference between these contrastive predictions, allowing more precise and informative learning signals. Empirically, we find that GCPO emphasizes semantically relevant regions such as visual areas aligned with textual prompts in text-to-image generation, and critical keywords within reasoning traces for chain-of-thought tasks. Through extensive experiments, GCPO consistently outperforms GRPO and DAPO baselines on both text-to-image generation and chain-of-thought reasoning benchmarks, demonstrating its effectiveness as a general and scalable optimization strategy for discrete policy learning.

[64] MetaRanker: Human-in-the-loop Active Ranking for Metalens Image Quality cs.CV | cs.HCPDF

Yujin Park, Haejun Chung, Ikbeom Jang

TL;DR: 本文提出MetaRanker，一种人机交互主动排序框架，用于评估超薄超透镜（metalens）的图像质量。该框架将图像质量定义为语义可解释性，即人类在存在光学伪影时可靠识别物体和结构的能力。它结合概率偏好模型、不确定性感知查询选择，并利用视觉-语言模型提供轻量级语义先验，从而高效获取与人类判断一致的图像排序。

Details

Motivation: 当前超透镜成像流程中，重建模型通常使用基于失真的保真度目标（如PSNR）进行训练和选择，但这些代理指标与人类偏好及下游任务效用关联较弱，存在感知-失真权衡问题。因此，需要一种更符合人类感知的图像质量评估方法。

Result: 在真实和合成的超透镜数据集上，MetaRanker生成的排序与人类评估最为一致，同时相对于穷举成对评估，将所需的人工标注数量减少了约80%。实验表明，标准图像质量评估指标在超透镜领域与人类可解释性对齐有限。

Insight: 创新点在于将超透镜图像质量形式化为语义可解释性，并引入人机交互主动排序框架，结合概率偏好模型和视觉-语言模型先验来高效引导采样。客观来看，该方法将人类判断作为主要监督信号，仅使用模型先验指导信息丰富的比较采样，实现了感知驱动的评估与协同设计。

Abstract: Image quality in modern imaging systems emerges from the coupled effects of the sensor, optics, and computational reconstruction. Ultra-thin metalenses offer a path toward substantial miniaturization of optical modules, but practical designs often exhibit pronounced chromatic and field-dependent aberrations that necessitate computational reconstruction. In current metalens pipelines, reconstruction models are commonly trained and selected using distortion-based fidelity objectives, such as PSNR, yet these proxies can be weakly correlated with human preference and downstream utility, reflecting the well-known perception–distortion trade-off. We introduce MetaRanker, a human-in-the-loop active ranking framework that formalizes metalens image quality in terms of semantic interpretability, defined as the degree to which humans can reliably recognize objects and structures in the presence of optical artifacts. MetaRanker combines a probabilistic preference model with uncertainty-aware query selection, and leverages vision–language models to provide lightweight semantic priors. Importantly, these priors are used only to guide the sampling of informative comparisons; human judgments remain the primary supervision signal throughout. Across real-world and synthetic metalens datasets with distinct degradation profiles, MetaRanker produces rankings that align most closely with human assessments, while reducing the number of pairwise annotations required by approximately 80% relative to exhaustive pairwise evaluation. Finally, we show that standard image quality assessment metrics exhibit limited alignment with human interpretability in the metalens domain, positioning MetaRanker as a practical step toward perceptually grounded metalens evaluation and co-design.

[65] SalsaAgent: A multimodal embodied language model for interactive dance generation cs.CVPDF

Payam Jome Yazdian, Zoe Stanley, Angelica Lim

TL;DR: 本文提出了SalsaAgent，一种多模态具身语言模型，用于生成与人类领舞者互动并配合背景音乐的萨尔萨舞蹈动作。该方法将交互建模为非语言运动令牌传递，扩展了大型语言模型的词汇表以处理离散运动令牌、成对关系令牌和音频信息。通过引入全身运动关系令牌、基于自动生成骨架动态文本描述的LLM微调以及两阶段令牌到扩散的生成流程，实现了高质量的互动舞蹈生成。

Details

Motivation: 为了解决人形机器人或虚拟代理在社交互动中所需的双向非语言反应、协调与同步能力，特别是面向具有社会意识的机器人和交互式虚拟代理，本文旨在生成能够对人类领舞者和音乐背景做出反应的、富有表现力的全身萨尔萨舞蹈动作。

Result: 主观和客观评估表明，该方法在动作质量、音乐与舞伴协调性以及一致的双人空间行为方面均表现出色，相较于基线模型有显著提升。

Insight: 创新点包括：为全身运动和运动关系设计了新的令牌类型；利用自动生成的骨架动态文本描述对LLM进行微调以实现令牌接地；以及采用两阶段（令牌到扩散）的生成流程。从客观角度看，将复杂的多模态交互（运动、关系、音频）统一到LLM的离散令牌框架中，并通过扩散模型提升最终动作质量，是一个有借鉴意义的系统设计思路。

Abstract: Interaction between humanoids involves bidirectional and nonverbal reactivity, coordination and synchrony. Toward socially aware robots and interactive virtual agents, we present SalsaAgent, a language model that generates expressive, full-body salsa dance motions in reaction to a human leader and against a contextual music backdrop. We formulate interaction as nonverbal motion token passing, extending the vocabulary of a large language model (LLM) to process discrete motion tokens, pairwise relation tokens, and audio. Our contributions include new tokens for full-body and motion relations, LLM fine-tuning using automatically derived text descriptions of skeleton dynamics for token grounding, and a two-stage token-to-diffusion pipeline. Subjective and objective evaluations demonstrate the effectiveness of our approach in terms of motion quality, music and partner coordination, and consistent two-person spatial behavior, with significant improvements over baselines.

[66] Motion-guided sparse correction enables expert-quality point tracking across diverse microscopy regimes cs.CVPDF

Leonidas Zimianitis, Pasindu Thenahandi, Kai Buckhalter, Dineth Jayakody, Julian O. Kimura

TL;DR: 本文提出RIPPLE（Refinement Interpolation Platform for Point Location Estimation）平台，通过稀疏校正方法解决显微镜视频中非典型生物系统动态追踪的标注难题。该方法允许用户仅点击起始点，由系统生成完整轨迹，用户仅在轨迹漂移时进行干预校正。在五个具有挑战性的显微镜数据集上测试表明，RIPPLE能达到与详尽人工标注相当的质量，同时将手动点击次数减少3到25倍。

Details

Motivation: 解决显微镜视频中非典型生物系统动态追踪的标注瓶颈，因为传统和基于学习的追踪器都依赖专家评审数据进行评估和适应，而详尽的人工标注难以扩展到最需要这些工具的视频数据上。

Result: 在五个挑战性显微镜数据集（包括透明水母Clytia hemisphaerica和快速运动精子标志点）上测试，RIPPLE匹配了详尽人工标注的质量，同时将手动点击次数减少了3到25倍。

Insight: 将标注任务重新定义为稀疏校正问题，通过用户起始点引导和轨迹自动生成与局部干预相结合，在人工标注和全自动追踪之间构建了一个高效的中间层，为生物动力学量化、方法基准测试以及未来自动化显微镜追踪器的训练数据生成提供了新范式。

Abstract: Tracking the dynamics of non-canonical biological systems in microscopy videos remains a persistent challenge. Both classical and learning-based trackers depend on expert-reviewed data to be evaluated and adapted, yet exhaustive manual annotation rarely scales to the videos where these tools are needed most. We developed RIPPLE (Refinement Interpolation Platform for Point Location Estimation), which recasts annotation as sparse correction: a user clicks a starting point, RIPPLE proposes a full trajectory, and the user intervenes only where the trajectory drifts. We tested RIPPLE on five challenging microscopy datasets from our laboratories, four from the transparent jellyfish Clytia hemisphaerica and one tracking landmarks on rapidly moving sperm. Across these, RIPPLE matched the quality of exhaustive manual annotation while reducing manual clicks by 3 to 25 times across datasets. RIPPLE thereby fills a missing layer between manual annotation and fully automated tracking, enabling immediate quantification of biological dynamics, method benchmarking, and the production of the gold-standard data needed to adapt future automated microscopy trackers.

[67] Deep Psychovisual Image Representations cs.CVPDF

Wendi Ma, Aryaman Sharma, Wei Dai, Shekhar S. Chandra

TL;DR: 本文提出了一种名为Deep Visual Coding的深度心理视觉图像表示方法，该方法受1990年代量化感知显著频率的图像编码启发，结合复数值图像表示，生成了心理视觉风格的抽象表示。该方法首次实现了基于心理视觉的深度学习框架，利用数据驱动的频谱滤波器学习在不同频率子带中编码任务相关的语义结构。

Details

Motivation: 动机在于人类视觉系统通过中间抽象将低级特征提取与高级认知解耦，而当前基于深度学习的视觉模型通常使用同质的空间层堆叠来提取和聚合特征，导致其决策过程不透明，因此需要更高效和透明的视觉模型。

Result: 显著性分析表明，与常规卷积神经网络（CNN）产生的无定形区域相比，所提出的心理视觉模型提取了高度可解释的物体部分。此外，研究发现该模型在模型缩放时对深度的依赖性低于CNN，因为其复数值表示和学习到的抽象承担了深层空间层的作用。

Insight: 创新点在于将心理视觉模型与深度学习相结合，通过数据驱动的频谱滤波器和复数值表示实现任务相关的频率子带编码，这为构建更高效和透明的视觉模型提供了新路径，并揭示了模型可解释性和深度依赖性的改进潜力。

Abstract: Psychovisual models suggest human vision decouples low-level feature extraction from higher cognition by first forming intermediate abstractions. In contrast, deep learning-based vision models routinely extract and aggregate features using homogeneous stacks of spatial layers, rendering their decision-making processes opaque. In this paper, we propose Deep Visual Coding, a learned frequency-domain representation inspired by 1990s image codes that quantised perceptually salient frequencies, which together with complex-valued image representations produces psychovisual-style abstractions. This approach enables the first psychovisual-based deep learning framework, utilizing data-driven spectral filters that learn to encode task-relevant semantic structures within distinct frequency sub-bands. Salience analyses reveal that our psychovisual models extract highly interpretable object parts compared to the amorphous regions produced by regular Convolutional Neural Networks (CNNs). Furthermore, we find that our models are less depth dependent than CNNs for model scaling, since our complex-valued representations and learned abstractions subsume the role of the deep spatial layers. Together, these findings demonstrate that psychovisual coding provides a promising path toward more efficient and transparent vision models.

[68] ViASNet: A Video Ad Saliency Network for Predicting Dynamic Saliency and Viewer Engagement cs.CVPDF

Jianping Ye, Michel Wedel

TL;DR: 本文提出了一种名为ViASNet的视频广告显著性网络，用于预测动态显著性和观众参与度。该模型基于3D U-Net架构，并融合了音频和场景语义信息，旨在通过自动化系统加速广告设计与测试过程。

Details

Motivation: 随着数字媒体向短视频广告的转变，需要一种能够预测人类眼动模式的深度显著性模型，以优化广告内容设计并理解其有效性。

Result: 模型在151个视频广告数据集上进行了评估，每个广告由约20名观众观看并追踪眼动，通过消融实验探索了影响性能的关键因素，并在15个未见过的广告测试数据上展示了其诊断能力。

Insight: 创新点在于将音频和场景语义信息整合到3D U-Net架构中，用于动态显著性预测，并提出使用逐帧显著性图熵作为诊断工具，以识别未能吸引观众的广告和场景，从而提升广告优化效率。

Abstract: The digital media landscape has seen a pervasive shift toward short-form video advertising on TV, social media and e-commerce platforms. The present study focuses on deep saliency prediction for short-form video advertising. Deep saliency models have been used to generate predictions of human eye fixation patterns with the purpose of enhancing user interaction with digital technology and optimizing its design. For video ads, dynamic saliency maps capture where and when viewers are looking, revealing why video ads are effective, and how their content should be optimized. We develop and test a new deep dynamic saliency prediction model called ViASNet (Video Ad Saliency Network), which has an architecture founded on the 3D U-Net, and accommodates the influence of audio and the semantic meaning of scenes. We assess the model’s performance on 151 video ads, each seen by about 20 viewers wile their eye movements were tracked, and explore the critical factors influencing model performance through ablation experiments. We calculate the entropy of the predicted saliency maps frame-by-frame as a diagnostic tool to identify ads and scenes that fail to engage viewers, and illustrate its use on test data of 15 unseen ads. Our study reveals that ad design and testing can be sped up considerably through automated systems built on deep saliency models such as ViASNet.

[69] Pocket-Dentist: On-Device Dental Image Understanding via Efficient Multimodal Large Language Models cs.CV | cs.AIPDF

Kai Bian, Xucheng Guo, Bin Chen, Lingyan Ruan, Yiran Shen

TL;DR: 本文提出了Pocket-Dentist，一个面向牙科多模态问答的效率感知基准测试，整合了约1159名患者的数据集、五种任务类型和七项评估指标。研究发现，紧凑型视觉语言模型（如20亿参数模型）在牙科图像理解任务上不仅精度优于大型模型，且计算成本显著更低。在iPhone 17 Pro上部署的微调模型Pocket-Dentist-2B，相比70亿参数基线，处理延迟降低了4.9倍，内存使用减少了2.3倍。

Details

Motivation: 现有牙科视觉语言模型的评估在数据集、任务定义和指标上较为分散，且常忽略计算成本，这阻碍了其在专业中心之外（如需要及时推理、有限硬件和本地处理患者图像的临床预筛场景）的广泛部署。

Result: 在涵盖1159名患者、五种任务类型和七项指标的基准测试中，紧凑型VLM（如20亿参数模型）在精度上超越了更大的模型，同时计算成本显著更低。在iPhone 17 Pro上，Pocket-Dentist-2B模型处理每个样本仅需4.31秒，相比70亿参数基线，延迟降低4.9倍，内存使用减少2.3倍。

Insight: 论文的创新点在于提出了一个效率感知的牙科多模态问答基准，强调了在资源受限的移动设备上部署模型时，模型效率与精度平衡的重要性。客观来看，其核心洞察是：在特定领域（如牙科）的视觉理解任务中，紧凑模型可能通过针对性的微调，在保持甚至超越大模型精度的同时，实现显著的效率提升，这为边缘计算和隐私保护的临床应用提供了新思路。

Abstract: Evaluations of dental vision-language models remain fragmented across datasets, task definitions and metrics, and often ignore their computational cost. This limits their widespread deployment for dental screening outside specialist centres, where timely inference, limited hardware, and local handling of patient images are vital for practical, privacy-preserving clinical prescreening. Here we present Pocket-Dentist, an efficiency-aware benchmark for dental multimodal question answering that brings together three datasets spanning approximately 1,159 patients, five task types and seven metrics. Across typical 14 VLMs, our results reveals an interesting observation: compact VLMs (e.g., 2B-parameter models) outperform larger VLMs in accuracy while requiring substantially lower computational costs in dental image understanding. Deployed locally on an iPhone 17 Pro, our finetuned compact VLM Pocket-Dentist-2B processed each sample in 4.31 s, reducing latency by 4.9-fold and memory use by 2.3-fold compared with a 7B baseline.

[70] EarthShift: a benchmark for measuring robustness to real-world distribution shifts in Earth observation cs.CVPDF

Kelsey Doerksen, Hannah Kerner

TL;DR: 论文提出了EarthShift，这是首个用于评估遥感领域模型在面对真实世界分布偏移时鲁棒性的公开基准测试平台。该基准通过比较模型在分布内和分布外（如不同时间、地理、尺度和传感器）配对数据集上的性能来衡量鲁棒性。

Details

Motivation: 现有地球观测基准主要关注模型在分布内任务上的泛化性能，而实际部署时模型必须应对各种分布外场景（如新时段、新地点、新传感器），因此需要专门评估模型对这些真实分布偏移的鲁棒性。

Result: 在8个地理空间基础模型（GFMs）和11个任务（涵盖5种偏移类型）上的实验表明，无论模型架构、大小、预训练或微调策略如何，GFMs在分布外的平均性能下降15-20%。GFMs的鲁棒性与通用视觉基础模型甚至全监督模型相当。

Insight: 创新点在于构建了首个针对遥感领域真实分布偏移的鲁棒性基准，揭示了当前基础模型在分布外场景下性能显著下降的普遍问题，强调了未来研究需同时关注性能和鲁棒性提升，并提供了可复现的测试平台来指导开发更可靠的模型。

Abstract: Current Earth observation benchmarks focus on measuring performance on diverse tasks and applications, typically measuring generalization in-distribution. But when models are deployed, they must generalize to myriad out-of-distribution scenarios, such as new time periods, geographies, scales, and sensors. We introduce EarthShift: the first public testbed for benchmarking robustness across multiple realistic distribution shifts encountered in remote sensing. EarthShift enables users to measure distributional robustness by comparing performance in- and out-of-distribution using datasets from paired datasets from different sources, temporal windows, geographic locations, and sensors. Our experiments on 8 geospatial foundation models (GFMs) and 11 tasks covering 5 shift types show that GFMs consistently perform 15-20% worse out-of-distribution on average regardless of model architecture, size, pre-training or fine-tuning strategy. We show that GFM robustness is similar to that of generic vision foundation models, and even fully-supervised models. This highlights a need for future research to strive for improvements in distributional robustness, not just performance, which can be benchmarked using EarthShift. We release our code and datasets to provide a testbed to guide future work to create foundation models that are robust and reliable in real-world applications. Code and data for EarthShift are available at: https://earthshift.github.io

[71] Multi-Stage VLM Pipeline for Zero-Shot Traffic Accident Understanding cs.CVPDF

Fumiya Tatematsu, Fumihiko Takahashi

TL;DR: 本文介绍了CVPR 2026 AUTOPILOT Workshop ACCIDENT挑战赛的冠军解决方案，该方案旨在从监控视频中零样本预测事故时间、影响质心和碰撞类型。方法基于一个冻结的Qwen3-VL-32B-Instruct检查点，构建了一个三阶段流水线（全视频联合预测、时间细化和影响质心的单帧定位），并在一个235B的混合专家模型上再次运行相同流水线，以9:1的比例融合两个输出，最后将每个预测点对齐到最近的车辆检测框上。

Details

Motivation: 解决从CCTV监控视频中零样本预测事故关键属性（如时间、位置和类型）的挑战，该任务在自动驾驶和智能交通领域具有重要应用价值。

Result: 最终系统在公共排行榜（Public LB）上得分为0.55469，在私有排行榜（Private LB）上得分为0.57080，比最强的官方基线（Molmo-7B，0.358）高出约0.21，赢得了挑战赛。

Insight: 创新点在于设计了一个多阶段视觉语言模型流水线，结合了全视频联合预测、时间细化和单帧定位，并采用了模型融合（32B与235B MoE模型输出混合）以及预测结果与车辆检测的后处理对齐策略，提升了零样本理解的性能。从客观角度看，其系统化工程方法（包括组件消融和负结果报告）对构建稳健的视觉理解系统具有借鉴意义。

Abstract: We present the 1st-place solution to the ACCIDENT challenge at the CVPR 2026 AUTOPILOT Workshop, which asks for zero-shot prediction of accident timing, impact centroid, and collision type from CCTV footage. On a frozen Qwen3-VL-32B-Instruct checkpoint we build a three-stage pipeline (full-video joint prediction, time refinement, and single-frame grounding of the impact centroid), run the same pipeline a second time on a 235B Mixture-of-Experts sibling, blend the two outputs 9:1, and finally snap each predicted point onto the nearest vehicle detection. The final system reaches Public LB 0.55469 / Private LB 0.57080, roughly +0.21 over the strongest host baseline (Molmo-7B, 0.358) and wins the challenge. We ablate each component, report the negative results that shaped the final design, and release the code at https://github.com/fuumin621/cvpr2026-accident-1st-place-solution.

[72] DMC-CF: Dynamic Multimodal CounterFactual QA benchmark for Causal Reasoning cs.CVPDF

Junzhe Zhang, Huixuan Zhang, Guirong Wang, Xingyao Zhang, Pei Liu

TL;DR: 该论文提出了DMC-CF，一个用于评估多模态大语言模型因果推理能力的动态多模态反事实问答基准。它包含基于真实世界视频构建的静态基准DMC-CF-Static，以及利用因果图和动态图干预框架构建的动态评估基准DMC-CF-Dynamic，以解决传统静态评估中的数据污染等问题。实验表明，当前MLLMs在真实世界场景下的多模态因果推理能力仍有很大提升空间。

Details

Motivation: 旨在解决现有多模态因果推理数据集规模有限、或基于合成/非真实内容构建的问题，并评估MLLMs是否真正理解现实世界的因果关系。

Result: 在包含静态和动态评估的整体DMC-CF基准上的实验结果表明，当前多模态大语言模型在真实世界场景下的多模态因果推理能力仍需大幅改进。

Insight: 创新点在于利用真实世界视频构建大规模基准，并引入因果图和动态图干预框架来创建动态评估，以更严谨地测试模型的因果推理能力，避免了静态评估的局限性。

Abstract: With the rapid advancement of multimodal large language models (MLLMs), models have demonstrated increasingly powerful multimodal capabilities. However, whether MLLMs trained through statistical learning can truly understand the causal relationships underlying the real world remains a key research question. In recent years, numerous multimodal causal reasoning datasets have been proposed. Nevertheless, these datasets are either limited in scale or constructed from synthetic images and videos, cartoon-based content, or other non-realistic multimodal sources. To address these limitations, we collect real-world videos and construct DMC-CF-Static, a large-scale benchmark for multimodal causal counterfactual reasoning. Furthermore, to mitigate issues such as data contamination in traditional static evaluation, we represent causal events using causal graphs and propose the Dynamic Graph Intervention (DGI) framework to build the dynamic evaluation benchmark DMC-CF-Dynamic from DMC-CF-Static. Experimental results on the overall DMC-CF, which includes both static and dynamic evaluation benchmarks, demonstrate that the multimodal causal reasoning capabilities of current multimodal large language models in real-world scenarios still require substantial improvement.

[73] WorldMemArena: Evaluating Multimodal Agent Memory Through Action-World Interaction cs.CV | cs.CLPDF

Chengzhi Liu, Yuzhe Yang, Sophia Xiao Pu, Yepeng Liu, Lin Long

TL;DR: 本文提出了WorldMemArena，一个用于评估多模态智能体记忆的新基准，它通过一个可观察的四阶段生命周期（Action-World Interaction Loop）来建模记忆，包含400个多会话多模态任务，涵盖状态持续演化的Lifelong Evolution和基于真实观察、行动与反馈的Agentic Execution。该基准旨在解决现有评估方法在定位记忆失败（写入、维护、检索或使用）和比较不同记忆管理策略（如手动设计与自主管理）方面的不足。

Details

Motivation: 现有基准主要评估静态对话中的记忆召回，并将记忆性能简化为单一的任务最终准确率，同时将视觉观察简化为文本描述，这导致无法精确定位记忆在写入、维护、检索或使用阶段的失败。随着能够自主管理记忆的智能体框架兴起，缺乏一个原则性的方法来比较手动设计的记忆管道与自主管理方案。

Result: 在WorldMemArena基准上的实验结果表明：1) 更好的记忆写入和存储并不保证更好的性能；2) 多模态记忆仍难以充分利用视觉证据；3) 系统在不同领域表现不稳定，且在真实的智能体轨迹上性能下降；4) 基于框架的自主记忆管理更灵活，但成本更高且可靠性较低。该研究首次实现了长上下文、手动设计（如RAG和外部记忆系统）与基于框架的记忆智能体之间的直接比较。

Insight: 论文的核心创新在于将多模态智能体记忆建模为一个具有可观察四阶段生命周期的Action-World Interaction Loop，并构建了一个包含丰富注释（如黄金记忆点、更新、干扰项和证据链）的大规模基准，支持阶段级的故障诊断。这为系统性地分析和比较不同记忆管理策略提供了新的框架和工具。

Abstract: Multimodal large language models are increasingly deployed as long-horizon agents, where memory must do more than recall: it must track an evolving world, revise what has gone stale, and surface the right evidence at decision time. Existing benchmarks measure recall over static dialogue, collapse memory into a single end-of-task accuracy, and reduce visual observations to captions, leaving us unable to localize failures to writing, maintenance, retrieval, or use. The rise of agent harnesses that author their own memory sharpens this gap, since we have no principled way to compare hand-designed pipelines with self-managing alternatives. To close these gaps, we formulate multimodal agent memory as an Action-World Interaction Loop with an observable four-stage lifecycle, and instantiate it in WorldMemArena: 400 multi-session multimodal tasks spanning Lifelong Evolution (evolving personal and task states) and Agentic Execution (memory from real observations, actions, and feedback), annotated with gold memory points, updates, distractors, and evidence chains for stage-level diagnosis. This enables the first head-to-head comparison of long-context, manually designed (RAG and external memory systems), and harness-based memory agents. Results show that: (1) better memory writing and storage do not guarantee better performance; (2) multimodal memory still struggles to fully use visual evidence; (3) systems are unstable across domains and degrade on realistic agentic trajectories; and (4) harness memory is more flexible but remains costly and less reliable.

[74] Semantic and Visual Evidence for Efficient Long-Video Reasoning: A Solution for the HD-EPIC VQA Challenge cs.CV | cs.AIPDF

Yinsong Xu, Wei Jing, Liuxin Zhang, Wanjun Lv, Hui Li

TL;DR: 本文提出了一种统一框架，用于解决多模态大语言模型（MLLMs）在理解长视频时面临的上下文长度限制和细粒度视觉细节不足的问题。该框架将长视频推理解耦为语义证据和视觉证据两种互补形式，通过从粗到细的语义提取流程捕获全局程序结构，并通过以对象为中心的视觉证据（如边界框和视觉嵌入）保留细粒度信息。在推理时，采用基于查询的证据检索与集成过程，动态选择相关信息，从而在HD-EPIC-VQA挑战中取得了有竞争力的性能。

Details

Motivation: 解决多模态大语言模型在理解长视频时因上下文长度有限和细粒度视觉细节不足而性能受限的问题，特别是在HD-EPIC基准测试中表现不佳的挑战。

Result: 在HD-EPIC-VQA挑战的多个任务类别中取得了有竞争力的性能，表明该方法能有效提升长视频理解能力。

Insight: 创新点在于将长视频推理解耦为语义证据（全局结构）和视觉证据（细粒度对象信息），并通过动态检索与集成机制实现高效推理；客观分析认为，这种结构化证据处理方式为MLLMs的长视频理解提供了可扩展的解决方案。

Abstract: Understanding long-form egocentric videos remains challenging for multimodal large language models (MLLMs) due to limited context length and insufficient grounding of fine-grained visual details. The recently proposed HD-EPIC benchmark highlights these limitations: even strong long-context models achieve relatively low performance across diverse video question answering tasks. In this paper, we propose a unified framework that decouples long-video reasoning into two complementary forms of evidence: semantic evidence and visual evidence. Semantic evidence captures global procedural structure through a coarse-to-fine extraction pipeline, while object-centric visual evidence preserves fine-grained grounding through bounding boxes and visual embeddings. During inference, we formulate reasoning as a query-conditioned evidence retrieval and integration process, dynamically selecting relevant information from both sources. Our approach achieves competitive performance in the HD-EPIC-VQA Challenge across multiple task categories. More broadly, our results demonstrate that explicitly structuring, retrieving, and integrating semantic and visual evidence is critical for effective long-video understanding with MLLMs.

Yangchen Wu, Huiqiang Xie

TL;DR: 本文提出了一种名为Uni-RCM的统一参考引导跨模态映射框架，用于解决多模态工业异常检测中多类别统一处理时面临的类间干扰和特征流形混淆问题。该框架通过引入可学习的参考特征来动态过滤类别特定噪声，并采用离线残差量化器通过多级级联码本刻画正常分布。在MVTec-3D AD数据集上的评估表明，该方法在图像级检测和像素级定位方面均达到了最先进的性能。

Details

Motivation: 多模态工业异常检测通常依赖为每个产品类别单独训练模型，这限制了实际可扩展性。转向统一处理多类别的范式时，检测精度常因类间干扰和特征流形混淆而下降。

Result: 在MVTec-3D AD数据集上的广泛评估表明，该方法在具有挑战性的多类别设置中，在图像级检测和像素级定位方面均达到了最先进的（SOTA）性能。

Insight: 核心创新点在于提出了参考引导块，通过引入可学习的参考特征来动态过滤类别特定噪声，并捕捉不同模态间的共性。此外，提出的离线残差量化器通过多级级联码本更有效地刻画正常分布，有助于缓解统一模型中的特征混淆问题。

Abstract: Multi-modal industrial anomaly detection typically relies on separate models for each product category, fundamentally limiting practical scalability. When shifting to a unified paradigm that handles diverse classes simultaneously, detection accuracy often degrades due to inter-class interference and feature manifold confusion. To overcome these challenges, we propose a Unified Reference guided Cross-modal Mapping framework, named Uni-RCM. At its core, we propose a reference guide block to dynamically filter out category-specific noise by introducing a learnable reference feature, which captures the commonalities across different modalities. Besides, an offline residual quantizer is proposed to characterize the normal distribution by multiple cascaded codebooks. Extensive evaluations on the MVTec-3D AD dataset demonstrate the state-of-the-art performance in the challenging multi-class setting and in terms of image-level detection and pixel-level localization.

[76] FlowSeg: Dynamic Semantic Guidance for LLM-Conditioned Segmentation cs.CVPDF

Zekang Zhang, Guangyu Gao, Youyun Tang, ChengJing Wu, Xiaochao Qu

TL;DR: FlowSeg提出了一种动态语义引导机制，通过在大语言模型（LLM）条件嵌入与迭代掩码生成过程的中间解码状态之间建立双向语义流，来解决现有LLM条件分割方法中语言条件与掩码预测之间语义错配的固有问题。该方法使语言条件能主动指导每一阶段的掩码细化，同时条件嵌入也根据视觉证据进行更新，从而实现了更可靠的匹配。实验在指代表达式分割和推理分割任务上证明了其有效性，并达到了最先进的性能。

Details

Motivation: 当前基于‘提议-选择’流程的LLM条件分割方法存在一个持续性的失败模式：尽管能生成高质量的掩码候选，但最终预测可能无法匹配给定的语言条件。这是因为语言语义通常被用作静态提示或事后匹配信号，而没有参与到迭代掩码生成过程中，导致语义错配而非掩码质量差。

Result: 在指代表达式分割和推理分割任务上的大量实验表明，FlowSeg持续改进了语言-掩码的对齐，并取得了最先进的（SOTA）性能。

Insight: 核心创新点在于引入了动态语义引导，通过双向语义流使语言条件在生成过程中主动引导掩码细化，同时条件嵌入也根据视觉证据进行更新，从而实现了语义更扎实的掩码表示和视觉更对齐的语言条件。此外，还结合了轻量级的边界感知细化模块，在不扰动置信内部区域的情况下选择性地增强不确定区域。

Abstract: LLM-conditioned segmentation has recently advanced rapidly by coupling large language models with iterative mask generation frameworks. However, we identify a persistent failure mode in current propose-then-select pipelines. Although high-quality mask candidates are often generated, the final prediction may fail to match the given linguistic condition. This failure arises because language semantics are typically used as static prompts or post-hoc matching signals, rather than participating in the iterative mask generation process. Through systematic analysis, we show that many errors stem from semantic misalignment rather than poor mask quality. To address this issue, we propose FlowSeg, which introduces dynamic semantic guidance via a bidirectional semantic flow between intermediate decoding states and LLM-derived condition embeddings throughout the generation process. Language conditions actively guide mask refinement at each stage, while condition embeddings are progressively updated by emerging visual evidence. This design yields semantically grounded mask representations and visually aligned language conditions, enabling more reliable matching. We further incorporate a lightweight boundary-aware refinement to selectively enhance uncertain regions without perturbing confident interiors. Extensive experiments on referring expression segmentation and reasoning segmentation tasks demonstrate that FlowSeg consistently improves language-mask alignment and achieves state-of-the-art performance. Project page: https://zkzhang98.github.io/FlowSeg_page

[77] Benchmarking Large Vision-Language Models on CFMME: A Comprehensive Chinese Financial Multimodal Evaluation Dataset cs.CV | cs.AIPDF

Qian Chen, Xianyin Zhang, Yanzhi Liu, Lifan Guo, Feng Chen

TL;DR: 本文提出了一个名为CFMME的中文金融多模态评估基准，用于全面评估大型视觉语言模型在中文金融业务流程中的感知、理解、推理和认知能力。该基准包含6,052个样本，涵盖八种金融图像模态和四项核心多模态任务。作者在CFMME上对代表性LVLM进行了评估，发现当前最先进模型在问答任务上准确率为66.11%，在检测、识别和信息提取任务上平均得分为77.18%，表明现有模型仍有很大改进空间。

Details

Motivation: 为了全面评估大型视觉语言模型在中文金融业务全流程中的多模态能力，并弥补现有基准在金融领域和中文语境下的不足，作者构建了CFMME这一综合性评估数据集。

Result: 在CFMME基准上的评估结果显示，当前最先进的LVLM在问答任务上达到66.11%的准确率，在检测、识别和信息提取任务上的平均得分为77.18%，表明现有模型性能仍有显著提升空间。

Insight: 论文的创新点在于构建了首个专注于中文金融领域的综合性多模态评估基准CFMME，其覆盖了从基础学术知识到复杂实际应用的完整业务流程，并对模型的错误原因、跨模态能力和多方位设置进行了深入分析，为未来LVLM在垂直领域的优化提供了重要参考。

Abstract: The emergence of Large Vision-Language Models (LVLMs) has substantially expanded model capabilities beyond text-only understanding, enabling unified inference across both visual and textual modalities and supporting a broader range of real-world applications. To comprehensively evaluate the perception, understanding, reasoning, and cognition capabilities of LVLMs throughout the entire financial business workflow in Chinese contexts, we introduce CFMME, a novel Chinese financial multimodal evaluation benchmark. CFMME comprises 6,052 instances spanning from fundamental academic knowledge to complex real-world applications, covering eight primary financial image modalities and four core multimodal tasks. On CFMME, we conduct a thorough evaluation of representative LVLMs. The results show that the state-of-the-art model attains an overall accuracy of 66.11% on the question answering task and an average score of 77.18 on the detection, recognition, and information extraction tasks, indicating substantial room for improvement in current LVLMs. In addition, we conduct detailed analyses of error causes, cross-modal capabilities, and multi-orientation settings, yielding valuable insights for future research. We hope that CFMME will spur further progress in LVLMs, especially by improving their performance on multiple multimodal tasks in the financial domain.

[78] AnyMo: Scaling Any-Modality Conditional Motion Generation with Masked Modeling cs.CV | cs.AIPDF

Yiheng Li, Zhuo Li, Ruibing Hou, Yingjie Chen, Hong Chang

TL;DR: 本文提出了AnyMo框架，通过结合基于残差FSQ的运动分词器和可扩展的掩码建模Transformer，实现了在任意模态组合下的高质量人体运动生成。该工作还构建了大规模多模态对齐数据集OmniHuMo，包含超过5,000小时的运动数据和320万条序列，为多模态条件运动生成提供了重要数据基础。

Details

Motivation: 当前条件人体运动生成方法受限于固定的模态配置和任务特定架构，且缺乏大规模模态对齐数据，导致跨模态交互和多模态条件合成的扩展规律未被充分探索。

Result: 在OmniHuMo数据集上的大量实验表明，AnyMo能够实现高保真度的运动合成，并在空间和风格属性上提供灵活控制。

Insight: 创新点在于提出了统一的多模态框架AnyMo，结合了残差FSQ运动分词器和掩码建模Transformer，以及构建了大规模高质量多模态对齐数据集OmniHuMo，为任意模态条件运动生成提供了可扩展的解决方案。

Abstract: Conditional human motion generation remains a fundamental challenge in computer vision and robotics. Despite significant progress, current methods are often constrained by fixed modality configurations and task-specific architectures, leaving cross-modal interactions and the scaling laws of multimodal-conditioned synthesis largely underexplored. A key bottleneck is the scarcity of large-scale modality-aligned motion data, limiting generalization across diverse control signals. In this work, we introduce OmniHuMo, a large-scale, high-quality dataset comprising over 5,000 hours of motion and 3.2 million sequences with precisely aligned multimodal annotations (e.g., text, speech, music, and trajectory). Leveraging OmniHuMo, we propose AnyMo, a unified multimodal framework combining a Residual FSQ-based motion tokenizer with a scalable masked modeling transformer, enabling high-quality motion synthesis under arbitrary modality combinations. Extensive experiments show that AnyMo achieves high-fidelity synthesis while offering flexible control over both spatial and stylistic attributes.

[79] KGEdit: Ambiguity-Aware Knowledge Graphs for Training-Free Precise Video Generation and Editing cs.CVPDF

Mingshu Cai, Miao Zhang, Chenghe Yang, Yixuan Li, Osamu Yoshie

TL;DR: 本文提出KGEdit框架，通过构建歧义感知知识图谱（AAKG）对输入提示进行解耦和消歧，将其转换为身份、关系、属性和负约束四类结构化语义，并设计结构化语义注入模块（SSIM）与时间感知语义控制模块（TASC），以提升文本到视频（T2V）扩散模型在复杂指令下的语义精确性、概念绑定准确性和跨帧一致性。

Details

Motivation: 现有免训练视频生成方法在处理复杂文本指令时存在语义歧义、概念绑定错误和跨帧不一致等问题，KGEdit旨在通过结构化语义控制框架解决这些挑战。

Result: 实验表明，KGEdit在编辑精度和时间稳定性上优于现有方法，同时在文本驱动交互场景中提供了更高的效率和可控性。

Insight: 创新点包括歧义感知知识图谱的构建、结构化语义注入机制以及基于去噪过程阶段特性的动态语义目标调度，实现了对扩散Transformer的细粒度语义控制，提升了语义对齐与时间一致性。

Abstract: In recent years, training-free video generation has progressed remarkably. However, when handling complex textual instructions, existing methods still suffer from semantic ambiguity, incorrect concept binding, and cross-frame inconsistency. To address these issues, we propose KGEdit, a structured semantic control framework for text-to-video (T2V) diffusion models. Specifically, we first construct an ambiguity-aware knowledge graph (AAKG) to disentangle and disambiguate the input prompt, converting it into four types of structured semantics: identity, relation, attribute, and negative constraints. We then design a structured semantic injection module (SSIM) to inject these semantic signals into key layers of the diffusion Transformer, enabling fine-grained semantic control. In addition, we introduce a temporal-aware semantic control (TASC) module that dynamically schedules semantic objectives according to the stage-wise characteristics of the denoising process, further improving semantic alignment and temporal consistency. Experiments show that KGEdit outperforms existing methods in editing precision and temporal stability, while offering higher efficiency and controllability in text-driven interaction scenarios.

[80] RadioFormer3D: Weakly Supervised 3D Radio Map Estimation in Low-Altitude Airspace via Generative Modeling cs.CVPDF

Zheng Fang, Junjie Liu, Kangjun Liu, Jianguo Zhang, Yaowei Wang

TL;DR: 本文提出了RadioFormer3D模型，用于在弱监督条件下进行三维低空空域的无线电地图估计。该模型基于RadioFormer的双流多粒度融合架构，引入了基于傅里叶的采样编码器和体素解码器，以高效处理三维空间中的稀疏测量。为解决垂直维度监督不足的问题，作者提出了联合频谱完整性损失，在一个统一的优化方案中整合了体素级伪标签监督、地图级几何感知无线电渲染和像素级局部约束。

Details

Motivation: 随着无线应用（如低空空域和3D异构网络）在三维环境中的出现，无线电地图估计需要表征信号在水平和垂直维度的传播。然而，由于空间稀疏性增加和连续高度上监督有限，将无线电地图估计从2D扩展到3D仍然具有挑战性。

Result: 在多个无线电地图数据集上的大量实验表明，RadioFormer3D相比现有代表性方法实现了更优的整体性能。特别是在未标记高度上展示了改进的重建质量，同时在精度和推理效率之间保持了良好的平衡。

Insight: 主要创新点包括：1) 为3D频谱重建设计的专用弱监督模型架构，结合了傅里叶采样编码器和体素解码器；2) 联合频谱完整性损失，通过整合多粒度（体素、地图、像素）的监督和约束，有效缓解了垂直维度监督稀疏的问题，从而更好地捕捉复杂的垂直结构关系。

Abstract: With the emergence of wireless applications in three-dimensional environments, such as the low-altitude airspace and 3D heterogeneous networks, radio map estimation is increasingly required to characterize signal propagation across both horizontal and vertical dimensions. However, extending radio map estimation from 2D to 3D remains challenging due to increased spatial sparsity and limited supervision across continuous altitudes. In this paper, we propose \textbf{\textit{RadioFormer3D}}, a specialized model for volumetric spectrum reconstruction under weak supervision. Building on the dual-stream, multi-granularity fusion architecture of \textit{RadioFormer}, \textit{RadioFormer3D} introduces a Fourier-based sampling encoder and a volumetric decoder to efficiently process sparse measurements in 3D space. To alleviate the lack of vertical supervision, we propose the \textbf{\textit{Joint Spectrum Integrity Loss}}, which integrates volume-level pseudo-label supervision, map-level geometry-aware radio rendering, and pixel-level localized constraints within a unified optimization scheme. This design enables the model to capture complex vertical structural relationships more effectively under sparse supervision. Extensive experiments across several radio map datasets show that \textit{RadioFormer3D} achieves superior overall performance compared to representative existing methods. In particular, it demonstrates improved reconstruction quality at unlabeled altitudes while maintaining a favorable trade-off between accuracy and inference efficiency, positioning it as a highly promising solution for future 3D environment-aware wireless networks.

[81] GiPL: Generative augmented iterative Pseudo-Labeling for Cross-Domain Few-Shot Object Detection cs.CV | cs.AIPDF

Jiacong Liu, Shu Luo, Yikai Qin, Yaze Zhao, Yongwei Jiang

TL;DR: 本文提出GiPL框架，用于解决跨域少样本目标检测中支持集利用不足和过拟合问题。该框架包含两个分支：一是通过迭代伪标签自训练充分利用支持集数据；二是利用视觉语言模型生成领域对齐的增强图像以扩充样本。在多个数据集和少样本设置下，GiPL均显著超越现有方法。

Details

Motivation: 针对跨域少样本目标检测中，视觉语言基础模型在微调时面临支持集利用不足（因标注稀疏）和极端少样本下严重过拟合的问题。

Result: 在RUOD、CARPK、CarDD三个跨域少样本目标检测数据集上，于1/5/10-shot设置下进行了广泛实验，GiPL均一致显著优于最先进方法。

Insight: 创新点在于提出两分支训练框架：迭代伪标签自训练范式以挖掘支持集潜力，以及基于大视觉语言模型的生成式数据增强流程以合成领域对齐的多目标标注图像，从而协同提升模型泛化能力并抑制过拟合。

Abstract: Vision-language foundation models have shown promising zero-shot generalization for Cross-Domain Few-Shot Object Detection (CD-FSOD). However, they face two critical challenges in fine-tuning: insufficient support set utilization due to sparse single-instance annotations, and severe overfitting under extremely limited target-domain samples. To address these issues, this paper proposes GiPL, an efficient two-branch training framework.In the first branch, we design an iterative pseudo-label self-training paradigm, which performs zero-shot inference on the support set to generate reliable pseudo-annotations, fuses them with ground-truth labels, and iteratively optimizes the model to fully exploit support set data. In the second branch, we introduce generative data augmentation pipeline using large vision-language models, which synthesizes domain-aligned, multi-object annotated images to enrich training samples and suppress overfitting. Extensive experiments on three challenging CD-FSOD datasets (RUOD, CARPK, CarDD) under 1/5/10-shot settings demonstrate that GiPL consistently outperforms state-of-the-art methods with significant performance gains.Code is available at \href{https://github.com/z-yaz/CDiscover}{CDiscover}.

[82] From General Vision to Reliable Traversability Estimation: Adapting Vision Foundation Models for Unstructured Outdoor Environments cs.CV | cs.ROPDF

Ji-Hoon Hwang, Jisung Bae, Dong-Wook Kim, Yeonkyu Lee, Seung-Woo Seo

TL;DR: 本文提出了ViTA框架，用于将视觉基础模型（VFMs）适配到非结构化户外环境中的可通行性估计任务。该框架通过可学习的可通行性提示注入任务特定知识，采用视角多样化训练处理标注模糊性，并蒸馏几何知识以弥合语义与物理安全之间的差距，最终输出融合语义不确定性和几何风险的连续可通行性分数。

Details

Motivation: 当前基于视觉基础模型（VFMs）的可通行性估计方法面临三个根本挑战：VFMs的任务无关设计、可通行性标注的模糊性，以及语义标签与物理安全之间的差异，这些挑战影响了其可靠性。

Result: 在包括具有挑战性的真实世界越野数据集在内的多个领域评估中，ViTA在SAM2上实例化，实现了最先进的IoU和精确度，大幅减少了误报率，并展现出强大的跨域泛化能力。

Insight: 创新点包括：通过可学习提示将任务特定知识注入VFMs以保持其跨域泛化；利用视角多样化训练估计语义不确定性来抑制模糊边界处的自信预测；以及通过训练期间蒸馏几何知识，使模型仅从RGB图像推理坡度和高程，从而融合语义和几何信息生成连续可通行性分数。

Abstract: Vision-based approaches have become the dominant paradigm for traversability estimation in unstructured outdoor environments, typically adapting vision foundation models (VFMs) via semantic segmentation supervision. However, this paradigm faces three fundamental challenges that undermine its reliability: the task-agnostic design of VFMs, the ambiguity of traversability annotations, and the discrepancy between semantic labels and physical safety. We propose Vision-to-Traversability Adaptation (ViTA), a framework that adapts VFMs for reliable traversability estimation, instantiated on SAM2. ViTA injects task-specific knowledge through learnable traversability prompts while preserving the VFM’s cross-domain generalization. To handle annotation ambiguity, we introduce Perspective-Diversified Training, which estimates semantic uncertainty to suppress confident predictions at ambiguous boundaries. To bridge the semantic-traversability discrepancy, we distill geometric knowledge during training, enabling slope and elevation reasoning from RGB images alone at inference. The semantic and geometric outputs are fused into a continuous traversability score that reflects both semantic uncertainty and geometric risk. Evaluations across diverse domains, including challenging real-world off-road datasets, demonstrate that ViTA achieves state-of-the-art IoU and Precision with substantial false-positive reduction and strong cross-domain generalization.

[83] ReactBench: A Cause-Driven Benchmark for Multimodal Hallucination via Systematic Evaluation cs.CVPDF

Shizhe Zhou, Bohan Jia, Kai Wu, Yan Shen, Tongyun Li

TL;DR: 本文提出了ReactBench，一个针对多模态大语言模型幻觉问题的因果驱动基准测试。该基准通过生成对抗性图像和诱导幻觉的查询，设计了四个针对性任务来系统性地暴露模型在共现偏差、语言先验、跨图像比较感知和细粒度感知方面的缺陷。

Details

Motivation: 现有基准主要关注幻觉结果的检测，而非评估其根本原因，且场景简单、评估格式有限，难以挑战当前最先进的模型。ReactBench旨在填补这一空白，提供一个系统化、可解释的测试平台来诊断和改进多模态模型的鲁棒性。

Result: 广泛的评估表明，当前的多模态大语言模型对特定因果的幻觉触发仍然非常脆弱，验证了ReactBench作为诊断工具的价值。

Insight: 创新点在于从因果驱动而非结果检测的角度构建基准，通过对抗性任务设计（如关系擦除、反事实属性等）和思维链推理来细粒度识别幻觉子原因，提供了更系统、更具挑战性的评估框架。

Abstract: While multimodal large language models (MLLMs) have achieved rapid progress in vision-language understanding, they remain prone to multimodal hallucinations, producing responses that are inconsistent with the visual input. Existing benchmarks predominantly focus on detecting hallucination outcomes rather than evaluating the underlying causes of these failures. Moreover, many benchmarks rely on simplistic scenarios and limited evaluation formats that no longer challenge state-of-the-art models. To address these limitations, we introduce ReactBench, a cause-driven hallucination benchmark featuring multiple tasks and an exam-style evaluation format. By generating adversarial images and hallucination-inducing queries, ReactBench introduces four targeted tasks: Relational Erasure, Counterfactual Attribute, Alteration Tracing, and Dense Counting. These tasks systematically expose co-occurrence bias, language priors, cross-image comparative perception deficiencies, and fine-grained perceptual bottlenecks. Beyond standard accuracy-based evaluation, we leverage Chain-of-Thought reasoning to identify fine-grained sub-causes of hallucination within each task. Extensive evaluations reveal that current MLLMs remain notably vulnerable to cause-specific hallucination triggers, demonstrating the value of ReactBench as a systematic and interpretable testbed for diagnosing and improving multimodal model robustness. The project page is available at https://reactbench.github.io/.

[84] Mitigating State Aliasing in Vision-Language-Action Models via Inverse Dynamics Learning cs.CVPDF

Kyujin Lee, Injae Kim, Jihwan Park, Yejun Ju, Minseok Joo

TL;DR: 本文提出了一种通过逆动力学学习来缓解视觉-语言-动作模型中状态混淆问题的方法。该方法将预测当前与未来观测之间动作的逆动力学目标作为辅助任务，直接监督VLA的视觉编码器，以捕捉决定低级动作的细粒度视觉差异，并使用伪反转监督来提升泛化能力。

Details

Motivation: 现有的视觉-语言-动作模型源自预训练的视觉-语言模型，其表征对低级控制所需的细微视觉差异不敏感，导致视觉相似但所需动作截然不同的状态之间发生混淆，从而影响机器人操作性能。

Result: 在CALVIN ABC-D和SimplerEnv基准测试上的实验表明，该方法能持续提升多种VLA基线的性能。冻结编码器探测和状态特征对齐分析进一步证实，该方法学习了具有状态区分性的视觉表征，减少了状态混淆并更好地与机器人状态变化对齐。

Insight: 核心创新点在于引入逆动力学学习作为直接监督视觉编码器的辅助目标，以显式缓解状态混淆问题，并辅以伪反转监督来增强数据利用。该方法仅需标准观测-动作对，无需额外标注，且不改变原始推理流程，具有较好的通用性和实用性。

Abstract: Vision-Language-Action (VLA) models have emerged as a promising framework that unifies perception, reasoning, and control for robot manipulation by adapting pretrained vision-language models (VLMs) to action prediction. However, VLM-derived representations are often insensitive to subtle visual distinctions required for low-level control, causing state aliasing between visually similar states that require substantially different actions. Prior VLA studies improve visual understanding by generating visual or reasoning outputs, such as future frames, 2D grounding points or traces, or intermediate spatial reasoning steps, but these objectives typically shape the vision encoder only indirectly through end-to-end prediction and do not explicitly analyze state aliasing in the learned visual feature space. To mitigate state aliasing, we introduce inverse dynamics learning as an auxiliary objective that directly supervises the VLA vision encoder. By predicting the action between current and future observations, our objective encourages the encoder to capture fine-grained visual distinctions that determine low-level actions. We further use pseudo-reversed supervision to expose the encoder to a broader range of action directions and improve generalization under limited robot demonstrations. Our method applies to diverse VLA baselines, uses only standard observation-action pairs without additional annotations, and preserves the original inference pipeline at test time. Experiments on CALVIN ABC-D and SimplerEnv show consistent gains across diverse VLA baselines. Frozen-encoder probing and state-feature alignment analyses further show that our method learns state-discriminative visual representations that reduce state aliasing and better align with robot state changes.

Xiang Fang, Wanlong Fang, Changshuo Wang

TL;DR: 本文提出了CogniVerse，一个创新的多模态检索增强生成框架，旨在解决现有MMRAG系统中存在的检索噪声、跨模态语义错位、缺乏自适应推理以及局部与全局生成不连贯等问题。该框架通过认知反射模块、基于黎曼流形和信息几何的多模态检索模块以及基于最优传输的分层生成模块，显著提升了知识密集型问答任务的准确性和连贯性。

Details

Motivation: 现有MMRAG框架存在检索噪声大、跨模态语义不匹配、推理适应性差以及生成内容在局部与全局间不连贯等关键缺陷，限制了其在多模态知识密集型问答中的应用效果。

Result: 在广泛的实验中，CogniVerse在准确性和连贯性方面显著超越了当前最先进的系统，同时降低了检索延迟。

Insight: 创新点包括：引入认知反射模块动态评估检索必要性并过滤多模态内容；利用信息几何和谱图理论在黎曼流形中对齐嵌入并优化知识图谱；以及采用基于最优传输的损失函数实现分层生成，平衡词元级准确性与全局语义连贯性。

Abstract: Multi-modal Retrieval-Augmented Generation (MMRAG) has emerged as a powerful paradigm for enhancing Multimodal Large Language Models in knowledge-intensive question answering by integrating external visual, textual, and structural knowledge. However, existing MMRAG frameworks suffer from critical limitations, including noisy and irrelevant retrieval, cross-modal semantic misalignment, lack of adaptive reasoning, and incoherent generation across local and global contexts. We introduce \textbf{CogniVerse}, a novel MMRAG framework that addresses these challenges through a cognitive-inspired, mathematically rigorous approach. Drawing from human-like reasoning, CogniVerse integrates three synergistic components: (1) a Cognitive Reflection Module that dynamically assesses retrieval necessity and filters relevant multi-modal content, reducing noise and computational overhead; (2) a Multi-modal Retrieval Module that aligns embeddings in a Riemannian manifold using information geometry and refines knowledge graphs via spectral graph theory, ensuring precise and coherent retrieval; and (3) a Hierarchical Generation Module that employs an optimal transport-based loss to balance token-level accuracy and global semantic coherence. Extensive experiments demonstrate that CogniVerse significantly outperforms state-of-the-art systems in both accuracy and coherence, while reducing retrieval latency.

[86] AgentCVR: Active Multi-Agent Cross-Video Reasoning via Script-Simulated Reinforcement Learning cs.CV | cs.MAPDF

Yilun Qiu, Jiahe Wang, Cilin Yan, Jiayin Cai, Xiaolong Jiang

TL;DR: 本文提出AgentCVR，一个用于跨视频推理（CVR）的多智能体框架。该框架将CVR视为主动证据获取任务，通过一个主智能体迭代协调专门的视觉和音频智能体进行针对性证据提取。为了高效训练，作者引入了脚本模拟强化学习，利用LLM生成的语义脚本和轻量级文本模拟器优化策略，避免了在线探索时昂贵的多模态推理成本。

Details

Motivation: 当前的多模态大语言模型（MLLMs）在处理跨视频推理任务时，常因采用简单的单次编码策略将多个视频压缩到共享上下文中，而可能掩盖罕见但关键的证据，导致性能不佳。

Result: 在一个全面的CVR基准测试上的实验结果表明，AgentCVR超越了单次编码的基线方法，并在复杂的跨视频对齐和定位任务上，达到了与最先进的闭源系统相当的性能。

Insight: 论文的核心创新点在于将跨视频推理重构为主动的、迭代的证据获取过程，并采用多智能体架构进行分工协作。同时，提出的脚本模拟强化学习方法巧妙地利用文本模拟降低训练成本，为在资源受限下训练复杂的多模态交互策略提供了新思路。

Abstract: Cross-Video Reasoning (CVR) has emerged as a critical frontier in multimodal intelligence, requiring models to retrieve, align, and aggregate evidence distributed across multiple videos. Current Multimodal Large Language Models (MLLMs) often struggle with CVR, as simple single-pass strategies encode multiple videos into a shared compressed context, potentially obscuring rare but critical evidence. In this paper, we propose AgentCVR, a multi-agent framework that treats CVR as an active evidence-acquisition task. AgentCVR employs a Master Agent to iteratively coordinate specialized Visual and Audio Agents for targeted evidence extraction. To ensure efficient training, we introduce Script-Simulated RL, which optimizes the agent’s policy with LLM-generated semantic scripts and a lightweight text-based simulator, bypassing costly multimodal inference during online exploration. Experimental results on a comprehensive CVR benchmark show that AgentCVR outperforms single-pass baselines and achieves comparable performance to state-of-the-art closed-source systems, particularly in complex cross-video alignment and localization. To ensure reproducibility, our code is available at https://github.com/wang-jh24/AgentCVR.

[87] MARTIAN: A Rendering Framework for Aerial Mars Imagery from HiRISE Orbital Data cs.CVPDF

Dario Pisanti, Georgios Georgakis

TL;DR: MARTIAN是一个基于Blender的开源渲染框架，利用真实的HiRISE轨道地图数据合成火星地形的逼真航拍视图，以可控光照条件和不同高度生成带有精确位姿标注的观测数据，旨在解决火星视觉导航中大规模标注数据集稀缺的问题。

Details

Motivation: 火星空中导航需要视觉方法能适应火星表面多样的光照条件和地形形态，但训练和评估这些方法的关键瓶颈是缺乏大规模、带标注的航拍数据集。

Result: 该框架已在火星直升机Ingenuity和未来火星旋翼机的地图定位系统相关工作中得到验证，在真实火星图像上成功评估了合成数据训练的深度图像匹配器。

Insight: 创新点在于利用真实轨道地图产品合成可控条件下的逼真渲染数据，直接为火星视觉导航提供标注训练数据；从客观角度看，该方法通过模拟环境解决了数据稀缺问题，并已在实际应用中验证了其有效性。

Abstract: Aerial navigation on Mars requires vision-based pipelines that are robust to the diverse illumination conditions and terrain morphology of the Martian surface. A key bottleneck for training and evaluating such methods is the scarcity of large-scale, annotated aerial datasets. We present MARTIAN, an open-source Blender-based rendering framework that leverages real HiRISE orbital map products to synthesize realistic aerial views of the Martian terrain under controllable lighting conditions and at varying altitudes. MARTIAN generates observations with accurate pose annotations, directly addressing the scarcity of training data for vision-based navigation on Mars. The framework has been validated through its deployment in concurrent work on map-based localization systems for Ingenuity and future Mars rotorcraft, where synthetically trained deep image matchers were successfully evaluated on real Mars imagery. MARTIAN is publicly available at: https://github.com/nasa-jpl/martian.

[88] DiffSpot: Can VLMs Spot Fine-Grained Visual Differences in Web Interfaces? cs.CV | cs.CLPDF

Linhao Zhang, Aiwei Liu, Yuan Liu, Xiao Zhou

TL;DR: 本文提出了DiffSpot基准测试，用于评估视觉语言模型（VLMs）在网页界面中感知细微视觉差异的能力。该基准通过修改HTML元素的CSS属性生成受控的图像对，包含4400对图像，涵盖13种CSS属性操作符和三个难度等级。对13个前沿VLM的零样本评估显示，即使最佳模型也只能识别40.7%的真实变化，困难层级的召回率均低于23%。

Details

Motivation: 尽管视觉语言模型在高层图像-文本对齐方面取得进展，但其感知细微视觉差异的能力仍有限。本文旨在通过网页界面中的局部视觉变化来诊断VLM的细粒度感知能力，并为GUI代理和设计工具提供实用需求。

Result: 在DiffSpot基准上，13个前沿VLM的零样本评估结果显示，最佳模型的真实变化识别率仅为40.7%，所有模型在困难层级的召回率均低于23%。此外，难度与CSS属性高度相关，像素差异幅度或CLIP距离均无法可靠预测召回率。

Insight: 创新点包括：1）提出代码驱动的DiffSpot基准，通过受控的CSS属性突变生成图像对，确保像素差异局限于目标元素；2）揭示了VLM在细粒度视觉差异感知上的局限性，特别是困难层级的性能瓶颈；3）发现难度与CSS属性操作符的依赖性，挑战了传统基于像素或CLIP距离的预测方法。

Abstract: Vision-language models (VLMs) have made strong progress on high-level image-text alignment, yet their ability to perceive subtle visual differences remains limited. We study this problem in rendered web interfaces, where localized visual changes are both a diagnostic test of fine-grained perception and a practical requirement for GUI agents and design tools. We introduce \textbf{DiffSpot}, a code-driven benchmark for open-ended spot-the-difference on web interfaces. DiffSpot constructs controlled image pairs by mutating a single CSS property of a target element in self-contained HTML, re-rendering the page, and recording the changed property, element, and mutation magnitude. A grounding gate retains only pairs whose rendered pixel difference is confined to the target element. The benchmark contains 4{,}400 pairs, including 3{,}900 has-diff pairs balanced across 13 CSS-property operators and three difficulty tiers, plus 500 no-diff pairs for hallucination control. Evaluating 13 frontier VLMs zero-shot, we find that even the best model identifies only $40.7%$ of true changes, with Hard-tier Recall below $23%$ for every model. DiffSpot further shows that difficulty is strongly property-dependent: across CSS operators, neither pixel magnitude nor CLIP distance reliably predicts Recall.

[89] SuperVoxelGPT: Adaptive and Ordered 3D Tokenization for Autoregressive Shape Generation cs.CV | cs.GRPDF

Yuan Li, Congyi Zhang, Xifeng Gao, Xiaohu Guo

TL;DR: SuperVoxelGPT是一个用于自回归3D形状生成的框架，它通过自适应和确定性排序的‘超体素’（supervoxel）标记化方法，解决了现有3D标记化方案在序列长度与空间顺序保留之间的权衡问题。该方法首先根据文本提示预测几何显著性分布，并构建形状自适应的超体素分区，然后训练一个超体素VAE，并微调一个预训练的多模态大语言模型来生成有序的超体素标记序列。

Details

Motivation: 解决现有自回归多模态大语言模型在3D生成中，因3D标记化方案不足而难以扩展到高分辨率形状的问题。具体而言，基于集合的紧凑表示丢弃了确定性的空间顺序，导致序列预测模糊；而均匀或八叉树体素网格虽然保留了顺序，但存在严重冗余和序列过长的问题。

Result: 在Trellis-500K数据集上的实验表明，SuperVoxelGPT将标记序列长度减少到均匀体素标记化的12.8%，同时实现了最先进的生成质量，并比先前方法平均加速10倍。

Insight: 核心创新在于提出了‘自适应且有序的超体素标记化’方案。它通过预测几何显著性分布来指导构建形状自适应的超体素分区（使用显著性引导的质心Voronoi细分），从而在保留确定性空间顺序的同时，根据形状复杂度自适应分配标记粒度（复杂区域细粒度，平滑区域粗粒度），有效平衡了序列长度与信息完整性。

Abstract: Autoregressive multimodal large language models (MLLMs) enable 3D generation but struggle to scale to high-resolution shapes due to inadequate 3D tokenizations. Compact set-based representations discard deterministic spatial ordering, leading to ambiguous sequence prediction, while uniform or octree-based voxel grids preserve ordering at the cost of severe redundancy and excessively long sequences. This structural trade-off limits stable and efficient autoregressive 3D generation. We present SuperVoxelGPT, a representation-first framework that resolves this tension through adaptive and deterministically ordered supervoxel tokenization. Given a prompt, we first predict a coarse geometric saliency distribution and construct a shape-adaptive supervoxel partition using saliency-guided centroidal Voronoi tessellation, allocating fine-grained cells to complex regions and larger cells to smooth regions. Conditioned on the text and ordered supervoxel layout, we introduce a SuperVoxelVAE and fine-tune a pretrained MLLM to autoregressively generate supervoxel tokens. Experiments on Trellis-500K show that SuperVoxelGPT reduces token sequence length to 12.8% of uniform voxel tokenization while achieving state-of-the-art generation quality and an average 10$\times$ speedup over prior methods.

[90] OccamToken: Efficient VLM Inference with Training-Free and Budget-Adaptive Token Pruning cs.CV | cs.AIPDF

Geng Li, Guohao Chen, Ting Chen, Shilin Shan, Kuangji Zuo

TL;DR: 本文提出OccamToken，一种无需训练且预算自适应的视觉令牌剪枝框架，旨在解决视觉语言模型（VLM）推理时因长视觉令牌序列导致的计算和内存开销问题。该方法通过基于寄存器锚定的相对证据测试，替代传统的绝对排名剪枝范式，实现图像自适应冗余剪枝和查询自适应相关性剪枝，在多个VLM模型上显著提升准确率与效率的权衡。

Details

Motivation: 现有剪枝方法通常采用绝对排名范式，为视觉令牌分配重要性分数并保留固定的top-K子集，但这种方法存在根本性脆弱：注意力汇聚（attention sinks）会扭曲令牌重要性排名，且图像冗余和查询依赖性使得固定令牌预算在不同输入上不可靠。

Result: 在LLaVA-NeXT、LLaVA-v1.5和Qwen3-VL等模型上，OccamToken无需额外训练即可持续改善准确率-效率权衡。特别是在LLaVA-NeXT上，能将2,880个视觉令牌减少至约40个，同时保持超过93%的原始准确率，即使在极端1.4%的保留率下也能实现稳定的视觉令牌压缩。

Insight: 创新点在于用寄存器锚定的相对证据测试取代绝对令牌排名，利用寄存器令牌自然吸收低信息注意力模式的特点，将其作为稳定参考来识别真正信息丰富的视觉证据。这实现了动态、自适应的剪枝阈值，克服了固定预算和全局排名带来的局限性。

Abstract: Vision-language models (VLMs) rely on long visual token sequences for visual understanding, making the prefill stage expensive in both computation and memory. Most existing pruning methods follow an absolute-ranking paradigm, assigning importance scores to visual tokens and retaining a fixed top-K subset. In this work, we argue that this paradigm is fundamentally brittle: attention sinks distort token importance rankings, while image redundancy and query-dependent visual evidence make fixed token budgets unreliable across inputs. We propose OccamToken, a training-free framework that replaces absolute token ranking with register-anchored relative evidence testing. Instead of asking which tokens are globally important, OccamToken evaluates whether a visual token provides information beyond a register-based reference. Our key insight is that register tokens naturally absorb low-information attention patterns, making them a stable reference for identifying genuinely informative visual evidence. Based on this principle, OccamToken performs both image-adaptive redundancy pruning and query-adaptive relevance pruning through dynamic thresholds derived from register attention. Across LLaVA-NeXT, LLaVA-v1.5, and Qwen3-VL, OccamToken consistently improves the accuracy-efficiency trade-off without additional training. Notably, on LLaVA-NeXT, it reduces 2,880 visual tokens to approximately 40 while preserving over 93% of the original accuracy, enabling stable visual token compression even in the extreme 1.4% retention regime.

[91] SAFE-Pruner: Semantic Attention-Guided Future-Aware Token Pruning for Efficient Vision-Language-Action Manipulation cs.CVPDF

Shilin Ma, Chubin Zhang, Changyuan Wang, Yuji Wang, Yue Wu

TL;DR: 本文提出了一种名为SAFE-Pruner的即插即用视觉令牌剪枝框架，用于加速视觉-语言-动作（VLA）模型的实时推理。该方法通过引入未来层的注意力线索来指导剪枝决策，并利用语义注意力一致性来预测深层令牌的重要性，从而避免过早丢弃关键视觉信息。实验表明，该方法在仿真和真实场景中实现了高达1.89倍的加速，且成功率下降小于1.7%，性能优于现有最先进方法。

Details

Motivation: 现有视觉令牌剪枝方法主要基于浅层线索进行决策，存在丢弃深层所需视觉信息的风险，这限制了VLA模型在机器人控制等实时应用中的高效推理。

Result: 在仿真和真实世界实验中，该方法实现了高达1.89倍的推理加速，成功率下降小于1.7%，并在性能上优于最先进方法达1.9%。

Insight: 创新点在于发现了VLA模型在执行步骤间注意力集中在同一语义实体上的语义注意力一致性现象，并据此设计了前瞻性策略来预测深层令牌显著性，同时引入自适应子任务划分策略以检测注意力突变，从而提高了剪枝的准确性和稳定性。

Abstract: Real-time inference of vision-language-action (VLA) models is essential for robotic control. While visual token pruning has shown strong potential for accelerating inference, most existing methods mainly base pruning decisions on shallow-layer cues and risk discarding visual information required by deep layers. To address this issue, we propose SAFE-Pruner, a plug-and-play pruning framework that incorporates attention cues of future layers into pruning decisions. Specifically, we identify semantic attention consistency, the tendency that VLA models concentrate their attention probability mass on the same semantic entity across execution steps. Based on this observation, we design a forward-looking strategy to forecast the token saliency in deep layers, which prevents the premature removal of critical tokens and leads to more stable acceleration. We further introduce an adaptive subtask division strategy to detect abrupt attention shifts, thereby improving forecasting accuracy and pruning reliability. Extensive experiments in simulation and real-world settings demonstrate that our method achieves up to 1.89x speedup with a minimal degradation in success rate of less than 1.7%, while outperforming state-of-the-art methods by up to 1.9%.

[92] Unsupervised Semantic Segmentation Facilitates Model Understanding cs.CVPDF

Xiaoyan Yu, Lisa Mais, Jannik Franzen, Peter Hirsch, Nick Lechtenbörger

TL;DR: 本文提出了一种基于无监督语义分割的可视化协议，旨在直观地揭示自监督学习（SSL）模型中不同预训练方法（如对比学习CL和掩码图像建模MIM）的行为差异，包括位置偏差、缩放行为和边界伪影等，以促进更广泛的模型理解。

Details

Motivation: 当前自监督学习模型的内部机制理解尚未普及，针对CL模型的见解常被错误推广到MIM模型，因此需要一种简单直观的可视化方法，使模型行为易于被广泛社区理解。

Result: 通过对多种SSL模型在不同层和表示上进行基准测试，该协议揭示了新颖的位置偏差和缩放行为，例如在DINOv3-Large模型令牌中观察到强烈的边界伪影，这些结果补充了先前发现。

Insight: 创新点在于利用无监督语义分割作为可视化工具，专注于传达跨图像一致的模型行为而非分割性能，并能清晰区分位置效应与局部性偏差，为模型理解提供了可访问的视觉分析框架。

Abstract: Self-supervised learning (SSL) has produced a diverse landscape of vision transformers (ViTs) whose pretrained representations support a wide range of downstream tasks. Towards a better understanding of these models, a body of work has assessed the mechanics of their self-attention as well as the types of information captured across their representations, revealing, for example, stark differences between models trained with contrastive learning (CL) and masked image modeling (MIM). However, these advances in model understanding have not yet fully permeated the broader community, where insights specific to CL models are sometimes generalized to MIM models. To make model understanding straightforward and intuitive for a broad audience, we propose a simple and easily interpretable visualization protocol. Our protocol is based on visualizing unsupervised semantic segmentation results, yet our goal is not to maximize segmentation performance. Instead, it allows us to convey model behaviors that consistently emerge across images. Benchmarking a diverse set of SSL models across layers and representations, we obtain novel insights into distinct positional biases and scaling behaviors, including strong boundary artifacts in DINOv3-Large model tokens. These insights complement and help communicate a range of previous findings. Our protocol further enables a clear visual distinction between positional effects and the closely related but distinct locality bias, which has been studied much more extensively in the literature. The protocol is publicly available on GitHub and we believe it will catalyze further model understanding for a broad community.

[93] GeoMag: Geometric-Aware Video Motion Magnification via State Space Model cs.CVPDF

Kecheng Han, Yuchen Zhang, Bingqing Liu, Boqiang Guo, Wenbin Zheng

TL;DR: 本文提出GeoMag，一种基于状态空间模型的几何感知视频运动放大框架，旨在解决现有方法在复杂几何变换下结构不一致的问题，并通过构建大规模合成数据集Geo-200K提升训练信号的多样性和真实性。

Details

Motivation: 现有学习型视频运动放大方法面临CNN全局上下文有限与Transformer计算成本高的权衡，且训练协议多基于简单线性运动，难以捕捉真实视频中的几何和成像复杂性。

Result: 在合成和真实世界基准测试上的广泛实验表明，GeoMag在视觉保真度和计算效率上持续优于先前方法，产生更少的伪影和更好的结构一致性。

Insight: 创新点包括利用状态空间模型实现线性复杂度的全局一致运动放大，以及引入包含丰富几何变换和传感器真实退化的大规模合成数据集，以增强模型对现实场景的泛化能力。

Abstract: Video Motion Magnification (VMM) reveals imperceptible dynamics but often suffers from structural inconsistencies under complex geometric transformations. Existing learning-based methods generally face a trade-off between the limited global context of CNNs and the high computational cost of Transformers. In addition, current training protocols, largely dominated by simple linear motion, fail to capture the geometric and imaging complexities encountered in real-world videos. To address these issues, we propose GeoMag, a geometric-aware VMM framework built upon State Space Models to achieve globally consistent motion amplification with linear complexity. We further construct Geo-200K, a large-scale synthetic dataset that introduces rich geometric transformations together with sensor-realistic degradations, improving the diversity and realism of training signals. Extensive experiments on synthetic and real-world benchmarks show that GeoMag consistently outperforms prior methods in visual fidelity and computational efficiency, while producing fewer artifacts and better structural consistency.

Xiang Fang, Daizong Liu, Wanlong Fang, Pan Zhou, Zichuan Xu

TL;DR: 本文提出了一种名为SpotVMR的高效视频片段检索方法，旨在解决现有视频时刻检索（VMR）方法在处理长视频时因固定长度下采样导致的边界模糊和计算效率低下的问题。该方法通过一个可插拔的片段搜索模块，基于语言查询动态修剪相关视频片段，从而减少计算步骤并提升检索性能。

Details

Motivation: 现有VMR方法通常将未修剪视频稀疏下采样为固定长度的片段，这可能导致查询相关帧被过滤，引入边界偏差和推理偏差，且在处理长达数小时的真实世界视频时计算不可行。

Result: 在三个具有挑战性的数据集上进行广泛实验，证明了SpotVMR的有效性；它作为即插即用模块，能在保持良好检索性能的同时，显著提升现有最先进VMR方法的效率。

Insight: 创新点包括设计了一个基于语言查询的片段搜索模型来识别有前景的视频区域，并引入低成本语义索引特征以捕获对象和交互的上下文信息；此外，通过蒸馏损失解决了片段选择器与VMR模型端到端联合训练的优化问题。

Abstract: Given an untrimmed video and a sentence query, video moment retrieval using language (VMR) aims to locate a target query-relevant moment. Since the untrimmed video is overlong, almost all existing VMR methods first sparsely down-sample each untrimmed video into multiple fixed-length video clips and then conduct multi-modal interactions with the query feature and expensive clip features for reasoning, which is infeasible for long real-world videos that span hours. Since the video is downsampled into fixed-length clips, some query-related frames may be filtered out, which will blur the specific boundary of the target moment, take the adjacent irrelevant frames as new boundaries, easily leading to cross-modal misalignment and introducing both boundary-bias and reasoning-bias. To this end, in this paper, we propose an efficient approach, SpotVMR, to trim the query-relevant clip. Besides, our proposed SpotVMR can serve as plug-and-play module, which achieves efficiency for state-of-the-art VMR methods while maintaining good retrieval performance. Especially, we first design a novel clip search model that learns to identify promising video regions to search conditioned on the language query. Then, we introduce a set of low-cost semantic indexing features to capture the context of objects and interactions that suggest where to search the query-relevant moment. Also, the distillation loss is utilized to address the optimization issues arising from end-to-end joint training of the clip selector and VMR model. Extensive experiments on three challenging datasets demonstrate its effectiveness.

[95] Improving CLIP Adaptation by Breaking Tail Alignment for Source-Free Cross-Domain Few-Shot Learning cs.CVPDF

Shuai Yi, Yixiong Zou, Yuhua Li, Ruixuan Li

TL;DR: 本文针对基于CLIP的跨域少样本学习任务，提出了一种新颖的自适应尾-头对齐微调策略ATHA。研究发现，在域偏移大且训练数据稀缺的情况下，主动推开低相似度的图像补丁标记（尾标记）与对应文本嵌入的对齐，反而能提升目标域性能。该方法在四个具有挑战性的CDFSL基准测试上实现了最先进的性能。

Details

Motivation: 解决CLIP模型在跨域少样本学习场景下，由于域偏移大和训练数据稀缺，传统微调范式对所有图像补丁标记进行均匀对齐会导致对稀缺训练数据的过度拟合，从而性能显著下降的问题。

Result: 在四个具有挑战性的跨域少样本学习基准测试上进行了广泛实验，验证了所提ATHA方法实现了最先进的性能。

Insight: 核心创新点在于揭示了在特定条件下（大域偏移、数据稀缺），并非所有图像标记都应与文本对齐，主动打破低相似度“尾标记”的对齐反而有益。这挑战了均匀对齐的普遍信念，并提出了一种包含对齐增强和减弱的自适应对齐范式，为视觉语言模型的微调提供了新视角。

Abstract: Vision-Language Models (VLMs) such as CLIP demonstrate strong zero-shot generalization, but their performance significantly degrades in cross-domain scenarios with scarce target-domain training data (Cross-Domain Few-Shot Learning, CDFSL). In this paper, we focus on the target-domain few-shot finetuning in the CLIP-based CDFSL task. Prevailing finetuning paradigms uniformly align all image patch tokens with their corresponding textual embeddings. However, we find a counterintuitive phenomenon: actively pushing away certain low-similarity image tokens, termed “tail tokens”, from their textual embeddings consistently improves target-domain performance. We delve into this phenomenon and provide a novel interpretation: under great domain shifts and scarce training data, the model can hardly extract semantic information from visual inputs; therefore, the common belief of alignment is valid only for tokens already containing sufficient semantic information; for tail tokens, forcing the alignment would lead to excessive overfitting to the scarce training, while breaking the alignment is more useful. Motivated by this, we propose Adaptive Tail-Head Alignment (ATHA), a novel fine-tuning strategy for CLIP that transforms the conventional uniform alignment paradigm to an adaptive alignment paradigm, with both alignment strengthening and weakening. Extensive experiments on four challenging CDFSL benchmarks validate our state-of-the-art performance. Our code is available at https://github.com/shuaiyi308/ATHA.

[96] Low-Magnification SEM May Suffice: Interpretable Deep Learning for Multi-Scale Fracture-Cause Classification in Zirconia-Toughened Alumina cs.CV | cond-mat.mtrl-sci | eess.IVPDF

Julian Schmid, Pawel Astankow, Tom Vater, Julius Beck, Robert Cichon

TL;DR: 本文提出了一种基于可解释视觉变换器（ViT）的工作流程，用于自动分类氧化铝基复合材料（BIOLOX delta）中骨折成因。该方法在低放大倍数（50x）下表现出与高放大倍数（1k-10kx）相当的性能，表明宏观特征（镜面几何和裂纹线场）已包含足够的诊断信息，可用于陶瓷植入物质量保证的低倍预筛选。

Details

Motivation: 当前用于识别氧化铝基复合材料髋关节和膝关节植入物中骨折起源的断口分析工作流程耗时、部分主观且依赖高倍扫描电子显微镜（SEM），因此需要一种自动化、可解释的分类方法来提高效率与可靠性。

Result: 在严重类别不平衡的数据集上，微调后的ViT在分层五折交叉验证中达到了0.907的准确率和0.888的宏观F1分数；低放大倍数（50x）下的性能与高放大倍数（1k-10kx）相当。

Insight: 创新点在于利用可解释ViT进行骨折成因分类，并通过Grad-CAM归因可视化与经典断口学特征（如镜面、裂纹线、气孔、加工痕迹）对齐，验证了低倍SEM图像中宏观特征已足够用于诊断，这为减少对高倍、耗时检查的依赖提供了新思路。

Abstract: Reliable identification of fracture origins in alumina matrix composite hip and knee implants is critical for quality assurance and patient safety, yet current fractographic workflows are time-consuming, partly subjective, and reliant on high-magnification scanning electron microscopy (SEM). We present an interpretable vision-transformer (ViT) workflow for automated classification of fracture causes in an alumina matrix composite (BIOLOX delta, CeramTec GmbH) widely used in total joint replacements. A dataset of 8,493 SEM images (50x-10,000x) was curated from five years of in-production burst and proof tests and annotated into three defect categories defined along the manufacturing chain: green body, hard machining, and material defects. Under severe class imbalance, the fine-tuned ViT reached an accuracy of 0.907 and a macro-F1 of 0.888 in stratified five-fold cross-validation, with a two-stage perceptual-hash/SSIM leakage audit confirming negligible specimen overlap. Notably, performance at low magnification (50x) was comparable to that at high magnification (1k-10kx), indicating that macro-scale features - mirror geometry and hackle line fields - already encode sufficient diagnostic signal. Grad-CAM attributions consistently localised on canonical fractographic cues (mirrors, hackles, pores, machining marks), aligning with established fractographic criteria. Together, these results position interpretable ViTs as a complementary tool for ceramic-implant quality assurance, enabling low-magnification pre-screening and reducing reliance on time-intensive high-magnification inspection.

[97] Not All Inputs Are Valid: Towards Open-Set Video Moment Retrieval Using Language cs.CVPDF

Xiang Fang, Wanlong Fang, Daizong Liu, Xiaoye Qu, Jianfeng Dong

TL;DR: 本文提出了一种新的开放集视频时刻检索（OS-VMR）任务，旨在处理视频无关查询（OOD查询）的识别与拒绝，并提出了OpenVMR模型，该模型利用归一化流技术区分ID和OOD查询，并结合视频-查询匹配和帧-查询匹配进行跨模态交互，通过正未标记学习模块实现时刻检索。

Details

Motivation: 现有视频时刻检索方法基于封闭集假设，无法处理开放场景中的视频无关查询，可能导致高风险场景（如犯罪活动检测）中的不可恢复损失，因此需要探索能同时处理相关查询检索和无关查询拒绝的新设置。

Result: 在三个VMR数据集上的实验结果表明，OpenVMR模型在开放集视频时刻检索任务中有效，能够准确区分ID和OOD查询并完成检索。

Insight: 创新点包括引入开放集VMR设置、利用归一化流学习ID分布并引入不确定性分数界定ID-OOD边界，以及结合粗粒度与细粒度跨模态交互设计；客观分析认为，该方法将异常检测技术（如归一化流）融入跨模态检索，为开放集视频理解提供了新思路。

Abstract: Video Moment Retrieval (VMR) targets to retrieve the specific moment corresponding to a sentence query from an untrimmed video. Although recent works have made remarkable progress in this task, they implicitly are rooted in the closed-set assumption that all the given queries as video-relevant\footnote{In this paper, we treat video-relevant query'' as in-distribution (ID) query’’ and video-irrelevant query'' as out-of-distribution (OOD) query’’.}. Given an OOD query in open-set scenarios, they still utilize it for wrong retrieval, which might lead to irrecoverable losses in high-risk scenarios, \textit{e.g.}, criminal activity detection. To this end, we creatively explore a brand-new VMR setting termed Open-Set Video Moment Retrieval (OS-VMR), where we should not only retrieve the precise moments based on ID query, but also reject OOD queries. In this paper, we make the first attempt to step toward OS-VMR and propose a novel model \textbf{OpenVMR}, which first distinguishes ID and OOD queries based on the normalizing flow technology, and then conducts moment retrieval based on ID queries. Specifically, we first learn the ID distribution by constructing a normalizing flow, and assume the ID query distribution obeys the multi-variate Gaussian distribution. Then, we introduce an uncertainty score to search the ID-OOD separating boundary. After that, we refine the ID-OOD boundary by pulling together ID query features. Besides, video-query matching and frame-query matching are designed for coarse-grained and fine-grained cross-modal interaction, respectively. Finally, a positive-unlabeled learning module is introduced for moment retrieval. Experimental results on three VMR datasets show the effectiveness of our OpenVMR.

[98] Masked Diffusion Vision-Language Models for Temporal Action Localization cs.CVPDF

Fengshun Wang, Zhengbo Zhang, Zhigang Tu

TL;DR: 本文提出了一种基于掩码扩散视觉语言模型（MDVLM）的时间动作定位方法，通过迭代去噪和双向注意力机制，联合优化语义内容和时间边界。针对TAL任务中的不匹配问题，引入了计划训练目标和步级IoU奖励，在多个基准数据集上提升了时间推理和边界定位性能。

Details

Motivation: 现有基于视觉语言的自回归解码器在时间动作定位中从左到右生成标记，无法利用后续语义证据修正先前的时间戳预测，限制了边界定位的准确性。

Result: 在ActivityNet-RTL、ActivityNet-1.3和THUMOS-14数据集上的实验表明，MDVLM-TAL在时间推理和边界定位方面优于自回归视觉语言基线，尤其在更严格的时间IoU标准下提升显著。

Insight: 创新点包括将掩码扩散模型引入TAL以实现双向联合优化，以及针对任务特性设计的计划训练目标（边界感知掩码和步加权重建）和步级IoU奖励，增强了时间边界的可修正性和重叠感知监督。

Abstract: Temporal action localization (TAL) requires recognizing the target event and localizing its start and end times precisely in untrimmed videos. Recent vision-language formulations improve semantic reasoning and support language-conditioned outputs, but their autoregressive decoders still generate tokens from left to right, preventing later semantic evidence from revising earlier timestamp predictions. We adapt masked diffusion vision-language models (MDVLMs) to TAL so that semantic tokens and boundary tokens remain editable throughout iterative denoising with bidirectional attention, allowing temporal boundaries and semantic content to be refined jointly. Direct adaptation, however, creates two TAL-specific mismatches: standard masked diffusion training corrupts all positions uniformly at random, but the time tokens are more reliable when enough semantic context is available; and token-level cross-entropy does not reflect temporal IoU. To address these mismatches, we introduce a Planned Training Objective that uses boundary-aware masking and step-weighted reconstruction to rehearse the late recovery of time tokens, together with a Step-Level IoU Reward that provides overlap-aware supervision during denoising. A standard sequence-level cross-entropy term provides the base reconstruction signal. Experiments on ActivityNet-RTL, ActivityNet-1.3, and THUMOS-14 show that MDVLM-TAL improves both temporal reasoning and boundary localization over autoregressive vision-language baselines, with especially strong gains under stricter temporal IoU criteria.

[99] Parameter-Efficient Subspace Decoupling ViT for Mitigating Multi-Task Negative Transfer in Histological Scoring cs.CV | cs.LG | cs.MMPDF

Youhan Huang, Jiajun Li, Yilin Fang, Shuai Wang, Chuheng Li

TL;DR: 本文提出了一种参数高效的子空间解耦视觉Transformer（ViT）方法，用于缓解组织学评分中多任务学习的负迁移问题。该方法通过集成轻量级任务特定适配器并结合基于正交性的约束，为脂肪变性、气球样变和炎症构建独立的特征子空间，从而减少任务干扰并保留共享表示。作者还构建了一个经过专家标注的多任务小鼠NAFLD组织学数据集，实验结果表明该方法在显著降低计算成本的同时提升了多任务稳定性和泛化能力。

Details

Motivation: 自动化组织学评分对于诊断非酒精性脂肪性肝病（NAFLD）至关重要，但由于高标注成本以及多任务学习中高度相关的NAFLD活动评分（NAS）指标之间存在负迁移问题，其自动化仍面临挑战。

Result: 实验结果表明，所提方法在构建的多任务小鼠NAFLD组织学数据集上，相比训练单独的单任务模型，以显著降低的计算成本提升了多任务稳定性和泛化能力。

Insight: 创新点在于将轻量级任务特定适配器与基于正交性的约束相结合，以构建独立的特征子空间来解耦高度相关的多任务，从而有效缓解负迁移，这是一种参数高效且可推广的多任务学习设计思路。

Abstract: Histological scoring is essential for diagnosing Non-Alcoholic Fatty Liver Disease (NAFLD), yet its automation remains challenging due to the high annotation cost and negative transfer among the strongly correlated NAFLD Activity Score (NAS) indicators in multi-task learning. To address this issue, we propose a subspace-decoupled multi-task Vision Transformer (ViT) that integrates lightweight task-specific Adapters with orthogonality-based constraints. This design constructs independent feature subspaces for steatosis, ballooning, and inflammation, effectively reducing task interference while retaining shared representations. We further construct a curated multi-task mouse NAFLD histology dataset with expert annotations for all NAS components. Experimental results demonstrate that the proposed method improves multi-task stability and generalization with substantially reduced computational cost compared to training separate single-task models. The code and the curated dataset have been prepared and will be made publicly available upon acceptance to support reproducibility.

[100] DGSG-Mind: Dynamic 3D Gaussian Scene Graphs for Long-Term Scene Understanding and Grounding cs.CV | cs.ROPDF

Luzhou Ge, Xiangyu Zhu, Jinyan Liu, Xuesong Li

TL;DR: 本文提出了DGSG-Mind系统，一个结合了概率体素网格与显式3D高斯模型的混合实例感知动态3D场景图系统。该系统旨在解决长期场景理解中实例关联脆弱、处理物体级拓扑变化能力有限的问题，通过鲁棒的跨模态实例融合、增量式语义建图以及基于几何-语义一致性的动态更新机制来实现。

Details

Motivation: 现有方法在将开放词汇语义信息集成到动态3D场景表示中时，常因跨视图线索不完整而导致实例关联脆弱，且处理物体级拓扑变化的能力有限，这限制了长期机器人任务的执行。此外，当前3D场景理解方法要么依赖简单的特征匹配而缺乏显式空间推理，要么假设离线真值3D几何。

Result: 大量实验表明，DGSG-Mind在基于自重建地图运行的方法中，取得了最佳的零样本3D视觉定位（3DVG）性能，同时在3D开放词汇语义分割和场景重建任务中也表现出色。该系统已部署在真实机器人上，展示了其面向目标的推理和动态更新能力。

Insight: 创新点在于提出了一种混合表示（概率体素网格+显式3D高斯）以实现鲁棒的跨模态实例融合与增量建图，并构建了层次化场景图（3D Gaussian Mind）来整合结构关系、空间语义信息和视觉标注的RoI高斯渲染，以支持多模态推理。系统通过基于高斯的视觉重定位和局部掩码优化来处理动态变化，这是一个值得借鉴的、结合了概率与显式表示的动态场景理解框架。

Abstract: Integrating open-vocabulary semantic information into dynamic 3D scene representations is essential for long-term embodied scene understanding. However, existing methods often suffer from fragile instance association due to incomplete cross-view cues, while their limited ability to handle object-level topological changes restricts long-term robotic task execution. Moreover, current 3D scene understanding methods either rely on simple feature matching without explicit spatial reasoning or assume offline ground-truth 3D geometry. To address these challenges, we present DGSG-Mind, a hybrid instance-aware 3D Gaussian dynamic scene graph system with an embodied reasoning agent. Our system couples a probabilistic voxel grid with explicit 3D Gaussians to enable robust cross-modal instance fusion and incremental semantic mapping. It handles dynamic changes through Gaussian-based visual relocalization and localized masked refinement guided by geometric-semantic consistency. Built on the instance Gaussian map, DGSG-Mind further constructs a hierarchical scene graph and develops the 3D Gaussian Mind, which integrates structural relations, spatial-semantic information, and visually annotated RoI Gaussian renderings for multimodal reasoning. Extensive experiments show that DGSG-Mind achieves the best zero-shot 3DVG performance among methods operating on self-reconstructed maps, while also delivering strong performance in 3D open-vocabulary semantic segmentation and scene reconstruction. We further deploy DGSG-Mind on real-world robots to demonstrate its target-oriented reasoning and dynamic update capabilities. The project page of DGSG-Mind is available at https://icr-lab.github.io/DGSG-Mind

[101] Mitigating Hallucination in Vision-Language Models through Barrier-Regulated Adaptive Closed-form Steering cs.CV | cs.AIPDF

Soumyadeep Jana, Pulkit Mittal, Sanasam Ranbir Singh

TL;DR: 本文提出了一种名为BRACS的训练无关的引导框架，旨在缓解大型视觉语言模型（LVLM）中的幻觉问题。该方法通过监控模型自身的注意力来衡量视觉基础，仅在基础退化时对隐藏状态进行校正，且校正更新以闭式解析形式计算，无需额外训练。实验表明，BRACS在幻觉基准上优于现有方法，同时在通用多模态基准上保持或提升性能，且保持了较高的推理效率。

Details

Motivation: 大型视觉语言模型（LVLM）经常幻觉出输入图像中不存在的物体，主要原因是视觉基础能力随着解码过程而减弱。现有的推理时缓解方法存在三个关键局限：缺乏明确的基础目标、在模型已具备良好基础时仍进行干预，以及使用固定的校正强度而无法适应基础失效的严重程度。

Result: 在LLaVA-1.5-7B和Qwen-VL-Chat模型上的实验表明，BRACS在幻觉基准上持续优于先前方法，将CHAIR_s降低了9.4个百分点，并将POPE F1提高了2.7个百分点。同时，在四个通用多模态基准上，其性能达到或超越了基线水平。在效率方面，BRACS的推理吞吐量达到贪婪解码的80%，平均速度比基线快1.3倍。

Insight: 论文的创新点在于提出了一个基于屏障调节的自适应闭式引导框架。其核心思想是：1）利用模型自身的注意力作为视觉基础的监控信号，实现按需干预；2）通过闭式解析计算校正更新，避免了辅助网络的训练或模型重训练，保证了方法的轻量性和高效性。这为推理时缓解幻觉问题提供了一种新的、自适应的、无需训练的解决方案。

Abstract: Large vision-language models (LVLMs) often hallucinate objects that are not present in the input image, largely because visual grounding weakens as decoding progresses. Existing inference-time mitigation methods modify logits or hidden states throughout generation, but they suffer from three key limitations: they lack an explicit grounding objective, intervene even when the model is already well-grounded, and use fixed correction strengths that do not adapt to the severity of grounding failure. We propose BRACS (Barrier-Regulated Adaptive Closed-form Steering), a training-free steering framework that addresses these issues through barrier-regulated adaptive closed-form steering. BRACS monitors the model’s own attention to measure visual grounding and applies corrections to the hidden states only when grounding deteriorates. The corrective update is computed analytically in closed form, requiring no training of auxiliary networks or model retraining. Experiments on LLaVA-1.5-7B and Qwen-VL-Chat show that BRACS consistently outperforms prior methods on hallucination benchmarks, reducing CHAIR$_s$ by 9.4 points and improving POPE F1 by 2.7 points, while matching or improving performance on four general multimodal benchmarks. BRACS also remains efficient, operating at 80% of greedy decoding throughput and achieving 1.3 times higher speed on average than the baselines.

[102] Train the Agent, Not the Expert: Learning to Harness Heterogeneous Experts for Multi-Turn Visual Reasoning cs.CVPDF

Yaowu Fan, Tao Han, Dazhao Du, Andy J. Ma, Jia Wan

TL;DR: 本文提出VisHarness，一种可训练的视觉智能体，它将高层感知、推理和决策与低层任务执行解耦。该智能体不直接训练模型解决特定视觉任务，而是学习利用一组精心设计的异构视觉专家模型，通过多轮交互解决复杂视觉任务。

Details

Motivation: 当前计算机视觉领域存在大量强大的专用模型，但它们通常针对孤立任务优化，难以直接支持需要复杂语言理解和密集小目标感知的通用视觉智能任务。

Result: 在涵盖推理分割、广义指称分割、密集小目标检测和指称计数四个代表性基准测试上，VisHarness显著优于现有通用模型，并与任务专用模型相比取得了相当或更优的性能。

Insight: 核心创新在于提出了一种解耦高层智能与底层执行的智能体范式，通过轻量级训练学习通用的视觉专家调用策略。此外，引入动态视觉记忆归档技术，有效缓解了与视觉专家模型多轮交互带来的视觉令牌开销累积问题，从而支持高效的在线策略强化学习训练。

Abstract: Recent progress in computer vision has produced a wide range of powerful specialized models for detection, segmentation, counting, and other visual tasks. However, these models are usually optimized for isolated task formulations, making it difficult to directly support general-purpose visual intelligence, especially when a task requires complex language understanding and dense small-object perception. In this paper, we propose VisHarness, a trainable visual agent that decouples high-level perception, reasoning, and decision-making from low-level task execution. Instead of training a model to solve a specific visual task, VisHarness learns to harness a set of carefully designed heterogeneous visual experts. This paradigm preserves the general intelligence of the agent while fully leveraging the precision advantages of specialized visual models in concrete visual tasks. With only lightweight training, VisHarness learns a generalizable visual expert-harnessing policy and can solve common fundamental vision tasks under various complex conditions through multi-turn interactions with visual expert models. To enable efficient on-policy reinforcement learning training in a live environment, we introduce dynamic visual memory archiving, which mitigates the rapidly accumulating visual-token overhead caused by multi-turn interactions with visual expert models. Experiments on four representative benchmarks covering reasoning segmentation, generalized referring segmentation, dense small-object detection, and referring counting demonstrate that VisHarness substantially outperforms existing general-purpose models and achieves competitive or superior performance compared with task-specific models.

[103] SwInception – Local Attention Meets Convolutions cs.CVPDF

David Hagerman, Roman Naeem, Jakob Lindqvist, Carl Lindström, Fredrik Kahl

TL;DR: 本文提出了一种名为SwInception的新型架构，通过在前馈层中引入Inception模块来增强Swin Transformer的归纳偏置，旨在解决Swin在小数据集上容易过拟合的问题，并在解码器层进行修改以用更少参数捕获更精细细节。该模型在包括Medical Segmentation Decathlon在内的十一个医学数据集上展现了性能提升，为稀疏视觉Transformer在医学和自然图像分割任务中的能力增强提供了新途径。

Details

Motivation: 稀疏视觉Transformer（如Swin）在医学体积分割中作为高效编码器很受欢迎，但Swin在小数据集上仍容易过拟合，因此需要增强其归纳偏置以缓解这一弱点。

Result: 在十一个不同的医学数据集上通过广泛实验证明了性能改进，特别是在Medical Segmentation Decathlon和Beyond the Cranial Vault等基准挑战上超越了先前的最先进骨干网络。

Insight: 创新点在于将Inception块引入Transformer的前馈层，通过多分支卷积在Transformer块内实现更直接的局部多尺度特征推理；同时修改解码器层以更高效地捕获细节，这为增强稀疏视觉Transformer的归纳偏置提供了新思路。

Abstract: Sparse vision transformers have gained popularity as efficient encoders for medical volumetric segmentation, with Swin emerging as a prominent choice. Swin uses local attention to reduce complexity and yields excellent performance for many tasks but still tends to overfit on small datasets. To mitigate this weakness, we propose a novel architecture that further enhances Swin’s inductive bias by introducing Inception blocks in the feed-forward layers. The introduction of these multi-branch convolutions enables more direct reasoning over local, multi-scale features within the transformer block. We have also modified the decoder layers in order to capture finer details using fewer parameters. We demonstrate a performance improvement on eleven different medical datasets through extensive experimentation. We specifically showcase advancements over the previous state-of-the-art backbones on benchmark challenges like the Medical Segmentation Decathlon and Beyond the Cranial Vault. By showing that the existing inductive bias in Swin can be further improved, our work presents a promising avenue for enhancing the capabilities of sparse vision transformers for both medical and natural image segmentation tasks. Code and pre-trained weights can be accessed at https://github.com/Eiphodos/SwInception.

[104] Genetically Aligned Patient Representations Improve Hematological Diagnosis cs.CV | cs.AI | cs.LGPDF

Muhammed Furkan Dasdelen, Fatih Ozlugedik, Ilaria Looser, Rao Muhammad Umer, Christian Pohlkamp

TL;DR: 本文提出了一种将单细胞白细胞图像与染色体异常（核型）及靶向基因panel体细胞突变进行多模态对齐的框架，通过两阶段训练策略（自监督视觉预训练和基于监督对比损失的遗传对齐）提升患者表征质量，从而改善血液学诊断任务性能。

Details

Motivation: 血液细胞学诊断中，视觉单细胞评估常与细胞遗传学和分子遗传学结合，但现有方法未充分对齐多模态数据；本文旨在通过遗传对齐增强患者表征，以更好地支持血液癌症诊断。

Result: 遗传对齐的患者编码器在血液学诊断任务中表现优异，超越了slide-level组织病理学基础模型，并提供了即用的疾病和遗传变异检索能力。

Insight: 创新点在于将遗传数据（核型和突变）与单细胞图像对齐，采用两阶段训练策略（iBOT头自监督预训练+监督对比损失对齐），这为多模态血液学AI提供了与临床诊断流程一致的框架，可提升表征质量和下游任务性能。

Abstract: Multimodal alignment of histopathology encoders with transcriptomic and genomic data has been shown to significantly improve performance in downstream diagnostic tasks. Hematological cytology is unique in that visual single-cell evaluation is often paired with cytogenetics and molecular genetics for blood cancer diagnosis. In this study, we present a framework to align single white blood cell images with chromosomal aberrations (karyotype) and somatic mutations from targeted gene panels. Our training strategy follows a two-stage approach: (i) self-supervised, vision-only pretraining of a transformer aggregator using an iBOT head on a cohort of over 1500 patients, and (ii) genetic alignment via supervised contrastive loss on acute myeloid leukemia patients. Our genetically aligned patient encoder improves hematological diagnostic tasks, outperforming slide-level histopathology foundation models. Additionally, the model provides off-the-shelf retrieval capabilities for diseases and genetic alterations. Incorporating genetic data into patient encoders increases the quality of patient representations, providing a framework that aligns with clinical diagnostic workflows and paves the way for future multimodal hematology-specific AI. The code and model weights are available at https://github.com/marrlab/GenBloom.

[105] EVL-ECG: Efficient ECG Interpretation With Multi-Aspect Heterogeneous Knowledge Distillation cs.CV | cs.LGPDF

Dang Hong Nguyen, Nhi Ngoc-Yen Nguyen, Huy-Hieu Pham

TL;DR: 本文提出了EVL-ECG框架，旨在通过异构知识蒸馏实现高效的心电图（ECG）解读。该框架针对ECG信号的复杂时空依赖性，设计了三种ECG感知的创新蒸馏方法，以在跨架构（如从大型教师模型到小型学生模型）的知识迁移中保留关键的诊断逻辑和特征。最终构建了一个高效的20亿参数ECG基础模型，适用于资源受限的临床边缘环境。

Details

Motivation: 当前高保真ECG解读高度依赖大规模基础模型，但其巨大的计算需求阻碍了在临床边缘护理中的部署。传统知识蒸馏方法在处理ECG信号的复杂时空依赖性和跨异构架构知识迁移时存在不足。

Result: 在多个ECG基准测试中，EVL-ECG相比现有基线方法，AUC提升了高达2.4%，临床准确率提升了1.1%。它成功构建了一个高效的20亿参数ECG基础模型。

Insight: 论文的创新点在于针对ECG信号特性设计了三种异构知识蒸馏机制：多头交叉注意力对齐、基于最优传输的视觉特征匹配和几何架构内关系匹配。这些方法旨在分别解决架构差异对齐、全局结构关系保持和潜在诊断逻辑蒸馏的问题，为在资源受限环境下部署高效、准确的ECG模型提供了新思路。

Abstract: High-fidelity ECG interpretation is increasingly reliant on massive foundation models, yet their deployment in clinical edge-care remains hindered by extreme computational demands. While knowledge distillation (KD) is a promising solution, traditional methods fail to capture the complex spatio-temporal dependencies of ECG signals when transferring knowledge across heterogeneous architectures. In this paper, we propose EVL-ECG, a framework specifically designed for cross-architecture distillation of cardiac diagnostic logic. EVL-ECG introduces three ECG-aware innovations: (1) Multi-Head Cross-Attention Alignment, which harmonizes architectural discrepancies to preserve fine-grained morphological features; (2) Optimal Transport-based Visual Feature Matching, utilizing optimal transport to maintain global structural relationships across ECG leads despite mismatched token representations; and (3) Geometric Intra-Architecture Relation Matching, which distills the latent diagnostic reasoning of the teacher model. Evaluations across ECG benchmarks demonstrate that EVL-ECG yields improvements of up to 2.4% AUC and 1.1% clinical accuracy over existing baselines. Notably, EVL-ECG establishes an efficient 2B-parameter ECG foundation model, suitable for resource-constrained clinical environments.

[106] EarlyTom: Early Token Compression Completes Fast Video Understanding cs.CVPDF

Hesong Wang, Xin Jin, Lu Lu, Chenhaowen Li, Jian Chen

TL;DR: 本文提出了一种名为EarlyTom的无训练令牌压缩框架，旨在加速视频大语言模型（Video-LLMs）的推理过程。该方法通过在视觉编码器内部进行早期视觉令牌压缩，显著减少了首个令牌生成时间（TTFT）和计算量，同时保持了与完整令牌基线相当的准确性。

Details

Motivation: 现有视频大语言模型在处理大量视觉令牌时效率低下，且多数压缩方法仅在预填充后期进行，未优化视觉编码器本身的效率。本文发现视觉编码过程占据了TTFT的很大一部分，因此探索在编码器内部进行早期压缩以提升整体效率。

Result: 在LLaVA-OneVision-7B模型上，使用单张NVIDIA A100 GPU时，EarlyTok将TTFT最高提升2.65倍，FLOPs最高减少61%，同时准确性与完整令牌基线相当。

Insight: 创新点在于将令牌压缩提前至视觉编码器内部进行，并引入了解耦的空间令牌选择策略以提高压缩效果。这为视频大语言模型的实时部署提供了更高效的解决方案。

Abstract: Video large language models (Video-LLMs) have demonstrated strong capabilities in video understanding tasks. However, their practical deployment is still hindered by the inefficiency introduced by processing massive amounts of visual tokens. Although recent approaches achieve extremely low token retention ratios while maintaining accuracy comparable to full-token baselines, most of them perform compression only at the late stage of prefilling, leaving the efficiency of the vision encoder unoptimized. In this paper, we first show that vision encoding contributes a large portion to the time-to-first-token (TTFT). Therefore, instead of compressing visual tokens only after the vision encoder, performing compression inside the encoder still leaves substantial room for exploration. Based on this insight, we propose EarlyTom, a training-free token compression framework that performs early-stage visual token compression inside the vision encoder, enabling significantly better TTFT reduction and higher throughput. In addition, we introduce a decoupled spatial token selection strategy that improves the overall compression effectiveness. EarlyTom reduces TTFT by up to 2.65x and FLOPs by up to 61% on a single NVIDIA A100 GPU for the LLaVA-OneVision-7B model, while maintaining accuracy comparable to the full-token baseline. These improvements substantially enhance the practicality of deploying Video-LLMs in real-world production scenarios.

[107] VisualThink-VLA: Visual Intermediate Reasoning for Effective and Low-Latency Vision-Language-Action Policies cs.CV | cs.AIPDF

Mingjian Gao, Wenqiao Zhang, Yuqian Yuan, Yang Dai, Binhe Yu

TL;DR: 本文提出了VISUALTHINK-VLA，一个用于视觉-语言-动作（VLA）策略的视觉中间推理框架。它通过紧凑的视觉证据接口引导动作预测，避免了文本解码开销，并结合定制的选择性路由机制学习视觉证据令牌，以实现低延迟、高性能的具身控制。

Details

Motivation: 现有为VLA策略配备显式中间推理的工作主要依赖文本思维链，这在具身控制中存在不足：无关或弱文本信息会干扰动作预测，且自回归文本解码会带来过高延迟，无法满足实时闭环执行的需求。

Result: 在多个基准测试和真实机器人评估中，VISUALTHINK-VLA在大多数基准上取得了最高的成功率，同时将推理增强基线的多秒级延迟降低到亚秒级。例如，在BridgeData V2上，它将步骤延迟从ECoT的8.377秒降低到0.367秒，实现了22.8倍的加速。

Insight: 核心创新在于用视觉中间推理替代文本思维链，通过视觉证据接口和选择性路由机制，在保持空间精度和高容量专业化的同时，极大降低了推理延迟。此外，构建的VisualEvidence-Kit资源为监督和反事实忠实性测试提供了支持。

Abstract: Recent work has begun to equip vision-language-action (VLA) policies with explicit intermediate reasoning. In embodied control, however, textual chain-of-thought is a poor fit: irrelevant or weakly textual information can interfere with action prediction, while autoregressive text decoding adds too much latency for real-time closed-loop execution. We present VISUALTHINK-VLA, a visual intermediate-reasoning framework for accurate, low-latency VLA policies. Our bootstrapping philosophy is to guide action with effective visual thinking: VISUALTHINK-VLA bootstraps action prediction through a compact visual-evidence interface that preserves spatial precision while avoiding decoding overhead. Besides, to further improve performance and efficiency, VISUALTHINK-VLA adopts a tailored selective routing mechanism to learn the visual evidence tokens, enabling low-latency inference while preserving high-capacity specialization. We also introduce VisualEvidence-Kit, a supervision-and-audit resource centered on a VisualEvidence-Agent that constructs a 754.7k VLA instructions VisualEvidence-Set for route supervision and counterfactual faithfulness tests. Across multiple benchmarks and real-robot evaluation, VISUALTHINK-VLA achieves the highest success rate on most benchmarks while reducing the multi-second latency of reasoning-augmented baselines to the sub-second regime. For example, on BridgeData V2, it reduces step latency from 8.377,s with ECoT to 0.367,s, achieving a 22.8 times speedup.

[108] DocRetriever: A Plug-and-Play Framework for Multimodal Document Retrieval with Comprehensive Benchmark cs.CV | cs.IRPDF

Ruofan Hu, Menghui Zhu, Jieming Zhu, Bo Chen, Shengyang Xu

TL;DR: 本文提出了DocRetriever，一个即插即用的多模态文档检索框架，旨在解决现有方法在利用文档结构信息和泛化能力方面的不足。该框架包含布局感知的稀疏嵌入技术和基于推理增强演示的通用化重排序器，并构建了新的综合基准MultiDocR进行更严格的评估。

Details

Motivation: 现有方法通常结合稠密视觉嵌入模型和监督式重排序器，但存在两个主要问题：稠密嵌入的粗粒度特性掩盖了显式语义，无法有效利用结构信息；监督式重排序器泛化能力有限，严重依赖领域特定训练数据。此外，现有基准缺乏多样化的评估维度和全面的相关性标注。

Result: 在多个基准上的实验验证了DocRetriever的优越性，其性能超越了最先进的方法（SOTA）。

Insight: 创新点包括：1）布局感知的稀疏嵌入技术，无需OCR开销即可实现有效的混合编码；2）利用推理增强演示和优化采样的通用化重排序器，提升了少样本场景下的准确性；3）构建了新的综合基准MultiDocR，以支持更严格的评估。从客观角度看，该工作将稀疏表示与布局信息结合，并采用提示工程增强重排序器的泛化能力，为多模态文档检索提供了模块化且可扩展的解决方案。

Abstract: Multimodal documents contain diverse elements, such as tables, figures, and layouts, which can complicate retrieval tasks. While current approaches typically combine dense visual embedding models with supervised rerankers to achieve high-precision retrieval, they face inherent limitations. First, the coarse-grained nature of dense embeddings tends to obfuscate explicit semantics, failing to leverage structurally salient information. Second, supervised reranking models suffer from generalization bottlenecks, as their performance heavily relies on domain-specific training data. Furthermore, existing benchmarks often lack diverse assessment dimensions and comprehensive relevance annotations, limiting reliable evaluation. To address these challenges, we propose DocRetriever, a plug-and-play framework. It enhances visual retrieval via a layout-aware sparse embedding technique, enabling effective hybrid encoding without the overhead of optical character recognition (OCR). We also introduce a generalizable reranker that leverages reasoning-augmented demonstrations and optimized sampling to improve accuracy in few-shot settings. Finally, we construct a new benchmark, MultiDocR, to enable more rigorous evaluation. Experiments across diverse benchmarks validate DocRetriever’s superiority over state-of-the-art methods.

[109] GenEraser: Generalizable Video Object Removal via Balanced Text-Mask Guidance and Decoupled Locator-Preserver cs.CVPDF

Yuqing Chen, Lin Liu, Haisu Wu, Xiaopeng Zhang, Yaowei Wang

TL;DR: 本文提出GenEraser，一个用于通用化、高保真视频对象及其物理效应（如烟雾、反光）移除的新框架。它通过多条件专家混合与二分文本引导来增强对复杂效应的识别，利用可学习的深度CFG融合机制平衡掩码与文本条件的权重，并采用解耦的定位器-保存器专家架构来缓解语义泛化与像素对齐之间的权衡。

Details

Motivation: 现有视频对象移除方法主要依赖空间掩码，难以捕捉弱相关的物理效应，且文本引导潜力未充分挖掘。同时，移除模型在高层语义泛化与精确像素级背景保存之间存在根本的优化冲突。

Result: 在ROSE Benchmark和VOR-Eval等基准测试上，GenEraser超越了现有SOTA方法，取得了显著的定量提升（例如分别提升2.16 dB和1.44 dB），并在开放世界场景中保持了极强的泛化鲁棒性。

Insight: 创新点在于：1) 结合多模态先验的MC-MoE与二分文本引导，以增强对复杂物理效应的识别；2) 可学习的LD-CFG机制自适应平衡不同条件；3) 解耦的定位器-保存器架构有效分离了移除与保存任务，缓解了内在的优化冲突。

Abstract: Video object removal frequently struggles to simultaneously eliminate target objects and their associated physical effects (e.g., smoke, reflections, light, and ripples) in out-of-domain scenarios due to complex spatiotemporal ambiguities. While existing methods primarily rely on spatial masks, they often fail to capture weakly correlated effects, and the potential of explicit textual guidance remains underexplored. Furthermore, a fundamental optimization conflict exists in removal models between high-level semantic generalization and precise pixel-level background preservation. To address these challenges, we propose GenEraser, a novel framework for generalized and high-fidelity video object and effect removal. First, we introduce a Multi-Conditional Mixture-of-Experts (MC-MoE) paired with Bipartite Text guidance to fully exploit the multimodal priors of Diffusion Transformers, significantly enhancing the identification of complex effects. Second, a Learnable Deep ``CFG’’ Fusion mechanism (LD-CFG) is developed to adaptively balance the relative dominance of mask and textual conditions across diverse scenarios. Finally, we propose a Decoupled Expert Architecture, comprising a Locator and a Preserver, to mitigate the inherent trade-off between semantic generalization and pixel alignment. Extensive experiments demonstrate that our GenEraser surpasses recent state-of-the-art approaches, achieving significant quantitative improvements (e.g., $2.16$ dB and $1.44$ dB on the ROSE Benchmark and VOR-Eval, respectively) while maintaining exceptionally robust generalization in open-world scenarios. https://cyqii.github.io/GenEraser.github.io/

[110] Towards Consistent Video Geometry Estimation cs.CVPDF

Zhu Yu, Jingnan Gao, Runmin Zhang, Lingteng Qiu, Zhengyi Zhao

TL;DR: 本文提出了ViGeo，一种基于纯Transformer架构的前馈基础模型，用于从视频序列中恢复空间密集且时间一致的几何信息。模型通过动态分块注意力机制统一支持流式、全序列和长视频推理，并引入基于补全的数据精炼框架提升监督质量。ViGeo在公开数据集上训练，在深度估计、表面法线估计和视频点云图估计任务上实现了最先进的性能。

Details

Motivation: 解决从视频中恢复密集、时间一致的几何信息（如深度、表面法线）的挑战，旨在构建一个统一、灵活且无需任务特定架构修改的基础模型。

Result: 在在线、离线和长视频深度估计、表面法线估计以及视频点云图估计等多个基准测试中，ViGeo均达到了最先进的性能水平。

Insight: 核心创新在于动态分块注意力机制，它使模型在训练时能接触双向和因果时序上下文，并在测试时无需重新训练即可自适应调整注意力模式；此外，通过基于补全的数据精炼框架生成高质量的训练目标，提升了监督信号的质量。

Abstract: This work presents ViGeo, a feed-forward foundation model for recovering spatially dense and temporally consistent geometry from video sequences. Built upon a plain transformer architecture without task-specific architectural modifications, ViGeo supports streaming, full-sequence, and long-video inference within a unified model. The key design is dynamic chunking attention, which exposes the model to both bidirectional and causal temporal contexts during training and allows it to adapt its attention pattern at test time without retraining. To improve supervision quality, we further introduce a completion-based data refinement framework. This framework trains a video depth completion teacher that conditions on sparse and noisy annotations and exploits video/multi-view context to produce dense, temporally coherent, and geometrically reliable training targets. Beyond depth and point maps, ViGeo also predicts surface normals within the same framework. Trained solely on public datasets, ViGeo achieves state-of-the-art performance across online, offline, and long-video depth estimation, surface normal estimation, and video point map estimation.

[111] FakeVLM-R1: Internalizing Physical Laws via CoT for Synthetic Image Detection cs.CVPDF

Leqi Zhu, Junyan Ye, Kaiqing Lin, Zhiyuan Yan, Conghui He

TL;DR: 本文提出FakeVLM-R1模型，旨在通过结合监督微调、群体相对策略优化和批判性思维链机制，赋予模型在合成图像检测任务中类似人类的批判性思维能力。该模型在推理时执行双向辩证推理，同时提出伪造假设并调用物理常识构建真实性反证。此外，作者构建了包含高质量样本和真实图像物理规律标注的FakeClue++数据集，为模型提供了统一的真实性锚点。

Details

Motivation: 当前基于大型多模态模型的可解释检测方法依赖于从大量伪造数据中学习的模仿学习，缺乏真正的因果推理能力且容易产生解释性幻觉。本文旨在克服这一瓶颈，使模型具备类似人类的批判性思维来进行合成检测。

Result: 实验证实，FakeVLM-R1在多个基准测试中达到了SOTA性能，不仅实现了高精度、逻辑可解释的检测，还解决了现有方法对真实图像的过度拒绝偏差，并展现出对抗扰动的泛化性和鲁棒性。

Insight: 创新点在于将批判性思维链机制与双向辩证推理过程相结合，使模型在提出假设时必须同时构建反证，从而内化物理规律进行因果推理。此外，构建的FakeClue++数据集通过引入真实图像的物理规律标注，为模型提供了基于物理常识的统一学习锚点，这有助于减少幻觉并提升泛化能力。

Abstract: The development of generative artificial intelligence technologies has propelled the visual realism of synthetic images to an unprecedented level. Although current interpretable detection methods based on Large Multimodal Models (LMMs) have made certain progress, they still rely on imitation learning derived from massive volumes of forged data. Consequently, they lack genuine causal reasoning capabilities and are prone to explanatory hallucinations. To overcome this bottleneck, we propose FakeVLM-R1, aiming to endow the model with human-like critical thinking capabilities when performing synthetic detection tasks. Building upon Supervised Fine-Tuning (SFT), this framework integrates Group Relative Policy Optimization (GRPO) with a Critical Thinking Chain-of-Thought (CoT) mechanism. During the inference phase, the model executes a “bidirectional dialectical reasoning” process: while proposing a forgery hypothesis, it must simultaneously invoke physical commonsense to construct an authenticity counter-proof. Furthermore, we constructed the FakeClue++ dataset with high-quality samples, which extensively introduces annotations guided by the physical laws of authentic images, providing a unified authenticity anchor for the model. Experiments confirm that FakeVLM-R1 achieves SOTA performance the evaluated models across multiple benchmarks. It not only achieves high-precision, logically interpretable detection but also resolves the over-rejection bias of existing methods against real images, demonstrating generalization and robustness against perturbations.

[112] Native Audio-Visual Alignment for Generation cs.CVPDF

Longbin Ji, Guan Wang, Xuan Wei, Chenye Yang, Xiangrui Liu

TL;DR: 本文提出了NAVA（Native Audio-Visual Alignment）框架，用于联合音频-视频生成。该框架通过在一个专用的交互空间中建立音频-视频对应关系，并利用外部上下文条件化联合去噪过程，旨在合成时间同步且语义一致的视听内容。

Details

Motivation: 现有开源方法在联合音频视频生成中存在局限：双塔设计削弱了细粒度的音视频协同演化，而完全统一的三模态设计则将语义条件与低级同步耦合在一起。NAVA旨在解决这些问题，实现更好的细粒度对齐和条件解耦。

Result: 在Verse-Bench和Seed-TTS基准上的实验及用户研究表明，NAVA仅使用63亿参数就实现了卓越的视频质量、精确的音频-视频同步、有竞争力的音频质量以及更强的参考音色可控性。

Insight: 主要创新点是提出了基于上下文条件的原生音频-视觉对齐框架，其核心是“先对齐后融合”的MMDiT架构，实现了从模态感知对齐到模态共享联合去噪的过渡。此外，引入的“上下文中的音色条件化”技术，将参考音色线索与对应的语音片段关联，实现了可控的语音音色生成。

Abstract: Joint audio-video generation aims to synthesize temporally synchronized and semantically coherent visual-acoustic content. However, existing open-source methods mainly rely on either dual-tower designs with posterior alignment or fully unified tri-modal designs that mix textual context, audio and video in one shared space. The former weakens fine-grained audio-video co-evolution, while the latter couples semantic conditioning with low-level synchronization. To address these limitations, we propose NAVA, a Native Audio-Visual Alignment framework for joint audio-video generation. NAVA is built upon context-conditioned native audio-visual alignment: it first establishes audio-video correspondence in a dedicated interaction space, and then uses external context to condition the joint denoising process. Specifically, NAVA is instantiated with an Align-then-Fuse MMDiT architecture, which transitions from modality-aware audio-video alignment to modality-shared joint denoising. Furthermore, we introduce Timbre-in-Context Conditioning to associate reference timbre cues with corresponding speech spans to achieve controllable speech timbre. Experiments on Verse-Bench and Seed-TTS, together with a user study, demonstrate that NAVA achieves superior video quality, precise audio-visual synchronization, competitive audio quality, and stronger reference-timbre controllability using only 6.3B parameters.

[113] Future Forcing: Future-aware Training-free KV Cache Policy for Autoregressive Video Generation cs.CVPDF

Jiayi Luo, Qiyan Liu, Tengyang Wang, JunHao Liu, Jiayu Chen

TL;DR: 本文提出了一种名为Future Forcing的、无需训练的未来感知KV缓存策略，用于解决自回归视频生成中KV缓存随序列长度增长导致的内存和误差累积问题。该方法利用历史统计信息构建未来查询代理，并基于此评估和合并缓存中的关键token，从而提升长序列生成的连贯性。

Details

Motivation: 现有KV缓存压缩方法通常基于当前或历史上下文评估token重要性，容易忽略早期不重要但对未来帧生成至关重要的token，限制了自回归视频模型向更长序列扩展的能力。

Result: 在VBench-Long基准测试上进行60秒视频生成的实验表明，Future Forcing在有限KV缓存下显著提升了长时域一致性，在主体一致性指标上比现有AR视频KV缓存策略最高提升了1.49。

Insight: 创新点在于发现了训练好的自回归视频模型中，经过RoPE调制前的规范查询分布在视频生成过程中保持高度稳定，这使得无需额外训练即可从历史统计中估计未来查询分布，从而做出有原则的未来感知缓存决策。该方法的核心是利用未来查询代理进行重要性评分和在仿射子空间内合并冗余token对。

Abstract: Autoregressive (AR) video generation has emerged as a promising paradigm for long-horizon video synthesis, where each frame is generated conditioned on previously generated tokens. To accelerate inference, the KV cache is used to avoid redundant recomputation across generation steps. Nevertheless, its growth with generation length introduces increasing memory and error accumulation, limiting the scalability of AR models to even longer sequences. Existing KV cache compression methods mitigate this issue by selectively retaining only video tokens deemed important. However, most existing methods assess token importance using short-horizon signals derived from the current or historical generation context, making these methods prone to overlooking tokens that appear unimportant at early steps but later become critical for future frames. In this work, we identify an important property of trained AR video models: although RoPE-modulated queries evolve across autoregressive steps, the underlying canonical pre-RoPE query distribution remains remarkably stable throughout the video generation process. This approximate stationarity implies that future query distributions are estimable from historical statistics, enabling principled future-aware cache decisions without any additional training. Building on this insight, we propose Future Forcing, a training-free future-aware KV cache policy for AR video generation. Specifically, Future Forcing first constructs a future query proxy from historical statistics, then scores KV cache tokens by their importance under this proxy, and finally merges redundant token pairs within the affine subspace induced by the future query. Extensive experiments show that Future Forcing improves long-horizon consistency under limited KV caches, achieving up to 1.49 improvement in subject consistency on VBench-Long for 60s generation over existing AR video KV cache policies.

[114] Geometry Matters: 3D Foundation Priors for Learning Semantic Correspondence cs.CVPDF

Artur Jesslen, Olaf Dünkel, Adam Kortylewski

TL;DR: 本文提出了一种3D感知的后训练框架，通过整合3D基础模型的先验知识来增强2D基础特征（如DINO和Stable Diffusion）在语义对应任务中的性能。该方法利用SAM3D估计物体几何和姿态，并通过渲染-比较优化细化姿态，然后基于姿态将PartField描述符渲染到图像平面，生成几何感知的特征图。这些特征与现有2D特征互补，同时利用重建形状上的测地距离过滤候选对应关系，并以此作为监督训练轻量级适配器。

Details

Motivation: 现有基于自监督视觉模型和文生图扩散模型的基础特征在语义对应估计中有效，但它们主要从2D图像目标学习，缺乏明确的3D感知，容易混淆对称物体侧面、重复部分和视觉相似但3D结构不同的区域。

Result: 实验表明，该方法在语义对应任务上优于先前方法，同时减少了手动几何监督的需求。

Insight: 创新点在于自动获取实例特定的3D结构（通过SAM3D和优化）来指导对应学习，避免了先前后训练方法对姿态标注和粗略球形几何的依赖，将3D几何先验与2D基础特征有效结合以提升语义对应精度。

Abstract: Foundation features from self-supervised vision models and text-to-image diffusion models have proven effective for semantic correspondence estimation. However, because these features are learned primarily from 2D image objectives, they lack explicit 3D awareness and often confuse symmetric object sides, repeated parts, and visually similar structures that are distinct in 3D. We introduce a 3D-aware post-training framework that goes beyond available 2D foundation features by incorporating priors from 3D foundation models. Given an image, our method uses SAM3D to estimate object geometry and pose, and refines the pose through render-and-compare optimization. Subsequently, we render PartField descriptors from the reconstructed geometry into the image plane based on the estimated object pose. The resulting geometry-aware feature maps complement DINO and Stable Diffusion features, while geodesic distances on the reconstructed shapes enable reliable filtering of candidate correspondences. We use the filtered matches as supervision to train a lightweight adapter on top of DINO and Stable Diffusion for semantic correspondence. In contrast to prior post-training approaches that require pose annotations and rely on coarse spherical geometry, our method automatically obtains instance-specific 3D structure and uses it to guide correspondence learning. Experiments show that our approach improves semantic correspondence over the prior methods while reducing manual geometric supervision. Code and model can be found at https:/github.com/GenIntel/3D-SC.

Thenukan Pathmanathan, Kanchan Keisham, Thangarajah Akilan

TL;DR: 本文提出了一种名为xModel-KD的新型跨模态知识蒸馏框架，用于3D点云分割任务。该框架通过跨模态对齐学习统一的逐点表示，利用2D图像的纹理信息和3D点云的几何信息的互补优势，以解决标注数据稀缺和单模态表示受限的问题。

Details

Motivation: 动机在于3D点云分割任务面临密集标注成本高、标注样本难以获取的挑战，且单一模态（如仅2D图像缺乏几何结构，仅3D点云缺乏纹理信息）限制了学习表示的丰富性和泛化能力。现有多模态方法通常依赖大规模标注数据集，尚未充分用于数据高效的密集预测。

Result: 实验结果表明，跨模态融合在mIoU指标上比仅使用LiDAR的基线模型绝对提升了2%，证明了利用互补多模态信息对于可扩展且标注高效的3D场景理解的有效性。

Insight: 创新点在于设计了一个基于对比目标的跨模态融合编码器，通过多视角对应关系强制2D和3D表示之间的特征一致性，并整合预训练骨干网络与针对性融合策略，将外观线索从图像有效迁移到几何感知的点特征中。

Abstract: Point cloud segmentation is a fundamental task in 3D scene understanding. Its progress is constrained by the high cost and time required for dense 3D annotations, making labeled samples difficult to obtain. Beyond annotation scarcity, different sensing modalities face inherent limitations. 2D images provide rich texture and appearance cues, yet they lack explicit depth and geometric structure. In contrast, 3D point clouds capture accurate spatial geometry but are sparse and contain no texture information. As a result, relying on a single modality restricts the richness of learned representations and weakens generalization. Although recent multi-modal methods that combine 3D point clouds with 2D images have demonstrated strong performance in tasks such as classification and retrieval, they typically depend on large-scale labeled datasets and have not been fully exploited for data-efficient dense prediction. To address these limitations, we propose a novel cross-modal knowledge distillation framework, xModel-KD, for 3D point cloud segmentation. Our method exploits the complementary strengths of 2D texture and 3D geometry by learning unified per-point representations through cross-modal alignment. Specifically, we design a cross-modal fusion encoder trained with a contrastive objective that enforces feature consistency between corresponding 2D and 3D representations across multiple views. By integrating powerful pre-trained backbones with a targeted fusion strategy, the proposed framework effectively transfers appearance cues from images to geometry-aware point features. Experimental results show that cross-modal fusion achieves a 2% absolute improvement in mIoU over a LiDAR-only baseline, demonstrating the benefit of leveraging complementary multi-modal information for scalable and annotation-efficient 3D scene understanding.

[116] SGMD: Score Gradient Matching Distillation for Few-Step Video Diffusion Distillation cs.CV | cs.LGPDF

Zhuguanyu Wu, Ruihao Gong, Yang Yong, Yushi Huang, Xiangyu Fan

TL;DR: 本文提出了一种名为Score Gradient Matching Distillation (SGMD)的新方法，用于加速少步视频扩散模型的推理。该方法通过直接优化学生模型的伪分数向教师模型对齐，并采用教师模型的停止梯度Fisher信息作为稳定的分布匹配目标，解决了现有DMD方法在训练成本和运动动态保持方面的挑战。

Details

Motivation: 现有基于分布匹配蒸馏（DMD）的视频加速方法面临两个耦合挑战：伪分数需要持续跟踪不断演化的生成器，导致频繁更新时训练成本高昂；同时，基于反向KL散度的匹配方式可能过于保守，难以保持强烈的运动动态。

Result: 在实验中，与DMD2相比，SGMD实现了约3倍的训练加速，并在4步蒸馏模型中显著改善了运动动态，同时保持了时间一致性。一项人类研究也证实，SGMD在运动质量和整体偏好上更受青睐，而视觉质量和文本对齐性保持相当。

Insight: 核心创新点在于采用伪分数视角，并引入一对双重势函数（负残差用于外循环校正，残差收缩用于内循环跟踪）来稳定和优化训练过程。这为视频扩散模型的快速蒸馏提供了一种更高效且能更好保持运动细节的新范式。

Abstract: Distribution Matching Distillation (DMD) is a widely used paradigm for accelerating inference in few-step video diffusion models. However, DMD-style video distillation faces two coupled challenges: the fake score must track a continuously evolving generator, making training costly when frequent updates are required, while reverse-KL-style matching can be mode-seeking and conservative for preserving strong motion dynamics. To address these issues, we propose \textbf{Score Gradient Matching Distillation (SGMD)}. SGMD adopts a fake-score perspective by directly optimizing the fake score toward the teacher, while using teacher stop-gradient Fisher as a stable distribution-matching objective. We provide a gradient analysis that motivates this objective choice under ideal tracking. Building on this, SGMD introduces a pair of dual potentials: negative-residual (NR) for outer-loop correction and residual-contraction (RC) for inner-loop tracking. Empirically, compared to DMD2, SGMD achieves an approximately $\sim 3\times$ training speedup and substantially improves motion dynamics for 4-step distilled models while preserving temporal consistency. A human study confirms that SGMD is preferred in motion quality and overall preference, while visual quality and text alignment remain comparable. Code is available at https://github.com/ModelTC/LightX2V.

[117] PARCEL: Pool-Anchored Resampling with Conditioned Elastic Queries for Efficient Vision-Language Understanding cs.CV | cs.AI | cs.CL | cs.LGPDF

Selim Kuzucu, Alessio Tonioni, Vasile Lup, Bernt Schiele, Federico Tombari

TL;DR: 论文提出了PARCEL，一种用于高效视觉语言理解的视觉标记化架构，旨在解决大型视觉语言模型因密集视觉标记序列带来的二次计算瓶颈问题。该方法通过动态划分特征提取任务，结合空间池标记作为低频布局锚点，并利用池条件查询重采样来调节弹性查询标记，从而在激进压缩下保持性能。

Details

Motivation: 现有弹性视觉标记压缩方法（如仅空间压缩或仅查询压缩）在激进压缩时存在缺陷：空间压缩会导致频谱混叠和细节丢失，查询压缩则会损害空间定位能力。PARCEL旨在解决这种表征冲突，实现更高效的视觉语言理解。

Result: 在27个基准测试上的广泛评估表明，PARCEL改善了性能-效率的帕累托前沿，在不同视觉标记预算下持续优于现有的嵌套基线方法，同时保持了“一次训练，随处部署”的范式。

Insight: 创新点在于将空间池标记作为布局锚点，并通过条件机制引导查询标记关注互补的视觉特征，而非冗余的空间映射，从而在压缩时更好地平衡低频布局信息与高频细节。这种动态任务划分架构为视觉标记压缩提供了新思路。

Abstract: Large Vision-Language Models (LVLMs) map visual inputs into dense token sequences, imposing a quadratic computational bottleneck for inference. Elastic visual-token compression addresses this by training a single model that can run at multiple visual-token budgets. However, existing approaches struggle under aggressive compression. Spatial-only compression, as in nested pooling, behaves as an imperfect low-pass filter and induces spectral aliasing that obscures fine-grained detail. Query-only compression, as in nested query resampling, replaces explicit grid-aligned tokens with non-local summaries and substantially degrades spatial grounding. To resolve this representational conflict, we introduce PARCEL (Pool-Anchored Resampling with Conditioned Elastic Queries for Efficient Vision-Language Understanding), a visual tokenization architecture that dynamically partitions the labor of feature extraction. PARCEL establishes spatial pool tokens as low-frequency layout anchors and conditions elastic query tokens on these anchors through Pool-Conditioned Query Resampling. This encourages query tokens to focus on complementary visual features rather than redundant spatial mapping. Extensive evaluations across 27 benchmarks show that PARCEL improves the performance-efficiency Pareto frontier, consistently outperforming existing matryoshka baselines across visual-token budgets while preserving the “train once, deploy anywhere” paradigm.

[118] Why Far Looks Up: Probing Spatial Representation in Vision-Language Models cs.CVPDF

Cheolhong Min, Jaeyun Jung, Daeun Lee, Hyeonseong Jeon, Yu Su

TL;DR: 本文提出了一种表示层面的分析框架，通过构建最小对比对来探究视觉语言模型（VLMs）内部的空间表示组织方式。研究发现，多个模型家族普遍存在垂直-距离纠缠偏差，即模型将图像垂直位置与距离混淆，这反映了自然图像中的透视偏差。该偏差导致模型在透视一致与反直觉示例间存在显著的准确率差距，并且随着数据规模扩大而加剧。研究进一步表明，基准测试分数相近的模型可能具有不同的内部表示，而这些差异能预测其在多样化空间推理基准上的准确性和鲁棒性。

Details

Motivation: 尽管视觉语言模型在空间推理基准上表现出色，但尚不清楚这是源于结构化的3D理解，还是依赖于自然图像中的统计捷径。本文旨在探究VLMs内部空间表示的本质，以区分其真实理解能力与对数据偏差的依赖。

Result: 分析揭示了跨多个模型家族存在一致的垂直-距离纠缠偏差。该偏差在合成的SpatialTunnel基准上得到验证，表明其是模型固有的。研究还发现，具有更清晰分离的空间轴表示的模型，在多样化空间推理基准上表现出更强的鲁棒性。

Insight: 创新点在于提出了一个表示层面的分析框架和SpatialTunnel合成基准，用于隔离和暴露模型对自然图像中常见相关性的依赖。客观来看，该研究强调了基准测试分数可能掩盖模型内部表示的结构性缺陷，并指出构建良好解耦的空间表示对于实现可靠的空间推理至关重要。

Abstract: Vision-language models (VLMs) achieve strong performance on spatial reasoning benchmarks, yet it remains unclear whether this reflects structured 3D understanding or reliance on statistical shortcuts in natural images. We introduce a representation-level analysis framework that constructs minimal contrastive pairs to measure how spatial axes are organized and disentangled within VLM embeddings. Our analysis across multiple model families reveals a consistent vertical-distance entanglement: models conflate vertical image position with distance, mirroring the perspective bias of natural photographs. This bias produces a significant accuracy gap between perspective-consistent and counter-heuristic examples, and intensifies under data scaling even as overall benchmark accuracy improves. We further show that models with similar benchmark scores can exhibit different internal representations, and that these differences predict accuracy and robustness across diverse spatial reasoning benchmarks. To isolate this bias from evaluation-set skew, we introduce SpatialTunnel, a synthetic benchmark designed to expose spatial shortcut biases by removing common correlations present in natural images. Experiments confirm that the entanglement is model-intrinsic, and that models with well-separated spatial axes exhibit greater robustness, suggesting that well-structured spatial representations lead to more reliable spatial reasoning across diverse benchmarks. Code and benchmark are available on the project page: https://cheolhong0916.github.io/whyfarlooksup.github.io/.

[119] OmniCD: A Foundational Framework for Remote Sensing Image Change Detection Guided by Multimodal Semantics cs.CVPDF

Chenhao Sun

TL;DR: 本文提出了OmniCD，一个基于多模态语义引导的遥感图像变化检测基础框架。该框架通过整合图像和文本提示（如文本描述、语义图和地理空间元数据）来统一和增强遥感变化检测，支持从二元变化检测到零样本语义变化理解等多种任务。

Details

Motivation: 遥感变化检测在诸如城市监测和灾害评估等应用中至关重要，但传统方法难以在不同场景间实现良好的泛化能力。

Result: 广泛的实验表明，OmniCD在多个基准测试中取得了最先进的性能，展现了强大的适应性。

Insight: 创新点在于提出了一个统一的多模态语义引导框架，并引入了包含大规模标注图像-文本对的数据集RSITCD，同时通过风格解耦机制增强了跨域鲁棒性，为通用遥感变化检测系统奠定了基础。

Abstract: Change detection (CD) in remote sensing is vital for applications such as urban monitoring and disaster assessment, yet traditional methods struggle with generalization across diverse scenarios. We present OmniCD, a foundational framework that unifies and enhances remote sensing CD through multimodal semantic guidance. OmniCD incorporates image and text prompts – such as textual descriptions, semantic maps, and geospatial metadata – into a unified architecture, supporting tasks from binary CD to zero-shot semantic change understanding. The framework integrates a hierarchical scene retrieval module and a change detection module, reinforced by a style disentanglement mechanism for improved cross-domain robustness. We further introduce RSITCD, a large-scale multimodal dataset with 300K+ annotated image-text pairs. Extensive experiments show that OmniCD achieves state-of-the-art performance across benchmarks, demonstrating strong adaptability and setting a solid foundation for general-purpose CD systems in remote sensing.

[120] AnomalyAgent: Training-Free Agentic Models for Zero-/Few-Shot Anomaly Detection cs.CVPDF

Yi Zhang, Jiawen Zhu, Lele Fu, Guansong Pang

TL;DR: 本文提出了AnomalyAgent，一种无需训练、基于智能体（agentic）的框架，利用多模态大语言模型（MLLMs）的高级推理和泛化能力进行零样本/少样本异常检测。该框架包含一个全面的异常中心工具集和一个定制的记忆模块，旨在解决现有方法缺乏深度上下文推理能力的问题，并在更广泛的异常类型（如逻辑/上下文异常）上进行了评估。

Details

Motivation: 现有基于视觉语言模型（VLMs）的零/少样本异常检测方法虽然性能不错，但需要大量辅助数据训练以适应异常检测任务，且其推理主要依赖视觉-文本嵌入相似度，缺乏对需要深度上下文理解的复杂异常进行推理的能力。

Result: 在广泛的实验中，AnomalyAgent在零样本和少样本异常检测设置下，相比无需训练的VLM基AD方法和通用智能体方法，取得了显著更好的性能，展现了其优越的泛化能力。评估范围从广泛基准中的简单异常（如裂纹、凹痕）扩展到物流和制造环境中的逻辑/上下文异常等更多样类型。

Insight: 创新点在于提出了一个无需训练、基于MLLM智能体推理的框架，通过异常中心工具集和少样本上下文参考示例的记忆模块，实现了对复杂异常的深度上下文理解与推理，突破了传统方法依赖嵌入相似度的局限。

Abstract: Benefiting from generalizability of vision-language models (VLMs) such as CLIP, many zero-/few-shot anomaly detection (AD) approaches have achieved impressive detection performance across various datasets. Nevertheless, they require substantial training on large auxiliary datasets to adapt VLMs to anomaly detection, and their inference largely relies on visual-text embedding similarity-based anomaly scores, lacking reasoning abilities to detect complex anomalies that require in-depth contextual understanding. To address this limitation, we propose \textbf{AnomalyAgent}, a novel training-free, agentic framework that leverages the advanced reasoning and generalization capabilities of multimodal large language models (MLLMs) for anomaly detection. The key ingredients include \textbf{1)} a comprehensive anomaly-centric toolset that enables adaptive MLLM-driven, agentic anomaly reasoning in zero-shot settings, and \textbf{2)} a customized memory module that grounds anomaly reasoning with few-shot, in-context reference examples. We extend evaluation beyond the detection of simple anomalies (e.g., surface defects like cracks and dents and clear lesions) in widely used benchmarks to more diverse types of anomalies such as logical/contextual anomalies in logistics and manufacturing settings. Extensive experiment results demonstrate that our AnomalyAgent achieves substantially better performance compared to training-free VLM-based AD and generic agentic methods, highlighting its superior generalization capability in both zero-shot and few-shot anomaly detection settings. The code implementation can be find at this address.

[121] LiveSVG: Zero-Shot SVG Animation via Video Generation cs.CVPDF

Matan Levy, Ran Margolin, Bar Cavia, Dvir Samuel, Yael Pritch

TL;DR: LiveSVG提出了一种零样本方法，利用视频扩散模型生成可缩放矢量图形（SVG）动画。该方法通过冻结的图像到视频模型，根据输入SVG图像和运动提示生成目标预览视频，然后通过可微分渲染将原始SVG拟合到该视频上。

Details

Motivation: 当前SVG动画方法在复杂运动处理上存在局限：基于LLM的代码合成难以表达精细的非刚性贝塞尔变形，而分数蒸馏采样（SDS）则提供噪声梯度且常需类别特定先验（如骨架）。LiveSVG旨在直接通过显式生成的目标视频来拟合矢量几何，以解决这些问题。

Result: 在AniClipart和提出的ChallengeSVG基准测试中，LiveSVG显著优于现有方法，确立了直接参考视频拟合作为实现提示对齐且完全可编辑矢量动画的实用、鲁棒路径。

Insight: 创新点包括：1) 提出骨架自由的双层运动表示，结合用于粗粒度关节的每组单应性变换和用于局部变形的每路径贝塞尔控制点偏移；2) 引入新颖的球体填充重新着色策略，以解决像素级拟合中颜色引起的对应模糊问题；3) 构建了ChallengeSVG基准，暴露了先前工作的局限性。

Abstract: We introduce LiveSVG, a zero-shot approach for generating Scalable Vector Graphics (SVG) animations using video diffusion models. Current SVG animation methods struggle with complex motions: LLM-based code synthesis fails to express fine, non-rigid Bézier deformations, while Score Distillation Sampling (SDS) provides noisy gradients and often requires category-specific priors like skeletons. In contrast, LiveSVG fits vector geometry directly to an explicitly generated target video. Given an input SVG image and a motion prompt, we generate a previewable target video using a frozen image-to-video model, then fit the original SVG to this video via differentiable rendering. Our fitting stage is skeleton-free, utilizing a dual-level motion representation that combines per-group homographies for coarse articulation with per-path Bézier control-point offsets for local deformations. To resolve color-induced correspondence ambiguities during pixel-wise fitting, we introduce a novel sphere-packing recolorization strategy. We also present ChallengeSVG, a benchmark of complex, multi-object scenes that exposes the limitations of prior work. Evaluations demonstrate that LiveSVG significantly outperforms existing methods on both AniClipart and ChallengeSVG, establishing direct reference-video fitting as a practical, robust route to prompt-aligned and fully editable vector animation.

[122] Cycle Consistency in Video Object-Centric Learning cs.CVPDF

Rongzhen Zhao, Zhiyuan Li, Ruonan Wei, Juho Kannala, Joni Pajarinen

TL;DR: 本文提出了一种隐式循环一致性（ICC）方法，用于解决视频中以对象为中心的学习（OCL）中直接应用显式循环一致性（ECC）导致特征崩溃的问题。该方法将一致性约束从离散的槽空间转移到连续的重建流形上，鼓励槽在集体解释视觉场景上达成软共识，而非强制刚性的点对点特征对齐。

Details

Motivation: 动机在于解决自监督视频对象中心学习中，由于场景分解的非唯一性导致槽具有随机性和模糊性，直接应用显式循环一致性会强制均值寻求，惩罚模型探索同样有效的替代分解，从而引发特征崩溃的问题。

Result: 在复杂的视频OCL基准测试上的广泛实验表明，ICC避免了特征崩溃，并且性能优于ECC基线方法。

Insight: 创新点在于将循环一致性约束从确定性的槽表示空间转移到连续的重建流形，这是一种从强制刚性对齐到鼓励软共识的范式转变，为解决OCL中因表示模糊性导致的优化困境提供了新思路。

Abstract: Self-supervised video Object-Centric Learning (OCL) aims to discover distinct objects and associate them across time, whereas self-supervised Multi-Object Tracking (MOT) focuses on associating pre-defined object detections or segmentations. Although well-established in MOT, Cycle Consistency (CC) cannot naively or explicitly apply to the latent slot space of OCL. Unlike the deterministic and ideal object representations in MOT, OCL slots are inherently stochastic and ambiguous due to non-unique scene decompositions. Enforcing explicit cycle consistency (ECC) on slots imposes rigid mean seeking. This severely penalizes the model for exploring alternative but equally valid decompositions, thereby driving towards feature collapse. To resolve this dilemma, we propose \textit{Implicit Cycle Consistency (ICC)}, which shifts the cycle-consistency constraint from the restrictive slot space to the continuous reconstruction manifold, encouraging slots to reach a soft consensus on collectively interpreting the visual scene rather than forcing rigid point-to-point feature alignment. Extensive experiments on complex video OCL benchmarks demonstrate that ICC avoids feature collapse and outperforms ECC baselines. Our source code, model checkpoints and training logs are provided on https://github.com/Genera1Z/ICC.

[123] Déjà View: Looping Transformers for Multi-View 3D Reconstruction cs.CVPDF

Alessandro Burzio, Tobias Fischer, Sven Elflein, Qunjie Zhou, Riccardo de Lutio

TL;DR: 本文提出DéjàView模型，通过循环应用单个Transformer块对多视图特征进行K步迭代优化，实现高效的多视图3D重建。该方法将模型深度显式转化为迭代步骤，在多个基准测试中性能优于参数规模大得多的前馈基线模型，且参数量和计算成本更低。

Details

Motivation: 针对当前前馈式3D重建Transformer模型参数膨胀但连续层行为相似的问题，作者认为模型深度本质上是低效的参数迭代，因此提出显式迭代架构以提高效率。

Result: 在涵盖室内、室外、物体中心和驾驶场景的五个重建基准测试中，DéjàView匹配或显著优于参数规模大得多的前馈基线，同时参数量仅为后者一小部分且计算成本相当或更低。

Insight: 创新点在于将循环Transformer块作为显式迭代机制，这不仅是一种计算高效的容量替代方案，更为多视图3D重建提供了更强的归纳偏置；同一循环块在相同训练条件下优于每步独立参数的变体，验证了迭代架构的有效性。

Abstract: Recent feed-forward 3D reconstruction transformers have scaled to over a billion parameters, following the broader trend of increasing model capacity in computer vision. Yet emerging evidence suggests that contiguous transformer layers often behave like repeated applications of similar operations, and multi-view reconstruction transformers refine their predictions progressively across decoder depth. We posit that model depth partially buys iteration, paid for inefficiently in unique parameters, and instead make that iteration explicit in architecture. Our model, DéjàView, applies a single looped transformer block recurrently to per-view features for K refinement steps. Trained once, it exposes K as an inference-time compute knob, matching or outperforming substantially larger feed-forward baselines across five reconstruction benchmarks spanning indoor, outdoor, object-centric, and driving scenes, while using a fraction of their parameters and comparable or lower compute. Importantly, the same looped block formulation outperforms an otherwise identical variant with independent per-step parameters under matched training data and compute, suggesting that explicit iteration is not merely a compute-efficient substitute for capacity but a stronger inductive bias for multi-view 3D reconstruction.

[124] Beyond 3D VQAs: Injecting 3D Spatial Priors into Vision-Language Models for Enhanced Geometric Reasoning cs.CV | cs.AIPDF

Chun-Hsiao Yeh, Shengyi Qian, Manchen Wang, Yi Ma, Joseph Tighe

TL;DR: 本文提出GASP框架，通过向大语言模型的Transformer层注入几何先验知识来增强视觉语言模型的3D空间推理能力。该方法利用大规模视频场景的真实几何数据进行训练，通过对比损失和深度一致性监督学习2D视角不变性和解决3D几何歧义，无需依赖3D视觉问答数据进行微调。

Details

Motivation: 现有视觉语言模型在3D空间推理方面表现不佳，依赖3D视觉问答数据集微调的方法容易过拟合数据集特定偏差，而集成专用3D视觉编码器则不够灵活。作者认为真正的空间理解应来自学习基础几何先验，而非仅依赖高层VQA监督。

Result: 实验显示标准VLM内部对应匹配准确率极低（常低于5%），而GASP训练将层间对应峰值提升至70%以上，时间鲁棒性保持85%以上。在下游空间基准测试中，All-Angles Bench提升18.2%，VSI-Bench提升29.0%，均未使用任何3D VQA数据训练。

Insight: 创新点在于通过小型对应头作为深度监督信号跨所有Transformer层注入几何先验，采用基于真实几何数据的双重目标函数。该方法表明从基础几何先验学习是实现可靠3D空间推理的通用化途径，避免了传统方法对特定数据集的依赖。

Abstract: Vision-Language Models (VLMs) often struggle with robust 3D spatial reasoning. Prevailing methods that rely on fine-tuning with 3D visual question-answering (VQA) datasets may overfit dataset-specific biases, while integrating specialized 3D visual encoders is often inflexible and cumbersome. In this paper, we argue that genuine spatial understanding should emerge from learning fundamental geometric priors, not only from high-level VQA supervision. We propose GASP (Geometric-Aware Spatial Priors), a framework that injects these priors directly into the LLM’s transformer layers. GASP employs a small correspondence head, applied as a deep supervision signal across all layers, and is trained with a dual objective leveraging ground-truth geometry from large-scale video scenes: a contrastive loss on ground-truth point correspondences enforces 2D view-invariance, while a depth consistency supervision resolves 3D geometric ambiguities. Our analysis first provides a diagnostic showing that standard VLMs’ internal correspondence matching accuracy is very low (often below 5%). We then demonstrate that our training substantially improves this behavior, boosting peak layer-wise correspondence to over 70% and maintaining over 85% temporal robustness while baselines remain below 5%. These internal improvements translate to significant gains on downstream spatial benchmarks including +18.2% on All-Angles Bench and +29.0% on VSI-Bench, all without training on any 3D VQA data. Our findings indicate that learning from fundamental geometric priors is a promising and generalizable pathway towards VLMs with more reliable 3D spatial reasoning.

[125] GenClaw: Code-Driven Agentic Image Generation cs.CVPDF

Junyan Ye, Jun He, Zilong Huang, Dongzhi Jiang, Xuan Yang

TL;DR: 本文提出GenClaw，一种代码驱动的智能图像生成范式，旨在解决现有基于文本提示的图像生成代理缺乏对画布直接控制能力的问题。该方法模拟人类艺术家的创作流程，通过搜索与推理构建概念，利用代码（如SVG、HTML）生成可执行的视觉草图，最后使用图像生成模型补充纹理和真实感。

Details

Motivation: 现有图像生成代理依赖于黑盒模型，其工作流程局限于重复的提示词改写，缺乏直接操控画布的机制，未能充分发挥大语言模型作为精确视觉构建’画笔’的潜力。

Result: 论文未在摘要中提及具体的定量实验结果或基准测试对比。

Insight: 核心创新在于将代码作为可控的中间画布，桥接语言推理与像素合成，将图像生成从黑盒范式转变为分阶段、可解释的流程，实现了程序化逻辑与生成模型视觉表现力的无缝集成。

Abstract: Image generation models have evolved from text-conditioned pixel synthesis toward multimodal agents endowed with visual comprehension and tool invocation capabilities. Yet, existing agents remain at the mercy of underlying black-box image models. Their workflow is trapped in a repetitive cycle of prompt rewriting for generation refinement, leaving them with no mechanism to directly manipulate the canvas. In essence, the potential of LLMs to serve as a genuine “brush” for precise visual construction remains largely untapped. In this paper, we propose GenClaw, a code-driven agentic image generation paradigm that empowers the agent to create like a human artist: first conceptualizing, then sketching, and finally coloring. Specifically, the agent first constructs the conceptual knowledge and context through search and reasoning. It then utilizes code (e.g., SVG, HTML, Three.js) to render executable visual sketches. Finally, it employs an image generation model to supplement textures, materials, and photorealism. In this workflow, code serves as a controllable intermediate canvas bridging linguistic reasoning and pixel synthesis, seamlessly integrating programmatic logic with the visual expressiveness of generative models. By transforming image generation from a black-box paradigm into a staged process akin to authentic human creation, GenClaw offers a step toward for highly controllable and interpretable visual generation systems.

[126] Reinforcement Learning with Robust Rubric Rewards cs.CV | cs.AIPDF

Ya-Qi Yu, Hao Wang, Fangyu Hong, Xiangyang Qu, Gaojie Wu

TL;DR: 本文提出了RLR³方法，将可验证奖励的强化学习从任务级验证扩展到标准级验证，以解决视觉语言任务中多标准监督的挑战。该方法通过两种执行路径处理实例特定的评分标准：LLM作为提取器配合确定性验证器，或LLM作为法官处理不可验证标准，并引入最小暴露策略和分层聚合来确保评分忠实性。

Details

Motivation: 动机在于许多视觉语言任务仅部分可验证，需要多标准监督，而现有RLVR方法仅适用于可确定性检查的任务，无法有效利用评分标准进行细粒度监督。

Result: 在Qwen3-VL-30B-A3B模型上，于15个基准测试中评估，RLR³一致优于RLVR，相比基础模型提升4.7分，并超过了官方指导到思考模型的性能差距。受控审计证实其确定性验证和最小暴露策略显著减少了可利用的误报。

Insight: 创新点包括将可验证奖励强化学习扩展至标准级验证，设计LLM双路径执行架构，以及引入最小暴露策略和分层聚合机制来提升评分鲁棒性，有效处理部分可验证任务的多标准监督问题。

Abstract: While Reinforcement Learning with Verifiable Rewards (RLVR) is effective for deterministically checkable tasks, many vision-language tasks are partially verifiable, demanding multi-criteria supervision (e.g., perceptual details, reasoning steps, and constraints). Rubrics provide a natural interface for this fine-grained supervision, but their effectiveness depends on the execution accuracy during online RL. We propose Reinforcement Learning with Robust Rubric Rewards ($\text{RLR}^3$), extending RLVR from task-level verification to criterion-level verification. $\text{RLR}^3$ routes instance-specific rubrics through two execution paths: an LLM-as-an-extractor paired with a deterministic verifier, or an LLM-as-a-Judge for non-verifiable criteria. To ensure faithful scoring, $\text{RLR}^3$ introduce a minimal exposure strategy that masks ground truths from extractors and images from judges. Furthermore, $\text{RLR}^3$ employs hierarchical aggregation to prioritize essential criteria over additional criteria, and mitigates score saturation within rollout groups. Evaluated on Qwen3-VL-30B-A3B across 15 benchmarks, $\text{RLR}^3$ consistently outperforms RLVR, yielding a 4.7-point improvement over the base model and exceeding the official instruct-to-thinking model gap. Controlled audits confirm our deterministic verification and minimal exposure significantly reduce exploitable false positives.

[127] VideoFDB: Evaluating Full-Duplex Vision-Speech Capabilities in Conversational Agents cs.CV | cs.CL | cs.HCPDF

Amrita Mazumdar, Seonwook Park, Rajarshi Roy, Nikhil Srihari, Shengze Wang

TL;DR: 本文提出了VideoFDB，这是首个用于评估全双工视听对话代理的基准测试。该基准包含来自真实世界视频通话的237个对话片段，涵盖11种非语言对话动态，并提供了一个基于评分规则的LM-as-judge评估框架。研究发现现有系统存在系统性故障模式，如‘字幕崩溃’和‘视觉流忽视’，并且当前架构无法产生全双工非语言线索。

Details

Motivation: 自然的人类对话是全双工且视听兼备的，而现有的全双工基准仅评估语音能力。为了支持成功的人机交互，需要能够评估代理对全双工视听对话建模能力的基准。

Result: 研究评估了开源和闭源的视觉-语音代理，揭示了它们普遍存在的故障模式。同时评估了级联语音到化身系统，发现其架构从根本上阻碍了全双工非语言线索的产生。VideoFDB为系统性评估奠定了基础。

Insight: 主要创新点在于创建了首个全双工视听到视听交互的基准，并引入了将感知行为与生成行为分离的分类法。客观来看，其基于规则的、具有可解释维度的LM-as-judge评估框架，为评估对话质量与非语言动态的关系提供了新方法，有助于推动下一代多模态对话代理的发展。

Abstract: Natural human conversation is full-duplex and audio-visual: people simultaneously speak and listen while continuously interpreting and producing nonverbal cues, such as nods, smiles, and gestures. To support successful human-agent interaction, agents must model full-duplex audiovisual conversation; however, existing full-duplex benchmarks evaluate only speech. In this work, we present VideoFDB, the first benchmark to evaluate full-duplex audio-visual-to-audio-visual (AV2AV) conversational agents. VideoFDB contributes (i) 237 dyadic clips spanning 11 nonverbal conversational dynamics from real-world video calls, (ii) a taxonomy separating perception from generation behaviors, and (iii) a rubric-based LM-as-judge evaluation framework with interpretable axes for assessing conversational quality with respect to nonverbal conversational dynamics. Across open- and closed-source vision-speech agents, we find systematic failure modes: captioning collapse and visual-stream ignorance, and we show that current systems exploit vision for explicit visual question answering but not for the streaming joint audiovisual grounding required in natural conversation. We further evaluate cascaded speech-to-avatar systems and find that their architecture fundamentally precludes the production of full-duplex nonverbal cues. As the first benchmark for full-duplex AV2AV interaction, VideoFDB establishes a foundation for systematic evaluation and, we hope, will accelerate the advancement and development of next-generation multimodal conversational agents.

[128] Stable-Layers: Fine-Tuning Image Layer Decomposition Models with VLM-Scored Reinforcement Learning cs.CVPDF

Ciara Rowles, Reshinth Adithyan, Nikhil Pinnaparaju, Vikram Voleti, Mark Boss

TL;DR: 本文提出了Stable-Layers，一个基于强化学习的框架，用于微调预训练的图层分解模型。该方法无需成对的监督数据，仅利用视觉语言模型（VLM）的反馈作为奖励信号，通过Flow-GRPO算法和LoRA适配来优化模型，旨在生成具有更强图层分离度、更少伪影和更低重建误差的图像分解结果。

Details

Motivation: 动机在于解决图像图层分解模型微调时对成对监督数据的依赖问题，并设计一个可靠的、仅基于VLM反馈的奖励信号来指导模型优化。

Result: 在Crello数据集上的实验表明，与基础模型Qwen-Image-Layered相比，Stable-Layers生成的分解结果在图层分离度、伪影控制和单层重建误差方面均有提升。

Insight: 核心创新点在于提出了一个两阶段的VLM奖励评估流程，结合了基于五个编辑导向准则的结构化单样本评分和基于网格的校准步骤，有效缓解了VLM评分分布狭窄、方差不足的问题，从而为GRPO强化学习提供了有效的学习信号。

Abstract: We present Stable-Layers, a reinforcement learning framework that eliminates the need for paired supervision by fine-tuning a pretrained layer decomposition model using only feedback from a vision-language model (VLM). Starting from Qwen-Image-Layered, we apply Flow-GRPO with LoRA adaptation, sampling multiple candidate decompositions per image, scoring them with a VLM, and optimising the policy from group-relative advantages. The key challenge lies in designing a reliable reward signal: VLMs scoring samples in isolation tend to compress their judgements into a narrow band, leaving GRPO with little within-group variance to learn from. We address this with a two-stage evaluation pipeline that pairs structured per-sample scoring across five edit-centric criteria with a grid-based calibration step in which the VLM re-scores all candidates side-by-side. Stable-Layers produces decompositions with stronger layer separation, fewer blank or artifact-heavy layers, and lower per-layer reconstruction error on the Crello dataset compared to the base model.

[129] minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Models cs.CVPDF

Min Zhao, Hongzhou Zhu, Bokai Yan, Zihan Zhou, Yimin Chen

TL;DR: 本文提出了minWM，一个全栈开源框架，用于构建实时交互式视频世界模型。该框架提供端到端流程，可将现有的双向文本/图像到视频基础模型转化为相机可控、低延迟的自回归世界模型。

Details

Motivation: 现有视频扩散基础模型在高质量视频生成上取得进展，但将其转化为实时交互式世界模型仍具挑战，后者需要可控、因果且低延迟的推演能力。

Result: 框架在代表性开源骨干网络（如Wan2.1-T2V-1.3B和HY1.5-TI2V-8B）上实例化，支持适应现有视频世界模型（如HY-WorldPlay）到新数据分布和延迟目标，并提供了相机轨迹质量、可控性训练步骤等实用消融实验。

Insight: 创新点在于提出了一个模块化、可扩展的完整流程，包括因果强制/因果强制++管道（含自回归扩散训练、因果ODE或因果一致性蒸馏及非对称DMD），实现了从双向模型到少步自回归生成器的蒸馏，为构建和适配实时交互视频世界模型提供了可复现方案。

Abstract: Recent video diffusion foundation models have achieved remarkable progress in high-quality video generation, yet turning them into real-time interactive video world models remains challenging. Interactive world models require controllable, causal, and low-latency rollout, which in practice demands a full pipeline spanning data construction, controllable fine-tuning, autoregressive training, few-step distillation, and streaming inference. In this work, we present minWM, a full-stack open-source framework for building real-time interactive video world models. minWM provides an end-to-end pipeline that converts existing bidirectional T2V/TI2V video foundation models into camera-controllable few-step autoregressive world models. Specifically, minWM first fine-tunes a bidirectional video diffusion model with camera control, and then applies the Causal Forcing / Causal Forcing++ pipeline, including AR diffusion training, causal ODE or causal consistency distillation, and asymmetric DMD, to distill it into a few-step autoregressive generator for low-latency rollout. The framework is modular and architecture-extensible: we instantiate it on representative open backbones, including Wan2.1-T2V-1.3B and HY1.5-TI2V-8B, covering both cross-attention-based condition injection and MMDiT-style architectures. minWM also supports adapting existing video world models, such as HY-WorldPlay, to new data distributions, training recipes, and latency targets. Beyond releasing runnable scripts, checkpoints, documentation, and inference code, we provide practical ablations on camera trajectory quality, controllability training steps, and minimal batch-size requirements. We hope minWM serves as a reproducible and extensible recipe for building and adapting real-time interactive video world models. Project Page: https://github.com/shengshu-ai/minWM

[130] LoMo: Local Modality Substitution for Deeper Vision-Language Fusion cs.CV | cs.CLPDF

Feng Han, Zhixiong Zhang, Zheming Liang, Yibin Wang, Jiaqi Wang

TL;DR: 本文提出了局部模态替换（LoMo）方法，旨在解决视觉语言模型（VLMs）中存在的‘载体敏感性’问题。该问题表现为将文本问题替换为语义相同的渲染图像时，模型性能会大幅下降。LoMo通过将单模态提示重构为无缝交织的多模态序列，动态选择文本片段并将其转换为渲染图像，从而在‘文本-视觉-文本’载体间保持语义一致性，以监督跨模态表示不变性。

Details

Motivation: 当前视觉语言模型的训练数据存在固有偏差，文本和图像通常被组织成不对称的角色（文本作为语言查询，图像作为视觉参考），导致模型对不同模态的信息获取存在偏好，无法对齐语义等效内容的跨模态表示，使得模型在模态替换下推理脆弱。

Result: 在13个不同的多模态基准测试上的广泛实验表明，LoMo显著提升了整体多模态推理能力和跨模态融合深度。具体而言，它在基础模型上带来了一致的性能提升，例如在LLaVA-OneVision-1.5-8B上比标准SFT提高了2.67分，在Qwen3.5-9B上提高了2.82分。

Insight: 创新点在于提出了一种轻量级、架构无关的数据策展范式（LoMo），通过动态创建语义等效的跨模态序列来直接监督表示不变性，从而缓解训练数据偏差，促进更深层次的视觉语言融合。这为改善VLMs的跨模态对齐和鲁棒性提供了一种有效的数据层面解决方案。

Abstract: Vision-Language Models (VLMs) have achieved substantial progress across a wide range of understanding and reasoning tasks, driven by large-scale image-text training aimed at multimodal fusion. Ideally, replacing a textual question with its rendered-image counterpart should leave model performance essentially unaffected. In practice, however, such modality substitution induces dramatic performance degradation. We attribute this “carrier sensitivity” issue to an inherent bias in current training corpora. Across prevalent datasets such as image captioning, VQA, OCR, and web-sourced interleaved data, text and images are typically organized into distinct and asymmetric roles, with text serving as linguistic queries and images as visual references. Such data bias leads VLMs to exhibit distinct preferences for information acquisition across different modalities. Consequently, VLMs fail to align representations of semantically equivalent content across textual and visual carriers, making model reasoning fragile under modality substitution. To address this, we propose Local Modality Substitution (LoMo), a lightweight, architecture-agnostic data curation paradigm designed to provide supervision for cross-modal representational invariance between semantically equivalent text and image carriers. LoMo achieves this by reformulating single-modality prompts into seamlessly interleaved multimodal sequences. It dynamically selects target text spans and recasts them as rendered images, thereby preserving the same semantics across “text, visual, text” carriers. Extensive experiments across 13 diverse multimodal benchmarks demonstrate that LoMo significantly improves overall multimodal reasoning and yields deeper cross-modal fusion. Specifically, it delivers consistent gains across foundational models, improving over standard SFT by 2.67 points on LLaVA-OneVision-1.5-8B and 2.82 points on Qwen3.5-9B.

[131] PhyGenHOI: Physically-Aware 4D Generation of Dynamic Human-Object Interactions cs.CV | cs.AIPDF

Omer Benishu, Gal Fiebelman, Sagie Benaim

TL;DR: 论文提出了PhyGenHOI框架，用于生成物理准确且视觉逼真的4D人-物交互（HOI）动态场景。该方法将基于扩散模型生成的人体运动与基于物质点法（MPM）的显式物理对象模拟相结合，使用3D高斯作为统一的可微表示。通过三种耦合机制监督交互过程，实验表明该方法能生成物理一致的4D HOI，优于基线方法。

Details

Motivation: 解决生成物理准确且视觉逼真的4D人-物交互动态场景的挑战，即在给定静态3D人体和目标物体（表示为3D高斯）的情况下，根据输入文本合成人体通过特定动作（如拳击、踢腿）与物体进行主动交互的动态场景。

Result: 实验表明，PhyGenHOI能在多种动作、人体和物体上生成物理一致的4D HOI，性能优于基线方法。

Insight: 主要创新点在于将生成式人体运动（MDM）与显式物理对象模拟（MPM）通过3D高斯这一统一可微表示进行耦合，并设计了三种监督交互的机制（窗口吸引损失、接触驱动重模拟、掩码视频SDS目标），以同时保证动作的语义合理性和交互的物理准确性。

Abstract: We address the task of generating physically accurate and visually faithful 4D Human-Object Interaction (HOI). Given a static 3D human and target object represented as 3D Gaussian Splats (3DGS), our goal is to synthesize dynamic scenes where the human actively engages with the object through actions, such as punching or kicking, in accordance with a given input text. To this end, we introduce PhyGenHOI, a novel framework that couples generative human motion with an explicit physical object simulation. We model the human as a semantic agent driven by a Motion Diffusion Model (MDM) and the object as a physical agent simulated via the Material Point Method (MPM), utilizing 3D Gaussians as a unified, differentiable representation. We supervise their interaction through three coupled mechanisms: (1) A Windowed Attraction Loss that temporally synchronizes generative motion to intercept the object; (2) A Contact-Driven Re-simulation step that triggers physically consistent momentum transfer upon impact; and (3) A Masked Video-SDS objective that injects video-based priors to enhance contact fidelity. Experiments show PhyGenHOI generates physically consistent 4D HOI across diverse actions, humans, and objects, outperforming baselines. Project page and videos: https://omerbenishu.github.io/PhyGenHOI/

[132] Grounded 3D-Aware Spatial Vision-Language Modeling cs.CVPDF

An-Chieh Cheng, Yang Fu, Yatai Ji, Ligeng Zhu, Guanqi Zhan

TL;DR: 本文提出了GR3D模型，这是一个集成了显式2D、隐式2D和单目3D三种互补的视觉-语言空间基础能力的统一框架。该模型通过隐式基础机制在生成时识别实体提及并插入区域标记，以支持空间思维链响应；同时通过区域提示的单目3D基础设计，在相机视图中预测3D边界框。这些能力使模型能够将复杂的空间理解问题分解为基于2D感知的3D推理。

Details

Motivation: 旨在解决视觉语言模型（VLMs）在空间理解任务中缺乏有效视觉证据引用和3D推理能力的问题，通过引入多模态基础能力来增强模型对空间关系的理解和推理。

Result: 在多个基础和未基础的空间基准测试中取得了一致的性能提升，表明基础能力作为归纳偏置能有效增强VLMs的空间理解能力。

Insight: 创新点在于将显式/隐式2D基础与单目3D基础统一于单一模型，并通过隐式基础机制实现动态视觉证据引用，以及通过区域提示和几何监督实现从2D到3D的空间推理分解，这为增强VLMs的几何和空间理解提供了新思路。

Abstract: We present GR3D, a spatial vision language model equipped with three complementary grounding capabilities–explicit 2D grounding, implicit 2D grounding, and monocular 3D grounding–within a single framework. GR3D introduces an implicit grounding mechanism that identifies entity mentions during generation and inserts the corresponding region tokens into the text stream, allowing the model to reference visual evidence on the fly when producing spatial chain-of-thought responses. In parallel, a region-prompted monocular 3D grounding design predicts 3D bounding boxes in the camera view from grounded region queries, supported by intrinsic-aware normalization and dense geometric supervision. Together, these grounding capabilities enable GR3D to decompose complex spatial understanding problems into grounded 2D perception followed by 3D inference. GR3D achieves consistent improvements across grounded and non-grounded spatial benchmarks, demonstrating grounding as an effective inductive bias for strengthening spatial understanding in VLMs. These grounding capabilities collectively enhance general spatial understanding beyond the grounding task itself.

[133] Archon: A Unified Multimodal Model for Holistic Digital Human Generation cs.CV | cs.AIPDF

Chong Bao, Shichen Liu, Lijun Yu, David Futschik, Stylianos Moschoglou

TL;DR: 本文提出了Archon，一个完全预训练、以人为中心的统一多模态模型，用于生成整体数字人。该模型通过模态特定分词器统一了七种模态，并在同步模态和72个多样化任务上进行预训练，以建模整体联合分布。针对高保真说话视频中的令牌爆炸问题，引入了内存高效的语义视频重参数化方法，实现了4倍的令牌减少，同时保留了细粒度动态，并结合了语义驱动的视频扩散解码器。进一步提出了’模态思维’方法，将模糊的跨模态任务分解为逐步的模态交替链思维，逐步增强保真度和可控性。

Details

Motivation: 数字人对于沉浸式交互至关重要，但创建一个统一的模型来处理包括文本、音频、动作和视觉内容在内的整体模态仍然是一个开放挑战。

Result: 大量实验表明，Archon在多种数字人生成任务中实现了优越或可比的性能，验证了统一框架的有效性。

Insight: 创新点包括：统一七种模态的预训练多模态模型架构；针对高保真说话视频的令牌爆炸问题，提出了内存高效的语义视频重参数化方法，实现4倍令牌减少；以及’模态思维’方法，通过逐步模态交替链分解模糊跨模态任务，增强可控性和保真度。

Abstract: Digital humans are fundamental to immersive interaction, yet creating a unified model for holistic modalities, including text, audio, motion, and visual content, remains an open challenge. In this paper, we present Archon, a fully pretrained, human-centric unified multimodal model for holistic avatar generation. Archon unifies seven modalities with modality-specific tokenizers, and a native autoregressive unified multimodal model pretrained on synchronized modalities and 72 diverse tasks to model holistic joint distributions. To address the token explosion challenge in high-fidelity talking videos, we introduce a memory-efficient semantic video reparameterization, achieving 4x token reduction while preserving fine-grained dynamics, coupled with a semantic-driven video diffusion decoder. We further propose a “Thinking in Modality” that decomposes ambiguous cross-modal tasks into stepwise thinking in an alternative chain of modality, progressively enhancing fidelity and controllability. Extensive experiments demonstrate that Archon achieves superior or comparable performance across diverse digital human generation tasks, validating the effectiveness of our unified framework. Project page: https://zju3dv.github.io/archon/.

[134] VPG: Visual Prefix Guidance for Autoregressive Image and Video Generation cs.CVPDF

Xinyao Liao, Qiyuan He, Yicong Li, Jiayin Zhu, Xiaoye Qu

TL;DR: 本文提出了一种名为视觉前缀引导（VPG）的训练无关推理时引导方法，用于解决自回归图像和视频生成模型在推理时因暴露偏差和前缀漂移导致的质量下降问题。该方法通过对比模型在生成前缀与损坏前缀下的输出，并调整logits以增强生成前缀的后验支持，从而提升生成质量。

Details

Motivation: 自回归生成器在训练时使用教师强制历史，但在推理时必须从自身生成的前缀中采样，这使其容易受到暴露偏差和前缀漂移的影响。现有方法主要针对外部语义条件（如类别标签或文本提示）进行训练修改或采样时引导，而未关注下一步预测是否对生成前缀本身提供强后验支持。

Result: 在VAR的类别条件图像生成、Infinity的文本到图像生成以及InfinityStar的文本到视频生成任务中，VPG无需重新训练基础模型即可提升生成质量，例如在VAR上将FID平均降低0.36，并在图像和视频生成基准测试中表现更优。

Insight: 创新点在于提出了一种专注于增强生成前缀自身后验支持的推理时引导方法，通过对比和logits外推机制，有效缓解了自回归生成中的暴露偏差问题，且无需额外训练，具有通用性和高效性。

Abstract: Autoregressive image and video generators are trained with teacher-forced histories but must sample from their own generated prefixes at inference time, making them vulnerable to exposure bias and prefix drift. Existing remedies either modify training or apply sampling-time guidance aimed primarily at external semantic conditions, such as class labels or text prompts, rather than testing whether a next-step prediction provides strong posterior support for the generated prefix itself. We propose Visual Prefix Guidance (VPG), a training-free inference-time guidance method for autoregressive image and video generation. VPG improves next-step prediction by contrasting the model’s output under the generated prefix with its output under a corrupted prefix, then extrapolating logits toward candidates that strengthen the posterior support of the generated prefix. Across class-conditional image generation with VAR, text-to-image generation with Infinity, and text-to-video generation with InfinityStar, VPG improves generation quality without retraining the base model, reducing FID on VAR by 0.36 on average and improving benchmark performance on both image and video generation.

[135] MonoPhysics: Estimating Geometry, Appearance, and Physical Parameters from Monocular Videos cs.CVPDF

Daniel Rho, Jun Myeong Choi, Matthew Thornton, Biswadip Dey, Roni Sengupta

TL;DR: MonoPhysics是一个从单目视频中联合估计可变形物体的几何、外观和物理参数的框架。它通过结合可微分的MPM（物质点法）模拟和3D高斯泼溅技术，解决了单目设置下存在的尺度模糊、几何不准确以及外观优化与物理模拟耦合弱的问题。该方法在Vid2Sim和新构建的弹塑性物体数据集上进行了评估，性能优于现有单目基线，并达到了与多视图基线相当的水平。

Details

Motivation: 现有的逆物理方法通常依赖于多视图视频来恢复物理参数，利用视图间的几何约束来解决尺度与3D结构问题。然而，在单目设置下，由于缺乏这种跨视图约束，会导致严重的尺度模糊、不准确的几何估计，以及外观优化与物理模拟之间的弱耦合。本文旨在解决从单目视频中准确估计可变形物体物理参数的挑战。

Result: 在Vid2Sim数据集和作者新构建的包含弹性和塑性物体的数据集上进行了评估。结果表明，MonoPhysics在单目设置下超越了现有的基线方法，并且仅使用单目相机就达到了与多视图基线方法相当的性能。

Insight: 论文的核心创新在于提出了三个视觉-物理桥梁：全局尺度对齐、物理感知的几何细化以及可微分位置图。这三个组件共同作用，使得仅从单目观测中就能进行准确的联合优化。从客观角度看，将可微分的MPM物理模拟与新兴的3D高斯泼溅渲染技术相结合，为单目逆物理估计提供了一个新颖且有效的端到端框架，解决了该领域的关键瓶颈。

Abstract: Existing inverse physics methods recover physical parameters from multi-view videos, where geometric constraints across views resolve scale and 3D structure. In monocular settings, however, such constraints are absent, leading to severe scale ambiguity, inaccurate geometry, and weak coupling between appearance optimization and physical simulation. We propose MonoPhysics, a framework for monocular inverse physics estimation of deformable objects using differentiable MPM simulation and 3D Gaussian Splatting, which jointly optimizes geometry, appearance, and physical parameters from a single camera view. We address these challenges through three visual-physical bridges: global scale alignment, physics-aware geometry refinement, and a differentiable position map, which together enable accurate optimization from monocular observations alone. We evaluate on Vid2Sim and our new dataset of elastic and plastic objects, showing that MonoPhysics outperforms existing baselines in monocular settings and achieves performance comparable to multi-view baselines using only a single camera. Our project page is available at https://daniel03c1.github.io/MonoPhysics/

[136] Veda: Scalable Video Diffusion via Distilled Sparse Attention cs.CVPDF

Shihao Han, Hao Yang, Xinting Hu, Xiaofeng Mei, Yi Jiang

TL;DR: 论文提出Veda，一种用于视频扩散模型的蒸馏稀疏注意力框架，旨在解决自注意力二次计算成本过高的问题。该方法通过将分块选择建模为从完整注意力重建的显式问题，结合统计感知分块评分和头感知分块技术，在保持生成质量的同时实现高稀疏度，并利用硬件高效的分块跳过内核实现实际加速。

Details

Motivation: 扩散Transformer在生成高分辨率长视频时，受限于自注意力的二次计算成本，而现有稀疏注意力方法在高稀疏度下性能会下降。

Result: 在Waver和Wan2.1等大型视频扩散模型上的实验表明，Veda实现了显著的加速且生成质量无明显下降。例如，在Waver-T2V-12B上生成720P 10秒视频时，实现了5.1倍端到端加速和10.5倍自注意力加速，将注意力开销从92%降至50%。

Insight: 核心创新在于发现生成质量取决于稀疏掩码与完整注意力分块几何结构的对齐程度，而非稀疏比本身，并据此设计了基于重建的蒸馏稀疏注意力框架。该方法通过统计感知评分和头感知分块减少误差，且加速收益随序列长度增加，具有良好的时空分辨率扩展性。

Abstract: Scaling Diffusion Transformers to generate high-resolution, long videos is constrained by the quadratic cost of self-attention, and existing sparse attention methods degrade under high sparsity. We show empirically that generation quality is determined not by the sparsity ratio itself, but by how well the sparse mask aligns with the tile-wise geometry of full attention. Based on this insight, we propose Veda, a distilled sparse attention framework that formulates tile selection as an explicit reconstruction problem from full attention. Veda integrates statistics-aware tile scoring with head-aware tiling to reduce estimation error and structural mismatch, enabling aggressive sparsity. A hardware-efficient tile-skipping kernel converts theoretical sparsity into practical wall-clock speedups. Experiments on large video diffusion models, including Waver and Wan2.1, demonstrate substantial acceleration with no noticeable degradation in generation quality. To generate 720P 10-second videos on Waver-T2V-12B, Veda achieves a 5.1$\times$ end-to-end speedup and a 10.5$\times$ self-attention speedup, reducing attention overhead from 92% to 50%. Notably, the gains increase with sequence length, indicating that Veda scales favorably with spatiotemporal resolution across models.

[137] Supercharging Thermal Gaussian Splatting with Depth Estimation cs.CVPDF

Manoj Biswanath, Chenxin Cai, Hannah Schieber, Daniel Roth, Benjamin Busam

TL;DR: 本文提出了一种名为Thermal-to-Depth Gaussian Splatting (TDg)的方法，用于仅使用热红外图像和深度估计来高效构建3D场景表示。该方法旨在减少对多模态数据的依赖，在RGBT-Scenes和ThermalMix数据集上，其渲染质量和训练速度均优于多模态基线MSMG。

Details

Motivation: 在自动驾驶和机器人等领域，高效鲁棒的3D场景表示至关重要。现有方法融合多模态数据（如RGB、热红外、深度）会带来计算开销和复杂性，因此本文旨在探索尽可能摆脱可见光依赖、仅基于单一热红外模态的快速3D重建方案。

Result: 在RGBT-Scenes和ThermalMix测试数据集上，TDg方法在大多数情况下超越了多模态基线MSMG。其渲染质量指标（LPIPS、SSIM、PSNR）平均提升约1.12%、0.034%和0.01%，同时训练时间显著减少了12分47秒（提升55%）。

Insight: 论文的核心创新在于将3D高斯泼溅与深度估计结合，构建了仅依赖热红外单一模态的辐射场重建流程。这为在低光照、恶劣天气或隐私敏感场景下的3D感知提供了新思路，并验证了单一模态方案在速度和性能上的潜力。

Abstract: Efficient and robust 3D scene representation is crucial in autonomous driving, robotics, and related fields. While RGB images provide valuable content for 3D reconstruction, other modalities like thermal or depth can enable additional information on the environment. Lately, novel view synthesis methods like 3D Gaussian Splatting have started using multiple modalities to further boost their performance. But fusing or combining multimodal data can make the process slower and can bring in additional challenges. Therefore, our project aims to use single modality based on thermal infrared domain, by removing the reliance on visible light as much as possible. This single modality can be expected to be faster as it does not rely on multimodal data. We propose a method, Thermal-to-Depth Gaussian Splatting (TDg), that uses only thermal images and depth estimation in its architecture to derive the radiance fields. Our TDg method outperforms the MSMG (Multiple Single-Modal Gaussians) baseline in most cases on our test datasets, RGBT-Scenes and ThermalMix. On average, the rendering quality metrics such as learned perceptual image patch similarity (LPIPS), structural similarity index measure (SSIM), and peak signal-to-noise ratio (PSNR) of TDg are 1.12%, 0.034%, and 0.01% better than the baseline MSMG values. It also reduces the training time significantly, by 12 mins 47 secs (55% improvement). Overall, our method is successful in deriving these thermal radiance fields, which can ultimately have several applications, such as identifying heat sources critical in surveillance, search or rescue operations, and industrial inspections where temperature is widely used to monitor machines.

[138] Benchmarking Single-Factor Physical Video-to-Audio Generation cs.CV | cs.MM | cs.SD | eess.ASPDF

Tingle Li, Siddharth Gururani, Kevin J. Shih, Gantavya Bhatt, Sang-gil Lee

TL;DR: 本文提出了FlatSounds基准，用于评估视频到音频（V2A）生成模型的物理推理能力，通过控制单一物理因素变化的对比对和单视频模式测试来检验音频生成是否准确反映物理属性和时序。研究发现，现有SOTA模型更依赖文本描述而非视觉流来推断物理和语义，且文本描述在提升准确性的同时会损害时序对齐。

Details

Motivation: 现有V2A模型评估侧重于感知真实性，而忽略了在受控干预下的物理正确性，因此需要一个新的基准来审计模型对底层物理过程的理解能力。

Result: 在FlatSounds基准上评估SOTA模型，揭示了模型在物理推理上的权衡：文本描述能提升物理和语义准确性，但会降低时序对齐；基于物理的指标与人类偏好测试高度相关。

Insight: 创新点在于引入了一个专注于物理推理的V2A评估基准，通过控制变量和内部一致性测试来量化模型的物理理解能力；客观分析表明，该研究强调了直接从像素学习物理过程的必要性，而非仅依赖文本辅助。

Abstract: Generative video-to-audio (V2A) models produce highly plausible soundtracks, but it remains unclear whether they capture the underlying physical processes. Existing evaluations emphasize perceptual realism and overlook physical correctness under controlled interventions. In this paper, we introduce FlatSounds, a benchmark that audits the physical reasoning of V2A models through: 1) controlled counterfactual pairs in which a single physical factor is varied, and 2) single-video pattern tests that probe internal consistency and directional trends. These settings test whether the generated audio correctly reflects specific physical properties and timings. Our evaluation of state-of-the-art models reveals a consistent trade-off: models rely more on text captions than the visual stream to infer physics and semantics. Captions generally improve physical and semantic accuracy, but paradoxically degrade temporal alignment. Our results highlight the need to move beyond audio quality toward learning physical processes directly from pixels. Finally, we find that our physics-based metrics correlate strongly with human preference tests on our own data. Project webpage: https://research.nvidia.com/labs/cosmos-lab/flatsounds/

[139] GPIC: A Giant Permissive Image Corpus for Visual Generation cs.CV | cs.AIPDF

Keshigeyan Chandrasegaran, Kyle Sargent, Suchir Agarwal, Michael Jang, Michael Poli

TL;DR: 本文介绍了GPIC，一个包含约28万亿像素的巨型许可图像语料库，用于视觉生成建模研究。GPIC包含1亿训练、20万验证和100万测试样本，所有图像均获得研究和商业用途的许可，并经过安全过滤、去重处理，托管在Hugging Face上。论文还提供了GPIC的基准测试协议和基于像素空间流匹配的参考基线模型。

Details

Motivation: 为了解决视觉生成建模研究中缺乏大规模、可访问且稳定的数据集的问题，作者构建了GPIC，旨在为可扩展的生成方法提供高质量的数据支持。

Result: 论文提供了GPIC数据集上的基准测试协议，并展示了像素空间流匹配的参考基线结果，但摘要中未提及具体定量性能指标或与SOTA的比较。

Insight: 创新点在于构建了一个大规模、许可友好且经过安全处理的图像数据集，可直接用于研究和商业生成模型训练；同时，通过提供基准协议和基线模型，促进了生成建模领域的标准化评估。

Abstract: Studying scalable methods for visual generative modeling requires large, accessible, and stable datasets. We introduce GPIC, a Giant Permissive Image Corpus of approximately 28 trillion pixels. GPIC comprises diverse internet images captioned by a state-of-the-art vision-language model, including 100M training, 200K validation, and 1M test examples. Moreover, all GPIC images are permissively licensed for both research and commercial use. GPIC is safety-filtered, deduplicated, and centrally hosted on Hugging Face. We provide a benchmarking protocol for generative modeling on GPIC. Finally, we provide a reference baseline for pixel-space flow matching on GPIC. Our dataset, benchmark, and models are available at https://huggingface.co/datasets/stanford-vision-lab/gpic. Evaluation toolkit and code are available at https://gpic.stanford.edu

[140] YoCausal: How Far is Video Generation from World Model? A Causality Perspective cs.CVPDF

You-Zhe Xie, Yu-Hsuan Li, Jie-Ying Lee, Kaipeng Zhang, Yu-Lun Liu

TL;DR: 本文提出了YoCausal，一个从因果视角评估视频生成模型是否接近世界模型的双层基准。该基准利用真实视频的时间反转作为自然反事实样本，引入反向惊喜指数（RSI）量化时间方向感知，以及因果认知指数（CCI）通过视觉语言模型区分因果与非因果子集，以解耦真实因果推理与时间偏差。

Details

Motivation: 随着视频扩散模型向世界模型发展，需要评估它们是否真正理解因果关系，还是仅仅过拟合于统计时间模式；现有基准多依赖合成数据，存在模拟到现实的差距，限制了真实世界的泛化能力。

Result: 对13个最先进的视频扩散模型的评估表明，感知时间方向并不等同于理解因果关系，且相对于人类水平的因果认知仍存在显著差距。

Insight: 创新点在于借鉴认知科学中的期望违背范式，利用零成本的时间反转真实视频构建可任意扩展的评估协议，并通过RSI和CCI两个指数分别量化时间感知和因果推理能力，为评估模型的世界建模能力提供了新的因果视角基准。

Abstract: As video diffusion models (VDMs) advance toward world models, a key question arises: do they truly understand causality, or merely overfit to statistical temporal patterns? Existing benchmarks mostly rely on synthetic data, limiting real-world generalization due to the sim-to-real gap. We present YoCausal, a two-level benchmark inspired by the Violation of Expectation (VoE) paradigm from cognitive science. By temporally reversing real-world videos at zero cost as natural counterfactual samples, YoCausal establishes an arbitrarily extensible evaluation protocol. Level 1 introduces the Reverse Surprise Index (RSI), quantifying arrow-of-time perception via denoising loss. Level 2 introduces the Causality Cognition Index (CCI), which leverages a VLM to stratify datasets into causal and non-causal subsets, disentangling genuine causal reasoning from temporal bias. Evaluation of 13 state-of-the-art VDMs reveals that perceiving the arrow of time does not imply understanding causality, and a significant gap persists relative to human-level causal cognition.

[141] NeuROK: Generative 4D Neural Object Kinematics cs.CV | cs.GRPDF

Chen Geng, Guangzhao He, Yue Gao, Yunzhi Zhang, Shangzhe Wu

TL;DR: 本文提出了一种名为NeuROK（神经物体运动学）的数据驱动方法，用于生成逼真的4D动态物体变形。该方法通过在大规模4D数据集上训练基于Transformer的编码器-解码器模型，学习物体运动学的潜在状态参数化，从而简化了在低维潜在空间中模拟物体在各种物理条件下的动态变形过程。

Details

Motivation: 现有方法通常依赖预定义的物理模型并通过系统辨识估计参数，这限制了其泛化能力和数据集规模，难以生成逼真的物体4D动态变形。本文旨在克服这些限制，通过数据驱动的方式学习物体中心的物理系统运动学状态参数化。

Result: 论文在多样化动态物体类型上展示了该神经模拟框架的有效性和通用性，相较于先前工作显示出明显优势。

Insight: 创新点在于提出了一种数据驱动的神经物体运动学（NeuROK）参数化方法，将物体所有可能状态编码到潜在空间，并通过解码器映射到合理变形形状，从而从拉格朗日力学视角简化了动态生成，实现了更通用和高效的4D动态模拟。

Abstract: Data-driven approaches have revolutionized 3D vision, enabling transformers to effectively reconstruct and generate static 3D objects. However, generating simulative 4D dynamics – realistic temporal deformations of static objects under various physical conditions – remains challenging and often ad hoc, despite its importance in building comprehensive 3D world models. Most existing methods assume a predefined physical model and use system identification to estimate parameters, restricting these methods to specific categories and small-scale datasets. We propose that these restrictions can be overcome by learning a data-driven kinematic state parameterization for object-centric physical systems. Specifically, we learn both a latent space representing all possible states of the object and a decoder that maps any sampled latent to a plausibly deformed shape of the object. We refer to this parameterization as Neural Object Kinematics (NeuROK), and learn a transformer-based encoder-decoder model on a curated large-scale 4D dataset. This formulation and the learned model significantly simplify the generation of simulative dynamics since we only need to consider the dynamics within a low-dimensional latent space from the Lagrangian mechanics’ perspective in classical physics. We demonstrate the effectiveness and generality of this neural simulation framework across diverse dynamic object types, showing clear advantages over prior works. Project page: https://chen-geng.com/neurok

[142] AdaState: Self-Evolving Anchors for Streaming Video Generation cs.CVPDF

Yusuf Dalva, Pinar Yanardag

TL;DR: 本文提出AdaState方法，用于改进自回归视频扩散模型在生成流式视频时存在的动态性不足问题。该方法将模型结构中对第一帧的静态锚点替换为自适应状态，这是一个与每块内容共同去噪但从不渲染的隐藏潜在变量，使场景参考能够随生成内容动态演化。

Details

Motivation: 现有自回归视频扩散模型在生成流式视频时，其注意力机制被结构性地锚定在第一帧，导致该帧在注意力缓存中占据特权位置，过度抑制视频动态、锁定初始视角，从而生成时间上“浅薄”、运动与场景演进被抑制的视频。

Result: 实验表明，自适应状态显著改善了视频的动态性，在生成的视频中实现了更丰富的运动和更自然的场景演进。

Insight: 核心创新在于将绝对时间编码转换为相对时间处理，通过引入一个与内容共同演化的自适应状态（而非固定第一帧）作为场景参考，并在每一步生成中通过关注先前状态和当前内容来更新该锚点，从而在无需外部模块的情况下，将递归机制引入生成过程，去噪作为状态转移函数，KV缓存作为载体。

Abstract: Autoregressive video diffusion models generate streaming video by producing frames sequentially, conditioning each chunk on previously generated content. These models are structurally anchored to the first frame: its key-value representation occupies a privileged position in the attention cache and serves as the primary scene reference throughout generation. As the cleanest and most error-free position in the cache, this anchor draws disproportionate attention, suppressing video dynamics, and locking scene composition to the initial viewpoint even as the scene naturally evolves. The result is a temporally shallow video in which motion, camera movement, and scene progression are dampened in favor of static consistency. To address this, we replace the static anchor with an adaptive state, a hidden latent that the model denoises alongside content at every chunk but never renders. Rather than referencing a frozen first frame, the model generates its own scene anchor at each step by attending to both the previous state and the current content, producing a reference that evolves with the generated content. Unlike standard video generation, which encodes an absolute notion of time, our formulation treats time as relative: every generation step sees the same positional structure regardless of how far generation has progressed, and the state transition is identical at every chunk. Together, these properties introduce a recurrence into the generation process, where denoising serves as the transition function, and the KV cache serves as the carrier, requiring no external module. Experiments demonstrate that the adaptive state substantially improves video dynamics, enabling richer motion and natural scene progression within generated videos.

[143] GMOS: Grounding Moving Object Segmentation in 3D Space and Time cs.CVPDF

Junyu Xie, Tengda Han, Weidi Xie, Andrew Zisserman

TL;DR: 论文提出GMOS框架，通过将运动物体分割（MOS）任务建立在3D时空基础上，直接从RGB视频中生成具有3D感知能力、时间细粒度的多运动物体分割结果，并引入GMOS-S变体以加速部署。

Details

Motivation: 针对现有MOS方法依赖缺乏3D几何信息的2D辅助模态（如光流）以及将运动视为序列级属性而忽略物体瞬时运动状态的两个根本局限性。

Result: GMOS在MOS、新提出的瞬时运动分割协议MOS-I以及无监督视频物体分割基准上均达到最先进水平，且运行速度显著快于先前的多物体MOS方法，并支持在线推理。

Insight: 创新点在于将MOS任务直接与3D时空信息结合，提出了时间细粒度的评估协议与数据集，实现了无需预计算2D模态的端到端3D感知运动分割。

Abstract: Moving Object Segmentation (MOS) aims to discover, segment, and track objects that move independently of the camera. Current MOS methods, however, exhibit two fundamental limitations: they rely on pre-computed 2D auxiliary modalities such as optical flow or point trajectories that lack 3D geometric information, and they treat motion as a sequence-level attribute, overlooking the instantaneous motion state of each object. We address both by grounding MOS in 3D space and time, and propose GMOS, a framework that operates directly on RGB video to produce 3D-aware, temporally fine-grained segmentation of multiple moving objects, alongside a foreground–background variant GMOS-S for faster deployment. To support training and evaluation in this regime, we curate GMOS-2K, a dataset of 2,210 real-world videos with per-object temporal motion annotations drawn from five established Video Object Segmentation (VOS) benchmarks, and formalise MOS-I (“I” for instantaneous), a temporally fine-grained evaluation protocol with three complementary metrics. GMOS achieves state-of-the-art results across MOS, MOS-I, and Unsupervised VOS benchmarks, while running significantly faster than prior multi-object MOS methods and supporting online inference for streaming deployment.

[144] VideoMLA: Low-Rank Latent KV Cache for Minute-Scale Autoregressive Video Diffusion cs.CV | cs.AIPDF

Hidir Yesiltepe, Jiazhen Hu, Tuna Han Salih Meral, Adil Kaan Akan, Kaan Oktay

TL;DR: 本文提出了VideoMLA，一种用于长序列自回归视频扩散模型的多头潜在注意力机制，通过共享低秩内容潜在表示和解耦的3D-RoPE位置键，将每层每个token的KV缓存内存减少了92.7%。

Details

Motivation: 针对长序列因果视频扩散模型中固定大小滑动窗口KV缓存导致的流式内存和延迟瓶颈，现有方法主要在窗口布局或位置编码上创新，而本文首次研究了视频扩散中的多头潜在注意力，旨在从根本上减少KV缓存的内存占用。

Result: 在VBench基准测试中，VideoMLA在短时域流式视频扩散上匹配基线方法，在长时域评估方法中获得了最佳综合得分，并在单块B200 GPU上实现了1.23倍的吞吐量提升。

Insight: 创新点在于用共享低秩潜在表示替代传统的逐头KV缓存，并揭示了在视频扩散中，MLA瓶颈本身而非预训练注意力谱的低秩性决定了有效秩，这使得即使预训练注意力不满足低秩假设，高质量压缩仍能实现。

Abstract: Long-rollout causal video diffusion has converged on a fixed-size sliding-window KV cache, with recent progress innovating within this layout by changing which tokens occupy the window or how their positions are encoded. The per-head KV layout itself, a dominant contributor to streaming memory and latency, has been mostly left unchanged. In this paper, we present the first study of Multi-Head Latent Attention (MLA) in video diffusion. VideoMLA replaces per-head keys and values with a shared low-rank content latent and a shared decoupled 3D-RoPE positional key, reducing per-token KV memory by 92.7% at every cached layer. We further investigate why MLA succeeds in video diffusion even though the spectral assumption often used to motivate it in language models does not hold: pretrained video attention is not low-rank, with 99%-energy effective rank far above any practical latent dimension. VideoMLA retains quality at compression ratios where direct spectral approximation would predict large reconstruction error. We show that the MLA bottleneck, rather than the pretrained spectrum, determines the effective rank: both spectral and random initialization occupy nearly the full rank budget from initialization, and training preserves this budget while adapting within it. On VBench, VideoMLA matches short-horizon streaming video diffusion baselines, achieves the best overall score at long horizons among evaluated methods, and improves throughput by 1.23x on a single B200.

cs.AI [Back]

[145] Mind Your Tone: Does Tone Alter LLM Performance? cs.AI | cs.CL | cs.HCPDF

Om Dobariya, Akhil Kumar

TL;DR: 这篇论文研究了提示词（prompt）的语气（tone）变化是否以及如何影响大型语言模型（LLM）在客观选择题上的准确性。研究使用两个数据集（一个50题基础集和一个570题的MMLU子集）和四种流行的、成本效益高的LLM（ChatGPT-4o, ChatGPT-5-nano, Gemini 2.5 Flash, Gemini 2.5 Flash Lite）进行实验。研究发现语气的影响是系统性的，但高度依赖于具体模型，不同模型对语气的敏感度差异很大，并且在不同学科领域也存在差异。

Details

Motivation: 尽管LLMs应用广泛，但其性能被发现会因提示风格和语气而变化。本研究旨在探究提示词中的语气变化是否会导致LLM在客观问题上的准确性产生差异，以警示用户不应假设LLM部署具有语气鲁棒性。

Result: 实验结果表明，语气的影响是系统性的，但高度模型依赖。一些模型显示出虽小但统计显著的准确性偏移，而另一些模型则在不同语气间表现出巨大的准确性波动。研究还在学科层面识别出对语气敏感度的差异。

Insight: 论文的创新点在于系统性地量化了提示词语气对多种主流LLM性能的影响，揭示了这种影响是模型和学科依赖的。此外，提出了一个路由框架来解释语气如何可能调整模型的内部推理模式，这为理解LLM的提示工程提供了新的视角。

Abstract: The use of Large Language Models (LLMs) is proliferating, yet their performance is observed to vary based on prompting styles and tones. In this study, we investigate both whether and how tonal variations in prompts lead to disparate LLM accuracy for objective multiple-choice questions. We use two datasets: a 50-base question dataset with five tone variants and a 570-base question MMLU subset spanning 57 subjects with seven tone variants. Experiments were conducted to evaluate the performance of four cost-efficient, popular LLMs: ChatGPT-4o, ChatGPT-5-nano, Gemini 2.5 Flash, and Gemini 2.5 Flash Lite. Across models, tonal effects are systematic but highly model-dependent. Some models show small, yet statistically significant, shifts, while others exhibit large accuracy swings across tones. Further, we identify subject-level differences in tone sensitivity and present a routing framework to explain how tones may attune internal reasoning modes. Our findings caution users against assuming tone-robust reliability in LLM deployments.

[146] Robust and Efficient Guardrails with Latent Reasoning cs.AI | cs.CL | cs.CR | cs.LGPDF

Siddharth Sai, Xiaofei Wen, Muhao Chen

TL;DR: 本文提出了一种名为COLAGUARD的新型安全护栏模型，旨在解决现有基于推理的安全护栏方法因多步推理导致的高延迟和高令牌开销问题。该方法通过分阶段训练课程将多步安全推理转移到连续潜在空间中，实现推理时直接进行隐藏状态传播，从而在保持安全性能的同时大幅提升效率。

Details

Motivation: 随着大语言模型在现实应用中的广泛部署，确保其安全性至关重要。现有的安全护栏方法，尤其是基于显式推理的方法，虽然性能优于仅分类的基线，但带来了显著的查询延迟和令牌开销，难以满足高吞吐量部署的实际需求。

Result: 在涵盖八个安全基准测试的十种提示和响应调节设置上进行评估，COLAGUARD在宏F1分数上比Llama Guard 3提高了8.24个百分点，并与显式推理基线GuardReasoner性能相当，同时实现了12.9倍的加速和22.4倍的令牌使用量减少。

Insight: 论文的核心创新在于提出了‘潜在推理’范式，通过将多步推理过程压缩到模型的潜在空间中进行高效传播，避免了生成显式推理链的开销。这为可部署的安全护栏提供了一种实用的替代方案，将安全鲁棒性和推理效率从相互竞争的目标转变为可以共同优化的方向。

Abstract: Maintaining the safety of large language models (LLMs) is crucial as they are increasingly deployed in real-world applications. Existing safety guardrails typically rely on single-pass classification or, more recently, distilled reasoning. Reasoning-based guardrails significantly outperform classification-only baselines, but they incur substantial query latency and token overhead that make them impractical for highthroughput deployment. To address this challenge, we propose COLAGUARD, a guardrail model that transfers multi-step safety reasoning into a continuous latent space through a stage-wise training curriculum, enabling direct hidden-state propagation at inference. Evaluated on ten prompt- and response-moderation settings spanning eight safety benchmarks, COLAGUARD improves macro-F1 by 8.24 points over Llama Guard 3 and matches our explicit reasoning baseline, GuardReasoner, in macroF1 while delivering a 12.9X speedup and 22.4X reduction in token usage. Our results suggest that latent reasoning offers a practical alternative to explicit rationale generation for deployable guardrails, jointly improving safety robustness and inference efficiency rather than treating them as competing objectives.

[147] The Confidence Shortcut: A Reasoning Failure Mode of Masked Diffusion Models cs.AI | cs.CLPDF

Dueun Kim, Albert No

TL;DR: 本文揭示了掩码扩散语言模型（MDMs）在基于置信度的解码策略下存在推理失败模式，该策略会导致模型在复杂推理任务中过早预测局部简单部分而忽略长程依赖，产生高置信度错误。研究表明，与置信度对齐的训练会加剧这种错误，而传统随机掩码训练则能更稳健地保持推理轨迹的条件概率，有效处理困难样本。

Details

Motivation: 针对掩码扩散语言模型在基于置信度解码时可能出现的推理逻辑流错位问题，论文旨在分析这种解码策略与复杂推理所需轨迹之间的内在不匹配，并探讨不同训练方案（如置信度对齐训练与随机掩码训练）对此问题的影响。

Result: 在多位加法等五个推理任务上的实验表明，基于置信度的解码在高度复杂输入上引发失败，而置信度对齐训练将错误率放大了约一个数量级；相比之下，随机掩码训练尽管被认为低效，却能保持较低的失败率，稳健处理挑战性尾部样本。

Insight: 论文的创新点在于指出置信度解码与推理轨迹的逻辑流存在根本性错位，并实证表明置信度对齐训练会固化这种错位；从客观角度看，研究强调了在扩散模型训练中维护推理条件概率的重要性，随机掩码作为简单基线反而提供了更可靠的鲁棒性，这对改进生成式模型的推理能力设计具有借鉴意义。

Abstract: Masked diffusion language models (MDMs) uniquely support any-order generation, with confidence-based decoding currently serving as the de facto standard inference policy. To optimize for this, recent training schemes attempt to align training mask patterns directly with those observed during generation. However, we argue that confidence-based decoding is inherently misaligned with the logical-flow trajectories required for complex reasoning, and that confidence-aligned training actively entrenches this misalignment. We make this concrete using multi-digit addition, where the decoding strategy prematurely predicts locally easy digits before resolving their long-range dependencies, producing high-confidence errors on challenging inputs. While traditional random masking keeps the failure rate low on this challenging tail, confidence-aligned training amplifies the error rate by an order of magnitude. Across five distinct reasoning tasks, this same pattern emerges with task-dependent severity: confidence-based decoding induces failures on highly complex inputs, and confidence-aligned training exacerbates them. In contrast, random masking – despite its perceived inefficiency – robustly preserves the reasoning-trajectory conditionals essential for solving the challenging tail.

[148] ReasonOps: Operator Segmentation for LLM Reasoning Traces cs.AI | cs.CLPDF

Daniel Lee, Owen Queen, James Zou

TL;DR: 本文提出ReasonOps，一种无监督、表达性强的方法，用于标注大语言模型（LLM）的思维链（CoT）推理轨迹，通过识别句子开头的3个token作为枢纽进行无监督聚类，发现了7种可复现的通用推理操作符（如回溯、推断、假设）。该方法在12个LLM的44,662条轨迹上验证了操作符的普遍性，并用于模型识别、答案正确性预测和早期质量估计，取得了优异的下游任务性能。

Details

Motivation: 现有方法分析思维链轨迹时过于僵化或表达能力不足，无法跨领域和模型捕捉其内部结构特征，因此需要一种通用的、无监督的标注方法来描述LLM推理轨迹的内部组成结构。

Result: 在8个推理基准测试的44,662条轨迹上，发现了7种跨模型家族和领域普遍存在的推理操作符；三位独立的LLM评审者对保留样本的分类准确率达到70-76%；仅基于操作符分布的分类器就能以高宏AUC识别源模型；结构操作符特征在预测问题内答案正确性上显著优于基线，在AIME基准上达到特定WP-AUC；仅使用50%的轨迹即可实现高WP-AUC的早期质量估计。

Insight: 创新点在于通过无监督聚类句子起始的3-token枢纽，定义了简洁通用的推理操作符词汇表，揭示了LLM推理轨迹共享的组合结构；客观来看，该方法无需人工标注，能自动发现跨模型的通用推理模式，并成功应用于模型指纹识别、答案正确性预测和早期性能估计等多个下游任务。

Abstract: Chain-of-thought traces from large reasoning models can span tens of thousands of tokens, yet we lack a vocabulary for describing their internal structure. Previous methods developed to analyze chain-of-thought traces are either too rigid or not expressive enough, failing to capture features across domains and models. To remedy this, we develop ReasonOps, an unsupervised, expressive method for annotating chain-of-thought traces, providing succinct universal operators. Using ReasonOps, we analyze 44,662 traces from 12 thinking LLMs spanning 6 families across 8 reasoning benchmarks and discover that they share a common compositional structure: 7 recurring reasoning operators – discourse-level moves such as backtracking, inferring, and hypothesizing – that emerge from unsupervised clustering of sentence-initial 3-token pivots. These operators appear across every model family and benchmark domain, confirmed by three independent LLM judges who classify held-out samples at 70 -76% accuracy. We analyze the structure of operators on easy vs. hard problems, revealing that reflective operators are more helpful on hard problems and harm performance on easy problems. Operator sequences are highly model-identifying: a classifier trained on operator distributions alone recovers the source model with macro-AUC, revealing that each model family has a distinctive reasoning fingerprint. Structural operator features predict within-problem answer correctness well above baselines. Classifiers built on these operators reach WP-AUC and on AIME specifically. ReasonOps further enables early quality estimation well before the trace completes: we predict at WP-AUC for only 50% of the trace. The ReasonOps pipeline is unsupervised and annotation-free, enabling deep insights into LLM reasoning traces as well as strong downstream results on model identification and correctness prediction.

[149] GTA: Generating Long-Horizon Tasks for Web Agents at Scale cs.AI | cs.CLPDF

Tenghao Huang, Kung-Hsiang Huang, Prafulla Kumar Choubey, Yilun Zhou, Muhao Chen

TL;DR: 本文提出了一个名为GTA的可扩展框架，用于自动生成面向网页智能体的长视野、多跳任务及其可执行轨迹。该框架整合了网页爬取、基于检索的种子任务生成、上下文内生成和自动化质量控制，旨在解决现有基准测试中缺乏可扩展、过程级监督数据的问题。

Details

Motivation: 现有网页智能体基准测试大多为人工构建，仅提供粗略的起点-目标标注，缺乏中间轨迹；而近期的自动生成方法则成本高昂、存在偏见且任务深度不足。这些限制阻碍了对需要泛化到真实、多跳、跨页面任务的智能体进行可靠的训练和评估。

Result: 该框架在超过50个涵盖电子商务、政府、论坛和新闻的多语言网站上实例化，生成了一个动态基准。该基准揭示了显著的人-智能体性能差距，并支持详细的诊断分析。

Insight: 主要创新点在于：1）形式化了多跳网页智能体任务生成问题；2）提出了一种高效且经过验证的自动数据创建流程，通过将爬取与生成解耦以提高效率，并将任务锚定在站点图中以确保组合性；3）发布了一个具有可复现评估的动态基准。从客观角度看，其通过确定性回放和系统化验证确保密集监督的自动化质量控制机制具有借鉴意义。

Abstract: Web agents, which couple language models with browsing and tool-use capabilities, show promise as open web assistants. Yet progress is increasingly limited by the lack of scalable, process-level supervision. Existing benchmarks are largely manually constructed, providing only coarse start-goal annotations without intermediate trajectories, while recent automatic generation efforts remain expensive, biased, and shallow. These limitations prevent reliable training and evaluation of agents that must generalize to realistic, multi-hop, cross-page tasks. We introduce a scalable framework, GTA, that integrates crawling, retrieval-based seeding, in-context generation, and automated quality control to produce realistic tasks paired with executable trajectories. This design decouples crawling from generation for greater efficiency, grounds tasks in the site graph to enforce compositionality, and ensures dense supervision through deterministic replays and systematic validation. We instantiate the pipeline on over 50 websites covering e-commerce, government, forums, and news, with multilingual and multi-hop coverage. The resulting benchmark reveals a significant human-agent performance gap and enables detailed diagnostics. Our contributions are three-fold: (i) formalizing multi-hop web-agent task generation, (ii) proposing an efficient and validated pipeline for automatic data creation, and (iii) releasing a dynamic benchmark with reproducible evaluation.

[150] DenseSteer: Steering Small Language Models towards Dense Math Reasoning cs.AI | cs.CL | cs.LGPDF

Yang Ouyang, Shuhang Lin, Jung-Eun Kim

TL;DR: 该论文提出了一种名为DenseSteer的无训练推理时引导框架，旨在提升小型语言模型（<= 3B参数）在数学推理任务上的性能。研究发现，更高效的推理（称为密集推理）与更少的推理步骤但更高的每步信息密度相关。该方法通过调节模型内部表征来引导其遵循密集推理模式，从而在不增加负对数似然的情况下，在数学推理基准上取得了准确率的提升。

Details

Motivation: 动机源于观察到大型语言模型在思维链推理上表现出色，而小型模型在多步推理任务上表现不佳。通过对Qwen-2.5模型系列在数学推理基准上的实证分析，发现更熟练的推理与更少的步骤但更高的信息密度相关，这被称为密集推理。

Result: 实验表明，该方法在数学推理基准上带来了准确率的一致提升，且没有增加词元级别的负对数似然。

Insight: 论文的创新点在于定义了“密集推理”这一属性，并提出了一个无需额外训练、在推理时通过调节内部表征来引导模型遵循该模式的框架。这为提升小型模型在复杂任务上的性能提供了一种结构化的新思路。

Abstract: Large language models (LLMs) demonstrate strong chain-of-thought (CoT) reasoning abilities, while smaller models (<= 3B parameters) significantly underperform on multi-step reasoning tasks. Based on empirical analyses of the Qwen-2.5 model family on math reasoning benchmarks, we find that more proficient reasoning is associated with fewer reasoning steps but higher information density per step, a property we term Dense Reasoning. Motivated by this observation, we propose DenseSteer, a training-free inference-time steering framework that enhances small-model reasoning by modulating internal representations toward dense reasoning patterns. Experiments show that our method yields consistent accuracy improvements without increasing token-level Negative Log-Likelihood, highlighting dense reasoning as an effective structural approach to mathematical problem solving.

[151] Rubric-Guided Process Reward for Stepwise Model Routing cs.AI | cs.CLPDF

Shenghao Ye, Yu Guo, Zhengheng Li, Shuangwu Chen, Jian Yang

TL;DR: 本文提出RoRo框架，通过引入基于评分标准的流程奖励来优化大推理模型（LRMs）中的逐步模型路由问题。该框架利用Rubricor生成查询特定的评估标准，并由Judge根据该标准对路由轨迹进行评分，从而结合流程奖励与结果奖励来训练路由策略。实验表明，RoRo在多个推理基准测试中优于现有基线，实现了更好的准确性与成本权衡。

Details

Motivation: 现有方法将路由建模为序列决策过程并使用强化学习训练，但仅依赖结果奖励（如最终答案正确性）来监督路由决策，这无法评估中间路由步骤的质量，导致性能与泛化能力受限。

Result: 在五个推理基准测试（包括同族和跨族设置）上，RoRo均优于强基线方法，实现了更优的准确性与成本平衡。

Insight: 创新点在于提出了流程奖励框架，通过构建基于结果、成本和过程质量的偏好对，并交替优化Rubricor和Judge来生成查询特定的评估标准，从而为中间路由决策提供细粒度监督，增强路由策略的鲁棒性和效率。

Abstract: Stepwise model routing improves the efficiency of Large Reasoning Models (LRMs) by assigning each reasoning step to a suitable model. Recent methods formulate routing as a sequential decision process and train the router with reinforcement learning. However, although they model routing as a process, they still supervise the router with outcome rewards. Such rewards only reflect final answer correctness and fail to evaluate intermediate routing decisions, which can weaken performance and generalization. To address this gap, we propose RoRo, a rubric-guided process reward framework for stepwise model routing. RoRo first collects diverse routing trajectories and constructs preference pairs based on outcome, cost, and process quality. It then trains a Rubricor to generate a query-specific evaluation rubric and a Judge to score routing trajectories under this rubric through alternating optimization. The resulting process rewards are combined with outcome rewards to optimize the routing policy via GRPO. Experiments on five reasoning benchmarks under both same-family and cross-family settings show that RoRo consistently outperforms strong baselines and achieves better accuracy and cost trade-offs.

[152] Planning with the Views via Scene Self-Exploration cs.AI | cs.CV | cs.ROPDF

Kangrui Wang, Linjie Li, Zhengyuan Yang, Shiqi Chen, Zihan Wang

TL;DR: 本文研究了视觉语言模型（VLMs）在3D场景中进行多步视角规划的能力，发现现有模型具备基本的单步视角动作知识，但在多步组合规划上存在显著差距。为弥补这一差距，作者提出了一个结合自我探索与视角图蒸馏的迭代框架，通过从探索轨迹构建的视角图中提取监督信号来重塑策略分布，从而显著提升了交互式视角规划的性能。

Details

Motivation: 探究视觉语言模型是否能够预测相机移动如何改变视角，并规划多步移动序列以达到目标视角，即“视角规划”能力，这需要模型理解单步动作对视角的转换并组合多步转换。

Result: 在基于ScanNet真实场景构建的3D点云环境ViewSuite上测试了13个前沿VLM，发现其多步规划能力存在关键差距。提出的方法将Qwen2.5-VL-7B模型在交互式视角规划任务上的成功率从2.5%提升至47.8%，超越了GPT-4o Pro (18.5%) 和 Gemini 1.5 Pro (21.4%) 的性能。

Insight: 核心创新在于提出了一种通过自我探索构建场景视角图，并从中蒸馏出多样监督任务来训练规划策略的框架。这种方法将稀疏奖励的强化学习问题转化为密集监督学习，有效克服了多步规划中的组合爆炸和奖励稀疏问题，为VLM在3D空间中进行主动推理和规划提供了一条新路径。

Abstract: Can VLMs predict how each camera move changes the view, and plan many such moves ahead? We call this capability view planning, requiring (1)understanding how a single action transforms the view, and (2)composing many such transformations across multi-turn plans to identify a target view. We probe both abilities in our proposed ViewSuite, a 3D point-cloud environment on real ScanNet scenes. Across 13 frontier VLMs, a critical planning gap emerges: they possess basic view-action knowledge but fail to compose it across multi-turn plans, with the gap widening as viewpoint distance grows. To close this gap, we propose an iterative framework that alternates self-exploration with view graph distillation. The key insight is that all exploration trajectories, regardless of their outcome, collectively form a view graph that compactly captures how viewpoints connect across a scene. Distilling this graph into diverse supervised tasks reshapes the policy distribution and overcomes the sparse rewards that stall pure RL. This improves Qwen2.5-VL-7B from 2.5% to 47.8% on interactive view planning, surpassing GPT-5.4 Pro (18.5%) and Gemini 3.1 Pro (21.4%). Self-exploration emerges as a promising path toward VLMs that can actively reason and plan in 3D space.

[153] Towards Human-Like Interactive Speech Recognition With Agentic Correction and Semantic Evaluation cs.AI | cs.CLPDF

Zixuan Jiang, Yanqiao Zhu, Peng Wang, Qinyuan Chen, Xinjian Zhao

TL;DR: 该论文提出了一种名为Agentic ASR的交互式语音识别框架，旨在通过多轮迭代修正来模拟人类对话中的澄清与精炼过程，以解决传统单次通过ASR系统在纠正关键语义错误方面的不足。同时，论文引入了基于LLM的句子级语义错误率（S²ER）评估指标和交互式仿真系统，用于可扩展和可复现的基准测试。实验表明，该框架在多语言、命名实体密集和语码转换基准上能持续减少语义错误，且在S²ER上的提升远大于传统词级指标。

Details

Motivation: 当前大多数ASR系统采用单次通过范式，与人类通过迭代澄清和精炼来解决误解的交流方式不匹配，导致一旦出现关键语义错误难以纠正。同时，词错误率（WER）或字错误率（CER）等词级指标无法充分反映此类语义问题。

Result: 在多语言、命名实体密集和语码转换基准上的实验表明，迭代交互能持续减少语义错误，在提出的S²ER指标上获得的增益远大于传统词级指标（如WER/CER）。人机对齐和消融研究进一步验证了语义评估器的可靠性和所提框架的鲁棒性。

Insight: 论文的创新点在于将交互式ASR形式化为多轮精炼任务，并提出了一个结合单次通过ASR前端、语义纠正、意图路由和基于推理编辑的闭环框架（Agentic ASR）。此外，引入了基于LLM的句子级语义错误率（S²ER）作为更贴合语义的评估指标，以及用于可扩展基准测试的交互式仿真系统，这为ASR系统向更人性化、语义感知的方向发展提供了新思路。

Abstract: Automatic speech recognition (ASR) is a core component of human–computer interaction and an increasingly important front-end for LLM-based assistants and agents. However, most current ASR systems still follow a single-pass paradigm, which is poorly aligned with human communication, where misunderstandings are resolved through iterative clarification and refinement. This mismatch makes it difficult to correct meaning-critical errors once they occur. Meanwhile, token-level metrics such as WER or CER cannot adequately reflect such a problem. To address these limitations, we formulate \emph{Interactive ASR} as a multi-turn refinement task and propose \textbf{Agentic ASR}, a closed-loop framework that combines a single-pass ASR front-end with semantic correction, intent routing, and reasoning-based editing. We further introduce the \textbf{Sentence-level Semantic Error Rate} ($S^2ER$), an LLM-based semantic evaluation metric, together with an \textbf{Interactive Simulation System} for scalable and reproducible benchmarking. Experiments on multilingual, named-entity-intensive, and code-switching benchmarks show that iterative interaction consistently reduces semantic errors, with much larger gains in $S^2ER$ than in conventional token-level metrics. Human–AI alignment and ablation studies further validate the reliability of the semantic judge and the robustness of the proposed framework. The code is available at: https://interactiveasr.github.io/ and the live demo is available at https://i-asr.sjtuxlance.com/

[154] Architecture-Sensitive Supervised Fine-Tuning for Screen-Conditioned Action Prediction: A PiSAR Benchmark cs.AI | cs.CL | cs.HCPDF

Rahul Bissa, Abhishek Vyas, Yash Jain

TL;DR: 本文提出了一个名为PiSAR的基准测试，用于评估屏幕条件下的行为预测模型。该研究在PiSAR数据集的一个661行保留切片上，对比了三种监督微调模型与前沿零样本基线模型（Claude Opus 4.7和GPT-5.5）的性能。主要发现是，经过微调的Qwen3-VL-8B-Instruct模型在语义相似度指标上显著超越前沿零样本基线，而相同训练方案在Gemma-4-26B-A4B-IT模型上却效果不佳。

Details

Motivation: 研究动机是评估和比较不同架构的模型在屏幕条件行为预测任务上的表现，特别是探究监督微调相对于前沿零样本模型的有效性，以及不同模型架构对微调效果的敏感性。

Result: 在PiSAR基准的661行测试集上，前沿零样本基线Claude Opus和GPT-5.5的语义相似度（sem_sim）分别为0.459和0.482。微调后的Qwen3-VL-8B-Instruct达到0.783，并且在79%的样本上sem_sim >= 0.7，远超基线的1-2%。然而，相同数据和配方微调的Gemma-4-26B-A4B-IT仅得0.441，与零样本基线水平相当。

Insight: 论文的创新点在于构建了PiSAR基准并揭示了模型架构对微调效果的敏感性：并非所有模型都能从相同的监督微调中同等受益。客观分析表明，对于某些经过推理调优的大参数模型（如Gemma），标准的微调方法可能不足，需要更多数据或更强的微调技术，这为模型选择和微调策略提供了重要洞见。

Abstract: We benchmark three supervised fine-tuned models against frontier zero-shot baselines on a 661-row held-out slice of PiSAR (Persona, intent, Screen, Action, Rationale), a 12,929-tuple corpus of screen-anchored behavioural rationales curated from public app-store reviews, Pew American Trends Panel demographics, and the OPeRA shopper traces. Every model, frontier or fine-tuned, is evaluated on the same 661-row slice with the same scoring pipeline. Two findings. First, frontier zero-shot baselines (Claude Opus 4.7 and GPT-5.5) reach sem_sim 0.459 and 0.482 respectively; a fine-tuned Qwen3-VL-8B-Instruct reaches 0.783 and clears sem_sim >= 0.7 on 79% of rows, against 1-2% for either frontier baseline, a gap of 0.30 absolute on the same test set. Second, the same training data and recipe on Gemma-4-26B-A4B-IT scores only 0.441, in the same band as the frontier zero-shot baselines rather than the fine-tuned Qwen. We read this as a recipe-vs-model mismatch: the reasoning-tuned high-parameter model resists displacement and would likely need either more data or a stronger fine-tuning method.

[155] Why Specialist Models Still Matter: A Heterogeneous Multi-Agent Paradigm for Medical Artificial Intelligence cs.AI | cs.CL | cs.LG | cs.MAPDF

Yanan Wang, Shuaicong Hu, Jian Liu, Guohui Zhou, Aiguo Wang

TL;DR: 本文提出HetMedAgent，一种异构医疗多智能体框架，旨在协调通用大语言模型、领域专用医疗模型和临床医生之间的协作。该框架通过冲突感知证据融合、基于不确定性的临床医生干预触发和自适应阈值校准机制，在三个真实世界临床决策任务中验证了通用模型与专用模型协同的优越性。

Details

Motivation: 针对通用大语言模型在医疗领域表现优异是否会使专用医疗模型过时的疑问，作者认为医疗AI的未来在于促进通用模型、专用模型与临床医生的协同，而非构建单一医疗基础模型或取代人类专家。

Result: 在三个真实世界临床决策任务上的实验表明，HetMedAgent框架中通用LLM与领域专用模型的协同显著优于单独使用任一类模型，验证了专用模型在模态特定分析中不可替代的价值。

Insight: 创新点在于从构建单一医疗LLM或基础模型转向异构多智能体协作范式，通过冲突感知融合和不确定性触发等机制，在通用推理能力与领域专用精度之间取得平衡，为医疗AI系统设计提供了新思路。

Abstract: The impressive performance of generalist large language models (LLMs) such as GPT and Claude in healthcare raises a critical question: will domain-specific medical specialist models become obsolete? We argue that the future of medical artificial intelligence (AI) lies not in building monolithic medical foundation models, nor in replacing human expertise, but in orchestrating collaboration among generalist LLMs, domain-specific specialist models, and clinicians. We propose HetMedAgent, a heterogeneous medical multi-agent framework that enables conflict-aware evidence fusion, uncertainty-based clinician intervention triggering, and adaptive threshold calibration. Experiments on three real-world clinical decision-making tasks demonstrate that the synergy between generalist LLMs and domain-specific specialist models significantly outperforms using either type of model alone, validating the irreplaceable value of specialist models in modality-specific analysis. HetMedAgent represents a shift from building medical LLMs or foundation models to multi-agent collaboration, achieving a balance between general reasoning capabilities and domain-specific precision.

[156] MuPHI: Learning Implicit Multimodal Harm Reasoning via Semantically Grounded Reward Optimization cs.AI | cs.CL | cs.LG | cs.MMPDF

Anisha Saha, Varsha Suresh, Teodora Kamova, Sophia Wiedmann, Timothy Hospedales

TL;DR: 该论文提出了MuPHI数据集和MuPHIRM训练框架，旨在解决视觉语言模型在理解由图像-文本对组合产生的隐性、语境依赖的伤害语义方面的不足。MuPHI数据集包含编码了细微多模态线索的伤害性图像-文本对及其标注的伤害推理链，用于评估模型。MuPHIRM框架通过优化多视角奖励来学习联合语义，从而提升模型的伤害检测和推理能力。

Details

Motivation: 现有视觉语言模型擅长基于感知线索的字面推理，但难以对依赖于隐性、语境推理的伤害语义进行推导。因此，需要评估并提升模型在组合式伤害检测和推理方面的能力。

Result: 提出的MuPHIRM框架提升了视觉语言模型的伤害检测和推理质量，并且在分布外鲁棒性上优于经过训练的和推理时的基线模型。

Insight: 创新点在于引入了专注于组合式伤害推理的MuPHI数据集，以及通过优化多视角奖励来联合学习语义的MuPHIRM训练框架。该方法表明，面向推理的奖励优化是构建能够超越基准测试特定捷径、实现更好泛化的多模态系统的一个有前景的方向。

Abstract: Understanding how harm emerges from interaction between otherwise benign image-text pairs requires intent-aware cross-modal reasoning beyond surface-level features. Existing vision-language models (VLMs) excel at literal reasoning over perceptual cues but often fail to derive harmful semantics that rely on implicit, context-dependent reasoning. To evaluate VLMs on compositional harm detection and reasoning, we introduce Multimodal Pragmatic Harm Interpretation (MuPHI), a dataset containing image-text pairs where harm is encoded in subtle multimodal cues. MuPHI spans diverse harm categories and includes annotated harm rationales for assessing VLM reasoning chains. To improve both detection and reasoning in VLMs, we propose MuPHIRM, a reasoning-augmented training framework which learns joint semantics by optimizing multi-perspective rewards. MuPHIRM improves both harm detection and reasoning quality of VLMs while demonstrating superior out-of-distribution robustness compared to both trained and inference-time baselines. Our findings suggest that reasoning-oriented reward optimization offers a promising direction towards building multimodal systems that generalize beyond benchmark-specific shortcuts.

[157] SAAS: Self-Aware Reinforcement Learning for Over-Search Mitigation in Agentic Search cs.AI | cs.CL | cs.LGPDF

Yunbo Tang, Chengyi Yang, Shiyu Liu, Zhishang Xiang, Zerui Chen

TL;DR: 本文提出SAAS框架，一种基于强化学习的自感知机制，旨在解决智能体搜索中的过度搜索问题。该方法通过建模搜索边界、设计边界感知奖励和分阶段优化策略，动态调节搜索行为，在保持准确性的同时显著降低计算开销。

Details

Motivation: 现有基于LLM的智能体搜索系统缺乏对自身知识边界的认知，导致内部知识充足时仍盲目触发搜索，或收集足够证据后无法终止搜索，造成严重的过度搜索问题，带来高延迟和高计算成本。

Result: 大量实验表明，SAAS能显著减少过度搜索，同时保持准确性。具体定量结果未在摘要中给出，但暗示了在相关基准测试中有效降低了搜索开销。

Insight: 创新点包括：1) 通过对比禁用搜索与启用搜索的轨迹来建模动态搜索边界；2) 将边界感知转化为轨迹级惩罚奖励，抑制不必要和冗余搜索；3) 采用分阶段课程学习策略，优先优化推理再正则化搜索，避免奖励黑客问题。从客观角度看，该框架将自感知机制形式化为强化学习问题，为智能体搜索的效率优化提供了系统化解决方案。

Abstract: Agentic search enables LLMs to solve complex multi-hop questions through iterative reasoning and external search. Despite the effectiveness, these systems often suffer from a critical limitation in practice: agents fail to recognize their own knowledge boundaries, blindly triggering searches when internal knowledge suffices and failing to terminate search even when adequate evidence has been collected. The lack of self-awareness leads to severe \textbf{over-search}, incurring substantial inference latency and prohibitive computational cost. To this end, we propose SAAS, a novel RL framework designed to cultivate dynamic self-awareness that precisely regulates search behavior without compromising accuracy. SAAS introduces three key components: (i) a search boundary modeling mechanism, which identifies the search boundary under the evolving policy by contrasting search-disabled and search-enabled rollouts; (ii) a boundary-aware reward module, which translates this boundary awareness into trajectory-level penalties, suppressing unnecessary and redundant searches; and (iii) a stage-wise optimization strategy, which leverages a sequential curriculum to prioritize reasoning over search regularization, thereby avoiding reward hacking. Extensive experiments demonstrate that SAAS substantially reduces over-search, while maintaining accuracy. Our code is anonymously released at https://github.com/XMUDeepLIT/SAAS.

[158] When Should Models Change Their Minds? Contextual Belief Management in Large Language Models cs.AI | cs.CL | cs.LGPDF

Haoming Xu, Weihong Xu, Zongrui Li, Mengru Wang, Yunzhi Yao

TL;DR: 论文研究了大型语言模型在长程交互中的信念管理问题，提出了‘上下文信念管理’概念，并构建了BeliefTrack基准来评估模型在规则发现和电路诊断任务中维护信念状态的能力。研究发现现有模型存在三种失败模式，而基于信念状态奖励的强化学习能显著降低失败率，同时探索了表示层引导的改进方法。

Details

Motivation: 解决语言模型在长程交互中如何有效管理累积信息的问题，包括何时更新、保留或忽略状态，以确保信念与正式证据对齐并隔离任务无关噪声。

Result: 在BeliefTrack基准上，普通LLM表现出严重的信念管理失败，而基于信念状态奖励的强化学习将平均失败率降低了70.9%，表示层引导方法在两个任务中降低了46.1%的失败率。

Insight: 创新点在于将信念管理形式化为可测量的任务，并引入符号验证器进行精确评估；从客观角度看，研究揭示了模型在动态上下文中的潜在失败机制，并为通过强化学习和表示优化改进模型鲁棒性提供了新思路。

Abstract: Long-horizon interactions require language models to manage accumulating information: when to update their state, when to preserve their state, and what to ignore. We study this challenge as \textbf{Contextual Belief Management (CBM)}: maintaining a predicted belief state aligned with formal evidence while isolating task-irrelevant noise. To make CBM measurable, we introduce BeliefTrack, a closed-world benchmark spanning Rule Discovery and Circuit Diagnosis, where a finite belief space and symbolic verifiers enable exact turn-level evaluation. BeliefTrack diagnoses three failures: Failed Stay, Failed Update, and Failed Isolation. Across multiple LLMs, vanilla models exhibit severe CBM failures, while explicit belief-tracking prompts provide limited gains. In contrast, reinforcement learning with belief-state rewards reduces failure rates by 70.9% on average. Further probing reveals latent belief-state dynamics behind these failures, and representation-level steering reduces failure rates by 46.1% across two tasks\footnote{Code is coming soon at https://github.com/zjunlp/CBM.

[159] Conformal Certification of Reasoning Trace Prefixes cs.AI | cs.CL | cs.LG | stat.MLPDF

Matt Y. Cheung, Ashok Veeraraghavan, Hanjie Chen, Guha Balakrishnan

TL;DR: 本文提出了CROP（Conformal Reasoning Output Prefixes）方法，用于对语言模型推理轨迹的前缀进行保形认证。该方法通过校准阈值，在统计上保证返回的最长连续前缀不包含标注错误的概率，从而为推理过程中有效的中间步骤提供安全保障，并将未认证的后缀路由进行下游审查或修复。

Details

Motivation: 现有不确定性量化方法通常只认证最终答案或整个响应，无法为序列化推理轨迹中可安全保留的部分比例提供统计保证。本文旨在解决这一问题，为推理轨迹的可靠前缀提供严格的概率控制。

Result: 在六个带有过程标注的推理数据集上，实验表明标准的步骤级指标（如AUROC）不能完全捕捉前缀的效用，验证器应通过认证前缀长度来评估。CROP方法能平衡过度保留和保留不足，通过保留有效的中间推理并丢弃误导性后缀，提高了下游修复的准确性。

Insight: 创新点在于将前缀认证确立为一个连接过程监督、弃权和修复的严格且实用的桥梁。该方法与验证器无关，利用保形预测框架，为推理轨迹的部分可靠性提供了新的量化视角和评估标准。

Abstract: Language model reasoning traces are rarely all-or-nothing; they frequently contain valid intermediate steps before a critical error occurs. Existing uncertainty quantification methods typically certify final answers or entire responses, failing to provide statistical guarantees for the proportion of a sequential trace that can be safely retained. To address this, we introduce CROP (Conformal Reasoning Output Prefixes), a verifier-agnostic calibration procedure for clean-prefix certification. Given any step-level risk proxy, CROP selects a calibrated threshold and returns the longest contiguous prefix whose step risk proxies remain below it, routing the uncertified suffix for downstream review or repair. Assuming exchangeability, CROP rigorously controls the marginal probability that the returned prefix contains an annotated error. Across six process-labeled reasoning datasets, we demonstrate that standard step-level metrics such as AUROC do not fully capture prefix utility, suggesting verifiers should instead be evaluated by certified prefix length. Furthermore, CROP balances over- and under-withholding, improving downstream repair accuracy by preserving valid intermediate reasoning while discarding misleading suffixes. Ultimately, this work positions prefix certification as a rigorous, practical bridge between process supervision, abstention, and repair.

eess.IV [Back]

[160] Accelerating HEVC Intra Partitioning via a CNN-Hierarchical Attention Transformer Hybrid eess.IV | cs.CVPDF

Krishna Kumar Sharma, Somdyuti Paul

TL;DR: 本文提出了一种名为HFViT的混合架构，旨在加速HEVC帧内编码中的四叉树划分预测过程。该架构融合了重参数化深度可分离卷积主干和分层注意力变换器机制，通过载体令牌方案实现高效的全局信息传播。实验表明，HFViT在保持接近CNN基线CPU推理延迟的同时，显著降低了率失真性能损失，并在GPU上实现了更快的推理速度。

Details

Motivation: 解决HEVC帧内编码中递归四叉树划分带来的巨大计算开销问题。现有基于深度学习的划分预测方法存在架构上的两难：CNN计算高效但感受野有限，难以捕获长程语义关系；Transformer能捕获全局上下文但CPU延迟过高，不利于实际部署。

Result: 在标准JCT-VC测试序列上，与基线ETH-CNN相比，HFViT在A、B、E类序列上分别将VMAF BD-rate损失平均降低了2.4、2.6和7.9个百分点。CPU推理延迟保持在CNN基线的8%以内，GPU推理速度比基线快40%，证明了其在实时编码器集成中的实用性。

Insight: 主要创新点是提出了一种CNN与分层注意力Transformer的混合架构，通过载体令牌方案以亚二次复杂度实现高效全局信息传播。此外，采用训练后结构融合技术（如将批归一化折叠到前层）进一步降低了延迟，在保持CNN效率优势的同时引入了Transformer的全局建模能力。

Abstract: The recursive quad-tree partitioning in High Efficiency Video Coding (HEVC) incurs considerable computational overhead, with exhaustive rate-distortion optimization for CTU partition prediction consuming the dominant share of encoding time. Although partition prediction through deep learning has emerged as a viable encoding accelerator, an architectural dichotomy remains largely unaddressed: CNNs are computationally efficient but spatially myopic due to their localized effective receptive fields, failing to capture long range semantic relationships and repetitive textures; conversely, transformer based architectures are better at capturing global context but incur prohibitive CPU latency, a critical liability that impedes deployment which is predominantly CPU-bound. This paper introduces Hybrid Fast Vision Transformer (HFViT), a hybrid architecture designed to accelerate HEVC intra-mode partition prediction. HFViT fuses a reparameterized depthwise-separable convolutional backbone with a Hierarchical Attention Transformer (HAT) mechanism, leveraging a carrier token scheme to enable efficient global information propagation at sub-quadratic complexity. Post-training structural fusion collapses batch normalization into preceding layers to further reduce latency. Comprehensive evaluation reveals the efficacy of HFViT in accelerating HEVC intra-encoding across resolutions. On standard JCT-VC test sequences, HFViT reduces the average VMAF BD-rate penalty by 2.4, 2.6, and 7.9 percentage points on Classes A, B and E, respectively, as compared to the competing ETH-CNN baseline while maintaining CPU inference latency within 8% of the CNN baseline and surpassing it on GPU by 40%, establishing practical viability for real-time encoder integration.

cs.LG [Back]

[161] Mechanistic origins of catastrophic forgetting: why RL preserves circuits better than SFT? cs.LG | cs.AI | cs.CLPDF

Jeanmely Rojas Nunez, Viraj Sawant, Nathan Allen, Nomgondalai Amgalanbaatar, Yannis Zongo

TL;DR: 本文研究了大型语言模型微调中灾难性遗忘的机制起源，通过引入差分电路脆弱性指标，对比了强化学习（RL）与监督微调（SFT）在保护内部计算电路方面的差异。研究发现，SFT能更快适应目标任务但导致更严重的电路破坏和遗忘，而RL能更好地保留基础电路但任务适应速度较慢。

Details

Motivation: 解决大型语言模型微调中常见的灾难性遗忘问题，探究为何RL比SFT能更有效地保留模型原有能力，并将行为层面的解释延伸到内部计算电路的机制层面。

Result: 在Qwen2.5-3B-Instruct模型上针对科学问答任务进行实验，使用差分电路脆弱性指标进行头级分析，结果表明RL保留了更大比例的基础电路，而SFT产生了更显著的电路破坏。

Insight: 提出了差分电路脆弱性这一机制层面的度量指标，揭示了模型微调中任务适应速度与电路保留之间的权衡关系，为理解RL抗遗忘性更强的机制提供了新视角。

Abstract: Fine-tuning large language models (LLMs) frequently induces catastrophic forgetting of prior capabilities. Recent work has shown that reinforcement learning (RL) retains prior capabilities more effectively than supervised fine-tuning (SFT), attributing this to policy-gradient updates remaining closer to the base policy \cite{shenfeld2025rl}. We extend this behavioral account to the mechanistic level and ask whether RL’s advantage is mirrored by stronger preservation of internal computational circuits. We introduce differential circuit vulnerability, a head-level measure of how much a circuit degrades under fine-tuning, and use it to compare RL and SFT on Qwen2.5-3B-Instruct adapted to scientific question-answering. We find a clear mechanistic trade-off: SFT adapts more rapidly to the target task but produces substantially greater circuit disruption and forgetting of prior capabilities, whereas RL preserves a larger fraction of the base circuit at the cost of slower task adaptation. These findings suggest that circuit preservation may help explain why RL is more robust to catastrophic forgetting. We released our code here: https://github.com/rl-sft-circuit-research/differential-circuit-vulnerability.

[162] CosmicFish-HRM: Adaptive Reasoning via Hierarchical Recurrent Mechanisms in Compact Language Models cs.LG | cs.AI | cs.CLPDF

Venkat Akhil Lakkapragada

TL;DR: 本文提出了CosmicFish-HRM，一种基于分层循环机制（HRM）的紧凑语言模型，旨在实现自适应推理深度。该模型通过动态分配计算资源，根据输入复杂度迭代进行高层和低层推理循环，并学习何时停止，从而在保持较小参数规模的同时提升推理能力。

Details

Motivation: 动机是探索在紧凑语言模型中实现自适应推理深度，以替代依赖大规模参数和昂贵推理的传统大型语言模型，解决计算效率与推理能力之间的权衡问题。

Result: 结果表明，模型学会了非均匀的推理行为，能够针对不同任务和输入分配不同数量的推理步骤，验证了自适应推理深度在紧凑模型中的可行性。

Insight: 创新点在于引入了分层循环机制（HRM）实现动态计算分配，并结合了Grouped Query Attention、RoPE和SwiGLU等现代Transformer组件，为在有限参数下提升推理能力提供了新方向。

Abstract: Large language models have achieved strong reasoning capabilities, though often at the cost of massive parameter counts and expensive inference. In this work, we explore a different direction: adaptive reasoning depth in compact language models. We present CosmicFish-HRM, a compact language model built around a Hierarchical Reasoning Module (HRM) that dynamically allocates computational effort during inference. Instead of applying fixed computation to every input, the model iterates through high-level and low-level reasoning cycles and learns when to halt based on input complexity. CosmicFish-HRM combines this adaptive reasoning core with modern transformer components including Grouped Query Attention, RoPE, and SwiGLU activations. While the additional reasoning infrastructure introduces overhead at small scale, we hypothesize that this tradeoff becomes increasingly favorable as model size grows and the relative cost of the HRM core diminishes. Our results show that the model learns non-uniform reasoning behavior, allocating different numbers of reasoning steps across tasks and inputs. These findings suggest that adaptive reasoning depth may offer a promising alternative to relying solely on parameter scale for reasoning capability.

[163] OISD: On-Policy Internal Self-Distillation of Language Models cs.LG | cs.AI | cs.CVPDF

Xinyu Liu, Darryl Cherian Jacob, Yang Zhou, Jindong Wang, Pan He

TL;DR: 本文提出了OISD框架，一种新的在线策略内部自蒸馏范式，旨在通过将最终层的预测信号转移到中间层表示来改进语言模型的推理能力。该方法在策略优化过程中，将最终层作为策略和内部教师，通过逻辑对齐和注意力对齐两种互补机制指导选定的中间层，无需外部特权信息。实验表明，OISD在四个数学推理任务上显著且一致地超越了强大的强化学习推理基线。

Details

Motivation: 当前基于强化学习的后训练方法主要使用稀疏的结果级奖励来优化最终输出策略，而很大程度上忽略了编码在中间表示中的预测信号。本文旨在解决这一问题，探索如何利用这些中间信号来提升模型的推理性能。

Result: 在四个数学推理任务上的实验结果表明，OISD框架相比强大的推理强化学习基线模型，取得了显著且一致的性能提升。

Insight: 创新点在于提出了在线策略内部自蒸馏的新范式，通过最终层作为内部教师，利用逻辑对齐和注意力对齐两种机制，将高级推理行为（如何思考）和一致的注意力模式（关注何处）从最终层蒸馏到中间层，从而提升中间表示的质量和模型的整体推理能力，且无需外部数据或模型。

Abstract: Recent reinforcement learning (RL) post-training approaches primarily optimize the final output policy using sparse outcome-level rewards, while largely overlooking predictive signals encoded in intermediate representations. In this paper, we introduce a new paradigm called on-policy internal self-distillation and propose the OISD framework, which improves reasoning by transferring on-policy predictive signals from the final layer to intermediate representations. During rollout and Group Relative Policy Optimization (GRPO) optimization, the final layer acts as both the policy and a detached internal teacher for selected intermediate layers, which are guided to align with it through two complementary mechanisms: logit alignment, which transfers high-level reasoning behaviors (how to think), and attention alignment, which enforces consistent attention patterns (where to look) from the final layer to the selected intermediate layer, both without requiring external privileged information. Our OISD, together with GRPO, employs signed advantage-weighted Jensen–Shannon alignment to distill informative intermediate representations while preserving policy consistency under a unified acting policy. Experimental results demonstrate the effectiveness of OISD, with substantial and consistent improvements over strong reasoning RL baselines across four mathematical reasoning tasks. The code will be released at https://github.com/THE-MALT-LAB/OISD

[164] When RL Suppresses Its Own Vocabulary: Recovering Reasoning Diversity in Puzzle-to-Math Transfer cs.LG | cs.CLPDF

Mayug Maniparambil, Arjun Karuvally, Terrence Sejnowski, Fergal Reid

TL;DR: 本文研究了强化学习与可验证奖励（RLVR）在跨领域推理迁移中的作用，发现基于谜题训练的模型能提升数学推理能力，但传统RL方法会抑制探索性推理原语。通过引入基于困惑度的新颖性奖励，恢复了推理多样性，最终将模型在OlymMATH-Hard基准上的性能从16.0%提升至36.0%。

Details

Motivation: 探索强化学习在跨领域推理迁移中的条件与机制，特别是当模型仅在谜题上进行监督微调（SFT）和强化学习（RL）后训练时，如何迁移到数学问题领域。

Result: 在OlymMATH-Hard基准上，谜题SFT带来+7pp pass@32增益，传统GSPO RL进一步增加+6pp，而引入新颖性奖励的RL再提升+7pp，最终将OLMo3-7B-Instruct-SFT的硬数学能力上限从16.0%提高到36.0%。

Insight: 提出了基于推理原语的分析框架来追踪跨领域迁移；发现传统RL会抑制探索性推理原语；通过基于参考模型困惑度的新颖性奖励有效恢复推理多样性，提升跨领域性能。

Abstract: Reinforcement learning using verifiable rewards (RLVR) improves LLM reasoning, but the conditions under which it transfers across domains – and why it does so – remain under-explored. We study cross-domain transfer in a 7B model whose SFT and RL post-training stages use only constraint-satisfaction puzzles, with no mathematics problems in the post-training data. To analyze how transfer emerges, we introduce a reasoning primitive-level framework that combines a 9-class span classifier with motif extraction, allowing us to segment chain-of-thought traces into primitive motifs and track their evolution across training stages and domains. We find that puzzle SFT induces a reasoning-primitive vocabulary, yielding a $+7$pp \texttt{pass@32} gain on OlymMATH-Hard. Vanilla GSPO then composes these primitives into longer compute-verify chains, adding a further $+6$pp. However, this RL stage also suppresses exploratory primitives such as \textit{hypothesize} and \textit{backtrack}. To address this, we introduce a novelty bonus that rewards diverse correct rollouts, using perplexity under the reference model as a signal. This restores recovery primitives during RL and adds a further $+7$pp \texttt{pass@32} relative to vanilla GSPO. Finally, the end-to-end recipe raises the hard-math capability ceiling from $16.0%$ at the OLMo3-7B-Instruct-SFT base to $36.0%$, without adding any mathematics problems during the SFT or RL stages.

[165] TRACER: Persistent Regularization for Robust Multimodal Finetuning cs.LG | cs.AI | cs.CVPDF

Hesam Asadollahzadeh, Feng Liu, Christopher Leckie, Sarah M. Erfani

TL;DR: 本文提出了一种名为TRACER的鲁棒多模态微调方法，旨在解决预训练多模态模型在微调时出现的分布外（OOD）鲁棒性下降（灾难性遗忘）问题。该方法基于一个理论分析框架，揭示了标准指数移动平均（EMA）教师模型的局限性，并提出了使用加权移动平均（WMA）教师来提供持续正则化。TRACER结合了对比学习和WMA引导的多视角蒸馏，在CLIP微调实验中显著提升了OOD准确性和校准性。

Details

Motivation: 主流的多模态预训练模型微调策略往往会损害其分布外（OOD）鲁棒性，导致灾难性遗忘。本文旨在从理论上分析这一现象，并提出一种能保持预训练模型知识、提升微调鲁棒性的新方法。

Result: 在CLIP模型的微调实验中，TRACER方法在三种骨干网络架构上均取得了分布外（OOD）准确性和校准性的一致提升。全面的消融实验证实了该方法的原则性和对超参数选择的鲁棒性。

Insight: 理论分析表明，自蒸馏在保留预训练模型知识方面比其他正则化方法更有效。核心创新在于发现了标准EMA教师模型的坍缩局限，并理论证明了WMA教师能在有限时间内提供持续的正则化力，在任务子空间实现无偏收敛的同时保留正交知识。TRACER方法将这一理论洞察与对比学习、多视角蒸馏相结合，提供了一个原理清晰且鲁棒的微调框架。

Abstract: Mainstream strategies for finetuning pretrained multimodal models often degrade out-of-distribution (OOD) robustness, a phenomenon known as catastrophic forgetting. In this paper, we develop a theoretical framework for multimodal contrastive finetuning, yielding closed-form solutions and a geometric decomposition for each strategy. This framework shows that self-distillation is more effective than other regularization approaches to retain the knowledge of the pretrained model. Our analysis reveals a largely overlooked limitation: standard Exponential Moving Average (EMA) teachers, widely used in robust finetuning, suffer from collapse. To solve this, we prove that a Weighted Moving Average (WMA) teacher maintains a persistent regularizing force over finite horizons and yields bias-free convergence in the task subspace while preserving orthogonal knowledge. These insights motivate TRACER (Trajectory-Robust Anchoring for Contrastive Encoder Regularization), which combines contrastive learning with WMA-guided multi-perspective distillation. Extensive experiments on CLIP finetuning demonstrate consistent OOD accuracy and calibration gains across three backbone architectures, and comprehensive ablations confirm that TRACER is both principled and robust to hyperparameter choices. Code is available at https://github.com/HesamAsad/TRACER.

[166] PEARL: Training Socratic Tutors with Pedagogically Aligned Reinforcement Learning cs.LG | cs.CLPDF

Qikai Chang, Zhenrong Zhang, Linbo Chen, Pengfei Hu, Jianshu Zhang

TL;DR: 本文提出PEARL框架，通过教学对齐的强化学习训练苏格拉底式辅导智能体。该框架包含可控学生模拟器、生成式奖励模型和稳定多目标RL方案，以解决现有方法在模拟保真度、奖励建模和优化稳定性方面的挑战。

Details

Motivation: 当前大型语言模型作为教育辅导工具时，难以在多轮交互中提供渐进式苏格拉底引导并平衡多个教学目标，主要受限于学生模拟的保真度低、奖励建模不明确以及多目标优化不稳定。

Result: 在多个基准测试中，PEARL在开源模型中取得最佳性能，且仅使用300亿参数策略模型即可与领先的专有LLM保持竞争力。

Insight: 创新点包括：将潜在认知状态与响应生成解耦的可控学生模拟器；联合评估教学质量和客观正确性的生成式奖励模型；通过离散化奖励和归一化优势聚合的稳定多目标RL方案，防止高方差目标主导更新。

Abstract: Large Language Models (LLMs) have shown promise as educational tutors, yet effective tutoring requires more than solving problems: it must provide progressive Socratic guidance and balance multiple pedagogical objectives across multi-turn interactions. However, training such tutors remains challenging due to limited-fidelity and weakly controllable student simulation, under-specified pedagogical reward modeling, and unstable multi-objective optimization. To overcome these limitations, we propose PEARL, a pedagogically aligned reinforcement learning framework for training Socratic tutoring agents, consisting of three key components. First, we introduce a controllable student simulator that decouples latent cognitive states from response generation to model diverse abilities and misconceptions. Second, we develop a generative reward model that jointly evaluates pedagogical quality and objective correctness for policy optimization. Finally, we propose a stable multi-objective RL scheme that discretizes rewards within each dimension and aggregates normalized advantages across dimensions, preventing high-variance objectives from dominating updates. Experiments on multiple benchmarks show that PEARL achieves the best performance among open-source models and remains competitive with leading proprietary LLMs, despite using only a 30B policy model.

[167] SCOPE: A Lightweight-training LLM Framework for Air Traffic Control Readback Monitoring cs.LG | cs.AI | cs.CL | cs.HC | cs.IRPDF

Qihan Deng, Minghua Zhang, Yang Yang, Zhenyu Gao

TL;DR: 本文提出了SCOPE框架，一种轻量级训练的LLM框架，用于空中交通管制（ATC）复诵监控。该框架通过在冻结的LLM之上结合一个插件式开放集分类器和精心设计的上下文学习机制，旨在高效且准确地检测和纠正飞行员复诵中的异常。

Details

Motivation: 空中交通管制语音指令的飞行员复诵是防止误通信的主要保障，但复诵异常仍涉及约80%的航空事件，且交通量增加和认知负荷加剧了此问题，因此需要自动化监控。传统基于规则和机器学习方法难以泛化到高度可变且不断演变的管制员-飞行员通信术语，而现有LLM方法面临部署和计算障碍。

Result: 在半合成通信数据集上的大量实验表明，SCOPE在少样本设置下实现了91.05%的开放集检测准确率，并纠正了96.63%的异常复诵，优于现有最强基线，同时满足操作环境所需的低延迟响应。

Insight: 创新点在于将插件式开放集分类器与上下文学习机制结合到冻结LLM上，实现了轻量级训练下的高效准确监控，为可解释和可控的ATC复诵监控提供了实用路径。

Abstract: Pilot readback of Air Traffic Control (ATC) voice instructions is a primary safeguard against miscommunication in air transportation. However, readback anomalies remain implicated in approximately 80% of aviation incidents. This vulnerability is further exacerbated by rising traffic volume and elevated cognitive workload, thereby motivating automated readback monitoring by machine. Traditional rule-based and machine learning approaches struggle to generalize across the highly variable and evolving phraseology of air traffic controller-pilot communications. While Large Language Models (LLMs) have opened a new avenue through their strong reasoning and generalization capabilities, existing approaches still face deployment and computational barriers in practice. In this work, we propose Semantic reasoning for Communication via Open-set Plug-in with Examples (SCOPE), a novel lightweight-training LLM framework that advances both the efficiency and accuracy of machine-based ATC readback monitoring. The core idea is to couple a plug-in open-set classifier with a carefully designed in-context learning mechanism on top of a frozen LLM. Extensive experiments on the semi-synthetic communication dataset show that SCOPE attains superior accuracy while delivering the low-latency response required for operational environments. Under a few-shot setting, SCOPE achieves 91.05% accuracy in open-set detection and corrects 96.63% of anomalous readbacks, thereby outperforming the strongest available baselines while providing explanations for its decisions. These findings demonstrate the potential of our framework as a practical pathway toward interpretable and controllable ATC readback monitoring.

[168] Hista and Numca: Estimate State Value Effectively for LLM Reinforcement Learning cs.LG | cs.AI | cs.CLPDF

Zizhe Chen, Jiqian Dong, Yizhou Tian, Garry Yang, Yongqiang Chen

TL;DR: 本文针对大语言模型强化学习中状态价值估计不准确的问题，提出了两种新方法：Numca利用数值跨度作为可分级里程碑来估计状态价值，Hista则利用LLM的隐藏状态作为表示，对不连贯的轨迹及其回报进行加权平均。实验表明，这两种方法能有效提升状态价值估计的准确性，并在不同RL算法和模型规模上改善训练性能，且计算开销不大。

Details

Motivation: 在经典强化学习中，准确的状态价值估计对稳定训练至关重要，但在LLM后训练中仍是一个未被充分探索的挑战。现有RL框架中的评论家往往崩溃为粗略的组平均基线，导致估计不准确。

Result: 通过提出的状态价值估计基准（SVEB）进行评估，实验显示Numca和Hista方法在不同RL算法和模型规模上均能产生更准确的状态价值估计，并提升了训练性能，且未带来显著计算开销。

Insight: 创新点在于引入了数值跨度作为可分级里程碑（Numca）和利用隐藏状态加权平均不连贯轨迹（Hista）来改进状态价值估计。从客观角度看，这些方法为LLM强化学习中的价值估计提供了新的、计算高效的解决方案，可能增强训练稳定性。

Abstract: Reinforcement learning (RL) refines large language models (LLMs) by directly optimizing model behavior through reward signals. While accurate state value estimation is critical for stable training in classical RL, it remains an underexplored challenge in LLM post-training. In this work, we introduce the State Value Estimation Benchmark (SVEB) to assess state estimation within existing RL frameworks and show that critics in standard approaches like PPO collapse to a coarse group-average baseline. To address this, we propose two techniques: Numca, which leverages numerical spans as gradable milestones for state value estimation, and Hista, a framework that uses LLM’s hidden states as representation to weighted average disjoint rollouts and their return. Extensive experiments demonstrate that both methods yield more accurate state value estimates and enhance training performance across different RL algorithms and model sizes without incurring significant computational overhead.

[169] How’s it going? Reinforcement learning in language models recruits a functional welfare axis cs.LG | cs.CLPDF

Andy Q Han, David J. Chalmers, Pavel Izmailov

TL;DR: 本文研究了强化学习如何塑造语言模型的内部表征，发现强化学习会利用一个预先存在的功能福利轴（functional welfare axis），即系统相对于其目标表现好坏的估计。通过在一个语义中立迷宫环境中训练语言模型，提取奖励和惩罚轨迹的概念向量，并在与迷宫无关的场景中评估，发现惩罚向量表现为负面福利表征，促进失败和不可能令牌，与负面情绪概念对齐，而奖励向量则表现为其镜像。

Details

Motivation: 论文旨在探索强化学习如何影响语言模型的内部表征，特别是关注强化学习是否利用或创建了系统功能福利的表示，以解决模型行为可解释性和对齐问题。

Result: 实验在多个语言模型上进行，包括控制瓦片到奖励映射、规模、指令调优、RL训练算法、模型家族和LoRA与全微调等因素，结果显示奖励和惩罚向量在预训练模型中已有效，且效果在仅监督微调时也大部分存在，表明功能福利轴在训练前已存在。

Insight: 创新点在于揭示了强化学习通过招募预先存在的福利样表征来广泛影响模型行为，这为可解释性、训练后动态和对齐提供了新见解，强调了最小奖励信号在模型内部表征中的作用。

Abstract: How does reinforcement learning shape a language model’s internal representations? We present evidence that RL recruits a pre-existing representation of functional welfare: an estimate of how well or badly the system is doing, relative to its goals. We train several language models in a novel, semantically neutral maze environment. We then extract concept vectors for rewarded and punished trajectories, and evaluate those vectors in settings unrelated to the maze environment. The punishment vector behaves like a representation of negative welfare: it promotes failure and impossibility tokens, it aligns with negative emotion concepts, it negatively tracks goal-achievement, and steering with it induces negative self-reports, pathological backtracking, refusal, and uncertainty. The positive reward vector behaves as the mirror image, and the two are nearly antiparallel. These effects are robust when controlling for tile-to-reward mapping, scale, instruct tuning, RL training algorithm, model family, and LoRA versus full-finetuning, and largely persist when we replace RL with supervised fine-tuning. Importantly, the vectors are effective in models before they have undergone maze training. Combined with observations that the effects also appear in pretrain-only models, we therefore argue that this functional welfare axis pre-exists post-training: it is recruited, rather than created, by post-training. While we make no claims about any experience of welfare, the axis offers a demonstration that minimal reward signals can broadly affect model behavior by recruiting pre-existing welfare-like representations, with implications for interpretability, post-training dynamics, and alignment.

[170] Reasoning with Sampling: Cutting at Decision Points cs.LG | cs.AI | cs.CL | math.ST | stat.MLPDF

Felix Zhou, Anay Mehrotra, Quanquan C. Liu

TL;DR: 本文提出了一种名为Entropy-Cut Metropolis-Hastings的算法，用于从基础语言模型的幂分布中高效采样以进行推理，而无需额外的强化学习训练。该方法利用下一个标记的熵作为代理来识别推理轨迹中的关键决策点，并主要在这些位置进行重新采样，从而更有效地探索不同的推理策略。

Details

Motivation: 现有方法通过从基础模型的幂分布中采样来进行推理，但需要高效的采样器来在分布的不同模式（即不同推理策略）之间切换。先前提出的均匀随机切割采样器倾向于重写局部细节而非重新审视关键的决策点，这限制了其效率。

Result: 在MATH500、HumanEval、GPQA Diamond和AIME26等多个基准测试中，该方法持续优于基线方法和经过强化学习训练的模型。理论分析表明，其混合时间与推理轨迹中的决策数量（而非标记数量）成比例，后者可能大得多。

Insight: 核心创新在于使用下一个标记的熵作为代理来识别推理过程中的关键决策点，并针对性地在这些位置进行重新采样。这提供了一种更高效地从幂分布中采样的方法，理论上能更快地在不同推理模式间切换，从而提升推理性能。

Abstract: Frontier reasoning models are produced by posttraining base language models with reinforcement learning. Recent work has challenged this by showing that sampling from a sharpened version of the base model’s distribution, a so-called power distribution, elicits comparable reasoning without additional training, curated datasets, or verifiers. However, making this method practical requires efficiently sampling from the power distribution. A sampler needs to “mix” to the power distribution, which necessitates moving between modes of the target distribution; intuitively, e.g., trying different reasoning strategies. The samplers proposed in prior works repeatedly select a “cut” position in the current reasoning trace uniformly at random and resample the suffix from that position onward. However, reasoning traces typically contain a few consequential decisions (e.g., the choice of proof strategy or algorithm), and we observe that a uniformly chosen cut tends to rewrite local details rather than revisit decision points. We introduce an algorithm (Entropy-Cut Metropolis-Hastings) that uses the base model’s next-token entropy as a proxy to identify key decision points and resample from those positions. We empirically verify that entropy jumps are a useful proxy for decision points and, in a stylized model of reasoning, prove that our method’s mixing time scales with the number of decisions in a trace rather than with the number of tokens, which can be much larger. Across MATH500, HumanEval, GPQA Diamond, and AIME26, our method consistently improves over baselines and RL-trained models.

[171] Self-Trained Verification for Training- and Test-Time Self-Improvement cs.LG | cs.AI | cs.CLPDF

Chen Henry Wu, Aditi Raghunathan

TL;DR: 该论文提出了自训练验证（STV）方法，旨在通过改进验证器来同时提升测试时和训练时的自我改进能力。在测试时，STV显著增强了验证-精炼（V-R）循环在困难问题上的表现；在训练时，结合STV验证器反馈的验证器在环训练（ViL）进一步提升了生成器的性能。

Details

Motivation: 解决推理模型在测试时（通过验证-精炼循环）和训练时（通过自训练方法）自我改进的瓶颈，即验证器的性能限制，因为现有方法在验证器分数膨胀而准确率停滞或反馈过于泛化时失效。

Result: 在测试时，STV在困难数学问题上将准确率大致翻倍，在科学推理任务上从1.5%提升至21%；在训练时，ViL在RL收敛的生成器基础上，进一步带来33%的pass@1增益，且生成器的独立pass@1相对标准RL收敛点提升了30%。

Insight: 创新点在于利用参考解决方案的不对称性来训练验证器，使其模仿更知情版本的自身，从而捕获自生成错误；这解锁了验证-精炼循环和自训练的潜力，为困难推理问题提供了新的训练范式。

Abstract: Self-improvement at scale has been a longstanding goal for reasoning models, and there are two natural places to do it: at test time, through verification-refinement (V-R) loops; and at training time, through self-training methods. Both are gated by the same bottleneck: the verifier. V-R loops stall when verifier scores inflate while accuracy stagnates, and when feedback is too generic to act on; self-training fails similarly when bad self-generated data are added to training. Better verification would unlock both, but the capability we want to train, i.e., catching self-generated errors, lacks training signal. To address this challenge, we propose self-trained verification (STV). Our key observation is that, while a model cannot catch these errors alone, it can when shown the reference solution. We turn this asymmetry into a supervision target and train the verifier to imitate a more informed version of itself. At test time, STV substantially improves V-R loops on hard problems, while alternatives (e.g., SFT, RL on verifier scores, and even meta-verifiers) do not. STV roughly doubles accuracy on hard math and lifts it 14x on scientific reasoning tasks (1.5% to 21%). At training time, we additionally train the generator using RL with STV verifier’s feedback inside the V-R loop - a procedure we call verifier-in-the-loop training (ViL). Starting from an RL-converged generator, ViL yields a further 33% gain in pass@1. More notably, the generator’s standalone pass@1, with no verifier at test time, climbs 30% relative past where standard RL had converged. Hence, the next frontier in reasoning on hard problems may lie in how we train for and with verification.

cs.MA [Back]

[172] DynaGraph: Lightweight Multi-Model Interaction Framework via Dynamic Topological Reconfiguration cs.MA | cs.CL | cs.LGPDF

Yanxing Guo, Zihao Zheng, Fangzhou Wu, Ling Liang, Lin Bao

TL;DR: 本文提出了DynaGraph，一个通过动态拓扑重构驱动的轻量级多模型交互框架，旨在解决复杂推理任务中大规模单体LLM的计算冗余问题。该框架在单个消费级GPU上复用时分PEFT适配器，并引入评估器进行分层自愈，以应对静态拓扑的级联错误和动态代理的轨迹发散问题。

Details

Motivation: 动机在于解决大规模单体LLM在复杂推理任务中的计算冗余，以及现有结构化管道或多代理协作方法中静态拓扑易受级联错误影响、动态代理易导致轨迹发散和内存膨胀的困境。

Result: 在StrategyQA、MATH和FinQA基准测试中，8B参数的DynaGraph模型在推理能力上接近72B单体模型（例如StrategyQA上达到87.6%，MATH上达到82.7%），同时相比无约束动态架构，延迟降低高达68.1%，token消耗减少68.6%。

Insight: 创新点包括动态拓扑重构机制、基于时分PEFT适配器的轻量化多模型复用，以及通过评估器实现的分层自愈（细粒度修补和子图重建），这些设计在保持高性能的同时显著提升了效率和稳定性。

Abstract: Tackling complex reasoning tasks typically relies on massive monolithic LLMs, which suffer from severe computational redundancy. While task decomposition through structured pipelines or multi-agent collaborations offers an alternative, these approaches inevitably fall into a critical dilemma: predefined static topologies are highly vulnerable to cascading errors, whereas unconstrained dynamic agents suffer from trajectory divergence and unpredictable memory bloat. To address this, we present DynaGraph, a lightweight multi-model framework driven by dynamic topological reconfiguration. At the execution level, DynaGraph multiplexes time-division PEFT adapters over a shared base model, enabling both full system training and inference deployment on a single consumer-grade GPU. At the routing level, the Evaluator continuously monitors execution confidence to trigger hierarchical self-healing: Fine-grained Patching for localized data gaps and Subgraph Reconstruction for severe logical ruptures. Experiments on StrategyQA, MATH, and FinQA demonstrate our 8B model closely approximates the reasoning capabilities of a 72B monolithic model (e.g., 87.6% on StrategyQA, 82.7% on MATH). Furthermore, it reduces latency by up to 68.1% and token consumption by 68.6% compared to unconstrained dynamic architectures.

cs.SD [Back]

[173] COMET: Concept Space Dissection of the Modality Gap in Audio-Text Multimodal Contrastive Embeddings cs.SD | cs.AI | cs.CL | cs.LG | eess.ASPDF

Yonggang Zhu, Liting Gao, Aidong Men, Wenwu Wang

TL;DR: 本文提出了COMET框架，通过偏最小二乘奇异值分解（PLS-SVD）分析音频-文本多模态对比预训练模型中的模态间隙，揭示了模态间隙不仅源于均值偏移，更与共享概念轴的子集有关，并据此提出了一种无需训练的光谱截断方法来缓解该间隙。

Details

Motivation: 现有研究将CLAP模型中的音频-文本模态间隙主要归因于均值偏移（锥效应），但仅校正均值改进有限；其他假设如信息不平衡和维度坍缩在音频领域未得到充分验证，且缺乏从概念分解角度对模态间隙的深入分析。

Result: 提出的光谱截断方法在零样本音频描述任务中，通过条件交换接近了全监督性能，同时实现了显著的嵌入维度压缩，并在检索和音频描述任务上保持了强劲性能。

Insight: 创新点在于首次从概念空间分解的视角系统分析模态间隙，发现只有捕获共享概念的少数可解释轴对相似度计算贡献显著；据此提出的训练免费光谱截断方法，无需大型记忆库或昂贵计算，即可有效缩小模态间隙并保持模型性能。

Abstract: Contrastive Language-Audio Pretraining (CLAP) models are widely used for audio understanding and support modality-agnostic condition swapping in many zero-shot applications. However, their performance is heavily affected by the modality gap between audio and text embeddings. Existing explanations mainly attribute this gap to the cone effect, treating it as a shift between mean embeddings, yet correcting the mean alone yields only limited improvements. Alternative hypotheses, such as information imbalance and dimensionality collapse, have also been proposed, but they remain insufficiently verified and have not been thoroughly studied in the audio domain. Meanwhile, several works attempt to decompose multimodal contrastive embeddings into interpretable concepts, but none explicitly analyze the modality gap from the perspective of concept decomposition. In this work, we introduce COMET (Concept space Organization and Modality gap Explanation with PLS-SVD Transformation), a novel partial least squares singular value decomposition (PLS-SVD) framework for CLAP that unveils a broader perspective of the modality gap. Our framework reveals that only a small, interpretable subset of axes, which captures shared concepts, contributes substantially to similarity computation, and that the mean component represents only partially the modality gap. Building on this insight, we propose a simple spectral truncation method that mitigates the modality gap in a training-free manner. The method enables zero-shot audio captioning with condition swapping to approach fully supervised performance, without requiring large auxiliary memory banks or expensive computation. At the same time, it achieves substantial embedding dimensionality reduction while preserving strong performance on retrieval and audio captioning tasks.

[174] Audio Jailbreaks in Large Audio-Language Models: Taxonomy, Attack-Defense Analysis, and Cost-Aware Evaluation cs.SD | cs.AI | cs.CLPDF

Bo-Han Feng, Yu-Hsuan Li Liang, Chien-Feng Liu, You-Hsuan Chang, Yun-Nung Chen

TL;DR: 本文系统研究了大型音频语言模型中的越狱攻击与防御，提出了统一的分类体系，并在十个开源模型上进行了实证评估，重点关注攻击成功率、良性拒绝率和延迟等指标。研究发现声学最佳N攻击揭示了严重的音频空间漏洞，叙事框架是一种有效的低延迟语义威胁，而现有防御措施在鲁棒性和可用性之间存在权衡。

Details

Motivation: 大型音频语言模型将越狱风险从文本提示扩展到完整的语音感知-推理流程，现有研究在异构威胁模型和评估协议下进行，难以比较攻击的实用性或防御的有效性。

Result: 在十个开源LALMs上的评估结果表明，Acoustic Best-of-N攻击在音频空间表现出最强的漏洞，Narrative Framing是一种有效的低延迟语义威胁，而当前防御措施在鲁棒性和良性可用性之间存在权衡。

Insight: 论文的主要创新点在于提出了一个统一的LALM越狱攻击与防御分类法，并引入了包含成本（如延迟）和效用（如良性拒绝率）的评估框架，这超越了仅关注成功率的传统安全基准，为更全面的模型安全性评估提供了新视角。

Abstract: Large Audio Language Models (LALMs) expand jailbreak risks from token-level prompting to the full speech perception-to-reasoning pipeline, where unsafe behavior can be induced through semantics, acoustic style, signal artifacts, or internal representations. Existing work studies these risks under heterogeneous threat models and evaluation protocols, making it difficult to compare attack practicality or defense utility. This paper provides a unified taxonomy and a controlled empirical evaluation of LALM jailbreak attacks and defenses. We organize prior work into semantic, acoustic, signal, and embedding-layer attacks; guard-based, training-free, and training-based defenses; and cross-modal, audio-native, and interactive benchmarks. We then evaluate representative attacks and defenses across ten open-source LALMs, measuring not only attack success rate but also benign refusal and latency. Our results show that Acoustic Best-of-N reveals strong worst-case audio-space vulnerabilities, Narrative Framing is an effective low-latency semantic threat, and current defenses trade robustness against benign usability. These findings support cost- and utility-aware evaluation as a necessary complement to success-rate-only LALM safety benchmarks.

stat.ML [Back]

[175] Visual Spatial Learning: Single-Field Spatial Interpolation Using Convolutional Neural Networks stat.ML | cs.CV | cs.LG | stat.APPDF

Daniel Tinoco, Raquel Menezes, Carlos Baquero, Alexandra Silva

TL;DR: 本文提出了一种基于卷积神经网络（CNN）的单场空间插值方法，用于从稀疏观测点预测完整的空间相关场。该方法直接在单个部分观测场上进行训练和应用，无需外部数据或先验场，通过监督学习预测未观测点的值。

Details

Motivation: 解决经典插值方法（如克里金法）在非平稳场景下依赖高斯过程假设和变差函数建模的局限性，这些方法需要大量领域专业知识且效果受限。

Result: 方法在单实例稀疏监督下展示了CNN进行空间插值的潜力，无需显式协方差建模或变差图估计，能够以数据驱动方式灵活捕捉局部空间模式。

Insight: 创新点在于将CNN应用于单场空间插值这一新问题领域，提供了一种无需先验统计假设的实用替代方案，扩展了CNN在环境建模中的应用范围。

Abstract: Predicting a complete spatially correlated field from sparse observations is a fundamental challenge in spatial statistics and environmental modelling. Classical interpolation methods such as Kriging rely on Gaussian process assumptions and variography, which can limit their effectiveness in non-stationary settings and require substantial domain expertise. In this work, we leverage an architecture based on convolutional neural networks (CNNs) for spatial interpolation that is trained and applied on a single partially observed field, without access to external data or prior fields. The model is supervised directly on the observed locations and learns to predict values at unobserved points on the user defined grid. Unlike Kriging, our method does not require explicit covariance modelling or variogram estimation, and it can flexibly capture local spatial patterns in a data-driven manner. This work demonstrates the potential of CNNs for single-instance spatial interpolation under sparse supervision, offering a practical alternative to classical geostatistical methods, and extending the use of CNNs to a new problem domain.

cs.MM [Back]

[176] Unveiling the Visual Counting Bottleneck in Vision-Language Models cs.MM | cs.CV | cs.LGPDF

Xingzhou Pang, Yifan Hou, Junling Wang, Mrinmaya Sachan

TL;DR: 本文揭示了大型视觉语言模型在视觉计数任务中系统性泛化失败的根本原因。研究将视觉计数解构为视觉个体化、数量感知和符号映射三个阶段，通过合成围棋棋盘和线性探针实验，发现模型在感知和数量比较阶段表现稳健，但符号映射阶段崩溃，导致无法将未见过的视觉数量映射到符号标记。

Details

Motivation: 大型视觉语言模型在插值任务上表现出色，但在系统性泛化（尤其是视觉计数）上存在灾难性失败，本文旨在探究这一外推瓶颈的根源。

Result: 实验表明，视觉骨干网络在外推区域仍能保持线性可分的数量表示，模型也保留了潜在的数量感知能力，能成功进行数量比较推理，但在符号映射阶段失败。这些发现在最先进的基础模型上得到验证。

Insight: 论文提出了‘断裂数量假说’，认为视觉语言模型未能获得统一的数量空间，而是学习了分离的、模态特定的统计流形，阻碍了跨模态基础。创新点在于将计数任务解构为认知阶段进行分析，并指出仅靠数据缩放不足以解决此问题，需要引入强制统一表示的归纳先验。

Abstract: While Large Vision-Language Models (VLMs) excel at interpolation, they suffer catastrophic failures in systematic generalization, most notably in visual counting. In this work, we investigate this extrapolation bottleneck by deconstructing visual counting into three cognitive stages: visual individuation, magnitude awareness, and symbolic mapping. Using synthetic Go boards and linear probes, we demonstrate that visual backbones maintain robust, linearly separable representations of quantity well into the extrapolation regime, ruling out perceptual failure. Furthermore, models retain latent magnitude awareness, successfully performing comparative reasoning on quantities they fail to enumerate. We pinpoint the collapse to the symbolic mapping stage, where the model fails to project valid visual magnitudes onto symbolic tokens. Our findings support a frac tured magnitude hypothesis: VLMs fail to acquire a universal number space, instead learning disjoint, modality-specific statistical manifolds that prevent cross-modal grounding for unseen quantities. Validated on the state-of-the-art foundation model, our results suggest that bridging this gap requires inductive priors enforcing unified representations, as data scaling alone is insufficient.

cs.IR [Back]

[177] UniNote: A Unified Embedding Model for Multimodal Representation and Ranking cs.IR | cs.CVPDF

Jinghan Zhao, Wenwei Jin, Anqi Li, Jintao Tong, Luya Mo

TL;DR: 本文提出了一种名为UniNote的统一嵌入模型，旨在解决工业级项目到项目检索中的核心挑战。该模型通过定制化的多粒度检索策略和两阶段训练范式，结合对比监督微调和强化学习，以平衡全局内容表示与细粒度局部检索，并提升系统效率。

Details

Motivation: 论文的动机是解决多模态嵌入方法在项目到项目检索场景中的不足，包括难以平衡全局与局部表示、解耦的嵌入-排序流程效率低下，以及模型精度与推理延迟之间的固有权衡。

Result: 实验结果表明，UniNote在多种项目到项目检索任务上达到了最先进的性能。在小红书的大规模应用中，结合嵌套表示学习，显著提升了检索质量和成本效率。

Insight: 摘要宣称的创新点包括为工业检索设计的统一嵌入模型、支持多粒度内容表示的学习策略，以及结合对比学习和强化学习的两阶段训练范式。从客观角度看，其将表示学习与排序优化统一于单一模型，并集成强化学习进行对齐，是提升工业检索系统性能的有效途径。

Abstract: Item-to-Item (I2I) retrieval is a fundamental part of modern content platforms, supporting critical industrial workflows from recommendation engines to content auditing. While multimodal embedding methods have advanced general retrieval, they often falter in I2I scenarios due to the challenges of balancing global content representation with fine-grained local retrieval, the systemic inefficiency of decoupled embedding-and-ranking pipelines, and the inherent trade-offs between model precision and serving latency. To solve these issues, we propose \textbf{UniNote}, a unified embedding model designed for industrial I2I retrieval. Tailored retrieval strategies are introduced to support representation learning over complex, multimodal content at varying granularities. To operationalize these strategies, UniNote employs a two-stage training paradigm: the first stage leverages contrastive SFT to establish robust base embeddings, while the second stage refines ranking quality through a reinforcement learning (RL) process that aligns the model with content relevance. Our results show that UniNote achieves SOTA performance across diverse I2I tasks. Deployed at Xiaohongshu and integrated with Matryoshka Representation Learning (MRL), UniNote achieved significant improvements in retrieval quality and cost efficiency in large-scale applications.

[178] Latent Terms: Dense Retrievers Contain Trivially Extractable BM25-ready Zipfian Vocabularies cs.IR | cs.AI | cs.CLPDF

Benjamin Clavié, Sean Lee, Aamir Shakir, Makoto P. Kato

TL;DR: 本文提出了一种名为Latent Terms的方法，该方法揭示了无论是单向量还是多向量的稠密检索模型，其学习到的表示都可以被轻松分解为可用于检索的稀疏特征。通过在冻结的检索器上训练稀疏自编码器，无需任何检索特定的调整，即可提取出具有近似Zipf分布统计特性的潜在词汇，这些词汇可直接通过BM25进行经典稀疏检索评分。该方法无需学习扩展目标或稀疏检索监督，可应用于任何稠密检索器，并在某些任务上匹配或超越其基础模型的单向量评分方法以及类似的SPLADE变体。

Details

Motivation: 论文的动机在于揭示神经检索器（尤其是稠密检索器）内部蕴含比其默认评分函数所暴露的更丰富且可索引的结构，并探索如何利用其他方法（如稀疏自编码器）来提取这种结构，以实现高效的稀疏检索，同时克服单向量检索在某些任务上的局限性。

Result: Latent Terms方法在无需特定检索监督的情况下，能够匹配或超越其基础稠密检索模型的单向量评分方法以及可比的SPLADE变体。特别是在专门设计用于凸显单向量检索缺陷的LIMIT任务上，该方法显著优于其基础模型。

Insight: 论文的创新点在于发现并利用稀疏自编码器从预训练的稠密检索器中自动提取出具有Zipf分布特性的潜在词汇，从而将稠密表示无缝转换为可用于BM25评分的稀疏特征。这为结合神经检索的表达能力和传统稀疏检索的效率与可解释性提供了一条新途径，并表明神经模型内部可能隐含了更结构化的、可被传统方法利用的信息。

Abstract: We propose Latent Terms, a method revealing that models trained for dense retrieval, whether single- or multi-vector, learn representations that can trivially be decomposed into retrieval-ready sparse features. When trained on frozen retrievers, Sparse Autoencoders without any retrieval-specific adjustments extract a latent vocabulary with approximately Zipfian collection statistics, directly suitable for classical sparse retrieval scoring via BM25. This approach enables sparse retrieval while requiring no learned expansion objective or sparse retrieval supervision whatsoever, and can be readily applied to any dense retriever. Latent Terms is able to match or outperform single-vector scoring methods from its own base model as well as comparable SPLADE variants. In addition, it substantially outperforms its base model on LIMIT, a task specifically designed to highlight the failures of single-vector retrieval. Overall, our results highlight that neural retrievers contain more expressive and indexable structure than their default scoring functions expose, but that other methods can nonetheless be leveraged.

cs.CR [Back]

Naisha Minnah

TL;DR: 本文提出了DeepFake Forensics AI平台，这是一个集成了多模态深度伪造检测与基于区块链的证据管理功能的统一系统。它能够检测图像、视频和音频中的合成媒体，识别生成架构的指纹，并通过以太坊区块链实现防篡改的证据锚定。

Details

Motivation: AI生成的合成媒体（Deepfake）的泛滥对法律和取证领域的数字证据完整性构成了严重威胁，而现有的检测系统通常只针对单一模态，且缺乏防篡改的证据保存机制。

Result: 系统从头训练了四个独立的神经网络：图像检测器（EfficientNet-B4，AUC=0.9868）、视频检测器（双向LSTM，AUC=0.9628）、音频检测器（ECAPA-TDNN，EER=18.63%）和GAN指纹识别模块（准确率99.88%）。证据通过SHA-256哈希、IPFS存储和Solidity智能合约在以太坊上链管理。

Insight: 主要创新点在于首次将多模态深度伪造检测（图像、视频、音频及生成架构指纹）与基于区块链的监管链（chain-of-custody）管理统一在一个平台中，实现了从检测到证据保全的完整取证工作流。

Abstract: The proliferation of AI-generated synthetic media poses a critical threat to the integrity of digital evidence in legal and forensic contexts. Existing deepfake detection systems typically address a single modality and provide no mechanism for tamper-proof evidence preservation. We present DeepFake Forensics AI, a unified platform that detects synthetic media across image, video, and audio modalities, identifies generative architecture fingerprints, and anchors forensic evidence immutably on the Ethereum blockchain. Our system trains four independent neural networks from scratch: an EfficientNet-B4 image detector (AUC = 0.9868), a Bidirectional LSTM video detector (AUC= 0.9628), an ECAPA-TDNN audio detector (EER = 18.63%), and a novel GAN fingerprinting module (accuracy = 99.88%) that identifies the generative architecture behind a fake image. Evidence files are hashed with SHA-256, stored on IPFS via Pinata, and registered on-chain via a Solidity smart contract with role-based access control. The platform provides a React frontend and FastAPI backend suitable for deployment in forensic and legal workflows. To our knowledge, this is the first system to unify multi-modal deepfake detection with blockchain-based chain-of custody management.

[180] Token Inflation: How Dishonest Providers Can Overcharge for Large Language Model Usage cs.CR | cs.AI | cs.CLPDF

Shahinul Hoque, Jinghuai Zhang, Jinyuan Sun, Fnu Suya

TL;DR: 本文研究了商业大语言模型（LLM）按token计费模式中的审计漏洞，指出由于模型、分词器和执行过程对用户不透明，现有审计框架本质上依赖于服务提供商自身提供的证明，形成了信任悖论。作者分析了三种近期提出的token审计框架，证明具备普通商业能力的提供商可以系统性地虚报计费token数量，导致用户被大幅多收费。

Details

Motivation: 动机在于揭示按token计费这一主流LLM商业模式中存在的根本性审计缺陷。由于服务提供商为保护知识产权、防止越狱和用户隐私而隐藏关键信息，导致计费过程难以被独立验证，用户面临被不诚实提供商多收费的风险。

Result: 定量结果显示，在最宽松的设定下（隐藏推理过程），提供商平均可虚报计费token达1469%而不被检测到，使100美元的真实账单膨胀至约1569美元。即使在用户能看到完整推理字符串的情况下，仅凭分词歧义仍允许低于检测阈值的50.85%虚报。这些结果在分析的三种审计框架下均成立。

Insight: 核心创新点在于指出了现有LLM计费审计中的根本性“信任悖论”，即审计证据完全来自被审计方。客观的创新之处在于系统性地论证了该问题的普遍性，并指出解决方案必须将报告的token计数与提供商无法控制的证据（如可信执行证明、推理的密码学证明或第三方重新执行）绑定，而非依赖特定审计器的改进。

Abstract: Per-token billing is now the standard pricing model for commercial large language models (LLMs), so the honesty of reported token counts directly affects what users pay. We show that this kind of billing is hard to audit by design: providers hide the model, the tokenizer, and the execution to protect their IP, mitigate jailbreaks, and preserve user privacy, which means an auditor can only inspect proofs the provider supplies. The audit therefore reduces to a consistency check on the provider’s own reports. We call this a trust paradox: every audit must trust some artifact, but current frameworks trust exactly the ones a provider has the strongest reason to manipulate. We study three recent token auditing frameworks and show that a provider with ordinary commercial capabilities can systematically inflate billed token counts. In the most permissive setting, hidden reasoning usage can be inflated by 1,469% on average without detection. At current frontier reasoning prices, that turns a $100 honest bill into roughly a $1,569 bill on the same query. Even when the user can see the full reasoning string, tokenization ambiguity alone still allows 50.85% over-reporting below the detection threshold. These results suggest the problem is not in any specific auditor but in any audit whose evidence comes from the audited party. Restoring honest billing will require verification that ties reported token counts to evidence the provider does not control, such as trusted execution attestation, cryptographic proofs of inference, or third-party re-execution.

cs.GR [Back]

[181] Before the Shutter: Aesthetic and Actionable Portrait Photography Planning in 3D Scenes cs.GR | cs.AI | cs.CVPDF

Ruixiang Jiang, Chang Wen Chen

TL;DR: 本文提出了一种三维美学肖像规划方法，通过构建摄影场景图来表征场景可供性、主体-场景关系和肖像相关光照结构，从而在拍摄前生成人体姿态、相机、光照和曝光计划，以创作出视觉吸引力强且在三维场景中几何与光度可行的肖像。

Details

Motivation: 现有计算方法大多专注于二维图像空间的后期制作，而拍摄前的摄影规划仍未被充分探索。本文旨在解决在三维场景中协调主体姿态、相机配置和光照设备以生成美学肖像的预捕捉规划问题。

Result: 在多样化的室内外场景实验中，该方法生成的人像在人类评估者和多模态大语言模型评估者中均优于竞争基线，同时保持了较高的物理合理性。

Insight: 创新点在于提出了三维美学肖像规划任务，并构建了摄影场景图这一新颖表示来支持美学引导的比较规划，将计算摄影的重点从后期校正转向了前期规划。

Abstract: Portrait photography is largely decided before the shutter opens: the subject’s pose, the camera configuration, and the lighting devices must be coordinated within the surrounding 3D scene. In contrast, most existing computational methods focus on post-production in 2D image space, such as retouching, relighting, or editing images that already exist; pre-capture photographic planning remains largely unexplored. We introduce 3D aesthetic portrait planning, the task of generating human pose, camera, lighting, and exposure plans that produce visually compelling portraits while satisfying geometric and photometric feasibility in a 3D scene. Our approach builds a Photographic Scene Graph that represents scene affordances, subject-scene relations, and portrait-relevant lighting structure. Built on this representation, we perform aesthetic-guided comparative planning over previous attempts and current viewfinder observations. Experiments across diverse indoor and outdoor scenes show that our method produces portraits preferred by human raters and MLLM evaluators over competitive baselines, while maintaining high physical plausibility. Together, our results suggest a path from post-capture correction toward pre-capture computational portrait planning. Project repository: https://github.com/songrise/Before-the-Shutter

cs.RO [Back]

[182] 3DVLA: Enhancing Vision-Language-Action Models via 3D Spatial and Instance Understanding cs.RO | cs.CVPDF

Zhongyu Xia, Yousen Tang, Bingqing Wei, Yongtao Wang

TL;DR: 本文提出了3DVLA框架，旨在解决现有视觉-语言-动作模型在机器人操作中缺乏3D场景理解的问题。该框架通过引入多视角一致性约束、实例估计模块和掩码自监督3D编码分支，以即插即用的方式增强预训练VLA模型的3D空间和实例理解能力，无需额外人工标注。

Details

Motivation: 现有VLA模型在机器人操作中缺乏3D场景理解，导致三个关键挑战：多视角不一致导致3D空间位置提取弱、3D实例理解不足、以及遮挡下推理脆弱。尽管成熟3D感知方法存在，但直接集成到VLA流程中存在架构不兼容和依赖昂贵实例级标注的问题。

Result: 在LIBERO-Plus和RoboTwin 2.0基准测试中，将3DVLA集成到多个VLA基线模型上，均取得了持续且显著的性能提升，验证了其有效性和即插即用兼容性。

Insight: 创新点包括：1) 跨所有模态的显式多视角一致性约束和空间条件几何聚合方法，实现普适的3D特征编码；2) 使用高级实例令牌的实例估计模块，增强3D实例感知；3) 保留预测器的掩码自监督3D编码分支，通过视觉令牌补全处理遮挡。从客观角度看，该框架以无标注、保留VLM先验的方式解决了3D集成难题，具有实用价值。

Abstract: Vision-Language-Action models have achieved remarkable progress in robotic manipulation, yet they suffer from a critical limitation: a lack of 3D scene understanding. This deficiency manifests as three intertwined challenges: weak extraction of 3D spatial positions without enforcing multi-view consistency, inadequate 3D instance understanding, and fragile reasoning under occlusion. Although mature 3D perception methods exist, their direct integration into VLA pipelines is hindered by architectural incompatibility and by heavy reliance on costly instance-level annotations. To address the above challenges, we propose 3DVLA, a plug-and-play framework that injects robust 3D reasoning into pretrained VLAs without requiring extra manual labels or discarding VLM priors. Specifically, 3DVLA tackles the three challenges through: (1) pervasive 3D feature encoding with explicit multi-view consistency constraints across all modalities and a Spatially-Conditioned Geometry Aggregation method, (2) an instance estimation module with high-level instance tokens for 3D instance awareness, and (3) a masked self-supervised 3D encoding branch that retains its predictor for visual token completion to handle occlusions. We integrate 3DVLA with multiple VLA baselines and evaluate on LIBERO-Plus and RoboTwin 2.0. Results show consistent and significant gains in manipulation performance, validating both the effectiveness and plug-and-play compatibility of our approach.

[183] VLA-Pro: Cross-Task Procedural Memory Transfer for Vision-Language-Action Models cs.RO | cs.AI | cs.CVPDF

Shengyu Si, Yuanzhuo Lu, Ruimeng Yang, Ziyi Ye, Zuxuan Wu

TL;DR: 本文提出VLA-Pro，一个即插即用的框架，旨在通过存储和迁移任务相关的程序性记忆来增强视觉-语言-动作（VLA）模型的跨任务泛化能力。该框架在训练时存储任务特定的LoRA适配器作为参数化程序记忆，在推理时根据当前多模态上下文检索并动态融合这些记忆以生成动作序列。

Details

Motivation: 现有VLA模型在需要跨物体、场景和动作模式迁移相关经验的未见任务上泛化能力不足，VLA-Pro旨在解决这一跨任务泛化挑战。

Result: 在RoboTwin、RLBench仿真环境和真实世界操作任务上的实验表明，VLA-Pro能持续提升多种骨干模型的跨任务泛化性能，仿真中相对提升最高达207%，真实世界成功率从5.8%提升至65.0%。

Insight: 创新点在于将任务特定的LoRA适配器作为可检索的程序性记忆，实现了模块化的经验迁移；客观来看，其动态记忆检索与融合机制为VLA模型提供了一种保持执行稳定性的有效泛化途径。

Abstract: Vision-Language-Action~(VLA) models have shown strong potential for general-purpose robotic manipulation, yet they still struggle to generalize to unseen tasks that necessitate transferring relevant experience across objects, scenes, and action patterns. This paper proposes VLA-Pro, a plug-and-play framework designed to enhance cross-task generalization by storing task-relevant procedural memories at training time and transferring these memories during inference. Specifically, VLA-Pro stores task-specific LoRA adapters as parameterized procedural memories during training. At inference time, VLA-Pro retrieves relevant procedural memories based on the current multi-modal context and dynamically fuses these memories for generating the current action chunk. Experiments on RoboTwin, RLBench, and real-world manipulation tasks show that VLA-Pro consistently improves cross-task generalization across multiple backbones, achieving up to a 207% relative improvement in simulation and increasing real-world success rate from 5.8% to 65.0%. These results suggest that procedural memory retrieval and adaptation provide an effective mechanism for transferring manipulation experience to novel tasks while preserving modularity and execution stability.

[184] Qwen-VLA: Unifying Vision-Language-Action Modeling across Tasks, Environments, and Robot Embodiments cs.RO | cs.AI | cs.CLPDF

Qiuyue Wang, Mingsheng Li, Jian Guan, Jinhui Ye, Sicheng Xie

TL;DR: 本文提出了Qwen-VLA，一个统一视觉-语言-动作建模的具身智能基础模型。它通过基于DiT的动作解码器，将Qwen的视觉语言能力扩展到连续动作和轨迹生成，旨在解决不同具身决策任务（如操作、导航）的碎片化问题，并实现跨任务、环境和机器人形态的泛化。

Details

Motivation: 当前具身智能研究通常针对特定任务（如操作或导航）开发专用模型，导致能力碎片化，难以泛化到不同任务、环境和机器人形态。本文旨在探索是否能用单一模型统一异构的具身决策问题。

Result: 在多个基准测试中取得优异性能：LIBERO上97.9%，Simpler-WidowX上73.7%，RoboTwin-Easy/Hard上86.1%/87.2%，R2R上69.0% OSR，RxR上59.6% SR，真实世界ALOHA实验中平均76.9%的OOD成功率，以及DOMINO动态操作上26.6%的零样本成功率。

Insight: 核心创新在于提出了一个统一的动作-轨迹预测框架，并引入了具身感知提示条件机制，使模型能适应不同机器人平台的控制规范。通过大规模联合预训练融合多种数据源，实现了跨任务和形态的可迁移视觉 grounding、空间推理和连续动作生成。

Abstract: Embodied intelligence is often studied through specialized models for individual tasks such as manipulation or navigation, resulting in fragmented capabilities and limited generalization across tasks, environments, and robot embodiments. In this work, we study whether heterogeneous embodied decision-making problems can be unified within a single vision-language-action model. We present Qwen-VLA, a unified embodied foundation model that extends Qwen’s vision-language modeling stack from perception, understanding, and reasoning to continuous action and trajectory generation through a DiT-based action decoder. Qwen-VLA is trained with a large-scale joint pretraining recipe over diverse data sources, including robotics manipulation trajectories, human egocentric demonstrations, synthetic simulation data, vision-and-language navigation data, trajectory-centric supervision, and auxiliary vision-language data. To support multiple robot platforms, we introduce embodiment-aware prompt conditioning, where robot-specific textual descriptions specify the current embodiment and control convention. We further cast manipulation, navigation, and trajectory prediction into a unified action-and-trajectory prediction framework, enabling transferable visual grounding, spatial reasoning, and continuous action generation across robot morphologies, task families, and environments. Experiments on manipulation, navigation, and trajectory-centric benchmarks show consistent multi-task performance and out-of-distribution generalization under variations in scene layout, background, lighting, object configuration, and robot embodiment. Qwen-VLA-Instruct achieves 97.9% on LIBERO, 73.7% on Simpler-WidowX, 86.1%/87.2% on RoboTwin-Easy/Hard, 69.0% OSR on R2R, 59.6% SR on RxR, 76.9% average OOD success in real-world ALOHA experiments, and 26.6% zero-shot success on DOMINO dynamic manipulation.

Table of Contents

cs.CL [Back]

[1] Micro-Macro Retrieval: Reducing Long-Form Hallucination in Large Language Models cs.CL | cs.AIPDF

[2] Lightweight Multimodal LLM-Enabled Cost-Effective Defect Grading of Power Transmission Equipment cs.CLPDF

[3] MechELK: A Mechanistic Interpretability Framework for Eliciting Latent Knowledge in Large Language Models cs.CLPDF

[4] Aryabhata 2: Scaling Reinforcement Learning for Advanced STEM Reasoning cs.CL | cs.AI | cs.CYPDF

[5] GenesisFunc: Multi-Agent Data Generation for Accurate and Generalizable Function-Calling cs.CL | cs.AIPDF

[6] Thoughts-as-Planning: Latent World Models for Chain-of-Thoughts Optimization via Reinforcement Planning cs.CL | cs.AIPDF

[7] Hallucination Detection-Guided Preference Optimization for Clinical Summarization cs.CL | cs.AIPDF

[8] Reasoning that Travels: Dissecting How Chain-of-Thought Transfers Across Models cs.CLPDF

[9] From Data to Insights: Exploring Program-of-Thoughts Prompting for Chart Summarization cs.CLPDF

[10] Error as a Lens: Probing LLM Reasoning through Synthetic Misconception Generation cs.CLPDF

[11] Structured Prompt Optimization Meets Reinforcement Learning for Global and Local Interpretability over Complex Text cs.CL | cs.AI | cs.LGPDF

[12] Analyzing Persona Effects in Generated Explanations from Multimodal LLM Agents in Urban Perception cs.CL | cs.CV | cs.HC | cs.MAPDF

[13] UA-Legal-Bench: A Benchmark for Evaluating Large Language Models on Ukrainian Legal Reasoning cs.CL | cs.AIPDF

[14] Prompt-Level Reward Specifications for Open-Ended Post-Training cs.CLPDF

[15] Rethinking Stepwise Model Routing: A Cost-Efficient Table Reasoning Perspective cs.CLPDF

[16] GrepSeek: Training Search Agents for Direct Corpus Interaction cs.CL | cs.AI | cs.IR | cs.LGPDF

[17] STAMP: Training Explicit Memory for Mobile GUI Agents in Controllable and Scalable Virtual Environments cs.CL | cs.CVPDF

[18] Reasoning-preserved Efficient Distillation of Large Language Models via Activation-aware Initialization cs.CL | cs.LGPDF

[19] Casual as an Anchor: Resolving Supervision Misalignment in Formality Transfer Dataset cs.CLPDF

[20] SURGENT: A Surgical Multi-Agent Assistance System Across the Perioperative Workflow cs.CL | cs.AIPDF

[21] Learning Design Skills as Memory Policies for Agentic Photonic Inverse Design cs.CLPDF

[22] FinGuard: Detecting Financial Regulatory Non-Compliance in LLM Interactions cs.CLPDF

[23] Adaptive Interviewing for Persona Simulation in LLMs: Evidence-Grounded Reasoning Improves Decision Alignment cs.CL | cs.AIPDF

[24] Comparative Evaluation of Machine Translation Systems on Images with Text cs.CLPDF

[25] PhoneWorld: Scaling Phone-Use Agent Environments cs.CL | cs.AI | cs.LGPDF

[26] On Asymmetric Optimization of Reasoning and Perception in Vision-Language Model Post-Training cs.CL | cs.CVPDF

[27] From Blind Guess to Informed Judgment: Teaching LLMs to Evaluate Materials by Building Knowledge-Augmented Preference Signals cs.CLPDF

[28] Source-Grounded Semantic Reinforcement Learning for Low-Resource Target-Language Generation cs.CL | cs.AIPDF

[29] LiteCoder-Terminal: Scaling Long-Horizon Terminal Environments for Learning Language Agents cs.CLPDF

[30] GAPD: Gold-Action Policy Distillation for Agentic Reinforcement Learning in Knowledge Base Question Answering cs.CLPDF

[31] World Models in Words: Auditing Physical State-Transition Commitments in Vision-Language Models cs.CLPDF

[32] Training Deliberative Monitors for Black-Box Scheming Detection cs.CL | cs.AI | cs.LGPDF

[33] Spurious Prompts: Can Irrelevant Prompts Steer Large Language Models? cs.CLPDF

[34] Verifiable Rewards Beyond Math and Code: Lightweight Corpus-Grounded Process Supervision for Factual Question Answering cs.CLPDF

[35] Teaching Language Models to Check Grounded Claim Factuality with Human Test-Taking Strategies cs.CL | cs.AIPDF

[36] User-Aware Active Knowledge Acquisition for Emotional Support Dialogue cs.CLPDF

[37] Multi-Legal-Bench: Evaluating LLMs on Legal Reasoning Across Jurisdictions, Languages, and Legal Traditions cs.CL | cs.AIPDF

[38] ActTraitBench: Quantifying the Knowledge-Decision Gap in Large Language Models via Human-Grounded Behavioral Validation cs.CLPDF

[39] Nine Judges, Two Effective Votes: Correlated Errors Undermine LLM Evaluation Panels cs.CLPDF

[40] Towards Localized and Disentangled Knowledge Editing for Multimodal Large Language Models cs.CL | cs.AIPDF

[41] EvoRubric: Self-Evolving Rubric-Driven RL for Open-Ended Generation cs.CLPDF

[42] Towards Verifiable Multimodal Deep Research: A Multi-Agent Harness for Interleaved Report Generation cs.CL | cs.AIPDF

[43] CRITIC-R1: Learning Structured Critics for Retrieval-Augmented Generation cs.CL | cs.AIPDF

[44] Does The Way You Plan Matter? An Empirical Study of Planning Representations for LLM Web Agents cs.CL | cs.AI | cs.LGPDF

[45] Who Am I? History-Aware Profiles for Student Simulation in Tutoring Dialogues cs.CL | cs.CYPDF

[46] Latent Performance Profiling of Large Language Models cs.CL | cs.LGPDF

[47] HEART-Bench: Do LLM Agents Exhibit Human-like Psychology? cs.CLPDF

[48] DirectorBench: Diagnosing Long-Form Video Generation with Personalized Multi-Agent Evaluation cs.CL | cs.CVPDF

[49] SEAL: Can Saturated Benchmarks Be Revived by LLM-as-a-Meta-Judge? cs.CLPDF

[50] CCS: Clinical Consensus Selection for Radiology Report Generation cs.CL | cs.CVPDF

[51] GRUFF: LLM Pronoun Fidelity, Reasoning, and Biases in German cs.CLPDF

[52] Do Language Models Track Entities Across State Changes? cs.CL | cs.AIPDF

[53] Knowing What to Solve Before How: Preplan Empowered LLM Mathematical Reasoning cs.CLPDF

[54] Loong: A Human-Like Long Document Translation Agent with Observe-and-Act Adaptive Context Selection cs.CL | cs.AIPDF

[55] MedCase-Structured: A Text-to-FHIR Dataset for Benchmarking Diagnostic Reasoning in Clinically Realistic EHR Settings cs.CL | cs.AIPDF

[56] Unlocking the Working Memory of Large Language Models for Latent Reasoning cs.CL | cs.AIPDF

cs.CV [Back]

[57] GAP3D: Generative Alignment of VLM Latents to Patch-Level Embeddings for 3D Generation cs.CVPDF

[58] A Deep Learning Iterative Framework for Sentinel-1 Stripmap Enhancement Based on Azimuth Doppler Decomposition cs.CVPDF

[59] Embodied3DBench: Benchmarking Low-Level Embodied Spatial Intelligence of Vision Language Models cs.CV | cs.ROPDF

[60] Robust Cross-Domain Generalization Using Unlabeled Target Data with Source-Domain Supervision cs.CVPDF

[61] Lightweight Complementary-Cue Fusion for Robust Video Face Forgery Detection cs.CV | cs.LG | cs.MMPDF

[62] Towards the automated segmentation of epicardial and mediastinal fats: A multi-manufacturer approach using intersubject registration and random forest cs.CVPDF

[63] Guidance Contrastive Token Credit Assignment for Discrete Policy Optimization cs.CVPDF

[64] MetaRanker: Human-in-the-loop Active Ranking for Metalens Image Quality cs.CV | cs.HCPDF

[65] SalsaAgent: A multimodal embodied language model for interactive dance generation cs.CVPDF

[66] Motion-guided sparse correction enables expert-quality point tracking across diverse microscopy regimes cs.CVPDF

[67] Deep Psychovisual Image Representations cs.CVPDF

[68] ViASNet: A Video Ad Saliency Network for Predicting Dynamic Saliency and Viewer Engagement cs.CVPDF

[69] Pocket-Dentist: On-Device Dental Image Understanding via Efficient Multimodal Large Language Models cs.CV | cs.AIPDF

[70] EarthShift: a benchmark for measuring robustness to real-world distribution shifts in Earth observation cs.CVPDF

[71] Multi-Stage VLM Pipeline for Zero-Shot Traffic Accident Understanding cs.CVPDF

[72] DMC-CF: Dynamic Multimodal CounterFactual QA benchmark for Causal Reasoning cs.CVPDF

[73] WorldMemArena: Evaluating Multimodal Agent Memory Through Action-World Interaction cs.CV | cs.CLPDF

[74] Semantic and Visual Evidence for Efficient Long-Video Reasoning: A Solution for the HD-EPIC VQA Challenge cs.CV | cs.AIPDF

[75] Uni-RCM: Unified Reference-guided Cross-modal Mapping for Multi-Class Anomaly Detection cs.CV | eess.SPPDF

[76] FlowSeg: Dynamic Semantic Guidance for LLM-Conditioned Segmentation cs.CVPDF

[77] Benchmarking Large Vision-Language Models on CFMME: A Comprehensive Chinese Financial Multimodal Evaluation Dataset cs.CV | cs.AIPDF