cs.CL [Total: 27]
cs.CV [Total: 55]
cs.HC [Total: 3]
cs.LG [Total: 6]
cs.IR [Total: 1]
cs.AI [Total: 7]
eess.SP [Total: 1]
cs.SD [Total: 1]
cs.CY [Total: 1]
eess.IV [Total: 2]
cs.RO [Total: 3]

cs.CL [Back]

[1] The Dialect Tax: Dialectal Biases Persist throughout the Language Modeling Pipeline cs.CL | cs.AI | cs.LGPDF

Elle

TL;DR: 该论文研究了语言模型（LM）中存在的系统性方言性能差距，即’方言税’。通过使用保持语义不变但表面形式不同的平行英语方言语料库，研究发现方言税并非由单一环节造成，而是在语言建模流程的每个步骤（包括分词、预训练、后训练和推理）中持续存在并累积。

Details

Motivation: 动机是探究现代语言建模流程中方言性能差距的根源，尽管已知语言模型存在系统性方言差异，但其具体来源尚不清楚。

Result: 研究发现，即使使用字符级反事实分词器绕过传统子词分割，也无法消除输入输出不对称性和方言准确性差距。在预训练中，方言对引起的梯度更新差异比完全不相关的标准美式英语文档对更大；在后训练中，奖励模型表现出不稳定且依赖于上下文的方言偏好。

Insight: 创新点在于系统性地追踪了’方言税’在整个NLP流程中的表现，揭示了方言偏见在建模的每个环节都被编码和累积，而不仅仅是分词或特定训练阶段的问题，这挑战了仅通过改进分词就能解决方言偏见的观点。

Abstract: Systematic dialectal performance gaps in language models (LMs) are well documented, but the source of these disparities within the modern language modeling pipeline remains unclear. Our study traces this “dialect tax” across the natural language processing pipeline. Using parallel English dialect corpora that hold meaning fixed while varying surface form, we first confirm that LMs recognize matched Standard American English (SAE) and dialectal texts as semantically equivalent. However, we discover further representational gaps corresponding to downstream performance gaps. Across model families and generations, modern LMs still encode dialectal texts unequally during tokenization, pre-training, post-training, and inference. Strikingly, bypassing traditional subword segmentation via a character-level counterfactual tokenizer removes neither input and output asymmetries nor dialectal accuracy gaps. During pre-training, dialect pairs induce more divergent gradient updates than pairs of entirely unrelated SAE documents, indicating that models find semantically equivalent dialectal content harder to learn from than unrelated SAE documents. During post-training, reward models show contextual, unstable dialect preferences, assigning higher values to isolated AAVE-exclusive tokens than to SAE-exclusive tokens, while full reasoning contexts receive task- and model-dependent dialect penalties. Overall, our findings suggest that the dialect tax is encoded and accumulated not by any one step in isolation, but at every step of the language modeling process.

[2] The Imperfective Paradox Is Not Necessarily in Large Language Models: A Benchmark Failure Before a Model Failure cs.CL | cs.LGPDF

Kaiqiao Han, Yizhou Sun

TL;DR: 这篇论文重新审视了先前关于不完全体悖论在大型语言模型中表现的基准测试，指出该基准存在概念和评估上的误设，导致模型被错误地认为具有目的论偏差。作者通过构建词汇匹配最小对、采用多步推理评估方法，发现模型实际上表现出充分性偏差，而非目的论偏差，并且在适当提示下可以达到接近人类标注者的性能。

Details

Motivation: 针对先前研究构建的NLI基准及其结论（即模型常从进行体描述推断完成的有界事件，并归因于目的论偏差），作者认为该基准存在概念和评估上的根本性误设，需要重新检验模型的实际语义理解能力。

Result: 在严格NLI标准下，基准中76%的Group A实例未明确排除事件完成；人工标注显示38%的Group A和29%的Group C实例允许替代解释。通过构建Lexically Matched Minimal Pairs并采用多步推理评估，实验表明模型常不肯定事件完成却接受对应的简单过去假设（即Sufficiency Bias）。在Qwen-7B（适当提示）、GPT-5.4和Qwen-72B上的实验显示，模型可以达到与人类标注者相当的性能。

Insight: 论文的创新点在于揭示了基准构建中的Aspectual Reduction等概念误设，并提出了将事件语义NLI建模为多步推理问题，以评估中间语义决策和最终预测。这强调了在评估模型语义能力前，需确保基准本身的有效性，并指出模型的失败可能源于组合性体分类错误或表面形式吸引，而非固有的目的论偏差。

Abstract: The imperfective paradox provides a useful test of compositional semantic analysis. Recent work constructs an NLI benchmark and reports that models frequently infer completed telic events from progressive descriptions, attributing this behavior to a Teleological Bias. It further argues that prompting interventions cause a Calibration Crisis. We reexamine the benchmark and conclusions and show that it is substantially affected by conceptual and evaluation mis-specifications. We identify three conceptual mis-specifications. In particular, Aspectual Reduction affects the benchmark construction, analysis, experiments, and conclusions. Under a strict NLI standard, 76% of Group A instances do not explicitly rule out culmination. In our native-speaker annotation, 38% of Group A examples and 29% of the Group C examples were judged to permit an alternative interpretation. To control these issues and lexical variation, we construct Lexically Matched Minimal Pairs. At the evaluation level, we formulate event-semantic NLI as a Multi-step Reasoning Problem and assess both intermediate semantic decisions and final predictions. Our results show that models often do not affirm culmination but nevertheless accept the corresponding simple-past hypothesis, a pattern we characterize as Sufficiency Bias. We further show that prompting interventions produce a Decision Shift among labels without reliably improving the underlying semantic understanding and reasoning. Intermediate and oracle-guided analyses identify two additional failure modes: errors in compositional aspectual classification and Surface-form Attraction toward surface-associated answers. Our experiments on Qwen-7B with suitable prompts, GPT-5.4, and Qwen-72B provide initial evidence for the context sensitivity of aspectual classification and suggest that these models can achieve performance comparable to that of human annotators.

[3] SelfGraphRAG: Bridging the Supervision Gap in Graph-Based RAG with Synthetic QA Generation cs.CL | cs.AIPDF

Ben Lagnese, Manas Gaur

TL;DR: SelfGraphRAG是一个用于图检索增强生成（Graph RAG）的框架，旨在解决新构建知识图谱缺乏标注问答数据的问题。它通过直接从知识图谱结构中生成合成问答对，来训练一个查询条件化的图检索器，从而捕获实体间的多跳关系和局部邻域信息。

Details

Motivation: 现有基于图的RAG方法虽然能利用知识图谱中的关系结构，但其监督式图检索通常需要标注的问答数据，这对于新构建的图谱往往不可得。论文旨在克服这一监督缺口。

Result: 在多跳问答和分类基准测试上的实验表明，SelfGraphRAG在检索精度和下游推理性能上优于基于嵌入的基线方法。

Insight: 核心创新点在于利用知识图谱结构本身作为监督信号，自动生成合成QA对来训练检索器，无需人工标注。这为缺乏标注数据的图RAG应用提供了一种有效的自监督解决方案。

Abstract: Retrieval-augmented generation (RAG) improves large language models by incorporating external knowledge without retraining, but existing methods often underuse the relational structure encoded in knowledge graphs. Graph-based RAG can capture entity relationships, yet supervised graph retrieval typically requires labeled question-answer data that may not be available for newly constructed graphs. We address this limitation with SelfGraphRAG, a framework that generates question-answer pairs directly from knowledge graph structure and uses them to train a query-conditioned graph retriever. The generated questions capture multi-hop paths and local neighborhoods, providing relational supervision without manual annotation. Experiments on multi-hop question answering and classification benchmarks show that SelfGraphRAG improves retrieval precision and downstream reasoning performance over embedding-based baselines. These results suggest that knowledge graph structure can provide useful supervision for training graph retrievers when labeled data are unavailable.

[4] From Memorization to Absorption: Mixed-Policy RL for Continual Knowledge Injection cs.CL | cs.LGPDF

Zhibo Hou, Fan Zhao, Zhiyu An, Wan Du

TL;DR: 本文提出了一种名为Golden-GRPO Injection (GRIN)的三阶段自学习框架，用于持续知识注入。该方法采用混合策略强化学习算法，旨在解决监督微调在知识泛化方面的不足，使大语言模型能够吸收知识而不仅仅是记忆。

Details

Motivation: 现有基于监督微调的方法在持续知识注入时，只能记忆训练格式的事实，但无法在释义、文档组合和推理任务上实现泛化。

Result: 在针对新知识获取和反事实覆盖的两个文档级基准测试（Blank和Counter）上，GRIN在较难的问题类型（如多源检索和推理）上显著优于监督微调和混合策略强化学习基线，同时在基础事实回忆任务上与之相当。

Insight: 核心创新点是提出了专门为知识注入设计的混合策略强化学习算法Golden-GRPO，它通过注入黄金答案来提供学习信号，即使在线策略探索在新事实上失败时也能有效学习，从而实现了从‘记忆’到‘吸收’的转变。

Abstract: Continual knowledge injection is essential for keeping large language models up-to-date in a fast-evolving world. Existing methods rely on supervised fine-tuning (SFT), which memorizes injected facts in their training format but fails to generalize across paraphrasing, document combinations, and reasoning. To address this, we propose Golden-GRPO Injection (GRIN), a three-stage self-learning framework for continual knowledge injection. Golden-GRPO is a mixed-policy reinforcement learning algorithm designed specifically for knowledge injection, which injects a golden answer to provide learning signal even when on-policy rollouts fail on novel facts. We further introduce Blank and Counter, two document-level benchmarks targeting novel acquisition and counterfactual overwrite respectively, each evaluating single-fact recall, multi-source retrieval, and inferential reasoning. Our experiments establish a clear empirical claim: mixed-policy reinforcement learning enables knowledge absorption beyond what supervised fine-tuning can achieve. GRIN substantially outperforms SFT and mixed-policy RL baselines on the harder question types while matching them on basic fact recall.

[5] Groundhog Bit-Flip Attack: Seeding Infinite Generation Loops in Mixture-of-Experts LLMs through Bit Flips cs.CLPDF

Huakang Lin, Tiancheng Zheng, Mingxuan Sun, Tianhong Xu, Fan Zhang

TL;DR: 本文提出了一种针对基于混合专家（MoE）架构的大型语言模型（LLM）的新型比特翻转攻击——Groundhog Bit-Flip Attack (GBFA)。该攻击通过识别并翻转路由层中与特定专家激活相关的比特，能够诱导模型陷入无限生成循环，从而显著增加解码令牌使用量，造成拒绝服务式的钱包消耗攻击。

Details

Motivation: MoE架构通过路由机制选择性激活专家子网络以实现高效扩展，但这种自适应设计引入了新的攻击面：特定专家与某些令牌（如序列结束符）过度关联，使得攻击者可以通过轻量级扰动操纵模型行为。本文旨在探索MoE架构对此类比特翻转攻击的鲁棒性漏洞。

Result: 在四种主流的真实世界MoE LLM上进行评估，手动平均停用少于4个专家即可驱动平均输出膨胀率达到5912%，大多数测试样本达到最大令牌数。攻击在对话、推理和代理任务三种不同LLM模式下均能大幅延长解码令牌使用，同时基本保持语义保真度。

Insight: 创新点在于首次提出了针对MoE LLM的基于比特翻转的拒绝服务（钱包消耗）攻击，揭示了路由机制中专家与令牌的强相关性可被恶意利用。从客观角度看，该研究凸显了MoE架构在硬件级故障（如比特翻转）下的安全性脆弱性，为模型鲁棒性评估提供了新维度。

Abstract: Mixture-of-Experts (MoE) architectures enable scalable and efficient large language models (LLMs) by selectively activating expert sub-networks through a routing mechanism. However, this adaptive design introduces a new attack surface: specific experts become disproportionately correlated with certain tokens (e.g., end-of-sequence), allowing adversaries to manipulate model behavior via lightweight perturbations. In this work, we present \textbf{Groundhog Bit-Flip Attack (GBFA)}, the first bit-flip-based \textit{ Denial-of-Wallet availability attack} against MoE-based LLMs. By identifying and flipping routing-layer bits associated with related expert activations, we demonstrate that GBFA substantially extends the decoding token usage across three different LLM modes: conversational, reasoning, and agentic tasks, while largely preserving semantic fidelity. Across four main real-world MoE-based LLMs, manually deactivating on average fewer than \textbf{4 experts} drives average output inflation to $\mathbf{5912%}$, with the majority of test samples reaching max tokens. These results reveal a robustness vulnerability of MoE architectures to bit flip, and highlight the potential of GBFA as an availability attack against LLMs.

[6] Routed Graph Handoff: Adaptive Format Selection for Multi-Agent LLM Delegation cs.CL | cs.AIPDF

Pratyay Banerjee, Ankit Chadha

TL;DR: 本文提出了路由图切换方法，用于多智能体大语言模型系统中的委托通信。该方法通过一个轻量级的路由器，为每次委托在结构化依赖图和自然语言之间进行自适应选择，以在降低通信成本的同时保持适应性推理能力。

Details

Motivation: 多智能体LLM系统通过自然语言消息进行协调，这消耗了40-60%的令牌预算。用结构化图替换可以降低成本，但在需要自适应推理的任务上会失败。因此，需要一种能兼顾效率和灵活性的通信格式选择机制。

Result: 在四个基准测试（超过1050条轨迹）上，路由系统在所有任务上都达到或超过了纯自然语言系统的性能：在τ-retail上以3.2倍压缩率提升12.7个百分点，在BrowseComp上以2.2倍压缩率提升8.7个百分点，在BFCL和AppWorld上达到同等水平。没有路由器时，纯图委托在AppWorld上会下降14.6个百分点，而路由器以近乎零成本消除了这种退化。

Insight: 核心创新是引入一个极轻量的LLM路由器（155个令牌，0.15%开销）进行实时的通信格式选择。关键洞察是，仅使用结构化图模式是不够的，必须结合一个能够理解图结构的执行器提示。此外，预言机分析揭示了额外的性能提升空间，为未来研究执行时自适应路由指明了方向。

Abstract: Multi-agent LLM systems coordinate through natural-language messages that consume 40–60% of their token budget. Replacing these with structured graphs reduces cost but fails on tasks requiring adaptive reasoning. We propose \textbf{Routed Graph Handoff}, where a lightweight LLM router (155 tokens, 0.15% overhead) selects between a typed dependency graph and natural language for each delegation. On four benchmarks (1,050+ trajectories), the routed system matches or exceeds NL-only on every task: \textbf{+12.7,pp} on $τ$-retail at 3.2$\times$ compression ($p{<}0.01$), \textbf{+8.7,pp} on BrowseComp at 2.2$\times$ compression ($p{<}0.05$), and parity on BFCL and AppWorld. Without the router, graph-only delegation regresses 14.6,pp on AppWorld; the router eliminates this at near-zero cost. A graph-aware executor prompt is required: the same schema without interpretation guidance yields no gain. An oracle analysis reveals 8.6,pp of additional headroom, motivating execution-time adaptive routing as future work.

[7] Adaptive Triggering for Bias Correction in LLM Reasoning cs.CL | cs.AIPDF

Nayoung Kim, Mickey Mancenido, Huan Liu

TL;DR: 该论文针对大语言模型（LLM）在思维链推理过程中暴露和放大人口统计偏见的问题，提出了一种自适应触发机制来进行偏见校正。该方法将干预时机决策建模为在线变点检测问题，通过累积偏差信号并仅在证据充分时注入校正，从而在避免过度干预的同时有效阻断偏见传播。

Details

Motivation: 解决思维链提示中，LLM的中间推理过程会暴露并放大人口统计刻板印象，而仅对最终答案去偏无法解决此问题。现有方法要么事后评估完整推理链，要么在预定步骤干预，未能解决何时干预的时机决策难题。

Result: 在gpt-4o-mini上，自适应黑盒触发机制在需要更少干预的情况下，恢复了大部分在固定间隔干预下损失的消歧上下文准确性，即使使用独立评判模型也成立。在六个开源模型上，白盒信号提升了所有模型在模糊项目上的准确性，但在五个模型上降低了消歧项目的准确性。

Insight: 将偏见校正的干预时机决策形式化为在线变点检测问题，并利用CUSUM统计量进行自适应触发。创新性地结合了基于模型内部概率的白盒信号和基于外部LLM评判的黑盒信号，为不同部署场景（开源与托管模型）提供了解决方案。该方法的核心在于平衡干预的及时性与必要性，避免破坏正确推理。

Abstract: Chain-of-thought prompting can expose and amplify demographic stereotypes within an LLM’s intermediate reasoning and create a failure mode that final-answer debiasing alone cannot address. Mitigating such bias during generation presents a fundamental timing problem: intervening too late allows biased reasoning to propagate, while unnecessarily intervening can disrupt otherwise correct reasoning. Existing approaches largely avoid this decision by either evaluating completed reasoning chains post hoc or intervening at predetermined steps, leaving open when a developing reasoning trajectory provides sufficient evidence to warrant correction. We formulate this decision as an online change-point detection problem. A per-step bias signal updates a CUSUM statistic and a targeted correction is injected only when accumulated evidence crosses a detector-specific threshold calibrated on held-out data. We instantiate the framework with a white-box signal derived from next-token probabilities and a black-box signal obtained from an LLM judge, enabling deployment with both open-weight and hosted models. On gpt-4o-mini adaptive black-box triggering recovers most of the disambiguated-context accuracy lost under fixed-interval intervention while requiring substantially fewer interventions. That result holds even with an independent judge. Across six open-weight models, the white-box signal improves ambiguous-item accuracy on all six but reduces disambiguated-item accuracy on five because it cannot distinguish unsupported stereotype reliance from correct, stereotype-congruent evidence.

[8] OmniPhys: A Unified Multimodal Benchmark for Physics Understanding and Generation from Chinese Educational Corpora cs.CLPDF

Hao Chen, Yumin Lin, Nadila Yushanjiang, Xin Lin, Min Zhang

TL;DR: 本文提出了OmniPhys，一个基于中国教育语料库的大规模多模态物理理解与推理基准，涵盖中学到大学水平的物理问题，包含15,246个问题和19,850张图像，并支持细粒度推理过程分析。该基准不仅评估传统理解能力，还系统评估多模态输出，特别是物理图表的生成能力。广泛评估揭示了当前多模态大语言模型在复杂推理和视觉生成方面的关键不足。

Details

Motivation: 当前多模态大语言模型在物理领域的发展因缺乏全面基准而受阻，本文旨在填补这一空白，提供一个统一的基准以促进多模态物理智能的进步。

Result: 在OmniPhys基准上的广泛评估显示，当前多模态大语言模型在复杂推理和视觉生成（如物理图表生成）方面存在显著差距，尚未达到理想水平。

Insight: 创新点在于构建了一个覆盖广泛教育阶段、支持细粒度分析（包括推理过程和知识使用）的多模态物理基准，并首次系统评估了物理图表的生成能力，为物理领域的多模态研究提供了基础资源。

Abstract: Multimodal Large Language Models (MLLMs) have demonstrated strong abilities in solving diverse visual and textual reasoning tasks. However, their development in the physics domain is significantly hindered by the lack of a comprehensive benchmark. To fill this gap, we introduce OmniPhys, a large-scale benchmark for multimodal physics understanding and reasoning, covering middle school through university-level problems from Chinese Educational Corpora. OmniPhys consists of 15,246 questions and 19,850 images, accompanied by detailed annotations that support fine-grained analysis of reasoning processes and knowledge usage. Beyond conventional evaluation, OmniPhys is a benchmark that systematically evaluates multimodal outputs in the physics domain, including models’ ability to generate structured physics diagrams, which constitute a fundamental component of authentic physics problem solving. Extensive evaluations reveal critical gaps in the capabilities of current MLLMs, especially in complex reasoning and visual generation. To address this, we release OmniPhys to serve as a foundational resource for advancing multimodal intelligence in physics and scientific domains. Codes and data are available at https://github.com/ECNU-RAIL/OmniPhys-EMNLP2026.

[9] DCGC: Draft-Conditioned Global Correction for Complex Reasoning with Masked Diffusion Models cs.CL | cs.AIPDF

Minhae Oh, Nakyung Lee, Jungwoo Lee

TL;DR: 本文提出DCGC框架，一种基于掩码扩散模型的全局修正方法，利用上游求解器生成的不完美草稿作为辅助上下文，通过动态双CFG机制分离问题分支和问题-草稿联合分支，并基于相对置信度间隙缩放草稿条件残差，以纠正大型语言模型在复杂推理任务中的错误推理轨迹。

Details

Motivation: 解决大型语言模型在自回归生成中早期错误会传播至后续推理的问题，以及缺乏对不完美推理草稿进行全局修正的有效方法。

Result: 在数学、代码和知识推理基准测试中，DCGC优于标准采样和更简单的CFG变体，并在无需真实失败标签的测试时设置中，通过修正低共识上游输出来提升全测试集准确率。

Insight: 创新点在于将掩码扩散模型用于推理修正，并引入动态双CFG机制来有效利用草稿条件信息；客观分析认为其将扩散模型的全局生成能力与条件控制相结合，为复杂推理修正提供了新思路。

Abstract: Correcting flawed reasoning traces remains a significant challenge for Large Language Models (LLMs), whose autoregressive generation can propagate early mistakes into subsequent reasoning. We introduce DCGC, a Masked Diffusion Model (MDM) framework for global correction that uses an imperfect solution draft from an upstream solver as auxiliary context. DCGC combines task-specific Supervised Fine-Tuning (SFT) with a novel inference-time mechanism called Dynamic Dual-CFG. This mechanism separates problem-only and joint problem-draft branches and scales the draft-conditioned residual using a relative confidence gap. Across math, code, and knowledge reasoning benchmarks, DCGC outperforms standard sampling and simpler CFG variants, with additional results suggesting transfer to different diffusion backbones. In test-time setting where ground-truth failure labels are unavailable, DCGC improves full test set accuracy by correcting low-consensus upstream outputs, highlighting its utility as a verifier-free global correction module for difficult reasoning instances.

[10] MathAdv: What Theorem Provers Know, Reason, Formalize, and Generalize cs.CL | cs.AI | cs.LOPDF

Jiaxin Yuan, Connor Martinez Lockhart, Xiaoyu Liu, Jiaqi Wang, Chenghao Deng

TL;DR: 论文提出了MathAdv诊断基准，涵盖13个数学领域，通过定理证明、多项选择、填空和等价变换四个任务评估模型，发现形式化是主要瓶颈、性能跨领域差异大、自然语言引导对通用LLM有益但对专用模型有碍、等价变换暴露鲁棒性不足。

Details

Motivation: 现有定理证明基准过于强调总体证明准确率，覆盖数学领域狭窄，且缺乏对等价问题表述鲁棒性的评估，因此需要更全面的诊断工具。

Result: 在MathAdv基准上的评估表明，形式化是主要瓶颈，性能在不同数学领域差异显著，自然语言引导对通用大语言模型有帮助但可能阻碍专用证明模型，且等价变换揭示了模型鲁棒性的重大局限。

Insight: 创新点在于提出了一个多任务、跨领域的诊断性基准，通过分解评估揭示了总体准确率所掩盖的模型具体能力和失败模式，强调了形式化、领域适应性和鲁棒性的重要性。

Abstract: Formal theorem proving enables machine-verifiable evaluation of mathematical reasoning, yet existing benchmarks often emphasize aggregate proof accuracy, concentrate on a narrow range of mathematics, and provide limited evidence of robustness to equivalent reformulations. We introduce MathAdv, a diagnostic benchmark spanning 13 domains across undergraduate- and graduate-level mathematics. Alongside Lean 4 theorem proving, MathAdv provides up to three auxiliary tasks: multiple-choice questions that probe mathematical knowledge, fill-in-the-blank problems that isolate informal reasoning, and expert-crafted transformations that test robustness to problem presentation. Our evaluation of contemporary theorem provers yields four findings: formalization remains a major bottleneck; performance varies substantially across mathematical domains; natural-language guidance helps general-purpose LLMs but can hinder proof-specialized models; and mathematically equivalent reformulations expose substantial robustness limitations. Together, these results show how component-wise evaluation can reveal model capabilities and failure modes that aggregate theorem-proving accuracy obscures. The dataset and evaluation scripts are available at https://github.com/margotyjx/MathAdv.git.

[11] ReliableRAG: Combating Misinformation in Retrieval-Augmented Generation via Reliability-Guided Reasoning Chains cs.CL | cs.IRPDF

Jinpu Jiang, Xuan Wu, Wenhao Song, Bo Yang, You Zhou

TL;DR: 本文提出了ReliableRAG框架，旨在解决检索增强生成（RAG）系统在多跳问答中易受检索文档中欺骗性错误信息误导的问题。该框架通过对信息片段进行细粒度可靠性评估，构建结构化三元组并量化其可靠性，然后基于可靠三元组自回归地构建鲁棒的推理链，从而过滤错误信息并生成准确答案。

Details

Motivation: 现有RAG方法在评估细粒度信息可靠性方面能力有限，容易受到与问题语义相关但事实错误的欺骗性错误信息误导，导致在多跳问答中产生错误答案。

Result: 在三个多跳问答数据集上的实验表明，ReliableRAG优于现有方法，在欺骗性错误信息注入的情况下，显著提高了RAG系统的事实可靠性和鲁棒性。

Insight: 创新点在于首次提出了一个可靠性驱动的框架，通过结合查询-三元组语义相关性和三元组可信度来量化细粒度信息可靠性，并基于此构建鲁棒的推理链以巩固可信证据。这为增强RAG系统对错误信息的抵御能力提供了新思路。

Abstract: Retrieval-Augmented Generation (RAG) has emerged as a powerful architecture for Question Answering (QA) by integrating external information into Large Language Models (LLMs). However, false, inaccurate, and misleading information in news and social media poses a serious challenge to real-world RAG systems, especially in multi-hop QA, where complex multi-step reasoning can be misled by even a single deceptive misinformation segment in the retrieved documents. Existing approaches mainly rely on implicit alignment or explicit regulation, but their limited ability to assess fine-grained information reliability makes them vulnerable to deceptive misinformation that is semantically relevant to the question yet factually incorrect, leading to erroneous answers. To address this limitation, we propose ReliableRAG, which, to the best of our knowledge, is the first reliability-driven framework that mitigates deceptive misinformation in multi-hop QA through fine-grained evaluation of individual triples. ReliableRAG first extracts information segments from source documents and represents them as structured triples. It then quantifies triple reliability by combining query-triple semantic relevance with triple credibility, retaining only the top-$K$ reliable and non-redundant triples. Based on these refined triples, ReliableRAG autoregressively constructs robust reasoning chains to consolidate trustworthy evidence and filter deceptive misinformation, producing accurate answers faithful to reliable information. Experiments on three multi-hop QA datasets show that ReliableRAG outperforms existing methods, substantially improving the factual reliability and robustness of RAG systems under deceptive misinformation injection.

[12] ClueWeaver: Reward-Guided Dual-Agent Evidence Reasoning for Compact LLMs on Literary Long Narratives cs.CLPDF

Jihao Zhu, Zhiwei Yang, Wenxiao Zhang, Junqian Zhao, Qi You

TL;DR: ClueWeaver是一个用于紧凑型本地大语言模型的双智能体证据推理框架，旨在解决长叙事文本（如小说、档案）的问答任务。它通过Finder智能体检索关键证据段落，再由Interpreter智能体基于证据生成答案和带有段落引用的解释，并利用奖励引导的强化学习优化两个智能体，以提高证据保留和答案正确性。

Details

Motivation: 解决人文学科研究中因无法使用昂贵的长上下文专有模型，而依赖紧凑本地模型处理长叙事材料时，面临的直接输入整个长上下文成本高、难以检查且容易遗漏稀疏证据的问题。

Result: 在多个长上下文叙事问答和声明验证设置上的实验表明，ClueWeaver显著提升了本地端到端语言模型的性能，同时提供了证据覆盖和段落引用的推理轨迹。

Insight: 创新点在于将证据检索与答案推理解耦为两个可检查的智能体，并通过针对证据保留、忠实引用和答案正确性等不同目标的奖励机制进行强化学习优化，使得紧凑模型在长叙事任务上更可靠和可解释。

Abstract: Humanities and social science research requires close reading of long narrative materials such as novels, scripts, archives, and case reports, yet many users have limited access to costly proprietary long-context models. Compact, locally deployable language models are a practical alternative, but directly feeding them an entire long context remains costly, hard to inspect, and prone to missing sparse evidence. We present ClueWeaver, an evidence-aware dual-agent framework for long-narrative question answering with compact local models. A Finder identifies passages containing answer-critical clues through retrieval-guided segmentation, while an Interpreter derives the answer from the selected evidence, produces rationales with paragraph-ID citations, and applies an internal self-calibration pass for high-risk questions. Both agents are optimized with reward-guided reinforcement learning: Finder rewards emphasize evidence retention and faithful paragraph-ID references, and Interpreter rewards emphasize correctness, grounding, and concise explanations. This decomposition makes evidence selection and reasoning more inspectable than end-to-end prompting. Experiments across multiple long-context narrative question answering and claim verification settings show that ClueWeaver substantially improves local end-to-end language models while providing evidence coverage and paragraph-referenced reasoning traces. Code is available at https://github.com/Ameame1/ClueWeaver.

[13] EgoArgus: Benchmarking VLMs as Situational Assistants for Modality-Grounded User Supports cs.CLPDF

Yu-Chien Tang, Yu-Hsiang Liu, An-Zi Yen

TL;DR: 本文提出了EgoArgus基准，用于评估视觉语言模型（VLMs）作为第一人称视角（egocentric）日常情境助手的能力。该基准包含五个日常对话-视频场景，要求模型在视觉证据与用户语言信息存在帮助、无关或冲突时，进行理解与决策。实验表明，当前VLMs作为可靠的第一人称助手仍面临挑战，现有缓解模态偏见的方法提升效果有限。

Details

Motivation: 现有第一人称基准主要孤立评估视觉理解能力，未能测试模型在视觉证据与用户语言信息（可能有用、无关或冲突）并存时，如何进行仲裁与决策。

Result: 在EgoArgus基准上的实验结果表明，当前VLMs作为可靠的第一人称助手表现仍具挑战性；现有缓解模态偏见的方法对性能提升相当有限。

Insight: 论文的创新点在于构建了一个关注多模态（视觉与语言）信息仲裁与决策的第一人称助手评估基准EgoArgus，揭示了当前VLMs在判断信息可信度与决定何时干预方面的核心难点，为实际部署提供了重要见解。

Abstract: VLMs are increasingly positioned as daily assistants that perceive first-person environments, follow user dialogue, and decide how to help. Existing egocentric benchmarks mainly evaluate visual understanding in isolation, leaving open whether models can arbitrate between visual evidence and user-provided language when the two are helpful, irrelevant, or conflicting. We introduce EgoArgus, a human-annotated dataset for evaluating egocentric assistants on understanding and decision tasks in five dialogue-video daily scenarios. Our results demonstrate that it is still challenging for current VLMs as reliable egocentric assistants, which requires identifying which modality is trustworthy and deciding when intervention is warranted. Deeper analysis also shows that existing modality bias mitigation methods are quite restricted to enhance performance, providing insights to aid practioners into the deployment of current VLMs as daily assistants.

[14] GRIP: Granular Reward-Guided Parameter Interpolation for Efficient Reasoning cs.CLPDF

Lam So, Canhui Wu, Han Lin

TL;DR: 本文提出GRIP框架，通过可学习的模块级参数插值融合推理模型与指令模型的优势，在保持高准确率的同时提升推理效率。该方法仅优化插值权重而不更新源模型参数，利用奖励信号同时优化答案正确性与简洁性。

Details

Motivation: 针对推理大模型生成冗长思维链导致推理成本高、延迟大，而指令调优模型虽简洁但推理能力不足的问题，旨在轻量化结合两者优势而无需全模型重训练。

Result: 实验表明GRIP在准确率-效率权衡上优于固定或基于搜索的基线方法，并在模块级融合模式上揭示了高效推理的关联规律。

Insight: 创新点在于模块粒度的可学习参数插值机制与奖励驱动的双目标优化，为模型融合提供了轻量且可解释的设计思路。

Abstract: Reasoning-oriented large language models often achieve strong problem-solving performance by generating long chains of thought, but this behavior substantially increases inference cost and latency. In contrast, instruction-tuned models tend to answer more concisely, yet often lack comparable reasoning ability. This accuracy-efficiency mismatch motivates a lightweight approach that combines the strengths of both models without full model retraining. In this paper, we propose GRIP (Granular Reward-guided Interpolation of Parameters), a reward-guided parameter interpolation framework for efficient reasoning. Given a reasoning model and an instruction model with identical architectures, GRIP assigns learnable interpolation ratios to individual modules and optimizes only these ratios while keeping both source models frozen. The interpolation ratios are trained with a reward signal that favors responses that are both correct and concise. Experiments show that GRIP achieves a better accuracy-efficiency trade-off than fixed or search-based merging baselines and further reveals module-wise fusion patterns associated with efficient reasoning.

[15] AutoVerifier: Residual-Guided Non-Parametric Optimization for Reference-Based Answer Verification cs.CLPDF

Zebei Zhao, Zhihao Shi, Minqi Shi

TL;DR: AutoVerifier是一种基于残差引导的非参数优化方法，用于提升基于参考的答案验证器性能。该方法通过从重复的验证错误中学习验证器的归纳偏置，并将其记录在规则卡片中，经过回放验证后提升为代码模块或提示指导，从而在保持更新可审计、可编辑和可重用的同时提高验证准确性。

Details

Motivation: 现有基于参考的验证器在处理不同答案形式（如$1+3.14$和$1+π$）的等价性时，其判断可能依赖于问题和评分标准，这些隐含假设构成了验证器的归纳偏置，而传统方法难以有效学习这些偏置以提高验证精度。

Result: 在四个验证器基准测试上的实验表明，AutoVerifier大幅优于当前最先进的验证器。

Insight: 创新点在于提出了一种残差引导的非参数优化框架，能够从验证错误中自动学习并编码归纳偏置，通过规则卡片和回放验证机制确保更新的可靠性和可维护性，为验证器的自适应优化提供了新思路。

Abstract: Reference-based verifiers are important for evaluating reasoning models and providing accurate outcome rewards in reinforcement learning with verifiable rewards. To improve verification accuracy, prior work has explored rule-based, model-based, and tool-augmented verifiers for checking answer equivalence across diverse answer forms. However, the equivalence of answer forms such as $1+3.14$ and $1+π$ may depend on the question and scoring criterion. We frame such implicit assumptions as verifier inductive biases. To address this challenge, we propose AutoVerifier, a residual-guided non-parametric optimization method that learns these biases from recurring verifier errors. Specifically, AutoVerifier records these biases in rule cards and promotes them to code modules or prompt guidance only after replay validation detects no direct regressions, keeping accepted updates auditable, editable, and reusable. Experiments on four verifier benchmarks demonstrate that AutoVerifier outperforms state-of-the-art verifiers by a large margin.

[16] AWM: Answerable Working Memory for Long-Document VQA Agents cs.CLPDF

Dongzhuoran Zhou, Yuqicheng Zhu, Yule Liu, Zhen Yang, Rui Lu

TL;DR: 本文针对长文档视觉问答中VLM智能体工作记忆质量评估的盲点，提出了‘仅记忆可答性’诊断指标和‘可答工作记忆’方法。该方法将智能体最终工作记忆视为可回答的证据产物，并通过AWM-GRPO算法将其融入强化学习奖励，在提升最终答案准确率的同时，确保工作记忆本身包含足够的支持证据。

Details

Motivation: 现有长文档VQA评估主要关注最终答案正确性和证据页面访问，忽略了工作记忆的质量问题：智能体可能访问正确页面并给出正确答案，但其工作记忆却过于笼统或不完整，一旦移除页面上下文便无法支持回答。

Result: 在MMLongBench-Doc和LongDocURL基准测试上，AWM-GRPO相比RAG基线分别将最终答案准确率提升了8.1和11.9个百分点，并将‘记忆缺失正确’率比仅答案GRPO降低了2.7个百分点。实验发现，即使提供黄金证据页面，42.5%的正确答案也无法仅从最终工作记忆中得出。

Insight: 创新性地提出了‘仅记忆可答性’这一诊断性评估维度，将工作记忆本身的质量作为可优化的目标；设计了AWM-GRPO方法，在GRPO强化学习框架中引入基于记忆可答性的奖励信号，实现了在优先保证最终答案正确性的前提下，同步优化工作记忆的证据支持能力。

Abstract: Long-document visual question answering increasingly relies on VLM agents that retrieve candidate pages, inspect page images, write findings to working memory, and synthesize answers. Working memory should carry answer-supporting evidence across page inspections for later grounded answering, yet existing evaluation mainly checks final-answer correctness and evidence-page access. This creates a memory-quality blind spot: an agent may reach the right page and answer correctly while leaving behind memory too generic or incomplete to support answering once page context is removed. We introduce \emph{memory-only answerability}, a diagnostic that asks whether a reader can answer from the question and terminal working memory alone. Building on this diagnostic, \emph{Answerable Working Memory} (AWM) treats terminal working memory as an answerable evidence artifact, and AWM-GRPO incorporates this signal into the GRPO reward while preserving final-answer priority. Under GRPO, this reward assigns higher advantages to answer-correct trajectories whose terminal working memory remains answerable. On \textsc{MMLongBench-Doc}, even when gold evidence pages are provided, 42.5% of correct answers still cannot be answered from terminal working memory alone. AWM-GRPO improves final-answer accuracy over the RAG baseline by 8.1 and 11.9 points on \textsc{MMLongBench-Doc} and \textsc{LongDocURL} and reduces the memory-missing-correct rate by 2.7 points over answer-only GRPO.

[17] Think-Probe-Respond: Improving Large Language Models as Judges of Research Idea Novelty cs.CL | cs.AIPDF

Tim Schopf, Tobias Schreieder, Akiko Aizawa

TL;DR: 本文提出Think-Probe-Respond（TPR）方法，旨在解决大语言模型作为研究想法新颖性评判者时存在的系统性偏差问题。该方法通过从推理阶段的隐藏状态中探测潜在的新颖性判断，并以此调节最终响应，从而显著提升评判性能。

Details

Motivation: 大语言模型在自动化新颖性评判任务中，其生成的推理依据与人类专家高度相似，但最终的新颖性判断却常常出现显著偏差。研究发现这种误校准源于模型倾向于将想法判断为“中等新颖”的系统性偏差。

Result: 在多个强基线模型上，TPR方法将新颖性判断性能提升了22.30%，并成功缓解了普遍的“中等新颖性”偏差。

Insight: 创新点在于提出了一种轻量级的TPR框架，通过探测推理过程中的隐藏状态来获取更准确的内在判断，并以此引导最终输出，从而校准模型偏差，这为提升大语言模型在细粒度评估任务中的可靠性提供了新思路。

Abstract: Automated novelty judgment can accelerate scientific discovery by enabling efficient evaluation, refinement, and comparison of research ideas. While large language models are increasingly adopted for this task, we investigate a previously overlooked limitation in their judgment capabilities: despite generating reasoning rationales that closely mirror those of human experts, their final novelty judgments often diverge substantially. We demonstrate that this miscalibration stems from a systematic bias towards judging ideas as “medium novel”. To mitigate this, we propose Think-Probe-Respond (TPR), a lightweight approach that probes latent novelty judgments from hidden states during the reasoning phase and uses the probed judgments to condition the final response. Across strong baselines, TPR improves novelty judgment performance by 22.30% and successfully mitigates the prevalent “medium novelty” bias.

[18] Overview of SHROOM-Visions 2026: A Shared Task on Hallucination Detection in Large Vision-Language Models cs.CLPDF

Raúl Vázquez, Aman Sinha, Chuyuan Li, Claudio Savelli, Eduardo Calò

TL;DR: SHROOM-Visions 2026是第四届SHROOM共享任务，专注于大型视觉语言模型（LVLMs）中的幻觉检测。该任务基于SHEEP数据集，要求参与者对图像条件文本生成（如VQA、图像描述）中的细粒度幻觉跨度进行检测和分类，评估涵盖中文、英文、法文和意大利文四种语言。共有27个团队提交了600多份系统，最佳系统在字符级相关性、标签条件相关性和IoU指标上平均得分分别为0.58、0.46和0.51，显著超越基线30-40个百分点。

Details

Motivation: 该任务旨在解决大型视觉语言模型在图像条件文本生成中产生的幻觉问题，通过一个模型无关的检测任务来应对这一挑战，延续了2024和2025年SHROOM系列的成功。

Result: 最佳系统在四种语言上的平均字符级相关性得分为0.58，标签条件相关性为0.46，IoU为0.51，比基线提高了30-40个百分点，在SHROOM-Visions 2026共享任务中达到了当前最先进水平。

Insight: 创新点包括使用SHEEP数据集进行长期跨模型评估，以及引入细粒度幻觉跨度检测和五类分类法，支持多语言评估，这为幻觉检测提供了更系统化和可扩展的框架。

Abstract: In 2026, we held the fourth iteration of the SHROOM Shared Task series: SHROOM-Visions (\textbf{S}hared-task on \textbf{H}allucinations and \textbf{R}elated \textbf{O}bservable \textbf{O}vergeneration \textbf{M}istakes in \textbf{Vision} language model\textbf{s}), which is hosted at the UncertaiNLP Workshop co-located with EMNLP 2026. Following the success of the 2024 and 2025 tasks, this time we aim to tackle hallucinations through a model-agnostic detection task focused on large vision-language models. Building on the recently introduced SHEEP dataset, designed for long-term evaluation across model generations, the task invites participants to detect and classify fine-grained hallucination spans in image-conditioned text generation (VQA, image captioning, etc.). The evaluation uses a five-class taxonomy of hallucinations spanning four languages: Chinese, English, French, and Italian. The shared task generated strong interest in the NLP community worldwide, with 27 teams contributing 600+ system submissions. The best systems achieve average scores of 0.58 in character-level correlation, 0.46 in label-conditioned correlation, and 0.51 in intersection-over-union (IoU) across four languages, outperforming the baselines by 30-40 points.

[19] Learning New Facts with QLoRA: An Acquisition-Retention Frontier cs.CL | cs.AI | cs.LGPDF

Estelle Zheng, Sébastien Warichet, Emmanuel Helbert, Christophe Cerisara

TL;DR: 本文研究了参数高效微调（PEFT）在保持预训练能力与学习新事实之间的权衡，特别关注QLoRA的秩（rank）大小对性能的影响。通过在OpenStreetMap地理关联任务和数学任务上的实验，发现低秩QLoRA能较好地保留预训练模型的通用能力（OOD性能），但学习新事实的能力较弱；而高秩QLoRA能更好地学习新事实，但会以牺牲无关任务的性能为代价，形成一种获取-保留的权衡边界。

Details

Motivation: 参数高效微调通常被认为能保持预训练能力，因为它只更新少量参数。本文旨在验证这一假设是否成立，并探究微调方法（特别是QLoRA的秩）在模型学习新事实与保留原有能力之间的具体影响。

Result: 在OpenStreetMap地理关联基准测试中，低秩（如秩8）QLoRA能较好地保留无关任务（OOD）的性能，但学习新事实的能力较弱；高秩（如秩64）QLoRA能更好地学习新事实并提升对同义转述的泛化能力，但会损害无关任务的性能。全微调（FFT）则表现为一个保守的基线，保留通用能力较好，但未达到最高的事实获取水平。在数学任务上，这种权衡边界较弱。

Insight: 论文的核心创新点在于揭示了参数高效微调（如QLoRA）并非总能完美保持预训练能力，其秩的大小在模型的能力获取（学习新事实）与保留（保持原有技能）之间形成了一个清晰的权衡边界。这对于理解和设计微调策略，特别是在需要模型学习与预训练数据差异较大的新知识时，具有重要的指导意义。

Abstract: Parameter-efficient fine-tuning is often assumed to preserve pretrained capabilities because it updates only a small number of parameters. We show that this assumption depends strongly on adapter capacity. We study factual acquisition in a controlled OpenStreetMap-derived benchmark where Qwen3-4B must acquire anonymized geographic associations while retaining unrelated capabilities. Comparing full fine-tuning (FFT) with quantized low-rank adaptation (QLoRA) at ranks 8, 16, 32, and 64, we find that rank induces a clear acquisition–retention frontier. Low-rank QLoRA preserves out-of-domain (OOD) performance but acquires fewer facts, whereas higher ranks improve same-fact paraphrase generalization at an increasing cost in performance on unrelated benchmarks. FFT behaves as a conservative baseline: it retains general capabilities well, but does not reach the highest factual-acquisition regime. Distributional, weight-space, and spectral diagnostics mirror this behavioral trade-off, with higher-rank QLoRA moving farther from the pretrained model. A separate math adaptation experiment shows a weaker frontier, suggesting that the effect is most pronounced when adaptation must install new factual associations rather than reinforce skills already supported by pretraining. Code and data are available at https://github.com/zhngstl/new_facts_forgetting.

[20] Unfolding Scientific Papers into Multi-Turn Generation Trajectories for Continued Pre-Training cs.CL | cs.AI | cs.LGPDF

Qiankai Xu, Qiguang Chen, Zixin Su, Wenhao Huang, Yue Gao

TL;DR: 本文提出了一种将科学论文展开为多轮生成轨迹的流程，用于构建持续预训练（CPT）语料库。该流程通过教师模型重构整篇论文的写作过程（包括写作请求、全局计划和各章节的预写作思考），生成包含原始论文文本的轨迹。该语料库规模约为源文本的两倍，并可用于创建指令微调数据集和学术写作基准PAW-Bench。实验表明，基于该语料库的CPT结合公开数据集的监督微调能广泛提升写作能力，同时保持通用推理并改善长文档阅读。

Details

Motivation: 现有合成数据方法主要处理短文本片段，仅恢复局部思考，且未触及整个文档的结构。科学论文具有清晰统一的结构，为将此类范式提升到文档级别提供了自然基础。

Result: 在arXiv论文上应用该流程，构建了规模约为源文本两倍的CPT语料库。CPT结合公开数据集的监督微调能提升写作基准性能，同时保持通用推理和长文档阅读能力；即使所有模型都在专用写作SFT数据集上微调，写作增益依然存在。混合本文的SFT数据能进一步提升学术写作。

Insight: 创新点在于将科学论文展开为多轮生成轨迹，以重构文档级写作过程，这扩展了合成数据范式到长文档。该方法不仅能生成CPT数据，还能衍生出SFT数据集和带有评估标准的写作基准（PAW-Bench），为提升模型写作能力提供了系统化解决方案。

Abstract: A recent line of synthetic-data work reconstructs the thinking behind existing text rather than rewriting the text itself, but it operates on short web passages, recovers only local thoughts, and leaves the structure of whole documents untouched. Scientific papers are written to a clear and largely uniform structure and make a natural substrate for lifting this paradigm to the document level. We present a pipeline that unfolds each paper into a multi-turn generation trajectory in which a teacher model reconstructs the writing process of the whole paper: a writing request, a global plan, and pre-writing deliberation for each section. All section texts and the abstract are kept verbatim from the source paper. We apply the pipeline to quality-filtered arXiv papers and obtain a corpus for continued pre-training (CPT) that is roughly twice the size of the source text. The same reverse construction extends to instruction data and evaluation. Treating real paper text as the answer yields an SFT dataset. Anchoring tasks in held-out papers yields PAW-Bench, an academic-writing benchmark whose tasks carry their own rubrics and checklists. In controlled experiments CPT on our corpus followed by supervised fine-tuning on public datasets improves writing benchmarks broadly while preserving general reasoning and improving long-document reading. The writing gain persists even when every model is fine-tuned on a dedicated writing SFT dataset. Mixing our SFT data into that recipe lifts academic writing further.

[21] Skill Issue: Are Skills Language-Invariant in LLMs? cs.CL | cs.AI | cs.GT | cs.LGPDF

Bobby Cheng, Adam Gaber, Zhengyuan Liu, Catherine Arnett, Omer Goldman

TL;DR: 这篇论文通过多语言自博弈实验，量化了大型语言模型在不同语言中技能表现的不一致性。研究发现，同一模型在不同语言界面下进行基于文本的游戏时，其获胜率、无效操作和策略倾向存在系统性差异，表明语言选择直接影响模型的决策过程和执行能力。

Details

Motivation: 动机是探究大型语言模型在不同语言中的技能表现是否一致，旨在隔离语言因素对模型行为的影响，从而识别和量化跨语言技能差异这一阻碍真正多语言模型发展的关键问题。

Result: 在TextArena的多语言扩展环境中，评估了三个开源模型在八种语言和六种游戏（涵盖空间推理、不完全信息、资源分配和重复交互）上的表现。结果显示，模型在不同语言中的游戏强度存在显著差异，包括胜败差距、无效操作和策略倾向的系统性变化。

Insight: 创新点在于提出多语言自博弈框架来正交地量化技能不一致性，独立于知识和基准性能；关键发现是仅改变中间推理语言就能恢复大部分性能损失，表明语言影响决策过程的不同阶段，这为设计更公平的多语言模型提供了新视角。

Abstract: Large language models access knowledge inconsistently across languages, but to what extent do they differ in their skill sets when interacting with different languages? This work quantifies cross-lingual skill inconsistency orthogonally from knowledge and general benchmark performance. We do this via multilingual self-play: two instances of the same model compete in a text-based game, each interacting through a different language interface. Since the model, opponent, rules, state space, and available actions remain fixed, this setting isolates the effect of language on the model’s realized behavior. We build a multilingual extension to TextArena and evaluate three open-weight models across eight languages and six games covering spatial reasoning, imperfect information, resource allocation, and repeated interaction. We find that the same model can exhibit markedly different playing strength across languages, with systematic variation in win–loss margins, invalid actions, and strategic tendencies. Detailed analyses reveal language-specific failures in spatial reasoning, card-conditioned decisions, and optimal move selection. In some settings, changing only the intermediate reasoning language recovers much of the lost performance, suggesting that language can affect different stages of the decision process. These results show that skill discrepancies are a measurable major roadblock in the development of truly multilingual models. Better understanding these discrepancies can help us design models that perform more equitably across languages.

[22] Anchoring Bias in LLM-as-a-Judge Systems: Prior Scores Compromise Evaluation Independence cs.CLPDF

Ante Kapetanovic, Kemal Altwlkany, Andro Mercep, Tomislav Duricic, Emanuel Lacic

TL;DR: 该论文研究了LLM-as-a-Judge系统中存在的锚定偏差问题，发现即使仅作为上下文元数据提供的先前评分也会显著影响LLM的后续评估，导致评分向锚定值偏移，并影响分类决策的准确性。

Details

Motivation: 动机在于验证LLM-as-a-Judge系统中每个判断是否独立于先前评估的假设，揭示元数据（特别是先前评分）如何引入系统性偏差，从而影响评估的可靠性。

Result: 在192,000次评估尝试中，八个模型中的七个显示出锚定元数据对20个固定文本的评分有显著负向影响（95%置信区间低于零），Cohen’s d绝对值达0.71；在行业分类数据上，锚定元数据阻止了48%的错误修正，并将10.18%的正确判断翻转为错误标签。

Insight: 创新点在于通过实验揭示了LLM评估中先前评分作为锚定偏差的来源，并证明思维链和忽视元数据警告等常见方法无法有效缓解该偏差，强调了针对特定模型和任务进行上下文工程验证的重要性。

Abstract: Large language models (LLMs) increasingly assess generated content, giving rise to the LLM-as-a-Judge paradigm. These systems now score outputs, filter content, and gate iterative refinement in production pipelines, where each judgment is often assumed to be independent of earlier evaluations. We test this assumption using three prompt conditions: no metadata, revision framing, and anchored metadata containing revision, attempt, and prior-score fields. We show that prior scores, even when included only as context metadata, anchor judgments and systematically shift ratings toward their values. Across 192,000 attempted evaluations (185,271 successful), seven out of the eight evaluated models have 95% task-stratified bootstrap intervals below zero for the total anchored-metadata effect on 20 fixed texts. Cohen’s $d$, a standardized measure of the difference between score distributions, reaches an absolute value of 0.71. Token-level analysis of selected model-task probes suggests a threshold-like response pattern: introducing anchored metadata produces a marked redistribution of output-score probabilities, while changing the anchor value within the tested below-threshold range produces comparatively little additional variation. On categorical industry data with human-labeled ground truth, anchored metadata blocks 48% of error corrections and flips 10.18% of correct judgments toward an assigned wrong label, demonstrating the bias extends beyond numerical scoring to categorical decisions. Neither Chain-of-Thought nor a metadata-disregard warning reduces the total effect, although the warning improves the paired accuracy effect relative to baseline in the industry experiment. Reliable LLM evaluation demands careful context engineering rather than an assumption of impartiality. Effective mitigation must be validated for the intended model and task or domain.

[23] From Passive Response to Proactive Correction: Enhancing LLM Robustness Against Input Fact Perturbations cs.CLPDF

Ping Wang, Xiangguo Sun, Bingbing Xu, Guocong Li, Xiaofeng Meng

TL;DR: 本文提出DEDUCE框架，旨在增强大语言模型对输入中事实扰动的鲁棒性。该框架通过检测、规划和纠正三个阶段，使模型从被动响应转变为主动纠错。实验在TruthfulQA、FalseQA和自建的MisFactQA数据集上验证了其有效性。

Details

Motivation: 现有缓解幻觉的方法通常假设用户输入可靠，忽略了输入中的事实错误会主动误导模型推理。本文旨在解决大语言模型在面对包含误导性前提的输入时，容易产生自信但事实错误回答的脆弱性问题。

Result: 在TruthfulQA、FalseQA和自建的MisFactQA基准测试上，DEDUCE显著提高了模型的准确性和纠错能力。在Qwen、LLaMA和Gemma系列模型上均取得了一致的性能提升，证明了其有效性和可扩展性。

Insight: 核心创新在于将模型角色从被动响应者转变为主动纠错者，提出了一个包含检测、规划、纠正的三阶段框架。同时，构建了包含不同程度事实错误的MisFactQA数据集，并提出了新的评估指标来衡量模型鲁棒性。

Abstract: Large language models (LLMs) frequently produce confident yet factually incorrect responses when user inputs contain misleading premises, a phenomenon we attribute to fact perturbations in the input. Existing approaches to hallucination mitigation typically assume reliable user inputs, overlooking how such factual errors can actively mislead model reasoning. To address this vulnerability, we propose DEDUCE, a three-stage framework that transforms LLMs from passive responders into proactive error correctors. DEDUCE operates in three stages: (1) detect errors through fine-grained fact extraction and verification; (2) devise correction strategies via multi perspective deliberation; and (3) correct misconceptions while delivering reliable answers. We also present MisFactQA, a dataset containing factual errors of varying degrees, and propose new metrics for evaluating model robustness. Experiments on TruthfulQA, FalseQA, and our MisFactQA benchmark demonstrate that DEDUCE significantly improves both accuracy and error correction capability. Consistent gains across Qwen, LLaMA, and Gemma families confirm its effectiveness and scalability.

[24] Query-Side Attacks on GNN-Based KGQA: Tracing Failures from Entity Linking to Answer Generation cs.CL | cs.AI | cs.IRPDF

Pankaj Kumar, Subhankar Mishra

TL;DR: 该论文研究了基于图神经网络的知识图谱问答系统在输入问题遭受对抗性扰动时的脆弱性，并提出了一个阶段隔离评估协议。研究发现，端到端性能下降的主要根源在于子图构建阶段，而非GNN推理阶段，揭示了答案存在性与答案可达性之间的关键区别。

Details

Motivation: 现有鲁棒性评估将KGQA管道各阶段的失败混为一谈，无法定位脆弱性来源和缓解目标。论文旨在探究当输入问题受到对抗性扰动时，具体哪个阶段会失败及其原因。

Result: 在ComplexWebQuestions和WebQSP基准上的评估结果表明，在保持子图完整时，GNN推理阶段准确率接近基线；而在组合重构扰动下，超过99%的端到端性能崩溃源于子图构建阶段，即使74%的检索子图中包含正确答案。

Insight: 论文的创新点在于提出了两种针对特定阶段的答案保持性对抗扰动（组合重构和关系同义词替换）以及阶段隔离评估协议，客观揭示了子图构建是KGQA鲁棒性的关键瓶颈，并强调了答案可达性这一被端到端指标忽略的核心概念。

Abstract: GNN-based Knowledge Graph Question Answering (KGQA) pipelines process queries through four discrete stages: entity linking, subgraph retrieval, GNN reasoning, and answer generation. Standard robustness evaluations conflate stage-level failures into a single end-to-end metric, obscuring both the source of brittleness and the appropriate mitigation target. We ask which stage fails, and why, when the pipeline is subjected to adversarial perturbations on the input question. We introduce a stage-isolation protocol with two answer-preserving adversarial perturbations verified against the knowledge graph: Compositional Restructuring (CR) and Relation Synonym Swap (RS) target distinct stages while leaving entity seeds intact. Evaluated across ComplexWebQuestions and WebQSP, the results run counter to prevailing assumptions: the GNN reasoning stage retains near-baseline accuracy when the subgraph is intact, while subgraph construction accounts for over 99% of the end-to-end collapse under CR, occurring even when the gold answer is present in 74% of retrieved subgraphs. This exposes a fundamental distinction between answer presence and answer reachability that end-to-end metrics cannot detect, and places the mitigation target firmly at the subgraph construction stage rather than the reasoning model. Perturbed datasets and evaluation infrastructure are released at https://anonymous.4open.science/r/atkgrag-E85C .

[25] VISA: Agentic Self-Evolving Data Synthesis for Multimodal Instruction Following cs.CLPDF

Min Zeng, Guanxin Tan, Libin Cen, Yawei Wen, Rui Hu

TL;DR: 本文提出了VISA（Visual Instruction Synthesis Agent），一种用于多模态指令跟随数据合成的智能体框架，它将数据合成重新定义为自我演进的循环过程。该框架通过分析图像、采样约束、生成候选指令、使用工具和大型语言模型进行验证，并对失败样本进行诊断恢复，从而迭代地提升数据质量。

Details

Motivation: 现有的一步生成-过滤式多模态指令数据合成流程会丢弃失败样本、验证器结果和目标模型错误等反馈信息，导致数据在准确性、多样性、可验证性和挑战性方面存在不足。

Result: 在MM-IFEval基准测试上的实验表明，VISA持续提升了多模态指令跟随能力，优于多个强基线模型，同时在七个公开基准上保持了通用的多模态能力。

Insight: 核心创新在于将数据合成构建为一个自我演进的智能体循环，利用验证信号和目标模型失败信息动态更新记忆，自适应扩展约束空间并聚焦于未解决的模型弱点，同时验证器合约可直接为强化学习提供奖励信号，无需单独训练奖励模型。

Abstract: Multimodal instruction-following models require training data that is accurate, diverse, verifiable, and challenging. Existing synthesis pipelines typically follow a one-pass generate-and-filter paradigm, discarding feedback from failed samples, verifier outcomes, and target-model errors. We present VISA (Visual Instruction Synthesis Agent), an agentic framework that reformulates multimodal instruction synthesis as a self-evolving loop. At each round, VISA analyzes an image to filter incompatible constraints and discover new verifiable ones, samples diversity- and difficulty-aware constraint sets from persistent memory, generates candidate instructions, and verifies the resulting samples with executable tools and structured large language model judges. Failed samples trigger diagnostic-guided recovery, while accepted samples are probed against the target model to estimate difficulty. The resulting verifier signals and target-model failure profiles are written back to memory, allowing subsequent rounds to adaptively expand the constraint space, reduce template repetition, and focus on unresolved model weaknesses. The same verifier contracts further provide reward signals for reinforcement learning without a separately trained reward model. Experiments on MM-IFEval show that VISA consistently improves multimodal instruction following over strong baselines, while preserving general multimodal capability across seven public benchmarks.

[26] Beyond Local Surprise: Grounded Dialogue as Selective Belief Revision under Referential Uncertainty cs.CLPDF

Ziming Liu, Bhanu Chaitanya Jasti, Ziyang Xu, Hongyu Wu, Yi Wu

TL;DR: 本文提出了一种数据驱动的框架，用于研究对话中听者在面对指代不确定性时如何选择保持或修正其当前理解。通过比较四种理论驱动的修正策略，研究发现基于局部不匹配的更新策略会破坏对话的稳定性，而一种对不确定性敏感的、基于累积证据的策略则能在保持强检索性能的同时维持连贯的理解。

Details

Motivation: 解决在对话中，当说话者提及听者无法直接看到的场景时，听者如何基于连续到来的话语，决定是保持现有理解还是修正它的问题。动机在于探究对话理解是否比单纯依赖局部不匹配信号更为保守。

Result: 在受控的数据驱动框架下比较了四种修正策略。结果表明，对不确定性敏感的修正策略（结合局部不匹配和累积证据）在保持强检索性能方面表现最佳，而仅基于局部不匹配的策略会损害对话的稳定性和检索效果。

Insight: 论文的创新点在于提出了一个用于系统研究对话中信念修正策略的对比框架。一个关键的、反直觉的发现是：局部不匹配反而促进理解保持，而累积的不确定性才触发修正，这与概念契约理论一致，为构建更稳健的对话系统提供了新视角。

Abstract: When a speaker refers to a scene that the listener cannot directly see, the listener must decide whether to preserve its current understanding or revise it as new utterances arrive. Many language systems treat local mismatch as a cue for updating: divergence from the current understanding encourages adjustment. Yet conversational understanding may be more conservative, interpreting mismatching evidence relative to prior understanding rather than immediately revising it. We introduce a controlled, data-driven framework for turn-by-turn preserve/revise decisions in dialogue, where competing revision policies are learned under otherwise identical conditions. We compare four theory-driven revision strategies, each reflecting a different assumption about when listeners should preserve or revise. Two findings stand out. First, a mismatch-driven policy that updates solely based on local divergence reacts strongly to mismatch but destabilizes grounding and degrades retrieval. Second, an uncertainty-sensitive policy extends mismatch-based updating with accumulated evidence, preserving coherent understanding while maintaining strong retrieval performance. Surprisingly, coherent understanding emerges from a counterintuitive pattern: local mismatch promotes preservation, whereas accumulated uncertainty promotes revision, suggesting that listeners maintain prior understanding despite local mismatch and revise only when uncertainty sufficiently accumulates. This pattern is consistent with conceptual pact theory.

[27] Prefix Sliding for efficient test-time scaling cs.CL | cs.AI | cs.LGPDF

Niklas Muennighoff, Zhengyang Wang, Zeyi Chen, Weijia Shi, Binyuan Hui

TL;DR: 本文提出了一种名为Prefix Sliding的新方法，用于解决测试时扩展（test-time scaling）中因长推理轨迹导致内存消耗过高的问题。该方法通过在推理过程中动态丢弃不重要的中间令牌，仅保留关键的前缀指令和最近生成的令牌窗口，从而将内存需求限制在固定范围内，实现高效的长序列推理。

Details

Motivation: 动机在于，测试时扩展（如让语言模型进行更长时间的推理）虽然能提升性能，但会因注意力机制需要存储完整的推理轨迹而导致内存开销巨大，尤其对于需要长序列思考的复杂任务。作者观察到大多数中间推理令牌的重要性会随时间衰减，因此质疑保留它们的必要性。

Result: 实验表明，无需额外训练，Prefix Sliding能使现有模型推理速度提升3倍且性能保持不变；若结合强化学习进行训练，该方法能支持超过十万令牌的推理轨迹，并获得更好的性能。消融研究显示，Prefix Sliding优于对中间令牌进行摘要或使用普通滑动窗口的方法。

Insight: 核心创新点在于提出了Prefix Sliding机制，它结合了固定前缀（包含关键指令和工具）与动态滑动窗口（保留最近的关键推理令牌），从而在保证性能的同时，将长序列推理的内存复杂度从线性降低为常数。这为高效的大规模测试时计算扩展提供了新思路。

Abstract: Test-time scaling uses extra test-time compute to improve performance, such as letting language models reason longer when solving a problem. As models keep the entire reasoning trace in memory via full attention, hard tasks that need long thinking can be prohibitively expensive. However, we find most intermediate reasoning tokens lose importance as the model continues reasoning. This calls into question whether retaining them is worth the cost. Based on this insight, we propose Prefix Sliding, which discards tokens during reasoning that are not part of the prefix or the window of the last few thousand tokens. The prefix has key instructions and tools available to the model, while the most recent tokens are the current reasoning the model is working on. This caps the total memory requirement regardless of how long the model reasons, allowing for efficient long-horizon test-time scaling. Without training, Prefix Sliding can make existing models 3x faster while maintaining performance. Training with Prefix Sliding using reinforcement learning can achieve better performance by enabling scaling to reasoning traces beyond a hundred thousand tokens. Ablations show Prefix Sliding outperforms summarizing intermediate tokens or vanilla sliding window. Our code is at https://github.com/Muennighoff/prefix-sliding

cs.CV [Back]

[28] Fusing Perceptual Vision Experts with Multimodal Large Language Models for Explainable Plant Disease Diagnosis: From Benchmark Imagery to Real-World Robotic Field Validation cs.CV | cs.AIPDF

Ranjan Sapkota, Konstantinos I. Roumeliotis, Pengyao Xie, Nikolaos D. Tselikas, Lirong Xiang

TL;DR: 本文提出了一个名为H²MAF的混合分层多智能体框架，用于可解释的植物病害诊断。该框架结合了EfficientNet-B3和ConvNeXt-Tiny在决策层的融合，并利用开放权重的多模态大语言模型（Gemma和Qwen）进行语义仲裁，通过结构化JSON证据生成包含诊断、风险等级、治疗紧迫性和经济损失的可解释输出。

Details

Motivation: 解决在真实、不受控的田间条件下，植物病害诊断需要可靠融合不确定且可能冲突的感知证据的问题，旨在实现可解释的农业AI和机器人田间决策支持。

Result: 在PlantDoc基准上，使用Gemma仲裁将准确率从63.9%提升至68.5%，在CNN冲突子集上提升7.6个百分点。在两个非公开的康奈尔机器人采集数据集上，准确率达到99.3%和98.9%，模型间分歧率低。Gemma的关键风险错误率很低，而Qwen存在过度标记风险。

Insight: 创新点在于将决策级视觉专家融合与MLLM的语义仲裁相结合，利用结构化JSON证据进行可解释推理。客观来看，这为处理感知冲突、提升诊断可靠性和可解释性提供了一种有前景的、基于校准的框架，并进行了从基准到真实机器人田间的全面验证。

Abstract: Accurate field plant disease diagnosis requires reliable fusion of uncertain and conflicting perceptual evidence. We present the Hybrid Hierarchical Multi-Agent Framework (H$^{2}$MAF), combining decision-level fusion of EfficientNet-B3 and ConvNeXt-Tiny with semantic arbitration by open-weight multimodal large language models (MLLMs), Gemma 4 E4B and Qwen3.5 4B, using structured JSON evidence to generate explainable diagnoses, risk levels, treatment urgency, and financial exposure. (H$^{2}$MAF) is evaluated on 14,364 images (1,370 test images) across PlantDoc (2,922 images, 27 classes) and two non-public, continuously captured Cornell robot-acquired field datasets: Stage 2 (20 GB; 4,215 images) and Stage 4 (40 GB; 7,227 images), covering Early Blight, Late Blight, and Septoria Leaf Spot under uncontrolled field conditions. On PlantDoc, Gemma improves accuracy from 63.9% to 68.5%, achieving +7.6 points on the 41.7% CNN-conflict subset. Cornell accuracies reach 99.3% and 98.9%, with only 1.7-4.1% disagreement, demonstrating conflict-dependent MLLM utility. The critical-risk error of gemma is 0.14-0.5 points, whereas Qwen overflags by 3.5-14.4 points. These results establish MLLM arbitration as a promising, yet calibration-dependent, approach for explainable agricultural AI and robotic field decision support. Github Link: https://github.com/Applied-AI-Research-Lab/Explainable-AI-Plant-Disease-Detection

[29] A Lightweight Multimodal Vision-Language Framework for Early-Stage Anatomical Green Fruit Classification in Commercial Orchards cs.CV | cs.AIPDF

Ranjan Sapkota, William Bu, Chen Chen, Yunjun Xu, Manoj Karkee

TL;DR: 本研究提出了一种轻量级多模态视觉-语言框架，用于在复杂果园环境中对早期苹果幼果的解剖结构（包括花萼、幼果体和果梗）进行细粒度分类。该方法基于TinyCLIP进行适配，利用领域特定的语言提示引导图像与园艺结构的多模态对齐，并通过滑动窗口推理策略生成空间热图以实现可解释的定位。在NVIDIA T4 GPU上的评估显示，该方法在三个类别上取得了较高的F1分数（宏观F1为0.93），并通过ONNX和TensorRT优化实现了在边缘设备（如NVIDIA Jetson）上的高效部署。

Details

Motivation: 准确识别早期苹果幼果的解剖结构对于机器人疏果、作物负载管理和其他精准果园操作至关重要，但复杂果园环境下的细粒度分类和边缘部署需求是现有方法的挑战。

Result: 在由600张高分辨率RGB图像组成的数据集上，该方法在花萼、幼果体和果梗三个类别上的F1分数分别为0.95、0.98和0.85，宏观F1分数为0.93。通过ONNX和TensorRT优化，模型大小约为127-137 MB，在INT8量化下保持精度，并在边缘硬件上实现毫秒级推理。

Insight: 创新点包括将轻量级视觉-语言模型（TinyCLIP）适配到农业领域，利用领域特定的语言提示进行多模态对齐，以及采用滑动窗口推理生成可解释的空间热图。从客观角度看，该方法展示了轻量级多模态模型在复杂农业场景中实现高效、可解释且可部署的感知能力的潜力。

Abstract: Accurate identification of early-stage apple fruitlet anatomical structures, including the calyx, fruitlet body, and peduncle, is essential for robotic thinning, crop-load management, and other precision orchard operations. This study presents a lightweight multimodal vision-language framework that adapts TinyCLIP for fine-grained fruitlet anatomy classification in complex orchard environments. A dataset of 600 high-resolution RGB images collected from Scilate and Scifresh apple orchards was converted into 224 x 224 image patches and annotated for three anatomical classes. Domain-specific language prompts, such as ``a photo of a class,’’ were used to guide multimodal alignment between orchard imagery and horticultural structures. A sliding-window inference strategy with a stride of 112 pixels aggregates patch-level predictions into spatial heatmaps, enabling interpretable whole-image localization of fruitlet components relevant to robotic thinning. Patch-level evaluation on an NVIDIA T4 GPU achieved F1-scores of 0.95 for calyx, 0.98 for fruitlet, and 0.85 for peduncle, with a macro-F1 score of 0.93. Deployment-oriented optimization using ONNX and TensorRT enabled efficient inference on NVIDIA Jetson hardware, preserved accuracy under INT8 quantization, and supported model sizes of approximately 127-137 MB with millisecond-level patch inference. These results demonstrate that lightweight vision-language models can provide interpretable and edge-deployable perception for automated fruitlet analysis and future robotic thinning systems. The source code and implementation details are publicly available at https://github.com/WilliamBu1/A-Lightweight-Vision-Language-Model-for-Early-Stage-Fruitlet-Classification-in-Apple-Orchards.

[30] Targeting the Attention Heads Behind Object Hallucination in LLaVA cs.CV | cs.AIPDF

Armaan Sandhu, Abhilasha Senapati, Hima Kammachi

TL;DR: 本文针对LLaVA-1.5-7B等视觉语言模型在生成图像描述时出现物体幻觉的问题，提出了一种从可解释性诊断到针对性干预的流程。通过识别与幻觉相关的注意力头，并应用头部切片LoRA适配器和推理时接地控制器，显著降低了模型在COCO数据集上的物体幻觉率。

Details

Motivation: 解决视觉语言模型（如LLaVA）在图像描述生成中普遍存在的物体幻觉问题，即模型会生成图像中不存在的物体描述。研究旨在探索是否可以通过对模型失败案例的可解释性分析来指导有效的针对性修复。

Result: 在400张保留的COCO图像上，结合方法将CHAIRs（包含幻觉物体的描述比例）从0.370降至0.230，CHAIRi（幻觉物体提及比例）从0.156降至0.096（p < 0.001）。与随机选择注意力头的对照组相比，该方法效果显著，且幻觉减少效果随解码预算增加而增强。

Insight: 创新点在于建立了一个从诊断到干预的完整流程，通过注意力机制分析精准定位导致幻觉的模型组件（注意力头），并实施针对性干预（如头部切片LoRA）。这提供了一种基于模型内部机制、非随机的、可解释的修复策略，而不仅仅是优化单一性能指标。

Abstract: Vision-language models such as LLaVA-1.5-7B often hallucinate objects absent from the image when generating captions. We ask whether an interpretability diagnosis of this failure can guide a targeted fix, and we measure what that fix actually changes. We rank attention heads by how much their image attention drops around hallucinated object words, then screen the shortlist by ablating candidate heads and measuring the change in hallucination-token log probability, yielding a 32-head set. We restrict two interventions to these heads: a head-sliced LoRA adapter and an inference-time grounding controller. On 400 held-out COCO images, the combined method lowers CHAIRs (the fraction of captions with a hallucinated object) from 0.370 to 0.230 and CHAIRi (the fraction of hallucinated object mentions) from 0.156 to 0.096 (p < 0.001, paired sign-flip tests). Two controls sharpen attribution. A random-head LoRA control, matched layer-for-layer and trained identically, performs no better than the matched baseline on a separate 200-image control split, supporting the role of head selection rather than LoRA capacity. Under fixed decoding budgets, the CHAIR reduction persists and grows with budget (23% at 64 tokens to 58% at 128), arguing against a pure max-token or truncation artifact, although the method remains shorter and more conservative. The resulting behavior reduces unsupported object mentions while also lowering object recall (0.78 to 0.70). We present a diagnosis-to-intervention pipeline for object hallucination, and, more importantly, a controlled account of what acting on the diagnostic signal actually does: it localizes intervention sites with real, non-random leverage, reported as a behavioral profile rather than a single score.

[31] See More, Detect Less? Taming Information Leakage in Multi-View Anomaly Detection cs.CV | cs.MMPDF

Shang-Fu Chen, Kuan-Chuan Peng, Jhih-Ciang Wu, Wen-Huang Cheng, Kai-Lung Hua

TL;DR: 本文研究了多视图异常检测中的跨视图信息泄漏问题，指出在基于重建的检测流程中，来自完整视图的正常信息会泄漏到解码器，导致异常区域被错误重建，从而缩小了检测所依赖的重建误差。为此，作者提出了GLAD框架，该框架结合了视觉基础模型特征，并引入了局部和全局的跨视图融合机制来限制信息流。

Details

Motivation: 解决多视图异常检测中，简单融合多个视图信息会导致正常信息泄漏到解码器，从而掩盖异常、降低检测性能的问题。

Result: 在Real-IAD和MANTA-Tiny数据集上的实验表明，GLAD在样本级、图像级和像素级指标上均优于现有最先进方法。

Insight: 创新点在于明确指出了跨视图信息泄漏这一失败模式，并提出了通过可学习的视图重要性加权、令牌级门控以及对象级全局表征广播等机制来限制信息流，从而保护重建误差，这是实现有效多视图融合的关键。从客观角度看，将局部细粒度融合与全局对象级上下文分离并结构化处理，是一种新颖且高效的解决方案。

Abstract: In multi-view anomaly detection, more cross-view information can actually hurt. When multiple inspection views are naively fused in a reconstruction-based pipeline, normal cues from intact views propagate to the decoder, which faithfully reconstructs anomalous regions, collapsing the reconstruction gap the detector depends on. We call this failure mode \emph{cross-view information leakage} and show that effective multi-view fusion must explicitly restrict the information reaching the decoder. Building on this insight, we present GLAD(Global-Local Attention Driven framework), the first framework combining vision foundation model features with local and global cross-view fusion for multi-view anomaly detection. The Multi-view Merging Attention (MMA) module performs local cross-view fusion at linear complexity with learnable view importance weighting and token-wise gating, letting each view selectively incorporate fine-grained evidence from other views at $\mathcal{O}(N)$ cost. The Object-Guided Attention (OGA) module captures global context by aggregating class tokens from all views into a single object-level representation and broadcasting it back to patch tokens via temperature-scaled sigmoid gating, replacing the original patch representations rather than adding a residual to preserve the reconstruction gap. Experiments on Real-IAD and MANTA-Tiny show that GLAD outperforms state-of-the-art methods across sample-, image-, and pixel-level metrics, confirming that principled information restriction is key to multi-view anomaly reasoning.

[32] Can You Trust Frozen Hematology Foundation Models under Acquisition Shift? cs.CV | cs.AI | q-bio.QMPDF

Jai Kumar Sharma, Peeyush Tapadiya

TL;DR: 该论文评估了15种冷冻血液学基础模型在跨域采集偏移下的可靠性。研究发现，尽管这些模型在域内白细胞分类任务上达到近乎饱和的准确率（0.98-0.997），但在跨数据集（不同扫描仪、染色等）时性能显著下降（宏F1下降34-72%），且模型排名发生重排。论文还发现校准性能在域外严重恶化，并提出了训练无关的特征归一化方法CBR来部分缓解该问题。

Details

Motivation: 临床部署血液学基础模型需要其在不同的扫描仪、站点、染色和制备流程下保持可靠，但现有研究主要关注域内性能，缺乏对采集偏移下模型鲁棒性的系统性审计。

Result: 在四个公共单细胞采集域上的评估显示，域内最佳模型DinoBloom-L在偏移最大的目标域MLL23上性能跌至第10名。模型校准误差从域内的0.004急剧恶化到域外的0.35。提出的CBR方法改善了所有评估的目标先验场景的平均性能。

Insight: 创新点在于对血液学基础模型进行了多维度（准确性、校准、预训练数据暴露、类别先验鲁棒性）的联合审计，揭示了域内高性能与域外鲁棒性之间的巨大差距。客观来看，其提出的无需训练的伪标签平衡特征归一化方法（CBR）是一种简单有效的域适应技术思路。

Abstract: Frozen hematology foundation-model (FM) embeddings reach near-saturated in-domain white-blood-cell (WBC) accuracy, but clinical deployment demands reliability across scanners, sites, stains and preparation pipelines. We audit 15 frozen encoders (hematology, pathology, and general vision) across four public single-cell acquisition domains along two axes: accuracy robustness and calibration. In-domain linear-probe macro-F1 is saturated (0.98-0.997), yet cross-dataset macro-F1 drops 34-72% and rankings re-order: DinoBloom-L, the in-domain best, falls to 10th of 15 on the most-shifted target (MLL23) at the benchmark’s shared 224-px input, behind RedDino and several general and pathology encoders. Rank transfer is probe-dependent: 1-NN retrieval is more stable on average than a source-fitted linear head (median $ρ$ 0.65 vs 0.45), but neither probe universally predicts target robustness. Calibration also collapses: source-trained probes are nearly calibrated in-domain (expected calibration error, ECE, 0.004) but confidently wrong off-domain (ECE 0.35), and source-fitted temperature scaling transfers poorly. We further audit pretraining exposure and identify MLL23 as DinoBloom’s internal cohort; because DinoBloom’s only held-out dataset is also our source domain, this benchmark cannot isolate exposure from scanner-associated shift. Label-free adaptation and marginal-entropy-based model selection appear safe under balanced evaluation but fail under realistic WBC class-prior shift. Class-Balanced Re-standardization (CBR), a training-free pseudo-label-balanced feature normalization, improves all evaluated target-prior scenario means and partially improves calibration, although encoder-level exceptions and residual miscalibration remain. Hematology FM benchmarks must therefore jointly audit accuracy, calibration, exposure, and class-prior robustness.

[33] RefLAM: A Reference-Grounded Line Annotation Pipeline for Historical Arabic Manuscripts cs.CV | cs.CLPDF

Mohamed Guechaoui, Mohamed Diaa Zellagui, Souleyman Chaib, Sahraoui Dhelim

TL;DR: 本文提出了RefLAM（基于参考的手稿行级标注流程），这是一个用于历史阿拉伯语手稿的自动化标注流程。它将手稿页面图像和干净转录文本转换为经过验证的行级真实标注数据，结合了深度学习页面分割模型、多模态大语言模型（MLLM）进行结构化OCR，以及一个不依赖变音符号的模糊对齐引擎，为每个OCR行提供字符级置信度分数。该方法在7本经过完整页面验证的书籍中实现了比手动标注高75倍的吞吐量增益，并发布了包含近2.8万行标注的AraMS-28k数据集，证明了其对于下游手写文本识别（HTR）训练的实际效用。

Details

Motivation: 解决现有阿拉伯语手写文本识别（HTR）训练数据构建方法无法规模化的问题。现有方法要么完全依赖手动标注（不可扩展），要么依赖自动OCR-参考对齐方法，但这些方法尚未扩展到具有可证明正确性保证的多脚本、双区域（正文加边注）手稿布局。

Result: 在7本完全页面验证的书籍中，测量到比手动标注高75倍的吞吐量增益（每小时3000行 vs. 40行）。在一周内，对另外7本书应用相同保证，保留了16,533个置信度为100的正文行。使用RefLAM发布的AraMS-28k数据集包含14本历史阿拉伯语手稿书籍、3,043页、27,971个正文行和629个边注行标注。在AraMS-28k上微调Muharaf预训练基线模型（包括HATFormer）并报告了CER结果，证实了其对于下游HTR训练的实际效用。

Insight: 主要创新点在于提出了一个结合深度学习分割、MLLM结构化OCR和模糊对齐的完整自动化流程，并引入了可证明正确性的“置信度-100规则”（即完美分数在归一化字符串上等同于字符级完全一致），使得审阅者可以信任完美对齐的行，从而将人工注意力集中在不确定的对齐上，实现了标注工作的分流和效率大幅提升。其方法特别针对历史阿拉伯语手稿的多脚本、双区域布局挑战，并提供了字符级置信度评分机制。

Abstract: Existing approaches to building line-level Arabic handwritten-text-recognition (HTR) training data either rely on fully manual annotation, which does not scale, or on automatic OCR-to-reference alignment methods not yet extended to multi-script, two-zone (main-plus-margin) manuscript layouts with a provable correctness guarantee. We present RefLAM (Reference-grounded Line Annotation for Manuscripts), a pipeline converting manuscript page images and clean transcriptions into validated, line-level ground truth without sacrificing human oversight. RefLAM couples a deep-learning page-segmentation model with a multimodal large language model (MLLM) for structured OCR and a diacritic-agnostic fuzzy alignment engine that grounds each OCR line in a contiguous span of the reference text, with a character-level confidence score in $[0,100]$. A perfect score is provably equivalent to character-for-character identity of the normalised strings (the Confidence-100 rule), verified with no counterexample across the released corpus. A reviewer can thus trust a perfect score, confirming most lines at a glance rather than retyping them, so annotation becomes triaged, with attention concentrated on uncertain alignments. Across 7 fully page-validated books we measured a 75$\times$ throughput gain over manual annotation (3,000 vs. 40 lines/hr); applying the same guarantee to 7 further books, we retained 16,533 confidence-100 main-text lines within one week, excluding sub-100 lines rather than manually correcting them. Using RefLAM, we release AraMS-28k: 14 historical Arabic manuscript books, 3,043 pages, and 27,971 main-text and 629 margin-line annotations with bounding boxes, layout labels, and insertion anchors for 191 margin entries (30.4%). We also finetune Muharaf-pretrained baselines (including HATFormer) on AraMS-28k and report CER results confirming its practical utility for downstream HTR training.

[34] Lowering the Barrier to AI-Driven Inspection: A No-Code Workflow for Automated Structural Defect Detection cs.CV | cs.LG | eess.IVPDF

Michael Holm, Tanner McElroy, Xinghang Zhang, Guang Lin

TL;DR: 该论文介绍了YOLOEZ，一个基于图形用户界面的开源工具，旨在降低AI驱动的结构缺陷检测的应用门槛。该工具集成了数据标注、模型训练和推理功能，无需编程即可实现端到端的YOLO模型应用，从而促进结构健康监测中人工智能的广泛采用。

Details

Motivation: 传统计算机视觉方法在结构缺陷检测中存在对噪声和成像变化敏感、可靠性有限的问题，而现代机器学习方法（如CNN和YOLO）虽提高了精度，但其应用因数据标注、模型训练和部署等技术壁垒（通常需要编程专业知识）而受限。

Result: 评估表明，YOLOEZ在大多数检测指标上优于传统图像处理方法，并且降低了其他现代计算机视觉工具存在的应用门槛。

Insight: 论文的主要创新点在于开发了一个无需代码、基于GUI的端到端工具（YOLOEZ），将高性能模型开发与易用性相结合，从而显著降低了AI在结构健康监测领域的技术应用门槛，促进了可复现的工作流程。从客观角度看，其将先进目标检测模型（YOLO）与用户友好的交互界面深度集成，是一个面向实际工程应用的有效解决方案。

Abstract: Structural health monitoring (SHM) is essential in modern engineering, providing data for condition-based maintenance, lifecycle assessment, and predictive decision-making. Traditionally, SHM relied on visual inspection to detect defects such as cracks and deformations. Early computer vision (CV) methods, including thresholding, edge detection, and handcrafted features, aimed to automate this process but were highly sensitive to noise, imaging variations, and multiscale defects, limiting their reliability. Recent advances in machine learning, particularly convolutional neural networks (CNNs) and You Only Look Once (YOLO), have improved defect detection accuracy and enabled real-time analysis. However, adoption in SHM remains limited due to technical barriers such as data labeling, model training, and deployment, which typically require programming expertise. To address this gap, we introduce YOLOEZ, an open-source, GUI-based tool for end-to-end YOLO model application. YOLOEZ integrates data labeling, training, and inference into a single interface, enabling high-performance model development without code while supporting reproducible workflows. Evaluation against existing software and classical image processing demonstrates that YOLOEZ not only outperforms traditional methods across most detection metrics, but also lowers adoption barriers present in other modern CV tools. By combining accuracy with accessibility, YOLOEZ facilitates wider use of AI-driven monitoring for predictive maintenance, digital twins, and intelligent structural systems.

Lkhanaajav Mijiddorj, Yang Yan, Tyler Beringer, Bilguunzaya Mijiddorj, Alex N. Ho

TL;DR: 本文提出了一种用于微型交通工具导航的轻量级单目视觉人行道路径提取方法。该方法通过三个设计迭代，从骨架图基线到距离变换走廊规划，最终形成轻量级图像空间架构，并系统比较了鸟瞰图和图像空间中的五种路径规划方法。

Details

Motivation: 解决在杂乱、地图稀疏环境中，于紧凑、低功耗硬件上可靠运行的人行道尺度路径提取需求，以支持嵌入式微型交通工具导航。

Result: 在32帧人工标注图像的控制实验中，图像空间中点规划实现了最低的横向中心误差（14.3像素）和2.2毫秒处理时间，相比BEV距离变换规划速度提升421倍。在六个校园序列（22,679帧）的全视频回放中，改进的分割将时间不稳定性从1.46%降至0.33%，并将模板路径可用性从73.7%提升至79.3%。最终架构在CPU上每帧处理时间低于50毫秒。

Insight: 创新点包括：采用半监督师生框架训练的紧凑SegFormer-B0学生模型；系统比较并证明了图像空间路径规划在单目设置下的高效性与鲁棒性；提出了一种结合图像空间中点规划（主）、图像空间距离变换（后备）和BEV（仅用于可视化）的混合架构，在嵌入式系统上实现了实时性能。

Abstract: Sidewalk-scale path extraction demands perception and planning that run reliably on compact, low-power hardware in cluttered, map-sparse environments. We present a monocular vision pipeline for sidewalk path extraction in micromobility systems that progresses through three design iterations, from a skeleton-graph baseline through distance-transform corridor planning to a lightweight image-space architecture, and provides a systematic comparison of five path-planning methods across both bird’s-eye-view (BEV) and image-space domains. A compact SegFormer-B0 student model, trained with a semi-supervised teacher-student framework using OneFormer Swin-L pseudo-labels, achieves a hand-annotated IoU of 0.946 at 11.7 ms per frame, improving over the baseline checkpoint (IoU 0.758, 18.9 ms). In a controlled planner comparison on 32 hand-labeled frames, image-space midpoint planning achieves the lowest lateral center error (14.3 px) at 2.2 ms, a 421x speedup over BEV distance-transform planning (926.8 ms, 65.0 px center error), while maintaining comparable mask-path alignment (98.5% versus 98.6%). A full-video replay across six campus sequences (22,679 frames) confirms that the improved segmentation reduces temporal instability from 1.46% to 0.33% and increases template-path availability from 73.7% to 79.3%. We further show that BEV-only path extraction is fragile in monocular settings: in one profiled run, 99.3% of frames produced no valid BEV path. The final recommended architecture, image-space midpoint primary, image-space distance-transform fallback, and BEV reserved for visualization, runs the full perception-to-path stack in under 50 ms per frame on CPU, making it suitable for embedded pedestrian-speed micromobility systems.

[36] PointRL: Learning Point-Level Vision-Language Grounding from Verifiable Annotation Evidence cs.CVPDF

Jingyang Su, Pu Cao, Xiuze Jin, Longyue Zhang, Qing Song

TL;DR: 论文提出PointRL框架，通过可验证的强化学习方法从异构标注证据中学习点级视觉语言对齐。该方法将边界框、掩码和实例标签转化为指向指令，并利用隐藏的验证证据评估预测的解析性、点有效性、实例覆盖和基数一致性。

Details

Motivation: 解决视觉语言模型在点坐标作为视觉对齐接口时，由于监督空间非唯一性（同一目标区域存在多个有效坐标）以及多实例指令需要满足目标覆盖、计数一致性和重复抑制等约束而难以学习可靠指向行为的问题。

Result: 在PointArena基准上，PointRL将Qwen3.5-4B模型的整体准确率从56.11%提升至65.58%；在RoboSpatial、BLINK和Ref-Adv等外部基准测试中也显示出相同骨干网络的性能提升。

Insight: 创新点在于将传统视觉标注（如边界框、掩码）转化为可验证的强化学习奖励信号，通过隐藏的验证证据（标注支持、实例成员关系和集合约束）提供结构化反馈，从而提升点级空间对齐的鲁棒性和泛化能力。

Abstract: Vision-language models (VLMs) increasingly rely on point coordinates as a compact and executable interface for visual grounding in GUI interaction, robotic manipulation, and interactive visual systems. However, learning reliable pointing behavior remains difficult because the supervision space is inherently non-unique: many coordinates may be valid within the same target region, while multi-instance instructions require target coverage, count consistency, and duplicate suppression. This work presents PointRL, a verifiable reinforcement learning framework that learns point-level grounding from existing heterogeneous annotation evidence. PointRL converts bounding boxes, masks, and instance labels into pointing instructions, while retaining their target supports, instance membership, and set constraints as hidden verifier evidence, i.e., annotations kept outside the prompt and used by a deterministic checker to score predictions. The proposed reward evaluates parseability, point validity, instance coverage, cardinality consistency, and redundant or missing predictions. On PointArena, PointRL improves the overall accuracy of Qwen3.5-4B from 56.11% to 65.58%. Further evaluations on RoboSpatial, BLINK, and Ref-Adv show same-backbone gains on the evaluated external benchmarks, suggesting that verifiable point-level feedback may benefit spatial grounding in these settings.

[37] What Do Medical Vision-Language Models Learn in Radiology? Transfer, Alignment, and Source-Proxy Leakage Under Distribution Shift cs.CV | cs.AIPDF

Ayoub Louaye Bouaziz, Lokmane Chebouba, Yassine Himeur

TL;DR: 该研究探讨了医学视觉语言模型在分布偏移下的可靠性问题，重点关注其在跨数据集视觉迁移、多模态对齐以及源代理信息泄露方面的表现。研究发现，自监督视觉初始化在NIH到CheXpert的迁移中优于监督ImageNet初始化，而对抗性适应仅在狭窄范围内有效且不稳定。多模态精确配对检索在外部OpenI压力测试下表现不佳，且学习到的表示中仍可恢复源代理信息。

Details

Motivation: 医学视觉语言模型在单一协议下可能表现可靠，但在采集域、配对监督或评估协议变化时可能失效，研究旨在揭示这种与认知智能相关的表示级盲点，而不声称提供形式化的认知不确定性估计。

Result: 在NIH ChestXray14和CheXpert上的实验表明，自监督视觉初始化在匹配的ResNet-18比较中，其跨数据集视觉迁移优于监督ImageNet初始化；对抗性适应仅在狭窄范围内有用且不稳定。在PadChest和OpenI上的评估显示，多模态精确配对检索在外部压力测试下保持较低水平，且源代理信息仍可从冻结嵌入中恢复。

Insight: 研究揭示了医学视觉语言模型在分布偏移下可能隐藏的迁移、对齐和捷径相关失败模式，强调了在分布偏移下对医学视觉语言模型进行压力测试评估的重要性。自监督初始化在跨域迁移中的优势以及对抗性适应的局限性是重要的实践发现。

Abstract: Medical vision-language models (VLMs) can appear reliable in-domain while failing when acquisition domain, paired supervision, or evaluation protocol changes. We study this failure mode as a representation-level blind spot relevant to epistemic intelligence, without claiming a formal estimator of epistemic uncertainty. Using NIH ChestXray14 and CheXpert, we first isolate source-only cross-dataset visual transfer from unsupervised domain-adaptation diagnostics. Using PadChest and OpenI, we then evaluate multimodal alignment under strict pair-index retrieval and quantify metadata-derived source-proxy information retained in frozen embeddings. Self-supervised visual initialization improves NIH-to-CheXpert transfer over supervised ImageNet initialization in matched ResNet-18 comparisons, whereas adversarial adaptation is useful only in a narrow regime and becomes unstable as adversarial pressure increases. Multimodal exact-pair retrieval remains low under external OpenI stress testing, and source-proxy information remains recoverable from learned representations. Qualitative nearest-neighbor and Grad-CAM analyses show clinically plausible cross-dataset structure and thoracic attention patterns in many cases, while device-heavy and false-positive cases remain ambiguous. Auxiliary architecture checks are task-dependent and do not support a universal backbone ranking. Overall, the study shows that apparent competence under a single protocol can conceal transfer, alignment, and shortcut-related failure modes, motivating stress-tested evaluation of medical VLMs under distribution shift.

[38] V-Link: Recovering Lost Visual Representations in Action DiT for Vision-Language-Action Models cs.CVPDF

Yehao Lu, Jiarui Yang, Yuning Su, Yufeng Xie, Yu Zhong

TL;DR: 本文提出V-Link方法，旨在解决视觉-语言-动作（VLA）模型中动作专家难以充分获取视觉语言模型（VLM）特征中的3D几何和2D语义信息的问题。该方法通过在VLM中学习互补的空间查询和语义查询表示，并通过非对称路径将其注入到动作DiT中，从而在特征传递过程中显式恢复视觉表征，以增强感知基础并提升精细机器人操作性能。

Details

Motivation: 现有VLA架构存在一个关键局限：动作专家对VLM特征中可用的3D几何和2D语义信息访问受限，这削弱了感知基础，并限制了精细机器人操作的性能。

Result: 在LIBERO、LIBERO-Plus和RoboTwin 2.0基准测试中，V-Link相较于基础模型GR00T N1.6，平均成功率分别提升了+1.9%、+31.2%和+18.8%。在AGIBOT A3 Ultra上，V-Link在两个真实世界人形机器人任务中进一步实现了+20%和+24%的性能增益。

Insight: 论文的创新点在于显式地在视觉语言到动作的特征传递过程中恢复视觉表征，通过引入互补的空间查询（提供几何条件）和语义查询（补充原始图像标记）的非对称注入机制，以弥合VLM与动作专家之间的可访问性差距，从而增强动作生成的感知基础。

Abstract: Vision-language-action (VLA) models provide a scalable path toward generalist robotic manipulation by integrating visual perception, language understanding, and continuous action control. However, we reveal a critical limitation of VLA architectures: the action expert has limited access to the 3D geometric and 2D semantic information available in VLM features. This accessibility gap weakens perceptual grounding and limits performance on fine-grained robotic manipulation. To address this issue, we propose V-Link, which explicitly recovers visual representations during the vision-language (VL) to action (A) feature transfer. Specifically, V-Link learns complementary Spatial and Semantic Query representations within the VLM and injects them into Action DiT through asymmetric pathways. Semantic Queries complement the original VLM image tokens, whereas Spatial Queries provide dedicated geometric conditioning for spatially grounded action generation. Across LIBERO, LIBERO-Plus, and RoboTwin 2.0, our V-Link improves the average success rate over base model GR00T N1.6 by +1.9%, +31.2%, and +18.8%, respectively. On the AGIBOT A3 Ultra, V-Link further achieves gains of +20% and +24% on two real-world humanoid tasks.

[39] Not All Attention Heads Contribute to Critical Visual Token Selection: Head-Aware Pruning Matters More cs.CVPDF

Chaofang Ma, Lin Jiang, Carol Jingyi Li, Xingyu Liu, Zeyu Li

TL;DR: 本文揭示了视觉语言模型中只有少数注意力头对识别关键视觉令牌至关重要，并提出了ProViP这一无需训练的渐进式视觉令牌剪枝框架。该框架首先基于输入令牌的嵌入相似性进行冗余令牌移除，然后在推理过程中通过头感知剪枝进一步精简令牌，从而在保持高性能的同时显著提升推理效率。

Details

Motivation: 视觉语言模型在多种视觉场景中表现出色，但视觉令牌数量的爆炸式增长带来了巨大的内存和计算开销，导致推理延迟增加。现有视觉令牌剪枝方法通过聚合所有注意力头的注意力分数来估计令牌重要性，但作者发现识别关键视觉令牌的能力仅集中在少数头部，这启发了更高效的剪枝策略。

Result: 实验表明，ProViP在LLaVA-1.5-7B模型上，在88.9%的剪枝比例下，能保持95.9%的原始性能，并实现1.62倍的推理加速，展现了出色的任务性能和推理效率。

Insight: 创新点在于发现视觉令牌选择的关键能力集中于少数注意力头，并据此提出头感知剪枝方法；客观来看，该研究通过分析注意力头的不均匀贡献，设计了一种渐进式、无需训练的剪枝框架，为视觉语言模型的高效推理提供了新思路。

Abstract: Vision-Language Models (VLMs) have exhibited impressive performance across diverse visual scenarios. However, this success comes at the cost of explosive growth in visual tokens, which imposes substantial memory and computational overhead during inference, ultimately increasing latency. To improve VLM inference efficiency, a typical class of visual token pruning methods estimates token importance by aggregating attention scores across all heads in the pruning layer of the Large Language Model (LLM) backbone and prunes tokens based on aggregated scores. However, in this paper, we reveal a compelling phenomenon: the capability to pinpoint critical visual tokens is concentrated within a small fraction of heads. Aggregation exclusively on these heads can improve task performance. Inspired by this observation, we propose ProViP, a training-free progressive visual token pruning framework. ProViP first removes redundant visual tokens based on the embedding similarity of input tokens before reasoning of the LLM backbone, and then further prunes tokens during reasoning via head-aware pruning. Experiments demonstrate that ProViP delivers outstanding task performance and inference efficiency. For instance, when applied to LLaVA-1.5-7B, ProViP retains 95.9% of the original performance and achieves 1.62x inference speedup under an 88.9% pruning ratio.

[40] CoRE: Weakly Supervised Coarse-to-Fine Risk Evidence Learning in Driving Videos cs.CV | cs.AIPDF

Kaiser Hamid, Can Cui, Nade Liang

TL;DR: 本文提出了CoRE框架，一种弱监督的从粗到细学习方法，旨在从粗粒度的视频级监督中学习细粒度的风险证据支持。该方法通过冻结视频级预测器，对候选时间区域或实体轨迹进行结构化干预，生成预测效应目标，并蒸馏到学生网络中，从而在推理时无需干预即可直接预测时间和实体支持。

Details

Motivation: 解决驾驶视频中风险感知的细粒度证据学习问题，传统方法需要昂贵的时间和实体级标注，而CoRE仅利用粗粒度的视频级监督来学习细粒度的预测支持。

Result: 在RISEE、DoTA和UCF-Crime三个基准上评估，CoRE在DoTA上实现了强时间定位性能，在UCF-Crime上达到竞争性水平，表明能从粗监督中学习信息丰富的细粒度支持。

Insight: 创新点在于通过结构化干预和蒸馏机制，从粗粒度预测中自动提取细粒度证据，无需对应细粒度标签，为弱监督学习提供了新思路。

Abstract: Perceived risk in driving evolves over time and may be supported by specific scene entities, yet supervision is typically limited to coarse video-level judgments. Learning \emph{when} supporting evidence emerges and \emph{which entities} support a risk predictor would ordinarily require costly temporal- and entity-level annotations. We introduce \textbf{CoRE}, a weakly supervised coarse-to-fine framework that learns fine-grained prediction support from coarse video supervision. CoRE first trains a video-level predictor and then freezes it. Structured interventions over candidate temporal regions or entity tracks measure how each candidate changes the coarse prediction, producing graded prediction-effect targets. These targets are distilled into a student that directly predicts temporal and entity support from the original video, without requiring interventions at inference. We evaluate this learning principle across three complementary settings: RISEE tests perceived-risk support from subjective clip-level judgments without temporal or entity-level risk annotations; DoTA provides independent temporal event annotations for evaluating weakly supervised traffic-anomaly localization; and UCF-Crime tests whether the same coarse-to-fine mechanism extends to a standard non-driving anomaly-detection benchmark. Across these settings, CoRE learns informative fine-grained support from coarse supervision, with strong temporal localization on DoTA and competitive performance on UCF-Crime. These results show that coarse video predictions can provide useful supervision for recovering the fine-grained evidence supporting them, without requiring corresponding fine-grained labels.

[41] Where to Look Matters: On-Policy Self-Distillation for Long-Video Understanding cs.CVPDF

Kaishen Wang, Dongdi Zhao, Yijun Liang, Dingqiang Ye, Ruibo Chen

TL;DR: 本文提出了一种名为Clue-OPSD的线索特权在线策略自蒸馏框架，用于提升长视频理解任务中视觉语言模型的性能。该方法通过在训练阶段利用标注的、包含问题相关证据的短线索区间作为特权监督，指导一个使用全视频作为输入的学生模型学习，从而减少无关时间内容的干扰，而无需在推理时使用线索标注或额外模块。

Details

Motivation: 随着视频变长，全视频上下文不可避免地包含更多与问题无关的时间内容，这会分散模型对回答特定问题所需证据的注意力。因此，需要一种方法能聚焦于包含问题相关证据的短时间区间，以提升模型性能。

Result: 在多个长视频理解基准测试和不同规模的Qwen3.5模型上进行的广泛实验表明，该方法相比对应的骨干模型取得了持续改进，并在监督后训练基线上表现出强劲性能。

Insight: 核心创新点在于利用线索区间作为特权监督进行在线策略自蒸馏，通过对齐学生模型（基于全视频）和自教师模型（基于线索区间）的下一词元分布来传递知识。这种方法无需依赖真实答案标签，且在推理时无需线索标注，实现了训练与推理的解耦和性能提升。

Abstract: Vision-language models (VLMs) have made substantial progress in long-video understanding, with standard backbone models typically answering questions from frames sampled across the full video. However, as videos become longer, the full-video context inevitably contains more question-irrelevant temporal content, which can distract the model from the evidence needed to answer a specific question. We empirically find that focusing the visual input on short annotated clue intervals containing question-relevant evidence consistently improves prediction accuracy across model scales compared with using the corresponding full videos, while requiring fewer input frames. Based on this finding, we introduce Clue-OPSD, a clue-privileged on-policy self-distillation framework for long-video understanding. During training, a full-video student learns from a self-teacher conditioned on the corresponding clue interval by aligning their next-token distributions along student-generated trajectories. Clue-OPSD thus uses clue intervals as privileged supervision without relying on ground-truth answer labels, while requiring no clue annotations or additional modules at inference time. Extensive experiments across multiple long-video understanding benchmarks and Qwen3.5 model scales demonstrate consistent improvements over the corresponding backbone models and strong performance against supervised post-training baselines.

Xiaocheng Zou, Tiancheng Zheng, Xiaolin Xu, Ruyi Ding

TL;DR: 本文揭示了视觉混合专家（Vision MoE）模型中一个被忽视的安全漏洞：由于MoE架构采用容量有界的令牌分配机制，其处理能力依赖于推理批次大小，这为供应链后门攻击提供了新的攻击面。作者提出了一种隐蔽的三阶段后门攻击框架，通过在小批次安全审计时保持休眠、在大批次部署时激活后门，成功规避了多种现有防御方法。

Details

Motivation: 动机在于发现视觉MoE模型中批次依赖的执行行为（即专家处理容量随批次大小变化）是一个未被充分认识的安全盲点，攻击者可利用这一特性设计隐蔽的供应链后门攻击，从而绕过常规安全检测。

Result: 在ImageNet-100和GTSRB数据集上，对V-MoE和Swin-MoE模型的实验显示，激活模式下攻击成功率（ASR）达76-87%，而休眠模式下ASR低于9%，且成功规避了Neural Cleanse、STRIP、Fine-Pruning和Activation Clustering等主流后门检测方法。

Insight: 创新点在于首次将MoE的批次依赖容量机制识别为安全攻击面，并设计了三阶段攻击框架（后门注入、中性化器训练、批次自适应容量配置），实现了动态隐蔽的后门激活；从客观角度看，这揭示了可扩展视觉MoE架构中由计算效率设计引入的固有安全风险，对模型安全审计具有重要警示意义。

Abstract: Mixture-of-Experts (MoE) has become a prevalent paradigm for scaling Vision Transformers efficiently. To ensure computational scalability and prevent expert overload, Vision MoE architectures employ a capacity-bounded token dispatch mechanism, where each expert’s processing budget depends on the inference batch size. This work identifies this batch-dependent behavior as an overlooked attack surface, and proposes a stealthy supply-chain backdoor attack that exploits this property through a three-phase framework. First, we inject a backdoor into an early MoE layer. Second, we train a neutralizer in a deeper MoE layer that suppresses the backdoor under normal capacity. Third, we configure a batch-adaptive capacity factor that preserves high capacity for small batches while reducing it for large batches, naturally disabling the neutralizer via token overflow at deployment-scale batch sizes. The attack remains in dormant mode during small-batch security audits and enters activation mode during large-batch deployment. Experiments on V-MoE and Swin-MoE across ImageNet-100 and GTSRB demonstrate activation-mode attack success rates of 76-87% with dormant-mode ASR below 9%, while evading Neural Cleanse, STRIP, Fine-Pruning, and Activation Clustering. Our findings reveal a fundamental security risk arising from batch-dependent execution in scalable Vision MoE architectures.

[43] RSFusionDet: Underwater RGB-Sonar Multimodal Object Detection cs.CVPDF

Zhuoyan Liu, Yihan Wang, Bo Wang, Bing Wang, Ye Li

TL;DR: 论文提出了RSFusionDet，一种用于水下RGB-声纳多模态目标检测的新方法。通过创建RGB-Sonar Fusion (RSFusion)数据集和相应评估指标，并设计Cross-Attention Fusion (CAFusion)模块和Object Matching Head (OMHead)来融合互补的RGB与声纳模态特征并匹配跨模态的同一物体。

Details

Motivation: 水下单模态目标检测面临挑战：光学图像受水下噪声和可视距离限制，声纳图像则缺乏物体结构信息。RGB和声纳模态在水下具有互补性，因此需要开发有效的多模态融合检测方法。

Result: 在自建的RSFusion数据集上，RSFusionDet在目标检测上达到76.4/48.6 AP (RGB/声纳)，在物体匹配上达到83.4 F1-Score，优于其他检测模型。相比DINO基线，RGB和声纳AP分别提升0.7和1.4，同时提供可靠的跨模态物体匹配。

Insight: 创新点包括：1) 构建了RGB-声纳多模态目标检测数据集和基准；2) 提出CAFusion模块处理空间未对齐特征融合；3) 设计OMHead与OMLoss实现跨模态物体匹配。从客观角度看，其将注意力机制与匹配损失结合，为异构传感器融合提供了新思路。

Abstract: Underwater unimodal object detection faces many challenges in sensor imaging, such as optical images limited by underwater noise and visible distance, and sonar images limited by less object structural information. While, optical images have rich object structural information, and sonar images are less affected by underwater noise and have a longer visible distance. Optical (RGB modality) and sonar (Sonar modality) images have complementary information underwater. In this paper, we create an RGB-Sonar multimodal object detection dataset, \textbf{R}GB-\textbf{S}onar \textbf{Fusion} (RSFusion) and propose evaluation metrics for the benchmark. And we propose the \textbf{R}GB-\textbf{S}onar \textbf{Fusion} \textbf{Det}ector (RSFusionDet) with a new RGB-Sonar multimodal object detection result expression for RGB-Sonar multimodal object detection. We analyze the features of RGB and Sonar modal information, and design a Cross-Attention Fusion (CAFusion) module to fuse RGB-Sonar spatial misalignment features and Object Matching Head (OMHead) with Loss (OMLoss) to match identical objects in RGB-Sonar modalities. Our RSFusionDet achieves 76.4/48.6 AP (RGB/Sonar) for object detection and 83.4 (\text{F1-Score}_{match}) for object matching, on RSFusion, which outperforms other object detection models. Compared with the DINO baseline, our method improves by 0.7/1.4 AP (RGB/Sonar) while simultaneously providing reliable cross-modal object matching. The code and datasets are publicly available at https://github.com/LEFTeyex/RSFusionDet.

[44] Efficient Training with Foresight: Multi-Token Auxiliary Supervision for Autoregressive Image Generation cs.CVPDF

Guo Niu, Xiongfei Yao, Teng Wang, Nannan Zhu

TL;DR: 本文提出了一种名为多令牌自回归（MTAR）的统一训练框架，旨在解决自回归图像生成中存在的监督稀疏短视、表征区分度不足以及训练成本高昂的问题。该框架通过多令牌预测、令牌级对比正则化和语义丢弃三个仅在训练时使用的组件，在提升生成质量的同时显著提高了训练效率。

Details

Motivation: 传统自回归图像生成中的下一令牌预测存在监督稀疏短视、表征区分度不足以及对完整令牌序列进行密集计算导致训练成本高的问题，MTAR框架旨在从预测目标、表征正则化和训练效率三个方面系统性地解决这些问题。

Result: 在ImageNet数据集上，与LlamaGen基线相比，MTAR实现了更低的FID（最高降低0.95）和更快的训练速度（提升39%）。即使仅使用1/3的训练迭代次数，其性能仍与基线相当或更优，大幅减少了训练时间。

Insight: 创新点在于将多令牌预测、对比正则化和基于语义的加速策略整合到一个统一的训练框架中，共同作用于改善监督信号、增强表征可区分性和减少冗余计算，且这些改进仅在训练阶段引入，不影响推理效率。

Abstract: Autoregressive (AR) image generation has shown strong potential for scalable high-fidelity synthesis by modeling images as discrete token sequences. However, traditional next token prediction (NTP) continues to suffer from sparse and myopic supervision, insufficiently discriminative representations, and high training cost caused by dense computation over the full token sequence. To address these issues, we propose multi-token autoregressive (MTAR), a unified training framework that improves autoregressive image generation from three aspects: prediction objectives, representation regularization, and training efficiency. Specifically, MTAR introduces multi-token prediction (MTP) to alleviate the sparsity and myopia of traditional NTP by imposing joint supervision on multiple future tokens; employs token-level contrastive regularization (TCR) to explicitly enhance the separability of sampled token representations and thereby improve representation discriminability; and incorporates semantic dropping (SD) as a semantics-aware training acceleration strategy to reduce redundant computation on low-information tokens while preserving informative learning signals. All three components are applied only during training and introduce no additional overhead during autoregressive inference. On ImageNet, MTAR achieves a better balance between generation quality and training efficiency. Compared with LlamaGen, MTAR achieves up to 0.95 lower FID and 39% faster training. Moreover, even with only 1/3 of the training iterations, it still attains performance comparable to or better than the baseline, substantially reducing training time.

[45] AdaptiveEmbed: Sample-Adaptive Multi-Vector Representation for Multimodal Retrieval cs.CVPDF

Xinze Liu, Lei Yang, Dayan Wu, Hengjie Zhu, Zihao Zhang

TL;DR: 本文提出了样本自适应多向量表示（SAMVR）这一新的多模态检索问题设置，并提出了AdaptiveEmbed统一框架来学习样本自适应的多向量表示。该框架通过多组对比学习和效用策略优化，根据样本特定的检索效用动态分配表示容量，从而超越了固定容量多向量表示的性能。

Details

Motivation: 现有多向量表示方法通常对所有样本使用固定的表示容量（向量数量），忽略了不同样本可能具有不同的检索难度和表示需求。本文旨在研究如何在样本级别自适应地分配多向量表示的容量，以更有效地利用表示资源。

Result: 在涉及图像、文本、视频和音频的多模态检索基准测试中，样本自适应容量分配方法在整体检索性能上优于固定容量的多向量表示方法，验证了SAMVR的有效性。

Insight: 核心创新在于将多向量表示的容量分配问题形式化为一个样本自适应的优化问题（SAMVR），并提出了一个结合多组对比学习和基于边际效用的策略优化（UPO/MUA）的统一框架来实现。这为多模态检索中动态资源分配提供了新思路。

Abstract: Multi-vector representations have emerged as an effective paradigm for multimodal retrieval, representing each sample with multiple complementary embeddings to capture fine-grained cross-modal information. However, existing approaches typically employ a fixed representation capacity, assigning the same number of vectors to all samples regardless of their individual retrieval demands. Such a fixed-capacity formulation overlooks the fact that different samples may require different amounts of representation capacity for effective retrieval. In this work, we introduce \emph{Sample-Adaptive Multi-Vector Representation} (SAMVR), a new problem setting for multimodal retrieval that studies how multi-vector representation capacity can be allocated at the sample level. Under SAMVR, each sample is represented by a \emph{content-adaptive embedding set} (CAES), whose capacity is determined according to the sample-specific retrieval utility of additional representation vectors. To instantiate SAMVR, we propose \emph{AdaptiveEmbed}, a unified framework for learning sample-adaptive multi-vector representations. AdaptiveEmbed learns structured multi-vector representations through \emph{Multi-Group Contrastive Learning} (MGCL) with the symmetric \emph{set-to-set similarity} (SetSim), and further employs \emph{Utility Policy Optimization} (UPO) to determine sample-specific representation capacity via \emph{Marginal Utility Allocation} (MUA). Experiments across multimodal retrieval benchmarks involving image, text, video, and audio show that sample-adaptive capacity allocation achieves overall better retrieval performance than fixed-capacity multi-vector representations, validating the effectiveness of SAMVR for multimodal retrieval. These results establish SAMVR as a viable formulation for adaptive capacity allocation in multi-vector multimodal retrieval.

[46] Bootstrapping a 4D LiDAR Annotation Tool from Video Foundation Models cs.CVPDF

Jihun Kim, Hyun-Kurl Jang, Hyemin Yang, Jinnyeong Yang, Hyeokjun Kweon

TL;DR: 本文提出了LiDAR-SAM2框架，旨在解决4D LiDAR分割领域数据标注成本高、难以扩展的问题。该框架利用2D视频基础模型SAM2，通过多视图投影和时空聚合自动生成高质量、时序一致的LiDAR点云序列标签，无需人工标注。实验表明，在SemanticKITTI数据集上，其生成的标签质量接近全人工标注，且基于此训练的模型性能接近全监督方法。

Details

Motivation: 4D LiDAR分割的进展受限于数据，因为为稀疏点云序列分配时序一致的标签成本高昂、难以扩展，且每个新任务或领域都需要重新进行密集标注。这促使研究者探索能否无需人工标注，自动生成高质量的LiDAR训练数据。

Result: 在SemanticKITTI数据集上，LiDAR-SAM2仅需每个物体少量点击即可生成接近全人工标注质量的语义和全景分割标签。基于这些标签训练的模型性能接近使用全真实标注监督的模型水平。

Insight: 创新点在于将2D视频基础模型（SAM2）通过定制化的模态接口和两阶段学习目标，适配到时空LiDAR结构上，从而将视频分割能力转化为可扩展的4D LiDAR监督源。这为3D/4D场景理解提供了一种大幅降低标注负担的自动化标注工具新思路。

Abstract: Progress in 4D LiDAR segmentation is bottlenecked by data. Assigning temporally consistent labels across sparse point cloud sequences is costly and hard to scale, and every new task or domain tends to demand fresh dense annotation. This motivates a simple question of whether high-quality LiDAR training data can be produced automatically, without any human labeling. To this end, we introduce LiDAR-SAM2, a framework that turns a 2D video foundation model, SAM2, into a scalable source of supervision for the 4D LiDAR domain. On the data side, it automatically generates temporally coherent LiDAR-level labels from SAM2 video masks through multi-view projection and spatio-temporal aggregation. On the modeling side, a tailored modality interface and a two-stage learning objective adapt SAM2’s video segmentation kernel to spatio-temporal LiDAR structure, so that a single click per object yields a consistent mask track across the sequence. Trained with no human LiDAR annotation, LiDAR-SAM2 produces semantic and panoptic labels on SemanticKITTI that approach the quality of full human annotation from only a few points, and models trained on these labels approach the performance of full ground-truth supervision. This positions LiDAR-SAM2 as a scalable labeling tool that substantially reduces the annotation burden for 3D and 4D scene understanding.

[47] VGA-BenchV2: An Expanded Unified Benchmark and Multi-Model Framework for Evaluating Video Aesthetics and Generation Quality cs.CV | cs.AIPDF

Longteng Jiang, DanDan Zheng, Qianqian Qiao, Heng Huang, Huaye Wang

TL;DR: 本文介绍了VGA-BenchV2，这是一个扩展的统一基准和多模型框架，用于联合评估和改进视频生成的质量与美学价值。它在VGA-Bench的基础上，保留了原有的细粒度分类法（美学和生成两大维度及52个子维度），并大幅扩展了人工标注数据（新增36,000个任务级标注）。利用这些标注，作者开发了一个混合评估器架构，包括用于连续美学评分的VAQA-Net，以及基于Qwen的大型视觉语言模型评估器VTag-Net和VGQA-Net，分别用于美学标记和生成质量评估。实验表明该评估器与人类判断高度一致。此外，VGA-BenchV2还引入了一个从评估到优化的流程，将学习到的美学评估器用作基于强化学习的生成器微调的奖励模型，从而形成了一个从基准构建、人工监督到自动评估和模型优化的闭环。

Details

Motivation: 为了解决现有基准在联合评估视频生成质量和美学价值方面的不足，并扩展人工标注监督以支持更可靠的自动化评估，作者构建了VGA-BenchV2。其动机是创建一个统一的、人类对齐的基准和优化框架，以推动视频生成模型不仅在真实性上，而且在美学质量和人类偏好对齐方面得到改进。

Result: 广泛的实验表明，所提出的混合评估器架构（VAQA-Net、VTag-Net、VGQA-Net）在多样化的生成模型上与人类判断表现出强对齐。该基准包含了由12个主流视频生成模型根据1,016个多样化提示生成的超过60,000个视频，并提供了大规模的人工标注（总计36,000个任务级标注）。

Insight: 论文的创新点在于将细粒度的视频美学与生成质量评估基准（VGA-BenchV2）与一个混合评估器架构（结合了专用网络和基于大型视觉语言模型的评估器）以及一个评估到优化的闭环流程相结合。这为视频生成领域提供了一个从标准化评估到直接利用评估信号进行模型优化的完整框架，有望系统性提升生成视频的美学价值和人类偏好对齐。

Abstract: We introduce VGA-BenchV2, an extended human-aligned benchmark and optimization framework for jointly evaluating and improving video generation quality and aesthetic value. Built upon VGA-Bench, VGA-BenchV2 preserves the original fine-grained taxonomy with two primary dimensions-Aesthetic and Generation-and 52 sub-dimensions. Guided by this taxonomy, we curate 1,016 diverse prompts and collect over 60,000 videos generated by 12 mainstream video generation models. More importantly, VGA-BenchV2 substantially expands human-labeled supervision by adding 36,000 task-level annotations, including 16,200 for aesthetic quality, 13,200 for aesthetic tagging, and 6,600 for generation quality, corresponding to 13.46x, 11.15x, and 1.55x scale-ups over VGA-Bench, respectively. Leveraging this enlarged annotation corpus, we develop a hybrid evaluator architecture consisting of VAQA-Net for continuous aesthetic scoring and two Qwen-based Large Vision-Language Model evaluators, VTag-Net and VGQA-Net, for aesthetic tagging and generation quality assessment. Extensive experiments demonstrate strong alignment with human judgments across diverse generation models. Beyond evaluation, VGA-BenchV2 further introduces an evaluation-to-optimization pipeline, where the learned aesthetic evaluator serves as a reward model for reinforcement learning-based generator fine-tuning. This closes the loop from benchmark construction and human supervision to automated evaluation and model optimization, enabling video generators to improve not only in realism but also in aesthetic quality and human preference alignment. Resources are available at https://huggingface.co/datasets/BestiVictoryLab/VGA-Bench.

[48] 4DStreamCtrl: Interactive Video Generation with Online 4D Control cs.CV | cs.AIPDF

Shiqian Li, Chenguo Lin, Zhiguang Liu, Yu Tang, Jiarong Ou

TL;DR: 本文提出了4DStreamCtrl，一种能够实时生成并交互式控制视频中物体和相机运动的模型。该方法通过将相机运动、物体轨迹和深度统一为3D点轨迹表示，实现了在单个前向传播中联合控制相机与物体、编辑深度以及进行运动迁移。模型采用轻量级几何运动头编码3D运动信息，并通过蒸馏技术实现因果流式生成，能够以20 FPS的速度生成长度不受限制的480p视频。

Details

Motivation: 现有视频生成模型在细粒度控制方面存在局限：基于相机参数的方法无法控制物体运动，2D轨迹方法忽略了深度和遮挡，而3D方法则无法实时生成。本文旨在统一对相机和物体的3D一致控制，并实现实时流式生成，以构建交互式视频生成工具。

Result: 在运动控制精度上，该方法超越了现有的仅控制相机、2D控制以及离线3D控制方法。模型在单个高端GPU上能以20 FPS的速度生成480p视频，并在数百帧内保持时间一致性，首次实现了交互式的4D可控流式生成。

Insight: 核心创新在于将相机、物体和深度控制统一为单一的3D点轨迹表示，并设计了轻量级几何运动头来编码该表示。通过因果蒸馏实现流式生成，使得模型能够高效、实时地生成长视频，为构建具有闭环时空控制的交互式世界模型提供了方向。

Abstract: Generative video models now synthesize footage nearly indistinguishable from reality. Their promise as interactive tools hinges on fine-grained control of how objects and the camera move over time, yet each existing approach captures only part of this: camera-parameter methods steer the viewpoint but cannot move objects, 2D-trajectory methods act in the image plane and ignore depth and occlusion, and recent 3D methods add geometry but run only offline at a fixed length. In particular, none combines 3D-consistent control of both camera and objects with real-time, streaming generation. Here we show that camera motion, object trajectories, and depth can be unified into a single 3D point-track representation, from which one model performs joint camera and object control, depth editing, and motion transfer in a single forward pass. To learn this interface at scale, we mine in-the-wild video for 3D motion supervision, yielding OpenVidHD-Motion3D, and encode it with a lightweight Geometric Motion Head that plugs into a pretrained video diffusion model. Because this encoder is temporally separable, we distill the model into a causal streaming student that generates arbitrarily long video in four denoising steps at memory independent of length. This unified design surpasses prior camera-only, 2D, and offline-3D methods in motion-control precision while covering modalities they address only in isolation. 4DStreamCtrl runs at 20 FPS on a single high-end GPU for 480p video and stays temporally coherent over hundreds of frames, enabling, to our knowledge, interactive 4D-controllable streaming generation for the first time. More broadly, grounding generation in explicit 3D geometry with efficient causal inference points toward interactive world models with closed-loop spatiotemporal control, from controllable simulators to real-time visual imagination for embodied agents.

[49] Semi-Supervised Adaptation of Vision-Language Models for Image Classification cs.CVPDF

Mohamed L. Mekhalfi, Mohamad M. Al Rahhal, Yakoub Bazi, Salah E. Khenfer, Mingdeng Shi

TL;DR: 本文提出了一种名为SE-CLIP的半监督框架，用于将视觉语言模型（如CLIP）适应到卫星图像场景分类任务中。该方法通过一个包含初始预热和递归发现的双阶段流程，从无标签数据中迭代挖掘高置信度样本，并采用类平衡选择策略来优化支持集。

Details

Motivation: 动机在于解决CLIP等视觉语言模型在卫星图像上性能受限的问题，特别是当标注样本稀缺时，现有参数高效适应技术的效果不佳。

Result: 在UCM和NWPU基准测试上，SE-CLIP显著优于现有的半监督方法，为遥感领域适应视觉语言模型提供了有效解决方案。

Insight: 创新点包括递归标签挖掘的双阶段半监督框架，以及类平衡选择策略以防止模型被易学类别主导，这减少了人工干预需求并提升了模型在特定领域的适应性。

Abstract: Vision-language models like CLIP have shown sig- nificant potential in handling natural images, yet their perfor- mance is often limited by the distinct characteristics of satellite imagery. While parameter-efficient adaptation techniques exist, their efficacy is frequently limited by the scarcity of annotated samples. In this letter, we propose Self-Evolutionary CLIP (SE- CLIP), a semi-supervised framework designed for recursive label mining in scene classification. The approach follows a dual-phase pipeline, where an initial warm-up on a few annotated seeds is followed by a recursive discovery phase that iteratively identifies high-confidence samples from unlabeled pools. To maintain the integrity of the evolving support set, we employ a class-balanced selection strategy that prevents the model from being dominated by easily learned categories. Results on the UCM and NWPU benchmarks indicate that SE-CLIP significantly outperforms existing semi-supervised approaches. The framework provides a viable solution for adapting VLMs to the remote sensing domain with minimal human intervention.

[50] SMART: MLLM-guided Temporal Alignment for Unifying Sign Language Recognition and Spotting cs.CVPDF

Eunjee Choi, JungHoon Sung, Seongwhan Cho, Chu Xin, Younggeun Choi

TL;DR: 本文提出SMART框架，通过多模态大语言模型（MLLM）生成运动描述作为语义线索，在小批量训练下实现稳定的视频-文本对齐，以统一手语识别与定位任务。该框架包含多尺度时序适配器增强时序表示学习，并引入CSFormer模块将识别得到的语素证据注入边界感知的定位网络，使识别与定位相互促进。

Details

Motivation: 现有连续手语识别方法依赖句子级语素标注，对细粒度表示学习的时序和语义指导有限，且传统视频-文本对齐需要大批量训练，对内存密集型的手语视频训练效率低下。

Result: 在PHOENIX14-T、CSL-Daily、Large-scale KSL和Disaster and Safety KSL四个手语基准数据集上的实验表明，SMART在识别和定位任务上均有效，实现了统一框架下的性能提升。

Insight: 创新点包括利用MLLM生成辅助语义描述以增强对齐稳定性，设计多尺度时序适配器建模时序交互，以及通过CSFormer模块实现识别与定位的协同监督，形成弱监督与密集定位的互补优化。

Abstract: Continuous sign language recognition (CSLR) aims to recognize gloss sequences from unsegmented sign videos under weak sequence-level supervision. However, existing methods rely on sentence-level gloss annotations, providing limited temporal and semantic guidance for fine-grained representation learning. Conventional video-text alignment also requires large batch sizes, making it inefficient for memory-intensive sign language video training. In this work, we propose SMART, an MLLM-guided temporal alignment framework for joint sign recognition and spotting. SMART uses MLLMgenerated motion descriptions as auxiliary semantic cues and performs stable videotext alignment under small-batch training. To improve temporal representation learning, we introduce a Multi-Scale Temporal Adapter that models temporal interactions during transformer encoding. For dense temporal localization, SMART incorporates CSFormer, a CSLR-guided spotting module that injects recognition-derived gloss evidence into a boundary-aware spotting network. This unified framework enables CSLR features to benefit spotting, while spotting supervision complements weak CTC-based recognition. Experiments on four sign language benchmarks, including PHOENIX14-T, CSL-Daily, Large-scale KSL, and Disaster and Safety KSL datasets, demonstrate the effectiveness of SMART across both recognition and spotting tasks.

Bohan Deng, Shuo Ye, Zitong Yu

TL;DR: 本文提出了一个用于非对称跨模态细粒度视觉分类（FGVC）的新框架ACF-Net，并构建了一个新的鸟类音频-视觉基准数据集BirdPro。ACF-Net通过光流引导运动模块和不对称跨模态自适应融合模块，解决了音频与视频未严格同步或不对应情况下的表示学习和模态对齐挑战。

Details

Motivation: 解决在非对称跨模态场景下的细粒度视觉分类问题，即配对的视频和音频并非严格同步，甚至可能不对应同一主体或时刻，这种弱对应关系给表示学习和模态对齐带来了巨大挑战。

Result: 在构建的BirdPro数据集上进行的广泛实验表明，ACF-Net相比代表性基线方法取得了最佳结果，在融合和不匹配设置下分别比最强基线高出2.97%和1.92%，达到了SOTA水平。

Insight: 创新点在于提出了一个专门针对非对称跨模态场景的框架，通过光流引导提取运动敏感视觉线索以抑制背景干扰，并引入不确定性感知的自适应融合机制来估计弱匹配下的模态可靠性。此外，构建的大规模鸟类音频-视觉数据集BirdPro填补了该研究领域的数据空白。

Abstract: Audio-visual cross-modal Fine-Grained Visual Categorization (FGVC) aims to identify fine-grained categories by jointly leveraging visual and auditory information. However, FGVC under asymmetric cross-modal scenarios has received limited attention, where paired video and audio are not strictly synchronized and may not even correspond to the same individual or moment. Such weak and ambiguous cross-modal correspondence poses substantial challenges to effective representation learning and modality alignment. To address these issues, we propose ACF-Net, a novel optical flow-guided framework for asymmetric audio-visual fine-grained learning. ACF-Net consists of two key modules: Optical Flow-Guided Motion (OFGM) and Asymmetric CrossModal Adaptive Fusion (ACAF). OFGM captures motion-sensitive visual cues and suppresses irrelevant background interference, thereby enhancing discriminative dynamic representations in videos. ACAF estimates modality reliability under weakly matched audio-video pairs and performs uncertainty-aware adaptive fusion to improve category-level recognition robustness. To support research on asymmetric cross-modal FGVC, we further construct BirdPro, a new bird-oriented audio-visual benchmark, since existing datasets often lack large-scale category-level audio-video associations under non-strict temporal and instance correspondence. BirdPro contains 1,919 audio recordings and 11,965 videos covering 194 bird species. Extensive experiments show that ACF-Net achieves the best results compared with representative baseline methods, outperforming the strongest baselines by 2.97% and 1.92% in the fused and mismatched settings, respectively.

[52] Video-IFBench: Evaluating Instruction Following of Multimodal LLMs in Video Understanding Scenarios cs.CVPDF

Hongbo Liu, Peixian Chen, Sihan Liu, Peiyuan Zhang, Kai Zou

TL;DR: 本文介绍了Video-IFBench，一个用于评估多模态大语言模型在视频理解场景中遵循指令能力的综合性基准。该基准要求模型满足用户指定的多样化约束，包括基于视觉和音频内容的约束。作者构建了一个包含四类指令模板、32种任务类型和39个约束类别的数据集，并通过半自动管道创建了1.5K个样本。对超过20个近期MLLMs的大规模评估表明，当前模型在遵循视频指令方面仍面临挑战，特别是在处理多约束、语义约束或复杂条件结构时。

Details

Motivation: 现有的视频理解基准主要关注任务准确性，而忽略了模型遵循用户指令（即满足多样化约束）的能力，这一能力在现实世界视频理解中至关重要，但目前尚未得到充分探索和评估。

Result: 对超过20个近期MLLMs的大规模评估显示，当前模型在Video-IFBench上的表现仍具挑战性，尤其是在处理约束数量多、涉及语义约束或需要基于视频内容选择正确分支的复杂条件指令时。

Insight: 论文的创新点在于首次系统性地构建了一个专注于评估视频理解中指令遵循能力的基准，并提出了一个涵盖语义和格式要求的细粒度指令与约束分类法。从客观角度看，其半自动数据构建管道（结合MLLMs、程序化处理和人工验证）为高效创建高质量、复杂指令的评估数据提供了可借鉴的方法。

Abstract: Multimodal Large Language Models (MLLMs) have shown strong performance in video understanding. However, their ability to follow instructions in this domain remains under-explored. Real-world video understanding requires models not only to interpret video content correctly, but also to satisfy diverse user-specified constraints. Existing benchmarks focus primarily on task accuracy rather than instruction adherence, leaving this capability insufficiently evaluated. To address this gap, we introduce Video-IFBench, a comprehensive benchmark for evaluating instruction following in video understanding, where models must satisfy diverse user-specified constraints, including those grounded in visual and audio content. We develop an instruction taxonomy with four templates, including single-task, multi-task, selection, and nested instructions, covering 32 task types and 39 manually designed constraint categories spanning both semantic and format requirements. To reduce annotation cost, we build a semi-automatic data construction pipeline that combines MLLMs, programmatic processing, and human verification, resulting in 1.5K samples. We conduct a large-scale evaluation of more than 20 recent MLLMs and show that video instruction following remains challenging for current models, especially for instructions with many constraints, semantic constraints, or complex conditional structures that require selecting the correct branch or path based on video content. We hope our work will facilitate future research on instruction following in video understanding scenarios.

[53] AdaVDR: Adaptive Tool Use and Reflection for Video Deep Research cs.CV | cs.AIPDF

Xintong Zhang, Xiaomeng Fan, Shilin Yan, Ekko He, Zicheng Liu

TL;DR: 本文提出AdaVDR，一种用于视频深度研究（Video Deep Research, VDR）的自适应智能体，旨在通过理解视频内容并检索外部知识来回答复杂问题。其核心创新在于自适应工具调用与反思机制，即根据任务和模型能力选择工具，并在不可靠时进行回溯修正。为此，作者构建了一个数据生成流程来创建高质量QA对和工具使用轨迹，并引入了模型条件化的工具必要性过滤，以生成适配目标模型能力的训练数据。

Details

Motivation: 视频深度研究需要结合视频理解和开放网络检索来回答复杂问题，但不同问题和视频需要不同的工具使用策略，不当的工具调用会导致错误结果，且不确定的定位和检索会带来高延迟和推理错误。

Result: 在作者构建的VDR-EE基准测试（涵盖以实体和事件为中心的问题）上，该方法在评估的开源模型中表现最佳，并在VideoDR基准上相比其基础模型有显著提升。

Insight: 主要创新点包括：1）自适应工具调用与反思机制，实现按需工具选择和错误回溯；2）一个高质量视频深度研究数据构建流程，能生成任务特定的工具使用轨迹；3）模型条件化的工具必要性过滤，根据目标模型的理解能力和内部知识精简工具链，使训练数据更贴合模型实际能力。

Abstract: Video deep research answers complex questions by jointly understanding video content and retrieving external knowledge from the open Web. However, diverse questions and videos require different tool-use strategies, and inappropriate tool calls can produce incorrect results. Uncertain grounding and retrieval also make unnecessary interactions costly and error-prone, increasing latency and reasoning errors. To address these challenges, we propose AdaVDR, an adaptive video deep research agent with adaptive tool invocation and reflection. AdaVDR selects tools according to the task and its capabilities, and backtracks only when unreliable intermediate results require correction. To enable these capabilities, we develop a video deep research data construction pipeline. We first discover retrieval-relevant events and entities in diverse videos and acquire detailed information through grounding and external retrieval to construct high-quality QA pairs. For each QA, task-specific prompts organize the information acquisition process into a tool-use trajectory, allowing different question and video types to follow different grounding and retrieval strategies. We further introduce model-conditioned tool necessity filtering, which evaluates tool calls against the target model’s video understanding and internal knowledge, removing tools or tool chains the model can bypass. This yields trajectories tailored to the target model’s video understanding capability and knowledge. Using this pipeline, we construct training data and VDR-EE, a benchmark covering entity-centric and event-centric questions. We perform supervised fine-tuning followed by reinforcement learning with a redundancy-aware reward to strengthen adaptive tool invocation and reflection. Experiments show that our method performs best among the evaluated open-source models on VDR-EE and substantially improves over its base models on VideoDR.

[54] CrossMambaTuning: Synergistic Spatial and Cross-Layer Adaptation for Machine Vision Compression cs.CV | cs.AIPDF

Haobo Xiong, Shaobo Liu, Kai Liu, Chongyang Ding

TL;DR: 本文提出了一种名为CrossMambaTuning的新型参数高效微调框架，用于将预训练的深度学习图像压缩模型适配到下游机器视觉任务。该框架通过集成状态空间模型和跨层交互机制，设计了包含任务特定提示和多尺度分支的Mamba适配器，以及一个参数共享的尺度不变跨层适配器，以精确捕获特征并融合跨尺度任务信息。

Details

Motivation: 为了解决现有方法在微调预训练图像压缩模型时，通常独立插入微调模块而缺乏跨层协调机制的问题，旨在降低部署成本和再训练开销。

Result: 大量实验表明，CrossMambaTuning在多个机器视觉任务上实现了最先进的性能，与现有最佳方法相比，参数开销减少了72%。

Insight: 创新点在于将状态空间模型引入参数高效微调，并设计了具有跨层交互机制的适配器结构；其核心洞察是通过任务特定提示、多尺度分支和参数共享策略，协同优化空间和跨层适应，从而高效捕获局部与全局依赖并减少冗余。

Abstract: To reduce deployment cost and retraining overhead, adapting pretrained learned image compression (LIC) models to downstream machine vision tasks has attracted growing attention. However, existing methods typically insert fine-tuning modules independently into frozen backbones, lacking explicit mechanisms for cross-layer coordination. To address this limitation, we propose a novel framework named CrossMambaTuning, which integrates State Space Models with cross-layer interaction mechanisms for parameter-efficient fine-tuning. Specifically, we design an efficient Mamba adapter equipped with task-specific prompts and multi-scale branching to precisely capture both local features and global dependencies. Furthermore, we introduce a Scale-Invariant Cross-Layer Adapter (SICA) utilizing a parameter-sharing strategy to fuse task information across different scales and reduce redundancy. Extensive experiments demonstrate that CrossMambaTuning achieves state-of-the-art (SOTA) performance on multiple machine vision tasks, reducing parameter overhead by 72% compared to SOTA methods. Code is available at https://github.com/rsr1123/CrossMambaTuning.

[55] V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learning cs.CV | cs.AIPDF

Shulin Tian, Minglun Li, Yuhao Dong, Hao Ding, Jiarui Yao

TL;DR: 本文提出V-Rubrics方法，通过基于量规的强化学习提升视觉语言模型在视觉忠实性、推理一致性和指令遵循方面的表现。该方法将参考回答分解为原子命题，并构建包含5万示例的训练集进行训练，实验表明其在知识导向和视觉基础推理基准上显著优于基线模型。

Details

Motivation: 现有视觉语言模型生成的回答常缺乏视觉证据的充分支撑，单一未支持的物体、图表值或中间推理即可破坏整体可信度，这源于多模态后训练中的信用分配失败问题。

Result: 在基于相同SFT检查点的实验中，本文的基于量规的GRPO方法在共享SFT基线和仅答案GRPO上均取得改进，尤其在知识导向和视觉基础推理基准上获得最大提升。

Insight: 创新点在于将参考响应分解为原子命题并构建结构化部分信用评分量规，通过组件化、前缀局部化的量规信用实现更精细的奖励建模，为视觉后训练提供了有效的奖励抽象方法。

Abstract: Vision-language models can produce fluent answers that are insufficiently grounded in the visual evidence: a single unsupported object, chart value, or intermediate inference can undermine an otherwise plausible response. We argue that this is a credit-assignment failure in multimodal post-training. Scalar outcome rewards indicate whether an answer is acceptable, but do not identify which visual facts are grounded, which reasoning steps are valid, or which instruction constraints are missed. We introduce Visual Rubrics-Based Reinforcement Learning, which decomposes reference responses into atomic propositions and scores generated answers along Visual Faithfulness (VF), Reasoning Consistency (RC), and Instruction Following (IF). The resulting rubric items provide structured partial credit and localize rubric credit when supporting evidence spans are available. We first obtain an SFT checkpoint by fine-tuning Qwen3-VL-8B-Instruct on the public OpenMMReasoner-SFT-874K corpus, adapting OpenMMReasoner’s cold-start data recipe. We construct V-Rubrics 50K, a 50,248-example training set from 17 visually grounded sources, by applying rule-based filters before deriving example difficulty from rejection-sampling scores and then annotating every example with Gemini-3-Pro under the same structured prompt and protocol. We train our model based on the same SFT checkpoint using component-wise, prefix-localized rubric credit. Experiments show that our rubricbased GRPO improves over both the shared SFT baseline and answer-only GRPO, with the largest gains on knowledge-oriented and visually grounded reasoning benchmarks. The results show rubrics as a useful reward abstraction for visual post-training.

[56] A Dual-Transformer for Multi-Camera View Recommendation cs.CV | cs.AIPDF

Josep Cabacas-Maso, Carles Ventura, Ismael Benito-Altamirano

TL;DR: 本文提出了一种用于多摄像机视角推荐的Dual-Transformer with Cross-Attention架构，在TVMCE数据集上显著超越了现有SOTA模型。该模型通过解耦时序编码与候选视角查询任务，利用交叉注意力机制让每个候选视角独立地从历史上下文中检索相关信息进行评估。

Details

Motivation: 解决多摄像机系统在媒体制作中的关键编辑任务——如何在每个时刻自动选择最合适的摄像机视角，以替代传统人工编辑流程。

Result: 在TVMCE数据集上达到56.60%的Precision@0.5，大幅超越此前最佳结果37.16%；使用SwinV2骨干网络时性能进一步提升至69.65%。微调实验表明仅用20%视频数据即可实现编辑风格个性化适配。

Insight: 创新性地将时序建模与视角选择解耦，通过交叉注意力机制实现候选视角对历史记忆的独立查询；同时展示了使用轻量级骨干网络（如SwinV2）和少量数据微调即可实现编辑风格个性化迁移的可行性。

Abstract: Multi-camera systems are foundational to modern media production, and multi-camera editing is a critical task. This involves the proper selection of the appropriate camera view at each moment. In this paper, we propose a novel Dual-Transformer architecture with Cross-Attention that heavily outperformed the current SOTA models over the TVMCE dataset (TV Shows Multicamera Editing dataset). Our model decouples these tasks: (1) a dedicated temporal encoder first processes the sequence of past frames to build a rich memory of the recent history, and (2) the candidate camera views then act as queries to this memory via a cross-attention module, allowing each candidate to independently interrogate the historical context and find the most relevant information for its own evaluation. Our approach achieved 56.60% Precision@0.5, representing a substantial improvement over the prior best result of 37.16%. We further conducted an ablation study exploring the use of lightweight backbone architectures, where the SwinV2 backbone yielded the best performance, achieving 69.65% Precision@0.5. Using this best-performing configuration, we then investigated the feasibility of adapting the model to replicate the editing style of a specific human editor. To this end, we fine-tuned the model using varying proportions of the initial segment of a target video. Our results demonstrate that even with only 20% of the video used for fine-tuning, the model exhibited measurable improvements in Precision@0.5, indicating strong potential for data-efficient personalization of editing style adapted to each individual TV show or producer.

[57] MLLMCLIP: Feature-Level Distillation of MLLM for Robust Vision-Language Representations cs.CV | cs.AIPDF

Jongsuk Kim, Qiyu Wu, Zhuoyuan Mao, Hiromi Wakaki, Junmo Kim

TL;DR: 本文提出MLLMCLIP，一个异构蒸馏框架，通过特征级蒸馏将生成式多模态大语言模型（MLLM）的知识直接迁移到判别式CLIP模型中，以增强其组合性能力，避免了合成数据的开销。该方法引入基于注意力的逐层令牌选择和基于CKA的蒸馏损失来弥合架构差异。

Details

Motivation: 解决CLIP等预训练视觉语言模型在组合性（特别是属性-对象和关系结构）任务上表现不佳的问题，同时避免现有方法依赖合成硬负样本带来的复杂流程开销。

Result: 在组合性准确性上达到SOTA水平，并在标准零样本分类和图文检索任务上取得一致提升，表明特征级蒸馏同时增强了组合性和通用视觉语言表示能力。

Insight: 创新点在于提出异构蒸馏框架，直接利用MLLM作为教师模型进行特征级知识迁移，并设计了注意力令牌选择和CKA蒸馏损失来有效桥接生成式与判别式模型之间的架构不匹配问题。

Abstract: Pretrained vision-language models such as CLIP excel at zero-shot recognition but often fail at compositionality, particularly attribute-object and relational structures. Recent studies mitigate this issue by augmenting training with synthetic hard negatives generated by a cascade of large language models and text-to-image models, which incurs substantial pipeline overhead. We instead propose MLLMCLIP, a heterogeneous distillation framework that transfers multimodal knowledge directly from a generative Multimodal Large Language Model (MLLM) teacher into a discriminative CLIP student, bypassing synthetic data entirely. To bridge the architectural mismatch between the two paradigms, we introduce an attention-based per-layer token selection and a CKA-based distillation loss. Compared to prior CLIP-enhancement methods, MLLMCLIP achieves state-of-the-art compositional accuracy while delivering consistent gains on standard zero-shot classification and image-text retrieval, showing that feature-level distillation strengthens both compositional and general vision-language representation capability.

[58] Plans You Can Check: Verifier-Grounded Learning of an Open-Weight Planner for Executable Video-Editing cs.CV | cs.CLPDF

Haoyu Wang, Cheng Feng, Liuyang Bian, Ruiyang Huang, Lei Wei

TL;DR: 本文提出RefineCut，一种用于可执行视频编辑规划的紧凑型开放权重规划器，通过结构化补丁编辑类型化时间线，并使用确定性验证器检查约束。该方法采用验证器重放蒸馏和自评分偏好对训练，最终8B规划器在推理时无需调用教师模型，在RefineCut-Bench上达到0.924的Video-Editing Score。

Details

Motivation: 解决实际视频编辑中的决策层问题，即如何将简报、剪辑池、音乐元数据和硬约束转化为可执行的时间线，而非仅关注像素生成。

Result: 在RefineCut-Bench（3,578个任务）上，验证器重放蒸馏将规划器的Video-Editing Score从0.620提升至0.858，RefineCut-Evo进一步达到0.924；8B规划器在相同闭环中匹配或超越前沿教师模型，且结果可迁移至Llama-3.1-8B和GLM-4-9B。

Insight: 创新点包括：使用验证器重放蒸馏替代直接模仿教师，避免编辑任务缺乏单一真值修复的问题；引入自评分偏好对训练，实现无教师推理的闭环规划；公开了代码和基准数据集，促进可执行视频编辑规划研究。

Abstract: Practical video editing is not only pixel generation: an editor must turn a brief, a clip pool, music metadata, and hard constraints into an executable timeline. We study this decision layer as \emph{executable video-editing planning} and introduce RefineCut, which, unlike workflow systems that wrap a prompted frontier model, trains a compact open-weight planner for it. The planner edits a typed timeline through structured patches covering clip selection, trimming, ordering, transitions, and duration and music alignment; a deterministic verifier applies each patch and checks it against an explicit constraint ledger. Because editing has no single ground-truth repair, we do not imitate teachers directly: RefineCut replays every multi-teacher branch through the verifier and keeps verifier-best repairs as supervision. A second stage, RefineCut-Evo, lets the student score its own repairs with the verifier and a task rubric and trains on high-margin preference pairs, so the final $8$B planner runs in a closed verifier loop with no teacher calls at inference. On RefineCut-Bench ($3{,}578$ tasks, $7{,}971$ captioned clips, $499$ music tracks, explicit ledgers), verifier-replayed distillation lifts the planner from $0.620$ to $0.858$ on the protocol-specific Video-Editing Score and RefineCut-Evo reaches $0.924$; the gain transfers to Llama-3.1-8B and GLM-4-9B, and in the same closed loop the $8$B planner matches or exceeds its frontier teachers. Code and RefineCut-Bench are publicly released; see the Data Availability statement.

[59] On the Separation of Human and AI-Generated Images in CLIP Embedding Space cs.CVPDF

Andrea Asperti

TL;DR: 本文发现CLIP嵌入空间中存在一个未报告的现象：人类绘画和AI生成绘画会沿着其联合嵌入分布的主成分方向自发分离，而无需任何监督目标来区分这两类图像。研究目标不是利用该现象进行检测，而是对其进行解释：旨在识别分离背后的视觉信息，并将其从嵌入空间追溯到图像域。通过结合可解释图像表示和基于梯度的反演进行渐进式研究，逐步排除了基于全局图像属性和简单局部统计的直观解释，指出分布式多尺度图像结构是关键。多尺度散射提供了最具信息量的可解释表示，但仅部分解释了该现象。直接反演提供了一个互补且惊人的观察：沿着CLIP主方向的大幅位移可以由人类观察者几乎无法察觉的图像扰动引起，这表明分离所涉及的方向对人类感知显著性极低的图像变化高度敏感。这些结果共同揭示了CLIP表示中反映的视觉证据与人类感知可及的证据之间存在显著差异，引发了关于人工与人类视觉之间以及最终人工与人类审美判断之间关系的更广泛问题。

Details

Motivation: 旨在解释CLIP表示中人类与AI生成图像自发分离的现象，识别其背后的视觉信息，并探究这种分离如何从嵌入空间映射回图像域，而非直接用于检测任务。

Result: 研究通过渐进式实验（结合可解释表示和梯度反演）发现，分离不能由全局属性或简单局部统计充分解释，而指向分布式多尺度图像结构；多尺度散射提供了部分解释，而直接反演显示沿CLIP主方向的微小、人类难以察觉的扰动即可导致显著位移，表明CLIP对这些低感知显著性变化高度敏感。

Insight: 创新点在于首次报告并系统解释了CLIP嵌入空间中人类与AI生成图像的无监督分离现象，揭示了CLIP表示与人类感知在视觉证据提取上的根本差异；方法上结合可解释表示与梯度反演作为系统性实验探针，为理解模型内部表示与人类视觉的错位提供了新视角。

Abstract: We identify a previously unreported phenomenon in CLIP representations: human and AI-generated paintings spontaneously separate along the dominant principal directions of their joint embedding distribution, without any supervised objective designed to distinguish the two classes. Rather than exploiting this phenomenon for detection, our objective is to interpret it: we seek to identify the visual information underlying the separation and to trace it back from the embedding space to the image domain. We pursue this objective through a progressive investigation combining interpretable image representations with gradient-based inversion, used systematically as an experimental probe of the relationships identified in feature space. Robustness experiments and increasingly expressive statistical descriptors progressively rule out several intuitive explanations based on global image properties and simple local statistics, and point instead to distributed multiscale image structure. Multiscale scattering provides the most informative interpretable representation considered, but offers only a partial account of the phenomenon. Direct inversion provides a complementary and striking observation: substantial displacements along the dominant CLIP directions can be induced by image perturbations that remain nearly imperceptible to human observers, showing that the directions involved in the separation are highly sensitive to image variations with very low perceptual salience for humans. Taken together, these results reveal a significant difference between the visual evidence reflected in CLIP representations and that readily accessible to human perception, raising broader questions about the relationship between artificial and human vision and, ultimately, between artificial and human aesthetic judgment.

[60] SeVeR: Selective Visual Exposure and Retrieval for 3D Medical Image Question Answering cs.CVPDF

Yaojun Hu, Danyang Tu, Yang Liu, Jiajin Zhang, Wei Fang

TL;DR: 本文针对多序列医学影像VQA中冗长视觉序列导致的冗余问题，提出了SeVeR框架，通过模态原型压缩和门控注意力检索多层级证据，并引入边际效用自一致性训练目标抑制无效检索。研究还构建了BreMRIs-VQA临床乳腺MRI基准数据集，包含119万QA对。实验表明SeVeR在减少视觉令牌暴露的同时提升了判别和生成性能。

Details

Motivation: 解决多序列医学影像VQA中因冗余解剖区域重复导致的冗长视觉令牌序列处理难题，提升三维医学图像问答的推理效率。

Result: 在BreMRIs-VQA和公开基准测试中，SeVeR显著减少了视觉令牌暴露量，同时提升了判别性和生成性任务的性能，实现了效率与精度的平衡。

Insight: 创新点包括模态原型压缩机制、变化感知门控注意力检索多层级证据，以及边际效用自一致性训练目标；其核心思想是通过选择性视觉暴露实现冗余信息的高效过滤与互补证据的精准检索。

Abstract: Volumetric medical VQA requires reasoning over long and redundant 3D visual token sequences, especially in multi-sequence MRI where complementary modalities provide diverse diagnostic cues but expose the decoder to many repeated anatomical regions. To investigate reasoning under multi-sequence visual redundancy, we first introduce BreMRIs-VQA, a clinically curated breast MRI benchmark with 1.19M QA pairs from 71.0K sequences and 12.9K patients, covering both free-text and multiple-choice questions. We further propose SeVeR, a selective visual exposure framework that compresses dense volumes into modality-wise prototypes and retrieves complementary multi-level evidence with change-aware gated attention during decoding, trained with a marginal-utility self-consistency objective that suppresses unhelpful retrieval. Experiments on BreMRIs-VQA and public benchmarks show that SeVeR improves both discriminative and generative performance while exposing substantially fewer visual tokens.

[61] MAMA-FLUX.2: Image-to-Image Synthesis of Post-Contrast Breast DCE-MRI for the MAMA-SYNTH Challenge cs.CVPDF

Kamil Kwarciak, Marek Wodzinski

TL;DR: 本文提出MAMA-FLUX.2模型，用于解决动态对比增强乳腺MRI中预对比图像到后对比图像的合成问题。该方法基于FLUX.2-Klein-4B预训练模型，采用条件潜在流匹配技术，并通过LoRA微调和区域训练目标进行高效适配。研究通过消融实验优化了模型参数，最终在MAMA-SYNTH挑战中实现了图像保真度与肿瘤区域准确性的最佳平衡。

Details

Motivation: 动态对比增强乳腺MRI是癌症诊断和监测的关键手段，但依赖于钆基对比剂。本文旨在通过图像合成技术，从预对比MRI生成后对比图像，以减少对对比剂的依赖，并参与MAMA-SYNTH挑战。

Result: 最终模型在MAMA-SYNTH挑战中取得了最佳整体平衡，具体参数为LoRA秩/α=64/64、MHA_max=25、λ_tumor=0.25和λ_stable=0.1。消融研究表明，适度的肿瘤区域和稳定前景加权改善了图像保真度与肿瘤区域准确性之间的权衡。

Insight: 创新点在于将预训练的整流流变换器（FLUX.2）通过参数高效的LoRA微调和任务感知的区域损失（结合全局流匹配、肿瘤区域监督和稳定前景正则化）适配于对比增强MRI合成任务，证明了紧凑预训练模型在医学图像合成中的可迁移性和有效性。

Abstract: Dynamic contrast-enhanced breast MRI is central to cancer diagnosis and monitoring, but requires gadolinium-based contrast agents. In this work, we address pre-to-post contrast breast MRI synthesis for the MAMA-SYNTH challenge. We propose MAMA-FLUX.2, a conditional latent flow-matching approach based on FLUX.2-Klein-4B. The pre-contrast image is encoded as spatial conditioning, while the model predicts the flow field associated with the post-contrast target latent. To adapt the pretrained model efficiently, we use LoRA fine-tuning and introduce a regional training objective combining global flow matching, tumor-region supervision, and stable foreground regularization. We further investigate LoRA rank, intensity windowing, and regional loss weights on axial slices, prioritizing clinically relevant tumor-focused metrics. Our ablation study shows that moderate tumor and stable-foreground weighting improves the trade-off between image fidelity and tumor-region accuracy. The final model achieves the best overall balance with LoRA rank/$α=64/64$, $\mathrm{MHA}{\max}=25$, $λ{\mathrm{tumor}}=0.25$, and $λ_{\mathrm{stable}}=0.1$. These results demonstrate that compact pretrained rectified-flow transformers can be adapted for contrast-enhanced MRI synthesis using parameter-efficient fine-tuning and task-aware regional losses.

[62] Towards Purified Multi-Label Test-Time Adaptation of Vision-Language Models cs.CVPDF

Yiwen Liang, Hui Chen, Yizhe Xiong, Mengyao Lyu, Yuhan Cao

TL;DR: 本文提出了一种名为PuRF的新方法，用于解决视觉语言模型在多标签测试时适应（MLTTA）中的挑战。该方法通过区域净化和缓存净化两个步骤，有效缓解了多标签场景下的一对多映射问题，提升了模型在分布偏移下的性能。

Details

Motivation: 现实世界图像通常包含多个对象，但现有的测试时适应方法主要针对单标签识别，多标签测试时适应研究较少。现有缓存方法直接扩展到多标签场景时，会因共享全局表示纠缠共现对象而导致主导标签偏差和缓存校准问题。

Result: 实验表明，PuRF在五个数据集上持续优于最先进方法，在ViT-B/32模型上实现了4.05% mAP的显著提升。

Insight: 创新点在于提出了区域净化和缓存净化的双重净化机制，前者识别可靠区域以提供细粒度对齐，后者通过情景净化和时间刷新增强缓存表示和长期适应性，从而有效解决了多标签TTA中的一对多映射和区域证据不可靠问题。

Abstract: Test-time adaptation (TTA) has been widely explored in single-label recognition, effectively mitigating distribution shifts, especially when combined with vision-language models. However, real-world images often contain multiple objects, while the more practical multi-label test-time adaptation (MLTTA) has received little attention so far. Recent cache-based TTA methods have shown promising efficiency and effectiveness, yet directly extending them to multi-label scenarios suffers from a one-to-many mapping problem: a shared global representation entangling co-occurring objects is stored as class-wise cache prototypes, inducing dominant-label bias and compromised cache calibration. While introducing region-level cues helps isolate class-specific evidence, such regional evidence can also be unreliable under distribution shifts, making its identification and utilization non-trivial. To address these issues, we introduce PuRF, a novel PuRiFication-driven cache-based method for multi-label test-time adaptation of vision-language models. Specifically, PuRF first performs region purification to identify reliable regions, providing comprehensive regional cues for multi-label recognition and enabling fine-grained alignment. Based on these purified regions, PuRF conducts cache purification to enhance cache representation and adaptability, where episodic purification builds a discriminative region-based cache, and temporal refreshing further promotes long-term cache adaptability. Experiments demonstrate that PuRF consistently outperforms state-of-the-art methods, achieving a notable 4.05% mAP improvement on ViT-B/32 across five datasets.

[63] Skeleton-based Zero-Shot Spatio-Temporal Action Localization via Weakly-Supervised Pretraining cs.CVPDF

Koshiro Nagano, Fumiaki Sato, Ryo Hachiuma, Kazuki Tsutsukawa, Taiki Sekii

TL;DR: 本文提出了一种基于骨架的零样本时空动作定位新预训练策略，通过弱监督视觉语言预训练机制，利用大规模动作场景数据集进行预训练，以降低新目标动作的标注成本并实现未见动作的估计。该方法包含Skeleton-Language特征池化切换机制和场景混合判别对比学习，在四个公开数据集上验证了其有效性。

Details

Motivation: 解决基于骨架的时空动作定位中未见动作估计问题，并克服因新目标动作训练所需的高标注成本，通过弱监督预训练利用大规模数据集减少标注依赖。

Result: 在四个公开时空动作定位和分类数据集上的实验表明，该方法能有效应对标注限制，实现了零样本设置下的性能提升。

Insight: 创新点包括Skeleton-Language特征池化切换机制，实现从视频级到实例级特征的过渡对齐，以及场景混合判别对比学习，通过MIL框架在组合场景中区分实例级动作，提升了零样本泛化能力。

Abstract: We propose a novel pretraining strategy for skeleton-based zero-shot spatio-temporal action localization to estimate unseen actions for person instances while overcoming high annotation costs for training via new target actions and pretraining using large-scale action scenery datasets. Specifically, our approach, termed Skeleton-Language feature Pooling Switching, introduces a weakly-supervised vision-language pretraining mechanism. This mechanism transitions pooling kernels from pretraining, which aggregates skeleton features at the video level and aligns them with each video’s known action text embeddings, to the inference phase that computes instance-level features without training via target actions. Furthermore, we propose Scene-Mixed Discriminative Contrastive Learning to distinguish actions at the instance level within the combined scene through the MIL framework. Our experiments on four public spatio-temporal action localization and classification datasets demonstrate that the proposed method effectively addresses annotation limitations.

[64] Unsupervised Anatomical Feature Learning via Diffusion Models: Enhanced Medical Image Segmentation with Denoising Diffusion Probabilistic Models cs.CV | cs.AI | cs.LGPDF

Akshat G, Divyansh Gupta, Shaleen Bhatnagar, Shilpa Ankalaki, Tusar Kanti Mishra

TL;DR: 本文提出一种利用无监督扩散模型学习解剖特征的方法，以增强医学图像分割性能。通过在未标注的腹部CT扫描上训练DDPM来提取结构表示，并将编码器权重迁移至BTCV多器官分割任务，显著提升了分割精度和边界描绘能力。

Details

Motivation: 医学图像分割中像素级标注获取困难，传统U-Net架构在低数据条件下缺乏全局解剖结构感知，导致边界分割失败，因此需要无监督方法学习解剖先验。

Result: 在BTCV数据集上，扩散预训练使肝脏分割Dice从0.75提升至0.93，ASD降低66%，HD95减少45%；肾脏分割Dice从0.90提升至0.95。多器官分割方差降低68%，边界精度提升74%。在仅10%标注数据下仍保持稳健性能。

Insight: 创新点在于利用扩散模型无监督学习解剖特征作为先验，使U-Net具备解剖结构感知能力；客观分析表明该方法在低数据场景下能有效迁移结构知识，减少对标注的依赖。

Abstract: Acquiring pixel-level annotations for medical image segmentation is a severe bottleneck. Traditional U-Net architectures, while effective, learn local texture patterns and lack awareness of global anatomical structures, leading to boundary delineation failures in low-data regimes. This research paper proposes utilizing unsupervised Denoising Diffusion Probabilistic Models (DDPMs) to extract anatomical features. We train a DDPM on 21 unlabeled abdominal CT scans to learn structural representations, transferring the encoder weights to a downstream segmentation task evaluated on the BTCV multi-organ dataset. Diffusion pretraining significantly improved liver segmentation: Dice increased from $0.75\pm0.36$ to $0.93\pm0.16$ ($p < 5.33\times10^{-26}$, 0.529 Cohen’s d), Average Surface Distance (ASD) decreased by 66%, and 95th-percentile Hausdorff Distance (HD95) reduced by 45%. For kidney segmentation, Dice improved from $0.90\pm0.19$ to $0.95\pm0.10$ ($p < 4.01\times10^{-11}$). Multi-organ pooled performance showed a 68% variance reduction and a 74% improvement in boundary precision (Dice $0.95\pm0.07$). Crucially, frozen encoder models retained > 80% of fine-tuned performance without exposure to segmentation labels, proving the existence of learned anatomical priors. In low-data scenarios, diffusion-pretrained models maintained robust performance with only 50% (Dice: 0.92 liver, 0.94 kidney), 25%, and even 10% (Dice: 0.89 liver, 0.71 kidney) of labeled data. Using unlabeled images for diffusion-based pretraining successfully embeds robust anatomical features prior to human supervision, transforming U-Nets into anatomy-aware systems.

[65] LongVU-TTT: Causal Test-Time Training for Visual Resampling in Long Video Understanding cs.CVPDF

Mahmoud Ahmed, Sameh Abdulah, Olatunji Ruwase, Sam Ade Jacobs, Mathis Bode

TL;DR: 本文提出LongVU-TTT方法，通过引入具有因果快速权重更新的卷积测试时训练（TTT）重采样器，在视觉编码器和LLM之间对长视频进行视觉重采样，以在有限的视觉令牌预算下更好地建模时序变化并保留关键帧证据。

Details

Motivation: 解决长视频多模态大语言模型（MLLMs）在视觉令牌预算有限时，因压缩丢失大部分帧证据而难以有效建模时序变化的问题。

Result: 在MLVU基准上，TTT-Conv比TTT-MLP提升高达+2.12，比双向Mamba2提升高达+3.04；在三个基准测试中优于基于注意力和固定状态的循环重采样器；在五个视频理解基准上达到有竞争力的性能，能处理512帧并压缩至128个LLM帧。

Insight: 创新点在于将因果卷积与测试时训练结合，利用分组2D快速权重对每个视频进行自适应特征上下文化；同时采用混合均匀与变化感知的选择器显式保留视觉证据。分析表明快速权重主要充当时序聚合状态而非长期情景记忆，其效用随证据距离增加而衰减，这为显式帧保留提供了动机。

Abstract: Long-video MLLMs must model temporal change before a limited visual-token budget removes most frame evidence. We introduce LongVU-TTT, which inserts a convolutional Test-Time Training (TTT) resampler with causal fast-weight updates between the vision encoder and the LLM. Its grouped 2D fast weights adapt to each video and contextualize frame features before compression, while a hybrid uniform-and-change-aware selector retains explicit visual evidence for downstream reasoning. Under controlled conditions, TTT-Conv improves over TTT-MLP by up to +2.12 and bidirectional Mamba2 by up to +3.04 on MLVU, and it is stronger than attention- and fixed-state recurrent resamplers across three benchmarks. Analysis shows that the fast weights behave as a temporal aggregation state rather than a reliable long-horizon episodic memory: their benefit attenuates as evidence becomes more distant, motivating explicit frame retention. LongVU-TTT processes up to 512 frames before reducing them to 128 LLM frames and achieves competitive performance across five video understanding benchmarks.

[66] Moving Beyond More Views: Redundancy-Aware Ego-Exo Fusion for Proficiency Estimation cs.CVPDF

Xu Dong, Wanqing Li, Anthony Adeyemi-Ejeye, Andrew Gilbert

TL;DR: 本文提出了一种用于EgoExo熟练度估计的新方法，旨在通过融合第一人称（自我中心）视角的精细运动线索和多个第三人称（外部中心）视角的空间上下文来评估动作质量。研究发现，简单地增加外部视角会因冗余或噪声视角稀释有用运动线索而导致性能下降。为此，论文提出了两个互补模块：AdaMVS（从数据角度自适应识别并融合最具信息量的视图标记）和VIB-GB（从特征角度结合梯度混合与变分信息瓶颈正则化），以压缩冗余信号并抑制训练过程中的过拟合。

Details

Motivation: 解决在EgoExo熟练度估计中，简单地融合更多外部视角会导致性能下降的问题，因为冗余或噪声的视角会稀释有用的运动线索。

Result: 在EgoExo-4D和EgoExo-Fitness基准测试上取得了新的最先进（SOTA）结果。

Insight: 创新点在于从数据和特征两个角度分别处理多视图冗余和过拟合问题：AdaMVS模块通过弱监督自适应选择信息量最大的视图进行融合；VIB-GB模块则利用梯度混合和信息瓶颈正则化来压缩冗余特征并提升泛化能力。这种双管齐下的方法有效地学习了“看哪个视图”以及“如何融合它们”。

Abstract: EgoExo proficiency estimation aims to assess action quality by integrating fine-grained motion cues from egocentric (1st-person) views with spatial context from multiple exocentric (3rd-person) views. Simply adding more exocentric views degrades EgoExo performance, as redundant or noisy perspectives dilute useful motion cues. Our analysis identifies two key causes: (1) Multiview redundancy - From the data perspective, certain views provide limited or noisy information, diluting discriminative cues; (2) Overfitting - From the feature perspective, conventional fusion increases representational complexity, causing the model to memorise view-specific patterns rather than learn generalisable representations. To address these issues, we propose two complementary modules: AdaMVS, which adaptively identifies and fuses the most informative view tokens under weak supervision from the data perspective, and VIB-GB, which combines Gradient Blending and Variational Information Bottleneck regularisation from the feature perspective to compress redundant signals and suppress overfitting during training. Experiments on EgoExo-4D and EgoExo-Fitness demonstrate that our method learns both which view to look at and how to fuse them, achieving new state-of-the-art results. Our source code is available at https://github.com/dx199771/AdaMVS

[67] TDFNet: Tri-projection Deformable Fusion Network for Panoramic Salient Object Detection cs.CVPDF

Qiangqiang Zhou, Jiacong Yu, Jiawei Xu, Yong Chen, Xin Huang

TL;DR: 本文提出了TDFNet，一种用于全景显著目标检测的三投影可变形融合网络，通过结合ERP、CMP和切平面投影的互补表示来缓解几何畸变，并设计了跨投影可变形注意力模块和纬度引导融合模块以提升特征聚合与对齐能力。

Details

Motivation: 现有基于投影的全景显著目标检测方法（如ERP和CMP）存在严重的几何畸变（如极区拉伸或立方体面边界不连续），导致特征判别性下降和几何一致性受损，限制了检测性能。

Result: 论文未在摘要中提及具体定量结果或基准测试，但声称TDFNet是首个利用三投影表示的全景显著目标检测网络，旨在提升检测性能。

Insight: 创新点包括：利用三种投影（ERP、CMP、切平面投影）的互补性构建三分支编码架构；设计跨投影可变形注意力模块实现几何感知的采样；引入纬度引导融合模块自适应平衡特征并整合切平面投影的语义参考以细化特征。

Abstract: Recent years have witnessed the growing potential of panoramic salient object detection in robotic vision, virtual reality, and related applications. However, projecting spherical scenes onto 2D planes inevitably introduces geometric distortions, which fundamentally limit the effectiveness of existing projection-based methods. Specifically, Equirectangular Projection (ERP) suffers from severe polar stretching distortions, while cube map projection introduces discontinuities across cube-face boundaries, resulting in degraded feature discriminability and compromised geometric consistency. To address these limitations, we propose TDFNet, the first Tri-projection Deformable Fusion Network for panoramic salient object detection, exploiting complementary projection representations to alleviate geometric distortions and improve detection performance.Specifically, we design a cross-projection deformable attention (CDA) module that leverages spatial correspondences between different projections to construct geometry-aware sampling locations, guiding deformable attention for cross-projection contextual aggregation and enhancing robustness against projection-induced deformations. Furthermore, we introduce a latitude-guided fusion module, which utilizes spherical latitude priors to construct geometric confidence weights for adaptively balancing ERP and CMP features. Meanwhile, LGF incorporates distortion-reduced semantic references from Tangent Projection to achieve cross-projection feature refinement and spatial alignment.By constructing a three-branch encoding architecture based on ERP, CMP, and Tangent Projection, TDFNet simultaneously preserves global spatial continuity, local geometric details, and fine-grained boundary information.

[68] Label-Free Foundational Model Selection for Medical Image Classification under Distribution Shift via Pseudo Label Discrepancy cs.CVPDF

Juan Iñaki Larrea, Lucas Mansilla, Enzo Ferrante

TL;DR: 本文提出了一种无需目标域标签的医学图像基础模型选择方法，用于处理机构间分布偏移下的部署问题。该方法基于SUDO框架，通过预测概率对无标签目标数据进行分区，并测量每个区域的伪标签差异来反映类别污染，最终聚合得到AURCC评分。实验表明，AURCC能在零样本和MLP探针设置下，对多种视觉语言模型在胸部X光分类任务中进行有效排序，其排序与真实性能排序高度相关。

Details

Motivation: 在医学图像分析中，基础模型在部署时面临机构间分布偏移，导致性能波动且无法在没有目标域标签的情况下评估，而目标域标签通常难以获取。因此，需要一种无需目标域标注的方法，从多个候选基础模型中选择在无标签目标域上表现最佳的模型。

Result: 在三个医院间偏移场景下的胸部X光分类任务中，AURCC评分对多种视觉语言模型（如BioMedCLIP、CXR-CLIP等）的排序与真实性能排序的Spearman相关系数最高达0.943（p<0.05）。与基于源域保留准确率的基线相比，AURCC在源域标注数据量大时表现相当，在数据量小时则能提供更准确的排序。

Insight: 创新点在于提出了一种完全无标签的模型选择标准AURCC，它无需目标域标注或微调，通过伪标签差异量化类别污染来评估模型在分布偏移下的泛化能力。这为资源受限的医疗场景提供了一种实用的模型部署决策工具，特别是在标注数据稀缺时优于传统源域性能基准。

Abstract: Foundation models are increasingly deployed for medical image analysis. However, under the inter-institutional distribution shift typical of deployment, their performance varies widely and cannot be known without target-domain labels, which are rarely available. This leaves a practical question unresolved: given several candidate foundational models and labeled-data from a source domain, which one to deploy in an unlabeled target domain? We propose a label-free selection criterion built on SUDO, a framework for evaluating clinical AI systems without ground-truth annotations. SUDO partitions the unlabeled target data by predicted probability and, for each region, measures a pseudo-label discrepancy reflecting class contamination; aggregated across regions, this yields a score (AURCC) requiring neither target annotation nor fine-tuning. We show that AURCC can be used to rank a variety of vision-language models (BioMedCLIP, CXR-CLIP, CheXzero, MedCLIP, MedImageInsight, CLIP) on chest X-ray classification across three inter-hospital shift scenarios, under zero-shot and MLP-probe regimes. The AURCC ranking recovers the ground-truth ranking with Spearman rho up to 0.943 (p<0.05). Against the natural baseline of ranking by held-out source accuracy, AURCC is competitive when the labeled source is large and yields a more accurate ranking once it is small; the regime of interest in resource-constrained settings.

[69] FlowMoDL: Model-Based Deep Learning with Conjugate-Gradient Data Consistency for Highly Accelerated 4D Flow MRI Reconstruction cs.CV | cs.LGPDF

Tristan Gottwald, Michelle Bruch, Mubashir-Ul Hassan, Fatma Alickovic, Milan Kloiber

TL;DR: FlowMoDL是一种用于高度加速4D血流MRI重建的展开式神经网络，它直接优化解剖学幅度和相位衍生速度的准确性。该方法基于MoDL框架，交替使用学习的(3+1)D时空去噪器和基于SENSE前向模型的共轭梯度数据一致性更新。通过新颖的双路径条件方案，单个模型能够处理不同的加速因子（10倍至50倍），并在多中心CMRx4DFlow数据集上超越了经典和深度学习基线方法。

Details

Motivation: 解决高度加速4D血流MRI重建中，同时保证解剖学幅度图像质量和相位衍生速度场生理学准确性的挑战。

Result: 在CMRx4DFlow数据集上，FlowMoDL在幅度SSIM、nRMSE、相对速度误差和角度误差等所有指标上，均严格优于所有对比方法（CG-SENSE, MoDL, FlowVN, FlowMRI-Net），尤其是在梯度步数预算有限的情况下，其收敛鲁棒性和性能优势显著。

Insight: 创新点包括：1）将共轭梯度数据一致性更新集成到展开式网络中以提高效率；2）采用双路径条件方案使单个模型适应不同加速因子；3）使用深度监督复合损失（惩罚速度大小和角度误差）并结合课程学习策略来确保生理学准确性。从客观角度看，其梯度步数效率和对速度场时空一致性的优化是值得借鉴的关键设计。

Abstract: We present FlowMoDL, an unrolled neural network for highly accelerated 4D flow MRI reconstruction that directly optimizes for both anatomical magnitude and phase-derived velocity accuracy. Building on the MoDL framework, FlowMoDL alternates a learned (3+1)D spatiotemporal denoiser with conjugate-gradient data-consistency updates based on the SENSE forward model. A novel dual-pathway conditioning scheme adapts the denoiser features and data-consistency weighting, enabling a single model to handle varying acceleration factors ($10\times$ to $50\times$). To ensure physiological accuracy, the network is trained using a deep-supervision composite loss that explicitly penalizes velocity magnitude and angular errors, stabilized by a curriculum schedule. We evaluate FlowMoDL on the multi-center CMRx4DFlow dataset against classical and deep-learning baselines (CG-SENSE, MoDL, FlowVN, and FlowMRI-Net). A key advantage of FlowMoDL is its superior gradient step efficiency. When evaluated under an equivalent, limited budget of gradient steps, competing flow-specific networks degrade significantly. In contrast, FlowMoDL robustly converges and strictly outperforms all competitors across all acceleration factors in magnitude SSIM, nRMSE, relative velocity error, and angular error, successfully recovering sharp structural details and temporally coherent velocity fields.

[70] DEFUSE: Generalizable Backdoor Defense for Self-Supervised Encoders with Generative Priors cs.CVPDF

Tuo Chen, Jie Gui, Minjing Dong, Lanting Fang, Ju Jia

TL;DR: 本文提出DEFUSE，一种针对自监督学习编码器的通用后门检测框架。该方法将后门检测重新定义为基于条件扩散生成模型的表示条件图像似然估计问题，通过语义重建在参考编码器提供的分离表示空间中评估异常，从而识别后门。DEFUSE显著减少了对受害者编码器或攻击策略先验知识的依赖，并在多种攻击设置下优于现有检测器。

Details

Motivation: 自监督学习编码器易受后门攻击威胁，现有防御方法通常仅针对单一范式（视觉SSL或视觉-语言编码器），且依赖难以满足的假设（如访问未感染的同分布数据或预计算的伪标签）。

Result: 大量实验表明，DEFUSE在多样化攻击设置下大幅优于现有检测器，可泛化至视觉SSL和视觉-语言编码器。

Insight: 创新点在于将后门检测重构为基于贝叶斯后验推断的表示条件图像似然估计问题，并利用预训练扩散模型的生成先验进行微调，以实现语义重建并在分离表示空间中进行评估，从而降低对先验知识的依赖并提升泛化能力。

Abstract: Self-supervised learning (SSL) encoders are vulnerable to backdoor attacks, posing threats to both visual SSL encoders and vision-language encoders. Existing defenses are typically designed for only one of these paradigms and rely on restrictive assumptions such as access to uninfected in-distribution data or precomputed pseudo-labels, which are difficult to satisfy in practice. To address these limitations, we propose DEFUSE, a generalizable backdoor detection framework for SSL encoders. Inspired by Bayesian posterior inference, we reformulate backdoor detection as a representation-conditioned image likelihood estimation problem parameterized by a conditional diffusion generative model. Uninfected representations tend to yield semantically consistent reconstructions, whereas backdoored ones are more likely to be mapped to the attacker’s target class or semantically meaningless images, deviating from the original semantics and thereby exposing the backdoor. However, we find that the exact likelihood is intractable, because highly abstracted representations discard the low-level information necessary for pixel-faithful reconstruction. We therefore relax the objective to semantic reconstruction and evaluate it in a well-separated representation space provided by a reference encoder. Rather than training from scratch, we fine-tune a pretrained diffusion model, leveraging its generative prior to map data onto the natural image manifold while preserving semantic content. Extensive experiments demonstrate that DEFUSE substantially outperforms existing detectors across diverse attack settings, generalizing to both visual SSL and vision-language encoders. Notably, our method greatly reduces the reliance on prior knowledge about the victim encoder or the attack strategy. The source code is available at https://github.com/jsrdcht/DEFUSE .

[71] LUTSeg: A Longitudinal Multi-Expert Dataset for Ulcer Tissue Segmentation cs.CVPDF

Karen Sanchez, Carlos Hinojosa, Albert A. Ávila, Andrea C. Riano-Rojas, Diego H. Romero

TL;DR: 本文介绍了LUTSeg，一个用于慢性溃疡组织分割的纵向多专家标注数据集，包含39名患者的141张图像及五类组织标注。同时提出了TiSage，一个半监督组织分割框架，利用冻结的医学视觉语言模型的多尺度语义先验，在师生架构中进行训练。

Details

Motivation: 量化伤口组织成分对监测慢性溃疡进展和指导治疗至关重要，但像素级标注成本高昂，且多组织伤口数据集稀缺，尤其是针对麻风病等被忽视的疾病。

Result: 在LUTSeg和DFUTissue数据集上评估TiSage，结果显示在大多数低标注设置下，其性能优于有监督和半监督基线方法。

Insight: 创新点在于构建了一个具有多专家标注和纵向数据的溃疡分割基准数据集，并提出了一个结合医学视觉语言模型先验知识的半监督分割框架，以应对标注数据稀缺的挑战。

Abstract: Quantifying wound tissue composition is essential for monitoring chronic ulcer progression and guiding treatment decisions. However, pixel-level annotations are costly, and multi-tissue wound datasets remain scarce, particularly for neglected diseases such as leprosy. We introduce LUTSeg, a longitudinal chronic ulcer dataset comprising 141 images from 39 patients with wound masks and five tissue categories annotated by five expert clinicians, including a multi-expert gold-standard subset for inter-rater agreement analysis. To establish an initial benchmark for LUTSeg, we further propose TiSage, a semi-supervised tissue segmentation framework that integrates multi-scale semantic priors from a frozen medical vision-language model within a teacher-student architecture. We evaluate TiSage on LUTSeg and DFUTissue, showing improvements over supervised and semi-supervised baselines in most low-label settings. Code & data: https://github.com/carlosh93/TiSage

[72] Visual General Intelligence: A White Paper cs.CVPDF

Hirokatsu Kataoka, Yoshihiro Fukuhara, Yonglong Tian, Shangzhe Wu, Oishi Deb

TL;DR: 本文从视觉中心视角重新审视智能，探讨通过视觉经验和学习涌现的智能是否可作为实现通用人工智能（AGI）的途径，即视觉通用智能（VGI）。论文汇集了多领域贡献者的观点，旨在阐明AGI时代计算机视觉应遵循的原则、视觉输入模态、基准测试、学习范式以及以视觉为核心时与其他模态（如语言）的关系。

Details

Motivation: 受GPT系列通过自回归语言建模在文本领域展现的泛化能力启发，论文探索视觉模态（如图像、视频和几何）能否作为实现AGI的路径，解决视觉智能的潜力和发展方向问题。

Result: 论文未提供具体实验数据，而是通过多视角讨论提出框架性见解，旨在为视觉通用智能（VGI）的未来研究建立原则和基准方向。

Insight: 创新点在于将视觉置于智能发展的核心地位，倡导跨模态整合（如视觉与语言），并强调视觉经验学习可能成为AGI的关键途径，为计算机视觉在AGI时代的范式转变提供理论框架。

Abstract: This paper reconsiders intelligence from a vision-centered perspective and examines whether intelligence emerging from visual experience and learning may provide a pathway toward AGI. In the language domain, beginning with the introduction of the Transformer architecture, the GPT series has demonstrated transfer to unseen tasks through autoregressive language modeling on web-scale text combined with aggressive scaling. This raises a natural question, namely, what capabilities and forms of intelligence can emerge from visual modalities such as images, videos, and geometry? In this paper, we discuss whether visual intelligence can serve as a pathway toward AGI, referred to in this paper as visual general intelligence (VGI), by bringing together contributors from diverse standpoints and affiliations. Our aim is not to offer a single definition of visual intelligence, but to clarify the principles that computer vision should pursue in the AGI era, the visual input modalities, the benchmarks, the learning paradigms, and the relationship between vision, when taken as the core, and other modalities such as language.

[73] Code World Model: Coding Agent as World Brain cs.CV | cs.AI | cs.CLPDF

Yiwen Chen, Guosheng Lin, Chi Zhang

TL;DR: 本文提出Code World Model框架，通过将语言模型的推理与编码能力与视频模型的生成先验相结合，将世界演化与视觉呈现分离。编码代理作为世界大脑，推理事件及其后果，生成可执行代码以维护持久世界状态并进行规则一致的演化。通过代理表示连接可执行状态与视觉生成，并利用对齐的代理-观测数据对进行微调，实现灵活的高保真视觉渲染。

Details

Motivation: 现有基于视频的世界模型主要从视觉观测中学习动态，这些观测仅揭示结果而非支配世界演化的底层知识、规则和机制，导致难以维持持久后果和支持连贯、开放式的演化。

Result: 在配对游戏数据上微调后，MiniMax-H3能够遵循编码代理构建的简单交互世界中的基于代理的时空规范，同时保留丰富的视觉细节和动态，展示了结合代码进行持久世界演化与视频模型进行灵活视觉实现的潜力。

Insight: 创新点在于将世界演化与视觉生成解耦，利用编码代理作为世界大脑进行推理和代码生成以维护持久状态，并通过代理表示桥接可执行状态与视觉模型，为开放式世界模型提供了新路径。

Abstract: World models aim to simulate how complex environments evolve under actions and events, yet existing video-based world models primarily learn dynamics from visual observations, which reveal outcomes rather than the underlying knowledge, rules, and mechanisms governing world evolution. This makes it difficult to maintain persistent consequences and support coherent, open-ended evolution. We introduce Code World Model, a framework that separates world evolution from visual realization by combining the reasoning and coding capabilities of language models with the generative priors of video models. A coding agent serves as the world brain, reasoning about events and their consequences and generating executable code to maintain persistent world state and perform rule-consistent evolution. To connect executable state with visual generation, we introduce a proxy representation that encodes frame-wise spatiotemporal constraints and is compiled into a proxy video, which conditions a video model to render high-fidelity visual observations. We further develop data pipelines for constructing aligned proxy-observation pairs from gameplay and real-world videos. After fine-tuning on paired gameplay data, MiniMax-H3 follows proxy-based spatiotemporal specifications from simple interactive worlds built by the coding agent while preserving rich visual details and dynamics. These results demonstrate the potential of combining code for persistent world evolution with video models for flexible visual realization, providing a new path toward open-ended world models.

[74] Auditable CT Phenotyping Through Report-derived Radiological Observations cs.CVPDF

Riga Wu, Walter Witschey, Yicheng Li, Felix Barajas Ordonez, Keno K. Bressem

TL;DR: 该论文提出了一种可审计的CT表型分析方法（ACT），该方法基于从放射学报告中提取的观察结果来预测临床表型。ACT在零样本标注和线性探测任务上超越了多个视觉-语言基线模型，并揭示了模型可能依赖与疾病无关的捷径特征进行预测的问题。通过限制证据库为临床医生指定的观察结果，可以在不损失准确性的情况下将模型注意力引导至与表型相关的有效证据上。

Details

Motivation: 解决医学图像基础模型在预测临床表型时，可能依赖与诊断相关但非疾病特异性的“捷径”特征，而非真正读取疾病特异性发现的问题，旨在提高模型预测的可解释性和可靠性。

Result: 在包含221个电子健康记录表型的测试中，ACT在零样本评分（0.651 vs 0.572）和线性探测（0.709 vs 0.662）上均超越了CT-CLIP等基线模型。通过将证据库限制为临床医生指定的观察结果，在86个表型上实现了模型注意力重定向，且准确率未受损失（0.751 vs 0.741）。

Insight: 创新点在于提出了一种基于报告衍生观察结果的可审计表型分析框架，能够识别并干预模型对无效证据（如主动脉和冠状动脉钙化描述被用于预测骨质疏松等不相关表型）的依赖，从而在保持高准确性的同时增强模型决策的临床可解释性。

Abstract: Medical image foundation models can predict clinical phenotypes from computed tomography (CT), but strong performance leaves open whether they read disease-specific findings or shortcuts that correlate with the diagnosis. We tested this in 221 electronic-health-record (EHR) phenotypes using Auditable CT phenotyping (ACT), built on report-derived radiological observations. We trained ACT on 38,317 patients, mined 376,194 observations and evaluated it in 25,183 held-out patients. ACT exceeded five vision-language baselines on zero-shot annotation, and CT-CLIP across 221 phenotypes from unseen CT pulmonary angiography, both under zero-shot scoring (0.651 versus 0.572) and under linear probing (0.709 versus 0.662). Reading each probe exposes what accuracy conceals: only 97 observations occupy the 221 rank-1 positions, and one phrase describing aortic and coronary calcification ranks first for 20 phenotypes, including osteoporosis, urinary tract infection and major depressive disorder. Restricting the bank to clinician-specified evidence redirects those probes onto phenotype-related observations in 86 phenotypes at no accuracy cost (0.751 versus 0.741). Accurate CT-based EHR phenotyping can therefore rest on observations that are not valid evidence for the coded phenotype and that ACT can identify and intervene on.

[75] TAU-Agent: An Agentic Retrieval-Augmented Framework for Traffic Anomaly Understanding cs.CV | cs.AIPDF

Yuqiang Lin, Yan Shi, Sam Lockyer, Harish Tayyar Madabushi, Adrian Evans

TL;DR: 本文提出了TAU-Agent，一个用于交通异常理解的智能体检索增强框架。该框架通过一个中央检索智能体协调两个视觉感知工具（视频描述工具和开放词汇跟踪工具）来检索和选择与查询相关的证据（如描述、时间区间和物体轨迹），然后将这些证据与采样的视频帧和输入查询一起提供给一个经过监督微调的视觉语言模型进行最终推理和答案生成。

Details

Motivation: 为了解决交通异常理解任务中需要模型检测、推理和解释交通视频中异常事件的挑战，作者提出了一个智能体化的检索增强框架。

Result: 在AI City Challenge 2026的域内和域外基准测试中，TAU-Agent在Track 3、Track 7和Track 8上分别取得了0.6779、0.3998和67.9275的分数，排名分别为第二、第十二和第五。

Insight: 论文的创新点在于将智能体架构与检索增强生成相结合，通过协调专门的视觉工具来提取多模态证据，以增强视觉语言模型在复杂视频理解任务中的推理能力。从客观角度看，其系统化整合特定工具进行证据检索和选择的框架设计具有借鉴意义。

Abstract: Traffic Anomaly Understanding (TAU) requires models and systems to detect, reason about, and explain anomalous events in transportation videos. To address this challenge, we propose TAU-Agent, an agentic retrieval-augmented framework for traffic anomaly understanding. Given a task query, a central retrieval agent orchestrates two visual perception tools, namely a Video Captioning Tool and an Open-Vocabulary Tracking Tool, to retrieve and select query-relevant evidence, including captions, temporal intervals, and object trajectories. The selected evidence, together with sampled video frames and the input query, is provided to a supervised fine-tuned vision-language model for final reasoning and answer generation. We evaluate TAU-Agent on both the in-domain and the out-of-domain benchmarks from the AI City Challenge 2026. TAU-Agent achieves scores of 0.6779 on Track 3, 0.3998 on Track 7, and 67.9275 on Track 8, ranking second, twelfth, and fifth, respectively. Code is available at: https://github.com/siri-rouser/TAU-Agent.

[76] Less Contouring, More Accuracy: Lesion-Guided ROI Deep Learning for Ovarian Ultrasound Classification cs.CVPDF

Mehran Ahmad, Ali Abbasian Ardakani, Afshin Mohammadi, Alisa Mohebbi, Gernot Kronreif

TL;DR: 本研究探讨了在卵巢超声分类中，使用病灶引导的感兴趣区域（ROI）深度学习方法，旨在降低像素级病灶分割的标注负担，同时保持有竞争力的诊断性能。研究在MMOTU和OUD两个公开数据集上比较了四种策略，发现病灶引导的ROI策略整体性能最强，其中MaxViT-Tiny模型在两个数据集上分别达到了93.10%和97.56%的准确率。

Details

Motivation: 解决经阴道超声卵巢病变分类中因成像特征重叠和依赖专家解读带来的挑战，并探索能否在减少像素级病灶分割所需繁重标注工作的同时，实现有竞争力的诊断性能。

Result: 在MMOTU八分类和OUD二分类任务上，病灶引导的ROI策略取得了最佳整体性能，MaxViT-Tiny模型在MMOTU上准确率93.10%、AUC 0.99，在OUD上准确率97.56%、AUC 0.99。基于轮廓的方法取得了相当的准确率，但标注工作量显著更高。

Insight: 论文的创新点在于提出了病灶引导的ROI深度学习方法，在诊断性能和标注效率之间取得了有效平衡，为可扩展的AI辅助卵巢超声分析提供了实用方案。从客观角度看，该方法通过简化标注要求（从像素级分割简化为ROI框选），可能降低了临床应用的门槛，同时利用病灶位置信息引导网络关注关键区域，提升了模型效率与性能。

Abstract: Ovarian lesion classification using transvaginal ultrasound remains challenging due to overlapping imaging characteristics and the dependence on expert interpretation. This study investigates whether lesion-guided region-of-interest (ROI) deep learning can achieve competitive diagnostic performance while reducing the annotation burden associated with pixel-level lesion segmentation. Two publicly available ovarian ultrasound datasets were evaluated: the Multi-Modality Ovarian Tumor Ultrasound (MMOTU) dataset for eight-class classification and the Ovarian Ultrasound Dataset (OUD) for binary classification. Four strategies were compared under a unified framework: global image-based deep learning, lesion-guided ROI-based deep learning, lesion contour-based deep learning, and contour-based radiomics with machine learning classifiers. Four deep learning architectures, MaxViT-Tiny, Swin Transformer, EfficientNet-B7, and ResNet18, were evaluated. Radiomics models were developed using support vector machine, k-nearest neighbors, and artificial neural network classifiers, with ANOVA-based feature selection applied for the lower-sample OUD dataset. The lesion-guided ROI strategy achieved the strongest overall performance, with MaxViT-Tiny obtaining 93.10% accuracy and an AUC of 0.99 on MMOTU and 97.56% accuracy and an AUC of 0.99 on OUD. The contour-based approach achieved comparable accuracy but required substantially higher annotation effort. These findings demonstrate that lesion-guided ROI deep learning provides an effective balance between diagnostic performance and annotation efficiency, offering a practical approach for scalable AI-assisted ovarian ultrasound analysis

[77] PANDA - Prototype-Anchored Alignment for Partially Unpaired Multimodal Learning, with Applications to Alzheimers MRI and TCGA Pathology cs.CV | cs.AIPDF

Sheethal Bhat, Mahfuzur Rahman Chowdhury, Paula Andrea Perez-Toro, Stephan Wunderlich, Rose Dawn Bharat

TL;DR: 本文提出了一种名为PANDA（原型锚定数据对齐）的两阶段框架，用于处理多模态医学预测中辅助模态数据部分缺失或不完整配对的问题。该方法通过第一阶段学习共享嵌入并估计类别原型，第二阶段训练主模态编码器并使其对齐冻结的原型，从而在推理时无需辅助模态输入即可提升主模态模型的性能。

Details

Motivation: 解决多模态医学预测中辅助模态数据（如表格评分、PET影像、外部手写动力学等）仅对部分受试者可用或完全不配对的问题，旨在在不依赖辅助模态输入的情况下，将辅助信息有效迁移至主模态模型，以提升预测性能。

Result: 在ADNI队列的AD/CN分类任务中，PANDA相比仅使用MRI的基线模型，AUC提升7.9个百分点至0.868，并减少1.5T CN假阳性24.3个百分点；在TCGA-Lung生存预测任务中，PANDA相比仅使用WSI的模型，2年OS的AUC提升3.5个百分点，C-index提升9.0点，且优于完全融合训练方法。

Insight: 创新点在于提出基于类别原型锚定的对齐机制，允许任意配对率（包括零重叠），通过原型级别的监督实现辅助信息向主模态的有效迁移，为部署导向的多模态学习提供了灵活且高效的解决方案。

Abstract: Multimodal medical prediction often faces incomplete pairing: auxiliary modalities with complementary signal are available for only a subset of subjects (or none) and cannot be assumed at deployment. We introduce PANDA (Prototype Anchored Data Alignment), a two-stage framework that transfers auxiliary information to a primary-modality model without auxiliary inputs at inference. Stage 1 learns a shared embedding from the paired subset and estimates class prototypes from auxiliary modalities; Stage 2 trains the primary encoder on all subjects using cross-entropy plus alignment to the frozen prototypes. Because supervision is defined at the class-prototype level, PANDA accommodates arbitrary pairing rates, including zero subject overlap. We evaluate PANDA on two applications. On a 1,021-subject multi-scanner ADNI cohort, we perform AD/CN classification with three auxiliary modalities at distinct pairing rates: tabular scores (44.8%), FDG-PET (18.7%), and external handwriting kinematics (0% overlap). Relative to the same-backbone MRI-only baseline, PANDA attains AUC 0.868 +-0.020 (+7.9pp) and reduces 1.5T CN false positives by 24.3pp; on a fully trainable Conv5-FC3 backbone it reaches AUC 0.893 (best overall). A pairing-rate ablation shows that the joint anchor remains within seed noise from 75% to 5% pairing. On TCGA-Lung survival prediction from whole-slide images with RNA-seq as auxiliary data, PANDA improves over WSI-only on 2-year OS (AUC +3.5pp) and Cox PH (C-index +9.0pts) and outperforms full-fusion training, which underperforms WSI-only, while requiring no RNA at inference; wide confidence intervals on this smaller cohort keep the gains below conventional significance. Overall, PANDA provides a deployment-oriented mechanism for leveraging incomplete auxiliary modalities to improve primary-modality prediction.

[78] MyoMechanix: Biomechanically-Grounded Compositional Skilled Activity Understanding and Coaching cs.CV | cs.AI | cs.ET | cs.HC | cs.LGPDF

Hao Yin, Paritosh Parmar, Lijun Gu, Lin Xu, Tianxiao Guo

TL;DR: MyoMechanix是一个用于负重动作理解与指导的多模态生态系统，它通过同步采集多视角RGB视频、3D姿态、表面肌电信号（sEMG）等生理信号，构建了目前最大的多模态动作质量评估（AQA）基准。该工作进一步构建了结构化知识图谱（FKG）并开发了CUBIST推理引擎，实现了对动作的细粒度分解、错误归因和可解释的反馈生成。

Details

Motivation: 现有动作质量评估方法主要依赖视觉输入（如RGB和姿态），忽略了肌肉力学等生理动态，并将动作视为整体模式进行建模，这阻碍了提供基于生物力学的细粒度反馈。

Result: 实验表明，多模态感知和结构化表征提升了性能、可解释性和错误归因能力，其中CUBIST推理引擎取得了最先进（SOTA）的结果；VideoQA任务增强了基于语言的动作理解；Video2EMG任务则探索了用视频替代昂贵肌电传感的可能性。

Insight: 创新点在于首次构建了大规模、多模态、生物力学对齐的动作数据集，并引入了结构化知识图谱（FKG）和基于分解-分析-重组范式的CUBIST推理引擎，将动作理解从整体模式识别推进到基于生物力学的、可组合的、可解释的推理，为健身、康复等物理AI应用奠定了基础。

Abstract: Existing action quality assessment (AQA) datasets and methods rely primarily on visual inputs such as RGB and pose, overlooking physiological dynamics such as muscle mechanics and often modeling actions as monolithic patterns. These limitations hinder fine-grained, biomechanically grounded feedback. We introduce MyoMechanix, a multimodal ecosystem for weight-loaded actions that aligns motion with muscle activity. Expert-annotated, it contains 7,500+ samples of 20 actions from 38 subjects, with synchronized multiview RGB video, 3D pose, sEMG, and additional physiological signals, forming the largest multimodal AQA benchmark to date. We further construct the Fitness Knowledge Graph (FKG), which organizes expert annotations into structured relationships among actions, phases, key steps, errors, and corrective feedback, enabling compositional scoring and interpretable assessment. Building on these representations, we develop CUBIST (Compositional Ontological Reasoning Engine), which performs decomposition-analysis-recomposition for fine-grained error attribution and feedback generation. We also establish MyoMechanix-AQA, MyoMechanix-VideoQA, and a novel MyoMechanix-Video2EMG task. Experiments show that multimodal sensing and structured representations improve performance, interpretability, and error attribution, with CUBIST achieving state-of-the-art results; VideoQA enhances language-grounded action understanding; and Video2EMG suggests video-based alternatives to costly EMG sensing. MyoMechanix advances skilled activity understanding toward biomechanically grounded, multimodal, and compositional reasoning for Physical AI applications in fitness, rehabilitation, healthcare, and machine learning. Project page: https://haoyin116.github.io/MyoMechanix/

[79] StreamPI: Streaming Multimodal Temporal Modeling for Vision-Language-Action Models cs.CVPDF

Zhe Liu, Jinghua Hou, Yuxiang Lu, Zhenya Yang, Xianzhe Fan

TL;DR: 本文提出了StreamPI，一种流式多模态时序建模框架，旨在为单帧视觉-语言-动作（VLA）模型赋予时序推理能力，而无需引入额外参数。其核心设计包括指令锚定的时序建模和随机间隔流式训练策略，以提升模型在记忆依赖和精确感知任务中的性能，并支持异步机器人部署。

Details

Motivation: 当前最先进的VLA模型（如pi0.5）采用单帧范式，限制了其保留历史观察和形成精确空间感知的能力。本文旨在解决单帧VLA模型缺乏时序推理的问题，并弥合同步训练与异步真实机器人部署之间的差距。

Result: 在涵盖记忆依赖和精确感知场景的真实机器人任务以及仿真基准LIBERO上的实验表明，StreamPI在多种任务上超越了pi0.5。

Insight: 创新点在于指令锚定的时序建模，将（视觉观察，语言指令）对作为原子时序单元，结合双向和因果注意力实现跨模态融合与流式推理；以及随机间隔流式训练策略，通过随机化帧间隔提升对时序扰动的鲁棒性，支持异步部署。模型还无缝继承了预训练单帧权重，支持灵活的单帧与多帧推理。

Abstract: Vision-Language-Action (VLA) models have demonstrated effectiveness in robot manipulation, yet state-of-the-art models such as pi0.5 operate under a single-frame paradigm, limiting their ability to retain past observations and develop precise spatial perception. In this paper, we propose StreamPI, a streaming multimodal temporal modeling framework that equips single-frame VLA with temporal reasoning capability without introducing any additional parameters. One core design is instruction-anchored temporal modeling. It treats each (visual observation, language instruction) pair as an atomic temporal unit: bidirectional attention within each pair enables cross-modal fusion, while causal attention across pairs preserves autoregressive streaming inference. This ensures the language instruction serves as a persistent semantic anchor throughout task execution. To bridge the gap between synchronous training and asynchronous real-robot deployment, we introduce a andom-interval streaming training strategy: a proper inter-frame interval (e.g., every 3 frames) enables faster and smoother action execution. Beyond this, randomizing the interval further improves robustness to frame-timing perturbations, supporting asynchronous deployment in practice. Furthermore, by leveraging the length extrapolation capability of the LLM backbone, StreamPI seamlessly inherits pretrained single-frame weights and supports flexible single-frame and multi-frame inference. Experiments on real-robot tasks spanning memory-dependent and precise perception scenarios, as well as the simulation benchmark LIBERO, demonstrate that StreamPI outperforms pi0.5 across diverse tasks.

[80] A Visual Dependence-Aware Framework for Multimodal Unsupervised Continual Post-Training cs.CV | cs.AIPDF

Kaichen Li, Zhilin Zhu, Jianhao Huang, Zhengqin Lai, Baochen Xiong

TL;DR: 本文提出了一种视觉依赖感知（VDA）框架，用于解决多模态大语言模型（MLLMs）在无监督持续后训练（MU-CPT）任务中的挑战。该框架通过视觉约束最优传输（VC-OT）来缓解跨模态灾难性遗忘，并通过视觉调制适应（VMA）来促进新任务的可塑性，从而在流式无标签数据上实现模型的持续进化。

Details

Motivation: 现有MLLMs的无监督后训练方法通常均匀优化所有目标词元，忽视了它们对视觉信息的异质性依赖。本文发现词元级别的视觉依赖（VD）对于MU-CPT至关重要，其结构扭曲是跨模态遗忘的指标，其异质性可指导新任务学习，因此需要一种能利用此特性的新方法。

Result: 在作者提出的MU-CPT设定下进行的广泛实验验证了VDA框架的有效性。该方法在挑战性的MU-CPT过程中，同时保持了旧任务的稳定性和新任务的可塑性。

Insight: 核心创新在于揭示了视觉依赖在持续学习中的关键作用，并据此设计了VC-OT和VMA两个组件。VC-OT通过区域感知的地面成本和依赖分层传输惩罚，将VD结构扭曲建模为最优传输问题，有效防止了视觉焦点全局偏移和视觉依赖退化为语言偏见。VMA则利用VD异质性来强调基于视觉的新任务学习。这种对视觉依赖的细粒度分析和利用是新颖的。

Abstract: In this paper, we explore a novel task of Multimodal Unsupervised Continual Post-Training (MU-CPT), enabling deployed MLLMs to continually evolve from streaming unlabeled data. Existing unsupervised post-training methods for MLLMs typically optimize target tokens uniformly, overlooking their heterogeneous visual dependence (VD). However, we reveal that token-level VD is crucial for MU-CPT. Specifically, its structural distortion serves as an indicator of cross-modal catastrophic forgetting, and its inherent heterogeneity acts as a compass to guide new-task learning. Leveraging this property, we propose a Visual Dependence-Aware (VDA) framework with two main components. First, Visually Constrained Optimal Transport (VC-OT) formulates the VD structural distortion of old-task VD during new-task learning as an optimal transport problem to mitigate cross-modal forgetting. By designing a region-aware ground cost and a dependence-stratified transport penalty, it prevents global shifts in visual focus while strictly prohibiting visual reliance from degenerating into language bias. Second, Visually Modulated Adaptation (VMA) exploits VD heterogeneity to emphasize visually grounded new-task learning, promoting new-task plasticity. Together, our method simultaneously maintains old-task stability and new-task plasticity during challenging MU-CPT. Extensive experiments under our MU-CPT setting validate the effectiveness of VDA.

[81] VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning cs.CV | cs.AI | cs.LG | cs.MM | cs.ROPDF

Junxiang Xu, Ruisi Wang, Fanyi Pu, Maijunxian Wang, Ran Ji

TL;DR: 本文提出了VBVR-Pro，一个用于原生视觉推理的可扩展且可验证的测试平台。它将视觉推理转化为一个包含300个程序生成任务的可控任务空间，提供了基于确定性任务规则的可验证奖励评分器，并支持对超过30种图像、视频及交错生成器进行受控的模态研究。

Details

Motivation: 当前原生视觉推理的进展受限于缺乏可扩展的训练任务、可靠的反馈机制以及跨生成基质的受控比较。本文旨在通过VBVR-Pro解决这些问题，使通过生成进行的原生视觉推理变得可训练、可验证、可优化且实验可控。

Result: 在VBVR-Pro上训练的模型在七个外部视觉推理基准测试（如RISE-Video、MME-CoF-Pro和BabyVision）上表现出强大的迁移能力。其提出的可验证奖励评分器与人类判断细粒度对齐，并作为可靠的奖励信号用于大规模多任务强化学习，在视觉推理任务上展现出更强的后RL性能。

Insight: 创新点在于构建了一个闭环、可扩展且可验证的视觉推理任务测试平台。其核心贡献包括：1）将视觉推理转化为一个程序化生成的可控任务空间以实现规模化训练；2）引入基于确定性规则的奖励评分器，克服了当前VLM-as-a-judge范式的常见失败模式；3）通过受控的模态研究，揭示了视频生成在需要持续时空状态跟踪的任务中表现最强，并发现了对视觉推理至关重要的视觉原生轨迹。

Abstract: Native visual reasoning treats visual generation as the medium of reasoning itself: visual states (i.e. images and videos) are not merely inputs to be understood or outputs to be rendered, but first-class substrates for problem solving beyond language. Yet progress remains bottlenecked by the lack of scalable training tasks, reliable feedback, and controlled comparisons across generative substrates. In this work, we introduce VBVR-Pro, a closed-loop testbed that makes native visual reasoning through generation trainable, verifiable, optimizable, and experimentally controllable. 1) Task scaling. VBVR-Pro turns visual reasoning into a controlled task space of 300 procedurally generated tasks. Models trained on VBVR-Pro show strong transfer beyond the proposed suite across seven external visual reasoning benchmarks such as RISE-Video, MME-CoF-Pro, and BabyVision. 2) Verifiable rewards. VBVR-Pro provides verifiable reward scorers for task-grounded evaluation. Through a systematic study of leading MLLMs as judges, we identify recurring failure modes of the prevalent VLM-as-a-judge paradigm. In contrast, the proposed scorers are grounded in deterministic, task-specific rules, achieve fine-grained alignment with human judgments. Importantly, they serve as reliable reward signals for large-scale multi-task reinforcement learning and demonstrate stronger post-RL performance across visual reasoning tasks. 3) Mechanism study. VBVR-Pro enables controlled modality studies across more than 30 image, video, and interleaved generators. Our analysis shows that video generation remains strongest for tasks requiring persistent spatiotemporal state tracking, while interleaved generation provides a compute-efficient alternative. Critically, ablations and probing suggest the presence of vision-native trajectories that are crucial to visual reasoning. We release all data, models, scorers, and code.

[82] RefVideo-6M: A Reliable Reference-Based Dataset for Instructional Video Editing cs.CVPDF

Bojia Zi, Xiaoyan Yang, Yu Zhou, Ruijie Sun, Lihan Zhang

TL;DR: 本文提出了RefVideo-6M，一个大规模、基于视觉参考的视频编辑数据集，包含500万个视频编辑样本和100万个图像编辑样本。该数据集旨在解决现有指令编辑数据集中存在的伪影问题和缺乏视觉参考的局限性，通过使用无伪影的真实视频作为编辑目标，并利用多位编辑专家生成高质量输入条件。基于此数据集训练的Ref-MoT模型在视觉质量、可控性和参考一致性方面表现优异。

Details

Motivation: 现有的大规模指令视频编辑数据集存在两个关键局限：一是目标视频通常由自动编辑模型生成，可能引入可见伪影并提供不可靠的监督信号；二是主要依赖文本指令，缺乏对实现精确、保持身份和可控编辑至关重要的视觉参考。

Result: 大量实验表明，RefVideo-6M比现有数据集提供了更可靠的监督，使得训练的编辑模型在视觉质量、可控性和参考一致性方面均有显著提升。

Insight: 创新点在于构建了一个以无伪影真实视频为目标的、包含多样化视觉参考类型和编辑场景的大规模数据集，使模型能够学习超越纯文本指令的细粒度视觉对应关系。从客观角度看，其数据构建流程（利用多位编辑专家生成质量过滤的输入条件）确保了高质量监督，为参考引导的视频编辑任务提供了更可靠的基准。

Abstract: Recent advances in video editing have been largely driven by large-scale instruction-based datasets. However, existing datasets still suffer from two critical limitations. First, target videos are commonly produced by automatic editing models, which may introduce visible artifacts and unreliable supervision signals. Second, most public datasets rely primarily on textual instructions, while lacking visual references that are crucial for precise, identity-preserving, and controllable editing. To address these limitations, we introduce RefVideo-6M, a large-scale reference-guided editing dataset containing 5 million video editing samples and 1 million image editing samples. To ensure reliable supervision, our dataset uses a construction pipeline that treats artifact-free real videos as editing targets and generates quality-filtered input conditions with multiple editing experts. In addition, it provides approximately 6 million visual references, covering diverse reference types and editing scenarios, thereby enabling models to learn fine-grained visual correspondence beyond text-only instructions. Based on RefVideo-6M, we further train a reference-guided video editing model, Ref-MoT, to evaluate the effectiveness and scalability of the proposed dataset. Extensive experiments demonstrate that RefVideo-6M provides substantially more reliable supervision than existing datasets and enables the training of powerful editing models with improved visual quality, controllability, and reference consistency. The open-source dataset is available at https://huggingface.co/datasets/RefVideo6M/RefVideo6M.

cs.HC [Back]

[83] PA-CoT: Profile-Adaptive Chain-of-Thought for Personalized Nutritional Consulting cs.HC | cs.AI | cs.CL | cs.LGPDF

Evgenii Garmashov, Nikita Kulin, Artur Khairullin, Viktor Zhuravlev, Daniil Sukhorukov

TL;DR: 本文提出了PA-CoT（Profile-Adaptive Chain-of-Thought），一种用于个性化营养咨询的多阶段提示方法。该方法将用户档案分析作为一个显式、独立的推理步骤，以弥补现有方法在个性化方面的结构缺陷。作者还引入了包含200个样本的QPA基准，用于系统评估，并在与11种对比方法的比较中，PA-CoT在个性化与安全性方面均取得了最佳成绩。

Details

Motivation: 在健康和营养咨询领域，广泛使用的提示方法将用户档案作为非结构化块直接传递，缺乏专门的分析步骤，导致个性化成为一个关键的结构性缺陷。

Result: 在包含11种对比方法（如CoT、Few-Shot、DSPy等）及零样本基线的比较研究中，PA-CoT在QPA基准上取得了最佳平均分（G-Eval 1-5量表中为4.21），并在个性化（4.71 vs. 4.39）和安全性（4.68 vs. 4.52）两个关键指标上显著领先于最接近的竞争对手，置信区间不重叠。

Insight: 核心创新点在于将用户档案分析明确设计为独立的推理步骤，这被证实是提升个性化效果的关键驱动因素。从方法学角度看，这种多阶段、结构化的提示工程策略，为将领域知识（如用户档案）有效整合进大语言模型推理流程提供了可借鉴的范式。

Abstract: In health and nutrition consulting, widely used prompting methods pass the user profile as an unstructured block without a dedicated analysis step, leaving personalization as a critical structural gap. We introduce PA-CoT (Profile-Adaptive Chain-of-Thought), a multi-stage prompting method that treats profile interpretation as an explicit, standalone reasoning step prior to response generation. To enable systematic evaluation, we introduce the QPA (Question–Profile–Answer) benchmark – 200 nutritional consulting samples with structured user profiles scored on four criteria. In a comparative study against 11 comparison methods (CoT, Few-Shot, Role Prompting, DSPy, TextGrad, Self-Refine, and others, plus a Zero-Shot Baseline; 12 total including PA-CoT), PA-CoT achieves the best average score (4.21 on the G-Eval 1–5 scale) and leads on both Personalization (4.71 vs. 4.39) and Safety (4.68 vs. 4.52) with non-overlapping 95% confidence intervals over the nearest competitor – the only method to simultaneously top both criteria. The results confirm that an explicit profile-analysis step is the key driver of personalization gains over widely used prompting approaches.

[84] Super Star: Towards Streaming Real-time Interactive Agents for Digital Humans cs.HC | cs.CV | cs.SDPDF

Wentao Jiang, Youchen Xie, Haidi Fan, Yajing Chen, Xin Wang

TL;DR: 本文提出了一种面向交互式数字人的实时在线协同语音手势生成框架Super Star，通过流式语音响应模块与在线手势生成模块耦合，实现了低延迟、语音同步的手势合成，无需依赖未来语音信息。

Details

Motivation: 现有协同语音手势生成方法主要基于离线设置，依赖完整语音段，无法满足真实交互场景中数字人实时在线生成语音同步手势的需求，且存在延迟问题。

Result: 大量实验表明，该框架在延迟-质量权衡、语音-动作同步性以及用户偏好方面均优于现有基线方法。

Insight: 创新点包括：1）将在线协同语音手势生成任务形式化，并提出因果多模态自回归模型实现流式生成；2）针对虚拟伴侣场景设计离线数据合成流程，利用主题和情感感知的主体语料构建多样化人机对话；3）通过整合在线交互中收集的用户反馈建立自进化训练循环，实现持续适应用户偏好。

Abstract: Existing co-speech gesture generation methods are predominantly studied in offline settings, where gestures are synthesized from complete speech segments. However, interactive digital humans in real-world scenarios are required to generate speech-synchronous gestures online, using only currently available response audio under strict latency constraints. As a result, prior methods are unsuitable for real-time interaction, as they either rely on future speech information or incur substantial inference delay. In this paper, we formulate online co-speech gesture generation for interactive digital humans and propose a real-time interactive framework that couples a streaming speech response module with an online gesture generation module. Specifically, the gesture generator is designed as a causal multimodal autoregressive model that predicts body motion from streaming response speech and motion history, enabling low-latency and speech-aligned gesture synthesis without access to future speech. To support this setting, we further propose an offline data synthesis pipeline tailored to virtual companion scenarios, which leverages topic- and emotion-aware subject corpora to construct diverse human-agent dialogues and then generates co-speech gestures conditioned on the agent responses. Moreover, to bridge the gap between offline data construction and online deployment, we establish a self-evolving training loop by incorporating user feedback collected during online interaction into the data generation process, enabling continual adaptation to user preferences. Extensive experiments demonstrate that our framework achieves superior better latency-quality trade-off, stronger speech-motion synchronization, and higher user preference than competitive existing baselines. Project Page: https://super-star-2026.github.io/

[85] Do Vision-Language Models Agree on the Affective Qualities of Shape? A Cross-Model Audit for Generative Design Interfaces cs.HC | cs.CVPDF

Luca Bux, Thiago Rios, Ingo Scholtes, Stefan Menzel

TL;DR: 本文对六种最先进的视觉语言模型（VLM）进行审计，评估它们对ShapeNet数据库中10个类别的无纹理3D物体在感性（Kansei）形容词对（如‘优雅’与‘简约’）上的感知一致性。研究发现，模型在情感轴上的排名相关性（平均0.36）高于无关形容词对的基准（0.14），但低于几何轴的上限（0.44），且一致性因物体类别而异。模型间的一致性并不等同于与人类判断的一致性。基于此，作者实现了一个UI原型，指导生成设计界面选择哪些感性描述符作为控制参数。

Details

Motivation: 生成式设计界面常使用VLM编码语义控制（如‘更优雅’），但不同VLM对同一概念的表示是否一致尚不明确。本文旨在审计多个VLM在评估物体情感品质时的一致性，以解决其在设计应用中的可靠性问题。

Result: 在ShapeNet数据库的10个类别上，VLM在情感轴上的平均成对排名相关性为0.36（高于无关基准0.14，低于几何上限0.44）。一致性高度不均衡，例如在共享的三个轴上，书架类别的平均收敛性为0.21，而罐子类别为0.51。

Insight: 创新点在于首次系统审计了VLM在感性设计维度上的一致性，并揭示了收敛性主要取决于类别表征变化与语义方向的对齐程度，而非整体形状变化量。这为生成设计界面选择可靠的语义控制提供了实证依据和UI设计指导。

Abstract: Generative design interfaces increasingly expose semantic controls that let users steer output with concepts such as “more elegant” or “more minimalist,” typically encoded by a vision-language model (VLM). A practical question is whether state-of-the-art VLMs represent objects consistently in terms of the same concept. We audit 6 VLMs by ranking untextured 3D objects along Kansei adjective pairs, where Kansei describes affective impressions of product form, with each axis defined as the difference between the text representations of its two poles. Geometric pairs serve as positive controls, and pairs of unrelated adjectives establish an empirical null. Across 10 categories of ShapeNet database, affective axes converge above the null (mean pairwise rank correlation 0.36 vs. 0.14) but below the geometric ceiling (0.44). The agreement between models is partial and highly uneven: on the three axes shared by all categories, mean convergence ranges from 0.21 for bookshelves to 0.51 for jars. Convergence depends primarily on whether a category’s representational variation aligns with the semantic direction being evaluated, rather than simply on how much the objects vary in shape overall. Cross-model convergence does not imply agreement with human judgments. Based on our findings, we implement a UI prototype that shows how the audit can inform which Kansei descriptors to expose as controls for a given object class and which to withhold.

cs.LG [Back]

[86] Demystifying Reinforcement Learning Post-Training of Language Models cs.LG | cs.AI | cs.CLPDF

Donovan Clay, Saket Gollapudi, Sankar Harilal, Min Jang, Jacob Morrison

TL;DR: 本文系统解构了语言模型强化学习后训练（RL post-training）机制，通过可控简化环境中的可验证奖励实验，揭示了基础模型先验分布、奖励信号粒度、提示分布多样性和模型规模等因素如何共同影响训练效果，并利用策略输出分布的熵分析预训练、监督微调和RL后训练各阶段对模型确定性的塑造作用。

Details

Motivation: 针对当前强化学习后训练对许多研究者而言仍是一个’黑箱’的现状，旨在阐明其底层原理，帮助NLP社区更好地理解和应用RL工具。

Result: 研究通过实验表明，所谓’虚假奖励’的影响取决于后训练使用的提示分布，并揭示了RL后训练的成功依赖于基础模型是否已在期望行为上分配足够概率质量，这与RL中经典的探索概念相关联。

Insight: 创新点在于将RL后训练过程分解为可验证的组件进行机理分析，特别是引入策略输出熵作为比较不同训练阶段分布特性的透镜，为理解模型确定性演变提供了新视角。

Abstract: Reinforcement learning (RL) post-training has emerged as a powerful framework for enhancing the capabilities of large language models (LLMs), enabling impressive reasoning, math, and coding capabilities. Yet for many researchers and practitioners, the principles behind classical RL remain a “black box”. In this work, we deconstruct the RL post-training algorithm, investigating each step to clarify what is actually happening beneath the surface. By isolating the mechanics of RL with Verifiable Rewards in a controlled and simplified environment, we examine how RL outcomes are shaped by the base model’s prior distribution, the granularity of the reward signal, the diversity of the prompt distribution, and model scale. We use the entropy of the policy’s output distribution as a lens to compare the distributions learned through pretraining, SFT, and RL post-training, revealing how each stage shapes model certainty. Our investigation sheds light on how these choices interact to affect post-training success. For example, we show that the effect of so-called ‘spurious rewards’ depends on the prompt distribution used for post-training. We also provide insight into why the success of RL post-training depends on whether the base model already places sufficient probability mass on the desired behavior, linking it to the classical concept of exploration in RL. Ultimately, we provide this primer as a resource to those in the NLP community wishing to incorporate RL as a tool in their toolbox.

[87] Escaping Low-Dimensional Overlap: Multi-Task Model Merging via High-Dimensional Sparse Disentanglement cs.LG | cs.AI | cs.CLPDF

Yihang Zhang, Shengke Sun, Junjie Wen, Feng Zeng

TL;DR: 本文提出了一种基于稀疏表示的模型合并框架，通过稀疏自编码器将任务向量投影到高维稀疏特征空间，实现特征级解耦后再融合，以缓解多任务合并中的任务干扰问题。该方法还引入了轻量级的组排序零阶优化器来识别任务关键层进行选择性合并，从而降低计算开销。

Details

Motivation: 模型合并是构建多任务通用模型的高效方法，但严重的任务干扰会导致性能下降。这种干扰主要源于参数空间中的‘叠加’现象，即任务特定特征相互纠缠，使得传统分解方法难以有效隔离有用的任务方向。

Result: 在Qwen2.5-1.5B和Qwen2.5-7B模型上的实验表明，该方法在数学推理、代码生成、指令遵循和通用知识任务上，持续优于Task Arithmetic、TIES-Merge、DARE、Fisher-Merge等代表性基线及多种近期免训练合并方法。在Qwen2.5-1.5B的高冲突四任务设置中，该方法比最强基线进一步提升了2.78%。

Insight: 论文的创新点在于利用高维稀疏表示进行特征解耦，以应对模型合并中的低维重叠问题。从客观角度看，将稀疏自编码器与轻量级优化器结合，为在参数空间中进行更精细的任务特征分离和选择性融合提供了新思路，可能提升多任务模型的鲁棒性和性能。

Abstract: Model merging provides an efficient way to construct multi-task generalist models without additional training, but its performance often degrades under severe task interference. Task interference in model merging primarily stems from \textit{superposition}, where task-specific features become entangled within the parameter space. This entanglement renders conventional decomposition methods insufficient for effectively isolating useful task directions from interfering components. In this paper, we propose a sparse-representation-based merging framework that uses Sparse Autoencoders (SAEs) to project task vectors into a high-dimensional sparse feature space, enabling feature-level disentanglement before fusion. To reduce computational overhead, we further introduce a lightweight Group-Ranked Zeroth-Order Optimizer (GR-ZOO) to identify task-critical layers for selective merging. Experiments on both Qwen2.5-1.5B and Qwen2.5-7B demonstrate that our method consistently outperforms representative baselines, including Task Arithmetic, TIES-Merge, DARE, Fisher-Merge,and several recent training-free merging methods, across mathematical reasoning, code generation, instruction following, and general knowledge tasks. In a highly conflicting four-task setting on Qwen2.5-1.5B, our method further achieves a 2.78% improvement over the strongest baseline.

[88] Reflection Steering: Disentangling Reflection from Reasoning in Activation Space for Token-Efficient Inference cs.LG | cs.CLPDF

Jiarui Hu, Zhiyuan Wen, Xiaoyun Liu, Jiaxing Shen, Yu Yang

TL;DR: 本文提出了一种名为Reflection Steering的训练免费框架，旨在通过解耦激活空间中的反思与推理信号，从而在大型语言模型推理过程中减少不必要的反思计算，以提升推理效率。该方法通过对比反思与非反思隐藏状态、使用PCA降噪和正交化技术分离反思方向，并引入层间校准和有界干预来稳定性能。

Details

Motivation: 大型推理模型在生成推理轨迹时经常包含验证、修订和回溯等反思过程，当反思仅重复检查已确立的结果时会浪费推理令牌并增加延迟。现有反思引导方法通常将标签导出的均值差异方向添加到预设层中，但其与推理和长度信号的纠缠导致准确性与效率的权衡不稳定。

Result: 在两个公共基准和三个开源权重LLM上进行的广泛实验表明，Reflection Steering在六个匹配设置中平均减少了16.9%的推理令牌，优于最先进的激活引导基线方法。

Insight: 创新点在于提出了一种无需训练的解耦框架，通过PCA降噪和正交化技术从激活空间中分离反思相关方向，并引入有界反射干预强度参数α，允许在部署时动态调整以平衡令牌节省、准确性和生成稳定性，从而实现了更精细的反思控制。

Abstract: Large reasoning models often produce reasoning traces with verification, revision, and backtracking. When reflection merely re-checks established results, it wastes reasoning tokens and increases latency. Most existing reflection steering methods add a label-derived mean-difference direction across preset layers, but its entanglement with reasoning and length signals destabilizes the accuracy-efficiency trade-off. In this paper, we propose Reflection Steering, a training-free framework for controlling reflection-associated computation within LLMs by disentangling reflection-related activations from general reasoning. Specifically, we contrast reflective and non-reflective hidden states at each LLM layer, denoise the resulting reflection directions with PCA, and orthogonalize them against general-reasoning directions. To limit downstream amplification from early-layer interventions, we calibrate each layer across multiple intervention strengths on a small set, retain only stable layers, and apply bounded projection removal to their residual-stream activations. We conduct extensive experiments across two public benchmarks and three open-weight LLMs against state-of-the-art activation-steering baselines. Results show that Reflection Steering reduces reasoning tokens by 16.9% on average across six matched settings. Besides, our method further introduces a bounded reflection intervention-strength parameter $α$, enabling deployment-time adjustment to balance token savings, accuracy, and generation stability.

[89] Why Does Graph Learning Fail to Fully Benefit from a Text Teacher? cs.LG | cs.CLPDF

Fumiaki Kimino, Ryoma Sato

TL;DR: 本文研究了结合图神经网络（GNN）与文本教师（如语言模型）的多模态模型，旨在通过自监督和交替优化方法提升图学习性能。然而，实验发现这种结合未能充分提升预测性能，并系统性地识别了导致失败的六个关键因素。

Details

Motivation: 研究动机是探索如何有效结合图神经网络与文本教师的优势，通过自监督预训练和交替优化（E步和M步）来提升跨数据集和图表示学习的性能。

Result: 尽管预期结合模型能提升性能，但实验结果表明其未能充分改善预测效果。通过一系列分阶段实验，验证了六个因素对性能的限制作用。

Insight: 创新点在于系统性地揭示了图学习未能从文本教师中充分受益的六个关键障碍，包括E步锚点的强度-安全性权衡、知识注入不直接、表示空间目标不一致、GCN传播的平滑效应、余弦对齐的判别性不足，以及不同优化力之间的冲突。这为未来设计更有效的多模态图学习模型提供了重要见解。

Abstract: Graph neural networks (GNNs) are widely used to represent complex interactions and relationships among entities. We investigate a multimodal model that combines two complementary ideas: a self-supervised method that enables a GNN encoder pretrained on one dataset to operate directly on another dataset with a different node-feature dimensionality, without rebuilding the model or realigning the data; and an alternating optimization method that updates a language-model module in an E-step and a GNN module in an M-step, rather than jointly training a large language model and a GNN end to end on a large graph. Despite expectations, the combined model did not sufficiently improve predictive performance. We identify six factors: (1) an external anchor in the E-step has a strength-safety trade-off: a weak anchor has little effect, whereas an overly strong anchor can damage the graph representation; (2) the knowledge of the E-step teacher is not injected directly into the GCN embedding Z; (3) the representation space constructed in the M-step is not optimized for the same objective as the E-step teacher space, resulting in a compromise representation for target classification; (4) GCN propagation averages a node’s own textual information with information from its neighbors; (5) cosine alignment does not guarantee axes that are discriminative for classification, so stronger geometric alignment with the E-step text anchor need not sufficiently improve the target decision boundary or classification performance; and (6) the force that preserves the source-side self-supervised geometry in the M-step conflicts with the force that moves the representation toward the E-step teacher. We support these observations through a staged set of experiments that varies the influence of the E-step.

[90] One Symptom, Three Levers: A Critical Review of On-Policy Self-Distillation cs.LG | cs.AI | cs.CLPDF

Justin Robert, Raheel Qader

TL;DR: 本文对策略内自蒸馏（OPSD）方法进行了批判性综述。OPSD是一种让语言模型在自身生成内容上进行训练的方法，其中教师模型由学生模型本身通过利用测试时不可用的特权信息（如参考答案）构成。尽管早期结果显示出与强化学习相当的准确性且计算成本更低，但该方法存在一个主导性的失败模式——模型生成推理路径的“坍缩”。本文不进行新实验，而是提供一个结构化分析框架，将坍缩视为由三个关键杠杆控制的症状。

Details

Motivation: 动机在于深入分析OPSD方法，该方法旨在结合模仿学习的密集监督和强化学习的策略内采样优势，同时避免使用额外的大模型作为教师所带来的成本。然而，该方法固有的信息不对称性导致了模型推理路径多样性的坍缩问题，本文旨在系统地剖析此问题。

Result: 论文未报告新的实验结果，而是对现有文献进行综述。早期研究结果表明，在数学推理等任务上，OPSD能以远少于强化学习的生成token数，达到与之相当的准确性。但其核心挑战是坍缩现象，这限制了模型产生多样化推理路径的能力。

Insight: 本文的核心创新在于提供了一个结构化的分析框架，将OPSD中的坍缩问题归结为三个可调控的杠杆：信号应用位置（token加权方式）、教师所见信息（特权信息的性质）以及信号变化时机（教师动态与引导衰减）。这为理解和改进OPSD方法建立了共享词汇并划定了已知与未知的边界。

Abstract: On-policy distillation trains a language model on its own generations while a teacher scores them token by token. It combines the dense supervision of imitation learning with the on-policy sampling of reinforcement learning. But it requires a second, larger model to act as teacher. On-Policy Self-Distillation (OPSD) removes that cost. The teacher is the model itself, conditioned on privileged information the student will not have at test time, such as a reference solution, a plan, or environment feedback. The teacher is no stronger than the student, only better informed. Early results were promising, with accuracy comparable to reinforcement learning at a fraction of the generated tokens. But the same asymmetry that produces the signal also biases it. One failure mode now dominates the field: collapse, the progressive narrowing of the set of reasoning paths the model can produce. Collapse is not specific to OPSD, though privileged information aggravates it. This review treats collapse as a symptom governed by three levers: (i) where the signal is applied, that is, how tokens are weighted; (ii) what the teacher is shown, that is, the nature of the privileged information; and (iii) when the signal changes, that is, the teacher’s dynamics and the decay of guidance. We restrict our scope to mathematical reasoning, where the method originated and where its failure modes are best documented. We report no new experiments. The contribution is structural: a shared vocabulary for phenomena named differently across papers, and a clear line between what is settled and what is still disputed.

[91] Learning from waste: Machine Learning for health risk prediction and computer vision-based sorting in Ghana cs.LG | cs.CV | cs.CYPDF

Hilda Adwubi Osei, Catherine Tenewaa Osei, Desdemona Yaa Asobayire

TL;DR: 本研究利用机器学习方法解决加纳固体废物处理不当引发的公共卫生问题。通过随机森林模型预测废物处理方式与疾病类别的关联，并使用MobileNetV2图像分类模型实现基于视觉的自动化废物分拣。

Details

Motivation: 针对加纳固体废物管理不当导致的公共卫生风险，此前研究仅通过描述性分析提出社区感知的疾病与废物处理关联，缺乏定量验证。

Result: 随机森林模型在69名患病受访者数据上获得宏观F1分数0.63，废物处理方法成为最重要的疾病类型预测因子；MobileNetV2模型在415张测试图像上达到88.2%准确率和0.87宏观F1分数，为资源受限环境提供可行方案。

Insight: 研究创新点在于将计算机视觉与机器学习结合应用于低收入国家的公共卫生场景，通过数据驱动方法为定性观察提供定量证据，同时强调技术方案需结合制度支持才能实现公共卫生改善。

Abstract: The inappropriate disposal of solid waste remains a significant public health and environmental concern worldwide, including in Ghana. Poor sanitation and improper waste management practices contribute to substantial economic costs and avoidable deaths annually. In 2022, a field study in Atonsu, Kumasi, Ghana, reported a community-perceived relationship between household waste disposal and illness patterns, but only through descriptive analysis without quantitative validation. This study extends that investigation using two data-driven approaches. First, a Random Forest classifier was developed to predict illness categories using waste disposal practices and demographic survey data. On a held-out group of respondents who reported illness (N=69), the model obtained a macro F1 score of 0.63, with disposal method emerging as the most important substantive predictor of illness type. Second, a MobileNetV2 image classification model enabled automated waste sorting via visual recognition, achieving 88.2% accuracy and a macro F1 score of 0.87 on the test set (N=415). The vision-based approach offers an affordable, camera-driven alternative to complex multi-sensor systems, making it highly suitable for resource-constrained settings. Taken together, the findings provide quantitative evidence for a community health relationship previously documented only qualitatively. They demonstrate the potential for automated waste-sorting in low-resource environments. Importantly, the results illustrate that technological performance alone does not guarantee public health improvements; effective institutional support and implementation are equally necessary.

cs.IR [Back]

[92] PlanSightRAG: A Visual-First Multimodal RAG for Automating Question Answering and Compliance Checking for Civil Standard Plans cs.IR | cs.CL | cs.CVPDF

Nabaraj Subedi, Shuvo Dip Datta, Ahmed Abdelaty, Shivanand Venkanna Sheshappanavar

TL;DR: 本文提出了PlanSightRAG，一个视觉优先的多模态检索增强生成框架，用于自动化土木标准图纸的问答与合规性检查。该框架直接对图纸图像进行索引和推理，集成了ColNomic-3B多向量检索器、智能体化的规划-检索-审核-合成模块以及作为证据追踪的MaxSim热力图。

Details

Motivation: 解决土木基础设施合规性检查长期依赖工程师手动阅读遗留2D图纸的问题，现有基于OCR的自动化方法会丢失图纸中关键的几何与布局信息。

Result: 在来自五个州交通部的4056对图纸基准测试中，零样本检索的Recall@5达到91.47%；在密歇根州交通部的保留测试集上达到91.40%。在参数化生成的合规性图纸上，当提供预解析的规则阈值时，Qwen2.5-VL-72B流程的判决准确率达到100%，而非视觉语言模型的OCR基线准确率为76.4%。

Insight: 创新点在于提出了一个视觉优先的多模态RAG框架，直接处理图纸图像以保留几何信息；引入了智能体化的四阶段流程（规划、检索、审核、合成）和MaxSim热力图作为可解释的证据追踪；展示了无需人工提供规则、直接从规范语料库中提取数值限制的自主视觉规则落地能力。

Abstract: Civil infrastructure compliance checking has long relied on engineers manually reading legacy 2D plans; however, OCR-based automation strips away the geometry and layout essential for interpreting these plans. We present a Visual-First Multimodal Retrieval-Augmented Generation (RAG) framework called PlanSightRAG. It indexes and reasons directly over plan imagery, integrates a ColNomic-3B multi-vector retrieval, an agentic Planner-Retriever-Auditor-Synthesizer, and MaxSim heatmaps as an evidence trail. We introduce a 4,056-pair benchmark from five state Departments of Transportation (DOT) standard plans (1,898 pages). PlanSightRAG achieves 91.47% Recall@5 on zero-shot retrieval, while on a held-out Michigan DOT corpus, it achieves 91.40%. On synthetic, parametrically-generated compliance drawings, our Qwen2.5-VL-72B pipeline reaches 100% verdict accuracy only when supplied a pre-resolved rule threshold, a controlled ceiling that a non-VLM OCR baseline already reaches at 76.4%. Finally, we demonstrate autonomous visual rule-grounding by extracting numeric limits directly from a specification corpus without any human-supplied rules.

cs.AI [Back]

[93] Retrieve, Match, Escalate: Accurate and Scalable Product Linking with VLM-Distilled Cross-Encoders and Agentic VLMs cs.AI | cs.CL | cs.DB | cs.IRPDF

Jian Wang, Steven Xu, Sanjyot Thete, Maryam Barouti, Tom Tang

TL;DR: 本文提出了一种用于大规模产品链接的检索-匹配-升级级联系统，通过根据匹配难度动态分配计算资源来解决传统单一模型在准确性和成本上的两难问题。系统首先检索候选产品，然后使用轻量级文本交叉编码器自动处理高置信度匹配，最后通过多模态视觉语言代理模型处理模糊案例，从而在保证高精度的同时显著提升覆盖率和成本效益。

Details

Motivation: 解决大规模电商平台中产品链接（将商家产品记录映射到标准目录产品）的实体解析问题，传统单一模型在处理数十亿条嘈杂、多类别记录时，要么对困难案例能力不足，要么计算成本过高。

Result: 系统在验证集上达到98%的自动接受链接精度。代理模型在达到前沿闭源VLM精度的同时，召回率仅低4个百分点（88% vs 92%），且每对成本约为其七分之一。通过该级联策略，端到端链接覆盖率从轻量级阶段的68%提升至77%。

Insight: 创新点在于提出了一种根据难度动态分配计算资源的级联架构，并利用从数百万VLM共识标签中蒸馏出的轻量级交叉编码器替代人工标注，以及使用无需微调的自托管开源多模态代理模型处理模糊案例，实现了准确性、覆盖率和成本效益的平衡。

Abstract: Product linking, the entity-resolution task of mapping merchant product records to canonical catalog products, consolidates fragmented listings so downstream search, recommendation, and advertising see one clean entry per product. At marketplace scale, billions of noisy, multi-category records must be resolved against tens of millions of canonical products, where scoring every candidate with a single model is either too weak for the hard cases or too costly for the easy ones. We present a production retrieve-then-match cascade that spends computation in proportion to difficulty: retrieval surfaces plausible matches, a lightweight text cross-encoder auto-resolves the high-confidence majority, and an agentic multimodal vision-language model settles the ambiguous remainder by inspecting product images and issuing web searches for evidence that is in neither record. The cross-encoder is distilled from millions of dual-VLM-consensus labels, retiring human annotation from the training set, and is calibrated to auto-accept links at a 98% precision bar validated against a smaller operator-certified audit. The agent is a self-hosted open-weight model that reaches a closed frontier VLM’s precision at a four-point recall cost (88% versus 92%) for roughly one-seventh the per-pair cost, with no fine-tuning. Per-pair cost spans nearly five orders of magnitude from the cheap cross-encoder to the frontier VLM, so escalating only the hard tail to the agent raises end-to-end link coverage from the cheap stage’s 68% to 77%.

[94] FinRiskAtlas: Decision-Aligned Evaluation of Large Language Models for Financial Risk Review cs.AI | cs.CLPDF

Suyang Zhong, Jingzhe Zhu, Qi Xu, Liyao Sun, Yin Wang

TL;DR: 论文提出了FinRiskAtlas，一个用于评估大语言模型在金融风险审查任务中表现的中文基准。该基准从两个互补维度进行评估：在固定证据状态下的操作执行能力，以及在动态审查条件下的证据状态控制能力。它包括一个包含9742个实例的静态基准和一个通过回放专业轨迹进行动态评估的扩展框架FinRisk-Ask。

Details

Motivation: 现有金融基准主要评估模型的一般金融能力（如知识、推理、合规性），但其评估单元通常围绕数据集或任务形式组织，而非与已部署系统在实际工作流中必须支持的决策和证据状态对齐。因此，需要一种决策对齐的评估方法来衡量模型在专业金融审查中的可靠性和实用性。

Result: 在33种模型配置上的实验表明，操作级别的评估能产生非冗余的排名（下游操作间平均成对Spearman相关系数为0.42），仅基于知识的筛选在个别操作上可能导致高达18.01分的遗憾值。FinRisk-Ask进一步显示，更频繁地进入’询问’分支并不一定能改善请求定位或端到端的证据获取效果。

Insight: 核心创新在于提出了一个决策对齐的评估框架，将评估单元与工作流中的具体审查操作和证据状态控制直接挂钩，而非仅测试宽泛的金融能力。这揭示了通用金融能力得分无法完全捕捉模型在专业工作流中的可靠性，强调了评估需与部署系统的实际决策支持需求紧密结合。

Abstract: Deploying large language models for professional financial review requires more than measuring general financial competence: models must perform the specific review operation required by a workflow and determine whether available evidence is sufficient for a defensible decision. Existing financial benchmarks cover knowledge, reasoning, compliance, and professional tasks, but their evaluation units are often organized around datasets or task formulations rather than the decisions that deployed systems support. We introduce FinRiskAtlas, a Chinese-language benchmark that evaluates financial LLMs along two complementary dimensions: operation execution under fixed evidence states and evidence-state control under evolving review conditions. The static benchmark contains 9,742 instances across 53 task families, including 42 Domain Knowledge families and eleven downstream review operations defined by explicit evaluation contracts. FinRisk-Ask extends this framework through offline replay of 680 pre-action states from 104 de-identified professional trajectories, withholding future evidence during inference and using it only to construct expert-verified evidence targets. Across 33 model configurations, operation-level evaluation yields non-redundant rankings (mean pairwise Spearman correlation 0.42 across downstream operations), and knowledge-based shortlisting can incur up to 18.01 points of regret on individual operations. FinRisk-Ask further shows that entering the Ask branch more frequently does not necessarily improve request targeting or end-to-end evidence acquisition. These results show that broad financial capability scores do not fully capture where models are reliable in professional workflows, motivating evaluation units aligned with the decisions and evidence states that deployed systems must support.

[95] PonsRAG: A Pons-Inspired RAG Bridging Cognitive Islands for Coordinated Long Narrative Reasoning cs.AI | cs.CLPDF

Rongchen Zhao, Yu Chen, Juyuan Wang, Zhouting Mo, Jianxing Yu

TL;DR: 本文提出PonsRAG，一个受生物脑桥启发的协调式检索增强生成框架，旨在解决长叙事推理中的认知孤岛和跨层证据断开问题。其核心包括构建三层索引以连接知识结构，以及协调推理机制来整合跨层信息。在四个长上下文叙事基准测试中，PonsRAG在多项选择任务上平均准确率相对最强基线提升了11.56%。

Details

Motivation: 解决长叙事推理中现有检索增强生成方法面临的两个关键挑战：认知孤岛（信息片段孤立）和跨层证据断开（不同层次证据缺乏关联）。

Result: 在四个长上下文叙事基准测试上进行评估，实验结果表明PonsRAG超越了最强基线，在多项选择任务上实现了平均准确率11.56%的相对提升。

Insight: 创新点在于受生物脑桥启发，通过三层索引构建连接的知识结构来桥接认知孤岛，并设计协调推理机制实现跨层证据检索与信息整合，为长叙事推理提供了结构化的增强框架。

Abstract: Long Narrative Reasoning is an essential capability for processing and reasoning over complex narratives. While retrieval-augmented generation provides a promising framework, existing methods still face two critical challenges: cognitive islanding and cross-layer evidence disconnection. To address these issues, we propose PonsRAG, a coordinated RAG framework inspired by the biological pons. PonsRAG consists of two key components: Triple-Layer Indexing, which organizes documents into a connected knowledge structure to bridge cognitive islands, and Coordinated Reasoning, which retrieves evidence across distinct layers and integrates cross-layer information into a unified context. We evaluate PonsRAG on four long-context narrative benchmarks, and experimental results show that it outperforms the strongest baseline, achieving a 11.56% relative improvement in average accuracy on multi-choice tasks.

[96] CVE-SAI: Counterfactual Visual Evidence-Guided Selective Attribute Indexing for Risk-Controlled E-commerce Search cs.AI | cs.CVPDF

Xiaolong Sun, Qichao Wang, Hangyu Li, Liang Chen

TL;DR: 本文提出了一种名为CVE-SAI（反事实视觉证据引导的选择性属性索引）的方法，用于电子商务搜索中的风险控制。该方法首先从主图像和属性问题中推断并冻结一个受本体约束的候选属性（不依赖目录文本），然后决定该候选是否应被纳入索引。通过焦点区域扭曲（FZD）和证据引导注意力重分配（EGAR）等技术，系统评估视觉证据支持，并在严格的校准和审计下控制不安全属性的准入，从而在提升检索性能的同时限制索引污染。

Details

Motivation: 当前多模态产品模型在补全缺失的电商属性时，仅优化属性-答案的准确性，缺乏对视觉证据支持的验证，混淆了瞬时预测与持久索引准入，且没有对事实错误或视觉不支持的值进行明确的风险控制。

Result: 在基于Amazon Berkeley Objects的五个视觉属性上的实验表明，CVE-SAI提升了属性推断和证据定位能力，在共享风险协议下实现了最高的认证准入覆盖率，并在自动准入系统中获得了最强的受控检索性能，同时具有最低的不安全自动诱导暴露。

Insight: 创新点在于将推断与准入决策分离，通过反事实干预构建视觉依赖代理来评估证据必要性，并引入严格的校准和审计机制（如证据保留、干扰变换稳定性等）进行风险控制，确保只有视觉支持的属性才能被持久索引，从而在提高检索质量的同时有效管理风险。

Abstract: Multimodal product models can complete missing e-commerce attributes, yet current methods still optimize attribute-answer accuracy without verifying visual support, conflate transient prediction with persistent index admission, and lack explicit risk control over factually incorrect or visually unsupported values. We address these gaps with Counterfactual Visual Evidence-Guided Selective Attribute Indexing (CVE-SAI), which first infers and freezes an ontology-constrained candidate from the primary image and attribute question without catalog text, and then decides whether that candidate should enter the index. Focus-Zone Distortion (FZD) constructs an attribute-specific visual-dependence proxy through a controlled counterfactual intervention, and Evidence-Guided Attention Redistribution (EGAR) uses the proxy to refine ontology-constrained scoring. The canonical candidate is frozen before evidence necessity, evidence retention, nuisance-transformation stability, and candidate-specific catalog-text conflict audits; catalog text can only tighten admission and cannot revise the candidate. Independent family-level calibration selects one policy with a simultaneous one-sided finite-sample bound under a 5% unsafe-admission budget. Experiments on five visual attributes derived from Amazon Berkeley Objects show that CVE-SAI improves attribute inference and evidence localization, achieves the highest certified admission coverage under the shared risk protocol, and yields the strongest controlled retrieval performance with the lowest unsafe auto-induced exposure among automatic-admission systems. Separating inference from admission therefore enables visually supported attribute completion to improve retrieval while limiting persistent index contamination.

[97] Trace Integrity for LLM Data Agents: A Vision for Auditable Structured Reasoning in Real-World Systems cs.AI | cs.CLPDF

Srimonti Dutta, Akshata Kishore Moharir

TL;DR: 本文针对LLM数据代理在结构化数据任务中的可靠性问题，提出了’追踪完整性’这一部署可靠性标准，强调仅答案正确性不足以评估系统可靠性，因为正确的答案可能来自无效的计算追踪。论文通过引入’执行契约’这一结构化构件来绑定用户意图、模式元素、操作计划等，并定义了’正确答案/无效追踪率’来量化仅答案评估的不足。在BIRD Mini-Dev基准上的实验表明，答案准确率、追踪完整性通过率和CAIT率是三个不同的评估信号。

Details

Motivation: 当前LLM数据代理在结构化数据任务中，仅凭答案准确性作为可靠性信号是不充分的，因为正确的答案可能由无效的计算追踪产生，这在实际部署中会导致不可审计的’静默失败’。论文旨在解决自然语言推理与自由形式原理无法可靠指定现实系统所需操作级程序之间的’结构鸿沟’问题。

Result: 在BIRD Mini-Dev基准上的实证演示中，Direct SQL、Operation Summary + SQL和Contract-First SQL三种方法的答案准确率分别为20%、22%和24%，而其追踪完整性通过率分别为39%、43%和40%，CAIT率则高达55%、59.1%和45.8%，表明答案准确率、追踪有效性和静默失败风险是三个独立的评估信号。

Insight: 论文的核心创新点是提出了’追踪完整性’这一可审计的可靠性标准，并引入了’执行契约’这一结构化构件来确保计算过程的显式性、可执行性、模式有效性、操作忠实性、可重放性、答案一致性和可审计性。这为评估和部署现实世界中的LLM数据代理提供了一个超越答案匹配的、更严格的框架，强调了过程可审计性的重要性。

Abstract: Answer accuracy is an insufficient reliability signal for LLM data agents. In structured-data tasks, a benchmark-correct answer can be produced by an invalid trace. This paper introduces Trace Integrity, a deployment reliability criterion for evaluating whether the computation recorded behind an answer is explicit, executable, schema-valid, operator-faithful, replayable, answer-consistent, and auditable. We identify the Structure Gap as the deployment failure mode that makes Trace Integrity necessary: natural-language reasoning and free-form rationales do not reliably specify the operator-level programs required by real-world systems. We operationalize Trace Integrity with execution contracts, structured artifacts that bind user intent to schema elements, operator plans, assumptions, executable queries, verification status, and final-answer linkage. We also introduce CAIT (Correct Answer / Invalid Trace) Rate, which measures how often answer-only evaluation counts computationally unsupported outputs as successes. In an empirical demonstration on BIRD Mini-Dev, Direct SQL, Operation Summary + SQL, and Contract-First SQL achieve answer accuracies of 20%, 22%, and 24%, while their Trace Integrity Pass Rates are 39%, 43%, and 40% and their CAIT Rates remain high at 55%, 59.1%, and 45.8%, showing that answer accuracy, trace validity, and silent-failure risk are distinct evaluation signals. Real-world LLM data agents should, therefore, be evaluated not only by whether their outputs match a reference answer, but by whether those outputs are backed by auditable computation.

Alec K. Peltekian, Gorkem Durak, Halil Ertugrul Aktas, Carrie Lynn Richardson, Mary Carns

TL;DR: 本文提出了一种用于间质性肺病（ILD）分类的分层多模态混合专家（MoE）模型，该模型通过两阶段门控机制整合了预训练的影像专家和结构化电子健康记录（EHR）。模型使用模态级门控为影像和EHR预测分配患者特异性权重，并使用子门控模块将EHR分支分解为临床定义的特征组，实现明确的EHR专业化。

Details

Motivation: 动机是利用MoE模型的原则性机制来利用医学数据的异质性，解决ILD诊断中如何有效且可解释地融合多模态数据（影像和EHR）的问题。

Result: 在严格的患者级交叉验证下，该模型取得了所评估方法中最高的平均AUC（0.8750 ± 0.0443），优于仅使用影像的REN模型（0.8646）和SwinUNETR模型（0.7685）。

Insight: 创新点在于分层门控设计：它保持了预训练影像表示的稳定性，同时实现了输入依赖的临床权重分配和明确的EHR特征组专业化。该框架还将可解释性扩展到解剖区域、影像-EHR利用以及临床定义的EHR特征组层面。

Abstract: Mixture-of-experts (MoE) models combine specialized predictors under learned routing, offering a principled mechanism for leveraging heterogeneity in medical data. We present a hierarchical multimodal MoE for interstitial lung disease (ILD) classification that integrates a frozen, pre-trained imaging expert with structured electronic health records (EHR) via two-stage gating. A modality-level gate assigns patient-specific weights to imaging and EHR predictions, while a sub-gating module decomposes the EHR branch into clinically defined feature groups with learned, group-specific contributions. This design preserves stable imaging representations while enabling input-dependent clinical weighting and explicit EHR specialization. Under strict patient-level cross-validation, the model achieved the highest mean AUC among the evaluated methods (0.8750 +- 0.0443), compared with 0.8646 for imaging-only REN and 0.7685 for SwinUNETR. The framework extends interpretability across anatomical regions, imaging–EHR utilization, and clinically defined EHR feature groups.

[99] AsymSpec: Context-Asymmetric Speculative Decoding for Agentic LLMs cs.AI | cs.CLPDF

Sheng Liang, Yongyue Zhang, Nathanael Brian, Hang Lv, Hao Wang

TL;DR: 本文提出了AsymSpec，一种用于智能体大语言模型（LLM）的非对称推测解码框架。它通过让轻量级草稿模型读取完整上下文，而大型验证模型仅处理压缩后的上下文，来平衡推理延迟与任务准确性。该方法在保持高验证稳定性和草稿接受率的同时，显著提升了吞吐量并降低了计算成本。

Details

Motivation: 智能体LLM流水线在多轮交互中上下文不断累积，导致推理成本激增。现有方法（如输入压缩）会损害任务准确性，而传统的推测解码（SD）要求草稿和验证模型共享相同上下文，无法解决准确性与开销之间的权衡问题。

Result: 在四个智能体能力和两个端到端智能体基准测试中，AsymSpec平均达到了约90%的全上下文准确率，在独立的文本能力任务上实现了1.3-1.7倍的吞吐量加速，计算成本仅为0.2-0.3倍。

Insight: 核心创新在于打破了传统推测解码的上下文对称性假设，提出了非对称上下文访问框架。具体技术包括：通过对比性δ融合的对数概率引导，以及一个基于分歧感知的接受门控机制，以稳定验证过程并维持高草稿接受率。这在压缩会丢弃关键推理信号时尤其有效。

Abstract: Agentic LLM pipelines face escalating inference costs as context accumulates across retrieval, tool use, and multi-turn interactions. To control latency, deployments routinely compress inputs, but this degrades task accuracy. Speculative decoding (SD) accelerates generation losslessly, yet it assumes the drafter and verifier share an identical context, preventing SD from resolving the accuracy-overhead trade-off. We propose AsymSpec, an asymmetric speculative decoding framework that breaks this symmetry: a lightweight drafter reads the full input while the large verifier operates on the compressed view. The drafter steers the verifier via a contrastive $δ$-fusion of logits, modulated by a divergence-aware acceptance gate that preserves verification stability and high draft acceptance rates. Evaluated across four agentic capabilities and two end-to-end agent benchmarks, AsymSpec reaches $\approx 90%$ of full-context accuracy on average, delivering $1.3$–$1.7\times$ throughput speedups at $0.2$–$0.3\times$ the compute cost on isolated text capabilities. These results show that asymmetric context access yields substantial gains precisely when compression discards critical reasoning signals.

eess.SP [Back]

[100] Token-Oriented Semantic Communication with Pretrained Vision Transformers eess.SP | cs.AI | cs.CV | cs.LGPDF

Jiwoong Im, Minwoo Kim, Jaeho Lee, Yo-Seb Jeon, Yongjune Kim

TL;DR: 本文提出了一种面向令牌的语义通信框架，用于资源受限的边缘系统中的客户端-服务器协同推理。该框架通过预训练的视觉Transformer（ViT）与学习型图像压缩（LIC）模型的空间对齐，实现了基于令牌级任务相关性的选择性潜在向量传输，避免了直接传输令牌嵌入，从而降低了通信成本并提升了模型互操作性。

Details

Motivation: 解决直接传输Transformer令牌嵌入带来的两大实际挑战：高昂的通信成本和跨模型特定令牌嵌入空间的有限互操作性。

Result: 在ImageNet上的实验表明，该框架在率-精度权衡上优于最近的语义通信方案、手工编解码器以及任务无关的LIC模型。

Insight: 创新点在于利用ViT补丁令牌与LIC潜在向量的一对一空间对齐，实现令牌级任务相关性指导的选择性传输；框架采用模块化设计，协调三个预训练组件而无需端到端训练，并通过代理令牌替换等技术适配冻结的服务器模型。

Abstract: Token communications realize the semantic communication principle at the granularity of transformer tokens, providing a promising direction for client–server collaborative inference in resource-constrained edge systems. However, directly transmitting token embeddings presents two practical challenges: substantial communication cost and limited interoperability across model-specific token embedding spaces. To address these challenges, we propose a \emph{token-oriented} semantic communication framework. In this framework, token-level task relevance determines which compressed image latents are transmitted, enabling token-granular transmission without directly transmitting token embeddings. The framework is modular, coordinating three pretrained components—a lightweight client-side vision transformer (ViT), a learned image compression (LIC) model, and a large server-side ViT—without end-to-end training. The key enabler is the one-to-one spatial alignment between ViT patch tokens and the LIC latent vectors, which allows token-level task relevance to directly determine which latent vectors are transmitted. Building on this alignment, token-aligned LIC selectively transmits task-relevant latents, layer-selective attention rollout estimates token relevance from a selected range of attention layers in a single forward pass, and surrogate token substitution adapts the frozen server model by optimizing a single learnable token. Experiments on ImageNet show that the proposed framework achieves a more favorable rate–accuracy trade-off than recent semantic communication schemes, hand-crafted codecs, and task-agnostic LIC models.

cs.SD [Back]

[101] Can We Read the Mind of an Audio LLM? A Verbalizable, Multilingual Middle-Layer Workspace cs.SD | cs.AI | cs.CLPDF

Jiajun Fan, Jingyuan Li, Prashanth Gurunath Shivakumar, Qi Luo, Jia-Hong Huang

TL;DR: 本文通过logit lens技术读取Qwen3-Omni音频语言模型的中间层激活，发现模型在输出任何token之前，其内部已形成可言语化的、多语言的概念表示。研究揭示了音频驱动信号的五个关键特性：包含隐藏的多跳推理链、语言无关性、保留副语言信息、在模型中层最清晰且因果有效，以及不同认知功能在层间的分布。

Details

Motivation: 音频语言模型通常被视为黑盒，其内部推理过程不可见。本研究旨在探索模型在处理音频输入时，在最终输出之前的中间层中究竟形成了何种可解读的表示，以理解其’思维’过程。

Result: 研究为定性分析，未报告具体基准测试分数。但通过控制实验（如波形交换）定量表明，38%的英语输入在中间层的top-1读出是中文概念，且音频输入比其无情感的文字转录能更准确地驱动正确回答。

Insight: 创新点在于发现并系统描述了音频LLM中间层存在一个可言语化、多语言的工作空间，它能编码音频特有的副语言信息和隐藏的推理链。这为理解模型内部表示、进行中间层监控或干预提供了新视角，且方法不依赖于模型的链式思维输出。

Abstract: An audio language model is a black box in a specific way: we see what it says, never what it works out on the way there, and chain-of-thought monitoring helps only if the model writes its reasoning down. Reading a base Qwen3-Omni with a logit lens at the audio-token positions, we find that the answer to a spoken question becomes legible - in words - in the model’s middle layers, before it emits any token. Five findings follow. (1) The readout carries concepts in neither the question, the options, nor the model’s own transcription: on a clip whose verbatim transcription is empty garbling, it reconstructs Watergate and scandal, passes through the role president, and resolves to Nixon - a hidden multi-hop chain, read with no chain-of-thought. (2) The content is language-agnostic: one audio-inferred concept surfaces in several scripts at once, and 38% of top-1 readouts are Chinese on English inputs. (3) It is paralinguistic: given the same clip as audio and as the model’s own emotion-free caption, the audio mind forms the sound source, speaker role, or affect that the caption discards, and answers correctly more often. (4) The audio-driven signal is absent at the input, turns on about a tenth of the way into the network, separates most cleanly from the text prior in the middle band (35-80% of depth), and activation patching shows it is causally used and committed before the last fifth of the layers. (5) Deleting single layers maps the pipeline: reading the sound in is localized to the entry layers and answer delivery to the output layer, while retrieval is distributed across the interior. Throughout, a waveform-swap control - identical text, only the sound changed - isolates the audio-driven signal from a prior over the printed options. This is a qualitative account of what an audio model works out before it speaks: the quantities are controls, not benchmark scores.

cs.CY [Back]

[102] GGSS: Geodesic-Gated Spherical Steering for Inference-Time Debiasing of Generative Vision-Language Models cs.CY | cs.CL | cs.CVPDF

Yiqun Sun, Junyu Chen, Pengfei Wei, Lawrence B. Hsieh

TL;DR: 本文提出GGSS（Geodesic-Gated Spherical Steering），一种用于生成式视觉语言模型（VLMs）推理时去偏的方法。该方法在单位超球面上发现反事实偏置子空间，沿测地线弧引导视觉令牌，并使用自适应门控机制聚焦于携带更强人口统计信号的令牌进行校正。

Details

Motivation: 生成式视觉语言模型在人类中心场景中应用日益广泛，但即使图像仅在受控属性（如感知种族或性别）上不同，它们也可能产生人口统计偏见的输出。现有推理时去偏方法主要针对静态嵌入或CLIP类模型设计，而非生成式VLMs。

Result: 在四个生成式VLM上，针对十种适应后的推理时去偏基线方法和基于提示的缓解方法进行评估，遵循单一操作点协议，涵盖分类、成对和职业-性别偏置测试，同时测量通用视觉语言能力。GGSS在所有四个模型上实现了最低的平均偏置，在配对置换检验中，四个骨干网络中有三个结果显著，同时将MMStar准确率保持在未引导基线的+/- 0.6个百分点以内。

Insight: 创新点在于提出了一种保持范数的干预方法，通过发现单位超球面上的反事实偏置子空间、沿测地线弧引导视觉令牌，并引入自适应门控来聚焦校正，专为生成式VLMs的推理时去偏设计，在有效降低偏置的同时保持了模型的通用能力。

Abstract: Generative vision-language models (VLMs) are increasingly used in human-centered settings, yet they can produce demographically biased outputs even when images differ only in controlled attributes such as perceived race or gender. However, existing inference-time debiasers were largely designed for static embeddings or CLIP-like models rather than generative VLMs. We propose GGSS—Geodesic-Gated Spherical Steering—a norm-preserving intervention that discovers a counterfactual bias subspace on the unit hypersphere, steers visual tokens along geodesic arcs, and uses an adaptive gate to focus correction on tokens that carry stronger demographic signal. We evaluate four generative VLMs against ten adapted inference-time debiasing baselines and prompt-based mitigation under a single operating-point protocol across categorical, pairwise, and occupation-gender bias tests, while also measuring general visual-language capability. GGSS achieves the lowest average bias on all four models, significant on three of four backbones under paired permutation tests, while preserving MMStar accuracy within +/- 0.6 p.p. of the unsteered baseline. Code is available at https://github.com/dukesun99/GGSS.

eess.IV [Back]

[103] Modality Contribution Score - A Per-Patient Framework for Quantifying the Relative Diagnostic Contribution of Structural MRI and Amyloid PET in Alzheimer’s Disease eess.IV | cs.AI | cs.CV | cs.LGPDF

Dawa Chyophel Lepcha, Aaliya Ali, Sophie A. Martin, Deepika Koundal, Pierrick Coupe

TL;DR: 本文提出了模态贡献网络（MCNet）和模态贡献分数（MCS），这是一个针对单个患者的归因框架，用于量化在阿尔茨海默病（AD）连续谱（从认知正常到轻度认知障碍再到AD）中，结构MRI和淀粉样蛋白PET这两种成像模态对诊断决策的相对贡献。MCS通过模态消融进行归一化，为每位患者提供一个可解释的、临床可操作的分数。该方法在ADNI-3和OASIS-3数据集上进行了验证，展示了其有效性和泛化能力。

Details

Motivation: 现有的多模态神经影像AI系统（结合结构MRI和PET）虽然能捕获互补信息，但只输出单一诊断标签，无法解释对于特定患者，是哪种成像模态驱动了诊断决策。这限制了其在个性化医疗和可信AI中的应用。

Result: 在ADNI-3的327名参与者（认知正常、轻度认知障碍和AD三组平衡）上，MCNet实现了有竞争力的三阶段分类性能（AUC=0.881）。MCS揭示了从认知正常到AD，PET模态贡献度显著单调增加的趋势（p<0.0001），并与独立的淀粉样蛋白SUVR和FDG代谢生物标志物显著相关。在独立的OASIS-3队列（1073名受试者）中成功复现，证明了其跨队列泛化性。

Insight: 核心创新点是提出了首个针对单个患者的、可量化的模态贡献度评分框架（MCS），它通过模态消融进行归一化，直接量化了每种成像模态对特定患者诊断的“投票权重”。这比仅提供单一标签或事后归因（如SHAP）更具临床可解释性和行动指导意义，为个性化影像决策、临床试验分层和可信赖的痴呆症护理AI奠定了基础。

Abstract: Multimodal neuroimaging combining structural MRI and positron emission tomography (PET) captures complementary structure-function relationships across the Alzheimer’s disease (AD) continuum, yet existing artificial intelligence systems produce a single diagnostic label without quantifying which imaging modality drove that decision for a specific patient. We introduce the Modality Contribution Network (MCNet) and the Modality Contribution Score (MCS), the first per-patient attribution framework quantifying the shift in modality dominance from structural atrophy to amyloid and metabolic dysfunction across the cognitively normal to MCI to AD continuum. MCS is normalised to unity per subject via modality ablation (MCS_MRI_i + MCS_PET_i = 1.0 for every subject i), providing an interpretable, clinically actionable score that fluid biomarkers cannot supply. Applied to 327 ADNI-3 participants balanced across cognitively normal, mild cognitive impairment, and AD groups, MCNet achieved competitive three-class staging performance (AUC=0.881). The MCS revealed a statistically significant monotonic gradient (Kruskal-Wallis p<0.0001), with increasing PET dominance from cognitively normal (MCS_PET 0.412+/-0.229) through MCI (0.489+/-0.289) to AD (0.671+/-0.426), validated against amyloid SUVR (r=0.172, p=0.006) and FDG metabolic biomarkers (r=-0.287, p=0.0005) from separate imaging pipelines. External replication in 1,073 independent OASIS-3 subjects confirmed cross-cohort generalisability (H=166.99, p<0.0001, eta^2=0.156). A mechanistic comparison with SHAP demonstrated that ablation-based MCS captures clinically meaningful modality dependence that deviation-based methods cannot. These findings position MCNet as a foundation for personalised imaging decisions, clinical trial stratification, and trustworthy AI in dementia care.

[104] Improving Cross-Site Whole-Heart Segmentation eess.IV | cs.CVPDF

Tanish Mudaliar, Justin Li, Daniel Lin, Julianna Vo, Kaitao Liao

TL;DR: 该论文提出了一种用于提高跨站点全心脏分割鲁棒性的方法，通过结合TotalSegmentator初始化的nnU-Netv2模型与基于站点特征、保留标签的外观增强策略，有效应对多中心、多模态数据分布偏移带来的挑战。

Details

Motivation: 解决多中心、多模态CT和MRI数据中，由于采集分布差异（如间距、强度、重建纹理和解剖结构变化）导致的模型泛化性能下降问题，特别是在有限标注数据下，提升模型在未见站点上的分割效果。

Result: 在CARE全心脏分割任务的主要保留站点验证集上，该方法将CT的平均Dice系数从0.8350提升至0.9135，MRI的平均Dice系数从0.7695提升至0.7830，同时降低了HD95（豪斯多夫距离95%分位数），表明性能显著改善。

Insight: 创新点在于提出了一种基于站点特征分析的外观增强策略（结合偏置场和贝塞尔曲线增强），通过可测量的图像属性来指导数据空间的泛化路径，这是一种在有限数据下提升跨站点鲁棒性的实用方法。

Abstract: Whole-heart segmentation from CT and MRI is essential for quantitative cardiac image analysis, but remains challenging under multi-center and multi-modality distribution shift. In the CARE whole-heart segmentation task, models must generalize from limited labeled sites to unseen acquisition distributions, where variation in spacing, intensity, reconstruction texture, and anatomy can degrade out-of-distribution performance. We propose a modality-routed 3D cardiac segmentation pipeline that combines TotalSegmentator-initialized nnU-Netv2 models with site-characterized, label-preserving appearance augmentation. We first characterize the available sites using measurable image properties and use this analysis to motivate candidate data-space generalization routes. The final retained recipe applies Bias Field + Bezier appearance augmentation, combining smooth spatial intensity perturbation with nonlinear intensity remapping, followed by lightweight class-wise largest-connected-component cleanup. On the primary held-out-site validation splits, the final configuration improves CT mean Dice from 0.8350 to 0.9135 and MRI mean Dice from 0.7695 to 0.7830, while also reducing HD95. These results suggest that site-motivated appearance augmentation is a practical strategy for improving cross-site robustness in limited-data whole-heart segmentation. Our code can be found in https://github.com/Purdue-M2/Improving-Cross-Site-Whole-Heart-Segmentation

cs.RO [Back]

[105] GaussVLA: Geometry-Aware Spatial Reasoning for Vision-Language-Action Model cs.RO | cs.CVPDF

Md Selim Sarowar, Md Tanvir Islam, Sungho Kim, Sangtae Ahn

TL;DR: 本文提出了GaussVLA，一种基于Mamba架构的视觉-语言-动作模型，旨在解决现有VLA模型因使用缺乏几何结构的2D图像块标记而导致的有限空间推理能力问题。该方法通过引入高斯空间标记器将语义和深度特征提升为紧凑的3D高斯标记，并结合深度感知思维链进行结构化几何推理，从而在保持参数高效的同时，显著提升了模型在空间操作任务上的性能。

Details

Motivation: 现有VLA模型将视觉观测编码为扁平的2D图像块标记，这些标记缺乏内在的几何结构；即使加入稠密单目深度信息，也仅提供了像素级的标量值，无法有效表征表面方向或几何置信度，这限制了策略在动作预测中进行结构化空间推理的能力。

Result: 在仿真和真实世界评估中，GaussVLA展现出强大的空间操作性能且保持参数高效。在LIBERO基准测试中，仅用2亿参数就实现了93.5%的平均成功率，并在其空间套件上达到100%的成功率，相对于SpatialVLA模型，平均成功率相对提升了19.7%，同时参数效率显著更高。

Insight: 核心创新点在于提出了高斯空间标记器和深度感知思维链两个定制模块，前者将冻结的语义和深度特征提升为具有几何意义的3D高斯表示并进行池化，后者在语言和流时间条件下执行结构化的、非自回归的几何推理。这为VLA模型引入了显式的、可解释的几何结构理解能力，是提升空间操作任务性能的关键。从客观角度看，将3D高斯表示与Mamba架构结合，并设计专门的几何推理链，是一种新颖且有效的技术路径。

Abstract: Vision-Language-Action (VLA) models encode visual observations as flat 2D patch tokens that carry no intrinsic geometric structure, and augmenting them with dense monocular depth injects per-pixel scalar values that encode neither surface orientation nor geometric confidence. This leaves the policy with limited structured spatial reasoning for action prediction. We propose GaussVLA, a Mamba-based VLA that incorporates two custom modules: Gaussian Spatial Tokenizer (GST) to lift frozen semantic and depth features into compact 3D Gaussian tokens, pools geometrically salient regions with learned queries, and \emph{Depth-Aware Chain-of-Thought (DA-CoT)} that performs structured, non-autoregressive geometric reasoning under language and flow-time conditioning. Across both simulation and real-world evaluations, GaussVLA demonstrates strong spatial-manipulation performance while remaining parameter-efficient. On LIBERO, it achieves 93.5% average success and 100.0% success on the Spatial suite with only 200M parameters, improving over SpatialVLA by 19.7% relative average success while remaining significantly more parameter-efficient.

[106] $R^3$: Training Robots to Reason in Natural Language via Reinforcement Learning cs.RO | cs.AI | cs.CL | cs.LGPDF

Lehong Wu, Yuxiao Qu, Zheyuan Hu, Ivan Zhang, Limin Wei

TL;DR: 这篇论文提出了 $R^3$ 方法，一种将现成的视觉语言模型（VLM）转化为机器人推理器的后训练方案。该方法通过专家生成推理轨迹进行中期训练，然后利用基于离线动作数据的单步准则强化学习进行改进，以生成自由形式的语言推理来指导低层动作策略。在 Language Table 和模拟双臂杂货打包两个基准测试中，该方法在探索和泛化到未见任务方面表现优异，显著超越了仅使用指令的模仿学习基线。

Details

Motivation: 研究动机是探索视觉语言模型（VLM）是否能够通过自然语言推理来指导低层机器人操作策略，以解决长视野任务中需要跟踪部分进度、推理物体关系、从错误中恢复以及引导噪声低层策略等挑战。

Result: 在 Language Table 和模拟双臂杂货打包这两个用于研究机器人推理和长视野操作的受控测试平台上，$R^3$ 方法在探索和泛化到未见任务方面显著提升，并大幅超越了仅使用指令的模仿学习基线模型。

Insight: 论文宣称的创新点在于 $R^3$ 方法能够训练 VLM 生成自由形式的语言推理作为测试时的计算机制来引导低层策略，这与先前主要使用结构化轨迹作为辅助监督的机器人推理方法不同。从客观角度看，该方法将语言推理作为一种可优化的、灵活的中间表示，并通过强化学习进行对齐，为结合大模型推理能力与机器人控制提供了一种新的后训练范式。

Abstract: Reasoning in language allows foundation models to spend more test-time compute on hard problems, such as those requiring decomposition, constraint tracking, and prediction of future consequences. Whether this mechanism can improve robotic manipulation remains unclear, where long-horizon tasks require tracking partial progress, reasoning about object relations, recovering from mistakes, and steering noisy low-level policies. In this paper, we study whether VLMs can be trained to reason directly in natural language to guide low-level manipulation policies. We introduce $R^3$, a simple post-training recipe that turns off-the-shelf VLMs into robotic reasoners: it first mid-trains a VLM on expert-generated reasoning traces to initialize the desired reasoning style, then improves the reasoner with single-step rubric-based RL from offline action data. Unlike prior robotic reasoning methods that mostly use structured traces as auxiliary supervision, $R^3$ trains free-form language reasoning to produce test-time guidance for action. We instantiate $R^3$ on Language Table and simulated bimanual grocery packing, two controlled testbeds for studying robotic reasoning and long-horizon manipulation. $R^3$ improves exploration and generalization across unseen tasks and significantly outperforms instruction-only imitation learning baselines on both benchmarks. Our analyses suggest that free-form language reasoning can function as a test-time compute mechanism for steering low-level policies. Our project page is available at https://robotic-reasoner.github.io/.

[107] Zero-WAM: In-Context World-Action Modeling from Human Videos for Open-Ended Task Generalization cs.RO | cs.CVPDF

Jiaming Zhou, Qihang Zhang, Gangwei Xu, Cunxin Fan, Yujie Zhao

TL;DR: 本文提出了Zero-WAM，一种用于机器人操作的因果视频-动作模型，它能够通过遵循上下文提供的人类视频指导来执行未见过的任务。为了解决任务丰富的配对人机数据稀缺问题，作者构建了HumanGen数据集，并引入了上下文未来块预测（IFP）训练目标。该方法在仿真和真实世界评估中均实现了对未见任务的泛化。

Details

Motivation: 解决机器人学习中的零样本跨任务泛化挑战，即让策略执行训练中从未见过的操作任务。受大语言模型上下文学习启发，作者认为人类视频是比语言更丰富的任务规范形式，并旨在将这一范式引入机器人操作领域。

Result: 在RoboTwin 2.0仿真环境的七个未见任务上，Zero-WAM实现了47.0%的平均成功率，比最强的视频-动作基线绝对提升了29.5个百分点。在真实世界评估中，它能够泛化到涉及多物体场景、长时程操作和精细插入的未见任务配置。

Insight: 核心创新点在于将人类视频作为任务规范的上下文提示，并构建了大规模的人机上下文学习配对数据集（HumanGen）。所提出的IFP训练目标有效抑制了模型从已见任务中学习捷径，强制其从视频提示中提取任务信息，从而实现了零样本跨任务泛化。

Abstract: Zero-shot cross-task generalization, where a policy must execute manipulation tasks never seen during training, remains a central challenge in robot learning. In large language models, a novel task can be performed simply by specifying it in the context, without any parameter update. This form of in-context learning (ICL) turns generalization into a problem of task specification. To achieve cross-task generalization, we bring this paradigm to robotic manipulation, and argue that the natural task specification for manipulation is a human video: unlike language, it provides rich visual cues about the intended task evolution. We present Zero-WAM, a causal video-action model that executes unseen tasks by following in-context human video guidance. To address the scarcity of task-rich paired human-robot data, we propose an automatic pipeline that converts task-sampled robot trajectories into semantically matched human videos, yielding HumanGen, a dataset of 74.2K human-robot ICL pairs across 8.6K tasks. For model training, we further introduce an in-context future chunk prediction (IFP) objective that suppresses shortcuts learned from seen tasks and forces the policy to draw task information from the video prompt. On seven unseen tasks in RoboTwin 2.0 simulation, Zero-WAM achieves a 47.0% average success rate, an absolute improvement of 29.5 percentage points over the strongest video-action baseline. In real-world evaluations, it follows human video guidance to generalize to unseen task configurations involving multi-object scenes, long-horizon manipulation, and fine-grained insertion.

Table of Contents

cs.CL [Back]

[1] The Dialect Tax: Dialectal Biases Persist throughout the Language Modeling Pipeline cs.CL | cs.AI | cs.LGPDF

[2] The Imperfective Paradox Is Not Necessarily in Large Language Models: A Benchmark Failure Before a Model Failure cs.CL | cs.LGPDF

[3] SelfGraphRAG: Bridging the Supervision Gap in Graph-Based RAG with Synthetic QA Generation cs.CL | cs.AIPDF

[4] From Memorization to Absorption: Mixed-Policy RL for Continual Knowledge Injection cs.CL | cs.LGPDF

[5] Groundhog Bit-Flip Attack: Seeding Infinite Generation Loops in Mixture-of-Experts LLMs through Bit Flips cs.CLPDF

[6] Routed Graph Handoff: Adaptive Format Selection for Multi-Agent LLM Delegation cs.CL | cs.AIPDF

[7] Adaptive Triggering for Bias Correction in LLM Reasoning cs.CL | cs.AIPDF

[8] OmniPhys: A Unified Multimodal Benchmark for Physics Understanding and Generation from Chinese Educational Corpora cs.CLPDF

[9] DCGC: Draft-Conditioned Global Correction for Complex Reasoning with Masked Diffusion Models cs.CL | cs.AIPDF

[10] MathAdv: What Theorem Provers Know, Reason, Formalize, and Generalize cs.CL | cs.AI | cs.LOPDF

[11] ReliableRAG: Combating Misinformation in Retrieval-Augmented Generation via Reliability-Guided Reasoning Chains cs.CL | cs.IRPDF

[12] ClueWeaver: Reward-Guided Dual-Agent Evidence Reasoning for Compact LLMs on Literary Long Narratives cs.CLPDF

[13] EgoArgus: Benchmarking VLMs as Situational Assistants for Modality-Grounded User Supports cs.CLPDF

[14] GRIP: Granular Reward-Guided Parameter Interpolation for Efficient Reasoning cs.CLPDF

[15] AutoVerifier: Residual-Guided Non-Parametric Optimization for Reference-Based Answer Verification cs.CLPDF

[16] AWM: Answerable Working Memory for Long-Document VQA Agents cs.CLPDF

[17] Think-Probe-Respond: Improving Large Language Models as Judges of Research Idea Novelty cs.CL | cs.AIPDF

[18] Overview of SHROOM-Visions 2026: A Shared Task on Hallucination Detection in Large Vision-Language Models cs.CLPDF

[19] Learning New Facts with QLoRA: An Acquisition-Retention Frontier cs.CL | cs.AI | cs.LGPDF

[20] Unfolding Scientific Papers into Multi-Turn Generation Trajectories for Continued Pre-Training cs.CL | cs.AI | cs.LGPDF

[21] Skill Issue: Are Skills Language-Invariant in LLMs? cs.CL | cs.AI | cs.GT | cs.LGPDF

[22] Anchoring Bias in LLM-as-a-Judge Systems: Prior Scores Compromise Evaluation Independence cs.CLPDF

[23] From Passive Response to Proactive Correction: Enhancing LLM Robustness Against Input Fact Perturbations cs.CLPDF

[24] Query-Side Attacks on GNN-Based KGQA: Tracing Failures from Entity Linking to Answer Generation cs.CL | cs.AI | cs.IRPDF

[25] VISA: Agentic Self-Evolving Data Synthesis for Multimodal Instruction Following cs.CLPDF

[26] Beyond Local Surprise: Grounded Dialogue as Selective Belief Revision under Referential Uncertainty cs.CLPDF

[27] Prefix Sliding for efficient test-time scaling cs.CL | cs.AI | cs.LGPDF

cs.CV [Back]

[28] Fusing Perceptual Vision Experts with Multimodal Large Language Models for Explainable Plant Disease Diagnosis: From Benchmark Imagery to Real-World Robotic Field Validation cs.CV | cs.AIPDF

[29] A Lightweight Multimodal Vision-Language Framework for Early-Stage Anatomical Green Fruit Classification in Commercial Orchards cs.CV | cs.AIPDF

[30] Targeting the Attention Heads Behind Object Hallucination in LLaVA cs.CV | cs.AIPDF

[31] See More, Detect Less? Taming Information Leakage in Multi-View Anomaly Detection cs.CV | cs.MMPDF

[32] Can You Trust Frozen Hematology Foundation Models under Acquisition Shift? cs.CV | cs.AI | q-bio.QMPDF

[33] RefLAM: A Reference-Grounded Line Annotation Pipeline for Historical Arabic Manuscripts cs.CV | cs.CLPDF

[34] Lowering the Barrier to AI-Driven Inspection: A No-Code Workflow for Automated Structural Defect Detection cs.CV | cs.LG | eess.IVPDF

[35] Lightweight Machine Learning-Driven Monocular Sidewalk Path Extraction for Embedded Micromobility Navigation cs.CV | cs.AIPDF

[36] PointRL: Learning Point-Level Vision-Language Grounding from Verifiable Annotation Evidence cs.CVPDF

[37] What Do Medical Vision-Language Models Learn in Radiology? Transfer, Alignment, and Source-Proxy Leakage Under Distribution Shift cs.CV | cs.AIPDF

[38] V-Link: Recovering Lost Visual Representations in Action DiT for Vision-Language-Action Models cs.CVPDF

[39] Not All Attention Heads Contribute to Critical Visual Token Selection: Head-Aware Pruning Matters More cs.CVPDF

[40] CoRE: Weakly Supervised Coarse-to-Fine Risk Evidence Learning in Driving Videos cs.CV | cs.AIPDF

[41] Where to Look Matters: On-Policy Self-Distillation for Long-Video Understanding cs.CVPDF

[42] Capacity Overflow: A Blind Spot for Backdoor Attacks in Vision MoE cs.CV | cs.CRPDF

[43] RSFusionDet: Underwater RGB-Sonar Multimodal Object Detection cs.CVPDF

[44] Efficient Training with Foresight: Multi-Token Auxiliary Supervision for Autoregressive Image Generation cs.CVPDF

[45] AdaptiveEmbed: Sample-Adaptive Multi-Vector Representation for Multimodal Retrieval cs.CVPDF

[46] Bootstrapping a 4D LiDAR Annotation Tool from Video Foundation Models cs.CVPDF

[47] VGA-BenchV2: An Expanded Unified Benchmark and Multi-Model Framework for Evaluating Video Aesthetics and Generation Quality cs.CV | cs.AIPDF

[48] 4DStreamCtrl: Interactive Video Generation with Online 4D Control cs.CV | cs.AIPDF

[49] Semi-Supervised Adaptation of Vision-Language Models for Image Classification cs.CVPDF

[50] SMART: MLLM-guided Temporal Alignment for Unifying Sign Language Recognition and Spotting cs.CVPDF

[51] Asymmetric Cross-Modal Fine-Grained Visual Categorization: ACF-Net and the BirdPro Benchmark cs.CVPDF

[52] Video-IFBench: Evaluating Instruction Following of Multimodal LLMs in Video Understanding Scenarios cs.CVPDF

[53] AdaVDR: Adaptive Tool Use and Reflection for Video Deep Research cs.CV | cs.AIPDF

[54] CrossMambaTuning: Synergistic Spatial and Cross-Layer Adaptation for Machine Vision Compression cs.CV | cs.AIPDF

[55] V-Rubrics: Visual Faithfulness via Rubric-Based Reinforcement Learning cs.CV | cs.AIPDF

[56] A Dual-Transformer for Multi-Camera View Recommendation cs.CV | cs.AIPDF

[57] MLLMCLIP: Feature-Level Distillation of MLLM for Robust Vision-Language Representations cs.CV | cs.AIPDF

[58] Plans You Can Check: Verifier-Grounded Learning of an Open-Weight Planner for Executable Video-Editing cs.CV | cs.CLPDF

[59] On the Separation of Human and AI-Generated Images in CLIP Embedding Space cs.CVPDF

[60] SeVeR: Selective Visual Exposure and Retrieval for 3D Medical Image Question Answering cs.CVPDF

[61] MAMA-FLUX.2: Image-to-Image Synthesis of Post-Contrast Breast DCE-MRI for the MAMA-SYNTH Challenge cs.CVPDF

[62] Towards Purified Multi-Label Test-Time Adaptation of Vision-Language Models cs.CVPDF

[63] Skeleton-based Zero-Shot Spatio-Temporal Action Localization via Weakly-Supervised Pretraining cs.CVPDF

[64] Unsupervised Anatomical Feature Learning via Diffusion Models: Enhanced Medical Image Segmentation with Denoising Diffusion Probabilistic Models cs.CV | cs.AI | cs.LGPDF

[65] LongVU-TTT: Causal Test-Time Training for Visual Resampling in Long Video Understanding cs.CVPDF

[66] Moving Beyond More Views: Redundancy-Aware Ego-Exo Fusion for Proficiency Estimation cs.CVPDF

[67] TDFNet: Tri-projection Deformable Fusion Network for Panoramic Salient Object Detection cs.CVPDF

[68] Label-Free Foundational Model Selection for Medical Image Classification under Distribution Shift via Pseudo Label Discrepancy cs.CVPDF

[69] FlowMoDL: Model-Based Deep Learning with Conjugate-Gradient Data Consistency for Highly Accelerated 4D Flow MRI Reconstruction cs.CV | cs.LGPDF

[70] DEFUSE: Generalizable Backdoor Defense for Self-Supervised Encoders with Generative Priors cs.CVPDF

[71] LUTSeg: A Longitudinal Multi-Expert Dataset for Ulcer Tissue Segmentation cs.CVPDF

[72] Visual General Intelligence: A White Paper cs.CVPDF

[73] Code World Model: Coding Agent as World Brain cs.CV | cs.AI | cs.CLPDF

[74] Auditable CT Phenotyping Through Report-derived Radiological Observations cs.CVPDF

[75] TAU-Agent: An Agentic Retrieval-Augmented Framework for Traffic Anomaly Understanding cs.CV | cs.AIPDF

[76] Less Contouring, More Accuracy: Lesion-Guided ROI Deep Learning for Ovarian Ultrasound Classification cs.CVPDF

[77] PANDA - Prototype-Anchored Alignment for Partially Unpaired Multimodal Learning, with Applications to Alzheimers MRI and TCGA Pathology cs.CV | cs.AIPDF