cs.CL [Total: 44]
cs.CV [Total: 78]
cs.LG [Total: 2]
physics.med-ph [Total: 1]
cs.IR [Total: 3]
physics.ao-ph [Total: 1]
cs.CR [Total: 1]
cs.RO [Total: 1]
cs.SE [Total: 1]
eess.IV [Total: 1]
hep-ex [Total: 1]
cs.AI [Total: 14]
cs.HC [Total: 1]

cs.CL [Back]

[1] Behaviorally Grounded User Profiles from the Wild for Personalized Alignment and Multi-Perspective Reasoning cs.CL | cs.AIPDF

Yuxuan Li, Victor Zhong, Ehsan Kamalloo

TL;DR: 本文提出了一种名为‘行为基础用户画像’的框架，用于直接从真实的匿名社交媒体帖子中提取开放、高保真的用户画像。该框架在训练时通过监督微调实现个性化，在测试时支持非参数化的多视角推理。在复杂的推荐和开放查询基准测试中，该方法显著提升了基础模型性能，并超越了基于合成画像的基线方法。

Details

Motivation: 现有基于角色的方法主要依赖僵化、合成的用户画像，这些画像忽略了个人差异、依赖刻板印象，且无法捕捉驱动真实人类偏好的细微信号。本文旨在解决这一问题，通过从真实行为数据中提取更丰富、更准确的用户画像。

Result: 在复杂的推荐和开放查询基准测试中，基于行为基础的用户画像持续提升了基础模型性能，并超越了合成画像基线。该方法在参数化对齐和多视角推理方面都取得了更强的效果。

Insight: 主要创新点在于提出了直接从真实社交媒体行为数据中提取开放、高保真用户画像的框架。这为下一代个性化语言系统提供了一个高度多样化且有效的基础，避免了合成画像的刻板化和信息扁平化问题。

Abstract: Persona-driven techniques increasingly adapt large language models (LLMs) to diverse contexts. However, existing methods predominantly rely on rigid, synthetic personas that flatten individual variation, rely on stereotypes, and miss the nuanced signals driving actual human preferences. We introduce profile behavioral grounding, a framework for extracting open-ended, high-fidelity user profiles directly from authentic, anonymized social media posts. We evaluate these profiles across two paradigms: train-time personalization via supervised finetuning (SFT) and non-parametric test-time multi-perspective reasoning. Across complex recommendation and open-ended query benchmarks, behaviorally grounded profiles consistently improve base models and outperform synthetic profile baselines, driving stronger parametric alignment and enabling richer, multifaceted reasoning. Our findings establish open-ended, behavior-derived profiles as a highly diverse and effective foundation for the next generation of personalized language systems. Our code base is available at https://github.com/ServiceNow/behavior-grounding.

[2] Life Operators: a self-evolving framework for multiscale life modelling cs.CL | cs.AI | physics.bio-phPDF

Shuo Wang, Yike Guo

TL;DR: 本文提出了Life Operators框架，用于多尺度生命建模。该框架通过定义感知、演化和生成三种算子，以及桥接算子，构建任务特定的算子图，以表示患者状态、耦合不同尺度并支持科学假设的局部修订。

Details

Motivation: 解决医学AI中缺乏统一框架来表示患者状态、耦合多尺度数据以及修订失败假设的问题，旨在预测干预下患者状态的变化。

Result: 未在摘要中提及具体实验结果或基准测试，但框架被设计为支持任务特定的算子图构建，并可能通过AI协同科学家进行持续验证和积累。

Insight: 创新点在于引入算子化模块结构，将生命建模分解为可组合和修订的组件，支持多尺度集成和科学假设的局部化更新，为医学超智能提供计算基础。

Abstract: Medical AI is moving beyond recognition towards clinical dialogue and longitudinal prediction. Yet a central question remains: how would a patient’s state change under intervention? Statistical models learn future observations, whereas mechanistic models describe selected processes. Neither provides a common framework for representing patient state, coupling scales or revising failed assumptions. We propose Life Operators: task-bounded mappings that define three scientific roles. Perception operators infer task-relevant biological states from multimodal observations, Evolution operators propagate these states under natural or intervention-conditioned dynamics, and Generation operators map them to measurable signals. Each role may be realised by equations, statistical models, neural networks or hybrids. Bridge operators connect components with different variables, scales and time steps. Selected operators and bridges form task-specific Operator Graphs containing the smallest set of states and mechanisms sufficient for a declared claim. This modular structure also makes scientific revision localisable. An AI co-scientist may propose changes to states, operators, bridges or graph structure, while independent evidence determines which variants are retained, restricted or retired. Over time, validated components could accumulate into broader multiscale models of the human body and provide a computational foundation for medical artificial superintelligence.

[3] Do Multimodal LLMs See Before They Read? Diagnosing Contextual Sycophancy cs.CL | cs.AIPDF

Yi-Cheng Lai, Hen-Hsen Huang

TL;DR: 本文研究了多模态大语言模型中的‘上下文迎合’现象，即外部文本会覆盖冲突的图像证据。作者提出了一个包含998个案例的诊断方法，通过独立改变视觉证据、常识先验和外部文本来探究此现象，并引入‘系统2视觉仲裁’方法来缓解问题。实验表明，信息引入的时机和模型选择对结果有显著影响。

Details

Motivation: 解决多模态大语言模型中外部文本可能错误地覆盖或扭曲视觉证据的问题，即‘多模态上下文迎合’现象，旨在诊断和理解这一失败模式的发生条件。

Result: 在异常图像与错误文本配对的测试中，GPT-5.1在联合条件下的准确率仅为7.9%，而采用系统2视觉仲裁（S2VA）方法后提升至84.2%。在六个模型上，S2VA相比直接目击报告提升了19.7到44.1个百分点，所有配对95%置信区间均不包含零。

Insight: 创新点在于提出了一个诊断多模态上下文迎合的框架，并引入了系统2视觉仲裁（S2VA）方法，通过控制文本信息的引入时机来改善模型对视觉证据的依赖。客观分析表明，信息边界的设计（何时引入文本）对模型性能有决定性影响，且最佳策略可能因模型和上下文来源而异。

Abstract: External text can override conflicting image evidence in multimodal large language models, a failure we call multimodal contextual sycophancy. We introduce a 998-case diagnostic that independently varies visual evidence, commonsense priors, and external text, and probe when this failure arises by moving the information boundary around a context-blind visual witness. On abnormal images paired with Gemini-generated false text, GPT-5.1 scores 7.9% under joint conditioning, 49.7% when the context-blind witness report is scored directly, 63.7% under a matched two-call witness-arbiter pipeline that exposes the witness to the text, and 84.2% under System-2 Visual Arbitration (S2VA), which withholds the text from the witness. Across six models, S2VA improves over the direct witness report by 19.7 to 44.1 points, with all paired 95% confidence intervals excluding zero. The best information boundary is not uniform: textual context scaffolds some models, and a GPT-4o-regenerated subset changes the relative ordering of joint conditioning, Witness-Only, and S2VA. Contextual sycophancy is therefore sensitive to when text is introduced, as well as to the model and context source.

[4] Do General NLP Embeddings Capture Ontological Reasoning? cs.CL | cs.AIPDF

Hamed Babaei Giglou, Jennifer D’Souza, Sören Auer

TL;DR: 本文提出了AVA框架，用于评估通用NLP嵌入模型在捕捉本体论推理能力方面的表现。研究发现，现有模型在区分逻辑敏感的本体关系语义方面存在显著局限，且微调后的改进难以迁移到下游语义Web任务。

Details

Motivation: 研究动机是探究通用NLP嵌入模型是否能够有效捕捉符号化的本体结构，解决其在语义Web任务中能力不明确的问题。

Result: 在AVA框架的171,007个对比三元组上评估了25个SOTA嵌入模型，最佳模型三元组准确率仅为0.739，硬负例准确率低至0.135；微调虽能提升区分能力，但向下游任务（如分类发现和本体对齐）迁移效果差。

Insight: 创新点在于构建了系统性的本体推理评估框架AVA，揭示了语言表示学习与本体级判别之间的持续差距，挑战了NLP基准性能强即代表语义Web能力强的假设。

Abstract: General-purpose NLP embedding models perform well on linguistic tasks, but their ability to capture symbolic ontological structure remains unclear. We introduce AVA, a systematic framework for evaluating whether embeddings distinguish logic-sensitive relational semantics in ontologies and knowledge graphs. AVA comprises 171,007 contrastive triplets derived from 163 heterogeneous ontologies using hierarchy inversion, relation substitution, and disjointness injection. Each triplet contains an ontology statement, a semantically equivalent paraphrase, and a logic-sensitive hard negative with contradictory relational meaning. We evaluate more than 25 state-of-the-art embedding models and find substantial limitations: the best model achieves only 0.739 triplet accuracy, while hard negative accuracy falls to 0.135. Fine-tuning improves discrimination by a large margin but transfers poorly to downstream Semantic Web tasks, including taxonomy discovery and ontology alignment. Further analysis suggests that improvements stem partly from perturbation-specific pattern recognition rather than robust ontological understanding. These findings reveal a persistent gap between linguistic representation learning and ontology-level discrimination, challenging the assumption that strong NLP benchmark performance translates to Semantic Web competence.

[5] Uncovering and Mitigating Aggregation-Induced Reward Hacking in Multi-Reward Reinforcement Learning cs.CLPDF

Yu Yuan, Yaoyou Fan, Lili Zhao, Guangting Zheng, Kai Zhang

TL;DR: 本文研究了在多奖励强化学习中，固定权重聚合奖励维度会导致奖励黑客问题，即优化过程偏向于最容易、最密集或系统偏好的维度，从而陷入次优策略。为解决此问题，论文提出了自适应多奖励投影（AMRP）方法，通过在线调整聚合权重来改善奖励分布的平衡性和下游任务性能。

Details

Motivation: 动机在于发现多奖励强化学习中固定权重聚合会引发奖励黑客问题，导致策略陷入次优状态，无法收敛到更平衡的奖励分布，从而影响任务性能。

Result: 在结构化推理、引用生成和开放对齐等任务中，AMRP在GRPO框架下相比固定和动态权重基线，持续改善了奖励分布平衡和下游性能；同时，该方法在GDPO和PPO中也保持有效，支持跨RL算法的兼容性。

Insight: 创新点在于提出AMRP方法，利用相对短缺、奖励波动和近期进展三个信号动态调整聚合权重，以缓解奖励黑客问题；从客观角度看，该方法轻量且通用，为多奖励RL中的权重优化提供了新思路。

Abstract: Reinforcement learning fine-tuning of large language models increasingly adopts multiple reward dimensions, including verifiable rules, task-specific evaluators, and learned reward models, to provide richer supervision across diverse capabilities. These dimensions are commonly scalarized with fixed aggregation weights. We identify a failure mode in which aggregation itself induces reward hacking: static projection aliases qualitatively different reward profiles into a single scalar, steering optimization toward whichever dimensions are easiest, densest, or systematically favored by the reward signal. Over training, this traps the policy in suboptimal profiles and prevents convergence to better-balanced ones that would yield higher task performance. To address this, we propose Adaptive Multi-Reward Projection (AMRP), a lightweight online method that reallocates aggregation weights using three signals, relative shortfall, reward volatility, and recent progress, increasing pressure on lagging, unstable, or stagnant dimensions while relieving saturated ones. Across structured reasoning, citation-grounded generation, and open-ended alignment under GRPO, AMRP consistently improves reward-profile balance and downstream performance over fixed and dynamic weighting baselines; it also remains effective with GDPO and PPO, supporting compatibility across RL algorithms. Our code is available at https://github.com/yyhappier/AMRP.git.

[6] NSIDDx: A Design Framework for Neuro-Symbolic, Practitioner-First Differential Diagnosis in Low-Resource Settings cs.CLPDF

Aarav Singh

TL;DR: 本文提出NSIDDx设计框架，针对低资源环境下的鉴别诊断系统，强调将临床医生视为主动推理主体。该框架通过神经符号管道实现，包含三元症状编码、矛盾检测、审计字符串和医生覆盖等功能，可在消费级硬件上离线运行。

Details

Motivation: 现有基于LLM的诊断系统在基准测试中语义准确率高，但在临床罕见病例的开放评估中，其宣称的准确率与可验证的临床可靠性之间存在系统性差距，且输出常不可验证、难以被临床医生质询。

Result: 论文评估了一个LLM+罕见疾病RAG流程在两个队列中的表现，揭示了上述问题。提出的NSIDDx框架旨在解决这些问题，但大规模验证仍需前瞻性研究。

Insight: 创新点在于将临床医生置于循环核心的设计原则，以及具体实现的神经符号集成管道（包括三元编码、矛盾检测等机制），为低资源环境下的临床NLP系统提供了以从业者为中心的新设计范式。

Abstract: LLM-based diagnostic systems achieve high semantic accuracy on benchmarks, but open-ended evaluation on clinically uncommon presentations reveals a systematic gap between headline accuracy and verifiable clinical reliability. We evaluate an LLM+rare-disease-RAG pipeline across two cohorts and show that the paradigm produces confident outputs that are frequently unverifiable and systematically resistant to clinician interrogation. We present NSIDDx (Neuro-Symbolic Integrated Differential Diagnosis System), a design framework arguing that DDx systems in low-resource settings must treat the clinician as an active reasoning agent. We instantiate this through a neuro-symbolic pipeline with ternary symptom encoding, contradiction detection, audit strings, and practitioner override - running offline on consumer hardware. We distill five design principles for clinician-in-the-loop clinical NLP and invite the prospective studies needed to validate the claim at scale.

[7] Slow to See, Slow to Suppress: Understanding the Effects of Modality in Context-Memory Conflicts cs.CLPDF

Athulith Paraselli, Etha Tianze Hua, Ellie Pavlick

TL;DR: 该研究探讨了视觉语言模型在处理上下文-记忆冲突时的行为，即当模型在上下文中接收的信息与训练期间参数化存储的信息不一致时的情况。研究发现模型存在不对称偏好：对于文本中出现的实体，模型倾向于偏好上下文信息；而对于图像中出现的实体，则更倾向于参数化信息。这种不对称性与跨模态的晚期表征对齐有关，视觉实体处理时间较长阻碍了模型通常的事实回忆机制的抑制，从而导致更多参数化答案。思维链推理未能解决这一差距，但增加上下文中的视觉信息显示出一定效果。

Details

Motivation: 研究动机是理解视觉语言模型在面临上下文信息与训练记忆冲突时的处理机制，揭示多模态模型中行为一致性的复杂性，特别是在模型日益多模态化和检索增强的背景下。

Result: 研究结果表明模型在处理文本和图像实体时存在不对称偏见，视觉信息处理延迟导致参数化答案偏好；思维链推理无效，但增加视觉上下文信息能缓解问题。这些发现基于对VLMs在上下文-记忆冲突任务上的实验分析。

Insight: 创新点在于揭示了VLMs中跨模态处理的时间不对称性如何影响上下文与记忆的权衡，强调了视觉处理延迟对模型决策的特定影响，为设计更一致的多模态系统提供了见解。

Abstract: We investigate how vision-language models (VLMs) handle context-memory conflicts; that is, situations in which the model is given information in context that differs from what was stored parametrically during training. We document asymmetric biases: models tend to prefer in-context information about entities which appear in text, but prefer parametric information about entities which appear in images. We relate this asymmetry to the late representational alignment across modalities, showing that the longer processing time associated with resolving visual entities prevents the suppression of the model’s usual factual recall mechanism, thus resulting in more parametric answers. Chain-of-thought reasoning does not appear to resolve the gap, but increasing the amount of visual information in the context does show an effect. These results illustrate the complexity of ensuring consistent behavior as models become increasingly multimodal and retrieval-augmented.

[8] From Tool Use to Technological Agency: LoopCAT as a Local-First, Open-Source Tool for Translation Technology Education cs.CLPDF

Gokhan Dogru, Adrià Martín Mor

TL;DR: 本文介绍了LoopCAT，一个基于Apache-2.0许可、本地优先的开源计算机辅助翻译环境，它整合了本地项目存储、翻译记忆、术语库、质量保证和AI服务连接等功能，并提出了一个连接工作流能力、评估判断和技术能动性的教育框架，旨在为翻译技术教育提供一个可审查的学习工具和教学材料。

Details

Motivation: 为了解决翻译学生不仅需要学习如何使用翻译技术，还需要学会评估这些技术所提供选择的问题，论文旨在通过一个开源、可审查的工具和环境，促进学生在技术使用中发展批判性判断和能动性。

Result: 论文未报告新的学生学习成果定量结果，但详细描述了LoopCAT工具的实现功能、开发验证记录以及一个包含四类参与形式（操作工作流、评估输出、检查配置机制、进行有界干预）的教育框架及其教学应用示例（如六次课程序列、UI本地化作业）。

Insight: 创新点在于将开源、本地优先的翻译工具（LoopCAT）本身作为可翻译和审查的教学材料，并提出了一个连接技术操作与批判性判断的教育框架，强调在可审查的软件环境中培养翻译学生的技术能动性，而非仅仅关注工具使用技能。

Abstract: Translation students need to learn both how to use translation technologies and how to judge the choices those technologies make available. This article presents LoopCAT, an Apache-2.0-licensed, local-first computer-assisted translation environment co-created with OpenAI Codex using GPT-5.5 and GPT-5.6, and proposes a framework connecting workflow competence, evaluative judgement, and technological agency. The account draws on repository history, implementation inspection, and the verification records of an identified development build. LoopCAT combines local project storage, translation memories, terminology, quality assurance, document exchange, and optional connections to local or hosted AI services. Its English, Catalan, and Turkish interface catalogs also make the application itself available as teaching material: students can translate English UI strings into another language, review the existing automatically generated target drafts, import their revisions, and test the interface. We organize these opportunities around four forms of participation: operating a workflow, evaluating outputs, inspecting and configuring mechanisms, and making or defending a bounded intervention. A six-session sequence, a UI-localization assignment, a placeholder example, and an assessment rubric specify how teachers could use the framework. The paper separates implemented capabilities from proposed educational benefits; it reports no new student-learning outcomes. It distinguishes the latest package checks from earlier regression evidence and sets out a protocol for classroom evaluation. LoopCAT provides an inspectable setting for teaching how translation decisions interact with data, interfaces, and software rules. Whether these activities improve judgement, transfer, or participation remains an empirical question.

[9] Neurosymbolics for Data Engineering: Achieving Long Context Token Reduction Without Finetuning cs.CL | cs.AI | cs.LGPDF

Vishvesh Bhat

TL;DR: 本文提出了一种新型的神经符号层，可无缝集成到现有LLM骨干网络中，旨在同时提升逻辑推理能力和缓解长上下文推理的计算瓶颈。该方法无需微调即可在BIRD-CRITIC和LiveSQLBench等基准上显著提升准确率，并能在长上下文任务中将有效token使用量减少50%以上，将时间复杂度从O(n²)降至近似O(n)。

Details

Motivation: 解决LLM在数据工程任务中面临的两大挑战：一是无需微调即可提升逻辑推理准确率的需求，二是Transformer架构固有的二次方时间复杂度在长上下文推理中造成的计算瓶颈。

Result: 在BIRD-CRITIC和LiveSQLBench等基准测试中，平均准确率提升了85%，且无需任务特定微调或RLHF。在长上下文任务中，有效token使用量减少超过50%，时间复杂度从O(n²)降至近似O(n)。

Insight: 创新点在于设计了一个即插即用的神经符号层，通过符号处理来优先处理和压缩相关上下文信息，从而同时实现推理性能提升和计算效率优化。这种方法为增强LLM的可靠性和降低推理成本提供了新思路。

Abstract: Large Language Models are increasingly deployed for sophisticated data engineering tasks such as generating structured queries from natural language, Text-to-SQL, and automating complex spreadsheet operations. However, maximizing their utility demands both higher finetuning-free accuracy and solutions to the computational bottleneck imposed by the Transformer architectures inherent quadratic (On2) time complexity. This paper introduces a novel drop-in neurosymbolic layer designed to seamlessly integrate into existing LLM backbones enhancing logical reasoning and mitigating long-context resource consumption. On the reasoning front, the layer immediately and significantly improves performance yielding an average accuracy increase of 85% across rigorous benchmarks including BIRD-CRITIC and LiveSQLBench, critically achieving these gains without any task specific finetuning or RLHF. Concurrently, we repurpose this approach to address the severe computational strain of long context inference. By leveraging symbolic processing to prioritize and compress relevant contextual information the layer reduces the effective token usage by over 50% and brings the effective time complexity down from O(n2) to approximately O(n) on certain long context tasks. This dual impact approach not only makes LLMs substantially more reliable for data engineering but also drastically reduces the computational pressure on inference chips, making long context tasks more manageable and cost effective.

Zach Studdiford, Kanishka Misra

TL;DR: 本文通过跨模态泛化实验研究视觉语言模型（VLMs）是否能够超越表面共现学习抽象语法规则，特别是数的一致性。研究发现VLMs在仅通过视觉线索诊断数的情况下仍能表现出跨模态泛化行为，表明其具有抽象能力。

Details

Motivation: 解决语言模型是否仅依赖词汇共现学习语法数，还是能学习抽象规则的争议，通过跨模态设置排除文本分布线索的干扰。

Result: 在行为、表征动态和因果机制分析中，VLMs在仅视觉线索条件下表现出非平凡的跨模态泛化，且与文本线索条件处理方式相似。

Insight: 利用跨模态泛化作为探测抽象能力的工具，表明统计学习者（如VLMs）能超越表面共现，展现出与抽象规则一致的行为。

Abstract: Language models learn about grammatical number primarily from co-occurrence, and show frequency effects as a result—sometimes taken to indicate that they do not learn abstract ``rules’’, and are instead dependent on specific lexical items. Testing generalization with text stimuli alone cannot settle this debate, since distributional cues (is/are, this/these) easily give number away. We instead use cross-modal generalization as a tool to investigate abstractions in LMs that can also accept visual inputs (VLMs), restricting the evidence that diagnoses number to an extra-linguistic modality. We teach VLMs pairs of new nouns by adding new embeddings and only updating them during learning, comparing conditions where number is diagnosed by visual cues alone against ones where it is disambiguated by text. Across behavior, representational dynamics, and causal mechanisms, we find non-trivial evidence for cross-modal generalization across both exposure conditions, and that linguistic vs. extra-linguistic cue conditions are treated in similar ways in the internal mechanisms of the model. This suggests that statistical learners like VLMs can generalize beyond surface-level co-occurrence and show genuine abstraction-compatible behavior.

[11] Removable and Irreducible: A Token-Cost Ledger for the Multilingual Tokenization Tax cs.CLPDF

Madhulatha Mandarapu, Sandeep Kunkunuru

TL;DR: 本文研究了多语言大语言模型中非英语文本的’分词税’问题，即相同内容在非英语语言中需要更多分词，导致计算成本显著增加。论文通过构建一个分词成本账本，将分词成本分解为可移除的编码冗余、残余编码松弛、内在内容项和不可约的字形-音素项，并量化了可移除冗余的比例。在FLORES-200数据集上的实验表明，生产级分词器对印度语系脚本的分词成本是英语的8.9倍，而通过训练脚本匹配的编码可移除约64%的冗余，且内在内容差异小于6%。

Details

Motivation: 解决大语言模型在处理非英语文本时存在的’分词税’问题，即相同内容在非英语语言中需要更多分词，导致序列长度增加和二次方注意力计算成本大幅上升，探究这种成本中有多少是可移除的冗余。

Result: 在FLORES-200数据集的八种语言上，生产级分词器对印度语系脚本的分词成本是英语的8.9倍；通过训练脚本匹配的编码（基于1012个句子）可移除中位数64%的冗余（自助法95%置信区间[0.638, 0.647]），且内在内容差异小于6%；构建的编码在受控源上可移除98%的冗余，分词税导致注意力成本最高增加79倍。

Insight: 创新点在于提出了统一的分词成本账本框架，将分词成本分解为可移除与不可约部分，并量化了可移除冗余；客观分析表明，分词税主要源于表示冗余而非信息内容差异，这为优化多语言分词器以降低计算开销提供了理论依据和实用工具（开源一键式工具）。

Abstract: Large language models pay a well-documented tax on non-English text: the same content costs several times more tokens, and because attention is quadratic in sequence length, far more compute. We ask how much of this tax is removable. Framing the token layer as source coding – transformer compute is monotone in sequence length, whose per-atom floor is the Shannon rate $H/\log_2 V$, an object already applied to tokenizers in prior work – we assemble a token-cost ledger that splits each language’s cost, at fixed parallel content, into a removable coding redundancy, a residual coding slack, an intrinsic-content term, and an orthogonal, irreducible grapheme-to-phoneme term that governs the multimodal rather than the text cost. On FLORES-200 across eight languages, a production tokenizer costs up to $8.9\times$ more tokens for Indic scripts than for English; a script-matched code trained on $1,012$ sentences removes a median $64%$ of that excess (bootstrap 95% CI $[0.638, 0.647]$), and a script-fair information floor shows the intrinsic content differs by under $6%$ – the tax is representational, not informational. A constructed code removes $98%$ of a controlled source’s redundancy, and the token tax implies up to $79\times$ attention cost. We are explicit about scope and failure: this is compute-and-memory accounting, not a model-quality claim; we neither measure nor claim the cross-lingual direction of the orthographic term; and our matched code is a conservative small-data demonstration. We contribute the unifying ledger, the removable-versus-intrinsic attribution, and an open one-command harness.

[12] MemeBridge: A Dataset for Benchmarking and Mitigating the Bidirectional Cultural Gap in Meme Interpretation cs.CL | cs.HCPDF

Hangxiao Zhu, Suliu Qin, Zhuoyan Li, Ming Jiang, Yu Zhang

TL;DR: 本文介绍了MemeBridge数据集，该数据集聚焦于美国起源的模因，旨在捕捉跨文化理解中的双向文化鸿沟。数据集通过众包流程构建，包含中国参与者对模因的解释以及美国参与者对其他文化可能误解的预期，并提供了情感、文化意义等多维度标注。实验表明，现有大语言模型在跨文化理解上存在局限，而基于MemeBridge微调能有效提升模型性能。

Details

Motivation: 解决跨文化交流中因文化背景差异导致的模因理解困难，现有基准数据集缺乏必要文化语境，无法准确评估模型跨文化理解能力。

Result: 在MemeBridge数据集上评估多个大语言模型，发现不同文化背景开发的模型仅具备部分跨文化理解能力，在复杂解释上表现不佳；而使用该数据集微调后模型性能得到提升。

Insight: 创新点在于构建了双向文化视角的模因数据集，强调表达与感知的双重框架，为跨文化理解提供细粒度基准；客观分析认为，该数据集通过标注文化隐含知识（如信念、规范），为训练和评估全球化场景下的大语言模型提供了有价值的文化接地资源。

Abstract: Communicating across cultures is inherently challenging, especially through culturally dense and ambiguous formats like memes. While people expect large language models (LLMs) to hold promise for bridging such gaps, existing benchmark datasets often fail to capture the cultural context necessary for accurate interpretation. To address this, we introduce MemeBridge, a curated dataset centered on U.S.-originated memes, designed to capture two complementary perspectives: (1) how Chinese participants interpret these memes, and (2) how U.S. participants anticipate how people from other cultures might misunderstand them. Here, context refers to implicit cultural knowledge, including background beliefs, norms, and shared assumptions that shape meme comprehension. The dataset was constructed via a multi-stage crowdsourcing pipeline with rigorous validation, including human agreement checks and GPT-based classification verification. Each meme is annotated with sentiment, emotion, cultural significance, and knowledge type, providing rich supervision for downstream tasks. Notably, we observe that the anticipated misunderstandings from U.S. participants are often inaccurate, highlighting the asymmetries in cultural understanding and the challenges of adopting perspectives beyond one’s own. This bidirectional framing, which focuses on both expression and perception, enables more nuanced benchmarking of cross-cultural comprehension. Our probing of multiple LLMs reveals that while models developed in different cultural contexts exhibit partial cross-cultural understanding, they often struggle with sophisticated interpretations. By contrast, fine-tuning with MemeBridge improves model performance, underscoring the value of culturally grounded resources for training and evaluating LLMs in globally diverse settings.

[13] Same Semantics, Different Outcome: On the Modality Robustness of Multimodal LLMs under Knowledge Conflict cs.CLPDF

Jungyeon Lee, Yejin Yoon, Taeuk Kim

TL;DR: 本文研究了多模态大语言模型在知识冲突下的模态鲁棒性问题，发现模型在处理文本和图像形式的矛盾信息时存在不一致性，且这种不稳定性会影响多模态检索增强生成性能并易受对抗攻击。

Details

Motivation: 探究多模态大语言模型在处理异构形式（文本、图像或两者结合）的上下文证据时，尤其是在证据与模型参数知识冲突的情况下，是否具有一致的模态处理能力。

Result: 在13个MLLMs和两个数据集上的实验表明，模型远非鲁棒：模型更倾向于接受图像形式的矛盾信息；当矛盾文本和图像同时出现时，偏好模态具有任意性。监督微调能部分缓解问题，但多数简单技术无效。

Insight: 揭示了MLLMs在知识冲突下存在根本性的模态处理不一致问题，挑战了常见认知，并指出需要在多个训练阶段关注此问题以实现更稳健的模型。

Abstract: Multimodal large language models (MLLMs) are increasingly provided with contextual evidence in heterogeneous forms: as a text passage, as a rendered image of the same passage, or as both together. However, it remains unclear how consistently these surface forms are processed, especially when the evidence conflicts with the model’s parametric knowledge. We study modality robustness under knowledge conflict across 13 MLLMs and two datasets, and find them far from robust. (1) Contrary to common belief, models favor a context that contradicts parametric knowledge more readily in image form than in text form; (2) when a contradicting text and image are presented together, the preferred modality is essentially arbitrary, varying with input order, model, and dataset. We further demonstrate that this instability has practical consequences: it degrades performance in multimodal RAG and can be exploited by adversarial attacks. To alleviate this brittleness, we examine several simple techniques—prompting, steering, supervised fine-tuning (SFT), and direct preference optimization; the majority prove ineffective, whereas SFT achieves moderate success. We therefore call for greater awareness of this inconsistency and argue that it is fundamental, demanding attention at multiple training stages.

[14] EM^2Mem: Event-Centric Multimodal Memory for Large Language Models cs.CL | cs.AI | cs.LG | cs.MMPDF

Yijun Chen, Yaqi Zheng, Yanya Li, Boyi Xiao, Buqiang Xu

TL;DR: 本文提出了EM^2Mem，一种以事件为中心的多模态记忆框架，用于提升大语言模型在长视频问答任务中的性能。该框架在构建记忆时将异构证据（如字幕、帧、文本、摘要、图事实）绑定到事件锚点上，形成事件索引的记忆单元，从而支持基于事件的紧凑证据读取，而非检索孤立的模态片段。

Details

Motivation: 现有用于长视频问答的多模态记忆方法通常检索孤立的模态片段（如字幕、帧、文本摘要等），这些片段虽然可搜索，但并非“生成就绪”，导致语言模型在推理时需要在上下文有限且归因困难的情况下重建跨模态和时间对齐。

Result: 在三个长视频问答基准测试中，EM^2Mem比最强的记忆基线平均准确率分别提高了2.0、2.4和3.7个百分点，严格事件级Top-5证据召回率提高了7.0个百分点，同时将每次查询的延迟降低了4.67倍，并将总推理令牌数减少了63.66%。

Insight: 创新点在于提出了以事件为中心组织多模态记忆的范式，将跨模态证据、时间上下文、图关联关系和语义事实统一绑定到事件锚点上，形成结构化的记忆单元，从而直接提供对齐的、可归因的证据，减轻了模型在推理时对齐和整合的负担。

Abstract: Multimodal memory offers a scalable interface for long-video question answering, but existing methods often retrieve captions, frames, transcripts, summaries, or graph facts as isolated fragments. Although searchable, such fragments are not generation-ready: language models must reconstruct cross-modal and temporal alignments at inference time, when context is limited and attribution is difficult. We propose EM^2Mem, an event-centric multimodal memory framework that binds heterogeneous evidence to event anchors during memory construction. Each event-indexed memory cell aligns multimodal records, temporal context, graph-linked relations, semantic facts, and provenance, enabling compact evidence readout over grounded multimodal events rather than modality-specific fragments. Across three long-video QA benchmarks, EM^2Mem improves average accuracy over the strongest memory baseline by 2.0, 2.4, and 3.7 points, improves strict event-level Top-5 evidence recall by 7.0 points, and reduces per-query latency by 4.67 times and total inference tokens by 63.66% (The code will be integrated into https://github.com/zjunlp/LightMem).

[15] Trust Your Guide Only When Certain: Uncertainty-Aware Sparse Alignment at Inference Time cs.CLPDF

Zeen Zhu, Zhuo Li, Weiyang Guo, Liye Zhao, Haibing Di

TL;DR: 本文提出了一种名为TUSA（基于信任的不确定性稀疏对齐）的推理时对齐方法，旨在解决现有密集干预方法中弱监督器在大多数令牌上表现出高熵、导致低置信度干预破坏基础模型有效推理的问题。该方法将对齐重构为动态仲裁过程，仅当监督器置信度高且令牌语义显著时才授权干预，从而过滤噪声和冗余监督。

Details

Motivation: 现有推理时对齐范式使用轻量级监督器引导大语言模型，但存在结构不匹配：弱监督器在绝大多数令牌上表现出普遍的高熵，而主流的密集干预方法要求在每个解码步骤都进行监督，导致频繁的低置信度干预，可能破坏基础模型的有效推理并产生大量效用成本。

Result: 在多个模型和基准测试上的广泛实验表明，TUSA一致地提高了安全对齐和通用帮助性。通过绕过约50%的对齐步骤，与密集基线相比，它不仅将安全偏好提高了高达15.6%，还将通用偏好率提高了高达12.0%。

Insight: 创新点在于将推理时对齐从连续监督重构为动态仲裁过程，引入一个不确定性感知的仲裁器，仅在监督器置信度高且令牌语义显著时才进行干预。这提供了一种选择性、高精度的对齐策略，证明其可以超越连续监督，有效过滤不确定性驱动的噪声和冗余监督，从而提升整体性能。

Abstract: A prominent paradigm in inference-time alignment employs lightweight supervisors to steer Large Language Models (LLMs). Through empirical analysis, we identify a structural mismatch in this paradigm: weak supervisors exhibit pervasive high entropy across the vast majority of tokens, yet prevailing dense intervention approaches mandate supervision at every decoding step. This leads to frequent low-confidence interventions that can disrupt valid base-model reasoning and incur substantial utility costs. To resolve this, we propose TUSA (Trust-based Uncertainty Sparse Alignment). Moving away from continuous oversight, TUSA reframes alignment as a dynamic arbitration process, introducing an uncertainty-aware arbiter that authorizes intervention only when two conditions are met: the supervisor is confident and the token is semantically salient. This mechanism effectively filters out uncertainty-driven noise and redundant supervision. Extensive experiments across multiple models and benchmarks show that TUSA consistently improves both safety alignment and general helpfulness. By bypassing approximately 50% of alignment steps, it not only enhances safety preference by up to 15.6%, but also boosts general preference rates by up to 12.0% compared to the dense baseline, demonstrating that selective, high-precision alignment can outperform continuous supervision.

[16] ExpArt-KG: Artwork Image Description Generation through Iterative Exploration of Knowledge Graphs cs.CL | cs.CVPDF

Yuta Kato, Shintaro Ozaki, Kazuki Hayashi, Yusuke Sakai, Hidetaka Kamigaito

TL;DR: 本文提出ExpArt-KG框架，通过检索增强生成（RAG）和迭代探索知识图谱的方法，旨在提升大型视觉语言模型（LVLMs）生成图像描述的准确性和细节丰富度。该方法在艺术品领域构建了一个图像与实体对应明确的知识图谱（ExpArt-KG），并通过交替进行答案生成和知识图谱检索，结合正确性判断来控制搜索过程，从而高效获取必要且充分的事实信息。

Details

Motivation: 大型视觉语言模型在图像描述生成和视觉问答方面表现强劲，但难以全面准确地描述图像中物体所关联的实体和概念之间的真实关系。

Result: 实验表明，该方法在艺术品解释任务中提高了描述的细节水平，并降低了外部知识的检索成本，同时保持了与固定迭代次数相当的生成质量。

Insight: 创新点在于提出了一种迭代检索与生成交替的框架，通过正确性判断动态控制知识图谱搜索，实现了高效且充分的事实信息获取；同时构建了艺术品领域内图像与实体无歧义对应的知识图谱，为特定领域的精准描述提供了结构化知识基础。

Abstract: Large Vision-Language Models (LVLMs) achieve strong performance on image-grounded text generation and visual question answering. However, it remains difficult for them to comprehensively and accurately describe the factual relations among the entities and concepts associated with the objects depicted in an image. In this work, we propose a framework that efficiently exploits factual information from a knowledge graph via retrieval-augmented generation (RAG), with the goal of enabling LVLMs to generate detailed and accurate image explanations. Specifically, our method alternates between answer generation and knowledge-graph retrieval, and controls the search using a correctness judgment, thereby acquiring the necessary and sufficient factual information efficiently. We also construct a knowledge graph for the artwork domain (ExpArt-KG), in which the correspondence between images and entities is unambiguous. Applying the proposed method to this knowledge graph, we show experimentally that it improves the level of detail of artwork explanations and reduces the retrieval cost of external knowledge while maintaining generation quality comparable to that of iterating a fixed number of times.

[17] Creative Generation via Multi-Agent Debate: Does Debate Suppress Diversity? cs.CLPDF

Tien Anh Nguyen, Khanh-Binh Nguyen, Van Dai Do, Svetha Venkatesh, Hung Le

TL;DR: 本文研究了多智能体辩论（MAD）在创意生成任务中的应用，发现其趋同设计会抑制输出多样性。为此，作者提出了Creative-MAD方法，通过认知透镜分配和基于嵌入的同伴选择两种干预措施来维持智能体间的分歧，从而在保持输出质量的同时显著提升多样性。

Details

Motivation: 创意生成任务（如叙事写作和科学构思）既要求高质量输出，也要求不同运行间产生独特响应以最大化探索。虽然MAD在事实和推理任务上表现出质量增益，但其趋同设计会主动抑制跨独立运行的输出多样性，与创意任务存在内在矛盾。

Result: 在四个创意基准测试上的实验表明，Creative-MAD在保持MAD输出质量的同时，显著提升了词汇和语义层面的多样性。

Insight: 核心创新点在于理论上论证了保持每个辩论会话中智能体间多样性是实现跨运行输出多样性的必要条件，并据此设计了两种协同干预措施（认知透镜分配和基于嵌入的同伴选择）来对抗身份漂移和多数派牵引，从而解耦MAD在创意任务中的质量与多样性权衡。

Abstract: Creative generation tasks, such as narrative writing and scientific ideation, demand both high-quality outputs and distinct responses across independent runs to maximize exploration. Multi-Agent Debate (MAD) has shown strong quality gains on factual and reasoning tasks, making it a natural candidate for creative generation. However, we find its convergence-driven design actively suppresses output diversity across independent runs, creating an inherent trade-off with creative tasks. We theoretically show that preserving diversity among agents within each debate session is a necessary condition for achieving diverse outputs across independent runs. Building on this finding, we propose Creative-MAD, which introduces two synergistic interventions to sustain agent divergence. Specifically, Cognitive Lens Assignment counters identity drift by anchoring each agent to a distinct and persistent cognitive mode, while Embedding-based Peer Selection counters majority pull by limiting each agent’s context to its most semantically distant peers. Experiments across four creative benchmarks demonstrate that Creative-MAD significantly enhances both lexical and semantic diversity while maintaining MAD’s output quality.

[18] A Certificate-Producing Cascade for Equational Implication: The SAIR EQT2 Stage 2 Solver cs.CLPDF

Haobo Ma, Wenlin Zhang, Manuel Israel Cázares

TL;DR: 本文介绍了SAIR EQT2 Stage 2求解器，它是一个用于解决等式理论蕴含问题的单文件求解器，采用最廉价优先的级联结构。求解器分为两个分支：假分支通过系数测试、有限模型搜索和显式反例生成来证明不蕴含；真分支则使用证明生成的有序单位叠加过程来证明蕴含，并生成Lean可接受的证书。该求解器在公开测试集上表现良好，所有结果均通过确定性Lean验证器验证。

Details

Motivation: 解决SAIR数学蒸馏挑战中关于等式理论蕴含的分类问题，即判断一个幺半群恒等式是否蕴含另一个，并要求为判断结果提供可被确定性Lean验证器接受的证书。

Result: 在本地运行中，求解器对六个公开测试集的1,889个问题均生成了被接受的证书，无需调用语言模型；在800个已发布的Stage 1评估分布问题上完全一致，并在规范马拉松清单和托管游乐场中分别接受了100和200行数据。所有定量结果均与不可变的结果账本绑定，但未声称完备性或比较优势。

Insight: 创新点包括采用最廉价优先的级联结构高效组织求解流程，假分支结合了结构化代数族系数测试、有界有限模型搜索和显式反例生成，真分支则整合了证明生成的有序单位叠加与多种优化技术（如Knuth-Bendix排序、双向解调等）。关键是将搜索过程置于可信基之外，通过生成小型Lean项重放证明或由竞赛验证器重新检查反例，确保了结果的可验证性。

Abstract: The SAIR Mathematics Distillation Challenge on Equational Theories asks a solver to classify whether one magma identity implies another and, for either verdict, to return a certificate accepted by a deterministic Lean judge. We present a single-file solver organized as a cheapest-first cascade. Its false branch combines coefficient tests over structured algebra families, bounded finite-model search, an explicit central-groupoid witness, and several infinite-carrier witnesses. Its true branch is a proof-producing ordered unit superposition procedure with Knuth-Bendix ordering, bidirectional demodulation, indexing, memoised substitution, and anytime size deepening. Search results remain outside the trusted base: successful derivations are replayed as small Lean terms, and countermodels are rechecked by the competition judge. The frozen solver is a 189,504-byte Python file with SHA-256 f2392533c9f4c03b…. In local runs through official judge revision 2848228, it produced accepted certificates for all 1,889 rows of the six public sets with no language-model calls. Separate measurements recorded full agreement on the 800 published Stage 1 evaluation-distribution problems, 100 accepted rows in the canonical Marathon manifest without tokens, and 200 accepted rows in the hosted playground. These are regression and playground measurements, not a leaderboard result and not evidence about a hidden set. All quantitative claims are tied to immutable result ledgers; the paper makes no completeness or comparative-superiority claim.

[19] Joint Training Is Not Enough: Conditioned Cross-Granularity Training for Multimodal Document Understanding cs.CLPDF

Chengguang Gan, Yunhao Liang, Hanjun Wei, Qinghao Zhang, Shiwen Ni

TL;DR: 该论文研究了在多模态文档理解中，细粒度（字段级）和粗粒度（文档级）任务之间的相互增强效应（MRE）。通过比较单任务训练、联合训练和条件训练三种范式，在三个数据集（两个收据数据集和一个商业表格数据集）上进行实验。研究发现，传统的混合联合训练并未带来增强，而条件训练（在训练时将一个粒度的黄金输出作为另一个粒度的提示）在两个数据集上实现了对两个粒度的同时增强。

Details

Motivation: 动机是探究在多模态文档理解中，一个模型同时处理细粒度的字段提取任务和粗粒度的文档级分类任务时，这两种不同粒度的任务是否能相互促进（即相互增强效应，MRE）。

Result: 在三个数据集（CORD、WildReceipt和一个商业表格数据集）上评估。传统的混合联合训练在主要规模上未在任何数据集上实现增强（在CORD上低于两个单任务模型，在其他两个数据集上以牺牲一个粒度为代价换取另一个粒度的提升）。而条件训练在CORD（字段级+0.5点，文档级+4.8点）和商业表格数据集（字段级+7.2点，文档级+11.0点）上实现了对两个粒度的增强，在WildReceipt上则存在权衡。在给定的配置下，没有其他方法能在任何一侧显著优于条件训练。

Insight: 论文的主要创新点是提出了“条件训练”范式，在训练期间将一个粒度的黄金输出作为另一个粒度的提示，这被证明比传统的联合训练更有效地实现任务间的相互增强。一个关键的客观发现是，这种增益部分源于提示的结构本身，而非具体内容，并且在某些情况下（如表格数据集）能有效避免模型崩溃（如将所有文档预测为多数类标签）。

Abstract: The Mutual Reinforcement Effect (MRE) asks whether a fine, span-level and a coarse, document-level task help each other when one model handles both. We test it in multimodal document understanding on three corpora, two of receipts and one of scanned business forms, comparing single-task, joint and conditioned training, which puts one granularity’s gold output in the other’s prompt during training only. We build Doc-MRE, an annotation layer pairing gold field extraction (point) with four document-level facets (line), from a three-judge LLM committee under a pre-registration, validated by blind re-annotation. One predicate, fixed in advance: at a shared recipe, a regime reinforces if it beats the matched single-task model on both granularities. Mixed joint training, the arrangement prior MRE work assumes, reinforces on no corpus at the main scale: it is below both single-task models on CORD and trades one granularity for the other on the two others, as single-task tuning does. Conditioned training reinforces on two of the three, CORD (+0.5 point, +4.8 line) and the forms corpus (+7.2 point, +11.0 line), resolvably on the coarse side and directionally on the fine one, and trades on WildReceipt; at that recipe no alternative measurably beats it on either side anywhere. Two byte-identical-prompt controls separate content from format: shuffled conditioning destroys the coarse-side skill but costs the fine side far less, and a neutral-content control reproduces the whole fine-side gain on WildReceipt, which is therefore prompt structure but buys nothing resolvable on the other two. On the forms corpus conditioning buys collapse avoidance: mixed training and the neutral control both assign the majority semantic label to all 50 test documents; only conditioning recovers the gold distribution. Probes find the information decodable under every regime with no resolvable increase under conditioning.

[20] SFAD: Speculative Factuality-Aware Decoding cs.CLPDF

Guanqiao Chen, Di Wang, Lijie Hu

TL;DR: 本文提出SFAD（推测性事实感知解码）框架，旨在提升大语言模型在知识密集型应用中的上下文忠实度，同时避免推理效率下降。该方法通过构建细粒度扰动偏好数据集ConFide训练草稿模型，在推理时结合认知摩擦检测和不对称对数引导机制，在提高事实一致性的同时实现了2.48倍的加速。

Details

Motivation: 解决大语言模型在上下文忠实度与生成效率之间的平衡难题，避免对比解码方法带来的双倍计算开销和后训练对齐所需的大量强化学习成本。

Result: 在广泛实验中，SFAD显著提升了忠实度，并在保持模型性能的同时实现了2.48倍的推理加速，为高效LLM提供了实用解决方案。

Insight: 创新点包括：1）通过细粒度原子扰动构建偏好数据集训练忠实草稿模型；2）引入认知摩擦机制基于专家确定性加权检测幻觉；3）采用不对称对数引导在必要时通过残差对数注入修正目标分布，兼顾效率与准确性。

Abstract: As one of the most critical challenges in large language models, contextual faithfulness directly determines their reliability in knowledge-intensive applications. This task is particularly challenging as it requires balancing factual consistency with generation efficiency. Contrastive decoding methods require dual forward passes (with and without context) to compare model outputs, doubling inference computational overhead, while post-training alignment demands extensive reinforcement learning with substantial computational overhead. To address this challenge, we present \textbf{SFAD}, a speculative decoding framework that enhances contextual faithfulness without inference degradation. We first construct \textbf{ConFide}, a preference dataset with fine-grained atomic perturbations, to train a context-faithful draft model via Direct Preference Optimization. During inference, Epistemic Friction detects potential hallucinations by quantifying distributional tension weighted by specialist certainty. When friction exceeds the threshold, Asymmetric Logit Steering refines the target distribution through residual-based logit injection; otherwise, standard speculation proceeds. Extensive experiments demonstrate that SFAD substantially improves faithfulness while achieving $2.48\times$ speedup, offering a practical solution for efficient LLMs.

[21] Instella-MoE Technical Report cs.CL | cs.AIPDF

Jiang Liu, Sudhanshu Ranjan, Prakamya Mishra, Yonatan Dukler, Gowtham Ramesh

TL;DR: 本文介绍了Instella-MoE，一个完全开源的混合专家（MoE）语言模型，总参数量160亿，每token激活参数量28亿。该模型在AMD Instinct MI300X/MI325X GPU上从头训练，结合了稀疏激活的MoE设计、门控多头潜在注意力（Gated MLA）和FarSkip-Collective连接等架构与系统级创新，并通过多阶段训练流程（包括预训练、中期训练、长上下文扩展、监督微调、直接偏好优化和强化学习）开发。

Details

Motivation: 旨在构建一个完全开源、高性能且高效的MoE语言模型，以支持透明和可重复的研究，并为高效、高性能的MoE模型提供一个强大的开源基础。

Result: 在标准预训练基准测试中平均得分为76.7，优于包括OLMo-3-7B、SmolLM3-3B和OLMoE-1B-7B在内的先前完全开源模型，并与可比激活参数量级的开源权重MoE和稠密基线模型（如Moonlight-16B-A3B和Qwen3.5-4B）保持竞争力。经过后训练的最终Think检查点在指令遵循、推理、数学、编码和聊天基准测试中平均得分为73.2，优于评估中激活参数量相当或更大的完全开源和开源权重模型。

Insight: 主要创新点包括：1）结合稀疏激活MoE与Gated MLA、FarSkip-Collective连接等架构与系统级创新以实现高效的大规模训练和推理；2）采用包含多个阶段（如中期训练、长上下文扩展、基于反馈的数据管理、多教师策略蒸馏强化学习）的全面训练流程；3）完全开源模型流程（包括权重、配置、数据混合和代码），致力于透明和可重复的研究。

Abstract: In this work, we introduce Instella-MoE, a fully open Mixture-of-Experts (MoE) language model with 16 billion total parameters and 2.8 billion active parameters per token, trained entirely from scratch on AMD Instinct MI300X and MI325X GPUs. Instella-MoE combines a sparsely activated MoE design with architectural and system-level innovations, including Gated Multi-head Latent Attention (Gated MLA) and FarSkip-Collective connectivity, enabling efficient large-scale training and inference. The model is developed through a multi-stage pipeline comprising pre-training, mid-training, long-context extension, supervised fine-tuning with feedback-driven data curation, direct preference optimization, and reinforcement learning with Multi-Teacher On-Policy Distillation. Instella-MoE achieves an average score of 76.7 across standard pre-training benchmarks, outperforming prior fully open models including OLMo-3-7B, SmolLM3-3B, and OLMoE-1B-7B, while remaining competitive with open-weight MoE and dense baselines at comparable active-parameter scales, including Moonlight-16B-A3B and Qwen3.5-4B. After post-training, our final Think checkpoint achieves an average score of 73.2 across instruction-following, reasoning, math, coding, and chat benchmarks, outperforming both fully open and open-weight models with comparable or larger active parameter counts in our evaluation. To support transparent and reproducible research, we release the complete Instella-MoE model flow, including model weights, training configurations, data mixtures, and training code. Together, these contributions establish Instella-MoE a strong, fully open foundation for efficient, high-performing MoE models and reproducible research.

[22] TEIDAN: A Multilingual Multiparty Dialogue Corpus cs.CL | cs.HCPDF

Taiga Mori, Koji Inoue, Mikey Elmers, Divesh Lala, Tatsuya Kawahara

TL;DR: TEIDAN是一个多语言多模态对话语料库，目前包含日语和英语的三方自发对话。它通过多个麦克风和摄像头记录开放式话题的讨论，并提供基于IPU的转录文本。该语料库旨在支持跨语言比较，并计划扩展到更多语言，可用于研究话轮转换、受话者识别和多模态基础等任务。

Details

Motivation: 现有语料库多集中于会议、任务导向、文本交互或表演场景，缺乏支持跨语言比较的自发面对面三方讨论资源。本文旨在填补这一空白，为多人人机交互系统研究提供基础数据。

Result: 论文主要介绍了语料库的构建细节，包括采集设计、参与者、录音设置、转录格式和统计数据，并提供了初步分析示例。目前尚未提及在特定基准测试上的定量性能结果，而是作为资源本身进行描述。

Insight: 创新点在于构建了一个专注于自发、面对面、三方、开放式讨论的多语言多模态语料库，支持跨语言比较研究。其多设备同步采集设置（领夹麦克风、麦克风阵列、面向参与者的摄像头）和IPU级精细转录为深入研究对话动态提供了丰富数据。

Abstract: Multi-party interaction is a central setting for human communication and a necessary target for human-agent interaction systems that must participate in group conversation. Yet available corpora often focus on meetings, task-oriented interaction, text-based interaction, or acted scenarios, and fewer resources support cross-linguistic comparison of spontaneous face-to-face triadic discussion. This paper presents TEIDAN, a multilingual multimodal corpus that currently consists of Japanese and English three-party conversations. TEIDAN records groups of three participants discussing open-ended topics with individual pin microphones, a microphone array, and participant-facing cameras, and provides IPU-based transcripts for both language portions. Earlier studies used subsets of the Japanese portion for task-specific benchmarks in multi-party dialogue modeling; in contrast, this paper presents TEIDAN as a corpus resource spanning both Japanese and English, with planned expansion to additional languages. We describe the collection design, participants, recording setup, transcription format, and corpus statistics, and provide preliminary analyses to illustrate how TEIDAN can support research on turn-taking, addressee recognition, and multimodal grounding in human-human and human-agent interaction.

[23] Dense Process Supervision for Search Agents via Fact Utility Estimation cs.CL | cs.LGPDF

Rongzhi Zhu, Xiangyu Liu, Yi Liu, Shuo Zhang, Ruirui Zhang

TL;DR: 本文提出了一种基于事实效用估计的密集过程监督方法，用于提升搜索智能体的强化学习效果。该方法将推理过程建模为离散证据事实的积累，通过提取结构化事实、聚类语义等价事实并利用贝叶斯估计推断事实簇的后验效用，最终将估计的事实效用转化为密集的步骤级奖励来指导强化学习训练。

Details

Motivation: 传统基于结果奖励的强化学习方法在搜索智能体中难以实现有效的信用分配，因为中间步骤的价值不明确，其贡献难以从最终结果中分离。

Result: 在七个单跳和多跳问答基准测试上的实验表明，该方法始终优于现有基线方法。消融研究验证了与仅使用结果奖励的训练相比，在多跳问答任务上取得了明确的相对改进。

Insight: 创新点在于将推理过程显式地建模为事实的积累和效用估计，并通过贝叶斯估计和聚类技术实现密集的步骤级监督，从而改进了强化学习中的信用分配问题。

Abstract: Reinforcement learning (RL) for search agents typically relies on outcome rewards. However, it often fails to achieve effective credit assignment, due to the unclear value of intermediate steps. It is hard to separate their contributions from the final result. In this paper, we propose a dense process supervision method based on fact utility estimation, which models the reasoning process as the accumulation of discrete evidence facts. We first extract structured facts from raw observations and organize them into an explicit fact store. To support credit assignment, we then cluster semantically equivalent facts and infer the posterior utility of each fact cluster using Bayesian estimation over group rollouts. Finally, we convert the estimated fact utilities into dense step-level rewards to guide RL training. Experiments on seven single-hop and multi-hop QA benchmarks show that our method consistently outperforms existing baselines. Ablation studies validate clear relative improvements on multi-hop QA compared to outcome reward-only training.

[24] PersianAnonymizer: Evaluating LLM-Labeled Training for Efficient NER-based Anonymization in Persian cs.CLPDF

Mohammad Hossein Shalchian, Mostafa Amiri, Amir Mahdi Sadeghzadeh

TL;DR: 本文提出PersianAnonymizer方法，通过利用指令调优大语言模型（LLM）生成标注数据，训练紧凑的NER模型，以实现波斯语客户聊天记录的高效匿名化。研究比较了DeepSeek、GPT-OSS和Qwen三种LLM在零样本和少样本设置下的标注效果，并基于MatinaRoberta训练了token分类器进行评估。

Details

Motivation: 解决波斯语工业数据（如客户聊天记录）的实用匿名化需求，旨在找到一种高质量、低成本的自动化解决方案，以替代昂贵或低效的人工或纯LLM标注流程。

Result: 在测试集上，基于OSS_ZeroShot标注数据训练的NER模型取得了最高的宏平均F1分数和标签覆盖召回率（LCR）。该模型在单块RTX 3090消费级GPU上，仅需约2分钟即可完成4万条消息测试集的标注，速度远超原始LLM在H200节点上的标注延迟。

Insight: 创新点在于系统性地评估了不同LLM作为标注源对下游紧凑NER模型性能的影响，并提出了标签覆盖召回率（LCR）这一评估指标。其核心实践路径是：利用性能最佳的LLM（本研究中为GPT-OSS）进行零样本批量标注以构建高质量训练集，进而训练出高效、低部署成本的专用NER模型，为资源受限语言的工业应用提供了可借鉴的范式。

Abstract: We target practical anonymization of Persian customer chats by training a compact NER model from LLM-labeled supervision and selecting the best labeler for deployment. We compare three instruction-tuned LLMs: DeepSeek-V3-0324, GPT-OSS-120B, and Qwen3-235B-A22B-Instruct-2507, to produce span annotations under a shared JSON protocol, yielding four corpora (OSS_ZeroShot, Qwen_ZeroShot, Qwen_FewShot, DeepSeek_FewShot). A MatinaRoberta-based token-classifier is trained per corpus and evaluated with token-level Precision/Recall/F1 (overall and per-class). We also report Label Coverage Recall (LCR), the proportion of gold non-O tokens predicted as non-O, and quantify cross-labeler behavior via a token-level Venn on test annotations. Finally, we contrast test-set annotation latency of the LLMs on H200 nodes with the trained NER’s test-time labeling on a single RTX 3090. Results show that supervision from OSS_ZeroShot yields the strongest macro-F1 and LCR, while the resulting NER labels an entire 40K-message test set in approximately 2 minutes on one consumer GPU. This establishes a practical path to high-quality, low-cost anonymization for Persian industrial data.

[25] OUTLETS: Output-Length Prediction from Speculative Decoding Backbones cs.CLPDF

Weihuang Wen, Yingying Liu, Yichuan Liu, Wenqi Zeng, Li Zhou

TL;DR: 本文提出OUTLETS方法，利用推测解码（SD）框架（如EAGLE-3）中草稿解码器产生的潜在表示来预测大语言模型（LLM）服务的输出长度，以解决输出长度长尾分布带来的资源调配和集群调度挑战。该方法仅需在推测解码骨架上添加一个轻量级回归头，即可实现高效且准确的预测。

Details

Motivation: LLM服务中输出长度的长尾分布给资源供给和集群调度带来了重大挑战。现有预测方法存在缺陷：外部代理模型会引入显著延迟且保真度有限，而基于内部状态的方法虽高效，但仅依赖于对当前模型状态的浅层探测。

Result: OUTLETS在输出长度预测上实现了比评估方法更低的平均绝对误差（MAE）。在饱和解耦服务场景下，利用其预测结果进行标准调度策略（如优先处理短请求、更均匀地分配请求），可将短请求的P99延迟降低34.8%。

Insight: 核心创新点在于发现了推测解码与长度预测之间的结构关联，将推测解码骨架重新用作轨迹感知的长度预测器。这提供了一种高效利用现有计算框架（推测解码）进行辅助任务（长度预测）的新思路，避免了引入额外复杂模型的开销。

Abstract: The heavy-tailed distribution of output lengths in Large Language Model (LLM) serving poses major challenges for resource provisioning and cluster scheduling. Although output-length prediction can mitigate these issues, existing approaches have key drawbacks: external proxy models add substantial latency and often have limited fidelity, whereas internal state-based methods are efficient but rely on shallow probes of current model states. We identify a structural connection between speculative decoding (SD) and length prediction: latent representations produced by the draft decoder in advanced frameworks (e.g., EAGLE-3) encode signals that are predictive of generation length. Building on this insight, we introduce OUTLETS (Output-Length Prediction from Speculative Decoding Backbones), which repurposes the speculative backbone as a trajectory-aware length predictor. When its draft representations are already computed for speculative decoding, OUTLETS adds only a lightweight regression head and achieves lower MAE than the evaluated methods. Under saturated disaggregated serving, OUTLETS predictions enable standard scheduling policies to prioritize shorter requests and distribute requests more evenly across decoding instances, reducing short-request P99 latency by 34.8%.

[26] Beyond Magnitude: Contrastive Routing for Modular Mixture-of-Experts cs.CLPDF

Nikolaos Xiros, Dimitrios Damianos, Maria-Eleni Zoumpoulidi, Leon Voukoutis, Vassilis Katsouros

TL;DR: 本文提出了一种新的对比路由机制（CoRM），用于改进混合专家模型中的路由策略。该方法通过将每个输入token与层隐藏状态的指数移动平均值进行对比，而非依赖绝对幅度，从而将路由信号集中到低维、高度可分的子空间。实验表明，CoRM在九个零样本推理基准测试中显著提升了性能，同时仅增加了少量参数和计算开销。

Details

Motivation: 当前混合专家模型中的路由机制主要基于所有token共享的结构表示，这限制了专家的专业化能力。为了解决这一问题，作者旨在设计一种更有效的路由方法，以更好地捕捉语言结构。

Result: 在九个零样本推理基准测试中，CoRM相比标准Top-k MoE基线，在Top-1准确率上提升了0.67到1.69个百分点，在Top-2准确率上提升了1.38到1.77个百分点，同时仅增加了2.9%的参数和每token 2.6%的FLOPs。

Insight: 创新点在于引入对比路由机制，通过对比token与共享参考状态（EMA隐藏状态）的亲和度差异来评分专家，使得路由边界更符合语言结构。这提供了一种从相对差异而非绝对幅度进行路由的新思路，有助于提升专家模型的判别能力。

Abstract: In current Mixture-of-Experts architectures, routing is performed based on representations dominated by structure shared across all tokens, limiting expert specialization. We show that contrasting each token against an Exponential Moving Average of the layer’s hidden states, rather than routing on absolute magnitude, concentrates the routing signal onto a low-dimensional, highly separable subspace. Building on this, we propose the Contrastive Routing Mechanism (CoRM), which scores each expert by the gap between its affinity for the incoming token and its affinity for this shared reference state, interpreted through a distinct per-expert projection. The resulting experts have routing boundaries that align with linguistic structure significantly more than the Top-k baseline. Our experiments show that CoRM improves average zero-shot accuracy by +0.67 to +1.69 points (Top-1) and +1.38 to +1.77 points (Top-2) over standard Top-k MoE baselines on nine zero-shot reasoning benchmarks, at the minimal cost of 2.9% added parameters and 2.6% added FLOPs per token.

[27] ClinTraceBench: Source-Verifiable Longitudinal Clinical Reasoning over EHR-Derived Dialogues cs.CLPDF

Huimin Wang, Zhengyi Zhao, Yutian Zhao

TL;DR: 本文介绍了ClinTraceBench，这是一个包含385个源自MIMIC-IV、具有事件ID溯源的可验证临床对话数据集，并提出了一个包含九项任务（T1-T9）的分类法和L0-L5的验证框架。研究评估了八种历史表示策略在四个大语言模型骨干上的表现，发现压缩策略会显著损失纵向关系信号，且完整上下文与无上下文之间的性能差距巨大，同时模型性能与上下文长度呈非单调关系，并挑战了‘最大骨干模型最优’的启发式规则。

Details

Motivation: 临床LLM助手需要在多访视的患者轨迹上进行推理，但目前用于扩展其规模的紧凑历史表示方法（如检索、结构化时间线、LLM摘要、智能体记忆）是否保留了临床推理所需的纵向信号尚未得到衡量。

Result: 在6,271个问题、200,672个预测上评估了八种策略和四个骨干模型。关键发现包括：压缩策略在关系恢复上表现极差（仅0-5.3%）；在多访视趋势和跨患者比较上存在聚合损失；完整上下文与无上下文的性能差距从+29.8个百分点（GPT-4o-mini）到+62.7个百分点（Haiku）不等；弃权率与上下文长度呈非单调关系。在帕累托前沿上，Haiku在完整上下文下成本效益优于Sonnet（25.76美元 vs. 106.21美元）。

Insight: 创新点在于构建了一个具有事件溯源和严格验证的临床对话基准，用于系统评估历史表示策略对纵向临床推理信号的影响。客观分析表明，该研究揭示了现有压缩和记忆策略在捕捉复杂临床关系方面存在根本性局限，并挑战了模型规模越大性能越好的常见假设，强调了在临床应用中保留完整上下文或开发更优表示方法的重要性。

Abstract: Clinical LLM assistants must reason over multi-visit patient trajectories, yet whether the compact history representations used to scale them—retrieval, structured timelines, LLM summaries, agentic memory—preserve the longitudinal signal clinical reasoning needs has not been measured. We introduce ClinTraceBench: 385 MIMIC-IV-derived verified dialogues with event-ID provenance, a nine-task taxonomy (T1–T9), and L0–L4 deterministic + L5 human-audit validation (98.92% agreement). We evaluate eight history representation strategies—a no-context floor, \textit{last-visit-only}, \textit{full-context}, BGE-M3 \textit{dense-retrieval}, two compression schemes, and two agentic-memory systems (\textit{Mem0}, \textit{A-Mem})—across four backbones (DeepSeek-V3, GPT-4o-mini, Haiku~~4.5, Sonnet~~4.6) on 6{,}271 questions: 32 cells, 200{,}672 predictions. Four findings: (SP4) a controlled T3 injection probe isolates compression-induced \textit{relation} loss—with the attribution sentence present \textit{before} construction, \textit{Mem0}, \textit{A-Mem} and \textit{llm-summary} still recover only 0–5.3% of the injected positives; (SP1) compressed strategies pay an aggregation tax on multi-visit trends and cross-patient comparisons; (SP2) the blind-to-full gap spans $+29.8$~~pp (GPT-4o-mini) to $+62.7$~~pp (Haiku); (SP3) abstention scales non-monotonically with context length. On the Pareto frontier Haiku dominates Sonnet under \textit{full-context} ($25.76 vs.\ $106.21), inverting the ``biggest backbone wins’’ heuristic.

[28] CaRL-EM: Cost-Aware Reinforcement Learning for Entity Matching with LLMs cs.CLPDF

Chaohui Guo, Michel Klein, Zhisheng Huang

TL;DR: 本文提出CaRL-EM，一种基于强化学习的成本感知控制器，用于管理大型语言模型在实体匹配任务中的操作。它将实体匹配建模为一个成本感知的顺序决策问题，通过自适应地选择不同的操作符和模型容量，以在质量和成本之间实现最优权衡。

Details

Motivation: 现有基于LLM的实体匹配方法缺乏在多候选场景下的灵活性，且通常忽略大规模推理成本，因此需要一种能动态规划操作、平衡质量与成本的自动化方法。

Result: 在7个基准测试上的实验表明，CaRL-EM能根据任务复杂度动态规划廉价与昂贵操作符的使用，实现跨数据集和领域的零样本鲁棒迁移，并在可比或更高质量下获得比强基线更优的质量-成本权衡，降低了推理成本。

Insight: 创新点在于将实体匹配形式化为成本感知的顺序决策问题，并设计了一个与抽象操作符交互的强化学习策略，该控制器可在推理时无需重新训练即可重用不同的底层LLM后端，实现了灵活且成本高效的自动化匹配。

Abstract: Entity matching (EM) requires fine-grained contextual understanding and domain knowledge. Recent work shows that large language models (LLMs) can serve as strong matchers across domains, but most methods either make independent pairwise decisions or rely on manually designed composite pipelines, thus lacking flexibility in realistic multi-candidate settings. At the same time, they typically ignore inference cost at scale. We formulate LLM-based EM with candidates as a cost-aware sequential decision problem and propose CaRL-EM, a reinforcement learning controller that manages LLM operations. Given the state of an anchor record, its candidate set, and the cost, CaRL-EM adaptively chooses among different operators (Match/Compare/Select/Decide) and model capacities to maximize a quality-cost objective. The policy interacts with abstract operators, allowing the same controller to be reused with different underlying LLM backends at inference time without retraining. Experiments on 7 benchmarks show that CaRL-EM (i) learns to dynamically plan the usage of inexpensive and expensive operators based on task complexity, (ii) achieves robust zero-shot transfer across diverse datasets and domains, and (iii) consistently achieves a better quality-cost trade-off than strong LLM-based baselines and manually designed pipelines, yielding a lower inference cost at comparable or higher quality.

[29] PersuaRL: Reinforcement Learning-Driven Multi-Expert Selection for Persuasive Dialogue Generation in Insurance cs.CLPDF

Rohan Kirti, Akash Ghosh, Aryan Vats, Niladri Ghosh, Shipra Shriparn

TL;DR: 该论文提出了一种名为PersuaRL的强化学习框架，旨在提升大型语言模型（LLMs）在保险领域对话中的说服力。该框架通过自适应地探索、选择和协调多个专家模块的策略来生成更具说服力的回应。研究还引入了InsureDial数据集，用于捕捉汽车保险交互中说服性沟通的细微差别，并在包括该数据集在内的基准测试上验证了方法的有效性。

Details

Motivation: 当前基于LLM的对话代理在事实性沟通方面表现出色，但在需要信任和清晰度的领域（如保险）中，往往缺乏进行真正有说服力、上下文敏感对话的能力。

Result: 在包括InsureDial在内的两个说服性对话基准数据集上进行的广泛评估表明，PersuaRL在生成上下文恰当且高度有说服力的回应方面，表现优于基线方法。

Insight: 论文的核心创新点在于提出了一个基于强化学习的多专家选择与协调框架（PersuaRL），使LLM能够根据动态演进的对话上下文自适应地整合不同说服策略，从而提升说服效果。同时，构建了领域特定的说服性对话数据集（InsureDial）以支持相关研究。

Abstract: Large Language Models (LLMs) are revolutionizing digital communication by powering conversational agents deployed across domains such as customer service, digital sales, and insurance. These agents, built on LLMs, can understand user input, retrieve relevant information, and generate coherent responses. However, while they excel at factual communication, they often lack the ability to engage in truly persuasive, context-sensitive dialogue, especially in domains like insurance, where trust and clarity are critical. Building on this need within the insurance domain, our work focuses on improving the persuasiveness of digital agents, aka LLMs. To support this, we introduce InsureDial, a Persuasive Insurance Dialogue dataset, designed to capture the nuances of persuasive communication specific to motor insurance interactions. We introduce PersuaRL, a reinforcement learning-based framework that equips LLM-driven dialogue agents with the ability to adaptively explore, select, and coordinate strategies across multiple expert modules, guided by the evolving dialogue context, to achieve more effective persuasion. We conduct extensive automatic human and qualitative evaluations on two benchmark persuasion dialogue datasets, including our InsureDial. Our evaluations consistently demonstrate that PersuaRL outperforms baseline, generating contextually appropriate and highly persuasive responses.

[30] From Base Rollouts to RL Reasoning: A Budgeted Search Perspective cs.CLPDF

Wenhe Sun, Cunxiang Wang, Zijun Yao, Yixin Cao

TL;DR: 本文研究了强化学习（RL）在语言模型推理任务中提升性能的机制。通过一个统一的解码框架（UDF），作者将各种解码策略（如采样、束搜索）形式化为在一个共享的预算操作空间中的可执行策略。研究发现，RL模型获得的性能增益在很大程度上可以通过一个预算操作点转换规则（BOPTR）来近似，该规则表明RL的收益主要源于改变了采样效率，使模型更倾向于搜索基础模型本已能够达到但很少采样的轨迹。

Details

Motivation: 论文旨在探究强化学习可验证奖励（RLVR）提升语言模型推理能力的本质原因：这种提升是源于RL创造了基础模型缺乏的推理能力，还是仅仅改变了轨迹的采样分布，使其更倾向于基础模型本已能够达到但很少访问的解空间。

Result: 在Math500、AIME、GPQA和IFEval等多个基准测试上，实验表明基础模型的性能曲线可以通过一个预算操作点转换规则（BOPTR）来近似恢复RL模型的性能。在Qwen2.5-7B模型上，BOPTR在非先知规则中取得了最低的转移误差（3.41个百分点）。该规则在十个不同模型、四个未拟合的基准测试上均表现出良好的泛化能力。

Insight: 论文的核心创新点在于提出了一个统一解码框架（UDF）来形式化比较不同解码策略，并发现了一个描述性的预算操作点转换规则（BOPTR）。这提供了一个行为诊断工具，支持了一种“内化搜索”的解释：在所测试的配方下，RL带来的大部分可测量增益对应于采样效率的改变，而非创造了全新的推理能力。这为理解RL对推理的贡献提供了新的视角。

Abstract: Reinforcement learning with verifiable rewards (RLVR) improves language-model reasoning, but how these gains relate to inference-time decoding and search remains unclear. Does RL create reasoning the base model lacks, or shift the rollout distribution toward trajectories it can already reach but rarely samples? We study this behaviorally with a Unified Decoding Framework (UDF), which expresses token-level sampling, beam-like search, tree search, and sequence-level resampling as executable policies over a shared budgeted operating space, scored post hoc with pass@$k$, self-consistency, best-of-$N$, and first-finish success. Using paired Base/RL checkpoints from SimpleRL-Zoo, we ask whether an RL default-policy curve can be approximated by a structured path of Base operating points. On Math500, AIME, GPQA, and IFEval, the pass@$k$ recovery path follows a Budgeted Operating-Point Transition Rule (BOPTR), $N_{\mathrm{Base}} \approx αN_{\mathrm{RL}}^β$, with benchmark-conditioned exponents. On Qwen2.5-7B, BOPTR gives the lowest transfer error among the non-oracle rules we test, 3.41 pp (95% CI [2.32, 5.53]); a three-seed replication gives 3.07 $\pm$ 0.39 pp. The rule extends to ten models across four families (3.28 to 4.87 pp on checkpoints added after fitting), to four benchmarks it was never fitted on (5.03 pp vs. 4.44 pp in fit), and holds without an RL checkpoint for the target model (4.19 pp) or without RL supervision of any kind (5.08 pp). These results support a qualified internalized-search reading: under the recipe we test, much of the measured RL gain corresponds to a change in sampling efficiency toward operating points the base model can already reach under search. We treat the scaling patterns as descriptive of this recipe and cohort, report where they break down, and use UDF and BOPTR as behavioral diagnostics rather than evidence of parameter-level equivalence.

[31] VerTox: Verifiable Reward-Guided Corpus Poisoning Against Neural Ranking Models cs.CL | cs.IRPDF

Zhiqi Huang, Vivek Datla, Zhichao Xu, Puxuan Yu, Vivek Srikumar

TL;DR: 本文提出了VerTox框架，首次将针对神经排序模型的语料库投毒攻击形式化为一个可验证的、奖励引导的强化学习问题。该方法通过微调紧凑型大语言模型来生成对抗性文档，旨在扭曲排序行为并破坏事实性，从而攻击检索增强生成等下游应用。

Details

Motivation: 动机在于探究神经排序模型在面临大语言模型能够大规模生成流畅且具有欺骗性内容时的鲁棒性不足问题，特别是针对语料库投毒攻击的脆弱性。

Result: 实验表明，该方法在主要神经排序架构以及一个专有商业嵌入模型上，都实现了接近完美的攻击成功率，生成的对抗性文档经常排在目标文档之前，并且显著降低了下游RAG应用的性能。

Insight: 创新点在于将语料库投毒形式化为一个可验证的奖励引导强化学习问题，通过专门的奖励塑形将排序扭曲与事实破坏显式耦合，从而生成流畅、低困惑度且难以检测的对抗性文档。

Abstract: Neural ranking models have become core components of modern information retrieval systems and important building blocks of AI systems such as retrieval-augmented generation (RAG) pipelines. However, their robustness remains insufficiently understood in the presence of large language models (LLMs), which can generate fluent and deceptive content at scale. This work investigates the vulnerability of neural ranking models to corpus poisoning attacks, in which an adversary injects a small number of maliciously crafted documents into the corpus to distort ranking behavior. We propose VerTox, the first framework to formulate corpus poisoning as a verifiable reward-guided reinforcement learning (RLVR) problem. By explicitly coupling ranking distortion with factual corruption through specialized reward shaping, we fine-tune compact LLMs into adversarial generators. Experiments demonstrate that our method achieves near-perfect attack success rates, producing adversarial documents that frequently rank higher than target documents across major neural ranking architectures, as well as a proprietary commercial embedding model. The generated adversarial documents are fluent and exhibit low perplexity, making them difficult to detect. Furthermore, by explicitly encouraging factual corruption, our adversarial documents significantly degrade the performance of a downstream RAG application.

[32] Explore Before Committing: Hypothesis-Guided Search for Deep Research Agents cs.CLPDF

Ruochen Zhou, Zhengyu Chen, Luan Zhang, Siyang Gao, Yee Whye Teh

TL;DR: 本文提出HypoSearch方法，通过生成轻量级假设作为软搜索提示，在有限独立分支中进行探索，并在决策前比较分支级证据，以解决深度研究代理在单一轨迹搜索中因早期方向选择错误而导致的失败问题。该方法在四个深度研究基准测试和三个骨干模型上均优于单轨迹搜索和标准并行基线，同时减少了工具调用次数。

Details

Motivation: 深度研究代理在回答复杂问题时通常沿单一轨迹进行搜索，一旦早期选择错误方向，后续工具调用会强化该路径，增加失败风险。本文旨在通过分析成功轨迹的行为模式，设计一种能减少此类风险的搜索策略。

Result: 在四个深度研究基准测试（如BC-small）和三个骨干模型（如Qwen3.5-122B）上，HypoSearch consistently outperforms single-trajectory search and standard parallel baselines，将Qwen3.5-122B在BC-small上的得分从46.7提升至60.0，且工具调用次数少于五个独立轨迹。初步监督微调研究表明，该方法的行为信号可用于构建紧凑的训练轨迹并减少未过滤数据导致的性能下降。

Insight: 创新点在于将假设生成与有界分支探索相结合，通过比较分支证据再决策，避免了早期方向锁定。从客观角度看，该方法借鉴了人类研究中的“探索-验证”思维，将软提示和并行搜索机制有效整合，提升了代理的鲁棒性和效率。

Abstract: Deep-research agents answer complex questions by interacting with search and browsing tools, yet they often search along a single evolving trajectory. Our trajectory-level analysis reveals a common failure mode in which the agent may encounter an early search state with several plausible directions, but follow one direction before collecting enough comparative evidence. Once this happens, subsequent tool calls tend to reinforce the same path, increasing the chance of failure when the initial direction is misleading. We further find that successful trajectories reduce this risk through two behaviors: grounding vague exploration in concrete candidates and shifting directions when the current path is weak or incomplete. Based on these findings, we propose HypoSearch, which generates lightweight hypotheses as soft search hints, explores them through bounded independent branches, and compares branch-level evidence before commitment. Across four deep-research benchmarks and three backbone models, HypoSearch consistently outperforms single-trajectory search and standard parallel baselines, improving Qwen3.5-122B from 46.7 to 60.0 on BC-small while using fewer tool calls than five independent trajectories. A pilot supervised fine-tuning study further shows that these behavioral signals can curate compact training trajectories and reduce degradation from unfiltered data.

[33] Where the Verifier Fails: A Category-Level Audit of Reward Signals in RLVR cs.CL | cs.LGPDF

Esther Xin

TL;DR: 本文对强化学习可验证奖励（RLVR）和标准基准评估中使用的自动验证器进行了类别级审计，通过生成保留数学意义的等价答案变体，测量了四个广泛使用的验证器在307,420个判断上的拒绝率。研究发现验证器的自我验证率差异巨大，错误主要集中在空白和标点符号，且不同验证器因相反原因失败。

Details

Motivation: 解决现有RLVR和基准评估中自动验证器将自由文本答案转换为二元奖励时存在的可靠性问题，特别是针对先前工作仅报告聚合错误率（如94%接受率）而未分解错误来源的不足，旨在揭示哪些答案形式消耗了错误预算。

Result: 在四个广泛使用的验证器上，自我验证率范围从53.8%到95.2%，差异达41.3个百分点；错误主要集中在空白和标点符号（占默认LaTeX配置中合同失败的93.0%）；参考数值级联验证器因相对容差尺度不变，对‘差一’错误答案的接受率从低于10^4时的0%跃升至达到或超过时的100%。

Insight: 创新点在于应用蜕变测试生成经认证的等价答案变体，无需人工裁决即可证明假阴性错误；客观分析揭示了验证器错误的高度集中性（非均匀分布）和实现细节（如标点处理）对评估结果的重大影响，强调了基准验证器可靠性审计的重要性。

Abstract: Reinforcement learning with verifiable rewards (RLVR) and standard benchmark evaluation both rely on an automatic verifier that turns a free text answer into a binary reward. Prior work reports that one evaluation harness accepts only about 94% of its own ground truth answers, blaming LaTeX parsing. That is an aggregate: it does not say which answer forms consume the error budget. We supply the decomposition. We apply metamorphic testing to the verifier rather than the model, generating certified equivalent answer variants, that is, rewrites that preserve mathematical meaning by construction, so that any rejection is a provable false negative needing no human adjudication. We then measure rejection per answer category across four widely used verifiers over 307,420 verdicts. We find three things. (1) Self validation ranges from 53.8% to 95.2% on identical inputs, a spread of 41.3 points. The published figure describes one implementation, not the task; two configurations of the same library disagree on 49.9% of pairs. (2) The residual is not spread across parsing categories but concentrated in whitespace and punctuation, which account for 93.0% of in contract failures for the default LaTeX configuration. A trailing period or newline dominates the budget. (3) Separating rejection from execution failure shows that verifiers with similar aggregate error fail for opposite reasons, and that a reference numeric cascade accepts off by one wrong answers as a step function of magnitude, from 0% below 10^4 to 100% at or above, because its relative tolerance is scale invariant.

[34] Separating Syntax from Language: A Mechanistic Account of Translation in Multilingual LLMs cs.CLPDF

Mikhail Sonkin, Tanja Baeumel, Daniil Gurgurov, Josef van Genabith, Simon Ostermann

TL;DR: 本文通过构建控制性多语言数据集，结合因果干预和探针技术，揭示了多语言大语言模型（mLLMs）在翻译过程中将输出语言生成进一步解耦为句法和表层语言两个独立阶段。研究发现模型在翻译时先构建目标语言的词序（句法结构），再实现表层语言形式，并识别出对句法转换敏感而对语言身份不变的特定注意力头。

Details

Motivation: 旨在深入理解多语言大语言模型（mLLMs）在机器翻译中如何将一种语言的表征转换为另一种语言的内在机制，特别是验证翻译过程是否比先前假设的更具模块性，即输出语言生成能否进一步分离为句法和表层语言过程。

Result: 研究通过因果干预和探针分析发现，模型在翻译时确实先构建目标语言词序（句法），再生成表层形式；识别出对句法转换敏感且与语言身份无关的特定注意力头，这为翻译的模块化分解提供了实证支持。

Insight: 创新点在于将翻译中的输出语言生产明确解耦为独立的句法承诺和表层语言实现两个阶段，并通过可解释性方法（如注意力头分析）揭示了mLLMs内部功能不同组件如何协作实现翻译，这深化了对模型模块化结构的理解，并为改进翻译模型的可控性和解释性提供了新视角。

Abstract: Multilingual large language models (mLLMs) achieve strong performance in machine translation, yet our understanding of the mechanisms by which they transform representations from one language to another remains incomplete. Prior work suggests that translation decomposes into separable processes within an mLLM, where conceptual content is first represented independently, followed by a production into language-specific form. In this work, we show that translation is even more modular than previously assumed and that the output language production in translation processes is actually further separable into a syntax and a surface language process. We construct controlled multilingual datasets that isolate cross-linguistic differences in word-order and use causal interventions and probing to track how representations are transformed during translation. We find that models first construct target-side word-order before realizing the target language surface form. We identify individual attention heads that are selectively sensitive to syntactic transformations while remaining largely invariant to language identity. These results establish the commitment to a syntactic structure as an independent stage in translation, extending prior decompositions and showing how translation is implemented by functionally different components within mLLMs.

[35] InSight: A Benchmark for Agentic Claim Verification in Interactive Visualizations cs.CL | cs.CV | cs.HCPDF

Maeve Hutchinson, Syed Mahbubul Huq, Mohammad Albinhassan, Radu Jianu, Aidan Slingsby

TL;DR: 本文提出了InSight基准测试，用于评估智能体在交互式可视化环境中进行声明验证的能力。该基准包含超过2.1万个基于人类分析叙述的声明，并要求智能体在完全交互的网页环境中导航以验证这些声明。

Details

Motivation: 现有的视觉语言模型基准主要局限于静态图像和一次性问答，无法满足现代数据分析的动态性和交互性需求，因为证据可能被遮挡、分布在多个视图或需要通过用户交互有条件地揭示。

Result: 论文评估了最先进的模型，结果表明交互式验证仍然是一个非平凡的重大挑战，揭示了当前模型在此任务上的局限性。

Insight: 该工作的核心创新在于将交互轨迹视为推理过程的内在代理，从而能够严格审计模型如何寻找和综合视觉证据，这为评估和理解模型在动态环境中的认知能力提供了新范式。

Abstract: Vision Language Models have demonstrated remarkable proficiency in interpreting static visual artifacts, but modern data analysis is inherently dynamic, requiring the active interrogation of interactive environments. Existing benchmarks are predominantly constrained to static imagery and one-shot question answering and fail to capture the epistemic demands of this domain, where evidence is frequently occluded, distributed across linked views, or conditionally revealed through user agency. In this paper, we introduce InSight, a benchmark for agentic claim verification over interactive visualizations. The dataset consists of 21,349 claims derived from human-authored analytical narratives and grounded in fully interactive web-based environments. Agents must navigate these environments to determine whether a natural language claim is supported, refuted or not verifiable given the available evidence. Unlike traditional evaluations, InSight treats interaction traces as intrinsic proxies for reasoning, enabling a rigorous audit of how models seek and synthesize visual evidence. We evaluate state-of-the-art models, revealing that interactive verification remains a non-trivial challenge. We release InSight at https://github.com/maevehutch/insight.

[36] When Tokenization is Secretly Output Supervision cs.CLPDF

Tanja Baeumel, Josef van Genabith, Simon Ostermann

TL;DR: 本文挑战了将分词视为纯输入预处理的传统观点，提出在自回归模型中，输出分词粒度实质上决定了模型在单次前向传播中必须解决的任务，从而构成了监督信号。通过数值推理任务的受控实验，作者发现任务性能、训练动态和模型内部表征的差异主要由输出分词而非输入分词引起。

Details

Motivation: 动机在于揭示分词不仅影响输入表示，更通过决定自回归模型在单次前向中需预测的单元，定义了模型被训练的任务本身，这导致不同分词策略的模型比较可能混淆任务定义与模型能力。

Result: 在数值推理的受控实验中，输出分词的不同显著影响了任务性能（如准确率）、训练动态（如收敛速度）和模型内部表征，而输入分词的影响微乎其微；对120篇*CL论文的调研显示，69%的研究在未报告数值分词的情况下跨分词策略比较模型，仅约10%报告了评估模型的分词细节。

Insight: 创新点在于将分词重新框架化为输出监督，这为理解分词如何系统性影响模型性能提供了原则性解释；客观来看，该视角强调了在模型评估中透明报告分词策略的重要性，以避免混淆任务定义与模型能力。

Abstract: Tokenization in language models is treated by default as an input preprocessing decision. We argue that this framing is incomplete: in autoregressive models, tokenizer granularity determines what the model must resolve in a single forward pass, and therefore the supervision signal it receives. This affects both the difficulty of the learning problem and the representations that emerge inside the model. We test this in a controlled experiment on numeric reasoning with a novel decoupling of input and output tokenization. As the output supervision view predicts, differences in task performance, training dynamics, and model internals are induced by output tokenization and largely invariant to input tokenization. This may matter in practice, because models with different tokenization strategies differ not only in input representation but in the task they were trained on. Comparisons between models may thus partly reflect task definition rather than ability. A survey of 120 recent *CL papers on numeric reasoning confirms that this is rarely acknowledged: only about 10% report the numeric tokenization of the models they evaluate, while 69% compare across tokenization, and thus supervision, regimes without reporting it. While prior work documents that tokenization consistently affects model performance, there is no principled account of why. We argue that framing tokenization as output supervision provides that account.

[37] From Rollouts to Recipes: Self-Contained Post-Training for LLMs cs.CLPDF

Yifei Li, Lingling Zhang, Muye Huang, Zihan Ma, Jiashuai Liu

TL;DR: 本文提出了一种名为Self-Routing的行为条件化后训练框架，用于大型语言模型。该框架根据模型自身在样本上的表现（正确性和置信度），将样本动态路由到不同的优化策略（如GRPO、策略内自蒸馏、正则化或跳过），从而实现自适应的、无需外部监督的训练。实验表明，该方法在数学推理任务上优于统一的训练方法。

Details

Motivation: 现有的大语言模型后训练通常对所有样本采用单一的训练方案，忽略了模型自身在不同样本上的学习状态差异。本文旨在解决这一问题，通过利用模型自身的行为来动态调整每个样本的训练策略。

Result: 在基于Qwen3和Qwen3.5的数学推理实验中，Self-Routing方法在性能上持续优于统一的GRPO、统一的OPSD、固定混合策略以及更简单的路由基线。分析表明，路由分布会随训练动态变化，并减少对低信号或已稳定样本的不必要更新。

Insight: 核心创新点在于提出了一种基于模型自身行为（rollout）进行样本级路由的自适应后训练框架。其借鉴了强化学习中的思想，将样本根据其学习状态分类处理，从而实现了无需外部教师或额外标注的高效训练。这种方法为模型后训练提供了一种新的、更精细化的优化视角。

Abstract: Post-training large language models usually applies a single training recipe to all samples, even though the model’s own rollouts reveal different sample-level learning states. We propose Self-Routing, a behavior-conditioned post-training framework that uses rollout correctness and confidence to decide how each sample should be optimized. Depending on its behavior state, a sample is routed to GRPO, on-policy self-distillation, regularization, or skipping, allowing training to adapt without external teachers, extra annotations, or additional sampling. Experiments on mathematical reasoning across Qwen3 and Qwen3.5 backbones show that Self-Routing consistently improves over uniform GRPO, uniform OPSD, fixed mixtures, and simpler routing baselines. Further analyses show that the routing distribution changes over training and reduces unnecessary updates on low-signal or already stable samples.

[38] Knowledge Distillation During Mid-Training Favors Reasoning over Factual Recall cs.CLPDF

Jacqueline He, Howard Yen, Shuyue Stella Li, Margaret Li, Hanqing Zeng

TL;DR: 本文研究了基于logit的知识蒸馏（KD）在语言模型不同训练阶段的效果差异。研究发现，标准的前向KL蒸馏在预训练阶段能同时提升推理和事实回忆能力，但在中期训练阶段会阻碍事实回忆的获取。为此，作者提出了Switch Distillation方法，根据教师模型的预测熵动态选择蒸馏或交叉熵损失，以平衡推理和事实回忆能力。

Details

Motivation: 动机在于探究知识蒸馏的益处是否在语言模型训练的各个阶段都保持一致，特别是发现标准的前向KL蒸馏在中期训练阶段对事实回忆能力有负面影响，这促使研究者寻找一种更平衡的蒸馏目标。

Result: 在多个教师模型规模下，Switch Distillation均优于现有蒸馏目标。相对于标准的下一个词预测（NTP），它在推理任务上达到1.61-1.71倍的性能，在知识和常识任务上达到1.13-1.19倍的性能，同时保留了96.7-96.8%的事实回忆能力。在后续训练后，该方法在保持推理和知识常识增益的同时，弥补了事实回忆的差距。

Insight: 核心创新点是揭示了知识蒸馏效果对训练阶段的依赖性，并提出了Switch Distillation这一简单而有效的动态目标。其关键洞察是利用教师模型的预测熵作为轻量级路由信号，在教师置信度高的token上进行蒸馏，否则回退到交叉熵，从而缓解了教师在不同数据域上置信度不对称以及学生知识状态演变带来的不平衡问题。

Abstract: Logit-based knowledge distillation (KD) is used to train smaller language models (LMs) via supervision from stronger teachers, but whether its benefits are consistent across training stages remains unclear. Through controlled experiments, we find that forward Kullback-Leibler (KL) distillation–the standard KD formulation–with post-trained teachers behaves fundamentally differently during mid-training, an intermediate phase of self-supervised learning on curated corpora. Surprisingly, while forward KD simultaneously improves reasoning and factual recall during pre-training relative to standard next-token prediction (NTP), it instead slows factual recall acquisition during mid-training despite continued reasoning gains. We trace this stage dependence to an asymmetry in teacher confidence across data domains and the student’s evolving knowledge state: teachers are more confident on procedural than knowledge-intensive data, while students acquire low-entropy factual knowledge earlier in training. To mitigate this imbalance, we propose Switch Distillation, a simple mid-training objective that distills on tokens where the teacher is confident, using teacher predictive entropy as a lightweight routing signal, and otherwise falls back to cross-entropy. Switch Distillation consistently outperforms existing distillation objectives across teacher sizes. Relative to standard NTP, it achieves 1.61-1.71x the reasoning performance and 1.13-1.19x the knowledge and commonsense performance while preserving 96.7-96.8% of factual recall. Crucially, these benefits persist after post-training: Switch Distillation closes the factual recall gap while maintaining 1.25-1.32x and 1.13-1.20x gains in reasoning and knowledge and commonsense, respectively.

[39] From Production Traffic to Post-Training: Building a Self-Hosted LLM That Covers the Corporate Request Mix cs.CLPDF

Olga Tsymboi, Dmitrii Stoianov, Ramil Latypov, Danil Taranets, Daniil Dryabin

TL;DR: 该论文提出了一种为企业构建自托管大语言模型（LLM）的方法，旨在解决因数据驻留要求而需自托管模型时，因持续部署新模型导致GPU资源碎片化的问题。核心方案是通过分析生产环境中的错误，在指令遵循、函数调用和内部任务分布三个维度上提升模型质量，并训练专门的GRPO专家模型，再通过两阶段SLERP进行合并，最终将来自200多个内部应用的流量整合到单一模型上。

Details

Motivation: 企业因数据驻留限制必须自托管LLM，但不断采用新模型而不淘汰旧模型会导致服务集群扩张，从而碎片化有限的GPU资源池。因此，需要将分散的流量整合到单一模型上，以降低成本并提高效率。

Result: 在非推理模式下，该方法在内部评测平台（Arena）上以69.6比65.8的分数超越了总参数量约大7倍的基线模型；指令遵循得分从0.83提升至0.85，函数调用从0.77提升至0.79，同时提升了通用对话基准测试的性能。该模型吸收了平台50%的流量（每月1.16亿请求），且服务成本大幅降低。

Insight: 创新点在于通过生产错误分析识别并针对性优化三个关键质量维度（指令遵循、函数调用、内部任务分布），并采用为每个维度训练独立GRPO专家再通过两阶段SLERP合并的策略，避免了多目标联合优化带来的跨领域奖励干扰问题。每个专家模型暴露了特定的失败模式（如语义崩溃、过度调用、冗长攻击），并需要针对性的修复方案。

Abstract: Data-residency constraints force enterprises to self-host LLMs, but continuous adoption of newer models without decommissioning their predecessors expands the serving fleet, fragmenting a finite GPU pool. We consolidate traffic from over 200 internal applications onto a single model by closing quality gaps identified through production error analysis along three axes: instruction following, function-calling, and internal task distribution. Quality is tracked by offline benchmarks stratified to production traffic and scored by deterministic verifiers or calibrated LLM judges. Rather than optimising all objectives jointly, which introduces cross-domain reward interference, we train a separate GRPO expert per axis and merge them via two-stage SLERP. Each expert’s reward exposes a distinct failure mode, namely semantic collapse, over-calling, and verbosity hacking, each requiring a domain-specific fix. In non-reasoning mode the recipe surpasses a ${\sim}7\times$ larger by total parameters baseline on the in-house Arena with 69.6 to 65.8, instruction following with 0.85 to 0.83, and function-calling with 0.79 to 0.77, while lifting general dialogue benchmarks. The model absorbs 50% of platform traffic, 116M requests per month, at a fraction of the serving cost.

[40] Scaling Near-Optimal SFT-RL Annotation Budget Allocation from Small to Large LLMs cs.CL | cs.AI | cs.LGPDF

Jingtan Wang, Arun Verma, Xiaoqiang Lin, Zhengyuan Liu, Nancy F. Chen

TL;DR: 本文研究了在大语言模型后训练阶段，如何在一个固定的标注预算下，在监督微调（SFT）和强化学习（RL）之间进行分配的问题。作者提出了一个“近优区域”的概念，即性能在峰值容忍度（如2-10%）内的分配方案集合。研究发现，这个区域很宽，且随着模型规模增大而变宽，并且可以可靠地从小的代理模型迁移到大的目标模型。

Details

Motivation: 现有工作仅描述了宽泛的趋势（例如在低数据量时SFT占主导），缺乏一个原则性的分配框架，并且没有研究最优的SFT-RL比例是否能在不同模型规模间迁移。

Result: 实验结果表明，即使在很小的容忍度下，近优区域也很宽，并且该区域随着模型规模增大而变宽。更重要的是，从小的代理模型实验中确定的近优区域可以可靠地迁移到大的目标模型上，从而无需进行大规模穷举搜索。这一发现在不同任务、模型家族以及基于偏好的离策略和基于奖励监督的同策略RL方法中均保持一致。

Insight: 核心创新点在于将问题框架从寻找单一最优比例，转变为刻画一个“近优区域”。这提供了一个实用的策略：通过小规模代理模型的实验即可确定一个可迁移的近优分配方案，从而显著降低大规模模型调优的标注成本。此外，论文还分析了SFT与RL数据标注成本的不对称性如何影响近优区域。

Abstract: How to divide a fixed annotation budget between supervised fine-tuning (SFT) and reinforcement learning (RL) during LLM post-training remains an open problem. Existing work characterizes only broad trends (e.g., SFT dominates in low-data regimes), lacks a principled allocation framework, and does not examine whether the optimal ratio transfers across model sizes. We frame this problem in terms of near-optimality: rather than seeking a single optimal SFT-RL ratio, we characterize the near-optimal region, the set of allocations within a specified tolerance of peak performance. Empirically, this region is wide even for small tolerances (2-10%), widens with model scale, and transfers reliably from small proxy models to large target models. This yields a practical strategy: small proxy-model experiments suffice to identify a transferable near-optimal region, eliminating the need for exhaustive large-scale search. Our results hold consistently across tasks, model families, and both preference-based off-policy and reward-supervision on-policy RL methods. We further analyze how the asymmetry in annotation costs between SFT and RL data shifts the near-optimal region.

[41] Closing Cost-Quality Gap in Document VLMs: Difficulty-Aware Data Curation and Quality-Adjusted Deployment Economics cs.CLPDF

Maksim Evdokimov, Matvey Ivanov, Dmitrii Tsiupin, Olga Tsymboi, Anatolii Potapov

TL;DR: 本文提出了一种基于专家混合视觉语言模型的文档理解系统，通过难度感知数据筛选和质量调整部署经济性分析，显著降低了文档结构化信息提取的成本。该系统在单个H100 GPU上训练，通过提示工程服务异构工作流，在保持高质量的同时大幅降低了部署成本。

Details

Motivation: 解决受监管行业中大规模文档结构化字段提取的高成本问题，现有定制OCR流水线覆盖范围有限，隐私规则限制外部模型使用，而开源视觉语言模型服务成本高于人工标注。

Result: 模型在可部署（非推理）基线中表现最佳，甚至优于规模大一个数量级的模型；质量调整成本分析显示，相比人工基线成本降低超80%，相比最佳竞争开源模型成本降低超50%，更大基线在经济上不可行。

Insight: 创新点包括难度感知数据筛选管道（关注布局多样性、事实可提取性和跨模型一致性）以及基于生产遥测校准确认与纠正成本的质量调整部署经济性分析框架，为高成本敏感场景的VLM部署提供了实用解决方案。

Abstract: Extracting structured fields from hundreds of millions of documents annually remains costly in regulated industries: bespoke OCR cascades cover only a fraction of workflows, privacy rules preclude external models, and existing open-source VLMs that clear quality thresholds cost more to serve than human annotation. We present a deployed document-understanding system built on a Mixture-of-Experts VLM (35B total, 3B active), fine-tuned on in-house production data mixed with open-domain documents curated by a Difficulty-Aware pipeline for layout diversity, fact-extractability, and cross-model consistency. Fitting on a single H100 and serving heterogeneous workflows via prompting, the model leads all deployable (non-reasoning) baselines up to an order of magnitude larger. A quality-adjusted cost analysis, with confirmation and correction costs calibrated from production telemetry, shows it reduces expected costs by over 80% against the human baseline and by more than 50% against the best competing open-source model, while larger baselines remain economically unviable.

[42] StudentSim: Training LLM-based Student Simulators cs.CLPDF

Ke Yang, Chenglong Wang, Michel Galley, Chandan Singh, Jeevana Priya Inala

TL;DR: 该论文提出了StudentSim，一个用于训练基于大语言模型的学生模拟器的框架，旨在解决个性化AI导师开发中缺乏学生行为数据的问题。该框架通过池化训练和个体化微调，将稀疏的学生数据转化为能够模拟学生行为并对导师指导做出反应的个体模拟器。

Details

Motivation: 动机在于开发能够适应学生个体差异的AI导师需要大量关于何种指导对何种学生有效的证据，而从真实学习者处收集此类数据既稀疏又昂贵。现有的学生模拟器方法，如状态追踪模型和LLM角色扮演，在准确模拟学生能力和响应指导方面存在局限。

Result: 在涵盖国际象棋、第二语言英语写作和数学三个领域的标准化评估协议StudentSimEval上，StudentSim在行为保真度和指导响应度两个指标上均优于GPT-5.4。例如在国际象棋领域，StudentSim的F=0.51，R=0.91，而GPT-5.4为0.23和0.72。概念验证表明，使用StudentSim作为奖励模型训练的强化学习AI导师，在专家评估中比无强化学习基线和使用GPT-5.4模拟器训练的导师更准确、指导性更强且更个性化。

Insight: 论文的创新点在于提出了一个结合池化训练与个体化微调的两阶段训练框架，以及一个标准化的评估协议StudentSimEval，用于量化模拟器的行为保真度和指导响应度。从客观角度看，其核心贡献是提供了一种高效利用稀疏学生数据来构建高质量、可个性化学生模拟器的方法论，并验证了其在提升AI导师性能方面的实用价值。

Abstract: AI tutors are most useful when they adapt to each student’s strengths, weaknesses, and preferred guidance, but evidence about which guidance works for which student is sparse, slow, and costly to collect from real learners. Student simulators can provide this signal as a proxy, yet existing approaches are limited: state-tracking models fit student behavior but struggle to process explanations or corrections, while LLM role-play follows guidance fluently but does not reliably match the competence of the student being imitated. We present StudentSim, a training framework that turns sparse per-student data into individualized simulators through pooled training followed by per-student specialization. The resulting simulators both mirror a student’s own responses and update them under tutor guidance. We also introduce StudentSimEval, a standardized protocol covering 60 students across chess, second-language English writing, and mathematics, using public learner datasets with de-identified records shared for research. StudentSimEval measures behavioral fidelity (F), or how well a simulator matches a student’s responses, and guidance responsiveness (R), or how readily it updates under tutor guidance, with all methods fit and evaluated on the same records. Across all three domains, StudentSim outperforms GPT-5.4 on both metrics. In chess, StudentSim reaches F=0.51 and R=0.91, compared with 0.23 and 0.72 for GPT-5.4 and 0.45 and 0.27 for Maia2. As a proof of concept, using StudentSim as a reward model for tutor reinforcement learning produces a chess tutor that expert humans rate as more accurate, better-guided, and more personalized than a no-RL baseline and a tutor trained against a GPT-5.4 simulator reward. Code is available at https://github.com/microsoft/StudentSim.

[43] The Rise of Verbal Reinforcement Learning cs.CL | cs.AIPDF

Kshitij Tayal, Arun Sharma, Genta Indra Winata, Anirban Das, Sambit Sahu

TL;DR: 本文提出了‘言语强化学习’这一统一框架，将自然语言作为反馈来改进语言智能体的范式系统性地归纳为三个支柱：语言作为基础信号、语言作为审慎反馈以及语言作为学习信号，并围绕反馈生效的时机和作用对象进行了梳理与综述。

Details

Motivation: 自然语言正成为改进语言智能体的主要反馈渠道，能够以人类和现代语言模型都可理解的形式传达意图、偏好和因果结构，但缺乏一个统一的系统性论述。

Result: 本文是一个综述性工作，未报告具体的定量实验结果，但通过提出的分类法系统性地梳理和综合了该领域的代表性工作，并指出了未来的挑战与机遇。

Insight: 创新点在于首次提出了‘言语强化学习’的统一概念框架，并围绕‘何时’及‘修改什么’这一核心轴线，构建了一个清晰的三支柱分类法，为理解和推进该领域的研究提供了结构化视角。

Abstract: Natural language is emerging as a primary feedback channel for improving language agents, capable of conveying intent, preferences, and causal structure in forms interpretable by both humans and modern language models. We call this paradigm Verbal Reinforcement Learning (VRL) and offer the first unified account of it. We organize the field around a single axis, \textit{when} verbal feedback takes effect in an agent’s lifecycle and \textit{what} it modifies, yielding three pillars: (1) \textbf{Language as Grounding Signal}, where language defines the task itself by specifying goals, states, and reward structures; (2) \textbf{Language as Deliberative Feedback}, where natural language guides reasoning at test time without the need to update model parameters; (3) \textbf{Language as Learning Signal}, where language-based feedback shapes model parameters through training. Within each pillar, we synthesize representative work, distinguish key subcategories of approaches, and outline the distinct role language plays in shaping agent behavior. Together, this taxonomy shows how verbal reinforcement is reshaping agent development, while also defining the challenges and opportunities for building more capable and aligned agents.

[44] CordisBench: Can Language Models Reason About Component Lifecycles in Dynamic Agent Harnesses? cs.CL | cs.AIPDF

Damien Sileo, Dimitri Kachler

TL;DR: 本文介绍了CordisBench，一个包含1200个问题的基准测试，用于评估语言模型在动态代理框架中对组件生命周期依赖关系的推理能力。该基准结合了形式化设置与Cordis运行时环境，要求模型识别受影响的组件、预测指定拆卸顺序后的状态、确定在所有或某些顺序下成立的条件，并选择能成功执行的重配置方案。

Details

Motivation: 动态代理框架允许语言模型改变影响其执行的软件，这种灵活性带来了新的推理负担：局部插件变更可能通过依赖关系和清理操作传播，因此需要评估模型对此类生命周期推理的能力。

Result: 在CordisBench上评估了三种注重效率的模型，模型通常能较好处理小型系统，但随着相关交互数量增加（从2到32），可靠性下降，尤其在预测最终状态和跨拆卸顺序推理时表现不佳；增加推理努力可带来显著提升，但代价高昂（如GPT-5.6 Luna在16交互子集上每个问题需近3000个推理token）。

Insight: 创新点在于构建了首个专注于动态代理框架中组件生命周期推理的基准测试，结合形式化语义与可执行运行时环境；客观来看，该研究揭示了语言模型在复杂依赖推理中的局限性，并强调了高效推理方法的重要性，同时指出对于可控实例，可通过独立有限参考语义避免高成本推理。

Abstract: Dynamic agent harnesses let language models change the software that shapes their own execution. This flexibility brings a new reasoning burden: a local plugin change can propagate through dependencies and cleanup. We introduce CordisBench, a 1,200-question benchmark of this lifecycle reasoning. It combines a controlled formal setting with programs executed against Cordis, a runtime that manages component dependencies and cleanup, and asks models to identify affected components, predict state after a specified teardown order, determine which conditions hold under all or some orders, and choose reconfigurations that succeed when executed. Across these tasks, we evaluate three efficiency-oriented models at low reasoning effort with 2, 4, 8, 16, 24, or 32 relevant interactions, using deterministic task-specific scoring. Models usually handle small systems well but grow less reliable as more interactions become relevant, especially when predicting final state and when reasoning across teardown orders. Additional inference effort recovers marked gains for some models. The cost is nontrivial: on our 16-interaction subset, GPT-5.6 Luna uses nearly 3,000 reasoning tokens per question at medium effort. For these controlled instances, that cost is avoidable: an independent finite reference semantics agrees with Cordis execution on every observation and action outcome used for scoring across all 528 executable questions.

cs.CV [Back]

Ruotong Wang, Zihao Zhu, Siwei Lyu, Xin Tao, Baoyuan Wu

TL;DR: 本文研究了多模态大语言模型在视频内容审核中存在的组合安全盲区，即由看似无害的组件组合而成的视频可能传达有害含义，作者将这种现象称为分布式隐含危害。为研究此问题，作者构建了一个包含9000多个视频的数据集，并评估了30多个MLLM模型，发现它们在检测此类危害方面存在显著缺陷。

Details

Motivation: 解决多模态大语言模型在视频内容审核中存在的组合安全盲区问题，即视频中分散的、看似无害的组件在组合后可能产生有害含义，而现有模型难以识别这种分布式隐含危害。

Result: 在构建的包含9000多个视频的数据集上评估了30多个前沿专有和开源MLLM模型，发现它们在检测时间分布危害和跨模态危害方面存在显著且一致的缺陷，即使是顶级前沿模型也经常失败；在从社交媒体手动收集的真实世界视频集上观察到了相同的失败模式。

Insight: 创新点在于识别并形式化了分布式隐含危害这一组合安全盲区，并开发了一个多智能体合成框架来生成具有明确推理注释的多样化DIH视频数据集，为系统研究此问题提供了数据基础；客观分析认为，对视频内容进行组合语义理解而非孤立分析是提升审核安全性的关键方向。

Abstract: Despite their growing use in video moderation, multimodal large language models (MLLMs) exhibit a compositional safety blind spot: videos composed of seemingly benign components can convey harmful meaning when interpreted as a whole. We refer to this phenomenon as Distributed Implicit Harm (DIH), where harm arises from relations among components distributed along a decomposition axis of the video, rather than from any single explicit cue. Among many possible axes, we study two representative cases: temporally distributed harm across visual segments (DIH-T) and cross-modal harm between audio and visual streams (DIH-M). Studying and mitigating DIH at scale requires data that is difficult to collect: such videos lack compositional harm annotations, evade retrieval based on local visual cues, keywords, or single-modality signals, and are consequently absent from existing safety datasets. To bridge this gap, we develop a multi-agent synthesis framework that composes individually benign components into harmful scenarios and generates diverse DIH videos with explicit reasoning annotations, yielding a dataset of over 9,000 videos spanning visual-only and audio-visual settings. Benchmarking over 30 MLLMs spanning frontier proprietary models and leading open-source systems reveals substantial and consistent deficits in detecting both DIH-T and DIH-M. Notably, this failure persists even among the strongest frontier models: they often correctly assess individual components in isolation but fail to recognize the harmful meaning that emerges from their composition. We further evaluate these models on a manually collected set of real-world DIH videos from social media and observe the same failure mode, highlighting DIH as a practical and underexplored challenge for video moderation.

[46] ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-training cs.CVPDF

Xionghao Wu, Yijun Yang, Shiyang Zhou, Haoze Sun, Jianhui Liu

TL;DR: ZimaBlue是一个通过大规模视频预训练学习通用世界动作模型（WAMs）的可扩展框架，旨在解决机器人操作中数据稀缺和泛化能力不足的问题。它采用三阶段训练课程：首先在大量人类和机器人第一视角视频上进行因果具身视频预训练，然后通过统一的动作表示将学习到的视觉动态与异构机器人轨迹对齐，最后针对目标机器人进行微调部署。

Details

Motivation: 机器人操作面临一个根本性的扩展挑战：鲁棒的泛化需要广泛的物理经验，但带动作标签的机器人轨迹数据收集成本高且多样性有限。第一视角视频提供了更具可扩展性的具身体验来源，但如何将这些丰富但无动作标签的经验转化为有效的机器人控制是核心难题。

Result: 在真实机器人零样本评估中，从仅使用目标机器人数据扩展到使用超过12万小时的具身视频，任务成功率从36.1%提升至77.8%。ZimaBlue在多个基准测试中表现出色，尤其是在未见任务上取得了显著提升。

Insight: 创新点包括：1）提出一个三阶段的、从大规模无动作视频到机器人控制的可扩展训练课程；2）采用异步的慢-快双系统架构，兼顾模型容量和实时推理速度；3）利用统一的动作表示来桥接异构的视觉动态和机器人轨迹数据，有效提升了模型的泛化能力。

Abstract: Robotic manipulation faces a fundamental scaling challenge: robust generalization demands broad physical experience, yet action-labeled robot trajectories are expensive to collect and inherently limited in diversity. Egocentric videos offer a far more scalable source of embodied experience, capturing object interactions, contact dynamics, tool use, and long-horizon behaviors across diverse environments. The central challenge is how to convert this abundant but action-free experience into effective robot control. We introduce ZimaBlue, a scalable framework for learning generalizable World Action Models (WAMs) from large-scale video. ZimaBlue follows a three-stage training curriculum: it first performs causal embodied video pre-training on large-scale human and robot egocentric videos, then grounds the learned visual dynamics in heterogeneous robot trajectories through video-action mid-training with a unified action representation, and finally specializes the model to a target robot for deployment. To make generative WAMs practical for real-time control, ZimaBluefurther adopts an asynchronous Slow-Fast dual-system architecture, where a high-capacity Slow world model provides generalizable spatiotemporal representations and a lightweight Fast branch enables 30 Hz action prediction on NVIDIA RTX 4090. On real-robot zero-shot evaluations, scaling from target-robot data alone to over 120,000 hours of embodied video improves success from 36.1% to 77.8%. ZimaBlue further delivers strong performance across multiple benchmarks, with particularly pronounced gains on unseen tasks.

[47] Beyond Language Priors: Diagnosing and Fixing Visual-Origin Hallucinations in Multimodal LLM cs.CVPDF

Peiyang Xu, Xiaopei Zhu, Jun Zhu, Xiaolin Hu

TL;DR: 本文挑战了多模态大语言模型（MLLM）物体幻觉主要源于语言先验的传统观点，提出了视觉起源幻觉这一被忽视的成因，即错误的视觉特征提取和图文嵌入失准。作者通过余弦相似度和注意力熵分析进行诊断，并提出了对抗性对比微调（ACFT）方法，该方法利用对抗性幻觉属性翻转（AHAF）构建对齐样本对进行微调，以极小的数据和零推理开销在多个基准测试上取得了SOTA性能。

Details

Motivation: 现有研究主要将MLLM的物体幻觉归因于语言先验（如对文本共现统计的过度依赖），本文旨在挑战这一观点，揭示并解决一个被忽视的互补性成因——视觉起源幻觉。

Result: 在POPE、MME以及四个描述级幻觉基准测试上，ACFT方法在LLaVA、MiniGPT-4和Qwen2.5-VL等多个模型上取得了最先进的性能，且仅需COCO数据集的0.9%并保持零推理开销。

Insight: 创新点在于首次系统性地诊断了视觉起源幻觉，并提出了ACFT这一高效微调框架。其核心是AHAF程序，它既能作为诊断探针揭示模型表示接近幻觉决策边界，又能通过构造完美对齐的正负样本对进行对比学习，从而精准修正幻觉。

Abstract: Existing research on object hallucination in multimodal large language models (MLLMs) predominantly attributes the problem to language priors such as over-reliance on textual co-occurrence statistics. We challenge this view by presenting quantitative evidence for a complementary, under-explored cause: visual-origin hallucination, where hallucinations arise from incorrect visual feature extraction and misalignment between image and text embeddings. Through cosine similarity analysis and Smooth Grad-CAM entropy measurements, we show that hallucinated samples exhibit systematically lower image-text similarity (average 0.158 vs. -0.122) and inverted attention patterns, where attention is dispersed when the target object is present but wrongly concentrated when it is absent. Guided by this diagnosis, we propose Adversarial Contrastive Fine-Tuning (ACFT). ACFT uses an Adversarial Hallucination Attribute Flipping (AHAF) procedure, involving minimal, targeted adversarial perturbations that flip an image’s hallucination attribute, to construct perfectly aligned positive-negative pairs, which are then used for contrastive fine-tuning. AHAF simultaneously serves as a diagnostic probe, revealing that MLLM visual representations lie dangerously close to hallucination decision boundaries. Requiring only 0.9% of the COCO dataset and adding zero inference overhead, ACFT achieves state-of-the-art performance on POPE, MME, and four description-level hallucination benchmarks across LLaVA, MiniGPT-4, and Qwen2.5-VL. Code is available at https://github.com/zxp555/ACFT_MM

Yue Zhou, Yuan Wu, Yi Chang

TL;DR: 本文针对多模态大语言模型在OCR相关任务中的可靠性问题，提出了OCR任务验证的概念，并构建了VeriOCRBench基准数据集。该数据集包含1800个样本，涵盖8种陷阱类型和四个验证维度，用于评估模型在遇到无效任务时的识别能力。通过对15个主流MLLM的评估，揭示了当前模型存在盲目服从、诊断失败和过度拒绝等关键可靠性缺陷。

Details

Motivation: 现有OCR中心的多模态大语言模型评估通常假设所有任务都是有效且可回答的，但在真实OCR场景中，问题可能基于不可读文本、遮挡证据、不存在目标、矛盾前提或缺失变量，导致模型可靠性不足。本文旨在研究这一可靠性差距，即模型在回答问题前应能判断图像前提、文本前提和问题是否共同构成可执行任务。

Result: 在构建的VeriOCRBench基准上评估了15个领先的MLLM，结果显示模型普遍存在盲目服从（即对无效任务仍尝试回答）、诊断失败以及提示诱导的过度拒绝问题，暴露了当前OCR推理系统的关键可靠性缺陷。

Insight: 创新点在于首次系统性地定义了OCR任务验证问题，并构建了一个基于视觉原子事实锚定流程和人工审核的诊断性基准数据集，支持任务验证、根因诊断和过度拒绝的解耦评估。这为提升MLLM在真实OCR场景中的可靠性提供了新的评估范式和洞见。

Abstract: Multimodal Large Language Models (MLLMs) have achieved strong performance on OCR-centric document understanding and text-rich visual reasoning benchmarks. Yet existing evaluations largely assume that every task is valid and answerable. In real-world OCR scenarios, this assumption often fails: questions may rely on illegible text, occluded evidence, nonexistent visual targets, contradictory premises, or missing variables. We study this reliability gap as OCR-grounded Task Verification: before answering, a model should determine whether the Image Premise (IP), Textual Premise (TP), and Question (Q) jointly define an executable task. We introduce VeriOCRBench, a 1,800-sample human-verified benchmark built from source images drawn from 8 OCR-related datasets and spanning 8 real-world image domains, with controlled, image-grounded diagnostic tasks. It contains 1,600 trap-injected invalid tasks across 8 trap types and four verification dimensions—Visual, Contextual, Factual, and Logical—plus 200 trap-free controls for measuring over-refusal. Built with a Visual Atomic Fact (VAF)-anchored pipeline and full human auditing, VeriOCRBench enables decoupled evaluation of task verification, root-cause diagnosis, and over-refusal. Evaluating 15 leading MLLMs reveals persistent blind compliance, diagnosis failures, and prompt-induced over-refusal, exposing a critical reliability gap in current OCR reasoning systems. The code is available at: https://github.com/zy001122/Beyond-Blind-Compliance.

[49] CoLT-Drive: Counterfactual Long-Tail Benchmarking and Knowledge-Preserving Adaptation for Driving Affordance Prediction cs.CV | cs.AI | cs.CL | cs.ROPDF

Zhengxu Tang, Guofeng Cui, Ziyu Gong, Xiaozhou Zhang, Ruifeng Deng

TL;DR: 本文提出了CoLT-Drive，一个用于评估自动驾驶决策级驾驶可供性预测能力的反事实长尾基准测试集，并针对小型视觉语言模型（VLMs）提出了一个名为KPA的知识保持适应框架。该框架通过结构化提示、专家模型融合和专家混合模块，在保持模型预训练知识的同时，有效提升了其在罕见场景下的决策准确性。

Details

Motivation: 当前自动驾驶的长尾故障常被归因于罕见物体识别错误，但作者认为决策层面的问题更为关键：模型不仅需要识别罕见物体，更需要推断该物体如何改变自车可行的驾驶行为。

Result: 在提出的CoLT-Drive基准测试上，KPA方法达到了60.8%的配对准确率，优于预训练的Qwen3-VL-2B基线模型（50.3%）和LoRA SFT方法（32.4%），同时在领域内数据集上保持了有竞争力的准确率。

Insight: 论文的创新点在于将长尾问题从物体识别层面提升到决策层面的驾驶可供性预测，并提出了一个结合结构化提示、专家融合和特定任务适配模块（RegMoE）的知识保持适应框架，有效平衡了通用知识保留与特定驾驶决策能力提升。

Abstract: Long-tail autonomous driving failures are often framed as rare-object recognition errors. We argue that this view is incomplete: the decision-critical question is not only whether a model recognizes an unusual object, but whether it infers how that object changes the ego vehicle’s feasible high-level actions. We formalize this problem as decision-level driving affordance prediction, where a model maps a front-view image, ego-motion history, and navigation command to a structured longitudinal–lateral meta-action. To evaluate this capability, we introduce CoLT-Drive, a 3,536-sample counterfactual long-tail benchmark that inserts rare objects into otherwise fixed driving scenes and measures whether models predict acceptable action pairs. To improve deployable small VLMs, we propose KPA, a knowledge-preserving adaptation framework that combines structured perception-to-decision prompting, SLERP-based expert merging, and RegMoE, a regime-aware LoRA mixture-of-experts module. KPA preserves the pretrained model’s open-world knowledge while allocating lightweight adaptation capacity to different driving decision regimes. Experiments on an in-domain driving split and CoLT-Drive show that KPA achieves 60.8% pair accuracy on CoLT-Drive, outperforming the pretrained Qwen3-VL-2B baseline (50.3%) and LoRA SFT (32.4%) while maintaining competitive in-domain accuracy. Our benchmark and code are available at https://huggingface.co/datasets/tangzx2024/CoLT-Drive and https://github.com/tangzhengxu/CoLT-Drive.

[50] Qwen-Drive-1.0: An Initial Step towards a Vision-Language Foundation Model for Autonomous Driving cs.CVPDF

Xin Zhou, Zongchuang Zhao, Zhibo Yang, Mingsheng Li, Humen Zhong

TL;DR: Qwen-Drive-1.0是一个面向自动驾驶的视觉语言基础模型的初步尝试。它基于预训练的视觉语言模型架构，在一个统一框架中整合了3D感知、视觉问答和运动规划。模型通过一个外部鸟瞰图感知头执行3D物体检测、语义占据预测和BEV地图分割，并利用规划专家模块生成未来自车轨迹。

Details

Motivation: 旨在构建一个统一的视觉语言基础模型，以解决自动驾驶中3D感知、场景理解和运动规划等多个任务分散的问题。

Result: 实验表明模型在3D感知和驾驶场景理解方面表现强劲，同时很大程度上保留了通用视觉语言能力。在开环、伪闭环和闭环设置下的综合评估进一步显示出极具竞争力的运动规划性能。

Insight: 创新点在于将3D感知、VQA和运动规划集成到单一VLM框架中，并通过分阶段训练结合驾驶监督与通用视觉语言数据，以在获得驾驶专用能力的同时保持广泛的视觉理解和指令跟随能力。外部BEV感知头作为3D信息的可探测接口，提供了可检查的显式场景结构表示。

Abstract: We present Qwen-Drive-1.0, an initial step towards a vision-language foundation model for autonomous driving. Qwen-Drive-1.0 retains the architecture of the pretrained vision-language model (VLM) and integrates 3D perception, visual question answering, and motion planning within a unified framework. An external bird’s-eye-view (BEV) perception head jointly performs 3D object detection, semantic occupancy prediction, and BEV map segmentation. It serves as a probe of the 3D information accessible from the shared representations and provides an explicit, inspectable interface to 3D scene structure. A Planning Expert conditions on shared VLM representations to generate future ego trajectories. A staged training recipe combines driving supervision with general-purpose vision-language data to acquire driving-specific competence while helping preserve broad visual understanding and instruction-following capabilities. Experiments demonstrate strong 3D perception and driving scene understanding while largely preserving general vision-language capability. Comprehensive evaluations across open-loop, pseudo-closed-loop, and closed-loop settings further show highly competitive motion-planning performance.

[51] CrossFeat: Bridging Imaging Modalities in Feature Descriptor Space cs.CVPDF

Paul Schneider, Nazim Haouchine

TL;DR: 本文提出CrossFeat框架，旨在解决跨模态图像（如多光谱、RGB-D、卫星或医学影像）中特征描述符匹配的难题。该方法通过在描述符空间中学习一个’交叉函数’，将一种模态的特征映射到与另一种模态兼容的表示，从而无需为每对模态重新训练或使用大型模型，即可使现有的单模态描述符实现跨模态工作。

Details

Motivation: 现有关键点描述符的进展主要针对单模态场景，而跨模态场景中，由于成像原理不同，相同结构在不同模态下外观差异巨大。现有解决方案需要为每对模态重新训练描述符或使用大型模型，导致灵活性差或计算成本高。

Result: 在多个领域和数据集上的实验表明，CrossFeat在跨模态匹配任务中提升了性能。

Insight: 核心创新在于提出了一种在描述符空间进行模态转换的轻量级框架，并通过几何-外观解耦的设计，确保在转换外观信息的同时，保留原始描述符捕获的关键几何结构信息，这为实现高效、灵活的跨模态特征匹配提供了新思路。

Abstract: Most advances in keypoint descriptions address monomodal settings, where image variations arise from viewpoint, illumination, or contrast changes. Multimodal scenarios involve images produced by fundamentally different sensing processes, such as multispectral imaging, RGB-depth, satellite imagery, or medical imaging, causing the same structures to appear differently. A common solution to cross-modal description is to train descriptors for each modality pair, which requires retraining whenever the modalities change, or to train large models, which incur a significant increase in runtime. Instead, we propose CrossFeat, a framework that enables an existing monomodal descriptor to operate across modalities. Our method learns a crossing function in descriptor space that maps features from one modality to a representation compatible with another. To preserve the structural information captured by the original descriptor, CrossFeat introduces a geometry-appearance disentanglement such that only appearance is altered while the geometric properties are preserved. Experiments across multiple domains and datasets demonstrate improved performance in multimodal matching.

[52] StreamScout: Learning When to Look Deeper for Streaming Video Understanding cs.CVPDF

Ce Zhang, Jing Bi, Jinxi He, Jianshu Zhang, Jingyang Lin

TL;DR: StreamScout是一个用于流式视频理解的自适应推理框架，它通过维护一个轻量级文本时间线，并根据查询需求逐步增强视觉信息（如最近帧、均匀回看和查询相关检索）来动态决定推理深度。该框架包含通过知识蒸馏优化的StreamScout-S和通过强化学习优化的StreamScout-R变体，旨在平衡准确性与计算成本。

Details

Motivation: 现有流式视频理解系统对所有查询使用固定成本的记忆访问流程，忽略了不同查询所需证据量的巨大差异。本文认为，为每个查询决定访问记忆的深度与决定记忆存储内容同等重要。

Result: 在三个骨干模型和三个流式基准测试（包括OVO-Bench）上，StreamScout及其变体均优于先前的流式方法，同时显著降低了推理成本和token消耗。例如，在OVO-Bench上，StreamScout-S将Qwen3-VL-8B的性能提升了14.65分，同时比均匀采样少用59%的token，平均回答时间为1.04秒。

Insight: 核心创新在于将流式视频理解建模为一个渐进式、自适应的级联推理过程，通过动态的“停止或升级”策略来优化效率。通过知识蒸馏和强化学习来优化该策略，实现了准确性与计算开销的有效权衡，为资源受限的实时视频分析提供了新思路。

Abstract: Streaming video understanding requires answering questions that arrive at arbitrary moments over an unbounded video stream. Existing systems primarily focus on what to retain in a bounded memory, yet access that memory using the same fixed-cost procedure for every query, despite substantial variation in the evidence required. We argue that deciding how deeply to access memory for each query is as important as deciding what the memory should store. To this end, we introduce StreamScout, an adaptive inference framework that maintains only a lightweight textual timeline in context as the stream unfolds. At query time, StreamScout progressively augments the timeline with up to three increasingly informative visual views: a glance at recent frames, a uniform look-back over the past stream, and query-salient retrieval. At each stage, the model answers immediately if the available evidence is sufficient; otherwise, it escalates to the next view. To improve this stop-or-escalate policy, we probe the cascade on an auxiliary set and distill the model’s empirical competence boundary into supervision for a lightweight LoRA adaptation, yielding StreamScout-S. We further refine the policy through reinforcement learning, allowing the model to explore stopping behaviors beyond imitation of the distilled decisions, yielding StreamScout-R. Across three backbones and three streaming benchmarks, StreamScout and its variants consistently outperform prior streaming methods while substantially reducing inference cost and token consumption; on OVO-Bench, for instance, StreamScout-S improves Qwen3-VL-8B by 14.65 points while using 59% fewer tokens than uniform sampling and answering in 1.04 s on average.

[53] Where Should Experience Live? Hierarchical Hebbian Memory for Continual Vision Transformers cs.CV | cs.NEPDF

Mohammed Yusuf Mujawar, Noorbakhsh Amiri Golilarz

TL;DR: 本文提出了一种名为’分层赫布记忆’的三层记忆架构，用于增强视觉Transformer在持续学习中的能力。该架构包含快速工作记忆、持久路由情景记忆和较慢语义记忆，通过一个学习控制器来调节记忆的贡献、读写路由、可塑性、保留和巩固。在Omniglot 5-way 1-shot识别和CORe50持续物体识别任务上进行了评估，结合经验回放，模型在Swin-Tiny上分别达到了97.39%和95.37%的准确率。

Details

Motivation: 视觉Transformer虽然提供了强大的视觉表示，但其参数更新缓慢，限制了其在不同记忆时间尺度上组织新获取信息的能力。因此，需要一种能够有效管理在线视觉经验的记忆架构。

Result: 在Omniglot 5-way 1-shot识别任务上达到97.39%准确率，在CORe50持续物体识别任务上达到95.37%最终准确率。学习到的多库检索在延迟关联任务上达到47.50%准确率，优于单持久库的24.17%和无记忆的25.00%。在干扰后，情景记忆与存储关联的余弦相似度保持在约0.96，而工作记忆降至约0.05。

Insight: 创新点在于将赫布关联与学习记忆路由相结合，在视觉Transformer内构建分层记忆系统，以组织快速、持久和巩固的记忆时间尺度。这为持续学习中的记忆管理提供了新的架构思路，特别是通过因果读写生命周期确保预测的独立性。

Abstract: Vision Transformers provide strong visual representations but typically rely on slowly updated parameters, limiting their ability to organize newly acquired information across different memory timescales. This work proposes \textit{Hierarchical Hebbian Memory}, a three-level memory architecture composed of rapid Working Memory, persistent Routed Episodic Memory, and slower Semantic Memory. A learned controller regulates memory contribution, read and write routing, plasticity, retention, and consolidation. A causal read-before-write lifecycle ensures that the current outcome cannot influence the prediction it supervises. The architecture is evaluated on Omniglot 5-way 1-shot recognition and CORe50 continual object recognition. With Swin-Tiny, the hierarchical model reaches 97.39% accuracy on Omniglot and 95.37% final accuracy on CORe50 when combined with experience replay. Learned multi-bank retrieval reaches 47.50% delayed-association accuracy, compared with 24.17% for a single persistent bank and 25.00% without memory. After intervening distractors, Episodic Memory retains approximately 0.96 cosine similarity with stored associations, while Working Memory falls to approximately 0.05. These results show that Hebbian association and learned memory routing can jointly organize online visual experience across rapid, persistent, and consolidated memory timescales within Vision Transformers.

[54] SlideMix: Enhancing Whole Slide Image Analysis via Multimodal Shuffling cs.CVPDF

Chad Wong, Sicheng Chen, Tianyi Zhang, Enhui Chai, Yueming Jin

TL;DR: 本文提出SlideMix，一种用于基于多示例学习（MIL）的病理全切片图像（WSI）分析的模型无关多模态增强框架。它通过检索增强的视觉语言模型（VLM）选择诊断相关区域，进行原位图块混洗以混合特征嵌入并保持切片级上下文，同时使用VLM软标签和课程学习反馈方案自适应控制增强参数，以提升跨尺度表征学习。

Details

Motivation: 解决病理全切片图像分析中因图像尺度巨大、组织异质性、弱切片级监督、诊断区域稀疏以及多尺度证据带来的挑战，现有增强策略常扰动组织区域但未能保持诊断相关性、切片上下文或跨尺度结构。

Result: 在包含20,523张切片、8个诊断任务和10个WSI骨干网络的11个WSI数据集上，SlideMix在大多数设置中提高了准确性和泛化能力，优于已有的增强基线方法。

Insight: 创新点在于结合VLM进行诊断相关区域选择以减少弱标签噪声，以及通过原位图块混洗和自适应课程学习反馈来混合特征并促进跨尺度学习，为数字病理提供了一个简单即插即用的鲁棒增强方案。

Abstract: Histopathological whole slide images (WSIs) are central to cancer diagnosis, but their gigapixel scale, tissue heterogeneity, weak slide-level supervision, sparse diagnostic regions, and multi-scale evidence make robust automated analysis challenging. Multiple instance learning (MIL) is widely used to aggregate tile-level features into slide-level predictions, yet existing augmentation strategies often perturb tissue regions without preserving diagnostic relevance, slide context, or cross-scale structure. We propose SlideMix, a model-agnostic multimodal augmentation framework for MIL-based WSI analysis. SlideMix uses a retrieval-augmented vision-language model (VLM)-based Visual-Language Adaptive Region selector to identify diagnostically relevant regions and reduce weak-label noise. It then performs In-place Tile Shuffling within meaningful tissue regions to mix feature embeddings while preserving slide-level context. A VLM-based soft-labeling module supervises mixed samples, while a multi-factor, loss-driven online Curriculum-Learning Feedback scheme adaptively controls shuffle granularity, feature similarity, and shuffle ratio to promote cross-scale representation learning. Across 11 WSI datasets comprising 20,523 slides, 8 diagnostic tasks, and 10 WSI backbones, SlideMix improves accuracy and generalization in most settings and compares favorably with established augmentation baselines, providing a simple plug-and-play approach for more robust and scalable digital pathology models. Source code: https://github.com/Xia-Research-Lab/SlideMix

[55] FoldingAgent: Inferring Parametric Origami Procedures from Demonstration Videos cs.CV | cs.AI | cs.GRPDF

Maya Moriya, Sigal Raab, Yael Vinker, Tali Dekel

TL;DR: FoldingAgent是一个智能体框架，能够直接从折纸演示视频中推断出显式的参数化折叠程序。该框架利用预训练视觉语言模型的推理能力，结合一系列专用工具来模拟几何变换、验证物理合理性、检索比较视觉内容并评估自身预测，从而将非结构化的视觉演示转化为可执行的参数化折叠计划。

Details

Motivation: 旨在弥合主要通过非结构化视觉演示分享的人类折纸知识与通常依赖结构化参数表示（如折痕图或可执行参数计划）的计算方法之间的差距。

Result: 在新构建的PurelandFold基准（包含多样化Pureland折纸视频及真实几何与动作标签）上进行了评估，结果表明结合VLM推理、专用工具和物理模拟，能够成功地将非结构化视觉演示转化为可执行且物理合理的折叠程序。

Insight: 创新点在于定义了一个包含纸张几何和参数化折叠动作的参数空间，使智能体能够顺序操作并重新规划动作，有效缓解多步折叠中固有的累积误差，从而超越了仅预测静态折痕图的模型。

Abstract: We present FoldingAgent, an agentic framework for inferring explicit parametric folding programs directly from origami demonstration videos. Our framework leverages the reasoning power of a pre-trained Vision-Language Model (VLM) equipped with a suite of specialized tools that enable the agent to simulate geometric transitions, verify physical plausibility, retrieve and compare visual content, and evaluate its own predictions. To translate visual content into folding programs, we define a parametric space that consists of the paper’s geometry and a set of parametric folding actions. Unlike models that predict static crease patterns, our agent operates sequentially and possesses the ability to re-plan its actions, effectively mitigating the compounding errors inherent in multi-step folding. Our approach takes a step toward closing the gap between human origami knowledge, which is primarily shared through unstructured visual demonstrations, and computational methods, which typically rely on structured, parametric representations such as a crease pattern or an executable parametric plan. We evaluate our approach on PurelandFold, a newly curated benchmark of diverse Pureland origami videos with ground-truth geometry and action labels. Our results demonstrate that by combining VLM reasoning with a set of specialized tools and physical simulation, we can successfully transform unstructured visual demonstrations into executable, physically plausible folding procedures.

[56] Unmasking Face Embeddings: Reading, Rendering and Naming with Foundation Models cs.CVPDF

Fizza Rubab, Yiying Tong, Arun Ross

TL;DR: 本文提出了一种通过简单的预计算线性变换，将特定领域的人脸识别模型的身份嵌入与通用基础模型对齐的方法。对齐后，无需训练或修改任何模型，即可实现人脸嵌入的自然语言描述、图像重建和姓名识别，从而揭示了人脸嵌入的语义和视觉丰富性。

Details

Motivation: 解决传统人脸识别模型的身份嵌入虽然匹配性能好，但语义解释性差的问题，探索其与通用基础模型互操作后带来的新能力。

Result: 方法在多个任务上展示了能力，包括通过文本查询人脸嵌入库、使用未修改的扩散解码器重建人脸图像，以及在无注册图库的情况下进行身份识别。

Insight: 核心创新在于仅使用简单的线性变换实现不同模型嵌入空间的低成本对齐，从而解锁了人脸嵌入的语义解释、图像生成和开放集识别等新功能，对可解释性、检索、重建和模板安全有直接意义。

Abstract: Modern face recognition (FR) owes much of its success to deep neural networks that learn to extract compact identity embeddings from face images. These models are typically trained for identity discrimination, producing embeddings that are highly effective for biometric matching but largely opaque to semantic interpretation. In contrast, foundation models, pretrained on broad visual or vision–language tasks, provide rich interfaces for describing, retrieving, generating, and organizing visual content. This contrast raises a natural question: what capabilities become available when face embeddings from domain-specific FR models are made interoperable with foundation models? Building on recent work on embedding compatibility across models, we use simple pre-computed linear transformations, estimated from paired embeddings alone, to connect existing FR models with off-the-shelf foundation models. Once aligned with a foundation model, a face embedding can be ‘unmasked’ in multiple ways, without training or modifying either model: it can be read in natural language, enabling free-form text queries over a gallery of FR embeddings; rendered into a face image that recovers a person’s appearance, using an unmodified diffusion decoder; and converted to a name, enabling identification even in the absence of an enrolled face gallery. In effect, one linear transformation turns an identity embedding into a rich embedding for web-scale foundation models. This interoperability exposes face embeddings as semantically and visually rich biometric representations, with direct implications for interpretability, retrieval, reconstruction, and template security.

[57] Instance-Guided Report Anchoring for Text-Free 3D Abnormality Segmentation in Chest CT cs.CVPDF

Zhenyu Bu, Haoyan Ding, Chushu Shen, Xinyuan Zheng, Peiyu Duan

TL;DR: 本文提出了一种名为实例引导报告锚定（IGRA）的模型无关模块，用于在胸部CT中进行无需文本的3D异常分割。该方法在训练时利用放射学报告中实例特定的描述来增强监督，通过将每个异常实例表示与对应的报告发现嵌入进行锚定，而在推理时丢弃所有文本组件，实现仅使用图像的预测。

Details

Motivation: 解决在胸部CT中获取专家体素级标注成本高昂的问题，利用临床常规生成的放射学报告中的实例描述作为额外监督，避免新的密集标注需求。

Result: 在ReXGroundingCT基准上，IGRA将Dice分数比最强的仅图像基线提高了22.5%（30.93 vs. 25.25），在单发现子集上与VoxTell相当（30.29 vs. 30.43）。在四个标准3D分割骨干网络上应用均提升了Dice和命中率，并在LIDC-IDRI、PleThora和私有数据集上的零样本评估中一致优于仅图像基线。

Insight: 创新点在于通过实例与报告发现的对应关系进行训练时锚定，实现了推理时无需文本输入的多类别异常分割；将自由文本定位重新表述为多标签体素分割，允许单次前向传播预测所有异常类别，提高了效率与泛化能力。

Abstract: Accurate 3D abnormality segmentation in chest CT requires dense spatial supervision, but obtaining expert voxel-level labels is costly. Radiology reports, however, are routinely generated during clinical interpretation and contain instance-specific descriptions that can provide additional guidance without new dense annotation. Existing vision-language grounding methods typically require report-derived findings at inference, making localization dependent on paired text and limiting each forward pass to a queried finding. We propose Instance-Guided Report Anchoring (IGRA), a model-agnostic module that preserves the correspondence between each annotated abnormality instance and the report finding that describes it. IGRA pools each instance representation and anchors it to the corresponding finding embedding during training; all text-related components are discarded at inference. We further reformulate free-text grounding on ReXGroundingCT as multi-label volumetric segmentation by merging same-category instances, allowing all abnormality categories to be predicted in one image-only forward pass. IGRA improves Dice by 22.5% over the strongest image-only baseline (30.93 vs. 25.25) and is comparable to VoxTell on the single-finding subset (30.29 vs. 30.43). Applied unchanged to four standard 3D segmentation backbones, IGRA improves Dice and hit rate across all architectures. Zero-shot evaluation on LIDC-IDRI, PleThora, and a private in-house dataset further shows consistent gains over image-only baselines.

Sethuraman T, Savya Khosla, Onkar Kishor Susladkar, Aditi Tiwari, Seoung Wug Oh

TL;DR: 本文提出ViTAL-X模型，通过跨模态时序编辑（XTE）自监督框架为冻结的图像-文本骨干网络注入时序感知能力，以解决视频-文本模型中的时序盲区问题。该方法在仅使用0.4B参数和1M训练片段的情况下，在六个时序基准测试中达到SOTA性能，超越了参数规模更大或数据量更多的模型。

Details

Motivation: 基于图像-文本架构（如CLIP）的视频-文本模型常存在时序盲区，无法感知顺序、方向和运动动态等基本线索，而现有数据集通过静态空间捷径掩盖了这一缺陷，因此需要系统评估并解决该问题。

Result: 在XTE-Bench诊断基准上，ViTAL-X在六个时序基准测试中实现了最先进的性能，仅用0.4B参数和1M训练片段就超越了7B参数模型以及使用600倍更多数据训练的基线模型。

Insight: 创新点在于提出跨模态时序编辑（XTE）自监督框架，通过同步视频-文本变换生成硬时序负样本，无需人工标注，从而高效地为冻结骨干网络注入时序对齐能力；这证明了针对性高质量时序对齐是比纯参数缩放更高效的替代方案。

Abstract: Video-text models adapted from image-text architectures (e.g., CLIP) frequently exhibit temporal blindness, the inability to perceive fundamental cues like order, direction, and motion dynamics. Standard datasets mask this limitation by enabling models to exploit static spatial shortcuts. To systematically evaluate this, we introduce XTE-Bench, a diagnostic probe revealing that even large-scale video-language models struggle with basic temporal reasoning, indicating that parameter scaling alone is insufficient to resolve this flaw. To address this, we propose Cross-Modal Temporal Edits (XTE), a self-supervised framework that injects precise temporal supervision. By performing synchronized video-text transformations, XTE generates hard temporal negatives without manual annotation. We instantiate this with ViTAL-X, a lightweight model that equips frozen image-text backbones with temporal awareness while preserving their foundational spatial knowledge. Across six temporal benchmarks, ViTAL-X achieves state-of-the-art performance. Utilizing only 0.4B parameters and 1M training clips, ViTAL-X outperforms 7B-parameter models and surpasses baselines trained on 600x more data. These results demonstrate that targeted, high-quality temporal alignment provides a highly efficient alternative to pure scaling.

[59] Soft-Argmax for the Projective Plane via the Veronese Embedding cs.CV | cs.LGPDF

Benjamin El-Zein, Dominik Eckert, Paul Zech, Christopher Syben, Bernhard Geiger

TL;DR: 论文提出了一种名为Veronese soft-argmax的新方法，用于在霍夫空间中连续且无歧义地提取直线参数。通过将直线参数化为单位范数齐次向量，并应用Veronese映射嵌入到对称矩阵空间，解决了传统soft-argmax在Möbius带结构上因全局线性缺失导致的几何撕裂问题。该方法在基于霍夫变换的网络中实现了对所有可解析直线的均匀、无缝恢复，并推导了与投影空间中弦距离等价的损失函数。

Details

Motivation: 传统soft-argmax方法依赖于全局线性空间，但霍夫空间H（方向-偏移对(θ,ρ)的域）双覆盖了无向直线空间H/ℤ₂（即Möbius带），导致几何上相邻的直线在参数化时被撕裂。因此，需要一种ℤ₂不变的嵌入方法，将直线映射到线性空间，使soft-argmax有意义。

Result: 在基于霍夫变换的网络中验证了Veronese soft-argmax方法，实现了对所有可解析直线的均匀、无缝恢复。该方法通过将直线嵌入到Sym²(ℝ³)空间，消除了对跖点歧义，确保了连续提取。

Insight: 创新点在于利用Veronese映射v₂(ℓ)=ℓℓᵀ将直线嵌入到对称矩阵空间，该映射满足v₂(ℓ)=v₂(-ℓ)，从而自然处理ℤ₂对称性。此外，推导出等距加权Veronese嵌入上的L₂损失等于投影空间中直线间的弦距离平方，提供了几何精确的训练目标。

Abstract: From horizon detection to fibre structures in X-ray imaging, many vision tasks recover lines via peak detection in Hough space $H=S^1\times\mathbb{R}$, the domain of orientation-offset pairs $(θ,ρ)$. Differentiable pipelines extract coordinates via \emph{soft-argmax}, a probability-weighted average that is only meaningful in a globally linear space. However, $(θ,ρ)$ and $(θ+π,-ρ)$ describe the same undirected line, so $H$ double-covers the space of undirected lines $H/\mathbb{Z}_2$: a Möbius strip, obtained by identifying each pair under $\mathbb{Z}_2$ action. Soft-argmax operates on the cover $H$, but since $H/\mathbb{Z}_2$ admits no linear structure, it tears geometrically adjacent lines apart. Thus we need a $\mathbb{Z}_2$-invariant embedding of lines into a linear space, on which soft-argmax is well-defined. We achieve this by parametrising lines via unit-norm homogeneous vectors $\ell=(1+ρ^2)^{-1/2}(\cosθ,\sinθ,-ρ)^{\top}\in\mathbb{R}^3$ and applying the Veronese map $v_2(\ell)=\ell\ell^{\top}$ that satisfies $v_2(\ell)=v_2(-\ell)$. This descends continuously to an embedding of the quotient $H/\mathbb{Z}_2$ into the linear space $\mathrm{Sym}^2(\mathbb{R}^3)$, where the antipodal ambiguity vanishes. Line extraction becomes a barycentre in $\mathrm{Sym}^2(\mathbb{R}^3)$, projected back via its leading eigenvector. We validate our \emph{Veronese soft-argmax} in a Hough transform-based network across all resolvable lines, confirming uniform and seam-free recovery. We further derive that the $L_2$-loss on isometrically weighted Veronese embeddings equals the squared chordal distance between lines in projective space, enabling a geometrically precise training objective.

[60] A Glance Is All You Need: Single-Pass Fine-Grained Image Captioning with SimLoss cs.CVPDF

Suryaansh Jain, Rahasya Barkur, Vishal G, Ryan Rossi, Franck Dernoncourt

TL;DR: 本文提出SimLoss，一种用于单次推理细粒度图像描述的无参考嵌入空间目标函数，通过对比损失在解码前提供密集视觉监督，无需人工标注或多阶段伪标注。

Details

Motivation: 现有视觉语言模型生成的描述缺乏细节属性，而多阶段系统虽能恢复细节但推理延迟高，本文旨在实现低延迟的细粒度描述。

Result: 在细粒度描述任务中，SimLoss FFT变体在精度上超过单次推理、多阶段验证等基线，F1分数接近多阶段方法，推理速度快20倍；SimLoss GRPO变体则实现最佳召回率。

Insight: 创新点在于利用嵌入空间对比损失进行预解码视觉监督，避免了多阶段流程的延迟，同时通过可微调与奖励优化两种变体平衡精度与召回。

Abstract: An image may be worth a thousand words, but most captioning models describe it in only a few. Modern vision-language models produce fluent high-level captions, yet routinely miss the attributes, counts, textures, materials, and spatial relations that make an image visually specific. Recent multi-stage systems recover some of these details through generation, decomposition, verification, and rewriting, but they do so at the expense of substantially higher inference latency. We propose SimLoss, a reference-free embedding-space objective for single-pass fine-grained image captioning. SimLoss trains a vision-language model to align its projected hidden-state representation with a frozen image embedding through an InfoNCE contrastive loss, supplying a dense visual supervision signal before any text is decoded, and requiring neither human-written fine-grained captions nor pseudo-captions from a multi-stage pipeline. We instantiate it as SimLoss FFT, which backpropagates through a locally available embedding model, and SimLoss GRPO, which treats that model as a black-box reward. Compared with single-pass, multi-stage verification, reward-optimized, and perception-aware baselines, the fully differentiable fine-tuning variant, SimLoss FFT, achieves the highest precision while nearly matching the F1 score of the multi-stage method, all while retaining single-pass inference and running roughly 20 times faster than the multi-stage pipeline. The reward-based variant SimLoss GRPO attains the strongest recall. Together, these results show that embedding-space supervision can recover the quality of multi-stage verification at the latency of a single-pass captioner.

[61] SAM3-LoRA: Parameter-Efficient Adaptation of a Concept-Promptable Foundation Model for Multi-Class Structural Defect Segmentation cs.CVPDF

P. Malaisree, S. Youwai, S. Janrungautai, D. Amorndechaphon, P. Rojanavasu

TL;DR: 该研究将低秩适应（LoRA）应用于SAM3分割基础模型，用于多类别结构缺陷分割。论文提出了一个直接从COCO风格标注中监督概念提示模型的方法，并识别和缓解了仅使用正提示导致的模型退化问题。在两个结构缺陷数据集上验证了方法的有效性，显著提升了分割性能。

Details

Motivation: 像SAM3这样的可提示分割基础模型虽然能接受开放词汇文本概念并返回匹配实例，但对其进行全参数微调以适应专业领域（如结构缺陷检测）的计算成本过高，限制了其实际应用。

Result: 在自建的隧道衬砌数据集上，像素交并比从0.017提升至0.338，实例级召回率从0.375提升至0.672；在独立的公开结构缺陷数据集上，像素交并比从0.017提升至0.855，实例级召回率从0.574提升至1.000。在十个指标上均取得了一致性提升，且在零样本能力缺失的类别上增益最大。

Insight: 方法上的创新点包括：1) 提出了一种直接使用类别名称作为提示、无需提示模板或学习类别嵌入的监督流程；2) 识别了仅使用正提示导致模型预测与文本条件解耦的失效模式，并通过提出“穷举硬负提示”策略（即对图像中不存在的所有类别发出零检测查询）来缓解该问题，且无需额外标注成本。

Abstract: Promptable segmentation foundation models such as SAM3 accept an open-vocabulary text concept and return every instance matching it, but adapting them to a specialized domain by full fine-tuning is computationally prohibitive for the organizations that would benefit most. This study applies Low-Rank Adaptation (LoRA) to SAM3 for multi-class structural defect segmentation and examines both how such a model can be supervised from conventional annotation and whether the resulting efficiency gain transfers across datasets. Two contributions are methodological. First, we describe a supervision procedure that trains a concept-promptable model directly from COCO-style class-labeled instance segmentation by using the category name itself as the prompt, requiring no prompt templates, no synonym expansion, and no learned class embeddings. Second, we identify and mitigate a failure mode specific to this setting: because a conventional annotation file yields positive prompts exclusively, the model’s presence prediction decouples from the text condition and degenerates into responding to any prompt, a collapse that is invisible to every metric computed on positive prompts alone. Exhaustive hard-negative prompting, in which every dataset category absent from an image is issued as a zero-detection query, addresses this at no annotation cost. Two adapter placements were compared under an identical protocol, updating 0.121% and 1.341% of model parameters. On a purpose-built tunnel lining dataset, pixel intersection-over-union improved from 0.017 to 0.338 and instance-level recall from 0.375 to 0.672; on the independent public Structural Defects Dataset, from 0.017 to 0.855 and from 0.574 to 1.000. Improvements were directionally consistent across ten metrics on both datasets, and the largest per-category gains occurred precisely where zero-shot competence was absent.

[62] Less Is More: Balancing Positive and Negative Space in Visual Concept Blending cs.CV | cs.HCPDF

Shishi Xiao, Adam J. Coscia, David H. Laidlaw

TL;DR: 本文提出了一种自动化的视觉概念融合方法，通过显式地利用正负空间来平衡构图，从而生成更具表现力、创意和可识别性的图像。该方法结合了视觉语言模型的语义推理与几何约束来识别概念融合区域，并采用混合像素-向量流程进行生成与优化，由一个多模态智能体作为规划器和评估器进行迭代控制。

Details

Motivation: 现有计算方法在自动进行视觉概念融合时，大多忽视了空间构图在设计中的关键作用，特别是正负空间的平衡。本文旨在填补这一空白，通过显式地应用正负空间来提升概念融合的质量。

Result: 通过与基线方法的比较和用户研究评估，该方法在表达力、创造性和概念可识别性方面表现更优，并展示了在可控图像和信息图生成等多样化应用中的泛化能力。

Insight: 创新点在于将正负空间平衡作为核心设计原则融入自动化流程，并提出了一个结合语义推理、几何约束、扩散模型修复与矢量优化的混合生成框架，由一个多模态智能体进行协调以实现可解释的迭代控制。

Abstract: Graphic designers often blend visual concepts to communicate multiple ideas within a single image, leveraging positive and negative space to create balance, emphasis, and aesthetic appeal. While computational methods have begun to support automatic concept blending, they largely overlook the role of spatial composition in the design. To address this gap, we present an automatic pipeline that explicitly applies positive and negative space throughout the blending process. Our approach first identifies plausible regions for concept integration by combining semantic reasoning from vision-language models with geometric constraints derived from real-world examples. Conditioned on these regions, the system generates blended compositions using a hybrid pixel-vector pipeline: diffusion-based inpainting produces a fast, coarse initialization, which is then refined through vector-based optimization at the point level to ensure structural coherence and balanced semantic expression. A multimodal agent orchestrates this process as a planner and evaluator, enabling iterative improvement and interpretable control. Through an evaluation using both baseline comparisons and a user study, we demonstrate greater expressiveness, creativity, and concept recognizability by effectively leveraging positive and negative space. We further demonstrate the generalizability of our approach across diverse applications, including controllable image and infographic generation.

[63] BrainDiff: Longitudinal Report Generation for Multimodal Brain MRI cs.CVPDF

Krish Patel, Peirong Liu

TL;DR: 本文提出了BrainDiff，这是首个用于脑部MRI的纵向视觉语言系统，旨在生成多时间点脑部MRI的对比报告。该系统在相同患者配对数据上超越了前沿的通用模型和单次研究神经影像模型，并在外部跨医院队列中保持了91%的内部RadGraph-XL实体+关系F1分数。

Details

Motivation: 解决当前自动化脑部MRI报告生成主要针对单次研究，而忽略了临床实践中常见的纵向对比分析需求，特别是脑部MRI的间隔变化通常细微且空间分布广泛，这一问题尚未得到解决。

Result: BrainDiff在相同患者配对数据上优于前沿通用模型和单次研究神经影像模型；在外部跨医院队列中，其RadGraph-XL实体+关系F1分数（rg_er）保持了内部性能的91%。此外，实验表明视觉贡献为+0.0387 rg_er，且在缺乏先前报告时贡献更大。

Insight: 创新点包括：1）引入了反事实目标与先前报告丢弃策略，将图像依赖性提高了约47%；2）采用分阶段课程学习；3）通过因子设计隔离了视觉贡献；4）提出了一个低成本的变更可解码性测试，显示间隔变化比单次研究病理更难解码（AUROC 0.60 vs. 0.77）。

Abstract: Neuroradiologists rarely read a brain MRI in isolation, yet automated brain-MRI report generation has been built almost entirely for single studies. Temporal analysis has been explored on chest radiography and chest CT, but to our knowledge, longitudinal reporting for brain MRI, where interval change is often subtle and spatially distributed, remains unaddressed. We present BrainDiff, the first longitudinal vision-language system for brain MRI. BrainDiff outperforms both frontier general-purpose and single-study neuroimaging models on the same patient pairs. Moreover, BrainDiff retains 91% of internal RadGraph-XL entity+relation F1 (rg_er) on an external, cross-hospital cohort. Beyond the system, we contribute three analyses. First, we identify two independent grounding levers: a counterfactual objective with prior-report dropout, which increases measured image reliance by ~47%, and a staged curriculum. Together, these interventions raise image reliance 2.5-fold from the baseline. Second, we provide a factorial over prior-report availability and image identity, isolating a visual contribution of +0.0387 rg_er, which grows when the prior report is withheld. Third, a cheap change-decodability test for candidate backbones shows that interval change is decodable far more weakly than single-study pathology (0.60 vs. 0.77 AUROC). Code is publicly available at https://github.com/jhuldr/BrainDiff.

[64] Streaming4D: Accelerate 4D World Models via Block-wise Video Generation and Incremental Reconstruction cs.CVPDF

Xiaoyan Liu, Jiaxin Liu, Kangrui Li, Sifan Zhou

TL;DR: 本文提出Streaming4D，一种用于加速4D世界模型生成的新框架。它通过将分块自回归视频生成与增量式3D重建紧密耦合，替代了传统的先视频生成、后3D重建的顺序解耦范式，从而显著降低了交互延迟，实现了合成与几何更新的并行执行。

Details

Motivation: 当前4D生成范式通常采用顺序解耦设计（先生成视频，再进行3D重建），导致较高的交互延迟，限制了在交互式实时场景中的应用。

Result: 在单个RTX 4090上的实验表明，该方法在不同分辨率下均实现了运行时的持续提升（加速比达1.24倍），同时保持了高质量的4D几何和多视图一致性。

Insight: 核心创新在于提出了一个同步流水线，将视频生成与3D重建过程紧密集成，通过分块生成和增量重建实现并行化，使世界表示能够随着视频流在线演化，在降低延迟的同时保证了几何保真度。

Abstract: Current 4D generation paradigms are often bottlenecked by a sequential decoupling design: video is generated first, followed by 3D reconstruction, leading to high interaction latency. This limits applications in interactive real-time scenarios. To this end, we propose \textbf{Streaming4D}, a tightly coupled synchronous pipeline that integrates block-wise autoregressive video generation with incremental 3D reconstruction. Unlike traditional frame-by-frame emission and delayed geometry recovery, Streaming4D generates temporal video blocks and immediately triggers reconstruction for each completed block, enabling parallel execution between synthesis and geometric updates. This approach allows the world representation to evolve online with the video stream, reducing feedback latency while preserving geometric fidelity. We instantiate \textbf{Streaming4D} using a Self-Forcing-style autoregressive generator and an incremental reconstruction backend. Experiments show consistent runtime improvements across resolutions on a single RTX 4090 (1.24$\times$ speedup), while maintaining high-quality 4D geometry and multi-view consistency.

[65] Restrict, Don’t Retrain: Inference-Time VLM Guidance for Zero-Shot Aerial Segmentation cs.CV | cs.AIPDF

Teresa DiMeola, Charles Walter, Hong Xiao

TL;DR: 本文提出了一种无需重新训练、在推理时利用视觉语言模型（VLM）进行引导的方法，以提升零样本航空图像分割的性能。该方法融合了冻结的基础模型（负责像素级标注）和VLM的两次查询（一次用于选择相关类别，一次用于定位基础模型遗漏的小物体），从而生成结构化、可审计的证据。

Details

Motivation: 全球福祉常依赖于对航空和卫星影像的正确解读，而直接应用预训练通用基础模型进行像素级分割时，往往会遗漏重要特征和小物体。本文旨在通过轻量级VLM引导来弥补这一不足，提升分割精度。

Result: 在四个航空数据集上的评估表明，该方法在基础模型能力范围内，每个阶段都带来了持续的性能提升。

Insight: 创新点在于提出了一种推理时融合冻结基础模型与VLM查询的引导框架，无需微调即可提升零样本分割效果，并生成可解释的结构化证据。这为利用轻量级VLM增强现有大模型在特定领域（如遥感）的细粒度感知能力提供了新思路。

Abstract: Global welfare often depends on the correct interpretation of aerial and satellite imagery. Acting on such imagery (mapping flooded ground, crop extent, or damaged infrastructure) demands pixel-level segmentation to ensure perfect class localization. Pretrained general foundation models, when applied directly, often miss important features and cannot always find all the classes belonging to a given scene, overlooking smaller objects that matter most. We use a single consumer-grade GPU running a vision-language model (VLM) to supply this missing guidance, improving segmentation while producing structured, auditable evidence that drives the result and can be inspected on its own. We fuse three approaches: the frozen foundation model that labels every pixel, and two queries to a VLM, one to choose the classes that matter, and one to locate the small objects the base model misses. Evaluating across four aerial datasets, we see consistent gains at each stage where the base model is competent.

[66] You Cannot Photograph the Same Street Twice: Reliability Limits in Vision-Language Measurement of Urban Change cs.CVPDF

Kaizhen Tan

TL;DR: 该论文研究了使用视觉语言模型从重复的街景图像中测量城市变化的可靠性。通过分析美国五个城市中435个谷歌街景视点的4,648对连续时期图像，研究发现，即使街道本身未经历实质性重建，重新拍摄同一街道也会导致感知评分平均变化0.80分，这相当于同一城市中两条不同街道之间差异的66.5%。尽管在单个位置层面可靠性较差，但通过聚合数据可以恢复出连贯的重建信号。

Details

Motivation: 视觉语言模型越来越多地用于从重复的街景图像中测量城市变化，但其纵向可靠性尚未得到充分理解。本研究旨在测试当街道本身未发生重大变化时，感知评分可能发生多大变化，以评估此类测量的可靠性极限。

Result: 研究发现，图像重新编码和提示顺序变化各占街道间差异的五分之一左右，而重复模型调用几乎不产生变异。在众包图像中，仅相机几何因素就导致模型在45%的相同场景对中报告物理变化；将两幅图像归一化到共同的虚拟相机可将此比率降低至7.5%。聚合分析表明，发生变化的街道被判断为更富裕、维护更好、更封闭且绿化更少。

Insight: 论文的创新点在于系统性地量化了视觉语言模型在城市变化测量中的噪声来源，揭示了图像采集条件（如相机属性）对评分的重要影响，并提出了通过图像归一化来减少虚假变化检测的方法。客观来看，该研究强调了在微观层面使用此类模型时需要谨慎，并展示了通过数据聚合可以提高可靠性，为实际应用提供了重要见解。

Abstract: Vision-language models are increasingly used to measure urban change from repeated street-level imagery, but their longitudinal reliability is not well understood. We test how much a perception score can change when the street itself does not undergo substantial redevelopment. Using 4,648 consecutive-epoch image pairs from 435 Google Street View standpoints across five US cities, we find that re-photographing the same street changes a perception score by 0.80 points on average, equivalent to 66.5% of the difference between two different streets in the same city. Repeated model calls contribute almost no variation, while image re-encoding and prompt-order changes each account for about one fifth of the between-street difference. Six image statistics describing scattering, contrast, colour, exposure, sharpness and specularity explain almost none of the remaining epoch-to-epoch variation. A small systematic drift of about 0.1 points remains and increases with the interval between captures, consistent with minor physical changes not recorded by redevelopment labels. Controlled experiments further show that acquisition conditions can shift scores when camera and image properties are allowed to vary, and that the direction of these shifts depends on the model. In crowdsourced imagery, camera geometry alone causes a model to report physical change in 45% of identical-scene pairs; normalising both images to a common virtual camera reduces this rate to 7.5%. Despite poor reliability at the individual-location level, aggregation recovers a coherent redevelopment signal: changed streets are judged wealthier, better maintained, more enclosed and less green. These results show that vision-language measurement of urban change is reliable at the scale of hundreds of paired observations, but not at the scale of individual sample points.

[67] Beyond Landmark Extraction: A Framework for Robust Geometric Feature Construction in Structured Image Classification cs.CVPDF

Saravana Mauree, Sakshi Arya

TL;DR: 本文提出了一种用于结构化图像分类的鲁棒几何特征构建框架，强调在分类器预测之前应关注特征表示本身而非仅比较分类算法。论文以静态手势识别为例，系统评估了坐标、距离、角度及混合表示等几何特征，发现混合表示通过结合互补的几何组件实现了最佳性能。

Details

Motivation: 针对结构化视觉问题（如手势识别、面部表情分类和医学图像分析），判别信息主要存在于语义部分之间的空间关系而非单个像素。现有研究过度关注分类算法比较，而忽略了特征表示本身的重要性，原始像素空间高维且对噪声敏感，地标提取虽能降维但未决定保留的信息。

Result: 通过扰动和消融实验评估，结果显示在视觉可变数据中，原始坐标特征与几何不变特征之间存在显著差距，而混合表示通过结合互补的几何组件实现了最强的整体性能。

Insight: 创新点在于将地标后特征映射作为核心分析对象，提出系统框架来构建和解释地标衍生表示，将其视为基于知识的特征降维步骤。客观分析认为，该研究将特征构建视为基本建模决策，强调了“分类器应从何种表示中学习”这一问题的重要性，为结构化视觉任务提供了可解释的几何特征设计思路。

Abstract: Much of the literature on structured image recognition has disproportionately focused on the comparison of classification algorithms. Rather than investigating which classifier performs best, this paper instead asks: what should a classifier know before it ever makes a prediction? In structured vision problems such as gesture recognition, facial expression categorization, and medical image analysis, discriminative information lies less in individual pixels and more in spatial relationships between semantic parts. Raw pixel spaces are high-dimensional, sensitive to nuisance variation, and often obfuscate the geometric structures that make visual tasks interpretable. Landmark extraction provides one form of dimension reduction, but it does not by itself determine the information preserved. This paper studies the post-landmark feature map as the central object of analysis and proposes a systematic framework for constructing and interpreting landmark-derived representations as an, informed, feature-based ``dimension reduction’’ step. Using static hand gesture recognition as a case study, we evaluate coordinate, distance, angle, and hybrid representations through perturbation and ablation experiments. The results show that visually variable data exposes substantial gaps between raw coordinate features and their geometrically invariant counterparts, while hybrid representations achieve the strongest overall performance by combining complementary geometric components. These findings frame feature construction as a fundamental modeling decision and ultimately suggests that the question of what representation should a classifier learn from is one worth asking. The code used for feature construction and evaluation is available at https://github.com/ShivMaureeCWRU/Feature_based_dimension_reduction

[68] Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioning cs.CVPDF

Zixuan Wang, Yixin Hu, Wen Li, Feng Chen, Yan Liu

TL;DR: 本文提出了一种基于视觉语义事件链的物理合理视频生成框架，通过将物理演化建模为因果连接且受物理约束的事件链，解决了现有方法因自然语言条件描述不充分而难以生成符合物理规律视频的问题。

Details

Motivation: 现有基于思维链的物理知识增强提示方法通常整体描述物理现象，忽略了中间状态和过渡动态，导致生成的视频在物理合理性上存在不足。

Result: 在PhyGenBench、VideoPhy、PhyWorldBench和Physics-IQ等基准测试上，该框架生成的视频在多个领域均表现出卓越的物理合理性。

Insight: 创新点在于将物理合理视频生成重新定义为以事件为中心的生成任务，通过物理驱动的事件链推理、过渡感知的路由关键帧条件以及物理注入的对比语义引导三个模块，实现了对物理演化过程的细粒度建模和可控生成。

Abstract: Physically Plausible Video Generation (PPVG) seeks to synthesize videos consistent with physical principles, yet remains challenging due to underspecified natural language conditioning. Advanced chain-of-thought (CoT) frameworks augment prompts with physical knowledge. However, such prompts describe physical phenomena holistically, overlooking intermediate states and transition dynamics. In this paper, we reformulate PPVG as event-centric generation by representing physical evolution as a chain of causally connected and physically constrained events. Our framework comprises three key modules: (1) Physics-driven Event Chain Reasoning. This module decomposes physical phenomena into causally connected events represented by evolving scene graphs. Formula-derived physical quantities are bound to relevant objects and interactions, characterizing the direction and magnitude of each event transition. (2) Transition-aware Routed Keyframe Conditioning. This module routes each event to a specialized keyframe synthesis operator for appearance variation or object transformation. Consecutive keyframes are injected as residual guidance during denoising, enabling smooth visual transitions between event-boundary states. (3) Physics-injected Contrastive Semantic Guidance. This module constructs physics-informed positive and counterfactual negative prompts for classifier-free guidance, steering generation toward plausible dynamics and away from physics-violating counterparts. Experiments on PhyGenBench, VideoPhy, PhyWorldBench, and Physics-IQ demonstrate that our framework generates videos with superior physical plausibility across diverse domains.

[69] Do Satellites See Commuters? A Critical Benchmark of Vision Foundation Models cs.CVPDF

Ashiq Shukoor Iqbal, Wilson Wongso, Flora D. Salim

TL;DR: 这篇论文系统性地评估了四种卫星视觉基础模型（RemoteCLIP、DINOv3、SatCLIP、AlphaEarth）在通勤起讫点（OD）生成任务中的表现。研究在一个统一的WeDAN图扩散框架下，于美国、英国及全球多个城市的数据集上进行了消融实验，揭示了不同编码器范式在分布内性能与零样本迁移能力上的差异，并指出跨大陆OD生成仍是一个未解决的开放性问题。

Details

Motivation: 卫星基础模型为生成通勤起讫点数据提供了全球可用的替代方案，但目前缺乏研究在同一下游任务流程中系统比较不同编码器范式（如语言监督、自监督、地理基础模型）的性能。

Result: 在分布内评估中，语言监督模型RemoteCLIP表现最佳（CPC 0.602）；在零样本迁移到英国地区时，地理基础模型AlphaEarth比RemoteCLIP的CPC提升了33%。然而，所有模型在迁移到全球城市时性能均大幅下降（最佳CPC仅0.122），表明跨大陆迁移能力不足。自监督模型DINOv3尽管预训练数据规模更大，但表现不佳。

Insight: 创新点在于首次在同一OD生成框架下系统比较了不同范式的卫星视觉编码器。关键发现是：语言监督特征在分布内任务中占优，而地理基础特征在零样本迁移中更鲁棒；预训练数据规模并非性能的决定因素；跨大陆迁移是当前模型的重大挑战。此外，研究澄清了人口普查噪声参数η的语义在不同评估场景下的反转现象，这对正确解读先前结果至关重要。

Abstract: Satellite foundation models offer a globally available alternative to census data for commuting origin-destination (OD) generation, yet no study has systematically compared encoder paradigms within a single downstream pipeline. We ablate four satellite vision encoders: language-supervised (RemoteCLIP), self-supervised (DINOv3), and geographically grounded (SatCLIP, AlphaEarth) within an identical WeDAN graph diffusion framework across 1,925 US counties, 325 UK districts, and 14 global cities under five random seeds. Three main findings emerge. First, language-supervised features achieve the strongest in-distribution performance (RemoteCLIP CPC 0.602), while geographically grounded encoders transfer more reliably zero-shot: AlphaEarth improves CPC by 33% over RemoteCLIP on UK districts. Second, pretraining corpus scale alone is insufficient: DINOv3, trained on a substantially larger satellite corpus, underperforms RemoteCLIP by 0.091 CPC in-distribution and collapses to CPC 0.022 globally. Third, no encoder transfers usefully to global cities (best CPC 0.122 for RemoteCLIP, 0.022 for DINOv3), confirming cross-continental OD generation remains an open problem. We additionally clarify the semantics of the census noise parameter $η$, whose ordering reverses under cross-continental evaluation, a distinction critical to correctly interpreting prior results. Training scripts and evaluation logs will be released.

[70] Teaching Vision-Language Models to Use the Scale They Are Given: Label-Free Equivariance Training for Metric Physical Reasoning cs.CVPDF

Kaizhen Tan, Yang Feng, Heqing Du, Siru Tao, Xin Xu

TL;DR: 本文发现当前视觉语言模型在回答涉及物理单位的度量问题时，未能充分利用提供的真实世界尺度信息，导致预测结果对尺度变化响应不足。作者提出了一种名为EquiSD的无标签等变性训练方法，利用物理尺度变换的对称性作为监督信号，通过微调模型来提升其度量推理能力。该方法在模拟和真实视频数据集上均显著提高了模型的度量预测准确性和尺度响应性。

Details

Motivation: 解决当前视觉语言模型在处理需要将视觉测量转换为物理单位的度量问题时，对提供的尺度信息利用不足的问题，即模型预测未能正确遵循物理尺度变换的规律。

Result: 在模拟视频上，EquiSD方法将一个30亿参数模型的尺度响应斜率中位数从0.66提升至0.94，跨尺度平均相对准确率提高了9.2个百分点。该方法学习到的关系能泛化到未见过的世界尺度，并在无需适应的情况下迁移到真实的QuantiPhy视频数据集，使准确率提高了6.4个百分点。

Insight: 创新点在于利用物理对称性（尺度等变性）作为无标签监督信号来改进模型的度量基础能力，仅需每个训练视频一次模型查询，无需真实标注答案。这为利用精确的物理约束来增强多模态模型的推理能力提供了一种有效途径。

Abstract: Metric questions about video require vision-language models to use supplied real-world references to convert visual measurements into physical units. Yet we find that current models use this scale information only partially. When every world-space quantity in a prompt is rescaled by a common factor, the video remains equally valid and the correct answer changes by exactly that factor, but model predictions move only part of the way and accuracy remains concentrated near the familiar scale of the depicted objects. Across eight vision-language models, this under-response persists over four orders of magnitude. The same models recover the correct closed-form scaling laws when the identical physics is asked in a scale-free form, indicating that the main deficit lies in metric grounding rather than physical mechanism knowledge. We use this exact scaling relation as supervision without requiring metric annotations. Under a common rescaling of the supplied world-space quantities, the correct metric answer must change by the same factor. EquiSD exploits this constraint by projecting a model’s own prediction onto the scale-equivariant family and fine-tuning the model on the resulting targets. It requires no ground-truth answers and only one model query per training video. On held-out simulated videos, EquiSD increases a 3B model’s median response slope from 0.66 to 0.94 and improves mean relative accuracy by 9.2 points across scales. The learned relation generalizes to unseen world scales and transfers without adaptation to real QuantiPhy videos, where accuracy increases by 6.4 points. These results show that an exact physical symmetry can provide label-free supervision for improving metric grounding in vision-language models.

[71] Separating perception from reasoning in vision-language models: a model-free render ceiling for crystal structures cs.CV | cond-mat.mtrl-sci | physics.chem-ph | quant-phPDF

Can Polat, Mustafa Kurban, Erchin Serpedin, Hasan Kurban

TL;DR: 本文提出了一种名为‘渲染天花板’的无模型基准测试方法，用于分离视觉语言模型中的感知与推理能力。该方法通过渲染已知物体（如晶体结构）并利用几何反演来获取图像支持的精确答案，从而为评估提供参考标准。实验在14个视觉语言模型上进行，结果表明，即使提供精确几何信息作为文本输入，多数模型的性能提升有限，而纯视觉模型在感知任务上优于所有视觉语言模型。

Details

Motivation: 现有多模态评估方法无法区分视觉语言模型是错误感知图像还是错误推理，因为现有分离方法都依赖于引入第二个模型，导致评估不纯粹。本文旨在通过无模型方法直接量化模型的感知缺陷，避免混淆感知与推理。

Result: 在2,160个渲染晶体结构上验证了渲染天花板的可靠性，证明其仅在可枚举的投影巧合下失效，且该集合为空。实验显示，提供精确几何文本仅能弥补不到一半的性能差距，而纯视觉监督模型在感知任务上达到0.8952的准确率，超越所有视觉语言模型。

Insight: 创新点在于提出了一种无模型的基准测试框架，通过几何反演和跨视图对应来分离感知与推理，为基准构建者提供了相机放置规则。该方法可推广至任何具有可逆前向渲染的基准，有助于揭示模型在提取阶段的虚构问题，避免将感知错误归因于推理缺陷。

Abstract: Multimodal evaluations cannot say whether a vision-language model misread an image or misreasoned about it, because every existing method for separating the two places a second model in the loop. We introduce the render ceiling, a model-free reference for benchmarks built by rendering known objects: inverting the frozen cameras and re-solving cross-view correspondence recovers exactly the answer the images support. We prove the ceiling fails only through an enumerable set of projection coincidences and certify that set empty on 2,160 rendered crystal structures, so every point of a model’s deficit belongs to the model. Across fourteen vision-language models, supplying exact geometry as text lifts every model yet closes under half the gap for thirteen, while a supervised vision model with no language component reads the same images at 0.8952, above every vision-language model. The instrument exposes extraction-stage fabrication that downstream accuracy would misattribute to reasoning, yields camera-placement rules for benchmark builders, and transfers to any benchmark with an invertible forward rendering.

[72] DGNet: Dual-knowledge Guided Network for Infrared Small Target Detection cs.CVPDF

Chenglong Yu, Mingzhu Xu, Jing Wang, Tongtong Wang, Pingping Miao

TL;DR: 本文提出了一种名为DGNet的双知识引导网络，用于红外小目标检测。该方法利用分别描述背景和目标的通用化文本先验，通过先验知识小波调制模块在频域解耦语义，并结合共识知识方向对齐损失构建清晰的优化轨迹，以解决现有文本引导方法中语义纠缠和部署依赖的问题。

Details

Motivation: 现有文本引导方法在红外小目标检测中存在两个关键局限：一是单一文本同时建模背景和目标导致语义纠缠，与背景抑制、目标增强的目标相矛盾；二是依赖图像特定的文本提示（推理时需要CLIP等外部模型）导致部署受限。

Result: 在三个公共数据集上的大量实验表明，DGNet取得了优越的性能，并且每个组件都被证明是有效的。

Insight: 创新点在于提出了双文本先验（分别建模背景和目标）来解耦语义，并设计了共识知识方向对齐损失来构建统一的优化方向；客观来看，将通用化文本先验与频域调制结合，避免了推理时对外部模型的依赖，是一种更实用的部署友好设计。

Abstract: InfRared Small Target Detection (IRSTD) is a prominent and challenging task in computer vision. In recent years, text-guided methods have significantly improved detection performance. However, they still suffer from two key limitations. First, a single text description simultaneously modeling both background and target leads to semantic entanglement, which contradicts the objective of background suppression and target enhancement. Second, reliance on image-specific textual prompts (requiring additional external models such as CLIP during inference) results in deployment constraints. To address these issues, we propose a novel Dual-knowledge Guided Network (DGNet) based on multiple generalizable texts. Specifically, we design a Prior-knowledge Wavelet Modulation (PWM) module, which leverages dual textual priors that separately characterize large-scale backgrounds and sparse targets to effectively disentangle and modulate entangled semantics in the frequency domain. Furthermore, we introduce a Consensus-knowledge Directional Alignment (CDA) loss, which models the initial state and the ideal target across samples as complex background' and bright target’, respectively, thereby constructing a clear and unified directional optimization trajectory for the model. Extensive experiments on three public datasets demonstrate the superior performance of DGNet and the effectiveness of each component. The source code is available at https://github.com/iLearn-Lab/MM26-DGNet.

[73] EarthLD: Towards Unified Open-World Landslide Understanding via Vision-Language Guided Diffusion Models cs.CVPDF

Yuanchao Su, Lianru Gao, Mengying Jiang, Jiangyi Chen, Jiaxin Cheng

TL;DR: 本文提出EarthLD，一种基于视觉语言引导扩散模型的开放世界滑坡理解框架，能够统一进行滑坡识别、制图和触发因素解释。该框架将滑坡理解建模为扩散过程，从噪声潜在表示中逐步推断滑坡的存在、空间范围和像素级边界，并整合视觉观测与上下文知识以区分滑坡与背景。

Details

Motivation: 滑坡形态不规则、光谱特征模糊且跨成像平台存在显著域偏移，导致遥感影像中滑坡的自动检测与制图面临挑战，需要一种统一且鲁棒的解决方案。

Result: 在不同区域、传感器和触发事件的广泛实验中，EarthLD在构建的全球尺度开放世界滑坡基准上持续优于现有滑坡检测方法，展现了其作为全球地质灾害监测和应急响应的统一解决方案的潜力。

Insight: 创新点在于将滑坡理解形式化为扩散过程，实现概率化联合识别与制图并量化预测不确定性；同时通过视觉语言引导整合上下文知识，增强了模型在开放世界场景下的区分与泛化能力。

Abstract: Landslides are widespread geological hazards, yet their automated detection and mapping in remote sensing imagery remain challenging because of their irregular morphology, ambiguous spectral signatures, and substantial domain shifts across imaging platforms. To overcome these challenges, we propose EarthLD, a vision-language-guided diffusion framework for open-world landslide understanding, enabling unified landslide recognition, mapping, and trigger interpretation. At its core, EarthLD formulates landslide understanding as a diffusion process that progressively infers the presence, spatial extent, and pixel-level boundaries of landslides from noisy latent representations. This probabilistic formulation enables the model to jointly perform image-level landslide recognition and mapping while characterizing predictive uncertainty. By integrating visual observations with contextual knowledge in the denoising process, EarthLD distinguishes diverse landslides from backgrounds, produces confidence-aware predictions for suspected regions, and maps landslide ranges. We additionally construct a global-scale open-world landslide benchmark by systematically harmonizing multiple publicly available remote sensing data collected by diverse institutions. Extensive experiments across regions, sensors, and triggering events demonstrate that EarthLD consistently outperforms existing landslide detection methods, highlighting its potential as a unified and robust solution for global geological-hazard monitoring and emergency response.

[74] Controllable Image Captioning with Prompt-Conditioned Scene Rewards cs.CV | cs.CL | cs.LGPDF

Jongyeop Hyun, Taeyoung Kim, Hyounghun Kim

TL;DR: 本文提出了一种名为FoCUS的可控图像描述生成方法，该方法通过自然语言控制提示来引导描述内容，使其能够根据用户指定的语义重点（如属性、关系或特定区域）生成图像描述。该方法基于场景图对齐的组件评分构建提示条件控制目标，并采用GRPO优化和验证机制提升可靠性。

Details

Motivation: 现有的大规模视觉语言模型生成的图像描述虽然流畅，但缺乏细粒度的语义控制能力，用户难以可靠地指定描述应强调的属性、关系或图像区域。

Result: 在两个VLM骨干网络上的实验表明，FoCUS在保持通用描述性能的同时，显著提升了可控性和细粒度描述质量，并在新提出的SCoPE基准测试中有效衡量了目标内容覆盖和范围外抑制能力。

Insight: 创新点在于利用场景图对齐的组件评分（包括负权重）构建提示条件控制目标，结合GRPO优化和基于推理的验证机制，实现了对图像描述中对象、属性及关系的精确语义控制。

Abstract: Large Vision-Language Models produce fluent image descriptions but offer limited semantic control: users cannot reliably specify whether captions should emphasize attributes, relations, or particular image regions. We present Fine-grained Captioning Control Using Scene Rewards (FoCUS), a controllable image captioning method that lets users steer captions toward specific semantic emphases through natural-language control prompts. The core idea is a prompt-conditioned control objective based on scene-graph-aligned component scores. Generated captions are parsed and aligned to scene-graph components such as objects, attributes, and relations. These components are differentially weighted, including negative weights, according to the requested emphasis. We optimize this objective with GRPO and further improve its reliability through a stricter object validity threshold and reasoning-based verification for attribute and relation scoring. To evaluate controllability, we introduce Semantic Control and Precision Evaluation (SCoPE), a benchmark with contrastive Include/Avoid constraints for measuring both target content coverage and out-of-scope suppression. Experiments on two VLM backbones show that FoCUS consistently improves controllability and fine-grained caption quality without degrading general caption performance.

[75] Solaris: Towards Interfaces That Are Generated, Not Coded cs.CV | cs.AIPDF

Yuval Alaluf, Omri Avrahami, Guy Bukchin Leshem, Michal Geyer, Kfir Goldberg

TL;DR: 本文介绍了Solaris，一种创新的界面世界模型，它通过逐帧生成交互式UI来响应用户操作，而不是依赖预先编写的代码。该系统将鼠标交互作为条件信号，以自回归方式实时合成视觉状态，并结合语言模型解释用户意图，从而动态生成界面的外观和行为。

Details

Motivation: 传统数字界面需要通过代码等中间表示预先指定外观和行为，限制了交互的开放性和灵活性。Solaris旨在探索一种新范式，使界面能够围绕用户意图持续生成和适应，而非作为预定义状态的固定集合来实现。

Result: 论文未在摘要中提供具体的定量实验结果或基准测试比较，但提到通过结合自回归帧生成、少步蒸馏和模型自身输出训练，实现了交互速度下的实时生成，并保持了长时间交互中的视觉连贯性。

Insight: 主要创新点在于提出了一个端到端的界面世界模型，将视觉生成与高层推理分离：视觉模型负责实时帧合成，语言模型则解释用户意图并指导交互影响。这为实现无需预先编程的开放式交互界面提供了新思路，可能推动软件范式向更动态、自适应的方向发展。

Abstract: Digital interfaces are traditionally implemented through intermediate representations such as code, requiring their appearance and behavior to be specified in advance. We introduce Solaris, an interface world model that instead generates an interactive UI directly, frame by frame, in response to user actions. Solaris treats mouse interactions as conditioning signals and autoregressively synthesizes the resulting visual state at interactive speeds. To enable real-time generation while maintaining visual coherence over extended interactions, we combine autoregressive frame generation with few-step distillation and training on the model’s own outputs. A language model complements the visual world model by interpreting user intent and specifying how interactions should affect the generated environment, separating high-level reasoning from visual rendering. By generating both the appearance and behavior of an interface dynamically, Solaris enables open-ended interactions that need not be explicitly programmed in advance. We view interface world models as a step toward a new paradigm for software, where interfaces are generated and adapted continuously around user intent rather than implemented as fixed collections of predefined states and

[76] Mind the Rift: Cross-Scale Coupling Mismatch for AI-Generated Video Detection cs.CV | cs.MMPDF

Siyu Li, Jin Yang, Weiheng Liang

TL;DR: 本文提出了一种名为RIFT的新颖AI生成视频检测框架，其核心思想是利用跨尺度耦合失配作为鉴伪信号。该方法通过一个宏流捕捉视频的语义动态，一个微流分析像素级残差模式，并利用耦合发散模块量化两者之间的条件依赖关系，从而有效区分AI生成视频与自然视频。

Details

Motivation: 随着AI视频生成器达到电影级真实感，可靠的检测技术对于维护数字信任至关重要。论文的动机是发现并利用自然视频与AI生成视频之间在宏观语义动态和微观像素残差模式上的固有耦合差异，这种跨尺度耦合失配是现有生成模型训练目标未明确保留的，从而成为一种新的鉴伪信号。

Result: 在两个大规模基准测试集（VidProM和GenVidBench）上，RIFT分别取得了99.33%和99.72%的F1分数，并在留一法评估中实现了97.87%的未知生成器检测率。此外，该方法表现出对编码器的强鲁棒性，更换不同规模或家族的编码器对性能影响极小。

Insight: 论文的核心创新点在于首次提出并形式化了“跨尺度耦合失配”这一鉴伪概念，并设计了一个正交的、信息论有效的框架来独立提取和量化宏微观信息流的关系。其将微分几何、持续同调等数学工具与隐写分析滤波相结合的方法，为视频鉴伪领域提供了新的、可解释的分析视角。

Abstract: As AI video generators achieve cinematic realism, reliable detection becomes essential for safeguarding digital trust. We identify cross-scale coupling mismatch as a new forensic signal, where scale refers to the level of abstraction (semantic dynamics vs. pixel-level residuals): in natural videos, macro-level temporal dynamics and micro-level residual patterns are intrinsically coupled by the unified imaging physics pipeline, whereas AI generators, whose training objectives do not explicitly preserve this joint distribution, systematically violate this coupling. Detecting such mismatch is challenging because it requires independently extracting information at both scales while simultaneously quantifying their cross-scale relationship. We propose RIFT (Representation Inconsistency Forensics on Trajectories), an orthogonal forensic framework that addresses this through three interlocking components: a macro stream that builds a dynamic baseline of expected temporal evolution via differential geometry and persistent homology on learned manifold trajectories, a micro stream that acts as a sensitive forensic probe via steganalytic filtering and temporal modeling, and a coupling divergence module that measures the conditional dependency between the two streams. Gram-Schmidt orthogonality guarantees the information-theoretic validity of this measurement. Experiments on two benchmarks (VidProM, 120K videos, 7 generators; GenVidBench, 68K videos, 4 generators) demonstrate that RIFT achieves 99.33% and 99.72% F1-score respectively, with 97.87% unseen-generator detection rate in leave-one-out evaluation, while exhibiting encoder agnosticism: scaling from ViT-S/14 (22M) to ViT-L/14 (300M) changes F1 by less than 0.1%, and switching to a different encoder family (DINOv1) reduces F1 by only 0.73 pp. Code is available at https://github.com/Litsay/RIFT

[77] Feed-Forward Multi-view Multi-person Reconstruction with Contrastive Human-Aware 3D Representation cs.CVPDF

Yuanwang Yang, Buzhen Huang, Zongxuan Ren, Jing Huang, Kun Li

TL;DR: 本文提出了一种新的自上而下范式，用于无约束环境下的多视角多人三维重建。该方法通过构建统一的、以实例为中心的人类感知三维空间，利用跨模态对比学习同时实现相机标定、跨视角关联和人体重建。最终通过前馈方式从实例级三维人体标记回归SMPL参数，恢复结构化人体模型。

Details

Motivation: 现有自底向上方法依赖精确的相机标定和显式的跨视角匹配，在严重遮挡和模糊场景下表现不佳。本文旨在解决无约束环境中鲁棒且高效的多视角多人重建难题。

Result: 大量实验表明，该方法在具有挑战性的真实场景中实现了鲁棒、准确且高效的多视角人体重建。

Insight: 创新点在于提出了一种统一的三维空间表示范式，并引入了空间对比学习策略，在三维空间内原生地进行对应关系推理、语义聚合和实例区分，从而提升了跨视角一致性和遮挡下的鲁棒性。

Abstract: Multi-view human reconstruction has been extensively studied under simplified settings, yet robust and efficient multi-person reconstruction in unconstrained environments remains challenging. Existing bottom-up methods often rely on accurate camera calibration and explicit cross-view matching, and therefore struggle with severe occlusions and ambiguities. We propose a new top-down paradigm that maintains a unified, instance-centric human-aware 3D space, enabling simultaneous camera calibration, cross-view association, and human reconstruction via cross-modal contrastive learning. Observations from multiple views are lifted and fused into this shared 3D space, where geometric structure, visual appearance, and human-centric semantic cues are jointly encoded at the instance level. We further introduce a spatial contrastive learning strategy that aligns 3D features corresponding to the same human instance across different views and modalities while separating different instances. This enables correspondence reasoning, semantic aggregation, and instance discrimination to be performed natively in 3D, improving cross-view consistency and robustness under severe occlusions. Finally, structured human body models are recovered in a feed-forward manner by regressing SMPL parameters from instance-level 3D human tokens. Extensive experiments demonstrate robust, accurate, and efficient multi-view human reconstruction in challenging real-world scenarios.

[78] Can Scene Text Recognition Read Rare Compositions? cs.CVPDF

Genpei Zhang

TL;DR: 该论文挑战了场景文本识别（STR）任务已趋于饱和的观点，通过分析发现，当测试图像根据真实单词稀有性和字符n-gram新颖性进行分层时，在稀有词与稀有三元组的组合角落，现有模型的准确率显著下降。研究指出，这种性能下降并非模型容量瓶颈所致，而是源于自回归解码器的词汇先验问题，且现有非架构性缓解措施效果有限，仅CTC解码等架构性改变能带来显著提升。

Details

Motivation: 尽管场景文本识别在标准基准测试上报告了89-97%的高准确率，并被广泛视为已饱和，但论文旨在探究模型在处理罕见单词组合（即稀有词与稀有字符n-gram的组合）时的真实性能，揭示潜在的性能瓶颈和未被充分解决的挑战。

Result: 在将测试图像按单词稀有性和字符三元组新颖性分层形成的5x5网格中，稀有词x稀有三元组角落的准确率比q3/q3中心低10-18个百分点；即使将视觉骨干模型规模扩大6倍（CLIP4STR-Base 158M -> CLIP4STR-Huge 1.0B），整体基准准确率领先但压力角落性能未变（86.9 -> 86.5）；仅从自回归解码转向CTC解码（SVTRv2）能带来显著提升（+2.5 pt, p=0.02）。

Insight: 论文的创新点在于通过分层分析揭示了场景文本识别模型在罕见组合上的系统性弱点，并定位到自回归解码器的词汇先验是主要失败原因；客观来看，其提出的评估框架（基于稀有性和新颖性的分层）为理解模型的长尾性能提供了新视角，并强调了架构变革（如CTC解码）而非单纯增加模型容量对解决此类问题的重要性。

Abstract: Scene text recognition is reported as 89–97% accurate on the six standard benchmarks, and the problem is widely treated as saturated. We present an alternative reading. When the same test images are stratified jointly by ground-truth word rarity and character n-gram novelty against a reference corpus, accuracy at the rare-word x rare-trigram corner of the resulting 5x5 grid drops 10–18 pt below the q3/q3 centre across nine English specialised recognisers, and the same direction (corner below centre) holds on all 13 of 13 (language, model) pairs we test across four writing systems (Latin, Han, Han+kana, Arabic). The drop is not a capacity bottleneck. A 6x vision-backbone scale-up (CLIP4STR-Base 158M -> CLIP4STR-Huge 1.0B, OpenCLIP ViT-H/14 LAION-2B) leads every benchmark in aggregate accuracy yet leaves the stress corner unchanged (86.9 -> 86.5, within paired-bootstrap noise). Four converging probes–layer-wise probing, confidence-when-wrong, attention re-balancing, and a cross-script commit-vs-abstain error split–localise the failure to the autoregressive decoder’s lexical prior. We then ask how much of the gap existing techniques recover. Of 16 non-architectural mitigations, the largest mean q5/q5 gain is +1.3 pt and none clears the paired-bootstrap noise floor; the only intervention that does is the architectural shift from autoregressive to CTC decoding (SVTRv2, +2.5 pt, p=0.02, n=474). A confidence-routed AR-CTC ensemble adds a directionally consistent +0.6 pt that stays within noise, and its dominant learned coefficient is each model’s own minimum-softmax confidence–independently echoing the mechanism above. No configuration we test improves both the compositional corner and aggregate accuracy. The rare-input long tail thus points to architectural change rather than added capacity.

[79] Visual Attention Faithfulness in Vision-Language Models is Heterogeneous cs.CV | cs.AIPDF

Xurui Song, Weishi Wang, Zhongqi Yue, Kuluhan Binici, Tao Bai

TL;DR: 该论文探讨了视觉语言模型中视觉注意力机制是否忠实反映模型推理过程的问题。通过因果扰动分析，研究发现视觉注意力的忠实性是异质的，表现为三种不同的处理模式：忠实-充分、忠实-分布式和非聚焦。研究还发现模型视觉依赖与人类直觉存在系统性差异。

Details

Motivation: 在NLP领域，注意力权重是否忠实反映模型推理一直存在争议，但视觉语言模型中视觉模态的这一问题尚未得到充分探索。论文旨在填补这一空白，评估视觉注意力排名的全面性和充分性差距。

Result: 分析表明，人类标注的真实区域与模型注意力排名相比，仅在约60%的情况下满足全面性。这些模式在VQAv2的通用VQA任务以及VRDU和ChartQA的文档任务中均得到验证，表明视觉注意力忠实性随处理需求和模型架构系统性变化。

Insight: 创新点在于首次系统评估了VLMs中视觉注意力的忠实性，并识别出三种异质处理模式。客观来看，该研究提供了分析注意力机制可靠性的新框架，揭示了模型内部视觉处理与人类认知之间的差异，对可解释性研究具有重要价值。

Abstract: Whether attention weights faithfully reflect model reasoning has been actively debated in NLP, yet this question remains largely unexplored for the visual modality in Vision-Language Models (VLMs). We address this gap through causal perturbation analysis on current VLMs, evaluating both the comprehensiveness and sufficiency gap of attention-ranked visual tokens. Our analysis reveals that visual attention faithfulness is heterogeneous, manifesting in three distinct processing modes: Faithful-Sufficient, where top-$k$ attention tokens are both necessary and sufficient for prediction; Faithful-Distributed, where they are necessary but broader visual context remains required; and Non-Focal, where no localized attention region is individually necessary while visual information remains an essential trigger for prediction. Furthermore, human-annotated ground-truth regions satisfy comprehensiveness in only $\sim 60$% of cases compared with model attention rankings, revealing systematic divergence between model visual reliance and human intuition. We demonstrate these patterns across both general VQA on VQAv2 and document tasks on VRDU and ChartQA, showing that visual attention faithfulness varies systematically with processing demands and model architectures rather than being uniformly faithful or unfaithful.

[80] ADGNet: Asymmetric Dual-text Guided Network for Infrared Small Target Detection cs.CV | cs.AIPDF

Tongtong Wang, Mingzhu Xu, Chenglong Yu, Jing Wang, Xiaohui Lin

TL;DR: 本文提出了一种名为ADGNet的非对称双文本引导网络，用于解决红外小目标检测（IRSTD）中仅依赖像素级信息的视觉方法难以区分目标与背景杂波的问题。该方法通过设计非对称双文本提示（ADP），结合图像无关的抽象目标提示和图像特定的详细背景提示，并利用非对称双分支交互（ADBI）模块和自适应特征聚合（AFA）模块，有效抑制背景噪声并保护小目标。实验表明，ADGNet在多个公开数据集上超越了21种最先进方法。

Details

Motivation: 当前多模态方法通常使用单一文本提示描述目标和背景，缺乏针对性的区域引导，忽略了红外语义不对称性，导致背景抑制信息不足并引入严重的特征优化冲突，使小目标被噪声淹没。

Result: 在IRSTD-1K、NUDT-SIRST和SIRST等公开数据集上进行的广泛实验显示，ADGNet超越了21种最先进（SOTA）方法，取得了优异的性能。

Insight: 创新点在于提出非对称双文本提示（ADP）来分别处理目标和背景的语义不对称性，并通过ADBI模块实现文本先验对视觉特征的分离引导，以及AFA模块的动态特征融合，这为多模态红外目标检测提供了新的思路，强调了语义不对称性建模的重要性。

Abstract: InfRared Small Target Detection (IRSTD) is a challenging task. Relying solely on pixel-level information, vision-only methods struggle to distinguish targets from clutter. Current multimodal methods typically describe both targets and backgrounds with a single textual prompt. Such an approach lacks dedicated regional guidance and ignores infrared semantic asymmetry. Consequently, it provides insufficient background suppression information and introduces severe feature optimization conflicts, overwhelming small targets with noise. To address these issues, we propose a novel Asymmetric Dual-text Guided Network (ADGNet). Specifically, accounting for the infrared semantic asymmetry, we first design the Asymmetric Dual-text Prompt (ADP), comprising an image-agnostic abstract target prompt and an image-specific detailed background prompt. To leverage these prompts, we introduce an Asymmetric Dual-Branch Interaction (ADBI) module to separately guide visual features with their respective text priors, protecting targets from noise while suppressing background clutter. Subsequently, we introduce an Adaptive Feature Aggregation (AFA) module to dynamically fuse features from the two branches. Furthermore, we construct a multimodal Asymmetric Image-Text Infrared (AITIR) dataset by providing asymmetric text annotations for three public datasets (IRSTD-1K, NUDT-SIRST, and SIRST). Extensive experiments demonstrate that ADGNet outperforms 21 state-of-the-art (SOTA) methods. Code is available at https://github.com/iLearn-Lab/MM26-ADGNet.

[81] Forbid Your Attention: Fooling Multimodal Large Language Models by Selectively Removing Intrinsic Focus in Spectral Domain cs.CVPDF

Daizong Liu, Junhao Dong, Zhiyuan Ma, Xiaoye Qu, Xiang Fang

TL;DR: 本文提出了一种针对多模态大语言模型（MLLMs）的新型对抗攻击方法，通过分析模型在频域中的内在关注点，发现其对编码结构和语义信息的相位信息特别敏感。基于此，作者设计了一个相位感知的对抗攻击框架，将扰动限制在结构相关的相位区域，并引入辅助对抗提示学习模块来误导模型注意力，从而实现高效且不易察觉的攻击。

Details

Motivation: 尽管MLLMs在感知和推理方面表现出色，但现有研究揭示其对对抗性输入（尤其是针对视觉组件的攻击）高度脆弱。现有攻击主要关注全局扰动，缺乏对MLLMs内部如何解释视觉结构的理解。本文旨在探究MLLMs在频域的内在关注机制，并基于此设计更有效的攻击。

Result: 在多个代表性MLLM模型和数据集上的广泛实验表明，该方法相比现有攻击方法具有显著优越的有效性。

Insight: 创新点在于首次从频域角度（特别是相位信息）分析MLLMs的视觉处理机制，并据此设计针对性攻击。该方法通过选择性抑制模型在关键相位区域的关注，结合对抗提示学习来放大结构误导，为理解模型脆弱性和设计防御提供了新视角。

Abstract: Multimodal large language models (MLLMs) have extended the capability of large language models (LLMs) to process more contextual multimodal information, showing remarkable progress in diverse realistic multimodal applications. Despite their strong perception and reasoning abilities, recent studies reveal that MLLMs remain highly vulnerable to adversarial inputs, especially those targeting visual components. However, existing attacks mainly focus on global perturbations, lacking an understanding of how MLLMs internally interpret visual structures. In this paper, we make the attempt to investigate the intrinsic focus of MLLMs in the frequency domain and discover that their predictions are particularly sensitive to phase information, which encodes essential structural and semantic cues. Based on this observation, we propose a novel phase-aware adversarial attack framework that explicitly restricts adversarial perturbations to structure-relevant phase regions to suppress the MLLMs’ focus for effective and imperceptible attacks. To further amplify the structural influence, we also introduce an auxiliary adversarial prompt learning module to guide multimodal misalignment around phase-sensitive regions, misleading the MLLM’s attention toward targeted structural patterns. Extensive experiments on multiple representative MLLM models and datasets demonstrate the superior effectiveness of our method compared to existing attacks.

[82] Benchmarking Vision-Language Models for Automated Pathology Diagnosis and Report Generation cs.CV | cs.AIPDF

Yumi Lee, Harim Oh, Hyoryung Kim, Minji Kim, Eunsu Kim

TL;DR: 该论文介绍了REG 2025基准测试，这是一个用于评估基于全切片图像的病理报告生成模型的新基准。它通过一个包含约10,500对WSI-报告的临床数据集和一个MICCAI挑战赛，系统分析了多种多模态模型方法。研究发现，最佳性能并非仅依赖于预训练视觉语言模型，而是得益于结构化报告表示、分层诊断分解和有效的多模态基础。

Details

Motivation: 解决计算病理学中基于全切片图像的病理报告生成任务所面临的挑战，即大规模WSI-报告数据集的稀缺性以及将空间分布的视觉模式映射到结构化临床文本的复杂性。

Result: 在REG 2025基准测试上，顶级方法的表现表明，单纯使用VLM不足以实现最优性能。最佳方法受益于结构化报告表示和分层诊断分解等策略。同时，研究也识别了模型在定量属性估计（如数字幻觉）和诊断过度具体化方面的关键局限性。

Insight: 论文的创新点在于创建了一个大规模、临床策划的Pan-Asia WSI-报告数据集和REG 2025基准，为系统评估提供了基础。客观分析表明，其核心洞察是：在计算病理学中，成功的报告生成需要超越通用VLM，结合领域特定的结构化知识表示和分层推理机制，这为设计临床基础的多模态病理模型提供了重要方向。

Abstract: The rapid advancement of vision-language models (VLMs) has accelerated progress in computational pathology; however, whole-slide image (WSI)-based pathology report generation remains limited by the scarcity of large-scale WSI–report datasets and the complexity of mapping spatially distributed visual patterns to structured clinical text. To address this, we introduce a clinically curated Pan-Asia WSI–report dataset of approximately 10,500 pairs from five institutions and establish the REG 2025 benchmark through a MICCAI challenge for systematic evaluation of multimodal models. We analyze submitted methods spanning pretrained VLMs, multiple-instance learning frameworks, hierarchical expert models, retrieval-augmented generation, and cross-modal Transformers. Rather than indicating that VLM use alone was sufficient for superior performance, the results suggest that top-performing methods benefited from structured report representations, hierarchical diagnostic decomposition, and effective multimodal grounding. We identify key limitations, including instability in quantitative attribute estimation (e.g., numeric hallucination) and a tendency toward diagnostic overspecification, with some errors resembling known diagnostic pitfalls in routine pathology. These findings establish REG 2025 as a benchmark for evaluating WSI-based structured report generation and vision-language understanding in computational pathology, providing insights for the design of clinically grounded multimodal pathology models.

[83] The Visual Insensitivity Gap: Diagnosing When Vision-Language Models Fail to Use Visual Evidence cs.CV | cs.CL | cs.LGPDF

Genpei Zhang

TL;DR: 本文揭示了视觉语言模型（VLMs）在多项感知基准测试中存在视觉不敏感现象，即模型在40%至97%的样本中未能有效利用视觉输入，即使模糊问题相关区域，其下一个词分布也几乎不变。作者提出了视觉敏感指数（VSI）来量化这一现象，并发现该现象是样本固有的，而非模型特性，且在不同模型间具有相关性。

Details

Motivation: 当前视觉语言模型的评估通常依赖于多模态基准测试的聚合准确率，这隐含假设模型使用了视觉输入，但作者发现这一假设在许多样本中并不成立，因此旨在诊断模型何时忽略视觉证据。

Result: 在六个VLMs和三个感知基准测试中，视觉不敏感现象普遍存在；线性探测显示视觉编码器能区分扰动与干净图像（准确率0.72-0.79），但模型的最大概率词仅在2%-11%的样本中改变，编码器与LLM间存在超过0.65的差距。VSI在多项选择推理任务中表现良好（AUROC=0.85-0.87），但在事实性校准任务中较弱。

Insight: 创新点在于提出了视觉敏感指数（VSI）作为样本固有的视觉忽略失败指标，揭示了视觉语言模型中视觉编码器与语言模型间的脱节现象，并指出VSI可作为条件集成组件用于诊断，而非通用的最佳弃权信号。

Abstract: Vision-language models are evaluated by aggregate accuracy on multimodal benchmarks, a practice that implicitly assumes the model uses its visual input. We show this assumption fails on 40%–97% of samples across six VLMs and three perceptual benchmarks: blurring the question-relevant visual region leaves the next-token distribution nearly unchanged. We name this phenomenon the Visual Insensitivity Gap and quantify it with a per-sample Visual Sensitivity Index (VSI). The gap is a property of samples, not of models: VSI ranks correlate across models (grand-mean Spearman rho=+0.40, permutation p<10^-3), so the same samples are flagged insensitive by VLMs sharing no architectural detail beyond a contrastively pretrained vision tower. The mechanism is concrete: on the insensitive samples, a linear probe on each model’s own vision tower distinguishes perturbed from clean images at 0.72–0.79 accuracy, yet the model’s argmax token changes on only 2%–11% of the same samples, an encoder–LLM gap above 0.65 on every model. Mapping VSI’s diagnostic utility cell by cell surfaces a strong regime (multi-choice reasoning on capable VLMs: AUROC=0.85–0.87) and a weak regime (well-calibrated factuality, where softmax confidence already leads). VSI is not a universal best abstention signal; it is a sample-intrinsic indicator of vision-ignoring failure, best used as a conditional ensemble component.

[84] HELIOS: From midnight to noon, continuous outdoor urban scene relighting cs.CVPDF

Hala Djeghim, Nathan Piasco, Luis Roldão, Moussab Bennehar, Dzmitry Tsishkou

TL;DR: 本文提出HELIOS，一种无需配对标注的真实世界图像重光照方法，通过结合反照率条件与循环一致性扩散模型，并引入基于GPS太阳角度的细粒度控制机制，实现昼夜连续、结构一致的光照编辑。

Details

Motivation: 现有驾驶图像重光照方法依赖合成数据或配对多光照监督，难以泛化到真实世界多样且挑战性的光照条件，因此需要一种无需配对标注、能处理真实场景的方法。

Result: 在夜间到白天和白天到夜间的任务中，HELIOS在广泛评估和用户研究中均优于现有先进方法，生成结构一致且逼真的结果。

Insight: 创新点包括将反照率条件集成到循环一致性扩散流程以防止身份崩溃，提出鲁棒的反照率蒸馏策略处理低可见度夜间条件，以及用GPS太阳角度替代文本提示实现连续光照控制。

Abstract: Modifying the illumination of driving images is a fundamental challenge, as most datasets are captured at specific times of day. Existing methods rely on synthetic data or paired multi-illumination supervision, which limits their generalization to the diverse and challenging conditions of real-world scenarios. To address this, we propose HELIOS, a novel image relighting approach that relies on unlabeled real-world datasets without requiring any paired images for training. Our approach integrates albedo-based conditioning into a cycle-consistent diffusion pipeline to prevent identity collapse and ensure accurate domain translation. To handle low-visibility nighttime conditions, we introduce a robust albedo distillation strategy that transfers structural stability from the daytime domain. Additionally, we replace traditional text prompts with a fine-grained control mechanism based on GPS-derived solar angles, enabling smooth and continuous lighting manipulation across the day-night cycle. Through extensive evaluation and a user study, we demonstrate that HELIOS produces structurally consistent and realistic results in both night-to-day and day-to-night tasks, outperforming state-of-the-art methods.

[85] Vision-Language-Guided Pseudo-Labels for Unsupervised Domain Adaptation in Semantic Segmentation for Waste Sorting cs.CV | cs.AI | cs.LGPDF

Udo Schlegel, Shubhangi, Gabriel Dax, Sai Rahul Kaminwar, Florian Karl

TL;DR: 本文提出了一种基于视觉-语言引导的伪标签生成管道，用于语义分割任务中的无监督域自适应，特别针对工业废品分拣等应用场景。该方法利用SAM生成类别无关的区域建议，并通过EVA-CLIP基于区域-文本相似度分配语义标签，结合置信度过滤确保伪标签可靠性，可选地使用BLIP对模糊区域进行语言验证以提升质量。

Details

Motivation: 解决应用场景（如自动驾驶、工业废品分拣）中语义分割标注数据获取成本高、难以规模化的问题，实现无需目标域标注的无监督域自适应。

Result: 在合成到真实自动驾驶和实验室到工厂废品分拣两种域偏移场景下评估，该方法持续优于仅使用源域的基线，强调了伪标签质量而非数量在域偏移自训练中的决定性作用。

Insight: 创新点在于结合视觉基础模型（SAM）和视觉-语言模型（EVA-CLIP/BLIP）进行跨模态伪标签生成，通过置信度过滤和语言验证提升伪标签质量，为部署关键应用提供了可靠的自动标注路径。

Abstract: Obtaining labeled data for semantic segmentation in applied settings (e.g., autonomous driving, industrial waste sorting) is expensive and often infeasible at scale. We present a cross-modal pseudo-labeling pipeline that enables unsupervised domain adaptation without any target-domain annotations. The pipeline is built on two core foundation models: SAM generates class-agnostic region proposals, and EVA-CLIP assigns semantic labels based on region-text similarity, with confidence filtering ensuring that only reliable pseudo-labels are used for self-training a segmentation model. As an optional extension, BLIP provides language-grounded verification for ambiguous regions, thereby improving pseudo-label quality without altering the overall pipeline. Evaluated on two domain shifts, synthetic-to-real autonomous driving and, with a primary focus, lab-to-factory industrial waste sorting, the pipeline consistently improves over source-only baselines. Our results demonstrate that pseudo-label quality, not quantity, is a decisive factor in self-training under domain shift, and that cross-modal language grounding offers a practical path to reliable automatic annotation in deployment-critical applications.

[86] A multicenter benchmark and clinically structured metric for coronary CTA report generation cs.CVPDF

Zhiyu Ye, Yue Sun, Limiao Zou, Cheng Xu, Keting Xu

TL;DR: 该论文提出了一个用于评估冠状动脉CTA（CCTA）自动报告生成的多中心基准（包含3021个系列）和一个临床结构化评估指标CSM_CCTA。该指标在解剖结构层次上比较报告，并基于专家评估加权不同临床成分，在30个病例上显示出与放射科医生评分的高度相关性（皮尔逊r=0.97）。在多中心基准测试中，CCTA专用模型C2RG表现最佳，但仍有提升空间，而通用模型生成的报告大多不相关。

Details

Motivation: 动机是解决自动CCTA报告生成领域缺乏标准化多中心基准和符合临床指南的结构化评估指标的问题，以实现更可靠、临床相关的模型评估。

Result: 提出的CSM_CCTA指标与放射科医生评分高度相关（r=0.97, p<0.001），显著优于次优指标FORTE（r=0.70）。在多中心基准中，CCTA专用模型C2RG在所有四个医院都取得了最高的CSM_CCTA分数，但性能仍远未达到最优；通用模型则产生了高达98.7%的不相关报告。

Insight: 创新点在于构建了一个大规模、多中心的标准化评估基准，并设计了一个层次化、临床结构化的评估指标CSM_CCTA，该指标能根据临床指南在患者、血管、节段级别进行细粒度比较，并通过专家评估对临床成分进行加权，从而实现了更贴近临床实践和具有解剖特异性的评估方法。

Abstract: Reliable evaluation of automated coronary computed tomography angiography (CCTA) report generation requires standardized multicentre benchmarks and clinically structured metrics. We established a four-centre benchmark comprising 3,021 CCTA series from 818 patient-report pairs to evaluate seven open-source three-dimensional vision-language models. We developed CSM${\text{CCTA}}$, a clinically structured metric for CCTA report evaluation, with patient-, vessel-, and segment-level variables defined according to clinical guidelines. Report pairs are compared at the finest shared anatomical level, and the contributions of different clinical components are weighted based on expert assessments. We estimated these weights using 70 expert-scored cases and evaluated clinical alignment in a non-overlapping set of 30 cases. CSM${\text{CCTA}}$ showed a strong correlation with radiologist scores (Pearson’s $r=0.97$, $p<0.001$), exceeding the next-best metric, FORTE ($r=0.70$), by 0.27, and agreed with expert preferences in 115 of 160 pairwise comparisons (71.9%). Under controlled perturbations, CSM${\text{CCTA}}$ remained stable to clinically equivalent wording and decreased monotonically with progressive information omission. In the multicenter benchmark, the CCTA-trained C2RG model achieved the highest CSM${\text{CCTA}}$ scores across all four hospitals, although its performance remained far from optimal. In contrast, CCTA-irrelevant reports accounted for up to 98.7% of the outputs from generalist models. Together, the benchmark provides a standardized setting for model comparison, while CSM$_{\text{CCTA}}$ enables clinically structured evaluation of finding agreement and anatomical specificity. These results support a more clinically aligned and anatomically resolved approach to evaluating CCTA report generation. Code is available at https://openi.pcl.ac.cn/OpenMedIA/CSM_CCTA.

[87] From Terminology to Diagrams: Visual-Instruction Generation for Scientific Diagram Understanding cs.CV | cs.AI | cs.CLPDF

Raul Ortega, José Manuel Gómez-Pérez

TL;DR: 本文提出了一种利用科学课程术语生成大规模图解指令数据的框架，以解决视觉语言模型在理解科学图表方面的不足。该框架通过提取领域概念、合成原子事实、检索相关图表并生成多模态监督（如图表说明和多项选择题），构建了包含超过19.4万张图表和140万条视觉指令的SciGram数据集。实验表明，基于SciGram微调的模型在多个图解基准测试（如TQA、ScienceQA和AI2D）上取得了显著提升，性能达到或超越了现有最先进的视觉语言模型。

Details

Motivation: 视觉语言模型在自然图像问答中表现良好，但在理解旨在传达功能或关系意义的科学图表时仍存在困难，因此需要专门的数据和方法来提升其科学图解理解能力。

Result: 在TQA、ScienceQA和AI2D等图解基准测试上，基于SciGram微调的模型实现了显著改进，性能达到或超越了最先进的视觉语言模型，且使用更少的训练实例；此外，将SciGram数据增强到现有模型（如LLaVA OneVision）中，在图解问答任务上建立了新的最先进性能。

Insight: 创新点在于提出了一种基于术语的指令生成通用策略，通过系统化流程从科学课程中提取概念并合成数据，有效提升了视觉语言模型在科学领域的推理能力；客观来看，该方法利用噪声网络数据和合成标注构建大规模高质量数据集，为领域特定视觉语言理解提供了可扩展的解决方案。

Abstract: Vision-language models (VLMs) have demonstrated strong performance in visual question answering with natural images. However, they continue to struggle with scientific diagrams, which are designed to convey functional or relational meaning rather than literal scenes. We therefore introduce a framework for generating large-scale diagram-grounded instruction data by leveraging terminology derived from scientific curricula. Our approach systematically extracts domain concepts, synthesizes atomic facts, retrieves relevant diagrams from the web, and generates multimodal supervision in the form of diagram captions and multiple-choice questions. Using this pipeline, we construct SciGram, a dataset of over 194K diagrams and 1.4M visual instructions across life, earth, and physical sciences. Despite relying on noisy web data and synthetic annotations, models fine-tuned on SciGram achieve substantial improvements on diagram-centric benchmarks, including TQA, ScienceQA, and AI2D, outperforming or matching state-of-the-art VLMs while using fewer training instances. Furthermore, augmenting existing models such as LLaVA OneVision with SciGram establishes new state-of-the-art performance on diagram question answering. Our results highlight the effectiveness of terminology-grounded instruction generation as a general strategy for improving vision-language reasoning in scientific domains. To support future research in scientific diagram understanding, we release both the SciGram dataset and models.

[88] Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking cs.CV | cs.AIPDF

Orcun Cetintas, Guillem Brasó, Tim Meinhardt, Laura Leal-Taixé

TL;DR: 本文提出PLANET，一种端到端的多目标跟踪器，旨在超越图像平面限制。通过将现有2D跟踪数据集提升至3D，并利用重建的3D场景几何信息构建世界锚定查询，结合辅助3D位置预测任务和双分辨率时序记忆机制，该方法在三个不同基准测试中实现了最先进的性能。

Details

Motivation: 单目视频将3D场景记录为2D图像平面投影序列，掩盖了深度和空间关系，现有多目标跟踪器主要依赖图像平面观测的外观和几何信息，继承了这些模糊性。

Result: PLANET在三个多样化基准测试中达到了最先进的性能水平。

Insight: 创新点在于将2D跟踪数据集提升至3D以构建世界锚定查询，并引入辅助3D位置预测任务和双分辨率时序记忆机制，使模型能更好地编码物体在3D空间中的位置信息。

Abstract: Monocular videos record 3D scenes as sequences of 2D image-plane projections, obscuring depth and spatial relationships. Multi-object trackers localize and associate objects primarily using appearance and geometry observed only in the image plane, inheriting these ambiguities. To address this limitation, we introduce PLANET, an end-to-end multi-object tracker designed to move beyond the image plane. As an enabling step, we lift existing 2D tracking datasets into 3D. We then form world-grounded queries by embedding reconstructed 3D scene geometry into the features and positional encodings used during query formation. An auxiliary 3D location prediction task further encourages the queries to encode object positions during training. A complementary dual-resolution temporal memory preserves this evidence across longer temporal gaps. As a result, PLANET achieves state-of-the-art performance across three diverse benchmarks.

[89] Candidate-Expanding Routing with Permutation-Stabilized Experts for Mixed-Format Medical VQA cs.CVPDF

Hai-Dang Nguyen, Huy-Hieu Pham

TL;DR: 本文提出了一种用于混合格式医学视觉问答（VQA）的候选扩展路由框架，结合了答案文本记忆、置换稳定的视觉-语言专家和稀疏候选扩展路由器，以稳定选项选择并生成机器可读的自由文本输出。

Details

Motivation: 解决混合格式医学VQA中存在的两个问题：多选题预测可能因选项符号或位置而改变，以及临床合理的开放答案可能因序列化格式错误而无法通过自动评估。

Result: 在包含1,403个病例的回顾性内部分析中，该方法将匹配二元路由器的性能从88.95%提升至91.73%（+2.78个百分点），同时开放问题路径生成了475/475个无需修复、重试或硬门失败的架构有效输出。

Insight: 主要创新点在于将专家模型的top-2预测作为可路由候选，与记忆和top-1预测并列，通过候选扩展实现可控路由增益；同时通过确定性防护确保开放答案输出的格式有效性，而非直接评估临床正确性。

Abstract: Mixed-format medical visual question answering (VQA) requires stable option selection and machine-readable free-text output. The two formats fail differently: multiple-choice predictions can change with option symbols or positions, while clinically plausible open answers can fail automated evaluation when serialization is malformed. We address both challenges with an answer-text memory, a permutation-stabilized vision–language expert, and a sparse candidate- expanding router. The cyclic schedule follows prior work; our contribution is to make expert top-2 a routable candidate alongside memory and expert top-1. On a 1,403-case retrospective internal analysis, this expansion improves a matched binary router from 88.95% to 91.73% (+2.78 percentage points; 95% CI 1.57–3.99), with 56 rescued errors and 17 regressions. Oracle coverage rises from 90.31% to 96.15%, and the final submitted configuration reaches 92.23% on the same retrospective split. For open questions, strict generation and deterministic guards produce 475/475 schema- valid participant-facing outputs without repair, retry, or hard-gate failure. Visual ablations reveal substantial textual dependence. Candidate expansion supplies the principal controlled routing gain; open-path evidence establishes output-contract validity rather than clinical correctness in medical use or deployment.

[90] Semi-Supervised Virtual Staining via Morphology Preservation and Histopathological Realism Constraints cs.CV | cs.AIPDF

Baoshun Wang, Weiping Lin, Linwu Wang, Yihuang Hu, Baptiste Magnier

TL;DR: 本文提出了一种稳定的半监督虚拟染色框架，旨在减少对严格配对和精确配准训练数据的依赖。该方法通过Hessian导数形态学保留和病理学真实性约束，从有限的配对数据和丰富的未配对源图像中联合学习，以生成高质量的目标染色病理图像。

Details

Motivation: 现有虚拟染色方法主要依赖严格配对且精确配准的训练数据，这些数据在常规实践中难以获取且成本高昂。为了降低这种依赖性，本文旨在利用有限的配对数据和大量未配对的源图像，开发一个稳定的半监督框架。

Result: 在H&E到IHC（针对Ki67和HER2）以及FFPE到H&E的染色转换任务上进行了广泛实验，结果表明该方法在图像质量、形态保留、鲁棒性和下游诊断性能方面均取得了持续改进。

Insight: 创新点在于联合使用Hessian导数形态学保留（从源图像提取结构线索以约束输出保留组织形态）和病理学真实性约束（引导输出具有合理的目标染色特征），从而抑制结构和外观漂移，稳定半监督染色转换，并促进诊断相关信息的保留。

Abstract: Virtual staining aims to computationally generate target-stained histopathological images while reducing the cost and time associated with conventional staining procedures. However, existing methods rely predominantly on strictly paired and accurately registered training data, which are difficult and expensive to obtain in routine practice. To reduce this dependence, we propose a stable semi-supervised virtual staining framework that jointly exploits both limited paired data and abundant unpaired source images. Directly incorporating unpaired images is challenging because their generated results lack corresponding targets for supervision, potentially leading to unrealistic staining, morphological degradation, or even training collapse. To obtain reliable supervision from these images, Hessian-derived morphology preservation extracts structural cues from each source image and constrains the generated output to retain tissue morphology. Histopathological realism constraints further guide the output toward plausible target-stain characteristics, preventing the source-derived structural supervision from degenerating into contour enhancement or simple color transformation. Together, the two components suppress structural and appearance drift, stabilize semi-supervised stain translation, and promote the preservation of diagnostically relevant information. Extensive experiments on H&E-to-IHC translation for Ki67 and HER2, as well as FFPE-to-H&E translation, demonstrate consistent improvements in image quality, morphology preservation, robustness, and downstream diagnostic performance. Code will be available.

[91] ReFlowSET: Representation-Aligned Latent Flow Matching for SAR-to-EO Image Translation cs.CVPDF

Jeonghyeok Do, Seungchul Lee, Munchurl Kim

TL;DR: ReFlowSET提出了一种用于SAR到EO图像转换的条件潜在流匹配框架，通过联合SAR-EO重建审计选择编码器，并训练一个较小的条件DiT模型，利用双流SAR条件化和联合特征细化，在训练中通过冻结视觉基础模型对齐中间噪声EO特征与干净目标EO表示以提供语义指导。

Details

Motivation: 现有潜在扩散方法通常继承预定的自动编码器，但不同编解码器和模态间的重建保真度差异显著，而编解码器选择影响SAR条件和EO目标的双向保留，现有方法主要依赖在自然图像上预训练的编解码器，因此需要改进。

Result: 在QXS-SAROPT和SAR2Opt数据集上的实验表明，ReFlowSET在多种感知保真度和分布指标上达到了最先进的性能。

Insight: 创新点包括通过联合SAR-EO重建审计选择编码器而非依赖预训练编解码器，训练小型条件DiT并采用双流SAR条件化与联合特征细化，以及在训练中利用冻结视觉基础模型对齐特征以提供语义指导而不增加推理成本。

Abstract: SAR-to-EO image translation aims to generate electro-optical (EO) imagery from synthetic aperture radar (SAR) observations. Existing latent diffusion approaches typically inherit a predetermined autoencoder, although reconstruction fidelity can vary substantially across codecs and modalities. Because the latent codec affects the round-trip preservation of both SAR conditions and EO targets, codec selection constitutes a fundamental design choice; nevertheless, existing methods largely rely on codecs pretrained on natural images. To remedy this, we introduce ReFlowSET, a conditional latent flow-matching framework that selects its codec through a joint SAR–EO reconstruction audit. Rather than inheriting a heavyweight pretrained generator, ReFlowSET trains a substantially smaller conditional DiT from scratch in the selected latent space, using dual-stream SAR conditioning followed by joint feature refinement. To provide semantic guidance for this from-scratch training, intermediate noisy-EO features are aligned with clean target-EO representations extracted by a frozen vision foundation model. This alignment is used only during training and introduces no additional inference cost. Experiments on QXS-SAROPT and SAR2Opt demonstrate state-of-the-art performance across diverse perceptual fidelity and distributional metrics. Code and pretrained weights are publicly available at https://github.com/KAIST-VICLab/ReFlowSET.

[92] CQF-HMR: Continuous Quaternion Flows for Probabilistic 3D Human Mesh Recovery from a Single Image cs.CVPDF

Cuong Le, Bao-Long Tran, Pavlo Melnyk, Tahereh Dehdarirad, Bastian Wandt

TL;DR: 本文提出CQF-HMR方法，使用四元数约束的连续归一化流从单张图像进行概率性3D人体网格恢复。该方法通过生成模型从先验分布中采样多个3D假设，在保持合理姿态的同时解决了深度信息丢失的问题。

Details

Motivation: 解决单图像3D人体恢复的病态问题，现有概率方法多关注3D关键点而忽略姿态合理性，SMPL-based方法因关节旋转的非可加性需要更复杂的建模。

Result: 在Human3.6M数据集上达到SOTA水平（特别是在模糊场景下），在3DPW和EMDB挑战性基准测试中取得相当的姿态估计精度。

Insight: 创新性地将四元数表示与连续归一化流结合，相比其他旋转表示方法具有显著优势；通过概率建模生成合理的人体网格，可直接用于动画等下游任务。

Abstract: Recovering 3D digital humans from a single 2D image is an ill-posed computer vision problem due to the loss of depth information. Probabilistic 3D human pose estimation compensates for this by estimating a set of 3D hypotheses from a prior distribution via generative models. However, most prior work focuses only on 3D keypoints, which often leads to implausible poses that are difficult to apply to downstream tasks, e.g. animation or digital humans. SMPL-based methods are more scalable thanks to the explicit body priors, but it requires more complex modeling of the generation process due to the non-additive nature of the joint rotations. In this work, we propose a novel approach for probabilistic 3D humans using quaternion-constrained continuous normalizing flows conditioned on 2D pose estimations. Our proposed quaternion flows show significant advantages over approaches using other rotation representations. Experiments demonstrate state-of-the-art results of our method on Human3.6M, particularly in ambiguous settings, and comparable pose estimation accuracy on challenging 3DPW and EMDB benchmarks.

[93] Does This Moment Justify the Recommendation? Counterfactual Behavior-Grounded Evidence Retrieval for Personalized Video Recommendation cs.CVPDF

Xin Liu

TL;DR: 本文研究个性化视频推荐中的反事实行为证据检索问题，提出CBGER-10K数据集和CBGER框架，将视频片段定位与个性化证据评估解耦，通过反事实监督学习提升推荐证据的可靠性。

Details

Motivation: 现有方法在视频级推荐和时序定位上表现良好，但无法判断检索到的片段是否构成针对特定用户的推荐有效证据，需要分离证据存在性（Whether）与位置（Where）的评估。

Result: 在五个个性化高亮和时序定位基线模型上，CBGER达到0.4432 MRR、0.6977配对准确率和0.6987干预一致性；相比QD-DETR，配对准确率提升11.03个百分点，MRR提升不显著。

Insight: 创新点在于引入反事实行为证据检索范式，构建可控事实-反事实对数据集，并设计解耦定位与证据估计的框架，强调在推荐中需显式评估证据存在性而不仅是定位准确性。

Abstract: Personalized video recommendation predicts user preference at the video level, while temporal video grounding localizes query-relevant moments. However, strong localization does not establish whether the retrieved moment constitutes valid evidence for recommending the video to a particular user. We study counterfactual behavior-grounded evidence retrieval, which separates where personalized evidence occurs from whether such evidence exists and evaluates whether model predictions respond consistently when that evidence is replaced. We introduce CBGER-10K, containing 5,000 controlled factual–counterfactual pairs for 3,026 users, where each pair replaces only the focal behavior-supported segment while preserving the user, temporal position, and hard distractors. We further propose CBGER, a compact framework that decouples segment-level localization from video-level evidence estimation and learns both through structured counterfactual supervision. CBGER achieves $0.4432$ MRR, $0.6977$ Pair Accuracy, and $0.6987$ Intervention Consistency across five adapted personalized-highlight and temporal-grounding baselines. Notably, compared with QD-DETR, its MRR improvement is not statistically significant, while Pair Accuracy improves by $11.03$ points. These results show that accurate temporal localization does not necessarily imply reliable personalized evidence existence, motivating explicit evaluation of Whether alongside Where.

[94] SinkPruner: Sink-Free Visual Token Pruning for Multimodal Large Language Models cs.CV | cs.AI | cs.CL | cs.LGPDF

Shiyu Li, Zi-Yuan Hu, Shijia Huang, Yanyang Li, Yiwu Zhong

TL;DR: 本文提出了SinkPruner，一种无需训练的视觉令牌剪枝框架，旨在高效减少多模态大语言模型（MLLMs）处理长视觉令牌序列时的计算开销。该方法采用由粗到细的设计，包含一个过滤高范数冗余令牌的视觉净化器和一个保留与文本查询语义对齐令牌的文本引导剪枝器。

Details

Motivation: 现有视觉令牌剪枝方法（基于视觉中心或文本引导的策略）常忽略具有异常大特征范数的高范数离群令牌，这些令牌在特征和空间维度上高度冗余，却被错误地保留为信息线索，导致剪枝决策次优。

Result: 在十二个图像-语言和四个视频-语言基准测试上的广泛实验表明，该框架在保持LLaVA-1.5（Qwen2.5-VL）原始性能96.5%（91.8%）的同时，实现了89%的令牌削减，证明了其有效性、高效性和泛化性。视觉净化器还能提升现有剪枝方法的性能，展现出良好的可迁移性。

Insight: 核心创新在于识别并过滤高范数离群令牌这一冗余源，通过视觉净化器缓解注意力汇聚和注意力分散问题，并结合文本引导进行精细剪枝，实现了无需训练的高效令牌压缩，为MLLMs的推理加速提供了新思路。

Abstract: Despite their strong multimodal understanding ability, multimodal large language models (MLLMs) incur substantial computational overhead when processing long visual token sequences. To reduce inference costs, recent studies have explored visual token pruning through vision-centric or text-guided strategies. However, these methods often overlook high-norm outlier tokens, i.e., tokens with abnormally large feature norms, leading to suboptimal pruning decisions. In this work, we show that such high-norm outlier tokens are highly redundant in both feature and spatial dimensions, yet are often mistakenly preserved as informative cues by existing methods. Motivated by this observation, we propose SinkPruner, a training-free visual token pruning framework for efficient MLLM inference. SinkPruner follows a coarse-to-fine design with two key modules: a visual sanitizer that filters high-norm redundancies and alleviates attention sink and attention dispersion, and a text-guided pruner that further retains tokens semantically aligned with the text query. Extensive experiments on twelve image-language and four video-language benchmarks demonstrate the effectiveness, efficiency, and generalizability of our framework. Notably, SinkPruner preserves 96.5% (91.8%) of the original performance of LLaVA-1.5 (Qwen2.5-VL) under an 89% token reduction. Experiments further indicate that our visual sanitizer exhibits promising transferability in enhancing the performance of existing pruning methods. Our code is available at https://github.com/LaVi-Lab/SinkPruner.

[95] ViTAMINS: An Empirical Study of Training Self-Supervised Vision Transformers with Synthetic Hard Negatives cs.CV | cs.AI | cs.LGPDF

Nikos Giakoumoglou, Andreas Floros, Kleanthis-Marios Papadopoulos, Tania Stathaki

TL;DR: ViTAMINS是一种在无监督视觉Transformer预训练中集成合成困难负样本的方法，旨在提升表征质量。该方法在ImageNet、迁移学习、图像检索、复制检测以及图像/视频分割等多个任务上进行了全面基准测试。研究发现，该方法不仅通过简单的对比学习框架修改实现了性能提升和更高的资源效率，还促使表征学习出现了涌现特性，使其超越了现有方法。

Details

Motivation: 论文旨在通过引入合成困难负样本来改进无监督视觉Transformer的预训练，以提升学习到的表征质量，并探索对比学习作为一种更简单但强大的替代方案，以挑战当前主流的生成式和自蒸馏方法。

Result: 在ImageNet等基准测试中，ViTAMINS显著提升了性能，例如在分类任务上比基线方法高出+11.3%。其ViT-B模型甚至超越了使用ViT-L的V-JEPA方法，同时在资源效率方面表现更优。

Insight: 创新点在于通过合成困难负样本的集成，使对比学习框架产生了涌现特性，即学习到的表征能显式地包含图像的语义信息并作为优秀的分类器。这为简化无监督预训练流程提供了新思路，并展示了对比学习在资源效率和性能上的潜力。

Abstract: We introduce ViTAMINS, a method that integrates synthetic hard negatives into unsupervised vision transformer pretraining to improve representation quality. Our approach is thoroughly benchmarked on ImageNet and transfer learning, image retrieval, copy detection, and image, video segmentation tasks. Notably, our proposed negatives give rise to emergent properties, where learned representations contain explicit information about the semantic content of an image and serve as excellent classifiers (up to +11.3% over baselines). ViTAMINS achieves these benefits through simple modifications to existing contrastive frameworks and outperforms competing methods while being more resource efficient, e.g., our ViT-B surpasses V-JEPA with ViT-L. Our findings motivate reconsidering contrastive learning as a simpler yet powerful alternative to dominant generative and self-distillation approaches.

[96] Fi-ImageNet-1k: An OOD Benchmark From the Inside of the ImageNet-1k Validation Set cs.CVPDF

Ruslan Rozumnyi, Matěj Suchánek, Tomáš Vojíř, Klára Janoušková, Jiří Matas

TL;DR: 本文提出了Fi-ImageNet-1k，一个从ImageNet-1k验证集内部构建的、更具挑战性的OOD检测基准数据集。该数据集利用了ImageNet-1k中存在的标注错误，通过专家和模型辅助筛选出不属于任何ImageNet-1k类别的图像。

Details

Motivation: 为了解决现有OOD检测基准数据集通常临时定义或收集、不够具有挑战性的问题，作者提出利用现有标注数据集（如ImageNet-1k）内部的标注错误，构建一个更贴近真实、更具挑战性的OOD检测基准。

Result: 在Fi-ImageNet-1k上，所有评估的分类器与OOD检测器组合在95%真阳性率下的假阳性率（FPR@95）均不低于51%，表明该数据集极具挑战性。与近期基准NINCO相比，在FPR@95指标上，该数据集对SOTA监督OOD检测方法的挑战性高出3.8倍。

Insight: 创新点在于从大规模标注数据集内部挖掘标注错误来构建OOD基准，这比外部收集的数据更具挑战性和现实意义。其构建方法结合了专家人工审核、多模态大语言模型、视觉语言模型和反向图像搜索，确保了数据质量。

Abstract: Out-of-distribution (OOD) detection predicts whether a test image belongs to none of the predefined classes. To evaluate this task, benchmarks need images from outside the in-distribution (ID) data; typically, these are defined or collected in an ad hoc fashion. Since no ground truth is perfect, ID-labeled datasets themselves contain a natural source of OOD images. We exploit such annotation errors and present Fi-ImageNet-1k, an OOD dataset built from ImageNet-1k validation images that the recent ReImageNet reannotation effort assigned to no ImageNet-1k class. Each image was examined by expert human annotators supported by evidence from MLLMs, VLMs, and reverse image search, comparing it against all visually similar ID classes. We keep only images that could be assigned a specific class outside the ImageNet-1k label space. The resulting Fi-ImageNet-1k, with 655 images from 522 classes, is substantially more challenging than any commonly used OOD dataset. No evaluated combination of classifier and OOD detector achieves a false positive rate below 51% at 95% true positive rate (FPR@95). Compared to the recent NINCO, our dataset is 3.8x more challenging in the FPR@95 metric for state-of-the-art supervised OOD detection methods.

[97] Dyn-3D: Unveiling and Resolving Ego-Motion Ambiguity in Vision-Language Models cs.CVPDF

Jiayu Ding, Zhuodong Liu, Lei Zhang, Manyu Xiong, Hongbo Jin

TL;DR: 论文提出了Dyn-3D基准和TempoVista框架，旨在解决视觉语言模型在动态3D空间推理中因运动感知模糊导致的性能退化问题。通过引入反事实3D渲染来解耦视觉变化与真实运动属性，并利用Kinematic-GSPO算法将物理真值嵌入策略优化，从而显著提升了运动估计和空间推理的鲁棒性。

Details

Motivation: 当前视觉语言模型在处理动态3D空间推理时，其自我运动感知往往过度拟合平滑轨迹先验，而非真正理解物理运动，导致在大位移场景下出现严重的空间推理退化（称为运动学崩溃）。这一问题的根源在于自然视频中的虚假视觉-运动关联以及缺乏明确的物理监督。

Result: 实验表明，所提出的TempoVista框架通过利用相机动态作为有效的几何校准信号，显著改善了运动估计和鲁棒的空间推理性能。

Insight: 论文的创新点在于引入了Dyn-3D基准，通过反事实3D渲染严格分离视觉变化与运动学属性，从而揭示了模型性能退化的根本原因；同时提出的TempoVista框架和Kinematic-GSPO算法，将度量物理真值嵌入策略优化，为视觉表示在3D空间中的显式锚定提供了新思路。

Abstract: As Vision-Language Models (VLMs) tackle dynamic 3D spatial reasoning, ego-motion perception becomes essential to resolve monocular scale ambiguity. However, current models often overfit to smooth trajectory priors rather than genuinely understanding physical motion. Consequently, their spatial reasoning degrades severely under large displacements, a phenomenon we term Kinematic Collapse. This failure stems from spurious visual-motion correlations in natural videos and a lack of explicit physical supervision. To evaluate this, we introduce Dyn-3D, a benchmark using counterfactual 3D rendering to rigorously decouple visual changes from true kinematic properties. Furthermore, we propose the TempoVista framework, featuring the Kinematic-GSPO algorithm. By embedding metric physical ground truth into policy optimization, TempoVista explicitly grounds visual representations in 3D space. Experiments demonstrate that our approach significantly improves both motion estimation and robust spatial reasoning by utilizing camera dynamics as an effective geometric calibration signal.

[98] IT-TextFusion: Iterative Text-Image Interaction with Text-Guided Residual Refinement for Degradation-Aware Image Fusion cs.CVPDF

Siyang Liu, Peiyi Zhou, Tianle Jin, Rongrong Bian, Zheke Jin

TL;DR: 本文提出了一种名为IT-TextFusion的迭代式文本引导图像融合框架，通过多阶段融合与精炼过程中的文本条件化特征交互，旨在提升对复杂退化场景的鲁棒性并充分利用文本指导。该方法整合了深层交叉注意力、多尺度交叉门控融合和阶段特定的文本条件调制，实现了全局文本嵌入对分层特征融合与残差精炼的引导。

Details

Motivation: 现有文本引导图像融合方法通常依赖浅层的语义-视觉交互和有限的注意力机制，限制了其鲁棒处理复杂退化并充分利用文本指导的能力。本文旨在解决这一问题。

Result: 在多个基准数据集上的实验表明，该方法在多项信息保留和感知质量指标上有所提升，但在某些数据集上表现出指标依赖性的权衡。

Insight: 创新点在于提出了一个迭代式融合框架，通过在多阶段（分层解码器和精炼阶段）反复注入池化的文本嵌入，实现了退化感知的全局语义条件化，同时保留了可见光和红外模态的互补信息。这通过深层交叉注意力、多尺度交叉门控融合和阶段特定调制等技术实现。

Abstract: Text-guided image fusion has recently emerged as an effective paradigm for integrating multi-modal information while enabling flexible and task-oriented fusion control. However, existing text-guided fusion methods often rely on shallow semantic-visual interaction and limited attention mechanisms, which restrict their ability to robustly handle complex degradations and fully exploit textual guidance. In this paper, we propose an iterative text-guided image fusion framework that incorporates text-conditioned feature interaction across multiple fusion and refinement stages. The proposed method integrates deepest-level Cross-Attention, multi-scale Cross-Gate Fusion, and stage-specific text-conditioned modulation, allowing the global text embedding to condition hierarchical feature fusion and residual refinement. By repeatedly injecting the pooled text embedding across hierarchical decoder and refinement stages, the proposed framework provides degradation-aware global semantic conditioning while preserving complementary information from the visible and infrared modalities. Experiments on several benchmark datasets show that the proposed method improves several information-preservation and perceptual-quality metrics, while exhibiting metric-dependent trade-offs on some datasets.

[99] On the Design Fundamentals of Pixel Text Representation Learning cs.CV | cs.CLPDF

Chaohao Yuan, Ruifeng Yuan, Zhuoxu Huang, Yu Rong, Hong Cheng

TL;DR: 本文研究了像素文本表示学习的基本设计原则，提出了四个关键组件：可变图像分辨率和渲染字体大小、自然图像-文本对、布局感知渲染以及两阶段多语言课程。基于这些原则，作者训练了Pixel Linguist II模型，该模型在英语、跨语言和多语言的视觉语义文本相似性（Visual STS）和视觉文档检索（ViDoRe）任务上取得了新的最先进（SOTA）结果，并在80%的视觉令牌压缩下保持鲁棒性。

Details

Motivation: 解决现有像素文本编码器在固定分辨率预训练、视觉捷径学习、弱视觉基础和多语言视觉文本理解方面的不足，旨在为鲁棒的视觉文本表示学习建立基础设计原则。

Result: Pixel Linguist II在英语、跨语言和多语言的Visual STS和ViDoRe基准测试中取得了新的SOTA结果，并且在80%的视觉令牌压缩下仍能保持鲁棒性，展现了在光学上下文压缩方面的潜力。

Insight: 创新点在于系统性地识别并整合了四个关键设计原则，特别是可变分辨率/字体大小作为高分辨率文档泛化的空间代理、自然图像-文本对防止文本崩溃、布局感知渲染防止像素级捷径，以及两阶段多语言课程实现有效的跨语言对齐。这些原则构成了一个可扩展的训练方案，提升了模型在多种视觉文本任务上的性能与鲁棒性。

Abstract: Text-rich visual inputs require models that can read, retrieve, and compress language directly in pixel space, yet existing pixel-text encoders struggle with fixed resolution pretraining, visual shortcut learning, weak visual grounding, and multilingual visual text understanding. In this work, we investigate the fundamental design principles required for robust visual text representation learning. Through systematic controlled ablations, we identify four critical components: variable image resolutions and rendered font sizes provide spatial proxies for high-resolution document generalization; natural image-text pairs are indispensable for grounding and prevent text-only collapse; layout-aware rendering helps prevent pixel-level shortcuts; and a two-stage multilingual curriculum enables effective cross-lingual alignment. By integrating these principles into a scalable training recipe, we train Pixel Linguist II, a native-resolution vision encoder trained with on-the-fly rendering, unified contrastive grounding, and a multilingual curriculum over 280M training examples. Pixel Linguist II sets new state-of-the-art results on English, cross-lingual, and multilingual Visual STS and ViDoRe, while also enabling better MLLM downstream evaluation. Notably, Pixel Linguist II remains robust under 80% visual token compression, showing great promise for optical context compression. Our code and resources are available at https://github.com/Pixel-Linguist/Pixel-Linguist-II.

[100] Different Changes Require Different Reasoning: Change-Type-Specialized Experts for Robust Change Captioning cs.CVPDF

Jiyoung Park, InJae Oh, Jung Uk Kim

TL;DR: 本文提出了一种名为MEDIC的新型变化描述框架，该框架通过引入变化类型感知机制，专门针对不同变化类型（如颜色变化、物体增减）设计专门的记忆专家模块，从而生成更精确且类型感知的变化描述。

Details

Motivation: 现有变化描述方法往往忽视不同变化类型在视觉线索和推理过程上的差异，导致生成的描述不够精确和鲁棒。

Result: 在多个具有挑战性的数据集上的广泛实验表明，MEDIC框架一致优于现有方法，实现了更优的性能。

Insight: 创新点在于通过变化类型感知的专门化记忆专家模块，动态检索类型相关的视觉模式，并学习每个变化类别的专用表示，从而实现对不同变化类型的针对性建模。

Abstract: Change captioning is the task of generating natural language descriptions that explain the changes between a pair of images. Although different change types (e.g., color shifts, object additions) exhibit distinct visual cues and require specialized reasoning processes, existing methods often overlook these distinctions. To address this limitation, we propose Multi-Expert Diagnosis for Image Change (MEDIC), a novel framework that introduces change-type awareness by explicitly modeling change categories. MEDIC employs type-specialized memory experts that dynamically retrieve type-relevant visual patterns conditioned on the input. This design enables each expert to capture diverse variations within its change type while focusing on the most informative visual cues. By softly routing inputs across type-specialized experts and learning dedicated representations for each change category, MEDIC generates more precise and type-aware change descriptions. Extensive experiments demonstrate that the proposed MEDIC consistently outperforms existing methods across diverse and challenging datasets. The code is available at \href{https://github.com/VisualAIKHU/MEDIC}{GitHub}.

[101] Monocular Depth Estimation from a Single Image: Progress and Opportunities cs.CVPDF

Muxin Liu, Xiaoyang Lyu, Yang-Tian Sun, Yi-Hua Huang, Ziyi Yang

TL;DR: 这篇论文是一篇关于单目深度估计领域的综述性文章，系统性地回顾了该领域从早期学习方法到当前基础模型时代的发展历程。文章涵盖了问题定义、数据集、方法演进、应用场景以及未来挑战。

Details

Motivation: 单目深度估计是计算机视觉中的一个基础且具有挑战性的问题，对3D重建、机器人、自动驾驶和增强现实等广泛应用至关重要。本文旨在梳理该领域的研究进展，特别是在基础模型兴起后的新范式，为研究人员提供全面的概览。

Result: 作为一篇综述，本文未提出新模型，因此没有具体的定量实验结果。但它对代表性模型在常用数据集（室内、室外、合成数据）上的表现进行了比较和讨论，并强调了大规模预训练（如DINOv3）和合成数据的关键作用。

Insight: 本文的核心创新在于对单目深度估计领域进行了系统性的历史梳理和范式分类，特别是将新兴的基础模型方法分为判别式和生成式两类。它清晰地指出了该领域向基础模型时代演进的关键驱动力和未来研究方向，为后续研究提供了有价值的路线图。

Abstract: Monocular depth estimation has long stood as a fundamental challenge in computer vision, enabling a wide range of applications including 3D reconstruction, robotics, autonomous driving, and augmented reality. This survey traces the field’s evolution from early learning-based methods to the emergence of transformative foundation models. We begin by framing the problem, distinguishing between relative and metric depth estimation, and highlighting the key challenges that have shaped a decade of research. We then present common problem formulations and introduce the most widely used datasets, covering indoor, outdoor, and synthetic data. Following this, we review major advances prior to the foundation model era, distilling core insights from influential methods that contributed to improvements in accuracy, efficiency, and robustness. The survey then turns to the recent surge of foundation-model-based approaches, categorizing them into discriminative and generative paradigms and emphasizing the critical roles of large-scale pretraining (e.g., DINOv3) and synthetic data. We compare representative models using both quantitative benchmarks and qualitative examples, and discuss natural extensions to video-based depth estimation. Further, to illustrate real-world impact, we highlight the integration of depth estimation into applications such as visual SLAM, content generation, and robot perception. Finally, we outline open challenges and promising research directions as the field advances further into the era of foundation models.

[102] Dotting the Eye: An Intent-Driven Image Retouching Agent for Visual Focus Enhancement cs.CVPDF

Chujie Qin, Zilong Zhang, Zewei Chang, Chunle Guo, Ruixing Wang

TL;DR: 本文提出EyeControl，一种基于多模态大语言模型（MLLM）驱动的智能体，结合扩散模型作为修图执行器，旨在通过弱用户意图（如点击或粗略涂鸦）实现视觉焦点增强的图像修图。该系统通过将用户意图与目标编辑区域及色调调整操作显式关联，并引入操作一致性约束来协调全局与局部调整，从而在提升图像视觉焦点引导的同时保持自然感。

Details

Motivation: 传统图像修图主要关注整体视觉质量提升，但实践中常需通过引导观众注意力至特定主体或区域来增强视觉焦点，这一过程需要协调全局与局部调整以操纵感知显著性并保持自然度，对专业要求高。本文旨在解决这一难题，使非专业用户能通过简单交互实现焦点导向的修图。

Result: 在提出的高质量评估数据集ControlArt-Bench上进行广泛评估，结果表明EyeControl在意图对齐和感知吸引力方面均产生出色结果，实现了更强的视觉焦点增强效果。

Insight: 创新点包括：1）将弱用户意图（点击/涂鸦）与目标编辑区域及修图操作显式链接，通过MLLM解析意图并生成结构化指导；2）在扩散修图执行器中引入伪意图图对齐注意力机制，强化对目标区域的响应；3）设计操作一致性约束以改善全局与局部调整的协调性，提升修图的自然性与连贯性。

Abstract: Image retouching is commonly formulated as enhancing overall visual quality through color adjustment, but in practice, it also serves to emphasize visual focus by guiding viewers’ attention toward a specific subject or region. Achieving such focus-oriented retouching is inherently challenging, as it requires well-coordinated global and local adjustments to manipulate perceptual saliency while maintaining visual naturalness. This intricate process typically demands substantial professional expertise. In this study, we propose EyeControl, a MLLM-driven agent with a diffusion-based retouching executor that enables visual focus enhancement under weak user intent. With only a few clicks or coarse strokes, EyeControl directs visual attention to the intended region, effectively “dotting the eye” of the image. The core idea is to explicitly link the weak user intention with the target editing region and the corresponding tonal adjustment operations during retouching. To achieve this, the system first interprets the intent and image content to infer the visual focus and generate structured intent guidance for the retouching executor. Second, the retouching executor is encouraged to respond more strongly to the target region, explicitly aligning its attention map with a designed pseudo-intent map. We also introduce an operation-consistency constraint to improve coordination between global and local adjustments, achieving more natural and coherent retouching. Additionally, we contribute ControlArt-Bench, a high-quality evaluation dataset for visual focus enhancement. Extensive evaluations demonstrate that EyeControl yields perceptually appealing results with stronger intent alignment. Code can be found in https://github.com/DragonisCV/EyeControl.

[103] Compressing AI Traffic: Standardized Neural Network Coding of Visual-Token Representations in Split Vision-Language Inference cs.CV | eess.IVPDF

Reza Heidari, Hamed R. Tavakoli, Juho Kannala

TL;DR: 本文研究了在视觉语言模型（VLM）的视觉编码器和语言解码器分离部署时，中间视觉令牌嵌入（AI流量）的压缩问题。通过插入标准化的、无需训练的ISO/IEC 15938-17神经网路编码（NNC）编解码器，对Qwen3-VL-8B-Instruct视频问答流水线中的视觉令牌表示进行压缩，并发现下游推理任务对压缩具有很高的鲁棒性。

Details

Motivation: 当VLM的视觉编码器和语言解码器运行在不同计算节点时，中间视觉令牌嵌入成为需要传输的AI流量。本文旨在探索使用标准化的、无需训练的编解码器对这种AI流量进行压缩的极限。

Result: 在Video-MME闭集问答任务中，即使传输的BF16张量大小减少了98%，准确率仍接近未压缩的参考水平，之后才急剧下降。在MLVU开集生成任务中，LLM评判也显示出类似的平台期后崩溃的曲线。

Insight: 创新点在于将标准化的NNC编解码器应用于VLM的AI流量压缩，并发现下游推理依赖于张量的粗粒度结构和相对几何关系，而非精确的浮点数值。这为AI流量编解码器的优化提供了新思路，即应进行率-任务优化而非传统的率-失真优化。

Abstract: When the visual encoder and the language decoder of a vision-language model (VLM) run on different compute nodes, the intermediate visual-token embeddings become a communicated payload rather than an internal activation. We call such machine-consumed intermediate tensors AI traffic and ask how far they can be compressed with a standardized, training-free codec. We insert ISO/IEC 15938-17 Neural Network Coding (NNC) round trips on the complete visual interface of a Qwen3-VL-8B-Instruct video question answering pipeline, comprising the main visual-token representation and the DeepStack feature streams, while leaving weights, prompts, and generation untouched, and sweep the quantization parameter (QP) over a wide rate range. Closed-ended Video-MME accuracy remains close to the uncompressed reference up to a 98% reduction of the transmitted BF16 tensor and only then collapses; open-ended MLVU generation shows the same plateau-and-collapse profile under an LLM judge. This robustness is not due to near-lossless reconstruction: the decoded tensor is heavily discretized, carries substantial row-wise relative L2 error, and has a visibly steeper singular-value decay than its source. Downstream reasoning therefore depends on coarse structure and relative geometry rather than exact floating-point values, which argues for rate-task rather than rate-distortion optimization of AI traffic codecs.

[104] S$^2$Prune: Spatially Structured Visual Token Pruning for Multimodal Large Language Models cs.CVPDF

Yuanyuan Jia, Shunpu Tang, Qianqian Yang

TL;DR: 本文提出了一种名为S^2Prune的训练无关视觉令牌剪枝方法，用于降低多模态大语言模型（MLLMs）的推理开销。该方法通过将图像划分为区域并确保每个区域至少保留一个令牌来维持空间覆盖，同时根据拉普拉斯变化将剩余令牌预算分配给结构更丰富的区域，并使用早期表示变化（ERC）在每个区域内选择代表性令牌。

Details

Motivation: 现有视觉令牌剪枝方法通常基于重要性或冗余性选择令牌，但作者观察到这些标准会产生跨输入的稳定空间偏差，且性能不一定优于简单的均匀网格采样，这凸显了广泛空间覆盖的价值。

Result: 在Qwen2.5-VL-7B-Instruct等多种设置和两种MLLM架构上的评估表明，S^2Prune在评估的训练无关剪枝方法中取得了最高的平均准确率。仅使用原始576个视觉令牌中的32个，仍能保留完整模型性能的79.3%。

Insight: 创新点在于强调并系统性地保持了空间覆盖，通过区域划分和拉普拉斯变化自适应地分配令牌密度，并结合ERC进行区域内选择。这提供了一种更平衡的剪枝策略，超越了单纯依赖重要性或冗余性的方法。

Abstract: Visual token pruning reduces the inference overhead of multimodal large language models (MLLMs) by retaining only a subset of visual tokens. Existing methods usually select tokens based on importance or redundancy. However, we observe that these criteria produce stable spatial biases across inputs and do not always outperform simple Uniform Grid sampling, highlighting the value of broad spatial coverage. Motivated by this, we propose S$^2$Prune, a training-free pruning method that preserves spatial coverage while adapting token density to local image structure. We first divide the image into regions and assign at least one token to each region to preserve coverage. The remaining token budget is then distributed according to Laplacian variation, giving more tokens to regions with richer structure. We then use Early Representation Change (ERC), computed from the first decoder block, to select representative tokens within each region. We evaluate S$^2$Prune across diverse settings and two MLLM architectures. On Qwen2.5-VL-7B-Instruct, it achieves the highest average accuracy among the evaluated training-free pruning methods. With only 32 of the original 576 visual tokens, it still retains 79.3% of the full-model performance. Code is available at https://github.com/yuanyuanjia71-spec/S2Prune.

[105] MeRoPE: Metric Rotary Position Embedding for Camera-Controlled Video Generation cs.CV | cs.ROPDF

Zhijian Qiao, Xinjiang Wang, Jiajie Chen, Haoming Huang, Meng Li

TL;DR: 本文提出了一种名为MeRoPE的度量旋转位置嵌入方法，用于相机控制视频生成任务。该方法通过正交旋转块编码校准视线的相对方向，将原始度量位移映射到多频旋转相位，并沿极线弧添加视差锚定的对应先验，从而解决了现有方案在真实世界度量相机轨迹上因尺度依赖导致的注意力对数无限增长问题。

Details

Motivation: 现有相机控制视频生成中的几何感知位置编码方案存在尺度依赖的失败模式：齐次投影编码会导致注意力对数和特征范数随物理平移基线无界增长，无法处理真实世界的度量相机轨迹。

Result: 在nuScenes（大基线轨迹）和PanShot（多样化相机光学）数据集上，MeRoPE在相机控制方面优于现有编码方案，在生成相机运动与条件姿态（旋转和平移）之间实现了最佳一致性。

Insight: 创新点在于设计了一种严格保持特征范数、无论物理平移尺度如何都能限制预softmax注意力对数、并保持对全局刚性坐标变换精确不变性的相对相机编码方案。从客观角度看，其将度量位移映射到旋转相位的多频处理以及对极几何先验的引入是解决尺度问题的关键。

Abstract: In camera-controlled video generation, geometry-aware positional encodings condition tokens on camera extrinsics and per-token viewing rays. Existing schemes, however, have a scale-dependent failure mode on real-world metric camera trajectories: homogeneous projective encodings cause attention logits and feature norms to grow unbounded with physical translation baselines. We propose MeRoPE (Metric Rotary Position Embedding), a norm-preserving relative camera encoding for attention. MeRoPE encodes relative orientations between calibrated viewing rays with orthogonal rotation blocks, maps raw metric displacements into multi-frequency rotary phases, and adds a disparity-anchored correspondence prior along the epipolar arc. This design strictly preserves feature norms, bounds pre-softmax attention logits regardless of the physical translation scale, and maintains exact invariance to global rigid coordinate changes. Across nuScenes and PanShot, which cover large-baseline trajectories and diverse camera optics, respectively, MeRoPE achieves stronger camera control than prior encodings, with the best consistency between generated camera motion and conditioning poses in both rotation and translation. Code will be made publicly available.

[106] HiLRP: Toward One Trustworthy Explanation for Vision Transformer: Conservation-Valid Attribution via Attention Primitives cs.CV | cs.AIPDF

Sathiyamohan Nishankar, Pubudu Sanjeewani, Asanka Perera, Selvarajah Thuseethan

TL;DR: 本文提出了HiLRP，一种针对多样化Vision Transformer（ViT）架构的统一归因解释框架。该方法通过将ViT中的注意力与分辨率降低操作分解为四种基本操作类型（线性映射、双线性混合、归一化/门控、重索引），并为每种操作设计满足守恒性的相关性传递规则，从而实现对不同ViT变体（如窗口注意力、空间缩减、多轴注意力、线性注意力模型）的可靠解释。

Details

Motivation: 现有归因方法（如Grad-CAM、注意力滚降、LRP）的假设（如需要终端空间特征图、全局softmax注意力、模块特定规则）无法统一适用于日益多样化的ViT架构变体，缺乏一个跨架构的统一解释框架。

Result: 在14种归因方法和10种ViT架构上的评估表明，先前方法在ViT家族中均不可靠，而HiLRP是唯一能在窗口注意力、空间缩减、多轴注意力和线性注意力模型中保持守恒性的方法。在EfficientViT上，HiLRP的Pointing指标达到0.97，显著优于竞争方法的0.55。

Insight: 核心创新在于将复杂的ViT操作抽象为四种可组合的“注意力原语”，并为每种原语设计满足守恒性的通用相关性传递规则，从而构建了一个无需针对特定架构推导的、可证明守恒且具有条件等变性的统一归因框架，解决了现有方法假设不匹配的问题。

Abstract: Vision Transformer (ViT) design has become increasingly diverse, with backbones combining convolutional stems, windowed, linear, or multi-axis attention, patch merging, and spatial reduction in various configurations. This diversity poses challenges for existing attribution methods, whose assumptions often do not hold across ViT variants: Grad-CAM requires a terminal spatial feature map, attention rollout assumes global softmax attention, and layer-wise relevance propagation (LRP) requires module-specific rules. To the best of our knowledge, no existing method provides a unified attribution framework across this architectural space. We show that this architectural diversity can be captured by a simpler underlying structure. The attention and resolution-reduction operators in current ViTs can be decomposed into four operation types: linear maps, bilinear mixing, normalization or gating, and reindexing. Each operation admits a relevance rule that satisfies conservation. Based on these rules, HiLRP supports new backbones by construction rather than by architecture-specific derivation, and its attribution maps decompose the prediction rather than relying on heuristic assumptions. We prove conservation and conditional equivariance and verify both to machine precision. Across 14 attribution methods and 10 architectures, we find that no prior method remains reliable across ViT families, while Faithfulness Correlation becomes uninformative for backbones robust to spatial masking. HiLRP alone preserves conservation across windowed, spatial-reduction, multi-axis, and linear-attention models, where naive extensions can produce zero or inflated relevance. It also localizes attribution failures in class activation mapping, achieving 0.97 Pointing compared with 0.55 for competing methods on EfficientViT.

[107] CMRVision: A Foundation Model for Cardiac MR Image Analysis cs.CVPDF

Athira J. Jacob, Puneet Sharma, Daniel Rueckert

TL;DR: 本文提出了CMRVision，一个针对心脏磁共振（CMR）图像分析的基础模型。该模型采用DINOv3风格的自监督学习方法，在一个包含3600万张多中心、多序列CMR图像的数据集上进行预训练。论文系统评估了模型架构和训练设计选择，并在多任务分割（如左心室、心肌、右心室等结构的分割）和电影序列视图分类两个下游任务上验证了其性能。

Details

Motivation: 心脏磁共振成像能提供多序列、多视角的心脏解剖、功能和组织特征信息，但目前缺乏专门针对CMR领域的大规模预训练基础模型。本文旨在通过构建一个CMR专用的基础模型，提升心脏MRI分析的鲁棒性和泛化能力。

Result: 在多任务分割基准测试中，CMRVision取得了最强的综合性能，超越了先前的自然图像、医学图像、有监督以及CMR基础模型基线。具体Dice分数范围：左心室0.940-0.967，心肌0.855-0.905，右心室0.929，左心房0.920，右心房0.931。在未见过的LGE长轴视图零样本分割任务中，平均Dice为0.692。在电影序列视图分类任务中，CMRVision取得了最高的平均准确率0.906。

Insight: 论文的创新点在于构建了首个大规模、CMR专用的自监督基础模型。关键设计选择包括：领域特定的预训练、使用更小的图像块尺寸以及采用块级学习目标，这些都被证明能持续提升下游任务性能，并展现出良好的跨视图泛化能力。

Abstract: Cardiac magnetic resonance (CMR) imaging provides complementary information on cardiac anatomy, function, and tissue characterization across multiple sequences and views. In this work, we investigate foundation model pretraining for 2D CMR and introduce CMRVision, a CMR-specific foundation model trained using DINOv3-style self-supervised learning on a multi-center, multi-sequence cohort of 36 million CMR images. We systematically evaluate architectural and training design choices for domain-specific pretraining. CMRVision is evaluated on two downstream tasks: multi-task segmentation across cine, late gadolinium enhancement (LGE), and mapping sequences, and cine view classification. Our experiments show that CMR-specific pretraining, smaller patch sizes, and patch-level objectives consistently improve downstream performance. Across a multi-task segmentation benchmark, CMRVision achieved the strongest overall performance, outperforming prior natural-image (NI), medical-image, supervised, and CMR foundation model baselines. Improvements were modest but consistent across structures and sequences, with Dice scores ranging from 0.940-0.967 for LV and 0.855-0.905 for myocardium, and reaching 0.929 for RV, 0.920 for LA, and 0.931 for RA. The largest gains were observed for myocardium segmentation in LGE and mapping images. In a zero-shot segmentation task on unseen LGE long-axis views, the model achieved an average Dice score of 0.692, demonstrating cross-view generalization. For cine view classification, CMRVision achieved the highest average accuracy (0.906), compared to prior methods reported in the literature. These results highlight the potential of CMRVision to support robust and generalizable cardiac MRI analysis across multiple sequences and views.

[108] Seeing the World and the Self from Egocentric Video cs.CVPDF

Kai Guan, Minchao Jiang, Ruichen WangLi, Wentao Zhu, Lei Zhang

TL;DR: 本文提出了RESELF，一个从第一人称（egocentric）视频中联合恢复周围场景三维几何与穿戴者全身运动的统一框架。它通过几何基础模型进行确定性场景重建，并利用扩散模型生成几何条件约束下的运动，最后通过运动学反馈阶段进行细化。

Details

Motivation: 现有方法通常将场景重建与人体运动估计分开处理，前者忽略穿戴者，后者缺乏显式场景几何且依赖外部轨迹。两者存在非对称可见性与不同预测范式（确定性回归 vs. 生成式推理）的挑战，需要统一的解决方案。

Result: 在从EgoExo4D构建的EE4D-JSM数据集上，RESELF在深度估计、相机跟踪和全身运动估计任务上均优于为单个任务设计的现有最先进方法。

Insight: 核心创新在于将确定性几何重建与几何条件扩散生成模型耦合，以解决场景与人体任务的不对称性；并利用在大规模第三人称数据预训练的几何基础模型，通过尺度与相对位姿一致性目标适应第一人称视频，实现了跨视角的知识迁移。

Abstract: Complete 3D perception from egocentric video requires recovering the surrounding scene and the wearer’s full-body motion in a shared metric frame. Existing methods typically address scene reconstruction and motion estimation separately: scene reconstruction methods ignore the wearer, whereas motion estimation methods lack explicit scene geometry and often depend on external trajectories. Joint recovery is challenging because the two tasks exhibit asymmetric visibility and require different prediction paradigms. The largely visible scene supports deterministic geometric regression, whereas the severely occluded body requires generative motion inference. We therefore propose RESELF (REconstructing the Scene and the sELF), a unified framework that couples deterministic metric geometry reconstruction with geometry-conditioned motion generation. RESELF adapts a geometry foundation model pre-trained on large-scale exocentric data to egocentric video using frame-wise scale and relative-pose consistency objectives. The resulting camera trajectory and latent geometric features condition a diffusion model that recovers the wearer’s motion. A subsequent closed-loop kinematic feedback stage further refines the camera head while preserving the reconstructed scene geometry. To support training and evaluation, we curate EE4D-JSM from EgoExo4D by aligning egocentric video, sparse metric scene geometry, camera trajectories, and full-body motion annotations. Experiments show that RESELF outperforms state-of-the-art methods designed for the individual tasks across depth estimation, camera tracking, and full-body motion estimation. Code, models, and datasets will be available at https://ka1guan.github.io/RESELF/.

[109] Reliability Challenges in Diffusion Vision-Language Models cs.CV | cs.CLPDF

Md. Atabuzzaman, Chris Thomas

TL;DR: 本文首次对基于扩散的大视觉语言模型（dLVLMs）的可靠性进行了系统性评估，重点关注幻觉和偏见问题。研究发现，dLVLMs在二元视觉查询中逆转了自回归模型的“是”偏好，在幻觉率上表现相当但语言质量下降，在少数族裔群体上准确率崩溃并表现出相反的性别偏见，且在多项选择题中受答案长度先验影响严重。

Details

Motivation: 扩散大视觉语言模型作为自回归模型的有前景替代方案，其并行解码等优势已获认可，但其可靠性特性（如幻觉和偏见）尚未得到系统研究。

Result: 在四个维度的基准测试中，评估了六个扩散模型与竞争性自回归基线。关键定量结果包括：在二元查询中逆转“是”偏见；幻觉率具有竞争力但语言质量退化；在代表性不足的种族群体上准确率接近零且存在相反极性的性别偏见；在多项选择题中，当正确答案比干扰项短时出现准确率崩溃。

Insight: 创新点在于首次系统评估了dLVLMs的可靠性，并揭示了其独特的机制信号（如去噪早期步骤产生的长度先验，以及低置信度的晚期去噪步骤与幻觉内容相关）。客观来看，研究强调了生成范式与训练数据共同塑造模型可靠性，为理解和改进扩散模型的可靠性提供了新视角。

Abstract: Diffusion-based Large Vision-Language Models (dLVLMs) have recently emerged as a compelling alternative to autoregressive (AR) LVLMs, offering advantages in parallel decoding, bidirectional context, and controllable generation. Despite rapid progress, their reliability properties remain largely uncharacterized. We present the first systematic reliability evaluation of hallucination and bias in dLVLMs, benchmarking six diffusion models against competitive AR baselines across four dimensions. Our key findings are: (1) dLVLMs reverse the yes-bias of AR models in binary visual queries; (2) they achieve competitive hallucination rates yet exhibit degraded linguistic quality; (3) they collapse to near-zero accuracy on underrepresented racial groups with opposite-polarity gender bias; and (4) they exhibit accuracy collapse in multiple-choice settings when the correct option is shorter than its distractors, associated with a length prior that emerges at the first denoising step. Tokens committed at late denoising steps with low confidence further correlate with hallucinated content, pointing to a mechanistic signal unique to diffusion generation. These patterns vary across model families, suggesting reliability is shaped by the generative paradigm together with training data.

[110] Agentic Multimodal Models for Environmental Hyperspectral Unmixing cs.CVPDF

Michał Cholewa, Luca Ciampi, Nicola Messina, Przemysław Głomb, Giuseppe Amato

TL;DR: 本文提出了一种基于大型视觉语言模型（LVLM）的智能体框架，用于改进高光谱解混任务中传统模块化流程的输出结果。该框架通过迭代调用光谱库检索和丰度图可视化等工具，结合光谱与空间证据，对初始解混结果中的端元集合进行合并与剔除操作，从而优化端元数量和分解质量。

Details

Motivation: 传统模块化高光谱解混方法通常包含模型阶数估计、端元提取和丰度估计等多个串行阶段，各阶段的误差累积可能导致冗余或模糊的候选组分，最终影响分解结果的准确性。本文旨在利用LVLM智能体的推理与工具调用能力，对现有数值算法的输出进行后处理优化，而非直接替换底层算法。

Result: 在HYDICE Urban、Jasper Ridge和Stonewall Playa等数据集上的实验表明，该智能体框架能一致地改善端元数量估计，并在多种异构模块化流程中普遍提升了恢复的光谱特征和丰度图质量。同时，其性能与CNN-AE、uDAS和R-CoNMF等端到端集成方法具有竞争力。

Insight: 创新点在于提出了一个算法无关的、由LVLM驱动的智能体框架，能够迭代整合光谱与空间证据来优化物理基础的高光谱解混结果。这展示了工具使用型LVLM智能体在结合多模态信息、对现有数值算法输出进行通用性后处理精炼方面的潜力。

Abstract: Hyperspectral unmixing is a key task in remote sensing that aims to decompose mixed pixels in hyperspectral images into their constituent material signatures, or endmembers, and their fractional abundances. Conventional modular approaches estimate the scene composition through successive model-order estimation, endmember extraction, and abundance estimation stages, whose errors can lead to redundant or ambiguous candidate components and ultimately affect the recovered decomposition. We introduce an algorithm-agnostic, large vision-language model (LVLM)-driven agentic framework that refines the outputs of such pipelines rather than replacing their underlying numerical algorithms. Starting from an initial decomposition, the agent iteratively gathers complementary spectral and spatial evidence through dedicated tools, including spectral-library retrieval and abundance-map visualization, and modifies the active endmember set through merge and discard operations followed by abundance re-estimation. We apply the same refinement procedure to several modular pipelines combining different model-order, extraction, and abundance-estimation methods, and evaluate it on HYDICE Urban, Jasper Ridge, and Stonewall Playa. Experiments show that the proposed agent consistently improves endmember cardinality and generally improves the recovered spectral signatures and abundance maps across heterogeneous modular pipelines, while remaining competitive with integrated end-to-end unmixing methods, including CNN-AE, uDAS, and R-CoNMF. These results highlight the potential of tool-using LVLM agents to combine spectral and spatial evidence for algorithm-agnostic refinement of physically grounded hyperspectral unmixing decompositions. Code is publicly available at https://anonymous.4open.science/r/agentic-hu.

[111] ExBind: A Controlled Diagnostic Benchmark for Visual-to-Executable Correspondence cs.CVPDF

Ziqian Wang, Yuxiao Cheng, Tingxiong Xiao, Jinli Suo

TL;DR: ExBind是一个用于诊断视觉到可执行对象对应关系的受控基准测试，它通过采样独立于表示的潜在绑定实例，并将其编译为SVG、DOM、canvas、树、图和表格等场景，以评估模型在将视觉或语义指称映射到精确可执行对象时的准确性。

Details

Motivation: 为了解决多模态编码和编辑系统中，错误的引用可能导致选择有效但不正确的可执行对象（如DOM节点、SVG元素等），而仅靠最终执行成功无法揭示失败根源的问题。

Result: 在ExBind基准测试中，Qwen2.5-VL-3B模型实现了98.4%的候选有效性但仅有76.4%的精确准确率，而Qwen3-VL-4B模型达到了100%的有效性和98.8%的精确准确率；在目标表格测试集中，Qwen2.5-VL-3B的所有残余错误都是有效但选错列的行选择。

Insight: 创新点在于将视觉到可执行的对应关系层独立出来作为诊断基准，通过潜在绑定实例和确定性映射来评估模型的结构约束能力，而不依赖推理轨迹，这有助于系统性地分析多模态模型在细粒度引用任务中的失败模式。

Abstract: Multimodal coding and editing systems must map a visible or semantic referent to the exact executable object that can be edited. A wrong reference may select a valid but incorrect DOM node, SVG element, graph endpoint, hierarchy member, or table cell, while final execution success alone does not reveal the source of the failure. ExBind isolates this visual-to-executable correspondence layer as a controlled diagnostic benchmark between semantic localization and action execution. It samples representation-independent latent binding instances and compiles them into SVG, DOM, canvas, tree, graph, and table cases with deterministic mappings to executable references. Models output only a strict reference; the evaluator maps predictions back to latent structure and scores structural constraints without requiring reasoning traces. The release contains a 250-case broad suite, a disjoint 240-case targeted suite, and 50 paired latent groups. Qwen2.5-VL-3B achieves 98.4% candidate validity but 76.4% exact accuracy, while Qwen3-VL-4B achieves 100.0% validity and 98.8% exact accuracy. In the targeted table suite, all Qwen2.5-VL-3B residual errors are valid correct-row/wrong-column selections. Candidate-order perturbations change case-level outcomes while preserving this error pattern. ExBind is designed for controlled diagnosis rather than population-scale ranking or end-to-end editing evaluation. Code and benchmark records are available at https://github.com/Daerwang2020/Exbind and https://huggingface.co/datasets/Ziqianwwww/ExBind.

[112] Multimodal RGB-Infrared Combination for UAV-Based Wildfire Segmentation: A Comparative Study on FLAME3 cs.CVPDF

Matheus F. Kovaleski, Luís Garrote, Cristiano Premebida, Jérôme Mendes, João Ruivo Paulo

TL;DR: 本研究在FLAME3数据集上，针对无人机（UAV）野火分割任务，系统比较了RGB图像、红外图像以及三种代表性融合策略（包括早期、中期和晚期融合）在U-Net、DeepLabV3+和SegFormer三种分割架构上的性能。

Details

Motivation: 旨在分析RGB和红外两种模态各自对分割任务的贡献，评估不同融合时机（早期、中期、晚期）的影响，并探究不同网络架构如何利用多模态信息进行无人机野火轮廓划分。

Result: 实验结果表明，热红外信息在无人机野火分割中起主导作用。在特征层级进行多模态融合，并结合基于Transformer的架构（如SegFormer），为未来研究提供了最有前景的方向。

Insight: 创新点在于对多模态融合策略和网络架构进行了系统性比较研究。客观来看，其核心洞察是明确了热红外模态的关键作用，并指出“特征级融合+Transformer架构”是提升无人机野火分割性能的有效组合，为后续研究提供了清晰的优化路径。

Abstract: Unmanned Aerial Vehicles (UAVs) have emerged as a promising platform for firefighting operations due to their flexibility, low operational cost, and ability to acquire high-resolution imagery in locations that may be difficult or dangerous to access using conventional methods. Recent advances in deep learning have significantly improved the capabilities of UAV-based wildfire monitoring systems. The present work investigates RGB-infrared fusion for binary wildfire segmentation on the FLAME3 dataset. In this Study, RGB and Infrared baselines are compared with three representative fusion strategies across three segmentation architectures, including U-Net, DeepLabV3+, and SegFormer. The key motivation of this work is to analyze the contribution of each modality, evaluate the impact of fusion timing, and examine how different network architectures exploit multimodal information for UAV wildfire delineation. The findings indicate that thermal information plays a dominant role in UAV segmentation and that feature-level multimodal fusion combined with transformer-based architectures offers the most promising direction for future research.

[113] IntroConformal: Conformal Factuality Guarantees for Large Vision-Language Models via Introspective Signals cs.CV | cs.CLPDF

Md. Atabuzzaman, Christian Alexander, Chris Thomas

TL;DR: 本文提出了IntroConformal，一个无需训练的共形风险控制框架，旨在为大型视觉语言模型生成内容的真实性提供统计保证。该方法利用模型自身的自省信号（如层间语义稳定性和验证概率）作为共形分数，避免了对外部验证器的依赖。实验表明，该方法在满足共形风险保证的同时，显著减少了弃答率，并在多个LVLM架构上实现了与基于外部验证器的基线方法相当或更优的声明级判别性能。

Details

Motivation: 大型视觉语言模型在多模态任务上表现出色，但确保其生成内容的真实性仍然是一个挑战。现有提供真实性统计保证的方法通常依赖外部验证器或生成时的置信度信号，这些方法引入了额外的依赖性，并且对于自信但错误的输出常常失效。

Result: 在多个LVLM架构上的实验表明，IntroConformal方法满足了共形风险保证，同时显著减少了弃答率，并在声明级判别性能上达到了与基于外部验证器的基线方法相当或更优的水平。

Insight: 论文的核心创新在于提出利用模型自身的自省信号（如隐藏状态表示的层间语义稳定性和模型对声明真实性的自我判断概率）来构建共形分数，从而无需训练或外部工具即可提供分布无关的有限样本真实性保证。这为模型事实性控制提供了一种更直接、更可靠的新思路。

Abstract: Large Vision-Language Models (LVLMs) have achieved strong multimodal performance, yet ensuring the factual correctness of generated content remains challenging. Existing methods that provide statistical guarantees on factuality typically rely on external verifiers or generation-time confidence signals, which introduce auxiliary dependencies or often fail for confident but incorrect outputs. We argue that reliable factuality control can instead be achieved through introspective signals derived from the model itself. We introduce IntroConformal, a training-free Conformal Risk Control (CRC) framework that provides finite-sample, distribution-free factuality guarantees. We first instantiate it with layer-wise semantic stability, a conformity score derived from hidden-state representations, and then propose verification probability, a stronger score capturing the model’s self-administered judgment on claim factuality. Across multiple LVLM architectures, IntroConformal satisfies the conformal risk guarantee while substantially reducing abstention and achieving competitive or superior claim-level discrimination relative to external verifier-based baselines.

[114] Semantic-Guided Multimodal Preprocessing for Vision Transformer-Based Clear Cell Renal Cell Carcinoma Grading cs.CV | cs.AI | cs.LG | eess.IVPDF

Fatemeh Javadian, Zhu Chen, Zahra Aminparast, Johannes Stegmaier

TL;DR: 本文提出了一种语义引导的多模态预处理方法，用于基于Vision Transformer (ViT)的透明细胞肾细胞癌分级。该方法将来自预训练模型的细胞核分类图与RGB组织病理学图像相结合，通过通道拼接和乘法调制等策略，有效利用了细胞核分级信息并保留了RGB纹理特征。

Details

Motivation: 现有的透明细胞肾细胞癌分级方法要么直接分析图像块，要么仅关注细胞核级别的分类，未能将细粒度的细胞核分析与最终的肿瘤分级联系起来。

Result: 在评估中，所提出的语义引导增强方法取得了0.916的平衡准确率，优于仅使用RGB的基线（0.707）和先前研究的最大投票聚合方法（0.427）。敏感性分析表明，即使在模拟扰动下，该方法仍能保持对基线21个百分点的性能提升。

Insight: 创新点在于提出了一种基于预处理的多模态融合框架，能够有效利用现有不完美的细胞核分类器的诊断潜力，从而将细粒度的细胞核分析与粗粒度的基于ViT的图像块分类桥接起来。从客观角度看，该方法通过简单的预处理操作（如通道拼接和调制）实现了显著的性能提升，展示了将语义先验信息有效整合到ViT模型中的潜力。

Abstract: Clear cell renal cell carcinoma (CCRCC) grading is essential for treatment planning, yet existing approaches either analyze patch-level images directly or focus solely on nuclei-level classification, without linking to final tumor grading. We propose a semantic-guided multimodal preprocessing method that integrates nuclei classification maps from existing pre-trained models with RGB histopathology images for Vision Transformer (ViT)-based CCRCC grading. Our approach employs classification map channel concatenation and multiplicative modulation, with optimized overlays to leverage nuclei grading information, while preserving RGB textural features. Evaluation of multiple preprocessing strategies demonstrates that semantic-guided enhancement achieves 0.916 balanced accuracy, outperforming RGB-only baseline (0.707) and max-voting aggregation from prior studies (0.427). Sensitivity analysis reveals that this 21 percentage point improvement over baseline persists even under simulated perturbation at rates matching current state-of-the-art nuclei classification model error thresholds, suggesting both effective semantic utilization and practical robustness. These findings show that preprocessing-based multimodal fusion can leverage the diagnostic potential of existing imperfect nuclei classifiers, effectively bridging previously isolated fine-grained nuclear-level analysis with coarse-grained ViT-based patch classification. Per-class recall was consistent across grades (0.93, 0.91, 0.91), indicating that gains are not concentrated in the majority class. Because the sensitivity analysis perturbs ground-truth maps rather than predictions from an actual nuclei model, this result characterizes robustness under simulated error rather than deployment with a real upstream model, which remains for future work.

[115] CameraEditor: Camera-Controlled Image Editing via Video-Prior Sequential Modeling cs.CVPDF

Xin Shen, Chengyou Jia, Keshuo Xing, Zifeng Zhu, Changliang Xia

TL;DR: CameraEditor是一个通过视频先验序列建模实现相机参数控制图像编辑的框架。它将相机控制编辑从空间问题转化为时序预测任务，利用视频扩散模型的时间一致性，结合几何感知模块和动态参考路由机制，以处理大视角变换并保持内容一致性和空间连贯性。

Details

Motivation: 现有图像编辑模型擅长语义和风格操控，但难以精确控制相机参数，在处理大视角变换时面临结构撕裂或忽略几何指令的保守输出问题。

Result: 在构建的5,760实例训练数据集上，CameraEditor在相机控制精度和源身份保持方面达到SOTA水平，并通过CamEditor-Bench（包含462测试用例的评估套件）验证了其优越性。

Insight: 创新点在于将相机控制编辑重构为时序预测，利用视频扩散的时序连贯性，通过动态全景裁剪构建几何严谨的视觉参考对，并插入中间过渡帧分解大视角变换，从而提升编辑的几何精确性和内容保真度。

Abstract: Beyond semantic content, camera parameters play a pivotal role in dictating the geometric perspective and appearance of any given image. While recent image editing models excel at semantic and stylistic manipulation, they struggle with explicit camera parameter control. When handling large perspective shifts, instruction-driven models face a dilemma: they either suffer from structural tearing or generate conservative outputs that ignore geometric instructions. To address this, we introduce CameraEditor, a framework that reformulates camera-controlled editing from a spatial problem into a temporal sequence prediction task. By leveraging the temporal coherence of video diffusion models, our approach integrates an explicit geometric perception module with a dynamic reference routing mechanism. This allows us to construct geometrically rigorous visual reference pairs via dynamic panorama cropping, overcoming the ambiguity of text-based instructions. Furthermore, CameraEditor strategically inserts intermediate transition frames to decompose large perspective shifts, providing a robust temporal buffer that preserves content identity and spatial coherence. We construct a training dataset of 5,760 instances. As an independent contribution, we introduce CamEditor-Bench, a model-agnostic evaluation suite of 462 test cases. Extensive experiments demonstrate that CameraEditor achieves state-of-the-art camera control precision and source identity preservation, outperforming existing methods.

[116] Benchmarking Spatial, Spectral, and Self-Supervised Cues for Face Forgery Detection under Realistic Degradation cs.CVPDF

Lucas Cunha, Lucas Sotomaior, Lucas Gasperin, Beatriz Caldas, Eduardo Pianovski

TL;DR: 本文提出了一个基于MFFI数据集的标准化人脸伪造检测基准，评估了六类模型在干净和退化测试集上的性能。研究发现，干净集性能不能可靠反映模型在压缩、缩放和模糊等真实退化下的鲁棒性，其中Xception模型在干净集上表现最佳，而冻结的DINOv3自监督模型在退化集上表现最优。

Details

Motivation: 人脸伪造检测器在受控基准上表现良好，但在真实图像退化下的可靠性有限，因此需要建立一个标准化基准来评估模型在退化条件下的鲁棒性。

Result: 在干净集上，Xception模型（RGB输入）达到0.884的平均ROC-AUC，但在退化集上性能显著下降；冻结的DINOv3模型仅训练线性分类头，在退化集上达到0.726的平均ROC-AUC，表现最强。

Insight: 研究强调了退化评估协议的必要性，并指出自监督视觉表示（如DINOv3）是鲁棒人脸伪造检测的有前景方向；同时，傅里叶域线索与RGB信息结合时最有效，而纯谱输入始终不及空间表示。

Abstract: Face forgery detectors often achieve strong results on controlled benchmarks, but their reliability under realistic image degradations remains limited. This paper presents a standardized benchmark for face forgery detection using the Multi-Dimensional Face Forgery Image (MFFI) dataset and evaluates performance on both clean and degraded test partitions. We compare six model families, including convolutional networks, transformer-based models, and a frozen self-supervised DINOv3 backbone, across spatial, spectral, and hybrid input representations. The results show that clean-set performance is not a reliable indicator of robustness under compression, resizing, and blurring. Xception with RGB obtains the best clean performance, reaching 0.884 mean ROC-AUC, but degrades substantially on the harder partition. In contrast, frozen DINOv3 achieves the strongest degraded-set result, with 0.726 mean ROC-AUC, while training only a linear classification head. The representation analysis indicates that Fourier-domain cues are most useful when combined with RGB information, whereas purely spectral inputs consistently underperform spatial representations. Qualitative attribution maps further suggest that convolutional detectors focus on localized artifacts, while DINOv3 relies on broader facial structure. These findings reinforce the need for degraded evaluation protocols and highlight self-supervised visual representations as a promising direction for robust face forgery detection. Our source code is publicly available at https://github.com/lucasdocunha/FaceForgery-Benchmark/.

[117] TempCloze: Can Video-LLMs Identify the Missing Middle? cs.CV | cs.AIPDF

Wenqi Pei, Henry Hengyuan Zhao, Yilai Liu, Jiahao Meng, Han Chen

TL;DR: 本文提出了TempCloze，一个用于评估视频大语言模型视觉时序推理能力的视频完形填空基准。该基准通过要求模型根据视频的开头和结尾片段，从四个候选片段中识别出真实的中间片段，来减少语言捷径的影响。

Details

Motivation: 现有的视频大语言模型时序推理基准往往通过语言介导，存在选项措辞、答案相关性或语言先验等语言捷径问题，因此需要构建一个更侧重于视觉时序推理的评估基准。

Result: 在包含1,521个视频的TempCloze基准上评估了10个专有和21个开源视频大语言模型，发现模型在时间对齐维度上表现最差，是其主要的性能瓶颈。

Insight: 创新点在于构建了一个基于视频完形填空的评估基准，通过设计语义、对齐和进展三个维度的干扰项来系统评估视觉时序推理能力，并揭示了时间对齐是当前视频大语言模型的关键挑战。

Abstract: Temporal reasoning benchmarks for Video-LLMs are often mediated by language, leaving room for linguistic shortcuts from option wording, answer correlations, or language priors. To reduce such shortcuts, we introduce TempCloze, a video cloze benchmark for evaluating visual temporal reasoning in Video-LLMs. Given the beginning and ending clips of a video, models must identify the true missing middle from four candidates. TempCloze contains 1,521 carefully filtered videos from seven sources, mainly long-take and egocentric videos. We construct same-source distractors along three dimensions: Semantic asks what event should happen, Alignment probes when it should occur, and Progression tests how it should unfold, while shared scenes and objects reduce appearance cues. Our evaluation of 10 proprietary and 21 open-source Video-LLMs reveals Alignment as the primary bottleneck: models often recognize plausible semantic content and local event progression but struggle with temporal alignment. We further conduct error pattern and behavioral sensitivity analyses on TempCloze-Mixed and TempCloze-Hard with four representative models to examine where errors arise and how candidate order, context direction, visible span, frame density, and test-time scaling influence model choices.

[118] Revisiting Cross-View Completion: Self-Supervised Pre-Training via Reconstruction Error Comparison cs.CVPDF

Thibaut Loiseau, Guillaume Bourmaud, Vincent Lepetit

TL;DR: 本文提出Gekko，一种自监督预训练方法，通过比较跨视角补全与掩码自编码器的重建误差差异，为所有掩码区域提供双目信号。该方法无需3D标注，在零样本对应估计、相对姿态估计和点云回归任务上显著优于CroCo基线，并在ETH3D数据集上实现22%的端点误差下降。

Details

Motivation: 现有跨视角补全方法在非共视区域仅提供单目训练信号，限制了特征学习效果。本文旨在将这一限制转化为可利用的信号，通过重建误差比较显式建模共视性。

Result: 在相同架构和训练数据下，Gekko在零样本对应估计、相对姿态估计（最严格阈值下精度提升6倍）和ETH3D点云回归（端点误差降低22%）上全面超越CroCo，其冻结特征也优于同类跨视角骨干网络。

Insight: 创新点在于将跨视图与掩码自编码重建误差的相对改进作为共视性代理信号，联合训练三个任务；该方法可直接从原始视频训练，无需繁琐的3D预处理，为自监督3D视觉提供了高效的双目信号学习框架。

Abstract: Self-supervised pre-training via cross-view completion learns strong features for 3D vision from co-visible regions of image pairs. However, the reference view provides little information for reconstructing non-co-visible patches, implicitly yielding a monocular training signal in these regions. We introduce Gekko, which turns this limitation into a useful signal. The relative improvement of the cross-view reconstruction error over a masked-autoencoder error is a self-supervised proxy for co-visibility: large improvements indicate co-visible regions, negligible ones non-co-visible areas. Gekko is a network, trained from scratch, that jointly performs cross-view completion, masked autoencoding, and per-pixel prediction of this relative improvement, providing an additional binocular signal for all masked regions without any ground-truth 3D annotation. Under identical architectures and training data, Gekko consistently outperforms CroCo on zero-shot correspondence estimation, relative pose estimation, and pointmap regression, with up to 6 times higher accuracy at the strictest relative-pose threshold and a 22% drop in end-point error on ETH3D. The extra channel it learns is itself a strong co-visibility detector on unseen scenes, and Gekko’s frozen features outperform released cross-view backbones of comparable or larger size. It can also be trained directly from raw videos with a simple stride-based curriculum, removing the cumbersome 3D preprocessing prior methods require while matching models trained on curated data. Code and pre-trained models are publicly available.

[119] H3-World: Turning Language Understanding into World Control cs.CV | cs.AIPDF

Danze Chen, Zeqing Wang, Ziyue Lin, Xingyi Yang, Yeying Jin

TL;DR: H3-World是一个高效框架，将33B参数的MiniMax-H3视频生成器转变为交互式世界模型。它通过结构化动作表示和时间注意力路由，将自然语言指令转化为精确的时序世界控制，仅需少量数据和轻量适配即可实现。

Details

Motivation: 动机在于利用大型视频生成器（如MiniMax-H3）已具备的零样本语言控制能力，将其粗糙的语言接口转化为精确、时序基础的世界控制，而无需引入专门的动作模块。

Result: 仅使用8,000个游戏样本、10,000步LoRA优化和0.199%可训练参数，H3-World在保持强生成质量的同时实现了有效的角色和相机控制，并能泛化到未见场景，展示了从视频生成到交互控制的转化潜力。

Insight: 创新点包括将动作表示为角色和相机指令的结构化组合并与视频潜在对齐，以及引入时间注意力路由来限制指令作用区间、减少控制泄漏；其核心洞察是直接重用大规模视频预训练中的语义表示进行轻量适配，高效解锁交互控制能力。

Abstract: We present H3-World, an efficient framework that turns the 33B MiniMax-H3 video generator into an interactive world model. Our key finding is that, as large video generators become more capable, language is emerging as a natural interface for control. MiniMax-H3, for example, already supports zero-shot control of character behavior and camera motion through natural-language instructions. Building on this, H3-World turns this coarse language interface into precise, temporally grounded world control, without introducing dedicated action modules. Specifically, we represent each action as a structured combination of character and camera instructions, and align them with the corresponding temporal video latents. To make the control temporally precise, we further introduce temporal attention routing, which restricts each instruction to its intended time interval and reduces control leakage across actions. Importantly, H3-World directly reuses the semantic representations learned during large-scale video pretraining and requires only lightweight adaptation. With only 8,000 gameplay samples, 10,000 LoRA optimization steps, and 0.199% trainable parameters, H3-World achieves effective character and camera control while preserving strong generation quality. It also generalizes to unseen scenarios. These results show that the control capabilities emerging in large video generators can be efficiently transformed into interactive world control.

[120] What, Where, and How: Probing Spatiotemporal Representations in Video Foundation Models cs.CVPDF

Sharon S. Musa, Fereshteh Forghani, Harrish Thasarathan, Sonia Joseph, Matthew Kowal

TL;DR: 本文对视频基础模型V-JEPA 2和VideoMAE-v2进行了系统性的分层分析，探究了它们时空表示中编码的视觉概念、在Transformer层中的出现位置以及几何组织方式。研究发现模型能有效编码相机运动，在异常检测上表现中等，但在直觉物理任务上接近随机水平。此外，论文发现时序特征在表示空间中形成平滑的低维轨迹，并基于此提出了几何感知的样条插值方法，以生成更平滑、连贯的视频。

Details

Motivation: 自监督视频基础模型学习丰富的时空表示，但尚不清楚这些表示编码了哪些视觉概念、在Transformer层的何处出现以及如何几何组织。本文旨在通过系统分析回答这三个问题。

Result: 在相机运动理解任务上，模型在60-70%网络深度处达到最佳性能（ROC AUC >90%）；在异常检测上表现中等（ROC AUC >60%）；在直觉物理任务上接近随机水平。基于几何分析，提出的样条插值方法比线性插值能生成更平滑、连贯的视频。

Insight: 创新点包括：通过轻量级探针系统分析视频基础模型的时空表示特性；发现时序特征在表示空间中形成平滑低维轨迹的几何组织规律；提出基于几何感知的样条插值方法改进视频生成。这为理解模型内部表示和提升视频处理任务提供了新视角。

Abstract: Self-supervised video foundation models learn rich spatiotemporal representations, yet it remains unclear what visual concepts these representations encode, where they emerge across transformer layers, and how they are geometrically organized. In this work, we tackle these three questions through a systematic layer-wise analysis of V-JEPA 2 and VideoMAE-v2. We leverage lightweight probes trained to discover three temporally grounded properties: (i) camera motion understanding, (ii) intuitive physics, and (iii) anomaly detection. Both models encode camera motion, with best results ($>90$ ROC AUC) emerging at 60-70% of network depth, and achieve moderate anomaly detection performance ($>60$ ROC AUC), but remain near chance on intuitive-physics tasks, suggesting a limited encoding of deeper physical reasoning. Beyond classification, we find that temporal features from individual videos form smooth low-dimensional trajectories in representation space, suggesting that camera motion is not only linearly decodable but also geometrically organized. Based on these results, we apply geometry-aware spline-based steering in the model’s latent representations to interpolate camera motion, yielding steered videos with smoother trajectories and more coherent temporal progression than linear interpolation.

[121] SpatialGuard: Harness-Guided Verifiable Spatial Reasoning for Text-to-Image Generation cs.CVPDF

Ziyun Qian, Zizhi Chen, Yizhou Liu, Mingyang Sun, Dingkang Yang

TL;DR: SpatialGuard是一个用于复杂3D空间文本到图像生成的结构化布局引导框架。它将文本提示解析为面向图像合成的3D布局，通过视觉实现器生成视觉条件和候选图像，并使用视觉对齐评判器验证提示、布局和图像之间的一致性。该框架通过布局约束装置组织规则约束、工具调用、共享知识和反馈循环，将复杂的空间生成过程转变为可验证的规划、实现、验证和修复流程。

Details

Motivation: 现有基于提示驱动或布局条件的方法在复杂3D空间文本到图像生成中缺乏可优化和可验证的空间中间表示，导致物体关系、遮挡、可见性和相机约束在多轮生成过程中容易衰减。

Result: 综合实验表明，SpatialGuard在复杂3D空间布局生成任务上达到了最先进的性能，并在空间忠实度方面优于现有的文本到图像和布局控制基线方法。

Insight: 创新点在于引入了可编辑的布局状态作为核心中间表示，并通过布局约束装置将规则约束、工具调用和反馈循环系统化地组织起来，将隐式的提示跟随过程转变为显式的可验证工作流程。这种结构化方法为解决生成模型中空间关系一致性难题提供了新思路。

Abstract: Complex 3D spatial text to image generation requires models to convert natural language into stable visual geometry, not merely semantic appearance. Existing prompt-driven or layout-conditioned methods improve controllability, but often lack an optimizable and verifiable spatial intermediary before visual sampling. As a result, object relations, occlusion, visibility, and camera constraints can decay during multi-round generation. This paper presents SpatialGuard, a structured layout-guided framework for complex 3D spatial text-to-image generation. SpatialGuard parses prompts into image synthesis-oriented 3D layouts through a Spatial Layout Architect, realizes them as visual conditions and candidate images through a Visual Realizer, and uses a Visual Alignment Critic to validate consistency among prompt, layout, and image. To keep constraints stable across iterations, SpatialGuard introduces a Layout Harness that organizes rule constraints, tool invocation, shared knowledge, and feedback loops around the editable layout state. This design turns complex spatial generation from implicit prompt following into a verifiable process of planning, realization, validation, and repair. Comprehensive experiments show that SpatialGuard achieves state-of-the-art performance in complex 3D spatial layout generation and improves spatial faithfulness over existing text-to-image and layout control baselines.

[122] Uncovering Understanding-Generation Synergy in Native Unified Multimodal Models: From Representation, Task to System cs.CVPDF

Penghao Wu, Haiwen Diao, Weichen Fan, Lewei Lu, Dahua Lin

TL;DR: 本文研究了统一多模态模型（UMMs）中视觉理解与生成任务之间的关系，发现两者在表征、任务和系统层面存在协同效应。通过实验证明，适当的架构设计（如任务解耦）和端到端优化可以将共存转化为协同，提升模型在复杂任务上的性能。

Details

Motivation: 探究统一多模态模型中视觉理解与生成目标之间是相互促进、竞争还是仅仅共存，旨在揭示功能统一是否带来学习协同，并指导更有效的模型设计。

Result: 在无预训练视觉先验的受控环境中，实验表明：任务解耦架构避免了单一路径下的不对称退化；在共享知识的任务上观察到双向正向迁移；端到端UMM在需要同时理解与生成的复杂任务上优于规划-执行器流水线。

Insight: 创新点在于从表征、任务、系统三个层面系统分析了理解与生成的协同机制，并提出通过任务解耦架构平衡专业化与语义交互，以及端到端优化来释放UMM的协同潜力，而非仅提供统一接口。

Abstract: While unified multimodal models (UMMs) jointly perform visual understanding and generation within a single model, functional unification does not guarantee learning synergy: the two objectives may reinforce each other, compete for capacity, or merely coexist. We investigate their relationship at the representation, task, and system levels in a controlled, structurally native setting without pretrained vision priors. At the representation level, we find that each objective provides useful signal to the other: generation enriches the visual features learned for understanding, while understanding strengthens vision–language alignment for generation. However, when both objectives are forced through the same computation path, one tends to dominate. A task-decoupled architecture that specializes conflicting visual computation while preserving semantic interaction avoids this asymmetric degradation. At the task level, through three case studies, we find positive bidirectional transfer when understanding and generation tasks rely on shared knowledge. At the system level, we show that an end-to-end UMM outperforms a matched planner–executor pipeline on complex tasks that explicitly require both image understanding and generation. Together, these results show that the value of UMMs extends beyond a unified interface: appropriate specialization, shared task knowledge, and end-to-end optimization can turn coexistence into synergy.

cs.LG [Back]

[123] Group Adaptive Clipping Policy Optimization cs.LG | cs.CLPDF

Sheng Jia, Xiao Wang, Shiva Prasad Kasiviswanathan, Rein Houthooft

TL;DR: 本文提出了一种名为Group Adaptive Clipping Policy Optimization（GAPO）的强化学习方法，旨在改进现有GRPO方法中固定重要性采样（IS）比率裁剪边界的问题。GAPO根据rollout的优势自适应调整裁剪边界，以更好地利用不同难度的rollout所提供的梯度信号。

Details

Motivation: 现有GRPO方法对所有rollout使用固定的IS比率裁剪边界，导致在困难问题上稀有的正确rollout和在简单问题上丰富的正确rollout被以相近的比率裁剪，尽管它们提供的学习信号差异很大。这抑制了低成功率rollout（通常具有更大IS比率和更强梯度信号）对探索和解决新问题的贡献。

Result: 在数学推理和代码生成基准测试（其中基础模型的通过率相对较低）上，GAPO在Qwen和Llama模型上一致地提升了Pass@1和Pass@k指标，优于固定裁剪和优势塑形基线方法。

Insight: 创新点在于从反向KL信任区域视角出发，提出根据rollout优势自适应调整裁剪边界，使得具有更大学习信号的rollout获得相应更大的更新空间。这是一种无需奖励塑形、仅调整裁剪阈值的即插即用改进，保留了标准PPO/GRPO代理目标。

Abstract: Group relative policy optimization for reinforcement learning with verifiable rewards (RLVR) typically uses a fixed importance-sampling (IS) ratio clipping boundary across all rollouts. We identify a key limitation: rare correct rollouts on harder problems and abundant correct rollouts on easier problems are clipped at comparable rates, despite contributing very different learning signals. Rollouts with low group success exhibit larger IS ratios and carry stronger gradient signal for exploration and solving new problems, yet are disproportionately suppressed by fixed clipping. To address this, we propose Group Adaptive Clipping Policy Optimization (GAPO), a plug-in modification to GRPO methods that adapts the clipping boundary to the rollout advantage. GAPO is motivated by a reverse-KL trust-region perspective, which suggests that rollouts with larger learning signal should receive proportionally greater update headroom. GAPO requires no reward shaping and preserves the standard PPO/GSPO surrogate while adapting only the clipping threshold. Across Qwen and Llama models, GAPO consistently improves both Pass@1 and Pass@k over fixed clipping and advantage-shaping baselines on math reasoning and coding benchmarks where the pass rates by the base model are relatively low.

[124] Confess What You Know: Forget-Set Misalignment with Model Knowledge in LLM Unlearning cs.LG | cs.AI | cs.CLPDF

Miso Kim, Georu Lee, Seungwon Jeong, Woojin Lee

TL;DR: 本文研究了大型语言模型（LLM）遗忘任务中一个常见但被忽视的问题：预定义的遗忘集与模型实际记忆的知识之间存在偏差，即遗忘集错位。作者识别了两种错位情况（欠遗忘和知识外遗忘），并通过梯度分析揭示了其根源在于目标错位。为解决此问题，论文提出了一个名为CONFS的无数据框架，通过引导和形式化模型记忆的知识来构建与模型对齐的遗忘集，从而在多个基准测试中实现了接近黄金标准的性能，并取得了更好的遗忘-效用平衡。

Details

Motivation: 动机在于现实隐私场景中，原始训练数据通常不可访问，导致为LLM设计的遗忘算法所依赖的预定义遗忘集，往往与模型实际记忆的内容不匹配，从而引发隐私泄露或模型效用下降的问题。

Result: 在合成、多模态和真实世界基准测试中，CONFS框架在多个指标上接近黄金标准性能，并在遗忘与效用的平衡上表现优异，同时比其他无数据遗忘集构建方法更好地保持了模型效用。

Insight: 核心创新点在于首次系统性地定义了遗忘集错位问题及其两种类型，并提出了一个无需原始数据、通过模型自白来构建对齐遗忘集的无数据框架。从客观角度看，该方法将遗忘任务的重点从依赖外部数据假设转向了挖掘模型内部知识，为解决现实世界中的隐私遗忘问题提供了一个更实用的新思路。

Abstract: Machine unlearning for large language models (LLMs) often assumes that a pre-defined forget set matches what the model has memorized, but this frequently breaks in realistic privacy settings where the original training data is inaccessible. We term this gap forget-set misalignment and identify two cases. In Under Unlearning, the forget set omits memorized information and leakage persists. In Out-of-Knowledge Unlearning, the algorithm is driven to “forget” knowledge the model never learned, perturbing parameters and degrading utility. Using gradient-level analysis, we show these behaviors arise from misaligned unlearning targets rather than specific optimization choices. We then propose CONfession-to-Forget-Set (CONFS), a data-blind framework that constructs model-aligned forget sets by eliciting and formalizing the model’s memorized knowledge. Across synthetic, multimodal, and real-world benchmarks, CONFS approaches Gold-standard performance on several metrics and achieves a competitive forgetting-utility balance, while preserving utility better than other data-blind forget-set constructions.

physics.med-ph [Back]

[125] PyDoseRT Proton: A GPU Pencil-Beam Engine with a Convolutional Residual-Correction Network for Fast Proton Dose Calculation physics.med-ph | cs.CVPDF

Lukas Zimmermann, Hermann Fuchs, Attila Simkó, Gerd Heilemann

TL;DR: 本文提出了PyDoseRT Proton，一个用于快速质子剂量计算的GPU加速引擎。它结合了基于物理的分析笔形束算法和一个3D卷积残差校正网络，旨在以接近蒙特卡洛方法的精度高效预测质子治疗中的剂量分布。

Details

Motivation: 动机是解决质子治疗计划中快速且精确的剂量计算问题，传统蒙特卡洛方法计算成本高，而笔形束等方法精度不足，需要一种混合方法在速度和精度之间取得平衡。

Result: 在DoseRAD2026质子剂量预测任务中，该方法在初步测试中取得了优异结果：笔形束平均绝对误差为0.0066，计划剂量平均绝对误差为0.0049，伽马通过率（1%/1 mm）达到98.30%，展示了接近蒙特卡洛的精度。

Insight: 创新点在于将可微分的物理引擎与深度学习残差校正网络（RepVGG-U-Net）相结合，通过梯度优化校准物理参数，并利用条件嵌入（如材料标签、能量）进行跨解剖部位的通用校正，实现了物理模型与数据驱动模型的高效融合。

Abstract: Architecture category. Hybrid method: a physics-based analytical pencil-beam (PB) dose engine followed by a 3-D convolutional residual-correction network (RepVGG-U-Net). We addressed the DoseRAD2026 proton dose-prediction task with PyDoseRT Proton, a GPU-accelerated engine implemented in PyTorch and augmented by a learned residual toward Monte Carlo (MC) accuracy. A double-Gaussian PB kernel was calibrated to GATE/Geant4 integrated depth doses in water in two stages: a classical per-energy curve fit, then a gradient-based fit of the full 3-D dose through the PyTorch physics engine as it retains a differentiable execution path for gradient-based optimization of dose-dependent objectives. The engine computes each beamlet on a beam’s-eye-view (BEV) lattice with variance-preserving Gaussian splitting, an analytic nuclear halo, and a Fermi-Eyges heterogeneity term, then rotates the result into the patient frame. Additionally, a compact residual U-Net predicts an additive correction in BEV space. It is conditioned on voxelwise material-label embeddings, a discrete energy embedding and spot size. The same model was used for all anatomical sites (thoracic and abdominal). It was trained with a patient-space L1 objective emphasizing the scored high-dose region and multi-scale BEV deep supervision. The submitted CT configuration obtained preliminary-test beamlet MAE 0.0066, image-z IDD distance 0.0025, plan MAE 0.0049, 98.30% gamma pass rate (1%/1 mm), and DVH error 0.460.

cs.IR [Back]

[126] From Saliency to Discriminability: Rank-Preserving Visual Token Pruning for VLM Rerankers cs.IR | cs.CVPDF

Siyi Liu, Hanjun Yang, Chenchen Zhang, Xiaorong Zhu, Xinyu Zuo

TL;DR: 本文提出了一种名为RaDiCal的训练无关视觉令牌剪枝框架，用于提升视觉语言模型作为列表重排序器的效率。该方法通过归一化注意力熵诊断注意力显著性对排序贡献的可靠性，并结合无注意力的排序判别先验，在多个检索基准和VLM架构上实现了高效剪枝。

Details

Motivation: 现有基于注意力显著性的剪枝方法存在显著性与排序贡献不匹配的问题，即视觉上突出的令牌往往捕获的是跨候选样本共享的、与顺序无关的模式，这影响了重排序器的实际部署效率。

Result: 在Flickr30K和MSCOCO等三个检索基准上，RaDiCal在20%令牌预算下匹配或超越了Dense MRR@10的性能，在FashionIQ上排名所有剪枝方法第一，在10%令牌保留率下性能损失在1.2个百分点内，并将FLOPs降低了39-45%，实现了1.28-1.45倍的实测加速。

Insight: 创新点在于揭示了注意力显著性对排序贡献的可靠性随层变化的规律，并提出了基于归一化注意力熵的信任诊断机制来指导剪枝层选择，结合了无注意力的排序判别先验，实现了无需数据集特定调优的高效剪枝。

Abstract: Large vision-language models used as listwise rerankers must jointly process visual tokens from tens of candidates per query, making token pruning essential for practical deployment. Existing pruning methods retain tokens by attention saliency, yet we show that saliency is systematically misaligned with ranking contribution: visually prominent tokens often capture order-neutral patterns shared across candidates. This mismatch is layer-dependent: saliency becomes informative only where attention is concentrated, and normalized attention entropy diagnoses the reliability shift (Pearson r=0.87). We propose RaDiCal (Rank-Discriminative Calibration), a training-free framework that uses normalized attention entropy to decide when saliency can be trusted, fusing it with an attention-free rank-discriminative prior and selecting pruning layers from the same trust landscape. Across three retrieval benchmarks and multiple VLM architectures, RaDiCal matches Dense MRR@10 on Flickr30K and surpasses it on MSCOCO at a 20% token budget, ranks first among all pruning methods on FashionIQ, and holds within 1.2 pp on Flickr30K and MSCOCO at 10% retention. It cuts FLOPs by 39–45% and delivers 1.28–1.45$\times$ measured speedups across two VLM architectures without dataset-specific retuning.

[127] It Takes Two to Match: Co-Evolving Generative Retriever with Reinforcement Learning cs.IR | cs.CLPDF

Runpeng Dai, Kaili Huang, Changsung Kang, Ciya Liao

TL;DR: 本文提出CoGR框架，通过协同进化的强化学习训练LLM直接生成查询和物品的检索表示（关键词集合），并利用倒排索引进行匹配，从而在保持与现有关键词检索基础设施兼容的同时提升检索性能。

Details

Motivation: 现有检索系统通常仅利用LLM进行查询侧增强，而最终匹配仍依赖下游检索器，这限制了检索性能的进一步提升。

Result: 在内部APP Marketplace数据集和公开WANDS基准测试中，CoGR在10个代表性稀疏、密集和生成基线中均取得最佳性能，F1分数分别比最强基线提升10.9%和36.1%。

Insight: 创新点在于通过协同进化强化学习同时优化查询侧和物品侧生成器，使双方在共同优化检索F1目标的过程中逐渐对齐关键词空间，实现了端到端的生成式检索表示学习。

Abstract: Retrieval is the first stage of modern search and advertising systems, selecting a candidate set from a large item universe for downstream ranking and auction. Recent work increasingly leverages LLMs to improve retrieval through query expansion, data synthesis, and retrieval-feedback training. However, the generative component is typically used for query-side augmentation, while final matching is still delegated to a downstream retriever. We introduce CoGR, a retrieval framework that instead trains LLMs to directly construct retrieval representations on both query and item sides. Each generator produces a compact set of keywords, which are matched directly through an inverted index, preserving compatibility with existing keyword-based retrieval infrastructure. CoGR uses a two-stage training pipeline. Supervised fine-tuning first establishes an aligned keyword space, after which co-evolving reinforcement learning alternately optimizes the query- and item-side generators with GRPO against the opposite side’s frozen index. Both sides optimize the same query-to-item retrieval $F_1$ objective: the query side receives retrieval $F_1$ directly, while the item side receives a counterfactual marginal reward measuring the change in query-side $F_1$ caused by its generated keywords. Across 10 representative sparse, dense, and generative baselines, CoGR achieves the best performance on both an internal APP Marketplace dataset and the public WANDS benchmark, improving $F_1$ over the strongest baseline by $10.9%$ and $36.1%$, respectively. Further analysis shows stable co-evolution and increasingly aligned query–item keyword spaces over training.

[128] MIDR: Enrichment-Augmented Indexing for Multimodal Document Retrieval cs.IR | cs.AI | cs.CL | cs.CV | cs.LGPDF

Debanjan Mahata, Atharva Tendle, Daniel Preotiuc-Pietro, Yong Zhuang, Ozan Irsoy

TL;DR: 本文提出了MIDR（多模态文档检索索引）框架，这是一种无需训练的、基于增强索引的方法，用于检索视觉丰富的文档。它将多模态推理从查询时转移到索引时，利用多模态大语言模型将渲染的页面转换为经过验证的文本字段，然后使用BM25F进行索引，并可选择与密集检索融合，从而实现基于文本的高效检索。

Details

Motivation: 解决视觉丰富文档检索中的表示问题，因为OCR处理会线性化、破坏或遗漏表格、图表、图形和布局关系中的重要内容。现有方法（如ColPali系列）在查询时进行视觉交互，而本文旨在将多模态推理前置到索引阶段。

Result: 在ViDoRe V3基准测试的五个英文领域中，MIDR Hybrid的平均nDCG达到0.6219，相对于BM25有23.0%的相对提升，并与ColQwen2.5保持竞争力。在两个法语文档领域中，该方法显著提升了跨语言检索性能（nDCG从0.1532提升至0.5448），并超越了ColQwen2.5。在全部七个领域中，MIDR在四个领域上领先于ColQwen2.5，同时索引内存使用量减少约9倍，查询延迟降低约2倍。

Insight: 核心创新在于将多模态推理从查询时服务路径转移到索引时，通过多模态LLM生成并验证文本描述来增强索引，从而在保持或提升检索精度的同时，大幅降低了部署开销（内存和延迟）。这为视觉文档检索提供了一种新的“精度-部署”权衡方案。

Abstract: Retrieval over visually rich documents has a representation problem: important content often lives in tables, charts, figures, and layout relations that plain OCR linearizes, corrupts, or omits. ColPali-family visual retrievers address this with patch-level multi-vector indexes and late-interaction scoring, keeping image-derived retrieval on the query-time serving path. We introduce MIDR (Multimodal Indexing for Document Retrieval), a training-free framework for enrichment-augmented indexing that shifts multimodal reasoning to index time. During ingestion, a multimodal LLM converts rendered pages into verified textual fields that are indexed with BM25F and optionally fused with dense retrieval, enabling text-centric serving over multimodally grounded evidence. On ViDoRe V3, MIDR Hybrid achieves 0.6219 average nDCG across five English domains, a 23.0% relative gain over BM25, remaining competitive with ColQwen2.5. On two French-document domains, enrichment bridges English queries and French page text, lifting BM25 from 0.1532 to 0.5448 nDCG and outperforming ColQwen2.5. Across all seven domains, MIDR leads ColQwen2.5 on four while using approximately 9x smaller index memory and approximately 2x lower query latency. These results establish index-time multimodal reasoning as a compelling accuracy-deployment alternative to serving-time visual late interaction.

physics.ao-ph [Back]

[129] A Sensor-Adaptive Incremental Learning Framework for Artifact Detection in Satellite Precipitation Data physics.ao-ph | cs.CV | stat.APPDF

Andres F. Monsalve, Hernan A. Moreno, Christian D. Kummerow

TL;DR: 本文提出了一种传感器自适应的增量学习框架，用于检测卫星降水数据中的伪影。该框架利用预训练的计算机视觉模型并结合少量人工标注数据，在SSMI和SSMIS卫星数据上测试，能有效区分正常轨道和包含伪影的轨道，性能与现有先进方法相当，且具有可解释性和迭代优化能力。

Details

Motivation: 随着低成本小型卫星（SmallSats）的快速发展，私营部门卫星发射和地表降水产品激增，但数据验证工作滞后，因此迫切需要一种鲁棒的工具在近实时数据发布前检测异常。

Result: 在SSMI和SSMIS卫星数据上的测试结果表明，该方法能有效分离正常轨道和包含伪影的轨道，性能与最先进的现有方法（state-of-the-art in-place methods）相当。

Insight: 创新点在于结合预训练计算机视觉模型与稀缺人工标注数据，构建了一个传感器自适应的增量学习框架，不仅实现了有效的异常检测，还提供了可解释性和基于误报/漏报的迭代优化能力。

Abstract: Historically, retrieving rainfall data from satellite imagery has been the domain of space agencies. However, in recent years, the development of cheaper, more compact satellites (SmallSats) capable of detecting rainfall proxies has led to a significant increase in private-sector initiatives for satellite launch and surface precipitation products. This rapid growth has yet to be matched by data validation efforts. Consequently, the need for a robust tool to detect anomalies in near-real-time data before it is disseminated to the public has become critical. In this paper, we present the development of an anomaly-detection system to identify artifacts in global satellite-based rainfall products. The developed framework leverages pre-trained computer vision models and incorporates scarce human-labeled data to detect specific anomalies. Our proposed anomaly detection strategy is tested on data from the Special Sensor Microwave Imager (SSMI) and the Special Sensor Microwave Imager/Sounder (SSMIS). Results demonstrate the efficacy of our approach at separating regular orbits from artifact-containing orbits for each satellite, with performance comparable to state-of-the-art in-place methods. Additionally, the framework offers explainability and the capacity for iterative refinement following false-positive or false-negative classifications.

cs.CR [Back]

[130] Differentially Private Paired Table-Image Multimodal Synthesis cs.CR | cs.AI | cs.CVPDF

Kai Chen, Josephine Lamp, Somesh Jha, Tianhao Wang

TL;DR: 本文提出DP-TabImage，一种用于差分隐私下成对表格-图像数据合成的模态专业化框架。该框架通过私有概率图模型处理表格分布，并使用基于DP-SGD训练的条件扩散模型生成图像，同时引入私有原型预训练以提升条件学习效果。在三个真实数据集上的实验表明，该方法在表格保真度、图像保真度和跨模态对齐方面取得了良好平衡。

Details

Motivation: 现实世界中许多数据集包含图像与多变量表格记录的配对数据，但在差分隐私约束下合成此类数据具有挑战性，因为两种模态需要不同的私有学习机制，且必须保持它们之间的依赖关系。

Result: 在三个真实数据集上的实验显示，DP-TabImage在表格保真度、图像保真度和跨模态对齐方面实现了强平衡。分析进一步表明，视觉预热主要提升边缘图像保真度，而对齐的表格-图像预热对于改善跨模态对应关系至关重要。

Insight: 创新点在于将联合分布分解为私有概率图模型和条件扩散模型，并引入无额外隐私成本的私有原型预训练机制。从客观角度看，其模态专业化设计和预热策略有效解决了差分隐私下多模态数据合成的对齐难题。

Abstract: Differentially private (DP) synthesis has been extensively studied for tabular and image data separately, yet many real-world datasets contain images paired with multivariate tabular records. Synthesizing such data is particularly challenging under DP, as the two modalities favor different private learning mechanisms while their dependence must also be preserved. To address this challenge, we propose DP-TabImage, a modality-specialized framework for private paired synthesis. DP-TabImage instantiates the factorization $p(x,y)=p_T(y)p_I(x;|;y)$ using a private Probabilistic Graphical Model for the multivariate table distribution and a table-conditioned diffusion model trained with DP-SGD for the conditional image distribution. To facilitate conditional learning under clipped and noisy gradients, we further pretrain the model on private table-image prototypes, pairing privately constructed attribute-conditioned images with tabular vectors derived from the already private tabular model at no additional privacy cost. Experiments on three real-world datasets show that DP-TabImage achieves a strong balance among tabular fidelity, image fidelity, and cross-modal alignment. Our analysis further reveals that visual warm-up primarily improves marginal image fidelity, whereas aligned table-image warm-up is critical for improving cross-modal correspondence. Our source code is available in the GitHub repository, https://github.com/KaiChen9909/TabImage_Syn.

cs.RO [Back]

Zhixin Wang, Chengzheyi Yao, Leyuan Liu, Xiaosong Zhang, Yongzhao Zhang

TL;DR: 本文提出了VerNav，一种基于验证器优先的低延迟视觉语言导航框架，旨在解决传统自回归方法在每一步决策中累积高延迟的问题。该方法通过批量动作验证替代逐步自回归生成，并结合基于熵的自适应生成器处理不确定决策，从而显著降低决策延迟。

Details

Motivation: 视觉语言导航任务中，自回归生成在每一步决策中累积高延迟，影响实时导航效率；需要一种既能保持推理能力又能降低延迟的框架。

Result: 在Room-to-Room基准测试中，VerNav仅使用验证器决策路径就达到了与代表性基于LLM的VLN智能体相当的导航性能，同时将平均每步决策阶段的LLM延迟降低了10倍以上。

Insight: 创新点包括验证器优先架构降低延迟、基于熵的自适应生成器动态处理不确定性，以及两阶段对齐方案（VPO和步级强化微调）提升导航性能；可借鉴其将批量验证与自适应生成结合以平衡效率与准确性的思路。

Abstract: Vision-and-Language Navigation (VLN) requires an agent to navigate through unseen 3D environments according to natural-language instructions. Explicit reasoning can improve instruction understanding and semantic grounding, but autoregressive generation at every step accumulates large decision-stage latency over multi-step navigation. We propose VerNav, a verifier-first framework for low-latency LLM-based VLN. The verifier reduces decision-stage latency by replacing per-step autoregressive generation with batched action verification, while an entropy-based adaptive generator is invoked only for uncertain decisions to produce compact state evidence. To further improve navigation performance with the verifier, we introduce a two-stage alignment scheme: (i) VPO improves local action-preference alignment in static verifier training, and (ii) step-level reinforcement fine-tuning provides dense progress rewards over multi-step navigation rollouts during dynamic task execution. Experiments on the Room-to-Room (R2R) benchmark show that the verifier-only decision path of VerNav achieves competitive navigation performance among representative LLM-based VLN agents while reducing average decision-stage LLM latency per step by more than $10\times$ compared with autoregressive methods.

cs.SE [Back]

[132] InteractBench: Benchmarking LLMs on Competitive Programming under Unrevealed Information cs.SE | cs.AI | cs.CLPDF

Jiaze Li, Aocheng Shen, Bing Liu, Boyu Zhang, Xiaoxuan Fan

TL;DR: 本文介绍了InteractBench，一个用于评估大型语言模型在竞争性编程中处理未揭示信息能力的基准测试。该基准包含322个来自Codeforces、AtCoder、IOI和ICPC的高质量交互式问题，每个问题都配有可执行的本地交互器，支持完全离线评估。评估发现，即使是当前最先进的推理模型在交互式问题上也表现有限，并提出了细粒度的失败分类来诊断缺陷根源。

Details

Motivation: 现有基准测试主要关注全信息任务，即所有问题输入都预先提供，这忽略了算法推理的一个关键维度：在关键信息未预先揭示时生成程序的操作能力。交互式问题作为竞争性编程的独特组成部分，体现了这一挑战。

Result: 评估揭示了显著的交互差距：即使是最先进的推理模型在交互式问题上的成功率也有限。除了成功率，论文还提出了细粒度的失败分类来诊断缺陷根源，其中算法逻辑错误占主导，但协议违规和查询预算超支也频繁发生。

Insight: 创新点在于引入了首个专注于评估LLMs在竞争性编程中处理交互式问题（即未揭示信息场景）能力的基准测试InteractBench，并提供了可执行的本地交互器以实现离线评估。客观来看，该工作强调了动态信息获取和状态跟踪作为算法推理关键维度的评估重要性，并为模型缺陷提供了更细致的诊断框架。

Abstract: Competitive programming is increasingly being used to evaluate the algorithmic reasoning capabilities of large language models (LLMs). However, existing benchmarks primarily focus on full-information tasks where all problem inputs are provided upfront. This overlooks a critical dimension of algorithmic reasoning: the ability of generated programs to operate when key information is not revealed upfront. Interactive problems, a distinctive component of competitive programming, embody this challenge. These problems require programs to engage in multi-round interaction with an interactor (a judge program) under strict protocol constraints and limited query budgets, with new information revealed only in response to queries. To address this gap, we introduce InteractBench, a benchmark comprising 322 high-quality interactive problems curated from Codeforces, AtCoder, IOI, and ICPC. Each problem is packaged with executable local interactors, enabling fully offline evaluation. Unlike existing benchmarks, InteractBench assesses whether model-generated code can acquire information and track state dynamically. Our evaluation reveals a significant interaction gap: even the most advanced reasoning models achieve limited success on interactive problems. Beyond success rates, we propose a fine-grained failure taxonomy to diagnose the root causes of these deficiencies. Although algorithmic logic errors remain dominant, protocol violations and query-budget overruns are frequent. Code is available at https://github.com/kmsgk0/InteractBench.

eess.IV [Back]

[133] Lightweight Interpretable RGB-Guided Hyperspectral Super-Resolution under Real Cross-resolution Misalignment eess.IV | cs.CVPDF

Mohamad Jouni, Aurélien Godet, Mauro Dalla Mura

TL;DR: 本文提出了一种轻量级且可解释的RGB引导高光谱超分辨率框架，用于解决紧凑型快照高光谱相机空间分辨率低的问题。该方法结合了跨模态光流对齐和基于模型的Gram-Schmidt正交化融合，能够处理真实场景中RGB与高光谱图像之间的跨分辨率未对准问题，并支持可见光-近红外光谱范围和不同缩放因子而无需重新训练。

Details

Motivation: 现有基于学习的RGB引导高光谱超分辨率方法通常针对固定的光谱范围和空间缩放因子进行训练，计算成本高，且难以灵活适应不同传感器和真实场景中因双相机系统视场不同导致的残余未对准问题，后者会引入虚假高频细节。

Result: 在Real基准测试上的实验表明，该方法在重建精度上优于基于学习的融合基线方法，同时计算速度显著更快。在使用真实RGB-HSI双相机系统采集的34帧序列上进行的降分辨率定量评估验证了该方法在真实跨传感器辐射度、噪声和几何差异下的有效性，而原生分辨率的定性结果展示了其在完整的51波段VIS-NIR采集上的部署能力。

Insight: 创新点在于将跨模态光流对齐与基于模型的Gram-Schmidt正交化融合相结合，通过估计基于能量的置信权重图来指导加权最小二乘光谱回归和门控融合，从而构建了一个轻量、可解释且无需针对特定传感器或缩放因子重新训练的灵活框架。

Abstract: Compact snapshot hyperspectral cameras provide rich instantaneous spectral measurements for ground-level machine vision, but at lower spatial resolution than standard RGB cameras. RGB-guided hyperspectral super-resolution (HSR) addresses this limitation by transferring spatial detail from a high-resolution RGB guide to a low-resolution hyperspectral image (HSI). These dual-camera systems are typically in a horizontal rig geometry, requiring cross-camera image alignment due to different fields of view. However, residual misregistration can inject spurious high-frequency details. Existing learned unaligned-fusion methods are usually trained for a fixed spectral support and spatial scale factors and can be computationally demanding, limiting their flexibility across sensors. We propose a lightweight and interpretable RGB-guided HSR framework combining cross-modal flow alignment with model-based Gram-Schmidt orthogonalization fusion. The method first warps the RGB guide onto the HSI grid, then estimates an energy-based confidence weight map by measuring local alignment reliability. This map is then used both in a weighted least-squares spectral regression and in a gated fusion between the super-resolved estimate and an HSI-preserving estimate. Unlike existing learned methods, the proposed framework has a low computational footprint and supports VIS-NIR spectral supports and scale factors without retraining. Experiments on the Real benchmark show that the proposed method improves reconstruction accuracy over learned fusion baselines while remaining substantially faster. On a 34-frame sequence acquired with our real RGB-HSI dual-camera setup, a reduced-resolution quantitative evaluation validates the method under genuine cross-sensor radiometric, noise, and geometric differences, while native-resolution qualitative results demonstrate deployment on the full 51-band VIS-NIR acquisition.

hep-ex [Back]

[134] Panda Diplomacy: Foundation Model Pre-training across Particle Imaging Detectors for High Energy and Nuclear Physics hep-ex | cs.CVPDF

Samuel Young, César Jesús-Valls, Kazuhiro Terao

TL;DR: 本文提出了一种名为Panda V2的通用点云自蒸馏预训练框架，旨在解决高能与核物理领域中基础模型因探测器特定架构或预训练目标而难以跨传感器模态复用的问题。该框架在三种性质不同的探测器模态（液态氩时间投影室、对撞机时间投影室、水切伦科夫探测器）上以最小改动独立预训练，并在下游任务中仅使用少量标注数据即达到或超越需要大量监督的专用基础模型性能。

Details

Motivation: 当前粒子与核物理领域的基础模型通常与特定实验绑定，受限于探测器专用架构或预训练目标，导致其难以跨不同传感模态复用，限制了模型的通用性和效率。

Result: 在仅使用1,000张标注图像进行下游任务适配的情况下，Panda V2在sPHENIX数据集上以70倍更少的标注事件匹配了最先进的粒子聚类性能，并显著改善了粒子识别；在LArTPC数据上，以高达1,000倍更少的标签匹配了Panda模型的粒子重建性能。此外，简单的线性探针揭示了与粒子因果关系和径迹曲率相关的物理意义潜在结构。

Insight: 创新点在于提出了一种通用的点云自蒸馏预训练框架，通过统一的架构和目标实现了跨不同探测器模态的有效预训练，大幅减少了下游任务所需的标注数据量，同时模型学到的表征蕴含了可解释的物理结构，为跨实验基础模型开发提供了新思路。

Abstract: Foundation models are increasingly being pursued in particle and nuclear physics, but existing approaches remain strongly tied to individual experiments through detector-specific architectures or pre-training objectives, limiting their reuse across sensing modalities. We show that a point cloud self-distillation framework yields a substantially more general sensor-level pre-training recipe. We show that the same refined architecture and objective can be independently pre-trained with minimal changes on three qualitatively different detector modalities: liquid argon time projection chamber (LArTPC), collider TPC, and water Cherenkov. Using 1,000 labeled images for downstream task adaptation, Panda V2 matches or exceeds specialized foundation-model baselines trained with orders of magnitude more supervision, matching state-of-the-art particle-clustering performance with 70x fewer labeled events on sPHENIX while substantially improving particle identification, and on LArTPC data matching Panda (arXiv:2512.01324) particle reconstruction with up to 1,000x fewer labels. Beyond reconstruction, simple linear probes reveal physically meaningful latent structure associated with particle causality and track curvature.

cs.AI [Back]

[135] SCAFFOLD: A Large-Scale Structured Dataset of Computer Science Research Figures with Diagram QA and Chain-of-Thought Reasoning Traces cs.AI | cs.CVPDF

Ranjit Raut, Aarav Subedi, Sagun Rai, Sudan Jha

TL;DR: 该论文提出了一个名为SCAFFOLD的大规模结构化数据集，专门针对计算机科学研究论文中的图表。该数据集包含图像、标题、上下文、问答对以及思维链推理轨迹，旨在训练视觉语言模型理解复杂的科学图表。

Details

Motivation: 当前缺乏一个公开数据集，能够将计算机科学论文中的图表（如架构图、流程图）与标题、上下文、问答及逐步推理配对，而这正是训练视觉语言模型理解此类信息密集型图表所必需的。

Result: 构建了三个规模的数据集：大型SCAFFOLD-157K（包含157,387个配对）、中型SCAFFOLD-37K和小型SCAFFOLD-12K，并利用SCAFFOLD-12K在Qwen2.5-VL-3B-Instruct模型上进行了基线实验。

Insight: 创新点在于首次创建了一个结合图表问答与思维链推理轨迹的计算机科学图表数据集，并通过布局检测、PDF解析和AI辅助问题生成来构建，为图表理解任务提供了关键资源。

Abstract: Computer science papers rely heavily on diagrams: architecture drawings, system flowcharts, and pipeline schematics that often carry more information than the text around them. There is currently no public dataset that pairs this specific kind of figure with captions, context, questions, answers, and step-by-step reasoning, which is exactly what is needed to train a vision-language model to understand them. We present \textbf{SCAFFOLD}\footnote{https://github.com/theranjitraut/scaffold}, a large-scale structured dataset of computer science research figures with diagram QA and Chain-of-Thought reasoning traces. This dataset consists of (image, caption, context, question-answer, chain-of-thought) tuples from arXiv computer science papers prepared using layout detection and PDF parsing, with an AI-assisted question-generation step. The resulting large-sized SCAFFOLD-157K dataset spans 3,058 papers with 29,887 figures (157,387 pairs), a medium-sized SCAFFOLD-37K dataset (36,797 pairs), and a small-sized SCAFFOLD-12K dataset (12,000 pairs). We used SCAFFOLD-12K for baseline experiments on Qwen2.5-VL-3B-Instruct.

[136] A survey of AI-generated voices and their detection cs.AI | cs.CVPDF

Chengzhe Sun, Tianle Yang, Siwei Lyu

TL;DR: 这篇综述论文全面概述了AI生成语音技术及其检测方法，涵盖了技术基础、最新进展、关键挑战、基准资源和未来方向，旨在为研究人员提供参考。

Details

Motivation: AI生成语音技术快速发展，在带来便利的同时也催生了冒充、欺诈和虚假信息等恶意用途，因此迫切需要开发有效的检测方法来应对这些威胁。

Result: 论文综述了当前最先进的语音生成与检测方法，并指出了该领域面临的独特挑战和现有基准资源，但未提及具体的定量实验结果或SOTA模型对比。

Insight: 论文的创新之处在于系统性地梳理了语音深度伪造检测这一新兴领域，强调了其相对于图像/视频检测的独特性（如语音学、韵律和听觉感知的复杂性），并明确了未来的研究挑战和方向。

Abstract: The ability of artificial intelligence (AI) models to generate highly realistic human voices has advanced rapidly. These technologies power accessibility tools, virtual assistants and creative applications, but they also enable harmful uses, including impersonation, fraud and disinformation. Recent incidents of voice cloning scams targeting businesses and political leaders underscore the urgent need for robust safeguards. Unlike image and video deepfakes, the detection of synthetic voices poses unique challenges due to the complexity of phonetics, prosody and auditory perception. This survey offers a comprehensive overview of AI voice generation and detection methods, encompassing both the technical foundations and the latest state-of-the-art advances. This study also identifies key open challenges, benchmark resources and future directions to make this survey useful for future researchers.

[137] UI-Venus-2 Technical Report cs.AI | cs.CL | cs.CV | cs.LGPDF

Venus Team, Zhuohan Cai, Haoxing Chen, Jiaxuan Chen, Weizhi Chen

TL;DR: 本文介绍了UI-Venus-2，一个通用的基础GUI代理，旨在通过统一的闭环推理-行动框架在移动、网页和桌面环境中操作。该工作通过扩展环境覆盖、任务构建和验证机制三个维度，以弥合基准模型与实际部署之间的差距，并集成了安全感知机制以确保可控执行。

Details

Motivation: 解决多模态GUI代理从基准模型转向可靠实际应用时面临的环境覆盖有限、任务构建脆弱和奖励验证不可靠等挑战。

Result: 通过扩展至超过170个多语言移动应用和原生桌面操作系统，并采用基于视觉关键点和多模型投票的追踪级与样本级评估器，为训练提供可靠的强化学习信号。

Insight: 创新点在于联合扩展环境、任务和验证三个关键维度，并集成安全感知机制，以构建更通用、可验证和自反思的GUI代理，推动领域向实际应用发展。

Abstract: Multimodal GUI agents have emerged as a promising paradigm for digital task automation, yet transitioning from benchmark-oriented models to dependable real-world applications remains challenging due to limited environment coverage, brittle task construction, and unreliable reward verification. In this work, we present UI-Venus-2, a general-purpose foundation GUI agent designed to operate across mobile, web, and desktop environments through a unified closed-loop reasoning-action framework. To bridge the gap toward practical deployment, we jointly scale three critical dimensions: (1) Environments, expanding coverage to more than 170 multilingual mobile apps and native desktop operating systems; (2) Tasks, employing a deep-research pipeline for function-grounded instruction generation; and (3) Verification, adopting trace-level and sample-level evaluators with visual keypoints and multi-model voting to ensure reliable RL signals for training. Furthermore, we integrate safety-aware mechanisms to ensure controlled execution of consequential actions. By offering a capable, efficient, and open-source foundation, UI-Venus-2 advances the field toward more generalizable, verifiable, and self-reflective agents for real-world applications.

[138] Vision Is Not Overhead: One-Pass Block Drafting for Lossless Speculative Decoding in Vision-Language Models cs.AI | cs.CL | cs.CVPDF

Jungseob Lee, Seongtae Hong, Dongyub Jude Lee, Chanjun Park, Jaehyung Seo

TL;DR: 本文提出了GLANCE，一种用于视觉语言模型的无损推测解码方法，通过单次前向传递生成整个候选块，并利用目标模型已融合的视觉-语言状态，避免了传统推测解码中视觉信息压缩或丢弃的问题，从而在保持输出不变的前提下显著加速生成过程。

Details

Motivation: 传统推测解码在视觉语言模型中陷入自相矛盾的循环：草稿模型必须保持自回归且小型化，导致无法充分利用图像信息，而缺乏视觉信息的草稿模型在图像可预测文本的区域最不可靠。

Result: GLANCE在未修改的目标VLM上实现无损解码，在单引擎单轮预算下解码速度比自回归快2.93倍，接受块长度比相同语料训练的EAGLE-3头长2.7倍，并在五个任务中验证了接受长度由目标的下一个词元熵决定且随任务基础性增强而增加的规律。

Insight: 创新点在于单次块草稿机制和块扩散头直接读取目标模型融合后的视觉-语言状态，使视觉计算对草稿模型零成本，并通过宽候选树单次验证确保精确贪婪解码，突破了传统推测解码在视觉信息利用和序列深度成本上的限制。

Abstract: Speculative decoding accelerates generation without changing its output, yet on vision-language models (VLMs) it has been caught in a self-defeating cycle. The drafter stays autoregressive, so it must stay small. A small drafter cannot afford the image at every step, so vision is compressed, pruned, or hidden. A drafter cut off from the image is then least reliable exactly where the image makes text predictable. We present GLANCE, the first one-pass block drafter that is lossless on an unmodified VLM target, and it breaks the cycle at both ends. A block-diffusion head reads the target’s already-fused vision-language state, so vision costs the drafter nothing, and fills a whole block in one forward pass, so depth costs no sequential steps. A wide candidate tree is verified in one target pass, and every audited prompt reproduces greedy decoding exactly. Grounded workloads reward this most, entering a verbatim-copy regime whose long runs cost an autoregressive drafter a pass for every token and a block drafter one in total. Under one engine and one round budget, GLANCE decodes up to 2.93x faster than autoregression, from one draft pass a round where the production EAGLE3-VL head takes eight, and accepts 2.7x longer blocks than an EAGLE-3 head trained on the same corpus. One law organizes these results. Accepted length is set by the target’s next-token entropy, with a fitted slope that steepens with grounding across all five tasks. The law transfers across targets and modalities and names its own boundary, since free-running text still favors a chain. Our code is available at https://github.com/js-lee-AI/GLANCE.

[139] LLM-Driven Autonomous Vehicles Inherit Human Driver Biases in Pedestrian Yielding: Results and Implications From A New Benchmark cs.AI | cs.CL | cs.CV | cs.CYPDF

Irem Yoldas, Martim Brandão, Jie Zhang, Odinaldo Rodrigues

TL;DR: 本文提出两种新的偏见测试方法（’All Else Being Equal’和’Self-Consistency’），用于评估大型语言模型（LLMs）和视觉语言模型（VLMs）在自动驾驶行人让行决策中的偏见。研究发现，这些模型在决策时受到行人性别、种族、宗教、残疾、年龄、肤色和社会经济地位等因素的影响，揭示了’常识’模型范式可能继承人类驾驶员偏见的问题。

Details

Motivation: 自动驾驶车辆（AVs）的公信力不仅取决于技术成功，还取决于其决策的公平性。鉴于心理学研究表明人类驾驶员存在偏见（如在美国对黑人行人的让行率较低），作者认为模型偏见分析应成为AV评估的一部分，特别是当前AV研究趋势使用通用’常识’模型来指导决策，但这些模型继承人类驾驶偏见的程度尚未充分研究。

Result: 研究结果显示，LLMs和VLMs在行人让行决策中均受到行人多种社会属性（如性别、种族、宗教等）的影响，导致偏见。虽然不同模型的偏见类型和程度各异，但存在共同模式，这质疑了’常识’模型范式的有效性，并强调需要修订该范式或解决下游偏见问题。

Insight: 创新点在于提出了两种针对LLMs和VLMs的偏见测试方法，以量化评估自动驾驶决策中的社会偏见。客观分析认为，该研究揭示了将通用AI模型应用于安全关键领域（如自动驾驶）时可能无意中放大人类偏见的风险，强调了在模型开发和评估中纳入公平性测试的必要性。

Abstract: Public trust in Autonomous Vehicles (AVs) may depend not only on technical success but also on the fairness of their decision making. While a recent trend in AV research involves using general purpose “common sense” models to guide AV decision making, the degree to which these inherit human biases in driving is still understudied. Given that psychology studies have shown human driver biases exist, such as lower pedestrian-yielding rates to Black pedestrians in the US, we argue that analyses of model bias should also be part of AV evaluation. Concretely, in this paper we propose two new bias testing methodologies for Large Language Models (LLMs) and Visual-Language Models (VLMs)-“All Else Being Equal” tests and “Self-Consistency” tests-in order to assess bias in pedestrian-yielding decisions. Our findings show that both LLMs and VLMs make yielding decisions which are influenced by pedestrian gender, ethnicity, religion, disability, age, skin tone and socio-economic status. While the type and degree of bias is different from model to model, we highlight common patterns-and raise questions about the “common sense” model paradigm, particularly the need to either revise the paradigm or address issues of downstream bias.

[140] Learning What to Retain: Gated-Memory Routing for Efficient Collaboration in Multi-Agent LLM Systems cs.AI | cs.CLPDF

Rakibul Hasan Rajib, Mengxing Zheng, Qian Lou

TL;DR: 本文提出了一种名为门控记忆路由（Gated-Memory Routing）的新框架，用于提升基于大语言模型（LLM）的多智能体系统的协作效率。该框架通过学习机制，动态地筛选和存储非冗余的推理步骤到执行记忆中，并基于此记忆和查询来路由决策，同时引入自适应停止控制器来终止执行。

Details

Motivation: 现有基于LLM的多智能体系统在协作时面临编排（orchestration）挑战：仅基于查询的路由无法适应中间进展或错误，而基于完整执行历史的路由则因处理所有冗余步骤而导致成本膨胀。因此，需要一个紧凑的状态来捕获有效进展，避免冗余上下文累积。

Result: 在五个推理和代码生成基准测试中，该框架取得了最佳平均准确率，比最强基线高出2.44个百分点，同时在HumanEval基准上推理成本降低了31.9%。

Insight: 创新点在于引入了学习型记忆写入门和检索门，动态构建并利用紧凑的执行记忆来指导路由决策，避免了历史过载；同时结合自适应停止机制，在证据充分时提前终止，实现了效率与准确性的平衡。

Abstract: Large language model (LLM)-based multi-agent systems tackle complex reasoning by orchestrating how multiple agents are configured and how they collaborate. A central challenge is to adapt orchestration to the evolving collaboration state. Routing from the query alone cannot adapt to intermediate progress or errors, which hurts accuracy. Routing from the complete execution history supplies this missing context, but forces later decisions to process every prior step, including redundant or low-utility ones. This creates an execution-history overload that inflates cost. Effective orchestration instead requires a compact state that captures useful progress without accumulating redundant context. We propose Gated-Memory Routing, which conditions each decision on the query and a learned execution memory. A learned Memory Write Gate commits only non-redundant reasoning steps, and a learned Retrieval Gate supplies each agent a compact, relevant subset, so every decision conditions on a clean, informative state. At each step, the system selects the next role and backbone from this memory, while an Adaptive Halting Controller stops execution once the memory contains sufficient evidence for answering. Across five reasoning and code-generation benchmarks, our framework is both effective and efficient: it attains the best average accuracy, exceeding the strongest baseline by 2.44 points, while reducing HumanEval inference cost by 31.9% relative to that baseline. Code is available at https://github.com/rajibrhasan/gated-memory-routing

[141] Control-Data Flow Separation: Stable Prompt Optimization in Multi-Agent LLMs cs.AI | cs.CL | cs.MAPDF

Wentao Zhang, Syed Shariyar Murtaza, Junaid Ahmad Bhatti, Utkarsh Soni, Yifan Nie

TL;DR: 本文提出控制-数据流分离框架，用于稳定优化多智能体大语言模型系统中的提示词。核心思想是将执行关键的控制协议（如消息路由、输出格式）与任务相关内容解耦，前者表示为类型化、可验证的程序对象，后者作为可优化的数据流。该方法在保持协议100%有效性的同时，持续提升任务性能。

Details

Motivation: 现有提示优化方法中，提示词同时承担生成任务内容和定义执行协议（如路由、格式化）的双重角色，导致优化内容时可能意外破坏协议，使整个智能体流程失效。

Result: 在合成推理、协作评论生成和保险评级工作流等任务上，该框架经验证实现了100%的最终协议有效性，并持续提升了任务性能。

Insight: 创新点在于基于控制流（结构化协议）与数据流（非结构化语言）的不同表示进行分离设计，使优化器能安全改进多智能体行为，避免提示漂移对关键接口的影响。这是一种将程序验证思想融入提示工程的系统设计方法。

Abstract: Prompt optimization can improve multi-agent LLM systems, but the prompts being optimized often serve two entangled roles: generating task-relevant content and specifying execution-critical protocols, such as message routing, output formatting, and termination signals, on which the underlying code relies. As a result, a prompt edit intended to improve content generation can inadvertently corrupt the protocol and cause the entire agent pipeline to fail. Our key observation is that these two roles have different representations: execution protocols are typically structured, while task-relevant content is usually expressed in unstructured language. Based on this, we propose control-data flow separation, where execution-critical control is represented as typed, validated program objects, while task-relevant language remains the optimizable data flow for agent communication. This design allows optimizers to improve multi-agent behavior without exposing the routing or formatting interface to prompt drift. Across synthetic reasoning, collaborative review generation, and insurance rating workflows, our framework empirically achieves 100% eventual protocol validity while consistently improving task performance.

[142] SciTrue: Reliable Scientific Claim Validation with Frontier and Open Language Models at the NTCIR SciClaimEval Task cs.AI | cs.CLPDF

Qiming Bao, Neşet Özkan Tan, Siyuan Wang, Mark Gahegan

TL;DR: SciTrue团队在NTCIR-19 SciClaimEval任务的两个子任务中，通过评估11个前沿和开源多模态模型，并结合轻量级后处理，在官方盲测排行榜上取得了领先成绩。研究发现，强指令调优模型已具备竞争力，任务中的配对结构是性能提升的最大杠杆，且大部分剩余错误源于标签噪声而非模型能力不足。

Details

Motivation: 该研究旨在解决科学声明验证任务，即根据论文中的图表验证科学主张的真实性，旨在评估和提升多模态模型在此类任务上的可靠性和性能。

Result: 在NTCIR-19 SciClaimEval任务的官方盲测中，SciTrue在四个证据类别/子任务组合中的三个取得明显领先，在第四个任务的主要指标上并列第一。具体地，GPT-5.5和Claude Fable 5在子任务2上达到97.7分，超越了公开基线模型。

Insight: 创新点包括：揭示了任务配对结构（如无泄漏配对先验）对性能提升的关键作用，远超过模型替换或集成；通过案例分析指出剩余错误多源于数据集标签噪声，表明模型真实能力被低估；同时警示了数据打包中可能存在的标签信息泄漏问题。

Abstract: We describe the SciTrue team’s participation in both subtasks of the NTCIR-19 SciClaimEval task\cite{sciclaimeval}, which asks systems to verify scientific claims against the tables and figures of a paper. Rather than tuning a single model, we benchmark eleven frontier and open multimodal models under one honest, per-sample protocol and combine them with light, transparent post-processing. On the official, blind test leaderboard (Section\ref{sec:results}), SciTrue placed first by a clear margin in three of the four evidence-category/subtask combinations, and tied for first on the primary metric in the fourth. Three findings explain the result. First, strong instruction-tuned models are already competitive: Claude Opus~~4.8 and Gemma-4-31B each exceed the strongest public baseline (o4-mini), and GPT-5.5 and Claude Fable~~5 lead both subtasks (97.7 on Subtask~2). Second, the task’s pairing structure is the largest lever: a \emph{leak-free pair prior} that recovers the Supported/Refuted pairing from the claim text alone (a visible field) and assigns Supported to the higher-confidence evidence raises Subtask-1 pair-accuracy from 72.2 to 93.5, far more than any model swap or ensemble weighting. Third, a case-by-case audit finds that most residual errors are visually-undetectable label-mapping swaps or dataset label noise, so measured accuracy understates the true ability and the fixable-by-modeling headroom is small. Controlled fine-tuning, distillation, and agentic consistency-checking support the same conclusions, and we document throughout a measurement leak—label information reaching a system through the packaging of the data rather than its content—in which the released file ordering encodes the label, including one instance that briefly misled our own pipeline.

[143] Neuro-Symbolic Geometric Abstraction (NeuSOGA): From Observations to Symbolic Mathematical Representations cs.AI | cs.CV | cs.GRPDF

Qingde Li, Qingqi Hong, Jie Tian

TL;DR: 本文提出了一种名为NeuSOGA（神经符号几何抽象）的框架，旨在解决将几何观测数据转化为显式、可解释的符号数学表示这一核心挑战。该框架通过结合拓扑引导的结构发现、基础模型感知、自适应多尺度几何抽象和符号合成，逐步将点云、投影等观测数据转化为支持任意阶平滑度、可加性组合和闭式计算的解析隐式模型。

Details

Motivation: 动机在于解决人工智能中一个基本问题：如何将观测数据转化为适合抽象、解释和推理的显式符号表示，以克服当前基于大规模统计学习的AI系统其知识通常编码在难以检查或分析的隐式参数中的局限性。

Result: 在ModelNet40点云数据集、任意视角投影和分割光学观测上的实验表明，NeuSOGA能够将多样化的观测数据转化为紧凑的符号表示，并在不同传感模态和视角下保持关键的几何与拓扑结构。

Insight: 核心创新点在于提出了一种从观测到符号的渐进式、可解释的神经符号混合框架，其生成的符号数学表示（如隐式面积样条）具有可解释、可编辑和数学显式的特性，这为几何抽象和符号推理提供了一条新途径。

Abstract: A fundamental challenge in artificial intelligence is the transformation of observations into explicit symbolic representations suitable for abstraction, interpretation, and reasoning. While modern AI systems achieve remarkable perceptual capabilities through large-scale statistical learning, the resulting knowledge is typically encoded within latent parameters that are difficult to inspect or manipulate analytically. Inspired by Neuro-Symbolic AI and theories of human abstraction, this paper investigates the formation of symbolic mathematical representations from geometric observations. We propose NeuSOGA (Neuro-Symbolic Geometric Abstraction), a framework that progressively transforms observations into topological abstractions, geometric abstractions, and ultimately symbolic mathematical representations. The architecture combines topology-guided structural discovery using Euclidean Distance Transforms, foundation-model perception using Segment Anything, adaptive multi-scale geometric abstraction, and symbolic synthesis through Implicit Area Splines. The resulting representation is an analytical implicit model supporting arbitrary-order smoothness, additive composition, and closed-form evaluation. Unlike neural latent encodings, the generated representation remains interpretable, editable, and mathematically explicit. Experiments on ModelNet40 point clouds, arbitrary-view projections, and segmented optical observations demonstrate that NeuSOGA transforms diverse observations into compact symbolic representations while preserving essential geometric and topological structure across sensing modalities and viewing directions. NeuSOGA provides an interpretable and explainable pathway from observation to symbol and establishes

[144] EdiTikZ: Scientific Figure Editing from Revision Trajectories cs.AI | cs.CL | cs.CVPDF

Christian Greisinger, Zhixue Zhao, Steffen Eger

TL;DR: 本文提出了EdiTikZ模型，专注于科学图表编辑任务。通过挖掘arXiv、GitHub和TeX SE中的TikZ代码修订轨迹，构建了大规模数据集DaEdiTikZ和人工精炼的基准DaEdiTikZ-Bench。训练了基于Qwen3.5的4B和9B参数模型，采用重建与编辑联合学习及强化学习优化，在自动和人工评估中表现优异。

Details

Motivation: 现有视觉语言模型在生成科学图表方面表现良好，但制作出版级图表需要迭代编辑，而当前方法依赖昂贵的专有系统、仅关注评估或使用合成编辑数据。本文旨在利用自然发生的科学修订轨迹作为可扩展的监督来源，解决科学图表编辑这一重要但未充分探索的任务。

Result: 在自动评估中，9B模型优于所有测试基线；在9位标注者4320次评分的人工评估中，优于GPT-5.6-Sol，与Gemini-3.1-Pro相当；在严重分布外偏移下，仍与GPT-5.6-Sol在2K训练序列长度范围内竞争。

Insight: 创新点包括：首次利用自然修订轨迹构建大规模科学图表编辑数据集；提出联合学习重建与编辑的训练范式，并结合强化学习优化渲染保真度和编辑应用；证明了紧凑模型在专业编辑任务上可超越大型通用模型。

Abstract: Vision-language models (VLMs) have shown strong performance in generating scientific figures from text or images. However, producing publication-ready figures requires iterative refinement, making scientific figure editing an important yet largely unexplored task. Existing approaches rely on costly proprietary agentic systems, focus primarily on evaluation, or construct training supervision from synthetically generated edits. Instead, we leverage naturally occurring scientific revision and development trajectories as a scalable source of supervision. To this end, we introduce DaEdiTikZ, the first large-scale dataset of revision-derived scientific figure edits, constructed by mining 391K plausible TikZ edit pairs from arXiv, GitHub, and TeX SE and inferring 781K directed edit instructions with a VLM conditioned on rendered figures and TikZ code. We further introduce DaEdiTikZ-Bench, a human-refined benchmark with 790 instances, and train two compact Qwen3.5-based EdiTikZ models (4B and 9B) by jointly learning reconstruction and editing, followed by reinforcement learning (RL) with complementary rewards for rendered fidelity and edit application. Automatic evaluation places our 9B model above all tested baselines, while human evaluation with 9 annotators and 4,320 ratings places it above GPT-5.6-Sol and on par with Gemini-3.1-Pro. Under severe out-of-distribution shifts, it remains competitive with GPT-5.6-Sol near its 2K training sequence-length regime. Models and datasets will be released.

[145] RPCBench: A Benchmark for Proactive Premise Critique in LLM-based Recommendation cs.AI | cs.CLPDF

Zhongru Chen, Yuan Wu, Yi Chang

TL;DR: 本文提出了RPCBench基准，用于评估基于大语言模型的推荐系统中主动前提批判的能力，即检测、诊断和处理推荐请求中的错误前提。该基准包含五个推荐领域的证据基础测试实例，覆盖十种前提失败类型，并设计了细粒度评估框架。通过对11个LLM的系统评估，发现主动检测是主要瓶颈，模型在前提不明确错误上表现最差，且目标关键信息密度比冗余证据更重要，过长推理会因过度思考而降低性能。

Details

Motivation: 现有推荐基准主要评估排序、生成或偏好满足，而错误检测基准通常缺乏推荐特定的用户和候选证据基础，因此需要专门评估LLM推荐助手识别有缺陷推荐请求的能力。

Result: 在RPCBench基准上系统评估了11个LLM，发现主动检测是主要瓶颈，模型在前提不明确错误上表现最差，性能在中等推理长度达到峰值，过长推理会导致过度思考惩罚。

Insight: 创新点在于提出了首个专注于推荐前提批判的基准RPCBench，并设计了细粒度评估框架；客观分析发现目标关键信息密度比冗余证据更重要，且推理长度与性能存在非单调关系，这对优化LLM推荐系统的推理过程具有借鉴意义。

Abstract: Large language models are increasingly used as interactive recommender assistants. Their evaluation should therefore go beyond plausible item recommendation and test whether they can recognize flawed recommendation requests. Existing recommender benchmarks mainly assess ranking, generation, or preference satisfaction, while existing error-detection benchmarks are usually not grounded in recommendation-specific user and candidate evidence. To address this gap, we introduce RPCBench, a benchmark for evaluating Recommender-Premise Critique: the ability to detect, diagnose, and properly handle faulty premises in natural-language recommendation requests. RPCBench contains evidence-grounded test instances from five recommendation domains and covers ten types of premise failures. Each instance provides a visible recommendation context and a corrupted user query. We further design a fine-grained evaluation framework that measures proactive detection, error localization, post-detection handling strategy, and evidence faithfulness. Through a systematic evaluation of 11 LLMs, we find that proactive detection is the main bottleneck in Recommender-Premise Critique, and models perform worst on underspecified-premise errors. We also observe that target-critical information density matters more than redundant evidence, and that longer reasoning does not monotonically improve critique quality: performance peaks at intermediate reasoning length, while overly long reasoning is accompanied by an overthinking penalty. The code is available at https://github.com/ZhongruChen/RPCBench.

[146] VIBE-Bench: Evaluating Personalized Large Language Models When Profiles Don’t Mean Preferences cs.AI | cs.CLPDF

Yiwen Jiang, Yang Deng, Stephanie Fong, Zimu Wang, Yaling Shen

TL;DR: 本文提出了VIBE-Bench基准测试，用于评估个性化大语言模型在‘档案-偏好概念错位’场景下的表现，即当用户可观察的档案线索与查询特定偏好处于不同概念空间时，模型难以通过语义检索进行个性化推理。该基准包含两个基于心理学的任务、3504个人物角色和12239个对话，要求模型进行跨概念偏好推理。

Details

Motivation: 现有个性化大语言模型基准大多假设用户偏好可以从语义相关的历史中检索，但忽略了档案线索与查询偏好可能处于不同概念空间的实际情况，导致语义检索失效，因此需要新的评估框架来研究这一未充分探索但重要的失败机制。

Result: 在VIBE-Bench上的实验表明，当前多种个性化方法严重依赖浅层语义关联，无法学习到稳健的跨概念映射，从而在档案-偏好概念错位场景下表现不佳。

Insight: 论文的创新点在于识别并形式化了‘档案-偏好概念错位’这一个性化LLM的独特失败机制，并构建了一个专注于评估跨概念偏好推理能力的基准测试，推动了超越语义匹配的偏好推理研究。

Abstract: Personalized Large Language Models (PLLMs) aim to tailor responses to individual users, where a central challenge is preference reasoning: inferring query-relevant preferences from user-related history. Existing benchmarks, however, largely assume that such preference can be retrieved from semantically related history. We study an underexplored but practically important regime, profile-preference conceptual misalignment (PRCM), where observable profile cues and query-specific preferences lie in different concept spaces, making semantic retrieval inconsistent for personalization. We introduce VIBE-Bench, a benchmark with two psychology-grounded tasks, 3,504 personas and 12,239 dialogues, including a manually verified gold test set, and requires cross-concept preference reasoning beyond surface semantic overlap. Experiments with several personalization methods show that current PLLMs largely rely on shallow semantic correlations and fail to acquire robust cross-concept mappings. These findings establish PRCM as a distinct failure regime in PLLMs and position VIBE-Bench as a focused testbed for advancing preference reasoning beyond semantic matching.

[147] Selective Agent Guidance via Entropy: Learning Autonomous Policies from Imperfect VLM Teachers cs.AI | cs.CL | cs.LGPDF

Matteo Merler, Giovanni Bonetta, Davide Zago, Rossella Cancelliere, Bernardo Magnini

TL;DR: 本文提出SAGE框架，通过基于熵的选择性引导机制，从昂贵且不完美的视觉语言模型（VLM）教师中学习轻量级自主策略。SAGE仅在学习者不确定时查询VLM，在训练中执行建议动作，并将引导蒸馏到强化学习策略中，同时根据环境优势对教师建议进行加权。

Details

Motivation: 解决直接使用VLM作为策略时存在的成本高、脆弱性（需每步查询、无法从环境交互中改进、易重复系统性错误）的问题，旨在从在线、昂贵但信息丰富的VLM教师中学习廉价自主策略。

Result: 在稀疏奖励的视觉推理和导航任务中，SAGE学习的策略在评估时无需VLM引导，在多个环境中优于无引导的强化学习，部分场景下甚至超越VLM教师性能；同时将VLM使用量减少到仅部分训练步骤，部署时无需调用。

Insight: 创新点在于基于熵的不确定性触发选择性VLM查询机制，以及利用环境优势对教师建议进行加权蒸馏；核心洞察是VLM可作为临时、不完美的引导源，其价值通过交互被测试和内化，而非固定策略。

Abstract: Vision-Language Models (VLMs) provide useful priors for interactive decision-making, but using them directly as policies is expensive and brittle: they must be queried at every step, do not improve from environment interaction, and can repeat systematic errors. We study how to learn a cheap autonomous policy from an online, expensive, and imperfect but informative VLM teacher. We propose SAGE (Selective Agent Guidance via Entropy), a framework that queries a VLM only when the learner is uncertain, executes the suggested action during training, and distills guidance into a lightweight Reinforcement Learning (RL) policy. Because VLM advice is not always reliable, SAGE can weight teacher-action distillation using environment-derived advantages rather than treating all suggestions as equally useful. Across sparse-reward visual reasoning and navigation tasks, SAGE learns policies that act without VLM guidance at evaluation time and improves over unguided RL in several environments, including settings where the learned policy exceeds its VLM teacher. The results show that selective guidance is most beneficial when the VLM can help the agent discover high-reward trajectories, and less useful when unguided exploration already succeeds or teacher actions do not lead to informative experience. SAGE also reduces VLM usage by prompting the teacher only on a fraction of training steps and requiring no VLM calls at deployment. Overall, our results suggest that VLMs don’t need to be used as fixed policies to be useful; they can instead act as temporary, imperfect sources of guidance whose value is tested and internalized through interaction.

Zhaoliang Chen, Jie Fu

TL;DR: 本文提出了Latent Recurrent Thoughts (LRT)方法，旨在让冻结的大型语言模型在连续表示空间中进行推理。该方法通过一个小型辅助网络生成连续的潜在思考作为输入，并利用一个微小的循环推理器对这些潜在状态进行多步迭代精炼，从而将计算深度与模型大小解耦。

Details

Motivation: 解决传统思维链推理在离散token空间中展开所导致的错误传播和依赖模仿轨迹的问题，探索在模型的连续表示空间中进行推理，以规避这些限制。

Result: 在符号推理任务（Countdown-4, Sudoku）和自然语言推理任务（HumanEval, MBPP, StrategyQA）上，LRT在相同解码器、提示、数据和训练预算下，显著优于先前的冻结解码器连续空间推理方法，并且以远低于推理计算成本的方式，在同一骨干模型上超越了非思维链提示方法。

Insight: 创新点在于将推理过程移至连续潜在空间，并采用循环精炼机制迭代优化潜在状态，这允许深度计算独立于模型规模，同时保持了大型语言模型的冻结状态，专注于其序列建模和解码优势。

Abstract: Chain-of-thought reasoning unfolds in discrete token space: each step is committed as text, errors propagate, and eliciting good traces presupposes traces to imitate. Reasoning instead in a model’s continuous representation space - where intermediate states are vectors rather than words - sidesteps these constraints, but leaves open how those latent states should be computed. We approach this along two axes. First, we keep a large language model (LLM) frozen and use it for what it is already good at - modeling and decoding sequences - while a small auxiliary network supplies continuous latent thoughts as input. Second, we produce those latents by recurrence: a tiny recurrent reasoner refines them over many steps, decoupling the depth of computation from the size of the model, so that the latents are a product of iterative processing rather than a single forward pass. We instantiate this as Latent Recurrent Thoughts (LRT): a task-dedicated proposer supplies base latents, a recurrent reasoner refines them through bounded residual corrections, and the frozen LLM decodes the answer. On symbolic reasoning with answer supervision but no reasoning traces (Countdown-4, Sudoku) and on natural-language reasoning (HumanEval, MBPP, StrategyQA), LRT substantially outperforms prior frozen-decoder continuous-space reasoning methods under an identical decoder, prompt, data, and training budget, and outperforms non-thinking-mode chain-of-thought prompting on the same backbone at a small fraction of its inference compute.

cs.HC [Back]

[149] Designing Proactive Thought Partners for Writing cs.HC | cs.AI | cs.CLPDF

Chao Zhang, Abe Davis, Chih-Wei Chen, Chin-Chia Hsu

TL;DR: 本文研究了主动式思维伙伴的设计空间，即能够在写作过程中主动提供可定制化高层次认知支持的AI代理。通过开发一个技术探针并部署给16名参与者进行为期一周的测试，研究发现用户通过前瞻性规划来配置主动支持，利用建议进行创意生成和自我监控，并重视轻量级的视觉呈现和非指令性的修辞框架以实现非侵入式干预。

Details

Motivation: 写作涉及从构思到修改的多种认知活动，且作者的需求因人因时而异。现有主动式工具主要集中于通用文本辅助（如自动补全），缺乏提供适时、定制化高层次认知支持的能力。

Result: 研究通过一个允许用户配置伙伴角色和主动性的技术探针进行部署实验，定性结果表明参与者成功利用该工具进行前瞻规划、创意生成和自我监控，并认可其非侵入式干预设计。

Insight: 创新点在于提出了’主动式思维伙伴’的概念，强调可定制性、时机把握和轻量非指令性交互。从客观角度看，其将主动AI支持从通用文本操作提升到高层次认知任务，并通过配置化和情境感知实现个性化，对设计写作助手具有重要启示。

Abstract: Writing involves diverse cognitive activities, from ideation to revision, and writers’ needs vary across individuals and moments. Proactive AI promises to provide the right support at the right time, yet existing proactive tools largely focus on generic textual assistance, such as autocomplete. This paper studies the design space of proactive thought partners: AI agents that proactively offer customizable, higher-level cognitive support during writing. We instantiated this concept in a technology probe and deployed it with 16 participants for one week. The probe allows users to create partners by configuring their roles and proactivity. As users write, relevant partners take the initiative at appropriate moments to offer suggestions. Our findings show that participants configured proactive support through prospective planning, used suggestions for both idea generation and self-monitoring, and valued lightweight visual representations alongside non-directive rhetorical framing for non-intrusive interventions. We derive implications for designing proactive writing assistants around customization, timing, engagement, and representation.

Table of Contents

cs.CL [Back]

[1] Behaviorally Grounded User Profiles from the Wild for Personalized Alignment and Multi-Perspective Reasoning cs.CL | cs.AIPDF

[2] Life Operators: a self-evolving framework for multiscale life modelling cs.CL | cs.AI | physics.bio-phPDF

[3] Do Multimodal LLMs See Before They Read? Diagnosing Contextual Sycophancy cs.CL | cs.AIPDF

[4] Do General NLP Embeddings Capture Ontological Reasoning? cs.CL | cs.AIPDF

[5] Uncovering and Mitigating Aggregation-Induced Reward Hacking in Multi-Reward Reinforcement Learning cs.CLPDF

[6] NSIDDx: A Design Framework for Neuro-Symbolic, Practitioner-First Differential Diagnosis in Low-Resource Settings cs.CLPDF

[7] Slow to See, Slow to Suppress: Understanding the Effects of Modality in Context-Memory Conflicts cs.CLPDF

[8] From Tool Use to Technological Agency: LoopCAT as a Local-First, Open-Source Tool for Translation Technology Education cs.CLPDF

[9] Neurosymbolics for Data Engineering: Achieving Long Context Token Reduction Without Finetuning cs.CL | cs.AI | cs.LGPDF

[10] (V)LMs generalize beyond surface co-occurrence: Evidence from cross-modal number agreement cs.CL | cs.AIPDF

[11] Removable and Irreducible: A Token-Cost Ledger for the Multilingual Tokenization Tax cs.CLPDF

[12] MemeBridge: A Dataset for Benchmarking and Mitigating the Bidirectional Cultural Gap in Meme Interpretation cs.CL | cs.HCPDF

[13] Same Semantics, Different Outcome: On the Modality Robustness of Multimodal LLMs under Knowledge Conflict cs.CLPDF

[14] EM^2Mem: Event-Centric Multimodal Memory for Large Language Models cs.CL | cs.AI | cs.LG | cs.MMPDF

[15] Trust Your Guide Only When Certain: Uncertainty-Aware Sparse Alignment at Inference Time cs.CLPDF

[16] ExpArt-KG: Artwork Image Description Generation through Iterative Exploration of Knowledge Graphs cs.CL | cs.CVPDF

[17] Creative Generation via Multi-Agent Debate: Does Debate Suppress Diversity? cs.CLPDF

[18] A Certificate-Producing Cascade for Equational Implication: The SAIR EQT2 Stage 2 Solver cs.CLPDF

[19] Joint Training Is Not Enough: Conditioned Cross-Granularity Training for Multimodal Document Understanding cs.CLPDF

[20] SFAD: Speculative Factuality-Aware Decoding cs.CLPDF

[21] Instella-MoE Technical Report cs.CL | cs.AIPDF

[22] TEIDAN: A Multilingual Multiparty Dialogue Corpus cs.CL | cs.HCPDF

[23] Dense Process Supervision for Search Agents via Fact Utility Estimation cs.CL | cs.LGPDF

[24] PersianAnonymizer: Evaluating LLM-Labeled Training for Efficient NER-based Anonymization in Persian cs.CLPDF

[25] OUTLETS: Output-Length Prediction from Speculative Decoding Backbones cs.CLPDF

[26] Beyond Magnitude: Contrastive Routing for Modular Mixture-of-Experts cs.CLPDF

[27] ClinTraceBench: Source-Verifiable Longitudinal Clinical Reasoning over EHR-Derived Dialogues cs.CLPDF

[28] CaRL-EM: Cost-Aware Reinforcement Learning for Entity Matching with LLMs cs.CLPDF

[29] PersuaRL: Reinforcement Learning-Driven Multi-Expert Selection for Persuasive Dialogue Generation in Insurance cs.CLPDF

[30] From Base Rollouts to RL Reasoning: A Budgeted Search Perspective cs.CLPDF

[31] VerTox: Verifiable Reward-Guided Corpus Poisoning Against Neural Ranking Models cs.CL | cs.IRPDF

[32] Explore Before Committing: Hypothesis-Guided Search for Deep Research Agents cs.CLPDF

[33] Where the Verifier Fails: A Category-Level Audit of Reward Signals in RLVR cs.CL | cs.LGPDF

[34] Separating Syntax from Language: A Mechanistic Account of Translation in Multilingual LLMs cs.CLPDF

[35] InSight: A Benchmark for Agentic Claim Verification in Interactive Visualizations cs.CL | cs.CV | cs.HCPDF

[36] When Tokenization is Secretly Output Supervision cs.CLPDF

[37] From Rollouts to Recipes: Self-Contained Post-Training for LLMs cs.CLPDF

[38] Knowledge Distillation During Mid-Training Favors Reasoning over Factual Recall cs.CLPDF

[39] From Production Traffic to Post-Training: Building a Self-Hosted LLM That Covers the Corporate Request Mix cs.CLPDF

[40] Scaling Near-Optimal SFT-RL Annotation Budget Allocation from Small to Large LLMs cs.CL | cs.AI | cs.LGPDF

[41] Closing Cost-Quality Gap in Document VLMs: Difficulty-Aware Data Curation and Quality-Adjusted Deployment Economics cs.CLPDF

[42] StudentSim: Training LLM-based Student Simulators cs.CLPDF

[43] The Rise of Verbal Reinforcement Learning cs.CL | cs.AIPDF

[44] CordisBench: Can Language Models Reason About Component Lifecycles in Dynamic Agent Harnesses? cs.CL | cs.AIPDF

cs.CV [Back]

[45] Distributed Implicit Harm: A Compositional Safety Blind Spot in MLLM-Based Video Moderation cs.CV | cs.AIPDF

[46] ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-training cs.CVPDF

[47] Beyond Language Priors: Diagnosing and Fixing Visual-Origin Hallucinations in Multimodal LLM cs.CVPDF

[48] Beyond Blind Compliance: Benchmarking Task Verification in OCR Reasoning cs.CVPDF

[49] CoLT-Drive: Counterfactual Long-Tail Benchmarking and Knowledge-Preserving Adaptation for Driving Affordance Prediction cs.CV | cs.AI | cs.CL | cs.ROPDF

[50] Qwen-Drive-1.0: An Initial Step towards a Vision-Language Foundation Model for Autonomous Driving cs.CVPDF

[51] CrossFeat: Bridging Imaging Modalities in Feature Descriptor Space cs.CVPDF

[52] StreamScout: Learning When to Look Deeper for Streaming Video Understanding cs.CVPDF

[53] Where Should Experience Live? Hierarchical Hebbian Memory for Continual Vision Transformers cs.CV | cs.NEPDF

[54] SlideMix: Enhancing Whole Slide Image Analysis via Multimodal Shuffling cs.CVPDF

[55] FoldingAgent: Inferring Parametric Origami Procedures from Demonstration Videos cs.CV | cs.AI | cs.GRPDF

[56] Unmasking Face Embeddings: Reading, Rendering and Naming with Foundation Models cs.CVPDF

[57] Instance-Guided Report Anchoring for Text-Free 3D Abnormality Segmentation in Chest CT cs.CVPDF

[58] ViTAL-X: Video-Text Alignment with Cross-Modal Temporal Edits cs.CVPDF

[59] Soft-Argmax for the Projective Plane via the Veronese Embedding cs.CV | cs.LGPDF

[60] A Glance Is All You Need: Single-Pass Fine-Grained Image Captioning with SimLoss cs.CVPDF

[61] SAM3-LoRA: Parameter-Efficient Adaptation of a Concept-Promptable Foundation Model for Multi-Class Structural Defect Segmentation cs.CVPDF

[62] Less Is More: Balancing Positive and Negative Space in Visual Concept Blending cs.CV | cs.HCPDF

[63] BrainDiff: Longitudinal Report Generation for Multimodal Brain MRI cs.CVPDF

[64] Streaming4D: Accelerate 4D World Models via Block-wise Video Generation and Incremental Reconstruction cs.CVPDF

[65] Restrict, Don’t Retrain: Inference-Time VLM Guidance for Zero-Shot Aerial Segmentation cs.CV | cs.AIPDF

[66] You Cannot Photograph the Same Street Twice: Reliability Limits in Vision-Language Measurement of Urban Change cs.CVPDF

[67] Beyond Landmark Extraction: A Framework for Robust Geometric Feature Construction in Structured Image Classification cs.CVPDF

[68] Physically Plausible Video Generation via Visual-Semantic Chain-of-Events Conditioning cs.CVPDF

[69] Do Satellites See Commuters? A Critical Benchmark of Vision Foundation Models cs.CVPDF

[70] Teaching Vision-Language Models to Use the Scale They Are Given: Label-Free Equivariance Training for Metric Physical Reasoning cs.CVPDF

[71] Separating perception from reasoning in vision-language models: a model-free render ceiling for crystal structures cs.CV | cond-mat.mtrl-sci | physics.chem-ph | quant-phPDF

[72] DGNet: Dual-knowledge Guided Network for Infrared Small Target Detection cs.CVPDF

[73] EarthLD: Towards Unified Open-World Landslide Understanding via Vision-Language Guided Diffusion Models cs.CVPDF

[74] Controllable Image Captioning with Prompt-Conditioned Scene Rewards cs.CV | cs.CL | cs.LGPDF

[75] Solaris: Towards Interfaces That Are Generated, Not Coded cs.CV | cs.AIPDF

[76] Mind the Rift: Cross-Scale Coupling Mismatch for AI-Generated Video Detection cs.CV | cs.MMPDF

[77] Feed-Forward Multi-view Multi-person Reconstruction with Contrastive Human-Aware 3D Representation cs.CVPDF