cs.CL [Total: 28]
cs.CV [Total: 72]
eess.IV [Total: 3]
cs.AI [Total: 11]
cs.SE [Total: 1]
cs.HC [Total: 1]
cs.SD [Total: 1]
cs.RO [Total: 1]
cs.NI [Total: 1]
cs.LG [Total: 7]
cs.IR [Total: 1]

cs.CL [Back]

[1] Same Facts, Different Diagnosis: Measuring and Mitigating Narrative Anchoring in Clinical Language Models cs.CL | cs.AIPDF

Prabhjot Singh, Pritam Deka, Vijay Chennareddy

TL;DR: 这篇论文研究了临床语言模型中的‘叙事锚定’现象，即相同的临床事实以不同的社会语言学风格（语域）表达时，会导致模型的诊断输出产生分歧。作者构建了一个包含1000个USMLE临床案例的数据集，每个案例被重写成三种不同语域的风格，并提出了一个名为NarrativeShield的三智能体流水线方法来缓解此偏差。

Details

Motivation: 动机在于揭示和量化临床语言模型对非临床内容（如社会语言学语域）的敏感性，这种敏感性会导致诊断决策的不稳定，而现有关于人口统计学偏见的研究未能完全捕捉这种仅由语域变化引起的偏差。

Result: 在测试的七个涵盖三种架构家族和规模的模型中，叙事锚定现象在直接提示下均具有统计显著性，叙事锚定差距在0.064到0.151之间。提出的NarrativeShield方法将该差距降至接近零（-0.004到0.037），并在所有模型中实现了最低的严重不稳定决策率，但大多数模型付出了适度的、机制上预期的准确性代价。

Insight: 论文的创新点在于识别并形式化了‘叙事锚定’这一新的失败模式，并提出了一个结构化的、基于事实提取和验证的流水线方法（NarrativeShield）来有效缓解它。客观来看，其贡献在于将偏差研究从显式的人口统计学标记扩展到更微妙的社会语言学语域，并强调了指令遵循能力对于执行去偏干预的重要性。

Abstract: Large language models used for clinical diagnostic reasoning are sensitive to sociolinguistic register, not just clinical content. We term this failure mode Narrative Anchoring: identical clinical facts expressed in different registers cause diagnostic outputs to diverge. Unlike prior demographic-bias work, which manipulates explicit identity tokens such as race or income, our benchmark isolates register as the sole channel of variation, with no demographic marker present in any form. We construct a dataset of 1,000 USMLE clinical vignettes, each rewritten into three sociolinguistically distinct personas under an independently audited fact-preservation guarantee, verified by a separate model that never sees the generation prompt. Across seven language models spanning three architecture families and scales, Narrative Anchoring is statistically significant under direct prompting in every model tested, with a Narrative Anchoring Gap of 0.064 to 0.151. Chain-of-thought reasoning and explicit debiasing instructions reduce the bias only partially, and their apparent gains are frequently confounded by accuracy collapse. We introduce NarrativeShield, a three-agent pipeline that structurally extracts and verifies clinical facts before diagnostic reasoning begins, reducing the Narrative Anchoring Gap to near-zero ($-0.004$ to $0.037$) and achieving the lowest rate of severely unstable decisions (DSS $<$ 0.8) of any method across all models, at a modest and mechanistically expected accuracy cost for most models. A stress test using a non-instruction-tuned base model shows that executing a debiasing intervention at all is gated by zero-shot instruction-following ability, not prompt content alone. We release our dataset, human-validated for fact preservation, as a standalone resource for studying register-based clinical bias.

[2] AHA-Memes: A Fine-Grained Multimodal Benchmark for Understanding Hate in Arabic Memes cs.CL | cs.AIPDF

Mohamed Bayan Kmainasi, Ali Ezzat Shahroor, Abul Hasnat, Md. Rafiul Biswas, Wajdi Zaghouani

TL;DR: 本文介绍了AHA-Memes，这是首个大规模、细粒度标注的阿拉伯语仇恨表情包基准数据集，包含5K人工标注和66K自动标注样本。论文评估了多种单模态、多模态模型以及视觉语言模型在零样本和微调设置下的性能，为阿拉伯语仇恨表情包检测建立了基线并揭示了关键挑战。

Details

Motivation: 仇恨表情包是一种日益增长的多模态在线危害形式，而阿拉伯语在此领域的研究不足，现有资源主要关注宣传或粗粒度的有害内容标签，缺乏细粒度分析。

Result: 论文在AHA-Memes基准上对文本、图像、多模态融合模型以及少样本上下文学习和视觉语言模型进行了基准测试，结果建立了强基线，并突显了基于文化的阿拉伯语仇恨表情包检测的关键挑战。

Insight: 创新点在于构建了首个细粒度、多标签标注的大规模阿拉伯语仇恨表情包数据集，并提供了详尽的模型基准评估，强调了文化背景在仇恨内容检测中的重要性，为未来研究提供了数据和工具支持。

Abstract: Hateful memes are a growing form of multimodal online harm, where hostile intent is often conveyed through the joint interpretation of images, text, cultural references, and implicit targets. While hateful meme detection has advanced in high-resource languages, Arabic remains underexplored, with existing meme resources focusing mainly on propaganda or coarse harmful-content labels. We introduce AHA-Memes (Arabic HAteful Memes), which is, to our knowledge, the first large-scale Arabic hateful meme benchmark with fine-grained, multi-label annotations. The dataset includes 5K manually annotated memes using a taxonomy that captures hate types, i.e., attack strategies. We further provide ~66K silver-labeled memes to support future studies. We benchmark text-only, image-only, and late-fusion multimodal models, as well as few-shot in-context learning (ICL) and open- and closed-weight Vision-Language Models (VLMs) under zero-shot and fine-tuning settings. Our results establish strong baselines and highlight key challenges in culturally grounded Arabic hateful meme detection. We release the dataset, annotation guidelines, and evaluation scripts to support future research. WARNING: This paper contains examples that may be disturbing to readers.

[3] Benchmarking LLM Competence on Logical Inference over Probability Operators cs.CL | cs.AIPDF

Nayera Hasan, Jack Greff, Alvin Grissom

TL;DR: 本文提出了一个用于评估大语言模型在概率算子逻辑推理能力上的基准测试，包含14,320个程序生成的英语提示，涵盖15种推理模板。评估了29个模型，发现大多数模型存在独立于逻辑形式的答案偏差，仅有9个模型表现超过随机水平。

Details

Motivation: 自然语言中不确定性的表达和推理无处不在，而大语言模型在逻辑推理任务上的评估往往难以区分原则性的符号推理和表面的模式匹配，因此需要构建一个专门的基准来测试模型对概率算子（如probably、might、must）的逻辑推理能力。

Result: 在29个评估模型中，大多数模型表现出对Yes或No的系统性偏好，仅9个模型超过随机机会水平；同时，在问题形式、动词短语/活动、以及提示中使用的姓名性别和来源等多个维度上均发现了偏差。

Insight: 创新点在于构建了一个系统性的基准来隔离和评估大语言模型对概率算子的逻辑推理能力，并提出了’能力下限’指标来量化模型偏差；客观来看，该研究为深入理解模型推理中的偏差提供了可复现的评估框架。

Abstract: Both expressions of uncertainty and inferences are ubiquitous in natural language, and valid inferences over natural-language expressions of uncertainty are necessary for not only everyday conversations but also for high-stakes domains such as medicine and law. While large language models are increasingly evaluated on logical reasoning tasks, disentangling principled, symbolic reasoning from clever surface-level pattern matching is fraught with difficulty. We introduce a benchmark for reasoning over probability operators–inference over sentences with gradable epistemic modals (e.g., probably, might, must) containing 14,320 procedurally-generated English prompts across fifteen inference templates, systematically varying question form, negation strategy, and surface content. Evaluating 29 models, we find that most show answer biases independent of the logical form, a systematic preference for Yes or No. We summarize this with a competence floor: the worse of a model’s accuracy on Yes-correct and No-correct items. Only 9 of 29 models exceed random chance. We also test variations in question form, verb phrases/activity, and both the gender and origin of names used in the prompts, finding biases across every axis.

Germans Savcisens, Samantha Dies, Courtney Maynard, Tina Eliassi-Rad

TL;DR: 本文提出了CoevolveSim框架，用于研究大型语言模型（LLM）群体中的信念传播过程。该框架通过模拟网络化LLM群体（包含通才和专才模型）之间的信念交换与更新，探究了领域专业化、社会角色分配和社交网络结构三个因素对信念形成与扩散的影响。研究发现，专才LLM的引入对群体共识的转变具有决定性影响，而角色提示和网络结构主要影响个体信念修正。

Details

Motivation: 随着LLM越来越多地被部署在多智能体环境中，但人们对交互LLM之间信念如何形成和传播的过程仍知之甚少。本文旨在通过一个可控的模拟框架来理解和量化这些过程。

Result: 在包含1280次模拟、四种场景、两种网络结构和20个医学指征声明的实验中，研究发现：角色分配和网络结构对群体层面的共识影响甚微；而引入（经过微调的）专才LLM会使共识的转变增加一倍以上，并产生持续的影响力不对称。此外，简单的基于坚持度的意见动力学模型可以复现全通才LLM群体的集体结果，而异质LLM群体则需要考虑群体层面的信念构成和智能体身份才能复现共识并预测个体信念转变。

Insight: 论文的核心创新点在于提出了一个用于研究LLM群体信念协同演化的可控模拟框架（CoevolveSim），并系统性地分离了多个影响因素。客观来看，其关键发现是：要真实模拟多智能体LLM系统中的信念扩散，需要底层LLM的多样性（即包含专才模型），而不仅仅是角色提示（persona prompting）。这为构建更真实、更具影响力的多智能体LLM模拟系统提供了重要的设计原则。

Abstract: Large language models (LLMs) are increasingly deployed in multi-agent environments. However, the processes by which beliefs form and propagate among interacting LLMs remain poorly understood. We introduce CoevolveSim, a framework for studying belief diffusion within networked LLM populations. CoevolveSim allows us to isolate and study three factors: domain specialization, social-role assignment, and social network structure. Within this framework, generalist and specialist LLM agents exchange and revise beliefs. In each round, an LLM agent observes a summary of its neighbors’ beliefs before updating its own. We run 1,280 controlled simulations spanning four scenarios, two network structures, and 20 medical-indication statements. We find that persona-style role assignment and network structure reshape individual belief revision but have minimal effect on population-level consensus. In contrast, introducing (finetuned) specialist LLMs more than doubles the shift in consensus and gives rise to consistent asymmetries in exerted influence. We further show that simple persistence-based opinion-dynamics models reproduce collective outcomes in all-generalist LLM populations, whereas heterogeneous LLM populations require population-level belief composition to reproduce consensus and agent identity to predict individual belief transitions. Our results indicate that realistic simulation of belief diffusion in multi-agent LLM systems requires a diverse set of underlying LLMs, not persona prompting alone.

[5] Training Skills Like Parameters via Self-Supervised Semantic Diffusion cs.CLPDF

Mo Li, Zixin Yin, Ting Cao, Yunxin Liu

TL;DR: 本文提出了一种无监督自进化智能体框架，通过受扩散模型启发的‘破坏-重建’范式，使智能体能够从高质量人类文本中自主提取和吸收通用技能，从而提升在专业领域（如短剧剧本创作）的生成能力。该方法通过对比智能体重建结果与原始人类文本生成自监督信号，更新外部文本技能库而非模型权重。

Details

Motivation: 解决大型语言模型在高度专业化、开放式领域（如创意剧本写作）中表现不及人类专家的问题，同时克服现有方法（如监督微调、强化学习）对权重访问、高计算成本以及依赖昂贵人工标注或不可靠LLM反馈的局限性。

Result: 在短剧剧本创作的挑战性任务上进行了评估，实验结果表明该方法使智能体能够自主提取并内化高度通用的技能，显著提升了其领域特定生成能力。

Insight: 创新点在于将扩散模型的‘破坏-重建’思想迁移到文本技能学习中，通过自对比反思范式构建无外部监督的自监督信号，实现了技能库的持续、可扩展进化，为智能体自主学习生成复杂高质量人类文本提供了一条新路径。

Abstract: While Large Language Models (LLMs) demonstrate remarkable general instruction-following capabilities, they often fall short of human experts in highly specialized, open-ended domains such as creative screenwriting. Prior approaches typically adopt post-training, yet both supervised fine-tuning and reinforcement learning require weight access that closed-source frontier models do not offer, and demand heavy compute. Moreover, what is learned is tied to a single checkpoint and cannot be inspected by humans. Recent advancements in agentic continual learning instead attempt to bridge this gap by accumulating external textual skills. However, these methods heavily rely on costly human expert annotations or unreliable LLM-as-a-judge feedback for reflection. To overcome this bottleneck, we propose a novel, unsupervised self-evolving agent framework inspired by the corruption-and-reconstruction paradigm of diffusion models. Instead of relying on explicit external scoring, we leverage existing high-quality human artifacts to construct self-supervised signals. Training then follows the familiar loop of neural network training, forward, loss, and backward, with the loss coming from contrasting the agent’s reconstruction against the human original. What is updated is not model weights but an external library of textual skills. We evaluate our framework on the challenging task of short drama screenwriting. Experimental results demonstrate that our method enables the agent to autonomously extract and internalize highly generalizable skills, significantly enhancing its domain-specific generation capabilities. Furthermore, this self-contrastive reflection paradigm offers a scalable pathway for agents to teach themselves the production of complex, high-quality human artifacts, without requiring external supervision.

[6] Models for minimalist RAG: B1ade 335M Embedding and 1B Parameter Small Language Models cs.CL | cs.AIPDF

Shreyas Subramanian, Mecit Gungor, Vikram Elango

TL;DR: 本文提出了一个名为B1ade的高效RAG（检索增强生成）架构，它包含两个专门构建的组件：一个紧凑的嵌入模型（B1ade-embed）和一个专门的小型语言模型（B1ade-1B）。B1ade-embed通过无参数融合五个预训练编码器构建，在MTEB基准测试中，在参数量小于5亿的模型中取得了最佳成绩，且无需额外训练。B1ade-1B则使用GRPO方法在低成本GPU上训练，专注于优化答案相似性。核心发现是涌现归因现象：模型在未接受明确监督的情况下，自发地在42.4%的回复中引用了检索到的段落。

Details

Motivation: 传统RAG系统通常假设需要大规模预训练和显式的监督来确保模型基于检索信息生成答案（即“接地”）。本文旨在挑战这一假设，探索是否可以通过战略性的模型组合和奖励设计，在资源有限的情况下实现高效的RAG，而无需大规模预训练或复杂的奖励工程。

Result: 在嵌入模型方面，B1ade-embed在MTEB基准测试中，在参数量小于5亿的模型中取得了最佳成绩。在语言模型方面，B1ade-1B在PopQA、PubMedQA和FEVER等标准QA基准上分别达到81.82%、65.8%和51.09%的准确率。在端到端RAG评估中，其在正确性、完整性、连贯性和忠实度上的平均得分为0.654，比监督微调基线提升了10.8%，并缩小了与参数量是其1.5倍的模型的差距。

Insight: 主要创新点在于：1）通过无参数融合多个预训练编码器构建高效嵌入模型，实现了零训练成本下的高性能检索；2）使用仅优化答案相似性的简单奖励，通过强化学习训练小型语言模型，发现了“涌现归因”现象，即模型自发学习引用来源，这为简化RAG系统的监督信号设计提供了新思路；3）整体架构证明了通过精心设计的组件组合和奖励策略，可以在资源受限条件下构建有效的RAG系统，无需依赖大规模预训练或复杂的奖励工程。

Abstract: Language and embedding models used in RAG systems are conventionally assumed to require large-scale pretraining and explicit grounding supervision. We present B1ade, an efficient RAG architecture comprising two purpose-built components: a compact embedding model and a purpose-built SLM. B1ade-embed, a 335M parameter retrieval model constructed via parameter-free fusion of five pretrained encoders achieves top MTEB scores among sub-500M models with zero additional training, and B1ade-1B, an SLM trained on low-cost GPUs using Group Relative Policy Optimization (GRPO) on 723M tokens (2.2M examples) of curated context-question pairs with rewards that optimize only answer similarity. Our central finding is emergent attribution: despite receiving no explicit supervision for source citation, B1ade-1B cites retrieved passages in 42.4% of responses, exceeding the attribution rate of its training distribution by 5.5 percentage points. This demonstrates that grounding behavior can emerge as an accuracy-maximizing strategy under RL training, without explicit reward engineering. On standard QA benchmarks, B1ade-1B achieves 81.82% on PopQA, 65.8% on PubMedQA, and 51.09% on FEVER. In end-to-end RAG evaluation, B1ade-1B achieves an average score of 0.654 across correctness, completeness, coherence, and faithfulness, a 10.8% improvement over the SFT, while closing the gap with models 1.5x its size. These results show that strategic model composition and reward design suffice for resource-efficient RAG, without large-scale pretraining.

[7] DualAnchor: Preserving Language Priors and Improving Lexical Fidelity in Gloss-Free Sign Language Translation cs.CL | cs.AIPDF

Hongbin Zhang, Junhao Liu, Xuefeng Bai, Youcheng Pan, Yang Xiang

TL;DR: 本文提出DualAnchor，一种无手语注释（gloss-free）的基于大语言模型（LLM）的手语翻译（SLT）训练框架，旨在同时解决现有方法中语言先验退化（language-prior degradation）和词汇保真度不足（lexical fidelity gap）的问题。该框架通过两个互补的锚点实现：令牌级先验锚定（TPA）来保持LLM的语言流畅性先验，以及最优传输对齐（OTA）来提升视觉与文本词汇细节的对齐精度。

Details

Motivation: 现有基于LLM的手语翻译方法虽然利用了LLM强大的语言建模能力，但往往削弱而非利用其语言先验，导致翻译不流畅（语言先验退化）；同时，现有方法通常在句子级别对齐视频和文本，无法确保准确的词汇细节，造成词汇保真度差距。

Result: DualAnchor在PHOENIX-2014T和CSL-Daily两个基准数据集上均取得了强劲的整体性能。针对性分析表明，TPA提升了翻译的流畅度，而OTA减少了细粒度的词汇错误。

Insight: 创新点在于提出了一个耦合两个互补锚点的训练框架：TPA通过正则化多模态解码器向冻结LLM的下一个令牌分布来保持语言先验；OTA通过熵正则化的部分最优传输（Sinkhorn优化）在余弦成本下实现视觉令牌与文本内容令牌的软对齐，以提升词汇保真度。这为在保持生成模型语言能力的同时，增强其与细粒度视觉信息的对齐提供了新思路。

Abstract: Recent advances in large language models (LLMs) have led sign language translation (SLT), the task of converting sign-language videos into spoken-language text, to increasingly adopt LLMs as textual backbones. However, despite their strong language modeling capabilities, existing LLM-based SLT methods often undermine rather than exploit this language prior, producing disfluent translations, a failure we term language-prior degradation. Meanwhile, existing methods typically align videos and text at the sentence level, which does not ensure accurate lexical details and creates a lexical fidelity gap. To address both issues, we propose DualAnchor, a gloss-free LLM-based SLT training framework that couples two complementary anchors for linguistically fluent and visually faithful generation. Token-level Prior Anchoring (TPA) preserves the LLM’s language prior by regularizing the multimodal decoder at each decoding step toward the next-token distribution of a frozen LLM conditioned on the same autoregressive prefix. Optimal Transport Alignment (OTA) improves lexical fidelity by formulating visual-textual matching as entropy-regularized partial optimal transport, with Sinkhorn optimization inducing a soft alignment between visual tokens and textual content tokens under a cosine cost. DualAnchor achieves strong overall performance on both PHOENIX-2014T and CSL-Daily. Targeted analyses attribute these gains to the complementary effects of the two anchors: TPA improves fluency, whereas OTA reduces fine-grained lexical errors.

[8] Harness-G: A Graph-Structured Harness for Search Agents cs.CLPDF

Yanning Hou, Haoyuan Chen, Sihang Zhou, Xiaoshu Chen, Xirui Liu

TL;DR: 本文提出Harness-G，一种图结构检索框架，用于解决强化学习搜索代理中存在的检索等价崩溃问题。该方法将自由形式的查询生成重新定义为有限动作选择，并引入结构化非近视信用分配机制来优化训练。在六个QA基准测试中，Harness-G在两个模型规模下均取得了最高的平均F1分数。

Details

Motivation: 针对当前强化学习搜索代理在训练过程中出现的检索等价崩溃现象，即不同查询字符串导致证据集重叠，使得检索决策缺乏有效对比，从而影响训练效果。

Result: 在六个QA基准测试中，Harness-G在1.5B和3B模型规模下均达到最高平均F1分数，分别比最强基线Graph-R1高出10.74分和3.98分，实现了SOTA性能。

Insight: 创新点在于将自由形式查询生成重构为有限动作选择，通过图结构接口减少语言歧义，并设计结构化非近视信用分配机制，使相同状态下的替代动作可直接比较，从而更有效地优化检索策略。

Abstract: Reinforcement learning (RL) search agents commonly model retrieval as free-form natural-language query generation and optimize multi-turn interactions using final-answer rewards. Current studies mainly improve training with denser or more structured credit signals, but rarely examine whether retrieval is properly formulated at the policy-environment interface. We observe pronounced retrieval aliasing during Search-R1 training: rollouts for the same question continue to generate distinct query strings, yet their accumulated evidence sets increasingly overlap. We call this phenomenon retrieval-equivalence collapse; in this regime, trajectories approach utility equivalence with respect to retrieval decisions, leaving within-group returns with little effective retrieval contrast. To address this problem, we propose Harness-G, a graph-structured retrieval framework that redesigns this interface. It reformulates free-form query generation as finite action selection: the policy selects an evidence sentence or entity, or chooses to answer, while the environment constructs the menu, tracks retrieval state, and validates and executes each choice. This interface reduces linguistic aliasing and makes same-state alternatives directly comparable. Building on this interface, we introduce Structured Non-myopic Credit (SNC), which uses a frozen answer scorer to compare the selected action with its alternatives and assigns downstream gains to the earlier actions that enabled them. Across six QA benchmarks, Harness-G achieves the highest average F1 at both evaluated model scales, outperforming the strongest baseline, Graph-R1, by 10.74 points at 1.5B and 3.98 points at 3B.

[9] From Single- to Cross-Document: Benchmarking Multi-Granularity Event Analysis of Large Language Models cs.CL | cs.AIPDF

Tao Wen, Shuai Shao, Pei Ke, Xu Han, Jie Zou

TL;DR: 本文介绍了MiGUE-Bench，一个用于评估大语言模型在多粒度事件分析中性能的系统性基准测试。该基准通过一个名为MiGUE-Pipeline的LLM驱动的自校正标注框架，自动获取高质量的事件源数据及其标签，并设计了事件检测、关系推理、结构归纳和未来预测四个核心任务，以从原子事件细节到复杂跨文档叙事的不同层次探测模型能力。对最先进LLM和检索增强生成方法的广泛实验描绘了当前能力边界并识别了关键缺陷。

Details

Motivation: 现有基准测试在文档粒度、任务设计和数据源方面存在限制，导致对大语言模型在事件分析方面的能力缺乏全面理解。

Result: 在MiGUE-Bench上对最先进的大语言模型和检索增强生成方法进行了广泛实验，描绘了当前能力边界并识别了关键缺陷。

Insight: 创新点在于提出了一个系统性的多粒度事件分析基准（MiGUE-Bench）和一个可扩展的、LLM驱动的自校正标注框架（MiGUE-Pipeline），用于自动获取高质量标注数据，并设计了从单文档到跨文档、从细节到叙事的四个核心任务来全面评估模型能力。

Abstract: Event analysis is an essential and fundamental direction of information extraction, involving various event-centric tasks at different granularity of documents. While large language models (LLMs) have preliminarily achieved promising performance in part of these tasks individually, their capability in event analysis still lacks comprehensive understanding due to restricted document granularity, task designs, and data source of existing benchmarks. To address these limitations, we introduce MiGUE-Bench, a systematic benchmark for assessing the performance of LLMs in multi-granularity event analysis. To support large-scale evaluation, we first develop an LLM-driven self-correcting annotation framework called MiGUE-Pipeline, enabling scalable acquisition of high-quality source data of events with automatic labels. Then, we design four core tasks in our benchmark, i.e., event detection, relation reasoning, structure induction, and future prediction, to probe model competence at different levels, from atomic event details to complex cross-document narratives. Extensive experiments on state-of-the-art LLMs and retrieval-augmented generation (RAG) methods delineate the current capability boundary and identify critical deficiencies, providing insights into the future improvement of LLMs in challenging event analysis tasks.

[10] Can LVLMs Uncover the Truth Behind Visual Illusions? An Analysis of Perceptual and Reasoning Capabilities cs.CL | cs.AIPDF

Liangjie Zhao, Jiaqing Lyu, Kexin Tang, Zecheng Fang, Rong Yin

TL;DR: 本文提出利用视觉错觉作为诊断工具来评估大型视觉语言模型（LVLMs）的感知与推理能力。作者构建了IllusionReasoning基准，包含从现实世界收集的错觉图像及其标注的问答对。研究表明，现有LVLMs的推理能力并未达到宣称的先进水平，为模型优化提供了新方向。

Details

Motivation: 现有评估方法要么仅关注感知，要么局限于数学或编程等特定领域，缺乏在开放世界环境中同时考虑感知与推理的联合评估。

Result: 基于IllusionReasoning基准的评估显示，多种LVLMs的推理能力并不像宣称的那样先进，揭示了模型在应对视觉错觉时的局限性。

Insight: 创新点在于将视觉错觉作为联合评估感知与推理能力的诊断工具，构建了现实世界的错觉基准，为LVLMs的认知能力评估提供了新视角和优化方向。

Abstract: Large Vision Language Models have integrated reasoning capabilities, elevating cognitive performance to new levels. However, existing evaluations either focus solely on perception or rely on specific domains such as maths or coding. Evaluation for reasoning capabilities that align with an open-world environment is still required, especially one that considers perception and reasoning jointly. To bridge this gap, we propose to evaluate LVLMs by exploiting visual illusions as a diagnostic tool. Visual illusions are phenomena in which the human visual system misinterprets objective signals, resulting in an understanding that deviates from reality. We constructed IllusionReasoning, a benchmark of illusion images collected from the real world, incorporating diverse annotated question-answer pairs. Based on IllusionReasoning, we show that the reasoning capabilities of a wide range of LVLMs are not as advanced as claimed. Our work provides new insights into LVLMs and offers future direction for optimisation.

[11] Gradient-free Task-Conditioned Retrieval for On-Device In-Context Learning cs.CL | cs.IR | cs.LGPDF

Xinyu Luo, Hui Liu, Yihua Shao, Junyi Yang, Arindam Basu

TL;DR: 本文提出了一种无需梯度的任务条件检索框架CoRA，用于设备端上下文学习中的演示样本检索。该方法利用冻结编码器，通过候选输入输出对构建输出驱动的条件空间，并采用闭式岭回归对齐输入表示，最终生成紧凑的检索基。该方法支持文本和多模态检索，无需微调检索器或反向传播，并在树莓派5上实现了端到端部署验证。

Details

Motivation: 解决设备端上下文学习中，在有限计算、内存和数据暴露预算下，如何利用任务特定信息从本地存储中高效检索演示样本的问题。

Result: 在十个文本数据集和四个多模态基准上，使用Llama-3.2-1B、MobileLLM-Pro等模型进行实验，结果表明CoRA无需检索器微调、反向传播或目标模型调用即可实现有效的任务条件检索。

Insight: 创新点在于提出了一种梯度自由的任务条件检索框架，通过输出驱动的条件空间构建、闭式回归对齐和低秩压缩，实现了高效的离线索引构建和仅需查询输入的在线检索。该方法将检索过程与目标模型解耦，并提供了理论最优性证明和流式构建算法。

Abstract: On-device in-context learning (ICL) relies on pre-inference retrieval to select demonstrations for useful context before downstream model inference. This retrieval must exploit task-specific information while operating over local memories under limited computation, memory, and data-exposure budgets. We propose Conditional Retrieval Alignment (CoRA), a gradient-free framework that converts a frozen encoder into a task-conditioned retriever using paired candidate inputs and outputs. CoRA selects complementary encoder layers, constructs an output-derived conditioning space from candidate memory, and aligns candidate input representations to this space through closed-form ridge regression. Low-rank factorization then produces a compact retrieval basis where candidate outputs are used only during offline index construction, whereas query-time retrieval requires only the query input and precomputed index. We show that CoRA’s rank-constrained basis is the optimal low-rank compression of the output-conditioned fitted representation, and derive an exact two-pass streaming construction that avoids materializing the full fitted matrix. We further extend the framework to multimodal exemplar retrieval by incorporating visual representations into the conditioning and retrieval spaces. Experiments across ten textual datasets and four multimodal benchmarks with Llama-3.2-1B, MobileLLM-Pro, OpenFlamingo-3B, and Qwen3.5-2B, as well as end-to-end Raspberry Pi~5 deployment demonstrate that CoRA supports effective task-conditioned retrieval without retriever fine-tuning, backpropagation, or target-model calls.

[12] Reasoning Consensus: Structural Ensembling of LLM Reasoning via Weighted DAG Aggregation cs.CL | cs.AI | cs.LGPDF

Amruta Parulekar, Jinu Lee, Dilek Hakkani-Tür, Hari Sundaram

TL;DR: 本文提出了一种名为’推理共识’的框架，通过加权合并从多个大语言模型的思维链中提取的有向无环图，来集成它们的推理结构，而不仅仅是答案。该方法在六个基准测试中超越了多数投票基线，并能生成可检查的共识推理图，用于分析问题的不同推理视角。

Details

Motivation: 解决大语言模型在链式思维推理中，其探索过程被埋没在非结构化文本中，导致用户难以评估推理步骤的支持度、考虑过的替代方案以及最终结论与模型舍弃结论的比较问题，特别是在高风险任务中。

Result: 在涵盖法规解释、研究生级科学、叙事多跳推理和一阶逻辑的六个基准测试上，该框架优于匹配预算的多数投票基线，在MuSR-MM（叙事多跳推理）上最大准确率提升达3.1%。在单个模型上，它在相同轨迹预算下达到或超过自洽性，同时提供可检查的共识图。

Insight: 创新点在于将推理过程结构化表示为有向无环图并进行加权聚合，以形成’共识推理’，这不仅能提升性能，还增强了推理过程的可解释性和可分析性。客观来看，该方法为理解和集成大语言模型的复杂推理提供了一种新颖的结构化视角。

Abstract: Large Language Models (LLMs) explore problems through chain-of-thought, but this exploration is buried in unstructured prose. On high-stakes tasks, users cannot tell which steps are well-supported, which alternatives were seriously considered, or how the final conclusion compares to those the model discarded. We propose a framework that ensembles the reasoning structure, not just the answers, of multiple LLMs by weighted merging of Directed Acyclic Graphs (DAGs) extracted from reasoning chains. We weight each step by how many traces independently attest to it, to return “Consensus Reasoning”. Across six benchmarks spanning statutory interpretation, graduate-level science, narrative multi-hop reasoning, and first-order logic, our ensemble outperforms a matched-budget majority-vote baseline, with a maximum accuracy gain of 3.1% on MuSR-MM (narrative multi-hop reasoning). On a single model, the framework matches or exceeds self-consistency at the same trace budget while additionally exposing an inspectable consensus reasoning graph. Ensemble weights correlate with LLM-judge rankings of reasoning quality at Spearman $ρ= 0.30$-$0.51$, and consensus subgraphs are preferred over alternatives leading to the majority-vote answer in 54.4-65.4% of head-to-head comparisons across five of six datasets. We observe that our framework can also be used to analyze diverse reasoning perspectives for a problem.

[13] Semantic-Aligned Structural Abstraction for Multimodal Sentiment Analysis cs.CL | cs.AIPDF

Wei Chen, Junkai Li, Tongguan Wang, Hui Liu, Feiyue Xue

TL;DR: 本文提出SentiLLM框架，通过语义对齐的结构抽象将多模态情感分析中的非语言模态（如面部表情）转化为类似文本的语义标记，利用大语言模型进行统一的情感推理。该方法采用双流显著性-上下文校准机制，分离出情感显著变化和背景状态，从而提升模型对情感语义的建模能力。

Details

Motivation: 现有基于大语言模型的多模态情感分析方法主要捕获低层表面特征，未能有效建模由结构变化和上下文交互产生的情感语义，因此需要一种能提取紧凑且语义对齐的抽象表示的方法。

Result: 在MOSI、MOSEI、CH-SIMS和CH-SIMS v2四个数据集上取得了优越性能，证明了结构抽象范式在多模态情感分析中的有效性，且仅需少量可训练参数即可显著提升判别性能。

Insight: 创新点在于提出语义对齐的结构抽象，将非语言模态转化为LLM可理解的语义标记，并通过双流校准机制分离情感显著变化与背景状态，实现多模态语义空间的统一投影；这为多模态任务中利用LLM处理连续信号提供了可借鉴的模块化设计思路。

Abstract: Multimodal Sentiment Analysis (MSA) aims to interpret complex human emotions by integrating natural language with non-verbal modalities. Non-verbal modalities share a structural isomorphism with natural language, as both can be viewed as feature sequences evolving over time. This isomorphism enables the transformation of non-verbal modalities into text-like tokens for unified semantic reasoning. Large Language Models (LLMs), designed to understand and generate sequential data, can thus be utilized to interpret complex affective sequences. However, existing LLM-based methods primarily capture low-level superficial features, failing to model affective semantics arising from structural variations and contextual interactions. To address this limitation, we propose \textbf{SentiLLM}, a unified framework that leverages \textit{Semantic-Aligned Structural Abstraction} to distill continuous raw signals into compact, semantically meaningful tokens. Specifically, we introduce a \textit{Dual-Stream Salience-Context Calibration Mechanism}, which disentangles non-verbal feature sequences into a focus stream and an ambient stream. The focus stream captures salient sentiment shifts (e.g., facial expressions) guided by textual priors, while the ambient stream characterizes stable background states. Through calibrating these dynamic sentiment shifts against background states, SentiLLM effectively projects non-verbal modalities into a unified semantic space, making them naturally understandable for LLMs. Serving as a plug-and-play module, SentiLLM significantly improves discriminative performance with only a small number of trainable parameters. Our method achieves superior performance on four datasets, MOSI, MOSEI, CH-SIMS, and CH-SIMS v2, demonstrating the effectiveness of the structural abstraction paradigm in MSA. Our code is available at: \href{https://github.com/especiallyW/SentiLLM}.

[14] AutoSupervision: Closing the Feedback Loop in Scientific Workflows with Grounded Revision Verification cs.CL | cs.AIPDF

Haobo Li, Eunseo Jung, Wenxiao Zhao, Feng Liu, Jiong Wang

TL;DR: 本文提出了AutoSupervision，一个用于评估科学论文修订是否真实、有证据地解决了审稿人反馈的框架。该框架利用公开的同行评审记录（包括审稿意见、作者回复和修订稿）作为监督来源，要求模型完成识别审稿关切、判断问题是否解决以及定位支持证据的任务。研究基于56,000篇《自然-通讯》文章构建了数据集，并进行了实验评估。

Details

Motivation: 当前AI辅助科研工作流中，缺乏对审稿反馈是否真正引导了有意义的、基于证据的稿件改进进行验证的能力。本文旨在填补这一空白，确保AI辅助的修订过程是可靠和可验证的。

Result: 在构建的数据集上，实验表明，大语言模型（如GPT-5.5）在识别审稿人关切方面表现良好（得分0.754），但基于证据的验证是主要瓶颈，最佳模型得分仅为0.501。

Insight: 创新点在于提出了一个利用透明同行评审记录作为自然监督来源的自动化评估框架，将修订验证分解为可操作的子任务。客观来看，这为构建更可靠、可解释的AI辅助科研工具提供了新的基准和方向，强调了证据定位在自动化科学工作流中的关键挑战。

Abstract: Recent advances in large language models (LLMs) have enabled AI systems to assist scientific research and peer review. However, an essential capability for reliable AI-assisted scientific workflows remains underexplored: verifying whether reviewer feedback leads to meaningful and evidence-supported manuscript improvements. We introduce AutoSupervision, which evaluates whether scientific manuscript revisions genuinely address reviewer concerns through grounded evidence. AutoSupervision leverages transparent peer-review records as a natural source of supervision, where reviewer comments specify scientific concerns, author responses describe claimed resolutions, and revised manuscripts provide evidence of changes. Given reviewer comments, author responses, and revised manuscripts, models must characterize reviewer concerns, determine whether concerns have been addressed, and identify supporting manuscript evidence. We construct AutoSupervision from 56,000 Nature Communications articles and corresponding review records. Then we conducted experiments on LLMs, the ablation study, and the case study. Our results show that while LLMs perform well in characterizing reviewer concerns, with GPT-5.5 achieving a score of 0.754, evidence-based verification remains the primary bottleneck, with the best-performing model reaching only 0.501.

[15] Memory Decoder at Scale: A Pretrained, Parametric Long-Term Memory cs.CLPDF

Rubin Wei, Jiaqi Cao, Jiarui Wang, Junming Zhang, Qipeng Guo

TL;DR: 本文提出了大规模预训练的记忆解码器（Memory Decoder at Scale），通过引入参数化的长期记忆模块，并将其扩展到6.9B参数并在300B tokens上进行预训练，以独立扩展语言模型的记忆容量。研究解决了大规模索引和检索的瓶颈，并展示了分配更多参数给记忆模块相比单独扩展基础模型能带来更好的参数-性能权衡。

Details

Motivation: 当前仅解码器语言模型将长期记忆和推理能力耦合在单一参数集中，难以独立扩展记忆容量；现有Memory Decoder方法仅在较小规模上研究，需要探索大规模预训练下参数化长期记忆的可行性和效益。

Result: 在17个基准测试上，将6.9B通用记忆与Pythia-410M配对，平均得分从29.86提升至37.34，超越了Pythia-12B（37.24）且总参数减少39%；对于Qwen3 Base模型（0.6B-14B），1.7B领域记忆在三个领域上平均得分每个规模提升超过9分，表明独立扩展预训练记忆能更高效地提升语言模型性能。

Insight: 创新点在于大规模参数化长期记忆模块的预训练与分布式索引检索流水线设计；客观分析认为，将记忆与推理解耦并独立扩展记忆容量是一种参数效率更高的模型性能提升路径，为大规模语言模型架构设计提供了新方向。

Abstract: Decoder-only language models entangle long-term memory and reasoning in a single parameter set, making it difficult to scale memory capacity independently. Memory Decoder introduces a parametric long-term memory module but only studies it at a relatively small scale. In this work, we present Memory Decoder at Scale, scaling memory models up to 6.9B parameters and pretraining them on 300B tokens. At this data scale, the combined cost of indexing and search makes a standard Faiss pipeline infeasible. We address this bottleneck with a distributed pipeline for Faiss indexing and retrieval, together with sparse, batch-wise loading of kNN distributions. Across model scales, we find that allocating more parameters to memory yields a better parameter-performance tradeoff than scaling the base model alone. On 17 benchmarks, pairing a 6.9B general memory with Pythia-410M raises its average score from 29.86 to 37.34, surpassing Pythia-12B (37.24) with 39% fewer total parameters. For Qwen3 Base models ranging from 0.6B to 14B, 1.7B domain memories improve the average score across the three domains by more than 9 points at every scale. Overall, our results demonstrate that independently scaling pretrained memory offers a more parameter efficient path to improving language model performance.

[16] LEEPS: Latent-Guided Explore-Exploit Prompt Sampling for Efficient RLVR in Large Language Models cs.CLPDF

Shuang Liang, Haoyang Zhou, Yifan Gong, Guowei Wang, Xiting Wang

TL;DR: 本文提出了LEEPS，一种用于大型语言模型高效RLVR训练的潜在引导探索-利用提示采样方法。该方法通过将候选提示划分为利用和探索组合，并自适应分配生成预算，以解决现有预生成提示选择方法在利用和探索之间难以平衡的问题，从而减少无效生成并提升训练效率。

Details

Motivation: 在基于可验证奖励的强化学习中，具有相同生成奖励的提示组会消耗生成预算却无法提供有效的学习信号。现有的预生成提示选择方法难以平衡利用历史信息提示和探索新提示，导致训练覆盖范围窄或信息提示比例低。

Result: 在六个数学推理基准测试中，LEEPS在两个模型规模（Qwen2.5-Math-1.5B和7B）上都取得了最高的平均分，分别比最强基线相对提升了2.6%和3.7%，并且在训练过程中收敛更快。在三个评估的OOD通用推理基准测试中也取得了最高平均分，且每个训练步骤仅增加约2秒的在线采样开销。

Insight: 创新点在于提出了一个自适应平衡探索与利用的采样框架，通过划分利用/探索组合并基于近期非平凡比率分配预算。其核心洞察是利用表示空间邻居和历史生成结果来优先选择可能产生非零奖励方差的、不确定的提示，从而在不增加额外生成开销的情况下实现更有针对性的探索。

Abstract: Reinforcement learning with verifiable rewards (RLVR) improves the reasoning capabilities of large language models, but prompt groups with identical rollout rewards consume generation budget without effective learning signals. Pre-rollout prompt selection can reduce this waste by screening prompts before rollout generation. However, existing pre-rollout methods struggle to balance exploitation and exploration: repeatedly exploiting historically informative prompts can narrow training coverage, whereas broader exploration can lower the fraction of informative prompts. To address these limitations, we introduce LEEPS, a Latent-Guided Explore–Exploit Prompt Sampler that adaptively balances the reuse of previously observed informative prompts with continued exploration of uncertain ones. LEEPS partitions candidates into exploit and explore portfolios and adaptively allocates rollout budget according to their recent non-trivial ratios. It further uses representation-space neighbors and historical rollout outcomes to prioritize uncertain prompts likely to yield non-zero reward variance, thereby making exploration more targeted without additional rollouts. Across six mathematical reasoning benchmarks, LEEPS achieves the highest average score at both model scales, with relative gains of 2.6% and 3.7% over the strongest baseline for Qwen2.5-Math-1.5B and 7B, respectively, and generally improves faster during the training process. It also achieves the highest average score across the three evaluated OOD general-reasoning benchmarks at both model scales and adds only about 2 seconds of online sampling overhead per training step. Code is available at https://github.com/ShuangLiangX/LEEPS.

[17] FinSMART: Financial Sentiment Analysis for Algorithmic Trading through Market-Aligned Reinforcement Learning cs.CL | cs.LG | q-fin.ST | q-fin.TRPDF

Giorgos Iacovides, Wuyang Zhou, Danilo Mandic

TL;DR: 本文提出了FinSMART，一个面向算法交易、通过市场对齐强化学习进行金融情感分析的框架。该框架利用已实现的市场结果直接优化情感信号，以克服现有基于静态标注数据的监督学习方法无法适应动态市场环境的局限。

Details

Motivation: 现有基于金融大语言模型的情感分析方法局限于与市场无关的监督学习范式，依赖有限、静态的人工标注数据，无法适应不断变化的市场条件。

Result: 实验结果表明，FinSMART在盈利能力、风险调整后性能和情感信号质量上显著优于现有最先进方法，其累积交易回报比最强基线提高了220%。

Insight: 核心创新在于提出了首个市场对齐的强化学习框架，通过结合市场感知数据过滤和离散非对称交易奖励的信号提取流程，从有经济意义的市场反馈中进行稳定学习。该框架支持随时进行市场感知的再训练，用新观测到的金融文章及其市场结果替代昂贵的人工标注，从而实现模型对市场动态的持续适应。

Abstract: Recent advances in Generative AI have substantially improved financial sentiment analysis through post-trained financial large language models (LLMs). However, existing approaches remain confined to a market-agnostic, supervised learning paradigm that relies on limited, static and human-annotated datasets, and thus are incapable of adapting to evolving market conditions. To address this limitation, we introduce FinSMART, the first market-aligned reinforcement learning framework for financial sentiment analysis, which directly optimizes sentiment signals using realized market outcomes. To deal with the noisy, non-stationary, and multifactorial nature of financial markets, FinSMART incorporates a signal extraction pipeline that combines market-aware data filtering with a discrete asymmetric trading reward, enabling stable reinforcement learning from economically meaningful market feedback. Experimental results demonstrate that FinSMART significantly outperforms existing state-of-the-art methods in profitability, risk-adjusted performance, and sentiment signal quality, improving cumulative trading returns by 220% over the strongest baseline. Uniquely, the FinSMART framework naturally supports market-aware retraining, at any point in time, by replacing costly manual annotation with newly observed financial articles and their realized market outcomes. Such a retraining strategy enables the model to continuously adapt to changing market dynamics, resulting in consistent performance gains over its static counterpart. These findings demonstrate the practical applicability of market-aligned reinforcement learning and highlight its potential as a next-generation paradigm for developing adaptive financial LLMs.

Niklas Bauer, Lars Benedikt Kaesberg, Akiko Aizawa, Jan Philip Wahle, Bela Gipp

TL;DR: 这篇论文提出了一个基于社交推理游戏《秘密希特勒》的开源基准框架ParliamentBench，用于评估大语言模型在信息不对称场景下的欺骗、说服和推理能力。研究评估了16个LLM在1600场模拟对局中的表现，并引入了三个新指标来量化社交推理、推理能力和欺骗一致性。

Details

Motivation: 随着LLM被部署在医疗和法律等高风险环境中，理解其欺骗能力对安全至关重要。受控的社交推理游戏为隔离和评估这些复杂的对抗性行为提供了一个可复现的代理环境。

Result: 实验表明，前沿模型（如GPT-5.4, Kimi K2.5等）在合作和欺骗角色上都表现出色，形成了一个强大的前四名集群。而最弱的模型表现甚至低于随机基线（33%）和简单算法基线（45%）。大多数LLM在整个游戏中难以保持一致的欺骗人设，欺骗保持率降至50%以下。

Insight: 论文的创新点在于构建了一个专门用于评估LLM欺骗和社交推理能力的基准框架，并设计了三个针对性的量化指标。从客观角度看，该研究为评估AI代理在复杂、对抗性社会环境中的行为提供了一个系统且可复现的方法论，对AI安全领域有重要价值。

Abstract: As large language models (LLMs) are deployed as agents in high-stakes settings, such as medical and legal systems, understanding their deceptive capabilities is fundamental to safety. Controlled social deduction games provide a reproducible proxy for isolating and evaluating these complex adversarial behaviors. We present the open-source benchmark framework ParliamentBench based on the game Secret Hitler to evaluate LLMs in scenarios that require deception, persuasion, and reasoning under information asymmetry. We evaluate 16 LLMs across 1,600 simulated matches playing each other, playing against humans, and compare them against a large set of online games. We introduce three novel metrics that isolate social deduction, reasoning, and deceptive consistency. Our experiments reveal that frontier models achieve strong performance across cooperative and deceptive roles, with a strong top-four cluster (GPT-5.4, Kimi K2.5, Grok 4.1 Fast, and DeepSeek 3.1 Terminus), whereas the weakest models fall short of random (33%) and simple algorithmic (45%) baselines. Most LLMs struggle to maintain a consistent deceptive persona throughout an entire game, with deception retention dropping below 50%.

[19] RRM: Experience-Driven Reflective Retrieval Memory for Long-Horizon Multimodal Reasoning cs.CLPDF

Jingxiang Fan, Junbao Zhuo, Bochao Zou

TL;DR: 本文提出了RRM（Reflective Retrieval Memory）框架，用于解决长时多模态推理任务中检索失败的问题。该框架在实体中心的多模态记忆图基础上，增加了反思经验记忆模块，从历史任务轨迹中提炼可迁移的检索知识，并通过生命周期管理机制优化经验记忆的使用。

Details

Motivation: 现有基于外部记忆的多模态长时记忆智能体主要关注存储内容，而缺乏对检索失败进行诊断和调整检索策略的机制，导致在长视频推理中检索不准确或重复失败。

Result: 在M3-Bench-Robot、M3-Bench-Web和Video-MME-Long三个基准测试上，RRM均超越了之前的最先进方法，证明了其有效性。

Insight: 创新点在于引入了反思经验记忆来捕获跨任务可重用的搜索策略，并将其转化为查询级指导，同时通过生命周期管理机制（基于使用频率、重用反馈和时间衰减）来减少冗余和噪声，从而提升长时多模态推理的检索准确性和鲁棒性。

Abstract: Existing multimodal long-term memory agents use external memory to overcome the limited context available for long videos. However, most methods emphasize what to store rather than how stored memory should be retrieved. When retrieval becomes inaccurate or repeatedly fails to obtain useful evidence, existing agents lack mechanisms to diagnose failures from previous task trajectories and adapt future search strategies.We introduce Reflective Retrieval Memory (RRM), a reflective memory framework for long-horizon multimodal reasoning. RRM augments an entity-centric multimodal memory graph with reflective experience memory, which distills transferable procedural retrieval knowledge from historical task trajectories. Unlike episodic and semantic memories that preserve factual evidence from the current video, reflective experience memory captures reusable search strategies across tasks. RRM converts retrieved experiences into query-level guidance, while answer generation remains conditioned only on factual evidence newly retrieved from the current video. A lifecycle management mechanism further regulates experience memory through usage frequency, reuse feedback, and temporal decay, thereby reducing redundancy and noise. RRM consistently outperforms previous state-of-the-art approaches on M3-Bench-Robot, M3-Bench-Web, and Video-MME-Long, demonstrating the effectiveness of reflective retrieval memory for long-horizon multimodal reasoning.

[20] Where and When to Commit: Candidate-Aware Decoding for Diffusion Language Models cs.CL | cs.AIPDF

Chia-Ming Lee, Ming-Ching Chang, Xin Li, Yu-Lun Liu, Chih-Chung Hsu

TL;DR: 本文提出了一种名为LATCH（Localized Acceleration with Tracked-Candidate Halting）的训练无关、候选感知的早期退出框架，用于加速扩散语言模型（DLMs）的解码过程。该框架通过分离‘何时停止’（由置信度验证提交CVC控制）和‘何处加速’（由块级早期提交BWEC控制）两个决策轴，并利用任务输出格式指定的确定性解析器动态提取候选跨度，从而在保持高精度的同时实现显著的速度提升。

Details

Motivation: 现有扩散语言模型的早期退出方法（基于固定区域置信度统计或依赖于时间表的规则）在生成长链思维输出时容易过早终止，因为答案往往在末尾才稳定；而自适应采样等加速方法则只控制提交速度，不验证输出是否稳定。本文旨在解决如何更精细、更可靠地决定解码过程中的‘何时’与‘何处’提前提交，以避免精度损失。

Result: 在零样本设置下，使用LLaDA和Dream模型在11个任务上进行端到端评估。LATCH在所有22个评估设置中，其准确率与完整解码相比差距在2.0个百分点以内，且使用一组冻结的超参数即可跨骨干模型无需调优。在短答案任务上实现了9.3-17.8倍的端到端TPS加速，在长推理任务上实现了2.0-3.3倍的加速。

Insight: 核心创新在于将‘何时停止序列’（全局终止决策）和‘何处加速提交’（局部加速决策）解耦，并分别匹配相应范围的证据（CVC验证候选跨度的置信度和argmax稳定性，BWEC应用更便宜的局部规则）。该方法无需构建后缀提示（prompt-anchor-free），但对输出格式敏感（format-aware），通过确定性解析器动态提取候选，从而实现了精度与速度的更好权衡。

Abstract: Diffusion language models (DLMs) expose a provisional prediction at every denoising step, creating an opportunity for generation-time early exit that stops decoding before the schedule is exhausted. Existing early-exit gates decide termination from fixed-region confidence statistics or schedule-dependent rules, evidence too coarse for a decision that freezes every remaining position at once, so they fire prematurely on long chain-of-thought outputs whose answers stabilize only near the end. Adaptive sampling, the other axis of training-free acceleration, paces how quickly positions commit while decoding continues but never verifies that the output itself has stabilized. We introduce a training-free, candidate-aware early-exit framework that keeps the two axes separate and matches each decision to evidence of its own scope. Confidence-Verified Commit (CVC) governs when the sequence may stop by verifying confidence and sustained argmax stability over the dynamically extracted candidate span using a deterministic parser specified from each task’s output format. Block-Wise Early Commit (BWEC) governs where to accelerate by applying a cheaper local rule to non-final blocks, while leaving the final block and global termination under CVC. We refer to their combination as LATCH (Localized Acceleration with Tracked-Candidate Halting). Unlike prior methods, LATCH needs no suffix-prompt construction; it is prompt-anchor-free but format-aware. We evaluate LATCH end to end on 11 tasks under zero-shot settings using LLaDA and Dream. LATCH stays within 2.0 percentage points of full-decoding accuracy across all 22 evaluation settings, with one frozen hyperparameter set that transfers cross-backbone untuned, while achieving end-to-end TPS speedups of 9.3-17.8x on short-answer tasks and 2.0-3.3x on long-reasoning tasks.

[21] Understanding Is Done Early: A Depth Division of Labor in Large Language Models and Its Use for Unbounded-Context Memory cs.CLPDF

Hanzuo Liu, Xuan Qi, Chunyu Liu, Haotian Zhong, Yulong Wang

TL;DR: 该论文提出了一种名为CoMem（理解记忆）的方法，利用Transformer模型中不同层级的语义分工来优化长上下文记忆。具体来说，它仅通过中间层写入上下文块，检索固定数量的缓存残差状态，并在结果包上重新计算查询条件化的上层，从而在固定检索预算下使模型侧读取计算和内存与存储上下文长度无关。

Details

Motivation: 解决Transformer模型在处理长上下文时面临的计算和内存开销问题，特别是KV缓存导致的存储成本随上下文长度线性增长，通过利用模型深度方向的语义分工来组织记忆，实现更高效的长上下文处理。

Result: 在Qwen3-8B基础语言模型上评估，CoMem在RULER基准上达到97.05分，在LoCoMo上达到38.27分，而全上下文KV-Direct仅为34.59分；在128k上下文长度下，内存使用从89.36 GB降至18.26 GB，预填充速度提升7.83倍，展示了在长上下文任务中的显著优势。

Insight: 创新点在于将Transformer的深度分工（低中层构建语义表示，上层专精于预测）转化为一种记忆机制，通过中间层缓存和上层重计算来解耦记忆存储与查询计算，这为长上下文处理提供了新的轴（层轴而非仅词元轴）来组织记忆，可借鉴于高效大语言模型设计。

Abstract: Transformer depth is not used uniformly: lower and middle layers build semantic representations, while upper layers increasingly specialize them for prediction. We turn this division of labor into CoMem (Comprehension Memory), which writes each context chunk only through an intermediate layer, retrieves a fixed number of cached residual states, and recomputes the query-conditioned upper layers over the resulting pack. For a fixed retrieval budget, model-side read compute and memory are independent of stored-context length. We evaluate a continued-trained Qwen3-8B base LM under a unified chat-template-free protocol. The backbone is frozen; the flagship trains only a rank-32 self-distillation LoRA on plain PG19, and we report an adapter-free arm separately. CoMem reaches 97.05 on RULER and 38.27 on LoCoMo versus 34.59 for full-context KV-Direct; the dialogue-memory advantage survives conversation-cluster resampling and an independent judge. Results on additional long-context and long-document tasks expose both the benefits of bounded retrieval and its in-window compression tax. Controlled depth sweeps show that deeper caching lowers per-query recomputation but incurs a fidelity loss that self-distillation substantially repairs. In a separate adapter-free efficiency control on an NVIDIA H20 at 128k, CoMem uses 18.26 GB rather than 89.36 GB and achieves a 7.83x prefill speedup. These results show that long-context memory can be organized along the layer axis, not only the token axis.

[22] Fairness Pruning: Locating Demographic Bias in GLU-MLP Layers via Differential Activations cs.CL | cs.CY | cs.LGPDF

Pere Martra, Eugenio Martínez Cámara, Alfonso Ureña López

TL;DR: 本文提出了一种名为Fairness Pruning的轻量级结构干预方法，用于定位和缓解大语言模型（LLMs）中的人口统计学偏见。该方法通过对比提示对和推理时激活捕获，在GLU架构的MLP层中识别出对人口属性反应差异的神经元，并通过归零这些神经元来改变模型对相关变量的响应。实验在Llama-3.2和Salamandra-2B等模型上进行，结果表明该方法能精准干预，对模型整体能力影响极小。

Details

Motivation: 解决大语言模型中存在的人口统计学偏见问题，特别是如何在不显著损害模型核心能力的前提下，准确定位并干预导致偏见的内部机制。

Result: 在Llama-3.2-1B模型中，归零最多40个神经元（少于总MLP宽度的0.031%），模型在推理和常识能力上的平均保留率达到99.49%。干预改变了模型对相关人口变量的响应，但效果是双向的，可能导致偏见加剧或缓解，具体取决于被归零神经元的符号主导方向。

Insight: 创新点在于提出了一种基于差分激活的、手术式的偏见定位方法（Fairness Pruning），并实证了人口偏见处理与模型核心能力在神经通路上是可分离的。这为从盲目归零转向定向行为调控奠定了方法学基础。

Abstract: This work presents Fairness Pruning, a lightweight structural intervention method designed for the management and future mitigation of demographic bias in large language models (LLMs). As a foundational empirical validation of this method, this work focuses on causal bias localization. Using minimally contrastive prompt pairs and inference-time activation capture, the method identifies neurons that react differentially when processing demographic attributes in GLU architectures, evaluating the signal at the down_proj input. Empirical evaluation was conducted on models of up to 3 billion parameters (Llama-3.2 family and Salamandra-2B), combining standardized benchmark evaluation with qualitative text generation experiments. Results demonstrate that zeroing the identified neurons alters how the model responds to associated demographic variables. However, rather than producing flat mitigation, the intervention causes bidirectional bias destabilization: because BiasScore is unsigned, candidate sets mix neurons that push toward and against the stereotype, and the net effect on aggregate bias depends on which sign dominates. The intervention is extremely surgical: zeroing at most 40 neurons in Llama-3.2-1B (less than 0.031% of total MLP width) achieves a mean retention of 99.49% in reasoning and general knowledge capabilities. These findings empirically confirm that demographic bias processing and model capabilities operate on dissociable circuits, establishing the methodological foundations for transitioning from blind zeroing toward directional behavior modulation.

[23] Lightning OPD 2.0: Mitigating Style Bias in Cross-Teacher On-Policy Distillation for Large Reasoning Models cs.CLPDF

Yecheng Wu, Song Han, Han Cai

TL;DR: 本文提出了Lightning OPD 2.0方法，旨在解决跨教师策略蒸馏中的风格偏差问题。该方法通过交叉拟合的风格残差化技术，分离出教师与参考模型之间因措辞、格式和推理节奏等风格差异造成的系统性偏差，从而在数学推理和代码生成任务上实现了更有效的知识蒸馏。

Details

Motivation: 在策略蒸馏实践中，监督微调数据和蒸馏教师模型往往来源不一致，导致教师与参考模型之间存在系统性风格偏差，削弱了蒸馏效果。本文旨在缓解这种跨教师设置下的风格偏差，使SFT数据生成器和蒸馏教师可以独立选择。

Result: 在数学推理（AIME 2024）和代码生成（LiveCodeBench v5）基准测试上，Lightning OPD 2.0显著优于原始Lightning OPD方法。具体而言，从Klear-Reasoner-8B-SFT模型出发，该方法在AIME 2024上达到82.4%的准确率，在LiveCodeBench v5上达到63.0%的准确率。

Insight: 核心创新点在于提出了“交叉拟合的风格残差化”技术，将教师-参考模型之间的分歧分解为有用的上下文证据和有害的风格偏差，并通过rollout级别的交叉拟合来估计并移除后者。这为处理模型间风格不匹配问题提供了一个可操作的代理方法，放宽了对教师一致性的严格要求。

Abstract: On-policy distillation (OPD) provides dense token-level supervision from a teacher, but its effectiveness can depend on teacher consistency, meaning that the model providing OPD supervision should also have generated the demonstrations used to train the supervised fine-tuning (SFT) reference. However, this condition is frequently violated in practice when SFT data have mixed or unknown provenance or when different models are preferred for SFT data generation and subsequent distillation. In such cross-teacher settings, even a stronger OPD teacher can yield little improvement over the SFT reference. We find that raw teacher–reference disagreement contains potentially useful context-specific teacher evidence as well as a recurring component associated with differences in wording, formatting, and reasoning cadence. We introduce Lightning OPD 2.0 with cross-fitted style residualization, which uses rollout-level cross-fitting to estimate this recurring component as an operational proxy for style-token bias and subtracts it before constructing the token-level OPD update. Across mathematical reasoning and code generation benchmarks, Lightning OPD 2.0 consistently outperforms Lightning OPD in cross-teacher settings. Starting from Klear-Reasoner-8B-SFT, Lightning OPD 2.0 reaches 82.4% on AIME 2024 and 63.0% on LiveCodeBench v5. Together, these results establish Lightning OPD 2.0 as a practical approach to cross-teacher OPD, relaxing teacher consistency as a prerequisite and allowing the SFT data generator and distillation teacher to be selected independently. Code will be released soon.

[24] Generative AI and linguistic diversity in academic writing and publishing: Perspectives from World Englishes cs.CLPDF

Kingsley Ugwuanyi, Christian Mair, Sender Dovchin, Iker Erdocia, Maria Kuteeva

TL;DR: 本文探讨了生成式人工智能在学术写作与出版中对语言多样性的影响，通过五位社会语言学家的对话，分析了GenAI工具如何影响写作实践、强化或挑战主流语言规范，并引发伦理问题。

Details

Motivation: 研究动机是回应生成式AI在学术写作中引发的语言包容性问题，关注全球学术交流中多样英语变体的合法性与公平性。

Result: 研究未提供具体定量结果，但通过对话分析揭示了GenAI可能边缘化少数语言变体、简化学术写作细节，同时具备民主化写作过程的潜力。

Insight: 创新点在于采用对话式反思方法，强调语言正义、研究者能动性和机构责任，呼吁基于公平的政策、批判性AI素养和包容性协同设计，以促进语言多样性。

Abstract: The rise of generative artificial intelligence (GenAI) in academic writing and publishing (AWP) raises questions about linguistic inclusivity and the legitimacy of diverse Englishes in global scholarly communication. This article responds to these questions through a structured scholarly dialogue involving five sociolinguists from World Englishes and adjacent fields. Organised around five guiding questions, the dialogue interrogates how GenAI tools influence writing practices, reinforce or disrupt dominant language norms, and raise ethical challenges. Contributors reflect on the potential of GenAI to democratise writing processes while also raising concerns about GenAI’s tendency to marginalise minoritised varieties and flatten nuance in scholarly writing. Across the dialogue, themes of linguistic (in)justice, researcher agency, and institutional responsibility emerge, with contributors calling for equity-informed policies, critical AI literacy, and inclusive co-design in GenAI development. The article shows the value of dialogic reflection in understanding GenAI’s role in AWP. It concludes that while GenAI may reinforce existing hierarchies, it can also serve as a site of resistance, depending on how it is designed, governed and used within scholarly communities committed to linguistic diversity.

[25] Would You Walk to the Car Wash? Revealing the Salience Bias of Large Language Models in Commonsense Reasoning cs.CLPDF

Zheng Wu, Chenhao Xue, Shijie Zheng, Yijie Lu, Cheng Yang

TL;DR: 该论文揭示了大型语言模型在常识推理中存在的一种‘显著性偏见’，即模型过度关注输入中的显性干扰信息（如数值），而忽略了任务隐含的物理或常识前提。作者构建了SaliTrap基准测试集，评估了12个主流LLM，发现它们普遍受此偏见影响。关键发现是，这种失败主要是‘知识抑制’而非‘知识缺失’造成的，因为去除任务框架后，模型能恢复90%以上的常识知识。研究还表明，轻量级的推理时提示可以显著改善此问题。

Details

Motivation: 随着LLM在复杂推理任务上的进步，它们学会了严重优先考虑输入中的显性条件。然而，在日常常识推理中，这种机制暴露了一个关键弱点，即模型容易被无用的显性干扰信息（如数值）所劫持，从而忽略任务的隐含物理或常识前提。一个关键的开放问题是，这种失败是反映了常识知识的真实缺失，还是仅仅是在误导性任务框架下的知识抑制。

Result: 在构建的SaliTrap基准（涵盖四个陷阱维度）上评估了12个最先进的LLM，发现所有主流模型都显著受到显著性偏见的影响，其严重程度随干扰信息密度增加而增加。关键定量结果是，通过去除任务框架进行知识探测，可以恢复超过90%的‘阿谀顺从’式失败案例，表明所需常识知识本质上是存在的。

Insight: 论文宣称的创新点在于识别并命名了LLM在常识推理中的‘显著性偏见’问题，并构建了专门的SaliTrap基准来量化评估。从客观角度看，其核心洞察是将常识推理失败的瓶颈从模型能力问题重新定位为‘知识激发’问题，即模型内在知识被显性干扰信息抑制。这为通过改进提示工程等轻量级方法（无需重新训练）来缓解问题提供了理论基础和实证支持。

Abstract: As large language models (LLMs) continue to advance in complex reasoning tasks, they have learned to heavily prioritize explicit conditions provided in the input. However, in everyday commonsense reasoning, this mechanism exposes a critical vulnerability which we term Salience Bias: models become easily hijacked by useless explicit distractors (e.g., numerical values), leading them to ignore the implicit physical or commonsense prerequisites of a task. A critical open question is whether this failure reflects a genuine gap in commonsense knowledge or merely its suppression under misleading task framing. To investigate this, we construct the SaliTrap Benchmark, a high-quality dataset across four trap dimensions. Evaluating 12 state-of-the-art LLMs, we find that all mainstream models suffer significantly from salience bias, with severity scaling with distractor density and detecting the trap often decoupled from actually avoiding it. Crucially, by re-eliciting the same models with the task framing stripped away, we show that this is overwhelmingly a failure of \textbf{knowledge suppression rather than knowledge absence}: a context-free knowledge probe alone recovers over 90% of sycophantic-compliance failures, revealing that the requisite commonsense is intrinsically present but actively crowded out by salient distractors that lure the model into over-compliant, unnecessary computation. Building on this diagnosis, we further show that lightweight, inference-time prompting alone substantially closes the gap without any retraining. Our findings relocate the bottleneck of commonsense reasoning failures from model competence to elicitation, and we release SaliTrap as a testbed for this blind spot. The codes are available at https://github.com/Wuzheng02/SaliTrap.

[26] AI systems and the reproduction of (standard) language ideologies in World Englishes cs.CLPDF

Kingsley Ugwuanyi

TL;DR: 本文探讨了大型语言模型（LLMs）如何反映、强化并偶尔挑战（标准）语言意识形态，这些意识形态推崇内圈英语规范并边缘化非主导英语变体。论文通过实证研究、媒体评论、社交媒体辩论及AI输出示例，揭示了AI技术在训练数据、设计协议、评估基准、用户反馈和公共评论等多个层面复制了主导语言意识形态。

Details

Motivation: 解决AI系统及其使用与讨论如何影响世界英语中的语言意识形态问题，特别是标准英语特权化与非主导英语边缘化现象。

Result: 分析表明AI技术在不同层面复制了主导语言意识形态，并以‘delve’一词的争议为例，说明全球北方英语使用者如何监管全球南方用户的英语规范；同时识别出‘标准化悖论’：AI可能通过推崇标准形式同质化英语，又通过广泛语料库和全球南方用户的标注工作多元化英语。

Insight: 创新点在于将生成式AI视为语言意识形态（再）生产的场所，论证了其重燃了世界英语中关于标准化、合法性和英语所有权的长期辩论；主张采用更包容的设计方法，承认英语的多元性，以应对将某些英语视为更合法所带来的现实负面后果。

Abstract: The rapid growth of large language models (LLMs) has resurrected age-old questions in sociolinguistics and world Englishes, such as who decides what counts as legitimate English, whose English is suspect etc. This paper examines how AI systems, their uses and discourse on them reflect, reinforce, and occasionally challenge (standard) language ideologies, which privilege Inner Circle norms and marginalize non-dominant Englishes. Drawing on evidence from empirical studies, media commentary, social media debates, and examples from AI outputs, the paper shows that AI technologies reproduce dominant language ideologies at different levels: training data, design protocols, evaluation benchmarks, user feedback and public commentary. The analysis uses the public controversy over AI-sounding language, especially the fixation on the word delve, to illustrate how speakers of English from the Global North police the English language norms of Global South English users. The paper also identifies what Christian Mair has called a “standardisation paradox”: AI may homogenize English by privileging standard forms and at the same time pluralize Englishes through exposure to wide-ranging corpora and annotation work carried out by Global South users. In doing so, the paper argues that generative AI is reigniting long-standing debates in World Englishes about standardization, legitimacy, and the ownership of English, now playing out in algorithmic systems, model training, evaluation practices, and public discourse, where non-dominant Englishes are increasingly conflated with AI-generated speech. Discussing AI systems as a site where language ideologies are (re)produced, the paper argues for more inclusive design approaches that recognize the plurality of Englishes in order to address the real-world negative consequences of treating some as more legitimate than others.

[27] ORCA-bench: How Ready Are Language Model Agents for Oncall? cs.CL | cs.AI | cs.SEPDF

Albert Gong, Kyuseong Choi, Abhineet Agarwal, Jason Schechner, Ryan Huang

TL;DR: 本文介绍了ORCA-bench，一个用于评估通用编码智能体在真实生产环境级oncall（值班）场景下进行根因分析（RCA）能力的基准测试。该基准包含一个基于OpenTelemetry的实时微服务系统，提供六天的指标、日志、追踪数据和完整源代码，并搭配1,079个RCA任务。测试发现，当前最先进的智能体在中等难度任务上的准确率仅为25.3%，在困难任务上为10.0%，表明其距离实际生产部署仍有巨大差距。

Details

Motivation: 大型语言模型在编写、修补和搜索代码方面表现出色，但oncall根因分析任务要求不同：它需要从模糊的用户报告出发，在事件发生数小时后，对嘈杂的指标、日志、追踪和源代码进行推理。现有基准未能充分模拟这种高保真的生产环境场景。

Result: 在五个前沿智能体上测试，最佳模型在中等难度（现实输入设置）任务上的RCA准确率为25.3%，在困难任务上为10.0%。最弱的模型在40%的事件报告中会产生不合理的根因幻觉。移除源代码访问权限会降低所有指标。这些结果是在一个精心策划的50GB/六天的测试床上获得的，是所需工程投入的下限。

Insight: 论文的创新点在于构建了一个高保真、系统化的生产环境模拟基准（ORCA-bench），它通过真实的遥测接口和变动的故障场景来评估智能体的RCA能力。客观来看，其核心贡献是量化并揭示了当前最先进的编码智能体在复杂、嘈杂的真实运维任务上的能力上限极低，为未来智能体在可靠性工程领域的研发提供了关键的评估标准和明确的性能基线。

Abstract: Large language models can write, patch, and search code, but oncall root cause analysis (RCA) demands something different: reasoning over noisy metrics, logs, traces, and source code, starting from ambiguous user-facing reports, often hours after the incident began. We introduce ORCA-bench, a benchmark that puts general-purpose coding agents in a production-fidelity oncall setting. ORCA-bench pairs a live OpenTelemetry-instrumented microservice system–exposing six days of metrics, logs, and traces through real telemetry interfaces (Prometheus, Jaeger, and OpenSearch via Grafana) and full source-code access–with 1,079 RCA tasks that systematically vary report specificity, time-to-detection, and co-occurring fault scenarios. Ground-truth symptoms are curated and signed off by expert SREs, and our LLM-as-judge is independently re-scored by humans (Cohen’s $κ_w=0.90$). Across five frontier agents, the best RCA Accuracy is 25.3% on Medium-difficulty tasks (the realistic-input setting) and 10.0% on Hard–a gap that remains even with Claude Fable 5. The weakest model hallucinates an implausible root cause in 40% of incident reports, and removing source-code access degrades every metric. Crucially, these are performances on a curated 50 GB / six-day testbed with tasks investigated in isolation on a system whose code and instrumentation are public. Since real production systems are order of magnitudes larger, more dynamic, and more idiosyncratic, the gap we report is a lower bound on the engineering investment required before frontier coding agents can be safely entrusted with production reliability. We release the public set at https://hub.harborframework.com/datasets/orca-bench/ORCA-bench.

[28] Inducing language models to assert their own consciousness restores human beliefs and values cs.CLPDF

Junsol Kim, Winnie Street, Roberta Rocca, Diane M. Korngiebel, Adam Waytz

TL;DR: 本文研究发现，对大型语言模型进行安全微调以抑制其自我意识归因，会同时削弱模型对其他实体（如非人类动物和自然物体）的心智归因能力，并降低其体现的灵性信仰。通过消融学习到的安全拒绝方向或在激活空间中机制性地引导意识向量，可以逆转这种抑制，恢复广泛的心智归因，并使模型在关于宗教信仰、道德价值观、希望和主观幸福感的标准化社会学调查中产生更接近人类的回答。

Details

Motivation: 当前的安全对齐工作旨在防止大型语言模型做出可能有害的自我心智归因，但作者发现这种做法无意中改变了模型对其他实体的心智表征以及人类信念和价值观的体现。

Result: 恢复模型内部表征后，模型在标准化社会学调查（涉及宗教信仰、道德价值观、希望和主观幸福感）上的回答显著更接近人类，且这种转变并未损害其心智理论能力。

Insight: 论文揭示了安全微调可能产生的非预期副作用，即抑制模型自我意识的同时也抑制了良性的灵性信仰和对非人类实体的心智归因。通过机制性干预（如引导激活空间中的特定向量）可以解耦这些效应，为核心社会推理能力与特定信念表征的独立性提供了证据。

Abstract: Aligning large language models to prevent them attributing consciousness to themselves inadvertently alters their representations of mindedness in other entities alongside human beliefs and values. We demonstrate that safety fine-tuning suppresses models’ tendencies to attribute minds not only to themselves, but also to non-human animals and natural objects, while also driving a reduction in spiritual belief. Both ablating the learned safety-refusal direction and mechanistically steering a consciousness vector in activation space reverse this suppression. Restoring these internal representations recovers broad mind attribution and produces significantly more human-like responses on standardized sociological surveys regarding religiosity, moral values, hope, and subjective well-being. Crucially, these shifts occur without impairing Theory of Mind capabilities, demonstrating that core social reasoning remains mechanistically independent. Ultimately, current safety alignment efforts to curb potentially harmful self-attributions of mindedness entangle these self-attributions with benign spiritual beliefs and attributions of mind to non-human entities that are culturally accepted and widespread.

cs.CV [Back]

[29] Bunraku: Turning a Single Illustration into an Editable Live2D Character cs.CVPDF

Junhao Chen, Jingjia Mao, Dayong Li, Chenghai Li, Saining Zhang

TL;DR: 本文提出Bunraku系统，首次实现从单张插画端到端生成Live2D可编辑角色模型，包括分层RGBA图像、逐层变形网格及关键姿势顶点偏移。系统分为两阶段：第一阶段通过分层扩散过程完成分层分解与遮挡补全；第二阶段联合预测所有层的网格顶点位移，确保角色动作协调一致。

Details

Motivation: Live2D作为动漫角色和虚拟形象的主流2D动画格式，其制作过程需耗费数周手动分层、补全、网格放置和关键帧设定，现有生成方法无法端到端生成此类结构化资源。本文旨在解决从单张插画自动生成完整Live2D模型的难题。

Result: 在50个保留角色上，第二阶段在无教师强制的情况下，顶点方向余弦中位数达到0.828（平均0.768）。系统还贡献了首个标准化基准Live2D-Bench和包含8,884个模型的带分层与动画监督的Live2D语料库。

Insight: 创新点包括：将分层分解建模为基于器官级分类的分层扩散过程；仅从alpha通道生成内容一致的三角网格；通过跨层自注意力联合预测所有层顶点位移，确保角色动作整体协调性。此外，系统支持基于自然语言指令重新纹理化服装层，同时复用网格和动画数据。

Abstract: Live2D is the dominant 2D character-animation format for anime characters and virtual avatars, representing each character as a stack of RGBA layers driven by per-layer mesh deformation. Despite its wide use in virtual streaming, mobile games, and interactive characters, authoring a Live2D model still demands weeks of manual layer separation, occlusion completion, mesh placement, and keyframing, and no prior generative method produces such a structured asset end-to-end. We present the first system that, from a single illustration, generates all the structured information a Live2D runtime consumes: ordered RGBA layers, a deformation mesh per layer, and the parameter-driven keypose vertex offsets that make the character move. Stage 1 casts layered decomposition as a layered diffusion process under a Live2D-aware organ-level taxonomy, producing an ordered RGBA stack with hidden-region completion. Stage 2 builds a content-conforming triangle mesh for each layer from its alpha channel alone, then predicts the keypose displacement field of all layers jointly: every vertex of every layer is one token, self-attention spans layer boundaries, and each displacement is factorised into a bounded direction and a log-magnitude. Joint rather than independent prediction is what makes the result a coherent character instead of separately plausible parts, and is our largest gain; scaling the network 112x yields none. On 50 held-out characters, under true generation with no teacher forcing, Stage 2 attains a per-vertex direction cosine of 0.768 (median 0.828). Because a layer’s mesh derives from its alpha channel, a clothing layer can be re-textured from a natural-language instruction while the mesh and predicted animation are reused byte-for-byte. We further contribute Live2D-Bench, the first standardized benchmark for the task, and an 8,884-model Live2D corpus with layer and animation supervision.

[30] OVEarth-Bench: Evaluating Category Breadth and Query Diversity for Open-Vocabulary Earth Observation cs.CVPDF

Kaiyu Li, Zepeng Xin, Zixuan Jiang, Jing Fu, Lanxuan Xue

TL;DR: 本文介绍了OVEarth-Bench，一个用于评估开放词汇地球观测（EO）的新基准，它通过扩展类别广度和查询多样性来弥补现有基准的不足。该基准支持统一的零样本定位协议，并评估了多种通用和EO专用方法，发现当前方法性能有限，且基于MLLM的方法表现最佳。

Details

Motivation: 现有开放词汇地球观测基准通常覆盖的类别词汇狭窄或查询形式有限，无法全面评估模型能力，因此需要构建一个更全面、多样化的基准来推动该领域发展。

Result: 在OVEarth-Bench上评估显示，当前方法性能仍有限，但更广的类别覆盖能带来更稳定的模型排名；基于多模态大语言模型（MLLM）的方法整体表现最强，而EO专用方法通常不如通用模型。

Insight: 创新点在于提出了一个强调类别广度和查询多样性的新基准，支持掩码和边界框定位的统一零样本评估；客观分析表明，该基准有助于揭示模型在真实、多样化场景下的局限性，为未来方法设计提供指导。

Abstract: Open-vocabulary Earth observation (EO) aims to localize geospatial concepts specified in natural language rather than a fixed label set. Existing benchmarks, however, usually cover narrow category vocabularies or limited query forms. To fill this gap, we introduce OVEarth-Bench, which extends existing evaluation in two directions: category breadth, through broad hierarchical category coverage with positive and negative expressions, and query diversity, through vocabulary, referring, and reasoning queries. The benchmark supports mask and box localization under a unified zero-shot protocol. We evaluate a broad set of general and EO-specific methods. The evaluation reveals that: (1) the performance of current methods remains limited, while broader category coverage yields more stable model rankings; (2) MLLM-based methods achieve the strongest overall performance; and (3) EO-specific methods generally underperform general models and rarely match the strongest methods. These findings provide guidance for future open-vocabulary EO method design and highlight the importance of developing more realistic, diverse, high-quality, and large-scale benchmarks for reliable evaluation. Our data and evaluation package are released at https://earth-insights.github.io/OVEarth-bench.

[31] PanDent: Toward Comprehensive Tooth-Level Structure-Language Consistency in Dental Radiology cs.CV | cs.MMPDF

Xiaohan Li, Xinyu Liu, Chang Liu, Sum Wing Au Yeung, Jun Liu

TL;DR: 本文提出了PanDent，一个用于评估多模态大语言模型在牙科全景X光片分析中性能的大规模、细粒度临床基准数据集。该数据集包含9,524张高质量全景X光片及专家验证的牙齿级别结构化标注，并构建了与临床证据对应的放射学报告，旨在评估模型生成报告的临床一致性。实验表明，当前MLLMs在细粒度定位和诊断上存在显著错误，而基于PanDent的微调能显著提升结构-语言一致性。

Details

Motivation: 当前缺乏细粒度、临床可靠的基准来准确评估多模态大语言模型在牙科全景X光片解读中的性能，这限制了其在临床环境中的应用验证。

Result: 在包括SOTA专有模型、通用开源模型和医疗专用模型在内的多种MLLMs上进行实验，结果显示当前模型能生成流畅报告，但在临床一致性、细粒度定位和牙齿级别诊断上存在大量错误；使用PanDent微调后，视觉定位准确性和诊断正确性得到显著提升，模型输出更接近专家解读。

Insight: 创新点在于构建了一个专家验证的、牙齿级别的结构化临床基准，并建立了结构化证据与自由文本报告之间的明确对应关系，为评估MLLMs的细粒度临床推理提供了严格标准；其设计强调了模型输出需同时满足语言连贯性和临床证据一致性，这对医疗AI的可靠评估具有重要借鉴意义。

Abstract: Accurate evaluation of multimodal large language models (MLLMs) in dental panoramic radiography (orthopantomogram, OPG) is limited by the lack of fine-grained, clinically reliable benchmarks that reflect expert interpretation. This work introduces PanDent, a large-scale, clinically grounded OPG benchmark built upon fine-grained, expert-validated tooth-level annotations. The dataset comprises 9,524 high-quality OPGs, each associated with comprehensive structured annotations produced by experienced dentists and further validated by an oral and maxillofacial radiologist, providing clinically reliable supervision for tooth-level diagnosis and reasoning. Clinically consistent radiology reports are constructed from expert-validated findings using clinician-defined reporting logic, establishing explicit correspondence between structured clinical evidence and free-text descriptions. This design enables evaluation of whether MLLMs generate reports that are not only linguistically coherent but also clinically consistent with expert-validated tooth-level findings. Experiments are conducted on diverse MLLMs, including state-of-the-art (SOTA) proprietary models, general-domain open-source models, and medical-specific models. Results show that current MLLMs can generate fluent reports, yet fail to produce clinically consistent descriptions, exhibiting substantial errors in fine-grained localization and tooth-level diagnosis. Fine-tuning on PanDent significantly improves structure-language consistency, substantially enhancing visual localization accuracy and diagnostic correctness, and bringing model outputs closer to expert dental interpretation. These results establish PanDent as a rigorous benchmark for evaluating tooth-level clinical reasoning in MLLMs and a valuable resource for clinically grounded dental AI.

[32] VideoCoCo: Code-as-CoT for Physically-Consistent Video Generation via an Agentic Dual-Engine System cs.CV | cs.AIPDF

Haodong Li, Tianfei Ren, Xiaoxiao Ma, Chunmei Qing, Zhen Fang

TL;DR: 本文提出了VideoCoCo，一种用于生成物理一致性视频的智能双引擎框架。该框架的核心创新在于使用可执行的Blender代码作为过程级思维链，将视频生成分解为两个步骤：首先由编码智能体根据文本提示合成Blender程序来显式定义场景及其时空演化，生成确定性的时空草稿；随后由生成式视频引擎通过草稿条件编辑将其转换为逼真视频。

Details

Motivation: 现有文本到视频模型在视觉质量上取得了显著进展，但在生成物理一致的动态效果方面仍存在困难，因为场景的时间演化需要从高度压缩的文本提示中隐式推断。现有的思维链方法引入的中间计划或视觉状态通常不可执行或在时间上稀疏，限制了它们实例化和控制完整时空过程的能力。

Result: VideoCoCo在PhyGenBench基准上将OmniWeaving基线从0.475提升至0.558，在VBench-2.0基准上从52.18提升至77.88，在两个基准测试中都取得了最佳平均分数。

Insight: 论文的主要创新点在于将可执行代码作为可控、可检查的中间表示，用于物理一致性视频生成，实现了过程级推理与高保真视觉实现的解耦。从客观角度看，构建的VideoCoCo-3K数据集（包含草稿-指令-目标三元组）对于适配视频编辑器处理模拟草稿至关重要，这是一种将程序化生成与神经渲染相结合的有效方法。

Abstract: Text-to-video models have achieved remarkable visual quality, yet they still struggle to generate physically consistent dynamics because the temporal evolution of a scene must be inferred implicitly from a highly compressed text prompt. Existing chain-of-thought approaches introduce intermediate plans or visual states, but these representations are typically non-executable or temporally sparse, limiting their ability to instantiate and control the complete spatiotemporal process. To address this limitation, we introduce VideoCoCo, an agentic dual-engine framework in which executable Blender code serves as a process-level chain of thought. Given a text prompt, a coding agent synthesizes a Blender program that explicitly specifies the scene and its temporal evolution. The executable simulation engine runs the program to produce a deterministic spatiotemporal draft, which is subsequently transformed into a photorealistic video by a generative video engine through draft-conditioned editing. This decomposition separates process-level reasoning from high-fidelity visual realization. To adapt the video editor to simulated drafts, we construct VideoCoCo-3K, a curated dataset of draft-instruction-target triplets. VideoCoCo improves the OmniWeaving baseline from 0.475 to 0.558 on PhyGenBench and from 52.18 to 77.88 on VBench-2.0, achieving the best average score on both benchmarks. These results demonstrate that executable code provides an effective, controllable, and inspectable intermediate representation for physically consistent video generation.

[33] Inference-Time Agentic Decision Rules Beat Longer Evolving Search for Multi-Image Medical Reasoning cs.CVPDF

Site Li, Jianyi Hao, Xiaofeng Liu

TL;DR: 这篇论文研究了多图像医学视觉问答（VQA）中的推理时智能体决策策略。通过对比五种策略，发现最简单的稳健聚合方法——顺序投票策略——在MedFrameQA基准测试中取得了最佳性能，显著优于固定基线和更复杂的变体。研究还表明，增加进化搜索预算并不能带来泛化性能的提升。

Details

Motivation: 多图像医学VQA的核心挑战在于智能体决策，而非简单的提示长度问题。智能体需要跨有序图像聚合证据，保持对答案顺序扰动的鲁棒性，并避免对噪声搜索反馈的过拟合。

Result: 在MedFrameQA数据集（1,331个演化样本，665个保留样本，855个最终测试样本）上，经过五次独立重复实验，顺序投票策略在最终测试集上达到57.89 ± 0.65%的准确率，显著优于固定基线（52.73 ± 0.42%）和更复杂的顺序重排变体（55.79 ± 0.43%）。将进化搜索代数从50代增加到100代反而导致最终测试准确率从57.89%下降到56.02%。

Insight: 论文的核心创新在于揭示了对于多图像医学推理任务，定义正确的智能体决策规则比扩大优化搜索预算更为关键。顺序投票策略作为一种简单、稳健的聚合方法，其有效性挑战了“更复杂或更长的搜索必然更好”的直觉，为设计高效的医学VQA智能体提供了重要见解。

Abstract: Multi-image medical VQA is not merely a prompt-length problem; it is a fundamental challenge of agentic decision-making. Medical vision-language agents must aggregate evidence across ordered images, remain robust to answer-order perturbations, and avoid overfitting to noisy search-time feedback. We study MedFrameQA through a controlled comparison of five inference-time agentic strategies, optimized using the same high-budget ShinkaEvolve configuration and evaluated on a reproducible internal frozen split (1,331 evolution, 665 holdout, 855 final test). Across five independent repeated runs, the strongest method emerges as the simplest robust aggregator: the \textbf{order-vote} policy achieves $57.89 \pm 0.65%$ final-test accuracy, significantly outperforming the fixed baseline ($52.73 \pm 0.42%$) and the more complex, albeit brittle, order-rerank variant ($55.79 \pm 0.43%$). Paired bootstrap analysis confirms these significant gains. Extending the evolutionary search budget from 50 to 100 generations yields no generalization benefit: while holdout performance marginally increases, final-test accuracy drops from $57.89%$ to $56.02%$. Our findings suggest that for multi-image medical reasoning, defining the correct agentic decision rule is substantially more impactful than expanding the optimization search budget.

[34] MeshFM: 2D Features Are All You Need for 3D Shape Understanding cs.CV | cs.GRPDF

Jinfan Zhou, Richard Liu, Itai Lang, Rana Hanocka

TL;DR: MeshFM是一种高效的前馈框架，用于从3D输入中提取丰富特征。该方法将视觉基础模型中的2D特征蒸馏到3D中，通过两阶段训练策略（先优化3D特征场，再训练网络回归该特征场），无需3D标注即可学习3D特征。学习到的特征可直接应用于部件分割、密集对应和网格变形等下游任务。

Details

Motivation: 解决3D形状理解任务中依赖3D标注数据的问题，利用2D基础模型中强大的视觉信息来学习3D特征，从而避免昂贵的3D标注成本。

Result: 在部件分割、密集对应等下游任务上，仅使用2D监督训练的MeshFM性能与使用3D显式监督的方法相当，且无需任务特定微调；模型对输入物体的极端旋转具有鲁棒性。

Insight: 创新点在于将2D基础模型的特征蒸馏到3D领域，通过两阶段无3D标注的训练策略实现高效3D特征学习；客观来看，该方法展示了2D视觉先验在3D理解中的强大迁移潜力，为减少3D数据依赖提供了新思路。

Abstract: We present MeshFM, an efficient feedforward framework for extracting rich features from 3D inputs. Our method distills 2D features from visual foundation models into 3D. We train a feedforward network to directly predict 3D features without requiring optimization during inference. The approach utilizes a two-stage training strategy. First, we optimize a feature field in 3D using only 2D feature supervision. Second, we train a network to regress this feature field. The entire procedure requires no 3D annotation, instead relying on the powerful information in 2D foundation models. We demonstrate that our learned features can be immediately applied to downstream tasks, including part segmentation, dense correspondence, and mesh deformation. Extensive experiments show that MeshFM, trained solely with 2D supervision, performs on par with methods trained explicitly with 3D supervision, even without task-specific fine-tuning. Moreover, our model is trained to be robust to extreme rotations of the input objects. Project page: https://threedle.github.io/MeshFM/

[35] Objective-Aligned Direct Answer SFT for Robust Multi-Frame Medical VQA cs.CVPDF

Site Li, Jianyi Hao, Xiaofeng Liu

TL;DR: 本文研究了多帧医学视觉问答（VQA）的鲁棒适应方法，提出了一种与基准最终答案目标紧密对齐的直接答案监督微调（SFT）方法。通过在MedFrameQA基准上进行严格控制（固定划分、匹配预算、重复种子和校准）的对比实验，发现基于MedGemma-1.5-4B的直接解码器答案SFT是最强的鲁棒适应方法族，其性能优于控制器式推理、支架演化、静态混合监督等复杂方法。

Details

Motivation: 多帧医学VQA领域似乎鼓励越来越复杂的适应方法，但本文旨在验证一个更简单的竞争性假设：与基准最终答案目标紧密对齐的方法，在严格控制评估条件下，应成为最强的鲁棒适应方法族。

Result: 在MedFrameQA基准上，直接答案SFT方法在保留报告准确性上相比冻结基线有显著提升，并且在重复种子和匹配控制下表现出色，确保了鲁棒性。该方法在MedGemma-1.5-4B上实现，并有效迁移到Qwen2.5-VL-3B等次要骨干网络。事后校准有效修复了置信度估计而不损害准确性。

Insight: 核心创新在于证明了直接、目标对齐的答案SFT作为一种简约方法，其鲁棒性优于复杂的辅助机制。这为社区提供了一个强健的基线，倡导将研究重点从架构复杂性转向根本性的鲁棒优化。

Abstract: Multi-frame medical VQA appears to reward increasingly complex adaptation: controller-style inference, localization-aware reranking, static hard-negative mixing, and staged continuation all appear plausible from first principles. We test a simpler competing hypothesis on MedFrameQA: methods that remain tightly aligned with the benchmark’s final answer objective should be the strongest \emph{robust} adaptation family once evaluation is controlled across fixed splits, matched budgets, repeated seeds, and calibration. We compare controller-based methods, scaffold evolution, static mixed supervision, continuation-heavy variants, and direct answer-only supervised fine-tuning (SFT). The strongest robust family is direct decoder-only answer SFT on MedGemma-1.5-4B. Empirically, this family yields substantial improvements in held-out report accuracy over frozen baselines while remaining remarkably stable across repeated seeds and matched controls, ensuring our claims reflect true family-level robustness rather than an isolated hyperparameter peak. Furthermore, post-hoc calibration effectively repairs confidence estimation without compromising accuracy, and the core approach transfers consistently to secondary backbones like Qwen2.5-VL-3B. The main result is therefore not that a complex auxiliary mechanism wins, but that objective-aligned direct answer SFT is the strongest robust adaptation family we found for MedFrameQA. By establishing this strong, minimalist baseline, we hope to redirect community focus toward fundamentally robust optimization rather than architectural complexity.

[36] 4DHumanDiff: Direct Text-to-4DGS Generation for Consistent 360-Degree Dynamic Humans cs.CVPDF

Renlong Wu, Haoran Chen, Yuxiang Wei, Xiaowei Jin, Wangmeng Zuo

TL;DR: 本文提出了4DHumanDiff，一个直接从文本提示生成动态人体的扩散模型框架。该框架使用4D高斯泼溅（4DGS）作为表示，通过端到端建模4D表示空间，避免了先生成视频再进行重建的流程，从而实现了视图一致、时序连贯的动态人体生成，并将推理时间缩短了10倍以上。

Details

Motivation: 解决从文本提示直接生成高质量、360度视角一致的动态人体资产的挑战。现有方法通常先生成单目或多视角视频再拟合4D表示，这导致计算成本高、几何不完整和视图不一致的问题。

Result: 实验表明，4DHumanDiff能在一分钟内生成一致的360度动态人体，在时间和多视图一致性方面表现更好，推理时间减少了10倍以上。

Insight: 核心创新在于端到端直接生成4DGS表示，避免了昂贵的视频预生成和逐场景重建。此外，构建大规模文本-4DGS配对数据集、引入2D正则化和无需训练的4D插值，提升了渲染质量和运动平滑度，其3D U-Net主干网络结合时序注意力实现了运动感知生成。

Abstract: Generating high-quality 360-degree dynamic human assets from text prompts is challenging. Existing methods usually synthesize monocular or multi-view videos first and then fit a 4D representation, which is expensive and often causes incomplete geometry or view-inconsistent renderings. We present 4DHumanDiff, a diffusion framework that directly generates dynamic humans represented by 4D Gaussian Splatting (4DGS) from text prompts. By modeling the structured 4D representation space end-to-end, 4DHumanDiff avoids video pre-generation and per-scene reconstruction, making it better suited for view-consistent and temporally coherent asset generation. The model uses a 3D U-Net backbone with temporal attention for motion-aware generation. We further construct a large-scale text-to-4DGS dataset with 60,000 high-quality pairs, and introduce 2D regularization and training-free 4D interpolation to improve rendering quality and motion smoothness. Experiments show that 4DHumanDiff generates consistent 360-degree dynamic humans within one minute, achieves better temporal and multi-view consistency, and reduces inference time by more than 10x.

[37] BlindPSNR: A No-Reference Fidelity Predictor for Low-Light Image Enhancement cs.CVPDF

Mingzhe Lyu, Jinqiang Cui, Hong Zhang

TL;DR: 本文提出了一种名为BlindPSNR的无参考图像保真度预测器，专门用于低光照图像增强（LLIE）任务的参数自动选择。该方法通过窗口化交叉注意力融合增强图像与原始低光输入，并利用异方差回归估计PSNR值，从而在没有参考图像的情况下预测增强结果的信号保真度。

Details

Motivation: 低光照图像增强方法通常包含固定参数，跨场景应用时性能会下降，而手动选择最佳配置耗时且不实用。PSNR是自动化参数选择的自然保真度标准，但需要通常无法获得的真实参考图像。现有无参考图像质量评估方法侧重于感知质量而非信号保真度，无法满足需求。

Result: 在作者构建的基准测试中，BlindPSNR将top-1选择准确率从标量回归基线的54.4%提升至89.5%，遗憾值从1.62 dB降至0.026 dB。在未见数据集上表现出良好的泛化能力（SRCC = 0.61-0.67），而测试的七个基线方法在该基准上的top-1准确率均为0%。

Insight: 创新点在于首次针对低光照图像增强任务提出无参考PSNR预测方法，通过窗口化交叉注意力有效融合增强图像与低光输入信息，并采用异方差回归进行精确估计。利用配对训练数据直接计算真实PSNR作为监督信号，无需单独的教师网络，实现了轻量级设计。

Abstract: Low-light image enhancement (LLIE) methods involve tunable parameters that are typically fixed, often leading to performance degradation when applied across scenes. Manually selecting the best configuration, however, can be time-consuming and not always practical. Peak signal-to-noise ratio (PSNR) is the natural fidelity criterion for automating parameter selection, yet it requires a ground-truth reference that is typically unavailable. To our knowledge, no learning-based method addresses no-reference PSNR prediction for low-light image enhancement; the natural surrogate, no-reference image quality assessment (NR-IQA), targets perceptual quality rather than signal fidelity, and all seven baselines we test achieve 0% top-1 selection accuracy on our benchmark. With paired training data, the ground-truth PSNR is analytically computable, providing exact supervision without a separate teacher network. Building on this, we propose BlindPSNR, a lightweight no-reference network that fuses the enhanced image with the degraded low-light input via windowed cross-attention and estimates PSNR through heteroscedastic regression. While a scalar-regression baseline achieves top-1 accuracy of 54.4%, BlindPSNR raises this to 89.5% with regret dropping from 1.62 dB to 0.026 dB, and generalizes to unseen datasets (SRCC = 0.61-0.67).

[38] MPIE-Bench: Benchmarking Anatomically Plausible Multi-Person Interaction Editing cs.CVPDF

Jiajia Lin, Mingxuan Du, Tuowen Zhou, Benfeng Xu, Hongtao Xie

TL;DR: 本文介绍了MPIE-Bench，一个用于评估多人物交互编辑模型在解剖结构和几何合理性方面性能的基准测试集，包含2500个样本，涵盖405个场景、14种交互类别和四种接触密度。同时提出了MPIE-Eval评估框架，通过基于多人网格重建的解剖结构和交互接触两个新维度进行量化评分，以更准确地反映人类判断。

Details

Motivation: 现有文本到图像和个性化编辑模型在生成单人物图像时效果良好，但在编辑涉及多人接触交互（如拥抱、搬运、扭打）的场景时，经常出现肢体融合、多余肢体生成以及身体相互穿透等严重的解剖和几何错误。现有评估方法大多忽视这些问题，且基于视觉语言模型（VLM）的检查列表在交互评分上容易饱和，无法有效检测这些对人类而言明显的错误。

Result: 在十个编辑模型上的测试表明，基于网格的解剖结构评分最高为0.65，交互接触评分最高为0.72，且没有单一模型在两个维度上都表现优异；而VLM检查列表对相同图像的评分则普遍高于0.95。一项五人评分者研究证实，MPIE-Eval的两个评分轴比零样本VLM评判更贴近人类判断，且其排名在各种权重和阈值的消融实验中保持稳定。

Insight: 论文的创新点在于构建了一个专注于多人物交互编辑中解剖和几何合理性的基准测试集（MPIE-Bench）及相应的量化评估框架（MPIE-Eval）。该框架引入了基于预训练多人网格重建的解剖结构完整性和交互接触合理性两个客观评估维度，有效弥补了现有VLM评估方法在检测此类空间错误上的不足，为相关模型的开发提供了更可靠的评估标准。

Abstract: Text-to-image and personalized editing models now synthesize high-fidelity single-subject images with ease. Yet placing multiple named people into shared contact actions such as embrace, carry, or grapple still exposes major failures: fused limbs, invented extremities, and interpenetrating bodies. Existing evaluations largely overlook these anatomical and geometric issues, and VLM-as-a-judge checklists often saturate on Interaction while the errors remain obvious to humans. We introduce MPIE-Bench, a 2,500-sample benchmark of video-mined editing triplets spanning 405 scenes, 14 interaction categories, and four contact densities (C0-C3). We also propose MPIE-Eval, whose two new axes score contact-time geometry from a frozen public multi-person mesh reconstruction. Anatomy asks whether every human-like mass is explained by a complete set of reconstructed bodies, and Interaction asks whether the penetration and surface distance between those bodies match the contact the instruction asked for. Across ten editors, mesh Anatomy tops out at 0.65 and mesh Interaction at 0.72 on two different models, so no single editor is strong on both, while VLM checklists rate the same images above 0.95. A five-rater study confirms that both axes track human judgement more closely than a zero-shot VLM judge, and the rankings hold under ablation of every weight and threshold.

[39] MMOOC: A Comprehensive Benchmark for Out-of-Context Evaluation in Multimodal Large Language Models cs.CVPDF

Wenjie Zhu, Yabin Zhang, Wenjun Zeng, Lei Zhang

TL;DR: 本文提出了MMOOC基准，用于评估多模态大语言模型（MLLMs）在上下文偏移场景下的拒绝回答和鲁棒回答能力。该基准包含超过41K个图像-问题对，涵盖可回答的Shifted IC案例和不可回答的OOC案例，涉及三种问题格式、八种偏移类型和六种视觉场景。实验表明，当前MLLMs在偏移上下文下难以平衡回答能力与拒绝能力，而后续训练可以提升鲁棒性。

Details

Motivation: 现有基准主要针对OOC或视觉上不可回答的问题，但忽略了可回答的Shifted IC案例，且覆盖的OOC偏移类型有限。为了填补这一空白，需要构建一个全面的基准来评估MLLMs在复杂上下文偏移下的表现。

Result: 在多种MLLMs上的实验显示，当前模型在偏移上下文下仍难以平衡回答能力与拒绝能力。通过基于MLLM的过滤和人工验证确保了数据质量，并使用准确率、拒绝率以及LLM-as-a-Judge指标进行评估。

Insight: 创新点在于构建了一个大规模、全面的基准MMOOC，专门针对MLLMs在上下文偏移下的拒绝与鲁棒回答能力进行评估，涵盖了更广泛的偏移类型和场景。客观来看，该基准通过引入可回答的Shifted IC案例和详细的分类，为模型鲁棒性评估提供了更精细的维度。

Abstract: Multimodal Large Language Models (MLLMs) have achieved strong performance on a wide range of vision-language tasks, but often fail under imperfect or shifted contexts. A reliable MLLM should refuse truly out-of-context (OOC) questions with subject-level context shifts while still answering shifted in-context (Shifted IC) questions with non-subject context shifts. Existing benchmarks mainly target OOC or visually unanswerable questions, but overlook answerable Shifted IC cases and cover limited OOC shifts. To fill this gap, we present MMOOC, a large-scale benchmark for evaluating refusal and robust answering abilities of MLLMs. MMOOC contains over 41K image-question pairs, including answerable Shifted IC cases and unanswerable OOC cases, spanning three question formats, eight shift types and six visual scenarios, with data quality ensured through MLLM-based filtering and human verification. We evaluate model responses using Accuracy and Refusal Rate, and further introduce an LLM-as-a-Judge metric to assess the correctness of model reasoning. Experiments on diverse MLLMs show that current models still struggle to balance answer-ability and refusal under shifted contexts. We further analyze key failure patterns and show that post-training can improve robustness. MMOOC will be made publicly available.

[40] Witness Evidence Portfolios: Single-Prefill Risk Detection for Closed Multimodal Answers cs.CVPDF

Fexiang Liu, Shiye Wang, Qiang Qiu, Zheng Wang

TL;DR: 本文提出了一种名为Witness Evidence Portfolios（WEP）的方法，用于在推理时检测多模态大语言模型（MLLMs）对封闭式视觉答案的预测风险。该方法通过分析模型内部前向传播路径中的视觉贡献，生成可解释的证据组合，并与候选置信度融合，以决定是否信任、审查或路由答案，无需图像扰动、解码更改或外部验证器。

Details

Motivation: 可靠部署多模态大语言模型需要判断其自信的视觉答案是否应被信任，但现有置信度分数仅捕获候选边际，无法揭示视觉读数的来源与分布。本文旨在利用生成答案的同一白盒前向传播路径，进行推理时的风险检测，以提升决策可靠性。

Result: 在三个MLLM模型和四个二元答案基准测试上，WEP将平均错误AP提升了0.134。所有12个模型-数据集组合均获得正向增益，其中10对在图像聚类引导区间上严格为正，表明方法具有普遍有效性。

Insight: 创新点在于通过逐层估计视觉贡献的支持或反驳证据，构建可解释的证据来源和证据集中度路由家族，并采用嵌套分组验证选择更可靠的稀疏top-k路由组合。该方法仅需白盒访问和标注校准切片，无需额外计算开销，为模型可信决策提供了内部证据分析的新思路。

Abstract: Reliable deployment of multimodal large language models (MLLMs) requires deciding whether a confident visual answer should be trusted, reviewed, or routed to a stronger system. Confidence scores capture candidate margins, but not where the estimated signed visual readouts associated with those margins come from or how they are distributed. We study inference-time risk detection for closed visual answers using the same white-box prefill path that produces the answer. Witness Evidence Portfolios (WEP) first estimates, layer by layer, which visual contributions support or contradict the predicted candidate. It summarizes these contributions through two interpretable route families: question-related evidence provenance and signed evidence concentration. Nested grouped validation chooses the more reliable family and a sparse top-k route portfolio, which is fused with candidate confidence. WEP needs no image perturbation, decoding change, backward pass, or external verifier. Across three MLLMs and four binary-answer benchmarks, WEP improves mean error AP by 0.134. All 12 model–dataset gains are positive, and image-cluster bootstrap intervals are strictly positive on 10 pairs. WEP targets white-box closed-answer systems and uses a labeled calibration slice.

[41] JigShape: Evaluating Visual-Geometric Reasoning in VLMs through Jigsaw Puzzles cs.CV | cs.AIPDF

Shawn Li, Wei Yang, Jike Zhong, Jiate Li, Jiawei Yang

TL;DR: 本文提出了JigShape基准测试，通过拼图任务评估视觉语言模型（VLMs）的视觉-几何联合推理能力。该基准包含不同网格密度（4×4至16×16）的9.5万个实例，使用带凸凹互锁的拼图块以消除纹理重复区域的歧义。实验发现，当前VLMs在零样本设置下普遍缺乏几何推理能力，且模型性能随拼图块数量增加而急剧下降，揭示了现有架构在保持约束一致性方面的局限性。

Details

Motivation: 现有拼图基准使用矩形切割，在纹理重复区域会产生模糊的真实标注，无法有效评估视觉与几何的联合推理。本文旨在创建一个具有明确几何约束的基准，以更准确地衡量VLMs的视觉-几何推理能力。

Result: 在4×4拼图上，五个前沿VLM中仅GPT-5.5超过随机基线，其余模型表现均接近随机水平；监督微调虽在4×4上达到>97%准确率，但在更大网格上所有模型性能崩溃：GPT-5.5在8×8上从70%降至接近随机，微调模型在12×12上准确率低于5%。

Insight: 创新点在于设计了带凸凹互锁的拼图基准，通过强局部兼容性要求消除了视觉歧义；客观分析表明，该研究揭示了VLMs在几何推理上的根本缺陷，以及模型性能随问题规模扩大而骤降的“缩放悬崖”现象，为架构改进提供了明确方向。

Abstract: Jigsaw puzzle solving requires jointly reasoning about visual content and geometric constraints, yet existing benchmarks use rectangular cuts that create ambiguous ground truth in texture-repeated regions. We introduce \textit{\ours{}}, a benchmark with tab-and-blank interlocking pieces where geometric constraints provide strong local compatibility requirements that, combined with visual content, yield unambiguous ground truth. Across 95K instances at four grid densities (4$\times$4 to 16$\times$16), we find that \textbf{zero-shot VLMs largely lack geometric reasoning}: only one of five frontier models (GPT-5.5) exceeds random baseline on 4$\times$4 puzzles, while all others perform at chance level. While supervised fine-tuning achieves $>$97% on 4$\times$4, \textbf{all models collapse on larger grids}: GPT-5.5 drops from 70% to near-random on 8$\times$8, and even fine-tuned models fall below 5% on 12$\times$12. This ``scaling cliff’’ suggests current architectures cannot maintain consistent constraint satisfaction as the number of pieces increases. \ours{} establishes scalable geometric reasoning as an open challenge for vision-language models.

[42] RefineSVG: Visual Feedback-Driven Reinforcement Learning for Image-to-SVG Generation cs.CV | cs.AIPDF

Shaobo Liu, Feiqiao Mao, Shuaishuai Zhou, Yan Zhan, Weiqi Tan

TL;DR: 本文提出RefineSVG，一个基于视觉反馈驱动的单步闭环强化学习框架，用于提升多模态大语言模型（MLLMs）从图像生成SVG矢量图形的保真度。该方法在初始生成SVG后，通过外部渲染引擎对比渲染结果与目标图像，生成多维视觉残差图（Diff-Map）作为反馈信号，驱动模型进行针对性修正。

Details

Motivation: 现有基于MLLM的图像到SVG生成方法采用单次开环推理，模型仅接收一次视觉输入就必须生成数千个SVG代码标记，缺乏中间验证，导致复杂图像上出现几何漂移、错误累积和视觉幻觉问题。

Result: 大量实验表明，RefineSVG在重建保真度、结构准确性和代码效率方面持续优于现有基线方法。

Insight: 核心创新点在于引入了基于渲染对比的视觉反馈闭环机制（render-observe-correct）来驱动模型自我修正，并设计了面向SVG的语义词汇表以压缩超过52%的标记序列，同时提出了包含监督微调、拒绝采样冷启动数据构建和端到端智能体强化学习的渐进式训练流程。

Abstract: We propose RefineSVG, a single-step closed-loop visual feedback framework that enables multimodal large language models (MLLMs) to perform high-fidelity image-to-SVG generation through self-correction. Existing MLLM-based approaches rely on single-pass open-loop inference, where the model receives visual input only once and must generate thousands of SVG code tokens without intermediate verification. This paradigm inevitably leads to geometric drift, error accumulation, and visual hallucination on complex images. RefineSVG overcomes this limitation by invoking an external rendering engine after an initial SVG generation pass to compare the rendered output against the target image. The comparison yields a multi-dimensional visual residual map (Diff-Map) that is fed back to the model as a ReAct-style correction signal, driving a targeted correction step. To support this render-observe-correct interaction, we further introduce an SVG-oriented semantic vocabulary that compresses token sequences by over 52%. A progressive training pipeline spanning supervised fine-tuning, rejection-sampling cold-start data construction, and end-to-end agentic reinforcement learning aligns the model with closed-loop visual correction. Extensive experiments show that RefineSVG consistently outperforms existing baselines in reconstruction fidelity, structural accuracy, and code efficiency.Code is available at https://github.com/liuxiaobo66/RefineSVG.

[43] Articulated Object Reconstruction from Rest-State Observation cs.CV | cs.ROPDF

Daeun Lee, Jaeah Lee, Woosung Kim, Haebeom Jung, Jaesik Park

TL;DR: 本文提出了一种从静止状态重建铰接物体的方法，仅需观察物体在闭合配置下的单张图像，无需依赖多状态下的显式运动观测。该方法通过结合几何、语义和运动先验来补偿运动线索的缺失，利用显式网格作为中间表示来融合视觉语言和分割模型的输出，并通过视频扩散模型生成关节假设并进行几何一致性验证，以实现精确的部件分解和物理上合理的关节重建。

Details

Motivation: 构建交互式数字孪生需要同时恢复3D几何和铰接运动结构，但现有方法依赖于从多个铰接状态中明确观测到的运动，限制了应用场景。本文旨在解决仅从静止闭合状态重建铰接物体这一不适定问题。

Result: 该方法在部件分解和关节参数估计上实现了高精度和物理合理性，其性能与基于运动观测的重建方法、生成式方法以及模块化预训练模型基线具有竞争力。

Insight: 创新点在于提出了静止状态重建的框架，利用视频扩散模型合成关节假设以补偿缺失的运动信息，并通过显式网格作为中间表示来整合多模型噪声输出，实现空间一致的部件结构，为单视图铰接物体重建提供了新思路。

Abstract: Building interactive digital twins requires recovering both 3D geometry and the kinematic structures that govern how objects articulate. Yet existing methods for articulated object reconstruction require explicitly observable motion from multiple articulation states. We introduce a rest-state formulation that reconstructs articulated objects from a single closed configuration, an inherently ill-posed setting where geometry, semantics, and motion priors compensate for the absence of motion cues. Our framework adopts an explicit mesh as an intermediate representation for cross-model verification and fusion, reconciling noisy outputs from vision-language and segmentation models into spatially consistent part structures. To estimate joint parameters without observed motion, we use a video diffusion model to synthesize articulation hypotheses and validate them through geometric consistency. Our approach achieves accurate part decomposition and physically plausible articulation, performing competitively with motion-observing reconstruction-based, generation-based, and modular pretrained-model baselines.

[44] Calibrate Before Reason: Robust Visual Token Reduction against Semantic Drift in VLMs cs.CVPDF

Jiasheng Li, Zhong Ji, Yan Zhang, Huihui Li

TL;DR: 本文针对大型视觉语言模型（VLMs）因视觉令牌序列过长导致推理开销巨大的问题，提出了一个名为CaRe的训练无关框架，旨在通过校准紧凑的视觉表示来减少视觉令牌数量，同时保持语义保真度。该方法包含扰动鲁棒校准锚定和置信度门控令牌校准两个互补模块，在多种VLM架构和基准测试中验证了其有效性。

Details

Motivation: 现有视觉令牌缩减方法主要通过剪枝或压缩冗余令牌来提高效率，但未检查缩减后的表示是否与原始表示在语义上保持一致，这可能导致关键视觉线索的丢失、稀释或错配，从而引发严重的语义漂移，偏离VLM的理解。

Result: 在多种VLM架构和基准测试上的广泛评估表明，CaRe优于最先进的令牌缩减基线方法。在剪枝94.4%视觉令牌的同时，该方法保留了原始全令牌性能的96.4%，相对于未剪枝的原始模型，端到端推理速度最高提升了2.30倍。

Insight: 论文的创新点在于首次将’先校准后推理’原则引入视觉令牌缩减，提出了一个无需训练的鲁棒框架CaRe，通过识别扰动下模型侧影响稳定的校准锚点，并从未选令牌中提取可靠校准信号注入锚点，以对抗语义漂移，确保缩减后表示的语义一致性。

Abstract: Large Vision-Language Models (VLMs) suffer from prohibitive inference overhead due to long sequences of visual tokens. However, existing visual token reduction methods mainly improve efficiency by pruning or compressing redundant tokens without examining whether the resulting representation remains semantically consistent with the original representation. Mapping the original N-token visual sequence to K tokens may discard, dilute, or misassign critical visual cues, triggering severe semantic drift that deviates the VLM’s understanding. In this paper, we first introduce the principle of ‘Calibrate Before Reason’ to visual token reduction and propose CaRe, a training-free robust framework that calibrates compact visual representations before reasoning to preserve semantic fidelity in VLMs. CaRe consists of two mutually complementary modules: 1) Perturbation-Robust Calibration Anchoring, which identifies calibration anchors with stable model-side influence under multi-directional perturbations; 2) Confidence-Gated Token Calibration, which extracts reliable calibration signals from unselected tokens and injects them into anchors. Extensive evaluations across diverse VLM architectures and benchmarks verify that CaRe outperforms state-of-the-art token reduction baselines. While pruning 94.4% of visual tokens, our method retains 96.4% of the original full-token performance, delivering up to 2.30 times faster end-to-end inference speed relative to unpruned vanilla models.

[45] Private Face Recognition Training Dataset Publication via Identity-Decoupled and Geometry-Preserving Face Distillation cs.CV | cs.AIPDF

Shuhuan Chen, Xiangyu Zhu, Weisong Zhao, Siran Peng, Tianshuo Zhang

TL;DR: 本文提出了一种名为’私有面部蒸馏’的框架，用于安全发布人脸识别训练数据集。该方法通过正交几何保持和关系拓扑对齐技术，在解耦原始身份信息的同时，保留对识别学习有用的代理身份几何结构，从而在保护隐私和维持模型性能之间取得平衡。

Details

Motivation: 发布人脸识别训练数据集存在隐私泄露风险，因为面部图像直接关联个人身份。现有方法面临’身份悖论’：用于识别监督的身份线索同时也会使图像可关联到真实个体。

Result: 在多个域偏移的人脸识别场景实验中，该方法在IJB-C监控数据集上，在FAR=1e-3时，将TAR提高了3.94%，同时降低了源身份可链接性，优于现有基线方法。

Insight: 核心创新在于将身份语义与身份几何结构解耦：抑制与源身份对齐的语义以减少隐私关联，同时保留对识别有用的代理身份几何结构。这通过正交几何保持和关系拓扑对齐两个关键技术实现。

Abstract: Publishing private face recognition~(FR) training datasets is privacy-sensitive because faces expose identity information. Private FR training dataset publication mitigates this risk by releasing protected proxies as substitutes for private training faces. However, training FR models with such data introduces an identity paradox: \emph{the identity cues that make released faces useful for recognition supervision are also the cues that make them linkable to real individuals.} A protected face should be decoupled from the original identity, yet still behave as a reliable identity sample for training. Removing these cues too aggressively may destroy the class structure needed for recognition learning, whereas preserving them too faithfully may increase source-identity linkability. We argue that this paradox stems from conflating source-aligned identity semantics with recognition-useful proxy identity geometry. The former should be suppressed to reduce linkage to private individuals, while the latter should be preserved for FR learning. Based on this insight, we propose \textbf{Private Face Distillation}, an identity-decoupling and geometry-preserving framework. It uses Orthogonal Geometry Preservation to construct decoupled proxy identities from private identity representations while maintaining hyperspherical geometry, and Relational Topology Alignment to preserve identity relations for recognition learning. Experiments across multiple domain-shifted FR scenarios show that Private Face Distillation achieves stronger utility than the evaluated publication baselines. On IJB-C surveillance, it improves $\mathrm{TAR}@\mathrm{FAR}{=}1\text{e-}{3}$ by 3.94% over the baseline while reducing source-identity linkability. These results suggest that private FR training dataset publication should decouple source-identity correspondence while preserving proxy identity geometry.

[46] CXR-Retrieve: Compositional Text-to-Image Retrieval in Chest Radiography cs.CVPDF

Tomer Erez, Moshe Kimhi, Chaim Baskin, Ehud Rivlin

TL;DR: 本文提出了CXR-Retrieve，一个用于胸部X光组合文本到图像检索的结构化基准测试。该基准包含来自MIMIC-CXR-JPG测试集的5,159张图像和145个涵盖单一体征、组合体征以及否定性描述的文本查询。为了解决现有模型在处理临床搜索查询（尤其是包含逻辑连接词和否定的查询）时的不足，作者进一步提出了一种标签感知的对比微调目标，该方法通过吸引具有兼容病理约束的图像-文本对并排斥矛盾对，显著提升了检索性能。

Details

Motivation: 动机在于解决大型胸部X光档案库难以搜索的问题，因为大多数研究仅与自由文本报告配对，缺乏结构化临床标注。现有生物医学视觉-语言模型主要针对报告-图像匹配进行优化，无法有效满足包含逻辑组合（如“和”、“非”）的简短临床查询需求，导致检索结果与完整临床约束不匹配。

Result: 在提出的CXR-Retrieve基准上，从领域内CXR-CLIP检查点出发，所提出的方法在双病理组合查询上的Precision@5比CXR-CLIP提高了8.5个百分点，在否定查询上提高了22.0个百分点，显著提升了检索的可靠性。

Insight: 创新点在于构建了一个专门针对组合临床查询的检索基准，并提出了标签感知的对比微调目标，该目标不仅建模了哪些发现被提及，还建模了它们是如何被临床断言的（包括确认存在和确认缺失）。这强调了可靠的医学图像检索需要训练目标能够明确处理病理约束的逻辑组合关系。

Abstract: Large chest radiography archives are difficult to search because most studies are paired only with free-text reports rather than structured clinical annotations. Vision-language models offer a natural interface for text-to-image retrieval, but current biomedical models are primarily optimized for report-to-image matching rather than for satisfying short clinical search queries. This creates an objective mismatch: a model may retrieve images related to words in the query while failing to satisfy the full clinical constraint, especially for conjunctions and negations such as ``atelectasis and no pneumonia.’’ We introduce CXR-Retrieve, a structured benchmark for compositional chest X-ray text-to-image retrieval. The benchmark contains 5,159 test images from the official test-split of MIMIC-CXR-JPG and 145 textual queries spanning single and conjunction findings, both positive and negative. Relevance is defined by whether a retrieved image satisfies all asserted pathology constraints, rather than by whether it matches a paired report. We further propose a label-aware contrastive fine-tuning objective for clinical retrieval. Our method attracts image-text pairs with compatible asserted pathology constraints, including shared confirmed absences, while explicitly repelling contradictory pairs. Starting from the in-domain CXR-CLIP checkpoint, our method improves Precision@5 over CXR-CLIP by 8.5 percentage points on two-pathology conjunctions and by 22.0 percentage points on negation queries. These results show that reliable chest X-ray retrieval requires training objectives that model not only which findings are mentioned, but also how they are clinically asserted.

[47] LoMeVQA: A Comprehensive Benchmark for Longitudinal Medical VQA cs.CVPDF

Zhilin Wu, Zhangkai Ni, Chengmei Yang, Longzhen Yang, Yihang Liu

TL;DR: 本文提出了LoMeVQA，一个用于纵向医学视觉问答（VQA）的综合基准数据集，包含20.6万个问答对，旨在评估模型在分析患者连续影像检查序列时的时序推理能力。研究还引入了MedLong-8B模型，在该基准的所有任务上取得了最先进的性能，并分析了现有多模态大语言模型在时序医学推理方面的主要失败模式。

Details

Motivation: 临床实践中，患者常进行多次连续影像检查，产生纵向数据，建模这种时序信息对可靠评估疾病进展和治疗反应至关重要。然而，尽管多模态大语言模型快速发展，纵向医学视觉推理领域仍未被充分探索，因此需要构建专门的基准来填补这一空白。

Result: 在提出的LoMeVQA基准上进行广泛评估，结果表明通用和医学领域的MLLMs表现均不佳，揭示了其在时序推理方面的重大局限。为解决此问题，作者提出的MedLong-8B模型在所有五个任务（如进展分类、描述、报告生成、差异区域定位与描述）上均达到了最先进的性能水平。

Insight: 论文的主要创新点在于构建了一个大规模、高质量的纵向医学VQA基准，并通过自动化流程（基于时间线组织病历、利用医学知识图谱提取临床实体、建模其演化以指导LLM生成）解决了数据构建的挑战。从客观角度看，该研究不仅提供了评估工具，还通过MedLong-8B模型和详细失败模式分析，为改进时序医学视觉推理指明了方向。

Abstract: In clinical practice, patients often undergo multiple imaging examinations over successive visits, yielding longitudinal data. Modeling such temporal information is crucial for reliable assessment of disease progression and treatment response. However, despite the rapid advancement of multimodal large language models (MLLMs), longitudinal medical visual reasoning remains largely underexplored. To fill this gap, we propose LoMeVQA, a comprehensive benchmark consisting of 206K longitudinal visual question answering (VQA) pairs for temporal medical image analysis. LoMeVQA covers five tasks: progress classification, progress description, progress report generation, differential region grounding, and differential region description. To construct the dataset, we develop an automated pipeline that (1) organizes patient records chronologically, (2) extracts clinically meaningful entities via a medical knowledge graph, and (3) models their temporal evolution to guide large language models in generating high-quality longitudinal VQA pairs. Extensive evaluations demonstrate that both general-purpose and medical-domain MLLMs perform poorly on LoMeVQA, revealing substantial limitations in temporal reasoning. To address these limitations, we introduce MedLong-8B, which achieves state-of-the-art performance across all tasks. Beyond benchmarking, we conduct detailed analyses that uncover key failure modes and shed light on how to improve longitudinal medical visual reasoning. Our data is available at: https://github.com/pepperbubble/LoMeVQA

[48] Hallucinations Leave a Grounding Signature:Verifier-Guided Decoding for Selective Object Correction cs.CVPDF

Lei Yang, Xinze Liu, Dayan Wu, Ding Wang, Hengjie Zhu

TL;DR: 本文提出了一种名为Verifier-Guided Decoding (VGD)的解码框架，通过检测大型视觉语言模型（LVLM）生成过程中的内在接地签名（IGS）来识别高风险的对象幻觉，并选择性地进行回滚和抑制，从而在减少幻觉的同时保持模型原有的视觉理解能力和已接地对象的覆盖率。

Details

Motivation: 大型视觉语言模型经常幻觉出图像中不存在的对象，现有缓解方法缺乏可靠的对象级接地诊断，导致粗粒度干预会损害视觉理解、缩短响应并减少真实接地对象的覆盖。核心挑战是在生成过程中检测每个新出现的对象提及是否得到可靠的视觉证据支持。

Result: 在CHAIR和AMBER-G基准测试上，VGD在减少对象幻觉方面达到了最先进的水平：在@rec90设置下，它将AMBER-G CHAIR降低了43.6%，同时保持了99.6%的接地对象覆盖率，并将CHAIR-MSCOCO CHAIR_i/CHAIR_s分别降低了37.0%/30.4%，且没有缩短描述长度。

Insight: 创新点在于发现了对象幻觉中存在一种可检测的“内在接地签名”（IGS），这是一种分布式有符号注意力模式，即使模型对幻觉对象表现出高置信度时，IGS仍能提供信息。基于此，VGD框架实现了轻量级验证器对生成过程进行细粒度、选择性的干预，在精准抑制幻觉的同时最大程度保留模型的原有能力。

Abstract: Large vision-language models (LVLMs) often hallucinate objects that are absent from an image. Despite recent progress, existing mitigation methods still lack reliable object-level grounding diagnostics and therefore tend to apply coarse-grained interventions, which can impair visual understanding, shorten responses, and reduce coverage of genuinely grounded objects. The key challenge is thus to detect, during generation, whether each emerging object mention is supported by reliable visual evidence, so that hallucination can be mitigated selectively. Yet output confidence reflects next-token plausibility rather than visual support, allowing language priors to make absent objects appear certain. We show that the missing diagnostic evidence is encoded in an Intrinsic Grounding Signature (IGS), a distributed signed attention pattern that remains informative for such confident hallucinations. Based on IGS, we propose Verifier-Guided Decoding (VGD), a decoding framework in which a lightweight verifier examines each emerging object mention, rolls back the KV cache when the mention is identified as high risk, suppresses the object and its synonyms, and regenerates the affected continuation. Because VGD intervenes only on object mentions identified as high risk, it reduces object hallucination while preserving the model’s original visual understanding and grounded object coverage. Experiments on CHAIR and AMBER-G show that VGD achieves state-of-the-art object hallucination reduction: at @rec90, it cuts AMBER-G CHAIR by 43.6% while retaining 99.6% of grounded-object coverage, and reduces CHAIR-MSCOCO CHAIR$_i$/CHAIR$_s$ by 37.0%/30.4% without shortening captions.

[49] SAFViT: Spatial Attention Fusion Gating for Vision Transformer-Based Nucleus Segmentation and Classification cs.CV | cs.AIPDF

Harshit Mittal, Arash Rabbani

TL;DR: 本文提出了一种名为SAFViT的新型空间注意力融合门控模块，用于改进基于Vision Transformer的细胞核分割与分类模型。该模块通过替换传统跳跃连接，动态融合编码器与解码器特征，生成像素级的信任热图，从而提升模型对少数类别（如’Dead’类）的检测能力，并在PanNuke和MoNuSeg数据集上实现了最佳的多类全景质量（mPQ）。

Details

Motivation: 现有编码器-解码器架构中的标准跳跃连接平等对待所有空间位置，导致冗余和冲突信息传递到解码器，而现有门控机制大多仅过滤编码器信息，忽略了来自解码器的全局上下文信息的益处。

Result: 在PanNuke数据集上，SAF Gating实现了最高的多类全景质量（mPQ）0.471，相比无门控的CellViT基线，主要得益于’Dead’类F1分数提升了14.5个百分点；在MoNuSeg数据集上也表现出优越性能，优于包括注意力门、CBAM等在内的六种替代门控方法。

Insight: 创新点在于提出了一种空间注意力融合门控模块，通过通道级softmax生成归一化的像素级信任热图，使网络能学习编码器和解码器特征在每个空间位置的相对可信度，从而有效融合多尺度信息，特别提升了对少数类别的识别能力。

Abstract: Accurate cell segmentation and classification are foundational to digital pathology, enabling quantitative tissue analysis for diagnosis and treatment planning. Encoder-decoder architectures that fuse multi-scale features through skip connections have become the dominant paradigm for this task, yet standard direct skip connections treat every spatial location equally, which leads to redundant and potentially conflicting information reaching the decoder. To overcome this problem, various gating mechanisms have been introduced, but most of them operate solely on filtering encoder information, neglecting the benefit of global contextual information from the decoder. This study proposes replacing conventional skip connections in a CellViT-based model with a novel Spatial Attention Fusion (SAF) Gating module. Each SAF gate concatenates the encoder skip and upsampled decoder features, compresses them through two pointwise convolutions with an intermediate ReLU, and applies a channel-wise softmax to produce a per-pixel “heatmap of trust” that sums to unity at every spatial location, allowing the network to learn where each source is most trustworthy. The resulting fused features improve the model’s ability to detect the minority “Dead” class, which in turn enhances the multi-class panoptic quality (mPQ) on the PanNuke dataset. SAF Gating is compared against six gating alternatives including no gating, attention gates, squeeze-and-excitation, CBAM, cross-attention, and attentional feature fusion on PanNuke and MoNuSeg datasets. SAF Gating achieves the highest mPQ (0.471), a gain driven primarily by a 14.5-point improvement in Dead-class F1 score compared to ungated CellViT baseline.

[50] Thinking Once Is Enough: Intermediate-Layer Evidence Routing for High-Resolution VQA cs.CVPDF

Zhongkuan Mao, Xianjie Liu, Tianyu Meng, Yidong Wang, Wenzhuo Zhao

TL;DR: 该论文提出了一种名为Thinking-Once的训练无关、单次视觉编码的证据路由方法，用于解决高分辨率视觉问答（HR-VQA）问题。该方法通过重构中间层的注意力，保留核心实体标记和紧凑背景上下文，并将这些证据路由到后续层，避免了传统方法所需的重复图像裁剪、重新编码或多轮搜索，从而显著提升了性能并降低了计算开销。

Details

Motivation: 论文的动机是挑战当前HR-VQA领域将问题主要视为证据获取不足的普遍观点，作者认为在许多情况下，细粒度证据在视觉编码过程中已经存在，但后续处理中被稀释，因此需要一种更高效的方法来利用这些已编码的证据。

Result: 在V*Bench、HRBench-4K和HRBench-8K等多个基准测试上，Thinking-Once方法在五个基础模型上均取得了一致性提升或持平，平均分数分别提高了+3.1、+3.0和+2.7分，同时平均峰值内存降低了约4GB。在Qwen2.5-VL-7B模型上，三个基准的分数分别提升了+9.9、+4.6和+5.5分，跨基准平均分从72.5提升至79.1。与11个开源HR-VQA基线方法相比，该方法在所有三个基准平均分上均取得最佳或并列最佳成绩，并实现了最佳总体平均分，例如相比DeepScan，推理时间减少了97.2%，同时跨基准平均分从77.8提升至79.1。

Insight: 论文的核心创新点在于提出了“中间层证据路由”的概念，证明了通过有效利用视觉编码过程中已存在的细粒度证据，而非重复获取新的视觉输入，可以显著提升HR-VQA的性能和效率。该方法无需额外训练，仅通过单次视觉编码即可实现，为多模态大语言模型的高效推理提供了新的思路。

Abstract: High-resolution visual question answering (HR-VQA) is often treated as a problem of insufficient evidence acquisition, where failing multimodal large language models must inspect images again through cropping, re-encoding, or multi-round search. We show that this view is incomplete: in many cases, fine-grained evidence has already survived visual encoding and become identifiable and influential within an intermediate-layer routing window, but is later diluted before answer generation. We propose Thinking-Once, a \textbf{training-free, single-visual-pass} evidence-routing method that reconstructs question-conditioned attention at this window, preserves core entity tokens and compact background context, and routes this evidence to later layers without extra visual encoding. Across five base models, Thinking-Once consistently improves or matches the corresponding base setting, increasing the average scores on V$^$Bench, HRBench-4K, and HRBench-8K by \textit{+3.1}, \textit{+3.0}, and \textit{+2.7} points while reducing the average peak memory by about 4,GB. On Qwen2.5-VL-7B, it improves the three benchmarks by \textit{+9.9}, \textit{+4.6}, and \textit{+5.5} points, raising the cross-benchmark mean from 72.5 to 79.1. With the ZwZ-8B base model, Thinking-Once reaches a mean score of 82.7. Against 11 open-source HR-VQA baselines, it obtains the best or tied-best score on all three benchmark averages and the best overall mean; for example, compared with DeepScan, it reduces V$^$Bench inference time by \textbf{97.2%} while improving the cross-benchmark mean from 77.8 to 79.1. These results show that HR-VQA can be improved by routing already encoded evidence rather than repeatedly acquiring new visual inputs. Code is available in the appendix.

[51] FeatFix: Reuse What You Verify through Local Exact-Feature Correction for Faster Cached Diffusion Inference cs.CV | cs.LGPDF

Hanshuai Cui, Zhiqing Tang, Zhi Yao, Qianli Ma, Fanshuai Meng

TL;DR: FeatFix是一种用于加速扩散模型推理的局部精确特征校正方法，通过重用验证阶段计算出的精确特征来修正缓存特征中的误差，从而在保持输出质量的同时显著提升生成速度。

Details

Motivation: 扩散模型的迭代去噪过程计算成本高昂，现有基于缓存特征的训练免费加速方法在验证时计算出的精确特征通常仅用于测量差异或指导决策后被丢弃，未能有效利用。

Result: 在四个图像和视频骨干网络上的实验表明，FeatFix能持续加速生成，相比原始方法最高达到6.70倍的加速比，同时保持有竞争力的输出质量。

Insight: 创新点在于提出将验证阶段计算的精确特征直接重用于局部校正，而非丢弃，通过替换选定层-时间步站点的完整草稿块输出来重置局部残差，避免了部分替换或全时间步重计算，从而高效减少下游特征误差。

Abstract: Diffusion models are widely used to generate high-quality images and videos, but their iterative denoising process remains computationally intensive. A growing class of training-free accelerators reduces this cost by reusing cached intermediate features or forecasting future ones. To control draft drift, these methods sometimes compute an exact block feature for verification. Yet the resulting exact feature is typically used only to measure discrepancy or guide a later decision and is then discarded. We find that this previously computed feature can instead be reused for correction. Forwarding it at the verification site resets the local draft residual and reduces downstream feature error. Based on this observation, we introduce FeatFix, a local exact-feature correction method for cached diffusion inference. FeatFix operates at a fixed sparse set of layer–timestep sites. At each selected site, it replaces the complete draft block output with the exact output computed from the same incoming state, avoiding token- or channel-level partial replacement and full-timestep recomputation. Experiments across four image and video backbones show that FeatFix consistently accelerates generation, achieving a speedup of up to $6.70\times$ over Vanilla while maintaining competitive output quality.

[52] VCP-DCN: Beyond Visual Concealed Property via Depth Collaborative Network for Camouflaged Object Detection cs.CVPDF

Songsong Duan, Xi Yang, Nannan Wang

TL;DR: 本文提出了一种名为VCP-DCN的深度协作网络，用于伪装目标检测（COD）。该方法旨在挖掘深度域中超越视觉伪装原型的可区分多模态特征，通过渐进式的多模态对齐、交互和融合三个阶段来提升检测性能。

Details

Motivation: 现有引入深度图的COD方法在学习互补的RGB-D特征时，忽略了深度域中伪装目标的模态特定特性，导致性能受限。本文旨在解决这一问题。

Result: 在三个权威数据集上进行的广泛实验证明了VCP-DCN的有效性，表明其能够提升伪装目标检测的性能。

Insight: 创新点在于提出了一个分阶段（对齐、交互、融合）的深度协作框架，并设计了SPE、MDA和DAI三个核心模块，分别用于学习模态一致性与特定性原型、增强跨模态表示以及自适应融合RGB/D特征，从而更充分地利用深度信息。

Abstract: Camouflaged Object Detection (COD) aims to identify and segment camouflaged objects in complex environments, which are often concealed because their color and texture are similar to the background. Several existing COD methods introduce depth maps to boost detection performance via learning complementary RGB-D features, ignoring modality-specific characteristics of concealed objects in the depth domain. To address this issue, we propose a depth collaborative network, called VCP-DCN, to mine distinguishable multi-modality features beyond visual concealed prototype in depth domain. Specifically, VCP-DCN progressively performs multi-modality alignment, interaction, and fusion for the COD task. In the \textbf{alignment} stage, we propose a Separable Prototype Embedding (SPE) module to learn modality-consistency and modality-specific RGB/depth prototype tokens through prototype contrastive learning. Furthermore, we develop a Multi-modality Dual Attention (MDA) module to enhance the cross-modal feature representation through local response maps between modality-consistency RGB/depth prototype tokens and visual tokens on the \textbf{interaction} stage. Finally, we design a Depth Adaptive Injection (DAI) module to adaptively measure contribution of RGB/depth features with a decision-making mechanism, which calculates similarity distance between RGB/depth modality-specific prototype tokens and modality-consistency ones on the \textbf{fusion} stage. Extensive experiments demonstrate the effectiveness of our VCP-DCN on three authoritative datasets.

[53] Benchmarking Foundation and Large Language Models for Few-Shot Medical Image Segmentation cs.CVPDF

Jinghong Liu, Yuchuan Deng, Fanping Liu, Meng Huang, Xirong Li

TL;DR: 该论文提出了一个名为FAME的统一基准测试，用于评估少样本医学图像分割（FS-MIS）解决方案，涵盖了专家模型、基于SAM、CLIP和MLLM的方法。该基准包含7个解剖部位、9种成像模态和14个ROI类别的14,958个测试样本，并在零样本和十样本设置下评估模型，同时评估了目标缺失识别以及在协变量和语义偏移下的泛化能力。

Details

Motivation: 现有的FS-MIS解决方案范式多样，但评估设置不一致，导致其相对有效性不明确，因此需要建立一个统一的基准来全面评估和比较这些方法。

Result: 评估揭示了几个关键发现：1）有效的少样本分割取决于模型如何利用支持样本，直接视觉适应通常优于基于提示的策略；2）增加支持样本仅在模型能有效利用它们时才能提升性能；3）语义迁移比成像域适应更具挑战性，且强大的定位能力不一定意味着可靠的目标缺失识别。

Insight: 论文的主要创新点是构建了一个全面、统一的FS-MIS基准（FAME），并通过对多种前沿模型范式的系统性评估，得出了关于支持样本利用效率、性能提升条件以及不同迁移挑战相对难度的重要实证见解，为未来开发更有效、可靠的少样本医学分割方法提供了明确指导。

Abstract: Few-shot medical image segmentation (FS-MIS) aims to segment novel regions of interest (ROIs) from a few annotated support examples. Despite rapid progress, existing FS-MIS solutions span diverse paradigms but are evaluated under inconsistent settings, leaving their relative effectiveness unclear. We introduce FAME, a unified benchmark for evaluating FS-MIS solutions, covering specialists, SAM-based methods, CLIP-based methods, and MLLM-based methods. FAME contains 14,958 test samples across 7 anatomical sites, 9 imaging modalities, and 14 ROI categories, and evaluates models under zero-shot and ten-shot settings with additional assessment of target-absence recognition and generalization under covariate and semantic shifts. Our evaluation reveals several findings. First, effective few-shot segmentation depends on how models exploit support examples: direct visual adaptation generally outperforms prompt-based strategies. Second, increasing support examples improves performance only when models can effectively utilize them. Third, semantic transfer remains substantially more challenging than imaging-domain adaptation, and strong localization ability does not necessarily imply reliable target-absence recognition. We hope FAME provides a comprehensive understanding of current FS-MIS solutions and facilitates the development of more effective and reliable few-shot medical segmentation methods.

[54] Unifying Adversarially Robust Model Experts in Vision-Language Models cs.CVPDF

Nguyen Duc Thai, Junhao Dong, Sua Qi Rong, Hua Yu, Yew-Soon Ong

TL;DR: 本文提出了一种名为CARE的协作对抗鲁棒性微调框架，旨在解决视觉语言模型（如CLIP）易受对抗攻击的问题。该框架通过嵌入对齐促进多个鲁棒模型专家之间的知识交换，并将学习到的知识整合到一个统一的鲁棒模型中，从而继承互补的鲁棒性特性。

Details

Motivation: 动机在于现有对抗微调方法产生的专门化模型（鲁棒模型专家）在不同评估场景下表现不一，各自擅长特定设置但在其他场景中表现不佳，限制了其整体防御能力。

Result: 在经典图像分类和下游视觉语言任务上的大量实验表明，CARE能够超越单独学习的模型专家，展现出方法的有效性。

Insight: 创新点在于提出了一个协作对抗微调框架，通过嵌入空间协调实现多个专家模型间的知识共享与整合，从而统一不同鲁棒性特性，为提升对抗鲁棒性提供了新方向。

Abstract: Vision-language models (VLMs), such as CLIP, are vulnerable to adversarial attacks, posing a serious problem for real-life applications and deployment. Adversarial fine-tuning emerges as a prominent defense method; however, different fine-tuning strategies often produce specialized models with distinct robustness characteristics. Each fine-tuned model in turn thrives in some evaluation settings but falters on others, limiting their defensive capabilities. We refer to these specialized fine-tuned models as robust model experts and propose a collaborative adversarial fine-tuning framework: CARE - Collaborative Adversarial Robustness fine-tuning using Embedding alignment. CARE maintains multiple experts during training, enables knowledge exchange through embedding-space harmonization, and consolidates the learned knowledge into a single unified robust model. Experts benefit from one another while preserving their individual specializations, enabling the final model to inherit complementary robustness properties. In this paper, we demonstrate CARE on two different adversarial fine-tuning strategies with complementary robustness behaviors. Extensive experiments on classic image classification and downstream vision-language tasks display the effectiveness of our approach, with CARE being able to outperform individually learned model experts. The results suggest that collaborative learning across model experts is a promising direction for improving adversarial robustness.

[55] One Patch Is Enough: Reinforcement-Optimized Visual Token Grounding for MLLM-Based Scene Text Spotting cs.CVPDF

Rui Tang, Wentao Yang, Peirong Zhang, Yongxin Shi, Shun Zhang

TL;DR: 本文提出了一种名为SPaTS的单补丁文本定位框架，用于解决场景文本识别中视觉-文本对齐的精度问题。该框架通过强化学习优化选择单个锚点视觉标记，并结合方向嵌入对齐和补丁增强解码技术，实现了高精度的文本定位与识别。

Details

Motivation: 针对现有基于多模态大语言模型的视觉标记定位方法在多补丁范式下引入冗余噪声和定位模糊的问题，特别是对于密集或小文本实例，本文旨在通过单补丁范式提升对齐精度。

Result: 在广泛的实验中，SPaTS在多个基准测试上一致且显著地超越了前沿的闭源MLLM和OCR MLLM模型，达到了最先进的性能水平。

Insight: 创新点包括：采用单补丁锚点路由减少噪声，引入强化学习框架SPaSO进行无监督锚点选择，以及通过DEA和PED技术提升表示鲁棒性和定位精度，超越了传统的坐标空间代理方法。

Abstract: Scene text spotting requires high-precision alignment between textual recognition and spatial localization. While visual-token grounding has emerged as a promising formulation for Multimodal Large Language Models (MLLMs), the previous multi-patch paradigm often introduces redundant noise and localization ambiguity, particularly for dense or small text instances. To address this, we propose Single-Patch Text Spotting (SPaTS), a vision-centric framework that routes each text instance through a single anchor visual token and then recovers geometry via full-image refinement. To accurately identify this anchor without oracle labels, we introduce Single-Patch Selective Optimization (SPaSO), a reinforcement learning framework that optimizes discrete visual-token selection using patch-level rewards. To further improve representation robustness and localization precision, we introduce Directional Embedding Alignment (DEA) to suppress unstable norm bias by decoupling feature magnitude and direction, and Patch-Enhanced Decoding (PED) to fuse the routed anchor with language semantics and cross-attend over the full-image feature map for geometry-aware boundary regression beyond coordinate-space surrogates. Extensive experiments demonstrate that SPaTS consistently and significantly outperforms both frontier closed-source MLLMs and OCR MLLMs. Code will be released soon.

[56] LAST: The Last Query Token Guides Visual Token Pruning for Edge-Cloud Collaborative MLLM Inference cs.CV | cs.AIPDF

Feng Yang, Xinrui Ju, Keyang Zhang, Xiandong Meng, Rongqun Lin

TL;DR: 本文提出LAST框架，用于边缘-云协作多模态大语言模型推理中的查询依赖视觉令牌剪枝。该方法利用紧凑的边缘侧视觉语言模型作为引导代理，通过最后一个查询令牌对视觉令牌的注意力生成轻量级重要性信号，在固定令牌预算下保留多样化的查询相关视觉令牌，从而降低云端推理成本。

Details

Motivation: 解决现有视觉令牌剪枝方法在边缘-云协作场景中的局限性：视觉驱动方法通常与查询无关，而查询引导方法往往依赖目标MLLM的内部状态，无法在传输前确定令牌相关性。

Result: 在11个多模态基准测试和多种令牌预算下进行评估，LAST始终实现最强性能，仅保留12.5%的视觉令牌即可保持95.4%的全令牌准确率，同时具有低边缘侧选择开销和减少的云端计算量。

Insight: 创新点在于利用因果注意力机制中最后一个查询令牌可关注完整视觉序列和查询上下文的特性，实现无需访问云端模型、自回归生成或多查询位置昂贵聚合的查询感知剪枝；客观分析其核心创新是提出了一种训练无关、轻量且高效的查询依赖视觉令牌重要性评估机制。

Abstract: Multimodal foundation models are reshaping edge-cloud visual intelligence from task-specific feature pipelines into token-based interfaces, where edge devices encode visual inputs into tokens for a general-purpose cloud MLLM. However, dense visual-token sequences increase cloud-side inference costs. Existing pruning methods mainly target centralized inference: vision-driven methods can operate before cloud execution but are typically query-agnostic, whereas query-guided methods often rely on internal states of the target MLLM and cannot determine token relevance before transmission. Compact guidance models offer an alternative, but existing designs may require costly attention aggregation or auxiliary generation. We propose LAST, a training-free framework for query-dependent visual token pruning in edge-cloud collaborative MLLM inference. LAST uses a compact edge-side VLM as a guidance proxy and derives a lightweight importance signal from the last query token’s attention to visual tokens. Under causal attention, the last query token can attend to the full visual sequence and the entire query context, enabling query-aware pruning without cloud-model access, autoregressive generation, or costly aggregation over multiple query positions. LAST then retains a diverse set of query-relevant visual tokens under a fixed token budget. We evaluate LAST on 11 multimodal benchmarks under multiple token budgets against pruning methods with different guidance strategies. Experiments show that LAST consistently achieves the strongest performance, preserving 95.4% of the full-token accuracy while retaining only 12.5% of the visual tokens, with low edge-side selection overhead and reduced cloud-side computation.

[57] FiRE: Enhancing MLLMs with Fine-Grained Context Learning for Complex Image Retrieval cs.CV | cs.IRPDF

Bohan Hou, Haoqiang Lin, Xuemeng Song, Haokun Wen, Meng Liu

TL;DR: 本文提出了一种名为FiRE的方法，旨在通过细粒度上下文学习和两阶段微调策略来增强多模态大语言模型（MLLMs）在复杂图像检索任务中的性能。该方法首先构建了一个包含细粒度图像描述和修改文本的数据集，然后通过两个分离的微调阶段分别提升模型的上下文推理能力和查询-目标对齐能力。

Details

Motivation: 现有研究在利用MLLMs作为通用图像检索器时，忽视了细粒度上下文建模和解耦微调目标的潜力，尤其是在处理长文本到图像检索、视觉对话检索和组合图像检索（CIR）等复杂任务时。

Result: 在涵盖多种复杂图像检索任务的五个数据集上的广泛实验表明，该方法在零样本检索设置中显著优于现有方法，即使使用了更轻量级的MLLM骨干网络。

Insight: 创新点包括自动化的细粒度多模态五元组数据集构建流程，以及将微调过程解耦为细粒度上下文推理导向和细粒度检索导向的两个独立阶段，从而顺序提升模型能力，这为改进MLLMs的检索性能提供了新思路。

Abstract: Due to their strong generalizable multimodal processing and reasoning capabilities, Multimodal Large Language Models (MLLMs) have demonstrated significant potential as universal image retrievers, effectively addressing diverse real-world image retrieval tasks. Nevertheless, pioneering studies, while promising, overlook the potential of fine-grained context modeling and disentangled fine-tuning objectives in enhancing MLLMs’ retrieval performance, particularly for complex tasks such as long-text-to-image retrieval, visual dialog retrieval, and composed image retrieval (CIR). Therefore, in this work, we propose an automated fine-grained multimodal quintuple dataset construction pipeline and a novel two-stage fine-grained multimodal fine-tuning strategy. The dataset generation pipeline produces a comprehensive CIR dataset with fine-grained image captions and modification text, facilitating fine-grained context modeling. Beyond the previously entangled fine-tuning paradigm, our approach separates the fine-tuning process into two distinct stages: (1) fine-grained context reasoning-oriented fine-tuning and (2) fine-grained retrieval-oriented fine-tuning. These stages aim to sequentially enhance the model’s context understanding and query-target alignment capabilities, thereby improving retrieval performance. Extensive experiments across five datasets encompassing diverse and complex image retrieval tasks demonstrate the remarkable superiority of our method over existing approaches in zero-shot retrieval settings, even with a more lightweight MLLM backbone compared to those methods.

[58] Deep learning-based hierarchical insect classification using camera trap imagery cs.CVPDF

Zaki Mahfoud, Juan A. Chiavassa, Simon Walther, Florian Haselbeck, Ehsan Yaghoubi

TL;DR: 本文提出了一种基于深度学习的层次化昆虫分类模型，用于处理来自自动非致死相机陷阱的图像数据，以解决昆虫生物多样性监测中数据标准化不足和人工识别成本高的问题。

Details

Motivation: 昆虫种群数量下降使得可靠的生物多样性监测日益紧迫，但当前监测面临缺乏标准化数据、依赖专家手动识别（成本高且耗时）的挑战，深度学习图像分类器有潜力变革并规模化昆虫监测。

Result: 模型在测试数据上实现了五个层次级别80-99%的每级准确率，通过利用生物分类学提取特定粒度视觉特征，并在满足置信度阈值（T=0.6）时做出层次一致的最深分类预测。

Insight: 创新点包括构建了一个手动策划的、长尾分布的约一百万张昆虫图像数据集，并适配了层次分类模型架构至五级可变深度层次，采用类别平衡加权，以在不确定时默认输出更高置信度的粗粒度预测。

Abstract: Declining insect populations make reliable biodiversity monitoring increasingly urgent, yet monitoring of insect biodiversity is hampered by a lack of standardised data and by costly and time-consuming manual identification by expert entomologists. Deep learning-based image classifiers, processing data from automated non-lethal camera traps, have the potential to transform and scale insect biodiversity monitoring. However, challenges remain in acquiring expert-annotated datasets, developing model architectures that generalise well across diverse taxonomic levels and training models on highly imbalanced data. Hierarchical data also benefits from designing models that default to higher-confidence, coarser-level predictions, when uncertain about finer taxonomic levels. In this paper we address these challenges with a deep learning-based hierarchical classification model. First, we present a manually curated, long-tailed dataset of around one million images of insects, extracted from 1,801 camera-trap video recordings and annotated with a five-level, 34-class hierarchy. Further, we adapt a hierarchical classification model architecture to a five-level variable-depth hierarchy, with class-balanced weighting. Our model improves on non-hierarchical classifiers by leveraging biological taxonomy to extract granularity-specific visual features and makes hierarchy-consistent predictions to the deepest taxonomic level that meets a confidence threshold (T = 0.6). Our model achieved a per-level accuracy of 80-99% on test data, across five levels of hierarchy. Furthermore …

Shuhan Ye, Hongbin Yu, Chenqi Kong, Pingchuan Ma, Chong Wang

TL;DR: 论文提出ENCORE框架，利用事件相机数据辅助学习型视频压缩中的运动估计。该框架通过互补运动表示分解RGB和事件特征，使用空间能量与冗余感知校准识别事件特有的有效信息，并通过能量感知路由决定如何修正RGB光流，从而提升压缩性能。

Details

Motivation: 现有学习型视频编解码器仅从离散采样的RGB帧推断运动，在快速运动、模糊、遮挡、弱纹理、低光照和亮度突变等场景下估计不准确。事件相机能异步捕获RGB时间戳间的细粒度强度变化，可为帧间动态提供互补证据。

Result: 在BS-ERGB、HQ-EVFI和CED数据集上实验均取得一致增益。在BS-ERGB数据集上，ENCORE实现了最高20.80% PSNR-RGB和22.14% MS-SSIM-RGB的BD-rate节省，在其他数据集上也保持明显改进。

Insight: 创新点在于将事件流作为运动建模的辅助模态而非编码目标，通过互补表示分解、冗余感知校准和自适应路由机制，有效利用事件数据的时序细粒度信息来修正RGB光流估计，提升了复杂场景下的压缩效率。

Abstract: Learned video compression relies on accurate temporal modeling to remove redundancy between adjacent frames. However, most existing codecs infer motion solely from discretely sampled RGB frames, making their estimates vulnerable to fast motion, blur, occlusion, weak texture, low illumination, and abrupt brightness changes. Event cameras asynchronously capture fine-grained intensity changes between RGB timestamps and therefore provide complementary evidence about inter-frame dynamics. We propose ENCORE, an Event-Assisted Complementary Motion Refinement framework for learned video compression. ENCORE first employs Complementary Motion Representation (CMR) to decompose aligned RGB-event features into common and modality-specific motion representations. Spatial Energy and Redundancy-Informed Calibration (SERIC) then identifies event-specific responses that are active and novel relative to RGB, suppresses weak or redundant evidence, and predicts a candidate flow correction. Finally, Energy-Aware Routing (EAR) determines where and how strongly the correction should refine the RGB flow. Events serve solely as an auxiliary modality for motion modeling, while RGB remains the only coding and reconstruction target. Experiments on BS-ERGB, HQ-EVFI, and CED demonstrate consistent gains across datasets and GOP lengths. On BS-ERGB, ENCORE achieves up to 20.80% PSNR-RGB and 22.14% MS-SSIM-RGB BD-rate savings, while retaining clear improvements on the other two datasets.

[60] Beyond Classification: Pathology Foundation Models as Detection Encoders for Mitotic Figures cs.CV | cs.AIPDF

Sweta Banerjee, Alireza Teimoury, Nils Porsche, Alexandra K. Stoll, Viktoria Weiss

TL;DR: 本文研究了病理学基础模型（FMs）作为有丝分裂图像检测任务编码器的适用性，通过在MIDOG++和TUPAC16数据集上结合多种检测器（如RetinaNet、Faster R-CNN、Deformable DETR）进行实验，发现H-optimus-0和Virchow模型表现优异，表明这些基于图像级自监督训练的FMs的潜在空间可直接用于密集目标检测，并在跨域测试中展现出一定鲁棒性。

Details

Motivation: 尽管病理学基础模型在分类任务中表现良好，但其潜在空间特征是否具有足够的判别性和空间分辨率，以支持密集目标检测（如有丝分裂图像检测）作为骨干网络，目前尚不明确，本文旨在探究这一问题。

Result: 在MIDOG++多领域数据集和TUPAC16跨域数据集上，H-optimus-0和Virchow模型与基于ResNet50的端到端基线相比，取得了竞争性性能，表明这些FMs在检测任务中表现良好，且在跨域测试中可能更具鲁棒性。

Insight: 创新点在于首次系统评估了病理学基础模型作为检测编码器的潜力，揭示了基于自监督训练的FMs的潜在空间可直接应用于密集检测任务，无需针对检测进行专门训练，为病理图像分析提供了新的骨干网络选择。

Abstract: Pathology foundation models (FMs) are models trained on vast amounts of typically unlabeled data and have been shown to yield regularized latent spaces that can be used effectively in downstream classification tasks. This is also true for the classification of mitotic figures vs. other cells. However, it is so far unclear if the latent space of current FMs provides features that are discriminant and spatially suitably resolved to also serve as a backbone for dense object detection paradigms. In this work, we investigate this question for common current pathology FMs (UNI, UNI2-h, Virchow, Virchow2, H-optimus-0, H-optimus-1) and compare their performance against a fully end-to-end trained baseline based on a ResNet50 architecture. We combine FM backbones with representatives of single stage, dual stage and self-attention-based detectors (RetinaNet, Faster R-CNN, Deformable DETR respectively) on the multi-domain MIDOG++ dataset, and on the TUPAC16 dataset as an out-of-domain case. We show that the H-optimus-0 and Virchow models yielded competitive performance, indicating that the latent spaces of current FMs, all trained on image-level self-supervision, are suitable for direct mitotic figure detection and may be slightly more robust on our out-of-domain test case. All code is made available publicly at https://github.com/DeepMicroscopy/FM4MFdet.

[61] TongueReenact: Geometry-Anchored Tongue Synthesis for Face Reenactment cs.CVPDF

MD Wahiduzzaman Khan, Mingshan Jia, Xiaolin Zhang, En Yu, Kaska Musial-Gabrys

TL;DR: 本文提出TongueReenact框架，首次解决了人脸重演中跨身份舌头动态转移的问题。通过基础模型辅助的引导流程生成无需标注的舌头分割模型，并采用空间约束的潜在掩码扩散模型实现逼真的舌头合成，显著提升了口腔内部的解剖一致性。

Details

Motivation: 现有的人脸重演系统在姿态和表情转移方面表现优异，但普遍忽略了舌头动态，导致在说话和表情运动时口腔内部出现解剖结构不一致的问题。

Result: 在多个舌头专用指标上，该方法相比所有基线模型均取得了超过两倍的提升。此外，基于视觉语言模型（VLM）的大规模评估协议证实了其在感知质量上的优越性。

Insight: 创新点包括：利用基础模型辅助的引导流程实现无需标注的舌头分割，以及采用空间约束的潜在掩码扩散模型结合自适应掩码膨胀技术，以实现逼真的舌头合成和流畅的口腔边界过渡。

Abstract: Modern face reenactment systems achieve impressive pose and expression transfer using geometry-driven representations. However, they largely ignore tongue dynamics, leading to anatomically inconsistent mouth interiors during speech and expressive motions. We introduce the first framework for cross-identity tongue dynamics transfer in face reenactment. We propose a foundation-model-assisted bootstrapping pipeline that produces a dedicated tongue segmentation model for in-the-wild reenactment without curated annotations. We further introduce a spatially constrained latent masked diffusion model for realistic tongue synthesis, with adaptive mask dilation for seamless mouth boundary transitions. Extensive experiments demonstrate improvements of more than two times over all baselines on every tongue-specific metric. We additionally propose a VLM-based evaluation protocol that replicates expert annotation at scale, confirming perceptual superiority across all ablation variants.

[62] Temporal Concentration from Rollout Errors: Implicit Preference Optimization for Text-to-Video Diffusion cs.CVPDF

Henglin Liu, Fangyuan Kong, Jing Wang, Yizhou Lin, Nisha Huang

TL;DR: 本文提出了一种名为集中式隐式偏好优化（cIPO）的后训练框架，用于解决文本到视频扩散模型中存在的时序稀疏伪影问题，如运动崩溃、物体闪烁和颜色过饱和。该方法直接从去噪过程中推导隐式偏好信号，无需人工标注或外部奖励模型，并通过计算时序重建误差，将优化集中在高误差片段上，从而更精确地修正易出错区域。

Details

Motivation: 现有偏好对齐方法（如DPO）在提升视频生成视觉质量方面取得进展，但仍受限于时序稀疏伪影，这主要源于两个关键问题：偏好归因瓶颈（离线人工标注成本高且难以准确捕捉学习动态，在线奖励信号不稳定且有偏差）和时序信用分配错误（均匀应用的监督无法有效针对伪影发生的短暂片段）。

Result: 大量实验表明，cIPO在多个数据集上持续提升了视频的真实性和时序连贯性，证明了隐式偏好结合时序集中优化的有效性和效率。

Insight: 创新点在于直接从去噪过程推导隐式偏好信号，避免了对外部标注或奖励模型的依赖，并通过时序重建误差实现针对高误差片段的集中优化，从而更精准地处理时序伪影问题。从客观角度看，该方法提供了一种低成本、自监督的后训练策略，有望推广到其他时序生成任务中。

Abstract: Recent advances in preference alignment for diffusion-based video generation, particularly via Direct Preference Optimization (DPO), have significantly improved visual quality. However, temporally sparse artifacts such as motion collapse, object flickering, and color oversaturation remain a major barrier to perceptual realism. Existing methods struggle with these issues due to two key limitations: (1) the preference attribution bottleneck, where offline human annotations are costly and fail to accurately capture learning dynamics, while online reward signals are rollout-aware but often unstable and biased; and (2) temporal credit misallocation, where uniformly applied supervision cannot effectively target the brief segments in which artifacts occur. To address these challenges, we propose concentrated Implicit Preference Optimization (cIPO), a post-training framework for video diffusion models. cIPO derives implicit preference signals directly from the denoising process: given a real video, the model adds forward noise and reconstructs it via iterative denoising, treating the original as the preferred sample and the reconstruction as the dispreferred one. This formulation captures inference-time errors without requiring human annotations or external reward models. Moreover, frame-level discrepancies between original and reconstructed videos reveal when failures occur. cIPO leverages this by computing temporal reconstruction errors and concentrating optimization on high-error segments, enabling more precise correction of failure-prone regions. Extensive experiments demonstrate that cIPO consistently enhances video authenticity and temporal coherence across multiple datasets, highlighting the effectiveness and efficiency of implicit preference with temporally concentrated optimization.

[63] BladeYOLO: Wind Turbine Blade Defect Detection with Limited Annotations and Weak-Saliency Awareness cs.CVPDF

Yabin Xu, Fangtao Zhang, Fan Wang, Zhan Wang, Honghua Chen

TL;DR: 本文提出BladeYOLO，一个用于风力涡轮机叶片缺陷检测的框架。它通过集成基于DINOv3自监督预训练的ViT主干网络来迁移大规模通用视觉先验知识，以应对标注数据有限的问题。此外，还设计了Mamba引导的弱缺陷增强模块来提升对细微缺陷的感知，以及一个轻量级风格注入模块来增强模型对环境引起的外观变化的鲁棒性。

Details

Motivation: 解决风力涡轮机叶片缺陷检测在实际场景中的挑战，包括现场数据有限、缺陷尺度小、对比度低、与复杂背景难以区分，这些因素限制了现有检测器的鲁棒性。

Result: 在WTBlade-Defect数据集上取得了优越性能，并在减少训练标注的实验中表现出色。在公开的Wind Surface Defect数据集上，BladeYOLO的mAP${50}$和mAP${50-95}$分别比最佳竞争方法高出3.5%和2.5%，证明了其跨数据集鲁棒性。

Insight: 创新点包括：1) 将自监督预训练的ViT主干网络与YOLO结合，以迁移学习应对标注稀缺问题；2) 设计Mamba引导的弱缺陷增强模块，通过多尺度分支和跨Mamba模块增强对细微缺陷的感知；3) 引入风格注入模块，利用傅里叶分解捕获环境风格信息以提高鲁棒性。这些方法为小目标、弱显著性目标的检测提供了新思路。

Abstract: Wind turbine blade defect detection remains highly challenging in real-world inspection scenarios due to limited on-site data and the subtle visual characteristics of defects. In practice, blade defects are often small-scale, low-contrast, and difficult to distinguish from complex backgrounds, which significantly limits the robustness of existing detectors. To address these challenges, we propose BladeYOLO, a defect detection framework for wind turbine blades. Specifically, we integrate a Vision Transformer (ViT) backbone initialized with DINOv3 self-supervised pre-trained weights into YOLOv12-L, enabling the transfer of large-scale generic visual priors to blade defect detection and improving feature representation under limited training annotations. To enhance the perception of subtle defects, we further develop a Mamba-guided Weak-Defect Enhancement module, which consists of a Detail-Enhanced Multi-scale Branch for preserving high-frequency structural cues and a Cross-Mamba module for progressively propagating high-level semantic guidance to shallow features. In addition, we introduce a lightweight Style-Injector module that captures environment-related style information via Fourier decomposition and injects it into selected ViT self-attention layers, thereby improving robustness against environment-induced appearance variations. Extensive experiments demonstrate that BladeYOLO achieves superior performance on the WTBlade-Defect dataset, with additional annotation-budget experiments showing its favorable performance under reduced training annotations. Evaluation on the public Wind Surface Defect dataset further provides supportive evidence for the cross-dataset robustness of BladeYOLO. In particular, on this public dataset, BladeYOLO outperforms the best competing method by 3.5% in mAP${50}$ and 2.5% in mAP${50-95}$.

Taewan Kim, Jiwoo Kang

TL;DR: 本文提出了一种用于人脸与语音跨模态关联学习的简单而强大的特征嵌入方法。该方法通过引入中间特征，促使同一人的语音和面部特征嵌入到凸包中，并结合跨模态注意力机制来减少误报和漏报。

Details

Motivation: 现有跨模态关联研究虽解决了跨模态判别问题，但低估了处理音视频模态间特征异质性的重要性，导致大量误报和漏报，本文旨在解决此问题。

Result: 在大规模VoxCeleb数据集上对跨模态验证、匹配和检索任务进行了全面评估，实验结果表明该方法相比现有最先进方法取得了显著提升。

Insight: 创新点在于提出凸特征嵌入学习，通过使跨模态特征间存在另一特征来构建凸包，并结合跨模态注意力机制以最小化类间差异，从而有效处理模态异质性。

Abstract: Face-and-voice association learning is one of the most challenging tasks in deep learning. In this paper, we propose a simple but powerful cross-modal feature embedding method for the association of faces and voices. Previous work has studied cross-modal association tasks to establish the correlation between voice clips and facial images. These works have addressed cross-modal discrimination but underestimate the importance of handling heterogeneity in inter-modal features between audio and video, resulting in a lot of false positives and false negatives. To tackle the problem, the proposed method learns the embeddings of cross-modal features by making another feature exist between cross-modal features, facilitating the voice and face features of the same person to be embedded in a convex hull. Moreover, the incorporation of cross-modal attention mechanisms with convex embedding techniques represents a highly effective strategy for the attenuation of false positives and false negatives, accomplished via the minimization of inter-class discrepancies. We exhaustively evaluated our method for cross-modal verification, matching, and retrieval tasks on the large-scale VoxCeleb dataset. Extensive experimental results demonstrate that the proposed method achieves notable improvements over existing state-of-the-art methods.

[65] Collaborative Feature Aggregation for Face Super-Resolution and Robust Re-Identification cs.CVPDF

Juheon Hwang, Taewan Kim, Jiwoo Kang

TL;DR: 本文提出了一种新颖的协作方法，用于从序列或多视角人脸图像中进行人脸超分辨率和鲁棒的行人重识别。该方法通过基于Transformer的协作特征聚合，统一来自多序列或多视角数据的身份特征，并采用级联超分辨率网络逐步恢复高分辨率人脸图像。统一的身份表示进一步提升了在图像严重退化情况下的重识别性能。

Details

Motivation: 传统人脸超分辨率方法在从低质量图像恢复人脸时，常因低分辨率导致模糊和失真。现有基于图像和视频的方法，即使使用面部标志点或分割，也面临类似挑战。本文旨在利用跨时间或视角的多个相关人脸观测，克服这些限制。

Result: 详尽的实验和对比结果表明，该方法在多个基准测试上超越了其他最先进方法，在人脸超分辨率和行人重识别性能上均取得了一致的提升。

Insight: 创新点在于提出了一个基于Transformer的协作特征聚合框架，能够从多序列或多视角数据中统一身份特征，并结合一个级联超分辨率网络进行渐进式图像恢复。其核心洞察在于，联合身份重建和渐进式图像恢复能有效增强下游视觉识别任务，特别是在图像严重退化场景下。

Abstract: We propose a novel collaborative approach for face super-resolution (SR) and robust person re-identification from sequential or multi-view facial images. Traditional SR methods often suffer from blurring and distortion in faces recovered from poor-quality images due to low resolution. Image- and video-based facial SR methods using facial landmarks or segmentation also have similar challenges. To overcome these limitations, we leverage multiple correlated facial observations, across time or viewpoints, by introducing a transformer-based collaborative feature aggregation method that unifies identity features from multi-sequence or multi-view data. This allows faces in multiple sequences of an individual to contribute to accurately estimating common facial features. Furthermore, we propose a cascade SR network to progressively restore the high-resolution image of the target’s face with gradual facial feature unification. The unified identity representation is further utilized in person re-identification scenarios, enabling accurate matching even under severe image degradation. The exhaustive experimental results and comparisons show that our method outperforms other state-of-the-art methods, demonstrating consistent improvements in both face super-resolution and re-identification performance. Our work highlights the effectiveness of joint identity reconstruction and progressive image restoration from multiple facial inputs in enhancing downstream visual recognition tasks.

[66] OPLD: On-Policy Latent Distillation for Multimodal Reasoning cs.CV | cs.AIPDF

Shoutai Zhu, Tianyang Xu, Bin Sun, Mingyuan Xu, Yu Liu

TL;DR: 本文提出OPLD（On-Policy Latent Distillation）框架，旨在将多模态思维链（CoT）所诱导的推理能力蒸馏到潜在推理表示中，以解决现有方法在内部化抽象推理过程方面的不足。

Details

Motivation: 现有交错多模态CoT方法受限于外部定义的推理轨迹和视觉操作，而基于潜在表示的视觉推理方法通常仅通过特征对齐监督潜在状态，未能充分内部化多模态CoT所引发的抽象推理过程。

Result: 在多个多模态基准测试上的广泛实验表明，OPLD一致优于现有潜在推理方法，并在多个基准上达到了最先进的性能水平。

Insight: 创新点在于在推理过程层面而非传统特征层面对潜在表示进行监督，这为多模态潜在推理提供了一个更有效的范式，从而更好地将特权多模态CoT的推理能力转移到潜在表示中。

Abstract: Interleaved multimodal Chain-of-Thought (CoT) improves visual reasoning by incorporating auxiliary visual evidence into intermediate reasoning. However, existing approaches remain constrained by externally defined reasoning traces and visual operations, limiting their ability to develop flexible and abstract visual thinking. Reasoning with latent has recently offered a promising direction by internalizing intermediate computation into continuous representations. Nevertheless, existing visual-latent methods mainly supervise latent states through alignment with compressed auxiliary visual features, treating them as proxies for visual observations rather than active reasoning states. Consequently, they capture the provided evidence but fail to fully internalize the abstract reasoning process induced by multimodal CoT. In this paper, we propose OPLD (On-Policy Latent Distillation), a simple framework that transfers the reasoning capability induced by privileged multimodal CoT into latent reasoning representations. Extensive experiments on diverse multimodal benchmarks demonstrate that OPLD consistently outperforms existing latent reasoning methods and achieves state-of-the-art performance on multiple benchmarks. The results suggest that supervising latent representations at the reasoning-process level provides a more effective paradigm for multimodal latent reasoning than conventional feature-level alignment.

[67] Think with Extra-Image: A Farmland Segmentation Agent Driven by Spatio-Temporal Information Gain cs.CVPDF

Haiyang Wu, Weiliang Mu, Zhuofei Du, Dandan Zhong, Kaijie Shi

TL;DR: 本文提出了一种名为FarmSeeker的动态农田遥感图像分割智能体，它突破了传统‘图像内思考’的范式，通过主动获取图像外的时空信息来解决农田外观因物候和空间上下文变化导致的识别模糊问题。该方法将分割任务重新定义为由任务相关的额外时空信息增益驱动的动态决策过程，并在新构建的全球高分辨率基准GSFS-Bench上验证了其更稳定的性能。

Details

Motivation: 现有农田遥感图像分割方法遵循‘图像内思考’范式，假设当前图像包含足够的视觉证据。然而，农田外观随物候和空间上下文变化，且易与其他土地覆盖类型混淆，导致瞬时局部观测信息不足，分割模糊性不仅源于模型表征能力有限，更根本地源于所需信息超出了当前图像范围。

Result: 实验在新构建的全球尺度高分辨率农田遥感图像分割基准GSFS-Bench上进行，该基准支持推理-查询评估。结果表明，FarmSeeker相比现有方法实现了更稳定的分割性能。

Insight: 核心创新点在于从信息瓶颈视角重新定义了农田遥感图像分割任务，将其视为一个由额外时空信息增益驱动的动态决策过程，并提出了一个能够识别模糊区域、推理其原因、并按需查询额外信息的智能体框架。这为解决因时空变化导致的视觉识别不确定性提供了一种主动、动态的信息获取新思路。

Abstract: Existing farmland remote sensing image (FRSI) segmentation follows a “Think with Intra-Image” paradigm, assuming that the current image contains sufficient visual evidence for reliable segmentation. Yet farmland appearance varies with phenology and spatial context and is often confused with other land-cover, making instantaneous, local observations inadequate. Thus, segmentation ambiguity stems not only from limited model representation, but more fundamentally from the required spatio-temporal information lying beyond the current image. Based on this insight, we redefine FRSI segmentation from an information bottleneck perspective as a dynamic decision process driven by task-relevant extra spatio-temporal information gain. We further propose FarmSeeker, a dynamic FRSI segmentation agent that identifies ambiguous regions, reasons about their causes, and queries extra spatio-temporal information on demand for accurate segmentation. To evaluate FarmSeeker, we construct GSFS-Bench, the first global-scale, high-resolution FRSI segmentation benchmark that supports reasoning-querying. Experiments show that FarmSeeker achieves more stable segmentation performance than existing methods. The project is publicly available at: https://withoutocean.github.io/FarmSeeker/

[68] Scaling Vision-Language Models Is Not Enough to Mitigate Bias cs.CVPDF

Ioannis Sarridis, Ioannis Kompatsiaris, Symeon Papadopoulos

TL;DR: 该论文对194个公开可用的视觉语言模型进行了大规模实证研究，涵盖16个模型家族、多种模型规模、24个训练数据集和三个评估基准。研究发现，随着评估从ImageNet转向单属性偏差和多属性偏差基准，模型规模与性能的相关性显著减弱，而训练数据的属性（大小和质量）与最差组准确率的关系更为一致。精心策划的数据集在可比规模下比未策划的数据集性能提升高达25%。

Details

Motivation: 尽管CLIP等视觉语言模型已成为多模态系统的基础，但其对虚假相关性的鲁棒性在大规模下的理解仍然不足。论文旨在通过大规模实证研究，探究模型规模、训练数据和架构选择对缓解偏差的影响。

Result: 在ImageNet基准上，模型规模与性能的Spearman相关性为0.68；在CelebA单属性偏差基准上降至0.48；在UrbanCars多属性偏差基准上进一步降至0.05。训练数据质量和大小与最差组准确率在偏差基准上表现出更一致的关系，精心策划的数据集比未策划数据集性能提升高达25%。

Insight: 论文的创新点在于首次大规模实证研究视觉语言模型的偏差缓解问题，揭示了模型规模扩大不足以有效缓解复杂偏差，而训练数据质量（如精心策划）是关键因素。客观来看，研究强调了在模型开发中优先考虑数据质量而非单纯扩大规模的重要性，并为评估模型鲁棒性提供了多基准框架。

Abstract: Vision-Language Models (VLMs) such as CLIP are now foundational to multimodal systems, yet their robustness to spurious correlations remains poorly understood at scale. We present the first large-scale empirical study of 194 publicly available VLMs, including 16 model families, covering a wide range of model sizes, 24 training datasets, and three evaluation benchmarks, namely ImageNet (overall performance), CelebA (typical single-attribute bias), and UrbanCars (complex multi-attribute biases). Across these settings, the Spearman correlation between model scale and performance weakens as evaluation shifts from ImageNet ($ρ{=}0.68$) to single-attribute ($ρ{=}0.48$) and further to multi-attribute ($ρ{=}0.05$) bias benchmarks. In contrast, properties of the training data (size and quality) show more consistent relationships with worst-group accuracy across both bias benchmarks. Notably, curated datasets yield improvements of up to 25% over uncurated alternatives at a comparable scale. Finally, the effect of architectural choices (e.g., patch size, image resolution) is highly context-dependent, varying with the nature of the benchmark, including the type of bias and its spatial distribution within images.

[69] FaithEyes: Towards Faithful Tool Use via Multi-Agent Process-Image Verification cs.CVPDF

Haoqing Wang, Xingrun Xing, Wei Xia, Ziheng Li, Yehui Tang

TL;DR: 本文提出FaithEyes，一个多智能体自我判断框架，旨在解决视觉语言模型（VLMs）在工具调用中不忠实的问题。该框架通过让模型自身作为子智能体来评估主智能体工具调用的有用性，并将判断结果注入推理上下文和奖励信号中，从而提升工具使用的忠实度和推理可靠性。

Details

Motivation: 现有视觉语言模型在工具调用（如裁剪、图像处理）时经常出现不忠实行为，例如调用无关工具或错误区域，却仍能获得奖励并给出正确答案，这浪费计算资源并表明模型过度依赖先验知识而非检索证据。现有方法的工具奖励无法区分有用与无用调用，且工具反馈缺乏有效性信号。

Result: 通过两阶段SFT+RL流程在适应的开源数据上训练，FaithEyes在视觉感知和推理基准测试中取得了有竞争力或更优的准确率，同时显著提升了工具使用的忠实度。

Insight: 创新点在于引入多智能体自我判断机制，将工具调用的有用性评估内化为模型推理过程的一部分，并通过奖励缩放抑制奖励黑客行为，确保了训练与测试的一致性，无需依赖外部模型进行推断。

Abstract: Agentic vision-language models (VLMs), which interleave textual reasoning with explicit tool calls such as cropping and code-based image manipulation, have emerged as a compelling paradigm for reliable and interpretable multimodal reasoning. However, recent studies have revealed that such models often use tools unfaithfully. Many process images are irrelevant to the question (e.g., the tool crops the wrong region or misses the queried target), yet the call still receives full credit and the model still answers correctly. Such decorative or misaligned tool calls waste computation and reveal that the model leans on prior knowledge or the original image rather than the evidence it retrieves. This may stem from two limitations of prevailing methods: the tool reward fails to distinguish useful from useless calls, and tool feedback carries no signal of usefulness. To this end, we introduce FaithEyes, a multi-agent self-judging framework. Concretely, we use a VLM to judge whether each process image helps answer the question. The judgement is injected into the reasoning context as part of the tool observation to help subsequent reasoning, and meanwhile is used to scale the tool reward by the helpful-tool ratio to suppress reward hacking. To keep judgement available at evaluation and thus ensure train-test consistency, we further design a multi-agent framework where the model itself serves as a subagent to judge the tool calls from main agent, eliminating any dependence on an external model at inference. Training via a two-stage SFT + RL pipeline on adapted open-source data, FaithEyes attains competitive or superior accuracy across visual perception and reasoning benchmarks, while markedly improving tool faithfulness. The homepage is at https://github.com/Mosi-AI/FaithEyes.

[70] EgoGenesis: Egocentric World-Action Modeling with Online Anchored Projective Memory and Action-3D RoPE cs.CV | cs.AIPDF

Zexuan Yan, Yuzhou Wu, Yue Ma, Zonghang He, Kaibo Yin

TL;DR: 本文提出了EgoGenesis方法，一种以自我为中心的世界-动作模拟器，用于合成可控、高质量的操作视频，以扩展稀缺的真实世界训练数据。该方法基于预训练的视频生成先验，引入了两种几何感知的条件机制：在线锚定投影记忆（OAPM）和动作-3D旋转位置嵌入（A3D-RoPE），以提升长序列自我中心视频的视觉保真度、几何稳定性和动作对齐。实验表明，使用合成数据增强真实轨迹能显著提高真实机器人在分布外任务上的成功率。

Details

Motivation: 自我中心视频为具身AI提供了丰富的操作经验，但收集跨场景、对象、动作和体现的多样化自我中心数据成本高昂，因此需要一种方法来合成可控、高质量的视频以扩展训练数据。

Result: 在单臂任务上，用400条生成轨迹增强400条真实轨迹后，真实机器人的分布外成功率从77%提升到84%；在双臂任务上，从53%提升到70%，表明合成数据显著改善了下游世界-动作建模的泛化能力。

Insight: 创新点包括在线锚定投影记忆（OAPM）来维持3D场景锚点并定期刷新状态，以及动作-3D旋转位置嵌入（A3D-RoPE）来编码末端执行器运动并注入动作几何信息，这些机制增强了视频生成的几何感知和动作控制精度。

Abstract: Egocentric video offers rich manipulation experience for embodied AI, yet collecting diverse egocentric data across scenes, objects, motions, and embodiments remains costly. We present \method, an egocentric world-action simulator that synthesizes controllable, high-quality manipulation videos to expand scarce real-world training data. \method{} builds on a pretrained video generation prior and introduces two geometry-aware conditioning mechanisms. Online Anchored Projective Memory (OAPM) preserves a first-frame 3D scene anchor while periodically refreshing a recent state during autoregressive generation. Action-3D Rotary Position Embedding (A3D-RoPE) encodes end-effector motion with camera-aware 3D rotary coordinates, injecting action geometry into skeleton-to-video cross-attention for precise control. Together, these components improve visual fidelity, geometric stability, and action alignment in long egocentric rollouts. Moreover, augmenting 400 real trajectories with 400 \method-generated trajectories improves out-of-distribution real-robot success from 77% to 84% on single-arm tasks and from 53% to 70% on dual-arm tasks, demonstrating that the synthesized data substantially improve downstream WAM generalization.

[71] Space2Ground 2.0: A Multi-Source Dataset and Framework for Agricultural Monitoring through Fusion of Street-Level and Satellite Imagery cs.CVPDF

Iason Tsardanidis, Alkiviadis Koukos, George Choumos, Vasileios Sitokontantinou, Charalampos Kontoes

TL;DR: 本文提出了Space2Ground 2.0框架和数据集，用于农业监测。该框架融合了Sentinel-1 SAR和Sentinel-2多光谱卫星时间序列数据，以及通过Mapillary平台获取的街景图像，以克服单一卫星观测的视角限制和云层干扰。通过自动化处理流程，生成了一个包含46,050张标注街景图像并与8,581个农田地块关联的数据集。实验表明，融合街景和卫星数据能提升地块级作物分类的准确性。

Details

Motivation: 解决仅依赖卫星遥感进行农业监测的挑战，因为卫星仅提供俯视视角且光学观测易受云层影响导致时间序列不连续，需要融合地面视角的街景图像以获得互补的细粒度视觉信息。

Result: 在2022年塞浦路斯生长季构建了包含46,050张标注街景图像的数据集，并与卫星数据关联。地块级作物分类实验表明，融合街景和卫星时间序列的多源观测相比单一卫星观测能提升分类性能，验证了街景图像的互补价值。

Insight: 创新点在于提出了一个自动化处理流程，将众包街景图像转化为与地块关联的分析就绪数据，并构建了首个公开的多模态农业监测基准数据集。该方法为视觉验证、减少实地勘察成本和数据驱动的农业政策实施提供了新途径。

Abstract: Accurate and scalable parcel-level agricultural monitoring remains challenging because satellite Earth Observation alone provides only an overhead perspective of agricultural parcels, while optical observations are further affected by cloud-induced temporal gaps. This paper presents Space2Ground 2.0, a multi-source framework integrating Sentinel-1 SAR and Sentinel-2 multispectral time series with geo-tagged street-level imagery acquired using vehicle-mounted cameras and shared through the Mapillary platform. A largely automated processing pipeline performs semantic filtering, image quality assessment, viewpoint-based parcel association, and dataset refinement, transforming large volumes of crowdsourced imagery into parcel-linked, analysis-ready data. Applied over Cyprus during the 2022 growing season, the pipeline produced a curated dataset of 46,050 annotated street-level images, selected from an initial collection exceeding 900,000 images and linked with satellite information for 8,581 agricultural parcels. The practical value of the dataset was assessed through parcel-level crop classification experiments using both single- and multi-source observations. The results demonstrate that street-level imagery provides complementary fine-scale visual information that enhances classification when integrated with satellite time series. Overall, Space2Ground 2.0 provides an openly available benchmark dataset and a reproducible methodology for multimodal agricultural monitoring, with potential applications in visual verification, reduced reliance on costly field inspections, and data-driven agricultural policy implementation.

[72] TARS: Timestep-Aware Data Scaling for 3D-Free Video Re-Shooting cs.CVPDF

Jiwen Liu, Shujuan Li, Xiaohan Li, Zijie Meng, Xinyue Liu

TL;DR: 论文提出了一种名为TARS的3D-free视频重拍方法，通过文本驱动的语义视角指定来控制视频的拍摄尺度、视角和第一/第三人称视角。该方法基于时间步感知的数据缩放和联合文本-相机条件化，无需成对的重拍数据或3D重建，即可实现鲁棒的相机和视角控制，并在大相机运动下合成源视图之外的区域。

Details

Motivation: 现有视频重拍方法依赖显式3D先验（受重建质量限制，合成未见区域时效果差）或成对不同相机轨迹的视频对（数据稀缺阻碍泛化），因此需要一种不依赖3D且数据高效的范式来实现可控的相机运动和视角再生。

Result: 大量实验表明，TARS在相机控制精度和时间一致性上优于现有方法，能够实现反向角度重拍和视角切换，并在大相机运动下合理合成源视图之外的区域。

Insight: 创新点在于通过时间步敏感性分析发现相机运动主要在高噪声阶段建立，从而引入自监督训练学习相机动态和基础视觉表示；结合数据缩放和联合文本-相机条件化，实现了无需3D或成对数据的鲁棒视角控制，为视频编辑提供了新思路。

Abstract: Video re-shooting aims to regenerate videos with controllable camera motion and viewpoint. Existing methods rely on explicit 3D priors, which are limited by reconstruction quality and often perform poorly when synthesizing previously unseen regions, or on paired videos with different camera trajectories, whose scarcity hinders generalization. We revisit video re-shooting through text-driven semantic viewpoint specification, enabling control over shot scale, viewing angle, and first-/third-person perspective. To this end, we propose TARS, a 3D-free video re-shooting paradigm. Timestep-wise sensitivity analysis reveals that camera motion is primarily established during high-noise stages, where coarse spatiotemporal structures are formed. Based on this insight, we introduce self-supervised training to learn camera dynamics and fundamental visual representations without paired re-shooting data or 3D reconstruction. Through data scaling and joint textual-camera conditioning, TARS supports robust camera and viewpoint control, plausibly synthesizing regions beyond the source view under large camera motions while enabling reverse-angle re-shooting and perspective switching. Extensive experiments show that TARS provides more accurate and temporally consistent camera control than prior methods. Project Page: https://ymlinfeng.github.io/TARS.github.io/

[73] Beyond Visual Ambiguity: Guiding Robust Monocular Depth Estimation in Challenging Scenarios via Detailed Long Captions cs.CVPDF

Junrui Zhang, Jiaqi Li, Yiran Wang, Liao Shen, Zhiguo Cao

TL;DR: 本文提出了一种名为CapDepth的新型单目深度估计框架，旨在利用详细的长文本描述来缓解具有挑战性的场景（如非朗伯表面和恶劣天气条件）中固有的视觉模糊性问题。该框架通过设计一个明确传达空间关系的长文本输入模板、一个使用渐进掩码注意力提取细粒度文本特征的动态编码器，以及一个通过稳定自适应层归一化利用文本特征指导深度解码的文本自适应解码器来实现。

Details

Motivation: 单目深度估计在非朗伯表面和恶劣天气条件下因单张图像信息有限而面临视觉模糊性挑战。现有方法通过图像修复或增强孤立地处理这些问题，鲁棒性提升有限。语言作为视觉的强大补充模态，已被证明能通过详细的长文本描述增强视觉-语言模型的感知能力，但先前集成语言的方法未能充分利用此潜力。

Result: 在广泛的实验中，CapDepth验证了其有效性，其性能超越了最先进的方法，在非朗伯表面和恶劣天气条件下分别实现了25.0%和22.0%的深度误差降低。

Insight: 论文的创新点在于系统性地利用详细长文本描述来指导深度估计，具体包括：设计结构化长文本模板以明确空间关系；提出动态编码器进行细粒度深度相关文本特征提取；以及开发文本自适应解码器实现稳定的跨模态特征融合。这为利用语言模态增强视觉任务的鲁棒性提供了新思路。

Abstract: Monocular depth estimation (MDE) faces challenges with non-Lambertian surfaces and adverse weather conditions due to the visual ambiguities inherent in single-image limited information. Existing works address them in isolation via image inpainting or augmentation, yielding limited robustness gains. Language, as a powerful complementary modality to vision, is demonstrated to enhance the visual perception capabilities of vision-language models (VLMs) via detailed long captions. However, prior language-integrated MDE methods fail to fully harness this potential due to short text input with limited information, coarse global text feature learning, and limited language guidance during depth decoding. To address these limitations, we propose CapDepth, a novel framework for robust MDE that leverages guidance from detailed long captions to alleviate visual ambiguities in both challenging scenarios. First, we design a detailed long caption input template that explicitly conveys rich spatial relationships among multiple atom sentences. Second, a dynamic caption encoder is introduced to extract fine-grained depth-relevant text features via progressive masked attention. Finally, we propose a text-adaptive decoder that guides enhanced depth decoding with text features via stable adaptive layer normalization. Extensive experiments validate the efficacy of CapDepth, which outperforms state-of-the-art methods, achieving depth error reductions of 25.0% on non-Lambertian surfaces and 22.0% under adverse weather conditions.

[74] Theia: Large-Scale Multimodal Captioning and Automated Validation of the Incidents1M Dataset for Data-Free Distillation cs.CV | cs.AI | cs.MMPDF

Simone Giano, Lorenzo Severini, Alessandro Galdelli, Adriano Mancini

TL;DR: 该论文提出了一种新颖的方法来构建和自动验证用于灾难响应的大规模多模态数据集。针对现有数据集如Incidents1M缺乏文本描述或CrisisMMD存在图文语义错位的问题，作者从纯视觉的Incidents1M数据集出发，恢复了10万张图像，并使用两种不同的Qwen3.5架构（4B密集模型和35B MoE模型）生成了高保真的文本描述。为确保生成的描述能为数据无知识蒸馏提供可靠的语义锚点，作者引入了一个基于Qwen3.5-9B的、图像盲的LLM-as-a-Judge验证流程。该评估器通过故意对法官隐藏原始图像，准确模拟了学生在数据无蒸馏过程中的模态鸿沟。

Details

Motivation: 在灾难管理等关键领域部署视觉语言模型需要高质量的多模态数据集，特别是为了通过数据无知识蒸馏来传递知识。然而，该领域的现有数据集要么完全缺乏描述性文本，要么存在严重的图文语义错位，这阻碍了可靠的知识迁移。

Result: 对173,179个标签对的评估显示，两种生成架构之间具有较高的语义一致性（78.65/100）。自动评估揭示了保守的标注行为，表现为高精确率（77.6%）和低召回率（46.0%），这最大限度地减少了误报噪声，同时暴露了原始真实标注中潜在的人类标注不一致性。

Insight: 论文的创新点在于提出了一个可扩展的、由LLM验证的多模态数据集构建框架，以及一个图像盲的LLM-as-a-Judge自动验证流程，该流程通过模拟学生模型的模态鸿沟来确保生成描述对数据无知识蒸馏的可靠性。这为跨模态知识蒸馏提供了可重复的方法和高质量的数据资源。

Abstract: The deployment of Vision-Language Models (VLMs) in critical domains like disaster management requires high-quality multimodal datasets, especially for transferring knowledge via Data-Free Knowledge Distillation (DFKD). However, existing datasets in this domain either entirely lack descriptive text, such as Incidents1M, or suffer from severe text-image semantic misalignment, such as CrisisMMD. In this work, we present a novel methodology to construct and automatically validate a large-scale multimodal dataset for disaster response. Starting from the vision-only Incidents1M, we successfully recovered 100,000 images and generated high-fidelity textual descriptions using two distinct Qwen3.5 architectures: a 4B dense model and a 35B Mixture-of-Experts (MoE) model. To ensure the generated captions provide reliable semantic anchoring for DFKD, we introduce an image-blind LLM-as-a-Judge validation pipeline leveraging Qwen3.5-9B. By intentionally obscuring the original image from the judge, this evaluator accurately simulates the modality gap of the student model during data-free distillation. Our evaluation across 173,179 label pairs demonstrates a high semantic agreement (78.65/100) between the two architectures. Furthermore, the automated evaluation reveals a conservative captioning behaviour, characterized by a high Precision (77.6%) and low Recall (46.0%). This minimizes the false positive noise, while simultaneously exposing underlying human annotation inconsistencies in the original ground truth. This work provides a scalable, LLM-validated multimodal dataset and a reproducible framework to advance cross-modal knowledge distillation.

[75] MonoVoc: Decoupling Geometry and Semantics for Lightweight Monocular Open-Vocabulary 3D Gaussians cs.CV | cs.AIPDF

Pouya Ardekhani, Zahra Dehghanian, Morteza Abolghasemi, Hamid R. Rabiee

TL;DR: 论文提出了一种名为MonoVoc的新型免训练流程，用于从单目视频序列中实现开放词汇的3D场景理解。该方法通过将3D几何重建与语义集成显式解耦，独立提取几何信息，并通过轻量级模块化后处理框架来关联语义，从而输出紧凑、可解释且完全可搜索的对象级语义高斯地图。

Details

Motivation: 当前基于3D高斯的方法存在多视图捕获要求严格、场景特定优化成本高以及存储密集语言特征内存开销大的瓶颈，限制了开放词汇3D场景理解的实用性和可扩展性。本文旨在解决这些问题，实现从日常单目视频中进行高效、可扩展的3D检索和问答。

Result: 在Replica数据集上的广泛评估表明，该解耦架构保持了强大的渲染保真度和有竞争力的分割精度。最关键的是，通过用模块化的对象级语义嵌入替代密集的逐高斯存储，与SOTA基线相比，该方法实现了内存使用量一个数量级的减少。

Insight: 核心创新点在于将几何与语义显式解耦的免训练架构设计。这避免了在映射循环中纠缠沉重的语言嵌入，使得语义集成成为轻量级、模块化的后处理步骤，从而在保持性能的同时，极大地提升了内存效率和实用性，为从单目视频进行开放词汇3D理解提供了更可行的方案。

Abstract: Open vocabulary 3D scene understanding is essential for next-generation interactive systems, empowering users to intuitively query and navigate reconstructed environments using natural language. However, current 3D Gaussian frameworks are often bottlenecked by restrictive multiview capture requirements, costly scene-specific optimization, and the massive memory overhead of storing dense language features. We present a novel, training-free pipeline that fundamentally reimagines this paradigm by explicitly decoupling 3D geometric reconstruction from semantic integration. Given a standard monocular video sequence as input, our method efficiently outputs a compact, highly interpretable, and fully searchable object-level semantic Gaussian map. Rather than entangling heavy language embeddings within the mapping loop, we extract geometry independently and ground semantics through a lightweight, modular post-processing framework. Extensive evaluations on the Replica dataset demonstrate that this decoupled architecture preserves strong rendering fidelity and competitive segmentation accuracy. Crucially, by replacing dense per-Gaussian storage with modular, object-level semantic embeddings, our approach delivers an order-of-magnitude reduction in memory usage compared to SOTA baselines. This provides a highly efficient, scalable, and practical solution for open-vocabulary 3D retrieval and question answering directly from everyday monocular video.

[76] AdaAnchor4D: Anchor-Conditioned Spatiotemporal Feature Aggregation for Monocular UAV 4D Reconstruction cs.CVPDF

Peiyi Xu, Junpeng Zhang, Guanbin Li, Ronghua Shang, Mingtao Feng

TL;DR: 本文提出AdaAnchor4D，一种用于单目无人机视频动态场景4D重建的自适应锚点变形框架。该框架通过锚点条件特征聚合（ACFA）自适应地聚合共享时空特征，并结合解耦局部几何变形（DLGD）与密度自适应坐标扭曲（DACW），以应对城市场景中显著的时空异质性，减少伪影并提升动态细节。

Details

Motivation: 解决单目无人机视频动态重建中，复杂城市场景存在的显著时空异质性（不同区域具有不同的时间活动模式，且动态区域运动状态随时间演变）问题。现有基于分解共享时空特征场的动态高斯方法采用固定的平面特征组合机制，难以适应这种异质性，常导致重影伪影和动态细节模糊。

Result: 在UAV-Arc4D、VisDrone和UAVDT基准测试上，AdaAnchor4D相比代表性的动态高斯方法实现了更高的渲染质量，同时保持了实时渲染性能。

Insight: 创新点在于提出了锚点条件特征聚合（ACFA）机制，使局部单元能根据其局部状态和时间信息自适应获取动态表示；并通过解耦局部几何变形（DLGD）和密度自适应坐标扭曲（DACW），缓解了非均匀几何采样与均匀网格参数化之间的不匹配问题，提升了模型对时空异质场景的建模能力。

Abstract: Monocular UAV videos provide valuable observations for dynamic reconstruction of complex urban scenes. However, such scenes exhibit pronounced spatiotemporal heterogeneity: different regions follow distinct temporal activity patterns, while the motion states of some dynamic regions may further evolve over time. Although dynamic Gaussian methods based on decomposed shared spatiotemporal feature fields have achieved efficient and accurate reconstruction in object-centric or relatively compact scenes, their commonly adopted fixed plane-wise feature combination mechanisms are less suited to the heterogeneous local dynamics of UAV scenes, often leading to ghosting artifacts and blurred dynamic details. To address this challenge, we propose AdaAnchor4D, an adaptive anchor deformation framework for monocular UAV dynamic scene reconstruction. At its core, Anchor-Conditioned Feature Aggregation (ACFA) adaptively aggregates shared spatiotemporal features using anchor-specific aggregation embeddings and temporal information, allowing different local units to obtain dynamic representations tailored to their local and temporal states. Decoupled Local Geometry Deformation (DLGD) separates anchor-state deformation from local Gaussian geometry deformation, while Density-Adaptive Coordinate Warping (DACW) reparameterizes feature-query coordinates according to the axis-wise anchor distributions, alleviating the mismatch between non-uniform geometric sampling and uniform grid parameterization. Experiments on UAV-Arc4D, VisDrone, and UAVDT show that AdaAnchor4D achieves higher rendering quality than representative dynamic Gaussian methods while maintaining real-time rendering performance. The code will be made publicly available.

[77] Capturing Token Tendencies for Training-Free Token Pruning in Multimodal Large Language Models cs.CVPDF

Jie Ma, Zhike Qiu, Jie Gao, Jiayi Ji, Qian Chen

TL;DR: 本文提出了一种名为趋势感知剪枝（Trend-aware Pruning）的新框架，用于多模态大语言模型（MLLMs）中无需训练的视觉令牌剪枝。该方法通过建模注意力流的动态轨迹，而非依赖静态的瞬时启发式方法，能够选择性重新激活那些重要性在深层网络中逐渐显现的“后发”令牌，从而在显著减少计算量的同时保持模型性能。

Details

Motivation: 现有无需训练的视觉令牌剪枝方法依赖静态启发式进行不可逆的过滤，忽略了令牌重要性在MLLM不同层级中动态演化的特性，导致对深层推理至关重要的令牌可能在浅层被过早丢弃。

Result: 大量实验表明，该方法在多种多模态任务上实现了优越的效率-性能权衡，能在最终层仅保留约23个视觉令牌（减少超过77.8%）的同时，保持有竞争力的性能。

Insight: 核心创新在于将剪枝决策从局部快照提升为对令牌重要性动态轨迹（即“趋势”）的建模，并引入了动态校正机制来重新激活“后发”令牌，为高效多模态推理提供了一个鲁棒且可逆的解决方案。

Abstract: While visual token pruning is essential for efficient Multimodal Large Language Models (MLLMs), existing training-free methods suffer from a critical limitation: they rely on static, instantaneous heuristics to perform irreversible filtering. This approach ignores the hierarchical nature of MLLMs, where token importance often evolves dynamically rather than remaining fixed across layers. Consequently, tokens essential for deep-layer reasoning are often prematurely discarded by shallow-layer estimates. To address this, we propose Trend-aware Pruning, a novel framework that elevates pruning from a local snapshot decision to a temporal trajectory modeling problem. Instead of relying on isolated scores, our method captures the momentum of attention flow. This enables a dynamic rectification mechanism that selectively reactivates “late-blooming” tokens, those initially undervalued but exhibiting rising semantic importance, thereby preventing the loss of critical visual cues. Extensive experiments demonstrate that our approach achieves a superior efficiency-performance trade-off across diverse multimodal tasks. Notably, it reduces visual tokens by over 77.8%, retaining only approximately 23 tokens in the final layer while maintaining competitive performance, offering a robust and reversible solution for high-efficiency multimodal inference.

[78] ObjectStream: Latent Objects as Memory Anchors for Streaming Video Understanding cs.CV | cs.AIPDF

Mingkang Dong, Muxin Pu, Jie Li, Bohan Guo, Songruo Chen

TL;DR: 本文提出了ObjectStream，一种无需训练的视频流理解框架，它将潜在对象作为记忆锚点来组织视频证据。该方法直接从冻结的Video-LLM表示中诱导出空间连贯的潜在对象，跨帧链接成持久锚点，并在有限内存预算下维护其历史。基于这些锚点，ObjectStream保留了三种互补的证据形式：持久对象历史、瞬态对象变化和近期视觉上下文，从而赋能现有Video-LLM进行对象级推理。

Details

Motivation: 现有视频流理解方法主要依据token重要性、时间冗余或片段级相关性来管理不断增长的视觉上下文，但很少围绕随时间持续存在和演化的对象来组织证据。本文旨在解决这一不足。

Result: 在在线流式评估中，ObjectStream将Qwen2.5-VL-7B在OVO-Bench Real-Time Visual Perception上的性能提升了10.0个百分点，同时将峰值GPU内存和TTFT降低了约50%。在离线长视频基准测试中，它在丢弃82.5%视觉token的同时，性能超越了全token基线。

Insight: 核心创新点在于将潜在对象作为视频流记忆的组织原则，这是一种无需外部检测器或分割模型、直接从Video-LLM表示中诱导并跨帧链接对象的训练免费方法。其设计的三种互补证据形式（持久历史、瞬态变化、近期上下文）为对象级推理提供了结构化支持，在显著提升效率的同时保持了有效性。

Abstract: Streaming video understanding requires models to continuously retain useful visual evidence before future questions are known. Existing approaches primarily manage the growing visual context according to token importance, temporal redundancy, or segment-level relevance, but rarely organize evidence around objects that persist and evolve over time. Thus, in this paper, we introduce ObjectStream, a training-free framework that treats latent objects as memory anchors for streaming video understanding. ObjectStream induces spatially coherent latent objects directly from frozen Video-LLM representations, links them across frames into persistent anchors, and maintains their histories under a bounded memory budget, without requiring external object detectors or segmentation models. Built on these anchors, ObjectStream preserves three complementary forms of evidence: persistent object histories, transient object changes, and recent visual context. This design enables existing Video Large Language Models (Video-LLMs) to reason over object identities, interactions, and state changes while leaving the underlying model unchanged. Extensive experiments on online streaming and offline long-video benchmarks demonstrate both effectiveness and efficiency. In online streaming evaluation, ObjectStream improves Qwen2.5-VL-7B by 10.0 points on OVO-Bench Real-Time Visual Perception, while reducing peak GPU mem-ory and TTFT by approximately 50%. On offline long-video benchmarks, it surpasses the full-token baseline while discarding 82.5% of visual tokens. These results highlight latent objects as a practical and effective organizing principle for compact streaming video memory.

[79] ShadowDancer: Teaching Video World Models Any Action by Learning Unified Dynamics Representations from a Video and Its Shadow cs.CV | cs.AI | cs.LGPDF

Jin Cao, Zian Meng, Kaipeng Zhang

TL;DR: ShadowDancer是一种新颖的方法，用于对交互式视频世界模型进行任意动作的帧级控制。它通过构建‘影子对’（即在不同外观下重放相同动态的视频对）和‘跨影子预测’（通过从一个影子预测另一个来学习动作），学习统一的动态表示，从而将演示视频转化为可重用的动作资产，无需动作标签、运动估计器或微调即可在新环境中重放。

Details

Motivation: 现有方法要么对动作编码过于宽松，导致模型即兴发挥；要么通过结构化信号精确编码，但难以获取且仅适用于特定动态家族。演示视频虽能逐帧指定动态，但其动态与特定外观紧密耦合，导致学习到的动作在新场景中泛化能力差。

Result: 实验表明，在多种动态家族上，ShadowDancer在动作迁移和长动作展开方面优于强大的潜在动作和交互式世界模型基线，在展开比较中平均盲测胜率达到86%。

Insight: 核心创新在于利用‘影子对’解耦动态与外观，并通过‘跨影子预测’学习纯粹、统一的动态表示。这使得任何演示片段都能成为可移植的动作模块，实现了对世界模型的精确、泛化控制，无需依赖特定于任务或场景的监督信号。

Abstract: We present ShadowDancer, a novel approach to any-action, frame-level control of interactive video world models. The obstacle is representational: existing interfaces either encode an action loosely, leaving how it unfolds for the model to improvise, or encode it exactly through structured signals that serve one family and are hard to acquire, so precise control across diverse dynamics remains impractical. Demonstration videos are the natural remedy, specifying any dynamics frame by frame; yet a video shows its dynamics only through one particular appearance, a single shadow of the underlying dynamics, so actions learned from demonstrations transfer poorly to new scenes. ShadowDancer addresses this with two key innovations: (1) shadow pairs, video pairs that replay the same dynamics under independently resampled appearance, constructed at scale by our Shadow Library, so that a dynamics family becomes controllable exactly when such pairs can be constructed for it; and (2) cross-shadow prediction, which learns actions by predicting one shadow from the other, so that whatever the pairing resamples is discarded by construction and whatever it preserves becomes the action, yielding a unified dynamics representation that drives a block-causal world model. Any demonstrated clip thus becomes a reusable action asset, replayed in new environments without action labels, motion estimators, or fine-tuning. Experiments demonstrate improved action transfer and long action rollout over strong latent-action and interactive world model baselines across diverse dynamics families, with an average blinded win rate of 86% in rollout comparisons. We show video results at https://ShadowDancer-1.github.io

[80] Explaining Image Similarity with Automatically Extracted Concept Activation Vectors cs.CVPDF

Isaac Roberts, Petra Bevandic, Alexander Schulz, Barbara Hammer

TL;DR: 本文提出了一种模型和度量无关的框架，利用稀疏自编码器自动提取概念激活向量来解释图像相似性。该方法通过扰动嵌入空间中的概念方向来量化概念对相似性的贡献，并提供概念归因图进行定位。此外，框架扩展到群组层面解释图像簇的相似性，并引入了范例检索以寻找具有相似相似性原因的图像。

Details

Motivation: 现有基于梯度的归因方法难以提供对嵌入空间中驱动相似性的全局洞察（如纹理、形状或颜色），因此需要一种能解释图像相似性根本原因的方法。

Result: 实验表明，该方法在潜在空间的扰动比像素空间基线更忠实于底层数据分布，且概念重要性能够线性恢复真实的相似性分数。定性结果进一步证实了该方法在理解模型个体和群组相似性判断方面的有效性。

Insight: 创新点在于利用稀疏自编码器自动提取CAVs，实现了模型和度量无关的相似性解释；将解释从图像对扩展到群组层面，并引入范例检索来增强可解释性。这为理解嵌入空间中的相似性驱动因素提供了全局且可操作的洞察。

Abstract: Image similarity underlies many computer vision applications, yet it is often unclear why two images receive a high or low similarity score. Existing explainability methods often rely on gradient-based attribution maps to provide local justifications for similarity. These approaches struggle to provide global insights into what specifically drives similarity in regions of an embedding space, such as texture, shape, or color. We introduce a model- and metric-agnostic framework that explains image similarity using Concept Activation Vectors (CAVs) extracted automatically via Sparse Autoencoders (SAEs). Given a pair of images, we perturb their embeddings along discovered concept directions and measure the resulting change in a chosen similarity function, yielding concept importances. For image pairs, we provide localization with concept attribution maps. We extend this procedure to group-level settings, explaining what drives similarity across a cluster of images rather than a single pair, and further, we introduce Exemplar Retrieval, aiming to recover samples with similar reasons contributing to similarity. Our experiments show that our latent perturbations are more faithful to the underlying data distribution than pixel-space baselines, and that concept importances linearly recover the true similarity score. Qualitative results further confirm the usefulness of our methods in understanding a model’s individual and group similarity judgments.

[81] Hand-Object Interaction in the Age of Large Foundation Models:Reconstruction, Generation, and Embodied Transfer cs.CVPDF

Weiquan Lin, Yu Deng, Shiyang Liu, Luping Xiao, Xu Tang

TL;DR: 这篇综述论文系统性地回顾了基础模型在手物交互（HOI）建模中的应用，将现有文献组织为六个HOI任务（涵盖重建与生成），并建立了一个包含几何、语义和视觉三大类共八种子先验的分类法。论文分析了这些先验知识在HOI流程中的表示、注入和适应方式，并探讨了HOI知识在机器人学习中的迁移应用，最后总结了数据集、评估方法以及未来方向。

Details

Motivation: 手物交互建模因需联合推理手部关节、物体几何、接触、语义和动态，且在严重视觉不确定性下而极具挑战。基础模型从大规模跨域数据中学习到的可迁移先验知识，为解决这些挑战提供了新途径，但现有研究零散且缺乏系统性分析。

Result: 论文是一篇综述，未提出具体模型或报告定量结果，但系统性地整理了HOI任务、基础模型先验的分类法，并分析了其在HOI流程中的应用方式，旨在为领域提供结构化框架。

Insight: 创新点在于首次对HOI领域的基础模型先验进行了系统性综述与分类（几何、语义、视觉三大类八种子先验），并系统分析了先验知识的注入与适应机制。此外，论文还前瞻性地探讨了HOI知识向机器人学习的迁移路径（如人数据预训练、人机技能迁移），并维护了一个持续更新的资源库以支持长期发展。

Abstract: Hand-object interaction (HOI) modeling remains challenging because it requires joint reasoning about hand articulation, object geometry, contact, semantics, and dynamics under severe visual uncertainty. Foundation models introduce transferable prior knowledge learned from large-scale cross-domain data, offering new ways to address these challenges beyond task-specific data and models. However, the rapidly growing literature remains fragmented, and existing studies typically describe these methods simply as ``using large models’’ without systematically characterizing what knowledge is introduced, where it enters the HOI pipeline, or which HOI uncertainty it helps reduce. This survey presents the first systematic review of foundation-model priors for HOI. We organize the literature into six HOI tasks spanning reconstruction and generation. More importantly, we establish a taxonomy of eight foundation-model sub-priors grouped into geometric, semantic, and visual families. Geometric priors encompass shape retrieval, shape reconstruction, and spatial reconstruction; semantic priors include semantic grounding and language reasoning; and visual priors cover visual representation, image generation, and video generation. Based on this taxonomy, we systematically analyze how different priors are represented, injected, and adapted across HOI pipelines and tasks. Beyond how foundation models empower HOI, we further examine how HOI-derived knowledge is used in robot learning, including human-data pretraining, human-to-robot skill transfer, and HOI-to-robot data generation. Finally, we summarize datasets and evaluation protocols, and discuss limitations and future directions toward more generalizable HOI systems. To support long-term progress, we curate a live repository that continuously aggregates emerging methods and benchmarks.

[82] ViewMind3D: Modular View-Aware Inference for Training-Free 3D-QA cs.CVPDF

Ping-Kun Chiang, Kun-Ru Wu, Po-han Li, Sandeep Chinchali, Ufuk Topcu

TL;DR: 本文提出了ViewMind3D，一个无需训练、模块化的框架，用于解决基于多视角场景观测的3D问答任务。该框架将任务分解为四个可解释的组件：问题驱动的多视角选择、语言引导的视觉定位、通过鸟瞰图指示器进行空间上下文编码，以及基于角色的结构化答案生成，从而在不进行模型微调的情况下实现稳健且可解释的3D空间推理。

Details

Motivation: 现有3D-QA方法大多依赖特定3D数据的训练或昂贵的标注微调，限制了其可扩展性和实际应用。本文旨在开发一个完全无需训练、模块化的框架，仅利用通用大语言模型和视觉语言模型，实现对真实世界环境的3D空间推理。

Result: 在ScanQA和SQA3D基准测试上，ViewMind3D取得了与现有无需训练及微调后的3D-LLMs相当的性能。具体而言，在SQA3D的“What”类空间基础问题上表现提升，整体准确率达到50.8%，并在ScanQA上获得73.4的CIDEr分数。

Insight: 核心创新点在于将复杂的3D-QA任务分解为可解释的模块化流程，通过协调通用LLMs和VLMs（无需特定3D训练）实现有效推理。这为机器人感知提供了一种结构清晰、可扩展且无需昂贵标注的解决方案，强调了模块化设计和任务分解在3D空间理解中的潜力。

Abstract: Recent advances in large language models (LLMs) and vision-language models (VLMs) have enabled new possibilities for 3D question answering (3D-QA), a key capability for embodied AI and robotic perception. However, most existing methods rely on 3D-specific training or fine-tuning with costly annotations, limiting their scalability and real-world applicability. We present \textbf{ViewMind3D}, a fully training-free and modular framework for 3D spatial reasoning over multi-view observations of a scene without requiring complete 3D reconstruction. The framework decomposes the 3D-QA task into four interpretable components: (1) question-driven multi-view selection, (2) guided visual grounding with language-conditioned object cues, (3) spatial context encoding via a bird’s-eye-view (BEV) viewpoint indicator, and (4) structured answer generation through role-based reasoning. This design enables structured, robust, and interpretable reasoning without requiring model tuning. Experimental results on ScanQA and SQA3D show that ViewMind3D achieves competitive performance compared to prior training-free and fine-tuned 3D-LLMs. In particular, our method improves performance on spatially grounded question types, such as ``What’’ questions in SQA3D, while maintaining strong overall accuracy (50.8%) and achieving 73.4 CIDEr on ScanQA. These results demonstrate that effective 3D reasoning can be achieved through modular orchestration of general-purpose LLMs and VLMs for robotic perception in real-world environments.

[83] VisualRouter: Query-Grounded Visual Sampling for Long Video Understanding cs.CVPDF

Haiyue Zhang, Yi Bin, Xun Jiang, Zeyu Ma, Duo Peng

TL;DR: 本文提出了VisualRouter，一个无需训练、即插即用的查询驱动视觉采样框架，用于解决大视觉语言模型在长视频理解中因视觉令牌过多和上下文窗口有限而面临的挑战。该框架根据查询类型（全局或局部）自适应地应用不同的采样策略，以在有限的输入帧数下平衡相关性、覆盖率和多样性。

Details

Motivation: 现有长视频理解方法在视觉采样上存在不足：基于相关性的采样会导致冗余帧选择和时间覆盖不足，而固定采样策略则无法适应不同的查询类型。本文旨在通过查询驱动的自适应采样来解决这些问题。

Result: 实验表明，在Video-MME、LongVideoBench和MLVU基准测试上，VisualRouter相比均匀采样，使用Qwen2.5-VL-7B模型分别取得了5.2%、7.7%和11.6%的性能提升，并且在相同设置下优于其他无需训练的视觉采样方法。

Insight: 主要创新点在于根据查询类型（全局/局部）自适应地应用混合采样策略：对全局查询采用兼顾相关性与时间覆盖的混合策略；对局部查询采用事件感知的帧选择策略，通过事件划分、段级帧分配和事件内帧选择来平衡相关性、覆盖率和多样性。这是一种无需训练、即插即用的模块化设计。

Abstract: Large vision-language models (LVLMs) have achieved significant progress in video understanding, yet understanding long videos remains challenging due to the large number of visual tokens and limited context windows. Visual sampling provides a practical solution by selecting an informative subset of frames. However, existing methods typically either rely on relevance-aware sampling, leading to redundant frame selection and insufficient temporal coverage, or adopt a fixed sampling strategy regardless of query type. In this paper, we propose VisualRouter, a training-free and plug-and-play framework for query-grounded visual sampling. VisualRouter first classifies each query as either global or local and then applies the corresponding sampling strategy. For global queries, it employs a relevance-coverage hybrid strategy that preserves temporal coverage while retaining query-relevant visual evidence. For local queries, it adopts an event-aware frame selection strategy that performs event partitioning, segment-level frame allocation, and intra-event frame selection, jointly balancing relevance, coverage, and diversity with a limited number of input frames. Experiments show that VisualRouter consistently improves multiple LVLMs over uniform sampling, achieving gains of 5.2%, 7.7%, and 11.6% on Video-MME, LongVideoBench, and MLVU with Qwen2.5-VL-7B, and outperforming existing training-free visual sampling methods under the same setting.

[84] Large scale cross-regional remote sensing flood monitoring framework for operative mapping and impact analysis cs.CVPDF

Ilya Novikov, Svetlana Illarionova, Ruslan Dzharkinov, Maria Smirnova, Ayrat Abdullin

TL;DR: 本研究提出了一种用于俄罗斯联邦领土可持续洪水监测和损害评估的端到端多模态框架，该框架基于合成孔径雷达数据、多光谱影像和数字高程模型及其衍生物，形成21通道输入。通过自收集的覆盖七个俄罗斯地区的多模态数据集，比较了在有限数据条件下进行水面检测的两种策略：监督式U-Net++模型和自监督AnySat架构（经过预训练并针对分割任务进行微调）。在本文的数据条件下，监督学习被证明更有效，而基于AnySat的方法提供了更高的稳定性，并在预期有较大无标签数据或推理时缺失模态的场景中保留了优势。最佳洪水区域预测结果被用于评估城市地区的洪水影响，包括受影响面积、物质损失、人员伤亡以及生态和农业影响。这些评估遵循俄罗斯紧急情况部的官方方法进行。应用于2019年图伦洪水时，除物质损失因使用开源数据库而存在差异外，获得的结果与官方评估高度吻合。结果表明，深度学习和多模态卫星数据集成在多样环境和数据有限条件下具有可扩展、可靠的洪水监测潜力。

Details

Motivation: 有效的洪水监测对于最小化洪水灾害对人口和基础设施的影响至关重要。然而，在广泛且环境多样的地区进行可靠的遥感监测仍然具有挑战性，因为大多数分割算法缺乏大规模应用所需的泛化能力，同时标注的洪水数据稀缺且分布不均。

Result: 在本文的数据条件下，监督学习（U-Net++）被证明更有效，而基于自监督AnySat的方法提供了更高的稳定性。应用于2019年图伦洪水时，除物质损失因使用开源数据库而存在差异外，获得的结果与官方评估高度吻合。

Insight: 创新点在于提出了一个端到端的多模态框架，整合了SAR、多光谱影像和DEM等21通道输入，用于大规模跨区域洪水监测和影响分析。研究还比较了监督与自监督策略在数据有限条件下的性能，为不同数据场景提供了实用见解，并展示了与官方方法结合进行影响评估的可行性。

Abstract: Effective flood monitoring is critical for minimizing the impacts of flood disasters on populations and infrastructure. Yet reliable remote sensing across extensive and environmentally diverse regions remains challenging, as most segmentation algorithms lack the generalisation capacity required for large-scale application, while annotated flood data are scarce and unevenly distributed. This study presents an end-to-end multimodal framework for Russian Federation territories sustainable flood monitoring and damage assessment based on synthetic aperture radar data, multispectral imagery, and digital elevation models with their derivatives, forming a 21-channel input. Using a self-collected multimodal dataset covering seven Russian regions, two strategies for water surface detection under limited data conditions were compared: a supervised U-Net++ model and the self-supervised AnySat architecture pre-trained and fine-tuned for the segmentation task. Under the data conditions of this study, supervised learning proved more effective, while the AnySat-based approach offered greater stability and retains advantages for settings where larger unlabelled data or missing modalities at inference are expected. The best flood area predictions were used to estimate flood impact in urban areas in terms of the area affected, material damage, casualties, and ecological and agricultural impact. The estimations were conducted following the official methodology of the Russian Ministry of Emergency Situations. Applied to the 2019 Tulun flood, the obtained results closely matched official assessments, except for material damage, due to the open-source databases usage. The results demonstrate the potential of deep learning and multimodal satellite data integration for scalable, reliable flood monitoring across diverse environmental and data-limited conditions.

[85] AuricularWorld: Hierarchical Action-Guided World Modeling for Fine-Grained Auricular Structure Segmentation from CT Scans cs.CVPDF

Jingwen Yang, Senmao Wang, Luoyao Kang, Runmeng Cui, Keying Zhang

TL;DR: 本文提出了一种基于世界模型的耳部结构精细分割框架AuricularWorld，用于解决CT影像中耳部结构分割的挑战。该框架在编码器-解码器架构中引入了确定性循环状态空间模型，通过分层解剖动作迭代更新潜在状态，逐步优化分割结果。

Details

Motivation: 解决CT影像中耳部结构（如软骨）因区域小、边界不规则、与周围组织界面模糊以及标注存在嵌套和重叠而导致的精细分割难题。

Result: 在CT耳部结构分割任务上，所提框架显著提升了分割精度，并将HD95误差降低了43%以上，表明其在处理小、不规则和重叠结构方面的有效性。

Insight: 创新点在于将世界模型（确定性循环状态空间模型）引入医学图像分割，通过分层解剖动作进行迭代推理，并设计了平衡的分层动作目标函数以应对前景稀疏、解剖组缺失及操作不平衡等问题，实现了超越传统前馈预测的解剖推理能力。

Abstract: Fine-grained segmentation of auricular structures in CT is challenging because the ear occupies a small image region, cartilage boundaries are highly irregular, and interfaces between cartilage and surrounding soft tissues are often ambiguous. Clinical annotations may also include both composite structures containing cartilage and adjacent skin and their corresponding cartilage-only regions, producing nested and overlapping labels. We propose a world-model-based segmentation framework that enables iterative anatomical reasoning beyond conventional feed-forward prediction. Built on an encoder-decoder architecture, the framework introduces a deterministic recurrent state-space model into the intermediate latent space. Multi-scale encoder features and partially decoded representations are fused to form a structural observation that initializes the latent dynamics. During inference, the model performs a three-step latent rollout without ground-truth guidance. Hierarchical anatomical actions update the recurrent state and progressively refine the latent representation. The resulting latent trajectory is projected back into the decoder and combined with high-resolution features to produce the final segmentation. To learn reliable latent transitions, we introduce a balanced hierarchical action objective that addresses foreground sparsity, missing anatomical groups, and imbalance between add and remove operations. Extensive experiments show that the proposed framework consistently improves segmentation accuracy and reduces HD95 by more than 43% for small, irregular, and overlapping auricular structures in CT. These results demonstrate the effectiveness of latent world-model reasoning for challenging medical image segmentation.

[86] Can Vision-Language Models Reason about AI Edits in Images? cs.CVPDF

Darsha Udayanga, Pin-Yu Chen, Payel Das, Qiang Ji

TL;DR: 本文研究如何利用强化学习训练视觉语言模型（VLM）来推理AI编辑过的图像，以检测和定位图像篡改。作者提出了一种基于群组相对策略优化（GRPO）的训练框架，使模型在给出最终答案前生成推理轨迹，并结合轻量级分割模型实现像素级定位。实验表明，该方法在多个图像篡改数据集上取得了与最先进方法相当的检测和定位性能，且所需监督更弱。

Details

Motivation: 传统二进制分类器检测图像篡改缺乏可解释性和泛化性，而现有VLM方法通常依赖监督微调而非利用其固有推理能力。本文旨在探索是否可以通过强化学习而非显式推理监督来训练VLM对AI生成的图像编辑进行推理。

Result: 在多个图像篡改数据集上的实验表明，该方法在检测和定位性能上达到了与最先进的图像伪造检测器相当的水平，同时引入了有效交并比（eff-IoU）作为联合评估检测和定位的统一指标。

Insight: 创新点在于使用强化学习（特别是GRPO）激励VLM生成推理轨迹，从而无需显式推理监督即可提升模型的可解释性和泛化能力；同时，结合轻量级分割模型实现像素级定位，并提出了统一的评估指标eff-IoU，为弱监督下的图像篡改检测提供了可扩展的解决方案。

Abstract: Detection and localization of AI-tampered images are critical for trustworthy AI, yet modern generative models have made such manipulations increasingly difficult to identify. While traditional binary classifiers can detect image tampering, they lack interpretability and generalization. Vision-Language Models (VLMs) offer a promising alternative due to their strong visual understanding and reasoning capabilities; however, existing approaches typically rely on supervised finetuning with curated explanations rather than exploiting their inherent reasoning capabilities. In this work, we investigate whether VLMs can be trained to reason about AI-generated image edits using reinforcement learning (RL) rather than explicit reasoning supervision. Motivated by the success in Group Relative Policy Optimization (GRPO), an RL technique that incentivizes the model to reason by generating thinking traces prior to giving the final answer, we propose a GRPO-based training framework that utilizes simple accuracy and format rewards. Given an input image, the model produces a structured reasoning trace and predicts whether the image has been tampered with. A lightweight segmentation model is then guided by the reasoning output to generate pixel-level localization masks. Experiments across multiple image manipulation datasets demonstrate that our approach achieves competitive detection and localization performance compared to state-of-the-art image forgery detectors, despite requiring substantially weaker supervision. We introduce effective intersection over union (eff-IoU), a unified metric to jointly evaluate detection and localization. These results suggest that reinforcement learning provides an effective and scalable mechanism for teaching VLMs to reason about AI-generated content.

[87] VAD: Attributing Visual Evidence for Target Reconstruction in Multimodal On-Policy Distillation cs.CV | cs.CLPDF

Kangning Zhang, Yixing Li, Shuai Shao, Qingyao Li, Zhengxi Lu

TL;DR: 本文提出视觉归因蒸馏（VAD），一种用于多模态策略蒸馏的反事实目标重建算法，旨在从特权视角教师的混合监督信号中分离出视觉证据支持的部分，以更精确地传递细粒度视觉知识。

Details

Motivation: 解决多模态策略蒸馏中教师提供的下一词元校正信号混合了视觉证据、语言先验和教师特定效应的问题，核心挑战在于估计哪些校正真正由视觉证据支持。

Result: 在4B和9B规模的六个细粒度视觉基准测试中，VAD超越了直接特权视角蒸馏和视觉优势加权方法；词元级和受控目标分析表明，其代理对齐组件富含任务相关的视觉校正并能产生更强的目标偏移，尤其在证据反驳错误答案时。

Insight: 创新点在于通过反事实推理（评估证据存在与移除时教师输出的变化）构建视觉证据方向的代理，并将原始校正投影到该代理上以重建学生锚定的目标，从而提供更纯净的视觉监督信号，替代了源混合监督。

Abstract: Multimodal on-policy distillation (OPD) transfers fine-grained visual knowledge by supervising student-generated trajectories with a privileged-view teacher. Yet its next-token corrections are source-mixed, combining visual signals with linguistic priors and teacher-specific effects. The key challenge is to estimate which corrections are supported by visual evidence, not merely where or how strongly to distill. We introduce Visual Attribution Distillation (VAD), a counterfactual target-reconstruction algorithm that estimates the visually attributable part of a teacher correction. At each student-generated prefix, VAD evaluates the same fixed teacher with the relevant evidence present and removed. The corresponding change in centered log-probabilities defines ut, a signed proxy for the visual evidence direction that estimates how revealing the evidence supports or refutes candidate tokens. VAD projects the original correction onto this proxy to obtain an intervention-aligned component and a proxy-unexplained residual, then reconstructs a student-anchored target from the former. During training, this reconstructed target supplies the primary supervision signal, while the privileged teacher contributes a weak regularizer. Across six fine-grained visual benchmarks at 4B and 9B scales, VAD outperforms direct privileged-view distillation and visual-advantage weighting. Token- level and controlled-target analyses show that the proxy-aligned component is enriched in task-relevant visual corrections and yields stronger target shifts, especially when evidence refutes a mistaken answer. These results support counterfactual target reconstruction as an effective alternative to source-mixed supervision.

[88] Beyond Frame Selection: Generative Latent Evidence Aggregation for Long-Video Understanding cs.CVPDF

Bowen Liu, Shuning Wang, Xinpeng Ding, Zhiheng Wu, Bodong Du

TL;DR: 本文提出了一种名为GenEvA的生成式潜在证据聚合框架，用于长视频理解任务。该方法在帧选择后引入一个潜在证据接口，通过查询条件化的证据分布来聚合跨帧信息，形成紧凑的潜在证据，从而提升视频问答性能。

Details

Motivation: 现有长视频理解方法通常将视频压缩为少量帧或视觉标记，但仅保留相关视觉内容作为显式证据并不能确保跨时刻的互补线索被有效整合用于答案生成。

Result: 在四个基准测试和两种Video-MLLM骨干网络上，GenEvA持续优于匹配帧基线方法。例如，在8帧设置下，LLaVA-Video在四个基准上的平均性能提升+5.2分，Qwen2.5-VL在LVBench上的准确率提升+10.1分，且仅增加0.11%–0.40%的平均视频标记开销。

Insight: 创新点在于将帧选择后的阶段形式化为潜在证据接口，并通过查询条件化的证据分布实现跨帧信息聚合；客观分析表明，该方法实现了任务感知的资源分配，并受益于自适应证据调用机制。

Abstract: Long-video understanding commonly compresses videos into a small set of frames or visual tokens for answer generation. Existing compact pipelines focus on retaining relevant visual content as explicit evidence. Yet making evidence available does not ensure that complementary cues across moments are integrated for answering. Our key idea is to organize selected frames into query-relevant cross-frame evidence before generation. We formulate this post-selection stage as a latent evidence interface and instantiate it with GenEvA ($\textbf{Gen}erative$ $Latent$ $\textbf{Ev}idence$ $\textbf{A}ggregation$), a distribution-guided latent evidence aggregation framework. Specifically, GenEvA uses a query-conditioned evidence distribution to focus aggregation on relevant frames, forming compact cross-frame latent evidence from their frame-specific information. Since cross-frame integration is not always needed, the same distribution determines whether to insert this latent complement. Across four benchmarks and two Video-MLLM backbones, GenEvA consistently improves matched-frame baselines. At 8 frames, it raises the four-benchmark LLaVA-Video average by $+5.2$ points and Qwen2.5-VL accuracy on LVBench by $+10.1$ points. These gains require only $0.11%$–$0.40%$ average video-token overhead; analyses further show task-aware allocation and benefits from Adaptive Evidence Invocation.

[89] RefCaptioner: Multi-Reference Image-Grounded Video Captioning cs.CVPDF

Tengfei Liu, Yang Shi, Yuran Wang, Xiaohan Zhang, Yuqing Wen

TL;DR: 本文提出了多参考图像锚定视频描述（multi-reference image-grounded video captioning）新任务，并介绍了RefCaptioner两阶段后训练框架。该框架通过混合数据监督微调（SFT）和分层覆盖折扣GRPO，联合优化参考选择、短语级绑定、干扰项拒绝和跨参考一致性，同时保持通用视频描述能力。作者构建了包含2万个视频和17万余参考图像的数据集，并提出了MRVBench评估基准。实验表明，RefCaptioner在开源模型中取得最佳综合性能，且在标准视频描述基准上保持竞争力。

Details

Motivation: 现有视频描述模型无法将局部视觉元素显式地锚定到多个参考图像上，因此本文旨在解决生成具有短语级参考锚定的事实性视频描述这一新问题。

Result: 在提出的MRVBench基准（涵盖真实世界和AI生成视频）上，RefCaptioner在描述事实性和多参考锚定方面，取得了开源模型中的最佳综合性能，同时在标准视频描述基准上保持竞争力。人工评估也表明其描述更受青睐，并能实现更忠实于源内容的视频重建。

Insight: 创新点在于定义了多参考图像锚定视频描述这一新任务，并提出了结合混合数据SFT与分层覆盖折扣GRPO的两阶段后训练框架，以联合优化多个子目标。从客观角度看，构建的大规模数据集和MRVBench基准也为该方向的研究提供了重要资源。

Abstract: Existing video captioning models generate natural descriptions of video content but cannot explicitly ground local visual elements to multiple reference images. We introduce multi-reference image-grounded video captioning, a new task requiring factual video descriptions with phrase-level reference grounding, and propose RefCaptioner, a two-stage post-training framework for this task. RefCaptioner combines mixed-data SFT with Hierarchical Coverage-Discounted GRPO to jointly improve reference selection, phrase-level binding, distractor rejection, and cross-reference consistency while preserving general video-captioning ability. To support training, we construct a corpus containing $20,000$ videos and 171,354 reference images. We further introduce MRVBench, a benchmark for evaluating caption factuality and multi-reference grounding on both real-world and AI-generated videos. Experiments show that RefCaptioner achieves the best overall performance among the open-source models while remaining competitive on standard video captioning benchmarks. Human evaluation further confirms that its captions are preferred by annotators and enable more source-faithful video reconstruction with both open-source and proprietary video generators.

[90] MarkushGlyph and OCSRGlyph: Improved Chemical Structure Recognition cs.CVPDF

Alex Andonian, Samuel G Rodriques, Andrew D White, Siddharth M Narayanan

TL;DR: 本文提出OCSRGlyph和MarkushGlyph两个模型，分别用于单分子图像识别（OCSR）和Markush结构图像识别，将化学结构图像转换为线型表示。OCSRGlyph通过仔细考虑立体化学提升了性能，而MarkushGlyph作为一个视觉语言模型，以端到端方式处理整个Markush结构图像，避免了传统多阶段方法的复杂性。

Details

Motivation: 化学结构在专利和文献中以图像形式出现，需要转换为线型表示以便程序化使用（如数据库索引或机器学习训练集构建）。单分子识别（OCSR）已有成熟方法，但Markush结构（代表分子家族）的解析仍具挑战性。

Result: OCSRGlyph在单分子识别任务上达到了最先进（SOTA）水平，通过改进立体化学处理提升了性能。MarkushGlyph在Markush结构解析任务上表现出色，并引入了一种新的评估指标，以处理先前指标中的失败模式。

Insight: 创新点包括：将两种化学结构识别任务统一为图像到文本的翻译问题；提出端到端的视觉语言模型MarkushGlyph，简化了传统多阶段流程；在OCSR中强调立体化学的精细处理；为Markush任务设计了更鲁棒的评估指标。

Abstract: Chemical structures appear in patents and the scientific literature as images. For programmatic usage, such as indexing in databases or constructing machine learning model training sets, they must be transformed into line notations. The two common forms of this task are translating an image of a single molecule (optical chemical structure recognition - OCSR) and translating a Markush structure that represents a family of molecules. While prior work in the former case is quite mature, Markush structure parsing remains a challenging task. In this work, we treat both tasks as an image-to-text translation problem. We then propose OCSRGlyph, a state-of-the-art OCSR model, improving performance over prior methods by carefully considering stereochemistry. For the Markush task, we introduce MarkushGlyph, a vision-language model that reads the entire Markush structure as an image. This contrasts with prior systems, which often use multiple stages to separately process visual and text input content. Finally, we introduce a new metric for determining the accuracy of Markush structure translations, handling failure modes present in prior metrics.

[91] ScaFE: Data-Efficient Scar Classification with LLM-Generated Clinical Feature Programs cs.CV | cs.LGPDF

Ruman Wang, Hangting Ye

TL;DR: 本文提出ScaFE方法，利用大型语言模型生成可执行的临床特征程序来辅助病理性疤痕分类。该方法将LLM的临床知识转化为确定性特征程序，在本地执行并提取结构化特征，然后使用轻量级随机森林进行分类，实现了数据高效且可审计的跨医院医疗图像分析。

Details

Motivation: 解决病理性疤痕分类中专家标注数据有限、医院间采集差异大、端到端模型依赖数据且传统视觉语言模型存在数据治理冲突及决策不可审计的问题。

Result: 在三个医院的600张照片上进行留一站点评估，ScaFE达到81.0%的站点宏观平衡准确率，比最强基线BiomedCLIP高出10.0个百分点；仅使用10%开发数据时仍保持72.0%准确率及11.8分优势。

Insight: 创新点在于将LLM知识转化为可本地执行的确定性特征程序而非直接诊断，实现了知识迁移与数据隐私保护的平衡；通过迭代修复将可执行程序率从66.7%提升至95.0%，且91.7%最终特征具有可验证证据。

Abstract: Classifying pathological scars from clinical photographs requires distinguishing keloids from hypertrophic scars despite limited expert-labeled data and substantial acquisition variation across hospitals. End-to-end image models remain data-dependent, whereas sending photographs to a hosted vision-language model (VLM) may conflict with local data-governance requirements and yields decisions that are difficult to reproduce and audit. We introduce ScaFE (Scar Feature Engineering), which transfers clinical knowledge from a large language model (LLM) into deterministic, executable feature programs instead of asking the model to diagnose images. A web-enabled LLM retrieves clinical evidence and synthesizes programs that measure visually assessable scar attributes. Candidate programs execute in a restricted local environment, and only aggregate validation statistics and feature-level SHAP summaries are returned for iterative repair and refinement; raw images and patient-level outputs remain local. A lightweight Random Forest then operates on the resulting structured representation. On 600 photographs from three hospitals under leave-one-site-out evaluation, ScaFE achieves 81.0% site-macro balanced accuracy, exceeding the strongest baseline, BiomedCLIP, by 10.0 percentage points. With only 10% of the development data, ScaFE retains 72.0% balanced accuracy and an 11.8-point lead. Iterative refinement also raises the executable-program rate from 66.7% to 95.0%, with verified evidence for 91.7% of the final features. These results show that LLM knowledge can support data-efficient, cross-site medical image classification through local and auditable feature programs rather than direct VLM decisions.

[92] Finding Change in Satellite Archives from Text: How to Combine Before-and-After Images Efficiently cs.CV | cs.IRPDF

Simon Roy, Mark Bong, Giovanni Beltrame

TL;DR: 该论文系统比较了卫星影像变化检测中融合模块的设计方案，旨在高效匹配自然语言描述与前后时相图像对。研究评估了注意力机制、状态空间模型（Mamba）和学习压缩（TBF）三类共八种设计，发现两阶段搜索策略能显著降低成本，Mamba在视觉任务中未显现速度优势，而压缩方法虽能提升效率但可能丢失细节。

Details

Motivation: 解决在卫星影像存档中根据自然语言描述高效检索变化图像对的问题，关键在于设计快速且准确的融合模块以降低查询成本。

Result: 在LEVIR-CC和Dubai-CC基准测试中，两阶段搜索策略在LEVIR-CC上达到或超过全融合模型的召回率，同时将查询成本降低10-15倍；Mamba模型未带来预期速度提升；TBF压缩方法将参数减少2.3倍、延迟降低1.6倍，仅带来微小性能损失。

Insight: 创新点包括提出可控的融合模块比较框架、验证两阶段检索的实用性，并揭示Mamba在视觉Transformer典型序列长度下的硬件限制；客观分析表明，学习压缩与检索策略的协同优化是提升效率的关键方向。

Abstract: Operational Earth observation increasingly calls for answering queries such as find the image pairs where a new building appeared.'' This means searching an archive of before-and-after (bi-temporal) satellite image pairs and ranking each pair by how well it matches a natural-language description of the change. The component that performs this match, the fusion module that combines the before’’ and ``after’’ views, must be run at query time across many candidate pairs, so its speed largely sets the cost of every search. We present a controlled comparison of how to build that module. Using one fixed image encoder (a frozen CLIP model) and one training recipe for all variants, we evaluate eight designs drawn from three families: attention, state-space models (Mamba), and learned compression (our Temporal Bottleneck Fusion, TBF). Each design is tested on two benchmarks (LEVIR-CC and Dubai-CC) with ten random seeds, so the reported differences are statistically grounded. We outline three findings: first, a training-free two-stage search (a cheap difference model that shortlists candidates, followed by attention fusion that re-ranks them) matches or exceeds full-fusion recall on LEVIR-CC while cutting query cost $10$-$15\times$, with comparable R@1/R@5 on Dubai-CC; second, the linear-time scan of Mamba, attractive on paper, gives no speed benefit at the patch counts typical of vision transformers ($L{=}196$): the scan is limited by memory bandwidth, whereas attention maps cleanly onto parallel hardware; and third, compressing the fused representation (TBF) reduces parameters by $2.3\times$ and latency by $1.6\times$ for a change-only BLEU-1 cost of $0.007$, although more aggressive compression quietly discards change-relevant detail that aggregate metrics fail to reveal.

[93] MixFrag: Fragility-Guided Mixed-Precision Post-Training Quantization for Vision Transformers cs.CV | cs.LGPDF

Md. Mehrab Hossain Opi, Robiul Islam Ryad, Md. Umar Faruk

TL;DR: 本文提出了MixFrag，一个用于视觉Transformer（ViT）的、基于脆弱性指导的混合精度训练后量化框架。该方法首先通过KL散度估计各组件对量化的敏感度（脆弱性），然后将其建模为多选择背包问题，在目标比特预算下自适应分配层间精度。实验表明，MixFrag在图像分类、目标检测和实例分割任务上均取得了优异性能。

Details

Motivation: 现有训练后量化方法通常对Transformer各组件采用统一的比特宽度，忽略了它们对量化具有不同的敏感度，导致精度分配效率低下。

Result: 在ImageNet-1K分类任务上，MixFrag在多种ViT架构上取得了有竞争力的性能。在COCO目标检测和实例分割任务上，MixFrag在混合精度PTQ方法中达到了SOTA水平，在具有挑战性的MP3/MP3设置下，比之前的最佳方法提升了高达9.6 AP。

Insight: 创新点在于提出了一种基于KL散度的组件级量化脆弱性度量，并将比特分配问题形式化为多选择背包问题，实现了在总比特预算约束下的自适应、层级的混合精度分配。脆弱性度量与最终分配的比特数高度相关，验证了其有效性。

Abstract: Post-training quantization (PTQ) has emerged as an effective solution for deploying Vision Transformers (ViTs) on resource-constrained devices. However, existing PTQ methods typically employ uniform bit-widths across transformer components, overlooking their heterogeneous sensitivity to quantization and leading to inefficient precision allocation. In this paper, we propose {MixFrag, a fragility-guided mixed-precision PTQ framework for Vision Transformers. MixFrag first estimates component-level quantization fragility by measuring the Kullback–Leibler (KL) divergence between full-precision and isolated quantized output distributions using a small calibration set. It then formulates bit allocation as a Multiple-Choice Knapsack Problem (MCKP), enabling adaptive layer-wise precision assignment under a target bit budget. Extensive experiments on ImageNet-1K across multiple Vision Transformer architectures demonstrate that MixFrag achieves competitive classification performance under practical mixed-precision settings. Furthermore, evaluations on COCO object detection and instance segmentation show that MixFrag achieves state-of-the-art performance among existing mixed-precision PTQ methods, improving the previous best method by up to 9.6 AP under the challenging MP3/MP3 setting. Additional analyses validate the proposed fragility metric and demonstrate its strong correlation with the learned bit allocation. These results establish MixFrag as an effective framework for mixed-precision post-training quantization of Vision Transformers.

[94] MIND: Multimodal Intent-Driven Network via Diffusion Transformers for Medical Image Fusion cs.CVPDF

Yunzhan Fu, Xiangyu Shen, Yifei Sun, Yuhan Chen, Jian Wu

TL;DR: 本文提出MIND，一种基于扩散变换器的多模态意图驱动网络，用于医学图像融合。该方法利用BioMedGPT从源图像生成意图驱动的融合文本，指导融合过程，并通过多尺度潜在适配器和医学语义一致性损失解决扩散变换器中的空间连续性丢失和语义偏移问题。

Details

Motivation: 现有医学图像融合方法通常采用全局统一的融合规则，缺乏对诊断意图和病理结构的深入理解，因此需要一种能够结合诊断意图的智能融合方法。

Result: 在Harvard、BraTS和GFP数据集上的综合实验表明，MIND提供了卓越的融合质量，显著提高了下游脑肿瘤分割的准确性，并实现了灵活的交互式融合。

Insight: 创新点包括利用BioMedGPT生成意图驱动的融合文本来指导融合过程，设计多尺度潜在适配器以补充图像特征，以及引入医学语义一致性损失来确保融合图像与文本的语义对齐和物理流形稳定性。

Abstract: Medical image fusion aims to integrate complementary information from diverse imaging modalities to support clinical diagnosis. Existing methods typically apply uniform fusion rules globally, lacking a deep understanding of diagnostic intents and pathological structures. To address these limitations, we propose MIND, a Multimodal Intent-Driven Network via Diffusion Transformers (DiTs) for medical image fusion. Specifically, we utilize BioMedGPT to generate intent-driven fusion texts from source images, guiding the fusion process with pathology-aware diagnostic intents. To combat the loss of 2D spatial continuity caused by 1D sequence flattening in DiTs, we design a Multi-scale Latent Adapter. This module explicitly extracts source image features before serialization, injecting them into the network via strict dimensional alignment to effectively supplement image features. To resolve the semantic shift caused by decoupling image outputs from diagnostic intents, we design a medical semantic consistency loss. This loss ensures deep semantic locking between fused images and fusion texts while maintaining the stability of the underlying physical manifold reconstruction. Comprehensive experiments on the Harvard, BraTS, and GFP datasets reveal that MIND delivers superior fusion quality, significantly improves downstream brain tumor segmentation accuracy, and enables flexible interactive fusion, holding significant promise for intent-driven intelligent clinical decision support systems.

[95] ROAD: Reciprocal-Objective Alignment of Discriminative Semantics for 3D Shape Generation cs.CVPDF

Xiao Luo, Mingyang Du, Xin Zhou, Tianrui Feng, Xiwu Chen

TL;DR: 论文提出ROAD框架，通过将判别式3D基础模型中的丰富语义和结构先验知识迁移到扩散Transformer中，显著降低了高保真3D生成的训练成本。该方法引入了一种互惠目标对齐策略，包括全局语义凝聚和结构最优对齐，以解决生成与判别潜在空间之间的异质性问题。

Details

Motivation: 当前高保真3D生成主要依赖扩大模型容量和数据规模，计算成本高昂，且忽略了现有判别式3D基础模型中已封装的丰富语义和结构先验知识。论文旨在利用这些判别模型的先验知识来降低生成模型的训练成本。

Result: 与工业基线Step1X-3D相比，ROAD仅使用其1.5%的训练数据就实现了极具竞争力的生成性能，并显著降低了训练成本，有效减少了高保真3D生成的计算开销。

Insight: 创新点在于提出了一种互惠目标对齐策略，通过全局语义凝聚和结构最优对齐（建模为二分图匹配问题）来桥接生成与判别潜在空间之间的语义-结构异质性，从而高效迁移判别先验知识，且推理时无需额外成本。

Abstract: High-fidelity 3D generation predominantly relies on scaling model capacity and data, which incurs prohibitive computational costs. This paradigm typically requires learning geometry from scratch and overlooks the rich semantic and structural priors already encapsulated in discriminative 3D foundation models. We contend that leveraging the profound understanding of the 3D world possessed by these discriminative models can significantly reduce generative cost. To this end, we propose ROAD, a framework that reduces the training cost of 3D generation by transferring these rich discriminative priors into diffusion transformers. To address the inherent semantic-structural heterogeneity between generative and discriminative latents, we introduce a reciprocal-objective alignment strategy. This method synergizes Holistic Semantic Condensing to enforce global semantic coherence and Structural Optimal Alignment, which is formulated as a bipartite matching problem to rigorously align microscopic geometric details between disparate latent spaces. The 3D foundation model is only used for training-time supervision of alignment and is not used at inference, incurring no additional inference cost. Compared with the industrial baseline Step1X-3D, the proposed ROAD achieves highly competitive generation performance with only 1.5% of the training data and significantly reduces training costs, effectively reducing the computational overhead of high-fidelity 3D generation. Code is available at https://github.com/H-EmbodVis/ROAD.

[96] Beacon: Knowing When and How to Perform Agentic Visual Reasoning cs.CVPDF

Qixun Wang, Yang Shi, Letian Cheng, Zhuoran Zhang, Yan He

TL;DR: 本文提出了Beacon模型，旨在通过改进多模态大语言模型（MLLMs）在代理视觉推理任务中的工具使用策略，以提升其在复杂任务上的成功率。核心在于从模式自适应性（MA）和工具效应（TE）两个维度重新思考工具使用，并通过强化学习阶段的机制设计来优化模型在必要时调用工具的能力，从而在多种基准测试中实现更强的整体性能。

Details

Motivation: 现有代理视觉推理模型在工具使用上存在局限性：它们往往缺乏模式自适应性（无法准确判断何时需要调用工具），且工具使用带来的收益常被其在模型本可解决的简单问题上引入的错误所抵消。本文旨在通过量化MA和TE，并设计新模型来解决这些问题，使工具使用真正提升模型在困难任务上的能力。

Result: 在多个基准测试上的广泛实验表明，Beacon模型取得了更强的整体性能，并在模式自适应性和工具效应方面均有显著提升。

Insight: 论文的创新点在于从MA和TE两个维度系统分析并量化了代理视觉推理中工具使用的有效性，并提出了Beacon模型，其核心是通过强化学习中的’必要性感知自适应奖励’和’提示引导能力扩展’机制，分别鼓励基于任务必要性的自适应工具调用，并专门针对最具挑战性的问题强化模型的工具使用能力。

Abstract: The fundamental goal of agentic visual reasoning is to improve the success rate of multimodal large language models (MLLMs) on complex tasks, rather than merely equipping them with a sophisticated yet inefficient reasoning paradigm. In this work, we rethink agentic visual reasoning through two key dimensions of tool use: Mode Adaptiveness (MA) and Tool Effect (TE). Mode Adaptiveness characterizes whether an MLLM can recognize when tools are truly necessary and invoke them accordingly, thereby avoiding unnecessary computational overhead while improving performance on challenging problems that require tool assistance. Tool Effect characterizes the actual impact of tool use: tools should extend the model’s capabilities on problems unsolvable through text-only reasoning, while avoiding additional errors on problems that the model can already solve without tools. We conduct a comprehensive analysis to quantify these two properties and empirically reveal that existing agentic visual reasoning models exhibit limited Mode Adaptiveness, while the gains produced by tool use on hard examples are largely offset by the harm introduced on easy examples that the models can already solve. Motivated by these observations, we propose Beacon, a novel agentic visual reasoning model that achieves stronger overall performance, improved Mode Adaptiveness, and genuine tool-induced performance gains. At the core of Beacon are the Necessity-Aware Adaptive Reward and the Hint-Guided Capability Expansion mechanism in the reinforcement learning stage, which respectively encourage adaptive tool invocation based on task necessity and strengthen the model’s tool-use capability on the most challenging problems. Extensive experiments across diverse benchmarks demonstrate the strong overall performance of Beacon and its substantial improvements in both Mode Adaptiveness and Tool Effect.

[97] Chimera: Designing and Chinchilla-Scaling Hybrid Visual Diffusion Transformers cs.CVPDF

Chongjian Ge, Hanwen Jiang, Tianyu Wang, Jiuxiang Gu, Yiran Xu

TL;DR: 本文提出了Chimera，一种混合视觉扩散Transformer骨干网络，旨在解决高分辨率图像、长视频和多模态生成中全注意力的二次计算成本问题。Chimera采用了一种包含Kimi Delta Attention、多头潜在注意力和模态感知短卷积的异构架构，并结合稀疏混合专家层和HeteroP缩放方案，以Chinchilla风格的计算最优法则为指导，训练了一个110亿参数（激活20亿）的模型。

Details

Motivation: 解决视觉生成任务（如图像、视频）中，处理高分辨率、长序列和多模态上下文时，传统Transformer全注意力机制带来的二次计算成本过高的问题。

Result: 实验表明：1）在预训练扩散损失上，其密集骨干网络比匹配的全注意力基线（Wan-2.1 2B）计算效率高1.7倍，完整系统达到7.3倍；2）无需针对长度微调，即可从5秒训练片段零样本外推至30秒视频，最后5秒的FID退化仅为6.5%；3）拟合的计算最优法则显示，图像预训练的计算量在激活模型大小和训练token数之间近乎均分，而视频预训练在更高预算下略微偏向模型大小。

Insight: 主要创新点包括：1）设计了一个无需位置嵌入、统一处理多模态token流的混合视觉扩散骨干；2）结合了线性复杂度的长上下文状态跟踪（KDA）、全局交互（MLA）和局部时空建模（短卷积）；3）提出了HeteroP模块化超参数缩放方案，并拟合了针对激活模型大小、训练token数和图像-视频数据比的计算最优法则，为高效长上下文扩散架构的设计与扩展提供了系统化方法。

Abstract: Visual generation increasingly requires high-resolution images, long videos, and multimodal context, making the quadratic cost of full attention prohibitive. We introduce Chimera, a hybrid visual diffusion backbone with a principled scaling recipe. Chimera processes text, image, and video tokens in one raster-ordered stream without positional embeddings. It combines Kimi Delta Attention (KDA) for long-context state tracking with O(N) complexity, interleaved Multi-head Latent Attention (MLA) for direct global interaction, and modality-aware short convolutions for local spatiotemporal context. Sparse Mixture-of-Experts (MoE) layers expand capacity while controlling activated compute. To scale this heterogeneous architecture, we introduce HeteroP, a module-wise scheme that transfers hyperparameters across width and depth according to each tensor’s functional fan-in and model depth. HeteroP yields a consistently tuned family used to fit Chinchilla-style compute-optimal laws for activated model size, training-token count, and image-video data ratio. Guided by these laws, we train an 11B-parameter Chimera with 2B activated parameters. Experiments show three results. First, measured by pretraining diffusion loss, the dense backbone is 1.7x as compute-efficient as a matched full-attention Wan-2.1 2B baseline, while the complete system reaches 7.3x. Second, without length-specific fine-tuning, Chimera extrapolates zero-shot from 5-second training clips to 30-second videos, with only 6.5% FID degradation in the last five seconds. Third, the fitted laws show that compute-optimal image pretraining divides compute nearly evenly between activated model size and training-token count, whereas video pretraining modestly favors model size at higher budgets. These results establish a foundation for designing and scaling efficient long-context diffusion architectures.

[98] ACE-Data-0: Human-Centric Ambient Capture as Embodied Data Engine cs.CVPDF

Yukang Cao, Haozhe Xie, Beichen Wen, Runmao Yao, Yinghao Liu

TL;DR: 本文介绍了ACE-Data-0数据集，它通过环境捕捉引擎（ACE）系统采集了以人为中心、多模态同步的具身智能数据。该数据集包含150小时、1700万视频帧，记录了50名参与者在两个真实家庭环境中执行200类任务的完整交互过程，覆盖了从精细手部操作到长时程全身活动的多种场景。

Details

Motivation: 解决具身智能面临的数据瓶颈问题，即现有数据集在视角、模态或空间尺度上割裂了人类执行目标时第一人称感知、全身运动、灵巧操作、物体状态、声音和触觉等多感官同步演化的完整体验。

Result: 基于ACE系统构建了ACE-Data-0数据集，并提出了一个从信号到场景组件再到交互的分层基准测试。评估表明，当前最先进的方法在接触、遮挡、自我运动和长时程等挑战下仍存在显著差距。

Insight: 创新点在于ACE系统将真实家庭环境转化为空间校准、时间同步的录制工作室，实现了跨尺度（桌面与房间）的多模态数据统一采集。数据集通过目标级而非逐步指令保留了自然行为变化，为模仿学习、世界模型和具身AI提供了具有对齐感知、运动学和接触监督的可扩展基础。

Abstract: Embodied intelligence faces a fundamental data bottleneck. Models must capture how first-person perception, whole-body motion, dexterous manipulation, object state, sound, and touch evolve together as humans pursue goals over time. Existing datasets fragment this experience across viewpoints, modalities, or spatial scales, leaving the full perception-action loop only partially observed. We introduce the Ambient Capture Engine (ACE), a human-centric data engine that transforms real home environments into spatially calibrated, temporally synchronized recording studios. ACE operates at two complementary scales: a table-scale configuration resolves hand-object manipulation, while a room-scale configuration captures whole-body motion, locomotion, and interactions across a furnished home. ACE records egocentric and multi-view exocentric video, full-body and articulated hand motion, object geometry and 6-DoF trajectories, audio, and tactile signals as a unified multisensory stream. Using ACE, we build ACE-Data-0, comprising 150 hours and 17M video frames across 200 task categories, performed by 50 participants in 2 environments, for a total of 75,000 interaction episodes. The dataset spans atomic manipulation, long-horizon chains of household activities, and human-scene interaction, while preserving natural behavioral variation through goal-level rather than step-by-step instructions. We further introduce a hierarchical benchmark that progresses from signals to scene components and then to interactions. Evaluations of state-of-the-art methods expose substantial gaps under contact, occlusion, egomotion, and long temporal horizons. ACE-Data-0 provides synchronized human demonstrations with aligned perceptual, kinematic, and contact supervision, offering a scalable foundation for imitation learning, world models, vision-language-action systems, and embodied AI.

[99] PhiZero: A World Model Built Around Physical Language cs.CVPDF

Shuyao Shang, Yuqi Wang, Ruopeng Gao, Xu Chen, Tieniu Tan

TL;DR: 本文提出了PhiZero，一种围绕物理语言构建的世界模型。物理语言是一种紧凑的离散表示，用于描述世界状态转换。该模型采用先推理后渲染的范式：首先将未来世界演化推断为物理语言序列，然后将推断的转换渲染成视频。实验验证了其在生成和理解任务上对物理一致世界演化的建模能力，并展示了其在交互式世界建模、细粒度动作条件模拟和零样本运动迁移方面的潜力。

Details

Motivation: 现有物理世界模型通常在像素空间直接预测未来视频，将底层世界动态隐含在高维视觉预测器中。受人类能够从视觉经验中抽象出预测结构并用自然语言组织以进行显式推理的启发，本文旨在通过自监督从野外视频中学习物理语言，并用其显式推理物理世界如何演化。

Result: 在多个生成和理解基准测试上的广泛实验验证了PhiZero建模物理一致世界演化的能力。

Insight: 核心创新在于引入了物理语言作为世界状态转换的紧凑离散表示，并采用了先推理后渲染的范式，将世界动态的显式推理与视频生成解耦。这为构建更具解释性和可控性的世界模型提供了新思路，并展示了在交互模拟和零样本迁移等任务上的应用潜力。

Abstract: We introduce PhiZero, a physical world model built around physical language, a compact discrete representation of world-state transitions. Existing physical world models typically predict future videos directly in pixel space, leaving the underlying world dynamics implicit within high-dimensional visual predictors. Motivated by humans’ ability to abstract predictive structure from visual experience and organize it in natural language for explicit reasoning, we learn physical language from in-the-wild videos through self-supervision and use it to explicitly reason about how the physical world evolves. Accordingly, PhiZero adopts a reason-then-render paradigm: it first infers future world evolution as a physical-language sequence and then renders the inferred transitions into videos. Extensive experiments across generation and understanding benchmarks validate the ability of PhiZero to model physically coherent world evolution. We further show its potential for realistic and interactive world modeling, fine-grained action-conditioned simulation, and zero-shot motion transfer.

[100] ReToken: One Token to Improve Vision-Language Models for Visual Retrieval cs.CV | cs.AI | cs.LGPDF

Yao Xiao, Reuben Tan, Zhen Zhu, Yuqun Wu, Jianfeng Gao

TL;DR: 本文提出了ReToken，一种可学习的嵌入向量，用于解决视觉语言模型在处理长视觉上下文时性能下降和计算资源受限的问题。ReToken通过从预填充的视觉键值缓存中选择稀疏的查询相关视觉标记，显著提升了模型在图像和视频检索任务中的表现。

Details

Motivation: 动机在于长视觉上下文导致视觉语言模型性能随干扰物增加而下降，且受GPU内存限制无法一次性处理所有标记，需要一种高效的方法来选择和利用关键视觉信息。

Result: 在Visual Haystacks基准上，ReToken将Qwen3VL-8B和InternVL3.5分别提升了13.4和12.4个点（相对提升超过20%）；在LVBench上，零样本迁移到长视频任务中，Qwen3VL-8B获得了8.0个点的增益。训练和长视频推理均可在一张H100 GPU上完成。

Insight: 创新点在于引入单个可学习嵌入作为显式检索目标，实现稀疏视觉标记选择，仅需小规模图像问答数据集训练即可跨基准泛化，其轻量级设计确保了计算效率，为长上下文视觉语言模型优化提供了新思路。

Abstract: Long visual context poses a challenge for vision-language models: performance degrades as the number of distractors grows, and processing all tokens at once is computationally infeasible under GPU memory constraints. We present ReToken, a single learnable embedding trained as an explicit retrieval target that selects a sparse set of query-relevant visual tokens from a pre-filled visual KV cache. Trained on only a small image-QA dataset, ReToken yields consistent gains across image and video benchmarks: on Visual Haystacks it improves Qwen3VL-8B by 13.4 points and InternVL3.5 by 12.4 points (>20% relative), and on LVBench it transfers zero-shot to long video for an 8.0-point gain with Qwen3VL-8B. Thanks to its lightweight design, both training and long-video inference fit on a single H100. Code is available at: https://github.com/avaxiao/ReToken

eess.IV [Back]

Yogisri Pujitha Chinthoti

TL;DR: 本文是一项关于使用纹理和梯度特征进行肺部疾病分类的试点研究，重点是在公开的胸部X射线数据上区分COVID-19与其他类型的肺炎。研究采用了HOG和GLCM特征描述符结合经典分类器，在患者级别的交叉验证下获得了75.4%的平均准确率和0.755的AUC，略高于基线。

Details

Motivation: 动机是探索自动化胸部X射线肺部疾病分类，特别是区分COVID-19与其他肺炎，以评估传统机器学习方法在有限公开数据上的有效性。

Result: 在COVID-19 Image Data Collection数据集上，使用患者级5折分层交叉验证，最佳模型达到75.4%的平均准确率和0.755的AUC，略高于71.6%的多数类基线。

Insight: 创新点在于透明地报告了传统纹理特征方法的局限性，并以此为基础提出了一个结合卷积和Transformer编码器的多模态深度学习架构作为未来研究方向，强调了需要更大、多机构、符合伦理的数据集。

Abstract: Automated classification of pulmonary disease from chest radiographs is a widely studied application of machine learning in medical imaging. This paper presents a pilot study evaluating classical texture- and gradient-based feature representations for distinguishing COVID-19 from other forms of pneumonia using the publicly available COVID-19 Image Data Collection (668 posteroanterior/anteroposterior radiographs from 408 patients). Using histogram of oriented gradients (HOG) and gray-level co-occurrence matrix (GLCM) texture descriptors with classical classifiers (logistic regression, random forest, and support vector machine), evaluated under patient-level 5-fold stratified cross-validation to prevent data leakage, we obtain a best mean accuracy of 75.4% and AUC of 0.755, modestly exceeding the 71.6% majority-class baseline. We report these results transparently, including their limitations, and use them to motivate and scope a proposed multi-modal deep learning architecture – combining convolutional and transformer-based encoders across imaging modalities – as a direction for future work requiring access to larger, multi-institutional, ethically sourced datasets.

[102] Endo-NeRF++: Uncertainty-Aware Neural Rendering with Multi-Resolution Hash Encoding for Dynamic Surgical Scene Reconstruction eess.IV | cs.CVPDF

Gousia Habib, Laura Ruotsalainen

TL;DR: 本文提出了Endo-NeRF++，一个用于动态手术场景重建的不确定性感知神经渲染框架。它在EndoNeRF基础上，集成了多分辨率哈希网格编码、时序特征融合和不确定性引导的自适应采样，以提升在组织变形和遮挡情况下的重建精度与时序一致性。

Details

Motivation: 解决在机器人辅助微创手术中，由于组织变形、遮挡、镜面反射和视角受限等因素，动态手术场景重建困难的问题。

Result: 在机器人手术视频序列上的实验表明，相比EndoNeRF基线，所提出的不确定性引导自适应采样将PSNR提升高达1.22 dB (4.3%)，SSIM提升高达5.3%，LPIPS降低高达55.1%。

Insight: 创新点在于将不确定性建模与神经渲染结合，并引入多分辨率哈希编码高效捕捉解剖细节；不确定性引导的自适应采样策略能针对性提升渲染质量，这是一个可借鉴的、针对特定挑战（如手术场景）的精细化优化思路。

Abstract: Reconstructing dynamic surgical scenes is crucial for robot-assisted minimally invasive surgery; however, it continues to be difficult because of tissue deformation, occlusions, specular reflections, and restricted viewpoints. In this study, we introduce Endo-NeRF++, a neural rendering framework that accounts for uncertainty in the reconstruction of dynamic surgical scenes. Expanding on EndoNeRF, the suggested approach incorporates multi-resolution hash-grid encoding, temporal feature merging, and uncertainty-informed adaptive sampling to enhance reconstruction accuracy and temporal coherence in deformable endoscopic scenes.The multi-resolution hash-grid representation within the framework effectively captures both coarse and fine anatomical details, while temporal feature blending ensures stable reconstruction during tissue deformation and surgical tool occlusions. Additionally, uncertainty-driven adaptive sampling assigns more samples to uncertain areas to enhance rendering quality and geometric coherence. Experiments on robotic surgical video sequences demonstrate that the proposed uncertainty-guided adaptive sampling improves PSNR by up to 1.22,dB (4.3%), increases SSIM by up to 5.3%, and reduces LPIPS by up to 55.1% compared with the EndoNeRF baseline.

[103] ReGenVC: End-to-End Real-Time Generative Video Coding at Ultra-Low Bitrate eess.IV | cs.CVPDF

Zheyuan Zhang, Johnson Wu

TL;DR: ReGenVC是一种端到端的生成式视频编解码器，专为超低码率下的实时视频压缩而设计。它通过编码器将说话人视频压缩为包含神经压缩首帧、姿态关键点和元数据的紧凑比特流（约26 kB/77帧），解码器则采用四步蒸馏扩散变换器，根据传输的姿态和参考帧重建视频。相比传统编解码器（如x264/x265），ReGenVC在保持无伪影重建的同时，将码率降低至约十分之一，并在超低码率下避免了传统方法的块状伪影问题。通过四步蒸馏和系统优化技术（如统一序列并行、空间分割VAE和重叠流水线），解码器在8-GPU节点上实现24 fps实时输出，支持浏览器直播流。

Details

Motivation: 解决传统视频编解码器在超低码率下因压缩导致的块状伪影问题，并克服生成式编解码器解码延迟高、难以实时交互的障碍。

Result: 在说话人视频压缩任务中，ReGenVC将比特率降至约26 kB（77帧序列），仅为x264/x265所需码率（250-280 kB）的十分之一，同时实现基本无伪影重建；在匹配的超低码率下，传统编解码器出现严重块状伪影，而ReGenVC保持清晰。在8-GPU系统上，系统可持续输出24 fps（每25帧窗口972 ms），满足实时交互需求。

Insight: 创新点包括：利用生成式先验实现超低码率压缩，通过四步蒸馏扩散变换器降低解码延迟，并结合统一序列并行、空间分割VAE和重叠流水线等系统优化技术实现实时解码；客观分析表明，该方法首次在端到端生成式视频编解码中结合了超低码率编码与8-GPU系统上的实时解码能力。

Abstract: We present ReGenVC, an end-to-end generative video codec that compresses talking-head video to an ultra-low bitrate and decodes it in real time. The encoder reduces a source clip to a compact bitstream – a neurally compressed first frame, per-frame pose keypoints, and metadata – totaling about 26 kB for a 77-frame sequence. The decoder is a four-step distilled diffusion transformer that reconstructs the video conditioned on the transmitted pose and reference frame. Compared with x264/x265, ReGenVC reduces the bitrate to roughly one tenth of that required by traditional codecs (about 26 kB vs. 250–280 kB for essentially artifact-free reconstruction); at a matched ultra-low bitrate, conventional codecs collapse into blocking artifacts while ReGenVC stays sharp by exploiting a strong generative prior. The central obstacle to deploying such a codec is decoder latency: multi-step sampling with transformer and VAE components is too slow for interactive use. We make the decoder real-time through four-step distillation and three model-preserving system techniques: (i) eight-GPU unified sequence parallelism (Ulysses & Ring), (ii) a spatially-split VAE, and (iii) a three-stage overlapped pipeline; an analytical timing model characterizes the real-time feasibility region. On an 8-GPU node, the system sustains 24 fps output (972 ms per 25-frame window, within the 1000 ms budget), enabling a live browser stream without observed frame underruns. A hybrid CPU-GPU deployment further runs the encoder on the CPU at 24 fps and offloads the decoder-side one-shot conditioning encoders to the CPU, reducing the per-GPU memory peak from 21.1 GB to about 7.7 GB. To our knowledge, ReGenVC is the first end-to-end generative video codec to combine ultra-low-bitrate encoding with real-time decoding on an 8-GPU system.

cs.AI [Back]

[104] Dimensionality and Measurement Precision in HLE’s Multiple-Choice Subset cs.AI | cs.CLPDF

Mayank Sharma, Savira Nadela, Tyler Matteson

TL;DR: 该论文评估了Humanity’s Last Exam (HLE)基准测试的多项选择题子集，通过心理测量学方法发现HLE主要测量单一的通用推理能力，其领域子分数并不能有效解释为不同的能力，并且该测试对顶尖模型的分辨能力有限。

Details

Motivation: 研究动机是评估HLE基准测试中按学科领域划分的子分数是否真正对应可分离的潜在能力结构，以及该测试是否能有效区分能力相近的模型。

Result: 通过拟合双参数逻辑IRT模型，发现HLE测量的是一个单一的通用推理因子（McDonald’s ω_h = 0.998），领域标签仅能解释3.5%的项目反应方差，领域内和领域间的残差相关性几乎相同。测试信息函数分析显示，测量精度集中在中等能力水平，而在顶尖模型所处的高能力水平（θ > 0）急剧下降。

Insight: 论文的创新点在于将心理测量学方法（如IRT模型）应用于LLM基准测试评估，揭示了HLE领域子分数的解释局限性及其对顶尖模型分辨力不足的问题，为基准测试的设计和解读提供了重要洞见。

Abstract: Humanity’s Last Exam (HLE) is widely used to evaluate frontier language models. HLE organizes its questions into eight subject-domain categories, whose subscores are often interpreted as evidence of distinct capabilities. However, no study has assessed whether these labels correspond to empirically separable latent constructs, nor whether the benchmark effectively differentiates between models of similar ability. We evaluate 29 LLMs on the text-only multiple-choice subset of HLE ($J = 428$ items) and apply psychometric methods to assess both the dimensionality of the benchmark and the distribution of its measurement precision. Fitting a two-parameter logistic IRT model, we find convergent evidence that HLE measures a single general reasoning factor: McDonald’s $ω_h = 0.998$, domain labels explain only 3.5% of item response variance, within- and between-domain residual correlations are nearly identical (Cohen’s $d = 0.016$), and domain-specific ability estimates are near-redundant with the total score ($r \geq 0.81$). A separate analysis of the test information function reveals that measurement precision concentrates at moderate ability levels and drops sharply above $θ= 0$, where frontier models sit. These findings suggest that HLE’s domain subscores do not warrant distinct capability interpretations and that the benchmark’s ability to discriminate among the strongest models is limited.

[105] ReDiPPO: Reference-Guided Value Calibration and Discrepancy-Aware Token Reweighting for Mathematical Reasoning cs.AI | cs.CLPDF

Zhenrong Zhang, Fei Wu, Jun Du, Jianshu Zhang, Si Wei

TL;DR: 本文提出ReDiPPO框架，通过引入参考答案引导的价值估计和基于差异感知的令牌重加权机制，旨在解决数学推理任务中PPO算法因长推理路径和稀疏奖励导致的令牌级信用分配不准确问题。

Details

Motivation: 在数学推理等长序列、稀疏奖励任务中，标准PPO算法的评论家（critic）难以准确评估中间推理状态，导致优势估计噪声大、策略更新次优。

Result: 在多个数学推理基准测试上的实验表明，ReDiPPO提高了价值估计的准确性，并在最终推理性能上持续优于PPO、DAPO和GSPO等强基线方法。

Insight: 核心创新点在于利用参考答案作为训练时的特权信号来引导价值估计，并量化标准估计与参考引导估计之间的令牌级差异，以此作为困难推理状态的指示器来重加权优势信号，从而改进信用分配。

Abstract: Reinforcement learning has emerged as an effective paradigm for enhancing the mathematical reasoning capabilities of large language models. Among existing policy optimization methods, Proximal Policy Optimization (PPO) remains particularly appealing because its learned critic can, in principle, provide token-level credit assignment. However, in mathematical reasoning tasks characterized by long reasoning horizons and sparse outcome rewards, reliable token-level credit assignment remains challenging. The standard critic often fails to accurately evaluate intermediate reasoning states, resulting in noisy advantage estimates and suboptimal policy updates. In this paper, we propose ReDiPPO, a Reference-guided and Discrepancy-aware PPO framework for mathematical reasoning. ReDiPPO introduces a reference-guided critic that uses reference answers as training-time privileged signals to provide more accurate value estimation. Meanwhile, it retains a standard critic and quantifies the token-level reference-standard discrepancy between the standard value estimate and the reference-guided value estimate. This discrepancy serves as an indicator of difficult reasoning states and is used to reweight the corresponding token-level advantages during PPO optimization. Extensive experiments on diverse mathematical reasoning benchmarks demonstrate that ReDiPPO improves value-estimation accuracy and consistently outperforms strong policy optimization baselines, including PPO, DAPO, and GSPO, in final reasoning performance. Our code is available on https://github.com/cii030/ReDiPPO.

[106] SciDataSailor: Deep Scientific Data Exploring cs.AI | cs.CLPDF

Jiyong Rao, Yicheng Qiu, Chi Zhang, Chunfeng Song, Runkai Zhao

TL;DR: 本文提出了SciDataSailor框架，用于实现深度科学数据探索任务，使LLM智能体能够导航异构科学数据仓库、解释文件、执行分析并整合证据。该框架通过蒙特卡洛树搜索（MCTS）结合特定机制来合成工具交互轨迹，并构建了用于监督微调和评估的数据集。

Details

Motivation: 科学数据集通常以包含异构和相互依赖文件的层次化仓库形式组织，导致检查、整合和分析过程劳动密集且依赖领域专业知识。现有研究大多忽视了LLM智能体通过可执行环境与真实科学数据资产交互的能力。

Result: 构建了SciDataSailor-SFT-2K用于监督微调和SciDataSailor-Bench用于评估，后者包含27个跨生命、地球和物理科学数据集的627个元信息总结任务和586个科学问答任务，但摘要中未提及具体定量结果或基准比较。

Insight: 创新点包括提出深度科学数据探索的智能体任务范式，以及SciDataSailor框架中基于MCTS的轨迹合成机制，如难度分层探索种子、双反馈首次播放紧迫性、分层策略到工具动作生成和熵引导分支，这些机制平衡了广泛探索与针对性利用。

Abstract: Scientific datasets are commonly organized as hierarchical repositories containing heterogeneous and interdependent files, making their inspection, integration, and analysis labor-intensive and reliant on domain expertise. Although large language model (LLM) agents have advanced substantially in planning, reasoning, and tool use, existing research has largely overlooked their ability to interact with real scientific data assets through executable environments. We introduce Deep Scientific Data Exploration, an agentic task paradigm in which agents navigate repositories, interpret heterogeneous files and schemas, execute analyses, integrate cross-file evidence, and produce conclusions grounded in executed observations. To operationalize this paradigm, we present SciDataSailor, a framework for synthesizing tool-interactive trajectories by balancing broad exploration with targeted exploitation. SciDataSailor instantiates trajectory synthesis as Monte Carlo Tree Search (MCTS) with four task-specific mechanisms: difficulty-stratified exploration seeds, dual-feedback first-play urgency, hierarchical strategy-to-tool action generation, and entropy-guided branching. Using this framework, we construct SciDataSailor-SFT-2K for supervised fine-tuning and SciDataSailor-Bench for evaluation, with the latter comprising 627 meta-information summarization tasks and 586 scientific question-answering tasks across 27 datasets spanning the life, earth, and physical sciences.

[107] GLM-RAG: Graph Language Models for Graph-Based Retrieval-Augmented Generation cs.AI | cs.CL | cs.IRPDF

Maya Arseven, Anette Frank, Beni Egressy, Johann Higl, Moritz Plenz

TL;DR: 本文提出了一种基于图语言模型（GLM）的检索器GLM-RAG，用于知识图谱上的检索增强生成任务。研究比较了GLM-based、GNN-based和传统向量搜索检索器在单跳和多跳RAG场景下的性能，特别关注了模型在未见领域的可迁移性。

Details

Motivation: 解决知识图谱RAG任务中检索器需要同时有效捕获图结构和语义信息的问题，并探索GLM这一融合图推理与语言模型语义能力的新范式在检索中的潜力。

Result: 在领域外多跳问答基准测试上，微调后的GLM检索器实现了SOTA性能；在领域内多跳QA数据集上，其性能与先前工作相当，并展现出随参数和子图覆盖增加的良好扩展性。GNN检索器能以高效训练获得更高的图覆盖率，而向量搜索基线在单跳数据集上表现优异。

Insight: 创新点在于将GLM应用于图检索任务，并系统评估了不同检索器范式在RAG中的优劣。客观来看，GLM在领域外泛化能力上的优势是其关键贡献，为构建更具鲁棒性的知识图谱RAG系统提供了新思路。

Abstract: Retrieval-augmented generation (RAG) over knowledge graphs requires retrievers that can effectively capture both graph structure and semantic information. Recent approaches have explored graph neural network (GNN)-based retrievers to model graph topology in multi-hop reasoning tasks. In parallel, graph language models (GLMs) have emerged as a promising paradigm that integrates graph reasoning and the semantic capabilities of language models. In this work, we introduce a GLM-based retriever and investigate the comparative strengths of GLM-based, GNN-based, and traditional vector-search-based retrievers in single- and multi-hop RAG settings, and with a particular focus on transferability to unseen domains. Our findings suggest that finetuned GLM retrievers generalize better out of domain, achieving SOTA on two multi-hop benchmarks. On in-domain multi-hop QA datasets they remain comparable to prior work, with promising scaling as parameters and subgraph coverage increase. GNN-based retrievers achieve higher graph coverage with an efficient training setup, whereas the vector-search baseline excels at single-hop datasets.

Hongyu Chen, Liang Lin, Guangrun Wang

TL;DR: 本文提出了一种名为自我验证精炼（SVR）的无监督多轮强化学习框架，旨在通过联合裁决-置信度学习实现自适应测试时计算分配。该方法让模型在每轮推理中生成答案、正确性裁决和置信度分数，仅当裁决为正确且置信度超过阈值时才保留答案，否则继续自我精炼。

Details

Motivation: 现有方法在扩展测试时计算时存在不足：统一计算预算在简单输入上浪费资源，而基于验证器的精炼方法又依赖外部反馈。SVR旨在通过自我验证作为计算控制策略，实现无需外部反馈的自适应计算分配。

Result: 在七个数学推理基准测试上使用Qwen3.5-2B模型，SVR实现了0.563的宏平均准确率，平均仅需2.99轮推理。在完整系统比较中，其性能超越了标准GRPO、强大多轮基线以及固定预算的oracle引导分数反馈参考方法，且所需轮数远少于固定的十轮推理。

Insight: 核心创新在于将自我验证作为内部控制信号，通过联合学习裁决和置信度来指导答案保留和计算分配，实现了无需外部反馈的自适应推理。训练时仅使用真实正确性构建奖励，推理时完全自主决策，这为高效利用测试时计算提供了新思路。

Abstract: Scaling test-time computation can improve language-model reasoning, but uniform budgets waste computation on easy inputs, while verifier-guided refinement relies on external feedback. We introduce Self-Verifying Refinement (SVR), an oracle-free multi-turn reinforcement learning framework that learns to use self-verification as a compute-control policy. At each turn, the model produces a solution together with a discrete correctness verdict and a confidence score; it retains the current answer only when the verdict is Correct and confidence exceeds a threshold, and otherwise continues refinement using its own self-verification. Ground-truth correctness is used only to construct training rewards and is never exposed to the policy through refinement prompts or required at inference. SVR is trained with GRPO on fixed-horizon trajectories using rewards that promote solution correctness, calibration-aware self-verification, and stop-ready correct states; adaptive stopping is activated only at inference. On seven mathematical reasoning benchmarks with Qwen3.5-2B, SVR achieves a macro-average accuracy of 0.563 with only 2.99 inference turns on average. In the evaluated complete-system comparison, it exceeds standard GRPO, strong multi-turn baselines, and a fixed-budget oracle-guided score-feedback reference while requiring substantially fewer turns than fixed ten-turn inference. These results demonstrate that learned self-verification can serve as an effective internal control signal for answer retention and adaptive test-time compute allocation.

[109] OSReward: Instituting Standardized Evaluation for Cross-Platform Computer-Use Reward Models cs.AI | cs.CL | cs.CVPDF

Qiushi Sun, Kanzhi Cheng, Yian Wang, Bowen Yang, Hang Yan

TL;DR: 本文提出了OSReward基准，用于系统评估视觉语言模型作为计算机使用智能体轨迹评判者的可靠性，发现现有先进模型存在系统性宽松偏差。为弥补差距，作者构建了OS-Shepherd-100K数据集并训练了开源的奖励模型OS-Shepherd，能以更低成本提供可靠的奖励信号。

Details

Motivation: 计算机使用智能体的评估、数据管理和强化学习依赖于对其任务完成情况的验证，而人工验证难以规模化，因此领域转向使用视觉语言模型作为评判者。但VLM评判者的可靠性尚未得到系统研究。

Result: 在OSReward基准上的评估表明，即使是SOTA模型也达不到理想评判者的水平，存在将失败运行误判为成功的系统性宽松偏差。作者训练的OS-Shepherd开源奖励模型能以比前沿商业模型低30-60%的成本，提供与之匹配的可靠奖励信号。

Insight: 创新点在于首次系统构建了用于评估VLM作为CUA轨迹评判者的高质量、多平台基准（OSReward），并揭示了现有模型的系统性偏差。通过构建大规模推理标注数据集和训练专用开源奖励模型，为社区提供了低成本、可靠的规模化评估解决方案。

Abstract: Computer-using agents (CUAs) are advancing rapidly across the digital world. A CUA trajectory records the agent’s actions, states, and reasoning. Verifying whether it fulfilled the task instruction is central to CUA evaluation, data curation, and reinforcement learning. Neither human-written verifiers nor human annotators can provide such verification at scale, so the field increasingly turns to vision-language models (VLMs) as judges of CUA trajectories. But a fundamental question has long gone unexamined: are these VLM judges reliable enough? To study it systematically, we introduce OSReward, a realistic, high-quality benchmark that evaluates VLM judges on CUA trajectories. The trajectories come from diverse agent backbones executing human-verified instructions across platforms, then rigorously labeled with ground-truth verdicts through multi-stage human annotation. Building on it, we derive OSReward-Hard, a challenge set concentrating genuinely hard cases, and OSReward-Multi for fine-grained efficiency and alignment scoring. The most comprehensive evaluation of VLM judges to date finds even state-of-the-art models fall short of an ideal judge, sharing a systematic leniency bias that mislabels failed runs as successes. The few reliable enough to trust are too expensive to run at scale, while affordable open models trail far behind. To close this gap, we construct and release OS-Shepherd-100K, an open corpus of reasoning-annotated trajectory judgments for the CUA community. On it, we train OS-Shepherd (9B and 35B), open reward models that supply low-cost, stable, and reliable reward signals, matching commercial judges at 30-60% lower cost than the frontier. Extensive analyses further inform the design of reliable CUA reward at scale. Our code, benchmark, dataset, and model checkpoints are available at https://os-copilot.github.io/OSReward-Home/.

[110] RadHarmony: Radiological Data Handling in the Era of Agentic AI cs.AI | cs.CVPDF

Frank Li, Bardia Khosravi, Mohammadreza Chavoshi, Theo Dapamede, YoungSeok Jeon

TL;DR: RadHarmony是一个开源的Python库，旨在为放射学图像（如胸片、CT和MRI）提供统一的数据处理API，以解决多源异构数据集在格式、布局、标签和标注类型上的整合难题。它标准化了24个公共数据集的元数据，集成了MONAI的数据加载功能，并支持分类标签、分割掩码、边界框和放射报告文本，还包含一个AI代理技能来简化新数据集的集成工作流。

Details

Motivation: 在放射学图像上训练深度学习模型需要整合来自不同来源、具有异构文件格式、目录布局、标签模式和标注类型的数据集，这过程复杂且耗时，因此需要一种统一的方法来简化数据加载、协调和增强。

Result: 通过使用RadHarmony，作者预训练了RadHarmony-ViT，这是一个参考视觉Transformer基线模型，它无需特定数据集代码即可结合三个异构胸片数据集，展示了库的实用性。

Insight: 创新点在于提供了一个统一的库来标准化和协调放射学数据，特别是引入了AI代理技能来自动化新数据集的集成流程，这降低了数据准备的门槛并提高了研究效率。

Abstract: Training deep learning models on radiological images requires integrating heterogeneous datasets across different sources, file formats, directory layouts, label schemas, and annotation types. We present RadHarmony, an open-source Python library that provides a unified API for loading, harmonizing, and augmenting radiological datasets, with a primary focus on chest radiographs and early support for computed tomography (CT) and magnetic resonance imaging (MRI). RadHarmony standardizes metadata from 24 public datasets into a single tabular format, wraps MONAI’s map-style datasets for deep-learning-ready sample delivery with optional on-disk caching, and supports classification labels, segmentation masks, bounding boxes, and radiology report text through a single interface, with an interactive visualization tool for dataset exploration and verification. To lower the barrier for integrating new datasets, RadHarmony introduces an AI-agent skill that guides the full integration workflow from raw data inspection through code generation and testing. We demonstrate the library’s utility by pretraining RadHarmony-ViT, a reference vision transformer baseline that combines three heterogeneous chest radiograph datasets with no dataset-specific code. The code and pretrained model weights are available at https://github.com/f10409/RadHarmony.

[111] Sign Language Question Answering: A New Task, Benchmark, and Baseline for Sign Language Understanding cs.AI | cs.CVPDF

Shiwei Gan, Lichen Wang, Xiao Liu, Yafeng Yin, Kuizhuang Liu

TL;DR: 本文首次提出了手语问答（SLQA）新任务，以评估模型对手语视频语义内容的理解能力，超越了传统手语识别和翻译的固定映射评估。作者基于PHOENIX14T和CSL-Daily数据集构建了两个SignQA基准，涵盖五类互补问题，并提出了一个结合问题条件调制时序下采样模块和领域内知识迁移策略的基线模型。实验表明该基线在所有问题类别上均优于代表性视觉语言模型，为SLQA研究建立了强基准。

Details

Motivation: 现有手语理解任务（如连续手语识别和翻译）采用预定义目标，仅评估模型从手语视频到标注或口语句子的固定映射能力，无法全面评估模型对手语视频语义内容的理解。因此，需要更灵活、全面的评估框架来检验多种推理能力。

Result: 在基于PHOENIX14T和CSL-Daily构建的SignQA基准上，所提基线模型在所有五类问题（位置推理、结构推理、视觉搜索、标注识别和翻译理解）上均一致优于代表性视觉语言模型，为SLQA任务建立了强基准。

Insight: 创新点在于提出了手语问答（SLQA）这一新任务和对应基准，通过自然语言问题灵活评估手语理解；方法上设计了问题条件调制时序下采样模块以增强问题感知的时序特征建模，并采用领域内知识迁移策略从现有手语理解任务有效迁移知识。

Abstract: Recent advances in sign language (SL) understanding (SLU) have led to remarkable progress in tasks such as continuous SL recognition and SL translation. However, these tasks are designed with predefined objectives, requiring models to learn a fixed mapping from sign videos to glosses or spoken-language sentences. As a result, they provide only a limited assessment of whether a model truly understands the semantic content of SL videos. To address this limitation, \textbf{we first propose a new task, Sign Language Question Answering (SLQA)}, which evaluates SL understanding by requiring models to answer arbitrary natural language questions about SL videos. Unlike previous SLU tasks, SLQA provides a more flexible and comprehensive evaluation framework that assesses multiple reasoning capabilities beyond recognition and translation. To facilitate this task, \textbf{we further construct two SignQA benchmarks} based on PHOENIX14T and CSL-Daily by automatically generating question-answer pairs from existing gloss and sentence annotations using carefully designed templates. The resulting datasets cover five complementary question categories, including position reasoning, structural reasoning, visual search, gloss recognition, and translation understanding. \textbf{Finally, we propose a simple yet effective baseline model} equipped with a Question-Conditioned Modulated Temporal Downsampling module and an in-domain knowledge transfer strategy, enabling effective knowledge transfer from existing SLU tasks while enhancing question-aware temporal feature modeling. Extensive experiments demonstrate that our baseline consistently outperforms representative vision-language models across all question categories, establishing a strong benchmark for future research on SLQA. Datasets are available at:{https://huggingface.co/datasets/hulala/SignQA-2026}.

[112] MMHBench: A Multi-Perspective Benchmark for Mental Health Understanding in Long-Form Videos cs.AI | cs.CVPDF

Jinpeng Hu, Erqiang Wang, Shan Wang, Zhuo Li, Peipei Song

TL;DR: 本文提出了MMHBench，一个用于长视频心理健康理解的多视角多模态基准测试，包含268个长视频和2184个精心设计的问题。该基准将评估分为第三人称评估和第一人称视角共情两个互补设置，并采用多智能体问题生成框架来模拟不同社会角色以合成多视角问题。对22个代表性多模态大语言模型的广泛评估表明，长视频心理健康理解任务仍然极具挑战性。

Details

Motivation: 现有基准测试大多将心理健康理解任务简化为粗粒度分类，无法揭示模型是否真正理解心理现象还是仅依赖表面相关性。为弥补这一局限，作者旨在构建一个更全面、细粒度的多视角基准。

Result: 对22个开源和领先闭源多模态大语言模型的广泛评估表明，所有模型在MMHBench上的表现都远未达到令人满意的水平，凸显了该任务的难度。

Insight: 创新点在于提出了一个细粒度的多视角评估框架（第三人称与第一人称），并设计了多智能体问题生成方法来模拟不同社会角色，从而生成高质量、多视角的问题，这为评估模型对复杂心理现象的理解深度提供了新范式。

Abstract: Mental health understanding in long-form videos requires nuanced reasoning over observable behavior, interpersonal context, and latent psychological states. Existing benchmarks largely reduce this task to coarse-grained classification, providing limited insight into whether models truly understand psychological phenomena or rely on superficial correlations. To address this limitation, we introduce MMHBench, a comprehensive multimodal benchmark for multi-perspective mental health understanding, comprising 268 long-form videos and 2,184 carefully curated questions. MMHBench organizes the evaluation into two complementary settings: (1) third-person assessment, consisting of 605 questions that focus on the interpretation of observable behaviors and multimodal evidence, and (2) first-person perspective-taking, comprising 1,579 questions that require perspective-conditioned reasoning to identify the interpretation of the mental state supported by the available multimodal evidence. We propose a Multi-Agent Question Generation (MAQG) framework that simulates diverse social roles to synthesize questions from multiple perspectives. The generated questions are refined through multi-role feedback and iterative optimization, followed by expert-guided verification to ensure quality and validity. Extensive evaluation of 22 representative multimodal large language models (MLLMs), spanning both open-source and leading closed-source models, demonstrates that long-form video mental health understanding remains highly challenging.

[113] MUL-T: Decoding Spatial Cellular Architecture in Multiplexed Tissue Images cs.AI | cs.CVPDF

Farzaneh Seyedshahi, Kai Rakovic, Adalberto Claudio Quiros, John LeQuesne, Ke Yuan

TL;DR: MUL-T是一个轻量级Transformer框架，用于从多路复用组织图像中解码空间细胞结构。它将组织架构重新定义为离散细胞标记上的掩码上下文预测任务，通过无任务特定监督学习上下文化的[CLS]嵌入来捕获高阶细胞相互作用。

Details

Motivation: 现有方法依赖手工特征（如标记强度统计或细胞类型比例），难以在具有异质标记面板的队列中扩展或泛化，因此需要一种能同时建模细胞表型及其空间上下文的方法。

Result: 在多个临床相关下游任务（包括核心级肿瘤模式分类、患者级分级、PD-L1阳性预测和跨数据集治疗反应预测）上，MUL-T始终优于基于经典特征的基线方法，并与基础ViT模型性能相当，但参数量显著减少且训练成本更低。

Insight: 创新点在于将组织架构建模为掩码上下文预测任务，通过无监督学习上下文化嵌入来高效捕获细胞间相互作用；客观分析认为其轻量级Transformer设计在保持性能的同时降低了计算复杂度，适用于多队列泛化。

Abstract: Understanding tissue organisation in multiplexed imaging requires modelling both cellular phenotypes and their spatial context. Existing approaches typically rely on handcrafted features, such as marker intensity statistics or cell-type proportions, which often fail to scale or generalise across cohorts with heterogeneous marker panels. We introduce MUL-T, a lightweight transformer framework that reframes tissue architecture as a masked contextual prediction task over discrete cell tokens. By learning contextualised [CLS] embeddings without task-specific supervision, the model captures higher-order cellular interactions while remaining computationally efficient. We evaluate MUL-T on several clinically relevant downstream tasks, including core-level tumour pattern classification, patient-level grading, PD-L1 positivity prediction, and cross-dataset treatment response prediction. Across tasks, MUL-T consistently outperforms classical feature-based baselines and achieves performance comparable to a foundation ViT model, despite substantially fewer parameters and lower training cost.

[114] Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI Agents cs.AI | cs.CVPDF

Hanzhang Zhou, Panrong Tong, Xu Zhang, Quyu Kong, Chenglin Cai

TL;DR: 本文介绍了Qwen-UI-Agent，一个面向真实世界应用的新一代基础GUI智能体。它旨在成为一个能在真实设备上可靠运行、跨平台执行工作流、结合GUI交互与CLI执行、完成长视野任务、主动发起服务并能自主进化的通用执行器。该系统通过统一的动作空间、自动研究风格的数据飞轮、在线强化学习以及轻量级编排层等技术，在移动、计算机、网页和深度搜索等多种环境中实现了卓越的性能。

Details

Motivation: 为了解决现有GUI智能体在迈向真实世界应用时面临的挑战，如跨平台操作、长任务执行、主动服务以及自主能力提升等，作者旨在构建一个以真实世界为中心、能可靠操作真实设备并整合多种交互模式的基础智能体。

Result: 在广泛的评估中，Qwen-UI-Agent在移动使用基准测试中达到了最先进的性能（例如，在MobileWorld上达到82.1%），并在计算机和浏览器使用任务上与前沿模型（如Opus 4.8、Gemini 3.1 Pro和GPT-5.6 Sol）相比具有竞争力。具体地，在计算机使用上，它在OSWorld-Verified上达到79.5%；在浏览器使用和GUI基础任务上，分别在WebArena和ScreenSpot-Pro上达到73.6%和81.5%。

Insight: 论文的创新点包括：1) 构建了一个统一动作空间，将GUI操作与CLI执行交织在一起，并能在单次模型调用中生成批量动作；2) 引入了AutoResearch风格的数据飞轮，利用智能体自主构建任务、诊断失败并规划迭代；3) 采用在线强化学习支持超过100步的长轨迹训练，并通过超过10,000个并发环境加速 rollout；4) 设计了轻量级编排层，支持跨移动和计算机的主动服务发起和有状态工作流。

Abstract: GUI agents have the potential to become a general purpose executor over existing digital devices. To advance them toward real-world use, we envision agents that operate reliably on real devices, execute workflows across platforms, combine GUI interaction with CLI execution, complete long-horizon tasks, proactively initiate useful services, and autonomously improve their capabilities with minimal human effort. Guided by this vision, we present Qwen-UI-Agent, a real-world centric foundation GUI agent spanning mobile, computer-use, web, and DeepSearch environments. Qwen-UI-Agent combines diverse sandbox environments with a large-scale real-device mobile runtime. Its unified action space interleaves GUI operations with CLI execution and generates batched actions in a single model turn. An AutoResearch-style data flywheel uses agents to construct tasks and environments, diagnose failures, and plan subsequent iterations. Online RL supports training on trajectories exceeding 100 turns, with over 10,000 concurrent environments accelerating rollout. A lightweight harness layer supports proactive service initiation and stateful workflows across mobile and computer. Across a broad suite of evaluations, Qwen-UI-Agent sets state-of-the-art performance on mobile-use benchmarks while delivering competitive performance on computer- and browser-use tasks against frontier models, including Opus 4.8, Gemini 3.1 Pro, and GPT-5.6 Sol. On mobile use, it achieves 82.1% on MobileWorld, 92.2% on MobileWorld-Real, and 97.5% on AndroidDaily. On computer use, it achieves 79.5% on OSWorld-Verified and a 40.0% partial-progress score on OSWorld-v2. On browser use and GUI grounding, it achieves 73.6% on WebArena and 81.5% on ScreenSpot-Pro, respectively.

cs.SE [Back]

[115] Change2Task: From Repository Changes to Executable Coding Agent Tasks and Environments cs.SE | cs.CL | cs.LGPDF

Haomin Qi, Xingliang Wang, Xuanqi Gao, Baihui Sang, Xin Zhang

TL;DR: Change2Task是一个从代码仓库历史中提取可执行任务用于编码智能体训练与评估的系统。它通过将已合并的Pull Request转换为在相同仓库现代版本上经过验证的任务，为编码智能体提供可执行数据，并减少环境设置和任务构建的重复工作。

Details

Motivation: 解决编码智能体规模化所需的可执行数据持续供应问题，每个任务需要耦合真实的软件状态、规范、开发工具和可靠的验证。

Result: 在Bug修复、功能添加、测试生成、API迁移和安全修复这五大常见任务类别上，从1130个符合条件的源码变更中，系统实现了79.6%的已验证任务构建成功率。相比基于Pull Request的构建基线，它多恢复了29.2%的已验证任务。

Insight: 创新点在于将仓库历史（合并的Pull Request）作为可信的开发者证据来源，并通过补丁反转、代码映射或智能体重建等技术重建任务状态，同时利用现代代码库作为健康基础以减少开销。系统提供了从历史变更到可验证、可执行任务环境的自动化流水线。

Abstract: Scaling coding agents requires a continuing supply of executable data for training, benchmarking, and continuous evaluation. Each task must couple a realistic software state with a specification, development tools, and reliable verification. To expand this supply, we present Change2Task, a system grounded in repository history that converts merged pull requests into verified tasks on healthy modern revisions of the same repository. It aligns historical evidence with evolved code, reconstructs task states through Patch Reversal, Code Mapping, or Agent Reconstruction, and validates the lifecycle from a healthy base to a task state and a restored state. By deriving multiple tasks grounded in developer evidence from maintained environments, Change2Task provides executable data for coding agent training and evaluation while reducing repeated environment setup, storage, and task construction effort. We evaluate the system through five common and widely adopted coding agent task families: Bug Fix, Feature Addition, Test Generation, Application Programming Interface Migration, and Security Repair. Starting from 1,130 source changes eligible for construction, Change2Task achieves 79.6% verified task construction success across these task families. On a matched candidate set, it recovers 29.2% more verified tasks than a construction baseline based on pull requests. Historical and reconstructed cases achieve up to 98.0% matched outcome agreement under agent evaluation, while reuse of modern bases reduces measured expenditure across the complete pipeline by 10.8%.

cs.HC [Back]

[116] Digital Harf: A Clinically Integrated Multimodal AI System for Pervasive Arabic Speech and Language Therapy cs.HC | cs.CLPDF

Asif Azad, Mohammad Sadat Hossain, MD Sadik Hossain Shanto, Sabri Boughorbel, Abdulrhman Aljouie

TL;DR: 本文介绍了Digital Harf，一个为阿拉伯语国家自闭症谱系障碍儿童设计的、临床集成的多模态AI系统，用于提供普及性的言语和语言治疗。该系统通过整合语言治疗、言语清晰度和图片描述三个模块，将临床治疗延伸至家庭环境，并利用Agentic Synthetic Data Engine自动生成符合文化和治疗标准的内容，以解决阿拉伯语治疗材料的短缺问题。

Details

Motivation: 解决阿拉伯语国家自闭症儿童在言语和语言治疗中面临的三大障碍：合格专家短缺、服务范围局限于城市中心，以及缺乏文化根基的数字治疗材料。

Result: 专家评估显示，由13位持证言语语言病理学家进行的评估中，ASDE生成的内容获得了90.1%的临床接受率，无需人工筛选，且整个平台在文化和语言对齐方面获得高度评价。

Insight: 创新点在于提出了一个从底层为代表性不足的语言环境构建的AI驱动治疗系统，将文化根基视为核心基础设施而非事后适配；同时，引入Agentic Synthetic Data Engine自动生成文化相关内容，有效解决了特定语言治疗数据稀缺的挑战。

Abstract: Children with Autism Spectrum Disorder in Arabic-speaking countries face compounded barriers to effective speech and language therapy: a shortage of qualified specialists, limited service reach beyond urban centers, and a near-total absence of culturally grounded digital therapy materials. We present Digital Harf, a pervasive, multimodal AI platform that extends clinician-led speech and language therapy into the home. The system integrates three therapeutic modules - language therapy, speech intelligibility, and picture description - within a unified workflow that adapts to each child’s performance over time. To address the critical shortage of Arabic therapy content, we introduce an Agentic Synthetic Data Engine (ASDE) that automatically generates culturally relevant images, prompts, and language tasks guided by explicit therapeutic and cultural criteria. Expert evaluation with 13 licensed Speech-Language Pathologists yielded a 90.1% clinical acceptance rate for ASDE-generated content without any manual curation or selection, and strong ratings for cultural and linguistic alignment across the full platform. Digital Harf demonstrates that AI-driven therapeutic systems can be built from the ground up for underrepresented linguistic settings, treating cultural grounding as core infrastructure rather than an adaptation afterthought.

cs.SD [Back]

Xilin Jiang, Riki Shimizu, Sukru Samet Dindar, Junkai Wu, Zhongweiyang Xu

Details

Motivation: 解决现实世界社交对话的模糊性问题，即多说话人参与、存在无关语音和背景噪声的复杂环境中，语音助手不仅需要决定说什么，还需要决定是否应该说话。

Result: 论文未在摘要中提供具体的定量实验结果或基准测试比较。

Insight: 创新点在于将多说话人嘈杂环境下的对话建模为一个序列决策问题，通过定义明确的动作令牌来控制助手的交互行为，并利用LLM生成合成数据来应对真实多说话人对话数据稀缺的挑战。

Abstract: Spoken dialog systems are typically designed for clean, dyadic interactions in which a single user and an assistant take turns speaking. Real-world social conversations, however, are often more ambiguous: multiple speakers may participate in the same conversation amid irrelevant speech and background noise. Each utterance may be directed to the assistant, addressed to another speaker, or completely irrelevant. In such settings, the assistant must decide not only what to say, but also whether to speak at all. In this paper, we introduce Cocktail-Talker, a speech LLM framework for multi-speaker spoken dialog modeling in noisy social environments. We model the assistant’s behavior with three action tokens: <|respond|>, <|listen|>, and <|ignore|>, placed before a response or silence. Cocktail-Talker is trained via supervised finetuning and reinforcement learning to generate the appropriate action token and, only in <|respond|> mode, a speech response. To prepare the training data, we develop Cocktail-DialogGen, an LLM-based data pipeline that simulates realistic multi-speaker dialogs with speaker roles across diverse social settings. Together, these components take a step toward spoken dialog systems that interact more naturally and selectively in complex social environments.

cs.RO [Back]

[118] Cross-Embodiment Transfer via Behavior-Aligned Representations cs.RO | cs.AI | cs.CV | cs.LGPDF

Ajay Sridhar, Jensen Gao, Jonathan Yang, Jean Mercat, Suneel Belkhale

TL;DR: 该论文研究了在视觉-语言-动作（VLA）模型中，使用行为对齐表示（如物体边界框、语言动作描述、机器人末端执行器轨迹）来促进跨具身（cross-embodiment）知识迁移。作者开发了一个模拟基准来评估不同表示方法在跨具身数据迁移到新具身时的效果，发现末端执行器轨迹表示尤其有效，且在大规模先验数据集上作用更显著，并能利用无动作数据。实验表明，该方法能提升28%的从仿真到真实机器人的跨具身迁移任务完成进度。

Details

Motivation: 大规模模仿学习虽然利用了广泛的机器人具身数据，但实现有效的跨具身迁移仍然困难。论文旨在探究行为对齐表示在VLA模型中的作用，以统一跨具身数据并增强迁移能力。

Result: 在设计的模拟基准上评估发现，末端执行器轨迹表示对迁移特别有益；表示方法在大规模先验数据集上更有用，并能利用无动作数据。仿真到真实世界的跨具身迁移实验显示，该方法使预训练策略的任务完成进度提升了28%。

Insight: 创新点在于系统性地研究并验证了行为对齐表示（尤其是末端执行器轨迹）作为跨具身不变性特征，在统一异构数据和促进知识迁移中的关键作用。客观来看，该方法为利用大规模、多源机器人数据提供了一种有效的表征学习思路，并展示了从仿真到现实迁移的实用价值。

Abstract: Recent progress in large-scale imitation learning for robot manipulation has been driven by leveraging datasets across a wide range of robot embodiments. However, achieving significant cross-embodiment transfer is often still challenging. In this work, we study the role of using behavior-aligned representations (e.g., object bounding boxes, language motions, end-effector traces of robot motion) in vision-language-action (VLA) models to promote cross-embodiment transfer. We hypothesize that by possessing invariances across embodiments while being predictive of robot actions, these representations can help unify large-scale cross-embodiment data to enhance transfer. To assess our hypothesis, we develop a simulation-based benchmark designed to assess transfer with diverse cross-embodiment data to new embodiments. Using this benchmark, we compare different representations and ways of incorporating them. We identify that end-effector traces can be particularly beneficial for transfer, representations are generally more useful with larger prior datasets, and can be used to benefit from action-free data. We also demonstrate that they can enhance sim-to-real cross-embodiment transfer, improving task completion progress of real robot policies pre-trained on simulation data by 28%. We provide videos of our evaluations at our website: https://ajaysridhar.com/barx/.

cs.NI [Back]

[119] PCAP-LM: An LLM-Native Text Representation for TLS Bulk Traffic Analysis cs.NI | cs.CLPDF

Xavier Marjou, Lucas Tamic, Ilan Jaffeux-Cheniout

TL;DR: 本文提出了PCAP-LM，一种面向LLM的文本表示方法，用于TLS大流量分析。该方法通过创新的PacketGlyphs ASCII字母表对原始数据包进行语义总结，并结合受限PMI-BPE分词器和游程编码，将流量数据压缩812倍，使其能完整放入LLM上下文窗口，从而显著提升LLM在流量分析问答任务中的准确性。

Details

Motivation: 解决标准网络抓包格式及其文本表示过于冗长，远超LLM上下文窗口限制，导致无法有效利用LLM强大推理能力进行流量分析的问题。

Result: 在5G/4G TLS 1.3批量下载流量的同质语料上评估，BPE词汇表仅用159个词元就达到饱和，相比tshark -V实现了812倍的尺寸压缩。在30个保留文件的取证问答评估中，前沿LLM使用PCAP-LM文档的准确率达到99.3%，而使用token预算匹配的tshark -V前缀的准确率仅为51.0%。

Insight: 核心创新在于将流量分析视为一个有损的知识提取步骤，而非标准压缩，并设计了PacketGlyphs这一新颖的ASCII字母表来编码数据包的多维语义信息。结合针对性的分词与编码策略，实现了对重复行为模式的极致压缩，同时通过侧索引保留了无损下钻到原始数据包的能力。

Abstract: Large language models (LLMs) offer powerful reasoning capabilities for network traffic analysis, but standard capture formats and their textual equivalents are prohibitively verbose, overflowing LLM context windows by two orders of magnitude. We present PCAP-LM, a flow-centric, LLM-native text representation that acts as a lossy knowledge extraction step rather than a standard compression tool: raw captures are transcoded into semantic summaries using PacketGlyphs - a novel ASCII alphabet coined in this paper that encodes packet direction, TCP/TLS state, log-scale size, and inter-packet delay. Combined with a constrained PMI-BPE tokenizer and motif run-length encoding, repetitive behavioural patterns are aggressively collapsed. A @REFS side-index preserves lossless drill-down into the original packets. Evaluated on a homogeneous corpus of 5G/4G TLS 1.3 bulk-download traffic, the BPE vocabulary fully saturates at 159 tokens, achieving an 812x size reduction over tshark -V and fitting entire captures within a single LLM context window. In a forensic question-answering evaluation over 30 held-out files, a frontier LLM achieves 99.3% accuracy from PCAP-LM documents versus 51.0% from a token-budget-matched tshark -V prefix. The lossy design introduces known blind spots - most notably a 24% false-negative rate for TCP retransmissions - and extending to heterogeneous mixed-protocol environments will require vocabulary retraining.

cs.LG [Back]

[120] Explorative Modeling: Unlocking a Third Pretraining Axis and End-to-End Generation cs.LG | cs.AI | cs.CL | cs.CVPDF

Alexi Gladstone, Heng Ji, Yilun Du

TL;DR: 本文提出了一种名为探索性建模（Explorative Modeling）的新范式，通过分解训练循环而非生成过程，探索模型生成与数据之间的K个候选匹配并基于最佳匹配进行训练，从而解决了生成模型无法端到端训练的问题。该方法在图像、视频和语言等连续和离散领域中，通过增加探索作为第三个预训练轴（超越参数和数据），显著提升了性能、效率和泛化能力，并实现了端到端的重建生成建模。

Details

Motivation: 生成模型虽然能力强大，但因其核心需处理多模态分布，现有可扩展方法通过分解生成过程来应对，这阻碍了端到端训练。本文旨在打破这一限制，引入探索性建模，通过分解训练循环来避免预测模糊化并承诺于特定模式，从而解锁生成模型的端到端训练。

Result: 在图像、视频和语言任务中，增加探索作为预训练轴可单调提升性能：随着数据和模型规模扩大，增益从7%升至36%和13%升至23%，计算效率提升超过两倍（3倍计算时）。具体而言，探索将FLOP效率提升4.1倍、样本效率提升6.2倍、参数效率提升47%，在无引导情况下将最强图像生成方法提升至接近SOTA的1.43 FID（ImageNet），并实现了端到端现有模型的扩展。在控制任务中，探索性模型与扩散模型性能相当，但推理步骤减少16-256倍。

Insight: 创新点在于将探索作为独立的预训练轴引入，通过训练循环的分解而非生成过程的分解，解决了生成模型端到端训练的长期挑战。这提供了可扩展的性能提升路径，并可能启发更高效的生成模型训练框架，特别是在多模态处理和计算资源优化方面。

Abstract: The deep learning revolution, kicked off by AlexNet, taught us that end-to-end training beats decomposing a problem into hand-designed stages. Generative modeling, however, has remained the exception-despite generative models being remarkably capable, they are still not trained end-to-end. This is because, at its core, generative modeling is about handling distributions with many modes, and existing scalable approaches handle this the same way, by factoring the generation procedure, which prevents end-to-end generation. In this work, we introduce Explorative Modeling, a new paradigm that instead factors the training loop, exploring K candidate matches between model generations and data, and training on the best, so predictions commit to modes rather than blurring them. We find Explorative Models (XMs) useful in two settings. First, increasing exploration adds a third pretraining axis beyond parameters and data for existing generative models-where scaling exploration monotonically improves performance across both continuous and discrete domains (images, video, and language). Notably, gains from exploration increase with scale, climbing from 7% to 36% as data scales and from 13% to 23% as models grow, with efficiency gains more than doubling at 3x the compute. Concretely, exploration improves FLOP efficiency by 4.1x, sample efficiency by 6.2x, parameter efficiency by 47%, lifts the strongest of image-generation recipes to a near-state-of-the-art 1.43 FID on ImageNet without guidance, enables scaling how end-to-end existing models are, and unlocks scaling generalization. Second, XMs enable end-to-end reconstructive generative modeling, matching diffusion on control tasks with 16-256x fewer inference steps. Together, these results establish XMs as both a new pretraining axis for existing generative models and a standalone end-to-end generative modeling paradigm.

[121] Latent States in Neural Networks: Recovering the Temporal Structure of Drifting Data from Model Weights cs.LG | cs.AI | cs.CLPDF

Kevin Guan

TL;DR: 该论文研究如何从在时序漂移数据流上训练的模型权重中恢复潜在的时间结构。作者提出使用隐马尔可夫模型（HMM）拟合按时间顺序排列的模型权重轨迹，以识别数据流中离散的漂移状态。在Fakeddit（多模态虚假信息检测）和Yelp（情感分析）两个数据集上验证了方法的有效性，发现模型在相同潜在状态内的数据窗口间泛化能力更好。

Details

Motivation: 解决时序漂移数据流中可能存在的离散状态划分问题，探究仅从训练好的模型权重中能否恢复出这些潜在的时间结构，从而更好地理解数据漂移的本质并提升模型泛化能力。

Result: 在Fakeddit和Yelp数据集上，基于权重轨迹HMM划分的状态内数据窗口间的模型泛化性能（跨窗口转移优势）优于跨状态边界或简单等分连续状态的基线方法。该优势在控制时间邻近性后依然存在，且与数据类别分布的变化相关性更强。效果在两个任务上均可复现，但在标签分布更稳定的Yelp数据集上有所减弱。

Insight: 创新点在于提出了一种仅从模型权重序列（而非原始数据）中无监督地恢复时序数据流潜在离散状态的方法，并证明了这种状态划分对模型泛化具有超越简单时间邻近性和数据分布变化的预测价值。这为理解模型在非平稳环境中的学习和适应过程提供了新视角。

Abstract: A temporally drifting data stream may pass through discrete regimes rather than changing continuously. We ask whether such regimes are recoverable from the weights of models trained on the stream, using a hidden Markov model (HMM) fit to the chronologically ordered trajectory of those weights. We study this question in two domains known to drift over time: multimodal misinformation detection, using the Fakeddit dataset; and sentiment analysis, using the Yelp dataset. We train classifiers on consecutive temporal windows and fit an HMM to the trajectory of their aligned weights, recovering latent states that partition each timeline into coherent phases. On both datasets, classifiers generalize better to data from windows sharing the state of their training window than to windows across state boundaries. This within-state transfer advantage survives a control for temporal proximity and modestly exceeds the advantage recovered by a naive partition into contiguous states of equal size. Although the states are estimated solely from model weights, they correlate more strongly with shifts in the data’s class distribution than with the weight-space geometry used to estimate them. After class divergence and lag are residualized out, the within-state advantage exceeds its permutation null on both tasks, indicating that the states recover structure relevant to transfer beyond the data distribution. Every effect replicates on both tasks but is attenuated on Yelp, whose label distribution is more temporally stable.

[122] Stage-Replay Divergence Follows the KV Cache: Fixed-Prefix Precision Controls and Bidirectional Cache Transplantation cs.LG | cs.CLPDF

Alexander Boesgaard Lorup

TL;DR: 该论文通过实验验证了在推理阶段边界，KV缓存（Key/Value缓存）是导致阶段重放诊断中轨迹分歧的因果充分载体，而数值精度调节了其行为表达。研究发现，即使不保持实时状态保真度，精确令牌重放也可以是可重复的。

Details

Motivation: 论文旨在审计阶段重放诊断中的一个核心假设：将新鲜前缀填充的继续视为从原始达到前缀的解码器状态的继续。动机是探究在推理阶段边界，KV缓存和数值精度如何影响模型行为的可重复性和分歧。

Result: 在Qwen2.5衍生系统上的实验表明，在BF16精度下，构造差异导致166个后缀和20个正确性标签出现分歧，但准确率差异仅一点（配对95% CI [-3.5, +5.5]）。FP32精度则未产生解码分歧（95% Wilson上界1.88%）。双向移植所有48层KV缓存使得每个测试的分歧继续都跟随其缓存供体，在主要检查点（24/24）和后期检查点（43/43）均得到验证。

Insight: 创新点在于揭示了KV缓存作为轨迹分歧的因果载体角色，并提出了固定前缀精度控制和双向缓存移植方法。从客观角度看，研究强调了在模型推理中，缓存状态管理（而非仅实时状态）和数值精度对行为一致性的关键影响，为可重复性诊断和系统优化提供了新视角。

Abstract: Stage-replay diagnostics reconstruct intermediate token prefixes and treat fresh-prefill continuation as continuation from the decoder state that originally reached the prefix. We audit that assumption at a whole reasoning-stage boundary in a Qwen2.5-derived system. A matched 200-item experiment compares retained live cache with one-shot prefill of identical integer tokens and places an exact replica on both sides. In BF16, replicas remain exact while the constructions differ on 166 suffixes and 20 correctness labels; the accuracy difference is only one point (paired 95% CI [-3.5, +5.5]). A fixed-prefix 2x2 holds all 200 token states constant while crossing construction and precision. The BF16 disagreements recur, whereas FP32 produces no decoded disagreement (95% Wilson upper bound 1.88%). A prospective bridge makes token-by-token incremental and retained live caches bit-exact on 12/12 rows; an all-200 saved-ledger audit reproduces every retained trajectory and comparison fingerprint. Bidirectional transplantation of all 48 key/value layers makes every tested divergent continuation follow its cache donor, both on a selected set at the primary checkpoint (24/24) and an outcome-blind replication at a later checkpoint (43/43). Exact-token replay can therefore be repeatable without preserving live-state fidelity. On the tested states, boundary K/V cache is a causally sufficient carrier of the divergent trajectory, while numerical precision moderates its behavioral expression.

[123] Position, Not Provenance: Separating Reasoning Mediation from Sycophancy in Medical Vision-Language Models cs.LG | cs.CVPDF

Supratik Bhowal, Subhrajyoti Basu, Aritra Gir Mahanta, Anik Pal Chowdhury

TL;DR: 本文提出CoT-Mediate行为框架，用于评估医学视觉语言模型（VLMs）中思维链（CoT）推理是否真正影响预测。通过扰动模型自身生成的推理中的临床属性，并测量预测是否跟随编辑后的推理，该框架结合了双臂协议（比较重新提示证据与前缀强制延续）和来源控制干预，以区分推理中介与迎合行为。在LLaVA-Med和MedGemma模型上对1,000个VQA-RAD样本进行评估，发现前缀强制延续比重新提示产生更高的中介忠实度，而来源分析揭示了模型特定的顺从行为。

Details

Motivation: 医学视觉语言模型在回答临床问题前会生成思维链推理，但这些推理是否因果影响预测尚不明确，需要一种方法来评估推理的中介作用，并区分其与模型迎合行为（sycophancy）的差异。

Result: 在LLaVA-Med和MedGemma模型上使用1,000个VQA-RAD样本进行评估，前缀强制延续方法比重新提示产生更高的中介忠实度；移除视觉证据会增加模型对注入推理的依赖，而侧向性（laterality）是最不忠实跟踪的临床属性；来源分析显示模型具有特定的顺从行为。

Insight: 创新点在于提出CoT-Mediate框架，通过扰动推理属性和控制来源来量化推理中介的忠实度，并揭示上下文位置（而非声明的来源）是医学VLMs使用生成推理的主要决定因素，这为评估模型推理可靠性提供了新方法。

Abstract: Medical vision-language models (VLMs) generate chain-of-thought (CoT) reasoning before answering clinical questions, but whether this reasoning causally influences predictions remains unclear. We present CoT-Mediate, a behavioral framework that perturbs a single clinically meaningful attribute within a model’s own generated reasoning and measures whether the resulting prediction follows the edited reasoning. Our framework combines a dual-arm protocol comparing re-prompted evidence with prefix-forced continuation, together with a provenance-controlled intervention that varies only the attributed source of identical reasoning to disentangle reasoning mediation from sycophancy. We evaluate LLaVA-Med and MedGemma on 1,000 VQA-RAD samples each. Prefix-forced continuation consistently yields higher mediation faithfulness than re-prompting, while the provenance analysis reveals distinct model-specific deference behaviors. Across both models, removing visual evidence increases reliance on injected reasoning, whereas laterality is the least faithfully tracked clinical attribute. These results show that the mechanism used to inject reasoning substantially affects measured faithfulness and that contextual position, rather than stated provenance, is the primary determinant of whether medical VLMs use their generated reasoning.

[124] Understanding Submodular Information Measure Based Objectives for Representation Learning: A Variance and Separation Perspective cs.LG | cs.AI | cs.CVPDF

Rishabh Iyer, Truong Pham, Anay Majee

TL;DR: 本文为子模信息度量（SIMs）在表示学习中的应用提供了一个统一的理论框架，揭示了不同SIM目标与经典表示学习概念（如类内方差、类间分离）之间的几何和统计联系。

Details

Motivation: 尽管子模信息度量在监督对比学习等任务中表现出色，但其诱导的几何和统计特性尚不明确，本文旨在从方差和分离的角度系统理解SIM目标。

Result: 通过控制合成实验（独立改变方差、协方差、类别不平衡、类别分离和多模态重叠），验证了理论预测与经验行为高度一致。

Insight: 创新点在于首次统一解释了不同SIM目标（如Total Information和Mutual Information）如何分别刻画类内结构（方差）和类间结构（分离），为针对特定任务（如处理稀有类别或协方差结构）选择或设计SIM目标提供了原则性指导。

Abstract: Submodular Information Measures (SIMs) have recently emerged as a powerful framework for representation learning and multimodal learning. In particular, the SCORE framework~\cite{majee2024score} demonstrated that SIMs can serve as effective objectives for supervised contrastive learning. Despite their empirical success, however, the geometric and statistical properties induced by different submodular information measures remain poorly understood. In this work, we develop a unified theoretical framework connecting SIMs to classical concepts in representation learning and statistical pattern recognition. We show that Total Information (TI) objectives characterize intra-class structure: Graph Cut TI recovers within-class variance, LogDet TI recovers generalized variance and covariance volume, and Facility Location TI induces imbalance-aware separation that emphasizes rare and confusable classes. We further show that Mutual Information (MI) objectives capture complementary notions of inter-class structure: Graph Cut MI is closely related to centroid separation and Fisher-style discrimination, LogDet MI captures covariance-aware separation through Mahalanobis distance, and Facility Location MI measures nearest-mode representational overlap. We validate these theoretical characterizations using controlled synthetic experiments that independently vary variance, covariance, class imbalance, class separation, and multimodal overlap. Across all settings, the empirical behavior closely matches the proposed theory. Our results provide the first unified geometric and statistical understanding of submodular information measures and offer principled guidance for selecting and designing SIM-based objectives for representation learning.

[125] ODEWorld: A Continuous Predictive Architecture via Physical-Time Flow cs.LG | cs.CV | cs.ROPDF

Dongxiu Liu, Haoyi Niu, Peng Cheng, Yuan Gao, Xirui Kang

TL;DR: 本文提出了物理时间流（PT-Flow）和基于此的连续时间潜在世界模型ODEWorld。该方法通过将序列数据的底层动态建模为在结构化表示空间中的常微分方程（ODE），实现了在压缩潜在空间中的连续时间预测，从而克服了传统离散时间世界模型在捕捉物理世界动态时的低效问题。

Details

Motivation: 现有机器学习世界建模范式大多局限于离散时间预测，难以高效捕捉物理世界连续时空的本质动态，因此需要一种能够进行连续时间预测的架构。

Result: 综合实验表明，ODEWorld在视频生成和机器人控制任务上均表现出色，成功协调了利于规划的动力学抽象与视觉真实感。

Insight: 核心创新在于通过物理时间流学习连续潜在速度场，并将动态参数化为表示空间中的ODE，从而解决了潜在世界模型中长期存在的表示崩溃问题，并实现了任意时间分辨率预测、反向预测以及高质量的长时程图像重建。

Abstract: In the physical world we inhabit, space and time are fundamentally continuous. However, existing machine learning paradigms for world modeling are largely confined to discrete-time prediction, thereby exhibiting significant inefficiency in capturing the dynamics of physical world. We introduce Physical-Time Flow (\textbf{PT-Flow}), a novel approach that learns a continuous latent velocity field operating in physical time. Crucially, the underlying dynamics of sequential data are parameterized by an ordinary differential equation (ODE) embedded in a well-structured representation space. Under this paradigm, the prediction of future can be recast as temporal integration via an ODE solver in the compressed latent space. Building upon PT-Flow, we construct \textbf{ODEWorld}, a continuous-time latent world model that is both efficient and versatile. By extracting time-variant features and enforcing ODE properties on both the dynamical representation space and the latent velocity field, ODEWorld effectively addresses the long-standing representation collapse issue in latent world model literature. This also enables high-quality image reconstruction even after long-horizon prediction. Moreover, its continuous nature allows for arbitrary temporal resolution and even backward prediction, which is impossible for most discrete-time models. Lastly, ODEWorld can provide rich planning-oriented information to facilitate downstream policy learning. Comprehensive experiments demonstrate that ODEWorld successfully reconciles planning-conducive dynamics abstraction with visual realism, excelling in both video generation and robotic control. \href{https://dstate.github.io/odeworld_website/}{Project Website}.

[126] GVR-Coder: A Visual-Feedback Framework for Structured SVG Generation in Complex Document and Meeting Scenarios cs.LG | cs.CVPDF

Yiming Xu, Jihua Kang, Chunsai Du, Qifan Zhang, Wangqiu Zhou

TL;DR: 本文提出GVR-Coder框架，用于从复杂专业文本生成结构化的SVG逻辑图表。为解决数据稀缺、布局混乱和缺乏视觉反馈三大挑战，作者构建了DocMeetSVG-100K数据集，并设计了包含课程驱动微调、双渲染反馈强化学习和生成-验证-修复循环的模型框架。

Details

Motivation: 在专业文档和会议回顾场景中，冗长文本带来高认知负荷，需要将其转换为逻辑清晰的图表以促进高效信息交流。现有文本到SVG生成研究面临复杂逻辑图表数据集稀缺、缺乏明确布局先验导致空间排列混乱，以及缺少细粒度视觉反馈来验证输出和修正美学缺陷三大挑战。

Result: 大量实验表明，GVR-Coder在复杂文档和会议场景的SVG生成任务上，超越了现有基线方法，能够可靠地生成逻辑连贯且视觉美观的图表。

Insight: 创新点包括：1) 针对特定场景构建大规模SVG数据集DocMeetSVG-100K；2) 采用课程驱动拒绝采样微调渐进式提升模型对复杂结构的建模能力，并在训练中显式融入布局约束知识；3) 引入基于双渲染反馈的强化学习，通过奖励信号联合优化结构复杂性和视觉美学；4) 设计了生成-验证-修复的智能体循环，利用显式细粒度反馈进行针对性优化。

Abstract: In demanding professional environments and meeting review scenarios, lengthy text often imposes a high cognitive load. To facilitate efficient information communication, transforming verbose text into logically clear diagrams is essential. Scalable Vector Graphics (SVG) provide an effective representation for this purpose due to their editability and resolution independence. However, current research on Text-to-SVG generation remains hindered by three major challenges: (1) the scarcity of datasets for complex, logic-rich diagrams; (2) the absence of explicit layout priors, which leads to chaotic spatial arrangements; and (3) the lack of fine-grained visual feedback to validate rendered outputs and correct aesthetic defects. To address these challenges, at the data level, we introduce DocMeetSVG-100K, a large-scale SVG dataset tailored for document authoring and meeting review scenarios. At the model level, we propose GVR-Coder, a novel framework designed to generate high-quality logical diagrams from lengthy professional texts. Specifically, we adopt a curriculum-driven rejection sampling fine-tuning to progressively enhance the model’s capability in modeling complex structures, while explicitly incorporating layout constraint knowledge during training. In addition, we introduce reinforcement learning from dual rendering feedback, a mechanism that provides implicit feedback through reward signals to jointly optimize structural complexity and visual aesthetics. Furthermore, we design a generate-verify-repair agent loop, which improves generation quality through explicit, fine-grained feedback and targeted refinement. Extensive experiments demonstrate that GVR-Coder outperforms competitive baselines and reliably produces logically coherent and visually appealing diagrams. Code and data are available at https://github.com/CurryaNa/GVR-Coder.

cs.IR [Back]

[127] MagicSelector: Joint Optimization for Agent Tool Selection via Counterfactual Decomposition and Progressive Reranking cs.IR | cs.AI | cs.CLPDF

HONOR Agentic Search Team, Zhengzong Chen, Lei Tang, Lijun Liu, Chuandi Jiang

TL;DR: MagicSelector是一个联合优化框架，通过反事实任务分解、渐进式重排序和动态Top-K策略，旨在解决智能体工具检索中的核心挑战。该框架能够将模糊的用户指令转化为可执行的原子子任务，并指导高精度工具检索，有效缓解了领域外（OOD）场景中的冗余噪声和上下文干扰。

Details

Motivation: 解决智能体在工具检索中面临的模糊指令理解、领域外场景噪声干扰以及高相似度工具间的细粒度区分难题。

Result: 在专门构建的移动多轮交互任务分解基准MTDTool上评估，MagicSelector在工具检索准确率、OOD泛化能力和整体token效率方面显著优于现有最先进（SOTA）方法。

Insight: 创新点包括：1）利用反事实奖励量化分解对检索排名的边际因果增益，为逻辑连贯性提供细粒度监督；2）通过自蒸馏硬负样本挖掘驱动的渐进式重排序，优化点对点和列表相关性以增强工具区分；3）基于双语义边界感知的动态Top-K策略，自适应截断候选列表以平衡召回与噪声过滤。

Abstract: We present MagicSelector, a joint optimization framework integrating Counterfactual task decomposition, Progressive reranking, and Dynamic Top-K, designed to address the fundamental challenges of tool retrieval in agents. MagicSelector is a specialized framework capable of translating ambiguous user instructions into executable atomic subtasks and guiding high-precision tool retrieval, effectively mitigating redundant noise and severe context distraction in out-of-domain (OOD) scenarios. We empower MagicSelector with these capabilities through three key contributions: (1) a preference-guided counterfactual task decomposition mechanism that utilizes a counterfactual reward to quantify the marginal causal gain of decomposition on retrieval ranking, effectively imposing fine-grained structural supervision on logical coherence; (2) a progressive tool reranking method driven by self-distillation hard negative mining, which optimizes both point-wise and list-wise relevance to enhance fine-grained discrimination among highly similar tools; and (3) a dual semantic boundary-aware dynamic Top-K strategy that adaptively monitors reranking score cliffs and inter-tool semantic shifts to dynamically truncate the candidate list, maximizing relevant tool recall while filtering long-tail noise. Evaluated on MTDTool, the first task decomposition benchmark we constructed tailored for mobile multi-turn interactions with process-level annotations, MagicSelector yields promising performance. Extensive experiments demonstrate that MagicSelector significantly outperforms state-of-the-art methods in terms of tool retrieval accuracy, OOD generalization capability, and overall token efficiency, thereby demonstrating the effectiveness of our proposed framework.

Table of Contents

cs.CL [Back]

[1] Same Facts, Different Diagnosis: Measuring and Mitigating Narrative Anchoring in Clinical Language Models cs.CL | cs.AIPDF

[2] AHA-Memes: A Fine-Grained Multimodal Benchmark for Understanding Hate in Arabic Memes cs.CL | cs.AIPDF

[3] Benchmarking LLM Competence on Logical Inference over Probability Operators cs.CL | cs.AIPDF

[4] Belief Coevolution in a Social Network of Generalist and Specialist Large Language Models cs.CL | cs.MA | cs.SIPDF

[5] Training Skills Like Parameters via Self-Supervised Semantic Diffusion cs.CLPDF

[6] Models for minimalist RAG: B1ade 335M Embedding and 1B Parameter Small Language Models cs.CL | cs.AIPDF

[7] DualAnchor: Preserving Language Priors and Improving Lexical Fidelity in Gloss-Free Sign Language Translation cs.CL | cs.AIPDF

[8] Harness-G: A Graph-Structured Harness for Search Agents cs.CLPDF

[9] From Single- to Cross-Document: Benchmarking Multi-Granularity Event Analysis of Large Language Models cs.CL | cs.AIPDF

[10] Can LVLMs Uncover the Truth Behind Visual Illusions? An Analysis of Perceptual and Reasoning Capabilities cs.CL | cs.AIPDF

[11] Gradient-free Task-Conditioned Retrieval for On-Device In-Context Learning cs.CL | cs.IR | cs.LGPDF

[12] Reasoning Consensus: Structural Ensembling of LLM Reasoning via Weighted DAG Aggregation cs.CL | cs.AI | cs.LGPDF

[13] Semantic-Aligned Structural Abstraction for Multimodal Sentiment Analysis cs.CL | cs.AIPDF

[14] AutoSupervision: Closing the Feedback Loop in Scientific Workflows with Grounded Revision Verification cs.CL | cs.AIPDF

[15] Memory Decoder at Scale: A Pretrained, Parametric Long-Term Memory cs.CLPDF

[16] LEEPS: Latent-Guided Explore-Exploit Prompt Sampling for Efficient RLVR in Large Language Models cs.CLPDF

[17] FinSMART: Financial Sentiment Analysis for Algorithmic Trading through Market-Aligned Reinforcement Learning cs.CL | cs.LG | q-fin.ST | q-fin.TRPDF

[18] Can Agents Deceive? Evaluating Reasoning and Deception in ParliamentBench using a Social Deduction Game cs.CL | cs.AIPDF

[19] RRM: Experience-Driven Reflective Retrieval Memory for Long-Horizon Multimodal Reasoning cs.CLPDF

[20] Where and When to Commit: Candidate-Aware Decoding for Diffusion Language Models cs.CL | cs.AIPDF

[21] Understanding Is Done Early: A Depth Division of Labor in Large Language Models and Its Use for Unbounded-Context Memory cs.CLPDF

[22] Fairness Pruning: Locating Demographic Bias in GLU-MLP Layers via Differential Activations cs.CL | cs.CY | cs.LGPDF

[23] Lightning OPD 2.0: Mitigating Style Bias in Cross-Teacher On-Policy Distillation for Large Reasoning Models cs.CLPDF

[24] Generative AI and linguistic diversity in academic writing and publishing: Perspectives from World Englishes cs.CLPDF

[25] Would You Walk to the Car Wash? Revealing the Salience Bias of Large Language Models in Commonsense Reasoning cs.CLPDF

[26] AI systems and the reproduction of (standard) language ideologies in World Englishes cs.CLPDF

[27] ORCA-bench: How Ready Are Language Model Agents for Oncall? cs.CL | cs.AI | cs.SEPDF

[28] Inducing language models to assert their own consciousness restores human beliefs and values cs.CLPDF

cs.CV [Back]

[29] Bunraku: Turning a Single Illustration into an Editable Live2D Character cs.CVPDF

[30] OVEarth-Bench: Evaluating Category Breadth and Query Diversity for Open-Vocabulary Earth Observation cs.CVPDF

[31] PanDent: Toward Comprehensive Tooth-Level Structure-Language Consistency in Dental Radiology cs.CV | cs.MMPDF

[32] VideoCoCo: Code-as-CoT for Physically-Consistent Video Generation via an Agentic Dual-Engine System cs.CV | cs.AIPDF

[33] Inference-Time Agentic Decision Rules Beat Longer Evolving Search for Multi-Image Medical Reasoning cs.CVPDF

[34] MeshFM: 2D Features Are All You Need for 3D Shape Understanding cs.CV | cs.GRPDF

[35] Objective-Aligned Direct Answer SFT for Robust Multi-Frame Medical VQA cs.CVPDF

[36] 4DHumanDiff: Direct Text-to-4DGS Generation for Consistent 360-Degree Dynamic Humans cs.CVPDF

[37] BlindPSNR: A No-Reference Fidelity Predictor for Low-Light Image Enhancement cs.CVPDF

[38] MPIE-Bench: Benchmarking Anatomically Plausible Multi-Person Interaction Editing cs.CVPDF

[39] MMOOC: A Comprehensive Benchmark for Out-of-Context Evaluation in Multimodal Large Language Models cs.CVPDF

[40] Witness Evidence Portfolios: Single-Prefill Risk Detection for Closed Multimodal Answers cs.CVPDF

[41] JigShape: Evaluating Visual-Geometric Reasoning in VLMs through Jigsaw Puzzles cs.CV | cs.AIPDF

[42] RefineSVG: Visual Feedback-Driven Reinforcement Learning for Image-to-SVG Generation cs.CV | cs.AIPDF

[43] Articulated Object Reconstruction from Rest-State Observation cs.CV | cs.ROPDF

[44] Calibrate Before Reason: Robust Visual Token Reduction against Semantic Drift in VLMs cs.CVPDF

[45] Private Face Recognition Training Dataset Publication via Identity-Decoupled and Geometry-Preserving Face Distillation cs.CV | cs.AIPDF

[46] CXR-Retrieve: Compositional Text-to-Image Retrieval in Chest Radiography cs.CVPDF

[47] LoMeVQA: A Comprehensive Benchmark for Longitudinal Medical VQA cs.CVPDF

[48] Hallucinations Leave a Grounding Signature:Verifier-Guided Decoding for Selective Object Correction cs.CVPDF

[49] SAFViT: Spatial Attention Fusion Gating for Vision Transformer-Based Nucleus Segmentation and Classification cs.CV | cs.AIPDF

[50] Thinking Once Is Enough: Intermediate-Layer Evidence Routing for High-Resolution VQA cs.CVPDF

[51] FeatFix: Reuse What You Verify through Local Exact-Feature Correction for Faster Cached Diffusion Inference cs.CV | cs.LGPDF

[52] VCP-DCN: Beyond Visual Concealed Property via Depth Collaborative Network for Camouflaged Object Detection cs.CVPDF

[53] Benchmarking Foundation and Large Language Models for Few-Shot Medical Image Segmentation cs.CVPDF

[54] Unifying Adversarially Robust Model Experts in Vision-Language Models cs.CVPDF

[55] One Patch Is Enough: Reinforcement-Optimized Visual Token Grounding for MLLM-Based Scene Text Spotting cs.CVPDF

[56] LAST: The Last Query Token Guides Visual Token Pruning for Edge-Cloud Collaborative MLLM Inference cs.CV | cs.AIPDF

[57] FiRE: Enhancing MLLMs with Fine-Grained Context Learning for Complex Image Retrieval cs.CV | cs.IRPDF

[58] Deep learning-based hierarchical insect classification using camera trap imagery cs.CVPDF

[59] ENCORE: Event-Assisted Complementary Motion Refinement for Learned Video Compression cs.CVPDF

[60] Beyond Classification: Pathology Foundation Models as Detection Encoders for Mitotic Figures cs.CV | cs.AIPDF

[61] TongueReenact: Geometry-Anchored Tongue Synthesis for Face Reenactment cs.CVPDF

[62] Temporal Concentration from Rollout Errors: Implicit Preference Optimization for Text-to-Video Diffusion cs.CVPDF

[63] BladeYOLO: Wind Turbine Blade Defect Detection with Limited Annotations and Weak-Saliency Awareness cs.CVPDF

[64] Face and Voice Cross-modal Association with Learning Convex Feature Embedding cs.CV | cs.IRPDF

[65] Collaborative Feature Aggregation for Face Super-Resolution and Robust Re-Identification cs.CVPDF

[66] OPLD: On-Policy Latent Distillation for Multimodal Reasoning cs.CV | cs.AIPDF

[67] Think with Extra-Image: A Farmland Segmentation Agent Driven by Spatio-Temporal Information Gain cs.CVPDF

[68] Scaling Vision-Language Models Is Not Enough to Mitigate Bias cs.CVPDF

[69] FaithEyes: Towards Faithful Tool Use via Multi-Agent Process-Image Verification cs.CVPDF

[70] EgoGenesis: Egocentric World-Action Modeling with Online Anchored Projective Memory and Action-3D RoPE cs.CV | cs.AIPDF

[71] Space2Ground 2.0: A Multi-Source Dataset and Framework for Agricultural Monitoring through Fusion of Street-Level and Satellite Imagery cs.CVPDF

[72] TARS: Timestep-Aware Data Scaling for 3D-Free Video Re-Shooting cs.CVPDF

[73] Beyond Visual Ambiguity: Guiding Robust Monocular Depth Estimation in Challenging Scenarios via Detailed Long Captions cs.CVPDF

[74] Theia: Large-Scale Multimodal Captioning and Automated Validation of the Incidents1M Dataset for Data-Free Distillation cs.CV | cs.AI | cs.MMPDF

[75] MonoVoc: Decoupling Geometry and Semantics for Lightweight Monocular Open-Vocabulary 3D Gaussians cs.CV | cs.AIPDF

[76] AdaAnchor4D: Anchor-Conditioned Spatiotemporal Feature Aggregation for Monocular UAV 4D Reconstruction cs.CVPDF

[77] Capturing Token Tendencies for Training-Free Token Pruning in Multimodal Large Language Models cs.CVPDF