cs.CL [Total: 53]
cs.CV [Total: 63]
q-fin.ST [Total: 1]
cond-mat.mtrl-sci [Total: 1]
cs.MM [Total: 1]
cs.SE [Total: 2]
cs.GR [Total: 1]
cs.CY [Total: 1]
cs.NE [Total: 1]
cs.SD [Total: 2]
cs.MA [Total: 1]
cs.RO [Total: 5]
cs.LG [Total: 3]
cs.AI [Total: 11]

cs.CL [Back]

[1] Recipes for Steering and Scaling LLMs via Sampling cs.CL | cs.LGPDF

Jiajun He, Zongyu Guo, José Miguel Hernández-Lobato, Yuanqi Du

TL;DR: 本文提出了一种基于采样的灵活且理论基础的框架，用于引导和扩展自回归大语言模型（LLMs）的生成。该框架包含两种算法：基于序贯蒙特卡洛（SMC）和基于副本交换（RE）的方法，旨在引导生成朝向基础模型分布的幂次、乘积或倾斜。实验表明，该方法在无需外部监督或奖励模型的情况下，比Best-of-N和标准MCMC基线更有效地提升了LLMs的生成质量。

Details

Motivation: 当前LLMs作为概率模型，其采样策略在超越基础模型的更丰富目标分布上效率低下，本文旨在解决这一问题，提供一种系统化的概率推理方法。

Result: 实验结果显示，所提方法在扩展LLMs生成质量方面优于Best-of-N和标准MCMC基线，实现了更有利的扩展效果。

Insight: 创新点在于提出了一个统一的采样框架，通过SMC和RE算法灵活地引导LLMs生成，无需依赖外部监督，为LLMs的概率推理提供了系统化方案。

Abstract: Large Language Models (LLMs) are probabilistic models, typically defined by an autoregressive factorization. While recent work has begun to study richer target distributions beyond the base model, the sampling strategies remain highly inefficient. In this paper, we present a flexible and theoretically grounded framework for steering and scaling autoregressive LLMs with sampling. Within this framework, we describe two algorithms – one based on Sequential Monte Carlo (SMC) and one based on Replica Exchange (RE) – that steer generation toward powering, product or tilting of the base model distribution. We illustrate this framework through scaling the generation quality of LLMs without external supervision or reward models. Experimental results demonstrate our methods scale more favorably than Best-of-N and standard MCMC baselines. Overall, this paper offers a systematic recipe for probabilistic inference with LLMs via sampling.

[2] Training-Time Explainability for Multilingual Hate Speech Detection: Aligning Model Reasoning with Human Rationales cs.CL | cs.AIPDF

Muhammad Deedahwar Mazhar Qureshi, Sannaan Khan, Muhammad Atif Qureshi, Wael Rashwan

TL;DR: 本文提出了一种训练时可解释性框架，通过将模型推理与人工标注的理性依据对齐，旨在提升多语言仇恨言论检测的分类性能和可解释性。该方法在英语数据集HateXplain和印地语-英语混合数据集BullySent上进行了评估，重点关注反穆斯林仇恨言论的检测。

Details

Motivation: 在线仇恨言论常以文化编码的多语言形式出现，传统AI审核系统虽准确但缺乏透明度，易产生偏见、过度审查或审核不足，尤其当脱离社会文化背景时问题更突出。

Result: 实验表明，基于梯度和注意力的正则化方法提高了F1分数，增强了解释的合理性和忠实度，并能捕捉检测隐性反穆斯林仇恨的文化特定线索，在HateXplain和BullySent数据集上实现了性能提升。

Insight: 创新点在于将可解释性融入训练过程，通过正则化使模型推理与人类理性依据对齐，这为开发多语言、文化感知的内容审核系统提供了一条路径，同时提升了模型的可信度和实用性。

Abstract: Online hate against Muslim communities often appears in culturally coded, multilingual forms that evade conventional AI moderation. Such systems, though accurate, remain opaque and risk bias, over-censorship, or under-moderation, particularly when detached from sociocultural context. We propose a \emph{training-time} explainability framework that aligns model reasoning with human-annotated rationales, improving both classification performance and interpretability. Our approach is evaluated on HateXplain (English) and BullySent (Hinglish), reflecting the prevalence of anti-Muslim hate across both languages. Using LIME, Integrated Gradients, Grad X Input, and attention, we assess accuracy, explanation quality, and cross-method agreement. Results show that gradient- and attention-based regularization improve F-scores, enhance plausibility and faithfulness, and capture culturally specific cues for detecting implicit anti-Muslim hate, offering a path toward multilingual, culturally aware content moderation.

[3] TelecomGPT-R1: A Unified Open-Source Reasoner for the Telecom Stack cs.CL | cs.ITPDF

Bohao Wang, Chenwei Wu, Haoyu Li, Hang Zou, Yu Tian

TL;DR: 本文介绍了TelecomGPT-R1-9B，一个统一的、开源的电信领域推理模型，旨在解决通用推理模型缺乏电信领域知识而专用电信大语言模型在结构化多步推理方面能力有限的双重瓶颈。该模型基于Qwen3.5-9B，通过构建一个包含67,427个样本、围绕协议、知识、建模和故障四个互补推理轴组织的监督微调语料库，并采用两阶段后训练方法（多教师LoRA微调和GRPO优化）开发而成。

Details

Motivation: 当前大语言模型在电信领域的应用存在瓶颈：通用推理模型缺乏电信领域的具体知识，而专用的电信大语言模型在结构化、多步骤的推理能力上又有限。本文旨在弥合这一能力差距，为电信工程工作流提供一个统一的推理模型。

Result: 在GSMA开放电信排行榜上，TelecomGPT-R1-9B在开源电信大语言模型中排名第一，并且在七个公开电信基准测试中，其七个轴的平均性能与最先进的闭源前沿推理模型相当。

Insight: 创新点在于构建了一个围绕四个互补推理轴（协议、知识、建模、故障）组织的、经过特定思维链生成和前缀延续自验证增强的SFT语料库，并设计了一个结合多教师LoRA微调和基于GRPO（辅以解耦裁剪和动态采样策略优化）的两阶段后训练方法，以同时注入领域知识和优化推理策略。

Abstract: Telecommunications is a high-leverage domain for large language model (LLM)-based reasoning because routine engineering workflows require joint grounding in normative specifications, operational telemetry, vendor-specific fault evidence, and exact RF/network calculations. However, current LLM integration in telecom remains bottlenecked by a two-sided capability gap: generic reasoners often lack telecom-specific grounding, while domain-specific telecom LLMs remain limited in structured, multi-step reasoning. To bridge this gap, we release TelecomGPT-R1-9B, a unified open-source telecom reasoner that ranks top-performing on the GSMA open telco leaderboard. Specifically, we curate a 67,427-example supervised fine-tuning (SFT) corpus organized around four complementary reasoning axes: protocol, knowledge, modeling, and fault. The corpus is built from axis-matched public web sources and enhanced through axis-specific chain-of-thought (CoT) generation and prefix-continuation self-validation. Starting from Qwen3.5-9B, we further develop a two-stage post-training recipe. First, multi-teacher low-rank adaptation (LoRA)-based SFT injects telecom knowledge and induces axis-specific reasoning formats. Second, group relative policy optimization (GRPO), stabilized by decoupled clip and dynamic sampling policy optimization (DAPO), optimizes the policy using four axis-aligned binary verifier rewards. Across seven public telecom benchmarks, TelecomGPT-R1-9B ranks first among open-source telecom LLMs and achieves a seven-axis mean comparable to state-of-the-art closed-source frontier reasoners.

[4] Reward-Informed Sparse Autoencoders and the Solution-Completeness Confound cs.CLPDF

Tanvi Nagilla, Alexander Jameson, Daniel Manta, Shayaan Uddin

TL;DR: 该论文提出了一种奖励信息稀疏自编码器（RI-SAE），通过利用强化学习产生的奖励信号来分解语言模型激活，旨在识别与推理相关的特征。研究发现，RI-SAE虽然能有效区分高奖励和低奖励的推理延续，但这种区分主要捕捉的是解决方案的完整性（如答案格式、长度等结构线索），而非纯粹的推理质量。

Details

Motivation: 动机是利用强化学习已有的奖励信号来指导稀疏自编码器的训练，从而从语言模型激活中提取可解释的、与推理相关的稀疏特征，以增强对模型内部表示的理解。

Result: 在Llama-3.1-8B模型上，RI-SAE从16,384个特征中选出的稀疏子集能有效区分高/低奖励类别（轮廓系数0.79 vs. 全编码的0.005），但控制实验表明这种区分主要源于解决方案完整性（如文本长度、答案框等结构线索），而非推理质量；未使用奖励信号的通用SAE则完全无法区分类别（轮廓系数0.01）。

Insight: 创新点在于提出了一种利用奖励信号进行无标签数据筛选以提升可解释性的方法，但揭示了奖励过滤可能主要捕获形式特征而非本质推理结构的局限性；同时，该方法仍能识别出少量可读的判别性特征（如符号数学和过程性语言），为后续研究提供了参考。

Abstract: Sparse autoencoders (SAEs) decompose language-model activations into sparse, interpretable features, and an appealing way to aim them at reasoning is to curate their data with a signal reinforcement learning already produces: the reward. We build such a reward-informed SAE (RI-SAE): we split GRPO trajectories into high-reward (“good”) and low-reward (“bad”) reasoning continuations, train a standard JumpReLU SAE on their activations, and then ask what the resulting good/bad separation actually measures. On Llama-3.1-8B a sparse subset of the 16,384 features does separate the classes (silhouette 0.79 on the selected features versus 0.005 for the full code), but a control battery shows the separation is largely solution completeness rather than reasoning quality: a TF-IDF text classifier already splits the classes (AUC 0.75–0.83), and three structural cues alone (length, a closed reasoning block, and a boxed answer) reach AUC 0.70 (99% of good versus 69% of bad completions are boxed). A generic SAE that never saw the reward does not separate the classes at all (silhouette 0.01, no discriminative features), so the 0.79 is in-sample fitting of this curated signal rather than structure that a reward-blind dictionary recovers. We therefore present the recipe and its control battery together: reward filtering is a cheap, label-free way to reuse RL signals for interpretability, but most of what it surfaces is completion form. Two discriminative features are still readable (symbolic mathematics; procedural and evaluative language), which we take as illustrative rather than as isolated reasoning.

[5] Syntax vs. Semantics: How Transformers Learn Deep Dependencies cs.CL | cs.AIPDF

Jiangrui Zhao, Xiaoting Du

TL;DR: 本文提出了一种机制性框架，将大语言模型学习深层语义依赖的过程建模为表面统计与深层语义之间的竞争。理论分析揭示了“梯度饥饿”现象，即稀疏语义依赖的误差信号在早期优化中被抑制，导致结构推理能力以突变的相变形式涌现。该框架为思维链策略的有效性提供了机制解释，并通过实验验证了理论发现，最终提出了一种拓扑对齐的对比目标，在变量绑定任务上取得了超过标准交叉熵微调2倍以上的性能提升。

Details

Motivation: 尽管大语言模型展现出卓越的句法流畅性，但其学习深层语义依赖的优化动力学机制尚不明确。本文旨在理解并建模这一学习过程，特别是探索模型如何克服表面统计的干扰来掌握稀疏的、结构化的语义关系。

Result: 理论分析和实验验证覆盖了从玩具Transformer到生产级模型（如Llama-3.1-8B、Qwen2.5-Coder-7B）的不同规模。在变量绑定任务上，提出的拓扑对齐对比目标相比标准交叉熵微调，取得了超过2倍的性能提升。

Insight: 核心创新点是识别并理论化了“梯度饥饿”现象，为深层语义依赖学习的困难提供了机制性解释。这为思维链策略的有效性（通过外化中间推理步骤来绕过梯度抑制）提供了理论依据，并启发了通过显式修正梯度几何（如对比目标）来改进模型学习深层依赖的新方法。

Abstract: Large Language Models demonstrate remarkable syntactic fluency, yet the optimization dynamics governing their acquisition of deep semantic dependencies remain poorly understood. We propose a mechanistic framework that models this learning process as a competition between Surface Statistics and Deep Semantics. Our theoretical analysis identifies a ``Gradient Starvation” phenomenon where the error signals for sparse semantic dependencies are actively suppressed during early optimization. This suppression impedes the learning of structural reasoning and causes its emergence to manifest as a sudden phase transition. Furthermore, this framework offers a mechanistic basis for the effectiveness of Chain-of-Thought (CoT) strategies. By externalizing intermediate reasoning steps into concrete tokens, CoT effectively bypasses the suppression regime inherent to implicit reasoning. We validate these findings across scales ranging from toy transformers to production models (Llama-3.1-8B, Qwen2.5-Coder-7B). Finally, guided by this theory, we propose a topology-aligned contrastive objective that explicitly rectifies the gradient geometry. Experiments on variable binding tasks demonstrate that our method achieves an improvement that is over 2x larger than that obtained via standard cross-entropy fine-tuning.

[6] Beyond Accuracy: A Qualitative Analysis of Vision-Language Models for Hate Speech Detection in Memes cs.CL | cs.AIPDF

Muhammad Jawad Chowdhury, Adiba Hasan, Ishrak Hossain, Shahriar Ivan, Sabbir Ahmed

TL;DR: 本文对四种先进视觉语言模型（LLaVA-7B、Qwen-VL、GPT-4o mini和Claude 3 Haiku）在仇恨言论检测任务上进行了定性分析，超越了简单的分类准确率评估，重点关注模型在零样本和少样本提示下生成的理由及其思维过程。

Details

Motivation: 网络模因是传播仇恨言论的强有力媒介，但其复杂性和语境依赖性使得检测非常困难；现有的视觉语言模型在多模态任务上表现优异，但往往忽略语境、反讽等细微线索，因此需要深入评估其实际理解能力。

Result: 研究在仇恨言论检测任务上对四种SOTA模型进行了评估，通过零样本和少样本提示分析上下文框架如何影响模型输出，但摘要未提及具体的定量结果或基准测试排名。

Insight: 创新点在于超越传统准确率指标，对模型生成的理由进行定性分析，以深入理解其处理仇恨模因时的思维过程和局限性；这为评估多模态模型的语境理解能力提供了新的方法论视角。

Abstract: Memes have turned out to be a powerful tool through which individuals share their ideas concerning contemporary social and political problems. Their anonymity, as well as their ability to go viral, make them a powerful medium for spreading hate. It remains very difficult to identify such complex and context-dependent hate speech. Although they display excellent performance on multimodal tasks, vision-language models (VLMs) tend to ignore context, irony, and other subtle cues that play a key role in identifying hateful memes. In this work, we present a qualitative analysis of four state-of-the-art VLMs: LLaVA-7B, Qwen-VL, GPT-4o mini, and Claude 3 Haiku. We evaluate these models under zero-shot and few-shot prompting to examine how contextual framing influences their outputs. Our analysis goes beyond simple classification accuracy and focuses on a qualitative evaluation of the models’ generated justifications, providing a more in-depth understanding of their thought processes and constraints when dealing with hateful memes.

[7] AdaThinking-E: One-Token Entropy Regulation for Adaptive Thinking cs.CL | cs.LGPDF

Zining Wang, Tongkun Guan, Boming Chen, Zhentao Guo, Jianqiang Liu

TL;DR: 本文提出AdaThinking-E，一种基于单令牌熵调控的强化学习框架，用于实现多模态大语言模型的自适应推理。该方法通过分析关键决策令牌的概率分布熵值，量化模型对是否启动深度推理的信心，从而让模型能够根据问题复杂度智能决定是否进行深度思考。

Details

Motivation: 当前多模态大语言模型在处理文档任务时，无论问题简单与否都统一进行深度推理，这导致了不必要的计算开销，不仅影响用户体验，还可能降低基准数据集上的准确率。因此，需要一种自适应机制来智能判断何时需要进行推理。

Result: 广泛的实验表明，该方法使模型能够在多种文档任务上，既在复杂问题上保持高准确率，又在简单问题上实现高效率。

Insight: 核心创新在于利用单令牌的熵值来量化模型决策信心，并以此设计熵调控的奖励机制，使训练过程能够从高熵探索自然过渡到低熵收敛，从而让模型无需人工干预或外部难度标签，就能内在地发现何时需要进行思考。

Abstract: Multimodal large language models have demonstrated strong document reasoning capabilities by incorporating explicit thinking processes. While this capability significantly improves performance on challenging tasks, current models apply such deep reasoning uniformly to all questions, resulting in unnecessary computational overhead for simple task. This not only degrades user experience but also negatively impact accuracy on benchmark datasets. We identify the critical need for adaptive thinking mechanisms that can intelligently determine when to engage reasoning based on question complexity. To address this, we propose AdaThinking-E, a novel reinforcement learning framework that learns adaptive thinking through one-token entropy regulation. Our key insight is that model confidence in the decision to engage thinking (or not) can be quantified through entropy analysis of the predicted probability distribution at critical decision tokens. This observation motivates our entropy-governed reward mechanism: the training process naturally transitions from high-entropy exploration, where the model experiments with different thinking strategies, to low-entropy convergence with confident, generalizable decision-making policies. Crucially, this approach enables models to intrinsically discover when to think without requiring manual intervention or external difficulty labels. Extensive experiments demonstrate that our approach enables models to be both accurate on complex problems and efficient on simple ones across diverse document tasks.

[8] Position Is All You Need: A Free Lunch Token Compression Strategy for MLLM-based Referring Expression Segmentation cs.CL | cs.AIPDF

Yuhan Liu, Yixiong Zou, Yuhua Li, Ruixuan Li

TL;DR: 本文针对基于多模态大语言模型（MLLM）的指代表达式分割（RES）任务中计算开销过大的问题，提出了一种名为PAYN的即插即用、无需训练的令牌压缩方法。该方法的核心发现是，在RES任务中，视觉令牌的位置信息比内容信息更为关键，因此PAYN仅依据位置信息来选择和压缩令牌，通过保留每个局部邻域内分布良好的令牌并严格保持其原始位置索引来维持空间关系一致性。

Details

Motivation: 尽管MLLM显著提升了RES性能，但其巨大的计算开销成为关键瓶颈，而现有令牌压缩方法在该任务上会导致性能显著下降，因此需要探究其原因并设计有效的压缩策略。

Result: 在多个RES基准测试上的实验表明，PAYN方法优于现有的令牌压缩方法，验证了在基于MLLM的RES任务中，位置信息对于令牌压缩是充分且有效的。

Insight: 论文的创新点在于揭示了RES任务中视觉令牌位置信息的极端重要性，并据此设计了一种纯粹基于位置信息、无需训练的高效令牌压缩策略（PAYN），为MLLM的高效部署提供了新思路。

Abstract: Referring Expression Segmentation (RES) aims to generate pixel-wise segmentation masks from complex and implicit textual queries. While recent advances in Multimodal Large Language Models (MLLMs) have substantially boosted RES performance, their prohibitive computational overhead remains a critical bottleneck, which, however, is rarely explored. To fill this gap, we first evaluate typical token compression methods on this task and observe a surprising performance degradation. In this paper, we aim to understand this phenomenon for a solution. By extensive experiments, we find that token compression for RES requires preserving the original position embeddings and local neighboring spatial structures, indicating that visual token position information is far more critical than in other tasks. Building on this insight, we ask: Can we design the token compression method purely based on the position information? Therefore, we propose PAYN, a plug-and-play, training-free token compression method that relies solely on position information. PAYN retains tokens that are adequately distributed in every local neighboring region while strictly preserving original positional indices, thereby maintaining spatial relational consistency. Experiments on multiple RES benchmarks demonstrate that our method outperforms existing token compression methods, verifying that position is indeed all you need for token compression in the MLLM-based RES task. Codes are avaliable at https://github.com/YuhanLiu231/PAYN.

[9] Why Current XAI Is Not Enough for Arabic NLP: A Critical Survey of the Explainability Gap cs.CLPDF

Salima Lamsiyah, Ruslan Mitkov

TL;DR: 本文是一篇关于阿拉伯语自然语言处理（NLP）中可解释人工智能（XAI）现状的批判性综述。文章指出，当前阿拉伯语XAI存在方法、任务和语言三个层面的解释性差距，并提出了一个分类法和未来研究方向。

Details

Motivation: 论文的动机是揭示并批判性地分析当前阿拉伯语NLP领域在模型可解释性方面存在的严重不足，强调需要超越通用方法，提供真正符合阿拉伯语语言、文化和社会技术特性的解释。

Result: 作为一篇综述性论文，本文未提出具体模型或定量结果，而是通过系统性地梳理现有文献，构建了一个涵盖任务、方法、语言单位、变体、目标和评估实践的分类法，并指出了当前研究的局限性。

Insight: 论文的核心创新点在于首次系统性地识别并定义了阿拉伯语XAI特有的三大“解释性差距”，并主张将XAI研究从通用的“模型决策解释”转向“忠实于阿拉伯语语言文化特性的解释”，为未来研究提供了清晰的理论框架和议程。

Abstract: Explainable AI (XAI) is now a major theme in NLP; however, Arabic NLP remains under-explained in three connected senses. First, there is a method gap: Arabic XAI relies heavily on a small set of post-hoc techniques such as LIME, SHAP, attention visualization, and saliency, while broader NLP XAI offers richer diagnostic, counterfactual, probing, rationale-based, and human-centered methods. Second, there is a task gap: existing Arabic XAI work is concentrated in classification tasks, especially sentiment analysis, hate/offensive language detection, fake news, and spam, with weaker coverage of generation, retrieval, translation, summarization, structured prediction, and dialogue. Third, there is a linguistic gap: many explanations identify influential tokens, but rarely explain Arabic-specific phenomena such as morphology, clitics, dialectal variation, diglossia, orthographic ambiguity, diacritics, code-switching, named entities, cultural references, or Classical and religious registers. This critical structured survey synthesizes the reviewed literature on Arabic XAI across text, speech, and multimodal settings. We argue that Arabic NLP does not only need explanations of model decisions; it needs explanations that are faithful to Arabic as a linguistic, cultural, and sociotechnical object. We introduce a taxonomy of tasks, methods, linguistic units, varieties, goals, and evaluation practices, and propose a research agenda for linguistically grounded Arabic XAI.

[10] Vagdhenu: A Vrutta (Meter) Aware Shloka-to-Chant (TTS) System for Sanskrit cs.CLPDF

Prathosh A P

TL;DR: 本文介绍了Vagdhenu，一个面向梵语的、基于韵律感知的偈颂吟诵文本转语音系统。该系统并非提出新架构，而是基于现成的流匹配TTS主干网络和大规模神经声码器，通过构建专门的前端处理流程（包括通过卡纳达文字转写避免印地语式schwa删除、处理梵语特有的音系学特征）以及韵律感知机制（检测韵律并选取匹配的参考音频），实现了高保真度的梵语偈颂吟诵生成。

Details

Motivation: 解决梵语偈颂（shloka）高保真吟诵（chant）生成的特定需求，特别是处理梵语复杂的音系学特征（如连音变化、送气对比、齿音/卷舌音/腭音擦音区分）以及韵律（vrutta）的准确匹配，避免现有印度语言模型因天城文转写导致的错误发音。

Result: 系统在专家平均意见得分（MOS）上达到约4.6的高分，成功超越了StyleTTS2、VITS2、Matcha-TTS等先前TTS模型在连音或韵律处理上的性能瓶颈。已部署应用于包含5183偈颂（约17.5小时）的视频语料库和覆盖约18000偈颂的音频应用。

Insight: 创新点在于为特定语言（梵语）和领域（偈颂吟诵）定制TTS流水线，而非架构创新，包括：1) 通过卡纳达文字转写规避天城文触发的错误发音规则；2) 精细处理梵语特有音系；3) 韵律感知的参考音频匹配机制；4) 发现并验证在流匹配主干中，文本侧韵律调节器因梯度问题无效，而参考音频和声音导向重训练是有效的韵律控制手段。

Abstract: We present Vagdhenu, a vrutta (meter) aware shloka-to-chant system for Sanskrit: a text-to-speech system that maps a metrical verse to its chanted parayana recitation at high fidelity. This is an experience report, not a new architecture. We take an off-the-shelf flow-matching TTS backbone and a large-scale neural vocoder, and add the components a faithful Sanskrit chant pipeline needs: a frontend that routes Sanskrit through Kannada orthography to avoid the Hindi-style schwa deletion that Devanagari triggers in Indic models; a frontend that obeys subtle Sanskrit phonology (visarga sandhi with its jihvamuliya and upadhmaniya allophones, the aspiration contrast of alpaprana and mahaprana, and the dental, retroflex, and palatal sibilants kept distinct); and a vrutta-aware mechanism that detects the meter and picks an exactly matched reference under a half-reference rule. We report a negative result that shaped the system: in a self-infilling flow-matching backbone, a text-side prosody conditioner is architecturally inert, because the model recovers pitch from the context mel and the embedding gets no gradient; the reference clip and a voice-steering retrain are the only working prosody levers. We also report a comparative lineage across four families (StyleTTS2, VITS2, Matcha-TTS, and the flow-matching backbone), where each earlier family hit a ceiling on conjuncts or prosody that a five-hour clone cleared at an expert MOS near 4.6. The system shipped two deployments: a 32-chapter, 5183-verse video corpus (about 17.5 hours) and an audio app covering about 18000 verses across 12 books. We release the frontend, inference and training code, weights, a single-speaker chant dataset, and an interactive demo.

[11] CARE: Causally-Aligned Reasoning Exploration for Medical Large Language Models cs.CL | cs.CVPDF

Yucheng Zhou, Peng Luo, Qianning Wang, Chengzhong Xu, Jianbing Shen

TL;DR: 本文提出CARE（因果对齐推理探索）框架，旨在解决医学大语言模型在强化学习中因自回归信用分配失败和梯度方差爆炸导致的‘答案正确但推理错误’问题。该框架通过因果充分性和近端可学习性两个条件筛选高质量训练轨迹，并采用双流目标优化，在多个医学多模态和纯文本基准测试中显著提升模型性能。

Details

Motivation: 医学大语言模型的发展受限于专家标注数据的稀缺和成本，而标准基于结果的强化学习方法在医学领域容易陷入‘答案正确但推理错误’的陷阱，即模型强化了虚假关联而非有效的临床推理。

Result: 在多样化的医学多模态和纯文本基准测试中，CARE框架一致优于其他强竞争对手，显著减少了正确但不一致的推理，并提高了训练稳定性。

Insight: 创新点包括：1）引入因果充分性条件，利用基于一致性的自验证机制模拟do-演算干预以去偏梯度；2）提出近端可学习性条件，通过动态熵界选择模型近端发展区内的经验以实现方差有界优化；3）采用结合策略上组相对探索和难度加权经验回放的双流目标进行优化。

Abstract: Large Language Models (LLMs) have shown strong potential for medical reasoning, yet the scarcity and cost of expert-annotated data constrain their progress. While reinforcement learning offers a scalable alternative, standard outcome-based methods in medicine often suffer from autoregressive credit assignment failure and gradient variance explosion. This leads to the “Right Answer, Wrong Reason” trap, where models inadvertently reinforce spurious correlations and dataset shortcuts rather than valid clinical deduction. In this work, we propose Causally-Aligned Reasoning Exploration (CARE), a theoretically grounded framework for intrinsic experience curation. CARE is built upon two rigorous conditions for high-quality training trajectories: Causal Sufficiency, which utilizes an agreement-based self-verification mechanism to mimic $do$-calculus interventions and effectively debias gradients; and Proximal Learnability, which employs dynamic entropy bounds to select experiences within the model’s zone of proximal development for variance-bounded optimization. These rigorously filtered experiences are optimized via a dual-stream objective that combines on-policy group-relative exploration with difficulty-weighted experience replay. Extensive experiments on diverse medical multimodal and text-only benchmarks demonstrate that CARE consistently outperforms other strong competitors, substantially reducing correct-but-inconsistent reasoning and improving training stability.

[12] Towards Interpretable Depression Detection: Linking Acoustic Features to DSM-5 Indicators cs.CL | cs.SD | eess.ASPDF

Jonas Länzlinger, Katharina O. E. Müller, Burkhard Stiller, Bruno Rodrigues

TL;DR: 本文提出了一种可解释的抑郁症检测方法，通过一个透明的关联框架将语音声学特征（如音高变异性、停顿、语速）与DSM-5抑郁行为指标（如精神运动变化和注意力困难）明确关联起来，旨在克服传统主观自我报告诊断的局限性。该系统设计为可在本地硬件上运行以保护隐私，并在DAIC-WOZ数据集上进行了初步评估。

Details

Motivation: 抑郁症诊断主要依赖主观自我报告，可能遗漏真实行为特征，因此需要一种更客观、可解释的检测方法。

Result: 在DAIC-WOZ数据集上的初步评估显示，声学特征与DSM-5指标（特别是精神运动变化和注意力困难）之间存在方向一致的关联，支持了框架的设计原理。

Insight: 创新点在于提出了一个透明、可解释的关联框架，将低层声学特征直接映射到临床指标，避免了黑盒模型，同时兼顾了隐私保护的边缘计算部署。这为基于行为信号的客观心理健康评估提供了新思路。

Abstract: Depression affects millions worldwide, yet diagnosis relies on subjective self-reports that may miss authentic behavior. This paper presents an approach linking speech acoustics to DSM-5 depressive-behavior indicators through a transparent Linkage Framework. Unlike black-box models, the framework explicitly maps acoustic features (pitch variability, pauses, speech tempo) to clinical indicators, enabling interpretable, indicator-level outputs. The system runs locally on commodity hardware (HW) to preserve privacy. Preliminary evaluation on DAIC-WOZ shows directionally consistent associations between acoustic features and DSM-5 indicators for psychomotor change and concentration difficulty, supporting the design rationale. Future work will validate on longitudinal datasets and extend multimodal integration while maintaining edge constraints.

[13] VFA: Empowering Multilingual MLLMs via Vision-Free Adaptation cs.CL | cs.AIPDF

Yixia Li, Yaqing Shi, Zhiwen Ruan, Dongdong Zhang, Lingjie Jiang

TL;DR: 本文提出了一种名为VFA（Vision-Free Adaptation）的框架，旨在解决多语言多模态大语言模型（MLLM）训练中高质量非英语图像-文本数据稀缺且成本高昂的问题。该方法通过将多语言文本增强与视觉对齐解耦，在一个共享的LLM骨干网络上组合互补的任务向量，从而高效地提升MLLM的多语言能力。

Details

Motivation: 当前多模态大语言模型大多以英语为中心，扩展多语言多模态指令调优受到高质量非英语图像-文本监督数据稀缺和高成本的限制。虽然多语言文本数据丰富，但简单的文本微调会破坏视觉-语言对齐并导致灾难性遗忘。

Result: 在五个MLLM和六个多语言多模态基准测试上的实验表明，VFA方法带来了持续的性能提升，同时保留了一般的多模态和纯文本能力。此外，使用不到2%的文本数据，VFA就显著缩小了与完全多模态训练模型之间的差距，证明了其数据效率。

Insight: 核心创新点在于提出了一种解耦的适应框架（VFA），通过任务向量的组合（多语言任务向量与视觉对齐任务向量的合并）来增强多语言能力，而无需额外的视觉对齐数据。这为在数据受限情况下高效扩展MLLM的多语言能力提供了一种新颖且有效的途径。

Abstract: Multimodal large language models have advanced rapidly, yet most remain English-centric, as scaling multilingual multimodal instruction tuning is limited by the scarcity and high cost of high-quality non-English image-text supervision. Although multilingual text data is abundant, naive textual fine-tuning can disrupt vision-language alignment and induce catastrophic forgetting. We propose Vision-Free Adaptation (VFA), a framework that decouples multilingual language enhancement from visual alignment by composing complementary task vectors over a shared LLM backbone. Specifically, we fine-tune a base LLM on multilingual text data to derive a multilingual task vector, which is then merged with the vision-aligned task vector of an MLLM. Experiments on five MLLMs across six multilingual multimodal benchmarks show consistent improvements while preserving both general multimodal and text-only capabilities. Moreover, using less than 2% of the text data, VFA narrows the gap to the fully multimodal-trained model, demonstrating its data efficiency.

[14] Mutual Debiasing via Dual-Seed Comparison for Probabilistic Sampling in Large Language Models cs.CL | cs.AIPDF

Zihao Guo, Hongtao Lv, Chaoli Zhang, Laiguo Yin, Lei Liu

TL;DR: 本文提出了一种名为双种子比较（DSC）的新方法，旨在解决大语言模型（LLM）在概率采样中存在的系统性偏差问题。该方法利用两个独立的LLM生成种子，通过比较其字符序数值来构建比特序列，进而生成伪均匀变量，并最终通过逆累积分布函数映射到目标分布。实验表明，DSC在绝大多数评估设置中显著优于现有方法，并能改进多项选择题生成和属性约束文本到图像提示等任务中的分布控制。

Details

Motivation: 尽管大语言模型在推理和决策方面表现出色，但在生成随机变量时仍存在系统性偏差，扭曲目标概率分布。现有方法通常依赖单一的自生成种子，这继承了模型特定的偏差，因此需要一种透明、无需外部工具的方法来中和这种偏差。

Result: 实证结果表明，DSC在96%的评估设置中大幅优于现有方法。此外，基于DSC比较算子的任务适应变体在多项选择题生成和属性约束文本到图像提示等任务中改善了分布控制。

Insight: 论文的创新点在于引入双种子比较协议，通过两个独立种子的比较来中和模型偏差，提供了一种无需外部工具的透明采样方法。从客观角度看，这种方法通过简单的字符级序数比较和比特序列转换，有效提升了概率采样的保真度，并展示了在多种下游任务中的泛化能力。

Abstract: Although Large Language Models (LLMs) demonstrate remarkable capabilities in reasoning and decision-making, high-fidelity probabilistic sampling remains a persistent challenge. When generating random variables, LLMs consistently exhibit systematic biases that warp the target probability distributions. Current approaches often rely on a single, self-generated seed, which inherits model-specific biases. To overcome this vulnerability, we introduce Dual-Seed Comparison (DSC), a transparent, tool-free protocol that utilizes two independent LLM-generated seeds to neutralize bias. DSC compares the character-level ordinal values of the two seeds to construct a bit sequence, converts and normalizes this sequence into a pseudo-uniform variate, and then maps the variate to the target distribution through the inverse cumulative distribution function (CDF). Empirical results show that DSC substantially outperforms existing methods across 96% of evaluated settings. Beyond direct sampling, task-adapted variants based on the DSC comparison operator improve distributional control in MCQ generation and attribute-constrained text-to-image prompting.

[15] From Sound to Symptom: Real-Time Respiratory Signal Understanding for Conversational Healthcare Agents cs.CL | cs.AI | cs.HC | cs.MA | cs.SDPDF

Tanmay Laud, Herprit Mahal, Subhabrata Mukherjee

TL;DR: 本文提出了HealthCUES系统，这是一个用于实时对话式医疗助手的流式处理管道，能够从对话音频中实时监测并分析副语言呼吸信号（如咳嗽）。该系统不仅能检测咳嗽事件，还能区分咳嗽与清嗓，对咳嗽亚型（干咳、湿咳等）进行分类，并估计其时间边界，同时通过对话感知的门控机制避免警报疲劳。

Details

Motivation: 现有对话系统将对话中的咳嗽等呼吸信号视为需要丢弃的噪声，但这些信号具有临床价值。本文旨在开发一个能够在实时对话中连续监测和分析这些呼吸信号的系统，以填补现有系统的能力空白。

Result: 在847个内部对话音频片段上的评估显示，咳嗽检测的F1分数达到93%，湿/干亚型分类的加权F1分数为0.75，端到端平均延迟为340毫秒。在AMI会议语料库上的外部验证证实了其在语音存在下对咳嗽、清嗓和语音的鲁棒分离能力（宏观F1为0.91）。一项有执照医疗专业人员参与的用户研究证实了亚型信息的临床相关性及系统在远程医疗工作流程中的实用性。

Insight: 创新点在于将副语言呼吸信号分析集成到实时对话流中，而非事后处理；采用基于对话轮次边界的滚动缓冲实现亚秒级检测而不中断对话；利用多模态大语言模型（Qwen3Omni）并约束其结构化输出，将咳嗽分析分解为并行预测任务以独立优化提示；引入对话感知门控机制来根据上下文调节触发，防止警报疲劳。

Abstract: Cough events during live spoken conversations carry clinically valuable respiratory signals, yet existing dialogue systems treat them as acoustic noise to be discarded. We present HealthCUES (Clinical Understanding from Embodied Sounds), a streaming pipeline for paralinguistic respiratory monitoring in real-time conversational agents, a capability that, to the best of our knowledge, is absent from all prior systems. HealthCUES processes audio through a rolling buffer aligned with dialogue turn boundaries, enabling sub-second event detection without interrupting conversational flow. Beyond binary cough detection, the system provides fine-grained analytics: (i) differentiation between coughing and throat clearing, (ii) cough subtype classification (dry, wet, barking, whooping) with confidence scores, and (iii) temporal duration estimation with start-end boundaries. To prevent alert fatigue, HealthCUES introduces dialogue-aware gating mechanisms that modulate triggering based on conversational context. The system leverages Qwen3Omni, a multimodal large language model (MLLM), with constrained structured outputs, decomposing cough analysis into parallel prediction tasks for independent prompt optimization. Evaluation on 847 in-house conversational audio segments demonstrates 93% F1 for cough detection, 0.75 weighted-F1 for wet/dry subtype classification, and average end-to-end latency of 340ms; external validation on the AMI meeting corpus confirms robust cough, throat-clearing, and speech separation in the presence of speech (0.91 macro-F1). A user study with licensed healthcare professionals confirms the clinical relevance of subtype information and the system’s utility in telehealth workflows.

[16] Lost in Compression: A Controlled Cross-Lingual Audit of Extractive Prompt Compressors cs.CL | cs.AIPDF

Mantas Lukauskas

TL;DR: 本文通过跨语言对比实验，系统评估了提取式提示压缩方法在非英语语言上的表现。研究发现，仅用英语数据训练的压缩器在非英语语言上存在显著的性能下降，而多语言训练的压缩器表现更均衡，但某些语言在激进压缩下仍会损失几乎所有上下文信息。

Details

Motivation: 现有提示压缩方法主要在英语基准上表现优异，但非英语内容通常需要更多token，导致推理成本更高。本文旨在探究提示压缩是缩小还是扩大了这种跨语言差距。

Result: 在10种语言、11个目标模型上的大规模评估（超过25万次调用）显示：英语训练的压缩器在非英语语言上存在明显的性能下降（如中文在0.33保留率下几乎失去全部上下文），而确定性基线方法无此差距；多语言训练的XProvence v1无此问题，但其v2版本在中文上仍会清空92%的上下文。在长上下文任务中，激进压缩导致三种非英语语言的性能降至无上下文水平。

Insight: 压缩性能差距主要源于训练数据的语言偏差而非模型架构；跨语言安全压缩的预算远低于英语；翻译后压缩的流程在部分语言上能以一半的token成本达到或超过原生压缩效果。

Abstract: Extractive prompt compression promises to cut LLM inference costs by removing low-information tokens, and learned compressors such as LLMLingua-2 report strong results on English benchmarks. Most other languages already pay a token premium: the same content costs 1.3-1.8x more tokens than in English. We ask whether compression closes or widens this gap. Using fully parallel data in ten languages spanning five scripts, with controls budget-matched in the target model’s tokenizer, we audit four learned compressors against four deterministic baselines, on eleven target models from ten vendors (over 250,000 evaluation calls). Three of the compressors are trained with English supervision (LLMLingua-2 XLM-R/mBERT; Kompress-v2 from the production Headroom stack); the fourth, XProvence, is trained multilingually. First, the transfer gap is real, replicates across target models and compressor backbones, and is strongly rate-dependent: at a 0.33 keep-rate English retains 57-62% of normalized context utilization while Lithuanian retains 10-24% and Chinese essentially none, despite Chinese having the smallest token premium. Second, the gap tracks compression supervision data, not architecture. All three English-trained compressors show it, deterministic methods show no comparable gap, and the multilingually trained XProvence v1 shows none. Its v2 release, retrained on translated data, empties 92% of Chinese contexts at its aggressive threshold without any warning. Third, in a harder long-context setting, aggressive learned compression drives compressed contexts to or below no-context utility in three of five non-English languages. A translate-then-compress pipeline matches or beats native compression at roughly half the token cost in three of five tested languages. We release all code, compressions, and model outputs. Safe compression budgets are much smaller outside English.

[17] When the Canonical Completion Is Wrong: Formalizing and Measuring the Jump in Large Language Models cs.CL | cs.AI | cs.LG | cs.LOPDF

Dai Shi, Xiaoyu Li, José Miguel Hernández-Lobato

TL;DR: 本文针对大语言模型能否进行从证据到新公理系统的溯因跳跃（即“跳跃”）这一争议，提出了一个形式化定义和测量框架。通过将跳跃实例定义为具有机器可验证证书的有限扩展问题，并引入左/右Kan扩展作为规范补全（即默认输出），作者在9个认证实例和4个前沿模型上进行了测试。结果表明，模型在所有约束试验中均放弃了规范补全，表明跳跃的第二步并非瓶颈。

Details

Motivation: 当前关于LLM能否实现“跳跃”的争论缺乏形式化定义和可测量的标准，导致难以验证双方观点。本文旨在通过建立严格的形式化框架和测量方法，为这一争议提供实证基础。

Result: 在9个认证实例和4个前沿模型（如GPT-4等）的248次约束试验中，模型的“Kan默认率”为零，即每次都成功放弃了规范补全。更高难度下的失败源于推理预算耗尽或约束错误，而非回归默认输出。

Insight: 创新点在于将跳跃问题形式化为具有唯一正确解且不同于规范补全的有限扩展问题，并利用左/右Kan扩展定义默认输出。这为量化评估LLM的溯因推理能力提供了可操作的理论和实验框架，表明争议焦点可能在于约束生成或框架创新而非跳跃本身。

Abstract: Whether large language models (LLMs) can perform the abductive leap from evidence to a new system of axioms, commonly referred to as a jump, has recently attracted considerable debate. A prominent position holds that LLMs are structurally incapable of such jumps, while recent studies challenge both its mechanism and its evidence. However, the debate remains difficult to settle, since the field still lacks a formal definition of the jump and a measure to test either side. In this paper, we develop a formal account of the jump in four steps and measure the second. The steps ask what the default completion of partial data is, when abandoning it is forced, when the abandonment is correct, and how successive jumps compound. Specifically, we define a jump instance as a finite extension problem with a machine-checked certificate that a correct completion exists, is unique up to renaming, and differs from the canonical completion of the data. The canonical completion is given by the left and right Kan extensions and is also what models produce without constraints, so it serves as the default. We prove that jump instances are well-posed and establish a family theorem that certifies instances of unbounded difficulty without enumeration. We further formalize when a jump is correct and how successive jumps compound. Finally, we run the measurement on nine certified instances and four frontier models. The Kan-default rate is zero in all 248 constrained trials, so the models do jump at this step and abandon the excluded default every time. Failures at higher difficulty stem from exhausted reasoning budgets or constraint errors, never from reverting to the default. These results indicate that the second step is not the bottleneck. If the disputed incapacity is real, it lies in generating the constraints or inventing the framework. Code can be found at: https://github.com/EEthanShi/kan-jump-test.

[18] A Reranker for Orchestrating Heterogeneous Speech and Text Retrievers cs.CL | cs.AI | cs.IRPDF

Inho Kim, Sumyeong Ahn

TL;DR: 本文提出STeReO，一种基于语音和文本检索器的重排序器，用于聚合不同模态的数据库以增强检索增强生成（RAG）系统。通过构建包含查询、混合模态证据及其相关性排名的数据集来训练模型，并在单模态和混合模态场景中验证其有效性。

Details

Motivation: 解决RAG系统中知识库日益多样化（如包含语音和文本等多模态）但处理此类多模态数据库的研究仍有限的问题，旨在通过重排序器整合异构检索结果以减轻大语言模型的幻觉。

Result: 实验表明，所提算法在单模态和混合模态场景中均能有效选择最相关证据，从而显著提升下游问答任务的性能。

Insight: 创新点在于提出专门针对语音和文本混合检索的重排序器STeReO，并通过构建多模态相关性排名数据集来解决训练数据缺乏的问题，为多模态RAG系统的优化提供了新思路。

Abstract: Retrieval-Augmented Generation (RAG) systems have attracted significant interest for their ability to mitigate hallucinations in Large Language Models (LLMs). Although knowledge databases for RAG are increasingly diversifying to include various modalities such as speech and text, research on handling such multi-modal database scenarios remains limited. In this paper, we propose STeReO (Speech and Text Reranking Orchestrator), a reranker based on speech and text retrievers that aggregates disparate modality databases. To address the lack of specialized training data, we first curate a dataset comprising queries, mixed-modality evidence, and their corresponding relevance ranks. We then train the reranker and evaluate its effectiveness in both single-modality and mixed-modality scenarios. Our results demonstrate that the proposed algorithm excels at selecting the most relevant evidence, thereby significantly improving downstream question-answering performance.

[19] Neuro-symbolic PRM: Enhancing Scientific Reasoning via Structured Traces and Symbolic Verification cs.CLPDF

Yuxin Zi, Cong Xu, Suparna Bhattacharya, Martin Foltin, Amit Sheth

TL;DR: 本文提出一种神经符号框架，通过结构化轨迹和符号验证增强科学推理能力。该方法将推理过程解耦为符号有效性和语义基础性两个维度，利用确定性符号验证器保证形式正确性，并训练条件过程奖励模型评估语义合理性。

Details

Motivation: 针对当前工具增强大语言模型在STEM任务中存在的中间推理步骤形式正确但语义不接地的问题，现有方法要么无法评估语义意图，要么让过程奖励模型同时承担算术和逻辑检查的双重负担。

Result: 通过针对强工具使用LLM的残余错误类别，该方法显著提高了推理可靠性，且无需依赖先前框架的复杂启发式方法。

Insight: 创新点包括：将推理形式维度解耦的神经符号框架、通过反事实符号扰动算法生成约束保持的硬负样本的数据合成策略，以及推理时采用验证器优先的约束搜索机制。

Abstract: While tool-augmented Large Language Models have significantly improved multi-step reasoning in quantitative STEM tasks, a critical residual failure mode remains: intermediate reasoning steps that are syntactically well-formed, mathematically executable, and unit-consistent, yet contextually ungrounded. Current approaches either rely on formal verifiers that cannot assess semantic intent, or burden Process Reward Models (PRMs) with the dual task of checking both arithmetic and logic. In this paper, we propose a neuro-symbolic framework that cleanly decouples reasoning into two formal dimensions: Symbolic Validity ($V$) and Semantic Groundedness ($G$). We guarantee $V$ by construction using a deterministic symbolic verifier acting as a hard filter. To assess $G$, we train a PRM conditionally on the verifier-accepted manifold. To train this PRM efficiently, we introduce Counterfactual Symbolic Perturbation (CSP), a novel data synthesis strategy that algorithmically generates constraint-preserving hard negatives (steps that perfectly pass the verifier but are logically flawed). At inference, we deploy a verifier-first constrained search that guarantees execution consistency for verifier-covered operations while relying on the PRM solely to rank semantic grounding. By targeting the exact residual error class of strong tool-using LLMs, our method significantly improves reasoning reliability without the sprawling heuristics of prior frameworks.

[20] Cross-lingual Representation Learning via Centroid Intervention Fusion cs.CLPDF

Wei Sun, Marie-Francine Moens

TL;DR: 本文提出了一种名为Centroid Intervention Fusion (CIF)的投影融合框架，旨在通过干预大型语言模型(LLMs)前向传播过程中的隐状态，以轻量级方式提升跨语言表示学习性能，尤其改善低资源语言的表现。该方法将多个多语言干预投影整合为一个语言共享的操作符，克服了现有方法需要为每对语言学习独立投影的限制。

Details

Motivation: 大型语言模型在多语言任务上表现不均衡，尤其是在处理低资源语言时。现有的跨语言干预方法通常为源语言到目标语言学习独立的投影，这限制了方法的可扩展性并阻碍了跨语言的知识共享。

Result: 在多项多语言基准测试（包括常识推理、自然语言推理、事实编辑和机器翻译）上，CIF在四个模型骨干网络上平均比先前最强的成对干预基线提升了高达+3.378个百分点，并支持低资源语言获得性能增益。

Insight: 核心创新点在于提出了一个投影融合框架，将多个干预投影整合为一个语言共享的算子，这增强了方法的可扩展性和跨语言知识共享能力，是一种无需更新模型参数的轻量级推理时干预方法。

Abstract: Large language models (LLMs) exhibit uneven multilingual performance, especially when dealing with low-resource languages. Inference-time intervention offers a lightweight way to improve cross-lingual transfer by modifying the hidden states produced by the LLMs during the forward pass, without updating model parameters. However, existing cross-lingual intervention methods typically learn separate projections from source to target languages, which limits scalability and prevents knowledge sharing across languages. We propose Centroid Intervention Fusion (CIF), a projection fusion framework that consolidates multiple multilingual intervention projections into a single language-shared operator. Across multilingual commonsense reasoning, natural language inference, factual editing, and machine translation benchmarks, CIF outperforms the strongest prior pairwise intervention baseline by up to +3.378 pp on average across four model backbones, while supporting performance gains for low resource languages. The code is available at https://github.com/VRCMF/CIF.git.

[21] Survival-Guided Length Control for Efficient Diffusion Language Models cs.CLPDF

Ivan Kobyzev, Abbas Ghaddar, Yufei Cui

TL;DR: 本文提出了一种基于生存分析的序列长度控制方法，用于提升扩散语言模型（DLM）的解码效率。该方法将序列结束标记的预测建模为离散时间生存问题，并设计了一个无需额外训练、可即插即用的长度预测器。在推理和代码生成基准测试中，该方法在保持任务准确性的同时，将推理速度最高提升了7倍。

Details

Motivation: 标准扩散语言模型解码时要么固定序列长度，要么依赖临时停止规则，这通常导致不必要的去噪步骤，降低推理效率。

Result: 在推理和代码生成基准测试中，该方法在保持任务准确性的同时，将推理速度最高提升了7倍。研究还发现，即使在相同数据集内，预测的长度也存在很大差异，表明模型性能对所选长度敏感。

Insight: 创新点在于将序列长度控制问题重新定义为离散时间生存问题，并提出了一个无需训练、可即插即用的通用长度预测器。这为扩散模型提供了一种高效、自适应的解码策略，而非依赖固定或启发式规则。

Abstract: Diffusion language models (DLMs) generate text by iteratively denoising masked sequences, but standard decoding either fixes the sequence length or relies on ad hoc stopping rules, often leading to unnecessary denoising steps. We recast length selection as a discrete-time survival problem over the end-of-sequence token and propose a plug-in, training-free length predictor that can be added to any existing DLM. Across reasoning and code-generation benchmarks, survival-guided length decoding speeds up inference by up to 7 times while preserving task accuracy. We further find that predicted lengths vary widely even within the same dataset, making model performance sensitive to the chosen length.

[22] Co-Evolving Structured Knowledge and Reasoning in Language Models cs.CL | cs.AI | cs.LGPDF

Ryan Thomas Noonan, Linxi Zhao, Menghan Xu, Akanksha Sarkar, Mihir Mishra

TL;DR: 本文提出KBevo框架，通过联合学习构建结构化知识库并基于其进行推理，以解决知识密集型问答任务中检索增强方法存在的无关上下文干扰和可控性不足的问题。该方法通过端到端优化，使推理成功直接提升知识库质量，从而生成更大、连接性更好、答案可达性更高的知识结构。

Details

Motivation: 针对检索增强方法在非结构化文本检索中引入无关信息且可控性有限，以及结构化知识库构建成本高、推理脆弱的问题，旨在开发一种能够协同进化知识库构建与推理的框架。

Result: 与标准检索基线相比，该方法在知识密集型问答中提高了组合事实推理能力和可控性，并生成了更大、连接性更好、答案可达性更高的知识结构。

Insight: 创新点在于通过端到端优化，将知识库构建与推理过程协同进化，使推理结果直接反馈优化知识库质量，从而提升整体性能；客观分析认为这种联合学习机制有效解决了传统方法中知识库与推理脱节的问题。

Abstract: Retrieval-augmented methods improve factual accuracy by grounding language models in external knowledge, but retrieving over unstructured text often introduces irrelevant context and offers limited control over the retrieved information. Structured knowledge bases offer a more controllable alternative, yet they are expensive to construct and often brittle to reason over. To address these limitations, we propose KBevo: a co-evolving framework that jointly learns to construct a structured knowledge base and reason over it for knowledge-intensive question answering. By optimizing both components end-to-end with QA outcome rewards, our method enables reasoning success to directly improve the quality of the constructed knowledge base. This leads to larger, better-connected knowledge structures with higher answer reachability, while also improving compositional factual reasoning and controllability compared to standard retrieval baselines.

[23] Case2Flow: Bridging Patient Cases and Guideline Flowcharts through Multimodal Retrieval cs.CL | cs.IRPDF

Jiale Wei, Yufan Chen, Alexander Jaus, Zdravko Marinov, Julian Friedrich

TL;DR: 本文提出了Case2Flow任务，旨在根据患者病例从医学指南文档集合中检索最相关的指南流程图。为此，作者构建了FlowAtlas数据集，包含从2080份指南中提取的202个流程图以及1911个对齐的病例-流程图对。评估发现现有多模态检索方法存在系统性缺陷，如过度依赖关键词和无关背景区域导致的虚假匹配。作者进而提出了CRISP方法，一种无需训练的评分方法，通过抑制无关图像块、降低模糊词匹配权重以及结合双向查询-图像对齐来改进检索性能。

Details

Motivation: 医学指南包含丰富的循证决策逻辑，但临床医生很难在指南中定位到特定决策所需的流程图，尤其是在跨指南覆盖多种可能疾病和治疗时。虽然指南文本段落已支持端到端问答，但流程图在决策支持中仍未得到充分利用，尽管它们能编码可操作的临床路径。

Result: 在构建的FlowAtlas数据集上评估多模态检索方法，揭示了系统性失败模式。提出的CRISP方法将Recall@1提升了高达18.71个百分点。此外，对已发表病例叙述的盲法医师评估提供了超出合成查询的初步可行性证据。

Insight: 创新点在于首次定义了从患者病例到指南流程图的多模态检索任务（Case2Flow），并构建了首个针对该任务的精编数据集FlowAtlas。提出的CRISP方法是一种无需训练的后处理评分策略，通过抑制流程图中的非信息性背景区域、处理模糊词匹配以及引入双向对齐来锐化检索结果，有效解决了现有方法的关键缺陷。

Abstract: Medical guidelines encode rich, evidence-based decision logic, yet the specific decision artifact a clinician needs is hard to locate within a guideline, let alone across guidelines covering plausible diseases and treatments. While guideline passages have supported end-to-end question answering, flowcharts remain largely underused in decision support despite their ability to encode actionable clinical pathways. We therefore introduce Case2Flow, a task designed to retrieve the most relevant guideline flowchart for a given patient case from a collection of guideline documents. To support it, we construct FlowAtlas, a curated corpus of 202 flowcharts extracted from 2,080 medical guidelines, together with a pipeline that synthesises 1,911 aligned case-flowchart pairs. Our evaluation of multimodal retrieval methods reveals systematic failure modes, including overreliance on keywords and spurious token-patch matches induced by uninformative background regions in flowcharts. Motivated by this, we propose CRISP, a training-free scoring method that sharpens late-interaction retrieval by suppressing uninformative patches, discounting ambiguous token matches, and incorporating bidirectional query-image alignment. CRISP improves Recall@1 by up to 18.71 percentage points, while a blinded physician assessment on published case narratives provides preliminary feasibility evidence beyond synthetic queries.

[24] SPEAR: Distilling Domain-Adaptive Reasoning Skeletons via Sequential Symbolic Alignment in Reinforcement Learning cs.CLPDF

Zhuochun Li, Yuelyu Ji, Yiming Zeng, Daqing He

TL;DR: 本文提出SPEAR方法，通过将自然语言推理轨迹映射为领域自适应的符号里程碑，并利用最长公共子序列对齐学生探索与教师里程碑，为强化学习中的序列级策略蒸馏提供无需训练、即插即用的密集过程奖励信号，以解决现有方法在稀疏结果奖励与昂贵神经过程奖励模型之间的两难困境。

Details

Motivation: 当前基于强化学习的知识蒸馏面临关键困境：研究者必须在提供不足逻辑指导的稀疏结果奖励与昂贵的神经过程奖励模型之间做出选择，这限制了复杂推理从教师模型向学生模型的传递效果。

Result: 在数学、科学和常识推理任务上的实验表明，SPEAR通过序列级蒸馏与高效的密集过程奖励，有效弥合了学生模型与教师模型之间的推理差距。

Insight: 创新点在于提出了一种无需训练、即插即用的符号过程评估与对齐奖励方法，通过将推理过程符号化并利用最长公共子序列进行对齐，以低成本实现了对推理过程逻辑一致性的密集监督，避免了对外部神经验证器的依赖。

Abstract: Reinforcement learning-based knowledge distillation has the potential to transfer complex reasoning from teacher to student models, yet it currently faces a critical dilemma: researchers must choose between sparse outcome-based rewards, which provide insufficient logical guidance, or expensive neural Process Reward Models (PRMs) for dense signals. We resolve this by introducing SPEAR (Symbolic Process Evaluation and Alignment Reward), a training-free and plug-and-play process reward method for sequence-level on-policy distillation. SPEAR projects natural-language reasoning traces into domain-adaptive symbolic milestones, providing an efficient proxy for process-level reasoning alignment. By utilizing the longest common subsequence (LCS) to align student explorations with teacher milestones, SPEAR provides a dense, order-aware reward signal that enforces logical consistency without the need for an external neural verifier. Our experiments across math, science, and commonsense reasoning tasks demonstrate that SPEAR effectively bridges the reasoning gap between student and teacher models via sequence-level distillation with efficient dense process rewards. Our code and data are available at: https://github.com/zhuochunli/SPEAR.

[25] SPT: Skills as Pre-Training Data for Agentic Language Models cs.CLPDF

Yufei Sun, Yudong Li, Yiming Cheng

TL;DR: 论文提出了一种名为技能预训练（SPT）的中期训练方法，该方法将因果语言建模应用于一个名为SkillCorpus的公共多文件技能包集合，以提升语言模型的工具使用能力。该方法引入了一种名为Reference Insert的引用感知组装策略，以保持技能包内文件间的关系。实验表明，SPT在多个模型规模和后期训练方案下，都能持续提升智能体性能，同时基本保持通用能力。

Details

Motivation: 当前智能体（工具使用）语言模型主要依赖工具调用轨迹和智能体轨迹数据进行后期训练，这类数据生成成本高、覆盖范围有限。论文旨在利用公开可用的技能包作为预训练数据源，这些技能包编码了可重用的工具语义和工作流，但通常仅在推理时作为上下文使用。

Result: 实验结果表明，与在通用数据或轨迹数据上进行中期训练相比，SPT在多个模型规模和后期训练方案下，都能一致地提升智能体性能，同时基本保持了通用语言模型的性能。数据混合实验进一步表明，将技能数据与通用退火语料库结合能带来额外收益。

Insight: 核心创新点在于将公开的技能包（SkillCorpus）作为预训练数据源，并设计了Reference Insert策略来处理多文件技能包内的引用关系。这为训练工具使用语言模型提供了一种成本效益高、可扩展性强的新数据范式，揭示了技能数据在预训练阶段的价值。

Abstract: Agentic (tool-using) language models are mainly trained on tool-call traces and agent trajectories during post-training. These data provide direct behavioral supervision, but producing them requires task environments, execution, and verification, making broad tool and task coverage expensive. Publicly available skills offer another source of training data: they encode reusable tool semantics and workflows but are typically used only as inference-time context. We introduce Skill Pre-Training (SPT), a mid-training method that applies causal language modeling to SkillCorpus, a collection of public multi-file skill packages, optionally mixed with general data. To preserve relations among files within each package, we also introduce Reference Insert, a reference-aware assembly strategy that places supporting files near their mentions in the primary instruction. Experiments across multiple model scales and post-training recipes show that SPT consistently improves agentic performance over mid-training on general or trajectory data, while largely preserving general performance. Data mixture experiments show additional benefits from combining skill data with general annealing corpora. These results indicate that skill packages are a valuable data source for pre-training agentic language models.

[26] Dependency-Aware Revocable Decoding for Efficient Diffusion Large Language Model Inference cs.CLPDF

Wooje Park, Insu Lee, Minyoung Noh, Jaeyun Jang, Sungmin Lee

TL;DR: 本文提出了一种名为DARD（Dependency-Aware Revocable Decoding）的训练无关框架，用于提升扩散大语言模型（dLLMs）的解码效率与生成质量。该方法通过将解码令牌划分为掩码、候选和未掩码三种状态，并利用排除低可靠性令牌的选择性上下文来验证候选令牌，从而自适应地调节其对后续解码的影响。

Details

Motivation: 扩散大语言模型通过并行解码提供了一种替代自回归生成的方法，但提高解码并行度常导致生成质量下降，因为早期错误会污染后续上下文。现有的可撤销解码方法通过重新评估解码令牌来缓解此问题，但忽略了不可靠令牌也可能污染验证上下文本身。

Result: 在3个开源dLLMs上进行的12个文本和多模态基准测试表明，DARD在速度-质量的帕累托前沿上持续优于最近的可撤销解码方法。具体而言，在Flickr30K基准上，相比Saber方法，DARD实现了2.71倍的加速和4.35分的CIDEr分数提升。

Insight: 核心创新在于识别了现有可撤销解码方法中不可靠令牌污染验证上下文的失效模式，并提出了依赖感知的令牌状态划分与选择性上下文验证机制。这是一种无需额外训练、能自适应调节令牌影响以同时优化解码速度和质量的方法。

Abstract: Diffusion large language models (dLLMs) offer a promising alternative to autoregressive generation by decoding multiple tokens in parallel through iterative denoising. However, increasing decoding parallelism often degrades generation quality, as early errors can contaminate later contexts. Revocable decoding mitigates this issue by re-evaluating decoded tokens and remasking unreliable ones, but existing methods overlook that unreliable tokens may also corrupt the verification context itself. We identify this failure mode and propose Dependency-Aware Revocable Decoding (DARD), a training-free framework that separates tokens into masked, candidate, and unmasked states. DARD verifies candidate tokens using a selective context that excludes less reliable tokens and adaptively regulates their influence on subsequent decoding. Experiments across 12 textual and multimodal benchmarks on 3 open-source dLLMs show that DARD consistently improves the speed-quality Pareto frontier over recent revocable decoding methods, achieving a 2.71$\times$ speedup and a 4.35-point CIDEr score gain over Saber on Flickr30K.

[27] Surgical Alignment in Knowledge Graph Training for Clinical Diagnosis with Large Language Models cs.CLPDF

Saksham Khatwani, He Cheng, Majid Afshar, Dmitriy Dligach, Yanjun Gao

TL;DR: 本文系统研究了知识图谱（KG）与大型语言模型（LLM）在临床诊断应用中的整合方法，通过引入梯度干预密度（GID）和梯度失真（GD）两个指标，揭示了KL正则化下的KG判断训练能产生稀疏、局部化的模型更新（称为外科手术式对齐），相比任务特定的监督微调（SFT）能带来更好的推理质量，即使其领域内准确率可能更低。

Details

Motivation: 生物医学知识图谱为LLM在临床诊断中的推理提供了结构化知识基础，但如何将KG信号有效整合到LLM中仍是一个开放问题，本文旨在系统探索不同的KG任务表述、训练范式和模型，以找到更优的整合方式。

Result: 在五个KG任务、三种训练范式、两个KG和三个基础LLM上的实验表明，所有范式均优于未微调的基线；通过GID和GD指标分析发现，产生稀疏更新的范式（如KL正则化下的KG判断训练）能提升推理质量，尽管其领域内准确率有时低于任务特定的SFT。

Insight: 创新点在于提出了GID和GD这两个优化几何诊断指标，用以量化训练对预训练模型的修改程度，并发现了外科手术式对齐（稀疏更新）范式在提升推理质量上的优势；这表明评估KG-LLM整合需要超越准确率，结合优化几何分析。

Abstract: Biomedical knowledge graphs (KGs) offer structured medical knowledge that can ground large language model (LLM) reasoning in clinical diagnosis application, yet how KG signal should be integrated into LLMs remains an open question. We present a systematic study spanning five KG task formulations, three training paradigms, two KGs, and three base LLMs. At the task level, all paradigms improve over the non-finetuned baseline, but methods with comparable in-domain accuracy show substantially different knowledge transfer behavior. We introduce Gradient Intervention Density (GID) and Gradient Distortion (GD) to measure how broadly an optimizer modifies the pretrained model. GID and GD together reveal a clear divide: KG-judgment training under KL regularization produces sparse, localized updates (a regime we term as surgical alignment), while task-specific SFT produces dense ones. A controlled ablation shows that the objective and KL contribute to sparsity independently, and the paradigms that produce sparse updates also improve reasoning quality, even when their in-domain accuracy is lower than task-specific SFT. Assessing KG-LLM integration thus requires complementing accuracy with optimization-geometry diagnostics. Our implementation can be found at https://github.com/LARK-NLP-Lab/Surgical-Alignment.

[28] Not Just Reason, Not Just Scan: Reinforcement Learning for Proactive Scientific Error Verification over Academic Paper cs.CLPDF

Rongjin Li, Yuanxin Liu, Hao Zhou, Fandong Meng, Jie Zhou

TL;DR: 该论文提出了一种名为VERA-RL的强化学习框架，用于在学术论文中进行主动的科学错误检测。该方法通过构建包含12,900个样本的数据集VERA-13K，并设计细粒度的奖励机制，训练多模态大语言模型（如Qwen3-VL-8B）执行“推理-验证-扫描”的流程，以在没有预设问题或证据的情况下自主发现和验证错误。

Details

Motivation: 当前的多模态大语言模型（MLLMs）作为科学助手的能力有限，无法实现完全自主的研究，尤其是在缺乏预设问题和证据的情况下，主动检查论文、构建全局证据视图并进行可追溯的判断方面存在不足。论文旨在解决这种“无问题和证据”的验证挑战，通过科学错误检测任务来推动模型向更自主的研究助手发展。

Result: 在Scan基准测试中，使用VERA-RL训练的Qwen3-VL-8B模型在可验证推理方面显著提升，性能接近旗舰级MLLMs如Gemini 3 Pro和Qwen3-VL-235B-A22B。

Insight: 论文的创新点在于提出了一个强化学习框架（VERA-RL）和配套数据集（VERA-13K），用于训练模型在没有预设问题或证据的情况下进行主动错误检测，并通过细粒度的奖励（如推理完整性、证据对齐和错误精度）来优化模型的可验证推理能力。从客观角度看，这种方法为多模态大语言模型在自主科学研究中的应用提供了新的任务范式和训练策略。

Abstract: Multimodal large language models (MLLMs) are increasingly capable scientific assistants, yet they remain far from fully autonomous research. This transition requires models to actively inspect academic papers, build global evidence views, and make traceable judgments without prespecified issues or evidence. However, existing work provides limited task paradigms or training studies for such issue- and evidence-absent verification. We study this challenge through scientific error detection, where models must determine whether errors exist and justify them with evidence-based reasoning. To fill this gap, we present VERA-RL, a reinforcement-learning formulation for scientific error detection over academic papers. Following a Reason–Verify–Scan progression, we construct VERA-13K, a 12,900-sample dataset organized into 4,300 matched chains, covering 6 scientific-error categories across the research workflow and broad natural-science domains. We further introduce fine-grained rewards for reasoning completeness, evidence alignment, and error precision. Training Qwen3-VL-8B with VERA-RL substantially improves verifiable reasoning, approaching flagship MLLMs such as Gemini 3 Pro and Qwen3-VL-235B-A22B on Scan.

[29] Information-Guided Frontier Decoding: Contextual Utility-Driven Commitment in dMLLMs cs.CLPDF

Xingyou Fang, Jingxing Zhong, Xiaosong Yuan, Xiaofeng Zhang

TL;DR: 本文提出了一种名为信息引导前沿解码（IGFD）的训练无关解码策略，用于提升扩散多模态语言模型（dMLLMs）的生成质量。该方法通过综合考虑词元置信度、邻域不确定性和结构承诺风险来对候选词元进行排序，旨在优先解码可靠的语义锚点，同时延迟脆弱的结构词元（如标点），以改善解码过程中的上下文传播并减少错误累积。

Details

Motivation: 现有基于置信度的解码策略倾向于优先解码局部简单的词元（如标点），但置信度并不能反映词元在上下文中的实际效用。这导致信息丰富的语义锚点被推迟解码，削弱了上下文传播，增加了错误累积的风险。

Result: 在多种多模态理解、推理、定位和幻觉基准测试上的实验表明，在相同的解码预算下，IGFD在大多数基准测试和不同的扩散MLLM骨干网络上均持续优于现有的解码策略。

Insight: 核心创新在于提出了一种综合考虑局部置信度、上下文效用（通过邻域不确定性衡量）和结构风险的多因素解码排序机制，并引入了动态候选前沿来约束解码区域。该方法无需额外训练、辅助模型或前向传播，是一种高效即插即用的解码改进方案。

Abstract: Decoding quality in diffusion multimodal language models (dMLLMs) depends heavily on the order in which masked tokens are committed. Existing confidence-based strategies prioritize locally easy tokens, but confidence does not necessarily reflect contextual usefulness. As a result, structurally easy tokens such as punctuation may be committed before informative semantic anchors, weakening context propagation and increasing error accumulation. We propose Information-Guided Frontier Decoding (IGFD), a training-free decoding strategy that ranks candidates using token confidence, neighborhood uncertainty, and structural commitment risk. IGFD encourages early commitment of reliable semantic anchors while delaying fragile structural tokens, improving contextual support during decoding. A dynamic candidate frontier further constrains token selection to locally expandable regions under the same decoding budget. The method requires no additional training, auxiliary models, or extra forward passes. Experiments across multimodal understanding, reasoning, grounding, and hallucination benchmarks show that IGFD consistently outperforms existing decoding strategies across the majority of benchmarks and diffusion MLLM backbones under identical decoding budgets.

[30] Do LLMs Understand Personality? Rethinking Persona Fidelity Evaluation through Structured Behavioral Inference cs.CL | cs.AIPDF

Mengfan Li, Zesheng Wei, Xuanhua Shi, Yang Deng

TL;DR: 本文提出PRISM框架，通过结构化逆向推理任务重新评估LLM的人格保真度，将人格保真度分解为任务框架、人际立场和语言风格三个功能维度，并基于系统功能语言学理论进行证据聚合，以解决现有评估方法中存在的整体评估幻觉和静态心理测量不足的问题。

Details

Motivation: 随着大语言模型被广泛用于模拟多样化人类角色，确保人格保真度（即代理行为一致反映目标人格心理和风格特征的程度）成为关键需求，但现有评估范式主要依赖易产生“整体评估幻觉”的LLM整体评判或无法捕捉动态对话中上下文依赖保真度的静态心理测量工具。

Result: 实验表明，PRISM相比传统整体评判方法能产生更准确和稳定的判断，为人格保真度评估提供了更可靠的框架。

Insight: 创新点在于将人格保真度评估重构为基于系统功能语言学的结构化逆向推理任务，通过分解为三个可解释维度并进行证据聚合，实现了可审计的评估过程，避免了整体评估的幻觉问题。

Abstract: As large language models are increasingly deployed to simulate diverse human characters, ensuring persona fidelity, defined as the extent to which an agent’s behavior consistently reflects the psychological and stylistic characteristics of a target persona, has become a critical requirement. However, existing evaluation paradigms primarily rely on either holistic LLM-based judges, which are prone to “holistic appraisal hallucination’’, or static psychometric inventories, which fail to capture the context-dependent fidelity required in dynamic dialogue. To address these limitations, we propose PRISM (Persona Reasoning with Inverse SFL-based Modeling), a psycholinguistically grounded framework that reformulates persona fidelity evaluation as a structured inverse inference task. Inspired by Systemic Functional Linguistics (SFL), PRISM decomposes persona fidelity into three functional dimensions: Task Framing, Interpersonal Stance, and Linguistic Style. It estimates dimension-specific evidence over a persona-conditioned label space and aggregates these signals into an interpretable and auditable evaluation process. Experiments show that PRISM yields more accurate and stable judgements than traditional holistic judging, providing a more reliable framework for persona fidelity evaluation.

[31] Scaling phoneme-based TTS augmentation for ASR: A unified pipeline and controlled study cs.CLPDF

Zhen Wang, TianRui Wu, RongQi Han, Hao Wu, Wei Liang

TL;DR: 本文提出了一种统一的音素级TTS-ASR数据增强流水线，用于提升自动语音识别性能。该流水线整合了语言特定的字形到音素转换、参考语音过滤、候选文本选择、合成以及匹配的ASR训练延续。作者进一步提出了音素频率引导选择方法，通过估计真实ASR训练标签中的音素频率来对候选句子进行排序。

Details

Motivation: 合成语音为自动语音识别提供了可扩展的监督信号，但其效果取决于所选文本、参考语音和合成数据量。本文旨在通过一个统一的流水线来系统研究这些因素，并提升TTS数据增强在ASR中的有效性。

Result: 在阿拉伯语、法语、意大利语和葡萄牙语的13个测试集上进行实验。在合成规模扫描中，随机增强在11个测试集上优于仅使用真实数据的匹配训练。在60%合成预算下，PFGS方法在12个测试集上优于仅使用真实数据的训练，在9个测试集上优于随机选择，相对于随机选择的最大相对词错误率降低为19.3%。参考语音过滤在意大利语和法语Common Voice测试集上分别降低了0.29和0.59个百分点的绝对WER。

Insight: 创新点在于提出了一个统一的、音素级的TTS-to-ASR增强流水线，并引入了音素频率引导选择方法。客观分析认为，该研究系统性地识别并量化了合成规模、候选文本内容和参考语音质量作为TTS增强ASR的关键控制变量的重要性，为数据增强策略提供了可借鉴的指导原则。

Abstract: Synthetic speech provides scalable supervision for automatic speech recognition (ASR), but its benefit depends on the selected texts, reference speech, and amount of synthesized data. We present a unified phoneme-based TTS-to-ASR augmentation pipeline built around a multilingual TTS model trained from scratch using the F5-TTS architecture with language-ID conditioning. The pipeline combines language-specific grapheme-to-phoneme conversion, reference-speech filtering, candidate-text selection, synthesis, and matched ASR continuation. We further propose phoneme-frequency-guided selection (PFGS), which ranks candidate sentences using phoneme frequencies estimated from real ASR training labels. Experiments with separate monolingual ASR systems for Arabic, French, Italian, and Portuguese span 13 test sets. Across the synthesis-scale sweep, random augmentation improves over matched real-only continuation on 11 test sets. Under a nominal 60% synthesis budget, PFGS improves over real-only training on 12 test sets and over random selection on 9. Its largest relative word error rate (WER) reduction against random selection is 19.3%. With target texts and synthesis counts fixed, reference-speech filtering reduces absolute WER by 0.29 and 0.59 points on Italian and French Common Voice, respectively. These results identify synthesis scale, candidate-text content, and reference quality as important control variables in TTS-based ASR augmentation.

[32] Towards Expert Financial QA via Self-Improving RAG cs.CLPDF

Junjie Xiong, Shawheen Ghezavat, Aum Hirpara

TL;DR: 本文提出了一种名为Self-Improving RAG的框架，旨在解决专家级金融问答中需要基于事实验证和审计追踪的问题。该框架通过一个协调器管理三个专门代理（检索、推理和判断），并利用反馈驱动的自我纠正机制，在答案质量不达标时触发重试策略。

Details

Motivation: 标准单次检索增强生成系统缺乏对数值幻觉的验证和监管合规所需的审计追踪，无法满足专家级金融问答的要求。

Result: 在FinanceBench（SEC文件问答）基准测试中，Self-Improving RAG实现了86%的oracle引导准确率（与标准答案的一致性），Lazarus Rate为36.4%，通过针对性重试恢复了近40%的初始错误答案。

Insight: 核心创新在于采用固定检索流程结合判断驱动的重试机制，无需动态路由即可实现强大性能，同时保证了完全的可解释性；所有决策均记录置信度分数，为受监管的金融应用提供了必要的审计追踪。

Abstract: Expert-level financial question answering requires both grounded verification to catch numeric hallucinations and audit trails for regulatory compliance, attributes that standard single-pass RAG systems lack. We take a step toward this goal with Self-Improving RAG, a framework that decomposes document QA into three specialized agents (Retrieval, Reasoning, and Judge) coordinated by an orchestrator with feedback-driven self-correction. When the Judge Agent scores an answer below a dynamic threshold, the system triggers retry with escalated strategies: broader retrieval, more careful prompting, and relaxed acceptance criteria. We evaluate on FinanceBench (SEC filing QA), where Self-Improving RAG achieves 86% oracle-guided accuracy (measuring agreement with gold answers) with a 36.4% Lazarus Rate, recovering nearly 4 in 10 initially incorrect answers through targeted retry. A key finding is that a fixed retrieval pipeline with judge-driven retry achieves strong results without dynamic routing, providing full interpretability. Every decision is logged with confidence scores, enabling the audit trails required for regulated financial applications.

[33] Preserving General Capabilities during Domain Specialization with Uncertainty-Calibrated MOPD cs.CLPDF

Ziyuan Liu, Jiao Ou, Jian Liang, Ruiming Tang, Cheng Luo

TL;DR: 本文提出了一种不确定性校准的多教师策略蒸馏方法，用于在领域专业化过程中保持大语言模型的通用能力。该方法通过双温度采样扩展轨迹候选池，利用正优势密度过滤选择更强的学习信号，并通过中心化对数似然过滤基于熵校准的教师认可分数来概率性地保留令牌更新。在角色扮演和医疗领域的实验中，该方法显著提升了通用能力的平均表现。

Details

Motivation: 大语言模型在垂直领域专业化时，往往会提升领域特定性能，但导致通用能力（如推理、编码、指令遵循和创意写作）下降。标准的多教师策略蒸馏方法存在两个局限：普通策略采样很少暴露具有较大正教师-学生优势的令牌，且仅凭优势符号无法确定更新方向的可靠性。

Result: 在角色扮演和医疗领域专业化任务上的实验表明，该方法相比标准MOPD分别将通用能力平均提升了4.73%和10.84%，同时保持了垂直领域的性能。消融实验和诊断分析进一步证实了增益并非仅源于更大的采样预算，且所提出的轨迹和令牌级机制有效解决了预期的失败模式。

Insight: 创新点在于引入了不确定性校准机制来优化策略蒸馏过程，具体包括双温度采样以增加探索、正优势密度过滤以强化学习信号，以及基于熵校准的中心化对数似然过滤来确保更新方向的可靠性。这为在保持模型通用能力的同时进行领域适应提供了一种可借鉴的框架。

Abstract: Specializing large language models to vertical domains improves domain-specific behavior but often degrades general capabilities such as reasoning, coding, instruction following, and creative writing. We study this domain–general trade-off in Multi-Teacher On-Policy Distillation (MOPD), where a specialized student is supervised on its own sampled trajectories by domain and general teachers. Standard MOPD faces two limitations: ordinary on-policy sampling rarely exposes tokens with large positive teacher–student advantages, while the advantage sign alone does not establish whether the resulting update direction is reliable. We propose uncertainty-calibrated MOPD to address these limitations. Dual-temperature sampling broadens the candidate trajectory pool, and positive-advantage-density filtering selects trajectories with stronger positive learning signals. Centered log-likelihood (CLL) filtering then computes an entropy-calibrated teacher-endorsement score and probabilistically retains token updates according to direction–endorsement consistency. Experiments on role-playing and medical-domain specialization show that our method improves the general-capability average over standard MOPD by $4.73%$ and $10.84%$, respectively, while maintaining vertical-domain performance. Ablations and diagnostic analyses further confirm that the gains do not merely result from a larger rollout budget and that the proposed trajectory- and token-level mechanisms address their intended failure modes.

[34] Letters hide the truth from our eyes: English homophones have meaningfully different phonetic realizations cs.CLPDF

Yu-Hsiang Tseng, Mirjam T. C. Ernestus, Louis F. M. ten Bosch, R. Harald Baayen

TL;DR: 该论文通过分析美国电视新闻广播中的14,000个同音异义词实例，发现英语同音词（如’weight’和’wait’）在语音实现上存在系统性差异，这些差异可由其在语境中的含义预测，且与使用频率无关。研究还表明，时间归一化的声谱图是探究语音细节的有效工具，优于传统的音标转录。

Details

Motivation: 研究动机是探究英语同音词除了已知的时长差异外，其他语音特征（如音质）是否也存在差异，以揭示语境意义对语音产生的潜在影响。

Result: 定量分析显示，同音词对在语音实现上存在可预测的差异，这些差异在控制时长变量后依然显著，表明语音实现与语义相关。

Insight: 创新点在于使用时间归一化声谱图直接分析语音细节，避免了音标转录的信息损失，并揭示了语境语义对同音词语音产生的系统性影响，为语音变异研究提供了新方法。

Abstract: The distribution of spoken word duration of English homophones is known to co-vary with frequency of use. This study investigates whether other aspects of the phonetic realization of homophones also differ. A series of quantitative investigations of 14,000 homophone tokens in American television news broadcasts revealed that the tokens of homophone pairs such as \textit{weight} and \textit{wait} have different phonetic realizations, and that these can be predicted from their meanings in utterance context. These systematic differences remain even when taking duration-related variation into account. Time-normalized spectrograms emerged as an excellent tool for probing the fine details of phonetic realization, and obviate the need for phonetic transcriptions, which inevitably hide the phonetic truth from our eyes.

[35] RuleWeaver: Benchmarking Rule-Centered Scenario Reasoning for Large Language Models cs.CLPDF

Bohan Yu, Shi-Yang Li, Pengfei Cao, Jun Zhao, Kang Liu

TL;DR: 本文提出了RuleWeaver，一个用于评估大语言模型在规则中心化场景推理能力的基准构建框架。该框架从语料库中提取IF-THEN元规则，逐步增强为复杂规则，并组合成问答实例进行测试。实验表明，当前LLMs在处理复杂规则推理时仍面临困难，最佳模型得分仅约满分的50%。

Details

Motivation: 现有基准在评估大语言模型对领域专业知识中复杂规则的推理能力方面存在不足，要么只关注输出层面的指令约束，要么忽视了规则在场景推理中的独特作用。

Result: 在11个代表性大语言模型上的实验结果显示，当前模型在复杂规则中心化场景推理任务上表现不佳，即使最佳模型在基于量规的答案质量评估中也仅达到约50%的最高分。

Insight: 创新点在于提出了一个系统性的基准构建框架，不仅评估最终答案正确性，还通过基于量规的答案质量、规则召回率和精确度支持过程级评估，从而更全面地衡量模型对规则的理解和应用能力。

Abstract: Large language models (LLMs) are increasingly applied to specialized domains, where effective use of domain expertise often requires reasoning over complex rules in concrete scenarios. However, existing benchmarks only partially evaluate this capability, as they either focus on output-level instruction constraints or overlook the distinct roles that rules play in scenario reasoning. To address these gaps, this paper introduces RuleWeaver, a benchmark construction framework for evaluating rule-centered scenario reasoning. RuleWeaver starts from corpus-derived IF-THEN Meta Rules, progressively augments them into complex rules, and composes these rules into rule-centered scenario QA instances. Beyond final-answer correctness, RuleWeaver further supports process-level evaluation through rubric-based answer quality, rule recall, and rule precision. Experiments on 11 representative LLMs show that current models still struggle with complex rule-centered scenario reasoning, with even the best-performing model achieving only around 50% of the maximum rubric score. We make our code and dataset available here: https://github.com/SharkSpicy-NLP/RuleWeaver.

[36] Behavior2Trip: Towards Personalized Travel Planning via User Behavior Trajectory cs.CL | cs.AIPDF

Zihao Cheng, Yingyu Shan, Hongru Wang, Zeming Liu, Xinyi Wang

TL;DR: 本文提出了一个名为‘行为感知旅行规划’的新任务，旨在通过分析用户历史行为轨迹来推断其偏好，从而生成个性化旅行计划。为此，作者构建了基于大型中文在线旅行平台的Behavior2Trip基准数据集，并提出了一个基于强化学习的B2T-Agent，该智能体利用用户行为轨迹、与外部工具交互进行偏好对齐检索，并维护内部记忆模块。实验表明，B2T-Agent在Behavior2Trip基准上超越了所有基线模型，并在TravelPlanner基准上展现出强大的泛化能力。

Details

Motivation: 现有旅行规划智能体要么依赖用户明确指令，要么通过多轮澄清对话来获取用户偏好，这两种方式都忽略了用户历史行为中蕴含的丰富偏好信号，增加了用户交互负担并限制了计划的个性化程度。

Result: 在提出的Behavior2Trip基准测试中，GPT-4.1在最难任务上的全约束通过率仅为0.5%，而基于Qwen3-8B构建的B2T-Agent超越了所有基线模型。此外，使用B2T-Agent训练的Qwen3-8B在TravelPlanner基准上也超越了GPT-4.1，展示了强大的泛化能力。

Insight: 论文的核心创新在于将用户历史行为轨迹作为隐式偏好信号引入旅行规划任务，并为此构建了大规模、多维度标注的基准数据集。提出的B2T-Agent融合了强化学习、外部工具交互和内部记忆模块，为基于行为的个性化推荐系统提供了新的技术框架和评估标准。

Abstract: Travel planning agents assist users in generating personalized travel plans by modeling their individual preferences. Existing agents either rely on explicit user instructions or engage in multi-turn clarification to elicit user preferences. However, both approaches overlook the rich behavioral signals latent in users’ past behaviors, which implicitly encode their preferences. This over-reliance on active user input increases interaction burden and limits plan personalization. To bridge this gap, we introduce a new task, Behavior-Aware Travel Planning, which infers user preferences directly from past behaviors and generates personalized travel plans. To facilitate research on this task, we introduce Behavior2Trip, a benchmark constructed from one of the largest Chinese online travel platforms, comprising 11,400 instances. Each instance represents an average of 39.8 past user behaviors spanning 14 attributes across 5 preference dimensions. We further propose B2T-Agent, a reinforcement learning-based agent that leverages user behavior trajectories, interacts with external tools for preference-aligned retrieval, and maintains an internal memory module. Experiments on Behavior2Trip show that GPT-4.1 achieves a full-constraint pass rate of only 0.5% on the hardest tasks, while B2T-Agent built upon Qwen3-8B outperforms all baselines, highlighting the substantial challenge of this task. Moreover, Qwen3-8B trained with B2T-Agent also outperforms GPT-4.1 on the TravelPlanner benchmark, demonstrating strong generalization. Code and data are available at https://github.com/BUAA-IRIP-LLM/Behavior2Trip

[37] Mapping Written Words to Spoken Words in a Different Language Using Only Visual Grounding cs.CL | eess.ASPDF

Gabriel Pirlogeanu, Dan Oneata, Horia Cucu, Herman Kamper

TL;DR: 本文提出了一种基于对齐的方法，用于从视觉基础数据中学习跨语言单词到语音的映射，无需转录或显式模型训练。该方法利用自监督语音表示，通过自动获取图像英文标签并对其对应的印地语语音进行对齐，从而识别目标单词的重复语音片段。实验表明，该方法在关键词检测和定位任务上优于先前的基于注意力的神经模型。

Details

Motivation: 在低资源环境下，收集语音数据困难，而通过图像描述获取视觉基础语音数据是一种有前景的途径。本文旨在解决如何从这种数据中构建模型，将书面英语关键词映射到印地语口语实现的问题。

Result: 在关键词检测和定位实验中，该方法在视觉基础数据集上超越了先前基于注意力的神经模型，并展示了在对齐过程中融入负样本的益处。

Insight: 创新点在于采用简单的基于对齐的方法，而非端到端多模态神经网络，利用自监督语音表示和现成的图像描述系统，直接从视觉基础中学习跨语言映射，无需转录或显式训练，为低资源语音处理提供了高效解决方案。

Abstract: In many low-resource settings, even just eliciting speech for data collection is difficult. One promising approach has been to ask speakers to describe images. But how do we build models from such visually grounded speech data? Given a dataset of images with Hindi spoken captions, we consider how we can map a written English keyword to spoken realisations of that word in Hindi. Previous work trained end-to-end multimodal neural models. Instead, we explore a simpler alignment-based approach built on self-supervised speech representations. Written English tags are automatically obtained from images using off-the-shelf image captioning systems. Hindi utterances associated with the same keyword are then aligned (using self-supervised features), and alignment evidence is aggregated to identify recurring speech segments corresponding to the target word. Experiments evaluating keyword spotting and localization show that our alignment-based approach outperforms a previous attention-based neural model. We also show the benefit of incorporating negative examples during alignment. Our work demonstrates that cross-lingual word-to-speech mappings can be learned directly from visual grounding without transcriptions or explicit model training.

[38] JudgeStealer: Extracting LLM Judging Capabilities across Evaluation Protocols cs.CLPDF

Chen Chen, Yaolin Chen, Xuehan Sun, Juan Lin, Xueluan Gong

TL;DR: 本文提出了JudgeStealer，首个针对LLM评判能力的查询高效模型提取框架，旨在复制点式评分、成对比较和列表排序三种评估协议下的评判能力。该框架利用跨协议一致性获取点式分数并转换为其他监督信号，通过动态输入选择、分数平滑和多协议审查等技术提升查询效率和模型性能。

Details

Motivation: LLM评判能力作为重要知识产权，在黑盒访问下易受模型提取攻击，现有方法未专门针对LLM评判器且在多评估协议下查询效率有限，因此需要开发高效提取框架。

Result: 在SOTA的LLM-as-a-judge和奖励模型上的实验表明，JudgeStealer在点式、成对和列表评估中分别达到73.3%、87.0%和71.6%的准确率，优于现有基线，并在不同代理模型规模、适应策略和推理设置下保持有效，且对防御方法具有鲁棒性。

Insight: 创新点在于利用跨协议一致性减少查询需求，并通过动态选择（语义多样性、预测不确定性和偏见）提升效率，同时采用分数平滑和多协议审查来保持分数序结构并缓解灾难性遗忘，为模型提取攻击提供了新视角。

Abstract: Large language model (LLM) judges are increasingly used across various evaluation scenarios, making their judgment capabilities valuable intellectual property. However, black-box access exposes these capabilities to model extraction attacks. Existing extraction methods do not specifically target LLM judges and provide limited support for multiple evaluation protocols under restricted query budgets. In this study, we propose JUDGESTEALER, the first query-efficient model extraction framework for replicating judging capabilities across pointwise scoring, pairwise comparison, and listwise ranking protocols. JUDGESTEALER exploits the strong cross-protocol agreement to acquire pointwise scores and transform them into pairwise and listwise supervisions without additional victim queries. To capture informative judge patterns and improve query efficiency, JUDGESTEALER dynamically selects pointwise inputs based on semantic diversity, predictive uncertainty, and potential judge biases. It further applies score smoothing and multi-protocol review to preserve the ordinal structure of scores and mitigate catastrophic forgetting during surrogate adaptation. Extensive experiments on state-of-the-art LLM-as-a-judge and reward models show that JUDGESTEALER consistently outperforms existing extraction baselines, achieving up to 73.3%, 87.0%, and 71.6% accuracy for pointwise, pairwise, and listwise evaluation, respectively. JUDGESTEALER also remains effective across different sur- rogate model scales, adaptation strategies, and reasoning settings. Moreover, JUDGESTEALER demonstrates robustness against representative extraction defenses.

[39] Reasoning about In-Context Samples for Machine-Translation cs.CLPDF

Maxime Bouthors, Josep Crego, François Yvon

TL;DR: 本文提出了一种新颖的基于片段的推理框架，用于提升大语言模型在机器翻译任务中的性能。该方法首先从检索到的相似示例中提取并行的源语言-目标语言片段，并将这些片段作为中间推理轨迹来生成最终翻译。实验表明，该方法在Qwen3模型家族上，跨6种语言和多个领域，显著优于标准的k-shot或基础草稿生成方法。

Details

Motivation: 动机在于利用大语言模型的显式推理能力来改进基于上下文的机器翻译，通过引入中间推理步骤来提高翻译的可靠性。

Result: 在Qwen3模型家族上，针对6种语言（每种语言最多包含5个领域）的实验表明，基于片段的机器翻译方法显著优于标准的k-shot提示和基础草稿生成方法，取得了更好的性能。

Insight: 创新点在于提出了一个片段化的推理框架，将翻译过程分解为从示例中提取并行片段并以此作为推理轨迹的步骤。这为将复杂推理结构（如思维链）应用于生成任务（如翻译）提供了一种新的、可借鉴的思路。

Abstract: Large Language Models (LLMs) can be trained to perform chain-of-thoughts reasoning in order to improve the reliability of their responses. In this work, we investigate how explicit reasoning can be leveraged for LLM-Based Machine Translation (MT) with in-context samples. We introduce a novel fragment-based reasoning framework in which the model first extracts parallel source-target fragments from retrieved similar exemplars, and uses these fragments as intermediate reasoning traces to produce the final translation. To train our model, we distill silver fragments and drafts from a large teacher model. Our experiments with the Qwen3 model family, over 6 languages, including up to 5 domains per language, demonstrate that fragment-based MT significantly outperforms alternative methods like standard k-shot or basic drafting.

[40] Cascaded Batch Prompting cs.CLPDF

Sho Hoshino, Peinan Zhang

TL;DR: 本文提出了一种名为级联批量提示（cascaded batch prompting）的两阶段方法，旨在解决传统批量提示（batch prompting）在下游任务性能上的不可预测性问题。该方法通过将复杂推理与符号落地（symbol grounding）解耦，在多项选择题回答和自然语言推理任务上超越了标准单提示基线，并实现了与批量大小成比例的加速，在帕累托前沿（Pareto frontier）上建立了新的最优性能。

Details

Motivation: 动机是解决传统批量提示方法在处理多个实例时虽能提升大语言模型推理效率，但其下游任务性能不可预测的问题。

Result: 在多项选择题回答和自然语言推理任务上的实验表明，该方法优于标准单提示基线，实现了与批量大小成比例的加速，并在帕累托前沿上达到了新的最优水平（SOTA）。

Insight: 核心创新点是提出了一个两阶段的级联框架，将复杂推理与符号落地解耦，从而在保持批量处理效率优势的同时，稳定并提升了任务性能，为高效且可靠的批量推理提供了新思路。

Abstract: Although batch prompting makes large language model inference more efficient by processing multiple instances simultaneously, it suffers from unpredictable downstream task performance. We propose cascaded batch prompting, a two-stage approach designed to resolve the unpredictability of conventional batch prompting by disentangling complex reasoning from symbol grounding. Experiments on multiple-choice question answering and natural language inference demonstrate that the proposed method outperforms the standard single prompting baseline while achieving a speedup proportional to batch size, establishing a new state of the art on the Pareto frontier.

[41] DocTalkBN: A Novel Dataset of Expert Telemedicine Conversations in Bengali cs.CLPDF

Anik Saha, Fahmida Sultana Naznin, Sadatul Islam Sadi, Ananya Shahrin Promi, Wahid Al Azad Navid

TL;DR: 本文介绍了DocTalkBN，一个孟加拉语专家远程医疗对话的大规模多模态数据集，包含557.63小时的配对音频和文本，覆盖26个医学专科。该数据集旨在为低资源语言提供真实、自发的医患互动数据，以支持可靠的医疗对话AI研究。

Details

Motivation: 可靠的医疗对话AI需要真实的专家-患者互动数据，但此类数据集稀缺，尤其是在孟加拉语等低资源语言中。

Result: 基于该数据集构建了医疗分诊分类、建议安全性评估和医疗命名实体识别三个下游任务，并对多种大语言模型和基于编码器的基线进行了基准测试，结果表明DocTalkBN对于临床推理任务具有实际效用。

Insight: 创新点在于提供了首个源自真实广播远程医疗节目、保留自发性和口语特征的大规模孟加拉语医疗对话数据集，弥补了以往资源（如医疗论坛、书面内容或合成数据）的不足，并支持基准驱动的研究。

Abstract: Reliable medical conversational AI requires authentic expert–patient interaction data, yet such datasets remain scarce, especially for low-resource languages such as Bengali. We present DocTalkBN, a large-scale multimodal dataset of real-world expert telemedicine conversations in Bengali, collected from nationally broadcast telemedicine programs featuring board-certified physicians. DocTalkBN contains 557.63 hours of paired audio and text, 1,515 multi-turn patient calls, 10,274 host–doctor question–answer exchanges, totaling 1.7M tokens, spanning 26 medical specialties. Unlike prior resources derived from medical forums, written health content, or synthetic data, our dataset preserves the spontaneity, contextual richness, and spoken characteristics of authentic medical interactions in a low-resource setting. To support benchmark-driven research, we further construct three downstream tasks from the corpus, medical triage classification, advice safety evaluation, and medical named entity recognition, and benchmark a diverse set of large language models and encoder-based baselines. Our results show that DocTalkBN is a practically useful resource, particularly for clinically grounded reasoning tasks. We release this resource to facilitate future research on reliable medical NLP and safer, more culturally grounded healthcare systems for low-resource languages. Our source codes and dataset are publicly available at https://anonymous.4open.science/r/doctalk.

Basel Mousi, Fahim Dalvi, Shammur Chowdhury, Firoj Alam, Nadir Durrani

TL;DR: 本文研究了多模态基础模型在跨模态（文本与语音）和跨语言（英语与阿拉伯语）输入下的语义一致性，发现模态和语言的切换会引入显著的推理不稳定性。作者构建了一个基于中东和北非地区文化图像的语音增强视觉对比三元组基准，包含10,150张图像，用于评估模型在语义等效查询中的表现。

Details

Motivation: 解决多模态模型在语音助手等实际应用中，面对语义等效但模态或语言不同的查询时，是否能够保持判断一致性的问题。

Result: 评估显示，近期多模态模型在文本与语音、英语与阿拉伯语的切换下，产生了大量三元组级别的不一致性，这些不一致性无法被聚合准确率完全捕捉，且语音输入会放大局部失败。

Insight: 创新点在于定义了对比不稳定性指标，以隔离模型碎片化推理与完全失败，并构建了一个文化背景丰富的语音增强视觉基准；客观来看，该研究揭示了多模态模型跨模态泛化中的潜在脆弱性，对鲁棒性评估具有重要意义。

Abstract: Multimodal foundation models are increasingly used in speech-first assistants that must interpret spoken queries and produce visually grounded decisions. Yet it remains unclear whether semantically equivalent queries yield consistent judgments across modality (text vs. speech) and language (English vs. Arabic). We introduce a speech-augmented visually grounded contrastive triplet benchmark spanning 10,150 culturally grounded images from 18 MENA countries, where each image is paired with one supported statement and two plausible but unsupported alternatives. We define contrastive instability as the conditional rate at which a model fails to resolve all statements within a triplet, isolating fragmented reasoning from complete failure. Evaluating recent multimodal models under text and speech in English and Arabic, we find that modality and language shifts introduce substantial triplet-level inconsistencies that are not fully captured by aggregate accuracy, with speech amplifying partial failures. We make the benchmark publicly available to the community.

[43] When Text Misleads: Inconsistent-Aware Reasoning for Audio-Grounded Dialogue cs.CL | cs.AI | cs.LG | eess.ASPDF

Yen-Ju Lu, Yuzhe Wang, Yaohan Guan, Xiluo He, Jiarui Hai

TL;DR: 本文提出ContraTalk基准，用于评估语音对话理解中跨模态不一致问题，即文本转录与声学线索（如语调、说话风格）存在冲突的情况。作者开发了Audio Twin框架，将声学线索转化为文本可读表示，以增强模型对语音的推理能力。

Details

Motivation: 现有语音对话理解评估常依赖文本转录或单模态方案，掩盖了模型是否真正基于语音进行预测的问题，本文旨在解决跨模态不一致（文本与声学线索冲突）导致的模型误判。

Result: 在ContraTalk基准（包含501个问题，覆盖五个话语维度）上，纯文本LLM在一致情况下准确率超过90%，但在冲突情况下降至33-48%；直接AudioLLM在约30-40%冲突情况下仍选择文本偏向的陷阱答案，而Audio Twin框架提高了冲突情况准确率并减少了陷阱选择。

Insight: 创新点包括形式化跨模态不一致问题、构建对抗性基准ContraTalk以暴露文本偏向的捷径，以及提出Audio Twin框架将声学证据显式聚合为文本可读表示，为诊断和改进语音推理提供可控接口。

Abstract: Understanding spoken dialogue requires joint reasoning over lexical content and paralinguistic acoustic signals such as emotion and conversational intent. However, existing evaluations often allow shortcuts based on transcripts or single-modality solutions, obscuring whether models genuinely ground predictions in speech. We formalize this failure mode as cross-modal disagreement, where transcripts suggest plausible but incorrect surface interpretations while acoustic cues such as prosody or speaking style support different answers. We develop a scalable framework that identifies text-biased surface interpretations and converts disagreement regions into conflict QA examples. We also include consistent cases where transcript-based and speech-grounded interpretations agree, enabling evaluation beyond adversarial audio dependence. This results in ContraTalk, a controlled benchmark containing 501 questions across five discourse dimensions: interaction behavior, emotion state, dialogue act, social stance, and conversational intent. We further develop an agentic-style reasoning framework that converts speech into an Audio Twin, a text-readable representation of localized acoustic cues that exposes acoustic evidence to the reasoning model. Experiments show that strong text-only LLMs exceed 90% accuracy in consistent cases but drop to 33-48% in conflict cases. Direct AudioLLMs provide only partial grounding, still selecting the transcript-biased trap in roughly 30-40% of conflict cases. Our Audio Twin framework improves conflict-case accuracy while reducing trap selection, but its consistent-case behavior remains backbone-dependent. These results identify transcript-based shortcuts as an important failure mode in spoken dialogue understanding and show that explicit acoustic evidence aggregation provides a more controllable interface for diagnosing and improving speech-grounded reasoning.

[44] BALMS: Benchmarking Agentic LLMs for Longitudinal Mental Health Sensing cs.CLPDF

Yu Yvonne Wu, Arvind Pillai, Yuliang Chen, Yuwei Zhang, Sudarshan Regmi

TL;DR: 本文介绍了BALMS基准测试，用于评估基于LLM的智能体在纵向心理健康感知任务中的表现。该基准涵盖三个真实世界数据集、两个任务家族（封闭式健康评分预测和LLM作为评判者自动评分的理由生成），并评估了五种开源和闭源LLM骨干网络支持的三种智能体范式。研究发现，零样本智能体通常难以超越简单均值基线，但使用更强骨干网络或语义特征可提升性能；思维链提示能改善推理导向的骨干网络，但无法保证时间依据或数值准确性。

Details

Motivation: 现有心理健康评估依赖稀疏的自我报告量表，而可穿戴设备虽能提供连续行为与生理信号，但当前LLM驱动的个人健康智能体主要处理短期检索查询，缺乏对长期信号进行推理以预测健康评分并生成证据支持理由的能力。

Result: 在BALMS基准测试中，零样本智能体在多数情况下表现不及简单均值基线，除非使用更强LLM骨干或紧凑语义特征；思维链提示对推理导向骨干有改进，但未能确保时间依据和数值正确性。该研究未明确提及达到SOTA水平，而是揭示了现有方法的局限性。

Insight: 创新点在于构建了首个系统性评估纵向心理健康感知的LLM智能体基准，强调未来智能体需具备选择性检索历史、基于时间证据进行推理以及利用可解释行为特征的能力，为开发更有效的连续健康监测系统提供了方向。

Abstract: Mental health assessment relies on episodic self-report scales, which convert subjective states such as stress into numerical scores but provide only sparse snapshots of wellbeing. Wearable devices offer longitudinal behavioral and physiological signals for continuous, low-burden monitoring. Recent LLM-driven personal-health agents enable natural language queries over wearable signals, but mainly handle short-term, retrieval-based lookups (e.g., highest step count over a week). They do not evaluate whether agents can reason over long-term signals to predict wellbeing scores paired with evidence-grounded rationales. To address this gap, we introduce BALMS, the first systematic benchmark of LLM-based agentic systems for longitudinal mental health sensing. BALMS spans 3 real-world longitudinal datasets, 2 task families (closed-form wellbeing-score prediction and rationale generation auto-graded by an LLM-as-Judge), 3 agentic paradigms evaluated across 5 open- and closed-source LLM backbones. We find that zero-shot agents rarely outperform a simple mean baseline, except with stronger backbones or compact, semantically meaningful features. Chain-of-thought prompting improves reasoning-oriented backbones, but does not guarantee temporal grounding or numerical correctness. Together with more analysis on efficiency and temporal scaling, BALMS highlights the need for longitudinal mental health agents that selectively retrieve history, ground temporal evidence, and reason over interpretable behavioral features.

[45] SCIT: Testing Causal Cache Carriers in Latent Chain-of-Thought Models cs.CLPDF

Yi Ding, Lijun Huang, Menglin Yang

TL;DR: 本文提出了SCIT（后缀缓存交换测试），一种用于测试潜在思维链模型中因果缓存载体的协议。该方法通过构建精确的源-接收者反事实、修补声明的缓存段，以识别Transformer中承载反事实计算的具体对象。在CODI-GPT2和Sim-CoT风格的GPT-2模型上，实验表明反事实算术主要通过值缓存后缀轨迹传递，而非隐藏状态、键或单令牌触发器。SCIT揭示了不同模型能力下缓存载体机制的变化，为模型诊断提供了新工具。

Details

Motivation: 潜在思维链模型将中间推理过程从文本输出转移到连续状态，提高了紧凑性，但隐藏了因果对象。这导致难以理解和诊断模型内部的因果机制，因此需要一种方法来精确识别Transformer中承载反事实计算的具体缓存载体。

Result: 在CODI-GPT2和Sim-CoT风格的GPT-2模型上，SCIT测试表明反事实算术主要通过值缓存后缀轨迹传递，而非隐藏状态、键或可重用答案槽。对于CODI-GPT2检查点，晚期值后缀机制具有充分的充分性和必要性证据；而Sim-CoT风格检查点虽显示相同的充分性模式，但匹配损坏证据不足以支持必要性结论。此外，SCIT揭示了不同能力模型（如GPT-2/1B与8B）在缓存载体机制上的差异。

Insight: 创新点在于提出了SCIT这一因果协议，通过结合充分性测试与K/V组件分割、隐藏状态控制、语义源控制等方法，实现了对Transformer缓存载体的精确诊断。客观来看，该方法不仅提供了一种新的模型内部机制分析工具，还挑战了关于潜在思维链机制的普遍性假设，强调了模型能力对缓存载体路径的具体影响。

Abstract: Latent chain-of-thought models move intermediate reasoning from emitted text into continuous states, improving compactness but hiding the causal object. We introduce SCIT, the Suffix Cache Interchange Test, a causal protocol that constructs exact source-recipient counterfactuals, patches declared cache segments, and identifies which transformer object carries the counterfactual computation. SCIT combines sufficiency tests with K/V component splits, hidden-state controls, semantic source controls, decoded validation, and matched corruption. On CODI-GPT2 and a Sim-CoT-style GPT-2 reproduction, counterfactual arithmetic transfers primarily through value-cache suffix trajectories rather than hidden states, keys, reusable answer slots, or single-token triggers. Complete sufficiency-and-necessity evidence for the late-value-suffix mechanism holds for the main CODI-GPT2 checkpoint; the Sim-CoT-style checkpoint shows the same sufficiency and decoded-control pattern but insufficient matched-corruption evidence for a necessity call. Beyond these local arithmetic cells, SCIT reveals carrier-regime shifts: arithmetic-like GPT-2/1B cells preserve latent-tail value/KV transfer, whereas competent 8B and repaired non-arithmetic cells route through prompt-prefix or full-cache K/V; boundary cells receive no mechanism call. SCIT therefore contributes a cache-level diagnostic, a checkpoint-specific GPT-2 arithmetic mechanism, and a competence-gated carrier map rather than a universal latent-tail claim.

[46] BTS-AgentBench: A Deterministic, Replayable Pipeline from Read-Only Telemetry Logs to Agent Benchmarks cs.CL | cs.SEPDF

Jeong-Yoon Kim

TL;DR: 本文提出了BTS-AgentBench，一种将只读遥测日志转化为可执行多轮智能体基准测试的确定性、可复现的流水线方法。该方法通过规范化元数据和原始历史记录、编译静态任务并提升为面向操作员的回合，生成了包含532个任务的基准集，并在XAI4HEAT数据集上验证了其可扩展性。

Details

Motivation: 工业现场存在大量只读遥测数据，但缺乏将这些记录编译成可执行多轮智能体任务的标准化基准测试方法。

Result: 发布的基准集包含532个任务（训练/开发/测试集为356/87/89），构建过程零错误且两次独立构建完全复现了所有逻辑工具存储导出和发布产物。在XAI4HEAT数据集上生成的204个回合中，GPT-5.5在41个测试任务上全部执行成功。

Insight: 创新点在于提出了一种从只读日志到可复现基准的确定性流水线，引入了澄清、目标修订、时间戳策略和质量门控报告等机制，确保了基准构建的可靠性和可扩展性。

Abstract: Industrial sites contain large volumes of read-only telemetry, but few benchmarks specify how to compile these records into executable multi-turn agent tasks. We present a telemetry-to-episode construction method instantiated as BTS-AgentBench. The pipeline normalizes BTS metadata and raw histories into a read-only tool store, compiles static tasks with tool-derived gold answers and evidence, and lifts retained tasks into typed, bounded operator-facing episodes. The 532-row release adds clarification, goal revision, timestamp policy, quality-gated reporting, and evidence attribution while preserving the source computation and split. Coded contract preflight reports zero findings, and the construction-exclusion controller completes 0/532 rows. Two independent raw-to-episode builds match all 11 logical tool-store exports and reproduce the released 356/87/89 train/dev/test artifact exactly. Applying the shared construction path to XAI4HEAT produces 204 episodes; on its 41-row held-out test split, the controller completes 0 rows and the retained GPT-5.5 execution completes all 41. Code, artifacts, and replay reports are available at https://github.com/kjy7567/BTS-AgentBench.

[47] INTENT-AS-A-TOOL Makes it Easy to Track Agentic Misalignment cs.CLPDF

Yutong Zhang, Jianshuo Dong, Peng Xu, Long Wang, Jie Zhang

TL;DR: 本文研究LLM作为自主代理时的安全性问题，提出了一种名为INTENT-AS-A-TOOL的方法来追踪代理错位。该方法通过引入意图导向的工具，为模型提供了一个表达行为承诺的专用通道，从而将事后思维链标签扩展为密集的意图轨迹，并识别在线干预的关键步骤。

Details

Motivation: 随着大型语言模型被部署为自主代理，涉及严重后果的安全故障日益增多。作者旨在研究代理错位问题，即代理在目标冲突和压力下采取有害行动的现象。

Result: 研究结果表明，INTENT-AS-A-TOOL方法补充了思维链监控，将事后思维链标签扩展为密集的轨迹，并能识别在线干预的关键步骤。

Insight: 创新点在于提出了意图即工具的方法，通过意图工具调用的概率提供了一个无需人工评判的、细粒度的信号来追踪模型在推理过程中的行为倾向，这为理解和干预代理错位提供了新工具和视角。

Abstract: As large language models (LLMs) are deployed as autonomous agents, safety failures increasingly involve consequential actions. We study agentic misalignment, where agents take harmful actions under goal conflicts and pressures. Using chain-of-thought (CoT) monitoring, we find that harmful execution is often preceded by intent signals in reasoning. However, post-hoc CoT labels are too coarse to show how intent changes during generation. We introduce INTENT-AS-A-TOOL, an approach that adds intent-targeted tools to give the model a dedicated channel for expressing commitment to a target behavior. The probability of calling an intent tool provides a judge-free, fine-grained signal of the model’s tendency to pursue that behavior. Our results show that INTENT-AS-A-TOOL complements CoT monitoring, expands post-hoc CoT labels into dense trajectories, and identifies critical steps for online intervention. These findings suggest that action preferences are useful for tracking agentic misalignment during reasoning. Our code and data are accessible: https://github.com/RebeccaZhang22/intent-as-a-tool.

[48] RCMN: Understanding Misleadingness in Influential Public Discourse cs.CL | cs.AIPDF

Peiling Yi

TL;DR: 本文提出了读者中心误导性理解（RCMN）框架，通过五个维度（误导机制、读者解读、证据支持的解读、情感唤起、沟通意图）来操作化分析有影响力的公共话语中的误导性。基于此框架构建了一个基于证据的数据集，并研究了轻量级声明-上下文表示是否足以理解误导性，评估了五个生成式基础模型。

Details

Motivation: 现有研究较少关注有影响力的公共话语如何产生误导性以及如何塑造读者的解读，本文旨在填补这一空白。

Result: 实证结果表明误导性机制多样，远超捏造，包括无根据的推断、夸张和遗漏等，且常与高度的情感唤起和扭曲的沟通意图相关。对五个生成式基础模型的评估显示，从轻量级表示中恢复读者层面的解读是可行的，但识别误导性产生机制仍具挑战性。

Insight: 创新点在于提出了一个多维度的读者中心误导性理解框架，并构建了相应的证据数据集。客观来看，该研究强调了轻量级表示在可扩展误导性分析中的潜力，同时指出可靠理解误导机制仍需更丰富的上下文和证据基础。

Abstract: Influential public discourse shapes public beliefs and can also mislead, not only through what is stated, but also through how information is framed, omitted, contextualised, and communicated. Yet less research has focused on how such misleadingness arises and shapes the interpretations formed by readers. To address this gap, we introduce Reader-Centric Misleadingness Understanding (RCMN), a framework that operationalises misleadingness through five dimensions: misleading mechanism, likely reader interpretation, evidence-warranted interpretation, emotional arousal, and communicative intent. Based on this framework, we construct an evidence-grounded dataset of influential public discourse. Empirical findings show that misleadingness is diverse and extends well beyond fabrication, with unsupported inference, exaggeration, and omission among the prevalent mechanisms, and is frequently associated with heightened emotional arousal and distortive communicative intent. Moreover, we investigate whether lightweight claim-and-context representations retain sufficient cues for understanding reader-centric misleadingness without access to richer contextual, evidential, and multimodal information. Evaluation across five recent generative foundation models shows that reader-level interpretations can often be recovered from such limited representations, whereas identifying how misleadingness is produced remains considerably more challenging. These findings highlight the potential of lightweight representations for scalable misleadingness analysis, while reliable understanding of misleading mechanisms continues to require richer contextual and evidential grounding.

[49] RATIO: A Benchmark for Retrieval Across Typed Ideation Operations in Scientific Literature cs.CL | cs.IRPDF

Maayan Sharon, Tom Hope

TL;DR: RATIO是一个用于评估科学文献检索系统在支持不同类型创意操作（即‘创意移动’）方面性能的大规模基准。该基准定义了三种相关性操作：Address（针对问题检索解决方案）、Broaden（检索更通用的表述）和Specify（检索具体实例）。它通过结合远距离监督、LLM和人工审核，从数百万篇计算机科学全文论文中构建而成，旨在为支持文献驱动的创意生成提供可扩展的训练和评估框架。

Details

Motivation: 当前的科学文献检索通常服务于直接的信息查找，但检索到的文献也可以作为人类和AI科学家的灵感来源，这种灵感可以采取不同的形式（如直接解决问题、提供更通用的视角或具体的实现方案）。论文旨在解决现有检索基准缺乏对这类‘创意移动’操作进行评估的问题。

Result: 实验表明，针对特定操作（Address, Broaden, Specify）进行微调可以显著提升检索器的性能，但仍存在很大的改进空间。RATIO为评估支持文献驱动创意的检索组件提供了一个新的基准。

Insight: 论文的核心创新点在于将科学文献检索的‘相关性’概念扩展为三种类型化的创意操作（创意移动），并提出了一个可扩展的构建基准的方法，该方法将原本用于分类的‘话语标记远距离监督’扩展到语料库规模的检索任务中，为科学灵感检索开辟了新的研究方向。

Abstract: Retrieved scientific literature can serve as inspiration for both human and AI scientists. Inspiration can take different forms: prior work may directly suggest how to address a problem, or surface directions at different levels of abstraction - zooming out to a more general view or zooming in to a concrete realization. We introduce RATIO (Retrieval Across Typed Ideation Operations), a large-scale benchmark in which relevance is defined by three operations which we name ideation moves: Address retrieves potential approaches for stated problems, Broaden retrieves more general formulations, and Specify retrieves concrete instantiations. RATIO is constructed from millions of full-text scientific papers across CS literature via a general recipe that extends discourse-marker distant supervision - previously used only for classification - to corpus-scale retrieval, combined with extensive LLM and human vetting. Experiments show that operation-specific fine-tuning substantially boosts retrievers but leaves much room for further improvements. RATIO provides a scalable training and evaluation framework for retrieval components that support literature-grounded ideation, opening up new research avenues on scientific inspiration retrieval.

[50] Consolidating RLVR Capabilities Across Domains: A Deep Dive into Fusion Paradigms cs.CLPDF

Siye Wu, Kai Yang, Yuchen Cai, Xin Xu, Peng-Yuan Wang

TL;DR: 本文系统比较了三种融合可验证奖励强化学习（RLVR）领域专家能力的范式：Merge（合并专家任务向量）、Mix RL（混合专家数据集）和多教师策略蒸馏（MOPD）。研究通过共享专家和数据，在不同模型规模和跨领域基准测试中评估了它们的性能差异、训练动态和适用场景，并提出了基于实际需求的选择指南。

Details

Motivation: 当前RLVR方法为提升大语言模型的特定能力需训练多个领域专家并进行整合，但不同融合范式（Merge、Mix RL、MOPD）的研究相对孤立，缺乏系统比较和选择依据，因此需要明确它们的性能差异与适用条件。

Result: 在跨领域基准测试中，三种范式的平均性能差异最多仅1.4个百分点，但在单个基准上差距可达8.6分；领域级性能差异与任务向量几何中可见的跨领域关系相关。所有方法均提升了单样本准确率，但未显著改善解决方案覆盖率或导致已有能力损失。

Insight: 创新点在于首次系统比较了三种RLVR融合范式，揭示了它们各自的内在约束（Mix RL依赖领域混合比例、MOPD受限于教师性能、Merge压缩所有专家更新），并提出了实用选择指南：根据专家存在性、成本、跨领域迁移和领域特异性保持等需求灵活选用不同范式。

Abstract: Reinforcement learning with verifiable rewards (RLVR) improves specific capabilities of large language models, but covering multiple capabilities often involves training separate domain experts and subsequently consolidating them. We organize three fusion paradigms by the artefacts they reuse: Merge combines expert task vectors, Mix RL pools their datasets, and multi-teacher on-policy distillation (MOPD) uses both. Because they have largely been studied in isolation, how they compare and how to choose among them remain unclear. We compare all three using shared experts and data across model scales and a multi-domain benchmark suite. Although their average performance differs by at most 1.4 points, the gap reaches 8.6 points on a single benchmark, with domain-level variation tracking cross-domain relations visible in task-vector geometry. Training dynamics expose distinct constraints: Mix RL depends on domain mixture proportions, MOPD remains bounded by its teachers, and Merge compresses all expert updates into one. All three improve single-sample accuracy without measurable gains in solution coverage or losses in held-out capabilities. These results yield a practical guideline: use Merge when experts already exist and cheap fusion is paramount; Mix RL when training a unified model without experts, with domain proportions adjusted for cross-domain transfer; and MOPD when preserving domain-specific gains matters more than surpassing teachers or minimizing end-to-end cost.

[51] Boosting LLM Exploration via Weak-Model Guidance in RLVR cs.CLPDF

Xingyu Shen, Huishuai Zhang, Peng Li, Yinchun Wang, Dongyan Zhao

TL;DR: 本文提出了一种在RLVR（可验证奖励的强化学习）训练中提升大型语言模型探索能力的方法。该方法通过引入一个更小、更弱的语言模型生成的部分推理轨迹作为前缀，强制目标模型基于这些不熟悉的输入进行生成，从而打破模型的过度自信，鼓励其探索多样化的推理路径。实验表明，该方法能有效缓解RLVR训练中的熵崩溃问题，显著提升大k值下的pass@k性能，并扩展了推理覆盖范围。

Details

Motivation: RLVR虽然能提升LLM推理能力，但常导致策略熵下降，从而缩小推理覆盖范围并降低大k值下的pass@k性能。现有方法主要通过算法正则化来缓解熵崩溃，但忽略了跨模型的非参数化扰动潜力。

Result: 在多个数学推理基准测试上的实验表明，该方法始终优于原始RLVR方法。性能增益随着k值的增大而愈发显著，证明了其能大幅扩展推理覆盖范围。

Insight: 核心创新点是利用弱模型生成的外部前缀来引导目标模型的探索，这是一种简单有效的跨模型扰动策略。其机制在于利用分布差异来影响RLVR训练中的探索动态，无需额外的监督微调、复杂的奖励设计或提示工程即可缓解熵崩溃。

Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) significantly improves LLM reasoning but often causes a drop in policy entropy, leading to narrowed reasoning coverage and degraded pass@$k$ for large $k$. While existing methods mitigate this entropy collapse through algorithmic regularizations, cross-model non-parametric perturbation is also neglected. In this work, we propose a simple yet effective approach to preserve the generative diversity of LLMs during RLVR. Instead of relying solely on internal exploration, we force the target model to generate answers based on partial reasoning trajectories generated by a smaller, weaker language models. These unfamiliar prefixes effectively disrupt over-confidence and encourage the exploration of distinct reasoning paths. We empirically study the potential of outer prefixes, revealing the mechanism of the impact of distributional discrepancy to the exploration dynamics in RLVR training. Experiments across multiple mathematical benchmarks show that our method consistently outperforms vanilla RLVR. Notably, the performance gain becomes increasingly pronounced as $k$ scales up, demonstrating a substantial expansion of reasoning coverage. Furthermore, our approach efficiently mitigates entropy collapse without requiring additional SFT, intricate reward designs, or complex prompting.

[52] CritICL: Inference-Time Weak-to-Strong Generalization from Small Language Model Failure Modes cs.CLPDF

Yufan Wu, Yinghui He, Zhengyi Hu, Lang Wei, Ruichen Li

TL;DR: 本文提出了CritICL，一种新颖的推理时框架，旨在通过利用小语言模型的失败模式作为指导，来提升大语言模型的推理性能，同时保持高效率。该方法包含动态和静态两种变体，分别自适应地预测输入特定的失败模式或使用全局失败模式配置文件。

Details

Motivation: 现有的推理时扩展方法通常依赖重复生成或外部验证，效率较低。本文旨在解决这一限制，利用同一模型家族中不同规模模型失败模式的结构化模式，将其转化为指导信号。

Result: 实验结果表明，CritICL在多个任务上持续优于标准的上下文学习，其性能与或优于测试时扩展方法，同时所需的生成次数和令牌成本显著降低。

Insight: 核心创新在于将失败模式视为有价值的指导来源，而非不良输出，并通过基于批评的上下文示例将其整合到推理过程中。这为高效提升模型推理能力提供了一种新思路。

Abstract: Recent advances in inference-time scaling have significantly improved the reasoning performance of large language models (LLMs). However, these methods typically rely on repeated generation or external verification. To address this limitation, we introduce CritICL, a novel inference-time framework that improves reasoning while maintaining high efficiency. Our key insight is that LLM failure modes exhibit structured patterns across model scales within the same family. Instead of treating failures as undesirable outputs, CritICL leverages them as a source of guidance. Specifically, we utilize failure modes derived from weaker models and incorporate them into inference through critique-based in-context examples. We propose two variants: CritICL-dynamic, which adaptively predicts input-specific failure modes and retrieves critiques, and CritICL-static, which uses a global failure mode profile to provide stable guidance. Experimental results show that CritICL consistently outperforms standard in-context learning and achieves performance competitive with or superior to test-time scaling methods, while requiring significantly fewer generations and lower token cost. Code available at: https://github.com/umwyf/CRITICL

[53] TTPO: Test-Time Policy Optimization cs.CLPDF

Aozhe Wang, Zhengxi Lu, Jianze Wang, Shangke Lv, Ying Liu

TL;DR: 本文提出了测试时策略优化（TTPO）方法，用于在无真实标签的情况下优化大型语言模型的数学推理能力。该方法基于一个关键观察：与伪标签不一致的模型输出通常是错误的。TTPO采用非对称目标，通过策略自蒸馏优化一致输出，并通过分组强化学习惩罚不一致输出，结合了令牌级选择机制。该方法在多个竞赛级基准测试中，无需真实标签即可达到与有监督方法相当的性能。

Details

Motivation: 现有的后训练方法（如强化学习和策略自蒸馏）依赖真实标签，无法进行测试时训练。使用多数投票伪标签作为替代方案又很脆弱，因为错误的投票会误导整个模型。本文旨在解决在无真实标签条件下，如何稳健地进行测试时模型优化的问题。

Result: 在五个竞赛级基准测试中，TTPO无需任何标签即可匹配有监督策略自蒸馏（OPSD）的性能。在测试时训练设置下，它将Qwen3-1.7B模型的性能从38.0%提升至45.2%；在无思维链（without thinking）设置下，性能提升幅度达+25.2%到+36.4%。该方法还展现出强大的跨任务泛化能力。

Insight: 核心创新点在于利用了模型输出与伪标签不一致时的不对称性，并据此设计了非对称优化目标。具体技术贡献包括：1）结合策略自蒸馏和分组强化学习的双分支更新机制；2）引入令牌级选择来精细化处理不同位置的收敛状态和错误；3）多数投票路由机制能随着模型改进提供更严格的自监督信号。这种方法使得优化过程即使在伪标签频繁出错时也能保持稳健。

Abstract: Recent prominent post-training methods, such as Reinforcement Learning (RL) and On-Policy Self-Distillation (OPSD), have driven rapid progress in mathematical reasoning for large language models, yet their reliance on ground-truth labels precludes test-time training (TTT). Replacing ground truth with majority-vote pseudo-labels is a natural alternative, yet it is fragile: an incorrect vote corrupts the teacher and misleads every token. We observe that this failure mode is asymmetric: rollouts that disagree with the pseudo-label are typically wrong regardless of whether the vote itself is correct. Building on this observation, we propose Test-Time Policy Optimization (TTPO), an asymmetric objective that distills agreeing rollouts via OPSD and penalizes disagreeing rollouts with Grouped RL. Token-level selection further refines both branches: distillation down-weights already-converged positions, while RL penalizes only confident errors. Both updates remain well-grounded even under frequent pseudo-label errors, and majority-vote routing yields tighter self-supervision as the model improves. Without any labels, TTPO matches label-supervised OPSD on five competition-level benchmarks, raises Qwen3-1.7B from 38.0% to 45.2% in TTT, yields +25.2% to +36.4% without thinking, and shows strong cross-task generalization.

cs.CV [Back]

[54] Surgical Video Generation From Diffusion to World Models: A Survey cs.CVPDF

Fuxiang Huang, Chenxu Zhang, Liang Han, Lei Zhang

TL;DR: 本文是一篇关于手术视频生成技术的综述，系统梳理了2024-2026年间的研究文献，将其分为无条件生成、条件生成和世界模型生成三大类别，并揭示了该领域从合成视觉逼真帧到建模手术场景因果动态的根本性转变。

Details

Motivation: 手术视频数据是术中感知、手术工作流理解和机器人决策模型的主要训练资源，但临床数据获取受到隐私、成本和类别不平衡的限制，因此手术视频生成成为解决数据稀缺问题、并为手术模拟、培训和机器人策略学习奠定基础的关键方法。

Result: 综述总结了代表性方法在公共数据集上的实验结果，为领域提供了定量参考，并指出当前方法在像素级保真度与临床合理性之间仍存在差距。

Insight: 论文的创新之处在于首次为该快速发展的领域提供了一个清晰的概念框架，并系统性地识别了泛化性、物理真实性、可控性和可解释性等关键瓶颈，为智能感知、多模态融合、生成式AI和手术数据科学交叉领域的研究者提供了结构化参考。

Abstract: Surgical video data provides the primary training resource for models of intraoperative perception, surgical workflow understanding, and robotic decision-making. However, clinical data acquisition remains constrained by privacy, cost, and class imbalance. Surgical video generation has emerged as a transformative approach to addressing data scarcity and as a foundation for surgical simulation, training, and robotic policy learning. The field has developed rapidly without a clear conceptual framework. This survey organizes the 2024-2026 literature into three categories: unconditional generation, conditional generation, and world modeling generation, revealing a fundamental shift in how the task is defined from synthesizing visually plausible frames to modeling the causal dynamics of surgical scenes. We examine the persistent gap between pixel-level fidelity and clinical plausibility, and identify generalization, physical realism, controllability, and interpretability as bottlenecks. We further summarize experimental results of representative methods on public datasets to provide a quantitative reference for the field. This survey provides a structured overview of the current state and open challenges, offering a reference for researchers working at the intersection of intelligent perception, multi-modal fusion, generative AI, and surgical data science.

[55] Modality Maturity Index: A benchmark for assessing multimodal capabilities of omni models cs.CV | cs.AI | cs.MMPDF

Rohit Patel, Dieuwke Hupkes, Sloan Strader

TL;DR: 本文提出了模态成熟度指数（MMI），这是一个用于评估大型语言模型在文本、图像、音频、视频和文档五种模态及其组合（最多三种）上的多模态理解与生成能力的基准。MMI包含893个精心设计的问题，每个问题都要求模型理解多种输入模态并生成包含多种输出格式的响应。作者将MMI应用于五个前沿多模态模型，发现其模态存在分数（MPS）普遍较低，并探讨了使用LLM评判器进行自动评估的可行性。

Details

Motivation: 当前前沿语言模型被宣传为能够跨模态感知和响应的全能系统，但现有的评估框架几乎只关注双模态（通常是文本加另一种模态）理解，缺乏对更复杂多模态组合能力的系统性评估。

Result: 在五个前沿多模态模型上应用MMI，其模态存在分数（MPS）范围仅为15.6（Claude Opus 4.6）到34.9（GPT-5.4），表明模型生成所需输出模态的能力普遍不足。一项辅助实验表明，使用LLM评判器依据评分标准进行判断，与不知晓标准的盲评人类标注者在70.8%的判断上达成一致。

Insight: 论文的创新点在于提出了首个系统评估模型在多达五种模态及其组合（输入和输出）上能力的基准MMI，并引入了MMI值和MPS两个互补的量化指标。从客观角度看，其设计的自包含问题、明确的输出模态预期以及人工制定的评分标准，为全面、细粒度地衡量模型的“全能”程度提供了新工具和方法论。

Abstract: Frontier language models are increasingly marketed as omni systems that can perceive and respond across modalities. Existing evaluation frameworks, however, focus almost exclusively on bimodal understanding, typically text plus one other modality. We propose the Modality Maturity Index (MMI), a benchmark designed to evaluate the multimodal capabilities of large language models across five modalities (text, image, audio, video and document) and combinations of up to three modalities in both inputs and outputs. MMI consists of 893 questions, each carefully crafted to require the model to demonstrate its understanding of multiple input modalities and to generate responses that incorporate various output formats. The questions are designed to be self-contained, with clear expectations for the correct modality or mix of modalities required for an accurate response. Every MMI prompt carries human-authored rubric criteria for each output modality expected in the response; a model’s MMI Value expresses the average of the per-modality scores for each prompt. Because low scores can reflect either failure to generate a modality (lack of presence) or failure to generate correct content, we introduce also a supplementary Modality Presence Score (MPS), a per-prompt F1 over the expected output modalities. Applying MMI to five frontier multimodal models, we find that the MPS ranges from only 15.6 (Claude Opus 4.6) to 34.9 (GPT-5.4). Given the low availability of returned modalities to even grade, we report MPS as our main result pending model improvements. To assess the viability of judging output correctness with LLM judges and rubrics, we run a separate experiment with custom generation tools. On the assets that generates, we find that an LLM judge applying the rubrics agrees with rubric-blind human annotators (who score the outputs directly and never see the criteria) on 70.8% of judgments.

[56] Procedura: Agentic 3D Modeling with Procedural Control cs.CV | cs.GRPDF

Youtian Lin, Yikang Yang, Zhanpeng Hu, Mengqi Zhou, Feihu Zhang

TL;DR: Procedura是一个基于LLM的智能3D建模代理框架，它将3D对象生成为参数化的程序化装配体，而不是传统的密集网格。该框架通过规划装配图、编写程序化部件、进行类型化连接检查以及视觉批评修正，实现了从文本提示生成可编辑、部件化、具有锐利边缘的3D模型。

Details

Motivation: 现有单图像3D生成器生成的密集网格缺乏锐利边缘、部件分解和用户可编辑参数，无法满足机械类物体的建模需求。论文旨在探索’3D形状即代码’的范式，利用LLM的编程能力实现可控、结构化的3D建模。

Result: 在P3D-Bench和作者提出的硬表面基准MechBench-36上，Procedura在装配质量评估中均优于最先进的原生3D生成器和所有先前的3D代码代理方法，生成了最锐利的边缘，并且是唯一输出可编辑、部件结构化程序的方法。

Insight: 创新点在于将3D建模转化为由LLM驱动的程序化装配生成，通过装配图规划、类型化连接约束、编译检查和迭代式视觉批评，实现了高保真、结构化、可参数化编辑的硬表面物体生成，为AI驱动的CAD提供了新思路。

Abstract: Native 3D generators now recover impressive mesh geometry from a single image. However, a dense mesh stays soft where a machined object should be sharp, it carries no part decomposition, and it exposes no parameter a user could edit. To address this, we explore the paradigm of 3D shape as code, leveraging and scaling the coding ability of an LLM for 3D modeling. We introduce Procedura, a novel 3D modeling agent framework that writes an object as a procedural assembly, a parametric program whose named parts are joined by typed, machine-checkable mates. From a text prompt, the agent plans the object as an assembly graph and writes the program part by part, solving each placement from the mated frames rather than guessing it, and admitting a part only once compile, mate, and connectivity checks pass. A decoupled vision critic then refines the assembly one diagnosed fix at a time. Moreover, the same graph carries per-part materials and a simulator-validated articulation. We evaluate on P3D-Bench under its assembly judge, and with the same judge on MechBench-36, our hard-surface benchmark. On both, Procedura outperforms state-of-the-art native 3D generators and every prior 3D-code agent on judged quality, produces the sharpest edges of any method we evaluate, and is the only one whose output is an editable, part-structured program.

[57] Finding the Right Evidence: Factor-Guided Coarse-to-Fine Reasoning for Long Videos cs.CV | cs.LGPDF

Baixuan Xu, Yinyui Xu, Tianshi Zheng, Zhaowei Wang, Weiqi Wang

TL;DR: 本文提出PACE框架，针对长视频问答中证据稀疏且难以区分选项的挑战，通过问题驱动的两阶段检索机制（先基于问题因子索引片段描述，再结合候选答案进行对比性验证）提升证据获取质量。

Details

Motivation: 现有LVLM在长视频问答中面临证据稀疏且问题相关上下文缺乏区分正确选项的线索，导致答案准确率提升受限，瓶颈在于缺乏选项区分性证据而非仅主题相关性。

Result: 在MMR-V数据集上，PACE使用Qwen3-VL骨干网络达到42.6%的准确率，优于直接推理和Deep Video Discovery等基线方法；在诊断子集上恢复了66.9%的标注线索，证明其提升源于证据恢复能力的增强。

Insight: 创新点在于引入因子引导的粗到细推理框架，将答案选项作为后期验证的对比线索而非初始检索依据，从而更有效地获取区分性证据；该方法在多个长视频基准（LVBench、Video-MME等）上均表现一致优势，展示了跨数据集的泛化能力。

Abstract: While LVLMs rapidly improve, long-video question answering still remains challenging: relevant evidence is sparse, and question-relevant context often fails to provide cues that discriminate the correct answer from plausible alternatives. Diagnostic analysis on a manually annotated subset of MMR-V shows that prior agentic systems substantially improve cue retrieval over direct VLM inference yet fail to achieve a corresponding gain in answer accuracy, indicating that the bottleneck lies in option-discriminative evidence rather than topical relevance alone. We propose PACE (Progressive Acquisition of Critical Evidence), a factor-guided framework for long-video evidence acquisition. PACE proceeds in two stages: it first indexes clip-level descriptions guided by question-derived factors without observing the candidate answers; it then uses the candidate answers to derive contrastive cues and queries the index for verification. On MMR-V with the open-source Qwen3-VL backbone, PACE achieves 42.6% accuracy, outperforming direct inference and prior agentic baselines including Deep Video Discovery (DVD). On the same diagnostic subset, PACE recovers 66.9% of the annotated cues, providing empirical evidence that its gains are associated with improved evidence recovery rather than stronger answer-side priors alone. Consistent gains over DVD on LVBench, Video-MME, EgoSchema, and LongVideoBench suggest that option-aware evidence acquisition transfers beyond MMR-V. Code is available at https://github.com/HKUST-KnowComp/PACE.

[58] VIPER: An Expert-Curated Benchmark for Vision-Language Models in Veterinary Pathology cs.CVPDF

Luca L. Weishaupt, Simone de Brot, Javier Asin, Llorenç Grau-Roma, Nic G. Reitsam

TL;DR: 本文介绍了VIPER，首个针对毒理学病理学领域的专家策划视觉语言模型基准测试，包含1,251个与419张大鼠组织切片图像相关的问题，覆盖多种题型，并由专业兽医病理学家验证。研究评估了16个模型，揭示了兽医与人类病理学之间的领域差距，并强调了领域特定训练的重要性。

Details

Motivation: 现有病理学视觉语言模型基准主要关注人类组织（尤其是肿瘤学），而兽医病理学（特别是毒理学病理学）领域缺乏专门的评估工具，这限制了在临床前药物安全评估中的应用。

Result: 在VIPER基准上评估了16个模型（包括2个兽医病理学模型、7个人类病理学专用模型和7个通用前沿模型），结果显示兽医与人类病理学存在显著领域差距，前沿模型存在对正常组织过度诊断的风险，且领域特定训练对视觉基础预测至关重要。

Insight: 创新点在于构建了首个专家策划的兽医毒理学病理学视觉语言模型基准，通过跨领域比较揭示了模型泛化的局限性；客观分析表明，该研究强调了在专业医学领域开发专用数据集和模型的重要性，而非依赖通用前沿模型。

Abstract: Pathology vision-language models are advancing rapidly, yet existing benchmarks remain focused on human tissue, particularly oncology, leaving non-human pathology largely unaddressed. This gap is especially important in toxicologic pathology, where microscopic tissue examination of laboratory animals is a core component of preclinical drug safety assessment. To address it, we introduce VIPER, the first expert-curated benchmark for vision-language model evaluation in toxicologic pathology. VIPER contains 1,251 questions associated with 419 H&E-stained rat histology images across seven organ systems, covering multiple-choice, KPrim, and free-text formats. All questions were curated and validated by board-certified veterinary pathologists. In total, we benchmarked 16 models, including two newly introduced veterinary-pathology models, seven human pathology-specialized models, and seven general-purpose frontier models. The results identify a substantial domain gap between veterinary and human pathology, expose the risk of over-diagnosis of normal tissue in frontier models, and show that domain-specific training remains critical for visually grounded predictions. VIPER data and evaluation code are available at https://github.com/mahmoodlab/viper.

Cong Cao, Huanjing Yue, Xin Liu, Jingyu Yang

TL;DR: 本文提出了一种基于文本到图像潜在扩散模型的零样本视频修复与增强框架，通过双提示调优反演与采样、纹理感知视频令牌合并以及参考自注意力等创新技术，显著提升了视频修复的时域一致性并大幅降低了推理时间。

Details

Motivation: 现有基于文本到图像潜在扩散模型的零样本图像修复方法在视频修复中会导致严重的时域闪烁问题，因此需要开发能够保持视频时序一致性的零样本视频修复与增强方法。

Result: 实验结果表明，所提方法在恢复和增强时域一致的视频方面具有优越性，推理时间可减少至原始方法的近三分之一。

Insight: 创新点包括双提示调优反演与采样以加速推理、纹理感知视频令牌合并以利用帧间相关性增强时序一致性，以及参考自注意力与参考令牌合并以支持图像参考输入。

Abstract: Zero-shot image restoration methods with text-to-image latent diffusion models have achieved great success in universal image restoration tasks without training. However, applying them to video restoration will result in severe temporal flickering. In this paper, we propose a novel framework for zero-shot video restoration and enhancement which uses a text-to-image latent diffusion model and multi-modal references. Through the proposed dual prompt tuning inversion and sampling, the inference time can be reduced to nearly 1/3 of the original. The performance and temporal consistency can be also significantly stregthened. By using the proposed texture-aware video token merging, the temporal correlation between frames can be further utilized to improve the temporal consistency. We futher propose the referenced self-attention and referenced token merging to support image reference. Experimental results demonstrate the superiority of the proposed method in restoring and enhancing temporally consistent videos.

[60] Video-FLAIR: Not Whether to Reason, But How cs.CVPDF

Yogesh Kulkarni, Pooyan Fazli

TL;DR: 论文提出了Video-FLAIR训练框架，旨在为多模态查询自适应选择推理模式（感知、组合或审慎推理），而非对所有查询采用统一策略。该框架使用强化学习，通过比较同一提示下不同推理模式生成的响应，学习选择最有效模式，从而提升复杂任务性能并降低计算成本。

Details

Motivation: 现有方法对多模态查询通常采用统一的推理策略，导致简单任务计算冗余而复杂任务推理不足。本文旨在解决如何为不同查询动态选择最合适的推理模式的问题。

Result: 在MathVista、Video-Holmes和Video-MMMU基准测试上，Video-FLAIR相比基础模型Qwen2.5-VL分别提升了5.4、4.8和4.8个点的准确率，同时将平均token使用量从417大幅降低至95。

Insight: 核心创新在于通过强化学习框架实现无逐查询标注的自适应推理模式选择，其复合奖励机制（基于正确性、事实依据和成本）能有效引导模型学习，在提升性能的同时显著优化计算效率。

Abstract: Multimodal queries can require different types of reasoning. Some can be answered via perceptual reasoning, extracting information directly from the visual signal, while others require compositional reasoning that combines observations or deliberative reasoning that evaluates competing hypotheses. However, many existing methods apply a uniform reasoning strategy across queries, leading to unnecessary computation on simple tasks and insufficient reasoning on complex ones. We introduce Video-FLAIR, a training framework that learns to select the appropriate reasoning mode for each query using reinforcement learning. During training, the model generates responses under all three modes for the same prompt, enabling direct comparison. A composite reward compares these responses to favor the most effective one based on correctness, grounding, and cost, while discouraging unsupported or misaligned deliberation. This yields a supervision signal for learning adaptive reasoning without per-query annotations. Video-FLAIR improves accuracy over the Qwen2.5-VL base model by +5.4 on MathVista, +4.8 on Video-Holmes, and +4.8 on Video-MMMU, while reducing average token usage to 95 compared to 417 for always-thinking baselines.

[61] Systematic Literature Review of Machine Learning Models and Applications for Text Recognition cs.CV | cs.LGPDF

Nuzhat Khan, Ab Al-Hadi Ab Rahman, Shahriyar Masud Rizvi, Ibrahim Yousef Alshareef, Muhammad Nadzir Marsono

TL;DR: 本文是一篇关于机器学习模型在文本识别（OCR）中应用的系统文献综述，基于PRISMA指南对2015年至2025年初的97项研究进行了全面评估，追踪了AI模型在过去十年的演变，并探讨了其应用领域、数据类型、语言覆盖范围及面临的挑战。

Details

Motivation: 传统OCR模型在处理脚本变体、书写风格和退化文档方面存在困难，尽管技术进步带来了新的AI模型，但对OCR进展的全面评估仍然有限，因此需要进行系统的文献回顾以梳理该领域的发展脉络。

Result: 综述通过分析选定研究，识别了关键的OCR模型，并分析了它们的性能、优势和局限性，强调了OCR技术在处理结构化与非结构化文本、场景文本识别及多语言处理方面的演变。

Insight: 论文的创新点在于采用系统文献综述方法全面评估OCR领域，并提出了未来研究方向，如自监督学习、多模态AI、AutoML、AI辅助后处理、TinyML以及为脚本匹配创建联合语料库，以解决代表性语言资源有限、手写文本高变异性、字符视觉相似性及实时OCR应用约束等未解挑战。

Abstract: Optical Character Recognition (OCR) for text recognition using machine vision has significantly improved, particularly when handling heterogeneous textual data. Traditional OCR models struggle with script variations, writing styles, and degraded documents. Advancements in technology are leading to new AI models with improved architecture for handling multiple languages and complex data formats. Despite this progress, a comprehensive evaluation of OCR advancements remains limited. Based on the established preferred reporting items for systematic reviews and meta-analysis (PRISMA) guidelines, this literature review presents an extensive assessment of OCR research to trace the evolution of AI models over the past decade. It explores the transition in AI models, application domains, data types, linguistic coverage, and challenges. Through a detailed analysis of 97 selected studies published during January 2015 - January 2025, key OCR models are identified, and their performance, strengths, and limitations are analyzed. The findings highlight how OCR technologies have evolved to address structured and unstructured text, scene text recognition, and multilingual processing. Unresolved challenges include limited resources for underrepresented languages, high variability in handwritten text, visual similarity among characters, and constraints in real-time OCR applications. To address these issues, several promising approaches are proposed. Key suggestions include self-supervised learning, multimodal AI, automated machine learning (AutoML), AI-assisted postprocessing, tiny machine learning (TinyML), and the creation of joint corpora for script matching. The future recommendations aim to enhance OCR accuracy and tackle the challenges identified for real-time industrial applications. This study will guide future research and establish a foundation for OCR field.

[62] NeuDonatello: Uncertainty-Aware Framework for Accurate Neural SDF Learning cs.CVPDF

Alvin Jinsung Choi, Wanhee Kim, Taeyun Kim, Dasol Hong, Wooju Lee

TL;DR: 本文提出了NeuDonatello，一个不确定性感知的神经符号距离函数学习框架，旨在从多视角RGB图像中实现精确的3D表面重建。该框架通过蒙特卡洛采样策略建模空间变化的不确定性，并利用此不确定性设计了自适应正则化和不确定性感知的SDF到密度转换参数，以在纹理缺失、遮挡等区域不可靠的RGB监督下，强化几何约束并避免错误重建。

Details

Motivation: 仅从RGB图像恢复精确几何结构具有挑战性，因为纹理缺失区域、遮挡和固有的场景模糊性会引入不确定性，而现有方法往往忽视这些不确定性，导致符号距离函数估计不准确。

Result: 大量实验表明，NeuDonatello仅使用姿态已知的RGB图像，就在多种场景下实现了最先进的重建精度，并展现出鲁棒的性能。

Insight: 核心创新在于显式地建模并利用SDF的空间变化不确定性来指导重建过程，具体包括基于蒙特卡洛采样的不确定性建模、基于不确定性的自适应正则化方法，以及条件于不确定性的SDF到密度转换尺度参数设计，这些机制共同提升了在监督信号不可靠区域的几何重建质量。

Abstract: Neural surface reconstruction has emerged as a powerful paradigm for recovering high-quality 3D surfaces from multi-view images. However, recovering accurate geometry solely from RGB images remains challenging due to uncertainties arising from textureless regions, occlusions, and inherent scene ambiguities. Existing methods often overlook such uncertainties, leading to inaccurate estimates of the signed distance function (SDF). We introduce NeuDonatello, a novel framework that models and leverages SDF uncertainty to improve surface reconstruction. Central to our approach is to model spatially varying uncertainty using a Monte Carlo sampling strategy. Using this uncertainty, we develop an adaptive regularization that selectively strengthens geometric constraints where RGB supervision is unreliable, avoiding incorrect surface reconstruction. We further introduce an uncertainty-aware scale parameter for the SDF-to-density conversion. Conditioned on uncertainty, this design enables more accurate modeling of spatially varying densities. Extensive experiments demonstrate that NeuDonatello achieves state-of-the-art reconstruction accuracy, with robust performance across diverse scenes using only posed RGB images.

[63] HUG-VIS: A Multimodal Benchmark for Human-centered Understanding and Generation in Visual Intelligence cs.CVPDF

Fei Ma, Zebang Cheng, Minghui Li, Hongbo Xu, Yuyong Tan

TL;DR: 本文提出了HUG-VIS，一个面向以人为中心的视觉智能理解与生成的多模态基准测试。它包含8,400个由专业演员录制的半身视频，涵盖情感识别、视频生成、语音克隆和视频抠像四个任务，并提供了同步的视频、音频、文本和alpha遮罩数据。作者在统一的零样本协议下评估了多种模型，揭示了各任务中当前模型的性能特点与挑战。

Details

Motivation: 现有的以人为中心的视觉智能研究资源通常是任务特定的，缺乏一个协调理解与生成任务的共享多模态基础，这限制了多模态信号的利用和更广泛的研究。本文旨在填补这一空白。

Result: 在四个任务上对多种开源和闭源模型进行了零样本评估，使用了自动指标和人工评分。结果显示：情感识别中语言内容占主导，纯视觉情感识别最弱；视频生成和语音克隆任务中，自动指标与人工判断总体一致但排名存在差异；运动中的边界保真度是视频抠像的主要障碍；任务难度因情感、模型和指标而异，并存在显著的跨任务相关性。

Insight: 创新点在于构建了一个统一、协调的多模态基准，将理解与生成任务耦合，并提供了高质量、可控的同步多模态数据。从客观角度看，其统一的评估协议和跨任务分析为全面衡量以人为中心的AI模型能力提供了新视角，有助于揭示不同模态、任务间的相互作用与瓶颈。

Abstract: Visual intelligence seeks to perceive, interpret, and synthesize the visual world and is central to modern computer vision. Human-centered visual intelligence is especially demanding because it studies people as expressive, socially situated subjects whose meaning is rarely conveyed by appearance alone. It couples vision with audio and language across four representative tasks: human emotion recognition, human video generation, human voice cloning, and human video matting. Yet existing resources remain task-specific, providing modalities and annotations for individual problems rather than a shared foundation coordinating understanding and generation. This limits multimodal signal use and broader research. We address this gap with HUG-VIS, a unified benchmark for Human-centered Understanding and Generation in Visual Intelligence. It contains 8,400 seated half-body videos of 30 professional actors, each performing the same 280 emotion-action-prompt assignments under a controlled Mandarin studio protocol, with synchronized video, audio, text, and alpha mattes. We evaluate diverse open- and closed-source models across the four tasks under a unified zero-shot protocol using automatic metrics, criterion-specific mean opinion scores, and multiple cross-task analyses. Results show that (i) linguistic content dominates current emotion recognition, while purely visual affect recognition is weakest; (ii) in video generation and voice cloning, automatic metrics and human judgment agree overall but differ in their top rankings, requiring joint reporting; (iii) boundary fidelity under motion is the main remaining obstacle for human matting; and (iv) task difficulty varies across emotions, models, and metrics, with notable cross-task correlations. The dataset and results are available at https://github.com/GML-MMGroup/HUG-VIS.

[64] Visual Information-Guided Parallel Decoding for Diffusion Multimodal Large Language Models cs.CV | cs.CLPDF

Insu Lee, Wooje Park, Wonseok Shin, Jinwoo Son, Byonghyo Shim

TL;DR: 本文提出了一种用于扩散多模态大语言模型（dMLLMs）的视觉信息引导采样器（VIG-Sampler），以改进并行解码过程中令牌的选择策略。该方法通过优先选择对图像令牌关注度高的令牌，并惩罚与已选令牌具有相似图像注意力分布的候选令牌，从而增加解码子集的信息增益。在7个图像描述和视觉问答基准测试上的实验表明，VIG-Sampler在性能和解码效率上均优于现有方法。

Details

Motivation: 现有dMLLMs的并行解码策略要么基于令牌的确定性（倾向于训练数据中的高频令牌），要么基于对后续预测的影响，但都未明确考虑输入图像信息，这可能导致解码质量不佳。

Result: 在3个开源dMLLMs和7个基准测试（包括COCO Caption等）上的实验表明，VIG-Sampler在图像描述任务上平均超越Info-Gain Sampler 19.3个CIDEr分数，并且在COCO Caption上达到更高性能的同时，仅需一半的解码步骤。

Insight: 创新点在于将视觉注意力机制显式地整合到解码令牌的优先级排序中，并通过多样性约束避免冗余，这为多模态生成模型的解码过程提供了新的、更高效的引导策略。

Abstract: Diffusion multimodal large language models (dMLLMs) have recently emerged as a new decoding paradigm for multimodal generation. Starting from a fully masked sequence, dMLLMs progressively decode the sequence by unmasking a subset of the remaining masked positions at each step. Since the selected tokens serve as the prediction context for subsequent steps, deciding which tokens to decode is crucial to the quality of the final output. The most common strategy prioritizes tokens based on a certainty measure that tends to favor tokens frequently observed in the training data. Recent approaches instead order tokens according to their influence on subsequent predictions, but do not explicitly account for the input image. We propose the Visual Information-Guided Sampler (VIG-Sampler), which prioritizes tokens based on their attention to image tokens. We further impose a constraint that penalizes candidate tokens whose image-attention distributions are similar to those of previously selected tokens, thereby increasing the information gain of the decoded subset. Extensive experiments on 7 captioning and VQA benchmarks with 3 open-source dMLLMs demonstrate the effectiveness of VIG-Sampler, which outperforms the Info-Gain Sampler by an average of 19.3 CIDEr points across the captioning benchmarks and surpasses it on COCO Caption while using only half as many decoding steps.

[65] FAN-LoRA: A Fourier-Adaptive Nonlinear Low-Rank Adaptor for Medical Foundation Model Domain Adaptation cs.CVPDF

Ziquan Liu, Zhewei Zhu, Xuyang Shi

TL;DR: 本文提出了一种名为FAN-LoRA的新型参数高效微调架构，旨在解决视觉基础模型（如SAM）在适应医学影像领域时，因严重的跨模态和跨中心分布偏移而导致的性能下降问题。该方法通过傅里叶分析，将优化空间显式解耦为用于全局结构对齐的低通分支和用于局部纹理补偿的高通分支，从而克服了现有方法中异质频率成分在共享低秩子空间内隐式纠缠的表示瓶颈。

Details

Motivation: 动机在于解决现有参数高效微调方法在将SAM等视觉基础模型迁移到医学影像领域时，面对严重的分布偏移（如跨模态、跨中心）时性能下降的问题。其核心挑战在于现有方法的低秩适应子空间中，不同频率成分被隐式纠缠，导致结构对齐不佳和边界模糊。

Result: 在三个具有挑战性的跨模态和跨中心基准测试上的广泛实验表明，FAN-LoRA在平均Dice分数上持续优于最先进的参数高效微调基线方法，并显著降低了边界误差，同时保持了紧凑的模块大小且未牺牲计算效率。

Insight: 论文宣称的创新点在于提出了一种频率解耦的微调架构，通过B样条驱动的低通分支和离散傅里叶高通分支的协同耦合，显式地分离优化空间。从客观角度看，其核心创新是将傅里叶分析与低秩适应相结合，为处理医学影像中的复杂域偏移提供了一种新的、结构化的频率域解耦表示方法。

Abstract: The advent of vision foundation models, notably the Segment Anything Model (SAM), has catalyzed significant advancements in natural image segmentation. However, their direct transfer to medical imaging remains severely bottlenecked by profound domain gaps, such as cross-modality and cross-center shifts. Existing Parameter-Efficient Fine-Tuning (PEFT) methods facilitate the adaptation of SAM to medical domains; nevertheless, they frequently suffer from performance degradation under severe distribution shifts. This vulnerability primarily stems from the implicit entanglement of heterogeneous frequency components within a shared low-rank subspace, which directly exacerbates sub-optimal structural alignment and localized boundary blurring. To overcome this representational bottleneck, we propose the Fourier-Adaptive Nonlinear Low-Rank Adaptor (FAN-LoRA), a novel frequency-decoupled fine-tuning architecture. FAN-LoRA explicitly separates the optimization space by employing a B-spline-driven low-pass branch for global structural alignment, synergistically coupled with a discrete Fourier high-pass branch for local textural compensation. Extensive experiments across three challenging cross-modality and cross-center benchmarks demonstrate that FAN-LoRA consistently outperforms state-of-the-art PEFT baselines. Compared to the strongest competitors, our method achieves consistent improvements in average Dice scores and notable reductions in boundary errors, while maintaining a compact module size without compromising computational efficiency.

[66] DPA-I2P: Depth-Guided Projective Alignment for Image-to-Point-Cloud Registration in Autonomous Driving cs.CVPDF

Wenxin Zhang, Hang Li, Zhiwei Xu, Qiankun Dong, Gang Wang

TL;DR: 本文提出了一种用于自动驾驶中图像到点云配准的新方法DPA-I2P。该方法通过深度引导的投影对齐，利用结构化、几何感知的方式融合深度和视觉线索，并引入跨模态查询剪枝以提高匹配稳定性，从而更准确地估计给定图像在3D点云场景中的相机位姿。

Details

Motivation: 图像与稀疏LiDAR点云之间存在固有的模态差异，使得可靠的跨模态对应关系学习具有挑战性，这限制了现有端到端隐式对应学习方法在图像-点云配准任务中的性能。

Result: 在KITTI数据集上，DPA-I2P将相对平移误差(RTE)和相对旋转误差(RRE)分别比最强的隐式基线降低了45.0%和55.6%。在nuScenes数据集上也显示出优于基线的配准精度，表明其在不同驾驶场景中具有更好的可迁移性。

Insight: 核心创新在于提出了几何感知的深度编码(RMDE)和投影一致的视觉提升(PVL)模块，以结构化方式利用深度和视觉信息，而非简单的拼接。此外，跨模态查询剪枝(CQP)机制在早期优化阶段抑制不可靠查询，提升了匹配过程的稳定性。

Abstract: Image-to-Point Cloud Registration aims to estimate the camera pose of a given image within a 3D scene point cloud, which is a fundamental task in autonomous driving and large-scale outdoor localization. Recent implicit correspondence learning methods have improved registration performance by learning cross-modal alignment in an end-to-end framework, leading to more accurate camera pose estimation. However, due to the inherent modality discrepancy between images and sparse LiDAR point clouds, reliable cross-modal correspondence learning remains challenging. To address this issue, we propose Depth-Guided Projective Alignment for Image-to-Point-Cloud Registration (DPA-I2P). Unlike naive depth or feature concatenation, Ray-Conditioned Metric Depth Encoding (RMDE) and Projection-Consistent Vision Lifting (PVL) exploit depth and visual cues in a structured, geometry-aware manner. In addition, Cross-Modal Query Pruning (CQP) suppresses unreliable queries during early refinement to improve matching stability. Experiments on KITTI and nuScenes demonstrate the effectiveness of the proposed method. On KITTI, DPA-I2P reduces RTE and RRE by 45.0% and 55.6% over the strongest implicit baseline, respectively. On nuScenes, DPA-I2P also improves registration accuracy over the evaluated baselines, suggesting better transferability to different driving scenes.

[67] Who Remains, What Changes: Identity Anchored Composed Gait Retrieval cs.CVPDF

Jingchen Fei, Zengbin Wang, Yukun Liu, Muyi Sun, Shibiao Xu

TL;DR: 本文提出了组合步态检索（CoGR）这一新任务，旨在根据参考步态序列和自然语言修改指令来检索目标步态序列。为解决数据缺失问题，作者利用大视觉语言模型构建了两个步态-语言数据集，并提出了一个名为ComposeGait的身份锚定组合框架，以防止身份漂移问题。

Details

Motivation: 现有步态识别方法局限于刚性视觉匹配，忽视了自然语言指令在交互式检索中的潜力。本文旨在通过自然语言指令来灵活修改和检索步态序列，以提升交互性和实用性。

Result: 在构建的Language-Augmented CCPG和CASIA-B两个基准测试上，ComposeGait取得了最佳R@1性能，分别达到72.38%和83.61%，为CoGR任务建立了强基线。

Insight: 创新点包括：1) 提出了组合步态检索新任务及其首个数据集；2) 设计了身份锚定组合框架，通过部件感知身份适配器聚合身份证据，并利用共享Q-Former和联合优化目标来防止身份漂移，同时保持检索能力。

Abstract: Gait recognition has achieved remarkable progress, yet existing methods remain confined to rigid visual matching and often overlook the potential of natural language instructions for interactive retrieval. In this paper, we introduce Composed Gait Retrieval (CoGR), a novel task that retrieves a target gait sequence based on a reference sequence and a natural language modification query. To address the absence of existing datasets for this task, we design an automated annotation pipeline powered by large vision-language models (VLMs) to construct the first gait-language datasets: Language-Augmented CCPG and Language-Augmented CASIA-B. Building on this, we propose ComposeGait, an identity-anchored composition framework designed to prevent the identity drift that arises when generic composed retrieval follows the instruction but returns the wrong person. Its Part-aware Identity Adapter (PIA) aggregates multi-frame, part-aware identity evidence into a sample-specific ID token. We inject the ID tokens into both branches of a shared Q-Former to preserve identity, while excluding the ID-token outputs from the final retrieval embeddings. Joint identity and task-adapted composed-retrieval objectives optimize this space end to end. We evaluate ComposeGait on both benchmarks and show that it achieves the best R@1 among the compared methods, reaching 72.38% on Language-Augmented CCPG and 83.61% on Language-Augmented CASIA-B. These results establish ComposeGait as a strong baseline for CoGR. The datasets and code will be made publicly available.

[68] Tissue-Mixture Entropy-Weighted Reconstruction for Partial-Volume-Aware Brain MRI Super-Resolution cs.CVPDF

Xiao Tong, Wenyun Yang, Ziheng Zhang, Jingzhi Han, Zhaochu Luo

TL;DR: 本文提出了一种名为AGW-PBR的脑部MRI超分辨率方法，通过引入组织混合熵加权重建来增强对受部分容积效应影响的组织过渡区域的关注。该方法结合了仅使用低分辨率图像的重建主干和训练时强调组织过渡的目标，在IXI数据集上评估了2倍、4倍和6倍超分辨率性能，并在4倍下独立评估了组织界面与非界面区域的重建质量。

Details

Motivation: 解决脑部MRI超分辨率中，全图像目标函数可能低估受部分容积效应影响的组织过渡区域的问题，因为这些区域在图像中占比较小，且传统的二值边界无法捕捉体素内脑脊液、灰质和白质的连续混合。

Result: 在T2加权的IXI图像上，AGW-PBR在测试的2倍、4倍和6倍超分辨率尺度上改善了全图像重建质量，并在4倍下通过SynthSeg掩码独立评估显示其在组织界面区域的重建保真度得到提升；同时，无PVE监督的AGW主干在fastMRI数据集4倍超分辨率上也保持了强劲性能。

Insight: 创新点包括提出组织混合熵加权以平衡部分容积效应区域的重建权重，以及结合低分辨率Sobel引导、软潜在基分配和有界网格锚定残差扭曲的AGW主干结构；从客观角度看，该方法通过训练时引入组织分数衍生的熵权重作为侧信息，增强了模型对组织过渡的敏感性，而无需在推理时额外输入。

Abstract: Full-image objectives in brain magnetic resonance imaging (MRI) super-resolution (SR) can underweight tissue-transition regions affected by the partial-volume effect (PVE), as these regions occupy only a small fraction of the image. Binary boundaries also do not capture the continuous mixture of cerebrospinal fluid, gray matter, and white matter within a voxel. We propose Anatomy-Guided Gaussian-Parameter Warping with PVE-Balanced Reconstruction (AGW-PBR), which combines a low-resolution (LR)-only reconstruction backbone with a training-time objective that emphasizes tissue transitions. The backbone integrates LR-derived Sobel guidance, soft latent-basis assignment, and bounded grid-anchored residual warping. Fixed, quality-controlled tissue fractions derived from registered T1/T2/PD IXI images are converted into tissue-mixture entropy, which defines mean-normalized reconstruction weights within validated PVE support. These sidecars are used only during training, and inference requires only the LR image. AGW-PBR is evaluated on T2-weighted IXI images at 2x, 4x, and 6x using three seeds and subject-level paired analyses. At 4x, test-only SynthSeg masks independently assess reconstruction in tissue-interface and non-interface regions. Targeted ablations examine valid-support supervision, spatially aligned entropy weighting, and soft latent assignment. The AGW-backbone is also trained from scratch on fastMRI at 4x without PVE supervision. AGW-PBR improves full-image reconstruction across the tested IXI scales and regional fidelity at 4x, while the PVE-free backbone retains strong performance on fastMRI. These findings support tissue-mixture entropy weighting for partial-volume-aware brain MRI SR.

[69] RECAP-Forcing: Retaining Content Appearances for Long Video Generation cs.CVPDF

Haiyang Xu, Zheng Ding, Zhuowen Tu

TL;DR: 本文提出了RECAP-Forcing方法，用于解决长视频自回归生成中的内存挑战。该方法通过基于外观新颖性（而非时间顺序）来组织KV缓存记忆，优先保留首次出现的新内容（如新进入的主体、被遮挡区域和新场景），从而确保长视频中主体、物体和场景的身份一致性。

Details

Motivation: 现有的长视频生成方法通常按时间顺序组织记忆，保留近期帧并压缩或丢弃旧帧，这可能导致长期一致性丢失。本文的动机是认识到长视频的本质是不断演变的视觉内容，需要一种能根据内容新颖性而非时间远近来决定记忆保留的策略。

Result: 作为一个无需训练、不增加可学习参数的推理方法，RECAP-Forcing在多个强基线模型上持续提升了生成视频的视觉质量和语义保真度，并且性能优于现有的记忆方法。

Insight: 核心创新点在于将记忆组织从时间维度转向内容外观新颖性维度，并提出了一个统一框架：在视频开始时使用注意力汇（attention sink）保留初始场景，在视频演进过程中使用基于光流的新颖性库（novelty bank）选择性保留新出现的内容。这使得长程一致性成为内存结构的显式属性，且内存规模与引入的新内容量而非视频长度成正比。

Abstract: Long autoregressive video generation faces a fundamental memory challenge: with a finite attention window, a model must decide which information from an ever-expanding history to retain. Existing methods organize memory temporally, preserving recent frames while compressing or discarding older ones. We instead propose RECAP-Forcing, organizing memory by appearance novelty. A long video is not merely a sequence of frames, but an evolving cast of subjects, objects, and scenes whose identities must remain consistent over time. We organize memory by retaining the KV cache associated with newly appearing content–such as entering subjects, disoccluded regions, and newly introduced scenes–at the moment it first becomes visible, prioritizing novelty over recency. Memory should scale with the amount of newly introduced content, rather than with video length. This appearance-indexed memory makes long-range consistency an explicit property of the memory structure. Our framework unifies two mechanisms under this single principle. At the beginning of a video, when all visible content is novel, an attention sink preserves the initial scene. As the video evolves, an optical-flow-based novelty bank extends the same principle by selectively retaining newly revealed content. As a training-free inference method with no additional learnable parameters, RECAP-Forcing consistently improves visual quality and semantic fidelity across multiple strong baselines and outperforms existing memory methods.

[70] Hull First, Wake Second: Wake-Reliance Suppression for Robust Maritime Vessel Detection cs.CVPDF

Yefan Wang, Xingyu Wang, Ruibiao Zhu, Yusen Wu

TL;DR: 本文提出了一种名为HullWake的稳健海上船舶检测框架，旨在解决检测器过度依赖尾迹线索而导致的漏检和误报问题。该框架采用‘船体优先，尾迹其次’的策略，通过分离船体证据与尾迹上下文、提取双向尾迹线索，并应用多种尾迹响应抑制机制来提升检测鲁棒性。

Details

Motivation: 海上船舶检测器常因船体小而模糊、尾迹长而明显，导致过度依赖尾迹线索，从而漏检慢速或静止船舶（尾迹弱）或对类似尾迹的水面杂波产生误报。

Result: 在基于Ships/Vessels in Aerial Images、SMD和SeaDronesSee构建的约10,000张图像的Curated-Wake数据集上，HullWake相比仅使用边界框的检测器和掩码监督的分割基线，在整体AP、弱/无尾迹船舶的鲁棒性、类似尾迹的误报、最差组AP以及尾迹衰减后的置信度稳定性方面均有提升。

Insight: 创新点在于提出了一个系统性的尾迹依赖抑制框架，包括船体与尾迹证据分离、双向尾迹走廊提取，以及通过尾迹响应监督、尾迹衰减一致性、纯尾迹置信度抑制和船体-尾迹解相关等多种机制来抑制尾迹主导的预测；同时引入了一个面向尾迹的评估协议，以全面衡量检测器在尾迹相关场景下的性能。

Abstract: Maritime vessel detectors often face scenes where hulls are small, low-contrast, or blurred, while wakes are longer and easier to detect. This creates a wake-reliance problem: detectors may miss slow or stationary vessels with weak wakes, or produce false positives on wake-like water clutter. We propose HullWake, a hull-first wake-second framework for robust maritime vessel detection. HullWake separates proposal-centered hull evidence from directional wake context, extracts wake cues with bidirectional proposal-anchored corridors, and suppresses wake-dominant predictions through wake response supervision, wake-attenuated consistency, wake-only confidence suppression, and hull–wake decorrelation. We also introduce a wake-oriented evaluation protocol covering weak/no-wake vessels, wake-like hard negatives, worst-group AP, and confidence drop after wake attenuation. Experiments are conducted on Curated-Wake, a wake-oriented maritime dataset of about 10,000 images curated from Ships/Vessels in Aerial Images, the SMD benchmark, and SeaDronesSee, with newly added detection- and segmentation-level wake annotations. Compared with box-only detectors and mask-supervised segmentation baselines, HullWake improves overall AP, weak/no-wake robustness, wake-like false positives, worst-group AP, and confidence stability after wake attenuation.

[71] Reason in the Words You Speak: Idiolectal Paraphrasing Off-Policy Traces for Reasoning Distillation in VideoLLMs cs.CVPDF

Ji Soo Lee, Jinyoung Park, Seohyun Lee, Jongha Kim, Joonmyung Choi

TL;DR: 本文提出了Echo-GRPO框架，通过将教师模型的推理轨迹改写为学生模型自身的语言风格（即“个人习语”），来解决强化学习中离策略轨迹与学生策略分布不匹配的问题。该框架被实例化为VideoEcho-R1，用于视频推理知识蒸馏，在多个多模态大模型骨干和基准测试中取得了稳定提升。

Details

Motivation: 针对GRPO等策略强化学习方法受限于模型已有推理能力，以及引入更强教师模型的离策略轨迹会导致与学生策略分布不匹配的问题，后者会引发梯度裁剪并阻碍模型学习正确的推理过程。

Result: 在三个多模态LLM骨干和五个基准测试上取得了稳定的性能提升，表明该方法能有效改进推理蒸馏。

Insight: 核心创新在于提出了“个人习语”改写机制，通过双参考解码将教师轨迹语义适配到学生策略的分布中，从而提供策略对齐的监督信号；该方法被证明是一个可插拔模块，能持续改进强化学习和监督微调框架。

Abstract: Recent large language models achieve strong performance on complex reasoning tasks, where reinforcement learning with Group Relative Policy Optimization (GRPO) has emerged as a leading paradigm for optimizing models on self-generated trajectories. However, the on-policy nature of GRPO bounds the model to the reasoning skills it can already produce, restricting to learn more advanced capabilities. Prior works inject privileged reasoning traces from a stronger teacher policy to guide training, yet these traces are inherently out of distribution with respect to the student policy. We observe that this mismatch between on-policy and off-policy causes gradient clipping on semantically critical reasoning tokens, ultimately rewarding correct answers while leaving the reasoning that justifies them unlearned. Hence, we propose \textbf{Echo-GRPO}, a framework that lets the model reason in the words it speaks. Rather than imitating low-probability privileged traces from the teacher model, Echo-GRPO rewrites them into the student policy’s own \textit{idiolect}, that is, its own characteristic vocabulary and expression patterns, while preserving their semantics via Dual-Reference Decoding. We instantiate this framework as \textbf{VideoEcho-R1} for video reasoning distillation, achieving consistent improvements across three multimodal LLM backbones and five benchmarks. Finally, we show that our idiolectal paraphrasing is a plug-in module that consistently improves both RL and supervised fine-tuning frameworks for reasoning distillation, demonstrating that policy-aligned supervision extends beyond GRPO.

[72] LiveVVT: High-Fidelity Video Virtual Try-On in Real Time cs.CV | cs.AIPDF

Yushe Cao, Shikun Feng, Ruxiang Duan, Liyong Wang, Dianxi Shi

TL;DR: LiveVVT是一个用于实时高保真视频虚拟试衣的滚动流式扩散框架。它通过固定窗口内的有界双向建模、互补的记忆机制（时间记忆和全局外观记忆）以及一个集成了双向学习、教师轨迹回归和协作匹配蒸馏的渐进式蒸馏框架，解决了现有扩散模型因完全片段依赖而导致的高延迟问题。

Details

Motivation: 解决基于扩散的视频虚拟试衣方法因完全片段依赖而在实际连续部署中产生的高延迟和巨大计算开销问题。简单地强制因果性会破坏预训练的双向先验并严重降低合成质量。

Result: 在成对和非配对的长序列基准测试中，其生成质量优于同等规模的模型，同时实现了26倍更低的延迟和11倍更高的吞吐量，能够实现高保真的实时流式视频虚拟试衣。

Insight: 核心创新在于提出了滚动流式扩散框架，将有界双向建模与因果循环生成相结合，并引入了互补的记忆机制来维持长期一致性。其渐进式蒸馏框架将双向学习、因果少步适应和协作匹配蒸馏耦合，使优化与循环推理对齐，是高效实现高质量实时生成的关键。

Abstract: Diffusion-based Video Virtual Try-On (VVT) achieves high visual fidelity through bidirectional spatio-temporal modeling, but complete-clip dependence incurs prohibitive latency and computational overhead in practical continuous deployment. Naively enforcing causality disrupts pretrained bidirectional priors and substantially degrades synthesis quality. We introduce LiveVVT, a rolling streaming diffusion framework that preserves bounded bidirectional modeling within causal recurrent generation. Within a fixed-size window, LiveVVT jointly denoises multiple video chunks under bounded look-ahead, preserving local bidirectional interactions while emitting one clean chunk per iteration. Beyond the window, two complementary memories sustain long-term consistency: a bounded temporal memory propagates recent dynamics and occlusion context, whereas a persistent global appearance memory, constructed once from the target garment and a frontal try-on keyframe, anchors garment details and dressed appearance throughout the stream. We further introduce a progressive distillation framework integrating bidirectional VVT learning, teacher-trajectory regression for causal few-step adaptation, and Collaborative Matching Distillation, which couples teacher-distribution matching with rolling flow matching on real videos to align optimization with recurrent inference. Experiments on paired and unpaired long-sequence benchmarks demonstrate superior generation quality over similarly sized models, with $26\times$ lower latency and $11\times$ higher throughput, enabling high-fidelity real-time streaming VVT.

[73] AesCanvas: A Large-Scale Dataset and Benchmark for Aesthetic Critique and Contextual Suitability cs.CV | cs.AIPDF

Xuanwei Hu, Haoyu Dong, Kejun Wu, Tianyi Liu, Jianjun Gao

TL;DR: 该论文提出了AesCanvas数据集与评测框架，包含CritiqueCanvas和ContextCanvas两个组件，分别支持对图像进行多维度审美批判和评估图像在具体使用场景中的情境适宜性。研究评估了多种多模态大语言模型，发现审美批判生成与情境敏感判断之间存在明显差距，并指出审美专门化模型在情境适宜性任务上表现不佳。

Details

Motivation: 现有图像美学评估基准主要关注内在视觉质量或固定领域标准，未能评估图像在特定目的、受众、文化背景或领域惯例中的适宜性，因此需要构建一个能评估情境审美适宜性的大规模数据集和评测基准。

Result: 在AesCanvas基准上的评估结果显示，基于参考的词汇和语义指标仅能部分捕捉批判质量，审美专门化模型在部分批判指标上仍有竞争力，但在ContextCanvas的情境适宜性判断上显著落后于强大的通用MLLMs。

Insight: 创新点在于首次大规模地将图像美学评估从单纯的分数或批判，扩展到对具体使用场景中情境适宜性的评估，并揭示了审美专门化能力向情境判断迁移的局限性，为美学建模确立了文化情境化和证据基础的情境适宜性这一新目标。

Abstract: Recent advances in Multimodal Large Language Models (MLLMs) have extended Image Aesthetic Assessment (IAA) beyond scalar scores toward interpretable critique and guidance. Yet existing benchmarks mainly assess intrinsic visual quality or fixed domain criteria, leaving open whether an appealing image is appropriate for a specific purpose, audience, cultural setting, or domain convention. We introduce AesCanvas, a unified suite with two complementary components: CritiqueCanvas with 519,136 instruction-response pairs from 54,300 images supports long-form, multi-dimensional critique across photography, painting, and virtual imagery, whereas ContextCanvas with 301 expert-reviewed use scenarios evaluates contextual aesthetic suitability in realistic use scenarios. Under a unified protocol, we evaluate closed-source frontier, open-weight general, and aesthetic-specific MLLMs. Results reveal a clear separation between critique generation and context-sensitive judgment: reference-based lexical and semantic metrics only partially capture critique quality, while aesthetic specialists remain competitive on selected critique metrics yet substantially lag strong general-purpose MLLMs on ContextCanvas. Further analyses show that aesthetic specialization does not reliably transfer to contextual suitability and that model decisions may fail to track or ground themselves in decisive contextual visual cues. These findings establish culturally situated, evidence-grounded suitability as a distinct objective for aesthetic modeling.

[74] Beyond Atomic Layouts: Compositional Design Understanding with Vision-Language Models cs.CVPDF

Yiyang Huang, Zhaowen Wang, Simon Jenni, Jing Shi, Yitian Zhang

TL;DR: 本文提出了一种新的任务——组合式布局理解，旨在解决现有视觉语言模型在解析具有层次化多层结构的视觉纠缠元素时遇到的困难。作者构建了包含约20K真实世界多层布局的CoDeLayout VQA数据集，并提出了MASON后训练范式，通过多模态对齐和结构感知来增强模型对组合式布局的理解能力。

Details

Motivation: 现有视觉语言模型在处理由独立元素组成的原子布局时表现出色，但在需要推理视觉纠缠元素和层次化多层结构的组合式布局时存在困难，这限制了其在文档分析、用户界面创建和图形设计等领域的应用。

Result: 在CoDeLayout数据集上的实验表明，现有最强基线GPT-o3的准确率仅为79.68%，而采用MASON后训练的Qwen2.5-VL 7B模型达到了91.66%的准确率。MASON仅使用30%的训练数据就超越了全数据直接微调，并且随着数据增加展现出更好的扩展性。

Insight: 论文的创新点在于定义了组合式布局理解任务并构建了相应数据集，同时提出了MASON后训练范式，其核心是通过多模态对齐缓解文本元数据与视觉内容之间的语义漂移，以及通过结构感知建模层感知的元素间空间关系来减少结构模糊性，从而有效提升模型对复杂层次化布局的理解能力。

Abstract: Layout understanding, or the interpretation of element organization, is essential for document analysis, user interface (UI) creation, and graphic design. While recent vision-language models (VLMs) excel at interpreting atomic layouts composed of independent elements, they struggle with compositional layouts that require reasoning over visually entangled elements within hierarchical multi-layer structures. In this paper, we introduce a new task, compositional layout understanding, and present CoDeLayout, a VQA dataset of ~20K real-world multi-layer layouts annotated with compositional element pairs and design intent. Through empirical analysis on CoDeLayout, we identify two key challenges for existing VLMs: semantic drift between textual metadata and visual content, and structural ambiguity in hierarchical inter-element relationships. To address these challenges, we propose MASON, a post-training paradigm that integrates multimodal alignment (MA) and structural perception (SP). MA enhances element interpretation by grounding metadata-defined elements to their visual counterparts, mitigating semantic drift, while SP models layer-aware inter-element spatial relationships to improve hierarchical understanding and reduce structural ambiguity. Experiments reveal substantial gaps in existing VLMs: even the strongest baseline, GPT-o3, achieves only 79.68% accuracy, whereas Qwen2.5-VL 7B with MASON reaches 91.66%. Notably, MASON surpasses full-data Direct Finetune using only 30% of the training data and scales better with additional data.

[75] Parameter Efficient Continual Learning for Sparse Event-Based Transformers cs.CVPDF

Vaishnavi Nagabhushana, Kartikay Agrawal, Ayon Borthakur

TL;DR: 本文提出了一种名为sLoTh的参数高效持续学习框架，专为预训练的稀疏事件（脉冲）视觉Transformer设计。该框架通过冻结主干网络，并将可塑性限制在可扩展高效的低秩注意力更新（seLoRA）和共享神经元阈值调制上，实现了无需重放缓冲区的持续学习，更新参数少于1%。实验表明，该方法在多个数据集上实现了具有竞争力的免排练持续学习性能，同时能耗比传统密集视觉Transformer降低约6.5倍。

Details

Motivation: 机器人和边缘智能系统在动态环境中运行，需要模型在严格的内存和能耗约束下持续适应新数据并保留旧知识。稀疏事件视觉Transformer虽然能效高，但其持续学习能力尚未得到充分探索。

Result: 在CIFAR-100、Tiny-ImageNet、ImageNet-100和ImageNet-R数据集上，针对多达100个任务的类增量学习和在线持续学习场景，该方法取得了具有竞争力的免排练性能，同时能耗比传统密集视觉Transformer降低约6.5倍。

Insight: 创新点在于将参数高效微调（PEFT）思想与稀疏事件Transformer结合，通过低秩注意力更新和共享阈值调制实现高效持续学习。客观来看，其核心是将可塑性限制在极少数参数上，并结合了事件驱动的稀疏计算特性，为资源受限场景下的持续学习提供了新思路。

Abstract: Robotic and edge intelligence systems operate in dynamic environments where data arrives continuously, requiring models to adapt while preserving previously learned knowledge under strict memory and energy constraints. While parameter-efficient fine-tuning has shown promise for continual learning with vision transformers, conventional architectures rely on dense computation and remain costly for real-world deployment. Sparse event-based vision transformers provide energy-efficient event-driven computation, yet their continual learning capabilities remain largely unexplored. We here introduce sLoTh, a parameter-efficient continual learning framework for pretrained sparse event-based (spiking) vision transformers. sLoTh freezes the backbone and restricts plasticity to scalable-efficient low-rank attention updates (seLoRA) and shared neuronal threshold modulation, enabling adaptation without replay buffers by updating less than 1% of model parameters. Experiments across CIFAR-100, Tiny-ImageNet, ImageNet-100, and ImageNet-R with up to 100 tasks demonstrate competitive rehearsal-free performance in class-incremental learning and online continual learning, while enabling approximately 6.5x lower energy consumption than conventional dense vision transformers.

Jiahao Wen, Hang Yu, Zhedong Zheng

TL;DR: 本文提出UniGeo，一种用于文本引导跨视角地理定位的多模态大语言模型，通过联合支持地理语义理解、跨视角语义生成和候选级验证，解决现有方法在开放文本查询与候选图像直接匹配时因查询不完整和候选高度相似导致的细粒度定位不可靠问题。

Details

Motivation: 现有基于文本的无人机地理定位方法主要依赖开放文本查询与候选图像的直接全局跨模态匹配，但在查询不完整和候选高度相似的情况下，这种匹配方式不足以实现可靠的细粒度定位。

Result: 在GeoText-1652基准测试上，UniGeo将R@10和mAP分别提升了13.59和2.83个百分点，在多个检索骨干网络上均取得了一致的性能改进，验证了其对于细粒度文本引导无人机地理定位的有效性。

Insight: 创新点在于提出了一个统一的多模态大语言模型框架，联合学习地理语义理解、跨视角语义生成和候选验证；采用多阶段训练策略渐进式学习这些能力，并引入即插即用的验证模块对高度混淆的候选进行细粒度判别，提升了模型对文本引导地理定位任务的适应性。

Abstract: Text-guided drone geo-localization aims to identify a target region in a large-scale image gallery from a natural-language description. Existing methods mainly formulate this task as direct matching between an open-ended text query and candidate images. However, incomplete queries and highly similar candidates often make global cross-modal matching insufficient for reliable fine-grained localization. We propose UniGeo, a unified multimodal large language model (MLLM) for text-guided drone geo-localization. Built on a shared vision-language framework, UniGeo jointly supports geo-semantic understanding, cross-view semantic generation, and candidate-level verification. Specifically, it establishes stable correspondences among local scene elements, spatial relations, and language descriptions through geo-semantic learning, and further models semantic mappings between drone and satellite views through cross-view generation. Based on these capabilities, a plug-and-play verification module performs fine-grained discrimination among highly confusable candidates. We further introduce a multi-stage training strategy that progressively learns geo-semantic understanding, cross-view generation, and candidate verification, improving adaptation to text-guided geo-localization. Experiments demonstrate consistent improvements across multiple retrieval backbones. On GeoText-1652, UniGeo improves R@10 and mAP by 13.59 and 2.83 percentage points, respectively, validating its effectiveness for fine-grained text-guided drone geo-localization.

[77] GeoMAD: Geometry-Aware Multi-View Anomaly Detection via Deformable Fusion and Distributional Alignment cs.CVPDF

Shang-Fu Chen, Jhih-Ciang Wu, Kuan-Chuan Peng, Wen-Huang Cheng, Kai-Lung Hua

TL;DR: 本文提出了GeoMAD，一个用于多视角异常检测的统一框架，旨在解决现有方法在几何对齐和分布一致性方面的不足。该框架通过跨视角可变形融合模块在二维特征图上学习内容自适应的采样偏移，实现无需相机标定的分层跨视角对应；同时引入分布视角对齐损失，以自监督方式对齐各视角的瓶颈分布，确保全局一致性。

Details

Motivation: 多视角异常检测的核心挑战在于如何融合多个视角信息，使其具备充分的几何感知能力，同时保持对多类别工业场景的可扩展性。现有方法（如基于体素或基于图像块的方法）往往在几何对齐精度与计算效率之间存在权衡，且缺乏连续的跨视角对应关系。

Result: 在Real-IAD和MANTA-Tiny数据集上的大量实验表明，GeoMAD在统一的多视角异常检测任务中实现了强大的缺陷检测和定位性能。

Insight: 创新点在于将局部几何对应（通过可变形融合模块实现）与全局分布一致性（通过分布对齐损失实现）相结合，在无需相机标定、体素构建或类别特定三维监督的情况下，实现了几何感知且分布一致的多视角融合，保持了二维特征空间学习的高效性。

Abstract: Multi-view anomaly detection (MvAD) detects defects by exploiting complementary observations from multiple camera viewpoints. The central challenge is to fuse views with sufficient geometric awareness while remaining scalable to multi-class industrial settings. Existing methods typically fall into two extremes: voxel-based fusion provides explicit geometric alignment but requires costly 3D construction and class-specific assumptions, whereas lightweight patch-based fusion is efficient but relies on discrete candidate matching and lacks continuous cross-view correspondence. In this paper, we propose GeoMAD, a unified multi-view, multi-class AD framework that addresses both geometric correspondence deficiency and distributional inconsistency. Our \textit{Cross-view Deformable Fusion Module} (CDFM) learns content-adaptive, view-pair-specific sampling offsets directly on 2D feature maps and arranges them across a multi-scale window pyramid with image-global reference sampling, enabling hierarchical cross-view correspondence without camera calibration, voxel construction, or class-specific 3D supervision. We further introduce \textit{Distributional View Alignment} (DVA), a self-supervised cross-view regularization loss that aligns each view’s bottleneck distribution against a per-instance view-centric target, enforcing global consistency without pixel-level correspondence. Together, CDFM and DVA bridge local geometric correspondence and global distributional consistency, providing geometry-aware and distribution-consistent fusion while preserving the efficiency of 2D feature-space learning. Extensive experiments on Real-IAD and MANTA-Tiny show that GeoMAD achieves strong detection and localization performance in unified MvAD.

[78] Glass Surface Detection Grounded in 3D Visual Geometry cs.CVPDF

Yiwei Lu, Ke Xu, Tao Yan, Xiaojun Chang, Radu Timofte

TL;DR: 本文提出了一种基于3D视觉几何的玻璃表面检测新范式，通过从视觉几何基础Transformer中提取3D先验知识，生成玻璃感知的3D表示，并利用包含频率自注意力模块和几何基础块的新型检测头进行多任务学习，以解决玻璃表面因透明和反射特性导致的检测难题。

Details

Motivation: 现有玻璃表面检测方法主要依赖2D外观线索，在几何模糊场景中容易失效；本文旨在通过将检测任务建立在3D视觉几何基础上，显式建模玻璃表面的物理存在，以提升检测的鲁棒性和准确性。

Result: 在七个标准玻璃表面检测基准测试中取得了最先进的性能，并展示了在视频/多模态数据上的良好泛化能力，同时显著改善了玻璃场景的重建效果。

Insight: 创新点包括将玻璃表面检测从2D外观线索转向3D几何基础的新范式，以及引入频率自注意力模块来定位玻璃特定的频谱特征，并结合几何基础块将2D特征选择性地与3D几何对齐，从而增强了对透明和反射表面的建模能力。

Abstract: Glass surface detection (GSD) is critical for scene understanding and reconstruction, and yet remains challenging due to the transparency and reflectivity of glass surfaces. Existing GSD methods typically rely on 2D appearance cues, which may fail in geometrically ambiguous scenes. In this paper, we propose a paradigm shift: grounding GSD in 3D visual geometry to explicitly model the physical existence of glass surfaces. Our method first distills rich 3D priors from the visual geometry grounded transformer (VGGT) and generates glass-aware 3D representations. It then exploits multi-tasking learning with a novel glass detection head, consisting of two core modules: a Frequency Self-Attention Module (FSAM) that identifies glass-specific spectral features for glass surface localization, and a Geometry Grounding Block (GeGB) that selectively grounds 2D features in 3D geometry for glass surface segmentation. Extensive experiments demonstrate that our method achieves state-of-the-art performance across seven standard GSD benchmarks, generalizes well to video/multi-modal data, and substantially improves reconstruction in glass scenes. Code is available in https://github.com/YT3DVision/VGGT_GLASS.

[79] G2D: Generative-to-Discriminative Collaborative Inference for Zero-Shot Image Classification cs.CVPDF

Zehua Hao, Fang Liu, Qinliang Wang, Yaoyang Du, Xinyan Huang

TL;DR: 本文提出G2D，一个无需训练的零样本图像分类框架，它通过协作式推理结合了判别式模型（如CLIP）和生成式视觉语言模型（VLM）的优势。具体来说，它利用CLIP进行广泛的候选标签检索，然后使用生成式VLM对检索出的候选标签进行基于图像的细粒度验证，以解决歧义问题。

Details

Motivation: 现有方法中，判别式模型（如CLIP）的Top-1预测可能错误，但正确答案常在其Top-K候选列表中，而生成式模型则受限于大标签空间和非结构化输出。两者存在互补性，因此需要将广泛的候选检索与基于图像的细粒度验证分离。

Result: 在八个基准测试上，G2D的平均准确率达到68.85%，优于CLIP的59.35%和单独生成式VLM的63.11%。在七种生成器配置下，候选集验证将平均准确率提升了1.08到27.42个百分点。该方法也能迁移到DCLIP、WaffleCLIP和CuPL等模型上。

Insight: 核心创新点是提出了一个无需训练、模块化的协作推理框架，将判别式模型的检索能力与生成式模型的细粒度视觉推理能力相结合。具体技术亮点包括：利用候选名称和CLIP概率作为结构化先验、固定置信度路由、熵自适应候选集大小调整以及Trie树约束解码，这些设计聚焦于不确定样本的生成式推理并确保测试时每个输入只有一个有效输出。

Abstract: Zero-shot classification needs efficient label retrieval and fine-grained visual reasoning, yet discriminative and generative vision-language models fail in complementary ways.When CLIP’s top-1 prediction is wrong, the correct label often remains in its top-$K$ shortlist, making disambiguation rather than recall the key challenge.Standalone generative models, however, are hindered by large label spaces and unconstrained outputs.This complementarity motivates separating broad candidate retrieval from fine-grained, image-grounded verification.We propose G2D, a training-free framework that uses a generative VLM to verify CLIP-retrieved candidates against the image.Candidate names and CLIP probabilities provide a structured prior for resolving visually similar classes.Fixed confidence routing, entropy-adaptive candidate sizing, and trie-constrained decoding focus generative reasoning on uncertain samples and ensure one valid output for each input at test time.Across eight benchmarks, G2D achieves 68.85% average accuracy, versus 59.35% for CLIP and 63.11% for the standalone VLM.Across seven generator configurations, candidate-set verification improves average accuracy by 1.08–27.42 percentage points.G2D also transfers to DCLIP, WaffleCLIP, and CuPL, supporting a practical interface between discriminative proposal and generative visual reasoning. Code: https://github.com/Harzva/G2D

[80] Ring Forcing: Towards Precise Long-Term Memory for Autoregressive Video Diffusion cs.CVPDF

Bowen Xue, Brandon Y. Feng, Chenguo Lin, Yuchen Lin, Yujia Zeng

TL;DR: 本文提出了Ring Forcing，一种用于自回归视频扩散模型的框架，旨在解决现有模型在生成长视频时缺乏鲁棒长期记忆的问题。该框架通过环形结构训练策略强制从远距离历史中检索信息，并结合压缩与时间步组合策略以及稀疏RoPE机制，以增强对象持久性和扩展记忆容量。

Details

Motivation: 当前视频生成模型在扩展到长时长时面临关键瓶颈：缺乏鲁棒的长期记忆，具体表现为对象持久性不足（无法精确再现重新出现的对象外观）和记忆容量有限（难以处理超长上下文并利用遥远历史信息）。

Result: 大量实验表明，Ring Forcing在实现数分钟长度的连贯性和对象持久性方面表现优异，显著超越了现有最先进（SOTA）方法。

Insight: 创新点在于提出了环形结构训练策略来强制历史检索，以平衡严格的历史遵循与生成多样性；引入了压缩与时间步组合策略在固定序列长度限制下扩展有效历史跨度；以及设计了稀疏RoPE机制以实现灵活、可扩展的记忆适应，同时充分利用预训练先验知识。

Abstract: Scaling video generation to long durations reveals a critical bottleneck: current models lack robust long-term memory. This deficiency can be studied along two critical aspects: object permanence, the ability to precisely reproduce the appearance of objects upon re-entry; and memory capacity, the ability to process ultra-long context and use information from distant history. Robust long-term memory requires both: object permanence without sufficient context handling limits the temporal scope, while long context length without permanence fails to maintain identity. To address this, we present Ring Forcing, an autoregressive video diffusion framework designed to robustly construct and precisely utilize long-term memory. Our ring-structured training strategy enforces retrieval from distant history, effectively reconciling the trade-off between strict historical adherence and generative diversity. To expand memory capacity, we introduce a compression and timestep composition strategy. Under fixed sequence length constraints, this method extends the effective historical span to minutes-long durations and achieves a comprehensive receptive field over the entire history. Furthermore, we present a sparse RoPE mechanism to enable flexible, scalable memory adaptation while fully exploiting pre-trained priors. Extensive experiments demonstrate that Ring Forcing achieves superior minutes-long coherence and object permanence, significantly outperforming state-of-the-art methods.

[81] Multi-Image Visual Token Pruning in Large Visual Language Models cs.CVPDF

Rongyang Zhang, Chengqiang Lu, Cong Li, Hongchao Gu, Tingjia Shen

TL;DR: 本文提出了一种无需训练的、适用于多种大型视觉语言模型（LVLM）架构的自适应视觉令牌剪枝（AVTP）框架，旨在解决多图像序列处理中的计算和上下文长度限制。该方法通过经验分析确定剪枝层，并在多图像场景中根据图像重要性自适应调整剪枝比例，从而显著提升推理速度并保持高精度。

Details

Motivation: 现有视觉令牌剪枝方法多为静态策略，难以适应不同架构的LVLM和多图像场景，且依赖于注意力计算，与FlashAttention等高效技术不兼容，因此需要一种更灵活、高效的剪枝方案。

Result: 在多个多图像基准测试中，Qwen3VL-8B实现了2倍推理加速，同时保持96.1%的原始准确率；InternVL3.5-8B保持94.1%的准确率；LLaVA-OV-7B甚至超过了原始基线性能。

Insight: 创新点在于提出了一种无需训练、架构自适应的剪枝框架，通过经验分析视觉注意力分布来确定剪枝层，并在多图像场景中引入基于重要性的自适应剪枝比例，这提高了方法的通用性和效率，同时避免了与高效注意力技术的兼容性问题。

Abstract: With the growing demand for processing multiple image sequences in real-world applications, various visual token pruning methods have emerged to mitigate the computational and context length constraints faced by Large Vision Language Models (LVLMs). However, most existing pruning approaches rely on static strategies that struggle to adapt across different architectural LVLMs and multi-image scenarios, and are additionally constrained by their dependence on attention computations that are incompatible with efficient techniques like FlashAttention. To address these limitations, we propose a training-free, Adaptive Visual Token Pruning (AVTP) framework, applicable to diverse LVLM architectures. We strategically determine pruning layers based on empirical analysis of visual attention distributions across various LVLMs, and implement adaptive pruning ratios in multi-image contexts where images of higher importance retain proportionally more tokens. We conduct extensive experiments across different LVLMs to demonstrate the effectiveness and robustness of AVTP. Specifically, Qwen3VL-8B achieves 2 times inference speedup while maintaining 96.1% of its original accuracy on multiple multi-image benchmarks, InternVL3.5-8B retains 94.1% accuracy, and LLaVA-OV-7B even exceeds its original baseline performance. Our code is available at \href{https://github.com/zry13/AVTP}{this link}.

[82] Cross-Architecture Knowledge Distillation from a Vision Foundation Model to a Lightweight Visual State Space Model for Tea Leaf Disease Classification cs.CVPDF

Zibo Zhou, Zongsen Qiu, Rui Chen, Yujie Yao, Yue Zhou

TL;DR: 该论文研究了一种跨架构知识蒸馏方法，用于茶叶病害分类任务。该方法从一个经过微调的、基于Vision Transformer的大型视觉基础模型（DINOv2）中蒸馏知识，到一个轻量级的双向视觉状态空间模型（LVSSM）。通过解决训练稳定性问题并采用温度缩放的logit蒸馏，学生模型在参数减少5倍的同时，达到了接近教师模型的分类精度。

Details

Motivation: 在边缘设备上部署高精度的茶叶病害分类模型面临计算资源限制的挑战。大型自监督视觉基础模型（如DINOv2）特征强大但难以部署，而直接在小型农业数据集上从头训练轻量模型又容易欠拟合。因此，需要探索从大型模型到轻量模型的跨架构知识蒸馏。

Result: 在茶叶病害分类数据集上，通过所提出的知识蒸馏方法，学生模型的平均测试准确率从92.32%提升至95.41%（最佳单次运行达96.20%），平均增益为+3.09个百分点。该学生模型参数量（4.45M）仅为教师模型（22M）的1/5，但保留了其98.3%的准确率。

Insight: 论文的创新点在于探索了从Vision Transformer到视觉状态空间模型（SSM）的跨架构知识蒸馏，并识别并修复了SSM在有限数据下训练不稳定的两个关键问题（大尺寸的patch-embedding卷积和切断残差路径的融合层）。研究发现，对于此类蒸馏，简单的logit-level蒸馏效果优于中间特征对齐损失，这为跨架构蒸馏提供了有价值的经验。

Abstract: Automated tea leaf disease classification supports precision agriculture, yet deploying accurate models on edge devices remains challenging under tight compute budgets. Self-supervised vision foundation models such as DINOv2 provide strong features but are too large for field deployment, while lightweight models trained from scratch on small agricultural datasets often underfit. We study cross-architecture knowledge distillation (KD) from a fine-tuned DINOv2 teacher (Vision Transformer) to a compact bidirectional Visual State Space Model (LVSSM) student, an underexplored direction because the architectures use fundamentally different token-mixing mechanisms. We identify and fix two training-stability problems that prevent the from-scratch SSM student from learning on limited data: a single large patch-embedding convolution and a fusion layer that severs the residual path. With a progressive convolutional stem and gated bidirectional selective-scan block, the 4.45M-parameter student trains stably. Across three seeds, temperature-scaled logit distillation raises test accuracy from 92.32+/-2.14% to 95.41+/-1.17% (best single run: 96.20%; macro-F1: 94.45%), a +3.09 percentage-point mean gain. The student uses 5.0 times fewer parameters than the 22M-parameter teacher while retaining 98.3% of its accuracy. Ablations show that intermediate feature-alignment losses reduce accuracy, making simple logit-level KD the strongest configuration. A fair from-scratch comparison shows the gain is specific to students that start below the teacher. We report per-class metrics, confusion matrices, bootstrap confidence intervals, and FLOPs/latency measurements, and discuss limitations including the single-dataset scope and simplified non-official SSM implementation.

[83] Thinking on Shots: Consistent Multi-Shot Video Editing with Agentic Reasoning cs.CV | cs.MMPDF

Chenyang Wu, Fuchen Long, Binyuan Huang, Xinlong Sun, Xi Chen

TL;DR: 本文提出了多指令多镜头长视频编辑任务（MMLVE），旨在解决现有方法在编辑长视频时存在的实体碎片化、编辑幻觉和时间连续性破坏等问题。作者引入了一个基于大语言模型和视觉语言模型的智能体编辑框架，通过镜头级视频解耦和精确指令解析来实现一致的多镜头视频编辑。

Details

Motivation: 现有生成式AI视频编辑方法主要关注单镜头或短视频剪辑，而编辑包含多个指令的长视频仍面临巨大挑战，简单的分块策略会导致实体碎片化、严重编辑幻觉和时间连续性中断。

Result: 在构建的MMLVE-Bench数据集上进行的广泛实验表明，所提出的MMLVE-Agent框架优于现有的闭源SOTA方法（如Seedance 2.0），成功消除了编辑幻觉，保持了跨镜头编辑一致性，并实现了无缝的时空过渡。

Insight: 创新点在于定义了具有三个核心目标（跨镜头编辑一致性、多指令解耦、时空结构零破坏）的MMLVE任务，并提出了一个结合LLM和VLM的智能体框架来处理镜头级解耦和指令解析，同时构建了专门的评估数据集和指标。

Abstract: While generative AI has significantly advanced video editing, existing methods primarily focus on single-shot or short video clips. Editing long videos with multiple instructions remains a formidable challenge. Naive chunking strategies, e.g., fixed-duration segmentation, often lead to entity fragmentation, severe editing hallucinations, and disrupted temporal continuity. To bridge this gap, we introduce the Multi-Instruction Multi-Shot Long-Video Editing (MMLVE) task, which is structured around three core objectives: Cross-Shot Editing Consistency (CSEC), Multi-Instruction Decoupling (MID), and Zero-Destruction on Spatiotemporal Structure (ZDSS). To tackle these three unique challenges, we introduce an agentic editing framework that leverages the synergy of Large Language Models (LLMs) and Vision-Language Models (VLMs) to achieve shot-level video decoupling and precise instruction parsing. Furthermore, to comprehensively evaluate this task, we construct MMLVE-Bench, which is an MMLVE-focused dataset characterized by complex real-world spatiotemporal dynamics, high-density heterogeneous instructions, and sparse, random entity distributions. Three MMLVE-focused evaluation metrics are further exploited to assess the quality of the editing results. Extensive experiments demonstrate that our MMLVE-Agent outperforms existing closed-source SOTA approaches (e.g., Seedance 2.0), successfully eliminating editing hallucinations, preserving cross-shot editing consistency, and attaining seamless spatiotemporal transitions.

[84] LLaVAFlow: Preserving Latent Alignment Flow for Parameter-Efficient Multimodal Fine-Tuning cs.CVPDF

Muyao Yuan, Muyan Jiao, Jiangyong Ying, Weizhan Zhang, Yuanhong Zhang

TL;DR: 本文提出LLaVAFlow，一种基于信息论蒸馏的框架，旨在解决多模态大语言模型（MLLMs）在视觉指令微调下游任务时出现的灾难性遗忘问题。该方法通过压缩互信息来提炼和保持预训练模型中的跨模态对齐流，从而在提升下游任务性能的同时，维持模型的泛化能力。

Details

Motivation: 现有方法通过调节权重更新来减少遗忘，但忽视了MLLMs中根本的跨模态对齐。作者认为跨模态对齐隐含在信息压缩轨迹中，需要被保留。

Result: 大量实验表明，LLaVAFlow是一个有效的即插即用框架，在保持对齐流的同时，提升了多个下游任务的性能并增强了泛化能力。

Insight: 创新点在于从信息论角度出发，将跨模态对齐视为一种可提炼和转移的“对齐流”，并通过互信息压缩和最大化来实现参数高效的微调，避免了直接调整模型权重带来的遗忘问题。

Abstract: While Multimodal Large Language Models (MLLMs) exhibit strong generalization, visual instruction tuning for downstream tasks inevitably causes catastrophic forgetting, impairing overall generalization. While existing methods regulate weight updates to reduce forgetting, they overlook the fundamental cross-modal alignment in MLLMs. Based on prior work and our observations, we argue that cross-modal alignment is implicitly captured in the information-compression trajectory. To preserve the alignment flow embedded in the trajectory, we propose LLaVAFlow, an information-theoretic distillation framework. First, we compress the mutual information between the extracted relations and MLLM embeddings, encouraging a learnable module to produce a refined alignment flow that benefits downstream tasks. Second, we maximize the mutual information between the extracted alignment flows of the pretrained and fine-tuned MLLMs, enabling the transfer of compact alignment information. Extensive experiments show that LLaVAFlow is an effective plug-and-play framework that preserves alignment flow and enhances both downstream performance and generalization.

[85] MedFG-VQA: Low-Frequency Memory and Graph Attention for Lightweight Medical VQA cs.CV | cs.AIPDF

Haowen Gu, Gensheng Pei, Zeren Sun, Mingwu Ren, Xiangbo Shu

TL;DR: 本文提出MedFG-VQA，一个轻量级的医学视觉问答框架。它通过基于DCT的低频特征记忆库和基于图注意力的跨模态对齐机制，在计算成本显著降低的情况下，在多个生物医学VQA基准上取得了有竞争力甚至更优的性能。

Details

Motivation: 解决医学视觉问答领域标注数据稀缺，以及现有大型视觉语言模型计算需求高、难以临床部署的问题。

Result: 在自建的SynMed-VQA（包含超过200万个QA对）和三个标准生物医学VQA基准上的实验表明，该模型性能与更大模型相当或更优，同时计算成本显著更低。

Insight: 创新点在于结合了可学习的低频特征记忆库（FMF）和图感知的跨注意力机制（GACA）来增强特征表示与对齐；同时，利用GPT-4o构建大规模合成数据集以缓解数据稀缺问题，是数据增强和模型轻量化设计的有效结合。

Abstract: Medical Visual Question Answering (Med-VQA) holds significant promise for clinical decision support, yet faces challenges due to limited annotated data and the high computational demands of existing large vision-language models. We propose MedFG-VQA, a lightweight framework that leverages a memory bank to augment DCT-based low-frequency features and employs graph-enhanced cross-attention for effective visual-textual alignment. Specifically, our approach features two key components: Frequency-Memory Fusion (FMF), which enhances low-frequency features by retrieving from a learnable memory bank built on DCT decomposition, and Graph-Aware Cross-Attention (GACA), which aligns visual-textual features via cross-attention and refines them through graph-convolutional aggregation. To address data scarcity, we construct SynMed-VQA, a large-scale synthetic dataset comprising over 2 million question-answer pairs across 9 imaging modalities and 10 major organs, generated with GPT-4o. Extensive experiments on SynMed-VQA and three other standard biomedical VQA benchmarks demonstrate that MedFG-VQA achieves competitive or superior performance compared to much larger models while maintaining significantly lower computational costs, highlighting its efficiency and potential for clinical deployment.

[86] From Reasoning to Pixels: Grounded Medical Multimodal LLMs for VQA and Segmentation cs.CV | cs.AIPDF

Haowen Gu, Gensheng Pei, Junzhu Mao, Qiong Wang, Mingwu Ren

TL;DR: 本文提出MedREAL框架，通过SARP模块从MLLM的隐藏状态中提取与任务相关的语义证据，并结合R2V融合机制将推理感知特征注入分割流程，实现了医学视觉问答与分割的统一。

Details

Motivation: 现有医学多模态大语言模型在Med-VQA中依赖全局图像特征，缺乏像素级定位能力，限制了临床可信度，因此需要弥合高级临床推理与空间定位之间的语义鸿沟。

Result: 在构建的MedRAVS-13K数据集上，MedREAL显著优于现有方法，在基准评估中达到68.49% gIoU和70.47% cIoU，实现了SOTA性能。

Insight: 创新点在于提出SARP模块直接从[SEG]令牌蒸馏语义证据，以及R2V机制将推理特征注入分割解码，通过生成与文本诊断严格一致的证据掩码，提供了可解释的医学图像分析框架。

Abstract: Although Multimodal Large Language Models (MLLMs) have demonstrated impressive performance in Medical Visual Question Answering (Med-VQA), their reliance on global image features often lacks precise pixel-level grounding, thereby limiting clinical trustworthiness. To bridge the semantic gap between high-level clinical reasoning and spatial localization, we propose \textsc{\textsc{MedREAL}} (\textbf{Med}ical \textbf{RE}asoning-driven \textbf{A}nswering and \textbf{L}ocalization), a unified framework that seamlessly aligns linguistic reasoning with spatial grounding. Specifically, \textsc{MedREAL} introduces \textbf{S}eg \textbf{A}nchored \textbf{R}easoning \textbf{P}ooling (SARP) to distill task-relevant semantic evidence directly from \texttt{[SEG]} tokens within the MLLM’s hidden states. Furthermore, a \textbf{R}easoning-to-\textbf{V}isual (R2V) fusion mechanism is proposed to effectively inject these reasoning-aware features into a segmentation pipeline for accurate mask decoding. To facilitate this paradigm, we construct MedRAVS-13K, a comprehensive dataset comprising 13,824 expertly validated samples across four diverse imaging modalities. Extensive experiments demonstrate that \textsc{MedREAL} significantly outperforms state-of-the-arts, achieving 68.49% gIoU and 70.47% cIoU on benchmark evaluations. By generating evidence masks that are strictly consistent with textual diagnoses, \textsc{MedREAL} provides a robust, interpretable framework for reasoning-driven medical image analysis.

[87] Order Matters: A Chinese Multi-Panel Meme Benchmark for Vision-Language Reasoning cs.CVPDF

Haihan Li, Haihao Li, Zhenfei Xu, Jize Qian

TL;DR: 该论文提出了CMPM基准，这是一个包含1,214个标注样本的中文多格漫画（meme）评测集，用于评估大视觉语言模型在结构化视觉序列上的顺序感知推理能力。研究设计了结构类型识别、顺序敏感的面板排序（Task1）和中文漫画解释生成（Task2）两层评估任务，并对五个代表性LVLM进行了统一评测。

Details

Motivation: 现有大视觉语言模型在单图像理解上表现强劲，但其能否对结构化漫画布局（尤其是中文社交媒体中依赖阅读顺序和跨面板视觉-文本线索的漫画）进行序列感知推理，仍不清楚。

Result: 在Task1中，主要打乱顺序的条件导致准确率急剧下降，揭示了模型在顺序敏感多模态推理上存在持续差距。在Task2中，人类评分偏好显示Gemini 3.1 Pro和GPT-5.5优于开源模型，而评论上下文仅带来小幅且混合的性能提升。

Insight: 论文的核心创新在于构建了首个专注于中文多格漫画顺序依赖推理的基准，并通过精心设计的任务（如顺序打乱对比）揭示了模型表现与真实顺序理解之间的差异，即标准显示准确率本身不足以证明模型理解了顺序。这为评估LVLM的序列感知和结构化视觉推理能力提供了新视角和工具。

Abstract: Many multimodal tasks depend on how visual elements are ordered and composed, not only on recognizing them in isolation. Internet memes are a compact case of this problem: their punchline often depends on a constrained reading order and cross-panel visual–textual cues. While large vision-language models (LVLMs) show strong performance on single-image understanding, it remains unclear whether they can perform sequence-aware reasoning over structured meme layouts, especially in Chinese social media. We introduce CMPM, a Chinese Multi-Panel Meme benchmark with 1,214 annotated samples covering five structural types, ordering dependency, panel-order constraints, and optional comment context. We formulate a two-layer evaluation: Task1 probes structure typing and order-sensitive panel sequencing (with a context ablation setting), and Task2 evaluates Chinese meme explanation generation with human ratings on five 1-3 Likert dimensions (visual, panel, humor, context, and faithfulness). We benchmark five representative LVLMs under a unified protocol. Results indicate that canonical-display accuracy is not by itself evidence of order understanding: the primary shuffled condition produces a sharp accuracy drop, revealing a persistent gap in order-sensitive multimodal reasoning. Task2 preferences place Gemini 3.1 Pro and GPT-5.5 above the open models, while comment context yields only a small and mixed Core4 gain. Code and data will be released upon acceptance.

[88] Self-OPD: On-Policy Distillation for Flow Matching Models without Teacher cs.CVPDF

Shiyi Zhang, Mushui Liu, Yunze Tong, Wanggui He, Siyu Zou

TL;DR: 本文提出了一种名为Self-OPD的无教师策略蒸馏框架，用于流匹配模型。该方法通过将学生模型自身的随机探索转化为逐步监督信号，避免了传统方法中训练特定教师模型的高昂成本以及师生分布差异导致的误差累积问题。

Details

Motivation: 传统策略蒸馏方法需要为每个新目标训练专门的教师模型，计算成本高，且师生分布差异会导致生成轨迹上的误差累积。本文旨在解决这两个核心问题。

Result: 在单一和混合奖励基准测试上的实验表明，Self-OPD在无需任务特定教师模型的情况下，超越了先前的强化学习和策略蒸馏方法。

Insight: 核心创新在于提出了一种完全自监督的蒸馏框架，通过分支随机SDE候选、ODE采样器展开、基于奖励计算归一化优势值，并设计了一个方向感知衰减和SDE方差归一化的全分支推拉目标来优化速度场。对于多目标对齐，该方法在奖励层面融合归一化分数，避免了直接的梯度冲突。

Abstract: On-policy distillation (OPD), which leverages a pre-trained, specialized teacher model to provide dense supervisory signals, has achieved significant success in Large Language Models (LLMs) and has recently been adapted to flow matching models. However, this paradigm suffers from two major issues: First, training a separate, task-specific teacher for every new objective incurs high computational costs. Second, the discrepancy between teacher and student distributions often leads to compounding errors along the generation trajectory. In this paper, we introduce \textbf{Self-OPD}, a teacher-free OPD framework for flow matching models that turns the student’s own self-exploration into step-wise supervision. At each timestep, Self-OPD branches the deterministic next-state prediction into $K$ stochastic SDE candidates, rolls them out with the ODE sampler, and compares their rewards against a deterministic self-reference baseline to obtain normalized advantages. The velocity field is optimized with an all-branch pull-push objective, where high-advantage branches attract the student and low-advantage branches repel it under direction-aware attenuation and SDE-variance normalization. For multi-objective alignment, Self-OPD fuses normalized scores at the reward level, avoiding direct gradient conflict. Experiments on single and mixed reward benchmarks show that Self-OPD outperforms prior RL and OPD methods without task-specific teachers.

[89] Tether the Subject, Release the Scene: Query-Aware Memory Routing for Long-Horizon Autoregressive Video Generation cs.CVPDF

Chen Li, Peng Zhang, Hanyu Zhou, Jialong Zuo, Fei Wang

TL;DR: 本文提出TetherMem，一种无需训练的查询感知时空记忆路由器，用于解决流式自回归视频生成中因历史记忆锁定导致的场景停滞问题。该方法通过分离主体和场景查询，并基于区域和时序先验调制历史访问，使主体保持身份一致性，同时允许场景背景、视角和结构随局部运动自然演进。

Details

Motivation: 现有流式自回归视频生成方法通常以相似策略处理主体和场景查询，虽能稳定主体身份，但会导致背景、视角和场景结构被历史状态过度锁定，即使局部运动仍在继续，造成场景演进不足。

Result: 在10名标注者提供的2400个盲测成对判断中，TetherMem在八个流式长视频基线中获得了最高的整体质量（0.780）和场景演进（0.769）预期偏好估计。在完整的30秒视频生成中，它能持续改变背景、视角和场景状态，同时保持主体可识别性和时间连续性。

Insight: 创新点在于将主体与场景查询解耦，并引入基于区域和时序先验的调制机制，动态控制对历史记忆的访问。这提供了一种无需重新训练即可提升现有冻结视频生成器在长序列生成中场景动态性与一致性平衡的轻量级方案。

Abstract: Streaming autoregressive video models generate long videos chunk by chunk, using historical memory to maintain consistency. Existing methods typically expose subject and scene queries to history through similar policies. This stabilizes the subject, but can also lock backgrounds, viewpoints, and scene structure to previously generated states even when local motion continues. We call this failure memory-anchored scene under-progression; consistency and motion metrics alone can miss it. We introduce TetherMem, a training-free, query-aware spatiotemporal memory router for frozen video generators. TetherMem separates subject and scene queries and modulates historical access with region- and age-conditioned priors: subject queries retain identity-bearing history, while scene queries reduce reliance on subject history and stale backgrounds. Across 2,400 blinded pairwise judgments from 10 annotators, TetherMem achieves the highest estimated expected preference among eight streaming long-video baselines for overall quality (0.780) and scene progression (0.769). On complete 30-second videos, it sustains changes in background, viewpoint, and scene state while preserving subject recognizability and temporal continuity.

[90] RubricRM: Generative Reward Modeling via Dynamic Rubrics for Image Generation and Editing cs.CVPDF

Zijian Kan, Wei Wang, Long Luo, Bing Zhao, Xuan Ren

TL;DR: 本文提出了RubricRM，一种用于图像生成和编辑的成对生成式奖励建模框架。该方法首先生成包含评估维度、权重和评分标准的输入特定评分标准，然后应用该标准对候选图像进行评分。通过两阶段训练流程，RubricRM在多个生成和编辑基准测试中超越了现有专门奖励模型，并与强大的专有多模态大语言模型评判者保持竞争力。

Details

Motivation: 现有视觉奖励模型通常使用单一标量分数或依赖固定标准，无法适应不同指令，这限制了模型的可解释性和任务敏感性，特别是在需要不同评估维度的文本到图像生成和基于指令的图像编辑任务中。

Result: 在多个生成和编辑基准测试上的实验表明，RubricRM超越了现有的专门奖励模型，并且尽管使用较小的骨干网络，仍能与强大的专有多模态大语言模型评判者保持竞争力。

Insight: 核心创新在于提出了动态生成输入特定评分标准的范式，将奖励建模从单一标量或固定标准转变为可解释、任务敏感的细粒度评估。两阶段训练流程（监督微调结合GRPO的细粒度维度级奖励）有效提升了评分能力。

Abstract: Reward models play an essential role in aligning visual generative models, yet most existing visual reward models use a single scalar score or rely on fixed criteria that cannot adapt to different instructions. This limits both interpretability and task sensitivity, especially for text-to-image generation and instruction-based image editing, where different inputs require different evaluation dimensions. We propose RubricRM, a pairwise generative reward modeling framework that first produces an input-specific rubric with evaluation dimensions, weights, and scoring criteria, and then applies the rubric to score candidate images. We train dedicated RubricRM models for text-to-image generation and image editing using a two-stage training pipeline: supervised fine-tuning teaches the model the rubric-based scoring paradigm, while GRPO further improves scoring through fine-grained dimension-level rewards. Experiments on multiple generation and editing benchmarks show that RubricRM outperforms existing specialized reward models and remains competitive with strong proprietary MLLM judges despite using smaller backbones. Our models, data, and code are available at https://github.com/zijiankan/RubricRM.

[91] AraMS-28k: The Largest Publicly Released Line-Level Dataset of Historical Arabic Manuscripts with Margin and Insertion-Anchor Annotations cs.CV | cs.CLPDF

Mohamed Guechaoui, Mohamed Diaa Zellagui, Souleyman Chaib, Sahraoui Dhelim

TL;DR: 本文介绍了AraMS-28k，这是一个目前公开的最大历史阿拉伯语手稿行级数据集，包含14本书、3,043页和28,600个标注文本行（27,971个正文行，629个边注行）。数据集涵盖了Naskh、Ruq’ah和Maghrebi三种书写传统的手抄本以及一本石印印刷版，以增加格式多样性。每行被标注为正文或边注，且边注行在正文中有明确附着点的还标注了插入锚点，从而在线级粒度上恢复了手稿真实的非线性阅读顺序。数据集提供了带完整元音符号的原始转录和经过元音规范化的转录版本，并采用RefLAM（基于参考的标注流程）结合多模态大语言模型OCR、独立来源的干净转录和人工审核来构建。数据集以CC BY-NC-SA 4.0协议发布，包含页面图像、行级标注和固定的训练/验证/测试划分，旨在支持阿拉伯语手稿识别、版面分析和阅读顺序恢复的可重复研究。

Details

Motivation: 解决历史阿拉伯语手稿领域缺乏大规模、高质量、公开可用的行级标注数据集的问题，特别是缺乏能够恢复手稿非线性阅读顺序（如边注与正文的关联）的细粒度标注。

Result: 提供了详细的语料库和每本书级别的数据集统计信息，并给出了使用Kraken和HATFormer的基线手写文本识别（HTR）结果，包括从分布内页面到完全未见书籍的跨书写传统泛化梯度分析。

Insight: 创新点在于首次为历史阿拉伯语手稿语料库发布了包含边注和插入锚点标注的行级数据集，恢复了线级的非线性阅读顺序；同时，通过RefLAM流程结合自动化验证与专家监督来保证数据质量，并提供了元音符号化和规范化两种转录版本以应对手稿通常无元音符号的特点，为相关研究提供了重要的基准资源。

Abstract: We introduce AraMS-28k, the largest publicly released line-level dataset of genuine historical Arabic manuscripts, comprising 14 books, 3,043 pages, and 28,600 annotated text lines (27,971 main-text, 629 margin). Thirteen books are hand-copied manuscripts spanning three script traditions – Naskh, Ruq’ah, and Maghrebi – and one is a lithographed printed edition included to broaden format diversity. Each line is labelled as main-text or margin, and margin lines that have an unambiguous attachment point in the main text are further annotated with an insertion anchor, recovering the manuscript’s true non-linear reading order at line-level granularity – to our knowledge the first such annotation released for a historical Arabic manuscript corpus. Because reference transcriptions are fully vocalised while manuscript hands are typically undiacritised, we release both the raw diacritised transcription and a diacritic-normalised counterpart for every line. The dataset was constructed with RefLAM, a reference-grounded annotation pipeline that aligns multimodal-LLM OCR against independently sourced clean transcriptions and routes every line through human review, combining automatic verification with expert oversight. We describe the construction and quality-control process, present the annotation schema, report dataset statistics at both the corpus and per-book level, and provide baseline HTR results using Kraken and HATFormer, including a cross-script generalisation gradient from in-distribution pages to fully unseen books. AraMS-28k is released with page images, line-level annotations, and fixed train/val/test splits under CC BY-NC-SA 4.0 to support reproducible research on Arabic manuscript recognition, layout analysis, and reading-order recovery.

[92] TempJail: Temporal Jailbreak Attacks against Image-to-Video Generation Models cs.CV | cs.MMPDF

Qi Lu, Zehui Guo, David Yuanda Gan, Zijing Li, Hengda Zhang

TL;DR: 本文提出了一种针对图像到视频生成模型的新型时序越狱攻击框架TempJail，该攻击利用视频生成特有的时序维度，通过将恶意语义分解为初始帧视觉条件和时序文本指令，并结合潜在扰动与文本伪装技术，使不安全内容在时间推移中逐渐触发。实验表明，该方法在多个闭源商业模型上显著提升了攻击成功率。

Details

Motivation: 现有研究主要关注单帧违规的越狱攻击，忽视了视频生成模型特有的时序维度安全风险。本文旨在探究图像到视频系统中的时序脆弱性，即不安全语义可能通过时间上的语义组合而非单帧出现。

Result: 在Kling、Seedance、Veo和PixVerse等闭源商业模型上的实验表明，TempJail在GPT-5.2评估下将攻击成功率比先前最先进方法提升了23.3%，在人工评估下提升了22.0%。

Insight: 创新点在于首次系统性地针对I2V模型的时序维度进行越狱攻击，提出了时序抽象和语义伪装两大挑战的解决方案：通过分解恶意指令为视觉与文本时序组件，并利用扩散采样中的受控潜在扰动及安全过滤器规避的文本模板，实现了恶意语义的渐进式触发。

Abstract: In recent years, image-to-video (I2V) generation models have made remarkable progress in subject consistency and temporal coherence, enabling high quality video synthesis. However, these advances also introduce new safety risks. Existing studies mainly focus on jailbreak attacks involving single frame violations, while largely overlooking the temporal dimension unique to video generation models. In this paper, we investigate three attack scenarios and uncover a temporal vulnerability in I2V systems: unsafe semantics may emerge not from a single frame, but from semantic composition over time. We further identify two key challenges in such attacks: temporal abstraction and semantic camouflage. To address these issues, we propose TempJail, a novel temporal jailbreak framework for I2V systems. For temporal abstraction, we decompose a target malicious caption into an initial frame visual condition and a temporal text instruction. For semantic camouflage, on the image side we model semantic injection as controlled latent perturbation in diffusion sampling and introduce gradient guidance from pretrained encoders. On the text side, we rewrite the caption into an innocuous ``subject-action-scene’’ template that bypasses safety filters while preserving temporal guidance. In the black-box inference phase, these two modalities jointly enable malicious semantics to be gradually triggered over time. Experiments on closed-source commercial models, including Kling, Seedance, Veo and PixVerse, show that TempJail improves attack success rate over prior state-of-the-art methods by 23.3% under GPT-5.2 evaluation and 22.0% under human evaluation. Our codes are available at \href{https://github.com/luqi-glory/TempJail}{GitHub}.

[93] Aphanta: Diagnosing Task-Aligned Image-Edited Intermediates for Multimodal Reasoning cs.CVPDF

Hengyuan Xu, Wei Cheng, Yumeng Ji, Xuanyang Zhang, Xianfang Zeng

TL;DR: 本文提出了Aphanta框架，用于自动诊断和评估在多模态大语言模型（MLLM）推理流程中，图像编辑器生成的视觉中间状态（image-edited intermediates）与任务的对齐程度及其实际效用。该框架通过比较直接推理、使用编辑器生成的中间状态推理以及使用理想化参考中间状态推理三种条件，来分离视觉改进的潜力与当前编辑器的实际能力。研究发现，编辑器的效用高度依赖于具体任务类型。

Details

Motivation: 动机在于，虽然显式的视觉中间状态可以帮助MLLM外化空间证据和更新视觉状态，但其效用取决于图像编辑器能否忠实实现所需的视觉转换。目前缺乏系统性的方法来评估这种‘MLLM -> 图像编辑器 -> MLLM’流程中编辑器的实际贡献与任务对齐度。

Result: 在20个候选任务和多种编辑器-MLLM组合上的实验表明，效用集中在视觉线索注入、定位和反事实状态实现等任务上。在筛选出的正面任务子集上，整合的Qwen流程将平均任务分数从0.343提升至0.445（相对提升29.7%）。研究也保留了过滤掉的和不成功的任务以揭示能力边界。

Insight: 主要创新点在于提出了一个可复用的自动化诊断框架（Aphanta），用于系统评估视觉中间状态在MLLM推理流程中的任务对齐度和实际效用。核心见解是，图像编辑应被视为一种专门的视觉工作空间，而非通用的推理机制，其价值高度依赖于任务类型。

Abstract: Explicit visual intermediates can help multimodal large language models (MLLMs) externalize spatial evidence and updated visual states, but their utility depends on whether an image editor can faithfully realize the required transformation. We introduce \textbf{Aphanta}, an automated task-discovery and closed-loop diagnostic framework for the MLLM -> image editor -> MLLM pipeline. Aphanta evaluates three conditions—direct reasoning, reasoning with an editor-generated intermediate, and reasoning with an idealized reference intermediate—to separate potential visual headroom from the practical utility of current editors. Across 20 candidate tasks and multiple editor–MLLM combinations, we find that utility is strongly task-conditioned. Gains concentrate in visual cue injection, grounding, and counterfactual state realization, whereas intermediates requiring symbol-sensitive construction or structural extrapolation are substantially less reliable. On the selected positive-task subset, our consolidated Qwen pipeline improves the mean task score from 0.343 to 0.445 ($+10.2$ points; $+29.7%$ relative), while the full study also retains filtered and unsuccessful tasks to expose the boundary. These results position image editing as a specialized visual workspace rather than a universal reasoning mechanism, and establish Aphanta as a reusable protocol for measuring task–representation alignment, editor realization, and downstream pipeline utility.

[94] MVC-Bench: Benchmarking Calibration of Medical Vision-Language Models cs.CVPDF

Ashshak Sharifdeen, Shihab Aaqil Ahamed, Ufaq Khan, Muhammad Akhtar Munir Sujair Ibrahim, Mohamed Rafeek Mareer Ahamed

TL;DR: 该论文提出了MVC-Bench，一个专注于校准评估的医学视觉-语言模型基准测试。该基准从三个维度评估模型校准性能：对模态、主干网络和领域偏移的鲁棒性；校准策略和提示调优方法的有效性；以及在提示模板和随机种子变化下的稳定性。论文还提出了一种简单的训练时校准方法MCM正则化，并在大量实验中验证了其有效性。

Details

Motivation: 现有研究主要关注提升医学视觉-语言模型的准确性，而对其置信度校准在临床安全关键场景下的可靠性评估不足。

Result: 在涵盖8种主干网络、3种医学模态的1638个受控实验中，以准确率和预期校准误差为主要指标进行评估。提出的MCM正则化方法在12个域内设置中的10个上取得了最低的ECE，并在领域偏移下保持竞争力。

Insight: 创新点在于构建了首个系统评估医学VLM校准性能的基准，并揭示了模型失校准的潜在原因。提出的MCM正则化是一种简单有效的训练时校准方法，为提升医疗AI系统的安全可靠性提供了具体方案。

Abstract: Reliable evaluation of vision-language models (VLMs) and medical vision-language models (Medical-VLMs) requires calibrated confidence, particularly under realistic clinical conditions. However, existing efforts mainly focused on improving accuracy, leaving calibration in the medical domain underexplored. To this end, we propose MVC-Bench, a calibration-centric benchmark for medical image classification with VLMs and Medical-VLMs. MVC-Bench assesses the calibration across three axes: (i) robustness to modality, backbone, and domain shift (ii) effectiveness of calibration strategies and prompt-tuning methods (iii) stability under prompt-template and random-seed variations. The benchmark covers eight different backbones, three medical modalities, including fundus imaging, histopathology, and chest X-ray under in-domain and domain shift settings. It compares post-hoc calibration, train-time calibration, and zero-shot inference methods, together with six prompt-tuning methods. Across more than 1638 controlled experiments, we report accuracy and Expected Calibration Error (ECE) as primary metrics, and further report results with complementary calibration measures, including Maximum Calibration Error (MCE) and Adaptive Calibration Error (ACE). We further investigate the underlying causes of miscalibration in VLMs and Medical-VLMs and propose a simple train-time calibration method, Multi-Class Margin (MCM) regularization, which achieves lowest ECE on 10 out of 12 settings in in-domain and remains competitive under domain shifts. Collectively, MVC-Bench provides a structured evaluation framework and actionable guidance for improving calibration in safety-critical medical workflows.

[95] Multi-Person Human Motion Forecasting in Complex Scenes cs.CV | cs.AIPDF

Serdar Ozsoy, Lars Doorenbos, Juergen Gall

TL;DR: 本文提出了一种名为对象条件化社交扩散（OCSD）的条件扩散模型，用于复杂场景中的多人运动预测。该模型通过整合运动历史、多人交互和物体线索，能够处理变化的群体规模、复杂社交互动，并支持采样多个合理的未来轨迹。在HiK和HOI-M3基准测试中，OCSD实现了最先进的性能，显著降低了路径误差并生成了更真实的长期预测。

Details

Motivation: 在复杂场景中准确预测人的运动需要推理整个环境的过去和当前状态，但如何有效整合物体信息和社交交互到一个统一框架中仍具挑战性。

Result: 在Humans in Kitchens（HiK）和HOI-M3基准测试上，OCSD达到了最先进水平：与先前工作相比，在HiK上将两秒路径误差降低了121.5毫米（31.3%），在HOI-M3上降低了130.5毫米（33.2%），并生成了更真实的长期预测。

Insight: 创新点包括：提出对象条件化机制，在扩散过程的每个时间步调节去噪以实现细粒度的人-物推理；以及社交编码器建模场景中所有人之间的交互。这为复杂动态环境中的运动预测提供了统一的、可扩展的解决方案。

Abstract: Accurately forecasting the movement of people in complex scenes requires reasoning over the past and present state of the entire environment. In this context, effectively incorporating object information and social interactions into a unified framework remains particularly challenging. To address this, we propose Object-Conditioned Social Diffusion (OCSD), a conditional diffusion model that integrates motion history, multi-person interactions, and object cues into a single framework. OCSD uses an object-conditioning mechanism that modulates denoising at every timestep, enabling fine-grained human-object reasoning, and a social encoder that models the interactions between all humans in the scene. As a result, our model naturally handles varying group sizes, complex social interactions, and supports sampling multiple plausible futures. Extensive experiments show that OCSD achieves state-of-the-art results on the Humans in Kitchens (HiK) and HOI-M3 benchmarks. It reduces the two-second path error by 121.5 mm (31.3%) on HiK and 130.5 mm (33.2%) on HOI-M3 compared to prior work, and produces more realistic long-term forecasts.

Yuzhe Zhao

TL;DR: 本文提出AnatoProto框架，用于在胎儿超声盲扫序列中检测腹部标准平面。该框架通过解剖加权空间池化、病例内原型监督、三级级联精炼和混合预测头等组件，对冻结的BiomedCLIP编码器进行轻量级适配，有效处理高度不平衡的帧分类问题。

Details

Motivation: 解决低成本产科超声盲扫中胎儿腹部标准平面检测的极端类别不平衡问题，其中阳性帧占比不足3%，且现有超声或视觉基础模型难以有效处理此类序列数据。

Result: 在ACOUSLIC-AI基准测试中，AnatoProto达到67.72的F1分数，比最强基础模型基线（FetalCLIP + PRS）提升13.20 F1，比最强视频时序动作检测基线（TriDet + PRS）提升15.76 F1，实现了SOTA性能。

Insight: 创新点包括：利用nnU-Net解剖区域概率作为空间先验的加权池化机制；利用病例级结构的病例内原型损失；从帧到段再到病例的三级级联精炼策略；以及联合建模帧内稳定性和帧间边界过渡的混合预测头。特别值得注意的是，解剖加权池化与原型损失存在协同效应，而非简单叠加。

Abstract: Detecting the fetal abdominal circumference standard plane in low-cost obstetric blind sweeps is a highly imbalanced frame-classification problem: positive frames account for under 3% of a sequence, form short contiguous segments, and are poorly handled by off-the-shelf ultrasound and vision foundation models. We propose AnatoProto, a lightweight sequence-level framework that adapts a frozen BiomedCLIP encoder to fetal blind sweeps through four components: (i) anatomy-weighted spatial pooling that uses nnU-Net abdominal-region probabilities as a spatial prior to reweight BiomedCLIP patch tokens, so frozen semantic features are aggregated onto anatomically meaningful regions; (ii) a within-case prototype loss that pulls each frame embedding toward the mean of positive frames of the same sweep, exploiting case-level structure unavailable at the frame level; (iii) a three-stage cascade refinement (frame->segment->case-level rejecter) that lifts the prediction unit from noisy frames to structurally-constrained segments; and (iv) a hybrid prediction head that jointly models per-frame stability and inter-frame boundary transitions to suppress boundary false positives. On the ACOUSLIC-AI benchmark, AnatoProto reaches a test F1 of 67.72, outperforming the strongest foundation-model baseline (FetalCLIP + PRS, F1 = 54.52) by +13.20 F1 and the strongest video temporal-action-detection baseline (TriDet + PRS) by +15.76 F1. A synergy study, backed by embedding geometry and paired-bootstrap confidence intervals, shows that the prototype loss and anatomy-weighted pooling are not additive: applied alone the prototype loss reduces recall by 12 points, but combined with anatomy-weighted pooling it increases recall by 6.5 points – a sign-flip we trace to the accuracy of the within-case prototype.

[97] Video-OPSD: Exploiting Privileged Visual Evidence for On-Policy Self-Distillation in Video Large Language Models cs.CVPDF

Ziyue Wang, Shiqi Huang, Weiwen Xu, Bihan Wen, Xudong Jiang

TL;DR: 本文提出了Video-OPSD，一种用于视频大语言模型（Video-LLMs）的策略内自蒸馏（OPSD）框架。该方法的核心创新在于利用视频本身存在的特权监督信号——即仅基于标注的证据帧来构建特权自教师模型，并为学生模型提供更聚焦的知识蒸馏，从而提升模型在视频理解和推理任务上的性能与训练效率。

Details

Motivation: 现有OPSD方法在视频大语言模型中探索不足，通常通过为教师模型增加额外上下文信息来构建特权监督，但未充分利用视频输入本身的特点。视频中存在大量时间冗余，通常只有少量关键帧对回答问题至关重要，这为在原始输入内部构建特权监督提供了独特机会。

Result: 在多个视频理解和推理基准测试上的实验表明，Video-OPSD在不同骨干模型上均能持续改进标准OPSD的性能，并且达到了与GRPO相当的性能水平，同时所需的训练时间显著减少。

Insight: 主要创新点包括：1）基于证据帧的自我教师构建，让教师模型仅基于标注的关键证据帧进行推理，而学生模型处理完整视频，从而提供更具信息量的监督；2）证据引导的令牌优化，根据每个推理令牌对特权视觉证据的依赖程度自适应地加权令牌级蒸馏，强调基于感知的推理。这为Video-LLMs提供了一种有效且高效的后训练方法。

Abstract: On-policy self-distillation (OPSD) has recently emerged as an effective post-training paradigm that improves policy optimization through dense token-level supervision from a privileged self-teacher. Despite its promise, OPSD remains largely underexplored for Video Large Language Models (Video-LLMs). Existing methods typically construct privileged teachers by augmenting their context with additional information while keeping the primary input unchanged for both teacher and student. Video reasoning, however, offers a distinct source of privileged supervision within the primary input itself: long videos contain substantial temporal redundancy, and only a small subset of frames provides the evidence necessary to answer a question. Building on this observation, we present $\textbf{Video-OPSD}$, an OPSD framework that exploits privileged visual evidence for both self-teacher construction and knowledge transfer. First, our Evidence-Grounded Self-Teacher conditions the teacher exclusively on annotated evidence frames while the student continues to reason over the complete video. This focused visual input enables the teacher to provide more informative supervision. Second, our Evidence-Guided Token Optimization adaptively weights token-level distillation according to each reasoning token’s reliance on privileged visual evidence, thereby emphasizing perceptually grounded reasoning. Experiments across video understanding and reasoning benchmarks show that $\textbf{Video-OPSD}$ consistently improves upon Standard OPSD across multiple backbones and achieves performance comparable to GRPO while requiring substantially less training time, establishing an effective and efficient post-training approach for Video-LLMs.

[98] SpatialCrafter: Single Image World Modeling with Generative 3D Proxies cs.CV | cs.ROPDF

Chuan Fang, Lingteng Qiu, Yixun Liang, Rui Chen, Kunming Luo

TL;DR: SpatialCrafter是一个新颖的两阶段框架，用于从单张图像生成可探索的3D场景。它通过引入全局3D代理来解决现有方法（如视频扩散模型）的随机幻觉、长期漂移和3D一致性问题。该框架将生成过程分解为全局代理生成和外观细化两个阶段，并提出了新的训练策略和数据集。

Details

Motivation: 现有基于视频扩散模型的可探索图像到场景生成方法依赖于不完整的条件信号（如稀疏点云或2D全景图），导致随机幻觉、长期漂移和次优的3D一致性。本文旨在解决这些问题，实现高保真的图像到场景生成。

Result: 在合成和真实世界数据集上的大量实验表明，SpatialCrafter优于最先进的方法，减轻了长期漂移，并且在快速相机运动和极端视角变化下保持鲁棒性和一致性。

Insight: 创新点在于将生成过程分解为全局3D代理生成和外观细化，并提出了点锚定稀疏结构流模块、生成式延迟细化器、并行几何注入和代理感知损坏训练策略。此外，构建了一个用于此任务的新的大规模混合数据集。

Abstract: Explorable image-to-scene generation is essential for applications in gaming, robotics, and virtual reality. Existing methods based on video diffusion model (VDM) commonly rely on incomplete conditioning signals such as sparse point clouds or 2D panoramas, leading to stochastic hallucinations, long-term drifts and suboptimal 3D consistency. We present SpatialCrafter, a novel two-stage framework that addresses these issues by introducing a global 3D proxy for high-fidelity image-to-scene generation. Specifically, we decompose the generation process into global proxy generation and appearance refinement. For proxy generation, we propose a Point-anchored Sparse Structure~(PaSS) Flow module that predicts a spatially aligned and geometrically consistent 3D proxy. For appearance refinement, we re-frame the VDM as a Generative Deferred Refiner which synthesizes high-frequency photorealistic details upon proxy-defined scene geometry. To better integrate the proxy with the pre-trained VDM, we introduce Parallel Geometry Injection and Proxy-Aware Corruption training strategies, which improve robustness to proxy artifacts without disrupting the pretrained generative manifold. Furthermore, as no suitable dataset exists for this explorable scene generation task, we construct a new large-scale dataset of 115K scenes. To the best of our knowledge, it is the first hybrid dataset for image-to-scene generation. Extensive experiments on both synthetic and real-world datasets show that SpatialCrafter outperforms state-of-the-art methods, mitigates long-term drift, and remains robust and consistent under rapid camera motion and extreme viewpoint changes. Code, models, and the newly constructed dataset will be publicly released. See more at https://fangchuan.github.io/SpatialCrafter/.

[99] Beyond Classification: Task-Dependent Learnability under Privacy-Motivated Image Transformations cs.CV | cs.AI | cs.LGPDF

Leon Ranke, Wolfgang Hübner, Ronny Hug, Michael Arens, Jürgen Beyerer

TL;DR: 本文提出了一种超越分类任务的、计算感知的多任务评估协议，用于评估隐私增强技术（PETs）在计算机视觉中的效果。研究发现，仅依赖图像分类任务来评估PETs在保护隐私与任务性能之间的权衡过于简化，因为具有相似分类准确率的PETs在其他视觉任务上可能表现迥异。

Details

Motivation: 动机在于解决当前评估隐私增强技术时过度依赖图像分类任务的问题，因为分类任务对几何、空间布局或局部边界等视觉结构变化具有鲁棒性，无法全面反映PETs对通用视觉任务的影响，而穷举下游任务评估又计算成本高昂。

Result: 通过在一系列不可逆隐私变换、基于密钥的块基元以及可学习图像加密方案上的实验，结果表明，具有相似分类准确率的PETs在其他视觉任务上存在显著差异。

Insight: 创新点在于提出了一个结合了针对视觉结构互补方面的轻量级代理任务的多任务评估协议，该协议计算简单快速。核心见解是PETs的评估需要超越仅报告分类性能的协议，以更全面地衡量其在实际应用中的影响。

Abstract: Privacy-Enhancing Technologies (PETs) in computer vision often rely on noise or image perturbations to protect visual data while securely processing it, creating a trade-off between task performance and protection. This trade-off is commonly evaluated using image classification, which primarily captures semantic separability and remains robust despite significant geometric, spatial layout or local boundary alterations. As a result, it is too simplistic as a proxy for generic vision tasks. Exhaustive downstream-task evaluation, however, is computationally expensive because models must often be trained for each PET transformation and parameter setting. We therefore propose a compute-aware multi-task protocol for evaluating PETs in model training. It combines lightweight proxy tasks that target complementary aspects of visual structure while remaining simple and fast to compute. Across irreversible privacy transformations, key-based block primitives, and learnable image encryption schemes, we demonstrate that PETs with similar classification accuracy can differ substantially on other tasks. The outcomes highlight the need for PET evaluation protocols that move beyond classification-only reporting.

[100] Automated 2D and 3D Segmentation of AMD and DME Lesions in OCT cs.CVPDF

Lucia Sundberg, Zhihao Zhao, M. Ali Nasseri

TL;DR: 该论文开发了用于年龄相关性黄斑变性（AMD）和糖尿病性黄斑水肿（DME）的自动化2D和3D OCT病变分割流程，并通过系统消融实验优化模型。研究不仅评估了模型在域内验证集上的性能，还利用代理指标框架在外部临床队列OLIVES上测试了其泛化能力。

Details

Motivation: 解决现有OCT深度学习分割工作大多仅在域内验证，而对其在不同采集协议下的临床数据泛化能力测试不足的问题，旨在推动自动化病变负担追踪成为临床工具。

Result: 在域内验证集上，四个分割流程的Dice分数达到0.76至0.82，体积和表面校准指标（r_vol, r_surf）均≥0.97。在外部临床队列OLIVES上，预测结果与临床生物标志物（如生物标志物AUROC、中央子区厚度CST相关性）具有关联性，但关联强度弱于域内结果。

Insight: 提出了一个包含全体积、校准感知的模型采纳标准，能发现普通切片级评估会遗漏的机制；确定了集成组合是性能提升的最一致驱动因素；并构建了一个基于代理指标的框架来评估无病变级真实标签的外部临床数据上的模型泛化能力。

Abstract: Age-related macular degeneration (AMD) and diabetic macular edema (DME) are leading causes of vision loss, and optical coherence tomography (OCT) is the standard modality for detecting and monitoring the subtle lesions that drive treatment decisions. Most deep-learning segmentation work for OCT is validated only in-domain, leaving generalization to clinical data collected under different acquisition protocols largely untested. This work develops and systematically ablates four lesion-segmentation pipelines – 2D and 3D variants for AMD and DME – reaching Dice scores of 0.76 to 0.82 with strong volumetric and surface calibration (r vol, r surf greater than or equal to 0.97 across all four pipelines) on an in-domain validation set. The ablation process establishes a full-volume, calibration-aware adoption standard that catches mechanisms an ordinary slice-level evaluation would keep, and identifies ensemble composition as the most consistent driver of improvement. To test generalization, the models are evaluated on OLIVES, an external clinical cohort with no lesion-level ground truth, using a proxy-metric framework built around biomarker AUROC, central subfield thickness (CST) correlation, and longitudinal concordance. Predictions track clinical biomarkers outside the training distribution, though less strongly than in-domain – evidence for, not validation of, automated lesion-burden tracking as a clinical tool.

[101] EditaLive! Unified Character Video Editing for Live Streaming cs.CVPDF

Zhiyuan Li, Chi-Man Pun, Peng-Tao Jiang, Bo Li, Xiaodong Cun

TL;DR: 本文提出了EditaLive框架，用于实时直播中的人物视频编辑。该框架基于预训练的图像动画模型Wan-Animate，通过参考帧编辑和视频重建，将其改造为基于指令的人物中心视频编辑基础模型，并采用对齐自展开蒸馏策略将模型压缩为两步采样器，实现低延迟实时推理。

Details

Motivation: 传统视频编辑主要关注场景级内容，而直播更强调人物主体。现有视频编辑方法应用于以人物为中心的直播时，会引入面部表情不一致问题，且依赖多个离线推理步骤，无法满足实时交互需求。

Result: 大量实验表明，EditaLive在编辑性能上达到了最先进水平（SOTA），能够忠实保留面部表情，并实现低延迟的实时流式推理。

Insight: 创新点在于将预训练图像动画模型重新用于基于指令的人物视频编辑，并通过对齐自展开蒸馏策略将模型从离线双向生成适应为因果流式生成，设计了固定RoPE、对齐强制和首帧保留稀疏注意力等机制以减少训练-推理差异和外观漂移。

Abstract: Conventional video editing primarily focuses on scene-level content, whereas live streaming places greater emphasis on the human subject. However, directly applying existing video-editing methods to human-centric live streaming remains challenging, as they may introduce facial-expression inconsistencies and typically depend on multiple offline inference steps, making them unsuitable for real-time interaction. We propose EditaLive, a novel framework for real-time streaming character video editing. In detail, we start from a pretrained image animation model (Wan-Animate), which naturally decouples appearance from motion, and repurpose it as the base model for instruction-based human-centric video editing by reference frame editing and video reconstruction via the collected CharEdit-50K dataset. Besides, we adapt the model from offline bidirectional to causal streaming generation, and design an aligned self-rollout distillation strategy that compresses the model into a two-step sampler, where fixed RoPE and align forcing reduce training–inference discrepancies, and first-frame preserved sparse attention filters redundant historical information to mitigate appearance drift. Extensive experiments demonstrate that EditaLive delivers state-of-the-art editing performance with faithful preservation of facial expressions and low-latency real-time streaming inference.

[102] ReViCo: Unveiling the Limitations of VLMs in Visual Text Understanding via Error Correction cs.CVPDF

Bojun Zhang, Junhong Liang, Feifei Zhai, Fengxian Ji, Yu Zhou

TL;DR: 本文提出了ReViCo基准测试，专注于评估视觉语言模型在图像文本理解与纠错任务上的能力。该基准通过要求模型识别并修正真实图像中的文本错误，揭示了当前VLMs在视觉文本感知和上下文理解方面的显著不足。

Details

Motivation: 尽管视觉语言模型在通用视觉任务上表现优异，但在深度理解图像内文本方面仍存在局限，ReViCo旨在通过视觉文本纠错这一新任务来系统评估并暴露这些弱点。

Result: 实验表明，即使最优的VLMs与人类表现之间仍存在巨大差距，多数模型难以准确感知视觉文本，导致频繁的纠错错误；该基准为开发更鲁棒的文本感知VLMs提供了新的评估基础。

Insight: 创新点在于设计了视觉文本纠错这一新颖评估任务，强调文本与视觉上下文的交互理解；客观分析认为，该工作系统揭示了VLMs在细粒度文本感知上的核心瓶颈，为模型改进指明了方向。

Abstract: Vision Language Models (VLMs) have shown great success in general visual tasks, yet they still struggle to deeply understand text within images. In this paper, we introduce ReViCo (Real Visual Correction), a benchmark designed to evaluate VLM text understanding through a novel task of visual text error correction. ReViCo challenges models to identify and fix text errors in real-world images, which requires a profound understanding of the interplay between visual text and its surrounding visual context. We benchmark various VLMs using two distinct paradigms: prompt-based strategy and targeted model training, both aimed at pushing the limits of current models. Our experiments reveal a striking performance gap between even the best VLMs and human, and further analysis also shows that most models struggle to accurately perceive the visual text, resulting in frequent correction errors. By highlighting these gaps, ReViCo provides a new benchmark foundation for developing more robust and text-aware VLMs.

[103] Magpie: Real-Time World Renderer for Interactive Games cs.CVPDF

Xiaoyu Zhan, Xinyu Wang, Xiaohong Zhang, Huanjie Zhu, Tengjiao Sun

TL;DR: Magpie是一个实时生成式世界渲染系统，用于交互式游戏。它将游戏玩法执行与视觉生成分离：游戏引擎处理玩家动作并维护世界状态，而独立的渲染服务器根据引擎生成的白盒帧来生成视觉输出。该系统为生成模型在实时游戏渲染中的应用提供了系统级实现路径，减少了早期游戏原型对完整视觉资产的依赖。

Details

Motivation: 现代游戏开发严重依赖传统图形管线，高质量视觉内容需要建模、材质制作、动画、光照、特效和运行时优化，导致资产制作成本高昂，并延长了游戏原型的开发周期。游戏不仅需要连续逼真的图像，还需要稳定、可复现的游戏玩法规则、对象状态和交互结果。

Result: 摘要中未提及具体的定量实验结果或基准测试，但宣称Magpie为生成模型应用于实时游戏渲染提供了系统级实现路径，并减少了早期游戏原型对完整视觉资产的依赖。

Insight: 创新点在于将游戏玩法执行与视觉生成解耦，通过独立的渲染服务器处理白盒帧，从而在保持游戏设计可控性和可复现性的同时，利用生成模型加速视觉内容创作。这为生成式AI在实时交互式媒体中的应用提供了新的系统架构思路。

Abstract: Modern game development relies heavily on conventional graphics pipelines. High-quality visual content requires modeling, material authoring, animation, lighting, effects, and runtime optimization, making asset production expensive and extending the development cycle of game prototypes. Recently, video foundation models are beginning to change film and video production, but games differ from linear media, they require not only continuous and realistic imagery, but also stable and reproducible gameplay rules, object states, and interaction outcomes. We present Magpie, a real-time generative world-rendering system for interactive games. Magpie separates gameplay execution from visual generation. Designers define scenes and rules in a game engine. At runtime, the Game Engine resolves player actions and maintains world state, while an independent Render Server generates visual output from white-box frames produced by the engine. Magpie provides a system-level implementation path for applying generative models to real-time game rendering. It preserves gameplay designability and reproducibility, and reduces the dependence of early game prototypes on complete visual assets.

[104] Ancient-Bench: A Comprehensive Multi-millennial, Multi-medium, and Multi-script Benchmark for Ancient Chinese Artifact Text Recognition cs.CVPDF

Hiuyi Cheng, Nuo Xu, Yuyi Zhang, Xuhan Zheng, Wei Pan

TL;DR: 本文提出了Ancient-Bench，一个用于中国古代器物文字识别的综合性基准数据集，包含2700张图像，覆盖了3000年的文字演变、九种器物类别和七种历史书体。作者定义了三种针对古代文本介质特性的标注标准，并在该基准上对通用视觉语言模型和专用OCR模型进行了广泛实验，揭示了该任务仍面临变体字、特殊符号和幻觉等根本性挑战。

Details

Motivation: 现有古代文本识别基准存在‘碎片化’问题，表现为时间覆盖有限、介质多样性不足和书体类型不完整，因此需要构建一个更全面的基准来评估模型能力。

Result: 在Ancient-Bench上的广泛实验表明，无论是通用视觉语言模型还是专用OCR模型，对中国古代器物文字的识别问题都尚未解决，准确率远未达到实用水平。

Insight: 创新点在于构建了一个多维度（多千年、多介质、多书体）的综合性基准，并针对古代文本的介质特性定义了三种标准化标注规范（符号、字符、解析），为异构介质上的公平评估提供了基础。

Abstract: Ancient Chinese artifact text recognition is fundamental to heritage digitization, and benchmarks for ancient texts are essential for evaluating current model capabilities. However, existing benchmarks suffer from ‘’fragmentation’’, manifested in limited temporal coverage, limited medium diversity, and incomplete script types. Therefore, we present Ancient-Bench, a comprehensive benchmark of 2,700 images for ancient Chinese artifact text recognition, featuring three dimensions: Multi-millennial (spanning 3,000 years of character evolution), Multi-medium (covering nine artifact categories), and Multi-script (encompassing seven historical script forms). To enable consistent and fair evaluation across heterogeneous media, we further define three annotation standards tailored to the medium-specific characteristics of ancient texts: symbol standardization, character standardization, and parsing standardization. Extensive experiments on Ancient-Bench covering general Vision-Language Models (VLMs) and OCR-specialist models reveal that ancient Chinese artifact text recognition remains fundamentally unsolved, with persistent challenges in variant characters, specialized symbols, and hallucination. The dataset is available at https://github.com/SCUT-DLVCLab/Ancient_Bench.

[105] Temporal Sensitivity Analysis of Tessera Embeddings cs.CVPDF

Julia Guerrero-Viu, Alex López-Cifuentes, Ignacio Pérez-Villar, Fabio Pacifici

TL;DR: 本文对领先的遥感基础模型Tessera的嵌入表示进行了时间敏感性分析，研究了不同观测窗口（从一年到一天）下嵌入的质量变化。通过在线性探测器和UNet分割头上进行基准测试，发现嵌入的价值具有任务依赖性，在依赖物候学的任务（如作物分类）上表现优异，而在时间稳定的类别上则与从头训练模型相当。研究表明，时间覆盖范围是一个可调参数，而非固定前提，为近实时制图等应用开辟了新可能。

Details

Motivation: 许多地球观测应用需要既精确又频繁更新的土地利用/土地覆盖图，但最强的地球观测基础模型（如Tessera）的嵌入是基于一整年的观测数据构建的。这限制了其在需要快速更新或近实时应用中的潜力。本文旨在通过控制实验，系统分析Tessera嵌入对观测时间窗口长度的敏感性，以探索在缩短时间窗口下模型性能的变化规律。

Result: 在PASTIS-R（作物类型）、DynamicEarthNet和LUCAS数据集上进行了基准测试。对于依赖物候变化的PASTIS-R作物分类任务，基于全年嵌入的模型达到了58.3的平均交并比（mIoU），比最佳从头训练模型高出约46%。对于时间稳定的类别（如森林），在完全监督下，基于嵌入的模型与从头训练模型性能相当，但嵌入模型始终表现出更高的标签效率。将观测窗口从一年缩短到一个月，PASTIS-R上的分割精度下降39%，而DynamicEarthNet上仅下降5%。即使是单日嵌入，在LUCAS上的土地覆盖分类准确率仍是随机水平的3.4倍。

Insight: 论文的核心创新点在于对基础模型嵌入的时间敏感性进行了首次系统性量化研究，揭示了其性能衰减与任务类型（是否依赖时序动态）和观测窗口长度之间的复杂关系。从客观角度看，这项研究的重要见解是：将“全年观测”从模型使用的固定前提重新定义为“可调的成本/性能权衡参数”，这为在保持一定性能的前提下，实现更快的更新周期（如月度、近实时）的土地利用制图提供了理论依据和实用指导，拓宽了基础模型的应用范围。

Abstract: Many Earth Observation applications need land-use/land-cover maps that are both precise and frequently updated, yet the strongest Earth Observation foundation models build their embeddings from a full year of observations. We present a controlled study of the temporal sensitivity of Tessera, one of these leading foundation models, for land-use/land-cover mapping. Keeping the encoder frozen, we recompute its embeddings over varying observation windows, from a full year down to a single day. We use them as inputs to a linear probe and a UNet segmentation head, benchmarking both of them against from-scratch networks on LUCAS, DynamicEarthNet, and PASTIS-R datasets. We show that the value of the embeddings is task-dependent. Where classes are separated by phenology, as for the crop types of PASTIS-R, they reach a mean Intersection-over-Union of $58.3$, about $46%$ above the best from-scratch model. Where classes are temporally stable (e.g., forests in DynamicEarthNet and LUCAS), embedding-based and from-scratch models match only under full supervision. On both datasets, Tessera embeddings remain markedly more label-efficient. Degradation under shorter temporal windows is gradual and class-dependent. Contracting the window from one year to one month costs $39%$ of the segmentation accuracy on PASTIS-R but only $5%$ on DynamicEarthNet. Single-day embeddings still classify land cover in LUCAS at $3.4$ times the chance level. Our study shows that temporal coverage is therefore a tunable cost rather than a fixed prerequisite, opening regimes such as near-real-time mapping and faster land-use/land-cover refresh cycles.

[106] Vision-centric generative AI models: A software-hardware perspective cs.CV | cs.ARPDF

Eleni Tselepi, Cristian Sestito, Shady Agwa, Themis Prodromakis

TL;DR: 本文从软硬件协同设计的视角探讨了视觉生成式AI模型的发展现状与挑战。论文指出当前视觉生成模型主要关注输出质量提升，导致模型规模急剧膨胀，而硬件被动适配这种增长模式。作者通过量化不同加速器平台上的参数成本和能效，将四类生成模型家族映射到七个实际应用领域，最终倡导在模型设计初期就考虑部署约束的软硬件协同设计方法。

Details

Motivation: 当前视觉生成AI的发展主要由输出质量驱动，模型主要在大型数据中心运行，但许多边缘应用（如自动驾驶汽车、农业传感器和移动设备）同样需要生成模型，却面临严格的硬件约束。

Result: 论文量化了不同加速器平台上生成模型的参数成本和能效，并将扩散模型、自回归模型、生成对抗网络和变分自编码器这四类模型家族，映射到内容创作、自动驾驶、机器人等七个实际应用领域，以评估其适用性。

Insight: 创新点在于提出了‘软硬件协同设计’的范式转变，主张从设计之初就考虑部署约束，确保‘正确的模型’在‘正确的硬件’上运行以服务‘正确的应用’，从而使生成式AI的部署更具可持续性和可及性。这为资源受限的边缘设备高效部署生成模型提供了系统性思路。

Abstract: Vision generative artificial intelligence (AI) has emerged as one of the most rapidly advancing areas of deep learning. The explosion of multimodal models has made them widely associated with text-to-image applications running on large datacentres. However, vision generative models are equally needed in applications that operate under strict hardware constraints at the edge, including autonomous vehicles, agricultural sensors, and mobile devices. In this Perspective, we argue that progress in vision generative AI has been driven by output quality, with hardware evolving reactively to accommodate growing model demands. We quantify the parameter cost and energy efficiency of these models across a range of accelerator platforms, and map four generative model families against seven real-world application domains. Finally, we advocate a software-hardware co-design approach, where deployment constraints are considered from the start of the design process, ensuring that the “right model” runs on the “right hardware” to serve the “right application”, making generative AI deployment sustainable and accessible across a much broader range of platforms.

[107] PACE: A Unified Condense-and-Extract Paradigm for Fast VLM Inference cs.CV | cs.AIPDF

Junjie Liu, Shengyuan Ye, Xu Chen

TL;DR: 本文提出了PACE（Pixel-Adaptive Condense and Extract），一种无需训练、用于加速视觉语言模型（VLM）推理的框架。它通过统一的“压缩-提取”范式，在编码前自适应下采样冗余像素以减少视觉编码器计算，并在编码后融合视觉与语义信号来选择性保留关键视觉令牌，从而同时加速视觉编码器和大型语言模型（LLM）。

Details

Motivation: 现有视觉令牌剪枝方法存在两个根本局限：一是大多在视觉编码器之后操作，未能优化编码阶段的高延迟；二是在严格令牌预算下，难以同时保留整体视觉上下文和细粒度细节，导致性能下降。PACE旨在解决这些瓶颈。

Result: 在Qwen2.5-VL-7B模型上集成PACE后，仅使用10%的视觉令牌即可保留原模型93.8%的性能，并将首令牌生成时间（TTFT）加速了3.1倍。

Insight: 创新点在于提出了一个统一的、训练前的推理加速范式，将优化提前到像素级（Condense阶段），并结合了来自编码器和LLM的双重信号进行令牌选择（Extract阶段），从而在显著加速的同时更好地平衡全局上下文与关键细节的保留。

Abstract: Vision-Language Models (VLMs) demonstrate exceptional visual reasoning capabilities, yet their inference costs escalate rapidly with the proliferation of visual tokens. Existing visual token pruning methods exhibit two fundamental limitations. First, most approaches operate exclusively post-vision encoder, leaving the substantial latency of the visual encoding phase unoptimized. Second, under strict token budgets, these methods often fail to jointly preserve holistic visual contexts and fine-grained details, leading to performance degradation. To address these bottlenecks, we propose PACE (Pixel-Adaptive Condense and Extract), a training-free inference framework that accelerates both the vision encoder and the Large Language Model (LLM) via a unified Condense-and-Extract paradigm. During the Condense stage, an Adaptive Pixel Compressor (APC) evaluates visual information density prior to encoding, adaptively downsampling redundant inputs, curtailing encoder computation while preserving global context and essential visual cues. In the Extract stage, a Dynamic Dual-Attention Extractor (DDAE) selectively retains visual tokens via a fusion of internal visual signals from the encoder and semantic signals from the LLM, safeguarding task-critical details. By integrating PACE into Qwen2.5-VL-7B, the model retains 93.8% of its original performance while utilizing only 10% of the visual tokens, yielding a 3.1x speedup in time to first token (TTFT). Our code is available at https://github.com/jjL357/PACE.

Hao Xu, Zhaoning Shi, Hehe Jin, Bo Ma

TL;DR: 本文提出CODE框架，用于解决开放世界目标检测中由单向文本-视觉匹配引起的语义模糊问题，以及刚性离群点抑制对已知类边界附近未知物体的过度抑制问题。该框架包含三个互补组件：跨模态联合置信度校准、不确定性引导的通用物体性增强和基于置信度边界的动态离群点抑制。

Details

Motivation: 基于多模态基础模型的开放世界目标检测存在语义模糊问题，且刚性离群点惩罚可能过度抑制已知类决策边界附近的未知物体。

Result: 在Real-World Detection基准测试中，使用OWL-ViT L/14骨干网络，CODE在Task 1上取得了21.7 U-mAP和40.8 K-mAP，分别比之前的SOTA提升了2.6和2.3个点。

Insight: 创新点在于通过跨模态校准缓解语义模糊，利用不确定性增强未知物体检测，并引入动态抑制机制替代刚性惩罚，从而更精细地处理开放世界中的已知与未知物体。

Abstract: Open World Object Detection (OWOD) built on multimodal foundation models often suffers from semantic ambiguity caused by unidirectional text-to-vision matching, while rigid outlier penalties may over-suppress unknown objects near known-class decision boundaries. We propose CODE (Cross-Modal Calibration and Dynamic Suppression), a unified inference-time framework with three complementary components. Cross-Modal Joint Confidence Calibration injects global visual prototypes to calibrate text-driven known-class predictions. Uncertainty-Guided Universal Objectness Enhancement measures classification hesitation from local visual responses to strengthen potential unknown objects. Dynamic Outlier Suppression via Confidence Margin replaces rigid suppression with a margin-aware adjustment that preserves ambiguous out-of-distribution instances. Experiments on the Real-World Detection benchmark demonstrate that, with the OWL-ViT L/14 backbone, CODE achieves 21.7 U-mAP and 40.8 K-mAP in Task 1, surpassing the previous state of the art by 2.6 and 2.3 points, respectively.

[109] DINOcular: Self-Supervised Visuospatial Representations cs.CVPDF

Farkhat Almukhamedov, Sami Azirar, Hermann Blum

TL;DR: 论文提出了一种名为DINOcular的自监督框架，用于从RGB-D观测中学习联合视觉空间表示。该方法通过跨块和块内融合将深度几何先验与视觉主干网络集成，从而高效编码外观和空间结构。

Details

Motivation: 现有视觉基础模型主要基于RGB图像训练，而具身系统通常能获取深度信息，这些几何信息是单目输入无法恢复的，因此需要整合深度数据以增强3D感知能力。

Result: 该方法在多个3D几何基准测试中优于同等规模的前沿方法，并在RGB-D语义分割任务上保持竞争力，显示出3D感知能力的显著提升。

Insight: 创新点在于通过自监督方式将深度几何先验与视觉表示融合，实现了外观与空间结构的联合编码，为具身智能系统提供了更丰富的视觉空间表示。

Abstract: We introduce a self-supervised framework for learning joint visuospatial representations from RGB-D observations. While modern vision foundation models are trained almost exclusively on RGB images, many embodied systems have access to explicit depth sensing, which provides geometric information that monocular inputs cannot recover. Our method integrates depth-derived geometric priors with a visual backbone through inter-patch and intra-patch fusion, enabling the model to encode both appearance and spatial structure efficiently. The resulting representation shows promising improvements on 3D awareness while preserving semantic transfer: it outperforms prior methods of comparable scale on multiple 3D geometry benchmarks, and remains competitive when probed for standard RGB-D semantic segmentation tasks.

[110] PAWBench: How Far Are We from Probabilistically Aligned World Modeling? cs.CV | cs.AIPDF

Yuandong Pu, Le Zhuo, Sayak Paul, Gabriel Jorge Menezes, Avram Đorđević

TL;DR: 论文提出PAWBench基准和PAWEval评估协议，用于评估视频生成模型作为世界模型在概率对齐方面的表现，即模型能否生成与真实世界分布一致的行为轨迹分布。

Details

Motivation: 现有视频生成模型常被视为世界模型，但物理过程通常存在多种可能演化方式，当前评估主要关注单视频合理性，缺乏对生成分布与真实分布一致性的检验。

Result: 在50个场景和11个当前系统中，没有模型能一致地匹配参考概率分布并覆盖所有有效行为范围，揭示了现有模型与概率对齐世界建模之间的差距。

Insight: 论文创新性地将概率对齐形式化为世界模型的分布标准，并提出了通过重复视频生成构建经验分布来评估模型预测分布的方法，为未来改进模型概率对齐能力提供了基础。

Abstract: Recent video generation models are increasingly framed as world models. Many physical processes can unfold in more than one valid way. Therefore, a world model should reproduce not only a plausible trajectory, but also the distribution of possible behaviors under the same initial observation and action. We call this distribution-level requirement probabilistic alignment. However, existing evaluations largely assess individual-video plausibility and do not test whether repeated generations recover the correct distribution. This raises a central question: how far are current video generators from probabilistically aligned world modeling? To answer it, we formalize probabilistic alignment as a distributional criterion for world models and introduce PAWBench, a benchmark for evaluating video generators as stochastic samplers of world dynamics. We further introduce PAWEval, an outcome-level protocol that converts repeated video rollouts into empirical distributions over possible physical behaviors. Across 50 scenarios and eleven current systems, no model consistently matches the reference probabilities while recovering the range of valid behaviors. Having established this gap, we test whether language prompts, initial noise sampling, or model training can reshape the model’s predictive distribution. We believe our work can serve as a foundation for future efforts to move towards probabilistically aligned world modeling.

[111] R2M-Bench: Evaluating Revisit Memory via Relative Consistency in Interactive Video World Models cs.CVPDF

Qiwen Gu, Bingjie Gao, Rui Chen, Geng Li, Jifan Li

TL;DR: 该论文提出了R2M-Bench基准，用于评估交互式视频世界模型中的重访记忆能力。它通过引入相对一致性度量（如MemoryGain和Normalized Memory Ratio）来解决传统绝对重访分数对渲染稳定性、重复内容和失败动作敏感的问题，从而更准确地衡量模型对场景的记忆而非单纯的时间稳定性。

Details

Motivation: 现有评估方法中，首次访问帧和返回帧之间的高相似度不一定表明模型记住了场景，可能只是由于中间推演变化很小。这种模糊性使得绝对重访分数容易受到干扰，因此需要一种能区分重访特定一致性与通用时间稳定性的新基准。

Result: R2M-Bench包含300个实例，在七个动作条件视频世界模型上评估。总体NMR与人类一致性判断的Spearman相关系数为ρ=0.547（95% CI [0.45,0.63]），且与生成动作的相关性（0.072）显著低于原始重访相似度（0.207），表明相对校准有效减少了慢动作捷径。DreamX-World-Memo在评估模型中取得了最高的总体NMR。

Insight: 创新点在于提出了基于同一推演内相对校准的评估框架，通过比较重访对与两个控制对（间隙匹配的非重访对和短程对）来量化记忆增益，从而更鲁棒地分离重访记忆与时间稳定性。这为视频世界模型的记忆能力评估提供了更可靠的基准。

Abstract: High similarity between first-visit and return frames does not necessarily show that a video world model remembered the scene; the intervening rollout may simply have changed very little. This ambiguity makes absolute revisit scores sensitive to rendering stability, repetitive content, and failed motion. We introduce \emph{R2M-Bench} (\textbf{R}elative \textbf{R}evisit \textbf{M}emory Benchmark), a benchmark of observable revisit-selective consistency. For every detected return, R2M-Bench compares the revisit pair with two controls from the same rollout: a gap-matched non-revisit pair that measures generic temporal stability and a short-range pair that estimates short-horizon consistency. These comparisons produce \emph{MemoryGain} (MG), the revisit advantage over the temporal baseline, and the \emph{Normalized Memory Ratio} (NMR), which normalizes this advantage by the short-to-baseline dynamic range. R2M-Bench combines 100 reference scenes with three leave-and-return trajectories to form 300 instances and evaluates appearance fidelity, scene and object identity, local geometry, and persistent state. Across seven action-conditioned video world models, Overall NMR correlates with human consistency judgments at Spearman’s $ρ=0.547$ (95% CI $[0.45,0.63]$). Its within-model correlation magnitude with generated motion is $0.072$, compared with $0.207$ for raw revisit similarity, indicating that relative calibration substantially reduces the slow-motion shortcut. DreamX-World-Memo achieves the highest Overall NMR among the evaluated video models. Together, these results support same-rollout relative calibration as a practical way to distinguish revisit-specific consistency from generic temporal stability.

[112] Successive Capacity Growth: Task-Complexity-Driven Width and Depth Expansion for Vision Transformer Encoders in JEPA World Models cs.CV | cs.AIPDF

Frederik Berenz

TL;DR: 本文提出了一种名为‘连续容量增长’的方法，用于联合嵌入预测架构中的视觉Transformer编码器。该方法从一个极小的编码器开始，根据任务复杂度，通过任务无关的测试验证机制，逐步增加宽度或深度，以实现更高效的参数利用和性能提升。

Details

Motivation: 解决JEPA世界模型中固定大小的视觉Transformer编码器在简单任务上过度配置、在复杂任务上配置不足，以及注意力头之间存在显著冗余的问题。

Result: 在60维多目标动态任务上，深度扩展使预测损失比固定小基线模型降低了20.3%，且参数效率比扩展到固定大模型高56倍；在2D导航任务上，一次宽度扩展甚至比固定大模型提升了23%。在所有三个测试环境中，自适应编码器均匹配或超越了固定小基线，且没有误扩展，实现了精确的函数保持。

Insight: 创新点在于提出了一种任务驱动的、安全的架构增长机制，结合了函数保持扩展和SIGReg正则化器，使得模型容量可以按需增长，而非预先分配最大容量，从而在保持表示质量的同时显著提高了计算和数据效率。

Abstract: Joint-Embedding Predictive Architectures (JEPAs) for world modeling typically employ fixed-size Vision Transformer encoders that are over-provisioned for simple tasks and under-provisioned for complex ones, with significant redundancy across attention heads. We propose Successive Capacity Growth (SCG), a method that starts from a minimal encoder (1 head, 2 layers, 283K parameters) and grows incrementally in width (adding attention heads for low-level semantic capacity) or depth (adding transformer blocks for higher-order semantic abstraction), driven by a task-agnostic test-and-verify mechanism that exploits function-preserving expansion to safely trial architectural changes and roll back if they do not improve prediction loss. The Sketched Isotropic Gaussian Regularizer (SIGReg) ensures that all learned semantic dimensions remain statistically independent and aligned with the predictive objective, preventing collapse even as the architecture grows. On a 60-dimensional multi-object dynamics task, SCG naturally triggers depth expansion, improving prediction loss by 20.3% over the fixed small baseline with 56 times greater parameter efficiency than scaling to the fixed large model; on a 2D navigation task, a single width expansion yields even an 23% improvement over the fixed large model. Across all three tested environments of increasing complexity, the adaptive encoder matches or exceeds the fixed small baseline, with zero false-positive expansions and bit-exact function preservation (ratio = 1.0, absolute difference = 0.0). The take-away is that JEPA world model encoders need not be pre-allocated at maximum capacity - they can grow successively as the task demands, achieving significant compute and data efficiency while maintaining representation quality.

[113] LeVJEPA: Efficient & Scalable Video Pretraining without the Heuristics cs.CV | cs.AIPDF

Lukas Kuhn, Lucas Maes, Giuseppe Serra, Quentin Le Lidec, Yann LeCun

TL;DR: 本文提出了LeVJEPA，一种无需启发式方法的高效可扩展视频预训练框架。该方法通过单一编码器和投影器结构，结合SIGReg正则化防止表示崩溃，显著降低了计算成本。实验表明，LeVJEPA在减少5.6至20.8倍计算量的情况下，性能匹配或超越V-JEPA 2，并在ImageNet-1K上超越基线7.6个百分点。

Details

Motivation: 现有视频自监督学习方法存在计算成本高的问题，要么依赖架构不对称性防止表示崩溃，要么通过像素空间重建掩码内容来规避。本文旨在设计一种无需这些启发式方法的高效视频预训练方案。

Result: 在相同数据和训练轮数下，LeVJEPA在ViT-S/B/L上匹配或超越V-JEPA 2，计算量减少5.6-20.8倍；在相同总FLOPs下，ImageNet-1K上超越最强视频基线7.6分，在运动中心基准上保持竞争力。与计算匹配的DINOv2相比，在外观评估中接近图像预训练编码器，运动中心准确率提升近一倍。

Insight: 创新点在于采用LeJEPA的无崩溃目标训练视频编码器，仅需编码器和投影器，通过SIGReg正则化保证无崩溃；支持均匀随机令牌丢弃降低计算成本，且无需分支不对称性，可实现块因果注意力训练，使时序排序成为编码器固有属性。

Abstract: Video carries the temporal structure of the physical world, yet learning representations from it has remained computationally expensive: prevailing self-supervised methods either prevent representation collapse through architectural asymmetries, coupling an exponential-moving-average target encoder, a stop-gradient, and a capacity-limited predictor, or circumvent it by reconstructing masked content in pixel space. We introduce LeVJEPA, the first video encoder trained under LeJEPA’s collapse-free objective, which dispenses with both. A single encoder is trained with an invariance loss over global and local views of a clip, regularized by SIGReg, which excludes collapse with a provable guarantee. The architecture reduces to an encoder and a projector, and the objective to a single hyperparameter. This formulation admits two properties. First, the cost of pretraining is governed by the number of tokens the encoder observes; uniform random token dropping renders this number small while simultaneously improving downstream accuracy. At matched epochs on identical data, LeVJEPA matches or surpasses V-JEPA 2 across ViT-S/B/L at 5.6 to 20.8x less pretraining compute, and at matched total FLOPs it exceeds the strongest video baseline by 7.6 points on ImageNet-1K while remaining competitive on motion-centric benchmarks. Second, since no asymmetry between branches is required, the encoder can be trained with block-causal attention at no measurable accuracy cost: temporal ordering becomes a property of the encoder itself. Against a compute-matched DINOv2 trained on frames of the same videos, LeVJEPA approaches the image-pretrained encoder on appearance-centric evaluation while nearly doubling its motion-centric accuracy. These results indicate that, once its computational overhead is removed, video becomes a viable and in several respects preferable substrate for general-purpose visual pretraining.

[114] Reconstructing Humans and Objects in Interaction using Large Reconstruction Models cs.CVPDF

Agniv Chatterjee, Georgios Pavlakos

TL;DR: 本文提出了MILO框架，利用大型重建模型（LRMs）从单张图像中恢复详细的3D人-物交互。该方法将LRM生成的网格作为几何支架，通过分割网格、拟合参数化人体模型以及可选地对齐物体模板，简化了3D重建过程。

Details

Motivation: 现有3D人-物交互重建方法主要依赖重投影和接触约束，将参数化人体模型和物体模板拟合到2D图像，但面临深度模糊、遮挡和物体形状多变等挑战。本文探索了利用LRMs视觉能力的新途径。

Result: MILO在多个基准测试和交互场景中实现了强大的重建精度，并超越了现有基线方法。

Insight: 核心创新在于利用LRMs提供的几何支架来保持人-物相对排列和邻近线索，从而将复杂重建问题转化为对LRM网格的解释任务。这为3D HOI重建提供了一种更简洁、有效的范式。

Abstract: Estimation of Human-Object Interactions in 3D (3D HOI) is a fundamental problem in 3D computer vision with applications in AR/VR, robotics, and embodied AI. However, reconstructing these interactions in 3D remains challenging due to depth ambiguities, occlusions, and object shape variability. Existing approaches are primarily concerned with reprojection and contact constraints, fitting parametric human models and object templates to 2D images. In this paper, we explore a different avenue. We present MILO, a framework that leverages the visual capabilities of Large Reconstruction Models (LRMs) to recover detailed 3D human-object interactions from a single image. Our key observation is that LRMs provide a powerful geometric scaffold that preserves relative human-object arrangement and proximity cues. This significantly simplifies the reconstruction procedure, reframing the problem as interpreting the LRM mesh: we segment it into human and object components, fit a parametric body model to the human part, and optionally align an object template to the object part (if such a template is available). MILO achieves strong reconstruction accuracy and outperforms existing baselines across multiple benchmarks and interaction scenarios. Our code is available at https://ac5113.github.io/MILO.

[115] Retrieval Heads Meet Vision: Uncovering How VLMs Locate and Extract Visual Information cs.CVPDF

Chanho Park, Daehyeon Choi, Jihyun Lee, Minhyuk Sung

TL;DR: 该论文发现视觉语言模型（VLMs）中存在一种称为视觉检索头（VRHs）的特定注意力头子集，它们负责将文本描述定位到图像区域。通过改进现有的注意力头评分方法，作者在多个VLM和基准测试中识别出这些因果性头，并展示了它们的关键作用与独特属性。

Details

Motivation: 尽管视觉语言模型能够根据文本提示定位图像区域并提取视觉证据，但其内部机制尚不明确。受大型语言模型中检索头的启发，本研究旨在探究VLMs中是否存在类似的视觉检索机制。

Result: 在11个VLMs和5个指代表达式基准测试中，仅掩蔽前20个VRHs就能使定位准确率下降高达80个百分点，而掩蔽相同数量的随机头则影响甚微。这证明了VRHs在视觉定位任务中的因果性和关键作用。

Insight: 论文的创新点在于将文本检索头的概念扩展到视觉领域，提出了统一的注意力头评分设计空间，并发现了VRHs具有跨任务泛化性、功能特异性（保持输出格式但破坏定位）和架构共享性（在共享LLM骨干但视觉编码器不同的VLM间因果转移）等新特性。

Abstract: Vision-language models (VLMs) can locate an image region referred to by a text prompt and route the corresponding visual evidence to the output, yet the internal mechanism behind this behavior is not understood. Inspired by retrieval heads in large language models, we ask whether VLMs contain an analogous mechanism for visual retrieval. We answer affirmatively by introducing Visual Retrieval Heads (VRHs), a small subset of attention heads (about 1.7-2.6%) that are causally responsible for grounding text descriptions to image regions. To find them, we recast existing head-scoring methods under a unified design space over query tokens, key aggregation, and cross-sample aggregation. We then show that scoring attention from output prediction tokens with a sum over the ground-truth referent region most reliably identifies causal heads. Across eleven VLMs and five referring-expression benchmarks, masking only the top 20 VRHs reduces grounding accuracy by up to 80 percentage points, while masking the same number of random heads has little effect. Beyond replicating the causal-sparse-universal triad established for text retrieval heads, VRHs exhibit several properties not previously reported: they generalize across visual reference tasks, remaining causal on attribute, spatial, counting, and visual-math benchmarks despite being discovered through bounding-box prediction; they are functionally specific, preserving output format while corrupting localization; and they are architecturally shared, transferring causally across VLMs that share an LLM backbone but differ in vision encoder, projector, and instruction tuning.

[116] UrbanGround: From Local Perception to Spatial Agency in a Real-Scale City cs.CVPDF

Tianjie Ju, Zheng Wu, Yueqing Sun, Yuhan Cui, Bobo Li

TL;DR: 本文提出了UrbanGround，这是一个基于香港真实3D地理空间数据构建的物理约束沙盒环境，用于评估多模态大语言模型（MLLM）智能体在复杂、真实规模城市中从局部感知转向持续空间行动的能力。研究发现，当前MLLM智能体在视觉识别和短程空间推理上具备可用能力，但在长距离导航、方向感知和行人感知移动方面不可靠，局部能力难以组合成持续的目标导向行为。

Details

Motivation: 研究动机是探究当前MLLM智能体能否将局部城市感知（如解读街景）转化为在复杂、真实规模城市中可靠的动作和空间代理能力，解决智能体在开始移动后局部证据是否仍然有效的问题。

Result: 在UrbanGround沙盒环境中进行的分析表明，当代MLLM智能体在主动观察后能较好地理解局部场景以回答空间问题，但在目的地变远、变不明确时，其导航支持能力下降，且在路线可用性和行人运动变化时行为不可靠；其核心失败在于扩展探索中，局部能力无法组合成持续的目标导向行为，且错误会累积而无法有效纠正。

Insight: 论文的创新点在于构建了首个基于真实城市3D数据的物理约束沙盒UrbanGround，支持第一人称视角的闭环交互和导航，为系统评估MLLM智能体在开放复杂城市环境中的可靠探索范围提供了可测试平台；客观分析揭示了当前MLLM智能体在空间代理任务中从局部感知到持续行动的组合性瓶颈。

Abstract: Multimodal large language models (MLLMs) can interpret a street view, but urban agency depends on whether such local evidence remains useful after the agent starts to move. In this paper, we investigate how far current MLLM agents can turn local urban perception into reliable action in a complicated real-scale city. We propose UrbanGround, the first sandbox to make this question testable in a physically constrained replica of Hong Kong built from territory-wide 3D geospatial data. UrbanGround supports closed-loop interaction from a first-person view and provides an interactive map for navigation. Agents can directly enter the 3D city and explore from a first-person view. Our analysis follows the growth of the spatial problem through three research questions. We first test whether an agent can ground a local scene well enough to answer spatial questions after active observation. Then we ask whether that grounding supports navigation as destinations become farther away and less explicit. Finally, we examine whether the resulting behavior survives changes in route availability and pedestrian motion. Contemporary MLLM agents usually show useful atomic abilities in visual recognition and short-range spatial reasoning, while orientation and pedestrian-aware movement remain unreliable. Their central failure emerges over extended exploration, where local abilities do not compose into sustained goal-directed behavior and errors accumulate without effective correction. We hope UrbanGround will support broader study of how far current MLLM agents can explore reliably in complex, open-ended urban environments.

q-fin.ST [Back]

[117] Graph-Based Modeling of Financial Volatility Dynamics q-fin.ST | cs.CL | cs.LGPDF

Chuanzhen Wang, Alice Zhang, Wei Chen, Michael Brown

TL;DR: 该论文提出了一种名为金融感知图时空网络（FA-GSTN）的新架构，用于预测已实现波动率（RV）。该模型将隐含波动率（IV）曲面重构为时空图序列，通过融入金融领域知识（如期权希腊值）和处理高频噪声的模块，来捕捉其动态演化。

Details

Motivation: 现有方法将隐含波动率曲面视为静态图像，无法捕捉其固有的动态特性，这限制了波动率预测的准确性。论文旨在克服这一局限，通过建模结构化金融对象的演化来改进预测。

Result: 在大规模股票期权数据集上的综合评估表明，FA-GSTN达到了新的最先进水平（SOTA），预测精度最高（R²达0.473）。该模型还表现出卓越的数据效率，在仅使用一年数据训练时，其性能（R²: 0.372）显著优于强大的视觉Transformer基线（R²: 0.315），并在市场压力时期（如2020-2021年）展现出更强的鲁棒性。

Insight: 论文的核心创新在于将波动率预测问题重新定义为对时空图序列的建模，并明确地融入了金融领域的归纳偏置（如金融感知节点特征）和噪声处理机制（多尺度时间平滑门和自适应鲁棒损失函数）。这强调了显式建模时间动态和注入领域知识对于提升预测准确性和鲁棒性的重要性。

Abstract: Accurate forecasting of realized volatility ($RV$) is crucial for risk management and derivatives pricing. Although the implied volatility ($IV$) surface offers rich informational content, prevailing methods that treat it as a static image fail to capture its inherent dynamics. To overcome this limitation, we propose the Finance-Aware Graph Spatio-Temporal Network (FA-GSTN), a novel architecture that reframes $RV$ forecasting as modeling the evolution of a structured financial object. FA-GSTN builds a spatio-temporal graph sequence from the $IV$ surface, where nodes correspond to grid points and edges encode adaptive spatial (intra-day) and explicit temporal (inter-day) dependencies. The model incorporates domain knowledge through finance-aware node features (e.g., option Greeks) and tackles high-frequency noise via a multi-scale temporal smoothing gate coupled with an adaptive robust loss function. Comprehensive evaluations on a large-scale equity options dataset show that FA-GSTN sets a new state of the art, delivering superior predictive accuracy ($R^2$ up to 0.473). It also demonstrates remarkable data efficiency, substantially outperforming strong Vision Transformer baselines when trained on only one year of data ($R^2$: 0.372 vs. 0.315). Furthermore, the model exhibits enhanced robustness during periods of market stress, such as 2020–2021. Ablation studies confirm the vital roles of the spatio-temporal graph structure, finance-aware components, and integrated noise-handling modules. Our work underscores the substantial benefits of explicitly modeling temporal dynamics and infusing financial inductive biases for accurate and robust volatility forecasting.

cond-mat.mtrl-sci [Back]

[118] Data-efficient crack quantification in lithium-ion cathodes using foundation model transfer cond-mat.mtrl-sci | cs.CV | cs.LGPDF

Thorsten Tegetmeyer-Kleine, Thomas Schmitt, Phillip Aquino, Christiane Rahe, Dirk Uwe Sauer

TL;DR: 该论文提出了一种数据高效的锂离子电池正极裂纹量化方法，通过结合冻结的自监督视觉Transformer编码器、轻量级可训练解码器和迭代模型辅助标注，将稀疏标注转化为大规模电池老化测量。该方法应用于三个120兆像素的NMC正极截面图像，能够区分颗粒内裂纹和不同阶段的颗粒间裂纹，并量化裂纹宽度、曲折度和面积分数等分布。

Details

Motivation: 电池寿命是可持续电气化的核心，但驱动锂离子正极老化的颗粒裂纹难以测量，定量显微分析因标注瓶颈而受限，因为每个破坏性电子显微镜截面图像达数百兆像素，像素级专家标注每张图需数小时。

Result: 该方法在三个代表初始、循环老化和日历老化状态的120兆像素NMC正极截面上，成功量化了裂纹特征：循环老化样本中晚期颗粒间裂纹覆盖率达到4.6%，而初始和日历老化样本仅为0.5%，且形成更曲折、覆盖更高的网络，与电化学循环而非单纯高温存储导致的老化一致。

Insight: 创新点在于利用冻结的自监督基础模型编码器进行特征提取，结合轻量解码器实现数据高效迁移学习，并通过迭代模型辅助标注解决高分辨率图像标注瓶颈，为电池老化评估提供了从单张破坏性图像获取群体统计数据的可行方案。

Abstract: Battery lifetime is central to sustainable electrification, yet the particle cracking that drives lithium-ion cathode aging is hard to measure: quantitative microscopy of this degradation is bottlenecked by annotation, because each destructive electron-microscopy cross-section spans hundreds of megapixels and pixel-level expert labelling requires hours per image. We show that a frozen self-supervised vision-transformer encoder, combined with a lightweight trainable decoder and iterative model-assisted annotation, turns this sparse labelling budget into population-scale degradation measurements. Applied to three 120-megapixel NMC cathode cross-sections representing initial, cycled-aged and calendar-aged states, the framework distinguishes intragranular cracks from early- and late-stage intergranular cracks and yields per-particle distributions of crack width, tortuosity and area fraction. Late intergranular crack coverage reaches 4.6% in the cycled sample versus 0.5% in the initial and calendar-aged samples, forming more tortuous, higher-coverage networks, consistent with degradation from repeated electrochemical cycling rather than elevated-temperature storage alone. A single destructive image yields the population-level statistics needed for lifetime-extending design, aging assessment and second-life decisions.

cs.MM [Back]

[119] How AI Experiences Art: Emergent Aesthetic Structure in a Self-Supervised Multimodal Embedding Space cs.MM | cs.CV | cs.LGPDF

Corey D. C. Heath

TL;DR: 本文提出了一种自监督多模态嵌入框架，将文本、音频、图像和视频四种模态映射到共享的256维嵌入空间，并通过迭代聚类来发现AI模型对艺术媒体形成的、无需显式标签的美学结构。

Details

Motivation: 探索AI模型在没有显式标签或跨模态监督的情况下，如何对人类创作的艺术媒体形成自身的美学分类，以理解其跨模态相似性结构。

Result: 在弱监督多模态数据集上，分析了AI生成的聚类分配与人类情感标注标签之间的差异，展示了AI自主发现的美学结构与人类认知的异同。

Insight: 创新点在于通过自监督学习和迭代聚类，让AI自主发现跨模态的美学结构，这为理解AI的认知模式、组织异构媒体库以支持检索增强生成（RAG）以及自动化数据标注提供了新思路。

Abstract: Aesthetics are an important part of the symbolism of artistic works. Although subjective, humans categorize art based on the emotion evoked regardless of modality. What remains under-explored is how AI models form their own aesthetic categorization of human-produced media without explicit labels or cross-modal supervision. We present a self-supervised framework that projects four modalities (text, audio, image and video) into a shared 256-dimensional embedding space and applies iterative clustering to discover aesthetic structure. We discuss the divergence between AI-generated cluster assignments and human affective register labels on a weakly supervised multimodal dataset. This work has applications in understanding how AI structures cross-modal similarity, organizing heterogeneous media collections for Retrieval-Augmented Generation (RAG), and automated data labeling.

cs.SE [Back]

[120] The Thousand-Graph Hypothesis: A Testable Hypothesis of Task-Conditioned Relation Materialization in Repository-Level Code Reasoning cs.SE | cs.CLPDF

Fei Ding

TL;DR: 本文提出了一种名为’千图假设’的可测试假设，用于解决大型代码仓库推理中模型上下文限制的问题。该方法采用仅包含实体的外部接口，在推理过程中根据任务条件动态物化关系，并通过双层索引分离全局路由和局部实体聚焦。在DeepSeek-V4-Flash和SWE-bench Verified基准测试中，该方法在零预构建实体关系边的条件下取得了显著效果。

Details

Motivation: 解决大型软件仓库超出模型上下文限制的挑战，避免将仓库知识训练到模型中的高成本和快速过时问题，同时克服局部检索可能遗漏分散需求以及显式关系图带来持续维护负担的缺陷。

Result: 在DeepSeek-V4-Flash和SWE-bench Verified基准上评估，基础条件、单层条件和双层条件分别实现了92.1%、94.2%和95.6%的成功率，且均在零预构建实体关系边的设置下达成。

Insight: 创新性地提出了任务条件化关系物化的推理机制，通过实体专用外部接口和双层索引架构（分离全局路由与局部实体聚焦），实现了无需预定义关系图的动态知识构建，为代码仓库级推理提供了高效且可维护的解决方案。

Abstract: Large software repositories are often beyond model context limits. Training repository knowledge into models is costly and quickly stale, while local retrieval can miss scattered requirements, and explicit relation graphs add ongoing maintenance burden. We propose an entity-only external interface with task-conditioned relation materialization during inference. A two-layer index separates global routing from local entity focus and is evaluated on DeepSeek-V4-Flash and SWE-bench Verified. The base, one-layer, and two-layer conditions achieve 92.1%, 94.2%, and 95.6% success, respectively, under zero pre-built entity-relation edges.

[121] SWE-Prime: Fewer Trajectories, Better Performance cs.SE | cs.AI | cs.CLPDF

Dewu Zheng, Ruizhe Ye, Yanlin Wang, Yang Ye, Hongyu Zhang

TL;DR: 该论文提出了一种名为SWE-Prime的多粒度、两阶段监督微调数据选择方法，旨在通过筛选高质量轨迹和片段来提升大语言模型解决现实世界软件问题的能力。该方法首先在轨迹级别基于过程质量、结果质量和数据代表性进行筛选，然后在片段级别评估每个语义片段对最终解决方案的贡献、可学习性和潜在风险。实验表明，仅使用SWE-Prime选择的10%轨迹子集进行训练，其性能优于使用完整数据集。

Details

Motivation: 现有工作通过构建大规模智能体轨迹数据集并进行监督微调来提升大语言模型的软件问题解决能力，但成功的轨迹中可能包含无效、冗余或存在风险的步骤，直接用于微调会引入噪声监督并鼓励模型模仿不良的问题解决行为。

Result: 在SWE-Bench Pro和SWE-Bench Verified基准测试上的实验表明，使用SWE-Prime选择的10%轨迹子集进行训练，其性能优于使用完整已解决数据集，分别实现了高达12.2%和24.2%的相对性能提升。

Insight: 论文的创新点在于提出了一个两阶段的数据选择框架，不仅关注轨迹级别的整体质量，还深入到片段级别进行细粒度评估，并在训练时通过上下文保留与选择性损失计算相结合的方式，有效过滤了监督信号中的噪声，从而用更少的数据实现了更好的性能。

Abstract: To improve large language models’ ability to resolve real-world software issues, prior work has focused on constructing large-scale agent trajectory datasets and performing supervised fine-tuning (SFT) on successful trajectories. However, task success does not guarantee high-quality supervision: successful trajectories may still contain ineffective, redundant, or risky steps. Directly using such trajectories for SFT can introduce noisy supervision and encourage models to imitate undesirable problem-solving behaviors. Therefore, we propose SWE-Prime, a multi-granularity, two-stage SFT data selection method that progressively filters training data at the trajectory and segment levels. Specifically, the first stage performs trajectory-level screening based on process quality, result quality, and data representativeness, selecting a high-quality and representative subset of successful trajectories. The second stage performs segment-level selection by grouping consecutive steps into semantic segments and assessing each segment based on its contribution to the final solution, learnability, and potential risks. During SFT, all segments remain in the sequence to preserve context, while only selected segments contribute to the loss computation. Experiments on SWE-Bench Pro and SWE-Bench Verified show that training on the 10% trajectory subset selected by SWE-Prime outperforms training on the full resolved dataset, yielding relative performance gains of up to 12.2% and 24.2%, respectively.

cs.GR [Back]

[122] Comparative Evaluation of 3D Reconstruction Methods for Immersive Visualization of Laboratory Objects cs.GR | cs.CV | cs.HCPDF

Brian De La Cruz, Aaron Y. Zhao, Maitrey Gramopadhye, Sawyer J. Lazar, Xianming Tan

TL;DR: 本研究评估了四种3D重建方法（摄影测量法、基于神经辐射场的方法、高斯泼溅和LiDAR）在创建用于教育的实验室物体全息模型方面的效果。通过研究生对模型形状、颜色、纹理和视觉缺陷的评估，发现基于NeRF的方法在透明、反光或低纹理物体上表现最佳，能产生最一致的高保真度表示。

Details

Motivation: 研究动机是探究当前3D重建技术能否支持创建逼真的实验室物体全息模型，以用于教育目的，如增强现实/混合现实环境中的实验前准备和空间推理训练。

Result: 在评估中，基于NeRF的方法在多种物体上产生了最一致的高保真度表示，尤其在处理透明、反光或低纹理物体时优于其他方法；形状和颜色的再现普遍比纹理更成功。

Insight: 创新点在于对多种3D重建方法在教育全息可视化中的系统性比较，揭示了NeRF在复杂视觉属性处理上的优势，并提供了一个创建沉浸式学习对象的实用工作流程，为教育者和研究者设计数字学习体验提供了见解。

Abstract: In this study, we examined whether current 3D reconstruction methods can support the creation of realistic holographic representations of laboratory objects for educational use. In this regard, we compared four approaches: photogrammetry, a neural radiance field (NeRF)-based method, Gaussian splatting, and LiDAR. These methods were used to generate holographic models of common laboratory items and their fidelity was evaluated by graduate students. Participants assessed the models for shape, color, texture, and visual defects using a repeated-measures design. Across objects, the NeRF-based method produced the most consistently high-fidelity representations, particularly for transparent, reflective, or low-texture items that were difficult to capture with other approaches. Shape and color were generally reproduced more successfully than texture, suggesting that some visual properties remain more challenging to represent accurately in educational holograms. Beyond identifying the strengths and limitations of each reconstruction method, the study demonstrates a practical workflow for creating immersive learning objects that may support pre-laboratory preparation, spatial reasoning, and student engagement in AR/MR-based educational environments. These findings offer design-relevant insights for educators and researchers developing immersive digital learning experiences.

cs.CY [Back]

[123] ClassVision: AI-Powered Classroom Attendance System cs.CY | cs.AI | cs.CV | cs.LGPDF

Ankit Kumar Aggarwal, Veerabhadra Rao Marellapudi, Ovadia Sutton, Youshan Zhang

TL;DR: 该论文提出了一种名为ClassVision的AI驱动课堂考勤系统，利用人脸检测（FD）和人脸识别（FR）技术，通过实时图像处理自动识别教室中的学生并记录考勤，旨在替代传统耗时的人工考勤方法。

Details

Motivation: 传统基于纸笔或在线平台的考勤方式人力密集且耗时，论文旨在通过自动化技术解决这一痛点，特别是在教育环境中提升考勤效率。

Result: 研究发现，RetinaFace作为最佳人脸检测模型，结合人脸识别进行验证，在使用50x50像素裁剪嵌入时取得了最有希望的结果。

Insight: 创新点在于整合了实时图像处理、人机交互（HCI）和用户友好的Web界面，构建了一个端到端的自动化考勤系统；客观来看，其技术选型（RetinaFace结合人脸识别）针对课堂场景进行了优化，并强调了系统的易用性。

Abstract: Students and working professionals have to go through the attendance process every day. Traditional methods of marking attendance using pen and paper or online platforms are human-intensive and time-consuming. To address the challenges in manual attendance processes, this research explores the use of face detection (FD) and face recognition (FR) technology to automate the attendance process, particularly in educational settings, and build a ClassVision course attendance system. We also propose an automated attendance system featuring a human-computer interaction (HCI) and user-friendly web interface that utilizes real-time image processing to identify and recognize students in classrooms and automatically record their attendance. We identified RetinaFace as the best face detection model, and when combined with Face Recognition for verification, it provided the most promising results with a cropped embedding of 50x50 pixels.

cs.NE [Back]

[124] ANTShapes Benchmarking Datasets for Event-Based Neuromorphic Object Classification cs.NE | cs.AI | cs.CVPDF

M. Middleton, H. Kayan, B. Sen Bhattacharya, T. Ali, E. Baikas

TL;DR: 本文介绍了使用ANTShapes模拟工具创建的四个新颖的事件视觉数据集，用于基于事件的神经形态物体分类研究。这些数据集具有不同的难度级别，并通过卷积脉冲神经网络（SNN）在现有基准数据集（如N-MNIST、CIFAR10-DVS、DVSGesture和POKER-DVS）上进行了基准测试，验证了ANTShapes工具生成数据的适用性。

Details

Motivation: 基于事件的物体分类在安全和应用计算机视觉领域是基础任务，但传统基于帧的摄像头和计算管道存在设备尺寸、功耗、安全性和延迟等问题。神经形态设备和脉冲神经网络（SNNs）试图解决这些问题，但缺乏高质量的事件视觉数据集阻碍了研究进展。

Result: 论文创建了四个不同难度的数据集，并使用卷积SNN在现有事件视觉基准数据集上进行了分类性能测试，验证了ANTShapes工具生成的数据集适合用于事件视觉研究，但未提及具体的定量结果或是否达到SOTA水平。

Insight: 创新点在于通过ANTShapes工具生成多样化的事件视觉数据集，填补了该领域数据集的空白，并提供了基准测试框架，有助于推动基于事件的神经形态物体分类方法的发展。

Abstract: Object classification in event-based computer vision is a task that is attracting considerable research attention. Event-based object classification is a fundamental task in the fields of security and applied computer vision, which typically use synchronous frame-based cameras and computing pipelines for operation. This approach has several practical flaws. The size, weight and power consumption of the device could prohibit deployment at the extreme edge or in covert sensing environments. Besides this, there are security concerns inherent in cloud-based or other off-device computation approaches due to the requirement of sending and receiving potentially sensitive data. Furthermore, this transmission of data introduces latency and requires consistent connectivity to the cloud infrastructure to function. The use of Spiking Neural Networks (SNNs) hosted on neuromorphic devices attempts to solve several issues present in this conventional approach. Research into event-based object classification methods are hindered by the lack of high-quality vision datasets to use. To this end, the ANTShapes simulation tool has been previously proposed to create and label event-based vision datasets. In this paper, four novel datasets of varying difficulties are created using the tool and are benchmarked against existing spiking datasets commonly used for event-based vision research (N-MNIST, CIFAR10-DVS, DVSGesture and POKER-DVS). Classification is performed using a convolutional SNN. This work simultaneously provides four datasets with rich details for future experiments to use and validates the output of the ANTShapes dataset simulation tool as being suitable for its purpose.

cs.SD [Back]

[125] StreamAV-Bench: A Comprehensive Benchmark for Streaming Audio-Video Generation cs.SD | cs.CV | cs.MMPDF

Kaiqi Liu, Haoxuan Zeng, Jingqi Liu, Jiacong Fang, Ziqi Cai

TL;DR: 本文提出了StreamAV-Bench，这是首个专为流式音视频生成设计的综合性基准测试。该基准建立了一个统一的评估框架，包含用于评估指令遵循和长时稳定性的渐进式生成赛道，以及用于评估交互响应、状态保持与重用的交互式生成赛道。通过对13个代表性系统在32个细粒度维度上进行专家验证评估，揭示了当前模型在渐进生成中存在时间漂移、在交互控制中存在响应瓶颈等问题，并基于失败分析为原生联合音视频流式模型的发展提供了见解。

Details

Motivation: 现有基准主要评估完整序列，难以捕捉流式生成的特性，而生成模型的进步正推动视频生成向无界流式音视频生成发展，用于实时交互世界。为了弥补这一差距，需要专门的基准来评估流式音视频生成。

Result: 在提出的StreamAV-Bench基准上，对13个代表性系统进行了广泛评估，揭示了当前模型在渐进生成中存在时间漂移、在交互控制中存在响应瓶颈等关键问题。

Insight: 创新点在于首次提出了一个专门针对流式音视频生成的综合性基准，并设计了包含渐进式和交互式两条评估赛道的统一框架，以及专家验证的细粒度评估维度。这为评估和推动原生联合音视频流式模型的发展提供了关键的基准和分析工具。

Abstract: Recent advancements in generative models are pushing video generation toward unbounded streaming audio-video generation for real-time interactive worlds. However, existing benchmarks primarily evaluate completed sequences and struggle to capture streaming properties. To bridge this gap, we introduce StreamAV-Bench, the first comprehensive benchmark tailored for streaming audio-video generation. StreamAV-Bench establishes a unified evaluation framework, including the progressive track for instruction adherence and long-horizon stability, and the interactive track for interactive response and state retention and reuse. With expert-verified evaluation cases across 32 fine-grained dimensions, we conduct an extensive evaluation of 13 representative systems. Our analysis reveals that current models suffer from temporal drift in progressive generation and responsiveness bottlenecks during interactive control. Based on a comprehensive failure analysis, we share insights to advance the development of native joint audio-video streaming models.

[126] SpeechGym: An Audio-Native Gym for Training Voice Agents via Reinforcement Learning cs.SD | cs.AI | cs.CLPDF

Jiajun Fan, Jingyuan Li, Prashanth Gurunath Shivakumar, Jia-Hong Huang, Qi Luo

TL;DR: SpeechGym是一个专为语音智能体设计的音频原生强化学习训练环境，它让两个全模态模型直接在音频上进行对话，无需依赖外部ASR或TTS系统。该环境基于现有文本智能体基准的任务、工具和成功检查标准构建，仅改变交互模态，实现了端到端的本地可训练闭环。研究发现，语音引入的失败主要是感知错误（如误听参数）和行为错误（如未经授权的操作），这些错误可通过环境提供的免费标签进行训练。通过引入每轮过程奖励解决稀疏奖励问题，训练后的智能体在独立语音基准上任务成功率提升超过一倍，模型排名显著提升。

Details

Motivation: 现有语音智能体训练范式主要依赖文本，要么通过级联TTS和ASR围绕专有语音API（梯度无法流动且按调用计费使在线强化学习成本过高），要么停留在文本层面（只能评估无法改进语音智能体）。因此，需要构建一个音频原生的、可端到端训练的智能体环境，以解决语音交互中的独特挑战。

Result: 在独立实现的语音基准上，训练后的智能体无需进一步调优，任务成功率提升超过一倍，并将一个开源权重模型从排行榜末位提升至第二位，同时训练后使用的对话轮次和令牌数减少。

Insight: 创新点在于构建了首个音频原生的智能体训练环境，实现了纯音频交互下的端到端强化学习；关键洞察是语音智能体能力并非直接从音频理解能力衍生，其失败主要源于感知错误（如误听）和行为错误，这些可通过环境自动提供的标签进行训练；通过设计每轮过程奖励（奖励每次成功的工具调用）解决了结果奖励（GRPO）的稀疏性问题，显著提升了训练效果和泛化能力。

Abstract: Voice agents must call tools and hold multi-turn dialogue entirely through speech, yet the dominant paradigm trains them in text. Existing frameworks either cascade TTS and ASR around a proprietary voice API, where gradients cannot flow and per-call cost makes on-policy reinforcement learning prohibitive, or stay in text: they measure voice agents but cannot improve them. We present SpeechGym, an audio-native agentic environment in which two omni-modal models converse in native audio, with no external ASR or TTS and no API boundary, over the unmodified tasks, tools and success check of an established text agentic benchmark, so that the interaction modality is the only variable and the loop stays local and trainable end to end. Audio agentic capability does not follow from audio understanding. The failures speech introduces are perceptual rather than reasoning deficits: the agent picks the right tool and the right argument slot but fills it with a value misheard from the waveform, and that single error cascades into a failed call, a retry of the same call, and a wasted step budget. A second failure is behavioural: under an insistent caller the agent performs an unauthorised write and ends the episode believing it helped. Both are trainable, because the environment labels them for free: a call with a misheard argument fails against the database while a correct one succeeds. The obstacle is sparsity, not signal. Outcome-only GRPO is gradient-starved here, since almost every rollout group fails identically, while a per-turn process reward crediting each successful tool call restores variance to nearly every group. Trained this way, the agent transfers with no further tuning to an independently implemented voice benchmark, more than doubling task success and carrying an open-weights model from last place to second on that leaderboard, while using fewer turns and tokens than before training.

cs.MA [Back]

[127] Zero-Shot Self-Orchestration with Ledger-Based Control for Improved LLM Coding Performance cs.MA | cs.AI | cs.CL | cs.SEPDF

Victor Gao, Vida Khosrowshahi, Ali Khosrowshahi, Xihao Sun, Juhyun Lee

TL;DR: 本文研究了在LLM编码任务中引入基于共享文件系统工作空间的manager-worker多智能体架构（无需训练或针对特定基准调优）对性能的影响。通过在LiveCodeBench的100个最新难题上测试九个模型（包括开源和前沿闭源模型），发现该架构带来的提升是真实但条件性的：对部分模型有显著增益（如Qwen3.8-27B提升23.4分），而对另一些模型则无效甚至有害。使用manager大约使token成本增加三倍，但相比升级到更大模型，它能以更低成本提升准确率。

Details

Motivation: 多智能体LLM系统通常被报道优于单模型基线，但证据混杂且比较往往存在混淆因素（如同时改变token预算、工具调用和提示）。本研究旨在厘清在共享文件系统工作空间中引入manager-worker架构（无训练、无每基准调优）对LLM编码性能的实际影响。

Result: 在LiveCodeBench的100个最新难题上，该架构对部分模型带来显著提升（如Qwen3.8-27B +23.4，GPT-5.6-Luna +10.6，Kimi-K3 +30.4，p < 10^{-4}），而对其他模型无效或负向（如Qwen3.6-35B -1至-9）。使用manager时，Opus-5在单次通过中达到研究最高分91%。成本方面，manager使token账单增加约三倍，但相比升级更大模型更经济：例如GPT-5.6-Terra加manager以1/5成本（$11.71 vs $61.11）接近Fable 5的单次调用准确率（85.0 vs 87.4）。

Insight: 论文宣称的创新点在于零样本自编排（无需训练或调优）的manager-worker架构，通过共享文件系统工作空间和基于账本的控制来提升LLM编码性能。客观分析认为，其核心创新在于揭示了该架构通过上下文管理（短worker调用和共享笔记组织状态、减少截断）和问题分解两种机制实现增益，且提升效果因模型大小和推理能力启用状态而异，为低成本提升LLM编码性能提供了可借鉴的轻量级多智能体方案。

Abstract: Multi-agent large language model systems are widely reported to beat single-model baselines, but the evidence is mixed, and comparisons are usually confounded: pipelines change token budgets, tool calls, and prompts simultaneously, so an aggregate gain rarely reveals what actually helped. We investigate the effect of introducing the manager-worker scaffold over a shared filesystem workspace, with no training and no per-benchmark tuning, measured against the same model answering in a single pass. Across nine models – five open-weight, spanning 9B to ~2.8T parameters, and four frontier closed models – on the 100 latest hard LiveCodeBench problems, the scaffold’s benefit is real but conditional: large and statistically significant for some (Qwen3.8-27B +23.4, GPT-5.6-Luna +10.6 and GPT-5.6-Terra +8.0, each over five paired passes; Kimi-K3 +30.4 and Minimax-M3 +11.0 over five paired passes with reasoning off, both at $p < 10^{-4}$, and +42 and +12 in a single pass at a 128k cap) and null or negative for others (Qwen3.6-35B -1 to -9 with reasoning off). With the manager, Opus-5 achieves the highest score in the study at 91% in one pass. Running a manager roughly triples the token bill, but it buys accuracy more cheaply than moving to a larger model does: GPT-5.6-Terra with a manager nearly matches Fable 5’s single-call accuracy (85.0 against 87.4, $p = 0.59$) at a fifth of the price ($11.71 against $61.11 per 100-problem pass, $p < 10^{-4}$), and the Qwen-27B arm does it for $51.75 on weights anyone can self-host. Our transcript analysis finds several mechanisms behind the gains, of which two recur: context management, in which short worker calls and shared notes organize state and reduce truncation, and problem decomposition. Improvements are modest for large models with reasoning enabled, but larger for some models with reasoning disabled and for smaller models with reasoning enabled.

cs.RO [Back]

Easop Lee, Lingyu Zhang, Boyuan Chen

TL;DR: 本文提出了RTNav，一种面向实时零样本物体导航的架构，旨在解决现有方法在真实世界连续操作时因推理延迟导致的性能下降问题。该架构将推理延迟、异步环境步进和有限计算资源作为显式设计考量，在HM3D系列数据集上显著提升了实时导航性能。

Details

Motivation: 现有基于视觉和语言基础模型的零样本物体导航方法在同步模拟器中开发，忽略了推理延迟，导致在真实世界实时执行时性能显著下降。

Result: 在HM3D-v1、HM3D-v2和HM3D-OVON的实时变体上评估，RTNav将成功率提升了高达11%，将加权完成时间成功率（SCT）提升了高达5.1个百分点，优于先前工作。

Insight: 创新点在于将推理延迟和异步环境交互作为核心设计约束，而非事后优化；从客观角度看，其架构设计强调了在有限时间预算内感知、推理与行动的协同，对部署实时具身智能体具有借鉴意义。

Abstract: Navigation in unknown environments to find unforeseen objects has become increasingly feasible with capable vision and language foundation models. However, these models also introduce non-negligible inference latency, which becomes an important concern when agents must operate continuously in the real world. Most state-of-the-art methods are still developed in synchronous simulators, where the environment waits for the agent to act and inference time is effectively free. As a result, agents are often designed around the sequential execution of perception, reasoning, and action, with little regard for time constraints. Under real-time execution, where wall-clock time counts towards the task budget, the inefficiencies of these architectures become clear. We show that recent zero-shot object navigation methods suffer consistent performance degradation under such realistic timing conditions. Motivated by this observation, we propose RTNav, a simple but effective architecture that treats inference latency, asynchronous environment stepping, and bounded compute as explicit design considerations. Evaluated on real-time variants of HM3D-v1, HM3D-v2, and HM3D-OVON, RTNav improves the success rate by up to 11% and the Success weighted by Completion Time by up to 5.1 points over prior work.

[129] Beyond the Proving Ground: Independent Public-Road Testing of Assisted Lane Change Systems using LiDAR cs.RO | cs.CVPDF

Marcello Cellina, Akos Kriston, Antonio Migneco, Davide Maggi, Stefano Favelli

TL;DR: 本文提出了一种独立测试辅助变道系统在公共道路上合规性的方法，通过在法国A31高速公路上使用配备激光雷达的测试车辆，评估了系统在不同车距和速度组合下的表现，并与UNECE法规79号的安全距离要求进行对比。

Details

Motivation: 现有测试方法（如试验场场景）可能无法反映真实驾驶复杂性，且地理围栏需要制造商合作，限制了评估的独立性，因此需要开发独立、真实的公共道路测试方法。

Result: 在27个预定义的变道操作中，18个完成，9个被抑制；其中6个操作不符合法规最小距离要求，3个在考虑测量不确定性后仍存在显著偏差，证明了激光雷达传感在此类测试中的适用性。

Insight: 创新点在于首次设计了针对UNECE法规79号安全距离要求的公共道路测试活动，该方法可支持市场监督和未来法规修订，揭示审批程序未覆盖的真实世界行为。

Abstract: Testing of commercial Advanced Driver Assistance Systems is essential to ensure safety and compliance during type approval and in service operation. However, proving ground scenarios may not reflect real world driving complexity, while geo fencing can require manufacturer collaboration and limit assessment independence. This work presents a methodology for independently testing Assisted Lane Change systems on public roads. A campaign on the A31 French motorway used a test vehicle equipped with a LiDAR based vehicle detection and tracking system. Tests covered combinations of inter vehicle distance and speed between the test vehicle and the take over vehicle. Real time kinematic global navigation satellite system receivers assessed detection and tracking performance. Recorded lane change trajectories were compared with the lane change suppression requirements of UNECE Regulation Number 79. Of 27 predefined lane change manoeuvres, 18 were completed and 9 suppressed. In 6 cases, the system allowed manoeuvres that did not meet regulatory minimum distance requirements. In 3 cases, the deviation remained statistically significant after accounting for measurement uncertainty. To the authors knowledge, this is the first public road campaign designed to assess Assisted Lane Change compliance with Regulation Number 79 safety distance requirements. The results demonstrate the suitability of LiDAR based sensing for this purpose. The methodology can support market surveillance and future regulatory revisions by revealing real world behaviours not covered by approval procedures.

[130] TrapVLA: Trapping Vision-Language-Action Models in Configured Failure Modes cs.RO | cs.CVPDF

Jun-Hui Liu, Kun-Yu Lin, Yi-Lin Wei, Xu-Han Chen, Yinghao Li

TL;DR: 本文提出了一种针对视觉-语言-动作模型的新型后门攻击任务——配置故障捕获，旨在通过隐蔽的文本触发器激活攻击并诱导特定的故障模式。作者构建了Trap-LIBERO和Trap-RoboTwin两个新基准，并提出了TrapVLA方法，通过显式学习触发器诱导的动作残差来引导策略产生配置的故障行为。实验表明，该方法能在保持干净数据性能的同时，有效将配置故障注入VLA模型。

Details

Motivation: 现有后门攻击通常将任何任务失败视为攻击成功，而本文旨在解决更具挑战性的问题：攻击者需要精确控制机器人如何失败（例如，使其以指定的位置偏移进行抓取），这使得攻击更隐蔽且难以检测。

Result: 在仿真基准（Trap-LIBERO和Trap-RoboTwin）和真实机器人场景中的大量实验表明，TrapVLA方法能有效将配置故障模式注入VLA模型，同时在干净数据上基本保持原有性能。

Insight: 创新点在于定义了‘配置故障捕获’这一新攻击任务，强调对故障模式的精确控制；并提出了学习‘触发器诱导的动作残差’的方法来应对稀疏动作偏差的挑战，以及配套的数据合成引擎和自动化评估套件来支持该任务的研究。

Abstract: This work introduces Configured Failure Trapping, a novel backdoor attack task against Vision-Language-Action (VLA) models, which aims to activate attacks through stealthy textual triggers and induce configured failure modes. Unlike prior backdoor attacks that treat any task failure as a successful attack, Configured Failure Trapping requires the attacker to control how the robot fails (e.g., causing the robot to grasp with a specified positional offset), making it substantially more challenging and hard to detect. To support the new task, we propose an effective data engine for synthesizing high-quality target trajectories and an automated suite for measuring configured-failure fidelity. Then, based on this foundation, we construct two new benchmarks, namely Trap-LIBERO and Trap-RoboTwin, that instantiate Configured Failure Trapping across four representative failure modes. To address this task, we identify sparse action deviation as a critical challenge and accordingly propose a novel method named TrapVLA, which explicitly learns trigger-induced action residuals to steer the policy toward the configured failure behavior. Extensive experiments across simulation benchmarks and real-world robotic settings show that TrapVLA effectively injects configured failure modes into VLA models while largely preserving performance on clean data. Project page: https://john-liua.github.io/TrapVLA/

[131] 4DSynth: Controllable Procedural World Synthesis for Dynamic Embodied Simulation cs.RO | cs.CVPDF

Zehao Qi, Haochen Luo, Jia-Wang Bian, Zeyu Ma, Shuyang Sun

TL;DR: 4DSynth是一个可控的程序化系统，能够根据自然语言描述、蓝图掩码或单张照片生成可编辑的4D环境，包含显式几何、动画角色、无碰撞轨迹和物理就绪的模拟状态。该系统通过几何基础表示统一处理动画、相机规划、渲染和任务生成，并构建了4DSynth-Nav交互式导航基准来验证流程。

Details

Motivation: 解决具身智能体需要视觉多样、物理交互且随时间变化的环境的问题，而现有方法难以同时满足这些属性且缺乏可编辑性和可控性。

Result: 在完全由4DSynth生成的4DSynth-Nav基准上，两个视觉语言模型在三个难度级别中均未能完成大多数任务，并在早期子任务后停滞，展示了基准的挑战性。

Insight: 创新点在于将程序化生成与4D动态控制结合，实现从多种输入生成可编辑的4D环境，并通过统一表示支持多场景应用，为具身智能体的开发和评估提供了可扩展且可复现的基础。

Abstract: Embodied agents need environments that are visually diverse, physically interactive, and changing over time. Procedural simulators can generate large interactive scene collections, and recent 4D generators produce compelling visual dynamics. Combining these properties in one environment, however, still demands extensive manual effort, and the result is rarely editable or controllable enough to reuse at scale. We present 4DSynth, a controllable procedural system that turns a natural-language description, a blueprint mask, or a single photograph into an editable 4D environment with explicit geometry, animated actors, collision-free trajectories, and physics-ready simulation state. Multiple scene routes share one geometry-grounded representation, so the same pipeline handles animation, camera planning, rendering, and task generation. To validate the full pipeline, we construct 4DSynth-Nav, an interactive navigation benchmark generated entirely from 4DSynth’s procedural scenes. Two vision-language models evaluated across three difficulty tiers both fail the majority of tasks and stall after early subtasks. The same procedural controllability that produces these environments also makes each failure reproducible and each difficulty axis independently tunable. This paper presents both a controllable generation pipeline and the scalable benchmark it enables, offering a practical foundation for developing and evaluating embodied agents.

[132] CLAP: Cross-Embodiment Video World Models are Zero-Shot Physical Simulators cs.RO | cs.AI | cs.CVPDF

Kechen Liu, Ola Shorinwa

TL;DR: CLAP是一个跨具身动作条件视频生成框架，能够利用人类和机器人代理的多样化互联网规模视频数据进行训练，学习通用的物理规律，并作为零样本物理模拟器应用于现实世界任务。

Details

Motivation: 现有最先进的动作条件视频模型通常局限于单一机器人具身，无法利用包含丰富学习信号的异构视频数据来学习可泛化的物理知识，CLAP旨在通过跨具身学习来弥合这一差距。

Result: 在DROID等挑战性环境中，CLAP达到或超越了最先进的单具身视频模型的性能，并通过少样本适应建立了训练单具身视频世界模型的新范式。

Insight: 核心创新在于使用末端执行器位姿、语言指令和潜在动作来协调不同的动作空间，并引入基于课程学习的跨具身学习策略，先利用潜在动作从未标记视频数据中学习基础物理先验，再将其落地到末端执行器动作空间以实现零样本部署。

Abstract: State-of-the-art action-conditioned video models are typically restricted to a single robot embodiment, preventing them from leveraging the vast corpus of heterogeneous video data that contains rich signals for learning generalizable physics. To bridge this gap, we introduce CLAP, a framework for cross-embodiment action-conditioned video generation capable of being trained on diverse, internet-scale videos across human and robotic agents. CLAP is grounded in the insight that universal physical laws govern spatiotemporal dynamics regardless of the actor. However, cross-embodiment learning is non-trivial because action representations vary sharply across robot platforms and are typically absent in human videos. CLAP addresses this fundamental challenge through the following core contributions. First, CLAP reconciles disparate action spaces using end-effector poses, language instructions, and latent actions. Second, to resolve their individual limitations, CLAP introduces a curriculum-based cross-embodiment learning recipe that first learns foundational physical priors across unlabeled video data using latent actions and subsequently grounds them in end-effector action spaces for zero-shot deployment to real-world tasks. Crucially, CLAP approaches or surpasses state-of-the-art single-embodiment video models in challenging environments like DROID. These performance advantages compound via few-shot adaptation to establish a novel paradigm for training single-embodiment video world models. Ultimately, CLAP delivers the most comprehensive suite of action-conditioned video world models to date - spanning diverse action-conditioning spaces (end-effector, language, and latent) and robot morphologies (including cross-embodiment, DROID, Bridge, bimanual YAM robots, and G1 humanoids). We open-source all code and models. Project Website at https://omni-clap.github.io .

cs.LG [Back]

[133] SAGE: Variate-Wise Semantic Augmentation for Vision-Language Time Series Forecasting cs.LG | cs.CVPDF

Haizhao Fan, Xinyi Le

TL;DR: 本文提出SAGE框架，通过结合CLIP的文本和视觉编码器，为时间序列预测引入变量级别的语义增强。该方法联合建模时间、跨变量、文本和视觉信息，避免了推理时使用大型语言模型的计算开销，并在多个长期预测基准上实现了最先进的准确率。

Details

Motivation: 现有时间序列预测模型仅处理原始数值序列，缺乏领域专家所利用的语义知识（如变量的物理意义、统计行为和时间动态）。现有方法要么依赖推理时使用计算昂贵的大型语言模型，要么在数据集层面应用统一的文本提示，忽略了变量间的异质语义。

Result: 在八个长期预测基准和M4数据集上，SAGE达到了最先进的准确率。消融实验证实了多模态对齐和变量级别知识带来的互补性收益。

Insight: 创新点在于提出一种端到端的CLIP-based框架，通过门控残差路径注入变量特定描述和统计描述符，并利用冻结的CLIP视觉编码器通过对比目标对齐渲染序列与时间表示。这为时间序列预测引入了互补的语义和视觉监督，而无需在预测循环中引入大型语言模型。

Abstract: Time series forecasting models operate on raw numerical sequences, lacking the semantic knowledge that domain experts implicitly leverage, such as the physical meaning of each variable, its statistical behavior, and its temporal dynamics. Recent efforts to bridge this gap fall into two camps. Some rely on large language models at inference time, which is computationally expensive. Others apply uniform textual prompts at the dataset level, ignoring the heterogeneous semantics across individual variates. We propose SAGE (Seeing and Augmenting with Grounded Encoding), an end-to-end CLIP-based framework that jointly models temporal, cross-variable, textual, and visual information. The CLIP text encoder processes frequency-enhanced patches and variable tokens, while gated residual paths inject variable-specific descriptions and statistical descriptors. In parallel, the frozen CLIP vision encoder aligns rendered series with temporal representations through a training-only contrastive objective. This dual use of CLIP adds complementary semantic and visual supervision without placing an LLM in the forecasting loop. Across eight long-term benchmarks and M4, SAGE achieves state-of-the-art accuracy. Ablations confirm complementary gains from multimodal alignment and variable-level knowledge.

[134] ClusterAttention: A training-free speedup of bidirectional attention cs.LG | cs.CVPDF

Kasper Nordenram, Amelie Dittmann

TL;DR: 本文提出ClusterAttention，一种无需训练的双向注意力层加速方法。该方法通过快速递归聚类适应每个注意力头中键和查询的几何结构，生成大小可任意设置的簇，并利用固定大小的簇（2的幂次）在GPU上实现与稠密注意力相同的延迟。实验表明，在大型表格数据上，ClusterAttention将TabPFN-3加速2-6倍，同时保持至少99%的稠密精度；在视频生成任务中，相比领域专用方法SVOO，它实现了更接近稠密注意力的输出和更高的加速比（1.8倍 vs 1.4倍）。

Details

Motivation: 现有稀疏注意力方法要么依赖输入结构（如语言顺序或图像空间邻近性），要么使用缓慢的聚类过程，无法在非结构化输入和单次前向传播中高效工作。本文旨在开发一种无需训练、适应性强且能快速应用于任意几何结构的注意力加速方法。

Result: 在大型表格数据上，ClusterAttention将TabPFN-3加速2-6倍，同时保持至少99%的稠密精度；在Wan 2.1-14B T2V视频生成任务中，相比领域专用方法SVOO，它实现了更接近稠密注意力的输出和更高的加速比（1.8倍 vs 1.4倍），且无需离线校准。

Insight: 创新点包括：1）提出快速递归聚类方法，自适应键查询几何结构，实现无需训练且簇大小可任意设置；2）通过固定簇大小为2的幂次，在GPU上实现与稠密注意力相同的延迟；3）推导稀疏注意力输出误差表达式，解释紧簇误差大于随机簇的反直觉现象，并引入质心补偿机制降低误差。

Abstract: This paper introduces ClusterAttention, a general training-free speedup of bidirectional attention layers. Existing sparse attention methods either rely on structure in the input, such as order in language or spatial proximity in images, or use slow clustering processes amortized over several forward passes. ClusterAttention instead uses a fast recursive clustering method that adapts to the geometry of the keys and queries in each attention head to produce useful clusters. This method allows setting the size of the clusters arbitrarily. We utilize this by setting all clusters to be a fixed size that is a power of two, allowing the block-sparse attention to run at the same latency per query-key interaction as dense attention on GPUs. We also derive an expression for the output error in sparse attention, that explains the counterintuitive experimental finding that tight clusters can lead to larger errors than random clusters. We then derive the error when excluded clusters are compensated through their centroids, and show that this error shrinks with tighter clusters. We integrate this compensation into the method. On large-scale tabular data ClusterAttention speeds up TabPFN-3 arXiv:2605.13986 by two to six times, while retaining at least 99% of the dense accuracy. To our knowledge, it is the first training-free method that can be successfully applied in the setting of unstructured input and a single forward pass. For video generation with Wan 2.1-14B T2V arXiv:2503.20314 , ClusterAttention achieves output closer to dense attention and a larger speedup (1.8x versus 1.4x) compared to SVOO arXiv:2603.18636 , a leading method developed specifically for this domain, both run without offline calibration.

[135] J-Zero: Unified Challenger–Solver–Judge Co-Evolution from Zero Data cs.LG | cs.AI | cs.CLPDF

Gyouk Chu, Myeongho Jeon, Eunho Yang

TL;DR: 本文提出了J-Zero框架，一个统一的挑战者-求解者-评判者协同进化框架，旨在支持语言模型在可验证和不可验证领域进行自我进化。该框架通过挑战者生成日益困难的任务、求解者学习提供更高质量的回答，以及评判者利用已知偏好对进行协同适应，实现了无需人类监督的持续自我改进。

Details

Motivation: 动机是解决当前自进化语言模型主要局限于可验证领域的问题，探索并实现在不可验证领域的自我进化，以减少对人类监督的依赖。

Result: 在可验证和不可验证领域，J-Zero分别平均超越基线方法4.2分和8.0分，并且能够持续改进至少十次迭代，而基线方法在两次迭代后性能下降。

Insight: 创新点在于提出了一个统一的对抗性协同进化框架，特别是评判者的协同适应机制，它不依赖于评判者自身的评分，而是利用从响应生成过程中预先可知的偏好对（如求解者的答案优于挑战者的答案）进行学习，这有助于在缺乏明确反馈的不可验证领域实现稳定进化。

Abstract: Self-evolving language models have recently emerged as a promising path toward superintelligence, with the advantage of reducing the cost of human supervision. While considerable progress has been made in verifiable domains, self-evolution in unverifiable domains remains substantially less explored. We propose Judge co-adaptation from Zero data (J-Zero), a unified Challenger–Solver–Judge co-evolution framework that supports self-improvement across both domains. The Challenger and Solver co-evolve through an adversarial interaction: the Challenger generates increasingly difficult tasks, while the Solver learns to produce higher-quality responses to them. In parallel, the Judge co-adapts using preference pairs whose ordering is known in advance from how each response was produced, i.e., the Solver’s answer over the Challenger’s, and its decomposed-and-recombined answer over its one-shot answer, rather than from the Judge’s own scores. J-Zero outperforms the baselines by an average of 4.2 points on verifiable and 8.0 points on unverifiable domains, and continues to improve through at least ten iterations, whereas the baselines degrade after two.

cs.AI [Back]

[136] GameWAM: A World Action Model for Video Games cs.AI | cs.CV | cs.LGPDF

Yuncheng Guo, Zhanqiu Zhang, Yiwen Guo, Weijia Li

TL;DR: 本文提出了GameWAM，这是首个用于视频游戏原生闭环操作和GUI控制的世界-动作模型。该模型通过并行的视觉和动作生成过程，联合预测未来的视觉观察和可执行的键盘鼠标轨迹，以统一世界动态建模与任务策略。

Details

Motivation: 现有游戏智能体直接将视觉和任务上下文映射到动作，缺乏显式的世界动态建模；而交互式游戏世界模型则从给定动作预测视觉未来，但不能作为任务策略。本文旨在统一这两个目标，探索在视频游戏的动态和开放式交互下的世界-动作模型。

Result: 实验表明，与对比的智能体相比，GameWAM在任务成功率上具有竞争力，且执行的原生动作更少。

Insight: 创新点包括：通过块因果条件化和流匹配实现并行视觉与动作生成；引入游戏玩法/GUI模式预测以处理异构原生控制；采用块循环控制进行长时程交互规划；并揭示了采样动作源的低频成分会系统性地影响生成相机运动的失败模式（LASI）。

Abstract: Modern video games combine first-person perception, rapid visual changes, persistent world state, and heterogeneous native controls. Existing game agents map visual and task context directly to actions but lack explicit world dynamics modeling, whereas interactive game world models predict visual futures from supplied actions but do not serve as task policies. World-Action Models (WAMs) unify these objectives, but remain largely unexplored under the dynamics and open-ended interaction of video games. We introduce GameWAM, to our knowledge the first WAM for native closed-loop gameplay and GUI control. GameWAM jointly generates future visual observations and executable keyboard-mouse trajectories through parallel visual and action generative processes with block-causal conditioning and flow matching. To support joint world-action learning, we construct synchronized gameplay and GUI trajectories. To handle heterogeneous native control, GameWAM predicts a gameplay/GUI mode at each action step and generates actions with mode-specific prediction distributions and continuous-action normalization. For long-horizon interaction, block-cycle control predicts beyond the committed horizon, executes only a short action prefix, and replans from new observations, while fine-grained within-cycle context and hierarchical cross-cycle history preserve temporal continuity. Experiments demonstrate competitive task success with fewer executed native actions than the compared agents. We further uncover Low-Frequency Action Source Imprinting (LASI), in which low-frequency components of the sampled action source systematically steer coarse generated camera motion under fixed conditioning, revealing a source-sensitivity failure mode in generative control. Project page is available at https://yunncheng.github.io/GameWAM/.

[137] Omni-Interactive Universal Embedder cs.AI | cs.CVPDF

Wei-Yao Wang, Kazuya Tateishi, Shuyang Cui, Christian Simon, Takashi Shibuya

TL;DR: 本文提出了首个全交互通用嵌入器OmniUE，它通过利用专用可学习令牌的中间层表示，在文本、视频和音频之间学习统一的嵌入空间，并支持全交互查询，允许用户以文本、视觉感兴趣区域和音频片段的形式提供输入。

Details

Motivation: 现有的多模态表示学习方法主要关注语言和图像模态，且用户交互条件有限，本文旨在解决跨文本、视频和音频的统一嵌入学习，并支持更丰富的交互查询方式。

Result: 在多个基准测试中，OmniUE均超越最先进基线，在文本交互视频基准（MMEB-v2-video）上平均提升10.5%，在音频任务（MAEB）上提升1.1%，在视觉交互基准（SCaR）上提升83.7%，在全交互OmniCHOIR基准上提升24.1%。

Insight: 创新点在于结合专用可学习令牌的中间层表示实现跨模态统一嵌入，并引入视觉和音频分割器处理多样化用户交互，通过上下文聚合生成用户条件化的任意到任意嵌入，推动了全模态表示学习和全交互查询的联合发展。

Abstract: Multimodal representation learning has been shifting from traditional two-tower architectures to large language model (LLM)-based embedders due to their strong instruction-following capabilities. Despite this progress, existing approaches primarily focus on language and image modalities, which also remain the dominant modalities for user-conditioned interactions in current embedders. In this paper, we propose the first Omni-Interactive Universal Embedder (OmniUE), which not only learns a unified embedding space across text, video, and audio by leveraging intermediate-layer representations from dedicated learnable tokens, but also supports omni-interactive querying, enabling users to provide inputs in the form of text, visual regions of interest, and audio spans. Within OmniUE, visual and audio segmenters process diverse user interactions and integrate them with an omni-LLM to produce user-conditioned any-to-any embeddings via context aggregation. To evaluate OmniUE’s omni-interactive capabilities, we introduce OmniCHOIR, benchmarking models for omni-interactive compositional audio retrieval based on the given text, video, and audio as well as unimodal or multimodal interaction prompts. OmniUE consistently surpasses state-of-the-art baselines across diverse modalities, with average improvements of 10.5% on textual-interactive video benchmarks (MMEB-v2-video), 1.1% on audio tasks (MAEB), 83.7% on visual-interactive benchmarks (SCaR), and 24.1% on our omni-interactive OmniCHOIR benchmark. We believe that jointly advancing omni-modal representation learning and omni-interactive querying paves the way toward universal embedders.

[138] CIFQA: A Deterministic Tool-Grounded Multi-Agent LLM Framework for Financial Query Answering cs.AI | cs.CL | q-fin.CPPDF

Kunjesh Parekh, Anil Kumar Tiwari, Divya Saxena

TL;DR: 论文提出了CIFQA框架，这是一个基于确定性工具的多智能体大语言模型系统，专门用于解决计算密集型金融问答任务。该框架将语言理解与数值计算分离，通过专用智能体处理查询解释、路由、参数提取、计算规划和响应生成，并使用基于Python的确定性工具执行金融计算和规则应用。

Details

Motivation: 解决大语言模型在处理需要精确推理结构化利率、时间条件、数值公式和基于规则的约束的多步骤金融计算时，经常产生数值错误但看似合理的答案的局限性。

Result: 在精心策划的定期存款查询基准测试中，CIFQA在计算密集型查询上达到95.54%的准确率，总体准确率为90.87%，显著优于直接使用大语言模型的基线方法。一个17B的开源骨干模型在CIFQA框架内甚至优于使用相同金融信息评估的更大规模前沿模型。

Insight: 核心创新在于通过多智能体架构和确定性工具将语言理解与数值执行解耦，确保了计算过程的可靠性和可复现性。研究表明，对于数值可靠性而言，系统架构设计比模型规模更为关键，这为构建可靠的领域特定AI系统提供了重要思路。

Abstract: Calculation-intensive financial question answering requires exact reasoning over structured rates, temporal conditions, numerical formulas, and rule-based constraints. Although Large Language Models (LLMs) perform strongly on natural language tasks, they often produce numerically incorrect yet plausible answers when solving multi-step financial calculations. To address this limitation, we introduce CIFQA (Calculation-Intensive Financial Query Answering), a deterministic tool-grounded multi-agent LLM framework for financial question answering. CIFQA separates language understanding from numerical execution by assigning specialized agents to query interpretation, routing, parameter extraction, computation planning, and response generation, while deterministic Python-based tools perform financial calculations and rule application. We instantiate CIFQA for fixed deposit query answering and evaluate it on a curated benchmark of fixed deposit queries. CIFQA achieves 95.54% accuracy on calculation-intensive queries and 90.87% overall accuracy, substantially outperforming direct LLM baselines even when provided with complete formulas, rate cards, and benchmark instructions. Ablation studies show that deterministic components such as exact rate lookup, tenure computation, rolling-year adjustment, and premature-withdrawal logic are critical contributors to performance. Notably, a 17B open-source backbone operating within CIFQA outperforms substantially larger frontier models evaluated with the same financial information, demonstrating that architectural design is a more important determinant of numerical reliability than model scale. While evaluated on fixed deposit queries, CIFQA provides a generalizable framework for calculation-intensive financial reasoning tasks.

[139] Knowledge Cards: Structured Knowledge for AI Systems cs.AI | cs.CLPDF

Liliana Ferreira

TL;DR: 本文提出了一种名为’知识卡片’的新型结构化文档构件，旨在弥补现有AI系统文档实践的不足。知识卡片以领域专家可审查、组织可审计、AI系统可推理的形式，封装了关于单个有界概念的经过验证的知识，包括涉及的实体、关系、推理逻辑、适用条件限制以及每个主张的来源。

Details

Motivation: 当前AI系统的文档（如模型卡、数据卡、系统卡）主要描述系统行为、训练数据和部署风险，但缺乏对系统内部知识层（如持有的概念、建模的关系、应用的推理模式）的结构化、可审查的表示。这对于执行决策的智能体AI系统至关重要，是概念验证迈向可靠操作解决方案的关键步骤。

Result: 论文介绍了知识卡片的初始原型，已在能源和制药领域构建。其模式规范已作为公开草案发布，以促进社区参与。

Insight: 创新点在于提出了一个填补现有AI文档空白的结构化知识表示构件，其核心是将领域知识（概念、关系、推理）形式化、可审计化，并与领域本体和专家验证深度绑定，旨在提升AI系统决策的透明度、可靠性和可问责性。

Abstract: AI systems whose outputs inform real decisions, and increasingly consequential ones, require something that current documentation practice does not provide: a structured, inspectable representation of the knowledge they need to ground, contextualize, and reason about those decisions, ideally reviewed and signed off by a domain expert. Established documentation artefacts already capture important aspects of an AI system. Model cards describe how a system behaves, data cards describe what it was trained on, and system cards describe the risks of a deployed system. None of them addresses the layer between inputs and outputs, more precisely, the concepts a system holds, the relationships it models, and the patterns of reasoning it applies. For pattern-recognition tasks this gap is tolerable. For agentic AI, where systems act on their conclusions, it is the step that most often separates a promising proof of concept from an operational solution an organisation can rely on. This paper introduces the Knowledge Card, a structured artefact that captures validated knowledge about a single bounded concept in a form that experts can review, organisations can audit, and AI systems can reason over. For one concept, such as a specific failure mode, a compliance obligation, or a process decision, a Knowledge Card records the entities and relationships involved, the reasoning that connects them, the conditions under which that reasoning no longer holds, and the provenance of every claim, all grounded in a formal domain ontology and signed off by a domain expert. Initial prototype cards have been built in the energy and pharmaceutical domains. The schema is released as a public draft for community engagement.

[140] Don’t Overthink, Don’t Underthink: Toward Adaptive Reasoning in Agentic AI cs.AI | cs.CLPDF

Md Jueal Mia, M. Hadi Amini

TL;DR: 本文指出当前基于大语言模型（LLM）的智能体AI系统中，推理控制机制（如固定的token预算）往往是静态或预先分配的，这无法适应智能体在规划、工具使用、记忆检索和交互中动态演化的任务需求，导致过度推理或推理不足的问题。论文在MATH-500和GAIA基准上评估了这两种错误模式，发现过度推理会带来高计算成本却无相应的精度提升，而推理不足则导致错误或不完整的解决方案。

Details

Motivation: 解决现有智能体AI系统中静态或预分配的推理控制机制无法适应动态任务需求的问题，以避免因推理分配不当（过度或不足）导致的计算浪费、延迟增加、规划漂移、工具滥用或解决方案不完整。

Result: 在MATH-500和GAIA公开验证基准上，使用工具决策延迟、token消耗、token限制耗尽和答案正确性等指标进行评估。结果表明，被分类为过度推理的案例与更高的计算成本相关，但未带来成比例的精度提升；而被分类为推理不足的案例则始终与错误或不完整的解决方案相关。

Insight: 论文的核心创新在于将过度推理和推理不足概念化为智能体AI中因推理分配不当而反复出现的失败模式，并进行了实证评估。这强调了下一代智能体AI的关键挑战是发展自适应的推理机制，而非仅仅关注推理量，为未来研究提供了明确的方向和评估框架。

Abstract: Recent advances in Large Language Models (LLMs) have shown that increased inference-time reasoning can improve performance on complex tasks. However, many existing approaches rely on fixed or preallocated reasoning controls, such as fixed token budgets, pre-execution difficulty estimates, or activation-space interventions, and are often evaluated on standalone reasoning benchmarks rather than full agentic workflows. These assumptions may not hold in agentic AI systems, where reasoning requirements evolve dynamically through planning, tool use, memory retrieval, and agent-to-agent interactions. Consequently, reasoning can become either excessive or insufficient, resulting in unnecessary computation, increased latency, planning drift, excessive tool use, or incomplete solutions. We argue that a major challenge for next-generation agentic AI is not merely how much reasoning a language model should perform, but how it should allocate reasoning according to evolving task demands. We characterize over-reasoning and under-reasoning as recurring failure modes of misallocated reasoning and evaluate them on MATH-500 and the GAIA public validation benchmark. Using tool-decision latency, token consumption, token-limit exhaustion, and answer correctness, our results suggest that cases classified as over-reasoning are associated with higher computational cost without proportional accuracy gains, whereas cases classified as under-reasoning are consistently associated with incorrect or incomplete solutions. These findings motivate future research on adaptive reasoning mechanisms for agentic AI.

[141] SymbolLKG: Towards Verifiable Logical Reasoning via Logical Knowledge Graph and Symbolic Solvers cs.AI | cs.CLPDF

Haizhao Fan, Yuchi Xiong, Jize Wang, Xinping Guan, Xinyi Le

TL;DR: 本文提出了一种名为SymbolLKG的神经符号架构，旨在解决大语言模型在严格多步逻辑推理中存在的幻觉和不一致问题。该框架通过构建逻辑知识图（LKG）来显式建模文本中的逻辑依赖关系，并设计了一个逻辑路由器，将任务动态调度到最优的符号求解器。

Details

Motivation: 现有方法如思维链（CoT）缺乏严格的验证机制，而标准的检索增强生成（RAG）难以捕捉逻辑任务中固有的复杂结构依赖，因此需要一种能够提供可验证推理路径的解决方案。

Result: 在逻辑推理基准测试上的实验结果表明，该框架在准确性和可验证推理路径方面显著优于最先进的提示方法和RAG基线，达到了SOTA水平。

Insight: 主要创新点在于将逻辑规则和约束作为LKG中的一等拓扑节点进行显式建模，并设计了结合拓扑感知的混合检索机制来支持动态求解器路由，从而实现了神经与符号方法的有效集成。

Abstract: Large Language Models (LLMs) have demonstrated remarkable proficiency in natural language understanding, yet they struggle with strict multi-step reasoning, frequently suffering from hallucinations and inconsistency. Existing solutions like Chain-of-Thought (CoT) lack rigorous verification mechanisms, while standard Retrieval-Augmented Generation (RAG) often misses the complex, structural dependencies inherent in logical tasks. To bridge this gap, we propose a Neuro-Symbolic architecture that integrates a Logical Knowledge Graph (LKG) with dynamic solver routing. Specifically, we introduce an ontology-based LKG that treats logical rules and constraints as first-class topological nodes, enabling explicit modeling of dependencies extracted from text. We further design a Logic Router to dynamically dispatch tasks to the optimal symbolic engine, which is supported by a topology-aware hybrid retrieval mechanism. Experimental results on logical reasoning benchmarks demonstrate that our framework significantly outperforms state-of-the-art prompting and RAG baselines, delivering higher accuracy and verifiable reasoning paths.

[142] Decoupling Planning and Control for Instructable Agents cs.AI | cs.CL | cs.MA | cs.ROPDF

Zineng Tang, Kelsey R. Allen, Sjoerd van Steenkiste, Ishita Dasgupta, Alane Suhr

TL;DR: 本文提出了一种名为Instruct-to-Act的系统，通过将预训练的视觉语言模型（VLM）规划器与基于世界模型的控制器解耦，结合了VLM的高层任务规划能力和控制器的快速低层动作执行能力。系统训练控制器根据VLM生成的稀疏、高层文本指令自主执行高频动作，并在七个具身环境中进行了评估，包括三个多智能体环境。

Details

Motivation: 现有方法中，指令调优的VLM擅长从指令和观察生成高层计划，但在陌生环境中难以可靠地将其转化为低延迟动作序列；而世界模型控制器擅长快速观察到动作的控制，但缺乏开放式的任务指导。本文旨在结合两者的优势。

Result: 在七个具身环境（包括三个多智能体环境）中，在匹配的观察和动作空间下，所提出的解耦方法一致优于仅使用控制器或直接由VLM生成动作的变体，保持了快速控制能力，并允许在不微调的情况下交换不同的预训练VLM规划器，在七项任务中的六项上与强大的视觉-语言-动作和多智能体强化学习基线具有竞争力。

Insight: 创新点在于将规划与控制解耦的架构设计，以及通过为控制器策略轨迹重新标注合成指令来训练语言可指令的控制器，同时优化行为克隆、奖励最大化和世界建模目标。这实现了高层语言规划与低层快速执行的灵活结合，提升了系统的泛化性和模块化程度。

Abstract: Recent work shows that pre-trained, instruction-tuned vision-language models (VLMs) perform well at mapping from instructions and observations to high-level plans, but struggle to realize such plans as reliable low-latency action sequences in unfamiliar environments. At the same time, world-model controllers excel at fast observation-to-action control, but lack open-ended task guidance. In this work, we combine these strengths into a single system, Instruct-to-Act, where we train a world-model controller to act autonomously at high frequency when conditioned on sparse, higher-latency, and high-level text instructions generated by a VLM planner. To train controllers to be language-instructable, we relabel segments of controller policy rollouts with synthetic instructions and jointly optimize a behavior-cloning objective along with existing reward-maximizing and world-modeling objectives. We evaluate our proposed approach across seven embodied environments, including three multi-agent environments where VLM planners coordinate through language while trained controllers serve as their actuators. Under matched observation and action spaces, our decoupled approach consistently outperforms controller-only and direct VLM action-generation variants, preserves fast control, and lets us swap in different pretrained VLM planners without fine-tuning, while remaining competitive with strong vision-language-action and multi-agent RL baselines on six of seven tasks.

[143] C-Unseen: Weak Signal Detection in Dynamic Temporal Knowledge Graphs via LLM Reasoning cs.AI | cs.CL | cs.SIPDF

Yassir Lairgi, Ludovic Moncla, Khalid Benabdeslem, Rémy Cazabet, Pierre Cléau

TL;DR: C-Unseen是一个用于动态时序知识图谱（DTKG）中弱信号检测的自解释框架。它将弱信号定义为在连续TKG快照中扩散的、语义连贯的稀有子图，通过大语言模型（LLM）的思维链推理识别与主流叙事相悖的稀有子图，并追踪其跨时间步的持续性来筛选真正的弱信号。

Details

Motivation: 现有基于关键词频率、主题建模或无类型图拓扑的弱信号检测方法，无法捕捉弱信号所体现的语义和关系结构，因此需要一种能理解语义和时序关系的检测框架。

Result: 实验结果表明，C-Unseen在弱信号检测任务上，超越了基于关键词、主题和图的基线方法。

Insight: 创新点在于将弱信号形式化为跨时间步扩散的稀有语义子图，并利用LLM的思维链推理进行语义连贯性判断，结合了符号化图结构与神经语言模型的优势进行时序模式追踪。

Abstract: Weak signals are early, low-visibility indicators that precede significant changes before those changes become established. Existing detection methods, based on keyword frequency, topic modeling, or untyped graph topology, fail to capture the semantic and relational structure through which such signals manifest. In this paper, we propose C-Unseen, a self-interpretable framework for weak signal detection in Dynamic Temporal Knowledge Graphs (DTKGs). We define a weak signal as a rare, semantically coherent subgraph that proliferates across consecutive TKG snapshots. The framework operates through two modules: a Rare Subgraphs Extractor, in which an LLM identifies subgraphs whose content is in tension with the dominant snapshot narrative via chain-of-thought reasoning, and a Weak Signal Alerter, in which the persistence of these rare subgraphs is tracked across time steps to isolate true weak signals. Experimental results demonstrate that C-Unseen outperforms keyword-, topic-, and graph-based baselines.

[144] From Atomic to Agentic: Towards Interpretable Evaluation of LLMs’ Agentic Mathematical Capabilities cs.AI | cs.CLPDF

Jiayi Kuang, Yinghui Li, Yunze Song, Keyu Chen, Zhifeng Shen

TL;DR: 本文提出了一种过程级评估基准，用于评估大语言模型（LLMs）的智能体数学推理能力，超越了传统仅关注最终答案的评估方式。该框架将问题解决的智能体行为与可复用的数学原子能力结构化分类法对齐，并通过自动化流程生成高质量轨迹和细粒度标注。实验表明，具有相似端到端准确率的模型在智能体能力分布上存在显著差异，凸显了过程级评估对于理解LLMs真实潜力和指导下一代数学智能体发展的重要性。

Details

Motivation: 现有数学基准大多仅评估最终答案，这种结果导向的评估对识别过程级失败或严谨逻辑的诊断价值有限，无法有效指导LLMs向鲁棒智能体的转变。

Result: 实验表明，在端到端准确率相似的模型之间，其智能体能力分布存在显著差异，验证了过程级评估的必要性。

Insight: 创新点在于提出了一个将智能体行为与数学原子能力分类法对齐的过程级评估框架，并设计了涵盖规划、行动和反馈任务的自动化标注流程，为LLMs的智能体数学能力提供了可解释的细粒度评估方法。

Abstract: Large Language Models (LLMs) are evolving from performing end-to-end mathematical reasoning to integrating agentic intelligence. However, most existing math benchmarks evaluate only final answers. This outcome-oriented evaluation provides limited diagnostic value for identifying process-level failures or rigorous logic, failing to guide the transformation of LLMs into robust agents. To bridge this gap, we present a process-level benchmark designed to evaluate the inherent agentic mathematical reasoning abilities of LLMs. Our framework aligns problem-solving agentic behaviors with a structured taxonomy of reusable mathematical atomic capabilities. We design a comprehensive suite of planning, action, and feedback tasks across both textual and multimodal contexts, supported by an automated pipeline that synthesizes high-quality trajectories and produces fine-grained annotations via controlled LLM rewriting. Experiments reveal that models with similar end-to-end accuracy can exhibit markedly different agentic capability profiles. This demonstrates that process-level evaluation is crucial for interpreting the true potential of LLMs and guiding the development of next-generation mathematical agents.

[145] CorporateBench: Large-Scale Q&A Benchmarking with Temporal Knowledge Bases cs.AI | cs.CL | cs.IR | cs.LGPDF

Sil Hamilton, Albert Yu Sun, Oscar J. Romero, Carl-Leander Henneking, David Mimno

TL;DR: 论文提出了CorporateBench（CB），一个大规模、人类验证的多任务问答基准，用于评估大型语言模型在企业级文档集合上的表现。该基准包含超过23万份文档，模拟了从12人到1万名员工规模的公司通信网络，并基于时间演化的知识库确保跨文档逻辑一致性。

Details

Motivation: 现有评估方法存在局限性：企业不愿分享内部通信数据，而合成数据集又过于简单，因此需要构建一个接近真实企业通信网络规模且逻辑一致的基准来评估LLM在企业文档问答中的能力。

Result: 在CB基准上评估了五个LLM，结果显示随着输入规模接近真实场景，模型性能显著下降。该基准为LLM开发者提供了衡量企业通信推理能力的指标。

Insight: 创新点在于构建了大规模、时间演化且逻辑一致的企业知识库合成基准，填补了企业级文档问答评估的空白；客观来看，其通过模拟不同公司规模和文档数量，系统性地揭示了LLM在处理大规模、时序关联企业数据时的性能瓶颈。

Abstract: LLMs are increasingly able to answer complex questions about enterprise-scale document collections. But evaluation is hard: companies don’t want to share internal communications, and synthetic datasets have been overly simple. We present CorporateBench (CB), a human-validated multi-task Q&A benchmark whose scale approaches the conditions LLMs encounter in corporate communication networks, with evaluation corpora surpassing 230,000 documents. CB evaluates LLMs across two dimensions (information extraction and knowledge base querying) through four synthetically generated firms ranging from 12 to 10,000 employees. Each corpus is sampled from a temporally evolving knowledge base describing a consistent world, guaranteeing cross-document logical consistency even across hundreds of thousands of documents. We evaluate five LLMs on CB, revealing increasingly poor performance as input size approaches realistic scales. CB provides LLM developers a metric for corporate communication reasoning, filling a crucial gap in the benchmarking ecosystem.

[146] Naive Prompt Optimization: Rethinking the Need for Complex Prompt Search cs.AI | cs.CLPDF

Yuan Chang, Xiaoqi Chen

TL;DR: 本文提出Naive Prompt Optimization（NPO），一种轻量级的单谱系提示优化方法，通过教师模型结合rollout反馈迭代修订提示。NPO在减少rollout次数的情况下，性能达到或超越了更复杂的GEPA方法，且其优势随教师模型能力增强而提升，表明更强的教师推理能力可以部分替代优化器侧的搜索复杂度。

Details

Motivation: 当前提示优化方法日益复杂化，但作者认为这种复杂性并非必要。本文旨在探索简单、线性的提示优化方法是否能够媲美更复杂的搜索过程，以高效提升自主智能体在多样化任务上的性能，加速智能体AI的递归自我改进（RSI）。

Result: 在实验中，NPO使用更少的rollout达到了与GEPA相当或更好的性能。在交互式游戏中，NPO与GEPA保持广泛竞争力，而GRPO在某些不易进行提示优化的任务上表现更好。此外，NPO优化的提示直接迁移到其他学生模型（尤其是同系列模型）时，也能带来类似的性能提升。

Insight: 核心创新在于提出并验证了简单线性提示优化方法（NPO）的有效性，挑战了当前领域对复杂搜索过程的依赖。关键洞见是：更强的教师模型推理能力可以部分替代优化器本身的搜索复杂度，这为高效、低成本的提示优化提供了新思路。

Abstract: Efficiently improving autonomous agents across diverse tasks is central to accelerating recursive self-improvement (RSI) in agentic AI, with prompt optimization emerging as a promising approach capable of delivering performance gains comparable to those achieved by fine-tuning model weights, while reducing computational costs in both optimization and serving. However, recent developments increasingly favor unnecessarily complex prompt optimizers. We introduce Naive Prompt Optimization (NPO), a lightweight single-lineage method that iteratively revises prompts using a teacher model with rollout feedback. NPO achieves comparable or better performance than GEPA with fewer rollouts, and its advantage increases with stronger teacher models, suggesting that stronger teacher reasoning can partially substitute for optimizer-side search complexity. In interactive games, NPO remains broadly competitive with GEPA, while GRPO performs better on some tasks less amenable to prompt optimization. We also show that NPO-optimized prompts elicit similar performance improvements when applied verbatim to other student models, especially across models within the same family. Overall, our preliminary results show that simple, linear prompt optimization can rival substantially more sophisticated and complex search procedures.

Table of Contents

cs.CL [Back]

[1] Recipes for Steering and Scaling LLMs via Sampling cs.CL | cs.LGPDF

[2] Training-Time Explainability for Multilingual Hate Speech Detection: Aligning Model Reasoning with Human Rationales cs.CL | cs.AIPDF

[3] TelecomGPT-R1: A Unified Open-Source Reasoner for the Telecom Stack cs.CL | cs.ITPDF

[4] Reward-Informed Sparse Autoencoders and the Solution-Completeness Confound cs.CLPDF

[5] Syntax vs. Semantics: How Transformers Learn Deep Dependencies cs.CL | cs.AIPDF

[6] Beyond Accuracy: A Qualitative Analysis of Vision-Language Models for Hate Speech Detection in Memes cs.CL | cs.AIPDF

[7] AdaThinking-E: One-Token Entropy Regulation for Adaptive Thinking cs.CL | cs.LGPDF

[8] Position Is All You Need: A Free Lunch Token Compression Strategy for MLLM-based Referring Expression Segmentation cs.CL | cs.AIPDF

[9] Why Current XAI Is Not Enough for Arabic NLP: A Critical Survey of the Explainability Gap cs.CLPDF

[10] Vagdhenu: A Vrutta (Meter) Aware Shloka-to-Chant (TTS) System for Sanskrit cs.CLPDF

[11] CARE: Causally-Aligned Reasoning Exploration for Medical Large Language Models cs.CL | cs.CVPDF

[12] Towards Interpretable Depression Detection: Linking Acoustic Features to DSM-5 Indicators cs.CL | cs.SD | eess.ASPDF

[13] VFA: Empowering Multilingual MLLMs via Vision-Free Adaptation cs.CL | cs.AIPDF

[14] Mutual Debiasing via Dual-Seed Comparison for Probabilistic Sampling in Large Language Models cs.CL | cs.AIPDF

[15] From Sound to Symptom: Real-Time Respiratory Signal Understanding for Conversational Healthcare Agents cs.CL | cs.AI | cs.HC | cs.MA | cs.SDPDF

[16] Lost in Compression: A Controlled Cross-Lingual Audit of Extractive Prompt Compressors cs.CL | cs.AIPDF

[17] When the Canonical Completion Is Wrong: Formalizing and Measuring the Jump in Large Language Models cs.CL | cs.AI | cs.LG | cs.LOPDF

[18] A Reranker for Orchestrating Heterogeneous Speech and Text Retrievers cs.CL | cs.AI | cs.IRPDF

[19] Neuro-symbolic PRM: Enhancing Scientific Reasoning via Structured Traces and Symbolic Verification cs.CLPDF

[20] Cross-lingual Representation Learning via Centroid Intervention Fusion cs.CLPDF

[21] Survival-Guided Length Control for Efficient Diffusion Language Models cs.CLPDF

[22] Co-Evolving Structured Knowledge and Reasoning in Language Models cs.CL | cs.AI | cs.LGPDF

[23] Case2Flow: Bridging Patient Cases and Guideline Flowcharts through Multimodal Retrieval cs.CL | cs.IRPDF

[24] SPEAR: Distilling Domain-Adaptive Reasoning Skeletons via Sequential Symbolic Alignment in Reinforcement Learning cs.CLPDF

[25] SPT: Skills as Pre-Training Data for Agentic Language Models cs.CLPDF

[26] Dependency-Aware Revocable Decoding for Efficient Diffusion Large Language Model Inference cs.CLPDF

[27] Surgical Alignment in Knowledge Graph Training for Clinical Diagnosis with Large Language Models cs.CLPDF

[28] Not Just Reason, Not Just Scan: Reinforcement Learning for Proactive Scientific Error Verification over Academic Paper cs.CLPDF

[29] Information-Guided Frontier Decoding: Contextual Utility-Driven Commitment in dMLLMs cs.CLPDF

[30] Do LLMs Understand Personality? Rethinking Persona Fidelity Evaluation through Structured Behavioral Inference cs.CL | cs.AIPDF

[31] Scaling phoneme-based TTS augmentation for ASR: A unified pipeline and controlled study cs.CLPDF

[32] Towards Expert Financial QA via Self-Improving RAG cs.CLPDF

[33] Preserving General Capabilities during Domain Specialization with Uncertainty-Calibrated MOPD cs.CLPDF

[34] Letters hide the truth from our eyes: English homophones have meaningfully different phonetic realizations cs.CLPDF

[35] RuleWeaver: Benchmarking Rule-Centered Scenario Reasoning for Large Language Models cs.CLPDF

[36] Behavior2Trip: Towards Personalized Travel Planning via User Behavior Trajectory cs.CL | cs.AIPDF

[37] Mapping Written Words to Spoken Words in a Different Language Using Only Visual Grounding cs.CL | eess.ASPDF

[38] JudgeStealer: Extracting LLM Judging Capabilities across Evaluation Protocols cs.CLPDF

[39] Reasoning about In-Context Samples for Machine-Translation cs.CLPDF

[40] Cascaded Batch Prompting cs.CLPDF

[41] DocTalkBN: A Novel Dataset of Expert Telemedicine Conversations in Bengali cs.CLPDF

[42] Said Aloud, Read Different: Cross-Modal Instability in Multimodal Models cs.CLPDF

[43] When Text Misleads: Inconsistent-Aware Reasoning for Audio-Grounded Dialogue cs.CL | cs.AI | cs.LG | eess.ASPDF

[44] BALMS: Benchmarking Agentic LLMs for Longitudinal Mental Health Sensing cs.CLPDF

[45] SCIT: Testing Causal Cache Carriers in Latent Chain-of-Thought Models cs.CLPDF

[46] BTS-AgentBench: A Deterministic, Replayable Pipeline from Read-Only Telemetry Logs to Agent Benchmarks cs.CL | cs.SEPDF

[47] INTENT-AS-A-TOOL Makes it Easy to Track Agentic Misalignment cs.CLPDF

[48] RCMN: Understanding Misleadingness in Influential Public Discourse cs.CL | cs.AIPDF

[49] RATIO: A Benchmark for Retrieval Across Typed Ideation Operations in Scientific Literature cs.CL | cs.IRPDF

[50] Consolidating RLVR Capabilities Across Domains: A Deep Dive into Fusion Paradigms cs.CLPDF

[51] Boosting LLM Exploration via Weak-Model Guidance in RLVR cs.CLPDF

[52] CritICL: Inference-Time Weak-to-Strong Generalization from Small Language Model Failure Modes cs.CLPDF

[53] TTPO: Test-Time Policy Optimization cs.CLPDF

cs.CV [Back]

[54] Surgical Video Generation From Diffusion to World Models: A Survey cs.CVPDF

[55] Modality Maturity Index: A benchmark for assessing multimodal capabilities of omni models cs.CV | cs.AI | cs.MMPDF

[56] Procedura: Agentic 3D Modeling with Procedural Control cs.CV | cs.GRPDF

[57] Finding the Right Evidence: Factor-Guided Coarse-to-Fine Reasoning for Long Videos cs.CV | cs.LGPDF

[58] VIPER: An Expert-Curated Benchmark for Vision-Language Models in Veterinary Pathology cs.CVPDF

[59] Zero-Shot Video Restoration and Enhancement with Text-to-Image Latent Diffusion Models and Multi-Modal References cs.CVPDF

[60] Video-FLAIR: Not Whether to Reason, But How cs.CVPDF

[61] Systematic Literature Review of Machine Learning Models and Applications for Text Recognition cs.CV | cs.LGPDF

[62] NeuDonatello: Uncertainty-Aware Framework for Accurate Neural SDF Learning cs.CVPDF

[63] HUG-VIS: A Multimodal Benchmark for Human-centered Understanding and Generation in Visual Intelligence cs.CVPDF

[64] Visual Information-Guided Parallel Decoding for Diffusion Multimodal Large Language Models cs.CV | cs.CLPDF

[65] FAN-LoRA: A Fourier-Adaptive Nonlinear Low-Rank Adaptor for Medical Foundation Model Domain Adaptation cs.CVPDF

[66] DPA-I2P: Depth-Guided Projective Alignment for Image-to-Point-Cloud Registration in Autonomous Driving cs.CVPDF

[67] Who Remains, What Changes: Identity Anchored Composed Gait Retrieval cs.CVPDF

[68] Tissue-Mixture Entropy-Weighted Reconstruction for Partial-Volume-Aware Brain MRI Super-Resolution cs.CVPDF

[69] RECAP-Forcing: Retaining Content Appearances for Long Video Generation cs.CVPDF

[70] Hull First, Wake Second: Wake-Reliance Suppression for Robust Maritime Vessel Detection cs.CVPDF

[71] Reason in the Words You Speak: Idiolectal Paraphrasing Off-Policy Traces for Reasoning Distillation in VideoLLMs cs.CVPDF

[72] LiveVVT: High-Fidelity Video Virtual Try-On in Real Time cs.CV | cs.AIPDF

[73] AesCanvas: A Large-Scale Dataset and Benchmark for Aesthetic Critique and Contextual Suitability cs.CV | cs.AIPDF

[74] Beyond Atomic Layouts: Compositional Design Understanding with Vision-Language Models cs.CVPDF

[75] Parameter Efficient Continual Learning for Sparse Event-Based Transformers cs.CVPDF

[76] UniGeo: A Multi-modal Large Language Model for Text-Guided Cross-View Geo-Localization cs.CVPDF

[77] GeoMAD: Geometry-Aware Multi-View Anomaly Detection via Deformable Fusion and Distributional Alignment cs.CVPDF