cs.CL [Total: 22]
cs.CV [Total: 43]
stat.ML [Total: 1]
math.NT [Total: 1]
eess.IV [Total: 2]
cs.LG [Total: 1]
eess.AS [Total: 2]
cs.MA [Total: 1]
cs.GR [Total: 1]
cs.RO [Total: 4]
cs.IR [Total: 1]
cs.AI [Total: 5]
cs.SD [Total: 1]

cs.CL [Back]

[1] Auditable Emergency Triage for Maternal and Newborn Care in India cs.CL | cs.AI | cs.CYPDF

Shobhit Jagga, Aman Dalmia, Niharika Priyadarshini, Neelima Devadas, Amrita K Prasen

TL;DR: 该论文介绍了一个用于印度孕产妇和新生儿护理的紧急分诊系统，该系统结合了大型语言模型（LLM）和确定性规则引擎。LLM负责从查询中提取标准化的症状和患者背景信息，而规则引擎则基于临床专家制定的规则来判断是否为紧急情况。该系统显著提高了召回率和F1分数，并提供了可审计性，允许临床专家检查和修改系统的各个阶段。

Details

Motivation: 为了解决现有基于LLM的分诊系统不透明、难以分析错误、提示词更改成本高且操作困难的问题，以及弥补临床决策树未被系统化记录和利用的缺陷。

Result: 新系统将紧急分诊的召回率从0.565提升至0.810，F1分数从0.606提升至0.702。部署后已处理152,421条患者查询，标记了28,535条（18.7%）为紧急情况，误报率为17.8%，且未增加漏报。

Insight: 将LLM的任务分解为信息提取（使用临床术语）和基于确定性规则的决策两个步骤，实现了性能提升与系统可审计性的结合。结构化规则是准确率提升的主要驱动力，同时允许临床专家独立添加新规则而无需进行昂贵的全系统评估，形成了一个快速的修正循环。

Abstract: At Noora Health, our nurses answer more than 50,000 medical queries per month on our WhatsApp-based service that provides caregivers with on-demand support. Their most time-critical task is emergency triage: deciding which queries need immediate in-person attention. To support them, we built a system that uses a large language model (LLM) to classify whether a message is an emergency and provide a rationale for interpretability. But the system was opaque: analyzing mistakes meant reading reasoning chains for each message, which is infeasible at our scale. Prompt changes meant re-running a full evaluation to prevent regressions, which was both costly and operationally challenging. Clinicians follow a decision tree to make this call, but it was never documented or passed to the model, which relied on a flat list of danger signs. To address these issues, we decomposed triage into two steps: an LLM extracts canonical symptoms and patient context from the query using a clinician-authored vocabulary, and a deterministic rule engine captures the scenarios that indicate an emergency. We show that the new system raised recall from 0.565 to 0.810 and F1 from 0.606 to 0.702, with structured rules driving most of the accuracy gains while the decomposition provides auditability: clinical experts can inspect each stage of the new system to see whether the query was mistranslated, symptoms were incorrectly extracted, patient context was wrongly inferred, or the necessary rules were missing. They can add new rules independently without causing regressions and avoid running costly evaluations. Since deployment, the new system has triaged 152,421 patient queries and flagged 28,535 (18.7%) as emergencies. The over-escalation rate has been 17.8%, without any increase in missed emergencies. Clinicians have also added 48 new rules since deployment, evidence of the faster correction loop we set out to build.

[2] SWORD: Wikidata-based Distortions Reveal Hidden Cross-Lingual Inconsistencies in LLM Factual Error Rejection cs.CLPDF

Sanghyeok Park, Minji Kang, Hosung Kwak, Jinhyuk Yun

TL;DR: 该论文提出了SWORD基准测试，通过系统性地扭曲Wikidata三元组生成多语言事实错误陈述，评估大语言模型在不同语言间拒绝事实错误的一致性。研究发现模型在语义合理的扭曲上表现优于随机替换，且对东亚语言处理存在显著性能下降，揭示了传统基准测试无法捕捉的多语言事实推理不对称性。

Details

Motivation: 针对现有基准测试主要奖励正确答案选择而非评估真实事实理解能力的问题，旨在开发一种能够系统评估模型跨语言事实错误拒绝一致性的方法。

Result: 在八个广泛使用的语言上进行测试，发现模型在语义合理扭曲上的准确率高于随机替换，且某些模型在东亚语言上的性能下降高达28个百分点（相对减少49%），揭示了传统聚合准确率指标掩盖的跨语言性能差距。

Insight: 创新点在于通过受控的Wikidata三元组扭曲构建多语言事实错误检测基准，关键发现是模型更依赖分布熟悉度而非真实事实验证，且多语言能力存在不对称性，这为评估模型的事实理解提供了新视角。

Abstract: Modern LLMs demonstrate impressive multilingual performance, yet standard benchmarks primarily reward selecting correct answers rather than evaluating genuine factual understanding. We introduce Systematic Wikidata-based Object-Relation Distortion (SWORD), a benchmark that evaluates whether models consistently reject factual errors across languages. SWORD generates syntactically well-formed but factually incorrect statements in eight widely spoken languages through controlled perturbations of Wikidata triples, ranging from random entity substitutions to semantically plausible property-based selections. Our distortion-based evaluation surfaces two critical insights that remain entirely obscured by conventional benchmarks. First, models counterintuitively achieve higher accuracy on semantically plausible distortions than on nonsensical random substitutions, suggesting reliance on distributional familiarity rather than genuine factual verification. Second, models exhibiting comparable baseline accuracy across languages show substantial performance degradation specifically on (East) Asian languages when presented with distorted statements, with cross-lingual performance gaps reaching up to 28 percentage points (49% relative reduction) in some models. These findings demonstrate that multilingual factual reasoning involves asymmetric capabilities that aggregate accuracy metrics systematically obscure.

[3] Benchmarking Hybrid Deep Research Across Database Querying and Web Search cs.CLPDF

Ruofan Wu, Peiran Xu, Xiaolong Li, Fan Shu, Soyoung Yoon

TL;DR: 本文介绍了首个需要结合网络搜索和SQL查询的深度研究基准测试HybridDeepResearch，旨在评估智能体在结构化与非结构化信息空间之间进行约束保持的‘交接’能力。该基准包含380个基于真实数据库和公共网络语料的任务，涵盖三种推理模式，实验表明即使是顶尖模型在困难子集上的表现也仅约50-54%。

Details

Motivation: 现实世界中的复杂分析任务通常需要智能体同时处理模糊的非结构化文本（如开放网络）和精确的结构化数据（如关系数据库），而现有基准测试孤立地评估这些模态，未能捕捉跨系统传递证据时的约束保持能力。

Result: 在多种智能体框架下对专有和开源模型进行评估，结果显示即使是GLM-5.2、Claude-Sonnet-4.6和GPT-5等最先进模型，在困难子集上的Pass@8指标也仅达到约50-54%。定向推理（如SQL2S、S2SQL）比并行交叉推理（Parallel）困难得多。

Insight: 论文的创新点在于构建了首个融合网络搜索与数据库查询的混合深度研究基准，强调了跨模态信息‘交接’中约束保持的关键挑战；客观来看，该基准为评估智能体在真实混合环境中的推理能力提供了标准化测试平台，揭示了当前模型在结构化与非结构化信息融合方面的显著不足。

Abstract: While autonomous agents have made significant strides in “deep research” by iteratively navigating the open web to synthesize information, real-world problem-solving is rarely confined to a single environment. Complex analytical tasks inherently require agents to weave together evidence from both ambiguous unstructured text (e.g., the open web) and highly precise structured data (e.g., relational databases). However, existing benchmarks evaluate these modalities in isolation, failing to capture the critical “handoff” - the ability to preserve constraints when moving evidence between systems. We introduce HybridDeepResearch, to our knowledge the first deep-research benchmark that requires both web search and SQL to form a complete, verifiable answer. The benchmark contains 380 tool-dependent tasks grounded in LiveSQLBench-Base-Lite databases and public web corpora, validated through automated checks and human review, and covering three reasoning patterns: SQL2S, S2SQL, and Parallel. Evaluations across proprietary and open-weight models under various agentic scaffolds reveal that even state-of-the-art models like GLM-5.2, Claude-Sonnet-4.6 and GPT-5 achieve only about 50-54% Pass@8 on the hard subset. Notably, results show that directional reasoning is substantially more difficult than parallel intersection, highlighting that bridging structured and unstructured information spaces without losing constraints remains a major open challenge for agentic systems. Code and datasets are publicly available at GitHub (https://github.com/Snowflake-AI-Research/HybridDeepResearch) and Hugging Face (https://huggingface.co/datasets/Snowflake/HybridDeepResearch).

[4] SEA-SpeechBench: A Large-Scale Multitask Benchmark for Speech Understanding Across Southeast Asia cs.CLPDF

Jingyi Liao, Wenyu Zhang, Zhuohan Liu, Yingxu He, Geyu Lin

TL;DR: 本文介绍了SEA-SpeechBench，这是一个针对东南亚11种语言的大规模多任务语音理解基准测试，包含97,194个样本、99个评估集和597小时的音频数据，涵盖语音处理、副语言分析和时间理解三大类共9项任务。评估显示，现有开源和专有系统在时间理解、情感识别和语音翻译等任务上表现不佳，尤其是在缅甸语和泰米尔语等低资源语言上，性能落后英语高达41个百分点。

Details

Motivation: 当前音频和多模态大语言模型的评估框架主要围绕英语，导致东南亚语言严重缺乏代表性，因此需要构建一个全面的多语言基准来评估和推动包容性模型发展。

Result: 在SEA-SpeechBench上对领先系统进行评估，发现所有模型在时间理解、情感识别和语音翻译任务上表现均不理想，且低资源语言的提示性能显著落后于英语。

Insight: 创新点在于首次构建了大规模、多任务、覆盖11种东南亚语言的语音理解基准，并引入了‘时间理解’这一新颖维度，涉及带时间戳的内容查询和长达3分钟音频序列的时序定位，为多语言语音模型评估提供了关键工具。

Abstract: The rapid advancement of audio and multimodal large language models has unlocked transformative speech understanding capabilities, yet evaluation frameworks remain predominantly English-centric, leaving Southeast Asian (SEA) languages critically underrepresented. We introduce SEA-SpeechBench, to the best of our knowledge, the first large-scale multitask benchmark that evaluates speech understanding in 11 SEA languages through 97,194 samples across 99 evaluation sets and 597 hours of curated audio data. Our benchmark comprises 9 diverse tasks across 3 categories: speech processing (automatic speech recognition, speech translation, spoken question answering), paralinguistic analysis (emotion, gender, age, speaker recognition), and temporal understanding, a novel dimension featuring timestamped content queries and temporal localization within extended audio sequences up to 3 minutes. We implement multilingual prompting in both native SEA languages and English to reflect user interactions with audio-language models. Evaluation of leading open-source and proprietary systems reveals marked performance gaps. Across all models, performance remains underwhelming on temporal understanding, emotion recognition, and speech translation. Prompting in low-resource languages such as Burmese and Tamil lags behind English by up to 41 percentage points. Our findings expose critical model limitations and underscore the need for inclusive model development. The SEA-SpeechBench benchmark is available at https://zwenyu.github.io/SEA-SpeechBench/.

Jianing Wang, Xintao Wang, Aili Chen, Jie Shi, Hongcheng Guo

TL;DR: 本文提出SocialRL框架，通过多轮强化学习和奖励设计来提升大语言模型的社会智能。该方法采用PPO算法传播延迟结果奖励以实现长期规划，并设计了六个过程奖励维度（如目标推进、关系协调等）来平衡目标与关系间的张力。实验表明，SocialRL在多个社交对话基准上平均提升目标达成率9.2个百分点。

Details

Motivation: 现有强化学习方法优化单轮话语和稀疏结果奖励，导致策略短视，难以在多轮交互中处理目标与关系间的张力。

Result: 在多个社交对话基准测试中，SocialRL相比基础模型平均提升目标达成率9.2个百分点，在合成和真实社交场景以及标准与挑战性社交情境中均有效。

Insight: 创新点包括应用多轮强化学习进行长期规划，以及设计多维过程奖励和阶段感知权重调度来动态平衡目标与关系；客观分析认为其奖励模型的细粒度评分和时序权重调整机制具有借鉴意义。

Abstract: Social intelligence enables agents to read social context, infer intent, and adapt over sustained dialogue. As language models become autonomous collaborators, it is central to building effective and trustworthy human-AI interaction. Existing reinforcement learning methods optimize single-turn utterances and sparse outcome rewards, producing short-sighted policies that struggle to manage goal-relationship tensions across multi-turn interactions. We propose SocialRL, a multi-turn reinforcement learning framework addressing both challenges. First, we apply multi-turn reinforcement learning using PPO that propagates delayed outcome rewards back to each turn, enabling long-horizon planning. Second, we design six process reward dimensions capturing the goal-relationship trade-off, including goal advancement, relational attunement, contextual coherence, etc. A reward model dynamically generates fine-grained scoring criteria for each dimension, while a stage-aware weight schedule prioritizes relationship-building in early turns, goal advancement mid-way, and balanced closure late. Across multiple social-dialogue benchmarks, SocialRL improves Goal Achievement by an average of 9.2 percentage points over the corresponding Base models. These results demonstrate the effectiveness of SocialRL across synthetic and real social scenes, as well as standard and challenging social scenarios.

[6] Which Medical Questions Deserve Rationales? Perturbation-Sensitive Selection for Robust QA cs.CL | cs.AIPDF

Yuexin Wu, Dayou Yu, Vasile Rus

TL;DR: 该论文研究了在医学问答任务中，如何在有限的标注预算下，优先选择哪些已标注答案的问题来获取高质量的推理依据（rationale）监督。作者提出了一种基于扰动的样本优先级排序方法（RMS-RSP），该方法通过扰动推理依据对应的隐藏状态来评估样本对模型决策边界的影响，从而选择能提升模型鲁棒性的样本进行监督。

Details

Motivation: 医学问答数据集中高质量的推理依据（rationale）通常稀缺、有噪声或验证成本高昂。因此，研究动机从“应该标注哪些问题”转变为在固定标注预算下，“应该为哪些已标注答案的问题提供推理依据监督”，以更高效地利用监督资源。

Result: 在五个医学QA数据集和MedGemma-4B-IT模型上的实验表明，在固定预算下，RMS-RSP方法的平均准确率（60.61%）略高于随机选择（60.08%），但仅在AfriMed-QA数据集上取得了统计显著的增益（+1.44%）。然而，在答案选项重新排序的鲁棒性测试中，RMS-RSP将鲁棒准确率和语义一致性分别平均提升了1.91和2.85个百分点，且在五个数据集上表现一致。

Insight: 论文的创新点在于将样本选择问题从答案标注转向推理依据监督，并提出了基于推理依据局部边界敏感性的优先级排序方法（RMS-RSP）。核心洞察是，选择那些对模型决策边界在语义等价扰动下敏感的样本进行推理依据监督，能有效提升模型对格式变化的鲁棒性，而非单纯追求准确率提升。这为在有限监督资源下构建更稳健的模型提供了新思路。

Abstract: Medical question-answering datasets often contain answer labels, whereas high-quality rationales remain scarce, noisy, or costly to validate. This changes the acquisition question: rather than asking which questions should be labeled, we ask which already-labeled questions should receive rationale supervision under a fixed token budget. We study an offline version of this problem in which candidate rationales are visible to the selector but withheld from downstream training unless selected. We propose root-mean-square Robustness-based Sample Prioritization (RMS-RSP), which perturbs hidden states only at rationale tokens and measures the resulting shift in the gold-versus-best-distractor margin. Across five medical QA datasets, MedGemma-4B-IT, three training seeds, ten budgeted non-RSP selectors, and an unbudgeted full-supervision reference, RMS-RSP provides a deliberately qualified result. Its locked-budget accuracy is 60.61% on average versus 60.08% for Random, with a statistically resolved gain only on AfriMed-QA (+1.44 points). Its full-budget accuracy area is not better than Random. However, after three answer-option reorderings, RMS-RSP improves robust accuracy and semantic consistency by 1.91 and 2.85 points on average, respectively, with the same direction on all five datasets. Training on every pool rationale raises macro accuracy to 63.74%, but consumes 29–254 times more rationale tokens and does not uniformly improve robustness. These findings do not establish universal accuracy gains; they instead suggest that rationale-local boundary sensitivity can identify supervision that improves invariance to semantically equivalent formatting changes.

[7] CARRE: Counterfactual Action Retrieval and Reason Evaluation for Explainable Churn Prescription cs.CLPDF

MinJoo Kim, SanJin Park, SeungHwan Cho

TL;DR: 本文提出了CARRE框架，用于客户流失预测中的可解释性挽留处方。该框架通过检索增强的候选生成、成本感知的反事实评分和大型语言模型推理，为高风险客户推荐具体的挽留行动并生成解释。

Details

Motivation: 现有流失模型仅识别高风险客户，但无法指定应采取何种可行的挽留行动及其原因，CARRE旨在解决这一可解释性行动推荐问题。

Result: 在IBM Telco Customer Churn数据集上，CARRE相比SHAP基线在313个高风险测试案例中实现了79.8%更高的平均模型预测风险降低，成本归一化效率比普通SHAP高10.5%。在136个案例的评估中，诊断驱动的提示优化将弱标签一致性从79.4%提升至90.4%。

Insight: 创新点在于将检索、基于模型的反事实评分和语言生成分离并联合评估，构建了一个可解释的流失处方原型流程，同时通过成本感知和反事实分析提高了行动推荐的实用性和可解释性。

Abstract: Churn models typically identify high-risk customers but do not specify which feasible retention action should be considered or why that action is appropriate. We present CARRE (Counterfactual Action Retrieval and Reason Evaluation), a three-stage framework that combines retrieval-augmented candidate generation, cost-aware counterfactual scoring, and large language model (LLM) reasoning. CARRE retrieves a predefined catalog of retention actions, estimates model-predicted churn-risk changes under explicit feature transformations, and generates a structured churn reason and a profile-grounded explanation for the selected action. On the IBM Telco Customer Churn dataset, CARRE achieves 79.8% greater mean model-predicted risk reduction than the plain SHAP baseline and 80.4% greater reduction than the cost-controlled SHAP+Cost baseline across 313 high-risk test cases; its cost-normalized efficiency is 10.5% higher than that of plain SHAP. On a 136-case reason-stratified evaluation sample, diagnosis-driven prompt refinement increases weak-label agreement from 79.4% to 90.4%, with no auxiliary-plan constraint violations; because the same sample was used for error diagnosis and re-evaluation, the post-refinement result is not an independent estimate of generalization. For 135 explanations generated using the pre-refinement v2 reason outputs, two cross-vendor LLM judges assign mean scores ranging from 4.02 to 5.00 out of 5, although one judge saturates on actionability, and a deterministic audit finds no contradictions among 66 verifiable profile claims. Retrieval ablations show that k=5 provides the best evaluated compromise between high candidate coverage and downstream reasoning agreement in this dataset. These results illustrate how retrieval, model-based counterfactual scoring, and language generation can be separated and jointly evaluated in a prototype churn-prescription pipeline.

[8] $S^3$-Bench: Evaluating Speech Interaction Models as Scientific Voice Assistants cs.CLPDF

Heyang Liu, Jiayi Huang, Wenyang Xiao, Ziyang Cheng, Lixin Zhang

TL;DR: 该论文提出了S^3-Bench，一个用于评估语音交互模型在科学领域能力的系统性评测框架。该框架覆盖10个主要学科，包含用于语音问答的知识集和用于与模拟用户代理进行多轮渐进式交互的对话集。通过将单轮交互分解为语音识别、感知、知识推理利用和响应发音等阶段，论文系统性地分析了现有方法的常见挑战与性能权衡。

Details

Motivation: 尽管多模态大语言模型（MLLMs）作为通用语音助手表现出色，但其在科学等专业领域的性能仍未得到充分探索。科学交互涉及罕见技术术语、缩写口语规范以及符号表达式的自然口语化，带来了巨大挑战。

Result: 实验表明，现有方法在科学语音交互中面临共同挑战和性能权衡。多轮交互实验进一步揭示了模型在用户适应以及生成准确、全面、高效响应方面存在持续局限性。

Insight: 论文的主要创新点在于构建了一个针对科学语音助手能力的系统性、多阶段评测基准（S^3-Bench），它将复杂的语音交互分解为可分析的子任务，从而能够更细致地诊断模型在专业领域的瓶颈，特别是对技术术语和符号表达的处理能力。

Abstract: The advance of multimodal large language models (MLLMs) has fundamentally reshaped the paradigm of human-computer interaction, especially speech interaction models capable of seamless conversations. Despite remarkable performance as general voice assistants, their performance in specialized domains remains underexplored, particularly in scientific areas. Scientific interactions introduce formidable challenges, involving rare technical terminology, spoken norms of abbreviations, and the natural verbalization of symbolic special expressions. In this paper, we introduce S$^3$-Bench, a systematic evaluation framework covering 10 major disciplines, consisting of a Knowledge set for speech question-answering and a Dialogue set for multi-turn progressive interactions with simulated user agents. By decomposing a complete atomic turn into stages of speech recognition, perception, knowledge utilization with reasoning, and response pronunciation, we systematically characterize the common challenges and performance tradeoffs of existing approaches. Furthermore, experiments on multi-turn interactions reveal persistent limitations in user adaptation and the generation of accurate, comprehensive, and efficient responses.

[9] When Does Defendant Statement Matter? A Study of Bias and Persuasion in LLM-Simulated Jurors cs.CL | cs.CYPDF

Cho-Ying Wu

TL;DR: 本文研究了LLM模拟陪审员在普通法陪审团审判中的决策行为，重点关注被告的法庭陈述何时以及如何影响判决，涉及说服力、意识形态偏见和基于背景的亲和力。作者引入了JuryBench基准，包含美国刑法中的争议性刑事案件，并模拟了不同意识形态背景的陪审员对20个前沿LLM的决策进行分析。

Details

Motivation: 动机是探索LLM在模拟人类专业决策（特别是陪审团审判）中的行为，目前这一领域尚未充分研究，旨在分析被告陈述对LLM模拟陪审员的影响，包括偏见和说服因素。

Result: 研究基于JuryBench基准，生成了432K个决策和理由，量化了判决严重性的变化。结果显示，LLM陪审员模拟与人类陪审员发现一致：情感说服可能有害，背景匹配是比孤立因素更强的影响因素，陪审员对相反背景被告更严厉、对相同背景更宽容，且意识形态强烈影响严重性判断。

Insight: 创新点在于引入JuryBench基准来系统评估LLM在陪审团模拟中的行为，揭示了LLM模拟中存在的偏见和说服效应，强调了使用LLM建模陪审团推理的潜力和风险，为相关评估提供了数据和方法支持。

Abstract: LLMs have been used to simulate human decision-making in professional settings, yet their behaviors in common-law jury trials remain unexplored. We study when and how a defendant’s courtroom statement affects LLM-simulated jurors, focusing on persuasion, ideological bias, and background-based affinity. To support the analysis, we introduce JuryBench, a benchmark containing controversial criminal cases in U.S. criminal law. In each case, a defendant can claim various plausible justifications to support acquittal or reduced liability. We fix the base case and design defendants of different backgrounds, who give courtroom statements with varying emotional appeal or rebuttal. Jurors with diverse ideological profiles across the spectrum are simulated. We examine 20 frontier LLMs, resulting in a total of 432K decisions and rationales, and quantify changes in verdict severity. Our findings show that LLM-jury simulation echoes many human-jury findings. First, emotional persuasion can be detrimental, since jurors may perceive it as evidence of guilt or inconsistency. Next, we show that background fit between jurors and defendants is a stronger and significant factor than other isolated factors, and that jurors are in general harsher toward opposite-background defendants and lenient toward same-background ones. Finally, we find that juror ideology also strongly shapes severity judgments. These findings highlight both the promise and risks of using LLMs to model jury reasoning and call for careful evaluation. The data and code are available at https://github.com/choyingw/JuryBench

[10] Improving Cross-Lingual Token Representations by Adding a Pinch of SALT cs.CL | cs.AIPDF

Guillem Ramírez

TL;DR: 本文提出了一种名为SALT的轻量级后训练方法，旨在通过注入跨语言span级监督信号来改进现有句子编码器的token表示能力。该方法在五个多语言token级基准测试中，在四个任务上取得了最佳整体性能，同时提升了句子级跨语言检索和分类任务的性能。

Details

Motivation: 现有跨语言句子编码器主要针对句子级对齐训练，但在实际应用中越来越多地被用于token级任务（如幻觉检测和序列标注），导致训练与使用之间存在不匹配问题。

Result: 在五个多语言token级基准测试中，SALT在四个任务上取得了最佳整体结果，优于其他微调策略和竞争性编码器，同时在跨语言检索和分类任务上也提升了句子级性能。

Insight: 创新点在于提出了一种轻量级的后训练方法，通过引入span级监督信号来增强token表示，这证明了span级监督是改进token和句子表示的有效信号，且方法无需从头训练模型，具有高效性。

Abstract: Cross-lingual sentence encoders enable scalable transfer across hundreds of languages, powering applications such as translation mining and zero-shot learning in low-resource settings. Although trained for sentence-level alignment, they are increasingly also applied to token-level tasks such as hallucination detection and sequence tagging, exposing a mismatch between training and usage. We propose SALT, a lightweight post-training method that improves token representations by injecting span-level supervision into existing sentence encoders. Across five multilingual token-level benchmarks, SALT achieves the best overall results on four of them, outperforming alternative fine-tuning strategies and competitive encoders. It also improves sentence-level performance on cross-lingual retrieval and classification tasks. These results demonstrate that span-level supervision is an effective signal for improving both token and sentence representations.

[11] VLX-VR: An Agentic-Aware Video Reasoning Model cs.CL | cs.CVPDF

Sheng Li, Peng Liu, Qianqian Zhang, Tiancheng Zhao

TL;DR: 本文提出了VLX-VR，一种基于智能体感知的视频推理模型，它通过一个Think-Memory-Observation循环框架来动态整合视频中的多模态证据（视觉、音频、文本、时序）。该模型使用强化学习训练，能够自主决定证据获取、内存读写和推理终止，在MINERVA基准测试上取得了最先进的性能。

Details

Motivation: 解决现有视频理解方法通常使用固定视频上下文和单次推理的局限性，当观察信息不完整、模糊或冲突时，无法自适应地获取证据。

Result: 在MINERVA基准测试上，VLX-VR取得了78.79%的准确率，达到了比较模型中的最先进水平（SOTA）。在正确回答的样本中，96.20%的推理轨迹与MINERVA参考轨迹一致。

Insight: 创新点在于提出了一个基于智能体感知的循环推理框架（Think-Memory-Observation），使模型能够像智能体一样主动规划、记忆和观察，从而动态地整合多模态证据进行推理。这为构建更灵活、鲁棒的视频理解系统提供了新思路。

Abstract: Real-world video understanding requires integrating visual, audio, textual, and temporal evidence distributed across a video. Yet many pipelines use a fixed video context and single-pass inference, limiting adaptive evidence acquisition when observations are incomplete, ambiguous, or conflicting. We present VLX-VR, an agentic-aware video reasoning model trained within a video reasoning framework defined by a Think–Memory–Observation loop. At each step, VLX-VR determines the needed evidence, invokes read_memory or write_memory, incorporates the returned Observation, and decides whether to continue or produce the task output. We train VLX-VR with multimodal data, including videos and agent trajectories, using reinforcement learning to learn evidence acquisition, memory use, and termination. On MINERVA, VLX-VR achieves state-of-the-art performance among the models included in our comparison, with 78.79% accuracy. Under the original three duration groups, its accuracies are 76.70%, 78.73%, and 80.92%, with a cross-duration accuracy variance of 2.97~$\mathrm{pp}^2$. On correctly answered samples, 96.20% of VLX-VR’s reasoning traces are consistent with the MINERVA reference reasoning traces and the evidence described by them, while approximately 75.80% of all evaluated samples satisfy both answer correctness and this evidence-grounded trace criterion. These results show strong performance and broadly stable behavior across durations, while counting, state changes, causal reasoning, and spatial perception remain challenging.

[12] Stable Answers, Unfinished Reasoning: Why Self-Consensus Is Not a Safe Early-Exit Signal cs.CLPDF

Yunxiang Mo, Donghao Zhao, Hejia Geng

TL;DR: 本文研究了在推理模型中使用自我共识（self-consensus）作为早期退出信号以降低推理成本的可行性。通过大规模实验分析，发现自我共识信号存在共识-终止差距，无法安全地判断推理是否完成，导致模型在未完成推理时提前停止，产生错误答案。相比之下，基于边界置信度的控制方法（DEER）表现更优。

Details

Motivation: 动机是探索一种自然且节省计算资源的方法，通过重复探测单个部分推理轨迹的当前答案，并在答案一致时停止（即自我共识），以降低推理模型的成本。

Result: 在三个基准测试和两个模型上的3,520条共识规则实验中，自我共识方法未能通过预先设定的三个安全接受门槛；而DEER方法则全部通过。即使节省32%的token，自我共识仍有约11%的停止发生在模型后续会放弃的答案上，且多数阻止了本应发生的修正。

Insight: 创新点在于揭示了自我共识作为停止信号的本质缺陷：它测量的是答案在固定探测下的持久性，而非推理是否终止，导致共识与推理完成之间存在差距。这提示早期退出机制应直接评估推理状态，而非仅依赖答案一致性。

Abstract: A natural way to cut reasoning-model inference cost is to repeatedly probe a single partial trajectory for its current answer and stop once probes agree – self-consensus. We ask whether any such rule is both safe and token-saving, and whether one can be selected once and reused. A preregistered sweep of 3,520 consensus rules, replayed on frozen trajectories from two models and three benchmarks, clears none of three acceptance gates fixed in advance; the frontier reproduces on a held-out split and on two unseen models – while a boundary-confidence control (DEER) swept through the same pipeline clears all three. The reason lies in the signal: agreement establishes that the current answer persists under a fixed probing procedure, not that the reasoning has terminated – a consensus-termination gap. Stopping on it commits non-terminal answers. At a rule still saving 32% of the tokens, one stop in nine fires on an answer the trajectory itself later abandons, and most of those stops cut off a correction it would otherwise have made. Widening the agreement window does not remove them: the share levels off near 7%, and by then the saving has fallen to 8%. Probe re-wording and a hand-labelled error taxonomy show the agreed answer is often a placeholder the model had not settled on. Used on its own as the stop signal, agreement fails not because it is insufficiently strict, but because it repeatedly measures the wrong object.

[13] Direct Diversity Optimization for Diverse Successful Trajectories in Preference Post-Training cs.CL | cs.AI | cs.LGPDF

Junwon Ko, Dong-Jae Lee, Minchan Kwon, Sunghyun Baek, Junmo Kim

TL;DR: 本文提出了一种名为直接多样性优化（DDO）的离线后训练方法，用于提升LLM智能体在顺序决策任务中的成功策略覆盖范围。该方法结合了分歧树收集（DTC）和参考相对目标赔率目标（RTO），旨在使模型在固定探索预算下，从同一决策状态出发，能够实现更多样化的成功策略。

Details

Motivation: 现有基于轨迹级结果标签的后训练方法，对从同一决策状态保留多个成功分支的监督能力不足，导致模型实现的成功策略多样性有限。本文旨在解决这一成功策略覆盖问题。

Result: 在BabyAI、BabaIsAI和WebShop基准测试中，DDO在任务成功率和成功策略覆盖率方面均优于其他对比的后训练方法。同时，它在局部动作替换后的恢复率最高，并且在任务成功率和覆盖率上也超过了仅模仿成功轨迹和解码时多样性控制的方法。

Insight: 核心创新在于将成功策略覆盖形式化为一个优化目标，并提出了DTC（用于构建状态对齐的分支集）和RTO（用于训练模型匹配参考相对目标）的组合方法。这为在离线后训练中直接优化策略多样性，而非仅依赖解码时技术，提供了新思路。

Abstract: LLM agents for sequential decision tasks are often post-trained with trajectory-level outcome labels, but such labels provide little supervision for preserving multiple successful branches from the same decision state. We study this problem as successful strategy coverage: how broadly a model realizes distinct successful strategies under a fixed rollout budget. We present Direct Diversity Optimization (DDO), an offline post-training method that combines Divergence-Tree Collection (DTC) with the Reference-Relative Target-Odds Objective (RTO). DTC constructs state-aligned branch sets rooted at shared decision states, and RTO trains the model to match reference-relative targets over successful alternatives. DDO achieves the strongest task success and successful strategy coverage among the compared post-training methods across BabyAI, BabaIsAI, and WebShop. It also achieves the highest recovery rate after local action replacement and higher task success and coverage than successful-only imitation and decoding-time diversification controls.

[14] Data-Centric Post-Training for Financial Reasoning: Mining, Distillation, and Verifiable Learning cs.CLPDF

Zhirayr Hayrapetyan, Andrei Kalmykov, Denis Kokosinskii, Dmitry Stanishevskii, Dmitry Zmitrovich

TL;DR: 本文提出了一种以数据为中心的后训练流程，用于提升语言模型在金融推理任务上的能力。该流程通过挖掘开源推理轨迹、蒸馏金融指令数据以及从金融教育材料生成知识图谱引导的问答对来构建互补语料库，并采用轻量级分类器进行筛选。研究比较了监督微调、强化学习等多种模型适应方法，并引入自蒸馏微调和模型合并来防止金融能力的丢失。

Details

Motivation: 现有金融文本、教材和问答对虽然丰富，但大多缺乏显式推理、充分上下文或可靠可验证的答案，且教材需转化为合成训练样本，难以直接用于推理导向的后训练。

Result: 在FINESSE-Bench基准上评估，普通监督微调使准确率下降3.2-4.0个百分点，而自蒸馏微调相比初始模型提升1.0-2.8个百分点；等权重模型合并比其监督微调父模型恢复3.0个百分点，并比原始模型高0.9个百分点；在硬任务上应用GRPO强化学习可额外提升0.4-3.0个百分点。

Insight: 创新点在于构建互补金融推理语料库的数据中心化流程，以及采用保留感知的适应策略（如自蒸馏微调和模型合并）来避免后训练中的能力退化，从而在金融推理任务上实现稳定提升。

Abstract: Financial text, textbooks, and question-answer pairs are abundant, but only a small fraction is directly usable for reasoning-focused post-training. Existing QA pairs often lack explicit reasoning, sufficient context, or reliably verifiable answers, while textbooks must first be transformed into synthetic training examples. We present a data-centric pipeline that constructs complementary corpora by mining open-source reasoning traces, distilling financial instruction data, and generating knowledge-graph-guided question-answer pairs from financial educational material. After semantic deduplication, three lightweight sequence classifiers select finance-relevant examples, reject under-specified questions, and identify tasks suitable for reinforcement learning with compact rule-based verifiers. For model adaptation, we study supervised fine-tuning and reinforcement learning, while self-distilled fine-tuning and post-training model merging are used to prevent the loss of financial capabilities already present in the starting model. We evaluate the adapted language models using FINESSE-Bench, reporting aggregate performance and changes relative to their starting checkpoints. Across the selected comparisons, ordinary SFT reduces FINESSE-Bench accuracy by 3.2-4.0 percentage points, whereas self-distilled SFT improves over the corresponding starting models by 1.0-2.8 points. Equal-weight merging recovers 3.0 points over its SFT parent and finishes 0.9 points above the original model; GRPO on hard tasks adds 0.4 points after self-distilled SFT or 3.0 points when applied directly to verifiable tasks. These results show that retention-aware adaptation can improve financial reasoning without the regressions observed after ordinary SFT.

[15] $Φ$-Bench: Can Large Language Models Engineer the Infrastructure That Powers Them? cs.CLPDF

Leilei Ding, Shumin Wang, Yuting Huang, Fanqi Wan, Yinmin Zhang

TL;DR: 本文提出了$Φ$-Bench基准测试，用于系统评估大型语言模型在LLM基础设施堆栈工程方面的能力。该基准源自前沿研究的优化问题并基于真实代码库，覆盖了从局部内核级函数补全到长周期实现和端到端系统优化的不同复杂度的任务。通过对前沿LLM的大量实验，揭示了它们在工程复杂LLM基础设施方面的当前能力和局限性。

Details

Motivation: 现有基准主要关注孤立的内核、预定义的算子或预定的优化目标，无法评估LLM在开放式、长周期的LLM基础设施工程方面的能力，因此需要一个新的基准来填补这一空白。

Result: 在$Φ$-Bench上对前沿LLM进行的广泛实验揭示了它们在工程复杂LLM基础设施方面的当前能力和局限性，为未来AI基础设施的自主优化路径上的挑战提供了见解。

Insight: 创新点在于构建了一个系统性的、基于真实世界代码库的基准，用于评估LLM在开放式、长周期的LLM基础设施堆栈工程任务中的能力，这超越了以往对孤立任务的评估。从客观角度看，该工作将LLM的评估从应用层扩展到了支撑其运行的基础设施层，为评估和推动LLM在系统优化方面的潜力提供了重要工具。

Abstract: Large language models (LLMs) have demonstrated remarkable capabilities in reasoning and code generation, raising the prospect that they could assist in developing and optimizing the very infrastructure that powers them. However, existing benchmarks mainly focus on isolated kernels, predefined operators, or pre-specified optimization targets, and therefore fail to evaluate the ability of LLMs to perform open-ended, long-horizon LLM infrastructure engineering. To address this gap, we present $Φ$-Bench, a benchmark for systematically evaluating LLMs on engineering the LLM infrastructure stack. Derived from optimization problems studied in frontier research and grounded in real-world code repositories, $Φ$-Bench provides broad coverage of the LLM infrastructure stack and spans tasks of varying complexity, ranging from localized kernel-level function completion to long-horizon implementation and end-to-end system optimization. Extensive experiments on frontier LLMs reveal their current capabilities and limitations in engineering complex LLM infrastructure, offering insights into the challenges that remain on the path toward autonomous optimization of future AI infrastructure.

[16] ProbPlug: A Plugin Uncertainty Network for Reliable Confidence in LLM Binary Classification cs.CLPDF

Jianzong Wang, Chuhang Liu, Botao Zhao, Zuheng Kang, Xulong Zhang

TL;DR: 本文提出了ProbPlug，一个用于大语言模型（LLM）二元分类的轻量级置信度估计框架。它利用从冻结的LLM中提取的内部token特征来预测输出是否正确，通过自注意力模块聚合隐藏表示，并能以插件形式集成到原始推理流程中，无需修改基础模型。

Details

Motivation: 尽管LLM在各种分类任务中表现出色，但其预测的可靠性仍是高风险场景部署的主要障碍。目前针对LLM分类的置信度校准研究尚不充分，需要一种可靠且轻量的置信度估计方法。

Result: 在涉及文本和多模态大模型的多个任务上的实验表明，ProbPlug能提供更可靠的置信度估计，以可忽略的额外开销提升分类性能，并在不同任务间展现出强大的泛化能力。

Insight: 创新点在于提出了一种无需修改基础模型的插件式置信度估计网络，利用LLM内部token特征和自注意力机制进行聚合。这为LLM分类的可靠性评估提供了一个实用且可泛化的解决方案。

Abstract: Large language models (LLMs) have achieved strong performance across a broad range of classification settings, yet the reliability of their predictions remains a major obstacle to deployment in high-stakes scenarios. Although confidence estimation for LLMs has been widely studied, confidence calibration for LLM-based classification remains underexplored. We introduce ProbPlug, a lightweight confidence estimation framework for LLM-based binary classification, which predicts whether an output is correct using internal token features extracted from a frozen LLM. ProbPlug employs a self-attention module to aggregate hidden representations and can be integrated into the original inference pipeline without modifying the base model. Experiments across multiple tasks involving both text-based and multimodal large models show that ProbPlug provides more reliable confidence estimates, improves classification performance with negligible additional overhead, and exhibits strong generalization across tasks. These results indicate that ProbPlug serves as a practical solution for confidence estimation in LLM-based classification. Our code is publicly available at Github.

[17] Two-Token Features and Small-Large Ensembles for VLM Hallucination Detection cs.CLPDF

Eli Schwartz

TL;DR: 本文提出了一种用于视觉语言模型（VLM）字符级幻觉检测的系统。该系统结合了一个经过微调的小型VLM（作为逐词元分类器）和一个大型零样本VLM，并利用现成的OCR文本作为输入特征。在SHROOM-Visions 2026共享任务的隐藏测试集上，该系统在多个语言版本中均取得了前10名的成绩。

Details

Motivation: 解决视觉语言模型在图像描述任务中产生的字符级文本幻觉问题，即检测VLM生成的文本中哪些字符是虚假的。

Result: 在SHROOM-Visions 2026共享任务的隐藏测试集上，官方提交结果的平均Cor得分为0.487，Cor-lbl得分为0.387。在主要指标Cor-lbl上，英语、法语、意大利语和中文版本分别位列第6/28、第6/21、第8/21和第7/22名。

Insight: 创新点在于使用双词元特征（two-token feature）从VLM隐藏状态中提取信息，并构建小型-大型模型集成（small-large ensemble），其中利用大型模型生成的合成幻觉数据来增强集成多样性。同时，系统结合了现成的OCR文本作为视觉文本基础（OCR grounding）。

Abstract: We present our system for the SHROOM-Visions 2026 shared task on character-level VLM hallucination detection. A small ($4$B-parameter) VLM is fine-tuned as a per-token classifier reading a two-token feature from its own hidden states, and is ensembled with a $\sim$400B zero-shot VLM judge at prediction time. Both components see off-the-shelf OCR of any visible in-image text. We use synthetic hallucination data generated by the large model as a source of ensemble diversity, and use validation to select feature layer, training data and OCR grounding. Our official entry reaches mean Cor $0.487$ / Cor-lbl $0.387$ on the hidden test set, placing $6$th/$28$ (EN), $6$th/$21$ (FR), $8$th/$21$ (IT) and $7$th/$22$ (ZH) on the task’s primary Cor-lbl metric.

[18] On-Policy Distillation for Vision-Language Model Adaptation, an Effective Paradigm on Low-Quality Multimodal Data cs.CLPDF

Hongyuan Zhang, Xianda Guo, Yanlun Peng, Qianlong Yang, Yubin Guo

TL;DR: 本文提出OnPoKD，一种用于视觉语言模型适应的策略蒸馏框架，通过动态构建样本级自适应蒸馏目标来解决现有方法在类别和域偏移下目标不可靠的问题。该框架学习一个轻量级控制器，利用教师模型、学生模型和零样本先验的可靠性和分歧线索来动态平衡教师监督、零样本先验指导和硬标签锚定，从而优化知识迁移。

Details

Motivation: 当前视觉语言蒸馏方法通常基于教师预测构建统一的训练目标，在类别和域偏移下不可靠，因此需要将蒸馏目标构建视为动态训练决策而非固定方案。

Result: 在Base-to-novel泛化和Cross-dataset迁移基准测试上的广泛实验表明，OnPoKD持续优于强大的视觉语言蒸馏基线方法。

Insight: 创新点在于首次将策略蒸馏应用于视觉语言模型适应，通过可学习的控制器动态构建自适应蒸馏目标，优化迁移性而非仅拟合训练分布，且无需改变推理架构或增加测试成本。

Abstract: Knowledge distillation offers an efficient route to transfer a task-adapted vision-language teacher to a compact student. The training target in current vision-language distillation methods is typically constructed from the teacher prediction and applied uniformly to all training samples, making it unreliable under class and domain shifts. In this paper, we argue that distillation target construction should be treated as a dynamic training decision rather than a fixed recipe. To this end, we propose OnPoKD, an on-policy distillation framework for vision-language model adaptation. To the best of our knowledge, OnPoKD is the first framework that applies on-policy distillation to vision-language model adaptation by learning target construction as a policy decision. OnPoKD learns a lightweight controller that constructs sample-wise adaptive targets using reliability and disagreement cues from the teacher model, student model, and zero-shot prior. Instead of relying on a fixed teacher prediction, the controller dynamically balances teacher supervision, zero-shot prior guidance, and hard-label anchoring through bounded policy actions, allowing the distillation target to adapt to varying sample reliability and training stages. The policy controller is updated with validation feedback, encouraging target construction to optimize transferability rather than merely fitting the training distribution. Since the controller is only used during training, OnPoKD can be seamlessly integrated into existing vision-language distillation pipelines while preserving the original inference architecture and test-time cost. Extensive experiments on Base-to-novel generalization and Cross-dataset transfer benchmarks show that OnPoKD consistently improves over strong vision-language distillation baselines.

[19] GANDR: Claim Auditing for Verifiable Legal Answer Generation cs.CL | cs.AI | cs.IRPDF

Chen Qian, Yimeng Wang, Yu Chen, Lingfei Wu, Andreas Stathopoulos

TL;DR: 本文提出了GANDR系统，用于法律领域可验证答案生成中的声明审计。该系统采用双智能体架构，其中起草者生成结构化法律推理答案，批评者则基于检索到的来源对每个声明进行审计并生成审计轨迹。

Details

Motivation: 在法律等高风险领域，语言模型生成的答案需要每个声明都能根据系统引用的来源进行验证。当前基于检索的生成管道对整个答案进行评分，导致正确结论可能建立在伪造或松散匹配的引用上，因此需要专门针对每个声明进行验证的系统及评估方法。

Result: 在包含185个项目的法律基准测试中，所有六个系统共享相同骨干网络、检索表面和引用指令，GANDR在所有主要指标上均排名第一，严格准确率达到70.8%，比最强基线高出11.3个百分点（p<0.01）。

Insight: 创新点在于双智能体架构和协议锚定的提交规则，其中起草者生成结构化答案，批评者进行逐声明审计；严格正确性标准要求每个引用必须解析到检索器返回的段落，这显著提升了答案的可验证性。

Abstract: In high-stakes domains such as legal practice, a language-model answer is only useful to the extent that a reader can verify each claim against the source the system cites. Current grounded-generation pipelines score the answer as a whole, so a correct conclusion can rest on fabricated or loosely matched citations and still score well. Closing this gap requires both a system built for per-claim verification and an evaluation that measures it. We introduce GANDR (Grounded ANswer DRafter), a two-agent system in which a Drafter writes an answer in a structured legal-reasoning format and a separate Critic, with the same view as a human verifier, audits each claim against its cited source and emits a per-claim audit trace on every round. We pair it with a strict correctness criterion requiring every citation to resolve to a passage the retriever returned. On a 185-item legal benchmark where all six systems share one backbone, one retrieval surface, and one citation instruction, GANDR ranks first on every primary metric, reaching 70.8% strict accuracy and leading the strongest baseline by 11.3 points (p<0.01). Reverting the protocol-anchored commit rule lowers strict accuracy by 22.7 points, and the strict lead stays positive on three further backbones, at +3.2 to +6.5 points. This lead traces to the Drafter configuration and the protocol-anchored commit, not to rewriting. Against two law-trained annotators the audit flags under-supported claims at F1 0.84 as a binary detector, while its four-way verdict labels agree only weakly and are advisory. Code is available upon request.

[20] Can Foundation Models Moderate Online Content? Evaluating Instruction- vs. Example-Driven Policy Operationalization cs.CL | cs.AI | cs.CYPDF

Ayan Majumdar, Shounak Paul, Pushpdeep Singh, Ines Abdelaziz, Sayeh Jarollahi

TL;DR: 本文系统比较了两种引导视觉语言模型进行内容审核的范式：基于指令驱动的方法（模型从政策原则推理）和基于示例驱动的方法（模型从先例泛化）。研究基于新构建的ModerationBench基准（包含4000个来自Bluesky平台的手动标注真实帖子）进行实验，发现基础模型能显著超越Bluesky现有审核系统，在随机帖子上的F1分数从0.22提升至0.60，两种范式均能达到相近的峰值效果。

Details

Motivation: 内容审核政策日益复杂，对其一致执行提出了严峻挑战；基础模型虽具备应对挑战的基本能力，但其能否可靠地审核在线内容仍是未解问题。

Result: 在ModerationBench基准测试中，基础模型大幅超越Bluesky已部署的审核系统，在随机帖子上的F1分数从0.22提升至0.60（接近三倍），指令驱动和示例驱动两种范式均能达到可比的最佳效果。

Insight: 创新点在于系统对比了指令驱动与示例驱动两种VLM引导范式在内容审核任务中的表现，并构建了真实场景的ModerationBench基准；客观来看，研究证实了基础模型规模化实现可靠、自适应政策执行的潜力，为实际部署提供了实证依据。

Abstract: The growing complexity of content moderation policies presents a critical challenge for their consistent operationalization. While foundation models possess the basic capabilities needed to confront this challenge, whether they can reliably moderate online content remains an unanswered question. In this paper, we systematically compare two competing paradigms for Vision-Language Model (VLM) guidance: an instruction-driven approach where models reason from policy precepts, and an example-driven approach where they generalize from prior precedents. We ground this investigation in ModerationBench, a new benchmark of 4,000 manually annotated, in-the-wild posts from the Bluesky platform. Our experiments reveal that foundation models can substantially outperform Bluesky’s deployed moderation system, nearly tripling its $F_1$ score (0.60 vs. 0.22) on Random Posts in the benchmark, with both instruction- and example-driven paradigms achieving comparable peak effectiveness. Our findings thus chart a path toward reliable and adaptable policy operationalization at scale.

[21] Building Multilingual Bridges: Data Mixing as the Pillar of Generalization for In-Language Reasoning cs.CLPDF

Mehrnaz Mofakhami, Ananya Sahu, Alejandro R. Salamanca, Daniel D’souza, Alexandre Berard

TL;DR: 该论文提出了一种名为L2 reasoning的能力，旨在让语言模型能够根据用户提示的语言进行一致的推理，从而在提示和答案之间建立语言桥梁。作者从数据为中心的角度出发，研究了如何在监督微调（SFT）中优化数据组合和调度以实现推理泛化。通过构建3.35B参数的Tiny Aya L2-Thinker模型，在涵盖数学、常识推理、指令遵循、开放生成和文化推理的6个基准测试中，对60种语言实现了超过93%的L2推理率，同时保持了强大的性能。研究表明，通过广泛的语言覆盖、易获取的多语言非推理数据以及足够的英语推理骨干，可以将推理能力泛化到未见语言，而无需每种目标语言的推理监督。

Details

Motivation: 当前推理语言模型的能力严重偏向英语，无论提示使用何种语言，模型主要用英语推理，这限制了非英语用户的使用，可能导致原始问题意图丢失，并忽略了目标语言中更容易表达的知识。

Result: 构建的Tiny Aya L2-Thinker模型在60种语言的6个基准测试（涵盖数学、常识推理等）上实现了超过93%的L2推理率，同时保持了强大的性能。

Insight: 论文的核心创新点在于从数据混合和调度的角度解决多语言推理泛化问题，表明推理是一种语言无关的行为，可以通过精心设计的数据混合策略在类型多样的语言间迁移，而无需为每种目标语言提供推理监督数据。这为构建可访问的、支持多语言推理的模型提供了有效路径。

Abstract: Reasoning language models have made substantial advances on a variety of complex tasks, yet their capabilities remain overwhelmingly English-centric: models primarily reason in English regardless of the language they are prompted in. This is inaccessible for non-English-speaking users, risks losing the intent of the original question, and forgoes knowledge more readily expressed in the target language. In this work, we advance L2 reasoning, the ability of a model to reason consistently in the language of the user’s prompt, thus building an in-language bridge between the prompt and the answer. We approach this problem from a data-centric angle, investigating how to optimize data composition and scheduling in SFT for reasoning generalization. Building Tiny Aya L2-Thinker at 3.35B scale, we achieve an L2 reasoning rate above 93% across 60 languages on 6 benchmarks spanning math, commonsense reasoning, instruction following, open-ended generation, and cultural reasoning while keeping performance strong. We show the path to generalizing L2 reasoning to held-out languages goes through broader language coverage, readily available multilingual non-reasoning data, and a sufficient English reasoning backbone. These findings indicate that reasoning is a language-agnostic behavior that can be transferred across typologically diverse languages through careful data mixing and without requiring reasoning supervision in every target language. We release our model weights and multilingual reasoning data to support further research on accessible, in-language reasoning.

[22] IBIB: A Protocol for Measuring Enterprise AI Systems by Serving Route, Not Model Identifier cs.CL | cs.AI | cs.LGPDF

Blake Stenstrom, Charangan Vasantharajan, Brian Sathianathan

TL;DR: 本文提出IBIB协议，用于评估企业AI系统的实际可用能力，强调应基于服务路由而非模型标识符进行测量。该协议包含黄金盲能力绑定预检、可靠性包含的首轮评分规则和结构评分盲审三部分，并发布了算法、分类表和清单模式。

Details

Motivation: 现有基准测试仅评估模型标识符，而企业部署的是包含权重、服务路由、精度、输出契约和工具链的完整系统，这导致测量误差，因此需要一种能报告系统实际可用能力的协议。

Result: 在11个系统上应用IBIB协议，发现能力可用性可测量：相同权重的两个单路由运行在最终绑定门的不同谓词上失败，而第三个通过；服务臂选择使声明修订和精度从77.38提升至82.54；可靠性包含改变了结论而非措辞。

Insight: 创新点在于将评估焦点从模型标识符转向服务路由，通过预检、可靠性包含评分和盲审结构确保测量真实系统能力；客观分析认为，该协议为解决企业AI系统评估中的测量误差提供了可操作框架，强调评估应涵盖完整部署栈。

Abstract: Enterprises deploy systems, not checkpoints. Usable capability depends jointly on weights, serving route, precision, output contract, and harness, yet all 18 audited benchmarks score advertised model identifiers. We treat this as measurement error and give a protocol that makes it reportable. It has three parts. A gold-blind capability-binding preflight verifies that a route can execute the evaluation contract before any task reaches it; a reliability-inclusive first-pass scoring rule keeps failure in the score while keeping unsupported capability out; and adjudication is structurally score-blind. We call the protocol IB2 and release its algorithms, classification tables, request contract, and manifest schemas. Its reference instantiation, 128 locked tasks and 987 assertions over document, spreadsheet, chart, tool and database work, stays sealed: the procedure is the artifact, not the corpus. Across eleven systems, four results. Capability availability is measurable: two complete single-route runs on identical weights later failed distinct predicates of the finalized binding gate, while a third passed that gate before a fresh run. The advertised identifier exposed neither limit. Discrimination is not uniform: four of seven suites saturate under a six-system band, with the spread almost entirely from governed database work and multi-tab joins, so we report interval-backed resolution groups, not ranks; two of the nominal five-label output’s four cuts fail multiplicity adjustment. Serving-arm choice moved one declared revision and precision from 77.38 to 82.54, paired interval [0.11,10.60], though the arms differ in access mode, harness generation, and the serving tool-call parser, and harness generation is a property of our evaluator, not any endpoint. Excluding failed responses from denominators changes the point ordering, so reliability inclusion changes a conclusion, not its wording.

cs.CV [Back]

[23] Integrating Unimodal and Vision-Language Representations in Latent Space for Multi-Label Chest X-Ray Classification cs.CVPDF

Quang-Huy Tran, Duc-Tuan Ngo, Minh-Khoi Nguyen-Bui, Dang-Khoa Bui, Thanh-Trong Tran

TL;DR: 本研究提出了一种用于多标签胸部X光分类的框架，该框架在潜在空间中融合了来自RAD-DINO的单模态视觉表示和来自BioViL-T的视觉-语言表示。实验在MIMIC-CXR-JPG数据集上进行，旨在提升14个标签的分类性能，并探究不同嵌入源的互补作用。

Details

Motivation: 解决多标签胸部X光分类问题，有效利用视觉表示和临床语义知识以提升分类性能，并阐明不同嵌入源（单模态与视觉-语言）的作用及其互补程度。

Result: 在MIMIC-CXR-JPG数据集上，最佳模型取得了平均AUROC为0.840和mAP为0.467的结果。实验表明，RAD-DINO单独使用优于BioViL-T，而早期融合能进一步提升性能，且当各嵌入源在潜在空间细化后，混合融合相比早期融合带来了持续且统计显著的改进。

Insight: 创新点在于提出了一种在潜在空间中细化和融合单模态与视觉-语言表示的混合框架，以利用其互补信息。客观分析认为，该方法强调了融合效果依赖于各分支提供的表示质量，为多模态医学图像分类提供了一种有效的融合策略。

Abstract: Multi-label chest X-ray classification has attracted considerable attention in recent years, with the effective use of visual representations and clinical semantic knowledge playing an important role. This study proposes a framework that combines unimodal representations from RAD-DINO with vision–language representations from BioViL-T for the classification of 14 labels in the MIMIC-CXR-JPG dataset. The RAD-DINO and BioViL-T embeddings and their combined representation are refined separately in latent space before being normalized and fused across the three branches. In addition to improving classification performance, the study aims to clarify the role of each embedding source and the degree to which they complement one another. Experiments show that RAD-DINO outperforms BioViL-T when used independently, whereas early fusion further improves the results, indicating that the two embedding sources contain complementary information. The best-performing model achieves a mean AUROC of 0.840 and an mAP of 0.467. Ablation analysis shows that hybrid fusion provides consistent and statistically significant improvements over early fusion when each embedding source is refined in latent space, suggesting that fusion effectiveness depends on the quality of the representation supplied by each branch. However, the study has only been evaluated internally on MIMIC-CXR-JPG; its generalizability to data from other healthcare institutions therefore remains to be validated. The source code is available at: https://anonymous.4open.science/r/mimic-report-C210/.

[24] Evidence-Order Calibration for Selective Visual Reasoning under Progressive Loss of Question-Critical Evidence cs.CVPDF

Muhamathu Ameer Ali Aacaas Muhamath

TL;DR: 本文研究了视觉语言模型（VLM）在问题关键视觉证据逐步缺失情况下的置信度可靠性问题。作者通过逐步掩码GQA数据集中问题关键区域构建证据损失轨迹，发现模型原生序列置信度存在大量证据单调性违规。论文提出了一种轻量级后处理可靠性头部，并引入证据顺序监督来校准置信度，从而在掩码和未见的高斯模糊条件下均降低了违规率。

Details

Motivation: 动机在于探究VLM的置信度在视觉证据逐步退化时是否保持结构一致性（即证据越多置信度应越高），以及如何通过校准提升其在选择性视觉推理中的可靠性。

Result: 在GQA数据集构建的176条轨迹上，原生置信度的证据单调性违规率（EMVR）为0.436。使用带证据顺序监督的轻量级头部进行训练后，在掩码条件下EMVR从0.330降至0.303，在未见的高斯模糊条件下从0.449降至0.402。但校准后的置信度在选择性风险排序任务上并未超越原生置信度。

Insight: 创新点在于提出了证据顺序监督这一训练目标，将置信度校准与证据损失的顺序一致性（而非单纯正确性判别）解耦。这为提升VLM在证据不完整场景下的可靠性提供了一种新思路，即关注置信度变化轨迹的合理性。

Abstract: Vision-language model (VLM) confidence may change in aggregate when visual evidence is degraded while remaining structurally inconsistent within individual examples. We study answer-level reliability along five-step, question-conditioned evidence-loss trajectories. Using a frozen Qwen2.5-VL-3B-Instruct model, we construct 176 accepted GQA-derived trajectories (880 masking conditions) by progressively masking scene-graph-localized question-critical regions. Native sequence confidence has an evidence monotonicity violation rate (EMVR) of 0.436, and 92.0% of trajectories contain at least one adjacent violation. A matched non-critical-region control shows that full critical masking reduces accuracy by 28.2 percentage points, compared with 0.6 points for equally sized non-critical masks; the paired difference is 27.6 points (95% CI [20.0, 34.7]). We train a lightweight post-hoc reliability head on frozen hidden states, sequence confidence, and entropy. Adding evidence-order supervision to binary cross-entropy (BCE) reduces masking EMVR from 0.330 to 0.303 (paired difference -0.027, 95% CI [-0.044, -0.010]). The same mask-trained objective reduces EMVR from 0.449 to 0.402 on held-out question IDs under unseen local Gaussian blur (difference -0.0468, 95% CI [-0.0739, -0.0199]). AUROC, Brier, and AURC differences between the two learned heads are statistically inconclusive, and native confidence remains stronger for selective-risk ranking. The results separate evidence-order consistency from conventional correctness discrimination rather than establishing generic confidence superiority.

Muhammad Asif Hasan, Yanming Zhu, Xuefei Yin, Alan Wee-Chung Liew

TL;DR: 本文提出了一种名为M2LG-DG的多模态局部-全局域泛化框架，用于跨站点重度抑郁症（MDD）分类。该框架通过双流rs-fMRI编码器（全局路径建模区域间依赖，局部路径在功能连接脑图上进行图约束聚合），并结合成像与非成像表征的共享与私有成分，利用双向交叉注意力和模态门进行融合，旨在提升模型在未见站点上的泛化性能。

Details

Motivation: 基于静息态功能磁共振成像（rs-fMRI）的分类模型在模型开发未包含的成像站点上性能下降，限制了其临床应用。现有域泛化方法通常依赖单一成像模态，且可能无法充分处理站点特定采集效应对表征空间的影响，导致表征反映采集条件而非诊断信息。

Result: 在四个保留的REST-meta-MDD站点上，M2LG-DG实现了69.48%的AUC，比最接近的对比方法高出2.18个百分点。在自闭症脑成像数据交换（ABIDE）数据集上的实验进一步支持了其适用于其他精神神经影像分类任务。

Insight: 创新点包括：采用多模态（成像与非成像）局部-全局双流编码器结构；通过共享-私有表征分解与双向交叉注意力融合，结合学习的模态门；引入跨站点监督对比学习目标，鼓励融合表征在不同采集域中保留诊断信息。这为跨站点神经影像分类提供了有效的域泛化框架。

Abstract: Classification models based on resting-state functional magnetic resonance imaging (rs-fMRI) often show lower performance at imaging sites not included during model development, which can limit their use in clinical settings. Domain generalization (DG) addresses this issue by learning representations from source sites that remain effective for unseen target sites. However, existing DG approaches for psychiatric disorder classification commonly rely on a single imaging modality and may not fully account for site-specific acquisition effects on the learned representation space. Subjects scanned at the same site share scanner hardware, acquisition settings, and preprocessing characteristics, which can cause representations to reflect acquisition conditions rather than diagnostic information. In this work, we present M2LG-DG, a source-only multimodal local-global framework for cross-site major depressive disorder (MDD) classification. The framework employs a dual-stream rs-fMRI encoder, where the global pathway models inter-regional dependencies through self-attention and the local pathway performs graph-constrained aggregation over functional connectivity-derived brain graphs. Imaging and non-imaging representations are decomposed into shared and private components and integrated through bidirectional cross-attention with a learned modality gate. A cross-site supervised contrastive objective forms positive pairs from same-class subjects acquired at different source sites, encouraging the fused representation to preserve diagnostic information across acquisition domains. On four held-out REST-meta-MDD sites, M2LG-DG achieves an AUC of 69.48% and exceeds the closest comparison method by 2.18 percentage points. Experiments on the Autism Brain Imaging Data Exchange (ABIDE) dataset further support its applicability to other psychiatric neuroimaging classification tasks.

[26] MLLMs Hallucinate when Information Distribution Drifts in Synergy Heads cs.CV | cs.CLPDF

Meng’en Qin, Junye Chen, Jucheng Liu, Youlu Xing, Song Wang

TL;DR: 本文提出HEAL方法，通过因果噪声干预和多头信息解耦来识别和缓解多模态大语言模型（MLLMs）的幻觉问题。研究发现幻觉主要源于协同头中信息分布的偏移，而非模态特定头的数量或强度。HEAL通过向协同头的值向量注入动态信息校准因子，主动调节视觉-语言依赖关系，从而将输出分布引导至事实证据。

Details

Motivation: 现有基于注意力的缓解方法依赖间接信号（如注意力权重），无法准确反映幻觉生成背后的实际信息偏移，因此需要更直接的方法来识别和缓解MLLMs中的幻觉问题。

Result: 大量实验表明，HEAL能有效减少多种MLLMs中的幻觉，为增强模型可信度提供了一条简单且可解释的途径。

Insight: 创新点在于通过因果干预和信息解耦将多头分类为四种类型，并发现幻觉与协同头中信息分布失衡直接相关；方法上通过动态校准因子主动调节视觉-语言依赖，这是一种新颖且可解释的幻觉缓解策略。

Abstract: Multimodal Large Language Models (MLLMs) often struggle with hallucinations, thus hindering their reliable practical applications. Existing attention-based mitigation methods mainly rely on indirect signals (e.g., attention weights) that fail to accurately reflect the actual information shift underlying hallucination generation. In this paper, we propose HEAL, Head-lEvel information disentAnglement and caLibration for identifying and mitigating hallucinations. HEAL first employs causal noise intervention on multi-head outputs to filter out causally redundant heads. Subsequently, it disentangles information distribution within the remaining heads via the counterfactual Difference-in-Differences, categorizing heads into four types. Through analysis, we observe: hallucinations happen when information distribution drifts away from a healthy equilibrium in synergy heads, not strongly correlated with the quantity or strength of modality-specific heads. Motivated by this insight, HEAL injects dynamic information calibration factors into the value vectors of synergy heads, and actively regulates visual-language dependencies, steering the output distribution towards factual evidence. Extensive experiments demonstrate that HEAL effectively reduces hallucinations across multiple MLLMs, offering a simple and interpretable pathway to enhance model trustworthiness.

[27] DensePol: Dense-Angle Polarization Dataset for Learning-Based Polarimetric Vision cs.CVPDF

Param Sangani, Ahmad Moori, Erik Blasch, Guna Seetharaman, Hadi Aliakbarpour

TL;DR: 本文提出了DensePol数据集，这是一个基于分时采集的高冗余RGB-偏振图像数据集，包含2018对图像，以1度间隔捕获180个完整分辨率的分析仪方向。作者还提出了一个基于确定性扩散的RGB到偏振预测框架，包含循环AoLP表示和局部DoLP细化器，实验表明该方法能改善偏振预测和下游表面法线估计。

Details

Motivation: 现有基于分焦平面（DoFP）相机的偏振数据集存在角度冗余有限、插值和瞬时视场误差等问题，限制了从RGB图像预测偏振的保真度。

Result: 密集角度采样显著提高了偏振稳定性，将AoLP偏差从13.36度降低到2.21度。实验证明了该方法在偏振预测和下游表面法线估计任务上的改进。

Insight: 创新点包括：1) 高冗余、密集角度采样的偏振数据集DensePol；2) 基于确定性扩散的预测框架，采用循环AoLP表示和局部DoLP细化器，提升了偏振预测的准确性和鲁棒性。

Abstract: Polarimetric vision is gaining increasing attention because it provides physical cues about scene shape, material, and reflection that are difficult to recover from RGB alone. Recent work has therefore explored predicting polarization directly from conventional RGB images; however, the fidelity of these methods strongly depends on the polarization supervision used for training. Most existing datasets rely on Division-of-Focal-Plane (DoFP) cameras with four spatially interleaved analyzer orientations, which provide limited angular redundancy and introduce interpolation and instantaneous-field-of-view errors. We introduce DensePol, a high-redundancy RGB–polarization dataset based on Division-of-Time (DoT) acquisition, capturing 180 full-resolution analyzer orientations at $1^\circ$ intervals. DensePol contains 2,018 paired RGB–polarization images with the angular measurements and fitting residuals retained. Dense angular sampling substantially improves polarization stability, reducing AoLP deviation from $13.36^\circ$ to $2.21^\circ$. We further introduce a deterministic diffusion-based RGB-to-polarization framework with cyclic AoLP representation and a local DoLP refiner. Experiments demonstrate improved polarization prediction and downstream surface-normal estimation. The dataset and code will be publicly available.

[28] AgenticGen: Reward-Guided Agentic Video Generation for Advertising cs.CV | cs.AI | cs.CLPDF

Xingyuan Bu, Chengru Song, Hao Zhou, Tao Zhou, Dong Li

TL;DR: 本文提出了AgenticGen，一个奖励引导的智能体框架，用于广告视频生成。它将生成过程分解为可训练的策略选择和草稿生成两个推理阶段，并利用从在线业务反馈中学习的性能奖励和基于人类质量标准的规则奖励来监督策略优化。离线实验验证了奖励模型和策略优化，在线A/B测试表明，该方法在TikTok广告系统中显著提升了点击率、转化率和广告价值等关键业务指标。

Details

Motivation: 现有视频基础模型能生成逼真视频，但未能优化如何将产品转化为有效广告，也无法利用在线业务反馈改进生成过程。本文旨在通过一个智能体框架，将广告视频生成构建为一个可被在线业务指标监督的推理问题，从而形成优化闭环。

Result: 在TikTok广告系统的在线A/B实验中，经过DPO和GRPO优化的AgenticGen相比SFT基线，将点击率提升了2.72%，转化率提升了2.63%，广告价值提升了9.61%。离线实验也验证了奖励模型和策略优化的有效性。

Insight: 核心创新在于将广告视频生成分解为可优化的推理阶段，并引入结合在线业务反馈（性能奖励）和人类质量标准（规则奖励）的双重奖励机制来指导策略优化。这为将生成任务与下游业务指标直接对齐，并利用强化学习进行端到端优化提供了新思路。

Abstract: Advertising video generation is not only a video synthesis task, but also a product-conditioned reasoning problem whose success is measured by online business metrics. Recent video foundation models can generate realistic clips from multimodal conditions, yet they do not optimize how a product should be transformed into an effective advertisement or how future generation should be improved from online business feedback. To close this loop, we propose AgenticGen, a reward-guided agentic framework that decomposes advertising video generation into two trainable reasoning stages, strategy selection and draft generation, thereby exposing optimization targets that online business feedback can supervise. AgenticGen learns a performance-based reward from accumulated online feedback and a complementary rubric-based reward aligned with human quality standards, then uses them to supervise policy optimization. DPO first moves the agentic policies toward online preferences, and GRPO further refines both stages with process and outcome rewards. Offline experiments validate the reward models and successive policy optimization. Online A/B experiments in the TikTok advertising system show that AgenticGen after DPO and GRPO improves CTR by 2.72%, CVR by 2.63%, and Advv by 9.61% over the SFT baseline.

[29] Video-MOPD: Multi-Teacher On-Policy Distillation for Video Understanding cs.CVPDF

Zhenxin Qin, Peng Shi, Cong Han, Yinlong Qian, Zequn Jie

TL;DR: 本文提出了Video-MOPD-8B，一个用于视频理解的开源模型。其核心创新在于通过多教师在线策略蒸馏（MOPD）方法，整合了在视频时序定位、通用视频理解和视频STEM推理三个核心领域分别进行强化学习优化的专家知识，并引入了可靠性感知信息采样（RAIS）来提升蒸馏效率。

Details

Motivation: 视频理解需要融合感知、时序理解和复杂推理等多种互补能力，这些能力难以在单一模型中联合优化。本文旨在通过整合多个领域专家的知识，构建一个能力全面协调的视频理解模型。

Result: 在涵盖通用视频理解、时序定位、视频推理和视频STEM任务的综合基准测试中，Video-MOPD-8B在同等规模模型中实现了最先进的性能。

Insight: 主要创新点包括：1. 多教师在线策略蒸馏框架，通过路由教师反馈监督学生生成的轨迹来整合专家知识；2. 可靠性感知信息采样机制，选择教师监督可靠且师生性能差距大的样本进行高效蒸馏。该方法为整合多领域专家知识提供了一种系统性的解决方案。

Abstract: Video understanding demands a convergence of complementary capabilities across perception, temporal understanding, and complex reasoning, which are difficult to jointly optimize within a single model. We introduce Video-MOPD-8B, an open-weight model dedicated to video understanding tasks. To fundamentally enhance its capabilities, we conduct targeted reinforcement learning (RL) optimization across three core domains: video temporal grounding (VTG), general video comprehension, and video STEM reasoning. We then unify their complementary capabilities via Multi-Teacher On-Policy Distillation (MOPD), which consolidates expert knowledge by supervising student-generated trajectories with routed teacher feedback. We further introduce Reliability-Aware Informative Sampling (RAIS), which selects examples with consistently reliable teacher supervision and large teacher-student performance gaps. Together, these components enable Video-MOPD-8B to achieve coordinated and comprehensive performance gains across diverse video understanding tasks. Extensive experiments on comprehensive benchmarks covering general video understanding, temporal grounding, video reasoning, and video STEM tasks demonstrate that Video-MOPD-8B achieves state-of-the-art performance among existing models at a comparable scale. The trained model weights are available at https://huggingface.co/LandH/Video-MOPD-8B.

[30] OmniPoint: Universal Monocular Metric Pointcloud from Any Camera cs.CVPDF

Botao Ye, Marc Pollefeys, Ming-Hsuan Yang, Abhijit Kundu

TL;DR: OmniPoint是一个统一的单目度量点云重建框架，旨在克服现有方法对固定相机模型和输入方案的依赖。它通过解耦的光线和距离表示、双向数据增强策略以及鲁棒的信息注入机制，实现了对多种相机类型（如针孔、鱼眼、等距柱面投影）和不同几何先验的泛化能力。

Details

Motivation: 当前单目3D重建方法因固定相机模型假设和僵化的输入方案而高度碎片化，难以适应多样化的成像传感器和几何先验。本文旨在开发一个通用框架，以统一的方式从任意相机恢复度量3D几何。

Result: 在多个基准测试中，OmniPoint实现了最先进的零样本性能，为统一的单目3D重建建立了新的鲁棒标准。

Insight: 创新点包括：放弃传统的平面深度回归，采用解耦的光线/距离表示和训练目标以分离相机模型与场景结构；提出双向增强策略，在3D空间中桥接有标签的透视数据和无标签的全向数据；设计鲁棒的信息注入机制，通过可学习的输入状态嵌入和向量化高斯平滑来整合可选输入（如相机内参或稀疏深度），避免特征分布偏移导致的网络不稳定。

Abstract: Recovering metric 3D geometry from monocular images is a fundamental computer vision task, yet current methods remain heavily fragmented by fixed camera model assumptions and inflexible input schemes. We present OmniPoint, a unified framework designed to generalize metric reconstruction across diverse imaging sensors, including pinhole, fisheye, and equirectangular projections, while accommodating varying geometric priors. To overcome projection rigidity, OmniPoint abandons conventional planar depth regression. It instead adopts a decoupled ray and distance representation alongside a decoupled training objective, explicitly separating the camera projection model from the scene structure. To address the severe scarcity of training data for alternative cameras, we introduce a bidirectional augmentation strategy that explicitly bridges labeled perspective data and unlabeled omnidirectional domains in 3D space. Furthermore, to seamlessly integrate optional inputs like camera intrinsics or sparse depth without destabilizing the network through feature distribution shifts, we propose a robust information injection mechanism. This mechanism utilizes learnable input state embeddings to resolve architectural ambiguity and applies vectorized Gaussian smoothing to densify irregular measurements. Extensive experiments demonstrate that OmniPoint achieves state-of-the-art zero-shot performance across multiple benchmarks, establishing a robust new standard for unified monocular 3D reconstruction.

[31] The Living Library: Transforming Archival Collections into Conversational Knowledge Systems – Lessons from the Theodore Roosevelt Presidential Library cs.CVPDF

Pengce Wang, Lucia Ronchi Darre, Matt Briney, Michaell Bakalars, Dan Rutkowski

TL;DR: 本文介绍了Living Library框架，这是一个端到端系统，用于将零散的数字档案转化为受管控的、可对话的线下展览体验。该系统在罗斯福总统图书馆部署，包含数字化与语料库创建、AI处理、检索与推理以及可选的具体对话界面四层架构。核心创新包括’跨时代类比锚定’技术，使历史人物能基于历史相似性回答当代问题，以及支持可靠、无监督运行的多种工程保障。

Details

Motivation: 解决如何将大量零散的档案藏品转化为可信、互动性强且可控的线下对话式展览体验的问题，旨在让历史人物（如罗斯福）能与参观者进行实时、面对面的对话。

Result: 论文未报告受控基准测试结果，而是分享了将’与罗斯福对话’作为公共展览运营的经验教训，提供了一个可迁移的模型，表明该系统已成功支持数百名参观者的可靠、无监督互动。

Insight: 主要创新点包括：1) ‘跨时代类比锚定’方法，通过历史相似性将当代问题重构，使历史人物回答不捏造事实；2) 结合专家审核（通过Archivist App）与AI处理的混合工作流，确保语料质量与可控性；3) 面向高可靠、实时交互的系统工程设计，如双路径检索、端到端流式处理、多层监控和会话隔离等。

Abstract: We present the Living Library, an end-to-end framework for transforming fragmented digital archives into governed, conversational, in-person exhibit experiences. Developed and deployed at the Theodore Roosevelt Presidential Library, the framework comprises four layers: digitization and corpus creation, AI-powered processing, retrieval and reasoning, and an optional embodied conversational interface. The first three layers aggregate a 300,000-record collection, apply OCR and structured metadata enrichment for expert curatorial review, and publish records to a hybrid dense/semantic index. Expert review is conducted through the Archivist App, a curator-facing interface that supports correction of AI-generated transcriptions and metadata. The governed corpus powers both a researcher-facing interface and Talk to TR, a continuously operating exhibit that embodies Theodore Roosevelt as a full-scale digital human within a museum environment. To support live, face-to-face interactions, Cross-Era Analogical Grounding reframes contemporary questions through documented historical parallels, allowing Roosevelt to address present-day topics without inventing facts. Dual-path retrieval and end-to-end streaming keep responses grounded and responsive. Layered watchdogs, visitor-session isolation, automated conversation management, and independently restartable services enable reliable unattended operation for hundreds of visitors. Avatar realism, spatial audio, lighting, staging, and conversational design are developed and evaluated as an integrated experience. Rather than report a controlled benchmark, we describe lessons from operating Talk to TR as a public exhibit and offer a transferable model for transforming archival collections into believable, in-person conversational experiences.

[32] Vision-language models know more about agriculture than they show and rubric-grounded verifications close the gap cs.CVPDF

Earl Ranario, Jared Smith, Lars Lundqvist, Urmil Jatin Chandarana

TL;DR: 本文研究了视觉语言模型在农业分类任务中的表现，发现其零样本性能不佳并非源于视觉特征弱，而是模型未能有效利用已掌握的农业知识。通过引入基于任务诊断量规的推理框架，显著提升了模型在疾病、害虫、损害、质量和物种识别等任务上的性能，甚至在某些任务上超越了使用理想参考描述的上限。

Details

Motivation: 解决视觉语言模型在农业分类任务（如疾病、害虫识别）中零样本性能差的问题，探究性能瓶颈是源于视觉特征提取能力不足，还是模型未能有效连接视觉特征与领域知识。

Result: 在涵盖116个数据集、834个类别、8,324张图像的基准测试上，基于量规的推理方法（PPT验证器）将评判F1分数较下限几乎翻倍，并在多项任务上达到或超越了使用理想描述的上限性能；例如，Gemma 4 E4B-it的疾病识别F1从0.60提升至0.71。

Insight: 创新点在于揭示了视觉语言模型已编码足够的农业视觉特征，但知识调用是瓶颈；提出了基于固定任务诊断量规的测试时推理框架（PPT），通过生成候选响应并依据量规进行成对验证来提升性能。然而，验证器的置信度评分与正确性负相关，表明其不能可靠衡量预测不确定性，性能增益主要源于量规引导的生成过程。

Abstract: Vision-language models (VLMs) show promise for agricultural classification, but zero-shot performance on disease, pest, damage, quality, and species identification remains poor, and it is unclear whether this reflects weak visual features or a failure to connect them to domain knowledge. We build a benchmark of 116 datasets, 834 classes, and 8,324 images spanning these tasks to isolate where the gap arises. Linear probing shows VLM vision encoders already encode agricultural features nearly as separable as a self-supervised DINOv3 baseline, ruling out weak visual representations as the primary bottleneck. Conditioning each model on an oracle reference description (an upper bound on its parametric knowledge) closes most of the gap left by an unaided lower bound, showing VLMs already know more about agriculture than they show. To close this gap without an oracle description at inference time, we structure test-time reasoning around a fixed, per-task diagnostic rubric: the model generates $K$ candidate responses and a Probabilistic Pivot Tournament (PPT) verifier, scored pairwise against the rubric, selects the best one. This nearly doubles judged F1 over the lower bound and matches or exceeds the upper bound on several tasks, notably pushing Gemma 4 E4B-it’s disease F1 to 0.71, above its own upper bound of 0.60. However, the verifier’s letter-scale confidence score has the opposite of its intended effect: filtering to its most confident predictions does not improve accuracy and correlates negatively with correctness across every model and pool size tested, so the score cannot serve as a measure of predictive uncertainty, and most of the observed gain likely comes from rubric-grounded generation rather than pairwise verification.

[33] Low-Rank Prompt Learning for Vision-Language Models with Fixed-Token Bases cs.CVPDF

Tanvir Muntakim Tonoy, Sajjad Ghiasvand, Mahnoosh Alizadeh, Ramtin Pedarsani

TL;DR: 该论文研究了视觉语言模型（如CLIP）中提示学习的参数效率问题，提出了一种低秩提示学习方法。通过将密集提示矩阵分解为固定token基矩阵和可训练嵌入侧系数矩阵的乘积，显著减少了可训练参数数量，并在多个少样本基准测试中达到或超越了原始CoOp方法的性能。

Details

Motivation: 动机在于探索CLIP的提示学习（如CoOp）中使用的密集提示矩阵是否过度参数化，旨在通过低秩分解来减少可训练参数，提高参数效率并改善少样本泛化能力。

Result: 在七个少样本基准测试和两个CLIP骨干网络上，低秩提示方法以更少的参数匹配或改进了密集CoOp，尤其在低样本基础到新类别的泛化上表现突出。固定token基矩阵（如随机基）并仅训练嵌入侧系数，性能与完全可训练的分解相当。

Insight: 创新点在于揭示了提示矩阵分解中的不对称性：嵌入侧系数承载了主要的适应能力，而token基矩阵可以固定（如随机基），这简化了训练并保证了收敛。这为高效提示学习提供了新思路，即通过固定基矩阵来减少参数而不损失性能。

Abstract: Prompt learning adapts CLIP to downstream recognition by replacing hand-written templates with learned continuous context vectors, which in Context Optimization (CoOp) form a dense prompt matrix $\mathbf{P}\in\mathbb{R}^{m\times d}$ trained from only a few examples per class. We study whether this matrix is over-parameterized by factorizing it as $\mathbf{P}=\mathbf{B}\mathbf{A}$, which cuts the trainable prompt parameters from $md$ to $r(m+d)$, and to $rd$ once the token-side factor $\mathbf{B}$ is fixed. Across seven few-shot benchmarks and two CLIP backbones, low-rank prompts match or improve dense CoOp at far fewer parameters, with the clearest gains on low-shot base-to-new generalization. We then find that the token-side factor need not be learned at all: fixing $\mathbf{B}$ to a Gaussian, orthogonal, SVD-derived, or even random basis and training only the embedding-side factor $\mathbf{A}$ stays on par with the fully trainable factorization, and a source-trained $\mathbf{B}$ offers no advantage over a random one. A prompt-factor asymmetry and a local update-space dimension gap show why fixing $\mathbf{B}$ is far less restrictive than fixing $\mathbf{A}$, and a smoothness-only guarantee certifies that optimizing $\mathbf{A}$ over a fixed $\mathbf{B}$ converges. In the CLIP prompt setting, the embedding-side coefficients carry the adaptation while the token basis can simply be fixed.

[34] Learning Global Camera Poses from Noisy View-Graphs for Structure from Motion cs.CVPDF

Fadi Khatib, Meirav Galun, Ronen Basri

TL;DR: 本文提出了一种基于学习的全局结构运动框架，通过图神经网络聚合噪声视图图来估计相机位姿。该方法采用置换等变、边条件图神经网络，输入噪声成对相对位姿，输出全局一致的相机外参，无需真值监督，仅依赖相对位姿一致性目标进行训练，随后进行3D点三角测量和鲁棒光束法平差。该方法高效、可扩展至上千张图像，且对图密度鲁棒。

Details

Motivation: 解决传统结构运动中相机位姿估计依赖噪声成对相对位姿、难以实现全局一致性的问题，旨在通过深度学习提升位姿估计的鲁棒性和效率。

Result: 在MegaDepth、1DSfM、Strecha和BlendedMVS数据集上评估，相比深度以轨迹为中心的方法，本方法在旋转和平移精度上更优，且能注册更多图像；与最先进的经典流程相比，结果具有竞争力，同时速度更快。

Insight: 创新点包括使用无真值监督的图神经网络进行全局位姿优化，以及结合置换等变性和边条件设计以处理噪声输入；客观分析认为，该方法将深度学习与经典几何优化结合，为大规模结构运动提供了高效且鲁棒的解决方案。

Abstract: Camera pose estimation is a key step in 3D reconstruction and view-synthesis pipelines. We present a deep, global Structure-from-Motion framework based on learned view-graph aggregation. Our method employs a permutation-equivariant, edge-conditioned graph neural network that takes noisy pairwise relative poses as input and outputs globally consistent camera extrinsics. The network is trained without ground-truth supervision, relying solely on a relative-pose consistency objective. This is followed by 3D point triangulation and robust bundle adjustment. Our approach is efficient, scalable to more than a thousand images, and robust to graph density. We evaluate our method on MegaDepth, 1DSfM, Strecha, and BlendedMVS. These experiments demonstrate that our method achieves superior rotation and translation accuracy compared to deep track-centric methods while registering more images across many scenes, and competitive results compared to state-of-the-art classical pipelines, while being much faster.

[35] AnimalLift: Reconstructing Animatable 3D Animals from a Single Image by Learning Canonical Shape, Texture, and Fur Maps cs.CVPDF

Chunyi Sun, Ruyi Zha, Weijian Deng, Junlin Han, Dylan Campbell

TL;DR: AnimalLift是一个从单张图像重建可动画3D动物资产的框架，它通过将图像提升到一个共享的规范空间，联合预测规范的几何、纹理和毛发贴图，从而生成具有统一拓扑、可编辑外观和与变形模拟兼容的毛发表示的3D模型。

Details

Motivation: 解决从单张图像重建完全可动画3D动物的挑战，现有方法要么难以绑定或编辑，要么无法捕捉详细的纹理和毛发外观，需要一种能生成结构化、动画兼容且包含显式毛发表示的资产的方法。

Result: 在合成和真实世界数据集上的实验展示了强大的重建质量和跨动物类别的泛化能力，其结构化表示直接支持动画、姿态迁移、毛发编辑和模拟兼容渲染等下游应用。

Insight: 创新点在于引入了UV对齐的毛发贴图，在表面对齐的规范域中对毛发丝几何进行编码，实现了与网格变形和毛发模拟兼容的显式毛发重建；同时，通过程序化数据生成流程提供大规模监督，支持跨物种和外观的联合学习。

Abstract: Reconstructing a fully animatable 3D animal from a single image remains challenging because animation-ready assets require not only plausible geometry, but also a unified topology, editable appearance, and fur representations compatible with deformation and simulation. Existing image-to-3D approaches often rely on implicit or loosely structured representations that are difficult to rig or edit, while parametric animal models support animation but cannot capture detailed texture and fur appearance. We present AnimalLift, a framework for reconstructing structured, animation-compatible 3D animal assets with explicit fur from a single image. Our method lifts an input image into a shared canonical space with a consistent topology and UV parameterization across the dataset, enabling joint prediction of canonical geometry, texture, and fur in a unified feed-forward architecture. A key component of our representation is a UV-aligned fur map that encodes strand geometry in a surface-aligned canonical domain, allowing explicit fur reconstruction compatible with mesh deformation and fur simulation. To train the model, we introduce a procedural data generation pipeline that provides large-scale supervision with aligned geometry, texture, and fur across diverse animal species and appearances. Experiments on synthetic and real-world datasets demonstrate strong reconstruction quality and generalization across animal categories. Beyond reconstruction, our structured representation directly supports downstream applications including animation, pose transfer, fur editing, and simulation-compatible rendering.

[36] VANTAGE-Bench: Evaluating the Infrastructure AI Gap in Vision-Language Models cs.CV | cs.AIPDF

Zaid Pervaiz Bhat, Nimra Nayyar, Arihant Jain, Lap Fung Chan, John Suchanek

TL;DR: 该论文提出了VANTAGE-Bench基准，用于评估视觉语言模型在基础设施AI任务上的性能差距。该基准覆盖物流、交通和智能空间三大领域，整合了图像和视频评估，包含八种任务类型，并引入了针对固定摄像头视频的单目标跟踪评估协议。通过对17个模型进行零样本评估，发现模型在事件验证、指代表达和时间定位等任务上存在显著短板，而在视频问答和2D空间定位上表现相对较好。

Details

Motivation: 当前视觉语言模型的研究和评估主要集中在面向动作的具身AI和以主体为中心的消费级视频上，忽视了依赖固定摄像头进行开环洞察（如安全监控和操作记录）的基础设施AI这一普遍类别。本文旨在衡量并揭示这一“基础设施AI差距”。

Result: 在零样本评估17个模型后发现，相对于以消费者为中心的基准，性能差距是集中的而非普遍的。事件验证、指代表达和时间定位任务在每个模型规模上均落后约9到24个百分点，而视频问答与VideoMME基准的差距在5.3分以内，2D空间指向任务与BLINK基准相比没有差距。时间维度是绝对最弱的：在时间定位任务上，没有系统超过55.7 mIoU；在密集视频描述任务上，没有系统超过37.3 SODA_c。在跟踪任务上，前沿模型在短时间范围内与专业跟踪器差距约5分，但随着时间范围延长，差距扩大。开源模型在2D目标定位任务上领先。

Insight: 论文的创新点在于首次系统性地定义了“基础设施AI”评估场景，并构建了跨语义、空间、时间和时空能力的统一基准VANTAGE-Bench，其任务设计超越了传统的多项选择题，包含了密集描述和时空定位等更具挑战性的任务。客观来看，该研究揭示了当前VLMs能力在特定基础设施任务（尤其是时间相关任务）上的系统性短板，并表明性能差距模式不能简单地用模型规模或是否为专有模型来解释，为未来模型开发提供了重要的诊断方向。

Abstract: As Vision-Language Models (VLMs) advance toward physical deployment, the focus has remained on action-oriented Embodied AI evaluated on subject-centric consumer video. This overlooks a pervasive class of Physical AI: Infrastructure AI, which relies on fixed cameras for open-loop insights like safety monitoring and operational logging. We introduce VANTAGE-Bench, a benchmark measuring this “Infrastructure AI Gap.” It spans three operational domains (Logistics, Transportation, and Smart Spaces), unifies image and video evaluation across semantic, spatial, temporal, and spatio-temporal capabilities, and moves beyond multiple-choice to eight task formulations including dense captioning and spatio-temporal grounding. It adds a single-pass trajectory protocol for Single Object Tracking and, to our knowledge, the first such evaluation on fixed-camera infrastructure video, scored against specialist trackers. Annotation spans three regimes over 3,346 media assets: 3,342 video-task annotations, 4,281 image-grounding annotations, and 27,404 detection boxes. Evaluating 17 models zero-shot, we find the shortfall relative to consumer-centric benchmarks is concentrated, not general. Event verification, referring expressions, and temporal localization fall roughly 9 to 24 points at every model scale, while video question answering stays within 5.3 points of VideoMME and 2D spatial pointing shows no shortfall against BLINK. The temporal pillar is weakest in absolute terms: no system exceeds 55.7 mIoU on temporal localization or 37.3 SODA_c on dense video captioning. On tracking, frontier models come within roughly 5 points of specialist trackers over short horizons but separate as the horizon extends. Open-weight models lead 2D object localization outright, so neither scale nor proprietary access explains the pattern. Data, evaluation harness, and leaderboard: https://vantage-bench.org/

[37] MotionBlind: Probing the Illusion of Motion Understanding in Video-LLMs cs.CVPDF

Dhairya Bhatia, Bishoy Galoaa, Oliver Fritsche, Shahid Kamal, Muhammad Obaidullah Abdul Salam

TL;DR: 本文提出了MotionBlind基准测试，用于评估视频大语言模型对物理运动（速度、幅度和方向）的理解能力。研究发现，当前多数视频大语言模型无法区分视频中细微的运动差异，其表现接近随机猜测水平，仅Gemini 3.1 Pro模型整体通过测试，但在速度判断上仍有缺陷。

Details

Motivation: 视频大语言模型常被用作世界模型的感知前端，这假设它们能够理解运动，但作者发现现有模型实际上缺乏对物理运动（如速度、方向和力度）的基本感知能力。

Result: 在MotionBlind基准上，大多数开源模型的表现接近6.25%的随机猜测基线，模型规模扩大无助于提升性能；仅Gemini 3.1 Pro模型整体表现超过基线，但在速度判断任务上失败。移除视频或打乱帧顺序会导致模型性能降至随机水平，表明任务确实依赖视频时序信息。

Insight: 论文的创新点在于提出了一个基于对比视频对的物理运动理解基准，通过严格控制外观和语言线索，迫使模型必须理解运动本身；客观来看，该研究揭示了当前视频大语言模型在运动感知上的根本缺陷，挑战了其作为世界模型可靠前端的假设。

Abstract: Video large language models (Video-LLMs) are increasingly used as the perceptual front end of world models, a role that assumes they can read motion: how fast something moves, which way it travels, how hard it is pushed. We show they cannot. A Video-LLM can watch two clips of the same person in the same room, name every object in both, and still fail to say which clip moves faster. We introduce MotionBlind, a contrastive benchmark of self-recorded video for physically grounded motion(speed, magnitude, and direction), the variables a world model must predict. Each instance is a pair of near-identical clips that differ only in motion. Each clip carries two complementary yes/no questions, giving four items per instance, and a model earns credit only if all four are correct. We report Instance Accuracy(IAcc), which has a 6.25% chance floor. Single-frame, appearance, and language-only shortcuts all collapse to it. MotionBlind complements the recent TimeBlind benchmark. We run a controlled study of six open and two frontier Video-LLMs, varying whether the video is present, whether frames are shown in the correct temporal order, and how frames are sampled (1 to 24 frames, four selection strategies). Open models sit near the 6.25% floor, and scale does not help. Removing the video drops every model to zero IAcc, and shuffling frames collapses IAcc to chance, so the task genuinely needs video in order. Neither more frames nor smarter frame selection closes the gap, because these change which frames are seen, not whether motion is read. Only Gemini3.1 Pro clears the benchmark overall, and even it fails on speed. A frontend that cannot tell two speeds of the same action apart is not yet a trustworthy source of supervision, reward, or evaluation for a world model.

[38] RouteBridge: Reliability-Routed Bidirectional Distillation Between Neural Radiance Fields and 3D Gaussian Splatting cs.CV | cs.AIPDF

YuanHang Wang, Xin Cao

TL;DR: 本文提出了RouteBridge，一个在神经辐射场（NeRF）和3D高斯泼溅（3DGS）之间进行双向蒸馏的框架。它通过一个可靠性估计器为每条光线自适应地选择最佳的教学方向（从NeRF到3DGS，或从3DGS到NeRF），以避免全局固定教师模型传播局部重建误差。该方法通过一个与渲染器无关的接口传递颜色、不透明度和归一化深度信息，无需共享特征或点对应关系。

Details

Motivation: NeRF和3DGS对场景编码具有互补的归纳偏置，但现有的跨表示蒸馏方法通常将一种表示固定为整个场景的教师模型，这会导致局部重建误差的传播。本文旨在解决这一问题。

Result: 在mip-NeRF 360数据集上，蒸馏出的NeRF和3DGS模型分别达到28.56 dB和28.77 dB的PSNR。其中，3DGS导出模型比原始3DGS提升了1.56 dB，比NeRF-GS提升了0.45 dB，同时LPIPS降至0.207。在静态三视图DTU数据集上，RouteBridge获得了21.12 dB的PSNR。消融实验表明自适应路由和几何光线目标均对提升有贡献。

Insight: 核心创新点在于提出了一个基于光线级别的、自适应的双向蒸馏路由机制，而非固定全局的教师-学生关系。这通过结合光度残差和表示特定的几何证据的可靠性估计器实现。另一个创新是设计了一个与渲染器无关的监督信号传输接口，避免了特征对齐的困难。

Abstract: Neural radiance fields (NeRFs) and 3D Gaussian Splatting (3DGS) encode a scene with complementary inductive biases, but existing cross-representation distillation typically fixes one representation as teacher for the entire scene. A globally fixed teacher can propagate local reconstruction errors. We present RouteBridge, a bidirectional framework that selects the teaching direction for each ray. Its reliability estimator combines photometric residuals with representation-specific geometric evidence and routes supervision from NeRF to 3DGS, from 3DGS to NeRF, or abstains. A renderer-independent interface transfers color, opacity, and normalized depth without shared features or point correspondence. On mip-NeRF 360, the NeRF and 3DGS exports reach 28.56 and 28.77 dB, respectively. The 3DGS export improves over 3DGS by 1.56 dB and over NeRF-GS by 0.45 dB while reducing LPIPS to 0.207. On static three-view DTU, RouteBridge obtains 21.12 dB. Ablations show that both adaptive routing and geometric ray targets contribute to the improvement.

[39] VFNet: Multi-View Spatio-Temporal Model for Void Fraction Estimation in Gas-Liquid Two-Phase Flow cs.CVPDF

Md Adnan Faisal Hossain, Raghav Rajeev, Kumar Nishant, Justin A Weibel, Satish Kumar

TL;DR: 本文提出VFNet，一种用于从气液两相流同步多视角视频中预测空隙率的双分支时空神经网络。该方法通过局部分支提取受限空间区域特征并融合双视角信息，同时利用时空分支捕获流动的全局时空演化以优化粗略几何估计。在模拟计算流体动力学数据上训练，并在多种指标上优于现有基于学习和传统基线方法，同时提升了真实两相流数据的下游流型分类性能。

Details

Motivation: 空隙率是表征气液两相流的关键参数，现有估计方法要么依赖难以泛化到不同流体的流动假设，要么采用干扰流动行为的侵入式传感，因此需要一种非侵入式且普适的估计方法。

Result: VFNet在模拟CFD数据上训练，并在多种指标上优于所有基于学习和传统基线方法，同时在下游真实两相流数据的流型分类任务中提升了性能。

Insight: 创新点在于提出了一种结合局部特征融合与全局时空演化的双分支神经网络架构，直接从多视角视频中非侵入式地估计空隙率，避免了传统方法对流动假设或侵入式传感器的依赖，并展示了从模拟数据到真实数据的有效迁移能力。

Abstract: Void fraction, which quantifies the proportion of the fluid flow volume occupied by the gas phase, is a key parameter in the characterization of gas-liquid two-phase flow. Existing estimation methods either rely on flow assumptions that do not generalize across different fluids or on intrusive sensing that disturbs the flow behavior. We propose VFNet, a dual-branch spatio-temporal neural network for void-fraction prediction from synchronized multi-view videos of two-phase flow. A local branch extracts features from confined spatial regions and fuses the synchronized dual views, while a spatio-temporal branch captures the global evolution of the flow across space and time to refine a coarse geometric estimate. Trained on simulated computational fluid dynamics (CFD) data with known ground-truth void fractions and evaluated against both learning-based and traditional baselines, VFNet achieves the best performance across a broad range of metrics and also improves downstream flow-pattern classification on real two-phase flow data.

[40] IAE-VTG: Interaction-Aligned Action-Entity Video Temporal Grounding cs.CV | cs.MMPDF

Shiwen Zhao, Qi Zhang, Sezer Karaoglu, Theo Gevers, Martin R. Oswald

TL;DR: 本文提出了IAE-VTG方法，用于视频时序定位任务，旨在通过显式建模查询中动作与实体之间的交互关系，来更精确地定位与自然语言查询匹配的视频片段。该方法包含细粒度解耦交互模块和交互敏感分配策略，在多个基准数据集上提升了基线模型性能并达到了有竞争力的水平。

Details

Motivation: 现有视频时序定位方法通常将查询作为一个整体编码或使用通用的视频-文本交互，未能显式检查动作和实体是否共同发生，导致可能定位到包含两个概念但并非查询所描述事件的错误片段。

Result: 在QVHighlights、Charades-STA和TACoS数据集上的实验表明，IAE-VTG持续改进了强基线模型，并在标准定位指标上取得了有竞争力或最先进的性能。

Insight: 核心创新点在于从表示和训练分配两个层面显式建模动作与实体间的交互关系：通过细粒度解耦交互模块分离并对齐动作/实体信息与运动/外观特征；通过交互敏感分配将交互证据融入二分图匹配，结合时序重叠和语义兼容性选择训练目标，从而减少语义错误提案的监督信号。该方法在处理相似动作或实体多次出现的复杂事件时尤其有效。

Abstract: Video Temporal Grounding (VTG) localizes the video segment that matches a natural-language query. Many queries describe an action performed by a particular entity. Existing methods often encode the query as a whole or use general video-text interactions, without explicitly checking whether the action and entity occur together. They may therefore select a segment that contains both concepts but not the event described by the query. We propose Interaction Aligned Action-Entity Video Temporal Grounding (IAE-VTG), which models this rela?tionship at both the representation and training assignment levels. First, the Fine-grained Disentangled Interaction Module (FDIM) separates action and entity related query information and aligns it with complementary motion and appearance features. It then combines token-level interactions to build representations that capture the relationship between the action and entity. Second, Interaction-Sensitive Assignment (ISA) adds this interaction evidence to bipartite matching, so training targets are selected using both temporal overlap and semantic compatibility. This reduces supervision from temporally plausible but semantically incorrect proposals. Experiments on QVHighlights, Charades?STA, and TACoS show that IAE-VTG consistently improves strong baselines and achieves competitive or state-of-the-art performance on standard grounding metrics. Additional analyses show that the method is especially effective when similar actions or entities appear at multiple times and produces more reliable assignments for complex events.

[41] Recovering Biomechanical Signals from Missing Keypoints Using Temporal Interpolation in Monocular Gait Analysis cs.CV | eess.IVPDF

Shubham Jariwala

TL;DR: 该论文研究了在单目步态分析中，当关键点（如脚踝）因遮挡或检测错误而缺失时，如何恢复生物力学信号。作者评估了使用一阶时间插值方案来恢复缺失关键点的有效性，发现这种简单方法能显著降低膝关节角度估计误差，并恢复信号的方差和平滑度。

Details

Motivation: 单目姿态估计虽然成本低，但对关键点缺失敏感。现有研究多关注复杂的机器学习模型，而简单的时间插值方法的有效性尚未被充分探索。

Result: 在527帧单目行走视频中，移除脚踝关键点使平均角度误差增至23.4° ± 46.7°，信号方差降至接近零。时间插值将误差降至1.1° ± 6.7°，并将方差和平滑度恢复到接近基线水平。

Insight: 论文的创新点在于证明步态信号具有足够的时间冗余性，简单的、计算量极低的时间插值方案就能有效恢复关键缺失关节，无需依赖复杂的机器学习重建模型，这支持了在资源受限或易遮挡的单目设置中实现低复杂度、实时兼容的步态分析设计。

Abstract: Monocular pose estimation enables low-cost gait analysis but is sensitive to missing keypoints caused by occlusion, detection errors, or efficiency-driven model reduction. While prior work on recovering missing joints focuses on complex learned models, the effectiveness of simple temporal methods remains underexplored. We evaluate knee-angle estimation under a missing-ankle-keypoint condition and test a first-order temporal interpolation scheme as a recovery mechanism. Across 527 frames of monocular walking video (428 with valid baseline detections), removing the ankle keypoint increased mean angular error to 23.4° +/- 46.7° and collapsed signal variance to near zero. Temporal interpolation reduced error to 1.1° +/- 6.7° and restored variance and smoothness to within a few percent of baseline. These results indicate that gait signals possess sufficient temporal redundancy for a simple, computationally trivial interpolation scheme to recover a critical missing joint, without resorting to learned reconstruction models. The findings support low-complexity, real-time-compatible designs for gait analysis in resource-constrained or occlusion-prone monocular settings.

[42] LogiScope-VQA: Benchmarking Vision-Language Models for Logistics Hazard Identification in Industrial Scenarios cs.CV | cs.AI | cs.CLPDF

Hanjing Zhou, Mingze Yin, Ying Lian, Jun Ma, Chang-Yu Hsieh

TL;DR: 本文提出了LogiScope-VQA，一个专门用于评估大规模多模态模型在工业物流场景中危险识别能力的视觉问答基准。该基准包含从真实物流园区收集的2,476张图像和2,918个视频，以及10,274个人工精心标注和验证的视觉问答对。研究通过广泛的实验发现，即使是GPT-5.5、Gemini-3.1-Pro和Claude-Opus-4.7等强大的专有模型，在联合感知、理解和推理以识别危险的任务上，其性能与人类专家水平相比仍存在显著差距。

Details

Motivation: 工业仓库环境中大规模部署大规模多模态模型需要模型具备专家级的、面向危险的感知、理解和推理能力，但受限于商业条款，真实工业数据的稀缺严重阻碍了该领域的进一步发展。

Result: 在LogiScope-VQA基准上的广泛实验表明，主流专有模型（如GPT-5.5、Gemini-3.1-Pro、Claude-Opus-4.7）的性能与人类表现存在显著差距，揭示了模型在联合执行感知、理解和推理任务以识别危险方面仍有巨大的改进空间。

Insight: 论文的创新点在于构建了首个专注于工业物流危险识别的多模态基准，并设计了围绕工业元素感知、仓库知识理解和潜在风险推理三大主题的39个子任务。此外，引入了动态思维预算配置和双维度风险偏差分析，以深入剖析LMMs的特性，并揭示了阻碍模型实际部署的普遍性安全偏差问题。

Abstract: Large Multimodal Models (LMMs) large-scale deployment in industrial warehouse settings specifically necessitates that models exhibit human-expert-level hazard-oriented perception, understanding, and reasoning capabilities. However, the scarcity of real industrial data, tightly coupled to commercial terms, significantly hampers further advancement. To bridge this gap, we curate LogiScope-VQA to investigate the practical applicability of mainstream LMMs in real-world logistics operations. LogiScope-VQA comprises 2,476 images and 2,918 videos primarily sourced from real-world logistics parks, along with 10,274 VQAs meticulously curated and validated by human annotators. Grounded in 18 core objects and 20 risk types, we devise 39 subtasks aligned with three principal themes: industrial element perception, warehouse knowledge understanding, and potential risk reasoning. Furthermore, we incorporate dynamic thinking-budget configurations and dual-dimensional risk bias analyses to elucidate the properties of LMMs. Extensive experiments unveil that even powerful proprietary models, including GPT-5.5, Gemini-3.1-Pro, and Claude-Opus-4.7, exhibit a significant gap relative to human performance. The unique challenge of jointly integrating perception, understanding, and reasoning for hazard identification poses substantial headroom for further improvement on LogiScope-VQA. We additionally reveal the pervasive security bias issue that impedes LLMs’ practical deployment in real-world settings. The industrial dataset is publicly available under the CC BY-NC-SA 4.0 license.

Chandan Biswas, Aryan Singh, Anabik Pal

TL;DR: 该论文提出了一种跨模态子空间蒸馏框架，用于在空间遮挡条件下预测帕金森病患者的冻结步态。该方法结合了惯性测量单元（IMU）的准确性和视频的实用性，通过从预训练的IMU模型中提取不变潜在拓扑结构来监督视觉模型训练，并采用双流视觉模型融合骨骼图节点和空间像素以应对严重遮挡。

Details

Motivation: 现有冻结步态预测方法存在局限：基于视频的方法在患者连续转身时因肢体自遮挡导致姿态估计不准，而基于IMU的方法虽不受视觉遮挡影响但部署不便。论文旨在结合两者优势，提升视频方法在遮挡下的鲁棒性和实用性。

Result: 在一个包含帕金森患者执行连续360度转身的多模态序列公开数据集上评估，实验表明该方法有效降低了跟踪评估熵，并在无需可穿戴设备的推理环境中实现了高精度的冻结步态预测边界。

Insight: 创新点在于提出跨模态蒸馏框架，利用IMU监督提升视觉模型对遮挡的鲁棒性；采用双流模型动态融合骨骼节点和像素信息，在关节跟踪置信度下降时依赖连续像素边界，增强了模型在严重遮挡下的处理能力。

Abstract: Parkinson’s disease is a progressive neurodegenerative disorder characterised by gradual deterioration of movement control. Automated freezing-of-gait (FOG) detection supports the objective assessment of gait-related motor impairment. Two common approaches are used for FOG prediction: (i) analysing video recordings of the patient’s movements and (ii) analysing data collected using inertial measurement unit (IMU) wearable sensors attached to the patient’s lower limbs. Video-based approaches may suffer detection errors during continuous turning-in-place tasks because the lower limbs undergo substantial geometric self-occlusion, degrading pose-estimation accuracy. IMU-based approaches are generally less affected by visual occlusion; however, they are difficult to deploy outside clinical or laboratory settings, as the sensors must be attached securely and remain in place throughout the assessment. Motivated by this, we propose a cross-modal subspace distillation framework to mitigate the limitations of unimodal FOG detection by combining IMU accuracy with video-based practicality. We extract invariant latent topologies from a pre-trained kinematic oracle to structurally supervise a non-encoded visual architecture during training. To resolve periods of severe spatial occlusion, a dual-stream visual model probabilistically fuses skeletal graph nodes and continuous spatial pixels, dynamically shifting reliance to uninterrupted pixel boundaries as joint tracking confidence drops. Evaluated against a public, multi-modal sequence dataset of Parkinson’s individuals executing continuous $360^\circ$ turns, empirical results demonstrate that applying sensory boundary topologies strictly mitigates tracking evaluation entropy. Our constrained optimisation confirms that highly precise FOG prediction bounds can be achieved over zero-wearable inference environments.

[44] Pretraining and Distillation Matter More Than Architecture Family for Label-Free Single-Cell Classification cs.CVPDF

Philip Graemer, Giuseppe Di Caprio

TL;DR: 本文通过控制实验比较了EfficientNet、Vision Transformer和EVA-02在无标记单细胞分类任务上的表现，发现预训练和知识蒸馏比架构选择更为重要。预训练能显著提升模型性能，而细粒度tokenization对小尺寸细胞图像有益。知识蒸馏能有效提升紧凑模型的部署性能。

Details

Motivation: 解决在无标记单细胞分类任务中，关于选择CNN还是Transformer架构的争议，通过严格控制实验条件来分离架构、预训练、微调等因素的影响。

Result: 在LIVECell相位对比显微镜数据集上，预训练将macro-F1提升了3-4个百分点；最佳预训练的CNN与Transformer性能差距小于0.5个百分点；通过知识蒸馏的紧凑学生模型（如EfficientNet-B0）性能超过了所有单独训练的主干网络，包括更大的教师模型。

Insight: 预训练数据和方法对模型性能的影响远大于架构本身；细粒度tokenization（如ViT-S/8）对小目标图像处理更有效；从自然图像识别迁移的微调启发式方法（如分层学习率衰减）可能不适用于显微图像；知识蒸馏是提升紧凑模型部署性能的有效途径。

Abstract: Choosing a deep learning architecture for label-free single-cell classification remains an open question, with microscopy benchmarks reporting conflicting conclusions about CNNs versus transformers. We present a controlled benchmark on LIVECell phase-contrast microscopy data using source-image-disjoint train/validation/test splits to prevent parent-image leakage and matched optimisation, augmentation, and evaluation protocols across EfficientNet, Vision Transformer (ViT), and EVA-02 models. This allows the effects of architecture, pretraining, fine-tuning, tokenisation, and distillation to be disentangled. We find that the previously reported CNN advantage is largely explained by pretraining rather than architecture: the smallest pretrained model outperforms the strongest model trained from scratch despite far fewer parameters. Pretraining improves macro-F1 by 3-4 points, while the gap between the best pretrained CNN and transformer is below 0.5 points. Architectural choices nevertheless matter: ViT-S/8 outperforms ViT-S/16 and matches the four-times-larger ViT-B/16 at a quarter of the parameters, showing that finer tokenisation benefits small cell crops. Conversely, layer-wise learning-rate decay, central to the EVA-02 fine-tuning recipe, degrades performance, highlighting that transfer heuristics from natural-image recognition may not generalise to microscopy. Finally, knowledge distillation substantially improves the deployment frontier: compact EfficientNet-B0 students distilled from teacher councils outperform every individually trained backbone, including the EfficientNet-B5 and EVA-02 teachers. Overall, our results show that rigorous control of pretraining and evaluation is essential for interpreting biomedical architecture benchmarks, while distillation may be a more effective route to practical single-cell classification than architecture choice alone.

[45] From Pixels to Hierarchical Sequences: Quadtree Mask Encoding for Vision-Language Binary Change Detection cs.CVPDF

Xiao An, Ruikang Zhang, Chen Zhong, Xuli Shen, Jiaxing Sun

TL;DR: 本文提出QUAKE-CD框架，将遥感图像中的密集变化检测任务重新定义为语法可验证的结构化生成问题。该框架通过将二值变化掩码表示为语法约束的四叉树标记序列，使掩码更紧凑、可语法检查，并能在自回归生成空间中确定性地解码。此外，作者构建了QUAKE-CoT，将序列与基于视觉证据的思维链轨迹配对，并通过渐进式课程和语法门控双奖励强化学习联合优化文本推理和空间密集预测。

Details

Motivation: 解决现有视觉语言模型在遥感密集变化检测中的局限性，这些模型大多局限于变化描述输出，少数生成像素级掩码的模型仍依赖外部解码器或扁平化的文本作为掩码序列化方法，对于小而碎片化的变化效果不佳。

Result: 在QUAKE-CoT上，QUAKE-CD实现了78.31%的累积F1分数，优于基于解码器和扁平文本作为掩码的视觉语言模型，同时产生更忠实于双时相图像的推理结果。

Insight: 创新点在于将密集变化预测重构为语法约束的结构化生成任务，利用四叉树编码实现掩码的紧凑表示和可验证性，并通过结合思维链和强化学习联合优化推理与预测，提升了模型对复杂变化的处理能力。

Abstract: Dense change detection in remote sensing requires vision-language models (VLMs) to compare bi-temporal images and generate accurate pixel-level masks. Existing VLMs are largely confined to change captioning outputs, and the few that produce pixel-level masks still rely on external decoders or flat text-as-mask serialization, which are less effective for small and fragmented changes. We introduce QUAKE-CD, a framework that recasts dense change prediction as syntax-verifiable structured generation. QUAKE-CD represents binary change masks as grammar-constrained quadtree token sequences, making the masks compact, syntactically checkable, and deterministically decodable within an autoregressive generation space. We further construct QUAKE-CoT, which pairs these sequences with chain-of-thought traces grounded in visual evidence, and jointly optimizes textual reasoning and spatial dense prediction through a progressive curriculum followed by grammar-gated dual-reward RL. On QUAKE-CoT, QUAKE-CD achieves 78.31% accumulated F1, outperforming decoder-based and flat text-as-mask VLMs while producing more faithful bi-temporal reasoning.

[46] StreetDiff: Multi-view Street Scenes Generation via Cross-view Consistent Multi-view Stable Diffusion with Structure Prompts cs.CVPDF

Qi Zhang, Yanyifan Wang, Weiyuan Zhang, Hui Huang

TL;DR: StreetDiff提出了一种多视角扩散框架，通过全景-透视协同设计和全景对齐模块（PAM），在去噪过程中显式加强跨视图对齐，以解决现有多视角扩散模型在复杂城市街景生成中存在的物体重复、结构扭曲和布局不一致问题。

Details

Motivation: 现有多视角扩散模型在具有强几何先验和稀疏语义的场景（如室内房间或简单户外环境）中表现良好，但在相机旋转下难以保持跨视图一致性，尤其是在结构复杂的城市环境中，缺乏对视图间球形对应的显式建模会导致上述问题。

Result: 在构建的大规模HDR多视角城市全景数据集Street360上进行的大量实验表明，StreetDiff相比先前的多视角扩散生成方法，显著提高了结构一致性和视觉保真度。

Insight: 创新点在于提出了全景-透视协同设计来解耦全局布局推理与局部细节合成，并引入了基于球形投影的注意力约束的全景对齐模块（PAM），在不修改扩散主干网络的情况下注入结构化对齐约束，实现了鲁棒的跨视图一致性。

Abstract: Multi-view diffusion models have shown strong performance in scenes with strong geometric priors and sparse semantics, such as indoor rooms or simple outdoor environments (e.g., fields, courtyards). However, they often fail to maintain cross-view consistency under camera rotation, especially in structurally complex urban environments. Without explicit modeling of spherical correspondence across views, existing approaches tend to produce object duplication, structural distortion, and layout inconsistency. To address this limitation, we propose StreetDiff, a multi-view diffusion framework that explicitly enforces cross-view alignment during denoising. StreetDiff introduces a Panorama–Perspective Synergy design to decouple global layout reasoning from local detail synthesis, and incorporates a Panorama Alignment Module (PAM) that establishes spherical-projection-based attention constraints across views. By injecting structured alignment constraints without modifying the diffusion backbone, our framework achieves robust cross-view coherence in challenging urban street scene generation tasks. In addition, we construct Street360, a large-scale HDR multi-view urban panorama dataset. Extensive experiments demonstrate that StreetDiff significantly improves structural consistency and visual fidelity compared to prior multi-view diffusion generation methods.

[47] Can We Trust Video Hallucination Detectors? VidHalLoc for Evaluating the Evaluators cs.CVPDF

Xinyu Chen, Adnan Mahmood, Mark Dras

TL;DR: 本文提出了VidHalLoc基准，用于在统一诊断评估协议下评估视频幻觉检测方法的可靠性。该基准包含2000个对抗性幻觉样本，覆盖视频问答和视频描述任务，以及本体论和动态幻觉类别。为高效构建基准，作者引入了VideoHALO，一种基于工程化多智能体工作流的数据构建方法。

Details

Motivation: 现有基准主要评估模型幻觉，但异构机制使得检测器可靠性难以比较，因此需要统一评估协议来系统评估视频幻觉检测方法。

Result: 评估15种方法显示，四种专用检测器的最高总体准确率仅为34.63%，表明现有检测器在不同视频幻觉类型上的可靠性有限。

Insight: 创新点包括提出首个统一诊断评估协议的视频幻觉检测基准VidHalLoc，以及利用多智能体工作流VideoHALO高效构建对抗性样本，为评估检测器可靠性提供了标准化框架。

Abstract: Video-language models and video agents can produce hallucinations that conflict with spatiotemporal evidence. Existing benchmarks mainly evaluate model hallucinations, and heterogeneous mechanisms make detector reliability difficult to compare. We introduce VidHalLoc, a benchmark that evaluates hallucination detection methods under a unified diagnostic evaluation protocol using 2,000 adversarial hallucination samples across Video Question Answering and Video Captioning tasks, spanning Ontology and Dynamic hallucination categories. To construct VidHalLoc efficiently, we introduce VideoHALO, a Harness Engineering-informed multi-agent workflow that decomposes data construction into four executable stages supported by a memory system and a communication protocol. Evaluation of fifteen methods reveals that the four dedicated detectors peak at an Overall accuracy of only 34.63%, indicating limited reliability across video hallucination types [Dataset Repository: https://huggingface.co/datasets/wesfggfd/VidHalLoc].

[48] Putting Captions to the Test: Evaluating Video Caption Quality through Multiple-Choice Question Answering cs.CVPDF

Zizhen Wang, Bo Feng, Zhengfeng Lai, Shiyu Li, Yang Lu

TL;DR: 本文提出CapQuiz，一种基于多选题问答的无参考视频字幕质量评估基准，通过信息保真度视角重新定义字幕质量，要求字幕在保证事实准确性的同时最大化覆盖关键视觉信息。

Details

Motivation: 现有视频字幕评估指标主要依赖生成文本与参考字幕的匹配，但受限于视频描述的‘一对多’特性，常因词汇不匹配或合理的视觉焦点偏移而惩罚高质量字幕，且评估维度单一，无法提供细粒度分析。

Result: 在涵盖24个视频领域和10种问题类型的层次化分类数据集上，CapQuiz与人类判断的相关性显著优于现有指标，并能提供模型性能的可解释性洞察。

Insight: 创新性地将字幕质量评估转化为基于信息保真度的多选题问答任务，通过人类验证的细粒度问题构建无参考评估基准，实现了对字幕覆盖度和事实准确性的综合量化分析。

Abstract: Evaluating video captioning remains a critical challenge for Visual Large Language Models (VLLMs). Existing metrics primarily rely on matching generated text against ground-truth references. This paradigm suffers from the ``one-to-many’’ nature of video description, where high-quality captions are often penalized for lexical mismatches or valid shifts in visual focus. Furthermore, such assessments are typically one-dimensional, failing to provide a fine-grained analysis of caption quality. To address this, we redefine caption quality through the lens of information fidelity: A caption must maximize the coverage of salient visual information while ensuring strict factuality. We introduce CapQuiz, a novel reference-free benchmark that assesses captions based on their utility in answering human-verified, fine-grained, multiple-choice questions derived from the video. CapQuiz features a hierarchical taxonomy of 10 question types (spanning Descriptive and Inferential categories) across 24 diverse video domains. Extensive experiments demonstrate that CapQuiz correlates significantly better with human judgments than existing metrics and offers interpretable insights into model performance.

[49] Multimodal Emotion Recognition in Conversations via Class-Wise Adaptive Modality Fusion and Affective Geometry cs.CVPDF

Oriol Marín, Roger Marí, Gloria Haro, Rafael Redondo

TL;DR: 本文提出了一种用于对话中情感识别（ERC）的多模态方法，通过结合外观与几何视觉表征、类别自适应的模态融合以及基于效价-唤醒度的情感转移先验，来整合文本、音频和视觉线索并建模对话上下文与情感动态。该方法在MELD和IEMOCAP数据集上取得了性能提升。

Details

Motivation: 解决对话情感识别中需要融合异构多模态信息、建模对话上下文以及捕捉情感动态变化的挑战。

Result: 在MELD和IEMOCAP数据集上，几何增强的视觉表征相比仅使用外观特征，加权F1分数分别提升了0.27和4.36个百分点；类别自适应融合相比原始softmax门控机制进一步提升了0.17和0.25个百分点；效价-唤醒度先验在情感发生转移的话语上针对性提升了0.30和0.74个准确率百分点，同时在稳定话语上保持了性能。

Insight: 创新点包括：1）结合面部外观与几何结构（如关键点）的视觉表征；2）根据情感类别自适应地融合不同模态的权重；3）引入效价-唤醒度空间作为先验来建模情感转移。这些结构化线索、情感依赖的模态加权和情感几何提供了互补的优势。

Abstract: Emotion Recognition in Conversations (ERC) requires integrating heterogeneous textual, audio, and visual cues while accounting for conversational context and emotional dynamics. We extend the Self-Distillation Transformer architecture for ERC with appearance+geometry visual representations, class-wise adaptive modality fusion, and a valence-arousal prior for affective transitions. On the MELD and IEMOCAP datasets, geometry-enhanced visual representations improve weighted F1 by 0.27 and 4.36 points over appearance-only features, respectively, while class-wise adaptive fusion provides further gains of 0.17 and 0.25 points over the original softmax gate. The valence-arousal prior yields targeted improvements of 0.30 and 0.74 accuracy points on emotionally shifted utterances while preserving performance on stable turns. These results indicate that structured facial cues, emotion-dependent modality weighting, and affective geometry provide complementary benefits for multimodal ERC.

[50] Elastoformer: Enabling Dynamic Adaptivity via Elastic Model Transformation cs.CV | cs.AI | cs.PF | eess.SYPDF

Sudaksh Kalra, Dolly Sapra

TL;DR: 本文提出Elastoformer框架，将传统神经网络转换为弹性神经网络，实现运行时动态自适应推理。该框架通过单一模型在不同操作模式间动态切换，以适应边缘设备上计算预算的变化，无需维护多个独立模型。

Details

Motivation: 边缘AI系统在动态运行条件下面临延迟、功耗和内存资源的波动约束，而传统深度神经网络缺乏运行时灵活性，导致性能低下。因此需要一种既高效又能在运行时动态扩展的架构。

Result: 实验表明，该框架在计算FLOPs上减少高达85%，延迟降低50%，内存开销减少76%，并在Vision Transformers和CNNs上展示了架构无关性。

Insight: 创新点在于提出一种模块化解决方案，实现单一模型的多模式动态切换，避免了传统多模型方法的管理开销，同时保持了架构通用性。

Abstract: EdgeAI systems are increasingly employing computer vision applications to enable intelligent, on-device decision-making in real-time. However, these deployments face highly dynamic operational conditions, with fluctuating constraints on latency, power availability, and memory resources. Deep Neural Networks (DNN), which follow fixed computational execution flows, lack the flexibility to adapt to such variability, resulting in inefficient and suboptimal performance in edge scenarios. This underscores the need for architectures that are not only efficient but also dynamically scalable at runtime. In this paper, we propose Elastoformer: A framework that transforms conventional neural networks (NN) into Elastic NN capable of real-time elastic inference. Unlike the conventional bag-of-models approach, which requires maintaining multiple independent models for different operating conditions, Elastoformer offers a single, modular solution that dynamically switches between multiple modes of operation at runtime, adapting efficiently to the changing computational budgets of edge devices without the overhead of managing separate models. Experiments reveal that our framework achieves up to 85% reduction in computation FLOPs, 50% reduction in latency and 76% reduction in memory overhead, while showcasing the architecture agnostic nature of the framework across both Vision Transformers and CNNs. Our code is available at https://github.com/sudaksh14/Elastoformer.

[51] Beyond Similarity: Foundation Models as an Efficient Backbone for Training-Free Composed Video Retrieval cs.CVPDF

Dmitry Demidov, Muhammad Zaigham Zaheer, Omkar Thawakar, Abdelrahman Mohamed Shaker, Rao Anwer

TL;DR: 该论文提出了CoVRAGE框架，用于解决组合视频检索（CoVR）任务中效率与细粒度推理之间的权衡问题。该方法无需训练，通过自适应地利用冻结的基础模型在不同检索阶段执行不同深度的推理，实现了可扩展的检索与精细视频理解的结合。

Details

Motivation: 解决组合视频检索任务中存在的根本矛盾：紧凑嵌入虽支持高效、可复用的搜索，但可能遗漏需要细粒度视频推理的瞬时动作、状态变化和细微约束；而统一应用大型多模态模型则会牺牲可扩展性。

Result: 在无需训练的方法中达到了最先进的性能，在Dense-WebVid-CoVR和CoVR-R数据集上分别取得了89.55%和93.43%的R@1召回率，相对于最接近的对比方法有超过+35%和+25%的绝对提升。

Insight: 核心创新在于将冻结的基础模型置于互补角色，根据查询难度自适应调整推理深度，并设计了分阶段处理流程（包括初始搜索、重排序、候选扩展、描述生成和多模态验证），同时为每个阶段适配帧选择、空间分辨率和时间线索，从而在不进行任务特定训练的情况下结合了可扩展检索与细粒度推理。

Abstract: Composed video retrieval (CoVR) searches a gallery for the target video that realizes a natural-language modification of a source clip. However, at gallery scale, this creates a fundamental tension: compact embeddings enable efficient, reusable search but can miss the transient actions, state changes, and subtle constraints that demand fine-grained video reasoning, whereas applying large multimodal models uniformly sacrifices scalability. To address these limitations, we propose that frozen foundation models should instead occupy complementary roles, with inference depth adapted to query difficulty. Based on this premise, we introduce \methodname{}, a framework for training-free \methodexpansion{}. Specifically, a composed-query embedding first searches reusable video-only gallery representations; uncertain queries undergo bounded reranking and candidate expansion; ambiguous edits trigger target-description generation; and only close leading candidates reach multimodal verification. To support these roles, frame selection, spatial resolution, and time cues are adapted to each stage. Across complete target-gallery evaluations, our method reaches state-of-the-art performance among training-free approaches, with 89.55 and 93.43 R@1 on Dense-WebVid-CoVR and CoVR-R, respectively (with more than +35% and +25% absolute margins to the closest counterpart). These results show that adaptively orchestrating foundation-model capabilities can combine scalable retrieval with fine-grained reasoning without task-specific training. The source code and all relevant guidelines are available on https://github.com/demidovd98/CoVRAGE.

[52] Isotropic Embedding Perturbations for Robust Vision Language Encoders cs.CVPDF

Hyesong Choi, Daeun Kim, Song Park, Taekyung Kim, Byeongho Heo

TL;DR: 本文提出了一种名为Aether的新型数据增强方法，该方法在嵌入空间而非输入空间进行扩散式随机扰动，通过受控的alpha混合提供各向同性的正则化，旨在提升视觉语言编码器的鲁棒性和性能。

Details

Motivation: 传统像素级数据增强方法（如RandAug、CutMix等）的组合使用因功能重叠而性能饱和，且可能破坏跨模态对齐，因此需要探索嵌入空间这一新的增强维度。

Result: 在多种架构和识别任务上，Aether相比结合CutMix、Mixup、DropPath和RandAug的先进方案带来了持续的性能提升，并在多模态对齐方面表现出色，超越了传统像素空间增强方法。

Insight: 创新点在于将增强操作从输入空间转移到嵌入空间，利用受控的alpha混合进行各向同性扰动，这既保持了语义一致性，又平滑了表示而不损害细粒度结构信息，为多模态模型提供了更稳定的正则化信号。

Abstract: Data augmentation is fundamental to training modern deep vision and multimodal models. While individual methods, such as RandAug, CutMix, Mixup, RandErase, and DropPath, offer strong regularization effects, their combined use has saturated in performance due to overlapping functionalities, and aggressive pixel-level manipulations may disrupt delicate cross-modal alignment. This saturation motivates the search for a new augmentation axis within the embedding space rather than the input space. We introduce Aether, a simple plug-in method that applies diffusion-style random perturbations in the embedding space via controlled alpha-mixing, specifically designed to provide isotropic regularization that remains semantically consistent. Inspired by feature-space perturbations in language models and image degradation in generative pretraining, Aether induces mild yet effective perturbations that smooth the representations without compromising the fine-grained structural information required for strong vision-language encoders. Across diverse architectures and across multiple recognition tasks, Aether delivers consistent gains over the advanced recipe combining CutMix, Mixup, DropPath, and RandAug—a level of improvement rarely observed with modern augmentation alternatives. Notably, Aether demonstrates superior effectiveness in multi-modal alignment, succeeding where traditional pixel-space augmentations fail by providing a stable, isotropic regularization signal that respects the integrity of the high-dimensional feature space.

Yuchen Pei, Xiaoyu Hu, Yixiong Zou, Dingwen Hu, Hui Chu

TL;DR: 本文提出了一种名为CoReFuse-Med的、针对模态质量差异的、感知退化的再平衡融合框架，用于多模态医学图像分割。该框架旨在解决当空间对齐的输入模态质量不同（特别是分辨率退化）时，融合性能可能低于单模态基线的问题。通过在特征传输中抑制退化信息，并在高层融合中重新平衡模态贡献，该方法在多个数据集上提升了分割精度和鲁棒性。

Details

Motivation: 动机在于解决多模态医学图像分割中，当输入模态质量不一致（如分辨率退化）时，融合性能反而下降的问题。作者发现这是由于训练与推理的不一致性导致的：退化的模态在训练中更新微弱，但在推理中却对预测产生显著干扰。

Result: 在EPVS、BraTS和WMH数据集上进行了实验，测试了多种Z轴切片保留比例和一个辅助的噪声测试。结果表明，所提方法在模态质量差异情况下，相比基线方法，在分割准确性和鲁棒性上均有提升。

Insight: 核心创新点是识别并形式化了多模态融合中的“优化-推理不一致性”问题，并提出了一个针对性的两阶段解决方案：在特征传输阶段抑制退化特征传播，在融合阶段重新平衡模态权重。这为解决模态质量不匹配导致的融合失败提供了一个可借鉴的通用框架。

Abstract: Multi-modal medical image segmentation leverages complementary diagnostic information, yet fusion can underperform single-modality baselines when spatially aligned inputs differ in quality. Here, “corruption” primarily denotes resolution-induced degradation rather than misalignment or complete modality absence, while synthetic noise is evaluated only as an auxiliary setting. We identify a critical optimization-inference inconsistency: degraded modalities can receive weak training updates yet substantially affect predictions, indicating active interference with fusion. We attribute this failure to resampling-induced feature corruption and optimization bias, where noisy features propagate through skip connections and encourage unreliable modality selection. We therefore propose CoReFuse-Med, a Corruption-aware Rebalanced Fusion framework that suppresses corruption during feature transmission and rebalances modality contributions during high-level fusion. Experiments on EPVS, BraTS, and WMH, including multiple Z-axis slice-retention ratios and an auxiliary noise test, demonstrate improved accuracy and robustness under modality-quality discrepancies. Our code is available at https://github.com/lrever/CoReFuse.

[54] SynThermFace: Amplifying Limited Paired Data for Visible-Thermal Face Recognition via Synthetic Data Generation cs.CVPDF

Anjith George, Adam Unal, Sebastien Marcel

TL;DR: SynThermFace是一个用于可见光-热成像跨光谱人脸识别的框架，通过扩散模型将有限的真实可见光-热成像配对数据扩展为大规模合成配对数据集，从而训练适应跨光谱场景的人脸识别模型。

Details

Motivation: 解决跨光谱人脸识别中真实可见光-热成像配对数据稀缺且收集成本高的问题，以提升模型在低光照、夜间等受限条件下的可靠性。

Result: 在MCXFace真实配对协议下，PACT（论文提出的适应目标）优于基线方法；使用更大生成配对数据集训练进一步提升了未适应模型和仅用真实配对数据训练的PACT的性能，并在Tufts数据集上展示了跨数据库泛化能力。

Insight: 创新点在于将合成数据生成从测试时的图像转换转移到训练阶段，通过扩散模型生成大规模配对数据来适应预训练模型，实现单次前向推理，避免了测试时的额外计算开销。

Abstract: Face recognition (FR) is a widely used modality for biometric authentication, but conventional models rely on visible-spectrum imagery and degrade when high-quality RGB images cannot be captured. Cross-spectral face recognition addresses this limitation by matching visible images with other modalities such as thermal imagery, enabling more reliable performance in low-light, nighttime, and unconstrained conditions. However, progress is limited by the scarcity of paired visible-thermal data, which is difficult and costly to collect at scale. We propose SynThermFace, a framework that amplifies limited real visible-thermal supervision into larger paired adaptation datasets for cross-spectral face recognition. A diffusion model is first adapted using a limited set of paired visible–thermal images and then used to generate large-scale paired visible–synthetic thermal data from existing real or synthetic visible face datasets. The generated pairs are used to adapt a pretrained visible-spectrum face recognition model into a CFR model. Unlike synthesis-based approaches that require image translation at test time, the proposed method shifts generation to the training stage and performs inference with a single forward pass through the adapted recognition model. Under the same MCXFace real-pair protocol, PACT improves over the evaluated CFR adaptation baselines, isolating the effect of the proposed adaptation objective. Training PACT on larger generated paired datasets provides additional improvements over both the unadapted model and the real-pair PACT configuration. Cross-database evaluation on the Tufts dataset provides evidence that the learned representation transfers to an unseen database. The source code and trained models will be made publicly available.

[55] UOT-Gap: A Variational Principle for the Modality Gap in Vision-Language Models via Unbalanced Optimal Transport cs.CVPDF

Zonglin Yang, Huilan Ma, Xudan Zheng, Yuejun Xie

TL;DR: 本文提出UOT-Gap，一种无需训练的变分诊断方法，利用不平衡熵最优传输（UOT）分析视觉-语言模型中图像和文本嵌入之间的模态间隙。该方法将UOT最优解分解为传输、耦合复杂度和边缘质量变化，并通过配对感知残差比较观察到的图像-标题对与UOT软匹配。在Flickr8K和COCO-1K数据集上使用冻结的CLIP、OpenCLIP和SigLIP编码器进行实验，表明UOT-Gap能有效诊断标题质量、模态对齐和检索鲁棒性。

Details

Motivation: 现有研究将视觉-语言模型（如CLIP）中的模态间隙归因于初始化、对比动态和信息不平衡，但其分布性和配对性对检索性能的影响尚未解决。本文旨在通过不平衡最优传输提供一种变分诊断工具，以深入理解模态间隙的本质及其对检索任务的影响。

Result: 在Flickr8K和COCO-1K数据集上，使用冻结的CLIP、OpenCLIP和SigLIP编码器进行实验，标题退化使Flickr8K的Recall@1从0.559降至0.003。在六种数据集-模型条件下，配对感知残差与检索退化之间的平均绝对斯皮尔曼相关系数为0.973，远高于平均间隙的0.392。在五个随机COCO-1K子集上，该关联保持稳定（0.954±0.026，最小0.943）。UOT重心更新降低了传输目标但恶化了检索，区分了几何目标下降与任务改进。

Insight: 创新点在于引入不平衡熵最优传输（UOT）作为变分原理来建模模态间隙，将UOT最优解分解为可解释的组件，并设计配对感知残差来量化观察配对与UOT软匹配之间的差异。这提供了一种无需训练的诊断框架，能够系统评估嵌入对齐质量、标题退化影响和检索鲁棒性，为视觉-语言模型的模态间隙分析提供了新的理论工具和实证指标。

Abstract: Vision-language models such as CLIP embed images and text in a shared space, where modality-specific distributions often remain separated. Existing accounts connect this modality gap to initialization, contrastive dynamics, and information imbalance, while its distributional and pairwise contributions to retrieval remain unresolved. We introduce UOT-Gap, a training-free variational diagnostic that models frozen image and text embeddings with unbalanced entropic optimal transport (UOT). The UOT optimum separates transport, coupling complexity, and marginal mass variation; a complementary pair-aware residual compares observed image-caption pairs with the UOT soft matching. On Flickr8K and COCO-1K with frozen CLIP, OpenCLIP, and SigLIP encoders, caption degradation reduces Flickr8K Recall@1 from 0.559 to 0.003. Across six dataset-model conditions, the pair-aware residual tracks retrieval degradation with mean absolute Spearman 0.973, compared with 0.392 for the mean gap. The association remains stable across five random COCO-1K subsets at $0.954\pm0.026$, with a minimum of 0.943. UOT barycentric updates reduce the transport objective while degrading retrieval, distinguishing geometric objective descent from task improvement. These results establish UOT-Gap as a diagnostic for caption quality, modality alignment, and retrieval robustness.

[56] Decoupled Self-Forcing Distillation for Streaming Talking Head Generation cs.CVPDF

Yanru An, Ruiyan Wang, Wenwu Wei, Rui Bu, Qi Wang

TL;DR: 本文提出了一种解耦自强制蒸馏方法，用于流式说话头生成，通过将音频融合到低维身份解耦的运动空间中，并使用小型因果自回归变换器生成运动潜在表示，再由预训练扩散渲染器转换为视频，从而在保证高保真度的同时实现了高效生成。

Details

Motivation: 解决流式说话头生成中保真度与效率之间的矛盾：端到端方法直接以音频为条件使用视频扩散模型，虽质量高但计算量大；两阶段方法生成中间运动表示则保真度较低，主要问题在于音频与视频潜在表示中身份、外观和背景等无关信息的耦合导致细节模糊和容量浪费。

Result: 该方法在流式生成中达到15.4 FPS和1.3秒延迟，且无质量下降，实现了高保真度与高效率的平衡。

Insight: 创新点包括将音频条件融合到低维身份解耦的运动空间，按时间粒度路由音频和运动描述，以及通过解耦自强制蒸馏在单个冻结教师模型下同时训练渲染器和运动生成器，利用视频渲染结果监督运动生成，从而提升保真度上限。

Abstract: Streaming talking-head generation produces each frame as its driving audio arrives, yet fidelity and efficiency have so far pulled in opposite directions: end-to-end methods condition a video diffusion model on audio directly and achieve high quality but only at large scale, while cheaper two-stage methods generate an intermediate motion representation and trail in fidelity. We argue the cost of the former lies in the target of fusion: the video latent is dominated by identity, appearance and background, none of which audio bears on, so coupling audio to every pixel blurs detail and wastes capacity. We instead fuse conditions in a low-dimensional identity-disentangled motion space, routing audio and motion captions by their temporal granularity, and generate motion latents with a small causal autoregressive transformer that a pretrained diffusion renderer turns into video. Conditions thus control video transitively, and high fidelity no longer requires a large backbone. Streaming this decomposition needs both models to be causal, and the exposure-bias problem could be solved by self-forcing given a bidirectional teacher. But there is no such teacher in motion space. Our decoupled self-forcing distillation resolves both models under one frozen teacher: conditioned on motion, it distills the renderer into a block-causal student; unconditionally, it scores rendered rollouts against real videos, supervising motion by the video it produces. This lifts the fidelity ceiling from the motion generator onto the stronger renderer. The two models run as parallel causal streams, reaching 15.4 FPS at 1.3 s latency with no quality degradation.

[57] Geometry Without Coordinates: LiDAR Diffusion as a 3D Feature Bridge cs.CVPDF

Samed Doğan, Nico Leuze, Alfred Schöttl

TL;DR: 本文提出了一种基于LiDAR条件扩散模型的方法，通过利用2D基础模型的伪标签进行训练，将丰富的2D先验知识迁移到稀疏的3D LiDAR数据中。该模型支持多种输出模态（如深度、语义分割和实例预测），并可通过文本提示选择任务。研究发现，该模型能够在仅使用2D监督的情况下，诱导出结构化的3D表示，为大规模2D先验向稀疏3D领域的迁移提供了有效机制。

Details

Motivation: 由于数据和标注稀缺，训练大规模原生3D基础模型存在挑战，因此需要将大型2D基础模型的丰富先验迁移到稀疏3D LiDAR数据中。

Result: 线性探针在3D语义类别上恢复了约23%的平均交并比（MIoU），而匹配的高斯噪声控制仅为约3.5%，表明模型具有显著的非平凡结构。通过跨模态特征流的成对余弦相似性分析，揭示了特征的分层组织。

Insight: 创新点在于利用LiDAR条件扩散模型作为2D到3D的特征桥梁，通过2D监督学习3D表示，并分析了特征在点云空间中的分层结构（早期编码器层弱对齐，中间层趋于共享表示，解码器层重新专门化）。这为无坐标几何分析和跨模态表示学习提供了新视角。

Abstract: Transferring the rich priors of large 2D foundation models to sparse 3D LiDAR remains challenging, as training native 3D foundation models at comparable scale is limited by data and annotation scarcity. We introduce a LiDAR-conditioned diffusion model trained on pseudo-labels from off-the-shelf 2D foundation models. The model supports multiple output modalities, including depth, semantic segmentation and instance prediction, selectable via a textual task prompt. Because the model is conditioned on LiDAR, both its outputs and its intermediate UNet features can be projected back onto the input point cloud, enabling analysis of a 3D representation learned entirely under 2D supervision. We study this representation directly in point-cloud space, explicitly excluding raw spatial coordinates to isolate feature content from projection geometry. Linear probes recover up to ~23% Mean Intersection over Union (MIoU) on 3D semantic classes, compared to ~3.5% for a matched Gaussian-noise control, indicating substantial non-trivial structure. Pairwise cosine similarity across modality-specific feature streams reveals a layered organization. Early encoder layers remain weakly aligned across modalities while individually decodable, intermediate layers converge toward a shared representation, and decoder layers re-specialize toward task-specific outputs. These findings indicate that LiDAR-conditioned diffusion models can induce structured 3D representations from 2D supervision alone, with a modality-dependent manifold that locally unifies near a shared bottleneck. This positions diffusion as a viable mechanism for transferring large-scale 2D priors into sparse 3D domains.

[58] Learning to Adapt and Calibrate: Score Distribution Alignment for Few-Shot Uncertainty Prediction in Medical VLMs cs.CVPDF

Xuan Cuong Ngo, Ngan Le

TL;DR: 本文提出AlignCP框架，旨在解决医学视觉-语言模型（VLM）在少样本迁移场景中，由于监督微调导致非共形分数分布偏移，从而破坏校准与查询样本的可交换性，进而影响共形预测不确定性估计可靠性的问题。该框架通过学习重加权校准分布，对齐标注支持集与未标注查询集的一维非共形分数分布，以在不依赖查询标签的情况下弥补因模型适应带来的覆盖差距。

Details

Motivation: 在医学VLM的少样本迁移学习中，标准的共形预测方法依赖于校准集与测试集的可交换性，且需要足够大的校准集以保证覆盖可靠性。然而，监督微调会改变模型参数并导致非共形分数分布偏移，破坏可交换性，而现有方法为避免监督更新以保持有效性，却未能充分利用稀缺的标注支持数据进行任务适应。

Result: 摘要中未提及具体的定量实验结果、基准测试或达到的水平（如SOTA）。

Insight: 创新点在于提出AlignCP框架，通过分布对齐技术（学习重加权校准分布）来协调监督少样本适应与非可交换性下的共形不确定性估计，使得共形预测能够作为支持已适应模型的不确定性估计层，而非阻碍适应本身，从而在少样本场景下实现更可靠的不确定性量化。

Abstract: Uncertainty estimation for medical vision–language models (VLMs) using conformal prediction has gained increasing attention due to its distribution-free coverage guarantees. However, standard conformal prediction relies on exchangeability between calibration and test data and typically requires a sufficiently large calibration set to obtain reliable coverage. These assumptions are difficult to satisfy in few-shot transfer settings, where only a small labeled support set is available to adapt a pretrained VLM to a new medical task, while an unlabeled query set is used for evaluation. Supervised fine-tuning on the support set changes the model parameters and consequently shifts the nonconformity score distribution, breaking exchangeability between calibration and query samples and leading to unreliable coverage under distribution shift. Existing transductive conformal adaptation methods often preserve validity by avoiding supervised updates. While this helps maintain conformal assumptions, it underutilizes the scarce labeled support data and limits task adaptation, which is the primary objective in few-shot learning. In this setting, conformal prediction should serve as an uncertainty estimation layer that supports the adapted model, rather than preventing adaptation itself. To this end, we propose AlignCP, a framework that reconciles supervised few-shot adaptation with conformal uncertainty estimation under non-exchangeability. AlignCP learns a reweighted calibration distribution that reduces the score-level discrepancy between the labeled support set and the unlabeled query set. By aligning the one-dimensional nonconformity score distributions, AlignCP aims to close the coverage gap induced by adaptation without requiring query labels.

[59] Beyond One-Size-Fits-All: Sample-Adaptive Strategy Routing for Vision Token Pruning in MLLMs cs.CV | cs.AIPDF

Haiji Liang, Pengfei Zhou, Zhenglin Wan, Wei Wang, Yang You

TL;DR: 本文提出VIP-Router，一种轻量级的视觉剪枝路由器，用于多模态大语言模型（MLLMs）中的视觉令牌剪枝。它通过分析输入样本的特征，自适应地为每个样本选择最合适的剪枝策略，而不是对所有输入采用单一固定策略，从而在保持低计算开销的同时显著提升性能。

Details

Motivation: 现有视觉令牌剪枝方法隐含地假设单一固定剪枝策略可统一适用于所有输入，但分析表明不同策略在大量样本上存在互补性；因此需要一种能根据输入样本自适应选择最优剪枝策略的方法，以充分利用策略多样性并降低推理成本。

Result: 在精心构建的剪枝敏感视觉感知基准测试集VTC-Bench Group A上，VIP-Router在所有缩减比下均优于最佳固定策略基线，平均准确率相对提升26.9%，考虑实际令牌成本后平均效用相对提升22.0%；且该方法在不同MLLM骨干网络和未见过的基准测试上均表现出一致增益。

Insight: 创新点在于提出了样本自适应的策略路由框架，揭示了剪枝策略的样本级互补性，并通过轻量级路由器实现即插即用式自适应选择，无需修改底层剪枝算法或模型权重，仅引入相当于骨干网络0.017%的可训练参数。

Abstract: Multimodal large language models (MLLMs) process hundreds or thousands of visual tokens per image, incurring prohibitive inference costs. While existing vision token pruning methods mitigate this overhead, they implicitly assume that a single fixed pruning strategy can be applied uniformly across all inputs. Our analysis further reveals that ranking pruning methods by average benchmark accuracy conceals substantial sample-wise complementarity: although the average-best strategy excels overall, alternative strategies prove superior on a significant fraction of individual samples. To harness this diversity, we propose VIP-Router, a lightweight VIsion Pruning Router that adaptively selects the pruning strategy predicted to be best suited to each input at a specified pruning level. Conditioned on low-cost visual and textual features, VIP-Router identifies the most suitable candidate strategy while retaining full-token inference as an option when pruning is predicted to be unfavorable. Evaluated on a curated suite of pruning-sensitive visual perception benchmarks, VTC-Bench Group A, VIP-Router consistently outperforms the best fixed strategy baseline across all reduction ratios, achieving a 26.9% relative improvement in average accuracy, and a 22.0% relative increase in average utility after accounting for realized token cost. Crucially, VIP-Router operates in a plug-and-play manner without modifying underlying pruning algorithms or model weights, introducing trainable parameters equivalent to merely 0.017% of the backbone. Furthermore, VIP-Router proves effective across various MLLM backbones and yields consistent gains on unseen benchmarks, highlighting the potential of sample adaptive routing for visual token pruning.

[60] Spot-the-shift: Evaluating Grounded Image Difference Captioning of Long-term Changes cs.CVPDF

Benedetta Liberatori, Nermin Samet, Paolo Rota, Matthieu Cord, Elisa Ricci

TL;DR: 本文提出了SPOT-THE-SHIFT基准，用于评估模型在真实世界驾驶场景中对长期变化的、基于定位的图像差异描述能力。该基准包含人工验证的自然语言描述和空间掩码，并提出了可靠的评估协议。研究发现现有MLLMs在此任务上表现不佳，并开发了一个合成数据生成流程来提升模型性能。

Details

Motivation: 解决长期变化理解任务中，现有像素级预测或差异描述方法不足以可靠评估模型检测和描述变化能力的问题。

Result: 在提出的SPOT-THE-SHIFT基准上评估了最先进的多模态大语言模型（MLLMs），发现它们在处理该任务所需的细粒度多图像空间能力方面存在困难。通过合成数据生成流程，成功提升了现成MLLM的性能，且未牺牲其通用能力。

Insight: 创新点在于构建了一个包含空间定位信息的人工验证基准和评估协议，以更可靠地衡量模型对长期变化的描述能力；同时，合成数据生成方法为提升特定任务性能而不损害模型通用性提供了可行路径。

Abstract: Long-term change understanding from images of the same place revisited over time is a challenging task with applications in map maintenance and urban infrastructure monitoring. Prior work addresses it either through pixel-level prediction or difference captioning, neither of which is sufficient to reliably measure how well models detect and describe such changes. We introduce SPOT-THE-SHIFT, a human-verified benchmark for grounded image difference captioning of long-term changes in real-world driving scenes. Our benchmark provides natural language captions and spatial masks for structural changes across each image pair. We further propose an evaluation protocol that reliably assesses models’ captioning ability, validated through human studies. Benchmarking state-of-the-art MLLMs, we find that models struggle with the fine-grained multi-image spatial capability required for this task. Finally, we develop a synthetic data generation pipeline that improves an off-the-shelf MLLM without sacrificing general capabilities.

[61] Why Is Video Still So Expensive? A Survey of Inference-Efficiency Mechanisms in Video and Audiovisual LLMs cs.CV | cs.CL | cs.MMPDF

Killian Steunou, Yannis Tevissen, Mounîm A. El Yacoubi

TL;DR: 这篇论文是一篇关于视频和视听大语言模型（VideoLLMs）推理效率机制的综述，系统性地梳理了自2022年底以来为降低模型参数、计算量、延迟、内存和视觉/音频token数量而提出的各种方法。

Details

Motivation: 视频理解任务正快速向视频大语言模型发展，但其在字幕生成、问答、检索和时间定位等任务上的强大性能伴随着随帧数和上下文长度增长的计算与内存成本，这限制了其在实时、移动和资源受限环境中的部署。

Result: 论文汇总了文献中在共享主干模型和输入协议下报告的精度-成本比较数据，区分了异质性的跨论文证据，并指出了视听效率评估标准化方面的不足。

Insight: 创新点在于从帧采样、模态编码、连接器层token缩减以及LLM预填充和解码等多个流水线阶段，系统地分析和组织了提升VideoLLMs推理效率的机制，并维护了一个开源资源库以汇总相关研究。

Abstract: Video understanding has rapidly evolved toward video large language models (VideoLLMs): systems that couple video representations with pretrained large language models and condition generation on a textual prompt. Their strong performance on captioning, question answering, retrieval and temporal grounding comes at a computation and memory cost that grows with frame count and context length, limiting deployment in real-time, mobile and resource-constrained settings. This survey covers inference-efficiency mechanisms for visual and audiovisual VideoLLMs that report concrete reductions in parameter count, FLOPs per input, latency, memory, or visual and audio token count. We analyze bottlenecks across frame sampling, modality encoding, connector-level token reduction, and LLM prefilling and decoding. We organize methods by the pipeline stage at which they act, covering VideoLLMs developed since late 2022 together with earlier frame-sampling and vision-encoder mechanisms that remain components of current pipelines. We assemble literature-reported accuracy–cost comparisons under shared host models and input protocols wherever available, distinguish them from heterogeneous cross-paper evidence, and identify gaps in audiovisual efficiency and standardized evaluation. We maintain a repository at https://github.com/momentslab/awesome-efficient-videollm.

Muhammad Farhan Humayun, Mohammad Imangholiloo, Afifah Shah, Tomi Westerlund, Jukka Heikkonen

TL;DR: 本文提出了一种两阶段弱监督水体分割框架，用于高分辨率多光谱影像。第一阶段从栅格化的矢量伪标签中学习初始掩码，第二阶段将这些掩码转换为结构化的组件提示，以进行局部细化。该方法旨在解决官方水文矢量作为弱监督源时存在的边界噪声、时间不匹配和小型水体结构遗漏等问题。

Details

Motivation: 高分辨率水体制图对于环境监测至关重要，但获取精确的像素级标注成本高昂且困难。使用官方水文矢量作为弱监督虽然可扩展，但存在边界噪声、时间不匹配和遗漏小水体结构等伪影问题，需要改进。

Result: 在手动校正的验证集上，该方法将SegFormer-B0的IoU从0.9509提升至0.9535，U-Net的IoU从0.9408提升至0.9486，F1分数也相应提高。细化过程带来了更清晰的海岸线、减少的边界溢出和更好的细结构描绘。

Insight: 核心创新点在于将初始分割掩码转换为结构化的组件提示，以指导局部区域的细化，从而针对性地纠正全局训练监督难以捕捉的局部错误。这为利用弱监督进行精细分割提供了一种新的提示引导优化思路。

Abstract: High-resolution water mapping supports environmental monitoring and related applications, but accurate pixel-level labels are difficult and costly to produce. Official hydrographic vectors provide scalable weak supervision, but they contain artifacts like boundary noise, temporal mismatch, and omissions of small water structures. We propose a two-stage framework for weakly supervised water segmentation in high resolution multispectral imagery. Stage 1 learns initial masks from rasterized vector pseudo-labels, and Stage 2 converts these masks into structured component-wise prompts for localized refinement. On a manually corrected validation set, refinement improves SegFormer-B0 from 0.9509 to 0.9535 IoU and U-Net from 0.9408 to 0.9486 IoU, with corresponding F1 gains from 0.9749 to 0.9762 and 0.9695 to 0.9736. It leads to sharper shorelines, reduced boundary spillover, and better thin-structure delineation. The results indicate that prompt-guided refinement can improve pseudo-label-based water segmentation by targeting local errors that are poorly captured by global training supervision.

[63] Enhanced Deformable Convolution with Center-invariant Offset and Edge-aware Mask cs.CVPDF

Yixiao Li, Xiaoyuan Yang, Jin Jiang, Minghao Zou, Guanghui Yue

TL;DR: 本文提出了一种增强型可变形卷积网络（EDCN），用于语义分割任务。该方法通过引入中心不变偏移模块（COM）和边缘感知掩码模块（EMM），改进了传统可变形卷积在动态空间建模中的不足。实验表明，EDCN在多个主流分割数据集上超越了现有的可变形卷积变体。

Details

Motivation: 传统可变形卷积网络虽然具有动态空间建模能力，但由于密集的偏移和缺乏长程依赖，难以实现精确的特征表示变形。本文旨在解决这些问题，提升语义分割的性能。

Result: 在主流语义分割数据集上的实验表明，EDC超越了包括Deformable ConvNets V1-V4和Entire Deformable ConvNets在内的最先进可变形卷积变体。消融研究也证实了各模块的有效性。

Insight: 创新点在于设计了中心不变偏移模块（COM）来获取更符合目标的偏移，以及边缘感知掩码模块（EMM）来基于内容重要性选择性应用变形，从而减少不必要的变形并增强空间适应性和目标聚焦能力。

Abstract: Deformable convolution networks have recently become popular for many computer vision tasks, especially for semantic segmentation, because of their exceptional capabilities in dynamic spatial modeling. However, due to the dense deformable offsets and the lack of longer-range dependencies, they can not fully adopt proper and precise deformations for feature representations. To tackle the issues, in this paper, we propose Enhanced Deformable ConvNets (EDCN) for semantic segmentation. Specifically, a novel Enhanced Deformable Convolution (EDC) is exploited in the decoder, which integrates the Center-invariant Offset Module (COM) and Edge-aware Mask Module (EMM). The COM employs larger kernels and eliminates deformations at the kernel center, obtaining offsets that are more in line with the target from richer spatial information. Concurrently, the EMM obtains the significance of image content via Sobel edge detection, then selectively applies deformations based on the content significance, minimizing unnecessary deformations associated with relatively less important information, thereby avoiding impact from less informative regions. Experiments show that EDC outperforms state-of-the-art deformable convolution variants, including Deformable ConvNets V1-V4 and Entire Deformable ConvNets, across mainstream segmentation datasets with various decoder settings. Moreover, ablation studies confirm the effectiveness of each component. In addition, visualizations illustrate that EDC enhances spatial adaptation and target focus. We further analyze the extendibility of EDC to larger kernels on the image classification benchmark. Code will be publicly released.

[64] Programmable World Model cs.CVPDF

Zheng-Hui Huang, Guixu Lin, Jiacheng Lin, Yi-Chuan Huang, Ruihan Yu

TL;DR: 本文提出了Programmable World Model框架，将世界状态演化与视觉观察生成解耦，通过自然语言指令生成可执行程序来控制实体状态和状态转换规则，并使用状态增强的3D定向包围盒作为中间表示，结合预训练视频模型实现可编程、持久的世界状态生成。

Details

Motivation: 现有视频世界模型缺乏维护持久世界状态和执行可编程规则的可靠机制，无法在长时间交互中保持状态一致性和可控性。

Result: 在CombatStateBench基准测试中，该方法达到了94%的计数准确率和98%的状态准确率，显著优于现有交互式视频世界模型，并支持连贯的长时程生成。

Insight: 创新点在于将显式状态演化与生成渲染分离，通过程序化规则控制实体状态，并使用状态增强的3D OBB作为确定性中间表示，实现了对持久世界状态的可编程控制。

Abstract: Recent video world models generate increasingly realistic and interactive visual experiences, yet lack reliable mechanisms for maintaining persistent world state and enforcing programmable rules over extended interactions. We introduce Programmable World Model, a framework that decouples world-state evolution from visual observation generation. An agent translates natural-language instructions into executable programs that specify entity states and state-transition rules, enabling direct control over individual entities and their interactions. A lightweight engine executes these programs to update and maintain an explicit, persistent global world state, including off-screen entities and non-visual attributes. To connect world state with visual generation, we introduce state-augmented 3D oriented bounding boxes (OBBs) as an intermediate representation. This representation, together with the target camera trajectory, is deterministically compiled into pixel-aligned spatiotemporal conditioning signals for a pretrained video model serving as the generative renderer. This design allows users to create playable games with predefined mechanics, direct control over individual entities, and persistent world state throughout gameplay. We further introduce CombatStateBench, a benchmark for evaluating programmable world models. On CombatStateBench, our method achieves 94% Count Accuracy and 98% State Accuracy, substantially outperforming existing interactive video world models while supporting coherent long-horizon generation. These results demonstrate the effectiveness of separating explicit state evolution from generative rendering for building persistent, programmable worlds.

[65] Artificial Intelligence Literacy and Sustainable Development: An Ethical Governance and Development Goals Framework cs.CVPDF

Md. Masudul Islam, Mirza Niaz Morshed, Md. Shafiqul Islam

TL;DR: 该研究将人工智能素养定位为一种治理能力，旨在补充和加强所有17项联合国可持续发展目标。它引入了一个包含六个层级的人工智能推理与伦理分类法，将伦理判断和战略远见融入传统学习模型，并以此为基础构建了一个连接教育、治理和可持续发展的综合框架。一项针对300名来自不同专业背景参与者的调查显示，公众具备较强的技术意识，但伦理和治理准备度不足，突显了负责任管理人工智能所需公共能力的关键缺口。研究发现，伦理推理和反思性思维是可持续且可信赖地使用人工智能的最强预测因素。

Details

Motivation: 解决当前人工智能发展过程中，公众和机构在伦理判断、治理能力和战略决策等高级能力方面的不足，以支持符合可持续发展目标的、合乎伦理且透明的人工智能技术发展。

Result: 通过对300名参与者的调查发现，公众技术意识强，但伦理与治理准备度有限；研究结果表明，伦理推理和反思性思维是预测可持续、可信赖人工智能使用的关键因素。

Insight: 创新性地提出了一个将伦理判断和战略远见系统化纳入的人工智能素养六层级分类法，并以此构建了一个整合教育、治理与可持续发展的框架，强调了将素养能力嵌入课程、制度和治理机制以实现负责任发展的路径。

Abstract: AI literacy provides foundational competencies that support ethical, transparent, and sustainable technological development, although higher-order capabilities such as governance, critical evaluation, and strategic decision-making extend beyond basic literacy into advanced levels of AI competency. This study positions AI literacy as a governance capacity that complements and strengthens all 17 SDGs. It introduces a six-level taxonomy of artificial intelligence reasoning and ethics that extends traditional learning models by incorporating ethical judgement and strategic foresight. This taxonomy forms the foundation of an integrated framework linking education, governance, and sustainable development. A survey of 300 participants from diverse professional backgrounds within a national context which reveals strong technical awareness but limited ethical and governance readiness, highlighting critical gaps in public capacity to manage artificial intelligence responsibly. Findings show that ethical reasoning and reflective thinking are the strongest predictors of sustainable and trustworthy artificial intelligence use. The study proposed to embed literacy-based competencies into curricula, institutional policies, and governance mechanisms to accelerate equitable and responsible progress toward sustainable development goals

stat.ML [Back]

[66] FlowCPO: A Unified Divergence View of Preference Alignment for Flow Models stat.ML | cs.AI | cs.CV | cs.LGPDF

Yansen Han, Shengyi Liao, Peng Sun, Deyuan Liu, Yuanxing Zhang

TL;DR: 本文提出了FlowCPO，一种基于前向KL散度的离线偏好对齐方法，用于流模型和扩散模型。该方法通过一个基于散度的统一框架，将在线强化学习和离线偏好优化联系起来，避免了在线采样的需求，并在固定数据上使用偏好和非偏好样本进行优化。

Details

Motivation: 现有流模型和扩散模型的偏好对齐方法存在割裂：在线方法需要当前模型的新鲜样本，而离线方法主要依赖仅正样本微调或DPO风格的似然比替代目标。本文旨在建立一个统一的散度视角来理解这些方法，并设计一种无需在线采样的离线前向KL目标。

Result: 在线性插值假设和显式正则条件下，证明了前向KL目标被一个对比流匹配损失所界定，从而得到可处理的替代损失。在领域内设置中，FlowCPO在GenEval和OCR分数上均优于基线（如FlowDPO），分别达到0.84和0.87（CFG 3.0下）。在领域外设置中，结果好坏参半，取得了最佳的GenEval结果，但在多个指标上的奖励分数低于RFT。

Insight: 主要创新点在于提出了一个统一的散度框架来组织不同的偏好对齐方法，并推导出FlowCPO这一离线前向KL目标。其优势在于同时利用偏好和非偏好样本，且损失非负（避免了FlowDPO中带符号回归损失可能无下界的问题），为流模型的离线偏好优化提供了一个理论可靠且实践可行的新方案。

Abstract: Preference alignment for flow and diffusion models now spans online reinforcement learning and offline preference optimization, but the relation between these methods remains unclear. In particular, existing forward-process alignment methods require fresh samples from the current model, while offline methods based on fixed preference pairs rely primarily on positive-only fine-tuning or DPO-style likelihood-ratio surrogates. We organize these approaches through a divergence-based framework and introduce FlowCPO, an offline forward-KL objective that uses both preferred and dispreferred samples without online rollouts. For linear interpolation, we show under explicit regularity conditions that the forward-KL objective is bounded by a contrastive flow matching loss, yielding a tractable surrogate on fixed data. We further show that this loss is nonnegative, whereas the signed regression loss of simplified FlowDPO can be unbounded below. In the in-domain setting, FlowCPO achieves higher mean GenEval and OCR scores than the evaluated baselines, reaching 0.84 and 0.87 versus 0.81 and 0.74 for FlowDPO at CFG 3.0. In the out-of-domain setting, the results are mixed, with the best GenEval result but lower reward scores than RFT on several metrics.

math.NT [Back]

[67] What Does MMLU Actually Measure? A Psychometric Audit of Difficulty Structure in Aggregate Benchmark Scores math.NT | cs.CLPDF

Dana Paquin, Riddhiman Jain

TL;DR: 本文通过心理测量学方法对MMLU基准测试进行审计，发现其总分主要评估模型的事实检索能力而非推理能力。研究使用项目反应理论校准了14,042个测试项目的难度，并构建了结构复杂性的确定性框架，证明MMLU混淆了可分离的构念。研究发现总分排名更接近非STEM科目准确率，且推理深度增加时高能力模型性能下降更明显。

Details

Motivation: 尽管MMLU被广泛用作评估AI通用能力的基准，但其总分是否能有效衡量推理能力存在疑问，需要验证其心理测量学特性。

Result: 通过回归分析发现，结构复杂性到难度的映射在STEM和非STEM分区间不具有不变性；控制多项选择猜测基线后，高能力模型在推理深度增加时性能下降更陡峭；总分排名与STEM准确率的相关性较弱，基于总分选择Top-50模型会导致约22%的STEM适用选择被替换。

Insight: 创新点在于将心理测量学（项目反应理论）和确定性结构复杂性框架引入基准测试审计，揭示了MMLU总分对检索能力的偏好偏差；建议采用分项报告而非聚合分数，并提供了可复现的审计工具。

Abstract: Although MMLU is widely adopted as a benchmark for calibrating general AI capabilities, we psychometrically demonstrate that its aggregate score primarily evaluates a model’s factual retrieval capacity rather than its reasoning ability. By calibrating item difficulty for 1,000 open-weights language models over 14,042 MMLU test items using Item Response Theory, we show that evaluating both abilities via a single test is inherently flawed. Difficulty is then regressed on a deterministic, text-extractable framework of structural complexity. Applying a joint Wald test with subject-clustered covariances demonstrates that the MMLU conflates fundamentally separable constructs. The mapping from structural complexity to difficulty is not invariant across the benchmark’s STEM and non-STEM partitions. This finding has practical consequences. Aggregate leaderboard ranks track non-STEM accuracy more closely than STEM accuracy, so selecting a Top-50 model on the aggregate for a reasoning-intensive deployment displaces roughly 22% of the STEM-appropriate choices. Furthermore, when controlling for the multiple-choice guessing floor natively inside the response model, we find that higher-ability models continue to degrade more steeply under increased reasoning depth. The MMLU aggregate therefore weights retrieval capacity and reasoning stability unequally, inadvertently favoring models optimized for retrieval. We release our deterministic framework as a reproducible auditing instrument and recommend disaggregated reporting.

eess.IV [Back]

[68] CHIMERA Challenge Task 2 and 3: Response Subtypes Classification and Progression Survival Prediction in Bladder Cancer Patients using Multimodal Datasets eess.IV | cs.CV | q-bio.QMPDF

Catherine Chia, Tongjie Wang, Robert Spaans, Maryam Mohammadlou, Farbod Khoraminia

TL;DR: CHIMERA挑战赛任务2和3旨在利用多模态数据（组织病理学、结构化临床病理数据和RNA测序）对高风险非肌层浸润性膀胱癌（HR-NMIBC）患者进行BCG反应亚型分类和进展生存预测。研究提供了一个包含368名患者的多模态数据集，并进行了标准化评估，共收到159份提交，筛选出13个最佳模型进行基准测试。

Details

Motivation: 当前对高风险非肌层浸润性膀胱癌（HR-NMIBC）的临床风险分层能力有限，该研究旨在通过建立标准化的多模态AI挑战赛（CHIMERA），以基准测试的方式提升对HR-NMIBC的预测能力，解决复发和进展风险预测的难题。

Result: 在挑战赛中，最佳模型在任务BRS（BCG反应亚型分类）上取得了0.73的加权F1分数，在任务Progression（进展时间预测）上取得了0.68的C-index。

Insight: 研究揭示了任务依赖的模态贡献差异（如组织病理学可部分补偿结构化变量）、队列依赖的性能下降以及对缺失结构化数据的敏感性。创新点在于提供了一个标准化多模态基准框架，不仅评估模型性能，还关注其鲁棒性、信息充分性和患者层面的预测失败分析，强调了缺失感知建模和多机构独立验证的重要性。

Abstract: High-risk non-muscle-invasive bladder cancer (HR-NMIBC) carries substantial risks of recurrence and progression, while current clinical risk stratification remains limited. CHIMERA was established as a multimodal AI challenge to benchmark prediction in HR-NMIBC under standardized evaluation. Task BRS predicts RNA-seq-defined BCG Response Subtypes from histopathology and structured clinicopathological data, whereas Task Progression models time-to-progression using histopathology, structured data, and RNA sequencing. A multimodal dataset of 368 patients was divided into public training and hidden validation and test sets. In total, 159 submissions were made, and 13 top-performing models were selected for benchmarking. The best models achieved a weighted F1 score of 0.73 for Task BRS and a C-index of 0.68 for Task Progression. Post-challenge analyses revealed task-dependent modality contributions, cohort-dependent performance degradation, and sensitivity to missing structured data. In Task BRS, histopathology partly compensated for pathology-derived structured variables, whereas progression models showed greater dependence on complementary inputs. Cross-model error analysis further identified patients that were consistently difficult across different architectures, with T1 substage associated with prediction difficulty. These findings highlight barriers to transportability and the importance of missingness-aware modeling and independent multi-institutional validation. CHIMERA provides a standardized multimodal benchmark for bladder cancer and a framework for studying not only model performance, but also robustness, information sufficiency, and patient-level prediction failure.

[69] Morphological Decoupling-Based Skeletal Classification for Clinical Assessment of Malocclusion eess.IV | cs.CVPDF

Zhichun Jin, Zhicheng He, Hao Xu, Dongyang Li, Lin Wang

TL;DR: 该论文提出了一种名为TeethGNN的新型图神经网络框架，用于基于CBCT图像的错颌畸形骨骼分类。该方法通过解耦可学习解码器直接从图像预测关键形态指标，并利用图神经网络融合图像与形态特征，同时引入协作校准策略提升鲁棒性。在自收集的临床数据集上，该系统在准确率和AUC上均超越了现有先进方法。

Details

Motivation: 传统错颌畸形骨骼分级依赖专家手动测量CBCT重建的侧位头影测量片，过程耗时费力且存在操作者间差异。因此，需要一种自动、可靠的基于CBCT的自动分级系统。

Result: 在自收集的临床数据集上，该系统取得了77.08%的准确率和89.61%的AUC，性能优于所比较的先进方法（SOTA）。

Insight: 创新点在于提出了一个结合图像特征与形态信息的图神经网络框架，并引入了包含多尺度图对抗扰动（显式校准）和非线性拓扑图校准（隐式置信度调整）的协作校准策略，有效提升了多模态融合的鲁棒性和校准能力。

Abstract: Malocclusion skeletal grading is a fundamental task in orthodontics, critical for diagnosis and treatment planning. Traditionally, cone-beam computed tomography (CBCT) is used for visual measurement, and the reconstructed lateral cephalograms are handed over to expert dentists for diagnosis. However, manual review is time-consuming, labor-intensive, and subject to inter-operator variability. Therefore, an automatic CBCT-based system is needed for reliable malocclusion skeletal grading. In this case, we develop TeethGNN, a novel graph-based framework designed to combine CBCT image features with morphological information for accurate and efficient malocclusion grading. TeethGNN utilizes a decoupled learnable decoder to directly predict key morphological indicators from CBCT images, eliminating the need for manual measurements. These morphological features are then fused with image features using a graph neural network (GNN), which effectively models the relationships between the modalities. To further enhance robustness and calibration, we introduce a collaborative calibration strategy. This strategy combines multi-scale graph adversarial perturbation for explicit calibration and nonlinear topological graph calibration for implicit confidence adjustment. Extensive experiments and ablation studies on our collected clinical dataset demonstrate that our malocclusion measurement system achieves 77.08% in accuracy and 89.61% in AUC, outperforming the compared state-of-the-art methods. These results validate the effectiveness of graph-based multimodal fusion and collaborative calibration in improving malocclusion grading performance. Our system shows strong potential for advancing computer-aided orthodontic diagnosis, providing an accurate and reliable solution for vision-based clinical measurement and diagnosis.

cs.LG [Back]

[70] MetroLLM-Bench: Evaluating Language Models as Transit Kiosk Runtimes cs.LG | cs.AI | cs.CLPDF

Remco Hendriks

TL;DR: 该论文提出了MetroLLM-Bench，一个包含955个测试用例的基准，用于评估语言模型作为地铁售票亭策略层的性能。基准覆盖六个真实地铁系统，包含路线规划、票价计算、服务中断等十一类任务，要求模型调用结构化工具并提交机器可渲染的最终状态。论文评估了来自六个供应商的二十六个模型，并报告了基于确定性评分的第一层级和结合语义质量的综合得分。

Details

Motivation: 为了解决语言模型在现实世界、结构化任务（如公共交通售票亭交互）中作为策略层的性能评估问题，需要一个专门的基准来测试其工具调用、多任务处理和对抗性输入处理能力。

Result: 在留出的238个测试用例上，一个经过参数高效微调（PEFT）的4B Qwen 3.5学生模型在第一层级（Tier 1）得分91.3，超过了GPT-5.6的两个版本（90.6和90.0），并与最大推理努力下的GPT-5.4完整版（91.4）相当。基于规则的确定性基线在第一层级得分为84.6。Muse Glimmer 30B在综合排名中领先。

Insight: 论文的创新点在于构建了一个专注于公共交通售票亭场景的、要求结构化工具调用和输出的多任务基准。客观分析表明，参数高效微调（PEFT）对小规模模型（如2B）提升显著，但对大规模模型（如27B）提升有限甚至为负，这为模型规模与微调效益的关系提供了新见解。基准设计包含确定性和语义质量双重评分机制，增强了评估的全面性。

Abstract: We introduce MetroLLM-Bench, a 955-case benchmark for testing language models as the policy layer of a transit kiosk. It covers six real metro systems, ranging from 37 to 414 stations, and eleven categories that include routing, fare calculation, disruptions, accessibility, and adversarial input. In each case, the model must call structured tools and submit a machine-renderable terminal state containing an outcome, a per-ticket fare quote when applicable, and a kiosk action. Fourteen deterministic scoring components form Tier 1; eight semantic-quality components form Tier 2, six of which use a language-model judge. We report Tier 1 and the combined score of both tiers. A stratified 75/25 split reserves 717 cases for training-data generation and 238 for held-out evaluation. We evaluate twenty-six models from six vendors, of which twenty-three are ranked. On the held-out partition, a 4B Qwen 3.5 student trained through parameter-efficient fine-tuning (PEFT) exceeds both GPT-5.6 tiers on Tier 1 (91.3 against 90.6 and 90.0) and matches GPT-5.4 full at maximum reasoning effort (91.4), with a 2.6 GB Q4_K_M footprint. Larger 9B and 27B students provide no further Tier 1 improvement over the 4B student at this training scale. Across the four Qwen sizes, the PEFT gain over the corresponding base model decreases from +7.03 points at 2B (three training seeds) to -0.91 at 27B; every seed shows the same direction at every size. A deterministic rule-based baseline reaches 84.6 on Tier 1, with the remaining language-model advantage concentrated in policy adaptation, compound scenarios, accessibility, and temporal reasoning. Muse Glimmer 30B leads the composite ranking, and serving configuration alone moves the Qwen 3.5-to-3.8 comparison by 2.7 Tier 1 points. The benchmark, harness, reproduction guide, and fine-tuned students are released at https://github.com/continker/metrollm-bench.

eess.AS [Back]

[71] AVSRBench: A Multi-Condition AVSR Benchmark eess.AS | cs.CV | cs.MMPDF

Rishabh Jain, Naomi Harte

TL;DR: 本文介绍了AVSRBench，一个用于评估视听语音识别（AVSR）系统在多条件下泛化能力的基准测试。作者通过测试三种AVSR架构在六种不同语音条件下的表现，发现当前AVSR系统在广播语音之外存在显著的泛化差距，并提出了RoomReader-AV新基准和统一数据预处理流程以促进全面评估。

Details

Motivation: 动机在于探究AVSR在标准LRS3基准上取得低词错误率是否反映真正的泛化能力，还是仅依赖于广播语音的领域适应，从而揭示当前研究的局限性。

Result: 实验结果显示，纯视觉性能在广播领域外迅速恶化，视听融合主要对Lombard语音环境有益；视觉理解在90°侧面视角下急剧下降，多模态系统主要依赖声学回退；基于LLM的架构在领域外泛化能力较差。

Insight: 创新点在于首次系统评估了AVSR在多条件下的泛化差距，强调了说话者发音清晰度比相机轻微偏移更重要，并引入了RoomReader-AV新基准和预处理流程以推动更全面的评估研究。

Abstract: While AVSR has achieved sub-1% word error rates on the standard LRS3 benchmark, its reliance on broadcast speech obscures whether this reflects true generalization or just domain adaptation. To investigate this gap, we evaluate three AVSR architectures across six conditions: controlled broadcast speech, fixed-grammar utterances, hyper-articulated Lombard speech, read speech from professional lipspeakers and non-professional speakers, and spontaneous multi-party video conversations. We find that visual-only performance deteriorates rapidly beyond broadcast domains, and audio-video fusion mainly benefits Lombard speech environments. Visual understanding degrades sharply at 90° profile views, with multimodal systems relying largely on acoustic fallback. Additionally, speaker articulation proves more critical than minor camera shifts, and LLM-based architectures suffer from poor out-of-domain generalization. Our work highlights a significant generalization gap in current AVSR research. To address this, we also introduce RoomReader-AV as a new benchmark for AVSR and release a unified data preprocessing pipeline to make comprehensive multi-condition evaluation accessible.

[72] Candor-LR: A Dyadic Conversational Dataset for Audio-Visual Speech Recognition eess.AS | cs.CV | cs.MMPDF

Rishabh Jain, Aristeidis Papadopoulos, Zhaofeng Lin, Naomi Harte

TL;DR: 该论文提出了Candor-LR，一个用于视听语音识别（AVSR）的对话式基准数据集，源自1,656个自然成对视频会议的CANDOR语料库。通过定制数据处理流程，生成了总计约784小时的数据。评估发现，与LRS3等现有基准相比，纯音频模型在Candor-LR上性能显著下降，但视觉线索能有效补偿，且在该数据集上训练能提升跨域鲁棒性。

Details

Motivation: 现有AVSR基准（如LRS3）依赖干净、脚本化和排练过的语音，无法反映自然对话的复杂性，如重叠语音、自发轮流发言、非脚本词汇和可变声学条件。该研究旨在推动领域向现实对话场景发展。

Result: 在Candor-LR上评估预训练AVSR模型显示，纯音频准确率相比LRS3大幅下降，但视觉线索带来了比在LRS3上更大的性能提升。使用该语料库训练显著提高了在干净和嘈杂条件下的跨域鲁棒性。

Insight: 创新点在于构建了一个更贴近真实对话的AVSR基准，强调了视觉信息在复杂对话场景中的关键补偿作用，并开源数据处理流程以确保可复现性，为对话式AVSR研究提供了更具挑战性的评估标准。

Abstract: Current audio-visual speech recognition (AVSR) benchmarks, like LRS3, rely heavily on clean, scripted and rehearsed speech. They fail to reflect the complexity of natural conversation, which involves overlapping speech, spontaneous turn-taking, unscripted vocabulary and variable acoustic conditions. To shift the field toward realistic dialogue, we introduce Candor-LR, a conversational benchmark derived from the CANDOR corpus of 1,656 natural dyadic videoconferences. Our custom data preparation pipeline yields 713.5, 10.1, and 60.1 hours of training, validation, and test data, respectively. Evaluating pretrained AVSR models on Candor-LR reveals that audio-only accuracy drops sharply compared to LRS3, but visual cues compensate effectively, driving much larger performance gains on Candor-LR than on LRS3. Furthermore, training on this corpus significantly improves cross-domain robustness under both clean and noisy conditions, as its realistic conversational data captures broader audio-video features. We open-source our pipeline to ensure reproducibility, establishing Candor-LR as a challenging benchmark for conversational AVSR.

cs.MA [Back]

[73] Who Are They to Each Other? Multi-Agent Reasoning for Speaker Relationship Inference cs.MA | cs.CL | cs.SDPDF

Yaohan Guan, Yen-Ju Lu, Yuzhe Wang, Junhyeok Lee, Jesus Villalba

TL;DR: 本文提出了一种无需训练的多智能体推理框架，用于从对话中推断说话人关系。该框架通过结构化交互组织LLM智能体进行推理，包含两种具体设计：基于角色分工的多智能体辩论和基于竞争淘汰的多智能体竞争机制。

Details

Motivation: 现有监督学习方法成本高昂且难以扩展，而传统LLM推理方法难以处理对话中微妙、分散且多模态的关系线索，导致推理能力有限。

Result: 在Seamless Interaction数据集上的实验表明，该方法在多数情况下优于零样本基准和现有多智能体基线；在包含文本信息的设置中，LLM方法甚至能超越人类标注者，但在纯音频设置中表现较弱。

Insight: 创新点在于将社会理论视角融入多智能体辩论框架，并通过竞争性裁决机制提升推理鲁棒性；核心发现表明结构化推理时交互能有效提升关系推断性能，但当前模型对声学线索的利用仍不足。

Abstract: Inferring speaker relationships from spoken conversations is an important step towards socially aware speech understanding. However, this task remains underexplored, and supervised modeling is costly to train and scale. At the same time, existing inference-time LLM approaches provide limited structure for handling subtle, distributed, and multimodal relational cues that may support multiple plausible interpretations. To address these limitations, we introduce a training-free multi-agent reasoning framework that organizes inference through structured interaction among LLM agents, allowing relationship judgments to be proposed, challenged, and adjudicated without task-specific training. We instantiate this framework with two complementary designs. We propose Multi-Role Multi-Agent Debate as a task-specific adaptation of standard multi-agent debate for speaker relationship inference, assigning agents complementary roles or social-theory-grounded perspectives rather than a single undifferentiated viewpoint. In contrast, we introduce Multi-Agent Compete, a competition-based protocol that compares agent judgments through pairwise adjudication, eliminates weaker candidates, and retains the most defensible one. We evaluate these methods on the Seamless Interaction dataset across different modality settings, covering both binary classification and fine-grained relationship-detail prediction. Results suggest that they improve over zero-shot and existing multi-agent baselines in most cases. Human evaluation further suggests that this task is challenging even for people. LLM methods can sometimes outperform human annotators in text-included settings but are less competitive in the audio setting. Together, these findings suggest that relationship inference benefits from structured inference-time interaction among agents, while acoustic cues are not yet fully captured by current models.

cs.GR [Back]

[74] RealSimLoop: Online Real-to-Sim Adaptation via Differentiable Reduced-Order Simulation with Vision Feedback cs.GR | cs.CV | cs.ROPDF

Zhihao Cen, Chuhua Xian, Hailin Sun, Yuliang Liufu, Zhen Zhang

TL;DR: 本文提出了RealSimLoop，一种基于可微分降阶模拟与视觉反馈的在线实-仿自适应框架，用于从稀疏表面观测中恢复可变形物体的隐藏物理量（如内部变形、应力场和交互力）。该框架通过可微分渲染和滑动窗口目标函数，实现了准实时的物理参数优化，并能跟踪时变材料属性。

Details

Motivation: 现实世界中对可变形物体的观测通常是稀疏或表面级的，而下游任务需要隐藏的物理量；基于物理的模拟可以恢复这些量，但在线实-仿自适应面临全空间优化成本高、反馈有限和材料属性时变等挑战。

Result: 大量实验表明，该方法优于传统的离线方法，并在外力预测和结合新视角合成的3D应力场重建等下游应用中验证了其多功能性。

Insight: 创新点在于将可微分模拟与降阶神经子空间结合以实现准实时优化，并通过可微分渲染直接利用像素数据梯度优化物理参数；滑动窗口目标函数增强了在线自适应能力，能有效跟踪时变属性并弥补模型降阶或未建模动力学带来的实-仿差距。

Abstract: Real-world observations of deformable objects are often sparse or surface-level, while downstream tasks require hidden physical quantities such as internal deformation, stress fields, and interaction forces. Physics-based simulation can recover these quantities, but online real-to-sim adaptation remains challenging due to costly full-space optimization, limited feedback, and time-varying material properties. To address these challenges, we propose RealSimLoop, a differentiable framework for online real-to-sim adaptation using vision data as physical feedback. Our approach achieves quasi-real-time performance by executing differentiable simulation within a reduced-order neural subspace, drastically accelerating the optimization loop. We couple this efficient dynamics model with differentiable rendering, enabling direct gradient backpropagation that leverages high-fidelity pixel data to refine physical parameters such as material stiffness. Furthermore, by employing a sliding-window objective function, RealSimLoop enables robust online adaptation, allowing the system to track time-varying material properties and effectively bridge the real-to-sim gap arising from model reduction or unmodeled dynamics. Extensive experiments demonstrate that our method outperforms conventional offline methods, and we validate the framework’s versatility in downstream applications, including external force prediction and 3D stress field reconstruction with novel view synthesis.

cs.RO [Back]

[75] Identifying Habit, Physics, and Nuisance in Robot World Models cs.RO | cs.CVPDF

Jinting Hang, Zhenhui Cai

TL;DR: 本文提出了一种将机器人世界模型中的多模态演示数据分解为操作者习惯、共享物理和观测干扰三个因素的方法，并基于结构因果模型进行形式化。通过互补干预实验验证了分解的有效性，并提出了一种冻结共享物理读取器、仅更新薄接口的适应规则，在多个机器人任务上提升了少样本迁移性能并保持了更干净的动态模型。

Details

Motivation: 动机在于解决遥操作演示数据中多模态性（即使底层动态近乎确定）的问题，认为这种多模态性混合了操作者习惯、共享物理和观测干扰三个因素，而现有的纠缠的下一个观测预测器吸收了所有因素，阻碍了模型的清晰理解和有效适应。

Result: 在StackCube、DROID和RH20T等机器人任务上的实验表明，所提出的适应规则相对于从头训练提升了少样本迁移性能，在损坏的适应数据下保持了更干净的动态，并且能够从本体感知扩展到像素观测（通过多视图和多步检查验证）。

Insight: 创新点在于将多模态演示数据明确分解为习惯、物理和干扰三个因果因素的形式化框架，以及相应的互补干预验证方法和“冻结物理、更新接口”的高效适应规则，这为构建更清晰、更可迁移的机器人世界模型提供了新思路。

Abstract: Teleoperated demonstrations are often multimodal even when the underlying dynamics are nearly deterministic given the executed action. We argue that this multimodality typically mixes three factors–operator habit in action selection, shared physics, and observation nuisance–and that entangled next-observation predictors absorb all three. We formalize the split with a structural causal model a=g(h,z,u), z’=f(z,a), o=r(z,c), and test it with complementary interventions: replacing or shuffling actions at fixed state sharply increases next-state error, whereas appearance and camera changes should not; habit-aware reverse scoring improves ranking of feasible pasts without rewriting the dynamics. The associated adaptation rule is to freeze a shared physics readout and update only a thin interface. On StackCube, DROID, and RH20T this rule improves low-shot transfer relative to training from scratch, retains cleaner dynamics under corrupted adaptation data, and extends from proprioception to pixel observations with multi-view and multi-step checks. We do not equate latent actions with operator habit, and we do not target large-scale video generation benchmarks.

[76] No Free Checker: A Survey of Verifiers for Robot Policies cs.RO | cs.AI | cs.CV | cs.LG | eess.SYPDF

Yang Wan, Xihang Yue, Zhirui Liu, Ziyuan Chu, Shuxun Wang

TL;DR: 本文对机器人策略验证器进行了系统性综述，涵盖了约150种验证器，并将其分为人类验证器、基于规则的验证器、学习型验证器和模型内在验证器四类。研究比较了验证器的两个核心属性：可用性（成本、时效性和询问频率）和可信度（高分对任务完成度的真实反映程度），并发现两者之间存在权衡关系，即可信度随可用性提升而下降。

Details

Motivation: 机器人策略验证器用于评估和训练视觉-语言-动作策略，但其种类繁多、特性各异，缺乏系统的分类和比较框架。本文旨在通过调查现有验证器，厘清其关键属性（可用性与可信度）之间的内在权衡关系，为验证器的评估和设计提供指导。

Result: 研究通过分析约150个验证器，发现了一个普遍规律：在验证器的四大家族（人类、规则/形式化、学习/预训练、模型内在）中，验证器的可信度随着其可用性（更廉价、更早、更密集的裁决）的提高而下降，即不存在“免费的检查器”。

Insight: 论文的核心见解是揭示了验证器设计中“可用性-可信度权衡”这一根本矛盾。创新点在于提出了一个基于“裁决提供者”的分类框架，并系统地定义了可用性和可信度的衡量维度。这为未来验证器的评估（如提出了九项可检验的指标）和设计（指明了待构建验证器的坐标）提供了理论基础和实用指南。

Abstract: A verifier for robot policies reads a candidate behavior and returns a score for how well it did, used both to evaluate vision-language-action policies and to train them. Verifiers range from success detectors and reward models to runtime monitors, safety filters, and temporal-logic specifications. We survey roughly 150 verifiers and compare them along two properties. Availability is how much a verdict costs, how early in a rollout the verdict arrives, and how often a verdict can be asked for. Availability rises as verdicts get cheaper, earlier, and denser. Credibility is how much a high score tells us about the task. Credibility falls as the judgment becomes gameable and self-serving. We group the verifiers by who supplies the judgment: human verifiers, rule-based and formal verifiers, learned and pretrained verifiers, and model-intrinsic verifiers. Across the four families, we find that credibility falls as availability rises. Regardless of who supplies the judgment, there is no free checker. We then examine what validates a verifier itself, and how much a high score tells us. Three measures appear in the literature: agreement with human labels, the performance of the policy it trains, and behavior under reward hacking. We close with nine metrics that make a verifier claim checkable, and coordinates for the verifiers still to be built.

[77] Data-Driven Risk Fields for Safer End-to-End Autonomous Driving cs.RO | cs.CVPDF

Yuanxin Tian, Zhiyuan Liu, Jinhao Li, Zhenhua Xu, Wenhao Yu

TL;DR: 本文提出了一种名为DRiF的数据驱动风险场框架，旨在提升端到端自动驾驶的安全性。该框架通过学习共享的鸟瞰图特征，结合静态地图分割、动态风险预测和车辆规划，将基于规则的安全先验转化为成对风险标签进行训练。实验表明，DRiF在Bench2Drive基准测试中取得了具有竞争力的整体性能，并在驾驶评分、成功率和碰撞相关指标上实现了持续改进。

Details

Motivation: 现有端到端驾驶模型缺乏显式的风险感知学习能力，而基于规则的风险模型依赖人工设计的函数和阈值，学习型风险表示则常使用占用率衍生标签或启发式成本值，可能无法捕捉与自车状态相关的规划风险。

Result: 在Bench2Drive基准测试中，DRiF实现了具有竞争力的整体性能，在驾驶评分、成功率和碰撞相关指标上均取得了一致的提升。

Insight: 创新点在于将基于规则的安全先验转化为成对风险标签，并训练风险场以保持相对风险排序，而非回归人工设计的绝对风险分数，从而将显式安全结构与端到端规划有效连接起来。

Abstract: Safety is a fundamental requirement for autonomous driving, yet existing end-to-end driving models still lack explicit risk-aware learning capacities. Existing rule-based risk models provide interpretable safety priors, yet their absolute risk scores depend on handcrafted functions, coefficients, and thresholds. Learning-based risk representations reduce part of this manual design, but their supervision often relies on occupancy-derived labels or heuristic cost values, which may not capture ego-conditioned planning risk. In this paper, we propose DRiF, a data-driven risk-field framework for safer end-to-end autonomous driving. DRiF learns a shared BEV feature with static map segmentation, dynamic risk prediction, and vehicle planning. For dynamic risk learning, DRiF converts rule-based safety priors into pairwise risk labels, and trains the risk field to preserve relative risk ordering instead of regressing handcrafted absolute scores. Experiments on Bench2Drive show that DRiF achieves competitive overall performance, with consistent improvements in driving score, success rate, and collision-related metrics. These results establish relative risk supervision as an effective way to connect explicit safety structure with end-to-end planning. The data and code will be publicly available.

[78] Show-Harness: Just a VLM Agent Can Play Robots cs.RO | cs.AI | cs.CV | cs.MMPDF

Yanzhe Chen, Zechen Bai, Zhijun Cao, Wenzheng Zeng, Kevin Qinghong Lin

TL;DR: 本文提出了Show-Harness，一个将基础视觉语言模型（VLM）的智能转化为机器人控制的语义接口框架。该框架通过定义离散的语义动作单元，让VLM进行高层推理，并由特定于具体机器人的解释器将其确定性地映射为底层动作，从而实现了零样本机器人控制。

Details

Motivation: 动机在于解决如何将基础视觉语言模型（VLM）所具备的广泛世界知识有效且低成本地转化为实际机器人控制能力这一挑战。

Result: 大量实验表明，配备Show-Harness的VLM智能体在任务、机器人本体和环境上均展现出强大的泛化能力，其性能超越了代表性的智能体和视觉语言动作（VLA）范式。

Insight: 核心创新点是设计了一个紧凑的语义接口，将意图与动作解耦，使得前沿的闭源VLM无需额外训练即可用于零样本控制，同时开源小模型仅需少量微调即可低成本部署。该接口还可扩展用于GUI演示收集，降低了数据采集门槛。

Abstract: Foundation vision-language models (VLMs) exhibit broad intelligence about the world, yet translating this intelligence into robot control remains challenging. We present Show-Harness, an Embodied Harness that enables VLMs to “play” robots through a compact semantic interface linking intent to action. Show-Harness exposes discrete semantic action units that VLMs can naturally reason over, while embodiment-specific interpreters deterministically ground them into local robot actions, keeping the VLM directly responsible for fine-grained physical decisions. Through the same interface, Show-Harness demonstrates the feasibility of (1) directly unlocking closed-source frontier VLMs for zero-shot robot control, and (2) adapting small-scale open-source VLMs for low-cost deployment with just a few GPU-hours of fine-tuning. We further develop GUMI (GUI Manipulation Interface), which extends the same semantic action space to GUI-based demonstration collection, allowing humans and agents to “play” robots across embodiments without specialized teleoperation hardware. Extensive experiments show that Show-Harness-equipped VLM agents generalize robustly across tasks, embodiments, and environments, outperforming representative agentic and VLA paradigms. These results suggest that the right interface can unlock substantial embodied capability from foundation VLMs, without requiring additional model capacity or costly embodiment-specific pretraining.

cs.IR [Back]

[79] LiteRAG: Cost-Efficient Graph-Based Retrieval-Augmented Generation cs.IR | cs.AI | cs.CLPDF

Daniel Alejandro Coll Tejeda, Pedro García López, Daniel Barcelona-Pons

TL;DR: 本文提出了LiteRAG，一种基于图的高效检索增强生成方法，旨在解决现有图检索方法查询延迟高、上下文冗余的问题。它通过查询驱动的算法探索和推理链上下文构建，取代了昂贵的检索时LLM控制，显著提升了效率。

Details

Motivation: 现有基于图的检索方法虽然能提升多跳问答性能，但存在查询时延高、生成上下文庞大且分散的问题，这降低了生成效率并增加了成本。

Result: 在分布式系统论文多跳检索基准DistComp上，LiteRAG取得了最高综合质量分数（0.798），同时相比GraphRAG Global和DRIFT，查询延迟降低超过100倍，成本降低超过99%。在UltraDomain上，其综合质量与LinearRAG相当，但使用的token数量减少了约14倍。

Insight: 主要创新在于用查询驱动的算法探索替代昂贵的LLM控制，并引入了查询自适应阈值和社区感知的中心节点惩罚机制，这些是提升token效率的关键。该方法在保持或提升检索质量的同时，实现了显著的效率和成本优化。

Abstract: Graph-based retrieval can improve multi-hop question answering, but existing approaches often incur high query-time costs and produce diffuse, oversized contexts that reduce generation efficiency. We present LiteRAG, a graph-based retrieval method that replaces expensive retrieval-time LLM control with query-conditioned algorithmic exploration and reasoning-chain context construction. On DistComp, a benchmark for multi-hop retrieval over distributed-systems papers, LiteRAG attains the highest overall quality among the evaluated methods (0.798) while reducing per-query latency by over 100$\times$ and cost by over 99% relative to GraphRAG Global and DRIFT. On UltraDomain, it matches LinearRAG on overall quality while using about 14$\times$ fewer tokens. An ablation study indicates that LiteRAG’s query-adaptive thresholding and community-aware hub penalization are the main drivers of its token-efficiency gains.

cs.AI [Back]

[80] Less Is Personal: Learning Minimal Sufficient User Profiles for Personalized Language Models cs.AI | cs.CLPDF

Minghang Liu, Qiang Qiu, Yuanzhuo Wang, Huawei Shen, Xueqi Cheng

TL;DR: 本文提出ENOUGH方法，用于构建个性化语言模型的最小充分用户档案，通过迭代选择行为记录并动态停止，在保持个性化效用的同时减少不必要的上下文成本。

Details

Motivation: 现有检索增强的个性化语言模型通常固定预置检索记录数量，但额外历史记录可能冗余、有害或与用户独特行为无关，因此需要研究如何为每个输入构建成本最低且保持效用的有序档案。

Result: 在六个个性化任务上的实验表明，ENOUGH在效果和效率上均优于强启发式和检索增强基线，实现了保持个性化效用同时减少不必要上下文成本的最小充分档案。

Insight: 创新点在于提出最小充分个性化概念，通过离线有界反事实搜索评估档案前缀并蒸馏为多头价值控制器，实现轻量级决策选择排序记录，并在停止后单次调用冻结生成器。

Abstract: Retrieval-augmented personalization enables large language models to produce more accurate and preference-aligned outputs using relevant records retrieved from user histories. Personalized language models typically prepend a fixed number of retrieved user records, even when additional history is redundant, harmful, or unrelated to a user’s distinctive behavior. We study minimal sufficient personalization: constructing the least costly ordered profile for each input while preserving the utility achievable from a retrieved candidate pool. We introduce ENOUGH, a method that iteratively appends behavioral records or emits STOP to construct profiles with adaptive lengths. Offline, bounded counterfactual search evaluates profile prefixes by jointly considering downstream gains, user specificity, and token costs. The resulting long-horizon targets are distilled into a multi-head value controller with explicit ranking and stopping supervision. At inference, the controller selects and orders records through lightweight decisions, and the frozen generator is invoked once after stopping. Extensive experiments on six personalized tasks demonstrate that ENOUGH consistently outperforms strong heuristic and retrieval-augmented baselines in both effectiveness and efficiency, achieving minimal sufficient profiles that preserve personalization utility while reducing unnecessary context costs.

[81] Subagents vs Agent Skills: Executing Reusable Knowledge for Long-Horizon Agentic Tasks cs.AI | cs.CL | cs.LGPDF

Wasu Top Piriyakulkij, Rachel Lawrence, Alicia Curth, Sushrut Karmalkar, Niranjani Prasad

TL;DR: 本文探讨了语言模型智能体如何有效利用可重用知识库解决长时程任务，对比了两种执行方式：将技能包作为指令加载到主智能体上下文的传统方法，以及将技能包作为子智能体在独立上下文中执行的新方法。研究发现，当技能包具有清晰的输入输出契约且包含满足契约所需的程序性知识时，子智能体执行方式优于传统技能执行方式，但会带来额外的通信开销。

Details

Motivation: 解决长时程任务中，随着上下文窗口信息累积导致推理质量下降的问题，探索比传统‘智能体技能’执行更鲁棒的知识重用方法。

Result: 实验表明，在技能包具备清晰契约和程序性知识的前提下，子智能体执行方式在性能上超越了传统的智能体技能执行方式，但代价是产生了额外的令牌通信开销。

Insight: 核心创新点在于提出了将可重用知识包作为独立子智能体而非上下文指令来调用的执行范式。客观来看，这揭示了知识重用的效能不仅取决于知识内容本身，还高度依赖于其组织与调用方式，为智能体系统架构设计提供了新思路。

Abstract: How can language model agents effectively leverage libraries of reusable knowledge to solve long-horizon tasks? Recent work has increasingly focused on agent skills: reusable capabilities represented as skill packages, i.e., multi-file bundles containing instructions, scripts, and other resources that help agents perform specific tasks. Agent skills are typically executed by loading their skill instructions into an agent’s context and relying on the agent to follow them. As task horizons grow, however, this approach becomes increasingly brittle, because reasoning quality degrades as more information accumulates in the context window. We investigate an alternative approach in which skill packages are instead invoked as subagents. Rather than loading skill instructions into the main context, subagent execution spawns fresh context windows dedicated to solving individual subtasks. We show that subagent execution outperforms agent-skill execution when skill packages expose clear input-output contracts and their instructions encode the procedural knowledge needed to fulfill those contracts. The tradeoff is additional communication overhead, as extra tokens are required to coordinate between the main agent and its subagents. Our results show that the benefit of reusable knowledge depends not only on its content, but also on how it is organized and invoked.

[82] CityPlanner: A Sandbox Agent for Executable Urban Planning cs.AI | cs.CLPDF

Wentao Zhang, Jingyuan Wang, Zetong Zhou, Yifan Yang, Wenrui Wang

TL;DR: 本文提出了CityPlanner，一个用于可执行城市规划的沙盒智能体框架。该框架包含一个基于文件的统一环境UrbanSandbox，智能体在其中检查任务文件、生成规划、运行评估器并根据可执行反馈修订决策。为了便于学习，论文进一步提出了原子任务强化学习，将长轨迹分解为初始建设的BuildPlan和基于反馈改进的ImprovePlan两个阶段。

Details

Motivation: 城市规划是一个现实世界的空间优化问题，需要在成本和实用性等目标下从巨大的候选空间中选取可行方案。现有优化和强化学习方法对固定问题表述有效，但通常依赖于特定任务表示和约束处理，缺乏通用性。

Result: 在一个真实世界基准测试上的实验表明，CityPlanner在性能上持续优于启发式方法、特定任务强化学习方法以及通用大语言模型智能体基线。消融实验验证了UrbanSandbox环境、原子任务强化学习和迭代部署策略的有效贡献。

Insight: 核心创新点在于提出了一个统一的、基于文件的沙盒环境（UrbanSandbox）来封装城市规划任务，并设计了原子任务强化学习将长程规划问题分解为可管理的子阶段。这为处理复杂、长轨迹的现实世界空间优化问题提供了一个通用且可执行的智能体框架。

Abstract: Urban planning is a real-world spatial optimization problem that requires selecting feasible actions from large candidate spaces under practical objectives such as cost and service quality. Existing optimization and reinforcement learning methods are effective for fixed formulations, but often depend on task-specific representations and constraint handling. We propose \emph{CityPlanner}, a sandbox-agent framework for executable urban planning. CityPlanner introduces \emph{UrbanSandbox}, a unified file-based environment where agents inspect task files, generate plans, run evaluators, and revise decisions based on executable feedback. To make learning tractable, we further propose atomic-task reinforcement learning, which decomposes long sandbox trajectories into \emph{BuildPlan} for initial construction and \emph{ImprovePlan} for feedback-based refinement. Experiments on a real-world benchmark show that CityPlanner consistently outperforms heuristic, task-specific RL, and general LLM-agent baselines. Ablations verify the contributions of UrbanSandbox, atomic-task RL, and iterative deployment. We release the code and dataset at https://anonymous.4open.science/r/co-agent-C1C8

[83] From Symbolic Perception to Logical Deduction: A Framework for Guiding Language Models in Geometric Reasoning cs.AI | cs.CLPDF

Weichen Dai, Rafael Medeiros Cabral, Ziyi Shou, Yan Cao, Xin Shen

TL;DR: 本文提出了一种用于几何推理的框架，通过将几何图形解析为符号形式并结合符号求解器进行形式化演绎，使纯语言模型在复杂几何问题上达到与先进多模态模型相当的性能。该框架旨在减少幻觉并提升推理的可解释性。

Details

Motivation: 平面几何是AI的重大挑战，需要整合视觉感知与数学推理。现有大型多模态模型虽能处理视觉语言输入，但计算量大且不透明，因此研究旨在探索更高效、可解释的纯语言模型解决方案。

Result: 在基于2025年中考难题构建的基准测试上，该方法取得了与Gemini 2.5 Pro相当的性能，同时提供了更清晰、类人的解决方案。

Insight: 创新点在于将几何推理分解为符号感知与逻辑演绎两个模块，通过符号化表示和形式化求解来引导语言模型，从而提升推理的准确性和可解释性，为纯语言模型处理复杂多模态任务提供了新思路。

Abstract: Plane geometry remains a significant challenge in AI, requiring the integration of visual perception and mathematical reasoning. While Large Multimodal Models (LMMs) naturally handle visuo-linguistic inputs, they are often computationally intensive and opaque. We demonstrate that a pure Large Language Model (LLM), when equipped with specialized modules, can rival state-of-the-art LMMs on complex geometry problems. Our framework integrates a Geometric Vision Parser, which translates diagrams into symbolic form, with a Symbolic Solver that performs formal deductions, thereby mitigating hallucinations and promoting interpretable reasoning. To enable rigorous evaluation, we curate a benchmark of challenging problems from the 2025 Chinese Zhongkao examinations, ensuring data novelty and testing deeper deductive skills. Experiments demonstrate that our approach achieves performance comparable to Gemini 2.5 Pro while delivering clearer, human-like solutions.

[84] ConvMem: Convolutional Memory for Long-Context Reasoning cs.AI | cs.CLPDF

Hongming Zhang, Zhaozhen Gu, Fengshuo Bai, Ming Hao, Qingyang Zhang

TL;DR: 本文提出了ConvMem，一种无需训练、高度可并行的框架，用于解决大语言模型在超长上下文推理中的局限性。该框架将长上下文推理重新表述为分层卷积操作，通过将LLM视为卷积核，对文本片段进行分层汇总，从而将线性推理路径缩短为对数树结构。

Details

Motivation: 现有的大语言模型存在固定的上下文长度限制，而像MemAgent这样的顺序方法虽然通过分段读取和迭代更新固定大小内存来扩展有效上下文，但存在高延迟、需要昂贵的强化学习训练以及容易在特定数据集上过拟合的问题。

Result: 在RULER-HotpotQA和RULER-2WikiMultiHopQA基准测试上的实验表明，ConvMem优于无需训练的基线方法，并且在分布外任务上避免了强化学习训练模型常见的对参数先验过拟合的风险。

Insight: 核心创新点在于将卷积神经网络的思想引入长上下文推理，提出了可配置步长、跳跃连接和多核卷积等机制，以实现鲁棒的证据捕获与传播、错误累积缓解以及跨文本片段和推理线程的大规模并行化，从而以无训练的方式提升效率与泛化能力。

Abstract: While Large Language Models (LLMs) have demonstrated impressive capabilities, they often struggle with extremely long contexts due to fixed context limits. To address this, sequential approaches like MemAgent extend the effective context by reading text in segments and iteratively updating a fixed-size memory. However, this sequential paradigm suffers from high latency and requires costly reinforcement learning (RL) training, which can lead to overfitting on specific datasets. To overcome these limitations, we propose ConvMem, a training-free, highly parallelizable framework that reformulates long-context reasoning as a hierarchical convolution. Inspired by CNNs, ConvMem treats an LLM prompted with a specific query as a convolutional kernel. This kernel summarizes text segments hierarchically, shortening the reasoning path from a linear chain into a logarithmic tree. Specifically, ConvMem integrates \textit{Configurable Strides} and \textit{Skip Connections} to ensure robust evidence capture and propagation, while employing \textit{Multi-Kernel Convolution} to decompose complex queries into disentangled semantic channels. This design not only mitigates error accumulation but also enables massive parallelization across both text segments and reasoning threads. Experiments on RULER-HotpotQA and RULER-2WikiMultiHopQA demonstrate that ConvMem outperforms training-free baselines and avoids the risk of overfitting to parametric priors often observed in RL-trained models on out-of-distribution tasks.

cs.SD [Back]

[85] Arti-JEPA: Adapting Video World Model to Real-Time MRI of the Vocal Tract for Speech-Production Analysis cs.SD | cs.CVPDF

Hong Nguyen, Sean Foley, Christina Hagedorn, Yijing Lu, Sudarsana Reddy Kadiri

TL;DR: 本文提出了Arti-JEPA，一种联合嵌入预测架构，用于对声道的实时MRI（rtMRI）视频进行建模。该方法通过在约62小时的无标签声道视频上继续自监督学习，将视频世界模型适应到rtMRI领域，并在三个任务上评估了冻结表示的性能：跨领域音素预测、流畅与非流畅（口吃）分类以及术前/术后（舌部分切除后）言语转移的表征。

Details

Motivation: 实时MRI（rtMRI）能够捕捉言语过程中整个声道的动态，但标注数据稀缺，且其模态（单切片、灰度、低分辨率）与视频基础模型训练所用的自然视频存在显著差异。因此，需要一种方法能够适应这种特定领域，利用大量无标签数据学习有效的表示，以支持发音和临床言语科学分析。

Result: 在三个任务上的评估显示：1）时间视频先验显著优于逐帧图像编码器，潜在预测（V-JEPA）至少与像素重建（VideoMAE）相当，在细粒度音素上更有优势；2）领域适应是任务依赖的，它将跨领域音素预测的κ系数大致翻倍（达到0.352），但对二元口吃分类无帮助；3）Arti-JEPA能够从术前/术后言语中恢复音素信号，域内探针解码患者的表现至少与典型说话者相当，表明残余转移差距是跨说话者/领域错配而非手术信号丢失，且术后解码性能不低于术前。

Insight: 创新点包括将视频世界模型（如JEPA）适应到医学影像领域（rtMRI），通过自监督学习利用无标签数据；揭示了时间建模在视频表示中的关键作用，以及领域适应的任务依赖性；证明了冻结的、领域适应的rtMRI编码器可作为可重用的测量工具，用于发音和临床言语科学，特别是在处理稀缺标注和跨领域数据时具有潜力。

Abstract: Real-time MRI (rtMRI) captures the dynamics of the entire vocal tract during speech, but labeled data are scarce and the modality - single-slice, grayscale, low-resolution - differs substantially from the natural videos that video foundation models are trained on. We introduce Arti-JEPA, a joint embedding predictive architecture to model vocal tract rtMRI by continuing its self-supervised objective on about 62h of unlabelled vocal-tract videos, and evaluate the frozen representation on three tasks: cross-domain phoneme prediction (on typical speakers), fluent-vs-disfluent classification (a corpus containing stuttered speech), and characterizing pre/post-operative transfer (after partial glossectomy). Three key findings emerge. (1) A temporal video prior decisively outperforms per-frame image encoders, and latent prediction (V-JEPA) is at least as strong as pixel reconstruction (VideoMAE), with the edge on fine-grained phonemes. (2) Domain adaptation is \emph{task-dependent}: it roughly doubles cross-domain phoneme prediction $κ$ (to 0.352) but does not help binary stuttering classification. (3) Arti-JEPA was able to recover phoneme signal from pre/post glossectomy speech — an in-domain probe decodes patients at least as well as a typical speaker, indicating that the residual transfer gap is cross-speaker/domain misalignment, not surgical signal loss, and post-operative decoding does not fall below performance on pre-operative speech. Together, these position a frozen, domain-adapted rtMRI encoder as a reusable measurement tool for articulatory and clinical speech science.

Table of Contents

cs.CL [Back]

[1] Auditable Emergency Triage for Maternal and Newborn Care in India cs.CL | cs.AI | cs.CYPDF

[2] SWORD: Wikidata-based Distortions Reveal Hidden Cross-Lingual Inconsistencies in LLM Factual Error Rejection cs.CLPDF

[3] Benchmarking Hybrid Deep Research Across Database Querying and Web Search cs.CLPDF

[4] SEA-SpeechBench: A Large-Scale Multitask Benchmark for Speech Understanding Across Southeast Asia cs.CLPDF

[5] SocialRL: Refining LLMs’ Social Intelligence through Multi-turn Reinforcement Learning and Reward Design cs.CLPDF

[6] Which Medical Questions Deserve Rationales? Perturbation-Sensitive Selection for Robust QA cs.CL | cs.AIPDF

[7] CARRE: Counterfactual Action Retrieval and Reason Evaluation for Explainable Churn Prescription cs.CLPDF

[8] $S^3$-Bench: Evaluating Speech Interaction Models as Scientific Voice Assistants cs.CLPDF

[9] When Does Defendant Statement Matter? A Study of Bias and Persuasion in LLM-Simulated Jurors cs.CL | cs.CYPDF

[10] Improving Cross-Lingual Token Representations by Adding a Pinch of SALT cs.CL | cs.AIPDF

[11] VLX-VR: An Agentic-Aware Video Reasoning Model cs.CL | cs.CVPDF

[12] Stable Answers, Unfinished Reasoning: Why Self-Consensus Is Not a Safe Early-Exit Signal cs.CLPDF

[13] Direct Diversity Optimization for Diverse Successful Trajectories in Preference Post-Training cs.CL | cs.AI | cs.LGPDF

[14] Data-Centric Post-Training for Financial Reasoning: Mining, Distillation, and Verifiable Learning cs.CLPDF

[15] $Φ$-Bench: Can Large Language Models Engineer the Infrastructure That Powers Them? cs.CLPDF

[16] ProbPlug: A Plugin Uncertainty Network for Reliable Confidence in LLM Binary Classification cs.CLPDF

[17] Two-Token Features and Small-Large Ensembles for VLM Hallucination Detection cs.CLPDF

[18] On-Policy Distillation for Vision-Language Model Adaptation, an Effective Paradigm on Low-Quality Multimodal Data cs.CLPDF

[19] GANDR: Claim Auditing for Verifiable Legal Answer Generation cs.CL | cs.AI | cs.IRPDF

[20] Can Foundation Models Moderate Online Content? Evaluating Instruction- vs. Example-Driven Policy Operationalization cs.CL | cs.AI | cs.CYPDF

[21] Building Multilingual Bridges: Data Mixing as the Pillar of Generalization for In-Language Reasoning cs.CLPDF

[22] IBIB: A Protocol for Measuring Enterprise AI Systems by Serving Route, Not Model Identifier cs.CL | cs.AI | cs.LGPDF

cs.CV [Back]

[23] Integrating Unimodal and Vision-Language Representations in Latent Space for Multi-Label Chest X-Ray Classification cs.CVPDF

[24] Evidence-Order Calibration for Selective Visual Reasoning under Progressive Loss of Question-Critical Evidence cs.CVPDF

[25] M2LG-DG: A Multi-modal Local-Global Domain Generalization Framework for Cross-site Major Depressive Disorder Classification cs.CVPDF

[26] MLLMs Hallucinate when Information Distribution Drifts in Synergy Heads cs.CV | cs.CLPDF

[27] DensePol: Dense-Angle Polarization Dataset for Learning-Based Polarimetric Vision cs.CVPDF

[28] AgenticGen: Reward-Guided Agentic Video Generation for Advertising cs.CV | cs.AI | cs.CLPDF

[29] Video-MOPD: Multi-Teacher On-Policy Distillation for Video Understanding cs.CVPDF

[30] OmniPoint: Universal Monocular Metric Pointcloud from Any Camera cs.CVPDF

[31] The Living Library: Transforming Archival Collections into Conversational Knowledge Systems – Lessons from the Theodore Roosevelt Presidential Library cs.CVPDF

[32] Vision-language models know more about agriculture than they show and rubric-grounded verifications close the gap cs.CVPDF

[33] Low-Rank Prompt Learning for Vision-Language Models with Fixed-Token Bases cs.CVPDF

[34] Learning Global Camera Poses from Noisy View-Graphs for Structure from Motion cs.CVPDF

[35] AnimalLift: Reconstructing Animatable 3D Animals from a Single Image by Learning Canonical Shape, Texture, and Fur Maps cs.CVPDF

[36] VANTAGE-Bench: Evaluating the Infrastructure AI Gap in Vision-Language Models cs.CV | cs.AIPDF

[37] MotionBlind: Probing the Illusion of Motion Understanding in Video-LLMs cs.CVPDF

[38] RouteBridge: Reliability-Routed Bidirectional Distillation Between Neural Radiance Fields and 3D Gaussian Splatting cs.CV | cs.AIPDF

[39] VFNet: Multi-View Spatio-Temporal Model for Void Fraction Estimation in Gas-Liquid Two-Phase Flow cs.CVPDF

[40] IAE-VTG: Interaction-Aligned Action-Entity Video Temporal Grounding cs.CV | cs.MMPDF

[41] Recovering Biomechanical Signals from Missing Keypoints Using Temporal Interpolation in Monocular Gait Analysis cs.CV | eess.IVPDF

[42] LogiScope-VQA: Benchmarking Vision-Language Models for Logistics Hazard Identification in Industrial Scenarios cs.CV | cs.AI | cs.CLPDF

[43] Freezing of Gait Prediction Under Spatial Occlusion: An IMU-Supervised Cross-Modal Distillation Approach cs.CVPDF

[44] Pretraining and Distillation Matter More Than Architecture Family for Label-Free Single-Cell Classification cs.CVPDF

[45] From Pixels to Hierarchical Sequences: Quadtree Mask Encoding for Vision-Language Binary Change Detection cs.CVPDF

[46] StreetDiff: Multi-view Street Scenes Generation via Cross-view Consistent Multi-view Stable Diffusion with Structure Prompts cs.CVPDF

[47] Can We Trust Video Hallucination Detectors? VidHalLoc for Evaluating the Evaluators cs.CVPDF

[48] Putting Captions to the Test: Evaluating Video Caption Quality through Multiple-Choice Question Answering cs.CVPDF

[49] Multimodal Emotion Recognition in Conversations via Class-Wise Adaptive Modality Fusion and Affective Geometry cs.CVPDF

[50] Elastoformer: Enabling Dynamic Adaptivity via Elastic Model Transformation cs.CV | cs.AI | cs.PF | eess.SYPDF

[51] Beyond Similarity: Foundation Models as an Efficient Backbone for Training-Free Composed Video Retrieval cs.CVPDF

[52] Isotropic Embedding Perturbations for Robust Vision Language Encoders cs.CVPDF

[53] When Fusion Fails: Corruption-Aware Rebalanced Fusion for Multi-Modal Medical Image Segmentation cs.CVPDF

[54] SynThermFace: Amplifying Limited Paired Data for Visible-Thermal Face Recognition via Synthetic Data Generation cs.CVPDF

[55] UOT-Gap: A Variational Principle for the Modality Gap in Vision-Language Models via Unbalanced Optimal Transport cs.CVPDF

[56] Decoupled Self-Forcing Distillation for Streaming Talking Head Generation cs.CVPDF

[57] Geometry Without Coordinates: LiDAR Diffusion as a 3D Feature Bridge cs.CVPDF

[58] Learning to Adapt and Calibrate: Score Distribution Alignment for Few-Shot Uncertainty Prediction in Medical VLMs cs.CVPDF

[59] Beyond One-Size-Fits-All: Sample-Adaptive Strategy Routing for Vision Token Pruning in MLLMs cs.CV | cs.AIPDF

[60] Spot-the-shift: Evaluating Grounded Image Difference Captioning of Long-term Changes cs.CVPDF

[61] Why Is Video Still So Expensive? A Survey of Inference-Efficiency Mechanisms in Video and Audiovisual LLMs cs.CV | cs.CL | cs.MMPDF

[62] Beyond Weak Labels: Prompt-Guided Local Refinement for Weakly Supervised Water Segmentation in High-Resolution Multispectral Imagery cs.CVPDF

[63] Enhanced Deformable Convolution with Center-invariant Offset and Edge-aware Mask cs.CVPDF

[64] Programmable World Model cs.CVPDF

[65] Artificial Intelligence Literacy and Sustainable Development: An Ethical Governance and Development Goals Framework cs.CVPDF

stat.ML [Back]

[66] FlowCPO: A Unified Divergence View of Preference Alignment for Flow Models stat.ML | cs.AI | cs.CV | cs.LGPDF

math.NT [Back]

[67] What Does MMLU Actually Measure? A Psychometric Audit of Difficulty Structure in Aggregate Benchmark Scores math.NT | cs.CLPDF

eess.IV [Back]

[68] CHIMERA Challenge Task 2 and 3: Response Subtypes Classification and Progression Survival Prediction in Bladder Cancer Patients using Multimodal Datasets eess.IV | cs.CV | q-bio.QMPDF

[69] Morphological Decoupling-Based Skeletal Classification for Clinical Assessment of Malocclusion eess.IV | cs.CVPDF

cs.LG [Back]

[70] MetroLLM-Bench: Evaluating Language Models as Transit Kiosk Runtimes cs.LG | cs.AI | cs.CLPDF

eess.AS [Back]

[71] AVSRBench: A Multi-Condition AVSR Benchmark eess.AS | cs.CV | cs.MMPDF

[72] Candor-LR: A Dyadic Conversational Dataset for Audio-Visual Speech Recognition eess.AS | cs.CV | cs.MMPDF