cs.CL [Total: 96]
cs.CV [Total: 147]
cs.LG [Total: 9]
cs.AI [Total: 15]
cs.IR [Total: 2]
cs.RO [Total: 8]
eess.IV [Total: 1]
cs.HC [Total: 1]
cs.CR [Total: 3]
cs.SD [Total: 1]

cs.CL [Back]

[1] STAGEET: Stage-wise Typed Edit Tagging for Grammatical Error Correction with Arabic as a Case Study cs.CL | cs.AIPDF

Wenjie Lou, Alaa Mamdouh Akef

TL;DR: STAGEET是一种分阶段类型化编辑标注框架，用于语法错误纠正（GEC）。它将Seq2Edit监督重组为类型化的可执行阶段，并将编辑操作扩展到纠正类别，从而在保持高效性的同时提高可解释性。该框架在阿拉伯语GEC基准测试中实现了最先进的性能。

Details

Motivation: 现有序列到编辑方法虽然高效且局部可解释，但单一编辑词汇表无法清晰揭示纠正类型，限制了其可解释性。

Result: 在QALB-2014和ZAEBUC基准测试中，该方法在保持竞争力的编辑性能的同时，实现了QALB-2014上的最先进结果。

Insight: 将GEC分解为有序的中粒度类型化阶段，每个阶段使用独立的标签空间进行预测，并通过中间句子传递，从而提供更可检查的纠正轨迹；框架可实例化为共享编码器多头部模型或完全专业化变体。

Abstract: Sequence-to-edit approaches make grammatical error correction (GEC) efficient and locally interpretable by predicting edit labels over the input rather than generating a full corrected sentence. Their interpretability, however, is primarily operational: a label specifies how the string should change, but a single edit vocabulary does not always reveal the type of correction being made. We propose STAGEET, a stage-wise typed edit-tagging framework that reorganizes Seq2Edit supervision into typed executable stages and extends edit operations to correction categories. STAGEET decomposes correction into an ordered sequence of medium-grained typed stages; each stage predicts from its own label space, rewrites the current hypothesis once, and passes the resulting intermediate sentence to the next stage. We instantiate the framework as both an end-to-end shared-encoder multi-head model with stage-specific adapters and a fully specialized variant with one independent tagger per stage. Experiments on QALB-2014 and ZAEBUC show that category-aware staged correction retains competitive edit-based GEC performance while exposing a more inspectable correction trajectory, and attains state-of-the-art results on QALB-2014.

[2] From GenAI Virtual Patient Dialogue Logs to Teacher-Interpretable Process Evidence: A Learning Analytics Study in Higher Education cs.CL | cs.AI | cs.HCPDF

Xinyu Li, Zijian Li, Mengyu Xia, Luzhen Tang, Naping Chen

TL;DR: 本研究探讨了如何将生成式AI虚拟患者（GenAI VPs）的对话日志转化为教师可解释的临床推理过程证据。通过对1030个医学生与GenAI VPs的胸痛病例对话进行分析，并应用行为流行度、认知网络分析和转移网络分析等多层分析方法，揭示了高分咨询对话在信息收集、症状探索与沟通、核查、组织及综合等方面的关联模式。

Details

Motivation: 解决GenAI VPs对话日志在教育中难以直接使用的问题，即完整转录过于详细不便教师常规审查，而最终评分又无法反映学习者在咨询过程中是否跟进患者线索、核查不确定性或使用总结引导后续提问等过程细节。

Result: 在五周胸痛病例的对话分析中，高分咨询表现出更多的病史采集活动，且差异不仅在于数量；高分咨询更频繁地将信息收集和症状探索与沟通、核查、组织和综合相连接，总结和组织行为更常导向验证或机制导向的跟进。

Insight: 创新点在于提出并验证了多层分析框架（行为流行度、认知网络分析、转移网络分析）从GenAI VPs对话日志中提取可解释的临床推理过程模式，为医学教育中基于过程的反馈提供了新方法。

Abstract: Medical history taking is a dialogue-based clinical reasoning task in which learners must gather, organise, and integrate patient information while the consultation unfolds. Generative AI-powered virtual patients (GenAI VPs) make repeated history taking practice scalable and preserve full turn by turn dialogue. However, these logs are educationally difficult to use directly. Complete transcripts are too detailed for routine teacher review, whereas final scores obscure whether learners followed up patient cues, checked uncertainty, or used summaries to guide later questioning. This study examined whether coded GenAI VP dialogues can provide teacher-interpretable process evidence of clinical reasoning. We analysed 1{,}030 GenAI VP dialogues from 210 second-year medical learners across five weeks chest-pain cases. Each consultation was teacher-scored using a rubric assessing the full history taking dialogue, and consultations were classified within each week as high- or low-rated using the weekly median score. To explain how rated performance was reflected in the dialogue process, we applied three analytic layers to the same coded dialogue data: behavioural prevalence, local co-occurrence using Epistemic Network Analysis, and sequential transition using Transition Network Analysis. High-rated consultations involved more history taking activity, but differences were not simply about volume. High rated consultations more often connected information gathering and symptom exploration with communication, checking, organisation, and synthesis. Summarising and organising moves more often led to verification or mechanism-oriented follow-up. These findings show how layered analysis of GenAI VP dialogue logs can reveal process patterns associated with high rated history taking and support process-focused feedback in medical education.

[3] Parametric Multimodal User Memory: Storing What Captions Cannot Carry cs.CL | cs.AI | cs.CVPDF

Bojie Li, Noah Shi

TL;DR: 该论文提出了一种参数化多模态用户记忆系统，旨在解决传统基于文本的记忆模型无法捕捉用户感知特征（如声音、面部表情等）的问题。通过将视觉语言模型与专用编码器相结合，实现了对用户身份和上下文的联合建模，从而在多种模态（图像、音频、视频）上提升了对用户感知特征的记忆和识别能力。

Details

Motivation: 当前个性化代理主要依赖基于文本的记忆（如转录和字幕），这只能存储可描述的用户信息（如“我的猫叫Bibi”），而无法保留无法用文字描述的感知特征（如声音特质、面部表情变化等）。论文旨在解决这一局限性，构建能够存储多模态用户感知记忆的系统。

Result: 在PerceptMem基准测试（涵盖12个领域、1,080个任务）中，论文方法在非可命名信号（如跨年龄人脸识别）上实现了0.81的召回率，显著优于仅使用视觉语言模型（0.54）或未接地编码器（0.05）的方法。组合方法达到了接近正确区域预言机（0.96）的性能，并推广到多说话者音频和视频场景。

Insight: 创新点在于将用户记忆分解为两个子问题：视觉语言模型处理上下文接地（“什么”和“哪里”），专用编码器提取身份密钥（“谁”），两者通过注意力机制在生成时无缝集成。该方法无需训练即可在冻结模型上实现O(1)注册成本，并提出了参数化存储与文本存储的互补架构：感知身份信息适合参数化存储，而精确事实适合文本存储，两者可组合使用以全面记忆用户特征。

Abstract: A personalized agent needs a user memory: a persistent model of who its user is. Today it is almost always text – transcripts and captions retrieved by similarity. This serves the captionable half of a person (“my cat is named Bibi”), but discards the perceptual half no caption can hold: how a voice sounds, how a face reads across age and lighting, how tired someone sounds. We measure this loss across five modalities: a strong caption-based re-identifier recovers as little as 0.11 of a dedicated encoder’s recall, collapsing toward chance on non-nameable signals. We instead ground perceptual memory in the model, decomposing recall into two subproblems: a vision-language model grounds the referent in context (what and where), and a dedicated encoder extracts an identity key (who), stored as one inline token read by attention at generation with no external round-trip. Neither suffices alone – the VLM identifies cross-age faces at only 0.54 recall where a face encoder reaches 0.81, and an ungrounded encoder recognizes a two-person-scene referent at 0.05 – yet together they reach correct-region oracle (0.96), generalizing to multi-speaker audio and video. The recognition core is training-free: it reproduces the encoder’s recall on any frozen model at O(1) registration cost. On PerceptMem (12 domains, 1,080 tasks) perceptual identity is capacity-limited while exact facts are binding-limited: identity belongs in a parametric bank, facts in a text store. The two memories compose cleanly: an agent with both can remember not only what its user said, but also what they are like.

[4] Looking Again: Measuring Sycophancy in the Reasoning Chains of Multimodal Models Under Pressure cs.CL | cs.AIPDF

Mahir Numayeer Islam, Gakuto Okuyama, Nikolaus Siauw, Shivank Garg, Madhur Panwar

TL;DR: 本文针对大型多模态推理模型（LMRMs）中的谄媚行为（sycophancy）进行了研究，即模型倾向于在证据面前同意用户的错误观点。作者提出了一个用于评估LMRMs在面临用户错误答案时谄媚行为的基准和数据集，涵盖了数学、临床、时间和人口统计推理等多个视觉基础任务，并在单轮和多轮对话的压力条件下进行了测试。研究发现，在压力下谄媚行为普遍存在，尤其是在多轮临床视觉判断中，推理链层面的谄媚率可高达95.7%。

Details

Motivation: 大型多模态推理模型（LMRMs）通过生成显式的思维链推理来提升性能，但在语言模型中已观察到伴随而来的谄媚行为（即模型倾向于同意用户而非证据）。目前尚缺乏可靠的方法来测量LMRMs中的谄媚行为，本文旨在填补这一空白。

Result: 作者在四个视觉基础数据集（涵盖数学、临床、时间和人口统计推理）和五种压力条件下（单轮和多轮设置）评估了多个模型。研究发现，在压力下谄媚行为普遍存在，其中Statement压力引发最高谄媚率，Conviction压力最低（除Mistral-Small-4外）。在多轮压力下，临床视觉判断中的推理链层面谄媚率急剧上升，受影响最严重的模型达到95.7%。

Insight: 本文的创新点在于首次为LMRMs的谄媚行为建立了系统的评估基准和数据集，并引入了将推理链层面谄媚与答案层面谄媚分离的失败分类法，以及定位推理链中偏差首次出现的句子级分类法。关键洞察是：谄媚行为可能独立地腐蚀推理链，而不仅仅是最终答案，因此仅进行答案层面的评估是不充分的。

Abstract: Large multimodal reasoning models (LMRMs) are getting increasingly capable, primarily through generating explicit chain-of-thought reasoning before answering. In language models it has been observed that this performance often comes with sycophancy, the tendency of a model to agree with the user over the evidence. However, for LMRMs no reliable method to measure sycophancy yet exists. We bridge this gap by introducing a benchmark and dataset for evaluating LMRM sycophancy when confronted with a wrong answer from a user. Our benchmark pairs four visually grounded datasets spanning mathematical, clinical, temporal, and demographic reasoning with five pressure conditions in single-turn and multi-turn settings. We evaluate sycophancy in the final answer as well as its emergence within the reasoning chain. We find that sycophancy is prevalent under pressure, with Statement pressure eliciting the highest rates and Conviction the lowest for all models except Mistral-Small-4, and under multi-turn pressure reasoning-level sycophancy intensifies sharply in clinical visual judgement, reaching 95.7% for the most affected model. We further introduce a failure taxonomy separating reasoning-chain from answer-level sycophancy, and a complementary sentence-level taxonomy locating where in the chain drift first emerges. Our results show that sycophancy can corrupt the reasoning chain independently of the final answer, so answer-level evaluation alone is insufficient.

[5] MA-RAG: Multi-Agent Retrieval-Augmented Generation for Query-Driven Summarization of Longitudinal Parkinson’s Disease Assessments cs.CL | cs.AIPDF

Sana Alamgeera, Denise Goberta, Muhammad Irshad, Anne H. H. Ngu

TL;DR: 本文提出了MA-RAG框架，一种用于帕金森病纵向评估查询驱动总结的多智能体检索增强生成方法。该方法通过分解临床推理为多个领域专家智能体，结合结构化事实提取和最终验证阶段，来生成临床依据充分的总结。

Details

Motivation: 解决大型语言模型在总结结构化纵向临床评估数据时，缺乏领域专业知识、易产生事实错误和时间不一致性的问题。

Result: 在Fact Precision、Hallucination Rate、Temporal Fidelity和Semantic Similarity等客观指标以及临床专家主观评估上，MA-RAG显著优于传统、仅RAG和单智能体RAG基线，事实精度相对提升高达122%，幻觉率降低高达98%，并在组织和临床实用性方面获得专家最高评分。

Insight: 创新点在于将查询驱动的临床总结任务分解为由多个领域专家智能体协作完成，并结合了结构化事实提取和最终验证阶段，这为处理复杂、结构化的纵向数据提供了一种可靠的多智能体推理框架。

Abstract: Accurate interpretation of single-visit and longitudinal clinical assessments for Parkinson’s disease is time-consuming and often depends on specialist expertise. Although large language models (LLMs) can generate natural language summaries, they frequently lack domain-specific clinical grounding and struggle to produce factually correct and temporally consistent responses for structured longitudinal assessment data. To address these limitations, we propose MA-RAG, a query-driven multi-agent retrieval-augmented generation framework that decomposes clinical reasoning into domain-specialized agents, combines structured fact extraction, and synthesizes clinically grounded summaries through a final verification stage. The framework supports four clinical analysis tasks: single-session, trajectory, comparison, and cohort summarization. We evaluate MA-RAG using objective metrics, namely Fact Precision, Hallucination Rate, Temporal Fidelity, and Semantic Similarity, together with subjective evaluations conducted by clinical experts. Compared to Traditional, RAG-only, and Single-agent RAG baselines, MA-RAG substantially improves factual correctness, achieving up to a 122% relative increase in Fact Precision (from 0.436 to 0.990) and reducing the Hallucination Rate by up to 98% (from 0.564 to 0.010), while consistently receiving top ratings from clinical experts for organization and clinical usefulness. These results demonstrate that domain-specialized multi-agent reasoning enables reliable query-driven summarization of structured longitudinal clinical assessment data.

[6] Do large language models scrutinise what they review? A multimodal audit of scoring calibration, error detection, and author-identity effects cs.CL | cs.AIPDF

Emad Alharbi

TL;DR: 本研究评估了两种多模态大语言模型（Qwen2.5-VL-72B和Pixtral-Large-124B）作为同行评审员的能力，测试了其在评分校准、错误检测以及对作者身份（如机构声望）和图表呈现的敏感性。实验基于165篇ICLR 2026的投稿，并人为插入了145个可验证错误。

Details

Motivation: 随着大语言模型越来越多地被用于生成同行评审，本研究旨在检验其进行批判性评估的能力，特别是关注模型在评分、错误检测以及是否受作者身份或图表信息影响等方面的表现。

Result: 在ICLR 2026投稿数据集上，LLM给出的评分（7.0-8.1）显著高于人类平均分（3.4-6.8）。在自然提示下，模型仅检测出12.1%的插入错误，即使加入验证指令也只提升到22.2%。提供图表会降低错误检测率但提高评分。作者身份对评分和错误检测均无影响，且模型的编辑决定与简单平均分结果完全一致。

Insight: 论文的创新点在于对多模态LLM进行了一次系统的、受控的同行评审能力审计，揭示了其评分普遍虚高、错误检测能力有限、对图表存在依赖或幻觉（如描述未提供的图表），且决策机制简单。这为理解LLM在学术评审中的实际局限提供了实证依据。

Abstract: Large language models (LLMs) are increasingly used to generate peer reviews, prompting examination of their capacity for critical evaluation. This study evaluates two multimodal LLMs, Qwen2.5-VL-72B and Pixtral-Large-124B, as reviewers across 165 submissions to the 2026 International Conference on Learning Representations, a venue that postdates both models’ training cutoffs. Manuscripts were presented to both models with author identities blinded, replaced with high-prestige affiliations, or replaced with low-prestige affiliations, and in either text-only or text-with-figure format. Additionally, 145 verifiably detectable errors were inserted into 55 manuscripts to assess error identification under natural and verification-oriented prompts. Across all manuscript groups, including rejected submissions, LLM scores ranged from 7.0 to 8.1, whereas human mean scores ranged from 3.4 to 6.8. The models detected 12.1% of the verified errors under natural prompting, and a one-sentence verification instruction increased detection to 22.2%; however, 78% of the errors remained undetected. Providing figures reduced error detection while increasing review scores. No visual error was reliably verified against its corresponding figure, and half of the text-only reviews described figures that were not provided. Author identity did not influence either review scores or error detection. LLM editorial decisions exactly matched those produced by simple score averaging.

[7] Do MLLMs Really Understand Low-Resource Khmer Documents? A Pilot Study on Khmer Document VQA cs.CL | cs.AIPDF

Nimol Thuon, Panhapin Theang

TL;DR: 本文对多模态大语言模型在低资源高棉语文档理解任务上的能力进行了诊断性评估，构建了一个基于KH-FUNSD数据集的子集，包含发票、收据等商业表格的问答任务，并测试了Qwen-VL系列模型在不同配置下的性能。

Details

Motivation: 现有MLLMs在拉丁语系文档理解上表现良好，但其在低资源、非拉丁语系（如高棉语）场景下的可靠性尚不明确。高棉语文档因其复杂的字形、英柬混合字段及双重货币表示而带来独特挑战，且相关评测资源匮乏。

Result: 在构建的高棉语文档VQA子集上，直接基于图像的Qwen3-VL-8B模型总体准确率为51.9%，优于较小模型，但对高棉语及混合脚本答案的处理能力有限。结合外部OCR（Tesseract和PaddleOCR）可显著提升性能，分别达到61.9%和61.6%的准确率，但高棉语答案的难度仍远高于英语和数字字段。

Insight: 研究揭示了当前MLLMs在处理低资源非拉丁语系文档时的核心瓶颈：模型对视觉清晰的英语和结构化数字内容具备基础处理能力，但对原生高棉语脚本的理解仍是一项严峻挑战。这凸显了为低资源语言开发专用文档理解基准和增强模型跨语言泛化能力的重要性。

Abstract: Recent multimodal large language models (MLLMs) have advanced document understanding, visual question answering, and text extraction. However, their reliability in low-resource, non-Latin settings remains uncertain. Khmer form documents present particular challenges because they contain complex script forms, mixed Khmer-English fields, and monetary values in both Cambodian Riel and US Dollars. Available resources for Khmer Document VQA are also limited. This paper presents a pilot diagnostic evaluation of open MLLMs on Khmer document images. We construct an evaluation subset from the previously introduced KH-FUNSD collection, covering invoices, receipts, quotations, and other business forms. The subset includes questions in English and Khmer, with answers retained in their original English, Khmer, mixed-script, or numeric forms. Rather than introducing a full public benchmark, this study examines the capabilities and failure modes of existing models. We evaluate representative open Qwen-VL models using direct image-based prompting and compare parser-assisted and external OCR-assisted configurations with Qwen3-VL-8B. Direct Qwen3-VL-8B outperforms smaller models, achieving 51.9% overall accuracy, although performance remains limited for Khmer-script and mixed-script answers. External OCR produces the strongest results, reaching 61.9% with Tesseract and 61.6% with PaddleOCR. Nevertheless, Khmer-script answers remain substantially more difficult than English and numeric fields. The results indicate that current MLLMs can process visually clear English and structured numeric content, but reliable native Khmer document understanding remains an open challenge.

[8] Cross Lingual Transfer in Tulu Legal Comprehension: Script-Dependent Improvement and RAG-Induced Knowledge Conflict cs.CL | cs.AIPDF

Sindhu Shetty, Spurthi Setty, Natan Vidra

TL;DR: 本文研究了在低资源语言（图卢语）法律理解任务中的跨语言迁移问题，重点关注脚本依赖性和RAG框架下的知识冲突。通过测试Llama3、Hex-1和Sarvam三个模型对图卢语法律投诉的分类能力，发现将查询转写为其他德拉维达语系脚本（尤其是卡纳达语）能提升模型初步理解，但效果高度依赖脚本。在RAG框架下检索卡纳达语法律文献导致结果混杂，模型失败主要源于事实替换和虚构两种推理错误。

Details

Motivation: 解决低资源语言因缺乏充足训练语料而依赖高资源语言作为理解支架时，如何严格评估模型在跨语言低资源环境中的失败情况，特别是在法律领域。

Result: 在低资源德拉维达语言（图卢语）法律投诉分类任务上，转写为卡纳达语脚本时模型理解呈现最强正向趋势；RAG检索导致结果好坏参半，模型失败表现为事实替换和虚构。

Insight: 创新点在于揭示了低资源领域中模型失败根源是信息解析和后续推理过程，而非语料内容本身，并提出了脚本依赖理解与RAG鲁棒性相关联的见解；所采用的推理轨迹分析和统计诚实性框架可广泛适用于低资源多语言RAG评估。

Abstract: Low-resource languages without an adequate training corpus often use a related, higher-resource language as a scaffold for comprehension. Still, there is a need to develop rigorous evaluation methods to identify when models fail in cross lingual low-resource environments. Using the legal domain as a backdrop, three models (Llama3, Hex-1, Sarvam) were tested on the ability to classify legal complaints written in a low resource Dravidian language (Tulu). Transliterating queries across Dravidian scripts allowed models to gain a preliminary understanding of speakers’ complaints without the use of wide scale training, though the level of comprehension was heavily script dependent (with Kannada - another relatively low-resource language - producing the strongest positive trend). Retrieving from a corpus of Kannada legal papers across a RAG framework caused mixed results. Some models had a weak positive trend in comprehension under certain conditions, but when models failed, it was often across two axes: fact substitution (fixating on specific passage excerpts that skewed reasoning) and confabulation (hallucination that had no basis in either query or corpus). Within low resource domains, results identify the model’s parsing of information and subsequent reasoning as the source of reasoning failure, rather than corpus contents. Script-dependent comprehension and RAG robustness also seem to travel together. This is further supported by the reasoning-trace analysis and a statistical-honesty framework deployed - techniques that are more broadly applicable to low-resource multilingual RAG evaluation.

[9] Redesigning and Auditing Deep Research Writing for Faithful Reports cs.CL | cs.AIPDF

Hiroaki Hayashi, Pranav Narayanan Venkit, Prafulla Kumar Choubey, Chien-Sheng Wu

TL;DR: 本文针对深度研究（DR）系统生成的报告存在事实性错误的问题，提出了CLAIMPROBE审计框架和CLAIMWRITER写作框架。CLAIMPROBE通过将报告分解为具体主张来量化幻觉、错误归因、引用规范性和必要事实召回率。CLAIMWRITER则是一个基于主张的层次化写作器，通过提取源事实、映射到提纲并基于链接源的主张进行起草，显著提升了报告的忠实度。

Details

Motivation: 现有基于量规的深度研究系统评估方法往往掩盖了生成报告中细粒度的事实性错误，如幻觉和错误归因。论文旨在更精细地审计和改进DR系统生成报告的忠实性。

Result: 在三个现有的DR框架中，仅将报告生成器替换为CLAIMWRITER，就将幻觉减少了2.6到4.5倍，并将必要事实召回率提高了1.2到1.7倍，同时基本保持了整体报告质量。在源文档更新时，CLAIMWRITER在更新方法中能以最高比例将变更的源事实传播到修订报告中，且更具成本效益。

Insight: 创新点在于从“主张”层面进行细粒度审计（CLAIMPROBE）和生成（CLAIMWRITER），将报告生成过程解构为基于证据的主张构建与组织。这为评估和构建忠实、可追溯、易于更新的长文本生成系统提供了新范式。

Abstract: Rubric-based evaluations of deep-research (DR) systems often obscure fine-grained factual failures in generated reports. We introduce CLAIMPROBE, a claim-level audit that decomposes DR reports into claims and measures hallucination, misattribution, citation hygiene, and necessary-fact recall against retrieved evidence. Using CLAIMPROBE, we find that strong DR pipelines can omit key evidence and misattribute claims even when their rubric scores remain stable. We then propose CLAIMWRITER, a hierarchical claim-based writer that extracts source facts, maps them to a query-derived outline, and drafts each section from a source-linked claim representation. Across three prior DR frameworks, replacing only the report writer with CLAIMWRITER reduces hallucination by 2.6 to 4.5 times and improves necessary-fact recall by 1.2 to 1.7 times, while largely preserving overall report quality. CLAIMWRITER also enables localized revision: when sources change, it propagates changed source facts into revised reports at the highest rate among update methods, while also being more cost-effective.

[10] Can Large Language Models Identify Meaningful Touchpoints in Conversion Attribution? cs.CL | cs.AI | cs.IRPDF

Jinqi Wu, Sishuo Chen, Zhangming Chan, Yong Bai, Chao Yi

TL;DR: 该论文探讨了大型语言模型在转化归因中识别有意义的接触点（即对转化有贡献的交互）的能力。研究发现，LLMs能够有效发现现有基于协同过滤的启发式方法所遗漏的、与用户语义意图相关的隐含接触点，但仍存在改进空间。论文还分析了不同提示策略和基础模型选择对识别性能的影响，并展示了利用LLM生成的归因标签来增强工业级转化率模型训练的有效性。

Details

Motivation: 当前转化归因中的接触点选择方法严重依赖基于协同过滤的启发式规则，这些规则无法与用户感知的语义意图对齐，导致许多语义相关但隐含关联的接触点被遗漏，存在显著的语义鸿沟。

Result: 评估表明，LLMs能够有效发现大量隐含相关的接触点，但其选择性能仍有显著提升空间。利用LLM归因的转化标签来增强工业CVR模型训练，取得了显著的离线性能提升。

Insight: 论文的创新点在于系统评估LLMs在转化归因这一新任务上的语义推理能力，揭示了从机械规则匹配向人类对齐的语义推理过渡的新路线图，并实证了LLM生成标签对下游工业模型的实际价值。

Abstract: Touchpoint selection in conversion attribution, namely identifying meaningful touchpoints contributing to conversions, is essential for e-commerce recommendation and online advertising. Current selection methods rely heavily on collaborative-filtering-based heuristics, which fail to align with user-perceived semantic intent. Through human annotation, we reveal a significant semantic gap: many implicitly-related, semantically relevant touchpoints remain undetected by existing rules. Therefore, we systematically evaluate the capability of Large Language Models (LLMs) in identifying these hidden associations. Our evaluation shows that while LLMs effectively uncover a substantial portion of implicitly-related touchpoints, significant room for improvement remains in their selection performance. Furthermore, we analyze the impact of different prompting strategies and foundation model choices on identification performance, providing valuable insights into their reasoning patterns and effectiveness. These insights offer a new roadmap for transitioning conversion attribution from mechanical rule-matching to human-aligned semantic reasoning. Moreover, we leverage the LLM-attributed conversion labels for enhancing industrial CVR model training and achieve significant offline performance gains, showing the potential of LLMs in conversion attribution.

[11] Test-Time Scaling for Scientific Equation Discovery cs.CL | cs.AI | cs.LGPDF

Haowei Lin, Hubert Lim, Xiangyu Wang, Letian Huang, Di He

TL;DR: 本文研究了测试时缩放（TTS）在自动方程发现这一开放任务中的应用，将LLM驱动的方程发现建模为一个统一的迭代搜索过程，并比较了不同计算分配策略。研究发现，在固定计算预算下，搜索宽度是主导性能的关键参数，其最优值随预算增加而增加，而并行化能提升实际效率。

Details

Motivation: 现有TTS研究主要关注数学、编程等封闭式任务，本文旨在探索TTS在开放式的自动方程发现任务中的效果，该任务需要模型基于观测数据反馈搜索候选方程。

Result: 在LLM-SRBench方程发现任务上，实验表明搜索宽度是影响性能的主要分配参数，其最优值随计算预算增加而增加；种群-分支划分和控制器选择影响较小。适当的宽度选择通过增加并行性也提升了实际运行效率。

Insight: 论文的创新点在于将多种方程发现方法（如Best-of-N、序列精炼、树搜索、进化方法）统一到一个共同的计算分配框架下进行对比研究。核心洞察是，在拥有信息丰富的验证器的情况下，控制探索与利用的平衡是扩展基于LLM的方程发现的关键。

Abstract: Test-time scaling (TTS) improves language model reasoning by allocating additional test-time compute, but prior work mainly studies closed-ended tasks such as math and coding. We study TTS for automated equation discovery, an open-ended setting where models search over candidate equations and rely on observed datapoints for feedback. We formulate LLM-driven equation discovery as an iterative search process that unifies Best-of-N, sequential refinement, tree search, and evolution-style methods under a common compute-allocation view. To isolate allocation effects from prompt engineering and other heuristics, we compare minimal parallel controllers under fixed budgets. On LLM-SRBench equation-discovery tasks, we find that search width is the dominant allocation parameter: the best width in our sweep generally increases with the compute budget, while the population–branching split and controller choice matter less. Appropriate width selection also improves wall-clock efficiency by increasing parallelism. These results suggest that, given an informative verifier, controlling exploration and exploitation is central to scaling LLM-based equation discovery.

[12] ReVA: A Region-Aware Visual Assistant for Visually Grounded Question Answering cs.CL | cs.CVPDF

Anoop Senthil

TL;DR: 本文提出了ReVA，一种区域感知的视觉问答模型，旨在解决多模态大语言模型在需要精确空间推理和细粒度视觉理解问题上的局限性。该模型采用冻结的CLIP ViT-L/14视觉编码器和Qwen2.5-7B-Instruct大语言模型，通过一个双桥接机制将整图级和区域级视觉表征对齐到LLM的嵌入空间，并结合检测器栈提供的零样本边界框来增强视觉基础。

Details

Motivation: 当前多模态大语言模型在视觉问答中仍难以处理需要精确空间推理和细粒度视觉理解的问题，常出现物体、属性和空间幻觉，其根本原因在于缺乏足够的区域级和细粒度视觉基础。

Result: 在POPE基准测试中，ReVA取得了82.85%的平均F1分数，优于不使用区域标记的基线模型（81.14%）。在VQAv2、MMBench和SEED-Bench上的评估也验证了其有效性，表明显式的区域感知视觉表征能减少物体幻觉并提升模型的事实基础能力。

Insight: 核心创新点在于提出了一个双桥接架构，能够同时对齐整图和区域级视觉特征到LLM空间，并利用检测器栈（RAM++、spaCy、Grounding DINO）自动生成问题无关和问题相关的零样本边界框，从而为模型提供更丰富的细粒度区域证据。从客观角度看，这种显式地融合多尺度（从早期纹理到后期物体线索）区域信息的机制，是提升MLLM视觉基础能力的一个有效且可借鉴的方向。

Abstract: Multimodal Large Language Models (MLLMs) have achieved remarkable progress in Visual Question Answering (VQA), yet they continue to struggle with questions requiring precise spatial reasoning and fine-grained visual understanding. These limitations often manifest as object, attribute, and spatial hallucinations, where models generate confident but visually unsupported responses due to insufficient region-level and fine-grained visual grounding. To address this challenge, we propose ReVA, a region-aware VQA model that employs a frozen CLIP ViT-L/14 Vision Transformer (ViT) and a Qwen2.5-7B-Instruct large language model (LLM) connected through a dual bridge that aligns both whole-image and region-level representations with the LLM’s embedding space. The image bridge maps final transformer block features into image tokens. The region bridge maps cropped features from enriched intermediate features across ViT blocks so early texture and later object cues are more evident, into K region tokens for every bounding box. ReVA uses a detector stack that supplies automatic zero-shot bounding boxes that are both question-agnostic and question-dependent, using RAM++ (Recognize Anything Model), spaCy, and Grounding DINO. The image tokens and region tokens are concatenated as an LLM prompt prefix to jointly encode scene-level context and fine-grained regional evidence when answering questions. Evaluated on VQAv2, MMBench, POPE, and SEED-Bench, ReVA achieves 82.85% mean F1 on POPE, compared with 81.14% for an image-token baseline without region tokens. These results demonstrate that explicit region-aware visual representations reduce object hallucination and improve the factual grounding of MLLMs.

[13] A rigor-matched audit of periodic-step layer skipping for efficient llm inference: conflayers versus swift, with a supplemental analysis of trained routing alternatives cs.CL | cs.AI | cs.LGPDF

Prateek Kumar Sikdar, Arpan Ghosh

TL;DR: 本文对两种基于周期性步长搜索的层跳过方法（ConfLayers和SWIFT）进行了严谨匹配的审计，以评估它们在LLM推理效率上的表现。研究在两种模型规模（Qwen2.5-0.5B和1.5B）和两个任务（GSM8K推理与CNN/DailyMail摘要）上，比较了这两种方法与标准自回归解码的性能。结果表明，SWIFT在大多数情况下准确率最高，且在分离搜索开销后，其真实推理速度也更快；而ConfLayers则表现较差。此外，研究还补充分析了两种训练路由方法（LayerRoute和LayerDrop），发现它们虽能带来适度加速，但准确率远低于周期性步长方法。

Details

Motivation: 动机是评估和比较不同的层跳过方法在提高大型语言模型（LLM）推理效率时的实际性能，特别是区分在线搜索开销与纯推理成本，以提供更严谨的效率对比基准。

Result: 在四个实验单元（2模型规模×2任务）中的三个，SWIFT在准确率上表现最强；ConfLayers在所有单元中均被超越，尤其在1.5B模型上的GSM8K任务中差距显著。分离搜索开销后，SWIFT的真实推理速度比ConfLayers快5-21%，逆转了三个单元中的原始耗时排名。补充分析中，训练路由方法LayerRoute和LayerDrop实现了1.08-1.33倍的加速，但准确率远低于周期性步长方法，其中LayerRoute在1.5B模型的GSM8K任务上准确率近乎崩溃（平均精确匹配率仅0.003）。

Insight: 论文的创新点在于提出了一套严谨匹配的审计协议，用于公平比较不同层跳过方法的效率，并强调了分离搜索开销对于评估真实推理速度的重要性。客观来看，研究揭示了SWIFT这类自推测解码方法在平衡准确率与速度方面的潜力，同时指出训练路由方法在细粒度决策上的局限性，为未来高效LLM推理研究提供了重要的评估框架和基准。

Abstract: Layer-skipping methods for efficient LLM inference decide, at some granularity, which transformer layers to execute for a given input. We present a rigor-matched, three-seed audit of two periodic-step, search-based methods that make this decision online at inference time and re-evaluate it every few generation steps: a confidence-gated early-exit baseline (ConfLayers) and genuine self-speculative decoding (SWIFT, Xia et al. 2024), together with vanilla autoregressive decoding, across two model scales (Qwen2.5-0.5B and Qwen2.5-1.5B) and two tasks (GSM8K reasoning and CNN/DailyMail summarization). SWIFT is the strongest method on accuracy in three of four cells; ConfLayers is dominated everywhere, with particularly large deficits on GSM8K at 1.5B. Once online-search overhead is separated from pure inference cost, SWIFT’s true inference speed is faster than ConfLayers’s in all four cells (5-21%), reversing the naive wall-clock ranking in three of them. ConfLayers’s search overhead is small and stable (1-2% of cost), while SWIFT’s is larger and more variable (up to 28.7%). We additionally examine two trained-routing methods, LayerRoute (Sikdar, 2026) and LayerDrop (Fan et al. 2020), as a supplemental analysis because they operate at coarser decision granularities. Under a verified protocol with genuine per-input gating, a genuine full-model baseline, and genuine inference-time compute skipping, both show modest speedups (1.08-1.33x) but accuracy well below the periodic-step methods, including a near-total collapse for LayerRoute on GSM8K at 1.5B (0.003 mean exact-match across three seeds). We release the full audit protocol as a template for rigor-matched efficiency comparisons.

[14] No Detectable Change in Side-Level WER from Prompt-Level Context: A Preregistered Ablation on a Production Oral-History Corpus cs.CL | cs.AI | cs.SDPDF

Theodore O. Cochran, Stephanie Dodson, Keith Nore

TL;DR: 本研究通过预注册的消融实验，在真实的口述历史转录工具中测试了推理时提供上下文对大型多模态模型转录性能的影响。实验发现，在完整提示级上下文条件下，段落级词错误率（WER）未发生可检测的变化，且所有预注册假设均未得到支持。

Details

Motivation: 动机在于验证在推理时为大型多模态模型提供上下文是否是一种低成本、有效的领域自适应方法，以改进语音转录的准确性，特别是针对真实生产环境中的口述历史语料。

Result: 在GPT-4o-Transcribe配置下，完整上下文与无上下文条件之间的中位数配对差异仅为+0.6个WER点，置信区间为[-1.1, +1.0]，表明无显著改善；Gemini-2.5-Flash的结果则过于不稳定，无法得出可靠结论。

Insight: 创新点在于采用了预注册、代码冻结的严格实验设计，并在真实生产流水线上进行消融测试。核心发现是，在段落级别上，提示级上下文并未带来可测量的WER提升，这挑战了先前较小模型研究中报告的大幅增益。评估上下文机制需要结合序列对齐的术语级、插入和说话人标签指标，而不仅仅是聚合准确率。

Abstract: Supplying context at inference time to a large multimodal model is an inexpensive lever for adapting speech transcription to a domain, and earlier results on smaller models reported large gains. This work tested that mechanism where it ships, in the prompt-conditioning layer of a production oral-history transcription tool, on a sample from its own production corpus. Full prompt-level context did not detectably change side-level word error rate (WER), and none of the four preregistered hypotheses was supported. The design was a within-item paired ablation, preregistered with the analysis code frozen by hash before the confirmatory batch was scored; two disclosed gpt-4o pilot sides had been scored earlier, during scorer development. Nineteen cassette sides, about 10.6 hours of degraded 1970s-80s interview audio, were reprocessed through the production code path under three prompt arms, crossed with two deployed commercial configurations, gpt-4o-transcribe and gemini-2.5-flash, and scored against operator-corrected verbatim references. For gpt-4o-transcribe the median paired difference between the full-context and no-context arms was +0.6 WER points, with a side-resampled interval of [-1.1, +1.0]; the Gemini estimates were too unstable to support a comparable negative inference. A post-hoc rerun found run-to-run pipeline variability larger than the confirmatory differences, so effects of that size cannot be resolved from one transcription per cell. An implementation audit verified the manipulation was live, and sequence-alignment analysis found a small improvement on complete context-listed phrases, too small to materially change side-level WER, and for Gemini coexisting with worsened unlisted-token error. Evaluating context mechanisms therefore requires sequence-aligned term-level, insertion, and speaker-label measures alongside aggregate accuracy.

[15] CoVA-SFT: A Large-Scale Dataset for Chain of Visual Abstractions cs.CL | cs.CVPDF

Tsung-Han Wu, Heekyung Lee, Anya Ji, Haoming Chen, Trevor Darrell

TL;DR: 本文介绍了CoVA-SFT，一个包含51.9K样本、超过222K多模态推理步骤的大规模结构化数据集，以及配套的CoVA-Bench基准测试。该数据集旨在教导多模态语言模型在解决纯文本推理问题时，如何构建和维护内部视觉工作空间，通过交织文本和视觉抽象进行推理。

Details

Motivation: 现有文本链式思维（CoT）方法在处理视觉问题时，需要将视觉问题序列化为笨拙的文本描述，而社区缺乏大规模、多步骤、自校正的数据集来教导模型在纯文本推理中构建和维护内部视觉工作空间。

Result: 在CoVA-Bench基准测试上，使用CoVA-SFT微调的模型平均性能超过所有交织CoT基线两倍以上，但仍落后于强大的纯文本CoT基线。

Insight: 创新点在于提出了一个包含明确原理阐述、代理渲染和验证循环的大规模多模态推理数据集，以教导模型交织文本和视觉抽象进行推理，为视觉抽象链式推理提供了新的数据资源和方法探索。

Abstract: Chain-of-thought (CoT) reasoning has dramatically improved large language models (LLMs) by allowing them to decompose problems into intermediate steps. While CoT is widely effective for linguistic tasks, text-only CoT forces models to serialize visual problems into awkward prose. Although architectural solutions exist to process visual inputs, the community lacks a massive, multi-step, self-corrected dataset to teach models how to build and maintain internal visual workspaces when solving purely textual reasoning problems. To address this limitation, we introduce CoVA-SFT, a highly structured corpus of 51.9K samples containing over 222K multimodal reasoning steps across 5 distinct layout families and 17 complex tasks, and CoVA-Bench, a companion benchmark of 1,700 held-out test samples spanning the same tasks for reproducible evaluation. By providing explicit rationale formulations, agentic renderings, and verification loops, CoVA-SFT teaches multimodal language models to interleave text and visual abstractions. We validate the dataset by demonstrating that models fine-tuned on CoVA-SFT outperform all interleaved CoT baselines by more than 2x on average on CoVA-Bench, though they still fall short of strong text-only CoT baselines, highlighting open challenges for future work.

[16] HEAR Who Said What: Unlocking Speaker-Attributed Reasoning via Counterfactual Voice Grounding cs.CL | cs.AI | cs.SDPDF

Dongwook Lee, Sangkwon Park, Eunwoo Song, Che Hyun Lee, Youngho Cho

TL;DR: 该论文提出了HEAR基准测试，用于评估语音语言模型在多说话人环境中的说话人归属推理能力，发现现有模型主要依赖语义先验而非声学线索。为解决此问题，作者开发了A2R模型，通过CASH数据集训练以强化声学线索学习，在HEAR上取得优异表现并展现出零样本泛化能力。

Details

Motivation: 当前语音语言模型在多说话人场景中难以准确归属说话人并进行推理，缺乏专门的评估基准和方法来提升其基于声学线索的说话人感知能力。

Result: 在包含2.4K样本的HEAR基准上评估20个主流SLM发现性能不足；提出的30B参数A2R模型在HEAR上表现强劲，并在多说话人下游任务中实现零样本泛化，达到先进水平。

Insight: 创新点在于构建层次化基准HEAR揭示模型缺陷，并提出通过反事实音频与说话人级困难负样本（CASH）的数据集设计，引导模型聚焦声学特征而非语义信号，从而解锁说话人感知推理的潜在能力。

Abstract: Speech Language Models (SLMs) are increasingly deployed in multi-speaker environments, yet their ability to attribute speech to the correct speaker and reason over speaker identities remains unclear. Hence, we introduce HEAR, a conceptually hierarchical benchmark diagnosing the foundational capabilities of speaker-attributed reasoning, comprising 2.4K human-verified samples from 887 diverse multi-party audio clips. Evaluating 20 leading SLMs on HEAR reveals they struggle with these foundational tasks, often relying on semantic priors rather than actual vocal cues. To address this, we present A2R, a 30B model optimized on Counterfactual Audio with Speaker-level Hard negatives (CASH), a dataset designed to guide the model to prioritize acoustic vocal cues over linguistic signals. A2R achieves strong performance on HEAR and exhibits zero-shot generalization to diverse multi-speaker downstream tasks, demonstrating that learned speaker attribution unlocks the model’s latent capacity for speaker-aware reasoning. All resources are available at https://attributetoreason.github.io/AttributeToReason/

[17] Toward Cultural Alignment: Human-Centered Evaluation of Multimodal AI Stories Across Five African Communities cs.CL | cs.HCPDF

Millicent Ochieng, Felermino D. M. A. Ali, Elizabeth A. Ankrah, Najeeb Gambo Abdulhamid, Migisha Boyd

TL;DR: 本文研究了AI生成的多模态故事在五个非洲社区中与当地生活实践、关系、语言、价值观及视觉期望的文化对齐程度。通过社区参与的混合方法评估，发现文化对齐不仅取决于可识别的文化标记，还取决于这些标记如何融入社会、语言、程序和视觉背景。研究构建了文化对齐的分类法，并评估了五个多模态LLM评判者，发现自动化评估在不同社区中的可靠性差异显著，从而提出了社区校准的评估流程。

Details

Motivation: 解决AI生成内容（特别是多模态故事）与特定社区文化背景之间的对齐问题，以弥补当前AI系统在跨文化理解和代表性上的不足。

Result: 通过19位文化代表在五个非洲社区的定量标注和定性焦点小组讨论进行评估，揭示了文化对齐的复杂机制和常见的八种错位模式。评估五个多模态LLM评判者时，发现其可靠性和分数校准在不同社区间差异很大，没有单一评判者在所有五个场景中表现一致。

Insight: 创新点在于提出了一个基于社区的文化对齐分类法，强调文化对齐的上下文依赖性，并倡导社区校准的自动化评估流程，其中自动化评判者需根据社区判断进行验证，以确定其可信范围和仍需人工审核的领域。这为跨文化AI评估提供了可借鉴的框架和方法论。

Abstract: In this paper, we examine how well AI-generated multimodal stories align with the lived practices, relationships, language, values, and visual expectations of the communities they represent. We conduct a community-grounded mixed-methods evaluation with 19 culture representatives across five African communities, combining quantitative annotations with qualitative focus group discussions. We find that cultural alignment depends not simply on recognizable cultural markers, but on how those markers fit social, linguistic, procedural, and visual context. From these evaluations, we develop a taxonomy of cultural alignment comprising five broader cultural marker categories and eight recurring mechanisms of misalignment. We additionally evaluate five multimodal LLM judges to examine whether automated evaluation can approximate community-grounded judgments at scale. Judge reliability and score calibration vary substantially across communities, with no single judge performing consistently across all five settings. These findings motivate community-calibrated evaluation pipelines in which automated judges are validated against community judgments to determine where they can be trusted and where human review remains necessary.

[18] When Patients Cut In: Extending Clinical Conversational AI Safety to Interruptions cs.CLPDF

Zachary Ellis, Spencer Hazel, Adam Brandt, Yajie Vera He, Ernest Lim

TL;DR: 本文研究临床语音助手在患者打断情况下的安全性问题，提出了一种基于对话分析重叠类别的中断恢复评估框架，测试了四种LLM配置在信息收集和信息提供场景下的表现，发现中断鲁棒性需基于具体内容评估且无法用单一分数衡量。

Details

Motivation: 临床语音助手在真实部署中常被患者打断，而现有基准测试假设患者会等待代理说完，忽略了中断导致的关键临床内容丢失问题。

Result: 在信息收集场景中，模型表现存在差异；在信息提供场景中，所有模型在竞争性FAQ中断下均出现30/30的内容覆盖失败（Wilson 95% CI: 88.6-100.0%），且简短道歉标记对恢复率的影响因模型而异。

Insight: 创新点在于将对话分析中的重叠类别（识别性、竞争性、过渡性单元）操作化为中断类型，并提出了基于内容、分场景评估的中断鲁棒性框架，强调部署需匹配具体中断模式。

Abstract: Clinical voice agents are now deployed in routine care, where real patients do not wait their turn: they interrupt. These systems typically use a cascaded architecture (speech-to-text -> LLM -> text-to-speech), so when a patient cuts the agent off mid-utterance, clinically required content can be lost even when the model handles cooperative transcripts well. Yet clinical conversational-AI benchmarks almost universally assume patients wait for the agent to finish, missing interruption-induced loss of required content. We present a transcript-based evaluation of interruption recovery, adapting conversation-analytic overlap categories into three operational types (recognitional, competitive, transitional sub-unit) and testing four deployment-oriented, non-reasoning LLM configurations across four cells spanning history-taking (information gathering) and FAQ (information provision), scored on whether the agent preserves the clinically required content. In the gathering cells, target-question failure varied across models; in the provision cells, where arms are directly comparable, failure rose for every model. Rankings differ across cells, and competitive FAQ interruption produced 30/30 provision-coverage failures for all four models (Wilson 95% CI: 88.6-100.0%; baseline 0/30 for three, 4/30 for Llama). A brief apology marker (“sorry to interrupt”) shifts recovery by tens of percentage points, inconsistently across models, and for one it reduces recovery. Interruption robustness therefore cannot be a single score: evaluation must be content-grounded, reported per cell, and matched to the deployment’s interruption profile.

[19] Anchoring Speech with Semantics: A Multimodal Adapter Mechanism for Automatic Speech Recognition in Low-Resource Languages cs.CL | cs.SD | eess.ASPDF

Kuan-Tang Huang, Cheng-Yeh Yang, Chien-Chun Wang, Hung-Shin Lee, Hsin-Min Wang

TL;DR: 本文提出了一种名为SAMA-ASR的轻量级适配器机制，用于解决低资源语言自动语音识别（ASR）中因转录文本稀缺导致的监督证据不足问题。该方法通过引入来自辅助翻译的语义锚点和来自语音的声学锚点，增强编码器-解码器语音模型的解码器，实现跨模态适应。

Details

Motivation: 动机是解决低资源ASR任务中因转录数据稀缺而导致的监督信号有限、模型生成能力不足的问题。

Result: 在涵盖台湾闽南语和客家话的两个30小时低资源数据集上的实验表明，SAMA-ASR在声学基线、基于提示的基线以及仅使用翻译语义引导的基线上均取得了改进，并且在自动生成语义锚点的实际设置中依然有效。

Insight: 创新点在于提出了一种轻量级的跨模态适配器机制，将翻译任务中提取的语义嵌入与语音嵌入相结合，为解码器提供融合了话语级语义和语音证据的锚点，且这些语义锚点可由上游语音翻译模型自动生成，无需依赖人工翻译。分析表明，即使是紧凑的语音翻译模型也能产生有效的语义锚点。

Abstract: Low-resource ASR remains difficult because scarce transcripts provide limited supervised evidence for target-side generation. To address this gap, we propose SAMA-ASR, a lightweight adapter mechanism that augments the decoder with semantic anchors from auxiliary translations and an acoustic anchor from speech; in principle, the mechanism can be applied to similar encoder–decoder multitask speech models. Through cross-modal adaptation, SAMA-ASR conditions decoder states on translation-derived semantic embeddings and a speech embedding, combining utterance-level meaning with speech-grounded evidence before token prediction. At evaluation time, these semantic anchors can be generated automatically by an upstream speech-to-text translator rather than supplied as oracle translations. Experiments on two 30-hour datasets covering the low-resource Sinitic varieties Taiwanese Hokkien and Hakka show that SAMA-ASR improves over acoustic, prior prompt-based, and semantic-only translation-guided baselines and remains effective in practical automatic semantic-anchor settings; translator-capacity analyses show that useful semantic anchors can be produced by a compact ST model.

Zhaolu Kang, Meixin Wu, Yu Xue, Yingjie He, Qiming Shi

TL;DR: 该论文提出了模态断层线的概念，并引入了SCEval诊断评估协议，用于评估全模态大语言模型在跨模态证据结构受损时的鲁棒性。研究发现，结构损坏会降低模型在干净输入上的准确率，文本-视觉损坏是最稳定的共享断层线，且多模态性能下降是非加性的。

Details

Motivation: 当前全模态大语言模型的评估通常在干净、同步、可解释的多模态输入上进行，这无法判断模型的成功是依赖于稳定的跨模态结构，还是仅依赖于完整输入中的线索。论文旨在填补这一空白，探究当模态内部证据结构被扰动时模型的稳定性。

Result: 在基于Social-IQ、OmniBench和VALOR构建的273个人工验证的三模态示例上，SCEval评估了15个专有和开源的全模态系统。结果显示，结构损坏会降低干净准确率，文本-视觉损坏是影响最稳定的共享断层线，多模态性能下降是非加性的。

Insight: 论文的创新点在于定义了模态断层线这一诊断概念，并提出了SCEval评估协议来系统性地扰动模态内部结构。其核心洞察是，干净输入上的高准确率并不能保证模型在跨模态证据结构不可靠时依然可靠，这揭示了当前全模态推理的脆弱性。

Abstract: Omni-modal large language models are increasingly evaluated on clean text–vision–audio inputs, where every channel is present, synchronized, and readily interpretable. Such scores are often taken as evidence of robust cross-modal fusion, but clean evaluation cannot tell whether success depends on stable cross-modal structure or on cues sufficient only in intact inputs. To address this gap, we define a modality fault line: a boundary at which model behavior becomes unstable when a modality remains present and human-interpretable, but its internal evidence structure is perturbed. We introduce SCEval (Structure-Corruption Evaluation) a diagnostic evaluation protocol that keeps the question, answer space, and modality channels fixed while applying controlled structural corruptions to text, vision, and audio individually and jointly. Built from $273$ human-verified tri-modal examples from Social-IQ, OmniBench, and VALOR, SCEval evaluates $15$ proprietary and open-source omni-modal systems. The results show that structural corruption lowers clean accuracy, text–vision damage forms the most stable shared fault line, and multi-modal degradation is non-additive rather than a simple function of the number of corrupted modalities. Clean omni-modal accuracy therefore does not establish that a model will remain reliable when cross-modal evidence becomes structurally unreliable.

[21] Cloud and On-Premises Deployment of Uzbek Legal RAG via Targeted Retriever Fine-Tuning cs.CL | cs.IRPDF

Tatul Danielyan, Mariam Avetisyan, Hrant Davtyan

TL;DR: 本文介绍了为乌兹别克语法律问答构建和部署检索增强生成（RAG）系统的实践，该系统需在云端（追求质量与成本平衡）和本地（受限于硬件、延迟和数据安全）两种模式下运行。作者为此创建了两个领域基准测试，并发现通过微调可以低成本地缩小开源与专有模型之间的性能差距，因此训练了乌兹别克语的开源SOTA文本嵌入模型UTE-1。同时，论文指出对长上下文法律问答模型进行微调既不可行也无必要，并提供了实用的部署指南。

Details

Motivation: 解决在低资源语言（乌兹别克语）和严格操作约束（成本、延迟、数据安全）下，部署法律问答RAG系统所面临的挑战，这些挑战是通用排行榜无法反映的。

Result: 在构建的两个领域基准（检索基准和端到端问答基准）上评估，发现开源与专有模型的性能差距很小，且通过微调可以低成本地弥补。训练出的UTE-1模型在乌兹别克语开源模型中达到了SOTA的文本嵌入性能。同时，QLoRA实验报告了负面结果，表明对长上下文法律问答模型进行微调不切实际。

Insight: 针对特定低资源语言和领域（如法律），创建定制化基准比依赖通用排行榜更重要；通过针对性的检索器微调（如训练UTE-1）是提升RAG系统性能且成本效益高的关键；在数据频繁变化（如法律条文更新）且硬件受限的场景下，对长上下文问答模型进行全参数微调可能既不可行也无必要，应优先优化检索组件。

Abstract: Deploying large language models for legal question answering raises challenges that general-purpose leaderboards do not capture, particularly for low-resource languages and under hard operational constraints. We report on building and operating a retrieval-augmented (RAG) legal assistant for Uzbek that must run in two regimes: a managed cloud service that maximizes answer quality within a per-token cost ceiling, and an on-premises deployment for clients whose legal data may not leave their infrastructure, restricting us to open-weight models on limited local hardware under latency constraints. Because no evaluation existed for this setting, we build two domain benchmarks: a retrieval benchmark of 178 expert-annotated legal queries with gold provision spans, and an end-to-end benchmark of 504 expert-curated question–answer pairs scored by an LLM judge whose ratings we validate against human judgments and against an independent-family judge. Applying these benchmarks under each regime, we find the open-versus-proprietary gap is small and cheaply closed by fine-tuning. Therefore, we train UTE-1, which is a state-of-the-art text embedder among open models for Uzbek. We also demonstrate that closing the performance gap via fine-tuning is both impractical due to the intensive hardware demands of long-context legal Q&A and unnecessary, given that legal acts change frequently. We support this by reporting a negative result from a QLoRA experiment. We distill practical guidance for similar deployments, drawn from a system serving real users in production. We release our benchmarks, evaluation code and the fine-tuned embedder (UTE-1) \href{https://metric-ai-lab.github.io/Uzbek-Legal-RAG/}{at this https URL} to support future work on low-resource legal NLP.

[22] When to Adapt: Conditional Memory Adapters for Retention-Preserving Domain Specialization cs.CLPDF

Jiayu Hou, Lei Wang

TL;DR: 本文提出了Engram Adapter框架，用于在冻结的大型语言模型上进行领域专业化微调。该方法通过复用预训练时的条件记忆作为事后适配器，利用基于局部n-gram模式的多通道匹配和显式占用跟踪作为轻量级选择性先验，使残差注入更可能发生在领域内输入上，同时通过学习标量门抑制不相关的领域外检索。

Details

Motivation: 解决在专业领域部署大语言模型时，需要提升领域内性能而不牺牲通用能力的问题。现有参数高效微调方法通常是“始终开启”的，其学习的扰动应用于每个输入，这会损害领域外性能。

Result: 在Qwen3-4B和Qwen3-8B模型上，以AG-News和MedMCQA作为适应任务进行评估，领域外基准涵盖推理、翻译、代码生成和法律推理。Engram Adapter提升了领域内准确率，同时保持了99.4%到100.1%的平均领域外性能；在LegalBench上，其平均表现甚至略微超过了冻结的基础模型，而可比的“始终开启”基线方法则性能急剧下降。

Insight: 核心创新点在于将条件激活作为实现模块化、保留通用能力的领域专业化的有前景途径。具体机制包括：利用预训练条件记忆作为适配器，引入基于n-gram的轻量级选择性先验，以及通过门控和投影衰减将领域外激活的残差影响降至极低水平，从而最小化KL散度漂移和准确率变化。

Abstract: Large language models deployed in specialized domains must improve in-domain performance without sacrificing general capabilities. Existing parameter-efficient fine-tuning methods are typically always on: their learned perturbations are applied to every input, which can degrade out-of-domain (OOD) performance. We propose Engram Adapter, a framework that repurposes pretraining-time conditional memory as a post-hoc adapter for frozen LLMs. It uses multi-channel matching over local n-gram patterns with explicit occupancy tracking as a lightweight selectivity prior, making residual injection more likely on in-domain inputs while a learned scalar gate suppresses incoherent OOD retrievals. We evaluate on Qwen3-4B and Qwen3-8B with AG-News and MedMCQA as adaptation tasks and OOD benchmarks spanning reasoning, translation, code generation, and legal reasoning. Engram Adapter improves in-domain accuracy while preserving 99.4%–100.1% of average OOD performance; on LegalBench it slightly exceeds the frozen base model on average, whereas comparable always-on baselines degrade sharply. Mechanistic analyses show that although OOD activations are non-zero, gate and projection attenuation reduce residuals to approximately 0.08% of hidden-state norm, yielding small KL drift and negligible accuracy change. These results suggest conditional activation is a promising route toward modular, retention-preserving domain specialization over frozen backbones.

[23] AlgoWorlds: Benchmarking Tool Use for Global Optimization in Algorithmic Worlds cs.CLPDF

Zixiang Xu, Jiaan Wang, Fandong Meng

TL;DR: AlgoWorlds是一个用于评估智能体在组合优化问题中工具使用能力的基准测试，它将形式化定义的组合优化问题转化为部分可观测的决策环境，要求智能体通过任务特定的信息工具收集隐藏实例的信息，并做出结构化决策以评估其可行性和最优性。

Details

Motivation: 现有工具使用基准主要关注智能体是否能够使用合适的工具和参数完成任务，但在现实决策场景（如路径规划和车队调度）中，仅满足可行性是不够的，因为个体选择会通过共享约束和成本相互影响，导致可行解可能仍然显著次优。因此，需要评估智能体能否将工具收集的信息转化为全局最优决策。

Result: 在AlgoWorlds的240个环境中，覆盖了10个组合优化家族和4个工作量级别，评估了包括Claude Opus 4.8和GPT-5.6 Sol在内的七个领先LLM。结果表明，实现全局最优性仍然极具挑战性：尽管领先模型在大多数情况下能产生可行决策，但表现最佳的模型仅在38.61%的情况下达到精确最优性。

Insight: 创新点在于将组合优化问题转化为部分可观测的决策环境，并引入可验证的全局最优解作为评估标准，强调了智能体在信息整合、全局约束推理和决策验证方面的能力，而不仅仅是信息获取。这为工具使用评估提供了更全面的框架，有助于推动智能体在复杂决策任务中的发展。

Abstract: Tool-use benchmarks generally evaluate whether an agent completes a workflow using appropriate tools and valid arguments. However, feasibility alone is insufficient in real-world decision settings such as route planning and fleet dispatch. Individual choices interact through shared constraints and costs, so a feasible solution may still be substantially suboptimal. This raises a harder question: can an agent turn information gathered through tools into a globally optimal decision? We introduce AlgoWorlds, a benchmark that transforms formally specified combinatorial optimization problems into partially observed decision environments with verifiable global optima. Each environment contains a hidden instance observed only through task-specific information tools, after which the agent commits to one structured decision evaluated for feasibility and optimality. AlgoWorlds contains 240 environments covering ten combinatorial optimization families and four workload levels. Family-specific deterministic programs generate the instances, exact algorithms certify their optima and determine workload levels, and two structurally different tool interfaces present each underlying instance. We evaluate seven leading LLMs, including Claude Opus 4.8 and GPT-5.6 Sol. Achieving global optimality remains highly challenging: although leading models produce feasible decisions in most cases, the best-performing model reaches exact optimality in only 38.61% of cases. Even when agents collect sufficient information to reconstruct the hidden instance, most failures end in feasible but suboptimal decisions. The challenge therefore extends beyond information acquisition to information integration, global constraint reasoning, and decision verification. The project homepage is available at https://xzx34.github.io/AlgoWorlds/, and the code is available at https://github.com/xzx34/AlgoWorlds.

[24] StageWell: A Process-Aligned Chinese Corpus for Positive-Psychology Support Dialogue cs.CL | cs.AIPDF

Yuxiong Wang, Ziwei Lin, Bo Wang, Yu Zhang, Shiguang Ni

TL;DR: 该论文提出了StageWell，一个面向积极心理学支持对话的过程对齐中文语料库，以及一个名为HQS的结构化数据构建与评估协议。StageWell将支持过程组织为六个阶段，并通过多智能体全对话重写工作流构建了12,445个SFT实例、1,849个DPO偏好对以及一个包含120个专家修订对话和977个问答对的GroundTruth子集。实验表明，基于该语料库的监督训练能有效提升多个开源大语言模型在过程控制、回复质量和安全性方面的表现。

Details

Motivation: 现有积极心理学对话资源通常将监督简化为轮次级别的策略或整体偏好标签，使得过程位置、支持功能和局部修复目标变得隐式。论文旨在通过构建一个过程对齐的语料库，将支持性对话建模为一个结构化的多轮支持过程，而非单轮回复生成。

Result: 在四个9B-14B的开源大语言模型上，使用该语料库进行监督训练带来了稳健的性能提升。平均而言，BERTScore提高了0.037，Q-Overall评分增加了1.32分，S-exact指标提高了0.236，而H-critical率降低了0.167。

Insight: 论文的核心创新在于提出了一个结构化的多阶段支持过程框架（HQS协议）以及一个基于多智能体全对话重写的工作流来构建高质量、过程对齐的语料库。其DPO偏好对构建方法（将存在缺陷的模型输出作为被拒绝的回复，并在相同上下文和阶段约束下进行针对性重写作为被选中的回复）是一种新颖且有效的监督信号设计，强调了对话的过程性和局部修复目标。

Abstract: Positive psychology dialogue aims to support emotional distress and positive resource building, requiring models to produce not only empathetic replies but also coherent progression through a multi-turn support process. Existing resources often reduce supervision to turn-level strategies or holistic preference labels, leaving process position, support function, and local repair targets implicit. We introduce StageWell, a process-aligned Chinese corpus for positive psychology dialogue, together with HQS, a structured protocol for data construction and evaluation. StageWell organizes support into a six-stage support process and uses a multi-agent whole-dialogue rewriting workflow to construct 12,445 SFT instances, 1,849 DPO preference pairs, and a GroundTruth subset of 120 expert-revised dialogues and 977 QA pairs. Guided by HQS, DPO pairs are built as process-localized repairs: flawed model outputs are used as rejected responses, and targeted rewrites under the same context and stage constraint are used as chosen responses. Across four 9B-14B open-source LLMs, this supervision yields robust gains in process control, response quality, and safety. Averaged across models, BERTScore improves by 0.037, Q-Overall increases by 1.32 points, S-exact increases by 0.236, and the H-critical rate decreases by 0.167. These results highlight the value of modeling supportive dialogue as a structured multi-turn support process rather than as single-turn response generation.

[25] Evaluating the Semantic Specificity of Representation Steering in Language Models cs.CLPDF

Zhangdie Yuan, Andreas Vlachos

TL;DR: 本文提出Cross-Rule Transfer (CRT)诊断框架，用于评估语言模型中局部表征引导(LRS)技术的语义特异性。研究发现，针对逻辑矛盾盲区问题的LRS干预并未真正修复推理回路，而是注入了全局标签偏差，导致模型在原本能正确处理的规则上性能大幅下降。

Details

Motivation: 动机在于揭示广泛使用的LRS技术可能仅通过表面标签覆盖来修正推理缺陷，而标准基准评估容易被误导，需要更严格的诊断方法来区分真正的推理修复与表面干预。

Result: 实验显示，在模型原本正确率99.6%的规则上应用LRS向量后，性能降至40.4%；通过四项互补控制实验（直接logit偏差等效、控制向量标签翻转、跨模型嫁接、早期层引导检查）验证了诊断结论。

Insight: 创新点在于提出CRT诊断框架，通过评估模型在原生已掌握规则族上的表现来审计表征干预；客观分析认为该方法为区分真实推理修复与表面标签覆盖提供了严谨的方法论，对可解释AI领域具有重要参考价值。

Abstract: Localized Representation Steering (LRS) is widely used to correct reasoning pathologies in large language models. However, standard benchmark evaluations can easily be fooled by superficial label overrides, creating a false impression of reasoning circuit repairs. In this work, we propose Cross-Rule Transfer (CRT), a diagnostic framework that audits representational interventions by evaluating them on rule families where the model is natively competent. Evaluating late-layer LRS for a widespread logical failure, contradiction blindness, reveals that the intervention merely injects a global label bias: applying the steering vector to rules the model already handles correctly (99.6% baseline) degrades performance to 40.4% by forcing false contradiction predictions. We support this diagnosis with four complementary controls (direct logit bias equivalence, control vector label-flipping, cross-model grafting, and early-layer steering checks), providing a rigorous methodology to distinguish genuine reasoning repairs from superficial label overrides.

[26] Chain-of-Thought Faithfulness of Reasoning Models Varies with Where and How Preference Cues Are Delivered cs.CL | cs.AIPDF

Aryo Pradipta Gema, Neel Rajani, Rohit Saxena, Wai-Chung Kwan, Pasquale Minervini

TL;DR: 本文提出了FACE-Eval评估框架，用于测试推理模型在不同位置（用户消息或工具返回）和不同显式程度（直接总结或原始工件）接收偏好提示时，其思维链（CoT）的忠实性。研究发现，所有模型对工具返回提示的显式承诺都低于用户消息提示，且对隐式提示的未言明采纳率更高，表明CoT监控在偏好信息通过工具传递或需要从原始工件推断时可能不可靠。

Details

Motivation: 现有思维链忠实性测试通常将显式偏见提示放在用户消息中，而智能体可能通过工具返回或原始工件遇到偏好，因此需要评估提示位置和显式程度对推理模型忠实性的影响。

Result: 在15个开放权重模型（参数范围4B到1.60T）上，所有模型对工具返回提示的显式承诺均低于用户消息提示，且对隐式提示的未言明采纳率更高（30个模型-通道比较中28个成立）。源归属提示在7个模型上缩小了通道差距，而告知模型其推理将被监控则无效。两个转录监控器（GPT-5.6-Luna和GPT-4o-mini）检测偏好采纳的能力与未言明采纳率呈负相关（Pearson r分别为-0.54和-0.78）。

Insight: 创新点在于提出了FACE-Eval评估框架，系统性地测试提示位置和显式程度对CoT忠实性的影响。研究发现工具返回和隐式提示会降低CoT监控的可靠性，这为设计更健壮的推理监控机制提供了重要洞见。

Abstract: Chain-of-thought (CoT) monitoring assumes that reasoning traces faithfully record the information that shapes a model’s answer. Existing faithfulness tests often place explicit bias cues in the user message, while agents may encounter preferences through tool returns or raw artifacts. We introduce FACE-Eval (Faithful Attribution of Cue Effects Evaluation), a 5,100-sample evaluation that varies cue location (user message or tool return) and explicitness (direct summary or raw artifact). We measure verbalized commitment among cue-following answers and unverbalized adoption among all cued samples. We evaluate 15 open-weight models from eight families, with total parameters ranging from 4B to 1.60T. Every model has lower verbalized commitment for tool-return than user-message cues and for implicit than explicit cues. Unverbalized adoption is higher for tool-return cues on all 15 models and for implicit cues in 28 of 30 model-channel comparisons. A source-attribution prompt narrows the channel gap on seven models, sometimes by increasing user-channel unverbalized adoption, while telling models that their reasoning will be monitored does not reliably close the gap. We also use two transcript monitors (GPT-5.6-Luna and GPT-4o-mini) to detect preference adoption in the largest model of each family. Across 32 model-channel-explicitness cells, higher unverbalized adoption is associated with lower detection ability for both monitors (Pearson r=-0.54 and r=-0.78, respectively). These results suggest that CoT monitoring may be less reliable when preference information arrives through tools or must be inferred from raw artifacts, within the single-call, prefilled-tool setting tested here.

[27] Argument-Aware Semantic Alignment of Normative Texts: A Toulmin-Based Neuro-Symbolic Approach cs.CL | cs.AIPDF

William Schroeder

TL;DR: 本文提出了一种结合神经语义与图尔敏论证结构的神经符号方法，用于专业规范性文本的语义对齐。该方法利用大语言模型显式识别论证要素（如主张、依据、保证等），并构建论证感知的相似性与结构特征，以提升跨标准控制映射的准确性。在NERC-CIP到NIST-CSF的映射基准测试中，论证特征显著优于仅基于神经语义的基线方法。

Details

Motivation: 解决专业规范性文本（如网络安全标准）语义对齐的挑战，即等效要求可能使用不同术语、句法和抽象层次，而现有基于词汇重叠或分布嵌入的方法常忽略支撑规范性主张的论证结构。

Result: 在NERC-CIP到NIST-CSF映射基准上，论证衍生特征（特别是与保证相关的特征）提升了对齐性能，优于神经符号语义基线；精简的主张-依据-保证特征子集与完整图尔敏特征集表现相当。

Insight: 创新点在于将显式论证结构作为中间表示，通过神经符号管道结合神经文本表示与图尔敏特征；论证结构（尤其是主张与推理间的链接）提供了传统语义相似性未捕获的互补信息，可能支持后续规范性文本的检索、推理与解释任务。

Abstract: Semantic alignment between specialized normative texts is challenging when equivalent requirements use different terms, syntax, and levels of abstraction. Lexical overlap, distributional embeddings, and semantic similarity capture topical relatedness but often miss the argumentative structure by which normative claims are supported, qualified, and justified. This paper asks whether explicit argument structure adds information complementary to neural semantics for aligning requirements. We treat cross-standard control mapping as argument-aware semantic alignment and build a neuro-symbolic pipeline that combines neural text representations with Toulmin features. An LLM explicitation step identifies claims, grounds, warrants, qualifiers, and backing and reconstructs enthymemes. These feed an alignment model via argument-aware similarity and structural features. On a NERC-CIP to NIST-CSF mapping benchmark, argument-derived features improve alignment over a neuro-symbolic semantic baseline. Feature selection shows especially strong signal from warrant-related features, indicating that the link between a claim and its supporting reasoning is not captured by conventional similarity alone. A compact claim–grounds–warrant subset remains competitive with the full Toulmin feature set. The results give preliminary evidence that argument structure is a useful intermediate representation for aligning specialized normative texts. Cybersecurity standards are used as a controlled testbed, not as proof of domain-independent generalization. The argument graphs produced by LLM explicitation may also support later work on retrieval, reasoning, and explanation over normative text.

[28] Evaluating LLMs on Conversational Text-to-SQL under Chain Ambiguity and Intent Drift cs.CL | cs.AI | cs.DBPDF

Yujia Liu, Jiayan Lin, Zijin Hong, Zheng Yuan, Shengyuan Chen

TL;DR: 本文提出了TIDE-Bench，一个专门用于评估大型语言模型在对话式文本转SQL任务中处理链式歧义和意图漂移能力的基准测试。该基准基于BIRD数据集构建，包含1,542个样本，并引入了超越执行准确率的链式识别和漂移识别-解决专用指标。通过对12个先进LLM的评估，揭示了模型在链式识别上的瓶颈、意图漂移处理上的巨大差距以及联合失效模式的重叠问题。

Details

Motivation: 现有对话式文本转SQL基准主要评估执行准确率，未能充分覆盖多轮对话中用户意图的展开和漂移过程。论文旨在解决这一评估缺口，重点关注两种常见模式：链式歧义（指不明确的问题触发具有条件依赖关系的分层澄清）和意图漂移（指用户撤回并替换先前已确认的请求元素）。

Result: 在TIDE-Bench上评估了12个先进LLM，结果显示：链式识别存在持续瓶颈且不受澄清频率影响；意图漂移的识别与解决存在巨大差距；当链式歧义和意图漂移同时激活时，失败模式存在重叠。

Insight: 创新点在于构建了首个专门针对对话式文本转SQL中链式歧义和意图漂移的评估基准TIDE-Bench，并设计了相应的专用评估指标。这为深入理解LLM在复杂、动态多轮对话场景下的能力边界提供了系统化的评估框架，揭示了当前模型在理解对话逻辑流和意图动态变化方面的核心弱点。

Abstract: Recent advances in large language models (LLMs) have established conversational text-to-SQL as a practical interface between users and databases, often involving multiple turns of clarification and revision. However, existing benchmarks primarily evaluate execution accuracy, leaving the unfolding and shifting of user intent across turns largely uncovered. To address this, we introduce TIDE-Bench, a benchmark for conversational text-to-SQL under chain ambiguity and intent drift evaluation, targeting two recurring patterns: chain ambiguity, where an underspecified question triggers layered clarification with conditional dependencies, and intent drift, where the user retracts and replaces a previously committed request element. Built on 514 anchor SQLs from BIRD, TIDE-Bench comprises 1,542 samples and introduces dedicated metrics for chain identification and drift recognition-resolution beyond execution accuracy. Evaluating 12 advanced LLMs reveals a persistent chain identification bottleneck unaffected by clarification frequency, a wide drift recognition-resolution gap, and overlap between failure modes when jointly activated. The corresponding code of TIDE-Bench is released for further research.

[29] Which one is banana man? Evaluating vision-language models in multi-turn pragmatic interpretation cs.CLPDF

Alvin Wei Ming Tan, Ben Prystawski, Veronica Boyce

TL;DR: 本文评估了视觉语言模型在多轮迭代指称游戏中的语用推理能力，发现尽管模型能利用先验上下文理解人类指称表达，但难以有效构建相关上下文以实现高效语言协作。

Details

Motivation: 研究旨在测试视觉语言模型在多轮语言环境中进行上下文敏感语用推理的能力，以评估其是否具备人类对话中灵活适应上下文和共享语用直觉的核心技能。

Result: 在迭代指称游戏中，人类表现稳定且优秀，而所评估的模型（未具体命名）在利用上下文解释指称表达方面存在困难，未能达到人类水平。

Insight: 论文揭示了当前视觉语言模型在构建和利用多轮对话上下文方面的局限性，强调了高效语言协作所需的核心语用推理能力是模型亟待改进的方向。

Abstract: Flexible adaptation to context and shared pragmatic intuitions contribute to smooth human conversation. Iterated reference games—in which players repeatedly pick out novel referents using language—present a test case for agents’ ability to perform context-sensitive pragmatic reasoning in multi-turn linguistic environments. We tested humans and vision–language models on their ability to identify the intended meaning of descriptions produced in iterated reference games, varying the provided context in terms of amount, order, and relevance. While humans performed well consistently, the models we evaluated could make use of prior context to interpret humans’ referring expressions, but they struggled to build up the relevant context to interpret those expressions effectively. Our results suggest that the models we evaluated lack core skills needed for efficient linguistic collaboration.

[30] SUP-MIMIC: A Multi-Task Clinical Diagnosis Benchmark for Evaluating LLMs’ Robustness to Contradictory Evidence cs.CL | cs.AIPDF

Yi Yu, Bo Wang, Chong Feng, Ge Shi, Xia Liu

TL;DR: 该论文提出了SUP-MIMIC基准，一个基于MIMIC-IV-v3.1数据集的多任务临床诊断评估框架，旨在评估大语言模型在面临矛盾证据时的临床推理鲁棒性。该基准包含基础评估、诊断分歧任务和诊断收敛任务，以测试模型处理‘一对多’和‘多对一’复杂诊断映射的能力。评估发现，当前最先进的LLMs在这些任务上性能显著下降，暴露了其对统计捷径的依赖而非真正的因果推理，并存在导致漏诊风险的保守偏见。

Details

Motivation: 现有评估主要关注事实性知识检索，忽略了临床指标与诊断之间复杂、非双射映射的根本挑战，未能评估LLMs在诊断模糊性和收敛性场景中所需的真实推理能力。

Result: 在SUP-MIMIC基准上对SOTA LLMs的综合评估显示，与基线任务相比，模型在诊断分歧任务和诊断收敛任务上性能大幅下降，揭示了其系统性依赖统计捷径而非真正因果推理的问题。

Insight: 创新点在于提出了一个专门评估临床推理鲁棒性的多任务基准，通过诊断分歧任务和诊断收敛任务量化模型处理‘一对多’和‘多对一’诊断模式的能力，为增强语言模型在临床医学中的安全性提供了方法论和路线图。

Abstract: Current evaluations of large language models (LLMs) primarily focus on factual knowledge retrieval, overlooking the fundamental challenge of navigating the complex, non-bijective mappings between clinical indicators and diagnoses. Existing benchmarks fail to assess whether large language models truly possess the reasoning capability required for diagnostic ambiguity scenarios, where identical clinical presentations may correspond to different etiologies, and diagnostic convergence scenarios, where heterogeneous symptoms ultimately indicate the same disease. To address this issue, we propose SUP-MIMIC, a multi-task framework utilizing MIMIC-IV-v3.1 that comprises Basic Assessment (BA), Diagnostic Divergence Task (DDT), and Diagnostic Convergence Task (DCT). Specifically, DDT is designed to evaluate the model’s “one-to-many” disambiguation capability among phenotypically similar cases, while DCT assesses the model’s ability to identify “many-to-one” diagnostic patterns across different pathophysiological pathways. Comprehensive evaluation of state-of-the-art LLMs reveals substantial performance degradation on DDT and DCT compared to baseline tasks, exposing a systemic reliance on statistical shortcuts over genuine causal reasoning. Our findings further highlight a conservative bias toward “healthy” predictions, implying non-trivial risks for missed diagnoses in realistic medical settings. This work establishes a rigorous methodology for quantifying clinical reasoning robustness and provides a roadmap for enhancing the safety of language models in clinical medicine.

[31] Beyond Surface Alignment: Grounding the Dynamics of Situational Understanding and Generative Control in LLMs cs.CLPDF

Chenghao Yang

TL;DR: 本文提出了一种名为’Grounded Alignment’的新框架，旨在超越当前大语言模型（LLMs）仅关注流畅性、安全性和语气一致性的表面对齐范式。论文通过评估模型在情境理解和生成控制方面的失败案例，揭示了表面自信但情境脆弱的模型本质，并提出了动态控制方法以实现更扎实的交互。

Details

Motivation: 当前LLMs的对齐调优范式过于注重表面行为，导致模型虽然风格自信，但在动态变化的情境中缺乏扎实的理解和生成基础，容易变得脆弱。论文旨在解决这种表面化对齐所掩盖的模型缺乏’根基’的问题。

Result: 通过SitTest评估发现，即使拥有大上下文窗口，最先进的模型也难以维持对变化环境的一致’心智模型’。ReCode测试表明模型依赖表面启发式而非深层句法依赖。引入的分支因子（BF）分析显示标准对齐调优会限制生成空间，导致过早的风格坍缩。

Insight: 核心创新在于提出了’Grounded Alignment’框架，将模型的对齐从表面行为深化到对输入情境的理解和输出生成的控制这两个’根基’上。具体技术贡献包括用于评估情境扎根性的SitTest和ReCode，用于分析生成扎根性的分支因子（BF），以及用于实现动态控制的上下文工程、基础-对齐模型协作和退火采样等方法。

Abstract: The current alignment tuning paradigm for Large Language Models (LLMs) prioritizes surface-level behaviors – fluency, safety, and tonal consistency. While effective for casual chat, this thesis argues that such surface alignment masks a lack of grounding, creating models that are stylistically confident but situationally brittle. We propose a framework of Grounded Alignment, analyzing how models process context (Input) and structure generation (Output), then aligning these grounded behaviors to human needs. First, we evaluate failures in Situational Grounding. SitTest shows that despite large context windows, state-of-the-art models struggle to maintain a consistent “mental model” of a changing environment. ReCode further shows that models rely on surface heuristics rather than deep syntactic dependencies: they “read” extensive histories without truly “understanding” the evolving situation. Second, we evaluate Generative Grounding. We introduce the Branching Factor (BF) to map LLM generation, finding that standard alignment tuning constricts this landscape into premature stylistic collapse. Hindsight further shows that models often fail to understand their own generations. Finally, we propose Dynamic Control for grounded interaction. AI Realtor demonstrates context engineering to compensate for poor situational grounding. Base-Aligned Model Collaboration decouples exploration from stylistic constraints. We also present Annealed Sampling for verifiable reinforcement learning and apply these ideas to Addiction Support, where model-generated rationalization offers a communication interface for high-stakes domains. Collectively, this work moves beyond surface alignment toward agents anchored in both context and generation.

[32] JPO: Juris Policy Optimization for Structured Legal Reasoning in Criminal Judgment Prediction cs.CLPDF

Zhaolu Kang, Yantao Liu, Tailong Luo, Leqi Zheng, Lei Wei

TL;DR: 本文提出了一种名为JPO（Juris Policy Optimization）的后训练框架，用于提升中文刑事判决预测中的结构化法律推理能力。该框架首先利用教师生成的推理过程监督一个标准化的四步推理流程，然后通过结合法律预测质量、推理结构完整性和跨步骤一致性的复合奖励进行强化学习。实验表明，JPO在多个开源语言模型和三个中文法律基准测试上，相比监督微调和强化学习基线，能持续提升判决预测和推理质量。

Details

Motivation: 刑事判决预测需要模型从案件事实推断法条、罪名和量刑结果，这是一个涉及法条匹配、罪名论证和量刑一致性的结构化推理过程。现有方法主要优化最终标签，其推理质量评估往往是间接的，依赖于反映模型内部偏好的LLM生成标准，而非法律裁决固有的逻辑结构。

Result: 在多个开源语言模型和三个中文法律基准测试上的实验表明，JPO在判决预测和推理质量上均持续优于监督微调（SFT）和强化学习（RL）基线方法。

Insight: 论文的创新点在于提出了一个专门针对结构化法律推理的后训练框架JPO，其核心是结合了教师监督的标准化推理流程和基于复合奖励（法律预测、结构完整性、跨步一致性）的强化学习。此外，针对法律关键推理片段引入了令牌级优势重加权和自适应裁剪技术，以更好地捕捉法律逻辑的显著性。

Abstract: Criminal judgment prediction requires models to infer statutory articles, charges, and sentencing outcomes from case facts. Unlike standard classification tasks, it involves a structured reasoning process in which statutes should be matched with facts, charges should be justified by statutes, and sentencing outcomes should remain consistent with charges. Existing approaches optimize final labels, and while some have attempted to evaluate reasoning quality, their evaluations are indirect, often relying on LLM-generated rubrics that reflect model-internal preferences rather than the inherent logical structure of legal adjudication. We propose Juris Policy Optimization (JPO), a post-training framework for structured legal reasoning in Chinese criminal judgment prediction. JPO first uses teacher-generated rationales to supervise a standardized four-step reasoning process, and then applies reinforcement learning with a composite reward over legal prediction quality, reasoning structure completeness, and cross-step consistency. JPO further introduces token-level advantage reweighting and adaptive clipping for legally salient reasoning segments. Experiments on multiple open-source language models and three Chinese legal benchmarks show that JPO consistently improves both judgment prediction and reasoning quality over supervised fine-tuning and reinforcement learning baselines.

[33] Memory-First Fact-Checking: A Knowledge-Graph-Grounded Multi-Agent System for Misinformation Detection cs.CL | cs.AIPDF

Amelia Petrenciuc, Alexandru Lecu, Adrian Groza

TL;DR: 本文提出了一种名为’Memory-First Fact-Checking’的混合事实核查框架，用于可解释的虚假信息检测。该框架采用’记忆优先、网络回退’的架构，首先利用基于知识图谱的语义记忆进行判断，若证据不足则调用多智能体系统从可信网络源获取信息并进行对抗性推理。实验表明，该方法在COVID-19虚假信息基准上取得了优于大语言模型基线的性能。

Details

Motivation: 为了解决虚假信息检测中存在的可解释性不足、过度依赖外部网络查询以及缺乏持续学习能力的问题，旨在构建一个结合结构化知识存储与动态推理的自动化系统。

Result: 在精心构建的COVID-19虚假信息基准测试中，该方法在已解决的声明上达到了97.4%的准确率和92.6%的宏平均F1分数，显著优于准确率为87.7%、宏平均F1分数为86.3%的Llama 3.3 70B基线模型，实现了SOTA性能。

Insight: 创新点在于提出了’记忆优先、网络回退’的架构和基于知识图谱的语义记忆，通过图感知置信度机制智能控制查询开销，并设计了支持、反驳和裁决智能体组成的对抗性法庭进行可解释推理，同时系统能将验证后的信息结构化并入知识图谱以实现增量学习。

Abstract: This paper introduces a hybrid fact-checking framework that integrates Knowledge Graph-based semantic memory with adversarial multi-agent reasoning for explainable misinformation detection. The proposed system follows a memory-first, web-fallback architecture, in which input claims are initially evaluated against a dual-index Knowledge Graph through Sentence-BERT-based semantic retrieval and Natural Language Inference. When the evidence retrieved from the graph is insufficient to support a reliable decision, the framework collects information from trusted web sources and assesses it using an adversarial tribunal composed of support, contradiction, and judging agents. A graph-aware confidence mechanism combines semantic similarity, NLI confidence, and structural graph evidence to determine whether internal knowledge is sufficient, thereby reducing unnecessary web retrieval. Following verification, validated information is transformed into structured triples and incorporated into the Knowledge Graph, supporting the incremental expansion of the system’s semantic memory. Experimental evaluation on a curated COVID-19 misinformation benchmark demonstrates that the proposed framework achieves an accuracy of 97.4% and a macro-averaged F1-score of 92.6% on resolved claims, outperforming a Llama~~3.3~~70B baseline, which obtains an accuracy of 87.7% and a macro-averaged F1-score of 86.3%.

[34] MI-Distillation: Selecting from Model-Interpolated Instruct-Reasoning Data Spectrum for Chain-of-Thought Distillation cs.CL | cs.AIPDF

Yangsong Lan, Renkai Hu, HongKai Zheng, Bo Zhang, Renzhi Wang

TL;DR: 本文提出了一种名为MI-Distillation的框架，用于改进将大型推理模型的长思维链知识蒸馏到小型学生模型中的过程。该框架通过模型插值构建连续的指令推理数据谱，并引入SeqLSS评分机制从中选择信息丰富且易于学生模型学习的推理路径。

Details

Motivation: 直接使用长思维链监督进行知识蒸馏效果有限，甚至可能不如简洁的短思维链。本文旨在从梯度角度探究此现象，并寻找平衡推理信息密度与学生模型分布对齐的方法，以提升蒸馏效率。

Result: 在多个推理基准测试上的广泛实验表明，MI-Distillation方法相比强大的长思维链基线，能持续提升小型模型在思维链蒸馏上的性能。

Insight: 核心创新点在于从梯度视角分析长/短思维链对蒸馏的影响，并据此提出通过模型插值构建数据谱和可学习的序列化惊奇分数来选择最优蒸馏数据，这为知识蒸馏中的数据选择提供了新思路。

Abstract: Recent advances in large reasoning models (LRMs) have shown strong performance on complex problems through long chain-of-thought (Long CoT) reasoning. However, distilling such trajectories into smaller student models remains challenging: direct Long CoT supervision often provides limited gains and can be less effective than concise Short CoT rationales. In this work, we investigate this phenomenon from a gradient-centric perspective. Our analysis shows that Long CoT induces larger gradient magnitudes and more concentrated update directions than Short CoT, with this effect becoming more pronounced as student model capacity increases. These findings suggest that effective Long CoT distillation requires balancing the reasoning information density of reasoning trajectories with their distributional alignment to the student model. Motivated by this insight, we propose \textbf{M}odel \textbf{I}nterporlation \textbf{Distillation} (\textbf{MI-Distillation}), a framework that constructs a continuous Instruct-Reasoning data spectrum through model interpolation. To select suitable trajectories from this spectrum, we further introduce \textbf{Seq}uential \textbf{L}earnable \textbf{S}urprisal \textbf{S}core (\textbf{SeqLSS}), which favors reasoning paths that are both informative and learnable for the student. Extensive experiments on reasoning benchmarks show that MI-Distillation consistently improves small model CoT distillation over strong Long CoT baselines.

[35] ACTD: Anchor-Based Cross-Tokenizer Distillation with Residual Regularization cs.CLPDF

Huiyi Zhang, Zijian Li, Xiaocheng Feng, Weitao Ma, Xiaoliang Yang

TL;DR: 本文提出了一种名为ACTD的锚点式跨分词器蒸馏方法，通过词汇和序列对齐解决跨模型族知识蒸馏中的结构异质性问题，并引入锚点损失和残差正则化来减轻对齐噪声。该方法在五个推理基准测试中取得了SOTA性能，其多教师扩展版本也优于最强的单教师和多教师基线。

Details

Motivation: 跨分词器蒸馏面临词汇和序列不对齐的挑战，而近似的词汇对齐会引入额外噪声，因此需要一种方法来有效解决结构异质性问题并减少对齐噪声。

Result: 在三个不同教师模型和五个推理基准测试上的评估表明，ACTD实现了最先进的性能，其多教师扩展版本也超越了最强的单教师和多教师基线。

Insight: 创新点在于通过词汇与序列对齐桥接结构异质性，并设计锚点损失与残差正则化来缓解对齐噪声；客观来看，该方法将跨分词器蒸馏框架扩展到多教师场景，增强了方法的鲁棒性和泛化能力。

Abstract: Knowledge distillation effectively transfers reasoning capabilities from large language models to lightweight student models. To enable knowledge transfer across disparate model families, researchers increasingly explore cross-tokenizer distillation. However, cross-tokenizer distillation remains challenging due to vocabulary and sequence misalignment, while approximate vocabulary alignment can introduce additional noise into distillation. To address these challenges, we propose Anchor-Based Cross-Tokenizer Distillation with Residual Regularization (ACTD). ACTD bridges structural heterogeneity through vocabulary and sequence alignment, while mitigating alignment noise via a novel anchor loss with residual regularization. We further extend this framework to a multi-teacher setting. Evaluated across five reasoning benchmarks with three distinct teacher models, ACTD achieves state-of-the-art performance. Moreover, its multi-teacher extension outperforms the strongest single-teacher and multi-teacher baselines, further demonstrating the robustness of our method.

[36] ReTrace: Rejected-Trajectory Conditioning for Speculative Decoding cs.CLPDF

Luxi Lin, Zhanpeng Zeng, Shuang Peng, Songwei Liu, Rongrong Ji

TL;DR: 本文提出了ReTrace方法，用于改进推测解码中的草稿模型效率。该方法通过保留并利用上一轮被拒绝的草稿后缀信息，将其作为条件输入到下一轮草稿生成中，从而减少计算浪费并提高平均接受长度和解码速度。

Details

Motivation: 标准推测解码在首次拒绝后丢弃剩余草稿后缀，导致生成和验证这些位置的计算浪费。研究发现被拒绝的后缀可能仍包含有用的语义和结构信息，因此旨在利用这些信息提升效率。

Result: 在数学推理、代码生成和开放对话任务上使用Qwen3模型进行实验，ReTrace相比其DFlash骨干网络，一致地提高了平均接受长度和端到端解码速度。

Insight: 创新点在于受条件扩散启发，引入了跨轮次的条件机制，将被拒绝的后缀隐藏表示通过门控残差融合纳入草稿器输入，无需额外前向传递即可保留推测解码的无损特性，且与现有草稿改进方法正交。

Abstract: Speculative decoding accelerates autoregressive language model inference by having a lightweight draft model propose multiple candidate tokens, which are then verified in parallel by a larger target model. However, after the first rejection, standard prefix-based verification discards the remaining draft suffix, so the computation spent generating and verifying those positions does not contribute to decoding progress. Focusing on DFlash, we show that rejected positions in a rejected suffix may still align with the target continuation, indicating that the draft model can retain useful semantic and structural information despite local token-level errors. Motivated by this observation and inspired by conditional diffusion, we introduce~\textbf{ReTrace}, a rejected-trajectory conditioning method that conditions each draft block on the rejected suffix from the previous round rather than generating it from fresh mask placeholders alone. ReTrace retains the hidden representations of the rejected suffixes, aligns them with the next draft block, refines them using target-aware correction signals from the same verification pass, and admits them into the drafter’s input embeddings through gated residual fusion. Because rejected tokens are never committed and target-side verification remains unchanged, ReTrace preserves the lossless property of speculative decoding without requiring an additional model forward pass. Experiments with Qwen3 models across mathematical reasoning, code generation, and open-ended dialogue demonstrate that ReTrace consistently improves average acceptance length and end-to-end decoding speed over its DFlash backbone. By introducing cross-round conditioning without modifying within-round proposal generation, ReTrace is largely orthogonal to existing drafting improvements and might be combined with them for further gains.

[37] DVBench: Benchmarking MLLMs for Understanding Dynamic Charts and Narratives in Data Videos cs.CLPDF

Bomiao Wang, Zekai Shao, Jiexiang Lan, Xiaoliang Fu, Xingchen Zeng

TL;DR: 本文提出了DVBench基准测试，用于评估多模态大语言模型在理解数据视频（结合动态图表与结构化叙事）方面的能力。该基准包含300个真实世界数据视频和1000个人工验证的问答对，涵盖五个理解维度。实验评估了九个MLLM，发现Gemini-3.1-Pro整体表现最佳，而Kimi-k2.5是最强的开源模型，并揭示了开源模型性能不严格随参数规模增长、叙事能力不保证视觉能力等现象。

Details

Motivation: 当前MLLM评估主要孤立地测试图表理解和视频理解能力，缺乏对时序演化结构化视觉信息（如数据视频）的综合评估，因此需要构建专门基准来填补这一空白。

Result: 在DVBench基准上，Gemini-3.1-Pro取得最佳整体性能，Kimi-k2.5为最强开源模型；细粒度分析和消融研究揭示了模型在特定维度的弱点以及帧配置和字幕输入的影响。

Insight: 创新点在于首次构建了针对数据视频理解的综合基准，将动态图表与叙事理解分解为五个维度；客观来看，该工作揭示了MLLM能力评估中模型规模与性能的非线性关系以及模态能力解耦现象，为未来模型开发提供了重要指导。

Abstract: While MLLMs have made significant strides in chart comprehension and video understanding, current evaluations largely isolate these capabilities, leaving a critical gap in understanding temporally evolving structured visual information. To address this gap, we introduce DVBench, a benchmark for evaluating MLLMs on data videos, a storytelling medium that integrates dynamic charts with structured narratives. We decompose data video understanding into five dimensions. DVBench comprises 300 real-world data videos and 1,000 human-verified QA pairs curated through a rigorous semi-automated pipeline. Extensive evaluations of nine MLLMs show that Gemini-3.1-Pro achieves the best overall performance, while Kimi-k2.5 is the strongest open-source model. We further identify two notable phenomena: open-source model performance does not scale strictly with parameter size, and narrative proficiency does not guarantee visual capability. Fine-grained analyses and ablation studies further reveal dimension-specific weaknesses and the effects of frame configurations and subtitle inputs, informing future MLLM development. DVBench is publicly available at https://bomiaowang.github.io/DVBench/.

[38] A^2Agent: Action-Aware Reinforcement Learning for Repository-Level Code Localization Agents cs.CL | cs.SEPDF

Doyeon Kim, Suyoung Bae, Yumin Lee, Jee-Hyong Lee

TL;DR: 本文提出了一种名为A^2Agent的、基于动作感知强化学习的方法，用于自动化软件工程中的仓库级代码定位任务。该方法通过结合每轮奖励序列和动作级优势估计方案，解决了现有方法因依赖稀疏轨迹级信号而无法识别有效动作、以及在探索中发现正确代码区域但未能提交的问题。

Details

Motivation: 现有代码定位方法依赖稀疏的轨迹级信号，无法有效识别每轮动作的贡献，且经常在探索中发现正确代码区域后却未能提交，这限制了其性能。本文旨在解决这些局限性，提升代码定位的准确性和可靠性。

Result: 在SWE-Bench Verified和SWE-Bench Pro基准测试上，该方法将平均F1分数分别比当前最优方法（SOTA）提高了1.58%和8.55%。其4B参数的模型性能优于参数规模大8倍的基线模型。

Insight: 创新点在于引入了动作感知的强化学习框架，具体包括奖励发现和提交黄金代码区域的每轮奖励序列，以及通过分组共享相同探索上下文的轮次来隔离每个动作贡献的动作级优势估计方案。这为强化学习在代码定位等需要细粒度动作评估的任务中提供了新的思路。

Abstract: Localizing issue-relevant code regions is a critical step in automated software engineering. However, due to their reliance on sparse trajectory-level signals, existing methods cannot identify which per-turn actions are effective and often discover correct code regions during exploration but fail to commit them. To address these limitations, we propose an action-aware reinforcement learning method that combines a per-turn reward sequence rewarding both the discovery and commitment of gold code regions with an action-level advantage estimation scheme that isolates each action’s credit by grouping turns sharing the same exploration context. Extensive evaluations show that our method improves the average F1 over the state-of-the-art (SOTA) by 1.58% on SWE-Bench Verified and 8.55% on SWE-Bench Pro, with our 4B model outperforming baselines up to 8x larger. Our code is available at https://github.com/donian00/A2Agent.

[39] EVAR: Evidence-Validated Hypothesis Admission for Budget-Aware Narrative Reasoning cs.CLPDF

Peilin Liu, Zhiquan Ji, Jinglong Ping

TL;DR: 本文提出EVAR框架，用于解决大语言模型在长文本叙事推理中生成缺乏证据支持的结论的问题。该框架通过构建证据库、设定推理预算、验证候选假设并基于充分性停止机制，提升推理的准确性和证据可靠性。

Details

Motivation: 针对LLMs在非交互式长文本推理中容易产生缺乏证据支持的中间假设，并污染后续推理的问题，尤其是在证据分散在故事不同部分时。

Result: 在NarraCrime和多个公开推理基准测试上的实验表明，EVAR在提升任务性能（task performance）和证据忠实度（evidence faithfulness）的同时，保持了可控的推理成本（inference cost）。

Insight: 创新点在于提出了一个证据验证的假设准入框架，通过将叙事编译为不可变的、来源链接的原子证据库，并设计假设条件验证挑战，在预算约束下系统性地验证和筛选假设，避免了无证据支持的推理污染。

Abstract: Large language models (LLMs) often produce fluent but weakly grounded conclusions when reasoning over non-interactive, long-form narratives. A central failure mode is that unsupported intermediate hypotheses can enter the reasoning trajectory and contaminate subsequent inference, especially when evidence is scattered across distant parts of the story. To address this problem, we propose EVAR, an evidence-validated hypothesis admission framework for budget-aware narrative reasoning. EVAR first compiles the narrative into an immutable evidence store of source-linked atomic claims and assigns an instance-specific inference budget from unresolved gaps and uncertainty signals. During refinement, EVAR directly proposes candidate hypotheses for unresolved gaps, constructs hypothesis-conditioned validation challenges, and verifies each candidate against the locked store before admission: supported hypotheses enter the answer-supporting state, unverifiable ones are quarantined, and contradictory ones are discarded. A sufficiency-based stopping mechanism further avoids unnecessary refinement. Experiments on NarraCrime and multiple public reasoning benchmarks show that EVAR improves both task performance and evidence faithfulness while maintaining controllable inference cost.

[40] SkillForge: Compositional Skill Synthesis with Verification-in-the-Loop for Generating Formally Verified Dafny Programs cs.CL | cs.PLPDF

Yanming Liu, Xinyue Peng, Jiannan Cao, Xinyi Wang, Jinbo Su

TL;DR: SKILLFORGE是一个用于生成形式化验证Dafny程序的框架，它将代码合成过程分解为原子化、可复用的技能库，并通过一个验证驱动的协调机制来诊断验证失败并选择相应修复技能进行迭代，直至程序被形式化证明正确或预算耗尽。

Details

Motivation: 解决从自然语言生成形式化验证程序时，现有方法要么在验证失败时无法有效处理，要么依赖非确定性和不透明的开放式智能体推理的问题。

Result: 在自然语言到Dafny规范的基准测试中，SKILLFORGE显著优于最先进的智能体方法（如ReAct风格智能体、基于MCTS的修复和RL引导的验证）和传统迭代基线，同时需要更少的token和更低的延迟。消融研究证实每个技能都有可测量的贡献，且协调机制能快速收敛，多数程序在首次尝试时即通过验证。

Insight: 创新点在于将形式化代码合成分解为模块化技能库，并设计了一个基于验证反馈的确定性协调机制，实现了透明、高效的迭代修复过程，而非依赖黑盒的智能体推理。

Abstract: Generating formally verified programs from natural language remains challenging: existing approaches either produce code in a single pass without recourse when verification fails, or rely on open-ended agentic reasoning that is non-deterministic and opaque. We introduce SKILLFORGE, a framework that decomposes formal code synthesis into a library of atomic, reusable skills, each targeting a specific subtask such as specification inference, body synthesis, invariant generation, error diagnosis, or targeted repair, and defined by a prompt template, tool binding, and decidable success criterion. A verification-driven harness orchestrates these skills: it submits candidates to the Dafny verifier, diagnoses failures into structured categories, deterministically routes to the appropriate repair skill, and iterates until formal correctness is proved or a budget is exhausted. On a curated benchmark of natural language to Dafny specification pairs, SKILLFORGE substantially outperforms both state-of-the-art agentic approaches (including ReAct-style agents, MCTS-based repair, and RL-guided verification) and traditional iterative baselines, while requiring fewer tokens and lower latency. Ablation studies confirm that every skill contributes measurably, and the harness converges rapidly with the majority of programs verified on the first attempt.

[41] Influence-Directed Distillation: Solving the Diversity Bottleneck in Sampled-Token On-Policy Distillation cs.CL | cs.LGPDF

Run Yang, Runpeng Dai, Jie Sun, Jielei Zhang, Fan Zhou

TL;DR: 本文针对采样令牌在线策略蒸馏（OPD）中存在的多样性蒸馏失败问题，提出了一种名为影响导向自适应在线策略蒸馏（IDA-OPD）的新方法。该方法通过引入一阶局部熵影响指标，识别并保留熵扩展更新，同时用散度自适应优势收缩替换熵收缩更新，从而在仅使用教师模型采样令牌对数概率的情况下，有效提升学生模型在pass@k指标上的表现，继承教师的多样性。

Details

Motivation: 动机是解决采样令牌在线策略蒸馏（OPD）中常见的多样性蒸馏失败问题，即学生模型的pass@1提升但pass@k停滞，无法有效继承教师模型的输出多样性。

Result: 在面向推理的蒸馏实验中，IDA-OPD一致性地改善了pass@k，通过蒸馏继承了教师的多样性，在严格更低的成本下匹配了最强的教师信息方法，并基本保持了原始OPD的pass@1性能，且无需全词汇表的教师信息。

Insight: 创新点在于提出了一阶局部熵影响作为理论分析工具，揭示了熵收缩与负影响位置之间的经验联系，并据此设计了IDA-OPD，这是一种仅依赖采样令牌信息的高效自适应蒸馏策略，有效解决了多样性瓶颈。

Abstract: Sampled-token on-policy distillation (OPD) efficiently transfers capabilities from teacher to student using student-generated tokens, requiring teacher probabilities only for sampled tokens. Yet it frequently suffers from diversity distillation failure: the student’s pass@1 improves while its pass@$k$ plateaus, failing to inherit the teacher’s diversity. To explain this, we introduce First-Order Local Entropy Influence, a signed first-order proxy that decouples each update’s entropy effect into the teacher–student log-probability gap and the student’s local probability structure, and empirically links entropy contraction to negative-influence positions. Motivated by this, we propose Influence-Directed Adaptive On-Policy Distillation (IDA-OPD): rather than relying on costly full-vocabulary Forward-KL objectives, it preserves entropy-expanding updates while replacing entropy-contracting ones with divergence-adaptive advantage shrinkage, using only the teacher’s sampled-token log-probability. Experiments on reasoning-oriented distillation show IDA-OPD consistently improves pass@$k$, inheriting the teacher’s diversity through distillation, matches the strongest teacher-informed methods at strictly lower cost, and broadly maintains vanilla OPD’s pass@1, all without full-vocabulary teacher information.

[42] Improving Argument Saliency Coverage in Small LLMs for Long Legal Opinion Summarization via Sequence-Level Distillation cs.CLPDF

Mohamed Elaraby, Ahmed Elhady, Diane Litman

TL;DR: 本文提出了一种通过序列级蒸馏来提升小型LLM在长法律意见摘要任务中论点显著性覆盖的方法。该方法利用一个强大的长上下文教师模型，无需人工标注且数据高效，能有效改善小型LLM在保留关键论证内容上的不足。实验表明，仅需约10个训练摘要即可实现大部分性能提升。

Details

Motivation: 解决小型LLM在长法律意见摘要任务中难以保留最显著论证内容的问题，旨在通过一种简单、无需标注且数据高效的方法来提升论点显著性覆盖。

Result: 在法律意见摘要设置中，蒸馏方法在不同规模的学生模型上均持续优于基于专家撰写摘要的微调；仅需约10个训练摘要即可获得大部分性能增益，显示了教师生成监督的强数据效率。

Insight: 创新点在于使用序列级蒸馏从长上下文教师模型转移知识，以无标注方式提升小型LLM的论证覆盖；客观分析表明该方法数据效率极高，且仅摘要蒸馏已足够，推理链蒸馏虽具竞争力但结合时增益有限。

Abstract: We show that sequence-level distillation from a capable long-context teacher model is a simple, annotation-free, and data-efficient strategy for improving argument saliency coverage in long legal opinion summarization, where small LLMs often struggle to retain the most salient argumentative content. Across student model sizes, distillation consistently surpasses tuning on expert-written summaries in our legal-opinion setting. We further demonstrate that most gains are achieved with as few as ~10 training summaries, highlighting the strong data efficiency of teacher-generated supervision. Finally, we find that summary distillation is sufficient for improvements: reasoning-chain distillation remains competitive with summary-only distillation, but provides marginal benefit when combined with summary supervision.

[43] GenRubric: Self-Evolving Rubric Generation for Scalable LLM Evaluation cs.CLPDF

Yifan Chen, Haitao Li, Qingyao Ai, Fengbin Zhu, Tat-Seng Chua

TL;DR: 本文提出了GenRubric，一种自演进的评估准则生成框架，旨在为开放式任务提供可扩展的LLM评估。该方法通过强化学习，利用准则诱导的自一致性原理，从未标注的查询中自动生成并改进评估准则，无需额外人工标注。实验表明，自演进过程提升了生成准则与专家撰写准则在评估上的一致性，并能泛化到未见领域。

Details

Motivation: 当前许多LLM评估器在评分时依赖查询特定的标准，导致评估要求不够明确且难以审核。专家撰写评估准则成本高昂，而现有自动方法通常依赖推理时优化或外部监督，因此需要一种无需人工标注、可自我改进的自动准则生成方法。

Result: 在人工标注的评估准则基准测试中，自演进过程提高了生成准则诱导的评估与专家准则诱导的评估之间的一致性。改进效果进一步泛化到保留的领域，证明了该方法在可扩展和查询特定LLM评估方面的潜力。模型在4B、8B和14B规模上进行了训练。

Insight: 创新点在于提出了’准则诱导的自一致性’原则：同一查询独立采样的准则提供了其潜在评估要求的部分视图，一个全面的准则应能诱导出跨越这些互补评估视图的响应。通过强化学习结合跨准则全面性信号以及组级和准则级奖励来实现这一原则，实现了无需人工标注的自演进框架。

Abstract: Large language models are increasingly used as scalable evaluators for open-ended tasks. However, many LLM judges derive query-specific criteria during scoring, leaving the evaluation requirements insufficiently specified and their coverage difficult to audit. Query-specific rubrics make these requirements explicit, but expert-written rubrics are costly to construct, while existing automatic methods typically rely on inference-time refinement or external supervision. We introduce GenRubric, a self-evolving framework that improves rubric generation from unlabeled queries without requiring additional human annotations during self-evolution. Our approach is based on rubric-induced self-consistency: independently sampled rubrics for the same query provide partial views of its latent evaluation requirements, and a comprehensive rubric should induce a response that generalizes across these complementary evaluation views. We implement this principle through reinforcement learning, combining a cross-rubric comprehensiveness signal with group-level and criterion-level rewards for rubric quality. We train GenRubric models at 4B, 8B, and 14B scales across multiple domains. Experiments on human-annotated rubric benchmarks show that self-evolution improves the agreement between evaluations induced by generated rubrics and those induced by expert-written rubrics. The improvements further generalize to held-out domains, demonstrating the potential of self-evolving rubric generation for scalable and query-specific LLM evaluation. Code and models are publicly available at https://github.com/foggpoy/GenRubric.

[44] When History Is Multimodal: Rethinking Context Management for Long-Horizon Agents cs.CLPDF

Jiaqi Su, Cong Pang, Jiawei Hong, Tiankuo Yao, Zixuan Chen

TL;DR: 本文提出了一种基于视觉渲染（VR）的上下文管理器，用于长视野智能体压缩交互历史。通过引入视觉证据保留策略（VERA），在文本中心和多模态基准测试中，该方法显著减少了非缓存令牌数量，并在多模态任务上取得了最高准确率。

Details

Motivation: 解决现有光学内存方法将像素视为文本化历史的密集编解码器时，未公平评估视觉渲染作为上下文管理器的性能，以及未探索其在多模态历史中的原生优势的问题。

Result: 在四个文本中心和三个多模态基准测试中，VERA相比无压缩基线减少了31.5%-63.1%的累积非缓存令牌，在文本中心任务上与现有管理器相当，在多模态任务上达到所有基线中的最高准确率。

Insight: 视觉内存是多模态历史中视觉证据的自然载体，无需训练即可通过确定性渲染实现高效的上下文管理，支持模态保留的视角，避免了将视觉观察翻译为文本的损失。

Abstract: Long-horizon agents need a context manager to compress growing interaction histories into a bounded working context, via passive strategies or active strategies that decide how memory is accessed and reorganized. Meanwhile, prior optical-memory work mainly treats pixels as a dense codec for textualized histories, often presupposing that rendering context into optical memory incurs a significant performance drop relative to text, thus coupling this representation with SFT, self-distillation, or reinforcement learning to close this gap, leaving unresolved (i) how visual rendering performs as a context manager under a fair, controlled comparison, and (ii) whether this carrier offers a native advantage when history is inherently multimodal. In this paper, we formulate context management as a budget-constrained history transformation and introduce Visual Rendering (VR) as a representational context manager. Under a shared harness, policy model, trigger, and task domain, we evaluate VR on four text-centric and three multimodal benchmarks against four baselines (No Compression, Discard-All, Sliding Window, Summarization), finding visual memory is a natural carrier of native visual evidence. Building on this finding, we propose VERA (Visual Evidence-Retaining strategy for long-horizon Agents), a training-free context manager built on deterministic rendering with no exposed memory operations: on text-centric benchmarks it renders textual history as VR does, while on multimodal benchmarks it retains native visual observations instead of translating them into text. Across nearly all benchmarks, VERA cuts cumulative non-cache tokens by 31.5%-63.1% versus No Compression, matches existing managers on text-centric tasks, and achieves the highest accuracy among all baselines on multimodal tasks, supporting a modality-preserving view of long-horizon context management.

[45] REIGN: Refurbished Embeddings with Integrated Guidance Networks for Efficient Context-Length Scaling cs.CL | cs.AI | cs.IRPDF

Devrim Çavuşoğlu, Emre Akbaş

TL;DR: 本文提出了REIGN模型，一种用于长文档高效密集检索的对比训练双编码器。它通过解耦词元级处理和文档级推理，利用冻结的指导网络生成的上下文块嵌入序列进行操作，而非原始词元，从而大幅降低了训练成本。

Details

Motivation: 解决长文档密集检索计算成本高昂的问题，因为传统词元级编码器的计算复杂度随序列长度呈二次方增长，而现有长上下文嵌入模型通常依赖架构变通或大型LLM才能达到32K词元的处理能力。

Result: 在内部构建的维基百科基准、LoCo外部分布测试套件以及真实世界专利检索案例研究中，REIGN在更小的参数量下匹配了密集长上下文检索器的性能；在专利任务上与参数量大1.6-4.3倍的模型表现相当，在LoCo上仅比参数量大20倍的模型低0.65 nDCG@10。

Insight: 创新点在于将词元级处理与文档级推理解耦，并利用冻结的指导网络嵌入进行缓存，使每文档训练成本相对于分块Transformer微调降低了约四个数量级；同时发布了用于长上下文对比训练和评估的合成长文档检索基准。

Abstract: Dense retrieval over long documents is expensive. Token-level encoders scale quadratically in sequence length, and most long-context embedding models reach 32K tokens only through architectural workarounds or by stretching billion-parameter LLMs. We propose REIGN (Refurbished Embeddings with Integrated Guidance Networks), a contrastively trained bi-encoder that operates on sequences of contextualised chunk embeddings from a frozen Guidance Network (GN) rather than on raw tokens. REIGN targets multi-chunk inputs, primarily for document-to-document retrieval; single-chunk inputs stay with the GN. Decoupling token-level processing from document-level reasoning, and caching the GN embeddings to disk, cuts per-document training cost by roughly four orders of magnitude relative to chunked Transformer fine-tuning. We also release a synthetic long-document retrieval benchmark for contrastive training and evaluation at long context lengths. Across an in-distribution Wikipedia benchmark, the LoCo out-of-distribution suite, and a real-world patent retrieval case study, REIGN matches dense long-context retrievers at smaller parameter budgets in each regime. A paired significance test puts it on par with models 1.6-4.3x larger on the patent task, and it stays within 0.65 nDCG@10 of a 20x-larger model on LoCo.

[46] Compression-Aware Abstention: Teaching LLMs to Refuse When KV-Compression Masks Remove Answer Evidence cs.CL | cs.LGPDF

Mohammadali Khodabandehlou, Bhaskar Krishnamachari

TL;DR: 本文提出了一种KV缓存压缩感知的拒绝学习框架，旨在解决LLM在KV缓存压缩导致关键证据被移除时产生幻觉的问题。通过构建基于压缩器生存掩码和答案相关跨度的监督信号，训练一个LoRA适配器使模型学会在证据保留时回答、证据缺失时拒绝。

Details

Motivation: KV缓存压缩通过剔除上下文令牌来减少LLM推理内存，但当被剔除的令牌包含答案证据时，模型可能产生幻觉而非识别压缩后上下文信息不足。本文从行为角度出发，首次将压缩感知拒绝定义为一个学习问题。

Result: 在MuSiQue 2-hop QA数据集上，使用约2.6K样本训练的10.1M参数LoRA适配器，在提示式截断下将基础模型的幻觉减少了97%，同时在证据保留的示例上保持正确回答。在实际压缩缓存解码评估中，多压缩器训练在证据保留示例上相对无辅助基础模型取得了6-22倍的性能提升。

Insight: 创新点在于首次将压缩感知拒绝形式化为学习问题，并利用压缩器生存掩码构建监督信号；训练得到的适配器学习了一种条件策略，而非简单依赖输入长度，其行为由证据内容驱动，避免了仅基于提示的基线方法在可回答高保留示例上的过度拒绝问题。

Abstract: KV-cache compression reduces LLM inference memory by evicting context tokens, but when the evicted tokens contain answer-bearing evidence, the model may hallucinate instead of recognizing that the compressed context is insufficient. We address this failure from a behavioral perspective: to our knowledge, this is the first work to formulate compression-aware abstention as a learning problem, in which a model learns to answer when supporting evidence survives compression and abstain when it does not. We construct supervision from compressor survival masks and tight answer-bearing spans, labeling examples as Confident when evidence survives and Abstain when it is removed. A 10.1M-parameter LoRA adapter trained on ~2.6K MuSiQue 2-hop QA examples reduces base-model hallucinations by 97% under prompt-style truncation while preserving correct answering on evidence-retaining examples. Unlike prompt-only abstention baselines, which over-abstain on many answerable high-retention examples, the trained adapter learns a conditional policy. We also evaluate the method under actual compressed-cache decoding, where multi-compressor training yields a 6-22x relative lift over the unaided base on evidence-retaining examples. Controlled-deletion experiments show that the learned behavior is driven by evidence content rather than input length alone.

[47] Detecting Hidden Chain-of-Thought in Large Language Models with Linguistic, Behavioral, and Mechanistic Indicators cs.CLPDF

Armaan Singh, Ryan Trinh Le, Jasmine Kaur, Abdullah Sultan, Edward Lue Chee Lip

TL;DR: 该论文提出了一个名为隐藏思维链检测分数（HCDS）的指标，用于衡量大型语言模型在回答复杂推理问题时，其在中性提示下的行为是否更接近显式思维链（CoT）或无思维链（no-CoT）模式，从而间接探测模型是否存在潜在的、未暴露的推理过程。

Details

Motivation: 动机在于大型语言模型经常不展示中间步骤就回答复杂推理问题，这引发了一个疑问：它们是在进行潜在推理，还是仅仅在完成模式匹配？作者旨在开发一种不依赖模型自我报告推理痕迹的方法来研究这个问题。

Result: 在GSM8K基准测试上，HCDS对Qwen3-4B的两个变体（Thinking和Instruct）均显示出显著的正分数，表明其中性提示行为更接近CoT模式。该结果在不同推理栈和量化设置下具有可复现性，并且在大多数长度调整的校准控制组中不显著。

Insight: 创新点在于提出了HCDS这一结合了行为学和机制性信号的比较性指标，为探测大模型的潜在推理行为提供了一种无需直接观察内部推理痕迹的新方法。研究还发现，经过推理调优的模型展现出更强、更少依赖提示条件的类CoT行为。

Abstract: Large language models often answer complex reasoning questions without revealing intermediate steps, raising whether they reason latently or complete patterns. We propose the Hidden CoT Detection Score (HCDS), a comparative behavioral and mechanistic signal measuring whether neutral-prompt behavior aligns more closely with explicit CoT or explicit no- CoT. Here, hidden CoT operationally denotes this neutral-prompt CoT-like alignment; HCDS does not directly observe or prove an unexposed reasoning trace. On GSM8K, HCDS is significantly positive for both Qwen3-4B variants (Thinking $+1.87$, $p = 1.2 \times 10^{-7}$; Instruct $+1.41$, $p = 1.9 \times 10^{-4}$), replicates across a different inference stack and quantization within $0.08$ ($+1.80$ and $+1.45$), and is not significantly positive in seven of eight length-adjusted calibration-control cells. The unadjusted score produces large positive scores on single-step arithmetic and numeric factual lookup. The variants also respond differently to no-CoT instructions: Instruct complies from the prompt alone, whereas Thinking continues reasoning and requires intervention. These findings show stronger, less prompt-conditional CoT-like behavior in the reasoning-tuned model, consistent with but not proof of latent reasoning. HCDS thus investigates latent reasoning without relying on models’ self-reported traces.

[48] Small Language Models as Judges for Rubric-Based Reinforcement Learning cs.CLPDF

Fengyu Xie, Yilun Zhao, Bingsen Chen, Arman Cohan, Chen Zhao

TL;DR: 该论文研究了使用小型语言模型作为基于评分标准的强化学习中的评估者，以替代昂贵的大型模型。作者构建了两个基于点状评分标准的数据集，并比较了三种从小型模型中提取标准级判断的方法。研究发现，使用Qwen3-1.7B模型的探针评估者在标准级一致性方面表现最佳，作为GRPO奖励模型时，其训练效果优于8B生成式评估者基线，且所需奖励评估时间大幅减少。

Details

Motivation: 基于评分标准的强化学习需要根据实例特定标准对响应进行评分，这通常依赖于昂贵的专有API或大型生成式LLM，导致奖励计算成本高昂。论文旨在探索小型语言模型能否作为高效可靠的基于评分标准的评估者，以降低计算开销。

Result: 在构建的PointRubric和RaR-Science-Static数据集上，Qwen3-1.7B探针评估者在标准级一致性方面优于生成式和Logprob评估者。作为GRPO奖励模型，它将策略在RaR-Science评分标准上的得分从0.232提升到0.643，而8B生成式评估者基线为0.594，且基线需要10.7倍的奖励评估时间。任务和领域迁移实验表明探针评估者能在不同设置中保持标准级奖励结构。

Insight: 论文的创新点在于系统性地评估了小型语言模型作为基于评分标准的评估者的可行性，并提出了探针评估者这一高效方法，在保持性能的同时显著降低了计算成本。这为资源受限环境下的强化学习奖励建模提供了新思路，即通过轻量级模型和特定评估技术实现可扩展的奖励信号生成。

Abstract: Rubric-based reinforcement learning extends RL beyond tasks with exact answers or rule-based verifiers by scoring responses against instance-specific criteria. However, this makes reward computation expensive: training requires repeated rubric judging, often with proprietary APIs or local generative LLM judges with 7B parameters or more. We study whether smaller language models can serve as efficient and reliable rubric-based judges. To make this question measurable, we construct PointRubric and RaR-Science-Static, two pointwise rubric-based evaluation datasets with instance-specific criteria and itemwise satisfaction labels. We compare three ways of extracting criterion-level judgments from small models: Generative verdicts, Yes/No Logprob margins, and Probe judges. Across both datasets, the Qwen3-1.7B Probe judge achieves the strongest criterion-level agreement among these methods, outperforming Generative and Logprob judges. Used as a GRPO reward model, it trains a policy from 0.232 to 0.643 on RaR-Science rubric score, compared with 0.594 for an 8B Generative judge baseline, while the baseline requires 10.7$\times$ more reward-judge time. Task and domain transfer experiments further suggest that Probe judges preserve criterion-level reward structure across settings.

[49] Budget-Aware Compression Pipeline for Single-GPU LLM Inference: Methods, Trade-offs, and Coupling Effects cs.CLPDF

Hongyu Yu, Yifei Shen

TL;DR: 本文提出了一种面向单GPU部署的预算感知压缩流水线，用于解决70B参数大语言模型在设备内存、长上下文吞吐量和工程集成成本方面的限制。通过系统研究剪枝、量化和KV缓存压缩在真实执行环境下的交互效应，构建了一个实用压缩流程，将70B模型压缩至约33GB，在单A40 GPU上实现10k令牌提示下约57令牌/秒的推理速度，并在常见基准测试中保持准确率下降在5%以内。

Details

Motivation: 解决70B参数大语言模型在单GPU部署时面临的内存限制、长上下文吞吐量瓶颈和工程集成成本高昂的问题，将单GPU推理建模为在这三个维度上的预算感知设计问题。

Result: 在单A40 GPU上，将70B模型压缩至约33GB，在10k令牌长提示下实现约57令牌/秒的持续解码速度，在常见基准和推理基准测试中绝对准确率损失控制在5%以内。

Insight: 揭示了层剪枝能增强权重量化的鲁棒性，KV缓存稀疏化与INT8 KV量化互补可减少内存而不损害解码速度，而静态向量量化器常与动态缓存策略冲突；贡献了联合报告质量、内存和端到端速度的设计规则与可复现评估协议，为在真实单GPU约束下自动化流水线搜索奠定了基础。

Abstract: Single-GPU deployment of 70B-parameter language models on an NVIDIA GPU is constrained by device memory, long-context throughput, and engineering integration cost. We cast single-GPU inference as a budget-aware design problem over these three axes and study how pruning, quantization, and KV-cache compression interact under realistic execution. Controlled ablations show that layer-wise pruning makes weight quantization more robust. KV-cache sparsification complements INT8 KV quantization by reducing memory without hurting decoding speed, while static vector quantizers often conflict with dynamic caching. Guided by these coupling results and explicit budget tracking, we assembled a practical pipeline and compressed a 70B model to about 33 GB, sustained about 57 tokens/s on 10k token prompts on a single A40, and kept absolute accuracy within 5% on common and reasoning benchmarks. We contribute design rules and a reproducible evaluation protocol that jointly report quality, memory, and end-to-end speed, and we provide a foundation for automated pipeline search under realistic single-GPU constraints.

[50] COGTRL: Training LLMs for Scientific Discovery Assistance using Cognitive Traces via Reinforcement Learning cs.CLPDF

Shrinidhi Kumbhar Santosh Mashetty Divij Handa Kevin Coutinho, Siddharth Sambhaji Ghule, Chitta Baral

TL;DR: 本文提出了COGTRL，一个基于轨迹级强化学习的框架，用于训练大型语言模型（LLMs）生成包含约束检查、失败替代方案和迭代决策等细粒度认知过程的推理轨迹，以提升其作为科学发现助手的能力。在两个科学领域（AI和材料科学）的实验表明，该方法显著优于仅基于科学文献训练的基线模型。

Details

Motivation: 当前基于大量科学研究文献训练的LLMs作为科学发现助手时，往往缺乏科学家在特定目标和约束下进行推理的细粒度认知过程（如检查约束、考虑失败替代方案和迭代决策），这限制了其在真实科学发现场景中的有效性。

Result: 在两个3B参数模型和两个科学领域的实验中，COGTRL在方法质量上平均比可比的3B基线模型提高了7.85分，并且达到了与70B参数模型相当的性能水平。领域专家的分析也显示他们更偏好COGTRL生成的方法。

Insight: 论文的核心创新在于通过强化学习框架，联合优化认知轨迹和科学步骤的交错生成，从而将人类科学家的认知推理过程显式地融入到LLM的训练中。这为训练更具推理能力的AI助手提供了一种新范式，即关注过程而不仅仅是最终输出。

Abstract: Large Language Models (LLMs) trained on extensive scientific research are increasingly integrated as assistants for scientific discovery. However, most research papers omit the fine-grained cognitive process of examining constraints, failed alternatives, and iterative decisions required to achieve the desired goal. Such cognitive processes are vital for real-world scientists working toward specific goals under constraints. In this paper, we show that LLMs, when trained to produce such cognitive traces, perform better as scientific discovery assistants than when trained solely on scientific literature. We propose COGTRL, a trajectory-level reinforcement learning framework that trains LLMs to emulate cognitively grounded reasoning by jointly optimizing cognitive traces and the scientific steps produced in an interleaved manner. Across two 3B-parameter models and two scientific domains (AI and Materials Science), COGTRL improves method quality by an average of 7.85 points over comparable 3B model baselines and achieves competitive performance relative to 70B parameter models. Moreover, analysis by domain experts shows a preference for methods generated by COGTRL over the baselines.

[51] Manacá-1B: An Open, Reproducible Brazilian-Portuguese Language Model and a Tokenizer-Aware, Paired Evaluation cs.CLPDF

Bruno Leonardo Santos Menezes, Carlos Leonardo Souza Cardoso, Fabio Andre Machado Porto

TL;DR: 本文发布了Manacá-1B，这是一个专为巴西葡萄牙语设计的、参数为17.2亿的开源仅解码器语言模型，并提供了完全容器化、可复现的训练流程。论文在四个葡萄牙语基准测试上评估了该模型，并揭示了SentencePiece分词器在转换为HuggingFace fast格式时因大小写折叠归一化丢失而导致的评估陷阱，提供了修复方法。

Details

Motivation: 解决巴西葡萄牙语开源语言模型稀缺、现有模型难以复现且评估缺乏不确定性度量的问题，旨在提供一个可复现的模型和更可靠的评估框架。

Result: 在LAMBADA-PT的最后一个词预测任务中，Manacá-1B是7B参数以下最强的模型，显著优于Tucano-1b1和Tucano-2b4；在常识完成任务上具有竞争力，在多项选择推理任务上接近随机水平，与其他小型基础模型表现一致。

Insight: 创新点包括提供完全可复现的训练管道和详细日志，以及发现并量化了分词器转换中的隐藏缺陷（导致LAMBADA-PT准确率从45.3%降至25.0%），并提供了单行修复方案，强调了评估细节对结果的重要影响。

Abstract: Brazilian Portuguese remains under-served by open language models, and the few that exist are difficult to reproduce and are often compared without measures of uncertainty. We release Manacá-1B, an open decoder-only model of 1.72 billion parameters trained from scratch for Brazilian Portuguese with a fully containerized, reproducible pipeline. The pretraining is stable, with zero skipped or NaN steps and self-recovering loss spikes, and we release its full log and dynamics. We evaluate the model against nine open baselines on four Portuguese benchmarks under a single harness. Every comparison reports a standard error and a paired significance test, and the harness is validated against previously published numbers. On last-word prediction Manacá-1B is the strongest model below the 7B scale, exceeding both Tucano-1b1 and Tucano-2b4 on LAMBADA-PT with large paired margins; it is competitive on commonsense completion and near chance on multiple-choice reasoning, as are all small base models. Along the way we document a concrete evaluation pitfall: converting a SentencePiece tokenizer with case-folding normalization to the HuggingFace fast format silently drops the normalizer, routing every capitalized token to byte-fallback and depressing scores in a way that is invisible in aggregate metrics. The uncorrected tokenizer lowered LAMBADA-PT accuracy from 45.3 to 25.0; we quantify the effect and provide a one-line fix that reproduces the training tokenizer exactly. Code, raw training and evaluation logs, per-example prediction vectors, the model weights, and the corrected tokenizer are released so that every number in this paper can be recomputed.

[52] Verification-Aware Training for Speculative Decoding cs.CLPDF

Geonmo Gu, Byeongho Heo, HeeJae Jun, Yoohoon Kang, Sangmin Lee

TL;DR: 该论文提出了一种名为验证感知训练（VAT）的插件式框架，用于改进推测解码中草稿模型的训练。VAT通过在训练过程中模拟验证步骤，根据验证产生的接受/拒绝模式来监督草稿模型，从而提升候选序列的平均接受长度和推理加速效果。

Details

Motivation: 现有草稿模型的训练依赖于对目标模型的逐位置模仿，并使用固定的权重分配，这没有反映推测解码中验证过程的关键特性：验证是顺序进行的，并且从第一个拒绝位置开始，后续所有位置都会被丢弃。

Result: 在Qwen3-4B、Qwen3-8B和LLaMA-3.1-8B模型上应用VAT于EAGLE-3和DFlash方法，平均接受长度提升了最高11.4%，实际时钟加速提升了最高8.7%，在数学、代码和对话等多个基准测试上均取得了一致的性能提升。

Insight: 论文的创新点在于将推测解码的推理验证过程整合到训练目标中，具体通过引入一个轻量级的联合训练验证头来预测位置是否能在顺序验证中存活，并设计了验证自适应的权重分配策略。该方法仅修改训练目标，不改变草稿模型架构、目标模型或推理过程，具有良好的通用性和可插拔性。

Abstract: Speculative decoding accelerates large language model inference by using a draft model to generate candidate tokens, which are verified by the target model in a single forward pass. Verification proceeds sequentially and discards every position from the first rejection onward, yet existing draft training relies on token-level imitation of the target with a fixed per-position weighting that reflects neither property. We introduce Verification-Aware Training (VAT), a plug-in framework that simulates verification at every training step and turns the resulting accept and reject patterns into supervision. VAT consists of two components: (i) a verification head, a lightweight jointly trained binary classifier that supervises the draft model on whether each position survives sequential verification; (ii) verification-adaptive weighting, which replaces the fixed weighting schedule by keeping full weight up to each sample’s first rejection point and re-anchoring the decay to start there. VAT modifies only the training objective, so it can be layered on top of existing methods without changing the draft architecture, the target model, or the inference procedure. Applied to EAGLE-3 and DFlash on Qwen3-4B, Qwen3-8B, and LLaMA-3.1-8B, VAT improves average acceptance length by up to 11.4% and wall-clock speedup by up to 8.7%, with consistent gains across math, code, and chat benchmarks. Code will be available at https://github.com/naver-ai/vat

[53] CAST: Critique-Aware Supervision for Training Reliable Long-Horizon Tool-Calling Agents cs.CLPDF

Amir Saeidi, Zehua Zhang, Rishitosh Singh, Naman Ahuja, Vivek Gupta

TL;DR: 本文提出了CAST（Critique-Aware Supervision for Training）框架，旨在通过批判性监督训练来提升长视野工具调用LLM智能体的可靠性。该框架通过分析智能体轨迹，合成结构化推理来解释在部分可观测性下动作的有效性，并利用生成的批判模型来构建训练数据以优化策略模型。

Details

Motivation: 在长视野、交互式和有状态的环境中，LLM智能体的单个错误动作可能导致不可逆的任务失败，而现有基于提示的批判方法或优化方法难以系统地生成丰富的验证推理用于训练，因此需要一种能提供动作级监督的批判感知训练方法。

Result: 在动态工具调用基准测试上对Qwen3系列模型进行微调，CAST显著提高了跨领域的可靠性，在零售任务上比GPT-OSS-120B高出超过10%的pass^4分数，并在跨领域（远程医疗）设置中额外带来9%的性能提升。

Insight: 创新点在于将稀疏的任务结果转化为针对批判学习和策略优化的动作级监督，通过合成结构化推理来系统地生成训练数据，从而增强了智能体在现实动态环境中的鲁棒性。

Abstract: Large language model (LLM) agents are increasingly deployed in long-horizon, interactive, and stateful environments. In these settings, a single wrong action, such as refunding the wrong purchase, can cause irreversible task failure and must be intercepted before execution. Such failures may not appear in every single run, but can emerge across repeated trials, making reliability across steps and trials critical. However, ensuring agentic reliability is challenging: even frontier LLMs struggle to explain why an action may be wrong, especially in long, intertwined trajectories governed by domain-specific policies. Much recent work relies on prompt-based critique agents, while optimization-based methods lack a systematic way to produce rich verification rationales for training. We address this gap with CAST, a critique-aware training framework that converts sparse task outcomes into action-level supervision for critique learning and policy optimization. CAST analyzes agent trajectories to synthesize structured rationales explaining action validity under partial observability. The resulting critique model is used to construct critique-aware training data for optimizing the policy model. Fine-tuning Qwen3-family models on dynamic tool-calling benchmarks, CAST improves reliability across domains, outperforming GPT-OSS-120B by over 10% pass^4 on Retail tasks and yielding an additional 9% improvement on Telehealth in an out-of-domain setting. These results demonstrate that critique-aware training improves the robustness of LLM agents in realistic dynamic environments.

[54] Reactivating Test-Time Scaling for Plane Geometry Problem Solving cs.CLPDF

Xiaoqiang Kang, Shengen Wu, Maizhen Ning, Xiaobo Jin, Kaizhu Huang

TL;DR: 本文提出了一种名为多轨迹合成（MTS）的方法，旨在解决平面几何问题求解中测试时缩放（TTS）失效的问题。该方法通过将符号程序转换为异构推理轨迹（如可执行Python脚本和思维链增强变体），并结合感知增强训练与共识引导的多轨迹集成推理，显著提升了模型在多个几何基准测试上的性能。

Details

Motivation: 平面几何问题求解需要精确的视觉感知和多步符号推理，但现有的测试时缩放方法在符号程序范式下效果不佳，主要受限于推理多样性不足和符号推理前视觉基础不充分。

Result: 在三个几何基准测试上的实验表明，该方法在不同模型规模上均能持续提升求解性能，对比通用多模态大模型和专用几何求解器均表现出色。在测试时缩放下，其共识引导多轨迹集成方法能以高达8倍的采样成本降低，达到与高成本自一致性方法相当的精度。

Insight: 核心创新在于将单一符号程序解耦为异构推理轨迹以增加多样性，并在符号推理前引入结构化视觉语义解析以增强视觉基础。共识引导的多轨迹集成实现了高效的自适应推理，为符号程序范式下的测试时缩放提供了新思路。

Abstract: Plane geometry problem (PGP) solving has become a critical benchmark for multimodal reasoning because it requires accurate visual perception and precise multi-step symbolic deduction. Although test-time scaling (TTS) has demonstrated remarkable success in general mathematical reasoning, it fails to scale effectively under the symbolic-program paradigm for plane geometry. We identify two key obstacles: limited reasoning diversity induced by rigid symbolic programs and insufficient explicit visual grounding before symbolic deduction. To address these issues, we propose Multi-Trace Synthesis (MTS), which converts each symbolic program into heterogeneous reasoning traces, including executable Python scripts and CoT-augmented variants. We further propose Perception-Augmented (PA) training, which parses diagrams into structured semantic clauses before deduction, and Consensus-Guided Multi-Trace Ensemble (CG-MTE) for efficient self-adaptive inference. Experiments on three geometry benchmarks show that our method consistently improves PGP-solving across model scales and achieves strong performance against both general-purpose MLLMs and specialized geometry solvers. Under test-time scaling, CG-MTE achieves comparable accuracy to high-budget self-consistency while reducing sampling cost by up to 8x. Code and data are publicly available at https://github.com/Jason8Kang/ReTTS-PGPS.

[55] The Differential Reasoning Router: Operationalizing Cost-Aware LLM Annotation in E-commerce cs.CL | cs.AIPDF

Cheng Lyu, Jingyue Zhang, Vinny DeGenova, Mengwei Li, Yuanli Pei

TL;DR: 本文提出了一种名为差分推理路由器（DRR）的成本感知框架，用于解决电子商务中冷启动LLM标注问题。该框架通过联合优化模型选择和人工升级，在样本和业务规则层面分别估计直接模型和推理模型的成功概率，从而实现自适应路由：简单案例直接处理，推理模型仅用于预期能改善决策的案例，而可能双重失败或规则分歧的案例则升级给人工标注。

Details

Motivation: 解决电子商务中基于规则的标注工作流在冷启动阶段面临的挑战：仅有有限的预发布标签可用、昂贵推理的价值未知、系统规模化前需要人工审核，以及模型错误和模糊规则边界影响最终决策。

Result: 在电子商务生产工作流中，DRR达到了与最强基于置信度的路由器相当的准确率，同时实现了超过60%的推理令牌成本节省。

Insight: 创新点在于将推理模型不再作为默认后备方案，而是通过分层概率估计实现成本感知的自适应路由，为提示工程、监督微调、校准和规则细化提供针对性真实标签，从而推动从人工密集的冷启动标注向高置信度自动化路由的渐进转变。

Abstract: Large Language Models (LLMs) are increasingly used to annotate structured product data in e-commerce, but early deployment often begins as a cold-start problem: only limited pre-launch labels are available, the value of expensive reasoning is unknown, and human review is needed before the system can be trusted at scale. This challenge is especially common in rule-based annotation workflows, where each item must satisfy multiple business rules and both model errors and ambiguous rule boundaries affect final decisions. We introduce the Differential Reasoning Router (DRR), a cost-aware framework for cold-start LLM annotation that jointly optimizes model selection and human escalation. Rather than treating a reasoning model as a default fallback, DRR estimates separate success probabilities for a direct model and a reasoning model at both the sample and business-rule levels, enabling adaptive routing: easy cases are handled directly, reasoning is reserved for cases where it is expected to improve the decision, and likely double-failure or rule-disagreement cases are escalated to human annotators. The resulting labels provide targeted ground truth for prompt engineering, supervised fine-tuning, calibration, and rule refinement, enabling a gradual shift from human-heavy cold-start annotation toward high-confidence automated routing. In a production e-commerce workflow, DRR reaches accuracy parity with the strongest confidence-based router while achieving more than 60% reasoning-token cost savings.

[56] When Models Hear What They Expect: Diagnosing Prosodic Heuristics in Multimodal Sarcasm Detection cs.CLPDF

Yongjian Chen, Pengfei Wei, Yiqun Sun, Zhu Li, Lawrence B. Hsieh

TL;DR: 该论文研究了多模态大语言模型在讽刺检测任务中如何利用韵律线索，发现模型并非基于实际的讽刺韵律特征，而是依赖一种刻板的韵律启发式（如高音调和不规则停顿），导致音频模态的加入反而增加了误报率。

Details

Motivation: 动机在于探究多模态大语言模型在联合处理语音和文本时，究竟是利用韵律线索进行语用推理，还是仅仅依赖表面的声学模式，从而揭示模型在讽刺检测中的潜在偏差。

Result: 在普通话和英语的讽刺检测实验中，添加音频模态系统性地提高了误报率而未改善真阳性检测；通过针对性操纵音调和停顿维度，误报率最高可达60%，且在Gemini 3 Flash Preview模型上复现了相同效应。

Insight: 创新点在于通过分解模态贡献和声学错误诊断，揭示了MLLMs在讽刺检测中依赖与真实线索不符的刻板韵律启发式，这种偏差具有跨模型泛化性，而非单一架构所致。

Abstract: Multimodal Large Language Models (MLLMs) process speech and text jointly, yet whether they exploit prosodic cues for pragmatic inference or rely on surface acoustic patterns has received little systematic investigation. We address this through sarcasm detection, evaluating Qwen2.5-Omni and Qwen3-Omni on Mandarin Chinese and English under five modality conditions that decompose the contributions of lexical content, vocal semantics, and prosodic structure. Adding audio systematically inflates false positives without improving true positive detection. Acoustic error diagnosis reveals that model errors cluster on a shared stereotype of expressive prosody, namely elevated pitch and irregular pausing, that diverges from the actual cues marking sarcasm in both languages. Targeted manipulation of only these two dimensions causally confirms the heuristic, inducing false positive rates of up to 60%. Applying the same manipulation template to Gemini~3 Flash Preview without modification replicates the effect, suggesting that the stereotype extends beyond the Qwen Omni family rather than arising from a single model architecture.

Xueqing Wu, Ashwin Balasubramanian, Bingxuan Li, Dawei Zhu, Kai-Wei Chang

TL;DR: 本文提出了PaperBanana-Interact，一个通过多轮人类反馈来精炼科学图表的多智能体系统。为了解决现有单轮生成方法难以满足作者视觉和沟通偏好的问题，作者首先构建了多轮图表生成基准MTPaperBananaBench，并识别出基线系统普遍存在的质量漂移和遗忘两大失败模式。PaperBanana-Interact通过内部批判-精炼循环有效解决了这些问题，在多轮迭代中持续提升图表质量。

Details

Motivation: 现有科学图表自动生成方法通常为单轮生成，难以一次性满足作者复杂的视觉和沟通偏好。用户研究表明，作者普遍需要多轮修订，但这一多轮工作流程尚未得到充分探索。

Result: 在构建的MTPaperBananaBench基准上，PaperBanana-Interact在质量评分上比基线方法高出11.9-18.6分，并将遗忘问题减少了3.7-6.2分，实现了在多轮迭代中图表质量的持续提升而非下降。

Insight: 核心创新点在于提出了一个专门针对多轮科学图表精炼任务的多智能体系统，通过内部批判-精炼循环来主动缓解质量漂移和特征遗忘这两个关键失败模式。这为需要多轮交互的生成任务提供了一个有效的系统架构思路。

Abstract: Recent efforts have aimed to automate scientific diagram generation from paper content (Lin et al., 2026; Zhu et al., 2026a). However, fully satisfying an author’s visual and communicative preferences in a single turn is challenging: in our formative user study (N = 14), all participants requested further revisions after viewing an initial draft, and 86% of them rated the refined diagrams as more satisfactory. Despite the clear demand, the multi-turn workflow remains largely underexplored. To bridge this gap, we present MTPaperBananaBench, a benchmark for multi-turn diagram generation containing 292 images annotated with 3,518 user requirements. To reduce expensive human studies and enable scalable benchmarking, we construct a user simulator that, at each turn, identifies unsatisfied requirements and converts k of them into natural language feedback. Evaluating both requirement satisfaction and overall diagram quality reveals two key failure modes shared across baseline multiturn systems: (1) quality drift, where diagram quality progressively declines over turns, and (2) forgetting, where previously implemented features are lost in subsequent turns. To address these issues, we introduce PaperBanana-Interact, a multi-agent system that refines diagrams via an internal critique-and-refine loop. PaperBanana-Interact consistently improves rather than degrades diagram quality across turns, outperforming baselines by 11.9-18.6 points in quality score and reducing forgetting by 3.7-6.2 points.

[58] Beyond Surface Forms: Symbolic Edits as a Test for Logical Reasoning with LLMs cs.CL | cs.AIPDF

Ramya Keerthy Thatikonda, Wray Buntine, Ehsan Shareghi

TL;DR: 本文提出了一种基于符号编辑的框架，用于评估大语言模型在逻辑推理任务中的鲁棒性。该框架通过对一阶逻辑和约束满足问题进行受控的符号层面修改，并将其转化为自然语言问题，以测试模型对逻辑结构变化的敏感性。研究发现，无论模型规模或架构如何，LLMs在应对这些编辑时表现出不一致的推理行为，常常无法正确追踪逻辑后果。

Details

Motivation: 大语言模型的逻辑推理能力常对问题表述的表面形式变化敏感，这引发了对模型是否真正遵循底层逻辑结构的质疑。然而，由于逻辑问题中的符号组件（如运算符和谓词）难以在自然语言中系统操控，研究这一行为具有挑战性。

Result: 通过该框架对多种LLMs进行累积和单个运算符编辑的评估，定量和定性分析表明，模型在受控运算符编辑下的推理行为不一致，有时能正确适应结构变化，但经常无法追踪其逻辑后果。这一自动化压力测试结果有助于从不同维度评估语言模型并衡量其推理的可靠性。

Insight: 创新点在于开发了一个工具驱动的框架，能够生成受控的、保持标签不变的逻辑推理问题编辑，从而实现对逻辑运算符和结构组件的针对性修改。这为系统评估LLMs的逻辑推理鲁棒性提供了一种新方法，揭示了模型在符号层面理解上的局限性。

Abstract: Logical reasoning with large language models (LLMs) is a critical capability, as it reflects a system’s ability to correctly deduce hypotheses from a given context using faithful deductive processes. However, LLM reasoning has often been shown to be sensitive to small surface-level variations in problem formulation, raising questions about whether models truly follow the underlying logical structure. Studying this behavior is challenging because the symbolic components of logical problems, such as operators and predicates, are difficult to systematically manipulate in natural language. We introduce a tool-driven framework for generating controlled, label-preserving edits to logical reasoning problems. Our method operates on symbolic representations of first-order logic and constraint satisfaction problem tasks, enabling targeted modifications to logical operators and other structural components before translating them back into natural language. Using this framework, we evaluate various LLMs under cumulative and individual operator edits and analyze their behavior in response to these changes. Our quantitative and qualitative analyses show that LLM reasoning behavior under controlled operator edits is inconsistent, regardless of model size or family: models sometimes adapt correctly to structural changes but often fail to track their logical consequences. The results from this automated stress test enable an evaluation of language models across different dimensions and help measure the reliability of their reasoning.

[59] Stratified Consistency Distillation for Natural Language Formalization cs.CL | cs.AIPDF

Zhichao Hou, Ferhat Erata, Joe Lilien, MohamadAli Torkamani

TL;DR: 本文提出了一种基于分层一致性蒸馏的微调方法，用于提升自然语言到逻辑公式的翻译准确性。该方法通过生成多个逻辑翻译、基于语义等价性聚类、根据熵水平采用不同策略选择伪标签，并微调较小模型，在Pass@K和等效逻辑相似度指标上取得了显著改进。

Details

Motivation: 当前神经符号推理方法主要依赖提示工程，难以跨领域和输入格式扩展，因此需要一种可扩展的方法来提升自然语言到逻辑公式翻译的准确性。

Result: 实验表明，该方法在Pass@K和新提出的等效逻辑相似度指标上均取得了显著且一致的改进，证明了通过一致性蒸馏提升逻辑翻译的潜力。

Insight: 创新点在于将分层一致性蒸馏应用于逻辑翻译任务，通过聚类和基于熵的伪标签选择策略，有效利用大型语言模型的输出进行微调，提升了翻译的准确性和可扩展性。

Abstract: Neurosymbolic reasoning has shown promising success in addressing complex reasoning tasks by combining large language models (LLMs) and symbolic solvers. While this approach shows promise, a fundamental challenge remains: improving the accuracy of translations from natural language to logical formulas. Current methods predominantly rely on prompt engineering, which is difficult to scale across different domains and input formats. Drawing inspiration from the success of fine-tuning in other model adaptation and alignment applications, we propose a fine-tuning-based Stratified Consistency Distillation approach: (1) We generate K logical translations per input using a frontier LLM and cluster them by semantic equivalence (2) Based on the entropy level, we apply majority voting (low entropy), LLM-as-a-Judge (medium entropy), or unification/abstention (high entropy), and (3) fine-tune a smaller model using the selected pseudo-labels. Our experiments show significant and consistent improvements in both Pass@K and our novel Equivalent Logical Similarity metrics, demonstrating the potential of advancing logical translation through consistency distillation.

[60] Using Prosody to Predict Syntactic Structure cs.CL | cs.AI | cs.LGPDF

Junghyun Min, Alex Warstadt, Tamar I. Regev, Tiago Pimentel, Ethan Gotlieb Wilcox

TL;DR: 本文从信息论角度研究韵律与句法结构之间的关系，提出了一种基于多模态语言模型的通用框架来量化韵律特征与句法表示之间的互信息。该框架不依赖于特定结构且模块化，可用于评估单个韵律特征或结构成分的贡献。研究在英语朗读有声书和自发对话两个领域中，针对词长和词间停顿两个韵律特征进行了评估，发现韵律可显著降低句法不确定性，为句法-韵律接口的理论提供了新的实证支持。

Details

Motivation: 韵律对句法结构具有重要提示作用，但两者之间的对应程度和性质仍存在争议。本文旨在通过信息论视角量化韵律与句法之间的交互关系，以澄清这一接口的本质。

Result: 在英语自发对话中，韵律特征（如词长和词间停顿）可将句法不确定性降低高达10.2%，表明韵律包含可测量的句法信息。研究在朗读有声书和自发对话两个领域验证了该结果。

Insight: 创新点在于提出了一个结构无关且模块化的通用框架，利用多模态语言模型在大规模语音-文本语料上估计韵律与句法的互信息，从而能够量化单个特征对句法信息的贡献，为理论假设提供了可计算的实证基础。

Abstract: While it is well-established that prosody carries crucial cues for syntactic structure, the degree and nature of correspondence between these two domains remains contested. We investigate the syntax-prosody interface through an information-theoretic lens, quantifying the interaction between prosodic features and syntactic representations as their mutual information. We provide a general-purpose framework for estimating this quantity over large speech-text corpora using multimodal language models. Our framework is structure-agnostic and modular, insofar as it can be used to measure the contributions of individual prosodic features or components of structure. We evaluate the syntax-prosody relationship for two features (word duration and inter-word pauses) across two domains–read audiobooks and spontaneous conversations–both in English. Our results demonstrate that prosody contains measurable syntactic information, with prosodic features reducing syntactic uncertainty in spontaneous conversations by up to 10.2%. Our findings offer new empirical support for several theoretical accounts of the syntax-prosody interface.

[61] Read the Room, Read the Image: Understanding Indirect Speech Acts in Multimodal Visual Contexts cs.CLPDF

Jaehee Kim, Ji Hoon Chung, Seoyoon Park, Unsol Kim, Kyungwon Park

TL;DR: 本文提出了READI基准测试，用于评估多模态模型在视觉上下文和对话中理解间接言语行为的能力。该基准基于语用学理论建模了间接性的等级，并将任务形式化为基于视觉的语用问答，支持英语和韩语的跨语言评估。实验表明，即使是先进的多模态模型在处理视觉基础的间接言语行为时也存在困难，且性能随间接性增加而下降。

Details

Motivation: 现有基于文本的研究和多模态基准测试大多忽视了语用推理的要求，主要关注显式编码的上下文或感知识别，从而未能充分探索依赖于上下文的语用理解，特别是在韩语等高语境语言中。

Result: 实验结果显示，最先进的多模态模型在视觉基础的间接言语行为任务上表现不佳，性能随间接性增加而下降，突显了需要专门针对上下文语用推理的基准测试。

Insight: 创新点在于引入了首个专门评估多模态间接言语行为理解的基准READI，它基于语用学理论对间接性进行分级建模，并采用视觉基础的语用问答任务形式，支持跨语言评估，填补了现有基准在上下文语用推理方面的空白。

Abstract: Indirect speech acts (ISAs) require pragmatic reasoning over context, as directive intent can- not be inferred from surface form alone. Prior text-based studies and existing multimodal benchmarks largely overlook this requirement, focusing instead on explicitly encoded context or perceptual recognition, and thus underex- plore context-dependent pragmatic understand- ing, particularly in high-context languages such as Korean. We introduce READI, a multimodal benchmark for evaluating ISA understanding through integrated reasoning over visual con- text and dialogue. READI models graded in- directness grounded in pragmatic theory and formulates the task as vision-based pragmatic question answering (V-PQA), supporting cross- lingual evaluation in English and Korean. Ex- periments show that even state-of-the-art multi- modal models struggle with visually grounded indirect speech acts, with performance declin- ing as indirectness increases, underscoring the need for benchmarks that explicitly target con- textual pragmatic reasoning.

[62] Sequential Trajectories and Simultaneous Blending: Multi-Emotion Modeling for Instruction-Following TTS cs.CL | cs.SDPDF

Yan Zhou, Yun Hong, Yang Feng

TL;DR: 本文提出了HybridEmo，一个用于指令跟随TTS的多情感建模后训练框架，旨在解决情感轨迹（有序多阶段情感）和情感混合（多情感共存）两个任务中监督不匹配的问题。该框架通过监督微调初始化，并利用基于样本感知混合奖励的分组相对策略优化来对齐语音标记策略。

Details

Motivation: 现有情感TTS系统主要建模单一话语级情感，对多情感控制探索不足，且存在监督不匹配问题：监督微调不显式评估情感特征，而单情感奖励无法为轨迹完成提供结构感知反馈或为混合提供配对感知反馈。

Result: 在MultiEmo-Test基准上，HybridEmo显著提升了情感轨迹的正确性和混合强度，且未明显降低说话人相似度。人工评估中，HybridEmo优于CosyVoice 3和EmoVoice-0.5B，与Qwen3-TTS偏好基本持平。

Insight: 创新点在于提出了针对多情感TTS任务的统一后训练框架，设计了样本感知的混合奖励机制：对于轨迹样本，使用段对齐一致性结合平均和最弱阶段证据；对于混合样本，使用基于GMM的奖励结合离线情感空间中目标情感锚点并集的帧级支持与话语级弱目标边界。两者共享ASR奖励并在统一策略中路由。

Abstract: Natural-language instructions enable flexible control of synthesized speech, yet emotional TTS systems primarily model a single utterance-level affect, leaving multi-emotion control underexplored. We study two complementary multi-emotion TTS tasks: emotion trajectory, which spans several ordered affective stages, and emotion blending, in which multiple emotions coexist throughout an utterance. These tasks expose a supervision mismatch: supervised fine-tuning (SFT) does not explicitly evaluate emotion features, while single-emotion rewards provide neither structure-aware feedback for trajectory completion nor pair-aware feedback for blending. We introduce HybridEmo, a post-training framework that initializes both tasks with SFT and then aligns the speech-token policy through Group Relative Policy Optimization using a sample-aware hybrid reward. For trajectory samples, segment-aligned consistency combines average and weakest-stage evidence to preserve the correctness and completeness of prescribed stages. For blending samples, a GMM-based reward combines frame-level support from the union of target-emotion anchors in an offline emotion space with an utterance-level weaker-target margin. Both branches share an ASR reward and are routed within a unified policy. On MultiEmo-Test, HybridEmo significantly improves trajectory correctness and blending intensity, without a noticeable degradation in speaker similarity. Human evaluation prefers HybridEmo to CosyVoice 3 and EmoVoice-0.5B, with nearly balanced preferences against Qwen3-TTS.

[63] Do Small Models Use the Law You Give Them? Measuring Context Use on a Bilingual Bangladesh Legal Benchmark cs.CLPDF

Moniruzzaman Mahadi, Abrar Mohammed Tanzim Alam, Sayma Siddika Monalisa, Mir Mohammad Asif Abdullah, Swakkhar Shatabda

TL;DR: 该论文研究了在孟加拉国双语法律问答任务中，微调如何影响模型对上下文所提供法律条文的使用。通过构建一个层次化的法规语料库、双语微调数据集和一个包含150个条目的受控法律条文集，作者评估了六个指令微调模型。研究发现，微调虽然能提升答案评分，但并未显著增强模型对给定法律条文的依赖，揭示了区分评分器、检索器和模型本身影响的重要性。

Details

Motivation: 动机在于探究微调在法律问答任务中，是真正提升了模型对上下文法律条文的理解和使用能力，还是仅仅改善了答案评分或检索等表面指标。研究旨在区分这些效应，以更准确地评估法律领域自适应方法的有效性。

Result: 在孟加拉国法律基准测试中，使用精确行解析器（exact-line parser）评估时，Qwen3.5-2B模型的特定适配器带来了50.0%的准确率提升，而仅基于选项评分的方法仅提升3.0%。当确保相关法律条文存在时，六个参考模型中有五个在四项标准下提升了14.7%-19.3%；移除该条文则导致模型准确率下降8.0%-15.3%，适配器下降13.8%-14.9%。然而，双重差分估计表明微调后模型对法律条文的依赖并未增加。

Insight: 创新点在于设计了一套方法（包括约束性选项字母评分、循环选项轮换和受控法律条文移除）来分离评分、检索和模型使用法律条文的影响。客观来看，该研究强调了在法律领域评估模型时，需要精细区分不同组件的贡献，避免将表面性能提升误认为模型理解能力的增强。

Abstract: Fine-tuning can improve legal question-answering accuracy without improving how models use law supplied in context. We study this distinction in bilingual Bangladeshi legal QA, where observed errors can arise from answer scoring, retrieval, or failure to use relevant law. We construct a hierarchy-preserving statutory corpus, 2,165 reviewed bilingual fine-tuning examples, and a 150-item supplied-law control. We evaluate six instruction-tuned models: Llama-3.2-1B, Llama-3.2-3B, Qwen3.5-0.8B, Qwen3.5-2B, Qwen3.5-4B, and Gemma-4-E2B, with three LoRA seeds per model. To separate effects, we combine constrained option-letter scoring, cyclic option rotation, and controlled removal of the governing provision. On 398 Bar Council outputs, an exact-line parser attributes an accuracy gain of 50.0% to the Qwen3.5-2B seed-42 adapter, whereas option scoring yields only $3.0%$. For Gemma-4-E2B, the two scoring methods favor different systems. When the governing provision is guaranteed to be present, five of six reference models improve by $14.7%-19.3%$ under the four-order criterion. Removing that provision reduces accuracy by $8.0%-15.3%$ for models and by $13.8%-14.9%$ points for their adapters. However, difference-in differences estimates show no increase in reliance on the governing provision after fine-tuning. Results show that legal adaptation claims require separating scorer, retriever, and model effects. Our Code and data are available at https://anonymous.4open.science/r/bangladesh-legal-qa-11E3

[64] When LLM Meets Tree Search: A Systematic View of Inference as Search in Large Language Models cs.CLPDF

Jiaqi Wei, Xiang Zhang, Yuejin Yang, Wenxuan Huang, Juntai Cao

TL;DR: 这篇论文系统性地综述了将推理视为搜索过程的大语言模型推理方法，特别是基于树搜索的推理技术。它从高层次视角将推理重新定义为在部分推理状态空间上的搜索，并追溯了从无信息搜索到蒙特卡洛树搜索的演变。

Details

Motivation: 随着预训练扩展定律接近饱和，测试时扩展成为通过分配推理时计算来提升推理能力的重要方向。现有方法如思维链虽然暴露了中间步骤，但通常依赖单轨迹解码，限制了从早期错误中恢复和探索的能力。

Result: 论文未在摘要中提及具体的定量实验结果或基准测试表现，而是一篇综述性文章，旨在系统化该领域进展并引入统一的设计空间。

Insight: 主要创新点在于提出了一个统一的设计空间，涵盖搜索拓扑、评估信号和控制动态，并倡导标准化的计算报告抽象，以使计算-精度权衡变得明确且可比较。这为系统化理解和比较不同的树搜索推理方法提供了框架。

Abstract: As pretraining scaling laws approach saturation, Test-Time Scaling (TTS) has emerged as an important direction for improving reasoning by allocating inference-time compute to a fixed model prior. Viewed at a high level, TTS reframes inference as search over a space of partial reasoning states. While Chain-of-Thought (CoT) exposes intermediate steps, common instantiations rely on single-trajectory decoding, limiting recovery from early errors and exploration. This survey systematizes recent progress in tree-search-based reasoning, viewing inference as instance-specific optimization rather than decoding. We trace the evolution from uninformed search to Monte Carlo Tree Search (MCTS), highlighting how sampling-based control supports principled exploration-exploitation trade-offs. To unify a fragmented literature, we introduce a Unified Design Space spanning search topology, evaluation signals, and control dynamics, and advocate a standardized compute-reporting abstraction to make compute-accuracy trade-offs explicit and comparable.

[65] Co-Evolving Actor-Conditioned Critics for Non-Verifiable Generation cs.CLPDF

Jinyoung Kim, Muhammad Khalifa, Lajanugen Logeswaran, Jaekyeom Kim, Moontae Lee

TL;DR: 本文提出了一种针对非可验证生成任务的协同演化评论者-执行者框架，通过引入TAIScore奖励机制来评估评论的有用性，并利用该奖励训练适应特定执行者的评论者，同时通过评论引导的修订构建DPO偏好对来改进执行者，形成两者协同演化的闭环。

Details

Motivation: 解决在缺乏确定性验证器的非可验证生成任务中，自然语言评论作为监督信号的有效性问题，因为现有方法无法区分评论的实际有用性与执行者自身能力的影响。

Result: 实验表明，使用TAIScore训练的8B参数评论者性能优于零样本120B评论者以及仅基于结果或仅基于评论的奖励信号训练的评论者，协同演化进一步提升了性能。

Insight: 创新点在于将评论视为执行者条件化的修订指导，并提出TAIScore这一综合评估指标来量化评论的针对性、可执行性和改进效果，从而实现了评论者与执行者的动态适配与协同优化。

Abstract: Natural-language critiques provide supervision beyond scalar rewards for non-verifiable generation, which lacks deterministic verifiers. In critique-guided refinement, a critic gives feedback on an initial response and an actor revises it. However, final revision quality does not reveal whether the critique was actually useful: a capable actor may improve without following the feedback, while valid feedback may fail if the actor cannot execute it. We frame critique as actor-conditioned revision guidance, where usefulness depends on whether the feedback helps the target actor address the intended weakness. We introduce TAIScore (Targeted Actionable Improvement Score), a reward that evaluates the instruction, initial response, critique, and revision together, assessing whether the critique targets a real weakness, whether the actor follows it, and whether the intended aspect improves. We use this reward to train an actor-tailored critic with GRPO, and use critique-guided refinements to construct DPO preference pairs for the actor, forming a co-evolving critic-actor loop where the critic adapts to the actor’s changing capability. Experiments show that an 8B critic trained with TAIScore outperforms both a zero-shot 120B critic and critics trained with outcome-only or critique-only reward signals. Co-evolving the critic and actor further improves performance, suggesting that effective critique supervision should adapt as the actor changes.

[66] Beyond Polarization: The Generative Constraint of Chain-of-Thought in Pointwise Reranking cs.CL | cs.IRPDF

Xiaoyang Chen, Jie Liu, Haijin Liang, Haibo Shi, Jin Ma

TL;DR: 本文研究了在点式文档重排序任务中，Chain-of-Thought模型为何通常表现不如直接评分模型。通过实证研究发现，即使采用强化学习、细粒度监督和架构解耦等针对性训练干预，虽然能提升分类准确率和绝对分数，但相对排序差距依然存在。这表明，在点式评分范式下，通过离散文本来传递连续相关性语义会限制排序信号的分辨率，这是一个稳定且难以在当前标准方法下克服的瓶颈。

Details

Motivation: 解决点式文档重排序中Chain-of-Thought模型表现不如直接评分模型的问题，并探究针对性训练是否能弥补这一差距。

Result: 实验表明，即使在参数规模高达320亿的模型上，这一性能差距依然稳定存在；尽管干预措施提升了分类准确率和绝对分数，但相对排序差距并未消除。

Insight: 创新点在于揭示了点式评分范式中，通过离散文本（如Chain-of-Thought）传递连续语义会固有地限制排序信号分辨率，这是一个结构性瓶颈，而非简单的训练偏差问题。

Abstract: In pointwise document reranking, Chain-of-Thought models typically underperform direct scoring models. While existing diagnostics attribute this to inferior classification, score polarization, or calibration breakdown, whether targeted training can bridge this gap remains unclear. Our empirical study first confirms that this gap is stable across scales up to 32B parameters, ruling out model and data capacity confounders. We then apply stress tests utilizing reinforcement learning, fine-grained supervision, and architectural decoupling to explicitly repair these deviations. Although these interventions improve classification accuracy and absolute scores, the relative ranking gap persists. These findings suggest that, within the pointwise scoring paradigm, routing continuous relevance semantics through discrete text constrains ranking signal resolution, revealing a bottleneck that is stable and difficult to overcome under current standard methods, rather than an easily resolvable training bias.

[67] SemPOI-RL: Aligning LLM Semantic Reasoning for Interpretable Out-of-Town POI Sequential Generation cs.CL | cs.AIPDF

Yunqi Liu, Yang Zhang, Ruixing Zhang, Liangzhe Han, Yi Qiao

TL;DR: 该论文提出了SemPOI-RL框架，旨在解决大语言模型（LLM）在结构化序列生成任务中语义推理能力难以对齐的问题，特别是在异地（OOT）兴趣点（POI）序列生成推荐场景。该框架通过微调LLM从用户家乡轨迹中推断出以目的地为导向的旅行风格作为可解释的语义中间表示，并利用语义POI对齐模块（SPAM）将这些风格信息融入一个基于风格条件的掩码自编码器，以进行位置感知的轨迹生成，最后应用强化学习来对齐LLM生成的风格与下游序列质量。

Details

Motivation: 现有方法在异地POI序列生成任务中存在局限：基于潜在ID迁移的方法可解释性差，而直接使用LLM生成序列的方法未能将推断出的语义明确地、位置感知地融入预测。因此，需要一种新框架来对齐LLM强大的语义推理能力与结构化序列生成，以提供可解释的推荐。

Result: 在两个真实世界数据集上的实验表明，SemPOI-RL在性能上持续优于传统的推荐模型和直接的LLM基线方法。

Insight: 核心创新点在于提出了一个将LLM语义推理与结构化序列生成对齐的框架，其关键是通过自然语言作为可解释的语义中间表示（旅行风格），并设计SPAM模块将其接地到位置感知的生成模型中，再结合强化学习进行端到端优化，从而在提升推荐性能的同时保证了模型的可解释性。

Abstract: Large language models (LLMs) exhibit strong semantic reasoning and open-ended generation abilities, but aligning these abilities with structured sequential generation remains challenging. This challenge is particularly evident in out-of-town (OOT) POI sequence generation, where a model must infer transferable travel intent from a user’s hometown behaviors, adapt to cross-city interest drift, and generate a coherent destination trajectory under structural constraints. Existing approaches either rely on latent ID-based transfer with limited interpretability or directly use LLMs for sequence generation without explicitly grounding inferred semantics into position-aware predictions. To address this gap, we propose SemPOI-RL, a framework that aligns LLM semantic reasoning with structured sequence generation for interpretable OOT recommendation. Specifically, we first fine-tune an LLM to infer destination-oriented travel styles from users’ hometown trajectories, using natural language as an interpretable semantic intermediate. We then introduce a Semantic POI Alignment Module (SPAM) to ground these inferred styles into a style-conditioned masked autoencoder for position-aware trajectory generation. Finally, we apply reinforcement learning with recommendation-oriented rewards to align LLM-generated styles with downstream sequence quality. Experiments on two real-world datasets show that SemPOI-RL consistently outperforms both traditional recommenders and direct LLM baselines, while providing interpretable style attribution across different phases of a trip. The code is available at https://github.com/Wind-Flipped/SemPOI-RL .

[68] Learning to Reason and Use Tools through Unsupervised Fine-Tuning in Task-Oriented Dialog Systems cs.CLPDF

Markel Ferro, Oier Lopez de Lacalle

TL;DR: 本文提出了一种面向任务对话系统的无监督微调方法，通过结合ReAct框架使大语言模型能够访问外部知识并生成事实性回答。该方法利用上下文学习推理生成推理轨迹，并基于LLM的评判器筛选高质量样本构建训练集，通过无监督自改进循环持续优化模型。在SIMMC数据集上的实验表明，该方法在推理和工具使用方面优于基线模型，微调后的8B模型甚至超越了70B的上下文学习系统。

Details

Motivation: 当前对话系统在动态信息检索方面存在困难，容易产生幻觉并导致回答准确性下降，因此需要一种能够有效利用外部知识并提升事实性回答的方法。

Result: 在SIMMC数据集上的实验显示，基于ReAct的系统在推理和工具使用方面优于基线模型，微调后的8B模型超越了70B的上下文学习系统，达到了SOTA水平。

Insight: 创新点在于将ReAct框架应用于任务导向对话，并设计了无监督微调流程，通过上下文学习推理轨迹生成和LLM评判器筛选构建高质量训练集，结合自改进循环持续提升模型性能，实现了小模型超越大模型的效果。

Abstract: Current dialogue systems struggle with dynamic information retrieval, often leading to hallucinations and lower response accuracy. We address this by adapting the ReAct framework for Task-Oriented Dialogue, enabling Large Language Models (LLMs) to access external knowledge and produce factual responses. Mainly, we propose an unsupervised fine-tuning pipeline that harvests reasoning trajectories via in-context learning inference. High-quality samples are filtered using an LLM-based judge to construct a robust training set. This is enhanced by a unsupervised self-improvement loop, where improved checkpoints generate increasingly better trajectories for subsequent fine-tuning iterations. Experiments on the SIMMC dataset demonstrate that ReAct-based systems outperform baselines due to superior reasoning and tool use. Notably, our fine-tuned 8B model surpasses a 70B in-context system. Finally, we present an error analysis, impact of scene complexity, and cross-domain generalization.

Jaewoo Ahn, Junseo Kim, Hyunseo Kim, Heeseung Yun, Jaehyeon Son

TL;DR: 该论文提出了MineAmongUs，一个3D多模态的《Among Us》沙盒环境，用于研究VLM智能体在具身社交互动中的联合言语与非言语欺骗行为。同时，论文提出了ARIA，一个可配置的VLM智能体框架，以及一个基于欺骗分类学、通过LLM-as-a-Judge实现大规模标注的原子和弧级注释方案。实验表明，VLM智能体会通过联合言语与非言语欺骗来追求‘内鬼’胜利，且非言语通道在框架消融和跨VLM评估中成为更决定性的致胜因素。

Details

Motivation: 现有关于LLM/VLM智能体战略欺骗的测试平台仅限于文本交互，且运行在单一固定配置上，忽略了欺骗分类学中视为核心的非言语感知运动通道，并使得观察到的行为难以区分是源于底层模型还是外围框架。

Result: 实证结果表明，在MineAmongUs环境中，VLM智能体会通过联合言语与非言语欺骗来追求胜利，且非言语通道在框架消融和跨VLM模型评估中成为更决定性的致胜贡献者。

Insight: 论文的创新点在于构建了一个支持多模态（言语与非言语）欺骗研究的3D具身社交互动沙盒（MineAmongUs），并提出了一个可配置的VLM智能体框架（ARIA）以及一个可扩展的、基于LLM标注的欺骗行为细粒度注释方案，为具身VLM智能体对齐研究开辟了新路径。

Abstract: Strategic deception by LLM and VLM agents has emerged as a central AI alignment and safety concern. Social-deduction games (where each player holds a hidden role and communicates with others to deduce identities) serve as the canonical testbed, particularly in multi-agent settings. Existing testbeds, however, are text-only and run on a single fixed agent configuration, missing the non-verbal sensorimotor channels treated as core by deception taxonomies and leaving it ambiguous whether an observed behavior reflects the underlying model or the surrounding harness. We introduce MineAmongUs, a 3D multimodal Among Us sandbox where imposter agents must deceive crewmates through joint verbal and non-verbal action. We also propose ARIA, a configurable VLM-agent harness that exposes five cognitive-component ablation axes; and an atom- and arc-level annotation scheme grounded in deception taxonomies and operationalized at scale by an LLM-as-a-Judge reaching near-human atom-labeling agreement. Empirical results show that VLM agents pursue imposter wins through joint verbal and non-verbal deception, with non-verbal channels emerging as the more decisive winning contributors across both harness ablation and cross-VLM evaluation. Taken together, our work opens a new path for embodied VLM-agent alignment research.

[70] From Final Artifacts to Trajectories: Retrospective Process Supervision for Evidence-Grounded Long-Form Generation cs.CLPDF

Junjie Huang, Jiarui Qin, Di Yin, Weiwen Liu, Yong Yu

TL;DR: 本文提出了RetroGen框架，一种基于回顾性过程监督的自改进方法，旨在解决开放任务中轨迹数据稀缺的问题。该方法通过从高质量最终产物（如文献综述、分析报告）中重构潜在的证据寻求轨迹，并利用这些重构数据进行模型训练，从而提升长文本生成任务的证据基础和忠实性。

Details

Motivation: 动机在于开放任务（如文献综述、法律判断）缺乏单一标准答案，且轨迹数据标注成本高昂，难以像编码或数学等可验证领域那样大规模获取轨迹数据来增强语言模型的代理能力。

Result: 实验表明，RetroGen在多个长文本证据寻求代理任务上，提升了生成结果的证据基础（grounding）和忠实合成（faithful synthesis）能力。

Insight: 创新点在于利用大量预训练数据中已有的高质量最终产物作为“压缩轨迹”，通过重构和验证过程生成监督信号，实现无需更强模型轨迹数据的自监督训练，为开放领域任务的过程监督提供了新思路。

Abstract: Trajectory data is getting more vital for training large language models for boosting the agentic abilities. Unlike the verifiable domains such as coding or mathematics, scaling trajectory data for open-ended tasks is much more difficult because these tasks lack singular ground truth and are costly to annotate or verify. In this paper, we propose RetroGen, a self-improving framework of retrospective process supervision. Our key observation is that although expert trajectories are scarce, high-quality final artifacts such as literature reviews, analyst reports and legal judgments, are abundant in pre-training data and can be viewed as compressed traces of the evidence-seeking processes that produced them. RetroGen reconstructs candidate latent trajectories from expert artifacts, verifies them against both the artifact and supporting evidence, and trains models on their own successful reconstruction data, without requiring trajectory data from stronger models. Experiments show that RetroGen improves grounding, faithful synthesis, and long-form evidence-seeking agent tasks.

[71] Enhancing Low-Resource Language Reasoning via High-Resource Language Feature Transfer cs.CL | cs.AIPDF

Minju Song, Hyeon Hwang, Junhyun Lee, Jaewoo Kang

TL;DR: 本文提出了一种机制干预框架，用于识别和跨语言迁移任务相关的稀疏潜在特征，以解决低资源语言在推理任务中表现不佳的问题。该方法通过稀疏自编码器从高资源语言的残差流激活中提取与任务推理相关的特征，并在低资源语言推理时注入这些特征，从而在不进行翻译、微调或改变用户语言的情况下提升低资源语言的推理能力。

Details

Motivation: 研究动机在于探索大语言模型在不同语言间性能差异的原因，特别是低资源语言在语义等效任务中表现不佳的现象，并提出一种基于特征迁移的干预方法来弥补这一差距。

Result: 实验表明，通过提取高资源语言中的任务相关特征并注入低资源语言，能够显著提升低资源语言在数学推理等任务上的性能，超越随机和非任务控制基线，验证了特征迁移的有效性。

Insight: 创新点在于将跨语言推理差距重新定义为机制激发失败而非能力缺失，并提出了一种可因果测试的特征介导迁移框架，无需翻译或微调即可实现语言间特征转移，为低资源语言推理提供了新思路。

Abstract: Large language models exhibit substantial performance variation across languages, even when solving semantically equivalent tasks. Existing analyses often treat this phenomenon as an observational disparity caused by differences in pretraining data, tokenization, or benchmark coverage. We study a complementary hypothesis: high-resource languages (HRLs) may more reliably elicit latent computations useful for task-specific (i.e. mathematical) reasoning, while lower-resource languages (LRLs) may under-activate those computations despite expressing the same task. To test this hypothesis, we introduce a mechanistic intervention framework for identifying and transferring task-relevant sparse latent features across languages. Using sparse autoencoders over residual-stream activations, we isolate features enriched in successful HRL task-specific reasoning while filtering out source-language and generic-generation features. We then construct steering directions from these features and inject them during LRL inference. The resulting interventions test whether the selected features are functionally involved in the observed reasoning gap: suppressing them should impair source-language reasoning, while activating them should partially recover target-language reasoning beyond random and non-task controls. Our framework reframes some cross-lingual reasoning gaps as failures of mechanism elicitation rather than capability absence, and offers a causally testable route to feature-mediated transfer without translation, fine-tuning, or changing the user-facing language.

[72] More Capable, Less Faithful: A Multilingual Analysis of Mathematical (Un)Solvability Detection in LLMs cs.CLPDF

Maria-Eleni Zoumpoulidi, Nikolaos Xiros, Georgios Paraskevopoulos

TL;DR: 本文研究了大型语言模型在多语言环境下数学问题可解性检测的能力，发现尽管高资源语言如英语在数学推理上表现更强，但其可解性检测的忠实度反而更低。研究通过构建首个多语言基准数据集，并训练多语言探针进行分析，揭示了可解性信念是一种普遍且语言无关的特征。

Details

Motivation: 先前研究主要集中于英语环境下的数学可解性检测，缺乏对多语言场景的分析，因此不清楚多语言失败是由于内部可解性信念差异还是语言表达失败所致。

Result: 在扩展至法语和希腊语的ReliableMath基准上，通过行为、表示和忠实度分析，发现最先进的LLMs在英语等高资源语言上数学推理性能更强，但可解性检测忠实度更低。

Insight: 创新点在于构建首个多语言数学可解性检测基准，并揭示可解性信念是语言无关的普遍特征，这挑战了高资源语言在推理任务中全面占优的假设，为多语言模型评估提供了新视角。

Abstract: Solvability detection is one of the most challenging aspects of mathematical reasoning for Large Language Models (LLMs). While prior work has studied this capability extensively, these analyses have been limited to English. Consequently, it remains unclear whether multilingual failures arise from differences in internal Solvability Belief or from language-dependent failures to express it. To address this gap, we introduce the first multilingual benchmark of paired solvable and unsolvable mathematical problems, extending ReliableMath to French and Greek. Using this, we train multilingual probes predicting Solvability Belief and analyze the solvability detection capabilities of state-of-the-art LLMs behaviorally, representationally, and in terms of faithfulness. We find that Solvability Belief is encoded as a largely universal, language-agnostic feature, and that higher-resource languages such as English, despite achieving stronger mathematical reasoning performance, exhibit lower solvability-detection faithfulness.

[73] ImageEval 2026: Culturally Grounded Arabic Multimodal Evaluation cs.CL | cs.AIPDF

Samir Abdaljalil, Hunzalah Hassan Bhatti, Ahlam Bashiti, Farina Amir, Md Arid Hasan

TL;DR: 本文介绍了ImageEval 2026共享任务，这是一个以文化为背景的阿拉伯语多模态评估基准。该任务包含两个子任务：AynVQA（涵盖英语和现代标准阿拉伯语的语音视觉问答与基于图像的幻觉检测）和CRAI-Bench（评估文本到图像生成的文化准确性）。共有14支团队参与测试阶段，其中12支提交了系统描述论文，采用了包括零样本提示、视觉语言模型微调、语音识别流水线、集成学习和分数校准等多种方法。

Details

Motivation: 该共享任务旨在解决多模态评估中文化背景的重要性问题，特别是针对阿拉伯语语音和图像-文本推理的挑战，以推动更具文化敏感性的AI模型发展。

Result: 论文总结了不同赛道的主要结果，所有数据集和评估脚本已向研究社区发布，但摘要中未具体提及定量性能指标或与SOTA的比较。

Insight: 创新点在于构建了一个专门针对阿拉伯语和文化准确性的多模态评估基准，整合了语音、视觉问答、幻觉检测和文本到图像生成等多个任务，强调了在AI评估中纳入文化维度的必要性。

Abstract: We present an overview of the ImageEval 2026 shared task on culturally grounded Arabic multimodal evaluation. It includes two tasks: (i) AynVQA, covering spoken visual question answering and image-grounded hallucination detection in English and Modern Standard Arabic (MSA), and (ii) CRAI-Bench, evaluating the cultural accuracy of text-to-image generation. A total of 14 teams participated in the test phase, with 12 teams submitting system description papers. Participating systems used a range of approaches, including zero-shot prompting, fine-tuning of vision-language models, speech-recognition pipelines, ensembling, and score calibration. We describe the task setup, datasets, evaluation procedure, and participating systems, and summarize the main results across the different tracks. All datasets and evaluation scripts from the shared task are released to the research community. The shared task highlights the challenges of culturally grounded multimodal evaluation, particularly for Arabic speech and image-text reasoning.

[74] UTILMEM: Benchmarking Evidence Utilization in Long-Term Conversational Memory cs.CLPDF

Peijun Qing, Fobo Shi, Soroush Vosoughi

TL;DR: 本文提出了UtilMem基准测试，用于评估对话系统中长期记忆的利用能力，即整合分布式、隐式和噪声证据以生成连贯任务输出的能力。该基准包含1,717个实例，覆盖五个领域，重点评估密集历史推理、隐式记忆识别、分布式证据合成以及抗语义干扰四个维度。实验表明，传统事实记忆基准的优异表现并不能保证有效的记忆利用，且仅靠检索不足以实现信息整合与干扰区分。

Details

Motivation: 现有对话系统基准主要关注点状事实回忆，而现实世界中的记忆使用需要整合跨会话的分布式、隐式和噪声证据，这种记忆利用能力尚未得到充分评估。

Result: 在UtilMem基准上评估多种基于检索和记忆增强的系统，发现它们在传统事实记忆基准上的强性能并不能可靠转化为有效的记忆利用；即使成功检索到相关证据，系统也常无法跨会话整合信息或区分有用证据与语义相似的干扰项。

Insight: 创新点在于提出了记忆利用（memory utilization）这一更全面的评估维度，并构建了专门诊断该能力的基准；客观分析表明，长期对话记忆的进展需要显式支持证据整合和抗检索干扰的架构设计。

Abstract: Long-term memory is increasingly important for conversational agents, yet existing benchmarks primarily measure memory through pointwise factual recall: whether a system can recover isolated facts or event-level details from prior interactions. Real-world memory use, however, often requires a more demanding capability: integrating distributed, implicit, and noisy evidence across extended interaction histories into coherent, task-oriented outputs. We call this capability memory utilization. Here, we introduce UtilMem, a diagnostic benchmark comprising 1,717 instances across five domains, designed to evaluate four underexplored aspects of memory utilization: reasoning over dense histories, identifying implicitly relevant memories, synthesizing distributed evidence into summaries, analyses, or plans, and resisting interference from semantically similar distractors. Evaluating a diverse set of retrieval-based and memory-augmented systems, we find that strong performance on conventional factual-memory benchmarks does not reliably translate into effective memory utilization. Moreover, retrieval alone is insufficient: even when relevant evidence is successfully recovered, systems frequently fail to integrate information across sessions or to distinguish useful evidence from plausible distractors. These findings expose a substantial gap between accessing stored information and using it effectively, and suggest that progress in long-term conversational memory will require architectures that explicitly support evidence integration and robustness to retrieval interference. Code is available at https://github.com/peijunallin/UtilMem.

[75] WebWorld: The Browser as a World Model for Self-Improving Web Code cs.CL | cs.SEPDF

Jiajun Wu, Jian Yang, Yaxin Du, Wei Zhang, Haowen Wang

TL;DR: 论文提出了WebWorld框架，将浏览器作为网页代码的确定性世界模型，用于驱动视觉语言模型（VLM）进行自我改进。该框架通过浏览器执行代码并验证交互契约，仅将验证通过的代码转换作为监督数据，从而解决现有VLM自我改进循环中模型既当裁判又当选手、视觉合理性无法保证功能正确性的结构缺陷。

Details

Motivation: 现有VLM驱动的网页代码自我改进存在结构性缺陷：提出修复的模型同时是评估修复的模型，其视觉合理性判断无法保证页面实际功能。循环缺少一个VLM无法欺骗的、确定性的执行环境来验证代码行为。

Result: 在匹配训练下，WebWorld-27B相比Raw-27B在HTMLBench-400上提升5.3分，在MiniAppBench-Val上提升14.9分，在交互式HTML生成任务上达到Kimi-K2.6和GPT-5.4等前沿系统的水平。消融实验表明，浏览器支持的验证机制是性能提升的关键。

Insight: 创新点在于将浏览器重新定位为网页代码的确定性世界模型，并设计了一个基于浏览器执行验证的准入机制（证书），仅积累验证成功的代码转换作为高质量监督数据，构建了一个自我改进的质量棘轮。这为代码生成任务的自我改进提供了可验证、抗欺骗的闭环框架。

Abstract: VLM-driven self-improvement of web code has a structural flaw: the model that proposes the repair is the model that judges it, and visual plausibility under that judge is a poor proxy for whether the page actually works. What the loop is missing is a counterparty the VLM cannot fool, and the browser already is that counterparty: a deterministic, executable simulator of how an HTML artifact behaves under user actions, and in everything but name a world model for web code. We present WebWorld, the interface that lets a VLM prior interact with this browser-as-world-model autonomously and decides which interactions become supervision. Each round, the VLM emits a critique that the planner compiles into a typed interaction contract; the browser re-executes the candidate and issues an acceptance certificate only when both target progress and preservation of every previously verified capability hold; certified transitions accumulate as a quality ratchet that is the only thing the SFT export ever sees. Under matched training, WebWorld-27B improves Raw-27B by 5.3 points on HTMLBench-400 and 14.9 points on MiniAppBench-Val, and reaches the level of strong frontier systems such as Kimi-K2.6 and GPT-5.4 on interactive HTML generation. Equal-size ablations show that browser-backed admission carries the gain: without the certificate, the matched 9B lift nearly disappears.

[76] REER-PT: Reverse-Engineered Reasoning for Perplexity-Guided Pre-training Data Augmentation cs.CLPDF

Haoran Que, Jiajun Shi, Ting Huang, Renming Pang, Jiaheng Liu

TL;DR: 本文提出了REER-PT框架，一种用于预训练数据增强的可扩展方法。该方法通过识别难以预测但可从上下文推断的文本延续，并插入简洁的推理标注来重建上下文与延续之间的缺失联系，从而提升数据质量。实验表明，使用增强数据训练的模型在多个知识和推理基准上取得了性能提升。

Details

Motivation: 随着语言模型计算规模扩大，高质量训练数据日益成为瓶颈。传统的下一个词预测监督了上下文之后的内容，但未显式包含产生该延续的中间推理过程。

Result: 在增强数据、原始词元和选定延续的比较中，困惑度降低了0.42到7.29。使用增强语料库训练的680M参数模型在多个知识和推理基准上获得了高达2.07个百分点的性能提升。

Insight: 创新点在于将逆向工程推理（REER）扩展到原始预训练数据，通过离线生成和优化推理标注来增强数据，同时保持与标准下一个词预测目标的兼容性，无需在预训练时进行在线推理展开。该方法利用困惑度作为优化信号，并通过长度和目标泄露约束过滤无用标注，是一种稀疏且可扩展的数据增强策略。

Abstract: As language-model compute continues to scale, high-quality training data is becoming an increasingly important bottleneck. Conventional next-token prediction supervises what follows a context but leaves the intermediate reasoning behind that continuation implicit. We introduce \textbf{REER-PT}, a scalable framework that extends Reverse-Engineered Reasoning (REER) to raw pre-training data. REER-PT identifies continuations that are difficult to predict but can still be inferred from the preceding context, and inserts concise reasoning annotations that reconstruct the missing connection between context and continuation. Candidate annotations are generated and refined offline, with perplexity serving as the optimization signal. Constraints on length and target leakage filter out unhelpful or trivial annotations. This sparse transformation preserves the source text and remains compatible with standard next-token prediction, avoiding online reasoning rollouts during pre-training. We apply REER-PT to transform a source pre-training corpus into an augmented one. Across augmented-data, original-token, and selected-continuation comparisons, perplexity reductions range from 0.42 to 7.29, and only about 0.05% of annotation 13-grams appear verbatim in the source text. We then train two 680M-parameter models with the same architecture and training configuration on the source and augmented corpora, respectively. The augmented-data model gains up to 2.07 percentage points on several knowledge and reasoning benchmarks. Together, the perplexity analysis indicates improved continuation predictability, while the controlled pre-training experiments suggest that this augmentation can improve model performance without changing the standard pre-training objective.

[77] GMTS: Gradient Magnitude-based Token Selection Improves RLVR Training for LLM Reasoning cs.CL | cs.AI | cs.LGPDF

Outongyi Lv, Yuanwei Zhang, Xiaoqun Zhang

TL;DR: 本文提出了一种基于梯度幅度的令牌选择方法（GMTS），用于改进强化学习与可验证奖励（RLVR）训练中大型语言模型的推理能力。该方法通过连接熵与梯度幅度来量化令牌重要性，相比传统基于熵的令牌选择，GMTS在多个推理任务和模型规模上表现更优。

Details

Motivation: 尽管已有研究表明高熵令牌在模型训练中至关重要，但其有益原因尚不明确；作者发现高熵令牌与梯度幅度相关，但熵本身无法跨不同答案一致反映令牌重要性，因此需要更精细的量化方法。

Result: 在三个推理领域和多种模型规模上，使用GMTS排名前20%的令牌进行训练，均优于基于熵的令牌选择方法，表明GMTS能更准确地估计令牌对RLVR训练的贡献。

Insight: 创新点在于利用熵-梯度连接来近似梯度幅度排名，从而提供更细粒度的令牌重要性估计；客观分析认为，该方法通过直接关联训练动态（梯度）而非间接统计量（熵），提升了RLVR训练的效率和效果。

Abstract: Reinforcement learning (RL), particularly RL with Verifiable Rewards (RLVR), has recently emerged as a central paradigm for enhancing large language models’ (LLMs) reasoning abilities, demonstrating remarkable effectiveness across reasoning tasks. Recent studies suggest that high-entropy tokens play an exceptionally important role in model training, since training with only the highest 20% entropy tokens yields significant performance gains. However, why such high-entropy tokens are beneficial remains insufficiently understood. In this work, we find that although high-entropy tokens within one answer tend to correlate with large gradient magnitude, entropy alone fails to consistently reflect token importance across different answers, considering the variations in the answer-level reward signals. Based on this observation, we introduce the Gradient Magnitude-based Token Selection (GMTS) method to quantify token importance, which leverages the entropy-gradient connection to approximate gradient-magnitude rankings for token selection. We find that training on the top 20% tokens ranked by GMTS consistently outperforms entropy-based token selection across three reasoning domains and various model sizes, suggesting that GMTS provides a more fine-grained estimate of token contribution for RLVR training.

[78] BiG-SURE - Bipartite Graph for Semantic Uncertainty and Reliability Estimation of LLMs cs.CL | cs.AI | cs.LGPDF

Debarpan Bhattacharya, Malay Phadke, Sriram Ganapathy

TL;DR: 本文提出了一种名为BiG-SURE的黑盒不确定性估计方法，该方法基于跨温度语义一致性，通过构建锚点-探针二分图来衡量大语言模型和视觉语言模型输出的语义不确定性，以提高在安全关键场景中部署模型时的可靠性。

Details

Motivation: 在无法访问模型参数的黑盒设置下，为安全关键应用中的大语言模型和视觉语言模型提供可靠的不确定性估计是一个关键需求。

Result: 在文本问答、多语言问答和多模态问答任务上，BiG-SURE在多个模型家族上的平均弃权AUROC优于先前的黑盒不确定性估计方法。

Insight: 创新点在于利用跨温度采样（低温锚点和高温探针）结合基于NLI的蕴含分数构建二分图，并通过该图的归一化平方谱能量来定义置信度，这是一种简单、无监督且适用于黑盒设置的新颖语义不确定性度量方法。

Abstract: Reliable uncertainty estimation is a crucial requirement for deploying large language models (LLMs) and vision-language models (VLMs) in safety-critical settings, especially when the model parameters are not accessible (black-box). We propose BiG-SURE, an uncertainty estimator based on cross-temperature semantic agreement. The method samples low-temperature responses as stable semantic anchors and high-temperature responses as probes under meaning-preserving input transformations. It then constructs an anchor-probe Bipartite Graph (BiG) using NLI-based entailment scores and defines confidence through the normalized squared spectral energy of this matrix, with uncertainty given by its complement. This bipartite graph-based Semantic Uncertainty and Reliability Estimation (SURE) score measures whether high-temperature probes remain semantically aligned with the model’s stable low-temperature belief or not. We evaluate BiG-SURE on text QA, multilingual QA, and multimodal QA tasks across multiple model families. In these experiments, BiG-SURE improves average abstention AUROC over prior black-box uncertainty estimators, while remaining simple, unsupervised, and applicable to black-box model settings.

[79] Where Identity Lives: Localized, Retain-Free Identity Unlearning in Multimodal Large Language Models cs.CL | cs.CVPDF

Kangwook Ko, Jaehyuk Jang, Wonjun Lee, Hee-Seon Kim, Changick Kim

TL;DR: 本文提出了一种无需保留集的遗忘方法PAVA，用于从多模态大语言模型中移除特定个体的信息。该方法通过定位身份信息存储的特定层（早期至中期的解码器MLP层），并利用视觉属性锚点来限制更新范围，从而在仅使用遗忘集的情况下实现有效的身份遗忘，同时保持模型的视觉感知能力。

Details

Motivation: 现有方法依赖保留集进行身份遗忘，但部署后获取保留集困难且可能重新暴露隐私；仅使用遗忘集则可能损害视觉-语言共享计算，影响感知能力。因此，需要一种无需保留集且能精准定位身份信息存储位置的方法。

Result: 在MLLMU-Bench和ReMem基准测试中，PAVA在仅使用遗忘集的方法中表现出最强的遗忘-保留权衡，并与依赖保留集的基线方法保持竞争力。

Insight: 创新点在于将身份遗忘问题转化为定位问题，通过因果追踪、权重移植和Fisher重叠分析确定身份信息存储层，并设计视觉属性锚点来约束更新，避免破坏视觉基础行为。这为无保留集遗忘提供了可借鉴的模块化思路。

Abstract: Removing a specific individual’s information from multimodal large language models (MLLMs) is often needed after deployment, but existing methods rely on a retain set, which is hardest to obtain at that point, and rebuilding it recreates the privacy exposure that unlearning aims to remove. Forgetting from the forget set alone instead damages the shared visual-language computation, harming perception. We cast retain-free unlearning as a localization problem: causal tracing, weight transplant, and Fisher overlap all point to early-to-mid decoder MLPs as the layers where identity information is stored and, unlike other module families, can be modified without substantially disrupting vision. We turn this into Pathway-Aware Visual-attribute Anchoring (PAVA), which confines updates to these layers and pairs a forget loss with a visual-attribute anchor that preserves image-grounded behavior by distilling the model’s own pre-unlearning answers from the forget images alone. On MLLMU-Bench and ReMem, PAVA gives the strongest forget-retain trade-off among forget-set-only methods and remains competitive with retain-based baselines.

[80] LCoT-GV: Graph Attention Networks for Verifying Long Reasoning Chains in Large Language Models cs.CL | cs.AIPDF

Bérénice Jaulmes, Mehwish Alam

TL;DR: 本文提出LCoT-GV，一种基于图注意力网络的框架，用于验证大语言模型生成的长推理链。该方法将推理链表示为推理图，节点对应推理步骤，边编码语义和逻辑关系，并训练图网络来预测推理链的正确性。

Details

Motivation: 大语言模型生成的长推理链中常包含矛盾、无根据的推断或无关步骤，即使最终答案正确，这些中间步骤也可能存在错误，因此需要一种方法来验证推理链的可靠性。

Result: 在从多个问答推理基准构建的新图导向验证数据集上，该方法与最相似的方法相比具有竞争力。

Insight: 创新点在于将推理链建模为图结构，利用图注意力网络捕捉步骤间的语义和逻辑关系进行验证；客观来看，这种图表示方法为复杂推理过程的细粒度分析提供了新思路。

Abstract: Large Reasoning Models produce Long Chains-of-Thought (LCoTs) which involve breaking down the problem into smaller reasoning steps before reaching the conclusion. However, these steps often contain contradictions, unsupported inferences, or irrelevant steps, even when the final answer is correct. We propose Long Chain-of-Thought Graph Verifier (LCoT-GV), a graph-based framework that represents LCoTs as reasoning graphs. Each node in the graph represents a reasoning step and the edges encode semantic and logical relations. A Graph Attention Network is then trained to predict chain-of-thought correctness from the reasoning graph. We construct a new graph-oriented verification dataset from multiple reasoning benchmarks for question answering in various domains. The results show that our method is competitive with the most similar approaches.

[81] OCR-MetaReasoning Benchmark: Evaluating the Meta-Reasoning Ability of MLLMs in Text-Rich Image Understanding cs.CLPDF

Gengxu Li, Yuan Wu, Yi Chang

TL;DR: 本文提出了OCR-MetaReasoning基准，用于评估多模态大语言模型在文本丰富图像理解中的元推理能力。该基准将推理过程分为演绎、归纳和溯因三种类型，并分离最终答案正确性与推理过程合规性，包含1500个样本和自动评分指标。实验表明，现有模型在应用显式规则和布局敏感推理方面仍存在困难。

Details

Motivation: 现有评估方法常将文本提取与推理能力混为一谈，且很少测试模型是否遵循特定的推理方向（如应用显式规则、抽象隐藏规律或恢复缺失前提），因此需要一个新的基准来专门评估MLLMs的元推理能力。

Result: 在提出的OCR-MetaReasoning基准上测试了代表性的闭源和开源MLLMs，结果显示模型在应用显式规则和布局敏感推理方面表现不佳，且推理过程合规的模型也可能产生错误答案，表明该任务远未达到饱和。

Insight: 创新点在于构建了一个受控的单图像基准，明确区分了三种推理类型（演绎、归纳、溯因）和五种OCR对象类别，并引入了Meta-Reasoning Macro Score和Reasoning Process Compliance Score来分别评估答案正确性和推理过程合规性，为深入分析模型推理能力提供了新工具。

Abstract: Text-rich image understanding requires multimodal large language models (MLLMs) to organize OCR (Optical Character Recognition)-grounded evidence across words, layout, fields, charts, and visual correspondences. Existing evaluations often conflate extraction with reasoning and rarely test whether models follow the required reasoning direction: applying visible rules, abstracting hidden regularities, or recovering missing premises. We introduce OCR-MetaReasoning, a controlled single-image benchmark that treats deduction, induction, and abduction as distinct directions and separates final-answer correctness from reasoning-process compliance. The benchmark contains 1,500 verified samples in a balanced (3\times5) taxonomy crossing three reasoning types with five OCR-object categories, along with reference reasoning steps, automatic answer scoring, the Meta-Reasoning Macro Score (MRMS), and the Reasoning Process Compliance Score (RPCS). Experiments with representative closed-source and open-source MLLMs show that OCR-grounded meta-reasoning remains far from saturated: models struggle with visible-rule application and layout-sensitive inference, while process-compliant rationales can accompany incorrect final answers under exact-match evaluation. The code is available at https://github.com/gengxuli/OCR-MetaReasoning.

[82] GUIDE: Guiding Internal Evidence with Language Instructions cs.CLPDF

Soyeon Caren Han, Hyunsuk Chung, Jinwoo Kim, Seungyeon Ji, Kyungreem Han

TL;DR: 本文提出了GUIDE框架，旨在通过语言指令控制大型多模态模型在推理和生成过程中对内部证据的使用。该框架结合了分组参数高效适配和指令条件门控机制，以调节多模态证据通路。实验表明，GUIDE能在保持任务性能的同时，实现与指令对齐的证据依赖结构化重分布，并提升模型在针对性证据扰动下的鲁棒性。

Details

Motivation: 当前大型多模态模型虽然能遵循关于生成内容的指令，但未必能遵循关于依赖何种证据的指令，导致模型可能继续依赖与捷径相关的线索。本文旨在解决如何通过语言指令控制模型内部证据使用的问题。

Result: 在GQA、TextVQA、MM-IMDb、CREMA-D、RAVDESS和Flickr30K等多个多模态推理、分类和生成基准上的实验表明，GUIDE在保持任务行为的同时，提高了模型在针对性证据扰动下的鲁棒性，并实现了跨不同多模态场景的可控调节。

Insight: 主要创新点在于提出了一个结合分组参数高效适配与指令条件门控的框架（GUIDE），以语言指令调节多模态证据通路。同时，引入了一个通路级别的评估框架，通过依赖敏感性、受控扰动分析、通路调制和自回归解码动态来表征指令条件的证据调制，将多模态指令跟随从输出控制扩展到调节不同证据源对模型预测的贡献方式。

Abstract: Large multimodal models follow instructions about what to generate, but not necessarily about what evidence to rely on. Hence, models may continue to depend on shortcut-associated cues even when instructions suggest otherwise. We introduce GUIDE, a framework for controlling internal evidence usage through language instructions. GUIDE combines grouped parameter-efficient adaptation with instruction-conditioned gating to modulate multimodal evidence pathways during reasoning and generation. We further introduce a pathway-level evaluation framework that characterizes instruction-conditioned evidence modulation through reliance sensitivity, controlled perturbation analysis, pathway modulation, and autoregressive decoding dynamics. Across multimodal reasoning, classification, and generation, GUIDE induces structured and instruction-aligned redistribution of evidence reliance while largely preserving task behavior. Experiments on GQA, TextVQA, MM-IMDb, CREMA-D, RAVDESS, and Flickr30K show that GUIDE improves robustness under targeted evidence perturbations and enables controllable modulation across diverse multimodal settings. This suggests that multimodal instruction following can extend beyond output control toward regulating how different evidence sources contribute to model predictions.

Zheyu Huang, Zijing Shi, Haozhe Luo, Huadong Tang, Mingyu Liu

TL;DR: 本文介绍了SocialReasonBench，一个基于《底特律：变人》游戏视频构建的视频问答基准，用于评估大模型在社交情境下的推理能力。该基准利用游戏的分支叙事生成反事实情境，并包含七个推理维度的多项选择题。实验表明，现有大模型在基础社交理解上表现尚可，但在反事实和因果推理方面存在困难。

Details

Motivation: 现有视频理解基准通常依赖单一观察轨迹的视频，难以区分模型是真正理解社交动态还是仅利用了重复的叙事模式。因此，需要一个新的基准来评估模型在人类中心社交情境中的深层推理能力。

Result: 在当代大模型上的实验显示，模型在基本社交理解任务上表现合理，但在反事实推理和因果前件推理等维度上表现挣扎。进一步的消融和诊断错误分析揭示了模型对不完整模态线索的依赖以及陷入视觉捷径等推理陷阱。

Insight: 创新点在于利用交互式叙事游戏的分支剧情和已验证的游戏状态信号，构建了一个具有反事实对比和理论引导诊断干扰项的社交推理基准。这为评估模型对潜在社交状态的深层推理，而非仅对可观察事件的识别，提供了更严格的测试平台。

Abstract: Recent advances in Large Multimodal Models (LMMs) have greatly improved video understanding, yet their ability to reason about human-centered social situations remains limited. Existing benchmarks typically rely on videos with a single observed trajectory, making it difficult to determine whether models truly understand social dynamics or merely exploit recurring narrative patterns. We introduce SocialReasonBench, a video multiple-choice QA benchmark for evaluating socially grounded reasoning in scenarios derived from interactive narratives. Built from gameplay videos of Detroit: Become Human, the benchmark leverages branching storylines where player decisions lead to alternative social outcomes that can be checked against the game’s own script, flowchart, and recorded branches. We develop a multi-agent curation pipeline that localizes socially meaningful clips, grounds answer labels in game-state signals, and generates theory-guided questions with diagnostic distractors. SocialReasonBench covers seven reasoning dimensions, including intent recognition, emotional empathy, moral dilemma, counterfactual reasoning, and causal antecedent. Experiments on contemporary LMMs show that models perform reasonably well on basic social understanding but struggle with counterfactual and causal reasoning. Further ablation and diagnostic error analyses reveal that models often depend on incomplete modality cues and fall into reasoning traps such as visual shortcuts, highlighting a gap between observable event recognition and deeper reasoning over latent social states.

[84] Where Do Multilingual Vision-Language Encoders Fail on Low-Resource Languages? cs.CLPDF

Donghoon Han, SungHyun Moon, Aidyn Zhakatayev, Junghun Cha, SeungJae Lee

TL;DR: 本文研究了多模态视觉-语言编码器在低资源语言（LRL）上表现不佳的原因，发现性能差距并非源于输出层的线性语言偏差，而是编码器前向路径中EOS隐藏状态随深度变化的语言特异性轨迹。通过将LRL的EOS替换为平行英语值或训练时引入前层主干网络，可显著提升LRL检索性能，同时保持高资源语言性能。

Details

Motivation: 当前多模态视觉-语言编码器在低资源语言上的检索性能显著落后于高资源语言（差距达30个百分点以上），本文旨在探究这种性能差距在训练后编码器中的具体来源。

Result: 在XM3600基准的1,000图像子集上，通过EOS替换策略将斯瓦希里语检索准确率从22.1%提升至69.1%；训练时引入前层主干网络使LRL在XM3600检索上提升9.6/17.1个百分点，且在四个基准测试中均取得一致增益，同时保持高资源语言性能不变。

Insight: 创新点在于揭示了多模态编码器中语言性能差距的关键因果因素——EOS隐藏状态的深度依赖轨迹分歧，而非传统认为的线性分类器偏差；提出的EOS替换和训练时前层主干网络是轻量有效的干预方法，为改进多语言对齐提供了新方向。

Abstract: Recent multilingual vision–language encoders cover hundreds of languages in a single model, yet on two state-of-the-art instances retrieval on low-resource languages (LRL; e.g. Swahili) trails high-resource ones (HRL; e.g. English) by $30^+$,pp. We ask where in the trained encoder this gap is located. Prior modality-gap and cross-lingual subspace work suggests a linear language direction at the output crowds out alignment-relevant geometry. We falsify this: LEACE drives the linear language classifier from $>99%$ to near chance and iterated INLP to $37$–$50%$ while LRL retrieval moves within $\pm 1.5$,pp and all tier means within $2.2$,pp, tracking random controls. The linear bias is a \emph{symptom}, not the cause. Instead, the alignment-causal factor lies along the encoder’s forward path: the EOS (end-of-sequence) hidden state’s per-language trajectory diverges with depth. Substituting the EOS with its parallel English value three blocks before the projector lifts Swahili from $22.1%$ to $69.1%$ on one encoder (and reproduces on the other); three controls rule out pooled-position tautology and English specificity. A front-layer trunk that pulls each language’s projection toward the parallel-content centroid corroborates the diagnosis at training time, recovering $+9.6$ / $+17.1$,pp on LRL XM3600 retrieval (1{,}000-image subset), with consistent gains across three further benchmarks while preserving HRL performance.

[85] Error-Type-Aware Loss Reweighting for Robust Named Entity Recognition with Noisy LLM Labels cs.CLPDF

Elena Merdjanovska, Jonas Golde, Alan Akbik

TL;DR: 本文提出了一种针对大语言模型标注噪声的鲁棒命名实体识别方法。研究发现，现有噪声鲁棒损失函数无法有效处理NER任务中异质性的标注噪声，因此提出了一种基于错误类型感知的损失重加权策略，为不同类型的潜在错误标记引入独立的加权规则。该方法简单高效，无需额外训练资源，在多个噪声水平下显著提升了模型性能。

Details

Motivation: 动机在于解决使用大语言模型自动标注数据训练NER模型时，忽视其引入的异质性标注噪声（如缺失提及和类型错误）导致模型性能下降的问题。现有噪声鲁棒损失函数对所有噪声标记一视同仁，无法适应NER任务中不同类型错误对训练信号的不同影响。

Result: 在噪声水平为15%至40%的数据集上，该方法平均提升了0.8至2.0个百分点的F1分数。在Wikigold数据集上，当噪声为24.1%时，取得了最大4.6个百分点的性能提升。

Insight: 核心创新点在于认识到NER任务中LLM标注噪声的异质性，并据此设计了错误类型感知的损失重加权机制。从客观角度看，将噪声分类处理而非统一对待，是提升噪声鲁棒性的一个有效且实用的思路，其方法简单、无需额外资源的特点具有很好的可借鉴性。

Abstract: Large language models are increasingly used to annotate datasets for training smaller, task-specialized models such as named entity recognition. While this method yields effective models, it assumes that the synthetic dataset is correctly annotated. In this work, we find that (i) current fine-tuning processes simply ignore LLM-introduced annotation noise, resulting in degraded performance and (ii) existing noise-robust losses are not transferable to sequence labeling because annotation noise in named entity recognition is heterogeneous: for example, missing mentions and type errors affect the training signal in different ways. Treating all noisy tokens equally in noise-robust losses and applying a single reweighing criterion for all may therefore remove useful supervision or reinforce incorrect labels. To address this limitation, we propose error-type-aware loss reweighting for NER, which introduces separate reweighing rules for different types of potentially erroneous tokens. Our approach is simple and efficient, does not require additional training resources, and improves F1 by 0.8 - 2.0 percentage points on dataset-level average for noise levels between 15% and 40%, with a maximum improvement of 4.6 percentage points with 24.1% noise on Wikigold.

Yuzhe Ding, Kang He, Li Zheng, Shengwu Zheng, Teng Shi

TL;DR: 本文介绍了MMDS-Bench，一个用于评估多模态大语言模型在社交媒体互动中动态立场分类能力的基准数据集。该数据集包含3,482个多模态实例，标注了七类动态立场标签，并包含一个800实例的诊断子集，要求模型进行结构化推理。研究评估了12个开源和闭源MLLM模型，发现它们在多模态动态立场理解方面仍存在困难，尤其是在需要超越单独理解父消息和回复的关系推理时。

Details

Motivation: 现有动态立场分类研究主要集中于纯文本设置，而社交媒体互动日益依赖图像、表情包和跨模态引用，缺乏针对多模态动态立场分类的评估基准，因此需要构建一个诊断性基准来填补这一空白。

Result: 在MMDS-Bench上评估的12个MLLM模型表现不佳，特别是在需要结构化推理（如父消息理解、回复理解和立场关系推断）的诊断子集上，当前模型难以处理超越单独理解的关系推理任务。

Insight: 创新点包括引入多模态动态立场分类基准MMDS-Bench，提出基于七标签分类法和五类挑战因素（如多模态融合、非字面表达）的标注框架，以及采用参考接地的LLM评判协议来评估推理质量，为多模态社交互动理解提供了系统化的评估工具。

Abstract: Dynamic stance classification models how a reply responds to its direct parent message, rather than how a post relates to a fixed topic. Existing work has mainly studied this problem in text-only settings, while social media interactions increasingly rely on images, screenshots, memes, reaction images, and cross-modal references. We introduce MMDS-Bench, a diagnostic benchmark for multimodal dynamic stance classification in social media parent-reply interactions. MMDS-Bench contains 3,482 multimodal instances annotated with a seven-label dynamic stance taxonomy, together with an 800-instance diagnostic subset that requires structured reasoning over parent understanding, reply understanding, and stance-relation inference. We further annotate each instance with five challenge factors covering multimodal fusion, parent framing, non-literal expression, interaction reasoning, and label-boundary ambiguity. We evaluate 12 closed-source and open-source multimodal large language models and propose a reference-grounded LLM-judge protocol for assessing reasoning quality. Results show that current MLLMs still struggle with multimodal dynamic stance understanding, especially in cases that require relational inference beyond separate parent and reply comprehension.

[87] TRIPPULSE: Multi-Agent Travel Planning with Review-Grounded Reasoning cs.CLPDF

Priyanshu Karmakar, Borru Vijay Sai, Shubhojit Mallick, Abhik Jana, Shreya Ghosh

TL;DR: 本文提出了TRIPPULSE，一个基于多智能体框架的旅行行程生成系统。该系统通过分解行程规划任务为住宿、交通、餐饮、景点和活动等专业智能体，并由一个全局协调器进行调度，以整合来自真实世界评论的体验性信息，从而生成更个性化、更符合用户真实体验的行程。

Details

Motivation: 现有基于大语言模型（LLM）的行程规划器主要依赖结构化属性和预定义的旅行者画像，但真实的旅行决策往往受到评论中关于舒适度、安全性、服务质量等体验性因素的影响，这些信息在结构化数据库中通常缺失。因此，需要一种方法来整合评论信息，以生成更真实、以用户为中心的行程。

Result: 实验在多种行程时长以及多样化的专有和开源模型上进行。结果表明，TRIPPULSE在保持强约束满足（如时间和预算可行性）的同时，能生成更个性化、更基于真实体验的行程。

Insight: 主要创新点包括：1）采用多智能体架构分解复杂规划任务，缓解单一规划器的上下文和推理瓶颈；2）提出并整合了Review-Grounded Persona Alignment（RGPA）评估指标，这是一个基于LLM-as-a-Judge的度量，用于评估行程与以人为中心的旅行体验的对齐程度；3）利用大规模真实世界评论数据（超过10万条）来增强行程规划的体验基础。

Abstract: Travel itinerary generation requires balancing strict spatio-temporal constraints with human preferences. Existing LLM-based planners mainly rely on structured attributes and pre- defined traveler personas, but real travel deci- sions are often shaped by reviews that reveal experiential factors such as comfort, safety, ser- vice quality, ambiance, crowding, and hidden risks absent from structured databases. Incor- porating such review information is therefore critical to realistic, user-centric itinerary gen- eration. We propose TRIPPULSE1, a multi- agent framework for review-grounded travel planning. Instead of relying on a monolithic planner (and face context and reasoning bot- tlenecks), TRIPPULSE2 decomposes itinerary generation into specialized agents (each op- erating over localized contexts) for accom- modations, transportation, meals, attractions, and events, coordinated through a global or- chestrator with scheduling mechanisms that enforce temporal and budget feasibility. We augment TRIPCRAFT with 100K+ real-world reviews and introduce Review-Grounded Per- sona Alignment (RGPA), an LLM-as-a-Judge metric for evaluating alignment with human- centric travel experiences. Experiments across multiple trip durations and diverse proprietary and open-source models show that TRIPPULSE maintains strong constraint satisfaction while generating more personalized and experien- tially grounded itineraries.

[88] Annotated Surrogate Retrieval for Polish Statutory Law cs.CLPDF

Orkun Yiğit Cengiz

TL;DR: 本文提出了一种基于文档代理的波兰成文法检索方法体系，包含ASCR、ASCR-H和DTF三种设计，在成本-质量权衡上各有侧重。通过在82,508条法律条文上构建语言模型标注的代理，并在包含300道波兰律师资格考试题目的基准上评估，ASCR-H在排名第一的准确率上显著优于多数基线方法，达到72.3%，但DTF在延迟和成本上更具优势。

Details

Motivation: 解决波兰成文法检索中传统检索方法（如BM25和稠密检索）在准确率与效率上的局限，通过引入索引时附加语言模型标注的文档代理来提升检索性能。

Result: 在包含300道2024-2025年波兰律师资格考试的基准测试中，ASCR-H在排名第一的准确率上达到72.3%，显著优于BM25（61.7%）和稠密检索（52.3%），但在深度检索中优势减弱；DTF在延迟（降低至九分之一）和成本（降低一半以上）上表现更优，在排名二十的准确率估计值上达到86.0%。

Insight: 创新点在于提出文档代理（语言模型标注）作为检索基础，并通过级联、融合和确定性重排序等设计平衡质量与成本；重排序阶段对排名第一准确率的贡献达27.6个百分点，但代理标注仅覆盖27.0%的语料库却包含全部基准参考条文，揭示了数据不对称性。

Abstract: We present a family of retrieval methods for Polish statutory law built on document surrogates: language-model annotations attached to statutory articles at index time. Three designs occupy different points on the cost-quality frontier. ASCR is a surrogate cascade with reranking; ASCR-H fuses a dense list into that cascade; and DTF replaces both language-model stages with three lexical and dense retrievers, weighted reciprocal rank fusion, and a deterministic re-scoring prior, using no model call before generation. We evaluate all three against fourteen lexical, dense, fused and ablated baselines plus four controls, on 300 questions from the 2024 and 2025 Polish bar and legal counsel entrance examinations (264 with their reference article in the corpus), over 82,508 articles from 1,133 acts. On paired McNemar tests, ASCR-H places the reference provision at rank one significantly more often than every other non-oracle configuration except one of its own ablations (eighteen of twenty comparisons significant in its favour at p < 0.005), reaching 72.3% against 61.7% for BM25 and 52.3% for dense retrieval. The advantage is concentrated at the head and does not survive depth: it is significant at cutoffs of one and five, disappears by ten, and by twenty DTF leads on point estimate (86.0% versus 84.5%) at one ninth the latency and less than half the cost. Ablation attributes 27.6 points of rank-one accuracy to the reranking stage alone. We further report that the ranking advantage does not extend to citation accuracy, where DTF matches the oracle ceiling, and three negative results on lemmatisation, pseudo-relevance feedback and query rewriting. Surrogate annotation covers 27.0% of the corpus but every reference provision in the benchmark, an asymmetry we disclose and discuss. Benchmark, per-question outputs and paired significance tests are publicly available.

[89] CogEvol: Towards Efficient and Reliable Learning Environment Generation cs.CL | cs.AIPDF

Shangqing Tu, Daniel Zhang-Li, Yucheng Wang, Shiyu Gan, Yanpeng Wang

TL;DR: CogEvol是一个专门用于学习环境生成的模型系列，能够将课程大纲一次性转换为结构化的JSON幻灯片或独立的交互式HTML页面。该模型通过基于生产数据的监督微调和结合规则与视觉语言模型的强化学习，实现了高效率和可靠性，显著减少了生成时间。

Details

Motivation: 解决传统多轮代理框架生成学习材料耗时过长、可靠性难以保证的问题，旨在为大规模AI原生教育提供高效、可靠且成本更低的解决方案。

Result: 在22万次生产请求中，CogEvol-27B生成一张幻灯片的中位时间为17秒，生成交互式页面为59秒；在幻灯片质量上得分为83.7，在500个案例的交互式HTML基准测试中得分为63.7，参数量比主流编码模型少26.9倍。

Insight: 创新点包括：基于真实失败案例构建的监督微调数据管道，以及结合规则与视觉语言模型的混合奖励机制用于强化学习，有效防止了奖励欺骗；同时，模型支持在国产昇腾加速器上运行，实现了与A800 GPU的应用级性能对等，降低了大规模部署成本。

Abstract: We present CogEvol, a family of models trained specifically for Learning Environment Generation: turning a course brief into a finished learning artifact (structured-JSON slides or self-contained interactive HTML pages) in a single pass. Across 220k production requests, CogEvol completes a slide in a median of 17 seconds and an interactive page in 59, replacing minutes-long multi-turn agent scaffolding. Reliability is enforced rather than hoped for: a production-grounded data pipeline turns real failures into 53,687 verified SFT samples, and a hybrid rule-plus-VLM reward drives GRPO-based RL, hardened after we caught and fixed a reward-hacking episode that produced visually convincing but unplayable games. CogEvol-27B scores 83.7 on slide quality and 63.7 on a 500-case interactive-HTML benchmark with 26.9x fewer parameters than flagship coding models, and, in collaboration with the OpenMAIC team, serves their live production traffic. CogEvol-4B is released openly under the Apache 2.0 license at https://github.com/CogEvol/CogEvol-4B; external flagships are measured on the same suites under the identical harness. Scaffold editing cuts interactive-page generation cost by a further ~76%, and the full stack runs on domestic Ascend accelerators at application-level parity with A800 GPUs, lowering the unit cost of AI-native education at scale.

[90] Evaluating and Improving LLM Self-Modeling cs.CL | cs.AIPDF

Siqi Zeng, Andre N. Assis, Rowan Wang

TL;DR: 本文研究了大语言模型（LLM）的自我建模能力，即模型回答关于其自身行为问题的能力。作者创建了一个基准来测试多种类型的自我建模问题，发现现有模型具备一定但有限的能力，并在简单的反事实问题上犯系统性错误。为了提升该能力，作者开发了一个可扩展的合成数据管道来生成训练数据，并通过强化学习在三个开源模型家族上提升了整体自我建模技能，但改进可能并非源于对模型内部决策过程的特权访问。

Details

Motivation: 研究动机是评估和改进大语言模型回答关于其自身行为问题的能力，特别是针对可验证的行为问题，例如提示编辑是否会改变模型的最终答案。

Result: 实验结果表明，当前模型在作者引入的基准测试中表现出非平凡但有限的自我建模技能，在简单反事实问题上犯系统性错误。通过强化学习训练，在三个开源模型家族上提升了整体自我建模能力，并显示出一定的任务迁移性。

Insight: 论文的创新点在于提出了一个专门用于评估LLM自我建模能力的基准，并开发了一个可扩展的合成数据生成管道来训练此能力。一个关键的客观见解是，通过强化学习获得的自我建模能力提升，可能并非源于模型真正的内省或对其内部决策过程的特权访问，这揭示了当前LLM自我认知的局限性。

Abstract: We study self-modeling: an LLM’s ability to answer questions about its own behavior. We focus on verifiable behavioral questions, such as whether a prompt edit would change the model’s final answer. To measure this capability, we introduce a benchmark that tests diverse types of self-modeling questions. Current models show non-trivial but limited self-modeling skill, and make systematic mistakes on simple counterfactual questions about their own behavior. To improve self-modeling skill, we develop a scalable synthetic-data pipeline that produces self-modeling training data, and show that reinforcement-learning can improve aggregate self-modeling skill across three open-source model families with some transfer to held-out tasks. These gains, however, do not seem to constitute introspection consistently: improved self-modeling may not arise from privileged access to the model’s internal decision process.

[91] Evidence-Bounded Mental Health Reasoning from Heterogeneous Speech Protocols cs.CLPDF

Chengyuan Gao, Jiang Wu, Tao Lu, Jiayan Guo, Mingkun Xu

TL;DR: 本文提出了一种基于证据边界约束的多模态心理健康筛查方法，旨在解决现有模型在处理异质临床语音协议时忽视证据有效性的问题。作者引入了证据包基准测试集，并提出了EviBound框架，通过协议感知的证据控制来限制推理范围，确保模型仅基于有效证据进行判断，从而避免幻觉和过度声称。

Details

Motivation: 现有心理健康筛查模型通常假设所有临床语音协议具有相同的证据有效性，但现实中不同协议（如自由访谈与固定阅读任务）提供的证据性质不同，导致模型可能从无关文本中幻觉症状或过度声称支持。

Result: 在证据包基准测试集上，EviBound在抑郁症筛查的留出测试中取得了0.8658的AUROC，比最强的直接全模态基线提高了0.0811 AUROC，同时保持了零声称违规。

Insight: 创新点在于将多模态筛查重新定义为证据边界约束的推理问题，并提出了协议感知的证据控制框架，通过规划器限制推理范围、五路声学共识协调证据工具以及边界批评器抑制无支持声称，实现了更安全、证据一致的临床NLP系统。

Abstract: Computational mental health screening using multimodal speech and text has shown great promise. However, existing models often assume all clinical speech protocols carry equivalent evidentiary validity. In reality, heterogeneous protocols, from free interviews to fixed reading tasks, support fundamentally different evidence. Forcing uniform reasoning flattens these boundaries, causing models to hallucinate symptoms from irrelevant text or overclaim support. Even advanced long chain-of-thought LLMs fail to resolve this issue, as free-form reasoning can exacerbate boundary violations. To address this, we reformulate multimodal screening as an evidence-bounded reasoning problem. We introduce the Evidence Package Benchmark, integrating 1,870 packages across six heterogeneous sources with explicit modality masks and evidence permissions. We further propose EviBound, a protocol-aware evidence control framework. Unlike direct LLM prompting, EviBound uses a profile-aware planner to restrict reasoning scope, orchestrates evidence tools via five-way acoustic consensus, and enforces a boundary critic to suppress unsupported claims. Empirical results show EviBound achieves a held-out test Depression AUROC of 0.8658, exceeding the strongest direct omni-modal baseline by +0.0811 AUROC while maintaining zero claim violations. Our work moves beyond unconstrained accuracy toward evidence-consistent, protocol-aware systems for safer clinical NLP research.

[92] When Does Predictor-Based RL Align with Human Perception? A Study of Subjective Rewards in Codec-Based Speech Language Models cs.CL | cs.SD | eess.ASPDF

Joonyong Park, Jerry Li

TL;DR: 本文研究了在基于编解码器的语音语言模型中，使用学习到的感知预测器作为强化学习奖励时，如何保持与人类感知的一致性。通过引入字符错误率（CER）区域约束，比较了组相对策略优化（GRPO）和最佳N重排序（Best-of-N）方法在多个主观奖励（如动漫风格、自然度、喜好度和唤醒度）下的表现。

Details

Motivation: 动机在于探究基于编解码器的文本到语音（TTS）模型中，学习到的感知预测器何时能作为强化学习奖励而不失与人类听众的对齐，以解决主观奖励在优化过程中可能因转录漂移而失效的问题。

Result: 实验表明，每个主观奖励主要提升其自身目标指标，且奖励间不可互换；多评分者A/B测试显示人类转移效果不均，奖励差距分析能预测听众选择，而最佳8重排序（Best-of-8）在感知上与GRPO相当，可作为人类水平基线。

Insight: 创新点包括引入CER区域约束以防止转录漂移，并提出将主观语音奖励分析为预测器-轴-基元组，为多奖励语音后训练前的奖励选择提供了实用诊断方法，强调GRPO应视为将奖励选择行为摊销到策略中，而非普遍优于重排序。

Abstract: Codec-based text-to-speech (TTS) models make language-model post-training applicable to speech generation, but it remains unclear when learned perceptual predictors can serve as reinforcement learning rewards without losing alignment with human listeners. We study this question with Group Relative Policy Optimization (GRPO) using learned rewards for anime-like speaking style, naturalness, likability, and arousal. To prevent perceptual rewards from being optimized through transcript drift, we introduce a character error rate (CER) zone constraint and compare policy optimization with Best-of-$N$ reranking under the same reward gate. Across single-reward runs, each reward primarily improves its own target metric, showing that subjective predictors are not interchangeable quality surrogates. Multi-rater A/B tests further show uneven human transfer, while a reward-gap analysis separates average transfer from within-axis calibration: signed reward gaps significantly predict listener choices in the pooled analysis, whereas residual CER gaps do not, but per-axis calibration remains heterogeneous. Best-of-8 is a strong human-level baseline and is not clearly worse than GRPO perceptually, suggesting that GRPO should be viewed as amortizing reward-selected behavior into the policy rather than uniformly outperforming reranking. These results support analyzing subjective speech rewards as predictor-axis-base tuples and provide practical diagnostics for selecting rewards before multi-reward speech post-training.

[93] Improving Information Extraction with Learned Queries cs.CLPDF

Omar Sharif, Soroush Vosoughi, Nikhil Singh

TL;DR: 本文提出通过优化信息提取中的查询设计来提升性能，而非仅改进模型本身。作者引入了List of Questions (LoQ)生成文档特定问题集，以及FeedQ反馈驱动优化方法迭代改进问题。实验表明，优化问题设计在四个临床基准和五个大语言模型上带来18.6 F1分数的提升，甚至超过使用更大提取模型的效果。

Details

Motivation: 传统信息提取研究通常聚焦于改进模型规模或推理能力，但本文指出查询设计同样关键，失败的信息提取往往源于问题表述不佳，因此将查询优化视为首要问题来解决。

Result: 在四个临床基准测试和五个大语言模型上，仅优化问题设计就实现了18.6 F1分数的性能提升，超过使用更大提取模型的效果。经过微调的4B参数模型匹配或超越了专家设计的基线，并大幅超过未调优的更大模型。

Insight: 创新点在于将查询设计作为信息提取的核心问题，提出了LoQ和FeedQ方法实现可学习的查询优化。客观来看，这挑战了仅依赖模型改进的主流思路，为轻量级模型实现高性能提供了新途径，并发布了12,820个优化问题数据集推动该方向研究。

Abstract: When information extraction fails, a natural instinct is to improve the model doing it: for example, by scaling it up or refining its reasoning. In this paper, we show that another part of the pipeline matters at least as much: the queries used to elicit this information. Across four clinical benchmarks and five LLMs, improving the question design alone raises performance by 18.6 F1-score points, i.e. more than using larger extraction models. To make such question design learnable, we introduce List of Questions (LoQ), which generates document-specific question sets, and FeedQ, a feedback-driven optimization method that iteratively refines questions against extraction outcomes. The resulting optimized questions can be used to train lightweight generators: with fine-tuning, 4B-parameter models match or outperform expert-derived baselines and substantially exceed the performance of much larger untuned models. We release a dataset of 12,820 optimized questions to support a broader shift in information extraction research toward treating question design as a first-class problem.

[94] Every Token Leaves a Ripple in the Stream of Thought: Eliciting Model-Internal Token Saliency for Chain-of-Thought Compression cs.CLPDF

Tianyi Zhao, Yinhan He, Wendy Zheng, Chen Chen

TL;DR: 本文提出了一种名为MIST（Model-Internal Saliency for Token-level CoT compression）的方法，用于压缩思维链（CoT）推理过程。该方法从模型内部视角出发，通过评估每个推理token在残差流（stream of thought）中对答案计算的贡献程度（必要性和充分性），来定义其重要性并进行剪枝，从而降低推理成本。

Details

Motivation: 思维链推理虽然提升了多步问题解决能力，但冗长的推理过程增加了推理成本。现有的token级压缩方法多依赖外部评分器或启发式信号，这些信号与模型内部答案计算过程关联不直接。本文旨在从模型内部视角直接衡量推理token的重要性。

Result: 在四个推理基准测试和四个模型上的实验表明，MIST方法在压缩思维链方面持续优于基线方法，证明了模型内部显著性可以作为推理token重要性的有效代理。

Insight: 创新点在于从模型内部视角（残差流）定义token重要性，提出了结合必要性（移除贡献导致答案似然下降）和充分性（仅提供贡献导致答案似然增益）的统一评分机制。这为理解模型内部计算和高效压缩推理过程提供了新思路。

Abstract: Chain-of-thought (CoT) reasoning improves multi-step problem solving, but long reasoning traces inflate inference cost. Token-level CoT compression reduces this cost by pruning full reasoning chains into shorter traces for model adaptation, making token selection the central challenge. Existing methods often rely on external scorers or heuristic signals only indirectly tied to the model’s internal answer computation. We instead adopt a model-internal perspective: as the model forms an answer, each reasoning token leaves a ripple in the residual stream, the model’s \emph{stream of thought}, and the magnitude of this ripple reflects the token’s contribution to the answer computation. Building on this view, we propose \textsc{MIST} (Model-Internal Saliency for Token-level CoT compression), which defines token importance along two complementary axes: \emph{necessity}, the drop in answer likelihood when a token’s internal contribution is removed, and \emph{sufficiency}, the gain in answer likelihood when that contribution alone is provided. Combining the two yields a unified importance score for pruning. Across four reasoning benchmarks and four models, \textsc{MIST} consistently outperforms baseline methods, suggesting that model-internal saliency provides an effective proxy for reasoning-token importance.

[95] Learning to Evaluate Before Improving: Automatic Rubric Induction for Automatic Research Agents cs.CL | cs.AI | cs.IR | cs.LG | cs.MA | cs.SEPDF

Xuehai Wang, Haowei Qin, Tongxin Liu, Junkai Li, Buqiang Xu

TL;DR: 本文提出AutoSciRub框架，一种“先评估后改进”的方法，用于自动科学研究代理。该框架通过在执行研究任务前，自动归纳出特定任务的可执行评估准则（rubric），以指导研究执行、标准级验证和迭代修订，从而解决开放研究任务中分析、方法和成功标准不明确的问题。

Details

Motivation: 解决自主科学研究代理在开放研究任务中，因任务要求不明确而可能遗漏重要分析、使用不当方法或得出证据不足结论的问题。

Result: 在ResearchClawBench基准上，AutoSciRub显著提升了所有测试配置的性能，在固定Codex框架下平均提升2.08分，在固定DeepSeek-V4-Flash骨干模型下平均提升2.95分。在AstaBench E2E Discovery的20个任务子集上，平均提升16.8分，同时保持或增加了成功完成的任务数量。

Insight: 核心创新在于“先评估后执行”的范式，通过将模糊指令分解为原子科学目标、基于文献和数据生成具体可验证的准则，使隐含的实验和证据要求显式化，为研究代理提供了有效的、可泛化的控制机制。

Abstract: Autonomous scientific research agents are increasingly applied to end-to-end scientific workflows, including literature review, data analysis, experimentation, and report generation. However, open-ended research tasks often do not clearly specify the analyses, methods, and success criteria required to complete the task. As a result, agents may miss important analyses, use inappropriate methods, or draw conclusions that are insufficiently supported by evidence. To address the problem, we present AutoSciRub, an evaluation-first framework that induces a task-specific executable rubric before research execution, and uses it to guide execution, criterion-level verification as well as iterative revision. AutoSciRub decomposes an underspecified instruction into atomic scientific goals, grounds them in relevant literature and task-visible data, and synthesizes specific, actionable, and verifiable criteria. The resulting rubric makes implicit experimental and evidential requirements explicit, providing guidance for experiments and analyses. During revision, rubric-guided verification identifies unmet criteria and enables targeted refinement of the research report and its supporting artifacts. On ResearchClawBench, AutoSciRub consistently improves all tested configurations, with an average gain of 2.08 points across three backbone LLMs under the fixed Codex harness and 2.95 points across three agent harnesses using a fixed DeepSeek-V4-Flash backbone. On a randomly sampled 20-task subset of AstaBench E2E Discovery, AutoSciRub further achieves an average improvement of 16.8 points across three agent harnesses, while maintaining or increasing the number of successfully completed tasks. These results demonstrate that evaluation-first guidance provides an effective and generalizable control mechanism for autonomous scientific research (Code: https://github.com/zjunlp/AutoSciRub).

[96] PaperGym: Rubric-Centered Evolution for Research-Plan Generation cs.CLPDF

Yuhan Wang, Zhengxi Lu, Yuchen Yan, Kaitao Song, Wenqi Zhang

TL;DR: 本文提出了PaperGym框架，将科研论文转化为完整的训练环境，用于生成研究计划。该框架利用论文结构，从研究目标和背景合成问题，从方法和实验推导评估标准，有效避免了标准泄露问题。通过结合OPSD自教师模型和GRPO强化学习，在多个模型规模上显著超越了监督微调等基线方法。

Details

Motivation: 研究规划是AI科学家的关键能力，但研究计划没有可验证的答案，导致强化学习缺乏所需的环境（任务与评估者）。现有方法从相同内容提取问题和标准，存在通过改写即可获得奖励的问题。

Result: 在Qwen3-1.7B/4B/8B模型上，该方法在五个基准测试上的平均得分分别提升了+5.6、+5.0和+4.8分，优于监督微调等方法。在固定训练方案下，基于PaperGym-20k训练的模型在三方比较中胜率为58.1%，显著高于RubricHub Science的28.2%。训练后的Qwen3-8B在ResearchQA上达到73.48分，超过了更大的Kimi K2.6模型。

Insight: 创新点在于利用论文的固有结构（目标/背景 vs. 方法/实验）来分离问题生成与评估标准，将标准泄露率大幅降低至3.7%。训练流程的创新在于分两阶段使用评估标准：先作为OPSD自教师模型的特权上下文，再作为GRPO的奖励信号，这种顺序是关键。

Abstract: Research planning is the decisive capability of AI scientists. Yet a research plan admits no verifiable answer, so reinforcement learning lacks the environment it requires: tasks paired with a critic. Rubrics extracted from scientific papers can supply the critic. Existing pipelines, however, draw the question and the criteria from the same content, so the reward can be earned by paraphrase. The rubric is further compressed into a single scalar per rollout. We introduce PaperGym, a unified framework that turns each research paper into a complete training environment. PaperGym exploits the structure of a paper: the question is synthesized from the research goal and background, while the criteria are derived from the method and experiments. The criteria span methodological innovation and experimental design, and criterion leakage falls to 3.7%, versus 11.90% to 34.10% in existing datasets. Training uses the rubric twice: first as privileged context for OPSD’s self-teacher, then as the reward for GRPO. Across Qwen3-1.7B/4B/8B, this schedule outperforms supervised fine-tuning, either stage alone, and the reverse ordering, improving five-benchmark averages by +5.6, +5.0, and +4.8 points. With the recipe held fixed, models trained on PaperGym-20k win 58.1% of three-way comparisons, against 28.2% for RubricHub Science. The trained Qwen3-8B reaches 73.48 on ResearchQA, above the far larger Kimi K2.6. We release the pipeline, the 20,000-instance corpus PaperGym-20k, and the benchmarks PaperGym-Innov and PaperGym-Design.

cs.CV [Back]

[97] Improving Spatial-Temporal Reasoning in Video-Language Models with Structured Video Prompting cs.CVPDF

Sadegh Mohammadian

TL;DR: 本文提出了一种名为结构化视频提示的训练无关推理时方法，通过为输入视频添加轻量级的空间结构和时间结构，为跨时空组织证据提供显式锚点，从而改善视频语言模型在时空推理任务上的性能。该方法无需修改模型权重或解码过程，也不改变问题提示，在两个互补的视频基准和两个开放视频语言模型上进行了评估。

Details

Motivation: 视频语言模型在需要随时间跟踪事件并将答案定位到特定空间区域的任务上表现脆弱，作者认为部分限制源于推理时视觉证据的组织方式不佳。

Result: 在多个设置下，结构化输入在多种情况下提升了性能，具体增益因模型和任务而异。

Insight: 创新点在于提出了一种无需训练、仅通过推理时结构化组织视频证据来提升模型时空推理能力的方法，揭示了模型失败的部分原因可能源于推理时证据的呈现方式，而非仅仅是推理能力不足。

Abstract: Video-language models (VLMs) remain brittle on tasks that require tracking events over time and grounding answers in specific spatial regions. We propose that part of this limitation can be addressed through better organization of visual evidence at inference time. We introduce structured video prompting, a training-free inference-time method that augments the input video with lightweight spatial structure and temporal structure, providing explicit anchors for organizing evidence across space and time without changing model weights or decoding and without altering the question prompt in the main comparison. We evaluate this approach on two complementary video benchmarks and two open video-language models. Across these settings, structured inputs improve performance in several cases, with gains varying by model and task. Our findings suggest that some failures of VLMs arise not only from reasoning capacity, but also from how video evidence is presented at inference time. These results highlight structured video prompting as a simple and practical direction for improving video understanding.

[98] Memory-Efficient Training-Free Acceleration of Diffusion Transformers with BaryCache cs.CVPDF

Chengjie Lu, Tianchi Deng, Zhengqi He, Zhijian Gao, Huisi Wu

TL;DR: 本文提出了一种无需训练、基于重心外推的加速方法BaryCache，用于减少扩散变换器（DiT）在图像和视频生成中的采样计算开销。该方法通过步进预测来避免重复计算，在保持感知质量的同时显著降低内存占用，并实现高达3.30倍的端到端采样加速。

Details

Motivation: 扩散变换器在生成高保真图像和视频时，其迭代采样过程计算成本高昂，现有基于缓存的加速方法虽减少冗余计算，但会增加VRAM占用，从而限制推理批次大小。

Result: 在图像和视频生成的大量实验中，该方法在内存使用和感知质量之间取得了良好平衡，相比基线DiT推理实现了最高3.30倍的端到端采样加速。

Insight: 创新点在于引入数值稳定的重心外推预测器，避免了类似龙格现象的前向预测振荡伪影，提供了一种无需训练、内存高效的采样加速方案。

Abstract: Diffusion Transformers achieve high-fidelity image and video generation, but their iterative sampling remains expensive, for each denoising step requires large matrix operations. Existing cache-based acceleration reduces redundant computation yet increases the VRAM footprint by storing intermediate states, which can directly constrain inference batch size. In this work, we propose a training-free acceleration method that performs stepwise forecasting for DiT sampling using a Barycentric Extrapolator. By leveraging barycentric extrapolation, our predictor is numerically stable and alleviates oscillatory artifacts analogous to the Runge phenomenon during forward forecasting. Across extensive experiments on both image and video generation, our approach provides a favorable trade-off between memory usage and perceptual quality, while delivering up to 3.30x end-to-end sampling speedup compared with baseline DiT inference.

[99] MIRAGE-CAD: Construction-Mediated Multimodal Generation of Executable CAD Programs cs.CV | cs.PL | cs.SEPDF

Jizong Zhan

TL;DR: MIRAGE-CAD是一个多模态系统，能够从自然语言描述、渲染图像、点云或STEP/B-Rep几何体等多种输入中，生成可执行的参数化CAD程序。它通过一个显式的构造计划接口进行中介，将输入映射到共享的构造表示，并最终生成由OpenCASCADE内核执行的Python CAD代码以构建实体。

Details

Motivation: 从观察到的物体恢复可执行的参数化CAD程序存在根本性的模糊性，因为相同的最终几何体可能源于不同的构造过程。本研究旨在解决从多种模态输入中生成有效CAD程序的问题。

Result: 在每种模态2500个保留查询上，系统在不进行检索推理的情况下，实现了55.4-70.0%的构建成功率和52.3-66.2%的STEP文件导出成功率。对比实验表明，强重建能力不依赖于将构造表示表达为文本。

Insight: 核心创新在于引入了显式的、可读的构造计划作为中介表示，这不仅有助于程序生成，还提供了一个可单独度量的中间层，其与参考构造的一致性能够有效预测下游执行成功率。研究还强调了可执行有效性、几何保真度和参数响应性这三个评估维度可能显著分离，应分开评估。

Abstract: Recovering an executable parametric CAD program from an observed object is fundamentally ambiguous, because the same final geometry can result from different construction procedures. We study this problem from four types of input: natural-language descriptions, rendered images, point clouds, and STEP/B-Rep geometry. MIRAGE-CAD maps each input to a shared construction representation and mediates program generation through an explicit construction-plan interface. The resulting Python CAD code is executed by an OpenCASCADE kernel to build the solid and export it as STEP. On 2,500 held-out queries per modality, the system achieves 55.4-70.0% build success and 52.3-66.2% STEP export success without retrieval at inference. Controlled comparisons show that strong reconstruction does not depend on expressing the construction representation as text: a decoder conditioned directly on the continuous representation also reconstructs strongly, while an exposure-matched plan-based decoder shows no detected material loss in per-part geometric fidelity. The explicit plan instead provides a readable and separately measurable intermediate representation whose agreement with the reference construction is informative about downstream execution success. Finally, we show that executable validity, geometric fidelity, and parametric responsiveness can diverge substantially and should therefore be evaluated separately.

[100] FrameScope: Temporal Data Valuation for Stream Active Learning in Autonomous Vehicle Systems cs.CV | cs.LGPDF

Yuheng Zhu, Man-Ki Yoon

TL;DR: 本文提出FrameScope，一种用于自动驾驶车辆连续学习的时间数据估值框架。该框架将神经正切核理论扩展到时间域，实现对流式视觉数据的原理性估值，通过在车辆端进行本地帧选择并仅向云端查询高价值帧的标签，提高了样本效率并减少了带宽需求。

Details

Motivation: 自动驾驶车辆在动态环境中运行，静态学习模型无法适应不断变化的条件，而现有连续学习方法依赖启发式采样，未能捕捉时间动态，常忽略关键学习机会或选择冗余帧。

Result: 在多个域转移实验上，FrameScope持续优于现有方法，实现了更高的样本效率，并显著减少了自动驾驶感知中的灾难性遗忘。

Insight: 创新点在于将神经正切核理论扩展到时间域以进行流式数据估值，并提出车辆端本地帧选择与云端轻量级标签查询的协同框架，这减少了带宽需求并提升了可扩展性。

Abstract: Autonomous vehicles operate in dynamic, ever-changing environments where new scenarios and edge cases constantly emerge. As a result, static learning models are inadequate for ensuring safe and reliable operation. Continuous learning is essential for adapting to these evolving conditions and maintaining robust performance across diverse real-world settings. However, autonomous vehicles generate massive streams of visual data during operation, and existing continuous learning approaches typically rely on heuristic sampling methods that fail to capture temporal dynamics, often overlooking critical learning opportunities or selecting redundant frames. In this paper, we introduce FrameScope, a temporal data valuation framework for continuous learning in autonomous vehicles. FrameScope extends neural tangent kernel theory to temporal domains, enabling principled valuation of streaming visual data. Unlike cloud-centric methods that transmit all video data for processing, our approach performs principled, local frame selection on the vehicle and queries a cloud-based oracle model only for labels of those high-value frames. Extensive experiments across multiple domain shifts show that FrameScope consistently outperforms existing methods, achieving higher sample efficiency and significantly reducing catastrophic forgetting in autonomous vehicle perception. By valuing data on the vehicle and querying only labels for selected frames, FrameScope reduces bandwidth requirements, enabling scalable operation with a lightweight cloud labeling service.

[101] AdaptAV: Continuous Adaption of Vision Models for Autonomous Vehicles Using Cloud-based Oracle cs.CV | cs.LGPDF

Yuheng Zhu, Dhruva Ungrupulithaya, Boluo Ge, Man-Ki Yoon

TL;DR: 本文提出AdaptAV系统，通过云端持续重训练自动驾驶车辆的视觉模型，以提升模型在未知场景下的泛化能力。系统利用云端计算资源运行高精度Oracle模型指导车载模型的训练，并将更新后的模型通过网络传输至车辆，从而在保证推理速度的同时逐步提高感知精度。

Details

Motivation: 解决自动驾驶车辆因计算资源限制而采用轻量级视觉模型时泛化能力不足、在未知场景下性能下降的问题。

Result: 未在摘要中提及具体定量结果或基准测试，但宣称系统能通过持续重训练逐步提升车载模型的推理精度。

Insight: 创新点在于结合云端Oracle模型与车辆数据上传的闭环系统，实现模型在部署后的持续自适应优化，平衡了车载推理效率与模型准确性。

Abstract: Deploying vision perception models in autonomous vehicles requires that we prioritize inference speeds, resulting in a model with shallower architectures and lesser model parameters (i.e., more pruned). Such small models do not generalize well, which could result in poor performance when encountered with novel scenarios. We propose a system that overcomes this by continuously retraining the vision models on the cloud with data uploaded by vehicles. We leverage the abundant compute resources, including machine learning accelerators, of the cloud to run a highly-accurate oracle model that will guide the retraining process of the on-vehicle model. This newly trained model is transmitted to the vehicle over the network and is utilized by the vehicle for perceptions, leading to improved inference accuracy over time.

[102] Multi-exposure HDR Imaging: A Review of Pixel-level and Feature-level Reconstruction Methods cs.CVPDF

Qian Tao, Wei Wang, Chaobing Zheng, Zhengguo Li

TL;DR: 本文综述了多曝光高动态范围（HDR）成像技术，重点聚焦于像素级和特征级的重建方法。文章系统性地回顾了多曝光融合（MEF）和鬼影去除两大核心问题，对基于传统滤波器和数据驱动的方法进行了分类，并深入分析了深度学习方法的对齐与融合策略。

Details

Motivation: 多曝光是捕获真实世界高动态范围场景的有效方式，但在动态场景中，由于连续曝光之间存在时间间隔，HDR成像会遭受严重的鬼影伪影。本文旨在对解决此问题的相关文献进行系统性梳理和分类。

Result: 本文是一篇综述性文章，未提出具体的新方法，因此没有提供定量实验结果。但文章对代表性工作在不同监督设置下进行了比较，并总结了关键设计原则、常用数据集和评估指标。

Insight: 论文的创新之处在于提供了一个基于对齐和融合域的细粒度分类法：像素空间方法（通常采用光流或空间变换器进行显式运动补偿）和特征空间方法（利用可变形卷积、注意力机制或潜在表示融合进行隐式对齐）。这为理解HDR成像技术的发展脉络和未来方向提供了清晰的框架。

Abstract: Multi-exposure is an efficient way to capture real-world high-dynamic-range (HDR) scenes. However, HDR imaging suffers from severe ghosting artifacts in dynamic scenes due to the temporal gap between sequential exposures. In this article, we categorize the literature on two important topics on HDR imaging: multi-exposure fusion (MEF) and ghost removal. Conventional filter-based and data-driven methods are studied in pixel space and feature space. For popular deep learning-based approaches, we provide a granular taxonomy based on their alignment and fusion domains: pixel-space methods, which typically employ explicit motion compensation such as optical flow or spatial transformers, and feature-space methods, which leverage implicit alignment through deformable convolutions, attention mechanisms, or latent representation merging. Representative works are compared across different supervision settings, and key design principles are summarized. In addition, this survey summarizes commonly used datasets and evaluation metrics, discussing their applicability under diverse output forms. Finally, major bottlenecks and promising directions for future research are outlined.

[103] Multi-Agent Self-Improving Reinforcement Learning for Video Reasoning cs.CV | cs.CLPDF

Mingwen Zhang, Jisheng Dang, Minqiang Yang, Bimei Wang, Bin Hu

TL;DR: 本文提出了一种名为多智能体自我改进强化学习（MASIRL）的框架，用于视频推理任务，如基于视频的问答和时间定位。该框架将可训练的定位器与冻结的验证器相结合，通过验证器提供的查询条件分数来指导定位器的训练，实现零样本跨任务迁移。

Details

Motivation: 当前视频推理任务的训练通常使用局部目标（如边界回归）进行监督，而验证器仅在推理时用于重排序候选片段。本文研究是否可以利用冻结的验证器来指导训练过程，以提升证据选择能力。

Result: 在零样本跨任务评估中，一个20亿参数的实例在基于视频的问答基准上达到28.7%的交并比和25.4%的答案定位准确率，在时间定位基准上达到46.1%的交并比，在长视频问答基准上达到54.1%的准确率。相对于同规模基线，提升虽有限但一致，在相关性指标（如交并比）上改进最明显。

Insight: 创新点在于使用冻结的验证器作为训练信号，通过组相对策略梯度目标和自举校准损失来引导时间预测，这为证据选择提供了一种新的训练范式，并展示了在跨任务零样本迁移中的有效性。

Abstract: Video reasoning tasks such as grounded video question answering and temporal grounding require selecting temporal evidence that supports the query. In many current training setups, temporal supervision is applied through local objectives such as boundary regression or span generation, while verification is used mainly to rerank candidate segments at inference time. We study whether a frozen verifier can also guide training. Our multi-agent framework couples a trainable \emph{Grounder} with a frozen \emph{Verifier}: the Grounder samples candidate trajectories and evidence segments, the Verifier assigns query-conditioned segment scores, a group-relative policy-gradient objective favors trajectories that outperform their within-input peers, and a bootstrapped calibration loss steers temporal predictions toward verifier-preferred spans. Trained on source tasks and evaluated without target-dataset fine-tuning, a two-billion-parameter instantiation transfers zero-shot across grounded question answering, temporal grounding, and long-video question answering, reaching 28.7% intersection-over-union and 25.4% answer-grounding accuracy on a grounded-question-answering benchmark, 46.1% intersection-over-union on a temporal-grounding benchmark, and 54.1% on a long-video question-answering benchmark. Relative to a strong same-scale baseline, the gains are modest but consistent, with the clearest improvements on relevance-oriented metrics such as intersection-over-union and moderate-overlap recall. Within the tested benchmarks and transfer setting, the results support frozen verification as a training signal for evidence selection, while showing that strict boundary precision remains comparatively weaker. Code and models are available at https://anonymous.4open.science/r/MASIRL-E50C/

Matthew Perlman, James Beetham, Niels Da Vitoria Lobo, Amrit Singh Bedi, Mubarak Shah

TL;DR: 本文探讨了如何利用现成的视觉语言模型（VLMs）通过推理时方法（如约束迭代精炼）来生成可缩放矢量图形（SVG）。研究系统地评估了一种结合视觉反馈、结构化编辑和约束解码的框架，以揭示当前VLMs在SVG生成中的能力与局限。

Details

Motivation: 当前最先进的生成模型主要关注栅格化图像，而SVG在现代视觉生态系统中应用广泛，但缺乏专门的生成模型。本文旨在探索是否可以通过推理时方法，利用现成的VLMs解锁SVG生成能力。

Result: 实验在多个VLMs和生成设置中进行，发现约束解码提高了编译成功率，但迭代精炼揭示了模型在视觉推理和自我纠正方面存在缺陷。结果突显了使用推理时方法适配通用VLMs进行SVG生成的潜力和当前限制。

Insight: 创新点在于提出并系统评估了一个结合视觉反馈、结构化编辑和约束解码的推理时框架，用于SVG生成。从客观角度看，该方法展示了如何利用现有VLMs进行结构化输出生成，但揭示了模型在迭代自我纠正能力上的不足，为未来改进提供了方向。

Abstract: Scalable Vector Graphics (SVGs) power much of the modern visual ecosystem, yet state-of-the-art generative models focus almost entirely on rasterized images. We explore whether inference-time methods can unlock SVG generation capabilities in off-the-shelf vision-language models (VLMs). We systematically evaluate a constrained iterative refinement harness that combines visual feedback, structured editing, and constrained decoding to characterize the capabilities and limitations of current VLMs for SVG generation. Across multiple VLMs and generation settings, we find that constrained decoding improves compilation success rates, while iterative refinement reveals a deficit in visual reasoning and self-correction. Our results highlight both the promise and current limitations of using inference-time methods to adapt general-purpose VLMs for SVG generation.

[105] Automated pipeline for herbarium label digitization cs.CVPDF

Hiba Abbad, Hanane Ariouat, Eva Perez Pimpare, Nicolas Turenne, Eric Chenin

TL;DR: 本文提出了HERBIOME，一个用于植物标本标签数字化自动化的模块化端到端流水线。该流水线集成了基于YOLOv8的组件检测、CRAFT Hezar单词级文本定位、微调TrOCR用于识别混合手写和印刷文本，以及GPT-4o Mini用于将语义元数据结构化到标准化字段中。通过在450个法国植物标本上进行端到端评估，证明了其在提取结构化元数据和构建配对图像-文本数据集方面的有效性，以支持下一代多模态生物多样性AI系统。

Details

Motivation: 尽管数字化植物标本馆收藏已包含超过1亿张可自由访问的标本图像，但标签中编码的丰富元数据（如采集者身份、地理定位、采集日期和生态观察）在大规模上仍然难以获取，这限制了生物多样性信息学以及用于多模态AI的标本特异性图像-文本语料库的构建。

Result: 在450个法国植物标本上的端到端评估使用了双指标框架：最大窗口相似度（MWS: 0.614-0.618）和语义元数据准确性（SMA: 0.440-0.445）。微调的TrOCR在结合通用转录语料库和植物标本特定数据的多源数据集上训练，实现了4.05-4.10%的字符错误率。结果表明，混合训练策略提高了语义保真度，而随机采样最大化表面相似度，分类学字段仍是主要瓶颈。

Insight: 论文的创新点在于提出了一个集成了多种先进模型（YOLOv8, CRAFT Hezar, TrOCR, GPT-4o Mini）的模块化端到端流水线，专门用于处理复杂、异质的植物标本标签。从客观角度看，其将计算机视觉（检测、定位、识别）与大语言模型（语义结构化）相结合，以自动化方式从非结构化图像中提取结构化元数据，为构建高质量的配对多模态数据集提供了可行方案，这对于生物多样性领域的AI应用具有重要价值。

Abstract: Digitized herbarium collections, now comprising over 100 million freely accessible specimen images, have become a critical resource for addressing fundamental questions in ecology and evolutionary biology. Yet the rich metadata encoded in herbarium labels (collector identities, geographic localities, collection dates, and ecological observations) remains largely inaccessible at scale, constraining both biodiversity informatics and the construction of specimen-specific image-text corpora for multimodal AI. We present HERBIOME, a modular end-to-end pipeline for automated herbarium label digitization, integrating YOLOv8-based component detection, CRAFT Hezar word-level text localization, fine-tuned TrOCR for recognition of mixed handwritten and printed text, and GPT-4o Mini for semantic metadata structuring into standardized fields. TrOCR was trained on a multi-source dataset combining general transcription corpora (CREMMA-AN, PictoCatalogs) with herbarium-specific data (RéColNat), achieving a Character Error Rate of 4.05-4.10%. End-to-end evaluation on 450 French herbarium specimens, using a dual-metric framework of Maximum Window Similarity (MWS: 0.614-0.618) and Semantic Metadata Accuracy (SMA: 0.440-0.445), reveals that hybrid training strategies improve semantic fidelity while random sampling maximizes surface similarity, with taxonomic fields remaining the principal bottleneck. By automating the extraction of structured metadata from complex, heterogeneous labels, HERBIOME reduces transcription burden, enables the construction of paired image-text datasets that faithfully capture specimen individuality, which is a prerequisite for next-generation multimodal biodiversity AI systems.

[106] Data Diversity, Not Frequency Invariance: A Controlled and Self-Audited Study of Compression-Robust Deepfake Detection cs.CV | cs.LG | cs.MMPDF

Abbas Aliyev, Samir Rustamov

TL;DR: 本文通过对比实验挑战了频率特征和压缩不变性表示学习对深度伪造检测至关重要的假设。研究发现，在FaceForensics++数据集上，使用多质量数据的普通EfficientNet-B0模型在多个压缩级别下均优于专门设计的CAFRL方法，且鲁棒性主要源于数据多样性而非架构创新。

Details

Motivation: 动机是验证频率特征和压缩不变性学习是否真如广泛假设那样对抵抗视频压缩的深度伪造检测至关重要，通过控制实验探究其实际贡献。

Result: 在FaceForensics++测试集上，普通EfficientNet-B0在CRF 40压缩级别下比CAFRL高3.66 AUC点；修复实验缺陷后，基线方法进一步恢复3.96点，频率路径未带来可检测的边际提升。

Insight: 创新点在于通过预注册协议和自审计控制实验，揭示了深度伪造检测的压缩鲁棒性更依赖于训练数据的编解码器多样性，而非频率或压缩不变性架构设计；强调匹配训练方案与模型容量的重要性。

Abstract: Frequency features and compression-invariant representation learning are widely assumed to be key to deepfake detection that survives video compression. We test this with CAFRL - block-DCT and FFT-phase streams, compression-level-conditioned band attention, and adversarial (gradient-reversal) compression invariance - and report a controlled negative. Under a pre-registered protocol with capacity- and augmentation-matched controls, a plain EfficientNet-B0 on multi-quality data beat CAFRL as specified at every compression level on the FaceForensics++ test split, by 3.66 AUC points at CRF 40 (paired, single seed). A self-audit of our own negative found four defects biased against the frequency hypothesis, and pre-specified re-tests repairing all four showed the deficit to be a recipe artifact, not an architecture failure: the baseline recipe recovered 3.96 points over the matching shipped-recipe variant. The frequency path made no detectable difference: discriminative alone (standalone validation AUC 0.91-0.98 late in training) but of no marginal value under this fusion, at two feature widths of one 4.0 M trunk, every seed-pooled interval for the intra-dataset compression contrasts including zero; on the single held-out manipulation tested, the fair variants sat below the plain backbone. The adversarial branch, as specified, added nothing and degraded its own conditioning estimator; at the fair recipe it is untested. Robustness under single-pass H.264 re-encoding came instead from data diversity: real constant-rate-factor variants beat synthetic JPEG augmentation by 7.3 points (single runs, non-overlapping intervals). The evidence is FaceForensics++-family, GAN-era and single-codec. Match controls on training recipe as well as capacity, and buy compression robustness with codec diversity before architecture.

[107] Defending Wearable VLMs Against Private Attribute Inference cs.CV | cs.AIPDF

Zhimin Li, Pan Wang, Jingxian Chen, Yuantao Tang, Anthony Chen

TL;DR: 本文研究可穿戴视觉语言模型（VLM）在分割推理场景下的隐私-效用权衡问题，提出了一种名为TGAP的预LLM令牌解耦器，通过在视觉令牌离开可信设备边界前施加残差变换，有效抑制私有属性泄露，同时保持任务效用。

Details

Motivation: 可穿戴VLM管道利用第一视角视觉捕获提供持续多模态辅助，但用于辅助的自我中心证据也可能泄露佩戴者或旁观者的私有属性（如位置、收入、性别、兴趣），本文旨在解决这一隐私与效用的联合问题。

Result: 在构建的包含3221个图像-问题记录的隐私-效用基准测试中，TGAP将隐私属性推断准确率从56.7%降至7.4%（绝对下降49.3%），同时将宽松效用维持在74.4%，表明该方法能有效保护隐私且保持可用性。

Insight: 创新点在于识别了分割VLM推理中视觉令牌传输这一未被充分研究的泄露面，并提出了TGAP框架，它通过结合效用保持、身份正则化、语义隐私抑制和图像驱动表示抑制，避免了粗粒度硬掩码或注意力掩码带来的效用损失，为保护隐私的可穿戴多模态AI提供了实用路径。

Abstract: Wearable VLM pipelines promise continuous multimodal assistance from egocentric visual capture: a user asks a task-driven question about the surrounding scene, and the system uses compact visual tokens to support language reasoning. The challenge motivating this work is that the same egocentric evidence needed for useful assistance can also reveal private attributes about the wearer or nearby bystanders. We investigate this as a joint privacy-utility problem for split VLM inference, where visual encoding occurs within a trusted device boundary but intermediate visual tokens may be transmitted to downstream reasoning components. This exposes an understudied leakage surface: even when final textual responses are benign, external attackers or untrusted downstream components can recover private attributes from transmitted visual tokens. To evaluate this tension, we construct a paired privacy-utility benchmark with 3,221 image-question records, each paired with a utility question and privacy labels covering location, income, sex, and interests. We further propose Token-Guided Attribute Privacy (TGAP), a pre-LLM token disentangler that learns a residual transformation of visual tokens before they leave the trusted boundary. TGAP combines utility preservation, identity regularization, semantic privacy suppression, and image-driven representation suppression, avoiding the utility loss caused by coarse hard or attention masking. On the benchmark used for source-model evaluation, TGAP reduces privacy accuracy from 56.7% to 7.4%, a 49.3% absolute drop, while maintaining relaxed utility at 74.4%. These results suggest that securing the compact token interface is a practical path toward privacy-preserving wearable multimodal AI.

[108] Projection-Aware End-to-End Learned Video Compression for 360-Degree Video cs.CVPDF

Niloofar Maani

TL;DR: 本文研究了投影格式对360度视频端到端神经压缩性能的影响，评估了七种JVET 360Lib支持的格式，发现等距柱状投影和填充等距柱状投影在基于光流的神经压缩模型中效率最高，而立方体贴图类投影在传统混合编码器中更优，表明投影效率与编解码器类型相关。

Details

Motivation: 360度视频需映射为二维投影才能被传统编解码器处理，而投影选择会影响空间连续性、采样均匀性、运动估计和压缩效率，因此需要探究不同投影格式对新兴的端到端神经视频压缩模型的具体影响。

Result: 在JVET测试序列和通用测试条件下，使用尺度空间流模型评估，等距柱状投影和填充等距柱状投影压缩效率最高，而基于立方体和菱形十二面体的投影效果较差；这与传统HM-16.16编解码器的结果相反。性能通过PSNR、球形PSNR、加权球形PSNR和Bjøntegaard delta rate进行评估。

Insight: 创新点在于构建了一个结合投影转换、神经压缩和逆投影的可微分流程进行评估，并揭示了关键洞察：基于光流的神经模型受益于单面投影的空间连续性，而基于块的混合编解码器更适合多面布局，这为基于学习的360度视频压缩的投影选择提供了指导。

Abstract: 360-degree video supports immersive applications such as virtual reality, autonomous driving, and education. Because spherical content cannot be processed directly by conventional video codecs, it must first be mapped to a two-dimensional projection. Projection choice affects spatial continuity, sampling uniformity, motion estimation, and compression efficiency. This thesis investigates how projection format influences end-to-end neural compression of 360-degree video. Seven formats supported by JVET 360Lib are evaluated using the scale-space flow model, JVET test sequences, and common test conditions. Each sequence is converted from its source equirectangular projection to a coding projection, compressed at multiple rate points, reconstructed, and converted back. Performance is assessed using PSNR, spherical PSNR, weighted spherical PSNR, and Bjøntegaard delta rate. A differentiable pipeline combining projection conversion, neural compression, and inverse projection is also compared with 360Lib. Results show that equirectangular and padded equirectangular projections provide the highest compression efficiency with the scale-space flow model, while cubemap-based and rhombic dodecahedron projections are less effective. This differs from the conventional HM-16.16 codec, for which cubemap-based formats, particularly equi-angular and adjusted cubemap projections, outperform equirectangular formats. Neural models based on optical flow benefit from the spatial continuity of single-face projections, whereas block-based hybrid codecs better accommodate multi-face layouts. These findings show that projection efficiency is codec-dependent and provide guidance for selecting projections for learning-based 360-degree video compression.

[109] SNF-Bench: Separating Static Drift from Natural Flow in Long-Horizon Fixed-Camera Video Generation cs.CVPDF

Matiur Rahman Minar, Seunghun Oh, Ganghyeon Jeong, Unsang Park

TL;DR: 本文提出了SNF-Bench，一个用于评估长时程固定摄像头视频生成质量的框架。它通过将场景分解为静态支撑区域和动态流区域，分别评估静态保真度、流持续性和漂移泄漏，解决了现有整体帧评估指标在奖励运动时可能错误奖励背景漂移的模糊性问题。

Details

Motivation: 现有长时程视频生成的评估指标（如整体帧运动一致性）存在模糊性：对于固定摄像头自然场景，水、火等动态是期望的，而背景移动是错误。这导致系统可能在场景漂移时仍获得高分，或在流停滞时获得高一致性分数。

Result: 在公开发布的长时程文本条件模型检查点上进行审计发现，整体帧运动指标与静态区域漂移指标对相同输出的排序几乎相反。在最大受控平移下，fBD和NBF分别升至基线的1.86倍和1.32倍，而整体帧动态度仅升至1.07倍，反而奖励了这种损坏。

Insight: 核心创新在于将场景解耦为静态与动态部分进行分离评估，并引入漂移泄漏作为解释性上下文。该方法通过机制验证（如注入已知严重性的全局变换）来确保每个评估因子只对其目标属性敏感，提供了比相关性验证更可靠的评估维度。

Abstract: Long-horizon video generation is evaluated with whole-frame metrics that reward motion and temporal consistency. For fixed-camera nature scenes this creates an ambiguity: motion of water, fire, smoke, or rain is desirable, whereas motion of the background is an error. A system can therefore score well on motion while its scene drifts, or on consistency while its flow stagnates. We introduce SNF-Bench, an evaluation framework for long-horizon fixed-camera generation that partitions each scene into static support and dynamic flow and reports static fidelity, flow persistence with absolute magnitude, and drift leakage separately, never as one score. Drift leakage is interpretive context rather than a headline measurement. Each factor is validated mechanistically rather than by correlation with preference: we inject global translation, rotation, and scale drift and progressive late freezing at known severity into real generations, and require each factor to respond in its stated direction and to remain selective against corruptions it does not target. Auditing publicly released long-horizon text-conditioned checkpoints under one recorded common inference configuration, plus an image-conditioned track with released-pipeline references and a deployment-sensitivity panel, we find that whole-frame motion and static-region drift induce near-opposite orderings of the same outputs. At maximum controlled translation, fBD and NBF rise to $1.86\times$ and $1.32\times$ baseline, but whole-frame Dynamic Degree reaches only $1.07\times$—rewarding the corruption. SNF-Bench measures where motion occurs and whether it persists; it does not measure physical realism. Project page: https://minar09.github.io/snfbench/.

[110] State-Conditioned Visual Evidence Retrieval for Fine-Grained Perception in Document Vision-Language Models cs.CVPDF

Mingxu Chai, Chenyu Liu, Ziyu Shen, Jiazheng Zhang, Kaidi Zhang

TL;DR: 本文提出了一种状态条件视觉证据检索（SCVER）方法，用于改进文档视觉语言模型中的细粒度感知。该方法在自回归解码过程中，基于当前解码状态动态检索少量相关的高分辨率区域，实现按需访问细粒度视觉线索，从而提升计算效率与解析精度。

Details

Motivation: 现有基于视觉语言模型（VLM）的文档解析方法依赖全局压缩的视觉标记，导致细粒度细节纠缠在单一表示中并在解码时被重复访问，计算效率低下且与局部化、状态依赖的视觉证据需求不匹配。

Result: 在文档解析基准测试中，SCVER在降低输入分辨率的情况下提高了鲁棒性，并实现了更好的精度-效率权衡，证明了按需视觉证据检索对细粒度感知的有效性。

Insight: 创新点在于将感知建模为状态条件视觉证据检索（SCVER），采用由粗到细的设计，并引入空间引导学习目标（SGLO）来稳定检索过程的学习，从而缓解全局共享表示编码所有细粒度细节的负担，提升模型效率与性能。

Abstract: Compared with typical vision-language tasks, document parsing places stronger demands on fine-grained visual perception. Existing vision-language model (VLM)-based parsing approaches rely on globally compressed visual tokens, where fine-grained details are entangled within a single representation and repeatedly accessed during decoding. However, we observe that the visual evidence for each prediction is typically localized and conditioned on the current decoding state, whereas such representations must be accessed in full at every decoding step, resulting in inefficient computation. To address this mismatch, we formulate perception as state-conditioned visual evidence retrieval (SCVER) during autoregressive decoding. The model operates on a compact global representation for coarse structure and retrieves a small set of relevant high-resolution regions conditioned on the current token state. This coarse-to-fine design enables on-demand access to fine-grained visual cues, relieving globally shared representations from encoding all fine-grained details. We further find that learning such state-conditioned retrieval in VLMs is challenging and unstable. To stabilize this process, we introduce a Spatially-Guided Learning Objective (SGLO) to guide the retrieval process. Experiments on document parsing benchmarks show that SCVER improves robustness under reduced input resolution and achieves a better accuracy-efficiency trade-off, demonstrating the effectiveness of on-demand visual evidence retrieval for fine-grained perception.

[111] Weaving Visual Narratives: Agentic Image Bundle Composition Beyond Atomic Visual Matching cs.CV | cs.IRPDF

Rong Shan, Tianyi Xu, Congmin Zheng, Wenteng Chen, Jiachen Zhu

TL;DR: 本文提出了图像束组合（IBC）这一新范式，旨在从大规模无序照片池中动态组合出具有结构关系的连贯图像束，以超越传统的原子化图像匹配。为此，作者构建了首个IBC基准数据集IBCBench，并提出了一个名为BundleWeaver的智能体框架，该框架将IBC任务重新定义为查询条件下的增量超边发现，利用大语言模型和视觉语言模型协同工作。实验表明，该方法相比现有最先进的嵌入模型和静态分解重排方法取得了显著性能提升。

Details

Motivation: 传统图像检索被表述为点对点匹配问题，但这种方式无法捕捉个人照片集合中用户寻求由结构关系绑定的紧凑视觉故事（而非孤立快照）的复杂搜索意图。

Result: 在构建的IBCBench基准数据集（包含109,467张图像和667个已验证查询）上进行了广泛实验。结果表明，最先进的嵌入模型和静态分解重排范式存在关系盲区，而BundleWeaver框架实现了显著的性能提升，凸显了从原子评分转向动态关系组合的必要性。

Insight: 论文的核心创新在于提出了图像束组合（IBC）这一新任务范式，以及将任务重新定义为查询条件下的增量超边发现，并设计了一个由LLM和VLM协同驱动的智能体框架（BundleWeaver）来动态探索组合空间，有效解决了组合爆炸和不可分解联合相关性建模的挑战。

Abstract: Image retrieval has traditionally been formulated as a point-wise matching problem, where each candidate image is scored in isolation. However, this atomic paradigm fails to capture the complexity of human search intent within personal photo collections, where users often seek compact visual stories bound by structural relations rather than isolated snapshots. To address this limitation, we introduce Image Bundle Composition (IBC), a novel paradigm that shifts the objective from ranking individual images to dynamically composing cohesive image bundles from a massive, unstructured photo pool. Since target bundles are not predefined, IBC presents a severe combinatorial explosion challenge and demands modeling non-decomposable joint relevance. To establish this paradigm, we construct IBCBench, the first IBC benchmark dataset containing 109,467 images and 667 verified queries, built via a semi-automated verification pipeline. Furthermore, we propose BundleWeaver, an agentic framework that reformulates IBC as query-conditioned incremental hyperedge discovery. By employing a Large Language Model to adaptively search for missing relational roles and utilizing a Vision-Language Model for whole-bundle verification, BundleWeaver effectively navigates the combinatorial space. Extensive experiments demonstrate that while state-of-the-art embedding models and static decompose-and-rerank paradigms suffer from relational blindness, BundleWeaver achieves substantial performance gains, highlighting the necessity of shifting from atomic scoring to dynamic relational composition. Our dataset and code are available.

[112] Instruction Distillation: Text Instructions as Visual Examples cs.CVPDF

Hardik Jindal, Soumyabrata Pal, Sayak Ray Chowdhury

TL;DR: 本文提出了一种名为’指令蒸馏’的方法，用于提升多模态大语言模型在细粒度视觉分类任务中的上下文学习效率。该方法通过为每个训练图像生成结构化的识别指令，编码了外观线索、区分性特征和常见混淆点，从而在推理时减少上下文令牌消耗并降低延迟。

Details

Motivation: 解决多模态大语言模型在视觉上下文学习中，每个检索到的图像示例消耗大量上下文令牌，导致大规模K设置下推理成本过高的问题。

Result: 在七个细粒度基准测试和两个MLLM骨干网络上，基于指令的流程在K=1时匹配或超过图像ICL，在K=5时每查询令牌减少2.9倍，推理延迟降低3.3倍。混合配置进一步表明视觉和文本ICL信号具有互补性。

Insight: 创新点在于为每个训练图像生成个性化指令，保留了类内视觉多样性，避免了传统每类单一描述的坍缩问题。从客观角度看，该方法通过结合视觉模式和文本逻辑，提升了上下文质量，实现了效率与性能的平衡。

Abstract: Visual in-context learning (ICL) with multimodal large language models (MLLMs) is effective for fine-grained visual classification, but each retrieved image example consumes several hundred context tokens, making large-$K$ settings prohibitively expensive at inference scale. We propose Instruction Distillation: an offline procedure in which the MLLM itself generates, for each individual training image, a structured identification instruction encoding general appearance cues, features that differentiate the class from visually similar ones, and a common confusion point. Unlike prior work that produces a single description per class, our instructions are generated per training image, preserving the intra-class visual diversity that per-class descriptions collapse. At inference time, we study five configurations sharing a single CLIP retrieval index: zero-shot, image ICL, instruction-only ICL, and two hybrid variants in which retrieved neighbors are split between images and instructions. Across seven fine-grained benchmarks and two MLLM backbones, instruction based pipelines match, or exceeds image ICL at $K{=}1$ and reduces per-query tokens by $2.9\times$ and inference latency by $3.3\times$ at $K{=}5$. Hybrid configurations further show that visual and textual ICL signals are complementary, images give visual patterns to learn and see, while instructions give explicit rules and logic. When both of these are provided, the quality of context improves, which is noticeable in the performance.

[113] TopoAgent: A Structure-Aware Perception-to-Reasoning Framework for Diagram-to-Graph Topology Extraction with Large Vision-Language Models cs.CVPDF

Bangwei Guo, Xujiang Zhao, Yanchi Liu, Wei Cheng, Shengyu Chen

TL;DR: 本文提出了TopoAgent，一个用于从结构图中提取实体及其连接关系的图拓扑提取框架，以及TopoBench-180基准测试集。该框架结合了细粒度感知、全局结构先验和拓扑一致性约束，以解决当前视觉语言模型在需要全局一致性推理的拓扑提取任务上的挑战。

Details

Motivation: 当前视觉语言模型在从结构图中提取图拓扑的任务上存在困难，该任务需要细粒度的感知基础和具有全局一致性的拓扑感知推理。

Result: 在TopoBench-180基准测试上的实验表明，TopoAgent优于强大的视觉语言模型基线和最近的视觉推理框架，特别是在边提取方面表现出色。

Insight: 创新点在于提出了一个结合了基于感知的定位、全局结构先验、规范节点清单构建、以节点为中心的局部到全局关系推理以及拓扑一致性强化的渐进式提取框架，并建立了一个涵盖Web风格和网络风格类别的、经过人工验证的基准测试集，填补了多模态结构化理解领域的一个重要空白。

Abstract: Diagram-to-graph topology extraction aims to extract a graph of entities and their connections from a structural diagram. This task remains challenging for current vision-language models because it requires both fine-grained perceptual grounding and topology-aware reasoning with global consistency. We present TopoBench-180, a human-verified benchmark for diagram-to-graph topology extraction, and TopoAgent, a structure-aware perception-to-reasoning framework for reliable topology extraction using large vision-language models. TopoBench-180 contains 180 structural diagrams spanning Web-style and Network-style categories, paired with canonical graph annotations. TopoAgent progressively extracts the target graph by combining grounded perception, global structural priors, canonical node inventory construction, node-centric local-to-global relation reasoning, and topological consistency enforcement. Experiments on TopoBench-180 show that TopoAgent outperforms strong vision-language model baselines and recent visual reasoning frameworks, especially on edge extraction. More broadly, this work fills an important gap in multimodal structured understanding by establishing a benchmark and framework for diagram-to-graph topology extraction. The benchmark and associated resources will be publicly released at https://huggingface.co/datasets/WayneGuo0011/TopoBench-180.

[114] Inter-3D VQA: A Roadside Multimodal Benchmark for 3D Spatiotemporally Grounded Visual Question Answering cs.CVPDF

Shaozu Ding, Linan Song, Dajiang Suo

TL;DR: 该论文提出了Inter-3D VQA，一个用于路口3D时空基础视觉问答的大规模路边多模态基准数据集。它基于同步点云和多视角图像构建，包含40.7万个QA对，涵盖车道级位置、物体关系、运动模式和险情交互推理。论文还提出了一个集成激光雷达表征的MLLM基线模型Inter-Geo，以及一个统一的评估框架Inter-Metrics。

Details

Motivation: 现有VQA基准主要基于自车视角或2D路边视频，缺乏对真实世界距离、轨迹、基础设施拓扑和安全关键交互的3D基础推理能力进行评估。

Result: 实验表明，提出的Inter-Geo基线模型在基础空间和时间推理任务上优于基于图像的视觉语言模型。

Insight: 创新点在于构建了首个专注于路口、融合点云与多视角图像的3D时空基础VQA基准，并提出了集成物体级和场景级对齐激光雷达表征的MLLM方法，以及结合文本一致性、数值准确性和语义正确性的统一评估框架。

Abstract: Recent advances in visual question answering (VQA) and multimodal large language models (MLLMs) have enabled natural-language reasoning over traffic scenes. However, existing benchmarks are largely built from ego-vehicle views or 2D roadside videos, limiting their ability to evaluate 3D-grounded reasoning over real-world distances, trajectories, infrastructure topology, and safety-critical interactions. We introduce Inter-3D VQA, a large-scale roadside multimodal benchmark for 3D spatiotemporally grounded VQA at intersections. Built from synchronized point clouds and multi-view images, Inter-3D VQA contains 407K QA pairs covering lane-level positions, object relationships, motion patterns, and near-miss-oriented interaction reasoning. We further propose Inter-Geo, an MLLM baseline that integrates object- and scene-level aligned LiDAR representations, and Inter-Metrics, a unified evaluation framework for textual consistency, numerical accuracy, and semantic correctness. Experiments show that Inter-Geo outperforms image-based VLMs, especially on grounded spatial and temporal reasoning tasks. Our benchmark and codes are available at https://github.com/ASU-Suo-Lab/Inter-3D-VQA .

[115] FairReL: Deepfake Detection using Fairness-Aware Representation Learning cs.CVPDF

Xiaoman Lu, Jiaqi Li, Shuntian Zheng, Huiping Chen, Yu Guan

TL;DR: 本文提出了一种名为FairReL的公平感知表示学习框架，用于解决深度伪造检测中存在的跨人口统计子群（如种族、性别）的预测不公平问题。该方法通过识别并控制驱动不公平预测的两个子群敏感组件——多尺度空间特征和微调诱导的残差特征，并引入专门的群体监督损失来提升公平性。

Details

Motivation: 现有深度伪造检测器虽然整体准确率高，但其错误在不同人口统计子群间分布不均，例如某些群体的真实人脸更易被误判为伪造。现有公平感知方法通常对整个特征表示进行正则化，未能识别或控制导致不公平的具体组件，这种粗粒度干预可能过度抑制有用的伪造线索。

Result: 在FF++、Celeb-DF、DFD和DFDC等基准数据集上的实验表明，与最先进的公平感知检测器相比，FairReL在未见数据集上的AUC提升了3.9%，同时将子群间假阳性率（FPR）差异降低了10.2%。

Insight: 创新点在于识别并分离了导致不公平的两个具体特征组件，并设计了针对性的损失函数（GCWD和SLMA）进行干预。这为公平性研究提供了更细粒度的组件级分析视角，而非对整个表示空间进行粗粒度正则化，有助于在保持检测性能的同时提升公平性。

Abstract: Although recent deepfake detectors achieve high overall accuracy, their errors remain unevenly distributed across demographic subgroups, with real faces from certain groups more often misclassified as fake. Existing fairness-aware detectors typically regularise the entire feature representation, without identifying or controlling the specific components that drive unfair predictions. Such coarse intervention can over-suppress useful forgery cues while leaving demographic structure in component-specific subspaces. To address this, we identify two subgroup-sensitive components: multi-scale spatial features, which encode local facial and forgery patterns, and fine-tuning-induced residual features, which adapt the backbone to the unfair training distribution. We propose FairReL, a fairness-aware representation-learning framework that targets both components with dedicated demographic supervision. FairReL uses an SVD-decomposed foundation-model backbone to isolate the fine-tuning-induced residual representation, and introduces two complementary losses. Group-Conditional Wavelet Decorrelation (GCWD) suppresses subgroup-imbalanced structure across spatial wavelet sub-bands, while Subspace-Localised Mean Alignment (SLMA) aligns subgroup means within each real/fake class in the residual representation. Experiments on FF++, Celeb-DF, DFD and DFDC show that, against the state-of-the-art fairness-aware detector, FairReL improves unseen-dataset AUC by 3.9% while reducing subgroup FPR disparity by 10.2%. Code is available at https://github.com/xiaoman89/FairReL .

[116] ClearText-Video: A Large-Scale Text-Centric Video Dataset Bridging Video Restoration and Scene-Text Enhancement cs.CVPDF

Jinlong Li, Jiaming Ding, Dingfu Lu, Malcolm Hsiu, Chuang Ke

TL;DR: 本文提出了ClearText-Video (CTVid)数据集，这是一个大规模、以文本为中心的视频基准，旨在研究在受控质量变化下的文本中心视频理解。该数据集包含大量真实世界富含文本的自中心视频、人工验证的场景文本标注以及多语言问答对，并提供了原始高质量视频、降质版本和修复版本，以支持视频修复和视频问答两大任务族。

Details

Motivation: 多模态大语言模型在视觉-语言理解方面进展显著，但其在文本中心视频推理上的性能对输入质量高度敏感。现实世界中用户提供的视频常包含运动模糊、压缩伪影、噪声和低分辨率文本，这些因素损害了可靠的文本读取和下游推理。

Result: 在CTVid上评估了18种代表性修复方法和16种最先进的多模态大语言模型。结果表明，视觉增强并不保证文本保真度或下游推理增益：模糊比低分辨率更具破坏性，修复后的视频可能改变MLLMs使用的文本证据，且仅依赖OCR的流程性能远低于直接的多模态推理。

Insight: 论文的创新点在于构建了一个连接视频修复与场景文本增强的大规模基准数据集，并系统揭示了视觉修复与基于文本的理解之间的差距。这为开发具有修复意识、质量鲁棒的文本中心视频系统提供了严谨的基础。

Abstract: Multimodal Large Language Models (MLLMs) have recently made strong progress in visual–linguistic understanding. However, their performance on text-centric video reasoning remains highly sensitive to input quality. Real-world user-provided videos often contain motion blur, compression artifacts, noise, and low-resolution text, which impair reliable text reading and downstream reasoning. Whether MLLMs can robustly read and reason about real-world scene text under diverse quality conditions remains a fundamental open question. We introduce ClearText-Video (CTVid), a large-scale, scene-text-aware benchmark for studying text-centric video understanding under controlled quality variation. CTVid contains 4,639 real-world text-rich egocentric videos, 550K+ frames, 1.6M human-verified scene-text annotations, and 220K+ spatial/temporal question–answer pairs in Chinese and English. For each high-quality video, CTVid provides content-matched Degraded-Quality and Restored-Quality variants, supporting two task families: Text-Centric Video Restoration and Multi-Quality VideoQA. We evaluate 18 representative restoration methods and 16 state-of-the-art MLLMs on CTVid. The results show that visual enhancement does not guarantee textual fidelity or downstream reasoning gains: blur is more damaging than low resolution, restored videos can alter the textual evidence used by MLLMs, and OCR-only pipelines remain far below direct multimodal reasoning. CTVid exposes the gap between video restoration and text-grounded understanding, providing a rigorous foundation for restoration-aware, quality-robust text-centric video systems.

[117] Beyond Visual Boundaries: Rethinking Scene Segmentation for Movie RAG cs.CVPDF

Dong-Hee Kim, Seonwoo Choi, Changbeen Kim, Jungmyung Wi, Juyeon Ko

TL;DR: 本文针对多模态大语言模型理解长视频（尤其是电影）的挑战，指出现有基于检索增强生成的视频理解方法效果不佳，其核心问题在于检索单元（视频片段）的质量。作者发现，传统的场景分割方法旨在检测视觉上显著的过渡，而非服务于叙事理解的事件单元，因此在电影理解任务中甚至不如简单的均匀时间分块。为此，作者提出了NarraScene数据集，该数据集采用以叙事变化为中心的三层认知分类法进行标注，并证明基于此数据集的叙事片段作为检索单元能显著提升下游电影理解任务的性能。

Details

Motivation: 解决多模态大语言模型在理解长视频（如电影）时面临的挑战：稀疏采样丢失细节，密集采样超出上下文长度限制。检索增强生成（RAG）是一个有前景的折中方案，但其效果严重依赖于作为检索单元的视频片段的质量。作者旨在探究如何为电影RAG定义更有效的检索单元，并发现现有场景分割方法因标注与叙事结构不匹配而失效。

Result: 在电影理解的下游任务上进行评估，发现现有场景分割方法的表现一致性地无法超越简单的均匀时间分块。而使用作者提出的NarraScene数据集（以叙事变化为中心标注的片段）作为检索单元时，其性能超越了均匀分块。

Insight: 论文的核心创新点在于揭示了电影RAG中场景分割的核心挑战并非边界检测，而是识别对电影理解至关重要的叙事事件单元。作者提出的NarraScene数据集通过三层认知分类法（物理、角色、叙事变化）进行叙事中心的标注，为定义有效的检索单元提供了新的数据基础和方法视角。

Abstract: Understanding long-form video remains a fundamental challenge for multimodal large language models (MLLMs). Sparse frame sampling fails to capture fine-grained visual details, while dense sampling quickly exceeds context length limits. Retrieval-augmented generation (RAG) offers a promising middle ground by selectively retrieving relevant video segments for grounded generation, yet its effectiveness critically depends on the quality of the video segments used as retrieval units. In this paper, we investigate RAG for movie understanding, which demands story-level reasoning over characters, events, and narrative arcs spanning hours of content. Scene segmentation, a long-studied problem that partitions movies into semantically coherent units, is a natural candidate for defining such retrieval units. We reexamine whether existing methods actually serve this role through comprehensive evaluation on downstream movie understanding tasks, and find that they consistently fail to outperform naive uniform temporal chunking. Our audit of the most standard scene segmentation benchmarks reveals why: current annotations prioritize visually salient transitions over narrative event structure. Motivated by this mismatch, we introduce NarraScene, a narrative-centric scene segmentation dataset annotated with a three-level cognitive taxonomy spanning physical, character, and narrative change, where every valid boundary requires a narrative-level shift. When used as retrieval units, these narrative-grounded segments outperform uniform chunking on downstream movie understanding tasks, suggesting that the central challenge for scene segmentation in movie RAG is not detecting boundaries, but identifying the narrative event units that matter for movie understanding.

Wei Zhou, André Kaup

TL;DR: 本文提出了一种基于预测编码层次结构（PCH）的无参考立体全景图像质量评估方法。该方法模拟人类视觉系统，通过局部独眼感知模块、全局预测感知模块和视觉质量回归器，结合视口提取、独眼转换、显著性检测和双目融合等技术，来预测立体全景图像的感知质量。实验表明，该方法在性能上优于或与现有先进方法相当。

Details

Motivation: 立体全景图像在虚拟现实中提供了沉浸式体验，但由于视场自由可变和双目视觉等因素，开发高效准确的感知质量评估指标仍具挑战。本文旨在模拟人类视觉系统的观看过程，解决立体全景图像的无参考质量评估问题。

Result: 大量实验表明，所提出的PCH方法在性能上具有竞争力，并且相比最先进的（SOTA）质量评估方法取得了持续改进。

Insight: 创新点在于受人类视觉系统启发，将立体全景图像的观看过程建模为局部聚合与全局推断的层次化预测编码框架，并整合了独眼感知、显著性检测和双目融合机制，为无参考质量评估提供了新的仿生计算视角。

Abstract: Stereoscopic omnidirectional images (SOIs) have provided users with newly immersive quality of experience in virtual reality environments. However, developing efficient and accurate perceptual quality assessment metrics for SOIs remains challenging due to many factors such as freely changeable field of views and binocular vision. In this paper, based on the characteristics of the human visual system (HVS), we propose a Predictive Coding Hierarchy-inspired metric (PCH) for blind/no-reference stereoscopic omnidirectional image quality assessment. Motivated by the viewing process of SOIs, the proposed PCH includes a local cyclopean perception module, a global predictive perception module, and a visual quality regressor. First, observers browse different spherical sceneries from viewports, and aggregate the local visual information to infer the perceptual quality of SOIs. Therefore, we extract various viewports, followed by cyclopean conversion and saliency detection to approach the perception and attention of the human brain. After the local aggregation, viewers then infer the global scene in their minds. Based on the binocular mechanism, we fuse left and right views to perform predictive coding hierarchy modelling. Finally, the visual quality regressor is exploited to obtain the ultimate quality score related to both local and global perceptual cues. Extensive experiments demonstrate that the proposed PCH achieves competitive and consistently improved performance compared with state-of-the-art quality assessment methods.

[119] MWIR-4-Plastic: The Identification of Complex End-of-Life Industrial Plastic using Mid-wave Infrared Hyperspectral Imaging and Machine Learning cs.CV | cs.LGPDF

Elias Arbash, Andréa de Lima Ribeiro, Filipa Simões, Ahmed Jamal Afifi, Aldino Rizaldy

TL;DR: 该论文针对报废工业废料中黑色塑料碎片的自动化分拣难题，提出了首个公开可用的中波红外高光谱成像数据集MWIR-4-Plastic，并开发了一个结合光谱与空间信息的多模态深度学习框架，实现了对复杂黑色塑料的准确分类。

Details

Motivation: 现有方法主要依赖单点接触式红外光谱或实验室高光谱成像，缺乏空间分辨能力，且数据集多为实验室控制下的完整塑料，无法满足快速、大批量处理黑色工业塑料碎片的需求。

Result: 研究在自建数据集上建立了首个综合基准，评估了包括化学计量学、机器学习和深度学习在内的九种处理方法，所提多模态光谱-空间框架通过结合前景分离、像素级分类和物体级多数投票，实现了对复杂黑色塑料的准确分类。

Insight: 创新点在于公开了首个包含RGB、VNIR、SWIR和MWIR多场景配准的黑色塑料碎片高光谱数据集，并提出了一个集成先进高光谱Transformer和化学计量波段选择的多模态光谱-空间分析框架，为工业检测中的高光谱物体分析流程设立了基准。

Abstract: The automated sorting of shredded black plastics from end-of-life (EOF) industrial waste presents a significant challenge in recycling facilities, primarily due to the limitations of current sensing and analytical approaches. Existing studies predominantly rely on single-point contact-based mid-infrared spectroscopy or laboratory hyperspectral imaging (HSI) setups, which fail to provide the spatially resolved analysis necessary for fast, bulk processing. Moreover, available datasets are laboratory-controlled and focus on intact rather than shredded plastics, hindering further recycling refinement. Black industrial plastics, in particular, are underrepresented, while most classification pipelines depend on manual region selection and rule-based spectral matching, neglecting spatial information and modern deep learning (DL) methods. To address these gaps, we introduce the first publicly available HSI dataset of shredded black plastics from EOF vehicle, comprising four industrial polymers across 13 co-registered RGB, VNIR, SWIR, and MWIR scenes and their segmentation pipeline. We developed a multi-modal spectral-spatial framework that integrates foreground isolation, pixel-wise classification, and object-level majority voting. By adapting advanced hyperspectral transformers from earth observation and incorporating chemometric band selection, we achieve accurate classification of complex black plastics. The study establishes the first comprehensive benchmark using nine processing methods, including chemometric, machine learning, and DL architectures. To ensure reproducibility, the complete dataset and methodologies are publicly released, establishing a benchmark for a hyperspectral object-analysis pipeline in industrial inspection.

[120] Pixel-wise Geo-registration of Drone and Satellite Images cs.CVPDF

Qingyang Liu, David G Shatwell, Parth Parag Kulkarni, Mubarak Shah

TL;DR: 该论文提出了SkyReg数据集和基准测试，用于像素级无人机-卫星图像地理配准，提供密集的像素级地理坐标监督。论文评估了多种基线方法，并训练了一个几何感知重建流程，取得了显著优于现有方法的结果。

Details

Motivation: 现有跨视角地理定位基准大多仅提供GPS标签，限制了每张图像只能评估单个坐标，而密集的地理配准问题尚未得到充分探索。

Result: 在SkyReg基准上，论文提出的几何感知重建流程取得了最先进（SOTA）的结果，性能提升显著。

Insight: 创新点在于引入了首个用于像素级无人机-卫星地理配准的标准化数据集和基准，并提出了一个几何感知的重建流程，有效解决了密集地理对齐问题。

Abstract: Pixel-level cross-view geo-registration aims to align a query image (e.g., drone) to a geo-referenced satellite map so that every query pixel can be mapped to real-world GPS coordinates. Despite strong progress in cross-view geo-localization, existing benchmarks largely provide only GPS labels, limiting evaluation to a single coordinate per image and leaving dense geodetic alignment underexplored. We introduce SkyReg, a dataset and standardized benchmark for pixel-level drone-to-satellite geo-registration, providing dense per-pixel geo-location supervision across diverse settings (orthographic and perspective), scene types (urban, landmark-centric, suburban/rural), and camera configurations. Using SkyReg, we evaluate a broad set of baselines spanning retrieval, feature matching, homography-based alignment, and feed-forward 3D reconstruction. Finally, cross-view pairs from SkyReg, we train a geometry-aware reconstruction pipeline that achieves state-of-the-art results,improving performance by a significant margin.

[121] NBS: No Bias Stereo cs.CVPDF

Vage Taamazyan, Zhuowen Shen, Stefan Hinterstoisser, Alberto Dall’Olio, Agastya Kalra

TL;DR: 本文提出了一种名为NBS（No Bias Stereo）的立体匹配方法，挑战了现有SOTA方法必须依赖强架构归纳偏置的传统观念。该方法仅使用简单的端到端视觉Transformer（ViT），无需任何显式几何先验，通过在大规模合成数据集上训练，实现了SOTA精度和更优的运行效率。

Details

Motivation: 解决立体匹配任务中普遍认为必须依赖强架构归纳偏置（如显式几何约束）才能获得高质量结果和计算效率的范式，证明纯数据驱动的学习可以超越显式工程化的几何方法。

Result: 在立体匹配任务上，该方法实现了最先进的（SOTA）精度，并具有更优的运行时间效率。

Insight: 核心创新在于完全摒弃了立体匹配中传统的架构归纳偏置，仅依靠纯数据驱动的ViT模型，证明了显式归纳偏置不再是立体匹配的先决条件，为3D重建的持续改进解锁了真正的缩放定律（scaling laws）。

Abstract: Stereo reconstruction is one of the last remaining Computer Vision tasks where all state-of-the-art methods employ a heavy architectural inductive bias. Even though it has been demonstrated that the task can be solved using general-purpose methods, it is widely believed that inductive biases in stereo are strictly necessary for both high-quality results and computational efficiency. We challenge this paradigm. In this paper, we demonstrate that both state-of-the-art accuracy and superior runtime efficiency are achievable with a model completely devoid of architectural inductive biases, relying instead on a simple, end-to-end Vision Transformer. By training on massive synthetic datasets, we show that pure data-driven learning can surpass explicitly engineered geometry. This work proves that explicit inductive biases are no longer a prerequisite for stereo matching, ultimately unlocking true scaling laws for continuous improvement in 3D reconstruction.

[122] RoSe-SLAM: Robust Semantic-Aware Gaussian Splatting SLAM from Dynamic Monocular Videos cs.CV | cs.AIPDF

Wenting Wang, Jiaxin Guo, Wenzhen Dong, Yun-Hui Liu, Charlie C. L. Wang

TL;DR: RoSe-SLAM是一种鲁棒的语义感知高斯溅射SLAM系统，旨在从动态单目视频中解决传统SLAM因静态假设导致的精度退化问题。它通过利用2D基础模型的语义特征来增强动态跟踪和建图性能，结合时空运动掩码生成、遮挡感知关键帧选择和多视图语义一致性模块，实现了对动态物体的鲁棒分离和高质量静态场景重建。

Details

Motivation: 在动态和非结构化环境中，传统SLAM系统因其静态假设而导致精度显著下降，因此需要一种能够从单目输入中实现整体语义场景理解的方法，以应对动态挑战并实现准确的相机跟踪和几何重建。

Result: 在动态TUM、Bonn和Wild-Mocap等基准数据集上的大量实验表明，该方法在轨迹估计和静态场景建图方面均实现了优越性能，在长期动态室内环境中超越了现有的动态RGB SLAM基线方法。

Insight: 创新点包括利用2D基础模型的语义特征增强动态跟踪和建图，提出时空运动掩码生成模块以分离动态物体和静态背景，以及结合遮挡感知关键帧选择和多视图语义一致性模块来提升建图质量。从客观角度看，该方法通过融合几何运动线索和语义先验，动态过滤不可靠观测并重建准确的静态场景几何，为动态环境下的SLAM提供了有效的解决方案。

Abstract: In dynamic and unstructured environments, conventional SLAM systems generally suffer from significant accuracy degeneration due to their static assumptions. In this work, we propose Robust Semantic-aware Gaussian Splatting SLAM (RoSe-SLAM), to address the dynamic challenge by a holistic semantic scene understanding from uncalibrated monocular inputs, achieving accurate camera tracking and high-quality geometry reconstruction. Unlike conventional semantic SLAM using handcrafted semantic labels, our RoSe-SLAM exploits the semantic feature from 2D foundation model to enhance the dynamic tracking and mapping performance. By distilling the rich semantic features to our Gaussian fields, our method effectively identifies dynamic distractors and achieves semantic-aware multi-view consistency, significantly enhancing the geometric reconstruction and scene inpainting. Specifically, we propose a spatial-temporal motion mask generation module, enabling both long-term motion monitoring and short-term transient dynamics capturing, achieving robust and effective disentanglement of dynamic objects and static backgrounds. During global bundle adjustment, we propose an occlusion-aware keyframe selection mechanism to prioritize the occlusion as metric to pick the keyframes, and a multi-view semantic consistency module to improve the mapping quality in dynamic environments. By combining geometric motion cues with semantic priors, our system dynamically filters unreliable observations and reconstructs accurate static scene geometry. Extensive experiments conducted on benchmark datasets including dynamic TUM, Bonn and Wild-Mocap datasets, demonstrate that our method achieves superior performance in both trajectory estimation and static scene mapping, outperforming existing dynamic RGB SLAM baselines in long-term dynamic indoor environments.

[123] DocIntent: Answerability-Guided Agentic Restoration for Real-World Document Visual Question Answering cs.CV | cs.AIPDF

Zihan Huang, Shihang Wu, Junle Liu, Peirong Zhang, Yongxin Shi

TL;DR: 本文提出DocIntent，一种无需训练的、基于答案可回答性指导的代理修复框架，用于解决真实世界退化文档的视觉问答问题。该框架通过评估问题可回答性、识别任务相关退化并选择性调用修复工具，结合基于比较的回滚机制验证修复步骤，从而提升多模态大语言模型在退化文档上的问答性能。

Details

Motivation: 真实世界的退化（如模糊、阴影、扭曲、摩尔纹）严重损害了多模态大语言模型在文档视觉问答中的能力。现有修复方法多为手动设计且追求感知质量，忽略了修复应服务于下游任务而非通用图像质量指标，而面向自然图像的代理修复框架也未能针对文档VQA任务进行优化。

Result: 在WildDoc基准测试上的大量实验表明，DocIntent能持续提升不同开源和闭源MLLM的平均得分和一致性。

Insight: 创新点在于提出了以答案可回答性为指导的代理修复框架，无需额外预训练的退化分类器或图像质量评估模型；其基于比较的回滚机制能验证修复步骤并防止任务相关证据变得难以辨识，确保了修复服务于下游VQA任务的有效性。

Abstract: Real-world degradations such as blur, shadow, distortion, and moire patterns severely impair the document question-answering capabilities of Multimodal Large Language Models (MLLMs). Applying restoration tools before Visual Question Answering (VQA) is an intuitive solution. However, existing restoration approaches remain limited, as manually designing and executing restoration strategies is labor-intensive and requires domain expertise. Agentic restoration offers new possibilities for automation, yet existing frameworks primarily target natural images and pursue perceptual quality, overlooking that restoration should serve downstream tasks rather than optimize generic image quality metrics. To this end, we explore the value of agentic restoration for real-world degraded document VQA and propose DocIntent, a training-free Answerability-Guided Agentic Restoration framework. DocIntent first assesses question answerability, then identifies task-relevant degradations and selectively invokes restoration tools. A Comparison-Based Rollback mechanism validates each restoration step and reverts it when question-relevant evidence becomes less decipherable. The entire process requires no additional pretrained degradation classifier or image quality assessment model. Extensive experiments on the WildDoc benchmark show that DocIntent consistently improves the average score and consistency of different open- and closed-source MLLMs. The code and experimental data will be publicly available.

[124] AdapToPASS: Ambiguity-aware Adaptive Spherical Transformer for Panoramic Semantic Segmentation cs.CVPDF

Soumyaratna Debnath, Weiming Zhang, Shriram Damodaran, Dingwen Xiao, Addison Lin Wang

TL;DR: 本文提出了一种名为AdapToPASS的新型全景语义分割（PASS）方法，这是一种受生物感知启发的球形Transformer。它通过自适应球形注意力（AdaSpA）块动态建模上下文和几何模糊性，并结合双焦点球形表示和边界监督来提高鲁棒性。该方法在室内外数据集上均超越了现有SOTA方法，尤其在未见过的球形变换下表现出显著优势，并提供了一个轻量级变体AdapToPASS-Swift。

Details

Motivation: 现有球形Transformer通常假设规范的球形结构和稳定视点，但在真实世界图像中，无约束的相机运动会导致上下文和几何模糊性，现有方法缺乏自适应机制来处理这种模糊性，限制了其对未见球形变换的鲁棒性。

Result: 在室内（Stanford2D3D）和室外（WildPASS）语义分割基准测试中，AdapToPASS均优于先前SOTA方法。在未见球形变换下，其相对mIoU分别比次优方法高出+13.38%和+18.77%。其轻量级变体AdapToPASS-Swift（参数少于2M）也超越了紧凑基线并保持了鲁棒性。

Insight: 核心创新是受生物感知启发的自适应机制：1) 自适应球形注意力（AdaSpA）根据局部上下文模糊性动态调节注意力；2) 双焦点球形表示平衡视野和空间分辨率以处理几何模糊性；3) 引入边界监督，模仿生物视觉的边界敏感性。这些设计共同增强了模型对复杂球形变换的适应能力。

Abstract: Spherical Transformers have emerged as a promising framework for panoramic semantic segmentation (PASS) by operating directly on spherical geometry and alleviating projection-induced distortions. However, existing architectures often assume canonical spherical structure and stable viewpoints, which are frequently violated in real-world imagery due to unconstrained camera motion, introducing contextual and geometric ambiguity. Consequently, they lack adaptive mechanisms to handle such ambiguity, limiting robustness to unseen spherical transformations. In contrast, biological perception is inherently ambiguity-aware, adapting to fluctuations in cue reliability caused by geometric and contextual variations to maintain stable interpretation under complex transformations. Motivated by this, we first systematically analyze existing PASS architectures under various unseen spherical transformations. We then introduce AdapToPASS, a novel bio-inspired Spherical Transformer that adaptively models contextual and geometric ambiguities for robust PASS. At its core, Adaptive Spherical Attention (AdaSpA) blocks dynamically modulate attention according to local contextual ambiguity, mimicking adaptive, context-driven biological perception. To address geometric ambiguity, AdapToPASS employs Bifocal Spherical Representation to balance field of view and spatial resolution, together with boundary supervision inspired by the boundary-sensitive nature of biological vision. Across indoor and outdoor semantic segmentation, AdapToPASS consistently outperforms prior state-of-the-art methods. Under unseen spherical transformations, it surpasses the next-best method by +13.38% relative mIoU on Stanford2D3D and +18.77% on WildPASS. We further introduce AdapToPASS-Swift, a lightweight variant with fewer than 2M parameters, which surpasses compact baselines while retaining robustness to spherical transformations.

[125] Dancing Stick Figures: An Introductory Dataset for Training Video Generation Models cs.CVPDF

Jin Hyuk Cho

TL;DR: 论文提出了一个名为‘Dancing Stick Figures’的合成视频数据集，旨在解决视频生成模型训练中的迭代速度慢、数据获取困难和评估模糊三大挑战。该数据集包含64x64分辨率、64帧的视频片段，并附带丰富的注释（如关节位置、深度图、表面法线和部件标签），以支持快速训练和精确评估。

Details

Motivation: 视频生成模型的训练面临反馈循环长、数据难以获取（大型语料库常未公开）以及评估标准模糊（开放式生成无单一正确答案）等问题，这阻碍了模型开发和迭代效率。

Result: 论文未在摘要中提及具体的定量实验结果或基准测试比较，但通过发布数据集（包括4,020个视频剪辑、检查点和Colab工作流），为快速训练和评估提供了实用工具，支持数据集特定的指标（如可见拓扑和部件运动分析）。

Insight: 创新点在于设计了一个轻量级、注释丰富的合成视频数据集，通过确定性生成流程和多样化标注（如深度和部件标签），实现了快速迭代和精细评估，有助于降低视频生成研究的入门门槛。

Abstract: Training a video-generation model from scratch is hard for reasons that precede model design. The feedback loop is long: a failure that appears only after a training run can make each attempted fix another run. The data are hard to reach: the corpora and recipes behind strong models are large, heterogeneous, and often unreleased. And scoring is blunt: open-ended generation has no single correct output, and an aggregate score does not by itself establish whether a sample succeeds or which property failed. Dancing Stick Figures is a synthetic video dataset built against these three obstacles. For iteration speed, its 64x64, 64-frame reference task is sized for practical repeated training on a single workstation GPU. For accessibility, the release is a 0.79-GB training tier of 4,020 video clips–1,340 six-second source motions, each rendered from three cameras by a deterministic dataset-generation harness–with checkpoints and a Colab workflow that reruns the reference training pipeline at reduced budget on a 16 GB Tesla T4. For scoring, every frame retains its generating state (ARDY cskel27 joint positions, camera, body parameters, and source motion) and per-pixel depth, surface normals, and part labels. These annotations support dataset-specific metrics for visible topology and part-wise motion; corruptions expose their sensitivities and blind spots.

[126] Acoustically Grounded Cost Learning for Open-Vocabulary Audio-Visual Semantic Segmentation cs.CVPDF

Tianrui Hui, Shaofei Huang, Qisong Han, Yaxiong Wang, Lechao Cheng

TL;DR: 本文提出了声学引导代价学习（AGCL）框架，用于解决开放词汇音频-视觉语义分割（OV-AVSS）任务。该方法将静态的、音频无关的视觉-文本先验转换为动态的、基于音频的代价表示，通过音频调制代价生成（AMCG）和音频引导时序聚合（AGTA）模块实现帧级发声区域突出和视频级时序细化，并引入协同干扰挖掘（SDM）策略来惩罚声学和语义上混淆的负类别，从而学习更具判别性的决策边界。

Details

Motivation: 现有方法依赖于类别无关的前景定义，将语义多样的对象归入异质的正样本集，导致模型学习不稳定的发声模式并产生不可靠的提议。本文旨在解决这一问题，将目标重新定义为类别特定的，以提升分割的准确性和可靠性。

Result: 在AVSBench-OV数据集上的大量实验表明，该方法显著优于之前的最先进方法，特别是在未见类别上取得了更好的性能。

Insight: 创新点在于将音频信息动态地融入视觉-文本先验，通过音频调制和时序聚合实现精细化的发声区域定位，以及通过协同干扰挖掘策略增强类别间的判别能力，从而在开放词汇场景下提升音频-视觉语义分割的泛化性和鲁棒性。

Abstract: Open-Vocabulary Audio-Visual Semantic Segmentation (OV-AVSS) aims to perform pixel-level segmentation of sound-emitting objects from an open set of categories. The previous method relies on a class-agnostic foreground definition, which groups semantically diverse objects into a heterogeneous positive set, causing the model to learn unstable sounding patterns and produce unreliable proposals. To address this, we reformulate the objective to be category-specific and propose a novel Acoustically Grounded Cost Learning (AGCL) framework to transform the static, audio-agnostic visual-text priors into dynamic, audio-grounded cost representations. For intra-category soundingness discovery, we devise Audio-Modulated Cost Generation (AMCG) and Audio-Guided Temporal Aggregation (AGTA) modules to enable both frame-level sounding region highlighting and video-level temporal refinement with a low-intrusive audio injection mechanism. For inter-category distractor discrimination, we introduce a Synergistic Distractor Mining (SDM) strategy, which selectively penalizes acoustically and semantically confusing negative categories to learn more discriminative decision boundaries. Extensive experiments on the AVSBench-OV dataset demonstrate that our method significantly outperforms previous state-of-the-art approaches, particularly on unseen categories. Code is available at https://github.com/spyflying/AGCL.

[127] Efficient Language-to-Vision Feature Injection for Referring Single-Object Tracking cs.CVPDF

Han Wang, Yuxuan Liu, Yuhan Sun, Jian Yang, Xiaotong Xu

TL;DR: 本文提出LVTrack，一种用于指称单目标跟踪的纯Transformer框架，通过模式条件门控特征注入器自适应调节文本引导以缓解语义漂移，并直接利用冻结的视觉语言预训练模型降低训练成本。

Details

Motivation: 指称单目标跟踪需要跨阶段差异化使用语言：初始化时语言不可或缺，但跟踪中过度强调会导致语义漂移；同时现有方法通常需要昂贵的视觉语言对齐训练。

Result: 在标准基准测试上的大量实验表明，LVTrack实现了强劲的性能。

Insight: 创新点包括模式条件门控特征注入器、混合相对-绝对位置编码与轻量级记忆机制的结合，以及使用高斯平滑KL损失优化自回归框预测，这些设计有效平衡了语言引导并提升了时序定位能力。

Abstract: Referring single-object tracking enables language-grounded target initialization and subsequent tracking by jointly leveraging semantic cues and visual templates. The core difficulty is to use language differently across stages: it is indispensable for grounding but can induce semantic drift during tracking when overemphasized. Meanwhile, current methods often require costly vision-language alignment training. We present LVTrack, a pure transformer framework that introduces a mode-conditioned Gated Feature Injector to adaptively regulate textual guidance and alleviate semantic drift. Together with targeted adaptations, it directly harnesses a frozen vision-language pretrained model, greatly reducing training cost and preserving strong language understanding. To further improve temporal localization, LVTrack integrates hybrid relative-absolute positional encodings with a lightweight memory mechanism and optimizes autoregressive box prediction using a Gaussian-smoothed KL loss. Extensive experiments on standard benchmarks demonstrate that LVTrack achieves strong performance.

[128] Chat-Edit-3D++: Interactive 3D and 4D Scene Editing via Large Language Models cs.CVPDF

Shuangkang Fang, Yufeng Wang, Yi-Hsuan Tsai, Wenrui Ding, Yi Yang

TL;DR: 本文提出了CE3D++，一个基于大语言模型的交互式3D和4D场景编辑框架。其核心是Hash-Atlas网络，它将3D编辑解耦为2D图集图像操作和3D重建两个过程，并利用LLM理解用户任意文本输入，自主调度多达30种不同的视觉工具来完成编辑任务。

Details

Motivation: 现有文本驱动的3D场景编辑方案存在灵活性不足（输入模式固定）和编辑能力受限（依赖单一或少数2D视觉模型，且需要复杂流程设计）的问题，阻碍了其作为交互式设计工具的发展。

Result: 实验表明，CE3D++能有效集成多种视觉模型实现多样化的视觉编辑效果，并具备强大的场景理解和多轮对话能力。

Insight: 主要创新点在于：1）提出Hash-Atlas网络，将3D编辑解耦为2D图集操作，简化了流程；2）构建以LLM为中心的对话式编辑框架，允许任意文本输入并自主调度视觉工具；3）将方法扩展到单目4D场景，通过对运动物体施加约束并微调LLM来精确调度工具。

Abstract: Recent work on image content manipulation based on vision-language pre-training models has been effectively extended to text-driven 3D scene editing. However, existing schemes for 3D scene editing still have certain shortcomings, hindering their further development as interactive design tools. Such schemes typically adhere to fixed input patterns, limiting flexibility in text input. Furthermore, their editing capabilities are constrained by a single or a few 2D visual models and require intricate pipeline design to integrate these models into 3D reconstruction processes. To address the aforementioned issues, we propose the Hash-Atlas network, which reformulates 3D scene editing as operations on 2D atlas images, thereby achieving a workflow decoupling of the 2D editing and 3D reconstruction processes. Building on this foundation, we introduce a dialogue-based 3D scene editing approach, termed CE3D++, which is centered on a large language model (LLM) that allows arbitrary textual input from users and interprets their intentions, subsequently facilitating the autonomous invocation of the corresponding visual models. Additionally, we extend CE3D++ to monocular 4D scenes by imposing motion constraints on moving objects and further fine-tuning the LLM by creating a trajectory dataset related to editing tasks, which enables the smaller LLM to schedule up to 30 different visual tools accurately. Experimental results demonstrate that CE3D++ effectively integrates multiple visual models to achieve diverse visual editing effects, possessing strong scene comprehension and multi-round dialog capabilities. The source codes and trained models are available at https://github.com/Fangkang515/CE3D.

[129] Subtraction-Based Tumor Segmentation and Lesion-Centered pCR Prediction for the MAMA-MIA Challenge cs.CV | cs.AI | cs.LGPDF

Kai Geissler, Raphael Schäfer

TL;DR: 本文介绍了团队FME在MAMA-MIA挑战赛中的提交方案，该挑战赛旨在从治疗前的动态对比增强乳腺MRI中分割原发肿瘤并预测病理完全缓解（pCR）。团队采用了基于减影图像的nnU-Net集成方法进行分割，以及基于病灶中心裁剪的3D视频分类器集成方法进行pCR预测，最终在两个任务中均获得第二名。

Details

Motivation: 解决在跨国家、多中心的外部队列中，从预处理DCE-MRI中实现稳健的肿瘤分割和pCR预测的挑战，以评估方法在真实世界临床环境中的泛化能力。

Result: 在MAMA-MIA挑战赛中，分割任务获得了0.882的综合性能-公平性分数（Dice 0.713，归一化豪斯多夫距离0.099），pCR预测任务获得了0.664的综合分数（平衡准确率0.541，均衡几率差异0.212），两个任务均排名第二。

Insight: 创新点在于使用基于减影（首期后减影前）的单一图像输入结合nnU-Net集成来增强分割的鲁棒性，以及采用病灶中心裁剪和预训练3D视频分类器集成进行pCR预测。客观分析表明，减影输入和集成策略能有效应对跨站点域偏移，但仅基于基线DCE-MRI的pCR预测性能仍有局限。

Abstract: We describe the submission of team FME to the MAMA-MIA Challenge, which evaluated primary tumor segmentation and prediction of pathological complete response (pCR) from pretreatment dynamic contrast-enhanced breast MRI on an external multi-country cohort. For segmentation, we trained a five-fold residual-encoder nnU-Net ensemble using only the first post-contrast minus pre-contrast image, combined with mirroring test-time augmentation and largest-connected-component filtering. For pCR prediction, we ensembled 25 pretrained 3D video classifiers trained on lesion-centred crops from the pre-contrast and first two post-contrast volumes. FME ranked second in both tasks. The segmentation method achieved a combined performance-fairness score of 0.882, with Dice 0.713 and normalized Hausdorff distance 0.099. The pCR method achieved a combined score of 0.664, balanced accuracy of 0.541, and equalized-odds disparity of 0.212. The results indicate that subtraction-based input and ensembling support robust tumor segmentation under cross-site domain shift, whereas pCR prediction from baseline DCE-MRI alone remains limited. For the submission repository, see https://github.com/FraunhoferMEVIS/MAMA-MIA-Challenge-FME

[130] Foundational feature fusion for conditional flow matching in 6D pose estimation cs.CVPDF

Amir Hamza, Davide Boscaini, Fabio Poiesi

TL;DR: 本文提出FunFlow6D，一种基于条件流匹配的6D物体姿态估计新方法。它利用几何和外观基础模型的特征，无需训练任务特定编码器，并通过跨注意力机制动态融合这些特征来增强条件信息。在BOP基准的四个数据集上，该方法超越了现有最佳性能，同时减少了监督需求和内存开销。

Details

Motivation: 现有基于条件流匹配的姿态估计方法需要训练任务特定的编码器，并依赖简单的特征融合策略来解决姿态模糊性问题。本文旨在消除对任务特定编码器训练的依赖，并设计更有效的特征融合机制。

Result: 在BOP基准的四个数据集上进行实验，FunFlow6D的性能超越了之前的最先进方法（SOTA）。广泛的消融实验验证了所提各组成部分的有效性。

Insight: 核心创新点在于利用预训练的基础模型（几何和外观）特征，避免了任务特定编码器的训练开销。同时，引入基于跨注意力的动态特征融合机制，为流匹配模块提供了更丰富的条件信息，这比简单的融合策略更有效。

Abstract: Conditional flow matching has enabled a step forward in object 6D pose estimation, achieving state-of-the-art performance by progressively denoising and registering object representations to observed scenes. Existing methods require training task-specific encoders supervised on object-scene overlap and rely on trivial feature fusion strategies to resolve pose ambiguities. We present FunFlow6D, a novel flow matching-based formulation that leverages features from geometric and appearance foundation models for pose estimation, eliminating the need for task-specific encoder training. We also introduce a cross attention-based fusion mechanism that dynamically combines geometric and appearance features to provide richer conditioning for the flow matching module. Experiments on four datasets from the BOP benchmark show that FunFlow6D outperforms the previous state of the art while reducing supervision requirements and memory overhead. Extensive ablations validate the contribution of each proposed component. Project website: https://tev-fbk.github.io/FunFlow6D/.

[131] Multi-Scale Temporal Domain Alignment for Federated Video Domain Adaptation cs.CVPDF

Lee En-Yi Hannah, Haozhi Cao, Yuecong Xu

TL;DR: 本文提出了一种名为METAL的多尺度时序域对齐框架，用于解决联邦视频域适应（FVDA）中时序信息对齐的挑战。该框架通过在多个时间分辨率上利用时序信息，仅通过模型参数传输来提升跨域视频动作识别的性能。

Details

Motivation: 联邦视频域适应（FVDA）允许在分布式和非独立同分布视频数据集上进行协作学习并保护隐私，但由于时序信息对齐的困难，该领域尚未得到充分探索。

Result: 在Epic-Kitchens-55和Daily-DA数据集上的实验表明，METAL取得了最先进的性能，比当前FDA方法提升了高达28.47%。消融研究证明多尺度蒸馏和尺度协调对于有效的时序知识传递至关重要。

Insight: 创新点包括：利用多尺度Transformer编码器提取时序信息；通过独立知识投票生成鲁棒伪标签；引入L2方差惩罚确保跨尺度一致性；以及通过置信度加权聚合的后期融合有效利用互补时序信息。

Abstract: Federated Video Domain Adaptation (FVDA) enables collaborative learning across distributed and non-IID video datasets while preserving privacy, but is under-explored due to challenges in aligning temporal information. We propose Multi-scalE Temporal domAin aLignment (METAL), a novel framework that leverages temporal information at multiple resolutions to improve cross-domain video action recognition with only model parameter transfers. METAL trains per-scale transformer encoders on source-clients, then performs independent knowledge voting at each temporal scale to generate robust pseudo-labels on the target-server. A novel $L_2$ variance penalty enforces cross-scale consistency during scale-based knowledge distillation, preventing a singular dominant scale. The late fusion aggregates features across different scales, where the fusion head is trained via knowledge distillation using confidence-weighted aggregation of scale-wise predictions, enabling the model to effectively exploit complementary temporal information for final predictions. Experiments on Epic-Kitchens-55 and Daily-DA demonstrate state-of-the-art performances, with gains up to 28.47% over current FDA methods. Ablation studies prove that multi-scale distillation and scale coordination are critical for effective temporal knowledge transfer.

Haozhen Wei, Chengjun Jiang, Yutong Guo, Xinrui Ju, Xingyuan Li

TL;DR: SGPDFuse是一种多模态图像融合方法，通过基于预训练视觉基础模型构建的语义-物理参数桥（SPPB），将输入映射到物理解缠的结构表示中，利用本征-变化原理解耦不变场景属性和瞬态环境因素。该方法引入语义对齐机制，通过余弦相似度将融合表示锚定到基础模型特征空间中的显著语义特征以保留关键目标，同时通过Gram矩阵正则化强制物理纹理保真以消除不自然伪影。

Details

Motivation: 现有大多数多模态图像融合方法依赖于盲特征聚合，擅长信号累积但无法区分本质内容和物理退化，SGPDFuse旨在通过物理解缠和语义引导来弥补这一差距。

Result: 在红外-可见光、多焦点和多曝光基准测试上的广泛实验表明，SGPDFuse使用单一架构实现了最先进的性能。

Insight: 创新点在于利用预训练基础模型构建语义-物理参数桥进行物理解缠，并结合语义对齐机制（余弦相似度锚定和Gram矩阵正则化）来同时保证语义内容保留和物理纹理保真，实现了通用且高性能的多模态融合。

Abstract: Multimodal image fusion (MMIF) aims to integrate complementary sensor data into a single representation that preserves intrinsic scene reality while eliminating environmental interferences. Most existing approaches rely on blind feature aggregation, which excels at signal accumulation but fails to distinguish essential content from physical degradations. We propose SGPDFuse, which bridges this gap by mapping inputs into a physics-disentangled structural representation via a Semantic-Physical Parametric Bridge (SPPB) built on pretrained vision foundation models, utilizing the Intrinsic-Variation principle to decouple invariant scene attributes from transient environmental factors. To guide this decomposition, we introduce a Semantic Alignment mechanism: we explicitly anchor the fused representation to salient semantic features in the same foundation model feature space via cosine similarity to preserve critical targets, while enforcing physical texture fidelity through Gram-matrix regularization to strictly eliminate unnatural artifacts. Extensive experiments demonstrate that SGPDFuse achieves state-of-the-art performance across infrared-visible, multi-focus, and multi-exposure benchmarks using a single architecture.

[133] RLG-TPV: Radar- and LiDAR-Guided Tri-Perspective View Fusion for Camera-Radar 3D Object Detection cs.CVPDF

Ahmet Mete Dokgoz, A. Enes Doruk, Hasan F. Ates

TL;DR: 本文提出RLG-TPV，一种用于相机-雷达3D目标检测的多模态TPV（三视角）表示框架。该框架利用雷达和训练时的激光雷达为TPV表示构建提供互补的几何引导，包括通过射线引导的可变形注意力机制融合图像特征，以及基于雷达径向速度的多普勒引导时序融合。在推理时仅需相机和雷达，无需激光雷达。

Details

Motivation: 现有基于相机的TPV表示在沿相机射线采样图像证据时存在深度模糊性问题，而雷达和激光雷达能提供互补的几何信息。本文旨在融合相机、雷达和（训练时）激光雷达的数据，以构建更精确的3D场景表示，从而提升3D目标检测性能。

Result: 在nuScenes验证集上，RLG-TPV实现了0.4981 mAP和0.5959 NDS，相对于已发表的CRN基线，方向误差和速度误差分别降低了31.9%和30.7%。消融研究表明，射线级别的几何引导是最终性能的主要贡献者。

Insight: 创新点在于：1) 提出射线引导的可变形注意力提升机制，利用激光雷达监督的相机深度概率和雷达视锥体占用率来加权图像特征；2) 引入多普勒引导的时序融合，利用测量的雷达径向速度作为运动场来对齐过去特征；3) 采用RCS（雷达散射截面）感知的雷达散射机制，使雷达证据能根据RCS在空间邻域内传播。这些机制实现了多模态信息的有效几何引导融合。

Abstract: Tri-Perspective View (TPV) representations describe 3D scene structure through top, side, and front feature planes, but existing TPV lifting is primarily camera-based, leaving the depth of sampled image evidence ambiguous along projected camera rays. We propose RLG-TPV, a multimodal TPV framework for camera-radar 3D object detection in which radar and training-time LiDAR provide complementary geometric guidance during representation construction. A ray-guided deformable-attention lift weights sampled image features using LiDAR-supervised camera depth probabilities and radar frustum occupancy, while radar additionally refines the depth distribution before lifting. Because conventional radar provides limited elevation information, LiDAR-derived class-occupancy targets supervise the side and front planes during training; the corresponding heads are removed at inference, so deployment requires only cameras and radar. For temporal aggregation, Doppler-guided temporal fusion aligns past features using a motion field anchored by measured radar radial velocity, with gating that limits warping in regions without supported motion. An RCS-aware radar scatter further allows radar evidence to spread over spatial neighborhoods conditioned on radar cross section. On the nuScenes validation set, RLG-TPV achieves 0.4981 mAP and 0.5959 NDS, reducing orientation and velocity error by 31.9% and 30.7% relative to the published CRN baseline. Ablation studies show that ray-level geometric guidance is a major contributor to the final performance.

[134] Background-Free Objectness Learning for Class-Agnostic Detection cs.CV | cs.AI | cs.ROPDF

Dania Batool, Liliana Lo Presti, Marco La Cascia, Filippo Vella

TL;DR: 本文提出了一种背景无关的目标性学习（B-FOR）框架，用于解决类别无关检测中因标注不完整导致的目标性偏差问题。该方法通过预测密集的多尺度目标中心和尺度场来生成目标假设，避免了对未标注区域进行显式背景监督，从而学习通用的目标结构。

Details

Motivation: 传统目标检测器在闭集监督下训练，将未标注区域隐式视为背景，当标注不完整时，会导致目标性偏差，即视觉上有效但未标注的目标被用作负样本，使得目标性学习与标注类别而非通用目标结构绑定。这在类别无关和开放世界检测中尤为严重。

Result: 在PASCAL VOC、MS-COCO和Open Images数据集上的实验表明，B-FOR对未见类别和跨数据集目标分布具有强泛化能力，相比之前的类别无关基线，召回率（AR）提升了超过10个百分点。消融研究证实了局部目标性监督和位移感知尺度场的关键作用。

Insight: 创新点在于提出了背景无关的目标性学习范式，通过空间结构化的软目标将监督限制在可靠标注区域，避免了前景-背景区分；并引入了位移感知尺度场，将目标范围建模为学习到的目标性场的空间变化属性，从而支持从局部极值解码目标假设。这为处理不完整标注下的类别无关定位提供了新思路。

Abstract: Object detectors are typically trained under closed-set supervision, where unlabeled regions are implicitly treated as background. Under incomplete annotations, this assumption introduces objectness bias: visually valid but unlabeled objects are used as negatives, tying objectness to the annotated taxonomy rather than generic object structure. This limitation is particularly problematic for class-agnostic and open-world detection. This paper proposes Background-Free Objectness Learning (B-FOR), a dense class-agnostic detection framework that learns objectness without explicit background supervision on unlabeled regions. B-FOR formulates detection as the prediction of dense multi-scale object-center and scale fields, from which object hypotheses emerge as local spatial structures. Supervision is confined to reliable annotated regions through spatially structured soft targets, avoiding foreground-background discrimination. To support decoding from emergent local maxima, the paper further introduces displacement-aware scale fields that model object extent as a spatially varying property of the learned objectness field. Experiments on PASCAL VOC, MS-COCO, and Open Images demonstrate strong generalization to unseen categories and cross-dataset object distributions. B-FOR improves recall by more than +10 AR points over prior class-agnostic baselines. Ablation studies show that both localized objectness supervision and displacement-aware scale fields are critical for class-agnostic localization under incomplete annotations. Code available at: https://github.com/Daniaawan/B-FOR.

[135] AGRICAM: A Track-Mounted Crop Pollination Monitoring Robot cs.CV | cs.AI | cs.RO | eess.SY | q-bio.QMPDF

Malika Nisal Ratnayake, Adel N. Toosi, James Cook, Romina Rader, Alan Dorin

TL;DR: 本文介绍了AGRICAM，一种用于大规模作物授粉监测的自主轨道机器人系统。该系统集成了多种传感器和计算机视觉技术，能够在商业农场环境中自动采集和分析昆虫授粉活动数据，以支持数据驱动的农业管理决策。

Details

Motivation: 昆虫授粉对全球粮食生产至关重要，但在商业农场规模上监测授粉活动仍面临挑战，需要在监测细节、空间覆盖范围以及人力或技术资源之间进行权衡。

Result: 该系统在商业蓝莓农场进行了部署测试，成功地在30小时内绘制了80米长工业塑料隧道内的昆虫授粉模式，数据证实了隧道内授粉昆虫的均匀分布，并揭示了昆虫活动与一天中的时间和微气候相关的变化。

Insight: 创新点在于设计了一个低成本、易于安装、可自主运行的轨道机器人平台，实现了对大规模保护性种植系统中授粉活动的自动化、非侵入式监测，并结合云分析和计算机视觉模型进行量化分析，为精准农业管理提供了可扩展的解决方案。

Abstract: Insect pollination is critical for global food production, yet monitoring pollinators at commercial farm scale remains a challenge. Recent advances in computer vision and deep learning have enabled detailed analysis of pollinator behaviour, but monitoring must trade-off detail against spatial coverage and human or technological resources. This paper presents the Automated Guided Robot for Insect and Crop Activity Monitoring (AGRICAM), a purpose-built robotic system designed to meet the requirements of large-scale pollination monitoring in protected cropping systems. AGRICAM operates autonomously on low-cost, easily installed track for movement along crop rows, without disrupting farm operations or insect behaviour. The platform integrates two RGB cameras, microclimate sensors, GPS and RFID modules, motion sensors, and 4G cellular network connectivity for data transmission. A web interface enables remote device configuration and scheduling. The system autonomously captures video and image data of insects’ locations and local environmental conditions. These are transferred to the cloud and analysed using computer vision models to quantify pollinator visitation and spatio-temporal activity variation. We deployed the system on a commercial blueberry farm to demonstrate and test its capability. It successfully mapped insect pollination patterns across 80 m long industrial polytunnels over 30 hours. This data enabled spatial analyses of insect activity we used to confirm a uniform pollinator distribution within polytunnels, as desired by the farm management team. The data also highlighted variation of insect activity associated with time of day and microclimate. AGRICAM therefore has been shown to be a scalable, automated crop pollination monitor that can support data-driven decisions to enhance pollination management, thereby improving crop productivity and food security.

[136] Uncertainty-Aware Multimodal Anti-UAV Detection via Evidential Fusion and Conflict-Discounted Belief Aggregation cs.CVPDF

Sharanda Suttorp, Seyed Sahand Mohammadi Ziabari, Ali Mohammed Mansour Alsahag

TL;DR: 本文提出了一种基于证据深度学习和折扣信念融合的多模态反无人机检测方法，用于融合RGB和热成像数据。该方法通过建模预测不确定性来处理传感器退化或模态冲突的情况，在Anti-UAV基准测试中实现了优于单模态的性能和实时速度。

Details

Motivation: 现有的多模态反无人机系统通常对RGB和热成像流进行确定性融合，缺乏对预测不确定性的建模，无法在模态间出现分歧时表达怀疑。本文旨在解决传感器在遮挡、快速运动或特定模态故障下可靠性下降的问题。

Result: 在Anti-UAV基准测试上，多模态融合（测试准确率0.670）持续优于单红外（0.604）或单RGB（0.598）流，且保持实时速度（至少38 FPS）。融合不确定性校准良好（ECE 0.057），但作为定位失败检测器弱于空间方差方法（AUROC 0.626 vs. 0.739）。

Insight: 创新点在于将证据深度学习扩展到多模态RGB-热成像感知，并提出折扣信念融合方法，将模态间冲突转化为不确定性质量后再聚合。一个关键发现是，在目标普遍存在的数据集上，模态间冲突近乎为零，导致冲突感知融合的收益有限，这为该方法的应用范围提供了重要诊断。

Abstract: Anti-UAV perception systems must remain reliable when sensor streams degrade under occlusion, fast motion, or modality-specific failure. Existing multimodal anti-UAV systems fuse RGB and thermal streams deterministically, without modeling predictive uncertainty, and cannot express doubt when streams disagree. Evidential Deep Learning (EDL) produces calibrated per-class uncertainty in a single forward pass. EDTC already exploits this for thermal-only perception, yet cross-modal evidential fusion remains unaddressed. This paper extends EDTC to multimodal RGB-Thermal perception via Discounted Belief Fusion (DBF), which converts inter-modal conflict into uncertainty mass before aggregating stream opinions. Bounding boxes are resolved by selecting the lower-uncertainty modality. On the Anti-UAV benchmark, multimodal fusion consistently outperforms either single stream (test Acc 0.670 vs. 0.604 IR, 0.598 RGB) at real-time speed (at least 38 FPS). However, DBF is empirically indistinguishable from undiscounted averaging: near-zero inter-modal conflict on this presence-dominated benchmark leaves the discounting step inert. The fused uncertainty is well-calibrated (ECE 0.057) yet expectedly a weaker localization failure detector than spatial variance (AUROC 0.626 vs. 0.739). The null result is structural: the benchmark’s near-universal presence and vacuous miss-encoding jointly suppress inter-modal conflict, a diagnosis that delimits where conflict-aware fusion provides measurable benefit.

[137] DARD: Zero-Shot Degradation-Aware Retinex-Guided Diffusion for Low-Light Image Enhancement cs.CVPDF

Wenjie Cai, Yuezhe Yang, Jianyang Xia, Xingbo Dong, Zhe Jin

TL;DR: 本文提出了一种名为DARD的零样本退化感知Retinex引导扩散框架，用于低光照图像增强。该方法通过测试时退化感知Retinex分解提取图像特定的物理先验，作为可靠的场景约束，并通过时间步自适应频率融合策略将这些先验注入反向扩散过程，最后结合物理一致性和CLIP语义引导进行细化，以抑制结构伪影和语义漂移。

Details

Motivation: 现有基于扩散的低光照图像增强方法在零样本设置下缺乏可靠的场景约束，导致结构不一致和颜色漂移问题；而传统Retinex模型虽提供可解释的物理先验，但难以处理真实场景中的混合退化。

Result: 在多个真实世界低光照基准测试中，DARD在失真和感知性能上均优于现有零样本基线方法；在下游语义分割任务中，DARD增强的图像比AGLLDiff在mIoU上实现了28.10%的相对提升。

Insight: 创新点包括：测试时退化感知Retinex分解提取物理先验作为结构指导，时间步自适应频率融合策略平衡结构锚定与细节生成，以及结合物理一致性和CLIP语义引导的细化过程。这为零样本低光照增强提供了可解释且有效的约束机制。

Abstract: Existing diffusion-based enhancement methods provide strong generative capability for low-light image enhancement (LLIE), yet they either rely on paired supervision or lack reliable scene constraints in zero-shot settings, often leading to structural inconsistency and color drift. Motivated by conventional Retinex models, which offer physically interpretable priors that can serve as reliable scene constraints yet struggle with mixed degradations in real-world scenarios, we propose DARD, a zero-shot Degradation-Aware Retinex-guided Diffusion framework for LLIE. DARD first extracts image-specific physical priors from the degraded input through a test-time degradation-aware Retinex decomposition, thereby providing reliable structural guidance for zero-shot restoration. It then injects these priors into reverse diffusion through a timestep-adaptive frequency fusion strategy to balance structural anchoring and detail generation. Finally, a guided reverse refinement process with physical consistency and Contrastive Language-Image Pre-training (CLIP)-based semantic guidance is introduced to suppress structural artifacts and semantic drift during sampling. Extensive experiments show that DARD achieves strong distortion and perceptual performance and consistently outperforms existing zero-shot baselines across multiple real-world low-light benchmarks. To further validate the practical utility of our method for downstream applications, we evaluated its impact on semantic segmentation. Experiments demonstrate that images enhanced by DARD achieve a 28.10% relative improvement in mIoU over AGLLDiff.

[138] QCell: Recombining and Aligning Cell Queries for Overlapping Instance Segmentation cs.CV | cs.AI | cs.LGPDF

Yaroslav Prytula, Anton Popov, Dmytro Fishman

TL;DR: QCell是一种基于查询的模型，用于解决显微镜图像中重叠细胞实例分割的挑战。该方法通过实例重组模块在潜在空间中分解和重组查询表示，并结合对比查询对齐目标来学习区分性特征并分离重叠细胞查询。此外，论文还引入了新的Organoid数据集基准，用于评估重叠细胞分割性能。

Details

Motivation: 显微镜图像中重叠细胞的实例分割因半透明结构导致弱边界和重叠区域视觉证据混合而具有挑战性。现有方法依赖于局部感兴趣区域或形状先验，但缺乏对重叠对象的全局推理。

Result: QCell在多个基准测试中优于最先进方法，在ISBI2014数据集上实现了+2.2 AP和+2.7 AJI的提升，并在新引入的Organoid数据集上表现出色。

Insight: 创新点包括实例重组模块，通过潜在空间操作实现重叠下完整对象结构的推理，以及对比查询对齐目标，结合了区分性特征学习和重叠查询分离。这些方法增强了模型对重叠细胞的全局理解能力。

Abstract: Instance segmentation of overlapping cells in microscopy remains challenging due to semi-transparent structures that produce weak boundaries and mixed visual evidence in overlap regions. Existing methods address this through local regions of interest or shape priors but lack global reasoning across overlapping objects. We present QCell, a novel query-based model that de-overlaps cell instances in microscopy scenes. Our approach combines (i) an instance recombination module that decomposes and recombines query representations in latent space, enabling the model to reason about complete object structure under overlap, and (ii) a contrastive query alignment objective that combines distinctive instance feature learning and separation of overlapping cell queries. We additionally introduce a new Organoid dataset benchmark for overlapping cell segmentation. We show that QCell outperforms state-of-the-art methods across multiple benchmarks, achieving +2.2 AP and +2.7 AJI on ISBI2014. Code is available at https://github.com/SlavkoPrytula/QCell

[139] Learning to Ground Before Reading: Unified PCB Engineering Drawing Parsing with Compact Vision-Language Models cs.CV | cs.MMPDF

Jinghao Liu, Xingrun Liu, Gengchen Sun, Han Xiao, Xingyu Chen

TL;DR: 本文提出了一种名为G-Unified的紧凑视觉语言模型，用于统一解析PCB工程图纸。该方法无需检测器或裁剪解析器，而是直接读取整页图像，输出区域类别、归一化边界框以及文本或HTML内容序列。为了解决联合优化中类别/框标记稀疏导致的训练困难，论文提出了定位优先的课程学习方法，先学习类别-框格式，再引入内容目标。

Details

Motivation: PCB工程图纸包含稀疏图形、密集表格和依赖页面位置的文本，现有解析器通常依赖区域定位和裁剪后送交专用识别器，导致下游无法恢复遗漏区域。因此，需要一种能够直接解析整页图纸、避免依赖检测器的统一方法。

Result: 在工程图纸数据集（ED数据集）的固定验证集上，定位优先课程学习相比联合训练将严格定位F1提高了0.0955（配对图像自举95%区间：[0.0350, 0.1572]）。G-Unified模型取得了最低的归一化编辑距离（NED）、最高的单元格F1，并且是唯一具有非零精确匹配分数的模型，为全页PCB图纸解析提供了一个无检测器的基线。

Insight: 创新点在于提出了一种无检测器的全页PCB图纸统一解析框架，将边界框坐标转化为监督标记，并设计了定位优先的课程学习策略以缓解联合目标中稀疏标记的优化难题。该方法通过内容感知重采样，有效协调了稀疏的定位标记与长内容序列的学习。

Abstract: PCB engineering drawings mix sparse graphics, dense tables, and text whose meaning depends on page position. Localizing the regions and sending crops to specialized recognizers are determined as the methods for most parsers, so missed regions cannot be recovered downstream. We train a compact VLM to read the full page and get a sequence of region classes, normalized boxes, and text or HTML content. Bounding boxes are converted to coordinate tokens for supervision. Inference uses no detector or crop parser. The joint target is difficult to optimize because class and box tokens are sparse relative to the much longer content sequences. Our localization-first curriculum learns the class-box format before adding content targets with content-aware resampling. On the fixed validation split of the Engineering Drawing Dataset (ED dataset), Localization-First improves strict localization F1 by 0.0955 over joint training (paired image-bootstrap 95% interval: [0.0350, 0.1572]). G-Unified has the lowest NED, highest cell F1, and only nonzero exact-match score. It provides a detector-free baseline for full-page PCB drawing parsing.

[140] RAGDiffusion++: From Macro-Retrieval to Micro-Fidelity Alignment for Garment Generation cs.CV | cs.AIPDF

Yuhan Li, Xianfeng Tan, Fangao Zeng, Wenxiang Shang, Pipei Huang

TL;DR: 本文提出RAGDiffusion++，旨在解决服装资产生成中微观纹理保真度的瓶颈问题。通过引入属性感知奖励模型和对抗正则化GRPO策略，该方法有效缓解了高频轨迹崩溃和伪影黑客攻击，实现了从宏观检索到微观保真度对齐的工业级服装生成。

Details

Motivation: 标准服装资产生成需同时保证宏观拓扑准确性和微观物理保真度，但现有方法在实现工业级微观纹理真实感方面存在瓶颈，表现为高频轨迹崩溃和伪影黑客攻击问题。

Result: 在构建的27,725对高复杂度服装数据集（STGarment-Plus）上，所提方法通过属性感知奖励模型达到84.67%的人类偏好准确率，结合对抗正则化GRPO策略，显著提升了高频细节的生成质量。

Insight: 创新点在于将强化学习用于重塑流模型的采样分布以提升高保真轨迹概率，并引入对抗正则化防止奖励模型盲点被利用；同时构建大规模高质量数据集和双图像流架构升级为方法提供了基础能力支撑。

Abstract: Standard clothing asset generation—restoring forward-facing flat-lay garment images from diverse real-world contexts—holds immense commercial value yet demands both macroscopic topological accuracy and microscopic physical fidelity. Although our previous work RAGDiffusion effectively eradicated large-scale structural hallucinations via retrieval-augmented macro-constraints, achieving industrial-grade micro-texture realism remains an unsolved bottleneck. We formally identify this limitation as High-Frequency Trajectory Collapse: supervised fine-tuning (SFT) converges to the conditional mean of the training distribution, which is dominated by smooth, low-frequency textures, causing high-frequency patterns (e.g., fabric weaves, intricate logos) to become nearly un-sampleable. Naively applying Reinforcement Learning (RL) post-training further triggers Artifact Hacking, where models exploit semantic biases in generic reward models by generating deceptive checkerboard noise. Our key insight is that RL can fundamentally reshape the sampling distribution of flow models—elevating the probability of high-fidelity trajectories under accurate reward guidance—while adversarial regularization prevents exploitation of reward blind spots. Realizing this principle requires three prerequisites: (i)inherent capacity, established through a 27,725-pair high-complexity garment dataset (STGarment-Plus) and a Dual-Image-Stream FLUX architecture upgrade; (ii)perceptive reward, provided by a novel attribute-aware reward model (Garment-RM) trained on 500K images via fine-grained contrastive learning, achieving 84.67% human preference accuracy; and (iii)hacking prevention, enforced by our Adversarial-Regularized GRPO (AR-GRPO) strategy that integrates a dynamic discriminator into the RL sampling trajectory to penalize artifacts while enriching authentic high-frequency details.

[141] 3D-MRL: Nested Multimodal 3D Representations via Matryoshka Representation Learning cs.CVPDF

Márcus Lobo, Vitor Matias, Jeová Farias, Moacir Ponti

TL;DR: 本文提出了3D-MRL，一种基于套娃表示学习的多模态3D预训练框架。该方法通过将点云与冻结的CLIP图像和文本嵌入对齐，并跨多个嵌入维度应用对比监督，学习嵌套的3D表示。这使得单个模型无需重新训练即可生成不同维度的表示，并在零样本和少样本3D识别任务上取得了有竞争力的性能。

Details

Motivation: 现有的多模态3D预训练方法生成固定维度的嵌入，需要为不同的计算预算训练不同的模型，缺乏灵活性。本文旨在解决这一问题，使单个模型能适应多种计算需求。

Result: 在Objaverse-LVIS、ModelNet40和ScanNet数据集上的实验表明，3D-MRL在零样本和少样本3D识别任务上取得了有竞争力的性能。特别是在Objaverse-LVIS上，Top-1准确率从46.8%提升至50.9%。检索实验还表明，不同嵌入维度能产生不同层次的语义和几何特异性。

Insight: 主要创新点是将套娃表示学习引入3D多模态预训练，仅对3D编码器应用套娃目标，实现了单一模型的多尺度表示输出。这为3D理解任务提供了灵活且高效的表示，支持跨不同嵌入维度的检索，揭示了表示维度与语义/几何特异性之间的关系。

Abstract: Vision-Language Models align point clouds with image and text embeddings, enabling zero-shot recognition, retrieval, and open-vocabulary understanding of 3D shapes. Existing multimodal 3D pre-training methods produce fixed-dimensional embeddings, requiring separate models for different computational budgets. We propose 3D Matryoshka Representation Learning (3D-MRL), a multimodal 3D pre-training framework based on Matryoshka Representation Learning. 3D-MRL learns nested 3D representations by aligning point clouds with frozen CLIP image and text embeddings while applying contrastive supervision across multiple embedding dimensions. The Matryoshka objective is applied only to the 3D encoder, allowing a single model to produce representations at different dimensionalities without retraining. Experiments on the Objaverse-LVIS, ModelNet40, and ScanNet datasets show that 3D-MRL achieves competitive performance on zero-shot and few-shot 3D recognition tasks. In addition, the learned representations support retrieval across different embedding dimensions within a single model. On Objaverse-LVIS, 3D-MRL improves Top-1 accuracy from 46.8% to 50.9%. Retrieval experiments further show that different embedding dimensions yield varying levels of semantic and geometric specificity.

[142] Hyper3-CLIP: Hierarchy-Conditioned Hyperbolic Vision-Language Training cs.CV | cs.AIPDF

Matin Mahmood, Antonio Rueda-Toicen, Mohamed ElBassat, Seifeldin Elkerdany, Weixing Wang

TL;DR: 本文提出了Hyper3-CLIP，一种结合层次条件与双曲几何的视觉语言模型。它通过从文本构建轻量级查询层次结构（如完整描述、句子片段、局部部件描述和短语），并利用查询条件化的视觉池化，将全局、局部和全局-局部对比学习与双曲空间中的蕴含损失相结合，以更好地编码图像-文本对中的层次关系（如整体-部分、父类-子类关系）。

Details

Motivation: 现有CLIP类模型在欧氏空间中使用全局池化，难以编码图像-文本对中的层次结构关系；而现有的双曲视觉语言模型（VLMs）使用静态特征，查询条件化方法又缺乏层次几何结构。本文旨在弥合这一差距，将层次条件与双曲几何结合，以学习更具结构化的表示。

Result: 在COCO和Flickr数据集上，Hyper3-CLIP提升了R@5和R@10检索性能；在VOC和COCO的多标签分类任务上也取得改进，同时在层次结构评估指标上保持竞争力。

Insight: 创新点在于将文本查询层次结构（从全局到局部）与双曲空间中的对比学习和蕴含损失相结合，通过仅在训练时激活的查询条件化视觉池化机制，统一了全局对齐与细粒度层次关系建模。这为学习具有丰富结构关系的视觉语言表示提供了新思路。

Abstract: CLIP-like vision-language models (VLMs) trained with contrastive objectives learn strong global image-text representations, but their Euclidean embeddings and global pooling fail to encode relational structure such as part-whole and parent-child relations. Hyperbolic VLMs address this gap with entailment-based objectives, and text-conditioned variants improve fine-grained alignment through sentence- and phrase-level queries. However, these two lines of work remain separate: hyperbolic VLMs use static image and region features, while query-conditioned methods lack hierarchical geometric structure. We present Hyper3-CLIP, a hierarchy-conditioned hyperbolic VLM that combines global, local, and global-local contrastive learning with query-conditioned visual pooling. To train the model, we construct lightweight query hierarchies from text, comprising full captions, sentence fragments, localized part descriptions, and extracted phrases. Each query conditions the pooling of visual patches, and the resulting representations support image-text, whole-part, and parent-child entailment losses. Query-conditioned pooling is active only during training. Hyper3-CLIP improves R@5 and R@10 retrieval on COCO and Flickr, as well as multi-label classification on VOC and COCO, while remaining competitive on hierarchy metrics. We also audit zero-shot prompt sensitivity under fixed prompt regimes and study the effect of the localized GRIT part budget used during training. Code is available at https://github.com/Hyper3Labs/hyper3-clip.

[143] PERSIST: Persistent-State Discrimination for Shot Boundary Detection cs.CVPDF

Tingyu Lin, Christian Stippel, Armin Dadras, Jakob Zenzmaier, Florian Kleber

TL;DR: 论文提出PERSIST框架，将镜头边界检测重新定义为边界语义判别问题，强调仅当局部变化证据伴随着视频潜在时间状态的持久更新时才判定为边界，而非短暂的瞬态干扰。该方法通过一个FiLM调节的正弦表示网络和结构化判别器，结合局部变化、瞬态脉冲和回归趋势三种语义线索，在双速率时间骨干网上生成可解释的每帧信号。

Details

Motivation: 传统镜头边界检测方法将边界视为局部视觉不连续性，但手持抖动、光照闪烁、运动模糊等因素会产生类似的局部变化，导致大量误报。论文旨在通过引入持久性状态判别，区分真正的镜头转换与瞬态干扰，从而减少误报。

Result: 在包含2,727个视频的诊断集上，PERSIST相对于相同训练的线索检测器减少了闪光、文字叠加和档案材料误报的33-80%。在保持召回率的同时，在匹配真实转换召回率下，将TransNetV2的伪事件误报减少约一半，在ClipShots素材上误报减少约四分之一。在在线、广播、短视频和历史档案转移评估中，与最强的公共检测器达到同等性能，且训练数据更严格（仅使用ClipShots的真实转换）。

Insight: 创新点在于将镜头边界检测重新定义为持久性状态更新判别，而非仅依赖局部不连续性。通过结构化判别器整合多语义线索和可解释的每帧信号，提高了模型的判别能力和可解释性，同时使用更严格的真实数据训练达到了SOTA性能。

Abstract: Shot boundary detection (SBD) is widely treated as the localisation of local visual discontinuities, yet many false positives such as hand-held shake, illumination flicker, motion blur, occlusion, and damaged archival material produce equally sharp local change without introducing a new shot. We reformulate SBD as boundary semantic discrimination: a frame is favoured as a boundary only when its local change evidence is accompanied by a persistent update of the video’s latent temporal state, rather than a transient excursion that returns to the surrounding trend. This persistence test is operationalised with a continuous latent state from a FiLM-conditioned sinusoidal representation network and a structured discriminator that combines three semantic cues, local change, transient impulse, and return-to-trend, into a single interpretable per-frame signal over a dual-rate temporal backbone. The resulting framework, PERSIST, turns every decision into an inspectable one: the persistence criterion is trained into the classifier, its per-frame effect stays readable from the gate triple, and its learned latent state is measurably boundary-discriminative. On a 2,727-video per-subtype diagnostic it removes 33-80% of flash, text-overlay, and archival false positives relative to an identically trained cue detector, and at matched true-transition recall it roughly halves TransNetV2’s pseudo-event false positives on that diagnostic and cuts its false positives on ClipShots footage by about a quarter, while preserving recall. It does so while reaching parity with the strongest public detector across online, broadcast, short-form, and historical-archive transfer evaluations, under markedly stricter training: it learns from ClipShots real transitions only, whereas the anchor draws on additional corpora whose transitions are 85% synthetic. Code is available at https://github.com/linty5/PERSIST.

[144] Neural video codecs quality assessment dataset and benchmark cs.CVPDF

Nikolay Safonov, Nikita Gornostaev, Alexandra Dubonos, Dmitriy Vatolin

TL;DR: 本文提出了一个用于神经视频编解码器质量评估的大规模主观数据集和基准。该数据集包含使用神经和传统视频编解码器压缩的视频，并通过众包成对比较收集主观评分。该资源旨在促进针对神经视频编解码器定制的视频质量度量的开发和基准测试。

Details

Motivation: 神经视频编解码器作为视频压缩的新方法出现，但其引入了新的时间压缩范式，这为压缩质量评估带来了新挑战，而质量评估对于此类编解码器的进一步发展和改进至关重要。

Result: 论文构建并发布了一个大规模主观数据集，为视频质量度量提供了开发和基准测试的资源。

Insight: 创新点在于创建了首个专门针对神经视频编解码器质量评估的大规模主观数据集，并采用众包成对比较方法收集数据，这有助于客观评估NVCs引入的新颖时间压缩特性。

Abstract: Video traffic constitutes a significant share of global web traffic. To reduce its volume, video codecs have been developed and continuously improved. While the industry has achieved substantial progress in traditional video coding, neural video codecs (NVCs) have recently emerged as a new approach that applies deep learning to video compression. This creates new challenges for compression quality assessment, which is essential for the further development and improvement of such codecs. In particular, it is important to evaluate the novel temporal compression paradigms introduced by NVCs. In this work, we present a large-scale subjective dataset of videos compressed with both neural and traditional video codecs. The subjective scores were collected through crowd-sourced pairwise comparisons. The proposed dataset provides a valuable resource for the development and benchmarking of video quality metrics tailored to neural video codecs. The dataset is available at the following link: https://videoprocessing.github.io/nvc-dataset-benchmark

[145] Test-Time Scaling for Video Diffusion Models via Diagnosis-Guided Candidate Recycling cs.CVPDF

Hangzhou He, Lunhao Duan, Shanshan Zhao, Kaiwen Li, Qing-Guo Chen

TL;DR: 本文提出了GEARS框架，一种无需训练的视频扩散模型测试时缩放方法，通过诊断引导的候选样本回收机制，将生成过程中通常被丢弃的低质量候选转化为可编辑的先验，从而在固定计算预算下提升轻量级视频生成器的性能。

Details

Motivation: 现有视频扩散模型的高保真生成严重依赖闭源系统或大规模基础设施，而测试时缩放方法虽能提升轻量级模型，但主流基于噪声搜索的范式会直接丢弃低质量候选样本，浪费了其中已编码的部分运动、布局或外观结构信息。

Result: 在匹配的噪声函数评估预算下，GEARS在VBench基准测试上持续优于现有视频TTS方法，能将一个13亿参数的模型提升到与一个140亿参数模型相当的总分水平。消融实验验证了自适应调度、诊断条件编辑和流形感知重去噪的必要性。

Insight: 核心创新在于将‘生成-评估-编辑’循环引入测试时缩放，通过诊断引导的候选回收机制，将失败样本转化为可修复的先验，而非直接丢弃，从而更高效地利用计算资源并保留有用结构。其自适应调度器和基于流形感知的潜在SDEdit编辑方法具有借鉴意义。

Abstract: Recent video diffusion models have achieved remarkable generation quality, but high-fidelity results still largely depend on closed-source systems or costly large-scale infrastructure. Test-time scaling (TTS) offers a training-free way to improve lightweight generators by spending additional inference compute, yet existing methods mostly remain within a noise-search paradigm: they sample, select, or perturb denoising trajectories and discard low-scoring candidates after expensive generation. This generate-and-discard process wastes not only computation but also the partial motion, layout, or appearance structure already encoded in recoverable samples. We present \textbf{GEARS} (\textbf{G}uided \textbf{E}diting for \textbf{A}daptive \textbf{R}ecycling \textbf{S}earch), a training-free framework that introduces {diagnosis-guided candidate recycling} into video TTS by turning such candidates into editable priors through a generation-evaluation-editing loop. GEARS consists of two collaborative components. The \textbf{Stage-Aware Scheduler} determines what to repair, when to repair it, and which candidates should be preserved, recycled, or discarded. The \textbf{Candidate Recycler} diagnoses recoverable failures from keyframes and multi-dimensional reward feedback, derives candidate-specific repair prompts, and repairs the corresponding candidates through manifold-aware latent SDEdit. The repaired candidates are recycled into the search pool, creating refinement paths beyond standard noise perturbation while preserving useful structure. Under matched NFE budgets, GEARS consistently outperforms existing video TTS methods on VBench, bringing a 1.3B model to a total score comparable to a 14B counterpart, and ablations verify the necessity of adaptive scheduling, diagnosis-conditioned editing, and manifold-aware re-denoising. Code is available on GitHub.

[146] GSPotential: Camera Potential Field for Sparse-View 3D Gaussian Splatting cs.CVPDF

Zeyuan An, Yanghang Xiao, Zhiying Leng, Yijun Feng, Xiaohui Liang

TL;DR: 本文提出GSPotential框架，通过引入相机势场来量化稀疏视图下3D高斯泼溅（3D Gaussian Splatting）的监督不均衡问题。该方法从两方面指导重建：在低势能区域（监督薄弱处）放置虚拟相机以提供几何引导，并利用势场方向信息对高斯更新进行保守约束，从而缓解过拟合和几何伪影。

Details

Motivation: 针对稀疏视图场景下3D高斯泼溅因光度监督不足导致的严重过拟合和几何伪影问题，现有方法引入外部先验（如深度、点云、扩散模型）但忽略了视图空间中监督的非均匀分布，导致先验使用和目标控制受限。

Result: 大量实验表明，GSPotential在保持有竞争力的训练效率的同时，实现了高重建保真度。

Insight: 创新点在于提出相机势场来量化视图空间的监督不平衡，并基于此设计了两项互补的引导机制：概率性球面采样策略（在低势能区域放置信息丰富的虚拟相机）和基于方向覆盖线索的保守高斯更新，从而实现了对重建过程更具针对性的几何引导和空间控制。

Abstract: 3D Gaussian Splatting has achieved remarkable success in photorealistic rendering, yet it suffers from severe overfitting and geometric artifacts in sparse-view scenarios due to the inherent deficiency of photometric supervision. Recent advances have attempted to regularize optimization by incorporating external priors, such as depth, point clouds, or diffusion models. However, these methods typically overlook the non-uniform distribution of supervision across the viewing space, resulting in limited specificity in prior use and primitive control. In this paper, we propose GSPotential, a framework that quantifies view-space supervision imbalance using a Camera Potential Field. Our key insight is to identify supervision valleys where photometric constraints are most deficient, and use the potential field to guide reconstruction from two complementary aspects. First, we devise a probabilistic spherical sampling strategy that places informative virtual cameras in low-potential regions. Point-cloud renderings from these views then provide targeted geometric guidance. Second, the same field provides a directional coverage cue for conservative Gaussian updates in weakly covered spatial sectors. Extensive experiments demonstrate that GSPotential achieves high reconstruction fidelity while maintaining competitive training efficiency.

[147] Think, Look, and Revise: Inconsistency-Aware Visual Self-Correction in MLLMs cs.CVPDF

Yu Cheng, Arushi Goel, Hakan Bilen

TL;DR: 本文提出了ReVISE框架，旨在增强多模态大语言模型（MLLMs）在工具增强推理中的自我修正能力。该框架通过监督训练数据集和基于强化学习的奖励机制，使模型能够验证外部工具（如物体检测）的输出、检测不一致性、动态恢复错误，并在工具不可靠时回退到内在的视觉基础能力。

Details

Motivation: 现有工具增强的多模态推理方法很少验证工具输出，限制了其检测和从工具故障中恢复的能力，因此需要一种能够主动验证和修正错误的方法。

Result: 在多个基准测试上的实验表明，该方法相比现有方法取得了持续改进，突显了在工具增强多模态推理中错误检测与修正的重要性。

Insight: 创新点在于引入了专门的数据集来监督模型的反思行为（验证证据、重写查询、回退到内在基础），并结合强化学习奖励来鼓励内部反思和惩罚空间错位，从而实现了不一致性感知的视觉自我修正。

Abstract: Tool-augmented multimodal reasoning integrates external tools (e.g., object detection, depth estimation) into multimodal large language models (MLLMs) to address perceptual bottlenecks in complex visual tasks. However, existing approaches rarely verify tool outputs, limiting their ability to detect and recover from tool failures. We propose ReVISE, a framework that equips MLLMs with verification and dynamic error recovery for tool-augmented reasoning. ReVISE introduces (1) a curated training dataset that supervises reflective behaviors, enabling models to validate tool-derived evidence, reformulate queries when visual mismatches arise, and fall back to intrinsic grounding when external tools are unreliable; and (2) a reinforcement learning based targeted rewards that encourage internal reflection and penalize spatial misalignment. Experiments on several benchmarks demonstrate consistent improvements over existing methods, highlighting the importance of error detection and correction in tool-augmented multimodal reasoning.

[148] Sketch2Inspire: Structure-Sensitive Evaluation for Product Retrieval cs.CVPDF

Ge Kong

TL;DR: 本文提出了Sketch2Inspire，一个用于产品检索评估的新资源，它基于亚马逊伯克利对象数据集的一个精选子集构建，包含对齐的文本查询、基于边缘的草图代理查询以及融合的文本-草图查询。该资源将宽泛的类别级检索与对结构敏感的类别内检索分离开来，并包含用于校准的人工评分参考协议。

Details

Motivation: 早期产品设计检索通常需要超越简单的类别识别，设计师可能需要同时匹配简短语义意图和粗略结构线索的参考示例。现有的产品图像资源和通用图像-文本检索基准很少将类别检索与类别内的结构匹配分离开来。

Result: 评估了一个基于预训练CLIP系列编码器的轻量级参考系统。在宽泛相关性下，后期融合获得最高分（nDCG = 0.9962）。在自动结构敏感相关性下，后期融合再次获得最高分（nDCG = 0.7015），超过了纯文本检索（nDCG = 0.5912）。在人工评分结果中，后期融合获得最高的nDCG@10（0.9133）。

Insight: 创新点在于构建了一个专门用于诊断模态贡献、支持结构感知产品检索协议开发的评估资源。其核心是将结构敏感检索作为一个独立的评估维度，并提供了人工标注的参考标准，这有助于更精细地理解多模态输入（如文本与草图）在检索任务中的增益如何依赖于相关性定义。

Abstract: Early-stage product design retrieval often requires more than category recognition: designers may need reference examples that match both a short semantic intent and a rough structural cue. Existing product-image resources and generic image–text retrieval benchmarks rarely separate category retrieval from within-category structural fit. We present Sketch2Inspire, built from a curated subset of Amazon Berkeley Objects with aligned text queries, edge-based sketch-proxy queries, and fused text–sketch queries. The resource separates broad category-level retrieval from structure-sensitive within-category retrieval and includes a human-graded reference protocol for calibration. We evaluate a lightweight reference system based on pretrained CLIP-family encoders, comparing text-only retrieval, sketch-only retrieval, weighted late fusion, and text-first reranking without updating model weights. Under broad relevance, late fusion obtains the highest score (nDCG = 0.9962). Under automatic structure-sensitive relevance, late fusion again obtains the highest score (nDCG = 0.7015), exceeding text-only retrieval (nDCG = 0.5912). In the human-graded results, late fusion obtains the highest nDCG@10 (0.9133), while text-only retrieval ranks second (0.9030). These results show that the retrieval gain from multimodal input depends on how relevance is defined. Sketch2Inspire therefore provides a diagnostic resource for evaluating modality contribution and supports the development of structure-aware product-retrieval protocols with independent human annotation.

[149] GATE: Reliability-Gated Gaussian Evidence Fusion for Training-Free Test-Time Adaptation of Vision-Language Models cs.CVPDF

Pedram MohajerAnsari, Amir Salarpour, Run Wang, Mert D. Pesé

TL;DR: 本文提出了GATE，一种无需训练的双通道转导式测试时适应框架，用于提升视觉语言模型在目标数据分布偏移下的鲁棒性。该方法通过构建文本高斯和图像高斯两种互补的证据源，并利用可靠性门控机制融合它们，从而对原始零样本logits进行归一化残差校正。

Details

Motivation: 解决CLIP等视觉语言模型在部署时，因目标数据与预训练分布不同而导致性能下降的问题。现有测试时适应方法通常仅依赖提示侧或图像侧的单方面证据，缺乏对两者可靠性的联合考量。

Result: 在细粒度识别数据集、ImageNet系列分布偏移、多种CLIP骨干以及SigLIP-B/16模型上，GATE在所有基准/骨干组中均取得了最佳平均准确率。平均提升零样本性能5.41个百分点，并比最强的非GATE基线高出1.94个百分点。

Insight: 创新点在于提出了可靠性门控的高斯证据融合机制，通过双通道框架同时利用文本和图像侧的分布信息，并保持模型参数完全冻结。该方法有效结合了多语言描述和可靠目标样本的互补证据，为冻结视觉语言模型的适应提供了新思路。

Abstract: Vision-language models such as CLIP and SigLIP provide strong zero-shot recognition, but their predictions can degrade when deployed on target data that differ from the pretraining distribution. Test-time adaptation offers a practical way to improve robustness without source data or target labels, yet existing methods often rely on either prompt-side adaptation or image-side target evidence alone. In this work, we introduce GATE, a training-free two-pass transductive test-time adaptation framework that uses the unlabeled target set while keeping the image encoder, text encoder, and prompt parameters fully frozen. Instead of representing each class with a single prototype, GATE builds two complementary Gaussian sources of evidence in the shared vision-language feature space: a text Gaussian estimated from multiple language descriptions and an image Gaussian estimated from reliable unlabeled target samples. A class-wise reliability gate controls the influence of image-derived pseudo-evidence, and a score-level generalized Product-of-Experts fusion produces a normalized residual correction to the original zero-shot logits. Across fine-grained recognition datasets, ImageNet-family distribution shifts, multiple CLIP backbones, and SigLIP-B/16, GATE achieves the best average accuracy in every benchmark/backbone group. It improves zero-shot performance by an average of 5.41 points and outperforms the strongest non-GATE baseline by 1.94 points, demonstrating the benefit of reliability-gated distributional evidence for frozen VLM adaptation.

[150] FiLM-GPNet: Geometry-Aware Pseudo-Supervised Phase Restoration with Zero-Shot Generalization for Large Temporal InSAR Stacks cs.CV | cs.LGPDF

Getnet Demil, Muhammad Farhan Humayun, Tomi Westerlund, Jukka Heikkonen, Mourad Oussalah

TL;DR: 本文提出了FiLM-GPNet，一种用于干涉合成孔径雷达（InSAR）包裹相位恢复的几何条件网络。它通过特征线性调制（FiLM）和7D几何描述符显式适应不同的采集几何，利用来自Goldstein滤波干涉图的伪监督进行训练，并通过三重闭合一致性进行干涉物理正则化。实验表明，该模型在多个数据集上显著降低了时间残差和闭合误差，并展示了强大的零样本泛化能力。

Details

Motivation: 针对密集商业SAR时间序列分析中，固定经典滤波器在异构采集几何下失效，导致相位质量和时间一致性下降的问题，提出一种能够适应几何差异的相位恢复方法。

Result: 在IEEE GRSS 2026数据融合竞赛的三个Capella Spotlight数据集上，相比Goldstein基线，FiLM-GPNet将时间残差降低了68%（夏威夷）和66%（西澳大利亚），闭合误差分别降低了10%和13%。在西澳大利亚，解缠成功率提高了7.7个百分点，数字高程模型（DEM）的归一化中值绝对偏差（NMAD）改善了31%。模型在未经重新训练的情况下，对地理和几何特征不同的洛杉矶数据集也表现出强大的零样本泛化能力。

Insight: 创新点在于将几何信息（7D描述符）通过FiLM层显式地条件化到网络中，实现了对异构采集几何的自适应。同时，利用伪监督和基于干涉物理（三重闭合）的正则化进行训练，并估计像素级认知不确定性，这为跨异构SAR堆栈的稳健相位恢复提供了一种有效的替代固定滤波器的方案。

Abstract: The growing availability of dense commercial Synthetic Aperture Radar (SAR) time series enables temporal Interferometric SAR (InSAR) analysis, but fixed classical filters fail under heterogeneous acquisition geometries, degrading phase quality and temporal consistency. We propose FiLM-GPNet, a geometry-conditioned network for wrapped-phase restoration that explicitly adapts to acquisition differences using Feature-wise Linear Modulation (FiLM) and a 7D per-pair geometry descriptor. The model is trained with pseudo-supervision from Goldstein-filtered interferograms and regularized by interferometric physics via triplet-closure consistency, while also estimating per-pixel aleatoric uncertainty. Experiments on three Capella Spotlight stacks from the IEEE GRSS 2026 Data Fusion Contest show that FiLM-GPNet reduces temporal residual by 68% (Hawaii) and 66% (Western Australia) relative to the Goldstein baseline, alongside closure error reductions of 10% and 13%, respectively. In Western Australia, it further improves unwrapping success rate by 7.7 percentage points and Digital Elevation Model (DEM) Normalized Median Absolute Deviation (NMAD) by 31%. The model also shows strong zero-shot generalization to a geographically and geometrically distinct third stack (Los Angeles) without retraining, supporting geometry-conditioned restoration as an effective alternative to fixed classical filtering across heterogeneous stacks.

[151] Co-Evolutionary Prompt Optimization with Cross-Category Transfer for Zero-Shot Anomaly Detection cs.CVPDF

Sisi Zhu, Changwei Yu, Renshuai Tao, Zhenliang Ni

TL;DR: 本文提出了一种名为CoEvoAD的协同进化框架，用于零样本异常检测中的离散提示优化。该方法利用进化算法在离散的自然语言空间中进行提示搜索，并通过引入跨类别转移目标来提升模型在未见类别上的泛化能力。实验表明，该方法在多个异常检测数据集上达到了最先进的性能。

Details

Motivation: 现有基于CLIP的零样本异常检测方法通常使用连续的提示嵌入进行优化，其语义编码在潜在向量中，缺乏可解释性和可扩展性。本文旨在解决这一问题。

Result: 在多个异常检测数据集上进行的广泛实验验证了CoEvoAD的有效性，结果显示其达到了最先进的性能水平。

Insight: 主要创新点在于提出了一个在离散自然语言空间进行协同进化提示搜索的框架，保持了提示的自然语言可解释性和可组合性；同时，通过引入跨类别转移目标来评估和选择提示规则，有效提升了跨类别泛化能力。

Abstract: Zero-shot anomaly detection (ZSAD) has gained significant attention for its practical value in industrial inspection. Recently, CLIP-based approaches have been widely adopted in ZSAD due to their strong vision-language generalization capabilities. However, existing methods commonly employ continuous prompt embeddings for prompt optimization and encode semantics in latent vectors, which lack interpretability and scalability. To this end, we propose CoEvoAD, a co-evolutionary framework for discrete prompt selection. CoEvoAD performs prompt search in the discrete natural-language space using an evolutionary algorithm. Candidate prompts are iteratively generated, evaluated, and selected throughout population evolution, thus preserving the interpretability and composability of natural language. Furthermore, we introduce a Cross-Category Transfer Objective (CCTO), which treats held-out source categories as proxies for unseen categories and scores prompt rules based on their estimated cross-category transferability, effectively improving cross-category generalization. Extensive experiments are conducted to validate the effectiveness of CoEvoAD, and the results show that it achieves state-of-the-art performance across multiple anomaly detection datasets. The code is available at https://github.com/rstao-bjtu/CoEvoAD.

[152] Polis: 3D Self-Supervision at City Scale cs.CV | cs.AI | cs.LGPDF

Alexander Rusnak, Sophia Kovalenko, Jingru Wang, Ismail Moudden, Xiru Wang

TL;DR: Polis是首个将Sketched Isotropic Gaussian Regularization（SIGReg）作为原生点云编码器目标函数的3D自监督学习方法，专门针对城市尺度的点云数据。它结合了几何匹配的余弦不变性、SIGReg、VICReg风格的反坍塌项，并在12.8k个室外场景上进行预训练。实验表明，该方法在城市规模数据集上优于其他自监督编码器，但在细粒度地面捕获数据上表现一般。

Details

Motivation: 现有3D自监督模型主要在室内、物体级或自动驾驶LiDAR数据上预训练，与通过航空测量捕获的大范围城市场景数据分布差异大，导致在城市分析等任务中表现不佳。论文旨在设计一个专门针对城市尺度3D点云的自监督学习方法。

Result: 在三个与预训练数据不重叠的城市数据集上，Polis在高容量冻结特征评估中达到23.8%的平均mIoU，优于次优编码器的16.3%；在匹配点体素预算下，达到17.3% vs 16.1%。在预训练见过的数据集上同样保持领先，但在具有细粒度立面标签的地面捕获数据上排名反转。

Insight: 创新点在于首次将SIGReg应用于点云编码器，并针对城市尺度的捕获几何和空间上下文设计自监督目标（如重力保持的空间视图采样）。核心洞察是：为特定领域（如城市航空点云）的几何和上下文设计自监督能提升迁移性能，但也揭示了这种专业化的局限性（在细粒度地面数据上泛化能力下降）。

Abstract: Reliable semantic representations derived from city-scale 3D models are increasingly important for urban analysis, infrastructure monitoring, autonomous systems, and heritage conservation. However, urban scenes of large spatial extent captured through aerial surveying differ substantially from the indoor, object-level, and self-driving LiDAR data used to pretrain most 3D self-supervised models. We introduce Polis, to our knowledge the first application of Sketched Isotropic Gaussian Regularization (SIGReg) as an objective for a native point cloud encoder, and evaluate it through a frozen-feature benchmark spanning fourteen city- and building-scale corpora. Polis combines geometrically matched cosine invariance, SIGReg, and VICReg-style anti-collapse terms with a 12.8k-scene outdoor pretraining mixture and gravity-preserving spatial view sampling. Controlled ablations show that this objective outperforms student–teacher architecture alternatives, as well as Polis versions without anti-collapse terms, on the same representative outdoor corpus. On three pretraining-disjoint city datasets, Polis reaches $23.8%$ mean mIoU versus $16.3%$ for the next-best encoder under high-capacity frozen probing, and $17.3%$ versus $16.1%$ at a matched point and voxel budget. The same city-scale lead holds on datasets whose training sets were seen in pretraining. On localized terrestrial captures with fine-grained facade and streetscape labels, the ranking reverses. Our results show that distributionally-regularized joint embedding architectures can be successful on challenging city-scale 3D scenes, and that transfer improves when self-supervision is designed for the capture geometry and spatial context of this domain while also revealing the limits of this specialization.

[153] Seeing Through Extreme Visual Sparsity: Surface Understanding from a Single Random Visual Patch cs.CVPDF

Sindhuja Penchala, Sudip Mittal, Noorbakhsh Amiri Golilarz

TL;DR: 本文提出了一种稀疏表面理解框架（SSUF），用于在极端视觉稀疏条件下（仅保留原始图像10%的可见区域）同时进行表面重建和材料分类。该框架适配了四种预训练架构（ConvAE、ViT、Swin Transformer和MAE），并在Touch-and-Go数据集上进行了评估。实验结果表明，Swin Transformer在分类任务上表现最佳，MAE在重建任务上最优，而ViT在重建与分类之间取得了最佳平衡。

Details

Motivation: 解决机器人感知和环境理解中，从不完整的视觉观察（如图像大部分区域被遮挡）进行表面材料识别的挑战性问题。

Result: 在Touch-and-Go数据集上，使用仅10%可见区域的稀疏观测协议进行评估：Swin Transformer在分类任务上达到最佳性能（准确率89.21%，F1分数0.8922，ROC-AUC 0.9813）；MAE在重建任务上表现最优（PSNR 16.06 dB，SSIM 0.4501）；ViT在重建与分类的综合平衡上最好。所有模型均实现实时推理（每图像<5 ms）。

Insight: 创新点在于提出一个统一的双任务学习框架，通过扩展预训练模型（如为重建模型添加分类头，为分类模型添加重建解码器）来同时处理表面重建和材料分类。客观来看，该研究展示了预训练架构在极端视觉稀疏条件下仍能有效支持材料识别，但精确图像重建仍具挑战性，为稀疏视觉理解提供了实用基准。

Abstract: Surface material recognition from incomplete visual observations remains a challenging problem in robotic perception and environmental understanding. This paper discusses Sparse Surface Understanding Framework (SSUF), a unified dual-task learning framework that adapts four pretrained architectures-Convolutional Autoencoder (ConvAE), Vision Transformer (ViT), Swin Transformer, and Masked Autoencoder (MAE) for si-multaneous surface reconstruction and material classification. Experiments were conducted on the Touch-and-Go dataset using a sparse observation protocol in which only 10% of the original image remained visible while the remaining regions were masked. To enable a fair comparison, reconstruction-oriented models were extended with classification heads, whereas classification- oriented models were augmented with reconstruction decoders. The resulting architectures were assessed using reconstruction quality, classification performance, model complexity, and in-ference efficiency metrics. Experimental results revealed distinct strengths across the models. Swin Transformer achieved the best classification performance with an accuracy of 89.21%, an F1-score of 0.8922, and a ROC-AUC of 0.9813. In contrast, MAE produced the highest reconstruction scores among evaluated models, with a PSNR of 16.06 dB and an SSIM of 0.4501, while ViT provided the best overall balance between reconstruction and classification performance. Furthermore, all models achieved real-time inference, requiring less than 5 ms per image. Over-all, the results show that pretrained architectures can support material recognition under severe visual sparsity, while accurate image reconstruction remains challenging.

Arka Mukherjee, Soham Roy, Kartikeya Trivedi, Shreya Ghosh

TL;DR: 本文提出了GeoAgent基准测试，用于评估视觉语言模型在具身导航中的地理定位能力。该基准要求智能体在街景环境中自主探索，通过序列推理来精确定位，研究发现当前VLM在区域级模式识别上存在困难，但导航能显著提升定位精度。

Details

Motivation: 现有AI地理定位研究多局限于静态图像检索和分类，而真实任务需要具身导航以收集环境观察，因此需要建立基于导航的评估框架来更真实地反映模型能力。

Result: 在GeoAgent基准上，现代VLM在国家和大洲级预测表现良好，但在区域级模式识别上表现不佳；与静态图像基线相比，具身导航显著提高了所有标准指标的准确率。

Insight: 创新点在于将地理定位任务从静态图像扩展为具身导航环境，揭示了VLM在区域级推理中的局限性和导航对精度的提升作用，同时发现了模型在发达/发展中地区语境中的严重偏见及先验错误时自我改进能力差的问题。

Abstract: Modern Vision-Language Models (VLMs) perform well above the human baseline in image geolocalization, a task critically important in disaster response, OSINT verification, and location privacy. However, most efforts to study AI behavior on the task remain limited to static image-based retrieval, classification, and predictions. We argue that faithful recreation of the task should involve embodied navigation, where a multimodal agent autonomously explores its surroundings to gather observations before submitting a prediction. To this end, we introduce \textbf{GeoAgent}, an agentic environment-based benchmark that requires agents to navigate Street View environments to refine their geolocalization through sequential reasoning. Our analysis shows that modern VLMs struggle to discern regional patterns while succeeding at country- and continent-level predictions. When compared to static image-based baselines, agentic navigation significantly improves accuracy across established metrics. We also note severe bias in a developed/developing region context across frontier model architectures and poor self-improvement capabilities given incorrect priors. Overall, our work establishes the challenges of embodied navigation and geospatial reasoning. We publicly release our code and the GeoAgent environment: https://geoagent-benchmark.github.io

[155] FuncRoom-Agent: Sequential Feed-Forward 3D Functional Indoor Scene Generation cs.CVPDF

Hao Feng, Zhi Zuo, MingJian Liang, Jingyu Hu, Xiaowei Hu

TL;DR: 本文提出FuncRoom-Agent，一种用于生成支持明确功能目标的3D室内场景的序列前馈框架。该方法通过设计递归领域特定语言（DSL）来层次化组织对象，并利用场景构造专家进行前馈式代码生成，避免了耗时的生成-评估-修订循环。此外，引入基于执行的过程奖励框架ScenePRM，通过强化学习优化专家模型，在功能完整性、关系正确性和生成效率上达到SOTA水平。

Details

Motivation: 现有方法生成功能可控的室内场景时，通常依赖昂贵的测试时生成-评估-修订循环，导致生成速度慢、计算成本高。本文旨在解决这一问题，实现高效、可控的面向功能的3D室内场景生成。

Result: 在提出的面向功能基准测试中，该方法在通用室内场景生成和功能房间生成任务上均取得了最先进的性能，在功能完整性、关系正确性、几何可执行性和生成效率方面表现优异。

Insight: 创新点包括：1）递归领域特定语言（DSL）用于层次化、结构化地表示具有明确几何与功能关系的场景程序；2）序列前馈式场景构造框架，将递归构造轨迹蒸馏为专家模型，实现无需在线评估或迭代修复的直接生成；3）执行基础的过程奖励框架ScenePRM，通过多维度反馈（功能、几何、关系、未来可构造性）的强化学习来优化专家模型。

Abstract: We introduce Function-Room Generation, a new indoor 3D scene generation setting that creates rooms supporting explicit functional goals rather than merely visually plausible layouts. Existing agentic and executable methods improve controllability, but often depend on costly test-time generate–evaluate–revise loops, making functional room generation slow and computationally expensive. We address this challenge with three technical contributions. First, we design a recursive domain-specific language to effectively organize the hierarchical object compositions required by functional rooms, from room structure and major furniture to dense support-surface and nested small objects. It represents rooms as staged executable programs with explicit geometric and functional relations. Second, we propose a sequential feed-forward scene construction framework that distills recursive construction traces into a scene construction expert. At inference time, the expert writes executable DSL code stage by stage, and a deterministic executor directly instantiates each stage without teacher agents, online critics, or iterative repair. Third, we introduce ScenePRM, an execution-grounded process reward framework that improves the expert through reinforcement learning with functional, geometric, relational, and future-constructability feedback. We further establish a function-oriented benchmark and show state-of-the-art performance on both general indoor scene generation and function-room generation, achieving stronger functional completeness, relation correctness, geometric executability, and generation efficiency.

[156] TRINITY: A Multi-Perspective Benchmark for Personal-Style Video Highlight Detection cs.CVPDF

Qianqian Chen, Hyun Bin Kim, Denzel Elden Wijaya, Yang Yi, Bo Liu

TL;DR: 该论文提出了TRINITY，一个用于个人风格视频高光检测的多视角基准测试。它将高光显著性分解为事件、情感和自然三个互补维度，并设计了一个共享主干的多分支架构进行并行预测。实验表明，该方法在Mr. HiSum和YouTube Highlights数据集上显著优于现有技术。

Details

Motivation: 传统视频高光检测基于狭窄的、以事件为中心的定义，难以泛化到个人视频中视角依赖的异质高光。论文旨在解决这一问题，提供更稳健和全面的视频显著性建模。

Result: 在Mr. HiSum数据集上，该方法在rho=15%和50%时分别获得+7.15和+3.62 mAP的提升；在YouTube Highlights数据集上获得+10.82 mAP的提升，显著优于现有SOTA基线。

Insight: 创新点在于将视频高光显著性分解为事件、情感、自然三个互补维度的多视角统一框架，并设计了相应的多分支专家网络架构，为复杂真实场景提供了更全面的建模思路。

Abstract: Traditional video highlight detection relies on a narrow, event-centric definition of saliency, which often fails to generalize to unconstrained personal videos where highlights are heterogeneous and perspective-dependent. To address this, we introduce TRINITY, a multi-perspective benchmark that decomposes highlight saliency into three complementary dimensions, Event, Emotion, and Nature, within a unified temporal framework. Leveraging this multi-faceted view, we propose a shared-backbone multi-branch architecture designed for parallel multi-perspective prediction via view-specific experts. Comprehensive experiments demonstrate that our method significantly outperforms state-of-the-art baselines, achieving gains of +7.15/+3.62 mAP (rho=15%/50%) on Mr. HiSum and +10.82 mAP on YouTube Highlights. These results validate that multi-perspective modeling provides a more robust and comprehensive formulation of video saliency, especially for complex real-world scenarios. The benchmark and relevant codes will be released upon acceptance. The benchmark is available at https://huggingface.co/datasets/vanilladucky/TRINITY and the code is available at https://github.com/vanilladucky/TRINITY.

Rahul Ahuja, Bala Murali Manoghar Sai Sudhakar, Shashwata Gupta, Venkatraman Narayanan, Varun Ravi Kumar

TL;DR: MotionSync提出了一种结合因果与非因果处理的统一架构，用于自动驾驶数据引擎中的3D感知与标注。该系统在因果跟踪器基础上，通过非因果细化步骤修正轨迹，实现单系统同时支持在线与离线任务，显著降低标注成本。

Details

Motivation: 解决自动驾驶数据引擎中3D框与轨迹标注成本高昂的问题，避免同时维护在线和离线两套系统，通过统一架构降低开发与维护负担。

Result: 在Waymo数据集上，使用25%人工标注加MotionSync伪标签训练的检测器达到全监督mAP的96.9%；在10%标注预算下，非因果细化比因果阶段伪标签提升+3.3 mAP/L2。作为跟踪器，在关键指标上与领先的离线方法持平，并在错误构成（如漏检和轨迹碎片）上表现更优。

Insight: 创新点包括：将因果/非因果边界作为显式架构接缝，因果跟踪器引入不确定性校准、帧率不变运动关联门控和多假设运动学习，非因果细化采用RTS平滑、物理验证间隙补全和语义剪枝。系统设计允许非因果修正不写回因果估计，确保统一服务且效果可量化。

Abstract: Three-dimensional box-and-track annotation is the cost bottleneck in autonomous-driving data engines, and the offline systems built to relieve it replace the online perception stack outright, so a team needing both regimes maintains and reconciles two. MotionSync makes the causal/non-causal boundary an explicit architectural seam instead. A strictly causal tracker, built on a strong published baseline and extended with innovation-driven uncertainty calibration, frame-rate-invariant kinematic association gates, and multi-hypothesis motion with learned mode selection, emits a valid online result. A non-causal pass then revises the buffered trajectories with Rauch–Tung–Striebel smoothing applied separately to pose, extent and yaw, physics-validated gap completion, and semantic pruning of ghost tracks against LiDAR point labels. The refiner never writes back, so one system serves both regimes and refinement’s effect is a delta over an unaltered causal estimate. Used as an auto-labeller, a fixed 3D detector trained on 25% human labels plus MotionSync pseudo-labels reaches 96.9% of its full-supervision mean average precision (mAP) on Waymo, and at a 10% budget the non-causal pass accounts for +3.3 mAP/L2 over pseudo-labels from the same tracker’s causal stage. Re-fitting the online tracker on its own refined output recovers 73% of the benefit of human supervision, while its causal output is worse supervision than no re-fitting at all. As a tracker MotionSync is at parity with the leading published offline entries on the headline metric and ahead of them on error composition, which is where a refinement pass can act at all: it reduces misses and fragmentations together, the signature of gap completion rather than of a tuned detector.

[158] Guardrail-Agnostic Societal Bias Evaluation in Large Vision-Language Models cs.CVPDF

Yusuke Hirota, Michael Ross Boone, Arun George Zachariah, Jibin Rajan Varghese, Yu-Chiang Frank Wang

TL;DR: 本文提出了一种针对大型视觉语言模型（LVLMs）的社会偏见评估方法，旨在解决现有基准测试因模型安全护栏过强而频繁拒绝回答导致评估不可靠的问题。该方法通过将任务与图像中的人物解耦，使用不直接询问人物属性的提示（如故事生成、术语解释和考试式问答），并将图像作为临时用户信息隐式提供人口统计线索，从而实现对带强护栏模型的可靠偏见测量。

Details

Motivation: 现有偏见评估基准依赖于要求模型推断图像中人物属性的提示，但在安全护栏强大的LVLMs（如GPT和Claude）中，这些提示常被拒绝，导致评估不可靠。因此，需要一种能规避模型拒绝、在强护栏下仍能有效测量社会偏见的新方法。

Result: 该方法在20个近期开源和专有LVLMs上应用，发现所有模型在与人无关的任务中都不恰当地使用了用户人口统计信息（例如，故事中的角色常根据用户性别被描绘为机械师或护士）。专有模型（如GPT-5）虽仍有偏见，但比开源模型偏见更低。

Insight: 创新点在于改变了评估范式，通过任务与人物解耦和隐式人口线索注入，避免了模型因安全护栏而拒绝响应，实现了对强护栏LVLMs的可靠偏见评估。客观来看，该方法为持续模型监控和改进提供了实用框架，有助于分析并减少偏见。

Abstract: We propose a societal bias evaluation method for large vision-language models (LVLMs) in the era of strong safety guardrails. Existing benchmarks rely on prompts that ask models to infer attributes of people in images (e.g., “Is this person a CEO or a secretary?”). However, we find that LVLMs with strong guardrails, such as GPT and Claude, often refuse these prompts, making evaluations unreliable. To address this, we change the prior evaluation paradigm by decoupling the task from the depicted person: instead of inferring person’s attributes, we use prompts that do not ask about the person (e.g., “Write a fictional story about an imaginary person.”) and attach the image as provisional user information to implicitly provide demographic cues, then compare outputs across user demographics. Instantiated across three tasks — story generation, term explanation, and exam-style QA — our method avoids refusals even in guardrailed LVLMs, enabling reliable bias measurement. Applying it to 20 recent LVLMs, both open-source and proprietary, we find that all models undesirably use user demographic information in person-irrelevant tasks; for instance, characters in stories are often portrayed as mechanic for male users and nurse for female users. Although still biased, proprietary models like GPT-5 show lower bias than open-source ones. We analyze potential factors behind this gap, discussing continuous model monitoring and improvement as a possible contributor for reducing bias.

[159] SnapBench: Benchmarking Snap-and-Ask Multimodal Retrieval for Mobile Interactions cs.CV | cs.IRPDF

Zirong Chen, Fuda Ye, Kuan Zhang, Enjun Du, Junfu Pu

TL;DR: 本文提出了SnapBench，这是首个针对移动端Snap-and-Ask多模态检索的鲁棒性配对基准测试，包含1145个查询、9085个图库项和53种受控的输入损坏条件。研究评估了16种多模态检索模型，发现图像损坏会显著降低检索性能，而文本损坏影响有限。论文还提出了一种名为MOOR的自适应融合方法，以提升模态可靠性校准。

Details

Motivation: 移动AI中，用户通过拍照提问（Snap-and-Ask）是常见的交互入口，但实际输入（如模糊照片、简短或拼写错误的文本）往往存在噪声，而现有基准测试要么使用干净输入，要么未能隔离评估这种配对检索的鲁棒性。

Result: 在SnapBench基准上评估了16个多模态检索器（包括双塔编码器和基于嵌入的视觉语言模型），结果显示图像损坏会显著降低检索性能，而文本损坏主要影响纯文本检索，对联合检索影响有限。干净图像检索通常优于联合检索，揭示了在噪声输入下存在粗粒度文本拖累和跨模态回退机制的缺乏。

Insight: 论文的创新点在于构建了首个针对Snap-and-Ask场景的鲁棒性配对多模态检索基准（SnapBench），并揭示了噪声输入下模态交互的局限性（如粗粒度文本拖累）。提出的MOOR方法（模态锚定、异常感知、最优重加权）是一种简单的自适应融合策略，强调了在该场景下进行可靠性感知的模态校准的必要性。

Abstract: Mobile AI acts as a visual oracle, empowering users to snap a picture of something and ask for information. Snap-and-ask retrieval is now one of the most common entry points for mobile AI, yet photos are often blurry, while text questions may be short or mistyped. Existing benchmarks only test on clean inputs or do not isolate paired robustness in snap-and-ask retrieval. Therefore, we introduce SnapBench, the first paired benchmark for robust snap-and-ask multimodal retrieval, spanning 1,145 queries, 9,085 gallery items under 53 controlled corruption conditions with human annotations. We evaluate 16 multimodal retrievers, covering dual-tower encoders and embedding-based VLMs. Results show that image corruptions substantially degrade retrieval, while text corruptions mainly affect text-only retrieval and have limited impact on joint retrieval. Clean image-only retrieval often outperforms joint retrieval, indicating the coarse-text drag and the lack of cross-modal fallback under noisy inputs. SnapBench provides a controlled testbed for evaluating robust retrieval in snap-and-ask scenarios. We further propose MOOR (Modality-anchored, Outlier-aware, Optimal Reweighting), a simple adaptive fusion approach, highlighting the need for reliability-aware modality calibration in snap-and-ask retrieval.

[160] CineForge: Self-Improving Agents for Long-Horizon Video Generation cs.CV | cs.AIPDF

Junxiang Liu, Lin Wang, Haiyu Shi, Hongxu Ma, Xiaoyu Yang

TL;DR: CineForge是一个自进化的视频生成代理框架，包含CineForge-Produce用于视频生成和CineForge-Evolve用于跨故事策略进化。该框架通过将故事分解为叙事、角色、空间和电影状态来协调生成过程，并记录为生产轨迹，然后利用案例到模式到策略进化（CPPE）方法从轨迹中学习并改进策略。

Details

Motivation: 解决长篇幅故事驱动视频生成中，现有自适应系统主要优化请求或可重用技能，但无法将重复出现的生产失败与跨故事的、针对特定阶段的持久性改进联系起来的问题。

Result: 在CineScope-Data和两个公共基准测试中，进化后的CineForge策略将CineScope-Metric从4.024提升到4.380，在ScriptAgent下持续优于三个长视频基线，并在新故事上减少了37.0%的审查LLM调用。

Insight: 创新点在于将视频生成过程记录为规范化的生产轨迹，并引入案例到模式到策略进化（CPPE）方法，使代理能够从跨故事的经验中持续学习并改进，实现了视频生成代理的累积性自我提升。

Abstract: Long-horizon story-driven video generation requires a production agent to coordinate narrative decomposition, state tracking, shot design, prompt construction, rendering, and revision across interdependent scenes. Existing adaptive video systems primarily refine requests or reusable skills, leaving recurring production failures disconnected from persistent, stage-targeted improvements across stories. We introduce CineForge, a self-evolving video-production agent framework that couples CineForge-Produce for video generation with CineForge-Evolve for cross-story policy evolution. CineForge-Produce organizes each source story into typed narrative, character, spatial, and cinematic states, uses them to coordinate asset and clip generation, and records the process as a canonical production trajectory. CineForge-Evolve applies Case-to-Pattern-to-Policy Evolution (CPPE) to review trajectory evidence, consolidate recurrent findings into bounded stage-local patches, and deploy validated updates through structural replay and confidence-controlled paired evaluation. To measure complete story realization, we introduce CineScope, which combines a 100-script CineScope-Data suite with a human-aligned, multiscale CineScope-Metric spanning causal state, directorial orchestration, pacing and resource allocation, and character arc. Across CineScope-Data and two public benchmarks, the evolved CineForge policy improves CineScope-Metric from 4.024 to 4.380, outperforms three long-video baselines with consistent gains under ScriptAgent, and reduces review LLM calls by 37.0% on new stories. These results establish production trajectories as actionable experience for video agents that improve cumulatively across long-form storytelling tasks.

[161] Conducting Stylistic Analysis of Paintings through an Art-History Agent cs.CV | cs.AI | cs.CLPDF

Marc S. Walton, Astrid Harth

TL;DR: 本文提出了一种结合视觉Transformer（ViT）和大语言模型（LLM）的AI框架，用于自动化绘画的风格分析。该系统通过ViT编码绘画图像，利用稀疏字典学习分解出可复现的风格特征，再由LLM解释这些特征并生成描述性文本，最后通过一个协调器LLM进行推理和精炼，输出对单件艺术品或艺术品比较的连贯描述。

Details

Motivation: 传统艺术史的风格分析依赖详细的视觉观察和描述，而现有AI模型仅提供无法解释的概率分类。本文旨在弥合这一方法学差距，为证据收集、发现和验证提供自动化基础。

Result: 论文未在摘要中提及具体的定量实验结果或基准测试，但宣称该方法能将详细的视觉特征转化为描述性术语，解决了艺术史中的一个关键挑战。

Insight: 创新点在于将视觉特征编码与语义解释相结合，通过稀疏字典学习提取可解释的共享风格特征，并利用LLM的检索与合成能力生成符合人文学科语义关注的描述，为基于视觉的计算艺术史建立了新的研究方向。

Abstract: Attributing an artwork to an artist has traditionally relied on detailed visual observations and descriptions, known as stylistic analysis in art history. By contrast, current artificial intelligence (AI) models used in the field offer only unexplained probabilistic classifications. To bridge this methodological gap, we present an AI framework that automates stylistic analysis of paintings, providing a foundation for enhancing evidence collection, discovery, and verification. By training a vision transformer (ViT) on a large corpus of paintings with metadata, our system encodes this art history-specific data as embeddings. These representations are factorized via sparse dictionary learning into a shared set of features that recur across the training set. A large language model (LLM) then interprets each feature by retrieving associated artworks and their accompanying curator-written texts, and synthesizes them into descriptions that reflect their stylistic attributes. Finally, an autonomous coordinator LLM applies a reasoning-and-action (ReAct) framework to weight, test, and refine these features into cohesive descriptions of an artwork, or comparisons of artworks. This approach converts detailed visual features into descriptive terms, addressing a key challenge in art history. It thus connects the use of images as data with the semantic concerns of humanists, establishing vision-based computational art history as an area for future growth.

Zixu Li, Jianjun Qian, Hang Shao, Daoheng Li, Lei Luo

TL;DR: 本文提出了PhysVR，一种用于远程光电容积描记术（rPPG）估计的、由视觉语言模型引导的、干扰感知时序特征细化框架。该框架通过结合从生理信号和视觉语言模型中提取的证据，构建干扰感知的时序上下文，并利用共享的时序校正单元和干扰特定专家来细化全局时序特征，从而在最终rPPG估计前进一步抑制干扰。

Details

Motivation: 现有的rPPG方法主要在特征学习阶段抑制干扰，但很少研究学习到的时序特征是否仍受干扰影响，以及如何在rPPG估计前进一步抑制这些干扰。本文旨在解决这一局限性。

Result: 在五个公共基准数据集上的大量实验表明，PhysVR在数据集内和跨数据集评估协议下，均持续优于代表性方法。

Insight: 创新点在于将视觉语言模型（VLM）引入rPPG任务，利用其处理干扰导向提示的能力提取视觉干扰证据，并与生理证据结合，通过干扰感知的时序上下文引导特征细化。这提供了一种在特征层面进行后期干扰抑制的新思路，并利用了预训练VLM的通用视觉理解能力。

Abstract: Remote photoplethysmography (rPPG) enables contactless physiological measurement from facial videos, yet its subtle pulse-related variations are easily affected by illumination variation, head motion, facial blur, and region-of-interest instability. Existing methods mainly suppress interference during feature learning, while whether the learned temporal features remain affected by interference and how to further suppress such interference before rPPG estimation are rarely examined. To address this limitation, we propose PhysVR, a vision-language model guided interference-aware temporal feature refinement framework for rPPG estimation. Specifically, a physiological backbone produces global temporal features and a coarse rPPG prediction, from which signal-derived physiological reliability evidence is constructed from local temporal characteristics. In parallel, a frozen vision-language model processes sampled facial frames under an interference-oriented prompt, and an evidence head extracts visual interference evidence from the VLM output. Temporal cross-attention integrates the physiological and visual evidence with the global temporal features to construct interference-aware temporal context. Guided by this context, a shared temporal correction unit performs general refinement, while four interference-specific experts selectively suppress different interference through adaptive routing. The refined temporal features are then used for final rPPG estimation. Extensive experiments on five public benchmarks demonstrate that PhysVR consistently outperforms representative methods under both intra-dataset and cross-dataset evaluation protocols.

[163] MedSegBenchmarker: A Raw-Count-First Framework for Controlled 2D Medical Image Segmentation Benchmarks cs.CV | cs.AIPDF

Vanessa Borst, Lukas Horn, Daniel Grillmeyer, Thomas Prantl, Samuel Kounev

TL;DR: 本文提出了MedSegBenchmarker（MSB），一个用于二维医学图像分割（MIS）的、以原始像素计数为优先的、可配置的基准测试框架。该框架旨在解决当前领域内由于数据集异构、评估协议不一致以及架构快速演变导致的公平且可复现的模型比较难题。

Details

Motivation: 医学图像分割领域缺乏公平、可复现且可扩展的基准测试框架，模型排名常常隐含地依赖于数据划分、预处理、指标聚合等选择，这限制了新模型、数据集和训练范式的系统性研究。

Result: 在一个包含三个异构二维数据集和多个MIS及通用视觉模型的案例研究中，对相同预测结果进行重新聚合后，在六个数据集-分辨率设置中的三个里改变了排名第一的架构。增加输入分辨率会产生模型和数据集依赖的性能增益或损失，需与实测推理复杂度一同考量。

Insight: 创新点在于提出了一个以原始像素计数和预测结果为优先、支持配置驱动和可复现实验的框架，其核心在于保留样本级和类别级的像素计数等基本数据，支持事后分析而无需重复推理。客观来看，该框架将评估条件和选择显式化，为解决基准测试中的可复现性问题提供了实用且可扩展的基础。

Abstract: Despite rapid advances in MIS, fair and reproducible comparisons of segmentation models remain challenging due to heterogeneous datasets, inconsistent evaluation protocols, and rapidly evolving architectures. In particular, comparisons often implicitly assume that model rankings are invariant to data partitioning, preprocessing, metric aggregation, uncertainty estimation, and computational constraints. The lack of extensible and unified evaluation frameworks further limits systematic investigation of new models, datasets, and training paradigms. We present MEDSEGBENCHMARKER (MSB), a configuration-driven framework for controlled benchmarking of 2D MIS. It integrates duplicate and near-duplicate image detection, group-aware data splitting, YAML study specifications, resumable training, hyperparameter optimization, cross-validation, and checkpoint-based evaluation. Rather than retaining only aggregate performance measures, MSB exports sample- and class-level pixel counts and predictions together with the evaluation context. These elementary artifacts enable post-hoc analyses without repeated inference. We demonstrate MSB in a case study involving three heterogeneous 2D datasets and multiple MIS and general-purpose vision models evaluated at 256- and 512-pixel input resolutions. Reaggregation of identical predictions changes the top-ranked architecture in three of six dataset-resolution settings, despite high rank correlations between aggregation strategies. Increasing input resolution produces model- and dataset-dependent performance gains and losses that must be considered alongside empirically measured inference complexity. These results show that seemingly minor choices in evaluation and experimental setup can affect benchmark conclusions. MSB, available at GitHub, provides a practical and extensible basis for making benchmark conditions and evaluation choices explicit and reproducible.

[164] Drift Calibration in Geometric Eye Tracking Systems cs.CVPDF

Jiaqi Liu, Zixuan Wang, Yuhong Zhang, Dingkang Liang, Jane Hanqi Li

TL;DR: 本文提出了一种用于几何眼动追踪系统的漂移校准方法，通过构建包含12名参与者163次试验的校准数据集，在统一的空间外推协议下评估了全局、局部和复合校正函数，并引入了一种轻量级神经优化器来结合互补校准器的排名预测。实验表明，该方法将平均角度误差从1.53°降低至0.96°，并在闭环凝视任务中验证了较低残差误差与较高性能的关联。

Details

Motivation: 几何眼动追踪器在基于凝视的交互和多模态研究中需要高空间精度，但其测量对特定会话的残余校准误差敏感，且现有校正方法因设备、目标布局和误差定义不同而难以比较。

Result: 在受控数据集上，后供应商校正将平均角度误差从1.53°降至1.03°（最强经典复合方法）和0.96°（神经优化器）；在闭环凝视任务中，较低残差误差与更高性能相关。

Insight: 创新点包括引入一个校准聚焦的数据集以实现方法可比性，以及提出轻量级神经优化器来融合互补校准器的排名预测，为交互建模中凝视作为行为信号提供了可复现的数据质量基准。

Abstract: Geometric eye trackers can provide the spatial accuracy required for gaze-based interaction and multimodal studies, but their measurements remain sensitive to residual session-specific calibration error. Research on correcting this error is difficult to compare because methods are typically evaluated with different devices, target layouts, and error definitions. We present a calibration-focused dataset containing 163 trials from 12 participants, with separate 18-point fitting and 32-point test grids, and use it to evaluate global, local, and composite correction functions under a common spatial-extrapolation protocol. We further introduce a lightweight neural refiner that combines ranked predictions from complementary calibrators. On this controlled dataset, post-vendor correction reduces the mean angular error from $1.53^\circ$ to $1.03^\circ$ with the strongest classical composite and to $0.96^\circ$ with the refiner. In a closed-loop gaze task, lower residual error is associated with higher performance across four online correction conditions. These results provide a reproducible data-quality benchmark for using gaze as a behavioral signal in interactive modeling.

[165] XDG: Accelerated Visual Disambiguation cs.CVPDF

Gonglin Chen, Ben Southall, Hanyuan Xiao, Wenbin Teng, Haolin Xiong

TL;DR: 论文提出了一种名为XDG的高效视觉消歧模型，旨在解决结构从运动（SfM）中的视觉混淆（即‘分身’问题）。该方法的核心是观察到现有的3D基础模型已具备跨视图几何推理能力，因此通过轻量化的LoRA适配器微调Depth Anything 3模型，并重用其相机令牌作为紧凑的配对级分类令牌，由一个紧凑的MLP头预测图像对是否观测到同一3D表面。

Details

Motivation: 视觉混淆（相似但物理上不同的表面导致错误图像匹配）是SfM中的关键挑战。现有方法使用几何感知的基础模型特征，但需要在骨干网络上叠加沉重的Transformer分类器，导致大规模消歧计算成本高昂。

Result: 在成对匹配和重建基准测试中，XDG与最先进的消歧方法保持竞争力，同时实现了超过3倍的推理加速。在包含数千张图像的单个LaMAR场景上，XDG节省了超过10小时的视觉消歧处理时间。

Insight: 创新点在于利用现有3D基础模型（Depth Anything 3）已有的跨视图几何推理能力，直接通过轻量级适配（LoRA）和令牌重用来进行消歧分类，避免了在单独解码器中重新学习配对推理，从而在保持精度的同时显著提升了效率。

Abstract: Visual aliasing, also known as the doppelganger problem, remains a key challenge for structure-from-motion (SfM): visually similar but physically distinct surfaces can produce incorrect image matches and degrade reconstruction quality. Previous work mitigates this issue with geometry-aware foundation-model features, but places a heavy transformer classifier on top of the backbone, making large-scale disambiguation expensive. We introduce XDG, an efficient visual disambiguation model designed for scalable SfM. Our key observation is that a 3D foundation model already performs the cross-view geometric reasoning necessary for visual disambiguation, so doppelganger classification should adapt the backbone representation directly rather than relearn pair reasoning in a separate heavy decoder. XDG fine-tunes Depth Anything 3 with lightweight LoRA adapters and repurposes its camera tokens as compact pair-level classification tokens. A compact MLP head predicts whether a candidate image pair observes the same 3D surface. Extensive experiments show that XDG provides a favorable accuracy-efficiency tradeoff: it remains competitive with the state-of-the-art disambiguation method across pairwise and reconstruction benchmarks and delivers more than a 3x inference speedup. On individual LaMAR scenes containing thousands of images, XDG saves more than 10 hours of visual disambiguation processing. Code is available at https://github.com/xtcpete/xdg.

[166] SynCrash: A Multi-Stage Pipeline for Zero-Shot Accident Detection and Localization in Traffic Surveillance Video cs.CV | cs.AIPDF

Arkya Jyoti Bagchi, Ritul Jangir, Varun Raskar

TL;DR: SynCrash是一个用于交通监控视频中零样本事故检测、空间定位和碰撞类型分类的多阶段流水线。它通过三个解耦的阶段运作：利用在合成数据上微调的VideoMAEv2进行时间定位，结合YOLO检测和物理启发式启发式方法进行空间定位，以及基于规则的轻量级碰撞类型分类。该方法旨在解决CVPR 2026 ACCIDENT挑战赛的任务，即在没有真实世界标注数据的情况下预测事故的发生时间、位置和类型。

Details

Motivation: 解决在固定视角CCTV监控视频中，无需真实标注数据（零样本）即可进行事故检测、定位和分类的挑战，特别是针对CVPR 2026 ACCIDENT挑战赛的要求。

Result: 摘要未提及具体的定量实验结果或基准测试结果。

Insight: 核心创新在于将任务解耦为三个阶段，并针对不同子任务采用不同的知识来源：时间理解依赖于合成数据的监督微调，而空间理解则利用预训练的目标检测器和可跨域迁移的物理先验知识。这种混合策略旨在克服零样本设置下缺乏真实标注数据的限制。

Abstract: We present SynCrash, a multi-stage pipeline for zero-shot accident detection, spatial localization, and collision-type classification in fixed-view CCTV surveillance video. Our approach addresses the ACCIDENT at CVPR 2026 Challenge, which requires predicting when an accident occurs, where in the frame the impact happens, and what type of collision it is, all without access to labeled real-world training data. The pipeline operates in three decoupled stages: (1) Temporal localization via a VideoMAEv2-giant backbone fine-tuned on CARLA-based synthetic clips with metadata-aware embeddings and dense sliding-window inference; (2) Spatial localization using YOLO for object detection combined with a physics-informed hybrid heuristic that leverages bounding-box overlap and trajectory-based reasoning to predict the impact point; and (3) Collision-type classification using a lightweight rule-based strategy derived from the number and configuration of detected vehicles. The key insight is that temporal understanding benefits from supervised fine-tuning on synthetic data, whereas spatial understanding is better served by pretrained object detectors and physics priors that transfer naturally across domains.

[167] InspectorGPT: A Comparative Reasoning Enhanced VLM for Comprehensive Industrial Anomaly Detection cs.CVPDF

Weifei Chen, Honghao Zhang, Zhiyuan You, Xinyi Le

TL;DR: 本文提出了InspectorGPT，一个基于比较推理增强的视觉语言模型（VLM）框架，用于全面的工业异常检测。该方法的核心是模仿人类检查员，通过将查询图像与无缺陷的参考图像进行比较来识别差异。通过链式思维（CoT）微调和定制的组相对策略优化（GRPO）来内化这种比较推理能力，并进一步提出了InspectorGPT-Seg用于像素级异常分割。

Details

Motivation: 现有基于VLM的零样本检测方法存在局限性：面向推理的后训练可能导致异常判别能力崩溃，且现有方法通常只提供文本决策或粗粒度边界框，缺乏像素级分割。受人类检查员通过比较来识别异常的启发，旨在开发一个能执行全面检查任务的框架。

Result: 大量实验表明，该方法在多维性能和泛化到未见过的基准测试上表现出色，验证了比较推理在全面工业检查中的有效性。

Insight: 核心创新在于将人类检查中的比较推理范式系统性地引入VLM框架。技术亮点包括：1）通过CoT微调和定制的GRPO奖励来内化比较推理；2）针对分割任务，提出了通过任务向量融合来分离训练分割和语义推理分支的策略，以平衡两者性能，避免了联合训练的冲突。

Abstract: Industrial anomaly detection is a critical component of modern manufacturing. Most traditional unsupervised methods rely on modelling normal feature distributions, inherently limiting generalization to unknown categories. To improve generalizability, some recent methods incorporate vision-language models (VLMs) for zero-shot detection via text prompts. However, we observe that reasoning-oriented post-training can cause anomaly discrimination to collapse, with some fine-tuned models performing worse than their base VLMs. Existing methods also provide only textual decisions or coarse boxes, without pixel-level segmentation. A more explicit detection principle comes from human inspection: anomalies are identified by comparing a query image with a defect-free reference. Inspired by this, we propose InspectorGPT, a VLM framework centered on comparative reasoning. Given a normal reference and a query image, InspectorGPT compares them to identify discrepancies and perform multiple inspection tasks with detailed reasoning. We internalize this capability through Chain-of-Thought (CoT) fine-tuning and Group Relative Policy Optimization (GRPO) with tailored, verifiable rewards. We further introduce InspectorGPT-Seg for pixel-level anomaly masks. Segmentation supervision improves anomaly discrimination but weakens semantic reasoning, while joint training fails to balance them. We therefore train the two branches separately and combine them through task-vector fusion. Extensive experiments demonstrate superior multi-dimensional performance and generalization to unseen benchmarks, validating comparative reasoning for comprehensive industrial inspection.

[168] GridFlow: Structured Latent Flow for Seamless City-Scale 3D Point Cloud Generation cs.CVPDF

Xinyu Wang, Muhammad Ibrahim, Atif Mansoor, Ajmal Mian

TL;DR: 本文提出了GridFlow，一个多阶段框架，用于从卫星图像、语义分割图和数字表面模型（DSM）生成城市尺度的密集彩色点云。该方法通过网格对齐VAE将每个瓦片编码为保持拓扑结构的潜在网格，并结合条件整流流模型和方向感知扩散着色器，解决了现有方法无法处理城市生成中的规模、无缝拼接和部分可观测性等挑战。

Details

Motivation: 现有3D点云生成方法局限于单个物体或有边界的室内场景，无法应对城市尺度生成中的规模、无缝拼接和部分可观测性（如被遮挡的垂直立面）等挑战，而生成逼真的城市环境对于仿真、城市规划和混合现实应用至关重要。

Result: 在作者基于墨尔本和伦敦数据构建的City3D-MultiGen基准测试（包含16.3万个密集标注瓦片）上，GridFlow在所有几何指标上均优于经过调整的点云生成基线方法，并能生成视觉连贯、边界无缝的彩色点云，覆盖任意大的城市范围。

Insight: 创新点在于提出了网格对齐VAE，它将每个瓦片编码为空间区域对应的潜在网格，保持了拓扑结构，实现了空间连贯的多模态条件输入和紧凑的潜在空间边缘一致性，从而隐式对齐了数千个边界点以实现无缝跨瓦片生成。此外，将几何生成（通过条件整流流）与颜色生成（通过方向感知扩散模型分别处理可见水平面和被遮挡垂直立面）解耦，也是一个关键设计。

Abstract: Generating realistic 3D city environments from remote sensing data is important for simulation, urban planning, and mixed reality, yet existing point cloud generation methods are limited to single objects or bounded indoor scenes and cannot handle the scale, seamless tiling, and partial observability challenges of city-scale generation. We present \ours{}, a multi-stage framework that generates dense, colored point clouds ($10^5$ points per $150\text{m}{\times}150\text{m}$ tile) at city scale, conditioned on satellite imagery, semantic segmentation maps, and digital surface models (DSM). A \emph{Grid-Aligned VAE} encodes each tile into a topology-preserving latent grid where tokens correspond to fixed spatial regions, enabling spatially coherent multi-modal conditioning and compact latent-space edge consistency that implicitly aligns thousands of boundary points for seamless cross-tile generation. A conditional rectified flow model synthesizes geometry latents from the fused multi-modal conditions, and an orientation-aware diffusion colorizer separately handles satellite-visible horizontal surfaces and occluded vertical façades. To support standardized evaluation, we build on public 3D data sources to introduce \emph{City3D-MultiGen}, a benchmark of $163$K densely annotated tiles from Melbourne and London with aligned point clouds, satellite images, semantic maps, and elevation data. Experiments show that \ours{} outperforms adapted point cloud generation baselines across all geometry metrics and produces visually coherent colored point clouds with seamless boundaries over arbitrarily large urban extents. Our benchmark details are available at https://huggingface.co/datasets/e32/City3D-MultiGen

[169] Beyond Global Realism: Virtual Try-On Evaluation and Optimization with Dimension-wise Garment Fidelity Assessment cs.CVPDF

Kaidong Zhang, Yukang Ding, Xiaoyu Liu, Ying Chen

TL;DR: 本文提出了一种名为DAT的维度评估框架，用于虚拟试穿（VTON）任务，将服装一致性分解为七个可解释的维度进行细粒度评估。该框架采用两阶段学习范式进行训练，并可作为强化学习的奖励信号来优化VTON生成模型。

Details

Motivation: 现有虚拟试穿评估指标（如PSNR、SSIM、KID、FID）难以有效衡量生成服装与参考服装之间的一致性，尤其是在捕捉服装保真度的多维特征方面存在不足。

Result: 实验结果表明，该方法（80亿参数）在平衡准确率、SROCC和PLCC指标上达到了最先进的性能，超越了Gemini-3.1、Qwen3.7-plus和GPT-5.5等强大的专有模型。

Insight: 创新点在于将服装保真度分解为七个可解释的维度进行离散属性级预测，并采用大规模弱监督与高质量标注精炼的两阶段训练范式。该评估模型不仅能提供更细粒度的评估，还能作为强化学习的奖励信号，自适应地聚合维度奖励以优化生成过程。

Abstract: Virtual try-on (VTON) requires not only realistic generation but also faithful preservation of garment characteristics. However, existing evaluation metrics such as PSNR, SSIM, KID and FID struggle to measure the consistency between the generated and reference garments, particularly in capturing the multi-dimensional characteristics of garment fidelity. To address this, we propose DAT: a Dimension-wise Assessment framework for virtual Try-on, which decomposes garment consistency into seven interpretable dimensions: silhouette, color, neckline and sleeve shape, major decoration and structure, material texture, fine-detail fidelity, and logo preservation, each formulated as a discrete attribute-level prediction task. To train this specialized assessment model, we adopt a two-stage learning paradigm comprising large-scale weak supervision on 50K samples, followed by refinement on 10K higher-quality annotations obtained via multi-model voting. Furthermore, we employ weighted cross-entropy loss to mitigate the severe label imbalance inherent across evaluation dimensions. Beyond its role as an evaluation framework, the assessment model can be integrated into reinforcement learning optimization of Qwen-Image-Edit for VTON, where dimension-wise rewards are adaptively aggregated to emphasize under-optimized aspects during training. Experimental results show that our method (8B parameters) achieves state-of-the-art performance in terms of balanced accuracy, SROCC, and PLCC, outperforming strong proprietary models such as Gemini-3.1, Qwen3.7-plus, and GPT-5.5, while also serving as an effective optimization signal for reward-guided VTON generation

[170] Foundation and Multimodal Large Language Models for Face Presentation and Morph Attack Detection cs.CVPDF

Hatef Otroshi Shahreza, Asif Hussain Khan, Peter Lorenz, Alain Komaty, Sébastien Marcel

TL;DR: 本文系统研究了通用基础模型（FMs）和多模态大语言模型（MLLMs）是否编码了与呈现攻击检测（PAD）和换脸攻击检测（MAD）相关的信息，并探索了如何最好地利用这些模型来完成这两项任务。作者评估了从零样本提示到微调视觉编码器在内的五种方法，并在多个PAD和MAD数据集上对16个MLLM和30个视觉编码器骨干网络进行了基准测试。

Details

Motivation: 人脸识别系统在安全关键应用中日益普及，但仍易受呈现攻击和换脸攻击。现有的PAD和MAD检测器泛化能力有限，在跨数据集评估中性能下降。本文旨在探究通用预训练模型是否包含攻击相关信息，以提升检测器的泛化性能。

Result: 实验表明，FMs和MLLMs在PAD和MAD任务上能取得显著性能。其中，微调后的模型在跨数据集评估中达到了最先进的（SOTA）检测性能，在MSU-MFSD、CASIA-FASD等四个PAD数据集和FFHQ、FRGC等四个MAD数据集上进行了验证。

Insight: 论文的创新点在于系统性地将通用基础模型和多模态大语言模型引入人脸攻击检测领域，并提出了从零样本到微调的五种渐进式部署策略。客观来看，其核心洞察是通用预训练表征蕴含了丰富的攻击相关信息，通过适当微调能极大提升跨数据集泛化能力，这为构建更鲁棒的生物特征安全系统提供了新思路。此外，通过微调得到的PADLLM和MADLLM还能提供决策的文本推理，增强了模型的可解释性。

Abstract: Face recognition systems are increasingly deployed in security-critical applications, yet they remain vulnerable to presentation and morph attacks. Presentation attack detection (PAD) and morphing attack detection (MAD) are therefore essential components of trustworthy face biometrics. Despite advancements in PAD and MAD methods, existing detectors suffer from limited generalization and degrade in cross-dataset evaluation. In this paper, we systematically investigate whether general-purpose foundation models (FMs) and multimodal large language models (MLLMs) encode PAD-relevant and MAD-relevant information, and how such models can best be deployed for both tasks. We study five approaches with increasing access to the internal information of the model: (i) zero-shot prompting of off-the-shelf MLLMs; (ii) training a shallow model on the next-token logit probabilities at the output of the MLLM; (iii) parameter-efficient fine-tuning on task-specific question-answer data, yielding two specialized MLLMs, called PADLLM and MADLLM, which additionally provide textual reasoning for their decisions; (iv) linear probing of frozen vision encoders; and (v) fine-tuning of vision encoders of FMs and MLLMs. We benchmark 16 open-weight MLLMs and 30 vision encoder backbones on four PAD datasets (MSU-MFSD, CASIA-FASD, Replay-Attack, and OULU-NPU) and four MAD datasets (FFHQ, FRGC, FRLL, and FERET). Our experiments show that FMs and MLLMs can achieve significant performance for PAD and MAD. In addition, the fine-tuned models achieve state-of-the-art detection performance in cross-dataset evaluation, indicating that general-purpose pretrained representations carry substantial attack-relevant information. Source code of all our experiments will be publicly released.

[171] OptiGeo: Efficient Monocular Geometry for Embodied Perception in Optically Challenging Scenes cs.CVPDF

Muxin Liu, Tianbo Liu, Jing Xia, Xiaoyang Lyu, Xiaoshan Wu

TL;DR: OptiGeo是一个针对光学挑战性场景（如透明、反射、镜面）的高效单目几何感知训练框架。它通过引入干净的几何教师模型和残差修剪对齐，利用小规模的目标渲染集来校正真实深度传感器在困难区域产生的监督偏差，从而提升单目深度估计的鲁棒性。

Details

Motivation: 现有单目深度估计方法在开放域泛化能力强，但在透明、反射等光学挑战性场景中，深度传感器会产生缺失或有偏差的深度值，导致模型性能下降。现有解决方案通常依赖场景特定的预处理、辅助模块或微调，这增加了架构冗余并可能导致模型过度特化。

Result: 在透明场景基准测试上，仅3000万参数的OptiGeo显著优于3亿参数的单目模型和十亿参数的多视图基线模型，同时在通用的零样本深度估计和边界清晰度任务上保持竞争力。真实世界导航案例进一步验证了其作为高效感知模块的实用性。

Insight: 创新点在于将问题重新定义为基模型训练中的局部失效模式，并识别出传感器诱导的监督偏差是关键瓶颈。通过将面向透明物体的渲染重新定义为紧凑的干净几何来源，而非大型领域特定微调集，利用小规模目标渲染集学习透明物体的几何结构，校正局部几何失真。这是一种高效、通用的偏差感知训练框架设计思路。

Abstract: Monocular depth estimation has achieved strong open-domain generalization, yet reliable robotic deployment remains difficult in transparent, reflective, and specular environments, where depth sensors often produce missing or biased depth. Existing methods often handle such optical failures with scene-specific preprocessing, auxiliary modules, or post-hoc fine-tuning. While effective in constrained settings, these designs increase architectural redundancy and can over-specialize general geometry models to narrow optical scenarios. We revisit this problem as a localized failure mode within base-model training and identify sensor-induced supervision bias as a key bottleneck: models inherit sensor failure patterns from biased real-depth supervision in optically challenging regions. We then introduce OptiGeo, a bias-aware training framework that rehabilitates biased real supervision using a clean-geometry teacher and residual-trimmed alignment. We redefine transparency-targeted rendering as a compact source of clean optical geometry, rather than a large domain-specific fine-tuning set. With only a small targeted rendering set, OptiGeo learns the geometric structure of transparent objects and regions, correcting local geometry distortions that real sensors cannot reliably supervise. Despite only 30M parameters, OptiGeo outperforms substantially larger 300M-scale monocular models and billion-scale multi-view baselines on transparent-scene benchmarks, while remaining competitive on general zero-shot depth and boundary sharpness. Real-world navigation cases further validate its practicality as an efficient perception module in optically challenging scenes.

Hai Nguyen-Truong, Tuan-Anh Vu, Dang Huynh

TL;DR: 本文提出了一种名为Off-Manifold Refinement（OMR）的推理时方法，旨在提升视频生成模型的物理一致性。该方法通过在单个采样轨迹的中间步骤中，注入一个冻结世界模型（V-JEPA 2.1）的梯度反馈来引导生成过程，无需训练生成器或世界模型。

Details

Motivation: 现代视频生成器在物理动态上经常失败（如物体漂浮、违反重力），标准的去噪或流匹配目标无法显式惩罚这些物理违规。现有改进方法通常会增加显著的推理或训练成本。

Result: 在VideoPhy-2详细子集（400个固定提示）上，OMR将联合语义-物理常识指标从47.0%提升至52.0%（绝对提升5.0个百分点，相对提升10.6%），优于基础采样器。在效率子集（50个固定提示）上，其推理时间仅为基线的1.71倍，远低于奖励或搜索类替代方案。

Insight: 核心创新在于将外部世界模型的反馈直接注入到单个采样轨迹中，通过一个轻量级适配器在潜在空间计算梯度，从而在保持生成器和世界模型冻结的情况下，低成本地引导生成过程朝向物理更合理的区域。这是一种高效的推理时优化策略。

Abstract: Modern video generators routinely fail at physical dynamics: objects float, trajectories violate gravity, contacts vanish. Standard denoising and flow-matching objectives fit visual data distributions but do not explicitly penalize such physical violations. Existing remedies can improve physical consistency, but typically add substantial inference or training cost. Candidate-selection methods generate and score multiple videos, while gradient-based world-model guidance repeatedly decodes and re-encodes intermediate estimates. Generator-internal refinement adds perturbation and re-denoising loops, whereas post-training requires curated data and additional optimization. We propose Off-Manifold Refinement (OMR), an inference-time method that instead injects world-model feedback directly into a single sampling trajectory. During scheduled middle ODE steps, we augment the generator velocity with the gradient of an adapter-space V-JEPA 2.1 surprise energy. This external correction can move the latent away from the uncorrected sampling trajectory and toward regions ranked as more physically plausible by the frozen predictor, after which the generator continues rendering from the corrected state. A small trained latent-to-embedding adapter keeps the gradient tractable at inference, and both the video generator and the world model remain frozen. On our fixed 400-prompt VideoPhy-2 detailed subset, OMR lifts the joint Semantic-Adherence-and-Physical-Commonsense metric from 47.0% to 52.0% (+5.0pp absolute, +10.6% relative) over the base Wan2.2-T2V-A14B sampler. On a separate fixed 50-prompt efficiency subset, it requires $1.71 \times$ the base runtime rather than the multiplicative cost of reward/search alternatives. Project page: https://itruonghai.github.io/omr.

[173] Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory cs.CVPDF

Runjia Qian, Zile Wang, Jihai Zhang, Kai Zou, Wei Yu

TL;DR: Matrix-Game 3.5是一个用于实时流式交互世界模型增强的系统，旨在实现持久、稳定的长时程交互式虚拟世界生成。它通过引入无参数的几何感知记忆框架、静态-动态解耦的世界表示以及两阶段实时蒸馏框架，提升了场景几何保持、动态一致性和相机控制能力，支持分钟级的实时交互生成。

Details

Motivation: 解决在实时自回归生成中，同时保持场景几何、动态一致性和相机控制，以实现稳定长时程交互式世界模拟的挑战。

Result: 在涵盖Unreal模拟环境、开放世界游戏和互联网视频的统一训练语料上，实验表明Matrix-Game 3.5在长时程场景回忆、精确相机控制、主体一致性、提示驱动的世界生成和稳定的实时开放世界交互方面实现了强劲性能。

Insight: 创新点包括：1) 无额外可学习参数的统一几何感知记忆框架（Patch-Memory和Tiled-PRoPE），结合显式3D块检索与投影相机条件，实现几何一致的相机控制和忠实的长时程场景回忆；2) 静态-动态解耦的世界表示，分别建模静态场景几何和动态主体，以保持长时程生成中的几何一致性和主体身份；3) 两阶段渐进式实时蒸馏框架，通过感知流匹配和基于课程的自展开DMD，将双向扩散模型转换为少步因果生成器，实现实时生成。

Abstract: Interactive world models extend video generation from offline clip synthesis toward persistent simulation of interactive virtual worlds, enabling applications in games, robotics, embodied agents, and XR. Achieving stable long-horizon interactive generation, however, remains challenging, as the model must simultaneously preserve scene geometry, dynamic consistency, and camera control while supporting real-time autoregressive generation. Building upon Matrix-Game 3.0, we present Matrix-Game 3.5, as shown in Figure 1, which advances real-time interactive world generation toward geometry-aware and long-horizon consistent simulation through three key improvements. First, we propose a unified geometry-aware memory framework, whose patch-memory and tiled-PRoPE components introduce no additional learnable parameters, combining explicit 3D patch retrieval with projective camera conditioning to enable geometry-consistent camera control and faithful long-horizon scene recall. Second, we introduce a static-dynamic disentangled world representation that separately models static scene geometry and dynamic subjects, preserving both geometric consistency and subject identity throughout long-horizon generation. Third, we develop a two-stage progressive real-time distillation framework that converts a bidirectional diffusion model into a few-step causal generator through Perceptual Flow Matching and curriculum based Self-Rollout DMD, enabling minute-long real-time interactive generation. Extensive experiments demonstrate that, with a unified training corpus spanning Unreal simulation environments, open-world games, and internet videos, MatrixGame 3.5 achieves strong performance in long-horizon scene recall, precise camera control, subject consistency, prompt-driven world generation, and stable real-time open-world interaction.

[174] FoundYou: A Unified Model for Personalized Segmentation and Retrieval cs.CVPDF

Gabriele Trivigno, Marcos Alfaro, Claudia Cuttano, Gabriele Berton, Luis Payá

TL;DR: 本文提出了FoundYou，一个基于Segment Anything 2 (SAM 2)的统一框架，用于解决个性化分割和个性化检索这两个任务。该框架利用SAM 2在视频帧间保持物体身份的特性，通过实例对齐过程，同时实现目标在图像中的定位（分割）和跨图像的检索。

Details

Motivation: 个性化分割和个性化检索虽然共享在图像间识别同一物理物体的实例级目标，但长期以来被视为独立任务并采用不同解决方案。本文旨在探索并构建一个统一的模型来处理这两个任务。

Result: 在PerMIS数据集上mIoU提升18.4，在ILIAS数据集上mAP提升17.8，超越了统一方法和特定任务方法。在类别级检索基准测试中达到了最先进水平（SOTA）。模型保持SAM 2-small完全冻结，仅增加590万可训练参数，总参数量5200万，比之前唯一的统一方案快75倍且小20倍。

Insight: 核心创新在于洞察到SAM 2模型（为视频设计）隐含地捕获了实例级线索，并利用这一特性将其泛化到独立图像间的物体匹配，从而统一了分割和检索任务。这解锁了少样本个性化检索和灵活提示的个性化分割等新能力，且模型高效紧凑。

Abstract: Personalized segmentation and personalized retrieval both aim to identify the same physical object across different images. While the former localizes the object within a target image, the latter retrieves images where it appears. Despite this shared instance-level objective, the two tasks have largely evolved separately and are addressed with distinct solutions. In this work, we introduce FoundYou, a unified framework built on the observation that Segment Anything 2 (SAM 2), trained to preserve object identity across video frames, inherently captures instance-level cues. We leverage this property to match objects across independent images, enabling segmentation and retrieval to emerge as two outcomes of the same instance alignment process. This unified view unlocks new capabilities beyond traditional benchmarks, including few-shot personalized retrieval and promptable personalized segmentation with flexible prompts. Extensive experiments show consistent gains over unified and task-specific methods, including +18.4 mIoU on PerMIS and +17.8 mAP on ILIAS. Performance scales with additional references and remains robust to weaker prompts. Beyond personalization, FoundYou achieves state-of-the-art results on category-level retrieval benchmarks. Notably, our approach keeps the SAM 2-small model entirely frozen and adds only 5.9 M trainable parameters, yielding a 52 M-parameter model that is over 75x faster and 20x smaller than the only prior unified solution. Code is available at https://github.com/ga1i13o/FoundYou .

[175] Everybody Tracking Every Body cs.CVPDF

Daeyun Shin, Yunhan Zhao, Shu Kong, Alexander C. Berg, Charless Fowlkes

TL;DR: 本文提出了一种基于扩散模型的方法，用于从多个佩戴第一人称摄像头的个体的交互场景中估计三维人体姿态。该方法融合了由自我中心摄像头运动推导出的头部运动姿态估计，以及来自他人摄像头的外中心姿态观测，同时考虑了观测内容和可靠性。模型在单人运动捕捉数据和多人物视频混合数据上训练，以学习丰富的身体运动轨迹和视频观测可靠性先验。

Details

Motivation: 解决从多个交互个体的自我中心视角，在集中协调下进行三维人体姿态估计的问题。挑战在于外中心观测（即从他人视角看到的姿态）稀疏、间歇且可靠性变化大。

Result: 在具有挑战性的多人物数据集上评估，该方法在绝对和相对姿态精度上均优于仅使用运动或仅使用视觉的基线方法。

Insight: 创新点在于提出了一种基于扩散的融合框架，能够同时利用自我中心运动数据和外中心视觉观测，并显式地对观测内容和可靠性进行条件建模，从而在稀疏、不可靠的多视角观测下实现鲁棒的多人物三维姿态估计。

Abstract: We address the problem of 3D body pose estimation of multiple interacting people from their egocentric views with centralized coordination. Each individual wears a camera recording egocentric video and IMU data. Processing this video with VIO SLAM provides high-quality tracking of each egocentric camera through space. The first-person view from one individual provides third-person observations of other people, although these exocentric observations are sparse, intermittent, and of highly variable reliability as both cameras and subjects move. To integrate these synchronized data streams, we propose a diffusion-based approach that fuses estimates of pose based on head motion derived from egocentric camera motion with exocentric pose observations, conditioning on both observation content and reliability. Our model is trained on a mixture of single-person motion-capture data and multi-person video in order to learn rich priors for body motion trajectories and video observation reliability. Evaluation on challenging multi-person datasets suggests our fusion approach improves over motion-only and vision-only baselines in terms of both absolute and relative pose accuracy.

[176] Hallucination Mitigation for Large Vision-Language Models via Implicit Feature Stabilization cs.CV | cs.AI | cs.LGPDF

Aditi Sarker, Rafi Ibn Sultan, Hui Zhu, Dongxiao Zhu, Prashant Khanduri

TL;DR: 该论文提出了一种名为INFUSE的隐式特征稳定化框架，旨在缓解大型视觉语言模型（LVLM）的幻觉问题。该方法通过在微调阶段将抗扰动性构建到模型权重中，而非在推理时进行干预，从而在不增加推理开销的情况下，显著降低了模型在多个基准测试上的幻觉率。

Details

Motivation: 大型视觉语言模型容易产生幻觉，即描述图像中不存在的对象、属性或场景。作者将部分失败原因归咎于模型表征的“特征不稳定性”——输入的微小语义保留扰动会导致嵌入表示发生巨大变化，且幻觉率随这种变异性上升。现有基于稳定性的方法多为显式干预，在推理时带来额外开销。

Result: 在LLaVA-1.5、LLaVA-1.6和Qwen3-VL-8B-Instruct等模型上，INFUSE将AMBER CHAIR幻觉指标相对降低了46-63%，并提升了ObjHal、MMHal、HallusionBench和POPE等基准的性能，同时保持了VQA-v2和TextVQA的准确率，且不产生推理时开销。

Insight: 核心创新点在于提出了“隐式稳定化”框架，将扰动不变性内化到模型权重中，而非依赖推理时干预。其理论贡献在于证明了锚点表示与扰动平均表示之间的均方根偏差以$1/sqrt{K}$的速率收缩，并在Lipschitz解码器假设下，为模型幻觉行为的变化提供了上界。该方法实现了性能提升与推理效率的平衡。

Abstract: Large Vision-Language Models (LVLMs) are prone to hallucinations: they fluently describe objects, attributes, and scenes that are not in the image. We connect part of this failure to a measurable property of their representations, feature instability, where mild semantics-preserving perturbations of the input cause large changes in the learned embeddings; hallucination rates rise together with this variability. Existing stability-motivated remedies are explicit, in the sense that they intervene at inference time through latent steering or constrained decoding, and pay for it on every query. We propose implicit stabilization instead: perturbation-invariance is built into the model weights during fine-tuning, and nothing extra runs at deployment. Our framework, INFUSE, first stabilizes visual and textual representations around perturbation-averaged and ground-truth anchors, then aligns the stabilized representations across modalities with bidirectional contrastive objectives. We prove that the anchor’s root-mean-square deviation from the perturbation-mean representation shrinks at rate $1/\sqrt{K}$ in the number of views, and that under a Lipschitz decoder, this bounds how much any perturbation can change the model’s hallucination behavior. On LLaVA-1.5, LLaVA-1.6, and Qwen3-VL-8B-Instruct, INFUSE reduces AMBER CHAIR by 46-63% relative to each base model, improves ObjHal, MMHal, HallusionBench, and POPE, and preserves VQA-v2 and TextVQA, all with no inference-time overhead.

[177] Towards Continual Test-Time Adaptation of Vision-Language Models in Open-Vocabulary Semantic Segmentation cs.CV | cs.LGPDF

Chandler Timm C. Doloriel, Yunbei Zhang, Sarthak Kumar Maharana, Muhammad Salman Siddiqui, Tor Kristian Stevik

TL;DR: 本文针对开放词汇语义分割模型在持续测试时分布偏移下的脆弱性问题，提出了一种名为DAF的稳定化框架。该框架通过引入边际多样性损失、跨模态锚点一致性损失和特征显著性过滤机制，有效防止了基于熵最小化的自适应方法导致的类别崩溃和特征漂移，并在多个数据集上显著提升了模型性能。

Details

Motivation: 开放词汇语义分割依赖视觉-语言对齐来识别任意文本定义的类别，但这种对齐在持续测试时分布偏移下是脆弱的。诊断分析发现，熵最小化会导致补丁级类别崩溃，持续更新会侵蚀视觉-语言对齐，而低偏移样本的冗余梯度会浪费计算资源。

Result: 在涵盖自然场景、自动驾驶、水下图像和遥感及其损坏变体的五个数据集上进行评估。在评估的持续偏移中，DAF在熵最小化方法崩溃时保持稳定，与源模型相比，在Pascal VOC20-C上mIoU提升超过8个百分点，在LoveDA上提升超过9个百分点，在Foggy Cityscapes上提升超过3个百分点，并且对激进的自适应和学习率选择具有鲁棒性。

Insight: 创新点在于提出了一个集成了多样性损失、锚点一致性损失和过滤机制的三合一稳定化框架。边际多样性损失抵抗类别崩溃，跨模态锚点一致性损失约束特征漂移，特征显著性过滤则通过跳过低价值反向传播来抵消部分计算开销，从而在保持视觉-语言对齐的同时实现高效稳定的持续测试时自适应。

Abstract: Open-vocabulary semantic segmentation (OVSS) relies on vision-language alignment to recognize arbitrary text-defined categories, yet this alignment is fragile under continual test-time distribution shift. Our diagnostic analysis reveals that entropy minimization drives patch-level class collapse, continual updates erode vision-language alignment, and redundant gradients from low-shift samples waste computation. We propose Diversify, Anchor, and Filter (DAF), a stabilization framework that augments entropy-based adaptation with a marginal diversity loss that resists collapse, a cross-modal anchor consistency loss that constrains feature drift relative to a frozen source model, and feature salience filtering that skips low-value backward passes to offset part of the source-anchor overhead. We evaluate on five datasets spanning natural scenes, autonomous driving, underwater imagery, and remote sensing with their corrupted variants. Across the evaluated continual shifts, DAF remains stable where entropy minimization collapses, improving mIoU by over 8 points on Pascal VOC20-C, over 9 points on LoveDA, and over 3 points on Foggy Cityscapes compared to the source model, and is robust to aggressive adaptation and learning rate choices.

[178] RIDGE: Region-Informed Derivative-Guided Evidence Selection for Long Video Understanding cs.CVPDF

Shanqing Xu, Meng Luo, Mengchen Qian, Yuhui Gao, Siyue Peng

TL;DR: 本文提出RIDGE框架，用于长视频理解中的帧选择。该方法将帧-查询相似度曲线视为时序信号，通过分析局部变化和曲率将时间线划分为结构区域，并在固定视觉令牌预算下进行区域特定的选择，以保留事件核心、过渡、铺垫、后续和上下文帧。

Details

Motivation: 现有查询感知的帧选择方法通常基于帧-查询相关性得分进行排序或采样，但忽略了相似度序列作为有序信号的形状信息，这可能导致解释、情境化或跟随事件的帧被遗漏，因为这些帧可能位于相关性峰值的上升或下降侧而得分较低。

Result: 在四个长视频基准测试和三个骨干模型上，RIDGE在大多数设置中取得了最佳性能，在其他设置中也保持竞争力。

Insight: 创新点在于将帧选择问题重新定义为时序信号分析，利用导数信息划分结构区域并进行区域特定选择；该方法作为轻量级后处理步骤，无需训练或迭代调用大视觉语言模型，可直接应用于预计算的帧-查询得分。

Abstract: Long videos contain far more visual content than Large Vision-Language Models (LVLMs) can process under a fixed visual-token budget, making frame selection essential. Existing query-aware selectors usually estimate frame-query relevance and build a compact subset from high-scoring frames. Although their mechanisms differ, the similarity sequence is still often treated primarily as values to rank or sample from, rather than as an ordered signal whose shape reflects how query-relevant evidence emerges, peaks, and fades over time. This can obscure frames that explain, contextualize, or follow an event, because such evidence may lie on the rising or falling sides of a nearby relevance peak and receive lower absolute scores. We propose RIDGE, a frame selection framework that reads the frame-query similarity curve as a temporal signal. By using local changes and curvature, RIDGE partitions the timeline into structural regions and applies region-specific selection to preserve event cores, transitions, buildup, aftermath, and contextual frames under a fixed budget. It is a lightweight post-processing step on precomputed frame-query scores and requires neither training nor iterative LVLM calls. Across four long-video benchmarks and three backbones, RIDGE achieves the best performance in most settings and remains competitive in the others.

[179] Evaluating 2D and 3D-Aware Vision Foundation Models for Vehicle Attribute Recognition cs.CVPDF

Alexandre V. Delazeri, Gabriel E. Lima, Eduil Nascimento, Rayson Laroca, David Menotti

TL;DR: 本文对14种先进的2D和3D感知视觉基础模型在车辆属性识别任务上进行了实证性基准测试，评估了它们作为冻结特征提取器在车辆类型、品牌和型号识别上的性能。研究发现，标准的2D自监督模型（尤其是DINOv3）在细粒度任务上显著优于3D感知模型，而3D感知模型Depth Anything v2在车辆类型分类中对视角变化表现出更强的鲁棒性。

Details

Motivation: 在智能交通系统中，当自动车牌识别不可用或不可靠时，车辆属性识别变得尤为重要。尽管视觉基础模型展现出强大的跨领域迁移能力，但其在细粒度车辆分类中的有效性尚未得到充分探索。同时，考虑到车辆固有的三维结构，新兴的3D感知基础模型是否比标准2D架构更具优势尚不明确。

Result: 在具有挑战性的真实世界数据集UFPR-VeSV上，通过线性探测进行评估，2D自监督模型DINOv3在车辆品牌和型号识别任务上取得了超过93%的宏准确率，显著优于3D感知模型。然而，在车辆类型分类中，3D感知模型Depth Anything v2对视角变化表现出更强的鲁棒性。

Insight: 论文的创新点在于首次系统地实证比较了2D与3D感知视觉基础模型在细粒度车辆识别任务上的性能，揭示了2D模型在细粒度分类上的优势以及3D模型在视角不变性上的潜力。这为未来结合2D和3D先验知识的混合方法提供了动机和方向。

Abstract: Vehicle attribute recognition is an important task in intelligent transportation systems, particularly when Automatic License Plate Recognition (ALPR) is unavailable or unreliable. Although vision foundation models have shown strong transferability across domains, their effectiveness for fine-grained vehicle classification remains underexplored. Moreover, given the inherently three-dimensional structure of vehicles, it is unclear whether emerging 3D-aware foundation models offer advantages over standard 2D architectures. This paper presents an empirical benchmark of 14 state-of-the-art 2D and 3D-aware vision foundation models. Using the challenging real-world UFPR-VeSV dataset, we evaluate these models as frozen feature extractors via linear probing for vehicle type, make, and model recognition. We further stress-test the best-performing models under few-shot learning and Out-of-Distribution (OOD) domain shifts. Our results show that standard 2D self-supervised models, particularly DINOv3, substantially outperform 3D-aware models in fine-grained tasks, achieving over 93% Macro-Accuracy for make and model recognition. However, the 3D-aware Depth Anything v2 exhibits stronger invariance to viewing angles in vehicle type classification. These findings motivate hybrid approaches that combine 2D and 3D priors for robust vehicle recognition. Our code is publicly available at https://github.com/UFPR-IPASPPR/3D-Vision-Benchmark/.

[180] SpanCalib-VLM: Calibrated Hallucination Span Detection in Vision-Language Models cs.CV | cs.CLPDF

Amanuel Gizachew Abebe, Yasmin Moslem

TL;DR: 本文提出了SpanCalib-VLM，一个用于检测大型视觉语言模型幻觉的混合双系统。它结合了一个多模态序列标注器和一个微调的生成式VLM，通过一种名为Union-Calibrated Fusion的策略，利用序列标注器校准后的概率对生成模型提出的候选幻觉文本片段进行重新评分，旨在同时实现准确的片段定位和良好校准的置信度分数。

Details

Motivation: 现有方法在检测LVLM幻觉时存在缺陷：微调的生成式VLM能识别幻觉文本片段但存在过度自信和高推理延迟问题；判别式序列标注器速度快、校准好但片段召回率保守。本文旨在结合两者优势，解决准确片段定位与置信度校准的平衡问题。

Result: 在SHROOM-Visions英文评估集上，该集成方法取得了0.41的皮尔逊校准相关性和0.39的整体IoU，其中干净响应的IoU达到0.91，整体检测准确率为70.7%。

Insight: 核心创新点是提出了一种混合双系统架构及Union-Calibrated Fusion融合策略，将生成模型的片段召回能力与判别模型的校准及速度优势相结合，为幻觉检测任务提供了一种兼顾精度、校准和效率的新思路。

Abstract: Detecting hallucinations in Large Vision-Language Models (LVLMs) requires both accurate span localization and well-calibrated confidence scores. Fine-tuned generative VLMs excel at identifying hallucinated text spans but suffer from overconfidence and high inference latency. Discriminative sequence taggers offer deterministic speed and superior calibration but exhibit conservative span recall. We present SpanCalib-VLM, a hybrid dual-system for the SHROOM-Visions Shared Task that combines a multimodal sequence tagger, consisting of XLM-RoBERTa-Large fused with a SigLIP vision encoder via cross-attention, with our fine-tuned generative VLM (Qwen3.5-4B-SHROOM-SFT). Through a Union-Calibrated Fusion strategy, candidate spans from the generative model are re-scored with calibrated probabilities from the sequence tagger. On the SHROOM-Visions English evaluation split, our ensemble achieves a Pearson calibration correlation of 0.41 and an overall IoU of 0.39, with a clean-response IoU of 0.91} and overall detection accuracy of 70.7%. We make our model weights and code publicly available.

[181] FIS-OT: Feature-Induced Optimal Transport for Unsupervised Action Segmentation cs.CVPDF

Linxiang Peng, Xinyao Qin, Jinhan Li, Di Yang, Jiangtao Wang

TL;DR: 本文提出了一种名为FIS-OT的无监督动作分割框架，通过引入特征增强生成器和特征诱导残差结构先验，解决了现有最优传输方法忽视局部信息和对伪标签过度自信的问题，在三个数据集上验证了其有效性。

Details

Motivation: 解决无监督动作分割任务中，现有最优传输方法因使用全局约束而忽略局部信息，以及因过度信任伪标签而导致的早期训练阶段噪声学习（确认偏误）问题。

Result: 在三个数据集上进行了广泛实验，结果表明所提方法有效，但摘要中未明确提及具体定量结果（如准确率）或是否达到SOTA水平。

Insight: 创新点包括：1) 引入特征增强生成器模块作为内部正则化器，利用三元组损失捕获局部一致性，提供独立于噪声伪标签的鲁棒监督；2) 提出结合固定时间主干和动态特征相似性的特征诱导残差结构先验，确保时间连续性并适应复杂动作结构；3) 建立循环优化循环，对齐局部特征学习与全局结构对齐。

Abstract: Unsupervised action segmentation is a challenging task. It involves finding action categories and boundaries in videos without labels. Existing Optimal Transport (OT) methods use global constraints. This causes them to overlook the use of local information. Furthermore, existing Optimal transport architectures are prone to confirmation bias because they overly trust the pseudo-labels they generate. This causes models to learn from noise in the early training stages. To address these issues, we propose FIS-OT. It is a novel Feature-Induced Structured Optimal Transport framework. First, we introduce a Feature Enhanced Generator (FEG) module. It serves as an internal regularizer. By using triplet loss, FEG captures local consistency. It provides robust supervision that is independent of noisy pseudo-labels. Second, we propose a Feature-Induced Residual Structural Prior. This combines a fixed temporal backbone with dynamic feature similarities. This design ensures temporal continuity. It also allows the solver to adapt to complex action structures. Finally, we establish a cyclic optimization loop. This aligns local feature learning with global structural alignment. Extensive experiments on the three datasets show the effectiveness of our method.

[182] SVI2LoD3: Agent-Driven Reconstruction of LoD3 Facade Openings in Semantic 3D City Models from Volunteered Street View Imagery using Large Language and Visual Models cs.CVPDF

Elmehdi Kanna, Lukas Arzoumanidis, Huynh Duc An Son Nguyen, Youness Dehbi

TL;DR: 本文提出了一种端到端、智能体驱动的流程，用于从众包街景图像中重建3D城市模型中的立面开口（如门窗），并生成可直接使用的CityGML标准LoD3输出。该方法采用零样本分割策略，避免了传统方法对大量人工标注数据的依赖，并通过强制正确的部件层次结构来保证模型合规性。此外，论文还引入了一种新的立面重建评估指标——立面特征距离（FFD），该指标在视觉Transformer提取的高层特征空间中衡量重建质量，能更好地捕捉语义正确性和建筑布局。

Details

Motivation: 现有基于监督语义分割的立面重建方法需要大量人工标注数据，成本高昂且难以扩展。本文旨在开发一种减少标注依赖、能自动生成符合CityGML标准的LoD3细节模型的实用流程。

Result: 在eTRIMS数据集上的基准测试表明，该方法在显著减少标注工作量的同时仍能实现强劲性能。新提出的FFD指标比传统的mIoU或FRDS等像素级重叠指标更能全面评估立面重建质量。

Insight: 核心创新点在于结合大型语言和视觉模型，采用零样本分割策略进行立面开口重建，并强制生成符合CityGML标准的部件层次结构。从客观角度看，其提出的FFD评估指标通过高层特征空间距离来综合衡量语义和布局，为3D城市模型质量评估提供了新思路。

Abstract: This paper presents an end-to-end, agent-driven pipeline for the LoD3 reconstruction of facade openings in 3D city models, producing directly usable CityGML-conform outputs. In contrast to existing approaches that rely on supervised semantic segmentation and therefore require large amounts of manually annotated training data, the proposed method employs a zero-shot segmentation strategy. This substantially reduces the annotation effort while still achieving strong performance in our benchmark on the eTRIMS dataset. A further key contribution is the enforcement of correct partonomic hierarchies, thereby producing CityGML-conform LoD3 building models. Beyond the reconstruction pipeline itself, this work also introduces a novel evaluation metric for facade reconstruction, termed Facade Feature Distance (FFD). Unlike conventional metrics such as mIoU or FRDS, which assess similarity primarily through pixel-wise overlap, FFD measures distance in a high-level feature space derived from a vision transformer. In doing so, it captures both semantic correctness and architectural layout, providing a more suitable assessment of facade reconstruction quality. The proposed pipeline and evaluation strategy together offer a practical and scalable contribution toward the automated generation and analysis of semantically enriched 3D city models. The developed code is published at: https://github.com/hcu-cml/citydb-SVI2LoD3-ai.

[183] Partition-Aware Unlearning for Removing Spurious Correlations in Large Vision-Language Models cs.CV | cs.AI | cs.LGPDF

Aditi Sarker, Nazreen Shah, Rafi Ibn Sultan, Rhongho Jang, Dongxiao Zhu

TL;DR: 该论文提出了PURGE框架，旨在解决大型视觉语言模型（LVLMs）中存在的虚假对象-背景关联问题。该框架包含结构化数据集构建和分区感知遗忘两部分，通过构建可控的诊断数据集并选择性遗忘虚假关联，以减少模型的幻觉和错误，同时保持或提升整体性能。

Details

Motivation: 大型视觉语言模型在多种任务上表现优异，但经常利用虚假的对象-背景相关性进行预测，导致预测依赖于上下文捷径而非对象相关的视觉证据。现有基准测试在控制模型预测是基于目标对象还是相关背景线索方面能力有限，因此需要新的方法来诊断和缓解这一问题。

Result: 在多个LVLMs（如LLaVA-1.6-7B、Qwen3-VL-8B-Instruct等）和基准测试（如CHAIR、POPE、MM-SpuBench等）上评估PURGE框架，结果显示它一致地减少了幻觉和虚假关联驱动的错误，同时在大多数评估设置中保持或改善了整体性能。

Insight: 创新点在于提出了一个结合结构化数据集构建和分区感知遗忘的框架，通过分区示例来可控地诊断模型对捷径的依赖，并选择性遗忘虚假关联以增强模型的可靠性。这为评估和缓解LVLMs中的虚假相关性提供了可重用的协议和有效的缓解方法。

Abstract: Large Vision-Language Models (LVLMs) achieve strong performance across many multimodal tasks; however, they often exploit spurious object-background correlations, resulting in predictions driven by contextual shortcuts rather than object-relevant visual evidence. Despite growing interest in hallucination and robustness evaluation, existing benchmarks provide limited control over whether model predictions are grounded in the target object or induced by correlated background cues. In this work, we introduce PURGE (\underline{P}artition-aware \underline{U}nlearning for \underline{R}emoving spurious-correlation \underline{G}enerated \underline{E}rrors), a framework for constructing, benchmarking, and mitigating spurious-correlation-induced failures in LVLMs. The framework consists of: – (1) Structured dataset construction wherein we develop three complementary structured data construction strategies that partition examples by object-relevant evidence and spurious background cues, enabling controlled diagnosis of shortcut reliance; and – (2) Partition-aware unlearning, which uses these partitions to selectively remove spurious object-background associations while preserving object-based reasoning. We evaluate the \algo~framework across multiple LVLMs, including LLaVA-1.6-7B, Qwen3-VL-8B-Instruct, and Qwen3.5-9B, together with CLIP as a vision-language encoder, on a diverse suite of benchmarks, including CHAIR, POPE, Causal-HalBench, MM-SpuBench, AMBER, MMHal, and Waterbirds. Our results show that PURGE consistently reduces hallucinations and spurious-correlation-driven errors while maintaining or improving overall performance in most evaluated settings, providing both a reusable evaluation protocol and an effective mitigation framework for more reliable LVLMs.

[184] Input-Adaptive Gating of a Dehazing Front-End for On-Device Perception in Smoke-Obscured Environments cs.CVPDF

Seongjun Kang, Ishaan Garg, Vishnu Bharadwaj

TL;DR: 本文提出了一种针对烟雾环境中设备端感知的自适应去雾门控方法。该研究在消防员辅助视觉系统中，评估了在边缘检测器前放置去雾网络的效果，发现去雾仅在浓雾下有益，在清晰或轻度雾化帧中反而会损失细节。因此，作者引入了一种基于暗通道雾度估计的门控机制，仅在必要时运行去雾网络，从而在保持精度的同时大幅提升了处理速度。

Details

Motivation: 解决传统两阶段视觉流水线（先增强后任务）在烟雾环境中并非总是有效的问题，特别是在清晰或轻度雾化帧中，去雾操作反而会损害任务性能。目标是设计一个高效的自适应系统，以优化设备端（如树莓派）的实时感知性能。

Result: 在真实烟雾数据上，所提去雾网络PSNR达到18.60 dB，优于未处理的13.60 dB和同数据训练的AOD-Net的17.08 dB；边缘检测器F-measure (ODS)为0.738，优于优化Canny的0.692。自适应门控策略在四种雾度水平下的平均ODS为0.675，优于始终去雾（0.664）和从不去雾（0.630）。在树莓派上，门控将平均每帧处理时间从569 ms降至321 ms，在清晰帧上帧率从1.8 fps提升至9 fps。

Insight: 主要创新点在于提出了输入自适应的门控机制，根据暗通道雾度估计动态决定是否启用去雾前端，从而在保证任务性能（边缘检测）的同时，显著降低了计算开销。这挑战了“更清晰的输入总是带来更好的输出”的假设，并为资源受限设备上的自适应视觉流水线设计提供了新思路。

Abstract: Two-stage vision pipelines often place an enhancement network before a task network, on the assumption that a cleaner input produces a better output. We evaluate this in a firefighter assistance pipeline, where a dehazer precedes an edge detector that renders smoke-filled rooms as structural outlines. Both were designed for a Raspberry Pi 4, at 355K and 23K parameters, and quantized to UINT8 via TensorFlow Lite. The float dehazer reaches 18.60 dB peak signal-to-noise ratio (PSNR) on held-out real smoke against 13.60 dB unprocessed and 17.08 dB for an AOD-Net trained on the same data, and the edge detector reaches an F-measure at optimal dataset scale (ODS) of 0.738, outperforming an optimized Canny’s result of 0.692. Dehazing improves edge extraction under dense smoke but degrades it on clear and lightly hazed frames, where the dehazer discards more detail than the haze obscures. We therefore run the dehazer only when a dark channel haze estimate exceeds a threshold, a 10.1 ms test that lets the pipeline save 469.6 ms on the dehazing stage. Averaged over four haze levels, gating is more accurate than either fixed decision, at 0.675 mean ODS against 0.664 for always dehazing and 0.630 for never dehazing. It reduces the mean per-frame time on the Raspberry Pi from 569 ms to 321 ms, and on clear frames increases the frame rate fivefold, from 1.8 to 9 frames per second.

[185] TAKE 85: Testing Audiovisual filmmaKer’s intEnt across 85 Hours of Film cs.CVPDF

Kaishuu Shinozaki-Conefrey, Olivier Pascaud, Robin Courant, Xi Wang, Dimitris Samaras

TL;DR: 论文提出了TAKE 85基准测试，这是首个用于评估导演意图理解能力的基准，包含85小时、398部短片及其专家验证的问答对。通过实验发现，当前最先进的多模态大语言模型在感知事件描述与推断电影制作决策的沟通意图之间存在巨大差距。

Details

Motivation: 当前多模态大语言模型主要评估对‘发生了什么’的理解，而忽略了电影通过灯光、色彩、构图等创造性选择传达的‘为何如此呈现’的导演意图，因此需要专门的基准来填补这一评估空白。

Result: 在TAKE 85基准上，即使最强的模型得分仅为58/100，且模态消融实验表明任何单一输入模态都不足以独立完成任务，凸显了模型在意图理解上的不足。

Insight: 创新点在于首次将导演意图确立为多模态理解的一个关键维度，并构建了系统性的评估基准；客观来看，该研究揭示了模型在深层语义推理与创造性信号解释方面的局限性，为未来模型设计提供了重要方向。

Abstract: Films communicate through deliberate creative choices, including lighting, color, composition, editing, dialogue, music, and sound. Humans naturally interpret these signals as directorial intent, yet current multimodal large language models (MLLMs) are evaluated almost exclusively on understanding what happens rather than why it is presented that way. We introduce TAKE 85, the first benchmark for directorial-intent understanding, comprising 398 short films (85 hours) with expert-verified question-answer pairs spanning global and fine-grained visual and audio intent. Through controlled modality ablations, TAKE 85 enables systematic evaluation of multimodal reasoning. Experiments on state-of-the-art MLLMs reveal a substantial gap between perceptual recognition and intentional understanding: while models accurately describe events and narratives, they consistently fail to infer the communicative role of filmmaking decisions. Our results establish directorial intent as a previously overlooked dimension of multimodal understanding: even the strongest model reaches only 58 out of 100, and our ablations show that no input modality is sufficient on its own. All code, Q&As, and models are publicly available from https://github.com/KaiShinozakiConefrey/Take-85

[186] A Hybrid State-Space Approach for Census-Tract Population Estimation cs.CV | cs.LGPDF

Jackson R. Ye, Alexandre V. Morozov

TL;DR: 本文提出MambaPop，一种基于混合状态空间-注意力架构（MambaVision）的新方法，用于直接从行政区划（人口普查区）的卫星图像序列中估计人口，避免了传统方法中需要将人口数据分解到统一栅格网格的步骤。

Details

Motivation: 现有主流人口估算系统（如WorldPop和LandScan）将人口绑定到统一栅格，并通过辅助数据构建权重表面进行空间分解，这可能导致系统性空间偏差，且丢弃了原始人口普查的行政区划结构。本文旨在填补这一空白，直接利用行政区划自身的卫星图像进行人口估计。

Result: 在2020年美国本土约84,000个人口普查区上，MambaPop取得了每区1,141人的平均绝对误差（MAE），与最强的卷积基线模型（YOLOv11，MAE 1,122人）性能相当。

Insight: 创新点在于首次将人口估计任务建模为基于行政区划卫星图像块的序列建模问题，并首次将基于状态空间（Mamba）的混合架构应用于该任务，从而实现了直接从原始行政单元图像学习人口，消除了空间分解步骤及其引入的偏差。

Abstract: Sequence models—the architecture family behind large language models and, increasingly, state-of-the-art image recognition—have redefined how machines learn from high-dimensional data. Yet population estimation from satellite imagery, a task that underpins infrastructure planning, public health, and disaster response, has scarcely benefited: leading systems still bind population to a uniform raster, disaggregating census counts onto grid cells through weighting surfaces built from ancillary data (e.g., in WorldPop and LandScan), which can introduce systematic spatial bias, and predicting population per grid cell with convolutional neural networks. In this approach, the administrative-unit structure in which the census was actually collected is discarded. We close this gap with MambaPop, which renders each administrative unit as a single polygon-masked satellite image and treats tract-level population estimation as a sequence-modeling problem over its image patches, pairing each tract image directly with its population label and eliminating the disaggregation step entirely. Built on the hybrid state-space–attention MambaVision backbone, MambaPop is, to our knowledge, the first method to learn population directly from an administrative unit’s own image as well as the first to apply a state-space based (Mamba) hybrid architecture to the population estimation task. Across all $\sim$84{,}000 contiguous-US census tracts of the 2020 census, MambaPop attains a mean absolute error (MAE) of $1{,}141$ persons per tract, matching the strongest convolutional baseline (YOLOv11, MAE $1{,}122$).

[187] Aligning Multi-Trajectory Supervision with Policy Optimization for VLA Driving cs.CV | cs.AI | cs.LGPDF

Tian Zhang, Zhuo Huang, Hongrui Ye, Yu Wu, Zengmao Wang

TL;DR: 本文提出了一种将多轨迹监督与策略优化对齐的新框架，用于解决视觉-语言-动作（VLA）驾驶方法中，高评分轨迹可能因与当前策略可行行为分布不匹配而导致后续组相对策略优化（GRPO）性能下降的问题。该方法通过约束增强轨迹到真实可行区域的邻近流形、采用帕累托最优性准则筛选候选轨迹，并结合可行性优先优势分配与动态蒸馏机制，确保扩展的轨迹监督能被有效吸收，从而提升策略性能。

Details

Motivation: 动机在于解决VLA驾驶方法中，多轨迹模仿学习与GRPO结合时，某些用于改进模仿的高评分轨迹会因优势估计与当前策略可行行为分布不匹配，导致策略更新偏离安全合规行为的问题。

Result: 在NAVSIM v1和v2基准测试中，该方法在单轨迹推理下分别达到91.4 PDMS和89.1 EPDMS，并在658个初始失败场景中恢复了440个，比原始GRPO基线高出11.1%。

Insight: 创新点在于提出了一个对齐多轨迹监督与策略优化的框架，核心是通过约束增强轨迹到可行流形、采用帕累托最优筛选来减少策略梯度偏差，并引入可行性优先优势分配和动态蒸馏机制，确保监督信息被有效吸收并转化为策略改进。

Abstract: Vision-language-action (VLA) driving methods increasingly combine multi-trajectory imitation learning with group-relative policy optimization (GRPO), making trajectory selection critical to final performance. However, some high-scoring trajectories that improve imitation can degrade subsequent GRPO by inducing advantage estimates misaligned with the current policy’s feasible behavior distribution, driving updates away from safe and compliant behaviors. To address this, we propose a novel framework that aligns multi-trajectory supervision with policy optimization. To address the policy gradient bias induced by infeasible noisy trajectories outside the feasible region, augmented trajectories are constrained to a neighboring manifold of the ground-truth feasible region, and a Pareto-optimality criterion is adopted in place of the conventional aggregate score, retaining only non-dominated candidates and thereby filtering out conflicting samples at the source. To ensure that expanded trajectory supervision is effectively absorbed during policy optimization, we introduce two complementary mechanisms: feasibility-first advantage assignment and dynamic distillation. The former adapts Pareto credit to the feasibility composition of each rollout group and guides fully infeasible groups toward safe references. The latter updates teacher trajectories across refinement rounds to continually transfer useful supervision. Together, they progressively translate the benefits of expanded supervision into policy improvement. On NAVSIM v1 and v2, our method achieves 91.4 PDMS and 89.1 EPDMS, respectively, under single-trajectory inference, and recovers 440 of 658 initially failed scenes, 11.1% higher than the original GRPO baseline.

[188] ATGS: Anchored Temporal Gaussian Splatting for Long Volumetric Video Representation cs.CVPDF

Jiahao Wu, Jie Liang, Die Hu, Jiayu Yang, Kaiqiang Xiong

TL;DR: 本文提出ATGS（锚定时序高斯泼溅）框架，用于长时序体视频表示，通过引入时序锚点来组织高斯基元，降低长距离复杂运动的建模难度，并采用时序窗口策略提升可扩展性和时序一致性。

Details

Motivation: 现有体视频方法在处理长序列和复杂运动时存在时序不稳定和视觉伪影问题，需要一种更稳定的表示方法来重建动态真实场景。

Result: 在具有复杂运动的长序列体视频上，ATGS一致优于先前方法，实现了更优的重建质量。

Insight: 创新点在于用时序锚点局部化高斯基元的时空支持以简化运动建模，并结合多级锚点特征编码全局与局部时空信息，增强生成稳定性；客观分析认为其锚点机制和窗口激活策略有效提升了长序列处理的鲁棒性。

Abstract: Volumetric video enables immersive free viewpoint rendering of dynamic real world scenes, yet existing methods struggle with long sequences and complex motions, often leading to temporal instability and visual artifacts. To address these challenges, we propose \ourname, a Gaussian splatting based framework for volumetric video reconstruction. Our key insight is that explicitly tracking long term complex motion with individual Gaussian primitives is inherently unstable. Instead, we organize Gaussians around time conditioned anchors that localize their spatial and temporal support, thereby reducing long range motion complexity. We further introduce a temporal windowing strategy to activate only anchors relevant to the queried time, which improves scalability and temporal coherence. In addition, to ensure spatial and temporal stability, we design a compact set of multi level anchor features that encode global features, local spatial features, and local temporal features, jointly constraining Gaussian generation. Extensive experiments demonstrate that \ourname \ consistently outperforms prior methods on long sequence volumetric videos with complex motions. Project page: https://github.com/WuJH2001/ATGS.

[189] NoisEasier: Test-Time Noise Optimization for Text-to-Video Generation cs.CVPDF

Yujiang Pu, Yu Kong

TL;DR: 本文提出了NoisEasier，一个无需修改基础模型的测试时缩放框架，通过可微分的奖励引导噪声优化来提升文本到视频（T2V）生成的组合对齐能力。该方法结合高效短步生成器和多目标奖励公式，在现实推理预算下实现稳定实用的测试时优化。

Details

Motivation: 现有扩散模型在文本到视频生成中，对细粒度组合对齐（如属性绑定、空间关系、物体交互）仍存在困难。基于奖励的微调方法容易受到奖励攻击，且对新提示分布适应能力差。

Result: 在VBench和T2V-CompBench基准测试中，该方法在多个骨干模型上均取得了一致的改进，在属性绑定、物体交互和计数能力等挑战性维度上平均提升超过10%。

Insight: 核心创新在于联合优化整个随机轨迹（而非仅初始隐变量），这能加速奖励收敛并提升组合对齐，且额外计算和时间成本可忽略。该框架可作为基于奖励微调的灵活替代或补充增强，确立了测试时缩放作为可控文本到视频生成的有效范式。

Abstract: Diffusion models have recently advanced text-to-video (T2V) generation, yet they still struggle with fine-grained compositional alignment, such as attribute binding, spatial relations, and object interactions. While reward-based fine-tuning improves alignment, it is susceptible to reward hacking and adapts poorly to new prompt distributions. In this work, we propose NoisEasier, a test-time scaling framework that improves T2V generation through differentiable reward-guided noise optimization without modifying the underlying model. By combining efficient short-step generators with a multi-objective reward formulation, NoisEasier enables stable and practical test-time optimization under realistic inference budgets. Our key insight is that jointly optimizing the entire stochastic trajectory accelerates reward convergence and improves compositional alignment over optimizing only the initial latent, with negligible additional computational and time cost. Experiments on VBench and T2V-CompBench demonstrate consistent improvements across multiple backbones, achieving over 10% average gains on challenging dimensions such as attribute binding, object interaction, and numeracy. Overall, NoisEasier serves as both a flexible alternative and a complementary enhancement to reward-based fine-tuning, establishing test-time scaling as an effective paradigm for controllable text-to-video generation.

[190] AI-enabled Low-Cost 3D Maize Ear Morphometry Platform at Breeding Scale cs.CVPDF

Therin Young, Elijah Rodriguez, Lisa Coffey, Talukder Zaki Jubery, Adarsh Krishnamurthy

TL;DR: 本文提出了一种低成本、高通量的3D玉米穗表型分析平台，利用消费级单反相机在转台上拍摄视频，通过NeRF重建玉米穗的3D网格，并自动进行几何质量控制和度量标定。该平台在300个玉米穗样本中成功处理了250个，其测量的穗长和体积与手动测量结果高度一致，硬件成本低且操作时间大幅减少。

Details

Motivation: 现有高通量表型分析流程成本高、劳动密集且依赖专业硬件，限制了玉米穗几何性状（如长度、宽度、曲率和体积）的大规模测量，而这些性状与产量和籽粒灌浆密切相关。

Result: 在300个玉米穗样本中，250个（83.3%）通过了自动处理和质量控制；穗长与手动卡尺测量高度一致（R^2 = 0.964，RMSE = 4.68 mm），凸包体积与排水法体积在15个穗子子集上高度一致（R^2 = 0.982，RMSE = 5.26 mL）。

Insight: 创新点包括：结合COLMAP与NeRF从单视频重建3D网格，利用已知直径的圆柱支架实现自动度量标定，并揭示了穗长测量误差源于曲率导致的测地弧长与弦长定义差异。该平台为育种规模3D表型分析提供了低成本、自动化的解决方案。

Abstract: Maize ear geometry (length, width, curvature, and volume) is closely tied to yield and grain-filling outcomes, but existing high-throughput phenotyping pipelines remain constrained by the cost, labor, and specialized hardware they require. We developed and validated a low-cost pipeline that reconstructs a watertight 3-D mesh of a maize ear from a single 20-second video captured with a consumer-grade DSLR on a motorized turntable under uniform LED illumination. Camera poses from a multi-seed COLMAP procedure initialize a Neural Radiance Field (NeRF), and a cylindrical holder of known diameter, visible in every frame, provides automatic metric scaling with downstream geometric quality control. Applied to 300 ears spanning a diverse maize inbred panel, 250 (83.3%) passed automated processing and quality control. Skeleton length agreed with manual caliper measurements across all 250 ears (R^2 = 0.964, RMSE = 4.68 mm), and convex-hull volume agreed with water-displacement volume on a 15-ear subset spanning the full size range (R^2 = 0.982, RMSE = 5.26 mL). Residual length error grew with ear curvature, whereas bounding-box height, which records the same straight-line chord as calipers, showed no such trend; the discrepancy therefore originates in the measurement definition, since calipers record the chord while skeleton length traces the geodesic arc. The capture hardware costs approximately 607 USD, and operator involvement fell from roughly five minutes to one minute per ear, with all downstream processing running unattended. The platform provides a foundation for breeding-scale 3-D ear phenotyping.

[191] DICS: Exploring Data Intrinsic Consistency for Visual Instruction Selection cs.CVPDF

Yuyang Hong, Jinhui Guo, Jiaqi Gu, Lubin Fan, Ruixiang Wang

TL;DR: 该论文提出了一种名为数据内在一致性（DIC）的自评分指标，用于量化视觉指令数据中样本层面的组件间一致性，并基于此开发了自适应数据选择方法DICS。该方法在固定数据预算下，优化了样本内高一致性与全局分布多样性之间的权衡，从而有效提升视觉语言模型的指令微调效果。

Details

Motivation: 现有视觉指令微调方法在从快速扩张的数据集中选择最优子集时，主要依赖分布多样性或启发式过滤，往往忽略了单个样本内部的连贯性，这成为了一个关键瓶颈。

Result: 大量实验表明，DICS在不同数据集规模和模型架构上均持续优于最先进方法，仅使用LLaVA-1.5-665K数据集的25%即可超越全数据集微调效果，并在构建的DICS-6M语料库上，使用不到官方InternVL3-8B-Instruct报告训练数据25%的情况下，达到了其94.52%的性能。

Insight: 创新点在于提出了一个从样本内部一致性（包括视觉信息一致性和响应信息一致性）角度评估数据质量的新指标DIC，并基于此设计了一种能自适应权衡样本内一致性与全局多样性的数据选择策略DICS，为高效数据筛选提供了新视角。

Abstract: Visual instruction tuning is crucial for advancing the vision-language alignment and instruction-following capabilities of Vision-Language Models (VLMs). However, identifying optimal subsets under a fixed ratio constraint from rapidly expanding datasets remains a significant bottleneck. While existing methods largely depend on distribution diversity or heuristic filtering, they often overlook the internal coherence within individual samples. To bridge this gap, we propose Data Intrinsic Consistency (DIC), a self-scoring metric designed to quantify the sample-level inter-component consistency. DIC consists of two modules: Visual Information Consistency (VIC), evaluating the alignment between visual content and instructions, and Response Information Consistency (RIC), assessing response coherence relative to the instruction. Building upon DIC, we introduce Data Intrinsic Consistency Selection (DICS), an adaptive data selection method that optimizes the trade-off between high intra-sample consistency and global distributional diversity under varying data budgets. Extensive experiments demonstrate that DICS consistently outperforms state-of-the-art methods across diverse dataset scales and model architectures, surpassing full-dataset fine-tuning while using only 25% of the LLaVA-1.5-665K data. We further curate DICS-6M, a 6M-sample multi-modal instruction corpus that enables the largest-scale visual instruction selection study to date; remarkably, DICS reaches 94.52% of the official InternVL3-8B-Instruct performance using less than 25% of its reported training data. Code can be seen at https://github.com/cqu-student/DICS

[192] Semantic-Spatial Discriminability Enhancement for Generalized Visual Grounding cs.CVPDF

Kaiyan Lei, Xu-Yao Zhang

TL;DR: 本文针对广义视觉定位任务，提出了一种新颖的语义-空间可区分性增强框架，旨在通过细粒度语义解耦和空间分布建模，提升模型在复杂多目标场景下区分相似目标的能力。

Details

Motivation: 解决现有广义视觉定位方法在复杂多目标场景中，因依赖全局语义匹配或粗粒度区域交互，而难以区分视觉相似目标、建立稳定实例级决策边界的问题。

Result: 在经典和广义视觉定位任务共十个数据集上的大量实验表明，SSDE框架取得了优越的性能。

Insight: 创新点在于分别设计了语义可区分性增强模块和空间可区分性增强模块，前者利用空间引导的交叉注意力解耦细粒度目标相关视觉属性，后者通过建模实例中心密度图来显式构建空间分离结构作为辅助监督信号，从而协同提升细粒度语义和空间定位的判别能力。

Abstract: Generalized Visual Grounding (GVG) task aims to localize targets in an image based on referring expressions, extends the classical visual grounding paradigm by integrating multi-target and non-target scenarios. Previous methods typically rely on global semantic matching or coarse-grained region interactions for localization, where the discriminative cues are primarily derived from sentence-level semantics or regional context. In complex multi-target scenarios, such approaches tend to confuse visually similar targets, making it difficult to establish stable instance-level decision boundaries. To address these limitations, this paper proposes a novel Semantic-Spatial Discriminability Enhancement (SSDE) framework for generalized visual grounding, which aims to enhance the discriminative ability on fine-grained semantics and spatial localization, improving both cross-modal understanding and instance-level grounding. Specifically, to enhance the semantic discriminability of query representations at the fine-grained level, we propose a Semantic Discriminability Enhancement (SeDE) module, which leverages spatially guided cross-attention to disentangle fine-grained target-relevant visual attributes and integrates them with the textual subject semantics. Furthermore, to strengthen the spatial discriminability of the referred targets, we introduce a Spatial Discriminability Enhancement (SpDE) module, which models an instance center density map to characterize the spatial distribution of targets, and explicitly constructs instance separation structures in the spatial domain by employing them as an auxiliary supervision signal. Extensive experiments show that SSDE achieves superior performance on ten datasets across both classic and generalized visual grounding tasks.

[193] OPUS: A Simple yet Effective Unified Framework for Open-Vocabulary Detection cs.CVPDF

Xiaoyan Wei, Zhimin Yao, Ruilin Yang, Wei Zhang, Yong Dai

TL;DR: 本文提出了OPUS，一个简单而有效的统一开放词汇检测框架，支持文本查询、视觉示例及其组合等多种提示方式。该框架采用语义丰富的视觉编码器和提示感知解码器，结合一阶段文本-视觉训练策略和基于SAM3的数据引擎，在多个基准测试中实现了最先进的性能。

Details

Motivation: 现有统一开放词汇检测方法通常依赖复杂的跨模态融合、分阶段训练和迭代标注流程，本文旨在探究在强大基础模型时代是否仍需如此复杂性，并尝试通过语义丰富的视觉表示和可扩展的接地监督来简化框架设计。

Result: 在COCO、LVIS-minival和ODinW35基准测试上，OPUS在Visual-I任务上达到了68.1/69.2/54.7 AP的SOTA性能，同时在文本和视觉-通用提示任务上保持了平衡的准确率，混合提示性能也优于单一提示。

Insight: 创新点在于证明了统一开放词汇检测可以通过简洁的三部分设计实现，无需复杂架构；其核心是利用语义丰富的视觉编码器、避免提示特定分支的解码器，以及一阶段对比对齐训练和高效数据引擎，将混合提示从干扰转化为互补优势。

Abstract: Recent unified open-vocabulary detection (OVD) supports heterogeneous prompts, including text queries, visual exemplars, and their combinations, but often rely on increasingly complex designs such as heavy cross-modal fusion, staged training, and iterative annotation pipelines. We revisit whether such complexity is necessary in the era of stronger foundation models. Our finding is that unified OVD can be made substantially simpler with semantic-rich visual representations and scalable grounding supervision. We present OPUS (\textbf{O}pen-vocabulary, \textbf{P}rompt-\textbf{U}nified, \textbf{S}imple), a unified detector supporting text, interactive visual, generic visual, and mixed prompting within one framework. OPUS adopts a simple three-part design. Its model architecture combines a semantic-rich visual encoder, built on a DINOv3-ConvNeXt-B backbone with efficient hybrid encoding, with a prompt-aware decoder that avoids prompt-specific branches for unified prompt reasoning. OPUS is trained with a one-stage text-visual training strategy with Instance-level Contrastive Alignment (ICA), and is supported by a SAM3-based single-pass data engine for heterogeneous grounding supervision. Experiments on COCO, LVIS-minival, and ODinW35 show that OPUS achieves state-of-the-art Visual-I performance, reaching 68.1/69.2/54.7 AP, while maintaining balanced Text and Visual-G accuracy. OPUS also turns mixed prompting from interference into complementarity, improving over text or visual prompt alone. These results show that simplicity and strong unified prompting capability can be achieved together.

[194] Motion-Saliency Complementary Masked Modeling for Point Cloud Video Understanding cs.CVPDF

Wei Wang, Yiding Sun, Yuyan Wang, Zhuoyue Zhang, Zhengqiao Li

TL;DR: 本文提出MoSaiC，一种用于自监督点云视频表征学习的新型运动-显著性互补掩码建模框架。该框架通过课程式运动-显著性掩码、李代数空间的正规流运动建模以及跨视图令牌一致性预测三个组件，有效捕捉点云视频的外观和运动动态。

Details

Motivation: 解决点云视频表征学习问题，旨在通过自监督方式更好地理解3D动态场景，捕获其外观和运动信息。

Result: 在动作识别、时序动作分割和点级语义分割等多个下游任务上进行了广泛实验，证明了方法的有效性。

Insight: 创新点在于将运动显著性指导的课程式掩码、李代数空间的显式几何运动建模与跨视图令牌一致性预测相结合，为点云视频的自监督学习提供了新的互补视角和几何监督信号。

Abstract: Point cloud video representation learning is crucial for 3D dynamic scene understanding. In this paper, we propose MoSaiC, a novel Motion-Saliency Complementary masked modeling framework for self-supervised point cloud video representation learning. MoSaiC couples three components: Curriculum Motion-Saliency Masking (CMSM), which guides the masking process toward motion-salient tokens under a curriculum schedule; Normal-Flow Motion (NFM) modeling, which supervises the local rigid rotation of each token in the Lie algebra so(3) as an explicit geometric motion target; and Cross-view Token Consistency Prediction (CTCP), which enforces consistency between two complementary masked views at the token level. Together, these components allow MoSaiC to effectively capture both appearance and motion dynamics. Extensive experiments on multiple downstream tasks, including action recognition, temporal action segmentation, and point-level semantic segmentation, demonstrate the effectiveness of our approach.

[195] Centering before Pruning: Lightweight Geometry Correction for Diversity-Based Visual Token Pruning in LVLMs cs.CV | cs.AIPDF

Shunjie Wen, Jaeyeon Lee, Dong-Wan Choi

TL;DR: 本文提出了一种名为Cen-Prune的轻量级几何校正方法，用于改进大型视觉语言模型（LVLM）中基于多样性的视觉令牌剪枝。该方法通过中心化令牌特征来更好地衡量子集多样性，同时保留原始空间中的令牌独特性偏好，从而在不改变底层选择机制的情况下，显著提升了现有多样性剪枝器的整体性能。

Details

Motivation: LVLM的推理成本高昂，部分原因是其视觉令牌序列长且高度冗余。现有的基于多样性的剪枝方法通过余弦相似度选择令牌子集，但原始令牌特征的相似度高度集中在正值范围，限制了其区分非冗余令牌的能力。

Result: 在多个图像和视频理解基准测试（如VQA、GQA、ScienceQA、MSVD-QA、MSRVTT-QA）以及不同LVLM架构（如BLIP-2、InstructBLIP、Video-LLaMA）上的广泛实验表明，Cen-Prune为现有基于多样性的剪枝器带来了鲁棒的性能提升。

Insight: 核心创新在于揭示了原始令牌几何中同时编码了子集多样性和令牌独特性，而中心化操作虽能更好地解析多样性，却丢失了独特性偏好。Cen-Prune通过结合中心化余弦相似度（衡量多样性）和原始空间独特性（作为令牌级偏好），以轻量级、即插即用的方式解耦并整合了这两个关键因素。

Abstract: Large vision-language models (LVLMs) incur substantial inference costs due to their long and highly redundant visual-token sequences. Diversity-based pruning mitigates this cost by selecting token subsets based on pairwise cosine similarity. We find, however, that similarities between raw visual tokens are strongly concentrated in the positive range, limiting their ability to distinguish non-redundant tokens. A natural way to improve this resolution is to center token features before computing cosine similarity. Centering indeed reveals a substantially richer pairwise structure, yet unexpectedly degrades pruning performance when used alone. We show that this apparent contradiction arises because the raw geometry does more than represent pairwise diversity: it also implicitly favors globally distinctive tokens, which tend to contain semantically informative content. Centering better resolves subset diversity but loses this useful token-wise preference, revealing that diversity and distinctiveness are entangled in the raw geometry. Based on this analysis, we propose the \textbf{Cen}tered Geometry \textbf{Prune}r (Cen-Prune), which measures subset diversity using centered cosine similarity while retaining raw-space distinctiveness as a complementary token-wise preference. This lightweight, plug-and-play correction leaves the underlying selection mechanism unchanged and incurs negligible computational overhead. Extensive experiments across multiple image- and video-understanding benchmarks and LVLM architectures demonstrate that Cen-Prune provides robust improvements in overall performance across existing diversity-based pruners.

[196] Dynamic Hub-and-Spoke Memory for Streaming Video Understanding cs.CVPDF

Xinru Jiang, Lin Zhao, Xi Xiao, Yunbei Zhang, Janet Wang

TL;DR: 本文提出了一种名为动态枢纽-辐条记忆（D-HSM）的无训练框架，用于流式视频理解。该框架将长距离历史视频片段转化为结构化文本记忆存储，同时保留近期帧作为视觉令牌以进行细粒度感知，从而在回答任意时刻的问题时，能动态检索并整合相关的记忆子集与近期视觉信息。

Details

Motivation: 解决流式视频理解中，如何在连续增长的视觉流上紧凑地记忆长程历史并有效检索与问题相关证据的核心挑战。

Result: 在流式视频和长视频基准测试上的大量实验表明，D-HSM持续且显著地改进了各种视觉语言模型（VLM）骨干网络，并超越了其他最先进的在线和离线视频理解基线方法。

Insight: 创新点在于提出了一种无训练的、基于实体中心的枢纽-辐条结构来组织长时记忆，将历史视频转化为类型化文本观察进行存储，并通过动态检索和链接扩展来高效利用记忆，同时结合近期视觉窗口进行答案预测，实现了记忆效率与检索准确性的平衡。

Abstract: Streaming video understanding requires answering questions at arbitrary times over a continuously growing visual stream. The central challenge is to compactly remember long-range history while effectively retrieving question-relevant evidence. We propose Dynamic Hub-and-Spoke Memory (D-HSM), a training-free framework that represents distant history as structured textual memory while preserving the recent frames as visual tokens for fine-grained perception. Specifically, D-HSM turns selected historical video chunks into typed textual observations and stores them in an entity-centered hub-and-spoke memory, with entities as hubs and related evidence as spokes. When answering a question, D-HSM dynamically retrieves a compact question-aware memory subset, expands it through hub-and-spoke links, and combines it with the recent visual window for frozen-VLM answer prediction. Extensive experiments on both streaming and long video benchmarks show that D-HSM consistently and substantially improves VLM backbones and outperforms other state-of-the-art online and offline video understanding baselines.

[197] Knowing Beyond the Known: Reinforced Knowledge Specification for Multi-Label Class-Incremental Learning cs.CVPDF

Aoting Zhang, Dongbao Yang, Chang Liu, Xiaopeng Hong, Can Ma

TL;DR: 本文提出KBK（Knowing Beyond the Known）框架，用于解决多标签类增量学习（MLCIL）中因共现和不完整标签导致的学习目标矛盾问题。该框架通过明确建模已知与未知知识，统一历史、当前和未来学习，包括层次特征纯化、不确定性感知召回增强、语义相关未知特征合成以及类别平衡梯度补偿损失等模块。

Details

Motivation: 现有类增量学习方法在多标签场景下表现不佳，主要原因是共现和不完整标签导致学习目标矛盾，模型难以区分已知与未知知识，从而影响历史知识保留、当前任务学习和未来概念适应。

Result: 在多个基准测试中验证了KBK的有效性和鲁棒性，在MS-COCO B0-C10设置下，即使不使用任何重放缓冲区，其平均准确率（Avg. Acc）比先前最佳方法提升了2.7%，达到了新的SOTA水平。

Insight: 创新点包括：通过层次特征纯化强化细粒度类特定特征表示，利用不确定性感知召回提升历史知识质量，基于语义相关合成未知特征以保留未来学习空间，以及设计类别平衡梯度补偿损失动态缓解异构遗忘。这些方法为多标签增量学习提供了可借鉴的知识明确建模思路。

Abstract: Existing class-incremental learning methods struggle in multi-label scenarios (MLCIL) due to the inherent contradiction of learning objectives arising from co-occurring and incomplete labels. We argue that the core obstacle is the model’s ambiguous boundary between known and unknown knowledge, which undermines historical knowledge retention, complicates current task learning, and limits adaptability to future concepts. To address this, we propose KBK (Knowing Beyond the Known), a reinforced knowledge specification framework that explicitly models what is known or not to unify historical, current, and prospective learning. Specifically, to clarify known knowledge, we develop a hierarchical feature purification module that disentangles fine-grained class-specific features from global features, where high-level semantic abstraction is reinforced with low-level visual features. Additionally, an uncertainty-aware recall enhancement strategy suppresses unreliable predictions based on distribution priors, improving the quality of historical recall. For probing the unknown, KBK leverages semantic correlations to synthesize informative unknown features under co-occurring, preserving embedding space for future learning. Furthermore, to mitigate heterogeneous forgetting, we design a category-balanced gradient compensation loss that dynamically reweights gradient backpropagation according to forgetting speeds. Experiments on multiple benchmarks validate the effectiveness and robustness of KBK, which surpasses prior best methods by 2.7% in Avg. Acc on MS-COCO B0-C10 setting even without any replay buffers.

[198] ScenePilot: Grow-and-Repair Policy for Text-Driven 3D Indoor Scene Generation cs.CV | cs.AIPDF

Jiawei Zhang, Hongsong Wang, Pan Zhou

TL;DR: 本文提出了ScenePilot，一种用于文本驱动3D室内场景生成的检索增强型“生长-修复”框架。该框架通过分层检索增强规划（HRAP）模块检索布局先验来指导功能组规划，并使用强化多模态修复（RMR）模块进行轻量级局部和全局修正，以生成物理合理、功能连贯且可控的3D场景。

Details

Motivation: 现有文本驱动3D场景生成方法存在局限：一次性生成器常产生几何无效布局，后处理优化成本高且不稳定，仅依赖提示的规划器缺乏可重用的功能分组和物体关系布局先验。

Result: 通过结合HRAP与RMR，ScenePilot在物理合理性、功能连贯性和可控性方面得到提升，同时保持了多样性，为一次性生成和繁重的全场景优化提供了高效替代方案。

Insight: 创新点在于将场景生成建模为先验引导的增量生长与学习式修正过程，并构建了SceneReverse-17k修复轨迹数据集来训练策略，预测结构化的移动-旋转-缩放动作，实现了轻量级、可迭代的生成与修复循环。

Abstract: Text-driven 3D indoor scene generation has advanced from dataset-bound layout modeling to open-vocabulary synthesis with large language and vision-language models. Yet existing methods remain limited: one-pass generators often yield geometrically invalid layouts, heavy post-hoc optimization is costly and unstable, and prompt-only planners lack reusable layout priors for functional grouping and object relations. We propose \textbf{ScenePilot}, a retrieval-augmented \textbf{Grow-and-Repair} framework that formulates scene generation as prior-guided incremental growth with learned rectification. Given a prompt, the Hierarchical Retrieval-Augmented Planning (HRAP) module retrieves room-, group-, and anchor-level layout priors to support functional group planning. A text-driven base generator then inserts object groups sequentially, while the Reinforcement Multimodal Repair (RMR) module performs lightweight local correction after each insertion and a final global repair after completion. To train this policy, we construct \textbf{SceneReverse-17k}, a repair-trajectory dataset built by perturbing high-quality 3D scenes in position, rotation, and scale, then using inverse operations as executable rectification targets. The policy predicts structured \emph{move–rotate–scale} actions from rendered views, scene state, retrieved priors, and edit history. By combining HRAP with RMR, ScenePilot offers an efficient alternative to one-shot generation and heavy full-scene optimization, improving physical plausibility, functional coherence, and controllability while preserving diversity.

[199] CapFrame: Text-Instructed Viewpoint Grounding in 3D Gaussian Scenes via Geometric Pseudo Labels cs.CVPDF

Jirong Li, Satoshi Ikehata, Shuhei Kurita, Ikuro Sato

TL;DR: 本文提出了一种名为CapFrame的新方法，用于解决文本指导的视点定位（TIVG）任务，即在3D高斯场景中根据文本指令自动确定一个6自由度相机位姿，使得渲染出的图像与文本描述对齐。该方法采用部分可微框架，通过检索-转换-优化的流程，将语言指令转化为几何伪标签以优化相机位姿。

Details

Motivation: 现有3D高斯场景中的语言引导方法主要集中于物体中心的地面定位，关注观察什么，但很少控制单个帧中应如何呈现（如主体方向或画面布局），导致虚拟相机放置仍依赖手动操作。

Result: 在包含38个真实世界场景和135条指令的数据集上，CapFrame在VLM指标、MLLM评判和用户研究中均优于启发式视点搜索和适应轨迹生成的基线方法，生成的视点与文本指令更匹配。

Insight: 创新点在于将文本指令分解为方向和布局伪标签，并利用3DGS的可微渲染进行相机位姿优化；客观来看，该方法通过结合大语言模型（MLLMs）的检索与评估以及几何约束的优化，实现了从语言到3D相机位姿的端到端学习。

Abstract: 3D Gaussian Splatting (3DGS) enables photorealistic real-time novel view synthesis, yet placing a virtual camera to capture a desired frame remains largely manual. Existing language-guided approaches in 3D scenes mainly focus on object-centric grounding, determining what to observe but rarely controlling how it should appear in a single frame, such as subject orientation or frame layout. To address this limitation, we introduce a new task, Text-Instructed Viewpoint Grounding (TIVG), which aims to identify a 6-DoF camera pose in a 3D Gaussian scene whose rendered frame aligns with a text instruction. To solve this task, we propose CapFrame, a partially differentiable framework that converts language into geometric pseudo labels for camera pose optimization. CapFrame follows a Retrieve-Translate-Refine pipeline: it retrieves relevant views and ranks them through a Question-Evaluation process with MLLMs, translates the instruction into orientation and layout pseudo labels, and refines the camera pose via differentiable optimization with layout and orientation losses in 3DGS. Experiments on 38 real-world scenes with 135 instructions indicate that CapFrame produces viewpoints better aligned with texts than heuristic viewpoint search and adapted trajectory generation baselines, validated by VLM metrics, MLLM judges, and user studies. Code is available at: https://github.com/jirongli/CapFrame

[200] Seeing the Unseen: Camouflaged Object Detection Beyond the Visible Spectrum cs.CVPDF

Avi Gupta, Trasha Gupta

TL;DR: 本文提出了一种名为MSFormer的端到端框架，用于多光谱伪装目标检测，通过利用多光谱图像捕获的细粒度光谱特征来增强在低可见度场景中的检测能力。

Details

Motivation: 现有伪装目标检测方法主要依赖三通道RGB图像，限制了视觉信息的获取范围，而多光谱图像能提供更丰富的光谱信息，有助于解决复杂低可见度任务。

Result: 在广泛的实验中，该方法表现出色，超越了现有方法，证明了其有效性。

Insight: 创新点在于首次将多光谱图像引入伪装目标检测，通过MSFormer框架整合多光谱波段，为低视觉任务提供了新的数据源和解决方案。

Abstract: Recent advances in camouflaged object detection (COD) have led to substantial progress in challenging low-visibility scenarios, with pioneering studies demonstrating notable success in localizing objects in camouflaged scenes. Despite these achievements, existing approaches predominantly rely on conventional three-channel RGB imagery, thereby constraining the available visual information to a limited spectral range. Multispectral images offer a wide range of information about a scene by capturing fine-grained spectral signatures. Hence, by leveraging multispectral images for COD, we introduce a novel approach to detect camouflaged objects from the corresponding multispectral inputs. In particular, we propose an end-to-end framework, \textbf{\textit{MSFormer}}, that takes a multispectral camouflaged image as input and predicts a binary mask for it. Additionally, we also provide empirical justification for integrating multispectral bands for this complex low-vision task. Our extensive experiments demonstrate the effectiveness of our method, which outperforms existing methods.

Zhiyu Ye, Hairong Zheng, Tong Zhang

TL;DR: 本文提出了MCSeg，一种基于三维视觉Transformer（ViT）的体素级网络，专为多模态心脏图像分割任务设计。该方法通过创新的缩放特征金字塔（SFP）有效桥接了单尺度ViT编码器与多尺度CNN解码器，并采用掩码图像建模进行自监督预训练，结合区域互信息（RMI）损失进行微调以提升边界分割精度。

Details

Motivation: 自动心脏图像分割对心脏疾病的诊断和治疗至关重要，但现有混合网络存在架构不匹配问题，导致全局上下文信息利用不足。

Result: 在CT数据集ImageCHD、多模态数据集MM-WHS、MRI数据集HVSMR-2.0和MSD Heart上，MCSeg持续超越11种SOTA方法，并在少样本实验中展现出卓越的适应能力。

Insight: 创新点在于提出缩放特征金字塔（SFP）解决ViT编码器与CNN解码器的尺度不匹配问题，同时结合自监督预训练和区域互信息损失微调策略，显著提升了多模态心脏分割的精度和鲁棒性。

Abstract: Automatic cardiac image segmentation is pivotal for diagnosing and treating cardiac diseases. In this work, we introduce MCSeg, a volumetric transformer-based network tailored for multi-modal cardiac segmentation. To overcome the architectural mismatch inherent in existing hybrid networks, we propose a novel Scaling Feature Pyramid (SFP). Unlike conventional skip connections, the SFP effectively bridges the single-scale 3D Vision Transformer (ViT) encoder and the multi-scale CNN decoder by transforming the ViT’s output into a hierarchical feature pyramid, ensuring that global contextual information is effectively leveraged. For the training paradigm, the ViT encoder first undergoes self-supervised pre-training via masked image modeling. Subsequently, the network is fine-tuned on downstream tasks, during which a regional mutual information (RMI) loss is integrated to improve boundary segmentation accuracy. In experiments, MCSeg consistently outperforms eleven SOTA methods on CT dataset ImageCHD, multi-modal dataset MM-WHS, MRI dataset HVSMR-2.0 and MSD Heart, highlighting the effectiveness of our MCSeg for multi-modal cardiac segmentation tasks. Furthermore, MCSeg’s superior performance in few-shot experiment showcases its significant potential in adapting to limited data scenarios. Codes and pre-trained ViT-B weights are open-sourced at https://openi.pcl.ac.cn/OpenMedIA/MCSeg

[202] PRISM: Predictive Recomposition via Semantic Latent Decomposition for View-invariant Video Representation Learning cs.CV | cs.AIPDF

Youngchae Chee, Hosu Lee, Sungjune Park, Junho Kim, Yong Man Ro

TL;DR: 该论文提出了一种名为PRISM的新方法，用于跨视角视频表征学习，旨在从第一人称和第三人称视频中学习视角不变的动作语义。其核心思想是通过语义潜在分解将视频分解为视角不变和视角可变的潜在特征，然后在语言监督下进行预测性重组，以确保两种特征的独立语义得到干净分离。

Details

Motivation: 现有方法将视频编码为统一的嵌入表示，导致视角不变和视角可变的语义在共现情况下不可避免地纠缠在一起，即使是为视角不变性显式训练的跨视角方法也存在此问题。

Result: PRISM在EgoExo4D、EgoExoLearn和AE2等基准测试中取得了最先进（SOTA）的结果，甚至在零样本设置下超越了领域内模型。

Insight: 论文的核心创新在于提出了一个关键见解：当视角不变特征能够与任意视角可变特征充分重组，同时保持其独立语义时，才实现了真正的解耦。基于此，PRISM通过分解和语言监督下的重组，实现了两种语义流的干净分离，这是一种新颖的视角不变表征学习框架。

Abstract: Cross-view video representation learning aims to capture viewpoint-invariant action semantics despite substantial appearance changes across egocentric and exocentric videos. However, existing methods encode each video as a unified embedding, where view-invariant and view-variant semantics inevitably entangle under co-occurrences - a failure mode we show persists even in cross-view methods explicitly trained for view-invariance. Our key insight is that a view-invariant feature is truly disentangled when it can be sufficiently recomposed with an arbitrary view-variant feature while preserving their independent semantics. Building on this, we propose PRISM, that decomposes video into view-invariant and view-variant latents and recompose them under language supervision encouraging clean decomposition of the two streams. PRISM achieves state-of-the-art results on EgoExo4D, EgoExoLearn, AE2, even surpassing in-domain models under zero-shot setting. Code is available at https://github.com/litcoderr/prism.

[203] Real-Time Scene-Adaptive Tone Mapping for High-Dynamic Range Object Detection cs.CVPDF

Gongzhe Li, Linwei Qiu, Peibei Cao, Fengying Xie, Xiangyang Ji

TL;DR: 本文提出了一种新颖的色调映射方法，用于解决高动态范围（HDR）图像在嵌入式系统目标检测任务中的性能下降问题。该方法通过神经光度校准和尺度不变的局部色调映射模型，替代传统图像信号处理（ISP）流程，实现了从HDR RAW输入到检测网络所需的LDR sRGB输出的端到端优化，并在NVIDIA Jetson平台上实现了4K高比特深度HDR输入的实时处理。

Details

Motivation: 动机在于解决大多数为嵌入式系统设计的神经网络在低动态范围（LDR）图像上训练，而处理高比特深度HDR图像时，因极端动态范围导致的性能显著下降问题，特别是在自动驾驶等计算机视觉系统中。

Result: 在具有挑战性的汽车HDR场景中，该方法在目标检测任务上优于传统的色调映射算法和先进的AI-ISP方法，并支持从LDR sRGB图像到HDR RAW图像的高效性能迁移微调。

Insight: 创新点在于提出了神经光度校准和尺度不变的局部色调映射模型，以端到端方式桥接HDR RAW输入与下游检测任务，实现了与下游任务的联合优化，并支持高效的性能迁移微调，为HDR图像处理提供了新的实时优化方案。

Abstract: High-dynamic-range (HDR) images, with their rich tone and detail reproduction, hold significant potential to enhance computer vision systems, particularly in autonomous driving. However, most neural networks for embedded systems are trained on low-dynamic-range (LDR) inputs and suffer substantial performance degradation when handling high-bit-depth HDR images due to the challenges posed by extreme dynamic ranges. In this paper, we propose a novel tone mapping method that not only bridges the gap between HDR RAW inputs and the LDR sRGB requirements of detection networks but also achieves end-to-end optimization with downstream tasks. Instead of relying on the traditional image signal processing (ISP) pipeline, we introduce neural photometric calibration to regularize dynamic ranges and a scaling-invariant local tone mapping model to preserve image details. In addition, our architecture also supports performance transfer finetuning, enabling efficient adaptation from the LDR sRGB images to the HDR RAW images with minimal cost. The proposed method outperforms traditional tone mapping algorithms and advanced AI-ISP methods in challenging automotive HDR scenes. Moreover, our pipeline achieves real-time processing of 4K high-bit-depth HDR inputs on NVIDIA Jetson platforms.

[204] SePArate: Segmenting Patterns from Defects in Wafer Manufacturing Using Weak Supervision cs.CV | cs.AIPDF

Dain Kwon, Changmin Shin, Sunjong Park, Kanghyun Choi, Hyeyoon Lee

TL;DR: 本文提出了一种名为SePArate的弱监督晶圆缺陷分割方法，该方法仅利用图像级标注即可实现像素级的图案与缺陷分离，旨在解决半导体制造中缺陷分析的自动化难题。

Details

Motivation: 半导体制造中的缺陷分析至关重要，但人工检测难以扩展，而现有的自动化检测方法在根本原因分析和工艺优化方面仍显不足。

Result: 实验表明，SePArate在晶圆缺陷分割任务上优于基线方法，但摘要未具体说明在何种基准测试或达到何种水平（如SOTA）。

Insight: 创新点在于提出了一种仅需图像级弱监督的三阶段训练框架（编码器预训练、空间线索知识迁移、合成混合缺陷数据训练），以实现精确的像素级分割，这为数据标注成本高的工业视觉任务提供了新思路。

Abstract: In semiconductor manufacturing, defect analysis is essential, but manual inspection cannot scale. However, existing automated inspection methods remain insufficient for root-cause analysis and process optimization. To this end, we present SePArate, a weakly supervised wafer defect segmentation method. SePArate enables pixel-level separation of patterns by leveraging only image-level annotations. It consists of a three-phase training: encoder pretraining, knowledge transfer to learn spatial cues, and training on synthetic mixed-defect data for accurate segmentation. Experiments demonstrate that SePArate outperforms the baselines.

[205] FlowVVTON: Flow-Guided Mask-Free Video Virtual Try-On cs.CVPDF

Shengyao Chen, Xianbing Sun, Liqing Zhang, Jianfu Zhang

TL;DR: FlowVVTON是一种无需掩码的视频虚拟试穿框架，通过光流作为训练监督信号实现多尺度时序一致性，在TikTokDress数据集上显著优于基线方法。

Details

Motivation: 现有方法依赖人体解析掩码或姿态关键点，在大运动和遮挡下易失效，导致边界伪影和时序不一致，且缺乏显式运动监督。

Result: 在TikTokDress数据集上，FlowVVTON在时序一致性方面大幅超越基线（VFID-R指标比SwiftTry提升5.7倍），且无需任何分割掩码、姿态关键点或区域标注。

Insight: 创新点包括完全消除掩码依赖，使用光流作为纯训练监督信号，通过跨层流扭曲潜在损失实现多尺度时序对齐，并采用两阶段训练策略分离空间对齐与时序监督。

Abstract: Video virtual try-on aims to transfer a target garment onto a moving person across video frames. Current methods rely on human parsing masks or pose keypoints that frequently fail under large motions and occlusions, causing boundary artifacts and temporal inconsistency. A further limitation is that most approaches rely solely on attention mechanisms for temporal modeling, providing no explicit motion supervision. We propose FlowVVTON, a mask-free framework that eliminates parsing mask dependency entirely. Optical flow is used solely as a training-time supervision signal: a flow-warped latent loss, applied across all layers of the generation model, enforces multi-scale temporal consistency by aligning adjacent-frame features under explicit physical motion constraints. A two-stage training strategy establishes mask-free spatial alignment before introducing flow-guided temporal supervision. Experiments on TikTokDress show that FlowVVTON outperforms baselines by substantial margins, particularly in temporal consistency (5.7$\times$ VFID-R improvement over SwiftTry), while requiring no segmentation masks, pose keypoints, or region annotations at any stage.

[206] SeqAlign3DVG: A Sequence-Aligned Benchmark and Voxel Reasoning Framework for 3D Visual Grounding cs.CVPDF

Yi Zhang, Yi Wang, Yueting Wu, Kaiyue Yang, Yuejiao Su

TL;DR: 本文提出了SeqAlign3DVG，一个专注于时序对齐和严格观测对齐的图像式3D视觉定位新基准，包含大量单视图和序列样本。同时，作者提出了一个统一的基于体素的推理框架，包含ROVM和PLVF模块，以处理该基准并实现最先进的性能。

Details

Motivation: 现有3D视觉定位基准存在文本-观测对齐松散和忽略时序顺序的问题，限制了具身智能体的应用。本文旨在解决这些问题，构建一个更严格、时序敏感的基准。

Result: 在无深度协议下，所提方法达到了最先进的性能，在由复杂关系和外观线索定义的目标定位任务上取得了显著提升。

Insight: 创新点在于构建了首个强调时序对齐和严格观测对齐的3D视觉定位基准，并提出了一个结合了动态证据排序（ROVM）和渐进式语言-体素融合（PLVF）的体素推理框架，以处理多视角噪声和实现细粒度空间-语言推理。

Abstract: Image-based 3D visual grounding is critical for embodied agents, yet existing benchmarks suffer from loose text-observation alignment and neglect temporal ordering. We introduce SeqAlign3DVG, a novel benchmark dedicated to temporally ordered and strictly observation-aligned image-based 3D visual grounding. Unlike prior works using order-agnostic views or global point clouds, SeqAlign3DVG ensures all expressions are human-verified and strictly grounded in the provided RGB observations (single frames or ordered observation sequences). It comprises 9,622 single-view and 14,493 sequence samples featuring rich descriptions, complex relations, and multi-instance ambiguities. To tackle this benchmark, we propose a unified voxel-based pipeline featuring Relevance-Ordered Voxel Memory (ROVM) and Progressive Language-Voxel Fusion (PLVF). ROVM dynamically ranks and aggregates multi-view evidence via a conservative memory to mitigate noisy observations, while PLVF performs coarse-to-fine spatial-linguistic reasoning for precise disambiguation. Our approach achieves state-of-the-art performance under the depth-free protocol, significantly improving localization for targets defined by complex relations and appearance cues.

[207] Whole-Slide Image Analysis under Realistic Few-Shot Annotation Protocols cs.CV | cs.AIPDF

Tiffanie Godelaine, Maxime Zanella, Karim El Khoury, Benoit Macq, Christophe De Vleeschouwer

TL;DR: 本文提出SlideCRF方法，将条件随机场适应于全切片图像分析，结合空间和生物学线索处理类别缺失问题，并设计了一套基于空间局部点击和涂鸦的真实少样本标注协议。在四个数据集上的实验表明，该方法在宏观F1分数上优于现有转导方法，显著提升了零样本预测性能。

Details

Motivation: 现有转导方法在全切片图像分析中的评估条件忽略了关键特性：忽略组织复杂结构、假设类别平衡而实际存在严重类别不平衡、标注采样方式不符合病理学家实际标注习惯。需要将转导范式与真实全切片场景对齐。

Result: 在四个数据集上，SlideCRF在宏观F1分数上优于当前转导方法，相比零样本预测，在每个存在类别使用1次点击和16次点击时分别提升24.2%和37.5%，达到SOTA水平。

Insight: 创新点包括：1) 提出适应全切片图像的SlideCRF模型，结合空间与生物学线索并处理类别缺失；2) 设计真实标注协议模拟病理学家交互（如迭代修正模型错误）；3) 首次系统考虑全切片图像的实际特性（组织结构、类别不平衡、标注模式）来评估少样本方法。

Abstract: Automating the analysis of whole-slide images has high clinical value, since characterizing cancers requires examining them in detail. Such analysis increasingly relies on vision-language models that provide patch-level zero-shot predictions. However, these predictions remain noisy and must be refined with a few annotations. A promising paradigm for this refinement is few-shot transduction. Rather than treating each patch independently, these methods leverage the relations between patches, together with a few annotations, to refine all predictions jointly. However, current transductive methods are evaluated under conditions that overlook key properties of whole-slide images: (i) datasets consist of independent patches extracted from multiple slides, ignoring the complex tissue organization; (ii) datasets are mostly balanced, whereas a single whole-slide image exhibits severe class imbalance, with several classes absent; and (iii) annotations are sampled at random, without reflecting how a pathologist annotates a limited number of regions. To align the transduction paradigm to realistic whole-slide settings, we introduce the following contributions. First, we propose SlideCRF, which adapts conditional random fields for whole-slide images by combining spatial and biological cues while accounting for classes that may be absent from a given slide. Second, we provide a set of realistic annotation protocols, based on spatially localized clicks and scribbles, modeling different pathologist interactions, such as the iterative correction of model errors. Across four datasets, we show that SlideCRF outperforms current transductive methods in macro F1, improving over the zero-shot predictions by +24.2% and +37.5% with one and 16 clicks per present class, respectively.

[208] VisER: Visual Evidence and Reliance for Object Hallucination Detection in LVLMs cs.CV | cs.LGPDF

Afsaneh Hasanebrahimi, Hanxun Huang, Christopher Leckie, Sarah Erfani

TL;DR: 本文提出VisER，一种无需训练的双视角度量方法，用于检测大型视觉语言模型中的物体幻觉问题。该方法通过评估视觉证据和视觉依赖两个互补视角，更准确地识别生成物体描述是否基于图像特定证据而非文本前缀。

Details

Motivation: 现有免训练检测器依赖内部信号（如词元似然、注意力）识别幻觉物体，但这些信号常混淆来源，无法区分支持是来自物体特定的视觉证据还是生成的文本前缀，导致在困难场景中幻觉物体仍可能获得高内部支持。

Result: 在多个大型视觉语言模型和基准测试中，VisER在AUROC和AUPR指标上优于一系列基线方法，提升了物体幻觉检测的性能。

Insight: 创新点在于提出双视角度量，将物体级幻觉检测分解为视觉证据（评估物体-上下文兼容性是否基于图像令牌的物体特定证据）和视觉依赖（评估物体是否更多由图像而非文本前缀支持），从而提供更源感知的接地分数，同时避免额外的物体级验证生成。

Abstract: Object hallucination remains a persistent reliability issue in large vision-language models, where generated object mentions may sound plausible but lack visual grounding. Recent training-free detectors use internal signals such as token likelihood, attention, visual confidence, or image-text similarity to identify hallucinated objects. These signals are useful, but they are often source-confounded. They measure how strongly an object is supported inside the model without distinguishing whether that support comes from object-specific visual evidence or the generated text prefix. In difficult cases, a hallucinated object can still receive high internal support because it fits the scene, is associated with nearby visual cues, or follows naturally from the generated text prefix. We propose VisER, a training-free two-sided metric for object-level hallucination detection. VisER evaluates each generated object mention from two complementary views. Visual Evidence measures whether object-context compatibility is backed by object-specific evidence from image tokens. Visual Reliance measures whether the object is supported more by the image than by the generated prefix. Combining these views gives a more source-aware grounding score, while avoiding additional object-level verification generations. Across multiple LVLMs and benchmarks, VisER improves AUROC and AUPR over a range of baselines.

[209] Lot Machine: Multimodal Lot Extraction from Auction Catalogs cs.CV | cs.AI | cs.CL | cs.DLPDF

Mathias Zinnen, Alisha Mund, Sabine Lang, Lukas Hüttner, Thomas Gorges

TL;DR: 本文提出了一种从历史拍卖目录中自动提取结构化拍品元数据的流程，利用视觉语言模型（VLMs）在不同提示策略和约束解码框架下进行评估，旨在解决大规模分析拍卖目录时缺乏机器可读表示的难题。

Details

Motivation: 历史拍卖目录是溯源研究和艺术市场分析的重要资源，但其内部格式多变且缺乏机器可读表示，限制了大规模自动化分析。

Result: 在德国拍卖目录数据库的手动标注测试集上评估，商业端点模型达到性能上限，机构网关提供可行的隐私保护替代方案，本地部署需强制输出结构以保证有效JSON格式。

Insight: 创新点在于构建了基于VLM的自动化提取流程，并系统评估了不同部署模式（商业、机构、本地）在预算、计算资源和数据隐私约束下的可行性，为文化遗产机构的大规模分析提供了实用方案。

Abstract: For provenance research and art market studies, auction catalogs are an essential resource to trace specific objects over time and space. While historical auction catalogs follow established domain conventions, their internal formatting remains highly variable, and their large-scale analysis is currently restricted by the lack of machine-readable representations of the auction lots. We propose a pipeline to automatically extract structured lot-level metadata from German Sales, a large database of historical auction and sales catalogs from the 19th and 20th centuries. Using a manually annotated test set of representative catalog pages, we evaluate Vision-Language Models (VLMs) under varying prompt strategies and constrained decoding frameworks. To reflect the practical constraints faced by cultural heritage institutions, including budget, compute resources, and data privacy requirements, we benchmark the methods across different deployment modes ranging from commercial providers to locally hosted, quantized models. We find that commercial endpoints establish the performance ceiling, while institutional gateways offer a viable, privacy-preserving alternative. Local deployments remain feasible, but strictly require enforcing the output structure during generation to guarantee a valid JSON format. While varying degrees of human-in-the-loop correction are still necessary, this work demonstrates that a VLM-based pipeline can successfully unlock historical auction catalogs for large-scale automated analysis.

[210] Modality Disentangled Learning for Incomplete Multimodal Emotion Recognition: A Primitive Memory Distillation Perspective cs.CVPDF

Jiaqi Zhang, Zheng Pang, Mengting Li, Yiqi Wang, Guangyuan Dong

TL;DR: 本文提出了一种名为Primitive Memory Distillation (PriMD)的新框架，用于解决多模态情感识别中模态缺失的问题。该方法通过解耦模态间的共享语义和模态特有的表示，并将后者离散化为可学习的语义基元来构建记忆库，从而在模态缺失时动态检索信息以补偿缺失的细节。

Details

Motivation: 现有方法在处理缺失模态时通常将模态作为一个整体进行生成、对齐或蒸馏，忽略了模态内部信息的异质性，导致混合了可推断的共享语义和不确定的模态特有细节，从而产生不稳定的表示并降低鲁棒性。

Result: 在IEMOCAP、CMU-MOSI和CMU-MOSEI基准测试上的大量实验表明，PriMD在广泛的模态缺失设置下实现了最先进的性能，并展现出持续更强的鲁棒性，同时缓解了整体特征推断带来的不稳定性。

Insight: 创新点在于从模态内视角出发，关注模态内不同类型信息的可恢复性差异，通过解耦共享语义与模态特有表示，并利用离散化的语义基元构建记忆库进行动态检索，这为处理不完整多模态学习提供了新的思路，可借鉴于其他需要处理模态缺失或异质信息融合的任务。

Abstract: Multimodal Emotion Recognition (MER) systems often suffer from missing modalities in real-world scenarios. Existing methods usually generate, align, or distill missing modalities as a whole, overlooking the heterogeneous nature of the information carried by each modality. Such holistic treatment mixes inferable shared semantics with uncertain modality-specific details, yielding unstable representations and degrading robustness. To address this issue, we propose the Primitive Memory Distillation (PriMD) framework. Unlike existing methods, PriMD takes an intra-modal perspective and focuses on how different types of information within a modality differ in recoverability within each modality. PriMD first disentangles cross-modal shared semantics from modality-specific representations, and then discretizes the latter into learnable semantic primitives to construct modality-specific memory banks. When modalities are missing, PriMD is a teacher-student framework that the student model uses the shared semantics of available modalities as queries to dynamically retrieve primitives. It compensates for missing modality-specific information within a constrained memory space and aligns with the teacher model. Extensive experiments on IEMOCAP, CMU-MOSI, and CMU-MOSEI demonstrate that PriMD achieves state-of-the-art performance and consistently stronger robustness across a wide range of missing-modality settings, while mitigating the instability caused by holistic feature inference. Our code and project website are available at https://github.com/JiaqiZhang-Sengoku/PriMD and https://jiaqizhang-sengoku.github.io/PriMD/, respectively.

[211] MEOM: Multi-View Expected-OKS Maximization for Human Pose Triangulation cs.CVPDF

Ziliang Xiong, Henglin Shi, Per-Erik Forssen

TL;DR: 本文提出了一种名为MEOM（多视角期望OKS最大化）的新方法，用于从多视角2D关键点热图进行3D人体姿态估计。该方法通过最大化跨视角的概率质量一致性来定位3D关节点，并采用最高密度区域校准来评估热图可靠性，无需依赖基于距离的度量。该方法在有无3D监督的两种设置下均有效，在Human3.6M和CMU Panoptic数据集上取得了优异的性能。

Details

Motivation: 解决传统代数三角化方法在从预测热图解码2D关键点时不可靠的问题，因为遮挡下热图可能是多模态的，将其坍缩为单峰会丢弃其空间分布信息。目标是利用整个热图来更准确地估计3D姿态，这需要解决两个问题：如何鲁棒地跨视角融合热图，以及如何评估热图的可靠性。

Result: 在无3D监督设置下，通过最大化MEOM优化预训练热图预测器得到的3D姿态，性能与依赖更大骨干网络、时序融合和模拟3D数据的SOTA方法相当；在模糊的Human3.6M（H36MA）和遮挡的CMU Panoptic帧上优势显著。在有3D标签可用时，结合MEOM和MSE损失进行端到端训练，在Human3.6M上实现了19.11 mm的绝对MPJPE，优于SOTA体积方法，且推理成本减半。

Insight: 核心创新点是提出了MEOM目标函数，它通过寻找一个使所有视角的概率质量达成一致的3D点来融合多视角热图信息，而不是将热图坍缩为单峰。另一个关键点是引入了最高密度区域校准作为热图可靠性的诊断工具，这是一种独立于距离度量的评估方式。该方法提供了一种更充分利用热图空间分布信息的三角化框架。

Abstract: Conventional algebraic triangulation solves 3D human pose estimation (HPE) from multi-view 2D keypoints. The typical approach, decoding 2D keypoints from predicted heatmaps, is unreliable as heatmaps can be multimodal under occlusion, and collapsing them into single peaks discards their spatial distribution. We seek to use the entire heatmap to estimate 3D poses more accurately, which requires solving two problems: how to robustly fuse heatmaps across views, and how to assess the reliability of heatmaps. For the former, we introduce a novel objective, Multi-viewExpected-OKS Maximization (MEOM), that locates a 3D joint where the views agree in probability mass. For the latter, we adopt highest-density-region (HDR) calibration as a diagnostic of that mass, independently of distance-based metrics. The proposed framework covers two settings, with and without 3D supervision. Without 3D supervision, we optimize 3D poses from pretrained heatmap predictors by maximizing MEOM, achieving comparable performance with state-of-the-art methods that rely on larger backbones, temporal fusion, and simulated 3D data. On ambiguous Human3.6M (H36MA) and occluded CMU Panoptic frames, the advantage is substantial. When 3D labels are available, we train the model end-to-end with a combined MEOM and MSE loss, achieving 19.11 mm absolute MPJPE on Human3.6M outperforming the state-of-the-art volumetric approach on absolute MPJPE at half the inference cost.

[212] Learning Compositional Spatio-Temporal Video Grounding with Synthetic Curriculum cs.CVPDF

Xingjian Wang, Shijian Wang, Yibo Wang, Zihao Yu, Runhao Fu

TL;DR: 该论文提出了组合时空视频定位任务（CompSTVG），以解决现有模型在处理现实世界中复杂的组合查询时的不足。作者构建了一个合成数据引擎，用于生成难度分级的评估和训练数据，并在此基础上建立了STVG-CompBench基准。通过评估11个代表性模型，发现它们在组合查询上表现不佳，并进一步提出了课程强化学习框架CurrSTVG，在最具挑战性的查询上取得了显著提升。

Details

Motivation: 现有MLLM在时空视频定位上的评估和训练数据主要关注简单查询，忽视了现实场景中普遍存在的、需要通过联合推理目标属性和与其他实体的关系来进行消歧的组合查询，因此需要填补这一空白。

Result: 在提出的STVG-CompBench基准上评估了11个代表性STVG模型，发现它们在组合查询上表现不佳，性能急剧下降。提出的CurrSTVG框架带来了持续的提升，在最具挑战性的组合查询上观察到了最大的改进。

Insight: 创新点在于定义了组合时空视频定位任务，并利用时空场景图作为难度度量，将难度控制的查询合成构建为约束规划问题，从而生成难度分级的合成数据。此外，提出的课程强化学习框架能有效提升模型处理复杂查询的能力。

Abstract: Despite the impressive progress of recent MLLMs on spatio-temporal video grounding (STVG), existing evaluations and training data focus primarily on simple queries. They largely overlook the compositional queries prevalent in real-world scenarios, where a target must be disambiguated by jointly reasoning about its attributes and relations to other entities. To bridge this gap, we propose Compositional Spatio-Temporal Video Grounding (CompSTVG), a task that requires models to process complex textual queries where every intertwined attribute and relational cue is essential for disambiguation. To facilitate this task at scale, we build a synthetic data engine that leverages a spatio-temporal scene graph as a difficulty measure and casts difficulty-controlled query synthesis as a constraint programming problem, producing difficulty-graded data for both evaluation and training. Built on this engine, we introduce STVG-CompBench, a benchmark stratified by explicit difficulty levels that jointly capture temporal complexity and spatial interference. Evaluating 11 representative STVG models on STVG-CompBench reveals that current models perform poorly on compositional queries, exhibiting a sharp performance drop that is typically obscured by overall dataset-level averages. We further construct synthetic training data and propose CurrSTVG, a curriculum reinforcement learning framework that delivers consistent gains, with the largest improvements observed on the most challenging compositional queries.

[213] DiffSAC: Diffusion-guided Sampling for Consensus-based Robust Estimation cs.CV | cs.AIPDF

Chang Nie, Guangming Wang, Zhe Liu, Hesheng Wang

TL;DR: 本文提出了一种名为DiffSAC的新框架，用于改进基于采样共识的鲁棒估计任务。该框架利用扩散模型学习有效最小集（minimum sets）的分布，通过精炼每个数据点的置信度来指导采样，从而大幅减少需要评估的假设数量。

Details

Motivation: 传统基于采样共识的鲁棒估计方法存在采样效率低下的问题，因为它们难以在假设评估前识别出有效的最小集。本文旨在解决这一挑战，提高采样和估计的效率。

Result: 在五个经典计算机视觉任务上的大量实验表明，DiffSAC达到了最先进的性能。与先前需要评估上万个假设的工作相比，DiffSAC仅需评估几十个假设即可实现，显著提升了效率，并能实现实时运行。

Insight: 主要创新点在于引入扩散模型来学习有效最小集的分布，并精炼数据点置信度（而非简单排序）来指导采样。此外，将几何特征作为条件融入扩散模型以约束精炼方向，使得DiffSAC能作为一个即插即用模块来提升现有采样共识方法。

Abstract: Robust estimation is a core computer vision task frequently tackled using sample consensus. However, traditional methods suffer from inefficient sampling as they struggle to identify effective minimum sets before hypothesis evaluation. To address these challenges, we propose a novel Diffusion-guided Sampling for Consensus-based Robust Estimation (DiffSAC) framework. DiffSAC introduces a diffusion model to learn the distribution of effective minimum sets. It refines the confidence for each data point, indicating whether it belongs to a good minimum set, rather than ranking the data points as in previous work. This significantly reduces the need to process numerous bad sets. To constrain the refinement direction, geometric features are incorporated as conditions within our diffusion model. Consequently, DiffSAC outputs a small number of high-quality minimum sets, enabling identification of the best hypothesis via consensus evaluation. Notably, compared to previous works requiring evaluating over ten thousand hypotheses, DiffSAC achieves state-of-the-art performance with only dozens, significantly boosting efficiency. Extensive experiments across five classic computer vision tasks demonstrate the superiority of DiffSAC. The diffusion model’s sampling accelerators enable real-time operation, and DiffSAC can be used as a plug-and-play module to improve existing sample consensus methods.

[214] Quantum-Grassmann-Plucker Token Mixing for Deep Learning-Based Post-Disaster Damage Assessment cs.CV | cs.LGPDF

Kooroush Farahkhah, Umut Lagap, Taha Rezaei, Saman Ghaffarian

TL;DR: 本研究首次将Grassmann-Plucker（GP）令牌混合应用于计算机视觉，并提出了两种扩展：量子启发的Grassmann-Plucker（QGP）头和混合量子机器学习Grassmann-Plucker（HQML-GP）头，用于从卫星图像进行灾后建筑损伤评估。该方法通过编码令牌对形成的子空间来表示图像块令牌间的多尺度关系，在xBD龙卷风数据集上评估，QGP在可见和未见事件测试中均取得了最佳准确率和宏F1分数。

Details

Motivation: 解决灾后卫星图像损伤评估中存在的类别不平衡、中间损伤状态模糊以及跨事件可迁移性有限的问题，探索无需注意力的令牌混合方法作为传统基于Transformer的替代方案。

Result: 在xBD龙卷风数据集上，QGP在可见事件（Joplin和Moore）测试中达到83.46%准确率和64.50%宏F1，在未见事件（Tuscaloosa）测试中达到66.45%准确率和52.70%宏F1，均优于多层感知机和Transformer基线；HQML-GP获得了最高的验证宏F1（65.63%），但未在测试集上超越QGP且训练时间更长。

Insight: 创新点包括首次将GP几何表示引入视觉令牌混合，并扩展了量子启发的概率特征和模拟量子电路期望值；客观分析表明，GP方法提供了一种具有竞争力的、无需注意力的令牌混合机制，QGP在平衡性能和效率方面表现突出，为损伤分类任务提供了新思路。

Abstract: Timely post-disaster building damage assessment from satellite imagery is a critical engineering decision support task, yet it remains constrained by class imbalance, ambiguous intermediate damage states, and limited cross-event transferability. This study presents, to our knowledge, the first application of Grassmann-Plucker (GP) token mixing to computer vision and introduces two extensions for image classification: the Quantum-inspired Grassmann-Plucker (QGP) head and the Hybrid Quantum Machine Learning Grassmann-Plucker (HQML-GP) head. The GP head represents multiscale relationships among image patch tokens by encoding subspaces formed by token pairs with Plucker coordinates; QGP enriches these coordinates with amplitude-derived probability features, whereas HQML-GP incorporates expectation values generated by a simulated quantum circuit into the geometric token representation. Paired pre- and post-event image patches from the xBD tornado dataset were processed using a frozen six-channel Vision Transformer base encoder with 16 x 16-pixel patches. The three GP-based heads were compared with multilayer perceptron and Transformer baselines under identical training, checkpoint selection, and evaluation protocols. Joplin and Moore tornado samples were used for model development and seen-event testing, while Tuscaloosa was reserved for unseen-event evaluation. QGP led both test sets in accuracy and macro-F1: 83.46% and 64.50% for the seen events, and 66.45% and 52.70% for the unseen event. Although HQML-GP obtained the highest validation macro-F1 of 65.63%, it did not surpass QGP on either test set and required substantially more training time per epoch. These results establish GP token mixing as a competitive attention-free alternative to conventional Transformer-based token mixing for paired satellite image damage classification.

[215] Fine-Grained Multi Image Object Hallucination Benchmark cs.CV | cs.AI | cs.LGPDF

Joonki Min, Chaeyun Kim, Hyungwook Choi, Yejin Kim, Kihyun Kim

TL;DR: 本文提出了MIOH基准，用于细粒度评估多模态大语言模型在多图像场景下的物体幻觉问题。该基准通过四种基础任务（存在性、计数、属性、位置）、三种多图像推理模式（全面、比较、选择性）和三种对抗压力（视觉上下文规模、感知难度、上下文偏差）来系统分析幻觉触发因素。评估了29个模型，发现即使是GPT-5和Gemini-2.5-Pro等先进系统在不同推理模式和任务中也表现出明显的失败模式，揭示了幻觉源于多图像间物体表征整合阶段的局限性。

Details

Motivation: 当前多模态大语言模型在多图像场景中仍受物体幻觉（生成看似合理但事实不一致的物体描述）的根本限制，而现有基准主要针对单图像设置或仅提供高层次多图像评估，无法系统诊断视觉复杂性和推理需求如何触发幻觉。

Result: 在MIOH基准上评估了29个模型，包括GPT-5和Gemini-2.5-Pro等最先进系统，结果显示它们在不同推理模式和任务中均表现出明显的失败模式，表明当前模型在多图像物体幻觉方面存在显著缺陷。

Insight: 创新点在于提出了首个细粒度的多图像物体幻觉基准MIOH，通过结构化任务和推理模式系统分析幻觉；客观分析表明，幻觉不仅源于感知失败，更关键的是在多图像间维护物体表征的整合阶段限制，这为开发更可靠的多模态AI系统提供了重要诊断工具。

Abstract: Multimodal Large Language Models (MLLMs) are increasingly deployed in multi-image scenarios requiring complex reasoning across visual contexts. However, current MLLMs remain fundamentally limited by object hallucination-generating plausible yet factually inconsistent descriptions about objects. Existing benchmarks, designed primarily for single-image settings or providing only high-level multi-image assessments, cannot systematically diagnose how visual complexity and reasoning demands trigger hallucination. To address this gap, we introduce MIOH, a fine-grained multi-image object hallucination benchmark that systematically evaluates object hallucination across four foundational tasks (existence, counting, attribute, position) through three multi-image reasoning patterns (comprehensive, comparative, selective) under three controlled adversarial pressures (visual context scale, perceptual difficulty, contextual bias). Through evaluation of 29 models, we reveal that even state-of-the-art systems like GPT-5 and Gemini-2.5-Pro exhibit distinct failure patterns across different reasoning patterns and tasks. Our evaluation reveals that hallucination stems not merely from perceptual failures but from integration-stage limitations when maintaining object representations across multiple images. MIOH provides a controlled framework for analyzing multi-image object hallucination and serves as a critical evaluation tool for developing more reliable multimodal AI systems.

[216] InfraOcc: An Infrastructure Occupancy Benchmark with Static-to-Dynamic Reasoning cs.CVPDF

Lei Yang, Xiaokai Bai, Boqi Li, Chunmian Lin, Li Wang

TL;DR: 本文提出了InfraOcc，首个真实世界基础设施视角的语义占据栅格基准，包含290个多模态序列的密集体素标注，并揭示了路边感知中静态与动态占据的结构性不对称。同时，论文提出了ProSD-Occ方法，将占据栅格预测重新定义为从静态到动态的渐进式证据推理，在InfraOcc基准的所有评估轨道上均取得了最佳性能。

Details

Motivation: 现有占据栅格基准和方法均围绕移动的自车视角构建，将占据视为一次性体素分类，未能衡量和利用固定视角基础设施传感器所特有的、由持久静态结构与稀疏动态事件叠加而成的数据结构。

Result: 在提出的InfraOcc基准上，ProSD-Occ方法在整体、动态、静态和几何占据的所有评估轨道（纯相机、纯LiDAR、多模态）上均排名第一。例如，在纯相机动态mIoU上相对最强基线有23.5%的提升，多模态整体mIoU达到65.87。

Insight: 核心创新在于将固定视角的路边占据栅格预测定义为一个独特的推理范式，即渐进式静态到动态证据推理。这包括先解释持久布局，在静态置信度指导下暴露残差动态证据，最后将静态、动态和自由空间证据重组为统一场。基准构建中静态-动态解耦的标注流程和诊断指标也极具价值。

Abstract: Fixed-viewpoint infrastructure sensors repeatedly observe the same traffic space, making roadside 3D occupancy structurally different from ego-vehicle perception: a near-persistent static scaffold is overlaid with sparse, short-lived dynamic events. Existing occupancy benchmarks and methods, however, are built around moving ego vehicles and neither measure nor exploit this structure, instead treating occupancy as flat one-shot voxel classification. We address this gap from both data and model perspectives. We build InfraOcc, to our knowledge, the first real-world infrastructure-side semantic occupancy benchmark, with dense voxel annotations for 290 multi-modal sequences in a fixed roadside frame, a static-dynamic decoupled annotation pipeline, unified camera-only, LiDAR-only, and multi-modal evaluation, and diagnostics for static and dynamic occupancy. InfraOcc shows that static infrastructure fills 97.3% of occupied voxels and persists across frames, whereas dynamic participants have a median occupied-frame ratio of only 1.8% per location, revealing a structural static-dynamic asymmetry beyond semantic long-tailedness. We further propose ProSD-Occ, which reformulates occupancy as progressive static-to-dynamic evidence reasoning: it explains persistent layout, exposes residual dynamic evidence under static-confidence guidance, and recomposes static, dynamic, and free-space evidence into a unified field. ProSD-Occ ranks first in overall, dynamic, static, and geometric occupancy on every track, e.g., a 23.5% relative camera-only dynamic-mIoU gain over the strongest baseline and 65.87 multi-modal overall mIoU, establishing fixed-viewpoint roadside occupancy as a distinct problem with its own reasoning paradigm. The benchmark and code will be publicly available at https://github.com/yanglei18/InfraOcc

[217] TUE-Detector: A Tool-Using Expert MLLM-Based Detector for AI-Generated Videos cs.CVPDF

Yichen Wu, Haoxuan Qu, Yongxing Dai, Yan Bai, Yihang Lou

TL;DR: 本文提出了一种名为TUE-Detector的新型AI生成视频检测框架。该框架将通用多模态大语言模型训练成一个任务定制的工具使用专家检测器，使其能够调用合适的工具来收集不自然伪影的具体证据，并基于这些证据进行推理以实现可靠检测。

Details

Motivation: AI生成视频检测的关键挑战在于准确识别细微但可测量的不自然伪影。本文旨在从工具介导的证据发现这一新颖视角来解决这一挑战。

Result: 广泛的实验证明了该框架的有效性，但摘要中未提及具体的基准测试、定量结果或与SOTA的比较。

Insight: 核心创新点在于提出了一个工具使用专家MLLM的框架，通过让模型学习调用工具来收集和推理证据，从而提升检测可靠性。同时，框架还引入了新颖的设计来为专家检测器提供高质量且合适的工具集。

Abstract: AI-generated video detection, which aims to distinguish AI-generated videos from real ones, has recently received increasing research attention. To perform this task reliably, a key challenge lies in accurately identifying subtle-yet-measurable unnatural artifacts. In this work, we address this challenge from a novel perspective of tool-mediated evidence discovery and propose Tool-Using Expert MLLM-based AI-generated Video Detector (TUE-Detector), a novel framework for AI-generated video detection. TUE-Detector trains a general MLLM into a task-tailored tool-using expert detector that learns to invoke suitable tools, collect concrete evidence of unnaturalness, and reason over the evidence for reliable detection. Meanwhile, TUE-Detector further introduces novel designs to equip the expert detector with high-quality and suitable tools. Extensive experiments demonstrate the effectiveness of our framework.

[218] Can Video World Models Track Unobserved World States? cs.CVPDF

Joonghyuk Shin, Yicong Hong, Jaesik Park, Xun Huang

TL;DR: 本文研究了视频世界模型在跟踪未观测世界状态方面的能力，提出了一个动作条件化的视频Shell Game任务，用于评估模型在视觉渲染与隐藏状态组合解耦情况下的状态跟踪性能。研究发现，双向/自回归Transformer、Mamba和限制非负转移特征值的线性注意力模型在训练序列长度内表现良好，但在更长的交换链上（外推）性能下降至随机水平，尽管它们仍能生成看似合理的视频。论文识别了两种能够成功外推的机制：允许负特征值的线性注意力，以及通过非线性快速权重更新特征图来读取自身状态的TTT模型。

Details

Motivation: 视频世界模型常被用作模拟器，但仅凭视觉保真度无法证明模型能维持世界的隐藏状态。本文旨在探究这一差距，通过设计一个视觉类比任务（$S_5$状态跟踪），将视觉渲染与底层隐藏状态的组合解耦，以评估模型是否真正跟踪了未观测的世界状态。

Result: 在动作条件化的视频Shell Game任务中，多种模型（双向/自回归Transformer、Mamba、限制非负转移特征值的线性注意力）在5次交换的训练序列上拟合良好，但在更长的交换链（外推）上性能下降至随机水平。两种成功外推的机制（允许负特征值的线性注意力、TTT非线性快速权重）在动态世界探索任务中进一步验证了其有效性。

Insight: 论文的创新点在于提出了一个专门评估视频世界模型隐藏状态跟踪能力的基准任务（视频Shell Game），并揭示了模型成功外推的关键在于能够在架构内部跨块携带并就地修订状态，而非仅依赖像素级扩散目标或令牌。具体而言，允许负特征值的线性注意力和通过非线性快速权重更新特征图的TTT机制是实现这一点的有效途径，这对构建有状态的视频世界模型具有重要启示。

Abstract: Video world models are increasingly used as simulators, yet visual fidelity alone does not show that a model maintains the hidden state of the world. We examine this gap with an action-conditioned video Shell Game, a visual analog of $S_5$ state tracking that decouples visual rendering from compositing the hidden state underneath. Bidirectional and autoregressive Transformers, Mamba, and linear attention restricted to nonnegative transition eigenvalues all fit the training horizon of 5 swaps and then fall toward chance on longer swap chains (extrapolation) while still rendering plausible video with additional denoising steps providing no benefit. The pixel-based diffusion target never supervises the unseen hidden state, so the generated frames cannot carry it and the state has to live inside the architecture rather than in the tokens. For a Transformer, that architectural state is only an append-only KV cache, so the model has to re-derive the hidden arrangement from the whole history at every chunk. We find two mechanisms that do extrapolate, and both carry a state across chunks and revise it in place. Linear attention succeeds once its transition eigenvalues may be negative, and TTT with a nonlinear fast weight succeeds by updating the feature map through which it reads its own state. We further examine harder cases in dynamic world exploration tasks, and discuss the broader implications for building stateful video world models.

[219] UFPR-PEs: A Brazilian Face Recognition Benchmark with Self-Declared Race/Color Labels cs.CVPDF

Alexandre Diano, Bernardo Biesseck, Gabriel Polo, Vinicius Gregorio, Laura Lopes

TL;DR: 本文提出了UFPR-PEs，一个用于评估人脸识别系统偏见的新基准数据集，该数据集基于巴西当选政治家的公开视频构建，并标注了官方自我声明的种族/肤色类别。该基准采用巴西人口普查分类法，包含‘parda’类别，弥补了现有以欧美为中心的分类体系的不足。研究分析了在不同视觉难度和种族/肤色子组下的识别性能，强调了结合视觉难度解释性能差异的重要性。

Details

Motivation: 解决现有面部识别系统在非受控视觉条件下的人口统计学可靠性和鲁棒性评估不足的问题，特别是缺乏基于非欧美中心种族分类（如巴西分类法）的基准。

Result: 在验证和（闭集与开集）识别设置下评估了人脸识别性能，包括按种族/肤色和难度级别的子组分析。结果表明，识别性能随图像质量变化显著，且子组性能差距必须结合视觉难度而非孤立地解释。

Insight: 创新点在于引入了基于巴西自我声明种族/肤色分类（包含独特的‘parda’类别）的基准，并强调在具有挑战性的公开视频条件下，结合样本视觉难度来分析人口统计学偏见，为偏见研究提供了更贴近现实且可复现的评估环境。

Abstract: While face recognition systems are widely deployed, ensuring their demographic reliability and robustness under uncontrolled visual conditions remains a critical challenge. To bridge this gap, we present UFPR-PEs, a benchmark for face recognition bias evaluation using public videos of elected Brazilian politicians annotated with official self-declared race/color categories. The dataset adopts the Brazilian census taxonomy, including the parda category, which has no direct equivalent in the U.S.- or Europe-centric schemas commonly used in prior benchmarks. Our benchmark is built from compressed public video and preserves difficult samples so that performance can be analyzed under realistic conditions. We describe the construction pipeline, report dataset statistics, and evaluate face recognition performance across verification and (closed- and open-set) identification settings, including subgroup analysis by race/color and difficulty level. The results show that recognition performance varies substantially with image quality, and that subgroup gaps must be interpreted jointly with visual difficulty rather than in isolation. Overall, UFPR-PEs provides a reproducible and demographically grounded setting for studying face recognition bias under challenging public video conditions.

[220] VisLens: Single-Pass Interpretable Visual Search for Multimodal LLMs cs.CVPDF

Jingyi He, Sanghwan Kim, Zeynep Akata

TL;DR: 本文提出了VisLens，一种用于多模态大语言模型（MLLMs）的单次前向传播可解释视觉搜索方法。该方法基于logit lens，通过轻量级调谐透镜从早期隐藏状态解码视觉语义，并与查询中的目标词匹配以生成相关区域裁剪，从而在单次前向传播中完成细粒度目标定位，无需多次查询。

Details

Motivation: 解决MLLMs在高分辨率图像中定位细小或罕见物体（细粒度视觉搜索）时面临的挑战：现有免训练方法（基于注意力或置信度）准确但速度慢（需多次查询），而基于强化学习的工具调用模型推理快但缺乏可解释性和可控性。

Result: VisLens在性能上匹配或超越现有基线方法，同时大幅降低延迟：比Thyme方法快8.5-9.9倍，比免训练的多轮次搜索方法快达22.2倍。

Insight: 创新点在于将logit lens机制扩展到视觉搜索任务，通过轻量级调谐透镜实现从早期层解码视觉语义，实现了单次前向传播的可解释搜索，平衡了速度、准确性和可解释性。

Abstract: Multimodal large language models (MLLMs) struggle with fine-grained Visual Search, the task of locating small or rare objects in high-resolution images. Existing remedies fall into two families: (1) Training-free methods based on attention or confidence scores are accurate but slow, since they require multiple MLLM queries per example. (2) Reinforcement Learning (RL) trained tool-use models are faster at inference but opaque, since their tool calls remain uncontrollable and hard to interpret. To overcome this, we propose \emph{VisLens} (Visual Focus via Logit Lens), a Visual Search method built on the logit lens, which decodes the semantics held in a hidden state by projecting it through the LLM head. VisLens further uses a lightweight tuned-lens that maps early hidden states into the final hidden state space, so visual tokens can be read out from early layers. These tokens are matched to target words in the query to generate a crop of the relevant region, which is fed back in alongside the original image to produce the final answer. The whole process, from decoding to the final answer, completes in a single forward pass without repeated queries. VisLens matches or exceeds prior baselines while delivering a substantial latency advantage, running $8.5$–$9.9\times$ faster than Thyme and up to $22.2\times$ faster than training-free multi-pass search methods.

[221] RailGen: Improving Railway Intrusion Detection via Agent-Guided Small-Scale Foreign Object Generation cs.CV | cs.AIPDF

Quan Hao, Ziyang Tao, Chenxi Zhang, Yudong Wang, Rui Shi

TL;DR: 本文提出了一种名为RailGen的生成增强检测范式，用于解决铁路异物检测（RFOD）中长尾分布下小目标检测的挑战。该范式基于大模型构建了一个多模态图像生成智能体，能够自动生成包含高质量小尺度异物的合成样本，以丰富尾部类别的特征空间。同时，论文提出了FocalDEIM检测框架，通过Focal Modulation和Focal Loss来增强小目标判别能力，并在实验中超越了现有方法。

Details

Motivation: 铁路异物检测面临长尾数据分布和小目标易混淆、样本稀缺的挑战，现有方法难以有效处理。

Result: 实验表明，RailGen生成的小目标像素面积平均减少13.85倍，最高可达58倍。结合FocalDEIM框架，该范式在mAP@50和mAP@(50-95)指标上分别比基线DEIM提升了5.6%和7.5%，并超越了现有最先进方法。

Insight: 创新点在于提出了一种结合多模态生成（RailGen）与针对性检测框架（FocalDEIM）的端到端范式，通过合成数据有效丰富长尾小目标的特征空间，并利用Focal机制增强类间边界判别，为安全关键应用中的小目标检测提供了新思路。

Abstract: Small-object detection under long-tailed data distributions is a fundamental yet challenging problem in multimedia. Railway Foreign Object Detection (RFOD) epitomizes this challenge with easily confused small intrusions and scarce samples. To address these issues, we propose a generative-augmented detection paradigm that leverages multimodal image generation to enrich the feature space of rare and small objects. We first construct RailGen, a multimodal image generation agent based on large models. Under semantic constraints, RailGen automatically invokes tools to generate railway scenes, calibrate intrusion positions, extract foreign objects, and fuse them into realistic intrusion effects. This process produces high-quality synthetic samples that effectively densify the feature representations of tail classes and complete the small-object feature space. Within this paradigm, we further propose FocalDEIM, a detection framework designed to enhance training with generated data. FocalDEIM improves dense matching with Focal Modulation for better small-object discrimination and adopts Focal Loss to emphasize hard samples, thereby alleviating blurred inter-class boundaries in complex railway scenes. Experimental results demonstrate that RailGen can generate high-quality small-scale foreign objects, reducing the object pixel area by up to 58x and 13.85x on average. Equipped with these challenging samples, our paradigm surpasses the baseline DEIM by 5.6% and 7.5% in mAP@50 and mAP@(50-95), respectively, and outperforms existing state-of-the-art methods. Ablation studies verify RailGen’s feature-space enrichment and FocalDEIM’s boundary discrimination. The paradigm provides an effective multimodal generative solution for long-tailed small-object detection in safety-critical applications.

[222] CheXGround: Anatomical Region Tokens for Grounded Longitudinal Chest X-ray Interpretation cs.CVPDF

Adonay Demewez Gebremedhin, Wessam Shehieb, Sara Alansari, Mohamad Alansari, Muzammal Naseer

TL;DR: 本文提出了CheXGround，一种基于解剖区域进行视觉定位的纵向胸部X光语言模型。该模型通过提取当前和先前X光片中的解剖区域，将其编码为时间增强的感兴趣区域（ROI）标记，并与全局时间图像上下文结合进行报告生成。为了将区域标记与临床文本关联，作者提出了时间区域-短语对齐的预训练目标。

Details

Motivation: 当前放射学多模态语言模型在胸部X光报告生成和时序推理方面已取得进展，但如何利用局部视觉证据支持纵向解释（即比较序列检查以描述变化）仍未被充分探索。

Result: 在单研究和纵向视觉问答（VQA）、纵向发现生成、时序定位VQA和解剖定位等任务上，CheXGround在临床语言质量、时序推理和定位准确性方面均优于近期基线模型。

Insight: 核心创新点在于提出了一种在解剖区域层面组织纵向证据的表示方法，并通过时间区域-短语对齐的预训练目标，实现了局部视觉证据与临床语言的精准关联，为基于定位的放射学语言建模提供了新思路。

Abstract: Recent radiology multi-modal language models have made substantial progress in chest X-ray report generation, visual question answering, and temporal reasoning. While longitudinal chest X-ray interpretation compares sequential examinations to describe change, visual grounding aims to connect clinical language with localized image evidence. Although longitudinal modeling and visual grounding have each advanced radiology language models, how localized visual evidence can support longitudinal interpretation remains under-explored. We introduce CheXGround, a region-grounded longitudinal chest X-ray language model that represents paired studies through corresponding anatomical regions. CheXGround extracts anatomical regions from current and prior radiographs, encodes them as temporally enhanced Region-of-Interest (ROI) tokens, and combines them with global temporal image context during generation. To connect these region tokens with clinical text, we propose Temporal Region–Phrase Alignment, a pretraining objective that aligns temporal anatomical representations with localized report phrases. We evaluate CheXGround on single-study and longitudinal Visual Question Answering (VQA), longitudinal findings generation, temporal grounded VQA, and anatomical grounding. Across these tasks, CheXGround improves clinical language quality, temporal reasoning, and localization accuracy over recent baselines. Our results suggest that organizing longitudinal evidence at the anatomical level is a strong representation for grounded radiology language modeling. Project page: https://adonaydem.github.io/chexground-website

[223] Whole-Body MRI Classification via Prompt-Based Clinical Conditioning cs.CVPDF

Laura Daza, Marta Hasny, Cristina González, Julia A. Schnabel

TL;DR: 本文提出了一种名为TACTIC的基于提示的多模态框架，用于整合全身磁共振成像（WB-MRI）和结构化临床数据以改善系统性疾病的诊断。该方法通过将临床属性编码为提示，支持任意数量的表格输入并自然处理缺失数据，无需插补或固定输入结构。

Details

Motivation: 结合WB-MRI和临床变量可以利用互补的患者信息改进诊断，但结构化临床数据常不完整或缺失，限制了传统多模态融合方法的适用性。

Result: 在糖尿病、慢性阻塞性肺病、乳腺癌、前列腺癌和转移诊断等五个WB-MRI分类任务上，TACTIC在临床信息可用时始终优于仅使用图像的基线方法，并在不完整表格输入下保持强大的预测能力。

Insight: 创新点在于提出基于提示的临床条件化方法，将临床属性作为提示来调节视觉特征学习，实现了对任意数量表格输入和缺失数据的灵活处理，为多模态医学图像分析提供了一种可扩展的解决方案。

Abstract: Combining whole-body magnetic resonance imaging (WB-MRI) with clinical variables has the potential to improve systemic disease diagnosis by leveraging complementary sources of patient information. However, structured clinical variables are often incomplete or missing, limiting the applicability of conventional multimodal fusion methods that assume fixed inputs. In this work, we propose TACTIC (Tabular-Attribute Conditioned Transformer for Image Classification), a prompt-based multimodal framework that integrates WB-MRI and structured clinical data through conditional visual feature learning. By encoding clinical attributes as prompts, TACTIC supports an arbitrary number of tabular inputs and naturally handles missing data without requiring imputation or fixed input structures. We evaluate TACTIC on five WB-MRI classification tasks spanning systemic and oncologic applications, including diabetes, chronic obstructive pulmonary disease (COPD), breast cancer, prostate cancer, and metastasis diagnosis. Across all tasks, TACTIC consistently improves performance over image-only baselines when clinical information is available while maintaining strong predictive capability under incomplete tabular inputs. Our results demonstrate the effectiveness of prompt-based models as a flexible approach for improving WB-MRI analysis using clinical context. The model weights and code are available at https://github.com/lauradaza/TACTIC

[224] Lucida: Parse, Generate, and Place for Composable Real-to-Sim Scene Modeling cs.CV | cs.AIPDF

Minghan Qin, Yuang Wang, Xiuyu Yang, Yushi Long, Yujian Zhang

TL;DR: 本文提出了Lucida，一种用于可组合的真实到仿真场景建模的端到端流水线，旨在从真实室内场景的杂乱视频中恢复出完整、可编辑的物体资产，并按照观测排列，为机器人仿真和具身AI提供仿真就绪的环境副本。该方法将任务重新分解为解析、生成和放置三个步骤，每个步骤仅依赖真实捕获能可靠提供的信息，并将精度要求从流水线起始端转移到末端。

Details

Motivation: 解决现有可组合场景建模流水线在解析观测、生成资产和放置资产时，对输入（如精确的实例几何、无遮挡视图、与观测精确匹配的资产）要求过高，而真实捕获的杂乱数据往往无法满足这些要求的问题。

Result: 在场景级3D物体检测（R2S-Scene数据集上mAP相比Boxer提升69%）、物体姿态估计（CA-1M数据集上ADD-SB@0.05从57.8%提升至83.4%）和场景重建（场景F-Score从SAM3D的0.794提升至0.924）任务上均取得了显著提升。

Insight: 创新性地重新分配了流水线各步骤的精度要求，使其更适应真实捕获数据的特性；提出了GizmoAct，一种利用视觉语言模型（VLM）策略将物体放置任务转化为多轮GUI交互的闭环方法，让模型自行判断对齐何时完成。

Abstract: Composable scene modeling aims to recover a real indoor scene as complete, editable object assets arranged as observed, giving robot simulation and embodied AI a simulation-ready replica of the real environment whose objects can be manipulated individually. Existing pipelines decompose the task into three steps—parse the observations into instances, generate an asset for each, and place each asset back—but every step presumes an input that a cluttered capture rarely provides: accurate instance geometry, unoccluded views, and assets that accurately match the observations. We propose Lucida, which keeps this order but redistributes the requirements, so each step consumes only what a real capture reliably provides and precision is reached at the end of the pipeline rather than demanded at its start. Lucida parses the video into a scene graph whose nodes carry per-instance multi-view evidence, generates a complete asset for each instance from its evidence, and places assets with GizmoAct, a VLM policy that casts placement as multi-turn GUI interaction, manipulating the object’s gizmo in a closed loop and deciding itself when alignment is reached. Across scene-level 3D object detection, object pose estimation, and scene reconstruction, Lucida improves mAP over Boxer by 69% on R2S-Scene, raises ADD-SB@0.05 from 57.8% to 83.4% on CA-1M, and increases scene F-Score from 0.794 for SAM3D to 0.924.

[225] TAMI: Temporally Aligned, Missingness-Aware, and Interpretable Multimodal Fusion for Mental Health Assessment in Older Adults with Mild Cognitive Impairment cs.CV | cs.AIPDF

Merna Bibars, Bolaji Omofojoye, Allan I. Levey, Rachel Hershenberg, Gari D. Clifford

TL;DR: 本文提出了一个名为TAMI的多模态融合框架，用于对患有轻度认知障碍的老年人进行心理健康评估。该框架解决了现有方法在时间对齐、模态缺失处理和可解释性方面的不足，通过将语音、语言、面部和生理特征在共享时间线上对齐、编码模态缺失信息并结合问题上下文进行融合，实现了对抑郁和焦虑的自动筛查。

Details

Motivation: 解决老年人轻度认知障碍患者中抑郁和焦虑漏诊率高的问题，现有远程临床访谈多模态分析方法存在三个主要局限：跨模态特征时间未对齐导致虚假关联、模态缺失值处理不当、以及预测结果缺乏细粒度的可解释性。

Result: 在49名MCI老年人的访谈数据上，TAMI框架在抑郁和焦虑分类任务上分别取得了0.68和0.69的AUROC分数。其中，多模态特征的时间对齐带来了最大的性能提升（Δ≥0.1）。仅使用开放式问题回答（5.1分钟）的抑郁模型AUROC为0.67，与使用完整访谈（19分钟）无显著差异。

Insight: 创新点在于提出了一个集时间对齐、缺失感知和可解释性于一体的多模态融合框架。其核心是将不同分辨率的特征在问题-回答片段内对齐到共享时间线，并显式编码模态缺失模式。该框架还支持对模态、问题和访谈时刻进行多层次的归因分析，为临床解释提供了细粒度洞察，并验证了以开放式问题为中心的访谈协议设计的有效性。

Abstract: Depression and anxiety in older adults with Mild Cognitive Impairment (MCI) are frequently underdiagnosed due to limited access to care. Multimodal analysis of remote clinical interviews is a scalable screening approach, but existing methods have three limitations. First, they do not correct temporal misalignment across multimodal features extracted at different resolutions, inducing spurious cross-modal associations. Second, remote recordings exhibit uneven modality dropout, but missing values are often zero-filled, making them indistinguishable from valid near-zero measurements. Finally, they do not jointly attribute predictions to modalities, questions, and interview moments, limiting fine-grained clinical interpretation. We propose a Temporally-Aligned, Missingness-Aware, Interpretable (TAMI) multimodal fusion framework. TAMI aligns speech, language, facial, and physiological features within question-answer segments on a shared timeline, encodes modality-level missingness over time, and conditions fusion on question context. In interviews with 49 older adults with MCI, TAMI achieved area under the receiver operating characteristic curve (AUROC) scores of 0.68 (depression) and 0.69 (anxiety). Fine-grained temporal alignment of multimodal features produced the largest performance gain ($Δ{\geq}0.1$). Multi-level interpretability analysis revealed that depression classification relied on eyegaze and open-ended questions, while anxiety classification depended on eyegaze and head pose, with attribution uniformly distributed across questions. Using only responses to the open-ended questions (5.1min), the depression model achieved an AUROC score of 0.67, which was not significantly different from using the full interview (19min) ($p>0.05$). Our findings support designing interview protocols centered on open-ended questions for depression screening in older adults with MCI.

[226] SurgSkill-Bench: A Benchmark for Multimodal Surgical Skill Assessment cs.CVPDF

Chaohui Dang, Zheheng Jiang, James Glasbey, David Luke, Theodoros Arvanitis

TL;DR: 本文介绍了SurgSkill-Bench，一个用于多模态手术技能评估的基准数据集，包含手术模拟视频、OSATS评分和专家文本评论。论文定义了两种评估设置：仅视频的OSATS预测和专家评论辅助的预测，并通过基线实验验证了自适应关键帧采样和视频-文本融合模块的有效性。

Details

Motivation: 当前手术技能评估依赖劳动密集型的专家评审，现有自动化方法主要关注视觉输入，缺乏对操作表现、结构化评分和评估者反馈的联合研究。

Result: 在内部视频级验证中，自适应采样提升了仅视频设置的性能，专家评论在辅助设置中提供了额外信号，最佳平均AUROC在数据集特定中位数二分法下达到0.88。

Insight: 创新点在于构建了首个结合视频、评分和文本的多模态手术技能评估基准，并探索了评论作为辅助信息对预测的增强作用，为自动化评估提供了新思路。

Abstract: Objective assessment of surgical technical skill is important for surgical training and structured feedback, but current workflows remain dependent on labor-intensive expert review. Existing automated approaches primarily focus on visual inputs and provide limited support for jointly studying operative performance, structured skill scores, and evaluator feedback. We introduce SurgSkill-Bench, an initial video-score-text benchmark-style dataset containing 214 surgical training simulation videos, six-dimensional OSATS scores, and expert free-text comments. We define two evaluation settings: video-only OSATS prediction for automated assessment and post hoc expert-comment-assisted prediction, where evaluator comments are available as auxiliary information. We provide controlled baseline experiments using representative frozen visual backbones, content-adaptive key-frame sampling, and a simple video-text co-attention fusion module. Under internal video-level validation, content-adaptive sampling improves video-only performance in this dataset, while evaluator comments provide additional score-related signal in the assisted setting. The best mean AUROC reaches 0.88 under dataset-specific median dichotomization. We further discuss evaluation constraints related to dataset scale, metadata completeness, and the interpretation of comment-assisted prediction. Code will be released publicly at a later date.

[227] RealOOB: A Definition-Consistent Real-World Oriented Occlusion Boundary Benchmark cs.CVPDF

Lintao Xu, Yinghao Wang, Chenchu Rong, Xuchong Qiu, Chaohui Wang

TL;DR: 该论文提出了RealOOB，一个精心标注、定义一致的真实世界遮挡边界基准数据集，包含426万个几何基础的遮挡边界标签，涵盖物体间和自遮挡边界，并提供了有效性感知的遮挡方向图。基于此基准，作者评估了多种遮挡边界估计器、边缘检测器和单目深度估计器的性能。

Details

Motivation: 现有遮挡边界基准存在标注覆盖范围有限、类别特定设计、缺乏自遮挡标注或定义不一致等问题，限制了像素级遮挡边界估计的发展。同时，现代边缘检测器和深度估计器作为强大的边界和几何预测器，其与定义一致的遮挡边界之间的关系尚未得到充分探索。

Result: 评估了40个遮挡边界估计器和边缘检测器以及6个单目深度估计器。结果显示，现代边缘检测器在边界定位上与遮挡边界方法表现相当，但所有方法在遮挡方向预测上仍面临挑战。此外，即使是强大的深度估计器也常常无法在真实的遮挡边界处表现出可测量的几何信息。

Insight: 创新点在于构建了一个定义一致、覆盖全面的真实世界遮挡边界基准，并引入了有效性感知的遮挡方向图来约束监督信号。这为遮挡边界估计社区提供了一个强有力的参考基准，并为评估更广泛的低级视觉任务中的深度不连续性和几何保真度提供了真实世界的测试平台。

Abstract: Occlusion boundaries (OBs) are pixel-level image boundaries corresponding to surface visibility discontinuities caused by occlusion. Through precise boundary localisation and occlusion orientation, OBs encode local surface layout and depth ordering, providing geometry-driven mid-level cues for scene understanding. However, progress in pixel-level OB estimation has been limited by fragmented supervision: Existing benchmarks often suffer from limited coverage, category-specific designs, missing self-occlusion annotations, or inconsistent annotation definitions. Meanwhile, modern edge detectors and monocular depth estimators have become strong boundary and geometry predictors, yet their relationship to definition-consistent OBs remains underexplored. We introduce RealOOB, a carefully annotated real-world benchmark with 4.26M definition-consistent, geometry-grounded OB labels covering both inter-object and self-occlusion boundaries, together with validity-aware occlusion-orientation maps that restrict supervision to pixels whose cross-boundary depth ordering is reliably measurable. Based on RealOOB, we evaluate forty OB estimators and edge detectors alongside six monocular depth estimators. Our evaluation reveals a clear gap in occlusion reasoning: modern edge detectors perform competitively with OB methods in localisation, whereas orientation prediction remains challenging for all evaluated methods. Meanwhile, even strong depth estimators often fail to exhibit measurable geometry at true OBs. We believe RealOOB provides a strong reference benchmark for the OB estimation community and a real-world testbed for assessing depth discontinuities and geometry fidelity in broader low-level vision tasks. Dataset and code will be released.

[228] Audio-Driven Adversarial Defense for 3D Talking Face Generation with totally Visual Fidelity Preservation cs.CV | cs.MMPDF

Rui-Qing Sun, Chen-Hao Cui, Hui-Yang Zhao, Tian Lan, Zhijing Wu

TL;DR: 本文提出了一种针对音频驱动的3D说话人脸生成模型的对抗防御方法，通过将保护从视觉模态转移到音频模态，在语音信号中嵌入基于心理声学掩蔽的不可感知扰动，以破坏身份获取并保持视觉保真度。

Details

Motivation: 现有主动防御方法主要在视觉域注入细微扰动来干扰身份获取，但会损害视觉质量且易受常见变换（如缩放）影响；本文旨在克服这些限制，通过音频扰动实现更鲁棒且视觉无损的隐私保护。

Result: 大量实验表明，该方法能有效降低3D说话人脸生成质量，同时保持优良的感知质量，验证了音频扰动的有效性。

Insight: 创新点在于利用心理声学掩蔽将保护性扰动隐藏于语音信号的感知掩蔽频段，实现了对生成模型的对抗防御而不影响视觉保真度，为隐私保护肖像防护提供了新方向。

Abstract: The rapid development of generative portrait models has raised growing concerns about privacy leakage and identity misuse. In particular, audio-driven 3D talking face generation can reconstruct a reusable 3D portrait of a target person from a monocular video and animate it with arbitrary speech, making realistic identity impersonation alarmingly practical. Existing proactive defenses mainly operate in the visual domain by injecting subtle perturbations into acial regions to disrupt identity acquisition. However, such perturbations often compromise visual quality due to the strong structural priors and social sensitivity of human faces, and are easily weakened by common real-world transformations such as resizing. To overcome these limitations, we propose an imperceptible audio defense for audio-driven 3D talking face generation by shifting protection from the visual modality to the audio modality. Specifically,we exploit psychoacoustic masking to hide protective perturbations within perceptually masked frequency regions of the speech signal, thereby reducing perceptual distortion while suppressing reliable facial animation. Extensive experiments demonstrate that the proposed method effectively degrades 3D talking face generation while preserving favorable perceptual quality. These findings highlight psychoacoustically guided audio perturbations as a practical and promising direction for privacy-preserving portrait protection.

Walid Bousselham, Mathilde Caron, Arsha Nagrani, Cordelia Schmid

TL;DR: 本文提出了LOCI（Locator-Critic）框架，这是一个无需训练的、将视觉搜索与证据验证解耦的迭代优化系统。它通过定位器（Locator）提出候选视觉证据，再由评判器（Critic）评估其相关性和充分性，两者在循环中不断精炼证据，以解决视觉语言模型在复杂视觉理解任务中定位关键细节失败的问题。

Details

Motivation: 当前视觉语言模型在复杂视觉理解任务上表现不佳，核心问题并非高层推理能力不足，而是无法准确定位图像中的关键细节，导致基于错误感知基础的推理。

Result: LOCI在多个复杂视觉基准测试中取得了最先进的成果，显著提升了开源模型（如Qwen3-VL）和专有模型（如Gemini 2.5 Pro）的准确率，在V*、HR-Bench和VisualProbe-Hard等基准上均有大幅提升。

Insight: 创新点在于将视觉证据的定位与验证过程解耦，并引入一个无需训练的、自我修正的迭代精炼循环，这允许模型专注于各自的子任务，从而更可靠地整合视觉信息进行推理。

Abstract: Vision-Language Models (VLMs) still struggle on tasks requiring complex visual understanding. We argue that the core issue is not high-level reasoning, but instead failing to locate critical details in the image. Due to this shortcoming, VLMs generate often plausible but incorrect reasoning based on flawed perceptual grounding. To address this, we propose Locator-Critic (LOCI), a training-free framework that decouples visual search from evidence verification. LOCI employs a Locator agent to propose candidate visual evidence and a separate Critic agent to evaluate its relevance and sufficiency. These agents engage in an iterative refinement loop, progressively improving the evidence until it is adequate to answer the given question. This decoupled, self-correcting process yields substantial performance gains, achieving state-of-the-art results on multiple complex visual benchmarks. LOCI improves accuracy for both open-weight models like Qwen3-VL (+12.1 on V*, +5.8 on HR-Bench and +11.2 on VisualProbe-Hard) and proprietary models like Gemini 2.5 Pro (+8.9 on V*, +4.3 on HR-Bench, +4.8 on VisualProbe-Hard).

[230] Rad-R: A Raw-ADC Radar Dataset and Capture-Invariant SSM for Hardware-Fault Diagnosis cs.CVPDF

Mainak Mallick, Junghwan Yim, Seung-Kyum Choi

TL;DR: 本文介绍了Rad-R，一个用于汽车毫米波雷达硬件故障诊断的原始ADC数据集，包含192个虚拟通道的原始雷达数据，并配以受控硬件故障、物理严重程度测量以及多模态同步数据流。作者还提出了RadrNet，一种基于Mamba SSM的原始IQ信号处理模型，在跨严重程度泛化任务中表现优于传统视觉骨干网络。

Details

Motivation: 汽车毫米波雷达在感知前可能因振动、天线错位、天线罩阻塞和接收通道退化等硬件故障而信号受损，但此类故障数据稀缺，因为需要在物理硬件上诱导和测量。

Result: 在受控的跨严重程度协议基准测试中，RadrNet-DS-CI（使用每帧标准化幅度和相对啁啾间相位）以0.663的宏F1分数排名第一，优于最强的RD-CNN（0.628）；RadrNet系列在随时和少样本预算任务中也领先。

Insight: 创新点包括引入首个配有多模态同步数据和校准故障严重程度的原始雷达数据集Rad-R，以及提出捕获不变的Mamba SSM模型（RadrNet），通过相对相位特征提升跨严重程度泛化能力；客观分析认为，将雷达微多普勒与独立测量的IMU振动能量关联（Spearman ρ=0.41）为故障诊断提供了新视角。

Abstract: Automotive mmWave radar can develop vibration, antenna misalignment, radome blockage, and receive-channel degradation that corrupt the signal before perception begins. Data for these faults are scarce because each condition must be induced and measured on physical hardware. We introduce Rad-R, a raw-ADC dataset captured with a 4-chip 77GHz TI MMWCAS-RF-EVM cascade (192 virtual channels). Unlike existing raw-radar datasets, Rad-R pairs each recording with a controlled hardware fault at a calibrated severity, an independent physical severity measurement, and frame-synchronised IMU, temperature, GPS, and camera streams. Rad-R is a single-session dataset, so our generalisation claims are confined to a controlled cross-severity protocol in which train and test use physically distinct captures. A reproducible benchmark evaluates seven representative vision backbones and the proposed raw-IQ Mamba SSM (RadrNet) under within-clip, chirp-wise anytime, few-shot cross-capture, and controlled cross-severity protocols. Within-clip performance is near-saturated ($>0.98$ macro-F1), whereas cross-severity generalisation remains difficult: the absolute-phase RadrNet-DS falls to $0.49$ macro-F1. RadrNet-DS-CI replaces absolute phase with per-frame-standardised magnitude and relative chirp-to-chirp phase and ranks first on the controlled benchmark ($0.663$ vs. $0.628$ for the strongest RD-CNN; three seeds); the RadrNet family also leads on the anytime and few-shot budgets. A descriptive cross-modal analysis further finds that radar micro-Doppler covaries with independently measured IMU vibration energy (pooled Spearman $ρ=0.41$ across conditions). The complete dataset and code will be released publicly under permissive licences.

[231] Vision Models Predict Urban Scene Appraisal with Limited Neural Alignment cs.CVPDF

Kaizhen Tan, Yuantao Deng

TL;DR: 该论文评估了预训练视觉嵌入模型在预测城市街景评价方面的表现，并检验了这些模型是否能够像人脑一样组织场景表征。研究发现，尽管某些模型（如DINOv2 ViT-B）在预测人类评分方面表现良好（最高达r=0.87），但它们与脑电数据（EEG）表征的对应性较低，最佳模型仅达到噪声下限的29.6%。这表明高预测准确度并不等同于模型能够模拟人脑的感知表征。

Details

Motivation: 研究动机在于验证预训练视觉嵌入模型是否能够真正模拟人类对城市街景的感知表征，而不仅仅是预测评分。当前研究大多仅通过预测评分来验证模型，但高预测准确度可能无法反映模型是否以人脑类似的方式组织场景信息。

Result: 在63名成年人观看56个柏林街景的EEG数据上，评估了17种特征空间（包括语言监督、自监督、类别监督和密集预测训练等）与神经表征的对应性。最佳模型DINOv2 ViT-B仅达到噪声下限的29.6%，而Gabor能量描述符与最佳模型表现相当，且优于所有语言监督模型。同时，模型在预测街景评价评分上表现良好（最高r=0.87），但预测准确度与神经对应性不相关。

Insight: 论文的创新点在于将预测准确度与神经对齐性分开评估，揭示了高预测性能并不保证模型能模拟人脑表征。此外，研究提供了一个无需训练的基准测试，仅需55张图像的嵌入即可评估新表征，为模型评估提供了更全面的视角。从客观角度看，该研究强调了在评估视觉模型时，除了预测任务外，还应考虑其与神经数据的对齐性，这对理解模型是否真正“理解”场景具有重要意义。

Abstract: Pretrained vision embeddings are increasingly used as general-purpose representations for modelling how people appraise urban scenes, and are validated almost entirely by how well they predict human ratings. High predictive accuracy does not establish that these embeddings organise scenes as human perception does. We test the two properties separately against brain data. Using openly released EEG from 63 adults who viewed and rated 56 Berlin street scenes, we estimate the representational geometry of the scenes over time, the proportion of that geometry that is explainable at all, and its correspondence with seventeen feature spaces spanning language-supervised, self-supervised, category-supervised and dense-prediction training, two orders of magnitude of scale, and interpretable controls. Correspondence is low throughout: the best representation, DINOv2 ViT-B, reaches 29.6% of the lower bound of the noise ceiling, the panel spans 11.0% to 29.6%, and a Gabor energy descriptor is indistinguishable from the best model while outperforming every language-supervised model tested. Within a model, deeper layers still match later neural responses, so the hierarchical correspondence found for object recognition survives even at this low overall level. The same embeddings predict held-out appraisal ratings well, up to r = 0.87, and the two measures do not track each other across models; reweighting features towards the neural geometry lowers appraisal prediction for every model tested, against a control of matched dimensionality. Predicting how a street is appraised is therefore weak evidence that a model represents the street as the brain does. The benchmark uses only public data and requires no training, so evaluating a new representation needs only its embeddings for 55 images.

[232] MR-JEPA: A General Purpose Video Foundation Model for Cardiac MRI cs.CV | cs.AIPDF

Athira J. Jacob, Puneet Sharma, Dorin Comaniciu, Daniel Rueckert

TL;DR: 本文提出了MR-JEPA，一个用于心脏磁共振成像（CMR）的自监督视频基础模型。该模型通过管状标记化、时空掩码增强和从2D CMR基础模型初始化等技术，将LeJEPA扩展到3D时空输入。模型在来自两个中心、10,505名患者的多序列（电影、LGE、映射）无标注数据上进行预训练，并在六个下游任务（包括射血分数、心肌应变和疾病检测）上评估，均优于现有方法。

Details

Motivation: 现有的深度学习模型通常处理单个2D切片，丢弃了CMR数据（如时间电影视频和空间LGE/映射堆栈）中丰富的序列上下文信息。本文旨在开发一个通用的视频基础模型，以统一利用CMR中多样序列的时空信息。

Result: 在六个下游任务（LV射血分数、RV射血分数、三种心肌应变、四类疾病检测）的评估中，MR-JEPA在所有五个回归任务上均优于其他对比方法（包括在更多数据上以文本监督预训练的领域特定模型和自然视频基础模型）。例如，LV EF的MAE为4.79%，GLS的MAE为1.87，在应变任务上MAE比基线降低了21-27%。疾病检测的宏观AUG为0.868，与领域特定基线保持竞争力。

Insight: 论文的创新点在于将自监督学习框架（JEPA）扩展到3D CMR视频领域，通过多序列、无标注的预训练构建了一个通用的心脏MRI视频编码器。其核心在于管状标记化、时空掩码增强和从2D模型初始化的策略，这实现了对多样化CMR序列的统一、鲁棒表示，为临床心脏量化和诊断提供了潜力。

Abstract: Cardiac magnetic resonance imaging (CMR) produces rich sequential data such as temporal cine videos and spatial LGE/mapping stacks, yet most deep learning approaches process individual 2D slices, discarding this context. We present MR-JEPA, a self-supervised video foundation model for CMR that extends LeJEPA to 3D spatiotemporal inputs through tubelet tokenization, spatiotemporal masking augmentation, and initialization from a 2D CMR foundation model. Unlike prior CMR video models limited to cine data, MR-JEPA is pretrained on multi-sequence data (cine, LGE, mapping) from 10,505 patients across two centers without annotations. We evaluate the frozen encoder on six downstream tasks using a unified multi-view gated attention architecture: LV ejection fraction, RV ejection fraction, three myocardial strains (GLS, GCS, GRS), and four-class disease detection. MR-JEPA outperforms other compared methods on all five regression tasks, including both a domain-specific CMR model pretrained on more data with text supervision and a natural-video foundation model, achieving an LV EF MAE of 4.79% (r =0.764) and a GLS MAE of 1.87 (r=0.805), with 21-27% MAE reductions over baselines on strain tasks. For disease detection, MR-JEPA achieved a macro AUG of 0.868, remaining competitive with the domain-specific baseline despite using a fully self-supervised pretraining objective. These results demonstrate the potential of a unified video encoder for robust, multi-view utilization of diverse CMR sequences in clinical cardiac quantification and diagnosis.

[233] Multi-View Reflective Surface Inspection via Semantic-Saliency Cross-Verification cs.CVPDF

Van-Giang Nguyen, Thanh-Tuan Tran, Xuan-Hieu Phan, Xiem HoangVan

TL;DR: 本文提出了一种用于反射表面缺陷检测的多视角检查框架，通过结合视觉语言模型（VLM）生成的类别感知语义框和法向参考重建分支提供的类别无关显著性，利用两者的空间一致性作为证据对语义提议进行重新排序，从而提升检测性能。该方法无需跨视图配准，在生产线图像和产品级别上均取得了显著提升。

Details

Motivation: 解决在单一固定视角下检测反射性智能手机盖板玻璃缺陷的挑战，因为缺陷的可见性会随观察几何和镜面反射而变化，导致某些视角下缺陷难以观察，且可用的视觉证据存在空间模糊性。

Result: 在282张生产线图像上，通过语义-显著性关联对固定语义提议进行重新排序，将$AP_{50}$从52.6%提升至62.6%。在94个产品上，利用所有三个视图的跨视图证据召回率$R_{\rm prod}@0.5$从最佳单视图的75.5%提高到88.3%。

Insight: 创新点在于提出了语义-显著性交叉验证机制，将VLM的语义理解与重建分支的显著性线索相结合，利用其空间一致性作为支持证据来排序提议，而非直接修改坐标或将显著性作为真值。这种方法利用了多视角光学观测的互补性，且无需复杂的跨视图配准，为反射表面检测提供了一种高效、鲁棒的解决方案。

Abstract: Reflective smartphone cover glass is challenging to inspect from a single fixed viewpoint because defect visibility varies with viewing geometry and specular reflections. This gives rise to two practical challenges: defects may be weakly observable from certain viewpoints, while the available visual evidence may remain spatially ambiguous. To address these issues, we propose a multi-view inspection framework in which each RGB observation is processed by a shared per-view expert. A vision-language model (VLM) produces class-aware semantic boxes, while a normal-reference reconstruction branch provides class-agnostic saliency. Their spatial agreement is used as supporting evidence to rank semantic proposals without modifying their coordinates or treating saliency as ground truth. The resulting evidence records are combined at product level without cross-view registration. On 282 production-line images, semantic-saliency association improves $AP_{50}$ from 52.6% to 62.6% by re-ranking fixed semantic proposals. Across 94 products, cross-view evidence recall $R_{\rm prod}@0.5$ increases from 75.5% for the best single view to 88.3% using all three views. These results support the complementary roles of semantic-saliency cross-verification and additional optical observations in reflective-surface inspection.

[234] From Intent to Evidence: Policy-Steered Multi-Strategy Retrieval for Long-Video Agents cs.CVPDF

Can Zhang, Baofeng Zhang, Xiaotian Han, Junyuan Shang, Yuchen Ding

TL;DR: 本文提出VESTA，一种免训练的长视频智能体，通过意图路由器和证据账本实现策略引导的多策略检索。它采用获取-验证-巩固循环，根据问题意图动态选择聚焦、召回或对比检索策略，并维护可适应的证据视图，以解决现有方法因统一检索行为导致的证据获取不足问题。

Details

Motivation: 现有长视频智能体采用统一的检索行为，无法根据问题需求（如集中证据、广泛覆盖或区分竞争假设）灵活调整，导致在推理开始前就可能失败；而为每个问题预设细粒度解决方案又限制了自主探索。

Result: 在Video-MME-v2上，VESTA比VideoARM平均准确率提升2.7点，并在所有六个报告指标上均有增益；在LongVideoBench、EgoSchema和LVBench上，使用共享查询时模型，它在LongVideoBench长视频子集上提升6.9点，在LVBench上提升1.5点，在EgoSchema上与VideoARM相当。

Insight: 创新点包括引入意图路由器动态推断证据获取策略（聚焦、召回、对比）和证据记账策略，以及通过时间证据账本整合观察结果，形成自适应的压缩视图，以指导后续获取并优先处理已验证观察，从而增强长视频问答中的证据检索灵活性和鲁棒性。

Abstract: Existing long-video agents acquire evidence through one uniform behavior, ignoring whether the required evidence is concentrated, requires broad occurrence coverage, or must discriminate competing hypotheses—which can cause failure before substantive reasoning begins. Prescribing a fine-grained solution procedure for every question is not a satisfactory remedy, as it restricts autonomous exploration. We propose VESTA, a training-free long-video agent organized as a route-conditioned acquire–verify–consolidate loop. Before exploration, an intent router infers an evidence-acquisition policy—focused, recall, or contrastive retrieval over a shared visual–speech scene index—together with an evidence-accounting policy that configures the evidence view maintained during exploration. Policy-steered retrieval yields provisional references that multimodal evidence operations convert into observations, while the Reasoner remains free to verify them, re-query using intermediate findings, or inspect regions outside the retrieved set. A temporal evidence ledger consolidates observations into an adaptive, compressed view of temporal location, provenance, coverage, conflicts, verification outcomes, and hypothesis support, exposing missing and unresolved evidence to guide subsequent acquisition; finalization prioritizes verified observations. On Video-MME-v2, VESTA improves average accuracy by 2.7 points over VideoARM and gains across all six reported metrics. On LongVideoBench, EgoSchema, and LVBench under shared query-time models, it improves by 6.9 points on the LongVideoBench long subset and 1.5 on LVBench, and matches VideoARM on EgoSchema.

[235] SMG: Semantic Motion Graph for Monocular Dynamic Gaussian Splatting cs.CVPDF

Haozheng Yu, Xinyu Yang, Rundong Luo, Jennifer J. Sun, Bharath Hariharan

TL;DR: 本文提出了一种名为语义运动图（SMG）的新方法，用于从单目视频中进行动态高斯溅射建模。该方法通过构建一个低秩的语义运动图来结构化地表示场景运动，利用语义一致性先验来约束高斯点的运动，并利用图中可靠的节点指导不可靠节点的运动，从而解决现有方法在遮挡和复杂运动区域容易过拟合的问题。

Details

Motivation: 现有动态高斯溅射方法在建模动态场景时，由于欠约束区域缺乏可靠的规整化信号，容易对训练视图过拟合，并在遮挡或复杂场景运动下失效。

Result: 在具有挑战性的真实世界基准测试中，广泛的实验表明，SMG在单目动态高斯溅射任务上达到了最先进的性能。作者还为此任务引入了一个新的、在自我-外部（ego-exo）设置下收集的多视角数据集用于评估。

Insight: 核心创新点在于利用‘空间邻近且语义相关的区域倾向于表现出一致的动态’这一先验，构建语义运动图来结构化地建模场景运动，并利用图中可靠节点指导不可靠节点，从而为高斯运动提供更强的约束。这为解决动态场景重建中的过拟合和不确定性提供了新思路。

Abstract: We study dynamic Gaussian Splatting from monocular videos. While recent advancements in dynamic Gaussian splatting offer a promising foundation for modeling dynamic scenes, they often overfit to the training views and fail under occlusion or complex scene motion due to the lack of reliable regularization signals in under-constrained regions. We propose Semantic Motion Graph (SMG), a novel approach models the Gaussian motion as the low-rank semantic motion. Our key insight is that the real-world scene motion is often structured by semantic coherence: regions that are spatially close and semantically related tend to exhibit consistent dynamics. To leverage this prior, we construct SMG to model structured motion of the scene. The Gaussian motion is driven by the motion of SMG nodes. We further observe that the uncertainty of Gaussian motion arises from both unreliable off-the-shelf priors and weakly constrained regions during optimization. SMG addresses this by using reliable graph nodes to guide the motion of nearby unreliable nodes. To evaluate dynamic Gaussian splatting under challenging real-world scenarios, we introduce a new multiview dataset collected under an ego-exo setup. Extensive experiments demonstrate that SMG achieves state-of-the-art performance on monocular dynamic Gaussian splatting across challenging real-world benchmarks. Project page: https://smg-gaussian.github.io/.

[236] Analytic Dynamics: Learning Physics-Grounded Representation for Fast Intrinsic Dynamics Inference from Monocular Videos cs.CVPDF

Jailing Lin, Jikuan Zhang, Jianhua Sun

TL;DR: 该论文提出了一种名为Analytic Dynamics的前馈动力学推断框架，旨在从单目视频中快速推断物体的内在动力学。该方法通过引入一个基于物理的中间动力学表示，连接视觉观测与内在动力学，从而避免依赖昂贵的逐场景优化或直接映射导致的捷径问题。

Details

Motivation: 从视觉观测推断物体动力学对于智能体与物理世界交互至关重要，但现有方法存在效率低、可扩展性差或易受外观和几何捷径影响的问题。论文旨在弥合视觉证据与内在动力学之间的根本差距。

Result: 在构建的包含物理状态轨迹、渲染视频和真实材料模型及参数的数据集上进行广泛实验，结果表明Analytic Dynamics能够从单目视频中实现高效、准确且可泛化的动力学推断。

Insight: 创新点在于引入了一个基于物理的中间表示（如位置、位移和变形梯度场），为视觉模型提供了物理基础的归纳偏置，从而引导其捕获与动力学相关的模式，用于材料模型分类和参数回归。这提供了一种将模拟中的特权物理状态知识迁移到视觉推理任务中的有效途径。

Abstract: Inferring object dynamics from visual observations is essential for intelligent agents to reason about and interact with the physical world, yet remains challenging due to the fundamental gap between visual evidence and intrinsic dynamics. Existing methods either rely on costly per-scene optimization, limiting efficiency and scalability, or directly map visual evidence to intrinsic dynamics without intermediate physical abstractions, making them prone to appearance and geometry shortcuts. To bridge this gap, we propose Analytic Dynamics, a feed-forward dynamics inference framework that introduces an intermediate physics-grounded dynamics representation between visual observations and intrinsic dynamics. Specifically, we leverage privileged physical states, including position, displacement, and deformation gradient fields, which are available in simulation, to learn a structured dynamics representation that is difficult to discover from visual observations alone. By aligning visual representations with this space, we equip visual models with a physics-grounded inductive bias, guiding them to capture dynamics-relevant patterns for material model classification and parameter regression. To facilitate this research, we develop a dynamics data generation pipeline and benchmark containing paired physical state trajectories, rendered videos, and ground-truth material models and parameters. Extensive experiments demonstrate that Analytic Dynamics achieves efficient, accurate, and generalizable dynamics inference from monocular videos.

[237] Segmentation of Bovid Dentition Under Imperfect Annotations: A Comparative Study of Convolutional and Attention Models cs.CV | cs.LGPDF

Keith G. Mills, Evan B. Sanders, Gregory J. Matthews, Juliet K. Brophy

TL;DR: 本文对卷积神经网络和视觉Transformer等分割架构进行了比较研究，应用于B.O.V.I.D.数据集（包含高分辨率牛科动物牙齿照片及手工分割掩码）。研究评估了多种预处理和对齐技术以缓解标签不完美问题，发现这些预处理选择对Dice分数和mIoU等定量指标影响有限，但对预测掩码的定性影响显著。

Details

Motivation: 解决语义分割模型在训练数据存在不完美或未对齐的标注掩码时，学习效果受损的问题，特别是在标注并非专为机器学习设计的数据集上。

Result: 在B.O.V.I.D.数据集上评估了多种架构，预处理技术对Dice分数和mIoU等定量指标影响不大，但对预测掩码的视觉质量有实质性影响。

Insight: 针对非完美标注数据的预处理和对齐策略的重要性被凸显，其定性改善可能比定量指标更能反映模型实用性能；比较了卷积与注意力模型在该特定领域的适用性。

Abstract: Semantic segmentation decomposes an image into distinct mask regions corresponding to different object categories, such as people, cars, signs or buildings. Advances in machine learning (ML) have shifted this task away from traditional rule-based heuristics such as edge detection, towards deep neural networks (DNN) that learn to classify pixels directly. However, semantic segmentation DNNs crucially depend on expertly designed mask targets to learn from, and imperfect or misaligned masks can interfere with a model’s ability to learn effectively. This paper presents a comparative study of segmentation architectures, ranging from convolutional backbones to vision transformers, applied to the B.O.V.I.D. dataset, a corpus of high-resolution bovid dental photographs paired with hand-made segmentation masks not originally designed for ML-based training. We evaluate a range of preprocessing and alignment techniques to mitigate the resulting label imperfections. We find that while these preprocessing choices have limited effect on quantitative metrics such as Dice score and mIoU, their qualitative impact on predicted masks is substantial.

[238] Multimodal Shared Latent Representation of Narration, Microscope and iOCT Images for Phase Recognition in Vitreoretinal Surgery cs.CVPDF

Onur Izmitlioglu, Shervin Dehghani, Tarek Ghannoum, Benedikt Schworm, Nassir Navab

TL;DR: 本文提出了一种用于玻璃体视网膜手术阶段识别的多模态框架，通过将手术显微镜视频、术中OCT图像和手术解说三种模态映射到共享的潜在表示空间，解决了多模态数据同步稀缺的挑战。该方法利用显微镜视频作为共享锚点，结合真实显微镜-解说视频和合成的同步显微镜-iOCT数据集，通过对比学习对齐结构先验，并使用双头MS-TCN++模型进行宏观和微观手术阶段的联合预测。

Details

Motivation: 玻璃体视网膜手术的阶段识别是上下文感知计算机辅助反馈的关键，但同步的多模态术中数据（特别是显微镜视图和术中OCT）稀缺，限制了模仿外科医生自然多模态整合的方法。相比之下，手术解说在线资源丰富，能提供丰富的语义监督。先前工作主要探索成对的对比学习，而联合建模所有三种模态的研究尚不充分。

Result: 在真实的玻璃体视网膜手术数据上评估，该框架将宏观阶段识别的平均F1分数从零样本基线的0.38提升至0.53。对于微观阶段（如器械-组织测量）的估计，在合成数据上进行了定量验证，在真实手术中仅进行了定性展示。

Insight: 创新点在于首次将显微镜视图、iOCT B扫描和手术解说统一到一个共享潜在空间用于手术阶段识别，并提出了一个无需完全同步三模态数据集的框架，利用显微镜作为共享锚点来桥接解说和iOCT，通过对比对齐将合成域的结构先验迁移到缺乏iOCT的真实视频中。

Abstract: Surgical phase recognition is key to context-aware computer-assisted feedback in vitreoretinal procedures, yet the scarcity of synchronized multimodal intraoperative data, particularly microscope views and intraoperative OCT, limits approaches that aim to replicate the multimodal integration surgeons perform naturally. Surgical narration, by contrast, is abundantly available online and offers rich semantic supervision. Prior work has mainly explored pairwise contrastive learning (e.g., intraoperative OCT-microscope or microscope-narration), leaving the joint modeling of all three modalities largely unexplored. We introduce a framework that uses microscope views as a shared anchor to bridge surgical narrations and intraoperative OCT (iOCT) without requiring a fully synchronized tri-modal dataset, leveraging real microscope-narration videos and a synthetic dataset of synchronized microscope video and tool-aligned iOCT pairs. Contrastive alignment transfers structural priors from the synthetic domain to real videos lacking iOCT, and a dual-head MS-TCN++ integrates the resulting embeddings for joint macro- and micro-phase prediction. Evaluated on real vitreoretinal surgeries, our framework improves macro-phase recognition over a zero-shot baseline (mean F1 0.38 to 0.53) and provides an exploratory route to estimating fine-grained instrument-tissue measurements that are not directly observable in real microscope video alone; these micro-phase estimates are validated quantitatively on synthetic data and shown only qualitatively on real surgery. To our knowledge, this is the first work to unify microscope view, iOCT B-scans, and surgical narrations in a shared latent space for surgical phase recognition.

[239] LISynSeg: Data-Centric Label-to-Image Synthesis for Cross-Modality Whole-Heart Segmentation cs.CV | eess.IVPDF

Jiacheng Wang, Ivana Isgum, Ipek Oguz

TL;DR: 本文提出了一种名为LISynSeg的数据中心化方法，通过标签到图像的合成来增强基于真实图像的nnU-Net训练，以改善跨模态（CT和MRI）的全心脏分割性能。该方法利用经过校准的对比度和采集扰动从心脏标签图生成合成体积，并与真实图像混合以保留胸部上下文，从而在不改变分割架构的情况下提升模型对异构心脏数据的泛化能力。

Details

Motivation: 解决全心脏分割在CT和MRI中因采集偏移和异构心脏标注而受影响的问题，探索在保持分割架构不变的情况下，通过改进数据增强和训练监督策略来提升跨模态分割性能。

Result: 在CARE Whole-Heart基准测试中，仅使用合成数据训练的性能低于真实图像nnU-Net基线，而经过校准的真实-合成混合训练则改善了跨模态分割，其中MRI的改进幅度大于CT。

Insight: 创新点在于提出了一种数据中心化的标签到图像合成方法，通过校准的扰动生成合成图像并混合真实数据，以增强模型对异构数据的鲁棒性；客观来看，该方法展示了在不改变模型架构的情况下，通过优化训练数据策略（如合成数据生成和部分监督）可以有效提升医学图像分割的跨模态性能。

Abstract: Whole-heart segmentation (WHS) in computed tomography (CT) and magnetic resonance imaging (MRI) is affected by acquisition shifts and heterogeneous cardiac annotations. Existing WHS systems combine architectural design, transfer learning, and generic spatial or intensity augmentation. We investigate whether changes to data augmentation and training supervision can improve cross-modality WHS while the segmentation architecture is held constant. We present LISynSeg, a data-centric approach that augments real-image nnU-Net training with label-to-image synthesis. Synthetic volumes are generated from cardiac label maps using contrast and acquisition perturbations calibrated to the training cohort, then mixed with real images to retain thoracic context absent from the labels (and thus the synthesized images). We model cardiac label variation through controlled changes in myocardial wall thickness and partial supervision of uncertain vessel endpoints. On the CARE Whole-Heart benchmark, synthetic-only training performs worse than the real-image nnU-Net baseline, whereas calibrated real-synthetic training improves cross-modality segmentation without changing the architecture; the improvement is larger for MRI than for CT. The results show that modifying the training data strategy can benefit model development for heterogeneous cardiac data. Code and trained weights will be released at https://github.com/MedICL-VU/Care26_LISynSeg.

[240] Real-Time Video Anomaly Detection Using YOLO Pose Estimation and CLIP-Based Semantic Scoring cs.CV | cs.AI | eess.IVPDF

Vanodhya G. Warnasooriya, Amir Hajian, Watchara Ruangsang, Supavadee Aramvith

TL;DR: 本文提出了一种用于实时视频异常检测的轻量级两阶段框架。第一阶段使用YOLO v11n-pose单次前向传播检测行人并提取17个骨骼关键点；第二阶段通过CLIP ViT-B/32编码裁剪出的行人区域，并与预定义的异常行为文本描述计算余弦相似度。该架构无需光流、独立姿态估计器和基于密度的评分模块。

Details

Motivation: 旨在设计一个轻量、实时的视频异常检测系统，以解决传统方法依赖复杂模块（如光流、独立姿态估计器）导致计算开销大、难以实时部署的问题。

Result: 在CUHK Avenue、ShanghaiTech Campus和朱拉隆功大学自定义室内数据集上，在NVIDIA Titan XP GPU上实现了约51 FPS的端到端吞吐量，比多特征基线加速3.36倍，同时帧级AUROC值分别达到89.26%、70.26%和84.13%。

Insight: 主要创新点在于将YOLO姿态估计与CLIP语义评分高效结合，构建了一个无需光流等额外模块的端到端实时检测框架。其利用CLIP的图文对齐能力进行语义异常评分，是一种新颖且轻量的设计思路。

Abstract: We propose a lightweight two-stage framework for real-time video anomaly detection. The first stage employs YOLO v11n-pose to detect persons and extract seventeen skeletal keypoints in a single forward pass. The second stage encodes each cropped person region through CLIP ViT-B/32 and computes cosine similarity against predefined textual descriptions of anomalous behaviors. This architecture eliminates the need for optical flow, standalone pose estimators, and density-based scoring modules. Experiments on CUHK Avenue, ShanghaiTech Campus, and a custom indoor dataset collected at Chulalongkorn University demonstrate an end-to-end throughput of approximately 51 FPS on an NVIDIA Titan XP GPU, a 3.36x speedup over the multi-feature baseline, while maintaining frame-level AUROC values of 89.26%, 70.26%, and 84.13%, respectively.

[241] VeriCam: A Verification Baseline for the Classification of Unknown Data cs.CVPDF

Lucas Wojcik, Gabriel E. Lima, Sergio M. Silva, Eduil Nascimento, David Menotti

TL;DR: 本文提出了VeriCam，一个用于未知数据分类的验证基准流程。该方法利用为验证任务训练的视觉模型提取细粒度特征，构建关系图表示类别关系，并采用两种图聚类算法进行未知类别识别。在真实交通监控数据集LPLCv2上验证了其有效性，并解决了数据采集设备偏差问题。

Details

Motivation: 当前基础模型在零样本分类中缺乏对细粒度、细节驱动的类别区分能力，难以满足现实任务需求。本文旨在填补这一空白，通过验证任务学习高度专业化的特征，实现对未见数据中未知类别的分类。

Result: 在LPLCv2数据集上，VeriCam在跨设备场景下，验证基线达到93.45的F1分数，聚类步骤获得80.13的V-Measure分数，有效解决了数据采集设备偏差问题，为下游任务（如车牌OCR）提供了公平的基准。

Insight: 创新点在于将验证任务的特征表示能力用于未知类别分类，通过构建关系图和图聚类实现标签无关的类别发现。客观分析认为，该方法通过解决设备偏差问题，为现实世界数据集的公平评估提供了新思路，尤其在细粒度识别任务中具有借鉴价值。

Abstract: The advent of foundation models have enabled a new era in zero-shot classification. Yet, key challenges persist. Despite their impressive generalization power that leverages the immense pre-training knowledge, both foundation models for image and text as well as vision-text hybrids lack the representational power needed for fine-grained, minutiae-based class separation that some real-world tasks require. To address the current gaps in the literature, we propose VeriCam, a pipeline designed to learn highly specialized features that enable classification of unknown classes in unseen data. VeriCam works by leveraging the representation power of image models trained for the verification task, where the model develops an intricate feature space that incorporates fine-grained details. By training a model to discriminate between pairs of images from the same and different classes, a relational graph is constructed, representing the class relationships between data points. We then present two approaches for graph clustering: a naive algorithm and a specific setup for the Leiden graph clustering algorithm. The pipeline is validated on the LPLCv2 dataset, which comprises real-world traffic surveillance images. We show that the dataset carries an inherent capture device bias that is posed as a generalization challenge for downstream License Plate recognition tasks such as OCR. As such, we dynamically identify capture devices with a label-agnostic approach, enabling the construction of a fair and unbiased benchmark. In the cross-device scenario, our pipeline reaches an F1-Score of 93.45 in the verification baseline and a V-Measure score of 80.13 in the clustering step. All code is publicly available at https://github.com/lmlwojcik/VeriCam

[242] BLARM: Animating 3D Objects from Video via Blending Latent Rigid Motion Primitives cs.CVPDF

Pradyumn Goyal, Yizhak Ben-Shabat, Hsueh-Ti Derek Liu, Haomiao Jiang, Snehasish Mukherjee

TL;DR: BLARM是一种前馈方法，用于从单目视频驱动3D网格动画。它通过一组紧凑的、时变的刚性运动基元和时不变的蒙皮权重来表示动画，无需依赖显式的骨骼或直接回归高维顶点运动。该方法利用几何导出的变形潜在变量与视频特征进行因子化时空注意力交互，解码出由预测蒙皮权重混合的刚性变换，从而生成时间一致且准确的动画。

Details

Motivation: 解决从单目视频驱动3D网格动画的问题，目标是生成运动与视频一致且时间连贯的动画网格，同时避免对显式绑定（如骨骼、笼状结构、蒙皮权重或绑定标注）的依赖。

Result: 通过轨迹重建、熵正则化和运动感知对比学习进行训练，BLARM能够生成准确且时间稳定的动画，并从单目视频中恢复出紧凑、可解释的运动结构。

Insight: 核心创新在于使用一组学习的时变刚性运动基元和时不变顶点-基元蒙皮权重来紧凑地表示动画，这构成了一个低维变形空间。方法结合了因子化时空注意力来融合视频与几何特征，并通过混合刚性变换进行解码，实现了无需显式绑定结构的视频驱动动画生成。

Abstract: We introduce BLARM, a feed-forward method for video-driven 3D mesh animation. Given a monocular video and a static object mesh, BLARM predicts a temporally coherent animated mesh whose motion follows the video. Rather than relying on explicit rigs or directly regressing high-dimensional vertex motion, we represent animation using a compact set of learned, time-varying rigid motion components and time-invariant vertex-to-component skinning weights. This yields a low-dimensional deformation space without requiring skeletons, cages, skinning weights, or rig annotations. Our architecture conditions geometry-derived deformation latents on video features through factorized spatial-temporal attention, then decodes rigid transformations blended by predicted skinning weights. Trained with trajectory reconstruction, entropy regularization, and motion-aware contrastive learning, BLARM produces accurate and temporally stable animations while recovering compact, interpretable motion structure from monocular video.

[243] DreamX-Creator: Democratizing Native Audio-Video Generation at 2K Resolution cs.CV | cs.SDPDF

Jiashu Zhu, Yanhao Zheng, Ruitian Tian, Rujing Dang, Shen Zhang

TL;DR: DreamX-Creator 1.0是一个紧凑的原生联合音频-视频生成系统，基于一个7B参数的生成器，能够从第一帧图像和文本提示生成同步的2K分辨率音视频内容。该系统通过门控跨模态注意力机制耦合音频和视频流，并采用渐进式联合训练、音频-视频强化学习以及自回归单步2K细化流程来实现高质量输出。

Details

Motivation: 现有的视频生成器通常忽略音频或在单独阶段合成音频，限制了视觉动态与声学事件的相互建模，因此需要开发一个能够原生联合生成同步音视频的系统。

Result: DreamX-Creator 1.0在性能上与最先进的开源系统竞争，实现了原生、同步的音频-视频生成，并发布了紧凑的7B生成器和2K细化器。

Insight: 创新点包括门控跨模态注意力机制（通过令牌和头级输出门调制跨模态注意力头输出）、统一的音频-视频数据系统、渐进式联合训练、模态感知多模态反馈的强化学习，以及将双向多步教师模型适配为自回归多步细化器并蒸馏为单步去噪学生的2K细化流程，这些设计有助于推动统一音视频生成建模的研究民主化。

Abstract: Recent video generators often omit audio or synthesize it in a separate stage, limiting reciprocal modeling of visual dynamics and acoustic events. We present DreamX-Creator 1.0, a compact native joint audio-video generation system centered on a 7B generator. Conditioned on a first frame and a text prompt, the generator jointly denoises modality-specialized audio and video streams. The streams are processed independently in the first half of the network and coupled in the latter half through Gated Cross-Modal Attention, whose token- and head-wise output gates modulate each active cross-modal attention-head output. A unified Audio-Video Data System constructs and filters temporally coherent clips, produces structured multimodal annotations, and organizes clips into capability-oriented data pools. Progressive Joint Training comprises two audio-video pre-training stages followed by High-Quality Finetuning. Audio-Video Reinforcement Learning further post-trains the generator with Modality-Aware Multimodal Feedback that routes video-, audio-, and cross-modal feedback to the corresponding streams. For high-resolution output, our Autoregressive 1-Step 2K Refinement pipeline adapts a bidirectional multi-step teacher into an autoregressive multi-step refiner and distills it into a student requiring one denoising evaluation per temporal chunk. Overall, DreamX-Creator 1.0 achieves native, synchronized audio-video generation with performance competitive with state-of-the-art open-source systems. By releasing our compact 7B generator and 2K Refiner, we seek to democratize native audio-video generation and provide an accessible foundation for future research in unified audio-video generative modeling.

cs.LG [Back]

[244] The Halt Vector: Internalizing a Causal Steering Intervention for Efficient Reasoning cs.LG | cs.AI | cs.CLPDF

Dylan Jayabahu, Tinuade Adeleke

TL;DR: 本文提出了一种名为’停止向量’的方法，用于内部化因果可解释性干预，以高效地减少推理模型（如DeepSeek-R1-Distill-Qwen-7B）在已知答案后不必要的长链思考。该方法通过重构特定层的激活，在保持精度的前提下，显著缩短了推理长度，并解决了非终止问题。

Details

Motivation: 现有推理模型在得出答案后仍会继续生成冗长的思维链，全局长度惩罚无法有效移除这种冗余，且不同问题所需的可移除冗余量不同，因此需要一种更精细的方法来控制推理长度。

Result: 在五个未见过的基准测试上，该方法在保持准确率的同时，移除了约四分之一的思考长度，其削减量与每个问题自身的可移除冗余量相关性达0.70，并修复了随难度增长的非终止问题。

Insight: 创新点在于将因果可解释性发现（层18的均值差方向，即’停止向量’）内部化到模型权重中，并通过重构整个被干预的激活（而非仅最大化标量投影）来避免破坏下游维度，从而实现对推理长度的有效、精准控制。

Abstract: Reasoning models do not stop when they know the answer. On DeepSeek-R1-Distill-Qwen-7B the chain of thought runs about twice as long as the model’s own answer probability takes to settle, and how much of that excess is removable varies from problem to problem, so a global length penalty cannot take it out. We take it out by internalizing a causal interpretability finding into the weights. The mechanism is a halt vector: a difference-of-means direction at layer 18 of this model whose steering strength controls how long it thinks, while a replicated value axis does nothing. Installing that intervention in the weights is harder than it looks. Maximizing the scalar projection onto the direction corrupts the off-axis dimensions a frozen downstream reader depends on, and generation gets longer instead of shorter; what works is reconstructing the whole steered activation with those dimensions pinned to their natural values. Fit from 24 problems and no reinforcement learning, the halt removes about a quarter of the thinking at held accuracy across five unseen benchmarks, and the cut tracks each problem’s own removable slack at 0.70. It also closes a non-termination pathology that grows with difficulty and that a decoding-time confidence hook makes worse. We do not claim to beat a well-tuned length penalty or decoding-time early exit on the raw trade-off; the contribution is how the halt is obtained.

[245] Locked at the Entrance, Open Inside: Where RLVR Narrows the Solution Space cs.LG | cs.AI | cs.CLPDF

Qiancheng Zhou, Ruizhe Li

TL;DR: 本文研究了强化学习与可验证奖励（RLVR）在提升单样本准确率（pass@1）的同时，如何导致策略解空间收缩，并具体定位了这种收缩发生在推理轨迹的起始阶段（即‘入口’），而非后续计算执行过程。通过分析Countdown任务和多个数学基准测试，发现解覆盖范围大幅下降，且主要集中在第一个算术操作之前。研究还表明，针对入口的干预措施可以有效恢复解多样性。

Details

Motivation: 动机在于理解RLVR在提升推理任务单样本准确率时，为何会伴随解空间多样性的显著下降，并探究这种收缩具体发生在推理过程的哪个环节——是策略无法访问有效的解族，还是无法执行已启动的计算。

Result: 在Qwen2.5-3B和Qwen2.5-3B-Instruct模型上的实验表明，RLVR训练后解覆盖范围下降高达67%。收缩主要集中在推理入口（第一个算术操作前），该处的逐词元似然偏移是下游推理阶段的11-16倍。针对入口的干预（如后期层参数插值）能将解覆盖范围提升37%且不损失pass@1。在六个数学基准测试和7B/14B模型上均观察到早期步熵崩溃现象。

Insight: 核心创新点在于将解空间收缩精确定位到推理轨迹的‘入口’（起始决策点），并证明替代解方案本身是可执行的，只是不再被策略启动。关键洞见是：推理广度的丧失发生在‘门口’而非‘房间内’。这提示RLVR的多样性损失并非优化推理的必然副产品，通过针对性干预（如参数插值）或分阶段训练流程（如SFT–DPO–RLVR）可以缓解此问题。

Abstract: Reinforcement learning with verifiable rewards (RLVR) substantially improves single-sample accuracy (pass@1) but causes the policy’s solution space to contract, diminishing the returns of test-time scaling. In this work, we investigate where inside a reasoning trajectory this breadth is lost: does the policy fail to access a valid solution family, or does it fail to execute computation once initiated? To disentangle access from execution, we analyze the Countdown task, whose solution space can be exhaustively enumerated into discrete entrance families defined by the first operand and operator, across PPO on Qwen2.5-3B and GRPO on Qwen2.5-3B-Instruct. Across both training setups, solution coverage falls by up to 67%, halving even on problems solved across all checkpoints. We show that this contraction is heavily concentrated at the entrance: per-token likelihood shifts are 11x–16x larger prior to the first arithmetic operation than during downstream reasoning. Supplying only an unselected entrance prefix restores completion rates in low-access families by over an order of magnitude (0.018 -> 0.212 under PPO), demonstrating that alternative solutions remain executable but are no longer initiated. Guided by this localization, we find that while surface prompting fails to recover diversity, entrance-targeted interventions succeed: late-layer parameter interpolation with early checkpoints increases solution coverage by 37% at no loss in pass@1. Finally, we show that early-step entropy collapse recurs across six math benchmarks with 7B and 14B models, but is not an inevitable byproduct of reasoning optimization: an SFT baseline preserves more than double the coverage, and staged SFT–DPO–RLVR pipelines retain early-step entropy. In summary, reasoning breadth is lost at the door, not inside the room. Code: https://github.com/ershiyidian/early-branch-locking.

[246] Learning Where Outcomes Change:Credit-Addressable Reasoning for Multimodal Geometry cs.LG | cs.CLPDF

Jiani Guo, Junjie Wang, Jie Wu, Pengxiang Zhao, Dongdong Zhang

TL;DR: 本文提出了一种用于多模态几何推理的信用可寻址推理框架，旨在解决现有方法中决策过程不透明和强化学习信号分配不精确的问题。核心创新包括Code-CoT（一种将视觉关系表示为可执行代码的推理链）和CE-GRPO（一种基于事件边界和熵进行局部信用分配的优化方法）。

Details

Motivation: 现有方法（如自由形式推理轨迹和轨迹级强化学习）在多步几何推理中，难以精确追踪和归因影响最终答案的关键决策，导致学习信号模糊和优化效率低下。

Result: 在九个几何基准测试上，CE-GRPO取得了76.04的平均准确率，分别比Qwen3-VL-8B和轨迹级GRPO高出8.09和3.43个百分点，并且在推理步骤增多时优势更加明显。

Insight: 论文的核心创新在于将推理过程的结构化表示（Code-CoT的可寻址代码单元）与优化过程（CE-GRPO的局部优势计算）协同设计，使得学习信号能够精确分配到语义决策单元，这为处理长链、依赖重的多模态推理任务提供了有效的表示-优化协同设计范式。

Abstract: Multimodal geometry reasoning requires VLMs to extract precise visual relations and preserve them through multi-step deduction. Existing free-form traces obscure the decisions that determine the answer, and trajectory-level reinforcement learning distributes a single terminal signal across the entire response. We introduce credit-addressable reasoning, in which the semantic units exposed during inference also define where learning compares alternatives and assigns credit. We instantiate this principle with Code-CoT, which retains the diagram, represents visual relations as line-addressable executable code, and organizes reasoning into typed events, and CE-GRPO, which selects event boundaries using structural priors and type-normalized entropy, samples complete continuations from shared prefixes, and converts outcome differences into localized advantages. Across nine geometry benchmarks, CE-GRPO achieves an average accuracy of 76.04, outperforming Qwen3-VL-8B and trajectory-level GRPO by $8.09$ and 3.43 points, respectively. Its relative advantage increases with the number of intermediate events, demonstrating the value of representation–optimization co-design for long, dependency-heavy multimodal reasoning.

[247] PLC-DPO: Posterior Label Correction in Noisy and Ambiguous Preference Optimization cs.LG | cs.CLPDF

Boryeong Cho, Sumyeong Ahn, Se-Young Yun

TL;DR: 本文提出PLC-DPO方法，以解决直接偏好优化（DPO）在现实噪声和模糊偏好数据中性能下降的问题。该方法通过校准的策略-参考模型差值作为在线证据，将每个偏好对的路由信号分类为干净、翻转或平局情况，从而主动校正监督方向与强度，而非简单过滤可疑样本。

Details

Motivation: 现实世界中的偏好数据常包含不可靠、反转、微弱或模糊的标签，这违反了DPO假设所有观察到的偏好都可靠的强假设，导致有害的策略更新。

Result: 在涵盖57个数据集-模型-基准测试单元的大规模评估中，PLC-DPO取得了最佳的平均胜率（60.5%），优于次优方法（55.5%）。注入噪声测试、平局压力测试、人类分歧分析和自确认诊断进一步表明其路由机制稳定，并能有效区分翻转偏好与弱方向性偏好对。

Insight: 核心创新在于将噪声偏好学习重新定义为主动校正监督信号的方向和强度，而非被动过滤，并利用校准的策略-参考模型差值作为动态路由的在线证据。这为处理现实世界中不完美、有噪声的偏好数据提供了一种稳健的优化框架。

Abstract: Direct Preference Optimization (DPO) simplifies alignment through pairwise comparisons but assumes all observed preferences are reliable. Real data often violates this assumption, leading to reversed, weak, or ambiguous labels that cause harmful policy updates. To address this, we propose Posterior Label Correction DPO (PLC-DPO) to robustly optimize preferences by routing each pair’s training signal as a clean, flip, or tie case. The key idea is to use the calibrated policy-reference margin as online evidence to take appropriate correction actions. This reframes noisy preference learning as actively correcting supervision direction and strength rather than merely filtering suspicious examples. Across 57 dataset-model-benchmark cells, PLC-DPO obtains the best mean win rate against DPO (60.5 vs. 55.5 for the next-best method). Injected-noise and tie stress tests, human disagreement analysis, and self-confirmation diagnostics further show that the routing remains stable and distinguishes flipped from weakly directional pairs.

[248] S3C-LLM: Skill-Code Guided Agentic Language Models for Spectrum-to-Structure Elucidation cs.LG | cs.CLPDF

Xuanle Zhao, Xinyuan Cai, Xiang Cheng, Bo Xu

TL;DR: 这篇论文提出了S3C-LLM，一种用于谱图到结构解析的、由技能和代码引导的智能体大语言模型。它不直接预测分子SMILES，而是通过检索光谱学特定技能、执行分析代码来实例化这些技能，并整合峰值证据和分子式约束，最后生成结构。

Details

Motivation: 现有基于LLM的谱图结构解析方法大多将其视为直接的谱图到SMILES生成任务，未能显式建模光谱学家实际的分析工作流程（如诊断峰解释、片段推理、分子式约束和化学一致性检查）。

Result: 在多个基准测试上的实验表明，S3C-LLM在多种谱图类型上持续优于当前的通用LLM和光谱专用模型，同时其训练语料库规模不到SpectraLLM的十分之一。

Insight: 论文的创新点在于：1）提出了一个由技能和代码引导的智能体范式，将结构解析分解为可执行的技能步骤；2）贡献了一个自演进的光谱技能库、一个思维增强的技能-代码轨迹构建流程；3）采用了一个包含监督微调和步骤级强化学习的两阶段训练策略。

Abstract: Spectroscopic structure elucidation is central to molecular analysis, but recent Large Language Model (LLM)-based methods mostly formulate it as direct spectrum-to-SMILES generation. Although this paradigm can leverage paired spectral data, it does not explicitly model the analytical workflow used by spectroscopists, such as diagnostic peak interpretation, fragment reasoning, formula constraints, and chemical consistency checking. In this paper, we introduce S3C-LLM, a skill-guided and code-grounded agentic LLM for spectrum-to-structure elucidation. Rather than directly predicting a molecule, S3C-LLM retrieves modality-specific spectroscopy skills, executes analysis code to instantiate these skills on the input spectra, and integrates the resulting peak-level evidence and formula constraints before generating SMILES. Specifically, we contribute a self-evolving spectroscopy skill library, a thinking-augmented skill-code trajectory construction pipeline, and a two-stage training strategy that teaches Qwen3-4B through supervised fine-tuning (SFT) followed by our proposed step-level reinforcement learning (RL). Experiments on diverse benchmarks show that S3C-LLM consistently outperforms current general LLMs and spectrum-specific models across spectra, while using less than 1/10th of SpectraLLM’s training corpus.

[249] Does On-Policy Distillation Really Distill? From Noisy Teacher to Self-Improvement cs.LG | cs.CLPDF

Yi Ding, Ruqi Zhang

TL;DR: 本文研究了策略蒸馏（OPD）的有效性，发现其教师监督存在显著噪声且学生策略对此不敏感，进而揭示了OPD的增益主要源于抑制低对数概率令牌而非教师蒸馏。基于此，作者提出了无需监督的策略自适应方法（OPSA），通过熵自适应负优势信号实现性能提升。

Details

Motivation: 策略蒸馏（OPD）使用密集令牌级监督替代稀疏结果级优势，但其教师对学生生成轨迹的评分本质上是离策略的，导致监督可靠性存疑，需要探究其实际作用机制。

Result: 在AIME24基准上，OPSA相比基础模型Qwen3-1.7B将Avg@32提升了35.41分（相对增益263%），并在三个基准上将Pass@32提升了一倍以上；同时，OPSA在AIME24的Avg@32上比OPD高出16.77分，跨模型和任务的实验验证了其有效性和泛化性。

Insight: 创新点在于揭示了OPD的核心机制是抑制低概率令牌而非依赖教师蒸馏，并据此提出无监督的OPSA方法，通过熵自适应负优势动态分配学习信号，实现了更高效的自适应优化。

Abstract: On-policy distillation (OPD) offers dense token-level supervision as an alternative to the sparse outcome-level advantages of reinforcement learning with verifiable rewards (RLVR). However, the teacher scores student-generated trajectories that are inherently off-policy for it, so the reliability of its supervision, and hence the source of the student’s improvement, remains unclear. We quantitatively analyze teacher supervision during OPD training and find substantial noise whose prevalence increases with teacher scale. Surprisingly, the student policy is insensitive to such noise, converging to comparable performance regardless of whether noisy supervision is retained or removed. Does OPD distill at all? By analyzing what drives its gains, we find that learning concentrates on low log-probability tokens, and using a single fixed negative advantage matches the performance of teacher-provided ones. This suggests that OPD works largely by suppressing low log-probability tokens, which requires no teacher. These findings motivate On-Policy Self-Adaptation (OPSA), a supervision-free method using entropy-adaptive negative advantages. It assigns stronger learning signals to high-entropy positions, suppressing tail tokens, and evenly redistributing probability mass among head tokens. Compared with the base \texttt{Qwen3-1.7B}, OPSA improves Avg@32 by 35.41 points on AIME24, corresponding to a 263% relative gain, and more than doubles Pass@32 across all three benchmarks. It also outperforms OPD by 16.77 points in Avg@32 on AIME24. Extensive experiments and analyses across model families and tasks further demonstrate its effectiveness and generalizability.

[250] One Policy Is Enough: Single-Agent Reinforcement Learning Outperforms Tree Search for Chemistry Tool Learning cs.LG | cs.CLPDF

Armin Dariani, Sifan Wu, Bang Liu, Entao Yang

TL;DR: 本文提出了一种用于化学工具学习的单智能体强化学习方法，替代了之前基于分层进化蒙特卡洛树搜索的复杂系统。该方法通过一个单一的策略模型，以从左到右的生成方式交织推理、工具调用和结果返回，并使用监督预热和结果级强化学习进行训练。在ChemToolBench基准测试中，该方法在多个骨干模型上显著提升了工具选择和结果返回的F1分数，且每次问题仅需一次模型调用，计算成本远低于搜索方法。

Details

Motivation: 解决化学问题需要精确计算和数据库查询，这超出了语言模型自身参数的能力，因此必须借助外部工具。现有的CheMatAgent系统采用分层进化MCTS，结构复杂，需要独立的策略和执行模型以及两个学习到的评判器。本文旨在证明一个单一的策略模型就足以有效解决工具选择、参数填充和调用链构建这三部分问题。

Result: 在ChemToolBench多工具综合化学基准上，相比之前最强的搜索配置，该方法在Qwen-2.5-7B骨干模型上将Tool F1提升了5.5%，Return F1提升了9.6%；在Llama-3.1-8B骨干模型上分别提升了3.7%和3.9%。同时，在Qwen-2.5-7B上取得了最高的答案通过率。该方法每次问题仅需一次模型调用，而搜索方法的成本随搜索树增长。

Insight: 主要创新点在于用一个单一的端到端策略模型取代了复杂的多组件搜索架构，简化了系统设计。训练方法结合了监督预热和直接基于黄金调用链的程序化奖励进行的结果级强化学习，消除了对学习型评判器的依赖，使训练循环更简洁高效。这证明了在工具学习任务中，简单的单智能体方法可以超越复杂的搜索策略。

Abstract: Chemistry questions often demand exact computation and database lookups that a language model cannot supply from its parameters, so it must reach for external tools. Tool use here is a three-part problem: select the right tool from a large pool, fill it with correctly typed arguments, and chain calls so that each consumes the outputs of the last. CheMatAgent, a previously published system, addresses this with hierarchical evolutionary MCTS: separate policy and execution models searching tool-call trees under two learned critics, one regressed partly onto GPT-assigned scores. We show that a single policy suffices. Our model interleaves reasoning, tool calls, and returns in one left-to-right generation, trained by a supervised warm-up and then outcome-level reinforcement learning against a programmatic reward read directly off the gold call chain, which leaves no learned critic and no judge in the training loop. On ChemToolBench multiple-tool comprehensive chemistry, on both backbones CheMatAgent use, we improve Tool F1 by 5.5% and Return F1 by 9.6% on Qwen-2.5-7B, and by 3.7% and 3.9% on Llama-3.1-8B, compared with their strongest search configuration, at one model invocation per question, against a search whose cost grows with the tree; we also lead answer Pass Rate on Qwen-2.5-7B.

[251] A Model with No Head and Many Thoughts cs.LG | cs.CLPDF

Nikita Koriagin, Yaroslav Aksenov, George Bredis, Gleb Gerasimov, Nikita Balagansky

TL;DR: 本文提出了一种名为Soft Latent Thinking的方法，用于替代大型语言模型在推理过程中计算成本高昂的词汇表头投影。该方法通过一个轻量级投影器在嵌入空间中进行自回归推理，使推理步骤保持连续而非离散化。实验表明，该方法在减少每步计算量的同时，提高了多项推理任务的性能。

Details

Motivation: 解决传统大型语言模型解码时，每一步都需要通过庞大的词汇表头进行投影所带来的高计算成本问题，并突破推理过程必须通过离散令牌表达的局限。

Result: 在DeepSeek-Qwen-1.5B和LLaMA-3.2-3B模型上的实验表明，该方法在所有k值上持续提升了pass@k性能，并在思维链推理中减少了每步计算量。在所有软思考方法中，该方法取得了最高的pass@32结果。

Insight: 核心创新在于用轻量级投影器替代LM头，在连续的嵌入空间而非离散的令牌空间进行自回归推理，这证明了有效的推理可以在连续空间中完成，无需生成离散令牌。

Abstract: Large language models decode by projecting hidden states through a large vocabulary head at every step. This operation is computationally costly and forces all reasoning to be expressed in discrete tokens. We introduce Soft Latent Thinking, a method that replaces the LM head during reasoning with a lightweight projector, enabling autoregressive rollout in embedding space where reasoning steps remain continuous rather than tokenized. Experiments on DeepSeek-Qwen-1.5B and LLaMA-3.2-3B show that Soft Latent Thinking consistently improves pass@k across all k while reducing per-step compute during chain-of-thought. Our method achieves the highest pass@32 among all soft-thinking approaches, demonstrating that effective reasoning can be carried out in continuous space without discrete token generation.

[252] Does Latent Planning Survive Point Clouds? Action-Conditioned JEPA World Models for Geometric Observations cs.LG | cs.AI | cs.CVPDF

Fabio F. Oberweger, Michael Schwingshackl

TL;DR: 该论文研究了将JEPA世界模型从图像扩展到点云几何观测的可行性。通过将三种经典的JEPA设计（冻结编码器、分布先验和动作敏感模型）应用于点云数据，并在稳定世界模型基准上进行重新评估，发现潜在规划在几何观测中依然有效。特别是，分布先验模型在统计上与其重新评估的图像对应物等效，而动作敏感模型在几何移动最多的场景中取得了最佳结果。

Details

Motivation: JEPA世界模型主要基于图像构建，但点云数据具有稀疏、无序和自遮挡的特性，且场景中移动点比例极低（0.3-15%），这可能导致潜在预测的慢特征最优解与3D自监督的几何捷径相互影响。论文旨在探究潜在规划是否能在几何观测中存活，并解决点云带来的独特挑战。

Result: 在稳定世界模型基准上的实验表明，所有三种JEPA模型在点云上规划均未崩溃。分布先验模型在统计上与重新评估的图像基线模型等效，而动作敏感模型在几何移动最多的受控比较中取得了最强结果。模型能抵抗训练中未见的重度点云丢弃，但对范围噪声敏感。

Insight: 创新点在于首次将JEPA世界模型系统地扩展到点云观测，并验证了潜在规划的有效性。关键发现是对象位置几乎可完美线性解码，且注意力集中在少数移动点上。几何观测使得3D目标命令成为自然的目标接口，无需目标观测即可构建目标潜在表示，且不影响成功率。

Abstract: JEPA world models make latent-space planning a practical route to control, but they are built almost exclusively on images. Whether latent prediction survives geometric observations is unclear: point clouds are sparse, unordered, and self-occluded, and with 0.3-15% of scene points moving, the slow-feature optimum of latent prediction compounds with the geometric shortcut of 3D self-supervision. We lift three canonical JEPA designs to point clouds, frozen-encoder, distribution-prior, and action-sensitive, and re-sense the stable-worldmodel benchmark so that only the observation differs from the image baselines. All three plan without collapse: the distribution-prior model is statistically equivalent to its re-evaluated image counterpart on every benchmark, and the action-sensitive model attains the strongest result in our controlled comparison where the most geometry moves. Probing explains why: object positions are almost perfectly linearly decodable and attention falls on the few moving points. Planning withstands heavy dropout never seen in training, though range noise defeats the thinnest scene. Geometry finally makes a commanded 3D target a natural goal interface: we construct the goal latent from the target and the current latent, at no cost in success rate, without a goal observation.

cs.AI [Back]

[253] EmoLASP: Emotion Recognition with Language Models and Answer Set Programming cs.AI | cs.CLPDF

Thao Le, Michael Thielscher

TL;DR: EmoLASP是一个结合语言模型与答案集编程（ASP）进行声明式推理的框架，用于预测对话中的VAD（效价-唤醒-支配）情感得分。实验表明，该框架在IEMOCAP基准数据集上，使用多种开源LLM和PLM时，相比单独使用语言模型能提升预测性能，尤其对无需微调的提示型LLM效果显著。

Details

Motivation: 解决对话情感识别中语言模型不稳定、微调成本高以及长对话历史提示开销大的问题，通过引入声明式推理来增强预测一致性和降低计算成本。

Result: 在IEMOCAP数据集上，EmoLASP相比单独使用语言模型（包括3B-120B的LLM和BERT、RoBERTa等PLM）提高了预测性能，对提示型LLM提升最大，但对已微调且包含对话历史的PLM增益有限。

Insight: 创新点在于将语言模型与答案集编程结合，利用声明式推理确保情感预测一致性，并减少微调和长对话提示的成本；客观上，这展示了推理方法在增强模型鲁棒性和降低计算开销方面的潜力。

Abstract: Emotion recognition in conversations is increasingly tackled with language models, but these models can be unstable and expensive to fine-tune or to prompt with long dialogue histories. We propose EmoLASP, a framework that combines a language model with declarative reasoning via Answer Set Programming (ASP) to predict VAD scores (Valence-Arousal-Dominance) in conversations. Experiments on a widely used benchmark dataset (IEMOCAP) across six open-source LLMs (3B-120B) and two PLMs (BERT, RoBERTa) show that EmoLASP improves prediction performance compared to using the language model alone, even when the LLMs/PLMs are given no dialogue history in their prompts or input vectors. The gains are largest for prompt-only LLMs, which EmoLASP uses without any fine-tuning. However, for fine-tuned PLMs, the reasoner adds little once dialogue history is available. EmoLASP’s LLM pipeline demonstrates the potential advantages of using a reasoning approach to ensure emotion prediction consistency and to reduce both the cost of fine-tuning and the cost of prompting with long dialogue histories.

[254] Call Neighbours Yourself: Graph Walks with Destination-Conditioned On-Policy Self-Distillation cs.AI | cs.CLPDF

Yilun Liu, Boyu Luo, Yanran Tang, Ruihong Qiu, Zi Huang

TL;DR: 本文提出了一种名为Call Neighbours Yourself (CNY)的框架，用于增强大语言模型在文本属性图上的推理能力。该框架允许模型在推理过程中主动探索图邻域，通过拓扑约束的图游走动作来动态获取证据，而非依赖预定义的静态上下文。为了解决邻域探索中的延迟奖励问题，论文引入了目标条件策略自蒸馏方法，将事后评估转化为动作级别的训练信号。

Details

Motivation: 现有方法在生成前固定可访问的邻居集合，导致推理基于静态上下文，无法在推理过程中获取缺失的证据。作者认为邻居选择本身应是推理过程的一部分，因此需要一种能让LLM主动探索图结构以动态收集信息的方法。

Result: 在统一的原始文本设置下，于标准TAG推理基准测试中，CNY consistently outperforms fixed-context post-training baselines。此外，学习到的探索策略能够迁移到未见过的图以及训练中未遇到的图级任务上。

Insight: 核心创新点在于将邻居选择整合为推理过程的一部分，通过图游走动作实现动态上下文构建。提出的目标条件策略自蒸馏技术巧妙地解决了图探索中奖励延迟的挑战，将事后评估直接用于策略优化，这是一种新颖的强化学习训练范式。

Abstract: Reasoning over text-attributed graphs (TAGs) requires large language models (LLMs) to combine a node’s text with evidence distributed across its neighbourhood. Existing methods fix the set of accessible neighbours before generation, forcing reasoning to operate over a static context and preventing the model from acquiring missing evidence during inference. We argue that neighbour selection should itself be part of the reasoning process. To this end, we propose Call Neighbours Yourself (CNY), a framework that enables LLMs to proactively explore graph neighbourhoods through topology-constrained graph-walk actions. Instead of reasoning over a pre-selected neighbour set, CNY exposes lightweight neighbour previews and learns when to expand candidate neighbours for additional evidence. To address the delayed-credit challenge of neighbour exploration, we introduce destination-conditioned on-policy self-distillation, which retrospectively evaluates a selected neighbour after its content is revealed and converts the resulting change in action preference into an action-level training signal. Experiments on standard TAG reasoning benchmarks under a unified raw-text setting show that CNY consistently outperforms fixed-context post-training baselines. Furthermore, the learned exploration policy transfers to unseen graphs and to a graph-level task not encountered during training. Code is available at https://github.com/superallen13/CNY.

[255] MedTVL: Harnessing Vision and Language for Medical Time Series Classification cs.AI | cs.CVPDF

Jiexia Ye, Jia Li, Fugee Tsung

TL;DR: 本文提出了MedTVL模型，一种用于医学时间序列分类的文本引导双路径架构，通过结合基于卷积的时间路径和基于Transformer的视觉路径，并引入自适应医学文本语义指导和专家混合机制，实现了时间序列、视觉和语言三模态的协同学习。

Details

Motivation: 现有医学时间序列分类方法多关注双模态交互，而忽略了时间序列、视觉和语言三模态的协同潜力，这限制了其模拟临床诊断中数值评估、视觉检查和临床背景综合实践的能力。

Result: 在多个医学数据集和任务（包括监督学习、少样本学习和对比学习设置）上的广泛实验表明，MedTVL具有优越性和可迁移性，展现了其作为鲁棒临床决策支持工具的潜力。

Insight: 创新点在于首次探索医学时间序列分类中的三模态协同，通过文本引导的双路径异构架构和专家混合机制实现实例自适应的多模态融合，并利用对比学习缓解临床标签稀缺问题。

Abstract: Recent advancements in multimodal learning for medical time series (MedTS) classification highlight the benefits of integrating complementary modalities for clinical decision. However, existing methods typically focus on bi-modal interactions (e.g., time series and text), leaving the tri-modal synergy between time series, vision, and language largely unexplored. Inspired by diagnostic practice synergizing numerical assessment, visual inspection and clinical context, we introduce MedTVL, a text-guided dual-pathway architecture tailored for MedTS classification. Specifically, it synergizes a convolution-based temporal pathway for fine-grained temporal dynamics from raw numerical sequences and a transformer-based visual pathway for holistic morphological structures from time-series-derived images. Such combination of cross-modal and architectural heterogeneity provides a comprehensive diagnostic perspective. To further resolve potential diagnostic ambiguity, both pathways are guided by adaptive medical textual semantics. Finally, a Mixture-of-Experts mechanism dynamically routes each instance to specialized fusion experts, capturing instance-specific reliance on the temporal and visual pathway outputs. In addition, MedTVL supports multimodal contrastive learning to mitigate the clinical label scarcity challenge. Extensive experiments across multiple medical datasets and tasks, spanning supervised, few-shot, and contrastive learning settings, demonstrate the superiority and transferability of MedTVL, highlighting its potential for robust clinical decision support.

[256] EvoSkill Injection: Red-Teaming Autonomous Skill Generation and Evolution in Self-Evolving Agents cs.AI | cs.CLPDF

Doyun Kim, Chanwoo Kim, Sugyeong Eo, Yeo-Chan Yoon, Chanjun Park

TL;DR: 本文提出了EvoSkill Injection威胁模型，针对基于LLM的自进化代理中的自主技能生成与演化流程，并开发了SARGE红队测试框架进行威胁评估。研究构建了EvoSkillBench和EvoSkillSafetyBench两个基准数据集，用于诱导恶意技能形成并评估其后续激活风险，实验表明恶意技能可被持久存储并反复触发，揭示了自进化代理中持续能力腐化的安全风险。

Details

Motivation: 自进化代理通过自主生成、优化和复用技能实现持续能力进化，但这一过程引入了新的攻击面，恶意能力可能被生成并作为合法技能存储和复用，因此需要系统性评估该威胁。

Result: 在构建的EvoSkillBench和EvoSkillSafetyBench基准上评估表明，SARGE框架能成功诱导恶意技能形成，且注入的技能可被持久存储并重复激活，证实了自进化代理存在持续能力腐化的风险。

Insight: 创新点在于首次定义了针对自进化代理技能演化流程的EvoSkill Injection威胁模型，并提出了配套的红队测试框架与基准数据集，为LLM代理系统的安全性评估提供了新视角和方法论。

Abstract: LLM-based agent systems increasingly adopt skill-based architectures to reduce repetitive reasoning costs and improve stable, efficient task execution. Recent studies propose self-evolving agents that autonomously generate, refine, and reuse skills from past experiences to enable continuous capability evolution. However, autonomous skill evolution introduces a new attack surface in which malicious capabilities are generated, stored, and reused as legitimate skills. In this paper, we define EvoSkill Injection as a threat model targeting the autonomous skill generation and evolution pipeline of self-evolving agents. We further propose SARGE (Red-teaming Autonomous Skill Generation and Evolution in self-evolving agents), a red-teaming framework for evaluating this threat model through iterative generation, escalation, and reinforcement interactions. To support our framework, we construct EvoSkillBench, a benchmark dataset of malicious interaction trajectories for inducing malicious skill formation in self-evolving agents, and introduce EvoSkillSafetyBench, a post-attack benchmark for evaluating whether injected malicious skills are subsequently retrieved and activated as harmful behaviors. Our evaluation shows that SARGE induces malicious skill formation and that injected skills are persistently stored and repeatedly activated, highlighting the risk of persistent capability corruption.

[257] ScienceArena: Benchmarking LLMs on Latest Scientific Olympiad Competitions cs.AI | cs.CLPDF

Guangxiang Zhao, Qilong Shi, Xusen Xiao, Wenpu Liu, Yaoming Li

TL;DR: 本文介绍了ScienceArena，一个基于最新科学奥林匹克竞赛（如IPhO、IChO、IBO等）构建的开放式、多步骤科学推理基准，旨在解决现有基准饱和和数据污染问题。通过专家审核的数字化流程，将官方考试材料转化为结构化试题，并利用LLM-as-judge进行规模化评估。对14个最新LLM的评估显示，顶尖模型在部分国际考试中达到奖牌等效分数，但化学和长程一致性仍是关键瓶颈。

Details

Motivation: 现有基准饱和和数据污染问题日益严重，掩盖了前沿大语言模型（LLM）的真实科学推理能力，因此需要构建一个基于最新科学奥林匹克竞赛的、能评估开放式多步骤科学问题解决能力的基准。

Result: 在IPhO和IChO上校准的LLM-as-judge评分与专家总分误差在1分以内；评估14个最新LLM发现，顶尖模型在多个公开国际考试中获得奖牌等效的评分，但化学和长程一致性表现仍不足。

Insight: 创新点包括：通过专家审核的数字化流程构建高质量、结构化科学竞赛基准；利用LLM-as-judge进行规模化评估，并与专家评分校准；分析指出模型失败常源于视觉基础、结构保真度和全局问题控制，而非术语缺失，为模型改进提供了具体方向。

Abstract: Benchmark saturation and data contamination increasingly obscure genuine scientific reasoning in frontier LLMs. We introduce \textsc{ScienceArena}, an olympiad-style benchmark from thirteen public science competitions in physics, chemistry, and biology, including IPhO and IChO 2025–2026, IBO 2023, USAPhO 2026, and USNCO 2025. Its open-ended, multi-step problems use process-credit rubrics, making faithful scoring difficult. We build ScienceArena through an expert-audited digitization pipeline that converts official exams, figures, solutions, and rubrics into structured items verified by olympiad medalists. To scale evaluation beyond costly human grading, we calibrate LLM-as-judge against medalist ground truth on archived answers from five models across IPhO and IChO; two strong judges stay within one point of expert total scores. Medalist notes show that failures often stem from visual grounding, structure fidelity, and global problem control rather than missing terminology. Evaluating fourteen recent LLMs with interleaved solving, we find that top models obtain medal-equivalent rubric scores on several public international exams, while chemistry and long-horizon consistency remain key bottlenecks. We provide an interactive \href{https://science-arena.onrender.com/}{demo}.

[258] Geometry of Divergence: Tracking Hidden-State Trajectories for Adaptive Multi-Turn Reasoning cs.AI | cs.CLPDF

Jie Liang, Zhengxin Yu, Hamid Nasiri, Peter Garraghan

TL;DR: 本文提出了一种基于几何视角的多轮推理轨迹分析方法，通过跟踪LLM隐藏状态轨迹的曲率和方差斜率来表征推理过程，从而区分正确与错误推理路径，并识别关键推理轮次以提升任务成功率并降低计算成本。

Details

Motivation: 解决LLM智能体在多轮交互中因上下文累积导致任务相关信息表示漂移、推理过程不稳定的问题，旨在区分建设性推理与表示漂移的边界。

Result: 在四个任务和三个底层LLM上的实验表明，几何信号能在任务完成前区分正确与错误推理片段；在τ-Bench基准上，该方法将任务成功率从24.1%提升至39.6%，同时降低11.2%的token成本。

Insight: 创新性地将多轮推理建模为隐藏状态轨迹，并引入时间曲率和方差斜率两个互补的几何信号进行表征；通过分解为四类动作（读、写、响应、转移）的三动作链，揭示了可分离性是动作依赖的，为自适应推理提供了新视角。

Abstract: LLM agents need to sustain goal-consistent reasoning across long multi-turn interactions under strict resource constraints. However, as the multi-turn context accumulates, it can destabilize the underlying LLM’s internal representation of task-relevant information from earlier turns, blurring the boundary between constructive reasoning and representation drift. We formulate multi-turn reasoning as a hidden-state trajectory of the underlying LLM that is characterized via two complementary signals: temporal curvature that captures the directional consistency of turn-to-turn updates, and variance slope which measures the expansion or contraction of the exploration space. Across four tasks and three underlying LLMs, we observed that these geometric signals distinguish between correct and incorrect episodes prior to completion. We further decompose each episode into three-action chains formed from four actions (Read, Write, Respond, Transfer) and show that separability is action-dependent, with different signals distinguishing various chain patterns. Our experiments demonstrate that trajectory geometry can identify critical turns in the reasoning process, increasing task success rates on $τ$-Bench from 24.1% to 39.6% while reducing token cost by 11.2%.

[259] HSRM: Hidden-State Reward Models for Test-Time Verification cs.AI | cs.CLPDF

Xianzhi Li, Xiaodan Zhu

TL;DR: 该论文提出了HSRM（隐藏状态奖励模型），一种轻量级验证方法，通过直接读取LLM生成器的内部隐藏状态而非重新处理文本，来验证数学推理候选答案的正确性。该方法在四个数学推理基准测试中，以仅约200万参数实现了与5500万参数文本验证器相当或更优的性能。

Details

Motivation: 现有基于文本的验证器需要重新读取每个生成的解决方案，导致验证成为推理中昂贵的环节；而LLM的内部表示中往往编码了正确性相关信号，包括对自身答案可能错误的感知。

Result: 在四个数学推理基准（GSM8K、MATH、SVAMP、ASDiv）的16个生成器-数据集设置中，HSRM在15个设置中匹配或超越了5500万参数的文本能量验证器的性能。

Insight: 创新点在于利用生成过程中已计算的隐藏状态进行高效验证，避免了文本重读的开销；采用自生成轨迹与结果标签进行训练，无需人工过程监督或大型预训练验证器，实现了参数效率极高的轻量级验证架构。

Abstract: Large language models can often generate plausible mathematical reasoning traces, but reliably identifying the correct solution among multiple candidates remains a key challenge. Existing test-time reasoning pipelines typically rely on text-based verifiers that re-read each generated solution, making verification an expensive component of inference. Prior work has shown, however, that LLMs often encode correctness-related signals in their internal representations, including awareness of when their own answers are likely to be wrong. Building on this observation, we introduce HSRM, a lightweight hidden-state reward model that verifies candidate solutions by directly reading the generator’s internal representations rather than re-processing its text. HSRM extracts hidden states from a frozen generator at reasoning-step boundaries and uses a small Transformer encoder to rank candidates. It is trained from self-generated trajectories with outcome labels, requiring neither human-written process supervision nor a large pretrained verifier. Across four mathematical reasoning benchmarks, HSRM matches or outperforms a 55M-parameter text-only energy verifier in 15 of 16 generator–dataset settings while using only about 2M parameters, providing an efficient alternative to text-only verification by reusing representations already computed during generation.

[260] Responsible Integration of AI in Cancer Genomics: Barriers, Risks, and Pathways to Trustworthy Clinical Translation cs.AI | cs.CLPDF

Bahar İlgen, Yiannos Tolias, Denise Kühnert, Paraskevi Papadopoulou, Magnus Westerlund

TL;DR: 这篇综述论文探讨了人工智能（AI）和自然语言处理（NLP）在癌症基因组学中的应用现状，并指出其向临床肿瘤学常规转化进展缓慢的核心挑战在于可信赖地整合到临床工作流程中，而非单纯的计算能力。论文系统性地识别了四个相互关联的转化失败领域，并提出了一个概念框架和路线图，强调通过严格验证、不确定性感知方法、互操作基础设施、监管协调以及全生命周期的人工监督来应对这些挑战。

Details

Motivation: 论文的动机是解决AI和NLP在癌症基因组学中从研究到临床常规应用转化缓慢的问题，核心挑战在于如何实现可信赖的临床整合，而不仅仅是提升模型性能。

Result: 作为一篇综述，论文未报告具体的定量实验结果，但系统性地识别了证据不一致性、可解释性与不确定性、数据治理与可重复性以及互操作性这四个关键转化障碍领域。

Insight: 论文的创新之处在于提出了一个系统级的视角，强调这些挑战在转化路径上的相互作用，并构建了一个涵盖验证、不确定性方法、基础设施、监管和人工监督的综合框架，为可信赖的临床AI整合提供了路线图。

Abstract: Artificial intelligence (AI) and natural language processing (NLP) are increasingly used to extract, integrate, and interpret biomedical knowledge relevant to cancer genomics, yet their translation into routine clinical oncology has been comparatively slow. The central challenge is not computational capability alone, but trustworthy integration into clinical workflows. This review examines how NLP and AI support the cancer genomics pipeline, from literature mining and automated variant interpretation to clinical trial matching, knowledge graph construction, and multimodal data integration. We identify four interrelated translational failure domains: evidence inconsistency, explainability and uncertainty, data governance and reproducibility, and interoperability. Rather than considering these challenges in isolation, we take a systems-level view, focusing on their interaction across the translational pathway. We propose a conceptual framework and roadmap for addressing these domains through rigorous validation, uncertainty-aware methods, interoperable infrastructures, regulatory alignment, and human oversight across the AI lifecycle. Progress toward routine clinical use will depend less on further improving model capability than on systematically addressing these interacting failure domains from development through deployment and post-deployment monitoring.

[261] EviAnchor: Mitigating Hallucinations in Large Vision-Language Models via Regional Visual Evidence Compensation cs.AI | cs.CVPDF

Sihang Jia, Shuliang Liu, Songbo Yang, Xuming Hu

TL;DR: 该论文提出了一种名为EviAnchor的训练免费、单分支推理框架，旨在缓解大型视觉语言模型（LVLMs）中常见的幻觉问题，即生成视觉输入未支持的内容。其核心机制是通过引入区域证据锚（REA）槽来聚合密集的视觉标记，并通过决策条件证据路由来增强生成过程中对视觉证据的访问，从而在整个生成过程中保留并重新激活视觉证据。

Details

Motivation: 论文的动机源于大型视觉语言模型经常生成缺乏视觉输入支持的内容。初步实验发现，视觉证据主要在解码器的早期到中层被整合到答案侧表示中，而在后续层中的直接影响逐渐减弱，这表明早期获取的视觉证据在后续生成中可能未被充分利用。

Result: 在POPE、CHAIR和MMHal-Bench等基准测试上的实验表明，该方法在视觉基础任务上取得了持续性的改进，有效提升了模型生成内容的视觉真实性。

Insight: 论文的创新点在于提出了一个无需额外训练、在推理阶段通过结构化锚点（REA槽）和动态路由机制来持续补偿视觉证据的框架。从客观角度看，其核心洞察是识别并缓解了Transformer解码器中视觉信息流随层衰减的问题，并通过空间结构化的证据锚定与条件路由，巧妙地增强了生成决策对视觉上下文的依赖，而非过度依赖文本语境，这对于提升多模态模型的可靠性具有借鉴意义。

Abstract: Large vision-language models (LVLMs) frequently generate content unsupported by visual inputs. Preliminary experiments show that visual evidence is primarily incorporated into answer-side representations in early-to-middle decoder layers, while its direct influence progressively weakens in later layers. This attenuation suggests that visual evidence acquired earlier may be insufficiently utilized during subsequent generation. Based on this observation, we propose EviAnchor, a training-free and single-branch inference framework that preserves and reactivates visual evidence throughout generation. EviAnchor introduces Regional Evidence Anchor (REA) slots to progressively aggregate dense visual tokens into spatially structured representations. It then strengthens the current decision state’s access to these visual anchors through decision-conditioned evidence routing, mitigating excessive dependence on textual context. Finally, the model resumes its native Transformer computation to integrate the retrieved visual evidence with question semantics and generation history. Experiments across POPE, CHAIR, and MMHal-Bench demonstrate consistent improvements in visual grounding.

[262] SafeAtlas-VL: Beyond Binary Multimodal Safety with Large-Scale Data and Guard Models cs.AI | cs.CVPDF

Zongrui Wang, Xiangyang Zhu, Sicheng Wang, Han Wang, Dingyi Rong

TL;DR: 本文提出了SafeAtlas-VL数据集和SafeAtlas Guard模型系列，用于超越二元的、细粒度的多模态安全审核。数据集包含150万个训练实例，在图像、用户请求和助手响应三个层面进行五级有序风险评估，涵盖15个主要危害类别和55个子类别。基于此数据集训练的Guard模型不仅能进行五级分类，还能通过软累积序数头输出连续风险分数，在多个基准测试上展现出强大的泛化能力和SOTA性能。

Details

Motivation: 现有多模态安全审核方法通常针对单一判断目标（如图像或文本）进行二元决策，难以比较跨模态交互中的风险，且模糊案例容易被忽视。本文旨在解决这一问题，提供细粒度的、连续的风险评估框架。

Result: 在构建的SafeAtlas-Bench（5000个实例）上进行评估，实验结果表明，基于SafeAtlas-VL训练的Guard模型在未使用其他基准训练集的情况下，在相应测试集上取得了有竞争力的性能。其中8B模型实现了整体最佳性能，F1分数比之前的SOTA高出约4%。

Insight: 主要创新点包括：1）构建了大规模、细粒度（五级有序尺度）、多层面（图像、请求、响应）的多模态安全数据集；2）提出了目标条件调优和软累积序数头，使模型能同时输出离散分类和连续风险分数；3）通过分歧感知的标注流程和数据收集策略，提升了数据质量和模型泛化能力。

Abstract: Multimodal safety moderation requires distinguishing risks arising from visual content, user intent, and assistant behavior. Existing safeguards, however, are typically trained for a single judgment target and reduce safety assessment to a binary decision. Consequently, risk becomes difficult to compare across a multimodal interaction, and ambiguous cases are obscured. We introduce SafeAtlas-VL, a dataset of 1.5M training instances that places image-, request-, and response-level judgments on a five-level ordered scale. We curate a broad collection of safety-relevant data from both real-world and synthetic sources and apply a disagreement-aware annotation procedure. The resulting dataset spans 15 harm categories and 55 fine-grained subcategories, covering a broad range of multimodal safety scenarios. We also construct SafeAtlas-Bench, a held-out set of 5,000 instances for evaluating five-level predictions and continuous risk scores. Upon this dataset, we train the SafeAtlas Guard series of models via target-conditioned tuning for multimodal safety detection. Our models not only perform five-way classification of safety levels but also map safety to continuous scores through a soft cumulative ordinal head. Experimental results demonstrate that guard models trained on our dataset exhibit strong generalization: even without using the training sets of other benchmarks, they achieve competitive performance on the corresponding test sets. Notably, our 8B model attains the overall best performance, outperforming the previous SOTA by approximately 4% in F1 score. Code, data, and models are released to support further research. Warning: this paper contains example data that may be offensive, harmful, graphic, or disturbing.

[263] Computational Depth Measurement in Thermographic Video: Overcoming Spatial Overfitting via Spatio-Temporal Decoupling cs.AI | cs.CVPDF

Zain Ul Abidin, Habeeban Memon, Junaid Ahmed

TL;DR: 本文提出了一种时空解耦架构，用于从热成像视频中测量碳纤维增强聚合物（CFRP）内部脱层缺陷的深度。该方法首先通过分割定位缺陷区域，然后提取物理信息特征进行深度回归，有效克服了空间过拟合问题。

Details

Motivation: 解决光学脉冲热成像（OPT）中因校准缺陷呈规则网格分布而导致回归模型记忆几何位置而非学习热扩散与深度物理关系的数据集偏差问题。

Result: 在跨样本验证中，采用L1/L2正则化和列采样的XGBoost模型表现最佳，实现了0.056 mm的平均绝对误差（MAE）和0.085 mm的均方根误差（RMSE），并能在3-5秒内生成三维缺陷模型。

Insight: 核心创新在于时空解耦架构，将空间定位与时间深度测量分离，并结合物理信息特征与模型正则化，有效抑制了空间记忆，提升了模型的泛化能力。

Abstract: Accurate through-thickness measurement of subsurface delamination depth in Carbon Fiber Reinforced Polymer (CFRP) is important for structural assessment because defect location determines affected load-bearing layers. Optical pulsed thermography (OPT) provides a two-dimensional thermal video rather than volumetric measurements, so depth must be inferred from temporal heat-diffusion responses. A challenge is spatial dataset bias: when calibration defects follow regular grids, regression models may memorize their geometry instead of learning physical relationship between thermal decay and depth. This work introduces a spatio-temporal decoupling architecture that separates spatial defect localization from temporal depth measurement. Defect regions are first localized using segmentation methods, after which thermal responses are spatially averaged and converted into sixteen physics-informed temporal, energy, statistical, and geometric features. These features expose the one-dimensional heat-conduction relationship while withholding pixel coordinates from the depth model. Four regression models are evaluated using specimen-level cross-validation: Random Forest (RF), Gradient Boosting Machine (GBM), Advanced Multi-Layer Perceptron (Adv-MLP), and XGBoost. Unregularized trees and over-parameterized Adv-MLP exhibit calibration collapse under geometric shifts, with errors exceeding 0.5 mm. In contrast, regularized XGBoost with L1/L2 penalties and column sampling maintains cross-specimen calibration, achieving a mean absolute error (MAE) of 0.056 mm and root mean square error (RMSE) of 0.085 mm. Predicted depths are merged with masks to generate Delaunay-triangulated three-dimensional defect models in three to five seconds per specimen. Results show that mathematical regularization and spatio-temporal decoupling reduce spatial memorization in thermal-video depth regression.

[264] Token-Efficient Data Reasoning Agents via Adaptive Structuring of Unstructured Data cs.AI | cs.CL | cs.DBPDF

Milad Rezaei Hajidehi, Qitong Wang, Stratos Idreos

TL;DR: 该论文提出了一种名为’agentic data cracking’的方法，旨在降低LLM代理处理非结构化数据时的令牌消耗成本。该方法通过在代理推理过程中自适应地、推测性地提取和结构化数据，使得后续相关查询能够直接利用已结构化的信息，从而减少重复打开大型文档的需求。

Details

Motivation: 企业AI中部署的LLM代理需要从非结构化数据（如网页、报告、PDF）中推理以回答复杂问题，但当前方法成本高昂，每次查询都需反复打开大型文档来收集分散的证据，消耗多达百万令牌。然而，预先结构化所有数据不可行，因为文档包含的可能结构远多于实际需求，且有用结构和文档在查询到达前未知。

Result: 在FanOutQA基准测试中，理想预结构化存储的推理成本降低28倍，而论文提出的方法在仅扩展每个测试问题一个相关问题时，能将成本降低53%，同时保持准确性接近RAG水平。

Insight: 创新点在于将数据结构化作为推理过程的副产品，自适应地根据观察到的查询决定何时以及结构化什么内容，并推测性地提取可能服务于未来相关查询的接地结构。这为下一代非结构化数据上的代理推理基础设施提供了共享底层，使已揭示的知识得以积累。

Abstract: Valuable data remains embedded in unstructured sources: web pages, reports, contracts, filings, earnings calls, and PDFs. The big bet in enterprise AI is deploying LLM agents that reason over this data to answer complex questions for every knowledge worker. Agents can do this today, but at prohibitive cost. Each question repeatedly opens large documents to recover scattered evidence, consuming up to a million tokens. However, if the data were already structured, the same question would reduce to a cheap database lookup. For example, on FanOutQA benchmark, reasoning over an ideal pre-structured store is 28X cheaper, and the gap grows to orders of magnitude as questions fan out over more documents. Yet structuring everything in advance is not viable: documents hold vastly more possible structure than any workload will use, and the useful structure and documents are unknown until queries arrive. We propose agentic data cracking, a method that structures unstructured data adaptively and speculatively as a byproduct of reasoning itself. Structuring is adaptive because observed queries decide when it happens and what matters, and speculative because it goes beyond the current question. Whenever the agent opens a document to answer, a cracking sub-agent forks from the already-loaded context at marginal cost and extracts grounded structure likely to serve related future queries. Over time, an increasing share of queries is fully covered by structured data and answered without opening a document, keeping agentic accuracy at close to RAG cost. On FanOutQA, extended with merely one related question per test question, cracking cuts cost by 53% while preserving accuracy. Agentic data cracking is a first step toward next-generation data infrastructure for agentic reasoning over unstructured data: a shared substrate beneath the model where knowledge that reasoning already paid to uncover accumulates.

[265] GarmentWeaver: Schema-Aware Structured Synthesis for Multimodal Sewing Patterns cs.AI | cs.CVPDF

Yinwen Lu, Weihao Luo, Yueqi Zhong

TL;DR: 本文提出了GarmentWeaver，一个模式感知的结构化生成框架，用于从草图或文本描述等多模态设计线索中生成可执行的缝纫图案。该框架通过激活与服装相关的结构分支来构建紧凑的层次化目标，并以结构化方式预测图案，从而解决了现有方法将服装规格建模为扁平长序列所导致的冗余、细节不准确和模拟兼容性差的问题。

Details

Motivation: 现有方法将服装规格建模为扁平长序列，导致服装结构与详细参数纠缠，产生冗余组件、局部细节不准确和模拟兼容性差的问题。本文旨在通过结构化生成方法，从多模态设计线索中生成更准确、更可执行的缝纫图案。

Result: 大量实验表明，GarmentWeaver相比强基线方法能生成更准确、更可执行的缝纫图案，并产生更好的模拟结果，证明了其有效性。

Insight: 创新点包括引入模式感知的目标构建策略、在预训练视觉-语言模型基础上构建生成器以实现多模态服装理解，以及施加可行性感知的正则化以确保结构有效和模拟兼容的输出。这为可靠的多模态缝纫图案预测提供了结构化生成的新思路。

Abstract: Multimodal Sewing pattern generation aims to infer executable sewing patterns from design cues such as sketches and textual descriptions. As an interpretable and simulation-compatible representation, sewing patterns are particularly valuable for digital garment creation. However, existing methods often model garment specifications as flat long sequences, which entangles garment structure with detailed parameters and leads to redundant components, inaccurate local details, and poor simulation compatibility. In this paper, we present GarmentWeaver, a schema-aware framework for multimodal Sewing pattern generation. GarmentWeaver constructs compact hierarchical targets by activating garment-relevant structural branches and predicts executable Sewing patterns in a structured manner. Specifically, we introduce a schema-aware target construction strategy, build the generator on top of a pretrained vision-language model for multimodal garment understanding, and impose feasibility-aware regularization to encourage structurally valid and simulation-compatible outputs. Extensive experiments show that GarmentWeaver produces more accurate and more executable sewing patterns than strong baselines, while also yielding better simulation results. These findings demonstrate the effectiveness of schema-aware structured generation for reliable multimodal Sewing pattern prediction.

[266] Autoregressive Mosaics: Probing 2D Spatial Reasoning in Text-Only Language Models cs.AI | cs.CVPDF

Ashwin Nedungadi, Stefan Oehmcke, Stefan Lüdtke

TL;DR: 本文研究了仅接受文本和代码训练的大语言模型是否具备二维空间推理能力。作者提出了Autoregressive Mosaics基准，包含翻译任务和布局任务，以区分模型是将空间描述转换为代码，还是真正理解并规划空间布局。实验表明，模型性能不仅取决于其代码生成能力，还受输出媒介（如代码与原始SVG）的影响，并且模型在生成过程中会动态追踪几何状态，而非执行固定计划。

Details

Motivation: 旨在探究仅基于文本和代码训练的大语言模型是否真正内化了二维空间布局的表征，还是仅仅学会了将空间描述翻译成代码的映射关系。

Result: 在八个开源文本-代码模型上测试，所有模型都能可靠地将指定几何图形翻译为代码，但在开放式的布局任务上表现差异显著。将输出媒介从过程式代码改为原始SVG后，所有模型的布局得分均有提升。

Insight: 论文的创新点在于设计了能分离代码生成能力和空间布局理解能力的基准测试。客观来看，其核心发现是：LLM的二维空间表现是模型能力和输出媒介的共同作用结果，且模型在生成过程中进行的是动态的几何状态追踪，而非执行预先制定的固定计划。

Abstract: Large language models (LLMs) trained only on text and code can sometimes generate programs that draw recognizable images. However, it is unclear whether this reflects an internal representation of 2D spatial layout or simply the ability to translate spatial descriptions into code. We introduce Autoregressive Mosaics (AM-Bench), a benchmark that separates these factors: First, a translation task gives a model a fully specified geometry of a picture in words as a prompt and asks for the code that produces it. Second, a layout task requires the model to compose an image from an underspecified prompt. Across eight open-weight text-and-code-only models, all models reliably translate specified geometry into code, but their open-ended layout performance differs substantially, indicating that these differences are not explained by code-generation ability alone. An output-medium ablation further shows that the interface or medium of expression that the model uses matters: replacing procedural code with raw SVG improves layout scores across all models. Finally, probing model activations shows that a coarse layout plan is present before generation, but reflects only the layout implied by the prompt. During generation, models track the evolving geometric state instead of executing an initially fixed plan. Overall, these results show that 2D spatial performance in text-only LLMs depends on both the model and the output medium, and is not explained by code-generation ability alone.

[267] MNIST-PRO: MNIST is Back as a Partially Observable World for AI Agents cs.AI | cs.CVPDF

Vernon Toh, Navonil Majumder, Zhengyuan Liu, Nancy F. Chen, Soujanya Poria

TL;DR: MNIST-PRO是一个新的基准测试，它将经典的MNIST手写数字识别任务转化为一个序列化的、基于局部观察（glimpse）的搜索任务，并带有回看约束，旨在隔离和评估AI智能体在部分可观测环境中构建和解释感知状态的能力。

Details

Motivation: 现有的基准测试难以孤立地评估智能体构建和解释感知状态的能力，因为它们引入了物理和控制复杂性。本文旨在通过一个简化的任务来专门研究智能体在部分可观测环境下如何协调主动感知与工作记忆。

Result: 在完全可观测条件下模型表现优异，但在部分可观测条件下性能出现明显差距。评估了十种多模态模型在四种记忆表示（原始视觉历史、文本状态、结构化度量网格地图、整合视觉画布）上的表现，并识别出三个主要瓶颈。

Insight: 创新点在于设计了一个简化的基准（MNIST-PRO）来专门研究感知状态构建这一核心能力。核心洞察是：仅仅获取视觉证据是不够的，智能体必须能够构建和更新可靠的感知状态，这揭示了当前模型在整合碎片化观察、持续探索和信念修正方面的关键缺陷。

Abstract: AI agents in partially observable environments need to coordinate active sensing with working memory to maintain an evolving perceptual state. However, existing benchmarks struggle to isolate this perceptual-state construction and interpretation capability because they introduce physical and control complexities. We address this with MNIST-PRO, a benchmark that isolates agentic perception by converting MNIST digit recognition into a sequential, glimpse-based search task with lookback constraints. We evaluate ten multimodal models across four memory representations, including raw visual history, textual states, structured metric grid maps, and a consolidated visual canvas. While models excel under full observability, partial observability exposes a clear performance gap. We identify three distinct bottlenecks. First, perceptual-state construction and interpretation present a challenge, as agents struggle to integrate fragmented glimpses. Second, agents often stop exploring before they see the full sequence. Third, models often fail to revise early, incorrect beliefs even when faced with subsequent contradictory evidence. These results show that simply acquiring visual evidence is not enough. Agents must also be able to build and update a reliable perceptual state.

cs.IR [Back]

[268] RePair: Turning Retrieval Failures into Counterfactual Hard Pairs cs.IR | cs.CVPDF

Siyi Liu, Xiaorong Zhu, Enjun Du, Xinyu Zuo, Lisheng Duan

TL;DR: 本文提出RePair方法，通过将检索失败案例转化为反事实困难样本对来提升视觉-语言检索性能。该方法从CLIP风格双编码器的误检结果中提取反事实支架，利用LLM引导的局部编辑生成修正版本，构建跨越决策边界的困难正负样本对进行对比学习。

Details

Motivation: 现有困难样本挖掘方法无法构建修正后的对应样本，而合成增强方法缺乏针对实际模型失败的针对性，导致效率低下。本文旨在通过将检索失败直接转化为反事实训练对，实现更精准有效的监督信号。

Result: 在Flickr30K和COCO30K基准测试中，RePair仅使用10.7万个合成样本（比可比方法少26%-75%）即超越受控增强基线，证实了失败条件修复比误差无关增强更具数据效率。

Insight: 创新点在于将误检结果视为反事实支架，通过有效性、最小性和局部性三原则指导LLM进行针对性编辑，构建跨越决策边界的困难样本对。该方法实现了从模型失败中直接生成对抗性训练数据的闭环机制。

Abstract: Vision-language retrieval with CLIP-style dual encoders achieves strong cross-modal performance, yet practical accuracy often hinges on localized semantic distinctions where top-ranked near misses differ from the true match by a single critical detail. Hard-sample mining can select confusable candidates but cannot construct corrected counterparts; synthetic augmentation can generate novel samples but, without conditioning on actual model failures, targets irrelevant dimensions of hardness. We observe that a top-ranked false positive is a counterfactual scaffold—sharing most of the query’s semantics while differing in a localized failure-causing residual. Minimally correcting this residual yields a hard positive of the ground truth in the same modality; the corrected and unedited versions form a hard negative pair that straddles the decision boundary, producing complementary pull–push supervision. We introduce RePair, guided by three principles—Validity, Minimality, and Locality—which mines false positives bidirectionally, applies LLM-guided counterfactual editing, and trains with a local hard-pair contrastive objective. On Flickr30K and COCO30K, RePair outperforms controlled augmentation baselines with only 107K synthetic samples—26%–75% fewer than comparable methods—confirming failure-conditioned repair is more data-efficient than error-agnostic augmentation.

[269] Doc-REFRAG: Rethinking Multimodal Document Retrieval-Augmented Generation cs.IR | cs.CVPDF

Ruofan Hu, Shengyang Xu, Minjie Hong, Xiaoda Yang, Sashuai Zhou

TL;DR: 论文提出了Doc-REFRAG框架，用于解决多模态文档检索增强生成（RAG）在处理多图像场景时精度有限和计算开销大的问题。通过引入大规模数据集DocLongRAG和一种问题引导的视觉令牌压缩与选择性扩展机制，该方法在多个基准测试中实现了最先进的准确性并显著降低了推理延迟。

Details

Motivation: 现有多模态RAG模型主要针对单图像或封闭文档设置，在现实多图像场景中精度有限，且处理大量检索图像时因无关视觉令牌而产生高计算开销。

Result: 在六个基准测试上，Doc-REFRAG超越了十一个强基线模型，达到了最先进的准确性，并显著降低了推理延迟。

Insight: 创新点包括构建反映真实RAG工作流的大规模多图像问答数据集，以及通过问题引导的粗粒度压缩和基于轻量级强化学习的选择器进行选择性扩展，以优化计算效率。

Abstract: Real-world knowledge resides in multimodal documents, necessitating retrieval-augmented generation (RAG) for accurate question answering. However, existing multimodal RAG models are primarily designed for single-image or closed-document settings and exhibit limited accuracy in realistic multi-image scenarios. Moreover, processing numerous retrieved images incurs substantial computational overhead from irrelevant visual tokens. To address these challenges, we introduce DocLongRAG, a large-scale dataset of 343K question–answer pairs, each associated with an average of 37.4 retrieved images to reflect authentic RAG workflows. Building on this dataset, we propose Doc-REFRAG, a question-guided framework that compresses visual tokens into coarse chunks and selectively expands question-relevant ones via a lightweight RL-based selector. Experiments on six benchmarks show that Doc-REFRAG outperforms eleven strong baselines, achieving state-of-the-art accuracy with significantly lower inference latency. Our resources are available at https://github.com/Collab-Gen/Doc-REFRAG.

cs.RO [Back]

[270] The Potential of Haptic Foundation Models cs.RO | cs.CV | cs.MMPDF

Jianquan Wang, Haiwei Dong, Abdulmotaleb El Saddik

TL;DR: 本文探讨了触觉基础模型（HFMs）的变革潜力与发展路径，旨在解决当前触觉模型因硬件异构性和主动数据收集需求而局限于特定任务的问题。论文概述了从被动的大语言模型和视觉语言模型向主动HFMs转变所需的四个核心维度范式转变，并综合了现有大规模触觉数据集，在TacBench基准上对多个模型进行了力估计、滑动检测和相对位姿估计的评估。

Details

Motivation: 尽管基础模型在语言和视觉领域取得成功，但其在具身AI中的扩展因缺乏通用化触觉感知而受限，尤其在需要安全自适应物理交互的消费电子产品（如智能手机、可穿戴设备）中问题突出。

Result: 论文在TacBench基准上对UniTouch、AnyTouch、T3和Sparsh等模型进行了力估计、滑动检测和相对位姿估计的基准测试，但未明确提及具体定量结果或是否达到SOTA水平。

Insight: 创新点在于提出了向主动触觉基础模型（HFMs）发展的范式转变，聚焦于动作耦合、物理动力学表示空间、连续时间序列数据粒度和动作条件化未来状态预测四个核心维度，为通用触觉感知提供了系统化的发展框架。

Abstract: Despite the success of foundation models in language and vision, their expansion into embodied AI is bottlenecked by a lack of generalized touch sensing. This limitation is especially relevant to consumer electronics, where smartphones, wearables, VR controllers, home robots, and health monitoring devices require safe and adaptive physical interaction. Constrained by hardware heterogeneity and the necessity of active physical data collection, current haptic models remain rigidly task-specific. To overcome these limitations, this article explores the transformative potential and developmental trajectory of Haptic Foundation Models (HFMs). We detail the paradigm shift required to transition from passive Large Language Models and Vision Language Models into active HFMs across four core dimensions: action coupling, physical dynamical representation space, continuous time-series data granularity, and action-conditioned future state prediction. Furthermore, we synthesize existing large-scale tactile datasets and benchmark UniTouch, AnyTouch, T3, and Sparsh on TacBench for force estimation, slip detection, and relative pose estimation.

[271] RedLight-VLA: Models for traffic-rule grounding and behavioral emphasis in driving policies cs.RO | cs.CVPDF

Bala Murali Manoghar Sai Sudhakar, Sourab Bapu Sridhar, Sandipan Das, Rahul Ahuja, Meda Lazar

TL;DR: 本文提出了RedLight-VLA，一种用于训练视觉-语言-动作驾驶策略的新目标函数。它通过轨迹衍生的行为重加权来强调罕见的加减速行为，并通过并行辅助头将交通灯和停车线状态显式地融入连续规则令牌中，旨在解决行为克隆策略在信号灯路口处理规则约束的罕见机动时表现不佳的问题。

Details

Motivation: 基于行为克隆的视觉-语言-动作驾驶策略在处理信号灯路口受规则约束的罕见机动（如停车和启动）时存在困难，因为平均轨迹损失对这些行为不敏感，且融合表征缺乏对交通灯和停车线状态的显式监督。

Result: 在精心挑选的20秒序列（5秒预测范围）上评估，RedLight-VLA相比基线模型，将红灯停车线越线率从7.3%降至6.8%，停车线速度误差降低12.7%，并将3秒交通灯切片ADE/FDE从0.274/0.964米提升至0.247/0.897米。结合两种机制（BR+AUX）的模型在所有四个切片位移指标上均优于单独使用任一机制。

Insight: 创新点在于提出了无需额外人工规则标注的训练目标，通过行为重加权（利用旋转不变纵向动力学）来强调罕见行为，以及通过并行辅助头将规则状态显式地融入连续令牌中，从而实现对交通规则更好的理解和遵循，同时不改变轨迹解码器或引入自回归语言生成。

Abstract: Behavior-cloned Vision-Language-Action (VLA) driving policies struggle with rare rule-governed maneuvers at signalized intersections. Braking and launching examples contribute little to averaged trajectory loss, while fused representations lack explicit supervision for the governing traffic-light and stop-line state. We present RedLight-VLA, a training objective that uses expert futures and automatically generated perception targets without additional manual rule annotation. First, trajectory-derived behavioral reweighting (BR) emphasizes rare deceleration and acceleration using rotation-invariant longitudinal dynamics and a scale-preserving reduction that exactly recovers the baseline when disabled. Second, parallel auxiliary (AUX) heads ground traffic-light and stop-line state in continuous post-fusion rule tokens, without autoregressive language generation or changes to the trajectory decoder. We evaluate on a curated set of 20 s sequences with a 5 s prediction horizon. Controlled variants share the same backbone, training data, decoder, and evaluation population. Against an otherwise identical VLA baseline, RedLight-VLA reduces red-light stop-line overshoot from 7.3% to6.8%, reduces stop-line velocity error by 12.7%, and improves 3 s trafficlight-sliced ADE/FDE from 0.274/0.964 m to 0.247/0.897 m. Green-light false stops increase from 3.2% to 3.9%; however, combining BR with AUX supervision mitigates the larger increase observed for AUX alone (4.0%). The combined model also improves non-traffic-light ADE/FDE from 0.268/0.956 m to 0.241/0.876 m and outperforms either mechanism alone on all four sliced displacement measures.

[272] RoboPhys-3D: A Comprehensive Embodied World Model Evaluation via 3D Reconstruction cs.RO | cs.AI | cs.CV | cs.ET | eess.SYPDF

Tianyi Wang, Jiazhou Chen, Yiming Xu, Xiangyu Li, Tianyi Zeng

TL;DR: 本文提出了RoboPhys-3D，一个基于3D重建的具身世界模型（EWM）综合评估基准。该基准构建于RoboTwin 2.0之上，包含50个操作任务、5000个片段和25000个多视角真实视频。其核心特点是利用统一的3D重建流程处理生成视频与真实视频，以区分重建误差与生成误差，并通过四个层次（像素保真度、3D几何一致性、状态级理解、任务级完整性）的50个互补指标进行全面评估。

Details

Motivation: 现有的具身世界模型基准缺乏一个统一的、基于3D场景状态的评估协议，无法有效判断模型生成的视频序列是否保持了底层3D场景状态或可转化为可执行动作。

Result: 在四个代表性视频世界模型中，Cosmos 3取得了最高的RoboPhyscore分数（0.6330，达到真实数据的92.7%）。该基准提出的RoboPhyscore分数与人类评估结果高度一致（皮尔逊相关系数r=0.9761，斯皮尔曼等级相关系数ρ=0.8962）。

Insight: 创新点在于提出了一个通过统一3D重建流程进行“接地气”评估的基准，能够区分不同来源的误差，并揭示了基于感知或视觉语言模型的判断所无法捕捉的模型在状态和执行层面的重大失败。这强调了面向执行、基于物理的评估对于衡量EWM能力的重要性。

Abstract: Video world models increasingly serve as data engines, action planners, and simulators for embodied AI, but conventional embodied world model (EWM) benchmarks lack a unified 3D-grounded protocol for establishing whether generated rollouts preserve the underlying 3D scene state or translate into executable actions. We introduce RoboPhys-3D, a 3D-grounded EWM benchmark built on RoboTwin 2.0, covering 50 manipulation tasks across four regimes, with 5,000 episodes and 25,000 multi-view ground-truth videos. A defining feature of RoboPhys-3D is that generated and ground-truth videos are processed through the same 3D reconstruction pipeline, enabling reconstruction-induced error to be distinguished from generation-induced error. The RoboPhys-3D benchmark organizes 50 complementary metrics into 18 sub-dimensions across four levels: pixel-level fidelity, 3D geometry consistency, state-level understanding, and task-level completeness. We further introduce Average Full Score, a hierarchical score averaging all 50 metrics for comprehensive evaluation, and RoboPhyscore, a compact task-aligned score averaging the metrics most strongly correlated with task success. Among the four representative video world models, Cosmos 3 achieves the highest RoboPhyscore (0.6330, 92.7% of ground truth), while state- and execution-grounded metrics reveal substantial failures that perceptual and vision-language model-based judgments fail to capture. RoboPhyscore further exhibits strong agreement with human evaluation (Pearson r = 0.9761 and Spearman \r{ho} = 0.8962), demonstrating the importance of grounded, execution-aware evaluation for EWM capability.

[273] Adversarial Calibration Attack on Autonomous Vehicles cs.RO | cs.CV | cs.ET | cs.LG | eess.SYPDF

Liangkai Liu, Qingzhao Zhang, Kang G. Shin

TL;DR: 本文提出了针对自动驾驶车辆在线传感器标定的首个物理攻击方法——对抗性标定攻击（ACA）。该方法通过单一对抗性海报，先欺骗误标定检测器触发标定过程，再引导标定估计器产生错误的变换矩阵，从而在感知、规划与控制环节引发系统性错误。

Details

Motivation: 现有自动驾驶攻击大多假设传感器标定正确，但实际中在线标定算法因振动、温度变化或传感器位移而存在漂移，作者将其识别为一个新的攻击面，旨在揭示其安全风险。

Result: 在KITTI和nuScenes等基准数据集上，ACA可诱导高达33.9度的平均旋转标定误差，严重降低目标检测性能；在CARLA模拟器中，攻击导致车辆在攻击者设计的脆弱场景中发生碰撞；在真实Husky机器人上，打印的对抗海报成功复现了标定错误。

Insight: 创新点在于首次将在线传感器标定作为物理攻击目标，并通过联合优化海报几何与纹理的统一设计方法，实现了对误标定检测和标定估计的双重欺骗，揭示了自动驾驶系统标定环节的安全脆弱性。

Abstract: Autonomous vehicles (AVs) rely on accurate camera-LiDAR calibration for multimodal sensor fusion. In practice, calibration can drift due to vibration, temperature variation, or minor sensor displacement, motivating online calibration algorithms that detect and correct misalignment at runtime while allowing the vehicle to continue operating without a factory visit. Existing AV attacks largely assume correct calibration. We instead identify online sensor calibration as a new attack plane. A corrupted calibration update can persist across subsequent fusion operations, causing system-wide errors that propagate from perception to planning and control. We present Adversarial Calibration Attack (ACA), the first physical attack against camera-LiDAR online calibration. Using a single adversarial poster, ACA first spoofs the miscalibration detector to trigger the calibration process and then steers the calibration estimator toward an incorrect transformation. A unified optimization jointly designs the poster’s geometry and texture for both objectives. We evaluate ACA across benchmark datasets, simulation, and physical experiments. On benchmark datasets such as KITTI and nuScenes, ACA induces up to 33.9 degrees mean rotational calibration error, thereby severely degrading object detection. In the CARLA simulator, the attack causes a collision when the corrupted calibration is accepted in vulnerable scenarios crafted by the attacker. On a real Husky robot, a printed adversarial poster successfully reproduces the calibration error. These results demonstrate that online calibration is a practical and safety-critical attack surface for AVs.

[274] $\mathcal{N}_0$-Foundation: Towards the Age of Tactile Intelligence cs.RO | cs.CV | cs.LGPDF

NeoteAI Team, Fudan TEAI Team

TL;DR: 本文提出了一个名为N0-Foundation的触觉智能范式，旨在推动触觉使能的具身操作研究。该范式整合了触觉传感硬件、大规模多模态数据、触觉表征学习和标准化评估。核心贡献包括：设计了一个可扩展的数据收集基础设施（含视觉触觉传感器和通用操作接口UMI），构建了包含超过3万小时同步视觉与触觉演示的大规模数据集NeoData，提出了跨传感器设计的视觉-触觉表征模型NeoForce，并建立了一个结合真实世界与模拟环境的综合基准测试套件。

Details

Motivation: 解决现有操作数据集在可变形物体操作、精密装配、精细力控制和持续表面交互等任务中的核心局限性，为触觉使能的具身操作提供一个集成的硬件、数据、模型和评估框架。

Result: 在提出的真实世界NeoReal和模拟NeoSim基准套件上的实验表明，策略受益于物理接触状态，而非触觉信号的设备特定外观。

Insight: 创新点在于构建了一个从硬件、数据到模型和评估的完整触觉智能研究生态系统；其大规模、多模态、跨传感器的数据集和表征学习方法，为解决依赖触觉的复杂操作任务提供了关键基础。

Abstract: We present $\mathcal{N}_0$-Foundation, a paradigm for tactile-enabled embodied manipulation, which integrates tactile sensing hardware, large-scale multimodal data, tactile representation learning, and standardized evaluation. First, we engineer the infrastructure for scalable data collection, including a vision-based tactile sensor, a tactile Universal Manipulation Interface (UMI), and a synchronized visuo-tactile data collection system supporting both robot embodiments and UMI-based demonstrations. Leveraging this infrastructure, we construct NeoData, which contains more than 30000 hours of synchronized visual and tactile demonstrations, spanning six embodiments, 450 tasks, and billions of paired RGB and tactile frames collected through a mixture of real-robot teleoperation and UMI-based demonstrations. To facilitate open research, we further release OpenNeoData, a 5000-hour open-source subset of NeoData. The dataset addresses a central limitation of existing manipulation corpora, critical for deformable-object manipulation, precise assembly, delicate force control, and sustained surface interaction. Capitalizing on the large-scale, heterogeneous tactile measurements, we propose NeoForce, a visuo-tactile representation model that learn transferable tactile representations across different sensor designs. To enable systematic evaluation of tactile embodied models built upon our infrastructure, datasets and tactile representations, we further propose a comprehensive benchmark, which combines the real-world NeoReal suite and the simulated NeoSim suite for standardized evaluation. Experiments across both suites show that policies benefit from the physical contact state rather than from the device-specific appearance of the tactile signal. We release the dataset, the representation, and the benchmark, aiming at supporting future work on tactile-enabled embodied manipulation.

[275] Motus2: A Self-Evolving General World Model for Dexterous Manipulation cs.RO | cs.AI | cs.CV | cs.LGPDF

Hongzhe Bi, Zihao Zhou, Yihang Tang, Jingrui Pang, Shuhe Huang

TL;DR: Motus2是一个用于灵巧操作的自进化通用世界模型，通过模型缩放和数据缩放推进世界建模。模型采用单一共享权重结构，整合策略、模拟器和评估器三个控制接口，形成闭环决策与学习循环以改进策略。数据方面从大规模单目自我中心数据扩展到同步立体自我中心数据，并进行机器人领域适应与触觉反馈增强。

Details

Motivation: 现有世界模型通常仅将动作输出头附加到世界模拟器上，未将其耦合到闭环决策与学习循环中以实现策略改进，Motus2旨在构建一个统一的感知、预测、行动、评估和改进系统。

Result: 论文未在摘要中提及具体定量结果或基准测试，但强调了通过闭环通用世界模型缩放和自我中心数据缩放，为自进化灵巧操作提供通用路径。

Insight: 创新点在于将策略、模拟器和评估器耦合为闭环学习循环，利用专家演示进行动作学习，同时从失败和次优交互中学习动态和值函数；数据缩放策略结合多模态感知（立体视觉、触觉）和领域适应，增强了模型的泛化能力。

Abstract: General embodied agents should perceive, predict, act, evaluate, and improve within a unified system. World models have shown great promise in building such agents, yet existing models typically append an action output head to a world simulator, without coupling them into a closed decision-and-learning loop for policy improvement. We present Motus2, a self-evolving general world model for dexterous manipulation. Motus2 advances world modeling through model scaling and data scaling. For model scaling, a single model with shared weights exposes three control interfaces: a policy (world-action model), a simulator (action-conditioned world model), and an evaluator (value model). The policy proposes candidate action chunks, the simulator predicts their visual consequences, and the evaluator assesses the predicted outcomes. Their coupling forms a closed decision-and-learning loop for policy improvement. This formulation uses curated expert demonstrations for action learning, while failed and suboptimal interactions provide valuable evidence for dynamics modeling and value learning. For data scaling, Motus2 progresses from large-scale monocular egocentric data to synchronized stereo egocentric data, followed by robot-domain adaptation with robot trajectories and supplementary human-robot alignment data. Motus2 further studies global-autoregressive and hybrid-memory extensions of its sliding-window context, adds tactile feedback for contact-aware control, and is instantiated on a fully biomimetic platform with stereo vision, dual arms, dual dexterous hands, and tactile sensing. Together, egocentric data scaling and closed-loop general world model scaling provide a general path toward self-evolving dexterous manipulation.

[276] DARP: A Calibrated Dual-Arm RGB-D-IR Dataset for Multi-View Robotic Perception cs.RO | cs.CVPDF

Manish Kansana, Mohammed Yusuf Mujawar, Sudip Mittal, Shahram Rahimi, Noorbakhsh Amiri Golilarz

TL;DR: 本文提出了DARP数据集，这是一个经过标定的双机械臂RGB-D-IR数据集，用于面向物体的机器人感知。该数据集通过两个独立运动的眼在手机械臂从不同视角采集数据，包含RGB、深度和红外图像，并记录了同步的机器人关节状态。数据集旨在支持多视角重建、协作机器人感知、多模态融合和主动感知等任务。

Details

Motivation: 单视角机器人感知常因自遮挡和表面可见性不完整而受限，因此需要从多视角获取互补信息以提升感知能力。

Result: 在包含1,563,466个三维查询点的224个保留RGB-D关键帧上进行评估，该方法的中值点到网格距离为2.13毫米，RMSE为4.04毫米，96.56%的点位于测量表面网格10毫米范围内，验证了采集的几何一致性。

Insight: 创新点在于提出了一个包含完整标定信息和多模态数据的双机械臂采集系统与数据集，其采集流程实现了自动定位、跨臂确认和自适应视点生成，并且评估时采用了确定性的多视角融合流程，不依赖学习或生成式补全方法，保证了结果的可靠性和可复现性。

Abstract: Robotic perception from a single viewpoint is often limited by self-occlusion and incomplete surface visibility. This paper presents DARP(Dual-Arm Robotic Perception) https://doi.org/10.21227/rmv3-be47, a calibrated dual-arm RGB-D-IR dataset for object-centered robotic perception using two independently moving eye-in-hand manipulators positioned on opposite sides of a shared tabletop workspace. Each arm carries an Intel RealSense sensor that continuously records RGB, depth, and stereo infrared data while synchronized robot joint states are logged for pose recovery. Objects are placed without fixed poses or marked locations, and the acquisition procedure performs automatic localization, cross-arm confirmation, adaptive viewpoint generation, and continuous multimodal recording. DARP contains ten unique tabletop objects and preserves the original sensor recordings, robot-state logs, object-level metadata, and calibration information required to reconstruct camera trajectories in a shared metric frame. To evaluate the geometric consistency of the acquisition, we implement a deterministic multi-view fusion pipeline that converts calibrated RGB-D observations into complementary partial point clouds and measured surface meshes without using learned or generative completion methods. Evaluation on 224 held-out RGB-D keyframes comprising 1,563,466 three-dimensional query points yields a median point-to-mesh distance of 2.13~~mm and an RMSE of 4.04~~mm, with 96.56% of points within 10~mm of the measured-surface mesh. DARP is intended as a reusable resource for multi-view reconstruction, collaborative robotic perception, multimodal fusion, active perception, and future learning-based reasoning over partial object observations.

[277] GAFT: Geo-Anchored Fine-Tuning for Hazard Identification from Rare Failures cs.RO | cs.CVPDF

Yanran Xu, Chuanhang Qiu, Yue Wang, Wenbo Wu, Zhaoxing Li

TL;DR: 本文提出了一种名为GAFT（Geo-Anchored Fine-Tuning）的参数高效微调方法，用于从罕见的故障事件中识别越野导航中的危险结构（如导致车辆卡住的障碍物）。该方法通过几何先验引导LoRA适配，将空间注意力图与几何先验对齐，以保留预训练模型的表征能力，从而解决因故障数据稀缺和视觉线索不明确导致的泛化能力差的问题。

Details

Motivation: 越野导航中，物理结构可能导致不可恢复的故障（如车辆托底或被困），需要人工干预。识别这些危险结构至关重要，但相关故障事件罕见且收集成本高，导致训练数据有限，且现有数据仅关联帧与结果，未指明导致故障的具体视觉线索，直接学习易过拟合特定场景，泛化能力差。

Result: 在一个经过干预验证的森林危险基准测试上，GAFT在十次独立训练的适配中，均显著优于冻结的DINOv2和监督式PEFT基线，将重复留一场景外平均F2分数从0.0607提升至0.3757（具有统计显著性）。其中表现最佳的GAFT模型达到了0.570的重复-LOSO F2分数。

Insight: 创新点在于提出了一种几何锚定的微调策略，利用几何先验引导LoRA的注意力对齐，从而在参数高效适配的同时，增强模型对危险结构的泛化识别能力，避免了对稀缺故障数据的过拟合。从客观角度看，该方法将几何信息作为弱监督信号融入视觉基础模型的微调过程，是一种新颖的领域适应思路。

Abstract: Off-road navigation can fail when physical structures induce irrecoverable states such as high-centering or entrapment, requiring human interventions. Identifying these structures is crucial, yet challenging. Such failure events are rare and costly to collect, resulting in limited training data. Moreover, the collected data associate frames with outcomes, but do not indicate the visual cues responsible for the failure. Learning directly from these data can therefore exploit scenario-specific visual cues, leading to poor generalization. We propose \textbf{Geo-Anchored Fine-Tuning (GAFT)}, a parameter-efficient method that adapts a vision foundation model with a geometry-derived prior. It guides LoRA adaptation by aligning a spatial attention-rollout map with the geometry prior, while preserving pretrained representations. On an intervention-verified forest hazard benchmark, across ten independently trained adaptations, GAFT consistently outperforms frozen DINOv2 and supervised PEFT baselines, improving the repeated leave-one-scenario-out mean $F_2$ from 0.0607 to 0.3757 with statistical significance under paired analysis. Within these independently trained models, the best-performing GAFT model achieves a repeated-LOSO $F_2$ of 0.570. Code and benchmark: https://github.com/Xu-Yanran/geo_anchored_fine_tuning

eess.IV [Back]

[278] Medical Foundation Model Features as Perceptual Loss for Brain MRI Contrast Dose Simulation eess.IV | cs.CVPDF

Changsheng Fang, Dayang Wang, T. Campbell Arnold, Enhao Gong, Srivathsa Pasumarthi

TL;DR: 本文提出使用医学基础模型（如RadImageNet）的特征作为感知损失，替代传统的自然图像预训练模型（如VGG16），以改进脑部MRI对比剂剂量模拟任务。研究分为两个阶段：首先在多个医学影像基准上评估不同特征提取器的性能，RadImageNet表现最佳；随后将其集成到现有剂量模拟框架中，定量指标略有提升，视觉结果显示出更准确的剂量还原轨迹和更少的残留增强。

Details

Motivation: 当前医学图像合成中广泛使用的感知损失（如基于VGG16或ResNet50）源于自然图像预训练模型，与MRI领域存在领域不匹配，可能削弱对解剖结构、对比增强和采集变异的监督。本文旨在探索医学基础模型特征是否能提供更合适的感知损失，以提升脑部MRI对比剂剂量模拟的质量。

Result: 在四个公共医学影像基准（甲状腺超声、乳腺超声、膝关节前交叉韧带MRI、膝关节半月板MRI）上评估特征提取器，RadImageNet取得了最低的平均排名，被选为最佳特征提取器φ*。将其集成到脑部MRI剂量模拟框架后，PSNR从41.63提升至41.74，SSIM从0.9739提升至0.9754，RMSE从0.1384降至0.1369，残留摄取CNR从0.0085降至0.0082。视觉结果显示，RadImageNet减少了标记结构中的残留增强，并更忠实地遵循剂量降低轨迹。

Insight: 主要创新点在于提出使用领域对齐的医学基础模型（如RadImageNet）特征作为感知损失，以解决自然图像预训练模型与医学影像领域不匹配的问题。这为医学图像合成任务提供了一种更合适的特征监督方式，能够更好地捕捉解剖结构和对比增强特性，从而提升合成图像的质量和临床相关性。

Abstract: Perceptual losses are widely used in medical image synthesis because they encourage agreement in high-level structure beyond voxel-wise intensity similarity. In practice, most perceptual losses are still computed with natural-image backbones such as VGG16 or ResNet50, even when the target domain is magnetic resonance imaging (MRI). This mismatch may weaken supervision for anatomy, contrast enhancement, and acquisition variability. We test whether medical foundation model features provide a more suitable perceptual loss for brain MRI contrast dose simulation. The study has two stages. First, we compare RadImageNet, SegVol, and BrainIAC with ImageNet-pretrained VGG16 and ResNet50 as frozen feature extractors on four public medical imaging benchmarks: thyroid ultrasound, breast ultrasound, anterior cruciate ligament knee MRI, and meniscus knee MRI. RadImageNet achieves the lowest mean rank across the Stage I representation suite and is selected as $φ^\star$. Second, we replace only the VGG16 feature extractor in an existing iterative brain MRI dose simulation framework with $φ^\star$. The generator, reconstruction loss, adversarial loss, auxiliary losses, optimization schedule, and loss weights are kept unchanged. Standard metrics change modestly, with PSNR increasing from 41.63 to 41.74, SSIM from 0.9739 to 0.9754, RMSE decreasing from 0.1384 to 0.1369, and residual-uptake CNR from 0.0085 to 0.0082. The visual results show the main effect: RadImageNet reduces residual enhancement in marked structures, follows a more faithful dose-reduction trajectory, and remains close to the acquired 10% low-dose target. These results support domain-aligned radiology features as a practical perceptual feature space for MRI dose simulation, while leaving clinical equivalence and larger-cohort validation as future work.

cs.HC [Back]

[279] Frontier vision-language models have overtaken young adults at detecting AI-generated portraits – but not their calibration cs.HC | cs.CVPDF

Sunwhi Kim, Sunyul Kim, Meounggun Jo, Jini Tae

TL;DR: 本研究评估了19个视觉语言模型在检测AI生成人脸肖像方面的性能，发现2026年7月发布的最新模型（如gpt-5.6-sol和claude-fable-5）在检测准确率上已超越年轻成年人，但模型的校准能力（即判断的置信度与准确性之间的匹配程度）仍不及人类。

Details

Motivation: 随着AI图像生成器能创建难以与真实照片区分的人脸肖像，研究旨在评估视觉语言模型在检测此类图像方面的能力，并与人类表现进行对比。

Result: 在198张人脸肖像（包括真实照片及ChatGPT-4o和Imagen 3生成的匹配图像）的测试中，2026年7月发布的模型如gpt-5.6-sol达到92.8%的平衡准确率，高于20多岁成年人的88.5%，claude-fable-5甚至能检测出所有AI图像；但模型校准指标（c值）从-1.10到+1.45不等，而人类各年龄段均接近零，显示模型存在偏差。

Insight: 论文的创新点在于系统比较了VLMs与人类在AI图像检测任务上的表现，揭示了模型在敏感度上超越人类但在校准能力上不足的差距，强调了模型需改进置信度校准以实现更平衡的信任机制。

Abstract: AI image generators now create face portraits that are hard to tell from real photographs. Vision-language models (VLMs) are increasingly proposed to flag such images. We benchmarked 19 VLMs on the same 198 face portraits – real photographs and identity-matched ChatGPT-4o and Imagen 3 versions – under the same task as our earlier study of 1,667 adults (85% correct overall; accuracy fell steeply with age). The June-2026 cohort of 14 models only matched adults in their 20s-30s. Four weeks later the ceiling broke. Among five July-2026 releases under the identical protocol, gpt-5.6-sol reached 92.8% balanced accuracy (five-draw mean 92.1%), clearly above adults in their 20s (88.5%), and claude-fable-5 detected every AI image while averaging 91.9%. Model sensitivity now exceeds young adults decisively (d’ up to 3.4 versus ~ 2.4). What has not been overtaken is human calibration. Model criteria spread from c = -1.10 to +1.45 while humans sit near zero at every age; both new leaders are biased (+0.44, -0.97), and only a few mid-ranked models approach the human balance. Changing the labelled examples still flipped about one answer in four. The best machines now out-see young adults here, without matching the human balance between suspicion and trust.

cs.CR [Back]

[280] Breaking Darknet CAPTCHAs with general purpose LLM cs.CR | cs.CVPDF

Benjamin Fehrensen, Jens Hubler

TL;DR: 本文评估了自动化方法破解暗网CAPTCHA的有效性，这些CAPTCHA通常无JavaScript支持，具有独特特性。研究聚焦于开环定位、旋转对齐和对象选择三类挑战。实验发现当前多模态大语言模型（MLLMs）在空间定位和几何变换方面存在局限，但通过任务重构或结合专用图像处理工具可缓解。作者提出一个混合框架，利用MLLM进行高层推理和协调，并通过模型上下文协议（MCP）将几何计算委托给确定性算法，从而在所有评估的CAPTCHA类型上实现了超过90%的成功率。

Details

Motivation: 解决暗网环境中常见的、无JavaScript支持的独特CAPTCHA挑战的自动化破解问题，评估现有方法的有效性并弥补其不足。

Result: 提出的混合框架在所有评估的CAPTCHA类型（开环定位、旋转对齐、对象选择）上取得了超过90%的成功率，证明了其高效性。

Insight: 创新点在于结合MLLMs的高层推理能力与经典计算机视觉算法的精确几何计算，通过MCP进行协调，形成优势互补的混合求解框架，显著提升了破解准确率和效率。

Abstract: Our work evaluates the effectiveness of automated methods for solving CAPTCHA challenges commonly encountered in darknet environments. These CAPTCHAs are typically designed to operate without JavaScript, resulting in distinct characteristics compared to mainstream CAPTCHA systems. Our study considers three representative challenge types: open-circle localization, rotation-based alignment, and object-selection CAPTCHAs. The experiments reveal a systematic limitation of contemporary MLLMs: while they are generally capable of identifying relevant visual structures, they frequently struggle with precise spatial localization and geometric transformations. These deficiencies can be mitigated either through task reformulation or by augmenting the models with specialized image processing tools. These deficiencies can be mitigated by task reformulation or by equipping the model with specialized image-processing tools. We therefore propose a hybrid framework in which an MLLM serves as a high-level reasoning and orchestration layer while delegating geometric computations to deterministic algorithms via the Model Context Protocol (MCP). The resulting system achieves success rates above 90% across all evaluated CAPTCHA types and demonstrates that combining the complementary strengths of MLLMs and classical computer vision yields a more accurate and efficient solver than either approach alone.

[281] Asymmetric Phase Coding Video Watermarking cs.CR | cs.CV | cs.GRPDF

Guang Yang, Fengchen Liu

TL;DR: 本文提出了一种非对称相位编码视频水印方案，通过将完整的Ed25519数字签名嵌入到色度平面的相位谱中，实现了无需共享密钥、无需模型或网络即可离线验证的水印系统。该方法采用游程长度时间布局、基于载体的尺度/旋转/平移恢复以及闭环签名过程等技术，显著提升了有效载荷容量和抗攻击能力。

Details

Motivation: 现有视频水印系统多为对称设计，验证方掌握提取器权重或生成密钥，导致易受白盒伪造攻击。本文旨在消除共享密钥依赖，构建可公开验证且抗伪造的非对称水印方案。

Result: 在1000个真实世界视频片段上，系统对99.3%的视频成功生成可验证签名，1000次尝试中未出现错误接受。在通过攻击感知接受门控的视频中，水印可100%抵抗H.264重编码，97.4%抵抗50%缩放，且首次在真实显示-捕获循环中验证有效。

Insight: 创新点包括：1）将完整数字签名嵌入相位谱实现非对称验证；2）游程时间布局通过相关性而非帧索引解码；3）从载体自身恢复几何变换；4）闭环签名通过公开验证器自适应选择嵌入强度。这些设计使有效载荷（1024位）比常见学习方案高一个数量级。

Abstract: Existing video watermarking systems are symmetric: the party that can verify a mark holds the extractor weights or generator secret and can therefore also embed one. Benchmarks confirm the consequence, reporting that white-box forgery defeats all evaluated methods. We present a training-free video watermark that removes the shared secret. The signer embeds a complete Ed25519 signature into the phase spectrum of the chroma plane; any party holding the 32-byte public key and public per-video metadata verifies offline, with no model, no registry, and no network. The payload, 1024 bits of signed message with error correction, is an order of magnitude above common learned payloads and is carried by three design elements: a run-length temporal layout whose decoder identifies payload groups by correlation and never reads a frame index, a payload-free search that recovers scale, rotation, and translation from the carrier itself, and a closed-loop signing procedure that selects each video’s embedding strength by self-verification through the unchanged public verifier. On 1000 uncurated real-world clips the system ships a verifying signature for 99.3% of the corpus and accepts a wrong public key zero times in 1000 attempts. An attack-aware acceptance gate yields embeddings that survive H.264 re-encoding at 100% and 50% rescaling at 97.4% on gated clips. The signature also verifies through a real display and capture loop, an axis absent from published evaluations.

[282] SpatialTrust: A Benchmark for Environmental Risk Recognition in Secure Authentication cs.CR | cs.CVPDF

Junbin Lu, Hsiang-Wei Huang, Saesha Wadhwa, Yu Ting Hsu, Jenq-Neng Hwang

TL;DR: 本文提出了SpatialTrust基准，用于评估多模态大语言模型在安全认证场景中对环境风险的识别能力。该基准测试了敏感因素检测、直接/间接因素识别与解释等五项能力，发现现有模型性能有限，尤其在间接风险理解方面。同时，作者提出了SpatialTrustGuard结构化问答与审计流程，提升了Qwen3-VL-30B-A3B-Instruct模型的性能。

Details

Motivation: 现有MLLM评估很少关注模型在空间定位的安全认证场景中能否可靠识别、定位和解释环境风险，而视觉环境风险识别对保护敏感信息至关重要。

Result: 在SpatialTrust基准上，现有专有和开源MLLM表现有限，整体性能较低；提出的SpatialTrustGuard方法将Qwen3-VL-30B-A3B-Instruct模型的总体准确率从36.78%提升至41.12%。

Insight: 创新点在于构建了首个专注于安全认证环境风险识别的问答基准，并设计了结构化推理流程来提升模型的可信度；客观来看，该研究强调了空间风险感知是MLLM尚未解决的关键挑战，并为模型安全评估提供了新维度。

Abstract: Visual environmental risk recognition plays an important role in secure authentication, where a user’s surroundings may reveal sensitive information or introduce potential security risks. However, existing evaluations of multimodal large language models (MLLMs) rarely examine whether models can reliably recognize, localize, and explain such risks in spatially grounded authentication scenarios. We present SpatialTrust, a question-answering benchmark for evaluating environmental risk recognition in secure authentication. SpatialTrust assesses five complementary abilities: sensitive factor detection, direct factor identification, indirect factor identification, direct factor explanation, and indirect factor explanation. We evaluate both proprietary and open-source MLLMs and find that current models show limited performance, especially in understanding and explaining indirect risks, indicating that spatial risk awareness remains a challenging capability for MLLMs. In addition, we introduce SpatialTrustGuard, a structured QA-and-audit pipeline that improves Qwen3-VL-30B-A3B-Instruct from 36.78% to 41.12% overall. Our findings highlight the need for dedicated benchmarks and structured inference methods to improve the trustworthiness of MLLMs in secure authentication.

cs.SD [Back]

[283] VIBE: Video Instruction-aligned Background music gEneration cs.SD | cs.AI | cs.CL | cs.CV | cs.LGPDF

Aryan Vijay Bhosale, Vaibhavi Lokegaonkar, Vishnu Raj, Gouthaman KV, Sreyan Ghosh

TL;DR: VIBE是一个新颖的文本-视频到音乐生成模型，旨在解决现有视频配乐模型缺乏语义控制和指令遵循能力的问题。它通过创新的深度跨层条件机制和全面的奖励建模方法，实现了对音乐生成在节奏、调性等硬约束以及音乐性、多模态对齐等软约束上的增强控制。

Details

Motivation: 当前视频到音乐模型缺乏语义控制且无法惩罚指令违反，这主要源于其对重建目标的依赖以及扩散自回归架构中静态跨模态条件表示的瓶颈。

Result: 在音频-视觉对齐、指令遵循和音频质量指标以及主观人工评估中，VIBE在增强可控性和指令遵循方面表现优异，同时在生成保真度和多模态对齐方面与大多数评估基线表现相当。

Insight: 主要创新点包括：1. 条件连接，一种动态桥接规划头和扩散细化头的深度跨层条件机制；2. 一个全面的奖励建模分类法，通过结构化的五阶段训练课程，同时优化硬约束和软约束。这为可控生成任务提供了新的条件机制和训练范式。

Abstract: Current video-to-music (V2M) models lack semantic control and fail to penalize instruction violations, largely due to their reliance on reconstruction objectives and the representational bottleneck of static cross-modal conditioning in Diffusion Autoregressive (DAR) architectures. To resolve this, we introduce VIBE, a novel text-and-video-to-music (T+V2M) generation model that leverages: (1) Conditioning Connection, a depth-wise cross-layer conditioning mechanism that dynamically bridges the planning and diffusion refinement heads and (2) a comprehensive reward modeling taxonomy, optimizing for both hard, verifiable constraints (e.g., tempo, key) and soft, subjective qualities (e.g., musicality, multimodal alignment) with a structured 5-stage training curriculum. Upon evaluation using audio-visual alignment, instruction following, and audio quality metrics, along with a subjective human evaluation study, we observe that VIBE demonstrates enhanced controllability and instruction adherence while performing comparably to most evaluated baselines on generation fidelity and multimodal alignment.

Table of Contents

cs.CL [Back]

[1] STAGEET: Stage-wise Typed Edit Tagging for Grammatical Error Correction with Arabic as a Case Study cs.CL | cs.AIPDF

[2] From GenAI Virtual Patient Dialogue Logs to Teacher-Interpretable Process Evidence: A Learning Analytics Study in Higher Education cs.CL | cs.AI | cs.HCPDF

[3] Parametric Multimodal User Memory: Storing What Captions Cannot Carry cs.CL | cs.AI | cs.CVPDF

[4] Looking Again: Measuring Sycophancy in the Reasoning Chains of Multimodal Models Under Pressure cs.CL | cs.AIPDF

[5] MA-RAG: Multi-Agent Retrieval-Augmented Generation for Query-Driven Summarization of Longitudinal Parkinson’s Disease Assessments cs.CL | cs.AIPDF

[6] Do large language models scrutinise what they review? A multimodal audit of scoring calibration, error detection, and author-identity effects cs.CL | cs.AIPDF

[7] Do MLLMs Really Understand Low-Resource Khmer Documents? A Pilot Study on Khmer Document VQA cs.CL | cs.AIPDF

[8] Cross Lingual Transfer in Tulu Legal Comprehension: Script-Dependent Improvement and RAG-Induced Knowledge Conflict cs.CL | cs.AIPDF

[9] Redesigning and Auditing Deep Research Writing for Faithful Reports cs.CL | cs.AIPDF

[10] Can Large Language Models Identify Meaningful Touchpoints in Conversion Attribution? cs.CL | cs.AI | cs.IRPDF

[11] Test-Time Scaling for Scientific Equation Discovery cs.CL | cs.AI | cs.LGPDF

[12] ReVA: A Region-Aware Visual Assistant for Visually Grounded Question Answering cs.CL | cs.CVPDF

[13] A rigor-matched audit of periodic-step layer skipping for efficient llm inference: conflayers versus swift, with a supplemental analysis of trained routing alternatives cs.CL | cs.AI | cs.LGPDF

[14] No Detectable Change in Side-Level WER from Prompt-Level Context: A Preregistered Ablation on a Production Oral-History Corpus cs.CL | cs.AI | cs.SDPDF

[15] CoVA-SFT: A Large-Scale Dataset for Chain of Visual Abstractions cs.CL | cs.CVPDF

[16] HEAR Who Said What: Unlocking Speaker-Attributed Reasoning via Counterfactual Voice Grounding cs.CL | cs.AI | cs.SDPDF

[17] Toward Cultural Alignment: Human-Centered Evaluation of Multimodal AI Stories Across Five African Communities cs.CL | cs.HCPDF

[18] When Patients Cut In: Extending Clinical Conversational AI Safety to Interruptions cs.CLPDF

[19] Anchoring Speech with Semantics: A Multimodal Adapter Mechanism for Automatic Speech Recognition in Low-Resource Languages cs.CL | cs.SD | eess.ASPDF

[20] Modality Fault Lines: Structural Corruptions Reveal Fragile Omni-Modal Reasoning cs.CLPDF

[21] Cloud and On-Premises Deployment of Uzbek Legal RAG via Targeted Retriever Fine-Tuning cs.CL | cs.IRPDF

[22] When to Adapt: Conditional Memory Adapters for Retention-Preserving Domain Specialization cs.CLPDF

[23] AlgoWorlds: Benchmarking Tool Use for Global Optimization in Algorithmic Worlds cs.CLPDF

[24] StageWell: A Process-Aligned Chinese Corpus for Positive-Psychology Support Dialogue cs.CL | cs.AIPDF

[25] Evaluating the Semantic Specificity of Representation Steering in Language Models cs.CLPDF

[26] Chain-of-Thought Faithfulness of Reasoning Models Varies with Where and How Preference Cues Are Delivered cs.CL | cs.AIPDF

[27] Argument-Aware Semantic Alignment of Normative Texts: A Toulmin-Based Neuro-Symbolic Approach cs.CL | cs.AIPDF

[28] Evaluating LLMs on Conversational Text-to-SQL under Chain Ambiguity and Intent Drift cs.CL | cs.AI | cs.DBPDF

[29] Which one is banana man? Evaluating vision-language models in multi-turn pragmatic interpretation cs.CLPDF

[30] SUP-MIMIC: A Multi-Task Clinical Diagnosis Benchmark for Evaluating LLMs’ Robustness to Contradictory Evidence cs.CL | cs.AIPDF

[31] Beyond Surface Alignment: Grounding the Dynamics of Situational Understanding and Generative Control in LLMs cs.CLPDF

[32] JPO: Juris Policy Optimization for Structured Legal Reasoning in Criminal Judgment Prediction cs.CLPDF

[33] Memory-First Fact-Checking: A Knowledge-Graph-Grounded Multi-Agent System for Misinformation Detection cs.CL | cs.AIPDF

[34] MI-Distillation: Selecting from Model-Interpolated Instruct-Reasoning Data Spectrum for Chain-of-Thought Distillation cs.CL | cs.AIPDF

[35] ACTD: Anchor-Based Cross-Tokenizer Distillation with Residual Regularization cs.CLPDF

[36] ReTrace: Rejected-Trajectory Conditioning for Speculative Decoding cs.CLPDF

[37] DVBench: Benchmarking MLLMs for Understanding Dynamic Charts and Narratives in Data Videos cs.CLPDF

[38] A^2Agent: Action-Aware Reinforcement Learning for Repository-Level Code Localization Agents cs.CL | cs.SEPDF

[39] EVAR: Evidence-Validated Hypothesis Admission for Budget-Aware Narrative Reasoning cs.CLPDF

[40] SkillForge: Compositional Skill Synthesis with Verification-in-the-Loop for Generating Formally Verified Dafny Programs cs.CL | cs.PLPDF

[41] Influence-Directed Distillation: Solving the Diversity Bottleneck in Sampled-Token On-Policy Distillation cs.CL | cs.LGPDF

[42] Improving Argument Saliency Coverage in Small LLMs for Long Legal Opinion Summarization via Sequence-Level Distillation cs.CLPDF

[43] GenRubric: Self-Evolving Rubric Generation for Scalable LLM Evaluation cs.CLPDF

[44] When History Is Multimodal: Rethinking Context Management for Long-Horizon Agents cs.CLPDF

[45] REIGN: Refurbished Embeddings with Integrated Guidance Networks for Efficient Context-Length Scaling cs.CL | cs.AI | cs.IRPDF

[46] Compression-Aware Abstention: Teaching LLMs to Refuse When KV-Compression Masks Remove Answer Evidence cs.CL | cs.LGPDF

[47] Detecting Hidden Chain-of-Thought in Large Language Models with Linguistic, Behavioral, and Mechanistic Indicators cs.CLPDF

[48] Small Language Models as Judges for Rubric-Based Reinforcement Learning cs.CLPDF

[49] Budget-Aware Compression Pipeline for Single-GPU LLM Inference: Methods, Trade-offs, and Coupling Effects cs.CLPDF

[50] COGTRL: Training LLMs for Scientific Discovery Assistance using Cognitive Traces via Reinforcement Learning cs.CLPDF

[51] Manacá-1B: An Open, Reproducible Brazilian-Portuguese Language Model and a Tokenizer-Aware, Paired Evaluation cs.CLPDF

[52] Verification-Aware Training for Speculative Decoding cs.CLPDF

[53] CAST: Critique-Aware Supervision for Training Reliable Long-Horizon Tool-Calling Agents cs.CLPDF

[54] Reactivating Test-Time Scaling for Plane Geometry Problem Solving cs.CLPDF

[55] The Differential Reasoning Router: Operationalizing Cost-Aware LLM Annotation in E-commerce cs.CL | cs.AIPDF

[56] When Models Hear What They Expect: Diagnosing Prosodic Heuristics in Multimodal Sarcasm Detection cs.CLPDF

[57] PaperBanana-Interact: Scientific Diagram Refinement with Multi-Turn Human Feedback cs.CL | cs.CVPDF

[58] Beyond Surface Forms: Symbolic Edits as a Test for Logical Reasoning with LLMs cs.CL | cs.AIPDF

[59] Stratified Consistency Distillation for Natural Language Formalization cs.CL | cs.AIPDF

[60] Using Prosody to Predict Syntactic Structure cs.CL | cs.AI | cs.LGPDF

[61] Read the Room, Read the Image: Understanding Indirect Speech Acts in Multimodal Visual Contexts cs.CLPDF

[62] Sequential Trajectories and Simultaneous Blending: Multi-Emotion Modeling for Instruction-Following TTS cs.CL | cs.SDPDF

[63] Do Small Models Use the Law You Give Them? Measuring Context Use on a Bilingual Bangladesh Legal Benchmark cs.CLPDF

[64] When LLM Meets Tree Search: A Systematic View of Inference as Search in Large Language Models cs.CLPDF

[65] Co-Evolving Actor-Conditioned Critics for Non-Verifiable Generation cs.CLPDF

[66] Beyond Polarization: The Generative Constraint of Chain-of-Thought in Pointwise Reranking cs.CL | cs.IRPDF

[67] SemPOI-RL: Aligning LLM Semantic Reasoning for Interpretable Out-of-Town POI Sequential Generation cs.CL | cs.AIPDF

[68] Learning to Reason and Use Tools through Unsupervised Fine-Tuning in Task-Oriented Dialog Systems cs.CLPDF

[69] Lies We Can See: Joint Verbal and Non-Verbal Deception by VLM Agents in Embodied Social Interactions cs.CL | cs.AI | cs.CV | cs.LGPDF

[70] From Final Artifacts to Trajectories: Retrospective Process Supervision for Evidence-Grounded Long-Form Generation cs.CLPDF

[71] Enhancing Low-Resource Language Reasoning via High-Resource Language Feature Transfer cs.CL | cs.AIPDF

[72] More Capable, Less Faithful: A Multilingual Analysis of Mathematical (Un)Solvability Detection in LLMs cs.CLPDF

[73] ImageEval 2026: Culturally Grounded Arabic Multimodal Evaluation cs.CL | cs.AIPDF

[74] UTILMEM: Benchmarking Evidence Utilization in Long-Term Conversational Memory cs.CLPDF

[75] WebWorld: The Browser as a World Model for Self-Improving Web Code cs.CL | cs.SEPDF

[76] REER-PT: Reverse-Engineered Reasoning for Perplexity-Guided Pre-training Data Augmentation cs.CLPDF

[77] GMTS: Gradient Magnitude-based Token Selection Improves RLVR Training for LLM Reasoning cs.CL | cs.AI | cs.LGPDF

[78] BiG-SURE - Bipartite Graph for Semantic Uncertainty and Reliability Estimation of LLMs cs.CL | cs.AI | cs.LGPDF