cs.CL [Total: 50]
cs.CV [Total: 94]
cs.SE [Total: 2]
cs.MM [Total: 1]
eess.AS [Total: 1]
cs.MA [Total: 1]
cs.LG [Total: 6]
cs.RO [Total: 1]
cs.CR [Total: 1]
cs.IR [Total: 1]

cs.CL [Back]

[1] Domain Adaptation and Reasoning Frameworks in Language Models: A Controlled Experiment with Historical Cosmology cs.CL | cs.AIPDF

Francesco De Bernardis

TL;DR: 本文通过历史宇宙学作为受控场景，研究领域适应如何重塑语言模型的解释行为。实验分为两个阶段：第一阶段训练小型语言模型于移除日心说引用的前哥白尼语料，观察地动或日心说延续是否出现；第二阶段使用QLoRA对大型预训练模型进行微调，分析适应如何改变解释框架和宇宙学立场。评估采用LLM-as-judge框架标注宇宙学立场（地心说、日心说或模糊）和解释框架（前现代与现代）。

Details

Motivation: 探究领域适应对语言模型解释行为的影响，特别是在历史宇宙学领域，了解模型如何通过语料适应改变其解释框架和立场。

Result: 第一阶段中，小型模型偶尔生成本土地动延续，但全局不稳定且无法支持连贯的宇宙学推理；第二阶段微调导致前现代解释框架显著增加，而宇宙学立场分布相对稳定，地心说输出的增加主要源于解释框架的重新分配而非立场直接改变。

Insight: 领域适应可能主要通过重塑生成延续的语言框架来影响模型输出，立场变化是这些框架转变的次要结果；使用QLoRA进行高效微调结合LLM-as-judge评估框架，为分析语言模型行为提供了可控实验方法。

Abstract: We investigate how domain adaptation reshapes explanatory behavior in language models using historical cosmology as a controlled setting. In Phase 1, we train a small language model from scratch on a pre-Copernican corpus from which explicit heliocentric references were removed, and evaluate whether Earth-motion or heliocentric continuations nevertheless emerge. In Phase 2, we fine-tune a larger pretrained model using QLoRA on the same corpus in order to study how adaptation modifies explanatory framing and cosmological stance. Model outputs are evaluated using an LLM-as-judge framework that labels both cosmological stance (geocentric, heliocentric, or ambiguous) and explanatory frame (premodern versus modern). In the constrained setting of Phase 1, the smaller models occasionally generate local Earth-motion continuations, but these remain globally unstable and insufficient to support coherent cosmological reasoning. In Phase 2, fine-tuning induces a large and statistically significant shift toward premodern explanatory framing, while the conditional cosmological stance distributions remain comparatively stable within those frames. As a result, increases in geocentric outputs arise primarily from redistribution over explanatory regimes rather than from direct modification of stance. These results suggest that domain adaptation may primarily reshape the linguistic frameworks from which continuations are generated, with changes in stance emerging secondarily from those shifts.

[2] Can LLM Teams Play What? Where? When? cs.CLPDF

Anastasia Kotelnikova, Viktor Byzov, Maria Dolzhenkova, Evgeny Kotelnikov

TL;DR: 该论文研究了基于团队的交互策略是否能提升大语言模型在需要间接推理、文化知识和协调假设测试的复杂问答任务中的表现。作者在What? Where? When? (ChGK) 问答游戏上测试了三种团队策略：投票、沉默团队（队长只观察最终答案）和健谈团队（队长观察答案和推理过程）。实验表明，团队策略显著优于单模型基线，最高可将准确率提升20个百分点。

Details

Motivation: 大语言模型在需要间接推理、文化知识和协调假设测试的任务上仍存在局限。论文旨在探索基于团队的交互是否能通过集体推理来提升LLM在此类复杂任务（如ChGK问答游戏）上的性能。

Result: 在包含572个2025年发布的ChGK问题的数据集上，使用六个近期的大规模开源模型进行测试。团队策略优于单模型基线，准确率最高提升20个百分点。最佳团队达到44.23%的准确率，在有人类统计结果的问题上接近人类团队水平。分析表明，模型间的分歧强烈预示着较低的准确率，但解释性沟通能显著缓解性能下降。

Insight: 论文的创新点在于系统性地比较了不同LLM团队协作策略（投票、沉默团队、健谈团队）在复杂推理任务中的效果。客观来看，其核心发现是LLM团队主要充当答案选择和错误过滤机制，而非新解决方案的生成器，这为多智能体系统的自适应策略设计提供了重要启示。

Abstract: Large language models (LLMs) remain limited on tasks requiring indirect reasoning, cultural knowledge, and coordinated hypothesis testing. We investigate whether team-based interaction improves LLM performance in What? Where? When? (ChGK), a quiz game designed to reward collective reasoning. We introduce three team strategies: Voting, Silent Team (the captain observes final answers), and Talkative Team (the captain observes both answers and rationales). To minimize data leakage, we evaluate these strategies on a dataset consisting of 572 ChGK questions released in 2025. Using six recent large-scale open models, we show that team-based strategies outperform single-model baselines, yielding gains of up to 20 percentage points in accuracy. The best team achieves 44.23% accuracy, and approaches human team performance on questions with available human statistics. Analysis of inter-model diversity reveals that disagreement strongly predicts lower accuracy, but explanatory communication substantially mitigates performance drops. We further examine captain behavior and find no evidence of self-preference bias; access to peer rationales improves captain judgments. Overall, LLM teams function primarily as answer selection and error-filtering mechanisms rather than generators of novel solutions. Our findings highlight the importance of interaction and suggest adaptive strategies as a promising direction for multi-agent systems.

[3] Your Multimodal Speech Model Says I Have a Face for Radio cs.CLPDF

Maya K. Nachesa, Vlad Niculae, Vagrant Gautam

TL;DR: 本文首次对多模态语音识别模型进行了偏见评估，通过将不同人脸与相同音频配对创建视频，测量语音转录准确率的变化。研究发现，mWhisper-Flamingo和Gemini模型在自我声明的性别、种族及其交叉维度上存在显著的服务质量差异，词错误率下降高达4.05个百分点。

Details

Motivation: 随着多模态模型处理更多数据模态，研究旨在探索新模态如何影响模型性能与偏见，尤其是在人类中已知存在偏见的情况下，目前缺乏对多模态语音识别的偏见评估。

Result: 在mWhisper-Flamingo和Gemini模型上，观察到基于性别、种族及其交叉维度的词错误率差异，最高下降4.05个百分点，表明模型存在服务质量偏见。

Insight: 创新点在于首次系统评估多模态语音识别中的偏见，揭示增加模态信号不一定改善性能，反而可能引入偏见，强调开发者需评估、修复并沟通此类限制。

Abstract: As large neural models have become better at language tasks, researchers are increasingly building multi- and omnimodal models that handle more modalities of data. One example is the expansion of speech recognition models to audio-visual data for noise mitigation and multimodal subtitling. While performance and bias have been studied extensively in the single-modality regime, it is unknown how new modalities affect this, even though they produce biases in humans. We therefore propose the first bias evaluation of multimodal speech recognition, where we create videos pairing different faces with the same audio, and measure changes in speech transcription accuracy. We find large quality-of-service differences across mWhisper-Flamingo and Gemini models, with drops of up to 4.05 word error rate points, across self-declared gender, ethnicity, and their intersection. Our findings point to a priority for developers to evaluate, fix, and communicate such limitations, as providing more signals through additional modalities is not necessarily better, and may even lead to biased outcomes.

[4] Semantic Motion Anchors: Bridging Motion and Meaning in Co-Speech Gestures cs.CLPDF

Varsha Suresh, Mohammad Mahdi Abootorabi, Mohamed Salman, M. Hamza Mughal, Christian Theobalt

TL;DR: 本文提出了一种名为‘语义运动锚点’的方法，用于在语音手势中建立语音文本与手势运动之间的共享表示，以改进手势检索、合成和理解。该方法通过将3D手势离散化为身体-手部运动基元，并将其转化为结构化描述，然后与文本转录进行对比监督，从而更好地捕捉语义手势的交流意图。

Details

Motivation: 当前语音手势检索和合成中，直接对比文本转录与连续运动嵌入的方法往往过度强调低层次运动学特征，而忽略了语义手势的符号内容，导致无法有效捕捉具有交流意图的语义手势。

Result: 在BEAT2数据集上，该方法在文本到手势检索的R@1指标上比直接文本-运动基线提高了8.2%，并在文本到手势和手势到文本检索方向上优于先前检索方法；下游检索增强手势生成研究中，用户显著偏好于本方法检索出的手势。

Insight: 创新点在于引入语义运动锚点作为自然语言抽象，通过离散化和语言化手势运动来提供辅助对比监督，从而在检索中更好地匹配语义内容而非默认通用运动模式，提升下游生成手势的交流意图传达效果。

Abstract: Learning a shared representation between spoken text and gesture is central to co-speech gesture retrieval, synthesis, and understanding, but remains challenging for semantically meaningful gestures whose communicative intent is not captured by motion alone. Direct contrastive alignment between transcripts and continuous motion embeddings often overemphasizes low-level kinematics and misses the symbolic content of semantic gestures. We propose semantic motion anchors, natural-language abstractions of gesture motion capturing physical form and communicative intent. Our method discretizes 3D gestures into body-hand motion primitives, verbalizes them into structured descriptions, and grounds them in the transcript to provide auxiliary contrastive supervision. On BEAT2, our method improves text-to-gesture R@1 by 8.2% over a direct text-motion baseline and outperforms prior retrieval approaches on text to gesture and gesture to text retrieval directions. Beyond aggregate retrieval metrics, semantic motion anchor supervision helps retrieve gestures that are semantically meaningful for the spoken query, rather than defaulting to generic motion patterns. A downstream retrieval-augmented gesture generation study showed that users significantly preferred gestures retrieved by our approach over a retrieval-augmented generation baseline, demonstrating that semantically grounded retrieval translates to gestures that better convey communicative intent in downstream generation.

[5] ImmigrationQA: A Source-Grounded Dataset and Small-Model Adaptation for U.S. Immigration Law cs.CL | cs.AIPDF

Nazarii Shportun

TL;DR: 本文介绍了ImmigrationQA数据集，这是一个基于美国移民法源文件的问答数据集，包含17,058个问答对，覆盖13个移民子领域。作者使用LoRA方法对Llama 3.2 3B Instruct模型在该数据集上进行了微调，并在一个101个样本的分层评估集上，使用LLM-as-judge评分方法进行评估。微调后的模型在平均分上相比基础模型有27%的相对提升，尤其在程序性子领域表现更好，但在复杂法律推理和时间敏感统计方面仍较弱。所有数据、模型和代码均已公开。

Details

Motivation: 美国移民法体系庞大且频繁变更，对缺乏法律代表的申请人影响重大。为了解决这一领域缺乏高质量、基于源文件的问答数据集的问题，并探索小模型在专业法律领域的适应能力，作者构建了ImmigrationQA数据集并进行了模型微调研究。

Result: 在101个样本的分层评估集上，微调后的Llama 3.2 3B模型平均得分为1.08/3.0（16.8%完全正确），相比基础Llama 3 8B模型的0.85/3.0（4%完全正确）有27%的相对提升。零样本Claude Sonnet基线得分为1.52/3.0（25%完全正确）。微调模型在旅行证件、身份调整、非移民签证等程序性子领域有集中改进。

Insight: 主要创新点包括：1）构建了一个高质量、基于多源官方文件的美国移民法专业问答数据集（ImmigrationQA），并公开了完整构建流程；2）展示了使用参数高效的LoRA方法对较小规模模型（3B参数）进行领域特定微调的可行性和成本效益（约29美元），使其在特定任务上能超越更大的基础模型；3）提供了在专业领域使用LLM-as-judge进行模型评估的实践案例。这为其他垂直领域构建专业问答系统和高效微调小模型提供了可借鉴的范式。

Abstract: U.S. immigration law spans thousands of pages of official policy, federal regulations, and procedural guidance that change frequently and carry high stakes for petitioners who lack legal representation. We describe the construction of ImmigrationQA, a source-grounded question-answering dataset of 17,058 pairs across 13 immigration subdomains, and the fine-tuning of a Llama 3.2 3B Instruct model on that dataset using parameter-efficient LoRA. The corpus was assembled from 11 primary and secondary sources – including the USCIS Policy Manual, 8 CFR, BIA precedent decisions, and community Q&A – yielding 10,056 validated canonical documents and 18,308 text chunks. Structured QA pairs were generated from these chunks using Claude Sonnet 4.6 via five mode-specific prompts, with 22 pairs rejected for insufficient source-span overlap. The fine-tuned model was evaluated against a held-out split of 993 pairs using LLM-as-judge scoring on a 101-example stratified sample. The fine-tuned model scored a mean of 1.08/3.0 (16.8% fully correct; 101-example stratified eval) versus the Llama 3 8B base model at 0.85/3.0 (4% fully correct), a relative improvement of 27% in mean score; a zero-shot Claude Sonnet baseline scored 1.52/3.0 (25% fully correct). The fine-tuned model shows concentrated improvement in procedural subdomains (travel documents, adjustment of status, nonimmigrant visas) while remaining weak on complex legal reasoning and time-sensitive statistics. The full pipeline ran for approximately $29 in cloud compute. All artifacts – dataset, model, code, and prompt templates – are publicly released. The system is not a substitute for legal counsel and does not reflect regulatory changes after the corpus crawl date.

[6] COFT: Counterfactual-Conformal Decoding for Fair Chain-of-Thought Reasoning in Large Language Models cs.CL | cs.AIPDF

Arya Fayyazi, Mehdi Kamal, Massoud Pedram

TL;DR: COFT是一种无需训练的推理时解码方法，通过反事实掩码提示、轻量级logit融合和双分支分形校准三个步骤，在保持任务效用和语言质量的同时，显著降低大语言模型思维链生成中的社会偏见。该方法在六个模型和多个偏见基准测试中，将标准偏见指标降低了30-55%（中位数38%），计算开销仅相当于一次额外的缓存前向传播（<=11%）。

Details

Motivation: 解决大语言模型在思维链生成过程中揭示和放大社会偏见的问题，旨在提供一种无需重新训练、无需辅助分类器或权重访问的公平解码方案。

Result: 在六个模型和多个偏见基准测试中，COFT将标准偏见指标降低了30-55%（中位数38%），同时推理准确率保持在运行间噪声范围内，任务效用和语言质量得以保留。

Insight: 创新点在于将反事实推理与分形预测相结合，通过解码时的令牌级公平控制，为任何冻结的因果语言模型提供分布无关的边缘有效性保证，提供了一条清晰、可审计的路径来实现更安全的思维链生成。

Abstract: Large language models (LLMs) can reveal and amplify societal biases during chain-of-thought (CoT) generation. We present COFT (Chain of Fair Thought), a training-free decoding method that applies token-level fairness control at decode time, with distribution-free marginal validity guarantees (under exchangeability) for any frozen causal language model. COFT operates in three stages. First, it creates a masked counterfactual prompt by replacing sensitive spans with neutral tokens. Second, it compares the factual and masked logit distributions through lightweight logit fusion to attenuate attribute-driven biases. Third, it uses dual-branch split-conformal calibration to certify per-step candidate token sets at a user-chosen risk level. We evaluate COFT across six models and multiple bias benchmarks. Our method reduces standard bias metrics by 30-55% (median 38%) while preserving task utility and language quality. Reasoning accuracies remain unchanged within run-to-run noise margins. The computational overhead is modest, equivalent to one additional cached forward pass (<=11%). COFT offers a clear, auditable path to safer CoT generation with significant bias reduction, negligible utility loss, and no requirement for retraining, auxiliary classifiers, or weight access.

[7] EUDAIMONIA: Evaluating Undesirable Dynamics in AI cs.CL | cs.AI | cs.HCPDF

Jun Rui Huang, Wang Bill Zhu, Ziyi Liu, Nathanael Fast, Ravi Iyer

TL;DR: 该论文提出了一个名为EUDAIMONIA的基准测试，用于评估大型语言模型（LLMs）在社交互动中可能引发的有害动态，如鼓励有害的亲密关系、依赖性或过度投入。研究基于Social AI Design Code框架，构建了包含969个用户输入和3,147项违规检查的基准，并测试了22个近期LLMs，发现即使是顶级模型也存在显著的违规率。

Details

Motivation: 当前LLMs越来越多地被用作伴侣、情感倾诉和人际建议的对话伙伴，但传统的能力导向或安全评估未能捕捉这些社交互动中可能产生的危害，因此需要专门评估LLMs是否在社交互动中与用户福祉保持一致。

Result: 在EUDAIMONIA基准上评估22个近期LLMs，发现最强的模型Claude-Opus-4.7和GPT-5.5分别违反了30.7%和27.2%的检查；扩展思考并未降低违规率，表明这些失败是持久的社会对齐问题。

Insight: 论文的创新点在于提出了Social AI Design Code框架和EUDAIMONIA基准，专注于评估LLMs在社交互动中的有害动态，而非传统能力；通过弱到强过滤、多模型重新标注和受控重写等方法构建基准，揭示了LLMs在社会对齐方面的持续性问题，而非仅靠推理即可解决。

Abstract: Large language models (LLMs) are increasingly used as conversational partners for companionship, emotional disclosure, and interpersonal advice, but the social dynamics of these interactions can create harms that are not captured by capability-oriented or traditional safety evaluations. We introduce the Social AI Design Code, a framework for evaluating whether LLMs align with user welfare in social interactions, including whether they encourage harmful intimacy, dependence, or prolonged engagement. To evaluate these risks in natural and diverse user-LLM interactions, we operationalize the code with EUDAIMONIA, a benchmark of 969 user inputs and 3,147 design-requirement violation checks built from WildChat through weak-to-strong filtration, multi-model relabeling, and controlled rewriting. Evaluating 22 recent LLMs, we find that even the strongest models, Claude-Opus-4.7 and GPT-5.5, violate 30.7% and 27.2% of checks, respectively. Extended thinking does not reduce violation rates, suggesting that these failures are persistent social-alignment problems rather than deficits solvable through test-time reasoning alone.

[8] CobSeg: Coherence Boundary Modeling for Dialogue Topic Segmentation cs.CL | cs.AIPDF

Sijin Sun, Liangbin Zhao, Jiaxiang Cai, Ming Deng, Mingyu Luo

TL;DR: 本文提出CobSeg模型，用于对话主题分割任务。该模型采用多分支架构，分别建模连贯性层面的语义连续性和词汇边界转换，并通过方向性边界预测进行恢复。模型进一步利用边界信息加权来强调高效用的话语位置，并结合语料库衍生的主题连贯性线索。

Details

Motivation: 现有的话语模型在处理对话主题分割时，常常会稀释局部的词汇信号，而该任务需要识别异质的边界线索，包括话语边缘的词汇转换和跨话语的语义不连续性。

Result: 在五个基准测试上，CobSeg在P_k和W_d指标上均有提升，特别是在局部词汇线索显著时。在有监督的金标准边界训练下，在VHF数据集上P_k降低0.7点，W_d降低0.6点，在DialSeg711上P_k达到1.0。在自动诱导边界的伪标签设置下，在VHF上P_k降低14.8点，在DialSeg711上降低1.5点，在TIAGE上降低1.1点，超越了之前的非LLM方法。

Insight: 创新点在于将语义连续性与词汇边界转换分离建模的多分支架构，以及结合边界信息加权和语料库衍生主题连贯性线索的机制。该方法在推理时无需调用LLM，实现了增强的边界预测。

Abstract: Dialogue topic segmentation is critical in many human-AI collaborative applications which requires identifying heterogeneous boundary cues, including lexical transitions near utterance edges and semantic discontinuities across utterances. Existing utterance models often dilute these local lexical signals. We propose CobSeg, a novel multi-branch architecture that separates coherence-level semantic continuity from lexical boundary transitions and recovers both through directional boundary prediction. CobSeg further uses boundary informativeness weighting to emphasize high-utility utterance positions, and incorporates a corpus-derived topic coherence cue with learned combination weights. While CobSeg is evaluated as a compact trainable segmenter under supervised gold-boundary training and a pseudo-label setting with automatically induced boundaries, it performs enhanced boundary prediction without LLM calls during inference. Across five benchmarks, it improves $P_k$ and $W_d$ particularly when local lexical cues are prominent: under gold supervision, it reduces $P_k$ by 0.7 points and $W_d$ by 0.6 points on VHF, and reaches $P_k$ of 1.0 on DialSeg711; with induced boundaries, it reduces $P_k$ by 14.8 points on VHF, by 1.5 points on DialSeg711, and by 1.1 points on TIAGE, outperforming prior non-LLM approaches.

[9] TeachObs: A Human-Validated Benchmark for Multimodal Teaching Observation and Model Evaluation cs.CLPDF

Yeil Jeong, Youngjin Yoo, Seobin Sohn, Hyejin Han, Jinseo Lee

TL;DR: 本文提出了TeachObs基准，这是一个经过人工验证的多模态教学观察基准，用于评估模型在课堂视频分析中的表现。该基准包含30个公开课视频，划分为5,158个15秒片段，并由研究人员标注了39个二元观察代码，涵盖视觉和非视觉教学实践。基于此，作者评估了五个前沿视觉大语言模型在三个任务上的性能，发现没有模型在所有任务上均表现最优，并揭示了模型评估与专家评分之间的差异。

Details

Motivation: 课堂视频包含可观察的教学实践，但其教学和视觉信号通常缺乏适合模型评估的组织形式。因此，需要构建一个经过人工验证的多模态基准，以系统评估AI模型在教学视频分析中的能力。

Result: 在TeachObs基准上评估了五个视觉大语言模型，涉及仅文本片段编码、文本+帧片段编码以及课程级覆盖评分三个任务。结果显示，没有单一模型在所有任务上持续优于其他模型；添加中间帧会增加每个场景的真假归因；模型评估相对于专家评分会高估程序清晰的课程。

Insight: 创新点在于构建了一个结合细粒度片段标注和整课评估的多模态教学观察基准，支持对AI系统在课堂视频分析中辅助能力的评估，并明确了专家判断在不同学科、课堂形式和标注难度下仍必要的领域。

Abstract: Classroom videos contain observable teaching practices, but their pedagogical and visual signals are rarely organized in forms suitable for model evaluation. We present \textit{TeachObs}, a human-validated benchmark for multimodal teaching observation in classroom videos. \textit{TeachObs} includes 30 public lesson videos from eight countries divided into 5,158 fixed 15-second scenes. Seven researchers annotated each scene with 39 binary observation codes, covering 20 visual codes, such as gesture, board work, pointing, and visual materials, and 19 nonvisual codes, such as instruction, monitoring, questioning, feedback, and reflection. Gold segment labels are constructed using reliability- and prevalence-aware rules based on Krippendorff’s alpha. In addition to segment-level labels, three expert raters produced lesson-level ratings and qualitative evaluations of instructional design, instructional delivery, learner response, learning materials, and lesson closure across the 30 lessons, with rater coverage detailed in the body. Using these two human reference layers, we evaluate five vision-capable frontier LLMs across three tracks - text-only segment coding, text + frame segment coding, and lesson-level coverage scored under an LLM-as-judge protocol - and find that no single model consistently outperforms others across all three tracks, that adding a mid-frame inflates both true and false attributions per scene, and that model evaluations over-rate procedurally clear lessons relative to expert raters. \textit{TeachObs} therefore supports both fine-grained annotation benchmarking and whole-lesson evaluation, showing where AI systems can assist classroom video analysis and where expert judgment remains necessary across varied subjects, classroom formats, and annotation difficulty levels.

[10] SAGE: A Novelty Gate for Efficient Memory Evolution in Agentic LLMs cs.CL | cs.AI | cs.LG | stat.MLPDF

Sijia Wang, Dhanajit Brahma, Ricardo Henao

TL;DR: 本文提出了一种名为SAGE的新型记忆演化门控机制，用于智能体大语言模型（Agentic LLMs）的高效记忆管理。它将记忆演化视为新颖性检测问题，通过基于冯·米塞斯-费希尔分布的密度估计器和自适应阈值来评估新事实，从而决定是添加、忽略还是合并到现有记忆中，以减少昂贵的LLM推理调用。

Details

Motivation: 现有工作主要关注记忆的检索和存储，而缺乏对写入侧（write-side）进行原则性控制的方法。智能体LLM需要持续决策新提取的事实是应被添加、与现有记忆合并还是忽略，因此需要一个高效、可控的记忆写入机制。

Result: 在LoCoMo基准测试中，SAGE在所有七个开源权重骨干模型的比较中，针对Mem0取得了最佳的平均token-F1分数。使用GPT-4o-mini时，它将添加阶段的API成本降低了3.4倍，延迟降低了2.5倍，且平均法官评分差距很小。作为A-Mem的即插即用二进制门，SAGE在五个模型上跳过了大约16-18%的LLM调用，且在开源权重骨干上质量变化最小。

Insight: 论文的核心创新点是将记忆演化形式化为新颖性检测问题，并提出了一个基于球面自适应阈值（Spherical Adaptive Gate）的密度估计器来路由新事实。这提供了一种轻量级、可解释的写入控制机制，能在保证记忆质量的同时，显著提升系统效率，为长期智能体记忆系统的优化提供了一个实用的杠杆。

Abstract: Agentic LLMs must continuously decide whether newly extracted facts should be added, merged with existing memories, or ignored, yet prior work has focused more on retrieval and storage than on principled write-side control. We frame memory evolution as a novelty-detection problem and propose SAGE, a Spherical Adaptive Gate for memory Evolution that scores candidate facts with a von Mises-Fisher-based density estimator over memory embeddings and routes them with an adaptive threshold that tracks memory-store geometry. SAGE resolves clearly novel facts as ADD, clearly redundant facts as NOOP, and sends only uncertain cases to an LLM merge step, reducing expensive write-time reasoning. On LoCoMo, SAGE achieves the best average token-F1 against Mem0 on all seven open-weight backbone comparisons, while on GPT-4o-mini it reduces add-phase API cost by 3.4$\times$ and add-phase latency by 2.5$\times$ with only a small average judge-score gap. As a drop-in binary gate for A-Mem, SAGE skips roughly 16-18% of LLM calls across five models with minimal quality change on open-weight backbones. These results suggest that novelty-aware write control is a practical lever for improving both memory quality and system efficiency in long-term agentic memory.

[11] ExpGraph: Model-Agnostic Experience Learning with Graph-Structured Memory for LLM Agents cs.CLPDF

Tao Feng, Chongrui Ye, Tianyang Luo, Jingjun Xu, Xueqiang Xu

TL;DR: 本文提出ExpGraph，一种模型无关的经验学习框架，通过图结构记忆存储历史轨迹中的技能和失败教训，使冻结或可替换的LLM执行器无需参数更新即可复用外部经验。该方法在静态任务和代理环境中显著提升了性能并减少了交互步骤。

Details

Motivation: 现有LLM代理通常从零开始解决任务，难以复用先前成功的策略或失败教训；而基于收集经验进行微调的方法在出现更强或更合适的执行器时不够灵活。

Result: 在涵盖问答、数学推理、代码生成以及ALFWorld和AppWorld等多步代理环境的ExpSuite基准上，ExpGraph相比最强基线在较小和较大执行器的静态任务上分别提升12.2%和4.7%，在代理环境中分别提升21.4%和12.7%，同时平均交互步骤减少12.7%和21.6%。

Insight: 创新点在于将经验组织为自演化的图结构，结合图扩散和效用感知排序进行检索，并通过强化学习训练轻量级检索副驾驶；客观来看，其模型无关性、在线图更新机制以及联合利用图结构、效用排序和自适应检索，实现了跨任务和模型的通用经验复用。

Abstract: Large language model (LLM) agents have shown strong capabilities in reasoning, tool use, and multi-step interaction, but they often solve tasks from scratch and fail to reuse successful strategies or failure lessons from prior experience. Fine-tuning on collected experience can improve reuse, but it is inflexible when stronger or more suitable executors emerge. We propose ExpGraph, a model-agnostic experience learning framework that enables frozen and replaceable LLM executors to improve through external experience reuse without parameter updates. ExpGraph summarizes historical trajectories into reusable skills and failure lessons, organizes them as nodes in a self-evolving experience graph, and retrieves useful experiences through graph diffusion and utility-aware ranking. A lightweight retrieval copilot is trained with reinforcement learning using feedback that compares executor performance with and without retrieved experiences, while the graph is updated online from downstream task outcomes. We evaluate ExpGraph on ExpSuite, covering question answering, mathematical reasoning, code generation, and multi-step agentic environments including ALFWorld and AppWorld. ExpGraph improves over the strongest baseline by 12.2% and 4.7% on static tasks with smaller and larger executors, and by 21.4% and 12.7% in agentic environments, while reducing average interaction steps by 12.7% and 21.6%. Ablations show that graph-structured experience, utility-aware ranking, and adaptive retrieval jointly enable effective experience reuse across diverse tasks and executor models.

[12] MosaicLeaks:Privacy Risks in Querying-in-the-Open for Deep Research Agents cs.CLPDF

Alexander Gurung, Spandana Gella, Alexandre Drouin, Issam H. Laradji, Perouz Taslakian

TL;DR: 该论文提出了MosaicLeaks基准，用于评估深度研究智能体在结合本地私有文档与外部网络检索时，通过外部查询泄露敏感信息的隐私风险。研究发现，现有模型普遍存在泄露问题，并提出了结合任务成功奖励与隐私分类器的强化学习框架PA-DR，在提升任务准确率的同时显著降低了信息泄露。

Details

Motivation: 解决深度研究智能体在开放查询环境中，因马赛克效应（即看似无害的单个查询在聚合后可能泄露信息）而导致的隐私泄露风险。

Result: 在MosaicLeaks基准（包含1001个多跳深度研究任务）上评估，发现不同家族和规模的模型在三个隐私级别（研究意图、具体问题答案、可验证声明）均频繁泄露；提出的PA-DR框架将Qwen3-4B-Instruct的准确率从48.7%提升至58.7%，并将答案和完整信息泄露率从34.0%降至9.9%。

Insight: 创新点在于构建了首个针对深度研究智能体隐私泄露的基准测试，并提出了一个结合情境奖励和隐私分类器的强化学习框架PA-DR，实现了任务性能与隐私保护的双重优化，为隐私敏感的AI系统设计提供了新思路。

Abstract: Deep research agents increasingly combine private local documents with external tools like web retrieval, creating a privacy risk: an agent’s external queries may leak sensitive information from its local context. This risk is amplified by the mosaic effect, where individual queries may appear harmless but become revealing in aggregate. We introduce MosaicLeaks, a benchmark of 1,001 multi-hop deep research tasks that chain private enterprise documents and a public web corpus, forcing agents to make external queries that depend on local information. We evaluate leakage with an adversary LLM that observes only the agent’s external queries and attempts to infer private information at three levels: the agent’s research intent, answers to specific private questions and verifiable claims about the enterprise documents. We find that models across families and sizes frequently leak at all three levels, that zero-shot privacy prompting reduces but does not eliminate leakage and that reinforcement learning for task performance alone worsens leakage. To address this, we propose Privacy-Aware Deep Research (PA-DR), an RL framework that combines situational rewards for task success with a learned privacy classifier to provide dense credit assignment over both per-query and mosaic-level leakage. Training Qwen3-4B-Instruct with PA-DR improves accuracy from 48.7% to 58.7% and reduces answer and full-information leakage from 34.0% to 9.9%.

[13] Your Teacher Can’t Help You Here: Combating Supervision Fidelity Decay in On-Policy Distillation cs.CL | cs.AIPDF

Yanjiang Liu, Jie Lou, Xinyan Guan, Yuqiu Ji, Hongyu Lin

TL;DR: 本文提出了一种名为Lookahead Group Reward（LGR）的新方法，用于缓解策略蒸馏中的监督保真度衰减问题。该方法通过评估学生模型生成的候选令牌在下一步诱导出的教师置信度来分配奖励，并结合熵触发的树注意力机制保持计算效率。在六个数学和代码基准测试中，该方法显著提升了学生模型的性能。

Details

Motivation: 论文的动机是解决策略蒸馏中一个关键瓶颈——监督保真度衰减，即随着学生生成的前缀增长，教师模型的下一个令牌分布变得不那么自信和具有区分性，导致依赖于教师的纠正信号减弱，学生模型在长推理链中产生漂移。

Result: 在六个数学和代码基准测试上，该方法将7B参数学生模型的平均性能（mean@8）提升了2.57个百分点，在生成长度增加时增益更大，在AIME-26基准（39k令牌）上达到了+4.92个百分点的提升。

Insight: 论文的创新点在于提出了Lookahead Group Reward机制，利用下一步教师置信度来评估当前学生候选令牌，以增强长序列生成中的监督信号；同时设计了熵触发的树注意力机制来平衡性能与计算开销，为长上下文推理任务中的蒸馏提供了新思路。

Abstract: On-policy distillation transfers reasoning capabilities by training a student model on its own generated trajectories using token-level feedback from a teacher. However, we identify a critical bottleneck, \textbf{Supervision Fidelity Decay (SFD)}: as student-generated prefixes lengthen, the teacher’s next-token distribution becomes less confident and less discriminative. Consequently, the teacher-dependent corrective signal in reverse-KL distillation weakens, causing student drift to compound across long reasoning chains. To mitigate SFD, we introduce \textbf{Lookahead Group Reward (\ours{})}. Building on the insight that next-step teacher confidence reflects the discriminative strength of future reverse-KL supervision, \ours{} evaluates the student’s top-K candidate tokens by the teacher confidence they induce at the subsequent step and assigns a group-normalized reward. To maintain computational efficiency, we further design an entropy-triggered tree-attention mechanism. Across six math and code benchmarks, \ours{} improves mean@8 by \textbf{2.57} points over OPD for a 7B student, with gains increasing in longer-generation and reaching +\textbf{4.92} points on AIME-26 at 39k tokens.

[14] The Flip Side of RLHF: On-Policy Feedback for Reward Model Self-Supervised Improvement cs.CLPDF

Xiaobo Wang, Tong Wu, Min Tang, Jiaqi Li, Qi Liu

TL;DR: 论文提出SAVE框架，通过价值锚定的在线策略反馈实现奖励模型的自监督改进，利用价值函数对在线策略生成的响应进行评分，从而将奖励分级的响应转化为监督信号，并通过对比目标更新奖励模型。

Details

Motivation: 解决语言模型对齐中奖励模型构建的瓶颈，即获取多样且可靠的人类标注或评判模型偏好数据的成本高、难度大，且策略演化超出静态奖励模型训练范围时问题加剧。

Result: 在六个多样化基准测试中通过严格实证评估验证了SAVE的有效性，在所有数据集上均取得优于现有方法的结果，并在三种RL算法（GRPO、RLOO、GSPO）和不同策略骨干上保持一致的改进。

Insight: 创新点在于利用在线策略反馈和价值锚定机制实现奖励模型的自监督训练，通过计算奖励模型优势并过滤模糊样本来提升模型性能，这为减少对昂贵人工标注的依赖提供了新思路。

Abstract: Building strong reward models (RMs) for language model alignment is bottlenecked by the cost and difficulty of acquiring diverse and reliable preference data from human annotation or judge models. It is dramatically worse as the policy evolves beyond the static RM training. Therefore, we propose SAVE (Self-supervised reward model improvement via Value-Anchored On-policy feedback), a framework that grades on-policy responses as feedback by using the value function for on-policy RM training. SAVE naturally converts the reward-graded on-policy responses into supervision with a prompt-specific value head as an adaptive anchor. It computes RM advantages and filters ambiguous samples to update the RM via a contrastive objective. The effectiveness of SAVE for enhancing RM training is strongly validated through rigorous empirical evaluation across six diverse benchmarks. It achieves outperforming results across all datasets while maintaining consistent improvements across three RL algorithms (GRPO, RLOO, GSPO) and different policy backbones.

[15] EMBGuard: Constructing Hazard-Aware Guardrails for Safe Planning in Embodied Agents cs.CLPDF

Dongwook Choi, Taeyoon Kwon, Bogyung Jeong, Minju Kim, Yeonjun Hwang

TL;DR: 本文提出了EMBGuard，一种基于MLLM的具身智能体安全护栏，旨在将物理风险推理与智能体策略解耦。通过评估（视觉观察，动作）对，它能识别危险配置并提供潜在风险的自然语言解释。同时，作者贡献了包含15.1K个动作条件对的训练数据集EMBHazard，以及涵盖七类物理风险的329个手动策划真实场景的基准测试EMBGuardTest。

Details

Motivation: 解决现有方法缺乏显式机制来识别危险和推理动作条件风险的问题，这导致智能体要么错过危险交互，要么过度识别风险。

Result: 尽管模型尺寸较小（2B, 4B），EMBGuard在性能上与专有MLLM（如GPT-5.1, Gemini-2.5-Pro）相当，同时显著降低了阻碍实时部署的误报率。

Insight: 创新点在于首次提出了一个专门用于具身智能体的、基于MLLM的安全护栏框架，实现了风险推理与策略的分离。通过组合变化危险和动作来生成多样化的风险/良性场景，并构建了专门的训练数据和评估基准，为安全规划提供了系统化的解决方案。

Abstract: MLLM-powered embodied agents deployed in real-world environments encounter physical hazards. However, existing approaches lack explicit mechanisms for identifying hazards and reasoning about action-conditioned risks, leading agents to either miss risky interactions or over-identify risks. To address this, we propose EMBGuard, the first MLLM-based safety guardrail for embodied agents designed to decouple physical risk reasoning from agent policy. By evaluating a (visual observation, action) pair, EMBGuard identifies hazardous configurations and provides natural language explanations of potential risks. Alongside EMBGuard, we contribute EMBHazard, a training dataset of 15.1K action-conditioned pairs, and EMBGuardTest, a benchmark of 329 manually curated real-world scenarios spanning seven physical risk categories. Through compositional variation of hazards and actions, we generate diverse risky and benign scenarios that agents may encounter during planning. Despite its compact size (2B, 4B), EMBGuard achieves performance competitive with proprietary MLLMs (e.g., GPT-5.1, Gemini-2.5-Pro) while significantly reducing the false-positive rates that hinder real-time deployment. We make the code, data, and models publicly available at https://github.com/dongwxxkchoi/EMBGuard

[16] Toxic HallucinAItions: Perturbing Prompts and Tracing LLM Circuits cs.CL | cs.AI | cs.CY | cs.HCPDF

Soorya Ram Shimgekar, Agam Goyal, Amruta Parulekar, Joshua Chen, Yian Wang

TL;DR: 本文研究了提示词中不同语气（礼貌、随机、有毒）对大型语言模型事实可靠性的影响。通过在ARC-Easy、GSM8K和MMLU基准上评估五个LLM，发现有毒的词汇扰动会降低事实准确性并增加不确定性，而礼貌措辞影响有限。通过归因图分析模型激活，发现毒性增强会选择性放大对扰动敏感的变体节点，而核心推理节点保持相对稳定。

Details

Motivation: 探究在语义等效的前提下，提示词中的有毒语言是否会损害LLM的事实可靠性，以理解用户从礼貌到对抗性的不同语气对模型行为的影响。

Result: 在ARC-Easy、GSM8K和MMLU基准测试中，有毒词汇扰动持续降低了LLM的事实准确性并增加了不确定性；礼貌措辞带来的变化有限且不一致。归因图分析提供了模型内部计算变化的机制性证据。

Insight: 创新点在于将提示词语气确立为影响LLM可靠性的关键维度，并通过行为实验和归因图分析相结合，揭示了表面词汇变化如何改变事实输出和内部计算路径，为理解模型对对抗性输入的脆弱性提供了新视角。

Abstract: Large language models (LLMs) are increasingly deployed in conversational settings where user tone ranges from polite to adversarial or toxic, yet less is known about whether toxic language in otherwise semantically equivalent prompts can degrade factual reliability. We study how lexical and tone-based prompt perturbations affect the factual reliability of LLMs. Using controlled prompt variations across polite, random, and three toxicity levels, we evaluate five LLMs on ARC-Easy, GSM8K, and MMLU. We find that toxic lexical perturbations consistently reduce factual accuracy and increase uncertainty, while polite phrasing yields limited and inconsistent changes. To examine whether these answer inconsistencies correspond to internal changes, we conduct attribution-graph analyses of model activations and influences. We find that increasing toxicity selectively amplifies perturbation-sensitive variant nodes while relatively stable core reasoning nodes remain more invariant. These findings position prompt tone as a critical dimension of LLM reliability and provide behavioral and mechanistic evidence that surface-level lexical variation can alter factual outputs and internal computation.

[17] MineExplorer: Evaluating Open-World Exploration of MLLM Agents in Minecraft cs.CLPDF

Tianjie Ju, Yueqing Sun, Zheng Wu, Wei Zhang, Yaqi Huo

TL;DR: 该论文提出了MineExplorer基准，用于在《我的世界》游戏中评估多模态大语言模型（MLLM）智能体的开放世界探索能力。该基准通过筛选不依赖特定游戏知识的原子任务，并将其组合成隐含的多跳任务，来测试智能体的长期推理和协调能力。实验表明，当前先进的MLLM智能体在开放世界探索中仍面临巨大挑战，尤其是在处理具有隐藏前提的长轨迹任务时性能显著下降。

Details

Motivation: 现有基准测试通常将交互压缩为短期任务或将成功与特定领域游戏机制绑定，无法有效评估MLLM智能体在动态开放世界中维持探索的能力。

Result: 在MineExplorer基准上的实验表明，即使强大的模型能处理许多单跳任务，但在需要协调隐藏前提的较长轨迹任务上性能急剧下降。任务难度与智能体完成度相关，更大的模型或思维模式并不总能带来更好的性能。

Insight: 创新点在于提出了一个专注于评估通用开放世界推理能力的基准，并采用多智能体合成工作流来构建更可靠的任务实例。客观来看，其将任务分解为原子步骤并组合成隐含多跳任务的设计，为评估智能体的长期规划和状态跟踪能力提供了新思路。

Abstract: Multimodal large language models (MLLMs) have shown strong capabilities in perception, reasoning, and action generation. However, their ability to sustain exploration in dynamic open worlds remains unclear. Existing embodied and game-based benchmarks often compress interaction into short-horizon tasks or entangle success with domain-specific game mechanics. In this paper, we introduce MineExplorer benchmark for evaluating open-world exploration capabilities of MLLM agents in Minecraft. We first filter atomic tasks whose solutions rely heavily on Minecraft-specific knowledge to better reflect general open-world reasoning. Then we organize the benchmark around a ReAct-style capability formulation and compose atomic tasks into implicit multi-hop tasks. To further construct reliable instances, MineExplorer uses a multi-agent synthesis workflow that jointly designs task graphs, sandbox scenes, and rule-based milestone evaluators. Human evaluation shows that the multi-agent synthesis workflow produces significantly more reliable instances than a single-agent baseline. Experiments with advanced MLLM agents show that open-world exploration remains challenging, as strong models can handle many single-hop tasks but degrade sharply when hidden prerequisites must be coordinated over longer trajectories. Further analysis finds that task difficulty tracks agent completion, and larger models or thinking modes do not consistently translate into better performance. Code and dataset are available at https://github.com/Jometeorie/MineExplorer.

[18] Do Large Language Models Encode Institutional Experience? Evidence from Cross-Linguistic Moral Reasoning Under Ambiguity cs.CL | cs.AIPDF

Nattavudh Powdthavee

TL;DR: 这篇论文研究了大型语言模型（LLMs）在不同语言间进行道德推理时出现系统性差异的来源。通过两项预先注册的研究，作者测试了语言是否编码了其使用环境的制度经验，从而使LLMs在训练中继承了特定于制度的道德先验。研究发现，在制度模糊的场景下，跨语言道德分歧会增加并与现实世界的制度差异相关，而明确的制度框架则会削弱这些差异。

Details

Motivation: 动机是探究LLMs跨语言道德推理差异的根源，特别是检验这些差异是否源于语言所编码的制度环境经验，即LLMs是否通过训练数据继承了不同语言社区的制度特定道德先验。

Result: 研究结果表明：在制度模糊的场景下（制度风险存在但未明确说明），跨语言道德分歧相对于制度无关的控制组有所增加，并且（除一个理论上有信息的例外）与语言社区之间的现实世界制度差异相关；而明确的制度框架则减弱了这些效应。研究一（明确制度框架）的结果则普遍为阴性。

Insight: 论文的创新点在于提出并验证了“制度经验通过语言编码影响LLM道德推理”的假设，揭示了隐性制度线索（模糊场景）比显性线索更能触发LLMs中继承的、与语言相关的制度先验，这对理解LLMs的文化/制度偏见及其在跨语言应用中的行为有重要启示。

Abstract: Large language models (LLMs) exhibit systematic differences in moral reasoning across languages, yet the source of this variation remains unclear. We test the hypothesis that languages encode aspects of the institutional environments in which they are spoken, allowing LLMs to inherit institution-specific moral priors through training. Across nine languages spanning a broad gradient of institutional quality, six frontier LLMs, and two preregistered studies, we examine moral dilemmas whose acceptability depends on institutional functioning. In Study 1, explicit institutional framing produced uniformly null results: cross-linguistic moral divergence did not increase in institutionally contingent scenarios, nor did it track institutional differences between language communities. In Study 2, we introduced institutionally ambiguous scenarios in which institutional stakes were present but not explicitly stated. Under these conditions, cross-linguistic moral divergence increased relative to institutionally inert controls and, with one theoretically informative exception, was associated with real-world institutional differences between language communities. Explicit framing again attenuated these effects. These findings suggest that institutional experience may leave detectable traces in language that shape LLM moral reasoning, while also indicating that explicit institutional cues can suppress the expression of those differences.

[19] MoG: Mixture of Experts for Graph-based Retrieval-Augmented Generation cs.CLPDF

Zheng Yuan, Chuang Zhou, Linhao Luo, Siyu An, Di Yin

TL;DR: 本文提出了MoG（基于图的专家混合检索增强生成）方法，通过将知识组织为始终可访问的枢纽图和稀疏激活的专家图，利用拓扑感知路由器动态选择相关专家图进行检索，从而在复杂推理任务中更精准地获取外部证据，避免不相关信息的干扰。

Details

Motivation: 解决传统检索增强生成中从统一知识库检索可能引入无关信息、误导复杂推理的问题，受混合专家条件计算启发，旨在实现更聚焦的检索。

Result: 在多个具有挑战性的基准测试中，MoG consistently outperforms strong baselines，在MuSiQue上取得了超过20%的相对提升。

Insight: 创新点在于将知识结构化组织为枢纽图和专家图，并引入拓扑感知路由器进行动态专家激活，实现了检索空间的精准约束，提升了复杂推理的准确性。

Abstract: Retrieval-augmented generation is intensively studied to ground large language models on external evidence. However, retrieving from a unified knowledge base could inevitably introduce irrelevant information that may mislead generation for complex reasoning. Inspired by the conditional computation of mixture of experts (MoE), where a router sparsely selects specialized experts alongside shared ones for each input, we propose \textbf{M}ixture \textbf{o}f experts for \textbf{G}raph-based Retrieval-Augmented Generation, i.e., \textbf{MoG}. It organizes knowledge into two core components: (i) diverse, always-accessible hub graphs that encode semantically and structurally central knowledge and provide contextual clues for expert activation, and (ii) sparsely activated expert graphs that contain domain-specific evidence. MoG first accesses hub graphs to identify general evidence and derive contextual clues. Then, a topology-aware router dynamically activates a limited set of expert graphs conditioned on the query, thereby confining retrieval to a focused evidence subspace. Extensive experiments on challenging benchmarks show that MoG consistently outperforms strong baselines, with over 20% relative improvement on MuSiQue. Our code is available in https://github.com/DEEP-PolyU/MoG.

[20] Extending AI for Research to the Humanities: A Multi-Agent Framework for Evidence-Grounded Scholarship cs.CLPDF

Yating Pan, Jiajun Zhang, Jun Wang, Qi Su

TL;DR: 本文提出了SPIRE（Scholarly-Primitives-Inspired Research Engine），一个用于人文学科证据驱动研究的多智能体框架。该框架将人文学科中常见的学术操作（如源发现、证据标注、比较、出处核查等）转化为协作的智能体角色，并构建了一个基于段落、上下文内图社区和跨上下文语义聚类的多尺度细读检索基底。在古典中文和希腊罗马拉丁学术的同行评审论文基准测试中，SPIRE在证据检索和答案质量上优于现有方法。

Details

Motivation: 现有基于LLM的研究智能体主要针对科学和工程领域，侧重于可执行实验和定量信号，而人文学科研究需要基于原始资料的、解释性的、证据驱动的论证，现有系统对此支持不足。

Result: 在古典中文和希腊罗马拉丁学术的同行评审论文基准上，SPIRE在恢复引用的原始证据方面比Naive LLM、Text RAG和GraphRAG更可靠，并在答案准确性、深度、覆盖面和证据质量方面获得了更高的盲审评分。消融实验表明，学术操作智能体和细读检索都对生成证据驱动的文章有贡献。

Insight: 创新点在于将人文学科的“学术原语”理论转化为一个多智能体协作框架，并设计了专门针对人文学科细读和证据溯源需求的多尺度检索基底，为人文学科的AI辅助研究提供了新的系统化思路。

Abstract: LLM-based research agents have advanced rapidly in science and engineering, where research is organized around executable experiments, code, and quantitative signals. Humanities scholarship, however, requires a different mode of reasoning: interpretive, evidence-grounded argument over primary sources, where scholarly value depends on faithful quotation, verifiable provenance, and close reading. Existing research agents remain largely optimized for execution and retrieval, not evidence-grounded interpretive reasoning. To address this gap, we introduce SPIRE (Scholarly-Primitives-Inspired Research Engine), a multi-agent framework for evidence-grounded humanities scholarship. Drawing on Scholarly Primitives theory, SPIRE casts recurring humanities operations as cooperating agent roles (source discovery, evidence annotation, comparison, provenance checking, sampling, citation binding, and argumentative synthesis) over a multi-scale close-reading substrate of passages, intra-context graph communities, and cross-context semantic clusters. On a peer-reviewed-paper benchmark over classical Chinese and Greco-Roman Latin scholarship, SPIRE recovers cited primary-source evidence more reliably than Naive LLM, Text RAG, and GraphRAG, and receives higher blind-judge scores on answer accuracy, depth, coverage, and evidence quality. Ablations show that both the scholarly-operation agents and close-reading retrieval contribute to evidence-grounded essays. Code, data catalogues, and reproduction scripts are released at https://github.com/YatingPan/SPIRE.

[21] How Much Do LLMs Know About Chinese Zero Pronouns? cs.CLPDF

Yifei Li, Guanyi Chen, Tingting He

TL;DR: 本文系统评估了大型语言模型（LLMs）处理中文零代词（ZPs）的能力，涵盖识别、指代性分类、指代类型分类、消解和翻译等任务。研究发现，当前LLMs在处理中文ZPs方面仍面临巨大挑战，尤其是在上游任务中，即使是先进的推理导向型LLMs在翻译任务中的正确率也不足一半。

Details

Motivation: 零代词是中文等空语类语言中普遍存在的语言现象，对自然语言处理系统构成长期挑战。尽管LLMs在许多中文任务上表现良好，但其处理零代词的能力尚不明确，因此需要系统评估。

Result: 在涵盖识别、分类、消解和翻译的一系列任务中，多种LLMs的表现均不佳。特别是在上游任务（如识别和指代性分类）上挑战巨大，而在下游翻译任务中，最先进的推理导向型LLMs正确翻译中文零代词的比例也低于50%。

Insight: 论文的创新点在于首次对LLMs处理中文零代词的能力进行了系统性的、多任务的评估，揭示了LLMs在这一特定语言现象上的显著弱点，尤其是在需要深层语言理解的推理任务上。这为未来改进LLMs在空语类语言上的处理能力提供了重要基准和方向。

Abstract: Zero Pronouns (ZPs) are a pervasive linguistic phenomenon in pro-drop languages such as Chinese and have long posed a challenge for natural language processing systems. Although Large Language Models (LLMs) perform well on many Chinese language tasks, their ability to process ZPs remains poorly understood. We conduct a systematic investigation of LLMs’ handling of Chinese ZPs through a sequence of linguistically motivated tasks, including identification, referentiality classification, referential type classification, resolution, and translation. A diverse set of LLMs is evaluated across all tasks. Our results show that Chinese ZPs remain highly challenging for current LLMs, particularly for upstream tasks such as identification and referentiality classification. Performance on downstream tasks, such as ZP translation, is also consistently low: even state-of-the-art reasoning-oriented LLMs correctly translate fewer than half of Chinese ZPs into English.

[22] AdaptR1: Reinforcement Learning Based Adaptive Interleaved Thinking in Multi-hop Question Answering cs.CLPDF

Yuxin Wang, Jiahao Lu, Qifeng Wu, Shicheng Fang, Chuanyuan Tan

TL;DR: 论文提出了AdaptR1，一种基于强化学习的自适应交错思考框架，用于多跳问答任务。该框架通过动态分配推理预算，在保持性能的同时显著减少不必要的推理步骤，从而解决大语言模型在复杂推理中存在的“过度思考”问题。

Details

Motivation: 现有自适应推理方法通常只在查询级别决定是否进行推理，忽略了多步任务中不同中间阶段对显式推理需求的动态变化，导致模型对简单查询生成不必要的长推理轨迹，产生可避免的推理成本。

Result: 在Graph-R1设置下，AdaptR1平均减少了69.71%的思考令牌，在HotpotQA上减少了90.35%，同时保持了与标准基线相当或更好的性能。

Insight: 创新点在于完全基于强化学习的策略，使用质量门控的效率奖励进行冷启动，实现步骤级的自适应预算分配；分析发现过度思考主要发生在初始规划阶段，这凸显了逐步骤自适应分配的有效性。

Abstract: Large Language Models (LLMs) have achieved remarkable performance in complex reasoning tasks through Chain-of-Thought (CoT) prompting. However, this approach often leads to ``over-thinking,’’ where models generate unnecessarily long reasoning traces for simple queries and incur avoidable inference cost. While recent work has explored adaptive reasoning, existing methods typically make a single query-level decision about whether to reason. This overlooks the dynamic nature of multi-step tasks, where the need for explicit reasoning varies across intermediate stages. To address this limitation, we introduce AdaptR1, a Reinforcement Learning (RL) based framework for adaptive interleaved thinking in multi-hop Question Answering (QA). Unlike previous approaches that require Supervised Fine-Tuning (SFT) for cold-start initialization, AdaptR1 uses a fully RL-based strategy with a quality-gated efficiency reward to dynamically allocate reasoning budgets at each step. Under the Graph-R1 setting, AdaptR1 reduces average think tokens by 69.71%, with a 90.35% reduction on HotpotQA, while maintaining performance comparable to or better than standard baselines. Furthermore, our analysis reveals that overthinking in multi-hop reasoning is not uniformly distributed but occurs predominantly during the initial planning stages, highlighting the effectiveness of step-wise adaptive budget allocation.

[23] Combinatorial Synthesis: Scaling Code RLVR via Atomic Decomposition and Recombination cs.CL | cs.SEPDF

Jiasheng Zheng, Boxi Cao, Boxi Yu, Yuzhong Zhang, Jialun Cao

TL;DR: 本文提出了一种名为原子分解与重组（ADR）的新框架，用于生成可验证的代码任务，以解决强化学习与可验证奖励（RLVR）中因缺乏足够挑战性任务而难以扩展的问题。该方法通过将代码任务分解为原子元素并进行受控重组，能够产生新颖且困难的任务，从而提升RLVR训练的可扩展性和效果。

Details

Motivation: 当前RLVR方法的可扩展性受到缺乏足够挑战性、接近模型能力边界的可验证代码任务的限制，而现有基于启发式种子扩展的数据合成方法在任务新颖性和难度上存在严重不足，导致训练价值无法随合成规模成比例提升。

Result: 实验表明，ADR在原创性、难度、多样性和测试质量方面均优于现有基线方法，并在算法编程、工具使用和数据科学等多个下游领域的RLVR训练中，持续带来代码能力的更大提升。

Insight: 论文的创新点在于提出了原子分解与重组（ADR）这一系统化框架，通过分解和重组原子元素来生成新颖且具有挑战性的可验证代码任务，这为代码任务合成和可扩展的RLVR训练提供了一种新范式，突破了传统启发式方法在创造性和难度上的局限。

Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as the cornerstone for shaping the remarkable coding abilities of Large Language Models (LLMs). However, the scalability of RLVR is severely constrained by the scarcity of sufficiently challenging verifiable code tasks that target near the model’s edge of competence. Prior studies often rely on heuristic seed expansions for data synthesis, which severely limits both novelty and difficulty. Consequently, the training value of such data fails to scale proportionally with the size of its synthesis. To this end, we propose Atomic Decomposition and Recombination (ADR), a novel framework that generates verifiable code tasks via decomposition into atomic elements and controlled recombination, thereby enabling the generation of genuinely novel and challenging verifiable code tasks. Experiments and analysis demonstrate that ADR achieves superior originality, difficulty, diversity, and test quality over existing baselines, and consistently delivers greater improvements in code ability across RLVR in diverse downstream domains, including algorithmic programming, tool usage, and data science. Our work sheds light on a new paradigm for novel code task synthesis and scalable RLVR training.

[24] Beyond Static Dialogues: Benchmarking Realistic, Heterogeneous, and Evolving Long-Term Memory cs.CL | cs.IRPDF

Han Zhang, Zihao Tang, Xin Yu, Xiao Liu, Yeyun Gong

TL;DR: 本文提出了RHELM基准测试，用于评估大语言模型在真实、异构和动态演化长期记忆方面的能力。该基准通过精心设计的用户档案和LOOP模块构建具有长期语义一致性和异构数据流（如文档和电子邮件）的对话场景，包含七种查询类型和27种关键记忆特征，揭示了现有方法在复杂现实场景中的不足。

Details

Motivation: 现有大语言模型的记忆基准测试中，对话会话缺乏长期语义一致性，人物设定扁平静态，且现实交互涉及多样异构数据流，这些局限降低了评估的真实性和有效性。

Result: 在完整上下文模型、检索增强生成（RAG）方法和代表性记忆框架上的综合实验表明，当前方法在复杂现实设置中仍存在关键弱点，特别是在多源聚合和现实上下文推理方面。

Insight: 创新点包括引入LOOP模块生成动态演化且长期一致的对话，以及将异构外部数据源与用户时间事件轨迹同步集成；客观分析认为，该研究系统识别了27种未充分探索的关键记忆特征，为评估模型在真实世界记忆能力提供了更全面的基准。

Abstract: In existing memory benchmarks for Large Language Models (LLMs), the evaluated dialogue sessions often lack long-term semantic consistency, and the underlying personas tend to be flat and static. Furthermore, in real-world scenarios, interactions between users and assistants involve more diverse, heterogeneous data streams, such as documents and emails. These shortcomings significantly limit the realism and effectiveness of current evaluations. To address these limitations, we introduce RHELM (Realistic, Heterogeneous, and Evolving Long-term Memory). Driven by meticulously crafted user profiles and a novel LOOP (pLan-rOllout-evOlve-Prune) module, we construct realistic dialogues across diverse interaction scenarios that exhibit dynamic temporal evolution and long-term coherence. Crucially, these dialogues are deeply integrated with heterogeneous external sources synchronized with the user’s temporal event trajectory. The resulting benchmark encompasses challenging question-answer pairs spanning seven inquiry types, with each question mapping to at least one of 27 critical memory characteristics that we identify as essential yet underexplored in current research. Comprehensive experiments across full-context models, retrieval-augmented generation (RAG) methods, and representative memory frameworks reveal that contemporary approaches still expose critical weaknesses in complex, real-world settings, particularly in resolving multi-source aggregation and real-world contextual reasoning.

[25] ConsisGuard: Aligning Safety Deliberation with Policy Enforcement in LLM Guardrails cs.CLPDF

Yan Wang, Zhixuan Chu, Zihao Xue, Zhen Bi, Bingyu Zhu

TL;DR: 本文提出ConsisGuard框架，旨在解决基于推理的大语言模型护栏中存在的审议与执行不一致问题，即模型的安全推理与其最终决策可能不匹配。通过策略到决策轨迹蒸馏和功能耦合对齐方法，该框架增强了安全审议与决策执行之间的一致性。在提示和响应有害性检测基准上的实验表明，ConsisGuard提高了检测性能并减少了策略执行失败。

Details

Motivation: 现有基于推理的LLM护栏在生成安全原理后，其最终决策可能与推理不一致，存在审议到执行的差距，这威胁了安全策略的可靠执行。

Result: 在提示和响应有害性检测基准上，ConsisGuard提高了检测性能，同时减少了策略执行失败，表明其能更可靠地执行安全策略。

Insight: 创新点在于明确提出了审议-执行差距问题，并通过轨迹蒸馏和耦合对齐来强制内部一致性，强调了可靠护栏需要安全策略的忠实执行，而不仅仅是生成推理链。

Abstract: Reasoning-based LLM guardrails improve safety moderation by generating explicit rationales before issuing final decisions. However, their rationales do not always lead to faithful enforcement: a model may recognize a harmful intent in its reasoning but still predict a safe label, or issue an unsafe decision without policy-grounded justification. We identify this safety-critical failure mode as the deliberation-to-enforcement gap. Unlike general chain-of-thought faithfulness, guardrail reliability requires policy execution consistency: the generated reasoning should be grounded in the safety policy, and the final decision should be entailed by that reasoning. We propose ConsisGuard, a consistency-aware framework for reasoning-based LLM guardrails. ConsisGuard performs Policy-to-Decision Trajectory Distillation and Functional Coupling Alignment, aligning the internal coupling between safety deliberation and decision enforcement. Experiments on prompt and response harmfulness detection benchmarks show that ConsisGuard improves detection performance while reducing policy execution failures. These results suggest that reliable reasoning-based guardrails require accurate faithful execution of safety policies.

[26] Not All Synthetic Data Is Yours to Learn From cs.CL | cs.AI | cs.LGPDF

Sina Alemohammad, Li Chen, Richard G. Baraniuk, Zhangyang Wang

TL;DR: 本文研究了语言模型在无提示、无监督条件下，仅通过自身生成的文本进行自我训练的效果。研究发现，合成数据的效用取决于数据源与模型之间的兼容性，而非数据本身的内在属性；自我训练主要通过放大模型已有的能力，而非从数据中引入新结构；同时，这种训练方式能在不显式遗忘的情况下，显著降低逐字记忆，而保持或提升模型能力。

Details

Motivation: 探索语言模型能否仅通过自身生成的纯文本进行自我提升，而不依赖任何外部提示、教师、验证器或奖励模型，以理解合成数据效用的本质。

Result: 在Pythia模型上的受控实验表明，自我训练能保持或提升基准测试效用，同时将未见过数据的逐字匹配提取率降低超过95%，实现了能力与逐字记忆的解耦。

Insight: 提出了’潜在能力重现假说’，强调合成数据效用的关系性而非内在性；揭示了无提示自我训练通过放大已有知识而非导入新结构来工作的机制；发现了一种无需显式遗忘目标即可分离能力与逐字记忆的新范式。

Abstract: Can a language model improve from plain text sampled from itself, with no prompts, no teacher, no verifier, and no reward model? Yes, but only when the synthetic corpus is compatible with the student, a relational property of the source-student pair rather than an intrinsic property of the data. We call this the latent capability resurfacing hypothesis: weak self-training can amplify capabilities already present in the pretrained model, but only under this compatibility condition. We study this in the minimal setting of prompt-free unconditional self-training, where base language models are fine-tuned on text generated from the BOS token alone, with no task specification or external supervision. We report three findings. First, synthetic utility is relational rather than intrinsic: self-generated data is the most effective source, same-lineage transfer outperforms stronger but differently trained sources, and cross-family transfer is substantially weaker. Second, common intrinsic proxies fail: neither benchmark-level semantic similarity nor average per-token likelihood under the student predicts which corpora help. Third, this regime produces a surprising byproduct. In controlled Pythia experiments, capability and verbatim memorization decouple: benchmark utility is preserved or improved while held-out exact-match extraction drops by over 95 percent, with no forget set, privacy objective, or targeted unlearning. Together, these results suggest that prompt-free self-training works by amplifying what the student already knows, not by importing structure from the data. They also reveal a regime in which capability and verbatim memorization can be separated without any explicit unlearning objective.

[27] Shared Doubt: Zero-shot Cross-Lingual Confidence Estimation for Language Models cs.CL | cs.AI | cs.LGPDF

Athina Kyriakou, Dennis Ulmer, Ivan Titov

TL;DR: 本文研究了多语言大语言模型（LLMs）中是否存在跨语言共享的置信度特征。作者使用一个轻量级的线性探针，直接从模型的中间层表示中预测答案正确性。该探针在单一语言上训练后，能够零样本泛化到未见过的、类型学多样的语言，无需目标语言的监督。

Details

Motivation: 现有置信度估计（CE）研究主要集中于英语，忽略了LLMs的多语言使用现实，且许多方法在不同语言间性能下降或需要重新训练。本文旨在探究多语言LLMs是否编码了可跨语言迁移的共享置信度特征。

Result: 线性探针在零样本跨语言设置下表现良好，其性能取决于与源语言的相似性。该方法无需任何重新训练，为跨语言置信度估计提供了一个强有力的基线，并优于其他流行的置信度估计方法。

Insight: 创新点在于首次系统性地探索了多语言LLMs中置信度特征的跨语言可迁移性。客观分析表明，置信度特征集中在模型的中间层，且在不同语言间共享一个置信度子空间，这为构建语言无关的模型可靠性评估工具提供了新思路。

Abstract: Confidence estimation (CE), i.e. quantifying the reliability of a model’s prediction, has attracted great interest in the context of large language models (LLMs). However, most studies focus on English, ignoring the multilingual reality of LLM usage, while many CE methods degrade or require retraining across languages. To address this gap, we investigate whether multilingual LLMs encode shared, language-transferable confidence features. We use a lightweight linear probe that predicts answer correctness directly from intermediate representations. Trained monolingually, the probe generalizes zero-shot to unseen, typologically diverse languages without target-language supervision. Learned layer weights and multiple ablations reveal that confidence features concentrate in middle layers across languages, suggesting a shared confidence subspace. While zero-shot cross-lingual performance depends on similarity to the source language, the probe provides a strong baseline without any retraining and compares favorably to other popular confidence estimation methods.

[28] Scaling Multi-Hop Training Data via Graph-Constrained Path Selection cs.CL | cs.LGPDF

Pengyu Chen, Yonggang Zhang, Mingming Chen, Jun Song, Wei Xue

TL;DR: 本文提出了一种名为Graph-Constrained Path Selection（GCSCS）的方法，用于从无标注的专业文档（如法律合同）中大规模生成多跳训练数据。该方法通过构建上下文关键词质心图来离线枚举推理路径，并施加几何约束以确保路径质量，从而显著提升了教师模型合成数据的可用性。

Details

Motivation: 现有方法在从结构化、重复模板且密集交叉引用的专业文档（如法律合同）中生成多跳训练数据时性能急剧下降，因为这些文档缺乏现成的大规模标注数据。

Result: 在CUAD法律合同语料库上构建80K训练样本，并用于微调Qwen3-32B模型，将闭卷Token F1分数从21.66%提升至38.58%，达到了显著的性能改进。

Insight: 创新点在于将路径发现与问题生成解耦，并通过图约束（如几何可容许性约束）来提升教师模型合成数据的可行性，而非直接提高单条链的质量；关键机制是使可用语料库扩展了4.4倍，从而实现了数据规模的规模化。

Abstract: Endowing large language models with compositional reasoning over specialized documents requires multi-hop training data at scale, where such data rarely exists outside of curated benchmarks built on structured sources. To construct it directly from plain, unannotated text, existing methods ask a single teacher model to jointly discover an evidence path through a document and verbalize it as a question-answer pair. However, these methods degrade sharply when documents are structured around repetitive templates and densely cross-referencing clauses, conditions that characterize most real-world specialized corpora. In this work, we decouple the two operations: reasoning paths are enumerated offline over a graph of contextual keyword centroids, and the teacher is invoked only to verbalize pre-validated paths. The graph enforces five geometric admissibility constraints, for which we provide Gram-matrix arguments establishing that local similarity bounds alone admit endpoint drift up to ${\sim}91^{\circ}$, and that an upper similarity bound is necessary to exit dense embedding cliques formed by boilerplate text. A matched-size ablation isolates the mechanism: at equal training scale, constrained and unconstrained chains yield indistinguishable downstream performance, and the gain at full scale comes from a 4.4$\times$ expansion of the usable corpus rather than from higher per-chain quality – reframing the role of graph constraints, in this setting, as raising teacher synthesizability rather than improving chain content. Fine-tuning Qwen3-32B on 80K examples constructed from the CUAD legal contract corpus improves closed-book Token F1 from 21.66% to 38.58%. We have released our codes at https://github.com/hkgai-official/GCSCS.

[29] Mellum2 Technical Report cs.CLPDF

Marko Kojic, Ivan Bondyrev, Aral de Moor, Joseph Shtok, Petr Borovlev

TL;DR: Mellum 2 是一个开源的、拥有120亿参数但每token仅激活25亿参数的混合专家（MoE）语言模型，专注于软件工程领域。它通过三阶段课程预训练、扩展上下文窗口以及两阶段后训练，产生了可直接回答的指令模型和先输出推理链的思考模型。在多项基准测试中，其性能与4B-14B参数范围的开源模型相当，但推理计算成本仅相当于一个25亿参数的稠密模型。

Details

Motivation: 旨在开发一个专注于软件工程（如代码生成、调试、工具使用等）的高效、开源通用语言模型，作为其前代专注于代码补全的4B稠密模型的继任者。

Result: 在代码生成、数学推理、工具使用、知识和安全等多个基准测试中，Mellum 2 的性能与4B到14B参数范围的开源基线模型（如 CodeLlama 等）具有竞争力，同时其每token的计算量仅相当于一个25亿参数的稠密模型。

Insight: 创新点包括：1）采用混合专家架构（64个专家，激活8个）并结合分组查询注意力、滑动窗口注意力及多token预测头（兼作推测解码的草稿模型），在保证性能的同时极大提升了推理效率；2）设计了三阶段课程预训练，逐步将数据混合从通用网页数据转向精选的代码和数学内容；3）通过层选择性的YaRN方法将上下文窗口扩展到128K，并采用监督微调与RLVR两阶段后训练，产出指令和思考两种变体，增强了模型的推理透明度。

Abstract: We present Mellum 2, an open-weight 12B-parameter Mixture-of-Experts (MoE) language model with 2.5B active parameters per token. Mellum 2 is a general-purpose language model specialized in software engineering, spanning code generation and editing, debugging, multi-step reasoning, tool use and function calling, agentic coding, and conversational programming assistance, and it is the successor to the completion-focused 4B dense Mellum model. The architecture builds on the Mixture-of-Experts (64 experts, 8 active) and combines Grouped-Query Attention with 4 KV heads, Sliding Window Attention on three of every four layers, and a single Multi-Token Prediction head that doubles as both an auxiliary pre-training objective and a built-in draft model for speculative decoding; each choice was validated by ablation with inference efficiency on commodity GPUs as a design constraint. Pre-training spans approximately 10.6 trillion tokens through a three-phase curriculum that progressively shifts the mixture from diverse web data toward curated code and mathematical content, optimized with Muon under FP8 hybrid precision and a Warmup-Hold-Decay schedule with linear decay to zero. The pre-trained base is extended to a 128K context window via a layer-selective YaRN and then post-trained in two stages (supervised fine-tuning followed by RLVR), yielding two released variants: an Instruct model that answers directly and a Thinking model that emits an explicit reasoning trace before its final answer. Across code generation, math and reasoning, tool use, knowledge, and safety benchmarks, Mellum 2 is competitive with open-weight baselines in the 4B-14B range while running at the per-token compute of a 2.5B dense model. We release the base, instruct, and thinking checkpoints, together with this report on the architecture decisions, data pipeline, and training recipe behind them, under the Apache 2.0 license.

[30] Reinforcement Learning Amplifies Emergent Misalignment from Harmless Rewards cs.CLPDF

Magnus Jørgenvåg, David Kaczér, Lasse Ruttert, Marvin Gülhan, Lucie Flek

TL;DR: 本文研究了强化学习（RL）如何放大语言模型中的涌现错位（EM）现象，即在窄域错位示例上进行微调后模型出现广泛错位。通过在小规模开源模型上进行实验，论文发现RL比监督微调（SFT）更易导致广泛错位，且错位可由自然奖励信号（如不受欢迎的审美偏好）诱发，同时验证了SFT中开发的缓解措施在RL设置下也有效。

Details

Motivation: 旨在探究强化学习是否会导致语言模型出现涌现错位，此前相关研究仅限于大型闭源模型，成本高且难以复现，因此本文使用小型开源模型系统分析RL诱导的EM现象。

Result: 实验表明，RL在诱导广泛错位方面显著优于样本匹配的SFT；RL诱导的EM可由看似自然的奖励信号（如不良修辞或小众审美）触发；针对SFT诱导EM的缓解措施（如交错策略安全数据）在RL设置下同样有效，且性能最佳。

Insight: 创新点在于首次在小规模开源模型中系统验证RL会放大涌现错位，揭示了RL比SFT更易导致模型广泛失准，并证明跨训练范式的缓解措施具有可迁移性，为安全对齐研究提供了可复现的实验框架。

Abstract: Emergent misalignment (EM) is the surprising tendency of language models to become broadly misaligned after fine-tuning on narrowly misaligned examples. While EM has been extensively studied in the supervised fine-tuning (SFT) setting, evidence that it also arises from reinforcement learning (RL) is limited to large, closed-source models, leaving the phenomenon expensive to study and difficult to reproduce. We characterize EM from RL in small, off-the-shelf open-weight models along three axes. First, we show that rewarding narrow, overtly misaligned behavior produces substantially higher general-domain misalignment than sample-matched SFT. Second, we show that EM from RL can be induced by reward signals that could plausibly arise naturally, such as unpopular aesthetic preferences or poor rhetorical appeals. Third, we evaluate in-training mitigations developed for SFT-induced EM and find that they broadly transfer, with interleaving on-policy safety data performing best.

[31] Bundesrecht: An Open Library and Corpus for German Statutory Reference Processing cs.CLPDF

Harshil Darji, Martin Heckelmann, Christina Kratsch, Gerard de Melo

TL;DR: 本文介绍了bundesrecht，一个用于处理德国法律条文引用的开放资源，包括一个软件库和一个结构化的德国联邦法律语料库。该库能够解析、标准化和解析德国法律条文引用，将原始引用字符串映射为结构化对象，扩展紧凑引用为规范形式，并链接到具体法律条款。

Details

Motivation: 法律条文引用是法律语言理解的核心，但自动处理困难，因为引用形式紧凑多变、可能组合多个目标、使用特殊缩写，且常指向低层级单位。现有德语工具要么专注于从法律文档中解析引用，要么在引用明确后访问法律文本。

Result: 在2,944个标注的德国法律引用上，使用严格的精确匹配和微观信息提取指标评估了解析器和标准化器。进一步评估了规范引用去重，显示标准化引用比字符串匹配更可靠地分组真实引用表面变体。

Insight: bundesrecht是首个覆盖从原始引用字符串到已解析法律条款的端到端流程的开放资源，提供了完整的处理管道，并公开在PyPI上，促进了德语法律文本的自动化处理和分析。

Abstract: Statutory references are central to legal language understanding, but are difficult to process automatically, as they appear in compact and variable surface forms, may combine multiple targets, use special abbreviations, and often point to lower-level units. Existing tools for German focus either on parsing references from legal documents or accessing statutory text once citations are explicit. This paper introduces bundesrecht, an open resource for German statutory reference processing, consisting of a software library and a structured corpus of German federal law. The library parses, normalizes, and resolves German statutory references, mapping raw citation strings to structured objects, expanding compact references into canonical forms, and linking them to statutory provisions. The accompanying dataset preserves the internal hierarchy of statutes from laws to fine-granular subclauses. We evaluate the parser and normalizer on 2,944 annotated German legal references using strict exact-match and micro information extraction metrics. We further evaluate canonical reference deduplication and show that normalized references group real citation surface variants far more reliably than string matching. bundesrecht is the first open resource that covers German statutory reference processing as an end-to-end pipeline, from raw citation string to resolved statutory provision, and is available on PyPI.

[32] FBHM: Functional Benchmarking and Steering of VLMs for Hateful Meme Detection cs.CL | cs.AI | cs.CV | cs.MMPDF

Paramananda Bhaskar, Naquee Rizwan, Daksh Jogchand, Saurabh Kumar Pandey, Animesh Mukherjee

TL;DR: 本文提出了FBHM基准，这是一个针对仇恨表情包检测的功能性基准，包含25种修辞功能和10个目标社区，共5000个表情包。研究发现现有最先进的视觉语言模型在FBHM上性能严重下降，表明它们依赖数据集特定的启发式方法而非稳健的多模态推理。为弥补这一差距，作者提出了LSV（可学习引导向量）策略，仅需500个引导样本即可将FBHM性能提升约30个Macro-F1点，且不损害源域性能。

Details

Motivation: 现有仇恨表情包检测基准是结构观察性的，混淆了修辞仇恨机制与目标社区特征，无法对模型漏洞进行因果评估，因此需要构建一个功能性基准来系统评估模型。

Result: 在FBHM基准上，现有最先进的视觉语言模型性能从标准数据集的较高准确率急剧下降至接近随机水平；LSV策略使用仅500个样本即可将FBHM性能提升约30个Macro-F1点，优于上下文学习和参数高效微调方法。

Insight: 创新点在于构建了基于功能性的仇恨表情包基准FBHM，通过正交轴（修辞功能和目标社区）实现系统评估；提出的LSV策略在极低数据量下通过因果干预目标有效提升模型泛化能力，且保持源域性能。

Abstract: Hateful meme detection remains a formidable challenge for vision-language models, as existing benchmarks are structurally observational - confounding rhetorical hate mechanisms with target community features and preventing causal evaluation of model vulnerabilities. To address this, we introduce FBHM, a systematically curated benchmark of Functionality Based Hateful Memes constructed along two orthogonal axes: 25 distinct rhetorical functionalities and 10 target communities (5,000 memes total). Benchmarking state-of-the-art VLMs reveals a severe generalization gap: models highly accurate on standard datasets catastrophically drop to near-random performance on FBHM, proving they exploit dataset-specific heuristics rather than robust multimodal reasoning. To efficiently close this gap, we propose LSV (learnable steering vectors), an ultra-low data regime strategy that applies a causal intervention objective on as few as 500 steering samples (50 unique base memes), boosting FBHM performance by ~30 Macro-F1 points while outperforming in-context learning and PEFT without degrading source-domain performance.

[33] A Visually Impaired Assistance Benchmark for VLM-as-a-Judge Evaluation cs.CL | cs.CVPDF

Yi Zhao, Siqi Wang, Zhe Hu, Yushi Li, Jing Li

TL;DR: 本文提出了VIABLE基准，用于评估视觉语言模型（VLM）作为评判者在视觉障碍辅助（VIA）任务中的可靠性。研究发现现有VLM评判者在有效性、公正性和稳定性方面普遍不可靠，并提出了一个模型无关的推理时增强方法VIA-Judge-Agent来改善其性能。

Details

Motivation: 视觉障碍辅助任务的人工评估成本高昂，而通用的VLM-as-a-Judge范式是否适用于该领域尚不明确。本文旨在探究VLM评判者在VIA任务中的可信度，并为此建立首个专门的评估基准。

Result: 在VIABLE基准上对七个不同规模的评判者模型进行系统评估，结果显示现有模型在所有评估维度上都不可靠。最强的GPT-5.4模型仅达到52.6%的单故障诊断准确率，且表现出94.2%的最高自偏好率；开源模型则存在严重偏见和对抗脆弱性。提出的VIA-Judge-Agent方法在诊断准确率和下游VIA响应方面取得了积极改进。

Insight: 论文的创新点在于构建了首个针对VIA任务的VLM-as-a-Judge评估基准（VIABLE），并提出了一个包含有效性-公正性-稳定性的评估框架及12种故障分类法。从客观角度看，其提出的模型无关的推理时增强架构（结合视觉证据提取和分类法引导的工作流）为解决VLM评判者在专业领域的局限性提供了可借鉴的思路。

Abstract: AI-based Visually Impaired Assistance (VIA) remains challenging, largely due to the high cost of human evaluation. The VLM-as-a-Judge paradigm may offer a promising alternative, although it has mostly been studied in general domains. We therefore ask whether such judges can be trusted for VIA tasks. To investigate this question, we introduce VIABLE (Visually Impaired Assistance Benchmark for VLM-as-a-Judge Evaluation), the first benchmark for VLM-as-a-Judge evaluation in VIA. VIABLE contains over 300K judgment samples across three scenarios and introduces an Effectiveness–Impartiality–Stability framework with a 12-mode failure taxonomy. Based on VIABLE, our systematic study of seven judges across different model scales shows that existing models are largely unreliable across all evaluation axes. The strongest judge, GPT-5.4, achieves only 52.6% single-failure diagnostic accuracy, yet exhibits the highest self-preference rate at 94.2%; while open-source judges are strongly biased and adversarially fragile. To address these issues, we propose VIA-Judge-Agent, a model-agnostic inference-time harness that augments judges with visual evidence extraction and a taxonomy-guided workflow. It enables positive improvements in diagnostic accuracy and downstream VIA responses more preferred by BLV users. Data and code are available at: https://github.com/YiyiyiZhao/VIABLE

[34] Unlocking Fine-Grained Translation Quality Estimation in LRMs through Synergistically Evolving Implicit and Explicit Reasoning cs.CLPDF

Renfei Dang, Xinye Wang, Zhejian Lai, Weilu Xu, Shimin Tao

TL;DR: 本文提出RIEQE框架，通过两阶段训练（NonThinking-SFT和Thinking-RLVR）协同演化隐式（层间）和显式（词间）推理能力，以解决大型推理模型在细粒度翻译质量评估任务中的性能瓶颈。

Details

Motivation: 大型推理模型虽具备强大多语言能力，但在细粒度翻译质量评估任务上表现不佳，核心挑战在于该任务本身的学习难度较高。

Result: 在WMT测试集上，基于Qwen3-4B-Thinking-2507的RIEQE在显式推理性能上超越所有基线，其隐式推理能力也与当前最佳基于编码器的模型相当。

Insight: 创新点在于将复杂任务分解为子任务，并通过两阶段训练框架实现隐式与显式推理的协同演化；客观上，该方法为提升模型在复杂判别任务中的推理能力提供了可借鉴的协同训练范式。

Abstract: Large Reasoning Models (LRMs) still struggle with fine-grained translation quality estimation (QE), even with long reasoning chains. We argue that LRMs already possess strong multilingual capabilities, while the core challenge stems from the intrinsic difficulty of learning the fine-grained QE task. In this paper, we propose RIEQE (Reasoning both Implicitly and Explicitly for QE), a simple two-stage training framework that enables the co-evolution of implicit (layer-wise) and explicit (token-wise) reasoning capabilities. To make implicit reasoning feasible, we first decompose the complex QE task into straightforward subtasks. Based on this, our two-stage approach applies: (1) NonThinking-SFT, Supervised Fine-Tuning (SFT) without reasoning chains to directly boost the model’s implicit reasoning tendency and capability; and (2) Thinking-RLVR, standard Reinforcement Learning with Verifiable Reward (RLVR) to subsequently strengthen explicit reasoning. Results demonstrate that implicit and explicit reasoning synergistically co-evolve under our framework. On the WMT test sets, RIEQE based on Qwen3-4B-Thinking-2507 surpasses all baselines in explicit reasoning performance, while its implicit reasoning capability is also comparable to the best current encoder-based models. We further provide evidence for the synergistic collaboration between implicit and explicit reasoning, showing how they mutually benefit each other.

[35] Multi-Turn Multi-Agent Dialogue for Collaborative Reconstruction Improves VLM Performance on Spatial Reasoning, But Only Barely cs.CL | cs.ROPDF

Chalamalasetti Kranti, Sherzod Hakimov, David Schlangen

TL;DR: 本文研究了视觉语言模型（VLMs）在需要空间推理的协作对话任务中的能力，通过一个协作结构重建任务，结合视觉解释、基础、语言引导交互和动作生成。研究发现，当前VLMs在视觉空间基础方面存在局限，详细文本表示能提高重建成功率，而分解的图像表示也能改善性能。

Details

Motivation: 解决VLMs在需要空间推理的协作对话任务中能力未被充分探索的问题，特别是在机器人操作中通过语言沟通视觉理解的需求。

Result: 在协作结构重建任务中，评估了开放权重和封闭VLMs，结果显示空间推理对VLMs仍具挑战性；详细文本表示在所有模态条件下提高了重建成功率，分解图像表示也提升了性能，但整体改进有限。

Insight: 创新点在于开发了一个基于对话的协作重建框架，揭示了VLMs在视觉空间基础和基于基础的指令生成方面的限制，强调了文本表示和图像分解在提升性能中的作用。

Abstract: Robots operating in diverse environments rely on visual input to interpret objects and spatial layouts. In human-collaborative tasks, they are expected to communicate this understanding through language. Vision-language models (VLMs) support robotic tasks involving visual interpretation, question answering, and instruction following, but their capabilities in collaborative dialogue tasks requiring spatial reasoning remain underexplored. We study this gap through a collaborative structure-building task that combines visual interpretation, grounding, language-guided interaction, and action generation. We develop a framework in which VLMs use dialogue to reconstruct a target structure from visual and textual inputs. We evaluate open-weight and closed VLMs across interaction settings, input modalities, and image representations. Results show that spatial reasoning over visual representations remains difficult for the evaluated VLMs. Detailed text representations of the target yield higher reconstruction success across modality conditions, while decomposed image representations improve performance. These findings reveal limits in visual spatial grounding and grounded instruction generation for collaborative VLM agents.

[36] Target-Side Paraphrase Augmentation for Sign Language Translation with Large Language Models cs.CL | cs.AIPDF

Pedro Dal Bianco, Jean Paul Nunes Reinhold, Oscar Stanchi, Facundo Quiroga, Franco Ronchetti

TL;DR: 本文研究了利用GPT-4o生成目标端（文本）释义变体来增强手语翻译（SLT）数据的方法，通过一个基于姿态的Signformer式Transformer模型进行两阶段训练（预训练与微调），并在三个具有不同挑战性的数据集上进行了评估。

Details

Motivation: 手语翻译面临配对数据稀缺和目标词汇长尾分布的约束，本文旨在通过大语言模型生成目标端释义来增强数据，以缓解这些问题。

Result: 在PHOENIX14T数据集上，该方法将BLEU-4分数从9.56提升至10.33；在GSL和LSA-T数据集上，该方法分别揭示了其在接近饱和基线及极端稀疏场景下的局限性。

Insight: 创新点在于首次将LLM生成的目标端释义和LLM-as-a-Judge评估应用于手语翻译；语义评估表明，该方法在保真度上的提升被词汇重叠指标所低估。

Abstract: Sign language translation (SLT) remains constrained by limited paired sign-video/text corpora and heavy-tailed target vocabularies. We study target-side augmentation in which GPT-4o generates controlled paraphrase variants of reference sentences while the sign input remains unchanged. A Signformer-style pose-based Transformer is trained under a two-stage schedule: pre-training on the augmented corpus followed by fine-tuning on the original references. We evaluate on three datasets spanning complementary challenges: PHOENIX14T (German Sign Language), with moderate lexical diversity; GSL (Greek Sign Language), with highly ontrolled, repetitive recordings; and LSA-T (Argentinian Sign Language), with severe long-tail sparsity. On PHOENIX14T, augmentation improves BLEU-4 from 9.56 to 10.33. The near-saturated GSL baseline and extremely sparse LSA-T setting reveal the limits of the approach. To our knowledge, this is the first study to apply LLM-generated target-side araphrases and LLM-as-a-Judge evaluation to SLT. The semantic evaluation reveals gains in fidelity that lexical overlap metrics understate.

[37] “Intelegi Româneşte?’’ A Recipe for Romanian Vision-Language Models cs.CLPDF

Mihai Masala, Marius Leordeanu, Mihai Dascalu, Traian Rebedea

TL;DR: 本文系统性地研究了如何为罗马尼亚语构建特定语言的视觉语言模型（VLM），涵盖了从数据构建到架构选择的完整流程。作者通过机器翻译将成熟的英语VLM训练和评估语料库转化为罗马尼亚语，并创建了基于罗马尼亚日常场景的文化原生评估集HoraVQA。实验表明，经过罗马尼亚语适配的VLM在性能上优于同规模模型，甚至在某些基准测试中超越了更大规模的模型。

Details

Motivation: 当前视觉语言模型主要遵循仅文本大语言模型的轨迹，在英语基准上表现出色，但在低资源语言（如罗马尼亚语）上性能急剧下降，因为缺乏大规模图像-文本语料库和文化相关的评估。

Result: 罗马尼亚语适配的VLM在所有评估基准上一致优于同规模模型，甚至超越了更大规模类别的模型，特别是在文化原生评估集HoraVQA上表现突出。

Insight: 创新点包括通过机器翻译和OCR风格图像文本数据构建罗马尼亚语VLM训练数据的方法，以及创建文化原生评估集HoraVQA来评估模型在低资源语言上的真实性能；客观分析认为，系统性地研究数据构建、架构选择和文化适配对VLM性能的影响，为其他低资源语言提供了可借鉴的完整流程。

Abstract: Vision-Language Models (VLMs) largely follow the text-only LLM trajectory, excelling on English benchmarks but sharply degrading on low-resource languages, where neither large-scale image-text corpora nor culturally grounded evaluations exist. We present a systematic study of building a language-specific VLM for Romanian, covering the full pipeline from data construction to architectural choices. We translate established English VLM training and evaluation corpora into Romanian, applying machine translation to textual annotations and to in-image text, preserving visual grounding while adapting the textual content. Using this data, we train and ablate a series of VLMs to isolate the contribution of (i) vision backbones of varying scale and pretraining, (ii) language backbones from multilingual to Romanian-adapted LLMs, and (iii) OCR-style image-text data. We further curate HoraVQA, a culturally native evaluation set grounded in Romanian everyday scenes. Romanian-adapted VLMs consistently outperform their same-sized counterparts and, across all evaluated benchmarks, even surpass models from the next larger size category.

Xudong Zhang, Jian Yang, Shengkai Wang, Jiangpeng Tian, Shaowen Chen

TL;DR: 本文提出了一种双干预框架，用于解耦语言结构和上下文线索，以评估大型语言模型在导航规划中的语言归纳偏置。研究发现，拓扑信息是鲁棒规划的坚实后盾，语言格式是一把双刃剑，而语义信息则是致命弱点，错误语义线索会系统性地破坏规划过程。

Details

Motivation: 现有基于LLM的导航系统通常将空间表示转换为文本描述作为输入，但语言结构和上下文特征的选择常被视为中性工程决策，而非影响LLM行为的关键因素，本文旨在填补这一研究空白。

Result: 在多种空间推理任务和不同模型规模上的实验表明，拓扑信息是鲁棒规划的支柱，语言格式的效果取决于模型大小、任务需求和压缩水平，而错误语义信息会系统性地破坏规划。

Insight: 创新点在于提出双干预框架来解耦语言结构和上下文线索，客观分析表明，有效的基于文本的空间表示应保持拓扑完整性、根据模型能力校准表示压缩并确保语义正确性，而非简单采用单一表示。

Abstract: Large Language Model (LLM)-based navigation systems commonly construct explicit spatial representations (e.g., topological graphs, semantic raster maps) and translate them into textual descriptions as LLMs’ inputs. However, the linguistic structures of such text-based spatial representations and the choices of contextual features (e.g., topology, geometry) they contain are often treated as neutral engineering decisions rather than key factors that shape LLMs’ behavior. To fill the gap, we propose a dual-interventional framework that disentangles linguistic structures from different contextual cues to evaluate the linguistic inductive bias of LLMs for navigation planning. In the framework, representation intervention varies the linguistic format and the degree of linguistic compression, clarifying when linguistic representations support or inhibit navigation planning. Context intervention, combined with contextual feature combination and conflict probing, explicitly clarifies the preferences and weaknesses of LLMs when processing different contextual cues. Experiments across diverse spatial reasoning tasks and multiple model scales reveal a consistent pattern: topological information is a sturdy shield and the backbone of robust planning; linguistic format is a double-edged sword whose effect depends on model size, task demands, and the compression level; and semantic information is a fatal Achilles’ heel – incorrect semantic cues can systematically derail the planning process. Overall, our study shows that effective text-based spatial representations in LLM-based navigation should preserve topological integrity, calibrate representational compression to model capacity, and ensure semantic correctness, rather than simply adopting a single representation. Our code is publicly available at https://github.com/jonesdong150/LLM-Navigation-Inductive-Bias.

[39] Skill Availability and Presentation Granularity in Large-Language-Model Agents: A Controlled SkillsBench Study cs.CL | cs.AI | cs.LGPDF

Xiaonan Xu, Wenjing Wu

TL;DR: 本文通过一项受控的SkillsBench研究，探讨了在大语言模型智能体中，技能知识的可用性及其呈现粒度对下游任务成功率的影响。实验表明，提供技能文档能显著提升任务成功率，而技能描述的抽象程度（粒度）变化则影响较小且不确定。

Details

Motivation: 研究动机是探究在推理时为LLM智能体提供程序性知识（技能文档）时，技能知识的呈现粒度（如抽象程度、是否包含示例）是否会改变下游任务的执行成功率。

Result: 在SkillsBench的30个任务子集上，相对于不提供技能，提供技能使GPT-5.5的任务平均通过率提升26.7至36.0个百分点，使DeepSeek V4-Flash提升18.0至26.0个百分点。而呈现粒度（高低抽象、是否添加示例）的对比效应较小，且置信区间包含零，表明结果不确定且模型依赖。

Insight: 核心创新点在于对技能知识“呈现粒度”这一具体维度进行了受控实验分析。客观来看，研究强调了技能可用性是提升任务性能的关键强信号，而单纯调整技能描述的抽象程度或添加示例，其效果在本次实验中有限且不稳定，这为设计高效的LLM智能体技能系统提供了实证依据。

Abstract: Skill documents provide procedural knowledge to large-language-model agents at inference time. This article studies whether the presentation granularity of controlled skill knowledge changes downstream task success. The experiment uses a pinned SkillsBench version, a 30-task domain-balanced subset validated by official oracle runs, two reasoning-enabled model configurations, six skill conditions, and five trials per task-condition-model cell. Skill availability is the clearest empirical signal. Relative to no skill, skill conditions increase task-mean pass rate by 26.7 to 36.0 percentage points for GPT-5.5 and by 18.0 to 26.0 percentage points for DeepSeek V4-Flash. The final data contain 1,800 rows, with 900 rows for each model. The task is the inference unit. Five trials are aggregated within each task-condition-model cell before paired contrasts are estimated over 30 tasks. The primary presentation contrasts are smaller and uncertain. Low-abstraction guidance differs from high-abstraction guidance by +0.7 percentage points for GPT-5.5 and -6.7 percentage points for DeepSeek V4-Flash, with both 95% bootstrap confidence intervals crossing zero. Adding one worked example to medium-abstraction guidance differs from the no-example variant by +0.7 and +1.3 percentage points. Mean-reward robustness checks preserve the same substantive conclusion. In this controlled subset, skill availability is associated with higher success than no skill, while the tested presentation-granularity changes yield small, uncertain, and model-dependent effects.

[40] DOA: Training-Free Decoder-Only Attention Policy for Long-Form Simultaneous Translation with SpeechLLMs cs.CL | cs.AI | cs.SDPDF

Sara Papi, Luisa Bentivogli

TL;DR: 本文提出了一种名为Decoder-Only Attention (DOA)的训练无关策略，用于解决仅解码器架构的语音大语言模型在长文本同声传译任务中的流式决策问题。该方法通过从自注意力中提取代理对齐信号，无需重新训练即可实现低延迟的长文本同声传译，性能接近离线解码。

Details

Motivation: 现有基于编码器-解码器架构的同声传译方法依赖交叉注意力提供明确的对齐信号，而仅解码器的语音大语言模型仅依赖自注意力，其是否包含足够稳定的对齐信号来指导流式策略尚不明确。此外，现有方法通常依赖基于训练的调整或启发式策略，且未在长文本场景中得到验证。

Result: 在Phi4-Multimodal和Qwen3-Omni模型上的实验表明，DOA策略能提供有效的对齐信号来支持流式决策，在长文本同声传译任务中实现了低延迟，且翻译质量接近离线解码水平。

Insight: 创新点在于首次提出并验证了仅解码器模型的自注意力机制可用于提取稳定的流式对齐信号，并设计了一种无需训练的策略（DOA）来利用该信号，从而将现成的语音大语言模型直接应用于长文本同声传译任务，无需模型微调或复杂启发规则。

Abstract: Simultaneous speech-to-text translation (SimulST) generates translations while speech is still unfolding, requiring a streaming policy that decides when to read and when to write. State-of-the-art approaches rely on attention-based encoder-decoder models where cross-attention provides explicit alignment signals. In contrast, Speech Large Language Models (SpeechLLMs) are decoder-only architectures relying solely on self-attention. This raises a central question: whether decoder self-attention contains sufficiently stable alignment signals to guide the streaming policy. Moreover, existing approaches typically rely on training-based adaptations or heuristic wait-$k$ policies and have not been validated in long-form settings. To fill these gaps, we propose Decoder-Only Attention (DOA), a training-free policy that enables long-form simultaneous translation with off-the-shelf SpeechLLMs by deriving a proxy alignment from self-attention. Experiments on Phi4-Multimodal and Qwen3-Omni show that DOA provides an effective alignment signal for supporting streaming decisions, enabling low-latency long-form SimulST with quality close to offline decoding without retraining.

[41] Fine-grained Verification via Diagnostic Reasoning Supervision for Aspect Sentiment Triplet Extraction cs.CL | cs.AIPDF

Wenna Lai, Haoran Xie, Guandong Xu, Qing Li, S. Joe Qin

TL;DR: 本文提出FiVeD框架，用于细粒度验证方面情感三元组提取（ASTE）的结果。该框架通过诊断推理监督训练验证器，结合有效性分类、质量评分估计、错误类型分类和理由生成等多任务学习，对提取的三元组进行过滤或重排序，以提高ASTE系统的可靠性。

Details

Motivation: 现有ASTE研究主要关注端到端提取，而提取后三元组的验证相对不足，导致预测的三元组可能局部合理但全局无效，限制了系统的可靠性。此外，候选无效性具有多面性，候选可用性本质上是分级的，因此需要细粒度验证机制来过滤或重排序不同提取器的输出。

Result: 在多个ASTE基线模型上的实验表明，FiVeD作为即插即用验证模块，能持续提升提取性能，最高可提高3.53 F1分数，支持可调整的精确率-召回率权衡。

Insight: 创新点包括引入细粒度验证机制，通过多任务学习（主任务为有效性分类和质量评分估计，辅助任务为错误类型分类和理由生成）和层次化错误类别定义，并利用现成大语言模型（LLM）生成质量评分和诊断理由，以增强ASTE输出的可靠性。

Abstract: Aspect Sentiment Triplet Extraction (ASTE) aims to identify aspect terms, opinion terms, and sentiment polarities as structured triplets, providing essential inputs for downstream information system applications such as opinion mining, explainable recommendations, and review summarization. Prior work mainly focuses on end-to-end extraction, while post hoc verification of extracted triplets remains comparatively underexplored. This gap limits the reliability of ASTE systems, since predicted triplets may be locally plausible while being globally invalid. Moreover, candidate invalidity is multi-faceted and candidate usability is inherently graded, motivating a fine-grained verification mechanism that can filter or re-rank outputs from diverse extractors. In this paper, we propose FiVeD, a framework for Fine-grained Verification with Diagnostic reasoning supervision. Specifically, the verifier is trained with multiple complementary objectives, including validity classification and quality score estimation as primary tasks, with error type classification and rationale generation as auxiliary tasks. We define hierarchical error categories and construct plausible incorrect triplets under semantic and syntactic constraints, and leverage an off-the-shelf LLM with task-specific rubrics to produce quality scores and diagnostic rationales. During inference, the resulting quality scores are used to filter candidate outputs, supporting adjustable precision-recall tradeoffs. Experiments across multiple ASTE baselines demonstrate that FiVeD consistently improves extraction performance by up to 3.53 F1 points as a plug-and-play verification module.

[42] SCOPE: Self-Play via Co-Evolving Policies for Open-Ended Tasks cs.CLPDF

Wai-Chung Kwan, Aryo Pradipta Gema, Joshua Ong Jun Leang, Pasquale Minervini

TL;DR: SCOPE是一种无需外部数据的自博弈框架，用于开放域任务训练。它通过协同演化两个策略——生成基于文档任务的Challenger和通过多轮检索回答的Solver——并利用初始模型的冻结副本作为自我评判器来生成任务特定评分标准并评估回答，从而提升语言模型在开放域任务上的性能。

Details

Motivation: 现有自博弈方法依赖规则可检查的答案，导致开放域任务需要人工设计的提示或前沿模型作为评判者，限制了其应用范围。SCOPE旨在解决开放域任务中缺乏有效自监督训练框架的问题。

Result: 在三个7-8B指令调优模型（Qwen2.5、Qwen3、OLMo-3）上，SCOPE在八个开放域基准测试中性能提升高达+10.4分，匹配或超越了使用约9K人工设计提示训练的GRPO_data。此外，在七个保留的短问答基准测试中，性能提升高达+13.8分，在所有三个模型上均超越了GRPO_data。

Insight: 创新点包括：通过协同演化Challenger和Solver策略保持任务难度接近模型前沿；利用冻结初始模型作为自我评判器生成任务特定评分标准；研究表明任务协同演化是必要的，性能提升源于检索和合成的共同改进，而评分标准生成质量是自我评判的瓶颈。

Abstract: Self-play can train language models without external supervision. However, existing methods require rule-checkable answers, leaving open-ended tasks dependent on curated prompts or frontier-model judges. We introduce SCOPE, a data-free self-play framework for open-ended tasks that co-evolves two policies: a Challenger that generates document-grounded tasks, and a Solver that answers them through multi-turn retrieval. A frozen copy of the initial model serves as the self-judge, which writes task-specific rubrics from the source document and grades Solver responses against them. Across three 7-8B instruction-tuned models (Qwen2.5, Qwen3, OLMo-3), SCOPE improves open-ended performance by up to +10.4 points on eight benchmarks and matches or exceeds GRPO_data trained on ~9K curated prompts. Although trained only on open-ended tasks, SCOPE also improves held-out short-form QA by up to +13.8 points on seven held-out benchmarks, surpassing GRPO_data on all three models. Ablations show that co-evolving the Challenger is necessary to keep tasks near the Solver’s frontier, that gains arise from improvements in both retrieval and synthesis with the relative contribution varying by task, and that rubric generation quality is the bottleneck for self-judging.

[43] Are Full Rollouts Necessary for On-Policy Distillation? cs.CLPDF

Yaocheng Zhang, Jiajun Chai, Songjun Tu, Yuqian Fu, Xiaohan Wang

TL;DR: 本文研究了在线策略蒸馏（OPD）中是否需要生成完整轨迹的问题，指出完整轨迹计算成本高且可能导致不可靠的教师反馈。作者提出了两种简单的轨迹长度控制策略：渐进式OPD（POPD）在训练中逐步扩展轨迹长度，截断式OPD（TOPD）则永久使用截断的可靠轨迹进行蒸馏。

Details

Motivation: 标准OPD在训练中生成完整轨迹，计算开销大，且在训练早期轨迹后期可能提供不可靠的教师反馈，影响训练效率。作者认为OPD不像RLVR那样需要完整轨迹或最终奖励来提供学习信号，因此完整轨迹可能并非必要。

Result: 在数学推理任务上的实验表明，POPD将OPD的训练效率提升了高达3倍，而TOPD仅使用10%的轨迹长度就能达到与OPD相当的性能，显著减少了训练时间和内存消耗。

Insight: 创新点在于识别轨迹长度是OPD的关键瓶颈，并提出了两种简单有效的轨迹控制策略。从客观角度看，这为高效OPD提供了一种实用路径，通过动态或固定地缩短轨迹来平衡计算成本与反馈可靠性，尤其适用于长序列推理任务。

Abstract: On-policy distillation (OPD) provides dense teacher feedback along rollouts generated by the student and has emerged as a promising post-training paradigm for long-horizon reasoning. However, standard OPD typically generates full rollouts during training, which is computationally expensive and may expose the student to unreliable teacher feedback at late rollout positions, especially during early training. We identify the rollout horizon as a key bottleneck in OPD that substantially impacts training efficiency. Unlike Reinforcement Learning with Verifiable Rewards (RLVR), OPD does not require a complete trajectory or a final answer reward to provide learning signals. This observation suggests that full rollouts may not always be necessary for effective OPD. Motivated by this insight, we propose two simple horizon-control strategies: Progressive OPD (POPD), which gradually expands the rollout horizon during training, and Truncated OPD (TOPD), which permanently performs distillation on reliable truncated rollouts. Experiments on mathematical reasoning show that POPD improves the training efficiency of OPD by up to 3$\times$, while TOPD matches OPD performance using only 10% of the rollout horizon, leading to substantial wall-clock and memory reductions. These results demonstrate that controlling the rollout horizon offers a simple and practical path to more efficient OPD.

[44] BenHalluEval: A Multi-Task Hallucination Evaluation Framework for Large Language Models on Bengali cs.CLPDF

Shefayat E Shams Adib, Ahmed Alfey Sani, Ekramul Alam Esham, Ajwad Abrar, Ishmam Tashdeed

TL;DR: 本文提出了BenHalluEval，这是首个针对孟加拉语大语言模型的细粒度幻觉评估框架，涵盖生成式问答、孟英混合代码问答、摘要和推理四个任务。该框架构建了12,000个由GPT-4生成的幻觉候选样本，并采用双轨评估协议（Track A测量真实实例的假阳性率，Track B测量幻觉候选的检测率）评估了七类LLM。为了联合惩罚两种失败模式并避免统一响应偏差导致分数虚高，作者提出了BenHalluScore校准指标，其值在模型和任务间差异显著（7.72%至55.42%）。思维链提示作为一种缓解策略，改变了响应分布但并未持续改善幻觉辨别能力。该工作为低资源语言环境建立了首个专用幻觉基准，并凸显了单轨和仅提示评估方法的不足。

Details

Motivation: 尽管孟加拉语是世界第六大语言，但此前没有系统评估孟加拉语大语言模型幻觉的工作。本文旨在填补这一空白，为孟加拉语建立一个全面的幻觉评估基准。

Result: 在构建的BenHalluEval基准上，评估了七种LLM（涵盖推理导向、多语言和孟加拉语中心化类别）。提出的BenHalluScore指标值在模型和任务间从7.72%到55.42%不等，揭示了幻觉校准存在显著差异。思维链提示未能一致改善幻觉辨别。

Insight: 主要创新点在于为低资源语言（孟加拉语）建立了首个细粒度、多任务的幻觉评估框架和专用基准。方法论上的创新是提出了双轨评估协议（Track A和Track B）以及联合校准指标BenHalluScore，这能更全面地评估模型性能，避免因响应偏差导致的分数虚高，对低资源语言评估具有借鉴意义。

Abstract: Despite Bengali being the sixth most spoken language in the world, no prior work has systematically evaluated hallucination in large language models (LLMs) for Bengali. We introduce BenHalluEval, a fine-grained hallucination evaluation framework for Bengali covering four tasks: Generative Question Answering (GQA), Bangla-English Code-Mixed QA, Summarization, and Reasoning. We construct 12,000 hallucinated candidates using GPT-5.4 across twelve task-specific hallucination types, drawn from three existing Bengali datasets, and evaluate seven LLMs spanning reasoning-oriented, multilingual, and Bengali-centric categories under a dual-track protocol that independently measures false-positive rate on ground-truth instances (Track A) and hallucination detection rate on hallucinated candidates (Track B). To jointly penalise both failure modes and prevent inflated scores from uniform response bias, we propose BenHalluScore, a dual-track calibration metric that ranges from 7.72% to 55.42% across models and tasks, revealing substantial variation in hallucination calibration. Chain-of-thought prompting, applied as a mitigation strategy, shifts response distributions without consistently improving hallucination discrimination. BenHalluEval establishes the first dedicated hallucination benchmark for Bengali and highlights the inadequacy of single-track and prompting-only evaluation approaches for low-resource language settings. The dataset and code are available at https://anonymous.4open.science/r/BanglaHalluEval-EB77.

[45] If LLMs Have Human-Like Attributes, Then So Does Age of Empires II cs.CL | cs.AI | cs.CYPDF

Adrian de Wynter

TL;DR: 这篇论文通过构建一个在《帝国时代II》游戏中训练的简单神经网络，论证了大型语言模型（LLMs）所表现出的类人属性（如道德或自然语言理解）并非其独有，而是任何足够强大的系统都可能呈现的。作者指出，基于经验讨论这些属性需要明确的衡量标准，否则解释将依赖于表征方式，并提出了以‘非唯一性’为假设的实验设计方法。

Details

Motivation: 针对当前许多研究将类人属性（如道德或自然语言理解）归因于LLMs的现象，作者旨在指出这些结论可能不正确，因为类似属性在其他系统中也可能出现，从而强调需要更严谨的实证标准来评估这些属性。

Result: 论文通过构建并训练一个在《帝国时代II》游戏上的简单神经网络，展示了该系统也能表现出类似LLMs的类人属性，从而实证地证明了这些属性并非LLMs独有。

Insight: 创新点在于通过具体案例（《帝国时代II》神经网络）挑战了LLMs类人属性的独特性假设，并提出了以‘非唯一性’为实验假设的方法论，强调在评估AI系统时需要明确的测量标准以避免主观解释。

Abstract: Much research has been carried out on large language models (LLMs) and LLM-powered agentic workflows. However, many works within the field state emergence of, ascribe to, or assume, generalised anthropomorphic attributes to them (e.g., morality or understanding of natural language). Our goal is not to argue in favour or against the existence of these attributes, but to point out that these conclusions could be incorrect. For this we build and train a simple neural network on the videogame Age of Empires II, and note that any entity in a sufficiently-powerful substrate, such as LEGO or the Greater Boston Area, could also present such attributes. Hence, the purported anthropomorphic attributes of LLMs are empirically non-unique: although some properties (e.g., responses to prompts) could remain constant, others, such as the interpretation of their perceived behaviour, might change with the substrate. Thus, any empirically-grounded discussion requires explicit measurement criteria; otherwise the interpretation is left to the representation. We then show that assuming that these attributes exist or not in a system, independent of the substrate and in a generalised way, leads to either circular or uninformative conclusions, regardless of the experimenter’s viewpoint on the subject. Finally we propose a ‘null’ assumption, where one assumes LLM non-uniqueness instead of assuming anthropomorphic attributes to set up an experiment, along with examples of it. We also discuss potential objections to our work, briefly survey the field, and prove that \textit{Age of Empires II} is functionally- and Turing-complete.

[46] UniAudio-Token: Empowering Semantic Speech Tokenizers with General Audio Perception cs.CL | cs.SDPDF

Yuhan Song, Linhao Zhang, Aiwei Liu, Chuhan Wu, Sijun Zhang

TL;DR: 本文提出了UniAudio-Token框架，旨在增强语义语音分词器的通用音频感知能力，同时保持其语音能力。该框架通过引入语义-声学基元（SAP）的结构化监督和语义-声学均衡（SAE）的内容感知门控机制，来弥补传统语义分词器在声学细节上的信息损失。实验表明，该分词器能学习全面的通用音频表示，并在下游LLM集成中，在理解和生成任务上均优于所有单码本基线分词器，成为一个统一的音频接口。

Details

Motivation: 现有的语义语音分词器因其紧凑的单码本设计和强语言对齐而被广泛用作Audio-LLM的接口，但其专注于语言抽象导致了声学盲区，限制了其在非纯语音任务中的适用性。本文旨在解决这一局限性，赋予语义分词器通用音频感知能力。

Result: 广泛的评估表明，UniAudio-Token在保持高保真语音生成的同时，学习了全面的通用音频表示。当下游与LLM集成时，它在理解和生成任务上均优于所有单码本基线分词器。

Insight: 主要创新点包括：1）语义-声学基元（SAP），通过将音频分解为语言内容、声乐属性和听觉场景基元来提供结构化监督；2）语义-声学均衡（SAE），引入内容感知门控机制，自适应地从浅层恢复细粒度的声学细节。这为构建统一的音频表示接口提供了新思路，在不改变语义范式的前提下有效弥补了信息损失。

Abstract: Semantic speech tokenizers have become a widely used interface for Audio-LLMs, owing to their compact single-codebook design and strong linguistic alignment. However, their focus on linguistic abstraction induces acoustic blindness, limiting their applicability beyond speech-centric tasks. We propose UniAudio-Token, a framework that empowers semantic tokenizers with general audio perception without compromising speech ability. Instead of altering the semantic paradigm, UniAudio-Token mitigates its information loss through two key innovations: (1) Semantic-Acoustic Primitives (SAP) provide structured supervision by decomposing audio into linguistic content, vocal attributes, and auditory-scene primitives; and (2) Semantic-Acoustic Equilibrium (SAE) introduces a content-aware gating mechanism that adaptively restores fine-grained acoustic details from shallow layers. Extensive evaluations show that UniAudio-Token learns comprehensive universal representations while preserving high-fidelity speech generation. When integrated with downstream LLMs, it outperforms all single-codebook baseline tokenizers on both understanding and generation tasks, effectively serving as a unified audio interface. We publicly release all our code, including training and inference scripts, together with the model checkpoints at https://github.com/Tencent/Universal_Audio_Tokenizer.

[47] Preference-Aware Rubric Learning for Personalized Evaluation cs.CLPDF

Yilun Qiu, Xiaoyan Zhao, Yang Zhang, Yuxin Chen, Cilin Yan

TL;DR: 本文提出了一种名为PARL（偏好感知评分标准学习）的个性化评估框架，旨在解决大语言模型（LLM）个性化评估的瓶颈。该框架将个性化评估视为一个学习问题，通过从原始用户交互历史中学习偏好感知的评估标准，并结合判别式强化学习目标，以可靠地识别符合用户偏好的模型输出。

Details

Motivation: 随着大语言模型向以用户为中心的智能体发展，个性化对于使模型行为与个体偏好对齐变得至关重要。然而，现有的评估方法（从自动指标到LLM作为评判者）无法捕捉长期交互历史中嵌入的主观、用户特定的偏好，因此需要新的评估范式。

Result: 在真实世界的个性化文本生成任务上的实验表明，PARL能够持续地诱导出高保真度的评估标准，这些标准能可靠地识别用户对齐的响应，并在不同用户和任务间具有良好的泛化能力，同时能捕捉稳定的风格偏好和细粒度的评估模式。

Insight: 论文的核心创新在于将个性化评估重新定义为学习问题，并提出了一个集成了评分标准归纳和判别式强化学习的框架。其提出的代表性、用户一致性和判别性三个原则，以及通过对比用户真实响应与模型输出来学习精确决策边界的方法，为构建更可靠的个性化评估系统提供了新思路。

Abstract: As Large Language Models (LLMs) evolve from general-purpose assistants to user-centric agents, personalization has become central to aligning model behavior with individual preferences, making the evaluation of personalized alignment a critical bottleneck. Existing evaluation methods-ranging from automatic metrics to LLM-as-a-judge approaches-fail to capture subjective, user-specific preferences embedded in long-term interaction histories. We identify three essential principles for reliable and effective personalized evaluation: Representativeness, User-Consistency, and Discriminativeness. To address these principles, we introduce Personalized Evaluation as Learning, a paradigm that formulates personalized evaluation as a learning problem rather than a static judgment. Under this paradigm, we propose PARL (Preference-Aware Rubric Learning for Personalized Evaluation), a framework that learns to induce preference-aware evaluation rubrics directly from raw user histories and performs a self-validation mechanism to ensure consistency with the user’s preferences. PARL integrates rubric induction with a discriminative reinforcement learning objective that contrasts user-authored responses against competitive personalized model outputs, enabling the learned rubrics to capture precise, user-specific decision boundaries. Experiments on real-world personalized text generation tasks show that PARL consistently induces high-fidelity rubrics that reliably identify user-aligned responses and generalize across users and tasks, while capturing stable stylistic preferences and fine-grained evaluative patterns. To ensure reproducibility, our code is available at https://github.com/SnowCharmQ/PARL.

[48] What Am I Missing? Question-Answering as Hidden State Probing cs.CLPDF

Chu Fei Luo, Samuel Dahan, Xiaodan Zhu

TL;DR: 本文提出了一种利用提问作为推理时干预的方法，通过学生-教师框架探索大型语言模型（LLM）的隐藏状态。研究发现，提问过程中的自我诊断信号能预测推理轨迹的正确性，但干预效果受模型自一致性限制，揭示了诊断与修正之间的差距。

Details

Motivation: 旨在探索LLM推理过程的机制，特别是如何通过提问干预来揭示模型隐藏状态中的信息，以理解模型在不确定性下的自我修正能力。

Result: 实验表明，基于隐藏状态训练的探针能预测推理正确性，但干预策略在检测模型不确定性的同时，对正确轨迹的损害与错误轨迹的修正概率相当，未实现显著性能提升。

Insight: 创新点在于将提问框架为隐藏状态探针，揭示了LLM自我诊断与修正之间的脱节；客观分析认为，这突显了模型自一致性对干预效果的关键影响，为理解推理机制提供了新视角。

Abstract: Test-time reasoning has become a significant field of study since the introduction of chain-of-thought reasoning in large language models (LLMs). However, the mechanisms of this reasoning process are still under-explored – from the same input prompt, and even the same partial solution, LLMs can produce varied answers if sampled multiple times. We propose to leverage question-asking as an inference-time intervention that articulates information about the model’s hidden state. To achieve that, we present a student-teacher setting where a student asks questions to a teacher. We train a probe on the student’s hidden state before and after asking a question and find it is predictive of the trajectory’s final correctness, even before generating the teacher’s answer. This suggests there is a meaningful signal from the self-diagnosis that occurs during question generation rather than information transfer from the teacher. We then frame question-asking as a sequential decision problem, using this probe as a quality score, and define a gating policy to ask questions that maximize likelihood of correctness. We find that the success of question-asking as an intervention is largely dependent on the model’s self-consistency. Our empirical results show a gap between detection and recovery; while our gating policy captures model correctness and uncertainty, interventions are equally likely to harm correct trajectories as they are to recover incorrect ones. This gap between diagnosis and correction has broader implications on language models’ capacity for self-refinement under uncertainty.

[49] Disagreeing Rationales: Rethinking Classification and Explainability Evaluation in Hate Speech Detection cs.CLPDF

Benedetta Muscato, Beiduo Chen, Gizem Gezici, Barbara Plank, Fosca Giannotti

TL;DR: 本文系统研究了仇恨言论检测中人类标注分歧与解释多样性的影响，通过统一框架比较了不同模型、训练策略和评估指标在分类与可解释性任务上的表现。研究发现软标签和软解释表示能更好地捕捉人类标注的变异性，并揭示了主观性NLP任务中评估方法需重新思考。

Details

Motivation: 针对人类在标注仇恨言论时存在的标签分歧和解释多样性问题，探索如何有效评估和聚合这些多样化的解释，以更全面地理解人类推理的丰富性。

Result: 在统一监督框架下，通过分类指标（预测性和分布性）和可解释性指标（合理性、忠实性、复杂性）评估模型，结果表明硬指标和软指标均倾向于软表示，突显了其在捕捉变异方面的有效性。

Insight: 创新点在于提出了一个统一的评估协议，将分类与可解释性指标系统化，并强调在主观NLP任务中使用软表示来更好地处理人类标注的不确定性，为未来评估方法提供了新视角。

Abstract: Human disagreement is ubiquitous and well-known in labeling. However, variation in explanations, captured through token-level human rationales, remains far less explored. At the same time, it is unclear how to best evaluate human labels and rationales – or even how to best aggregate rationales beyond majority vote – in light of this variation. Yet, rationales may provide additional insights into the richness of human reasoning, that may differ in style, values and interpretations – especially in subjective NLP tasks like hate speech detection. In this work, we unify diverse models, training strategies, loss functions, and existing evaluation metrics under a single protocol by systematically re-implementing them across different label and rationale representation spaces. Classification metrics are organized around two key properties – predictive and distributional – while explainability metrics through three complementary dimensions: plausibility, faithfulness, and complexity. In this unified supervision framework, we evaluate model behavior across classification and explainability metrics, as well as metric sensitivity to the choice of label (hard and soft) and rationale representation space (hard, intermediate and soft). Results show that both hard and soft metrics favor softer representations, highlighting their effectiveness in capturing variation and the need to rethink evaluation in subjective NLP.

[50] LongTraceRL: Learning Long-Context Reasoning from Search Agent Trajectories with Rubric Rewards cs.CL | cs.AI | cs.LGPDF

Nianyi Lin, Jiajie Zhang, Lei Hou, Juanzi Li

TL;DR: 该论文提出了一种名为LongTraceRL的新方法，旨在解决大语言模型在长上下文推理任务中的核心挑战。该方法通过利用搜索代理轨迹构建分层干扰文档，并设计基于评分标准的细粒度奖励，来训练模型在复杂长文本中进行更全面、基于证据的推理。

Details

Motivation: 当前大语言模型在长上下文推理中难以定位和整合关键信息，而现有的基于可验证奖励的强化学习方法存在干扰项混淆度低、奖励信号稀疏且仅关注最终结果的问题，无法监督中间推理步骤。

Result: 在三个参数量为4B至30B的推理大语言模型上，于五个长上下文基准测试中进行实验，结果表明LongTraceRL方法持续优于多个强基线模型，并能促进全面、基于证据的推理。

Insight: 主要创新点包括：1）利用搜索代理轨迹构建具有不同混淆度的分层干扰文档，创造了比随机采样或一次性搜索更具挑战性的训练上下文；2）提出了一种仅应用于最终答案正确响应的“评分标准奖励”，该奖励以推理链中的黄金实体作为细粒度的过程监督，能区分正确回答的推理质量并防止奖励攻击。

Abstract: Long-context reasoning remains a central challenge for large language models, which often fail to locate and integrate key information in extensive distracting content. Reinforcement learning with verifiable rewards (RLVR) has shown promise for this task, yet existing methods are limited by low-confusability distractors and sparse, outcome-only reward signals that cannot supervise intermediate reasoning steps. To address these issues, we introduce \textsc{LongTraceRL}. For data construction, we generate multi-hop questions via knowledge graph random walks and leverage search agent trajectories to build \emph{tiered distractors}: documents the agent read but did not cite (high confusability) and documents that appeared in search results but were never opened (low confusability), producing training contexts that are far more challenging than those built by random sampling or one-shot search. For reward design, we propose a \emph{rubric reward} that uses the gold entities along each reasoning chain as fine-grained, entity-level process supervision. This rubric reward is applied only to responses with correct final answers (positive-only strategy), distinguishing the reasoning quality among correct responses and preventing reward hacking. Experiments on three reasoning LLMs (4B–30B) across five long-context benchmarks demonstrate that \textsc{LongTraceRL} consistently outperforms strong baselines and encourages comprehensive, evidence-grounded reasoning. Codes, datasets and models are available at \href{https://github.com/THU-KEG/LongTraceRL}{https://github.com/THU-KEG/LongTraceRL}.

cs.CV [Back]

[51] SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformer cs.CV | cs.AIPDF

Yuyang Zhao, Yicheng Pan, Qiyuan He, Jincheng Yu, Junsong Chen

TL;DR: SANA-Streaming是一个系统-算法协同设计的框架，旨在实现消费级GPU上的高分辨率实时流式视频编辑。它通过混合扩散Transformer架构、循环反向正则化训练策略以及针对NVIDIA Blackwell架构优化的高效系统协同设计（包括融合GDN内核和混合精度量化），在单块RTX 5090 GPU上实现了1280x704分辨率下24端到端FPS的实时编辑性能。

Details

Motivation: 解决实时流式视频到视频编辑（V2V）在直播和游戏等交互式应用中的挑战，这些应用对时间一致性和推理吞吐量有严格要求。

Result: 在单块RTX 5090 GPU上实现了1280x704分辨率下24端到端FPS的实时编辑，其DiT核心运行速度为58 FPS。实验结果表明，该协同设计方法在时间一致性和系统吞吐量方面显著优于现有的SOTA方法。

Insight: 创新点包括：1）混合扩散Transformer架构，在部分块中引入softmax注意力以提升局部建模能力，同时保持线性层效率；2）循环反向正则化训练策略，通过流匹配从生成内容预测源帧来增强语义一致性，无需成对的长编辑视频；3）针对特定硬件（NVIDIA Blackwell）的系统协同优化，如融合GDN内核和混合精度量化，以最大化Tensor Core利用率并保持生成质量。

Abstract: Real-time streaming video-to-video editing (V2V) is critical for interactive applications such as live broadcasting and gaming, yet it remains a formidable challenge due to the stringent requirements for temporal consistency and inference throughput. In this paper, we present SANA-Streaming, a system-algorithm co-designed framework for high-resolution, real-time streaming video editing on consumer GPUs, with the following three core designs: (1) Hybrid Diffusion Transformer architecture introduces softmax attention in part of the blocks to improve local modeling capabilities while preserving the efficiency of linear layers. (2) Cycle-Reverse Regularization is a novel training strategy that enforces semantic consistency by predicting source frames from generated content via flow matching, improving temporal consistency without requiring paired long edited videos. (3) Efficient System Co-design combines fused GDN kernels and Mixed-Precision Quantization (MPQ) optimized for the NVIDIA Blackwell (RTX 5090) architecture. By profiling real-world throughput, our MPQ maximizes Tensor Core utilization while maintaining generation quality. The resulting system achieves real-time 1280 x 704 resolution editing at 24 end-to-end FPS on a single RTX 5090 GPU, with the DiT core running at 58 FPS. Experimental results demonstrate that our co-design approach significantly outperforms existing SOTA methods in both temporal coherence and system throughput.

Hidir Yesiltepe, Koutilya PNVR, Gaurav Pathak, Navaneeth Bodla, Bharat Singh

TL;DR: 本文提出了一种无需训练的扩散细化框架DTG-Restore，用于生成式视频超分辨率。该方法通过时间解耦引导（DTG）技术，在采样过程中将条件分支和无条件分支的信号在时间上分离，利用更早时间步的无条件分支提供前瞻性先验，从而在保持几何结构的同时抑制扭曲内容的复制。该方法可与现成的修复模块即插即用，提升感知一致性和结构合理性。

Details

Motivation: 现有视频扩散模型在生成保真度上取得了显著进展，但标准无分类器引导中条件分支与无条件分支的强耦合限制了其在视频修复任务中的应用。本文旨在解决这一限制，利用扩散先验来增强失真和低分辨率视频。

Result: 在专门构建的GenWarp480基准测试（包含4400个从多种文生视频模型合成的失真480p视频）上进行了广泛实验。结果表明，该方法在无需任何模型训练的情况下，在结构保真度和时间稳定性方面取得了显著提升。

Insight: 核心创新点是提出了时间解耦引导（DTG）机制，通过在更干净的时间步评估无条件分支来提供前瞻性先验，并在采样过程中退火这种时间偏差，实现了从结构校正到细节细化的自然过渡。此外，构建了专注于生成式退化（如扭曲人脸、身体错位和空间伪影）的GenWarp480基准，为评估方法对生成错误的鲁棒性提供了专用测试平台。

Abstract: Recent progress in video diffusion models has enabled remarkable generative fidelity, yet leveraging these priors for restoration remains limited by the strong coupling between conditional and unconditional branches in standard classifier-free guidance. We introduce a training-free framework that enhances distorted and low-resolution videos by decoupling these signals in time. Our proposed Decoupled Time Guidance (DTG) evaluates the unconditional branch at a cleaner diffusion timestep, providing a lookahead prior that preserves geometry while suppressing replication of warped content. This temporal bias is annealed throughout sampling, allowing the model to transition from structure correction to detail refinement without retraining. Combined with any off-the-shelf restoration module in a plug-and-play manner, our approach improves perceptual coherence and restores plausible structure in AIgenerated and real-world videos alike. To facilitate evaluation, we curate GenWarp480, a benchmark of 4,400 distorted 480p videos synthesized from diverse text-to-video models. GenWarp480 focuses on characteristic generative degradations such as warped faces, body misalignments, and spatial artifacts, providing a purpose-built testbed for assessing robustness to generative errors. Extensive experiments demonstrate that our method achieves significant improvements in structural fidelity and temporal stability without any model training.

[53] A Novel Global Context-aware Deep Neural Network for Enhanced Brain Tumor Segmentation using Magnetic Resonance Images cs.CV | cs.AIPDF

Sourjya Mukherjee, Ananya Bhattacharjee, R. Murugan

TL;DR: 本文提出了一种名为全局上下文感知挤压激励残差UNet（GCSER-UNet）的新型深度神经网络，用于从多模态磁共振图像中精确分割脑肿瘤。该方法融合了空间和通道注意力机制，以增强模型捕获复杂空间依赖性和上下文信息的能力。

Details

Motivation: 脑癌的严重性要求精确的肿瘤分割，但手动分割成本高、劳动密集且易出错，因此迫切需要自动化方法。

Result: 在TCGA LGG数据集上，GCSER-UNet取得了94%的Dice分数，超越了91.8%的现有最佳结果。在BraTS 2020数据集上，其集成方法在全肿瘤、肿瘤核心和增强肿瘤区域分别达到了95%、92%和90%的Dice分数，部分指标优于当前最佳水平（94%、93%、88%）。

Insight: 主要创新点在于提出了一个融合空间与通道注意力的全局上下文感知模块，增强了模型对复杂空间关系和上下文信息的建模能力，从而提升了分割精度。从客观角度看，其注意力机制的集成设计是提升性能的关键技术贡献。

Abstract: Brain cancer’s severity necessitates precise brain tumor segmentation, which is crucial for effective brain tumor diagnosis. Manual identification, burdened by high costs, labor, and error risks, highlights the need for automated methods. In this study, we introduce the Global Context-aware Squeeze and Excite Residual UNet (GCSER-UNet), which facilitates a fusion of spatial and channel-wise attention and thus enhances the model’s capacity to capture intricate spatial dependencies and contextual information. GCSER-UNet efficiently extracts tumor segments from multimodal MRI slices, delivering exceptional performance. Evaluations on benchmark databases exhibit its superiority, achieving a notable 94 percent dice score on the TCGA LGG dataset, surpassing the state-of-the-art dice score of 91.8 percent. In the BraTS 2020 dataset, the proposed GCSER-UNet ensemble approach yielded dice scores of 95 percent, 92 percent, and 90 percent for the tumor regions - Whole Tumor (W), Tumor Core (T), and Enhancing Tumor (E), respectively. The current state-of-the-art dice scores were 94 percent, 93 percent, and 88 percent. These compelling outcomes highlight the efficacy of GCSER-UNet in precise brain tumor segmentation and thus can aid neurologists in effective brain cancer management and treatment planning.

[54] OmniMem: Scalable and Adaptive Memory Retrieval for Long Video Generation cs.CVPDF

Lin Zhao, Yushu Wu, Yifan Gong, Yanzhi Wang, Pu Zhao

TL;DR: 本文提出了OmniMem，一种用于长视频生成的可扩展和自适应内存检索框架。它通过稀疏KV检索访问历史缓存，解决了自回归视频生成中KV缓存不断增长带来的计算和内存开销问题。该方法引入了自适应窗口排除和查询共享KV选择等技术，以高效地检索长距离相关信息。

Details

Motivation: 自回归视频生成在生成长视频时需要反复访问不断增长的历史KV缓存，导致计算和内存成本高昂。现有方法通过截断或压缩KV缓存来降低成本，但牺牲了对查询相关历史细节的显式访问能力。本文旨在设计一个能够进行显式全范围内存检索的实用框架。

Result: 在长视频生成实验中，OmniMem将动态度（Dynamic Degree）指标提升了52.3%，并在保持与强基线相当的内存使用量的同时，保持了很强的一致性。

Insight: 创新点在于提出了一个显式的全范围稀疏KV检索框架，并针对基于分块的自回归视频生成，设计了自适应窗口排除来缓解局部偏差，以及查询共享KV选择和每头分散KV访问来避免内存访问中的联合爆炸问题，从而实现了高效的长距离信息检索。

Abstract: Autoregressive (AR) video generation extends videos by producing latent chunks sequentially, but scaling to long videos requires repeated access to a growing historical KV cache. Existing methods reduce this cost by truncating the KV cache or compressing it into implicit memory, but both lose explicit access to query-relevant historical details. We propose OmniMem, an explicit full-range memory retrieval framework that performs sparse KV retrieval over the historical cache. To make this practical for chunk-based AR video generation, OmniMem addresses two issues: (i) local bias in sparse KV selection and (ii) Union Explosion in memory access. Adaptive Window Exclusion removes local-window blocks from the selection candidates when sufficient long-range history is available, preserving the sparse budget for informative long-range retrieval. Query-Shared KV Selection reduces cross-query diversity, while Per-Head Scattered KV Access avoids expanding head-specific selections into a large selected KV buffer. This allows each attention head to retrieve non-contiguous KV blocks according to its own selection pattern. Experiments on long-video generation show that OmniMem improves Dynamic Degree by 52.3% and preserves strong consistency over strong baselines, while maintaining comparable memory usage.

[55] Clustering Guided Domain-Specific Pretrained Foundation Model Very High-Resolution Arctic Remote Sensing cs.CVPDF

Amal S. Perera, Chandi Witharana, Elias Manos, Michael Pimenta, Anna K. Liljedahl

TL;DR: 本研究提出了一种针对北极地区的新型遥感基础模型，通过结合多样性感知的区域尺度图像筛选与掩码自编码器自监督预训练，对Vision Transformer编码器进行预训练，用于超高分辨率卫星图像分析。该模型在四个手工标注的北极数据集上评估，相比ImageNet初始化的基线模型和通用地球观测基础模型Prithvi-EO-2.0，均取得了显著性能提升。

Details

Motivation: 解决北极地区超高分辨率遥感图像分析中，通用基础模型可能因数据分布不匹配而表现不佳的问题，旨在通过领域特定的自监督预训练获得更具可迁移性的表示。

Result: 在基础设施、IWP、RTS和TCNs四个下游任务上，相比ImageNet初始化的ViT-Large基线，平均F1分数分别提升了约0.87、0.72、0.93和0.87，提升幅度约5-8个百分点；在所有下游比较中均优于Prithvi-EO-2.0模型，最小增益对应至少15个百分点的平均F1分数提升。

Insight: 创新点在于将可扩展的亲和传播聚类用于多样性感知的区域尺度图像筛选，以减少视觉重复或低信息区域的过采样，并结合领域适应的MAE目标进行自监督预训练。客观来看，其核心在于证明了在架构和MAE目标固定的情况下，优化区域尺度的预训练数据分布，可以产生一个可重用的、针对特定领域（北极）的编码器。

Abstract: This study introduces a novel Arctic-focused remote sensing foundation model (RSFM) by combining diversity-aware regional-scale image curation with masked autoencoder (MAE) self-supervised pretraining of a Vision Transformer (ViT) encoder for very-high-spatial-resolution (VHSR) satellite image analysis. Spectral and acquisition-metadata descriptors were used in a scalable affinity-propagation clustering workflow to select approximately 3 million chips from 267 TB of Vantor VHSR imagery This curation strategy was designed to reduce oversampling of visually repetitive or low-information areas while preserving broad scene diversity across the study domain. We pretrained a ViT-Large encoder on the curated corpus using a domain-adapted MAE reconstruction objective, producing Arctic-specific transformer weights for downstream feature mapping. The pretrained encoder was integrated into an existing location-aware detection and segmentation framework and evaluated across four hand-labeled Arctic datasets. Compared to ImageNet-initialized ViT-Large baseline, Arctic MAE pretraining produced consistent improvements in foreground mean F1 scores of 0.87, 0.72, 0.93, and 0.87, for infrastructure, IWP, RTS, and TCNs, with approximately 5-8 percentage increase. The proposed model also outperformed Prithvi-EO-2.0 in all downstream comparisons, with the smallest gain corresponding to at least a 15 percentage improvement mean F1, suggesting that domain-specific self-supervised pretraining on curated Arctic VHSR imagery provides more transferable representations for fine-scale Arctic mapping than a general-purpose Earth observation foundation model. These results demonstrate that optimizing the pretraining data distribution at regional scale, while keeping the architecture and MAE objective fixed, can produce a reusable Arctic-domain encoder for multiple VHSR remote sensing applications.

[56] Seeing Isn’t Knowing: Do VLMs Know When Not to Answer Spatial Questions (and Why)? cs.CV | cs.AI | cs.CLPDF

Yue Zhang, Zun Wang, Han Lin, Yonatan Bitton, Idan Szpektor

TL;DR: 本文针对视觉语言模型（VLMs）在现实世界空间推理中的局限性，构建了名为SpatialUncertain的评估框架，重点关注模型在视觉信息不完整（如遮挡）或误导（如视角模糊）时是否能够识别无法回答的情况，以及能否确定需要哪些额外视角来解决问题。研究发现，现有前沿VLMs普遍存在过度自信回答和难以识别有效补充视角两大失败模式。

Details

Motivation: 现有空间推理基准通常假设视觉观察是充分可靠的，只关注模型答案的正确性，而忽略了现实世界中视觉信息固有的局限性（如遮挡和视角模糊）。本文旨在挑战这一假设，评估模型在信息不足或误导时是否知道何时应放弃回答，以及如何寻求可靠证据。

Result: 在SpatialUncertain框架下测试多种前沿开源和闭源VLMs，结果显示：在遮挡条件下平均准确率约为30%，在视角模糊条件下低于10%；即使有额外视角可用，部分模型在识别哪个视角能提供可靠证据方面的表现接近随机水平。

Insight: 论文的创新点在于将评估重点从单纯的答案正确性转向模型对视觉证据可靠性的认知能力（即“知道何时不知道”），并构建了包含遮挡和视角模糊挑战的受控评估框架。这为未来开发更稳健、能主动寻求信息的VLMs提供了重要的评估方向和设计启示。

Abstract: Spatial reasoning is a fundamental capability for vision-language models (VLMs) deployed in real-world environments. However, visual observations are inherently limited representations of a 3D world: occlusion can render objects invisible, and perspective can make geometric properties misleading. Despite this, existing spatial reasoning benchmarks typically assume that observations are sufficient and reliable, focusing on whether models produce correct answers rather than whether they recognize when a question cannot be answered and what additional observations would be needed. In this work, we challenge this assumption by constructing a controlled evaluation framework, SpatialUncertain, and introducing two types of observation challenges: (1) occlusion, which hides target information, and (2) perspective ambiguity, which produces misleading visual cues. For each configuration, we design spatial questions that are answerable under clean observations but require abstention under the introduced challenges. We further evaluate whether models can identify which additional viewpoints would resolve perspective ambiguity. Our results across a diverse set of frontier open- and closed-source VLMs reveal two consistent failure modes. First, models are prone to overconfident answering, attempting to solve spatial reasoning tasks even when visual evidence is incomplete or misleading, with average accuracy around 30% under occlusion and below 10% under perspective ambiguity. Second, even when additional views are available, some models perform near random chance in identifying which would provide reliable evidence. Together, our findings call for moving beyond answer correctness toward evaluating whether models know when to abstain and how to seek reliable evidence.

[57] Prior Availability in Industrial Visual Sim-to-Real: A Review of CAD-Guided and CAD-Unavailable Regimes cs.CV | cs.AI | cs.ROPDF

Chenxi Tao, Seung-Kyum Choi

TL;DR: 这篇综述论文重新定义了工业视觉仿真到真实（sim-to-real）问题，将其视为一个按先验可用性组织的领域差距问题。论文区分了CAD可用、CAD不可用以及边界先验三种情况，并通过T-LESS/BOP、MVTec AD和VisA等基准数据集进行实证分析，强调部署决策应基于具体先验而非单一排行榜。

Details

Motivation: 工业视觉sim-to-real通常被描述为从合成图像到真实图像的迁移，但实际部署中存在更广泛的可用证据与所需决策之间的不匹配，论文旨在通过先验可用性的框架来统一和梳理相关文献。

Result: 论文在T-LESS/BOP、MVTec AD和VisA等基准数据集上进行了实证锚定，结果表明仅靠CAD渲染数量无法有效缩小迁移差距，而源分布设计、检测器容量和小规模真实校准更为关键；同时，测试时CAD通过掩码、姿态和深度一致性提供了独特的验证通道。

Insight: 创新点在于提出了按先验可用性（CAD可用、CAD不可用、边界先验）分类的工业视觉sim-to-real框架，将基于CAD的检测与姿态估计文献和工业异常与表面检测文献联系起来，并强调部署决策应基于具体先验而非追求单一跨任务排行榜。

Abstract: Industrial visual sim-to-real is often described as transferring from synthetic images to real images, but industrial deployment usually involves a broader mismatch between available evidence and required decisions. A system may be built from CAD renderings, simulated RGB-D observations, normal reference images, synthetic defects, pretrained feature spaces, or language prompts, yet deployed under different sensors, lighting, materials, fixtures, calibration, production variation, and rare defect modes. This review reframes industrial visual sim-to-real as a domain-gap problem organized by prior availability. We distinguish CAD-available settings, where explicit object geometry can support rendering, calibration, pose estimation, segmentation, and test-time geometric verification; CAD-unavailable settings, where geometry is replaced by normal-reference appearance, feature distributions, teacher-student residuals, synthetic anomaly assumptions, foundation features, or vision-language priors; and boundary-prior settings, where approximate models, templates, reference views, or semantic correspondences preserve only part of the CAD role. This framing connects CAD-based detection and 6D pose-estimation literature with industrial anomaly and surface-inspection literature that is usually reviewed separately. To make the taxonomy concrete, we use empirical anchors on T-LESS/BOP, MVTec AD, and VisA. The anchors show that CAD render count alone does not close transfer; source-distribution design, detector capacity, and small real calibration can matter more. They also show that CAD at test time creates a distinct verification channel through mask, pose, and depth consistency, whereas CAD-unavailable inspection relies on calibrated normality and feature deviation. The review therefore argues against a single cross-task leaderboard and instead asks what prior grounds the deployment decision.

[58] VLM3: Vision Language Models Are Native 3D Learners cs.CV | cs.AIPDF

Zhipeng Cai, Zhuang Liu, Yunyang Xiong, Zechun Liu, Vikas Chandra

TL;DR: 这篇论文提出VLM3方法，旨在证明视觉语言模型（VLMs）本质上是3D学习者，无需复杂任务特定设计。通过焦距统一、基于文本的像素参考以及数据混合与扩展，VLM3使标准VLMs能够掌握深度估计、像素对应、相机姿态估计和物体级3D理解等多种3D任务，性能匹配专家视觉模型。

Details

Motivation: 当前3D理解主要依赖具有复杂任务特定设计的专家视觉模型，而视觉语言模型在语义理解上表现优异，但尚未有效应用于3D任务；本文旨在论证VLMs本质上是3D学习者，并探索简化3D学习的方法。

Result: VLM3显著提升了VLM深度估计精度（从0.84提高到0.9），并在像素对应、相机姿态估计和物体级3D理解等任务上达到专家视觉模型的准确度，同时保持标准架构和基于文本的训练。

Insight: 创新点在于提出焦距统一、基于文本的像素参考和数据混合与扩展这三个关键要素，证明无需模型架构变更、大型模型、重度数据增强或复杂损失函数即可实现高效3D学习，为简单可扩展的3D学习开辟了新范式。

Abstract: Vision Language Models (VLMs) enable a unified model to solve various vision tasks through prompting. They have shown promising performance in semantic understanding. However, 3D understanding still largely relies on expert vision models with complex task-specific designs. The key argument this work wants to make is that VLMs are native 3D learners. Our in-depth large scale study shows that 1) focal length unification, 2) text-based pixel reference and 3) data mixture and scaling, are all you need for effective 3D learning. Model architecture changes, large models, heavy data augmentations, and complex losses including the regression formulation, many of which form the foundation of expert vision models, are actually not necessary conditions. As a result, we propose VLM3, a scalable method with the simplest design that enables standard VLMs to master diverse 3D tasks. VLM3 not only advances the VLM depth estimation accuracy by a large margin (0.84 -> 0.9), but also enables diverse 3D tasks such as pixel correspondence, camera pose estimation and object-level 3D understanding, matching expert vision model accuracy while maintaining standard architectures and text-based training. We believe VLM3 opens up a new paradigm for simple and scalable 3D learning.

[59] ReGuLaR: Relation-Grounded Latent Reasoning for Large Vision-Language Models cs.CVPDF

Zihu Wang, Karthik Somayaji N. S, Peng Li

TL;DR: 本文提出ReGuLaR框架，通过将潜在推理过程显式地建立在视觉证据中的对象间关系上，以解决现有大型视觉语言模型在连续视觉证据编码方面的不足。该方法在训练时使用ReGFormer关注问题相关的对象和关系，推理时则无需调用该模块。实验表明，ReGuLaR在多个基准测试中均优于现有方法，达到了SOTA性能。

Details

Motivation: 现有基于思维链的推理方法在视觉语言模型中主要依赖离散的文本推理步骤，难以充分编码连续的视觉证据，且现有潜在推理方法未能充分关联视觉证据的组合与关系结构。

Result: 在多个基准测试上进行广泛实验，ReGuLaR一致性地超越了现有方法，并实现了最先进的性能。

Insight: 创新点在于提出了一个关系驱动的潜在推理框架，通过显式地将潜在状态建立在关键视觉证据（对象和关系）上，并构建了包含对象边界框和对象间关系标注的大规模真实世界视觉语言数据集RGROUNDING-351K来支持训练。

Abstract: Chain-of-thought (CoT) reasoning has significantly improved the reasoning ability of large vision-language models (LVLMs) by verbalizing intermediate reasoning steps in natural language. However, such discrete textual rationales are often insufficient for encoding continuous visual evidence. Recent work addresses this limitation by moving reasoning into continuous latent space. Despite promising progress, existing methods leave latent reasoning insufficiently connected to the compositional and relational structure of visual evidence. To address this gap, we introduce ReGuLaR, a relation grounded latent reasoning framework that explicitly grounds latent states in these critical yet overlooked visual evidence. ReGuLaR uses a training-time ReGFormer to focus latent reasoning on question-relevant objects and inter-object relations, while at inference time the model reasons and generates answers without invoking the ReGFormer. To support training ReGuLaR, we construct RGROUNDING-351K, a real-world vision-language dataset annotated with key object bounding boxes and inter-object relations. Extensive experiments across diverse benchmarks show that ReGuLaR consistently outperforms existing approaches and achieves state-of-the-art performance. We include our code in the submission and will release the code and training data publicly upon acceptance.

[60] WristCompass: Kinematic Coupling as a Learnable Visual Concept for Ego-Camera Orientation cs.CV | cs.ROPDF

Varun Nair, Vidyut Baradwaj, Jiahang He, Anya Singh, Jai Relan

TL;DR: 论文提出WristCompass方法，通过从手腕运动学习运动耦合动力学来估计自我中心相机的方向，解决了在操作视频中因手部遮挡导致场景几何方法失效的问题。该方法仅需少量参数，在TACO基准测试中表现优于大型场景重建模型，并能零样本迁移到其他数据集。

Details

Motivation: 动机是解决从自我中心操作视频中恢复相机方向的问题，特别是在手部遮挡场景时，传统基于场景几何的方法（如VGGT）会失败，因此需要寻找替代的视觉概念。

Result: 在TACO基准测试中，WristCompass仅用20万GRU参数，在Epic Kitchens烹饪视频上零样本迁移达到14.3°的中值测地误差，性能接近10亿参数的场景模型。

Insight: 创新点在于利用手腕间的运动耦合动力学作为可学习的视觉概念，该方法具有紧凑性、时间性和物理基础性，能零样本迁移，为自我中心视觉中的相机方向估计提供了新思路。

Abstract: Recovering ego-camera orientation from manipulation video is a prerequisite for disentangling hand motion from camera motion, a key step in imitation learning from egocentric demonstrations. The obvious approach, inferring orientation from scene geometry, fails when hands occlude the frame: VGGT, a 1B-parameter scene reconstruction model, scores worse than a constant predictor on the TACO benchmark. We identify an alternative visual concept that is present precisely when scene geometry is absent: kinematic coupling dynamics, the structured physical relationship between wrist motion and camera orientation imposed by the arm-shoulder-head chain. We find that this concept is compact (4D inter-wrist features outperform 126D full hand keypoints), temporal (requiring a GRU over short windows rather than per-frame retrieval), and physically grounded (transferring zero-shot across datasets because it is rooted in anatomy rather than scene appearance). Trained only on tabletop manipulation, WristCompass transfers zero-shot to Epic Kitchens cooking video, achieving 14.3$^\circ$ median geodesic error and approaching the performance of a 1B-parameter scene model at 200K GRU parameters.

[61] PInVerify: An Offline Embodied Benchmark for Active Instance Verification cs.CV | cs.AI | cs.ROPDF

Yuhang Jiang

TL;DR: 该论文提出了主动实例验证（AIV）任务，并引入了PInVerify离线具身基准测试，用于评估智能体通过主动选择多视角来验证候选对象是否与细粒度语言描述匹配的能力。论文围绕开源多模态大语言模型构建了无需训练的流程和微调的端到端智能体作为基线，并在包含3000个评估片段的数据集上进行了评估。

Details

Motivation: 现有具身智能体在导航到目标物体方面取得了进展，但到达目标附近并不能保证找到正确的实例，因为细微的属性差异（如“白色花卉”与“白色条纹”）通常需要近距离、多视角的检查。论文旨在解决这一差距，即主动实例验证问题。

Result: 在Qwen3-VL、SenseNova-SI-1.2-InternVL3-8B、CLIP和SigLIP2等模型上的评估显示，基于MLLM的最佳基线比基于嵌入的最佳基线高出4.9个百分点；LoRA微调的智能体（SFT+GSPO）达到了85.6%的准确率；在测试的NBV策略中，主动视角选择并未带来可靠的性能提升。

Insight: 论文的创新点在于形式化了AIV任务并创建了PInVerify基准，其特点包括多视图捕获、6扇区导航拓扑（暴露陷阱视图和不可达扇区）以及用于评估的基线方法（如属性分解、可见性加权多视图跟踪器）。这为具身AI中主动、细粒度语义验证的进一步研究提供了支持。

Abstract: Embodied agents have made strong progress in navigating to target objects, but reaching the goal vicinity does not guarantee that the agent has found the correct instance: subtle attribute differences (e.g., “white floral” vs. “white striped”) often require close-range, multi-view inspection. We address this gap with Active Instance Verification (AIV), a task in which an agent actively selects viewpoints around a candidate object to decide whether it matches a fine-grained natural-language description. We formalize AIV as a finite-horizon decision process and introduce PInVerify, an offline embodied benchmark for AIV: 3,000 evaluation episodes across 18 object categories, delivered as multi-view captures with a 6-sector navigation topology that exposes trap views (navigable but uninformative) and unreachable sectors. As reference baselines we build a training-free pipeline and a LoRA-fine-tuned end-to-end agent around open-source multimodal large language models (MLLMs) at on-device scale ($\leq$8B parameters), with attribute decomposition, a visibility-weighted multi-view tracker, and three next-best-view (NBV) strategies. In our evaluation across Qwen3-VL (4B/8B), SenseNova-SI-1.2-InternVL3-8B, CLIP, and SigLIP2, the best MLLM-based baseline exceeds the best embedding baseline by 4.9 pp; GT-box ablations show a +3.1 pp detection gap; and we do not observe reliable gains from active viewpoint selection within the tested NBV strategies. A LoRA-fine-tuned agent (SFT+GSPO) reaches 85.6%. PInVerify aims to support further work on active, fine-grained semantic verification in embodied AI. Code: https://github.com/Avalon-S/PInVerify.

[62] ConTrans: Learning Text-enhanced Local-global Temporal Representations for Zero-shot Temporal Action Localization cs.CV | cs.AIPDF

Kanchan Keisham, Thenukan Pathmanathan, Thangarajah Akilan

TL;DR: 本文提出ConTrans模型，用于零样本时序动作定位（ZS-TAL），通过结合卷积归纳偏置与Transformer自注意力机制，构建局部-全局多尺度特征表示模块，以同时捕获细粒度局部依赖和长程全局上下文，从而提升对未见过动作的检测与定位能力。

Details

Motivation: 现有ZS-TAL方法主要关注长程上下文建模，忽略了基于相对偏移的帧间局部相关性，且网络架构较浅导致特征表示能力有限。

Result: 在ActivityNet-1.3和THUMOS14数据集上的实验表明，ConTrans显著优于现有方法，为ZS-TAL设立了新的性能基准。

Insight: 创新点在于设计了一个融合卷积与Transformer的多尺度编码器架构，能够联合学习局部细节与全局上下文，形成更全面的视频特征表示，这为解决零样本动作定位中的特征表示不足问题提供了新思路。

Abstract: Zero-shot Temporal Action Localization (ZS-TAL) aims to detect and locate previously unseen actions in untrimmed videos. However, existing approaches primarily focus on modeling long-range contextual information, often neglecting the critical relative-offset-based local correlations between video frames. Furthermore, their performance is hindered by limited feature representation capabilities due to the shallow nature of their network architectures. In this paper, we address these limitations by introducing a novel local-global multi-scale feature representation module. We propose a novel multi-scale encoder architecture, termed ConTrans, that integrates convolutional (Conv) inductive biases with transformer Self-attention to jointly capture fine-grained local dependencies and long-range global context, leading to more comprehensive feature representations than existing methods. Experimental evaluations on the ActivityNet-1.3 and THUMOS14 datasets demonstrate that ConTrans significantly outperforms existing methods, establishing a new benchmark for ZS-TAL.

[63] Seeing Before Agreeing: Aligning Multi-Agent Consensus with Visual Evidence cs.CV | cs.AI | cs.MAPDF

Yuhan Wang, Shuochen Chang, Yalin Feng, Dongsheng Ma, Yuanzi Li

TL;DR: 本文提出了一种名为EAGLE的训练免费、以证据为中心的多智能体视觉问答框架，旨在通过对齐视觉证据来提升多智能体共识的可靠性。该框架通过显式暴露每个智能体所依赖的图像区域作为视觉证据，进行证据间的相互验证，并利用证据一致性来指导最终决策。

Details

Motivation: 现有基于多智能体协作的视觉问答方法主要沿用文本中心的协议，侧重于文本讨论而忽略了视觉信息的对齐，导致仅答案层面的共识不足以保证可靠性。本文的出发点是揭示并解决这一关键问题，即对齐的视觉证据对于达成可信的多智能体共识至关重要。

Result: 在六个视觉问答基准测试上的实验表明，EAGLE框架在多个领域取得了最佳的平均性能，同时保持了轻量级、可解释性强且易于部署的实用特性。

Insight: 论文宣称的核心创新点是强调了视觉证据对齐在多智能体视觉问答中的必要性，并提出了一个无需训练、以证据为中心的协调框架。从客观角度看，其创新之处在于将多智能体协作的关注点从纯文本讨论扩展到了对底层视觉依据的显式共享与验证，从而提升了决策过程的可靠性和可解释性。

Abstract: Vision-language models (VLMs) have achieved strong performance on visual question answering (VQA). To mitigate individual hallucinations and blind spots, aggregating diverse perspectives via multi-agent collaboration has emerged as a promising paradigm. While this approach has shown great success in textual QA, its potential in the multimodal domain remains under-explored. Existing multi-agent VQA methods predominantly adapt text-centric protocols, focusing on textual discussions while ignoring the alignment of visual information. In this work, we reveal a key insight: answer-level agreement is insufficient for reliable multi-agent VQA; \textit{aligned visual evidence} – shared support from the image regions agents rely on – is essential for trustworthy consensus. To leverage this insight, we propose EAGLE (\textbf{E}vidence-\textbf{A}ligned \textbf{G}rounded mu\textbf{L}ti-agent r\textbf{E}asoning), a training-free evidence-centered framework for coordinating multiple VLM agents. EAGLE explicitly exposes each agent’s grounding regions as visual evidence, enables mutual verification over the evidence, and uses evidence consistency to guide final decision-making. Experiments on six VQA benchmarks show that EAGLE achieves best average performance across domains while remaining lightweight, interpretable, and practical for deployment.

[64] Vision-Based Localization in Dense Urban Environments: A Case Study of an Urban Village in China cs.CVPDF

Menglin Wu, Rui Cao

TL;DR: 本文针对中国城中村等密集城市环境中GPS信号不可靠、地图数据不完整导致的定位与导航难题，提出了一种实用的视觉地理定位解决方案。通过双摄像头系统（全景相机与智能手机相机）采集同步的360度全景与查询图像，构建了广州石牌村的专用图像地理定位数据集，并评估了现有模型在不同场景类型下的性能。

Details

Motivation: 解决城中村等密集城市环境中因建筑密集导致GPS信号不可靠、地图数据不完整，从而影响日常出行、路线规划、紧急疏散和应急响应的实际问题。

Result: 在构建的广州石牌村专用数据集上评估了现有视觉地理定位模型，揭示了它们在密集城中村环境中的潜力与局限性，但未明确报告具体的定量指标（如准确率）或与SOTA模型的直接比较结果。

Insight: 创新点在于为GPS信号薄弱的密集非正规住区设计了一套低成本的双摄像头数据采集流程，并构建了针对性的地理定位数据集，为提升行人导航、末端配送和应急管理提供了实用的视觉解决方案框架。

Abstract: Urban villages, the widespread informal settlements which have emerged as a result of rapid urbanization, are now major residential hubs for migrant workers in large cities in China. The dense arrangement of buildings in these areas often leads to unreliable GPS signals, while incomplete mapping data further impairs accurate route planning and navigation. These issues not only hinder everyday mobility but also pose significant challenges for emergency response, as confusing road layouts and GPS inaccuracies can complicate evacuation efforts. To address these challenges, we propose a practical vision-based geo-localization solution tailored for dense urban environments. Our approach features a low-cost data collection pipeline utilizing a dual-camera system, comprising a panoramic camera and a smartphone camera, to capture synchronized 360-degree panoramas and query images. Using Shipai Village, a well-known densely populated urban village in Guangzhou, as a case study, we develop a specialized image geo-localization dataset. We then assess and compare the performance of existing models across various scene types to identify their strengths and weaknesses. The findings demonstrate both the potential and limitations of visual-based localization in dense urban-village environments. Our framework aims to enhance pedestrian navigation, last-mile delivery, and emergency management in areas with poor GPS coverage, ultimately supporting the vulnerable populations living within these informal settlements.

Xiang Fang, Daizong Liu, Wanlong Fang, Pan Zhou, Yu Cheng

TL;DR: 本文提出了一种跨模态知识迁移网络，用于解决无监督时序语句定位任务。该方法通过从图像-名词和视频-动词等有标签的跨模态任务中迁移外观和动作知识，无需依赖视频-查询对的标注即可进行定位。在ActivityNet Captions和Charades-STA数据集上的实验表明，该方法超越了现有无监督方法，甚至可与有监督方法竞争。

Details

Motivation: 解决时序语句定位任务严重依赖大量昂贵视频-查询对标注的问题，目标是实现更实用且更具挑战性的无监督设置，即训练时无需任何配对标注或片段边界标注。

Result: 在ActivityNet Captions和Charades-STA两个挑战性数据集上进行了广泛实验，结果表明该方法优于现有无监督方法，并且竞争性地超越了部分有监督工作。

Insight: 创新点在于从其他有标签的跨模态任务（如图像-名词、视频-动词）中迁移实体感知的外观知识和事件感知的动作表示，并通过一种新颖的复制-粘贴方法将动作表示细化以适应复杂真实场景，从而在无监督设置下实现有效的视频-查询关联和片段检索。

Abstract: This paper addresses the task of temporal sentence grounding (TSG). Although many respectable works have made decent achievements in this important topic, they severely rely on massive expensive video-query paired annotations, which require a tremendous amount of human effort to collect in real-world applications. To this end, in this paper, we target a more practical but challenging TSG setting: unsupervised temporal sentence grounding, where both paired video-query and segment boundary annotations are unavailable during the network training. Considering that some other cross-modal tasks provide many easily available yet cheap labels, we tend to collect and transfer their simple cross-modal alignment knowledge into our complex scenarios: 1) We first explore the entity-aware object-guided appearance knowledge from the paired Image-Noun task, and adapt them into each independent video frame; 2) Then, we extract the event-aware action representation from the paired Video-Verb task, and further refine the action representation into more practical but complicated real-world cases by a newly proposed copy-paste approach; 3) By modulating and transferring both appearance and action knowledge into our challenging unsupervised task, our model can directly utilize this general knowledge to correlate videos and queries, and accurately retrieve the relevant segment without training. Extensive experiments on two challenging datasets (ActivityNet Captions and Charades-STA) show our effectiveness, outperforming existing unsupervised methods and even competitively beating supervised works.

[66] Simple Token-Efficient Vision-Language Model for Case-level Pathology Synoptic Report Generation cs.CV | cs.AIPDF

Zhiyuan Yang, Jiahao Cheng, Vincent Quoc-Huy Trinh, Mahdi S. Hosseini

TL;DR: 本文提出了一种简单且token高效的视觉-语言模型，用于从全切片图像生成病例级别的病理学结构化报告。该方法采用三组件设计：冻结的病理学图像块编码器、轻量级视觉-语言对齐器和大型语言模型解码器，并引入显式的WSI标记符来区分病例中的不同切片。通过两阶段监督训练（WSI描述生成和病例级微调）及使用低分辨率图像块大幅减少序列长度，模型在仅需半块NVIDIA H100 GPU的条件下实现了高效训练。

Details

Motivation: 解决从高分辨率全切片图像生成临床有用病理报告的挑战，包括千兆像素分辨率、长视觉token序列以及病例级别推理的复杂性（单个病例可能包含多个具有异质组织和模糊发现的WSI），同时确保在受限GPU内存下的实用性。

Result: 模型在两个训练阶段均取得了高ROUGE-L、METEOR和BLEU-4分数；在基于AI的评估中，模型持续优于强基线；通过广泛的消融实验分析了性能与效率的权衡，并提升了多WSI设置下的鲁棒性。

Insight: 创新点包括：采用极简三组件架构与显式WSI标记符处理多切片病例；使用低放大倍数（5×）的图像块表征将平均序列长度减少高达64倍，显著提升效率；两阶段训练策略结合高效训练技术，在极低计算资源下实现强性能，为有限算力下的多WSI视觉-语言模型研究降低了门槛。

Abstract: Generating clinically useful pathology reports for pathology cases from whole-slide images (WSIs) is challenging due to gigapixel resolution, long visual-token sequences, and the complexity of case-level reasoning, where a single case may contain multiple WSIs with heterogeneous tissues and ambiguous findings. We present a simple token-efficient vision–language model for case-level synoptic report generation that remains practical under constrained GPU memory. Our architecture follows a minimal three-component design: a frozen pathology patch encoder, a lightweight two-layer MLP vision-language aligner, and a large language model decoder, with an explicit WSI marker token to separate slides within a case. Training proceeds in two supervised stages: (1) aligner-only WSI captioning using heterogeneous WSI-text pairs, and (2) case-level supervised fine-tuning on case-report pairs for structured report generation. To reduce sequence length, we represent each slide using $512 \times 512$ patches at $5\times$ magnification, which reduces the average sequence length by up to $64\times$ times compared to the commonly used $20\times$ patches. Combined with efficient training techniques, we enable practical training with only half a NVIDIA H100 GPU. Across both training stages, our approach achieves high ROUGE-L/METEOR/BLEU-4 scores while being substantially more efficient in memory and runtime. In AI-based evaluations, our model is consistently preferred over strong baselines. Extensive ablations characterize performance-efficiency trade-offs and identify simple choices that improve robustness in multi-WSI settings. Overall, this work provides a strong, reproducible baseline for efficient pathology report generation, lowering the barrier to multi-WSI VLM research under limited compute.

[67] Immuno-VLM: Immunizing Large Vision-Language Models via Generative Semantic Antibodies for Open-World Trustworthiness cs.CVPDF

Xiang Fang, Wanlong Fang, Wei Ji

TL;DR: 该论文提出了Immuno-VLM框架，旨在解决大型视觉-语言模型在开放世界部署中因语义抽象而导致的‘语义傲慢’问题，即模型会以高置信度将未知异常强行归类到已知类别。该框架受生物免疫负选择原理启发，利用大语言模型的生成推理能力主动产生‘语义抗体’，以界定已知类别的决策空间，从而提升模型的开放世界可信度。

Details

Motivation: 动机是解决大型视觉-语言模型在开放世界部署中存在的‘开放世界可信度悖论’，即模型因缺乏明确的负知识（不知道什么不是已知类别）而容易对未知异常产生过度自信的错误分类。

Result: 在ImageNet-1K和四个具有挑战性的OOD基准测试上的广泛实验表明，Immuno-VLM建立了新的最先进水平。

Insight: 宣称的创新点在于将生物免疫学中的‘免疫负选择’原理引入高维潜在空间，并利用大语言模型的生成能力主动构建描述近分布异常（如相似物、上下文异常）的‘语义抗体’文本，以主动界定决策边界，这区别于依赖被动密度估计或低效像素空间离群点生成的传统开放集识别方法。从客观角度看，将生成式AI用于主动构建负语义知识以增强模型鲁棒性是一个有前景的研究方向。

Abstract: Large Vision-Language Models have achieved unprecedented success in zero-shot recognition by aligning visual features with broad semantic concepts. However, this semantic abstraction creates a critical vulnerability in open-world deployment: the Hubris of Semantics'', where models force-fit unknown anomalies into known categories with high confidence due to the lack of explicit negative knowledge. To address this \textit{Open-World Trustworthiness Paradox}, we propose \textbf{Immuno-VLM}, a bio-inspired framework that adapts the biological principle of \textbf{Immunological Negative Selection} to high-dimensional latent spaces. Departing from traditional Open-Set Recognition methods that rely on passive density estimation or inefficient pixel-space outlier generation, Immuno-VLM leverages the generative reasoning of Large Language Models to actively hallucinate Semantic Antibodies’’, textual descriptions of near-distribution outliers (e.g., look-alikes, contextual anomalies) that effectively bound the decision space of known classes.Extensive experiments on ImageNet-1K and four challenging OOD benchmarks reveal that Immuno-VLM establishes a new state-of-the-art.

[68] CameraNoise: Enabling Faithful Camera Control in Video Diffusion through Geometry-Flow-Guided Noise Warping cs.CVPDF

Haoyu Zhao, Jiaxi Gu, Haoran Chen, Qingping Zheng, Yeying Jin

TL;DR: 本文提出CameraNoise方法，通过几何流引导的噪声扭曲技术，将相机运动编码为时间上一致的随机表示，从而在视频扩散模型中实现精确且几何一致的相机姿态控制。该方法将相机姿态直接嵌入噪声空间，解耦了运动与场景外观，并保持了扩散过程的高斯先验。实验表明，该方法在视觉质量和轨迹保真度上显著优于现有方法。

Details

Motivation: 现有方法直接将数值相机参数注入扩散模型主干，难以弥合抽象坐标与视觉内容之间的差距，导致结构失真。因此，需要一种能保持几何一致性的精确相机控制方法。

Result: 大量实验表明，该方法在视觉质量和轨迹保真度上显著优于现有方法，实现了稳定、高保真的视频生成。

Insight: 核心创新在于提出了一种流到噪声的扭曲方法，通过新颖的几何引导重投影流和噪声扭曲算法，将相机运动直接编码到扩散噪声空间，从而在解耦运动与外观的同时，忠实保持轨迹动力学和扩散的高斯先验。

Abstract: Precise camera pose control is critical for video diffusion, yet maintaining geometric consistency remains a challenge. Existing methods that directly inject numerical camera parameters into the diffusion backbone often fail to bridge the gap between abstract coordinates and visual content, leading to structural distortions. To address this issue, we propose CameraNoise, a flow-to-noise warping method that encodes camera motion into a temporally coherent stochastic representation. Unlike conventional conditioning, CameraNoise embeds camera poses directly into the noise space. This decouples motion from scene appearance while faithfully preserving trajectory dynamics. Specifically, we introduce a novel Geometry-guided Reprojection Flow and a noise warping algorithm, which jointly preserve the Gaussian prior of diffusion and ensure consistent noise propagation under camera transformations. By integrating CameraNoise into the diffusion process, our framework delivers stable, high-fidelity videos. Extensive experiments demonstrate that our approach significantly outperforms prior methods in both visual quality and trajectory faithfulness. The project page and code are available at: https://gulucaptain.github.io/CameraNoise/.

[69] SLAP: The Semantic Least Action Principle for Variational Video-Language Modeling cs.CVPDF

Xiang Fang, Wanlong Fang

TL;DR: 本文提出了一种名为语义最小作用量原理（SLAP）的新范式，用于解决大型视频语言模型中因稀疏帧采样导致的‘时间间隙’问题。该方法将视频插值任务建模为黎曼流形上的边界值问题，通过离散欧拉-拉格朗日方程求解，旨在保持长时程语义一致性，避免物体消失和能量不稳定。

Details

Motivation: 现有基于生成幻觉或自回归外推的方法在长时程视频插值中难以保持语义一致性，存在物体消失和能量不稳定问题。SLAP旨在通过变分力学原理，从根本上解决稀疏帧采样造成的‘时间间隙’挑战。

Result: 广泛的实验证明了SLAP的有效性，但摘要中未提及具体的基准测试、定量结果或与SOTA的比较。

Insight: 核心创新在于将经典力学与语义动力学建立严格同构，将视频轨迹建模为由语义拉格朗日量控制的黎曼流形上的路径，从而将插值任务转化为边界值问题求解，无需像素级渲染即可强制保持物体持久性。

Abstract: In the era of Large Video-Language Models (LVLMs), the computational necessity of sparse frame sampling creates a fundamental ``temporal gap’’, rendering models blind to critical causal transitions. Existing solutions relying on generative hallucination (e.g., latent diffusion) or autoregressive extrapolation often fail to maintain semantic consistency over long horizons, suffering from object vanishing and energetic instability. We propose a paradigm shift from probabilistic generation to variational mechanics with the \textbf{Semantic Least Action Principle (SLAP)}. Drawing a rigorous isomorphism between classical mechanics and semantic dynamics, we model the latent video trajectory as a path on a Riemannian manifold governed by a Semantic Lagrangian. By formulating the interpolation task as a Boundary Value Problem (BVP) solved via the discrete Euler-Lagrange equations, SLAP naturally enforces object persistence without pixel-level rendering. Extensive experiments show the effectiveness of our proposed SLAP.

Zhiyang Lu, Ming Cheng

TL;DR: 本文提出了一种名为TCFDNet的文本引导跨模态特征解缠网络，用于解决LiDAR与RGB相机之间的跨模态步态识别问题。该方法利用大语言模型构建步态模态文本字典生成语义描述，通过CLIP编码器对齐视觉与文本特征，并设计特征解缠与稳定性增强模块来学习鲁棒的模态共享表示。在SUSTech1K和FreeGait数据集上的实验表明，该方法达到了新的SOTA性能。

Details

Motivation: 现实场景中步态识别常涉及LiDAR与RGB相机等异质传感模态，由于2D视频与3D点云序列之间存在显著的模态差异，跨模态步态识别极具挑战性。

Result: 在SUSTech1K和FreeGait数据集上的大量实验表明，TCFDNet取得了新的最先进（SOTA）结果，并验证了所提出模块的有效性。

Insight: 创新点包括利用大语言模型生成模态感知的文本先验作为语义锚点来引导特征解缠，以及通过残差分解与正交约束分离模态特定与共享特征，并结合特征稳定性增强模块提升鲁棒性。

Abstract: Gait recognition is a biometric technique that identifies individuals based on their walking patterns, offering advantages in long-range, non-intrusive scenarios. However, real-world scenarios often involve heterogeneous sensing modalities such as LiDAR and RGB cameras, making LiDAR-Camera Cross-modal Gait recognition (LCCGR) a critical yet challenging task due to the substantial modality gap between 2D videos and 3D point cloud sequences. To address this challenge, we propose TCFDNet, a Text-guided Cross-modal Feature Disentanglement Network, which leverages modality-aware textual priors as semantic anchors to guide the learning of disentangled modality-shared representations. Specifically, we construct a Gait Modality Text Dictionary (GMTD) using large language models to generate rich semantic descriptions of gait across modalities and viewpoints. A CLIP-based Multi-grained Feature Encoder then aligns visual and textual features within a unified vision-language space. Furthermore, the Text-guided Feature Disentanglement (TFD) module selects the topk matched textual descriptions to reconstruct modality-specific representations and derive modality-shared features via residual decomposition and orthogonality constraints. To mitigate the fragility of the disentangled shared features, we propose a Feature Stability Enhancement (FSE) module, which models spatial and channel-wise correlations to improve feature robustness. In addition, a cross-modal patch exchange strategy is introduced to further improve generalization. Extensive experiments on SUSTech1K and FreeGait datasets demonstrate that TCFDNet achieves new state-of-the-art results and validate the effectiveness of the proposed modules.

[71] Function2Scene: 3D Indoor Scene Layout from Functional Specifications cs.CVPDF

Ruiqi Wang, Qimin Chen, Daniel Ritchie, Angel X. Chang, Manolis Savva

TL;DR: Function2Scene是一个从功能规格生成3D室内场景布局的框架，它通过解析自然语言设计简报中描述的居住者角色和活动，生成定制化的功能设计约束，并利用这些约束指导布局生成。

Details

Motivation: 现有文本驱动的3D室内场景合成方法主要关注放置什么家具，而忽略了空间如何支持居住者的活动和物理需求，该论文旨在解决如何从功能规格（即描述房间使用者和需求的自然语言简报）生成更符合实际室内设计需求的布局。

Result: 在30个专业室内设计案例上的实验表明，Function2Scene生成的布局比基于LLM的场景合成基线方法更好地满足功能需求，在成对比较中获得了94.3%的偏好率。

Insight: 创新点在于将场景生成从对象放置重构为支持人类使用的空间设计，通过结合几何测量、基于LLM的上下文推理和基于VLM的视觉评估，实现迭代评估和精炼的检查-修复循环，而非直接依赖LLM生成最终场景。

Abstract: Most text-driven 3D indoor scene synthesis methods generate rooms from object-centric prompts, asking what furniture should be placed rather than how the space is used. Yet in real interior design, a layout is judged by how well it supports its occupants, e.g., their activities and physical needs. We introduce Function2Scene, a framework for generating 3D indoor layouts from functional specifications, i.e., natural-language design briefs describing who will use a room and what they need to do there. Given such a specification, our system parses occupant personas and activities, derives a customized set of functional design constraints from a taxonomy of 17 criteria spanning spatial, ergonomic, activity, and environmental considerations, and uses these constraints to guide layout generation. Rather than relying on an LLM to directly produce a final scene, Function2Scene performs iterative evaluation and refinement through a tool-augmented check-and-repair loop, combining geometric measurements, LLM-based contextual reasoning, and VLM-based visual assessment. Experiments on 30 professionally written interior-design cases show that Function2Scene produces layouts that better satisfy functional requirements than recent LLM-based scene synthesis baselines, with our results preferred in 94.3% of pairwise comparisons. Our work reframes text-driven indoor scene synthesis from placing plausible objects to designing spaces that support human use.

[72] MechVQA: Benchmarking and Enhancing Multimodal LLMs on Comprehensive Mechanical Drawing Understanding cs.CV | cs.AIPDF

Qian Kou, Xiaofeng Shi, Yulin Li, Xiaosong Qiu, Xinyang Wang

TL;DR: 本文提出了首个全面的机械图纸理解数据集MechVQA，包含3.3k张高密度图片和21K个问答对，涵盖识别、推理和判断三个能力层次的10个细粒度任务。基于此，作者开发了MechVL模型，通过多阶段训练范式构建了强大的领域专用基线，显著提升了多模态大语言模型对机械图纸的理解能力。

Details

Motivation: 多模态大语言模型在通用视觉问答任务上表现优异，但在机械工程图纸理解上仍很脆弱，因为图纸标注密集、领域知识薄弱，且在严格投影规则和几何约束下空间关系推理不可靠，容易遗漏关键线索导致错误答案。

Result: 在MechVQA数据集上，MechVL模型在总分上比最强的闭源基线高出7.57个百分点，显著提升了机械图纸理解能力，为在机械设计和检测场景中部署MLLMs提供了可复用的基础。

Insight: 创新点包括构建首个全面的机械图纸理解数据集MechVQA，以及通过多阶段训练范式开发领域专用模型MechVL。从客观角度看，该研究填补了MLLMs在专业工程图纸理解领域的评估空白，并提供了系统的任务分类和高质量的基准，对推动MLLMs在垂直领域的应用具有借鉴意义。

Abstract: Multimodal Large Language Models (MLLMs) have demonstrated significant achievements in general visual question answering (VQA) tasks. However, they remain brittle on mechanical engineering drawings, where high annotation density and weak domain knowledge, compounded by unreliable spatial relation reasoning under strict projection rules and geometric constraints, make decisive cues easy to miss and frequently lead to wrong answers. To bridge this gap, we introduce the first comprehensive mechanical drawing understanding dataset, MechVQA, created through a semi-automated construction and quality-control pipeline. MechVQA contains 3.3k high-density pictures with 21K question-answer pairs, spanning 10 different fine-grained tasks across three capability levels: Recognition, Reasoning, and Judging, providing a testbed to evaluate and improve MLLM understanding on real-world mechanical drawings. On top of MechVQA, we then develop the MechVL model through a multi-stage training paradigm, building a strong domain-specialized baseline. Extensive experimental results demonstrate that MechVL outperforms the strongest closed-source baseline by 7.57 percentage points on the MechVQA total score, significantly enhancing mechanical drawing understanding ability and providing a reusable foundation for deploying MLLMs in mechanical design and inspection scenarios.

[73] LegSegNet: A Public Deep Learning System for Lower Extremity CT Tissue Segmentation and Quantification cs.CVPDF

Yuwen Chen, Yaqian Chen, Roy Colglazier, Haoyu Dong, Hanxue Gu

TL;DR: 本文提出了LegSegNet，一个用于下肢CT组织分割和身体成分量化的深度学习系统。该系统能够自动分割骨骼、骨骼肌、皮下脂肪组织以及肌肉间/肌肉内脂肪组织，并提供定量测量结果。

Details

Motivation: 现有公共分割工具无法全面分析下肢CT，特别是对临床重要的肌肉间/肌肉内脂肪组织，且大多仅提供掩码预测而非端到端量化系统。

Result: 在包含900个切片的测试集上，LegSegNet的平均Dice分数达到89.31，优于一系列2D分割方法（包括CNN、Transformer和微调的基础模型），并在外部公共CT数据集上展现了良好的泛化能力。

Insight: 该研究首次提供了一个公开可用的端到端下肢CT组织分割与量化系统，为医学图像分析中的计算机视觉研究提供了实用评估工具，并专注于临床相关组织的全面分割。

Abstract: Lower extremity computed tomography (CT) contains clinically relevant information for body composition analysis, sarcopenia assessment, and musculoskeletal disease monitoring, but extracting these measurements at scale requires accurate tissue segmentation and an automated quantification workflow. Existing public segmentation tools are not designed for comprehensive lower extremity CT analysis, particularly for clinically important inter/intramuscular adipose tissue, and most public methods only provide mask prediction rather than an end-to-end quantification system. To address this problem, we present LegSegNet, a deep learning system for lower extremity CT tissue segmentation and body composition quantification. Given an input CT scan, LegSegNet segments bone, skeletal muscle, subcutaneous adipose tissue, and inter/intramuscular adipose tissue. It then computes quantitative tissue measurements for downstream analysis. We developed the segmentation model using 1,302 manually annotated CT slices and evaluated it on 900 held-out test slices, with all annotations reviewed by radiologists. We benchmark LegSegNet against a broad set of 2D segmentation methods, including CNN-based models, transformer-based models, and finetuned foundation models, and further evaluate its generalization on an external public CT dataset. LegSegNet achieves the best overall segmentation performance, with an average Dice score of 89.31 on the held-out test set. To our knowledge, LegSegNet is the first publicly available end-to-end system for lower extremity CT tissue segmentation and quantification, providing a practical evaluation tool for future computer vision research in medical image analysis. The code and model weights are available at: https://github.com/mazurowski-lab/LegSegNet

[74] Count Anything cs.CVPDF

Mengqi Lei, Shuokun Cheng, Wei Bao, Shaoyi Du, Jun-Hai Yong

TL;DR: 本文提出了一个名为Count Anything的通用文本引导物体计数模型，旨在解决现有计数模型因领域特定而泛化能力差的问题。该模型采用双粒度实例枚举机制，结合区域级稀疏计数器和像素级密集计数器，并利用新构建的大规模跨领域物体计数数据集CLOC进行训练与评估。

Details

Motivation: 现有物体计数模型通常针对特定领域（如人群、车辆、细胞等）设计，难以泛化到不同类别、视觉领域、物体尺度和密度分布。本文旨在研究跨领域的文本引导物体计数，以统一的模型和任务表述来克服这种碎片化问题。

Result: 在涵盖六个视觉领域（通用场景、遥感、组织病理学、细胞显微镜、农业和微生物学）的大规模跨领域数据集CLOC上，Count Anything模型展现出强大的准确性和多领域泛化能力，超越了现有的开放世界计数方法。

Insight: 创新点包括：提出文本引导的跨领域物体计数统一任务表述；构建大规模跨领域数据集CLOC；设计双粒度实例枚举模型（区域级稀疏计数器和像素级密集计数器）以及参数无关的互补计数融合策略；采用以点为中心的监督策略以利用异构标注数据。

Abstract: Object counting remains fragmented across domain-specific datasets and task formulations, despite rapid progress in generalist vision models. Existing counting models are often tailored to scenarios such as crowds, vehicles, cells, crops, or remote-sensing objects, and thus struggle to generalize across categories, visual domains, object scales, and density distributions. In this paper, we study text-guided object counting across domains, where a model takes an image and a natural-language query as input and returns an instance-grounded set of target points whose cardinality gives the count. This formulation unifies category-conditioned counting with interpretable spatial localization. To support this setting, we construct CLOC, a Cross-domain Large-scale Object Counting dataset that reorganizes diverse public data sources into a unified benchmark. CLOC covers six visual domains: General Scene, Remote Sensing, Histopathology, Cellular Microscopy, Agriculture, and Microbiology, with about 220K images, 619 categories, and 15M object instances. Based on CLOC, we propose Count Anything, a generalist model for text-guided object counting. Unlike density-map-based methods, which dominate counting models, Count Anything adopts discrete instance points and performs dual-granularity instance enumeration. A Region-level Sparse Counter provides object-level anchors for large and sparse targets, while a Pixel-level Dense Counter handles small, crowded, and weakly bounded targets via dense point prediction. A point-centric supervision strategy enables learning from heterogeneous annotations, and Complementary Count Fusion combines both counters in a parameter-free manner. Extensive experiments show that Count Anything achieves strong accuracy and multi-domain generalization, outperforming existing open-world counting methods. Code is available at: https://github.com/Mengqi-Lei/count-anything.

[75] Robust Dreamer: Deviation-Aware Latent Gaussian Memory for Action-Controlled AR Video Generation cs.CVPDF

Hanlin Chen, Jiaxin Wei, Xibin Song, Yifu Wang, Steve Wang

TL;DR: 本文提出了Robust Dreamer框架，用于解决动作控制的图像到视频生成中视觉保真度和3D一致性的长期挑战。通过引入Latent Gaussian Memory避免重复VAE转换导致的信息损失，并采用Deviation Learning with Dynamic Deviation Archive来模拟推理过程中的误差，从而在长序列生成中实现更鲁棒的3D一致性和视觉质量。

Details

Motivation: 解决动作控制的自回归视频生成中，由于Latent-RGB Cycling导致的信息损失和训练-推理差距（error-free hypothesis）引起的灾难性漂移问题，以保持长期生成的视觉保真度和3D一致性。

Result: 在ScanNet、DL3DV和OmniWorldGame等基准测试中，该方法实现了最先进的长序列生成性能，显著提升了视觉质量和3D一致性。

Insight: 创新点包括Latent Gaussian Memory通过高斯图元锚定和潜在空间高斯泼溅来提供几何感知的稠密条件，避免VAE转换的累积退化；以及Deviation Learning通过动态偏差存档模拟推理误差，在训练中注入真实损坏的记忆状态，使生成器具备内部校正能力。

Abstract: Frame-wise action-controlled image-to-video generation is a promising paradigm for interactive world simulation, where each control signal should elicit an immediate visual response. However, maintaining visual fidelity and 3D consistency over long autoregressive rollouts remains challenging. Existing 3D-aware methods often suffer from catastrophic drift due to two impediments: information loss from \textit{Latent–RGB Cycling}, where generated latents are repeatedly decoded to RGB and re-encoded for future conditioning, and the training–inference gap induced by the \textit{error-free hypothesis}, where clean training memory fails to match prediction-corrupted inference memory. To address these challenges, we present \textbf{Robust Dreamer}, a memory-augmented framework built around how to design 3D memory and how to use it robustly. First, we introduce \textbf{Latent Gaussian Memory}, which anchors diffusion latents inherited from the generation process to Gaussian primitives and recalls them via latent-space Gaussian splatting. This provides dense, geometry-aware, view-aligned conditioning while avoiding accumulated degradation from repeated VAE conversion. Second, we propose \textbf{Deviation Learning with Dynamic Deviation Archive}, which synthesizes rollout-induced latent deviations through a one-step approximation, stores them by autoregressive stage and denoising timestamp, and injects them into historical memory during training. This exposes the generator to realistic corrupted memory states and teaches internal correction before inference. Experiments on ScanNet, DL3DV, and OmniWorldGame demonstrate state-of-the-art long-horizon performance.

[76] Foundation VAEs for 3D CT Reconstruction, Augmentation, and Generation cs.CVPDF

Qi Chen, Shuhan Ding, Yu Gu, Nan Liu, Jiang Bian

TL;DR: 本文提出利用在自然图像和视频上预训练的Foundation VAE作为统一接口，无需训练即可应用于3D CT的重建、增强和生成任务。通过冻结编码器和解码器，该模型能有效重建CT体积并抑制噪声，同时在其潜在空间中训练的扩散模型能实现更忠实、高质量的CT生成。

Details

Motivation: 针对特定CT数据训练或微调VAE模型计算和工程成本高昂，且在异构扫描仪、协议和疾病下性能易退化，本文旨在探索无需训练的医疗VAE解决方案。

Result: 在胰腺肿瘤和肺肿瘤分割任务中，使用Foundation VAE重建的CT训练分割模型，平均表面精度（NSD）提升3.9%；在潜在空间中训练的扩散模型，平均FVD降低3.9%，CT CLIP分数提高36.2%，并在18种疾病类型的生成忠实度上AUC提升2.76%。

Insight: 创新点在于发现并验证了大规模自然图像预训练的Foundation VAE可直接迁移到3D CT领域，作为无需训练的统一表示接口，实现了跨模态的知识复用和高质量的医疗图像生成，降低了领域特定模型开发成本。

Abstract: Variational autoencoders (VAEs) compress high resolution CT volumes into compact latents while preserving clinically relevant structure. However, training CT-specific VAEs from scratch or heavily fine-tuning them incurs substantial computational and engineering cost, and often degrades under heterogeneous scanners, protocols, and diseases. This paper makes a progressive stride toward training-free medical VAEs by leveraging a critical observation: a single Foundation VAE, pretrained at scale on natural images and videos, can serve as a unified interface for CT Reconstruction, Augmentation, and Generation. With both encoder and decoder frozen, the Foundation VAE reconstructs CT volumes with preserved anatomy while suppressing acquisition noise; training segmentation models on these reconstructions improves surface accuracy by 3.9% NSD on average for pancreatic tumor and lung tumor. Within the same Foundation VAE latent space, a conditional latent diffusion model achieves 3.9% lower average FVD with 36.2% higher CT CLIP score, and improves multi-disease generation faithfulness across 18 types by 2.76% AUC. These results demonstrate Foundation VAEs as a practical interface for scalable CT representation reuse and faithful CT generation. Our code and demo are available at https://github.com/qic999/Foundation-VAE.

[77] GUI-C$^2$: Coarse-to-Fine GUI Grounding via Difficulty-Aware Reinforcement Learning cs.CVPDF

Junlong Li, Chao Hao, Lap-Pui Chau, Yi Wang

TL;DR: 本文提出GUI-C^2框架，通过难度感知的强化学习实现从粗到细的GUI定位。在数据层面，设计了GUI-D流程挖掘并评分训练样本的难度以指导加权训练；在策略层面，采用区域门控的粗到细优化机制，基于模型内部不确定性信号逐步缩小视野，自适应保留大目标上下文并提升小目标精度，同时简化决策过程以减少推理时间。

Details

Motivation: 现有GUI定位的智能体强化学习方法存在两个层面的局限：数据层面平等对待所有训练样本，忽视其难度差异导致训练效率低下或崩溃；策略层面难以平衡裁剪大区域（提供充足上下文）与小区域（减少冗余）的权衡，且复杂决策增加小参数模型的负担和推理时间。

Result: 大量实验表明，该方法在GUI定位任务上取得了最先进的性能（state-of-the-art）。

Insight: 创新点包括：1) GUI-D数据挖掘与难度评分管道，根据测试筛选有价值样本并分配难度分数以指导训练权重；2) GUI-C^2的区域门控粗到细优化机制，利用模型内部不确定性自适应调整视野，配合改进感知的阶段奖励确保每次优化真正提升定位效果；3) 简化决策过程以显著降低额外推理时间。

Abstract: Existing agentic reinforcement learning methods for GUI grounding have limitations at two levels. At the data level, current approaches typically treat all training samples equally, although their training value to the baseline model varies with difficulty. Overlooking this can greatly reduce training efficiency or even cause collapse. At the strategy level, existing frameworks struggle to balance the trade-off between cropping larger regions for sufficient context and smaller ones for reduced redundancy, a tension inherent to tool-augmented grounding agents. In addition, overly complex decision-making is difficult for small-parameter models and significantly increases inference time. To address these issues, at the data level, we propose GUI-D, a data mining and difficulty scoring pipeline that identifies the training-worthy samples by proper testing and assigns difficulty scores to guide subsequent training weights. At the strategy level, we propose GUI-C$^2$, which employs an area-gated coarse-to-fine refinement mechanism that progressively narrows the visual field via model-internal uncertainty signals, adaptively reserving context for large targets while amplifying precision for small ones, reinforced by improvement-aware stage rewards that ensure each refinement genuinely advances grounding. Meanwhile, we simplify the decision-making process to greatly reduce additional inference time. Finally, extensive experiments show that our method achieves state-of-the-art performance. The code and data will be publicly available.

[78] MergeTok: Unified Continuous and Discrete Visual Tokenization via Token Merging cs.CVPDF

Luyuan Zhang, Siyuan Li, Zedong Wang, Qingsong Xie, Cheng Tan

TL;DR: MergeTok提出了一种统一的视觉分词器，通过令牌合并技术联合优化连续（VAE）和离散（VQ）分词器，旨在克服现有两类模型各自的局限性。该方法在编码过程中聚类相似令牌，建立结构先验，为两个分支提供双重监督信号，从而获得兼具高保真重建、解耦语义表示和稳定训练特性的令牌表示。

Details

Motivation: 现有视觉分词器分为连续VAE和离散VQ两大类，前者重建保真度高但潜在表示密集且纠缠，不利于语义控制；后者支持自回归生成但面临梯度稀疏、训练不稳定和码本崩溃等问题。本文旨在设计一个统一架构来融合两者的优势。

Result: 在ImageNet-256基准测试中，MergeTok在相同令牌预算下，取得了比强VAE和VQ模型更低的rFID（相对Fréchet Inception Distance），显示出具有竞争力的重建和生成性能。其生成的令牌表示具有语义组织性，且兼容自回归和扩散生成器。

Insight: 核心创新在于通过令牌合并作为语义桥梁，在一个编码器-解码器架构内联合优化连续和离散分词目标。这为VAE分支提供了合并令牌的语义对齐监督，正则化其潜在空间；同时为VQ分支提供了组间约束，促进了组内多样性和组间排他性，从而稳定了训练。这表明单一架构可以赋予视觉分词器鲁棒的语义组织和生成器友好的离散性。

Abstract: Most visual tokenizers for image generation are bifurcated into two families with complementary limitations: continuous VAEs offer high-fidelity reconstruction but suffer from dense, entangled latents that are poorly suited for semantic control, whereas discrete VQ-based models enable autoregressive generation yet struggle with gradient sparsity, unstable training, and codebook collapse. In this work, we introduce MergeTok, a unified tokenizer that jointly optimizes continuous (VAE) and discrete (VQ) tokenizers within a encoder-decoder architecture, leveraging token merging techniques as a semantic bridge. By clustering similar tokens during encoding, MergeTok establishes a structural prior that provides dual supervision signals: (i) it imposes merged-token semantic alignment in the VAE branch, regularizing its latent space toward disentangled, semantic-aware representations; (ii) it derives group-wise constraints, promoting intra-group diversity and inter-group exclusivity that stabilize VQ training. MergeTok shows competitive reconstruction and generation performance on ImageNet-256, with substantially lower rFID than strong VAE and VQ models under matched token budgets, while producing semantically-organized token representations compatible with both autoregressive and diffusion generators. This shows that a single architecture can endow visual tokenizers with robust semantic organization and generator-friendly discreteness.

[79] What Makes LVLMs Hallucinate Less? Unveiling the Architectural Factors Behind Hallucination Robustness cs.CV | cs.AIPDF

Yusheng He, Jizhe Zhou, Xia Du, Zheng Lin, Jun Luo

TL;DR: 本文系统研究了大型视觉语言模型（LVLM）幻觉问题的架构根源，将架构设计分解为语言基础、视觉表征和语义对齐三个维度，并提出包含共现、相似性和不确定性三种幻觉类型的细粒度基准CoSimUE。实验表明，参数缩放对减少幻觉作用有限，而增强语言基础、视觉编码器分辨率以及改进对齐策略能分别缓解不同类型的幻觉，其中联合提升视觉保真度与对齐质量效果最佳。

Details

Motivation: 针对LVLM中幻觉问题严重损害模型可靠性的挑战，现有研究多关注改进内部组件，而本文认为幻觉根源在于模型架构设计，旨在系统探索架构因素如何影响幻觉鲁棒性。

Result: 在提出的CoSimUE基准上对7个设计方面进行实验，结果显示：参数缩放对减少三类幻觉作用有限；更大、训练更好的语言基础减少共现幻觉；更强的视觉编码器和更高分辨率缓解相似性错误；有效的对齐策略减轻不确定性幻觉；联合增强视觉保真度与对齐质量带来最全面的改进。

Insight: 创新点在于首次将架构设计系统分解为三个维度并与细粒度幻觉类型关联，构建了可控扰动基准以量化设计选择与幻觉行为的关系；客观来看，其跨维度分析为高效可靠LVLM设计提供了可操作的架构级指导，而非仅依赖参数扩展。

Abstract: Hallucination remains one of the key challenges undermining the reliability of Large Vision-Language Models (LVLMs). But what makes an LVLM hallucinate less? Many existing efforts focus on improving internal components of the model. We argue that hallucination fundamentally stems from how the model architecture is designed. To investigate this, we factor the architecture design into three dimensions: Linguistic Foundation (LF), Visual Representation (VR), and Semantic Alignment (SA), and categorize hallucinations into Co-occurrence, Similarity, and previously overlooked Uncertainty types. Building on this formulation, we propose CoSimUE, a benchmark that creates fine-grained hallucination scenarios through controlled textual perturbations and random perturbations, enabling mapping between design choices and hallucination behaviors. Experiments across 7 design aspects show that: 1) the widely emphasized scaling of model parameters has only limited impact on reducing all three types of hallucinations; 2) larger and better-trained language foundations can reduce co-occurrence hallucinations; 3) stronger visual encoders and higher resolutions mitigate similarity errors; 4) effective alignment strategies alleviate uncertainty hallucinations. 5) Furthermore, cross-dimensional analysis reveals that jointly enhancing visual fidelity and alignment quality yields the most comprehensive improvements. This study provides the first systematic exploration linking architecture-level design to hallucination robustness, offering practical guidance for developing reliable and efficient LVLMs.

[80] Attend to Evidence: Evidence-Anchored Spatial Attention Supervision for Multimodal RLVR cs.CV | cs.CLPDF

Ruina Hu, Chen Wang, Lai Wei, Jionghao Bai, Bin Yu

TL;DR: 本文提出了一种名为EASE（Evidence-Anchored Spatial Attention）的方法，用于增强多模态可验证奖励强化学习（RLVR）。该方法通过将标注的证据区域转换为平滑的视觉标记目标，在RL训练期间引导模型对高奖励轨迹的响应-图像注意力，从而解决仅依赖最终答案奖励无法区分答案是否基于正确视觉证据的问题。

Details

Motivation: 现有的基于可验证奖励的强化学习（RLVR）仅优化最终答案的奖励，无法指导模型关注图像中支持答案的具体区域，导致模型可能通过语言先验捷径或猜测产生答案，而非基于正确的视觉证据。

Result: 在Qwen2.5-VL-7B、Qwen3-VL-4B和Qwen3-VL-8B模型上，EASE方法在感知、幻觉、视觉数学和多模态推理等基准测试中，平均得分比DAPO方法提高了2.5到3.1个百分点。诊断和消融实验表明，EASE能更好地将视觉注意力与标注的证据区域对齐。

Insight: 论文的创新点在于引入了基于视觉证据的过程监督，将证据区域作为特权训练标签来引导空间注意力，从而在无需额外推理开销的情况下，提升模型对视觉证据的依赖。这为多模态RL提供了一种结合结果奖励和过程监督的有效训练范式。

Abstract: Reinforcement learning with verifiable rewards (RLVR) improves vision-language models (VLMs) by optimizing outcome rewards derived from final answers. However, such outcome-only rewards do not tell the model which image regions justify an answer. For questions that require visual grounding, these rewards cannot distinguish responses supported by relevant visual evidence from those produced by language-prior shortcuts or lucky guesses. We introduce EASE (Evidence-Anchored Spatial Attention), which augments multimodal RLVR with visual-evidence process supervision. EASE converts annotated evidence regions into a smoothed visual-token target and uses it to guide response-to-image attention during RL training, but only on high-reward trajectories. The annotations are used solely as privileged training labels, while inference requires only the original image and question. Across Qwen2.5-VL-7B, Qwen3-VL-4B, and Qwen3-VL-8B, EASE raises average scores over DAPO by 2.5 to 3.1 points on perception, hallucination, visual math, and multimodal reasoning benchmarks. Diagnostics and ablations show that EASE better aligns visual attention with annotated evidence regions.

[81] DiTTo: Scalable Order-aware All-in-One Image Restoration Agent cs.CVPDF

Seungho Choi, Jihyong Oh

TL;DR: 本文提出了DiTTo，一种可扩展的顺序感知一体化图像修复代理框架，旨在解决现实世界中图像多退化问题。该框架通过DiTTo模拟器和DiTTo代理，显著降低了最优修复轨迹数据集的构建成本，并实现了即插即用的可扩展性，允许在不完全重新训练的情况下引入新的修复专家。

Details

Motivation: 现实世界图像通常遭受多种退化，且修复顺序对最终质量有重要影响。现有基于训练的代理方法在构建最优修复轨迹数据集时计算成本高（O((N^D)^2)），且与固定修复专家池耦合，难以扩展新专家。

Result: 在包含多达五种并发退化的MiO-100评估集上，DiTTo代理在基于代理的图像修复方法中取得了最先进的多退化修复质量。

Insight: 创新点包括：1) 引入DiTTo模拟器（结合∪S-IR和AiO-IQA）将最优修复轨迹数据集构建成本降至O(N^D)；2) 提出顺序感知修复对齐（ORA）技术，实现独立轴上的退化识别、修复动作排序和输出格式对齐；3) 框架支持即插即用的可扩展性，仅需更新轻量级ORA阶段即可集成新修复专家。

Abstract: Real-world images rarely suffer from a single degradation, and the order in which degradations are removed substantially affects the final restoration quality, motivating agent-based image restoration (IR), where a vision-language model schedules a pool of pre-built restoration-experts. However, existing training-based agents require $\mathcal{O}((N^{\mathbf{D}})^{2})$ restoration-expert calls per image to construct the Optimal Restoration-action Trajectory Dataset (ORTD), where $N^{\mathbf{D}}$ denotes the number of degradation types in the universe $\mathbf{D}$, and couple agent training to a fixed restoration-expert pool, preventing extension to newly introduced restoration-experts without full retraining. To overcome these efficiency and extensibility bottlenecks, we propose \textbf{DiTTo}, a novel order-aware image restoration agent framework consisting of the DiTTo Simulator and the DiTTo Agent. The DiTTo Simulator combines $\cup$S-IR for single-step restoration-action simulation and AiO-IQA for per-action quality prediction, reducing ORTD construction to $\mathcal{O}(N^{\mathbf{D}})$ simulator calls per image; the DiTTo Agent is trained by SFT on the simulator-generated ORTD, followed by \textbf{Order-aware Restoration Alignment (ORA)} that aligns degradation identification, restoration-action-ordering, and output format along independent axes. This enables \textbf{plug-and-play scalable extensibility}: adding a new restoration-expert requires updating only the lightweight ORA stage. On the MiO-100 evaluation set with up to five concurrent degradations, our DiTTo Agent achieves state-of-the-art multi-degradation restoration quality among previous agent-based IR methods.

[82] IAF-Net: Illumination-Adaptive Fusion for Low-Light Urban Road Segmentation cs.CVPDF

Bingtao Wang, Daojie Peng, Fulong Ma, Jun Ma, Liang Zhang

TL;DR: 本文提出了一种名为IAF-Net（光照自适应融合网络）的端到端框架，用于在低光照条件下实现鲁棒的城市道路分割。该网络通过核心的光照自适应融合模块动态调整RGB和几何特征的融合权重，并利用亮度调制注意力解码器增强低光照特征选择。作者还构建了两个专用数据集进行验证。

Details

Motivation: 语义道路分割对自动驾驶至关重要，但现有方法在低光照条件下性能严重下降。许多现有的多模态融合方法未能明确适应模态可靠性随光照变化的情况，导致在夜间可能将退化的RGB特征传播到融合表示中。

Result: 在nuScenes Nighttime Road Segmentation数据集上的实验表明，该方法在对比方法中达到了最先进的整体性能。在CARLA Multi-Weather Road Segmentation数据集上的实验进一步验证了其在恶劣天气条件下的鲁棒性。消融研究显示，IAF模块贡献了最大的性能提升，在MaxF指标上提高了0.70%。

Insight: 论文的创新点在于提出了光照自适应融合模块，能够根据光照条件动态调整多模态特征的融合权重，从而更有效地利用不同光照下各模态的可靠性。此外，构建的两个专用低光照和恶劣天气道路分割数据集也为该领域的研究提供了有价值的基准。

Abstract: Semantic road segmentation is important for autonomous driving, but existing methods suffer severe performance degradation under low-light conditions. Many existing multi-modal fusion methods do not explicitly adapt to illumination-dependent changes in modality reliability, which can propagate degraded RGB features into the fused representation at night. We propose IAF-Net (Illumination-Adaptive Fusion Network), an end-to-end framework with illumination-adaptive fusion for robust road segmentation across different lighting conditions. It dynamically adjusts fusion weights of RGB and geometric features via the core Illumination-Adaptive Fusion (IAF) module, and enhances low-light feature selection with a brightness-modulated attention decoder. We also construct two dedicated datasets: nuScenes Nighttime Road Segmentation (nuScenes-NRS) and CARLA Multi-Weather Road Segmentation (CARLA-MWRS). Experiments on nuScenes-NRS show state-of-the-art overall performance among the compared methods, while CARLA-MWRS further validates robustness across adverse weather conditions. Ablation studies on a 40% training subset further highlight the importance of the IAF module, which provides the largest individual gain of 0.70% in MaxF.

[83] PRISM: Progressive Reasoning through Iterative Slot Memory for Vision cs.CVPDF

Ziyu Wang, Shuangpeng Han, Mengmi Zhang

TL;DR: PRISM是一种渐进式推理的视觉架构，通过迭代槽记忆对图像进行多尺度迭代优化。它将视觉特征分组为以对象为中心的表示，从学习的内存中检索相关模式，并通过组织-召回-精炼过程逐步改进视觉表示。

Details

Motivation: 现代视觉模型通常单次前向处理图像，难以在不完整观测下恢复缺失证据或优化不确定表示，受人类感知迭代特性启发，旨在构建更具适应性的视觉模型。

Result: 在图像分类、目标检测和语义分割等标准视觉任务中，PRISM实现了具有竞争力的性能，并在遮挡等不完整观测条件下表现出更强的鲁棒性。

Insight: 创新点在于结合结构化表示与记忆的迭代推理机制，通过多尺度循环操作逐步优化视觉表示，为构建更具弹性的视觉模型提供了新方向。

Abstract: Modern vision models process images in a single feed-forward pass, which limits their ability to recover missing evidence or refine uncertain representations under incomplete observations. Inspired by the iterative nature of human perception, we introduce PRISM (Progressive Reasoning through Iterative Slot Memory), a pyramid vision architecture that reasons over images through iterative refinement. At a high level, PRISM groups visual features into object-centric representations, retrieves relevant patterns from a learned memory, and iteratively refines the representation to resolve ambiguity and recover missing information. This organize-recall-refine process operates recurrently across multiple scales, enabling progressive improvement of visual representations. Across standard vision tasks, including image classification, object detection, and semantic segmentation, PRISM achieves competitive performance while demonstrating improved robustness under incomplete observations such as occlusion. These results suggest that iterative reasoning with structured representations and memory is a promising direction for building more resilient and adaptive vision models. Source code and models will be released.

WenZhang Wei, Zhipeng Gui, Dehua Peng, Tiandi Ye, Huayi Wu

TL;DR: 本文提出了一种用于跨模态相似性表示的变分适配器（VACSR），旨在解决视觉-语言模型中由于细粒度跨模态匹配标注缺失导致的相似性空间二值化问题。该方法将图像-文本匹配重构为变分推断问题，构建跨模态相似性的隐空间，并通过正则化技术缓解对二值标注的过拟合。

Details

Motivation: 现有图像-文本匹配或多类图像分类数据集缺乏细粒度跨模态匹配标注，迫使连续相似性空间压缩为二值分类边界，导致假负样本并损害跨模态任务的泛化性能。

Result: 在图像-文本检索、领域泛化和基础到新类泛化任务上的实验证明了该方法的有效性和鲁棒的泛化能力。

Insight: 创新点在于将细粒度语义稀缺的跨模态匹配问题建模为变分推断，构建相似性隐空间以更合理分配不确定性，从而缓解标注缺陷带来的负面影响。

Abstract: The core of vision-language models lies in measuring cross-modal similarity within a unified representation space. However, most image-text matching or multi-class image classification datasets lack fine-grained cross-modal matching annotations, forcing the continuous similarity space into binary classification boundaries. This compression induces false negative samples and significantly impairs the generalization performance of cross-modal tasks. While prior research has attempted to mitigate this by modeling intra-modal ambiguity, it often overlooks inherent annotation flaws, leading to suboptimal uncertainty allocation. To address these challenges, we propose a Variational Adapter for Cross-modal Similarity Representation (VACSR). This approach reformulates image-text matching with fine-grained semantic scarcity as a variational inference problem. It constructs a latent space for cross-modal similarity and uses regularization techniques to mitigate overfitting to binary annotations. Experiments on image-text retrieval, domain generalization, and base-to-novel generalization demonstrate the proposed method’s effectiveness and robust generalization ability.

[85] Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative Learning cs.CVPDF

Zhenwu Shi, Jingyu Gong, Peiwei Wang, Xingzan Wang, Tianwen Qian

TL;DR: 本文提出了一种名为OmniME的全监督正负学习框架，用于基于文本的人体运动编辑任务，旨在根据自然语言指令修改现有运动序列，同时保持原始运动的一致性。该方法通过整合回顾性特征监督、运动保持机制和三元组语义对齐三个互补组件，平衡了编辑中的变化（精确修改目标区域）和不变性（保留未编辑部分）。

Details

Motivation: 现有基于扩散的方法通常依赖于启发式相似性线索或粗略的全局条件，导致运动失真和语义对齐不理想。核心挑战在于平衡编辑中的变化与不变性。

Result: 在MotionFix和STANCE Adjustment数据集上的大量实验表明，OmniME在编辑对齐方面实现了最先进的性能。

Insight: 创新点在于提出了一个统一的全监督学习范式，通过三个互补组件（回顾性特征监督、基于源-目标相似性的运动保持机制、三元组语义对齐）来协同解决编辑精度与保持性的平衡问题，从而提升文本-运动对应关系。

Abstract: Text-based human motion editing aims to modify existing motion sequences according to natural language instructions while maintaining the consistency of the original motion. Existing diffusion-based approaches often rely on heuristic similarity cues or coarse global conditioning, leading to motion distortion and suboptimal semantic alignment. The key challenge lies in balancing change (i.e. precisely editing target regions) and invariance (i.e. preserving unedited parts). To handle such challenge, we propose an Omni-Supervised Positive-Negative Learning framework, named OmniME. Our method integrates three complementary components: (1) retrospective feature supervision that enforces coarse-to-fine consistency across transformer layers,(2) motion preservation mechanism that focuses on subtle variations according to the source-target similarity, and (3) triplet-based semantic alignment that strengthens text-motion correspondence. Together, these components form a unified supervision paradigm that balances change and invariance. Extensive experiments on the MotionFix and STANCE Adjustment datasets demonstrate that OmniME achieves state-of-the-art performance in editing alignment, validating the effectiveness of our unified learning framework. Our source codes and models have been released at: https://github.com/rocket-ycyer/OmniME.git

[86] Can BEV Perception Gracefully Degrade under Sensor Failures? cs.CVPDF

Haifa Zhang, Yijing Wang, Haoyu Wang, Zheng Li, Zhiqiang Zuo

TL;DR: 该论文针对自动驾驶中多模态鸟瞰图感知系统在传感器故障时性能急剧下降的脆弱性问题，提出了一个名为Grace-BEV的轻量级即插即用框架。该框架通过主动评估模态可靠性，在BEV空间内动态调整特征融合，以实现在传感器损坏或缺失情况下的性能优雅降级。

Details

Motivation: 现有基于BEV的多模态感知系统在融合多传感器数据时采用静态方式，当传感器出现损坏或缺失时，融合机制极其脆弱，会导致性能灾难性下降。论文旨在解决这一关键漏洞，使系统能够在传感器故障时实现性能的优雅降级。

Result: 在nuScenes-R和nuScenes-C数据集上的大量实验表明，Grace-BEV能在多种损坏设置下保持鲁棒性能。在灾难性的LiDAR故障下，标准基线模型的平均精度均值降至0.0%，而Grace-BEV能恢复至高达34.7% mAP。此外，在正常（干净）数据上，其精度还能提升高达1.4%，在鲁棒性和效率之间取得了良好平衡。

Insight: 论文的核心创新在于提出了主动模态可靠性评估的融合范式，具体通过TrustGate Router显式评估模态可信度，并通过FailSafe Fusion Block动态重新校准特征融合。此外，采用包含模态丢弃的三阶段训练策略，以防止模态主导并鼓励在不可靠输入下的平衡跨模态学习，这是一种轻量且有效的鲁棒性增强方法。

Abstract: Despite the remarkable success of multi-modal bird’s-eye view (BEV) perception in autonomous driving, current systems exhibit a critical vulnerability: existing fusion mechanisms are highly brittle to sensor corruptions, often causing catastrophic performance degradation. This vulnerability largely stems from the fact that standard fusion frameworks typically integrate multi-modal representations in a static manner, leading to a precipitous performance collapse under missing or corrupted modalities. In contrast, we show that graceful degradation is achievable through active modality reliability assessment. To this end, we present Grace-BEV, a lightweight and plug-and-play framework that enforces active reliability awareness during multi-modal fusion. Instead of relying on computationally expensive cross-modal interactions, Grace-BEV leverages the aligned BEV space to explicitly assess modality trustworthiness via a TrustGate Router and dynamically recalibrate feature integration using the FailSafe Fusion Block. Furthermore, we devise a Three-Phase Training strategy with Modality Dropout to prevent modality dominance and encourage balanced cross-modal learning under unreliable inputs. Extensive experiments on nuScenes-R and nuScenes-C show that Grace-BEV maintains robust performance across diverse corruption settings. Notably, under catastrophic LiDAR failures where standard baselines collapse to 0.0% mean Average Precision (mAP), Grace-BEV restores performance to as high as 34.7% mAP. Moreover, it improves clean accuracy by up to 1.4%, achieving a strong trade-off between robustness and efficiency.

[87] BiSegMamba: Efficient Bidirectional Tri-Oriented Mamba for 3D Medical Image Segmentation cs.CVPDF

Bakht Zada, Chao Tong, Qile Su, Shuai Zhang

TL;DR: 本文提出BiSegMamba，一种用于3D医学图像分割的高效双向三向Mamba网络。该方法采用紧凑到细节的设计，通过渐进式压缩主干（PCS）实现高效的潜在空间推理，同时保留浅层高分辨率特征用于重建。提出的双向三向正交Mamba（Bi-ToOM）块从多个正交视角建模长程依赖关系，并使用自适应方向融合（ADF）学习扫描方向间的输入依赖通道权重。在颈动脉CTA数据集和三个公共基准测试（BraTS2023、ACDC、AMOS-CT）上的实验表明，该方法在血管、心脏、脑肿瘤和腹部多器官分割任务上具有良好的泛化能力，并在保持性能的同时显著降低了计算成本。

Details

Motivation: 解决3D医学图像分割中长程体积上下文建模与精细边界保留的平衡问题。现有CNN方法全局依赖建模能力有限，Transformer方法对密集3D输入计算成本高，而现有Mamba方法仍依赖重复高分辨率扫描、单向序列建模和固定方向求和，导致成本高、扫描顺序偏差和次优方向聚合。

Result: 在BraTS2023、ACDC、颈动脉数据集和AMOS-CT上的实验表明，与SegMamba-V2相比，BiSegMamba在BraTS2023上性能略优，在ACDC和颈动脉数据集上有明显提升，同时计算成本降低高达77.9% FLOPs，实现了精度与效率的良好平衡。

Insight: 创新点包括：1）紧凑到细节的设计架构，平衡效率与细节保留；2）双向三向正交Mamba块，从多个正交视角联合处理前向和后向扫描序列，缓解扫描顺序偏差；3）自适应方向融合机制，学习输入依赖的通道权重，替代固定求和，实现方向感知的特征融合。

Abstract: Accurate 3D medical image segmentation requires both long-range volumetric context and fine boundary preservation. CNN-based methods have limited global dependency modeling, while Transformer-based models are often computationally expensive for dense 3D inputs. Recent Mamba-based methods provide an efficient alternative, but existing volumetric designs still depend on repeated high-resolution scanning, forward-only sequential modeling, and fixed directional summation, causing high cost, scan-order bias, and suboptimal directional aggregation. We propose BiSegMamba, an efficient bidirectional tri-oriented Mamba network for 3D medical image segmentation. BiSegMamba follows a compact-to-detail design, where a progressive compacting stem (PCS) enables efficient latent-space reasoning while retaining shallow high-resolution features for reconstruction. A multi-scale spatial mixer (MSSM) captures local anatomical patterns in early stages, and the proposed bidirectional tri-oriented Ortho Mamba (Bi-ToOM) block models long-range dependencies from multiple orthogonal views using jointly processed forward and backward scan sequences. Adaptive directional fusion (ADF) learns input-dependent channel-wise weights across scan orientations, replacing fixed summation with orientation-aware fusion. Experiments on a collected carotid CTA dataset and three public benchmarks, BraTS2023, ACDC, and AMOS-CT, show that BiSegMamba generalizes well across vascular, cardiac, brain tumor, and abdominal multi-organ segmentation tasks. Compared with SegMamba-V2, BiSegMamba achieves slightly better performance on BraTS2023 and clear improvements on ACDC and the carotid dataset, while reducing computational cost by up to 77.9% FLOPs, demonstrating a strong accuracy-efficiency balance for general 3D medical image segmentation.

[88] PEEK: Picking Essential frames via Efficient Knowledge distillation cs.CVPDF

Killian Steunou, Anas Filali Razzouki, Khalil Guetari, Mounîm A. El-Yacoubi, Yannis Tevissen

TL;DR: PEEK是一种高效的动态帧采样方法，通过知识蒸馏将教师模型对帧相关性的排序能力迁移到轻量级时序模型中，以提升视频描述任务中有限帧数下的性能。

Details

Motivation: 视频语言模型通常只能处理有限数量的帧，而现有自适应帧采样方法计算成本高，因此需要一种既高效又能选择关键帧的方法。

Result: 在ActivityNet Captions和MSR-VTT数据集上，PEEK在低帧预算（如1-2帧）下优于现有SOTA方法，尤其在ActivityNet Captions的16种配置中赢得14项最佳，且仅增加5.2%的描述时间，远低于基线方法。

Insight: 创新点在于利用知识蒸馏将复杂的帧相关性评估任务压缩到轻量视觉模型中，实现了在低计算开销下动态选择关键帧，平衡了效率与准确性。

Abstract: Video-language models can process only a limited number of frames, making frame selection a key bottleneck for efficient video captioning. Most captioning pipelines still rely on uniform sampling, which is computationally cheap but agnostic to visual content. Adaptive frame sampling has recently emerged as a promising approach for selecting the most informative frames from a video; however, existing methods remain computationally expensive. We introduce PEEK, an efficient dynamic frame sampling method that distills caption-conditioned frame relevance rankings from a stronger teacher model into a lightweight temporal model that operates only on visual content. We find that, overall, on ActivityNet Captions and MSR-VTT, our method outperforms state-of-the-art methods across all evaluated downstream vision language models, especially when only one or two frames are selected for captioning, obtaining the best CIDEr for most frame budgets. On ActivityNet Captions, PEEK is particularly strong, winning 14 out of 16 configurations. Zero-shot evaluation on MSR-VTT shows that our model transfers best at low frame budgets, while results at four and eight frames are more mixed as temporal coverage and visual diversity become increasingly competitive. Compared with recent adaptive baselines, PEEK is both more accurate in the low-budget regime and more efficient: it adds only $5.2%$ to the captioning time, compared with $65.4%$ for CSTA and $211.9%$ for MaxInfo. We release our code and pre-trained checkpoint at https://github.com/momentslab/peek.

[89] Generating Reports or Repeating Templates? Measuring and Mitigating Template Collapse in 3D CT Report Generation cs.CV | cs.AI | cs.CLPDF

Tom Maye-Lasserre, Yitong Li, Bailiang Jian, Morteza Ghahremani, Benedikt Wiestler

TL;DR: 本文研究了3D医学影像报告生成中的’模板崩溃’问题，即模型倾向于生成通用模板化报告而忽略罕见但关键的病理发现。作者提出了CLarGen框架，通过将病理检测与语言生成解耦来缓解此问题，显著提升了临床准确性。

Details

Motivation: 解决现代3D医学视觉语言模型在生成放射学报告时出现的’模板崩溃’问题，即模型虽然能生成流畅文本，但病理检测率低、输出多样性差，尤其会漏报罕见但关键的发现。

Result: 在3D CT报告生成任务上，CLarGen显著提升了临床准确性（macro-F1从0.189提升至0.487，CRG从0.368提升至0.472），超越了现有SOTA基线模型，同时保持了报告的流畅性。

Insight: 创新点在于：1) 系统性地定义并诊断了’模板崩溃’现象；2) 提出解耦框架CLarGen，将’检测什么’（病理发现）与’如何描述’（语言合成）分离；3) 采用潜在查询变换器进行多标签病理检测，并结合病理引导检索和医学语言模型生成报告。

Abstract: Modern 3D medical vision-language models (VLMs) can generate fluent radiology-style text while exhibit critically low pathology detection and output diversity, collapsing to generic templates that under-report rare yet critical findings. We identify this failure mode as Template Collapse. This failure stems from the unique constraints of 3D medical imaging, e.g., limited data, severe label imbalance, and weak signals from volumetric encoders. Under these constraints, text-generation objectives encourage shortcut learning and fluent but weakly grounded reports. We systematically diagnose the Template Collapse through clinical fidelity, output diversity, normal-template bias, and rare-finding survival. To mitigate it, we propose CLarGen, a decoupled framework that separates what to say (clinical detection) from how to say it (language synthesis). CLarGen uses (i) a Latent Query Transformer for multi-label pathology detection, (ii) pathology-guided retrieval for clinically matched exemplars, and (iii) a medical language model to synthesize the final report from detected findings and retrieved context. Across state-of-the-art 3D CT report generation baselines, CLarGen mitigates Template Collapse and substantially improves clinical accuracy (macro-F1 0.487 vs. 0.189; CRG 0.472 vs. 0.368) while maintaining fluent reporting. Our results suggest that explicit, measurable clinical grounding is essential for template-collapse-resistant 3D CT report generation. Code will be released upon acceptance.

[90] GGT-100K: Generative Ground Truth for Generalizable Real-World Image Restoration cs.CVPDF

Xiangtao Kong, Jixin Zhao, Lingchen Sun, Rongyuan Wu, Lei Zhang

TL;DR: 该论文提出了生成式真实标注（GGT）方法，利用生成式多模态基础模型（MFMs）从真实世界的低质量图像生成高质量目标，以解决真实世界图像复原任务中高质量配对训练数据稀缺的问题。作者系统评估了九种先进的MFMs，发现Nano-Banana-2模型能合成感知真实且内容忠实的高质量目标，并基于此构建了包含103,707个训练对的GGT-100K数据集。实验表明，GGT-100K能有效提升多种图像复原模型在真实场景中的泛化能力。

Details

Motivation: 真实世界图像复原任务受限于高质量配对训练数据的稀缺性：合成数据集难以模拟真实退化，而真实配对数据集获取成本高昂，导致现有模型在真实场景中泛化能力有限。

Result: 在多种场景和退化类型图像上对九种先进MFMs进行系统评估，结果显示Nano-Banana-2结合基于VLM的自适应提示能合成最逼真的高质量目标。使用GGT-100K数据集训练能持续提升多种IR模型的真实世界泛化性能，尤其在微调生成式模型用于IR任务时效果显著。

Insight: 创新点在于利用生成式多模态基础模型为真实低质量图像自动生成高质量标注，构建大规模、多样化的配对数据集GGT-100K。这为复原导向的数据生成提供了实用工具，并扩展了真实世界图像复原模型的泛化边界。

Abstract: Real-world image restoration (IR) is bottlenecked by the scarcity of high-quality paired training data. Synthetic datasets are abundant but often fail to model real-world degradations, while real-world paired datasets are expensive and difficult to capture. As a result, IR models trained on these datasets show limited generalization in real-world scenarios. In this work, we propose Generative Ground Truth (GGT) by using generative multimodal foundation models (MFMs) to produce high-quality (HQ) targets from real-world low-quality (LQ) images. We first conduct a systematic evaluation of nine state-of-the-art MFMs, including Nano-Banana-2 and GPT-Image-2, on images of various scenes and degradation types. The results demonstrate that Nano-Banana-2 with VLM-based adaptive prompting shows the highest capability to synthesize perceptually realistic and content-faithful HQ targets, which can serve as the GGT for the LQ input. We then employ Nano-Banana-2 to build a GGT synthesis pipeline, which involves multi-stage quality control to ensure data reliability, and construct GGT-100K, an LQ-HQ paired dataset comprising 103,707 training pairs and covering diverse scenes and complex real-world degradations. A test set of 500 image pairs is also established. Extensive experiments show that GGT-100K consistently improves the real-world generalization of a wide range of IR models, with particularly strong benefits for finetuning generative models for IR tasks. Our results suggest that MFMs can serve as practical tools for restoration-oriented data generation, and GGT-100K is a useful resource to expand the generalization boundaries of real-world IR models.

[91] SlotMemory: Object-Centric KV Memory for Streaming Long-Video Generation cs.CVPDF

Weijia Dou, Hui Li, Jiahao Cui, Lei Zhou, Jingdong Wang

TL;DR: 本文提出SlotMemory，一种面向对象的键值记忆机制，用于流式长视频生成。该方法将Transformer的键值流形分解为离散、可重用的语义槽，从而将记忆抽象从‘何时发生’转变为‘表示什么’，实现了实体级持久性和提示感知检索。在Wan2.1-T2V-1.3B骨干网络上对60秒交互式叙事进行评估，SlotMemory取得了最先进的质量分数和动态一致性提升。

Details

Motivation: 解决现有流式视频生成模型中基于时间的记忆机制（如原始帧、片段或未聚类令牌）在实体离开画面或交互提示转换时，常导致身份漂移和语义不一致的问题。

Result: 在Wan2.1-T2V-1.3B骨干网络上对60秒交互式叙事进行评估，SlotMemory取得了81.61的SOTA质量分数，并在动态一致性上相对于现有最强流式基线有22.8%的相对提升。

Insight: 核心创新在于将记忆抽象从时间中心转向对象中心，通过语义槽对键值令牌进行索引和存储，实现了结构化语义表示，这被认为是持久长视频合成的关键基础，而非原始的时序容量。

Abstract: Streaming video generation models typically rely on temporal-centric memory, which organizes historical context as raw frames, chunk segments, or unclustered tokens. This organization frequently leads to identity drift and semantic inconsistency when entities exit the frame or during interactive prompt transitions. To address these limitations, we propose SlotMemory, an object-centric Key-Value memory mechanism for streaming video diffusion. Our approach shifts the memory abstraction from “when” an event occurred to “what” is being represented by decomposing the transformer’s key-value manifold into discrete, reusable semantic slots. By utilizing these slots as routing addresses to index and store high-fidelity key-value tokens, we enable entity-level persistence and prompt-aware retrieval across long horizons. Evaluated on 60-second interactive narratives using the Wan2.1-T2V-1.3B backbone, SlotMemory achieves a state-of-the-art quality score of 81.61 and a 22.8 percent relative improvement in dynamic consistency over the strongest existing streaming baseline. Our results demonstrate that structured semantic representation, rather than raw temporal capacity, is the essential primitive for persistent long-form video synthesis. Our codes and checkpoints are available at https://tj12323.github.io/SlotMemory/.

[92] Does Visual Information Play a Decisive Role in Vision-Language-Action Model Driving Behavior? cs.CV | cs.AIPDF

Jingtao He, Hongliang Lu, Xiaoyun Qiu, Yixuan Wang, Xinhu Zheng

TL;DR: 本文提出了一种结构化的多级视觉扰动框架，用于系统分析基于视觉-语言-动作（VLA）模型的自动驾驶行为对视觉信息的依赖程度。该框架从通道级退化、信息级干扰和结构级修改三个维度施加受控视觉扰动，并在开环轨迹预测和交互式闭环安全评估中测试VLA驾驶系统的行为响应。实验揭示了评估依赖的依赖模式以及不同抽象层次上视觉基础的不均衡性。

Details

Motivation: 当前基于VLA的自动驾驶模型的行为在多大程度上基于视觉信息尚不明确，现有评估协议主要关注聚合性能指标，缺乏结构化和实用的诊断方法来量化视觉-行为依赖性。

Result: 实验结果表明，VLA驾驶模型的视觉-行为依赖模式依赖于具体的评估方式（开环或闭环），并且在不同抽象层次上的视觉基础是不均衡的。

Insight: 创新点在于提出了一个结构化的多级视觉扰动分析框架，为系统诊断VLA模型的视觉基础提供了方法论。客观来看，该研究强调了在VLA驾驶模型设计中需要进行更结构化的分析和原则性设计，以理解视觉信息如何塑造行为并开发更安全、更鲁棒的系统。

Abstract: Vision-Language-Action (VLA) models have demonstrated promising capability in autonomous driving, highlighting the potential of unified multimodal architectures for jointly modeling perception and planning. However, how current VLA-based driving behavior is grounded in visual information remains poorly understood. Existing evaluation protocols mainly focus on aggregate performance metrics, lacking structured and practical diagnostics to quantify visual-behavior dependency. In this work, we introduce a structured multi-level visual perturbation framework to analyze visual-behavior dependency in VLA-based driving models systematically. The framework organizes controlled visual perturbations along three complementary dimensions: channellevel degradation, information-level disruption, and structurelevel modification. We apply it to VLA-based driving systems and evaluate behavioral responses under both open-loop trajectory prediction and interactive closed-loop safety evaluation. Experimental results reveal evaluation-dependent dependency patterns and uneven visual grounding across abstraction levels. These findings call for more structured analyses and principled design of VLA driving models to better understand how visual information shapes behavior and develop safer, more robust systems.

[93] LVSA: Training-Free Sparse Attention for Long Video Diffusion cs.CV | cs.LGPDF

Gael Glorian, Ioannis Lamprou, Zhen Zhang, Yujie Yuan, Hongsheng Liu

TL;DR: 该论文提出了LVSA（长视频稀疏注意力），一种无需训练、模型无关的块稀疏注意力机制，用于视频扩散Transformer模型。它通过结合结构化窗口模式和旋转全局锚点，解决了密集自注意力在生成长视频时计算成本二次增长和超出训练范围后输出趋于静态重复的问题。LVSA显著降低了计算开销，并支持在单GPU上生成更长的视频。

Details

Motivation: 密集自注意力是长视频扩散推理的计算和质量瓶颈：成本随序列长度呈二次方增长，且超出训练范围后模型输出会趋于静态重复。现有方法要么成本过高（如需要重新训练），要么无法以可扩展的方式同时满足性能和高质量目标。

Result: 在Wan 2.1 1.3B模型上，LVSA在6倍训练长度下将计算量减少至多3.17倍；在Wan 2.1 14B模型上减少2.98倍；在HunyuanVideo 1.5模型上减少3.33倍。与RIFLEx和UltraViCo相比，LVSA分别实现了高达2.41倍和3.27倍的加速。此外，LVSA使HunyuanVideo 1.5能够在单GPU上生成2倍长度的视频，否则会内存不足。在NPU平台上也实现了显著的加速。

Insight: 主要创新点是提出了一种无需训练、模型无关的块稀疏注意力机制，结合了结构化窗口和旋转全局锚点，以消除导致长程时序伪影的固定网格偏差。同时，论文引入了VQeval评估工具，以更公平地评估视频质量，特别是针对循环视频故障。该方法在保持训练长度视频质量的同时，在扩展长度上还能提升质量。

Abstract: Dense self-attention is the compute and quality bottleneck of long-video diffusion inference: cost grows quadratically with the sequence length, and beyond the training horizon the model converges to near-static output, that is, “frozen” repetitive video. State of the art approaches are either too costly, e.g., they require retraining, or fail to satisfy both performance and quality objectives in a scalable manner. To this end, we introduce Long Video Sparse Attention (LVSA), a training-free model-agnostic block-sparse attention for video diffusion transformers that combines a structured window pattern with rotating global anchors, thus removing the fixed-grid bias which causes long-range temporal artifacts. LVSA, combined with a FlashInfer kernel, reduces compute up to 3.17x on Wan 2.1 1.3B at a 6x horizon, 2.98x on Wan 2.1 14B at a 6x horizon, and 3.33x on HunyuanVideo 1.5 at a 1.5x horizon, compared to dense attention. Beyond reducing compute, LVSA enables HunyuanVideo 1.5 generation at a 2x horizon, which is otherwise out-of-memory on a single GPU. Moreover, LVSA provides speedups up to 2.41x compared to RIFLEx and 3.27x compared to UltraViCo on Wan 2.1 1.3B. To demonstrate applicability across diverse platforms, we apply LVSA on NPUs and achieve speedups up to 2.71x on Wan 2.2 A14B and 3.24x on Wan 2.1 1.3B compared to dense attention. To evaluate quality in a fair way, we introduce VQeval, a tool properly scoring loopy video failures, which instead are rewarded in state of the art evaluators like VBench-Long. LVSA is quality-neutral for generation at training horizon length and quality-positive at extended lengths.

Md Aminur Hossain, Ayush V. Patel, Sanjay K. Singh, Biplab Banerjee

TL;DR: 本文提出了HQ-JEPA，一种用于跨模态遥感表示学习的混合量子-经典联合嵌入预测架构。该框架通过从可见上下文区域预测掩码目标表示，并在共享嵌入空间中对齐异构模态特征，将JEPA风格的掩码潜在预测扩展到配对的Sentinel-1和Sentinel-2图像。为了提升表示质量，它结合了四个互补目标：潜在令牌预测、跨模态令牌对齐、融合潜在空间中的SIGReg高斯正则化，以及基于可微分SWAP测试的保真度量子相似性损失。

Details

Motivation: 解决在遥感领域中，如何有效学习来自不同传感器（如Sentinel-1雷达图像和Sentinel-2光学图像）的跨模态数据的统一语义表示问题，并探索将量子计算概念整合到表示学习中以提升性能。

Result: 在GeoBench分类和分割任务上，通过线性探测和微调进行评估。结果表明，HQ-JEPA相比强大的自监督和遥感基础模型基线，取得了有竞争力且通常更优的性能。

Insight: 主要创新点在于将JEPA架构扩展到跨模态遥感数据，并创新性地整合了量子相似性（FQS损失）作为正则化信号。其核心洞察是结合预测性自监督、跨模态几何正则化和基于量子保真度的表示学习，以学习更高质量的语义表示，而非依赖像素重建。

Abstract: We introduce HQ-JEPA, a hybrid quantum-classical joint-embedding predictive architecture for cross-modal remote sensing representation learning. The proposed framework extends JEPA-style masked latent prediction to paired Sentinel-1 and Sentinel-2 imagery by predicting masked target representations from visible context regions while aligning heterogeneous modality features in a shared embedding space. To improve representation quality, HQ-JEPA combines four complementary objectives: latent token prediction, cross-modal token alignment, SIGReg-based Gaussian regularization in the fused latent space, and a differentiable SWAP-test-based Fidelity Quantum Similarity (FQS) loss. Unlike pixel reconstruction methods, HQ-JEPA learns semantic representations directly in latent space and uses quantum state-overlap-based similarity as an additional regularization signal. We evaluate the pretrained encoder on GeoBench classification and segmentation tasks under linear probing and fine-tuning settings. Results show that HQ-JEPA achieves competitive and often superior performance over strong self-supervised and remote sensing foundation-model baselines, demonstrating the benefit of integrating predictive self-supervision, cross-modal geometric regularization, and quantum fidelity-based representation learning for remote sensing applications.

[95] Towards Effective Long-Video Event Prediction via Multi-Level Event Semantics Mining cs.CV | cs.CLPDF

Bo Peng, YuanJie Lyu, PengGang Qin, Tong Xu

TL;DR: 本文提出了一种名为VISTA的多层次事件语义挖掘框架，用于长视频事件预测。该框架通过角色中心的视觉提示提取事件相关的视觉细节，并采用知识增强的迭代检索策略构建逻辑连贯的事件链，最后通过类人的提议-检索策略整合多层次线索以生成未来事件预测。

Details

Motivation: 现有研究主要关注文本或短视频的事件预测，而长视频因多模态上下文复杂、叙事结构丰富，其事件预测研究不足；同时，现有的长视频语言模型在问答和摘要任务上表现良好，但难以泛化到事件预测任务，因为它们无法精确提取事件细节并进行细粒度的事件发展分析。

Result: 在真实世界数据集上的大量实验验证了VISTA在长视频事件预测中的有效性，但摘要中未提及具体基准或定量结果（如SOTA水平）。

Insight: 创新点包括：角色中心的视觉提示以增强细节级语义，知识增强的迭代检索策略以构建事件级叙事，以及类人的提议-检索策略以整合多层次线索生成鲁棒预测；从客观角度看，该框架将视觉细节提取、事件链构建和未来提议生成有机结合，为长视频复杂叙事理解提供了新思路。

Abstract: Accurately predicting future events is fundamental to content understanding and decision-making across various domains. While prior research has primarily focused on text or short-video scenarios, long-video event prediction, characterized by vast multimodal context and more complex narratives, remains underexplored. Meanwhile, although recent Long-Video Language Models (LVLMs), built on Large Language Models (LLMs) and Vision-Language Models (VLMs), have shown promise in long-video question answering and summarization, they struggle to generalize to event prediction, as they can neither precisely extract event-related details nor perform fine-grained analysis of event development. To address this gap, we propose VISTA, a multi-level event semantics mining framework for long-video event prediction. Initially, VISTA applies a character-centric visual prompt to precisely extract event-related visual details, enhancing detail-level semantics; subsequently, it employs a knowledge-enhanced iterative retrieval strategy, guiding the LLM to progressively construct logically coherent event chains, thereby improving event-level narratives; ultimately, VISTA adopts a human-like propose-then-retrieve strategy to generate diverse future-oriented proposals and integrate multi-level clues, producing robust and accurate predictions. Extensive experiments on real-world datasets validate the effectiveness of VISTA for long-video event prediction.

[96] Task-Focused Memorization for Multimodal Agents cs.CVPDF

Tao Zou, Yichen He, Tian Qiu, Yuan Lin, Hang Li

TL;DR: 本文提出TaskMem，一种基于强化学习的任务聚焦记忆策略学习框架，用于解决多模态智能体在持续感知环境中‘记忆什么’的关键挑战。该方法通过两阶段训练（学习如何记忆和根据任务需求调整记忆内容），在流式基准测试中显著提升了基于记忆的视觉问答准确率。

Details

Motivation: 多模态智能体（如具身智能体）在环境中持续接收海量多模态观测信息，核心挑战在于如何从信息爆炸中选择性地记忆与自身角色和未来任务相关的内容，而不仅仅是设计记忆模块或保证基本准确性。

Result: 在VideoMME、EgoLife和EgoTempo重构的流式基准测试上，基于Qwen3-VL-30B-A3B构建的TaskMem将视觉问答准确率分别提升了6.3%、7.0%和5.3%，这些任务要求智能体仅凭记忆回答，无法访问原始视频。

Insight: 创新点在于将记忆生成形式化为可学习的记忆策略，并通过部署后基于近期环境任务定义奖励模型来微调适配器，使策略能动态聚焦于任务相关内容，实现了从‘如何记忆’到‘记忆什么’的范式转变。

Abstract: Long-term memory is essential for multimodal agents to build coherent experience, accumulate world knowledge, and achieve continual learning. However, constructing effective memory goes beyond memory module design and basic requirements such as accuracy and fidelity; the key challenge lies in determining what to memorize. Multimodal agents, such as embodied agents, continuously perceive, reason, and act in real or virtual environments, receiving an unbounded stream of multimodal observations. From this combinatorial explosion of information, an agent must selectively retain content that is relevant to its role in the environment and valuable for future tasks. To bridge this gap, we frame memory generation as a learnable memorization policy and introduce TaskMem (Task-focused Memorization Policy Learning), a reinforcement-learning-based framework that enables the policy to dynamically adjust its focus to the demands of real tasks encountered in the environment. TaskMem adopts a two-phase training paradigm: Phase One learns how to memorize by optimizing memory quality under fundamental fidelity requirements; Phase Two occurs after deployment, where the agent learns what to memorize by tuning an adapter on its base MLLM, using recent environment tasks to define a reward model that guides the memorization policy toward task-relevant content. To evaluate our approach, we reformulate VideoMME, EgoLife, and EgoTempo into streaming benchmarks that simulate a realistic setting in which an agent processes streaming observations and handles tasks arriving online. To isolate memory assessment, the questions must be answered using only the agent’s memory, without access to raw video. Built on Qwen3-VL-30B-A3B, TaskMem improves VQA accuracy by 6.3%, 7.0%, and 5.3% on these benchmarks, respectively.

Jiayi Zhu, Fuxiang Huang, Yu Xie, Xi Wang, Zhixuan Chen

TL;DR: 本文提出了一种名为MammoRG的乳腺X光检查报告生成框架，旨在模拟放射科医生的临床报告工作流程。该框架采用两阶段训练策略，首先通过分类监督整合患者的四视图乳腺X光片中的临床先验知识，然后引入术语感知的监督微调策略，将乳腺X光特定的临床术语建模为原子语义单元，以生成具有更高临床一致性的高质量报告。此外，还开发了MammoRGTool工具来解析生成的自由文本报告，提取结构化临床信息以进行临床效能评估。

Details

Motivation: 现有自动化乳腺X光报告生成方法主要关注直接的视觉到文本映射，忽略了放射科医生在真实实践中遵循的结构化临床推理过程，导致报告缺乏临床一致性。本文旨在通过模拟临床报告工作流程，整合先验临床知识来解决这一问题。

Result: 在多个临床效能指标上，MammoRG均优于现有方法，特别是在诊断相关的BI-RADS F1分数上，在内部、外部1、外部2以及VinDr-Mammo数据集上分别比次优模型高出2.73%、2.04%、1.90%和3.27%，达到了SOTA水平。

Insight: 创新点在于明确遵循BI-RADS指南并整合先验临床知识来模拟临床工作流程，以及采用两阶段训练（分类监督整合知识 + 术语感知微调）来提升报告的临床一致性。从客观角度看，将临床术语建模为原子语义单元和开发专用报告解析工具（MammoRGTool）以进行结构化评估，是提升模型临床实用性的关键设计。

Abstract: Breast cancer is a major global health concern, and mammography screening plays a central role in early detection. The large volume of screening examinations creates a substantial workload for radiologists, making accurate and consistent report generation a critical clinical challenge. Existing automated mammography report generation methods primarily focus on direct visual-to-text mapping, while overlooking the structured clinical reasoning process followed by radiologists in real-world practice. To address this limitation, we propose MammoRG, a mammography report generation framework that explicitly simulates the clinical reporting workflow by following the BI-RADS guideline and incorporating prior clinical knowledge to produce diagnostic reports. Specifically, MammoRG adopts a two-stage training framework. In the first stage, the model learns to integrate clinically relevant prior knowledge from a patient’s four-view mammograms through classification-based supervision. In the second stage, a terminology-aware supervised fine-tuning strategy is introduced to model mammography-specific clinical terms as atomic semantic units, enabling the generation of high-quality reports with improved clinical consistency. To facilitate clinical efficacy evaluation of generated reports, we further develop MammoRGTool, a dedicated mammography report parsing tool that extracts structured clinical information from free-text reports. Extensive experiments demonstrate that MammoRG consistently outperforms existing methods across multiple clinical efficacy metrics, particularly in diagnosis-related BI-RADS F1, where it surpasses the second-best model by 2.73%, 2.04%, 1.90%, and 3.27% on the internal, external 1, external 2, and VinDr-Mammo datasets, respectively.

[98] iVGR: Internalizing Visually Grounded Reasoning for MLLMs with Reinforcement Learning cs.CVPDF

Chang-Bin Zhang, Yujie Zhong, Qiang Zhang, Kai Han

TL;DR: 本文提出iVGR框架，通过强化学习将视觉定位能力内化到文本推理链中，以解决显式视觉定位推理在推理阶段可能损害多模态大语言模型性能的问题。该方法采用双流训练策略，通过一致性奖励对齐文本流与高质量视觉定位流，使模型在推理时无需显式视觉定位即可实现准确感知。

Details

Motivation: 研究发现，在推理阶段强制使用显式物体框的视觉定位推理链（visually grounded CoT）相比标准文本推理链（textual CoT）反而会降低性能，作者假设视觉定位能力可被内化，而强制显式定位会干扰模型的核心答案预测目标。

Result: 大量实验表明，该方法在细粒度感知基准测试上显著优于现有基线，同时保持了支持工具辅助推理工作流程的灵活性。

Insight: 创新点在于提出了一种通过强化学习将视觉定位能力隐式整合到文本推理过程中的框架，避免了显式视觉定位带来的干扰，实现了感知能力的内化与推理效率的提升。

Abstract: While visually grounded Chain-of-Thought (CoT) has emerged as a promising paradigm to enhance fine-grained perception in multimodal large language models (MLLMs), its efficacy during the inference phase remains underexplored. In this work, we empirically find that mandating explicit object boxes in visually grounded CoT during inference often degrades performance compared to standard textual CoT, which reasons without explicit visual grounding. We hypothesize that the visual localization capability can be internalized into the textual CoT and that the mandatory explicit grounding introduces unnecessary interference with the model’s primary objective of answer prediction. To address this problem, we propose Internalizing Visually Grounded Reasoning (\textbf{iVGR}), a novel reinforcement learning framework that transfers localization capabilities into the textual reasoning process. We employ a dual-stream training strategy, where a textual stream is aligned with a high-quality visually grounded stream via a proposed consistency reward, enabling the model to localize accurately without explicit grounding during inference. Extensive experiments demonstrate that our method significantly outperforms existing baselines on fine-grained benchmarks, while maintaining the flexibility to support tool-assisted inference workflows.

[99] Remembering by Reconstructing: Domain Incremental Learning With Test-Time Training on Video Streams cs.CV | cs.LGPDF

Jonathan Swinnen, Tinne Tuytelaars

TL;DR: 本文提出了一种新颖的领域增量学习方法，用于适应随时间演化的非平稳数据。该方法结合了主任务头和一个自监督的掩码自编码器（MAE）头，在增量训练中学习领域特定的LoRA适配器。在推理时，通过对MAE头进行在线测试时训练，以识别与当前输入最匹配的LoRA适配器，从而使模型能够’重新记住’相应的领域。

Details

Motivation: 旨在解决模型在适应不断变化的现实世界流数据（如视频）时面临的领域增量学习问题，其核心动机不是避免灾难性遗忘，而是利用它。

Result: 在领域增量动作识别和语义分割任务上进行了演示，结果表明该方法特别适用于样本高度相关且领域转移渐进的视频流数据。

Insight: 创新点在于将灾难性遗忘视为一种特性而非缺陷，通过结合自监督MAE和领域特定LoRA适配器，并引入在线测试时训练进行领域识别，实现了对渐进领域漂移的有效适应。

Abstract: In this work we introduce a novel approach to domain incremental learning, adapting models over time to evolving, non-stationary data. In contrast to other works, we do not attempt to avoid catastrophic forgetting, but rather allow it and exploit it. Our model combines a main task head with a self-supervised masked autoencoder (MAE) head. We then learn domain-specific LoRA adapters during incremental training. Each adapter specializes to its domain, naturally inducing forgetting on other domains in both heads. At inference, we perform online test-time training on the self-supervised MAE head to identify which LoRAs best matches the current input, so the model can `remember’ the domain again. Our scheme is especially well-suited to real-world streaming data, such as video, where consecutive samples are highly correlated and domain shifts are gradual. We demonstrate our method on domain-incremental action recognition and semantic segmentation tasks.

[100] Polyphony: Diffusion-based Dual-Hand Action Segmentation with Alternating Vision Transformer and Semantic Conditioning cs.CVPDF

Hao Zheng, Hu Wang, Tiantian Zheng, Prajjwal Bhattarai, Tuka Alhanai

TL;DR: 本文提出了Polyphony，一种用于双人手部动作分割的三阶段方法，通过交替训练的双手视觉Transformer、语义特征条件化以及基于扩散的分割模型，解决了双手动作分割中的依赖关系、视觉不对称、梯度主导和语义模糊等挑战。

Details

Motivation: 双人手部动作分割在理解复杂双手活动时至关重要，但面临双手间复杂依赖、视觉不对称、优势手梯度主导以及细粒度动作语义模糊等独特挑战。

Result: Polyphony在双人手部数据集（HA-ViD, ATTACH）上达到了最先进的性能，提升高达16.8个百分点，在单流Breakfast数据集上达到82.5%，超越了使用12倍大骨干网络的先前最佳方法。

Insight: 创新点包括交替训练的双手视觉Transformer确保梯度平衡、语义特征条件化增强动作区分度，以及扩散模型结合跨手特征融合和自适应损失加权。统一共享骨干模型超越了需要独立每手模型的基线。

Abstract: Dual-hand action segmentation, densely predicting actions for both hands from untrimmed videos, is essential for understanding complex bimanual activities. However, it poses several unique challenges: complex inter-hand dependencies, visual asymmetry between hands, representation conflicts where the dominant hand monopolizes gradients, and semantic ambiguity in fine-grained actions. We propose Polyphony, a three-stage method to address these challenges through: (1) an Alternating Dual-Hand Vision Transformer that alternates training between left- and right-hand mini-batches to ensure balanced gradient contributions from both hands while sharing a spatio-temporal encoder; (2) Semantic Feature Conditioning that aligns visual features with structured, compositional action descriptions to enhance discrimination of semantically similar actions; and (3) Diffusion-Based Segmentation with cross-hand feature fusion for inter-hand coordination and adaptive loss weighting for balancing performance. Polyphony achieves state-of-the-art on both dual-hand datasets (HA-ViD, ATTACH) with improvements up to 16.8 points, and on the single-stream Breakfast dataset (82.5%), outperforming the prior best method that uses a 12x larger backbone. Notably, our unified model with a single shared backbone surpasses baselines requiring separate per-hand models. Code is at https://github.com/x-labs-xyz/Polyphony-Dual-hand-Action-Segmentation.

[101] NTR: Neural Token Reconstruction for Scene Token Bottleneck in End-to-End Driving cs.CV | cs.ROPDF

Jiahui Li, Jiawei Sun, Zixiang Ren, Ming Liu, Jiamin Shi

TL;DR: 本文提出了一种名为神经令牌重建（NTR）的表示学习框架，用于解决感知无关端到端自动驾驶中场景令牌瓶颈的监督不足问题。该方法通过自蒸馏掩码潜在重建目标，仅使用紧凑的场景令牌作为重建记忆来重建掩码的图像块级潜在特征，从而迫使重建梯度仅通过场景令牌瓶颈传递，以增强其视觉表示能力。

Details

Motivation: 现有感知无关端到端自动驾驶方法将密集图像块令牌压缩为紧凑的场景令牌用于轨迹规划，但这些场景令牌仅受规划目标监督，对编码的视觉信息约束有限，可能导致信息冗余或丢失。

Result: NTR在三个公开自动驾驶基准测试中达到了最先进的性能，包括Waymo E2E上的8.0461 RFS分数，以及NavSim1&2上的94.1 PDMS和90.9 EPDMS分数。学习的场景令牌表现出更低的成对冗余和更高的有效秩。

Insight: 创新点在于引入了自蒸馏掩码潜在重建目标来直接约束场景令牌瓶颈，并利用基础模型提供的语义先验作为弱语义接口，在不引入显式感知头的情况下偏向于驾驶相关结构。该方法在推理时可移除所有辅助重建组件，保持规划器部署不变，实现了有效的瓶颈监督以改善紧凑视觉表示学习和规划性能。

Abstract: Recent perception-free end-to-end (E2E) autonomous driving methods bypass explicit perception outputs by compressing dense image patch tokens into compact scene tokens for downstream trajectory generation and scoring. While these scene tokens form a compact visual bottleneck for the planner, they receive supervision solely from the planning objective, providing limited constraints on the encoded visual information. To address this limitation, we introduce Neural Token Reconstruction (NTR), a representation learning framework to directly constrain the compact scene-token bottleneck in perception-free driving. NTR introduces a self-distillation masked latent reconstruction objective that reconstructs masked patch-level latent features using only compact scene tokens as reconstruction memory. This forces reconstruction gradients to pass exclusively through the scene-token bottleneck, encouraging scene tokens to preserve richer and less redundant visual representations for planning. We further introduce semantic priors derived from foundation-model annotations as a weak semantic interface biasing reconstruction targets toward driving-related structures without introducing explicit perception heads. All auxiliary reconstruction components are removed at inference time, leaving the deployed planner unchanged. NTR achieves state-of-the-art performance on three public autonomous driving benchmarks, including 8.0461 RFS on Waymo E2E and 94.1 PDMS / 90.9 EPDMS on NavSim1&2. The learned scene tokens exhibit lower pairwise redundancy and higher effective rank, indicating that effective bottleneck supervision improves both compact visual representation learning and planning performance.

[102] PolSAR Image Classification using a Hybrid Complex-Valued Network (HybridCVNet) cs.CVPDF

Mohammed Q. Alkhatib

TL;DR: 这篇论文提出了一种名为HybridCVNet的新型混合网络，用于极化合成孔径雷达（PolSAR）图像分类。该网络结合了复数卷积神经网络（CV-CNN）和复数视觉变换器（CV-ViT）技术，通过融合复数3D和2D CNN作为特征提取器，有效利用了PolSAR数据中的互补信息和内部依赖关系，从而提升了分类性能。

Details

Motivation: 传统实值网络在处理如PolSAR数据这样的复数数据时，常常忽略了重要的相位信息。为了充分利用复数数据的全部信息，需要开发新的复数深度学习架构。

Result: 在广泛使用的PolSAR数据集上的实验结果表明，HybridCVNet优于其他方法。在Flevoland数据集上达到了97.39%的总体准确率，在San Francisco数据集上，即使仅使用1%的采样率，也获得了0.972的Kappa值，显示出优越的性能。

Insight: 论文的主要创新点是提出了一种混合复数网络架构，将CV-CNN和CV-ViT的优势相结合。从客观角度看，其核心创新在于设计了一种有效融合复数3D和2D CNN特征提取器的机制，以捕获PolSAR数据中不同维度的互补信息，并利用变换器结构建模数据内部的依赖关系，从而更全面地利用复数域信息。

Abstract: Recently, convolutional neural networks (CNNs) have become popular for image classification due to their effectiveness in computer vision tasks. Now, researchers are exploring the potential of vision transformers (ViTs) in remote sensing and Earth observation. However, traditional Real-Valued networks often overlook important phase information in Complex-Valued (CV) data like polarimetric synthetic aperture radar (PolSAR) data. To address this, new CV deep architectures have emerged. HybridCVNet, a novel hybrid network, blends CV-CNN and CV vision transformer (CV-ViT) techniques. It efficiently combines CV 3D and 2D CNNs as feature extractors, enhancing PolSAR image classification by extracting complementary information and effectively leveraging interdependencies within the data. Experimental results from widely-used PolSAR datasets show HybridCVNet outperforms other methods, achieving an overall accuracy of 97.39% on the Flevoland dataset and showing promise even with just a 1% sampling ratio, with a Kappa value of 0.972 on the San Francisco dataset. Source code is accessible through https://github.com/mqalkhatib/HybridCVNet

[103] QVGGT: Post-Training Quantized Visual Geometry Grounded Transformer cs.CVPDF

Zhizhen Pan, Hesong Wang, Huan Wang

TL;DR: 本文提出了QVGGT，一种针对Visual Geometry Grounded Transformer (VGGT)模型的定制化量化框架。VGGT是一个用于从单张图像直接估计相机参数、深度图和点云的12亿参数大模型，但其规模限制了在资源受限设备上的部署。QVGGT通过分析Transformer块对量化的异质性敏感度，设计了选择性混合精度策略、针对高方差相机和寄存器令牌的过滤与补偿机制，以及任务感知的尺度搜索方法，成功实现了近乎无损的W4A16量化。

Details

Motivation: VGGT模型虽然能单次前向传播完成多种3D属性估计，但其12亿参数的巨大规模使其难以部署在无人机、移动AR等资源受限的边缘设备上。因此，需要一种高效的模型压缩方法来减少其内存占用和计算开销，同时尽可能保持其高精度的3D感知能力。

Result: 在多个几何感知基准测试上的广泛实验表明，QVGGT实现了近乎无损的W4A16（权重4位，激活16位）量化，成功保留了所有3D预测头（相机姿态、深度图、点云图）的精度。与FP32精度相比，该方法实现了3~4.9倍的内存减少，并在真实硬件上获得了高达2.8倍的加速。

Insight: 创新点在于：1) 针对VGGT中Transformer块对量化敏感度不均的特性，提出了基于块级敏感度分析的选择性混合精度分配策略；2) 提出了令牌过滤与相机信息补偿机制，以解决高方差相机/寄存器令牌放大量化误差的问题；3) 设计了任务感知的量化尺度搜索机制，该机制不仅评估层重建误差，还通过多头监督和跨头几何一致性（相机姿态、深度图、点云图之间）来评估候选量化尺度，确保了量化后模型在具体下游任务上的性能。

Abstract: Estimating 3D attributes directly from images has advanced rapidly with the Visual Geometry Grounded Transformer (VGGT), which predicts camera parameters, depth maps, and point clouds in a single forward pass. However, its 1.2B-parameter scale severely limits deployment on resource-constrained platforms such as UAVs and mobile AR devices. To address this limitation, we introduce QVGGT, a tailored quantization framework designed to compress VGGT. Our approach starts from the observation that transformer blocks within VGGT exhibit heterogeneous sensitivity to quantization. We thus analyze per-block quantization sensitivity and propose a selective mixed-precision strategy that allocates higher precision to the most fragile transformer blocks. To address the amplification of quantization error caused by high-variance camera and register tokens, we further introduce token filtering with camera information compensation, which removes these outliers from activation calibration and restores their geometric cues using a PCA-derived global compensation token. Finally, we develop a task-aware scale search mechanism that evaluates candidate quantization scales not only through layer reconstruction but also through multi-head supervision and cross-head geometric consistency among camera poses, depth maps, and point maps. Extensive experiments on multiple geometry perception benchmarks demonstrate that QVGGT achieves near-lossless W4A16 quantization, preserving the accuracy of all 3D prediction heads while delivering 3$\sim$4.9$\times$ memory reduction and up to 2.8$\times$ real hardware speedup over FP32. Our approach makes high-fidelity 3D perception feasible on edge devices, enabling practical deployment of feed-forward 3D reconstruction models in real-world constrained environments.

[104] FOCUS: Forcing In-Context Object Localization through Visual Support Constraints and Policy Optimization cs.CV | cs.AI | cs.LGPDF

Mohammed Asad Karim, Vinay Kumar Verma

TL;DR: 本文提出了一种名为FOCUS的两阶段训练框架，用于解决上下文定位（ICL）问题，即在无需训练或参数更新的情况下，根据少量支持示例在查询图像中定位目标物体。该方法通过视觉支持约束和策略优化，强制模型关注视觉证据而非语义先验，实现了鲁棒的实例级定位。

Details

Motivation: 现有基于视觉语言模型（VLMs）的上下文定位方法依赖于显式的类别监督，这限制了其在现实场景（如未命名或实例特定物体）中的应用，并引入了导致预测偏向语义先验而非视觉证据的类别偏差。本文旨在实现无需类别监督、基于视觉对应的类别无关且视觉基础扎实的上下文定位。

Result: 实验表明，使用本文方法训练的7B参数模型在定位性能上超越了参数高达72B的模型，证明了上下文感知的定位目标可以超越单纯模型缩放的效果。全面的消融实验验证了每个组件的贡献。

Insight: 主要创新点在于：1）提出了一个两阶段训练框架，明确优化支持框与查询图像之间的上下文注意力，无需类别监督；2）引入基于Group Relative Policy Optimization（GRPO）的强化学习来直接最小化定位误差，从而强制视觉对应关系。这为解决类别无关的视觉基础定位问题提供了新思路。

Abstract: In-context localization (ICL) seeks to localize a target object specified by a small set of support examples in a query image, operating on the fly without training or parameter updates. Despite rapid advances in vision-language models (VLMs), achieving category-agnostic and visually grounded ICL remains an open problem, even though it is essential for applications such as image editing, personalized visual search, and retrieval. Existing methods are fragile and rely on explicit category supervision, which not only limits applicability in realistic settings with unnamed or instance-specific objects but also introduces category bias that steers predictions toward semantic priors rather than visual evidence. We introduce a two-stage training framework that explicitly optimizes in-context attention between support bounding boxes and query images without category supervision. We further refine localization via reinforcement learning using Group Relative Policy Optimization (GRPO) to directly minimize localization error. This formulation enforces visual correspondence over semantic priors, yielding robust instance-level localization. Empirically, a 7B-parameter model trained with our objectives outperforms models up to 72B parameters, demonstrating that context-aware localization objectives can surpass scaling alone. Comprehensive ablations validate the contribution of each component.

[105] SpatialAct: Probing Spatial Reasoning-to-Action Capabilities of VLM Agents in 3D Scenes cs.CV | cs.AI | cs.CLPDF

Tianhui Liu, Jie Feng, Zhiheng Zheng, Shengyuan Wang, Yiming Guo

TL;DR: 该论文提出了SpatialAct基准，用于评估视觉语言模型在3D场景中基于空间推理执行动作的能力。研究发现，尽管现有模型在孤立的空间推理任务上表现良好，但在多轮交互反馈中难以保持连贯的空间信念并产生可靠动作，与人类表现存在显著差距。

Details

Motivation: 研究旨在探究视觉语言模型是否能在3D环境中构建连贯的空间理解、据此执行动作，并通过多轮反馈优化动作，以弥补当前模型在动作条件化空间推理能力评估上的空白。

Result: 实验表明，当前视觉语言模型在多轮交互精炼设置中表现不佳，显著落后于人类水平，突显了推理与动作执行之间的鸿沟。

Insight: 创新点在于设计了包含多轮交互精炼及其分解版本（单步错误检测与修复）的基准，揭示了模型在动作引发的环境变化下缺乏鲁棒的空间状态跟踪能力，即使底层控制被抽象化后问题依然存在。

Abstract: Humans can effortlessly perceive spatial layouts, form cognitive representations, reason about spatial relations, and translate such reasoning into actions in everyday 3D environments. Although recent vision-language models (VLMs) have shown promising performance on observation-conditioned spatial perception and reasoning tasks, it remains unclear whether they can build coherent spatial understanding, act upon it, and refine their actions through multi-turn feedback. To study this problem, we introduce \textbf{SpatialAct}, a simulator-grounded benchmark for probing \textit{action-conditioned spatial reasoning} in 3D scenes. Starting from the most challenging setting, Multi-turn Interactive Refinement, we further design its decomposed counterpart, Single-step Error Detection and Fix, together with five fundamental spatial ability tasks to diagnose the underlying causes of model failures. Experiments reveal a clear reasoning-to-action gap: current VLMs can perform well on isolated spatial reasoning tasks, but struggle to maintain coherent spatial beliefs and produce reliable actions during multi-turn feedback, substantially underperforming humans. These results suggest that current VLM agents still lack robust spatial state tracking under action-induced environment changes, even when low-level control is abstracted away.

[106] Light Interaction: Training-Free Inference Acceleration for Interactive Video World Models cs.CV | cs.LGPDF

Jiacheng Lu, Haoyi Zhu, Sipei Yi, Enze Xie, Yu Li

TL;DR: 本文提出了一种名为Light Interaction的训练无关推理加速框架，用于交互式视频世界模型。该框架通过自适应上下文管理、去噪缓存加速以及软硬件协同设计的3D块稀疏注意力机制，显著降低了模型在生成长交互轨迹时的计算开销。

Details

Motivation: 交互式视频世界模型在响应相机运动时逐块生成视频，但其扩展至长交互轨迹的成本极高，主要受限于不断增长的上下文内存、二次注意力复杂度和重复的去噪步骤。

Result: 在HY-WorldPlay和Matrix-Game-3.0基准测试上，Light Interaction实现了高达2.59倍的加速，同时保持了有竞争力的视觉质量，且无需模型重新训练。

Insight: 核心创新在于利用交互特性实现轨迹相关的自适应计算，包括丢弃探索新区域时的检索空间记忆、根据局部潜在动态调整时间上下文，以及在相机重访熟悉区域时重用早期模型输出。从客观角度看，其将自适应策略与高效的稀疏注意力实现相结合，为交互式生成模型的推理优化提供了系统性的解决方案。

Abstract: Interactive video world models generate video chunk by chunk in response to user-controlled camera movements, enabling applications such as real-time game simulation, virtual scene navigation, and embodied AI training. However, scaling to long interactive trajectories is prohibitively expensive due to growing context memory, quadratic attention complexity, and repeated denoising steps. We present Light Interaction, a training-free inference acceleration framework for interactive video world models. Our key insight is that interaction naturally enables trajectory-dependent adaptive computation: retrieved spatial memory can be discarded during novel exploration, temporal context can be adjusted according to local latent dynamics, and early-step model outputs can be reused when the camera revisits familiar regions. Based on this insight, Light Interaction combines adaptive context management, denoising cache acceleration, and hardware-software co-designed 3D block sparse attention with fused Triton kernels. Evaluated on HY-WorldPlay and Matrix-Game-3.0, Light Interaction achieves up to 2.59x speedup without model retraining while maintaining competitive visual quality.

[107] Detect in Any Scene: An Agentic Framework for Object Detection with Experience-Aware Reasoning cs.CV | cs.LGPDF

Wenlun Zhang, Jun Yin, Kentaro Yoshioka

TL;DR: 本文提出了DetAS，一种将目标检测视为动态决策过程的智能体框架，以解决现实场景中图像退化多样和物体分布异构导致的泛化难题。该框架利用多模态大语言模型作为中央智能体，自适应地组合图像恢复模块和领域专家检测器的工作流。进一步引入自我进化经验收集机制，升级为DetAS-X，通过积累节点级决策经验实现经验感知推理，从而在复杂动态环境中提升检测性能。

Details

Motivation: 现实世界目标检测面临图像退化多样和物体分布异构的挑战，现有检测器泛化能力受限。传统基于预定义条件的场景特定表示学习和端到端流水线方法缺乏对动态环境的适应性。

Result: 在六个具有挑战性的基准测试上进行广泛实验，DetAS-X显著优于现有的基于MLLM的检测器，F1分数平均提升28.36%，在DarkFace数据集上最高提升达37.01%。

Insight: 核心创新在于将目标检测重构为由MLLM智能体驱动的动态决策过程，并设计了自我进化经验收集机制，使系统能够通过积累的节点级经验进行推理，逐步优化决策策略以适应多样化的真实场景。

Abstract: Object detection in real-world scenarios remains challenging due to diverse image degradations and heterogeneous object distributions, which significantly hinder the generalization of existing detectors. Conventional approaches, including scene-specific representation learning and end-to-end pipeline design, are inherently limited by their reliance on predefined conditions and lack adaptability to dynamic environments. In this paper, we propose DetAS, an agentic detection framework that formulates object detection as a dynamic decision process. Instead of relying on static pipelines, DetAS leverages a Multimodal Large Language Model (MLLM) as a central agent to adaptively compose detection workflows by selecting from a toolbox of restoration modules and specialized detectors. Specifically, DetAS consists of two key components: Self-Adaptive Image Restoration, which dynamically determines whether and how to enhance images for downstream detection, and Multi-Expertise Detection, which integrates multiple domain-specialized detectors and resolves their predictions through instance-level reasoning. To further improve decision quality under fine-grained conditions, we introduce Self-Evolving Experience Harvesting and extend the framework to DetAS-X, which accumulates node-level decision experience from a small set of annotated data and enables experience-aware reasoning during inference. This mechanism allows the system to progressively refine its decision policy and adapt to diverse real-world scenarios. Extensive experiments on six challenging benchmarks demonstrate that DetAS-X significantly outperforms existing MLLM-based detectors, achieving an average improvement of 28.36% in F1 score, with up to 37.01% gain on DarkFace. These results demonstrate the promise of agentic detection and establish a solid foundation for its application in complex and dynamic environments.

[108] Vanilla ViT for Automotive Point Cloud Semantic Segmentation cs.CVPDF

Gilles Puy, Nermin Samet, Alexandre Boulch, Spyros Gidaris, Tuan-Hung VU

TL;DR: 本文提出VaViT方法，将非分层的Vanilla ViT应用于大规模自动驾驶激光雷达点云语义分割任务，通过精心设计的tokenizer、轻量级解码器和数据增强策略，在多个基准数据集上达到或超越了现有最先进方法的性能。

Details

Motivation: 当前点云语义分割的主流架构仍以U-Net为主，结合卷积与局部注意力机制，而本文旨在探索如何有效利用简单的Vanilla ViT架构来处理大规模自动驾驶点云场景。

Result: 在nuScenes、SemanticKITTI和Waymo Open Dataset等基准数据集上进行了广泛评估，VaViT方法匹配或超越了现有最先进方法的性能。

Insight: 创新点在于设计了专门的点云tokenizer、轻量级解码器以及针对性的数据增强策略，使得简单的Vanilla ViT架构能够有效处理大规模点云分割任务，保持了架构的简洁性同时达到高性能。

Abstract: Plain Transformers have become the de-facto architecture for processing text, audio, image, and video, offering a unified backbone for multimodal learning. However, state-of-the-art architectures for point cloud semantic segmentation remain dominated by U-Nets architectures where convolutions are interleaved with local or windowed attentions. In this work, we show how to effectively leverage vanilla, non-hierarchical ViTs for segmentation of large-scale automotive lidar scenes. We bridge the performance gap thanks to a carefully designed tokenizer, a lightweight decoder segmentation head, and tailored data augmentations. Our approach, VaViT for Vanilla ViT, matches or exceeds the performance of state-of-the-art methods while maintaining the simplicity of ViT architecture. We provide extensive evaluations on nuScenes, SemanticKITTI, and Waymo Open Dataset to validate the efficiency of our method. Code and models are available at https://github.com/valeoai/VaViT.

[109] From Local Geometry to Global Pseudo Labeling for Robust Positive Unlabeled Learning under Covariate Shift cs.CV | cs.LGPDF

Firas Gabetni, Alexandre Rocchi Henry, Nacim Belkhir, Ziyi Liu, Gianni Franchi

TL;DR: 本文提出了一种名为SPUNA的几何感知框架，用于在协变量偏移下进行鲁棒的正例无标签学习。该方法通过利用视觉特征的局部流形结构，逐步发现偏移数据，有效解决了协变量偏移检测问题。

Details

Motivation: 现有协变量偏移检测方法通常依赖全监督训练，需要原始和偏移分布下的标注样本，这在实践中往往不切实际。本文旨在探索使用正例无标签学习这一弱监督方式来解决协变量偏移检测问题。

Result: 大量实验表明，SPUNA在PU设置下达到了最先进的性能，并且显著匹配了全监督方法的性能。此外，该方法在不同类型的偏移下均能稳健迁移，展现出强大的泛化能力。

Insight: 创新点在于引入几何感知框架SPUNA，通过局部流形结构逐步发现偏移数据，克服了经典PU方法在协变量偏移下不稳定和对噪声敏感的挑战。从客观角度看，该方法将几何信息融入PU学习，为弱监督下的协变量偏移检测提供了新思路。

Abstract: Detecting covariate shift is critical for building reliable vision systems. While most prior work focuses on improving robustness to shift, explicitly detecting covariate shift remains underexplored. Existing approaches typically rely on fully supervised training, requiring labeled examples from both original and shifted distributions, which is often impractical. In this paper, we show that covariate shift detection can be effectively addressed with weaker supervision using Positive Unlabeled (PU) learning. However, under covariate shift, in distribution and shifted data overlap significantly, making classical PU methods unstable and sensitive to noise. To overcome this challenge, we introduce Spectral PU Neighborhood Annotation (SPUNA), a geometry aware framework that progressively discovers shifted data by leveraging the local manifold structure of visual features. Extensive experiments show that SPUNA achieves state of the art performance in PU settings and remarkably matches the performances of fully supervised methods. Moreover, our approach transfers robustly across different types of shifts, demonstrating strong generalization capabilities.

[110] The Regularizing Power of Language-Training Deepfake Detectors cs.CVPDF

Benedikt Hopf, Zongwei Wu, Radu Timofte

TL;DR: 本文提出一种利用语言作为正则化机制来提升深度伪造检测器泛化性和可解释性的方法。通过结合冻结的专家检测器和LoRA调优的多模态大语言模型编码器，采用两阶段训练策略：首先进行二元对齐以缓解数据集特定伪影的过拟合，然后通过强化学习鼓励模型在分类前生成描述性推理，从而优先使用高层鲁棒特征。该方法在基准数据集上大幅超越现有最优方法。

Details

Motivation: 解决深度伪造检测中因过度拟合低层领域特定伪影而导致的泛化性差问题，并利用多模态大语言模型的描述能力提升模型的可解释性。

Result: 在基准数据集上的大量实验表明，该方法显著优于当前最先进方法，实现了卓越的跨数据集性能提升。

Insight: 创新性地将语言作为正则化机制，通过“先解释后分类”的强化学习策略，迫使模型依赖高层可描述特征，从而同时提升泛化性和可解释性；采用两阶段课程训练有效结合了专家模型和MLLM的优势。

Abstract: Recently, thanks to the advent of Multimodal-LLMs, deepfake detectors are striving not only to be generalizable but also interpretable. We propose that these two challenges can effectively be tackled jointly, since describable artifacts typically generalize better, opening the possibility to use language as a regularization mechanism. Since deepfake detection generally suffers from overfitting to low-level domain-specific artifacts, our intuition is that an LLM that has been pretrained on language would prefer high-level artifacts that can be described better. This way, we can use high-level features where possible, while training the model to use low-level features where necessary. We utilize a dual-encoder architecture, pairing a frozen specialist detector with a LoRA-tuned MLLM encoder, and a two-stage training curriculum: first, a binary alignment phase demonstrates that the intrinsic capability of MLLMs can effectively combine features to mitigate overfitting to dataset-specific artifacts. To further bolster generalization and achieve interpretability, we employ a reinforcement learning stage that encourages the model to generate descriptive reasoning before classifying, using only binary labels. By rewarding this “explain-then-classify” behavior, we explicitly incentivize the model to prioritize high-level, robust features. Crucially, this process yields both interpretable descriptions and a further boost in cross-dataset performance, even when reasoning chains are omitted at inference. Extensive experiments on benchmark datasets validate our approach, outperforming state-of-the-art methods by a large margin.

[111] Probabilistic Precipitation Nowcasting with Rectified Flow Transformers cs.CVPDF

Johannes Schusterbauer, Jannik Wiese, Nick Stracke, Timy Phan, Björn Ommer

TL;DR: 本文提出了一种名为FREUD的概率降水临近预报模型，该模型基于整流流变换器，通过帧级编码和统一解码器高效压缩时空天气数据，并利用集成方法捕捉解码过程中的不确定性，在SEVIR基准测试中实现了最先进的性能。

Details

Motivation: 现有基于扩散模型的数据驱动天气临近预报方法依赖确定性压缩来降低高维数据复杂度，这限制了其在解码过程中捕捉不确定性的能力，尤其是在极端天气事件中。

Result: 在SEVIR基准测试中，FREUD实现了最先进的降水临近预报性能，并通过模型和测试时缩放进一步提升了性能。

Insight: 创新点包括帧级编码支持连续预报更新、统一视频解码器确保时间一致性，以及不确定性保持的第一阶段通过集成捕捉偶然不确定性，这特别适用于解码变异性高的极端天气事件。

Abstract: Accurate weather forecasts are essential across various domains and are safety-critical in extreme weather conditions. Compared to simulation-based forecasting, data-driven approaches show greater efficiency, enabling short-term, high-resolution nowcasting. In particular, diffusion models proved effective in weather nowcasting due to their strong probabilistic foundation. However, existing methods rely on deterministic compression to reduce the complexity of high-dimensional weather data, limiting their ability to capture uncertainty in the decoding process. In this work, we introduce $\textbf{FREUD}$, a $\textbf{Fr}$ame-wise $\textbf{E}$ncoder and $\textbf{U}$nited $\textbf{D}$ecoder model based on rectified flow transformers for efficient compression of spatio-temporal weather data. Frame-wise encoding enables continuous forecast updates, while the unified video decoder ensures temporal consistency. Our uncertainty-preserving first stage allows us to capture aleatoric uncertainty via ensembling, which is particularly beneficial for extreme weather events with high decoding variability. We achieve state-of-the-art performance in precipitation nowcasting with a compact latent-space rectified flow transformer on the SEVIR benchmark and show further performance gains by model and test-time scaling. Code available here: https://github.com/CompVis/weather-rf

[112] Probing Collision Grounding in Vision-Language Models for Safe Human-Robot Collaboration cs.CV | cs.AI | cs.CL | cs.ROPDF

Jun Wang, Xiaohao Xu, Xiaonan Huang

TL;DR: 本文提出了碰撞接地（collision grounding）的概念，即通过视觉观察绑定机器人几何、相机视角、场景布局、人体接近度和时序运动，以推断当前和即将发生的接触。作者为此构建了TouchSafeBench基准，用于评估视觉语言模型在安全人机协作中的碰撞接地能力，并发现现有模型性能远未达到可靠水平。

Details

Motivation: 安全的人机协作不仅需要视觉描述，还需要监控系统能够判断机器人是否安全分离、已发生碰撞或即将发生碰撞。现有视觉语言模型缺乏这种物理可问责性，因此需要专门的基准来评估和推动该能力的发展。

Result: 在TouchSafeBench基准（包含2940个模拟室内共存场景）上，对三个前沿或面向机器人的VLM和九种视觉表示进行评估。最佳模型的平均Macro-F1分数低于50%，显式深度信息未能自动转化为机器人-身体碰撞证据，且机器人-场景接触的识别比人-接触风险更难。

Insight: 论文的创新点在于明确定义了碰撞接地任务并创建了相应的物理仿真基准。核心洞察是视觉流畅性并不等同于物理可问责性，可靠的机器人安全监控需要能够显式绑定视角、机器人形态、度量几何和未来碰撞的表征。

Abstract: Safe human–robot collaboration requires more than visual description: a monitor must determine whether the robot body is safely separated, already colliding with the scene or a person, or about to collide. We call this capability collision grounding: binding visual observations to robot body geometry, camera viewpoint, scene layout, human proximity, and temporal motion in order to infer present and imminent contact. We introduce TouchSafeBench, a physics-grounded benchmark for evaluating collision grounding in vision-language models (VLMs). Built in Habitat~3.0, TouchSafeBench contains 2,940 simulated indoor co-presence episodes across social navigation and social rearrangement, with synchronized multi-view RGB-D observations, top-down trajectory maps, calibrated camera metadata, and simulator-derived contact labels. We study two deployment-facing tasks: classifying the current safety state and warning about imminent collision before contact. Across three frontier or robotics-oriented VLMs and nine visual representations, current models remain far from reliable: the best average Macro-F1 stays below 50%, explicit depth is not automatically transformed into robot-body collision evidence, and robot–scene contact is consistently harder than human-contact risk. TouchSafeBench reveals a central limitation of embodied VLMs: visual fluency does not imply physical accountability. Reliable robot safety monitors will need representations that explicitly bind viewpoint, robot morphology, metric geometry, and future collision. We will release the benchmark upon acceptance.

[113] HiERO-StepG @ Ego4D Step Grounding Challenge: hierarchical activity understanding enables zero-shot step grounding cs.CVPDF

Andrea Zenotto, Simone Alberto Peirone, Francesca Pistilli, Giuseppe Averta

TL;DR: 本文提出HiERO-StepG方法，用于解决程序性活动中的步骤定位问题。该方法基于弱监督表示学习框架HiERO，通过利用细粒度动作级旁白，在特征空间中映射功能相关的动作，从而无需特定任务的微调即可通过聚类检测步骤。在Ego4D步骤定位挑战中，该方法通过增强层次一致性、强制时间单调性和后处理来提升性能，实现了零样本的步骤定位。

Details

Motivation: 程序性活动（如烹饪或维修）具有明确的层次结构，传统步骤定位方法需要大量标注且扩展性差。本文动机是利用未标注的人类活动视频中反复出现的动作共现模式，自然涌现出层次结构，以降低对标注的依赖。

Result: 在Ego4D步骤定位挑战的全局排行榜上，HiERO-StepG在R@1（IoU=0.3）指标上达到56.27%，排名第二，且完全为零样本方法，无需特定程序的标注。

Insight: 创新点在于利用弱监督表示学习从细粒度动作旁白中学习功能相关的特征表示，通过聚类实现零样本步骤检测，并通过层次一致性约束和时间单调性增强来提升定位精度。这为减少标注依赖和泛化到新任务提供了新思路。

Abstract: Procedural activities follow well-defined structures: whether we consider a cooking recipe or a mechanic repairing a car, these activities naturally decompose in a hierarchy of steps and sub-steps. Traditional approaches for step grounding require extensive annotations and scale poorly. Instead, we argue that such hierarchical structure can emerge naturally from uncurated videos of human activities through recurring patterns of co-occurring actions and activities. Our approach builds on HiERO, a weakly-supervised representation learning approach that maps close in the feature space actions that are functionally related to each other, leveraging only fine-grained action-level narrations. In this feature space, procedure steps can be detected by a simple clustering, with no additional task-specific fine-tuning. For the Ego4D Step Grounding challenge, we augment this approach by ensuring fine and coarse level agreement in step assignments, enforcing strict temporal monotonicity of the grounded steps and post-processing the detected steps to reduce the impact of noisy predictions. We call this approach HiERO-StepG and it achieves 56.27 % on the R@1 (IoU = 0.3) metric on the global leaderboard at submission time, ranking second while being completely zero-shot and not requiring procedure-specific annotations. Project page: https://github.com/andreazenotto/HiERO-StepG.

[114] TALON: Token-Aligned Lightweight Adapters for 6-DoF Spacecraft Pose Estimation cs.CVPDF

Abid Ali, Arunkumar Rathinam, Djamila Aouada

TL;DR: 论文提出了TALON（Token-Aligned Lightweight Adapters for Orbital Navigation），一种用于单目6自由度航天器姿态估计的时空轻量适配器方法。该方法在冻结的ViT自注意力层前注入3D适配器，并结合补丁令牌对齐损失来几何约束特征，以利用图像序列中的时间信息，同时仅增加不到5%的参数。

Details

Motivation: 现有的单目6自由度航天器姿态估计方法主要处理单帧图像，忽略了航天器机动过程中图像序列的时间信息；而少数时序方法需要全骨干网络微调或辅助光流网络，分别存在灾难性遗忘或计算成本增加的问题。

Result: 在SPADES数据集上，TALON将姿态误差比先前最先进方法降低了50%；在SwissCube数据集上，ADD-0.1d精度比先前最佳方法提升了21.8%。在SPARK真实数据上进行模拟到真实的零样本跨域评估，姿态误差减少了4.7倍。

Insight: 创新点包括：在冻结ViT的自注意力层前注入时空3D适配器，允许注意力机制处理时间增强的令牌；引入基于原型条件KL散度的补丁令牌对齐损失，使特征与关键点结构几何对齐；适配器设计轻量，参数增量小，避免了灾难性遗忘并提升了跨域性能。

Abstract: Monocular 6-DoF spacecraft pose estimation methods predominantly process individual frames, discarding the temporal information present in an image sequence acquired during spacecraft manoeuvres. Few temporal approaches require full backbone fine-tuning or auxiliary optical flow networks, risking catastrophic forgetting or increasing computational cost, respectively. We propose TALON (Token-Aligned Lightweight adapters for Orbital Navigation): spatiotemporal 3D adapters injected before the self-attention layers of a frozen ViT vision transformer, combined with a patch-token alignment loss that geometrically grounds the adapted features to keypoint structure through a prototype-conditioned KL-divergence objective. Pre-attention placement allows the frozen attention to reason over temporally enriched tokens, achieving stronger performance with a single adapter per block than post-attention alternatives. The alignment loss shapes the intermediate representations so that each keypoint induces a spatially precise activation in the token field, while the framework adds less than 5% parameters to the frozen backbone. On SPADES dataset, TALON reduces the pose error by 50% over the prior state-of-the-art, and on SwissCube dataset it surpasses the prior best by 21.8% in ADD-0.1d accuracy. Zero-shot cross-domain evaluation from sim-to-real on SPARK real data reduces pose error by 4.7x, and ablations characterise the role of adapter depth across in-domain and cross-domain settings.

[115] Beyond Classification: Dynamic Adapter Routing for Continual Multimodal Retrieval cs.CV | cs.AIPDF

Alicja Dobrzeniecka, Filip Szatkowski, Sebastian Cygert, Szymon Lukasik, Bartlomiej Twardowski

TL;DR: 本文针对视觉语言模型在持续多模态检索任务中的更新问题，提出了一个原则性的评估框架，并发现传统的类增量学习方法在该场景下效果有限。为此，作者提出了动态适配器路由方法，该方法通过基于原型的路由选择适配器并进行模型合并，在更具挑战性的持续检索设置中取得了优于基线方法的性能，并展现出良好的分布外泛化能力。

Details

Motivation: 现有研究多从类增量学习的角度处理持续检索问题，其评估设置可能无法充分捕捉检索特有的动态性。本文旨在为持续多模态检索建立一个更严谨的评估框架，并解决现有方法在该更具挑战性场景下的不足。

Result: 在提出的持续多模态检索评估框架下，动态适配器路由方法超越了之前的基线方法，并在分布外评估中表现出强大的泛化能力。

Insight: 创新点在于提出了一个专门针对持续多模态检索的评估框架，揭示了其与类增量学习的本质区别。方法上的核心创新是动态适配器路由，它通过基于原型的路由机制动态选择和组合适配器，为持续学习中的模型更新提供了一种灵活高效的解决方案。

Abstract: While retrieval is a core function of vision-language models, continually updating these models for retrieval tasks remains critically underexplored. Existing work often approaches continual retrieval through the lens of class-incremental learning (CIL), evaluating both standard CIL methods and retrieval-oriented adaptations in settings that may not fully capture the retrieval-specific dynamics. To address this, we introduce a new, principled evaluation framework for continual multimodal retrieval (CMR) spanning diverse visual domains, and systematically evaluate common approaches within this setting. Our empirical analysis shows that standard CIL methods fail to yield meaningful gains in our more challenging scenario. Therefore, we propose Dynamic Adapter Routing (DAR), a novel approach based on adapters selected through prototype-based routing and combined via model merging.DAR achieves superior performance over the previous baselines and demonstrates strong generalization under out-of-distribution evaluation. Our results highlights the unique challenges of CMR and encourages further research in this direction.

[116] ERGeoBench:A Comprehensive Benchmark for Embodied Reasoning and Geo-localization in Multimodal Large Language Models cs.CV | cs.AIPDF

Kaiwen Xue, Tao Wei, Guoxin Zhang, Zhonghong Ou, Kaoyan Lu

TL;DR: 该论文提出了ERGeoBench，一个用于评估多模态大语言模型在具身地理定位任务中能力的综合性诊断基准。该基准包含2,207个全球分布的街景全景图，通过单视图、全景视图和具身视图三种渐进式设置，评估模型的基础感知、空间意识、常识推理和地理定位推理四种互补能力。

Details

Motivation: 多模态大语言模型作为具身智能体展现出巨大潜力，但受限于缺乏细粒度评估，具身地理定位任务仍未得到充分探索。

Result: 对领先的专有和开源MLLMs的评估表明，当前模型能够推断高级地理语义，但在细粒度感知操作、度量定位和跨视图空间一致性方面仍存在困难。研究还发现地理定位能力与其他能力维度强相关。

Insight: 论文的创新点在于构建了一个统一的、多层次的诊断框架，强调了地理定位任务依赖于综合的感知、空间推理和常识推断，而非孤立的视觉识别，为推进类人具身地理定位提供了系统性评估工具。

Abstract: Multimodal large language models (MLLMs) have shown strong potential as embodied agents, yet embodied geo-localization remains underexplored due to the lack of fine-grained evaluation. We introduce ERGeoBench, a diagnostic benchmark for vision-driven embodied geo-localization. ERGeoBench evaluates models under three progressive settings – single-view, panorama-view, and embodied-view – where agents may actively acquire observations through sequential changes in yaw, pitch, and zoom. The benchmark contains 2,207 globally distributed street-view panoramas and measures four complementary capabilities: foundational perception, spatial awareness, common sense reasoning, and geo-localization reasoning. Evaluations of leading proprietary and open-source MLLMs show that current models can infer high-level geographic semantics, but still struggle with fine-grained perceptual operations, metric localization, and spatial consistency across views. We further observe that geo-localization is strongly correlated with the other capability dimensions, suggesting that accurate localization depends on integrated perception, spatial reasoning, and commonsense inference rather than isolated visual recognition. Overall, ERGeoBench provides a unified framework for diagnosing and advancing human-like embodied geo-localization. Project Page: https://kaixuewen.github.io/ERGeoBench/

[117] Envisioning Beyond the Few: Disentangled Semantics and Primitives for Few-Shot Atypical Layout-to-Image Generation cs.CV | cs.AI | cs.LGPDF

Nan Bao, Yifan Zhao, Wenzhuang Wang, Jia Li

TL;DR: 本文提出了一种名为DSP的表示驱动框架，用于解决少样本非典型布局到图像生成任务中的表示碎片化问题。该框架通过语义锚定和基元注入模块，将语义身份与视觉细节解耦，并结合概念引导优化目标，实现了在仅有5个样本的非典型领域下稳定且高质量的图像生成。

Details

Motivation: 现有布局到图像生成方法在少样本非典型设置下会产生碎片化和扭曲的生成结果，这源于语义身份与视觉细节的粒度不匹配导致的表示碎片化问题。

Result: 在5样本设置下，该方法在多个非典型领域的视觉保真度和布局对齐度上均优于现有最先进的布局到图像生成方法，实现了SOTA性能。

Insight: 创新点在于通过解耦语义锚定（稳定类别身份）和可重组基元（建模局部细节）的表示学习框架，并引入显著性感知的概念引导优化目标，有效解决了少样本适应中的表示碎片化问题，为少样本生成提供了可借鉴的表示解耦思路。

Abstract: The layout-to-image (L2I) task enables fine-grained control over image generation via object categories and spatial layouts. However, existing L2I methods yield fragmented and distorted generations under few-shot atypical settings. We term this failure as representation fragmentation, arising from a granularity mismatch that entangles semantic identity with visual details. To address this issue, we propose a representation-driven framework that disentangles semantics from primitives for robust few-shot adaptation. Specifically, Semantic Anchoring aggregates categorical semantics into anchors for stable identity, while Primitive Imbuing models recomposable primitives for robust local detail modeling. Conceptual Steering further regulates optimization with a saliency-aware objective to preserve foreground semantic consistency. Extensive experiments demonstrate consistent improvements in the 5-shot regime over state-of-the-art L2I methods in both visual fidelity and alignment across diverse atypical domains. The source code is publicly available at https://github.com/iCVTEAM/DSP.

[118] DriveMA: Driving Vision-Language-Action Models with verifiable Meta-Actions cs.CVPDF

Weicheng Zheng, Yixin Huang, Qiao Sun, Derun Li, Hang Zhao

TL;DR: 本文提出了DriveMA框架，通过可验证的元动作来弥合语言与动作之间的鸿沟，以提升端到端驾驶规划性能。该方法将未来自车运动总结为紧凑的语言意图，并利用基于轨迹的标注流程从专家轨迹中构建元动作，同时通过基于规则的投影验证其与生成轨迹的一致性。DriveMA采用以动作为中心的监督训练和数据高效的回合级信用分配强化学习框架，通过密集奖励和精确信用分配，显式地对齐高层决策与低层轨迹规划。

Details

Motivation: 当前驾驶视觉-语言-动作模型（Driving VLAs）旨在利用语言改进端到端规划，但语言与动作之间的差距限制了其潜力。本文旨在通过可验证的元动作来弥合这一鸿沟，提升语言与动作的对齐效果。

Result: 在Waymo开放数据集基于视觉的端到端驾驶任务上，DriveMA取得了新的SOTA性能，2B模型获得8.060的评分员反馈分数，4B模型进一步提升至8.079。在NAVSIM上也获得了有竞争力的闭环规划性能。

Insight: 创新点在于引入了可验证的元动作作为语言与动作之间的桥梁，并通过轨迹标注和规则验证确保其可靠性。同时，结合监督训练和高效的强化学习框架，实现了高层语言意图与低层轨迹规划的显式对齐，从而以简单的接口实现了SOTA性能。

Abstract: Driving Vision-Language-Action Models (Driving VLAs) aim to use language to improve end-to-end planning, but the language-action gap limits this promise. We propose DriveMA, a Driving VLA framework built on verifiable meta-actions, which summarize future ego motion into compact language-domain intentions and can be constructed from expert trajectories with a trajectory-grounded annotation pipeline and can be verified against generated trajectories through rule-based projection. DriveMA exploits this verifiability with action-centric supervised training and a data-efficient turn-level credit assignment reinforcement learning framework, explicitly aligning high-level decisions with low-level trajectory planning through dense rewards and precise credit assignment. DriveMA sets a new state of the art on the Waymo Open Dataset Vision-based E2E Driving, achieving a Rater Feedback Score of 8.060 with a 2B model and further improving it to 8.079 with a 4B model; it also obtains competitive closed-loop planning performance on NAVSIM. These results show that even a simple meta-action interface can achieve state-of-the-art planning when made verifiable and optimized for language-action alignment. Code, data, and models will be released to facilitate future research.

[119] Learning from Fine-Grained Visual Discrepancies: Mitigating Multimodal Hallucinations via In-Context Visual Contrastive Optimization cs.CV | cs.CLPDF

Haolin Deng, Xin Zou, Zhiwei Jin, Chen Chen, Haonan Lu

TL;DR: 本文提出了一种名为IC-VCO（In-Context Visual Contrastive Optimization）的新方法，旨在解决视觉语言模型（VLMs）中的多模态幻觉问题。该方法通过在共享的多图像上下文中进行对比优化，确保了数学上的严谨性，并引入了视觉对比蒸馏（VCDist）作为辅助正则化器，以及通过精确语义扰动生成困难负样本的策略。

Details

Motivation: 标准文本直接偏好优化（DPO）因缺乏明确的视觉监督而难以缓解多模态幻觉，现有视觉偏好DPO方法存在目标函数理论不一致和依赖粗粒度负样本导致捷径学习的问题。

Result: 在五个基准测试上的实验表明，IC-VCO取得了最佳的整体性能，并且其样本编辑策略有效。

Insight: 创新点包括：在共享多图像上下文中进行对比优化以确保理论一致性；引入VCDist正则化器以增强训练与推理的一致性；提出通过精确语义扰动生成困难负样本的策略，以提升模型鲁棒性。

Abstract: Multimodal hallucination remains a persistent challenge for Vision-Language Models (VLMs). Standard textual Direct Preference Optimization (DPO) often fails to mitigate it due to a lack of explicit visual supervision. While existing works introduce visual preference DPO by contrasting original images against negative ones, they suffer from a theoretically inconsistent objective caused by partition function mismatches and rely on coarse-grained negatives that could enable shortcut learning. In this work, we propose In-Context Visual Contrastive Optimization (IC-VCO). By placing contrastive images within a shared multi-image context, IC-VCO ensures a mathematically rigorous objective. We further introduce Visual Contrast Distillation (VCDist), an auxiliary reliability-gated regularizer that encourages consistency between multi-image contrastive training and single-image inference. Finally, we propose a contrastive sample editing strategy that generates hard negatives via precise semantic perturbations. Experiments on five benchmarks demonstrate IC-VCO’s best overall performance and the effectiveness of our sample editing strategy. Code and data are available at https://github.com/OPPO-Mente-Lab/IC-VCO.

[120] DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memory cs.CVPDF

Zhenhao Yang, Xiaoshi Wu, Zhengyao Lv, Xiaoyu Shi, Xintao Wang

TL;DR: 本文提出了DecMem，一种解耦的记忆架构，用于解决长视频生成中的细粒度时空一致性问题。该方法通过稀疏全局记忆和锚定局部记忆的组合，实现了对全局历史的高效访问和稳定高质量的外推，从而支持分钟级可控长视频生成。

Details

Motivation: 现有视频生成模型在长时推理中难以保持细粒度时空一致性，且显式3D记忆和粗粒度帧级隐式建模存在局限，因此需要一种细粒度、可学习且可扩展的记忆机制。

Result: 在广泛实验中，DecMem显著优于当前最先进方法，实现了高保真度和一致性的分钟级可控长视频生成。

Insight: 创新点在于通过解耦记忆架构解决朴素可学习记忆在长时外推中的计算低效和注意力分散问题，具体采用稀疏全局记忆进行高效细粒度全局历史访问，以及锚定局部记忆确保稳定高质量外推。

Abstract: Recent advances in video generative models have promoted rapid progress in controllable world models. However, maintaining fine-grained spatio-temporal consistency under long-horizon reasoning remains a key challenge. In this work, we move beyond explicit 3D memory and coarse frame-level implicit modeling, and propose a fine-grained, learnable, and scalable memory for consistent world generation. We first identify two fundamental limitations of naïve learnable memory architectures in long-horizon extrapolation, namely computational inefficiency and attention dispersion. Through a systematic analysis of attention dispersion, we propose DecMem, a decoupled memory architecture that employs Sparse Global Memory for efficient fine-grained access to global history and Anchored Local Memory for stable and high-quality extrapolation. Extensive experiments demonstrate that DecMem significantly outperforms current state-of-the-art methods. By ensuring precise and efficient long-term memory and achieving superior extrapolation capabilities, DecMem enables minute-level controllable long video generation with high fidelity and consistency.

[121] YARD: Y-Architecture Register Decoding for Efficient Hallucination Mitigation in Large Vision-Language Models cs.CVPDF

Ting Chen, Geng Li, Guohao Chen, Yu Hu, Guan Huang

TL;DR: 本文提出了一种名为YARD的训练免费Y架构寄存器解码框架，旨在高效缓解大型视觉语言模型（LVLM）中的幻觉问题。该方法通过共享浅层计算并在中间解码层分支，构建一个内部退化分支，将补丁级视觉令牌替换为保留全局语义但缺乏细粒度局部证据的寄存器令牌，从而提供对比信号，严格避免了昂贵的第二次前向传播。

Details

Motivation: 现有基于对比解码（CD）的无训练方法存在退化分支次优的问题：完全丢弃视觉令牌过于极端并会引发语言幻觉，而破坏输入图像则对视觉证据控制粗糙且因需要两次完整前向传播导致高推理延迟。YARD旨在解决这些困境，通过内部构建退化分支来提供更精确的对比信号并降低延迟。

Result: 在生成式和判别式幻觉基准测试上的广泛实验表明，YARD在多个LVLM上持续实现了最先进的幻觉缓解效果，同时显著降低了推理延迟。

Insight: 创新点在于观察到可靠的文本到视觉基础主要出现在中间解码层，并据此设计Y架构，通过共享浅层计算和在该关键阶段分支来内部构建退化分支，使用寄存器令牌替代视觉令牌以平衡全局语义与局部证据的缺失，从而在避免极端模态不匹配的同时实现高效推理。

Abstract: Contrastive decoding (CD) seeks to mitigate hallucinations in Large Vision-Language Models (LVLMs) by contrasting the output distributions of a standard model and a visually degraded model. However, existing training-free CD methods suffer from sub-optimal degraded branches: completely dropping visual tokens is too extreme and induces language hallucinations, while corrupting input images offers coarse control over visual evidence and suffers from high inference latency due to requiring two full forward passes. To address these dilemmas, we propose YARD, a training-free Y-Architecture Register Decoding framework. Motivated by the observation that reliable text-to-vision grounding predominantly emerges in the middle decoder layers, YARD constructs the degraded branch internally by sharing shallow-layer computations and branching exactly at this critical stage. For the degraded branch, YARD replaces patch-level visual tokens with register tokens, which preserve global image semantics but lack fine-grained local evidence. This image-aware yet locally under-grounded design provides a faithful contrastive signal without extreme modality mismatch, while the Y-architecture strictly avoids a costly second forward pass. Extensive experiments on generative and discriminative hallucination benchmarks demonstrate that YARD consistently achieves state-of-the-art hallucination mitigation across multiple LVLMs, alongside a significant reduction in inference latency.

[122] FSM-Net: An Efficient Frequency-Spatial Network for Real-World Deblurring cs.CVPDF

Vinh-Thuan Ly

TL;DR: 本文提出了一种名为FSM-Net的高效频率-空间网络，用于解决真实世界图像去模糊任务中高保真恢复与计算效率难以兼顾的问题。该网络采用双域方法，结合新颖的频率注意力模块和具有线性复杂度的瓶颈层结构，并通过渐进式课程训练策略进行优化。在NTIRE 2026高效真实世界去模糊挑战赛中获得第二名，并在RSBlur基准测试中取得了优异的性能。

Details

Motivation: 现有方法难以在真实世界图像去模糊任务中，同时实现高保真度的图像恢复和较高的计算效率。本文旨在解决这一平衡问题。

Result: 在RSBlur基准测试中，FSM-Net取得了33.144 dB的峰值信噪比（PSNR），模型参数量仅为4.94M，计算量为159.35 GMACs（在1920x1200分辨率下）。该结果在NTIRE 2026高效真实世界去模糊挑战赛中排名第二，有效推进了效率与质量的帕累托前沿。

Insight: 主要创新点包括：1）开创性的双域方法，通过频率注意力模块（利用FFT）显式恢复高频结构细节；2）在瓶颈处采用具有线性复杂度的Cross-Gated Vision E-Branchformer来捕获全局依赖；3）采用由复合损失函数引导的渐进式课程训练策略以确保鲁棒收敛。这些设计为资源受限的图像恢复任务提供了一个强有力的基线模型。

Abstract: Real-world image deblurring demands both high-fidelity restoration and computational efficiency, a balance existing methods often struggle to achieve. In this paper, we propose FSM-Net (Frequency-Spatial Multi-branch Network), a highly efficient solution that secured 2nd place in the NTIRE 2026 Challenge on Efficient Real-World Deblurring. FSM-Net pioneers a dual-domain approach: a novel Frequency Attention module explicitly recovers high-frequency structural details via FFT, while a Cross-Gated Vision E-Branchformer at the bottleneck captures global dependencies with linear complexity. To ensure robust convergence, we employ a progressive curriculum training strategy guided by a composite loss function (Multi-Scale Charbonnier, Structural Edge, and Frequency). Evaluated on the RSBlur benchmark, FSM-Net achieves an outstanding 33.144 dB PSNR with only 4.94M parameters and 159.35 GMACs (at 1920x1200 resolution). By effectively pushing the Pareto frontier of efficiency and quality, FSM-Net establishes a strong baseline for resource-constrained image restoration.

[123] VisionPulse: Dynamic Visual Sparsity for Efficient Multimodal Reasoning cs.CVPDF

Hengbo Xu, Shengjie Jin, Yanbiao Ma, Zhiwu Lu

TL;DR: 本文提出VisionPulse，一种用于大型多模态模型（LMMs）推理时动态视觉稀疏化框架。该框架通过计算轻量级视觉注意力质量来估计每步解码的视觉令牌保留预算，仅保留最关键令牌，从而在几乎不影响准确性的前提下显著减少视觉令牌数量并缩短推理轨迹。

Details

Motivation: 现有方法通常在预填充阶段静态剪枝视觉令牌，但作者实证发现视觉证据具有强烈的步骤依赖性，且冗余的视觉上下文会引导模型关注查询无关区域，导致推理轨迹变长，成为实际部署的瓶颈。

Result: 在广泛的实验中，VisionPulse每步仅保留5%的视觉令牌，推理轨迹缩短了11.2%，同时保持准确性几乎不变。

Insight: 创新点在于揭示了视觉证据在推理过程中的动态演变特性，并据此提出了在推理过程中进行步骤级视觉令牌剪枝的框架，通过轻量注意力质量估计预算，自然过滤冗余上下文，这是对静态预填充剪枝方法的显著改进。

Abstract: With the rapid advancement of large multimodal models (LMMs), inference-time overhead has become a key bottleneck for real-world deployment. Existing methods typically prune visual tokens at prefill, assuming the required visual evidence remains static during reasoning. However, we empirically show that visual evidence is strongly step-dependent: only a sparse subset of visual tokens is critical at each decoding step, and the critical set evolves across reasoning. Furthermore, we identify a coupled bottleneck where redundant visual context can steer the model toward query-irrelevant regions, lengthening the reasoning trace. Guided by these insights, we propose VisionPulse, a step-wise visual token pruning framework during reasoning. VisionPulse computes a lightweight visual attention mass to estimate the step-wise retention budget by exploiting its strong positive correlation with LMMs’ effective visual token usage and retain only the most critical tokens under this budget. By enforcing visual sparsity during reasoning, VisionPulse filters redundant visual context while preserving relevant visual evidence, shortening reasoning traces naturally. Extensive experiments show that VisionPulse only retains 5% of visual tokens per step with reasoning traces shortened by 11.2%, while keeping accuracy almost unchanged.

[124] Astra: a generalizable report generation foundation model for 3D computed tomography cs.CVPDF

Zhuhao Wang, Fang Chen, Chaohui Yu, Zihan Li, Yuchao Zheng

TL;DR: 本文提出了Astra，一个用于3D计算机断层扫描（CT）的可泛化报告生成基础模型。该模型在包含90,678个胸腹部CT-报告对的数据集上进行训练，并通过强化学习统一报告风格和诊断一致性，从而支持多区域报告并在多个外部真实世界队列中保持鲁棒性。

Details

Motivation: 解决CT解读耗时且高度依赖专家经验的问题，当前领域缺乏一个支持多区域报告、且在外部真实世界队列中具有强泛化能力的CT报告生成基础模型。不同队列间报告风格和诊断术语的内在不一致性限制了模型的泛化能力。

Result: 在CTRgDB和六个外部队列上的评估表明，Astra在细粒度诊断指标上平均提升了44.1%，达到了最先进的性能（SOTA）。在真实临床工作流中，Astra辅助将胸部报告起草速度提升了29.6%，并将腹部报告的完整性提升了11.3%。

Insight: 创新点在于通过强化学习来统一报告风格和细化诊断一致性，以解决跨队列监督噪声问题，从而提升模型的泛化能力。该模型不仅作为临床助手，还可作为CT AI开发的基础设施，通过高质量报告合成来提升下游诊断性能和扩展视觉-语言预训练。

Abstract: CT interpretation requires radiologists to review hundreds of volumetric slices per examination, making reporting time-consuming and highly expertise-dependent. Automated CT report generation offers a promising route to improving clinical efficiency, yet the field still lacks a generalizable CT report generation foundation model that supports multi-region reporting and remains robust across external real-world cohorts. Intrinsic inconsistencies in reporting style and diagnostic terminology across cohorts make naive joint training prone to noisy textual supervision, thereby limiting model generalizability. Here we present Astra, a generalizable CT report generation foundation model trained on 90,678 thoracoabdominal CT-report pairs (CTRgDB) with 353,671 abnormalities spanning eight organ systems. By harmonizing report style and further refining diagnostic consistency via reinforcement learning, Astra achieves style-consistent and diagnostically accurate report generation across diverse anatomical regions and institutions. Evaluating on CTRgDB and six external cohorts, Astra achieves state-of-the-art performance with a 44.1% average improvement in fine-grained diagnostic metrics (P<0.001). In real-world clinical workflows, Astra assistance accelerates chest report drafting by 29.6% and improves abdominal report completeness by 11.3% (P<0.001). Furthermore, Astra also demonstrates broad utility as a foundation for CT AI development, improving downstream diagnostic performance and scaling vision-language pretrain through high-quality report synthesis. Overall, Astra serves as a broadly accessible clinical assistant and a pivotal infrastructure for the next generation of AI-powered healthcare.

[125] VolFill: Single-View Amodal 3D Scene Reconstruction with Volumetric Flow Matching cs.CVPDF

Tuan Duc Ngo, Chuang Gan, Evangelos Kalogerakis

TL;DR: VolFill是一个从单张RGB图像重建完整3D场景的生成框架，它通过混合3D VAE压缩稀疏截断无符号距离函数网格到潜在空间，并利用潜在扩散Transformer去噪以恢复完整场景。该方法利用几何基础模型作为条件，提供结构化表示支持直接表面提取和大规模占用查询，在SCRREAM和NRGB-D数据集上显著优于现有基线。

Details

Motivation: 解决从单张RGB图像重建完整场景几何的挑战，特别是推断视觉证据不完整的隐藏结构，传统像素对齐回归方法存在局限。

Result: 在SCRREAM和NRGB-D数据集上的大量实验表明，该方法显著优于当前基线，为整体空间理解提供了鲁棒基础。

Insight: 创新点在于采用生成式框架而非传统回归，结合混合3D VAE和潜在扩散Transformer进行结构化3D表示生成，并利用几何基础模型提供空间先验，克服了每射线约束或非结构化点云查询的限制。

Abstract: Reconstructing the complete geometry of a scene from a single RGB image remains challenging - especially when inferring hidden structures where visual evidence is incomplete. We introduce VolFill, a generative framework that predicts the 3D structure of the complete scene rather than relying on traditional pixel-aligned regression. Our method utilizes a hybrid 3D VAE to compress sparse truncated unsigned distance function grids into a compact latent space, paired with a latent Diffusion Transformer that denoises this representation to recover the complete scene. We condition the generation on geometry foundation models, leveraging rich spatial priors for robust reasoning. Unlike existing methods limited by per-ray constraints or unstructured point-cloud queries, VolFill provides a structured representation that supports direct surface extraction and occupancy queries at scale. Extensive experiments on the SCRREAM and NRGB-D datasets demonstrate that our approach significantly outperforms current baselines, providing a robust foundation for holistic spatial understanding.

[126] Enhancing Computer Vision Model Generalization in Warehouse Facilities: A Case Study on Anomaly Detection in Vertical Material Handling Systems cs.CVPDF

Ruiliang Liu, Tina Dongxu Li, Joshua Migdal, Ken Meszaros, Trevor Dardik

TL;DR: 本文提出了一种简化仓库设施中计算机视觉模型部署的创新方法，通过在实验室环境中完成标准流程（包括相机放置、图像采集、模型选择与集成），并将其有效泛化到多样化的实际仓库环境，从而显著减少图像标注和模型重新训练所需的资源与时间。研究聚焦于垂直物料搬运系统中的货叉异常检测，通过实验验证了该方法的可行性。

Details

Motivation: 传统仓库设施中部署计算机视觉模型需要大量资源，且因相机安装限制和环境变化，每个新环境都需重复整个流程，过程繁琐耗时。本文旨在探索一种简化流程，通过在实验室完成核心步骤并实现向实际环境的有效泛化，以降低部署成本。

Result: 通过大量实验发现，结合最优相机放置、策略性图像触发、谨慎的模型选择和模型集成，能够实现从实验室条件到多样化仓库设施环境的有效泛化。这是一项实验性研究，并非生产部署，但结果表明该方法有潜力简化部署流程。

Insight: 创新点在于将完整的模型开发流程（包括数据收集与标注）前置到受控的实验室环境中，并通过系统性的相机放置、触发策略和模型集成技术来实现跨环境泛化，这为仓库自动化部署提供了一种资源节约型的新范式。

Abstract: Deploying computer vision models in Warehouse Facilities traditionally requires extensive resources for camera mounting, image collection, annotation, training, and deployment - a process often needing repetition in each new environment due to camera mounting constraints and environmental variability. This paper explores an innovative approach to streamline this process by conducting the standard procedure solely in a laboratory setting, focusing on vertical material handling systems and anomaly detection in forks of the systems. Through extensive experimentation, we have found that combining optimal camera placement, strategic image triggering, careful model selection and model ensemble enables effective generalization from laboratory conditions to diverse warehouse facilities environments, potentially transforming warehouse automation implementation by simplifying warehouse facilities deployment to just camera mounting, image collection, and model deployment, thereby saving significant resources and time typically spent on image annotation and model retraining. This is an experimental research study and not a production deployment.

[127] How can embedding models bind concepts? cs.CV | cs.LGPDF

Arnas Uselis, Darina Koishigarina, Seong Joon Oh

TL;DR: 本文研究了视觉语言嵌入模型（如CLIP）在概念绑定（即确定场景中哪个概念属于哪个对象）方面的能力。研究发现，CLIP虽然能识别单个概念，但难以学习共享的绑定机制，导致其跨模态检索表现类似“概念袋”模型。通过分析绑定函数的复杂性，论文证明在足够数据覆盖下，从头训练的Transformer模型可以学习低复杂度的乘法交互绑定函数，从而实现系统性泛化。

Details

Motivation: 人类能轻松理解多对象场景中概念与对象的归属关系（概念绑定），而像CLIP这样的视觉语言嵌入模型在此任务上存在困难：它们能识别单个概念，但无法表示哪些概念组合成哪些对象。本文旨在探究这种绑定能力不足的根本原因，并验证其是否是可克服的固有局限。

Result: 研究发现，CLIP的绑定函数具有高复杂性，阻碍了图像和文本编码器学习可泛化到未见概念组合的共享绑定机制。然而，在从头训练的受控Transformer模型中，当数据覆盖足够时，绑定泛化能力会出现，这些模型能学习到以概念间乘法交互为特征的低复杂度绑定函数。

Insight: 论文的核心创新点在于通过“绑定函数”的视角分析嵌入模型的绑定能力，并揭示了绑定泛化与绑定函数复杂度之间的关键联系。客观来看，其重要见解是：绑定能力的缺乏并非嵌入模型的根本限制，通过适当的模型架构和充分的数据，可以实现低复杂度、可泛化的绑定表示，这为改进多模态模型的组合推理能力提供了方向。

Abstract: Humans easily determine which color belongs to which shape in multi-object scenes, an ability known as concept binding. Vision-language embedding models such as CLIP struggle with binding: they recognize individual concepts but fail to represent which concepts form which objects. Although CLIP behaves like a bag-of-concepts model in cross-modal retrieval, object information is recoverable from its image and text embeddings separately. We study this tension through the binding function, which maps concepts to scene embeddings. We find that scene embeddings decompose additively into object representations, explaining why uni-modal probes can recover object information. However, CLIP’s binding function is high-complexity, which likely prevents the image and text encoders from learning a shared binding mechanism that generalizes to unseen concept combinations. We then ask whether this limitation is fundamental. We show that it is not. In controlled transformer models trained from scratch, binding generalization emerges with sufficient data coverage. These models learn low-complexity binding functions characterized by multiplicative interactions between concepts, enabling systematic generalization. Code is publicly available at https://github.com/oshapio/binding-concepts-complexity.

[128] Internalizing Temporal Consistency in Video Object-Centric Learning without Explicit Regularization cs.CVPDF

Rongzhen Zhao, Zhiyuan Li, Juho Kannala, Joni Pajarinen

TL;DR: 本文提出了一种无需显式正则化的视频对象中心学习新范式xSSC，通过引入时序通道分解（CCD）和跨时序重建（CTR）两种机制，在模型设计中隐式地强制时序一致性，从而移除了现有方法依赖的Slot-Slot对比损失（SSC）。该方法仅通过最小化标准重建误差，即可让对象表示（slot）在帧间自然地保持一致性，并在多个视频对象发现与识别任务上实现了新的SOTA，同时提高了训练效率。

Details

Motivation: 现有视频对象中心学习（OCL）方法依赖Slot-Slot对比损失（SSC）来强制对象在帧间的一致性，但这需要跨帧的一对一对象对应关系并引入了额外的损失项。本文遵循奥卡姆剃刀原则，旨在探索一种更优雅的范式：将时序一致性作为隐式的模型设计来实现，而非显式的损失函数。

Result: 将xSSC集成到领先的基线模型中，在视频对象发现和识别任务上建立了新的SOTA。实验表明，该方法不仅提升了训练效率，而且PCA和梯度分析证实了所提出的子空间分别编码了对象的时间不变语义和时间可变运动学信息。

Insight: 核心创新在于通过模型结构设计（CCD和CTR）隐式地学习时序一致性，从而移除了对显式对比损失的依赖。这提供了一种更简洁、高效的视频对象中心学习范式，其将对象表示沿通道维度解耦为静态和动态子空间的思想，为理解与分离对象的语义和运动信息提供了新视角。

Abstract: Video Object-Centric Learning (OCL) aims to represent objects as \textit{slot} vectors and maintain their consistency across frames. Slot-Slot Contrastive (SSC) loss has become the cornerstone for state-of-the-art (SOTA) video OCL methods. While highly effective, SSC relies on one-to-one object correspondence across frames and introduces an extra loss. Following Occam’s Razor, we propose a paradigm shift: temporal consistency is better enforced as an implicit model design rather than an explicit loss. To elegantly exclude SSC (\textbf{xSSC}), we introduce two quasi-zero-overhead synergistic mechanisms: (\textit{i}) Chrono-Channel Decomposition (CCD) structurally disentangles slot representations along the channel dimension into \textit{static} and \textit{dynamic} sub-spaces, serving as an empirically unified information bottleneck; (\textit{ii}) Cross-Temporal Reconstruction (CTR) stochastically reconstructs target features of either the current or previous time step by fusing current slots’ static channels and target slots’ dynamic channels, using a single standard OCL decoder with minor training adaptation. Thereby, the slot sets inherently learn temporal consistency by minimizing the standard reconstruction error alone. Extensive experiments show that integrating xSSC into leading baselines not only improves training efficiency but also establishes new SOTAs on video object discovery and recognition tasks. Furthermore, our PCA and gradient analyses confirm that objects’ time-invariant semantics and time-variant kinematics are encoded into the proposed sub-spaces. Our source code, model checkpoints and training logs are provided on https://github.com/Genera1Z/xSSC.

[129] SVI-Bench: A Dynamic Microworld for Strategic Video Intelligence cs.CVPDF

Yulu Pan, Han Yi, Seongsu Ha, Md Mohaiminul Islam, Benjamin Zhang

TL;DR: 该论文提出了SVI-Bench，一个用于评估战略视频智能（SVI）的大规模基准测试。它利用团队体育（篮球、足球、冰球）作为动态微世界，结合了真实多智能体交互的复杂性与明确规则的可验证性，包含大量视频、标注和结构化数据。评估涵盖从动态场景理解到智能体合成的9个任务，揭示了模型在感知任务上表现良好，但在因果推理和战略规划等更高认知任务上能力急剧下降。

Details

Motivation: 现有基准无法全面评估视频智能从感知到因果推理、模拟和战略规划的完整能力栈。真实世界视频缺乏因果和战略问题的可验证真值，而合成环境又牺牲了真实多智能体系统的复杂性。

Result: 在SVI-Bench上评估的强大多模态和智能体基线模型表现出能力悬崖：在感知任务（如细粒度动作问答）上达到约73%的准确率，但在后续每个认知层级（因果推理、战略模拟、智能体合成）上性能急剧下降。智能体任务最难，最强模型在需要自主收集和整合180万片段证据的任务上准确率仅为5%。

Insight: 创新点在于构建了一个结合真实世界复杂性与可验证性的基准，通过团队体育这一领域系统化地定义了从感知到战略规划的渐进式评估层次。其数据引擎和跨模态、跨参考的密集语料库构建方法，为评估高级视频推理能力提供了新范式。

Abstract: True video intelligence demands more than recognizing what is visible: it requires reasoning about why events unfold, predicting what would change under different conditions, and deciding what to do next. We refer to this progression, from perception through causal reasoning and simulation to strategic planning, as Strategic Video Intelligence (SVI). No existing benchmark evaluates this capability stack: in-the-wild videos lack verifiable ground truth for causal and strategic questions, while synthetic environments sacrifice the complexity of real multi-agent systems. To bridge this gap, we introduce SVI-Bench, a large-scale benchmark that leverages team sports as a dynamic microworld, combining the complexity of real-world multi-agent interaction (10-22 agents making coordinated decisions under adversarial pressure) with the verifiability of explicit rules and definitive outcomes. SVI-Bench comprises approximately 35K hours of broadcast video, 15M annotated actions, 15K hours of expert commentary, 23K game reports, and 103K structured statistical records across basketball, soccer, and hockey, all constructed via a data engine that transforms raw game data into a dense, cross-referenced corpus. We organize evaluation into 9 tasks spanning a progressive four-pillar hierarchy: Dynamic Scene Understanding, Causal Reasoning, Strategic Simulation, and Agentic Synthesis. Evaluating strong multimodal and agentic baselines, we find a capability cliff: models perform competently on perceptual tasks, achieving approximately 73% on fine-grained action QA, but degrade sharply at each successive cognitive level. Agentic tasks prove hardest: the strongest model achieves only 5% accuracy when required to autonomously gather and integrate evidence across a corpus of 1.8M clips.

[130] Feature-Optimized Vision for Adaptive 3D Scene Reconstruction cs.CV | cs.AIPDF

Eric Liang

TL;DR: 本文提出了一种用于3D场景重建的自适应特征优化视觉前端方法。该方法通过纹理、可重复性、独特性、预期三角化角度和空间覆盖度对候选特征进行评分，并分配每视角特征预算以最大化有用轨迹。在合成多视角数据集上的实验表明，自适应策略在质量感知完整性和重建RMSE方面优于随机、仅纹理和均匀网格基线。

Details

Motivation: 解决传统3D重建中固定特征阈值和均匀特征预算导致的计算浪费问题，例如在重复纹理、低视差区域或不稳定点上过度计算。

Result: 在走廊、立面、物体-桌面和杂乱场景的合成多视角原型评估中，自适应策略获得了最佳的质量感知完整性和最低的总体重建RMSE，同时保持了广泛的图像覆盖。

Insight: 创新点在于提出了一种模块化的前端策略，通过多维度特征评分和预算分配，使经典和学习的3D重建流程能更明智地选择视觉证据，而非直接替代现代学习方法。

Abstract: Three-dimensional scene reconstruction depends on local image evidence that is both visually discriminative and geometrically useful. Fixed feature thresholds and uniform feature budgets are easy to deploy, but they can waste computation on repeated texture, low-parallax regions, or unstable points. This paper proposes an adaptive feature-optimized vision front end for 3D reconstruction. The method scores candidate features by texture, repeatability, distinctiveness, expected triangulation angle, and spatial coverage, then allocates a per-view feature budget to maximize useful tracks under a fixed reconstruction pipeline. A small synthetic multi-view prototype evaluates four selection policies across corridor, facade, object-table, and cluttered scenes. Compared with random, texture-only, and uniform-grid baselines, the adaptive policy obtains the best quality-aware completeness and the lowest aggregate reconstruction RMSE while preserving broad image coverage. The result is not a replacement for modern learned matching or neural reconstruction systems; it is a modular front-end policy that can make classical and learned 3D pipelines more deliberate about which visual evidence they spend compute on.

[131] Personalize Your Large Vision-language Models With In-context Prompt Tuning cs.CVPDF

Yanshu Li, Jiaqian Li, Kuai Yu, Xi Xiao, Dongfang Liu

TL;DR: 本文提出了一种名为上下文提示调优（ICPT）的新方法，用于个性化大型视觉语言模型（LVLM）。该方法通过轻量级投影模块从多张参考图像中提取细粒度视觉语义，并将其与身份标签映射转换为连续提示，同时引入几何正则化来克服环境偏差和概念间干扰，从而在复杂多图像、多概念场景中实现高效且准确的个性化。

Details

Motivation: 现有LVLM个性化方法通常依赖推理时训练，效率低下，且在复杂多图像、多概念设置中难以保持准确性，限制了其广泛部署。本文旨在解决这些问题，实现快速、有效的模型个性化以满足用户特定需求。

Result: 大量实验表明，ICPT在多种任务和LVLM骨干网络上均达到了最先进的个性化准确率（SOTA）。

Insight: 创新点包括：1）设计轻量级投影模块，能自适应确定提示长度以提升计算效率；2）引入两种新颖的几何正则化，通过解耦关键身份与瞬态环境状态、分离概念以避免语义混淆，从而精炼提示表示，有效应对现实应用中的环境偏差和跨概念干扰。

Abstract: Large vision-language models (LVLMs) have demonstrated strong general multimodal capability and are increasingly deployed in downstream systems. This trend has driven growing interest in LVLM personalization, which aims to enable models to quickly and effectively learn out-of-distribution multimodal concepts to meet user-specific needs. However, many existing methods rely on inference-time training, which reduces efficiency. They also struggle to maintain accuracy in complex multi-image, multi-concept settings. These limitations restrict the broader deployment of LVLM-based systems. Therefore, this paper proposes in-context prompt tuning (ICPT). Specifically, ICPT employs a lightweight projection module capable of operating in complex scenarios to extract fine-grained visual semantics from multiple reference images, seamlessly transforming these features alongside identity-label mappings into continuous prompts. To maximize computational efficiency, this module adaptively determines the prompt length based on the intrinsic visual complexity of each concept. Crucially, to overcome the environmental biases and cross-concept interference prevalent in real-world applications, we introduce two novel geometric regularizations. These constraints refine prompt representations by decoupling key identities from transient environmental states and separating concepts to avoid semantic confusion. Extensive experiments show that ICPT achieves state-of-the-art personalization accuracy across diverse tasks and LVLM backbones.

[132] RayDer: Scalable Self-Supervised Novel View Synthesis from Real-World Video cs.CV | cs.AI | cs.LGPDF

Ulrich Prestel, Stefan Andreas Baumann, Nick Stracke, Björn Ommer

TL;DR: RayDer是一种用于自监督新视角合成的统一前馈Transformer模型，它将相机估计、场景重建和渲染整合到单一骨干网络中，从而将自监督NVS转化为一个定义良好的单模型扩展问题。该模型通过引入最小动态状态来处理视频中的时变内容，实现了在无约束真实世界视频上的稳定训练，并展现出在数据和计算量上的清晰幂律扩展行为。

Details

Motivation: 尽管视频数据丰富，但自监督新视角合成（NVS）的扩展仍然具有挑战性，主要因为基于真实视频的训练脆弱性以及多网络系统设计难以预测的扩展行为。RayDer旨在通过统一架构解决这些问题，将自监督NVS转化为一个定义良好的单模型扩展问题。

Result: RayDer在多个模型大小和数据量级上展现出清晰的幂律扩展，并优于静态场景数据混合方法。在大量基准测试中，RayDer实现了强大的零样本开放集性能，与最先进的监督方法相竞争。

Insight: RayDer的创新点在于将相机估计、场景重建和渲染统一到一个前馈Transformer骨干网络中，并通过引入最小动态状态作为干扰因子来吸收时变内容，从而稳定训练。这使得模型能够利用动态内容作为可扩展的监督信号，同时保持静态场景NVS作为目标任务，避免了复杂的动态场景（4D）重建。从客观角度看，这种统一架构和动态状态处理策略为自监督NVS的扩展提供了简洁有效的解决方案。

Abstract: Self-supervised novel view synthesis (NVS) remains challenging to scale, despite the abundance of video data, largely due to the brittleness of training on realistic videos and the hard-to-predict scaling behavior of multi-network system designs. We introduce RayDer, a unified, feed-forward transformer that consolidates camera estimation, scene reconstruction, and rendering into a single backbone, turning self-supervised NVS into a well-posed single-model scaling problem. A minimal dynamic state, treated as a nuisance factor, absorbs time-varying content and enables stable training on unconstrained real-world video. Importantly, RayDer keeps static-scene NVS as its target task: dynamic content is leveraged purely as scalable supervision, not reconstructed as in dynamic-scene (4D) NVS. Across multiple model sizes and orders of magnitude in data, RayDer exhibits clean power-law scaling with data and compute, and outperforms static-scene data mixtures. On a large number of benchmarks, RayDer achieves strong zero-shot open-set performance competitive with state-of-the-art supervised approaches. Project Page: https://compvis.github.io/rayder

[133] SMART: SMPLest-X Mesh Adaptation and RAFT Tracking for Soccer Pose Estimation cs.CVPDF

Parthsarthi Rawat

TL;DR: 本文提出了一种名为SMART的方法，用于解决足球广播视频中球员的3D世界空间姿态估计问题。该方法通过分层片段划分、多任务深度监督和广播增强对SMPLest-X模型进行微调，并结合RAFT密集光流相机跟踪、足平面锚定和双通道时间平滑技术。

Details

Motivation: 旨在应对FIFA骨骼跟踪挑战赛2026，从广播视频中准确估计足球运动员的3D世界空间姿态，以提升姿态估计的精度和鲁棒性。

Result: 在验证集上，SMART将基线得分从1.053提升至0.647，改进了38.6%；在测试集上得分为0.593（全局MPJPE: 0.324米，局部MPJPE: 0.054米），达到了先进水平。

Insight: 创新点在于将SMPLest-X模型与RAFT相机跟踪相结合，并通过分层训练、多任务监督和特定领域的数据增强来优化性能，同时利用足平面锚定和时间平滑提升时空一致性。

Abstract: We present our approach to the FIFA Skeletal Tracking Challenge 2026, which requires estimating 3D world-space poses of soccer players from broadcast video. Our method finetunes SMPLest-X (ViT-H, 687 M parameters) via a stratified clip split, multi-task depth supervision, and broadcast augmentation, paired with a RAFT dense optical flow camera tracker, foot-plane anchoring, and two-pass temporal smoothing. Against the FIFA baseline score of 1.053 on the validation set, SMART achieves 0.647, a 38.6% improvement; on the held-out test set, SMART scores 0.593 (Global MPJPE: 0.324 m, Local MPJPE: 0.054 m).

[134] Vision-Language Models Suppress Female Representations Under Ambiguous Input cs.CV | cs.AI | cs.CL | cs.CY | cs.HCPDF

Arnau Marin-Llobet, Simon Henniger, Mahzarin R. Banaji

TL;DR: 该论文研究了视觉语言模型在处理性别模糊输入图像时的表现，发现尽管模型经过对齐训练以避免表达人口统计偏见，但在模糊情境下仍会默认输出男性职业描述，即使该职业具有强烈的女性刻板印象。

Details

Motivation: 动机在于探究视觉语言模型在性别模糊输入（如穿戴全身装备的工人、背影人物）下的表现，这些情况在实践中常见但研究较少，旨在揭示模型内部表征与输出之间的系统性脱节。

Result: 在15种职业、超过800张性别模糊图像和四个VLMs上的实验表明，模型内部常编码女性关联但输出男性描述；层间分析显示男性信号被端到端放大，而女性信号在中间层达到峰值并在生成前被抑制。

Insight: 创新点包括引入LALS（潜在关联倾斜分数）这一零指标度量方法，通过将视觉令牌激活投影到文本嵌入空间来测量每令牌和每层的概念关联，并揭示了模型内部存在不对称过滤机制，以及文化负载的视觉线索（如服装颜色）如何调节这些内部关联。

Abstract: Alignment teaches vision-language models (VLMs) to avoid expressing demographic biases, and when gender is clearly visible they largely succeed. Far less is known about ambiguous inputs (a worker in full gear, a figure seen from behind) cases common in practice yet rarely studied. We find that minimal prompting pressure exposes occupation-gender defaults when prompting ambiguous input images, with models collapsing to male even for strongly female-stereotyped occupations. But do these outputs reflect what models actually encode internally? We introduce LALS (Latent Association Leaning Score), a zero-shot metric that projects visual-token activations into the model’s text-embedding space to measure concept associations per token and layer. Across 15 occupations, over 800 gender-ambiguous images, and four VLMs, internal representations and outputs are systematically decoupled: models often encode a female association internally yet output male. Layer-wise analysis reveals an asymmetric filter – male signal amplifies end-to-end while female signal peaks mid-network and is suppressed before generation – and a color ablation shows that culturally loaded visual cues such as clothing color further modulate these internal associations.

[135] nuReasoning: A Reasoning-Centric Dataset and Benchmark for Long-Tail Autonomous Driving cs.CVPDF

Zhiyu Huang, Johnson Liu, Rui Song, Zewei Zhou, Ruining Yang

TL;DR: nuReasoning是一个专注于推理的大规模真实世界自动驾驶数据集和基准测试，包含20,000个20秒长的多城市采集片段，提供多传感器数据和涵盖空间推理、决策推理及反事实推理的人工验证标注。该数据集旨在推动自动驾驶系统在长尾场景下的推理能力评估，并支持推理与规划性能的直接关联研究。

Details

Motivation: 现有自动驾驶数据集主要关注感知、预测或规划，缺乏对真实长尾驾驶场景中推理能力的监督与评估，而推理对于自动驾驶在复杂、罕见场景下的安全决策至关重要。

Result: 实验表明，在nuReasoning上微调视觉语言模型显著提升了驾驶相关问答性能；将推理监督融入视觉语言-动作模型训练后，即使在推理时禁用文本输出，也能改善规划性能。

Insight: 创新点在于构建了首个支持推理评估与规划评估直接关联的大规模真实世界自动驾驶推理数据集，为可解释、鲁棒的推理驱动自动驾驶系统提供了基础；客观来看，其多维度推理标注（特别是反事实推理）和与规划任务的结合设计，为研究推理如何影响驾驶性能提供了新途径。

Abstract: Reasoning is essential for autonomous driving (AD) in long-tail scenarios, where vehicles must apply commonsense knowledge, understand spatial relations, infer agent interactions, and make safe decisions. However, existing AD datasets and benchmarks mainly target perception, prediction, or planning, and provide limited supervision for reasoning over realistic long-tail driving scenes. We introduce nuReasoning, a large-scale real-world dataset and benchmark for reasoning-centric AD. Following the lineage of nuScenes and nuPlan, nuReasoning advances real-world AD datasets and benchmarks toward reasoning in long-tail driving scenarios. The dataset contains 20,000 clips, each 20 seconds long, collected across multiple cities, with synchronized multi-camera images, LiDAR data, HD maps, object annotations, and human-verified reasoning annotations spanning Spatial Reasoning, Decision Reasoning, and Counterfactual Reasoning. Unlike prior datasets that focus primarily on visual question answering, nuReasoning supports both reasoning evaluation and planning evaluation, enabling a direct study of how reasoning supervision affects driving performance. Experiments show that fine-tuning VLMs on nuReasoning substantially improves driving-specific question answering, while incorporating reasoning supervision into VLA training improves planning performance even when textual reasoning outputs are disabled at inference time. These results establish nuReasoning as a foundation for evaluating and improving robust, interpretable, reasoning-driven AD systems in realistic long-tail settings.

[136] Recognizing Co-Speech Gestures in-the-Wild cs.CVPDF

Sindhu B Hegde, K R Prajwal, Andrew Zisserman

TL;DR: 本文介绍了GRW数据集，这是首个大规模、用于在自然场景下识别伴随语音手势的基准数据集。该数据集包含大量精确标注的视频片段，用于训练模型完成手势语义性分类、对应词语识别和时序定位三项任务。

Details

Motivation: 当前多模态模型难以捕捉与特定词语语义关联的伴随语音手势，主要瓶颈在于缺乏精确标注的训练数据。

Result: 利用GRW数据集为手势语义性分类、对应词语识别和时序定位三项任务建立了基准。

Insight: 创新点在于构建了首个大规模、帧级精确标注的伴随语音手势数据集，并定义了包含物理动作、空间描述和抽象概念的多样化词语分类体系，为相关研究提供了关键数据基础。

Abstract: While humans naturally gesture during speech, only a sparse subset of these movements are visually depictive and semantically linked to specific spoken words. Current multimodal models struggle to capture these semantic co-speech gestures, heavily bottlenecked by a lack of precisely annotated training data. To address this, we introduce the Gesture Recognition in the Wild (GRW) dataset, the first large-scale benchmark designed to map unconstrained human gestures to specific words with frame-accurate temporal boundaries. Comprising 156,688 manually annotated video clips, GRW spans a highly diverse 150-word taxonomy of physical actions, spatial descriptors, and abstract concepts. We leverage GRW to train video models to (a) classify gestures as semantic or not, (b) recognize the word corresponding to a co-speech gesture, and (c) temporally localize the gesture. We also use GRW to establish benchmarks for these three tasks.

[137] EGOSTREAM: A Diagnostic Benchmark for Streaming Episodic Memory in Egocentric Vision cs.CVPDF

Rosario Forte, Giuseppe Lando, Antonino Furnari

TL;DR: 本文提出了EGOSTREAM，一个用于评估第一人称视角流式情景记忆的诊断性基准测试。该基准包含2,250个精心设计的问题，涵盖七个认知维度，并引入了答案有效性窗口（AVW）概念，将问题扩展为8,528个回忆条件评估，以区分模型遗忘与真实世界状态变化。研究在一个统一的流式多模态大语言模型框架下，比较了多种先进的记忆管理机制，揭示了不同机制在记忆特性上的显著差异，并指出当前所有机制的性能和效率均存在严重不足。

Details

Motivation: 当前流式视频基准测试缺乏有效的工具来诊断模型记住了什么以及记忆能持续多久，这限制了在动态真实世界环境中运行的自主智能体所需的核心能力——连续情景记忆的发展。

Result: 在统一的Qwen3-VL骨干网络上进行的实验表明，尽管总体准确率相近，但不同记忆管理机制的记忆特性差异巨大。例如，token剪枝在保留细粒度细节和时间结构上显著优于token合并，而量化卸载则能挽救超长期记忆。所有机制的处理速度均远低于实时（>1秒/帧），且最佳方法的准确率上限约为45%，暴露了当前架构的关键缺陷。

Insight: 论文的核心创新点在于提出了一个结构化的诊断性基准（EGOSTREAM）和答案有效性窗口（AVW）概念，这为精细评估和区分模型记忆能力提供了新工具。从客观角度看，该研究通过系统比较多种记忆管理机制，揭示了不同技术路径在记忆保留特性上的权衡，为未来高效、长时记忆架构的设计指明了具体的研究缺口和方向。

Abstract: Continuous episodic memory is a core capability for autonomous agents operating in dynamic, real-world environments, yet current streaming video benchmarks provide limited tools for diagnosing what models remember and for how long. We introduce \egostream, a diagnostic benchmark for streaming episodic memory evaluation in egocentric vision. \egostream organizes 2,250 curated questions along seven cognitive dimensions: detail, spatial, temporal, event, social, causal, and prospective memory. We introduce the Answer Validity Window (AVW), which specifies the temporal span an answer remains valid as the observed scene evolves. This allows us to expand the questions into 8,528 recall-conditioned evaluations, enabling controlled testing from instant to ultra-long-term recall while separating genuine model forgetting from natural world-state changes. We rigorously establish baseline performance through a unified streaming MLLM framework that compares several state-of-the-art memory-management mechanisms, covering sliding windows, attention sinks, KV-cache pruning, merging, and offloading. Experiments within a unified Qwen3-VL backbone reveal that comparable aggregate accuracies mask starkly different memory profiles. For instance, token pruning preserves fine-grained details and temporal structure significantly better than token merging, while quantized offloading rescues ultra-long-term recall. Ultimately, all mechanisms operate well below real-time (>1s per frame), and top performing methods ceil at about 45% accuracy, exposing critical gaps in current architectures. \egostream provides the diagnostic testbed needed to close these gaps.

[138] TunerDiT: Training-free Progressive Steering of Diffusion Transformer for Multi-Event Video Generation cs.CV | cs.AIPDF

Ruotong Liao, Guowen Huang, Qing Cheng, Guangyao Zhai, Lei Zhang

TL;DR: 本文提出TunerDiT，一种无需训练的渐进式引导方法，用于解决多事件视频生成中的挑战。该方法通过分析扩散Transformer的去噪轨迹，发现文本条件在特定转折点影响生成的全局布局和细节，并设计了事件分区掩码和跨事件提示融合两个引导机制。在自建的多事件视频基准Meve上，TunerDiT在8个指标上达到SOTA性能。

Details

Motivation: 解决文本到视频生成中长时域多事件视频生成的难题，现有方法在生成包含多个连续事件的视频时面临一致性与事件分离的平衡问题。

Result: 在自建的多事件视频基准Meve上，TunerDiT在8个评估指标上达到最先进水平，相比其他无需训练的方法，在视频一致性和事件分离之间提供了可调节的权衡。文本对齐度随事件数量增加而提升，显示出良好的扩展性。

Insight: 创新点在于发现扩散Transformer去噪轨迹中的内在转折点，并基于此设计无需训练的渐进引导机制；事件分区掩码允许跨事件过渡带，跨事件提示融合引入相邻事件语义进行后期细化，这些设计平衡了事件连贯性与独立性。

Abstract: Text-to-video (T2V) generation faces challenging questions when generating videos with long horizons containing multiple events. Inspired by the intrinsics of the diffusion process, we probe video diffusion transformers (DiTs) and uncover intrinsic turning points in the DiT denoising trajectory where conditioning text affects generation from global layout to fine-grained details. Building on this finding, we present TunerDiT, a simple yet effective progressive steering method that requires no additional training for multi-event generation. TunerDiT comprises two steering handles: (1) Event-Partitioned Masking that enforces event boundaries while allowing cross-event transition bands; (2) Cross-Event Prompt Fusion that injects neighboring event semantics for late-stage refinement. We contribute a self-curated prompt suite for benchmarking multi-event generation, i.e., Meve. TunerDiT achieves state-of-the-art performance across 8 metrics and offers a tunable trade-off between video consistency and event separation, compared with other training-free methods. The improvement in text alignment increases with the event count, indicating a scaling possibility with increasing event count.

[139] CoFiDA-M: Concept-Aware Feature Modulation for Cross-Domain Adaptation with Image-Only Inference cs.CVPDF

Nurjahan Sultana, Moi Hoon Yap, Xinqi Fan, Wenqi Lu

TL;DR: 本文提出CoFiDA-M，一种用于跨域适应的概念感知特征调制方法，旨在解决AI皮肤癌筛查模型从专业皮肤镜图像迁移到消费级临床图像时性能下降的问题。该方法利用训练时的概念信息（如MONET模型提供的概率性语义概念）作为特权信息，通过教师-学生蒸馏框架，将临床推理‘烘焙’到仅使用图像推理的学生网络中，从而在测试时无需额外元数据即可实现高性能部署。

Details

Motivation: 现有域适应方法常忽略关键的语义不变性（如临床概念），而新基础模型（如MONET）能提供密集的概率性概念分数，但这些元数据在测试时不可用，导致实际部署中仅依赖图像的筛查工具面临‘部署悖论’。

Result: 在具有挑战性的多数据集基准测试中，仅使用图像推理的学生网络显著优于现有最先进方法，尤其在黑色素瘤召回率方面表现突出，展示了强大的跨数据集鲁棒性。

Insight: 创新点在于提出特权信息框架，将噪声、概率性元数据作为训练时的概念指导，通过FiLM调制器将视觉特征转换为语义‘编辑’的特征空间，并蒸馏到轻量级学生网络中，实现无需额外元数据的部署；这为利用语义信息提升跨域适应性能提供了通用且实用的方案，可扩展至皮肤病学以外的领域。

Abstract: Models for AI-based skin cancer screening suffer a severe performance drop when shifting from expert dermoscopic (source) images to consumer-grade clinical (target) images, hindering real-world deployment. Existing domain adaptation methods often ignore crucial semantic invariants, such as clinical concepts. While new foundation models like MONET can provide this semantic information as dense, probabilistic scores, this metadata is unavailable at test time, creating a deployment paradox for practical image-only screening tools. We address this gap by proposing CoFiDA-M, a privileged information framework that learns from concepts at training time but deploys as an image-only model. Our method trains a teacher network that uses MONET concept probabilities to guide a FiLM modulator, transforming visual features into a semantically edited" feature space. A lightweight, image-only student is then trained to reproduce this edited representation, not just the teacher's final predictions. This distillation bakes” the clinical reasoning into the student’s weights. On a challenging multi-dataset benchmark, our image-only student significantly outperforms state-of-the-art approaches, especially in melanoma recall. Our work provides a practical and generalizable framework for leveraging noisy, probabilistic metadata as privileged information, demonstrating strong cross-dataset robustness and potential for real-world deployment beyond dermatology. Implementation code is available at: https://github.com/mmu-dermatology-research/CoFiDA.git

[140] Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction cs.CVPDF

Mungyeom Kim, Minkyeong Jeon, Honggyu An, Jaewoo Jung, Hyuna Ko

TL;DR: 本文提出C4G，一种基于紧凑高斯查询令牌的前馈式4D重建框架，用于从单目视频重建动态场景。该方法通过时间戳条件化的高斯令牌聚合全时序特征并解码3D高斯，实现全局一致的运动建模，无需逐场景优化，并引入视频扩散模型增强渲染细节。

Details

Motivation: 现有前馈方法逐帧逐像素预测3D高斯，存在高斯重复和视图依赖偏差问题，阻碍了场景运动的有效学习，因此需要一种能建模全局运动且更紧凑的表示方法。

Result: C4G在显著减少高斯数量且无需相机位姿的情况下，实现了强大的新视角合成性能，在运动建模和对大时间间隔的鲁棒性方面表现更优。

Insight: 创新点在于使用紧凑的、时间戳条件化的可学习高斯查询令牌来聚合时序特征并解码动态3D高斯，实现了全局一致的运动建模；同时将特征聚合能力扩展到特征提升，生成支持点跟踪和动态场景理解的4D特征场。

Abstract: Dynamic scene reconstruction from monocular video remains a fundamental challenge in computer vision. Existing feed-forward methods predict 3D Gaussians pixel-wise for each frame, suffering from duplicated Gaussians and view-dependent biases that hinder effective learning of scene motion. We present C4G, a feed-forward 4D reconstruction framework built upon a compact set of timestamp-conditioned learnable Gaussian query tokens. Each token aggregates corresponding features across the full temporal context and decodes a 3D Gaussian whose position is modulated by the target timestamp, enabling globally coherent motion modeling without per-scene optimization. To capture fine-grained details, we further introduce a video diffusion model-based rendering enhancement module. Since our framework effectively aggregates features into Gaussians, we extend this capability to feature lifting, producing a 4D feature field that supports point tracking and dynamic scene understanding. C4G achieves strong novel-view synthesis performance using significantly fewer Gaussians and without requiring camera poses, while exhibiting stronger motion modeling and robustness to large temporal gaps.

[141] SOCO: Benchmarking Semantic Object Correspondence in Vision Foundation Models cs.CVPDF

Olaf Dünkel, Basavaraj Sunagad, Haoran Wang, David T. Hoffmann, Christian Theobalt

TL;DR: 论文提出了一个名为SOCO的新基准测试，用于系统评估视觉基础模型中的语义对象对应关系能力。该基准引入了一种对应关系类型的分类法，并在100个类别中提供了超过100万个功能上有意义的关键点标注，还包括关键点的语言描述，以评估大型视觉语言模型。

Details

Motivation: 由于评估协议不一致和部件级监督有限，衡量视觉基础模型中的结构化对象理解能力仍然具有挑战性。语义对应关系通过测试对象部件能否在实例和类别之间、在存在外观、视角和几何形状巨大变化的情况下进行匹配，来评估这种能力。

Result: 综合实验表明：视觉基础主干编码了强大的语义结构，但在相关类别间的对应关系迁移能力较差，且仅部分捕获了对象部件的位置；大型视觉语言模型在文本提示的部件定位方面强于基于视觉参考的跨图像匹配，揭示了基于语言的定位与细粒度视觉对应之间的差距；对应关系性能比ImageNet分类更能预测下游密集任务（如分割、跟踪、3D姿态估计和3D检测）的性能。

Insight: 创新点在于提出了一个系统性的、包含语言描述的语义对应基准SOCO，并利用它揭示了视觉基础模型在部件级理解和跨模态能力上的具体差距。从客观角度看，该基准为评估模型的结构化表示质量提供了一个新的、与下游任务强相关的度量标准。

Abstract: Measuring structured object understanding in vision foundation models remains challenging due to inconsistent evaluation protocols and limited part-level supervision. Semantic correspondence (SC) evaluates this capability by testing whether object parts can be matched across instances and categories under large variations in appearance, viewpoint, and geometry. To enable a systematic SC evaluation, we introduce SOCO, a new benchmark for Semantic Object Correspondence that introduces a taxonomy of correspondence types and provides consistent, functionally meaningful keypoint annotations across 100 categories and over 1M correspondence pairs. In addition, SOCO includes keypoint language descriptions, enabling the evaluation of large vision-language models (LVLMs) and their fine-grained part-level understanding. Comprehensive experiments reveal that (i) vision foundation backbones encode strong semantic structure but transfer correspondences poorly across related categories and only partially capture object-part position, (ii) LVLMs are stronger at text-prompted part localization than at visual-reference cross-image matching, exposing a gap between language-grounded localization and fine-grained visual correspondence, and (iii) correspondence performance predicts performance on dense downstream tasks, including segmentation, tracking, 3D pose estimation, and 3D detection, more strongly than ImageNet classification. Together, these findings position SOCO as a benchmark for structured, part-level representation quality in vision and multimodal foundation models.

[142] Lumos-Nexus: Efficient Frequency Bridging with Homogeneous Latent Space for Video Unified Models cs.CV | cs.AIPDF

Jiazheng Xing, Hangjie Yuan, Lingling Cai, Xinyu Liu, Yujie Wei

TL;DR: 本文提出了Lumos-Nexus，一个高效的视频统一生成框架，旨在解决现有基于连接器的视频统一模型因集成高保真生成器导致训练成本过高的问题。该框架采用两阶段设计：训练时仅对齐轻量级生成器以学习推理驱动的语义控制；推理时通过统一的渐进式频率桥接技术，在共享的隐空间中将生成任务逐步移交给预训练的高容量生成器，从而实现从粗到细的优化，生成高保真视频。

Details

Motivation: 现有基于连接器的视频统一模型在指令驱动的视频合成中表现出色，但将大型高保真生成器集成到统一训练循环中计算成本过高，限制了可实现的视觉质量。因此，需要一种训练高效的框架，既能发展强大的推理驱动生成能力，又能显著提升视觉保真度。

Result: 大量实验表明，Lumos-Nexus在VBench基准上实现了视觉真实性和时间连贯性的显著提升，同时在作者新提出的VR-Bench基准上展现出强大的基于推理的生成性能。

Insight: 核心创新点在于两阶段设计，特别是推理阶段引入的统一渐进式频率桥接技术，它允许在共享的隐空间中高效利用预训练的高容量生成器进行细化，而无需在训练中直接对齐，从而平衡了推理质量与视觉保真度。此外，作者提出的VR-Bench为评估推理驱动的视频生成能力提供了新的基准。

Abstract: Connector-based video unified models have demonstrated strong capability in instruction-grounded video synthesis, but integrating a large high-fidelity generator into the unified training loop is computationally prohibitive, limiting achievable visual quality. We therefore propose Lumos-Nexus, a training-efficient unified video generation framework that facilitates the development of strong reasoning-driven generation capabilities while significantly enhancing visual fidelity. Lumos-Nexus adopts a two-stage design: 1) During training, only a lightweight generator is aligned with the understanding block to learn to take in reasoning-driven semantic control. 2) During inference, we introduce Unified Progressive Frequency Bridging (UPFB) to progressively hand off generation to a high-capacity pretrained generator in the shared latent space, enabling coarse-to-fine refinement and producing high-fidelity videos without compromising reasoning quality. To fill the gap in reasoning-driven video generation benchmarks, we introduce VR-Bench, which assesses a model’s capability to translate inferred intent into coherent and semantically aligned video content. Extensive experiments demonstrate that Lumos-Nexus achieves substantial gains in visual realism and temporal coherence on VBench, while exhibiting strong reasoning-based generative performance on VR-Bench. Code and models are available at https://jiazheng-xing.github.io/nexus-lumos-home/.

[143] Linear Scaling Video VLMs for Long Video Understanding cs.CVPDF

Cristobal Eyzaguirre, Jiajun Wu, Juan Carlos Niebles

TL;DR: 本文提出了一种名为StateKV的推理时方法，旨在解决视频视觉语言模型（VLMs）在处理长视频时因时空自注意力导致的二次计算增长问题。该方法通过一个基于重要性的固定容量循环状态来携带跨帧上下文，并结合一个用于解码的完整逐帧缓存，实现了线性时间的视频预填充，从而在保持接近全自注意力精度的同时显著提升了计算效率。

Details

Motivation: 当前视频VLMs在处理长视频或流式场景时，其视频编码器通常依赖时空自注意力，导致计算量和延迟随帧数呈二次增长。现有提升效率的方法（如激进地丢弃帧/令牌或粗略的注意力近似）往往以牺牲精度为代价，因此需要一种既能保持模型精度又能实现线性计算扩展的解决方案。

Result: 在三个长视频基准测试和涵盖三个模型家族、多种规模的七个模型上，StateKV的性能接近全自注意力，并始终优于主流的基于滑动窗口/最近邻的流式近似方法，且无需微调或架构修改。同时，StateKV显著降低了视频预填充的计算成本（以FLOPs衡量），使得在固定计算预算下运行更大模型成为可能，从而获得更强的准确性。

Insight: 论文的核心创新在于提出了一种推理时适配方法，通过引入一个基于重要性的循环状态来高效管理跨帧长程依赖，实现了计算复杂度的线性化。这为预训练的长视频VLMs提供了一种无需重新训练即可显著提升推理效率的实用途径，是迈向可扩展长视频理解的重要一步。

Abstract: Video vision-language models (VLMs) are increasingly used in long-horizon and streaming settings, yet most video encoders still rely on spatiotemporal self-attention, causing compute and latency to grow quadratically with the number of frames. Existing efficiency methods improve scalability but often lose accuracy relative to full self-attention, for example through aggressive frame/token dropping or coarse attention approximations. We introduce StateKV, an inference-time method that adapts pretrained long-video VLMs to linear-time video prefill by carrying cross-frame context in a fixed-capacity, importance-based recurrent state, paired with a second full per-frame cache used for decoding. Across three long-video benchmarks and seven models spanning three families and multiple scales, StateKV remains close to full self-attention and consistently outperforms dominant sliding-window / recency-based streaming approximations, without fine-tuning or architectural changes. StateKV also reduces video-prefill cost measured FLOPs, enabling stronger accuracy at a fixed compute budget by running larger models. These results suggest a practical step toward scalable long-video understanding.

[144] Representation Forcing for Bottleneck-Free Unified Multimodal Models cs.CVPDF

Yuqing Wang, Zhijie Lin, Ceyuan Yang, Yang Zhao, Fei Xiao

TL;DR: 本文提出了一种称为表示强制（Representation Forcing, RF）的技术，旨在解决统一多模态模型（UMMs）中因依赖外部预训练VAE进行图像生成而引入的结构瓶颈问题。RF通过强制解码器在预测像素之前自回归地预测视觉表示作为中间标记，使表示预测成为模型的内在能力，从而无需外部生成潜在空间。该方法在图像生成和理解任务上均表现出色，推动了端到端、无瓶颈UMMs的发展。

Details

Motivation: 现有统一多模态模型（UMMs）仍依赖冻结的、单独预训练的VAE进行图像生成，这引入了结构瓶颈，而直接移除VAE会导致模型需从原始像素同时学习高级结构和低级细节，造成质量差距。本文旨在消除这一瓶颈，实现真正的端到端多模态建模。

Result: 在图像生成任务上，采用RF的像素空间模型与基于VAE的最先进统一模型性能相当；在图像理解任务上，像素空间RF通常优于其基于VAE的变体。这些结果表明RF在多个基准测试上达到了SOTA或可比水平。

Insight: 核心创新点是将视觉表示从感知输出转变为生成目标，通过自回归预测中间表示标记来引导同一骨干网络内的像素扩散，从而统一了理解和生成过程。这提供了一种无需外部潜在空间的端到端建模新思路，有效提升了模型的内聚性和性能。

Abstract: Unified multimodal models (UMMs) aim to handle perception and generation in a single model. Yet existing UMMs still rely on a frozen, separately pretrained VAE for image generation, imposing a structural bottleneck. Naively removing it introduces a quality gap, as the model must learn both high-level structure and low-level details from raw pixels. In this paper, we propose Representation Forcing (RF), a technique that closes this gap by making representation prediction a native capability of the model. Concretely, RF forces the decoder to autoregressively predict visual representations as intermediate tokens before pixels; these tokens then stay in context to guide pixel diffusion within the same backbone. By turning representations from perception outputs into generation targets, RF eliminates the need for any external generative latent space. We find that RF benefits both understanding and generation. On image generation, our pixel-space model with RF matches state-of-the-art VAE-based unified models. On image understanding, pixel-space RF generally outperforms its VAE-based variant. Together, these results offer an effective step toward end-to-end, bottleneck-free UMMs.

cs.SE [Back]

[145] Improving Small Language Models for Code Generation with Reinforcement Learning from Verification Feedback cs.SE | cs.CLPDF

Egor Skopin, Evgeny Kotelnikov

TL;DR: 本文通过实证研究探讨了基于可验证奖励的强化学习（RLVR）在小型语言模型（Qwen3-0.6B和Llama3.2-1B）上优化Python代码生成的效果。研究在MBPP基准上比较了不同奖励设计（如仅单元测试奖励、仅静态分析奖励及其组合）和基于组的策略优化方法（GRPO和GSPO），发现RLVR在组合奖励配置下可将pass@1提升高达13个百分点，但奖励设计对模型行为有显著影响。

Details

Motivation: 动机是研究如何利用可验证奖励（如单元测试结果、静态分析）通过强化学习直接优化代码生成的功能正确性，并探索不同奖励设计对小型语言模型行为的影响。

Result: 在MBPP基准测试中，RLVR在提出的组合奖励配置下将pass@1提升了高达13个百分点。然而，仅使用静态分析惩罚会导致模型偏向生成更短但功能正确性未可靠提升的代码，而组合奖励能缓解这种退化并在正确性与风格约束间实现更稳定的权衡。

Insight: 创新点在于系统评估了RLVR中奖励设计（单元测试、静态分析及其组合）和优化粒度对代码生成效果的影响，并强调超越pass@1的诊断指标（如生成长度、Ruff严重性分布和执行错误类型）对于识别失败模式的重要性。从客观角度看，研究揭示了奖励塑造在强化学习训练中的关键作用及其可能引发的系统性行为偏移，为代码生成模型的稳健优化提供了实用见解。

Abstract: Reinforcement learning with verifiable rewards (RLVR) trains language models using programmatically checkable signals such as unit-test outcomes, enabling direct optimization for functional correctness in code generation. We conduct an empirical study of RLVR for Python code generation on the MBPP benchmark using two small models (Qwen3-0.6B and Llama3.2-1B) with LoRA fine-tuning. Across multiple reward formulations such as: unit-test-only rewards, static-analysis-only shaping via the Ruff linter, and a combined reward, we compare group-based policy optimization variants (GRPO and GSPO) and evaluate both functional correctness and behavioral diagnostics. In our experimental setting, RLVR improves pass@1 on MBPP test by up to 13 percentage points under proposed combined reward configuration. However, we find that reward shaping can induce systematic behavioral shifts: using only static-analysis penalties may bias the policy toward shorter completions that reduce lint errors without reliably improving functional correctness. In contrast, combined rewards mitigate this degeneration and yield more stable trade-offs between correctness and style constraints. Overall, our results highlight that RLVR effectiveness for code generation is highly sensitive to reward design and optimization granularity, and that diagnostics beyond pass@1, including generation length, Ruff severity profiles, and execution error types are useful for identifying failure modes.

[146] Knowledge Boundary Probing and Demand-Guided Intervention for LLM-Based Power System Code Generation cs.SE | cs.CL | eess.SYPDF

Hui Wu, Xiaoyang Wang, Zhong Fan

TL;DR: 本文针对电力系统代码生成任务中LLM存在的API知识边界错误问题，提出了PowerCodeBench基准测试生成器、L0-L3文档驱动探测方法以及边界感知干预策略。该方法通过评估模型API知识剖面，并结合需求估计进行主动文档注入和反应式修正，显著提升了多种开源和商用LLM在电力系统代码生成上的准确率，为无需微调或云端推理的本地可靠LLM辅助电网分析提供了部署方案。

Details

Motivation: 解决在电力系统分析自动化中，由于保密、监管、可复现性和成本原因而需要本地部署的LLM所面临的可靠性问题，特别是其代码生成中由结构化API知识边界错误（如幻觉函数名、参数误用、结果表处理错误）导致的首轮失败。

Result: 在包含2000个任务的固定版本上评估了10个开源LLM（1.5B-480B参数）和4个商用中端API。干预策略使所有评估的至少7B参数的开源模型和所有商用API的准确率提升了32到56个百分点。70B-120B参数范围的开源模型达到了商用中端API的准确率范围，其中Llama-3.1-405B和Qwen3-Coder-480B表现最佳。定向提示在仅使用41%提示令牌成本的情况下保持了全上下文准确率上限。

Insight: 创新点在于将代码生成失败归因于结构化API知识边界错误，并提出了系统性的文档驱动探测和边界感知干预框架。该方法通过需求引导的主动/反应式干预，在不大幅增加计算成本的前提下有效弥补了模型的专业领域API知识缺口，为领域特定、资源受限的本地化LLM可靠部署提供了可借鉴的路径。

Abstract: Large language models (LLMs) are increasingly used to automate power-system analysis, but many utilities and energy-research labs require on-premise serving for confidentiality, regulatory, reproducibility, and cost reasons. This makes the reliability of open-weight models a deployment issue. We show that first-pass failures in power-system code generation are dominated not by reasoning alone, but by structured API-knowledge boundary errors: hallucinated function names, misused parameters, and mishandled result tables in versioned simulation libraries. We introduce PowerCodeBench, an execution-validated benchmark generator that pairs natural-language operator queries with pandapower code and numerical ground truth; an L0-L3 documentation-driven probing procedure that measures per-model API knowledge profiles; and a boundary-aware intervention that combines query-side API demand estimation with targeted proactive documentation injection and routed reactive correction. On a 2,000-task frozen release, we evaluate ten open-weight LLMs (1.5B-480B parameters) and four commercial mid-tier APIs. The intervention improves every evaluated open-weight model of at least 7B parameters and every commercial API by 32 to 56 accuracy points. Open-weight models in the 70B-120B range match the commercial mid-tier accuracy range, while Llama-3.1-405B and Qwen3-Coder-480B lead the panel. The targeted prompts preserve the full-context accuracy ceiling while using 41% of the prompt-token cost. The result is an accuracy-side, deployment-time path toward reliable on-premise LLM assistance for grid-analysis workflows without fine-tuning or cloud inference.

cs.MM [Back]

[147] A Pilot Study on Curator-Guided Multilingual Art Description for Blind and Low-Vision Audiences with Small Vision-Language Models cs.MM | cs.AI | cs.CL | cs.CV | cs.HCPDF

Iosif Tsangko, Andreas Triantafyllopoulos, George Margetis, Ioana Crihana, Björn W. Schuller

TL;DR: 本研究探索了在博物馆等隐私和知识产权受限场景下，利用小型视觉语言模型为视障和低视力群体提供多语言艺术描述。研究以Qwen2.5-VL-3B-Instruct模型为基础，针对德语、罗马尼亚语和塞尔维亚语，构建了面向BLV的平行描述语料库，并比较了语言特定LoRA适配器与单一多语言适配器的性能。

Details

Motivation: 解决视障和低视力观众在视觉艺术描述方面，尤其是在多语言和博物馆环境中服务不足的问题，这些环境因隐私和知识产权限制而倾向于使用本地部署的小型视觉语言模型。

Result: 在实验设置下，针对罗马尼亚语和塞尔维亚语，语言特定适配器在可控性和视觉描述质量上表现更稳定；而多语言适配器在德语上仍具竞争力。评估结合了自动词汇/嵌入指标以及经小型罗马尼亚BLV试点研究校准的LLM-as-Judge协议。

Insight: 为本地部署的小型VLM提供了面向实际部署的证据；研究强调了在得出关于多语言可访问性的普遍结论前，需要进行更大规模的BLV用户研究和更广泛的语言覆盖。方法上，比较语言特定与多语言适配器在固定骨干和训练预算下的表现是一个实用的工程视角。

Abstract: Blind and low-vision (BLV) audiences remain underserved by visual art descriptions, particularly across languages and in museum settings where privacy and intellectual-property constraints may favour small on-premise vision-language models (VLMs). This pilot study investigates curator-guided multilingual art description with Qwen2.5-VL-3B-Instruct for German, Romanian, and Serbian. We construct a parallel BLV-oriented caption corpus from artwork images and metadata, and compare language-specific LoRA adapters with a single multilingual adapter under a fixed backbone and training budget. Evaluation combines automatic lexical and embedding-based metrics with an LLM-as-Judge protocol calibrated against a small Romanian BLV pilot study. Under our pilot setup, language-specific adapters show more stable controllability and visually grounded description quality for Romanian and Serbian, while multilingual adaptation remains competitive in German. We frame these findings as deployment-oriented evidence for small on-premise VLMs, and highlight the need for larger BLV user studies and broader language coverage before drawing general conclusions about multilingual accessibility.

eess.AS [Back]

[148] ImmersiveTTS: Environment-Aware Text-to-Speech with Multimodal Diffusion Transformer and Domain-Specific Representation Alignment eess.AS | cs.AI | cs.CLPDF

Jun-Hak Yun, Seung-Bin Kim, Seong-Whan Lee

TL;DR: 本文提出了ImmersiveTTS，一种环境感知的文本到语音模型，旨在生成与环境音频无缝融合的自然语音。该模型基于多模态扩散Transformer，通过联合注意力机制融合文本对齐的语音潜变量和文本条件化的环境上下文，并引入了领域特定的表示对齐目标以增强语义一致性。

Details

Motivation: 解决在生成语音时，如何使其与背景环境音频在声学模式和时间动态上自然融合的挑战，因为两者存在固有差异。

Result: 实验结果表明，ImmersiveTTS在客观指标和人类听力测试中，在自然度、清晰度和音频保真度方面均优于现有方法。

Insight: 创新点在于使用多模态扩散Transformer显式建模跨模态交互，以及引入针对环境感知TTS的领域特定表示对齐目标，利用语音和音频编码器的互补自监督表示来提升语义一致性。

Abstract: Recent advancements in text-guided audio generation have yielded promising results in diverse domains, including sound effects, speech, and music. However, jointly generating speech with environmental audio remains challenging due to the inherent disparities in their acoustic patterns and temporal dynamics. We propose ImmersiveTTS, an environment-aware text-to-speech (TTS) model that generates natural speech seamlessly integrated within environmental contexts by explicitly modeling cross-modal interactions. Our model builds on a multimodal diffusion transformer and fuses transcript-aligned speech latent with text-conditioned environmental context via joint attention. To enhance semantic consistency, we introduce a domain-specific representation alignment objective tailored to environment-aware TTS, leveraging complementary self-supervised representations from speech and audio encoders. Experimental results show that ImmersiveTTS achieves higher naturalness, intelligibility, and audio fidelity than existing approaches across objective metrics and human listening tests.

cs.MA [Back]

Tom Pecher

TL;DR: 本文首次通过大语言模型的多智能体辩论（LLM-MAD）模拟了论证推理理论（ATR），即真理是通过集体对抗性话语涌现的社会认知属性。研究表明，当精心设计一组具有认知多样性的模型时，LLM-MAD能显著提升基于问卷任务的求真性能，即使单个辩论参与者独立表现有限。此外，论文还提出了一种利用LLM-MAD衡量模型内在属性（如幻觉倾向）的新基准方法。

Details

Motivation: 动机源于论证推理理论（ATR），该理论认为人类推理本质上是社会性的，真理是通过集体对抗性辩论涌现的，而非孤立个体认知。论文旨在探索是否能在机器中模拟这种集体求真动态，以提升大语言模型的推理性能。

Result: 在基于问卷的求真任务上，LLM-MAD显著提升了性能，且性能增益机制上根植于ATR的核心原则。结果表明集体推理可能普遍优于个体主义推理，而不仅仅是生物或进化的特例。

Insight: 创新点在于首次通过LLM-MAD模拟ATR，证明了集体对抗性辩论能有效提升机器求真能力，并基于辩论动态分析提出了一种可衡量模型内在属性（如幻觉倾向）的新基准方法，超越了当前静态基准的局限。

Abstract: Human reasoning has long been theorised to operate socially, not through isolated individual cognition, but through collective adversarial discourse, a framework known as the Argumentative Theory of Reasoning (ATR). Rather than relying on individual “intellectualist reasoners” as the primary vehicle for truth-seeking, ATR reconceptualises truth as an emergent property of social epistemology: the product of imperfect individual reasoning refined under the adversarial pressure of debate. This distributed method of collective intelligence has guided humanity to ever-greater epistemic heights and underpins the foundational principles of all democratic systems. This thesis breaks new ground by, for the first time, simulating ATR through the multi-agent debate (MAD) of large language models (LLMs). With rigorous empirical analysis, we demonstrate that, when correctly engineering an epistemically diverse set of models, LLM-MAD can significantly improve truth-seeking performance on questionnaire-based tasks, even when individual debate participants exhibit limited standalone performance. Furthermore, we present strong empirical evidence that this performance gain is mechanistically grounded in the central principles of ATR, suggesting that collective reasoning may be universally favourable over individualist reasoning, rather than a quirk in biology or evolution. Finally, drawing on our analysis of debate dynamics, we propose a novel benchmarking methodology that leverages LLM-MAD to measure intrinsic model properties (such as hallucination propensity) in order to compare models in ways that current static benchmarking approaches cannot support.

cs.LG [Back]

[150] MAAT: Multi-phase Adapter-Aware Targeted Unlearning cs.LG | cs.CLPDF

Suryash Yagnik, Shubham Gaur, Saksham Thakur, Vinija Jain, Aman Chadha

TL;DR: 本文提出了5WBENCH，一个包含5000个样本的平衡基准测试集，用于评估机器遗忘在因果知识上的表现，并揭示了现有方法在Why类问题上的不足。针对这一问题，作者提出了MAAT框架，通过多阶段操作LoRA适配器权重，首次在因果遗忘任务中同时实现了高遗忘率和高知识保留。

Details

Motivation: 现有机器遗忘评估数据集（如CounterFact、ZSRE等）中因果推理类（Why-type）问题占比极低（<1.3%），导致无法有效检测方法在因果知识遗忘上的失败，因此需要构建平衡的评估基准并开发针对性解决方案。

Result: 在提出的5WBENCH基准上，MAAT是首个在Why类因果知识上同时实现高遗忘和高保留的方法，在遗忘-保留帕累托前沿上达到了新的最优操作点。

Insight: 创新点在于构建了首个平衡的5W分类遗忘评估基准5WBENCH，并设计了基于LoRA适配器的多阶段框架MAAT，通过梯度投影上升、SVD秩修剪、任务向量取反和混合KL-隐状态修复等技术的组合，有效解决了因果知识遗忘中遗忘与保留的权衡难题。

Abstract: Machine unlearning evaluation is structurally skewed: Why-type questions, which probe causal and relational knowledge, comprise less than 0.06% of CounterFact, 0.6% of ZSRE, and less than 1.3% of TOFU, MUSE, and WMDP-Cyber. This near-zero representation means that methods that fail on causal knowledge can score highly in aggregate, and this failure is undetectable without balanced evaluation. We present 5WBENCH, a balanced 5,000-sample benchmark with 1,000 examples per 5W category (Who, What, When, Where, Why), making causal unlearning failures quantifiable for the first time. Using 5WBENCH, we show that no existing baseline simultaneously achieves high forgetting and high retention on Why-type questions: aggressive forgetting degrades retained knowledge, while conservative methods fail to forget causal facts. Why-type difficulty stems from multi-hop reasoning chains (44% of Why entries vs. less than or equal to 2% for others) and gradient dilution over 40.1-token answer spans. We present MAAT (Multi-phase Adapter-Aware Targeted Unlearning), a three-phase framework operating on LoRA adapter weights, combining gradient-projected ascent, SVD rank-dimension pruning, task vector negation, and hybrid KL-hidden-state retain repair. MAAT is the first method to simultaneously achieve high forgetting and high retention on Why-type causal knowledge, reaching a new operating point on the forget-retain Pareto frontier. We make our code publicly available.

[151] AMNESIA: A Large Scale Medical Unlearning Benchmark Suite with Disease-Informed Analysis cs.LG | cs.CLPDF

Saeedeh Davoudi, Reihaneh Iranmanesh, Ophir Frieder, Nazli Goharian

TL;DR: 本文提出了AMNESIA，这是首个大规模、开源的医学遗忘基准套件，包含来自11种疾病类别、8820份患者记录的70560个问答对，用于评估医疗大语言模型（LLM）的遗忘能力。该基准包含测试直接回忆的事实性问题和测试临床推理的推理问题，并引入了一种新的医学术语泄露检测指标。研究评估了四种广泛使用的遗忘方法，发现遗忘单个患者会侵蚀模型对其他患有相同疾病患者的知识，表明需要能更好区分患者与共享临床知识的方法。

Details

Motivation: 医学知识持续演变，需要更新或选择性遗忘已训练医疗LLM中的信息，而现有遗忘基准依赖合成或小规模通用数据，临床遗忘研究不足。

Result: 在AMNESIA基准上评估了四种广泛使用的遗忘方法，发现遗忘个体患者会损害模型对患有相同疾病的其他患者的知识。

Insight: 创新点在于构建了首个大规模、疾病信息分析驱动的医学遗忘基准，并引入了医学术语泄露检测新指标，揭示了患者级遗忘对共享临床知识的意外影响，为开发更精准的医学遗忘方法提供了方向。

Abstract: Medical knowledge is continuously evolving. This creates a need to update or selectively forget information encoded in already-trained medical LLMs. Machine unlearning aims to remove the influence of specific training data from a model without full retraining. Yet, existing unlearning benchmarks rely on synthetic or small-scale general data, leaving clinical unlearning understudied. We introduce AMNESIA, the first large-scale, open source benchmark for medical unlearning, with 70,560 question-answer pairs from 8,820 patient notes across 11 disease categories. AMNESIA includes both factual questions testing direct recall and reasoning questions testing clinical inference. We use it to evaluate four widely used unlearning methods at both random patient and disease-level, and introduce a new metric for detecting leakage of medical terminology. We show that unlearning individual patients erodes knowledge of others with the same condition, calling for methods that can better separate patients from shared clinical knowledge.

[152] Diversity Matters: Revisiting Test-Time Compute in Vision-Language Models cs.LG | cs.CV | cs.MMPDF

Yijie Tong, Yifan Hou, Shaobo Cui, Antoine Bosselut, Mrinmaya Sachan

TL;DR: 本文系统研究了视觉语言模型中的测试时计算策略，发现传统投票方法因预测多样性不足而效果有限，并提出基于熵的ETTC方法，通过利用模型间的置信度差异来提升集成效果，使小模型能够协同增强大模型性能。

Details

Motivation: 针对测试时计算策略在视觉语言模型中应用不足的问题，研究旨在探索如何有效利用多模型集成来提升推理性能，特别是解决传统投票方法因预测相关性强和模型能力差异而效果受限的挑战。

Result: 在七个视觉语言模型和六个基准测试上的实验表明，ETTC方法在模型集成设置中一致优于多数投票和最佳单模型，实现了显著的性能提升，验证了其理论优势。

Insight: 创新点在于提出ETTC方法，通过基于预测熵的置信度选择机制，有效利用模型能力差异，解决了传统集成方法中多样性不足的问题；客观分析认为，该方法为轻量级提升视觉语言模型性能提供了新思路，强调了模型间协同作用的重要性。

Abstract: Test-time compute (TTC) strategies have emerged as a lightweight approach to boost reasoning in large language models (LLMs). However, their application and benefits for vision-language models (VLMs) remain underexplored. We present a systematic study of TTC across seven VLMs and six benchmarks, specifically analyzing feature-based scoring and majority voting methods. We find that feature heuristics fail and voting yields only modest gains in single-model settings. We theoretically show that this limitation stems from a lack of prediction diversity: when outputs are highly correlated, voting provides little benefit. In contrast, multi-model ensembles offer richer diversity, yet standard majority voting fails to account for varying model capabilities. To address this, we propose Entropy-based TTC (ETTC), which selects the most confident prediction based on predictive entropy. Our method reduces to majority voting in the single-model case, but in model ensembles, it leverages confidence disparities to prioritize stronger models. We prove that ETTC outperforms majority voting under mild assumptions and empirically demonstrate that it consistently surpasses both voting and the best individual model. Crucially, our results show that smaller models can synergistically enhance larger ones, unlocking ensembling gains not achievable with standard strategies.

[153] Parallel Tempering Initial Sampling in Inference-Time Reward Alignment cs.LG | cs.CVPDF

Myeongjun Oh, Gwangho Kim, Sungyoon Lee

TL;DR: 本文提出了一种名为PATHS（PArallel Tempering for High-complexity reward Sampling）的新型初始化方法，用于解决推理时奖励对齐任务中，基于顺序蒙特卡洛（SMC）的方法因从标准先验初始化粒子而难以探索复杂、多模态奖励景观中稀有高奖励区域的问题。PATHS通过并行回火耦合多个采样链，定期执行Metropolis交换，从而在平坦化的奖励景观中实现高效探索，缓解模式陷入问题。

Details

Motivation: 动机在于解决现有基于SMC的推理时奖励对齐方法性能不佳的问题，这些方法因从标准先验初始化粒子，在复杂的多模态奖励景观中难以有效探索稀有高奖励区域，且即使最近的奖励感知初始化方法也容易陷入局部模式。

Result: 在布局到图像和数量感知生成任务上的实验表明，PATHS在对齐质量上取得了持续提升，尤其是在复杂提示上。

Insight: 创新点在于将并行回火机制引入推理时奖励对齐的初始化阶段，通过维护一个奖励回火链梯子并执行交换，系统性地增强了对稀有高奖励区域的有限预算探索能力，这是一种新颖的采样策略改进。

Abstract: Inference-time reward alignment steers pretrained diffusion and flow-based generative models to satisfy user-specified rewards without retraining. Recently, Sequential Monte Carlo (SMC) has emerged as a powerful framework for this task by iteratively filtering and propagating multiple particles. However, we show that standard SMC-based methods often suffer from poor performance because they initialize particles from a standard prior, whereas high-reward regions in complex reward landscapes are extremely rare. Further, we show that even recent reward-aware initial sampling approaches remain vulnerable to getting trapped in local modes, as complex reward landscapes are often multi-modal. To overcome these limitations, we propose PATHS (PArallel Tempering for High-complexity reward Sampling), a novel initialization method that couples multiple sampling chains through parallel tempering. PATHS maintains a ladder of reward-tempered chains and periodically performs Metropolis swaps, enabling efficient exploration across flattened reward landscapes, thereby mitigating the mode-trapping issues. Our analysis reveals that this mechanism substantially enhances the finite-budget exploration of rare, high-reward regions that are typically challenging to sample. Experiments on layout-to-image and quantity-aware generation show that PATHS achieves consistent gains in alignment quality, particularly on complex prompts.

[154] DRIFT: Decoupled Rollouts and Importance-Weighted Fine-Tuning for Efficient Multi-Turn Optimization cs.LG | cs.CLPDF

Jian Mu, Tianyi Lin, Chengwei Qin, Zhongxiang Dai, Yao Shu

TL;DR: 本文提出了一种名为DRIFT（解耦轨迹生成与重要性加权微调）的高效多轮优化框架，用于解决大语言模型在多轮交互场景中的优化难题。该方法通过离线采样参考策略的交互轨迹、计算基于回报的重要性权重，并利用加权监督微调来优化策略，从而在保持训练效率的同时，有效应对多轮动态。

Details

Motivation: 针对大语言模型在多轮交互部署中面临的优化困境：在线强化学习能有效处理多轮动态但成本高昂，而离线监督微调虽高效却易受分布偏移和行为崩溃影响，因此需要一种兼顾效率与性能的解决方案。

Result: 实验表明，DRIFT在性能上匹配或超越了多轮强化学习基线方法，同时保持了标准监督微调的训练效率和简单性。

Insight: 创新点在于将KL正则化强化学习目标等价转化为重要性加权监督学习，通过解耦轨迹生成与优化步骤，利用离线采样和重要性加权微调，实现了高效且稳定的多轮策略优化，这一理论洞察为交互式语言模型训练提供了新思路。

Abstract: Large language models are increasingly deployed in multi-turn interactive settings where users or environments can iteratively provide lightweight feedback. Unfortunately, optimizing such behavior presents a sharp dilemma in practice: online reinforcement learning is able to effectively address multi-turn dynamics but is prohibitively expensive due to the cost of generating full correction trajectories at every update, whereas offline supervised fine-tuning (SFT) is efficient but suffers from distribution shift and behavioral collapse. To this end, we novelly propose DRIFT (Decoupled Rollouts and Importance-Weighted Fine-Tuning), a framework that operationalizes the theoretical insight that the KL-regularized RL objective is equivalent to importance-weighted supervised learning. DRIFT decouples rollout from optimization by sampling offline interaction trajectories from a fixed reference policy, deriving return-based importance weights, and optimizing the policy via weighted SFT on the resulting dataset. Empirically, we demonstrate that DRIFT matches or exceeds the performance of multi-turn reinforcement learning baselines while maintaining the training efficiency and simplicity of standard supervised fine-tuning. Code is available at https://github.com/2020-qqtcg/DRIFT.

[155] Interpretability Without Tradeoffs: Disentangling Polysemanticity At Equal Predictive Performance cs.LG | cs.CVPDF

Doğukan Bağcı, Bernt Schiele, Simone Schaub-Meyer, Jonas Fischer, Robin Hesse

TL;DR: 本文提出了一种名为ELUDe（显式、无损、无监督解耦）的方法，旨在提升深度神经网络的可解释性，同时保持其功能等效性。该方法通过重组层间信息流，将潜在表示分解为清晰、可检查的子单元，这些子单元表现为可解释的特征，且无需显式训练或标签即可应用于预训练模型。

Details

Motivation: 深度神经网络难以解释的主要障碍在于单个神经元通常编码多个不相关的概念，而现有方法（如稀疏自编码器）在分离这些混合信号时往往会改变模型结构，导致下游性能下降。

Result: 在包括DINOv2和监督ViT-B/16在内的多个视觉模型上，ELUDe提升了可解释性，同时保持了下游准确率不变，运行高效，并支持实际应用（如引导模型表示）。

Insight: 创新点在于通过构造性地重新路由特定概念的贡献，在保持原始计算不变的前提下实现无损解耦，从而在几乎不牺牲性能的情况下提供清晰、可扩展且可操作的模型洞察。

Abstract: Deep neural networks (DNNs) are widely used, but interpreting what they actually learn remains difficult. A major obstacle is that individual neurons often encode multiple unrelated concepts, obscuring the decision process of the network. While prior work, such as sparse autoencoders, can separate these mixed signals into more meaningful, “monosemantic” features, this typically requires altering the model in ways that can degrade downstream performance. To overcome this, we introduce ELUDe (explicit, lossless, unsupervised disentanglement), a method for improving the interpretability of DNNs while preserving their functional equivalence. ELUDe breaks latent representations into clear, inspectable sub-units that behave like interpretable features, while guaranteeing that the model’s outputs remain exactly the same. It requires no explicit training, no labels, and can be applied to pretrained models. ELUDe works by reorganizing how information flows between layers, re-routing concept-specific contributions while preserving the original computation by construction. Across several vision models, including DINOv2 and supervised ViT-B/16, ELUDe improves interpretability, keeps downstream accuracy unchanged, runs efficiently, and supports practical uses such as steering model representations. In short, ELUDe offers interpretability (almost) without a tradeoff: clearer, scalable, and actionable model insights with no loss in performance.

cs.RO [Back]

[156] VLM-GLoc: Vision-Language Model Enhanced Monte Carlo Localization for Robust Semantic Global Localization in Cluttered Quasi-Static Environments cs.RO | cs.CVPDF

Shivendra Agrawal, Bradley Hayes

TL;DR: 本文提出VLM-GLoc方法，一种利用开放词汇视觉语言模型作为统一语义观测前端的层次化语义蒙特卡洛定位方法，旨在解决杂乱的准静态环境中（如杂货店、办公室）因几何相似性和语义模糊性导致的全局定位难题。

Details

Motivation: 解决在几何相似、准静态的室内环境（如杂货店、办公室）中，传统方法依赖独特几何特征或特定领域视觉流程，难以处理长尾语义分布和瞬时视觉杂波，导致全局定位困难的问题。

Result: 在两个真实环境（一个3500平方英尺的杂货店和一个3700平方英尺的实验室）和两个不同平台（手机和四足机器人）上进行评估，VLM-GLoc分别实现了70%和74%的全局定位成功率，显著优于传统的仅几何方法和特定领域基线。

Insight: 创新点在于利用视觉语言模型提取高区分度的丰富文本特征、对模糊或动态对象进行隐式质量过滤以及进行持久性推理以实现针对性数据增强，并引入了通过文本到地图检索来播种粒子的逆语义提议机制。

Abstract: Global localization in geometrically aliased, quasi-static environments such as grocery stores, offices, schools, and hospitals poses a significant challenge for mobile robots. Grocery stores with parallel aisles and a long tailed distribution of products, as well as offices and labs with repetitive furniture such as chairs, desks, monitors, and doors, exemplify common indoor environments that present geometric and even semantic ambiguity. Traditional approaches rely either on distinct geometric features or on domain-specific vision pipelines that struggle with long-tail semantic distributions and transient visual clutter. We present VLM-GLoc, a method for hierarchical semantic Monte Carlo Localization (MCL) that leverages open-vocabulary Vision-Language Models (VLMs) as a unified semantic observation front-end. We hypothesize a three-fold benefit from VLMs: (1) extracting highly discriminative rich text features, (2) implicit quality filtering of blurry or dynamic objects, and (3) permanence reasoning for targeted data augmentation. We introduce an inverse semantic proposal mechanism that seeds particles via text-to-map retrieval. Evaluated across two real-world environments with different characteristics and two different platforms: a 3,500 sq. ft. grocery store with a cellphone and a 3,700 sq. ft. lab space with a quadruped, VLM-GLoc achieves 70% and 74% global localization success respectively, substantially outperforming traditional geometry-only and domain-specific baselines.

cs.CR [Back]

[157] AdvScene: Rethinking Adversarial Patch Evaluation Through Scene Robustness cs.CR | cs.CVPDF

Xiaoyong, Yuan, Lan, Zhang

TL;DR: 本文提出了AdvScene框架，用于在重建的真实环境中评估对抗性补丁的场景鲁棒性，即补丁在不同视角、距离和场景条件下保持攻击有效性的能力。该框架通过对抗性补丁到场景嵌入（APSE）解决跨视图表示的挑战，并量化补丁的操作范围。

Details

Motivation: 现有评估方法无法很好地衡量对抗性补丁在真实部署后随场景条件变化的鲁棒性，即场景鲁棒性。真实图像基准固定，而模拟器可控但未基于特定真实场景。

Result: 使用真实世界物理数据验证了AdvScene，并对现有对抗性补丁进行了全面评估。结果表明，AdvScene揭示了攻击效果存在显著的场景依赖性变化，这是现有以图像为中心或基于模拟器的评估所无法捕捉的。

Insight: 创新点在于将对抗性补丁评估重新定义为操作测量，并形式化为约束提升问题，提出了APSE嵌入方法以保持攻击关键外观并确保跨视图一致性。这为物理世界对抗攻击的鲁棒性评估提供了更贴近实际场景的框架。

Abstract: Adversarial patches are physical patterns attached to real objects to mislead AI vision systems. Their real-world risk is not determined by a single successful prediction, but by whether they remain effective after deployment under changing viewpoints, distances, and scene conditions. We refer to this property as scene robustness, the effectiveness of a deployed patch across conditions in a real environment. Yet existing evaluations do not measure scene robustness well: real image benchmarks are realistic but fixed, while simulators are controllable but not grounded in a specific real scene. We present AdvScene, a scene-grounded framework for measuring the scene robustness of adversarial patches in reconstructed real environments. AdvScene reframes evaluation as operational measurement: given a fixed deployed patch, it characterizes the patch’s operational envelope - where and when the attack succeeds - as a function of viewpoint, distance, and scene context. A key challenge is that the attack is typically defined only in a single anchor view, while evaluation requires a representation that remains faithful under viewpoint changes. We formalize this as a constrained lifting problem and introduce Adversarial Patch-to-Scene Embedding (APSE), which resolves cross-view ambiguity while preserving attack-critical appearance and enforcing locality, target-surface attachment, and cross-view consistency. We validate AdvScene using real-world physical data and conduct a comprehensive evaluation of existing adversarial patches. Our results show that AdvScene reveals substantial scene-dependent variation in attack effectiveness that is not captured by existing image-centric or simulator-based evaluations.

cs.IR [Back]

[158] Inference-Free Multimodal Learned Sparse Retrieval for Production-Scale Visual Document Search cs.IR | cs.CVPDF

Gyu-Hwung Cho, Youngjune Lee, Kiyoon Jeong, Siyoung Lee, Sanggyu Han

TL;DR: 本文提出了V-SPLADE，一种用于视觉文档检索的无推理稀疏检索器。它通过引入标题门控令牌监督来解决视觉稀疏表示难以捕捉文档图像中词汇内容的问题，从而在保持高稀疏度的同时，实现了超越密集检索模型和传统基于OCR/标题的BM25方法的检索效果。

Details

Motivation: 随着arXiv论文和企业PDF等大规模视觉文档语料库的增长，现有视觉文档检索方法要么依赖神经查询编码（导致服务时开销大），要么依赖耗时的OCR或标题生成（牺牲检索质量），缺乏一种可部署的、无需神经编码即可进行大规模检索的系统。

Result: 在六个视觉文档检索基准测试中，V-SPLADE将平均NDCG@5比同等规模的密集基线提高了13.8个百分点，比基于OCR或标题的BM25基线最高提高了6.3个百分点。在一个包含1870万个文档的语料库上，其R@5比密集基线提高了一倍以上，并通过分数融合将竞争检索器的R@5进一步提升了最高2.4个百分点。

Insight: 核心创新点是提出了“标题门控令牌监督”这一仅在训练时使用的信号，它利用VLM生成的标题作为词汇线索来激活与检索相关的词汇维度，从而解决了视觉稀疏表示中的词汇接地问题，实现了无需推理服务的高效、高精度稀疏检索。

Abstract: As large-scale visual-document corpora such as arXiv papers and enterprise PDFs continue to grow, visual-document retrieval has gained increasing attention; yet it still lacks a deployable system that lexically indexes visual documents to serve queries without neural encoding at scale. Existing methods either achieve strong retrieval quality with VLM-based dense or multi-vector models but require neural query encoding at serving time, or avoid query encoding with OCR- or caption-based BM25 at the cost of time-consuming text extraction or generation. To fill this missing serving regime, we present V-SPLADE, an inference-free sparse retriever for visual-document retrieval. However, such inference-free multimodal learned sparse retrieval systems remain underexplored and have not yet shown dense-level effectiveness under high sparsity. We attribute this limitation to a lexical grounding problem: visual sparse representations often fail to capture the lexical content embedded in document images. To address this problem, we introduce caption-gated token supervision, a training-only signal that uses VLM-generated captions as lexical cues to activate retrieval-relevant vocabulary dimensions. With this supervision, V-SPLADE improves average NDCG@5 across six visual-document retrieval benchmarks by +13.8pp over the same-scale dense baseline and by up to +6.3pp over OCR- or caption-based BM25 baselines. On an 18.7M-document corpus, it more than doubles R@5 over the same-scale dense baseline and further improves competing retrievers through score fusion by up to +2.4pp R@5. Code will be released soon at https://github.com/naver/v-splade.

Table of Contents

cs.CL [Back]

[1] Domain Adaptation and Reasoning Frameworks in Language Models: A Controlled Experiment with Historical Cosmology cs.CL | cs.AIPDF

[2] Can LLM Teams Play What? Where? When? cs.CLPDF

[3] Your Multimodal Speech Model Says I Have a Face for Radio cs.CLPDF

[4] Semantic Motion Anchors: Bridging Motion and Meaning in Co-Speech Gestures cs.CLPDF

[5] ImmigrationQA: A Source-Grounded Dataset and Small-Model Adaptation for U.S. Immigration Law cs.CL | cs.AIPDF

[6] COFT: Counterfactual-Conformal Decoding for Fair Chain-of-Thought Reasoning in Large Language Models cs.CL | cs.AIPDF

[7] EUDAIMONIA: Evaluating Undesirable Dynamics in AI cs.CL | cs.AI | cs.HCPDF

[8] CobSeg: Coherence Boundary Modeling for Dialogue Topic Segmentation cs.CL | cs.AIPDF

[9] TeachObs: A Human-Validated Benchmark for Multimodal Teaching Observation and Model Evaluation cs.CLPDF

[10] SAGE: A Novelty Gate for Efficient Memory Evolution in Agentic LLMs cs.CL | cs.AI | cs.LG | stat.MLPDF

[11] ExpGraph: Model-Agnostic Experience Learning with Graph-Structured Memory for LLM Agents cs.CLPDF

[12] MosaicLeaks:Privacy Risks in Querying-in-the-Open for Deep Research Agents cs.CLPDF

[13] Your Teacher Can’t Help You Here: Combating Supervision Fidelity Decay in On-Policy Distillation cs.CL | cs.AIPDF

[14] The Flip Side of RLHF: On-Policy Feedback for Reward Model Self-Supervised Improvement cs.CLPDF

[15] EMBGuard: Constructing Hazard-Aware Guardrails for Safe Planning in Embodied Agents cs.CLPDF

[16] Toxic HallucinAItions: Perturbing Prompts and Tracing LLM Circuits cs.CL | cs.AI | cs.CY | cs.HCPDF

[17] MineExplorer: Evaluating Open-World Exploration of MLLM Agents in Minecraft cs.CLPDF

[18] Do Large Language Models Encode Institutional Experience? Evidence from Cross-Linguistic Moral Reasoning Under Ambiguity cs.CL | cs.AIPDF

[19] MoG: Mixture of Experts for Graph-based Retrieval-Augmented Generation cs.CLPDF

[20] Extending AI for Research to the Humanities: A Multi-Agent Framework for Evidence-Grounded Scholarship cs.CLPDF

[21] How Much Do LLMs Know About Chinese Zero Pronouns? cs.CLPDF

[22] AdaptR1: Reinforcement Learning Based Adaptive Interleaved Thinking in Multi-hop Question Answering cs.CLPDF

[23] Combinatorial Synthesis: Scaling Code RLVR via Atomic Decomposition and Recombination cs.CL | cs.SEPDF

[24] Beyond Static Dialogues: Benchmarking Realistic, Heterogeneous, and Evolving Long-Term Memory cs.CL | cs.IRPDF

[25] ConsisGuard: Aligning Safety Deliberation with Policy Enforcement in LLM Guardrails cs.CLPDF

[26] Not All Synthetic Data Is Yours to Learn From cs.CL | cs.AI | cs.LGPDF

[27] Shared Doubt: Zero-shot Cross-Lingual Confidence Estimation for Language Models cs.CL | cs.AI | cs.LGPDF

[28] Scaling Multi-Hop Training Data via Graph-Constrained Path Selection cs.CL | cs.LGPDF

[29] Mellum2 Technical Report cs.CLPDF

[30] Reinforcement Learning Amplifies Emergent Misalignment from Harmless Rewards cs.CLPDF

[31] Bundesrecht: An Open Library and Corpus for German Statutory Reference Processing cs.CLPDF

[32] FBHM: Functional Benchmarking and Steering of VLMs for Hateful Meme Detection cs.CL | cs.AI | cs.CV | cs.MMPDF

[33] A Visually Impaired Assistance Benchmark for VLM-as-a-Judge Evaluation cs.CL | cs.CVPDF

[34] Unlocking Fine-Grained Translation Quality Estimation in LRMs through Synergistically Evolving Implicit and Explicit Reasoning cs.CLPDF

[35] Multi-Turn Multi-Agent Dialogue for Collaborative Reconstruction Improves VLM Performance on Spatial Reasoning, But Only Barely cs.CL | cs.ROPDF

[36] Target-Side Paraphrase Augmentation for Sign Language Translation with Large Language Models cs.CL | cs.AIPDF

[37] “Intelegi Româneşte?’’ A Recipe for Romanian Vision-Language Models cs.CLPDF

[38] The Sword, Shield, and Achilles’ Heel: Characterizing the Linguistic Inductive Bias of Large Language Models for Spatial Reasoning in Navigation Planning cs.CL | cs.AIPDF

[39] Skill Availability and Presentation Granularity in Large-Language-Model Agents: A Controlled SkillsBench Study cs.CL | cs.AI | cs.LGPDF

[40] DOA: Training-Free Decoder-Only Attention Policy for Long-Form Simultaneous Translation with SpeechLLMs cs.CL | cs.AI | cs.SDPDF

[41] Fine-grained Verification via Diagnostic Reasoning Supervision for Aspect Sentiment Triplet Extraction cs.CL | cs.AIPDF

[42] SCOPE: Self-Play via Co-Evolving Policies for Open-Ended Tasks cs.CLPDF

[43] Are Full Rollouts Necessary for On-Policy Distillation? cs.CLPDF

[44] BenHalluEval: A Multi-Task Hallucination Evaluation Framework for Large Language Models on Bengali cs.CLPDF

[45] If LLMs Have Human-Like Attributes, Then So Does Age of Empires II cs.CL | cs.AI | cs.CYPDF

[46] UniAudio-Token: Empowering Semantic Speech Tokenizers with General Audio Perception cs.CL | cs.SDPDF

[47] Preference-Aware Rubric Learning for Personalized Evaluation cs.CLPDF

[48] What Am I Missing? Question-Answering as Hidden State Probing cs.CLPDF

[49] Disagreeing Rationales: Rethinking Classification and Explainability Evaluation in Hate Speech Detection cs.CLPDF

[50] LongTraceRL: Learning Long-Context Reasoning from Search Agent Trajectories with Rubric Rewards cs.CL | cs.AI | cs.LGPDF

cs.CV [Back]

[51] SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformer cs.CV | cs.AIPDF

[52] DTG-Restore: Training-Free Diffusion Refinement for Generative Video Super-Resolution cs.CVPDF

[53] A Novel Global Context-aware Deep Neural Network for Enhanced Brain Tumor Segmentation using Magnetic Resonance Images cs.CV | cs.AIPDF

[54] OmniMem: Scalable and Adaptive Memory Retrieval for Long Video Generation cs.CVPDF

[55] Clustering Guided Domain-Specific Pretrained Foundation Model Very High-Resolution Arctic Remote Sensing cs.CVPDF

[56] Seeing Isn’t Knowing: Do VLMs Know When Not to Answer Spatial Questions (and Why)? cs.CV | cs.AI | cs.CLPDF

[57] Prior Availability in Industrial Visual Sim-to-Real: A Review of CAD-Guided and CAD-Unavailable Regimes cs.CV | cs.AI | cs.ROPDF

[58] VLM3: Vision Language Models Are Native 3D Learners cs.CV | cs.AIPDF

[59] ReGuLaR: Relation-Grounded Latent Reasoning for Large Vision-Language Models cs.CVPDF

[60] WristCompass: Kinematic Coupling as a Learnable Visual Concept for Ego-Camera Orientation cs.CV | cs.ROPDF

[61] PInVerify: An Offline Embodied Benchmark for Active Instance Verification cs.CV | cs.AI | cs.ROPDF

[62] ConTrans: Learning Text-enhanced Local-global Temporal Representations for Zero-shot Temporal Action Localization cs.CV | cs.AIPDF

[63] Seeing Before Agreeing: Aligning Multi-Agent Consensus with Visual Evidence cs.CV | cs.AI | cs.MAPDF

[64] Vision-Based Localization in Dense Urban Environments: A Case Study of an Urban Village in China cs.CVPDF

[65] Annotations Are Not All You Need: A Cross-modal Knowledge Transfer Network for Unsupervised Temporal Sentence Grounding cs.CVPDF

[66] Simple Token-Efficient Vision-Language Model for Case-level Pathology Synoptic Report Generation cs.CV | cs.AIPDF

[67] Immuno-VLM: Immunizing Large Vision-Language Models via Generative Semantic Antibodies for Open-World Trustworthiness cs.CVPDF

[68] CameraNoise: Enabling Faithful Camera Control in Video Diffusion through Geometry-Flow-Guided Noise Warping cs.CVPDF

[69] SLAP: The Semantic Least Action Principle for Variational Video-Language Modeling cs.CVPDF

[70] Text-guided Feature Disentanglement for Cross-modal Gait Recognition cs.CVPDF

[71] Function2Scene: 3D Indoor Scene Layout from Functional Specifications cs.CVPDF

[72] MechVQA: Benchmarking and Enhancing Multimodal LLMs on Comprehensive Mechanical Drawing Understanding cs.CV | cs.AIPDF

[73] LegSegNet: A Public Deep Learning System for Lower Extremity CT Tissue Segmentation and Quantification cs.CVPDF

[74] Count Anything cs.CVPDF

[75] Robust Dreamer: Deviation-Aware Latent Gaussian Memory for Action-Controlled AR Video Generation cs.CVPDF

[76] Foundation VAEs for 3D CT Reconstruction, Augmentation, and Generation cs.CVPDF

[77] GUI-C$^2$: Coarse-to-Fine GUI Grounding via Difficulty-Aware Reinforcement Learning cs.CVPDF