cs.CL [Total: 26]
cs.CV [Total: 46]
cs.LG [Total: 4]
cs.RO [Total: 2]
quant-ph [Total: 1]
eess.IV [Total: 2]
cs.HC [Total: 1]
cs.IR [Total: 1]
cs.AI [Total: 3]

cs.CL [Back]

[1] Backdoor Learning in Language Models and Vision-Language Models cs.CL | cs.AIPDF

Weimin Lyu

TL;DR: 这篇论文主要研究深度学习模型中的安全威胁，特别是针对自然语言处理和视觉语言模型的后门攻击。论文一方面分析了后门攻击的机制、检测方法并设计了新的攻击方式，另一方面也研究了面向临床和医学影像应用的高效多模态表示学习方法，旨在提升AI的可信度和多模态学习效率。

Details

Motivation: 动机在于，尽管深度学习的进步显著提升了NLP和VLM的能力，但也带来了新的安全漏洞，尤其是后门攻击构成了严重的安全威胁。论文旨在从可信AI和高效多模态表示学习两个维度应对这些挑战。

Result: 摘要中未提及具体的定量实验结果或基准测试，但论文宣称其工作包括分析、检测和设计NLP与VLM中的后门攻击，以及开发面向临床医学应用的高效多模态表示方法。

Insight: 创新点在于将后门攻击的安全研究从单一模态（如NLP）扩展到多模态（VLM），并同时关注安全（后门攻防）与效率（特定领域的高效表示学习）这两个关键维度，为构建可信赖的AI系统提供了综合视角。

Abstract: Recent advances in deep learning have significantly enhanced the capabilities of Natural Language Processing (NLP) and Vision-Language Models (VLMs). However, these advancements come with increased vulnerabilities, notably through backdoor attacks that pose severe security threats. This thesis addresses two critical dimensions of Trustworthy AI and Efficient Multimodal Representation Learning: (1) security through analyzing, detecting, and designing backdoor attacks in NLP and VLMs, and (2) efficiency through advanced multimodal representation methods tailored for clinical and medical imaging applications.

[2] Compiler-Guided Adaptive Proof Search with Cross-Model Synergy on Context-Dependent Theorem Proving cs.CL | cs.PLPDF

Zhuo Liu, Ding Yu, Hangfeng He

TL;DR: 本文提出了一种编译器引导的自适应证明搜索框架，用于解决现实世界Lean 4项目中上下文相关的定理证明难题。该方法通过双模型生成和停滞触发重采样来探索多样化的证明起点，同时利用基于编译器反馈的成对比较来指导对最有希望证明状态的迭代精化。

Details

Motivation: 现实Lean 4项目中的定理证明具有挑战性，因为证明通常依赖于项目特定的上下文。现有的迭代精化方法虽然可以利用编译器错误修复失败的证明，但需要仔细的搜索控制，因为并非所有失败的尝试都同样有用，且后续修订可能使部分正确的证明退化。

Result: 在miniCTX-v2数据集的七个真实Lean 4项目上的实验表明，该方法在效果和效率之间取得了比pass@k基线更好的权衡。在pass@32的预算内，该方法将平均通过率提高了12.8个百分点，同时减少了21.9%的LLM调用。

Insight: 核心创新在于提出了一个平衡探索与利用的编译器引导搜索框架。具体创新点包括：利用双模型生成和停滞触发机制进行探索，以及利用基于编译器反馈的成对比较来指导精化过程，从而更智能地复用失败的证明尝试，实现更优的搜索控制。

Abstract: Theorem proving in real-world Lean 4 projects is challenging because proofs often depend on project-specific context. While iterative refinement can use compiler errors to repair failed proofs, reusing failed attempts requires careful search control: some proofs provide better starting points than others, and later revisions may degrade a partially correct proof. We propose a compiler-guided proof search framework that balances exploration and exploitation. It explores diverse starting points through dual-model generation and stagnation-triggered resampling, while exploiting promising proof states through current-best refinement guided by compiler-grounded pairwise comparison. Experiments on seven real-world Lean 4 projects from miniCTX-v2 show that our method achieves a better effectiveness–efficiency tradeoff than pass@k baselines. Within the pass@32 budget, our method improves average pass rate by 12.8 percentage points while reducing LLM calls by 21.9%.

[3] Nine Emotion Centroids: A Label-Free Valence Axis That Transfers Across Four Modalities cs.CL | cs.AIPDF

Yousef Radwan

TL;DR: 该论文提出了一种无监督方法，通过九个情感类别名称和少量叙事段落，在冻结编码器中识别出一个通用的情感效价轴（V轴）。该轴在文本、图像、音频和脑电图（EEG）四种模态的编码器中均存在，无需联合训练，并能有效捕获情感极性。

Details

Motivation: 动机在于探索是否能在不同模态的预训练编码器中，仅使用极少的监督信号（远少于传统监督方法），发现一个通用的、可解释的情感效价内部方向，以解决跨模态情感分析中的标签稀缺问题。

Result: 在多个基准测试中取得良好结果：在SST-2文本情感任务上达到监督方法93%的性能（AUC 0.772 vs. 0.828）；在EmoSet图像数据集上与人类效价评分相关度r=0.636；在ESC-50音频任务上AUC为0.906；在123名受试者的EEG数据上AUC为0.720。消融实验表明该方向对模型预测至关重要。

Insight: 核心创新点在于提出了一种极简的、基于九个情感锚点故事集和主成分分析（PCA）的无监督方法，来发现跨模态的共享情感效价方向。这揭示了预训练模型内部存在与人类情感感知对齐的通用结构，并实现了仅用文本标签训练的简单分类器向其他模态的零样本迁移。

Abstract: Inside a modern language model sits a single internal direction that tracks how positive or negative a sentence feels. We show how to find this valence axis (V-axis) from just 9 emotion category names plus 50 short narrative paragraphs per emotion – about 1,500 fewer labels than the usual supervised approach – and that the same direction appears in vision, audio, and human-brain encoders never jointly trained. The recipe: embed nine emotion-anchored story sets in a frozen encoder, take the top principal direction of the nine averaged embeddings. Projecting new inputs onto it captures 93% of supervised performance on SST-2 (Llama-3-8B-Instruct, AUC 0.772 vs. 0.828), correlates with human valence ratings on 11,811 EmoSet images at r=0.636, reaches AUC 0.906 on ESC-50 audio (p<2.2e-15), and AUC 0.720+/-0.055 on EEG from 123 subjects (p<3.65e-8). The direction is mechanistically active: ablating it collapses sentiment accuracy by 5.5-37.2 pp across three LLMs vs. at most 0.88 pp for matched random directions (z>12). A 2-parameter classifier trained on text labels transfers to images (AUC 0.961), audio (0.764), and brain recordings (0.828) without target-modality labels; a generic 16-D subspace stays at chance (0.525). The recipe is bounded to continuous attributes – seven tests on categorical concepts return near-chance – and steering is family-specific (Llama/Mistral yes, Qwen/Gemma no).

[4] MAVEN: A Macro-Societal Value Evaluation Framework of Multimodal Content with Compact Aligned Evaluators cs.CL | cs.LGPDF

Zijuan Zhao, Zheren Fu, Hou Xia, Licheng Zhang, Yi Liu

TL;DR: 本文提出了MAVEN框架，用于评估多模态内容是否符合宏观社会价值观（如和平、正义、自由）。该框架基于国际人权文书和文化价值理论，将价值观组织为6个主要维度和72个次要指标，支持多层次定量评分。作者构建了一个人工验证的多模态基准和软匹配度量来评估视觉语言模型（VLMs）的价值判断能力，并提出了一种跨层自适应多级偏好优化方法和训练免费的多角色共识策略来优化评估器。实验表明，其紧凑的2B评估器性能与同系列的8B模型相当，并接近前沿闭源VLMs。

Details

Motivation: 当前评估多模态内容是否符合宏观社会价值观的框架主要局限于安全导向的分类法、仅文本的心理测量探测或单标签分类，缺乏系统、多层次的评估方法。

Result: 在构建的MacroValue-Bench基准上评估了现有开源和闭源VLMs，揭示了它们在宏观社会价值判断上的共同趋势和明显差异。实验表明，提出的紧凑2B评估器性能与同系列的8B模型相当，并接近前沿闭源VLMs的水平。

Insight: 创新点包括：基于国际人权和文化理论构建了层次化的宏观社会价值评估框架（MAVEN），提出了跨层自适应多级偏好优化（SA-MDPO）用于评估器蒸馏，以及推理时的训练免费多角色共识策略，为可扩展的宏观社会价值评估提供了实用路径。

Abstract: Assessing whether multimodal content aligns with macro-societal values, such as peace, justice, and freedom, has become an increasingly urgent challenge. Existing frameworks are largely confined to safety-oriented taxonomies, text-only psychometric probes, or single-label classification. Therefore, we propose MAVEN, a hierarchical framework for macro-societal value evaluation of multimodal content, grounded in international human-rights instruments and cultural value theory. MAVEN organizes values into 6 primary dimensions and 72 secondary indicators, supporting multi-level quantitative scoring. Building on MAVEN, we construct a human-verified multimodal benchmark and a soft-match metric to evaluate VLMs’ assessments across value dimensions. For evaluator optimization, we propose a span-adaptive variant of multi-level preference optimization for evaluator distillation, together with a training-free multi-role consensus strategy at inference time. We evaluate existing open- and closed-source VLMs on our benchmark, revealing shared tendencies and clear differences in macro-societal value judgments. Experiments show that our compact 2B evaluator matches its 8B counterpart in the same family and approaches frontier closed-source VLMs, offering a practical path toward scalable macro-societal value evaluation. Our SA-MDPO implementation and MacroValue-Bench are available at https://github.com/zzzzzzzzjj/MAVEN.

[5] Fractional Decay KV-Cache: Ownership-Aware Memory Management for Improved Inference Relevancy in Dialog Systems cs.CL | cs.AIPDF

Sukanta Ganguly

TL;DR: 本文提出了一种名为Fractional Decay KV-Cache (FD-KVC)的新型算法，用于改进基于Transformer的对话系统中的KV缓存管理。该方法通过双通道评分机制（累积注意力通道和时效加权相关性通道）和自适应学习率，实现了对历史重要令牌的保留和对话题转移的快速适应。

Details

Motivation: 现有KV缓存策略对所有缓存条目一视同仁或采用粗粒度的淘汰启发式方法，无法适应对话话题的动态演变，导致推理相关性下降。本文旨在解决这一局限性。

Result: 在五个不同的多轮对话场景（每个场景600个对话）中，FD-KVC在综合后期轮次对齐指标上比当前最先进的基准方法H2O高出6.7%，在话题转移、渐进演变和混合话题对话场景中分别提升了127%、87%和30%。FD-KVC适应新话题的速度是H2O的3.6倍，并达到了所有方法中最高的主题多样性（80.6%）。

Insight: 创新点在于结合了累积重要性和时效相关性的双通道评分机制，以及由所有权损失函数驱动的自适应学习率，实现了更精细、自适应的缓存管理。从客观角度看，其将强化学习思想融入缓存更新、在CPU上高效运行且开销可忽略的设计具有借鉴价值。

Abstract: Key-value (KV) caching is essential for efficient autoregressive inference in transformer based dialog systems, yet existing strategies treat all cached entries uniformly or apply coarse eviction heuristics that fail to adapt as dialog topics evolve. We propose Fractional Decay KV-Cache (FD-KVC), a novel algorithm that maintains a dual-channel scoring mechanism for each cached KV pair: a cumulative attention channel that tracks aggregate importance (akin to H2O), and a recency-weighted relevance channel governed by temporal decay and reinforcement-inspired updates. The combination enables FD-KVC to both preserve historically important tokens and rapidly adapt when dialog topics shift. An adaptive learning rate driven by an ownership loss function ensures convergence without oscillation. FD-KVC operates entirely on CPU with negligible overhead. Across five diverse multi-turn dialog scenarios with 600 dialogs each, FD-KVC outperforms H2O, the state-of-the-art heavy-hitter baseline, by +6.7% on composite late-turn alignment, with improvements of +127% on topic-shift, +87% on gradual evolution, and +30% on mixed-topic dialogs. FD-KVC adapts to new topics 3.6X faster than H2O and achieves the highest topic diversity (80.6%) across all methods. Ablation studies confirm the contribution of each component.

[6] DeepTCM1.0: A Multi-Expert AI Agent for Deciphering Mechanisms of Chinese Herbal Formulae Based on General Large Language Models cs.CL | cs.AIPDF

Wenxin Duan, Hanwei Wang, Zhongying Peng, Zhonghua Lu, Jiayi An

TL;DR: DeepTCM1.0是一个基于通用大语言模型DeepSeek V3.2构建的多专家AI智能体框架，旨在解决中药复方机制解析的难题。该框架采用三层协作架构和三轮迭代质量控制工作流，模拟11个跨学科智能体的协同分析过程，并以桂枝汤为案例，从经典中医理论和现代科学研究双重视角进行机制阐释。

Details

Motivation: 中药复方机制阐明是中药现代化的核心挑战，现有数据挖掘和网络药理学方法难以实现经典理论与现代研究的深度融合，而通用大语言模型直接问答又存在对中医理论框架适应性不足和推理幻觉问题，因此亟需开发符合中医整体性原则的智能分析方法。

Result: 通过双盲五维评分、组内相关系数可靠性检验、Mann-Whitney U检验和效应量分析进行综合评估，使用四个独立大语言模型作为评估者，对五份匿名报告进行五轮重复评分，共获得100个独立评分结果，验证了框架的有效性。

Insight: 创新性地构建了多专家智能体协作框架，将经典中医理论与现代生命科学相结合，通过结构化的工作流模拟跨学科专家会诊过程，为中医药研究提供了系统化、可解释的智能分析新范式，避免了单一模型的局限性。

Abstract: Background: Mechanistic elucidation of traditional Chinese medicine (TCM) compound formulas remains a central challenge in the modernization of TCM. Conventional approaches, including data mining and network pharmacology, are insufficient for achieving deep integration between classical TCM theory and modern scientific research. In addition, direct question-answering using general-purpose artificial intelligence large language models is limited by inadequate adaptation to TCM theoretical frameworks and susceptibility to reasoning hallucinations. Consequently, there is an urgent need to develop intelligent analytical methods aligned with the holistic principles of TCM. Objective: To establish a multi-expert intelligent agent framework integrating classical TCM theory with modern life sciences, thereby enabling systematic and interpretable mechanistic analysis of TCM compound formulas, with Guizhi Decoction serving as a representative validation case. Methods: The DeepTCM1.0 framework was constructed based on the general-purpose large language model DeepSeek V3.2. It adopts a three-tier collaborative architecture and a three-round iterative quality-control workflow, simulating the collaborative analytical process of 11 interdisciplinary intelligent agents. The framework was applied to the mechanistic interpretation of Guizhi Decoction from the dual perspectives of classical traditional Chinese medicine theory and modern scientific research. Framework performance was comprehensively evaluated through double-blind five-dimensional scoring, intraclass correlation coefficient (ICC) reliability testing, Mann-Whitney U tests, and effect size analysis. The evaluation employed four independent large language models as evaluators, each conducting five rounds of repeated scoring on five anonymized reports, resulting in a total of 100 independent scoring assessments.

[7] StocksTalk: A Voice-Enabled Conversational Agent for Structured Query Generation over Web Data cs.CL | cs.AI | cs.LGPDF

Akshat Parmar, Vikranth Udandarao, Abhay Shakya, Tanmay Hire, Avinash Anand

TL;DR: StocksTalk是一个语音驱动的对话系统，旨在将口语化的金融筛选请求转换为可执行且经过验证的结构化查询，以查询真实市场数据。该系统集成了流式语音识别、检索增强的约束提取、基于模式引导的LLM SQL生成、基于规则的验证以及交互式仪表板中的人机协同验证。

Details

Motivation: 传统模板驱动的金融助手缺乏透明度和灵活性，无法有效处理口语化、多变的金融查询请求。StocksTalk旨在通过一个透明、交互式的语音界面，弥合自然语言交互与结构化金融分析之间的鸿沟，提供更有效的对话式股票筛选和决策支持。

Result: 在包含150个口语化金融提示（涵盖多种投资策略和输入噪声条件）的基准测试中，与基于LLM的基线方法相比，StocksTalk的检索增强、约束查询生成和交互式验证显著提高了约束提取准确性、SQL可执行性、逻辑一致性和多轮对话稳定性。

Insight: 创新点在于系统公开了中间推理过程（如提取的约束、归一化的金融指标、操作符锚定和生成的查询），允许用户在执行前检查和细化每个阶段；这结合了检索增强、模式引导的LLM生成和基于规则的验证，提供了一个透明、可交互的语音驱动框架，提升了结构化查询生成的可靠性和用户体验。

Abstract: StocksTalk is a voice-enabled conversational system for transforming spoken financial screening requests into executable and validated structured queries over real-world market data. The system combines streaming speech recognition, retrieval-augmented constraint extraction, schema-grounded LLM-based SQL generation, rule-based validation, and human-in-the-loop verification within an interactive dashboard. Unlike traditional template-driven financial assistants, StocksTalk exposes intermediate reasoning artifacts, including extracted constraints, normalized financial metrics, operator grounding, and generated queries, allowing users to inspect and refine each stage before execution. To evaluate the system, we curate a benchmark of 150 spoken financial prompts spanning multiple investment strategies and input noise conditions. Experimental results show that retrieval grounding, constrained query generation, and interactive verification substantially improve constraint extraction accuracy, SQL executability, logical consistency, and multi-turn stability compared to baseline LLM-based approaches. StocksTalk demonstrates how transparent, voice-driven interfaces can bridge natural language interaction and structured financial analysis, providing an effective framework for conversational stock screening and decision support.

Davide Mazzaccara, Leonardo Bertolazzi, Raffaella Bernardi

TL;DR: 本文研究了大型语言模型（如Qwen3-4B）在不确定性表达上的过度自信倾向，通过设计控制推理场景，比较了三种不确定性表达方式（言语认知标记、弃权和数值置信度分数），并提出了可解释性方法识别与不确定性和确定性相关的特征。研究发现，模型默认机制倾向于通过广泛共享特征生成确定性，而不确定性则由少量专用特征稀疏覆盖，干预这些特征可缓解过度自信错误。

Details

Motivation: 解决大型语言模型在证据不足时仍给出断言性答案的过度自信问题，通过可解释性方法深入理解其不确定性表达机制。

Result: 在Qwen3-4B上的实验证实了过度自信倾向，尤其在输出数值置信度分数时更明显；干预识别出的不确定性特征能因果证明并缓解过度自信错误，这些特征在三种不确定性表达设置、不同语言和分布外模态任务中具有泛化性。

Insight: 创新点在于提出了一种可解释性方法，能差异识别与不确定性和确定性相关的特征，揭示了模型默认机制以共享特征支持确定性、而不确定性作为稀疏覆盖的失衡结构，为缓解过度自信提供了干预途径。

Abstract: Large language models tend to overconfidence, giving assertive answers when the evidence suggests hedging or abstention. Using controlled reasoning scenarios that manipulate logical necessity and possibility, we study this behavior in Qwen3-4B, across three ways to express uncertainty: verbal epistemic markers, abstention, and numeric confidence scores. Our results confirm this tendency toward overconfidence, particularly when the model is prompted to output a numeric confidence score. At the interpretability level, we propose a method that differentially identifies transcoder features responsible for uncertainty and certainty. Our analysis reveals Qwen3-4B’s default mechanism favors certainty generation through a broad coalition of shared features, while uncertainty is implemented as a sparse override mediated by a small set of dedicated features. Intervening on these uncertainty features both causally proves this imbalance underlying overconfidence and also mitigate overconfident errors. The same set of features generalise across the three uncertainty-expression settings, languages, and an out-of-distribution modality task.

[9] Operationalizing Narrative Entropy (Sn): A Two-Scene Registered Pilot Report and Pre-Validation Protocol cs.CLPDF

Levent Bulut

TL;DR: 该论文首次尝试将叙事熵（Sn）这一理论概念操作化，通过手动编码两个叙事场景（塔伦蒂诺《落水狗》的开场餐厅对话和卡佛《大教堂》的开场内心独白）并应用候选公式Sn = If × Cb × t进行计算。研究发现，单一声道的内心独白（Sn = 30.0）的叙事熵值高于九人对话场景（Sn = 18.8），这一与作者直觉相悖的结果被视为核心发现。论文将此结果归因于三种可能的解释（公式不完整、文本本身高负荷、测量误差），并预先注册了下一阶段的研究设计以区分这些解释。

Details

Motivation: 叙事熵（Sn）是Bulut学说中提出的一个量化描述符，旨在捕捉叙事文本对读者施加处理负荷的速率。然而，该概念此前仅停留在理论定义层面，尚未针对真实文本进行操作化验证。本研究的动机就是首次实现Sn的操作化，以检验其实际应用可行性。

Result: 在仅包含两个叙事场景（n=2）的试点研究中，应用候选公式计算得到了具体的Sn数值：卡佛的内心独白场景Sn为30.0，塔伦蒂诺的多人对话场景Sn为18.8。该结果是初步的定量发现，但研究明确声明Sn尚未得到验证，且未与任何基准模型或SOTA进行比较。

Insight: 创新点在于首次将叙事熵理论操作化，并坚持将反直觉的发现（独白负荷高于对话）作为核心结果而非异常值，拒绝事后调整公式，体现了严谨的研究态度。方法上，论文采用了预注册研究协议，预先明确了下一阶段区分三种竞争性解释（公式完整性、文本特性、测量误差）的验证设计，这有助于提高研究的透明度和可重复性。从客观角度看，将认知负荷的量化测量从理论推向实证是一个有价值的跨学科尝试。

Abstract: Narrative Entropy ($S_n$) is a proposed quantitative descriptor within the Bulut Doctrine, intended to capture the rate at which a narrative text imposes processing load on a reader. To date the construct has been defined theoretically but not operationalized against real texts. This report documents the first such operationalization (the v2.0 pilot): two narrative scenes – the opening restaurant scene of Tarantino’s Reservoir Dogs and the opening interior-monologue block of Carver’s Cathedral – were coded manually by a single rater and scored with the candidate formula $S_n = I_f \times C_b \times t$. The result was a divergence from the author’s naive intuition: the single-voice monologue ($S_n = 30.0$) scored higher than the nine-character dialogue scene ($S_n = 18.8$). We treat this not as a result to be explained away but as the central finding, and we refuse post-hoc adjustment of the formula. Three competing interpretations are presented – formula incompleteness, genuine high-load prose, and measurement error – and the design that would discriminate among them is pre-registered. This v2.1 revision adds: (i) explicit acknowledgement that the divergence is consistent with the pre-existing architectural framework which privileges inferential reconstruction over surface declaration, and that what was called “contrary to expectation” in v2.0 reflected the author’s anticipatory intuition rather than the methodology’s own predictions; (ii) a pre-registered construct validity test for $I_f$, motivated by the observation that $I_f$ values were nearly equal across the two scenes (1.71 vs 1.58) despite the headline $S_n$ divergence. The document functions simultaneously as a pilot report ($n=2$) and as a pre-registration of the next-stage protocol. It does not claim that $S_n$ has been validated.

[10] You Are What You Prompt: Prompt Quality, Domain Shift, and Uncertainty in Agrifood Vision-Language Models cs.CL | cs.LGPDF

Andrea Morales-Garzón, Salvador López-Joya, Miguel López-Pérez, Maria J. Martin-Bautista

TL;DR: 本文研究了视觉语言模型在农业食品领域的零样本分类中提示词质量、领域偏移和不确定性的影响。通过评估零样本提示集成（ZPE）方法在四个数据集和四个提示池上的表现，发现ZPE在领域偏移条件下能显著提升性能和校准效果，并引入基于提示不一致性的检测（PID）方法，利用提示分歧作为认知不确定性来改进严重领域偏移下的失败检测。

Details

Motivation: 视觉语言模型在零样本分类中性能受提示词表述影响较大，尤其在专业领域；ZPE方法通过加权提示词来解决此问题，但其在领域偏移下的行为尚未被探索，特别是在农业食品这一专业领域。

Result: 在领域内（ID）条件下，ZPE提供有限改进，但在领域偏移下，使用51-52个领域特定提示池的性能优于247-426个通用提示池，显著提升了分类准确性和校准；PID方法在严重领域偏移下能有效检测失败案例，而标准置信度度量则失效。

Insight: ZPE可作为无监督领域对齐检测器，无需标签访问；通过词汇分析揭示其机制；PID创新性地将提示分歧重新利用为认知不确定性，增强了模型在极端领域变化下的鲁棒性和失败检测能力。

Abstract: Vision-language models enable zero-shot classification through natural language prompts, but performance is sensitive to prompt formulation, especially in specialized domains. Zero-shot Prompt Ensembling (ZPE) addresses this by weighting prompts by discriminative signal, yet its behavior under domain shift remains unexplored. We evaluate ZPE in the agrifood domain using CLIP and SigLIP across four datasets and four prompt pools, spanning in-distribution (ID) food and out-of-distribution agricultural benchmarks. ZPE provides limited benefit under ID conditions but substantially improves performance and calibration under domain shift, where domain-specific pools of 51-52 prompts consistently outperform generic pools of 247-426. Lexical analysis shows that ZPE acts as an unsupervised domain-alignment detector without label access. We further introduce PID (Prompt-based Inconsistency Detection), which repurposes prompt disagreement as epistemic uncertainty, improving failure detection under severe domain shift where standard confidence measures collapse.

[11] Alignment Is All You Need: Instruction-Free Training for General Audio-Language Models cs.CL | cs.SD | eess.ASPDF

Xuanru Zhou, Yiwen Shao, Jiahong Li, Dong Yu

TL;DR: 本文提出了一种仅通过跨模态对齐（alignment）即可构建高性能音频-语言大模型（LALM）的方法。该方法保持音频编码器和大型语言模型（LLM）完全冻结，仅训练一个轻量级投影器，并使用LLM扩展的（音频，自由形式响应）数据进行训练，无需显式任务指令。

Details

Motivation: 针对传统多模态大模型（MLLM）构建流程（跨模态对齐、监督微调、偏好优化）需要大量任务特定监督的假设，本文探讨是否能够以最小干预（仅对齐）高效地将LLM的强大推理和指令跟随能力迁移到新模态（音频）。

Result: 在MMAU、MMAR、MMSU和MMAU-Pro等多个基准测试上，该方法仅使用更少的数据，其性能即可匹配或超越经过大量后训练（post-trained）的基线模型。

Insight: 核心创新点在于证明了仅通过跨模态对齐（保持LLM冻结）即可构建有竞争力的MLLM，将多模态扩展简化为一个轻量级投影器训练问题。这不仅能保留LLM原有的指令跟随能力，还能快速适应新的LLM版本，并可能泛化到其他模态。

Abstract: Multimodal large language models (MLLMs) are typically built through a multi-stage pipeline consisting of cross-modal alignment, supervised fine-tuning (SFT), and preference optimization. This pipeline assumes that adapting an LLM to a new modality requires extensive task-specific supervision. However, pretrained LLMs already possess strong reasoning and instruction-following abilities. As LLMs evolve rapidly, an important question remains: can we efficiently transfer these capabilities to a new modality with minimal intervention, and is alignment alone sufficient for building a multimodal model? We introduce an Instruction-Free Alignment-Only large audio-language model (LALM) that keeps both the audio encoder and the LLM fully frozen, learning only a lightweight projector. Borrowing insights from AzeroS [1], we train on (audio, response) pairs from Self-Generated Data Construction, where an LLM expands captions into free-form responses without explicit task instructions. Across MMAU, MMAR, MMSU, and MMAU-Pro, our approach matches or surpasses heavily post-trained baselines using substantially less data. By keeping the LLM frozen, our model preserves its native instruction-following competence and can port seamlessly across model generations. Our results suggest that competitive MLLM can emerge from alignment alone, reducing multimodal extension to a lightweight projector-training problem that generalizes across modalities and adapts rapidly to each new LLM release.

[12] When Do LLMs Actually Help? Evaluating LLMs as Data Quality Annotators cs.CL | cs.AIPDF

Praphulla Lal Shrestha

TL;DR: 本研究评估了LLM作为数据质量标注器的实际效果，通过两个电子商务数据质量任务（实体匹配和品牌误标检测）对比了基于规则的基线方法和人工验证的真实标签。研究发现，LLM的价值高度依赖于任务特性：当任务存在强词汇信号时，LLM相比简单规则方法优势有限；而当任务需要背景知识时，LLM则表现出明显优势，且在不同查询间保持高度一致性。

Details

Motivation: 随着LLM越来越多地用于自动检测数据质量问题，但其判断的一致性尚不明确。本研究旨在评估LLM在数据质量标注任务中的实际表现，并与传统方法进行比较。

Result: 在实体匹配任务（使用Abt Buy基准，2,194个标注对）中，基于规则的基线方法（F1=0.950）与LLM零样本提示（F1=0.948）表现相当，且小样本提示评估可能误导性能。在品牌误标检测任务（500个亚马逊产品列表，含合成注入错误）中，LLM（F1=0.833）明显优于朴素规则基线（F1=0.721）。重复运行一致性测试显示模型平均自洽率达99.7%，多数投票仅带来微小性能提升（F1+0.005）但推理成本增加5倍。

Insight: LLM在数据质量任务中的优势取决于任务是否需要背景知识：对于依赖词汇信号的任务，传统规则方法可能足够；而对于需要领域知识的任务，LLM能提供显著改进。同时，LLM在不同查询间具有高度一致性，但通过多次运行集成带来的性能提升有限且成本较高。研究还提示小样本提示评估可能存在误导性，需谨慎对待。

Abstract: LLMs have been increasingly used to catch data quality issues automatically, but we know very little about how consistent these judgments actually are. This study tests an LLM on two e-commerce data quality tasks, entity matching and brand mislabeling, against rule based baselines and human verified ground truth, under both zero-shot and few-shot prompting. On entity matching while using the Abt Buy benchmark (2,194 labeled pairs), a simple rule based baseline (F1=0.950) performed about as well as LLM zero shot prompting (F1=0.948). Moreover, a few-shot prompt revision that looked effective on a small validation sample reduced full-scale performance to F1=0.914. This showed that small sample prompt evaluation can be misleading. On brand mislabeling detection, using 500 Amazon product listings with synthetically injected labeling errors, the LLM clearly outperformed a naive rule based baseline (F1=0.833 vs 0.721), because it could draw on background knowledge of brand product relationships that a simple rule could not access. Testing consistency across repeated runs (200 pairs, 5 runs at temperature 0.7) showed the model agreeing with itself 99.7% of the time on average, with 99% of pairs giving identical answers across all 5 runs. Using majority voting across these runs only improved F1 by 0.005, at 5 times the inference cost. These results suggest that the value of using an LLM over traditional methods depends heavily on the task. LLMs offer little advantage when strong lexical signals already exist, but a clear advantage when the task requires background knowledge, all while remaining highly consistent across repeated queries.

[13] Figurative and Cultural Knowledge in LLMs: Investigating Cross-Domain Transfer through Fine-Tuning cs.CLPDF

Mena Attia, Mona Diab, Thamar Solorio

TL;DR: 本文系统研究了LLMs通过微调在文化与比喻语言理解之间的跨领域迁移能力，发现诗歌微调能提升成语理解，但文化微调反而降低谚语解释准确率，表明两者关系并非简单通过微调即可捕获。

Details

Motivation: 探究LLMs能否通过学习文化数据来提升比喻语言理解能力，反之亦然，以验证文化与比喻语言之间的内在关联是否可通过微调实现迁移。

Result: 在四个模型和六个阿拉伯语数据集上的实验显示，诗歌微调使成语理解提升2.33%（p<0.05），而文化微调降低阿拉伯中心模型的谚语解释准确率，跨领域迁移效果与噪声无异，多语言模型展现出更大适应空间。

Insight: 微调可能强化体验性文化知识，但动摇历史事实知识，表明LLMs在文化与比喻语言领域的知识存在饱和现象，需更精细的方法来捕捉其复杂关联。

Abstract: Figurative language is deeply culturally embedded; fluent use requires not just linguistic competence but cultural immersion. We ask whether LLMs can learn this link: does fine-tuning on cultural data improve figurative language understanding, and vice versa? We conduct a systematic study across four models (ALLaM-7B, Fanar-1-9B, Qwen3-8B, Llama-3.1-8B) and six Arabic datasets spanning cultural commonsense, proverbs, and poetry across diverse dialects and regions. Fine-tuning on poetry improves idiom comprehension (+2.33%, p<0.05), a gain our ArabicMMLU control does not reproduce, indicating that it stems from figurative content rather than Arabic language adaptation and pointing to a sensitivity to non-literal meaning that transfers across figurative types. Cultural fine-tuning, by contrast, lowers proverb-interpretation accuracy in both Arabic-centric models. Transfer between the two domains is otherwise indistinguishable from noise, with Arabic models frequently regressing after fine-tuning, suggesting prior saturation of relevant knowledge, while multilingual models show greater adaptation headroom. Error analysis further reveals that fine-tuning reinforces experiential cultural knowledge while destabilizing historically grounded factual knowledge. Our findings suggest that the relationship between culture and figurative language, though conceptually natural, is not straightforwardly captured through fine-tuning alone.

[14] Pedagogical AI in Mental Health: A Tri-Stream Fine-Tuned LLM Framework for Automated Clinical Supervision and Risk Triage cs.CL | cs.AI | cs.LGPDF

Shreeya Sharma, Ravish Gupta, Saket Kumar, Abhishek Aggarwal

TL;DR: 本文提出了一种名为’Supervisor-in-the-Loop’的自动化临床监督框架，该框架基于微调的Mistral-7B-instruct模型，对心理治疗会话进行三流分析：追踪治疗联盟、预测潜在风险以及通过动态临床紧急指数进行监督分诊。该系统利用DAIC-WOZ数据集，实现了实时风险分诊，将延迟从72小时缩短至约10秒。

Details

Motivation: 现代心理健康护理面临资深监督资源严重短缺的问题，导致’监督缺口’，即新手治疗师在处理高风险案例时缺乏及时的专家反馈。本文旨在通过AI自动化系统来弥补这一缺口。

Result: 在DAIC-WOZ数据集上，该多模态（视觉-听觉-语言）框架取得了显著成果：技术识别准确率达95%，治疗联盟评估的MAE为0.105（5分量表），治疗保真度α系数为0.423，平均动态临床紧急指数为0.370。训练在单块Tesla T4 GPU上仅需105步，损失降低了85.2%。

Insight: 创新点在于提出了一个集成了三流分析（语义依从性、注意力加权分析、动态临床紧急指数）的微调LLM框架，用于实时临床监督与风险分诊。技术上，通过贝叶斯先验解决冷启动问题，并采用基于时间戳的多模态同步以实现鲁棒的融合。

Abstract: Modern mental healthcare faces a critical shortage of senior supervisory oversight, leading to a “supervision gap” where novice therapists manage high-stakes risks with delayed professional feedback. This paper proposes a new framework utilizing a fine-tuned Mistral-7B-instruct model as an automated “Supervisor-in-the-Loop” system. By leveraging 106 sessions from the DAIC-WOZ dataset, the model performs a tri-stream analysis: (1) Therapeutic Alliance tracking via semantic adherence, (2) Latent risk prediction using attention-weighted analytics, and (3) Supervisory Triage via a Dynamic Clinical Urgency Index (D-CUI). Our multi-modal VAL (Visual-Acoustic-Linguistic) framework achieves 95% technique identification accuracy [95% CI: 75.1%-99.9%], alliance assessment MAE of 0.105 on a 5-point scale [95% CI: 0.059-0.151], therapeutic fidelity alpha = 0.423, and mean D-CUI of 0.370 [95% CI: 0.322-0.419]. Training converged in 105 steps with 85.2% loss reduction on a single Tesla T4 GPU. The system reduces supervisory triage latency from 72 hours to real time (~10 seconds per session), enabling proactive intervention in high-risk cases. The system addresses the cold-start problem through Bayesian priors and implements timestamp-based modality synchronization for robust multi-modal fusion.

[15] DART-SD: Diamond-topology Aware Retrieval and Tuning for Self-Distillation of Multi-Turn Tool-Calling Agents cs.CL | cs.AI | cs.LG | cs.MAPDF

Hangrui Xu, Jiarui Wang, Yang Yang, Chuanbo Zhu, Fangda Chen

TL;DR: 本文提出DART-SD框架，旨在解决多轮工具调用大语言模型训练中，因依赖完整轨迹模仿而导致的策略多样性退化问题。该方法将执行过程建模为交互状态转移图以捕捉任务固有的钻石拓扑结构，通过识别关键拓扑断点并提供恢复参考，实现局部监督的自蒸馏训练。

Details

Motivation: 当前为LLM赋予多轮工具调用能力主要依赖完整轨迹模仿，但对于包含多个顺序无关子目标的任务，最优解空间构成庞大的组合钻石格。将这种丰富拓扑强行压缩为单一轨迹会导致拓扑塌缩，无差别地惩罚有效替代探索路径，严重降低策略多样性。

Result: 在复杂的多轮工具调用基准测试上的实验表明，DART-SD显著优于传统的完整轨迹基线方法。

Insight: 核心创新在于从全局强制模仿范式转向拓扑引导的局部校正范式，具体包括：将执行过程建模为交互状态转移图以忠实捕捉成功与失败探索路径的钻石拓扑；引入关键拓扑断点识别与成功支持的恢复参考检索机制；提出通过关键拓扑断点引导的局部监督进行渐进式自蒸馏，确保训练损失仅计算在生成的恢复步骤上，并严格保护有效推理前缀免受破坏性梯度更新。

Abstract: Equipping Large Language Models (LLMs) with multi-turn tool-calling capabilities is essential for building autonomous agents. However, progress is fundamentally limited by the reliance on full-length trajectory imitation. For tasks involving multiple order-independent sub-goals, the optimal solution space forms a vast combinatorial diamond lattice. Forcing this rich topology into monolithic trajectories causes a severe topological collapse, indiscriminately penalizing valid alternative explorations and severely degrading policy diversity. To address this, we propose DART-SD (Diamond-topology Aware Retrieval and Tuning for Self-Distillation), a novel framework that shifts the paradigm from global forcing to topology-guided localized correction. DART-SD first models the execution process as a converging Interaction-State Transition Graph (ISTG), faithfully capturing the inherent diamond topology of successful and failed exploratory paths. During autonomous rollouts, the framework identifies the Critical Topological Breakpoint (CTB) and retrieves success-supported recovery references. Finally, we introduce a progressive self-distillation paradigm through CTB-guided localized supervision, ensuring that the training loss is calculated exclusively on the generated recovery steps while strictly protecting the valid reasoning prefix from destructive gradient updates. Experiments on complex multi-turn tool-calling benchmarks demonstrate that DART-SD significantly outperforms traditional full-trajectory baselines.

[16] Beyond LLM-Based Reasoning: Lightweight GNNs for Agent Failure Attribution cs.CLPDF

Ting-Wei Li, Yuanchen Bei, Xiao Lin, Hanghang Tong

TL;DR: 本文提出AFANet，一个轻量级的图神经网络框架，用于多智能体系统中的故障归因任务。该方法通过建模智能体交互轨迹中的语义信号和关系，以远低于基于大语言模型方法的计算成本，实现了相当或更优的性能。

Details

Motivation: 现有基于大语言模型的多智能体故障归因方法计算开销大、准确率有限，作者质疑这种昂贵生成式解决方案的必要性，旨在探索更轻量、结构化的替代方案。

Result: AFANet在领域内基准测试中匹配或超越了基于大语言模型的基线方法（包括微调模型），在不同GNN架构上保持鲁棒性能，并在OOD基准上通过低成本测试时适应进一步改进。

Insight: 创新点在于用轻量图结构建模智能体交互，证明了故障归因无需依赖重型LLM推理；客观来看，将时序轨迹转化为图节点（步骤语义）和边（智能体关系）进行结构化分析是高效的关键。

Abstract: Large language model (LLM)-based multi-agent systems (MAS) often exhibit complex failure modes, which frequently cause agents to produce incorrect outcomes. This motivates the task of Agent Failure Attribution: given a failed multi-agent trajectory, identify the faulty agents and their corresponding error types. Existing approaches predominantly rely on LLMs to perform failure attribution, either through direct prompting, fine-tuning on synthetic data or complex agentic pipelines. While effective, these methods incur substantial computational overhead due to long-context processing, expensive post-training and handcrafted workflows. Moreover, empirical evidence shows that even state-of-the-art models achieve limited accuracy on existing benchmarks, suggesting that scaling model size alone is insufficient. In this work, we revisit this task and question the necessity of such expensive generative solutions. We introduce AFANet, a lightweight graph-based framework that models interaction trajectories through step-level semantic signals and agent-level relationships. We show that with significantly fewer parameters and near-zero inference cost, AFANet (i) matches or outperforms LLM-based baselines, including fine-tuned models on in-domain benchmarks, (ii) maintains robust performance across different GNN architectures and (iii) can be further improved with inexpensive test-time adaptation on the OOD benchmark. Our results suggest that effective agent failure attribution does not require heavy LLM reasoning and a lightweight, structured approach can achieve strong performance.

[17] From Storage to Access: Verifiable Activation of Parametric Knowledge in LLMs via Explicit Priming and Implicit Reasoning cs.CL | cs.AI | cs.LGPDF

Zuocheng Ying, Yang Yang, Yumou Wu, Chuanbo Zhu, Jiarui Wang

TL;DR: 本文提出VAKE框架，通过显式知识引导和隐式推理两阶段强化学习，解决大语言模型中参数化知识可靠激活与验证的难题。该方法在七个基准测试和3B至14B规模模型上均超越基线，并能有效迁移到分布外数据集。

Details

Motivation: 现有端到端方法将知识提取与推理过程耦合，难以区分正确回答是源于模型参数知识还是输入上下文，导致知识验证不可靠。

Result: 在七个基准测试中，VAKE一致优于标准基线模型；基于LLM的评估显示，超过80%插入的三元组提供了检索上下文无法推导的桥接知识，且超过一半的知识无法通过直接提示获取。

Insight: 通过两阶段强化学习将知识显式外部化为可验证证据，再迁移至隐式推理，实现了参数知识的可追溯激活；该方法揭示了模型潜在知识的可分离性与可迁移性。

Abstract: Although Large Language Models (LLMs) encode rich factual knowledge in their parameters, reliably recalling and verifying such knowledge remains a key bottleneck in factual question answering. Existing end-to-end methods entangle knowledge elicitation with reasoning, making it difficult to determine whether correct answers arise from parametric knowledge or the input context. To address this challenge, we propose VAKE (Verifiable Activation of Parametric KnowledgE), a two-stage reinforcement-learning framework that externalizes latent parametric knowledge through explicit Priming and transfers the acquired elicitation capability to implicit Reasoning. Given a query and an insufficient retrieved subgraph, the Priming policy explicitly inserts bridging triples as verifiable evidence, with supervision provided by rewards derived from answers generated by a separate frozen model over the augmented subgraph. Building on the policy learned during Priming, the Reasoning stage trains the model to answer from the original input, testing whether the capability acquired through explicit knowledge elicitation transfers to implicit reasoning. Experiments across seven benchmarks and models from 3B to 14B show that VAKE consistently outperforms standard baselines, including when transferring directly from HotpotQA to OOD datasets. LLM-based evaluation further shows that over 80% of the inserted triples provide factual bridging knowledge not derivable from the retrieved context, while more than half elicit knowledge inaccessible through direct prompting. These results suggest that VAKE activates latent parametric knowledge rather than copying the input context or memorizing dataset-specific associations.

[18] X2Streaming-TTS: Causal Token-Level Text-to-Speech from Streaming Text with Speech-State Inheritance cs.CLPDF

Rime Wen, Zehan Liu, Shawn Qin, Lights Shi, Roy Gan

TL;DR: 本文提出了X2Streaming-TTS，一个因果的、真正在词元级别工作的流式文本转语音框架。它通过因果承诺机制处理不确定的文本前缀，并通过因果语音状态继承机制在分段边界保持语音的感知连续性，从而实现低延迟、高质量的流式语音合成。

Details

Motivation: 解决现有流式TTS系统多为伪流式（需等待句子级文本）的问题，实现真正的词元级合成，即在文本流异步到达时，仅基于有限上下文生成语音，同时保持无界语音流的感知连续性。

Result: 在主观和客观指标上优于现有的伪流式模型，其合成质量与评估的离线基线相当。具体地，单请求的首个音频词元生成时间中位数为15.8毫秒，128个并发请求下为260.8毫秒。

Insight: 核心创新在于提出了因果承诺（用于处理不确定前缀的缓冲与分段）和因果语音状态继承（用于跨分段边界传递语音状态以保持连续性）两个机制，共同实现了严格因果、低延迟且高质量的流式TTS。

Abstract: Streaming text-to-speech is essential for low-latency spoken dialogue systems, yet many systems wait for sentence-level text and are therefore only pseudo-streaming. True token-level synthesis must generate speech from uncertain prefixes while maintaining perceptual continuity over an unbounded stream with bounded context. We present X2Streaming-TTS, a causal TTS framework that consumes asynchronously arriving text tokens and emits speech without accessing future input. To handle uncertain prefixes, we introduce causal commitment, which keeps ambiguous expressions provisional through uncertainty-aware buffering and performs capacity-adaptive, punctuation-aware segmentation. To preserve acoustic continuity, we further introduce causal speech-state inheritance, which carries the complete Code2Wav state and selected historical Talker states across segment boundaries. Together with an attention prior constraint, it blocks access to future positions while retaining bounded acoustic context. Experiments show that X2Streaming-TTS outperforms existing pseudo-streaming models on most subjective and objective metrics. Further analysis shows that causal commitment stabilizes online segmentation and reduces failures caused by insufficient context, while speech-state inheritance improves boundary continuity without degrading naturalness or speaker identity. X2Streaming-TTS thus achieves strict token-level synthesis with quality comparable to the evaluated offline baselines, a median time to first audio token (TTFT) of 15.8 ms for a single request, and a median TTFT of 260.8 ms at 128 concurrent requests. Our implementation is publicly available at https://github.com/X-Square-Robot/X2Streaming-TTS .

[19] MemFuse: Multi-Source Memory Fusion from Fragmented Observations cs.CL | cs.AIPDF

Chao Li, Yuanfa Li, Wenhao Wu, Xule Liu, Zhi Wang

TL;DR: 本文提出了MemFuseBench基准和MemFuse记忆系统，旨在解决智能体在现实场景中整合多来源、碎片化信息以形成连贯长期记忆的问题。MemFuseBench通过场景到传感器的流程生成可控的多源标记观测数据，用于评估时序推理、跨源证据融合和抗噪能力。MemFuse系统采用结构化设计，在事件层保存原子记忆并维护来源，在聚类层通过因果融合图组织相关事件，在检索时能追溯原始来源。

Details

Motivation: 现有记忆系统和基准主要关注单一来源的文本历史，而现实世界中相关信息往往分散在不同应用、设备、用户和时间中，智能体需要整合这些碎片化观测并保留来源信息，以形成连贯的情景记忆。

Result: 在MemFuseBench上的实验表明，MemFuse在所有三种大型语言模型设置下，在评估的记忆系统中取得了最佳的整体性能，并且在需要跨源证据融合的问题上持续提升了性能。

Insight: 创新点在于提出了首个专注于多源记忆融合的基准MemFuseBench，以及一个结构化的记忆系统MemFuse，该系统通过原子记忆和融合记忆的双层设计，在融合信息的同时保持了来源的可追溯性，这对于现实世界中的可信记忆构建具有重要意义。

Abstract: Long-term memory is essential for agents that operate across extended interactions, yet existing memory systems and benchmarks predominantly focus on single-source textual histories. In realistic settings, however, relevant information is often fragmented across applications and devices, as well as across users and time, requiring agents to integrate dispersed observations into coherent episodic memories while preserving their source provenance. To address these gaps, we introduce MemFuseBench, a benchmark for multi-source memory fusion. MemFuseBench is built with a Scene-to-Sensor pipeline that synthesizes controllable scenarios into source-tagged observations, evidence-grounded questions, and adversarial distractors. It enables systematic evaluation of temporal reasoning, cross-source evidence fusion, and robustness to noise. We further propose MemFuse, a structured memory system that preserves source-level evidence in event-layer atomic memory and organizes related atomic events into cluster-layer fused memory within a causal fusion graph. During retrieval, MemFuse retrieves and organizes related evidence fragments while maintaining traceability to original source events. Experiments on MemFuseBench show that MemFuse achieves the best overall performance among the evaluated memory systems under all three LLM settings and consistently improves performance on questions requiring cross-source evidence fusion.

[20] Gradient Mirage: Trainable yet Label-Unidentifiable Gradients in Large Language Model Split Learning cs.CL | cs.LGPDF

Shiyu Miao, Yunlong Mao, Zirui Huang, Liang Yao, Tianshuo Zheng

TL;DR: 本文提出了一种名为Gradient Mirage的防御方法，用于保护大型语言模型（LLM）分割学习（SL）中的隐私标签。该方法通过破坏梯度与原始训练目标之间的一致性，使攻击者无法从暴露的梯度中恢复出私有标签，同时保持了模型优化的有效性。

Details

Motivation: 动机在于解决LLM分割学习中梯度匹配攻击（GMA）所依赖的关键假设——梯度是客户端全标签训练目标的忠实导数。攻击者利用这一一致性恢复私有标签，因此需要一种防御机制来打破这种一致性而不损害优化效果。

Result: 大量实验表明，在保持可比的微调性能下，Gradient Mirage提供了比现有防御方法更强的保护，实现了更好的隐私-效用权衡。

Insight: 创新点在于通过三个维度（目标、方向和尺度）诱导不一致性，具体包括：选择性自回归监督、尺度盲化和方向性私有化。这些技术使攻击者面临一个错误指定的逆问题，同时通过双轨反向传播和底部梯度恢复等技术保持了优化效用。

Abstract: Gradient matching attacks (GMAs) in LLM split learning (SL) rely on a critical yet underexplored assumption: the gradient exposed at the split interface is a faithful derivative of the client’s full-label training objective. This gradient-objective consistency allows a curious server to recover private labels by searching for a sequence whose induced gradient explains the observation. We propose Gradient Mirage, a defense that breaks this consistency without discarding the optimization utility of the backward signal. Our key idea is to induce the adversary to solve a misspecified inverse problem, in which no plausible label sequence in the sequence space can explain the observed gradients. Concretely, Gradient Mirage achieves this by inducing inconsistency across three dimensions: objective, direction, and scale. Selective Autoregressive Supervision derives the exposed gradient from a masked surrogate loss rather than the full-label objective assumed by the attacker; Scale Blinding then applies randomized multiplicative rescaling, obscuring the gradient’s natural magnitude; and Directional Privatization further randomizes the gradient direction while preserving its magnitude through the von Mises-Fisher (vMF) mechanism under a directional metric differential privacy guarantee. Crucially, utility is preserved: the Top segment still learns from all target tokens via Dual-Track Backpropagation, the exposed gradient remains informative since each supervised token retains its complete autoregressive context, and Bottom-Gradient Recovery restores the effective gradient for Bottom-segment optimization. Extensive experiments show that Gradient Mirage provides substantially stronger protection than existing defenses under comparable fine-tuning performance, achieving a better privacy-utility trade-off.

[21] SMTrap: Cost-Effective DoS Attacks Against Large Reasoning Models via SMT Conflict Guidance cs.CL | cs.AIPDF

Jian Yang, Zhenqi Feng, Zhaoyang Yu, Zhaoxin Fan, Kejian Wu

TL;DR: 本文提出了一种名为SMTrap的新型、无需模型反馈的拒绝服务攻击方法，专门针对大型推理模型。该方法利用可满足性模理论求解器产生的冲突计数作为低成本外部信号，指导合成计算密集型的约束满足问题实例，从而诱导模型进行大量回溯搜索，产生极长的输出轨迹，实现高效的DoS攻击。

Details

Motivation: 现有针对大型推理模型的DoS攻击方法严重依赖模型反馈来合成攻击查询，需要反复查询目标模型或训练专门的攻击模型，这些昂贵的操作严重削弱了攻击的杠杆效应。本文旨在提出一种无需模型反馈、成本更低的攻击范式。

Result: 在七个前沿模型上的评估表明，SMTrap展现出最先进的LRM-DoS能力，其产生的DoS效果比现有基线方法强数倍。

Insight: 核心创新在于提出了“搜索放大”这一攻击范式，其关键洞察是发现LRM在解决CSP时依赖试错回溯搜索，而SMT求解器在给定CSP实例上产生的冲突计数与LRM所需的回溯搜索量正相关。这允许攻击者无需查询目标模型即可生成高效的攻击查询。此外，论文还展示了一种基于工具的缓解方法，能显著减少令牌使用。从客观角度看，将SMT求解器的冲突计数作为攻击引导信号是一个新颖且低成本的思路，将DoS攻击的生成成本从依赖目标模型转移到了独立的、计算成本更低的SMT求解过程上。

Abstract: Existing LRM-DoS methods rely heavily on model feedback to synthesize attack queries, requiring either repeated queries to the target model or training a dedicated attack model. These expensive operations severely weaken attack leverage. In this paper, we propose \emph{search amplification}, a novel, model-feedback-free LRM-DoS paradigm. It employs the conflict count derived from an Satisfiability Modulo Theories (SMT) solver as a low-cost external signal to guide the synthesis of inference-heavy Constraint Satisfaction Problem (CSP) instances. Our key observation is that LRMs depend on trial-and-backtracking search when solving CSPs, where higher SMT conflict counts on a given CSP instance positively correlate with more extensive LRM backtracking search and substantially longer output trajectories. Building on this finding, we propose \textsc{SMTrap}, a lightweight, CPU-only framework. Guided by SMT conflict counts, \textsc{SMTrap} generates inference-heavy CSP queries without model queries, attack-model training, or GPU computation. Evaluations across seven frontier models demonstrate the state-of-the-art LRM-DoS capability of \textsc{SMTrap}, producing DoS effects multiple times stronger than existing baselines. To mitigate the threat of \textsc{SMTrap}, we demonstrate a tool-based mitigation that significantly cuts token usage.

[22] MedUAG: Unified Understanding and Generation for Medical Multimodal Models cs.CL | cs.AIPDF

Zijie Meng, Yuncheng Zhang, Hualiang Wang, Yitian Tang, Xiaotang Gai

TL;DR: 本文提出了MedUAG，一个用于医学领域的统一理解与生成多模态大语言模型框架。为了解决该领域缺乏综合性训练评估基准和已验证统一模型的问题，作者构建了包含超过600万实例的MedUAGCorpus数据集和涵盖12种任务的MedUAGBench基准。基于这些资源开发的MedUAG模型在广泛的医学理解与生成任务上展现了强大性能。

Details

Motivation: 当前多模态大语言模型正向统一理解与生成框架演进，但将其扩展到医学领域面临两大障碍：缺乏全面的训练与评估基准，以及缺少经过广泛验证的统一医学模型。

Result: 大量实验表明，MedUAG在广泛的理解与生成任务上均取得了强劲性能，为下一代医学多模态系统建立了有竞争力的基线。

Insight: 主要创新点在于系统性地构建了医学领域首个大规模统一理解与生成数据集（MedUAGCorpus）和标准化评估基准（MedUAGBench），并基于此开发了端到端训练的统一模型，为医学多模态研究提供了重要的基础设施和基线模型。

Abstract: Recent Multimodal Large Language Models (MLLMs) are rapidly evolving into unified understanding and generation (UAG) frameworks. However, extending these unified paradigms to the medical domain is hindered by: the absence of comprehensive training and evaluation benchmarks, and the lack of broadly validated unified medical model. To address these gaps, we present a comprehensive foundation for medical UAG. First, we construct MedUAGCorpus, the largest unified medical understanding and generation dataset to date, comprising over 6 million instances across 14 imaging modalities. Second, we introduce MedUAGBench, a systematic benchmark that expands medical generation evaluation to 12 diverse tasks under standardized protocols. Finally, leveraging these resources, we develop MedUAG, an end-to-end trained unified medical model. Extensive experiments demonstrate that MedUAG achieves strong performance across a wide array of understanding and generation tasks, establishing a competitive baseline and paving the way for next-generation medical multimodal systems.

[23] DeepWeaver: Bridging the Evidence Synthesis Gap in Open-Ended Question Answering cs.CL | cs.AIPDF

Xujia Wang, Yizhe Zhang, Bin Xu, Lei Hou, Juanzi Li

TL;DR: 本文提出DeepWeaver框架，通过维护结构化表示Thought Block Chains（TBCs），将检索到的碎片化证据编织成全面、引用准确的答案，以解决开放域问答中检索与生成之间的证据合成鸿沟。

Details

Motivation: 现有检索-生成流程在开放域问答中，直接生成常导致证据利用不足、引用错位和信息浅层化，存在证据合成差距。

Result: 在LoQA基准和DeepResearch Bench上，DeepWeaver提升了内容充分性、引用准确性和细节保留度，并实现了更深入的洞察和更高的引用质量。

Insight: 创新点在于引入Thought Block Chains（TBCs）这一结构化表示来组织证据，并通过从属TBCs检查剩余证据、修订TBCs和发现新主张，从而有效弥合检索与生成之间的差距。

Abstract: Retrieve-then-generate pipelines are commonly used to produce deep-research answers for open-ended questions, but retrieval alone is insufficient: LLMs must organize noisy and fragmented evidence into comprehensive, well-cited answers. We refer to this process as evidence synthesis. However, direct generation often underuses evidence, misaligns citations, and collapses diverse information into shallow summaries, exposing an evidence synthesis gap between retrieval and generation. Thus, we propose DeepWeaver, a novel framework that weaves noisy retrieved evidence into comprehensive answers by maintaining Thought Block Chains (TBCs), a structured representation that groups claims, salient information, keywords, and supporting evidence. DeepWeaver uses subordinate TBCs to inspect residual evidence, commit TBC revisions, and discover new claims before final generation. We evaluate DeepWeaver on open-ended QA over both knowledge bases and the web, and introduce LoQA, a high-density benchmark for evidence synthesis. Across multiple LLMs, DeepWeaver improves content sufficiency, citation grounding, and detail preservation on LoQA, while achieving deeper insights and higher citation quality on DeepResearch Bench. These results show that evidence weaving is an effective mechanism for bridging retrieval and generation in open-ended QA. Our code is available at https://github.com/KlozeWang/DeepWeaver.

[24] ChildSafeAds Shared Task 2026: Commercial Content in Child-Facing YouTube Videos cs.CL | cs.CYPDF

Thales Bertaglia, Catalina Goanta, Gerasimos Spanakis, Gunes Acar

TL;DR: ChildSafeAds是一个关于YouTube视频中面向儿童和青少年的商业内容的共享任务，包含来自939个频道的3360个视频。系统需要识别推广内容类型、产品类别和法律风险标志，并基于四个累积访问级别的证据进行评估。

Details

Motivation: 该任务旨在检测面向儿童和青少年的YouTube视频中的商业内容，以应对平台广告披露不足的问题（45.5%的视频未正确使用付费推广标签）。

Result: 任务使用GPT-5.4生成标签，并由专家团队迭代优化分类法、提示和模型选择；GPT-5.6-luna独立标注开发集，但参与系统和共享任务结果将在更新版本中补充。

Insight: 创新点在于结合开源众包数据（SponsorBlock）、多模态信息（视频、文本、链接页面）和累积访问级别设计，以评估数据收集成本与性能的权衡，并利用大模型辅助标注以提高效率。

Abstract: ChildSafeAds is a shared task on commercial content in YouTube videos likely to reach children and teenagers. It contains 3,360 videos from 939 channels. Each instance begins with a segment submitted to SponsorBlock, an open-source crowdsourced browser extension whose users mark sponsor segments so that others can skip them. We pair the segment with its available transcript, video and channel information, and a sales or service page linked from the video description. Systems determine what kind of offer is being promoted (ST1), assign product categories (ST2), and identify legal risk flags (ST3). The evidence is divided into four cumulative access levels, from the transcript to the linked page, so results can be compared against the cost of collecting the data. 45.5% of videos in our data failed to properly use the in-platform ad disclosure method (the ``Includes paid promotion’’ label). GPT-5.4 produced the labels after the expert organiser team reviewed samples and iterated on the taxonomy, prompts and model choices. GPT-5.6-luna independently labelled the development set. This report describes the task, data and evaluation. An updated version will add participating systems and shared-task results.

[25] Grading the Graders: Verification Autonomy Levels (L0-L5) for LLM Reasoning cs.CLPDF

Yajie Yin

TL;DR: 本文提出了验证自主性等级（VAL）框架，用于统一评估大型语言模型（LLM）验证方案。该框架根据验证规范的来源和判决保证程度，将验证方案分为L0到L5六个等级，并指出完整性盲点是核心限制。作者通过四个领域（符号数学、行为监控、医疗诊断和代码生成）的实例，澄清了文献中对‘等级’概念的混淆。

Details

Motivation: 当前LLM验证文献中‘等级’一词含义混乱，至少存在五种不同解释（如验证粒度、概念抽象等），缺乏统一的评估标准来比较不同验证方案的能力和局限性。

Result: 在四个应用领域的分析表明，基于替换和采样的验证器存在‘完整性盲点’，无法证明没有遗漏候选解；形式化可规约属性的验证最高可达L3/L4（具有单属性或领域级完整性），而经验性开放世界验证（如事实核查）上限为L2（锚定正确性）。

Insight: 创新点在于提出了VAL这一元标准，将验证方案的核心差异统一到‘验证规范来源’和‘判决保证’这一单一轴线上，并明确揭示了形式化验证与经验验证在完整性可达性上的根本二分法，有助于系统化评估和比较不同验证方法。

Abstract: Large language models (LLMs) are increasingly paired with verifiers (step checkers, self-consistency filters, tool-based fact checkers, formal proof assistants) that claim to detect the model’s errors. Yet the verification literature uses the word “level” to mean at least five different things: verification granularity, concept abstraction, risk tier, system-stack layer, and the epistemic source of the ground truth. We propose Verification Autonomy Levels (VAL), a meta-standard classifying verification schemes along a single axis: where does the verification spec come from, and what does the verdict guarantee? VAL ranges from L0 (LLM self-declaration, no deterministic anchor) through L2 (objective ground truth, correctness only) to L3/L4 (decidable systems with single-property or domain-level completeness), with L5 impossible in the unrestricted case. Central to VAL is the completeness blind spot: substitution- and sampling-based verifiers can confirm that proposed candidates hold, but cannot prove that no candidate was missed. We further identify a dichotomy the literature has not stated: completeness is reachable only for formally specifiable properties, while empirical open-world verification (fact-checking, diagnosis) caps at anchored correctness (L2). We document this across four domains (symbolic mathematics, behavior monitoring, medical diagnosis, and code generation) and in the strongest existing formal-verification baseline, whose authors note the verifier “focuses on the correctness of each step.” We show the levels of granularity, concept hierarchy, risk, and system stack are orthogonal to VAL, resolving a systematic conflation across 17 surveyed papers. Code and full assessment are released as supplementary material.

[26] SPADE: Self-Play in Adaptive Synthetic Executable Environments cs.CL | cs.AIPDF

Bo Liu, Simon Yu, Yiding Jiang, Ao Qu, Andrew Zhao

TL;DR: SPADE是一个自博弈强化学习框架，其中单个大语言模型扮演两个角色：环境设计师和推理智能体。环境设计师编写可执行的、长视野的训练环境代码，推理智能体在其中学习行动。通过优化基于特权提示奖励差距的遗憾信号，环境设计师学会生成处于智能体能力边缘但可行的环境，从而实现持续自我改进。

Details

Motivation: 现有语言智能体训练环境池（如人工策划、静态合成或固定验证器）在智能体规模扩大时保持目标分布固定，限制了持续自我改进所需的多样化、自适应目标的生成。

Result: 在扩展到300亿参数模型时，SPADE在八个保留的数学、科学、代码和推理基准测试中平均比最强的固定环境基线提高了+5.3分；在工具使用场景中，BFCL-v4多回合任务上提高了+5.7分，ACEBench-Agent上提高了+13.9分；在游戏设置中，与最强基线的差距随模型规模扩大而增加。

Insight: 核心创新在于将环境设计本身作为可学习组件，通过自博弈机制实现开放式的自我改进；关键技术包括基于大规模预训练语料库文档对环境设计师进行基础训练，并赋予其累积的环境记忆，以生成适应智能体当前能力的挑战性环境。

Abstract: Continuous self-improvement requires an ever-expanding pool of self-generated, diverse, adaptive goals. For language agents, existing training environment pools (hand-curated, statically synthesized, or frozen-verifier) keep the goal distribution fixed as the learner scales. We introduce SPADE (Self-Play in Adaptive Synthetic Executable Environments), a self-play RL framework in which a single LLM plays two roles: an Environment Designer that writes complete, long-horizon training environments as executable code with an OpenAI Gym-style reset()/step() interface, and a Reasoning Agent that learns to act in them. Each is a stateful, multi-turn environment (state transitions, reward functions, and verification code), so one interface spans reasoning problems and multi-step agentic tool use. The Reasoning Agent’s regret is estimated using the gap between its reward with and without privileged hints; in optimizing this regret signal the Environment Designer learns to target environments at the edge of the agent’s capabilities while keeping them feasible. Through extensive experimentation, we find several components critical to success: grounding the Environment Designer on documents sampled from a large pretraining corpus, and giving it an accumulated environment memory. Scaling to 30B-parameter models, SPADE improves over the strongest fixed-environment baseline by +5.3 on average across eight held-out math, science, code, and reasoning benchmarks, and lifts the tool-use setting by +5.7 on BFCL-v4 multi-turn and +13.9 on ACEBench-Agent; on the games setting, the margin over the strongest baseline grows with model scale. By making environment design itself a learnable component, SPADE takes a concrete step toward open-ended self-improvement.

cs.CV [Back]

[27] XRF-to-Optical Field-of-View Localization with Vision Language Models cs.CVPDF

Xiangyu Yin, Tatjana Paunesku, Letonia Copeland-Hardin, Martina Ralle, Zichao Wendy Di

TL;DR: 本文评估了无需训练的视觉语言模型（VLM）在X射线荧光（XRF）与光学显微镜图像之间的视场定位任务上的性能。研究在两个数据集（同切片高对应性和相邻切片低对应性）上测试了无约束和元数据约束搜索，并比较了VLM与几何控制、经典模板匹配及其他无需训练方法（DINOv2和multiGradICON）。研究发现，直接VLM提示能产生内容相关的空间信号但不稳定，而一种结合VLM候选生成与图像相似性验证的工作流在低对应性场景下实现了有效定位。

Details

Motivation: 解决不同显微成像模态（如XRF与光学）图像配准中，由于外观和结构差异导致的视场定位困难问题，特别是在对应性较低（如相邻组织切片）的场景下。

Result: 在跨模态结构保留的高对应性数据集中，经典模板匹配最准确；在低对应性数据集中，经典方法失败，而提出的VLM候选生成与验证工作流能恢复有效的定位结果。

Insight: 创新点在于提出了一种无需训练的、结合VLM内容感知与图像相似性验证的两阶段工作流，以应对跨模态图像间外观差异大、对应性低的挑战性定位任务，为多模态图像配准提供了新的训练自由解决方案。

Abstract: Registering images acquired with different microscopy modalities is essential for relating complementary measurements of the same specimen. In correlative X-ray fluorescence (XRF) and optical microscopy, the XRF map often covers only a small region of an optical image acquired from the same or an adjacent tissue section. Field-of-view (FOV) localization is necessary but can be difficult when appearance and structure differ across modalities. Here we evaluate training-free vision language model (VLM) localization on two datasets representing same-section high-correspondence and adjacent-section low-correspondence imaging. We test unconstrained and metadata-constrained search and compare VLMs with geometric controls, classical template matching, and two alternative training-free approaches (DINOv2 and multiGradICON). Direct VLM prompting produced content-dependent spatial signals but was not reliable alone. Classical matching was most accurate when cross-modal structure was preserved but failed in the low-correspondence collection. A proposal-and-verify workflow used repeated VLM predictions as candidates and image-based similarity to select the final location. This workflow recovered useful localization in the low-correspondence regime.

[28] FedCoRe: Target-Adaptive Completion for Missing Modalities in Healthcare Federated Learning cs.CV | cs.AI | cs.LGPDF

Holger R. Roth, Ziyue Xu, Peter Cnudde

TL;DR: 本文提出FedCoRe框架，用于解决联邦学习中客户端模态缺失的问题。该方法通过表示空间或对数空间的修正来补偿缺失模态，而非生成合成数据。在模拟的MIMIC呼吸衰竭任务上，FedCoRe能恢复约50%因缺失ECG或CXR模态导致的性能损失。

Details

Motivation: 联邦多模态学习通常假设所有客户端都具备完整模态，但实际医疗场景中不同医院可能缺少某些数据模态（如心电图、胸片）。本文旨在解决联邦学习环境下客户端模态不一致的问题。

Result: 在MIMIC衍生的呼吸衰竭预测任务上，缺失ECG模态导致AUROC下降约0.085；通过配对样本联邦平均可恢复0.0415 AUROC（49.0%损失性能）。对于CXR模态，在受控测试中恢复52.8%的性能损失。

Insight: 创新点在于提出验证门控的修正框架，通过配对样本监督学习跨模态表示补全，且仅在验证支持时才启用补全模块。该方法避免生成合成模态数据，直接进行表示/对数空间修正，更具部署可行性。

Abstract: Federated multimodal models often assume every site has every modality, although hospitals differ in access to EHRs, chest radiographs, and ECGs. We study this setting on a MIMIC-derived respiratory deterioration task with simulated FL clients and introduce FedCoRe (Federated Cross-Modal Representation Completion). FedCoRe learns representation- or logit-space corrections rather than generating synthetic ECGs or CXR images. When a client observes a modality that may be missing at deployment, it evaluates the same example with and without that modality to obtain paired supervision. Only clients with such pairs update the completion module, and validation may retain the unchanged prediction. We freeze the trained multimodal predictor during evaluation so that measured differences come only from completion. Hiding ECG reduced AUROC by about 0.085; paired-example FedAvg restored 0.0415 AUROC, or 49.0% of the lost performance. We therefore report two distinct effects: paired-example FedAvg partially recovers the missing-ECG gap, while validation-selected completion is a task-specific classifier-logit correction rather than literal ECG recovery. For CXR, effect-aware completion recovers 52.8% of the loss in a controlled test where CXR is hidden. Paired-example FedAvg transfers part of this effect, but validation keeps the no-completion baseline for deployment cases whose inputs lack CXR. Thus, FedCoRe should be read as a validation-gated completion/correction framework: it can recover missing-modality signal in supported settings, but it should be deployed only when paired examples and validation evidence support that modality.

[29] Reproducible Multimodal Affordance Prediction cs.CV | cs.ROPDF

Tommaso Apicella, Alessio Xompero, Andrea Cavallaro

TL;DR: 本文针对可负担性预测领域存在的评估和比较困难问题，提出了Affordance Sheet这一文档框架，旨在通过详细记录任务定义、输入模态、模型架构、训练信息、数据集和实验协议，促进该领域的透明度和可复现性。该框架支持可负担性模型在现实场景中的可复现基准测试和可靠评估，包括对新条件的泛化能力和人类安全考量。

Details

Motivation: 解决可负担性预测领域因问题表述异构、数据集标注不一致、实验协议报告不完整以及部署条件信息有限而导致的评估困难、公平基准测试和性能比较挑战。

Result: 论文提出了Affordance Sheet框架，但摘要中未提及具体的定量实验结果或基准测试性能指标。

Insight: 创新点在于提出了一个标准化的文档框架（Affordance Sheet）来系统化地记录和报告可负担性预测研究的各个方面，这有助于提升研究的透明度、可复现性和公平比较，是一个方法论上的贡献。

Abstract: Affordance prediction is the identification of potential actions an agent can perform on a target object from multimodal inputs. Affordance prediction methods are difficult to evaluate and compare due to heterogeneous problem formulations, inconsistent dataset annotations, incomplete reporting of experimental protocols, and limited information about deployment conditions. These limitations challenge fair benchmarking and performance comparison. To promote transparency, we propose the Affordance Sheet, a documentation detailing task formulation with its input modalities, model architectures and training information, datasets, and experimental protocols. Affordance Sheets enable reproducible benchmarking and reliable evaluation of affordance models for real-world scenarios, including generalisation to novel conditions and human safety.

[30] From Inference to Adaptation: A Unified Optimal Transport View of Vision Language Model cs.CV | cs.AI | cs.CL | cs.LGPDF

Qi Yu, Zhichen Zeng, Katherine Tieu, Xiyuan Yang, Ruizhong Qiu

TL;DR: 本文提出了一种名为\algname的统一最优传输视角下的视觉语言模型（VLM）测试时适应方法。该方法通过Wasserstein最优传输公式将零样本图像分类任务建模为跨模态对齐问题，以生成鲁棒的样本级伪标签，并采用基于最优传输的软标签InfoNCE损失进行模型适应，从而统一了推理和适应的目标。

Details

Motivation: 现有VLM在测试时适应方法严重依赖从原始嵌入相似度直接预测的噪声伪标签，这些标签在分布偏移下不可靠且会误导适应过程；同时，现有方法在适应阶段使用粗粒度的替代目标，未能显式建模不同模态间的样本级关系，导致与推理目标不匹配，性能提升有限。

Result: 大量实验表明，该方法在效率和效果上均表现优异，在多个基准测试中优于最佳性能方法高达7%，并达到了最先进的效率水平。

Insight: 创新点在于将VLM的推理和适应统一到一个Wasserstein最优传输框架下：推理时通过最优传输公式提供鲁棒的样本级伪标签；适应时采用可重构为最优传输公式的软标签InfoNCE损失进行对比学习，显式建模图像-文本对关系，实现了目标统一与性能提升。

Abstract: Vision-language models (VLMs) have demonstrated remarkable zero-shot capabilities yet remain sensitive to real-world distribution shifts during inference. Although significant efforts are devoted to adapting VLMs at test time, they rely heavily on noisy pseudo-labels predicted directly from raw embedding similarities during inference, which are unreliable under distribution shift and mislead the adaptation. To avoid noise amplification, existing works craft coarse-grained surrogate objectives during adaptation, which fail to explicitly model sample-level relationships across different modalities, creating objective mismatch with inference, thus leading to marginal performance improvement. In this work, we aim to bridge the detached objectives of inference and adaptation for VLMs, and propose a principled VLM TTA method called \algname. For VLM inference, we formulate the zero-shot image classification task as a cross-modal alignment problem encoded via a Wasserstein OT formulation, providing robust pseudo-labels at the sample-level to effectively adapt VLMs. For VLM adaptation, we adopt a soft-label InfoNCE loss to adapt VLMs based on the OT-induced pseudo-labels, leveraging fine-grained supervisions to explicitly model relationships of individual image-text pairs via contrastive learning, which empowers accurate inference at the same granularity. Moreover, we theoretically reveal that the InfoNCE loss can be neatly reformulated as a Wasserstein OT formulation, thereby unifying the objectives of the inference and adaptation of VLMs to achieve their mutual benefits. Extensive experiments demonstrate the effectiveness and efficiency of our methods, outperforming the best-performing methods by up to 7% with state-of-the-art efficiency.

[31] TTSD-FAR: Test-Time Self-Distillation with Fisher-Anchored Restoration for Missing-Modality Emotion Recognition in LVLMs cs.CV | cs.AIPDF

Muhammad Haseeb Aslam, Alessandro Koerich, Marco Pedersoli, Ali Etemad, Eric Granger

TL;DR: 本文提出TTSD-FAR框架，用于解决大型视频-语言模型在缺失模态下的情感识别问题。该方法结合了测试时自蒸馏和基于Fisher信息的锚定恢复机制，以参数高效的方式适应任意缺失模态模式，并在持续适应中保持稳定性能。

Details

Motivation: 现实世界中部署多模态情感识别系统时，测试时可能面临模态缺失或噪声问题，这导致分布偏移。现有基于熵最小化或困惑度降低的测试时适应方法不适用于自回归LVLMs，而检索增强生成在观测模态较弱时性能下降。

Result: 在MELD、DFEW和BAH数据集上，面对0%-50%的模态缺失情况，TTSD-FAR在长期适应过程中持续优于基于熵的适应、RAG和基于困惑度的生成方法。基线方法在没有恢复机制的情况下性能逐渐下降，而TTSD-FAR保持稳定。

Insight: 创新点在于将测试时自蒸馏与Fisher锚定恢复相结合，通过冻结的完整模态教师指导自适应低秩学生，仅更新少量参数，并利用Fisher信息稳定性监测收敛与漂移，在检测到分布偏移时将学生恢复至教师锚点，实现了参数高效且稳定的持续适应。

Abstract: Large video-language models (LVLMs) have shown remarkable performance on multimodal tasks like multimodal emotion recognition (ER) in the wild. ER is inherently multimodal, requiring a joint understanding of facial expressions, vocalizations, language, biosignals, and gestures. However, real-world deployment remains challenging: modalities may be missing or noisy at test time. Partial observations can be viewed as a distribution shift relative to the complete-modality distribution. SOTA TTA methods based on entropy minimization or perplexity reduction do not transfer to autoregressive LVLMs, while retrieval augmented generation (RAG) degrades when the observed modality is weak. Because no ground-truth supervision exists to verify individual updates, adaptation across this stream risks accumulating drift and degrading once the model departs from a reliable solution. An effective solution must therefore adapt to arbitrary missing-modality patterns and remain effective during continual adaptation. We address both jointly with Test-Time Self-Distillation (TTSD), a parameter-efficient framework in which a frozen teacher, trained on complete modalities, guides an adaptive low-rank student via self-distillation, updating only a negligible number of parameters. Stability is built into this same loop through Fisher-Anchored Restoration (FAR), which monitors Fisher information stability to detect convergence versus drift and restores the student toward the teacher’s anchor when distributional shifts are identified. Our experiments on MELD, DFEW, and BAH under 0%-50% missing modalities show that this unified adaptation-restoration design consistently outperforms entropy-based adaptation, RAG, and perplexity-based generation over long adaptation horizons, where baselines without restoration progressively degrade while TTSD-FAR remains consistent.

[32] Depth Anything V4: Dynamic 4D Scene Reconstruction via Riemannian Flow Matching on 4D Gaussian Splatting cs.CVPDF

Jiaming Fan, Jian Lu, Jinling Jia, Chenbin Zhang

TL;DR: Depth Anything V4 (DAV4) 是一个从单目视频进行动态4D场景重建的框架。其核心创新是将黎曼流匹配（RFM）应用于4D高斯泼溅的参数上，直接在非欧几里得流形（如尺度、旋转、不透明度）上定义概率路径，确保所有中间状态有效。该框架无需人工标注的深度标签作为训练损失，在动态重建和新视角合成任务上超越了之前的Depth Anything模型和逐场景优化的4D-GS方法。

Details

Motivation: 解决从单目视频高效、高质量地重建动态4D场景（3D几何+时间）的挑战，特别是确保4D高斯泼溅参数优化过程中的中间状态始终有效（位于合法的流形上）。

Result: 在动态重建任务上，通过控制实验分离了RFM的贡献：与使用相同数据、架构和测试时优化的确定性MLP基线（F-score 0.762）相比，RFM达到了0.806，获得了+0.044的增益。DAV4在动态重建和新视角合成方面超越了之前的Depth Anything模型和逐场景优化的4D高斯泼溅（4D-GS）。

Insight: 宣称的创新点是将黎曼流匹配（RFM）引入4D高斯泼溅的参数优化，直接在非欧几里得流形上建模，保证了参数演化的有效性。客观来看，该方法提供了一种在概率框架下优化复杂动态3D表示的新范式，并通过严格的消融实验量化了核心组件的贡献，同时提供了对计算成本和不确定性的详细分析，增强了方法的可解释性和部署可行性。

Abstract: We present Depth Anything V4 (DAV4), a framework for dynamic 4D scene reconstruction from monocular video. Our key contribution is the application of Riemannian Flow Matching (RFM) to 4D Gaussian Splatting parameters, defining probability paths directly on non-Euclidean manifolds (scale, rotation, opacity), ensuring all intermediate states are valid. Through controlled experiments, we isolate RFM’s contribution from test-time optimization (TTO) and pre-training. A deterministic MLP baseline with the same data, architecture, and TTO achieves F-score 0.762; RFM achieves 0.806 - the +0.044 gain is RFM’s isolated contribution. We provide corrected computational cost analysis: pre-training is 360 GPU-hours, amortizing for large-scale deployment (over 10,000 scenes). Uncertainty is quantified via Negative Gaussian Log-Likelihood and Expected Calibration Error. DAV4 outperforms prior Depth Anything models and per-scene 4D-GS on dynamic reconstruction and novel-view synthesis, while using no human-annotated depth labels as training losses.

[33] What Does Attention Transfer Transfer? Attention Structure and Robustness in Vision Transformers cs.CVPDF

Jesse Ponnock

TL;DR: 本文研究了视觉Transformer（ViT）中注意力转移机制对模型鲁棒性的影响。通过实验发现，通过注意力蒸馏训练的学生模型在分布内准确率接近教师模型，但在分布偏移下表现较差。研究揭示这种鲁棒性差距主要源于特征学习而非注意力结构本身，且与训练成熟度相关。

Details

Motivation: 动机在于探究注意力转移机制在ViT中传递的具体内容，特别是注意力结构与模型鲁棒性之间的关系，以解释为何通过注意力蒸馏训练的模型在分布偏移下表现不佳。

Result: 在ImageNet-100数据集上，使用自监督教师模型训练ViT-S学生模型。实验显示，注意力蒸馏能完美转移注意力结构（比微调模型接近教师模型两个数量级），但鲁棒性差距在14倍更少参数和10倍更少数据下依然存在；该差距与训练成熟度相关，延长训练可缩小差距。

Insight: 创新点在于通过注意力结构测量和干预实验，证明鲁棒性差距主要源于特征学习而非注意力结构；注意力可视化仅显示模型“看哪里”，而非“知道什么”，为理解ViT的泛化机制提供了新视角。

Abstract: Vision transformers (ViTs) trained to copy a pretrained teacher’s attention maps recover most of fine-tuning’s in-distribution accuracy yet fall measurably short of it under distribution shift, as recent work has shown. What the copy delivers has never been measured directly in the attention structure and tied to robustness. We build that instrumentation for ViT-S students of a self-supervised teacher on ImageNet-100, and report three findings that triangulate one conclusion. First, the transfer is essentially perfect and permanently so: the distilled student’s attention ends up roughly two orders of magnitude closer to the teacher’s than fine-tuning does, and does not drift with additional training. Second, the gap is real at 14$\times$ fewer parameters and 10$\times$ less data than previously studied, but it has a time axis. It tracks training maturity, and completing the schedules that the stopping rule interrupted closes it below our pre-registered threshold in two of three seeds, with comparisons at equal accuracy giving the same result. The endpoint gap at this scale is substantially a training-maturity artifact: robustness matures later than accuracy, and stopping rules tuned to accuracy undersample it. Third, forcing cross-row redundancy down by half the structural separation between the distilled and fine-tuned conditions produces no detectable robustness response under two registered ways of matching accuracy. Verified transfer, a gap that closes while the structure never moves, and a null under direct intervention are together consistent with the deficit residing in features, not in the visible attention structure. This is elimination plus intervention, and its scope is the regime we measured. In this regime, attention overlays show where a model looks, not what it knows.

[34] CoMVS-GS: Collaborative Multi-View Stereo and 3D Gaussian Splatting for Surface Reconstruction cs.CVPDF

Shihan Chen, Junjing Zhang, Qingsong Yan, Haibing Liu, Haofan Ren

TL;DR: CoMVS-GS是一个结合多视图立体视觉（MVS）与3D高斯泼溅的表面重建框架，旨在解决高斯泼溅在弱观测和遮挡区域难以进行准确网格重建的问题。它通过MVS点云初始化高斯基元，并引入PatchMatch-3DGS相互监督机制来优化几何一致性，最后使用Delaunay图割网格化流程提取表面。

Details

Motivation: 3D高斯泼溅虽然能高效合成新视角，但在弱观测和遮挡区域，高斯基元可能形成不稳定或几何不一致的结构，导致准确的网格重建困难。

Result: 在DTU、GauU-Scene V2和MatrixCity数据集上的实验表明，CoMVS-GS在物体级重建上保持竞争力，并在室外场景中提高了几何精度和网格紧凑性，同时维持了高渲染质量。

Insight: 创新点包括：使用密集MVS点云初始化高斯基元以提供更强的几何先验；提出PatchMatch-3DGS相互监督机制，通过深度和法向量的交互优化来改善弱约束几何；采用Delaunay图割网格化替代截断符号距离场体素融合，减少对体素分辨率的敏感性并保持可见性一致的表面证据。

Abstract: 3D Gaussian Splatting enables efficient novel view synthesis, but accurate mesh reconstruction remains difficult in weakly observed and occluded regions, where Gaussian primitives may grow into unstable or geometrically inconsistent structures. We propose CoMVS-GS, a general surface reconstruction framework that combines Multi-View Stereo with Gaussian splatting. CoMVS-GS initializes Gaussian primitives from dense multi-view stereo points with pre-flattened scales and normal-aligned orientations, providing stronger geometric priors than sparse structure-from-motion initialization and reducing ambiguity during early optimization. It further introduces PatchMatch-3DGS Mutual Supervision, where Gaussian-rendered depths and normals initialize PatchMatch refinement, and refined PatchMatch depths supervise Gaussian optimization to improve weakly constrained geometry. For surface extraction, CoMVS-GS replaces truncated signed distance field voxel fusion with a Delaunay graph-cut meshing pipeline, reducing sensitivity to voxel resolution while preserving visibility-consistent surface evidence. Experiments on DTU, GauU-Scene V2, and MatrixCity show that CoMVS-GS remains competitive on object-level reconstruction and improves geometric accuracy and mesh compactness in outdoor scenes while maintaining high rendering quality.

[35] JSL-DC: A Word-Level Japanese Sign Language Dataset with Linguist-Derived Descriptions for Distinguishing Confusable Signs cs.CVPDF

Ken Takaki, Asuka Ando, Misa Suzuki, Uiko Yano, Masaya Tsujimoto

TL;DR: 本文介绍了JSL-DC，一个针对日本手语（JSL）的大规模、多手语者单词级数据集，包含来自19位手语者的3.67万个视频。该数据集以聋人为中心构建，并提供了由语言学家撰写的、用于区分易混淆手语的描述。基于这些描述启发的模型在易混淆子集上比现有最佳方法提升了9.8%。

Details

Motivation: 解决日本手语缺乏大规模、多手语者数据集的问题，以开发能够泛化到新用户的模型，并支持帮助听力障碍儿童父母学习手语的工具。

Result: 在易混淆手语子集上，受语言学描述启发的模型比最先进（SOTA）的识别方法性能高出9.8%。

Insight: 创新点在于构建了一个以聋人为中心、经过严格审查的大规模JSL数据集，并首次提供了语言学描述来区分易混淆手语，这启发了新的模型设计并显著提升了识别性能。

Abstract: Effective sign language (SL) acquisition is crucial for deaf children, yet 95% are born to hearing parents who often lack proficiency in SL. SL recognition can power learning tools to help parents communicate with their children. However, Japanese Sign Language (JSL) lacks large-scale, multi-signer datasets, hindering the development of models that can generalize to new users. To address this gap, we introduce JSL-DC, the largest JSL dataset by video count, comprising 36.7K videos from 19 signers. The entire process was Deaf-centric: the lexicon comprising 270 JSL words was selected by Deaf and Coda linguists to facilitate parent-child communication, all participants were Deaf individuals who use JSL daily, and the data underwent a two-stage review process involving Deaf linguists. Moreover, we provide linguist-derived descriptions for distinguishing confusable signs. We demonstrate that the proposed model inspired by the descriptions outperforms state-of-the-art recognition methods by 9.8% on the confusable subset. The dataset, along with its linguistic description that inspires new models, will be released under a CC-BY 4.0 license to accelerate research in SL recognition.

[36] Partition the Support, Reconstruct the Residual: Training-Free Sparse Attention for Video Generation and World Models cs.CV | cs.AI | cs.LGPDF

Pardis Taghavi, Reza Langari, Gaurav Pandey

TL;DR: 该论文提出了一种名为SparsePR的无训练块稀疏注意力方法，用于加速视频生成和世界模型中的Transformer。该方法结合了响应耦合分区和探针拟合残差重建技术，通过优化分区几何和重建稀疏输出中的残差，在保持生成质量的同时显著降低了计算成本。

Details

Motivation: 现有无训练块稀疏注意力方法虽然能加速视频Transformer，但仅靠行级注意力集中度无法定义一个可执行的稀疏算子，且忽略的注意力交互可能导致较大的后softmax误差。论文旨在解决稀疏算子定义不精确和残差预测性差的问题。

Result: 在四个异构的视频生成和世界模型上，SparsePR在保持生成质量的同时，将实际执行的注意力对密度降低到22.0-26.0%，并实现了1.48倍到2.61倍的端到端加速。消融实验表明，探针拟合是误差降低的主要原因。

Insight: 创新点在于将分区几何与残差可预测性联系起来，并提出了响应耦合分区与探针拟合残差重建的组合方法。这为设计高效、精确的无训练稀疏注意力算子提供了新思路，即通过少量精确查询行来校准稀疏输出，从而在降低计算量的同时控制误差。

Abstract: Training-free block-sparse attention can accelerate video transformers, but row-wise attention concentration does not by itself specify an executable sparse operator. Queries sharing a block route may have poorly overlapping supports, while retained attention mass alone does not determine the post-softmax error from skipped interactions. We show that partition geometry affects both pooled support and the predictability of the remaining residual from the sparse output. We introduce SparsePR, which combines Response-Coupled Partitioning with Probe-Fitted Residual Reconstruction. Sampled-query key responses form paired K/V groups, whose centroids induce query-response coordinates for shared routing. A small set of exact query rows then calibrates a call-specific affine correction from the sparse output within the output subspace observed in the probe residuals. Across four heterogeneous video generation and world models, SparsePR consistently reduces attention-reconstruction error. Ablations show that probe fitting accounts for most of this reduction, while response-coupled partitioning lowers hard-drop error and improves reconstruction under a finite probe budget. SparsePR preserves generation quality at 22.0-26.0% realized executed-pair density while achieving 1.48x-2.61x end-to-end speedups. Project page: https://pardistaghavi.github.io/SparsePR-website/

[37] COSTA: A Cluster-Centric Paradigm for Annotation-Free Open-Set Semantic Segmentation of Aerial Point Clouds with Domain Shifts cs.CVPDF

Yanghong Lin, Li Fang, Tianyu Li, Shudong Zhou, Wei Yao

TL;DR: 本文提出了COSTA，一种面向航空点云无标注开放集语义分割的集群中心范式，旨在解决领域偏移下的泛化危机。该方法通过将封闭集逐点适应转变为集群中心的开放集语义传播，利用测试时适应技术桥接领域差距，并通过聚类级投票实现跨标签空间的语义分割。

Details

Motivation: 现有航空点云语义分割方法在领域偏移下泛化能力受限，且受限于封闭集标签假设和非可扩展的逐点分割流程，难以处理语义偏移。本文旨在探索仅通过推理阶段适应预训练模型，无需额外训练，即可分割目标域特定类别的方法。

Result: 以DALES为源域，COSTA在三个具有不同领域和异构类别空间的航空点云基准测试中实现了按需分割，在该新设置下达到最高70.09%的mIoU。

Insight: 创新点在于将开放集语义分割重新定义为集群级传播过程，核心发现是适应后的特征分布可提炼为可跨标签空间转移的语义中心。该方法通过测试时适应、基于相似度分布的聚类以及开放词汇视觉语言模型的伪标签传播，实现了领域间隙下的有效适应。

Abstract: Semantic segmentation of aerial point cloud is trapped in a generalization crisis under distinct domain shifts. While test-time adaptation offers a privacy-preserving and computationally efficient way to adapt pre-trained models to unlabeled target-domain data during inference, existing methods, bound to closed-set label assumptions and non-scalable point-wise segmentation pipelines, still struggle with semantic shifts. We ask: can we adapt any given pre-trained aerial point cloud segmentation model to a shifted target domain at the inference phase alone, without additional training, while segmenting target-specific categories beyond the source label space on demand? This paper introduces COSTA, which breaks this limitation by shifting from closed-set point-wise adaptation to cluster-centric open-set semantic propagation. Our core discovery is that, once effectively adapted at test time, the rich feature distribution of aerial point clouds can be distilled into a compact set of well-separated semantic centroids that are transferable across label spaces. COSTA leverages this to reformulate open-set semantic segmentation as a cluster-level propagating process: it first bridges the domain gap through proven test-time adaptation, then groups each batch of target-domain points into a small set of semantic clusters based on the similarity distribution in the adapted feature space, and finally propagates high-confidence pseudo labels obtained from an open-vocabulary vision-language model to all points through cluster-level voting. This cluster-centric paradigm enables test-time adaptation of aerial point clouds under significant domain gaps with mixed semantic shifts. With DALES as the source domain, COSTA enables on-demand segmentation across three aerial point cloud benchmarks with distinct domains and heterogeneous category spaces, achieving up to 70.09% mIoU under this new setting.

[38] DyG$^2$T: Modeling Object Dynamics with 3D Gaussian Temporal-Spatial Particle Graph Transformer cs.CVPDF

Yansong Wang, Zhaobo Qi, Xinyan Liu, Beichen Zhang, Shuhui Wang

TL;DR: 本文提出DyG$^2$T，一个用于建模物体动态的框架，旨在从有限的视觉观测中预测精确的运动轨迹。该方法通过空间上补全和时间上区分关键点表示，并在粒子图上建模多尺度交互，以克服现有方法因压缩粒子表示和局部约束交互而导致的细节丢失和轨迹漂移问题。

Details

Motivation: 现有动态建模方法将重建的粒子表示压缩为稀疏关键点，并使用局部约束的交互对其演化进行建模，这丢弃了细粒度的局部细节，并模糊了跨时空尺度的判别性交互建模，导致轨迹漂移和外观预测不准确。

Result: 在合成和真实世界数据集上的实验表明，DyG$^2$T实现了精确的动态建模和推理，并展现出强大的跨物体和真实世界泛化能力。

Insight: 创新点包括：1) 空间上通过聚合相邻原始粒子位置来丰富每个关键点以恢复细粒度细节，并显式编码关键点间的相对偏移以增强几何结构感知；2) 时间上引入时序解耦网络(TDN)识别潜在空间中的主导跨帧变化并放大帧间差异，再通过时序注意力聚合以捕捉逐帧演化线索；3) 使用粒子图变换器通过全局注意力保持关键点间判别性的长程依赖，缓解局部约束建模导致的表示同质化。

Abstract: Modeling object dynamics from limited visual observations is a fundamental problem for enabling accurate motion trajectory prediction in embodied interaction scenarios. Existing dynamics modeling methods first compress reconstructed particle representations into sparse Key Points and model their evolution using locally constrained interactions, thereby discarding fine-grained local details and obscuring discriminative interaction modeling across spatial and temporal scales, leading to drifting trajectories and inaccurate appearance prediction. To tackle these issues, we propose DyG$^2$T, a dynamics modeling framework that infers object motion trajectories by spatially completing and temporally discriminating Key Point representations and modeling multi-scale interaction over particle graphs. Spatially, DyG$^2$T enriches each Key Point by aggregating neighboring raw particle positions to recover fine-grained local details, while explicitly encoding relative offsets among Key Points to enhance geometric structure perception. Temporally, we introduce a Temporal Disentangling Network (TDN) to identify dominant cross-frame variations in latent space and amplify inter-frame differences, yielding temporally discriminative representations that are subsequently aggregated via Temporal Attention to capture frame-wise temporal evolution cues. For comprehensive interaction modeling, a Particle Graph Transformer leverages global attention to preserve discriminative long-range dependencies among Key Points, mitigating representation homogenization induced by locality-constrained modeling and providing a robust basis for accurate trajectory prediction. Experiments on both synthetic and real-world datasets demonstrate that DyG$^2$T achieves accurate dynamics modeling and reasoning, and exhibits strong cross-object and real-world generalization.

[39] OptiModNet: A UNet-Transformer Hybrid with Grouped-Query and Channel Attention for Optic Disc and Cup Segmentation cs.CV | cs.AIPDF

Soumili Ghosh, Debapriya Roy, Aryan Das, Bikash Santra

TL;DR: 本文提出了一种名为OptiModNet的新型轻量级混合架构，专门用于视盘和视杯的精确分割。该模型结合了UNet和Transformer的优势，并引入了分组查询和通道注意力机制，以增强局部和全局特征表示。在REFUGE2数据集上的实验表明，该方法在保持低计算开销的同时，实现了最先进的性能。

Details

Motivation: 视盘和视杯的精确分割对于青光眼的早期检测和诊断至关重要，但现有深度学习方法（如UNet、ViT）在计算效率和全局上下文建模方面存在局限，难以在资源有限的临床环境中部署。

Result: 在REFUGE2数据集上的视盘和视杯分割任务中，OptiModNet取得了最先进的性能，超过现有方法超过2.5%，同时仅需3.73 GFLOPs和1.93M参数，保持了高效率。

Insight: 创新点包括设计了一个结合UNet局部特征提取和Transformer全局建模能力的轻量级混合架构，引入了分组查询和通道注意力机制以优化特征表示，并采用了聚合金字塔损失来监督多尺度预测，促进梯度流动和结构一致性。

Abstract: Precise segmentation of the optic disc and cup is critical for the early detection and diagnosis of glaucoma. However, achieving consistently high performance across datasets while maintaining low computational requirements remains a significant challenge. In glaucoma detection, low-computation methods are crucial for enabling rapid, large-scale screening and facilitating deployment in resource-limited clinical environments. While deep learning models such as UNets, Vision Transformers (ViTs), and Diffusion models have demonstrated strong segmentation performance but these methods often come with substantial computational overhead. UNets are efficient at capturing local features but are limited in modeling global contextual information. Conversely, ViTs excel at long-range dependency modeling but are computationally intensive. Hybrid architectures, such as UNetR, which combine transformer-based encoders with UNet-style decoders, have shown improved performance but while incurring additional complexity. Considering these, in this work, we propose OptiModNet, a light weight novel hybrid architecture tailored for optic disc and cup segmentation. The model integrates diverse attention mechanisms at multiple stages of the network to enhance both local and global feature representation. We include an Aggregated Pyramid Loss that supervises predictions at multiple decoder depths, to promote better gradient flow and structural consistency. We evaluate OptiModNet on the REFUGE2 dataset for both optic disc and cup segmentation tasks. Our method achieves state-of-the-art performance, exceeding existing approaches by over 2.5%, while maintaining high efficiency with only 3.73 GFLOPs and 1.93M parameters. The code is available at https://github.com/SG1947/OptiModNet.

[40] Zero-Shot SAM2 Segmentation and Vision Transformer-Based Recognition of Elamite Cuneiform Symbols from Degraded Tablet Images cs.CV | cs.HCPDF

Utsav Poudel, Rasik Bhattarai, Siddhartha Pathak, Raghavendra Ramacharna, Gaurav Jaswal

TL;DR: 本文提出EpigraphNet，一种用于从退化泥板图像中自动识别埃兰楔形文字符号的流程。该流程结合了零样本SAM2分割和视觉Transformer分类，在Persepolis Fortification Archive数据集上实现了86.41%的top-1准确率，显著超越了多种CNN和现代骨干网络基线。

Details

Motivation: 解决古代楔形文字自动识别中的复合信号退化问题，包括泥板三维浮雕导致的光照不均和阴影、表面侵蚀引入的结构化噪声，以及141个符号类别间的严重类别不平衡，这些因素共同损害了分类器的可靠性。

Result: 在132类基准测试上达到86.41%的top-1准确率，比最强的CNN基线（ResNet-101，69.20%）高出17.21个百分点，并在相同条件下超越DeiT、Swin、ConvNeXt和EfficientNet等四种现代骨干网络5.31-12.91%。

Insight: 创新点在于将零样本SAM2分割与视觉Transformer分类结合，通过亮度自适应形态学预处理和逆频率类别加权，有效处理了退化图像和类别不平衡问题，实现了对频繁和稀有类别更均衡的识别。

Abstract: Automated recognition of ancient cuneiform script poses a compound signal-degradation problem: the three-dimensional relief of clay tablets creates spatially varying illumination and cast shadows, surface erosion introduces structured noise that overlaps with genuine sign impressions, and severe class imbalance across 141 sign categories undermines classifier reliability. We introduce EpigraphNet, a segmentation-guided transformer pipeline evaluated on the Persepolis Fortification Archive. From 1,239 annotated tablet images, brightness-adaptive morphological preprocessing and zero-shot SAM2-Large segmentation generate clean binary symbol masks, which a fine-tuned Vision Transformer (ViT-B/16) with inverse-frequency class weighting then classifies. EpigraphNet reaches 86.41% top-1 accuracy on a 132-class benchmark, a 17.21 percentage-point gain over the strongest CNN baseline (ResNet-101, 69.20%) and 5.31-12.91% over four modern backbones (DeiT-B/16, Swin-B, ConvNeXt-B, EfficientNet-B4) under identical conditions. The full pipeline runs at approximately 18 ms per sign on an NVIDIA A100 GPU. A lower Spearman correlation between sign frequency and per-class performance indicates more balanced recognition across frequent and rare classes. Implementation is available at: github.com/r11up/sam-guided-vit

[41] StateTrace: An Object-Centric Framework for Hidden-State Spatiotemporal Reasoning in Long Videos cs.CVPDF

Yu Han, Wenhao Li, Yichao Cao, Hongyan Xu, Shuo Yang

TL;DR: 本文提出了一种名为StateTrace的以对象为中心的框架，旨在解决视频语言模型在长视频时空推理中的隐藏状态推理挑战。该框架构建了一个可重用的时空状态记忆，用于组织对象轨迹、对象间关系和状态转换事件，并在推理时检索问题相关的状态演化轨迹作为线索，从而显式地推断对象在不可见期间的状态。

Details

Motivation: 现有视频语言模型在长视频理解中表现良好，但当目标对象变得不可见时，它们难以进行时空推理，常常将’不可见’误判为’未知’。本文旨在解决这一隐藏状态时空推理问题，即从上下文交互中推断对象在长时间不可见间隔内的状态。

Result: 在多个视频语言模型上的广泛实验表明，StateTrace在公共基准和作者构建的HSR-Bench诊断基准上均能持续提升性能。例如，在HSR-Bench上，它将VideoLLaMA3的得分从39.6提升至64.2。

Insight: 论文的创新点在于提出了一个显式的、以对象为中心的隐藏状态推理机制，通过构建结构化的时空状态记忆和检索相关轨迹作为推理线索，使模型能够显式地推理对象消失的原因、不可见期间的状态演化以及查询时状态是否应持续。这为长视频理解中的复杂时空推理提供了新的框架思路。

Abstract: Existing VLMs have achieved strong performance in video understanding, yet they struggle with long-video spatiotemporal reasoning when target objects become invisible, often mistaking “invisible” for “unknown”. We define this challenge as hidden-state spatiotemporal reasoning: inferring object states during prolonged invisible intervals from context interactions. To address this, we propose StateTrace, a novel object-centric framework that endows VideoLLMs with an explicit mechanism for hidden state reasoning in long videos. StateTrace builds a reusable spatiotemporal state memory that organizes object trajectories, inter-object relations, and state-transition events into a structured reasoning substrate. At inference time, it retrieves question-relevant state-evolution trajectories and converts them into compact reasoning cues, enabling the model to explicitly reason about why an object disappears, how its state evolves while invisible, and whether that state should persist at query time. We further build HSR-Bench, a diagnostic benchmark for hidden-state reasoning, containing 1,427 video-QA samples from 1,384 unique videos. Extensive experiments across multiple VideoLLMs show that StateTrace consistently improves performance on both public benchmarks and HSR-Bench (e.g., improving VideoLLaMA3 from 39.6 to 64.2 on HSR-Bench).

[42] PATE-Forensics: Perception-as-Tool for Explainable Deepfake Forensics with General-Purpose MLLMs cs.CVPDF

Yaqi Li, Jielun Peng, Yabin Wang, Jincheng Liu, Xiaopeng Hong

TL;DR: 本文提出了一种名为PATE-Forensics的可解释深度伪造取证新范式，其核心是‘感知即工具’（Perception-as-Tool）理念。该方法将取证任务解耦：首先，一个基于DINOv3的专用‘感知工具’紧密耦合地完成伪造检测与定位，生成结构化取证上下文；然后，一个通用的多模态大语言模型（MLLM）利用此上下文，在提示约束下生成解释，无需任务特定的微调。

Details

Motivation: 现有可解释深度伪造取证方法通常依赖经过任务适配的MLLM来联合处理检测、定位和解释，这可能导致耦合不理想。本文受智能体式工具使用启发，旨在通过架构解耦来改进这一流程，将检测与定位紧密集成在一个专用工具中，而将解释生成交给通用MLLM，以实现更优的性能和可解释性。

Result: 在DDL-X Track 3基准测试中，PATE-Forensics取得了0.89的最佳官方分数，比第二名团队高出0.19分，展现了其优越性能。

Insight: 主要创新点在于提出了‘感知即工具’的范式，将检测/定位与解释生成在架构上解耦，同时通过一个精心设计的取证感知工具（集成多粒度检测与线索引导定位）将检测与定位紧密耦合。这允许使用通用MLLM进行零样本解释生成，无需针对特定取证任务进行微调，提高了方法的通用性和可解释性。

Abstract: Existing explainable deepfake forensic methods typically rely on task-adapted MLLM to jointly address detection, localization, and explanation. Inspired by agent-style tool use, we instead introduce a Perception-as-Tool paradigm and instantiate it as PATE-Forensics, which architecturally decouples detection and localization from explanation generation while coupling detection and localization as tightly as possible within a forensic perception tool. The DINOv3-based tool couples a multi-granularity detection module that integrates global, patch-level, and segment-level evidence with a cue-guided localization module by spatializing the patch-level and segment-level evidence into forgery score maps that guide dense mask prediction. The original image and forensic perception outputs produced by the tool form structured forensic context for a general-purpose MLLM, which is guided by prompt constraints to generate explanations without task-specific fine-tuning. On DDL-X Track 3, PATE-Forensics achieves the best official score of 0.89, outperforming the second-ranked team by 0.19 points. Our code is available at https://github.com/yqli00000/PATE-Forensics.

[43] MR-IQA-2: Faithful Image Quality Reflection via Fine-Grained Credit Assignment cs.CV | cs.AIPDF

Yuan li, Youyuan Lin, Chenhui Chu, Shin’ya Nishida

TL;DR: 本文提出MR-IQA-2框架，通过细粒度信用分配提升多模态大语言模型在图像质量评估中的忠实性和可靠性。该框架采用演员-编辑-评判者结构，将推理过程与评分监督解耦，并利用视觉反射提供可验证的监督，从而确保质量推理能忠实反映图像质量。

Details

Motivation: 现有基于MLLM的图像质量评估方法主要依赖人类评分进行监督，但评分准确性本身不能保证推理过程的忠实性，且共享的奖励信号可能掩盖监督来源，甚至强化偶然正确的非忠实推理。

Result: 在多个IQA基准测试中，MR-IQA-2实现了与人类评分具有竞争力的对齐。此外，视觉反射能力使其能够超越评分，提供更丰富、更忠实的视觉理解。

Insight: 创新点在于提出了一个解耦推理与评分监督的演员-编辑-评判者框架，并通过细粒度信用分配（如掩码令牌特定更新）区分不同监督信号，同时保持从推理到评分的因果关系，从而提升推理的忠实性和可解释性。

Abstract: Multimodal large language models (MLLMs) have shown strong potential for image quality assessment (IQA) by improving consistency between quality ratings and their underlying reasoning. However, most approaches supervise reasoning through human-provided ratings and rarely examine whether it faithfully reflects image quality. Rating accuracy alone does not ensure faithful reasoning; a shared reward also obscures supervision sources and may reinforce unfaithful reasoning when a correct rating occurs by chance. To improve the faithfulness and reliability of blind IQA, we aim to (1) decouple credit assignment for reasoning and rating and (2) provide verifiable supervision for faithful reasoning. We introduce MR-IQA-2, an actor-editor-judge framework that operationalizes reasoning-editing-reflection. The actor generates quality reasoning for an input image, and the editor revises the image according to the identified quality factors. A frozen judge compares the original and edited images and provides reflective supervision for the actor’s reasoning. MR-IQA-2 further uses fine-grained credit assignment to decouple reasoning and rating supervision. Judge feedback supervises reasoning, whereas human ratings supervise the predicted rating. Masked token-specific updates distinguish these signals while preserving the causal relation from reasoning to rating. Across IQA benchmarks, MR-IQA-2 achieves competitive rating alignment with humans. Visual reflection also enables richer and more faithful visual understanding beyond rating, which may inform image-quality optimization and related downstream tasks. Code is available at https://github.com/RobinY99/MR-IQA-2.

[44] SPARC: Subspace Position-Aware Robust Few-Shot Calibration for Distribution-Shifted Industrial Anomaly Detection cs.CVPDF

Seokhee Han, Seungjun Chu, Mateusz Nowak, Peter Chin

TL;DR: SPARC是一种用于分布偏移下工业异常检测的少样本校准方法，它通过拦截编码器与检测器之间的补丁特征，并利用每个单元的子空间投影来消除部署时干扰的闭式估计，仅需不超过8张已验证的正常图像即可实现无需梯度更新的校准，适用于多种检测器架构。

Details

Motivation: 工业异常检测模型在部署时可能面临光照、夹具放置或传感器特性等分布偏移问题，导致性能下降，而标注异常样本稀缺，因此需要利用少量已验证的正常图像进行校准。

Result: 在易发生偏移的基准测试中，SPARC将七个检测器的图像AUROC和AU-PRO$_{0.3}$分别提升了13.8和3.5个百分点；在没有人为偏移的基准上，变化较小且混合。

Insight: 创新点在于提出了一种基于单元子空间投影的闭式校准方法，无需反向传播或权重更新，通过代数饱和秩选择实现鲁棒性，适用于多种检测器类型，有效应对分布偏移。

Abstract: Vision-based industrial anomaly detectors are calibrated on one distribution but may be deployed on another that differs in illumination, fixture placement, or sensor characteristics, sharply degrading an otherwise accurate detector. Adapting to the incoming lot is a natural response, but labeled anomalies are scarce. We therefore consider calibration using only a handful of verified-normal images available before scoring the rest of the lot. Existing fixes require backpropagation, detector-specific tuning, or choices about feature directions that few calibration samples cannot justify. We present SPARC, a few-shot calibration method that intercepts patch features between encoder and detector and removes a closed-form, spatially indexed estimate of deployment-time nuisance through per-cell subspace projection. It needs only $k \le 8$ verified-normal images and uses the algebraic saturation rank $r{=}k{-}1$ on the encoder’s native patch grid. The correction requires no gradient or weight updates and works with memory-bank, density, prototype, and mutual detectors. On the shift-prone benchmarks, SPARC improves pooled Image AUROC and AU-PRO$_{0.3}$ for all seven detectors whose image scores depend on corrected patch features by $+13.8$ and $+3.5$ percentage points (pp), respectively; on benchmarks without engineered shift, the changes are small and mixed. Controls that give competing corrections the same calibration images attribute these gains to the per-cell subspace structure rather than the images alone. Further ablations support the saturation-rank choice and characterize sensitivity to backbone and calibration conditions.

[45] OmniHandwritingOCR: A Diagnostic Benchmark for Evaluating Multimodal LLMs in Handwritten OCR Scenarios cs.CV | cs.AIPDF

Zinuo Guo, Min Zhang, Bo Jiang

TL;DR: 本文提出了OmniHandwritingOCR，一个用于评估多模态大语言模型（MLLMs）和OCR系统在手写OCR场景下性能的诊断性基准。该基准覆盖手写文本识别和手写数学表达式识别，包含6个子任务和12个子集，总计77.57K张标注图像。评估了13个开源和闭源系统，发现现有系统在复杂多行公式上性能显著下降，且存在幻觉问题。

Details

Motivation: 当前多模态大语言模型越来越多地被用作OCR系统，但其真实手写文本的识别能力尚未得到充分探索。现有OCR基准主要关注印刷体文本或干净的单行输入，对多语言手写、书写错误、结构复杂的数学表达式等真实手写OCR场景覆盖有限。

Result: 在统一协议下使用五个互补指标评估了13个系统。结果显示，当前系统远未达到忠实转录的水平：在复杂多行公式上性能急剧下降，模型排名因语言和公式设置而异，并且多个生成模型会产生看似合理但缺乏视觉依据的修正（幻觉）。

Insight: 创新点在于构建了一个难度分层的多行公式语料库，专门用于测试模型在结构复杂性增加下的鲁棒性。该基准为诊断多模态模型在手写OCR场景下的语言、内容、结构和视觉基础失败模式提供了一个具有挑战性的测试平台。

Abstract: Multimodal large language models (MLLMs) are increasingly used as OCR systems in document and knowledge-processing pipelines, but their ability to faithfully read real handwriting remains underexplored. Existing OCR benchmarks focus largely on printed text or clean single-line inputs, leaving limited coverage of realistic handwritten OCR scenarios such as multilingual handwriting, writer errors, and structurally complex mathematical expressions. We introduce OmniHandwritingOCR, a diagnostic benchmark for evaluating MLLMs and OCR systems on handwritten OCR. It covers handwritten text recognition and handwritten mathematical expression recognition across six subtasks and twelve subsets, totaling 77.57K labeled images from public datasets and newly collected student writings. A key component is a difficulty-stratified multi-line formula corpus designed to test robustness under increasing structural complexity. We evaluate thirteen open- and closed-source systems with five complementary metrics under a unified protocol. Results show that current systems remain far from faithful transcription: performance drops sharply on complex multi-line formulas, model rankings vary across language and formula settings, and several generative models hallucinate plausible but visually unsupported corrections. OmniHandwritingOCR provides a challenging testbed for diagnosing language, content, structural, and visual-grounding failure modes of multimodal models in handwritten OCR scenarios.

[46] Teach a Molmo2Fish: Towards interactive fish tracking with natural language guidance cs.CVPDF

Kai Van Brunt, Justin Kay, Sara Beery

TL;DR: 本文提出了一种名为Molmo2Fish的交互式预测校正工作流，利用多模态大语言模型通过自然语言对话来校正不完美的多目标跟踪预测，并以声纳鱼类跟踪数据集作为概念验证。

Details

Motivation: 解决计算机视觉在生态学数据集中多目标跟踪等复杂任务中预测不完美的问题，探索如何通过人机交互流程使不完美的预测变得有用。

Result: Molmo2Fish在鱼类跟踪和轨迹校正任务上表现出高性能，但在整合自然语言指导方面仍有改进空间。

Insight: 创新点在于将多模态大语言模型与交互式校正工作流结合，通过自然语言对话实现跟踪预测的实时修正，为生态学工作流中的人机协作提供了新思路。

Abstract: Computer vision is increasingly used to automate recognition tasks in large ecological datasets, but more complex tasks such as multi-object tracking continue to pose challenges. As researchers seek to incorporate vision models in ecology workflows, various lines of research have explored how to make imperfect predictions useful through human-in-the-loop processes. We propose a new approach to working with imperfect tracking predictions through an interactive prediction correction workflow taking place as a conversation with a multimodal large language model, which we tailor to a sonar fish tracking dataset as an initial proof of concept. We investigate the performance of the tool, Molmo2Fish, across guided and unguided tasks, correcting its own predicted tracks and external tracks. We find that Molmo2Fish achieves high performance on fish tracking and track correction tasks, but there is still much room to improve on incorporating natural language guidance. The code and data are publicly available at https://github.com/tidalove/molmo2fish.

YoungJae Cheong, Jhonghyun An

TL;DR: 本文提出了FD-CanKD，一种面向紧凑目标检测器的知识蒸馏框架，旨在通过解耦的跨注意力机制，在预测、关系和频率三个互补层面传递教师模型的知识，以缩小紧凑模型与大型模型之间的精度差距。

Details

Motivation: 紧凑型目标检测器由于表示能力有限，其精度与大型模型存在差距；传统的检测器蒸馏方法通常仅依赖预测级监督或单一的特征对齐目标，缺乏多层次的互补知识传递。

Result: 在MS COCO数据集上的固定50轮从头训练对比实验中，FD-CanKD与代表性检测器知识蒸馏基线保持竞争力；蒸馏后继续微调20轮，学生模型达到mAP50:95为48.87%，mAP50为65.84%，mAP75为53.40%，且部署时无需额外模块，参数量保持19.7M。

Insight: 创新点在于提出了频率解耦的跨注意力知识蒸馏框架，通过头级预测监督、关系级非局部上下文传递和频率级组件选择性对齐三个互补层次进行知识转移；客观分析认为，其结合了空间上下文聚合与频率感知对齐，有效保留了结构和细节敏感线索，为紧凑检测器的精炼提供了强化的学生模型。

Abstract: Compact object detectors are suitable for resource-constrained visual perception, but their limited representation capacity creates an accuracy gap relative to large models. Conventional detector distillation often relies on prediction-level supervision or a single feature-alignment target, such as response, distribution, correlation, or frequency-domain matching. Frequency-Decoupled Cross-Attention Knowledge Distillation (FD-CanKD) is presented as a detector-oriented framework that transfers teacher knowledge at three complementary levels: head-level prediction supervision, relation-level non-local context transfer, and frequency-level component-selective alignment. Student features first aggregate teacher-side spatial context through cross-attention-based relation transfer, after which frequency-aware alignment preserves complementary structural and detail-sensitive cues. Under controlled Microsoft Common Objects in Context (COCO) experiments, fixed 50-epoch from-scratch comparisons show that FD-CanKD remains competitive with representative detector knowledge distillation baselines. Post-distillation continued fine-tuning further produces a stronger refinement-ready student than detector-only fine-tuning, reaching 48.87 mean average precision (mAP) at intersection-over-union thresholds from 0.50 to 0.95 (mAP50:95), 65.84 mAP50, and 53.40 mAP75 after 20 additional epochs. All distillation modules are removed after training, leaving the deployed student unchanged at 19.7M parameters. The framework is instantiated and evaluated in a controlled YOLOv12 teacher-student setting as a representative compact-detector case study.

[48] PCQA-R1: Advancing Generalized 3D Point Cloud Quality Assessment with Reinforcement Learning cs.CVPDF

Kangning Ye, Yunhao Li, Sijing Wu, Yucheng Zhu, Guangtao Zhai

TL;DR: 本文提出了PCQA-R1，一种基于强化学习的大型多模态模型（LMM），用于无参考点云质量评估（PCQA）。该方法通过构建思维链数据集PCQA-CoT进行冷启动训练，并引入高斯邻近奖励来稳定评分预测，旨在解决现有方法在跨数据集泛化时因MOS尺度异构和标注有限而面临的挑战。

Details

Motivation: 现有基于LMM的PCQA方法主要依赖监督微调直接预测数值质量分数，难以泛化到具有不同MOS尺度和有限标注的异构数据集。关键难点在于绝对MOS回归在不同评分尺度和失真分布的数据集上表现脆弱，而相对质量排序在此类变化下更为稳定。

Result: 实验结果表明，PCQA-R1在五个基准测试上实现了最先进的跨数据集泛化性能，并在域内精度上具有竞争力。消融研究支持了排序、高斯奖励和冷启动轨迹的作用。

Insight: 论文的主要创新点在于首次将强化学习引入PCQA领域的LMM，通过相对排序策略（GRPO）和思维链数据构建来建模质量理解与评分，并设计高斯邻近奖励来防止校准漂移，从而提升了模型的泛化能力。

Abstract: No-reference point cloud quality assessment (PCQA) has been an active topic in recent years and is used to measure and optimize the visual experience of point clouds. However, large multimodal models (LMMs) have rarely been explored in this area. Previous LMM-based methods mainly rely on supervised fine-tuning to directly predict numerical quality scores, lacking the ability to generalize across datasets with heterogeneous MOS scales and limited annotations. A key difficulty is that absolute MOS regression can be brittle across datasets with different score scales and distortion distributions, whereas relative quality ranking is more stable under such shifts. In this paper, we present PCQA-R1, the first reinforcement learning LMM for 3D point cloud quality assessment to simultaneously model quality understanding and scoring. Built upon the group relative policy optimization (GRPO) strategy, PCQA-R1 first constructs a chain-of-thought dataset, PCQA-CoT, which serves as cold-start training data through a reverse reasoning strategy that teaches the LMM to generate its reasoning process. We further introduce a Gaussian proximity reward that prevents calibration drift by anchoring score predictions to the source MOS range. Experimental results demonstrate that PCQA-R1 achieves state-of-the-art cross-dataset generalization across five benchmarks and competitive in-domain accuracy. Ablation studies support the role of ranking, Gaussian reward, and cold-start traces.

[49] VA-Judger: Reward Modeling from Human Preference Feedback for Joint Video-Audio Generation cs.CVPDF

Yinming Huang, Shuyuan Tu, Xi Yan, Zihan Yang, Jianhua Han

TL;DR: 本文提出了VA-Judger，一个用于联合视频-音频生成的奖励模型。为了解决现有基于组合指标的奖励信号无法捕捉整体语义和时间连贯性、易导致奖励攻击的问题，作者首先构建了一个大规模人类偏好数据集VAPref-10K和一个评估基准VA-Judger-Bench。VA-Judger模型采用思维链全奖励建模方法，通过分阶段学习从清晰质量差异到困难近质量比较的偏好，并将人类反馈分解为各质量维度以提供更密集的奖励信号。实验表明该模型在预测人类偏好方面优于基线指标，并能显著提升生成模型的质量。

Details

Motivation: 现有方法通过组合音频质量、视觉保真度和同步性等独立维度的指标来构建奖励信号，但这些指标无法捕捉文本提示、视频和音频之间的整体语义与时间连贯性，导致模型优化时出现奖励攻击，生成内容虽在指标上得分高但人类观感不连贯或不忠实。

Result: 实验表明，VA-Judger在领域内和领域外评估中，在预测人类偏好方面均优于基于指标的基线方法。使用其与人类对齐的奖励对音视频生成模型进行后训练，能显著提升生成质量。

Insight: 创新点包括：1) 构建了大规模细粒度人类偏好数据集VAPref-10K和评估基准VA-Judger-Bench；2) 提出了VA-Judger模型，采用分阶段思维链学习策略，从易到难学习偏好，并通过拒绝采样验证获取可靠偏好解释；3) 将人类反馈分解为各质量维度进行强化学习，提供比单一二元偏好标签更密集的奖励信号，从而更好地对齐人类偏好。

Abstract: Using reinforcement learning to post-train joint video-audio generation models requires a reward signal. Existing methods construct this reward by combining metrics for individual quality dimensions, including audio quality, visual fidelity, and synchronization. However, these metrics evaluate perceptual dimensions separately and fail to capture the overall semantic and temporal coherence among the text prompt, video, and audio that shapes human preferences. Optimizing models against these metrics encourages reward hacking, generating video-audio content that achieves high scores on these metrics yet appears incoherent or unfaithful to human viewers. To address this problem, we first construct a large-scale human-preference dataset VAPref-10K for joint video-audio generation, comprising 9K prompts and 10.3K fine-grained paired comparisons from open-source generation models. We also introduce the VA-Judger-Bench benchmark with both in-domain and out-of-domain model comparisons to evaluate whether reward models truly align with human preferences. We further propose VA-Judger, a chain-of-thought omni-reward model for joint video-audio generation. In particular, VA-Judger first learns from pairs with clear quality gaps to establish structured output and coarse preference discrimination, then distills reliable preference explanations for harder near-quality comparisons via rejection sampling verified against human annotations, and finally performs dimension-wise reinforcement learning that decomposes human feedback into individual quality dimensions for denser reward signals than a single binary preference label. Experiments show that VA-Judger outperforms metric baselines in predicting human preferences on both in-domain and out-of-domain evaluations. Using its human-aligned rewards for post-training audio-video generation model also yields significant improvements in generation quality.

[50] When Safety Overrides Vision: Exploring Dynamics between Vision Influence and Safety Alignment in Vision-Language Models cs.CV | cs.CLPDF

Mehak Gupta, Tanmoy Chakraborty

TL;DR: 本文研究了安全对齐的视觉语言模型（VLMs）在安全约束指令下拒绝回答可正确回答问题的现象，发现视觉感知基础在解码过程中仍被保留，但安全对齐会覆盖视觉表达，导致模型拒绝生成答案。

Details

Motivation: 探究安全对齐是否抑制了视觉感知基础本身，还是视觉证据在内部保持可用但生成被重定向至拒绝行为，以揭示对齐VLMs中未被充分探索的故障模式。

Result: 在多个架构和多模态基准测试中，实验表明拒绝生成在解码过程中持续受视觉证据影响，感知基础基本保留；安全约束指令一致改变后期隐藏状态动态，指向拒绝导向的解码；通过激活级干预可恢复基础回答行为。

Insight: 创新点在于揭示安全对齐可能覆盖视觉表达，即使感知证据内部保留；通过解码动态分析和激活干预，为理解VLMs中安全与视觉的权衡提供了新视角，有助于改进模型对齐策略。

Abstract: Aligned vision-language models (VLMs) are designed to balance grounded visual reasoning with safe generation behavior. However, we observe a striking phenomenon: under safety-constrained instruction, models frequently abstain from answering questions that remain correctly answerable under default instruction despite receiving identical image-question inputs. This raises a fundamental question: does safety alignment suppress perceptual grounding itself, or does visual evidence remain internally available while generation is redirected toward abstention? In this work, we investigate the internal decoding dynamics underlying safety-induced abstention in aligned VLMs. Across multiple architectures and multimodal benchmarks, we show that abstained generations remain consistently influenced by visual evidence throughout decoding, indicating that perceptual grounding is largely preserved despite refusal behavior. We further demonstrate that, although the representational organization of refusal differs substantially across architectures, safety-constrained instruction consistently alters late-stage hidden-state dynamics toward refusal-oriented decoding. Finally, through targeted activation-level interventions, we show that suppressing refusal-related representations reliably restores grounded answering behavior across models without retraining or modifying visual inputs. Together, these findings reveal a previously underexplored failure mode in aligned VLMs: safety alignment can override grounded visual expression even when perceptual evidence remains internally preserved.

[51] SAM2Dual: Training-Free, Dual Memory for Long-Term Video Object Segmentation cs.CVPDF

JeongRae Kim, Changwon Lim

TL;DR: SAM2Dual是一种无需训练、即插即用的推理时增强方法，旨在提升长时视频目标分割（VOS）的鲁棒性。它通过双记忆设计（短期记忆和长期记忆）以及文本感知记忆（TAM）来解决长视频中因遮挡、重现和场景变化导致的错误累积和漂移问题。

Details

Motivation: 长时视频目标分割在长时间遮挡、目标重现和场景变化下容易因错误累积而性能下降。尽管SAM2在零样本分割上表现强劲，但其流式记忆机制在长视频中可能因近期不可靠预测主导记忆状态而放大漂移问题。

Result: 在长时基准测试中，SAM2Dual显著提升了长视频的稳定性，例如在MOSEv2上将J&F分数从49.33提高到50.65，并在LVOSv2上实现了持续的性能增益。

Insight: 创新点包括双记忆设计（分离短期和长期记忆以平衡局部适应和全局身份线索）和文本感知记忆（利用文本嵌入基于语义兼容性重新加权记忆贡献），这些方法无需更新模型权重即可增强长时鲁棒性，是一种高效的推理时优化策略。

Abstract: Long-term video object segmentation (VOS) remains challenging due to error accumulation under extended occlusions, re-appearance, and scene changes. Although SAM2 provides strong zero-shot performance, its streaming memory can amplify drift over long horizons when recent, unreliable predictions dominate the memory state. We propose SAM2Dual, a training-free, plug-and-play inference-time enhancement that improves long-video robustness without updating model weights. SAM2Dual introduces a Dual Memory design that explicitly separates (i) short-term memory for rapid local adaptation and (ii) long-term memory built via interval-based sampling to preserve global identity cues, combined through a gated fusion strategy. In addition, we present Text-Aware Memory (TAM), which extracts a compact word-level cue from early frames and uses text embeddings to reweight memory contributions based on semantic compatibility, supporting identity preservation when visual evidence becomes weak or ambiguous. Across long-term benchmarks, SAM2Dual consistently improves stability on long videos, raising J&F from 49.33 to 50.65 on MOSEv2 and achieving consistent gains on LVOSv2.

[52] Clinically Structured Surrogate Rewards for Post-SFT Medical Image Captioning cs.CVPDF

Hyun Jun Kim, Heeseung Shin, Changwon Lim

TL;DR: 本文提出了一种用于医学图像描述生成后监督微调阶段的临床结构化替代奖励框架，该框架结合了生物医学语义和短程词汇保真度，以及两种结构化奖励：分布图像邻域对齐和临床图一致性，以优化生成的临床描述。

Details

Motivation: 医学图像描述生成需要将异构视觉证据转化为简洁的临床描述，现有基于序列级策略优化的方法通常依赖全局文本相似性或无序概念重叠等奖励，未能显式地建模视觉邻域和临床声明结构，可能导致临床意义错误。

Result: 在ImageCLEFmedical Caption标准与合成赛道的隐藏测试集上，使用三种视觉-语言骨干网络，该方法在所有六个骨干-赛道组合中均超越了匹配的SFT基线，在总体、相关性和事实性指标上平均相对增益分别为3.4%、2.1%和5.8%。

Insight: 创新点在于引入了两种结构化奖励：分布图像邻域对齐（匹配参考和生成描述在医学图像库中诱导的分布）和临床图一致性（对实体、断言状态和类型化关系应用最大权重一对一匹配），为优化提供了互补信号，减少了图像邻域差异并改善了实体-断言-关系一致性。

Abstract: Medical image captioning requires translating heterogeneous visual evidence into concise clinical descriptions, where errors in findings, assertion states, or anatomical relations can alter clinical meaning despite surface-level fluency. Sequence-level policy optimization can directly optimize complete captions, but common rewards rely on global text similarity, direct image-caption compatibility, or unordered concept overlap, leaving visual neighborhoods and clinical-claim structure implicit. We propose a clinically structured surrogate reward framework for post-SFT medical image captioning. The framework combines biomedical semantic and short-range lexical fidelity with two structured rewards: distributional image-neighborhood alignment, which matches the medical-image-bank distributions induced by reference and generated captions, and clinical graph consistency, which applies maximum-weight one-to-one matching to entities, assertion states, and typed relations. The four rewards are independently normalized within each rollout group, combined with fixed relative weights, and optimized with GDPO. Across organizer-evaluated hidden test sets for the Standard and Synthetical ImageCLEFmedical Caption tracks and three vision-language backbones, the method improves Overall, Relevance, and Factuality over matched SFT baselines in all six backbone-track combinations, with average relative gains of 3.4%, 2.1%, and 5.8%, respectively. Ablations and paired diagnostics indicate that the structured rewards provide complementary signals, reducing image-neighborhood divergence and improving entity-assertion-relation consistency.

[53] DynCur-Geo: Dynamic Curiosity Reward Shaping for Multimodal Active Geo-Localization cs.CVPDF

Yiming Sun, Yang Zhang, Pengfei Zhu

TL;DR: 本文提出DynCur-Geo，一种用于多模态主动地理定位的动态好奇心框架，旨在解决无人机在搜索目标时平衡探索与收敛的难题。该方法通过根据剩余目标距离动态调整基于预测误差的内在奖励，并利用距离感知门和基于势能的奖励塑形来引导智能体行为。

Details

Motivation: 现有好奇心驱动方法在整个搜索过程中分配固定的内在奖励权重，导致智能体接近目标后仍因奖励新奇性而产生绕行，难以在受限视图和稀疏反馈下有效平衡探索与目标收敛。

Result: 在多模态、跨场景、受灾和长距离设置下的实验表明，该方法在主动地理定位基准上取得了持续的性能提升。

Insight: 创新点在于将动态内在奖励权重与剩余目标距离相关联，并引入距离感知门进行行为模式切换，结合基于势能的奖励塑形提供密集进度指导，从而更高效地引导搜索过程。

Abstract: Active geo-localization enables low-altitude UAVs to search for specified targets from limited local aerial observations, supporting time-sensitive applications such as search and rescue and emergency inspection. However, multimodal target cues, restricted views, and sparse feedback make it difficult to balance exploration with target convergence. Existing curiosity-driven methods assign a fixed intrinsic-reward weight throughout search, which can continue rewarding novelty after the agent nears the target and induce detours. We propose DynCur-Geo, a dynamic curiosity framework that adjusts prediction-error intrinsic reward according to remaining target distance. A distance-aware gate encourages early exploration and shifts the policy toward goal-directed behavior near the target, while potential-based reward shaping supplies dense progress guidance. Experiments across multimodal, cross-scene, disaster-affected, and long-range settings show consistent gains over active geo-localization baselines.

[54] Vision-Language Models for Egocentric Video: From Hand-Object Interaction to Embodied AI cs.CVPDF

Mohammad Zamani, Fatemeh Ziaeetabar

TL;DR: 本文是一篇关于视觉语言模型在自我中心视频理解中的综述，系统回顾了从传统识别架构到多模态基础模型及具身系统的演进。重点探讨了手-物交互理解、时序推理、多模态表征学习等关键任务，并指出了当前模型在长时活动理解与交互推理方面的局限性。

Details

Motivation: 自我中心视频从穿戴者视角捕捉活动，为可穿戴智能、辅助系统、人机交互和具身AI提供了独特视角，但面临自我运动、遮挡、小目标、视角依赖外观和长时序依赖等挑战。视觉语言模型通过连接视觉观察与语义知识，为解决这些挑战提供了有前景的基础。

Result: 综述未提供具体定量结果，但总结了现有文献在多个任务（如手-物交互理解、时序推理）和数据集上的进展，指出当前模型在识别可见物体方面比理解动态交互、动作和用户意图更可靠，尤其在长时活动中表现不足。

Insight: 创新点包括强调基于图和以物体为中心的推理机制来建模手、物体、动作和场景上下文随时间的关系，并提出了时序接地推理、交互感知监督、高效长视频处理、多模态融合、图增强表征等作为可部署具身智能的关键研究方向。

Abstract: Egocentric video captures activities from the wearer’s perspective, providing a direct view of human attention, hand–object interaction, and goal-directed behavior. This perspective is increasingly important for wearable intelligence, assistive systems, human–robot interaction, and embodied AI, yet it introduces challenges including ego-motion, occlusion, small active objects, viewpoint-dependent appearance, and long-range temporal dependencies. Vision–language models (VLMs) offer a promising foundation for addressing these challenges by linking visual observations with semantic knowledge and natural-language supervision. This survey presents a critical review of VLMs for egocentric video understanding, tracing the progression from conventional recognition architectures to multimodal foundation models and embodied systems. We organize the literature around tasks, datasets, hand–object interaction understanding, temporal reasoning, frame and clip selection, multimodal representation learning, prompting, semantic alignment, and model adaptation. Particular attention is given to graph-based and object-centric reasoning as mechanisms for modeling relations among hands, objects, actions, and scene context over time. We further examine how first-person perception and multimodal foundation models support wearable assistance, robot skill learning, human-to-robot transfer, and embodied decision making. Across the reviewed literature, a consistent limitation emerges: current models recognize visible objects more reliably than evolving interactions, actions, and user intent, especially over long activities. We therefore identify temporally grounded reasoning, interaction-aware supervision, efficient long-video processing, multimodal fusion, graph-enhanced representations, cross-domain generalization, privacy, and trustworthy evaluation as key priorities for deployable embodied intelligence.

[55] DocClaw: A Unified Agentic System for Intelligent Document Processing cs.CVPDF

Siqi Xiang, Zhipeng Xu, Yufei Liu, Junhao Ji, Qing Liu

TL;DR: 本文提出了DocClaw，一个统一的智能体系统，用于处理智能文档处理（IDP）中的多种任务，如OCR、文档问答和关键信息提取。它将不同的IDP任务统一建模为智能体与文档之间的交互过程，通过迭代调用工具、整合观察结果并利用结构化的文档状态来逐步精炼输出。

Details

Motivation: 当前智能文档处理中的各项任务（如OCR、DocQA、KIE）虽然目标不同，但都需要感知文档内容、获取任务相关信息并逐步精炼中间结果，然而它们通常被建模为独立的预测问题并由特定任务模型或流程处理，缺乏统一框架。

Result: 在多个智能文档处理基准测试上的广泛实验表明，DocClaw在单一智能体框架内有效处理了多样化任务，其性能与通用视觉语言模型（VLMs）及特定任务方法相比具有竞争力。

Insight: 核心创新在于将多样化的IDP任务统一为智能体与文档的交互过程，并引入了结构化的文档状态来组织可重用的文档知识和任务特定的交互上下文，使得交互循环、工具空间和文档状态可以在不同任务间共享，而任务特定需求则由智能体对查询目标的解释和相应的文档技能来捕获。

Abstract: Intelligent document processing (IDP) encompasses a broad range of tasks, including optical character recognition (OCR), document question answering (DocQA), and key information extraction (KIE). Despite their distinct objectives, these tasks share a common need to perceive document content, acquire task-relevant information, and progressively refine intermediate results. However, they are typically formulated as separate prediction problems and addressed by task-specific models or processing pipelines. We introduce DocClaw, a unified agentic system that formulates diverse intelligent document processing tasks as a shared process of interaction between an agent and a document. Given a document and a task-specific query, DocClaw follows an appropriate document skill to iteratively identify the information required, invoke relevant tools, and integrate the resulting observations into the desired output. Throughout this process, a structured document state organizes reusable document knowledge and task-specific interaction context, allowing the agent to accumulate, revisit, and progressively refine information as the interaction proceeds. Under this formulation, task-specific requirements are captured by the agent’s interpretation of the query objective and the corresponding document skill, while the underlying interaction loop, tool space, and document state are shared across tasks. Extensive experiments across multiple intelligent document processing benchmarks demonstrate that DocClaw effectively handles diverse tasks within a single agentic framework and achieves competitive performance compared with both general-purpose VLMs and task-specific methods.

[56] Composed Historical Image Retrieval by Modeling Temporal Representations cs.CV | cs.AI | cs.IRPDF

Adrià Molina Rodríguez, Oriol Ramos Terrades, Josep Lladós Canet

TL;DR: 本文提出了一种名为TDIR（Temporally Decomposable Image Representations）的表示学习算法，用于解决历史图像检索中同时考虑时间与内容的问题。该方法通过正交子空间将历史照片分解为日期和内容两个独立分量，从而在保持时间结构的同时，有效支持图像和物体检索任务。

Details

Motivation: 研究动机在于探索能否学习到既能保留时间结构、又对图像和物体检索有效的表示，因为传统的一维时间嵌入会牺牲下游任务性能，而高维嵌入空间的时间结构又难以解释。

Result: 在历史照片的组合图像检索（Composed Image Retrieval）这一真实世界任务中，TDIR方法在日期估计和物体检索方面均保持了有竞争力的性能，无需标签监督即可实现时间信息的提取与注入。

Insight: 创新点在于提出了可分解的时间与内容正交子空间表示，并证明了在联合优化中正交性会自然涌现，无需显式约束；这支持了嵌入空间上的传递操作，为历史图像检索提供了直观可解释的导航方式。

Abstract: While time evolves linearly, the geometry of neural embedding spaces is inherently multi-dimensional, often chaotic, and difficult to interpret. In principle, one could constrain an embedding space to a single temporal dimension; however, such a reduction would sacrifice performance on downstream tasks, as one-dimensional embeddings cannot retain sufficient expressive capacity. This paper asks whether it is possible to learn representations that preserve temporal structure while remaining effective for image and object retrieval, and answers this question by building the mathematical foundations of such a system. We propose Temporally Decomposable Image Representations (TDIR), a representation learning algorithm that decomposes historical photographs into separate date and content components through orthogonal subspaces. We define and prove the conditions under which such a decomposition is achievable, characterize the error incurred when those conditions are only partially met, and show that orthogonality between temporal and categorical subspaces emerges naturally from the joint optimization, without requiring it to be imposed explicitly. Beyond its geometric properties, TDIR enables a class of transitive operations on embedding spaces: the temporal information of one image can be extracted and injected into the representation of another, with no label supervision required. All theoretical properties are grounded and validated in the real-world problem of Composed Image Retrieval on historical photographs, where a query simultaneously specifies object content and a target time period, either through labels or through example images. This in-the-wild setting serves as a concrete backing for the propositions we derive, offering an intuitive and interpretable way to navigate photographic archives while maintaining competitive performance in both date estimation and object retrieval.

[57] Impact of Iterative Fine-Tuning on Transcription Accuracy in Complex Historical Sanskrit Manuscripts cs.CV | cs.AIPDF

Kartik Chincholikar, Kaushik Gopalan, Mihir Hasabnis

TL;DR: 本文提出了一种针对复杂历史梵文手稿的迭代微调OCR流程，通过布局级和外观级的自适应微调，逐步提升转录准确性并减少人工标注成本。作者构建了包含三个梵文手稿的数据集，并评估了传统OCR流程与多模态大语言模型的性能。

Details

Motivation: 历史手稿因复杂的异质布局、特定时期的书写风格、页面纹理和相机噪声等因素，导致OCR转录困难且人工标注成本高昂，需要一种能自适应目标手稿分布的解决方案。

Result: 在引入的梵文手稿数据集上，迭代微调的传统OCR流程取得了定量增益；同时，作者对领先的多模态大语言模型在该数据集上的性能进行了基准测试。

Insight: 创新点在于提出布局级和外观级的迭代微调OCR流程，通过自适应目标手稿分布逐步减少人工标注需求；同时发布了具有细粒度布局标注和标准PAGE-XML格式的梵文手稿数据集，为历史文档数字化研究提供了资源。

Abstract: Digitizing the text from handwritten historical manuscripts is required to make them easily accessible, preservable, and to enable historical scholars to study them in new ways. Historical manuscripts, however, often exhibit complex heterogeneous layouts and non-standard appearance due to period-specific writing styles, page textures, camera noise, and other nuisance factors, making them difficult to perform OCR on. To tackle this challenge, we introduce a local traditional OCR pipeline, which can be iteratively fine-tuned on the target manuscript at the layout-level and the appearance-level. By adapting to the target manuscript distribution, the proposed Traditional OCR pipeline makes better predictions on subsequent pages, causing iterative reduction in human annotation effort, which is expensive and time-consuming as it requires historical domain expertise. Using this pipeline, we digitize text from three complex historical Sanskrit manuscripts and introduce a dataset with granular layout-level annotations, along with Unicode annotations in the standard PAGE-XML format. We demonstrate quantitative gains due to iterative fine-tuning of the proposed traditional OCR pipeline, and also benchmark the performance of leading Multi-Modal Large Language Models on the introduced Dataset. Code and dataset are available at: https://github.com/flame-cai/gnn-synthetic-layout-historical/.

[58] CamWorldQA: Perceptual Quality Assessment of Camera-Controlled World Video Generation cs.CVPDF

Yunhe Li, Likun Wu, Sijing Wu, Xinyu Tian, Huiyu Duan

TL;DR: 本文提出了CamWorldQA，首个用于评估相机控制世界视频生成感知质量的基准数据集，并设计了CWQA无参考质量评估网络。该数据集包含720个由6种代表性生成方法在20个源视频和6种相机轨迹下生成的视频，并进行了主观质量评分。CWQA网络通过结合空间特征、时序运动特征和光流特征来预测质量分数，在CamWorldQA数据集上超越了现有方法。

Details

Motivation: 现有视频质量评估方法主要针对自然视频，无法有效评估相机控制生成视频特有的感知特性，如视角一致性、运动连贯性和内容保持性，因此需要专门的评估基准和方法。

Result: 在提出的CamWorldQA基准数据集上，CWQA网络取得了优于现有质量评估方法的性能，实现了SOTA结果。

Insight: 创新点在于首次构建了针对相机控制生成视频的感知质量评估基准，并设计了一个多分支网络，通过融合空间、时序和光流特征来全面捕捉此类视频的独特质量缺陷。

Abstract: Recent advances in generative video models have enabled camera-controlled world video generation, allowing models to synthesize videos under user-defined camera trajectories. However, existing video quality assessment (VQA) methods are mainly developed for natural videos and fail to capture the unique perceptual characteristics of camera-controlled generation, such as viewpoint consistency, motion coherence, and content preservation. In this work, we introduce CamWorldQA, the first benchmark for perceptual quality assessment of camera-controlled world video generation. CamWorldQA contains 720 generated videos produced by 6 representative generation methods from 20 diverse source videos under 6 camera trajectories, where each video is annotated with a human-rated perceptual quality score through subjective experiments. Furthermore, we propose CWQA, a no-reference quality assessment network with three complementary branches that extract spatial features, temporal motion features and optical flow features to jointly predict quality scores. Extensive experiments demonstrate that CWQA achieves superior performance over existing quality assessment methods on the CamWorldQA dataset.

[59] EgoHRV: Continuous Heart Rate Variability Estimation from Egocentric Systems for Autonomic Response and Skill Assessment cs.CV | eess.SPPDF

Berken Utku Demirel, Christian Holz

TL;DR: 本文提出EgoHRV方法，利用头戴式眼动相机视频估计心率和心率变异性，通过3D主干网络和低-高分解模块提取血容量脉冲信号，并结合跨域预训练实现高精度HRV估计。该方法在EgoExo4D基准测试中显著提升技能评估准确率，为自主神经系统状态监测开辟了新途径。

Details

Motivation: 现有眼动视觉系统主要依赖可见线索分析行为，但忽略了压力、专注度等自主神经状态的生理指标；心率变异性作为非侵入性自主调节标志，因眼动视频中的运动和噪声干扰而难以从现有平台获取。

Result: EgoHRV在眼动视频的心率和心率变异性估计上达到SOTA精度；在EgoExo4D技能评估任务中，结合HRV估计和置信度测量使准确率提升17.8%。

Insight: 创新点包括低-高分解模块从噪声视频中提取细微BVP信号，以及跨域预训练对齐接触式与相机信号的频域表示；该方法将眼动系统扩展至压力、唤醒度感知任务，为行为建模提供了不确定性感知设计。

Abstract: Egocentric vision systems capture human behavior from visible cues, but overlook physiological indicators of autonomic states such as stress, engagement, and attention. Heart rate variability (HRV) is a widely used noninvasive marker of autonomic regulation under stress. HRV reflects small timing differences between successive heartbeats and has so far been out of reach for egocentric platforms, where motion and noise in gaze video mask exactly this fine-grained timing. We propose EgoHRV, a method that estimates HRV as well as heart rate (HR) from the gaze cameras that are already integrated into egocentric headsets. Our pipeline combines a 3D backbone with a novel low–high decomposition module that extracts the blood volume pulse (BVP) signal from gaze video. Our cross-domain pretraining aligns the frequency-domain representations of contact-based and camera-derived signals. This alignment gives EgoHRV the temporal precision to recover HRV from the subtle fluctuations in gaze video. EgoHRV achieves state-of-the-art accuracy for HR and HRV estimation from egocentric video, and its uncertainty-aware design improves downstream behavioral modeling. Integrating our HRV estimates and confidence measures into EgoExo4D’s proficiency estimator raises accuracy by 17.8%. Beyond skill, continuous HRV estimation also opens egocentric systems to stress- and arousal-aware estimation tasks. Code: https://github.com/eth-siplab/EgoHRV

[60] CL4D: Contrastive Language-4D Pretraining for Vision-Language Reasoning in Dynamic Scenes cs.CVPDF

Kumal Hewagamage, Isuranga Senavirathne, Sasika Amarasinghe, Hasitha Gallella, Dulanga Weerakoon

TL;DR: 本文提出了CL4D，一种基于对比学习的4D视觉编码器，可直接处理动态点云数据，旨在对齐时空几何表示与自然语言描述。基于CL4D，作者进一步构建了4DVLM，这是一个直接以4D点云为输入的视觉语言模型，用于动态场景下的语言生成任务。模型在自建的DynAction4D数据集上训练，并在多个4D人体动作基准测试中取得了最先进的性能。

Details

Motivation: 现有视觉编码器主要局限于静态2D图像、3D点云或缺乏精确几何深度的2D视频，无法同时捕捉动态场景中的空间结构和运动演化。因此，需要一种能够直接处理动态4D数据（3D+时间）并支持视觉语言推理的基础模型。

Result: 在多个4D人体动作基准测试中，CL4D实现了最先进的性能，相比先前方法提升了约16.75%。此外，4DVLM在相同场景下，即使对比模型（如Gemini和GPT-5）使用对应的RGB视频序列，其性能也优于这些前沿的视频VLM。

Insight: 创新点在于首次提出了直接处理动态点云的基础4D视觉编码器（CL4D）和相应的4D视觉语言模型（4DVLM），通过对比学习对齐4D几何与语言，实现了零样本的运动-文本检索，并为下游4D视觉语言任务提供了基础。其核心是跳过了对2D图像/视频或静态3D的依赖，直接从4D时空数据中学习表示。

Abstract: 4D understanding and reasoning is a fundamental capability for embodied AI agents operating in dynamic physical environments. However, existing vision encoders are largely limited to static 2D images or 3D point clouds without temporal modeling, or to 2D videos that lack accurate geometric depth reasoning. Consequently, current approaches fail to jointly capture spatial structure and motion evolution in dynamic scenes. We present CL4D, the first foundational 4D vision encoder that directly operates on dynamic point clouds, trained with a contrastive learning objective to align spatio-temporal geometric representations with natural language descriptions. By learning a shared embedding space between text and 4D scene dynamics, CL4D enables zero-shot motion-to-text and text-to-motion retrieval in dynamic environments and serves as a foundational 4D vision encoder for downstream 4D vision-language tasks. Building on this encoder, we introduce 4DVLM, a 4D vision-language model that conditions language generation on dynamic geometric representations. 4DVLM is the first VLM designed to operate directly on 4D point clouds without relying on 2D images, 2D videos, or static 3D point clouds. We train CL4D and subsequently 4DVLM on a newly constructed dataset termed DynAction4D capturing diverse human motions across varying object interactions and scene environments. Extensive experiments across multiple 4D human action benchmarks demonstrate that CL4D achieves state-of-the-art performance, with improvements of approximately ~16.75% over prior methods. Furthermore, 4DVLM outperforms frontier video VLMs such as Gemini and GPT-5 even when these models are provided with RGB video sequences corresponding to the same scenes represented as 4D point clouds for 4DVLM.

[61] EfficientSync: Real-Time Lip Synchronization via Deformation-Based Reference Texture Mixing cs.CVPDF

Fa-Ting Hong, Runzhen Liu, Luchuan Song, Hongmin Cai, Chuhua Xian

TL;DR: 本文提出EfficientSync，一种基于形变的实时唇形同步框架，通过保留参考纹理而非重新合成，解决了现有方法因使用重型GAN或扩散解码器导致的延迟高、纹理失真问题。该方法包含动态纹理混合器、时空移位自适应掩码和STAR采样三个核心组件，实现了高保真身份保持与实时性能。

Details

Motivation: 现有音频驱动唇形同步方法通常重建整个下半脸，导致高延迟并容易产生牙齿、唇纹等口腔细节的幻觉，而非保留真实纹理；作者认为身份保持的瓶颈在于缺乏忠实转移已有真实纹理的机制。

Result: 在HDTF和VFHQ基准测试中，该方法在单GPU上达到166 FPS，实现了最先进的视觉质量和身份保持性能。

Insight: 创新点在于将多参考帧融合重新定义为通道选择，通过低成本加权求和保留纹理完整性；将源帧分解为唇部生成条件和独立背景先验，实现无缝混合；以及零开销预处理选取最清晰、拓扑多样的参考帧，兼顾效率与质量。

Abstract: Audio-driven lip synchronization manipulates the mouth region of a talking-face video to match the driving audio while preserving head pose, identity, and background. Although the task is inherently local editing, prevailing approaches reconstruct the entire lower face with heavy GAN- or diffusion-based decoders, incurring substantial latency and, more critically, hallucinating intra-oral details such as teeth and lip wrinkles instead of preserving authentic textures. We contend that the bottleneck in identity preservation is not the scarcity of reference frames, but the lack of a mechanism that faithfully transfers the genuine textures they already contain. We therefore present EfficientSync, a real-time deformation-based framework that retains reference textures rather than resynthesizing them. First, the Dynamic Texture Mixer reformulates multi-reference fusion as channel-wise selection, evaluating each spatially aligned reference in a global context and aggregating them by channel-wise weighted summation, preserving textural integrity at low cost. Second, Spatio-Temporal Shifted Adaptive Masking decomposes the source frame into lip-generation conditions and an independent background prior, suppressing lower-face leakage while blending the synthesized mouth seamlessly into the background. Third, STAR Sampling, a zero-overhead pre-processing step, retrieves the sharpest and most topologically diverse reference frames. Experiments on HDTF and VFHQ show state-of-the-art visual quality and identity preservation at 166 FPS on a single GPU. Video demos: https://alunaticat.github.io/EfficientSync/index.html.

[62] Falcon Perception-HD: High Density Perception via Reinforcement Learning cs.CVPDF

Sofian Chaybouti, Yasser Dahou, Ngoc Dung Huynh, Reda Alami, Hilde Kuehne

TL;DR: 本文提出Falcon Perception-HD，通过强化学习（特别是GRPO方法）直接优化开放词汇感知模型的评估指标（如精确率和召回率），以解决传统监督微调中代理目标（逐令牌交叉熵）与感知指标不匹配的问题。该方法在极高密度场景（每场景多达500个物体）中实现了SOTA性能，并消除了掩码重复、NMS和坐标去重等常见问题。

Details

Motivation: 现有自回归感知模型使用监督微调（SFT）和最大似然训练，其优化的逐令牌交叉熵目标与感知评估指标（如精确率、召回率）存在根本性错位，导致模型在密集场景中性能下降或崩溃。

Result: 在PBench和SACO-Gold的指代表达分割基准上，该方法在所有难度级别均取得改进，在极高密度场景（每场景500个物体）中达到SOTA性能，并大幅减少对NMS和坐标去重的依赖。

Insight: 创新点包括：设计针对集合结构输出的奖励函数和多头采样控制的RL框架；发现简单惩罚假阴性和假阳性的奖励即足够；提出两种混合自标注流程用于困难指代表达和密集场景的RL训练；无需负样本训练即可保持物体存在性知识（通过MCC评估）。

Abstract: Autoregressive perception models trained to localize visual entities under the open-vocabulary setting are mostly trained using Supervised fine-tuning (SFT) with maximum likelihood, yet it optimizes a proxy objective (per-token cross-entropy) that is fundamentally misaligned with perception metrics such as precision and recall. In this paper, we explore post-training reinforcement learning (RL), specifically GRPO, to directly align these models with their evaluation metrics. Building up on the recently introduced Falcon Perception, we design an RL framework that addresses perception-specific challenges: reward design for set-structured outputs and multi-head sampling control. We discover multiple benefits from RL for perception: first, RL unlocks state-of-the-art performance in very dense scenes (up to 500 objects per scene), a regime where most existing systems degrade sharply or collapse; furthermore it fixes common issues in autoregressive perception models like mask repetitions and removes almost entirely the need for NMS and coordinate deduplication, which improve both performance and efficiency and remove the need for hyperparameters tuning; overall, we notice improvements on all levels of difficulties in referring expression segmentation (on PBench and SACO-Gold), and we find an elegant way to preserve the knowledge of whether an object exists or not (as evaluated by MCC) without training on negative samples. We show that a simple reward that penalizes false negatives and positives is sufficient. We develop two hybrid self-annotation pipelines, respectively tailored for difficult referring expressions and very dense scenes, and show their benefits on RL-training. Model weights are released as a Falcon Perception revision~\footnote{https://huggingface.co/tiiuae/Falcon-Perception}. Datasets will be published.

[63] EVADE: Evidence-Verified Agentic Diagnosis with Escape cs.CVPDF

Mohaimenul Azam Khan Raiaan, Nur Mohammad Fahad

TL;DR: 本文提出了EVADE（证据验证的代理诊断与回避）方法，这是一种无需训练的推理方法，旨在提升单一冻结视觉语言模型（VLM）在医学诊断中的部署安全性。该方法在不确定时，会定位最具诊断相关性的区域，在放大视图上重新回答，并仅在全局图像和放大视图的答案一致时才给出最终诊断，否则选择弃答。

Details

Motivation: 现有医学视觉语言模型虽然能达到较高准确率，但存在系统性过度自信、测试时推理收益有限以及无法可靠校准对自身回答的信任等问题，导致其在实际部署中不可靠。

Result: 在VQA-RAD、SLAKE和PathVQA基准上使用Qwen2.5-VL-7B模型的实验表明，EVADE是唯一能同时改善校准性能和选择性风险（selective risk）并保持准确率的方法，与零样本方法相比，预期校准误差（ECE）最多降低了45%。而思维链、自洽性和自我验证等方法至少在一个指标上失败。

Insight: 核心创新在于通过验证不同图像视图（全局与局部）之间答案的一致性来做出决策，而非依赖单一模型对自身文本输出的重复检查，这直接解决了单模型自检中的验证幻觉问题。此外，模型自我提出的诊断区域定位比中心或随机裁剪效果更好，但可靠性提升主要源于一致性门控机制和经过校准的弃答策略。

Abstract: Medical vision-language models (VLMs) can achieve high accuracy but remain unreliable: they are systematically overconfident, benefit little from test-time reasoning, and lack the ability to reliably calibrate trust in their own responses. We introduce EVADE (Evidence-Verified Agentic Diagnosis with Escape), an inferential, non-training method that enhances the safety of deploying a single frozen VLM. EVADE responds and, when uncertain, localises the region most diagnostically relevant, re-answers on a zoomed view, and commits only when both the entire image and the zoomed view responses agree; otherwise, it abstains. To directly address verification hallucination in single-model self-checking, our main idea is to verify gate consistency across different image views rather than re-reading the model’s own text. Experimental evaluation on VQA-RAD, SLAKE, and PathVQA using Qwen2.5-VL-7B reports that EVADE is the only method that simultaneously improves both calibration and selective risk while maintaining accuracy, reducing expected calibration error (ECE) by up to 45% compared to zero-shot. Chain-of-thought, self-consistency, and self-verification all fail at least one axis. A grounding analysis reports that self-proposed regions perform better at diagnostic structure localisation than centres or random crops. However, a 7B VLM cannot use this localisation to revise answers. Therefore, reliability gains come from the consistency gate and calibrated abstention.

[64] When Simplicity Wins: Bottleneck-Aware Context Modeling for Lightweight Semantic Segmentation cs.CVPDF

Mian Muhammad Naeem Abid, Nancy Mehta, Zongwei Wu, Radu Timofte

TL;DR: 本文提出了一种名为SiConMo的轻量级语义分割框架，旨在平衡准确性、效率和可扩展性。该框架通过专注于瓶颈阶段来整合局部和全局上下文，包含三个核心组件：用于分层多尺度表示的Token金字塔提取模块、用于瓶颈感知上下文建模的Transformer分支深度卷积块，以及用于保持空间结构并增强语义一致性的特征合并模块。

Details

Motivation: 解决高分辨率图像语义分割中准确性、效率和可扩展性之间的平衡难题，特别是针对卷积网络难以建模长距离依赖、而Vision Transformers计算成本高的问题，并指出当前研究相对忽视了瓶颈阶段在上下文聚合和信息流中的关键作用。

Result: 在ADE20K、PASCAL Context、Cityscapes和COCO-Stuff等多个基准数据集上的广泛实验表明，SiConMo在轻量级语义分割模型中实现了最先进的准确性与效率权衡。

Insight: 创新点在于提出在极低计算预算下，瓶颈阶段是整合局部和全局上下文的最有效阶段这一设计原则，并据此构建了轻量高效的框架；客观来看，其将Transformer与深度卷积结合用于瓶颈建模，以及分层多尺度表示与特征合并的策略，为轻量级视觉任务提供了可借鉴的架构思路。

Abstract: Semantic segmentation demands a careful balance between accuracy, efficiency, and scalability, which remains difficult to achieve for high-resolution imagery. Convolutional networks effectively model local patterns but struggle with long-range dependencies, whereas Vision Transformers capture global context at a high computational cost. While recent work largely focuses on encoder design, the bottleneck stage, central to contextual aggregation and information flow, has been relatively overlooked. We propose SiConMo, a lightweight yet effective framework, implemented in two variants: an RGB-only model (SiConMo) and a GME-enhanced variant (SiConMo$_\dagger$). We show that simplicity arises from a key design principle: at very low computational budgets, the bottleneck is the most efficient stage to integrate local and global context. SiConMo integrates three complementary components: a Token Pyramid Extraction Module for hierarchical multi-scale representation, a Transformer-Branched Depthwise Convolution block for bottleneck-aware context modeling, and a Feature Merging Module that preserves spatial structure while enhancing semantic consistency. Extensive experiments on ADE20K, PASCAL Context, Cityscapes, and COCO-Stuff demonstrate that SiConMo achieves a state-of-the-art accuracy-efficiency trade-off among lightweight semantic segmentation models, highlighting simplicity as a powerful design principle.

[65] Uncertainty-Aware Art-Historical Dating with Vision-Language Models cs.CVPDF

Stefanie Schneider, Peter Bell

TL;DR: 本文研究了艺术史年代测定中的时间纠缠现象，即预训练视觉模型可能编码了机构收藏与数字化过程的偏差而非真实历史时间。通过将艺术品年代测定构建为基于冻结图像嵌入的不确定性感知回归任务，评估了多种预训练视觉模型在受控时间维度的Wikidata艺术品数据集上的表现。

Details

Motivation: 解决博物馆与档案数据集因收藏、编目和数字化过程的历史偶然性导致的偏差问题，这些偏差使预训练图像表征可能错误编码机构条件而非真实历史时间信息。

Result: 在受时间控制的Wikidata艺术品数据集上，视觉语言模型（VLMs）优于纯视觉自监督基线模型，表明模型包含可用时间信息，但定性分析揭示该知识受多种偏差影响。

Insight: 提出时间纠缠概念以揭示数据历史偏差对模型的影响，并通过不确定性感知回归框架量化模型在艺术史年代测定中的可靠性；创新性地将VLMs用于艺术品年代分析并系统评估其时间编码能力与局限性。

Abstract: Museum and archival datasets do not mirror historical artistic production, but materialize the contingent histories of collecting, preservation, cataloging, and digitization. This has direct consequences for interpreting pretrained image representations: they may appear to encode historical time while actually encoding the institutional conditions under which objects become visible as data. We describe this phenomenon as temporal entanglement and investigate it by formulating artwork dating as an uncertainty-aware regression task over frozen image embeddings. We evaluate several pretrained vision models on a temporally controlled Wikidata corpus of artworks. Our results show that these models contain usable temporal information, with Vision-Language Models (VLMs) outperforming purely visual self-supervised baselines. However, a qualitative analysis indicates that this temporal knowledge is shaped by various biases.

[66] GrabVG: Graph-Attentive Binding for Visual Grounding in UAV Imagery cs.CV | cs.AIPDF

Chaowei Wang, Yan Di, Jingjun Sun, Baozhe Liu, Jiaxu Tian

TL;DR: 本文提出GrabVG框架，用于解决无人机图像中的视觉定位问题。该框架受人类视觉搜索启发，将定位分解为预注意假设搜索和图注意特征绑定两个阶段，通过生成可靠目标假设并利用图注意力机制联合建模视觉特征与拓扑关系，以应对密集小目标场景中的视觉冗余和拓扑模糊性挑战。

Details

Motivation: 无人机图像中目标物体小、分布密集且视觉相似，导致高视觉冗余和拓扑模糊性，现有方法难以区分细微的实例间差异并有效利用空间拓扑结构，在高度拥挤场景中定位不准确。

Result: 在AerialVG和AerialSense基准测试上，GrabVG分别达到67.31%和80.34%的Acc@0.5，比相应基线分别高出10.55和8.76个百分点，实现了精度与速度的良好权衡。

Insight: 创新点在于将视觉定位分解为序列化的预注意假设搜索和图注意特征绑定两阶段，通过蒸馏引导的提议归纳和文本感知假设过滤减少干扰，并利用图注意力联合绑定语言引导的实例内视觉线索和实例间拓扑关系进行空间推理，这为处理密集场景提供了可借鉴的层次化推理思路。

Abstract: Visual grounding in Unmanned Aerial Vehicle (UAV) imagery aims to localize a target object in complex bird’s-eye-view scenes according to a natural language description. However, the abundance of small, densely distributed, and visually similar objects creates high visual redundancy, while repetitive local configurations give rise to strong topological ambiguity. Existing approaches mainly focus on visual–language feature alignment or dense contextual interaction, yet they struggle to distinguish subtle inter-instance differences and effectively exploit spatial topological structures, leading to inaccurate grounding in highly crowded scenarios. To address these challenges, we propose $\textbf{GrabVG}$, a novel visual grounding framework inspired by human visual search. GrabVG explicitly decomposes grounding into two sequential stages: $\textit{preattentive hypothesis search}$ and $\textit{graph-attentive feature binding}$. Specifically, we first generate a compact set of reliable object hypotheses through distillation-guided proposal induction and text-aware hypothesis filtering, substantially reducing background distractions and semantic mismatches. These hypotheses are then organized into a sparse graph, where language-guided intra-instance visual cues and inter-instance topological relationships are jointly bound and propagated via graph attention, enabling efficient spatial reasoning and accurate target localization. Extensive experiments on AerialVG and AerialSense show that GrabVG achieves a favorable accuracy–speed trade-off, reaching 67.31$%$ and 80.34$%$ Acc@0.5 and outperforming the corresponding baselines by 10.55 and 8.76 percentage points, respectively.

[67] USR-Drive: Unified Driving Scene Representation via Joint Denoising of 3D Gaussians and Boxes cs.CVPDF

Li-Heng Chen, Haokai Pang, Chengye Su, Jiarun Liu, Qifeng Chen

TL;DR: 本文提出了USR-Drive，一个统一的生成框架，仅给定多视角驾驶视频，即可联合恢复密集的动态几何和实例级物体布局。它将3D高斯图元和3D边界框表示为对齐的潜在令牌流，并通过统一的多模态扩散Transformer进行联合去噪，实现了两种互补表示之间的相互增强。

Details

Motivation: 现有方法通常将动态重建和实例级感知视为独立任务，导致动态重建约束不足，而3D检测缺乏几何基础。本文旨在弥合这一鸿沟，通过统一的表示学习来共同解决这两个问题。

Result: 该方法在nuScenes和VKitti数据集上，在动态重建和3D检测任务上均取得了最先进（SOTA）的结果。

Insight: 核心创新在于提出了一个统一的生成框架，将密集几何与稀疏检测框作为对齐的、相互约束的状态变量进行联合建模，并通过统一位置编码（UPE）在共享时空坐标中对齐异构令牌，使两种模态能够相互提供几何证据和结构先验，从而提升性能。

Abstract: Spatial representation learning for autonomous driving aims to map raw visual signals into structured 3D scene representations, where object-centric bounding boxes and rendering-oriented 3D primitives (\eg, 3D Gaussians) serve as two distinct yet highly complementary levels for scene understanding. Existing methods typically treat dynamic reconstruction and instance-level perception as separate tasks, despite their shared goal of estimating the underlying 3D world state. As a result, dynamic reconstruction is under-constrained while 3D detection lacks geometric grounding. To address this gap, we propose USR-Drive, a unified conditional generative framework that, given only posed multi-view driving videos, jointly recovers dense dynamic geometry and instance-level object layouts within a shared scene representation. Specifically, USR-Drive represents dense Gaussian primitives and sparse 3D bounding boxes as two aligned latent token streams and jointly denoises them with a unified multi-modal diffusion Transformer. Unlike prior paradigms that use boxes as external conditions or predict them with detached modules, USR-Drive treats them as mutually constrained state variables with a Unified Positional Encoding (UPE) that aligns heterogeneous tokens within a shared metric spatiotemporal coordinate. Via such unified representation and generative framework, the two modalities reinforce each other: geometry supplies dense metric evidence for box prediction, while boxes provide instance-level structural priors that help preserve spatial consistency and reduce ambiguity in sequential 3D geometric representation. Our approach successfully delivers state-of-the-art results for both dynamic reconstruction and 3D detection on the nuScenes and VKitti datasets.

[68] When Two Tracers Disagree: An Investigation of Multimodal Fusion for Clinical PET/CT Segmentation cs.CVPDF

Jack A. Johnson, Bartłomiej W. Papież

TL;DR: 本研究探讨了在临床PET/CT分割任务中融合PSMA和FDG两种示踪剂的多模态策略。通过评估早期融合和基于交叉注意力的中间融合架构，发现融合模型未能持续超越单一示踪剂的基线模型，尤其是在FDG分割上性能下降。

Details

Motivation: PSMA和FDG PET/CT在显示前列腺癌的互补生物学信息方面各有优势，但缺乏有效的深度学习架构来融合这两种模态以捕获异质性肿瘤表型。

Result: 在DEEP-PSMA Challenge数据集上，单一示踪剂基线模型表现强劲（PSMA Dice=0.93，FDG Dice=0.81），而融合模型性能参差不齐，未能一致超越基线，例如OETD模型达到PSMA/FDG Dice为0.69/0.64。

Insight: 论文的创新点在于系统比较了不同的多模态融合策略（如早期融合和交叉注意力融合），并指出当前融合架构在保留示踪剂特异性表征方面存在不足，未来需要设计更优的架构以实现临床增益。

Abstract: PSMA and FDG PET/CT visualise complementary biological information in prostate cancer. Combining both tracers could capture heterogeneous tumour phenotypes that may be missed by either alone, yet there is no consensus on effective deep learning architectures for fusing these modalities. We evaluated multimodal image-fusion strategies for automatic whole-body PET/CT lesion segmentation to estimate total tumour burden. Using the public DEEP-PSMA Challenge dataset, we trained tracer-specific 3D nnU-Net baselines and compared (i) early fusion with a single encoder and one decoder (OEOD) or two decoders (OETD), and (ii) intermediate fusion via a dual-encoder cross-attention U-Net (DECA-UNet). Tracer-specific baselines performed strongly (PSMA Dice = 0.93; FDG = 0.81). Fusion yielded mixed results: OEOD produced a combined Dice of 0.90 (on an easier, non-tracer-specific task), whilst the tracer-specific fusion models reached PSMA/FDG = 0.69/0.64 (OETD) and 0.76/0.57 (DECA-UNet). Whilst fusion often provided reasonable PSMA segmentation, FDG performance degraded and no strategy consistently exceeded the single-tracer baselines. Under the evaluated setting, tracer-specific models remain the stronger baseline; clinically useful gains from multimodal fusion will likely require architectures that better preserve tracer specific representations. Our code is available at: https://github.com/JackJ3636/DEEP_PSMA_code

[69] ForeSightGuide: An Anticipatory Framework toward Accurate and Low-Redundancy Guidance for the Visually Impaired cs.CVPDF

Zhiyuan Wang, Xu Li, Shikang Guo, Wei Meng, Quan Liu

TL;DR: 论文提出了ForeSightGuide，一个为视障人士设计的预见性辅助引导框架。该框架结合了语义场景理解和预测性危险评估，旨在利用视觉语言模型（VLM）的推理能力来预测障碍物运动，从而过滤掉非威胁性物体，提供简洁、可操作的引导。

Details

Motivation: 现有基于视觉语言模型的电子旅行辅助工具在动态场景中常产生过多误报，导致用户认知过载。论文旨在解决此问题，通过预测性方法减少冗余警报，提供更准确的引导。

Result: 在公开基准和作者提出的新数据集（包含复杂动态交通场景）上的大量实验表明，ForeSightGuide达到了最先进的性能。具体而言，它将每次引导输出的冗余警报降至0.299，同时保持了0.112的低漏报率。

Insight: 核心创新在于将预测性危险评估与语义理解相结合，从被动反应转向主动预见，从而有效过滤信息。提出的新数据集也为评估预测能力提供了基准。

Abstract: Electronic travel aids are pivotal for the independent mobility of the visually impaired. While Vision-Language Models (VLMs) offer rich environmental understanding, they often suffer from excessive false positives in dynamic scenarios, leading to cognitive overload. To address this, we present ForeSightGuide, an anticipatory assistive guidance framework that couples semantic scene understanding with predictive hazard assessment. Unlike reactive systems, ForeSightGuide leverages the reasoning capabilities of VLMs to anticipate obstacle motion, effectively filtering out non-threatening objects to provide concise, actionable guidance. To validate our approach, we introduce a novel dataset captured in complex, dynamic real-world traffic scenes, designed to benchmark predictive capabilities. Extensive experiments on both public benchmarks and our proposed dataset demonstrate that ForeSightGuide achieves state-of-the-art performance. Notably, it significantly mitigates information overload by reducing redundant alerts to 0.299 per guidance output while maintaining a low missed-hazard rate of 0.112, proving its efficacy for safe walking assistance.

[70] ReWEIGH the Evidence: Calibrating Token-Level Ordinal Visual Evidence to Mitigate Hallucinations in Large Vision-Language Models cs.CV | cs.AI | cs.CLPDF

Jihae Jeong, Junha Choi, Hwanjo Yu

TL;DR: 这篇论文提出了ReWEIGH方法，一种无需训练的推理时解码干预技术，旨在缓解大型视觉语言模型（LVLM）中的幻觉问题。该方法通过校准图像在词汇排序上提供的token级序数视觉证据，在解码时对低于参考证据的候选token施加有界惩罚，从而减少模型生成图像不支持的内容。

Details

Motivation: 大型视觉语言模型经常产生与输入图像内容不符的幻觉。为了在解码过程中防止此类内容，需要一种针对每个候选token的、衡量图像对其支持强度的度量。模型的视觉token状态是这种证据的自然来源，但直接聚合这些跨视觉位置的词汇排序证据存在挑战。

Result: 在四个7B骨干模型上，ReWEIGH将幻觉的对象提及减少了高达21.3%，同时在很大程度上保持或改进了描述性和通用性能。在缓存证据后，每个token的平均额外延迟仅为1.33%，并且该方法的有效性扩展到了六个架构家族，直至320亿参数模型。

Insight: 核心创新在于提出了一种基于词汇排序的、尺度不变的视觉证据聚合方法，并通过从无标签图像中估计token特定的参考证据来校准该证据。这使得模型能够在推理时快速、轻量地识别并抑制证据不足的候选token，从而有效缓解幻觉，且无需额外训练。

Abstract: Large vision-language models (LVLMs) often hallucinate, generating content that the input image does not support. Preventing such content during decoding calls for a candidate-specific measure of how strongly the image supports the token under consideration. The model’s visual-token states offer a natural source of this evidence because projecting each state through the output head reveals which vocabulary items that position favors. These position-wise readouts cannot be pooled directly because their probability magnitudes are not comparable across visual positions. Vocabulary ranks provide a scale-invariant basis for pooling, but tokens still differ systematically in their typical rank-based evidence. We propose ReWEIGH, a training-free decoding intervention that aggregates these ranks across visual positions and compares each candidate with a token-specific reference estimated from unlabeled images. At inference, ReWEIGH caches the image evidence during prefill and applies a bounded penalty only to candidates that fall below their reference. On four 7B backbones, ReWEIGH reduces hallucinated object mentions by up to 21.3% while largely preserving or improving descriptive and general performance. With evidence cached, the average added latency is 1.33% per token, and the reductions extend across six architecture families to 32B parameters.

[71] GS-VLA: Plug-and-Play Viewpoint Canonicalization for Frozen VLA Policies via Gaussian Splatting cs.CV | cs.AIPDF

Yechan Park, HyunJin Kim

TL;DR: 本文提出了GS-VLA，一个轻量级、即插即用的框架，旨在提升视觉-语言-动作（VLA）策略对视角变化的鲁棒性，而无需重新训练策略。该方法首次将基于3D高斯的新视角合成技术直接用于VLA策略的观测空间适应，通过一个仅4M参数的3D高斯规范化模块前置到冻结的VLA策略前，以解决视角偏移问题。

Details

Motivation: 当前VLA策略的性能依赖于训练和部署时相机配置完全相同的隐含假设，但实验表明，即使相机安装位置发生微小位移，也可能导致在LIBERO基准测试上的成功率从约90%骤降至约10%。现有方法（如大规模微调或生成式数据增强）计算成本高且存在灾难性遗忘风险。

Result: 在LIBERO基准测试上，GS-VLA无需修改策略权重，即可在三个正交维度上提升性能：（1）不同策略架构，（2）未见过的任务套件，以及（3）不同尺度的扰动。该轻量级视觉模块能够恢复因视角偏移而损失的大部分性能。

Insight: 主要创新点在于将视角偏移重新表述为一个局部化的新视角合成问题，并基于相机扰动相对于工作空间保持在小范围有界区域的局部性假设，实现了一个与场景和策略无关的去遮挡任务。这是首个直接利用3D高斯新视角合成技术进行VLA策略观测空间适应的方法，提供了一种计算高效的即插即用解决方案。

Abstract: This paper proposes a lightweight, plug-and-play framework that improves robustness to viewpoint shifts in Vision-Language-Action (VLA) policies without policy retraining. To our knowledge, this is the first approach to directly leverage 3D Gaussian-based novel-view synthesis for observation-space adaptation in VLA policies. Current VLA performance relies on the implicit assumption that training and deployment camera configurations are identical. Our experiments show that even a small displacement of the camera mount can reduce the success rate on the LIBERO benchmark from about 90% to about 10% in the worst case. Prior approaches, such as large-scale fine-tuning or generative data augmentation, are computationally expensive and risk catastrophic forgetting. To address this, viewpoint shifts are reformulated as a localized novel-view synthesis problem. Under a Locality assumption, that camera perturbations remain within a small bounded region relative to the workspace, viewpoint normalization reduces to a scene- and policy-independent disocclusion task. Our work implements this idea with a 4M-parameter 3D-Gaussian canonicalizer prepended to a frozen VLA policy. Without modifying policy weights, GS-VLA improves performance across three orthogonal axes: (1) Policy architectures, (2) Unseen task suites, and (3) Perturbation scales. These results show that a lightweight visual module can recover a large fraction of the performance lost under viewpoint shift, without policy retraining.

[72] SPK: Eliciting Structured Prior Knowledge for Interpretable Out-of-Distribution Detection in Real-Time Object Detection cs.CV | cs.LGPDF

Changshun Wu, Weicheng He, Xiaowei Huang, Saddek Bensalem

TL;DR: 本文提出了一种名为结构化先验知识（SPK）的框架，用于在实时目标检测中实现可解释的分布外（OoD）检测。该框架通过利用分布内数据和诱导幻觉的样本作为诊断监督，从预训练的目标检测器中显式地提取与OoD相关的先验知识，包括部件级语义、几何和上下文先验，并将其组织成一个紧凑的五维表示。实验表明，SPK在多种目标检测器架构和多个OoD基准测试中实现了最先进的OoD检测性能。

Details

Motivation: 目标检测器对于训练类别之外的对象往往会产生过度自信的预测，导致所谓的分布外（OoD）幻觉。现有方法通常直接在学习的检测器表示上构建评分函数或修改检测器本身来抑制幻觉，但其中隐含的潜在先验知识尚未被充分探索和显式解码用于OoD检测。

Result: 在多种目标检测器架构（如Faster R-CNN、YOLO等）和多个OoD基准测试（如MS-COCO、OpenImages等）上的广泛实验表明，SPK实现了最先进的（SOTA）OoD检测性能。

Insight: 创新点在于提出了一种主动的、可解释的框架SPK，它显式地提取并整合了预训练目标检测器中隐含的部件级语义、几何和上下文先验，形成紧凑的结构化知识表示，用于可靠性分析。这揭示了预训练检测器编码了比通常用于OoD检测更丰富的潜在知识，并且这些知识可以被显式地组织和利用。

Abstract: Object detectors often produce over-confident predictions for objects outside their training categories, leading to so-called out-of-distribution (OoD) hallucinations. Existing approaches for detecting or mitigating such hallucinations typically either construct scoring functions directly over learned object detector representations or modify the object detector itself to suppress hallucination emergence. However, the latent priors implicitly encoded in these representations remain largely unexplored and have not been explicitly decoded for OoD detection. To uncover and exploit these latent priors, we propose Structured Prior Knowledge (SPK), a hallucination-oriented framework that explicitly elicits OoD-relevant priors from pretrained object detectors. Specifically, SPK leverages in-distribution data and hallucination-inducing samples as diagnostic supervision to elicit part-level semantic concepts underlying object detector decision-making, rather than using them merely for rejection or object detector adaptation. The elicited semantic priors are further integrated with geometric and contextual priors to form a compact five-dimensional SPK representation for OoD detection. Extensive experiments across diverse object detector architectures and multiple OoD benchmarks demonstrate that SPK achieves state-of-the-art OoD detection. Our findings reveal that pretrained object detectors already encode substantially richer latent knowledge than is typically exploited for OoD detection. More importantly, this knowledge can be explicitly elicited and organized into a compact, structured, and interpretable knowledge space for prediction reliability analysis. This suggests a promising proactive route for improving object detector reliability by explicitly uncovering and leveraging latent priors. Code and data are available at: https://gricad-gitlab.univ-grenoble-alpes.fr/dnn-safety/spk

cs.LG [Back]

[73] Selection, Recombination, or a Fresh Solve? A Candidate-Free Control for Single-Pass Test-Time Aggregation cs.LG | cs.AI | cs.CLPDF

Guiv Farmanfarmaian

TL;DR: 本文研究了在测试时聚合（test-time aggregation）中，当候选答案全部错误时，是否应该依赖候选上下文进行推理，还是应该重新求解。通过引入一个无候选答案的对照组，并在AIME-2025和HMMT-2025数学基准上使用Qwen3-4B模型进行实验，发现当多个候选答案正确时，基于候选答案的聚合能提高准确性；但当所有候选答案都错误时，基于候选答案的聚合反而会降低准确性。

Details

Motivation: 动机在于探索在高效测试时推理中，候选答案上下文是否在额外的生成过程之外提供了价值，特别是在所有候选答案都错误的情况下，正确的聚合答案可能来自重组、重新求解或两者结合，而现有方法缺乏无候选答案的对照组来评估这一点。

Result: 在AIME-2025和HMMT-2025基准上使用Qwen3-4B模型进行实验，结果显示：当多个候选答案正确时，基于候选答案的聚合将准确性提高了0.290；当所有候选答案都错误时，准确性降低了0.123；在只有一个正确答案的情况下，结论未明确。这些结果在保守校正后仍然成立。

Insight: 创新点在于引入了无候选答案的对照组，以量化候选答案上下文在聚合中的价值，并揭示了基于错误候选答案的聚合可能损害性能，这挑战了传统依赖候选答案的聚合方法。然而，证据仅限于特定模型、基准和设置，机制尚未完全解析。

Abstract: When every candidate is wrong, correct-candidate selection is unavailable, yet the aggregation call can still solve the problem afresh. A correct aggregate answer may therefore reflect recombination, fresh solving, or both. For efficient test-time reasoning, the relevant question is whether candidate context adds value beyond the additional generation pass. We introduce the missing candidate-free control under the same maximum output-token allowance and stratify by the number of correct candidates. Across AIME-2025 and HMMT-2025 with Qwen3-4B, candidate conditioning improves accuracy when multiple candidates are correct ($Δ_{\mathrm{cand}}$(c2+) = +0.290), lowers accuracy when every candidate is wrong ($Δ_{\mathrm{cand}}$(c0) = -0.123), and remains unresolved in the one-correct regime. The c2+ and c0 conclusions survive a conservative correction for the adaptive two-benchmark procedure. Under this counterfactual, the interpretation of all-wrong recovery reverses at this scale: conditioning on an all-wrong candidate pool lowers accuracy relative to a fresh solve. Original-format matching and placebo results characterize the failures descriptively but leave their mechanism unresolved. Within a separate structured intervention, explicit answer fields causally steer outputs toward their values; masking yields no measurable accuracy improvement, and equivalence with the original format was not established. The evidence is limited to one Qwen3-4B family, two mathematics benchmarks, first-answer-truncated candidate fragments, and single-pass prompted aggregation.

[74] MLREF: Efficient Module Reuse for Reward Design in Reinforcement Learning via Large Language Models cs.LG | cs.AI | cs.CLPDF

Chenglin Liu, Xun Wang, Ruishuo Chen, Zhuoran Li, Longbo Huang

TL;DR: 本文提出了一种名为MLREF（模块级奖励演化框架）的新方法，用于解决强化学习中奖励函数设计的瓶颈问题。该方法通过构建一个可重用的模块池，将奖励函数设计为模块的线性组合，并利用反思式精炼、混合信用分配和回滚合并策略来优化模块池，从而提升奖励设计的效率和稳定性。

Details

Motivation: 现有基于大语言模型（LLM）的奖励生成方法通常将奖励函数视为整体程序进行生成和修订，难以可靠地保存和重用先前迭代中发现的有效组件，导致迭代过程中性能不稳定。MLREF旨在通过模块化重用机制来解决这一问题。

Result: 在17个任务上的实验表明，MLREF在运动控制任务上比强基线方法性能提升25.2%，在操作任务上提升6.6%，并且优化过程更加稳定。

Insight: 创新点在于将奖励设计从整体程序生成转向模块化演化，通过维护一个可演化的模块池作为核心优化对象，并结合多种机制确保模块的有效重用和稳健优化，这为自动化奖励设计提供了更可靠、可复用的框架。

Abstract: Reward function design remains a bottleneck in reinforcement learning. While large language models (LLMs) have enabled automated reward generation, existing methods generate and revise reward functions as monolithic programs, making it difficult to reliably preserve and reuse effective components discovered in earlier iterations, leading to unstable performance across iterations. To address this, we propose Module Level Reward Evolution Framework (MLREF). At the core of MLREF is a module pool, a persistent repository of reusable reward components. MLREF treats the module pool as the primary optimization object: the pool evolves across iterations by accumulating successful modules, refining underperforming ones, and reusing proven components; while reward functions are constructed as linear combinations of modules drawn from this pool. To drive this evolution, MLREF integrates three mechanisms: reflection-based refinement, hybrid credit assignment, and a merge strategy with rollback, which together improve the effectiveness and robustness of reward optimization. Experiments on 17 tasks show that MLREF outperforms strong baselines by 25.2% in locomotion and 6.6% in manipulation, with more stable optimization dynamics.

[75] Open-MOPD: Diagnosing and Fixing Capability Imbalance in Multi-Teacher On-Policy Distillation cs.LG | cs.AI | cs.CLPDF

Huan-ang Gao, Haohan Chi, Yong Yan, Shiyuan Feng, Hanlin Wu

TL;DR: 本文针对多教师策略蒸馏（M-OPD）中存在的性能整合差距问题，通过建立受控基准揭示了标准M-OPD仅能利用35.6%性能上限的不足，并提出了Open-MOPD框架，通过引入令牌共享平衡、间隙感知动态预算分配和学生奖励刷新机制，将性能恢复率提升至83.4%。

Details

Motivation: 尽管多教师策略蒸馏在整合领域专家知识方面表现出潜力，但其优化动态机制尚不明确，且缺乏可复现的公开方案，本文旨在诊断并解决M-OPD中存在的性能不平衡问题。

Result: 在基于SmolLM3-3B-Base和预言路由的受控M-OPD基准上，标准方法仅恢复了35.6%的性能上限，而提出的Open-MOPD框架将这一指标提升至83.4%，实现了显著的性能改进。

Insight: 创新点在于识别出性能差距源于令牌级优化预算的严重错配，而非梯度冲突，并提出了针对序列长度差异、收敛漂移和奖励陈旧性三个正交因素的系统性解决方案；客观来看，其受控基准的建立和对优化病理的深入分析为理解多教师蒸馏提供了新视角。

Abstract: Multi-teacher on-policy distillation (M-OPD) has emerged as a promising paradigm for consolidating domain-specialized reinforcement learning (RL) experts into a single generalist student via dense, token-level reward supervision. Despite its practical success, the optimization dynamics governing multi-teacher capability integration remain poorly understood, and open, rigorously reproducible recipes are conspicuously lacking. In this work, we establish a controlled M-OPD benchmark on SmolLM3-3B-Base with oracle routing, isolating capability integration from routing ambiguity. Our investigation reveals a pronounced capability integration gap: standard M-OPD captures only 35.6% of the available headroom relative to a domain-routed oracle ensemble, with concise tasks such as instruction following suffering severe degradation and premature stagnation. Crucially, we show that this failure stems not from gradient conflict, but from a severe misallocation of the token-level optimization budget. This pathology is driven by three orthogonal factors: structural sequence-length disparities across domains, dynamic convergence drift due to non-uniform learning rates, and multi-step reward staleness from asynchronous policy updates. To resolve these imbalances, we introduce Open-MOPD, a principled framework incorporating token-share balancing, gap-aware dynamic budget allocation, and student reward refresh. Together, these mechanisms systematically restore cross-domain balance, elevating headroom recovery from 35.6% to 83.4% in a single deployable student. We fully open-source our end-to-end post-training recipe, training trajectories, and evaluation suites on an academically accessible hardware budget.

[76] Beyond Teacher Likelihood: Group-Calibrated On-Policy Distillation for Long-Context Reasoning cs.LG | cs.AI | cs.CLPDF

Zhu Zhang, Jixun Wang, Xiaoang Xu, Xiaorong Wang, Zihan Zhou

TL;DR: 本文提出了组校准策略蒸馏（GC-OPD）方法，用于解决长上下文推理任务中，传统策略蒸馏（OPD）的令牌级教师指导与任务级验证器奖励之间不匹配的问题。该方法通过计算组内归一化的验证器奖励与OPD轨迹分数的差异作为残差，并结合基于相对优势的信用分配（RACA）将残差分配到各个令牌，从而在保留密集令牌级指导的同时融入任务完成度反馈。

Details

Motivation: 在长上下文任务中，传统的基于令牌级教师似然度的策略蒸馏方法可能产生局部合理但忽略全局证据或违反任务约束的响应，而任务特定的验证器在响应层面评估任务完成度并给出分级奖励，两者之间存在不匹配。本文旨在弥合这种不匹配，以提升模型在长上下文推理中的表现。

Result: 在五个长上下文基准测试上，使用GC-OPD对Qwen3-4B和Qwen3-8B模型进行后训练，其五个基准的平均分数分别从29.08提升至40.47和从35.12提升至44.65，优于传统OPD方法（39.31和43.56）。消融实验表明，带符号的残差比额外的OPD项或直接添加归一化验证器奖励更有效，且RACA优于均匀令牌分配。

Insight: 核心创新在于引入了组相对残差校准机制，将响应层面的验证器反馈与令牌层面的教师指导相结合，并通过基于相对优势的信用分配（RACA）精细调整令牌级损失。这为在强化学习或蒸馏框架中整合不同粒度（令牌级与任务级）的监督信号提供了一种有效途径。

Abstract: On-policy distillation (OPD) trains a student on its own responses using dense token-level guidance from a stronger teacher. In long-context tasks, however, token-level teacher support can favor locally plausible responses that omit evidence distributed across the input or violate global task constraints. Task-specific verifiers, in contrast, evaluate task completion at the response level and may return graded rewards that reflect partial success. We diagnose this mismatch on fixed responses from two representative long-context evidence-aggregation tasks. Across longer input ranges, trajectory-level OPD scores become progressively less aligned with verifier rewards, indicating teacher-verifier disagreement. Motivated by this observation, we introduce Group-Calibrated On-Policy Distillation (GC-OPD). GC-OPD separately normalizes verifier rewards and trajectory-level OPD scores within each rollout group and uses their difference as a signed teacher-verifier disagreement residual. Relative-advantage-based credit assignment (RACA) distributes this trajectory-level residual across tokens according to their relative OPD advantages while preserving the original OPD signal. Across five long-context benchmarks, post-training with GC-OPD raises the five-benchmark averages of the official Qwen3-4B and Qwen3-8B checkpoints from 29.08 to 40.47 and from 35.12 to 44.65, respectively. Vanilla OPD reaches 39.31 and 43.56 under the same setup. Controlled ablations show that the signed residual is more effective than either an additional OPD-derived term or direct group-normalized verifier reward addition, while RACA further improves over uniform token allocation. Together, these results demonstrate that group-relative residual calibration can incorporate verifier outcomes without discarding dense token-level guidance. Code is available at https://github.com/SolereZhang/GC-OPD.

cs.RO [Back]

[77] Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interaction cs.RO | cs.CVPDF

Zijian Xiao, Zipeng Ye, Jinkun Hao, Xiong Yang, Yuchen Xie

TL;DR: 本文提出了RoomWright框架，一种基于智能体、以使用为驱动的代码化三维场景生成方法，旨在为具身AI创建可执行、可编辑且模拟就绪的交互环境。该方法超越了传统仅关注视觉布局和物体关节的方法，通过将每个锚点视为任务中心，推理任务所需物体及其可供性，并使用代码智能体将交互编译为触发-条件-效果规则来更新结构化物体状态，从而建模场景的功能性使用。

Details

Motivation: 现有基于代码的场景生成方法主要关注视觉构建和物体层面的关节，未能充分建模场景的功能性使用，这限制了其为具身交互、机器人操作和基于仿真的策略学习提供有效环境的能力。

Result: 广泛的实验证明了该方法的有效性。生成的场景是可执行、可编辑且模拟就绪的，为具身AI和策略学习提供了交互式环境。

Insight: 核心创新在于提出了‘使用驱动的物体推理’范式，将场景生成从视觉布局提升到功能建模层面；同时，通过代码智能体将多部分交互编译为结构化规则，捕获物体间的因果依赖关系，并使用基于标注的使用引导方向来解决可操作物体方向模糊的问题，从而生成更符合真实交互逻辑的场景代码表示。

Abstract: Indoor scene synthesis provides essential environments for embodied AI, robotic manipulation, and simulation-based policy learning. Recent code-based scene generation methods produce editable and extensible environments, yet they remain focused on visual construction and object-level articulation, leaving the functional usage of scenes largely unmodeled. To address this problem, we present RoomWright, an agentic usage-driven framework for generating 3D scenes represented entirely as code for embodied interaction. RoomWright performs usage-driven object reasoning, which treats each anchor as a task centre and admits task-required objects and their affordances. A code agent further enables multi-part interaction by compiling each interaction into a trigger, condition, effect rule that updates structured object states, capturing causal dependencies across objects. Moreover, since manipuland orientation is ambiguous and hard to recover from pixels, RoomWright alleviates this via annotation-informed usage-guided orientation. Extensive experiments demonstrate the effectiveness of our method. The resulting scenes are executable, editable, and simulation-ready, providing interactive environments for embodied AI and policy learning.

[78] LT-Mem: Volatility-Aware Spatio-Temporal Memory for Lifelong Scene Understanding cs.RO | cs.CVPDF

Yumin Lee, Hyoseok Ju, Giseop Kim

TL;DR: 论文提出了LT-Mem，一个用于终身场景理解的、考虑对象动态变化（波动性）的时空记忆框架。该框架通过多会话SLAM提供空间对齐的物体观测，并利用一个基于波动性的推理层来管理物体记忆的演化（如覆盖、保持或多假设操作），最终形成一个包含当前状态和事件历史的Tri-Memory结构（Live, Delta, Meta）。论文还引入了包含多会话记录和时序问答对的LT-VQA数据集用于评估。实验表明，LT-Mem在所有指标上均优于基线方法，且消耗的token数量少一个数量级。

Details

Motivation: 解决机器人在动态环境中长期运行时面临的’时间遗忘’问题。现有系统要么覆盖历史以保持地图最新，要么存储语义快照但缺乏跨会话的物体身份一致性，导致无法追踪物体（如一把绿色椅子）在整个运行历史中的状态变化。

Result: 在提出的LT-VQA数据集上，LT-Mem在所有评估指标上持续优于基线方法，同时消耗的token数量少一个数量级。消融实验证实性能提升源于其结构化的记忆架构，而非大语言模型（LLM）的容量。

Insight: 核心创新点在于将空间对齐的实例级3D感知与基于波动性条件（volatility-conditioned）的时序推理相统一。其设计的Tri-Memory结构（Live, Delta, Meta）能同时保存物体当前状态和事件历史，支持以物体为中心的纵向推理。此外，提出的LT-VQA数据集为评估终身场景理解提供了新的基准。

Abstract: Long-term robot operation in evolving environments requires object-level understanding that persists across repeated revisits. Existing systems either overwrite history to maintain an up-to-date map or store semantic snapshots without consistent cross-session object identity, resulting in temporal amnesia: the systematic loss of object history that prevents answering queries such as “Where has the green chair been across all sessions?” We propose LT-Mem, a volatility-aware memory evolution framework that unifies spatially aligned instance-level 3D perception with volatility-conditioned temporal reasoning. First, a multi-session SLAM backbone provides spatially aligned per-object observations across sessions. Second, a reasoning layer governs how object memory evolves: deterministic evidence scoring preserves cross-session identity, and a volatility-aware policy selects among overwrite, hold, and multi-hypothesis actions based on each object’s dynamics. Third, the resulting Tri-Memory structure (Live, Delta, Meta) preserves both current states and event histories, enabling longitudinal object-centric reasoning. We further introduce LT-VQA, a dataset and evaluation suite comprising multi-session recordings, persistent identity annotations, and temporal QA pairs. Experiments show that LT-Mem consistently outperforms baselines across all metrics while consuming an order of magnitude fewer tokens, and ablations confirm that gains are driven by the structured memory architecture rather than LLM capacity.

quant-ph [Back]

[79] Bernstein-Vazirani Networks: Quantum Machine Learning by Interference quant-ph | cs.AI | cs.CV | cs.LGPDF

Natacha Kuete Meli, Tolga Birdal, Prayag Tiwari, Vladislav Golyanik, Michael Moeller

TL;DR: 本文提出了Bernstein-Vazirani Networks (BVNs)，一种基于量子干涉的非变分量子机器学习框架，用于监督学习任务，如图像视觉和表征学习。标准BVN遵循量子傅里叶采样原理，将标记数据置于叠加态并在傅里叶基中干涉以提取全局信息特征。作者还定义了广义BVN，允许在问题自适应基中进行干涉，从而在相同测量预算下获得更具表达力的模型。BVN通过（过）完备干涉基实现通用函数逼近，且训练无需梯度。在合成和真实分类任务以及隐式图像表示上的实验表明，BVN具有良好的泛化能力，并与经典及量子基线模型性能相当。

Details

Motivation: 动机是开发一种利用量子干涉原理进行监督学习的非变分量子机器学习框架，旨在解决传统变分方法可能面临的优化难题，并探索量子计算在特征提取和模型表达力方面的潜力。

Result: 在合成和真实世界的分类任务以及隐式图像表示任务上进行了实验，结果表明BVN表现出强大的泛化能力，并且与经典机器学习模型以及其他量子基线模型相比，取得了有竞争力的性能。

Insight: 创新点在于提出了基于量子干涉的非变分学习范式，通过量子傅里叶采样和问题自适应干涉基来提取特征，实现了无需梯度的训练和通用函数逼近能力，为量子机器学习提供了新的架构思路。

Abstract: We introduce Bernstein-Vazirani Networks (BVNs), a non-variational quantum machine learning framework that leverages quantum interference for supervised learning, demonstrated on vision and representation learning tasks. In their standard form, BVNs follow the principle of quantum Fourier sampling: labelled data are placed in superposition and interfered in the Fourier basis to extract globally informative features. We then define generalised BVNs that enable interference in problem-adapted bases, yielding more expressive models under the same measurement budget as in the standard setting. BVNs achieve universal function approximation through (over)complete interference bases, while training of BVNs is gradient-free. Experiments on synthetic and real-world classification tasks, as well as implicit image representation, show strong generalisation capabilities and competitive performance with classical and quantum baselines.

eess.IV [Back]

[80] TractoGraphVLM: A Unified Vision-Language Framework for White Matter Tractography eess.IV | cs.CVPDF

Gurucharan Marthi Krishna Kumar, Janine Dale Mendola, Amir Shmuel

TL;DR: 本文提出了TractoGraphVLM，一个统一的视觉-语言框架，用于处理白质纤维束成像的四个任务：束分类、文本到束检索、解剖描述生成和视觉问答。该框架基于一个共享的GPS图Transformer架构，将纤维束表示为编码3D位置和切线方向的流线图，并通过对比学习与冻结的BiomedBERT文本编码器对齐，同时使用带有视觉前缀标记的BioGPT解码器生成描述和答案。

Details

Motivation: 视觉语言模型已在2D医学影像中取得变革性进展，但将其扩展到具有复杂拓扑结构的3D白质纤维束成像仍具挑战。本文旨在开发一个统一框架，以同时处理纤维束的多种理解和生成任务。

Result: 在HCP Young Adult数据集上训练并在独立测试集上评估，TractoGraphVLM在束分类任务上达到91.8%的准确率，文本到束检索的R@1为84.7%，解剖描述生成的BLEU-4为20.1、ROUGE-L为66.8，视觉问答准确率为66.4%。同一模型在HCP Aging数据集上进行了零样本迁移测试，判别性任务性能略有下降，生成性任务下降较大，显示出对年龄和采集偏移的鲁棒性。

Insight: 创新点在于提出了一个统一的、基于图表示的视觉-语言框架，通过多任务联合训练处理纤维束的多种模态任务。关键洞察包括：语言监督比仅使用标签训练能学习到更丰富的表示（如半球和纤维族结构）；保留纤维方向的图表示优于体积基线；GPS架构实现了最佳平衡；生成性指标评估了与结构化知识库的一致性，而非独立临床文本。这表明，一个联合训练的单一模型可以从纯语言中学习可迁移的神经解剖学知识，服务于纤维束的分类、检索、描述和问答。

Abstract: Vision language models have transformed 2D medical imaging, yet extending them to 3D white matter tractography remains challenging due to the complex topology of fiber bundles. We introduce TractoGraphVLM, a unified framework for four tasks, bundle classification, text-to-tract retrieval, anatomical captioning, and visual question answering, built on a shared GPS architecture, training procedure, and read-out design. Fiber bundles are represented as streamline graphs whose nodes encode 3D position and tangent orientation. A General, Powerful, Scalable (GPS) graph transformer produces bundle embeddings aligned with a frozen BiomedBERT text encoder via contrastive learning, while a BioGPT decoder with visual prefix tokens generates captions and answers. A single shared encoder and decoder is trained jointly across all four tasks and evaluated from one checkpoint. Trained on HCP Young Adult subjects, TractoGraphVLM achieves 91.8% bundle classification accuracy, 84.7% retrieval R@1, BLEU-4=20.1, ROUGE-L=66.8, and 66.4% VQA accuracy on a held-out test set. The same checkpoints transfer zero-shot to HCP Aging subjects, with a modest drop on discriminative tasks and a larger drop on generative tasks, showing robustness to age and acquisition shift. Language supervision yields richer representations than label-only training, recovering structure like hemisphere and fiber family, carried by captions but never given as a label. Swapping only the visual encoder, graphs preserving fiber orientation outperform volumetric baselines, with GPS giving the best balance. Generative metrics measure consistency with a structured knowledge base rather than independent clinical text; even so, TractoGraphVLM shows that classifying, retrieving, describing, and answering questions about a white matter bundle can be served by one jointly trained model that learns transferable neuroanatomy from language alone.

[81] QuARC-GS: Quantized Anchored Residual Coding for Compact Dynamic Scene Streaming with Gaussian Splatting eess.IV | cs.CVPDF

Vu Trung Nghia Nguyen, Yuchen Wang, Kyung Chul Lee, Kevin C. Zhou

TL;DR: 本文提出了QuARC-GS，一种用于在线动态场景流式传输的量化感知4D场景优化框架。该方法通过使用一个规范帧和高度压缩的每帧残差来表示动态场景，并引入了量化感知锚点变形和变化门控致密化两种策略，在保持重建质量和速度的同时，实现了高达11倍的存储压缩。

Details

Motivation: 解决动态3D场景表示（如基于高斯泼溅的模型）在在线自由视点视频流式传输中面临的巨大存储需求和高速重建/渲染挑战，旨在实现可持续的长视频流式传输。

Result: 在广泛使用的数据集上进行的大量实验表明，QuARC-GS在保持有竞争力的重建质量和训练速度的同时，与最先进的方法相比，每帧存储量减少了高达11倍。

Insight: 核心创新点在于将动态场景分解为规范帧加压缩残差的表示，并设计了量化感知锚点变形来抑制不重要的运动更新，以及变化门控致密化策略来仅在真正发生变化的区域分配新高斯点，从而高效地压缩了运动和外观更新数据。

Abstract: 3D scene representation techniques such as neural radiance fields (NeRFs) and Gaussian splatting have made substantial progress in novel view synthesis, achieving high-quality renderings from arbitrary view angles. More recently, such techniques have been extended to dynamic 3D scenes; however, achieving sustainable online free-viewpoint video (FVV) streaming remains challenging, especially for longer videos, due to significant storage demands of detailed scene representations and high reconstruction/rendering speed needs. To address these challenges, we propose Quantized Anchored Residual Coding Gaussian Streaming (QuARC-GS), a quantization-aware 4D scene optimization framework for online dynamic scene reconstruction that achieves ultra-high compression while maintaining reconstruction speed and quality. QuARC-GS represents a scene using a single canonical frame and highly compressed per-frame residuals. Specifically, we compress each residual through two complementary strategies targeting motion, appearance, and densification. We introduce quantization-aware anchor deformation, which suppresses insignificant motion updates while preserving meaningful deformations, maintaining reconstruction quality under low-storage streaming. Furthermore, we design a change-gated densification strategy that allocates new Gaussians only in regions exhibiting genuine temporal changes, effectively eliminating redundant appearance updates and reducing storage overhead. Extensive experiments on widely used datasets demonstrate that QuARC-GS enables competitive reconstruction quality and training speed while cutting per-frame storage by up to 11$\times$ compared to the state-of-the-art.

cs.HC [Back]

[82] Multimodal Rapport Estimation in Real-World HRI cs.HC | cs.CL | cs.ROPDF

Akihiro Sakuramoto, Takato Hayashi, Ryo Miyoshi, Yuki Okafuji, Shogo Okada

TL;DR: 本研究探讨了在真实世界人机交互（HRI）中自动评估互动质量（即融洽度）的可行性。通过在真实日本药房收集的多模态数据，比较了零样本大语言模型、预训练的文本/音频/视觉模型及其融合方法。研究发现，零样本LLM表现强劲，而音频和视觉模型提供互补信息，其中Gemini 2.5 Flash作为单一模型表现良好，而Gemini（文本）与HuBERT、V-JEPA的融合模型整体最佳。

Details

Motivation: 现有自动评估方法主要在受控实验室环境中开发，尚不清楚它们能否直接应用于用户可自由脱离、可能出现多方参与的真实世界HRI环境。本研究旨在解决真实世界HRI中互动质量（融洽度）的可靠估计问题，以改进对话策略并实现机器人行为的自主适应。

Result: 在真实世界HRI数据集（62个多模态会话）上，零样本LLM（如Gemini 2.5 Flash）取得了强劲性能；融合模型（Gemini文本 + HuBERT音频 + V-JEPA视觉）达到最佳整体表现。分析表明，估计性能随互动时长和群组规模条件而变化。

Insight: 论文的创新点在于将自动融洽度评估从实验室扩展到真实、动态的HRI场景，并系统比较了多模态模型的零样本与融合策略。客观来看，其核心洞察是：真实世界HRI的评估与模型设计必须考虑实验室设定之外的上下文变异性（如互动时长、群组规模），且多模态信息（尤其是文本与音视频的互补）对提升估计性能至关重要。

Abstract: Evaluating interaction quality in real-world HRI is an important challenge. If interaction quality can be estimated reliably, the results can be used to improve dialogue strategies and ultimately enable robots to adapt their behavior autonomously. However, existing automatic evaluation methods have been developed primarily in controlled laboratory settings, and it remains unclear whether they can be directly applied to real-world environments, where users are free to disengage and multi-party participation may arise naturally. In this study, we investigate the automatic estimation of third-party-rated rapport scores using 62 sessions of multimodal recordings collected in a Japanese drugstore. We compare zero-shot LLMs, pretrained text, audio, and visual models, and their prediction-level fusion. The results show that, in real-world HRI, zero-shot LLMs achieve strong performance, while audio and visual models tend to provide complementary information. In particular, Gemini 2.5 Flash performs strongly as a single model, and a fusion model combining Gemini (text) with HuBERT and V-JEPA performs best overall. Further analyses showed that estimation performance varied across interaction-duration and group-size conditions. These findings suggest that rapport estimation in real-world HRI requires evaluation and model design that account for contextual variability beyond that assumed in laboratory settings.

cs.IR [Back]

[83] rEDMRec: Distilling Large Language Model Reasoning into an Editable Experience Memory for Recommendation cs.IR | cs.AI | cs.CLPDF

Minh Hoang Nguyen, Tung Le, Huy Tien Nguyen

TL;DR: 本文提出了rEDMRec方法，旨在解决大语言模型在推荐系统中重复推理成本高且推理结果不可复用的问题。该方法将教师大语言模型的推理过程提炼并压缩到一个结构化的、可编辑的经验记忆中，该记忆包含长期偏好、短期上下文、物品感知和反事实硬负例比较四个通道。一个轻量级的学生模型通过检索该记忆进行候选物品排序，从而将在线推理成本与推理深度解耦。

Details

Motivation: 大语言模型通过显式推理（如提取用户偏好、解释物品匹配度）可以提升推荐质量，但这种推理在每次请求时重复生成成本高昂，且生成后通常被一次性使用后丢弃，无法跨请求复用，也难以随着用户兴趣漂移而进行检视或修正。

Result: 在ML-1M、Amazon Beauty和Steam三个数据集上，使用十个不同的学生模型骨干进行实验，rEDMRec在HR@1指标上均优于零样本、少样本、RAG基线，并且在大多数骨干上优于GraphRAG，在ML-1M数据集上相比次优基线的提升最高达13.3%。消融实验表明短期上下文通道在不同容量的学生模型中均能带来一致提升，而其他通道的贡献则依赖于模型容量。基于辩论的记忆优化在六个优化周期内将记忆库重复率降低了7.4个百分点，并将下游HR@1提升了最高+0.029。

Insight: 核心创新在于将昂贵的一次性LLM推理蒸馏为结构化的、可编辑的、可复用的经验记忆，并通过记忆控制器（执行增/删/改/保持操作）和K-agent辩论机制进行优化。这实现了推理成本与在线服务成本的解耦，并为推荐系统提供了一种可解释、可干预的记忆机制，以适应动态的用户兴趣。

Abstract: Large language models can improve recommendation quality by reasoning explicitly over user history and candidate items - for example, extracting a user’s preferences or explaining why one item fits better than another - rather than mapping history directly to a ranked list. This reasoning, however, is expensive to repeat on every ranking request and, once produced, is typically consumed once and discarded, leaving it neither reusable across future requests nor easy to inspect or correct as user tastes drift. Our insight is that reasoning does not need to be regenerated at every call if it can instead be compressed once into a compact, structured memory that a lightweight model retrieves from. We propose rEDMRec, which distills a teacher LLM’s reasoning into four typed, editable experience channels - long-term preference, short-term context, item-perception, and counterfactual hard-negative comparisons - maintained by an LLM memory controller that performs Add/Delete/Modify/Keep operations and refines entries via K-agent debate. A lightweight student LLM then ranks candidates purely by retrieving from this memory, without invoking the teacher again, decoupling online inference cost from reasoning depth. Across ML-1M, Amazon Beauty, and Steam and ten student backbones, rEDMRec improves HR@1 over zero-shot, few-shot, and RAG on every backbone, and over GraphRAG on most backbones, with Impv up to 13.3% vs. the second-best baseline on ML-1M. Channel ablations show that short-term context is the only channel that helps consistently across capacity tiers, whereas long-term, item-perception, and counterfactual contributions are capacity-dependent (and can reverse on the strongest students); debate-based memory optimization lowers bank duplication by 7.4 percentage points while raising downstream HR@1 by up to +0.029 over six optimization epochs.

cs.AI [Back]

[84] Can a Lightweight Multimodal Model Estimate LLM Reasoning Performance? A Study for Compute-Optimal Document Inference cs.AI | cs.CLPDF

Zishan Ahmad, Vishal Vaddina

TL;DR: 该论文提出了BudgetDoc基准和DRB模型，旨在解决大语言模型在文档任务中统一分配推理预算导致成本高昂和过思考惩罚的问题。DRB是一个约10亿参数的多模态预飞行估计器，能够预测不同预算水平下的模型性能，并在动态分配推理预算时，在多数配置下匹配或优于始终使用最大预算的基线，同时大幅降低成本。

Details

Motivation: 动机是解决LLM在文档任务中因视觉布局复杂而导致的统一推理预算分配效率低下和过思考惩罚问题，需要一个能够权衡模型、预算和性能的方法。

Result: 在BudgetDoc基准上，DRB在预测预算水平下的序数模型性能时达到了0.753的加权F1分数；在动态分配推理预算的实验中，在15个配置中的9个匹配或改进了F1分数，同时显著降低成本。

Insight: 创新点包括引入首个提供模型-预算-性能权衡显式监督的多模态基准BudgetDoc，以及训练轻量级多模态预飞行估计器DRB来动态优化推理预算，这为计算最优的文档推理提供了新思路，并展示了跨模型选择的泛化潜力。

Abstract: Uniformly allocating inference reasoning budgets to LLMs is expensive and prone to over-thinking penalties; especially in document tasks where visual layouts drive complexity. To address this, we introduce BudgetDoc, the first multimodal benchmark providing explicit supervision for model-budget-performance trade-offs across three document tasks. Using BudgetDoc, we train DRB (Document-Reasoning Balancer), an approx. 1B-parameter pre-flight estimator (SigLIP-2 + Qwen3-0.6B) that predicts ordinal model performance across budget levels, achieving a 0.753 weighted F1. When dynamically allocating reasoning budgets across five frontier models and three datasets, DRB matches or improves F1 scores compared to always-maximum-budget baselines in 9 of 15 configurations while drastically reducing cost. Finally, preliminary evaluations demonstrate DRB’s potential to generalize to cross-model selection.

[85] Adaptive Memory and Reflection Multi-Agent System for Medical Question Answering cs.AI | cs.CL | cs.MAPDF

Pradeep Murugesan, Luoxiao Yang, Xueli Chen, Xinqi Fan

TL;DR: 本文提出了一种用于医疗问答的自适应记忆与反思多智能体系统，旨在通过专门的智能体利用专用记忆和基于反思的反馈来检索相关先验案例并改进后续推理。该系统通过复杂性评估将问题路由到单独、协作或升级的工作流程，并利用共识和伦理监督模块支持推理整合与输出审查。

Details

Motivation: 现有医疗问答系统通常基于单智能体架构和静态检索，缺乏适应性、持久记忆和结构化决策能力，难以处理需要事实知识和细致推理的复杂医疗案例。

Result: 在MedQA和MedMCQA基准上的评估表明，该系统相比多个基线模型表现出色；消融研究证实，结合智能体专用记忆、反思和外部检索能实现最强的性能。

Insight: 创新点在于引入了结构化记忆和基于反思的反馈机制的多智能体框架，通过复杂性路由和共识/伦理监督模块增强了医疗问答的可信度和适应性，为开发更可靠的医疗智能体提供了新思路。

Abstract: Accurate and responsible medical question answering (QA) is important in healthcare, where complex cases require factual knowledge and nuanced reasoning. Existing medical QA systems, typically based on single-agent architectures and static retrieval, often lack adaptability, persistent memory, and structured decision-making. This work introduces an adaptive memory and reflection (AMR) agentic system, a multi-agent framework in which specialized agents use dedicated memory and reflection-based feedback to retrieve relevant prior cases and improve subsequent reasoning. Complexity assessment routes questions through solo, collaborative, or escalated workflows, while consensus and ethical overseer modules support reasoning consolidation and output review. Evaluation on MedQA and MedMCQA demonstrates strong performance compared with several baselines. Ablation studies show that combining agent-specific memory, reflection, and external retrieval yields the strongest performance. These findings highlight the potential of structured memory and feedback for developing more trustworthy medical agents. The source code is publicly available at https://github.com/mm-air/AMR-Agent.

[86] What is Missing from AI Post-Training AI: An Empirical Analysis cs.AI | cs.CL | cs.LGPDF

Joy Jia Yin Lim, Xin Huang, Hao Peng, Yaxi Lu, Xin Cong

TL;DR: 本文通过分析大量公开的LLM后训练轨迹，发现AI代理在端到端后训练大型语言模型时，其训练策略在初始阶段就被锁定，后续资源仅用于局部调整。研究通过逐步干预实验（经验驱动脚手架、人类指导、额外推理计算）证明，当前AI代理缺乏的是在执行过程中自发重新评估策略的机制。

Details

Motivation: 旨在探究AI代理在端到端后训练LLM时，为何其训练策略在初始阶段就被锁定，以及如何通过干预措施（如经验、指导、推理计算）来改善这一局限，从而揭示AI-for-AI范式中缺失的关键能力。

Result: 实验表明：经验驱动脚手架在GSM8K和HumanEval基准上分别提升12.6和40.8分，但策略仍静态；人类指导能有效重定向初始策略，但代理随后陷入局部调整循环；额外推理计算在简单任务上有效，在困难任务上几乎无增益。

Insight: 论文创新点在于区分了执行级能力（在选定策略内迭代）和策略级能力（根据实验证据修订高层判断），并指出当前AI代理缺乏自发重新评估策略的机制，这为未来AI-for-AI系统设计提供了关键方向。

Abstract: Large language model (LLM) agents can now post-train an LLM end-to-end. They can write code, launch training, evaluate checkpoints, and improve downstream performance, raising the prospect of AI-for-AI. We argue that this picture conflates two distinct capabilities: execution-level capability, iterating within a selected training strategy; and strategy-level capability, revising the high-level judgment as experimental evidence accumulates. Analyzing a large corpus of publicly released post-training trajectories, we find that across different tasks, the agent’s training strategy is locked in at the very beginning, and the entire remaining budget is spent on local adjustments within the selected strategy. We then examine three natural explanations–missing experience, missing guidance, and insufficient reasoning–with escalating interventions. Extensive experiments show that (1) an experience-driven scaffold improves execution across the board (+12.6 points on GSM8K and +40.8 on HumanEval) but leaves the strategy static; (2) human guidance effectively redirects the initial strategy, yet the agent falls back into local adjustment loops once training starts; and (3) additional inference compute pays off on easier tasks but yields almost no gain on the hardest one. In conclusion, what agents lack is neither experience, guidance, nor reasoning compute, but a mechanism for spontaneously reevaluating their strategy during execution.

Table of Contents

cs.CL [Back]

[1] Backdoor Learning in Language Models and Vision-Language Models cs.CL | cs.AIPDF

[2] Compiler-Guided Adaptive Proof Search with Cross-Model Synergy on Context-Dependent Theorem Proving cs.CL | cs.PLPDF

[3] Nine Emotion Centroids: A Label-Free Valence Axis That Transfers Across Four Modalities cs.CL | cs.AIPDF

[4] MAVEN: A Macro-Societal Value Evaluation Framework of Multimodal Content with Compact Aligned Evaluators cs.CL | cs.LGPDF

[5] Fractional Decay KV-Cache: Ownership-Aware Memory Management for Improved Inference Relevancy in Dialog Systems cs.CL | cs.AIPDF

[6] DeepTCM1.0: A Multi-Expert AI Agent for Deciphering Mechanisms of Chinese Herbal Formulae Based on General Large Language Models cs.CL | cs.AIPDF

[7] StocksTalk: A Voice-Enabled Conversational Agent for Structured Query Generation over Web Data cs.CL | cs.AI | cs.LGPDF

[8] Different Facets of Verbalised Overconfidence: an Interpretability Study cs.CL | cs.AIPDF

[9] Operationalizing Narrative Entropy (Sn): A Two-Scene Registered Pilot Report and Pre-Validation Protocol cs.CLPDF

[10] You Are What You Prompt: Prompt Quality, Domain Shift, and Uncertainty in Agrifood Vision-Language Models cs.CL | cs.LGPDF

[11] Alignment Is All You Need: Instruction-Free Training for General Audio-Language Models cs.CL | cs.SD | eess.ASPDF

[12] When Do LLMs Actually Help? Evaluating LLMs as Data Quality Annotators cs.CL | cs.AIPDF

[13] Figurative and Cultural Knowledge in LLMs: Investigating Cross-Domain Transfer through Fine-Tuning cs.CLPDF

[14] Pedagogical AI in Mental Health: A Tri-Stream Fine-Tuned LLM Framework for Automated Clinical Supervision and Risk Triage cs.CL | cs.AI | cs.LGPDF

[15] DART-SD: Diamond-topology Aware Retrieval and Tuning for Self-Distillation of Multi-Turn Tool-Calling Agents cs.CL | cs.AI | cs.LG | cs.MAPDF

[16] Beyond LLM-Based Reasoning: Lightweight GNNs for Agent Failure Attribution cs.CLPDF

[17] From Storage to Access: Verifiable Activation of Parametric Knowledge in LLMs via Explicit Priming and Implicit Reasoning cs.CL | cs.AI | cs.LGPDF

[18] X2Streaming-TTS: Causal Token-Level Text-to-Speech from Streaming Text with Speech-State Inheritance cs.CLPDF

[19] MemFuse: Multi-Source Memory Fusion from Fragmented Observations cs.CL | cs.AIPDF

[20] Gradient Mirage: Trainable yet Label-Unidentifiable Gradients in Large Language Model Split Learning cs.CL | cs.LGPDF

[21] SMTrap: Cost-Effective DoS Attacks Against Large Reasoning Models via SMT Conflict Guidance cs.CL | cs.AIPDF

[22] MedUAG: Unified Understanding and Generation for Medical Multimodal Models cs.CL | cs.AIPDF

[23] DeepWeaver: Bridging the Evidence Synthesis Gap in Open-Ended Question Answering cs.CL | cs.AIPDF

[24] ChildSafeAds Shared Task 2026: Commercial Content in Child-Facing YouTube Videos cs.CL | cs.CYPDF

[25] Grading the Graders: Verification Autonomy Levels (L0-L5) for LLM Reasoning cs.CLPDF

[26] SPADE: Self-Play in Adaptive Synthetic Executable Environments cs.CL | cs.AIPDF

cs.CV [Back]

[27] XRF-to-Optical Field-of-View Localization with Vision Language Models cs.CVPDF

[28] FedCoRe: Target-Adaptive Completion for Missing Modalities in Healthcare Federated Learning cs.CV | cs.AI | cs.LGPDF

[29] Reproducible Multimodal Affordance Prediction cs.CV | cs.ROPDF

[30] From Inference to Adaptation: A Unified Optimal Transport View of Vision Language Model cs.CV | cs.AI | cs.CL | cs.LGPDF

[31] TTSD-FAR: Test-Time Self-Distillation with Fisher-Anchored Restoration for Missing-Modality Emotion Recognition in LVLMs cs.CV | cs.AIPDF

[32] Depth Anything V4: Dynamic 4D Scene Reconstruction via Riemannian Flow Matching on 4D Gaussian Splatting cs.CVPDF

[33] What Does Attention Transfer Transfer? Attention Structure and Robustness in Vision Transformers cs.CVPDF

[34] CoMVS-GS: Collaborative Multi-View Stereo and 3D Gaussian Splatting for Surface Reconstruction cs.CVPDF

[35] JSL-DC: A Word-Level Japanese Sign Language Dataset with Linguist-Derived Descriptions for Distinguishing Confusable Signs cs.CVPDF

[36] Partition the Support, Reconstruct the Residual: Training-Free Sparse Attention for Video Generation and World Models cs.CV | cs.AI | cs.LGPDF

[37] COSTA: A Cluster-Centric Paradigm for Annotation-Free Open-Set Semantic Segmentation of Aerial Point Clouds with Domain Shifts cs.CVPDF

[38] DyG$^2$T: Modeling Object Dynamics with 3D Gaussian Temporal-Spatial Particle Graph Transformer cs.CVPDF

[39] OptiModNet: A UNet-Transformer Hybrid with Grouped-Query and Channel Attention for Optic Disc and Cup Segmentation cs.CV | cs.AIPDF

[40] Zero-Shot SAM2 Segmentation and Vision Transformer-Based Recognition of Elamite Cuneiform Symbols from Degraded Tablet Images cs.CV | cs.HCPDF

[41] StateTrace: An Object-Centric Framework for Hidden-State Spatiotemporal Reasoning in Long Videos cs.CVPDF

[42] PATE-Forensics: Perception-as-Tool for Explainable Deepfake Forensics with General-Purpose MLLMs cs.CVPDF

[43] MR-IQA-2: Faithful Image Quality Reflection via Fine-Grained Credit Assignment cs.CV | cs.AIPDF

[44] SPARC: Subspace Position-Aware Robust Few-Shot Calibration for Distribution-Shifted Industrial Anomaly Detection cs.CVPDF

[45] OmniHandwritingOCR: A Diagnostic Benchmark for Evaluating Multimodal LLMs in Handwritten OCR Scenarios cs.CV | cs.AIPDF

[46] Teach a Molmo2Fish: Towards interactive fish tracking with natural language guidance cs.CVPDF

[47] FD-CanKD: Frequency-Decoupled Cross-Attention Distillation as a Refinement Prior for Compact Object Detectors cs.CVPDF

[48] PCQA-R1: Advancing Generalized 3D Point Cloud Quality Assessment with Reinforcement Learning cs.CVPDF

[49] VA-Judger: Reward Modeling from Human Preference Feedback for Joint Video-Audio Generation cs.CVPDF

[50] When Safety Overrides Vision: Exploring Dynamics between Vision Influence and Safety Alignment in Vision-Language Models cs.CV | cs.CLPDF

[51] SAM2Dual: Training-Free, Dual Memory for Long-Term Video Object Segmentation cs.CVPDF

[52] Clinically Structured Surrogate Rewards for Post-SFT Medical Image Captioning cs.CVPDF

[53] DynCur-Geo: Dynamic Curiosity Reward Shaping for Multimodal Active Geo-Localization cs.CVPDF

[54] Vision-Language Models for Egocentric Video: From Hand-Object Interaction to Embodied AI cs.CVPDF

[55] DocClaw: A Unified Agentic System for Intelligent Document Processing cs.CVPDF

[56] Composed Historical Image Retrieval by Modeling Temporal Representations cs.CV | cs.AI | cs.IRPDF

[57] Impact of Iterative Fine-Tuning on Transcription Accuracy in Complex Historical Sanskrit Manuscripts cs.CV | cs.AIPDF

[58] CamWorldQA: Perceptual Quality Assessment of Camera-Controlled World Video Generation cs.CVPDF

[59] EgoHRV: Continuous Heart Rate Variability Estimation from Egocentric Systems for Autonomic Response and Skill Assessment cs.CV | eess.SPPDF

[60] CL4D: Contrastive Language-4D Pretraining for Vision-Language Reasoning in Dynamic Scenes cs.CVPDF

[61] EfficientSync: Real-Time Lip Synchronization via Deformation-Based Reference Texture Mixing cs.CVPDF

[62] Falcon Perception-HD: High Density Perception via Reinforcement Learning cs.CVPDF

[63] EVADE: Evidence-Verified Agentic Diagnosis with Escape cs.CVPDF

[64] When Simplicity Wins: Bottleneck-Aware Context Modeling for Lightweight Semantic Segmentation cs.CVPDF

[65] Uncertainty-Aware Art-Historical Dating with Vision-Language Models cs.CVPDF

[66] GrabVG: Graph-Attentive Binding for Visual Grounding in UAV Imagery cs.CV | cs.AIPDF

[67] USR-Drive: Unified Driving Scene Representation via Joint Denoising of 3D Gaussians and Boxes cs.CVPDF

[68] When Two Tracers Disagree: An Investigation of Multimodal Fusion for Clinical PET/CT Segmentation cs.CVPDF

[69] ForeSightGuide: An Anticipatory Framework toward Accurate and Low-Redundancy Guidance for the Visually Impaired cs.CVPDF

[70] ReWEIGH the Evidence: Calibrating Token-Level Ordinal Visual Evidence to Mitigate Hallucinations in Large Vision-Language Models cs.CV | cs.AI | cs.CLPDF

[71] GS-VLA: Plug-and-Play Viewpoint Canonicalization for Frozen VLA Policies via Gaussian Splatting cs.CV | cs.AIPDF

[72] SPK: Eliciting Structured Prior Knowledge for Interpretable Out-of-Distribution Detection in Real-Time Object Detection cs.CV | cs.LGPDF

cs.LG [Back]

[73] Selection, Recombination, or a Fresh Solve? A Candidate-Free Control for Single-Pass Test-Time Aggregation cs.LG | cs.AI | cs.CLPDF

[74] MLREF: Efficient Module Reuse for Reward Design in Reinforcement Learning via Large Language Models cs.LG | cs.AI | cs.CLPDF

[75] Open-MOPD: Diagnosing and Fixing Capability Imbalance in Multi-Teacher On-Policy Distillation cs.LG | cs.AI | cs.CLPDF

[76] Beyond Teacher Likelihood: Group-Calibrated On-Policy Distillation for Long-Context Reasoning cs.LG | cs.AI | cs.CLPDF