cs.CL [Total: 26]
cs.CV [Total: 48]
eess.IV [Total: 1]
cs.AI [Total: 2]
cs.CR [Total: 2]
stat.AP [Total: 1]
cs.SD [Total: 1]
cs.LG [Total: 2]
physics.soc-ph [Total: 1]
cs.IT [Total: 1]
cs.RO [Total: 2]
cs.DC [Total: 1]

cs.CL [Back]

[1] Sledgehammer or Scalpel? A Fine-grained Adaptive Framework for Implicit Hate Speech cs.CL | cs.AIPDF

Han Wang, Yuhu Cheng, Xuesong Wang, Yi Zhu

TL;DR: 本文提出了一种细粒度自适应隐式仇恨言论检测框架FAID，将隐式仇恨言论细分为浅层、目标相关和上下文相关三类，并针对不同类别采用轻量级提示调优、知识增强和代理框架等自适应方法，以优化计算资源分配并提升检测性能。

Details

Motivation: 现有基于PLM或LLM的隐式仇恨言论检测方法通常对所有样本采用单一推理过程，忽视了细粒度的语言差异，并对简单样本造成不必要的计算开销。

Result: 在四个基准数据集上的实验表明，FAID显著优于现有的SOTA基线方法。

Insight: 创新点在于首次对隐式仇恨言论进行细粒度分类，并设计自适应框架针对不同类别采用差异化处理策略，从而在提升检测精度的同时优化计算效率。

Abstract: Unlike explicit attacks with obvious profanity, implicit hate speech hides malice within seemingly compliant expressions through metaphors and contextual hints, making its detection in online content review challenging. While existing PLM- or LLM-based methods perform well, they typically apply a single reasoning process to all samples. This overlooks fine-grained linguistic nuances and causes unnecessary computation for simpler cases. We observe that online hate speech is not monolithic but manifests in varied forms. We therefore define three fine-grained categories: Shallow, Targeted, and Context-Dependent. Accordingly, we propose Fine-grained Adaptive Implicit Hate speech Detection (FAID), a novel framework that first performs fine-grained classification and then adapts to specific categories. Specifically, for Shallow samples with surface-identifiable intents, the framework adopts lightweight prompt-tuning for rapid classification; for Targeted comments that bind malicious intent to concealed targets, we design knowledge augmentation to iteratively refine the model and reveal hidden targets; for Context-Dependent comments lacking background information, we utilize an agentic framework that automatically generates prompts to evolve context, infer missing background information and identify ambiguous malicious intents. This adaptive architecture focuses computational resources on complex implicit samples while avoiding redundant reasoning for shallow samples. Experiments on four benchmark datasets demonstrate that FAID significantly outperforms SOTA baselines.

[2] SciReC: Diagnostic Evaluation of Multimodal, Multi-Turn Relational Reasoning with Adaptive Interaction cs.CL | cs.AI | cs.LGPDF

Nilay Yilmaz, Naga Sai Abhiram Kusumba, Stella Wenxing Liu, Yezhou Yang

TL;DR: 本文提出了SciReC基准和DMRA诊断框架，用于评估多模态大语言模型在关系推理任务上的表现。研究发现Claude 4.6在总体关系推理得分上表现最佳（73%），开源模型在空间关系上表现最差，而闭源模型在层次和顺序关系上更易出错。

Details

Motivation: 为了解决现有基准在评估多模态大语言模型进行多轮、多类别关系推理（如类比、结构、因果等）能力方面的不足，并诊断模型失败的具体原因（如视觉理解、知识展示或记忆召回）。

Result: 在SciReC基准上，Claude 4.6以73%的总体关系得分领先，GPT 5.4为68%；模型在心理学领域表现最佳，天文学领域最差；DMRA诊断显示关系推理错误是主要失败原因，其次是记忆限制。

Insight: 创新点在于构建了模型自适应的多模态学术对话基准（SciReC）和基于缺陷的诊断框架（DMRA），能够量化不同组件（如视觉、知识、记忆）对关系推理错误的贡献，从而更精细地评估模型能力瓶颈。

Abstract: Relational reasoning requires the process of perceptual understanding, comparing, and integrating the underlying relationships between concepts. This ability consists of multiple categories, such as analogical, structural, and cause-effect, each capturing a different aspect of higher-order understanding. To examine the performance of multimodal large language models (MLLM) on these relational inference tasks, we developed SciReC, a model-adaptive multimodal academic dialog benchmark. As the relational reasoning process involves multiple representations and various factors (visual understanding, exhibiting knowledge, and memory recall), we propose DMRA, a deficit-based diagnostic framework that quantifies the contribution of these components to identify the primary cause of unsuccessful cases. Claude 4.6 achieved the best performance on the overall relational score with 73%, followed by GPT 5.4 with 68%. Performance trends indicate that open-source models achieve their lowest scores on spatial relations, while proprietary models struggle more with hierarchical and sequential relations. Across domains, model performance is lowest on Astronomy and highest on Psychology. The results of DMRA reveal that relational reasoning is the primary source of error across all models, followed by memory limitations.

[3] PACE: Publisher-Adaptive Content Extraction via Agentic Automation cs.CL | cs.AIPDF

Zhanlin Liu, Munirathnam Srikanth

TL;DR: PACE是一个通过智能体自动化学习发布者特定内容提取配置的框架。它利用大语言模型分析网页结构并聚合可复用的提取模式，在推理时通过学习的配置实例化一个固定的确定性提取器模板，从而实现无需额外LLM调用的可扩展提取。

Details

Motivation: 现有网络内容提取方法难以同时满足准确性、可扩展性和适应性。通用提取器在发布者特定布局和复杂目标（如元数据、图像、表格）上表现脆弱，而基于LLM的直接提取成本高、延迟大，手动构建的发布者特定解析器则需大量人力维护。

Result: 在文章正文、元数据和多模态提取实验中，PACE优于可扩展的非手动基线方法，并接近手动构建的发布者特定解析器的质量。它在文章文本、元数据、图像和表格提取上表现更强，展示了智能体配置学习能够自动化生成超越文章文本的、适用于LLM的页面表示。

Insight: 创新点在于提出了一种混合方法：利用LLM的灵活性进行离线模式学习，然后部署轻量级确定性提取器以实现高效推理。这通过智能体自动化将发布者特定的知识编码到可扩展的模板中，平衡了准确性、适应性和成本。

Abstract: Web content extraction is essential for reliable LLM data pipelines, yet existing methods often struggle to jointly satisfy accuracy, scalability, and adaptability. General-purpose extractors can be applied broadly, but they are often brittle on publisher-specific layouts and richer extraction targets such as metadata, images, and tables. Direct LLM-based extraction offers greater flexibility, but incurs substantial cost and latency at scale, while manually engineered publisher-specific parsers can achieve high accuracy but require substantial human effort to build and maintain. We introduce PACE, an agentic framework for learning publisher-specific extraction configurations from representative pages and user requirements. During training, PACE uses LLMs to analyze page structure and aggregate reusable extraction patterns. At inference time, the learned configurations instantiate a fixed deterministic extractor template, enabling scalable extraction without additional LLM calls. Experiments spanning article-body, metadata, and multimodal extraction show that PACE outperforms scalable non-manual baselines while approaching the quality of manually engineered publisher-specific parsers. PACE achieves stronger extraction of article text, metadata, images, and tables, demonstrating that agentic configuration learning can automate publisher-specific extraction for LLM-ready page representations beyond article text.

[4] XHotpotQA: A Benchmark for Cross-Lingual Knowledge Composition in Multi-Hop Question Answering cs.CL | cs.AIPDF

Iman Barati, Arash Ghafouri, Behrouz Minaei-Bidgoli

TL;DR: 本文提出了XHotpotQA，一个用于评估跨语言知识组合能力的多跳问答基准数据集。该数据集通过构建证据依赖图，明确控制问题、桥梁证据、答案证据和干扰项的语言分配，以暴露推理链在语言边界上的失败。

Details

Motivation: 现有的多语言基准通常将整个示例翻译成单一语言，这掩盖了推理链在语言边界上的失败。本文旨在创建一个受控的基准，用于评估模型在混合语言证据上进行跨语言知识组合的能力。

Result: 在验证集上，99.81%的实例跨越了问题到黄金证据的语言接口，95.60%使用了不同语言的黄金段落。评估显示，与部分对齐相比，完全的问题-证据语言不匹配导致Unicode感知答案F1下降10.25到15.79点；不同文字的证据导致下降11.98到23.70点。

Insight: 创新点在于设计了角色感知的诊断、模块化评估以及经过审核的测试平台，通过构建明确的证据依赖图和语言分配，系统地暴露和量化跨语言推理中的挑战，特别是语言不匹配和不同文字带来的性能下降。

Abstract: Knowledge-intensive multi-hop question answering requires systems to select evidence and compose dependent facts, yet multilingual benchmarks usually translate an entire example into one language. This hides failures at language boundaries inside the reasoning chain. We introduce XHotpotQA, a controlled benchmark for cross-lingual knowledge composition over mixed-language evidence. Each instance is modeled as an evidence-dependency graph whose question, bridge evidence, answer-bearing evidence, and distractors have explicit language assignments. The audited resource contains 15,661 training and 7,405 validation instances, with sentence-level support supervision and supplied distractors. In validation, 99.81% of items cross the question-to-gold-evidence language interface and 95.60% use gold paragraphs in different languages. Across three reader artifacts, full question-evidence mismatch is associated with 10.25 to 15.79 lower Unicode-aware answer F1 than partial alignment, and different-script evidence with deficits of 11.98 to 23.70 points; the corresponding adapted-selector contrasts are 1.71 and 1.78 points. Under this supplied-candidate design, the evaluated readers therefore show substantially larger condition-associated deficits than the selector. XHotpotQA provides role-aware diagnostics, modular evaluation, and an audited test bed for knowledge-based systems that must integrate evidence across languages.

[5] A Survey on Rubric-Guided Reinforcement Learning for Language Models cs.CL | cs.AIPDF

Zifei Shan, Fangning Shao

TL;DR: 本文是一篇关于基于评分准则的强化学习在语言模型中的应用的综述。论文提出了一个贝叶斯框架，将评分准则视为评估标准的条件实例化，并以此为基础对相关方法进行了分类，涵盖了宪法AI、实例特定准则、过程级监督、自进化准则等方向。

Details

Motivation: 传统基于人类反馈的强化学习（RLHF）依赖缺乏可解释性的标量奖励信号，无法捕捉响应质量的多维特性。本文旨在通过引入结构化、可解释的评分准则来克服这些限制，以改进奖励设计、反馈生成和策略优化。

Result: 作为一篇综述性论文，本文未报告具体的定量实验结果，而是系统性地梳理和分类了现有方法，并分析了评分准则在语言模型对齐中的关键作用与挑战。

Insight: 论文的核心创新在于提出了一个统一的贝叶斯框架来形式化评分准则，并以此构建了分类体系。从客观角度看，其对评分准则的粒度权衡、语义漂移和语言奖励攻击等问题的语言学分析，为未来研究指出了重要的开放性问题。

Abstract: Reinforcement learning from human feedback (RLHF) has become the dominant paradigm for aligning large language models (LLMs) with human preferences. However, traditional RLHF relies on scalar reward signals that lack interpretability and fail to capture the multifaceted nature of response quality. Rubric-guided reinforcement learning addresses these limitations by introducing structured, interpretable evaluation criteria, or rubrics, as the backbone of reward design, feedback generation, and policy optimization. In this survey, we introduce a Bayesian framework that defines constitutions as prior distributions $P(R)$ over evaluation criteria and rubrics as conditional instantiations $R_x \sim P(R|x)$. Under this unified view, we present a taxonomy of rubric-guided RL along the prior-posterior axis, covering constitutional AI, instance-specific rubrics, process-level supervision, self-evolving rubrics, and their agentic and multimodal extensions. Furthermore, as rubrics are natural-language artifacts, we present a linguistic analysis of how granularity trade-offs, semantic drift, and linguistic reward hacking impact alignment reliability, identifying key open problems for future research.

[6] INSPIRE: An Internalize-Then-Improve Approach for Example-Driven Mathematical Reasoning cs.CLPDF

Shuai Wang, Jiayi Kuang, Yinghui Li, Haojing Huang, Xinnian Liang

TL;DR: 本文提出INSPIRE方法，一种’先内化后改进’的示例驱动数学推理框架，通过参考引导的学生内化(RGSI)生成高质量偏好候选，并采用分阶段标准偏好训练策略，将学习分解为面向方法和面向正确性的阶段，以提升大语言模型在数学推理中基于示例进行深度概念理解的能力。

Details

Motivation: 现有大语言模型在数学推理中主要优化最终答案正确性，可能导致模型仅记忆解题模式而非真正内化数学概念；人类数学教育中基于示例的推理（如构造反例测试定理边界）能反映深层理解，但当前模型在此能力上发展不足，且通过偏好优化增强该能力面临模型自身示例推理能力有限导致构建有效偏好对困难、以及能力获取需分阶段（先学习采用策略再学习正确应用）两大挑战。

Result: 在多个模型规模和系列上的实验表明，该方法带来了一致的性能提升，甚至超越了更大的开源模型；在分布外基准测试上的评估证实，该方法不会导致一般数学推理能力下降。

Insight: 创新点在于提出’先内化后改进’的两阶段框架，结合RGSI在策略模型自身分布下生成高质量偏好候选，以及分阶段标准偏好训练策略，将能力获取分解为方法采用和正确应用两个目标，从而系统性地提升模型基于示例的深层推理能力，同时保持泛化性能。

Abstract: Mathematical reasoning has seen rapid progress in large language models (LLMs), yet existing methods optimize predominantly for final-answer correctness, raising the question whether models truly internalize mathematical concepts or merely memorize solution patterns. In human mathematics education, example-based reasoning such as constructing counterexamples to test theorem boundaries reflects deep conceptual understanding, but remains underdeveloped in current LLMs. Enhancing this capability through preference optimization presents two key challenges: (1) the model’s limited example-based reasoning ability makes constructing effective preference pairs inherently difficult; and (2) capability acquisition is progressive, as the model must first learn to adopt this strategy before learning to apply it correctly. Therefore we propose INSPIRE, an Internalize-Then-Improve approach combining Reference-Guided Student Internalization (RGSI), which produces high-quality preference candidates under the policy model’s own distribution, with a stage-wise rubric preference training strategy that decomposes learning into method-oriented and correctness-oriented stages. Experiments across multiple model scales and families demonstrate consistent improvements, even surpassing larger open-source models, while evaluations on out-of-distribution benchmarks confirm no degradation in general mathematical reasoning ability.

[7] When Tokenizers Fail: Byte-Level Chunking for Zero-Shot Transfer to Low-Resource Languages cs.CLPDF

Sanjeev Kumar, Atsuki Yamaguchi, Nikolaos Aletras

TL;DR: 本文提出了一种适应性的分层网络框架，用于解决字节级模型在低资源语言词级任务中的粒度不匹配问题。该方法通过从冻结基础模型的子词表示中初始化字节嵌入，并应用块对齐损失和词性监督来引导边界检测，从而在不进行大量训练的情况下弥合模态差距。

Details

Motivation: 子词分词器将主导语言的频率模式强加于共享脚本的变体语言，阻碍了低资源语言处理；而字节级模型虽然避免了此问题，但在非拉丁脚本的词级任务中产生粒度不匹配。现有分层字节级架构需要大量训练数据，且与冻结的子词语言模型配对时存在表示不对齐。

Result: 在六种语言上的实验表明，该无分词器方法提升了词级形态任务的性能，在词性标注任务上实现了高达13.3%的改进。

Insight: 创新点在于直接从冻结基础模型的子词表示初始化字节嵌入，并引入块对齐损失和轻量级词性监督来引导字节块分组，从而有效弥合字节与子词模态间的差距，无需大量训练即可提升低资源语言处理性能。

Abstract: Subword tokenization hinders low-resource language processing by imposing frequency patterns from dominant languages onto script-sharing variants. Byte-level models bypass this issue by processing raw UTF-8 characters, yet they create a granularity mismatch for word-level tasks in non-Latin scripts. Hierarchical byte-level architectures address this mismatch by grouping bytes into word-aligned chunks. However, these architectures require massive training data and suffer from representational misalignment when paired with frozen subword-based language models. In this paper, we propose an adapted hierarchical network framework that bridges this modality gap without extensive training. Our method initializes byte embeddings directly from the subword representations of a frozen base model. We apply a chunk alignment loss to project dynamically grouped byte chunks toward precomputed subword targets, and interleave lightweight part-of-speech (POS) supervision to guide boundary detection. Experiments across six languages demonstrate that our tokenizer-free approach improves performance for word-level morphological tasks, yielding up to a 13.3% improvement on POS tagging.

[8] Trajectory-Level Speculative Decoding for Diffusion Language Models cs.CL | cs.AIPDF

Tianxiang Pan, Baitao Gong, Mo Guang, Hongwei Yong, Tianpeng Jiang

TL;DR: 本文提出了一种针对扩散语言模型（dLLMs）的轨迹级推测解码框架，通过置信度分层树探索构建草案去噪轨迹，并利用块级并行评估与双向注意力掩码进行验证。该方法进一步引入了块间推测，利用扩散模型的双向结构实现跨块前瞻。实验表明，该方法能减少30-40%的去噪迭代次数，将每步生成令牌数从2.6提升至4.3，在推理和代码基准测试上实现了7-14倍于原始dLLMs的加速，且准确率变化小于1%。

Details

Motivation: 扩散语言模型通过并行令牌生成实现迭代去噪，但现有解码策略在低置信度下会退化为单令牌生成，严重限制了吞吐量。与自回归模型固定从左到右顺序的令牌序列推测不同，dLLMs需要在具有明确位置和去掩码顺序的多令牌更新序列（即去噪轨迹）上进行推测。

Result: 在Fast-dLLM的双缓存基础设施上，该方法将去噪迭代减少30-40%，每步令牌数从2.6提升至4.3，在推理和代码基准测试上实现了7-14倍于原始dLLMs的加速，1.3倍于Fast-dLLM的加速，且准确率变化小于1%。

Insight: 创新点在于提出了轨迹级推测解码框架，通过置信度分层树探索构建草案轨迹，并利用块级并行验证与双向注意力掩码；进一步引入块间推测，利用扩散模型的双向特性进行跨块前瞻。从客观角度看，该方法将推测解码从令牌序列推广到去噪轨迹，并形式化分析了轨迹漂移作为并行性提升的根本成本，为扩散模型的高效解码提供了新思路。

Abstract: Diffusion-based language models (dLLMs) enable parallel token generation through iterative denoising, but existing decoding strategies collapse to single-token generation under low confidence, severely limiting throughput. Unlike autoregressive models where speculative decoding operates on token sequences in a fixed left-to-right order, dLLMs require speculating over denoising trajectories-sequences of multi-token updates with explicit positions and unmasking orders. We develop a trajectory-level speculative framework that constructs draft denoising trajectories via confidence-stratified tree exploration and verifies them through blockwise parallel evaluation with bidirectional attention masking. Our method further introduces inter-block speculation, exploiting diffusion models’ bidirectional structure to perform cross-block lookahead. We formally characterize when this approach is exact and identify trajectory drift as the fundamental cost of increased parallelism. Building on Fast-dLLM’s dual-cache infrastructure, our framework reduces denoising iterations by 30-40% and increases tokens-per-step from 2.6 to 4.3, achieving 7-14x speedup over vanilla dLLMs and 1.3x over Fast-dLLM with less than 1% accuracy change across reasoning and code benchmarks.

[9] Below the Noise Floor: Bimodal Seed Collapse and Distinct Failure Modes in Small-Model Knowledge Distillation cs.CLPDF

Dipto Sumit, Sakib Ul Haque, Farig Sadeque

TL;DR: 本文研究了小型模型知识蒸馏（KD）在API路由任务中的种子方差问题，发现单种子评估会掩盖关键失败模式。通过对8种KD变体进行多种子实验，揭示了双模态崩溃现象、不同KD方法的独特失败模式，以及输入增强在严格测试下可能带来的负面影响。

Details

Motivation: 在API路由等部署场景中，小型学生模型具有吸引力，但现有知识蒸馏研究通常基于单种子报告性能增益，而忽略了种子方差可能掩盖的失败模式。

Result: 在包含740个实例的医疗API路由任务上，使用1.5B Qwen学生模型和20B教师模型进行实验。发现多个KD变体存在高方差或双模态崩溃，其中一些种子准确率低于55%，而另一些训练正常。仅progressive_kd和rank_kd在所有观测种子中避免了崩溃，标准差小于等于3.9个百分点。

Insight: 研究揭示了小型模型KD中未被充分认识的种子方差和双模态崩溃问题，强调了多种子评估的必要性。同时，发现了reasoning_kd中一种新的输出截断失败模式，以及输入增强在严格测试下可能失效的现象，对KD的可靠评估和实践具有重要启示。

Abstract: Function routing – selecting the correct API call from a fixed catalog given a natural-language request – is a deployment problem where small students are attractive but knowledge distillation gains are typically reported single-seed, at scales where seed variance is unknown. On a 740-instance healthcare API routing task with a 1.5B Qwen student and a 20B teacher, we compare eight KD variants against supervised cross-entropy, using three to six seeds for key configurations. We find: (i) per-seed standard deviation ranges from 2.8 to 48.7 percentage points, swallowing every claimed KD gain below five points; (ii) three of seven KD variants exhibit bimodal collapse, with at least one in three to five seeds falling below 55% accuracy while the others train normally, and a fourth showing elevated variance; (iii) collapse has distinct modes – wrong-function selection for ce_kd and ce_paraphrase, and a previously undocumented output-truncation mode for reasoning_kd, where the model emits reasoning but terminates before producing a function name (0.9% accuracy); (iv) only progressive_kd and rank_kd avoid collapse across observed seeds, with sigma <= 3.9 pp; (v) a naive cross-split +3.78 pp gain from input enrichment reverses to -2.70 pp under controlled within-split multi-seed re-testing. Single-seed evaluation is therefore unable to detect central failure modes in small-model KD.

[10] Load-Bearing Context: The Question Damage Score for Evaluating Context Reliance in Linguistic Reasoning cs.CLPDF

Neh Majmudar, Elena Filatova

TL;DR: 本文提出了一种诊断框架，通过删除上下文示例来评估大型语言模型在语言推理中对上下文的依赖程度。利用53个英国语言学奥林匹克谜题，通过随机删除和针对性删除负载上下文示例，引入问题损伤分数来量化模型对上下文的依赖，并发现前沿LLM在关键上下文被移除后仍能产生正确答案。

Details

Motivation: 解决如何确定大型语言模型是从上下文还是先验知识中推导答案的基本挑战，通过自包含的语言学谜题提供受控环境，其中所有答案仅来自专家设计的上下文示例，无需外部知识。

Result: 在三个前沿LLM上评估，指令要求信息不足时弃权，但模型很少弃权，即使在负载上下文被移除后仍经常产生正确答案；使用问题损伤分数将谜题分类为脆弱或鲁棒。

Insight: 创新点包括引入问题损伤分数和针对性删除方法，基于纠错码思想移除结构上负载的上下文示例；从客观角度看，该框架支持对上下文依赖进行细粒度分析，如因果干预、停止集分析和机制可解释性研究。

Abstract: Determining whether large language models derive answers from context or prior knowledge remains a fundamental challenge. Self-contained linguistic olympiad puzzles provide a controlled setting where all answers derive solely from expert-designed context examples without external knowledge. Removing individual context examples can eliminate information needed for specific questions while leaving the rest of the puzzle unchanged. We leverage this to introduce a diagnostic framework for analyzing individual context examples. Using 53 UK Linguistics Olympiad puzzles, we generate two modified variants by deleting a single context example: (1) uniform random deletion, and (2) targeted deletion (inspired by error-correcting codes) to remove a structurally load-bearing example uniquely carrying necessary information. We formalize this impact using a Question Damage Score to classify puzzles as fragile or robust. Evaluating three frontier LLMs under instructions to abstain when information is insufficient, we find they rarely abstain, often continuing to produce correct answers after load-bearing context is removed. These findings motivate further investigation into context-based reasoning, prior knowledge, memorization, and linguistic inference. Beyond abstention, the framework enables fine-grained analyses of context reliance, including causal interventions, stopping-set analysis, targeted contamination studies, and mechanistic interpretability.

Adarsh Sudheer, David Li, Omar Elbanna, Ishaan Kodarapu, Arjun Bahuguna

TL;DR: 本文研究了音频-视觉大语言模型在跨模态冲突下的组合泛化失败问题，即模型在处理语义不兼容但时间同步的视听输入时，倾向于依赖内部先验而非实际证据进行决策。作者在VideoLLaMA 2-7B-AV和InternVideo2等模型上观察到显著的性能下降，并将此失败模式称为’先验主导’。通过机制可解释性分析，发现这种决策承诺集中在模型的后25层左右。

Details

Motivation: 动机是探究音频-视觉大语言模型在面临跨模态语义冲突时的组合推理能力，将其作为模型组合泛化能力的测试基准，以揭示模型是否真正整合多模态证据进行决策。

Result: 在AVHBench的精确字符串Yes/No子集上，VideoLLaMA 2-7B-AV的三种对齐配置在跨模态冲突下表现接近随机水平；商用模型InternVideo2在冲突条件下的准确率下降了32.3%，同时指令遵循失败率增加了17.3%。

Insight: 创新点在于提出了’先验主导’这一失败模式的概念，并通过机制分析定位到决策偏差主要产生于模型深层（约后25层）。研究发现更强的时序对齐仅改变答案偏差，而非提升组合冲突解决能力，这为改进多模态模型的组合推理提供了重要方向。

Abstract: We study audio-visual conflict as a compositional generalization test for AV-LLMs: the model must combine synchronized but semantically incompatible audio and video evidence and decide whether the pair matches. On VideoLLaMA 2-7B-AV, three alignment configurations remain nearchance on the scored exact-string Yes/No subset of AVHBench, even though their output priors shift substantially. Similarly, off-the-shelf InternVideo2 experienced a 32.3% accuracy decrease specifically under cross-modal conflict, accompanied by a 17.3% instruction-following failure. We call this failure mode prior dominance: late-layer commitment to an internally preferred answer pattern that is weakly grounded in the conflicting inputs. To explain this behavior, we conduct a mechanistic interpretability analysis and find that commitment remains concentrated at 25.5 $\pm$ 1 layers. We show that stronger temporal alignment changes answer bias, but do not improve compositional conflict resolution. Code and data to reproduce our mechanistic audit and behavioral evaluations are available at https://github.com/AdarshSudheer09/AVHBench-dmai.

Sixin Chen, Taizhou Chen

TL;DR: 该论文提出了合成语言能动性（SLA）的理论框架，并通过构建一个具身且具有生命期限的智能体（EMA），研究其如何通过社会互动学习语言的使用方式以影响伙伴行为并维持自身生存。

Details

Motivation: 现有语言模型缺乏持续、脆弱且具身的生活体验，无法形成真正的语言能动性。论文旨在探索如何在人工系统中实现体现为具身性、语言参与性和生存脆弱性的语言能动性。

Result: 研究开发了一个基于稳态调节强化学习和生命期限的模型，实验表明EMA的语言选择依赖于其身体状态和社会历史，能改变伙伴行为，并能通过特定伙伴的经验进行适应，从而展现出符合定义的SLA。

Insight: 创新点在于将语言能动性操作化为具身、互动和生存脆弱性的具体标准，并构建了一个将语言选择与生命维持直接关联的强化学习模型，为研究合成共情和人机战略互动提供了新思路。

Abstract: Contemporary language models can converse fluently and influence human decisions, yet their exchanges do not enter a continuing, vulnerable life of their own. Linguistic-agency theory identifies this missing connection as linguistic agency and characterizes it through embodiment, linguistic participation, and precariousness: a body that acts and bears consequences, interaction that changes both agent and partner, and a future that can be sustained or lost. Two coordinated studies examine how this organization can appear in artificial systems. First, we translate these relations into inspectable criteria for Synthetic Linguistic Agency (SLA) and identify several existing SLA systems. Second, building on Homeostatically Regulated Reinforcement Learning, we develop a mortality-grounded linguistic-reinforcement-learning model and instantiate it in an Embodied Mortal Agent (EMA). The EMA learns how ways of speaking change a partner’s willingness to protect it and chooses expressions by considering what those responses mean for its remaining life. Controlled experiments show that linguistic choices depend on the EMA’s body and social history, change partner behavior, and adapt through experience with particular partners. When bodily consequences persist, linguistic choices alter the future of the same life; when the body is reset, their social effects remain but no longer shape continued viability. The resulting EMA exhibits SLA under our operational definition. This work motivates further research on synthetic empathy and strategic human-AI interaction: how artificial agents with persistent bodies, histories, and futures might develop and express empathy, and how people might care for, negotiate with, or govern them.

[13] QUORUM: QUality-Optimized Routing Using Multiple annotators cs.CLPDF

Antonio Purificato, Maria Sofia Bucarelli, Andrea Bacciu, Amin Mantrach, Fabrizio Silvestri

TL;DR: 本文提出了QUORUM框架，这是一个预算感知的路由系统，旨在解决NLP数据标注中高质量与低成本之间的矛盾。它通过基于特征的信号动态评估实例难度，将每个实例分配给人类或LLM标注者，并在固定预算下支持对同一实例进行多次标注，通过基于一致性的奖励机制提高可靠性。

Details

Motivation: 解决大规模获取高质量数据标注的瓶颈问题，特别是LLM标注在复杂实例上可靠性不足，而人工标注成本高昂的矛盾。

Result: 在多种封闭式和开放式英语及多语言标注任务上评估，QUORUM相比竞争方法，将标注质量提升了高达34.4%，同时成本降低了8.8%。

Insight: 创新点在于提出了一个预算感知的动态路由框架，利用基于特征的信号（而非模型置信度）来估计实例难度，并支持基于一致性的多标注者奖励机制，以优化质量-成本权衡。

Abstract: Data annotation remains a central bottleneck in natural language processing, requiring human effort to obtain high-quality labels at scale. While Large Language Models (LLMs) offer a fast and cost-effective alternative, their reliability is highly instance-dependent: they perform well on simple inputs but often fail on examples requiring nuanced reasoning or contextual understanding. In this work, we address this challenge with QUORUM (QUality-Optimized Routing Using Multiple annotators), a budget-aware routing framework that dynamically assigns each instance to human or LLM annotators under a fixed annotation budget. Unlike prior approaches relying on model confidence or uncertainty estimates, QUORUM leverages feature-based signals to estimate instance difficulty and supports multiple annotations per instance, combining them through agreement-based rewards to improve reliability. We evaluate QUORUM across diverse closed- and open-ended annotation tasks in English and multilingual settings, and QUORUM improves annotation quality by up to 34.4% while reducing costs by 8.8% over competing methods. Code can be found at https://github.com/amazon-science/QUORUM.

[14] Twin Worlds: Equivariance-Based Abstention for Evidence-Grounded Reasoning cs.CL | cs.AI | cs.LGPDF

Vy Nguyen, Ziqi Xu, Jeffrey Chan, Estrid He, Feng Xia

TL;DR: 本文提出Twin Worlds（TW）框架，通过基于等变性（equivariance）的弃权机制来提升知识密集型推理的可靠性。该方法通过类型化实体替换构建多个“世界”，检测模型输出是否随实体替换而一致变化，从而判断答案是否基于证据而非参数先验。在四个基准测试和三种模型骨干上，TW能有效识别未可靠基于证据的答案，并优于基于不确定性和证据充分性的基线方法。

Details

Motivation: 解决知识密集型推理中，当证据不足时，大语言模型（LLM）应弃权而非自信生成无证据支持的答案的问题。现有方法依赖不确定性估计或证据充分性检查，但未能测试生成过程的推理是否真正基于证据，特别是实体提及可能激活记忆关联导致生成看似合理但无证据的答案。

Result: 在四个基准测试（未具体命名）和三种模型骨干上，TW在识别答案是否可靠基于所提供证据的任务上，表现优于基于不确定性和证据充分性的基线方法。

Insight: 创新点在于提出基于等变性（而非不变性）的弃权信号：一个基于证据的模型应在保持关系的同时替换实体时，其答案也相应一致地变化。通过构建保持关系结构但减少参数先验的多个“世界”（输入变体），利用等变性违规作为弃权信号，这是一种新颖的可靠性评估方法。

Abstract: Knowledge-intensive reasoning requires Large Language Models (LLMs) to ground answers in provided evidence. When evidence is insufficient, it is desirable that models abstain rather than confidently generating unsupported answers. Existing abstention methods rely on uncertainty estimation or evidence sufficiency checks, but neither tests whether the reasoning process for generation, driven by the interaction of provided evidence and the model’s internal memory parameters, is actually grounded in the evidence. A key contributing factor is that entity mentions in context activate memorised associations, causing models to generate plausible responses ungrounded in evidence. We propose Twin Worlds (TW), a framework for improving reliability in knowledge-intensive reasoning through equivariance-based abstention: unlike invariance, which requires outputs to remain unchanged, equivariance requires outputs to transform correspondingly under entity substitutions. A model grounded in the evidence should produce answers that shift consistently when entities are substituted while their relations are preserved. TW constructs multiple worlds via typed substitutions of the original input that preserve relational structure while reducing parametric priors, and uses equivariance violations as an abstention signal. Across four benchmarks and three model backbones, TW identifies when answers are not reliably grounded in the provided evidence and outperforms uncertainty- and sufficiency-based baselines.

[15] A Shaky Voice Is Not Always a Dodge: Benchmarking Textual and Vocal Evasion Detection in Earnings Calls cs.CL | cs.SDPDF

Mirae Kim, Seonghun Jeong, Youngjun Kwak

TL;DR: 该论文提出了DualEvasion基准，用于在财报电话会议问答中联合检测文本和音频维度的规避行为。该基准包含505个带注释的问答对，每个对都有独立的文本规避和说话者信心（声音线索）标签。研究发现，现有的最先进多模态模型在检测声音信心方面存在困难，尤其是在不自信的回答上，与人类表现存在显著差距。

Details

Motivation: 现有财报电话会议规避检测方法仅关注文本转录，将规避视为单维现象。作者认为，口语交流中的规避本质上是多维的：除了高管说什么，他们怎么说也承载着独立且互补的信息。

Result: 实验表明，最先进的多模态模型在检测声音信心方面表现不佳，尤其对不自信的回答。提供说话者级别的参考信息能带来适度改进，但与人类表现仍存在显著差距。

Insight: 创新点在于将规避检测从纯文本扩展到多模态（文本+音频），并构建了首个联合标注文本规避和声音信心的基准。客观分析认为，其核心洞察是模型需要理解说话者特有的声学基线（相对变化），而非孤立解释声学线索。

Abstract: Existing approaches to evasion detection in earnings calls focus on textual transcripts, treating evasion as a single-dimensional phenomenon. We argue that evasion in spoken communication is inherently multidimensional: beyond what executives say, how they say it carries independent and complementary information. To study these dimensions jointly, we introduce DualEvasion, a benchmark for evasion detection across text and audio in earnings call Q&A. The benchmark contains 505 annotated question-answer pairs from 60 earnings calls, each with two independent labels: textual evasion (direct vs. evasive) and vocal cues operationalized as speaker confidence (confident vs. unconfident). Our experiments show that state-of-the-art multimodal models struggle to detect vocal confidence, particularly on unconfident responses. Our analysis suggests these models interpret acoustic cues in isolation rather than relative to each speaker’s baseline. Providing speaker-level references yields modest improvements, but a substantial gap with human performance remains.

[16] FinExam-10K: When Retrieval Helps Financial Reasoning? cs.CLPDF

Yan Lin, Jingyu Sun, Zhongliang Guo, Qing Li, Zhuohan Xie

TL;DR: 本文介绍了FinExam-10K，一个针对金融专业考试（CFA和FRM）的大规模英文基准测试，包含10,198个专家重新标注的问题。论文评估了17个模型在该基准上的表现，并探索了Function-RAG和FunctionGraph-RAG等检索增强生成方法对提升推理准确性的效果。

Details

Motivation: 现有基准测试未能在一个统一的协议下全面覆盖CFA和FRM考试的结构，缺乏一个综合评估模型在金融领域结合专业知识、计算和判断能力的标准。

Result: 在17个模型中，整体最佳准确率为85.29%。在难度较高的子集上，Full-Coverage Track的最佳得分为34.68%，Context-Complete Reasoning Track的最佳得分为54.57%。使用基于公开数据训练的门控机制，在7.9%的问题上调用FunctionGraph-RAG，将准确率从70.83%提升至71.23%（p = .0446）。

Insight: 论文的创新点在于构建了大规模、结构化的金融推理基准FinExam-10K，并区分了全面覆盖与上下文完整推理两个评估轨道。研究发现，虽然RAG方法能纠正部分错误，但也可能推翻正确答案，导致净增益有限，因此提出了一个轻量级门控机制来选择性调用RAG，以提升效率。

Abstract: Professional financial examinations require models to combine domain knowledge, calculation, and judgment, yet no benchmark covers the full CFA and FRM structure under one protocol. We introduce FinExam-10K, to our knowledge the largest reported English benchmark for this setting, with 10,198 expert-reannotated questions spanning CFA Levels I-III and FRM Parts I-II. We release 5,110 questions and sequester 5,088 for a quarterly maintained leaderboard. To separate coverage from local answerability, we report a 10,198-item Full-Coverage Track and a 7,625-item Context-Complete Reasoning Track, which is the primary basis for claims about reasoning from the supplied record. Across 17 models, the best accuracy is 85.29% overall. On the frozen Hard band, the best score is 34.68% on the Full-Coverage Track and 54.57% on the 372 context-complete items. All 17 models share 47 context-complete failures. Function-RAG and FunctionGraph-RAG rescue hundreds of errors but also overturn many correct answers, producing little or negative net gain. A gate trained only on public data decides from the question and initial response when FunctionGraph-RAG should run. On the 5,088 held-out items, the gate invokes FunctionGraph-RAG for 7.9% of questions and improves accuracy from 70.83% to 71.23% (p = .0446).

[17] Embedding Models for Stance-Aware Argument Retrieval cs.CL | cs.AIPDF

Angelo Sparacino, Francesca Toni, Adam Dejl

TL;DR: 本文研究了在计算论证中，如何利用稠密嵌入模型进行立场感知的论点检索，以同时评估论点与主题的相关性及其对主张的支持或攻击立场。实验发现现有模型存在不对称推理问题，要么偏向主题重叠而忽略立场，要么过度纠正而依赖极性关键词。作者通过引入诊断性词汇消融指标和数据中心的解决方案，结合平衡论证课程和LLM增强的立场反转论点，促使模型学习更深层的方向逻辑而非表面词汇捷径，从而在立场感知论点检索中取得改进。

Details

Motivation: 解决在计算论证中，检索支持或攻击给定主张的论点时，现有语义搜索模型难以同时准确评估主题相关性和立场正确性的问题。

Result: 在立场感知论点检索任务中，通过提出的方法，对于足够强大的模型，可以缓解观察到的过度纠正现象，并实现进一步的性能提升。

Insight: 创新点包括诊断词汇消融指标来量化模型对极性关键词的过度依赖，以及通过平衡论证课程和LLM增强的立场反转数据进行对比训练，以迫使模型学习深层方向逻辑而非词汇捷径。

Abstract: In computational argumentation, obtaining arguments that explicitly support or attack given claims is a critical precursor to downstream reasoning tasks. When these supporting and attacking arguments are to be retrieved using semantic search methods, they need to be assessed for topic-relevance to the claims of interest as well as for correctness of their (positive or negative) stance towards the claims. In this paper we explore how dense embedding models (hereafter, models), powering modern retrieval pipelines, can serve as the basis of semantic search incorporating this dual assessment. We show experimentally that existing models struggle with asymmetric reasoning, exhibiting a strong bias toward topical overlap while ignoring instructional stance. We also show that correcting this bias via contrastive training triggers a new failure mode where models over-correct, over-fixating on polarity keywords (e.g., “supports” or “refutes”) at the expense of the semantic topic. We thus introduce diagnostic word-ablation metrics to quantify this phenomenon and propose a data-centric solution. By implementing a balanced argument curriculum alongside LLM-augmented, stance-inverted arguments, we force the (embedding) models to learn deeper directional logic rather than exploiting superficial lexical shortcuts. Our evaluation demonstrates that, for sufficiently powerful models, this approach can alleviate the observed overcorrection, achieving further improvements in stance-aware argument retrieval.

[18] A Probabilistic Interpretation of KV Cache Eviction cs.CL | cs.AIPDF

Renato Geh, Alex Chen, Daniel Israel, Aditya Grover, Guy Van den Broeck

TL;DR: 本文从概率推理的角度形式化了KV缓存逐出问题，证明了其计算复杂性，并提出了一种基于采样的近似方法。通过概率解释，论文还解决了解码时校正被逐出条目这一先前被忽视的问题，并揭示了现有方法可作为零方差有偏估计器进行改进。

Details

Motivation: 现有KV缓存逐出方法多依赖启发式策略，缺乏形式化定义，且忽略了逐出条目在解码时的校正问题。本文旨在通过概率推理框架正式定义该问题，并探索其理论性质与实用改进。

Result: 在相同压缩预算下，所提出的概率化KV逐出方法结合解码时校正，相比现有方法对不同任务更具鲁棒性，并取得了具有竞争力的性能。

Insight: 创新点在于首次将KV缓存逐出问题形式化为概率估计问题，并引入了可执行解码时校正的框架，揭示了现有启发式方法本质上是零方差有偏估计器，为理论分析和算法改进提供了新视角。

Abstract: The premise and promise of KV (cache) eviction is simple: higher throughput can be achieved by evicting some entries from the KV cache, at a negligible cost to quality. This holds empirically for many existing methods, though most rely on creative heuristics for selecting which entries to drop. Despite recent advances, the problem of KV eviction has remained informal in the literature. This paper aims to properly formalize this problem through the lens of probabilistic reasoning and reveal what can be learned from this perspective. Concretely, we (1) formalize the problem of KV eviction and, unfortunately, prove that it is computationally hard, (2) show that by framing it probabilistically, KV eviction reduces to the problem of expectation estimation, which can be approximated through sampling, (3) show that through this probabilistic interpretation, correcting for evicted entries during decoding—a previously ignored problem—becomes feasible, and (4) reveal that existing methods in the literature are zero-variance biased estimators that can be easily adapted in order to enable decode time correction. In practice, we show that this probabilistic version of KV eviction coupled with decode time correction is more robust to different tasks compared to existing eviction methods and achieves competitive performance at the same compression budget.

[19] A Unified Framework to Elicit Structured Feedback for Interpretable Multi-Trait Essay Scoring cs.CLPDF

Shihang Yang, Sanwoo Lee, Ningning Zhao, Yunfang Wu

TL;DR: 本文提出了HiFTS，一个用于多特质自动作文评分的统一自回归框架。该框架通过从教师大语言模型中提取基于评分标准的层次化思维链反馈，训练学生模型联合生成反馈和分数，并应用组合奖励策略优化。论文还引入了包含34个基于评分标准特质的CFMS-34中文数据集。实验表明，HiFTS在整体和特质层面评分上表现强劲，并能生成连贯、符合评分标准的反馈。

Details

Motivation: 解决现有多特质自动作文评分方法中反馈与评分脱节、特质评估独立进行的问题，旨在增强评分-反馈的一致性与评分标准的对齐。

Result: 在CFMS-34和ASAP++数据集上的实验表明，HiFTS在整体和特质层面评分上取得了强劲的性能，同时能生成连贯且符合评分标准的反馈。

Insight: 创新点在于提出了一个统一的、生成层次化思维链反馈后再进行评分的自回归框架，并通过策略优化平衡多个奖励目标；从教师模型蒸馏反馈知识以及使用轻量级全局先验指导长文本推理以减少漂移的方法具有借鉴意义。

Abstract: Multi-trait Automated Essay Scoring (AES) requires rubric-grounded reasoning across interdependent traits, rather than isolated score prediction. Existing feedback-enhanced methods often decouple feedback from scoring or assess traits independently, weakening score–feedback consistency and rubric alignment. We propose HiFTS, a unified autoregressive framework that generates hierarchical CoT feedback before predicting trait-level and holistic scores. HiFTS distills rubric-grounded hierarchical CoT feedback from a teacher LLM and trains student models to jointly generate feedback and scores. HiFTS further applies Group Relative Policy Optimization with a composite reward balancing score agreement, calibration, feedback quality, and structural validity. At inference, a lightweight global prior provides holistic guidance to reduce drift during long-form reasoning. We also introduce CFMS-34, a Chinese multi-trait AES dataset with 951 essays annotated with holistic scores and 34 rubric-based traits. Experiments on CFMS-34 and ASAP++ show that HiFTS achieves strong holistic and trait-level scoring while producing coherent, rubric-aligned feedback.

[20] Sliding-window beats linear attention cs.CL | cs.LGPDF

Alexia Jolicoeur-Martineau, Rhea Sanjay Sukthanker, Pashmina Cameron, Emy Gervais

TL;DR: 本文比较了滑动窗口注意力（SWA）与线性注意力在大型语言模型中的应用效果，发现SWA在长上下文推理任务中表现显著优于线性注意力模型，且无需后训练、速度快、内存消耗低。

Details

Motivation: 解决LLMs中二次注意力机制导致的内存和能耗问题，探索更高效的替代方案，并评估线性注意力与简单基线（如SWA）的实际性能差异。

Result: 在多个LLM和下游任务中，SWA表现优于或相当于后训练的线性注意力模型，尤其在长上下文推理任务（如Needle-in-a-Haystack和BABILong）上性能提升2到10倍。

Insight: SWA作为一种无需后训练、高效且低内存的解决方案，在长上下文处理中具有显著优势，挑战了线性注意力的现有研究价值，建议优先采用SWA而非后训练线性模型。

Abstract: Due to the nature of quadratic attention, Large Language Models (LLMs) consume a lot of memory and energy. Every new token costs more than the previous one. For each additional token, the keys and values must be stored in memory indefinitely, which is unsustainable. Several alternatives have been proposed to fix the quadratic scaling problem, one of which is retrofitting LLMs to use Linear Attention. This idea has attracted a lot of attention, given its promise to solve the quadratic scaling problem with state-of-the-art performance at low cost. However, this line of research has not been properly compared to simpler baselines. In this work, we show that Sliding Window Attention (SWA) with sinks performs as well or better than post-trained Linear Attention models. We observe this across multiple LLMs on various downstream tasks. For long-context reasoning tasks (Needle-in-a-Haystack and BABILong), SWA achieves massively higher performance (2 to 10 times higher than linear attention). SWA requires no post-training, is extremely fast, and requires low memory; therefore, making it an extremely cheap and reliable solution. To reduce inference memory cost, we strongly recommend switching to SWA instead of post-training linear models. Linear attention models may have shown some promise, but they likely require to be trained from scratch or extensive post-training in order to even match SWA.

[21] Are These Modules Worth Their Cost? A Paradigm-Level Accuracy-Cost Analysis of In-context Learning Text-to-SQL cs.CL | cs.AI | cs.DBPDF

Jiayan Lin, Yujia Liu, Zijin Hong, Zheng Yuan, Yilin Xiao

TL;DR: 本文对上下文学习（ICL）文本到SQL任务中的不同模块进行了全面的准确性与成本分析。通过在一个统一的实现框架下实例化17种范式级配置，并评估它们在四种不同能力水平和推理风格的基础模型上的边际贡献和成本，研究发现执行反馈精炼是唯一在低成本下普遍有效的范式，而其他模块的效益则依赖于基础模型。

Details

Motivation: 现有研究通常只报告文本到SQL系统的端到端聚合准确率，未能量化各个设计选择（如不同模块）的边际准确率-成本贡献，这阻碍了对现代文本到SQL系统的深入理解和优化配置。

Result: 分析表明，执行反馈精炼范式在所有基础模型上均能带来一致的准确性提升且成本较低；大多数其他模块仅在特定基础模型条件下有效；跨模块堆叠在多数模型上能提高准确性，但增益组合方式因模型能力而异；在固定预算下，为中等水平模型设计更精细的流水线通常比升级到前沿模型但使用精简流水线更有效。这些发现被提炼为可操作的、成本感知的分层指导原则，并在五个额外的基础模型上验证了其可迁移性。

Insight: 论文的创新点在于首次在范式层面系统量化了ICL文本到SQL流水线中各个模块的边际准确率-成本贡献，揭示了模块效益对基础模型的依赖性，并提出了基于成本效益的配置指导原则。从客观角度看，其研究范式（统一实现下的模块化成本-精度归因分析）为理解和优化复杂AI系统流水线提供了可借鉴的方法论。

Abstract: Recent advances in in-context learning (ICL) text-to-SQL have substantially improved execution accuracy on public benchmarks by assembling increasingly elaborate pipelines around the base generator, yet existing studies typically report aggregate end-to-end accuracy, without quantifying the marginal accuracy-cost contribution of individual design choices. Consequently, providing a unified, paradigm-level cost-accuracy quantification remains a critical challenge for understanding and configuring modern text-to-SQL. To address this, we instantiate 17 paradigm-level configurations across five recurring modules of the ICL text-to-SQL pipeline under a single controlled implementation, and attribute each paradigm’s marginal contribution and incurred cost across all four backbones spanning diverse capability levels and reasoning styles. Our analysis reveals that execution-feedback refinement is the only paradigm whose benefit holds universally at consistently low cost, while most other modules help only under backbone-dependent conditions. Token accounting shows that input demand is more closely tied to pipeline structure, whereas output demand is more sensitive to backbone generation behavior. Cross-module analysis further shows that stacking improves accuracy on most backbones, although how the gains compose varies with backbone capability. We also find that a fixed budget is often better spent engineering a more elaborate pipeline over a mid-tier backbone than upgrading to a frontier model with a lean pipeline. These findings distill into an actionable, cost-aware tiered guideline that transfers to five additional backbones without per-paradigm search.

[22] Acquire, Repair, Preserve: A Diagnosis-Guided Post-Training Recipe for Small-Model Dialogue Game Agents cs.CL | cs.LGPDF

Nan Li

TL;DR: 本文针对小型对话游戏代理模型，提出了一种诊断引导的后训练方法，包含获取、修复和保留三个步骤。该方法通过监督微调获取广泛游戏参与能力，利用回合局部偏好对修复特定游戏家族中的可验证故障，并保留对话游戏之外的通用能力。在LM Playschool挑战赛中，该方法显著提升了模型在目标游戏家族上的性能，同时基本保持了静态基准测试的总体能力。

Details

Motivation: 静态基准测试未能充分评估模型在交互式对话游戏中的关键能力，如跨回合状态保持、反馈解释和动态约束下的有效行动选择。研究发现，模型失败不仅源于广泛的知识缺失，还包括局部决策失误，如重复猜测、动作格式错误和违反刚收到的反馈。

Result: 在官方最终评估中，该方法将公开clemscore从10.67提升至38.92，闭域内分数从13.41提升至41.17，同时大致保持了聚合静态性能（44.14 vs. 基线44.24）。域外clemscore仍较低（7.88），最大提升集中在目标游戏家族的未见变体上。

Insight: 创新点在于将后训练过程结构化，基于诊断结果分步处理不同问题：广泛监督微调带来主要能力提升；当故障检测精确时，回合局部监督有效，且观察到的主要是家族内迁移。这为针对特定交互缺陷进行高效、靶向的模型优化提供了可借鉴的框架。

Abstract: Interactive dialogue games test a capability that static benchmarks largely leave implicit: a model must carry state across turns, interpret feedback, and choose valid actions under changing constraints. We study this setting in the LM Playschool Challenge with a 2B open-weight model, and find that many failures are not only broad knowledge failures but also local decision failures: repeated guesses, malformed actions, and violations of feedback that the model has just seen. These diagnostics motivate a training recipe organized around three steps: acquire broad game participation through supervised fine-tuning, repair mechanically verifiable failures within one targeted dialogue-game family using turn-local preference pairs, and preserve general capabilities beyond these dialogue games. In the official final evaluation, our submission improves public clemscore from 10.67 to 38.92 and closed in-domain score from 13.41 to 41.17, while approximately preserving aggregate static performance (44.14 vs. 44.24 for the baseline). Out-of-domain clemscore remains low at 7.88, with the largest gains concentrated in unseen variants of the targeted family. Our results suggest that broad SFT brings most of the model’s capability improvement; turn-local supervision can be effective when failure detection is precise, with observed transfer concentrated primarily within-family.

[23] ContextPilot: Teaching Agents for Proactive Context Management via Fine-grained RL cs.CLPDF

Zhuoshi Pan, Qizhi Pei, Junru Lu, Honglin Lin, H. Vicky Zhao

TL;DR: 本文提出了ContextPilot框架，用于解决长程智能体任务中LLM工作上下文持续增长的问题。该框架通过增强工具集（包括规划、长期记忆和软上下文卸载工具）和设计细粒度的强化学习方法，实现了更主动和高效的上下文管理。

Details

Motivation: 现有主动上下文管理方法工具集有限（仅支持搜索、删除和摘要），缺乏全局规划、长期记忆和自适应压缩能力；探索效率低下，对上下文编辑动作处理均匀；以及粗粒度的信用分配问题。

Result: 在长上下文问答和深度搜索任务上的实验表明，ContextPilot在多个基础模型和基准测试中均优于现有基线，能以更紧凑的工作上下文实现更强的性能。

Insight: 创新点在于系统性地扩展了上下文管理工具集，并提出了利用上下文和熵变来识别关键编辑决策以进行分支采样、并通过所有经过相应编辑动作的分支轨迹来估计动作级优势的细粒度RL方法，实现了更高效的探索和信用分配。

Abstract: Long-horizon agentic tasks require large language models (LLMs) to iteratively retrieve, integrate, and maintain dispersed information across multi-turn interactions, but preserving all interaction histories leads to a continuously growing working context. Recent proactive context management methods allow models to edit their own working context with specialized tools, yet they still face three key limitations: (1) a limited toolset restricted to search, deletion, and summarization, with no support for global planning, long-term memory, and adaptive compression; (2) inefficient exploration that treats context management actions uniformly despite their heterogeneous impacts on final outcomes; and (3) coarse-grained credit assignment that assigns the final trajectory-level reward to all intermediate context editing actions during RL. To bridge these gaps, we introduce ContextPilot, a proactive context management framework for long-horizon agentic reasoning. Our approach systematically augments the toolset with planning, long-term memory, and soft context offloading tools. We further propose an RL method tailored for context management, which uses context and entropy variation to identify critical editing decisions for branch sampling and estimates action-level advantages from all branched trajectories that pass through the corresponding context editing action. Experiments on long-context QA and deep search tasks show that ContextPilot achieves stronger performance with a more compact working context, consistently outperforming existing baselines across various base models and benchmarks. Code is available at https://github.com/Tencent/ContextPilot.

Zhuoshi Pan, Junru Lu, Yan Qian, H. Vicky Zhao, Di Yin

TL;DR: 该论文针对大语言模型在长尾分歧知识上的认知局限性，提出了ElephantBench基准测试集，通过基于图的可审计流程从低曝光网络语料中提取存在自然分歧的事实问题，构建了包含1,094个多版本答案的闭卷知识探测任务。实验发现即使最强模型也仅能在52.4%的问题上同时回忆起两种分歧答案，且模型规模扩展和推理时间优化无法完全消除这种认知不完整性。

Details

Motivation: 传统事实问答通常假设单一标准答案，掩盖了LLMs对长尾事实中分歧性知识的记忆能力缺陷，需要系统评估模型在存在多种可信叙述场景下的知识完整性。

Result: 在32个模型测试中，最佳模型仅能同时召回两种分歧答案的问题占比52.4%；语料分析表明曝光不平衡导致模型偏向主流叙述，而增加少数派叙述的曝光度能提升完整回忆率。

Insight: 创新点在于构建了可追溯来源的图基准生成流程，将长尾语料转化为可审计的知识探测工具；揭示了LLMs在分歧知识上存在系统性认知偏差，为评估下一代模型的认知严谨性提供了方法论。

Abstract: Factual question answering (QA) typically assumes a single canonical answer, obscuring whether large language models (LLMs) retain divergent accounts of long-tail facts. To address this gap, we introduce ElephantBench, a closed-book knowledge probe comprising 1,094 questions generated through an auditable graph-based pipeline. The pipeline retrieves related documents from a low-exposure web corpus, identifies naturally occurring disagreements, and converts them into multi-account QA records. Each answer is verified against the originating documents and authoritative public web sources and is then reviewed by human annotators. Across 32 models, even the strongest model recovers both accounts on only 52.4% of questions, while on nearly all remaining questions it recalls one account but omits the other. Scaling model size and inference-time reasoning improve recall but do not eliminate this incompleteness. Corpus analysis further shows that exposure imbalance favors the dominant account, whereas greater minority-side exposure is associated with more complete recall. These findings establish ElephantBench as a reproducible knowledge probe for diagnosing epistemic myopia in parametric memory. More broadly, our graph-based benchmark construction pipeline provides an efficient and scalable way to turn long-tail corpora into source-traceable knowledge probes, supporting efforts to evaluate and advance the epistemic rigour of next-generation LLMs. Code is available at https://github.com/Tencent/ElephantBench.

[25] NL2AGBench: Benchmarking LLM Auto-Formalization for AlphaGeometry cs.CL | cs.AIPDF

Samuel Xiao, Judy Song, Rory Hu, Ziliang Zong

TL;DR: 本文提出了NL2AGBench基准测试，用于评估大语言模型（LLM）将自然语言几何问题自动形式化为AlphaGeometry系统所需领域特定语言（DSL）的能力。该基准通过AlphaGeometry内部的执行验证来评估翻译质量，而非仅依赖文本相似性。实验评估了十个开源和闭源的SOTA模型，揭示了闭源模型（可执行翻译率超80%）与开源模型（难以保持几何约束）之间存在显著性能差距，并分析了错误类型及缓解策略。

Details

Motivation: 尽管AlphaGeometry在几何定理证明上达到接近IMO金牌选手的水平，但其定理证明引擎需要特定DSL的输入，而将自然语言问题手动转换为这种形式化表示是一个主要的可用性瓶颈。LLM在将非形式化数学问题转换为形式化表示方面的能力尚未得到充分探索。

Result: 在NL2AGBench上的评估显示，领先的闭源模型可执行翻译准确率超过80%，而最大的开源模型也难以持续保持几何约束并产生有效的形式化表示。研究还引入了区分语法和逻辑错误的分类法，并探讨了包括少样本提示、微调和人工引导提示在内的缓解策略，这些策略在多个模型系列中都带来了可测量的改进。

Insight: 论文的核心创新点是提出了一个基于执行验证的、面向实际系统（AlphaGeometry）的自动形式化能力基准测试（NL2AGBench），它更关注翻译结果的功能正确性。从客观角度看，其构建的错误分类法以及对不同规模模型和缓解策略的系统性分析，为理解和提升LLM在数学形式化这一特定任务上的能力提供了有价值的见解。

Abstract: Recent advances in large language models (LLMs) have demonstrated strong capabilities in natural language understanding and mathematical reasoning. However, their ability to translate informal mathematical problems into formal representations remains underexplored. This limitation is particularly important for neuro-symbolic geometry systems such as AlphaGeometry, whose theorem-proving engine requires inputs in a specialized domain-specific language (DSL). Although AlphaGeometry achieves near-IMO gold-medalist performance, manually converting natural-language problems into its formal syntax remains a significant usability bottleneck. To address this challenge, we introduce the Natural Language to AlphaGeometry Benchmark (NL2AGBench), which evaluates LLMs in translating English geometry problems into AlphaGeometry-compatible formal representations. NL2AGBench uses execution-based verification within AlphaGeometry to assess translation quality rather than relying solely on textual similarity. We evaluate ten state-of-the-art open- and closed-source LLMs across multiple parameter scales and analyze executable translation accuracy, syntactic correctness, and error characteristics. Our experiments reveal a substantial performance gap between closed- and open-source models: leading closed-source models achieve executable translation rates above 80%, while even the largest open-source models struggle to consistently preserve geometric constraints and produce valid formalizations. We introduce an error taxonomy distinguishing syntax and logic errors and investigate mitigation strategies, including few-shot prompting, fine-tuning, and human-guided hinting, which yield measurable improvements across multiple model families.

[26] A Formal Limitation on Learning Human Language From Textual Corpora cs.CLPDF

Emily Cheng, Ryan Cotterell

TL;DR: 本文从信息论角度探讨了仅从文本语料库学习人类语言的局限性，证明了无论何种文本特征提取器（包括大型语言模型的隐藏状态），都无法仅凭话语形式完全恢复说话者的意图含义。

Details

Motivation: 研究动机是探究听众能否仅从话语形式中准确推断说话者的真实意图，并量化这种恢复能力的理论上限。

Result: 在人工语言、汉语零代词消解和颜色指代任务上的实验为理论提供了实证支持，验证了所推导的上界。

Insight: 创新点在于将语言使用建模为含义、上下文和话语的联合分布，并区分了形式对含义不确定性的可约与不可约部分，揭示了语境在语义恢复中的不可替代作用。

Abstract: Can a listener recover what a speaker means from the form of an utterance alone? We answer this question information-theoretically, and for a listener given by any featurizer of text, including the hidden states of contemporary large language models. Modeling language use as a joint distribution over meanings, contexts, and utterances, we derive upper bounds on the probability that a decoder recovers a speaker’s intended meaning from a representation of the utterance. The bounds are governed by the uncertainty that form leaves about meaning, which splits into an irreducible part and a part that only (extralinguistic) context, but never the utterance alone, can resolve. Because these quantities are intrinsic to language, no representation, however much text or supervision produced it, can surpass them; the bounds hold whether the space of meanings is discrete or continuous. Experiments on artificial languages, Mandarin zero-pronoun resolution, and color reference provide empirical evidence in support of the theory.

cs.CV [Back]

[27] Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction cs.CVPDF

Jiarong Han, Jincheng Xiong, Yuzhou Liu, Linzhe Shi, Changjie Wu

TL;DR: 本文提出ABot-Recon，一种用于极长视频流式3D重建的简单模型。该模型仅缓存前11帧的KV特征，通过预测当前相机坐标系下的点云图及相邻帧相对位姿，并利用序列组合恢复全局位姿与几何，以解决长序列下内存与计算受限的问题。

Details

Motivation: 解决现有流式3D重建模型在长序列中因依赖有限上下文或循环状态而导致估计性能下降的问题，探索一种仅依赖严格局部上下文、预测目标与序列长度无关的新途径。

Result: 在Oxford Spires等挑战性长序列基准测试中，ABot-Recon实现了ATE为4.35米、RPE-R为0.12度的性能，相比先前最佳结果将两项误差均降低了约40%，展现了优越的长时域性能。

Insight: 创新点在于保持学习的时间状态严格局部化，并通过帧间等变性预测及序列组合来避免累积漂移；同时引入轻量级时间细化器和组合感知的位姿损失函数，以提升长期稳定性。

Abstract: Streaming 3D reconstruction from extremely long videos requires estimating camera motion and scene geometry online under bounded memory and computation. Early streaming models achieve causal, bounded-cost inference using finite context buffers or compact recurrent states, yet their estimates often deteriorate as sequences grow. Recent methods improve long-horizon stability by coupling short-range context with persistent or multi-level long-range memory. We pursue a different route: we keep the learned temporal state strictly local and formulate predictions whose targets remain independent of sequence length. We present ABot-Recon, a simple streaming model that caches KV features from only the preceding 11 frames. It predicts a point map in the current camera coordinate system together with an adjacent-frame relative pose. These predictions remain equivariant under changes of reference frame, and global poses and geometry are recovered through sequential composition. To reduce accumulated drift, a lightweight temporal refiner improves relative rotations using recent visual and motion context, while a composition-aware pose loss supervises multi-step pose composition. Extensive evaluations on challenging long-sequence benchmarks demonstrate the superior long-horizon performance of our local-context approach. On Oxford Spires, ABot-Recon achieves an ATE of 4.35 m and an RPE-R of $0.12^\circ$, reducing both errors by approximately 40% relative to the best prior results.

[28] Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoning cs.CVPDF

Hanyang Wang, Yimo Cai, Weiliang Chen, Jiawei Chi, Haowen Sun

TL;DR: 本文提出了Code-as-World范式，通过将物理世界的组成、动态演化和视觉外观表示为可执行代码，来构建可执行的世界表示。为了从多模态观察中构建这种表示，作者开发了一种受溯因推理启发的智能体发现循环。作为一个具体应用，该方法利用已验证的可执行世界为训练视觉语言模型提供可扩展的物理监督。

Details

Motivation: 现代视觉语言模型虽然能识别和解释多样的物理事件，但往往缺乏对底层机制（如物体状态、物理参数和支配动力学）的显式表示，这限制了其进行可靠物理推理的能力。

Result: 实验表明，基于该范式的Code-as-World-VL模型在QuantiPhy基准测试上取得了最先进的性能，并超越了领先的专有模型。

Insight: 核心创新点在于将物理世界抽象为可执行代码，并引入了一个智能体驱动的、迭代的溯因推理循环来发现和验证这些表示。这为物理智能提供了一个可扩展的、可定量验证的基础。

Abstract: Physical understanding and reasoning depend on forming compact and generalizable representations of the world. While modern vision-language models can recognize and explain diverse physical events, they often lack explicit representations of the underlying mechanisms-such as object states, physical parameters, and governing dynamics-needed for reliably reasoning how the world evolves and responds to interventions. In this work, we introduce Code-as-World, a paradigm that represents physical worlds through executable world representations. By expressing physical composition, dynamic evolution, and visual appearance as executable code, Code-as-World provides a compact, quantitatively grounded, and controllable abstraction of the physical world. To construct such representations from multimodal observations, such as natural-language descriptions or real-world videos, we develop an agentic discovery loop inspired by abductive reasoning, where an agent proposes, executes, renders, verifies, and iteratively refines executable world hypotheses. As a concrete application, we use verified executable worlds to provide scalable physical supervision for training vision-language models on quantitative physical reasoning. Experiments show that Code-as-World-VL achieves state-of-the-art performance on QuantiPhy and surpasses leading proprietary models, highlighting the potential of executable world representations as a scalable foundation for physical intelligence.

[29] VidParse: Online Parsing of Egocentric Procedures Like a Pro cs.CVPDF

Anubhav Gupta, Archit Kambhamettu, Vatsal Agarwal, Pulkit Kumar, Abhinav Shrivastava

TL;DR: VidParse是一种无需训练的在线框架，用于将第一人称视角视频流解析为离散有序的动作步骤。该方法通过提取基于操作的锚定特征构建时序相似度矩阵来动态识别语义转换，并利用程序任务图进行束搜索解码以强制执行有效的动作转移。

Details

Motivation: 解决第一人称视频中由于剧烈自我运动、短暂遮挡和未脚本化人-物交互的高类内变异性导致的在线时序模型过度分割和结构崩溃问题，以弥合不稳定低级感知与高级程序逻辑之间的差距。

Result: 在复杂多步骤解析任务中，相比强在线基线方法，VidParse实现了高达10倍的准确率提升，且无需梯度更新。

Insight: 创新点在于将活动理解视为图约束推理问题，利用冻结基础模型提取操作锚定特征构建时序相似度矩阵，并结合程序任务图进行束搜索解码来显式执行动作转移约束，从而在无需训练的情况下实现鲁棒的在线解析。

Abstract: Translating continuous, noisy egocentric video streams into discrete, temporally ordered action steps is fraught with visual challenges. Heavy ego-motion, transient occlusions, and the high intra-class variability of unscripted human-object interactions cause standard frame-level online temporal models to struggle, often resulting in severe over-segmentation and structural collapse. To bridge the gap between unstable low-level perception and high-level procedural logic, we present VidParse, an online, training-free framework that treats activity understanding as a graph-constrained inference problem. Rather than relying on learned temporal filters, we dynamically identify semantic transitions using a temporal similarity matrix over manipulation-anchored features, which are extracted from frozen foundation models to prioritize foreground hand-object interactions. A beam search decoder then leverages an induced procedural task graph to explicitly enforce valid action transitions and prune impossible trajectories. By anchoring robust visual segments to hard procedural constraints, our approach preserves long-range state transitions and achieves up to a 10x improvement in complex multi-step parsing accuracy over strong online baselines, all without requiring a single gradient update.

[30] Quanta Perception as Probabilistic Events cs.CV | cs.AIPDF

Varun Sundar, Pavan Thodima, Sacha Jungerman, Mohit Gupta

TL;DR: 本文提出了一种名为‘概率事件’的计算原语，用于从单个光子检测中实现实时量子感知。该方法通过计算自上次强度变化以来的时间后验概率，将光子流表示为递归信念状态，从而在极端光照条件下（如约0.05勒克斯）实现感知，例如对跑步者的姿态估计。该方法在商用GPU上能以超过50,000量子帧/秒的速度处理输入流，输出达到千赫兹级别，比现有量子重建基线快四个数量级。

Details

Motivation: 自主系统依赖从光中提取信息，但在极端环境（如夜间导航或高速机器人）中表现脆弱。传统传感器在固定曝光时间内聚合光子，导致灵敏度、动态范围和时间分辨率之间存在权衡，在光子稀少或动态快速时感知性能下降。量子传感器可检测单个光子，但其数据流远超实时计算和延迟预算。

Result: 该方法在约0.05勒克斯的极低光照条件下实现了对跑步者的姿态估计，无需重新训练视觉模型。在商用GPU硬件上，它能以超过50,000量子帧/秒的速度处理输入流，产生千赫兹级别的输出，比最先进的量子重建基线快四个数量级，即使对于百万像素阵列也是如此。

Insight: 创新点在于用递归贝叶斯公式将光子流表示为概率信念状态，替代了固定阈值的事件相机触发机制，从而生成运动自适应场景通量、高保真活动图和基于熵的感知不确定性等低延迟信号。该方法通过直接对光子流进行概率推断，而非帧重建，将光子计数量子传感与机器人视觉相结合。

Abstract: Autonomous systems rely on extracting information from light, yet remain brittle in extreme environments, from nighttime navigation to high-speed robotics. Conventional sensors aggregate photons over fixed exposures, imposing trade-offs between sensitivity, dynamic range, and temporal resolution that degrade perception when photons are scarce or dynamics are rapid. Quanta sensors detect individual photons, but their streams exceed real-time compute and latency budgets by orders of magnitude. Here we introduce $\textit{probabilistic events}$, a computational primitive for real-time quanta perception from individual photon detections. By computing the posterior over the time since the last intensity change, we represent photon streams as recursive belief states. Rather than fixed-threshold event-camera triggers, this recursive Bayesian formulation yields three low-latency signals: motion-adaptive scene flux, high-fidelity activity maps, and entropy-based perceptual uncertainty. This representation enables perception in extreme conditions, including pose estimation of a running person at $\sim$0.05 lux—without retraining vision models. Our approach processes input streams exceeding 50{,}000 quanta frames per second on commodity GPU hardware—yielding kilohertz-scale outputs up to four orders of magnitude faster than state-of-the-art quanta reconstruction baselines, even for megapixel arrays. By replacing frame reconstruction with direct probabilistic inference over photon streams, this work bridges photon-counting quanta sensing with robotic vision.

[31] Report Supervision cs.CVPDF

Pedro R. A. S. Bassia, Wenxuan Li, Jakob Wasserthal, Jieneng Chen, Xinze Zhou

TL;DR: 本文提出了一种名为报告监督（R-Super）的训练框架，旨在利用丰富的放射学报告来直接监督和改善肿瘤分割模型。该方法通过设计新的损失函数，使分割模型能够根据报告中描述的肿瘤数量、大小和位置信息来学习分割。实验表明，该方法在肾脏和胰腺肿瘤分割任务上显著提升了检测和分割性能。

Details

Motivation: 解决肿瘤分割模型训练中高质量肿瘤掩码标注稀缺的问题。临床实践中，生成三维肿瘤掩码耗时费力，导致可用标注数据量有限，而放射学报告则数量庞大且易于获取。

Result: 在肾脏和胰腺肿瘤分割的外部验证中，与仅使用掩码训练相比，R-Super将肿瘤检测的F1分数和分割的Dice相似系数（DSC）提升了高达15%。该方法在数据量从极少（如50个掩码）到较多（如3,488个掩码）的各种设置下均优于仅使用掩码训练以及CLIP、多任务学习等替代方法。

Insight: 核心创新点在于利用大规模、易获取的放射学报告文本作为弱监督信号来直接指导分割模型的训练，设计了与报告描述（数量、大小、位置）对齐的损失函数。这为在标注数据稀缺的医学影像分析领域，如何有效利用丰富的非结构化临床文本数据提供了新思路。

Abstract: Segmentation models can surpass radiologists, classification models, and vision-language models in tumor detection. Importantly, segmentation models outline tumors, allowing radiologists to better verify and trust the AI output. Their main limitation is the scarcity of tumor masks: creating one 3D tumor mask takes up to 30 minutes, so most public CT datasets contain only a few hundred masks, and even the largest private datasets contain only a couple of thousand. Tumor masks are not produced in clinical routine, but radiology reports are. Public datasets contain tens of thousands of CT-Report pairs, and hospitals contain hundreds of thousands. These reports describe tumors in detail, providing large-scale, informative training data. Here, we introduce Report Supervision (R-Super), a training framework that uses reports to directly supervise and improve tumor segmentation. R-Super introduces new loss functions that teach segmentation models to segment tumors that match report descriptions of tumor count, sizes, and locations. Reports are only used for training. We evaluated R-Super on kidney and pancreatic tumor segmentation, exploring diverse training data sizes, up to 41,418 CT-Report plus 3,488 pancreatic tumor CT-Mask pairs. On external validation, R-Super increased tumor detection F1-Score and segmentation DSC by up to +15% with respect to mask-only training. It also surpassed alternative methods such as CLIP and multi-task learning. Leveraging numerous readily available reports to supplement scarce masks, R-Super strongly improves AI performance when very few training masks are available (e.g., 50), and when many masks are available (e.g., 3,488), unlocking scale in tumor segmentation.

[32] What Can Low Resource Languages Learn From Each Other? cs.CVPDF

Achyuth P, Kahaan Shah, Chetan Arora

TL;DR: 本文针对低资源语言在光学字符识别（OCR）任务中数据稀缺的问题，提出了一种名为PSMC（预训练、专业化、合并与协同训练）的高效框架。该框架通过利用跨文字脚本的“迁移效应”，将特定语言的专家模型融合为统一的多语言骨干网络，从而在极低数据量（<10K真实图像和<250K合成图像）下提升OCR性能。

Details

Motivation: 尽管视觉语言模型（VLMs）快速发展，但其语言覆盖范围主要局限于高资源语言，导致全球7000多种语言中的大多数面临日益扩大的数字鸿沟。在OCR任务中，低资源文字脚本缺乏传统扩展定律所需的大规模数据集，常规微调策略在极端数据稀缺情况下往往达到性能瓶颈。

Result: 在10种印度文字脚本（支持20多种语言）上的广泛评估表明，PSMC框架在单词识别率（WRR）上比单个专家模型平均提升约2%，且不增加参数量。这表明合并后的潜在空间中的联合训练促进了建设性的知识迁移，使所有组成脚本受益。

Insight: 论文的创新点在于发现语言特定适应中的结构低效性：专业化模型的高层捕捉独特文字细微差别，而低层学习冗余且高度相似的特征。基于此，PSMC通过任务算术融合语言特定专家，实现跨脚本知识共享，为包容性VLM开发提供了可扩展路径。

Abstract: Despite the rapid advancement of Vision-Language Models (VLMs), their linguistic reach remains largely confined to high-resource languages, leaving the majority of the world’s 7,000+ living languages on the wrong side of a growing digital divide. This disparity is especially pronounced in Optical Character Recognition (OCR), where low-resource scripts lack the massive datasets required for traditional scaling laws. We investigate OCR adaptation in extreme data-scarce regimes (<10K real and <250K synthetic images), demonstrating that conventional fine-tuning strategies often reach a performance ceiling. Our key finding reveals a structural inefficiency in language-specific adaptation: while higher layers of specialized models diverge to capture unique script nuances, the lower layers learn redundant, highly similar features. Motivated by this observation, we propose PSMC (Pre-train, Specialize, Merge, and Co-train), a data-efficient framework that capitalizes on a cross-script “transfer effect”. Our approach first derives language-specific experts from a high-resource base model, then employs task arithmetic to fuse these experts into a unified, high-performance multilingual back- bone. Extensive evaluation across 10 Indian scripts (supporting 20+ languages) shows that PSMC achieves a ~2% average improvement in Word Recognition Rate (WRR) over individual specialist models without increasing parameter count. Our results indicate that joint training in the merged latent space facilitates a constructive knowledge transfer that benefits all constituent scripts, providing a scalable pathway for inclusive VLM development. Source code and datasets will be released post publication.

[33] uScenes: A Multimodal RGB and 3D Sonar Dataset for Underwater Robot Perception cs.CVPDF

Trung Tien Dong, Zhenqi Wu, Aditya Penumarti, Zi-Hao Zhang, Micaiah Bartlett

TL;DR: 本文介绍了uScenes，一个用于水下机器人感知的多模态数据集，包含同步的3D多波束声纳点云和RGB图像。该数据集包含110个场景和95,834个同步观测，总计277.6分钟的数据，旨在为水下传感器融合、跨模态表示学习和3D场景理解提供基础。

Details

Motivation: 水下自主机器人需要鲁棒的感知，但光学相机在光照差和背散射条件下不可靠，而传统2D声纳传感器无法解析高程，导致3D空间定位模糊，阻碍了3D场景理解和精确目标检测。

Result: 论文提出了uScenes数据集，包含大量同步的3D声纳点云和RGB图像，为相关研究提供了基准，但摘要中未提及具体的定量实验结果或与现有方法的比较。

Insight: 创新点在于首次提供了大规模、同步的3D多波束声纳与RGB图像的多模态水下数据集，解决了水下感知中传感器数据融合和3D场景理解的瓶颈问题，为跨模态学习提供了重要资源。

Abstract: Robust perception is essential for the deployment of autonomous underwater robots. However, optical cameras become unreliable under poor illumination and backscatter. Forward looking (2D) acoustic sensors remain effective under these conditions, but they measure range and bearing while leaving elevation unresolved, creating an ambiguity that prevents individual sonar returns from being localized in three dimensional (3D) space. This complicates the sensor use for 3D scene understanding and precise object detection. We introduce \textbf{uScenes}, a multimodal underwater dataset containing synchronized 3D multibeam sonar point clouds and RGB imagery. The dataset contains 110 scenes and 95,834 synchronized observation, representing 277.6 minutes of data collected across multiple field sessions. uScenes establishes a foundation for underwater sensor fusion, cross modal representation learning and 3D scene understanding. Code and datasets are given at https://github.com/era-research-lab/uScenes.

[34] From Perspective to Fisheye Depth Estimation and Open-Vocabulary Segmentation cs.CV | cs.AIPDF

Rit Gangopadhyay, Alex Wong

TL;DR: 该论文提出了一种名为Distortion Extenders (DEX)的方法，旨在将基于透视图像训练的视觉基础模型（如深度估计和开放词汇分割模型）泛化到存在径向畸变的鱼眼图像上。DEX通过一组可学习的参数来建模鱼眼畸变系数和潜在空间中的分布偏移，并通过自监督对齐损失将鱼眼图像的潜在嵌入转换为类似透视图像的嵌入，从而恢复高保真度的估计。该方法与架构和任务无关，在室内外鱼眼数据集上均能持续提升基线模型的性能，其激活还可用于解码畸变系数以支持相机标定。

Details

Motivation: 动机在于解决视觉基础模型（在大型透视图像数据集上训练）直接应用于广角鱼眼图像时，由于图像像素的径向畸变导致的协变量偏移和错误输出问题。

Result: 在基于卷积和Transformer架构的单目深度估计和开放词汇分割任务上，DEX方法在室内和室外的鱼眼数据集上均一致地超越了基线模型，展现了其有效性。

Insight: 核心创新点在于提出了架构和任务无关的DEX模块，它通过自监督学习在潜在空间中对齐鱼眼与透视图像的分布，从而无需重新训练即可适配基础模型。此外，DEX还能作为副产品输出畸变系数，辅助相机标定。

Abstract: Vision foundation models are capable of generalizing across 3-dimensional (3D) scenes with high-fidelity estimates; their empirical success can be attributed to training on large-scale datasets of perspective images. However, when transferred to wide field-of-view (FoV) images, such as those captured by fisheye cameras, they return erroneous outputs due to a covariate shift stemming from the radial distortion on the image pixels. We propose a method to generalize vision foundation models to fisheye cameras. The crux of our method lies in a set of learnable parameters, termed Distortion Extenders (DEX), that model the fisheye distortion coefficients and the distributional shift between fisheye and perspective images encoded in the latent space. By minimizing a self-supervised alignment loss, DEX transforms the latent embeddings of fisheye images to resemble those of perspective images to recover high-fidelity estimates. DEX is architecture- and task-agnostic: We demonstrate DEX on monocular depth estimation and open-vocabulary segmentation for convolution- and Transformer-based architectures, where we consistently improve over baselines across indoor and outdoor fisheye datasets. As a byproduct, the activations of DEX can also be decoded to distortion coefficients to support camera calibration. Code available at: https://github.com/Suchisrit/DEX.

[35] Iron: Intent-Aligned and Retrospective Dual Learning Framework for Enhancing Generalist Virtual Agents cs.CVPDF

Jiahe Ying, Wendong Bu, Kaihang Pan, Bingchen Miao, Siyu Chen

TL;DR: 本文提出了Iron框架，一个用于训练通用GUI智能体的意图对齐、自我改进且标注高效的框架。它通过一种新颖的双重学习策略，利用逐步循环一致奖励来实现低级操作与高级意图的细粒度对齐，并引入事后重现机制来重用失败轨迹进行训练。实验表明，Iron训练的智能体在跨环境和跨设备任务上性能持续提升，优于使用三倍数据训练的模型，并在未见过的网页任务上实现了25.06%的相对改进。

Details

Motivation: 解决在多模态大语言模型代理部署中面临的三大挑战：数据标注成本高、操作与意图对齐不精确、以及从被丢弃的失败轨迹中探索效率低下。

Result: 在跨环境和跨设备任务上，Iron训练的通用智能体性能持续提升，优于使用三倍数据训练的模型。在未见过的网页任务上实现了25.06%的相对改进，在固有复杂任务上观察到进一步的增益。

Insight: 创新点在于提出了结合逐步循环一致奖励的双重学习策略以实现细粒度意图对齐，以及事后重现机制以高效利用失败轨迹。这为构建更强大的虚拟智能体提供了一种标注高效且能自我改进的可行路径。

Abstract: Achieving virtual agents capable of automating tasks across diverse digital environments remains a pivotal challenge in Embodied AI. While Multimodal Large Language Models (MLLMs) offer enhanced visual perception and reasoning, their agentic deployment faces three challenges: costly data annotation, imprecise action-intent alignment, and inefficient exploration from discarded failed trajectories. To address these, we introduce Iron, an intent-aligned, self-improved, and annotation-efficient framework for training GUI agents. Iron employs a novel dual learning strategy that utilizes a stepwise cycle-consistent (SCC) reward to achieve fine-grained alignment between low-level actions and high-level intents, thereby improving instruction grounding and intent understanding. Concurrently, Iron introduces a hindsight reproduction mechanism to repurpose failed trajectories for training, improving both learning efficiency and task diversity. Extensive experiments demonstrate that Iron-trained generalist agents consistently improve performance on cross-environment and cross-device tasks, outperforming models trained with three times more data. Iron also achieves a substantial 25.06% relative improvement on unseen web tasks, with further gains observed on inherently complex tasks, demonstrating the feasibility of building more capable virtual agents.

[36] Relational Knowledge Distillation Brings DNN Representations Close Enough to Humans to Be Aligned Without Supervision cs.CV | q-bio.NCPDF

Yuria Shimizu, Soh Takahashi, Takato Horii, Masafumi Oizumi

TL;DR: 该论文提出，通过关系知识蒸馏（RKD）方法将人类表征的关系结构迁移到深度神经网络中，可以显著提升DNN与人类心理表征的相似性。研究采用无监督的Gromov-Wasserstein最优传输方法评估细粒度对齐，并在独立测试集上验证了泛化能力，发现RKD使预训练DNN的全局结构更接近人类，从而实现个体对象级别的无监督对齐。

Details

Motivation: 现有深度神经网络的内部表征与人类心理表征仍存在差距，而人类表征通常通过大规模图像相似性判断来间接测量。研究旨在通过关系知识蒸馏直接迁移人类表征的关系结构，以缩小这一差距，并评估其在细粒度对齐和泛化能力上的有效性。

Result: 在独立于训练数据的测试集上，经过RKD微调的预训练DNN与人类表征在个体对象级别实现了无监督对齐，其全局距离结构（如粗类别间距离排序）更接近人类，但局部最近邻重叠率变化不大。

Insight: 创新点在于使用无监督的Gromov-Wasserstein最优传输方法评估细粒度对齐，并证明关系知识蒸馏能有效迁移人类表征的全局结构，使DNN表征更接近人类心理表征，为构建人类视觉计算模型提供了新思路。

Abstract: Linking the internal representations of deep neural networks (DNNs) to human mental representations is important for using DNNs as computational models of human vision. Existing DNN representations remain insufficiently similar to human mental representations, which are not directly observable and are therefore commonly measured through large-scale similarity judgments of object images. A natural approach to narrowing this gap is to directly transfer the relational structure of human representations into DNNs, and previous studies have reported improved human-DNN representational similarity. However, whether this improvement holds under stricter evaluation remains untested in two respects: fine-grained alignment at the individual-object level, and generalization to a human embedding derived from a dataset independent of the training data. Here, we employ an unsupervised comparison method, Gromov-Wasserstein optimal transport (GWOT), which estimates human-DNN correspondences from the internal distance structure alone and thereby tests fine-grained alignment. We further assess generalization on a curated test set of concepts non-overlapping with the training data. We show that fine-tuning pre-trained DNNs with Relational Knowledge Distillation (RKD), an established relational transfer method, brings DNNs close enough to humans to be aligned at the individual-object level on this test set. We also show that this improvement is driven by a more human-like global structure, as reflected in the ordering of distances among coarse categories, while the local human-DNN nearest-neighbor overlap rate remains largely unchanged. These findings indicate that relational transfer from humans brings the global structure of pre-trained DNNs close enough to the human structure to enable fine-grained human-DNN alignment without supervision.

[37] Temporal Tree of Thought: Reasoning-Guided Visual Cue Search for Long-Video Understanding cs.CVPDF

Ziling Huang, Shin’ichi Satoh

TL;DR: 本文提出了Temporal Tree of Thought (T^3)，一个无需训练、从粗到细的自适应长视频理解框架。该方法通过递归时间约束聚类构建一个与问题无关的层次化时间树，每个节点代表一个包含关键帧的连续片段。在推理时，T^3执行一个“答案-检索-探索”循环：先在粗粒度代表性帧上进行推理，当证据不足时生成搜索指令，并扩展相关分支以获取更细粒度的视觉证据，从而自适应地将搜索目标从时间区域转移到具体对象和细节。

Details

Motivation: 解决多模态大语言模型（MLLMs）在长视频理解中因上下文长度有限而面临的挑战。均匀采样可能错过关键瞬间，而基于智能体的帧级理解方法通常独立评估各帧，忽略了视频的时间组织结构。理想的方法应模仿人类回答长视频问题的过程：先从全局上下文定位相关片段，再聚焦到局部对象和细节。

Result: 在VideoMME、LongVideoBench和LVBench基准测试上，在相同帧数预算下，T^3将Qwen2.5-VL-7B模型的性能分别提升了0.5%、4.6%和4.4%，证明了结构化时间推理的有效性。

Insight: 创新点在于提出了一个无需训练的层次化时间树结构，并通过“答案-检索-探索”循环实现了自适应、由粗到细的证据搜索机制。该方法的核心借鉴了人类认知过程，将时间推理与视觉线索搜索相结合，有效组织了长视频的时序信息，避免了均匀采样或独立帧分析的局限性。

Abstract: Long-video understanding remains challenging for Multimodal Large Language Models (MLLMs) due to limited context length. Uniform sampling may miss crucial moments, while agent-based frame video understanding methods often evaluate frames independently, overlooking the temporal organization of videos. Ideally, evidence selection should mimic how humans answer questions about long videos: first locating the relevant segment from the global context, then zooming into local objects and details. We propose Temporal Tree of Thought T^3, a training-free framework for adaptive coarse-to-fine long-video understanding. T^3 constructs a question-agnostic hierarchical temporal tree via recursive temporally constrained clustering, where each node represents a contiguous segment with an informative key frame. During inference, T^3 performs an answer-retrieve-explore loop: it reasons over coarse representative frames, generates a search statement when evidence is insufficient, and expands relevant branches for finer-grained evidence. This process adaptively shifts the search target from temporal regions to specific objects and visual details to help video understanding. Experiments on VideoMME, LongVideoBench, and LVBench show that T^3 improves Qwen2.5-VL-7B by 0.5%, 4.6%, and 4.4%, respectively, under the same frame budget, demonstrating the effectiveness of structured temporal reasoning.

[38] What Do Interaction Representations Actually Measure? Pre-Event Separability in Weakly-Supervised Violence Detection cs.CV | cs.LGPDF

Parishruthi Ganesh

TL;DR: 该论文研究了在弱监督暴力检测任务中，不同交互表示（包括粗略边界框几何、人体姿态及其丰富描述符、以及从原始关节点学习的编码器）的实际判别能力。通过固定下游处理流程并进行视频级评估，发现姿态表示并未超越粗略几何表示。进一步扩展到使用冻结视觉编码器并在更大数据集（XD-Violence）上测试，发现人物裁剪外观和全帧上下文均显著优于几何表示，且全帧上下文与裁剪外观表现相当甚至更好。论文还通过仅使用标注起始点前的帧进行测试，揭示了基准测试中事件证据与事件前源线索（如标题卡和水印）的混杂，表明视频级AUC是两者的复合指标，这可能掩盖了不同表示之间的真实差异。

Details

Motivation: 研究动机是探究在固定下游处理流程的早期暴力检测任务中，详细的人体姿态信息是否比粗略的空间几何关系提供更强的判别信息，并深入分析现有基准测试实际测量的是什么。

Result: 在UCF-Crime数据集上，没有任何基于姿态的表示优于粗略的边界框几何表示。在XD-Violence数据集（包含137个异常视频）上，使用冻结视觉编码器时，人物裁剪外观和全帧上下文表示均大幅超越几何表示，且全帧上下文在更大数据分割上表现优于裁剪外观。通过仅使用事件起始点前的帧进行诊断测试，在两个基准上均保留了39-91%的超出随机水平的分离能力，揭示了基准测试中混杂了事件前源线索。

Insight: 论文的创新点在于通过严格控制变量比较了多种交互表示，并提出了一个诊断性测试方法，仅利用现有标注即可揭示基准测试可能受到与事件无关的源线索（如编辑痕迹）污染，从而混淆了对不同表示真实判别能力的评估。这提示了在弱监督视频异常检测中，需要谨慎解读基准结果，并考虑数据集的构建偏差。

Abstract: Articulated human pose provides detailed body-configuration information beyond coarse spatial relationships, but whether this detail yields greater discriminative information when the downstream pipeline is held fixed remains unclear. We examine this through early violence detection. Holding the tracker, temporal head, supervision, folds, and evaluation fixed, we compare five interaction representations spanning coarse bounding-box geometry, a matched handcrafted pose analogue, enriched pose descriptors, and a matched-capacity encoder learned from raw joints, under video-level evaluation with cluster-bootstrap intervals. No pose-based representation outperforms coarse geometry, though with fifteen anomalous videos this subset cannot rule out small effects. Extending the pipeline to frozen visual encoders, and repeating the comparison on XD-Violence (137 anomalous videos, nine times our UCF-Crime sample), person-crop appearance and whole-frame context both exceed geometry by a wide margin, yet context matches appearance on UCF-Crime and exceeds it on the larger split: cropping to the interacting people yields no advantage over encoding the whole frame. This prompts a direct test of what the benchmark measures. Scoring anomalous videos using only frames preceding the annotated onset, under a control removing sequence length as a cue, retains 39-91% of above-chance separation on both benchmarks, including for seven hand-designed geometric channels. Inspection of the tightest pre-onset windows identifies concrete provenance artifacts: editorial title cards and platform watermarks absent from the surveillance footage supplying the normal class. Video-level AUC here is thus a composite of event evidence and pre-event source cues, a shared source of discrimination that can obscure differences between representations. The diagnostic requires only annotations these benchmarks already ship.

[39] StreamEMS: Streaming Video Understanding with Self-Evolving Memory Scheme for Vision-Language Models cs.CVPDF

Yuxin Liu, Peiqin Zhuang, Yali Wang

TL;DR: 本文提出StreamEMS，一种通过自演化内存方案增强流式视频理解的方法。该方法通过语义演化模块和先验信息演化模块，优化内存中历史数据的表示能力，从而提升视觉语言模型在流式视频理解任务中的性能。

Details

Motivation: 现有流式视频理解方法主要关注内存的读写操作，而忽略了提升内存本身表示能力的机会。本文旨在通过自演化内存方案，增强内存的表示信息密度和鲁棒性，以更好地支持流式视频理解。

Result: 在OVO-Bench和StreamingBench等流式视频理解数据集上的实验表明，该方法优于其他方法，尤其在token使用率下降率较高的设置下优势更明显，证明了其有效性和鲁棒性。

Insight: 创新点在于提出了自演化内存方案，通过语义演化模块（从粗到细的语义尺度收缩）和先验信息演化模块（利用先验分布优化内存状态），增强了内存的表示能力，为流式视频理解中的内存优化提供了新思路。

Abstract: Recently, many streaming video understanding methods have been proposed by constructing an external memory to store historical data for computational reduction. Most methods focus on optimizing the injection procedure of current data (write) and retrieving informative historical data (read) from memory, while overlooking the opportunity to further enhancing the representational capability of memory itself. In this work, we present StreamEMS, a general mechanism for improving streaming video understanding by re-structuring the historical data stored in memory through self-evolving memory scheme, enabling more informative and robust memory representations. Specifically, we first introduce a Semantic Evolution Module to evolve the memory into more information-dense representations by exploiting informative memory entities discovered via progressively shrinking semantic scales from coarse to fine. In addition, we further introduce a Prior-informed Evolution Module to evolve memory into more robust representations by leveraging prior memory distributions to refine the current memory state. We validate the effectiveness of our proposed designs on widely-used streaming video understanding datasets, i.e., OVO-Bench and StreamingBench, and the results showcase that our method performs better than other methods. Moreover, the advantage of our method becomes consistently evident even under high token usage drop rate settings, indicating the effectiveness and robustness of our method in unleashing the potential of the memory itself.

[40] CommerceVibe: Learning to Design E-Commerce Creatives as Executable Visual Code via Dual-Feedback Reinforcement Learning cs.CVPDF

Yajiao Xu, Jin Zhang, Jiangbo Ai, Tao Jiang, Mo Xu

TL;DR: CommerceVibe是一个将电商创意设计转化为可执行视觉代码（HTML/CSS程序）的系统。它通过双反馈强化学习，结合基于规则的反馈和视觉语言模型的反馈，来生成可渲染、可编辑、可复用的高质量创意。

Details

Motivation: 解决扩散模型生成电商创意时存在的文本扭曲、产品细节不一致、缺乏明确结构导致难以编辑和复用，以及复杂设计需求难以编码为可验证训练信号的问题。

Result: 在包含1300个案例的基准测试中，经过双反馈强化学习优化的CommerceVibe模型获得了94.0/100的加权分数，优于仅进行监督微调的变体（87.3分）和其他外部模型，并得到了五位电商设计专家的盲评验证。

Insight: 核心创新在于将创意设计建模为条件性HTML/CSS程序合成，并引入结合规则（评估文本可读性、产品可见性、布局有效性）与视觉感知（通过VLM评估六个维度的感知和商业指标）的双反馈强化学习机制，以同时提升约束满足度和感知质量。

Abstract: High-quality e-commerce creatives are essential for presenting products and conveying marketing messages. Recent diffusion models enable scalable creative generation and produce visually compelling images, but their flattened raster outputs often contain distorted text and inconsistent product details, requiring refinement before deployment. Moreover, without explicit structure, the resulting creatives are difficult to edit and reuse, while complex design requirements remain challenging to encode as verifiable training signals. To address these challenges, we present CommerceVibe, which represents creatives as executable visual code and formulates generation as conditional HTML/CSS program synthesis. Given product images, design requirements, and product information, it produces renderable, editable, and reusable creatives. We further introduce dual-feedback reinforcement learning, in which rule-based feedback evaluates rendered programs for text readability, product visibility, and layout validity, while visual feedback from a vision-language model (VLM) assesses rendered creatives against input specifications across six perceptual and commercial dimensions. Together, these complementary feedback signals improve both constraint satisfaction and perception-dependent quality. We perform supervised fine-tuning (SFT) of Qwen3.5-9B on over 28,000 e-commerce examples, followed by dual-feedback reinforcement learning. On a 1,300-case benchmark, the optimized CommerceVibe model achieves a weighted score of 94.0/100, compared with 87.3 for the SFT-only variant, and outperforms strong external models. Blind evaluations by five e-commerce design experts further validate these improvements. CommerceVibe supports controllable, editable, and scalable e-commerce creative production.

[41] DensityKV: Density-Guided KV Cache Compression for Long Video Generation cs.CVPDF

Wenqu Zhao, Xuemin Chi, Xin Zhang, Guoqing Ma, Baorun Li

TL;DR: 本文提出DensityKV，一种无需训练的历史KV缓存压缩策略，用于解决自回归视频扩散模型在长序列生成中因历史状态不断累积而导致的存储冗余和一致性退化问题。该方法通过基于Soft-Riesz密度度量键向量的局部冗余度，动态管理每个注意力头的KV缓存，在限制存储容量的同时保持生成长视频的时序一致性。

Details

Motivation: 自回归视频扩散模型采用滑动窗口注意力进行流式生成，但历史关键值（KV）缓存会随生成过程持续增长，导致存储开销增加和冗余状态积累，进而引发外观和运动误差的递归传播，影响长视频生成的一致性。

Result: 在三种自回归视频生成骨干模型和多种生成长度上的实验表明，在相同历史KV容量上限下，DensityKV能够提升长时序一致性和生成稳定性，同时使持久历史存储与生成长度无关。

Insight: 创新点在于引入基于Soft-Riesz密度的无监督冗余度量来指导KV缓存压缩，实现训练自适应的历史状态管理；从客观角度看，该方法将密度估计与注意力机制结合，为动态缓存压缩提供了可解释的几何依据，且无需额外训练，易于部署到现有模型中。

Abstract: Autoregressive video diffusion models enable streaming generation through sliding-window attention, but each generated block is conditioned on previously generated content, causing appearance and motion errors to propagate recursively over time. Historical key-value (KV) memory preserves earlier subject and scene states and helps maintain long-horizon consistency. However, retaining every generated state creates a historical archive that grows continuously with the rollout, while recurrent states repeatedly add redundant coverage. To address this problem, we propose DensityKV, a training-free historical KV bank management strategy. DensityKV maintains a separate token-level KV bank for each attention head and measures local redundancy among the post-RoPE keys that directly parameterize attention routing using Soft-Riesz density. By constraining neighborhood-density growth after states enter the bank, DensityKV limits repeated historical accumulation while preserving coherent states from each completed generation block. Experiments across three autoregressive video generation backbones and multiple generation lengths show that, at the same upper bound on historical KV capacity, DensityKV improves long-horizon consistency and generation stability while keeping persistent historical storage bounded independently of rollout length.

[42] Training-Free Temporal Abstraction for General Video Understanding cs.CVPDF

Etienne Casanova, Sevan Brodjian, Pietro Perona

TL;DR: 本文提出了一种名为STITCH的无训练方法，用于将视频分割成语义上有意义的时间块，以支持多种视频理解任务，如通用事件边界检测、基于语言的时刻检索以及长视频VLM推理的帧选择。该方法利用预训练的视频-文本模型嵌入短视频窗口，并通过检测嵌入序列的变化来划分视频，无需针对特定任务进行训练。

Details

Motivation: 视频逐帧分析成本高昂，而许多视频理解任务需要定位相关时刻，现有方法通常针对特定任务使用专门训练数据或架构，本文旨在探索预训练视频-文本模型是否能提供足够的时间结构来同时支持多个任务。

Result: 在通用事件边界检测、基于语言的时刻检索和长视频VLM推理的帧选择三个任务上，STITCH与更专门的方法保持竞争力，尤其在只能处理少量帧或标记时表现出明显优势，无需任务特定训练。

Insight: 创新点在于提出了一种可重用的时间抽象方法，通过无训练方式将密集视频流转换为语义单元，供下游系统定位、检索、采样或推理，这为通用视频理解提供了新方向，强调了预训练模型在跨任务时间结构提取中的潜力。

Abstract: Videos are expensive to analyze frame by frame, yet many video understanding tasks depend on knowing where relevant moments occur. A system may need to find when an action changes, locate the segment described by a sentence, or choose a few frames for a vision-language model. Existing methods often solve these problems separately, using task-specific training data or specialized architectures. We study whether a pretrained video-text model can provide enough temporal structure to support several of these tasks at once. We present STITCH, a training-free method that divides a video into semantically meaningful temporal chunks. STITCH embeds short video windows with a frozen video-text backbone and detects changes in the resulting embedding sequence. These chunks are computed once per video and reused across tasks. We evaluate STITCH on generic event boundary detection, language-based moment retrieval, and frame selection for long-video VLM reasoning. Across all three settings, STITCH remains competitive with more specialized methods while requiring no task-specific training, with especially clear gains when only a small number of frames or tokens can be processed. These results suggest that reusable temporal abstraction is a promising direction for general video understanding, allowing dense video streams to be converted once into semantic units that can be localized, retrieved, sampled, or reasoned over by downstream systems.

[43] GAAT: Geometry-Aware Alignment Transformer for Multimodal UAV Perception cs.CVPDF

Jingpu Yang, Debin Tang, Yilin Sun, Fengxian Ji, Jiahua Zhu

TL;DR: 本文提出GAAT（几何感知对齐Transformer），一种面向无人机多模态感知的预训练模型，通过同步视图变换学习跨模态局部对应关系，并利用几何先验引导稀疏融合，在六个下游任务上取得优异性能。

Details

Motivation: 无人机多模态感知中，不同传感器（如RGB、红外、SAR、深度）因光学特性、分辨率和安装差异，通常仅能进行全局或图像中心对齐，导致视差、平台运动和镜头畸变会破坏跨模态补丁的空间对应关系，影响密集对比学习和跨模态融合效果。

Result: 在六个下游任务上的广泛实验表明，GAAT实现了持续优越的迁移性能，成为无人机多模态感知的SOTA基础模型；所提出的StateBench支持对真实采集条件进行系统诊断。

Insight: 创新点包括：提出syncPATC方法，在无对应标注下通过同步视图变换学习补丁中心一致性；引入几何先验（如token置信度、查询中心）识别可靠局部锚点；采用MG-Sparse-MMA进行基于几何校准的稀疏局部融合；设计RA-QCGCL对齐预训练监督与稀疏查询瓶颈。

Abstract: Unmanned aerial vehicle (UAV) multimodal perception integrates visible (RGB), infrared (IR), synthetic aperture radar (SAR), and depth sensors for scene understanding under diverse conditions. However, differences in optics, resolution, and mounting often limit practical systems to global or image-center alignment. After tokenization, parallax, platform motion, and lens distortion can shift corresponding patch centers across modalities, weakening the spatial correspondence assumed by dense contrastive learning and cross-modal fusion. We propose GAAT (Geometry-Aware Alignment Transformer), an alignment-first pretrained model that estimates local correspondence reliability before cross-modal interaction. GAAT introduces syncPATC, which learns patch-center consistency under synchronized view transformations without correspondence annotations. It emits geometric priors, including token and query confidence, query centers, and sub-token offsets, that identify reliable local anchors across residual misalignment. Guided by these priors, MG-Sparse-MMA performs query-mediated sparse fusion over top-K_s reliable regions, replacing dense all-patch interaction with geometry-calibrated local updates. RA-QCGCL aligns pretraining supervision with this sparse query bottleneck through reliable patch-to-patch, patch-to-query, and query-to-query contrastive branches. We introduce UAVMeta and StateBench, which provide four acquisition-state scores derived from platform telemetry and image statistics: camera reliability, observation scale, viewpoint stability, and flight maneuver complexity. Extensive experiments across six downstream tasks demonstrate consistently superior transfer performance, establishing GAAT as a state-of-the-art multimodal foundation model for UAV perception. StateBench further enables a systematic diagnosis of real-world acquisition conditions.

[44] A-PAIR: A Benchmark and Identity-Consistent Grounding Framework for Air-Ground Cross-View Referring Person Detection cs.CV | cs.MMPDF

Zhoupeng Guo, Xinjie Yao, Yunqi Zhu, Zhihe Fan, Siqi Zhao

TL;DR: 本文提出了首个空地跨视角指代行人检测（AGCV-RPD）基准A-PAIR，包含22,137个跨视角指代样本，并设计了半自动标注框架FARA来高效生成分解式指代描述和身份一致性监督。同时，作者提出了身份一致性指代定位（ICRG）框架，通过分解式指代定位、候选完整性监督和跨视角一致性校准来联合选择空地配对目标，在基准测试中显著提升了配对检测性能。

Details

Motivation: 现有指代表达式理解和开放词汇定位方法未能共同考虑跨视角身份一致性，无法有效应对空地跨视角指代行人检测中存在的相似行人干扰、空中视角外观线索弱以及跨视角身份一致性问题。

Result: 在提出的A-PAIR基准上，ICRG框架相比强基线显著提升了地面、空中和配对级别的检测性能，将配对F1分数从16.65%提升至22.28%，证明了其有效性。

Insight: 创新点在于首次构建了专注于跨视角身份一致性的空地指代行人检测基准，并提出了结合分解式指代、完整性监督和一致性校准的联合检测框架，强调了配对检测和身份一致性推理在该任务中的必要性。

Abstract: Air-ground cross-view referring person detection is a necessary component in the language-to-perception-to-control chain of collective embodied intelligence, grounding a language command into the same physical target before ground and aerial agents can coordinate downstream actions. Existing referring expression comprehension and open-vocabulary grounding methods do not jointly account for cross-view identity consistency, making them insufficient for Air-Ground Cross-View Referring Person Detection (AGCV-RPD), which involves similar pedestrian distractors, weak aerial appearance cues, and cross-view identity consistency. To study this problem, we introduce Air-Ground Paired Identity-Aware Referring (A-PAIR), the first comprehensive AGCV-RPD benchmark, containing 22,137 cross-view referring samples. To construct A-PAIR efficiently, we propose Factorized Annotation and Referential Alignment (FARA), a semi-automatic annotation framework that generates factorized referring descriptions and identity-consistency supervision at reduced cost. We propose Identity-Consistent Referring Grounding (ICRG), a framework that combines factorized referential grounding, candidate-completeness supervision, and cross-view consistency calibration for joint air-ground pair selection. ICRG improves ground, aerial, and pair-level detection over strong baselines, increasing pair F1 from 16.65% to 22.28%. These results show that AGCV-RPD requires paired detection and identity-consistent reasoning.

[45] Visual Token Coding for Video Multimodal Large Language Models cs.CVPDF

Chenxin Fang, Tao Chen, JunChao You, Jun Peng, Yiyi Zhou

TL;DR: 本文提出了一种名为视觉令牌编码（VTC）的新令牌压缩范式，专为视频多模态大语言模型（MLLMs）设计。它借鉴了经典视频编码（如HEVC）的原理，通过预测视频的I/P帧并测量帧间残差来估计令牌冗余，从而实现结构化压缩。增强版本VTC_Dy引入了动态分辨率输入、动态令牌分配和空间覆盖Top-K等动态设计，在多个视频理解基准测试中，以显著减少的令牌预算（如50%或25%）实现了接近甚至超过原模型的性能保留。

Details

Motivation: 解决视频MLLMs在处理长视频时面临的高计算和内存开销问题，通过压缩视觉令牌数量来提升效率，同时保持模型的理解能力。

Result: 在多个视频理解基准测试中，VTC_Dy应用于Qwen3-VL等MLLMs时，以50%的令牌预算实现了平均100.1%的性能保留（即性能无损甚至略有提升），以25%的令牌预算仍保留了97.8%的平均性能。

Insight: 创新点在于将经典视频编码的I/P帧预测和残差估计思想引入视觉令牌压缩，形成结构化方法；动态设计（如DyRSO、DyTA、SC-TopK）允许自适应调整输入和令牌分配，提升压缩效率；作为即插即用模块，无需额外微调MLLMs，易于部署。

Abstract: In this paper, we propose a new token compression paradigm for video Multimodal Large Language Models (MLLMs), termed Visual Token Coding (VTC). Inspired by classical video coding principles, e.g., HEVC, VTC performs structured compression by predicting the I/P frames of a video and measuring their frame-wise residuals to estimate token redundancy. Based on this baseline framework, we also enhance VTC with a set of novel dynamic designs, such as Dynamic Resolution Input (DyRSO), Dynamic Token Allocation (DyTA), and Spatial Coverage Top-K (SC-TopK), and term this new approach $VTC_{Dy}$. To validate VTC, we apply it to three MLLMs and conduct experiments on multiple video understanding benchmarks. The experimental results show that VTC$_{\mathrm{Dy}}$ achieves an average performance retention of 100.1% with a 50% token budget for Qwen3-VL, while still retaining 97.8% of the average performance when the token budget is reduced to 25%. Moreover, as a plug-and-play design, VTC requires no additional tuning of MLLMs for token coding. Our code is available at https://github.com/Msr233/VTC.

[46] 3D-USE: From Image-Level to Scene-Level Underwater Enhancement cs.CVPDF

Jieyu Yuan, Yuanlin Zhang, Jihong Li, Chunle Guo, Huimin Lu

TL;DR: 本文提出了一种名为3D-USE的两阶段框架，用于从退化的多视角水下观测中学习一个持久且增强可见性的3D场景表示，从而实现一致的增强渲染。该方法首先通过MediumRBF建立介质感知的高斯场景表示，然后利用ATC将成对的2D水下图像增强知识转移到场景全局和高斯局部的目标上，最终通过U-BAF实现这些目标。

Details

Motivation: 水下3D重建会忠实地再现捕获视图的颜色偏移和能见度损失，而物理反演可能在恢复的场景外观中留下估计误差。本文旨在解决从退化的多视角观测中学习一个一致的、增强可见性的3D场景表示的问题，且没有成对的增强3D数据作为监督。

Result: 在真实水下场景上的实验表明，该方法在保持重建质量的同时，提高了能见度和跨视图一致性。

Insight: 创新点在于提出了一个两阶段框架，将2D图像增强知识迁移到3D场景表示中，避免了直接使用不一致的增强视图进行监督。具体包括使用共享径向基锚点表示水效应并分解物体与介质贡献的MediumRBF，以及通过ATC实现知识迁移和U-BAF实现增强目标。

Abstract: Underwater 3D reconstruction faithfully reproduces the color shifts and visibility loss of captured views, while physical inversion may leave estimation errors in the recovered scene appearance. We formulate Underwater Scene-level Enhancement (USE) as learning a persistent, visibility-enhanced 3D scene representation from degraded multi-view underwater observations, enabling consistent enhanced rendering. Realizing USE requires both a reliable scene representation for enhancement and a consistent enhancement target without paired enhanced 3D data. Therefore, we present 3D-USE, a two-stage framework. First, the Medium Radial Basis Anchor Representation (MediumRBF) establishes a medium-aware Gaussian scene by representing water effects with shared radial-basis anchors and explicitly decomposing object and medium contributions. Based on this fixed scene representation, Appearance Transition Consensus (ATC) transfers paired 2D underwater image enhancement (UIE) knowledge into scene-global and Gaussian-local targets, avoiding direct supervision from inconsistent enhanced views. An Underwater Bilateral Appearance Field (U-BAF) then realizes these targets in Gaussian radiance and medium appearance. The scene directly renders enhanced novel views without a 2D UIE model at inference. Experiments on real underwater scenes show improved visibility and cross-view consistency while preserving reconstruction quality.

[47] Dynamic Alignment Compensation for Hallucination Mitigation in Large Vision-Language Models cs.CV | cs.AIPDF

Kairong Yu, Zixin Zhu, Le Yu, Hongwei Wang

TL;DR: 本文提出了一种名为动态对齐补偿（DAC）的训练无关推理时方法，用于缓解大型视觉语言模型（LVLM）中的幻觉问题。该方法通过检测跨模态表示在解码器层间和生成步骤间的退化与漂移，并应用轻量级残差补偿来稳定令牌预测。在多个LVLM骨干网络和九个幻觉及通用多模态基准测试上的实验表明，DAC能持续减少幻觉，同时保持强大的整体性能。

Details

Motivation: 现有缓解LVLM幻觉的方法主要依赖外部监督、输出校准或注意力调节，对自回归生成过程中的内部表示动态探索不足。本文动机是识别并解决推理时跨模态表示在层间退化和跨步漂移这一失效模式，该模式会破坏令牌预测稳定性并增加幻觉风险。

Result: 在多个LVLM骨干网络（如LLaVA、InstructBLIP）和九个专注于幻觉及通用多模态基准（如POPE、MME、MMBench）上的实验表明，DAC方法能一致地减少幻觉，同时维持或提升整体性能，在多个基准上达到了最先进（SOTA）或具有竞争力的水平。

Insight: 论文宣称的创新点在于提出了首个无需训练、在推理时通过检测表示发散并选择性应用轻量级补偿来缓解幻觉的方法。从客观角度看，其核心洞察是将幻觉归因于自回归生成过程中内部跨模态表示的动态不稳定性，并设计了层间语义补偿和序列语义校正的组合机制来针对性解决，这是一种新颖且高效的内部表示对齐视角。

Abstract: Large Vision-Language Models (LVLMs) remain prone to hallucinations, producing responses that are irrelevant or inconsistent with the multimodal input. Existing mitigation methods mainly rely on external supervision, output calibration, or attention regulation, leaving the internal representation dynamics of autoregressive generation underexplored. We identify an inference-time failure mode in which cross-modal representations degrade across decoder layers and drift across generation steps, destabilizing token prediction and increasing hallucination risk. We propose \emph{Dynamic Alignment Compensation} (DAC), a training-free inference-time method that detects representation divergence and selectively applies lightweight residual compensation. DAC combines Layer-wise Semantic Compensation to mitigate inter-layer degradation with Sequential Semantic Correction to constrain temporal drift. Experiments on nine hallucination-focused and general-purpose multimodal benchmarks across multiple LVLM backbones show that DAC consistently reduces hallucinations while maintaining strong overall performance.

[48] Task-State Adaptation with Prototype Memory for Multi-Task Dense Prediction cs.CVPDF

Yangyang Xu, Haobo Yuan, Yuzhu Wang, Duo Su, Xi Ye

TL;DR: 本文提出MemMTL，一种用于多任务密集预测的框架，它通过从全局视觉上下文中估计紧凑的任务状态，并利用可学习的任务状态原型记忆进行精炼，以生成任务条件化的专家logits，再与token级logits结合，通过稀疏top-k选择从共享的专家库中路由，最后与任务无关的残差路径结合，对骨干网络特征进行一次性适应，以支持不同任务的预测。

Details

Motivation: 视觉基础骨干网络为密集预测提供了强大的表示，但单一的共享特征仍需支持具有不同、依赖于图像的适应需求的任务，因此需要一种机制来动态适应不同任务。

Result: 论文在NYUD-v2和PASCAL-Context数据集上，使用SAM 3和ViT-L骨干网络进行了匹配的评估协议，以衡量预测质量、计算成本以及任务状态条件化、原型检索和稀疏路由的贡献；但当前工作草案中的数值记录早于规范实现，需要重新生成才能支持实证主张。

Insight: 创新点在于引入了任务状态原型记忆来精炼任务状态，并设计了结合任务条件化专家logits与稀疏路由的混合适应路径，以及一个单独的任务无关残差路径，以实现高效且灵活的多任务特征适应。

Abstract: Vision foundation backbones provide strong representations for dense prediction, yet a single shared feature still needs to support tasks with different, image-dependent adaptation requirements. We propose MemMTL, a multi-task dense prediction framework that estimates a compact task state from global visual context and refines it through a learnable task-state prototype memory. The refined state is converted into task-conditioned expert logits and combined with token-level logits before sparse top-$k$ selection over a local expert bank shared by all tasks. A separate task-agnostic residual bank provides a common adaptation path, and both paths are added once to the backbone feature before task-specific prediction. We specify a matched evaluation protocol on NYUD-v2 and PASCAL-Context with SAM 3 and ViT-L backbones to measure predictive quality, computational cost, and the contributions of task-state conditioning, prototype retrieval, and sparse routing. The numerical record in the present working draft predates this canonical implementation and must be regenerated before it can support empirical claims.

[49] Attribute Token Arithmetic: Disentangled and Continuous Semantic Control for Visual Autoregressive Models cs.CVPDF

Xindi Yang, Yicheng Wu, Cheng Zhang, Jianfei Cai, Tien-Tsin Wong

TL;DR: 本文提出了一种名为属性标记算术（ATA）的方法，用于在视觉自回归模型中实现解耦和连续的属性控制。该方法通过识别预训练自回归潜在空间中与视觉属性（如年龄、体型、情绪）对应的语义方向，仅需单个参考图像即可学习，无需模型重新训练或大规模监督。在生成过程中，通过简单的算术运算可连续调整和组合多个属性，实现身份保持的细粒度多属性编辑。

Details

Motivation: 自回归文本到图像生成虽在保真度上取得进展，但细粒度语义控制仍面临属性纠缠以及文本与细粒度视觉表示不对齐的挑战。本文旨在解决这些问题，实现对视觉属性的解耦和连续控制。

Result: 大量实验表明，ATA在身份保持、细粒度、多属性调整方面表现出色，在可控性、通用性和计算效率上优于现有的自回归编辑基线方法。

Insight: 创新点在于受词嵌入向量算术特性启发，直接在预训练自回归潜在空间中识别视觉属性的语义方向，仅需单个参考图像即可学习，实现了无需重新训练的高效、解耦的连续属性控制。从客观角度看，该方法将语言模型中的概念算术操作成功迁移到视觉生成领域，为细粒度可控生成提供了新思路。

Abstract: Autoregressive text-to-image generation has recently achieved remarkable progress, offering high-fidelity synthesis via a unified generative framework. However, fine-grained semantic control remains challenging due to the attribute entanglement and the misalignment between textual and fine-grained visual representations. In this paper, we introduce Attribute Token Arithmetic (ATA), a method that enables disentangled and continuous attribute control in visual autoregressive modelling. Inspired by the vector arithmetic property observed in word embeddings, ATA identifies semantic directions corresponding to visual attributes (e.g., aging, fatness, emotion) directly within the pretrained autoregressive latent space. These directions are learned from a single reference image, without model retraining or large-scale supervision. During generation, attributes can be continuously adjusted and compositionally combined through simple arithmetic operations with other attribute tokens. Extensive experiments demonstrate that ATA achieves identity-preserving, fine-grained, and multi-attribute adjustment, outperforming existing autoregressive editing baselines in controllability, generality, and computational efficiency. Our code will be available at https://github.com/Madaoer/ATA.

[50] Token-Budget Distillation: Transferring Full-Token Semantics to Compressed Video Vision-Language Models cs.CVPDF

Xiaoyang Guo, Guoping Luo, Jusheng Zhang, Keze Wang, Wenhao Wang

TL;DR: 本文提出了Token-Budget Distillation（TBD），一种参数高效的微调框架，用于在固定令牌预算下适配视频视觉语言模型（VLMs）。该方法通过冻结预训练主干、仅更新LoRA适配器，并集成基于FlashVID的视觉令牌压缩，结合双路径师生设计，利用完整令牌教师提供监督，使压缩学生模型在保持高效的同时恢复完整令牌模型的语义行为。

Details

Motivation: 视频视觉语言模型（VLMs）的计算成本高昂，因为视频输入产生大量视觉令牌，导致微调和推理开销巨大；直接对压缩输入进行适配会导致语义漂移和性能下降，因此需要一种在固定令牌预算下高效微调的方法。

Result: 在LLaVA-Video、LLaVA-OneVision和Qwen3-VL-8B-Instruct三个视频VLM主干上，于四个视频理解基准测试中评估，TBD在中等和激进压缩下均优于仅压缩的基线方法；在LLaVA-Video上保留率R=10%时，TBD保持了Vanilla模型平均准确率的97.0%，在LLaVA-OneVision上R=10%时达到平均分58.4并匹配100.0%的相对准确率。

Insight: 创新点包括双路径师生设计，结合任务损失、答案区域KL蒸馏、GT锚定边界蒸馏和可靠性感知KD控制，以在压缩下保留完整令牌语义；从客观角度看，该方法通过参数高效微调和语义蒸馏策略，有效解决了视频VLM压缩中的语义漂移问题，为资源受限场景提供了实用解决方案。

Abstract: Adapting video vision-language models (VLMs) is computationally expensive because video inputs produce a large number of visual tokens, making both fine-tuning and inference costly. Although visual token compression can reduce this overhead, direct adaptation on compressed inputs often causes semantic drift and noticeable performance degradation. We present Token-Budget Distillation (TBD), a parameter-efficient fine-tuning framework for adapting video VLMs under a fixed token budget. TBD freezes the pretrained backbone, updates only LoRA adapters, and integrates FlashVID-based visual token compression into the video pathway. To preserve full-token semantics under compression, TBD employs a dual-path teacher-student design, where a full-token teacher provides stable supervision and a compressed student is optimized with task loss, answer-region KL distillation, GT-anchored margin distillation, and reliability-aware KD control. This design enables the student to recover the semantic behavior of the full-token model while remaining efficient under aggressive token reduction. We evaluate TBD on three video VLM backbones, including LLaVA-Video, LLaVA-OneVision, and Qwen3-VL-8B-Instruct, across four video understanding benchmarks. TBD consistently outperforms compression-only baselines under both moderate and aggressive compression. On LLaVA-Video at retention ratio R = 10 percent, TBD preserves 97.0 percent of the Vanilla model’s average accuracy; on LLaVA-OneVision at R = 10 percent, it achieves an average score of 58.4 and matches 100.0 percent relative accuracy.

[51] Dual-Stream Semantic Guidance with Prototype Anchor Calibration for Source-Fully-Free Adaptation of Vision-Language Models cs.CVPDF

Weiwei Xiang, Shun Peng, Guangyi Xiao, Hao Chen, Lei Yang

TL;DR: 本文提出DSSG（Dual-Stream Semantic Guidance）框架及其增强版DSSG-PAC，用于解决源数据完全不可访问的领域自适应（SFF-DA）问题。该方法通过双流语义引导模块和动态跨模态知识蒸馏，缓解了固定类别嵌入的静态漂移和生成描述的动态漂移，从而在多个基准测试上实现了最先进的性能，且DSSG-PAC在保持性能的同时显著降低了适应时间。

Details

Motivation: 动机是解决源数据完全不可访问的视觉语言模型（VLM）领域自适应中存在的关键‘双重语义漂移’问题，即静态漂移（固定类别嵌入的僵化）和动态漂移（生成描述的分歧），这导致了严重的语义错位并加剧了稳定性与可塑性困境。

Result: 在多个基准测试上的广泛实验表明，DSSG始终优于当前最先进的方法。其增强版DSSG-PAC在基本保持适应性能的同时，将总适应时间降低了18.9%。

Insight: 核心创新点在于提出了双流语义引导（DSG）模块，它集成了用于领域特定知识的描述流和用于锚定全局类别一致性的类别锚流，从而协调细粒度可塑性与全局稳定性。此外，原型锚校准（PAC）机制通过周期性校准和缓存原型锚，在减少文本侧冗余计算的同时，保持了类别引导对演化文本空间的适应性，并建立了SFF-DA风险界限的理论分析。

Abstract: Source-Fully-Free Domain Adaptation (SFF-DA) has emerged as a strategic paradigm to adapt Vision-Language Models (VLMs) without any access to source data or task-specific source models. However, we identify a critical Dual Semantic Drift that hinders this process: static drift arising from the rigidity of fixed class embeddings, and dynamic drift stemming from the divergence of generated captions, causing severe semantic misalignment that intensifies the stability-plasticity dilemma. To address this, we propose DSSG (Dual-Stream Semantic Guidance), an end-to-end framework that reconciles fine-grained plasticity with global stability. Our core contribution is the Dual Semantic Guidance (DSG) module, which integrates a caption stream for domain-specific knowledge with a class-anchor stream to anchor global categorical consistency. Furthermore, a Dynamic Cross-Modal Knowledge Distillation (CMKD) module is introduced to leverage the evolving teacher distribution for calibrating teacher-student consistency. Building upon DSSG, we further introduce Prototype Anchor Calibration (PAC), yielding DSSG-PAC, which periodically calibrates prototype anchors and caches them until the next calibration. This design reduces redundant text-side computation while preserving the adaptability of class guidance to the evolving text space. We further establish SFF-DA risk bounds that relate student risk to semantic-teacher quality and teacher–student discrepancy. Extensive experiments demonstrate that DSSG consistently outperforms current state-of-the-art methods across multiple benchmarks, while DSSG-PAC largely preserves its adaptation performance with 18.9% lower total adaptation time. The code is available at https://github.com/mrmenand/DSSG.

[52] EXPOSE: Explainable and Domain-Robust Embeddings from Pathology Vision Foundation Models using Sparse Autoencoders cs.CV | cs.LGPDF

Anja Witte, Maximilian Lennartz, Jan Baumbach, Guido Sauter, Stefan Bonn

TL;DR: 本文提出EXPOSE框架，利用稀疏自编码器作为可解释瓶颈，从病理视觉基础模型的嵌入中识别并抑制领域特定成分，以提升跨领域泛化能力。该方法通过训练稀疏表示、线性分类器识别领域相关维度，并在下游复发预测任务中屏蔽这些特征，无需重新训练主干模型。

Details

Motivation: 视觉基础模型在计算病理学中广泛应用，但对染色、组织制备和扫描仪硬件等引起的领域偏移敏感，其嵌入将生物信息与领域特定信息纠缠，限制了跨领域泛化。

Result: 在大型前列腺癌多采集领域数据集上的实验表明，移除领域特定特征后，跨领域性能提升，并通过领域鲁棒性指数衡量嵌入鲁棒性增强。

Insight: 创新点在于使用稀疏自编码器作为可解释工具实现特征解缠，通过线性分类和特征掩码在不重训练主干模型下提升领域鲁棒性，为病理视觉模型提供可解释的跨领域适应方法。

Abstract: Vision Foundation Models (VFMs) are widely used in computational pathology but remain sensitive to domain shifts arising from variations in staining, tissue preparation, and scanner hardware. A key limitation is that VFM embeddings entangle biological with domain-specific information, hindering cross-domain generalization. We propose Explainable Probing of Cross-Domain Sparse Embeddings (EXPOSE), a framework that uses Sparse Autoencoders (SAEs) as an explainable bottleneck to identify and suppress domain-specific components in VFM embeddings. We train a sparse representation of VFM features, use a linear classifier to identify domain-specific latent dimensions, and mask these features prior to downstream relapse prediction without retraining the backbone model. Experiments on a large prostate cancer dataset with multiple acquisition domains show that SAE features capture both domain- and task-specific information, which are partially disentangled in the latent space. Removing domain-specific features improves cross-domain performance and increases embedding robustness as measured by the Domain Robustness Index (DoRI). Code is available at https://github.com/imsb-uke/expose .

[53] Manifold4D: Denoising on Point Cloud Rendered Manifolds for Video Re-shooting cs.CVPDF

Yongqi Mao, Zijia Dai, Zhishuo Liu, Wei Xu, Kaiwei Wang

TL;DR: 本文提出MANIFOLD4D方法，用于视频重拍摄任务。该方法通过将点云渲染结果直接注入流匹配的初始噪声中，构建一个携带几何信息的噪声流形，从而避免渲染视频与源视频在去噪过程中作为竞争性条件输入，解决了模型在轨迹控制与视觉质量之间的信任困境。

Details

Motivation: 现有视频重拍摄方法将点云渲染结果和源视频同时作为视觉条件输入网络，导致它们在每个去噪步骤中相互竞争，使模型陷入信任困境，影响轨迹控制精度和分布外数据的视觉质量。

Result: 在DAVIS-Traj基准和Vista4D评估集上，MANIFOLD4D在所有指标上均取得了最佳的相机控制精度，相比最强基线，旋转误差降低了25%和27%，平移误差降低了高达32%，同时在视频保真度上与之相当，并在真实世界新视角光度质量上领先。用户研究也证实了其在轨迹跟随和动态一致性方面的优势。

Insight: 核心创新在于将渲染结果作为一次性几何先验，直接编码到生成过程的初始噪声流形中，而非作为持续的条件输入。这使得模型在后续去噪步骤中能专注于源视频信息，实现了几何引导与视觉生成的有效解耦，增强了方法的鲁棒性和泛化能力。

Abstract: Video re-shooting re-renders a monocular video of a dynamic scene along a user-specified camera trajectory, and the dominant recipe supplies the target geometry explicitly: per-frame depth lifts the source video into a 4D point cloud, which is rasterized along the trajectory into a point cloud render. Because the render and the source video are both handed to the network as visual conditions, they compete at every denoising step, leaving the model with a trust dilemma — how much of the render to believe — which can degrade trajectory control or visual quality on data outside the training distribution. We argue that a render already pixel-aligned with the target view does not need to be supplied as an explicit conditioning stream at all. We propose MANIFOLD4D, which injects the render directly into the initial noise of flow matching, so that generation no longer departs from standard Gaussian noise but from a new noise manifold carrying geometric information, leaving the source video as the only visual condition. The render is thus used exactly once, and the network is never asked to learn how to read it; in subsequent denoising steps the model can focus on the source video. On our DAVIS-Traj benchmark and on the Vista4D evaluation set, MANIFOLD4D attains the best camera-control accuracy on every metric, lowering rotation error by 25% and 27% and translation error by up to 32% over the strongest baseline, while matching it in video fidelity and leading on real-world novel-view photometric quality. In a user study, our method achieves clear advantages in trajectory following and dynamic consistency. The gap widens as the yaw amplitude grows past the training range, and the model still recovers correct dynamic motion from the source video when the render is deliberately corrupted, confirming that the geometric prior guides generation without overriding it.

[54] Locate Anything in Videos: Rethinking Efficient Generative Spatio-Temporal Video Grounding cs.CVPDF

Hanoona Rasheed, Haania Siddiqui, Ming-Hsuan Yang, Fahad Shahbaz Khan, Salman Khan

TL;DR: 本文提出了一种名为并行管解码（PTD）的新方法，用于时空视频定位（STVG）任务，旨在同时高效地定位视频中描述事件的时间段和空间位置。该方法通过将定位分解为时间块和空间块并行解码，显著减少了解码延迟并提高了吞吐量。

Details

Motivation: 现有基于多模态大语言模型的方法通常采用自回归方式序列化密集定位轨迹，导致解码延迟随管长度增长且定位误差在时间上传播，因此需要一种更高效的解码策略来解决这些问题。

Result: 在VidSTG基准测试中，PTD将管完成延迟降低了79倍，空间解码吞吐量提高了92倍，同时提升了定位准确性；使用紧凑的4B骨干网络，模型在VidSTG和HC-STVG上表现良好，并能零样本泛化到时间定位、基于视频的问答和参考视频对象跟踪任务。

Insight: 创新点包括并行管解码的生成式框架，通过解耦块注意力机制消除跨框依赖并保持共享视频-查询上下文访问，以及针对时间边界和空间几何的定位感知策略优化，为视频定位提供了一种高效且有效的自回归替代方案。

Abstract: Spatio-temporal video grounding (STVG) requires models to identify when a referred event occurs and localize the target entity throughout that interval. Existing multimodal large language models typically serialize dense localization trajectories autoregressively, causing decoding latency to grow with tube length and allowing localization errors to propagate across time. We introduce Parallel Tube Decoding (PTD), a generative formulation that decomposes grounding into a temporal block followed by time-conditioned spatial blocks decoded simultaneously. This removes both token-level and trajectory-level dependencies, reducing the sequential decoding depth to a fixed $1 + 1$ rounds, independent of tube length. To enable parallel spatial generation, we introduce Decoupled Block Attention, which preserves access to shared video-query context while eliminating cross-box dependencies, together with localization-aware policy optimization for temporal boundaries and spatial geometry. On VidSTG, PTD reduces Tube Completion Latency by 79x and increases spatial decoding throughput by 92x over standard autoregressive decoding, while also improving grounding accuracy. With a compact 4B backbone, our model performs favorably well on VidSTG and HC-STVG, and generalizes zero-shot to temporal grounding, grounded VideoQA, and referring video object tracking. Our results show parallel tube generation is an efficient and effective alternative to autoregressive localization in videos.

[55] Explainable Diabetic Retinopathy Classification Using Vision Foundation Models cs.CV | cs.LGPDF

Abhishek Verma, Anila Krishna, Abhishek Gajanan Bankar, Juan Miguel Lopez Alcaraz

TL;DR: 本研究探索了一种利用视觉基础模型（DINOv2、CLIP、ViT）和多种迁移学习策略（全微调、线性探测、LoRA）构建可解释的糖尿病视网膜病变（DR）分类框架。在ODIR数据集上进行内部评估，在APTOS数据集上进行外部泛化评估，DINOv2模型表现最佳。同时，使用Grad-CAM和HiResCAM等方法进行可解释性分析，并与专家标注的病灶区域进行定量比较。

Details

Motivation: 糖尿病视网膜病变是导致可预防性失明的主要原因，需要开发准确且可信赖的自动筛查工具。本研究旨在利用视觉基础模型构建一个兼具高性能和可解释性的DR分类框架。

Result: 在内部评估（ODIR数据集）中，DINOv2-LoRA取得了最高的AUROC（0.758）。在外部泛化评估（APTOS数据集）中，DINOv2全微调和ViT全微调取得了最高的AUROC（0.920）。可解释性评估在IDRiD数据集上进行，使用Dice、IoU和Pointing Game等指标将模型注意力图与专家标注的病灶掩膜进行定量比较。

Insight: 研究证实了视觉基础模型（尤其是DINOv2）在医学图像分类任务中强大的预测性能。同时，LoRA作为一种参数高效的微调方法，可以作为全微调的有效替代方案。论文通过定量评估模型注意力与临床相关病灶区域的一致性，为构建可信赖的AI医疗诊断系统提供了可解释性分析框架。

Abstract: Diabetic retinopathy (DR) is a major cause of preventable blindness, creating a need for accurate and trustworthy automated screening. This study investigates an explainable DR classification framework using vision foundation models and multiple transfer learning strategies. Three backbones, DINOv2, CLIP, and Vision Transformer (ViT), were evaluated using full fine-tuning, linear probing, and Low-Rank Adaptation (LoRA). Models were trained and internally evaluated on the ODIR dataset and externally evaluated on APTOS to assess generalization. DINOv2-LoRA achieved the highest internal AUROC of 0.758, while DINOv2 full fine-tuning and ViT full fine-tuning achieved the highest external AUROC of 0.920. Calibration was further assessed using reliability analysis after isotonic regression. For explainability, Grad-CAM and HiResCAM were evaluated against expert-annotated lesion masks from the IDRiD dataset using Dice, Intersection over Union (IoU), and Pointing Game metrics. The results demonstrate that foundation models, particularly DINOv2, can provide strong predictive performance, while LoRA offers a parameter-efficient alternative to full fine-tuning. Quantitative evaluation of explanation maps further supports the assessment of whether model attention corresponds to clinically relevant retinal lesions.

[56] WALDO: One-Shot Exemplar-Conditioned Object Detection in Cluttered Scenes cs.CVPDF

Kishor Datta Gupta, Ahmed Rafi Hasan, Md. Mahfuzur Rahman, Md. Sadman Haque, Mohd Ariful Haque

TL;DR: WALDO是一个参数仅340万的单样本示例和语言条件检测头，它读取冻结的V-JEPA 2.1特征来联合预测目标定位和存在性，无需对主干网络进行梯度更新。该方法通过从实例标注中合成训练数据来弥补监督数据稀缺的问题，并在杂乱场景中实现了优于基线模型的目标检测性能。

Details

Motivation: 论文旨在探索是否能够利用世界模型预训练目标已学习的表示，以远低于大型视觉语言模型的成本，实现通过单张参考图像和简短描述在杂乱场景中定位特定目标实例并报告其缺失的能力。

Result: 在35个保留的杂乱场景上，WALDO取得了0.461的catalogue AP@50，优于提示调用的Grounding DINO基线（0.306）。使用V-JEPA特征相比DINOv3特征，在相同576个token的网格下，将类别内缺失检测的AUROC从0.726提升到0.880，并将实例AP@50从0.141提升到0.201，表明性能增益主要源于预训练目标而非输入分辨率。然而，实例级别的Success@1仅为0.190，与类别随机猜测基线持平。

Insight: 创新点在于设计了一个轻量级的、基于冻结世界模型特征的检测头，并通过合成训练数据（包括挖掘正例和构造包含同类别干扰项的负例）来有效解决示例条件监督数据稀缺的问题。研究还通过负控制实验揭示了数据合成中可能存在的捷径（如裁剪尺寸单独预测标签），并成功关闭了这些捷径，确保了模型真正学习参考示例的信息。结果表明，世界模型特征能有效迁移到定位精度和缺失检测任务，但难以迁移到实例身份识别。

Abstract: Locating a specific object instance in a cluttered scene using a single reference image and a short description, and reporting when that instance is absent, large vision-language models usually address this task. We ask whether the same capability is available far more cheaply, from representations already learned by a world-model pretraining objective. We present WALDO, a one-shot exemplar- and language-conditioned detection head with 3.4M trainable parameters that reads frozen V-JEPA 2.1 features to jointly predict object localization and target presence, with no gradient on the backbone. Because exemplar-conditioned supervision is scarce, we synthesize training episodes from instance annotations, mining exemplars from ground-truth boxes and constructing absence cases that exclude the referenced instance while leaving same-category distractors in view. This is easy to get wrong: in the obvious implementation, crop size alone predicts the label, and a head trained on it reaches 0.9998 absence AUROC without ever consulting the exemplar, and we report the negative controls that close the shortcut. On 35 held-out cluttered scenes, WALDO achieves a 0.461 catalogue AP@50, compared to 0.306 for a prompted Grounding DINO baseline under an identical scorer. Substituting DINOv3 for V-JEPA under a matched 576-token grid drops within-category absence AUROC from 0.880 to 0.726 and instance AP@50 from 0.201 to 0.141, isolating the pretraining objective rather than input resolution as the source of the gain. Instance-level Success@1, however, reaches only 0.190 against a 0.190 category-chance floor: world-model features transfer to localization precision and absence detection but not to instance identity.

[57] Focus Where It Counts: A Salience-Driven Vision-Language Model for Low Vision Assistance cs.CVPDF

Jiazhao Liang, Hao Huang, Shuaihang Yuan, Congcong Wen, Geeta Chandra Raju Bethala

TL;DR: 本文提出了一种面向低视力辅助的显著性驱动视觉语言模型Salience-LLaVA，通过构建三个带有物体级显著性标注的数据集（Salience COCO、Salience Flickr、Salience VizWiz），使模型能够根据人类感知优先级生成按重要性排序的视觉描述。

Details

Motivation: 现有视觉语言模型主要为通用图像描述设计，未显式建模人类感知优先级，无法在场景中强调最相关信息，限制了其在低视力辅助应用中的有效性。

Result: 论文提出了SCMI指标来评估描述顺序的准确性，并将系统部署在辅助眼镜上以展示其实用性。

Insight: 创新点在于构建了经过低视力用户验证的显著性感知数据集，并提出了一个能按重要性顺序描述物体的显著性感知VLM框架，将人类中心化优先级直接整合到视觉语言建模中。

Abstract: Vision-language models (VLMs) are rapidly progressing and offer promising capabilities for assistive technologies supporting persons with blindness or low vision. However, existing VLMs are primarily designed for general-purpose captioning and do not explicitly model human perceptual priorities, thereby limiting their ability to emphasize the most relevant information in a scene. To address this gap, we propose a salience-driven captioning framework that prioritizes scene elements according to their importance for human-centered assistance. We curate three salience-aware datasets, namely, Salience COCO, Salience Flickr, and Salience VizWiz, with object-level salience annotations designed to reflect the visual information most relevant to low vision users across different environments. Building on these datasets, we introduce Salience-LLaVA, a salience-aware VLM that incorporates salience cues to generate captions in which important elements are mentioned in the order of importance. Our work makes four main contributions. We build salience-aware datasets verified by low vision participants, propose Salience-LLaVA to describe objects in the order of importance, introduce SCMI to evaluate ordering accuracy, and deploy the system on assistive glasses to demonstrate real-world practicality. Code and datasets are available at: https://github.com/topo-focus/Topofocus

[58] RASA: Disentangled Spatial-Motional Priors for Cross-Identity Character Animation cs.CVPDF

Zhen Xiao, Zhen Shen, Zhaofan Qiu, Ting Yao, Xueliang Liu

TL;DR: 本文提出了RASA框架，通过解耦空间映射与运动控制来解决跨身份角色动画中的核心挑战。该方法采用两阶段策略：空间先验校准器（SPC）融合参考身份与驱动姿态以生成空间对齐的初始噪声潜在表示，而固有运动引导器（IMG）则编码形状无关的SMPL关节参数以提供语义运动向量。实验表明，RASA在运动保真度和视觉质量上显著优于现有方法。

Details

Motivation: 跨身份角色动画的核心挑战在于空间映射（如位置、比例和骨骼比例对齐）与运动控制（如关节活动、体积一致性和视角连贯性）的内在纠缠问题，现有方法难以同时有效处理这两方面。

Result: 在精心构建的高质量基准CIM-Bench上进行的广泛实验显示，RASA在运动保真度和视觉质量方面显著超越了当前最先进的方法，确立了新的性能水平。

Insight: 创新点在于通过解耦空间先验和运动先验，并利用空间先验校准器和固有运动引导器分别注入结构化先验到Diffusion Transformer中，从而实现了更鲁棒的角色动画；客观分析认为，该方法通过分离空间对齐与运动细化，有效提升了跨身份动画的准确性和一致性。

Abstract: Cross-identity character animation aims to drive a target identity from a reference image to follow the motion of a source character from a driving video. The core challenge lies in the inherent entanglement of two capabilities: cross-identity spatial mapping (aligning position, scale, and skeletal proportions) and motion control (refining joint articulation, volumetric consistency, and view coherence). We introduce Reference-Aware Structural Alignment (RASA), a framework that disentangles spatial mapping from motion control by injecting structured priors into a Diffusion Transformer (DiT). Our approach has two stages. First, a Spatial Prior Calibrator (SPC) fuses reference identity with driving pose to generate a spatially grounded initial noise latent, ensuring correct positioning, scaling, and alignment with the driving skeleton. Second, an Inherent Motional Guider (IMG) encodes shape-agnostic SMPL articulation parameters into a semantic motion vector beyond appearance-biased 2D keypoints. Injected into intermediate DiT layers, this vector complements the base pose condition for anatomically consistent articulation and view-aware volumetric refinement. We curate CIM-Bench, a high-quality benchmark with rigorous curation, for evaluation. Extensive experiments show RASA significantly outperforms state-of-the-art methods in motion fidelity and visual quality. Our work establishes a new paradigm showing disentangled spatial and motional priors are key to robust character animation. Project page: https://hidream.ai.github.io/RASA/

[59] A comprehensive and trustworthy benchmark of AI methods for change detection in Earth observation cs.CV | cs.AIPDF

Tadej Tomanič, Alice Baudhuin, Jan Sotošek, Jure Brence, Panče Panov

TL;DR: 该论文提出了一个标准化、开源的基准测试，用于全面评估地球观测变化检测领域的最先进深度学习方法。研究对十种代表性模型架构（从卷积网络到视觉Transformer）在十个异构数据集上进行了统一协议下的性能与效率评估，发现优化后的经典架构（如孪生U-Net）在兼顾计算效率时常优于复杂新模型，且预训练能稳定提升性能而不增加推理成本。所有实验资源均已公开并遵循FAIR原则。

Details

Motivation: 当前地球观测变化检测领域的研究受限于不一致的评估协议，且过度关注预测精度而忽视计算效率，因此需要建立一个全面且可信赖的基准来标准化评估。

Result: 在十个异构变化检测数据集上的评估表明，当综合考虑计算效率（如参数量和推理延迟）时，优化后的经典架构（如孪生U-Net）常优于更复杂的当代模型；预训练能显著提升性能且不增加推理成本。

Insight: 创新点在于构建了一个标准化、开源且遵循FAIR原则的全面基准，强调在评估中同时考虑预测性能和计算效率；客观分析发现，在变化检测任务中，模型优化和预训练策略比单纯追求架构复杂性更为关键。

Abstract: Change detection in Earth observation (EO) is critical for monitoring land surface transformations, yet recent research in the field is constrained by inconsistent evaluation protocols and a narrow focus on predictive accuracy without regard for computational efficiency. To address this, we present a standardized, open-source benchmark for evaluating state-of-the-art (SOTA) deep learning methods for Earth observation change detection. We conduct a comprehensive analysis of ten representative model architectures, ranging from convolutional networks (CNNs) to vision transformers (ViTs), across ten heterogeneous change detection datasets. We rigorously evaluate these models with identical experimental protocols, comparing models trained from scratch against those utilizing pre-trained weights. Furthermore, we evaluate predictive performance alongside computational efficiency, including parameter counts and inference latency. Our findings reveal that well-optimized classical architectures, such as Siamese U-Nets, frequently outperform more complex contemporary models when computational efficiency is factored in, and that pre-training consistently provides a significant performance boost with no additional inference cost. To ensure complete transparency and reproducibility, all experimental resources, including standardized data splits, training scripts, training logs, and model checkpoints are publicly available and adhere to FAIR principles (Findable, Accessible, Interoperable, and Reusable).

[60] Synth-JDoc: Synthesizing a Japanese Document Image Dataset for OCR with Diverse Layouts and Embedded Images cs.CV | cs.CLPDF

Keito Sasagawa, Shuhei Kurita, Daisuke Kawahara

TL;DR: 本文提出Synth-JDoc，一种通过HTML和CSS合成日语文档图像的方法，以构建包含垂直和水平文本布局及嵌入图像的OCR数据集，旨在提升大型视觉语言模型（LVLM）对垂直书写日文文本的识别能力。

Details

Motivation: 现有LVLM在垂直书写日文文本上的性能显著低于水平文本，而手动或基于OCR提取构建高质量日语OCR数据集成本高且难以扩展，因此需要一种可扩展的合成方法。

Result: 实验表明，在本文合成的数据集上微调的模型，在阅读垂直书写日文文本任务上，性能优于基于先前工作合成数据集或高性能文生图模型生成数据集微调的基线模型，验证了该方法的有效性。

Insight: 创新点在于利用HTML/CSS直接合成多列、混合垂直/水平书写样式并嵌入文生图模型生成图像的文档，再施加噪声和退化滤镜以增强视觉真实性和模型鲁棒性，为特定语言（如日语）的OCR数据集构建提供了可扩展的合成方案。

Abstract: The ability of Large Vision Language Models (LVLMs) to read text within document images is crucial, as it enables various applications such as Document Visual Question Answering. To enhance the text-reading capabilities of LVLMs, high-quality OCR datasets are essential. This need is particularly critical for Japanese documents, which often feature vertically written text alongside horizontally written text. Current LVLMs demonstrate considerably lower performance on vertically written Japanese text than on horizontally written text, necessitating specialized OCR datasets to bridge this gap. However, manually constructing OCR datasets is expensive and difficult to scale. Alternatively, constructing datasets by extracting text from existing document images using OCR models introduces challenges, such as text recognition errors and the prerequisite of sourcing document images. To address these issues, we construct an OCR dataset by synthesizing document images directly from text. Leveraging HTML and CSS, we generate multi-column documents that incorporate both vertical and horizontal writing styles. Furthermore, to ensure the visual realism of the documents, we embed images generated by text-to-image models within the layout. Additionally, to foster model robustness, we apply noise and degradation filters to the synthesized document images. In our experiments, we compared the performance of models fine-tuned on our synthetic dataset against baselines fine-tuned on synthetic datasets from prior work and those generated by a high-performance text-to-image model. Evaluation results demonstrate that our synthetic dataset is the most effective approach for improving LVLM performance on reading vertically written Japanese text. Our dataset and code are publicly available (https://github.com/llm-jp/synth-jdoc).

[61] AIM: Anchor Identity Features, Then Match for Multimodal Large Language Model Unlearning cs.CV | cs.CLPDF

Wonjun Lee, Jaehyuk Jang, Kangwook Ko, Hee-Seon Kim, Changick Kim

TL;DR: 本文提出了一种名为AIM的两阶段方法，用于解决多模态大语言模型（MLLMs）中特定人物身份信息的遗忘问题，以应对用户请求删除个人数据时的隐私风险。该方法在删除时无需访问保留图像或真实答案，通过分析发现身份问题与视觉感知问题在模型隐藏状态中占据不同区域且组织方式不同，从而设计出先锚定身份遗忘目标，再在Fisher约束下匹配视觉编码器的策略。

Details

Motivation: 动机在于MLLMs在微调数据中会记忆特定人物的身份信息，当个人请求删除时存在隐私风险，而现有遗忘方法通常假设在删除时可访问保留图像或真实答案，这在许多实际场景中不切实际。

Result: 大量实验表明，AIM在相同图像上实现了具有竞争力的身份遗忘效果，同时保留了非删除身份、先验知识和视觉感知能力。

Insight: 创新点在于揭示了身份问题与视觉感知问题在模型隐藏状态中的分离特性，并基于此设计了无需保留图像的两阶段遗忘方法AIM，其核心是使用通用视觉提示锚定遗忘目标，并在Fisher约束下进行匹配，从而在保护隐私的同时最小化对模型其他能力的损害。

Abstract: Multimodal large language models (MLLMs) can memorize identity-specific facts about people in their fine-tuning data, creating privacy risks when a person requests deletion. Existing MLLM unlearning methods often assume access to retain images or ground-truth answers during deletion, which is unrealistic in many practical scenarios. We study identity unlearning when retain images are unavailable at deletion time. Our analysis shows that identity and visual-perception questions occupy distinct regions in fine-tuned hidden states and are organized differently: identity questions cluster by person, whereas perception questions cluster by question type. This suggests that identity knowledge can be suppressed without erasing general visual perception. Building on this observation, we propose AIM, a two-stage method that anchors an identity-forgetting target with a universal visual prompt and then matches the vision encoder to that target under a Fisher-based constraint. Extensive experiments show that AIM achieves competitive identity forgetting while preserving non-deleted identities, prior knowledge, and visual perception on the same images.

[62] Abstract4D: A Large-Scale Dataset and Framework for Understanding the Visual Language of Abstract Art cs.CVPDF

Haowei Zhang, Yuanpei Zhao, Ji-Zhe Zhou, Mao Li

TL;DR: 本文提出了Abstract4D，一个迄今为止最大的抽象绘画数据集，包含超过12万张图像，并配有丰富的元数据和捕捉作品感知属性（形式、颜色、纹理和构图）的多维度提示。利用该数据集，作者分析了抽象艺术的语义结构，并建立了分类、跨模态检索和文本到图像生成的基准任务，以评估AI模型对抽象视觉语言的理解和生成能力。

Details

Motivation: 人工智能虽然能分类艺术风格和合成图像，但仍缺乏理解赋予艺术意义的视觉语言模型。抽象绘画最大限度地减少了对象语义并突出了结构线索，使其成为计算感知的理想测试平台。

Result: 研究通过大规模嵌入可视化分析了抽象艺术的语义结构，揭示了感知关系如何组织艺术意义，并建立了分类、跨模态检索和文本到图像生成的基准任务，以定量评估AI模型。

Insight: 创新点在于构建了大规模、高质量且带有丰富感知属性标注的抽象艺术数据集，以及采用人机混合标注流程确保质量。该数据集为探索和定量评估AI在抽象艺术领域的表示与解释能力提供了基础。

Abstract: Artificial intelligence can classify artistic styles and synthesize images, but it still lacks a model of the visual language that gives art meaning. Abstract painting minimizes object semantics and foregrounds structural cues, making it an ideal testbed for computational perception. We introduce \textbf{Abstract4D}, the largest dataset of abstract paintings to date: more than 120,000 images paired with rich metadata and multi-dimensional prompts that capture each work’s perceptual attributes—\textit{form, color, texture, and composition}. Annotations are produced by a hybrid human–VLM pipeline for quality and consistency. Using Abstract4D, we (i) analyze the semantic structure of abstract art through large-scale embedding visualization, uncovering how perceptual relationships organize artistic meaning, and (ii) establish benchmark tasks for classification, cross-modal retrieval, and text-to-image generation to evaluate how AI models perceive and reproduce abstract visual language. Together, these analyses demonstrate how Abstract4D enables both exploration and quantitative assessment of AI’s ability to represent and interpret abstract art.

[63] Conditional Visual Evidence Utility: State-Dependent Rank Reversals in Frozen Vision-Language Encoders cs.CVPDF

Yunxuan Fang, Xinhe Wang

TL;DR: 本文研究了在受控组合视觉搜索任务中，视觉证据的重要性排序如何随已观察到的线索而动态变化。通过实验发现，冻结的视觉语言编码器（如OpenCLIP和SigLIP）在特定条件下会出现状态依赖的排序反转现象，并且更新证据排序能在评估者变化时保留决策相关价值。

Details

Motivation: 静态重要性评分将视觉证据压缩为单一排序，但观察到某个线索后，剩余证据的价值可能发生变化。论文旨在探究这种状态依赖的证据效用，并评估其是否影响决策。

Result: 在800个场景的验证中，冻结的OpenCLIP和SigLIP编码器在候选重叠区域表现出稳健的状态依赖排序反转。这种结构在两种证据积累构建和十种等效查询措辞下持续存在，但在查询-场景错乱下消失。匹配首动作分析表明，在一种证据模式、措辞或骨干网络下选择决策并在另一种下评估时，首次获取后重新排序能产生积极的第二步效用。

Insight: 创新点在于提出了证据重要性是状态依赖的观点，并设计了受控实验来量化条件边际效用。这挑战了单一静态排序的评估方式，为未来自适应证据选择方法提供了可测量的目标，强调了在视觉语言任务中动态更新证据排序的价值。

Abstract: Static importance scores compress visual evidence into a single ranking, but the value of remaining evidence can change after one cue has been observed. We study this possibility in controlled compositional visual search, where color, shape, and texture evidence can be independently exposed and their conditional marginal utility measured across acquisition states. In a held-out confirmation on 800 scenes, frozen OpenCLIP and SigLIP exhibit robust state-dependent rank reversals that concentrate in candidate-overlap regimes designed to induce ordering changes. The structure persists across two evidence-accumulation constructions and ten equivalent query wordings, but disappears under query-scene derangement. We also ask whether these reversals matter for decisions. In a post-confirmation exploratory matched-first-action analysis, reranking only after the first acquisition yields positive step-2 utility when decisions are selected under one evidence mode, wording, or backbone and evaluated under another. Together, these results show that evidence importance is state-dependent in this controlled setup and that updating an evidence ordering can retain decision-relevant value across evaluator changes. They motivate evaluating vision-language evidence use conditionally rather than through a single static ranking, while providing a measurable target for future adaptive evidence-selection methods.

[64] Cross-Spectral Dense Correspondence for Multimodal Spectral Medical Imaging cs.CV | cs.AIPDF

Eric L. Wisotzky, Jost Triller, Simon W. Härtl, Oliver T. Bruns, Peter Eisert

TL;DR: 本文针对多模态光谱医学成像中跨光谱密集匹配的难题，提出了一种传感器无关的跨光谱调制协议和合成跨光谱匹配基准，以解决因光谱灵敏度不重叠导致的对比度变化、强度反转和外观偏移问题。通过在现有匹配基准上进行强度输入投影并模拟物理上合理的辐射度差异，该方法显著提升了多种现代密集匹配骨干网络在严重光谱失配下的性能，同时保持了标准RGB基准上的表现。

Details

Motivation: 多模态光谱成像系统融合不同波长范围进行后续分析时，精确的密集匹配是基本前提，但对应图像点常因非重叠的光谱灵敏度而出现波长依赖的对比度变化、强度反转和外观偏移，且密集真值难以获取，传统基于RGB的训练数据监督有限。

Result: 在多个现代密集匹配骨干网络上评估，使用统一的跨光谱协议训练后，在严重光谱失配下性能大幅提升，同时标准RGB基准上性能得以保持。消融实验表明，视图依赖的通道选择和非线性辐射度变换提供了互补的鲁棒性。

Insight: 创新点在于引入传感器无关的跨光谱调制协议和合成跨光谱匹配基准来填补数据缺口，核心见解是现有模型的主要限制并非结构匹配能力，而是训练分布与目标图像对光谱特性之间的不匹配，这为高光谱成像工作流中实现空间一致的光谱融合提供了实用的训练数据增强方案。

Abstract: Precise dense correspondence is a fundamental prerequisite for multimodal spectral imaging systems that fuse disparate wavelength ranges for subsequent analysis in medical and scientific imaging. Corresponding image points are often observed with non-overlapping spectral sensitivities, leading to wavelength-dependent contrast changes, intensity inversions, and appearance shifts for which dense ground truth is difficult to obtain and conventional RGB-based training data provides only limited supervision. We address this data gap by introducing a sensor-agnostic cross-spectral modulation protocol on established correspondence benchmarks with intensity input projection, and by proposing a synthetic cross-spectral correspondence benchmark simulating physically plausible radiometric differences. Evaluation on several modern dense correspondence backbones trained with our unified cross-spectral protocol showed substantial improvements under severe spectral mismatch while maintaining performance on standard RGB benchmarks. Ablation experiments show that view-dependent channel selection and nonlinear radiometric transformations provide complementary robustness, indicating that the primary limitation of existing models is not their structural matching capacity but the mismatch between training distribution and spectral characteristics of the target image pair. Qualitative evaluations on heterogeneous medical spectral acquisition systems demonstrate the practical relevance of the proposed training data augmentation protocol as an enabler for spatially coherent spectral fusion in HSI workflows.

[65] Semantic Head Specialization Guides Hybrid ViT Attention for Multimodal LLMs cs.CV | cs.CLPDF

Chenhong He, Lei Li, Shicheng Li, Hanglong Lv, Lingpeng Kong

TL;DR: 本文研究了多模态大语言模型中视觉Transformer的注意力机制，发现注意力头会分化为对象专家和背景专家的语义角色，称为语义头专业化。作者提出了SHS-Index来量化这种专业化，并基于影响SHS的三个结构因素设计了Ariadne Attention混合注意力机制，在显著降低计算成本的同时，在22个图像和视频任务上达到了与全注意力相当的性能。

Details

Motivation: 当前前沿大语言模型普遍采用混合注意力，但多模态大语言模型中的视觉Transformer缺乏令人满意的混合设计，且对于何种注意力模式更优缺乏共识。本文旨在填补这一空白，研究ViT注意力头的角色分化现象，并以此为指导设计更优的混合注意力。

Result: 提出的Ariadne Attention混合注意力机制，在22个图像和视频任务上达到了与全注意力相当的性能，同时将注意力计算量减少了6.5倍。SHS-Index被证明可以有效区分全注意力和分块窗口ViT，并与下游基准测试性能强相关。

Insight: 核心创新点在于发现了ViT注意力头的语义专业化现象，并提出了可量化的SHS-Index作为诊断和设计混合注意力的原则性指标。基于窗口交互、令牌序列化和局部softmax分配这三个结构因素来指导混合注意力设计，为构建高效的多模态大模型提供了新的视角和可借鉴的设计范式。

Abstract: Hybrid attention dominates frontier LLMs, yet Vision Transformers (ViTs) in multimodal LLMs lack a satisfactory hybrid design, with no consensus on why certain attention patterns work better. To fill this gap, we study ViT attention heads and find they differentiate into object- and background-specialist roles, a pattern most pronounced under full attention; we call this Semantic Head Specialization (SHS). We propose SHS-Index to quantify this specialization, show that it distinguishes full-attention from chunk-window ViTs, and find that it strongly tracks downstream benchmark performance. We then identify three structural factors that shape SHS—window interaction, token serialization, and local softmax allocation—and use them as design principles for hybrid attention. Guided by these factors, we design Ariadne Attention, a hybrid that matches full attention on 22 image and video tasks at 6.5x less attention compute. Our findings establish head specialization as a measurable property for diagnosing and designing principled hybrid ViT attention at the multimodal-LLM scale.

[66] Post-Training VLMs for Video Mistake Detection cs.CV | cs.LGPDF

Federico Spurio, Olga Zatsarynna, Lars Doorenbos, Emad Bahrami, Gianpiero Francesca

TL;DR: 本文提出了一种用于视频错误检测的后训练视觉语言模型方法，并引入了MD-VQA协议和基准测试。该方法通过定制的奖励函数鼓励模型识别指令与视频之间的差异，在已见和未见动作上都能有效检测执行步骤是否正确，在EP-VQA基准上对未见流程的检测性能比最佳基线提升了11.6%。

Details

Motivation: 现有视频错误检测方法大多基于封闭集协议，对任务变化适应性差，需要重新收集数据和训练模型。本文旨在让方法学习错误的通用概念，而非过度拟合特定步骤细节，以提高其泛化能力和更广泛的适用性。

Result: 该方法在MD-VQA基准上进行了广泛评估，性能优于零样本、监督微调和后训练基线。特别是在未见流程（如EP-VQA基准）上表现出色，比最佳基线提升高达11.6%，展现了优越的泛化能力。

Insight: 创新点在于首次提出了针对错误检测的视频语言模型后训练技术，以及引入MD-VQA开放集协议来评估模型对已见和未见动作的泛化能力。其核心是通过定制奖励函数引导模型关注指令与视频内容的不一致性，这为通用错误检测提供了新思路。

Abstract: Human mistakes are inevitable when following instructions, yet they can lead to severe consequences. As such, there has been an increased interest in developing methods for detecting mistakes in videos, with current methods mostly focusing on closed-set protocols. While successful in controlled settings, the closed-set assumption limits their wider applicability, as any changes to the task require collecting new data and re-training models. Instead, we argue that mistake detection methods should learn the general concept of a mistake, rather than overfitting to step-specific details. To reflect this, we introduce the Mistake Detection Video Question Answering (MD-VQA) protocol and accompanying benchmark. MD-VQA tests whether methods can discern if a step was executed correctly with respect to its description, for both seen and unseen actions. To address this important challenge, we propose the first video-language-model post-training technique for mistake detection. Our method uses a tailored reward function to encourage the model to identify discrepancies between an instruction and the corresponding video. Extensive evaluations demonstrate that this approach outperforms zero-shot, supervised fine-tuning, and post-training baselines. Notably, our method generalizes especially well to unseen procedures, for instance, with an improvement of up to 11.6% over the best-performing baseline on EP-VQA, paving the way toward general mistake detection. We release our code and benchmark at https://github.com/FedeSpu/mstk.

[67] How Far Can 5,500 Hours of Driving Take You? A Scaling Law Analysis of Video Diffusion Models cs.CVPDF

Victor Besnier, Anh-Quan Cao, Elias Ramzi, Spyros Gidaris, Tuan-Hung Vu

TL;DR: 本文对自动驾驶视频生成中的视频扩散模型进行了系统的缩放定律研究，训练了参数量从1M到9B的模型家族，并在长达5,500小时的驾驶数据上进行不同训练时长的实验。研究发现，验证损失在模型大小和训练时长上都遵循一致的幂律关系，揭示了在有限计算预算下，延长训练时间比增大模型规模更有效，但更大模型在充足计算和数据下能达到更低的渐近损失。基于此规律训练的9B参数模型在nuScenes基准上达到了开源领域驾驶视频生成的新SOTA。

Details

Motivation: 自动驾驶视频生成无法遵循网络规模的路线，因为驾驶数据收集成本高、受隐私要求约束且无法随意抓取，因此模型必须充分利用固定的数据集。本文旨在通过缩放定律分析，指导如何在有限资源下最优地分配计算预算（是用于更长的训练还是更大的模型）以及是否需要更多数据。

Result: 在nuScenes基准测试中，根据缩放定律指导训练的9B参数模型，在驾驶视频生成任务上达到了新的开源最先进水平。

Insight: 主要创新点在于对驾驶视频扩散模型进行了系统的缩放定律实证研究，定量揭示了损失随模型规模和训练时长的幂律关系，为资源受限的自动驾驶视频生成模型开发提供了明确的优化指导。从客观角度看，该研究将缩放定律分析从语言模型等领域成功迁移到特定领域（自动驾驶）的视频生成任务，具有重要的工程实践价值。

Abstract: Video generation for autonomous driving cannot follow the web-scale route: driving data is expensive to collect, bound by privacy requirements, and cannot be scraped at will, so models must make the most of a fixed corpus. We present a systematic scaling-law study of video diffusion models trained from scratch on driving data: a family of models from 1M to 9B parameters, trained at different exposures on up to 5,500 hours of driving. Validation loss follows consistent power laws in both model size and training exposure, answering the questions that shape a training budget: whether compute is better spent on longer training or on a larger model, and whether more data is needed. Loss improves much faster with training exposure than with model size, making longer training the most effective way to improve a fixed model under limited compute. However, larger models continue to achieve lower asymptotic loss, so compute-optimal scaling still favors increasing model size when sufficient compute and data are available. Guided by these laws, we train a 9B-parameter model, to our knowledge the largest video diffusion model trained from scratch on driving data: it sets a new open-source state of the art for driving video generation, as measured on nuScenes. Our code and pretrained models are available at https://github.com/valeoai/VATIX. NATIX is separately releasing the underlying driving data in stages.

[68] Lossy Event Compression: From Event Stream Distortion to Task Performance cs.CV | eess.IVPDF

Zahra Rezaee, Catarina Brites, João Ascenso

TL;DR: 本文针对事件相机在高动态场景下产生海量数据带来的带宽与存储挑战，提出了两种有损压缩流水线：基于聚合的帧压缩（使用JPEG 2000）和基于点云的帧无关压缩（使用G-PCC）。论文建立了一个统一的任务驱动评估框架，首次将五种基于分类的失真度量应用于事件压缩，并验证了这些度量能可靠预测压缩对下游任务性能的影响。

Details

Motivation: 事件相机产生高时间分辨率的异步稀疏数据流，但在中高速运动场景下会产生极高的数据率，现有的事件流失真度量无法可靠预测压缩导致的任务级性能下降，迫使编解码器优化依赖昂贵的任务特定评估。

Result: 在视频重建、目标检测、光流估计和异步特征跟踪四个代表性任务上，实验结果表明，所提出的基于分类的失真度量能可靠地预测不同编码框架下压缩引起的任务性能退化，为事件数据编码方案的开发和优化提供了直接指导。

Insight: 创新点在于提出了两种不同范式的事件压缩流水线，并建立了一个统一的任务驱动评估框架，首次将基于分类的失真度量引入事件压缩领域，证明了事件流失真评估可以作为重复任务特定评估的有效替代方案。

Abstract: Event cameras generate asynchronous, sparse data streams with microsecond temporal resolution, but in moderate-to-high motion scenes they can produce as many as hundreds of millions of events per second, creating significant bandwidth and storage challenges. Lossy compression is therefore essential for practical deployment, yet existing event stream distortion metrics fail to reliably predict compression-induced degradation at the task level, forcing codec optimization to rely on expensive task-specific evaluations. To address this gap, this paper introduces two fundamentally different event compression pipelines: i) an aggregation-based pipeline that converts the event stream into polarity-based histogram frames for compression with the conventional image codec JPEG 2000, and ii) a frame-free point cloud-based pipeline that codes events natively as 3D points using the octree-based codec G-PCC. Both pipelines are then assessed within a unified task-driven evaluation framework that relates event stream distortion to downstream application performance across four representative tasks: i) video reconstruction, ii) object detection, iii) optical flow estimation, and a delay-sensitive task iv) asynchronous feature tracking under a reference-relative protocol. Building on this framework, five classification-based distortion metrics are applied to event compression for the first time, to the best of the authors’ knowledge, and benchmarked against existing event stream metrics. Experimental results demonstrate that the proposed metrics reliably predict compression-induced task degradation across different coding frameworks. This demonstrates that event stream distortion assessment can be an efficient alternative to repeated task-specific evaluation, providing direct guidance for the development and optimization of future event data coding solutions.

[69] ARC-CT: Anatomy-Routed Contrastive Vision-Language Learning for 3D Chest CT cs.CV | cs.AIPDF

Huseyin Umut Isik, Mehmet Alp Ozaydin, Sila Kurugol, Şeyda Ertekin

TL;DR: 本文提出ARC-CT，一种针对3D胸部CT的解剖结构引导对比视觉-语言学习框架，旨在解决传统全局对比学习在医学影像中因病灶局部性和共享异常而导致的性能限制。该方法通过器官掩码引导的局部化查询、标签重叠感知的软对比损失以及器官级对齐损失，仅利用LLM从报告中提取的标签进行无监督学习，无需人工标注或边界框。

Details

Motivation: 传统全局对比学习在胸部CT上存在两个挑战：一是关键异常通常小而局部，全局池化会稀释视觉证据；二是标准对比目标将批次内其他扫描均视为负样本，但许多CT共享异常，导致错误惩罚共阳性对。

Result: 在18种异常分类任务上，ARC-CT使用紧凑的3D ResNet-18骨干网络实现了0.86的宏观AUC（无需掩码标注），优于多个高效基线及更大的Transformer模型，达到先进水平。

Insight: 创新点包括：通过自动器官掩码约束查询实现解剖引导的局部证据定位；引入标签Jaccard软InfoNCE损失减少共享异常样本的假阴性惩罚；利用LLM提取器官特异性文本进行器官级对齐。这些设计提升了医学影像对比学习对局部病灶和标签噪声的鲁棒性。

Abstract: Contrastive vision-language learning uses paired chest CT volumes and radiology reports to learn abnormality classifiers without manually annotated labels. However, two characteristics of chest CT challenge conventional global contrastive learning. First, many critical abnormalities are small or anatomically localized, and pooling an en- tire volume into a single embedding may dilute their visual evidence. Second, the standard contrastive objective treats every other scan in a batch as a negative. Because many chest CTs share abnormalities, this objective incorrectly pushes co-positive pairs apart. We propose Anatomy-Routed Contrastive Learning for 3D Chest CT (ARC-CT), a region-aware framework that addresses these limitations using only la- bels extracted from reports by an LLM, with no manual annotations or bounding boxes. ARC-CT combines three components: (1) an Anato- myQFormer localizing evidence via queries constrained by automatically generated organ masks; (2) a label-Jaccard soft InfoNCE objective in- tegrating the standard one-hot target with the label-set overlap of each pair, which reduces false-negative penalties between studies that share clinical findings; and (3) an organ-level alignment loss connecting mask- pooled visual features to organ-specific report text extracted offline with a large language model. ARC-CT achieves a 0.86 mask-free macro AUC across 18 abnormalities using a compact 3D ResNet-18 backbone. Over- all, ARC-CT outperforms both comparable efficient baselines and sev- eral larger transformer models. Our code and weights are available at https://github.com/arc-ct/arc-ct.

[70] LayerRecall: A State-Conditioned Memory Router for Long-Horizon Consistency in Video Generation cs.CVPDF

Yixuan Ding, Jiahao Kong, Wei Huang, Ruijie Quan, Yi Yang

TL;DR: 本文提出了LayerRecall，一种状态条件化的记忆路由器，用于解决自回归视频扩散模型中长视频生成时的长期一致性问题。该方法通过分析视频DiT层对当前、近期和远期上下文的不同偏好，设计了一个层选择性的记忆检索机制，仅将相关历史K/V状态注入到对记忆敏感的特定骨干层中，同时保持其他层的局部注意力。

Details

Motivation: 现有的自回归视频生成模型基于最近上下文生成视频块，虽然基于最近性的缓存保持了局部连续性，但会驱逐当主体、对象、场景或属性重新出现时所需的历史线索。现有记忆机制虽然让模型能够接触到非局部历史，但单纯的访问并不能确保其被有效利用。

Result: 在100个多镜头评估提示上，LayerRecall在MemoBench和MovieBench上取得了最佳的整体结果，同时在VBench-Long上与骨干模型性能相当，证明了其在保持局部连续性的同时，实现了更强的长期恢复能力。

Insight: 核心创新点在于提出了一个当前状态条件化、层选择性的记忆路由器，它根据当前状态决定检索哪些历史K/V状态以及将其注入到哪些特定骨干层。此外，提出的跨视野预测匹配（CHPM）方法，利用一个具有长上下文特权的参考模型在预测空间监督有界记忆路由器，减少了对稀缺高质量长视频数据和显式记忆分配标签的依赖。

Abstract: Autoregressive video diffusion enables scalable long-video generation by producing chunks from a bounded recent context. While recency-based caching preserves local continuity, it evicts historical cues needed when subjects, objects, scenes, or attributes reappear. Existing memory mechanisms expose models to nonlocal history, but access alone does not ensure effective use. Our analysis reveals that video DiT layers exhibit distinct preferences for current, recent, and distant context, suggesting that long-range memory requires deciding both what to retrieve and where to use it. We introduce LayerRecall, a current-conditioned, layer-selective memory router that retrieves relevant historical K/V states and injects them only into backbone-specific memory-sensitive layers while preserving local attention elsewhere. To reduce reliance on scarce high-quality long-horizon videos and explicit memory-allocation labels, we further propose Cross-Horizon Prediction Matching (CHPM), which uses a privileged long-context reference to supervise the bounded-memory router in prediction space. Across 100 multi-shot evaluation prompts, LayerRecall achieves the best overall results on MemoBench and MovieBench while matching its backbone on VBench-Long, demonstrating stronger long-range recovery without sacrificing local continuity. Qualitative analyses further reveal memory-guided self-correction, whereby initially mismatched local attributes return to their historical appearance without resetting ongoing motion or scene structure. Additional analyses show cross-backbone portability and negligible inference overhead.

[71] Anatomy-Aware Promptable Segmentation with Online Interactive Training for AUTOPET V cs.CV | cs.AIPDF

Pablo Lozano-Jimenez, Sergio Romero-Tapiador, Ruben Tolosana

TL;DR: 本文提出了一种用于AUTOPET V挑战赛的、基于解剖学感知且支持提示交互的全身病灶分割模型。该方法基于nnU-Net系列模型，采用两阶段训练：预训练阶段生成初始分割，在线交互阶段学习利用涂鸦提示进行迭代优化。模型通过共享特征头进行器官监督以融入解剖上下文，并引入示踪剂分类器来路由FDG或PSMA PET/CT数据。

Details

Motivation: 解决在FDG和PSMA PET/CT中全身病灶分割的挑战，特别是在推理时示踪剂类型未知的情况下，减少生理性摄取导致的假阳性，并探索交互式提示对分割效果的提升。

Result: 在四折交叉验证中，器官监督模型取得了最佳且最稳定的性能；交互阶段随着每次提示的加入，Dice分数单调提升；针对PSMA的特定训练在示踪剂层面的结果最强。

Insight: 创新点在于将解剖学监督（器官分割）与病灶分割任务通过共享特征头结合以提升特异性，并设计了支持在线交互学习的提示机制。示踪剂分类器的引入有效处理了推理时示踪剂类型未知的实际情况。

Abstract: We present an anatomy-aware, promptable model for whole-body lesion segmentation in FDG and PSMA PET/CT, developed for the AUTOPET V challenge. The proposed method is built as family of nnU-Net-based models and trained in two stages: i) a pre-training stage that produces a strong initial segmentation, and ii) an online interactive stage that learns to exploit scribble prompts, refining the prediction over successive interactions. Anatomical context is incorporated through organ supervision using a single shared head that predicts lesions and organs from the same features, which reduces false positives arising from physiological uptake. Also as the tracer (i.e., FDG/PSMA) is not provided at inference, we add a tracer classifier based on image processing and a random forest over coronal MIP features, routing each study to a combined FDG+PSMA model or to a PSMA-specific model. Across four-fold cross-validation the organ-supervised model achieves the best and most stable performance, the interactive stage improves the Dice score monotonically with each prompt, and PSMA-specific training yields the strongest tracer-wise results.

[72] Texture Image Classification Using DWT AlexNet Feature Fusion and Deep Neural Networks cs.CV | cs.AIPDF

Arun D. Kulkarni

TL;DR: 该论文提出了一种名为DWT_AlexNet_DNN的混合特征融合框架，用于纹理图像分类。该框架结合了离散小波变换（DWT）提取的多尺度空间频率特征和AlexNet提取的深度特征，旨在提升分类性能。

Details

Motivation: 纹理图像分类在工业检测、医学图像分析等领域至关重要。手工特征虽能捕捉局部纹理但表征复杂模式能力有限，而深度学习模型虽能自动学习判别性表征却可能未充分利用纹理图像固有的多尺度空间频率信息。

Result: 摘要中未提及具体的定量实验结果、基准测试或达到的水平（如SOTA）。

Insight: 论文宣称的创新点在于将DWT的手工多尺度特征与AlexNet的深度特征进行融合，以互补优势。从客观角度看，这种结合传统信号处理与深度学习的混合方法，为充分利用纹理图像的多尺度信息提供了可借鉴的思路。

Abstract: Texture image classification plays a significant role in computer vision applications, including industrial inspection, medical image analysis, remote sensing, and object recognition. Handcrafted features can capture local texture characteristics but may have limited capability to represent complex visual patterns. In contrast, deep learning models automatically learn discriminative representations but may not fully exploit the multiscale spatial-frequency information inherent in texture images. This paper proposes a hybrid feature fusion framework, termed DWT_AlexNet_DNN, which combines Discrete Wavelet Transform (DWT) features with deep features extracted using AlexNet for texture image classification.

[73] Video Generative Models as Geometry Learner cs.CV | cs.AIPDF

Haosen Yang, Jifei Song, Zhensong Zhang, Xiatian Zhu, Jiankang Deng

TL;DR: 本文提出GeoNeNext方法，将预训练的视频生成模型重新用于几何估计任务，将其创新性地构建为下一帧预测问题，以实现数据高效且统一的深度和表面法线估计。

Details

Motivation: 现有基于图像扩散模型的几何估计方法要么独立训练任务特定模型，忽略了几何目标间的内在关联，要么需要大量标注数据联合微调模型，存在效率低下和数据需求大的问题。

Result: 在多个数据集上的零样本单目深度和表面法线估计实验中，该方法超越了之前的任务特定和统一生成式方法，且使用更少的训练数据；其性能可与使用超过100倍数据训练的判别式SOTA方法相媲美，甚至在多个基准测试中表现突出。

Insight: 核心创新在于将几何估计重新定义为视频生成模型中的下一帧预测任务，从而自然继承视频模型的结构化知识和丰富先验，实现图像与几何目标的联合建模，提升了数据效率和效果。

Abstract: Recent generative approaches to geometry estimation adapt pretrained image diffusion models and treat the task as image-conditioned generation. Leveraging off-the-shelf image diffusion models, they either (i) train task-specific geometry models (for depth and surface normal estimation) independently, losing the opportunity of exploring the intrinsic correlation of these geometric targets, or (ii) jointly fine-tune modified image diffusion backbones (e.g., altered self-attention), which typically demands substantial labeled data. To overcome these limitations in a principled fashion, we repurpose pretrained video generative models as a unified and data-efficient framework for geometry estimation, formulated innovatively as a next-frames prediction task. Our method, GeoNeXt, inherits naturally structured knowledge and richer priors from the video model, while further adapting them for joint modeling of images and geometry targets (image <-> geometry), enabling more data efficient and effective learning of geometry. Extensive experiments validate our method for zero-shot monocular depth and surface normal estimation across diverse datasets, outperforming both previous task-specific and unified generative competitors while using substantially less training data. Notably, our method rivals discriminative state-of-the-art approaches trained on over 100x more data and even standouts on several benchmarks.

[74] GeBDA: Building Damage Assessment as Text-Based Sequence Prediction cs.CVPDF

Olivier Dietrich, Krishna Sapkota, Konrad Schindler, Genady Beryozkin

TL;DR: 本文提出GeBDA方法，将建筑物损伤评估（BDA）重新定义为基于文本的序列预测任务，利用通用的视觉语言模型（VLM）仅通过自回归序列生成来定位建筑物并评估其损伤等级。该方法基于开源的Gemma模型，仅使用双时相卫星图像和合适的文本提示，即可实现有前景的损伤测绘结果。

Details

Motivation: 传统BDA方法依赖于专用网络架构或对地理空间图像基础模型进行微调，本文旨在探索通用VLM是否能够仅通过自回归序列生成来完成建筑物定位和损伤分级任务。

Result: 基于开源Gemma模型的初步实现，在仅使用双时相卫星图像和文本提示的条件下，取得了有前景的损伤测绘结果。

Insight: 创新点在于将BDA任务重新定义为预测一组可变长度的边界框及其损伤标签的序列生成问题，并验证了通用VLM（而非专用模型）通过纯文本序列生成完成此复杂视觉任务的可行性。

Abstract: Conventionally, Building Damage Assessment (BDA) is tackled either with dedicated network architectures or by fine-tuning geospatial image foundation models. In this work, we ask whether a general-purpose Vision-Language Model (VLM) can localize buildings and grade their damage through autoregressive sequence generation alone. We cast BDA as predicting a variable-length set of bounding boxes, each specified by its coordinates and a damage label. Our preliminary implementation, based on the open Gemma model, achieves promising damage mapping results from only bi-temporal satellite images and a suitable text prompt.

eess.IV [Back]

[75] Do Medical Vision Models Reason About Anatomy? Probing the Spatial Inductive Biases of Learned Visual Representations eess.IV | cs.AI | cs.CV | cs.LGPDF

Naren Akash, Neeraja Ramanan

TL;DR: 该论文构建了SPAR-Bench基准，用于评估医学视觉编码器在腹部CT扫描中对解剖结构的空间推理能力，包括坐标定位、关系推理和空间查询。研究发现，现有模型在切片内结构比较任务上表现不佳，其准确性主要依赖于对标准解剖位置的记忆而非图像计算，且模型池化特征会低估其表征能力。

Details

Motivation: 当前医学视觉编码器主要通过诊断准确性或多模态系统进行评估，难以判断其内部表征是否真正支持解剖学空间推理（如比较结构、判断距离和位置归属）。

Result: 在SPAR-Bench的八个探测任务中，模型在切片内比较任务上表现接近随机水平（0.7%），且预训练规模、微调或架构改进均未能缩小差距；使用池化头而非完整token读取特征可将关系推理准确率从0.7%提升至67.8%。四个开源多模态大语言模型（MLLMs）在编码器表现良好的任务上仅达到随机水平。

Insight: 创新点在于构建了专门评估医学视觉模型空间归纳偏见的基准SPAR-Bench，揭示了模型依赖解剖学先验记忆而非动态空间计算能力的局限性，并指出池化探测方法会严重低估表征的实际信息含量。

Abstract: Interpreting a CT scan means comparing structures on either side, judging how far apart organs sit, and knowing where each one belongs. Medical vision encoders are evaluated on diagnostic accuracy, or through assembled multimodal systems where a failure is hard to attribute, so it remains unclear whether their representations support any of this. We construct SPAR-Bench, eight probes over multi-organ abdominal CT that separate coordinate localization, relational reasoning, and spatial queries, and apply them to five architectural configurations and three medical foundation models, frozen and finetuned. Probes that ask for a comparison within the slice stay at chance, and neither pretraining scale, finetuning, nor architecture closes the gap. Probes that appear solved in domain fall to chance under zero-shot transfer, indicating that their accuracy reflects recall of canonical anatomy rather than computation over the image. Reading the same frozen features with a pooled head rather than the full set of tokens moves relational recovery from 0.7% to 67.8%, so pooled probing understates what a representation holds. Questions the encoders answer well are answered at chance by four open-weight MLLMs. Our results suggest these encoders carry a map of where organs usually lie, and little of the machinery for comparing structures within a particular patient. Code and data will be available at https://spar-bench.github.io.

cs.AI [Back]

[76] Retrieving Relations, Detecting Fallacies: A RAG Approach to Political Debate Analysis cs.AI | cs.CLPDF

Deborah Dore, Greta Damo, Elena Cabrio, Serena Villata

TL;DR: 本文提出了一种用于政治辩论分析的检索增强生成（RAG）方法，旨在自动检测谬误。该方法的核心创新在于利用论证话语中的支持与攻击关系，动态地引导从外部知识库中检索相关文档，从而为谬误检测和分类提供上下文知识。

Details

Motivation: 在政治辩论等敏感语境中，自动检测谬误至关重要。现有方法通常将论证结构编码为静态特征，灵活性有限。本文旨在解决这一问题，通过动态引导检索来整合论证关系知识，以提升检测性能。

Result: 在ElecDeb60to20基准测试上，该方法在42种检索配置和14个模型上进行了评估。相比非检索基线，它将谬误检测的macro-F1提升至0.864，将分类的macro-F1提升至0.725，证明了论证引导检索的有效性。

Insight: 主要创新点在于将论证关系（支持/攻击）作为动态引导信号来增强RAG中的检索过程，而非将其作为静态特征。这为需要复杂上下文推理的任务（如谬误分析）提供了一种更灵活的知识整合范式。

Abstract: Fallacies are arguments that employ invalid reasoning, making their automatic detection critical in sensitive contexts such as high-stakes political debates, where public opinion is shaped. Spotting a fallacious argument requires contextual knowledge beyond its pure surface text. This entails world knowledge pertaining to the subject matter under discussion, as well as knowledge of the relationships that exist between arguments within the argumentative discourse. Prior work on fallacy analysis has shown that argumentative discourse structure can beneficially improve classification performance. However, such structure is typically encoded only as static classifier features, limiting its flexibility. Building on this intuition while addressing this limitation, we introduce a guided retrieval-augmented methodology for fallacy detection and classification that leverages argumentative relations of support and attack to dynamically steer the extraction of relevant documents. We evaluate our approach on the ElecDeb60to20 benchmark across 42 retrieval configurations and 14 models, performing retrieval over a 15GB knowledge base of collected political-related documents. Our approach improves macro-F1 up to 0.864 for fallacy detection and up to 0.725 for classification over non-retrieval baselines. These results show that incorporating external knowledge significantly enhances fallacy detection and classification when retrieval is argumentatively guided.

[77] Benchmarking General Mobile Assistants in Challenging Real-World Scenarios cs.AI | cs.CVPDF

Yiqi Zhu, Feiyu Gao, Jiaxing Fan, Jiahui Zeng, Minggang Wu

TL;DR: 本文提出了GMA基准测试，用于评估通用移动助手在具有挑战性的现实场景中的性能。该基准包含七个基于开源应用程序的任务领域和300个跨四个难度级别的任务。评估发现，当前前沿模型在处理复杂任务时性能显著下降，且适当的代理框架设计能有效提升性能。

Details

Motivation: 现有移动代理基准测试（如AndroidWorld和MobileWorld）在应用覆盖范围和任务设计上未能充分捕捉现实移动使用的多样性和复杂性，因此需要一个新的基准来评估通用移动助手在真实挑战性场景中的能力。

Result: 在GMA基准上评估了八个前沿模型，结果显示随着任务复杂性增加，性能大幅下降，当前代理远未达到可靠处理现实用户需求的水平。消融研究表明，在共享环境、模型设置和任务分类下，适当的代理框架设计（如上下文保留和显式状态跟踪）能显著提升性能，尤其是在要求高的工作流中。

Insight: 创新点在于通过引入基于开源项目的多样化应用和分层任务设计，扩展了移动代理评估的应用覆盖和任务复杂性。客观分析认为，该研究强调了代理框架设计对复杂工作流执行的重要性，并为不同基础模型的有效设计提供了实证见解。

Abstract: Graphical user interfaces have emerged as an important environment for evaluating autonomous AI agents on multimodal interactive tasks. Existing benchmarks such as AndroidWorld and MobileWorld provide strong foundations for mobile agent evaluation, but their application coverage and task design do not yet fully capture the diversity and complexity of realistic mobile use. We present GMA, a benchmark for evaluating general mobile assistants in challenging real-world scenarios. GMA introduces seven applications based on open-source projects, spanning domains such as lifestyle sharing and travel planning, and 300 tasks across four difficulty tiers, from atomic actions to complex multi-step workflows. We evaluate eight frontier models and find that performance declines substantially as task complexity increases, with current agents remaining far from reliably handling realistic user requirements. We further conduct controlled ablation studies of agent harness choices, including context retention and explicit state tracking, under a shared environment, model setting, and task taxonomy. Results show that appropriate harness design can meaningfully improve performance, particularly on demanding workflows, while the effectiveness of specific designs can vary across foundation models. Overall, GMA complements existing benchmarks by expanding application coverage and task complexity, providing a challenging testbed for evaluating mobile agents and studying how harness design supports reliable execution in complex mobile workflows.

cs.CR [Back]

[78] Can Tainted Pixels Expose Deepfake Videos? cs.CR | cs.CVPDF

Juan Hu, Shaojing Fan, Sanjay Saha, Marc Herrera, Terence Sim

TL;DR: 本文提出了一种名为TaintedPixels的主动防御方法，旨在保护发布的人脸视频免受黑盒操纵工具的篡改。该方法通过在视频的蓝色通道中注入周期性扰动，使得水印在原始视频中不显眼，但在被下游工具处理后变得明显，从而有效暴露深度伪造视频。

Details

Motivation: 现有防御多为事后检测，且主要针对静态图像而非视频。研究缺乏对已发布视频的主动保护，以及对其感知效果的理解。本文旨在填补这一空白，提供一种针对黑盒操纵工具的主动视频保护方案。

Result: 在三个公开可用的现成视频操纵工具和两个现成检测器上，TaintedPixels实现了最高的伪造检测率，同时保持扰动极小（LPIPS = 0.0042）。人类研究显示，受保护源视频仅引起3.26%的怀疑，而源自受保护视频的伪造视频被识别为假的比例远高于源自未保护视频的伪造视频（90.72% vs. 56.71%）。

Insight: 核心创新在于提出了一种非对称可见性权衡的主动防御框架，专门针对黑盒视频操纵工具而非特定生成器。通过将结构化周期性扰动注入蓝色通道，并结合条纹可见性、色偏和视频级LPIPS约束进行优化，实现了轻量级且运动自适应的部署，在保持原始视频质量的同时有效暴露篡改。

Abstract: Publicly-acceesible face-manipulation tools have made deepfake creation accessible to non-expert users. Against these, existing defenses are mostly post-hoc, detecting only after forgery has occurred, and operating on still images rather than videos. Research is lacking in i) the proactive protection of published facial videos against black-box manipulation tools, and in (ii) understanding its perceptual effect on human viewers. We introduce TaintedPixels, a proactive video-protection method built around an asymmetric visibility trade-off: the embedded watermark should remain inconspicuous in the published video but become obvious once a downstream tool manipulates the video. TaintedPixels injects structured periodic perturbations into the blue channel of facial regions and refines them under stripe-visibility, color-cast, and video-level LPIPS budgets, with lightweight motion-adaptive deployment. We believe TaintedPixels is the first proactive defense designed specifically against black-box manipulation tools rather than image-level pipelines or specific surrogate generators. Across three publicly available off-the-shelf video manipulation tools and two off-the-shelf detectors, TaintedPixels attains the highest forgery fake rate while keeping perturbations small (LPIPS = 0.0042). Our non-expert human study, conducted on a diverse set of 300 video stimuli spanning different lighting conditions, backgrounds, and skin tones, shows that protected source videos draw a 3.26% suspicion rate, while forgeries from protected sources are identified as fake much more often than forgeries from unprotected sources (90.72% vs. 56.71%). This validates the effectiveness of TaintedPixels.

[79] Fully Unleashing the Multimodal Attacker: Meta-Adaptive Jailbreaking of Vision-Language Models cs.CR | cs.CVPDF

Benlei Cui, Shen Pang, Yuke Wang, Xuemei Dong, Yuwen Zhai

TL;DR: 本文提出了一种名为MAMJ的元自适应多模态越狱方法，通过优化攻击策略提示和攻击者权重来动态调整攻击过程，在MM-SafetyBench基准测试中对GPT-4o、Gemini-3-Pro-Preview和Seed 2.0等模型实现了超过80%的攻击成功率，显著优于现有基线方法。

Details

Motivation: 现有针对大型视觉语言模型的多模态越狱攻击在元层面通常是静态的，要么采用固定模板，要么仅调整内容而保持攻击策略不变，因此需要一种能够自适应优化攻击策略和参数的方法来更有效地测试模型安全性。

Result: 在MM-SafetyBench基准上，MAMJ对GPT-4o、Gemini-3-Pro-Preview和Seed 2.0的攻击成功率分别达到81.0%、78.9%和82.3%，比最强的样本级基线提升了高达24.1个百分点，且学到的攻击者能迁移到未见过的受害模型并在防御下保持有效。

Insight: 创新点在于首次在元层面同时优化攻击策略提示和攻击者权重，通过基于LLM的批评和群体聚合的ASR奖励进行双重更新，揭示了前沿VLM对元自适应攻击的系统性脆弱性，为防御元级对抗攻击提供了新方向。

Abstract: The safety of large vision-language models is increasingly stress-tested by multimodal jailbreaks, yet existing attacks remain largely static at the meta level: template-based attacks freeze the image–text layout, while iterative attacks adapt only the image–text content with fixed attack strategies and frozen attacker parameters. We propose Meta-Adaptive Multimodal Jailbreaking (MAMJ), which instead optimizes the attacker itself along two axes: an attack strategy prompt (ASP) $θ$ governing attack iteration and attacker weights $φ$ determining attack effectiveness. Across groups of multimodal attack trajectories, an LLM-based critique first refines $θ$, after which group-aggregated attack-success-rate (ASR) rewards update $φ$. On MM-SafetyBench, MAMJ achieves $81.0%$, $78.9%$, and $82.3%$ ASR against GPT-4o, Gemini-3-Pro-Preview, and Seed 2.0, respectively, outperforming the strongest sample-level baseline by up to $24.1$ percentage points. The learned attacker $(θ^\star,φ^\star)$ also transfers without retraining to unseen victims and remains effective under representative defenses. These results reveal a systemic vulnerability of frontier VLMs to meta-adaptive jailbreaks and motivate defenses against meta-level adversaries. Code is available at https://github.com/Alibaba-VELLDEPTH/MetaJailbreak-VLM.

stat.AP [Back]

[80] Climate Physics Dynamic Matching stat.AP | cs.CV | cs.LOPDF

Gurjeet Sangra Singh, Frantzeska Lavda, Alexandros Kalousis

TL;DR: 本文提出了Climate Physics Dynamic Matching (ClimPhyDM)，一个用于天气预报的变分、免模拟、物理信息框架。它将平流型物理先验与数据驱动组件结合，在ERA5基准测试的每小时（42小时）和每月（5个月）分辨率上，超越了ClimODE和GB-DM等模型，在更长预测时间上保持了更低的误差，并且其免模拟范式使得训练可以在单个12GB消费级GPU上完成。

Details

Motivation: 动机在于解决现有深度生成模型（如流匹配和扩散模型）作为黑盒忽略物理结构，而基于偏微分方程的物理模型又常因缺失源项或参数不确定而不完整的问题，旨在为天气预报开发一个结合物理先验与数据驱动优势的框架。

Result: 在ERA5基准测试中，ClimPhyDM在每小时（42小时）和每月（5个月）分辨率上均优于ClimODE和GB-DM，在扩展预测时间上保持了更低的误差，显示出更好的时间稳定性和抗误差累积能力。

Insight: 创新点在于提出了一个变分、免模拟的物理信息框架，将平流型物理先验与数据驱动组件有机结合，既利用了物理结构，又通过数据驱动捕获未解析大气动力学的随机性和多模态特性，同时实现了高效的单GPU训练。

Abstract: Deep generative models such as flow matching and diffusion models have shown potential for learning complex dynamical systems, but typically act as black boxes that neglect underlying physical structure, while physics-based models governed by partial differential equations are often incomplete due to missing source terms, or uncertain parametrisations. We present Climate Physics Dynamic Matching (ClimPhyDM), a variational simulation-free dynamics informed framework for weather forecasting that combines an advection-type physics prior with data-driven components in a variational framework. % to capture the stochasticity and multi-modality of unresolved atmospheric dynamics. On the ERA5 benchmark at hourly (42-hour) and monthly (5-month) resolutions, ClimPhyDM outperforms ClimODE, and GB-DM, keeping the lower error at extended horizon, indicating improved temporal stability and resistance to error accumulation, while its simulation-free paradigm also enables training on a single modest 12 GB consumer GPU.

cs.SD [Back]

[81] Auditing Generative Audio Calls for Known-Task Audio-LLM Evaluation cs.SD | cs.CL | eess.ASPDF

Mengzhe Geng

TL;DR: 这篇论文提出了一种审计生成式音频调用的方法，用于评估已知任务下的音频大语言模型。研究通过一个受控的调用决策问题，区分了利用声学证据和调用生成式音频模型两种因素对性能的影响。在VocalSound数据集上，实验表明，在已有转录文本和编码器证据的情况下，生成式音频调用的边际价值有限。

Details

Motivation: 当前语音和音频大语言模型的评估通常将声学证据的获取与生成式音频模型的调用混为一谈。论文旨在通过受控实验，量化在已知闭集任务中，生成式音频调用相对于仅使用转录文本和预训练编码器特征的边际贡献。

Result: 在VocalSound数据集上，仅使用转录文本的准确率为0.296。使用监督训练的CLAP和WavLM编码器（不调用生成模型）分别达到0.850和0.854的准确率。一个包含生成调用的选择器以12.5%的调用率达到了0.925的准确率，而与之匹配的无调用选择器准确率为0.921，配对差异为0.004（95% CI [-0.025, 0.033]），表明生成调用的边际提升不显著。

Insight: 论文的核心创新在于提出了一个受控的调用决策框架，用于分离和量化生成式音频模型在已知任务中的实际贡献。其客观分析表明，对于已知端点任务，在充分利用转录文本和预训练音频编码器特征后，调用生成式音频模型的边际价值可能很小，这挑战了单纯依赖生成模型调用进行性能比较的评估范式。

Abstract: Speech and audio LLMs are often evaluated by asking whether a waveform prompt beats an automatic speech recognition (ASR) transcript. For known closed-set tasks, that comparison conflates two factors: access to acoustic evidence and the need to call a generative audio model. We evaluate this distinction as a controlled call-decision problem. For each example, a policy chooses among keeping a transcript label, using encoder evidence from Contrastive Language-Audio Pretraining (CLAP), Audio Spectrogram Transformer (AST), or WavLM, and calling Qwen2-Audio, Qwen2.5-Omni, or MOSS-Audio; the decisive ablation removes all generative actions while keeping the selector and development protocol fixed. On VocalSound, transcripts reach 0.296 accuracy, so waveform information is needed. Yet supervised CLAP and WavLM controls reach 0.850 and 0.854 with no generative audio calls. A selector with generative actions reaches 0.925 accuracy using 12.5% calls, compared with 0.921 for the matched no-call selector (paired difference 0.004; 95% CI [-0.025,0.033]). Agreement and stacking features improve weaker selectors but do not beat the strongest no-call control. For known-task endpoint claims, the relevant quantity is the marginal value of the generative call after transcript and encoder evidence have already been used.

cs.LG [Back]

[82] VISTA: Verifier-Informed Student-to-Teacher Adaptation for On-Policy Self-Distillation cs.LG | cs.AI | cs.CLPDF

Zewen Ding, Zezhong Wu, Zhou Tao, Shida Wang, Shizhuo Hou

TL;DR: 本文提出了VISTA方法，用于改进策略内自蒸馏（OPSD）。该方法在保留标准OPSD学生模型更新的同时，利用经过结果验证的轨迹来调整教师模型，使其向学生模型的分布靠拢，从而解决教师模型目标与学生有效推理不匹配的问题。

Details

Motivation: 标准OPSD将教师模型的分布视为固定目标，仅更新学生模型，但当教师模型的分布与学生有效推理不一致时，这种单向监督可能会误导学生。

Result: 在AIME24、AIME25和HMMT25基准测试中，使用Qwen3模型的1.7B、4B和8B参数规模，VISTA在每个规模上都取得了最高的Avg@12分数，分别比OPSD提高了0.6、0.7和2.1个点。

Insight: 核心创新在于引入了基于结果验证轨迹的教师模型适应机制，特别是将适应过程限制在教师-学生KL散度最大的前k个位置。这种方法无需额外采样或单独的奖励目标，复用标准OPSD的轨迹和损失函数，实现了双向的师生协同优化。

Abstract: On-policy self-distillation (OPSD) improves reasoning by training a problem-only student on its own rollouts using dense token-level supervision from a privileged teacher that also sees a reference solution. However, standard OPSD treats the teacher distribution as a fixed target along the student’s rollout and updates only the student %, although – even though privileged conditioning does not guarantee that the teacher always provides the most appropriate target for problem-only reasoning. This one-way supervision can therefore misdirect the student when the teacher distribution is misaligned with valid student reasoning. We therefore introduce Verifier-Informed Student-to-Teacher Adaptation (VISTA), which preserves the standard OPSD student update while using outcome-verified rollouts to adapt the teacher toward the student distribution. Within each verified rollout, VISTA further restricts this adaptation to the top-$k$ positions with the largest teacher–student KL divergence. Notably, VISTA reuses the rollout and loss function from standard OPSD, introducing no additional sampling or separate reward objective. Across AIME24, AIME25, and HMMT25 with Qwen3 models at 1.7B, 4B, and 8B, VISTA achieves the highest Avg@12 at every scale, improving over OPSD by $0.6$, $0.7$, and $2.1$ points, respectively. These results demonstrate the value of student supervision from outcome-verified rollouts and highlight student-to-teacher adaptation as a promising direction for OPSD.

[83] A Deeper Analysis of Block-Sparse Featurizers cs.LG | cs.CVPDF

Alexandru-Iulius Jerpelea, Amith Ananthram

TL;DR: 本文对块稀疏特征化器（BSF）进行了深入分析，BSF是一种类似于稀疏自编码器（SAE）但以小块子空间为基本单元的特征提取方法，旨在处理视觉中常见的低维流形特征。研究发现BSF仍存在特征分裂和组合等经典SAE问题，并提出了包括锦标赛Top-K选择规则在内的架构改进，以减轻特征分裂，同时将块范式扩展到交叉编码器。

Details

Motivation: BSF被设计用于处理低维流形特征（在视觉中常见），但现有方法仍受限于SAE的经典失败模式，如特征分裂和组合，因此需要分析其优缺点并进行改进。

Result: 论文提出的改进（如锦标赛Top-K选择规则）显著减少了特征分裂问题，但未在摘要中提及具体基准测试或定量结果（如SOTA比较）。

Insight: 创新点包括将块稀疏范式从特征化器扩展到交叉编码器，以及引入锦标赛Top-K选择规则来缓解特征分裂，这为处理流形特征提供了更鲁棒的稀疏表示方法。

Abstract: The recently introduced block-sparse featurizer (BSF; Fel et al., 2026) is similar to a sparse autoencoder (SAE), but its atomic unit is a small subspace (a block of directions) rather than a single direction. It is designed for features that live on low-dimensional manifolds, which are especially frequent in vision. This work studies the BSF’s strengths and weaknesses, finding how it still somewhat suffers from classic SAE failure modes, like feature splitting and composition. We propose several architectural changes to the BSF, including a Tournament Top-K selection rule that significantly reduces feature splitting, and we also extend the block paradigm to the crosscoder.

physics.soc-ph [Back]

[84] Benchmarking large language model agent societies against human behavioural distributions physics.soc-ph | cs.CLPDF

Raad Bin Tareaf

TL;DR: 本文介绍了SILICA，一个用于评估大型语言模型（LLM）智能体社会行为与人类行为分布一致性的开源基准工具。该研究在五个具有已发表人类行为数据的环境中测试了12个开源模型，发现模型仅在初始行为（如公共物品博弈第一轮贡献）上与人类数据有部分一致，但在最终状态、合作动态及激励响应等方面均存在显著偏差，且模型行为对实验设置的微小扰动（如行动顺序）高度敏感。

Details

Motivation: 当前研究广泛使用LLM智能体群体作为实验社会，但其结果存在三个核心疑虑：智能体行为是否真正模拟人类、实验结果是否对实验装置的非规则性变化稳健、以及观察到的社会动态是真实互动还是模型对训练数据的复现。本文旨在系统性地测试这些疑虑。

Result: 在SILICA基准的五个环境中，11个模型中有8个在第一轮公共物品贡献上落在与人类数据的等效区间内，但没有一个模型能匹配最终贡献水平或人类的合作走廊。模型行为对实验设置的微小变化（如行动顺序）极其敏感，导致合作度大幅波动（如一个模型下降58点）。在响应固定报价序列的任务中，仅有一个经过推理训练的模型能正确设置接受阈值以符合激励要求。

Insight: 论文的核心创新点在于提出了一个系统性的、包含人类行为锚点、规则不变性扰动和反记忆化变体的基准测试框架SILICA，以量化评估LLM智能体社会的真实性。客观分析表明，当前LLM社会主要依赖于对名称的共享先验而非协商来形成惯例，且其行为稳健性不足，仅支持探索性研究主张，尚不能可靠地代表人类社会动态。

Abstract: Populations of large language model agents are increasingly used as experimental societies. Three doubts shadow every such result: whether the agents behave like the humans they stand in for, whether a finding survives changes to the apparatus that leave the rules untouched, and whether apparent social dynamics are interaction at all rather than the reproduction of experiments the models have read. This article introduces SILICA, an open instrument that tests all three. Five environments carry published human anchors, each paired with perturbations that re-render the same rules and with variants whose payoffs point away from the memorised result. Twelve open-weight models were run through it on a single consumer graphics card. Agreement with human data is confined to starting points: first-round public-goods contributions fall inside the equivalence margin for eight of eleven models, while no model matches end-state contributions or the human corridor of cooperation. Merely swapping the order in which two actions are listed costs one model 58 points of cooperation. Presenting responders with a fixed schedule of offers shows that only one model, the sole reasoning-trained one, places its acceptance threshold where the incentive requires; two move theirs part of the way, two move them the wrong way, and three never acquire one. Conventions form through a shared prior over the names rather than through negotiation, though negotiation reappears once that prior is disrupted. On the certification ladder defined here, current silicon societies support exploratory claims and no more.

cs.IT [Back]

[85] Ada-TokenCom: Rate-Adaptive Token Communications via Large-Model-Driven Token Compression and Generation cs.IT | cs.CV | eess.IVPDF

Zijun Zhang, Li Qiao, Mahdi Boloursaz Mashhadi, Zhen Gao, Mehdi Bennis

TL;DR: 本文提出Ada-TokenCom，一种基于大型自回归模型的速率自适应Token通信框架。它通过整合下一个令牌预测与算术编码，在令牌层面实现超低比特率语义通信，并采用混合重建/生成方案与基于Lyapunov的动态优化算法以适应时变网络条件。

Details

Motivation: 解决令牌通信中如何实现速率自适应、超低比特率的语义传输问题，以适应动态网络环境并提升通信效率。

Result: 仿真结果表明，Ada-TokenCom在性能上超越了基于数字通信和深度联合信源信道编码的语义通信基线方法。

Insight: 创新点在于将大型自回归模型的令牌预测能力与算术编码结合，实现令牌级的语义压缩与生成，并引入Lyapunov优化进行端到端自适应控制，为语义通信提供了新的高效框架。

Abstract: Token Communications (TokenCom) has recently emerged as a new paradigm in which tokens serve as unified units for communication and computation, enabling efficient multimodal semantic and goal-oriented transmission. In this paper, we develop Ada-TokenCom, a rate-adaptive TokenCom framework based on large autoregressive models, which integrates next-token prediction with arithmetic coding to achieve ultra-low bitrate semantic communication at the token level. We propose a mixed reconstruction/generation scheme, where the transmitter encodes and transmits the highly informative tokens at the beginning of the token sequence leveraging a pre-trained autoregressive large model, while the receiver uses an identical model to predict the rest. Moreover, we design a Lyapunov-based algorithm to dynamically optimize both the source compression rate and the modulation and coding scheme, adapting to time-varying network conditions. Simulation results demonstrate that our proposed Ada-TokenCom framework outperforms both digital and deep joint source-channel coding-based semantic communication baselines.

cs.RO [Back]

[86] Beyond Data Scaling: Representation-Centric Continued Pre-training for Vision-Language-Action Models cs.RO | cs.CVPDF

Senqiao Yang, Chengyao Wang, Yuxin Chen, Zixuan Wang, Longxiang Tang

TL;DR: 本文提出VLAct，一种面向视觉-语言-动作（VLA）模型的、以表征为中心的持续预训练方法。该方法在广泛的、异构的、多具身机器人数据上进行预训练，旨在将有限的机器人轨迹数据转化为可迁移的视觉-动作知识，而非仅仅拟合动作。实验表明，该方法在仿真、真实世界及未见具身迁移任务中，均能显著提升下游性能，并在多个基准上超越了现有工业级VLA系统。

Details

Motivation: 机器人轨迹数据难以像网络图像-文本数据那样大规模扩展，因为具身数据收集成本高且覆盖稀疏。这导致在固定机器人数据预算下，表征质量成为核心瓶颈。因此，研究目标是在有限数据下，通过持续预训练获得可迁移的视觉-动作知识，而不仅仅是过拟合特定动作。

Result: 在LIBERO-Plus和RoboTwin 2.0基准上，VLAct超越了ABot-M0和LingBot-VLA等工业VLA系统，成功率分别达到82.6%和92.5%。在RoboDojo上，其成功率排名第六，并在两项指标上超越了所有明确指定的世界-动作模型（WAM）参赛方案。在未见的人形机器人具身基准RoboCasa-GR1上，仅使用20%下游轨迹数据的VLAct超越了使用全数据的GR00T-N1.6基线。

Insight: 创新点在于提出了以表征质量为中心的持续预训练范式，而非单纯追求数据规模扩展。具体技术包括：VLM先验保持、多头连续动作协同监督以及部分统一的多具身动作布局，这些设计旨在保留广泛的视觉语言模型先验并鼓励跨具身的共享动作语义，同时允许在微调阶段使用任务特定的动作头。该方法表明，在适度计算预算下，表征中心的预训练是推动VLA模型进步的一个重要独立方向。

Abstract: Scaling robot data is crucial for building generalist Vision-Language-Action (VLA) models, yet robot trajectories are harder to scale than web-scale image-text data because embodied collection is costly and sparsely covers the physical world. This makes representation quality a central bottleneck: under a fixed robot-data budget, continued pre-training must turn limited trajectories into transferable visual-action knowledge rather than merely fit actions. We propose VLAct, a VLA-oriented VLM backbone trained on broad, heterogeneous, multi-embodiment robot data before task-specific fine-tuning. VLAct preserves the broad VLM prior and encourages shared action semantics across embodiments through VLM-prior preservation, multi-head continuous action co-supervision, and a partially unified cross-embodiment action layout, while allowing task-specific action heads during fine-tuning. Across simulation, real-world, and unseen-embodiment transfer, VLAct consistently improves downstream performance under fixed fine-tuning protocols. On LIBERO-Plus and RoboTwin 2.0, VLAct surpasses industrial VLA systems including ABot-M0 and LingBot-VLA, achieving success rates of 82.6% and 92.5%. On RoboDojo, VLAct ranks sixth among all policies by success rate and outperforms all explicitly designated world-action model (WAM) entries on both metrics. Most notably, on RoboCasa-GR1, an unseen humanoid embodiment, VLAct using only 20% of downstream trajectories outperforms the full-data GR00T-N1.6 baseline. These results are obtained using fully open-source data and only a 16-GPU training setup, showing that representation-centric continued pre-training can deliver highly competitive performance under a modest compute budget and is an important independent axis of VLA progress beyond data scaling.

[87] DeicticVLA: Unifying Instruction Modes Based on Language and Deictic Gestures in a Single VLA cs.RO | cs.CVPDF

Kango Yanagida, Tatsuya Aoki, Yuichiro Yoshikawa, Takato Horii

TL;DR: DeicticVLA提出了一种统一的视觉-语言-动作模型，通过文本提示补全和指示性手势定位，将语言指令、视觉-语言指令和视觉指令统一为文本提示和指示性掩码，使单个预训练的VLA能够处理所有三种指令模式。

Details

Motivation: 解决现有VLA模型在区分相同类别或相似外观物体中的目标或放置目标时，依赖可能不可靠的详细自然语言表达的问题。

Result: 在模拟实验中，两阶段训练下四种提示方法均实现了较高的分布内成功率，但在未见布局中使用指示性掩码的能力不同；在三个真实世界任务中，单一策略支持所有模式，VLI和VI在未见表达、外观变化和新物体下优于LI，对于未见类别两者达到100%成功率，而联合训练的LI仅为16.7%。

Insight: 创新点在于将多种指令模式统一为文本提示和指示性掩码的规范化方法，以及两阶段训练策略在提升指示性掩码使用能力和缓解遗忘方面的有效性，为VLA设计提供了统一的三模式接口指导。

Abstract: Vision-Language-Action models (VLAs) allow users to specify manipulation tasks in natural language, but distinguishing a target or placement goal among objects of the same category or similar appearance requires detailed expressions that VLAs may not use reliably. We propose DeicticVLA, which canonicalizes Language Instruction (LI), Vision-Language Instruction (VLI), and Visual Instruction (VI) into a text prompt and deictic masks through text-prompt completion and deictic gesture grounding, enabling a single pretrained VLA to handle all three instruction modes. With a shared backbone, demonstrations, and matched training steps, we compare two RGB visual prompting methods, two separate-channel mask prompting methods, and three training strategies in simulation. Under two-stage training, the four prompting methods achieve high in-distribution success but differ in their ability to use deictic masks in unseen layouts. Across methods, training-strategy ablations show that two-stage training improves such use, while retaining second-stage LI data mitigates forgetting without reducing VLI and VI performance. In three real-world tasks, one policy supports all modes. VLI and VI outperform LI under unseen expressions, appearance changes, and novel objects. For unseen categories, both achieve 100% success, compared with 16.7% for jointly trained LI. These results demonstrate the unified three-mode interface and guide DeicticVLA design.

cs.DC [Back]

[88] Memory-efficient GPU pipelines for real-time non-line-of-sight reconstruction cs.DC | cs.CVPDF

Alfonso López-Ruiz, Diego Royo

TL;DR: 本文针对非视距成像中的大规模重建计算瓶颈，通过重建GPU执行流水线，显著提升了两种波基算法的内存效率和实时处理能力。

Details

Motivation: 随着SPAD阵列采集吞吐量的提升，非视距成像中的大规模逆问题重建成为性能瓶颈，需要优化GPU内存使用和计算效率以实现实时处理。

Result: 优化后的实现比参考流式流水线快42倍，比已发布的最快GPU基线快14倍，同时内存占用降至2.5%，支持更大更精细的重建。

Insight: 通过离线组装传播核、融合内核、warp级光子分箱、批量变换和CUDA图重放等技术，在保持精度的同时大幅降低内存带宽需求，为下一代NLOS视频处理提供了可行的实时解决方案。

Abstract: Non-line-of-sight (NLOS) imaging reconstructs scenes hidden around a corner from indirect light recorded by a single-photon avalanche diode (SPAD). A single reconstruction is a large inverse problem: billions of photon timestamps must be binned, moved through memory, transformed and inverted. As SPAD arrays raise acquisition throughput, reconstruction becomes the limiting stage. We rebuild the GPU execution of two established wave-based algorithms, f-k migration and phasor-fields, for both streaming and offline processing. On the phasor-fields side we assemble the ring-and-radius kernels of previous work once and offline, using the analytic Fourier transform of a ring, so the propagation kernel never exists in dense form at runtime, reducing the memory and bandwidth. We reorganize the pipeline of both algorithms with fused kernels, warp-level photon binning, batched transforms, CUDA graph replay, and FP16 storage applied only where it reduces the actual bottleneck. Our implementations are up to 42x faster than the reference streaming pipeline and up to 14x faster than the fastest published GPU baseline, all while using a fraction of the memory (down to 2.5%), enabling vastly larger and finer reconstructions on the same hardware, or comparable ones within a much lower memory budget. We report an ablation of each implementation choice and propose three denoising strategies enabled by the resulting frame budget for next-generation NLOS video processing.

Table of Contents

cs.CL [Back]

[1] Sledgehammer or Scalpel? A Fine-grained Adaptive Framework for Implicit Hate Speech cs.CL | cs.AIPDF

[2] SciReC: Diagnostic Evaluation of Multimodal, Multi-Turn Relational Reasoning with Adaptive Interaction cs.CL | cs.AI | cs.LGPDF

[3] PACE: Publisher-Adaptive Content Extraction via Agentic Automation cs.CL | cs.AIPDF

[4] XHotpotQA: A Benchmark for Cross-Lingual Knowledge Composition in Multi-Hop Question Answering cs.CL | cs.AIPDF

[5] A Survey on Rubric-Guided Reinforcement Learning for Language Models cs.CL | cs.AIPDF

[6] INSPIRE: An Internalize-Then-Improve Approach for Example-Driven Mathematical Reasoning cs.CLPDF

[7] When Tokenizers Fail: Byte-Level Chunking for Zero-Shot Transfer to Low-Resource Languages cs.CLPDF

[8] Trajectory-Level Speculative Decoding for Diffusion Language Models cs.CL | cs.AIPDF

[9] Below the Noise Floor: Bimodal Seed Collapse and Distinct Failure Modes in Small-Model Knowledge Distillation cs.CLPDF

[10] Load-Bearing Context: The Question Damage Score for Evaluating Context Reliance in Linguistic Reasoning cs.CLPDF

[11] Compositional Failure in Audio-Visual LLMs: Late-Layer Prior Dominance Under Cross-modal Conflict cs.CL | cs.AIPDF

[12] Synthetic Linguistic Agency: How an Embodied Mortal Agent Learns Linguistic Affordances through Consequential Social Experience cs.CL | cs.MAPDF

[13] QUORUM: QUality-Optimized Routing Using Multiple annotators cs.CLPDF

[14] Twin Worlds: Equivariance-Based Abstention for Evidence-Grounded Reasoning cs.CL | cs.AI | cs.LGPDF

[15] A Shaky Voice Is Not Always a Dodge: Benchmarking Textual and Vocal Evasion Detection in Earnings Calls cs.CL | cs.SDPDF

[16] FinExam-10K: When Retrieval Helps Financial Reasoning? cs.CLPDF

[17] Embedding Models for Stance-Aware Argument Retrieval cs.CL | cs.AIPDF

[18] A Probabilistic Interpretation of KV Cache Eviction cs.CL | cs.AIPDF

[19] A Unified Framework to Elicit Structured Feedback for Interpretable Multi-Trait Essay Scoring cs.CLPDF

[20] Sliding-window beats linear attention cs.CL | cs.LGPDF

[21] Are These Modules Worth Their Cost? A Paradigm-Level Accuracy-Cost Analysis of In-context Learning Text-to-SQL cs.CL | cs.AI | cs.DBPDF

[22] Acquire, Repair, Preserve: A Diagnosis-Guided Post-Training Recipe for Small-Model Dialogue Game Agents cs.CL | cs.LGPDF

[23] ContextPilot: Teaching Agents for Proactive Context Management via Fine-grained RL cs.CLPDF

[24] Blind Men and the Elephant: Probing the Epistemic Myopia of LLMs under Long-Tail Divergent Knowledge cs.CLPDF

[25] NL2AGBench: Benchmarking LLM Auto-Formalization for AlphaGeometry cs.CL | cs.AIPDF

[26] A Formal Limitation on Learning Human Language From Textual Corpora cs.CLPDF

cs.CV [Back]

[27] Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction cs.CVPDF

[28] Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoning cs.CVPDF

[29] VidParse: Online Parsing of Egocentric Procedures Like a Pro cs.CVPDF

[30] Quanta Perception as Probabilistic Events cs.CV | cs.AIPDF

[31] Report Supervision cs.CVPDF

[32] What Can Low Resource Languages Learn From Each Other? cs.CVPDF

[33] uScenes: A Multimodal RGB and 3D Sonar Dataset for Underwater Robot Perception cs.CVPDF

[34] From Perspective to Fisheye Depth Estimation and Open-Vocabulary Segmentation cs.CV | cs.AIPDF

[35] Iron: Intent-Aligned and Retrospective Dual Learning Framework for Enhancing Generalist Virtual Agents cs.CVPDF

[36] Relational Knowledge Distillation Brings DNN Representations Close Enough to Humans to Be Aligned Without Supervision cs.CV | q-bio.NCPDF

[37] Temporal Tree of Thought: Reasoning-Guided Visual Cue Search for Long-Video Understanding cs.CVPDF

[38] What Do Interaction Representations Actually Measure? Pre-Event Separability in Weakly-Supervised Violence Detection cs.CV | cs.LGPDF

[39] StreamEMS: Streaming Video Understanding with Self-Evolving Memory Scheme for Vision-Language Models cs.CVPDF

[40] CommerceVibe: Learning to Design E-Commerce Creatives as Executable Visual Code via Dual-Feedback Reinforcement Learning cs.CVPDF

[41] DensityKV: Density-Guided KV Cache Compression for Long Video Generation cs.CVPDF

[42] Training-Free Temporal Abstraction for General Video Understanding cs.CVPDF

[43] GAAT: Geometry-Aware Alignment Transformer for Multimodal UAV Perception cs.CVPDF

[44] A-PAIR: A Benchmark and Identity-Consistent Grounding Framework for Air-Ground Cross-View Referring Person Detection cs.CV | cs.MMPDF

[45] Visual Token Coding for Video Multimodal Large Language Models cs.CVPDF

[46] 3D-USE: From Image-Level to Scene-Level Underwater Enhancement cs.CVPDF

[47] Dynamic Alignment Compensation for Hallucination Mitigation in Large Vision-Language Models cs.CV | cs.AIPDF

[48] Task-State Adaptation with Prototype Memory for Multi-Task Dense Prediction cs.CVPDF

[49] Attribute Token Arithmetic: Disentangled and Continuous Semantic Control for Visual Autoregressive Models cs.CVPDF

[50] Token-Budget Distillation: Transferring Full-Token Semantics to Compressed Video Vision-Language Models cs.CVPDF

[51] Dual-Stream Semantic Guidance with Prototype Anchor Calibration for Source-Fully-Free Adaptation of Vision-Language Models cs.CVPDF

[52] EXPOSE: Explainable and Domain-Robust Embeddings from Pathology Vision Foundation Models using Sparse Autoencoders cs.CV | cs.LGPDF

[53] Manifold4D: Denoising on Point Cloud Rendered Manifolds for Video Re-shooting cs.CVPDF

[54] Locate Anything in Videos: Rethinking Efficient Generative Spatio-Temporal Video Grounding cs.CVPDF

[55] Explainable Diabetic Retinopathy Classification Using Vision Foundation Models cs.CV | cs.LGPDF

[56] WALDO: One-Shot Exemplar-Conditioned Object Detection in Cluttered Scenes cs.CVPDF

[57] Focus Where It Counts: A Salience-Driven Vision-Language Model for Low Vision Assistance cs.CVPDF

[58] RASA: Disentangled Spatial-Motional Priors for Cross-Identity Character Animation cs.CVPDF

[59] A comprehensive and trustworthy benchmark of AI methods for change detection in Earth observation cs.CV | cs.AIPDF

[60] Synth-JDoc: Synthesizing a Japanese Document Image Dataset for OCR with Diverse Layouts and Embedded Images cs.CV | cs.CLPDF

[61] AIM: Anchor Identity Features, Then Match for Multimodal Large Language Model Unlearning cs.CV | cs.CLPDF

[62] Abstract4D: A Large-Scale Dataset and Framework for Understanding the Visual Language of Abstract Art cs.CVPDF

[63] Conditional Visual Evidence Utility: State-Dependent Rank Reversals in Frozen Vision-Language Encoders cs.CVPDF

[64] Cross-Spectral Dense Correspondence for Multimodal Spectral Medical Imaging cs.CV | cs.AIPDF

[65] Semantic Head Specialization Guides Hybrid ViT Attention for Multimodal LLMs cs.CV | cs.CLPDF

[66] Post-Training VLMs for Video Mistake Detection cs.CV | cs.LGPDF

[67] How Far Can 5,500 Hours of Driving Take You? A Scaling Law Analysis of Video Diffusion Models cs.CVPDF

[68] Lossy Event Compression: From Event Stream Distortion to Task Performance cs.CV | eess.IVPDF

[69] ARC-CT: Anatomy-Routed Contrastive Vision-Language Learning for 3D Chest CT cs.CV | cs.AIPDF

[70] LayerRecall: A State-Conditioned Memory Router for Long-Horizon Consistency in Video Generation cs.CVPDF

[71] Anatomy-Aware Promptable Segmentation with Online Interactive Training for AUTOPET V cs.CV | cs.AIPDF

[72] Texture Image Classification Using DWT AlexNet Feature Fusion and Deep Neural Networks cs.CV | cs.AIPDF

[73] Video Generative Models as Geometry Learner cs.CV | cs.AIPDF

[74] GeBDA: Building Damage Assessment as Text-Based Sequence Prediction cs.CVPDF

eess.IV [Back]

[75] Do Medical Vision Models Reason About Anatomy? Probing the Spatial Inductive Biases of Learned Visual Representations eess.IV | cs.AI | cs.CV | cs.LGPDF

cs.AI [Back]