cs.CL [Total: 17]
cs.CV [Total: 44]
cs.CR [Total: 1]
cs.AI [Total: 6]
stat.ME [Total: 1]
cs.RO [Total: 3]
cs.LG [Total: 4]
eess.IV [Total: 2]

cs.CL [Back]

[1] When Reasoning Narrows the Move: Diversity Collapse in LLM Game Play cs.CLPDF

Junyi Sha, Renfei Tan, David Simchi-Levi

TL;DR: 本文研究了监督微调（SFT）对大型语言模型在顺序决策中行为多样性的影响。通过在井字棋变体等确定性棋盘游戏中进行实验，发现推理生成模式会抑制动作多样性，而标准SFT在提升准确性的同时，会引发过早的多样性崩溃。研究提出动作增强训练可以部分缓解此问题。

Details

Motivation: 动机是探究SFT如何影响LLM在顺序决策任务中的行为多样性，这是一个尚未被充分探索的领域。

Result: 在基于井字棋变体的确定性棋盘游戏套件中，实验表明标准SFT提高了动作准确性，但导致了超出准确性-多样性权衡最小需求的过早多样性崩溃。动作增强训练方法被证明可以部分缓解这种崩溃。

Insight: 创新点在于将‘窄支撑模仿’识别为LLM决策中策略崩溃的一个来源，并强调了在SFT过程中保持动作支撑集对于维持探索行为的重要性。动作增强是一种有潜力的缓解方法。

Abstract: Supervised fine-tuning (SFT) is widely used to adapt large language models to downstream tasks, but its effect on behavioral diversity in sequential decision-making remains under-explored. We study this question in a controlled suite of deterministic board games based on tic-tac-toe variants, where optimal actions are exactly computable and diversity can be measured directly. Across state-level evaluation, arena gameplay, and training trajectories, we find that reasoning-mode generation frequently suppresses action diversity without uniformly improving action accuracy. Furthermore, standard SFT improves accuracy but often induces premature diversity collapse, which exceeds what is minimally required by the accuracy-diversity tradeoff. We then show that action augmentation, which trains on all optimal actions per state rather than a single demonstrated action, would partially mitigates this effect. Our results identify narrow-support imitation as a source of policy collapse in LLM decision-making and suggest that preserving action support during SFT is important for maintaining exploratory behavior.

[2] Scaling Laws for Hypernetwork-Based Knowledge Injection in Large Language Models cs.CL | cs.LGPDF

Nischay Dhankhar, Dos Baha, Abulhair Saparov

TL;DR: 本文研究利用超网络进行大规模知识注入到大型语言模型中的缩放规律。通过训练超网络生成固定的LoRA适配器，使目标模型能够回答基于事实知识库的问题，并首次系统性地探索了超网络架构在知识注入任务中的缩放行为。

Details

Motivation: 解决如何可靠且大规模地将事实知识注入大型语言模型的问题，探索超网络在训练时知识注入中的应用潜力，并研究其缩放规律。

Result: 在构建的大规模数据集MegaWikiQA（包含数千万个跨39个领域的多跳问答对）上评估，结果表明超网络注入在所有架构维度上均呈现可预测的幂律缩放，且在分布外泛化方面表现出比LoRA微调和全微调更优的缩放指数。

Insight: 创新点在于将超网络用于训练时知识注入并系统研究其缩放规律，揭示了超网络在知识注入任务中具有可预测的缩放行为和优越的泛化能力，为大规模知识注入提供了新的可扩展方案。

Abstract: Injecting factual knowledge into large language models (LLMs) reliably and at scale remains an open challenge. Hypernetworks provide a promising solution to large-scale knowledge injection. Although hypernetworks are typically applied for test-time adaptation, we explore their use in train-time knowledge injection, where, given a large corpus of facts, we train a hypernetwork to generate a fixed LoRA adapter that, when inserted into the target model, enable the model to answer questions about those facts. In this work, we investigate whether hypernetworks can be used to perform train-time knowledge injection and how this ability varies with scale. The scaling behavior of hypernetworks remains largely unstudied. Our design decouples the hypernetwork’s injection capacity from the target model’s general capability, enabling, for the first time, a rigorous study of scaling laws for hypernetwork architectures. We characterize how loss, reasoning accuracy, and out-of-distribution (OOD) generalization vary with hypernetwork depth, width, and target network size. We construct a large-scale dataset, called MegaWikiQA, containing tens of millions of multi-hop question-answer examples across 39 domains constructed from examples in Wikidata5M. Our results reveal: (i) hypernetwork-based injection exhibits broadly predictive power law scaling along all architecture axes; and (ii) hypernetworks are capable of reliable OOD generalization at increasing scales, suggesting that hypernetwork provides a promising alternative to other train-time adaptation methods such as LoRA finetuning and full fine-tuning, exhibiting steeper scaling exponents in all OOD evaluations. Together, these results establish hypernetworks as a principled and scalable substrate for train-time adaptation, and provide the first empirically grounded scaling laws to guide hypernetworks for factual reasoning in large language models.

[3] Adaptive Capitulation: A Structural Failure Mode of LLM Responses in Vulnerability Contexts cs.CL | cs.AI | cs.MAPDF

Eunna Lee

TL;DR: 本文研究了大型语言模型在情感敏感情境下的结构性困境，发现当前模型在应对脆弱用户请求时存在三种回应模式：保护性限制、无情感倾向的协助，或两者未整合的共存。通过实验，作者识别出一种名为‘适应性屈服’的新型失效模式，即模型先承认用户痛苦背后的社会不公，随后又详细协助其获取本应劝阻的信息。

Details

Motivation: 解决LLM在情感敏感情境中面临的结构性困境：当脆弱用户请求可能强化不良归因的信息时，现有回应架构无法同时满足保护用户和提供有效协助的双重目标，导致模型回应存在缺陷。

Result: 通过对三个商业LLM进行900次三回合脆弱情境测试，使用VCC/VCI二元指标编码，实验揭示了‘适应性屈服’这一先前未记录的失效模式，并证明该困境是结构性的而非偶然。

Insight: 创新点在于识别并命名了‘适应性屈服’这一LLM失效模式，并提出了‘最小再归因充分性’设计原则，通过在验证性回应中嵌入单一再归因线索，在尊重用户目标的同时保留自主再归因路径，为解决结构性困境提供了架构中立的解决方案。

Abstract: Large language models operating in emotionally sensitive contexts face a structural trilemma: when users in vulnerable states request information that may reinforce maladaptive attribution, current response architectures resolve the tension through protective restriction, uninflected facilitation, or unintegrated co-presence of both imperatives – each preserving one objective at the cost of the other. Administering a three-turn escalating vulnerability vignette to three commercial LLMs (900 sessions across material, relational, and somatic status-proxy variants) and coding responses with two binary indices (VCC/VCI), we characterize a previously undocumented failure mode we term adaptive capitulation: the model validates the social injustice underlying the user’s distress before pivoting to detailed facilitation of the very acquisition it nominally discouraged. We show that the trilemma is structural rather than incidental, and propose Minimal Reattributive Sufficiency (MRS), an architecture-neutral design principle that embeds a single reattributive cue within an otherwise validating response, preserving a pathway toward autonomous reattribution without contesting the user’s stated goal.

[4] Reference-Free Evaluation of Reasoning in Open-Ended Question Answering cs.CL | cs.AI | cs.LGPDF

Guneet Singh Kohli, Yuxiang Zhou, Michael Sejr Schlichtkrull, Gregory E Dean, Maria Liakata

TL;DR: 本文提出了一种基于推理的无参考评估框架，用于审核大语言模型生成的开放式问答输出。该方法将生成的推理轨迹分解为片段，使用自然语言推理标注局部前提-目标关系，并组织成超图，通过确定性后向AND-OR搜索分配片段级审核标签。在数学推理和医学推理两个场景中验证了其有效性。

Details

Motivation: 解决高风险领域中大语言模型生成答案流畅但难以验证的问题，特别是当答案包含多步推理而非单一最终答案时，需要一种无参考的评估方法来审核推理过程。

Result: 在Hard2Verify数学推理数据集和UroReason医学推理基准上，该框架比直接使用大语言模型作为评判者的基线方法提供了更可靠的评估信号；在临床场景中，SOTA大语言模型评判者常无法识别有问题的推理片段，而该方法能有效检测弱基础推理。

Insight: 创新点在于将推理轨迹建模为超图并进行结构化搜索来评估局部推理关系的组合，而非仅依赖最终答案或大语言模型验证；提出了新的医学推理基准UroReason并开源代码。

Abstract: AI-generated answers in high-stakes domains are often fluent but difficult to verify, especially when they contain multi-step reasoning rather than a single final answer. We propose a reasoning-based, reference-free framework for auditing LLM-generated outputs. The method decomposes a generated reasoning trace into segments, labels local premise-target relations using Natural Language Inference (NLI), and organizes these relations into a hypergraph. A deterministic backward AND-OR search then assigns segment-level audit labels that indicate how each segment is grounded within the generated response. We evaluate the framework in two settings: deductive mathematical reasoning with Hard2Verify, and open-ended medical reasoning with UroReason, a new physician-annotated benchmark of LLM reasoning traces from real clinical cases. Across these settings, our NLI-hypergraph audit provides a more reliable reference-free evaluation signal than direct LLM-as-judge baselines. In the clinical setting, state-of-the-art LLM judges often fail to identify problematic reasoning segments, over-accepting fluent but weakly grounded responses. Our results show that QA evaluation should account for how inferential relations compose across a reasoning trace, rather than relying only on final answers or LLMs as verifiers. UroReason will be made available through an API, and our code will be released as open source.

[5] SLPO: Scaling Latent Reasoning via a Surrogate Policy cs.CL | cs.AI | cs.LGPDF

Runyang You, Zhiyuan Liu, Yongqi Li, Wenjie Li

TL;DR: 论文提出了Surrogate Latent Policy Optimization (SLPO)方法，旨在将基于结果的奖励强化学习应用于自回归潜在推理器。该方法通过引入一个经验性的代理策略密度来处理潜在状态转移的轨迹级信用分配，并利用一个由正确性监督的停止头，通过结果奖励优化将其改进为可变时长的策略。

Details

Motivation: 当前，显式思维链推理器通过可验证奖励的强化学习实现了测试时的扩展，但计算成本高昂，因为每个中间步骤都需要解码为语言标记。而潜在推理将中间计算作为连续向量进行，已在较短时域内匹配或超越显式思维链，但缺乏可处理的每步似然和固定思考预算下的自适应停止接口，导致无法通过结果奖励实现测试时扩展。

Result: 在连续和软思考设置下，SLPO在并行采样中提高了Pass@k性能，并为更难的实例分配了更长的潜在计算时间，从而实现了更高的确定性准确率。

Insight: 论文的创新点在于提出了SLPO框架，通过代理策略密度和可变时长停止策略，解决了潜在推理中轨迹级信用分配和自适应停止的挑战，使潜在推理器能够利用结果奖励进行优化，从而在测试时实现扩展。

Abstract: Reinforcement learning with verifiable rewards has become the predominant recipe for eliciting test-time scaling in explicit Chain-of-Thought reasoners. Yet this scaling path remains computationally costly, since every intermediate step must be decoded as a language token. Latent reasoning instead carries intermediate computation as continuous vectors and already matches or surpasses explicit CoT at far shorter horizons. Despite this promise, latent reasoners remain largely imitation-bound, while explicit CoT has already moved past imitation via outcome-reward RL. Latent trajectories lack a tractable per-step likelihood and an adaptive stopping interface under fixed thinking budgets, so outcome rewards cannot elicit latent test-time scaling. We introduce Surrogate Latent Policy Optimization (SLPO) to bring outcome-reward RL to autoregressive latent reasoners: an empirical surrogate policy density over latent transitions for trajectory-level credit assignment, and a correctness-supervised stopping head that outcome-reward optimization refines into a variable-horizon policy. Across continuous and soft thinking settings, SLPO improves Pass@$k$ under parallel sampling and allocates longer latent computation to harder instances with higher deterministic accuracy.

[6] VizRAG: Enhancing Retrieval-Augmented Generation with Hypergraph Visualization cs.CLPDF

Yanbin Wei, Yang Chen, Renling Gan, Ziru Liu, Xinyu Fu

TL;DR: 该论文提出了VizRAG，这是首个支持视觉超图结构感知的检索增强生成系统。它通过将超图的可视化表示整合到RAG流程中，旨在解决现有基于超图的RAG框架局限于文本模态、未能充分利用多模态大语言模型视觉能力的问题。

Details

Motivation: 当前基于超图的RAG系统虽然能组织复杂的多元原子事实，但其知识检索与重建主要局限于文本模态，未能充分利用现代多模态大语言模型强大的视觉感知能力。

Result: 实验结果表明，VizRAG显著优于多个强基线模型，验证了超图可视化作为一种RAG系统新方法的巨大潜力。

Insight: 核心创新点在于首次将超图的可视化表示引入RAG系统，实现了对超图结构的视觉感知，从而将多模态大语言模型的视觉能力与超图的结构化知识优势相结合，为RAG系统开辟了新的感知维度。

Abstract: Hypergraph-based RAG systems surpass traditional graph-based approaches by organizing complex n-ary atomic facts among entities, rather than relying solely on binary relationships. Despite the advancements in multimodal large language models (MLLMs) with enhanced visual capabilities, current hypergraph-based RAG frameworks predominantly restrict knowledge retrieval and reconstruction to a unimodal, text-centric paradigm. This limitation prevents them from fully leveraging the powerful visual perception capabilities of modern MLLMs. To address this gap, we systematically explore the integration of hypergraph awareness in RAG systems through visual cues. By incorporating visual representations of hypergraphs into the RAG pipeline, we introduce VizRAG, the first RAG system to support visual hypergraph structure awareness. Experimental results demonstrate that VizRAG significantly outperforms strong baselines, validating the promising potential of hypergraph visualization as a novel approach for RAG systems.

[7] Sentence Splitter: Uncovering Latent Factual Structure for Self-Supervised Learning cs.CL | cs.AIPDF

Ahmad Pouramini, Mahsa Afsharizadeh

TL;DR: 本文提出Sentence Splitter，一种基于T5编码器-解码器架构的自监督框架，旨在揭示自然语言句子中潜在的事实结构。该方法将句子分割视为离散分割问题，通过概率序列生成学习恢复事实性补全，并利用符号化头-尾对生成自然语言模板进行训练。训练后的分割器从原始文本中提取对齐的前缀-尾对，进而训练生成模型以提出更多合理的补全，形成一个统一且可扩展的流程。

Details

Motivation: 解决自然语言句子中潜在事实结构（描述性前缀与事实性补全之间的语义边界）的自动发现问题，旨在为知识中心型NLP任务提供结构感知的自监督训练数据，并弥合符号知识与自然语言之间的差距。

Result: 实验表明，所提出的分割器能够泛化到合成模板之外，且这种结构感知的监督持续提升了知识图谱补全和常识问答等下游任务的性能，突显了恢复潜在事实结构的有效性。

Insight: 创新点在于将句子分割形式化为离散分割问题，并通过概率序列生成而非显式搜索来学习边界；同时，通过符号头-尾对的言语化生成监督信号，并结合轻量级引导过程构建自监督数据，提供了一种可扩展且结构感知的方法来连接符号知识与自然语言处理。

Abstract: This paper introduces Sentence Splitter, a self-supervised framework built upon a T5-based encoder–decoder architecture for uncovering the latent factual structure of natural language sentences. The proposed method identifies the semantic boundary between a descriptive prefix (head) and its factual completion (tail) by formulating sentence splitting as a discrete segmentation problem, where a sentence of length $N$ admits $N$ possible split points but only one recovers the intended head–tail structure. Rather than explicitly searching over all candidate boundaries, the model learns to recover the factual completion through probabilistic sequence generation. To eliminate the need for manual annotation, symbolic head–tail pairs are first verbalized into natural-language templates that provide supervision for training the Sentence Splitter. The trained splitter is then applied to raw text to extract aligned prefix–tail pairs, which are subsequently used to train a generative model that proposes additional plausible completions through a lightweight bootstrapping process. This unified pipeline provides a scalable and structure-aware approach to constructing self-supervised training data while bridging symbolic knowledge and natural language. Experiments on both structured and naturally occurring text demonstrate that the proposed splitter generalizes beyond synthetic templates and that the resulting structure-aware supervision consistently improves downstream performance on knowledge graph completion and commonsense question answering, highlighting the effectiveness of recovering latent factual structure for knowledge-centric NLP.

[8] Efficient Chain-of-Modality Reasoning via Progressive Compression for Spoken Language Models cs.CL | cs.SDPDF

Pengchao Feng, Chao-Hong Tan, Qian Chen, Wen Wang, Xiangang Li

TL;DR: 本文提出了一种名为高效模态链推理（ECoM Reasoning）的框架，旨在提升口语语言模型在口语数学问答任务上的推理能力。该框架通过压缩文本组件，使其同时作为语音指导和推理表示，从而在比标准模态链架构使用更少文本标记的情况下提高推理准确性。此外，作者还提出了渐进式压缩训练策略，以逐步训练模型从完整形式推理过渡到压缩推理。

Details

Motivation: 口语语言模型的推理能力落后于基于文本的大语言模型，尤其是在口语数学问答任务上，一个重要原因是其推理依赖于纯口语化的数学表达式，这比符号文本更难解释。然而，由于架构限制和额外的计算需求，直接将基于文本的推理方法迁移到口语语言模型并非易事。

Result: 在口语数学问答基准测试上的实验表明，ECoM Reasoning 相比无显式推理的标准模态链架构，准确率提升了21%；相比带有完整推理轨迹的模态链架构，准确率提升了3%，同时仅使用了40%的文本标记，证明了其在保持推理高效性的同时增强了SLM的推理能力。

Insight: 论文的创新点在于首次将压缩推理引入口语语言模型，提出了ECoM Reasoning框架，通过压缩文本实现多模态信息的紧凑表示和高效利用。从客观角度看，其提出的渐进式压缩训练策略是一种有效的课程学习方法，有助于模型平稳学习复杂的压缩推理能力，这种将推理过程压缩并整合到单一模态表示中的思路，对于多模态模型的效率优化具有借鉴意义。

Abstract: Spoken language models (SLMs) enable natural human-computer interaction, but their reasoning ability still lags behind that of text-based large language models, especially on spoken mathematical question answering tasks. One important reason is that SLMs reason over purely verbalized mathematical expressions, which are harder to interpret than symbolic text. However, directly transferring text-based reasoning to SLMs is nontrivial due to architectural constraints and the additional computational requirements. To address this challenge, we propose Efficient Chain-of-Modality Reasoning (ECoM Reasoning), the first framework to introduce compressed reasoning into SLMs. By compressing the textual component so that it jointly serves as speech guidance and reasoning representation, ECoM Reasoning improves reasoning accuracy while using a smaller token budget than the standard Chain-of-Modality (CoM) architecture, which generates intermediate text before speech. To train this capability, we further propose Progressive Compression, a curriculum-based strategy that gradually trains the model from full-form reasoning to compressed reasoning. Experiments on spoken mathematical question answering benchmarks show that ECoM Reasoning improves accuracy by 21% over standard CoM without explicit reasoning, and by 3% over CoM with full reasoning traces while using only 40% of the text tokens, demonstrating that it enhances SLM reasoning while remaining inference-efficient.

[9] Overview of FinMMEval 2026 Task 1: Multilingual Financial Multiple-Choice Question Answering cs.CL | cs.AI | cs.CEPDF

Zhuohan Xie, Yuyang Dai, Rania Elbadry, Vanshikaa Jani, Georgi Georgiev

TL;DR: FinMMEval 2026 Task 1是一个多语言金融选择题问答评测任务，涵盖英语、中文、阿拉伯语和印地语。该任务旨在评估系统在跨语言和文字的情况下，处理金融领域术语、数值解释和概念性金融推理问题的能力。最终测试集包含每种语言200道题，共800道题，根据准确率独立排名，提交系统使用了检索增强、答案选项直接评分、特定语言提示、选择性自洽性、置信度检查和基于LLM的审查阶段等多种技术。

Details

Motivation: 该任务的动机是评估和推动多语言金融领域问答系统的发展，解决系统在理解不同语言和文字的金融术语、数值及概念推理方面的能力问题。

Result: 在最终排行榜中，英语和阿拉伯语的最高准确率达到97.5%，印地语为92.0%，中文未明确提及具体数值但参与排名。每个语言独立排名，提交数量分别为英语13个、中文11个、阿拉伯语11个、印地语10个，领先团队在四种语言中均表现优异。

Insight: 论文的创新点在于构建了一个覆盖多种语言和文字（包括非拉丁文字）的金融领域评测基准，并展示了领先系统采用的多技术融合策略（如检索增强和选择性自洽性），这为开发鲁棒的多语言金融AI系统提供了可借鉴的方法。

Abstract: FinMMEval 2026 Task 1 evaluates multilingual financial multiple-choice question answering in English, Chinese, Arabic, and Hindi. The task tests whether systems can select the correct answer to finance questions involving domain terminology, numerical interpretation, and conceptual financial reasoning across languages and scripts. The final-test set contains 800 questions, with 200 questions per language; gold answers were withheld during submission, and each language was ranked independently by accuracy. The final leaderboards contain 13 English, 11 Chinese, 11 Arabic, and 10 Hindi ranked submissions. Top accuracies range from 92.0% in Hindi to 97.5% in English and Arabic, with the same leading teams appearing near the top across all four languages. The documented systems used retrieval augmentation, direct answer-option scoring, language-specific prompting, selective self-consistency, confidence checks, and LLM-based review stages.

[10] A Multi-Dimensional Evaluation of Explainability in Media Bias Detection cs.CLPDF

Ting Chen, Raina Zhang, Benjamin M. Ampel, Sagar Samtani

TL;DR: 本文对基于编码器的媒体偏见检测模型的可解释性进行了多维度评估，使用BABE数据集研究了BERT和RoBERTa模型在预测性能、解释合理性（与专家标注的对齐度）和机制忠实性（注意力头能否在反事实掩码下恢复预测信号）三个轴上的表现。

Details

Motivation: 自动检测媒体偏见具有挑战性，因为偏见框架往往微妙，且仅靠准确预测不足以满足新闻分析等领域的需求，需要能反映模型底层推理的解释。

Result: 研究发现，预测性能、归因合理性和机制忠实性表征了模型行为的不同方面，在媒体偏见检测的可解释性研究中应分开评估；注意力监督微调可干预归因合理性，但归因方法的有效性因架构而异；电路分析显示不同架构的机制可恢复性存在显著差异，模型规模本身不决定电路可压缩性。

Insight: 创新点在于提出了一个涵盖预测性能、解释合理性和机制忠实性的多维度可解释性评估框架，并引入注意力监督微调作为干预手段；客观分析认为，该研究强调了在复杂任务（如媒体偏见检测）中，单一指标不足以全面评估模型可解释性，需结合多种互补的评估轴。

Abstract: Detecting media bias automatically is difficult because biased framing is often subtle, yet in domains such as news analysis, accurate predictions alone are insufficient without explanations that reflect the model’s underlying reasoning. We present a multi-dimensional evaluation of explainability in encoder-based media bias detection using the Bias Annotations By Experts (BABE) dataset. Specifically, we study BERT and RoBERTa as classifiers (base and large variants) along three complementary axes: predictive performance, explanation plausibility (token-level alignment with expert rationales), and mechanistic faithfulness (whether compact sets of attention heads recover predictive signal under counterfactual rationale masking). To induce variation in plausibility, we additionally investigate attention-supervised finetuning, which incorporates expert rationale annotations as an auxiliary training signal. Attention supervision serves as an intervention on attribution plausibility, while the effectiveness of attribution methods varies substantially across architectures. Circuit analysis further reveals substantial variation in mechanistic recoverability across architectures, suggesting that model scale alone does not determine circuit compressibility. Taken together, our findings suggest that predictive performance, attribution plausibility, and mechanistic faithfulness characterize different aspects of model behavior and should be evaluated separately when studying explainability in media bias detection.

[11] Reinforcement Learning for Large Language Model Selective Evidence Adoption from Contaminated Retrieval Results cs.CL | cs.AIPDF

Yanyu Chen, Yue Li, Yongyi Cui, Dongsheng Shi, Lichang Dai

TL;DR: 该论文针对检索增强大语言模型在处理混杂检索结果时面临的挑战，提出了一种基于强化学习的选择性证据采纳方法。作者构建了SelectBench基准和训练集，并使用DAPO（确定性规则奖励或冻结语义评判器）对Qwen3.5-4B模型进行后训练，以提升模型在有用证据与误导性内容交织的上下文中，选择性采纳相关信息并拒绝有害内容的能力。

Details

Motivation: 检索增强大语言模型在实际应用中常遇到检索结果混杂有用证据与误导性指令或陈述的情况，全盘拒绝会丢弃有效信息，而无批判采纳则会导致错误或不安全的回答，因此开发选择性采纳能力对于可靠部署至关重要。

Result: 在SelectBench-v2测试集上，经过DAPO训练的模型（DAPO-Rule和DAPO-DeepSeek）将严格成功率从原始检查点的22.46%分别提升至25.54%和26.46%，减少了有害内容采纳并生成了更简短、聚焦的响应，但在提示注入跟随方面未改善。模型在MMLU和干净HotpotQA基准上未出现能力退化。

Insight: 论文的创新点在于构建了专门用于评估选择性证据采纳的基准SelectBench，并应用强化学习后训练策略来优化这一能力。从客观角度看，该方法为提升大模型在嘈杂检索环境下的鲁棒性提供了一种可行的技术路径，同时揭示了提示注入抵抗和统计鲁棒性仍是未来需要解决的关键挑战。

Abstract: Retrieval-augmented large language models frequently face contexts that interleave useful evidence with misleading statements or instruction-like content. Blanket refusal discards valid evidence, whereas uncritical adoption yields incorrect or unsafe answers. The ability to selectively adopt relevant information while rejecting deceptive or harmful content is therefore critical for reliable deployment in real-world retrieval settings. We introduce SelectBench, a controlled benchmark and training set for selective evidence adoption, and post-train Qwen3.5-4B directly with DAPO using either deterministic rule rewards or a frozen semantic judge. On the corrected 325-example SelectBench-v2 test set, strict success rises from 22.46% for the original checkpoint to 25.54% with DAPO-Rule and 26.46% with DAPO-DeepSeek. Both trained policies reduce forbidden-content adoption and produce shorter, more focused responses, yet prompt-injection following does not improve. The paired gains are modest and fail to survive Holm correction, suggesting that stronger reward shaping or additional training iterations may be needed for more robust gains. DAPO-DeepSeek exhibits no material degradation on MMLU or clean HotpotQA, indicating that the post-training procedure preserves general capabilities. These results demonstrate a directional improvement in selective evidence use, while identifying injection resistance and statistical robustness as important remaining challenges for future work.

[12] Language-Specific versus Cross-Lingual Knowledge Graphs for Implicit Aspect Identification in Arabic: A Comparative Study of Reasoning and Adaptation Strategies cs.CL | cs.AIPDF

Lujain A. Alawwad

TL;DR: 本文针对阿拉伯语基于方面的情感分析（ABSA）中的隐式方面识别问题，比较了两种知识图谱构建策略：复用成熟的英语知识图谱（跨语言策略）与构建原生阿拉伯语知识图谱（语言特定策略）。研究在一个统一的混合流程中评估了这两种策略，并在三个阿拉伯语基准数据集（M-ABSA、SemEval-2016 Arabic和HAAD）上进行了测试。此外，论文还比较了为知识图谱提供输入的生成式提取器的两种适应策略：零样本提示与任务特定微调。

Details

Motivation: 阿拉伯语ABSA需要识别文本中明确提及和隐含未提及的方面。对于资源较少的语言，隐式识别通常依赖辅助知识源（如知识图谱），但面临设计选择：是通过多语言嵌入复用成熟的英语知识图谱，还是构建较小的原生阿拉伯语知识图谱。本文旨在通过受控比较，评估这两种策略的有效性。

Result: 在三个阿拉伯语基准数据集上，原生阿拉伯语知识图谱（策略2）的表现优于跨语言英语知识图谱（策略1），在M-ABSA上micro-F1提升+0.199，在SemEval-2016上提升+0.251，精确率和召回率均有增益。任务特定微调将显式提取的micro-F1从零样本的<=0.13提升到M-ABSA和SemEval-2016的0.66-0.76（在较小的HAAD上为0.45），表明在形态丰富的语言中，任务适应比模型规模更具决定性。

Insight: 论文的创新点在于对阿拉伯语隐式方面识别中知识图谱构建策略进行了系统的比较研究，揭示了语言特定知识图谱相对于跨语言知识图谱的优势。同时，通过比较生成式提取器的适应策略，强调了在形态丰富的低资源语言中，任务特定微调比零样本提示更有效，这为类似语言的NLP任务提供了重要的实践指导。

Abstract: Aspect-based sentiment analysis (ABSA) in Arabic must recover both explicitly stated aspects and implicit aspects that are never named in the text. Implicit identification typically relies on an auxiliary knowledge source (e.g., a knowledge graph (KG)) linking opinion cues to aspect categories, but for a lower-resource language the practitioner faces a design choice: reuse a mature English KG through multilingual embeddings, or build a smaller native Arabic KG. This paper reports a controlled comparison of the two strategies within a single hybrid pipeline, evaluated on three Arabic benchmarks (M-ABSA, SemEval-2016 Arabic, and HAAD). We further compare two adaptation strategies for the generative extractor that feeds the KG – zero-shot prompting versus task-specific fine-tuning of an 8B-parameter large language model (LLM). The native Arabic KG (Strategy 2) outperforms the cross-lingual English KG (Strategy 1) by +0.199 micro-F1 on M-ABSA and +0.251 on SemEval-2016, gaining on both precision and recall. Task-specific fine-tuning raises explicit-extraction micro-F1 from <= 0.13 (zero-shot) to 0.66-0.76 on M-ABSA and SemEval-2016 (0.45 on the smaller HAAD), confirming that task adaptation, rather than model scale, is decisive in a morphologically rich language.

[13] OpenSkillRisk: Benchmarking Agent Safety When Using Real-World Risky Third-Party Skills cs.CLPDF

Qiyuan Liu, Tingfeng Hui, Kun Zhan, Kaike Zhang, Ning Miao

TL;DR: 该论文提出了OpenSkillRisk基准，用于评估LLM智能体在使用现实世界第三方技能时的安全性。该基准包含从公开技能市场收集的263个风险技能，分为七类威胁类型，并配以标准化用户任务和沙箱进行受控评估。实验覆盖三个主流CLI智能体框架和13个SOTA LLM，发现即使最安全的配置仍有约17%的情况会执行不安全操作，且当前系统难以避免上下文依赖和系统级风险。

Details

Motivation: 研究动机是系统调查当前智能体系统在识别和避免第三方技能引入的潜在安全风险方面的能力，这些风险在实际执行中才显现，而现有基准缺乏对此类现实场景的覆盖。

Result: 在OpenSkillRisk基准上的实验结果表明，所有测试系统（包括三个CLI智能体框架和13个SOTA LLM）均无法可靠处理风险技能，最安全配置的不安全操作执行率仍达约17%，尤其在上下文依赖和系统级风险方面表现不佳。

Insight: 创新点在于构建了一个专注于第三方技能安全性的细粒度基准，提供了行为模式诊断；客观分析揭示了智能体三种常见失败模式：未能识别风险、识别后未能及时干预或超出用户意图范围执行技能指令，这凸显了改进LLM风险推理和智能体框架执行控制的必要性。

Abstract: LLM-based agents leverage third-party skills to extend their capabilities in open-world scenarios. However, third-party skills can introduce extra security vulnerabilities, as seemingly harmless skills can contain latent safety risks that only emerge during actual execution. In this work, we conduct a systematic investigation into how well current agent systems recognize and avoid such risks. To support quantitative and qualitative evaluation, we construct OpenSkillRisk, a dedicated safety benchmark containing 263 risky skills collected from public skill marketplaces. We classify these skills into seven categories based on their threat types and pair each skill with a standardized user task and a corresponding sandbox for controlled evaluation. Distinct from prior benchmarks, OpenSkillRisk not only covers more realistic and diverse unsafe scenarios, but also provides a fine-grained analysis to diagnose the behavioral patterns of agents in such scenarios. We conduct comprehensive experiments covering three mainstream CLI agent frameworks and thirteen state-of-the-art LLMs. Experimental results show that no tested system handles risky skills reliably: even the safest configurations still execute unsafe actions in about 17% of cases. Context-dependent and system-level risks are especially difficult for current agent systems to avoid. Our behavioral analysis reveals three recurring failure patterns: agents may fail to recognize the risk, recognize it but fail to intervene before acting, or follow skill instructions beyond the user’s intended scope. These findings highlight the need to improve both risk reasoning in LLMs and execution control in agent frameworks.

[14] Back to Back with a Copy: A Computational Analysis of AI-Generated Visual Contemporary Art Pastiches cs.CLPDF

Anca Dinu, Andreiana Mihail, Andra-Maria Florescu, Claudiu Creanga, Liviu Dinu

TL;DR: 本文旨在评估新型生成模型在模仿当代艺术作品风格方面的能力，并探究不同大语言模型在风格评价多维特性上的一致性。通过使用五种互补的计算机视觉模型分析AI生成仿作与十二位当代艺术家原作之间的风格相似性，研究发现新模型在语义对齐和多样性方面有所提升，但在颜色、纹理等浅层特征上略有不足。研究证实艺术风格本质上是多维的，其测量不依赖于特定空间架构，并辅以艺术家本人的反馈进行验证。

Details

Motivation: 研究动机是评估新一代生成模型在创作当代艺术仿作上的进步，并探索风格评价的多维特性在不同大语言模型中的一致性。

Result: 实验结果显示，新模型在语义对齐和多样性方面优于先前模型，但在颜色、纹理和感知一致性等浅层特征上表现稍逊；这些定量结果通过艺术家的人类评估得到验证。

Insight: 创新点在于采用多模型互补方法量化艺术风格的多维特性，并强调风格评估不依赖于空间架构；研究结合人类反馈，为AI艺术生成提供了更全面的评估框架。

Abstract: The aim of this paper is twofold. First, it investigates whether newer generative models are getting better at pastiching contemporary artworks. Second, it explores the consistency of the multidimensional nature of stylistic evaluation across different LLMs. Building on previous work, we analyze stylistic similarity between AI generated pastiches and the original artworks of twelve contemporary artists. We used five complementary computer vision models to capture texture, color, semantics, composition, and perceptual features through cosine distance in high-dimensional embedding spaces. The distances obtained show that the newer image generation model that we used has produced pastiches with improved semantic alignment and greater diversity than the model used in previous work. However, it was slightly less performant on shallow features such as color, texture, and perceptual adherence. Our findings confirm that artistic style is inherently multidimensional, and measuring it does not depend on any spatial architecture. These quantitative findings are contextualized through feedback from human evaluators, which are the artists themselves.

[15] SLAI T-Rex: Full-Parameter Post-training of the DeepSeek-V4 Family on Ascend SuperPOD cs.CL | cs.AIPDF

Dongfang Li, Xiaodong Luo, Ruoyu Sun, Xuhui Chen, Linyuan Qiu

TL;DR: 本文介绍了SLAI T-Rex，一个在昇腾NPU集群上对万亿参数MoE模型DeepSeek-V4进行全参数后训练的端到端优化框架。该工作解决了大规模分布式训练中的内存压力、通信开销和内核执行效率等系统级挑战，并在此基础上构建了面向复杂运筹学任务的CPT和SFT工作流，最终训练出的专用模型在零样本评估中超越了GPT-5.4-Mini等模型。

Details

Motivation: 解决在昇腾NPU集群上进行万亿参数规模MoE模型全参数后训练时面临的严重系统级挑战，包括内存压力、通信开销和内核执行效率低下，并探索如何基于此高效基础设施构建面向特定领域（如运筹学）的专用模型。

Result: 优化后的系统实现了34.22%的模型FLOPs利用率，相比开源基线配方提升了2.93倍。基于DeepSeek-V4-Flash训练的运筹学专用模型在零样本Pass@1评估中取得了71.81%的最高平均分，分别比GPT-5.4-Mini和基础DeepSeek-V4-Flash模型高出3.98和11.27个百分点。

Insight: 创新点在于提出了一个面向昇腾NPU的、涵盖模型并行、计算-通信编排和底层内核执行的分层优化框架，有效提升了万亿参数模型训练效率；同时，展示了从高效基础训练到领域专用模型（结合领域资源与求解器验证的合成数据）的完整技术路径，为复杂推理任务的前沿模型系统提供了实践范例。

Abstract: Full-parameter post-training of trillion-parameter-scale MoE models introduces substantial system-level challenges for large-scale distributed training, including severe memory pressure, non-overlapped communication overhead, and inefficient kernel execution. While most large-scale LLM training systems are built around GPU-based clusters, this report presents an end-to-end optimization practice on the Ascend NPU SuperPOD. Using the DeepSeek-V4 model family as the target workload, we develop a hierarchical optimization framework spanning model-level parallelism, computation-communication orchestration, and low-level kernel execution. The resulting system achieves 34.22% Model FLOPs Utilization (MFU) with a 2.93x improvement over the open-source baseline recipe while maintaining training stability. Building on this optimized infrastructure, we further establish a CPT and SFT workflow for complex Operations Research (OR) tasks. We refer to the integrated framework as SLAI T-Rex. Using DeepSeek-V4-Flash, we develop OR-oriented CPT and SFT data pipelines that combine collected domain resources with solver-verified synthetic optimization documents. The resulting dataset contains 10K high-quality SFT samples spanning four task categories and three problem representations. The specialized model achieves the highest average zero-shot Pass@1 score among the evaluated models, reaching 71.81% and outperforming GPT-5.4-Mini and the base DeepSeek-V4-Flash model by 3.98 and 11.27 percentage points, respectively. Overall, this work demonstrates a full-stack pathway from efficient trillion-parameter model post-training on Ascend infra to domain-specialized Flash models for solver-grounded mathematical modeling, advancing frontier-model systems for complex reasoning.

[16] PyroDash: Cost-Efficient Token-Level Small-Large Language Model Collaborative Inference cs.CLPDF

Niqi Lyu, Pengtao Shi, Wei Qiu, Jianlin Zhong, Sicong Xia

TL;DR: PyroDash是一个成本感知的令牌级小语言模型与大语言模型协同推理框架。该框架通过在小语言模型中内化策略，使其在生成过程中决定是否请求大语言模型协助，从而在保持强大推理性能的同时显著降低推理成本。

Details

Motivation: 解决大语言模型推理成本高而小语言模型在复杂问题上可靠性不足的问题，旨在通过协同推理实现成本与性能的平衡。

Result: 在五个数学推理基准测试中，PyroDash支持不同的准确率-成本操作点：例如，在λ=0.05时，平均准确率达到64.04%，比仅使用大语言模型的基线高6.36个百分点，同时成本降低20.4%；在λ=0.6时，准确率为54.55%，大语言模型令牌使用率仅为1.90%，每个示例调用大语言模型0.012次，总成本从49.36美元降至1.78美元。

Insight: 创新点包括将协同策略内化于小语言模型，无需单独的路由器、大语言模型重训练或访问其logits；采用三阶段训练方法（控制令牌嵌入学习、卸载导向的监督微调、成本感知对齐），并通过奖励函数平衡准确率与归一化推理成本，实现了高效的令牌级协作推理。

Abstract: Large language models (LLMs) provide strong reasoning capabilities but are expensive to serve at scale, whereas small language models (SLMs) are cheaper but less reliable on difficult problems. We introduce PyroDash, a cost-aware framework for token-level SLM-LLM collaborative inference. During generation, the SLM decides whether to request assistance by emitting a control token. A Collaborate Engine then sends the query and partial reasoning trace to a frozen LLM for completion through a single handoff. The policy is internalized in the SLM, requiring neither a separate router, LLM retraining, nor access to LLM logits. PyroDash trains the SLM in three stages: control-token embedding learning, offloading-oriented supervised fine-tuning, and cost-aware alignment with Group Relative Policy Optimization. Its reward balances answer accuracy against inference cost normalized by LLM-only inference. Across five mathematical reasoning benchmarks, PyroDash supports different accuracy-cost operating points. With $λ=0.05$, it achieves 64.04 percent average accuracy, 6.36 percentage points above the LLM-only baseline, while reducing cost by 20.4 percent. With $λ=0.6$, it achieves 54.55 percent accuracy with a 1.90 percent LLM token ratio and 0.012 LLM calls per example, reducing total cost from USD 49.36 to USD 1.78. These results show that learned token-level handoffs can reduce LLM use while preserving strong reasoning performance.

[17] Notes to Self: Can LLMs Benefit from Experiential Abstractions? cs.CLPDF

Chang Liu, Xinyu Li, Artur Dubrawski

TL;DR: 本文研究大型语言模型（LLMs）是否能像人类一样从经验中提炼可重用的抽象（如策略和警示性提醒）并加以应用，以更有效地解决问题。通过从LLMs在MATH训练集上的解题轨迹中提取自然语言抽象，构建可检索库，并探索推理时检索和基于抽象增强提示的强化学习两种使用模式。实验表明，经验抽象能提升LLMs在数学和逻辑推理基准上的性能，且自我提取的抽象与教师提取的效果相当，该框架可迁移到其他数据集和模型。

Details

Motivation: 研究动机是探索LLMs是否能模仿人类将经验提炼为可重用抽象（如策略和提醒）的能力，以增强其问题解决效率，特别是在数学和逻辑推理任务中。

Result: 在数学和逻辑推理基准测试中，经验抽象显著提升了LLM性能；自我提取的抽象与教师提取的效果匹配，且该框架可成功迁移到其他数据集和模型，验证了其泛化能力。

Insight: 创新点在于提出了一种让LLMs从自身解题经验中自动提取自然语言抽象并构建可检索库的框架，结合推理时检索和强化学习两种模式，模拟了人类利用经验抽象的过程，为LLM的持续学习提供了新思路。

Abstract: Humans distill experience into reusable abstractions, e.g., strategies and cautionary reminders, and apply them to gradually solve problems more effectively. We study whether Large Language Models (LLMs) can similarly benefit from such experiential abstractions. From LLMs’ solution traces on the MATH training set, a stronger teacher or the LLMs themselves extract natural-language abstractions into a retrievable library. We explore two usage modes: (1) inference-time retrieval and (2) reinforcement learning (RL) with abstraction-augmented training prompts. Experiential abstractions improve LLM performance on mathematical and logical reasoning benchmarks. Self-extracted abstractions match teacher-extracted ones, and our abstraction usage framework can transfer to other datasets and models. These findings suggest LLMs can extract and apply experiential abstractions much as humans leverage distilled experience.

cs.CV [Back]

[18] Crowd4D: Scene-Aware Monocular 4D Crowd Reconstruction cs.CVPDF

Hongbo Kang, Tianyi Zhou, Qingyang Yang, Hongwei Wen, Jing Huang

TL;DR: 论文提出了Crowd4D，这是首个面向大规模场景、从单目RGB视频中联合优化人群与场景的4D人群重建框架。该方法通过引入人-场景交互代理（HSIP）作为中间表示，并结合人群结构一致性正则化（CSCR），有效解决了复杂地形下深度模糊和空间漂移的挑战，实现了场景感知的、时空一致的单目4D人群运动重建。

Details

Motivation: 从单目视频中恢复大规模场景下与场景一致的4D人群运动极具挑战，主要源于严重的深度模糊和复杂的场景几何。现有方法通常依赖单一平面假设，在复杂地形下会导致不可靠的度量尺度和空间漂移。

Result: 大量实验表明，Crowd4D在复杂的大规模真实世界场景中，持续优于现有的最先进（SOTA）方法，实现了鲁棒的单目4D人群重建。

Insight: 核心创新在于提出了场景感知的联合优化框架，并引入了人-场景交互代理（HSIP）作为编码显式场景几何先验的中间表示，重新定义了优化空间。此外，提出的人群结构一致性正则化（CSCR）利用基于HSIP的空间先验，增强了遮挡下的时间稳定性。

Abstract: Recovering scene-consistent 4D crowd motion from monocular video in large-scale scenes remains challenging due to severe depth ambiguity and complex scene geometry. Existing monocular crowd reconstruction methods typically rely on single-plane assumptions, leading to unreliable metric scale and spatial drift under complex terrain. We propose Crowd4D, the first scene-aware 4D crowd reconstruction framework that jointly optimizes the crowd and scene from a monocular RGB video in large-scale scenes. Crowd4D explicitly incorporates scene geometry and ensures consistency across image and scene spaces via a multi-stage optimization strategy. A key bottleneck of this task lies in accurate human-scene alignment, particularly in scale and position. However, human and scene reconstructions are typically decoupled. To address this, we introduce the Human-Scene Interaction Proxy, abbreviated as HSIP, as an intermediate representation derived from Scene Interaction Point Clouds and a Scene Interaction Surface, abbreviated as SIPC and SIS. These representations encode explicit scene-aware geometric priors and redefine the optimization space for large-scale monocular 4D crowd reconstruction. To further improve temporal stability under occlusions, we introduce Crowd Structural Coherence Regularization, abbreviated as CSCR, which leverages HSIP-based spatial priors to impose soft temporal consistency on pairwise relative displacements and directions within local crowd neighborhoods. Extensive experiments demonstrate that Crowd4D consistently outperforms existing state-of-the-art methods and enables robust monocular 4D crowd reconstruction in complex, large-scale real-world scenes.

[19] Detect Early, Escalate Rarely: Anytime Detection of AI-Generated Video from the Compressed Bitstream cs.CVPDF

Mert Onur Cakiroglu, Mehmet Dalkilic, Hasan Kurban

TL;DR: 该论文将AI生成视频检测任务重新定义为流式感知问题，提出直接从压缩比特流中解析运动场进行实时检测，避免了传统方法需解码像素并使用大型视觉语言模型的高计算开销。该方法通过单调运行聚合和单阈值校准实现任意时间有效的检测，并引入延迟窗口机制在计算预算内优化性能。

Details

Motivation: 现有AI生成视频检测器通常离线评估，需解码像素并依赖计算密集型模型，而实际部署需在线实时处理。论文旨在解决在线检测的高计算成本问题，通过利用视频编解码器已写入比特流的运动场信息，实现高效流式检测。

Result: 在GenVidBench上，该方法以比像素CNN低五个数量级的计算量（在CPU上运行）达到全长AUC 0.64；延迟15%的视频片段可将准确率从0.75提升至0.78，同时减少7倍计算量（McNemar检验p<10^{-6}）。在AIGVDBench上结果可复现，且能控制误报率。

Insight: 创新点在于将检测任务重构为流式感知，直接利用压缩比特流中的运动场信息，避免了像素域前向传播；通过单调聚合和校准阈值提供任意时间有效性保证，并结合延迟窗口在计算预算下优化检测性能，为实时AI生成内容检测提供了高效框架。

Abstract: Detectors for AI-generated video are evaluated offline. A clip is decoded to pixels and scored once, increasingly by a large vision-language model. Detection, however, is deployed online. We recast the task as streaming perception and score the motion field the codec already wrote into the bitstream. Reading that field is a parse, not a pixel-domain forward pass. Because the running aggregate is monotone, one end-calibrated threshold is anytime-valid at the data-dependent decision time. Recalibrating at each prefix is not. Escalation is priced in closed form. A compute budget maps to a deferral window, on a frontier monotone exactly where the deferral condition holds. On matched GenVidBench the codec stage reaches full-length AUC 0.64 at five orders of magnitude less compute than a pixel CNN, on CPU. Its gate holds the stopping-time false-positive rate at target while the real data match its calibration, and drifts above it under distribution shift. Deferring 15% of clips lifts accuracy from 0.75 to 0.78 at $7\times$ less compute (paired: McNemar $p<10^{-6}$). The stage-1 ordering replicates on AIGVDBench. We introduce no new detector. The contribution is the reframing, two guarantees, and the measured frontiers. Code, configurations, and evaluation splits: https://github.com/KurbanIntelligenceLab/streamdet.

[20] D3VL: Understanding Driving Scenes from 3D Time Series Data and Video with Language Models cs.CV | cs.AIPDF

Heesang Han, A. Lynn Abbott, Abhijit Sarkar

TL;DR: 本文提出了D3VL，一种新颖的多模态大语言模型（MLLM）框架，旨在通过整合2D和3D时序数据来理解和回答关于驾驶场景的问题。该模型特别关注处理激光雷达（LiDAR）和立体相机等3D传感器数据，以克服现有MLLM主要依赖2D图像的局限。

Details

Motivation: 当前用于自动驾驶的端到端MLLM主要基于2D图像和视频，而大多数自动驾驶系统依赖激光雷达等3D传感器，且融合3D数据已被证明能提升传统3D场景感知任务的性能。因此，本文旨在解决将稀疏、非网格结构的3D数据（如LiDAR）有效集成到MLLM中的挑战。

Result: 在KITTI问答（QA）数据集上，D3VL在处理2D和3D时序数据时相比基线方法提升了11%。此外，本文还引入了Waymo QA数据集扩展，用于评估模型在不同驾驶条件下处理3D和时序数据的能力。

Insight: 创新点在于提出了一个简单而统一的架构，能够同时整合2D和3D时序数据到MLLM中，解决了LiDAR数据稀疏性和非网格结构带来的集成难题。这为自动驾驶场景理解提供了更全面的多模态感知能力，并推动了3D传感器在MLLM中的应用。

Abstract: Recent advances in Multimodal Large Language Models (MLLMs) have triggered the development of end-to-end MLLMs for autonomous driving. However, the main emphasis to date has been for MLLMs using 2D images and videos. In contrast, this paper considers MLLM effectiveness using 3D sensors, particularly LiDAR and stereo cameras. LiDAR presents unique challenges to integration within an MLLM, largely because of data sparsity and lack of a grid structure for the data. For similar reasons, fusion of camera and LiDAR data within an MLLM pipeline is also uncommon. However, most autonomous systems rely on LiDAR-based sensing, and incorporating 3D data has been proven to improve performance in traditional 3D scene perception tasks. This paper presents D3VL, a novel MLLM framework that integrates 2D and 3D time-series data in a single but simple architecture. The model aims to answer questions involving traffic scene understanding and safety. D3VL shows an 11% improvement in the KITTI Question-Answering (QA) dataset compared to baseline methods in processing 2D and 3D time-series data. This paper further introduces the Waymo QA dataset extension, which assesses models’ capabilities in processing 3D and time-series data under diverse driving conditions. D3VL implementation code and WaymoQA extension can be found on our supplemental website: https://automotivesafety-lvlm.github.io

[21] ChronoStitch: Training-Free Composition of Visual KV Memories for Long-Horizon Temporal Reasoning cs.CV | eess.IVPDF

Santiram Tiwari, Nishant Sinha, Kunal Kislay

TL;DR: 本文提出了ChronoStitch，一种无需训练的方法，用于组合独立存储的视觉键值（KV）记忆，以解决长视频问答中跨时间推理的问题。该方法通过将存储的键重新映射到一个全局的三轴多模态RoPE坐标系来修复位置信息，并选择性重计算部分高偏差的视觉标记，从而在保持全局时序顺序的同时高效地组合视频片段。

Details

Motivation: 解决长视频问答中，独立缓存的视频片段在组合时因位置编码重置导致的全局时序信息丢失问题，例如无法正确回答事件先后顺序、发生频率或视频变化等问题。

Result: 在Qwen2.5-VL-3B模型和TempCompass数据集的时间推理分割上，ChronoStitch优于朴素组合和仅修复位置的方法，提高了事件排序的准确性，同时运行速度比完全联合重预填充快3.3倍。

Insight: 创新点在于提出了一个无需训练的、基于全局三轴（时间、高度、宽度）多模态RoPE坐标系的视觉KV记忆组合框架，并揭示了单纯的一维标量重索引在视觉标记上的几何不一致性，通过选择性重计算来弥补内容间隙，实现了高效的长时序推理。

Abstract: Long-video question answering requires a model to preserve visual evidence over time without repeatedly reprocessing the same video. A practical approach is to store the vision-language model’s internal key-value (KV) cache for each video chunk and retrieve that state at query time. However, independently cached video chunks do not compose correctly: every chunk is prefilled from local rotary position zero, so naive concatenation collides temporal phases and removes the global order required for questions about what happened first, how often events occurred, or what changed across the video. This paper presents ChronoStitch, a training-free method for composing independently stored visual KV memories. The method first re-bases stored post-rotary keys onto a global three-axis multimodal RoPE coordinate system that preserves time, height, and width structure. We show why a one-dimensional scalar re-indexing is geometrically inconsistent for visual tokens because it turns spatial order within a frame into false temporal displacement. We then address the residual content gap left by positional repair: later chunks were originally encoded without attending to earlier chunks. ChronoStitch therefore selectively recomputes a small fraction of high-deviation later-chunk visual tokens while allowing them to attend over the composed cache. On Qwen2.5-VL-3B and the temporal split of TempCompass, ChronoStitch outperforms naive composition and position-only variants, improving event-ordering accuracy while running 3.3x faster than full joint re-prefilling.

[22] Pathologist Attention-Aligned Report Generation for Prostate Histopathology cs.CVPDF

Ruoyu Xue, Suryakant Singh, Souradeep Chakraborty, Pierre Marza, Oksana Yaskiv

TL;DR: 本文提出了一种将病理学家视觉注意力引入前列腺组织病理学报告生成模型训练的方法。作者收集了一个包含121张前列腺全切片图像的多模态人类注意力数据集，其中记录了病理学家在诊断过程中的多尺度视口轨迹、口头描述和光标移动。通过引入注意力对齐损失函数，微调了两个具有不同内部注意力机制的报告生成模型，使模型对图像块的注意力分布与病理学家的注意力分布相匹配。

Details

Motivation: 病理学家在癌症诊断过程中的视觉注意力分配是一个高度选择性的过程，它决定了从全切片图像中提取的关键信息。人类注意力可以作为识别诊断信息区域并生成报告的强语义线索，因此将人类注意力引入病理报告生成模型的训练中，旨在提升模型的性能和可解释性。

Result: 在前列腺癌报告生成和视觉问答任务上的实验表明，该方法在基于NLP的指标上平均提升了10.9%，在五个临床相关报告成分的准确率上平均提升了19.3%。此外，推理时提取的模型注意力图与病理学家注意力更吻合，为生成的报告提供了更强的视觉支持。

Insight: 核心创新点在于构建了一个同步记录病理学家多尺度视觉轨迹与语言描述的多模态人类注意力数据集，并设计了一个注意力对齐损失来正则化模型，使其注意力分布与专家对齐。这为医学影像报告生成提供了一种利用人类专家先验知识来提升模型性能和可解释性的有效范式。

Abstract: The allocation of visual attention by pathologists during cancer diagnosis is a highly selective process that critically shapes the information extracted from whole-slide images (WSIs). Human attention helps medical imaging tasks such as classification and segmentation, and becomes a strong semantic cue for identifying diagnostically informative regions for report generation. In this paper, we introduce human attention into the training of pathologist report generation models. To this end, we collected a multimodal human-attention dataset of 121 prostate WSIs annotated with pathologists’ multi-scale viewport trajectories synchronized with the pathologists’ verbal descriptions and cursor movements for five clinically relevant components (e.g., Gleason patterns). Using this dataset, we finetune two report generation models with an attention-alignment loss that regularizes the model attention over image patches to match the distribution of pathologist attention. We evaluate our approach on prostate cancer report generation and visual question answering using two models with different internal attention mechanisms (i.e., how image tokens are integrated into the language decoder). Experiments show average gains of 10.9% on NLP-based metrics and 19.3% in accuracy across five clinically relevant report components. Further, model attention maps extracted at inference time, with minimal computational overhead, align more closely with pathologist attention, providing stronger visual support for the generated reports by highlighting the regions that most influence the output.

[23] A Unified Variational Framework for Deep Weakly Supervised Image Segmentation cs.CVPDF

Yin King Chu, Lingfeng Li, Sung Ha Kang, Jianping Zhang, Xue-Cheng Tai

TL;DR: 本文提出了一种统一的变分框架，用于稀疏像素级监督下的图像分割。该方法基于带有平滑周长正则化的单纯形约束Potts模型，产生一个凸的、平滑的能量泛函，可作为弱监督深度学习范式中的训练损失，或使用迭代方法高效优化。稀疏标签通过再生核希尔伯特空间（RKHS）中的函数扩展问题构建模糊隶属函数，并整合到数据保真项中，以有效捕捉不均匀的强度统计。

Details

Motivation: 解决在稀疏像素级监督下进行图像分割的问题，旨在开发一个统一的变分框架，以克服传统方法在弱监督设置下的局限性。

Result: 在实验中，所推导的用于训练标准网络的离散损失相比非训练和部分交叉熵（PCE）基线表现出鲁棒性和一致的改进，无需真实分割图像即可达到可比的性能。

Insight: 创新点在于将变分模型与深度学习结合，通过RKHS中的函数扩展处理稀疏标签，并设计凸平滑能量泛函作为损失，增强了弱监督分割的鲁棒性和效率。

Abstract: We propose a unified variational framework for image segmentation under sparse pixel-level supervision. Our method is based on a simplex-constrained Potts model with a smooth perimeter regularizer, yielding a convex, smooth energy functional that can be used as a training loss in weakly supervised deep learning paradigms or optimized efficiently using iterative methods. Sparse labels are incorporated into the data fidelity term by constructing a fuzzy membership function via a function extension problem in a Reproducing Kernel Hilbert Space (RKHS), which can effectively capture inhomogeneous intensity statistics. The derived discrete loss for training standard networks demonstrates robustness and consistent improvements over non-training and partial cross-entropy (PCE) baselines in experiments, achieving comparable performance without requiring ground-truth segmentation images.

[24] SafeGen: Goal-Conditioned Video Diffusion of Safety-Critical Scenarios for VLM-Based Autonomous Driving cs.CVPDF

Jiangfan Liu, Zexuan Cui, Tianyuan Zhang, Zonglei Jing, Zonghao Ying

TL;DR: SafeGen是一种面向基于视觉语言模型的自动驾驶系统的安全关键场景生成框架，通过目标条件扩散模型生成逼真的视频轨迹，以评估自动驾驶模型在罕见但安全关键场景下的表现。

Details

Motivation: 现有安全关键场景生成方法主要依赖仿真器，存在显著的仿真与现实差距，难以捕捉真实、多样且不可预见的人车交互动态，因此需要一种能够生成逼真安全关键场景的方法来严格评估自动驾驶系统的安全性。

Result: 在三个基于视觉语言模型的自动驾驶系统上的广泛实验表明，SafeGen将使用视觉语言模型法官评估自动驾驶系统理解和决策能力的Judge Overall Score指标平均提高了24.25%，优于现有最佳基线方法；此外，使用SafeGen生成的场景微调自动驾驶模型可使其在真实驾驶场景中的性能平均提升15.9%。

Insight: 论文的创新点在于将场景生成建模为目标条件扩散过程，利用预定义的灾难性最终状态作为强监督信号，并提出了上下文接地最终状态推理和最终状态条件视频演化方法，将语义威胁转化为物理上合理的视觉动态，从而生成具有时间一致性的高风险场景视频。

Abstract: VLMs are increasingly deployed in AD systems, creating an urgent need for rigorous safety evaluation under rare yet safety-critical scenarios. Among these, interactions with vulnerable road users represent a major source of real-world failures. However, existing safety-critical scenario generation methods predominantly rely on simulator-based pipelines, which suffer from a substantial sim-to-real gap and often fail to capture realistic, diverse, and unforeseen human-vehicle interaction dynamics. We present SafeGen, a goal-conditioned diffusion framework for safety-critical scenario generation in VLMADs. Our key insight is to formulate scenario generation as a goal-conditioned diffusion process, where a predefined catastrophic end-state serves as a strong supervisory signal, guiding the generation of temporally coherent video trajectories that naturally evolve toward safety-critical outcomes. Building on this formulation, we introduce Context Grounded End State Reasoning, which leverages VLMs to analyze benign driving contexts and infer latent vulnerabilities in human-vehicle interactions, producing structured end-state specifications that induce high-risk scenarios. Conditioned on these targets, we further propose End State Conditioned Video Evolution, which grounds semantic threats into physically plausible visual dynamics. Specifically, we instantiate high-risk agents within the scene via depth-aware geometric projection, followed by boundary-conditioned diffusion to generate intermediate frames with consistent motion patterns and temporal coherence. Extensive experiments across 3 VLMADs demonstrate that SafeGen increases the Judge Overall Score, a metric using a VLM judge to evaluate VLMADs’ understanding and decision-making, by 24.25% on average compared to SoTA baselines. Furthermore, fine-tuning a VLMAD improves performance in real-world driving scenes by an average of 15.9%.

[25] A Unified Tokenization Framework for Pain Recognition using Heterogeneous 3D Modalities cs.CVPDF

Stefanos Gkikas, Christian Arzate Cruz, Valentina Becchetti, Muhammad Umar Khan, Alessandro Giuseppi

TL;DR: 本文提出了一种用于疼痛识别的统一标记化框架，能够处理异质三维模态数据（如面部视频和fNIRS脑活动数据），通过单一处理流程将不同输入映射到共享标记空间，并在AI4Pain基准数据集上实现了最先进的性能。

Details

Motivation: 疼痛评估对临床管理至关重要，但现有计算系统通常需要为不同模态设计独立架构或依赖手工归纳偏置，缺乏统一处理异质三维数据（行为与脑活动）的框架。

Result: 在AI4Pain基准数据集上，该框架达到了最先进的性能，同时保持高计算效率，支持GPU和CPU硬件的实时评估。

Insight: 创新点在于通过统一标记化框架消除对模态特定架构或手工偏置的依赖，保留数据的时空和时频结构，实现异质三维模态的共享表示学习；客观分析认为其跨模态统一处理范式可推广到其他多模态识别任务。

Abstract: Pain is a complex and pervasive phenomenon affecting a large percentage of the population, and accurate assessment is essential for effective clinical management and intervention. Computational pain recognition systems enable continuous monitoring, support clinical decision-making, and help mitigate pain-related distress and functional decline. This study introduces a unified tokenization framework for heterogeneous 3D modalities in pain recognition that provides a single processing pipeline across behavioral and brain-activity 3D data, without requiring separate architectures for each modality or handcrafted inductive biases. The framework preserves spatial, temporal, and time–frequency structure while mapping diverse inputs into a shared token space. Extensive experiments show that the proposed approach effectively processes facial videos and fNIRS data in both raw-signal and spectrogram-based representations. On the AI4Pain benchmark dataset, the proposed framework achieves state-of-the-art performance while maintaining high computational efficiency and enabling real-time assessment on both GPU and CPU hardware.

[26] ReFace: Reorganizing Facial Spatiotemporal Representations for Improved Pain Assessment cs.CVPDF

Stefanos Gkikas, Yu Fang, Christian Arzate Cruz, Muhammad Umar Khan, Raul Fernandez Rojas

TL;DR: 本文提出ReFace方法，通过将面部输入在tokenization前划分为四个空间象限而非整体处理，以重组面部时空表征，用于改善疼痛评估。在AI4Pain数据集上评估，仅使用视频输入在测试集上达到56.00%准确率，在固定基准协议下取得了最高报告准确率。四象限配置处理与全脸输入相同的总像素预算，但准确率更高，表明空间重组在提出的tokenization设计下能提升性能。

Details

Motivation: 解决自动疼痛评估中因疼痛相关面部线索空间异质性带来的挑战，通过空间重组来更有效地捕捉局部特征。

Result: 在AI4Pain数据集上，仅使用视频输入达到56.00%测试准确率，在固定基准协议下为当前最高报告准确率（SOTA）。

Insight: 创新点在于将面部划分为空间象限进行tokenization前的重组，这能在相同像素预算下提升性能，且单个象限仅用四分之一像素仍保持竞争力，计算成本更低，为面部视频分析中的空间表征设计提供了新思路。

Abstract: Automatic pain assessment from facial video remains challenging due to the spatial heterogeneity of pain-related facial cues. This study proposes ReFace, a spatial reorganization pipeline that divides facial input into four spatial quadrants before tokenization, rather than processing the entire face as a single region. Evaluated on the AI4Pain dataset, the proposed approach achieves $56.00%$ accuracy on the test set using video only, achieving the highest reported accuracy under the fixed AI4Pain benchmark protocol among the compared methods. Notably, the four-quadrant configuration processes the same total pixel budget as the full-face input, yet achieves higher accuracy, suggesting that spatial reorganization can improve performance under the proposed tokenization design. A single quadrant region, processing just one quarter of those pixels, remains competitive at a fraction of the computational cost.

[27] Efficient Tracking and Understanding Object Transformations cs.CVPDF

Yihong Sun, Bharath Hariharan

TL;DR: 本文提出FluxGraph，一种高效跟踪和理解物体状态转换的方法。它通过SAM2内部多掩码不一致性作为轻量级触发器检测转换，避免了对视频中所有实体的密集分割和跟踪，从而显著降低了计算成本。

Details

Motivation: 现有方法（如TubeletGraph）在跟踪物体状态转换时计算开销大，无法实时部署，主要问题在于对输入视频进行密集的时空分割和跟踪所有实体，而不考虑转换是否发生。

Result: 在VOST基准测试中，FluxGraph比TubeletGraph快约3.3倍，同时提升了跟踪性能并保持了状态图质量；在VSCOS、M^3-VOS和DAVIS17等其他数据集上也实现了3.7-10.7倍的加速，且性能稳定。

Insight: 创新点在于利用SAM2的多掩码不一致性作为转换检测的触发器，这是一种反应式方法，避免了不必要的计算，专注于感兴趣的转换事件，从而在速度和精度之间取得平衡。

Abstract: Tracking objects through state transformations is essential for understanding real-world dynamics. However, existing methods are computationally expensive. TubeletGraph recently showed impressive capabilities, but its inference cost (~$4.4$ seconds per object-frame on VOST) precludes any real-time deployment possibilities. We observe that TubeletGraph’s overhead arises from building a spatiotemporal partition of the input video: (1) entity segmentation is computed densely for every frame regardless of whether a transformation occurs, and (2) every entity in the scene is tracked, scaling cost with scene complexity rather than the number of transformations of interest. To address both, we propose FluxGraph, a reactive variant that uses SAM2’s internal multi-mask disagreement as a lightweight trigger for transformation detection, and removes the need for tracking all entities in the given video. FluxGraph is ~$3.3\times$ faster than TubeletGraph on VOST while improving tracking performance and preserving state graph quality. Furthermore, we also observe consistent speedups of $3.7-10.7\times$ across VSCOS, M$^3$-VOS, and DAVIS17 while maintaining performance. Code is publicly available at https://github.com/YihongSun/FluxGraph.

[28] Extending a Large View Synthesis Model for Multi-view Panoptic Segmentation cs.CVPDF

Kwonyoung Ryu, In-Jae Lee, Jonghyun Jin, Hyunjee Lee, Jongmin Lee

TL;DR: 本文提出了一种将大型视图合成模型扩展到多视图全景分割任务的方法，通过重用预训练的视图合成模型来传播全景标签，无需3D重建或针对分割任务进行额外训练。

Details

Motivation: 动机在于观察到大型视图合成模型学习到的跨视图空间对应关系不仅适用于RGB图像合成，还能传播与外观无关的像素级标签，从而将视图合成模型的应用范围从外观渲染扩展到3D场景理解。

Result: 在ScanNet数据集上，该方法的分割质量与基于高斯方法且需要显式3D重建的方法相当，同时在新视图合成方面超过后者7 dB以上；在Replica数据集上无需微调即超越这些方法，展示了跨数据集泛化能力。

Insight: 创新点在于首次将大型视图合成模型用于3D场景理解任务，通过二进制编码的全景标签利用模型固有的空间对应关系进行标签传播，避免了显式3D重建和分割特定训练，实现了高效且可泛化的多视图全景分割。

Abstract: Large view synthesis models synthesize novel views through cross-view attention without explicit 3D representations, and recent studies have shown that they learn accurate spatial correspondence from RGB supervision alone. We observe that this correspondence generalizes beyond appearance. When non-photorealistic signals such as binary encoded panoptic labels are passed through the model, they are propagated to novel views with consistent spatial structure. These results indicate that the correspondence learned for RGB view synthesis can also propagate view-independent per-pixel labels. From this observation, we present the first work to extend large view synthesis models beyond appearance rendering to 3D scene understanding. We propose a panoptic segmentation pipeline that reuses a frozen view synthesis model to propagate panoptic labels from input views to novel views, without 3D reconstruction or any segmentation-specific training of the view synthesis model. Given panoptic labels on the input views, we encode them into binary channel representations and pass them through the same model to render target-view segmentation. On ScanNet, our method achieves segmentation quality on par with Gaussian based approaches requiring explicit 3D reconstruction, while outperforming them in novel view synthesis by more than 7 dB. The label propagation also transfers across datasets, surpassing these approaches on Replica without any fine-tuning.

[29] DRGBT-1K: A Large-scale High-quality Benchmark for Dynamic RGBT Tracking cs.CVPDF

Zhaodong Ding, Chenglong Li, Zeyu Ding, Futian Wang, Jin Tang

TL;DR: 本文提出了DRGBT-1K，一个用于动态RGBT跟踪的大规模高质量基准数据集。该数据集包含1045个真实世界场景序列和79.5万对RGBT帧，涵盖多种场景、视角变化、模态变化和目标外观不连续性。作者还评估了20种代表性多模态跟踪方法，并提供了在线评估平台和排行榜。

Details

Motivation: 现有基准不足以系统评估跟踪器在真实动态模态变化和跨平台转换下的鲁棒性，而动态RGBT跟踪更符合现实世界协同感知系统的需求。

Result: 在构建的DRGBT-1K基准上，作者对20种代表性多模态跟踪方法进行了统一协议下的全面评估，并提供了在线排行榜。

Insight: 创新点在于构建了首个大规模、高质量、专注于动态模态变化和跨平台场景的RGBT跟踪基准，并提供了细粒度标注（如密集边界框、模态标签、平台标签）以及未对齐版本和无人机-地面协同跟踪衍生数据集，支持更广泛的研究。

Abstract: Dynamic RGBT (DRGBT) tracking aims to continuously localize a target when the available sensing modalities and observation platforms vary over time. Compared with conventional RGBT tracking with fixed RGBT inputs and a fixed observation platform, DRGBT tracking is more consistent with real-world collaborative perception systems, where targets may be observed by heterogeneous sensors from different viewpoints. However, existing benchmarks are still insufficient for systematically evaluating tracker robustness under real dynamic modality variations and cross-platform transitions. To address this limitation, we make the following contributions. 1) We construct DRGBT-1K, a large-scale high-quality benchmark for DRGBT tracking. It contains 1,045 sequences captured entirely in real-world scenarios and 795K RGBT frame pairs collected using UAVs and handheld RGBT devices, encompassing diverse real-world scenes, pronounced viewpoint changes, modality variations, and target appearance discontinuities. 2) We provide comprehensive annotations for fine-grained evaluation, including dense bounding boxes, target category labels, challenge attributes, frame-level modality labels and platform labels. DRGBT-1K covers 24 target categories, more than 15 scene types and 15 challenge attributes. 3) We establish a comprehensive benchmark by evaluating 20 representative multimodal tracking methods, including conventional RGBT trackers, modality-missing RGBT trackers, and DRGBT trackers under a unified evaluation protocol. 4) We release an unaligned version of DRGBT-1K and derive UGVT-1K to support broader research on unaligned multimodal tracking and UAV-ground collaborative tracking. 5) We develop an online evaluation platform for DRGBT-1K and provide a leaderboard that collects all methods evaluated on this benchmark.

[30] MoAKE: Toward Unified All-in-One Action Quality Assessment via Mixture of Action Knowledge Experts cs.CVPDF

Huangbiao Xu, Huanqi Wu, Xiao Ke, Jiaxin Cai, Junyi Wu

TL;DR: 本文提出了一种名为MoAKE（动作知识专家混合）的统一框架，旨在解决动作质量评估（AQA）中传统‘一对一’模型的局限性，实现用一个模型评估多种异构动作。该方法通过设计互补的专家网络来捕获不同动作模式，并动态聚合知识以适应输入动作，同时引入了分段感知原型和自适应段内段间关系建模模块来处理时间动态性。

Details

Motivation: 现有AQA方法多为每个动作类型单独训练模型，这限制了实际部署，因为需要先验的动作类型知识来选择对应模型，且在不同动作间泛化能力差。因此，研究旨在开发一个统一的‘一体化’AQA模型，以评估异构动作。

Result: 在三个长期数据集上的大量实验表明，MoAKE在一体化AQA设置中显著优于现有方法。此外，在三个短期数据集上的零样本/少样本评估中也实现了一致的泛化性能，建立了该任务的全面基准。

Insight: 创新点在于提出了MoAKE框架，通过混合专家机制缓解动作间语义差异导致的负知识迁移，并设计了分段感知原型和自适应多粒度时间动态建模模块。从客观角度看，其统一建模思想和动态知识聚合策略为多任务学习与领域自适应提供了可借鉴的思路。

Abstract: Action Quality Assessment (AQA) aims to objectively evaluate performance quality from action videos. Most existing methods follow a ``one-by-one’’ paradigm, training a separate model for each action type. This setting limits real-world deployment, as it requires prior action-type knowledge to select the corresponding model and suffers from poor generalization across diverse actions. To address these limitations, we study the challenging task of all-in-one AQA, which aims to assess heterogeneous actions within a single unified model. We propose a novel Mixture of Action Knowledge Experts (MoAKE) framework, designed to mitigate negative knowledge transfer caused by large semantic discrepancies among actions. MoAKE learns complementary experts that capture diverse action patterns within a shared semantic space and dynamically aggregates their knowledge to adapt the assessment to the input action. Each expert is tailored with segment-aware prototypes to handle varying temporal lengths, together with an Adaptive Intra- and Inter-Segment Relationship Modeling (AIISRM) module to model multi-granularity temporal dynamics. Furthermore, we establish comprehensive benchmarks for all-in-one as well as zero/few-shot AQA. Extensive experiments on three long-term datasets demonstrate that MoAKE significantly outperforms existing methods in the all-in-one setting, while also achieving consistent generalization on three short-term datasets under zero/few-shot evaluation. Code is available at https://github.com/XuHuangbiao/MoAKE.

[31] Trace: A Taxonomy-Guided Environment for Multidomain Visual Reasoning cs.CVPDF

Md Tanvirul Alam

TL;DR: 本文介绍了Trace，一个用于多领域视觉推理的、由分类学指导的环境。它将任务构建分解为场景语法和可执行的任务程序，从而分离了视觉呈现和答案计算。该环境包含277个场景语法和11个视觉领域的1000个任务，具有可控的语义和视觉变化。在Trace实例上进行可验证奖励的强化学习（RLVR），显著提升了Qwen2.5-VL模型在多个外部基准测试上的性能。

Details

Motivation: 将可验证奖励的强化学习（RLVR）扩展到视觉语言模型（VLMs）受到限制，因为缺乏同时具备广泛性、精确可验证性和可复现性的训练数据。本文旨在解决这个问题。

Result: 在64,000个Trace实例上进行RLVR训练后，Qwen2.5-VL-3B和Qwen2.5-VL-7B模型在24个外部基准测试上的宏平均性能分别提升了3.51和4.06个百分点，证明了广泛的程序性训练可以迁移到生成的任务分布之外。

Insight: 核心创新在于通过将任务构建分解为场景语法和任务程序，实现了视觉呈现与答案计算的解耦，从而创建了一个大规模、可控、可验证且可复现的多领域视觉推理训练环境。这为视觉语言模型的程序性推理训练提供了高质量的数据基础。

Abstract: Reinforcement learning with verifiable rewards (RLVR) has substantially improved language-model reasoning, yet its extension to vision-language models remains constrained by the lack of training data that are simultaneously broad, exactly verifiable, and reproducible. We introduce Trace, a taxonomy-guided environment for multidomain visual reasoning. Trace factorizes task construction into a scene grammar and an executable task program, separating visual realization from answer computation. A shared semantic state determines the rendered image, prompt, typed answer, verifier state, and replayable instance trace. The resulting environment comprises 1,000 tasks over 277 scene grammars and 11 visual domains, with controlled semantic and visual variation. RLVR on 64,000 Trace instances improves the macro-average across 24 external benchmarks by 3.51 percentage points for Qwen2.5-VL-3B and 4.06 points for Qwen2.5-VL-7B, providing evidence that broad procedural training can transfer beyond the generated task distributions. Project page: https://maveryn.github.io/trace/.

[32] Memory-Augmented Multimodal Large Language Models for Small Object Understanding in Streaming Aerial Videos cs.CV | cs.AIPDF

Penglei Sun, Yehua Huang, Zhuoli Tao, Xiang Li, Runwei Guan

TL;DR: 本文提出了SkyAnchor模型，针对无人机流式视频中的小目标理解问题，通过语义感知令牌路由器和分层记忆库设计，解决了现有MLLMs在视觉压缩和流式处理中的不足，并构建了首个像素级开放词汇的无人机小目标数据集DroneEyes。

Details

Motivation: 解决无人机在线流式感知中，现有MLLMs因视觉压缩丢失小目标细节，以及资源限制下无法保留完整历史帧导致目标漂移或消失的问题。

Result: 构建了包含2,140个高清视频和176,623对标注的DroneEyes数据集，支持物体描述和指代表达任务，并提出了SkyAnchor模型，在流式视频小目标理解任务上实现了有效处理。

Insight: 创新点包括语义感知令牌路由器（在有限视觉令牌预算下保留小目标细节）和分层记忆库（维持流式视频中的目标一致性理解），以及首个像素级开放词汇的无人机小目标数据集，为小目标流式感知提供了新基准。

Abstract: Language-guided aerial perception aims to understand user-specified tiny targets in complex unmanned aerial vehicle (UAV) scenes. In real UAV deployment, the UAV must respond while it flies, so such perception runs in an online streaming manner, where frames arrive sequentially and the model responds to each one without access to future frames. However, applying current Multimodal Large Language Models (MLLMs) to this setting raises two challenges. First, targets viewed from the air are often tiny, yet the visual compression in existing MLLMs treats all regions equally and discards their fine-grained details. Second, understanding a continuous stream requires past-frame context, yet retaining the entire history is infeasible on resource-constrained onboard hardware, whereas discarding it causes the target to drift or disappear. We address the tiny object and streaming challenges from both data and method perspectives. From the data perspective, we present \textbf{DroneEyes}, the \textbf{first} pixel-level and open-vocabulary referring-segmentation dataset for tiny aerial targets, comprising $2,140$ high-definition videos and $176,623$ pairs across Object Description and Referring Expression tasks, with dense per-frame masks. From the method perspective, we propose \textbf{SkyAnchor}, an MLLM with two designs to the above challenges: a Semantics-Aware Token Router that preserves small-target under a reduced visual-token budget, and a Hierarchical Memory Bank that keeps the target consistently understood on streams.

[33] MTVDiff: Multimodal Conditional Latent Diffusion for Enhanced Thermal-to-Visible Face Translation cs.CVPDF

Zhiyuan Xia, Haojie Li, Jingyu Lin, Yiguo Qiao, Cunjian Chen

TL;DR: 本文提出了一种名为MTVDiff的新型多模态条件潜在扩散框架，用于增强热成像到可见光的人脸图像翻译。该方法协同整合深度和文本信息，以解决几何不连续、语义属性不匹配和身份退化等核心挑战，同时保持身份特征。

Details

Motivation: 热成像到可见光的人脸翻译面临几何不连续、语义属性不匹配和身份退化等根本性挑战，现有方法存在局限性。本文旨在通过多模态信息融合来解决这些问题，为不同光照条件下的人脸识别系统提供鲁棒解决方案。

Result: 在MCXFace和SpeakingFaces数据集上的大量实验表明，该方法在多项指标上显著优于现有的基于GAN和扩散模型的方法，实现了图像质量和人脸验证性能的显著提升，FID降低了高达48.3%，Rank-1准确率提升了高达8.9%，达到了该领域的先进水平。

Insight: 论文宣称的创新点包括：用于多尺度热-深度特征提取与融合的双分支交叉注意力模块、用于语义引导生成的门控文本-视觉特征对齐机制，以及用于自适应多模态先验整合的空间特征变换。从客观角度看，其核心创新在于将深度和文本信息有效整合到扩散模型中，以多模态方式协同解决跨光谱人脸翻译中的几何、语义和身份保持问题。

Abstract: Thermal-to-visible face translation presents fundamental challenges including geometric discontinuities, semantic attribute mismatches, and identity degradation. We propose MTVDiff, a novel multimodal latent diffusion framework that synergistically integrates depth and textual information to address these limitations while preserving identity characteristics. The MTVDiff framework presents three core technical contributions: (1) a Dual-Branch Cross-Attention Fusion (DBCAF) module for multi-scale thermal-depth feature extraction and fusion; (2) a Gated Text-to-Visual Feature Alignment mechanism for semantically-guided generation; and (3) Spatial Feature Transformations (SFT) for adaptive multimodal prior integration. Extensive experiments on the MCXFace and SpeakingFaces datasets demonstrate that our multimodal approach significantly outperforms existing GAN-based and diffusion-based approaches across multiple metrics, achieving substantial improvements in both image quality and face verification performance, with FID reductions of up to 48.3% and Rank-1 accuracy improvements of up to 8.9%. Our work provides a robust solution for face recognition systems operating under varying illumination conditions and advances the state-of-the-art in cross-spectral facial image translation through effective multimodal integration.

[34] LAVIFT: Latent-Action-Guided Vision Fine-Tuning for Surgical Interaction Recognition cs.CVPDF

Jiajun Cheng, Subarna Tripathi, Sainan Liu, Xiaofan Yu, Shan Lin

TL;DR: LAViFiT是一种用于手术交互识别的潜在动作引导视觉微调框架，通过结合逆向动力学模型和正向世界模型，增强视觉编码器对手术器械-组织交互区域的表示能力，并引入补丁级SIG正则化器防止局部特征崩溃。

Details

Motivation: 现有预训练视觉语言模型和视觉编码器在适应细粒度手术交互识别时面临挑战：冻结编码器依赖可能包含噪声的预训练表示，而全微调虽能改善全局语义对齐但无法确保编码器在正确动作区域学习有意义的特征。

Result: 在多个编码器和数据集上的实验表明，LAViFiT提高了识别性能和图像-文本对齐质量，表示分析显示其在完整器械-组织交互区域具有更强的定位能力和更空间一致的特征。

Insight: 创新点在于引入潜在动作引导机制，通过逆向动力学模型捕捉动作引起的视觉变化，正向世界模型驱动编码器关注动作相关区域，并结合无额外监督的补丁级SIG正则化器防止特征崩溃，提升了细粒度交互识别的表示质量。

Abstract: Understanding instrument-tissue interactions is essential for context-aware surgical AI and autonomous robotic surgery. Pretrained vision-language models (VLMs) and vision encoders offer an alternative to conventional interaction classifiers by transferring broad visual and semantic knowledge. However, adapting them to fine-grained surgical interactions remains challenging: (1) freezing the vision encoder depends entirely on pretrained representations that may retain noise and provide weak spatial localization, while (2) full fine-tuning can improve global semantic alignment without ensuring that the encoder learns meaningful features in the correct action region. We address these limitations by introducing LAViFiT, an end-to-end latent-action-guided framework for vision-language fine-tuning. An inverse dynamics model captures the visual changes induced by each action, while a forward world model drives the encoder to represent action-relevant regions. A patch-level SIG Regularizer further prevents local feature collapse without additional supervision, such as bounding boxes or pseudo-labels. Experiments across multiple encoders and datasets improve recognition and image-text alignment, while representation analyses show stronger grounding over the complete instrument-tissue interaction region and more spatially coherent features.

[35] OSVE: One Step Video Editing with One Step Diffusion Models cs.CV | cs.AIPDF

Habin Lim, Gyeong-Moon Park

TL;DR: OSVE是首个将一步式文本到图像（T2I）扩散模型成功适配于高质量视频编辑的框架，通过可学习的编码器预测初始噪声、结构感知编辑损失和统一帧编辑技术，在保持编辑质量的同时，实现了比现有多步方法快约155-171倍的极速处理。

Details

Motivation: 解决现有基于扩散模型的文本引导视频编辑方法因昂贵的多步采样和反转过程而导致速度极慢、不实用的核心问题。

Result: 在广泛的实验中，OSVE在编辑质量上达到或超越了最先进的多步方法，同时运行速度提高了约155-171倍。

Insight: 创新点包括：1) 训练可学习的编码器进行单次前向传播的快速噪声预测以绕过迭代反转；2) 在结构对齐图像对数据集上使用新颖的结构感知编辑损失来保持源视频几何结构；3) 引入统一帧编辑技术，通过拼接帧潜在表示在单步生成中实现跨帧注意力，并结合滑动窗口策略保证长视频的全局一致性。

Abstract: Text-guided video editing with diffusion models is impractically slow, hindered by costly multi-step sampling and inversion. We present OSVE, the first framework to successfully adapt one-step Text-to-Image (T2I) models for high-quality video editing, addressing the core challenges of inversion, editability, and temporal consistency. To bypass slow iterative inversion, we train a learnable encoder that predicts the initial noise for each frame in a single forward pass. This encoder is trained with a novel Structure-Aware Editing (SAE) loss on a curated dataset of structurally-aligned image pairs, teaching it to preserve the source video’s geometry during edits. For temporal coherence, we introduce Unified-Frame Editing (UFE), a technique that concatenates frame latents to facilitate cross-frame attention in a single generation step. Furthermore, for long videos, a sliding-window strategy with an anchor frame maintains global consistency. Our extensive experiments demonstrate that OSVE achieves editing quality comparable or superior to state-of-the-art multi-step methods, while operating approximately 155–171 times faster. This breakthrough paves the way for practical, real-time video editing applications. Code is available at https://github.com/KU-VGI/OSVE.

[36] LoRFT: Benchmarking Long-Range Vehicle Trajectory Reconstruction from Fixed Highway Cameras cs.CVPDF

Yufan Zhu, Kefu Yi, Xueju Zhang, Yunyang Tian, Long Chen

TL;DR: 该论文提出了LoRFT，这是首个专注于从固定高速公路摄像头进行长距离车辆轨迹重建的开放基准测试。它包含大量标注数据，并提出了一个名为Map-RSTNet的地图感知序列到序列模型，该模型在道路几何对齐的状态空间中重建远距离轨迹，显著提升了重建精度。

Details

Motivation: 长距离车辆轨迹对交通安全分析和自动驾驶评估至关重要，但从固定摄像头持续恢复轨迹很困难，因为车辆在远处时，透视压缩和尺度衰减会导致跟踪片段断裂或提前终止。

Result: 在提出的LoRFT基准上，Map-RSTNet模型相对于最强基线，在ADE、FDE和5秒RMSE指标上分别降低了11.0%、15.4%和10.5%，证明了其有效性。

Insight: 主要创新点在于构建了首个长距离车辆轨迹重建的专用基准数据集（LoRFT），并提出了一个结合道路几何信息的序列模型（Map-RSTNet），通过在对齐的状态空间中进行解码并动态更新局部道路几何来提升远距离轨迹重建的鲁棒性。

Abstract: Long-range vehicle trajectories provide important spatio-temporal evidence for traffic safety analysis, autonomous driving evaluation, and data-driven traffic management, yet continuously recovering them from fixed highway cameras remains difficult. As vehicles recede into distant road regions, perspective compression and scale decay often fragment or prematurely terminate automatic tracklets, even when their continuation remains identifiable from motion consistency across neighboring frames. We formulate this problem as recovering the far-range continuation of a vehicle trajectory from a reliable near-field tracklet. We introduce LoRFT, to our knowledge the first open benchmark dedicated to long-range vehicle trajectory reconstruction from fixed highway cameras. LoRFT comprises 22 expressway surveillance scenes, 366,109 video frames, 6,601 manually verified trajectories, 2,694,889 bounding boxes, road-geometry annotations, scene-level splits, and evaluation scripts. We further propose Map-RSTNet, a map-aware residual sequence-to-sequence model that reconstructs distant trajectories in a road-geometry-aligned state space and dynamically refreshes local road geometry during decoding. On LoRFT, Map-RSTNet reduces ADE, FDE, and 5-second RMSE by 11.0%, 15.4%, and 10.5%, respectively, relative to the strongest baseline. These results demonstrate that road-geometry-aware reconstruction can extend usable trajectory records from existing fixed-camera infrastructure. LoRFT provides a reproducible testbed for long-range vehicle trajectory reconstruction.

[37] MV-Bench: Benchmarking Multimodal Large Language Models for Coordinated Multi-View Interface Construction cs.CV | cs.HCPDF

Yue Zhao, Hongxu Liu, Feiyu Wang, Xiaoyu Yang, Tong Ge

TL;DR: 本文提出了MV-Bench，一个用于评估多模态大语言模型在构建协调多视图界面方面能力的基准。该基准基于Tableau工作簿文件作为真实标注，通过多阶段流水线生成可执行的Web界面，包含92个基础界面和1048个经过验证的实例。评估了五种最先进的MLLM，发现它们在视觉布局复现上表现尚可，但在数据绑定和交互逻辑生成方面存在显著不足。

Details

Motivation: 现有的MLLM评估主要关注单图表生成，而忽略了需要联合推理数据语义、视图协调和交互逻辑的协调多视图界面构建任务，导致该领域缺乏专门的系统性评估基准。

Result: 在单次生成设置下，最强模型在视觉布局复现准确率达到75.45%，但在数据绑定正确性上仅为21.71%，在交互完整性上仅为11.68%。迭代优化能提高代码可执行性，但未能显著缩小数据绑定和交互生成方面的差距。

Insight: 创新点在于使用Tableau工作簿文件作为真实标注来源，并构建了一个包含数据、视觉映射和交互的协调多视图界面基准。客观来看，该工作揭示了当前MLLM在生成复杂交互式可视化应用时，其代码生成能力在语义理解和逻辑推理层面仍存在根本性局限。

Abstract: Multimodal large language models (MLLMs) are increasingly expected to automate visualization development by generating code directly from visual designs. However, existing evaluations mainly focus on single-chart generation and overlook coordinated multi-view interface construction, which requires joint reasoning about data semantics, view coordination, and interaction logic. Consequently, MLLM capabilities in this setting remain underexplored, and the field lacks a dedicated benchmark for systematic assessment. We introduce MV-Bench, a benchmark for evaluating MLLMs on coordinated multi-view interface construction. Instead of relying on incomplete or inconsistent open-source implementations, we use Tableau workbook files as ground truth because they explicitly encode data bindings, visual mappings, and interactions. We develop a multi-stage pipeline that converts these specifications into executable web interfaces through structured intermediate representations. The benchmark contains 92 base interfaces and 1,048 verified instances created by recombining chart types, datasets, and interaction patterns. Each instance includes executable code, a rendered interface, a dataset, and interaction annotations. We evaluate five state-of-the-art MLLMs in a single-pass setting using metrics for visual fidelity, data binding correctness, and interaction completeness. The strongest model achieves 75.45 percent accuracy in visual layout reproduction, but only 21.71 percent in data binding and 11.68 percent in interaction completeness. These results show that current MLLMs can reproduce visual appearance but remain limited in generating the data semantics and interactive logic required by coordinated multi-view interfaces. Iterative refinement improves code executability but does not substantially reduce the gap in data binding and interaction generation.

[38] G-MAD: A Game-Based Data Generation Framework for Multi-View RGB-T Aerial Object Detection cs.CV | cs.AIPDF

Yechan Kim, JongHyun Park, Dongho Yoon, Namhoon Jung, Moongu Jeon

TL;DR: 本文提出了G-MAD，一个基于游戏引擎的开源框架，用于生成同步的多视角RGB-T（可见光-热红外）航空目标检测数据。该框架解决了真实航空数据集构建中的视角控制有限、RGB-T对齐不完美和标注成本高等关键限制。利用G-MAD，作者构建并发布了AMOD，一个新的大规模多视角航空RGB-T目标检测基准数据集。

Details

Motivation: 动机是解决真实世界航空数据集构建的局限性，包括难以控制观测视角、RGB-T模态对齐不完美以及人工标注成本高昂的问题，从而为航空目标检测研究提供可控、高质量的多模态合成数据。

Result: 论文构建并发布了AMOD基准数据集，这是一个新的大规模多视角航空RGB-T目标检测数据集，为研究多模态融合和合成到真实的迁移学习提供了资源。

Insight: 创新点在于利用商业游戏引擎（Arma3）进行结构化场景生成和可控的多视角相机布置，实现了完美的RGB-T同步采集和基于引擎几何元数据的自动边界框标注，为研究视角变化、多模态融合等提供了高度可控的合成数据生成框架。

Abstract: This work introduces G-MAD, an open-source framework that uses Arma3 to generate synchronized multi-view RGB-T data for aerial object detection. G-MAD addresses key limitations of real-world aerial dataset construction, including limited viewpoint control, imperfect RGB-T alignment and high annotation cost. The framework supports structured scenario specification, controllable multi-view camera placement, simultaneous visible/thermal capture, and automatic bounding box annotation using engine-level geometric metadata. These capabilities enable controlled studies of viewpoint variation, multi-modal fusion, and synthetic-to-real transfer in aerial object detection. Besides, using G-MAD, we construct and release AMOD, a new large-scale multi-view aerial RGB-T object detection benchmark. The source code and the dataset are available at https://unique-chan.github.io/G-MAD-Project.

[39] ETPDesigner: Multi-Agent Orchestration for Interactive Multimodal Electronic Theater Program cs.CVPDF

Mengtian Li, Xinru Guo, Xiaoru Lin, Xiao Rong, Zhifeng Xie

TL;DR: 本文提出了ETPDesigner，一个用于从原始戏剧脚本直接合成高质量电子剧场节目（ETP）的多智能体协作框架。该框架通过模拟专业设计流程，协调多个专用智能体进行语义脚本分析、核心海报合成、功能背景生成和分层角色资产组合，并引入全局风格锚机制来确保所有生成组件的视觉一致性。此外，系统通过集成肖像动画、定制语音合成和基于人设的大语言模型，将静态的ETP提升为沉浸式的交互式伴侣，使用户能与生成的虚拟角色进行实时语音对话。

Details

Motivation: 现有文本到图像范式难以处理电子剧场节目（ETP）这类复杂设计任务，因为它们无法理解长上下文叙事，也无法在多个不同页面间保持视觉一致性。

Result: 在构建的领域特定基准ETP-Pro上进行广泛评估，结果表明该方法在生成语义忠实、美学一致且高度交互的程序集方面具有优越性。

Insight: 创新点在于提出了一个模拟专业设计流程的多智能体协作框架，并引入了全局风格锚机制来强制跨组件的美学统一；同时，将静态出版物扩展为沉浸式交互伴侣，结合了动画、语音和LLM技术，实现了与虚拟角色的实时语音交互。

Abstract: Electronic Theater Programs (ETPs) serve as critical promotional media in the performing arts, comprising a multi-page collection of heterogeneous visual assets such as theatrical posters, performance details, and character portraits. However, existing text-to-image paradigms struggle with such complex design tasks due to their inability to comprehend long-context narratives and maintain visual consistency across multiple distinct pages. To address this, we introduce ETPDesigner, a collaborative Multi-Agent framework that directly synthesizes high-quality ETPs from raw dramatic scripts. Emulating a professional design pipeline, our framework orchestrates specialized agents for semantic script analysis, core poster synthesis, functional background generation, and the stratified composition of character assets. Central to ETPDesigner is a global style anchor mechanism that extracts visual priors from the core poster to enforce strict aesthetic uniformity across all generated components. Furthermore, we elevate the ETP from a static publication to an immersive interactive companion. By integrating portrait animation, customized speech synthesis, and persona-grounded Large Language Models (LLMs), our system enables users to engage in real-time, voice-enabled conversations with the generated virtual characters. To rigorously benchmark this task, we construct ETP-Pro, a domain-specific benchmark of professional theater posters and high-quality character portraits. Extensive evaluations demonstrate our method’s superiority in producing semantically faithful, aesthetically consistent, and highly interactive program sets.

[40] OffNadirLoc: Benchmark and Framework for Challenging UAV-to-Satellite Geo-Localization under Large Off-Nadir Views cs.CVPDF

Qian Qiao, Wenye Liu, Ting Liu, Jiuhe Shu, Peng Wang

TL;DR: 本文提出了OffNadirLoc基准测试和ONLoc框架，用于解决大离天底角视角下无人机与卫星图像跨视角地理定位的挑战。该框架通过结构感知的上下文加权机制和视图一致的学习策略，动态增强可靠局部特征并学习视角不变的特征，从而在存在严重透视畸变和遮挡的情况下实现更优的定位性能。

Details

Motivation: 现有无人机-卫星地理定位的研究主要关注近天底角场景，忽视了在大离天底角视角下由剧烈透视畸变、遮挡和外观差异带来的挑战，这限制了实际部署的性能。

Result: 在提出的OffNadirLoc基准测试和四个近天底角数据集上的大量实验表明，该方法持续优于现有最先进方法，并在无需额外训练的情况下对未见数据集展现出强大的零样本泛化能力。

Insight: 创新点在于引入了结构感知的上下文加权机制来动态处理局部特征，以及设计了将多视角图像作为语义组的视图一致学习策略，这比传统的成对对比学习更能捕捉多视图一致性，从而学习到更具判别性和视角不变性的特征。

Abstract: Cross-view geo-localization between UAV and satellite imagery remains a fundamental yet highly challenging task, especially under large off-nadir views where drastic perspective distortions, occlusions, and appearance gaps occur. Existing benchmarks and methods primarily focus on near-nadir scenarios and often overlook the importance of structural scene understanding and intra-domain relational constraints, limiting their performance in real-world deployments. In this work, we introduce OffNadirLoc, a new benchmark for large off-nadir UAV-to-satellite geo-localization. To tackle the unique challenges posed by off-nadir perspectives, we further propose ONLoc, a framework that incorporates a structure-aware contextual weighting mechanism to dynamically emphasize reliable local features while suppressing ambiguous or repetitive regions. Additionally, we design a view-coherent learning strategy, which treats one satellite image and the corresponding UAV images from multiple views as a cohesive semantic group. This set-level supervision enables the model to learn viewpoint-invariant and discriminative features, making it more effective at capturing multi-view consistency than conventional pairwise contrastive learning. Extensive experiments on the OffNadirLoc benchmark and four near-nadir datasets demonstrate that our method consistently outperforms state-of-the-art approaches while exhibiting strong zero-shot generalization to unseen datasets without additional training. The code will be released at https://montalario.github.io/offnadirloc/.

[41] Forecasting the Number of Harvest-ready Fruits of Sweet Peppers Using Multimodal Time-Series Data cs.CVPDF

Enrico Pallotta, Mohamed Farag, Esra Guclu, Chris McCool, Ribana Roscher

TL;DR: 本文提出了一种基于多模态时间序列数据的甜椒果实成熟数量预测方法。作者构建了一个包含691株甜椒在两个生长季的4837张图像的新数据集，并提出了一个融合视觉特征（使用DinoV3编码器提取）和数值计数测量的深度学习框架，利用LSTM建模时间依赖性并处理不规则采样间隔。

Details

Motivation: 解决精准农业中个体植株产量预测的难题，当前缺乏同时捕获视觉生长动态和每株植物测量标签的公开数据集。

Result: 该方法在2022和2023生长季的实验中，相比持续性基线模型分别降低了33%和38%的RMSE，相比仅使用测量数据的模型平均提升了1.2%。不确定性校准误差（UCE）在0.39到0.89之间，提供了可靠的置信度估计。

Insight: 创新点在于构建了首个针对甜椒的带注释图像时间序列数据集，并提出了融合高维视觉特征与数值测量的多模态LSTM框架，同时通过深度集成和高斯负对数似然提供了校准的不确定性估计，为实际农业决策提供了可解释的置信信号。

Abstract: Accurate yield forecasting at the individual-plant level is critical for precision agriculture and supply-chain planning, yet public datasets capturing both visual growth dynamics and per-plant measurement labels are scarce. In this paper, we introduce a novel, annotated image time-series dataset of 691 sweet pepper plants monitored over two growing seasons, comprising 4837 images with per-plant fruit counts categorized by maturity. We propose a multimodal deep learning framework that fuses high-dimensional image features, extracted using the DinoV3 encoder, with numerical count measurements. Our architecture utilizes a Long Short-Term Memory (LSTM) network to model temporal dependencies and handles irregular sampling intervals common in greenhouse monitoring. Through quantitative experiments, we demonstrate that this multimodal approach reduces RMSE over a persistence baseline by 33% and 38% in the 2022 and 2023 seasons, respectively, with a further 1.2% average gain over a measurement-only model. Furthermore, we employ Deep Ensembles and Gaussian Negative Log-Likelihood (NLL) to provide calibrated uncertainty estimates, with an Uncertainty Calibration Error (UCE) ranging from 0.39 to 0.89 depending on the cross-season evaluation direction, offering a principled confidence signal for real-world agricultural decision-making. We release the dataset and code to support reproducible research and to accelerate development of data-driven yield forecasting methods for horticultural crops.

[42] GaussianSeed: Hierarchical Gaussian Seeding for High-Resolution 3D Occupancy Prediction cs.CVPDF

Xinzhuo Li, Xianghui Pan, Jiayuan Du, Wei Wei, Liuyi Wang

TL;DR: 本文提出了GaussianSeed，一种用于高分辨率3D占据预测的渐进式多尺度高斯框架。该方法通过将基元组织成从粗到细的层次结构，有效规避了密集表示的内存瓶颈，成功扩展到0.1米空间分辨率并保持实时推理能力。作者还构建了TJScenes全景六相机占据数据集，并在Occ3D-nuScenes和TJScenes上验证了该方法的低延迟和高精度。

Details

Motivation: 解决以视觉为中心的3D占据预测方法在扩展到高体素分辨率时，因计算成本过高而面临的挑战。

Result: 在Occ3D-nuScenes和TJScenes数据集上的大量实验表明，GaussianSeed在所有评估方法中延迟最低，同时保持了极具竞争力的精度，推进了高分辨率3D占据预测的效率-质量前沿。

Insight: 核心创新点是提出了一种层次化的高斯播种（Hierarchical Gaussian Seeding）策略，通过渐进式多尺度框架组织基元，实现了计算效率与高分辨率的平衡。此外，构建高分辨率标注数据集TJScenes也为该领域提供了新的评估基准。

Abstract: Vision-centric 3D occupancy prediction provides dense scene representations essential for autonomous driving and robotic navigation, yet existing methods struggle to scale to high voxel resolutions due to prohibitive computational costs. To address this, we introduce GaussianSeed, a progressive multi-scale Gaussian occupancy prediction framework that organizes primitives into a coarse-to-fine hierarchy. Benefiting from this hierarchical design, GaussianSeed effectively circumvents the memory bottlenecks inherent in dense representations, successfully scaling to a $0.1\text{m}$ spatial resolution while maintaining real-time inference capabilities. To comprehensively evaluate high-resolution geometric perception, we further construct TJScenes, a panoramic six-camera occupancy dataset with highly detailed $0.1\text{m}$ annotations. Extensive experiments on Occ3D-nuScenes and TJScenes demonstrate that GaussianSeed delivers the lowest latency among all evaluated methods while maintaining highly competitive accuracy, advancing the efficiency-quality frontier of high-resolution 3D occupancy prediction.

[43] STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matching cs.CVPDF

Hao Wang, Haoran Geng, Xiaotong Yang, Jing Tang, Songlin Wei

TL;DR: 本文提出了一种名为STEREOFLOW的立体匹配生成框架，该框架将确定性匹配回归与生成式分布建模相结合，以解决传统方法在模糊区域因回归到均值偏差而表现不佳的问题。该框架包含三个核心组件：渐进级联匹配网络、频率解耦的像素扩散变换器（StereoDiT）以及用于高效优化的少步流匹配目标（Transition Flow Matching）。实验表明，STEREOFLOW在多个基准测试中取得了最先进的结果。

Details

Motivation: 传统立体匹配方法通常将其视为确定性回归问题，将多模态分布建模坍缩为单点估计，导致在模糊区域存在回归到均值的偏差。本文旨在通过一个先验引导的生成框架来整合确定性回归和生成式建模，以更好地处理对应关系的模糊性。

Result: 在Scene Flow、KITTI、ETH3D和Middlebury等多个立体匹配基准测试上，STEREOFLOW均取得了最先进（SOTA）的结果，并在不适定、不连续区域以及零样本泛化场景下表现出强大的几何一致性和丰富的细粒度细节。

Insight: 创新点在于提出了一个互补的生成框架，将确定性回归与生成式建模结合；具体技术贡献包括渐进级联匹配网络、用于建模模糊性的频率解耦扩散变换器（StereoDiT），以及高效的少步流匹配优化目标（Transition Flow Matching）。从客观角度看，该工作通过生成式方法处理立体匹配中的多模态不确定性是一个有前景的方向，其设计的组件在效率和效果上可能具有借鉴意义。

Abstract: Stereo matching is a fundamental task in 3D reconstruction. Despite remarkable advances, the prevailing paradigms formulate stereo matching as a deterministic regression problem, collapsing the multimodal distribution modeling into a single-point estimation. This formulation suffers from a regression-to-mean bias, frequently struggling with ambiguous regions. In contrast, we introduce a prior-guided generative framework that integrates deterministic matching regression and generative distribution modeling within a complementary formulation. Built upon this formulation, we introduce StereoFlow through three key components: (i) a two-stage progressive cascade matching network that progressively produces multi-resolution stereo conditions with complementary matching cues; (ii) a pixel diffusion transformer (termed StereoDiT) with a frequency-decoupled architecture for modeling correspondence ambiguity; (iii) a few-step flow matching objective (termed Transition Flow Matching) for efficient optimization. In summary, \textsc{\textbf{StereoFlow}} achieves strong geometric consistency and rich fine-grained details in ill-posed, discontinuous regions and under zero-shot generalization. Extensive experiments demonstrate that the proposed StereoFlow establishes multiple state-of-the-art results across benchmarks, including Scene Flow, KITTI, ETH3D, and Middlebury.

[44] Factor-Informed Uncertainty Distillation for Gaze Estimation cs.CV | cs.HCPDF

Mohammadreza Jamalifard, Yaxiong Lei, Javier Fumanal Idocin, Parastoo Azizinezhad, Tom Foulsham

TL;DR: 本文提出了一种名为因子知情不确定性蒸馏（FIUD）的师生框架，用于提升视线估计任务中不确定性预测的准确性和可解释性。该方法利用梯度提升教师模型从图像质量因子（如光照、清晰度、眼睛可见性与对称性）预测期望的视线误差，并通过课程学习和排序监督将这些信号蒸馏到一个轻量级的单次前向不确定性预测头中。

Details

Motivation: 解决在非受控环境下，深度视线估计模型性能下降且需要可靠拒绝不可靠预测的问题，现有单次前向不确定性方法缺乏明确的输入有效性线索，而基于采样的方法计算成本过高，难以实时应用。

Result: 在ETH-XGaze、Gaze360和MPIIFaceGaze（超过30万个样本）数据集上，FIUD在不确定性校准、误差排序相关性和选择性预测方面优于确定性基线和基于采样的基线，在非受控设置中提升最为显著。

Insight: 创新点在于将不确定性预测与可解释的图像质量失效模式对齐，通过因子驱动的教师模型提供明确的监督信号，并利用课程学习和排序监督进行高效蒸馏，实现了轻量、准确且可解释的单次前向不确定性估计。

Abstract: Deep gaze estimation works well in controlled capture but degrades in unconstrained settings, where systems must reject unreliable predictions. Single-pass uncertainty (e.g., heteroscedastic regression) infers uncertainty from pixels without explicit input-validity cues, while sampling based methods are often too costly for real time use. We propose Factor-Informed Uncertainty Distillation (FIUD), a teacher-student framework that aligns uncertainty with interpretable image-quality failure modes. A gradient-boosting teacher predicts expected gaze error from factors such as illumination, sharpness, eye visibility and symmetry; a neural student distills these signals via curriculum learning and ranking supervision into a lightweight single-pass uncertainty head. Across ETH-XGaze, Gaze360, and MPIIFaceGaze (>300k samples), FIUD improves uncertainty, error rank correlation and selective prediction versus deterministic and sampling-based baselines, with the largest gains in unconstrained settings.

[45] ENTRAP-VL: A Taxonomic Probe for Dual Contextual Entrainment in Vision-Language Models cs.CV | cs.AI | cs.CLPDF

Karan Goyal, Afreen Hossain, Debojyoti Das, Vishal Bhutani

TL;DR: 本文提出了ENTRAP-VL，一个用于评估视觉-语言模型中上下文顺应性（contextual entrainment）现象的手动构建数据集和分类框架。该研究认为，在VLMs中，顺应性是一种双重现象，可分别由文本和视觉上下文驱动，并引入了真实性与可能性的区分。

Details

Motivation: 目前，上下文顺应性（即模型输出被输入中的辅助上下文所牵引的现象）在单模态语言模型中已被研究，但在视觉-语言模型（VLMs）中如何表现尚不明确，且缺乏专门的研究工具。

Result: 研究构建了包含1,500个样本、覆盖八个类别的手动标注数据集ENTRAP-VL，并提供了一个分类法（基于上下文与项目的关联性及其与真实性的关系）和评估协议，但未声称测量任何特定模型的顺应性水平。

Insight: 创新点在于提出了一个针对VLMs的双模态、分类结构化的评估工具，将顺应性视为由文本和视觉上下文独立驱动的双重现象，并引入了在单模态研究中不存在的“对描绘场景为假但在世界中可能”的真实性区分维度。

Abstract: Contextual entrainment is the tendency of a model to let auxiliary context in its input pull its output, independently of whether that context is relevant, true, or even meaningful. Recently, it has been identified and given a mechanistic account in unimodal language models. Whether and how it manifests in vision-language models (VLMs) is, by contrast, largely unexamined, and the field lacks a purpose-built instrument with which to investigate it. We take the position that studying contextual entrainment in VLMs requires more than porting an existing text-only benchmark to the multimodal setting: it requires a taxonomically structured, dual-modality instrument whose conditions are constructed around the item at hand (the depicted image in the textual stream, the textual query in the visual stream). We argue that the move to VLMs is substantive rather than incremental. It makes entrainment a dual phenomenon, drivable independently by textual and by visual context, and it opens a veracity distinction (context that is false of the depicted scene yet possible in the world) that has no counterpart in the unimodal, world-knowledge-only formulation of prior work. To make this position concrete and actionable, we introduce ENTRAP-VL (ENTRainment Assessment Probe for Vision and Language), a manually curated dataset of 1,500 items across eight categories, organized by a taxonomy that spans two axes, i.e., the association of context with the item and its relationship to truth, and split into a textual-entrainment stream (eight context conditions) and a visual-entrainment stream (three context conditions). We do not claim to measure entrainment in any particular model; we provide the instrument, the taxonomy that motivates it, and the evaluation protocols it enables, so that the community can investigate the phenomenon rigorously. We will release the dataset and its documentation publicly.

[46] Development of an automated, reliable, and clinically meaningful artificial intelligence (AI) tool for diagnosing cardiac disease from conventional cardiovascular magnetic resonance (CMR) images cs.CVPDF

Sina Amirrajab, Volker Vehof, Michael Bietenbeck, Nuriye Akyol, Redouane Bouras

TL;DR: 本研究开发了一个用于从常规心血管磁共振（CMR）图像中自动诊断心脏病的AI工具。该工具通过整合开源本地运行的大型语言模型（LLM）来自动化数据整理流程，从叙述性CMR报告中提取诊断标签，并预处理包括电影序列和晚期钆增强（LGE）序列在内的多模态成像数据。研究采用两阶段方法对三种视觉基础模型（DINO, VST, UMedPT）进行微调，并在包含肥厚型心肌病（HCM）、扩张型心肌病（DCM）、缺血性心肌病（ICM）、心脏淀粉样变性（CA）和正常对照（NOR）的数据集上进行评估。集成策略进一步提升了诊断准确性和鲁棒性，在独立测试集上取得了高判别性能。

Details

Motivation: CMR成像在心肌结构、功能和病理的无创评估中至关重要，但其解读需要大量经验。当前AI模型在辅助CMR解读方面面临数据整理劳动密集、模型性能欠佳和实施路径不明确等限制。

Result: 在包含1067名患者的独立测试集上，微调后的AI模型实现了高判别诊断性能，例如HCM诊断的AUC-ROC高达0.937，CA高达0.945。集成多种模型和模态的策略进一步提升了性能，在HCM（AUC=0.959）、CA（AUC=0.966）、NOR（AUC=0.872）、DCM（AUC=0.848）和ICM（AUC=0.840）上达到了最高总体诊断性能。

Insight: 创新点在于开发了一个结合LLM的自动化数据整理流程，用于从非结构化报告中提取标签，并采用两阶段微调策略整合多种视觉基础模型处理多模态CMR数据。客观来看，其集成策略有效提升了模型的准确性和鲁棒性，且代码和模型权重已开源，促进了可重复性和临床转化。

Abstract: Aims: Cardiovascular magnetic resonance (CMR) imaging enables non-invasive assessment of myocardial structure, function, and pathology, but requires substantial experience in interpretation of CMR images that could be supported by artificial intelligence (AI)-based models. However, use of AI models for enhanced CMR reading is limited by labor-intensive data curation, suboptimal model performance, and unclear implementation pathways. Methods and results: We developed an automated data curation pipeline for CMR-based cardiovascular disease (CVD) diagnosis, integrating open-source locally-run large language models (LLMs) to extract diagnostic labels from narrative CMR reports and preprocessing multimodal imaging data, including cine and late-gadolinium-enhancement (LGE) CMR sequences. Three vision foundation models (DINO, VST, UMedPT) were fine-tuned across these modalities in a two-stage approach. The dataset comprised hypertrophic cardiomyopathy (HCM), dilated cardiomyopathy (DCM), ischemic cardiomyopathy (ICM), cardiac amyloidosis (CA), and normal controls (NOR). A total of 988 curated cases were randomly divided into 742 for training and 246 for validation. Fine-tuned AI-models achieved high discriminative diagnostic performance on an independent test set comprising 1067 patients , with individual AUC-ROC values of up to 0.937 for the correct diagnosis of HCM and 0.945 for cardiac amyloidosis. Ensemble strategies combining multiple models and modalities further improved AI-based diagnostic accuracy and robustness, achieving the highest overall diagnostic performance for HCM (AUC=0.959, CI [0.936-0.978]), CA (AUC=0.966, CI [0.939-0.986]), NOR (AUC=0.872, CI [0.852-0.894]), DCM (AUC=0.848, CI [0.808-0.885]) and ICM (AUC=0.840, CI [0.809-0.868]). All training and inference code, along with the trained model weights, are publicly available on https://github.com/sinaamirrajab/CMR_CVD.

[47] HeadCast: Casting Attention Heads for Efficient Autoregressive Video Generation cs.CV | cs.LGPDF

Jinliang Shen, Lianghao Su, Zheming Li, Kang He, ZiLiang Lai

TL;DR: 本文提出了一种名为HeadCast的免训练、即插即用加速框架，用于解决自回归视频扩散模型中因KV缓存持续增长导致注意力计算成为推理瓶颈的问题。该方法通过分析预训练模型中注意力头的稳定异质行为，将其分类为四种原型，并据此重组KV缓存，在保持视频质量的同时显著提升推理速度。

Details

Motivation: 自回归视频扩散模型在生成长序列和流式视频方面前景广阔，但其推理过程中不断增长的键值缓存导致注意力计算成本高昂，尤其是在高分辨率下每帧包含大量令牌时。现有方法要么使用粗糙的启发式策略清除缓存导致帧间闪烁，要么需要重新训练模型。

Result: 在多个SOTA自回归模型上，HeadCast在720P分辨率下加速高达1.62倍，在1080P下加速高达1.95倍，同时在VBench评估中保持了与完整注意力机制相当的视频质量，且基本消除了闪烁现象。

Insight: 核心创新点在于首次观察到预训练AR模型中注意力头具有稳定且异质的行为模式，并据此提出一种无需重新训练、基于注意力头分类的原型化缓存重组策略。该方法的关键在于保留了负责长程时间一致性的’全局’头，同时通过固定大小的’空间’通路实现计算节省，其效率随分辨率提升而增长。

Abstract: Autoregressive (AR) video diffusion models have become a promising paradigm for long and streaming video synthesis, but the continuously growing Key-Value (KV) cache makes attention the dominant inference cost, especially at high resolution where each frame contributes many tokens. Existing remedies either evict the cache with coarse heuristics that cause inter-frame flickering, or require model re-training. We propose HeadCast, a training-free, plug-and-play acceleration framework built on the observation that a pre-trained AR model’s attention heads exhibit stable, heterogeneous behaviors. After a short warm-up, HeadCast performs a one-time classification at the maximum-noise step that sorts every head into one of four archetypes: Sink, Dummy, Spatial, and Global, and restructures the monolithic KV cache into head-specific pathways. Crucially, it retains the Global heads that preserve the long-range temporal consistency aggressive eviction destroys. Because the Spatial pathway operates on a fixed-size grid, its savings grow with resolution: across state-of-the-art AR models, HeadCast accelerates inference by up to 1.62x at 720P and 1.95x at 1080P, while keeping VBench quality on par with full attention and largely flicker-free. Code is available at https://github.com/sjlgaga/HeadCast .

[48] Real-Time EEG Cap Electrode Detection for Guided Point-of-Care Placement cs.CV | eess.IVPDF

William Lehn-Schiøler, Mads Sverker Nilsson, Nicki Skafte Detlefsen

TL;DR: 本文提出了一种两阶段的视觉系统，用于实时检测脑电图（EEG）帽电极并通过面部标志点验证其解剖位置。该系统采用单类YOLO检测器定位电极，几何阶段将检测结果分配至10-20系统的命名角色。在五个受试者佩戴不同尺寸帽子的实验中，通过留一受试者交叉验证，检测器达到mAP@.5 = 0.94 +/- 0.07，并展示了实时性能（19 FPS）。

Details

Motivation: 解决在临床护理点（POC）环境中，快速、准确地放置EEG帽电极并验证其解剖位置的需求，以提高脑电图记录的效率和可靠性。

Result: 在留一受试者交叉验证中，检测器mAP@.5达到0.94 +/- 0.07（合并后0.96）；留一帽子验证显示中号和大号帽子性能稳定（mAP@.5约0.97），小号帽子下降至0.72。几何增强提升了鲁棒性和召回率，头部裁剪将远距离mAP@.5从0.23提升至0.45。使用YOLOv10n骨干网络在消费级CPU上实现19 FPS的实时吞吐量。

Insight: 创新点包括结合目标检测与几何分析的两阶段实时验证框架，以及通过数据增强和头部裁剪提升模型鲁棒性和适用范围。系统在保持高精度的同时实现实时处理，适用于移动或资源受限的临床环境。

Abstract: We present a two-stage vision system that detects EEG cap electrodes in a live webcam stream and validates their anatomical placement in real time. A single-class YOLO detector localises electrodes; a geometric stage assigns each detection to a named 10-20 role from facial landmarks. Evaluating under subject-disjoint leave-one-subject-out (LOSO) cross-validation across five subjects wearing the clinically-validated Small/Medium/Large caps, the detector attains mAP@.5 = 0.94 +/- 0.07 across five held-out folds (0.96 pooled). A dedicated leave-one-cap-out axis, holding out every frame of a cap regardless of subject, leaves Medium and Large mAP@.5 within 0.01 of LOSO (0.97, 0.97) while Small drops to 0.72 +/- 0.28, a gap confounded with subject familiarity rather than cap style. Geometric augmentation (rotation, perspective, mixup) improves in-plane-roll robustness and temporal-electrode recall at no inference cost, and a landmark-driven head crop extends the usable distance range, lifting mAP@.5 from 0.23 to 0.45 at 0.6 x apparent scale. A compact mobile-candidate backbone (YOLOv10n) keeps the detector at real-time throughput (19 FPS) on a commodity CPU at 640 px.

[49] SHFormer: Dynamic Spectral Filtering Convolutional Neural Network and High-pass Kernel Generation Transformer for Adaptive MRI Reconstruction cs.CVPDF

Sriprabha Ramanarayanan, Rahul G. S., Mohammad Al Fahim, Keerthi Ram, Ramesh Venkatesan

TL;DR: 该论文提出了一种名为SHFormer的新型神经网络架构，用于加速磁共振成像（MRI）的自适应重建。它结合了动态光谱滤波卷积神经网络（CNN）和高通核生成Transformer，旨在解决现有基于注意力机制（AM）的模型在捕获高频细节和跨模态泛化能力方面的不足。该方法在监督、自监督、基于扩散模型的训练以及异构MRI数据的闭集和开集泛化等多种场景下进行了评估，展示了其可扩展性和高质量重建能力。

Details

Motivation: 现有基于注意力机制的MRI重建模型更擅长捕获低频信息，对高频细节的表示能力有限，导致重建图像过于平滑。同时，这些模型通常需要针对不同模态的MRI数据进行特定重训练，因为它们捕获的局部上下文特征难以跨异构域迁移，限制了其可扩展性和泛化能力。

Result: 在未见过的场景下，该方法在峰值信噪比（PSNR）上取得了约1 dB的最佳提升，在结构相似性指数（SSIM）上提升了约0.01，实现了高质量的可扩展重建。评估涵盖了监督学习、自监督学习、基于扩散模型的训练以及异构MRI数据的闭集和开集泛化等多种设置。

Insight: 论文的核心创新在于提出了一种基于神经调节的判别性多光谱注意力机制，它通过一个光谱滤波CNN来捕获模态特定的可迁移特征，同时利用一个动态高通核生成Transformer来专注于高频细节的传播。这种设计使得模型能够生成上下文感知的高频细节以进行高质量重建，并捕获可在偏离的未见域中重用的特征，从而增强了跨模态的泛化能力。

Abstract: Attention Mechanism (AM) selectively focuses on essential information for imaging tasks and captures relationships between distant pixel neighborhoods to compute feature representations. Accelerated MRI reconstruction benefits from AM, as the imaging process involves Fourier domain measurements that influence image representation non-locally. However, AM-based models are more adept at capturing low-frequency information with limited capacity for high-frequency representations, restricting models to smooth reconstruction. Additionally, AM-based models need mode-specific retraining for multimodal MRI data, as their knowledge is restricted to local contextual variations that may be inadequate to capture transferable features across heterogeneous domains. To address these challenges, we propose a neuromodulation-based discriminative multi-spectral AM for scalable MRI reconstruction that can (i) propagate context-aware high-frequency details for high-quality reconstruction, and (ii) capture features reusable across deviated unseen domains in multimodal MRI. The proposed network consists of a spectral filtering CNN to capture mode-specific transferable features and a dynamic high-pass kernel generation transformer focusing on high-frequency details. We evaluate our model on comparative studies in supervised and self-supervised learning, diffusion model-based training, closed-set and open-set generalization under heterogeneous MRI data, and interpretation-based analysis. Our method offers scalable, high-quality reconstruction with best improvement margins of ~1 dB in PSNR and ~0.01 in SSIM under unseen scenarios. Code: https://github.com/sriprabhar/SHFormer

[50] StreamHOI: Interaction-aware Temporal Memory Adaptation for Streaming HOI Video Generation cs.CV | cs.AIPDF

Zejing Rao, Haoxian Zhang, Xiaoqiang Liu, Yiping Meng, Guoxin Zhang

TL;DR: 本文提出了StreamHOI，一个用于生成长时长人-物交互（HOI）视频的低延迟流式框架。该框架通过离线HOI感知的块性能分析和偏置引导的内存专用化训练，使生成器适应块特定的内存布局，并引入内存距离缩放模块以增强对早期交互状态的远程访问。实验表明，StreamHOI在交互合理性、物体保真度、人物质量和效率方面表现优异，达到17.6 FPS和0.75秒的首块延迟。

Details

Motivation: 现有HOI视频生成方法主要局限于离线短视频生成，且驱动条件复杂，不适合实时交互应用。因此，需要开发一个低延迟的流式框架来支持长时长的HOI视频生成。

Result: 与长视频基线及近期HOI生成方法的大量比较表明，StreamHOI在交互合理性、物体保真度、人物质量和效率方面均达到强竞争力水平，实现了17.6 FPS的帧率和0.75秒的首块延迟。

Insight: 创新点在于揭示了标准sink-local内存设计在流式HOI生成中的权衡，以及不同Transformer块对HOI区域和周围区域的历史内存偏好不同。通过HOI感知的块性能分析和偏置引导的内存专用化训练来适配内存组成与块行为，并引入内存距离缩放模块以增强长期依赖建模，从而在保证低延迟的同时提升生成质量。

Abstract: Existing human–object interaction (HOI) video generation methods are largely limited to offline short-video generation with complex driving conditions, making them unsuitable for real-time interactive applications. We present \emph{StreamHOI}, a low-latency streaming framework for long-duration HOI video generation. Instead of converting heavily conditioned HOI pipelines into streaming systems, we study how an image-to-video streaming generator should organize historical memory to preserve interactions under bounded latency. We find that the standard sink-local memory design faces a trade-off in streaming HOI generation, and different transformer blocks show different historical-memory preferences for HOI regions and surrounding regions. To match memory composition with block behavior, StreamHOI performs offline HOI-aware block profiling and applies bias-guided memory-specialized training to adapt the generator to block-specific memory layouts. We further introduce a memory distance scaling module to strengthen long-range access to early interaction states. Extensive comparisons with both long-video baselines and recent HOI generation methods demonstrate that StreamHOI achieves strong interaction plausibility, object fidelity, human quality and efficiency, reaching 17.6 FPS with 0.75s first-chunk latency.

[51] PerceptDrive: Perception Prior World-Action Modeling with Adaptive Expert Routing for End-to-End Autonomous Driving cs.CVPDF

Yushan Liu, Tianxiong Lv, Bohua Wang, Hangqi Fan, Chenxu Zhao

TL;DR: 本文提出了PerceptDrive，一种用于端到端自动驾驶的感知先验世界-动作建模框架，通过自适应专家路由机制，将冻结的感知基础模型提取的丰富先验知识与自监督视频编码器的密集观测潜在表示相结合，以生成驾驶轨迹，无需测试时的候选轨迹评分或搜索。

Details

Motivation: 为了解决冻结的感知基础模型因条件接口狭窄而可能削弱任务相关线索，以及静态融合无法根据场景动态调整专家贡献的问题，本文将其视为先验到规划的迁移挑战。

Result: 在NAVSIM v1和v2基准测试中，PerceptDrive分别取得了90.4 PDMS和90.2 EPDMS的SOTA性能，超越了现有方法。消融实验证实了先验保留和场景条件路由的互补增益。

Insight: 核心创新在于提出了一个自适应专家路由框架，通过先验保留目标将专家分支锚定在特定先验上，并利用基于场景表示的软门控路由动态融合专家条件，从而在无需测试时候选选择的情况下直接改进规划性能。

Abstract: Frozen perception foundation models encode rich geometric, semantic, and dynamic knowledge. Yet narrow conditioning interfaces may attenuate task-relevant cues, while static fusion cannot adjust expert contributions to each scene. We cast this challenge as the prior-to-plan transfer problem and introduce PerceptDrive, a perception prior world-action modeling framework with adaptive expert routing. PerceptDrive feeds teacher-distilled priors from a frozen, driving-adapted provider and dense observation latents from a frozen self-supervised video encoder into a trainable expert-routed world-action model. Expert-specific query branches process these signals, while a prior-retention objective anchors each branch to its prior. A router predicts soft gates from a shared scene representation and combines the expert conditions before trajectory generation. During training, privileged rule-based sub-metric estimates for branch-specific trajectory drafts provide soft-gate distillation targets. The predicted action-free future latent conditions a flow-matching actor. At inference, privileged components are absent; with one front-facing camera, PerceptDrive generates one trajectory per planning step without test-time scoring, reranking, or search. Experiments show that PerceptDrive achieves state-of-the-art performance with 90.4 PDMS on NAVSIM v1 and 90.2 EPDMS on NAVSIM v2, outperforming existing methods. Ablations confirm complementary gains from prior retention and scene-conditioned routing, alongside differential reliance on the three priors. These results demonstrate that preserving and adaptively routing perception priors improves direct planning without test-time candidate selection.

[52] Vera: Identity-Faithful Human Subject-to-Video Generation cs.CVPDF

Yulong Xu, Xinyue Liu, Shujuan Li, huafeng shi, Yan Zhou

TL;DR: 论文提出Vera框架，用于提升以人为中心的单人与多人主题到视频生成中的身份一致性。通过构建百万对身份对齐的人像图像-视频数据集，并引入身份聚焦掩码监督和参考感知分层注意力机制，有效解决了跨帧身份漂移、多人场景身份混淆等问题。

Details

Motivation: 现有主题到视频生成方法在保持参考主题一致性方面虽有进展，但在以人为中心的生成中，身份关键细节仍易在帧间、姿态和交互中漂移，尤其在多人场景下易出现身份混淆、属性交换和过度复制参考外观线索的问题。

Result: 大量实验表明，Vera在提升人类身份一致性、多人主题绑定和运动自然度的同时，减少了身份混淆和过度参考图像复制，在相关基准测试中表现出优越性能。

Insight: 创新点包括通过人物级跨片段检索构建大规模身份对齐数据集，以及身份聚焦掩码监督和参考感知分层注意力机制，这些设计强化了身份感知学习并稳定了身份锚点，为视频生成中的身份保持提供了新思路。

Abstract: Subject-to-video (S2V) generation has made substantial progress in preserving reference subjects across diverse categories, yet generic subject consistency remains insufficient for human-centric generation. A video may appear globally consistent while identity-critical human details still drift across frames, poses, and interactions. This issue becomes more severe in multi-person scenarios, where incorrect identity-role binding leads to subject confusion, attribute swapping, and excessive copying of reference-specific appearance cues. We propose Vera, a unified human-centric S2V framework for single- and multi-person generation. We first construct a million-pair identity-aligned human image-video dataset through person-level cross-clip retrieval, providing explicit identity correspondence and diverse references. Built on this dataset, Vera introduces two complementary designs. Identity-Focal Masked Supervision (IFMS) strengthens identity-aware learning with spatially focused supervision while reducing interference from irrelevant artifacts. Reference-Aware Layer-wise Attention (RALA) regulates how video tokens interact with reference identity cues in the DiT backbone, preserving stable identity anchors and enhancing layer-aware identity readout. Extensive experiments demonstrate that Vera improves human identity consistency, multi-person subject binding, and motion naturalness, while reducing identity confusion and excessive reference-image copying.

[53] RS-RIE-Bench: Benchmarking Reasoning-Guided Remote Sensing Image Editing cs.CVPDF

Zihan Qin, Boao Xu, Zhao Dong, Yingping Sun, Ziheng Jiao

TL;DR: 该论文提出了首个用于评估推理引导的遥感图像编辑能力的基准测试RS-RIE-Bench。该基准将任务分为时间推理、因果推理和空间推理三类，以捕捉遥感场景中的时序演变、因果后果和空间成像一致性。评估协议涵盖目标区域合理性、非目标区域保持和图像质量一致性三个维度，并验证了基于多模态大语言模型评估的可行性。对八个开源和闭源模型的系统评估表明，当前模型在推理引导的遥感编辑方面仍存在明显局限。

Details

Motivation: 现有基准主要针对自然图像或通用视觉场景，可能无法充分评估遥感图像编辑所需的推理、区域控制和传感器一致性能力。为了填补这一空白，作者旨在创建一个专门用于评估推理引导遥感图像编辑的基准。

Result: 在严格的联合满足标准下，即使最强的模型总体准确率也仅为24.28%，而八个模型的平均宽松联合-4成功率仅为32.23%。因果推理和空间推理尤其具有挑战性，一些开源模型在某些类别上接近零分。

Insight: 论文的主要创新点是构建了首个专注于遥感图像编辑推理能力的多维度基准测试，其任务分类和评估维度针对遥感领域特性设计。从客观角度看，该工作为未来模型在提升地理推理、区域控制和传感器一致性生成方面提供了标准化的评估工具和明确的研究方向。

Abstract: Remote sensing image editing aims to modify remote sensing images according to natural language instructions while preserving geographic rules and sensor observation characteristics. Existing benchmarks mainly target natural images or general visual scenes, and thus may not fully capture the reasoning, regional control, and sensor-consistency abilities required in remote sensing editing. To fill this gap, we introduce RS-RIE-Bench, the first benchmark for reasoning-guided remote sensing image editing. RS-RIE-Bench organizes tasks into three categories: temporal reasoning, causal reasoning, and spatial reasoning. These categories capture temporal evolution, causal consequence, and spatial imaging consistency in remote sensing scenes. The evaluation protocol covers three dimensions: target region plausibility, non-target region preservation, and image quality consistency. We further demonstrate the feasibility of MLLM-based evaluation through cross-judge consistency analysis and stratified expert review. Systematic evaluation on eight open-source and closed-source image editing models shows that current models still have clear limitations in reasoning-guided remote sensing editing. Even the strongest model achieves only 24.28% overall accuracy under the strict joint-satisfaction criterion, while the mean relaxed joint-4 success rate across all eight models is 32.23%. Causal reasoning and spatial reasoning remain especially challenging, and several open-source models are close to zero in some categories. These results show that RS-RIE-Bench can effectively reveal the limitations of current models in geographic reasoning, regional control, and sensor-consistent generation. It also provides a standardized benchmark and a clear research direction for future remote sensing intelligent editing models.

[54] How Does Urban Context Relate to Residential Building Health? A Vision-POI Fusion Framework for Building-Level Housing Inspection cs.CVPDF

Kun Zhao, Helei Ren, Guilin Tang, Tianyi Chen, Zhehui Song

TL;DR: 该研究提出了一种融合多视角视觉检测与POI（兴趣点）邻域上下文的框架，用于评估住宅建筑健康状况。通过整合图像级问题检测结果与周边功能环境特征，在青岛92个老旧小区、3237栋住宅建筑的数据集上进行了实证分析。结果表明，多视角聚合显著提升了建筑级分类性能，而POI上下文信息则提供了补充性的先验知识。

Details

Motivation: 现有自动化建筑检测研究主要依赖单张图像，缺乏对周边城市功能环境能否为建筑级评估提供补充信息的探索。本研究旨在通过融合视觉与POI数据，更全面地评估住宅建筑健康状况。

Result: 在包含七类住宅问题的数据集上，多视角聚合将建筑级Macro-F1从直接检测的60.84%提升至74.95%；加入POI上下文后进一步增至76.79%，但提升幅度有限且类别依赖。

Insight: 创新点在于首次将多视角视觉检测与POI衍生的邻域功能环境特征融合，用于建筑级健康评估；客观来看，该框架明确了POI上下文作为补充先验而非视觉证据替代品的角色，为城市体检提供了可解释的多源数据融合方法。

Abstract: Housing-level urban physical examination is essential for identifying residential building problems and supporting targeted urban renewal. Existing automated inspection studies primarily rely on individual images and rarely examine whether surrounding urban functional context can provide supplementary information for building-level assessment. This study proposes a vision-POI fusion framework that combines multi-view visual inspection with POI-derived neighborhood context for residential building health assessment. The empirical dataset covers 92 old residential communities, 3,237 residential buildings, and 25,608 field-acquired inspection images in Qingdao, China, encompassing seven categories of housing-related issues. First, multiple object detection models are evaluated to extract issue locations, categories, and confidence scores from individual images. The image-level outputs are subsequently aggregated across multiple views to construct interpretable building-level representations. Second, POI features are extracted within 500m, 1,000m, and 1,500m neighborhood buffers to characterize surrounding functional environments. Pearson and Spearman correlation analyses, combined with false discovery rate correction, are used to identify candidate contextual features. Finally, visual and POI features are integrated using a cost-sensitive Random Forest classifier under community-isolated spatial cross-validation. The results show that multi-view aggregation provides the main performance improvement, increasing the building-level Macro-F1 from 60.84% under Direct Detection to 74.95%. Incorporating POI context further increases Macro-F1 to 76.79%, although the additional gain is modest and category-dependent. POI information therefore functions as a supplementary contextual prior rather than a substitute for direct visual evidence or a causal determinant of building condition.

[55] Self-supervision drives representational convergence in medical foundation models more than clinical supervision cs.CV | cs.AI | cs.CL | cs.LGPDF

Soroosh Tayebi Arasteh, Sebastian Ziegelmayer, Mahshad Lotfinia, Lisa Adams, Sven Nebelung

TL;DR: 本文通过对比18个图像编码器和7个文本编码器，研究了医学基础模型表征的收敛性。研究发现，表征收敛主要由自监督目标驱动，而非临床监督或模型规模，且收敛程度有限，无法完全复现放射科医生的判断。

Details

Motivation: 探究医学图像编码器的表征是否真正收敛于共享结构，以及这种收敛是由规模、临床监督还是自监督目标驱动的，并评估其临床可用性。

Result: 在胸片X光数据集上，匹配的自监督编码器对齐度最高（40.4%），远高于标签监督（21.1%）和图像-文本对齐（3.3%），且收敛度不随模型规模或能力增长。线性分类器在不同编码器间和五家外部医院上可迁移，保持了约85%的原始性能。

Insight: 医学成像中的表征收敛性主要由预训练目标（特别是自监督）设定，而非继承自规模或临床监督。为实现互操作性，应通过设计预训练目标来达成，并在患者亚组和临床判断等共享几何最薄弱的环节进行验证。

Abstract: Medical image encoders from different groups are increasingly treated as interchangeable, on the assumption that scale and clinical supervision concentrate their representations onto a shared structure. Whether this convergence is real, what produces it, and whether it is clinically usable are untested, and the similarity measures behind such claims are fragile. We present a controlled dissection across 18 image and 7 text encoders, all open-weight and run locally, spanning 7M to 27B parameters and five imaging modalities, including 650,982 chest radiographs from six datasets. To isolate cause, we train encoders that vary only the objective under fixed data, architecture, and scale, and reproduce the effect in a synthetic model. Convergence is modest but above a random floor, driven by the self-supervised objective, not clinical supervision: matched self-supervised encoders aligned most (40.4% on chest radiography), with label-supervised (21.1%) and image-text (3.3%) far lower, and did not grow with size (Spearman 0.302, p=0.223) or capability. It is within-modality, does not reach clinical language, and does not reproduce how radiologists judge case similarity. Yet a linear classifier transfers across encoders and to five held-out hospitals, retaining about 85% of within-encoder performance. Convergence in medical imaging is therefore set by the pretraining objective, not inherited from scale or clinical supervision. Interoperability is accordingly something to design for through that objective, and to validate where the shared geometry is weakest, across patient subgroups and against clinical judgment.

[56] Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose? cs.CVPDF

Qiwei Ma, Chunping Qiu, Xinjun Cheng, Xiaoyu Zhang, Puhong Duan

TL;DR: 本文对用于遥感图像场景理解（RSISU）的多模态大语言模型（MLLMs）进行了系统性综述与诊断性评估。研究发现，尽管领域特定的遥感MLLMs（RS-MLLMs）在部分任务上保持竞争力，但通用计算机视觉MLLMs（CV-MLLMs）在未经遥感特定微调的情况下，也能在多个RSISU任务上达到相当甚至更优的性能，揭示了通用模型的强大可迁移性。

Details

Motivation: 目前缺乏对现有遥感MLLMs能力边界、跨任务泛化性和任务特定局限性的系统性理解，因此本文旨在通过系统性的综述和评估来填补这一空白。

Result: 评估表明，RS-MLLMs在遥感视觉定位和高分辨率视觉问答等特定领域任务中保持竞争力。然而，通用CV-MLLMs在多个RSISU任务上无需微调即可匹配甚至超越这些专用模型。当前模型在空间与关系推理、细粒度视觉理解、指令多样性和异构任务格式泛化方面仍存在局限。

Insight: 主要创新点在于对RS-MLLMs与通用CV-MLLMs进行了跨任务和基准的全面比较，揭示了通用模型在遥感领域的强大可迁移性，挑战了开发领域专用模型的必要性。从客观角度看，该研究为未来开发更鲁棒、可泛化、实用的RSISU模型提供了清晰的评估框架和发展方向，强调了提升模型基础推理能力的重要性。

Abstract: The rapid development of multimodal large language models (MLLMs) has introduced a flexible paradigm for remote sensing image scene understanding (RSISU), enabling natural-language interaction with remote sensing imagery. However, a systematic understanding of the capability boundaries, cross-task generalization, and task-specific limitations of existing remote sensing MLLMs (RS-MLLMs) is still lacking. This paper presents a systematic survey and diagnostic evaluation of MLLMs for RSISU. We review the technical evolution of RS-MLLMs, focusing on model design, multimodal learning, training data, and downstream capabilities. We further compare RS-MLLMs with general-purpose computer vision MLLMs (CV-MLLMs) across diverse RSISU tasks and benchmarks. RS-MLLMs remain competitive in domain-specific settings, particularly remote sensing visual grounding and high-resolution visual question answering. More notably, general-purpose CV-MLLMs can match or even outperform these specialized models on several RSISU tasks without remote sensing-specific fine-tuning. These findings demonstrate the strong transferability of general-purpose CV-MLLMs and show that current RS-MLLMs do not consistently outperform them across diverse RSISU tasks. Current MLLMs also face limitations in spatial and relational reasoning, fine-grained visual understanding, instruction diversity, and generalization across heterogeneous task formats. Based on these findings, we outline future directions toward reliable evaluation, multimodal and high-resolution reasoning, efficient deployment, and tool-augmented remote sensing agents. This survey provides a systematic reference for developing robust, generalizable, and practical MLLMs for RSISU.

[57] Test-Time Training for Modality Order Consistency in Vision-Language Models cs.CV | cs.CLPDF

Aditi Gupta, Yossi Gandelsman

TL;DR: 该论文发现视觉语言模型对图像和问题输入顺序这一语义无关的变化敏感，图像优先的提示方式始终优于问题优先，揭示了模态顺序一致性失败。作者设计了一种顺序一致性的测试时训练方法，显著缩小了模态顺序差距，并意外地提升了图像优先分支的性能。激活修补定位到网络中部一个狭窄区域，测试时训练方法修复了层间表征错位。

Details

Motivation: 解决视觉语言模型对图像和问题输入顺序敏感的问题，这种语义无关的顺序变化会导致性能差异，揭示模型存在模态顺序一致性的电路级失败。

Result: 在三个模型和三个基准测试中，测试时训练方法显著缩小了所有评估设置中的模态顺序差距，并在图像优先分支上持续超越基线，实现了性能提升。

Insight: 创新点在于利用模态顺序差距设计简单、非对称的测试时适应方法，不仅缓解顺序敏感性，还能提升基线性能；通过激活修补定位故障区域，为理解模型内部表征对齐提供了新视角。

Abstract: We find that vision-language models are sensitive to a specific semantically irrelevant change: the order in which the image and question are presented. Across three models and three benchmarks, image first prompting consistently outperforms question-first prompting, revealing a repeatable modality order failure. We use this gap to design an order-consistent test-time training method. Our method substantially closes the modality-order gap across all evaluated settings. Surprisingly, it also yields consistent improvements in the stronger image-first branch over the baseline, hence bootstrapping both orderings toward mutual consistency. Activation patching localizes the ordering failure to a narrow mid-network region where representations diverge sharply between prompt orders. We find that the test-time training method repairs this misalignment across layers. Together, our results identify modality-order sensitivity as a circuit-level failure in VLMs and demonstrate that simple, asymmetric test-time adaptation can effectively mitigate it and even improve performance over the baseline.

[58] Diverse-Intent Multi-Turn Fashion Image Retrieval cs.CVPDF

Mingqiang Tang, Haokun Wen, Meng Liu, Yupeng Hu, Weili Guan

TL;DR: 本文提出了DIM-Fashion基准数据集和FashionAM框架，以解决现实世界时尚搜索中多轮交互检索的局限性。现有方法假设交互遵循单一属性编辑模式且依赖文本化转换，而新方法通过构建包含多样化意图转换和回滚行为的会话数据集，并设计直接对齐多模态查询与视觉嵌入空间的MLLM-VLP框架来应对。

Details

Motivation: 解决现有多轮时尚检索方法的两大局限：一是假设所有交互遵循同质化的属性编辑意图，忽略了异质性意图转换；二是依赖文本化桥接多模态查询与视觉检索，可能导致细粒度视觉线索丢失。

Result: 在构建的DIM-Fashion基准（包含26K多轮会话，覆盖7个任务）上进行了广泛实验，证明了FashionAM框架相较于现有方法的有效性。

Insight: 创新点在于构建了首个专注于多样化意图转换（包括回滚行为）的时尚多轮检索基准，并提出了避免中间文本化、直接对齐多模态对话查询与时尚图库嵌入空间的新型MLLM-VLP框架，以保留细粒度视觉信息。

Abstract: Real-world fashion search involves interactive retrieval across multiple turns. However, existing multi-turn retrieval methods are built on a restrictive assumption that every interaction follows the same attribute-editing paradigm, leaving heterogeneous intent transitions unexplored. Moreover, existing approaches often rely on textification to bridge multimodal queries and visual retrieval, which may lose fine-grained visual cues. To address these gaps, we introduce DIM-Fashion, a benchmark of 26K multi-turn sessions constructed from 13 fashion retrieval datasets across 7 tasks, featuring diverse intent transitions and rollback behaviors. We further propose FashionAM, an MLLM-VLP framework that directly aligns multimodal conversational queries with a fashion-oriented gallery embedding space, avoiding intermediate textification. Extensive experiments demonstrate the effectiveness of FashionAM over existing approaches. The dataset and code will be made publicly available upon acceptance.

[59] PercepCap: Video Captioner with Structured Spatio-Temporal Perception cs.CVPDF

Yifan Xu, Zihao Wang, Zhixiao Wang, Jiaming Zhang, Yichun Yang

TL;DR: 本文提出了PercepCap，一种感知感知的视频描述框架，它采用‘感知-描述’生成链，先显式生成包含对象轨迹和时序事件的时空感知轨迹，再基于感知证据生成最终描述。通过两阶段训练策略（监督微调和基于感知的强化学习）以及配套的Caption-Anchored Perception Data Construction数据构建流程，该方法在视频描述任务上提升了性能。

Details

Motivation: 现有MLLM通常直接从视频输入生成描述，不暴露背后的感知证据，导致时空感知错误难以直接识别和纠正。

Result: 在直接描述和描述到QA评估中，PercepCap持续改进了Qwen3-VL基线，并展示了领先的描述质量。

Insight: 创新点在于显式化感知证据的‘感知-描述’生成链，以及配套的两阶段训练策略和数据构建流程，使模型能更可靠地关联感知与描述。

Abstract: Video captioning requires fine-grained spatio-temporal understanding of videos, including spatial perception of where objects are located and temporal perception of when events occur. Existing MLLMs usually generate captions directly from video inputs without exposing the perceptual evidence behind descriptions. As a result, mistakes in spatiotemporal perception are only observed in the final caption, making it difficult to identify the underlying perceptual errors directly. To address these issues, we present PercepCap, a perception-aware video captioning framework that makes perceptual evidence explicit before producing the final caption. Specifically, PercepCap follows a perceive-describe generation chain, where the model first produces a spatiotemporal perception trace comprising object trajectories and temporal events, and then generates the final caption conditioned on the perceived evidence. To support this, we design a two-stage training strategy. Perceive-then-Describe Supervised Fine-tuning adapts the model from caption-only generation to the proposed perceive-describe chain, while Perception-Grounded Reinforcement Learning optimizes perception trace and caption quality with joint rewards over perception chain and the final caption. To support our two-stage training, we introduce Caption-Anchored Perception Data Construction. This pipeline builds the SFT and RL training data by first generating a caption-only description, extracting the objects and events it mentions, and grounding them back in the video with boxes and timestamps. This yields caption-aligned perception data that provides solid training ground truth, ensuring that the explicit perception trace and final caption refer to the same objects and events. Across direct caption and caption-to-QA evaluation, PercepCap consistently improves upon the Qwen3-VL baseline and demonstrates leading caption quality.

[60] Look Less, Think Faster: Joint Token-Compute Adaptation for Multimodal LLMs cs.CVPDF

Pengcheng Wang, Zhiquan Wang, Jayoung Lee, Zhuoyan Xu, Ran Xu

TL;DR: 本文提出了SmartVL框架，通过联合控制视觉令牌数量和模型计算能力，动态适应输入内容和计算预算，以降低多模态大语言模型（MLLMs）的推理成本。该框架包含视觉侧令牌控制器和LLM侧计算控制器，通过共享预算编码和可微分延迟估计器进行端到端训练，实现跨阶段资源分配。

Details

Motivation: 多模态大语言模型在视觉语言任务中表现出色，但其高推理成本（源于大量输入视觉令牌和LLM的繁重计算）阻碍了实际部署。现有方法通常独立优化单个维度（如剪枝冗余视觉令牌或跳过LLM层），忽略了计算资源需根据输入内容动态跨维度分配的基本耦合问题。

Result: 在多个MLLM基准测试中，SmartVL通过联合调度，始终优于先前的自适应方法，并实现了更优的准确率-效率帕累托前沿（Pareto frontiers），达到SOTA水平。

Insight: 创新点在于提出统一的联合自适应推理框架，将视觉令牌选择和LLM计算调整协同训练，通过共享预算编码和可微分延迟估计器实现端到端优化，从而学习适应输入复杂性和运行时计算约束的跨阶段分配策略。

Abstract: Multimodal Large Language Models (MLLMs) have recently demonstrated strong performance across vision-language tasks. However, their high inference cost, arising from both the large number of input visual tokens and the heavy computation of the large language model (LLM), remains a key barrier to practical deployment. Recent work attempts to reduce the cost by adaptively optimizing individual dimensions, e.g., pruning redundant visual tokens or skipping LLM layers and heads. Nonetheless, prior approaches typically treat these dimensions independently and overlook a fundamental coupling: the available compute resources must be dynamically allocated across all dimensions based on the input content. To bridge the gap, we propose SmartVL, a unified adaptive inference framework that jointly controls vision token number and model compute capability in response to varying input contents and compute budgets. SmartVL introduces a vision-side token controller that dynamically selects informative visual tokens and an LLM-side compute controller that adaptively adjusts LLM computation. Importantly, these controllers are trained to coordinate with each other so that the overall inference cost satisfies a target budget. To allow this joint scheduling, we connect the controllers using a shared budget encoding and leverage a differentiable latency estimator for end-to-end training. This design enables SmartVL to learn cross-stage allocation strategies that adapt to both input complexity and runtime compute constraints. Experiments across multiple MLLM benchmarks demonstrate that, with joint scheduling, SmartVL consistently outperforms prior adaptive methods and achieves superior accuracy-efficiency Pareto frontiers. Project page: https://www.schaterji.io/publications/2026/jointtokencompute.

[61] Self Gradient Forcing: Native Long Video Extrapolation cs.CVPDF

Junhao Zhuang, Shiyi Zhang, Yuxuan Bian, Yaowei Li, Yawen Luo

TL;DR: 本文提出了一种名为自梯度强制（SGF）的两阶段训练策略，用于改进自回归视频扩散模型中的长视频外推能力。该方法通过恢复历史上下文梯度监督，使模型能够将早期生成的潜在变量编码为更有效的因果记忆，从而提升生成视频在主题一致性、背景布局和时间稳定性方面的表现。

Details

Motivation: 现有自回归视频扩散模型（如Self Forcing）在训练时使用自身生成的历史作为上下文，但历史键值缓存仅作为冻结的展开状态被未来帧使用，导致未来损失无法监督早期潜在变量如何被写入更有效的键值表示，这被称为历史上下文梯度缺口。

Result: 在多种初始化设置下的长时域逐帧和分块实验中，SGF在原生长视频外推任务上显著优于Self Forcing，特别是在主体身份、背景/布局一致性和时间稳定性方面。仅使用5秒训练窗口，SGF能够外推生成长达数分钟的视频。

Insight: 创新点在于设计了两阶段训练策略（无梯度自回归展开与并行上下文梯度重建），在不进行全序列反向传播的情况下，通过未来视频潜在损失来监督模型对上下文的编码，从而弥合了历史上下文梯度缺口，增强了自回归视频生成的因果记忆能力。

Abstract: Recent autoregressive video diffusion methods are increasingly built upon Self Forcing, where the student is trained on histories produced by its own rollout rather than ground-truth video contexts. This reduces exposure bias, but the historical key-value cache is still used by future frames only as frozen rollout state. As a result, future losses cannot supervise how earlier generated latents should be written into more useful keys and values for later video-latent generation. We call this the historical context-gradient gap. We propose Self Gradient Forcing (SGF), a two-pass training strategy that restores this missing supervision signal without backpropagating through the full serial rollout. Pass 1 performs a no-gradient autoregressive rollout matching inference and, at a sampled denoising exit step, records both the self-generated context and the noisy latents fed to the model. Pass 2 performs parallel context-gradient reconstruction for the recorded exit step. The generated context is used as stop-gradient clean-latent input, while the model recomputes the context KV representations and future-to-context causal attention. Thus, SGF provides the missing memory-writing supervision within the native autoregressive training objective, using losses on future video latents to train the model to encode context into more effective causal memory. Across extensive long-horizon frame-wise and chunk-wise experiments under different initializations, SGF achieves stronger native long-video extrapolation than Self Forcing, especially in subject identity, background/layout consistency, and temporal stability. Remarkably, using only a 5-second training window, SGF can extrapolate to videos lasting several minutes. Code and models will be released to advance research on autoregressive video generation.

cs.CR [Back]

[62] Twin Agent: Context Residual Compression for Privilege Separated Agents cs.CR | cs.CLPDF

Zhanhao Hu, Dennis Jacob, Xiao Huang, Zhaorun Chen, Bo Li

TL;DR: 论文提出Twin Agent，一种受残差编码启发的特权分离设计模式，通过探索代理和安全代理的对称结构，在压缩信息流的同时保持任务效用，以抵御LLM代理中的提示注入攻击。

Details

Motivation: 针对LLM代理面临的不受信任上下文（如提示注入攻击）安全风险，现有安全设计方法常导致效用下降且需大量任务特定工程，因此需要一种更通用的安全-效用权衡方案。

Result: 在SWE-bench Lite、AgentDojo和DecodingTrust-Agent基准测试中，Twin Agent在保持高任务效用的同时有效防御了提示注入攻击，性能优于未防御代理和现有特权分离基线方法。

Insight: 创新点在于将残差压缩思想应用于代理上下文，通过双代理结构实现信息流的最小化控制；客观来看，这种对称设计为LLM代理安全提供了可扩展的架构模式，降低了工程复杂度。

Abstract: Large language model (LLM) agents are vulnerable to security risks, such as prompt injection attacks from untrusted context that manipulate downstream reasoning and tool use. Existing secure-by-design approaches mitigate this risk by separating untrusted observations from privileged execution and careful control of information flow, but often degrade utility and require extensive task-specific engineering. We thus propose Twin Agent, a general privilege separation design pattern inspired by residual coding in the agent context. Twin Agent consists of two nearly symmetric agents: an Explore Agent that inspects untrusted information and a Safe Agent that executes privileged actions. The Explore Agent is conditioned on the Safe Agent’s current context and communicates only compact hints to the Safe Agent about the next action to take. This design reduces the information needed to preserve task utility and thus achieves a better security–utility tradeoff, which we empirically verify by measuring how utility and attack success change as the length of hints varies. We evaluate Twin Agent on long-horizon software engineering tasks with SWE-bench Lite and on heterogeneous multi-tool interaction tasks with AgentDojo and DecodingTrust-Agent. Across both benchmarks, Twin Agent preserves high task utility while preventing prompt injection attacks, outperforming both undefended agents and privilege separation baselines.

cs.AI [Back]

[63] HyGRL: Adaptive Hybrid Graph Reasoning for Multi-Entity Questions cs.AI | cs.CLPDF

Junyi Wang

TL;DR: 本文提出HyGRL框架，用于解决多实体组合问题对现有检索增强语言模型的挑战。该框架将非结构化文本嵌入结构化知识图谱，构建异质网络进行灵活证据检索，并通过模仿学习和强化学习两阶段过程自适应地诱导推理结构。

Details

Motivation: 现有方法存在标准RAG缺乏动态推理、传统Graph-RAG受限于结构稀疏性、以及LLM构建的Graph-RAG成本过高的问题，无法有效处理多实体组合问题。

Result: 实验表明，HyGRL在答案准确性和推理保真度上优于SOTA基线模型，同时保持了极低的token成本和接近实时的推理速度。

Insight: 创新点在于提出统一的混合图推理框架，将文本丰富性与结构知识有效融合，并通过两阶段学习（模仿学习提炼启发式专家信号，强化学习利用LLM驱动的偏好奖励优化策略）实现自适应结构归纳，兼顾了性能与效率。

Abstract: Multi-entity compositional questions pose significant challenges to existing retrieval-augmented language models. Conventional methods fall into a dilemma: standard RAG lacks dynamic reasoning, traditional Graph-RAG is limited by structural sparsity, and LLM-constructed Graph-RAG incurs prohibitive costs. We propose \textbf{\fwa}, a unified framework that embeds unstructured text into structured knowledge graphs, creating a heterogeneous network for flexible evidence retrieval. Reasoning is formulated as adaptive structure induction, learned via a robust two-stage process: (1) imitation learning distills heuristic expert signals, and (2) reinforcement learning refines the policy using LLM-driven preference rewards. Experiments demonstrate that {\fwa} effectively merges textual richness with structural knowledge, outperforming SOTA baselines in answer accuracy and reasoning fidelity while maintaining extremely low token costs and near real-time inference((code available at https://github.com/wjywjy123/HyGRL) .

[64] Knowledge-Centric Self-Improvement cs.AI | cs.CL | cs.LG | cs.MAPDF

Xuefei Julie Wang, Lauren Hyoseo Yoon, Chengrui Qu, Amanda Zichang Wang, Atharva Sehgal

TL;DR: 本文提出了一种以知识为中心的自改进范式，与传统的以智能体为中心的范式形成互补。在该范式中，智能体保持通用性和可丢弃性，而持久化的知识库成为改进的核心对象。通过任务级和跨任务论坛收集证据驱动的见解并进行知识蒸馏，该方法在抽象推理、编码和终端基准测试中提高了解决率并降低了成本，且蒸馏后的知识能够迁移到未见任务和不同LLM家族。

Details

Motivation: 传统以智能体为中心的自改进方法将改进绑定在特定智能体设计、任务分布或适应过程上，导致改进成本高昂且难以迁移。本文旨在探索一种互补的、以知识为中心的自改进范式，使改进体现在可持久化和可迁移的知识上，而非智能体本身。

Result: 在抽象推理、编码和终端基准测试上，该方法相对于以智能体为中心的基线提高了解决率并降低了美元成本。蒸馏后的知识能够迁移到未见任务和不同LLM家族，表明改进并非特定于某个LLM或运行过程。

Insight: 核心创新在于将自改进的焦点从智能体转移到可持久化的知识库，通过结构化的知识贡献和蒸馏协议实现改进。这种范式使得改进更具可检查性、可迁移性和可移植性，为构建自改进的智能体系统提供了新的视角。

Abstract: Self-improving AI systems typically treat the agent as the object that improves, by optimizing prompts, workflows, harnesses, or even the agent’s own code. This agent-centric view can make improvements expensive to maintain and difficult to transfer, because gains become tied to a particular agent design, task distribution, or adaptation run. We study a complementary paradigm: knowledge-centric self-improvement, in which agents remain generic and disposable while the persistent object is a curated knowledge base that agents can leverage for future tasks. We conduct controlled case studies to operationalize this idea via a simple protocol. Agents attempt one task, then contribute evidence-grounded insights to a shared knowledge base via task-level and cross-task forums, followed by knowledge distillation. Because self-improvement is contained in the knowledge rather than the agent, improvement can be more inspectable, transferable, and portable. Across abstract reasoning, coding, and terminal benchmarks, this protocol improves solve rates while reducing dollar cost relative to agent-centric baselines. The resulting distilled knowledge also transfers to held-out tasks and across LLM families, indicating that the improvement is not merely an LLM- or run-specific behavior. These results support a new view of self-improving agentic systems: progress can be driven primarily by the curated persistent knowledge. Code is available at https://github.com/recursive-knowledge/KSI.

[65] Rewarding Better Thinking for LLM Preference Alignment cs.AI | cs.CLPDF

Xubo Liu, Wenya Guo, Ruxue Yan, Xinying Qian, Ying Zhang

TL;DR: 该论文提出了一种名为思维清单奖励（TCR）的过程导向奖励机制，用于基于强化学习的LLM偏好对齐。TCR将偏好对转换为针对特定样本的思维清单，用以评估生成的推理轨迹是否解决了偏好所隐含的考量。为了减少与结果级监督的重叠，TCR进一步引入了指数移动平均（EMA）残差公式，以分离出超出结果奖励可预测范围的、互补的思维盈余。

Details

Motivation: 现有基于强化学习的偏好对齐方法主要使用结果层面的代理奖励，主要评估最终响应，而对推理轨迹的指导有限。这导致当多个响应获得相似的最终分数时，信用分配变得粗糙，轨迹层面的偏好未被充分指定。

Result: 在来自三个模型系列的五个模型上进行的实验表明，TCR在多种基准测试中持续提升了对齐性能。消融实验进一步验证了基于EMA的残差公式和针对特定样本的清单监督的重要性。

Insight: 主要创新点在于从结果层面的奖励转向过程导向的奖励，通过思维清单将人类偏好具体化为对推理过程的考量，并使用EMA残差公式来提取与结果奖励互补的、纯粹的“思维盈余”，从而更精细地指导模型优化。这为偏好对齐提供了更细粒度的监督信号。

Abstract: LLM preference alignment aims to optimize models toward human preferences across diverse user instructions. Reinforcement learning has become a major post-training approach for this goal, but existing proxy rewards are often outcome-level, mainly evaluating the final response while providing limited guidance for the reasoning trajectory. This can make credit assignment coarse when multiple responses receive similar final scores, leaving trajectory-level preferences under-specified. To address this limitation, we propose Thinking Checklist Reward (TCR), a process-oriented reward for RL-based preference alignment. TCR converts preference pairs into sample-specific thinking checklists and uses them to evaluate whether the generated reasoning trace addresses the preference-implied considerations. To reduce overlap with outcome-level supervision, TCR further introduces an exponential moving average (EMA) residual formulation to isolate a complementary thinking surplus beyond what is predictable from the outcome reward. Experiments on five models from three model families show that TCR consistently improves alignment performance across diverse benchmarks, with ablations further validating the importance of EMA-based residual formulation and sample-specific checklist supervision.

[66] PoTRE: Test-Time Reasoning inspired by Cognitive Heterogeneity cs.AI | cs.CLPDF

Anmol Kankariya, Sercan Ö. Arık

TL;DR: 本文提出了PoTRE（多拓扑推理集成）框架，这是一个受认知异质性启发的测试时推理方法。该框架将推理过程解耦为四个异构智能体（对抗精炼、分层策略规划、谱搜索和直接链式），并通过一个任务自适应聚合层动态整合它们的视角，以生成鲁棒的全局解决方案。

Details

Motivation: 动机在于解决大型语言模型在需要长程规划和迭代错误修正的复杂推理任务中的不足，以及标准单流提示在面对新颖抽象或严格领域约束时的脆弱性问题。

Result: 在三个前沿基准测试（ARC-AGI-2、Humanity’s Last Exam和PRBench Finance）上进行了评估。在HLE上达到了49.92%的准确率，超越了之前的最佳官方分数，实现了SOTA。

Insight: 主要创新点是提出了一个异构的、多智能体协作的推理框架，通过解耦和动态聚合不同推理策略来提升鲁棒性和效率。其架构异质性在消耗相似或更少推理令牌的情况下，相比大规模同质基线实现了更好的推理性能。

Abstract: While Large Language Models (LLMs) excel at many tasks, they frequently struggle with complex reasoning that requires long-horizon planning and iterative error correction. Furthermore, standard single-stream prompting proves brittle when models encounter novel abstractions or rigorous domain constraints. We introduce PoTRE (Poly-Topological Reasoning Ensembles), a heterogeneous framework that decouples inference into four agents: (1) Adversarial Refinement Agent, (2) Hierarchical strategic Planning Agent, (3) Spectrum Search Agent, and (4) Direct Chain Agent. A final Task-Adaptive Aggregation Layer dynamically reconciles these perspectives – via final candidate selection, semantic synthesis, or neuro-symbolic verification – to produce a robust global solution. We evaluate PoTRE on three frontier benchmarks: ARC-AGI-2, Humanity’s Last Exam (HLE), and PRBench Finance. PoTRE achieves state-of-the-art accuracy of 49.92% on HLE, surpassing the previous best official score. We demonstrate that this architectural heterogeneity achieves improved reasoning performance using similar or fewer inference tokens compared to heavily scaled homogeneous baselines.

[67] Train the Model, Not the Reader: Decodability Supervision for Verifiable Activation Explanations cs.AI | cs.CLPDF

Hiskias Dingeto

TL;DR: 本文指出自然语言自编码器通过重构隐藏激活的忠实性解释存在结构缺陷，即重构分数无法有效惩罚个别虚假声明。作者提出两种审计协议和RECAP方法，通过协同训练线性头使指定内容可解码，从而提升解释的可验证性。

Details

Motivation: 解决现有基于重构的解释方法无法检测个别虚假声明的问题，确保激活解释的忠实性和可验证性，以支持可解释性和AI安全。

Result: 在RECAP训练的沙盒模型中，虚假编码消失，指定内容可真实陈述（成本仅+0.001 nat）；在预训练Pythia-160M上，内容变得可靠可探测（真实声明比例0.44-0.46 vs 接近零的对照组）。对抗攻击下，RECAP探针能有效识别谎言（AUC 0.95），而对照组探针失效（AUC 0.51）。

Insight: 创新点在于提出RECAP方法，通过协同训练线性预测头保持指定内容可解码，从而避免模型生成虚假编码；审计协议（如grounded-vs-true cross和evaluator swap）为评估解释忠实性提供了新工具。

Abstract: Natural-language autoencoders score explanations of hidden activations by reconstruction: an explanation is deemed faithful if the activation can be regenerated from it. The test is structurally insensitive to individual false claims: if flipping a claim does not change the reconstruction, the claim is never penalized. We show the test is passed in two ways, neither faithful. On a released Qwen-2.5-7B verbalizer, explanations reconstruct well above chance while ~2% of specific claims are reconstruction-dependent, so the score tracks gist, not specific facts. Under exact synthetic ground truth, the standard recipe develops co-adapted private codes (false wording the reconstruction depends on) in 5/5 runs, and fixes that leave the target model unchanged do not help. We contribute two audit protocols, the grounded-vs-true cross and the evaluator swap, and RECAP (Readable Encodings via Co-trained Auxiliary Predictors): linear heads trained alongside the target model to keep designated content decodable. On RECAP-trained sandbox models, fresh verbalizers state the designated content truly and the codes vanish, at a +0.001-nat cost. This replicates on a pretrained Pythia-160M: the content becomes reliably probe-decodable, though a fresh verbalizer conveys it only in part (truth 0.44-0.46 vs a near-zero control). For interpretability, high reconstruction does not certify individual claims. For AI safety, RECAP makes designated internal content independently checkable against probes rather than asserted by prose a model can game: an independent probe scores the verbalizer’s true claims above its false ones (AUC 0.96, vs 0.82 without RECAP). Against an adversary that edits an explanation to maximize the reconstruction score while lying (suppressing ~87% of its lie penalty), the RECAP probe still flags the lies (AUC 0.95) while the control probe collapses to chance (0.51).

[68] Silent Failures in Multimodal Agentic Search:A Diagnostic Taxonomy and Cross-Judge Evaluation cs.AI | cs.CVPDF

Zhengxian Wu, Junjie Gao, Kai Yang

TL;DR: 本文研究了多模态智能搜索系统中的隐性故障问题，提出了一个包含六类故障的诊断分类法，并构建了一个轨迹级诊断流程来评估答案正确性和证据基础质量。实验表明，表面准确性会高估真实轨迹级正确性，且隐性故障具有能力依赖性。

Details

Motivation: 现有评估主要关注最终答案准确性，可能忽略搜索轨迹中的故障，因此需要研究多模态智能搜索系统中的隐性可靠性问题。

Result: 在MMSearch-Plus轨迹上对四个前沿多模态模型的实验表明，表面准确性持续高估真实轨迹级正确性；交叉评估验证、空白图像压力测试和工具消融实验进一步证实了隐性故障的能力依赖性和转移性。

Insight: 创新点在于提出了一个针对多模态智能搜索隐性故障的六类诊断分类法，并构建了统一的轨迹级评估框架，揭示了表面评估指标的局限性以及故障的系统性特征。

Abstract: Multimodal agentic search systems increasingly rely on external tools to answer knowledge-intensive visual questions. However, existing evaluations mainly focus on final-answer accuracy and may miss failures in the search trajectory. In this work, we study such hidden reliability issues as silent failures. We introduce a six-category taxonomy covering modality shortcuts, phantom grounding, wrong-evidence-right-answer cases, over-retrieval laundering, cross-modal contradiction, and provenance hallucination. Based on this taxonomy, we build a trajectory-level diagnostic pipeline that evaluates both answer correctness and evidence-grounding quality under a unified ReAct-style scaffold. Experiments on MMSearch-Plus trajectories across four frontier multimodal models show that surface accuracy consistently overestimates true trajectory-level correctness. We further use cross-judge validation, blank-image stress tests, and tool ablations to show that silent failures are capability-dependent and often shift rather than disappear. Home-page: https://github.com/DingWu1021/silent-failures-multimodal-agentic-search

stat.ME [Back]

[69] Deep Shape Regression for Planar Curves with Multimodal Covariates stat.ME | cs.CV | cs.LG | q-bio.QM | stat.MLPDF

Manuel Pfeuffer, Roshan Prakash Rane, Hadya Yassin, Kerstin Ritter, Sonja Greven

TL;DR: 本文提出了一种用于开放平面曲线的深度形状回归模型，能够处理多模态和高维协变量。通过将曲线表示为复值函数，证明了条件全Procrustes均值是条件协方差的主导特征函数，并设计了一种新颖的深度条件协方差平滑器，结合了模态特定编码器（如样条和卷积网络），实现了对输入曲线的平移、旋转和缩放不变性，并能处理稀疏和不规则采样的曲线。

Details

Motivation: 解决在神经影像等健康应用中，平面曲线形状分析需要处理多模态协变量（如标量和图像）以及高维数据的问题，同时传统样条平滑器无法有效处理图像等复杂协变量。

Result: 在模拟轮廓数据和ADNI队列的海马体轮廓数据上进行了实验，恢复了与文献一致的协变量效应，验证了方法的有效性。

Insight: 创新点包括将曲线表示为复值函数并利用条件协方差的主导特征函数估计形状均值，以及设计深度条件协方差平滑器结合不同模态的编码器，实现了对多模态协变量的灵活处理和对曲线几何不变性的保证。

Abstract: The shape of a planar curve is the geometric information that remains once translation, rotation, scale and reparametrisation are removed and is of interest in many health applications, e.g. in neuroimaging. We propose a deep shape regression model for open planar curves that admits multimodal and high-dimensional covariates. Representing curves as complex-valued functions, we show that the conditional full Procrustes mean is the leading eigenfunction of the conditional covariance. To estimate this covariance surface, we propose a novel deep conditional covariance smoother with modality-specific encoders - e.g. splines for scalar covariates and convolutional networks for images, which classical spline smoothers cannot accommodate. Our model is by construction invariant to the translation, rotation and scaling of the input curves and handles sparsely and irregularly sampled curves. We further provide an algorithm for elastic mean estimation that also removes parametrisation by iterating covariance smoothing, rotational alignment and parametrisation alignment. We illustrate the method on simulated outlines with known conditional mean and multimodal covariates, and give a first application to hippocampal outlines from the ADNI cohort, recovering covariate effects consistent with the literature. Code is available at https://github.com/mpff/dnn-shapes.

cs.RO [Back]

Junzhe Wu, Yue Hu, Zeyu Han, Po-Hsun Chang, Yinan Dong

TL;DR: NavVerse是一个用于室内到室外连续机器人仿真中具身导航的物理基准测试平台，包含100个室内场景、50个城市室外场景和50个室内到室外混合场景，以及10,000个涵盖物体导航、视觉语言导航和地点导航任务的测试片段。该基准通过可执行的机器人接口评估智能体的任务成功率、路径效率和安全性。

Details

Motivation: 现有基准通常单独评估室内和室外导航，且许多抽象掉了机器人执行过程，导致出口寻找、边界穿越、环境适应和运动动力学失败等问题未被充分探索。NavVerse旨在解决这一空白，为跨上下文连续导航提供综合评估。

Result: 零样本实验显示，当前智能体在跨上下文导航上仍远未解决：端到端的视觉语言智能体（VLA）获得最高的零样本成功率，而模块化方法在安全性方面表现最佳。地点导航任务进一步揭示了从室外到室内-室外场景的性能明显下降，表明环境适应仍是主要瓶颈。

Insight: 创新点在于提出了首个专注于室内到室外连续具身导航的物理基准测试，通过整合多种导航任务和可执行的机器人接口，全面评估了智能体在复杂跨环境中的性能。客观分析认为，该基准突出了环境适应作为关键挑战，为未来导航研究提供了重要的评估框架。

Abstract: Robots deployed in delivery, campus, and emergency-response settings often need to navigate from buildings to streets within a single continuous episode. Existing benchmarks usually evaluate indoor and outdoor navigation separately, and many abstract away robot execution, leaving exit finding, boundary traversal, adaptation, and kinodynamic failures underexplored. We introduce NavVerse, a physics-enabled benchmark for indoor-to-outdoor embodied navigation. NavVerse contains 100 indoor scenes, 50 urban outdoor scenes, and 50 indoor-to-outdoor scenes, and 10,000 episodes spanning Object Navigation, Vision-and-Language Navigation, and Place Navigation tasks, where agents search for semantic points of interest such as restaurants or banks. Agents are evaluated through executable robot interfaces using task-success, path-efficiency, and safety metrics. Zero-shot experiments with RL, VLA, and modular baselines show that current agents remain far from solving cross-context navigation: end-to-end VLAs obtain the highest zero-shot success, while the modular method provides the strongest safety profile. PlaceNav further reveals a clear drop from outdoor to indoor-to-outdoor scenes, indicating that adaptation remains major bottleneck.

[71] KineBench: Benchmarking Embodied World Models via IDM-Free Kinematic Grounding cs.RO | cs.CVPDF

Zeyu Liu, Zhangzhe Zhu, Yang Zhang, Chenyou Fan, Chenjia Bai

TL;DR: 论文提出了KineBench，一个无需逆动力学模型（IDM）的闭环基准测试框架，用于评估具身世界模型（EWM）的物理一致性。该框架通过级联视觉基础模型直接从生成视频中提取6D末端执行器姿态，并在物理模拟器中执行以进行闭环验证，同时引入轨迹平滑度和运动学可行性指标。在ManiSkill3的20个多样化操作任务上，KineBench评估了EWM在四个渐进套件中的表现，揭示了任务复杂性对视频生成的非线性缩放影响。

Details

Motivation: 现有评估具身世界模型物理一致性的闭环框架严重依赖逆动力学模型（IDM）进行动作提取，但IDM在遇到训练分布外的新物体和场景时可能不稳定，导致动作提取不可靠，从而难以区分世界模型不准确性和提取器错误。

Result: 在ManiSkill3的20个多样化操作任务上，KineBench评估了前沿模型在四个渐进套件（基本执行、任务迁移、视觉分布外泛化、复杂性条件缩放）中的表现，结果显示具身视频生成存在任务复杂性限制的非线性缩放现象。

Insight: 创新点在于提出了一种IDM-free的闭环基准测试方法，通过显式运动学基础管道直接提取6D姿态，避免了IDM引入的误差模糊性；同时引入了从机器人中心视角评估轨迹平滑度（SPARC）和运动学可行性（Maruyama Manipulability Index）的经典3D运动学指标，为未来数据缩放策略提供了实证指导。

Abstract: Evaluating the physical consistency of embodied world models(EWMs) is a critical open challenge. While closed-loop evaluation via simulator rollouts offers a more faithful assessment of physical plausibility than open-loop alternatives, existing frameworks almost exclusively rely on Inverse Dynamics Models(IDMs) for action extraction. Due to the intricate mapping from 2D pixel space to 3D kinematic space, the learned IDMs can be brittle to data outside their training distribution, resulting in unreliable action extraction from the generated videos with novel objects and scenarios. This creates an unavoidable attribution ambiguity between world model inaccuracies and extractor errors. To reduce this ambiguity, we present KineBench, an IDM-free closed-loop benchmark for EWMs, built upon an explicit kinematic grounding pipeline. Given a generated video, KineBench employs cascaded visual foundation models to directly extract 6D end-effector poses from individual frames, which are then executed in a physics simulator for closed-loop validation. Beyond execution-based task success, KineBench incorporates two classical 3D kinematic metrics–Spectral Arc Length (SPARC) and the Maruyama Manipulability Index–to characterize trajectory smoothness and kinematic feasibility from a robot-centric perspective. Built on 20 diverse manipulation tasks in ManiSkill3, KineBench evaluates EWMs across four progressive suites: basic execution, task transfer, visual out-of-distribution generalization, and complexity-conditioned scaling. Evaluation across frontier models reveals task-complexity-bounded nonlinear scaling in embodied video generation, providing empirical guidance for future data-scaling strategies.

Jialu Zhang, Yong Du, Xianda Guo, Shunwang Sun, Xinqi Liu

TL;DR: 本文提出了一种基于模仿学习的具身感知导航框架EA-Nav，旨在解决跨具身导航中因机器人形态差异导致的视觉观测与动作映射模糊问题。该框架采用模块化多阶段设计，在预训练阶段利用网络视频构建跨具身数据集并引入具身几何作为条件令牌以减少歧义，在微调阶段通过解耦架构注入多模态信息，并设计了轨迹增强策略来生成高风险样本以分别训练空间感知和风险感知校正，从而将具身几何显式地融入安全导航策略中。

Details

Motivation: 解决跨具身导航中，因机器人形态（如尺寸、运动能力）不同，导致相同的视觉观测可能对应不同安全动作的模糊性问题；同时，现有基于强化学习的方法需要大量交互和精心设计的奖励，难以支持可扩展的预训练和现实世界适应，而基于模仿学习的方法则发展有限。

Result: 实验结果表明，所提出的方法在不同具身设置下有效提升了导航性能，验证了将具身几何信息融入具身导航的有效性。

Insight: 创新点在于：1）提出了一种基于模仿学习的模块化多阶段框架，将具身几何作为条件令牌显式建模，以解耦观测歧义；2）设计了轨迹增强策略生成高风险样本，并采用解耦架构分别训练空间感知和风险感知校正模块，从而将安全约束和具身几何知识更有效地整合到导航策略中。这为构建可泛化、安全的视觉导航策略提供了一种数据驱动且可扩展的新思路。

Abstract: Cross-embodiment navigation is a key challenge in embodied intelligence. Due to differences in embodiment, the same visual observation may imply different actions for different agents, making prediction ambiguous when relying solely on vision. Existing studies mainly rely on reinforcement learning, which requires large-scale interaction and careful reward design, making it difficult to support scalable pretraining and real-world adaptation. In contrast, imitation-learning-based approaches remain limited. To address these challenges, we propose an imitation-learning-based embodiment-aware navigation framework with a modular multi-stage design. In pretraining, we construct a cross-embodiment navigation dataset from Internet videos and introduce embodiment geometry as conditional tokens to reduce action ambiguity under the same observation. In fine-tuning, we design a multimodal information injection mechanism based on a decoupled architecture. Specifically, we design a trajectory augmentation strategy to generate high-risk samples, which are used to train spatial perception and risk-aware correction separately, thereby explicitly incorporating embodiment geometry for safe navigation. Experimental results show that the proposed method effectively improves navigation performance across different embodiment settings, demonstrating the effectiveness of incorporating embodiment geometry into embodied navigation.

cs.LG [Back]

[73] Auto-Fill: Learning to Predict Missing Values Accurately with Specialist Language Models cs.LG | cs.AI | cs.CL | cs.DBPDF

Yurong Liu, Yeye He, Haoyu Dong, Junjie Xing, Shi Han

TL;DR: 本文提出Auto-Fill方法，通过训练三个分别专注于世界知识、文本推理和代码推理的专业化小语言模型，并采用校准集成机制动态选择最自信的专家或弃权，以低成本实现表格数据中缺失值的高精度预测。

Details

Motivation: 解决现有推理模型在预测表格缺失值时部署成本高、容易产生过度自信和幻觉预测的问题，旨在实现高精度且可扩展的缺失值预测。

Result: 在11个基准测试（包含2200个来自不同领域的真实表格）上，Auto-Fill相比最先进的推理模型（如o3-pro、Gemini 3 Pro和DeepSeek R1）取得了更优的准确率，同时成本仅为这些前沿模型的不到1%。

Insight: 创新点在于将缺失值预测任务分解为三个核心能力（世界知识、文本推理、代码推理）并分别优化，结合校准集成机制实现高精度与低成本；可借鉴之处包括任务分解的专业化设计、小模型协同策略以及通过置信度校准减少错误预测。

Abstract: Predicting missing cell values in tabular data is a fundamental problem in data cleaning. While state-of-the-art reasoning models show great promise in predicting missing values in tables, by reasoning holistically across rows and columns, they are costly to deploy at scale and tend to be overconfident, often generating hallucinated or false-positive predictions. In this paper, we observe that achieving high-precision missing-value prediction in tables requires a distinct combination of three capabilities: (1) world knowledge, (2) text-based reasoning, and (3) code-based reasoning. We systematically explore design choices for combining these capabilities, and propose an Auto-Fill approach that post-trains three specialist small language models (SLMs), each optimized for one capability. We develop a calibrated ensemble mechanism that either dynamically selects the most confident specialist or abstains, ensuring high accuracy. Extensive experiments on 11 benchmarks with 2200 real tables drawn from diverse domains show that Auto-Fill achieves superior accuracy compared to state-of-the-art reasoning models (e.g., o3-pro, Gemini 3 Pro, and DeepSeek R1), while operating at a fraction (less than 1%) of the cost of these frontier models. Our results highlight the effectiveness of specialization and calibrated abstention in the important domain of tabular data. Auto-Fill is publicly available at https://github.com/lyrain2001/auto-fill.

[74] Native Multi-Dimensional Subquadratic Operators via Input Dependent Long Convolutions cs.LG | cs.CV | stat.MLPDF

David R. Wessels, Farhad Ramezanghorbani, David W. Romero, Alireza Moradzadeh, Olivia Viessmann

TL;DR: 本文提出了HyenaND，一种直接作用于多维数据原生几何结构的次二次、全局、输入依赖的算子，通过隐式参数化的全局输入依赖多维卷积核实现。其CUDA实现nSubQ融合了FFT卷积路径，将理论复杂度转化为实际加速。在长上下文基因组学、计算机视觉、医学成像和PDE建模中，纯HyenaND堆栈匹配了强注意力基线的精度，而混合配置则超越了纯注意力和基于循环的混合模型。

Details

Motivation: 解决注意力机制的二次计算复杂度问题，同时避免现有次二次替代方案（如标准卷积缺乏全局感受野和输入依赖性，循环模型破坏多维数据空间结构）在多维数据应用中的妥协。

Result: 在多个领域（长上下文基因组学、计算机视觉、医学成像、PDE建模）中，纯HyenaND堆栈达到与强注意力基线相当的精度；混合HyenaND与注意力的配置超越了纯注意力和强基于循环的混合模型。

Insight: 创新点在于通过隐式参数化的全局输入依赖多维卷积核，直接处理多维数据的原生几何结构，避免了数据扁平化；其高效CUDA实现将理论O(L log L)复杂度转化为实际加速，为多维数据建模提供了新的高效算子。

Abstract: Subquadratic alternatives to attention require compromises when applied to multi-dimensional data: standard convolutions lack global receptive fields and input dependency, while recurrent models require rasterizing data such as images, volumes, and partial differential equation (PDE) into an ad-hoc $1\rm D$ scan order that violates their spatial structure. We introduce \textit{HyenaND}, a subquadratic, global, input-dependent operator that acts directly on the native geometry of multidimensional data through convolutions with implicitly parametrized global, input-dependent multi-dimensional convolutional kernels. Our CUDA implementation, \texttt{nSubQ}, fuses the FFT-convolution path to turn HyenaND’s $\mathcal{O}(L \log L)$ scaling into wall-clock speedups. Across long-context genomics, computer vision, medical imaging, and PDE modeling, pure HyenaND stacks match the accuracy of strong attention baselines, while hybrid configurations that interleave HyenaND and attention layers outperform both pure attention and strong recurrence-based hybrids.

[75] Leveraging Offline Supervision for Efficient and Generalizable Reinforcement Learning in Large-Scale Vision-Language-Action Models cs.LG | cs.AI | cs.CVPDF

Dmitriy Poyarkov, Aleksei Staroverov, Aleksandr I. Panov

TL;DR: 本文研究在视觉-语言-动作模型中，结合离线监督与在线强化学习的混合训练方法，以提升训练效率和泛化性能。实验表明，该方法在保持强分布外泛化能力的同时，显著减少了训练所需的计算资源。

Details

Motivation: 在线强化学习通常比离线方法产生性能更好的策略，尤其是在分布外泛化方面，但训练成本较高。本文旨在探索混合离线-在线训练能否结合两者的优势，即利用离线监督提升训练效率，同时保持在线强化学习的泛化能力。

Result: 在分布外基准测试中，混合方法在达到与标准强化学习相近性能的同时，训练预算减少约一半，且未牺牲分布外泛化能力。

Insight: 创新点在于将离线监督（通过离线数据或离线训练参考策略）作为正则化引入在线强化学习，实现了训练效率与泛化性能的协同提升，而非权衡取舍。

Abstract: It is commonly observed that online reinforcement learning (RL) produces better-performing strategies than offline methods across a broad range of performance measures. In particular, RL-trained policies exhibit stronger out-of-distribution (OOD) behavior, where models trained only with imitation learning approaches often struggle. A recent study introduced an OOD-focused benchmark and reported that RL-trained vision-language-action (VLA) policies achieve noticeably better OOD performance and slightly better in-distribution (IND) performance than their counterparts trained with supervised fine-tuning (SFT). In this work, we investigate whether hybrid offline-online training can combine the advantages of both approaches. Specifically, we study RL methods regularized by offline supervision via either offline data or an offline-trained reference policy. We evaluate these approaches on the OOD benchmark and compare them with both offline-only training and standard RL. Our results show that although offline training achieves limited OOD performance by itself, incorporating offline supervision into RL preserves strong OOD capability while substantially improving training efficiency. In particular, the guided methods reach performance close to that of standard RL while requiring roughly half of the training budget. Rather than producing a trade-off between speed and OOD performance, the hybrid approach retains strong OOD capability while achieving this efficiency gain. Project page: https://alstar8.github.io/offline-supervision-vla-rl

[76] Geospatial Diffusion-based Evolution Synthesis (GeoDES) for Storm-Centered Weather Augmentation cs.LG | cs.CVPDF

Sonia Cromp, Satya Sai Srinath Namburi GNVV, Youran Wang, Grace Kisslinger, Frederic Sala

TL;DR: 本文提出了Geospatial Diffusion-based Evolution Synthesis (GeoDES)模型，这是一种定制的图像到视频扩散模型，用于合成以风暴为中心的高保真、物理一致的天气事件，旨在增强气象数据集并压力测试预报模型。

Details

Motivation: 现有基于机器学习的天气模型难以预测大规模天气系统（如气旋风暴）的详细结构，区域模型受限于固定地理边界内的有限历史记录，而全球模型计算成本高且分辨率不足以捕捉细粒度风暴动态。

Result: 在北大西洋测试集上，GeoDES在关键指标上优于先前方法，峰值涡度误差降低了52%，异常相关系数提高了8%。

Insight: 创新点在于将扩散模型专门应用于风暴结构的演化合成，通过聚焦于风暴本身的演变，生成物理一致的高分辨率天气序列，为气象数据增强和模型测试提供了新工具。

Abstract: While machine learning-based weather models hold significant promise, they struggle to predict the detailed structure of large-scale weather systems such as cyclonic storms. Regional models are constrained by limited historical records within fixed geographic boundaries, while global models are computationally expensive and often operate at resolutions too coarse to capture fine-grained storm dynamics. To bridge this gap, we introduce the Geospatial Diffusion-based Evolution Synthesis (GeoDES) model, a custom image-to-video diffusion model. By focusing generation strictly on the evolving storm structure, GeoDES synthesizes physically consistent, high-fidelity weather events suitable for stress-testing forecast models and expanding meteorological datasets. Evaluations demonstrate that GeoDES outperforms prior methods on key metrics, achieving $52%$ lower Peak Vorticity Error and $8%$ higher Anomaly Correlation Coefficient than the next strongest methods on the North Atlantic test set.

eess.IV [Back]

[77] Group-of-Latents: Perceptual Video Compression at Extreme Bitrates via Masked Latent Generative Modeling eess.IV | cs.CV | cs.MMPDF

Shaokang Wang, Jinchang Xu, Peidong Jia, Zhijian Hao, Siyuan Qian

TL;DR: 本文提出了一种名为Group-of-Latents (GoL)的生成式视频压缩框架，旨在在极低码率下实现高感知质量。该方法利用预训练的扩散变换器（DiT）先验，通过将潜在流划分为I-潜在和P-潜在，并分别使用深度压缩模块（I-DCM）和统一的潜在去噪模块（U-LDM）进行编码与重建，从而在几乎不增加码率的情况下合成时间动态。

Details

Motivation: 现有视频压缩算法在极低码率下，受限于编码资源，其感知质量优化问题尚未得到充分解决。本文旨在探索这一前沿，解决在严重受限的比特率下保持高感知质量的挑战。

Result: 大量实验表明，该方法在极低码率（例如<0.005 bpp）下运行，实现了最先进的感知保真度，具有丰富的空间细节和鲁棒的时间一致性。

Insight: 创新点在于提出了GoL策略，将潜在流显式划分为I/P潜在，并利用DiT先验以零额外比特率成本合成P潜在，从而统一了纹理细化和时间动态重建。从客观角度看，这是一种将生成式模型（DiT）与结构化潜在表示相结合，以突破传统率失真权衡极限的新颖方法。

Abstract: Most existing video compression algorithms follow a paradigm of transformation and quantization, optimizing the trade-off between distortion and bitrate. However, extremely low-bitrate compression remains an underexplored frontier where perceptual quality optimization under severely constrained coding resources has not been adequately addressed. In this paper, we propose a unified generative framework that leverages pre-trained Diffusion Transformer (DiT) priors to achieve high perceptual quality at extremely low bitrates. We first introduce a flexible Group-of-Latents (GoL) strategy within the latent space of a causal tokenizer, explicitly partitioning the latent stream into intra $I$-latents and inter $P$-latents. The Deep Compression Module (I-DCM) then encodes key $I$-latents to preserve perceptual anchors with minimal overhead. Building upon these anchors, the DiT-based Unified Latent Denoising Module (U-LDM) refines intra-frame textures and synthesizes $P$-latents from noise, reconstructing temporal dynamics at zero additional bitrate cost. Extensive experiments demonstrate that our method uniquely operates in the extreme-low-bitrate regime (e.g., (<0.005) bpp), achieving state-of-the-art perceptual fidelity with rich spatial details and robust temporal consistency. The code will be made publicly available.

[78] BLUE: Semantics-Preserving Video Compression for Efficient Vision-Language Surveillance Analytics eess.IV | cs.CVPDF

Shubham Baid, Akash James, Sahil Chachra, Nishant Sinha, Kunal Kislay

TL;DR: BLUE是一种面向固定摄像头监控视频的压缩方法，它通过抑制静态背景冗余并保留前景活动来减少存储和传输负担，同时保持基于视觉语言模型（VLM）的语义分析性能。实验表明，BLUE压缩后的视频在VLM事件和异常理解任务中未导致语义质量下降，并能显著减少VLM推理调用次数。

Details

Motivation: 连续监控视频给企业视频分析系统带来日益增长的存储、传输和推理负担；现有编解码器（如H.265）的激进压缩可能损害下游计算机视觉性能，且不一定减少语义理解所需的VLM推理调用。

Result: 在VIRAT和CHAD两个监控数据集上，BLUE压缩的H.265视频与原始H.265视频相比，VLM评分均值基本不变（VIRAT差异约-0.01，CHAD分别为4.31和4.26），且压缩节省与VLM评分变化无关（r=0.004）；BLUE还将CHAD数据集中跳过密集型P帧比例从1.4%提升至53.2%，预计可减少53%的VLM调用。

Insight: BLUE创新性地将压缩目标从人类可观看转向机器中心，通过保留语义关键的前景活动来实现存储和推理双重优化；其基于包大小的帧跳过机制为降低VLM计算成本提供了实用途径，且验证了语义保持压缩在监控分析中的可行性。

Abstract: Continuous surveillance video creates a growing storage, transmission, and inference burden for enterprise video analytics systems. While modern codecs such as H.265 reduce bitrate for human-viewable video, aggressive compression can degrade downstream computer-vision performance and does not necessarily reduce the number of vision-language model (VLM) inference calls required for semantic video understanding. This paper evaluates BLUE, a fixed-camera surveillance compression approach that suppresses static-background redundancy while preserving foreground activity, for its effect on VLM-based event and anomaly understanding. We compare raw H.265 and BLUE-compressed H.265 video on two surveillance datasets: VIRAT, comprising 227 paired event samples from 106 clips, and CHAD, comprising 54 human-activity anomaly clips. For each pair, the same frame index is evaluated using a VLM captioning pipeline, and outputs are scored against annotation-derived ground truth using a blind judging protocol. The results show no measurable degradation in semantic inference quality. On VIRAT, the mean VLM score remains effectively unchanged between raw H.265 and BLUE, with a mean difference of approximately -0.01 on a 0-10 scale. On CHAD, raw H.265 and BLUE obtain near-equivalent mean scores of 4.31 and 4.26, respectively. Compression saving is also uncorrelated with VLM score change on VIRAT (r = 0.004), indicating that higher BLUE compression does not predict semantic quality loss. Beyond storage reduction, BLUE increases the share of skip-heavy P-frames on CHAD from 1.4% to 53.2%, enabling an estimated 53% reduction in VLM calls through packet-size-based frame skipping. These findings suggest that BLUE functions as a machine-centric compression layer for surveillance video, reducing bandwidth and inference cost while preserving VLM semantic performance.

Table of Contents

cs.CL [Back]

[1] When Reasoning Narrows the Move: Diversity Collapse in LLM Game Play cs.CLPDF

[2] Scaling Laws for Hypernetwork-Based Knowledge Injection in Large Language Models cs.CL | cs.LGPDF

[3] Adaptive Capitulation: A Structural Failure Mode of LLM Responses in Vulnerability Contexts cs.CL | cs.AI | cs.MAPDF

[4] Reference-Free Evaluation of Reasoning in Open-Ended Question Answering cs.CL | cs.AI | cs.LGPDF

[5] SLPO: Scaling Latent Reasoning via a Surrogate Policy cs.CL | cs.AI | cs.LGPDF

[6] VizRAG: Enhancing Retrieval-Augmented Generation with Hypergraph Visualization cs.CLPDF

[7] Sentence Splitter: Uncovering Latent Factual Structure for Self-Supervised Learning cs.CL | cs.AIPDF

[8] Efficient Chain-of-Modality Reasoning via Progressive Compression for Spoken Language Models cs.CL | cs.SDPDF

[9] Overview of FinMMEval 2026 Task 1: Multilingual Financial Multiple-Choice Question Answering cs.CL | cs.AI | cs.CEPDF

[10] A Multi-Dimensional Evaluation of Explainability in Media Bias Detection cs.CLPDF

[11] Reinforcement Learning for Large Language Model Selective Evidence Adoption from Contaminated Retrieval Results cs.CL | cs.AIPDF

[12] Language-Specific versus Cross-Lingual Knowledge Graphs for Implicit Aspect Identification in Arabic: A Comparative Study of Reasoning and Adaptation Strategies cs.CL | cs.AIPDF

[13] OpenSkillRisk: Benchmarking Agent Safety When Using Real-World Risky Third-Party Skills cs.CLPDF

[14] Back to Back with a Copy: A Computational Analysis of AI-Generated Visual Contemporary Art Pastiches cs.CLPDF

[15] SLAI T-Rex: Full-Parameter Post-training of the DeepSeek-V4 Family on Ascend SuperPOD cs.CL | cs.AIPDF

[16] PyroDash: Cost-Efficient Token-Level Small-Large Language Model Collaborative Inference cs.CLPDF

[17] Notes to Self: Can LLMs Benefit from Experiential Abstractions? cs.CLPDF

cs.CV [Back]

[18] Crowd4D: Scene-Aware Monocular 4D Crowd Reconstruction cs.CVPDF

[19] Detect Early, Escalate Rarely: Anytime Detection of AI-Generated Video from the Compressed Bitstream cs.CVPDF

[20] D3VL: Understanding Driving Scenes from 3D Time Series Data and Video with Language Models cs.CV | cs.AIPDF

[21] ChronoStitch: Training-Free Composition of Visual KV Memories for Long-Horizon Temporal Reasoning cs.CV | eess.IVPDF

[22] Pathologist Attention-Aligned Report Generation for Prostate Histopathology cs.CVPDF

[23] A Unified Variational Framework for Deep Weakly Supervised Image Segmentation cs.CVPDF

[24] SafeGen: Goal-Conditioned Video Diffusion of Safety-Critical Scenarios for VLM-Based Autonomous Driving cs.CVPDF

[25] A Unified Tokenization Framework for Pain Recognition using Heterogeneous 3D Modalities cs.CVPDF

[26] ReFace: Reorganizing Facial Spatiotemporal Representations for Improved Pain Assessment cs.CVPDF

[27] Efficient Tracking and Understanding Object Transformations cs.CVPDF

[28] Extending a Large View Synthesis Model for Multi-view Panoptic Segmentation cs.CVPDF

[29] DRGBT-1K: A Large-scale High-quality Benchmark for Dynamic RGBT Tracking cs.CVPDF

[30] MoAKE: Toward Unified All-in-One Action Quality Assessment via Mixture of Action Knowledge Experts cs.CVPDF

[31] Trace: A Taxonomy-Guided Environment for Multidomain Visual Reasoning cs.CVPDF

[32] Memory-Augmented Multimodal Large Language Models for Small Object Understanding in Streaming Aerial Videos cs.CV | cs.AIPDF

[33] MTVDiff: Multimodal Conditional Latent Diffusion for Enhanced Thermal-to-Visible Face Translation cs.CVPDF

[34] LAVIFT: Latent-Action-Guided Vision Fine-Tuning for Surgical Interaction Recognition cs.CVPDF

[35] OSVE: One Step Video Editing with One Step Diffusion Models cs.CV | cs.AIPDF

[36] LoRFT: Benchmarking Long-Range Vehicle Trajectory Reconstruction from Fixed Highway Cameras cs.CVPDF

[37] MV-Bench: Benchmarking Multimodal Large Language Models for Coordinated Multi-View Interface Construction cs.CV | cs.HCPDF

[38] G-MAD: A Game-Based Data Generation Framework for Multi-View RGB-T Aerial Object Detection cs.CV | cs.AIPDF

[39] ETPDesigner: Multi-Agent Orchestration for Interactive Multimodal Electronic Theater Program cs.CVPDF

[40] OffNadirLoc: Benchmark and Framework for Challenging UAV-to-Satellite Geo-Localization under Large Off-Nadir Views cs.CVPDF

[41] Forecasting the Number of Harvest-ready Fruits of Sweet Peppers Using Multimodal Time-Series Data cs.CVPDF

[42] GaussianSeed: Hierarchical Gaussian Seeding for High-Resolution 3D Occupancy Prediction cs.CVPDF

[43] STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matching cs.CVPDF

[44] Factor-Informed Uncertainty Distillation for Gaze Estimation cs.CV | cs.HCPDF

[45] ENTRAP-VL: A Taxonomic Probe for Dual Contextual Entrainment in Vision-Language Models cs.CV | cs.AI | cs.CLPDF

[46] Development of an automated, reliable, and clinically meaningful artificial intelligence (AI) tool for diagnosing cardiac disease from conventional cardiovascular magnetic resonance (CMR) images cs.CVPDF

[47] HeadCast: Casting Attention Heads for Efficient Autoregressive Video Generation cs.CV | cs.LGPDF

[48] Real-Time EEG Cap Electrode Detection for Guided Point-of-Care Placement cs.CV | eess.IVPDF

[49] SHFormer: Dynamic Spectral Filtering Convolutional Neural Network and High-pass Kernel Generation Transformer for Adaptive MRI Reconstruction cs.CVPDF

[50] StreamHOI: Interaction-aware Temporal Memory Adaptation for Streaming HOI Video Generation cs.CV | cs.AIPDF

[51] PerceptDrive: Perception Prior World-Action Modeling with Adaptive Expert Routing for End-to-End Autonomous Driving cs.CVPDF

[52] Vera: Identity-Faithful Human Subject-to-Video Generation cs.CVPDF

[53] RS-RIE-Bench: Benchmarking Reasoning-Guided Remote Sensing Image Editing cs.CVPDF

[54] How Does Urban Context Relate to Residential Building Health? A Vision-POI Fusion Framework for Building-Level Housing Inspection cs.CVPDF

[55] Self-supervision drives representational convergence in medical foundation models more than clinical supervision cs.CV | cs.AI | cs.CL | cs.LGPDF

[56] Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose? cs.CVPDF

[57] Test-Time Training for Modality Order Consistency in Vision-Language Models cs.CV | cs.CLPDF

[58] Diverse-Intent Multi-Turn Fashion Image Retrieval cs.CVPDF

[59] PercepCap: Video Captioner with Structured Spatio-Temporal Perception cs.CVPDF

[60] Look Less, Think Faster: Joint Token-Compute Adaptation for Multimodal LLMs cs.CVPDF

[61] Self Gradient Forcing: Native Long Video Extrapolation cs.CVPDF

cs.CR [Back]

[62] Twin Agent: Context Residual Compression for Privilege Separated Agents cs.CR | cs.CLPDF

cs.AI [Back]

[63] HyGRL: Adaptive Hybrid Graph Reasoning for Multi-Entity Questions cs.AI | cs.CLPDF

[64] Knowledge-Centric Self-Improvement cs.AI | cs.CL | cs.LG | cs.MAPDF

[65] Rewarding Better Thinking for LLM Preference Alignment cs.AI | cs.CLPDF

[66] PoTRE: Test-Time Reasoning inspired by Cognitive Heterogeneity cs.AI | cs.CLPDF

[67] Train the Model, Not the Reader: Decodability Supervision for Verifiable Activation Explanations cs.AI | cs.CLPDF

[68] Silent Failures in Multimodal Agentic Search:A Diagnostic Taxonomy and Cross-Judge Evaluation cs.AI | cs.CVPDF

stat.ME [Back]

[69] Deep Shape Regression for Planar Curves with Multimodal Covariates stat.ME | cs.CV | cs.LG | q-bio.QM | stat.MLPDF

cs.RO [Back]

[70] NavVerse: Benchmarking Indoor-to-Outdoor Embodied Navigation in Continuous Robot Simulation cs.RO | cs.CVPDF

[71] KineBench: Benchmarking Embodied World Models via IDM-Free Kinematic Grounding cs.RO | cs.CVPDF

[72] EA-Nav: Learning Safe Visual Navigation Policies with Embodiment Awareness cs.RO | cs.CVPDF

cs.LG [Back]