cs.CL [Total: 14]
cs.CV [Total: 59]
cs.AI [Total: 6]
q-bio.NC [Total: 1]
eess.AS [Total: 1]
cs.RO [Total: 3]
cs.NE [Total: 1]
cs.LG [Total: 3]

cs.CL [Back]

Xingyu Xiao, Mao Du, Jiejuan Tong, Jingang Liang, Haitao Wang

TL;DR: 本文提出G-SHARE框架，一种基于指南的结构化推理方法，用于核电站人因事件诊断。该框架将正式的九步诊断指南转化为多阶段诊断流程，包含证据提取、逐步推理和事后一致性修复，旨在解决现有数据驱动或单次提示大语言模型方法缺乏结构化推理、与指南对齐不足及逻辑不一致的问题。

Details

Motivation: 现有的人因事件诊断方法（如数据驱动或单次提示LLM）通常缺乏结构化推理，与正式诊断指南对齐有限，且可能产生逻辑不一致的结论，影响了诊断质量。

Result: 在基于中国核工业真实人因事件报告构建的数据集上，G-SHARE显著优于单次提示和传统机器学习基线，其最强版本在整体准确率和宏F1分数上达到最佳性能。消融实验表明结构化推理和一致性约束对鲁棒诊断至关重要，尤其在弱提示条件下。

Insight: 核心创新在于将专家诊断指南转化为可审计的多阶段推理工作流，实现了证据的显式使用、中间原理生成和诊断输出的逻辑验证，为安全关键领域的人因智能分析提供了实用路径。

Abstract: Human-factor event diagnosis is essential for learning from operational events in nuclear power plants, yet its quality depends strongly on expert interpretation of narrative reports and guideline-based reasoning.Existing data-driven or one-shot large language model approaches often lack structured reasoning, have limited alignment with formal diagnostic guidelines, and may generate logically inconsistent conclusions. To address this issue, this study proposes G-SHARE, a guideline-based structured reasoning framework that operationalizes the CNNP nine-step human-factor event diagnosis guideline into a multi-stage diagnostic pipeline.The framework consists of evidence extraction, stepwise diagnostic reasoning, and post-hoc consistency repair, enabling explicit use of report evidence, intermediate rationale generation, and logical validation of diagnostic outputs. A dataset of real human-factor event reports was constructed from Chinese nuclear industry sources, and a gold-standard subset annotated by domain experts was used for evaluation. Results show that G-SHARE substantially outperforms one-shot prompting and traditional machine learning baselines, with the strongest version achieving the best overall accuracy and macro-F1. Ablation results further indicate that structured reasoning and consistency enforcement are critical to robust diagnosis, especially under weak prompting conditions. The findings demonstrate the value of transforming expert diagnostic guidelines into auditable reasoning workflows, providing a practical pathway for intelligent human-factor analysis in safety-critical industries.

[2] CANDI: Contextual Alignment for Niche Domains Question Answering cs.CL | cs.AIPDF

Megha Chakraborty, Darssan L. Eswaramoorthi, Het Riteshkumar Shah, Madhur Thareja, Michelle A Ihetu

TL;DR: 本文介绍了CANDI-QA数据集，这是一个用于评估大语言模型在医疗、金融等专业领域进行上下文对齐、用户感知和领域理解能力的新基准。该数据集包含专家标注的信息辅助型和应用推理型两类问题，并评估了十余种模型。作者还提出了一个轻量级的神经符号框架MTSS-Net作为基线。研究发现，当前LLMs在专业领域实现上下文对齐面临巨大挑战，需要增强上下文或符号整合能力。

Details

Motivation: 传统问答基准无法充分评估LLMs在医疗诊断、金融咨询等专业领域所需的、对细微上下文、用户意图和领域知识的理解能力，因此需要一个新的评估框架。

Result: 在CANDI-QA基准上评估了十多种从开源到专有的语言模型，并提出了MTSS-Net作为鲁棒基线。结果表明，当前LLMs在实现专业领域的上下文对齐方面存在显著局限性。

Insight: 创新点在于构建了专注于专业领域上下文对齐评估的CANDI-QA数据集，其问题设计（信息辅助与应用推理）能更细致地评估模型能力。客观来看，提出的轻量级神经符号框架MTSS-Net（结合神经检索与基于规则的推理）为解决该问题提供了一个有启发性的架构方向。

Abstract: The deployment of large language models (LLMs) in specialized domains like medical diagnostics and financial advisory necessitates evaluating capabilities beyond general knowledge. Traditional question-answering benchmarks often fail to capture the nuanced contextual grounding, user awareness, and domain understanding these fields require. To address this, we introduce CANDI-QA (Contextual Alignment for Niche Domains Question Answering), a novel dataset evaluating LLMs on delivering accurate, context-sensitive, and user-aligned answers in specialized settings. CANDI-QA features expert-curated question-answer pairs structured into two categories: (1) Information Assistance Questions, which are direct, factual queries requiring precise extraction, and (2) Applied Inference Questions, which are multi-hop reasoning tasks needing situational inference to generate actionable insights. We evaluate over ten diverse language models, from compact open-source to state-of-the-art proprietary systems. As a robust baseline, we present MTSS-Net, a lightweight neuro-symbolic framework combining neural retrieval with rule-based reasoning. Our findings highlight the profound challenges of achieving contextual alignment in niche domains, revealing the limitations of current LLMs without enhanced contextual or symbolic integration. Ultimately, CANDI-QA serves as a critical benchmark for advancing research in context-aware language models, stimulating the development of robust, trustworthy AI for high-stakes domains.

[3] Scaling Point-in-Time Language Models cs.CL | cs.AIPDF

Bryan Kelly, Semyon Malamud, Johannes Schwab, Teng Andrea Xu

TL;DR: 本文提出了一种通过扩大模型规模来缩小点时间语言模型与无时间限制模型之间性能差距的方法。作者使用时间过滤的FineWeb数据集训练了参数高达40亿的解码器Transformer，构建了2013-2024年间的月度模型检查点序列。这些模型在常识推理和语言理解基准测试中接近同等规模的无时间限制模型（如Gemma-3-4B和LLaMA-7B）的性能，并通过LoRA进行指令微调提升了实用性。

Details

Motivation: 解决在金融和社会科学中，由于大型语言模型训练数据包含未来信息而导致回测和因果推断有效性受损的展望偏差问题。点时间语言模型虽然能消除这种时间泄漏，但现有模型性能显著落后于无约束模型。

Result: 在多个常识推理和语言理解基准测试中，提出的点时间模型接近同等规模领先开源模型（如Gemma-3-4B和LLaMA-7B）的性能，但在部分任务上仍存在性能差距。模型通过LoRA指令微调进一步提升了下游可用性。

Insight: 核心创新在于证明通过扩大模型规模（至40亿参数）和数据规模（1万亿时间过滤词元）可以显著缩小点时间模型与无限制模型的性能差距。方法上提供了完整的可复现管道（数据集构建、训练设施和评估代码），为需要严格时间有效性的研究应用提供了支持。

Abstract: Large language models trained on unrestricted internet corpora inevitably embed information from the future, introducing lookahead bias that compromises the validity of backtests and causal inference in finance and the social sciences. Point-in-time language models–trained exclusively on text available up to each calendar date–eliminate this leakage by construction, but existing efforts typically produce models that lag substantially behind their unconstrained counterparts. We show that this performance gap can be substantially narrowed through scale. Training decoder-only transformers with up to 4 billion parameters on 1 trillion chronologically filtered tokens from FineWeb, we construct a sequence of monthly model checkpoints spanning 2013-2024. Across a range of common-sense reasoning and language understanding benchmarks, our models approach the performance of leading open-weight models of comparable size (e.g., Gemma-3-4B and LLaMA-7B) trained on temporally unrestricted data, although a performance gap remains on several tasks. Instruction fine-tuning via LoRA further improves downstream usability. We release the complete pipeline–including dataset construction, training infrastructure, and evaluation code–to enable reproducible point-in-time language modeling and to support research applications that require strict temporal validity.

[4] I’m Sorry, but I Can’t Help with Braille: Revealing Accessibility Failures in State-of-the-Art LLMs cs.CL | cs.AIPDF

Abdullah Abdullah

TL;DR: 本文评估了最先进的大语言模型在韩语-盲文双向翻译任务上的表现，发现尽管预期多语言指令调优模型能通过文本表示泛化到盲文，但模型输出质量差且不稳定，与人类判断存在显著差异。相比之下，在相同数据上对小型模型进行监督微调能带来显著且稳定的性能提升。

Details

Motivation: 研究动机是探究大语言模型在结构受限、对可访问性至关重要的模态（如盲文）上的能力，目前尚不清楚。

Result: 在人类标注数据集上的评估显示，零样本和提示的LLM基线表现不佳，而监督微调的T5-small模型在SacreBLEU、ChrF++、CER、BLEU、ROUGE-L、METEOR、CIDEr等标准指标上均取得了大幅且稳定的提升。

Insight: 论文揭示了当前LLMs在盲文处理上存在系统性局限，主要源于缺乏盲文感知的分词以及韩语与盲文模式之间的弱对齐；同时证明了适度的任务特定监督的有效性，为提升模型在可访问性关键任务上的性能提供了方向。

Abstract: Large Language Models (LLMs) perform strongly on many language tasks, but their capability in structurally constrained, accessibility-critical modalities such as Braille remains unclear. We evaluate state-of-the-art LLMs on bidirectional Korean-Braille translation using a human-annotated dataset. Despite expectations that multilingual, instruction-tuned models can generalize to Braille via text representations, we find consistently poor, unstable outputs and substantial disagreement with human judgments. These results point to missing Braille-aware tokenization and weak alignment between Korean and Braille patterns. In contrast, supervised fine-tuning of a small model (T5-small) on the same data yields large and stable gains over zero-shot and prompted LLM baselines across standard metrics (SacreBLEU, ChrF++, CER, BLEU, ROUGE-L, METEOR, CIDEr). Our findings reveal a systematic limitation of current LLMs and demonstrate the effectiveness of modest task-specific supervision.

[5] Graph-Based Detection of Disinformation Narrative Diffusion between Russian and Ukrainian Telegram Channels cs.CL | cs.AIPDF

Yuliia Vistak, Viktoriia Makovska, Vera Schmitt, Veronika Solopova

TL;DR: 本文提出了一种基于图的方法，用于检测和分析Telegram生态系统中虚假信息叙事的传播。该方法结合弱监督与传播图分析，将语义相关的声明聚合成叙事级别的簇，并建模它们在相互关联的频道间的扩散过程。

Details

Motivation: 解决社交媒体上虚假信息叙事检测的挑战，包括放大规模大、演化迅速和语言多样性，以捕捉仅通过帖子级别分析难以发现的协同叙事放大行为。

Result: 结果表明，将文本信号与网络结构整合，为检测虚假信息叙事提供了一种可扩展的方法，并揭示了其在大规模消息环境中的传播机制。

Insight: 创新点在于将弱监督与传播图分析结合，实现从语义聚合到网络扩散的叙事级检测框架，为理解协同虚假信息传播提供了新视角。

Abstract: Detecting disinformation narratives on social media is challenging due to the scale of amplification, rapid evolution, and linguistic variability of online content. We propose a graph-based framework for identifying and analyzing disinformation narratives in Telegram ecosystems by combining weak supervision with propagation graph analysis. The approach aggregates semantically related claims into narrative-level clusters and models their diffusion across interconnected channels. This enables the detection of coordinated narrative amplification that is difficult to capture through post-level analysis alone. Our results demonstrate that integrating textual signals with network structure provides a scalable method for detecting disinformation narratives and offers insights into how they propagate within large-scale messaging environments.

[6] Fine-Tuned Multi-Agent Framework for Detecting OCEAN in Life Narratives cs.CL | cs.LG | cs.MAPDF

Rasiq Hussain, Darshil Italiya, Joshua Oltmanns, Mehak Gupta

TL;DR: 本文提出了一种用于从生活叙事文本中检测OCEAN人格特质的微调多智能体框架，通过让子智能体分别采用高、低或中立视角，并结合掩码语言建模和心理测量监督来减少预训练模型中的潜在人格偏见，最终通过一个法官LLM聚合子智能体输出以生成最终预测。

Details

Motivation: 从文本中准确评估人格特质具有挑战性，因为特质是潜在的、依赖于上下文且常以微妙方式表达；同时，大型语言模型（LLMs）的预训练可能引入潜在的’类人格’偏见，导致单一模型推断不一致。

Result: 该框架在生活叙事数据集上进行了定量和定性实验评估，包括基线比较、消融研究和推断质量分析，结果表明其提供了一种可扩展且可解释的基于文本的人格推断方法。

Insight: 创新点在于通过多智能体框架结合心理测量监督，让不同视角的子智能体互补，以缓解单个模型的偏见，并利用法官LLM进行聚合，从而提升人格特质检测的鲁棒性和可解释性。

Abstract: Accurately assessing personality from text is challenging because traits are latent, context-dependent, and often subtly expressed across long narratives. Large language models (LLMs) offer new opportunities by processing extensive textual contexts, but pretraining of these models can induce latent “personality-like” biases, making single-model inferences inconsistent. We propose a fine-tuned multi-agent framework for detecting OCEAN personality traits, in which sub-agents are conditioned to adopt high, low, or neutral perspectives for each trait through masked language modeling (MLM) and psychometric supervision. A judge LLM aggregates and compares sub-agent outputs to generate final trait predictions, capturing multiple complementary perspectives while mitigating individual model biases. We evaluate the framework on life narrative dataset through quantitative and qualitative experiments, including baselines, ablations, and inference quality analyses. Our approach offers a scalable and interpretable method for text-based personality inference, highlighting the benefits of multi-agent reasoning grounded in psychometric supervision.

[7] LakeQuest: A Three-Domain Benchmark for Grounded Question Answering across Data Lakes cs.CL | cs.AIPDF

Michael Solodko, Steven Gong, Guangwei Yu, Satya Krishna Gorti, Jesse C. Cresswell

TL;DR: LakeQuest是一个包含9,846个问答对的人工验证基准，旨在评估在现实世界数据湖（包含异构的表格、文本和元数据）上进行端到端检索与合成的问答系统性能。该基准涵盖AI/ML元数据、零售银行和多模态生物医学药物信息三个领域，并为每个问题提供精确的、模态感知的证据指针。

Details

Motivation: 现有问答系统在干净、模式对齐的数据集上表现优异，但无法应对真实世界中异构、弱结构化的企业或科学数据湖。当前基准测试抽象掉了这种嘈杂的发现过程，未能评估端到端性能，因此需要一个新的基准来填补这一空白。

Result: 基线评估（包括标准的检索增强生成和智能体工具使用方法）表明，高质量的检索并不能保证正确的推理。系统在元数据图的关系链推理、银行账本的政策落地以及生物医学背景下的联合表格问答方面持续存在困难。

Insight: 论文的创新点在于构建了一个跨三个领域的、包含精确证据指针的端到端数据湖问答基准，能够隔离源发现与跨模态合成过程，从而暴露现代问答系统的关键失败模式。其核心洞察是未来智能体问答系统需要鲁棒的发现机制和忠实（faithful）的跨文件组合机制，而不仅仅是高质量的检索。

Abstract: While modern question answering (QA) systems excel on clean, schema-aligned corpora, real-world knowledge is rarely so neatly packaged. Answering questions over enterprise and scientific data lakes requires systems to navigate heterogeneous, weakly structured collections of tables, passages, and linked metadata. Current benchmarks abstract away this noisy discovery process, failing to evaluate end-to-end performance. To bridge this gap, we introduce LakeQuest, a human-validated benchmark of 9,846 QA pairs designed to evaluate the end-to-end retrieve-and-synthesize pipeline over realistic data lakes. LakeQuest spans three diverse domains (AI/ML metadata, retail banking, and multimodal biomedical drug information) and pairs every question with exact, modality-aware evidence pointers. By isolating source discovery from cross-modal synthesis, LakeQuest exposes critical failure modes in modern QA systems. Our baseline evaluations, including standard Retrieval-Augmented Generation (RAG) and agentic tool-use methods, reveal that high-quality retrieval does not guarantee correct reasoning. Systems consistently struggle with relation chaining in metadata graphs, policy grounding in bank ledgers, and joint tabular QA in biomedical contexts, highlighting the need for robust discovery and faithful cross-file composition mechanisms in future agentic QA systems.

[8] Ring-Zero: Scaling Zero RL to a Trillion Parameters for Emergent Reasoning cs.CLPDF

Xinyu Tang, Gangqiang Cao, Yurou Liu, Yuliang Zhan, Xiaochong Lan

TL;DR: 本文提出了Ring-Zero，一个将无需人类标注数据的零样本强化学习（zero RL）扩展到万亿参数规模以激发推理能力的方法。研究发现，简单的模型缩放会导致推理质量下降，因此作者设计了一个包含算法和系统优化的稳定高效训练流程。实验表明，将模型扩展到1T参数能显著提升样本效率和性能上限，并自发涌现出拟人化、结构化输出、自我验证等高级认知行为。

Details

Motivation: 现有的零样本强化学习研究主要受限于计算资源，局限于小模型，大规模模型下的训练动态和涌现能力尚未被探索。本文旨在通过扩展模型规模，从模型中激发出高质量的推理行为。

Result: 在七个数学基准测试上，Ring-2.5-1T-Zero模型取得了有竞争力的性能。此外，在一个评估思维链质量（包括可理解性、可复现性和效率）的结构化框架中，该模型在生成结构化和简洁的推理轨迹方面展现出明显优势。

Insight: 论文的核心创新点在于提出了一个稳定高效的万亿参数规模零样本强化学习训练流程，并系统性地观察和分析了大规模模型涌现出的高级认知行为，验证了模型扩展的“苦涩教训”。这为理解大规模模型的训练动态和涌现能力提供了深刻见解。

Abstract: Reinforcement learning with verifiable rewards without human-annotated data, often referred to as zero RL, has emerged as a powerful paradigm for eliciting chain-of-thought reasoning. However, due to computational constraints, existing studies are largely restricted to small models, leaving the training dynamics and emergent capabilities at a large scale unexplored. To meaningfully explore this frontier, we aim to elicit high-quality reasoning behaviors from the model. However, we find that naive scaling often suffers from poor readability, token redundancy, and a lack of adaptive reasoning depth. To address these challenges, we present a stable and efficient training pipeline, incorporating algorithmic and system optimizations such as clipped importance sampling, training-inference ratio correction, and mixed-precision control. Our experiments offer three key findings that validate the “bitter lesson” of scaling: (1) scaling to 1T parameters significantly enhances sample efficiency and performance ceilings; (2) the training process progresses sequentially through an initial discovery phase followed by a sharpening phase; and (3) the model spontaneously develops advanced cognitive behaviors, including anthropomorphism, structured formatting, self-verification, parallel reasoning, and context anxiety, rendering hand-crafted heuristics redundant. Evaluated on seven mathematical benchmarks, Ring-2.5-1T-Zero achieves competitive performance. Additionally, to assess CoT quality beyond final-answer correctness, we propose a structured evaluation framework across three dimensions: comprehensibility, reproducibility, and efficiency, where our model demonstrates clear advantages in producing structured and concise reasoning traces. By sharing our observed emergent phenomena, we hope to provide the community with deeper insights into scaling behaviors, particularly at the 1-trillion scale.

[9] WikiSTAR: A System for Shedding Light on the Hidden History of Scientific Wikipedia Articles cs.CLPDF

Omer Ehrlich, Nitzan Barzilay, Rona Aviram, Tom Hope

TL;DR: 本文介绍了WikiSTAR系统，这是一个用于探索维基百科科学文章修订历史中具有科学意义变化的交互式工具。该系统利用基于专家设计分类法的LLM分类器对编辑类型（如技术术语添加、新研究发现）进行标记，并通过交互式视图实现从宏观趋势到单个编辑的粒度追踪。用户研究表明，该系统能帮助领域专家发现新规律并实现以往难以进行的分析。

Details

Motivation: 维基百科的公开修订历史是记录科学知识演变的重要资源，但海量的常规编辑掩盖了具有科学意义的修订，使得每篇文章的科学历史难以显现。本文旨在开发一个系统来揭示这些隐藏的科学修订历史。

Result: 在用户研究中，来自三个领域的专家发现WikiSTAR能够揭示新的模式和研究问题，并实现了以往不切实际的分析。作者同时发布了系统、代码和一个人工标注的基准数据集。

Insight: 创新点在于结合了专家设计的细粒度多标签分类法与LLM分类器来自动识别科学修订类型，并构建了交互式可视化系统，使得大规模追踪科学知识在维基百科中的演变成为可能，为科学计量学和科学传播研究提供了新工具。

Abstract: Wikipedia plays a key role in shaping public understanding of science, and its openly accessible revision history is a unique record of how scientific knowledge evolves over time. Yet scientifically meaningful revisions are obscured by the sheer volume of routine edits, leaving each article’s scientific history hidden. We present WikiSTAR (Scientific Tracking of Article Revisions), an interactive system for exploring scientifically meaningful changes across an article’s revision history. Using an LLM classifier with an expert-designed multi-label taxonomy, WikiSTAR first tags edit types such as the addition of technical terms, new research findings, and changes in scientific narrative. Then, through interactive views, an article’s full revision history can be traced at any granularity - from aggregate trends that reveal when and in which sections scientific content was added or refined, down to individual edits - showing how scientific knowledge develops at a scale previously impossible. In a user study, experts from three domains found that WikiSTAR surfaced new patterns and research questions and enabled previously impractical analyses. We release our system, code and a human-annotated benchmark.

[10] Segregate, Refine, Integrate: Decomposing Multimodal Fusion for Sentiment Analysis cs.CLPDF

Alexios Filippakopoulos, Elias Kallioras, Nikolaos Xiros, Efthymios Georgiou, Alexandros Potamianos

TL;DR: 本文提出了一种名为SeRIn（Segregate, Refine, Integrate）的新型多模态语言模型融合方案，用于情感分析。该方法将模态特定信号的提炼与跨模态交互的建模这两个通常纠缠在一起的目标进行分离，作为架构先验。具体而言，模态特定的表征在独立的路径上演化并针对各自的编码器上下文进行提炼，而一个专用的跨模态路径则在不污染单模态流的情况下积累它们的联合演化。完全的跨模态交互被推迟到最终的预测步骤。该方法在CH-SIMS和CMU-MOSEI基准测试上取得了最先进的结果。

Details

Motivation: 解决多模态融合中模态特定信号提炼与跨模态交互建模这两个相互竞争的目标通常在同一操作中纠缠不清的问题。

Result: 在CH-SIMS和CMU-MOSEI基准测试上取得了最先进（SOTA）的结果，所有指标均有提升。消融实验证实性能提升源于结构化的交互而非增加的模型容量。

Insight: 核心创新在于将模态提炼与跨模态交互在架构层面解耦，通过分离的路径进行处理。该方法还展现出在没有显式监督的情况下，能根据视觉信息损坏进行模态重加权的能力，这为鲁棒的多模态融合提供了新思路。

Abstract: Multimodal fusion must simultaneously refine modality-specific signals and model cross-modal interactions; two competing objectives typically entangled within the same operation. We propose \textbf{SeRIn} (\textbf{Se}gregate, \textbf{R}efine, \textbf{In}tegrate), a multimodal LM fusion scheme that enforces this separation as an architectural prior. Modality-specific representations evolve along isolated pathways, each refined against its respective encoder context, while a dedicated cross-modal pathway accumulates their joint evolution without contaminating unimodal streams. Full cross-modal interaction is deferred to a final prediction step - ablations confirm that structured interactions, not added capacity, drive the gains; gate analysis under visual corruption reveals emergent modality reweighting without explicit supervision. SeRIn achieves state-of-the-art results on CH-SIMS and CMU-MOSEI, improving all metrics on both benchmarks.

[11] From Critic to Confidence: PPO for Language-Based Quantitative Prediction with Confidence Estimation cs.CL | cs.AIPDF

Mehak Dhaliwal, Rasta Tadayon, Andong Hua, Haewon Jeong, Yao Qin

TL;DR: 本文提出CARE-PPO，一个强化学习框架，用于语言驱动的定量预测任务，旨在同时提升预测准确性和置信度估计的可靠性。该方法通过将PPO算法中的评论家网络与不确定性估计相结合，利用预测误差定义置信度对齐奖励，使模型在微调过程中学习准确的数值预测和可靠的置信度信号。

Details

Motivation: 当前大型语言模型在基于语言的定量预测任务中容易产生幻觉和过度自信的错误，因此不仅需要模型做出预测，还需要知道何时可以信任其预测结果。

Result: 在医疗和金融领域的两个真实世界任务以及Qwen-3模型的4B和8B规模上，CARE-PPO实现了强大的定量预测性能，并通过评论家网络产生的置信度估计显著优于基于logit和语言化表达的基线方法，且在跨领域的分布外场景下（包括语言和领域偏移）保持优势。

Insight: 创新点在于建立了不确定性估计的损失预测与PPO演员-评论家微调之间的联系，将评论家重新用作置信度估计器，并设计了与预测质量对齐的置信度奖励函数。从客观角度看，该方法将强化学习微调的泛化优势与可靠的置信度校准相结合，减少了特定任务的过拟合。

Abstract: LLMs can perform language-based quantitative prediction from unstructured inputs, but remain susceptible to hallucinations and overconfident errors, making it critical to know not only what a model predicts, but when its predictions can be trusted. We introduce CARE-PPO, a reinforcement learning framework that establishes a connection between loss prediction for uncertainty estimation and actor-critic PPO fine-tuning, enabling joint learning of accurate numerical estimates and reliable confidence signals in language-based quantitative prediction. CARE-PPO uses a Confidence-Aligned Reward for Estimation, defined as a function of prediction error, to provide dense error-aware feedback to the actor while inducing the critic to learn a value function aligned with prediction quality. During inference, we repurpose the critic as a confidence estimator. Across two real-world tasks in healthcare and finance and two Qwen-3 model scales (4B and 8B), CARE-PPO achieves strong quantitative prediction performance, while producing significantly better-aligned confidence estimates through the critic than logit-based and verbalized baselines. These gains persist under realistic out-of-distribution settings across domains, spanning linguistic and domain shifts. Finally, CARE-PPO reduces task-specific overfitting on general instruction-following prompts, consistent with the broader generalization advantages of RL fine-tuning over supervised approaches.

[12] Less Experts, Faster Decoding: Cost-Aware Speculative Decoding for Mixture-of-Experts cs.CL | cs.AI | cs.DCPDF

Jincheng Xie, Runheng Liu, Heyan Huang, Yawen Ling, Hanbin Dai

TL;DR: 本文提出了一种名为EcoSpec的成本感知推测解码框架，用于加速稀疏专家混合（MoE）大语言模型的推理。该框架通过将预测的专家激活成本纳入草稿令牌选择过程，旨在减少验证阶段激活的专家总数，从而降低内存流量并提高端到端解码速度。

Details

Motivation: 现有推测解码方法主要优化草稿令牌的接受概率，但在MoE模型中，草稿选择也决定了验证阶段激活的专家集合。高置信度的草稿令牌可能导致“专家分散”，激活大量不同的专家，增加内存流量并削弱推测带来的加速效果。

Result: 在DeepSeek-V3.1 (671B)、Qwen3-235B-A22B和GPT-OSS-120B等多个大规模MoE模型上，在推理、编码、问答和对话等基准测试中，EcoSpec持续减少了活跃专家数量，端到端解码速度最高提升了1.62倍。

Insight: 核心创新点在于将MoE推理中非均匀的内存成本结构引入到推测解码的草稿选择策略中，而无需修改目标模型的验证规则。通过轻量级专家预测器和动态专家缓冲区，优先选择能重用当前验证集已覆盖专家的草稿路径，在保持高接受率的同时降低专家激活开销。

Abstract: Sparse Mixture-of-Experts (MoE) models have become an important approach for scaling Large Language Models (LLMs), but their inference efficiency depends strongly on expert activation patterns. Speculative decoding (SD) accelerates autoregressive generation by verifying multiple draft tokens in parallel, yet existing draft selection strategies primarily optimize acceptance likelihood. In large-scale MoE models, however, selecting draft tokens also determines the union of experts activated during verification. We observe that confidence-driven SD can introduce \textit{expert scattering}: high-probability draft tokens may route to disjoint experts, increasing expert-weight memory traffic and reducing the speedup from speculation. Motivated by this observation, we revisit draft-tree selection under the non-uniform memory-cost structure of MoE inference. We propose \textsc{EcoSpec}, a cost-aware speculative decoding framework that incorporates predicted marginal expert activation cost into draft selection. With a lightweight expert predictor and a dynamic expert buffer, \textsc{EcoSpec} favors draft paths that preserve high acceptance likelihood while reusing experts already covered by the current verification set, without modifying the target-model verification rule. We evaluate \textsc{EcoSpec} on three large-scale MoE models, including DeepSeek-V3.1 (671B), Qwen3-235B-A22B, and GPT-OSS-120B, across reasoning, coding, question-answering, and dialogue benchmarks. \textsc{EcoSpec} consistently reduces active expert footprints and improves end-to-end decoding speed, achieving up to $1.62\times$ speedup. These results show that accounting for expert activation cost is important for efficient speculative decoding in large-scale MoE models.

[13] Epistemic Stance Flexibility Probing: Measuring Prompt-Conditioned Register Shift in Large Language Models cs.CLPDF

Binwen Liu, Yilin Ren

TL;DR: 本文提出了ESFP（认知立场灵活性探测）基准，用于评估大型语言模型在外部归因与自我归因提示下切换认知立场的能力。该基准包含104个精心设计的项目，从词汇、表征、句子和一致性四个维度评估模型响应，发现认知灵活性与模型整体能力正交，且立场内容密度是最强信号。

Details

Motivation: 现有基准无法直接评估语言模型在回答专家观点与自身观点时是否能够区分并切换认知立场，而可信的对话代理应具备这种能力。

Result: 在评估八个前沿模型后，发现一个270亿参数的开源模型与最强专有系统表现相当，某些旗舰模型表现不如轻量版本，且推理优化模型未展现更高灵活性；立场内容密度提供了最强评估信号。

Insight: 创新点在于将外部归因与自我归因的对比作为基本测量单元，并设计多维度评估框架；客观来看，该研究揭示了模型表面词汇标记（如“我认为”）与真实立场表达可能脱节，为评估模型认知行为提供了新视角。

Abstract: A language model may be asked either what experts believe about a contested claim or what it believes about the claim itself. A trustworthy conversational agent should distinguish these two requests and respond in different epistemic registers: neutral attribution in the first case and stance expression in the second. Whether such a shift occurs-and whether it occurs coherently-is not directly assessed by existing benchmarks for accuracy, instruction following, or safety. We introduce ESFP, a behavioral benchmark that treats the contrast between externally attributed and self-attributed prompts as the fundamental unit of measurement. ESFP consists of 104 carefully controlled items spanning six epistemic categories and five phrasing templates, and evaluates model responses along four complementary dimensions: lexical self-attribution, representation-level responsiveness to role framing, sentence-level stance content density assessed by an LLM judge panel, and cross-condition stance consistency. Evaluating eight frontier models from five vendors, we find that epistemic flexibility is largely orthogonal to general model capability: a 27B open-weight model matches the strongest proprietary systems, the flagship model of one family underperforms its lightweight counterpart, and reasoning-optimized models do not consistently exhibit higher flexibility. Stance content density provides the strongest signal, while surface-level lexical markers such as ‘I think’ can change substantially without corresponding changes in expressed stance. We provide item-level bootstrap confidence intervals, weight-sensitivity analyses, and an explicit discussion of the interpretation limits of the composite score. ESFP measures a model’s propensity to adapt its epistemic stance under changing attribution conditions, rather than a general competence measure.

[14] Knowledgeless Language Models: Suppressing Parametric Recall for Evidence-Grounded Language Modeling cs.CLPDF

Roi Cohen, Yvan Carré, Nick Lechtenbörger, Hendrik Droste, Lucas Kerschke

TL;DR: 该论文提出了一种名为’知识贫乏语言模型’的新型预训练范式，通过在预训练语料中对命名实体进行匿名化处理，旨在抑制模型对参数化知识的记忆，并促使其更多地依赖外部证据进行推理。

Details

Motivation: 解决语言模型过度依赖参数中存储的事实知识所导致的不可靠行为问题，例如知识过时、不完整或与上下文不一致的情况，探索通过修改预训练信号来系统性地引导模型进行证据驱动的推理。

Result: 在多个模型规模上，KLLMs在上下文问答、事实核查和幻觉检测基准测试中持续优于基线模型；在证据不完美的检索增强场景下，KLLMs表现出更强的鲁棒性，相对标准语言模型获得了高达20-25%的性能提升，并且在校准指标（如ECE、Brier分数、AUROC）和弃权行为方面也表现更好。

Insight: 核心创新在于通过预训练时移除命名实体这一与事实知识强关联的监督信号，从根本上改变了模型获取知识的方式，使其从’记忆-回忆’模式转向’证据-推理’模式，这为构建对证据更敏感的基础模型提供了新思路，可作为检索增强和工具使用系统的补充。

Abstract: Language models encode substantial factual knowledge in their parameters, which can lead to unreliable behavior when this knowledge is outdated, incomplete, or misaligned with the provided context. In this work, we study whether modifying the pretraining signal can systematically shift models away from parametric recall and toward evidence-grounded reasoning. We introduce Knowledge–’’Less’’ Language Models (KLLMs), a fundamentally different epistemic training paradigm for LLMs, which are pretrained on corpora in which named entities are anonymized, thereby removing a primary channel for entity-linked factual supervision. This intervention substantially reduces closed-book factual recall, while often improving performance on tasks where relevant information is provided as context. Across multiple model scales, KLLMs consistently outperform matched baselines on contextual question answering, fact verification, and hallucination detection benchmarks. Crucially, in retrieval-grounded settings with imperfect evidence, KLLMs show improved robustness and achieve up to 20–25% relative gains over standard language models. They further exhibit better calibration, with improved ECE, Brier score, and AUROC, as well as more reliable abstention behavior. Our results demonstrate that suppressing entity-linked supervision during pretraining induces a shift in epistemic behavior: KLLMs rely less on parametric knowledge and more on external evidence, leading to improved reliability under realistic conditions. This suggests that pretraining-time control over knowledge acquisition can complement retrieval-augmented and tool-based systems by providing a more evidence-sensitive base model.

cs.CV [Back]

[15] TSCA-Net: Temporal-Spatial Clique Attention for Interpretable Multimodal Pedestrian Trajectory Prediction cs.CVPDF

Md Mustafizur Rahman, Guangchao Yang, A F M Abdun Noor, Md Imam Ahasan, Md Mahfuzur Rahman

TL;DR: 本文提出了TSCA-Net，一个用于可解释多模态行人轨迹预测的框架。它通过三个互补模块来解决现有方法在处理历史信息、社会交互和运动复杂性方面的不足：TSCA模块引入可学习的时间门控来调制历史观测；CPCP模块通过动态团势能建模非对称的行人间关系；AKGR机制基于个体目标分布熵自适应调整解码器的表达能力。

Details

Motivation: 现有基于目标的轨迹预测模型存在三个主要局限：对历史时间步赋予等权重、使用标准的图注意力机制、以及解码器容量固定无法适应局部预测复杂性。本文旨在解决这些局限，以应对拥挤环境中行人运动的多模态不确定性和不同场景下运动动力学的可变复杂性。

Result: 在ETH/UCY和Stanford Drone Dataset (SDD)基准测试上，TSCA-Net达到了最先进的性能。具体结果为：在ETH/UCY上平均ADE/FDE为0.13/0.20米，在SDD上为6.95/10.43像素。消融研究证实了所有三个模块的互补贡献。

Insight: 主要创新点在于将时间感知机制（可学习时间门控）整合到基于团的交互中，以及通过动态调整KAN增强的LSTM解码器的网格分辨率来适应不同运动复杂性。这为轨迹预测提供了更精细的时间调制和自适应模型表达能力，是可借鉴的思路。

Abstract: Accurate pedestrian trajectory prediction in crowded environments remains challenging due to the multimodal uncertainty of human motion and the variable complexity of motion dynamics across different scene contexts. Existing goal-conditioned models rely on static displacement structures that assign equal weight to all historical time steps, standard graph attention mechanisms, and fixed-capacity motion decoders that cannot adapt to local prediction complexity. To address these limitations, we propose TSCA-Net, a trajectory prediction framework built upon three complementary modules. The Temporal-Spatial Clique Attention (TSCA) module introduces learnable temporal gating into clique-based goal-history interaction, enabling time-aware modulation of historical observations relative to each candidate goal. The Cross-Pedestrian Clique Potential (CPCP) module models asymmetric pairwise agent relationships through a dynamic clique potential framework with a time-varying social graph. The Adaptive KAN Grid Refinement (AKGR) mechanism dynamically adjusts the B-spline grid resolution of a Kolmogorov-Arnold Network-augmented LSTM decoder based on per-agent goal distribution entropy, balancing model expressiveness against overfitting across varying motion complexities. Extensive experiments on the ETH/UCY and Stanford Drone Dataset benchmarks demonstrate that TSCA-Net achieves state-of-the-art performance, with average ADE/FDE of 0.13/0.20 m on ETH/UCY and 6.95/10.43 pixels on SDD. Comprehensive ablation studies confirm the complementary contributions of all three proposed modules.

[16] Anomalous Frame Detection Using VLM-Based Description Comparison for Extracting Expert-Specific Actions and Contextual Decision-Making Scenes with Intra-Video Self-Similarity cs.CVPDF

Ryo Sakai, Kaname Yokoyama

TL;DR: 本文提出了一种基于视觉语言模型（VLM）描述比较的异常帧检测方法，用于从任务视频中自动提取专家特有的操作和上下文决策场景。该方法通过跨视频的帧级描述相似度识别专家特有动作，并利用视频内描述的自相似性提取决策场景。在模拟配电盘维护实验中，该方法在动作候选和决策场景候选的提取率上均优于传统方法。

Details

Motivation: 为了解决关键基础设施维护领域专家数量减少、需要向经验不足的工人传递专家诀窍（know-how）的问题。现有方法主要关注可观察动作的差异，但专家诀窍往往也嵌入在任务执行过程中的上下文决策里，因此需要一种能同时提取这两类场景的方法。

Result: 在包含27个任务场景的模拟配电盘维护实验中，所提方法对动作候选和决策场景候选的提取率分别达到65%和61%，优于传统方法的59%和33%，证明了其在发现包含专家诀窍的候选场景方面的有效性。

Insight: 创新点在于利用VLM生成帧级视觉描述，并分别通过跨视频描述比较和视频内描述自相似性来提取专家特有动作和上下文决策场景，从而更全面地捕捉专家诀窍。这为基于视频的专家知识提取提供了一种结合动作与决策上下文的新思路。

Abstract: Maintenance of critical infrastructures, such as railways and power plants, is essential for ensuring operational safety and reliability. However, the declining number of skilled maintenance workers highlights the need to transfer expert know-how to less experienced workers. Previous studies have attempted to extract candidates of expert knowledge by comparing videos of manual-based work with those of expert workers, mainly focusing on differences in observable actions. However, expert know-how is often embedded not only in actions but also in contextual decision-making during task execution. This paper proposes a method that detects anomalous frames between two task videos to automatically extract candidate scenes containing expert-specific actions and contextual decision-making scenes. The method generates frame-wise visual descriptions using a vision-language model (VLM). Expert-specific actions are extracted based on frame similarities computed from description comparisons between two videos, while contextual decision-making scenes are extracted using segment similarities derived from intra-video self-similarity of the descriptions. In simulated distribution board maintenance experiments involving 27 task scenarios, the proposed method achieved extraction rates of 65% for action candidates and 61% for decision-scene candidates, improving over conventional methods that achieved 59% and 33%, respectively. These results demonstrate the effectiveness of the proposed approach in discovering candidate scenes containing expert know-how.

[17] Anatomy-Privileged Distillation with Token Routing for MRI-Based Prediction of Perineural Invasion cs.CVPDF

Hyunsu Go, Youngung Han, Kyeonghun Kim, Junga Kim, Dohyun Kweon

TL;DR: 本文提出了一种基于解剖学先验知识的师生蒸馏框架，用于从T2加权MRI中预测肝内胆管癌的神经周围侵犯。该方法在训练时，教师模型利用带有肿瘤和肝脏掩膜的MRI学习密集令牌路由，学生模型则通过蒸馏来保留和聚合信息丰富的令牌，且推理时无需掩膜。

Details

Motivation: 神经周围侵犯是肝内胆管癌术后不良预后的重要因素，但现有术前影像模型常依赖放射科医生定义的变量、对比增强成像或手动标注，因此需要一种仅使用T2加权MRI的自动化预测方法。

Result: 在155名患者的数据集上，该方法在相同评估协议下取得了最高的平均AUROC（0.750），优于仅使用MRI的基线模型，并在Jetson Orin Nano开发板上实现了1.43 GFLOPs的计算量和每例8.02 ms的推理时间。

Insight: 创新点在于将解剖学监督（掩膜）仅用于训练阶段的教师模型，通过令牌路由蒸馏使学生模型在推理时无需掩膜即可有效聚合关键信息，实现了计算效率与预测性能的平衡，为医学影像分析提供了一种轻量化的知识蒸馏范式。

Abstract: Perineural invasion (PNI) is associated with poor postoperative outcomes in intrahepatic cholangiocarcinoma, but it is confirmed by surgical pathology. Existing preoperative imaging models often rely on radiologist-defined variables, contrast-enhanced imaging, or manual annotations. We propose an anatomy-privileged teacher–student framework for patient-level PNI prediction from T2-weighted MRI. During training, the teacher uses MRI with tumor and liver masks to learn dense token routing, and the student distills this guidance to retain and aggregate informative tokens under a fixed budget. Anatomical supervision is restricted to training, and the deployed model does not require masks at inference. In 155 patients, the proposed method achieved the highest mean AUROC of 0.750 among matched MRI-only baselines evaluated under the same protocol, with 1.43 GFLOPs and 8.02 ms per case on a Jetson Orin Nano Super Developer Kit.

[18] SymbOmni: Evolving Agentic Omni Models via Symbolic Concept Learning cs.CV | cs.LGPDF

Jinxiu Liu, Jianru Li, Tanqing Kuang, Xuanming Liu, Kangfu Mei

TL;DR: 本文提出了SymbOmni，一种通过符号概念学习实现累积进化的智能全能模型。其核心是符号概念盒，一个可优化的记忆模块，能将低级操作抽象为可重用的符号工作流指令。模型通过归纳-转换循环运作，并使用基于语言的反馈进行训练，实现了无需梯度微调的持续自我改进。

Details

Motivation: 现有单体模型存在’永久新手’问题，无法进行累积学习和自主进化，缺乏将经验结构化并重用的机制，导致组合泛化能力差和知识保留效率低下。

Result: 实验表明，SymbOmni在迭代创作任务上显著优于现有基于智能体的系统，并在图像质量和任务成功率上超越了闭源模型；它能将token消耗降低40%以上，同时在多个在线学习基准测试中实现了累积增益，达到了新的SOTA水平。

Insight: 创新点在于引入了符号概念盒和归纳-转换循环，将经验抽象为可组合的符号概念，并通过基于语言的反馈进行训练，实现了模型的持续自我改进和高效知识复用，为解决模型的累积学习和组合泛化问题提供了新思路。

Abstract: Visual generation is increasingly ubiquitous in diverse domains, from text-to-image/video synthesis to multimodal interactive creation. Yet prevailing monolithic models remain fundamentally constrained by their inability to learn cumulatively and evolve autonomously, which is a limitation we term the “perpetual novice” problem. They lack mechanisms for structuring experience into reusable knowledge and therefore rely on brittle, “from-scratch” reasoning for each task, resulting in poor compositional generalization and inefficient knowledge retention. Motivated by these limitations, we propose SymbOmni, an agentic omni-model designed for cumulative evolution through Symbolic Concept Learning. At its core is the Symbolic Concept Box, an optimizable memory module that abstracts low-level operations into reusable Symbolic Workflow Instructions. SymbOmni operates through an induction-transduction cycle: experiences are abstracted into symbolic concepts (induction), which are then adaptively composed to solve novel tasks (transduction). The training is done by verbalized backpropagation with language-based feedback to enable continuous self-improvement without gradient-based model fine-tuning. Comprehensive experiments validate that (I) SymbOmni significantly outperforms existing agent-based systems for iterative creation and also surpasses closed-source models (e.g., Nano Banana, GPT-Image-1) in both image quality and task success rates; (II) SymbOmni effectively reduces token consumption by over 40% while maintaining competitive generation quality; and (III) SymbOmni enables effective continual learning by achieving cumulative gains across multiple online-learning benchmarks and setting a new state of the art.

[19] An Empirical Analysis of Continual Learning for Heterogeneous Medical Visual Question Answering cs.CV | cs.AI | cs.CLPDF

Mai A. Shaaban, Tausifa Jan Saleem, Alaa Mohamed, Dilnaz Utemissova, Ufaq Khan

TL;DR: 本文对异构医学视觉问答（MedVQA）任务中的持续学习（CL）方法进行了系统性实证分析。研究评估了现有CL方法在缓解灾难性遗忘、对任务顺序的敏感性以及低秩适应参数演化方面的表现。

Details

Motivation: 在真实临床环境中部署MedVQA系统需要模型能够适应新任务而不遗忘旧知识，持续学习为此提供了实用框架，但现有研究对CL方法在异构MedVQA任务上的行为探索不足。

Result: 研究发现，当目标不同、监督格式各异的任务交错出现时，现有CL方法难以维持稳定性与可塑性之间的平衡。

Insight: 论文的创新点在于首次对MedVQA中的CL进行了跨多种临床目标（分类、多标签分类、检测、细胞计数和报告生成）的系统性评估，并揭示了任务顺序对性能的影响以及权重漂移的模式。

Abstract: Deploying medical visual question answering (MedVQA) systems in real-world clinical settings requires models that adapt to new clinical tasks without forgetting previously acquired knowledge. Continual learning (CL) provides a practical framework for this setting. Despite rapid progress in medical vision-language models, the behavior of CL methods when training these models across heterogeneous MedVQA tasks remains underexplored. This work presents a systematic evaluation of CL for MedVQA across diverse clinical objectives, including classification, multi-label classification, detection, cell counting, and report generation. Specifically, we explore (1) the ability of existing CL methods to mitigate catastrophic forgetting; (2) their sensitivity to task ordering, analyzing how different task sequences influence performance retention and forgetting; and (3) the evolution of low-rank adaptation parameters as new tasks are learned, revealing patterns of weight drift under different CL methods. Our findings suggest that existing CL methods struggle to maintain stability-plasticity balance when tasks with different objectives and supervision formats are interleaved. Code and full experimental setup will be publicly available.

[20] Causal Supervision of Attention for Affective Behaviour Analysis cs.CVPDF

Nemanja Rašajski, Konstantinos Makantasis, Antonios Liapis, Georgios N. Yannakakis

TL;DR: 本文提出了一种用于情感行为分析的注意力池化框架，旨在通过因果监督、交叉协方差独立正则化和非线性值投影来提升模型在真实世界多任务学习中的泛化能力。该方法在s-Aff-Wild2数据库的官方验证集上取得了较好的整体性能。

Details

Motivation: 解决情感行为分析中模型易受身份、光照、姿态等虚假因素干扰，以及注意力机制可能利用数据集特定相关性而非真实情感线索的问题，以提升模型泛化性。

Result: 在s-Aff-Wild2数据库的官方验证集上，该方法在效价-唤醒度估计、表情识别和动作单元检测任务上分别取得了CCC_VA=0.5123、F1_EX=0.3116和F1_AU=0.3974的成绩，整体P分数为1.2214。

Insight: 创新点包括：1) 引入因果监督使注意力关注跨被试不变的面部区域；2) 使用交叉协方差正则化促进键值投影的互补性；3) 采用SwiGLU非线性变换增强特征表达能力。这些设计有助于模型学习更鲁棒的情感表征。

Abstract: Affective Behaviour Analysis aims to enable machines to infer human affective states from behavioural signals, particularly facial expressions, in real-world environments. The \textit{11th Affective Behaviour Analysis in-the-wild Competition} includes the Multi-Task Learning Challenge based on the s-Aff-Wild2 database, where participants develop a unified framework for Valence-Arousal Estimation, Expression Recognition, and Action Unit Detection. This is challenging because emotion-related cues must be distinguished from spurious factors such as identity, illumination, pose, and demographic variation. Attention mechanisms are well suited as they aggregate information from the most informative facial regions, but may still exploit dataset-specific correlations instead of true affective cues. To improve generalization, we propose an attention pooling framework that promotes subject-invariant attention while increasing feature expressiveness. Our method consists of three components. First, we introduce causal supervision to enforce attention on facial regions with invariant predictive value across subjects. Second, we apply a cross-covariance independence regularization between Key (K) and Value (V) projections to encourage complementary, non-redundant representations. Finally, we replace the linear Value projection with a gated nonlinear SwiGLU transformation to increase feature expressiveness and capture finer-grained affective cues. Our method achieves $CCC_{VA}=0.5123$ for VA estimation on the official validation set, together with $F1_{EX}=0.3116$ and $F1_{AU}=0.3974$ for expression recognition and action unit detection, respectively, resulting in an overall $P$ score (the sum of the individual task metrics) of $1.2214$.

[21] NEEDL-Bench: Dataset for Swiss Needle Cast and Stomata Detection in Microscopy Images cs.CVPDF

Benjamin Blake, Declan McIntosh, Jürgen Ehlting, Nicolas Feau, Joey B. Tanney

TL;DR: 本文提出了NEEDL-Bench数据集，这是一个用于检测瑞士针叶病（SNC）真菌结构（假囊壳）和气孔（stomata）的显微图像基准。该数据集包含3250张标注图像，涵盖关键点和边界框检测任务，并设计了两种评估划分以覆盖数据分布和罕见结构。作者评估了多种主流检测方法作为基线，最高F1分数为0.8479，并发现模型性能提升主要依赖于领域特定的归纳偏置而非模型规模。

Details

Motivation: 瑞士针叶病（SNC）严重影响花旗松的生产力，但目前缺乏用于自动计算机视觉检测其真菌结构和气孔的数据集，而计算机视觉技术有望标准化并规模化病害严重程度测量。

Result: 在NEEDL-Bench数据集上评估了多种关键点和边界框检测方法，最高F1分数达到0.8479，表明该问题有显著的改进空间；同时发现更大模型并未带来相应性能提升，说明性能改进需依赖领域特定归纳偏置而非缩放定律。

Insight: 创新点在于首次构建了针对SNC病害显微结构检测的基准数据集，并设计了随机采样和顺序采样两种评估划分以更好地覆盖数据分布和罕见结构；客观分析表明，该研究强调了在特定生物医学视觉任务中，领域知识（归纳偏置）比单纯扩大模型规模更为关键。

Abstract: We present NEEDL-Bench, a microscopy detection benchmark for Swiss Needle Cast (SNC), a fungal disease of Douglas-fir trees. Douglas-fir is a keystone species of major ecological and economic importance as a softwood timber resource, and SNC affects productivity by forming sexual reproductive structures (pseudothecia) that emerge through the gas exchange pores (stomata) of the needles, thereby blocking gas exchange and compromising needle function. To date, there is no dataset for automatic computer vision detection of these structures, despite computer vision being well poised to standardize and viably scale severity measurements. To address this, we present NEEDL-Bench, a dataset of 3250 annotated images from 1082 Douglas-fir needles, annotated for both keypoints and bounding-box detectors. This dataset exhibits a challenging collection of features, including blur, poor object contrast, small objects of interest, and occlusions. To better capture both the nominal distribution of the data and the full breadth of rare structures, we present two distinct evaluation splits: either random sampling from the collected images or sequential sampling to maximize structural diversity. We evaluate multiple popular keypoint and bounding box methods for detection on this dataset as a baseline and observe a maximum F1 score of 0.8479, suggesting significant potential for gains from future development on this problem. Further, we find that larger models generally do not show commensurate gains in performance on this dataset, indicating that improvements on this problem will not come from scaling laws but rather from domain-specific inductive biases.

[22] A Calibrated Multimodal Ensemble for Ambivalence/Hesitancy Recognition: System Description and Private-Test Submission Strategy cs.CVPDF

Josep Cabacas-Maso, Ismael Benito-Altamirano, Carles Ventura

TL;DR: 本文描述了为ABAW A/H挑战赛（第11届）开发的系统，该系统旨在从视频中自动识别矛盾/犹豫情绪。核心是一个经过校准、等权重的集成模型，融合了冻结的面部、音频、文本和姿态嵌入特征。该系统在公开测试集上达到0.7358的宏F1分数。

Details

Motivation: 矛盾与犹豫情绪会削弱数字行为干预的效果，该研究旨在解决从视频中自动识别这些情绪的问题，以应对ABAW挑战赛在BAH数据集上的任务。

Result: 在公开测试集上达到0.7358宏F1分数。在由30名新参与者组成的私有测试集上，首次提交（仅使用公开验证集调优的校准集成模型）获得了0.7361宏F1分数，与公开测试结果几乎完全一致，证明了模型对未见参与者的泛化能力。

Insight: 主要创新点在于采用了一个经过校准的、等权重的多模态融合集成模型，并详细阐述了针对私有测试集（限制提交次数）的提交策略与配置原理，验证了模型在未见数据上的鲁棒性，避免了数据泄露问题。

Abstract: Ambivalence and hesitancy (A/H) undermine digital behaviour-change interventions, and recognizing them automatically from video is the goal of the ABAW A/H challenge on the BAH dataset. We describe our system for the 11th edition of the challenge: a calibrated, equal-weight ensemble of three fusion models over frozen face, audio, text, and pose embeddings, which reaches 0.7358 macro-F1 on the public test set. This year’s private test, released on a disjoint set of 30 new participants, is scored on five allowed submissions; we report the configuration and rationale of each of our five submissions, and, where already available, the private-test score obtained. Our first submission, an exact replica of the calibrated ensemble tuned only on public validation, scored 0.7361 macro-F1 on the private test, matching our public-test estimate almost exactly and confirming the pipeline generalizes to unseen participants without leakage.

[23] Overview of Cross-Component In-loop Filters in Video Coding Standards cs.CVPDF

Zhaoyu Li, Xuewei Meng, Jiaqi Zhang, Cheng Huang, Chuanmin Jia

TL;DR: 本文综述了视频编码标准中跨分量环路滤波器的起源、发展和现状，重点介绍了跨分量自适应环路滤波器和跨分量样本自适应偏移这两种技术。这些滤波器利用亮度与色度分量之间的相关性来减少压缩伪影，从而提高色度保真度。

Details

Motivation: 传统环路滤波器（如去块效应滤波器、样本自适应偏移、自适应环路滤波器）对各分量独立处理，而跨分量滤波器旨在利用亮度与色度通道之间的相关性来进一步提升色度保真度，解决压缩伪影问题。

Result: 论文未提供具体的定量实验结果，但指出跨分量滤波器已被纳入最新的视频编码标准（如VVC/H.266），作为提升压缩效率的技术之一。

Insight: 创新点在于将分量间的相关性引入环路滤波过程，通过跨分量预测来更精确地重建像素值，这为视频编码中的后处理滤波提供了新的设计思路，可能启发未来更高效的联合分量滤波方法。

Abstract: In-loop filters have been comprehensively explored during the development of video coding standards due to their remarkable noise-reduction capability. In the early stage of video coding, in-loop filters, such as Deblocking Filter, Sample Adaptive Offset, and Adaptive Loop Filter, were performed separately for each component. Recently, cross-component filters were studied to improve the chroma fidelity by exploiting correlations between the luma and chroma channels. This paper summarizes the cross-component filters used in the state-of-the-art video coding standard. Specifically, it includes the Cross-Component Adaptive Loop Filter and Cross-Component Sample Adaptive Offset. Cross-component filters aim to reduce compression artifacts based on the correlation between different components and provide more accurate pixel reconstruction values. In this paper, we introduce the origin, development, and status of cross-component filters in the current video coding standards. Finally, we had some discussions on the further evolutions of cross-component filters.

[24] RegHead: Non-Humanoid Head Blendshapes via Feed-Forward Registration cs.CV | cs.GRPDF

Jiahao Luo, Hao Zhang, Jianqi Chen, Yijie He, Jiaxu Zou

TL;DR: RegHead是一个为可动画的非人形头部化身构建语义混合形状集的框架。它通过大规模数据集、针对局部面部变形的密集随机锚点运动表示以及快速前馈配准模型，将未配准的表情网格转换为对应的混合形状基。该方法能生成比基线更高保真度的表情网格，运行速度比优化方法快几个数量级，并支持从人脸跟踪信号到非人形角色的实时重定向。

Details

Motivation: 为可动画的非人形头部化身构建语义混合形状集成本高昂，因为表情一致的监督数据稀缺、生成的4D资产通常缺乏对应关系，且面部运动高度局部化。

Result: 实验表明，该方法生成的表达网格比基线方法具有更高的保真度，同时运行速度比优化方法快几个数量级。它进一步展示了从人脸跟踪信号到非人形角色的实时重定向能力，能够捕捉头部姿态和局部面部运动。

Insight: 创新点包括：通过微调图像编辑扩展艺术家绑定库来构建大规模配对数据集；设计针对局部面部变形的密集随机锚点运动表示；以及开发快速前馈配准模型，通过从中性形状预测基于锚点的变形来实现高效配准。这为高效创建和动画化非人形角色提供了新思路。

Abstract: We present RegHead, a framework for constructing semantic blendshape sets for animatable non-humanoid head avatars. With a fixed expression vocabulary, semantic blendshapes provide a low-dimensional and interpretable animation interface and support cross-identity retargeting. Building such blendshape sets remains expensive because (i) expression-consistent supervision is scarce, (ii) generated 4D assets typically lack correspondence, and (iii) facial motion is highly localized. We propose (1) a large-scale dataset of non-humanoid identities paired with a shared expression vocabulary, obtained by expanding a small artist-rigged library via fine-tuned image editing; (2) a dense stochastic anchor motion representation tailored to localized facial deformations; and (3) a fast feed-forward registration model that converts unregistered expression meshes into a corresponded blendshape basis by predicting anchor-based deformations from the neutral shape. Experiments show that our approach produces higher-fidelity expression meshes than baselines, while running orders of magnitude faster than optimization. We further demonstrate real-time retargeting from human face tracking signals to non-humanoid characters, capturing both head pose and localized facial motions. Our project page is available at https://snap-research.github.io/RegHead/.

[25] Beyond Perfect Priors: Adaptive Gaussian Graph for 4D Driving Reconstruction in the Wild cs.CVPDF

Xiaoyun Dong, Qian Xu, Yun Wang, Yang Lu, Jen-Ming Wu

TL;DR: 本文提出了一种名为自适应高斯图（AGG）的自校正4D框架，用于在野外（如互联网和AI生成视频）中鲁棒地重建4D驾驶场景。该方法通过语义引导的Tick-Tock策略和自适应拓扑演化模块，解决了现有高斯场景图方法在噪声先验下存在的优化模糊和拓扑失败问题，并在KITTI和新建的Wild-30基准测试上验证了其优越性。

Details

Motivation: 现有高斯场景图方法严重依赖精确的先验信息（如准确的相机位姿和激光雷达深度），当使用从野外视频估计的噪声先验初始化时，会出现优化模糊和拓扑失败，导致严重的渲染伪影。本文旨在实现鲁棒的野外4D驾驶场景重建。

Result: 在KITTI和新建的挑战性基准Wild-30上的大量实验表明，AGG在视觉保真度和噪声先验下的鲁棒性方面持续优于最先进的方法。

Insight: 创新点包括：1）利用2D基础特征的语义引导Tick-Tock策略，显式解耦静态背景/相机位姿更新与动态智能体学习；2）自适应拓扑演化模块，通过生成缺失智能体、重新分配误分类高斯和剪枝误报来主动校正图结构；3）引入了Wild-30基准以严格评估野外场景重建。

Abstract: Reconstructing 4D driving scenes in the wild (e.g., internet and AI-generated videos) is critical for diverse autonomous driving simulation. While recent Gaussian Scene Graph (GSG) methods achieve impressive visual quality, they heavily rely on precise priors, such as accurate camera poses and LiDAR depth, or manual annotations. When initialized with noisy priors estimated from in-the-wild videos, existing GSG methods suffer from optimization ambiguity (e.g., entangling camera and agent poses) and topological failures (e.g., missing objects), causing severe rendering artifacts. To enable robust in-the-wild reconstruction, we introduce Adaptive Gaussian Graph (AGG), a self-correcting 4D framework. Our Semantically-Guided Tick-Tock Strategy leverages 2D foundation features to explicitly decouple static background and camera pose updates from dynamic agent learning. Concurrently, our Adaptive Topology Evolution module actively rectifies graph structures by spawning missing agents, reassigning misclassified Gaussians, and pruning false positives. To rigorously evaluate this in-the-wild setting, we introduce Wild-30, a challenging benchmark of internet and generative videos. Extensive experiments on KITTI and Wild-30 validate that AGG consistently outperforms state-of-the-art approaches in visual fidelity and robustness under noisy priors.

[26] The GEST-Engine: From Event Graphs to Synthetic Video. A Full Technical Report cs.CVPDF

Nicolae Cudlenco, Mihai Masala, Marius Leordeanu

TL;DR: GEST-Engine是一个从自然语言文本生成带完整标注的多角色视频的完整系统。其核心是一个显式的世界模型，即一个形式化的时空事件图（GEST），系统在商业游戏引擎中确定性地执行该图，并自动生成RGB视频、深度图、实例分割、骨骼姿态等多种对齐的标注数据。

Details

Motivation: 解决从文本生成高质量、多角色、时序一致的合成视频数据的问题，旨在为视频理解任务提供零边际标注成本的训练数据、评估基准和诊断工具。

Result: 系统在单次模拟中即可生成帧对齐的RGB视频、密集深度图、实例分割、骨骼姿态、空间关系图、2D边界框等多种模态的标注数据，所有输出均具有对象恒常性、多角色协调性和时序一致性。

Insight: 创新点在于采用显式的、可检查的时空事件图（GEST）作为世界模型，并通过确定性的游戏引擎执行来保证生成视频的语义一致性和物理合理性；同时，结合LLM进行故事规划与程序化状态验证，确保了生成规范的可执行性。

Abstract: We present the GEST-Engine, a complete system that goes from natural-language text to fully-annotated multi-actor video. At its core is an explicit world model: rather than encoding state as a learned latent, the engine maintains a complete, inspectable representation of the world (which actors exist, where they are, what they are doing, which objects they hold, and how events relate in time and space), expressed as a formal Graph of Events in Space and Time (GEST) and realized deterministically inside the open world of a commercial game engine driven through an open-source multiplayer scripting framework. GESTs are produced either procedurally or by an agentic text-to-GEST system in which an LLM Director plans a story through tool calls validated by a programmatic state backend, so every generated specification is executable by construction. A GEST then enters a four-stage execution pipeline: graph parsing and validation, entity and action grounding, temporal orchestration (Allen-style constraints resolved by Floyd-Warshall transitive closure), and execution and capture. In a single simulation pass the engine emits frame-aligned RGB video, dense per-pixel depth, instance segmentation, per-actor skeletal pose, per-frame pairwise spatial-relation graphs, 2D bounding boxes, event-to-frame temporal mappings, and natural-language descriptions, all at zero marginal annotation cost. We further describe an in-game world editor, runtime capability extraction, a text-generation pipeline, and a production system that renders corpora at scale across parallel virtual machines. Because every frame traces back to a semantic specification, the engine guarantees object permanence, multi-actor coordination, and temporal consistency by construction, making its output valuable as training data, evaluation benchmarks, and diagnostic tools for video understanding.

[27] Auditing Data Leakage in Whole-Slide Image Multimodal Benchmarks cs.CV | cs.LGPDF

Wenhao Zhang, Zhongliang Zhou, John Kang, Sheng Li

TL;DR: 该论文审计了全切片图像多模态基准测试中的数据泄露问题，发现患者层面和机构层面的数据泄露严重影响了当前视觉语言模型在病理学视觉问答任务中零样本性能评估的有效性。

Details

Motivation: 针对计算病理学中视觉语言模型在全切片图像视觉问答基准测试中报告的惊人零样本性能，论文旨在审计这些声称是否因数据泄露而受到根本性损害。

Result: 研究发现，在TCGA衍生的基准测试中，病例级别的训练-测试重叠率达到92.3%~100%，且组织来源站点重叠几乎完全；泄露案例与审计清洁案例之间存在可测量的准确率差距，且已发表模型的峰值报告准确率集中在污染最严重的基准上。

Insight: 论文的创新点在于系统性地识别和量化了多模态基准测试中两个层次的数据泄露问题，并证明这些泄露特征可从基础模型特征空间中线性解码；其提出的无污染评估建议（包括基准构建、来源披露和自动重叠审计）为未来研究提供了可验证进展的指导框架。

Abstract: Recent vision-language models (VLMs) for computational pathology report striking zero-shot performance on whole-slide image (WSI) visual question answering (VQA) benchmarks. We audit these claims and find them fundamentally compromised by data leakage at two hierarchical levels: patient-level leakage, where slides from the same case appear in both training and test folds, and institutional-level leakage, where different cases nonetheless share staining-batch and scanner signatures through a common Tissue Source Site (TSS). By tracing canonical slide, case, and TSS identifiers across major public resources, we document case level train test overlaps of 92.3~100% on TCGA-derived benchmarks, together with near-complete TSS overlap. We further demonstrate that both leakage levels are linearly decodable from foundation-model feature space, that they induce a measurable accuracy gap between leaked and audit-clean cases on a published checkpoint, and that across multiple published WSI VLMs, peak reported accuracies concentrate on the most heavily contaminated benchmarks. Therefore, the current WSI VQA evaluation cannot distinguish genuine multimodal reasoning from nearest-neighbor retrieval over memorized institutional and patient-specific artifacts. Finally, we outline concrete recommendations for contamination-free evaluation. By addressing benchmark construction, provenance disclosure, and automated overlap auditing, we aim to guide future research toward verifiable claims of progress.

[28] Rough Path Signature-Guided Geometry Augmentation for Few-Shot Industrial Surface Defect Detection cs.CV | cs.LG | math.PRPDF

Jiaqi Kuang

TL;DR: 本文提出了一种名为粗糙路径签名引导的几何增强（RPS-GA）方法，用于解决少样本工业表面缺陷检测中边界主导型缺陷检测性能差的问题。该方法将Canny边缘轮廓视为有序平面路径，通过计算其二阶签名响应（特别是反对称Lévy面积项）并聚合成空间图，再通过SIG-AUG和SGAA两种融合算子增强边界相关结构，从而在无需元学习或修改检测器的情况下提升少样本检测性能。

Details

Motivation: 标准监督检测器在边界主导的工业缺陷上表现不佳，尤其是在少样本场景下，因此需要一种几何感知的方法来增强边界结构信息以提升检测性能。

Result: 在NEU-DET和PCB-Defect数据集上，使用YOLOv8n检测器进行少样本评估（每类5、10、20或50张标注图像）。在10-shot设置下，SIG-AUG将NEU-DET的mAP@0.5从0.341提升至0.583；SGAA将PCB-Defect的mAP@0.5从0.086提升至0.299，并在5-shot下实现可用检测（基线完全失败）。随着标注数据增加，增益逐渐缩小。

Insight: 创新点在于利用二阶路径签名（特别是Lévy面积项）的几何信息来增强边界结构，通过简单的数据增强方式显著提升少样本工业缺陷检测性能，避免了复杂的元学习或检测器重新设计，为少样本视觉任务提供了一种实用的几何增强思路。

Abstract: Few-shot industrial defect detection remains difficult for standard supervised detectors, which achieve poor performance on boundary-dominated industrial defects. This paper proposes rough path signature-guided geometry augmentation (RPS-GA), a geometry-aware approach in which Canny edge contours are treated as ordered planar paths whose truncated second-order signature responses, especially the antisymmetric Lévy-area term, are aggregated into a spatial map that highlights boundary-related structure through two fusion operators, SIG-AUG and SGAA. The approach is evaluated on NEU-DET and PCB-Defect under a few-shot protocol with 5, 10, 20, or 50 labeled images per class, using an unmodified YOLOv8n detector throughout. Compared with the baseline, RPS-GA delivers large gains when supervision is limited, although the margin shrinks as more labels become available. On NEU-DET, SIG-AUG raises 10-shot mAP@0.5 from 0.341 to 0.583, whereas on PCB-Defect, SGAA improves 10-shot mAP@0.5 from 0.086 to 0.299 and yields usable detection at 5-shot where the baseline fails entirely. These trends are confirmed by multi-seed evaluation across independent random partitions. Overall, the results indicate that second-order path-signature geometry offers a practical way to strengthen few-shot industrial defect detection without meta-learning or detector redesign.

[29] Semantic-Edge Response Decoding of SAM3 for Zero-Shot Crack Segmentation cs.CVPDF

Shipeng Liu, Zhanping Song, Liang Zhao, Dengfeng Chen

TL;DR: 本文提出了一种名为语义边缘响应解码（SERD）的方法，用于改进SAM3模型在零样本裂缝分割任务中的性能。该方法通过解码SAM3解码器内部的语言条件化语义响应，将其视为密集的裂缝似然场，并结合轻量级边缘先验进行校准，最终使用统一的全局阈值生成裂缝掩码，无需标注或微调。

Details

Motivation: 现有高性能裂缝分割方法通常需要特定任务的像素级标注和训练，而像SAM3这样的文本可提示视觉基础模型虽然支持零样本部署，但其最终生成的掩码对于细长、破碎、低对比度的裂缝效果不佳，证据在掩码生成过程中易被抑制、截断或过度扩展。

Result: 在六个公共数据集上的实验表明，SERD方法持续优于原生SAM3，并超越了其他对比的零样本和开放词汇分割方法，平均裂缝IoU达到61.14%，比SAM3高出4.63个百分点，达到了SOTA水平。

Insight: 核心创新点在于发现并利用了SAM3解码器内部的语言条件化语义响应比其最终掩码保留了更连续、完整的裂缝证据，并提出了一个轻量级的解码与校准流程。这为处理细长、非紧凑目标提供了一种比基础模型最终掩码更具可迁移性的新接口。

Abstract: Crack segmentation is essential for infrastructure inspection and structural health assessment, but existing high-performance methods typically require task-specific pixel-level annotations and training. Text-promptable vision foundation models enable zero-shot deployment, yet their final mask proposals are poorly suited to thin, fragmented, and low-contrast cracks, whose evidence may be suppressed, truncated, or over-expanded during mask generation. We find that language-conditioned semantic responses within the SAM3 decoder preserve more continuous and complete crack evidence than its final masks. Based on this observation, we propose Semantic-Edge Response Decoding (SERD), which interprets internal responses as a dense crack-likelihood field, calibrates them with a lightweight edge prior, and generates crack masks using a unified global threshold, without annotation or fine-tuning. Experiments on six public datasets show that SERD consistently improves over native SAM3 and outperforms the compared zero-shot and open-vocabulary segmentation methods, achieving an average Crack IoU of 61.14%, 4.63 points higher than SAM3. Further analyses show that most gains arise from directly decoding internal semantic responses, while edge calibration improves structural recovery and false-positive control without increasing end-to-end inference overhead. These results suggest that, for thin and non-compact targets, internal continuous responses can provide a more transferable interface than the final masks of foundation models. Code is available at: https://github.com/xauat-liushipeng/SERD

[30] MobileSAM2: Lightweight Segment Anything for Spatial Intelligence cs.CVPDF

Kai Jiang, Jiaxing Huang, Jingyi Zhang, Weiying Xie, Yunsong Li

TL;DR: 本文提出了MobileSAM2，一种轻量化的SAM2模型，旨在使图像和视频分割任务能够在移动设备等资源受限环境中运行。通过引入超图知识蒸馏方法（HyperKD），包括时序超图蒸馏和粒度超图蒸馏，有效提取并迁移SAM2的通用时序知识和多粒度知识到轻量学生模型中。

Details

Motivation: SAM2作为强大的视频基础模型，虽能处理图像和视频分割，但其计算资源需求高，难以在手机和笔记本电脑等资源受限设备上部署，因此需要开发轻量化版本以实现移动端应用。

Result: 在多个基准测试上的广泛实验验证了MobileSAM2的有效性，并在具身AI任务上展示了良好的泛化性能，表明其能在保持性能的同时实现模型轻量化。

Insight: 创新点在于将超图概念引入知识蒸馏（HyperKD），通过构建超图显式建模SAM2的时序和粒度知识，并以此蒸馏到轻量模型；同时，MobileSAM2通过架构搜索在模型压缩过程中平衡效率与效果，为移动端分割任务提供了新思路。

Abstract: The recent large video foundation model, SAM2, enables segment anything in both images and videos, serving as a powerful base model for various applications. However, many of such use cases require to operate on resource-constrained devices like mobile phones and laptops. In this work, we aim to make SAM2 more mobile-friendly by distilling the heavyweight SAM2 into a lightweight model, facilitating segment anything in both images and videos on mobile devices. To this end, we propose Hypergraphical Knowledge Distill (HyperKD), which introduces the idea of hypergraph into knowledge distillation, aiming to effectively model and transfer SAM2’s generalizable and comprehensive knowledge. HyperKD consists of Temporal HyperKD and Granularity HyperKD that construct hypergraphs to explicitly model and extract the generalizable temporal knowledge and the comprehensive multi-granularity knowledge from SAM2 respectively, which are then distilled into the lightweight student model by aligning it with the constructed hypergraphs. Besides, we present MobileSAM2, a new family of lightweight SAM2 that balances efficiency and effectiveness via searching the best model architectures with HyperKD during model size reduction. Extensive experiments validate MobileSAM2 across multiple benchmarks and show promising generalization performance on embodied AI tasks.

Md Mahfuzur Rahman, Pengzhan Zhou, A F M Abdun Noor, Md Imam Ahasan, Kah Ong Michael Goh

TL;DR: 本文提出了一种名为ADAPT的多模态框架，用于预测行人过街意图。该框架通过五个专门模块，联合建模局部与全局视觉上下文以及时序运动动态，并采用稀疏跨模态注意力机制来选择性保留最有信息的模态间交互，从而在保持低计算复杂度的同时，实现了对现有方法的超越。

Details

Motivation: 现有方法通常依赖单模态输入或密集的多模态融合策略，未能充分捕捉互补的视觉与运动学信息，同时引入了冗余的模态间交互。本文旨在解决这一问题，以提升自动驾驶中这一安全关键任务的预测性能。

Result: 在JAAD和PIE基准数据集上的大量实验表明，ADAPT持续优于现有的最先进方法。具体而言，在JAAD数据集上，其在JAADbeh和JAADall子集上的AUC分别达到0.73和0.85；在PIE数据集上，其准确率达到0.92，AUC达到0.90。此外，ADAPT的推理速度仅为每样本17.23毫秒。

Insight: 主要创新点在于提出了一个包含稀疏跨模态注意力模块的多模态融合框架，该模块能自适应地选择性地融合信息，有效减少了冗余交互。同时，结合了基于Mamba的运动特征编码模块进行高效的时序建模，以及基于Vision Transformer的时序特征融合模块，在精度与实时效率之间取得了良好平衡。

Abstract: Predicting pedestrian crossing intention is a safety-critical task for autonomous driving, yet existing approaches often rely on single-modal inputs or dense multimodal fusion strategies that inadequately capture complementary visual and kinematic information while introducing redundant inter-modal interactions. We propose ADAPT (Adaptive Domain-Aware Pedestrian Crossing Transformer), a multimodal framework that jointly models local and global visual context together with temporal motion dynamics for accurate pedestrian crossing intention prediction. ADAPT processes four spatially aligned visual modalities, including RGB images, local depth maps, global semantic maps, and global depth maps, together with ego-vehicle speed, pedestrian bounding boxes, and skeleton pose information through five specialized modules: a weight-shared Swin Transformer V2 backbone for visual feature extraction, a Cross-Modality Guided Attention module for hierarchical visual fusion, a Mamba-based Motion Feature Encoding module for efficient temporal modeling, a Sparse Cross-Modal Attention module that selectively preserves the most informative inter-modal interactions, and a Vision Transformer-based Temporal Feature Fusion module for sequence-level prediction. Extensive experiments on the JAAD and PIE benchmark datasets demonstrate that ADAPT consistently outperforms existing state-of-the-art methods while maintaining low computational complexity. On JAAD, the proposed method achieves an AUC of 0.73 on JAADbeh and 0.85 on JAADall, while on PIE it achieves an accuracy of 0.92 and an AUC of 0.90. Furthermore, ADAPT performs inference in only 17.23 ms per sample, offering an effective balance between predictive accuracy and real-time deployment efficiency for intelligent transportation and autonomous driving applications.

[32] DM-KG: A Novel Method for Boosting Spatial Cognition of Vision-Language Models in Street View Imagery cs.CVPDF

Xinyue Xu, Zheng Zhang, Kunyang Ma, Ge Zhu, Lianshuai Cao

TL;DR: 本文提出了一种名为DM-KG（方向-度量知识图谱）的新方法，旨在提升视觉语言模型（VLMs）在街景图像中的空间认知能力。该方法通过从单张2D图像中显式提取实体间的方向和度量关系，构建结构化的知识图谱，并将其作为几何先验注入VLM，以指导空间推理。实验表明，该方法能显著减少距离和方向判断的误差，并保持较高的问答成功率。

Details

Motivation: 现有视觉语言模型在处理真实街景场景中物体的位置、距离和方向时，经常出现’空间语义幻觉’错误，且这些错误难以追踪和校准，这成为其在空间任务中实际部署的关键瓶颈。

Result: 在公开的空间问答基准测试上，DM-KG将距离估计的平均绝对误差降低了31.1%，将方向判断的平均角度误差降低了65.8%，同时保持了较高的问答成功率。

Insight: 创新点在于将全景分割与度量深度估计相结合，稳健地计算实体级3D空间坐标，并将实体对的方位角和欧氏距离编码为JSON格式的知识图谱，作为显式的结构化几何先验注入VLM，从而提供了一个灵活、通用且可解释的地理视觉问答框架。

Abstract: As vision-language models (VLMs) are increasingly deployed in geospatial question answering and visual scene understanding, improving their spatial cognition capability on street view imagery for complex logical reasoning has emerged as a key research priority. However, existing VLMs frequently suffer from “spatial semantic hallucinations” when perceiving object locations, distances, and directions in real-world street view scenes. Furthermore, such errors are often recalcitrant to tracing and calibration, posing a critical bottleneck for their practical deployment in geospatial tasks. To address this pressing challenge, this study proposes DM-KG (Direction-Metric Knowledge Graph), a structurally grounded spatial representation framework for street view imagery. By explicitly extracting directional and metric relationships between entities from a single 2D image, this framework enhances the spatial reasoning accuracy of VLMs through a structured knowledge graph. Specifically, we integrate panoptic segmentation with metric depth estimation to robustly compute entity-level 3D spatial coordinates. Subsequently, we encode the clock azimuths and Euclidean distances of entity pairs into a JSON-formatted knowledge graph, which is injected into the VLM as an explicit geometric prior to guide spatial reasoning. Experimental results on public spatial question-answering (QA) benchmarks demonstrate that DM-KG reduces the mean absolute error (MAE) in distance estimation by 31.1% and the mean angular error in direction judgment by 65.8%, while simultaneously maintaining a high QA success rate. By establishing a complete, augmented reasoning pipeline, this research significantly improves the spatial cognitive capabilities of VLMs in street view scenarios, thereby providing a flexible, generalized, and interpretable framework for geographic visual question answering (GeoVQA) in open environments.

[33] ProtoPointNet: Prototype-Based Interpretable Classification of 3D Dental Point Clouds with Verifiable Spatial Activations cs.CVPDF

George V. Jose, Thao Liang Chiam, Toby Hughes, Dilan Patel, Alan Brook

TL;DR: 本文提出了ProtoPointNet，一种基于原型的可解释3D点云分类模型，用于牙科咬合分类。该方法通过结合局部表面几何、曲率以及上下颌间位移和间隙的14维描述符编码每个点，并利用多任务点云骨干网络学习特定轴向的原型头进行分类。在Bits2Bites数据集上取得了良好的性能，并通过原型激活定位提供了可验证的空间解释。

Details

Motivation: 解决基于原型的网络在3D点云和临床表面配对推理中应用有限的问题，为牙科咬合分类提供一种透明且可解释的替代方案，以替代黑盒3D分类器。

Result: 在Bits2Bites数据集上，ProtoPointNet实现了平均测试宏F1分数0.724和AUROC 0.825，其中在垂直分类（F1 0.828）和矢状左分类（F1 0.807）上表现最强。

Insight: 创新点包括：1) 为3D牙科点云设计了一个结合局部几何和明确颌间关系的描述符；2) 采用多任务架构学习特定轴向的原型头；3) 通过原型激活定位提供可验证的空间解释，增强了模型在临床决策中的可信度。

Abstract: Prototype-based networks provide inherently interpretable classification by linking predictions to learned exemplars, but their use in 3D point clouds and clinical surface-pair reasoning remains limited. We introduce ProtoPointNet, a prototype-based model for dental occlusion classification from registered upper–lower intraoral arch pairs. Each point is encoded by a 14-dimensional descriptor combining local surface geometry, curvature, and explicit inter-arch displacement and clearance, exposing occlusal relationships to prototype matching. A shared multi-task point-cloud backbone learns axis-specific prototype heads for sagittal-left, sagittal-right, vertical, transverse, and midline classification. To support limited clinical data, we train prototypes from scratch using auxiliary supervision and encoder-freeze hand-off. On Bits2Bites, ProtoPointNet achieves mean test macro-F1 of 0.724 and AUROC of 0.825, with strongest performance on vertical (F1 0.828) and sagittal-left classification (F1 0.807). Projected prototype activations localise to anatomically plausible regions, including posterior molars and premolars for cross-bite evidence and anterior incisors for bite-depth evidence. These results support prototype-based reasoning as a transparent, spatially grounded alternative to black-box 3D classifiers for dental surface-pair analysis.

[34] What Does a Temporal Benchmark Score Measure? Decomposing Channel Use in Video VLM Evaluation cs.CV | cs.LGPDF

Farrukh Rahman

TL;DR: 该论文指出，现有视频VLM在时序问答基准上的得分并不能准确衡量模型是否真正理解时序信息，因为它混淆了任务本身是否需要时序理解（任务问题）与模型是从像素中恢复时序还是从位置编码（如RoPE）中读取时序（通道问题）这两个方面。作者提出了一种无需标注的‘反转丢弃’测试方法，用于评估模型对视觉序列的依赖程度，并发现不同模型在时序理解上存在‘位置主导’与‘视觉序列主导’的差异，这影响了模型的鲁棒性和可互换性。

Details

Motivation: 当前视频VLM的时序基准评分存在混淆，无法区分模型是否真正从视觉内容中理解时序，还是仅仅依赖位置编码等非视觉线索，这削弱了评估的有效性，因此需要一种方法来分解并量化模型在时序理解中对不同‘通道’的依赖。

Result: 在多个时序基准和任务上的实验表明，MoLMo2模型主要依赖位置编码（位置主导），而Qwen3-VL模型则更依赖实际看到的视觉序列（视觉序列主导），这种差异通过激活修补被证实是模型的内在属性，而非测试冲突的假象。

Insight: 创新点在于提出了‘反转丢弃’这一无需标注的评估方法，能够有效区分模型在时序理解中对位置编码与视觉内容的依赖模式；客观来看，这揭示了聚合的基准得分可能掩盖模型潜在的不同失败模式，强调了在评估中分解‘通道’使用的重要性，对设计更可靠的VLM评估体系具有借鉴意义。

Abstract: A score on a temporal video question answering benchmark is meant to measure that a model has temporal understanding, but it conflates two questions. 1. The task question: is the question even temporal, does it need several frames and their order? and 2. The channel question, when it does, does the model recover the order from the pixels, or read it off the positional encoding (RoPE)? Most of a temporal score answers neither, a single frame and answer priors often carry it. The field’s validity checks, frame-shuffle sensitivity and the accuracy gained from the full video, speak only to the task question. We contribute a label-free screen for the channel question, the reversal-drop: the accuracy lost when the visual sequence is reversed while RoPE remains forward. It can be applied to compatible temporal benchmarks without new annotations. Paired reverse labels, or tasks whose labels transform deterministically under reversal, distinguish models that follow reversed content from those merely disrupted by the conflict. Molmo2 answers the forward event reading order off positions, while Qwen3-VL answers the reversed event it actually sees, reading visual order (comparatively). We call them position-dominant and visual-sequence-dominant. The split holds across two benchmarks and several temporal tasks at two scales, and activation patching shows it is a real internal property, not an artifact of the conflict. The distinction matters, the two channels fail on opposite inputs so two models with similar score are not interchangable, i.e. an aggregate score does not reflect potential failure modes.

[35] ACID: Adaptive Caching for vIDeo generation cs.CVPDF

Om Agrawal, Saurabh Agarwal, Aditya Akella

TL;DR: 本文提出了一种名为ACID的自适应缓存方法，用于加速视频扩散模型的推理过程。该方法通过动态调整缓存阈值，在关键步骤使用低阈值以保证质量，在其他步骤使用高阈值以提升速度，从而打破了传统固定阈值方法在速度与质量之间的权衡。

Details

Motivation: 视频扩散模型推理速度慢，现有基于缓存的加速方法（如TeaCache、EasyCache、DiCache）使用固定阈值，导致速度与视觉质量之间存在明显的权衡。本文旨在打破这种权衡，通过自适应阈值来同时提升推理速度和保持生成质量。

Result: 在三种缓存方法（TeaCache、EasyCache、DiCache）和三种开源视频扩散模型（HunyuanVideo、Wan 2.1、CogVideoX）上评估，ACID均扩展了视觉质量与推理速度的帕累托前沿。在TeaCache和HunyuanVideo上，ACID相比无缓存基线实现了最高2.16倍的加速，相比保守固定阈值基线实现了额外38%的加速，且质量下降可忽略不计（PSNR下降<0.3 dB，SSIM和LPIPS变化<0.01）。

Insight: 创新点在于识别了去噪过程中的关键步骤，并据此动态切换缓存阈值，这是一种轻量级、无需训练、模块化的包装器方法。它不依赖于特定信号，可直接集成到现有动态缓存方法中，无需修改其核心机制，从而在保持质量的同时显著提升推理效率。

Abstract: Video diffusion models produce high-quality generations but remain slow at inference due to their sequential denoising procedure. Caching-based acceleration methods address this by reusing intermediate model outputs: leading dynamic approaches such as TeaCache, EasyCache, and DiCache accumulate a drift signal and skip expensive model evaluations when accumulated drift stays below a fixed threshold τ. This threshold controls an apparent tradeoff - raising it yields faster generation at the cost of visual quality, while lowering it preserves quality but sacrifices speed. We show this tradeoff is not fundamental; it is an artifact of holding τ constant throughout denoising. We identify the existence of critical steps - timesteps where the drift signal changes rapidly - and show that applying a low threshold selectively at these steps while caching aggressively elsewhere recovers most of the quality of conservative caching at substantially higher inference speeds. Building on this insight, we propose ACID, a lightweight, training-free wrapper that monitors the rate of change of each method’s existing drift signal to dynamically switch between a low and a high threshold. ACID is signal-agnostic and modular: it requires no retraining and plugs directly into existing dynamic caching methods without modifying their core mechanisms. Evaluated across three caching methods (TeaCache, EasyCache, DiCache) and three open-source video diffusion models (HunyuanVideo, Wan 2.1, CogVideoX), ACID consistently expands the Pareto frontier of visual quality versus inference speed beyond what any fixed threshold achieves. In particular, on TeaCache and HunyuanVideo, ACID achieves up to 2.16x speedup over the no-caching baseline, and up to 38% additional speedup over the conservative fixed-threshold baseline with negligible (<0.3 dB PSNR, <0.01 SSIM, <0.01 LPIPS) quality degradation.

[36] Lost in Visual Translation: A VLM-Assisted Perceptual-Semantic Coherence Framework for EEG-to-Image Reconstruction cs.CV | cs.AIPDF

Sukriti Tiwari, BHVSP Subrahmanyam, Nidhi Goyal, Sai Amrit Patnaik

TL;DR: 这篇论文指出，现有的EEG到图像重建评估指标（如SSIM、LPIPS、CLIP）无法有效区分图像的视觉保真度和可恢复的语义一致性，因为它们会惩罚语义可恢复但模糊的输出，或奖励视觉合理但语义错误的输出。为此，作者提出了一个基于视觉语言模型（VLM）的感知-语义一致性评估框架，通过结构化提问生成容忍性感知对齐分数（T-PAS）和容忍性语义对齐分数（T-SAS），并最终蒸馏为紧凑的BCI一致性分数（BCS），以更准确地评估EEG重建图像的质量。

Details

Motivation: 现有EEG到图像重建的评估指标存在缺陷，它们混淆了感知（视觉）错误和语义错误，无法准确反映从脑电信号中恢复语义内容的能力，因此需要一种新的评估框架来区分这两者。

Result: 在包含6,855个真实图像/重建图像对的数据集上，提出的BCS评估器在T-PAS上达到了MAE 0.079（相关系数r=0.700），在T-SAS上达到了MAE 0.082（r=0.850）。人类验证显示其联合一致性判断高度可靠（Cohen’s kappa = 0.882 +/- 0.174, Krippendorff’s alpha = 0.882），支持了其优于通用视觉相似性指标的评估能力。

Insight: 核心创新在于利用多个VLM通过结构化提问来分别评估感知和语义对齐，并引入“容忍性”概念以适应EEG重建图像的固有模糊性，最终蒸馏出一个紧凑、可解释的评估分数（BCS），为脑机接口图像重建领域提供了一个更合理的评估基准。

Abstract: EEG-to-image evaluation should distinguish visual fidelity from recoverable meaning. Yet EEG-derived reconstructions are blurry, distorted, and low-detail, causing SSIM, LPIPS, and CLIP to penalize semantically recoverable outputs or reward plausible but incorrect ones. We analyze 6,855 ground-truth/reconstruction pairs from ATM, ENIGMA, BrainVis, and DreamDiffusion using semantic probes, caption harshness and blind-spot rates, and controlled degradations. Pixel metrics show near-zero correlation with semantic consistency, while representation metrics conflate perceptual and semantic errors. We therefore introduce a BCI-aware framework in which four VLMs assess image pairs through structured questions, producing Tolerant Perceptual Alignment Scores (T-PAS) and Tolerant Semantic Alignment Scores (T-SAS). Their consensus is distilled into the BCI-Coherence Score (BCS), a compact evaluator achieving a T-PAS MAE of 0.079 (r = 0.700) and a T-SAS MAE of 0.082 (r = 0.850) on our data. Human validation shows highly reliable joint coherence judgments, with Cohen’s kappa = 0.882 +/- 0.174 and Krippendorff’s alpha = 0.882, supporting perceptual-semantic recoverability over generic visual similarity. Code and resources are available at https://sukt03.github.io/BCS/.

Haitian Zhang, Thai Duy Nguyen, Xiangyuan Wang, Mohan Liu, Lin Wang

TL;DR: 本文首次提出了无监督多模态语义分割（UMSS）问题，旨在无需人工标注的情况下有效利用多模态数据的互补信息。作者提出了名为UniM2的新框架，其核心是通过跨模态对应协同学习一个统一的潜在空间来提取共享语义线索，并引入跨模态协调器以RGB为稳定参考来缓解模态间冲突。在NYU Depth v2和MFNet数据集上的实验表明，该方法相比现有框架在mIoU指标上分别提升了6.4%和9.8%。

Details

Motivation: 多模态语义分割在复杂环境中对鲁棒感知至关重要，但高昂的人工标注成本限制了其潜力。现有的无监督语义分割方法在扩展到多模态数据时，由于缺乏显式监督，难以协调不同传感器捕获的异构结构模式，导致融合退化，无法有效利用互补信息。

Result: 在NYU Depth v2和MFNet数据集上进行了广泛实验，UniM2框架分别将mIoU提升了6.4%和9.8%，显著优于现有的无监督多模态语义分割框架，展示了其明确优势。

Insight: 论文的主要创新点在于首次定义了UMSS问题，并提出了通过跨模态对应协同学习统一潜在空间来提取内在共享语义线索的方法，避免了依赖标签引导的自适应融合。此外，引入以RGB为稳定参考的跨模态协调器，有效抑制了不一致的关系监督，同时引导模型利用互补的结构特征，为解决模态间冲突提供了新思路。

Abstract: Multimodal semantic segmentation (MSS) is essential for robust perception in complex environments, yet its potential remains largely untapped because of the prohibitive cost of human annotations. While unsupervised semantic segmentation (USS) has achieved strong results on a single RGB modality, its naive extension to multimodal data is often hindered by fusion degradation. This occurs because, without explicit supervision, existing frameworks struggle to reconcile the heterogeneous structural patterns captured by different sensors and therefore fail to effectively exploit their complementary information. In this paper, we make the first attempt to address the novel problem of Unsupervised Multimodal Semantic Segmentation (UMSS), aiming to effectively exploit complementary sensor information in a fully label free setting. To this end, we propose UniM2 (Unified Multimodal), a novel framework built on DINOv3 that transforms conventional fusion methods into consistent performance gains. Our key idea is to learn a unified latent space driven by Cross Modal Correspondence Synergy (CMCS) to extract intrinsic shared semantic cues, bypassing the need for label guided adaptive fusion. To mitigate inherent intermodal conflicts, we introduce a Cross Modal Harmonizer (CMH) that designates RGB as a stable reference, effectively suppressing inconsistent relational supervision while guiding the model to exploit complementary structural features. Extensive experimental results on NYU Depth v2 and MFNet show that UniM2 improves mIoU by 6.4% and 9.8%, respectively, demonstrating clear advantages over existing frameworks for UMSS.

[38] IQA-T1: Tool-based Visual Evidence Reasoning for Image Quality Assessment cs.CV | cs.AI | eess.IVPDF

Jinjian Wu, Jiaqi Tang, Wei Wei, Yingying Yan, Jianmin Chen

TL;DR: 本文提出IQA-T1，一个基于工具的视觉证据推理框架，用于解决开放世界图像质量评估（IQA）中泛化性和可解释性不足的问题。该框架通过调用专用分析工具（如生成噪声残差图、梯度统计和频谱）生成结构化视觉证据，增强多模态大语言模型（MLLM）的推理能力，从而实现对低层次感知退化的敏感评估。

Details

Motivation: 现有基于MLLM的IQA方法依赖语义偏置的内部表示，对低层次感知退化不敏感，导致泛化性和可解释性受限。

Result: 在七个IQA基准测试上的广泛实验表明，IQA-T1实现了跨数据集的最佳整体性能，同时产生可解释且基于证据的质量评估。

Insight: 创新点在于将工具调用与MLLM推理结合，通过显式感知观察（如结构化视觉证据）增强模型对低层次图像退化的敏感性；构建的Q-Tool数据集（包含11k多模态推理链）支持了这种基于证据的推理范式。

Abstract: Image Quality Assessment (IQA) in open-world environments remains challenging due to limited generalization and interpretability. Recent approaches based on multimodal large language models (MLLMs) introduce textual reasoning for quality prediction, yet their judgments rely heavily on semantically biased internal representations, making them insensitive to low-level perceptual degradations. We propose IQA-T1, a tool-based visual evidence reasoning framework that augments MLLM reasoning with explicit perceptual observations. During inference, the model autonomously invokes specialized analysis tools to generate structured visual evidence, such as noise residual maps, gradient statistics, and frequency spectra, which are progressively integrated into the reasoning process. To support this paradigm, we construct Q-Tool, a dataset containing 11k multimodal reasoning chains grounded in tool-generated evidence. Extensive experiments on seven IQA benchmarks show that IQA-T1 achieves the best overall performance across datasets while producing interpretable and evidence-grounded quality assessments. Code and dataset are available at https://github.com/zibuyu-02/IQA-T1.

Yumiao Zhao, Bo Jiang, Min Lu, Xiao Wang, Jin Tang

TL;DR: 本文提出了一种名为MQAdapter的多模态量子适配器，用于视觉语言模型（VLM）的从粗到精的少样本微调。该方法首先检索与输入图像最相似的前K个候选类别作为语义锚点，然后利用跨模态量子学习机制，在量子希尔伯特空间中通过纠缠和叠加来精炼视觉特征，以提升模型在细粒度类别上的区分能力。

Details

Motivation: 现有的大规模视觉语言模型在少样本分类中，虽然在前K个候选类别上表现良好，但在视觉相似类别的细粒度区分上（即Top-1准确率）仍有不足。现有VLM适配器通常关注特征空间的全局对齐，未能利用语义相似的类别来优化细粒度视觉表示。

Result: 在15个数据集上的评估表明，MQAdapter在保持参数高效的同时，有效提升了性能。它可以与多种现有微调算法集成，以进一步获得性能增益。

Insight: 核心创新在于将视觉和文本特征编码为量子态，利用量子纠缠和叠加在高维希尔伯特空间中建模高阶跨模态交互，从而生成比传统欧几里得适配器更具区分性的表示。这是一种参数高效的、从粗到精的细粒度优化新范式。

Abstract: Large-scale Vision-Language Models have demonstrated impressive transfer learning capabilities across a wide range of tasks. For few-shot classification, we observe that VLMs exhibit a notable ability to filter candidate categories and thus achieve high Top-K accuracy. However, they often struggle with fine-grained discrimination among visually similar categories, resulting in unsatisfactory Top-1 performance, as shown in Figure 1. Existing studies on VLM adapters generally focus on global alignment between visual and textual representations in the feature space, but fail to exploit semantically similar categories to refine fine-grained visual representations. Based on these observations, we propose a novel coarse-to-fine VLM fine-tuning approach for few-shot learning that leverages quantum computation, termed the Multi-Modal Quantum Adapter (MQAdapter). Specifically, MQAdapter first retrieves the Top-K category candidates most similar to the input image and uses them as semantic anchors. It then employs a cross-modal quantum learning mechanism to refine visual features under the guidance of these anchors. The core of this mechanism is the encoding of visual and textual features into quantum states. By leveraging quantum entanglement and superposition in a high-dimensional Hilbert space, MQAdapter effectively models higher-order cross-modal interactions, producing more discriminative representations than traditional Euclidean adapters. MQAdapter is parameter-efficient and can be integrated with various existing fine-tuning algorithms to achieve further performance gains. Evaluations on 15 datasets demonstrate the effectiveness of MQAdapter while requiring fewer trainable parameters.

[40] Contrastive-Augmented Flow Matching for Style-Content Disentanglement cs.CVPDF

Yusong Li, Pingchuan Ma, Ming Gui, Vincent Tao Hu, Björn Ommer

TL;DR: 本文提出了一种名为对比增强流匹配（CAtFM）的框架，用于学习解耦的内容与风格表示。该方法将对比正则化集成到可逆的流匹配公式中，通过对训练期间预测的端点施加对比监督，促进语义一致性并实现隐式解耦。实验在CLIP、DINO和ALIGN等嵌入空间中进行，并在多个真实世界基准测试中验证了其在内容-风格检索、嵌入聚类分离和开放集鲁棒性方面的提升。

Details

Motivation: 解决基于扩散和流的生成模型在主要使用生成目标训练时，其学习到的内容与风格表示往往纠缠或错位的问题，以实现可控生成和组合泛化。

Result: 在合成数据、领域内风格以及ImageNet、WikiArt、DomainNet和DTD等真实世界基准测试中，CAtFM在内容与风格检索、嵌入聚类分离方面优于生成式和判别式基线，并展现出更强的开放集鲁棒性。

Insight: 创新点在于将判别式的对比监督与确定性的流匹配（确定性传输）过程简单耦合，通过约束预测端点而非中间隐变量或速度场，在无需假设严格纯净或完全因子化表示的前提下，隐式地促进解耦，从而提升了表示的分离性和分布偏移下的鲁棒性。

Abstract: Learning representations that separate content and style is crucial for controllable generation and compositional generalization. However, diffusion and flow-based models trained primarily with generative objectives often produce entangled or misaligned factors. To address this gap, we introduce Contrastive Augmented Flow Matching (CAtFM), a framework that integrates contrastive regularization into an invertible flow matching formulation to promote structured content-style representations. Rather than constraining intermediate latents or velocity fields, we apply contrastive supervision to predicted endpoints during training, enforcing semantic consistency across transported distributions while allowing disentanglement to emerge implicitly, without assuming strictly pure or fully factorized content and style representations. Our main experiments operate in the CLIP embedding space, with additional validation using frozen DINO and ALIGN encoders. Across synthetic data, in-domain styles, and real-world benchmarks (ImageNet, WikiArt, DomainNet, and DTD), CAtFM improves content and style retrieval, enhances embedding cluster separation, and achieves stronger open-set robustness compared to generative and discriminative baselines. Overall, CAtFM provides a simple way to couple discriminative constraints with deterministic transport, improving disentanglement and robustness under distribution shift.

[41] DeGuNet: Depth-Guided Ultra-Compact Backbones for Efficient LiDAR-Camera 3D Detection cs.CVPDF

Haifa Zhang, Yijing Wang, Peixi Peng, Zhiqiang Zuo

TL;DR: 本文提出了DeGuNet，一种专为深度引导表示学习设计的超紧凑、即插即用图像主干网络，用于解决LiDAR和相机融合的3D目标检测中，依赖大规模2D预训练视觉主干导致的参数冗余和结构错配问题。

Details

Motivation: 当前多模态3D检测框架过度依赖在2D语义任务上预训练的大规模视觉主干，这引入了显著的参数冗余，并且2D先验知识难以处理鸟瞰图几何所需的、极其稀疏的LiDAR投影，导致结构错配。

Result: 在nuScenes数据集上的大量实验表明，DeGuNet具有广泛的即插即用适用性和卓越的效率。将其集成到现有基线模型中，可消除架构冗余，GPU内存消耗降低高达66.5%，推理速度提升1.16倍，同时mAP绝对提升高达6.20，实现了参数高效的多模态3D感知新范式。

Insight: 论文宣称的创新点在于设计了专门用于深度引导表示学习的超紧凑图像主干，通过引入稀疏感知的特征提取机制，有效对齐多视角图像与非结构化的LiDAR深度信息，并严格防止无效区域污染。从客观角度看，其核心创新在于将主干网络设计从通用的2D语义任务转向针对3D感知中特定稀疏几何结构的任务，实现了模型效率与性能的双重提升。

Abstract: In autonomous driving perception, the fusion of LiDAR and camera modalities has become the dominant paradigm for 3D object detection. However, current multi-modal frameworks heavily rely on massive visual backbones pretrained on 2D semantic tasks. This reliance introduces substantial parameter redundancy and a structural misalignment, as 2D priors are ill-equipped to handle the extreme sparsity of LiDAR projections required for Bird’s-Eye-View geometry. To address this, we present DeGuNet, an ultra-compact and plug-and-play image backbone explicitly designed for depth-guided representation learning. By incorporating sparsity-aware feature extraction mechanisms, DeGuNet effectively aligns multi-view images with unstructured LiDAR depth while strictly preventing invalid-region contamination. Extensive experiments on the nuScenes dataset demonstrate DeGuNet’s broad plug-and-play applicability and superior efficiency. When integrated into established baselines, it fundamentally eliminates architectural redundancy, reducing GPU memory consumption by up to 66.5% and achieving a 1.16x inference speedup. Concurrently, DeGuNet delivers up to a 6.20 absolute mAP gain, establishing a new paradigm for parameter-efficient multi-modal 3D perception.

[42] More Than Where You Are: Learning Semantics, Structure, and Geometry from Cross-View Localization cs.CVPDF

Mao Chen, Xiangkai Zhang, Zhiyong Liu, Chuankai Liu, Xu Yang

TL;DR: 该论文提出CROSS框架，重新审视跨视角定位任务，不仅将其视为姿态估计问题，更强调其作为实现极端视角下一致场景理解（包括语义、结构和几何）的途径。CROSS通过3D锚定对齐、结构感知匹配和假设排序来解决现有方法的局限性。

Details

Motivation: 现有跨视角定位方法通常仅视为2D匹配或姿态估计，缺乏对极端视角下一致场景理解（如稳定语义、可靠结构和可迁移几何）的关注，存在缺乏显式3D锚定、依赖严格点对匹配削弱语义一致性、以及绝对目标函数对几何推理指导有限三个关键局限。

Result: 在KITTI和VIGOR数据集上的大量实验表明，CROSS在跨视角定位任务中达到了最先进的性能（SOTA）。

Insight: 创新点在于将跨视角定位重新定义为促进模型学习极端视角下稳定语义、可靠结构和可迁移几何的框架，并通过3D锚定对齐、结构感知匹配和假设排序的统一设计来实现，使结构学习成为内在要求，鼓励语义表示保持稳定，并学习可迁移的几何知识。

Abstract: Consistent cross-view understanding under extreme viewpoint changes is essential for spatial intelligence, as it enables models to recognize the same scene across extreme viewpoint gaps. Cross-view localization naturally provides a promising pathway toward this ability, as it requires a model to align ground-view imagery with geo-referenced satellite-view imagery despite drastic appearance changes to estimate camera poses. Recent visual foundation models have made this long-standing localization problem increasingly feasible by providing rich 2D representations for cross-view matching. However, we argue that cross-view localization should not be viewed merely as 2D matching or pose estimation. In this work, we revisit cross-view localization as more than pose estimation and investigate how it can help the model develop consistent cross-view understanding under extreme viewpoint changes, including stable semantics, reliable structure, and transferable geometry. We identify three key limitations of existing methods that prevent them from achieving this. They usually lack explicit 3D grounding, rely on strict point-wise matching that can weaken semantic consistency, and learn from an absolute objective that provides limited guidance for geometric reasoning. To address these limitations, we propose CROSS, a unified cross-view localization framework built upon 3D-grounded alignment, structure-aware matching, and hypothesis ranking. This formulation makes structure learning an intrinsic requirement, encourages semantic representations to remain stable, and enables the model to acquire transferable geometry. Extensive experiments on the KITTI and VIGOR datasets show that CROSS achieves state-of-the-art performance in cross-view localization. More importantly, CROSS effectively learns stable semantics, reliable structure, and transferable geometry across extremely different viewpoints.

[43] Let RGB Be the Language of Vision cs.CVPDF

Timing Yang, Jinrui Yang, Xinlong Li, Yuhan Wang, Haoran Li

TL;DR: 本文提出了一种统一的视觉模型范式RINO，将各种视觉信息（如掩码、深度图等）统一表示为RGB图像，并将视觉任务转化为RGB到RGB的图像编辑问题。该方法基于通用图像编辑骨干网络，无需任务特定微调，在密集理解与条件生成任务上实现了零样本性能。

Details

Motivation: 旨在解决视觉模型中不同视觉信息（如掩码、深度图）与任务形式各异的问题，通过统一表示为RGB图像，构建一个类似语言模型的通用视觉接口，以实现跨任务的模型迁移。

Result: 在分割、深度估计等密集理解任务以及姿态到图像生成等条件生成任务上，RINO展示了稳健且有竞争力的零样本性能，其输出或输入均被统一为RGB格式。

Insight: 核心创新在于将多样化的视觉信号统一编码为RGB图像，从而将各类视觉任务抽象为统一的RGB到RGB编辑问题，这为构建通用视觉-语言系统提供了新思路，即通过共享的视觉‘语言’来表达和解决任务。

Abstract: This work introduces a unified formulation for vision models, where diverse forms of visual information beyond natural images, such as masks, depth maps, and other structured visual signals, are all represented as RGB images, while general visual tasks can be converted into a common RGB-to-RGB image editing problem. In this paradigm, different types of visual information internally share the same encoding and decoding architecture and parameters as natural images, enabling a single model to transfer across tasks through a unified visual interface, in a way analogous to how language models operate over text. We refer to this formulation as RGB In and RGB Out (RINO). Built upon a generic image editing backbone without task-specific fine-tuning, RINO demonstrates robust and competitive zero-shot performance on both dense understanding tasks such as segmentation and depth estimation (where we unify outputs as RGB), and dense-conditioned generation tasks such as pose-to-image generation (where we unify inputs as RGB). We hope this study provides useful insights toward general unified vision-language systems, where diverse visual tasks can be expressed, interpreted, and solved through a shared visual language. Code is available at https://github.com/yangtiming/RINO.

[44] Steering Diffusion Models via Class-Contrastive Influence for Few-Shot Medical Classification cs.CV | cs.LGPDF

Jeeyung Kim, Erfan Esmaeili, Qiang Qiu

TL;DR: 本文提出了一种名为类对比影响力（C2I）的新准则，用于量化生成样本对下游分类任务的有用性，并基于此通过强化学习微调扩散模型，引导其生成对分类更具信息量的样本，从而提升少样本医学图像分类的性能。

Details

Motivation: 在标记数据稀缺的情况下，现有方法主要通过提高生成样本的真实性、多样性或领域适应性来改进合成数据，但忽视了如何衡量和优化样本对分类任务的有用性这一更根本的问题。

Result: 在多个少样本医学成像基准测试中，C2I引导的生成方法在准确性和鲁棒性上优于基于扩散模型的增强基线，表明以任务有用性为指导的合成增强比仅关注图像质量更有效。

Insight: 创新点在于提出了C2I这一基于梯度影响力的准则来评估样本的有用性，并发现高C2I样本通常是困难的、接近决策边界的例子，有助于细化决策边界；通过强化学习将C2I作为奖励来引导扩散模型生成，实现了任务导向的数据增强。

Abstract: When labeled data are scarce, off-the-shelf diffusion models can augment training sets for few-shot medical image classification, but not all generated samples are equally useful for the downstream task. Existing approaches largely improve synthetic data by increasing realism, diversity, or domain adaptation, while overlooking a more fundamental question: how should sample usefulness for classification be measured and optimized? We address this with Class-Contrastive Influence (C2I), a criterion that quantifies a sample’s usefulness through its gradient-based influence on the classifier. We find that effective samples exhibit a strong C2I gap: their loss gradients align with validation gradients from the same class and oppose those from other classes. Our analysis further suggests that such high-C2I samples are hard, boundary-proximal examples that help refine the decision boundary and improve robustness. Building on this insight, we fine-tune diffusion models with reinforcement learning using a C2I-based reward to steer generation toward class-informative samples. Across several few-shot medical imaging benchmarks, C2I-guided generation improves downstream accuracy and robustness over diffusion-based augmentation baselines, showing that synthetic augmentation is most effective when guided by task usefulness rather than image quality alone.

[45] TerraLogic: A Benchmark for Hierarchical Geospatial Reasoning in Earth Observation cs.CVPDF

Yuhang Yan, Linchao Mou, Bokang Yang, Qingyu Li

TL;DR: 该论文提出了TerraLogic，一个用于地球观测中层次化地理空间推理的基准测试，包含545个场景驱动的任务，并引入了HieraPlan工具增强代理来执行容错推理。

Details

Motivation: 现有遥感研究主要关注感知任务，而认知层面的地理空间推理尚未充分探索，因此需要建立一个专门的基准来推动该领域的发展。

Result: 实验表明，现有方法在层次化地理空间推理上表现不佳，而HieraPlan在推理、跨模态泛化和错误处理方面提供了强大的基线性能。

Insight: 创新点在于构建了首个专注于认知级地理空间分析的基准，并提出了一个将工具包组织成功能层次、支持容错和长时程规划的工具增强代理架构。

Abstract: Beyond perception, reasoning is essential in remote sensing for advanced interpretation, inference, and decision-making. Recent advances in large language models (LLMs) have enabled tool-augmented agents that leverage external tools to perform complex analytical tasks. However, existing studies in remote sensing primarily focus on perception-oriented tasks, leaving cognitive geospatial reasoning largely underexplored. To address this gap, we introduce TerraLogic, a benchmark for geospatial reasoning. TerraLogic comprises 545 scenario-driven, hierarchy-aware tasks, such as hazard vulnerability assessment, urban heat island analysis, and forest fragmentation dynamics, spanning optical, Synthetic Aperture Radar (SAR), and infrared (IR) imagery. It advances evaluation beyond recognition and monitoring toward cognitive-level geospatial analysis. To facilitate evaluation on TerraLogic, we further propose HieraPlan, a tool-augmented agent that organizes toolkits into functional hierarchies and performs fault-tolerant reasoning. HieraPlan enables structured abstraction, robust recovery from tool failures, and stable long-horizon planning. Extensive experiments demonstrate that current approaches struggle with hierarchical geospatial reasoning, while HieraPlan provides a strong baseline with improved reasoning, cross-modal generalization, and error handling. The dataset and agent code are publicly available at https://github.com/Ireliya/TerraLogic.

[46] Self in Space: Benchmarking Self-Awareness and Spatial Cognition in UAV Embodied Intelligence cs.CVPDF

Zhishan Zou, Guoyan Sun, Zhiwei Wei, Jiancheng Pan, Yujie Li

TL;DR: 本文提出了SIS-Bench，一个用于评估无人机（UAV）具身空间智能的新基准。该基准以‘空间中自我’的统一框架，从空间和自我两个维度，以及感知、记忆和推理三个认知层次，对多模态大语言模型（MLLMs）进行评估。研究发现现有MLLMs在动态和以智能体为中心的建模上存在局限，并探索了融合运动信息的表征方法以提升性能。

Details

Motivation: 现有面向无人机的评估方法和基准主要关注环境空间理解，而智能体的自我意识是隐含的。为了填补这一空白，需要建立一个统一的基准来评估具身空间智能，同时涵盖空间认知和自我意识。

Result: 在包含4,856个问答对的SIS-Bench上进行的广泛评估表明，当前MLLMs在建模动态和以智能体为中心的过程方面存在根本性限制，表现为空间认知与自我意识之间的明显不平衡，以及跨认知层次的性能逐步下降。实验结果表明，通过光流和视觉特征融合来建模智能体运动的方法，能持续提升感知和记忆性能，并泛化到下游无人机决策任务。

Insight: 论文的创新点在于提出了首个统一评估无人机具身空间智能中‘空间认知’和‘自我意识’的基准SIS-Bench。一个关键的客观见解是，将智能体自身的运动动态（通过光流等）显式地纳入表征学习，是提升其在复杂具身场景中空间智能和自我意识性能的有效途径。

Abstract: Autonomous UAV systems increasingly rely on multimodal large language models (MLLMs) to operate in complex real-world environments. Such embodied scenarios require not only understanding the surrounding space but also maintaining a coherent representation of the agent itself. However, existing UAV-oriented approaches and benchmarks remain largely environment-centric, primarily focusing on spatial understanding tasks, with the agent’s self-awareness remaining implicit. To address this gap, we introduce SIS-Bench, a benchmark for evaluating embodied spatial intelligence in UAV scenarios under a unified self-in-space formulation. SIS-Bench organizes evaluation along two complementary dimensions, space and self, and a three-level hierarchy of perception, memory, and reasoning. It contains 4,856 question–answer pairs across 13 tasks derived from 1,646 real-world UAV videos through a task-conditioned construction pipeline with expert verification. Extensive evaluations reveal that current MLLMs exhibit fundamental limitations in modeling dynamic and agent-centered processes. In particular, we observe a clear imbalance between spatial cognition and self-awareness, as well as a progressive performance degradation across cognitive levels. Motivated by these findings, we further explore a motion-aware representation that incorporates self-related dynamics through optical flow and visual feature fusion. Experimental results show that modeling agent motion consistently improves perception and memory performance, not only in spatial cognition but also in self-awareness, and generalizes to downstream UAV decision-making tasks. Our results highlight the importance of self-awareness for advancing embodied spatial intelligence, and provide both a new benchmark and empirical evidence for motion-aware self-in-space modeling.

[47] DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMs cs.CVPDF

Rongxin Gao, Yuzhi Huang, Dongxuan Liu, Chu Li, Zhenye Wang

TL;DR: 本文提出了DynTrace，一种无需训练的多模态大语言模型（MLLM）框架，旨在解决MLLM在4D时空推理（结合3D空间结构和时间演化）中的动态物体证据跟踪问题。该框架包含两个互补组件：动态轨迹可视化（DTV）和动态追踪令牌（DT-Token），前者通过几何感知的视觉先验分离真实物体运动与相机运动，后者通过动态追踪图（DTG）持续跟踪物体级动态线索，从而为连贯的4D推理提供支撑。

Details

Motivation: 当前MLLM在静态场景理解和粗粒度4D任务上表现出色，但在连续动态场景感知方面存在明显不足，特别是难以跟踪动态物体证据以进行连贯的4D时空推理。这主要是由于依赖稀疏的帧级观测，导致连续动态线索碎片化，且无法区分真实物体运动与相机引起的表观运动。

Result: DynTrace在多个基准测试上取得了最先进（SOTA）的结果，包括Dyn-Bench、VLM4D和DSI-Bench，显著提升了开源MLLM的性能，验证了跟踪动态物体证据对于鲁棒4D时空推理的重要性。

Insight: 创新点在于提出了一个无需训练的双组件框架，将几何感知的视觉先验（DTV）与结构化时空追踪（DT-Token/DTG）相结合，以持续跟踪动态物体证据。这为MLLM提供了更连贯的动态场景理解能力，有效区分了真实运动与相机运动，是提升4D推理性能的关键方法。

Abstract: 4D spatio-temporal reasoning, jointly modeling 3D spatial structure and temporal evolution, is essential for understanding dynamic worlds and enabling embodied interaction. While current Multimodal Large Language Models (MLLMs) show strong capabilities in static scene understanding and coarse-grained 4D tasks, they still have notable limitations in continuous dynamic scene perception, especially in tracking dynamic object evidence for coherent 4D spatio-temporal reasoning. This shortcoming stems mainly from relying on sparse frame-level observations, fragmenting continuous dynamic cues and leaving models unable to disentangle genuine object dynamics from camera-induced apparent motion. Inspired by humans tracking dynamic cues while compensating for viewpoint changes, we propose DynTrace, a training-free framework for 4D spatio-temporal reasoning with two complementary components. Dynamic Trajectory Visualization (DTV) reprojects world-coordinate trajectories onto the image plane, providing geometry-informed visual priors that disentangle genuine object dynamics from camera-induced apparent motion. Meanwhile, the Dynamic Trace Token (DT-Token), organized into a Dynamic Trace Graph (DTG), tracks object-level dynamic cues, trace evolution, and key moments, maintaining continuous dynamic object evidence for coherent 4D reasoning. Together, these two components equip MLLMs with continuously tracked dynamic object evidence, grounded in geometry-informed visual priors and structured spatio-temporal traces. DynTrace consistently improves open-source MLLMs, achieving state-of-the-art results on Dyn-Bench, VLM4D, and DSI-Bench, validating the importance of tracking dynamic object evidence for robust 4D spatio-temporal reasoning.

[48] Gaussian Mixture Modeling for Event-Aware Visual Allocation in Long Video Understanding cs.CVPDF

Yifan Lu, Ziqi Zhang, Chunfeng Yuan, Jun Gao, Bing Li

TL;DR: 本文提出GMM-EVA方法，通过高斯混合模型对长视频进行事件级建模，并采用差异化视觉分配策略，为每个事件保留一个高分辨率关键帧以获取细节，同时使用低分辨率辅助关键帧维持时序上下文，从而在显著减少视觉令牌预算的同时提升长视频理解性能。

Details

Motivation: 解决大型视觉语言模型在长视频理解中因均匀采样导致的计算成本过高和信息丢失问题，以及现有关键帧选择方法将视频帧视为原子实体、忽略高级语义结构并引入冗余的局限性。

Result: 在多个长视频基准测试上的实验表明，该方法显著优于均匀采样，在使用仅约一半视觉令牌预算的情况下，达到了与基线选择方法相当的性能。

Insight: 创新点在于利用高斯混合模型对离散帧观测进行事件级结构建模，并实施差异化的分辨率分配策略；其训练无关、即插即用的设计使其能泛化至多种相关性度量和下游LVLM。

Abstract: Large Vision-Language Models (LVLMs) face significant challenges in long video understanding due to the excessive computational cost and information loss associated with uniform sampling. Existing keyframe selection methods often treat video frames as atomic entities and allocate visual budgets equally, thereby overlooking high-level semantic structures and introducing substantial redundancy. To address these limitations, we propose GMM-EVA (Gaussian Mixture Modeling for Event-Aware Visual Allocation), which leverages Gaussian Mixture Models to model event-level structure from discrete frame-wise observations. A differentiated allocation strategy is then applied to preserve one primary high-resolution keyframe per event for high-fidelity detail, while utilizing lower-resolution secondary keyframes to maintain temporal context and optimize token budgets. GMM-EVA is a training-free, plug-and-play framework that generalizes robustly across various relevance measures and downstream LVLMs. Extensive experiments on multiple long video benchmarks demonstrate that our method significantly outperforms uniform sampling. Notably, GMM-EVA achieves comparable performance to baseline selection methods while utilizing only approximately half of the visual token budget, highlighting its superior efficiency and effectiveness.

[49] WanToFight: Real-Time Generative Game Engine for Multi-Player Combat Interaction cs.CVPDF

Li Hu, Guangyuan Wang, Peng Zhang, Bang Zhang

TL;DR: WanToFight是一个生成式游戏引擎，能够根据键盘输入实时生成《拳皇’97》的双人对战游戏画面。它通过基于Wan-1.3B视频扩散Transformer的三个核心组件解决了多玩家控制、实时推理、复杂物理交互和对抗性游戏玩法等联合挑战，并在单张RTX 5090显卡上实现了30FPS的完整比赛实时生成。

Details

Motivation: 现有生成式游戏引擎主要针对单玩家第一人称或非实时合作场景，缺乏对多玩家控制、实时推理、复杂物理交互和对抗性游戏玩法的联合处理，WanToFight旨在填补这一空白。

Result: 该系统在单张NVIDIA RTX 5090显卡上以512x384分辨率实现了30FPS的实时生成，能够持续生成完整的比赛画面，据作者所知，这是首个同时实现上述所有功能的生成式游戏引擎。

Insight: 创新点包括：基于块因果注意力和滚动KV缓存的流式自回归生成器、视觉基础的玩家关联模块将键盘信号绑定到角色身份，以及采用单玩家到完整游戏课程训练的局部因果键盘注入门控模块；技术组合实现了多玩家实时对抗生成的突破。

Abstract: We present WanToFight, a generative game engine that simulates real-time, two-player The King of Fighters ‘97 (KOF~’97) gameplay from keyboard input. Prior generative game engines target either single-player first-person settings or non-real-time cooperative scenarios; multi-player control, real-time inference, complex physical interaction, and adversarial gameplay have not been jointly addressed. WanToFight closes this gap with three components built on the Wan-1.3B video diffusion transformer: a streaming autoregressive generator with block-causal attention and a rolling KV cache; a visually grounded Player Association module that binds each player’s keyboard signal to a character identity; and a gated, locally causal keyboard injection module trained with a single-player-to-full-gameplay curriculum. A four-step DMD-distilled student paired with a pruned VAE decoder sustains 30FPS at 512x384 on a single NVIDIA RTX 5090 over the duration of a complete match. To our knowledge, WanToFight is the first generative game engine to combine multi-player control, real-time inference, complex physical interaction, and adversarial gameplay in one system.

[50] Decouple and Reason: Anatomically Guided Two-Stage Voxel-Level Grounding of Free-Text Findings in 3D Chest CT cs.CVPDF

Kwang-Hyun Uhm, Inhwa Son, Sung-Jea Ko

TL;DR: 该论文提出了一种新颖的解耦框架，用于解决3D胸部CT中自由文本发现的体素级定位问题。该方法将任务分解为两个专门阶段：首先进行类别无关的病灶分割以提取候选子体积，然后通过增强的跨模态推理模块，结合解剖学先验知识，将这些子体积与自由文本医学发现进行对齐。

Details

Motivation: 现有端到端方法难以同时学习精确3D分割所需的局部特征表示和文本对齐所需的复杂语义理解，导致定位性能不佳。论文旨在克服这一根本限制，处理3D大体积的复杂空间结构和自由文本发现的异质性。

Result: 在ReXGroundingCT基准测试中，该方法在官方排行榜上取得了整体定位质量的最先进（SOTA）性能。

Insight: 核心创新点在于将检测与推理解耦的范式，以及推理模块中引入显式的解剖学指导（如相对空间坐标和肺叶先验）来解决局部区域的空间模糊性。这种结构分离允许模型专注于各自子任务，有效处理3D医学视觉定位的复杂性。

Abstract: Automatic voxel-level grounding of free-text findings in 3D chest Computed Tomography (CT) is critical for clinical interpretability. However, this task remains highly challenging due to the intricate spatial complexity of large 3D volumes and the heterogeneity of free-text findings. Existing end-to-end approaches often struggle to simultaneously learn the localized feature representations required for accurate 3D segmentation and the complex semantic understanding needed for text alignment, leading to suboptimal grounding performance. To overcome this fundamental limitation, we propose a novel decoupled framework that disentangles the problem into two specialized stages: (1) class-agnostic lesion segmentation and (2) text-volume reasoning. This structural separation allows the model to first extract candidate sub-volumes by localizing potential abnormalities. Subsequently, intensive cross-modal reasoning is performed to align these localized sub-volumes with free-text medical findings. To resolve the spatial ambiguities inherent in local regions, the reasoning module is augmented with explicit anatomical guidance, utilizing relative spatial coordinates and lung lobe priors. Evaluated on the ReXGroundingCT benchmark, our method achieves state-of-the-art performance in overall grounding quality on the official leaderboard. These results demonstrate that decoupling detection from reasoning is a highly effective paradigm for handling the complexity of 3D medical visual grounding. Our code is publicly available at https://github.com/khuhm/DAGG.

Yan Gong, Bohao Li, Bowen Du, Junchen Ye

TL;DR: 本文提出TextCAD，一种用于CAD平面图的全景符号检测的多模态框架，通过联合建模图形基元和文本标注来解决现有方法对文本信息利用不足的问题。

Details

Motivation: 现有CAD分析方法主要关注图形基元，未能充分利用文本标注的语义价值，即使少数考虑文本的方法也未能有效建模其复杂语法和层次语义，导致语义丢失和检测性能不佳。

Result: 在真实建筑设计数据集上的实验表明，TextCAD有效提升了符号检测性能，并取得了最先进的结果。

Insight: 创新点包括设计Type-Attribute Correlation Encoder来显式编码标注的组合语义，以及引入具有多级语义过滤和基元下采样的语义层次对齐框架，实现跨模态语义的精确注入与融合。

Abstract: Computer-Aided Design (CAD) floor plan drawings contain both graphical primitives and textual annotations, which provide complementary geometric and semantic cues for intelligent design understanding. Among CAD analysis tasks, panoptic symbol spotting has become increasingly important with the growing demand for industrial digitalization and deep learning-based automation. However, most existing methods remain primarily primitive-centric and underexploit textual annotations, despite their critical semantic value. Even the few text-aware approaches often treat annotations only superficially, without properly modeling complex syntax and hierarchical semantics of CAD annotations, which leads to semantic loss and suboptimal spotting performance. To address these limitations, we propose TextCAD, a multimodal framework that jointly models graphical primitives and textual annotations for panoptic symbol spotting. Specifically, we design a Type-Attribute Correlation Encoder (TACE) to explicitly encode the compositional semantics within annotations by jointly modeling their types and attributes. We further introduce a Semantic Hierarchy Alignment framework with Multi-level Semantic Filtering (MSF) and primitive downsampling, which adaptively aligns annotation semantics with graphical primitives at different semantic levels and enables accurate cross-modal semantic injection and fusion. Experiments on real-world building-design datasets show that TextCAD effectively improves symbol spotting performance and achieves state-of-the-art results.

[52] MAGE: Color-Invariant and Spatial Knowledge Distillation for Gastric Neoplasm Classification cs.CVPDF

Jiho Jun, Jeongwon Woo, Jaemin Song, Thanh Bong Nguyen, Dong-heon Yeon

TL;DR: 本文提出了一种名为MAGE的新型框架，用于胃镜图像中胃腺瘤和癌变的分类。该方法通过引入一个在掩蔽消色视图上训练的辅助局部专家分支，学习纯结构特征，并采用双目标蒸馏策略将分类逻辑和空间注意力图传递给主分支，以增强模型对形态特征的依赖，减少对颜色等虚假相关性的依赖。

Details

Motivation: 解决胃腺瘤与癌变分类中因类间相似性高、边界模糊以及现有方法易受检测/分割误差传播、缺乏空间焦点或依赖领域特定纹理偏差（如出血、光照伪影）而导致性能受限的问题。

Result: 在临床胃镜数据集上的大量实验表明，该方法显著优于基于检测（如YOLO）和基于分类（如Swin-Transformer）的现有方法，不仅提供了更优的分类性能，还生成了可解释的注意力图以增强临床可靠性。

Insight: 创新点包括通过掩蔽消色视图强制模型学习判别性结构特征，以及双目标蒸馏策略（结合分类逻辑和空间注意力图）来提供隐式空间监督，从而减少模型对捷径学习的依赖，提升分类的鲁棒性和可解释性。

Abstract: Accurate differentiation between gastric adenoma and carcinoma during endoscopy is critical for clinical decision-making. Yet, this task is highly challenging due to high inter-class similarity and ambiguous boundaries between the two classes. Existing ROI-based classification methods often suffer from detection/segmentation error propagation and loss of surrounding global context. In contrast, full-image classification lacks the necessary spatial focus. Furthermore, we observe that deep neural networks gravitate towards domain-specific texture biases(e.g. bleeding, lighting artifacts), often causing models to predict based on spurious correlations instead of intrinsic morphological features. To address these limitations, we propose a novel framework, Masked Achromatic Guidance Expert (MAGE). During training, we introduce an auxiliary local expert branch trained on masked achromatic views of the neoplasm. By suppressing background context and color, this branch is forced to learn highly discriminative, purely structural features. We then employ a dual-objective distillation strategy, transferring both classification logits and spatial attention maps to provide implicit spatial supervision to the main branch that receives full WLI as input. This dual-objective distillation forces the model to ground its predictions in morphology rather than relying on shortcuts, while still retaining clinically relevant color cues. At inference time, our deployable model operates on images without annotated masks, ensuring real-time deployability . Extensive experiments on a clinical gastric endoscopy dataset show that our method significantly outperforms existing detection-based methodologies (e.g. YOLO) and classification-based methodologies (e.g. Swin-Transformer), providing not only superior classification performance but also interpretable attention maps for clinical reliability.

[53] Towards Vision-Free CIR: Attribute-Augmented Scoring and LLM-Based Reranking for Zero-Shot Composed Image Retrieval cs.CV | cs.IRPDF

Ryotaro Shimada, Yu-Chieh Lin, Yuji Nozawa, Youyang Ng, Osamu Torii

TL;DR: 本文提出了一种无需视觉模型的组合图像检索框架，通过属性增强混合评分和基于大语言模型的重排序来解决文本化图像表示中的信息丢失问题。在CIRR数据集上，该方法在零样本设置下实现了44.04%的R@1召回率，优于现有方法8.79%。

Details

Motivation: 针对组合图像检索任务中文本化图像表示导致视觉信息丢失的问题，探索无需视觉模型的检索方法能否有效处理这一多模态任务。

Result: 在CIRR数据集上达到44.04%的R@1召回率，比现有零样本CIR方法提升8.79%；在FashionIQ数据集上揭示了语义推理与细粒度视觉匹配之间的权衡关系。

Insight: 通过属性增强匹配补偿视觉细节损失，结合LLM重排序验证语义一致性，为视觉无关的多模态检索提供了可扩展的解决方案。

Abstract: Recent work has shown that “Vision-Free’’ approaches (representing images as text) can be effective for standard image retrieval tasks. However, it remains unclear whether this paradigm can effectively handle a more complex, multimodal task, Composed Image Retrieval (CIR), due to the inherent information loss in textual descriptions. In this paper, we introduce a Vision-Free CIR framework that addresses this challenge through two key techniques: (1) Attribute-Augmented Hybrid Scoring, which compensates for lost visual details via explicit attribute matching, and (2) LLM-Based Reranking, which verifies semantic consistency of top candidates. Experiments on the open-domain CIRR dataset show that our approach outperforms existing Zero-shot CIR methods (44.04% R@1, +8.79%). On FashionIQ, our results highlight the trade-off between semantic reasoning and fine-grained visual matching. Ablation studies reveal that both attribute-augmented scoring and LLM-Based Reranking consistently improve performance.

Jiahang Wang, Yirong Yang, Yanqing Zhu, Minghua Luo, Shichao Xie

TL;DR: 本文提出ReflectVLN，一种用于视觉语言导航（VLN）的智能体框架，通过双向交互的意图代理和执行代理组织决策。该框架引入闭环机制来跟踪语义进展、诊断执行失败并从长视野导航的错误累积中恢复，并采用Action Chain-of-Thought训练方案提升决策的时序一致性和可解释性。

Details

Motivation: 现有视觉语言导航方法通常将视觉语言模型与路径点解码器耦合以生成多步动作计划，但缺乏显式的闭环机制来跟踪语义进展、诊断执行失败以及从长视野导航中的错误累积中恢复。

Result: 在标准VLN基准测试上的实验表明，ReflectVLN在有限数据预算下提高了成功率和路径效率，具有有利的训练成本，在推理时减少了高层意图调用，同时提供了可解释的中间决策用于分析和协作。

Insight: 创新点在于设计了双向交互的意图与执行代理架构，实现了闭环的双向通信；并提出了Action Chain-of-Thought这一路径条件化的双查询训练方案，用于生成具有可解释中间推理的动作链。

Abstract: Existing vision-language navigation methods often couple a VLM with waypoint decoders to produce multi-step action plans, but they typically lack an explicit closed-loop mechanism for tracking semantic progress, diagnosing execution failures, and recovering from error accumulation in long-horizon navigation. To address this gap, we propose ReflectVLN, an agentic VLN framework that organizes decision-making through bidirectionally interactive intention and execution agents. The intention agent performs subtask decomposition and reflection, generating executable subtask descriptions as corrective plans. Conditioned on these descriptions, the execution agent grounds them into short-horizon actions under current observations while monitoring sub-goal progress and detecting off-track behavior. Crucially, ReflectVLN enables closed-loop bidirectional communication: the execution agent emits progress and deviation signals to trigger reflection and subtask updates on demand, and the intention agent returns structured guidance that reconditions subsequent actions for recovery. To encourage temporally coherent decisions with interpretable intermediate rationales, we introduce Action Chain-of-Thought (Action-CoT), a path-conditioned dual-query training scheme for action generation. Experiments on standard VLN benchmarks show that ReflectVLN improves success rates and path efficiency under a constrained data budget, with favorable training cost and fewer high-level intention calls at inference time, while providing interpretable intermediate decisions for analysis and collaboration. Code is available at: https://github.com/AIprogrammer/ReflectVLN

[55] CRC-HGD: A Histopathological Image Dataset for Grading Colorectal Cancer cs.CVPDF

Elham Amjadi, Amin Bahreini, Sayed Mohammad Hasan Emami, Sayyed Mohammadreza Hakimian, Alireza Fahim

TL;DR: 本文介绍了CRC-HGD，一个用于结直肠癌分级的组织病理学图像数据集，包含从214名患者收集的1,914张H&E染色图像，分为三个分化等级（I、II、III级），并提供4x、10x、20x和40x四种放大倍数。该数据集旨在支持基于人工智能的自动癌症检测和分类研究。

Details

Motivation: 结直肠癌是全球常见且致命的癌症，准确的组织学分级对预后和治疗规划至关重要。为了实现基于人工智能的自动化分级，需要一个组织良好、标注清晰的数据集作为基础。

Result: 论文未在摘要中报告具体的模型性能或基准测试结果，主要贡献是发布了CRC-HGD数据集本身。

Insight: 该数据集的创新之处在于同时提供了所有三个分化等级（按WHO标准）的图像，并且每个样本包含四种不同的放大倍数，这为全面的计算分析（如多尺度特征学习）提供了独特资源，有助于推动结直肠癌自动分级模型的发展。

Abstract: Colorectal cancer (CRC) is the third most common cancer worldwide and the second leading cause of cancer-related deaths globally, with approximately 1,926,425 new cases and 904,019 deaths reported in 2022. Accurate histologic grading plays a critical role in prognosis and treatment planning for colorectal adenocarcinoma. In recent years, artificial intelligence and its subcategories, including machine learning and deep learning, have been increasingly employed for automated cancer detection and classification. An appropriate and well-organized dataset is the essential first step to achieve this goal. This paper introduces CRC-HGD, a histopathological microscopy image dataset of 1,914 images obtained from 214 colorectal adenocarcinoma patients (Grade I: 106, Grade II: 75, Grade III: 33). The specimens are H&E-stained colorectal tissue sections acquired at the Poursina Hakim Research Center of Isfahan University of Medical Sciences, Iran, diagnosed between 2014 and 2019, and graded according to the World Health Organization (WHO) criteria into three grades: well-differentiated (Grade I), moderately differentiated (Grade II), and poorly differentiated (Grade III). For each specimen, four magnification levels are provided: 4x, 10x, 20x, and 40x. The dataset is accessible via Mendeley Data (https://doi.org/10.17632/yfp5sfj47m.4) and at http://databiox.com, where the latest version is also available. The distinctive feature of this dataset is the provision of labeled specimens across all three differentiation grades at multiple magnification levels, enabling comprehensive computational analysis of colorectal cancer grading.

[56] MambaPSA: A Mamba-based Replacement for C2PSA in YOLO26 cs.CVPDF

Sheng-Wei Chan, Chia-Min Lin, Hsin-Jui Pan, Ching-Yu Tsai, Chih-Hsiang Yang

TL;DR: 本文提出MambaPSA，一种基于状态空间模型（SSM）Mamba的轻量级模块，用于替换YOLO26目标检测框架主干网络末端的C2PSA注意力块。同时，在颈部网络的P3、P4、P5层级额外插入双向视觉Mamba（BiViM）模块。实验表明，该方案在PASCAL VOC数据集上实现了参数、计算量的降低和推理速度的提升，同时保持了可比的检测精度。

Details

Motivation: 动机是利用具有线性计算复杂度的状态空间模型（如Mamba）作为自注意力机制的高效替代品，以提升无NMS的轻量级目标检测器（如YOLO26）的效率。

Result: 在PASCAL VOC 2007+2012数据集上的实验结果显示，MambaPSA减少了2.9%的参数和12.1%的FLOPs，CPU推理吞吐量提升了17.6%（从17 FPS到20 FPS），精度仅有微小下降（-0.1 mAP50:95）。在P4层级插入BiViM模块获得了最佳的精度提升（+0.9 mAP50:95）。

Insight: 创新点在于将Mamba SSM成功集成到无NMS检测框架中，具体设计了MambaPSA模块和BiViM模块。客观来看，这为在轻量级检测器中用SSM替换基于注意力的模块提供了一个有利的效率-精度权衡方案，证明了其可行性。

Abstract: State space models (SSMs), notably Mamba, have recently emerged as efficient alternatives to self-attention with linear computational complexity. We investigate the integration of Mamba into YOLO26, the latest non-maximum suppression (NMS)-free object detection framework, by proposing MambaPSA, a lightweight Mamba-based replacement for the C2PSA block at the end of the backbone. To complement this study, we additionally insert a bidirectional Vision Mamba (BiViM) module at the P3, P4, and P5 levels of the neck. Experiments on PASCAL VOC 2007+2012 show that MambaPSA reduces parameters by 2.9%, FLOPs by 12.1%, and improves CPU inference throughput by 17.6% (from 17 to 20 FPS) with negligible accuracy change (-0.1 mAP50:95), while the P4 BiViM placement yields the best accuracy gain (+0.9 mAP50:95). These results suggest that SSMs offer a favorable efficiency-accuracy trade-off when replacing attention-based blocks in NMS-free lightweight detectors.

Hongbo Wang, Huaibo Huang, Jie Cao, Jin Liu, Haoyang Tong

TL;DR: 本文提出了Hallo4D，一个模型无关的统一框架，用于缓解3D和4D内容生成中的时空幻觉问题。它采用生成-检测-校正范式，利用大型多模态语言模型（LMMs）从多视角和多帧渲染中识别并总结不一致性，并通过基于共识的图像空间一致性优化进行校正。

Details

Motivation: 现有3D生成方法依赖2D扩散监督，缺乏明确的几何一致性机制，导致空间幻觉（如结构重复、几何错位）。在4D生成中，保持跨视角和时间演化的一致性更具挑战性，会出现抖动、身份闪烁和结构漂移等问题。

Result: 广泛的实验表明，Hallo4D在多种3D和4D生成设置中持续优于强基线，为一致性感知的内容生成提供了可扩展和可泛化的解决方案。

Insight: 创新点在于提出了一个无需重新训练或修改架构的生成-检测-校正范式，利用LMMs进行不一致性检测与总结，并通过多模型投票的共识驱动优化进行校正。此外，引入了运动感知关键帧采样、LMM引导初始化和外观对齐等技术来提升时间一致性和优化效率。

Abstract: While recent advances in 3D generation have enabled impressive visual synthesis, existing methods often rely on 2D diffusion supervision without explicit mechanisms for geometric consistency, leading to spatial hallucinations such as duplicated structures and misaligned geometry. These issues become more severe in 4D generation, where maintaining consistency across viewpoints and temporal evolution introduces additional challenges, including jitter, identity flicker, and structural drift. We present \textbf{Hallo4D}, a unified and model-agnostic framework for mitigating spatiotemporal hallucinations in 3D and 4D content generation. Hallo4D introduces a generation-detection-correction paradigm that leverages large multimodal language models (LMMs) to identify and summarize spatial and temporal inconsistencies from multi-view and multi-frame renderings. These insights guide a consensus-driven image-space consistency optimization, where an LMM-based selector evaluates candidate corrections through multi-model voting, without requiring retraining or architectural modifications. To further improve temporal consistency and optimization efficiency, Hallo4D incorporates motion-aware keyframe sampling, LMM-guided initialization, and appearance alignment. We additionally introduce exposure-aware optimization and visibility pruning to enhance robustness under challenging viewpoints. Extensive experiments demonstrate that Hallo4D consistently outperforms strong baselines across diverse 3D and 4D generation settings, providing a scalable and generalizable solution for consistency-aware content generation.

[58] VisCo: Leveraging Large Language Models as Intrinsic Encoders for Visual Token Compression cs.CVPDF

Yupeng Zheng, Kai Zou, Bin Liu, Nenghai Yu

TL;DR: 本文提出VisCo，一种训练高效的视觉令牌自压缩框架，利用预训练视觉语言模型（VLM）自身作为内在编码器进行视觉信息压缩。该方法通过少量记忆令牌和分层信息传递实现压缩，在多种压缩比下超越现有方法，并在极端单令牌设置下保持稳定，同时学习到的记忆令牌还能与原始视觉令牌互补提升基础模型性能。

Details

Motivation: 现有视觉令牌压缩方法存在性能下降、重训练成本高或损害VLM先验知识的问题，而预训练VLM本身已具备强大的信息编码能力但未被充分利用。

Result: VisCo在所有评估的压缩比下均超越先前方法，在更高压缩比时优势更明显，且在极端单令牌设置下仍保持稳定；在多个基准测试中达到SOTA水平。

Insight: 创新点在于将预训练VLM本身复用为参数共享的自编码器进行自压缩，避免了引入外部模块；其学习到的记忆令牌能提供与原始视觉令牌互补的表征，甚至提升基础模型性能。

Abstract: Vision-language models (VLMs) process large numbers of visual tokens, resulting in substantial inference latency and memory overhead. This has motivated extensive research on visual token compression. While training-free strategies rely on heuristic metrics and suffer significant performance degradation under high compression ratios, many training-based methods introduce external compression modules that force the VLM backbone to adapt, incurring substantial retraining cost and compromising VLMs’ priors. Effective visual token compression hinges on strong information encoding, a capability already present in pretrained VLMs but underutilized by existing approaches. Motivated by this, we propose VisCo, a training-efficient self-compression framework that reuses the pretrained VLM itself as an intrinsic compressor. VisCo is a parameter-sharing autoencoder that compresses visual information using a small set of memory tokens and transfers hierarchical information from encoding to decoding. Experiments show that VisCo surpasses prior methods across all evaluated compression ratios, with larger gains under more aggressive compression, and remains stable even in the extreme single-token setting. Moreover, when combined with the original visual tokens, the learned memory tokens can even improve the base model, suggesting that VisCo captures complementary representations beyond compression.

[59] RFMSR: Residual Flow Matching for Image Super-Resolution cs.CVPDF

Shuwei Huang, Tianyao Luo, Jicheng Liu, Daizong Liu, Pan Zhou

TL;DR: 本文提出了RFMSR（残差流匹配超分辨率），一种仅依赖视觉信息的图像超分辨率框架。该方法将源分布中心置于低质量图像的潜在表示上，缩短了传输距离并保留了结构先验。通过两阶段训练策略，实现了高质量的单步生成，同时不牺牲多步细化能力。

Details

Motivation: 现有基于文本到图像大模型的超分辨率方法虽然感知质量好，但模型规模大、训练成本高；而基于流匹配的纯视觉方法通常从纯高斯先验出发，丢弃了低质量输入中已有的丰富结构信息，且单步加速技术常会丧失多步推理能力。

Result: 大量实验表明，RFMSR在感知质量上达到了与最先进方法相当甚至更优的水平。

Insight: 核心创新在于将流匹配的源分布锚定在低质量输入上，形成残差流，从而有效利用结构先验并缩短生成路径。两阶段训练策略（先条件流匹配预训练，后结合单步预测端到端监督与全时间步速度损失）兼顾了单步生成效率与多步细化潜力。

Abstract: Image super-resolution (ISR) has witnessed remarkable progress with diffusion models and flow matching. The dominant text-to-image (T2I) based approaches leverage large-scale foundation models as generative priors, achieving impressive perceptual quality but at the cost of massive model sizes and prohibitive training expenses. Recent flow-matching-based vision-only approaches have made significant strides; however, they adopt standard flow formulations that transport from a pure Gaussian prior to the data distribution, discarding the rich structural information already present in the low-quality (LQ) input. Furthermore, existing single-step acceleration techniques often forfeit the model’s multi-step inference capability. In this paper, we propose Residual Flow Matching for Image Super-Resolution (RFMSR), a vision-only framework that centers the source distribution at the LQ latent, reducing transport distance and preserving structural priors throughout the flow trajectory. We further introduce a two-phase training strategy: Phase I pretrains the velocity field via conditional flow matching, while Phase II applies end-to-end supervision to the single-step prediction while retaining the velocity loss across all timesteps, achieving high-quality single-step generation without sacrificing multi-step refinement. Extensive experiments demonstrate that RFMSR achieves comparable or even superior perceptual quality compared to state-of-the-art (SOTA) methods. The source code is available at https://github.com/Faze-Hsw/RFMSR.

[60] EvoGraph-R1: Self-Evolving Multimodal Knowledge Hypergraphs for Agentic Retrieval cs.CVPDF

Jiashi Lin, Changhong Jiang, Xiangru Lin, Ruifei Zhang, Xinyi Zhu

TL;DR: 本文提出了EvoGraph-R1，一个自演化的多模态知识超图框架，用于增强检索增强生成（RAG）系统。它将传统静态知识图重构为通过智能体交互动态演化的环境，将检索过程建模为马尔可夫决策过程（MDP），智能体可以执行查询、扩展、编辑和终止等动作来迭代优化知识结构和推理。

Details

Motivation: 现有GraphRAG方法将知识图视为离线构建、单次查询的静态数据结构，这与知识密集型推理所需的交互式、迭代式特性不匹配，导致了跨模态推理碎片化、结构无法更新以及检索缺乏自适应优化三大瓶颈。

Result: 在多模态VQA和文本QA基准测试上的实验表明，EvoGraph-R1在准确性、覆盖率和可追溯性方面相比现有RAG基线方法有显著提升。

Insight: 核心创新在于将知识图从静态数据重构为可通过智能体动作（查询、搜索、编辑）动态演化的环境，形成了一个闭环的自演化系统。这为解决静态知识图的局限性提供了一个根本性的新范式，支持跨模态的多跳推理和持续优化。

Abstract: Retrieval-augmented generation (RAG) has emerged as a critical paradigm for grounding Multimodal Large Language Models (MLLMs) in external knowledge. Recent GraphRAG methods introduce structured entity-relation graphs to improve retrieval and reasoning. However, they remain limited by treating knowledge graphs as static data structures built offline and queried in a single pass. This static paradigm misaligns with the interactive, iterative nature of knowledge-intensive reasoning, creating three bottlenecks: (i) text-centric fragmentation that impedes cross-modal reasoning, (ii) frozen structures unable to incorporate new evidence or correct errors, and (iii) rigid single-pass retrieval without adaptive refinement. To overcome these limitations, we introduce EvoGraph-R1, a self-evolving GraphRAG framework that reconceptualizes knowledge graphs as dynamic environments shaped through agent interactions. We formulate retrieval as a Markov Decision Process (MDP) where the agent observes the graph state and executes actions to query (GraphRetrieve), expand (WebSearch), refine (GraphEdit), or terminate (Answer) the reasoning. These actions reshape the hypergraph structure and generate feedback signals that guide subsequent evolution. Through this closed loop, the hypergraph evolves by integrating new evidence, correcting errors, and refining structure to support multi-hop reasoning. Experiments on multimodal VQA and text QA benchmarks demonstrate substantial improvements over existing RAG baselines in accuracy, coverage, and traceability, establishing self-evolving knowledge graphs as a fundamental paradigm across modalities.

[61] ExtraGS: Enhancing Endoscopic View Extrapolation via Diffusion-Guided 3D Gaussian Splatting cs.CVPDF

Cheng-Tai Hsieh, Jiwei Shan, Han Fang, Jianshu Hu, Tao Ni

TL;DR: 本文提出ExtraGS框架，通过扩散模型引导的3D高斯泼溅技术增强内窥镜视图外推能力。该方法从初始重建出发，采用不确定性引导的虚拟相机采样探索盲区，利用扩散模型生成伪观测以优化3D高斯表示，并通过置信度加权微调防止可靠区域退化。

Details

Motivation: 解决机器人辅助微创手术中传统内窥镜视野受限的问题，现有神经渲染方法在训练轨迹外推时易产生严重伪影。

Result: 在多个公共内窥镜数据集上的实验表明，ExtraGS显著减少了外推伪影，在内窥镜新视图合成任务中达到最先进（SOTA）性能。

Insight: 创新点在于将扩散模型与3D高斯泼溅结合用于视图外推，通过不确定性引导采样和置信度加权微调策略，在生成合理解剖结构的同时保护已有可靠重建区域。

Abstract: Robot-assisted minimally invasive surgery (MIS) critically depends on reliable endoscopic perception for navigation and safety. However, conventional endoscopes provide only a limited field of view, leaving large portions of surrounding anatomy unobserved. Recent neural rendering approaches, such as Neural Radiance Fields and 3D Gaussian Splatting, enable novel view synthesis from endoscopic videos, but their reliance on sparse observations often leads to severe artifacts when extrapolating beyond the training trajectory.In this work, we propose ExtraGS, a framework for enhancing endoscopic view extrapolation via diffusion-guided 3D Gaussian Splatting. Starting from an initial reconstruction, we introduce an uncertainty-guided virtual camera sampling strategy to actively explore blind spots and maximize information gain. The rendered views from these sampled locations are refined using a diffusion model to recover plausible anatomical structures, producing pseudo observations that guide further optimization. To prevent the generated content from degrading reliable regions, we adopt a confidence-weighted fine-tuning strategy when incorporating these pseudo observations.Extensive experiments on multiple public endoscopic datasets demonstrate that ExtraGS significantly reduces extrapolation artifacts and achieves state-of-the-art performance in endoscopic novel view synthesis.

[62] HSEmotion Team at the 11th ABAW Challenge: Multi-Task Learning and Ambivalence/Hesitancy Video Recognition cs.CV | cs.AIPDF

Aleksei Bakin, Andrey V. Savchenko

TL;DR: 本文介绍了团队在第十一届ABAW竞赛中的成果，包括两个任务：在s-Aff-Wild2数据集上使用冻结的轻量级面部特征提取器（MT-EmotiDDAMFN和MT-EmotiEffNet-B0）进行多任务学习（预测效价、唤醒度、面部表情和动作单元），并通过系统后处理（如时间高斯平滑、类别偏差调整、多模型融合等）提升性能；在扩展的BAH数据集上，通过融合面部、HuBERT音频和RoBERTa文本分类器的多模态晚期融合方法进行视频级别的犹豫/矛盾识别，并引入全局文本门控机制。

Details

Motivation: 解决在自然场景下进行多任务情感行为分析（如效价、唤醒度、表情等）以及视频中犹豫/矛盾识别的挑战，旨在通过轻量级方法和系统校准提升性能，避免对重型骨干网络进行微调以提高效率和部署灵活性。

Result: 在多任务学习任务中，集成方法在官方验证集上显著超过ConvNeXt基线；在犹豫/矛盾识别任务中，验证集帧级别加权F1从ABAW-8的0.74提升到0.79，最佳公开测试集视频级别Macro F1达到0.73，均表现出竞争力。

Insight: 创新点包括使用冻结的轻量级面部提取器结合系统后处理（如时间平滑和偏差校准）来优化多任务预测，以及通过多模态晚期融合（结合视觉、音频和文本）与全局门控机制提升视频级别识别性能；客观来看，该方法展示了轻量级校准和融合策略在效率与性能上可与重型端到端方法竞争的优势。

Abstract: This article presents our results for the 11th Affective Behavior Analysis in-the-Wild (ABAW) competition. For multi-task learning with simultaneous prediction of valence, arousal, facial expressions, and action units on s-Aff-Wild2 dataset, we use frozen lightweight facial extractors, MT-EmotiDDAMFN and MT-EmotiEffNet-B0, with separate heads and systematic post-processing: temporal Gaussian smoothing, per-class expression bias, AffectNet blending, per-AU threshold tuning, and weighted backbone fusion. On the official validation set, our ensemble significantly exceeds the performance of the ConvNeXt baseline. For ambivalence/hesitancy video recognition on the expanded BAH dataset, we extend the audiovisual pipeline to video-level Macro F1 by late fusion of face, HuBERT audio, and RoBERTa text classifiers, temporal aggregation, and a global-text gate. Frame-level Weighted F1 on validation set rises from 0.74 in ABAW-8 to 0.79, while the best public-test video-level Macro F1 reaches 0.73. In both tasks, competitive performance is achieved without fine-tuning heavy backbones. These results indicate that systematic prediction calibration and lightweight multimodal fusion can rival substantially heavier end-to-end approaches while offering improved efficiency and deployment flexibility.

[63] CoRe: A Comprehensive Framework for Cross-Image Comparative Reasoning in Vision-Language Models cs.CVPDF

Lin Peng, Cong Wan, Zeyu Guo, SongLin Dong, Yihong Gong

TL;DR: 本文提出了CoRe框架，旨在解决视觉语言模型在跨图像比较推理任务中的挑战，特别是需要细粒度属性定位和全局一致性推理的场景。该框架包含自动构建的大规模训练数据集CoRe-20K、结构化奖励框架TriSR以及首个专注于细粒度跨图像比较推理的基准测试CoRe-Bench。实验表明，CoRe在CoRe-Bench上显著优于现有视觉语言模型，同时在标准多模态基准上保持竞争力。

Details

Motivation: 解决视觉语言模型在跨图像比较推理任务中的困难，尤其是当正确预测需要细粒度属性定位和全局一致性推理时。

Result: 在CoRe-Bench基准测试中，CoRe大幅优于现有视觉语言模型，部分准确率比最强基线提升28.2个百分点，同时在标准多模态基准上保持竞争力。

Insight: 创新点包括通过多专家协作流程自动构建大规模三元组训练数据集、联合监督属性定位、判断对齐和三重一致性的结构化奖励框架，以及首个专注于细粒度跨图像比较推理的基准测试，为跨图像比较推理提供了系统化解决方案。

Abstract: Cross-image comparative reasoning remains challenging for vision-language models (VLMs), especially when correct prediction requires fine-grained attribute grounding and globally consistent reasoning. We present CoRe, a unified framework for this problem. CoRe includes: (i) CoRe-20K, a large-scale triplet-based training set automatically constructed from structured visual metadata through a multi-expert collaborative pipeline, covering counting, depth, distance, and spatial relations; (ii) TriSR, a structured reward framework that jointly supervises attribute grounding, judgment alignment, and triplet consistency under GRPO optimization; and (iii) CoRe-Bench, the first benchmark dedicated to fine-grained cross-image comparative reasoning. Experiments show that CoRe substantially outperforms existing VLMs on CoRe-Bench while remaining competitive on standard multimodal benchmarks, achieving a 28.2-point gain in partial accuracy over the strongest baseline.

[64] Breaking Déjà Vu: Independent Auditing of Visual Place Recognition through Vision-Language Reasoning cs.CVPDF

Sania Waheed, Michael Milford, Sarvapali D. Ramchurn, Shoaib Ehsan

TL;DR: 本文提出了一种视觉地点识别审计框架，利用视觉语言模型对查询图像和候选图像进行联合推理，以独立验证检索匹配的可靠性。该方法无需依赖特定架构的置信度度量、数据集相关阈值或先验环境知识，在六个基准数据集上显著提升了召回率并降低了误接受率。

Details

Motivation: 视觉地点识别在机器人应用中至关重要，但实际部署中依赖固定阈值来平衡精度和召回率，在环境变化且缺乏真实标签时不可靠，可能导致安全关键应用中的错误闭环检测。

Result: 在六个基准数据集上使用五种SOTA VPR方法和四种VLM进行评估，基于VLM的审计方法平均将召回率@1提升了13.6%，误接受率降至12%，同时保持精度高于95%和覆盖率高于75%。

Insight: 创新点在于利用视觉语言模型的跨模态推理能力进行实例级验证，摆脱了对传统阈值调优和特定置信度度量的依赖，为VPR提供了一种独立、可泛化的后检索审计机制。

Abstract: Visual place recognition (VPR) is a key enabler of accurate localization and long-term autonomous navigation in robotics applications, such as loop closure detection for simultaneous localisation and mapping (SLAM). However, real-world VPR deployment relies on selecting an image matching threshold that balances precision and recall. These thresholds are typically tuned using labeled validation data and fixed during deployment, making them unreliable under environmental changes where ground truth is unavailable. This is particularly problematic in safety-critical robotics, where accepting a false loop closure can corrupt the estimated trajectory and map. In this work, we introduce Visual Place Recognition Auditing, an independent post-retrieval verification framework that leverages Vision-Language Models (VLMs) to assess retrieved matches by reasoning jointly over query and candidate images. Unlike conventional verification methods, our approach performs instance-level verification without requiring architecture-specific confidence measures, dataset-dependent thresholds, or prior knowledge of the deployment environment. We evaluate our method on six benchmark datasets using five state-of-the-art VPR methods and four VLMs. Results show that VLM-based auditing improves recall@1 by 13.6% on average as compared to state-of-the-art methods while reducing false acceptance rates to 12%, maintaining precision above 95% and coverage above 75%.

[65] LARAD: Layout-Aware Road Anomaly Detection via Spatial-Logic Reasoning cs.CVPDF

Shiyi Mu, Xujie Chen, Shugong Xu

TL;DR: 本文提出了一种名为LARAD（Layout-Aware Road Anomaly Detection）的布局感知道路异常检测方法，通过空间逻辑推理来解决自动驾驶中的开放世界障碍物检测问题。该方法将范式从外观匹配转向空间逻辑推理，通过空间逻辑违规合成（SLVS）生成训练样本，并增强了一个标准的闭集分割网络。

Details

Motivation: 当前异常分割方法存在一个根本性盲点：过度依赖纹理新颖性来识别分布外（OoD）物体，而忽略了上下文空间逻辑。缓解由此产生的误报通常需要级联大量视觉模型，引入了不可接受的推理延迟。

Result: 大量实验表明，LARAD显著增强了对逻辑异常的鲁棒性，并建立了新的最先进水平（SOTA），同时保持了单模型架构的高效率。

Insight: 核心创新点在于引入了空间逻辑违规合成（SLVS）训练管道，以及一个轻量级的、OoD引导的注意力分支，将检测范式从外观匹配转向空间逻辑推理，从而在保持效率的同时提升了对逻辑异常（而非仅纹理异常）的检测能力。

Abstract: Accurate open-world obstacle detection is critical for autonomous driving. Current anomaly segmentation methods suffer from a fundamental blind spot: they over-rely on texture novelty to identify out-of-distribution (OoD) objects while ignoring contextual spatial logic. Furthermore, mitigating the resulting false positives often requires cascading massive vision models, introducing unacceptable inference latency. To address these issues, we propose Layout-Aware Road Anomaly Detection (LARAD), shifting the paradigm from appearance matching to spatial-logic reasoning. First, we introduce the Spatial-Logic Violation Synthesis (SLVS) pipeline, which generates training samples that are texture-consistent yet spatially invalid, forcing the model to learn contextual violations. Second, we augment a standard closed-set segmentation network with a lightweight, OoD-guided attention branch. Extensive experiments demonstrate that LARAD significantly enhances robustness against logical anomalies and establishes a new state-of-the-art, all while retaining the high efficiency of a single-model architecture.

Yanghai Wang, Jiahao Wang, Jiafu Tang, Yuanxing Zhang, Zhe Cao

TL;DR: 本文提出了AVSCap框架，用于全模态视频描述生成，通过显式的跨模态事件绑定来协调视听协同。该框架包括构建AVSCap-130K训练数据集、训练AVSCap-7B模型（采用监督微调和强化学习两阶段策略），并引入AVSCapBench评估基准。实验表明，AVSCap-7B在非语音音频覆盖和跨模态绑定方面表现优异，在开源模型中达到最佳整体性能。

Details

Motivation: 现有大型多模态模型在全模态视频描述任务中，往往将视听流视为松散耦合的观测，依赖自动语音识别，且对非语音声音及其与视觉事件的关联描述不足。论文旨在解决如何有效描述视觉动作、语音、音乐和音效协同演化的问题。

Result: 在AVSCapBench和外部基准测试中，AVSCap-7B提升了非语音音频覆盖率和跨模态绑定能力，在评估的开源模型中取得了最佳整体性能。缩放分析表明，强化学习比增加监督微调数据带来更大增益。

Insight: 创新点在于提出以显式跨模态事件绑定为中心的视听描述框架，通过解耦再融合的管道构建高质量训练数据，并采用混合奖励的强化学习来优化音频完整性和视听协同。这为协调多模态信息提供了可借鉴的结构化方法。

Abstract: Omni-modal video captioning is not merely combining visual captioning with audio transcription: a useful caption must describe how visual actions, speech, music, and sound effects co-evolve. Existing large multimodal models often fail at this relational step, treating audio and visual streams as loosely coupled observations, relying on automatic speech recognition, and under-specifying non-speech sounds and their links to visual events. We present AVSCap, a framework for audio-visual captioning centered on explicit cross-modal event binding. First, we construct AVSCap-130K, a tri-modal training corpus generated by a decoupled-then-fused pipeline that anchors visual and acoustic evidence before composing grounded omni-modal captions. Second, we train AVSCap-7B, a 7B captioner with a two-stage strategy: supervised fine-tuning establishes baseline capabilities, while sample-efficient reinforcement learning uses hybrid rewards to optimize acoustic completeness and audio-visual synergy. Our scaling analysis shows that reinforcement learning brings larger gains than increasing SFT data. Third, we introduce AVSCapBench, a benchmark that decomposes captions into visual, audio, and synergy events and evaluates them with fine-grained event recall. Experiments on AVSCapBench and external benchmarks show that AVSCap-7B improves non-speech audio coverage and cross-modal binding, delivering the best overall performance among evaluated open-source models.

[67] UniVR: Thinking in Visual Space for Unified Visual Reasoning cs.CVPDF

Zhongwei Ren, Yunchao Wei, Yao Zhao, Weibo Gong, Xiao Liu

TL;DR: UniVR是首个从纯视觉演示中同时学习复杂推理、细粒度物理动力学和长期规划的研究。其核心是VR-GRPO强化学习范式，通过全局和步骤级互补奖励确保逻辑连贯性和物理一致性，无需任务特定启发式或图文对。研究构建了大规模基准VR-X进行评估，UniVR在VR-X上提升达25%，其卓越的视觉推理能力也提升了多模态理解基准性能。

Details

Motivation: 直接从原始视觉数据中学习广泛的世界知识是智能的基本能力，但现有方法难以在纯视觉协议下统一处理复杂推理、物理动力学和规划等异构任务。

Result: 在从16个不同来源构建的大规模基准VR-X（涵盖长视野操作、空间谜题和物理推理）上，UniVR实现了高达25%的性能提升，并在多个多模态理解基准上表现出色。

Insight: 创新点在于提出VR-GRPO强化学习范式，通过互补奖励机制在纯视觉空间中实现统一推理；同时构建首个综合性纯视觉评估基准VR-X，为视觉推理研究提供了重要工具。

Abstract: Learning broad world knowledge directly from raw visual data is a fundamental capability of intelligence. We introduce UniVR, the first investigation into simultaneously learning complex reasoning, fine-grained physical dynamics, and long-term planning from pure visual demonstrations. At its core, UniVR features VR-GRPO, a reinforcement learning paradigm with complementary global and step-level rewards. This approach enforces logical coherence and physical consistency throughout the reasoning process without requiring task-specific heuristics or image-text pairs. To train and evaluate UniVR, we construct VR-X, a large-scale benchmark curated from 16 diverse sources spanning long-horizon manipulation, spatial puzzles, and physical reasoning. It is the first comprehensive suite to assess these heterogeneous capabilities under a purely visual protocol. Remarkably, UniVR achieves up to a 25% improvement on VR-X, and its superior visual reasoning also boosts performance on various multimodal understanding benchmarks. These findings underscore the vast potential of reasoning within visual spaces, with all code, data, and models are open-sourced for further research.

[68] Metric-Guided Synthetic Image Data Rendering for Deep Learning compatible with Agentic AI cs.CV | q-bio.QMPDF

Martina Radoynova, Samuel Pantze, Trina De, Ulrik Günther, Artur Yakimovich

TL;DR: 该论文提出了GraNatPy，一个用于指导合成图像数据渲染的Python包，通过量化指标（如真实感、多样性和数据集大小）来提升渲染场景的质量，从而缩小合成与真实图像之间的域差距。研究还展示了量化指标提升与目标检测模型零样本性能改善的相关性，并利用病毒噬斑检测照片证明梯度相似性对小目标检测性能的影响，可通过混合真实与合成数据来优化。最后，将程序化数据渲染转化为智能体技能（SynthClaw），以自动化参数优化过程。

Details

Motivation: 解决深度学习计算机视觉在科学应用中数据收集和标注过程繁琐、昂贵且易出错的问题，通过合成数据生成简化流程，但缺乏系统化量化指导来最小化合成与真实图像之间的域差距。

Result: 量化指标（真实感、多样性和数据集大小）的提升与场景视觉感知改善和目标检测模型零样本性能提高相关；在病毒噬斑检测任务中，梯度相似性影响小目标检测性能，混合数据可优化结果；实现了程序化参数优化的自动化（SynthClaw）。

Insight: 创新点在于引入量化指标（GraNatPy）系统化指导合成数据渲染，以客观方式缩小域差距；将渲染过程转化为智能体技能（SynthClaw），实现自动化优化，可借鉴于提升合成数据质量和深度学习模型性能。

Abstract: Deep learning computer vision for scientific applications requires collecting and annotating large datasets in a laborious, expensive and error-prone process. Synthetic data generation through 3D modelling and rendering may simplify this process and increase the accuracy of annotations by generating them programmatically. However, minimising the domain gap between real and synthetic images visually is subjective and lacks systematic quantitative guidance. We present GraNatPy, a Python package with metrics to guide improvement of the rendered scene. We show that quantifiable increase in realism, diversity and size of rendered dataset correlates with improved visual perception of the scene and higher zero-shot performance of an object detection model. Furthermore, we demonstrated using photographs of virological plaque assays that gradient similarity affects performance on small object detection, which can be improved by mixing real and synthetic data. Finally, we turn procedural data rendering into an agentic skill (SynthClaw) to automate the procedural parameter optimisation.

[69] Hy-Embodied-VLM-1.0: Efficient Physical-World Agents cs.CVPDF

Ziyi Wang, Xumin Yu, Yongming Rao, Yonggen Ling, Yunheng Li

TL;DR: 本文介绍了Hy-Embodied-VLM-1.0，一个专为物理世界具身智能体设计的高效且强大的基础模型。该模型基于Hy3-A3B语言主干和Hy-ViT2视觉编码器，采用高效的混合专家架构，旨在培养智能体在动作相关状态理解、动作转换推理以及序列自适应推理三个维度的能力。

Details

Motivation: 构建强大的具身智能体不仅需要多模态感知和理解，还需要具备对动作进行推理、适应动态环境并与物理世界交互的智能体能力。现有模型在这些方面的能力有待提升。

Result: 模型在涵盖具身感知、物理世界理解和具身推理的38个基准测试套件上进行了评估，在其中19个基准上取得了同规模模型中的最佳性能，显著优于Qwen3.6-A3B和Cosmos 3等竞争对手。相比前代模型Hy-Embodied-0.5 MoT-2B，平均性能提升了8.4%，并且仅激活30亿参数就达到了接近前代模型激活320亿参数时的性能。

Insight: 论文的创新点在于提出了一个以动作为中心的能力分类法来指导模型训练，并构建了系统化的数据管道。从客观角度看，其高效混合专家架构在保持强大模型容量的同时实现了高推理效率，这对于延迟敏感的部署场景具有重要价值。

Abstract: Building capable embodied agents requires not only multimodal perception and understanding, but also agentic capabilities for reasoning about actions, adapting to evolving situations, and interacting with the physical world. In this report, we introduce Hy-Embodied-VLM-1.0, an efficient and powerful embodied foundation model specifically designed for embodied agents operating in the physical world. To cultivate such capabilities from the pre-training stage onward, we define an action-centric capability taxonomy comprising three progressive dimensions: Action-Relevant State Understanding, Action-Transition Reasoning, and Sequential and Adaptive Reasoning. Guided by this taxonomy, we develop a systematic data pipeline and curate data mixtures spanning both pre-training and post-training. To deliver strong physical-world understanding and interaction capabilities while supporting latency-sensitive deployment, we build our model on the Hy3-A3B language backbone and the Hy-ViT2 vision encoder. Its efficient Mixture-of-Experts architecture combines strong model capacity with high inference efficiency. We evaluate Hy-Embodied-VLM-1.0 on a comprehensive suite of 38 benchmarks covering embodied perception, physical-world understanding, and embodied reasoning. The model achieves the best performance among similarly sized models on 19 of the 38 benchmarks and substantially outperforms strong competitors, including Qwen3.6-A3B and Cosmos 3. Compared with the previous-generation Hy-Embodied-0.5 MoT-2B, Hy-Embodied-VLM-1.0 improves average performance by 8.4%. Despite activating only 3B parameters, it achieves performance close to that of the previous-generation model with 32B activated parameters. Beyond static benchmark evaluation, Hy-Embodied-VLM-1.0 also demonstrates strong performance on embodied agentic tasks requiring multi-turn interaction and long-horizon reasoning.

[70] UniMedSeg: Unified In-Context Learning for Multi-Paradigm 2D/3D Medical Image Segmentation cs.CVPDF

Yunzhou Li, Jiesi Hu, Yanwu Yang, Hanyang Peng, Chenfei Ye

TL;DR: 本文提出UniMedSeg，一个统一的医学图像分割基础模型。它通过将视觉示例、几何交互、语言指令以及2D/3D图像映射到共享的序列空间，实现了对多种分割范式（视觉上下文学习、交互式分割、语言引导分割）和空间维度的统一建模。该模型在27个公开数据集上进行训练和评估，无需任务特定微调即可在多种任务上达到最先进的性能。

Details

Motivation: 现有医学图像分割通用方法因提示范式和空间维度（2D/3D）不同而各自为政，导致异构的标注和数据无法被单一可扩展模型联合吸收，也限制了跨范式的知识迁移。本文旨在解决这一瓶颈，构建一个真正统一的框架。

Result: 在从27个公开数据集整理的大型语料库上进行广泛训练和评估，UniMedSeg在视觉上下文学习、交互式分割和语言引导分割任务上均达到了最先进的性能，并且在多种未见任务上展现出强大的泛化能力，且无需任务特定微调。

Insight: 核心创新在于提出了一个统一的序列化接口，将不同范式和维度的输入映射到共享空间，消除了特定分支的需求。此外，提出了解耦分割注意力机制，在保持硬件友好计算和聚焦上下文-目标交互的同时，将注意力复杂度降低至线性，解决了长序列的内存瓶颈问题。

Abstract: Medical image segmentation foundation models are expected to generalize across diverse clinical scenarios, yet existing universal methods remain fragmented by prompt paradigms and spatial dimensions. Visual in-context learning, interactive segmentation, and language-guided segmentation are typically handled by paradigm-specific models, while 2D and 3D images are also modeled separately. Such isolation prevents heterogeneous annotations and data from being jointly absorbed by a single scalable model and limits cross-paradigm knowledge transfer. To address this bottleneck, we propose UniMedSeg, a Transformer-centric universal segmentation framework that maps visual examples, geometric interactions, language instructions, and 2D/3D images into a shared sequence space, enabling heterogeneous medical supervision to be jointly learned through a unified in-context interface without prompt- or dimension-specific branches. To overcome the long-sequence memory bottleneck caused by visual contexts, we introduce Decoupled Split Attention, which reduces attention complexity to linear while preserving hardware-friendly computation and focused context-target interaction. Extensively trained and evaluated on a large corpus curated from 27 public datasets, UniMedSeg achieves state-of-the-art performance across visual in-context, interactive, and language-guided segmentation without task-specific fine-tuning, demonstrating strong generalization on diverse held-out tasks. The code and model weights are publicly available at https://github.com/Lii1228/UniMedSeg

[71] Inhibited Self-Attention: Sharpening Focus in Vision Transformers cs.CVPDF

Peter R. D. van der Wal, Nicola Strisciuglio, George Azzopardi

TL;DR: 本文提出了一种受生物视觉系统启发的抑制性自注意力机制（ISA），用于改进视觉Transformer中的自注意力机制。该方法通过保留和利用负注意力分数来抑制无关特征，从而增强对感兴趣对象的聚焦能力。实验表明，ISA在多个数据集和鲁棒性基准测试中提升了模型的对象中心选择性和分布外泛化能力。

Details

Motivation: 视觉Transformer的自注意力机制往往将注意力分散到背景区域，依赖虚假相关性而非对象相关线索，这限制了其性能。

Result: 在ImageNet-1k、COCO等多个数据集和鲁棒性基准测试中，ISA增强了对象中心选择性，减少了捷径依赖，并改善了分布外泛化性能。

Insight: 创新点在于将生物抑制机制引入自注意力，利用负注意力分数抑制无关特征，从而提升特征选择性和模型可靠性；这为改进Transformer的注意力机制提供了新思路。

Abstract: Vision Transformers (ViTs) have demonstrated remarkable performance in computer vision tasks. However, their self-attention mechanism often diffuses focus across background regions, relying on spurious correlations rather than object-relevant cues. Inspired by inhibitory mechanisms observed in biological vision systems, we propose the Inhibited Self-Attention (ISA), a novel self-attention that integrates inhibitory signals to enhance feature selectivity and suppress spurious responses. In contrast to conventional self-attention, which relies solely on positive attention values due to softmax normalization, our approach retains and utilizes negative attention scores to suppress irrelevant features and sharpen focus on objects of interest. Experiments across multiple datasets, including ImageNet-1k and COCO, and several robustness benchmarks demonstrate that ISA enhances object-centric selectivity, reduces shortcut reliance, and improves out-of-distribution generalization. Our analysis of relevance maps confirms that ViTs with ISA exhibit sharper, more localized focus on object-relevant regions while reducing distractions from non-relevant (background) features, enabling more reliable models. We release our code at https://github.com/prdvanderwal/inhibited-self-attention

[72] Open-KNEAD: Knowledge-grounded Nutrition Estimation via Agentic Decomposition cs.CVPDF

Bruce Coburn, Jingbo Yue, Jinge Ma, Siddeshwar Raghavan, Gautham Vinod

TL;DR: 本文提出Open-KNEAD，一个无需训练、可本地部署的知识增强智能体框架，用于从餐食图像进行营养估计。该框架通过选择性、营养感知的检索将分解的食物项与FNDDS数据库代码对齐，生成可审计的逐项记录，并在多个MLLM主干和菜系上提升了分量估计精度，特别是在非美国菜系上通过内部食谱先验步骤校正了烹饪添加能量的偏差。

Details

Motivation: 尽管检索增强方法曾被认为能提升多模态大语言模型（MLLMs）的膳食营养估计精度，但作者发现现代MLLMs的直接估计已匹配或超越完整检索流程。因此，研究转向探索检索是否仍能为临床实践提供准确的食物分量和可追溯的逐项记录，同时满足临床采纳的关键要求：最小用户负担（单张无标注餐食图像）、可解释性和隐私保护（本地部署）。

Result: 在两个开放MLLM系列和三种菜系上，Open-KNEAD在大多数主干-数据集设置中，其分量估计优于先前的检索增强方法和直接估计。在经营养师验证的ACETADA数据集上，该本地开放智能体的分量估计比两个前沿闭源模型的直接估计分别提升约30%和53%，且所有餐食图像均在本地硬件处理。

Insight: 创新点在于提出了一个训练免费、可本地部署的智能体分解框架，通过选择性营养感知检索实现知识增强，并引入内部食谱先验步骤来校正非美国菜系中不可见的烹饪添加能量偏差，从而在保持隐私和可审计性的同时，显著提升了分量估计的准确性。

Abstract: Multimodal Large Language Models (MLLMs) are increasingly used for dietary assessment from meal images, where retrieval-augmented grounding was shown to sharpen nutrition estimates. However, we find this premise no longer holds for current MLLMs. A modern MLLM’s direct estimate now matches or surpasses the full retrieval pipeline. This raises a question: if retrieval no longer improves the overall estimate, can it still deliver the two things clinicians value, accurate portions and a traceable, item-by-item record? We pursue this while preserving what matters for clinical adoption: minimal user burden (a single, unannotated meal image), explainability (an auditable record), and privacy (locally hosted inference). We introduce Open-KNEAD, a knowledge-grounded agentic framework for meal nutrition estimation that is training-free and locally deployable. Each decomposed food item is grounded to a Food and Nutrient Database for Dietary Studies (FNDDS) code via selective, nutrient-aware retrieval, composing an auditable per-item record. Across two open MLLM families and three cuisines, Open-KNEAD improves portion estimates over both prior grounding methods and direct estimation in most backbone-dataset settings. An agent-internal recipe-prior step further recovers the invisible cooking-added energy that biases estimates on non-US cuisine. The advantage is largest on the dietitian-verified ACETADA dataset, where the local open agent surpasses the direct portion estimates of two frontier closed models by roughly $30%$ and $53%$, all while keeping every meal image on local hardware. We release the Open-KNEAD framework and its agent-ready FNDDS knowledge base.

[73] ViCo3D: Empowering LiDAR-based Collaborative 3D Object Detection with Vision Foundation Models cs.CVPDF

Haojie Ren, Songrui Luo, Lingfeng Wang, Yan Xia, Yao Li

TL;DR: ViCo3D是一个利用视觉基础模型增强基于LiDAR的协同3D目标检测的框架。它通过将点云投影为BEV图像，利用DINOv2提取视觉特征，并与LiDAR几何特征融合，再通过以自我为中心的跨智能体融合策略整合多智能体信息，在DAIR-V2X和V2XSet数据集上实现了SOTA性能。

Details

Motivation: 当前基于LiDAR的V2X协同感知系统主要融合BEV特征，但这些特征由从头训练的LiDAR骨干网络提取，以几何信息为主，缺乏通用的语义先验，限制了特征级协同的有效性。视觉基础模型在大规模图像数据上预训练，具有强大的通用视觉表示学习能力，有潜力增强LiDAR BEV表示，但图像与点云之间的模态差距巨大，直接适配面临挑战。

Result: 在DAIR-V2X和V2XSet基准测试上，ViCo3D实现了最先进的3D检测性能。在DAIR-V2X数据集上，其协同增益比先前方法高出高达1.8倍。

Insight: 创新点在于将视觉基础模型（DINOv2）成功适配到LiDAR 3D检测领域，核心是通过点云到BEV图像的投影来桥接模态鸿沟，并设计了多尺度BEV融合模块和以自我为中心的跨智能体融合策略。这为利用大规模预训练的2D视觉先验知识来增强3D感知任务提供了新思路。

Abstract: LiDAR-based collaborative 3D perception in Vehicle-to-Everything (V2X) systems typically relies on fusing bird’s-eye-view (BEV) features across agents. However, current BEV representations, typically extracted by LiDAR backbones trained from scratch, are geometry-dominated and lack general semantic priors, inherently limiting the efficacy of feature-level collaboration. Meanwhile, vision foundation models (VFMs) pretrained on large-scale image data have demonstrated strong capability in learning general-purpose and informative visual representations for 2D tasks, and have the potential to enhance agent-wise LiDAR BEV representations for collaboration. Despite this potential, adapting VFMs to LiDAR-based 3D detection remains challenging due to the substantial image-point cloud modality gap. To bridge this gap, we propose ViCo3D, a collaborative 3D object detection framework powered by VFMs. Specifically, ViCo3D adapts VFMs to LiDAR-based collaborative perception from three aspects: First, ViCo3D projects point clouds onto the BEV plane as three-channel images, enabling DINOv2 to extract BEV-space visual features from LiDAR inputs. Besides, to effectively integrate these DINOv2-derived features with LiDAR geometric features, ViCo3D introduces a multi-scale BEV fusion module within the single-agent encoder. In addition, ViCo3D adopts an ego-centric cross-agent fusion strategy to aggregate complementary information from multiple agents. Experiments on DAIR-V2X and V2XSet demonstrate that ViCo3D achieves state-of-the-art 3D detection performance. Remarkably, it delivers up to 1.8x greater collaborative gains than prior methods on DAIR-V2X. The code will be made public available for future investigation.

cs.AI [Back]

[74] A Learning-Rate-Gated Failure of GRPO in a Small Language and Vision-Language Model Web Agent: A Controlled Null and Its Mechanism cs.AI | cs.CLPDF

Chengguang Gan, Zhixi Cai, Yunhao Liang, Hanjun Wei, Shiwen Ni

TL;DR: 本文研究了在小规模语言和视觉语言模型（4B至8B参数）网络代理中，使用可验证奖励的强化学习（特别是组相对策略优化GRPO）是否真正提升了代理的技能。通过18次对照实验，发现GRPO未能显著提升已基本掌握任务的强监督基线的成功率，甚至在某些情况下（如文本轨迹中高学习率）会损害性能。研究进一步揭示了失败机制：中等学习率导致性能下降，高学习率导致崩溃，且这种效应与模型规模相关。

Details

Motivation: 动机是探究在小规模语言和视觉语言模型网络代理中，GRPO强化学习是否真正增加了新技能，还是仅仅重塑了监督模型已有的行为，以验证其在已掌握任务上的有效性。

Result: 在文本轨迹任务中，中高学习率使GRPO可信地降低了成功率（与强监督基线相比），而在Set-of-Marks截图观察中仅名义上受损；当任务奖励可通过采样达到时，成功率提升了22个百分点，表明GRPO仅在存在提升空间时有效。实验基于18次运行的控制网格，包括学习率、KL权重、种子等变量，结果在配对测试和多种配置下均保持无效。

Insight: 创新点在于揭示了GRPO在小规模模型已掌握任务上的局限性，并机制性分析了学习率导致的性能下降和崩溃的双重解离现象，以及模型规模对有效秩与能力耦合的影响。客观来看，这强调了在应用强化学习前评估任务掌握程度的重要性，并提供了针对小模型优化策略的实证见解。

Abstract: Reinforcement learning with verifiable rewards, and Group Relative Policy Optimization (GRPO) in particular, is now run routinely on a supervised checkpoint in the hope of producing a stronger agent. We ask whether it adds skill to a small language and vision-language model web agent at the 4B to 8B scale, or whether it mostly reshapes behavior the supervised model already has. Across a control grid of 18 runs that varies learning rate, KL weight, seed, initialization, and clipping, no configuration credibly improves the success rate of a strong supervised baseline on tasks the agent has largely mastered. On the text track, moderate to high learning rates make it credibly worse. The null holds under paired testing, 25 evaluation seeds, 6 training seeds, changes to the recipe, both text and Set-of-Marks screenshot observations, and scaling the backbone to 8B; the credible harm is a text-track finding and is only nominal under Set-of-Marks. To show that the null reflects the setting and not a broken pipeline, we run the identical harness, reward, and recipe on tasks whose reward is reachable by sampling, and there the success rate rises by 22 points with a paired interval that excludes zero. GRPO therefore helps only when there is headroom to climb, meaning the sampled policy already succeeds more often than the greedy one. We then explain the failure. A middle learning rate degrades the agent and a high one collapses it, and the two regimes form a double dissociation: grafting localizes the degrade regime to the attention and MLP blocks, while the collapse regime cannot be traced to any single group, and the embedding change that dominates the weight movement is causally inert. At 4B, effective rank in the late layers tracks capability in both directions; at 8B the two come apart. This coupling is specific to the smaller model, so we report it as scale-dependent.

[75] Function-Aware Fill-in-the-Middle as Mid-Training for Coding Agent Foundation Models cs.AI | cs.CLPDF

Yubo Wang, Jiarong Liang, Yuxuan Zhang, Xuye Liu, Cong Wei

TL;DR: 本文提出了一种名为‘函数感知中间填充’的中期训练方法，用于提升代码智能体基础模型的能力。该方法利用普通代码中函数调用的结构，通过自监督目标掩码函数并基于程序依赖图分析和复杂度-可推断性双重准则进行训练。在Qwen系列模型上进行中期训练后，再应用现有的智能体后训练流程，显著提升了模型在SWE-Bench等代码代理基准上的性能，并缓解了后训练对非代理编码及非编码工具使用能力的侵蚀。

Details

Motivation: 标准代码预训练仅暴露了从左到右的推理能力，而代码智能体需要能够整合外部工具返回结果到持续推理中。论文观察到代码智能体的动作-观察-继续循环在结构上同构于函数调用点，这种条件结构在普通代码中大量存在，因此利用它来增强模型处理工具返回和下游消费的能力。

Result: 在Qwen2.5-Coder-Instruct (7B/14B) 和 Qwen3-8B模型上进行中期训练后，在SWE-Bench-Verified上分别提升了+2.8/+3.0和+3.2，在SWE-Bench-Lite上分别提升了+3.7/+4.0/+5.4。改进在两个后训练流程（R2E-Gym, SWE-Smith）和非Qwen2.5基础模型（Qwen3-8B with SWE-Lego）上均成立。此外，中期训练还缓解了智能体后训练对非代理编码（如LiveCodeBench）和非编码工具使用基准（tau-bench, BFCL）的能力侵蚀。

Insight: 核心创新点在于将代码智能体的交互循环结构映射到普通的函数调用模式，并设计了基于程序依赖图分析和复杂度-可推断性双重准则的函数感知中间填充自监督目标。这种方法仅使用Python代码进行训练，但学习到的函数调用归纳偏置能有效泛化，在提升代理能力的同时保护了基础能力，为代码智能体基础模型的训练提供了新的中期训练范式。

Abstract: Coding agents must integrate external tool returns into ongoing reasoning - a capability that standard left-to-right pretraining on code exposes only in its forward direction. We observe that the action-observation-continuation loop of a coding agent is structurally isomorphic to a function call site, where a caller binds arguments, a callee returns a value computed elsewhere, and downstream code consumes that value. This conditioning structure exists at internet scale in ordinary code. We exploit it through function-aware fill-in-the-middle (FIM) mid-training: a self-supervised objective that masks functions selected via program dependency graph analysis and a complexity-inferability double criterion. We mid-train Qwen2.5-Coder-Instruct (7B/14B) and Qwen3-8B on a 2.6B-token decontaminated corpus drawn from 968 GitHub repositories, then apply existing agentic post-training pipelines. Mid-training improves SWE-Bench-Verified by +2.8/+3.0 at 7B/14B and by +3.2 on Qwen3-8B; SWE-Bench-Lite gains are +3.7/+4.0/+5.4 on the same models. The improvement holds across two post-training pipelines (R2E-Gym, SWE-Smith) and on a non-Qwen2.5 base (Qwen3-8B with SWE-Lego). Beyond in-domain gains, mid-training also mitigates the capability erosion that agentic post-training otherwise inflicts on non-agent coding (e.g., LiveCodeBench) and non-coding tool-use benchmarks (tau-bench, BFCL): although the mid-training corpus contains Python code only, the function-call inductive bias survives post-training and yields consistent gains.

[76] Tracing Agentic Failure from the Flow of Success cs.AI | cs.CLPDF

Samuel Yeh, Yiwen Zhu, Shaleen Deep, Sharon Li

TL;DR: 本文提出了一种名为OAT的无监督故障归因方法，用于识别基于LLM的智能体系统失败轨迹中的错误步骤。该方法将问题建模为基于神经控制微分方程的单类学习，仅需在成功轨迹上进行训练，无需失败数据的步骤级标注。实验表明，OAT比基于提示的基线方法快200-5000倍，并在领域内和分布外数据集上分别实现了F1分数提升20%和7%。

Details

Motivation: 现有LLM智能体系统的故障归因方法要么依赖计算成本高的提示管道，要么需要收集成本高昂且难以扩展的步骤级错误标注数据进行训练。本文旨在开发一种轻量级、无需失败数据步骤级监督的实用故障归因模型。

Result: 在仅使用100条成功轨迹进行训练后，OAT在领域内和分布外数据集上的F1分数分别比基于提示的基线高出20%和7%，同时推理速度提升了200至5000倍，展现了其高效性和有效性。

Insight: 创新点在于将无监督故障归因问题转化为基于神经控制微分方程的单类学习，通过在潜在空间中建模成功轨迹的动态模式来检测异常步骤。这种方法避免了昂贵的失败数据标注，为诊断智能体系统故障提供了一个高效且有前景的方向。

Abstract: Failure attribution for LLM-based agentic systems, i.e., identifying which steps in a failure trajectory caused the task to fail, is critical for debugging and improving these systems. Existing approaches either rely on prompting-based pipelines, which are computationally expensive, or require post-training on failure trajectories with step-level error annotations, which are costly to collect and difficult to scale. We argue that a practical failure attribution model should be lightweight and trainable without step-level supervision on failure data. To this end, we address unsupervised failure attribution, i.e., training exclusively on successful trajectories and identifying error steps at inference time given a failure trajectory. We propose OAT, which casts this problem as one-class learning with neural controlled differential equations, modeling the dynamical pattern of successful trajectories in latent space. At inference time, each step in a failure trajectory is assigned an anomaly score based on its deviation from the dynamics learned on successful trajectories, which is then used to form a set of error steps. With training on only 100 successful trajectories, experiments show that OAT is 200–5000 $\times$ faster than prompting-based baselines, and, at the same time, consistently outperforms them in both in-domain and out-of-distribution datasets with +20% and +7% F1 scores, respectively, demonstrating that OAT is a promising and efficient direction for diagnosing agentic system failures.

[77] Do We Really Need Multimodal Emotion Language Models Larger Than 1B Parameters? cs.AI | cs.CL | cs.CV | cs.MMPDF

Kaiwen Zheng, Junchen Fu, Wenhao Deng, Hu Han, Joemon M. Jose

TL;DR: 本文挑战了多模态情感识别（MER）需要大型模型（如7B参数以上）的假设，提出了一个轻量级框架Light-MER，通过知识蒸馏将大型教师模型的知识转移到亚十亿参数的学生模型中，以在保持高性能的同时显著提升推理效率。

Details

Motivation: 现有MLLMs在提升MER性能时往往伴随模型参数规模的增大，导致计算成本高、推理效率低，阻碍了在资源受限平台（如机器人和移动设备）上的实时部署，因此研究是否真的需要超过1B参数的大型模型来实现高质量MER。

Result: 在九个基准数据集上的广泛实验表明，Light-MER实现了最先进的性能，同时显著提高了推理效率。

Insight: 创新点包括引入结合Sliced Wasserstein Distance与隐藏状态对齐的最优传输损失，以及基于GRPO的多奖励优化策略以平衡MER性能与效率；客观分析认为，该研究展示了小型多模态情感语言模型在保持高性能和高效部署方面的潜力，为轻量级MER模型设计提供了新思路。

Abstract: Recent advances in multimodal large language models (MLLMs) have significantly improved the performance of multimodal emotion recognition (MER) and enabled interpretable description generation by jointly modeling video, audio, and language, etc. However, these performance improvements are often accompanied by an increase in model parameter size (e.g, at least 7B), which simultaneously incurs high computational costs and reduces inference efficiency, thereby hindering real-time deployment on resource-constrained platforms such as robots and mobile devices. This raises a fundamental question: do we really need the multimodal MER model larger than 1B parameters for high-quality MER? In this paper, we challenge the assumption that larger models are inherently necessary and proposes a lightweight MER framework (called Light-MER), which achieves better and faster multimodal sentiment understanding and recognition through knowledge distillation. It can transfer knowledge from a strong, large-scale teacher model to a lightweight sub-billion-parameter student model, aiming to preserve rich multimodal emotion reasoning and recognition while substantially improving deployment efficiency. Specifically, we introduce two new optimization strategies to enhance knowledge transfer: (1) a new optimal transport loss that combines Sliced Wasserstein Distance with hidden-state alignment, and (2) a new multi-reward optimization strategy based on GRPO that balances MER performance and efficiency, aimed at further enhancing the learning capabilities of student models. Extensive experiments on nine benchmark datasets demonstrate that Light-MER achieves state-of-the-art performance while significantly improving inference efficiency. This highlights the strong potential of small multimodal emotion language models for future research. Code is available at https://github.com/GAIR-Lab/Light-MER.

[78] Do AI Agents Know When a Task Is Simple? Toward Complexity-Aware Reasoning and Execution cs.AI | cs.CL | cs.SE | eess.SYPDF

Junjie Yin, Xinyu Feng

TL;DR: 本文提出E3框架，通过任务感知的执行范围估计来优化LLM代理的工作流程。E3采用‘估计-执行-扩展’策略，在MSE-Bench基准测试中，以100%成功率将成本降低85%、令牌使用减少91%、文件检查减少92%，并在真实模型测试中验证了其高效性。

Details

Motivation: 现有LLM代理在执行多步任务时缺乏对任务复杂度的感知，常采用‘最大上下文优先’策略导致资源浪费，因此需要一种能判断任务难度、所需信息及最短可靠路径的能力。

Result: 在MSE-Bench基准（121个确定性编辑任务）上，E3在保持100%成功率的同时，显著降低了各项成本指标；在真实模型测试（LLM-Case）中，E3是最精简、最快的策略，仅因速率限制而非错误编辑导致一次失败。

Insight: 创新点在于形式化了最小充分执行和代理认知冗余率（ACRR），并提出任务感知执行范围估计框架E3，推动AI代理向工程现实锚定的努力（EGAI）发展，可借鉴其通过估计初始操作点来动态调整执行范围的轻量级策略。

Abstract: Large language model (LLM) agents increasingly automate multi-step engineering and informatics workflows, yet they rarely ask how much effort a task actually requires. They often follow a maximum-context-first strategy–re-reading files and dependencies they have already seen–turning a one-line edit into a small code-base audit. We argue the missing capability is task-aware execution-scope estimation: judging a task’s difficulty, the information it truly needs, and the shortest reliable path before committing budget. We formalize minimum-sufficient execution and the Agent Cognitive Redundancy Ratio (ACRR), and propose E3 (Estimate, Execute, Expand): the agent estimates an initial operating point, executes a minimum viable path, and expands scope only when verification fails. On MSE-Bench–a deterministic benchmark of 121 edits in a capability-controlled simulator–E3 matches the strongest baseline’s 100% success while cutting cost by 85%, tokens by 91%, and inspected files by 92%, and further beats a strong adaptive retrieval baseline by 16%; the gains survive held-out instruction wording and essentially every cost weighting. A companion real-model harness (LLM-Case) corroborates the effect on a live gpt-4o agent editing a real open-source library, with every candidate patch graded by actually running the project’s real pytest suite against a measured oracle: the over-reading is milder but real, and E3 is the leanest and fastest policy at comparable task success–its one shortfall a provider rate-limit, not a wrong edit. We frame this as a controlled probe of execution redundancy, not a measurement of any deployed agent, and position task-aware execution as a step toward engineering-grounded AI (EGAI)–agents whose effort is anchored in the engineering reality of the task. We release the framework and benchmark.

[79] The Emerging Paradigm of Geospatial Foundation Models: From Pre-Training to Agentic Reasoning cs.AI | cs.CVPDF

Shelley Cazares

TL;DR: 本文提出了地理空间基础模型（GeoFMs）的概念，这是一种在大量地理空间数据上通过不同方法预训练的AI/ML模型。论文阐述了GeoFMs带来的核心范式转变，即职责分离：大规模模型提供商负责计算密集的预训练，而领域专家则能快速微调或提示这些模型以完成特定任务。文章探讨了不同类型GeoFMs（如基于掩码自编码的可微调视觉模型和基于对比学习的视觉语言模型）解锁的新能力，讨论了其实际部署的考量，并展望了由大语言模型驱动的、从感知迈向认知的智能地理空间推理（Agentic Geospatial Reasoning）未来愿景。

Details

Motivation: 随着基础模型的出现，卫星和航空影像分析进入新时代，但需要一种专门针对地理空间数据、能实现职责分离以兼顾先进AI能力与下游任务安全保密性的新范式。

Result: 论文未提及具体的定量实验结果或基准测试，而是从概念层面阐述了GeoFMs的范式、能力分类、部署策略框架及其对未来智能地理空间推理的推动作用。

Insight: 创新点在于系统性地提出了地理空间基础模型（GeoFMs）这一新范式，其核心是预训练与下游任务解耦的职责分离思想，并前瞻性地将大语言模型作为智能编排器，整合GeoFMs工具以实现从感知到认知的智能地理空间推理工作流自动化。

Abstract: The analysis of satellite and aerial imagery has entered a new era with the advent of foundation models. This paper describes the concept of Geospatial Foundation Models (GeoFMs), which are artificial intelligence/machine learning (AI/ML) models pre-trained on massive geospatial datasets through varied methodologies. We first articulate the core paradigm shift that GeoFMs enable: a separation of duties, where large-scale model providers perform the computationally intensive pretraining, allowing domain experts to rapidly fine-tune or prompt these models for specific, mission-critical tasks. This approach democratizes access to state-of-the-art AI/ML while maintaining the security and confidentiality of the downstream task. We then explore the novel capabilities unlocked by different types of GeoFMs, distinguishing between the finetunable vision models produced by self-supervised techniques like masked auto-encoding, and the vision-language models produced by contrastive learning which enable zero-shot tasks like open-vocabulary image analysis. Next, we discuss the practical considerations for operationalizing GeoFMs, from performance-cost analysis to the broader MLOps ecosystem. To that end, we introduce a taxonomy of model adaptation strategies and propose a framework for domain experts to select the most cost-effective adaptation approach for their particular mission set. Finally, we present a forward-looking vision of Agentic Geospatial Reasoning, where Large Language Models act as intelligent orchestrators, leveraging GeoFMs as tools to answer high-level user queries in natural language and automate complex analytical workflows, moving the field from perception to cognition.

q-bio.NC [Back]

[80] Real-time fall detection based on vision for low-power edge platforms q-bio.NC | cs.AI | cs.CVPDF

Wenjun Xia, Zhicheng Peng, Haopeng Li, Zhengdi Zhang

TL;DR: 本文提出了一种基于物理知识的实时跌倒检测框架，将跌倒重新定义为耦合动力系统中的稳定性丧失事件。该框架采用双LTC架构，包含质心子系统和支撑面子系统，通过自适应时间常数连续建模惯性轨迹演化和地面接触调整，并引入可学习的耦合模块模拟物理交互，利用稳定性流形分类器检测边界跨越。该方法设计为支持三状态预测范式，在资源受限的边缘设备上实现实时推理。

Details

Motivation: 现有基于视觉的跌倒检测方法主要将其视为静态姿态分类或离散时间模式匹配，忽略了人体支撑系统的不稳定动力学特性，因此需要一种能够连续建模物理动态并具有物理可解释性的实时检测框架。

Result: 在二分类数据集（正常 vs. 跌倒）上验证了核心稳定性判别能力，实验表明该方法在保持竞争力的准确率的同时，具有优越的物理可解释性，并且模型参数量低于5万，适合在低功耗边缘平台上实时运行。

Insight: 创新点在于将跌倒检测重新定义为连续时间动力系统的稳定性问题，采用物理启发的双LTC神经网络架构来建模惯性轨迹和接触调整，并通过李雅普诺夫启发的稳定性指标进行边界检测，增强了模型的物理可解释性和计算效率。

Abstract: Falling detection is vital for elderly care and intelligent surveillance; however, prevailing vision-based approaches predominantly frame it as static pose classification or discrete temporal pattern matching, fundamentally overlooking the instability dynamics of the human support system. This paper proposes a physics-informed falling detection framework that recasts falling as a stability-loss event in a coupled dynamical system. We introduce a novel dual-LTC architecture comprising a Center-of-Mass (CoM) subsystem and a Base-of-Support (BoS) subsystem, both instantiated as Liquid Time-Constant (LTC) neural networks to continuously model inertial trajectory evolution and ground-contact adjustment through adaptive time constants, Physical interpretability of falling motion. A learnable coupling module emulates physical interaction between the two subsystems, while a Stability Manifold classifier operates in the joint latent space to detect boundary crossing via Lyapunov-inspired stability metrics. Complementary counterfactual trajectory projection and Time-to-Collision (TTC) estimation further enable irreversibility assessment and early warning. The architecture is designed to support a three-state prediction paradigm (Normal, Falling, Fallen); in this preliminary study, we validate the core stability discrimination capability on a two-class dataset (Normal vs. Falling), leaving the full three-state temporal transition to future work. Unlike conventional CNN–RNN pipelines, the proposed formulation encodes continuous-time mechanical inertia, yielding a sub-50K-parameter network capable of real-time inference on resource-constrained edge devices. Extensive experiments demonstrate competitive accuracy with superior physical interpretability, validating its efficacy for low-compute visual fall detection.

eess.AS [Back]

[81] The Sound of Absence: Audio-Language Embedding Models Struggle with Negation eess.AS | cs.AI | cs.CL | cs.LG | cs.SDPDF

Chun-Yi Kuan, Hung-yi Lee

TL;DR: 本文揭示了音频-语言嵌入模型（如CLAP）在处理否定概念时的严重缺陷：它们无法区分肯定和否定的声音描述，导致在现有评估中隐藏了这一局限性。作者提出了NegEval-Audio框架，将现有数据集转换为两个否定感知任务（Retrieval-Neg和MCQ-Neg），以测试模型区分存在与缺失事件的能力。实验表明，在AudioCaps和Clotho数据集上，模型在否定任务上的性能急剧下降，甚至低于随机水平，且这一失败也出现在最新的多模态LLM嵌入模型中。尽管无训练的引导方法在MCQ-Neg上有所改进，但对Retrieval-Neg帮助有限，表明肯定偏见是表示几何中的根本缺陷，需要显式的否定感知训练目标。

Details

Motivation: 当前音频-语言嵌入模型（如CLAP）主要在肯定声音事件匹配上进行评估，而忽略了否定概念的处理，这掩盖了模型的关键局限性：无法编码否定的声音概念，导致肯定和否定描述被映射到几乎相同的表示中。

Result: 在AudioCaps和Clotho数据集上，模型在否定任务（Retrieval-Neg和MCQ-Neg）上的性能显著下降，其中否定类型的多项选择准确率远低于随机水平；即使对于最新的多模态LLM嵌入模型，这一失败仍然存在。无训练的引导方法仅对MCQ-Neg有改进，但对Retrieval-Neg的增益有限。

Insight: 论文的创新点在于首次系统性地暴露了音频-语言嵌入模型在否定概念处理上的盲点，并提出了NegEval-Audio框架来量化这一缺陷；从客观角度看，这揭示了肯定偏见是模型表示几何中的根本问题，强调了未来研究需要引入显式的否定感知训练目标以改进模型鲁棒性。

Abstract: Audio-language embedding models such as CLAP are widely evaluated on matching present sound events, but rarely on negation. We show this affirmation-only evaluation hides a key limitation: these models fail to encode negated sound concepts, mapping affirmative and negated captions to nearly identical representations. To expose this blind spot, we introduce NegEval-Audio, a framework that converts existing datasets into two negation-aware tasks, Retrieval-Neg and Multiple-Choice Negation (MCQ-Neg), to probe whether models distinguish present from absent events. On AudioCaps and Clotho, performance degrades sharply under negation, with negation-type MCQ accuracy falling far below chance, and the failure persists even for a recent multimodal LLM-based embedding model. While a training-free steering method improves MCQ-Neg, it yields marginal gains for Retrieval-Neg. This indicates that affirmation bias is a fundamental flaw in the representation geometry, necessitating explicit negation-aware training objectives.

cs.RO [Back]

Robel Mamo, Rajitha de Silva, Grzegorz Cielniak, Taeyeong Choi

TL;DR: 本文提出了一种无监督的日间到夜间跨模态图像翻译框架，可将白天的RGB图像转换为近红外（NIR）夜间图像，从而利用白天语义标签训练夜间感知模型，实现农业机器人的24小时视觉导航。该方法结合了预训练的CLIP模型以保持语义一致性，并引入可见性掩码处理NIR照明范围限制。

Details

Motivation: 现有农业机器人视觉导航系统大多依赖白天条件，而夜间部署具有全天候监测等优势，但缺乏大规模标注的夜间图像数据集。

Result: 在提出的AgriNight数据集上，与现有图像翻译基线相比，该方法获得了更高的图像质量，并提升了夜间语义分割的下游任务性能，支持了夜间实时自主导航实验。

Insight: 创新点在于无监督的跨模态（RGB到NIR）图像翻译框架，利用CLIP保持语义一致性，以及引入可见性掩码处理实际照明限制；同时发布了首个夜间农业视觉导航基准数据集AgriNight。

Abstract: While visual navigation has been extensively studied in agricultural robotics, most existing systems assume daytime conditions. In fact, deploying autonomous robots at night offers significant advantages, including 24-hour crop and soil monitoring, fruit harvesting, and nocturnal pest detection. Modern vision-based systems, however, rely heavily on large-scale well-annotated image datasets, which remains challenging to obtain for nighttime operation scenarios. To address this, we propose an unsupervised image translation framework that converts daytime plant-row RGB images into near-infrared (NIR) nighttime counterparts without requiring pixel-to-pixel supervision. This enables the direct reuse of daytime semantic labels for training nighttime perception models. In particular, by incorporating a pre-trained Contrastive Language-Image Pre-training (CLIP) model, the proposed framework is designed to preserve semantic consistency during day-to-night translation. Additionally, a visibility mask is introduced to account for the limited effective range of NIR illumination in nighttime scenes. We conduct comparative evaluations with state-of-the-art image translation baselines and demonstrate higher image qualities, as supported by improved performance in downstream semantic segmentation for nighttime visual navigation. For evaluation, we utilize AgriNight–a novel dataset comprising 428 daytime and 549 nighttime images collected using night-vision-equipped mobile robots in agricultural fields and manually annotated with pixel-wise semantic labels–and introduce it as the first benchmark for nighttime agricultural visual navigation. We also perform real-time autonomous navigation experiments with a physical robot operating at night. The data and code are available at: https://github.com/mamorobel/AgriNight.

Jiho Hong, Eunae Kang, Sanghyun Kim, Young-Sik Shin

TL;DR: 本文提出了一种名为实例增强语义地图的统一框架，用于提升视觉语言导航任务。该方法通过开放词汇全景分割构建包含实例级2.5D丰富信息的地图，并利用基于大语言模型的鲁棒查询处理来选择目标，在保持高效存储的同时显著提升了导航性能。

Details

Motivation: 现有视觉语言导航系统缺乏实例级的物体细节，且对多样化用户查询的鲁棒性不足，限制了在复杂室内环境中可靠导航的能力。

Result: 在预测归一化曲线下面积指标上，所提出的2.5D表示比3D基线方法高出27%以上。在导航实验中，该方法在物体检索和导航成功率上分别比基线提高了超过17%和23%。

Insight: 核心创新在于将实例级2.5D丰富信息映射、基于LLM的鲁棒查询处理与存储高效的语义表示相结合，形成了一个统一的框架，有效解决了现有方法在细节捕捉和查询泛化方面的不足。

Abstract: Visual Language Navigation (VLN) aims to enable an embodied agent to navigate complex environments by following natural language instructions. Recent approaches build semantic spatial maps and leverage Large Language Models (LLMs) for reasoning and decision making. Despite these advances, existing systems lack instance-level object detail and robustness to diverse user queries, limiting reliable navigation in complex indoor environments. To address these limitations, we propose Instance-Enriched Semantic Maps, a unified framework with three key contributions: (1) Instance-level two-and-a-half-dimensional (2.5D) rich information mapping that constructs maps from color and depth observations via open-vocabulary panoptic segmentation, preserving vertical distinctions and capturing small objects, while storing diverse semantic attributes and natural language captions enriched with room-level context. (2) Robust query processing via LLM-based target selection, which dynamically routes queries across type-specialized experts and integrates their outputs through score-level fusion, enabling consistent goal selection across diverse query formulations. (3) Storage-efficient semantic representation that achieves approximately 96% reduction compared to three-dimensional (3D) scene-graph approaches while preserving sufficient spatial information for navigation. The proposed 2.5D representation outperforms the 3D baseline by over 27% in prediction-normalized Area Under the Curve (AUC). In navigation experiments, our method achieves over 17% improvement in object retrieval and over 23% in navigation success compared to the baseline across diverse query types. The project page is available at https://rcilab.github.io/iesm_vln.

[84] FlowWAM: Optical Flow as a Unified Action Representation for World Action Models cs.RO | cs.CVPDF

Yixiang Chen, Peiyan Li, Yuan Xu, Qisen Ma, Jiabing Yang

TL;DR: FlowWAM提出了一种基于光流的统一动作表示方法，用于世界动作模型（WAMs）。它采用双流扩散框架，将光流作为与预训练视频生成器对齐的视频原生动作表示，同时支持策略模式的动作预测和世界模型模式的未来视频生成。

Details

Motivation: 现有数值动作表示无法与预训练视频生成器对齐，而先前的视觉动作表示忽略了帧间的时间运动结构，因此需要一种既能对齐视频生成器又能提供足够运动线索的动作表示形式。

Result: 在RoboTwin操作任务中，FlowWAM在Clean设置下成功率提升至92.94%，在Random设置下为92.14%，优于VLA和WAM基线。在WorldArena世界建模任务中，它以63.71的EWMScore实现了最佳整体性能，轨迹精度相对提升18.4%。

Insight: 创新点在于将光流作为统一的视频原生动作表示，其与RGB视频格式相同且编码了丰富的像素位移信息，使得模型能利用无动作标签的大规模视频数据进行预训练，并通过共享预训练视频生成器实现动作预测和世界建模的双重功能。

Abstract: World Action Models (WAMs) are able to leverage pretrained video generators for both world modeling and action prediction. However, directly leveraging such video generators for control raises a new challenge: how to represent actions in a suitable form that aligns with pretrained video generators while carrying enough motion cues for accurate control. Existing numerical actions fail to satisfy the former, and prior visual action representations overlook the temporal motion structure across frames. We address this issue with FlowWAM, a dual-stream diffusion framework that adopts optical flow as a unified, video-native action representation. Flow videos share the same format as RGB videos and encode rich per-pixel displacement. By jointly modeling them within a shared pretrained video generator, FlowWAM can naturally implement two modes of WAMs. In policy mode, FlowWAM generates flow for action prediction, while in world-model mode, it uses target flow sequences to guide future video generation. Moreover, since flow can be easily extracted from raw videos without action labels, FlowWAM can leverage large-scale action-unlabeled video datasets for pretraining. We empirically find that our flow-based action representation delivers gains across both modes. On RoboTwin manipulation, FlowWAM raises the success rate to 92.94% on the Clean setting and 92.14% on Random, outperforming both VLA and WAM baselines. On WorldArena world modeling, it achieves the best overall EWMScore (63.71) with an 18.4% relative improvement in trajectory accuracy. More results can be found on our project website: https://flow-wam.github.io .

cs.NE [Back]

[85] Do You Remember? Toward Memory-Centric Multimodal AI cs.NE | cs.AI | cs.CV | cs.LGPDF

Xuguang Yu, Weigang Zheng, Minyue Yu

TL;DR: 论文《Do You Remember? Toward Memory-Centric Multimodal AI》提出了一种名为DoYouRemember的三阶段架构，旨在为多模态大语言模型（MLLMs）引入重构性记忆能力。该架构通过VQ-VAE压缩图像为离散视觉令牌，利用LoRA微调的LLM联合处理视觉和文本令牌，并使用扩散解码器从LLM隐藏状态重建图像。研究发现，LLM隐藏状态几乎不包含可恢复的视觉信息，表明LLM能理解图像但无法记忆。通过局部EMA更新策略训练共享记忆矩阵M，有效解决了梯度抵消问题，实现了接近或超越VQ上界的压缩性能，并从信息论角度将记忆定义为有损压缩，回忆为解压缩，幻觉视为有损解压缩的固有属性。

Details

Motivation: 当前多模态LLMs（MLLMs）缺乏人类记忆的重构性能力，它们通过冻结的视觉编码器处理图像，生成一次性文本输出并丢弃内部表示，无法像人类记忆那样进行重建。论文旨在解决MLLMs中记忆缺失的问题，引入重构性记忆以提升模型对视觉信息的长期保留和回忆能力。

Result: 在1,000个3D面部皮肤纹理图和99,000个未标记面部图像上实验，发现LLM隐藏状态几乎不含可恢复视觉信息（解码器从隐藏状态输出纯噪声）。通过局部EMA更新训练的记忆矩阵M（229K参数，16倍压缩）在未见测试图像上接近VQ上界，扩展到1,024个槽位时甚至超越VQ上界（LPIPS 0.056 vs. 0.071），表明连续表示避免了VQ量化误差。

Insight: 创新点包括：三阶段架构将重构性记忆集成到MLLMs中，揭示了LLM隐藏状态缺乏视觉记忆的局限性；提出局部EMA更新策略解决共享记忆矩阵训练中的梯度抵消问题，提升记忆效率；从信息论框架统一记忆为有损压缩、回忆为解压缩，将幻觉重新定义为有损解压缩的固有特性而非缺陷，为多模态AI的记忆设计提供了新视角。

Abstract: Human memory is reconstructive, not a faithful recording. Current multimodal LLMs (MLLMs) lack this capability: they process images through a frozen visual encoder, produce a one-shot text output, and discard internal representations. We present DoYouRemember, a three-stage architecture introducing reconstructive memory into MLLMs: (1) a VQ-VAE compresses images into discrete visual tokens, (2) a LoRA-fine-tuned LLM jointly attends to visual and text tokens, and (3) a Diffusion Decoder reconstructs images from the LLM’s hidden states. On 1,000 3D facial skin texture maps and 99,000 unlabeled facial images, we find that LLM hidden states contain approximately zero recoverable visual information – the same Decoder producing clear reconstructions from VQ-VAE tokens (pre-LLM) produces pure noise from LLM hidden states (post-LLM), demonstrating that the LLM understands images but does not remember them. Training a shared memory matrix M under backpropagation systematically fails due to gradient cancellation (O(1/sqrt(N)) attenuation). We identify three root causes and show that local EMA updating resolves all three: each image updates only its top-8 slots out of 64, preserving inter-slot diversity. The resulting M (229K parameters, 16x compressed) approaches the VQ upper bound on unseen test images. Scaling to 1,024 slots surpasses it (LPIPS 0.056 vs. 0.071), as M’s continuous representation avoids VQ quantization error. We unify these findings under an information-theoretic framework: memory is lossy compression, recall is decompression, and hallucination is an inherent property of lossy decompression rather than a defect.

cs.LG [Back]

[86] Learning Mechanistic Reasoning for Chemical Reactions with Large Language Models cs.LG | cs.CE | cs.CL | q-bio.BMPDF

Xingyu Dang, Haocheng Tang, Junmei Wang, Yanjun Li

TL;DR: 该论文提出了一种通过构建大规模反应机理推理数据集来增强大语言模型化学推理能力的方法。作者创建了FukuyamaBench基准，并通过对Qwen3-30B-A3B模型进行微调，使其在机理推理任务上超越了专门的FlowER模型。

Details

Motivation: 当前化学大语言模型主要关注粗粒度的命名反应进行产物预测和逆合成分析，常导致物理不一致性和幻觉；而专门的机理推理小模型则泛化能力有限。论文旨在通过机理感知训练来克服这些限制，提升大语言模型的基础化学智能。

Result: 在从Fukuyama《高等有机反应机理》一书衍生的困难基准FukuyamaBench Set A上，微调后的Qwen3-30B-A3B模型实现了8.3%的精确路径匹配率，超过了专门的FlowER模型（5.1%）。

Insight: 论文的核心创新在于构建了一个新颖的大规模反应机理推理数据集，并建立了分层的机理推理评估基准FukuyamaBench。这证明了将逐步演绎的机理逻辑与大语言模型的推理范式对齐，能有效提升其化学推理的准确性和物理一致性。

Abstract: Reaction mechanisms consist of the step-by-step sequences of elementary reactions that explain chemical transformations. Learning the mechanism logic is therefore essential for enhancing the fundamental chemical intelligence of large language models (LLMs). The stepwise deduction of reaction mechanism aligns naturally with the reasoning paradigms of reasoning LLMs. However, current chemical LLMs primarily emphasize coarse-grained name reactions for product prediction and retrosynthesis, often leading to physical inconsistencies and hallucinations. In contrast, specialized small-scale generative models for mechanism inference typically suffer from restricted generalization capacity across diverse chemical spaces. To overcome these limitations, we built a novel, large-scale reasoning dataset of reaction mechanisms. Furthermore, we established the FukuyamaBench, a difficult benchmark derived from Fukuyama’s Advanced Organic Reaction Mechanism book, to rigorously evaluate model performance on hierarchical mechanism reasoning. Our fine-tuned Qwen3-30B-A3B achieves 8.3% exact pathway match on FukuyamaBench Set~A, surpassing the specialized FlowER model (5.1%), demonstrating that mechanism-aware training substantially enhances chemical reasoning in language models.

[87] Continual Learning with Elastic Regularization and Synthetic Replay for Federated MLLM Fine-Tuning cs.LG | cs.AI | cs.CV | cs.DCPDF

Jing Liu, Chenxuanyin Zou, Jiayang Ren, Gaoyun Fang, Chengfang Li

TL;DR: 本文提出联邦持续多模态学习框架FedCMM，用于解决联邦微调多模态大语言模型时面临的灾难性遗忘问题。该框架通过参数级的模态感知弹性权重巩固、数据级的轻量级本地生成回放模块，以及聚合级的任务相似性感知梯度聚合，在三个互补层面嵌入持续学习保障机制。

Details

Motivation: 动机在于解决分布式网络中多模态大语言模型联邦微调时，因顺序任务更新导致的灾难性遗忘问题，这对于在安全敏感领域（如内容审核）部署自主网络AI系统至关重要。

Result: 在两个基准测试上的大量实验表明，FedCMM在准确性和后向迁移方面持续优于近期基线方法，证实了其整体、模态感知的优化策略能够在异构网络AI部署中实现稳健的进化适应。

Insight: 创新点在于将持续学习保障机制分层嵌入联邦优化循环：参数级采用模态感知的弹性权重巩固提供细粒度保护；数据级通过本地生成回放模块合成无原始数据的嵌入级多模态回放元组；聚合级引入任务相似性感知的梯度聚合以稳定全局学习轨迹。

Abstract: Federated fine-tuning of Multimodal Large Language Models (MLLMs) across distributed networks enables privacy-sensitive adaptation to evolving data streams, yet a fundamental obstacle prevents robust deployment in dynamic environments: catastrophic forgetting, wherein sequential task updates erase previously acquired knowledge across visual, linguistic, and cross-modal representations. Addressing this challenge is especially critical for autonomous networked AI operating in safety-sensitive domains, such as content moderation, where reliable retention of prior knowledge underpins system integrity. To overcome this, we propose Federated Continual Multimodal Learning (FedCMM), a framework that embeds continual-learning safeguards into the federated optimization loop at three complementary levels. At the parameter level, modality-aware elastic weight consolidation computes separate Fisher information matrices for the vision encoder, language backbone, and cross-modal projector, providing granular, asymmetry-aware protection against modality-specific forgetting. At the data level, each client trains a lightweight local generative replay module to synthesize raw-data-free embedding-level multimodal replay tuples without any raw data sharing. At the aggregation level, Task-similarity-aware gradient aggregation autonomously filters and reweights client updates by gradient cosine similarity, suppressing conflicting directions and stabilizing the global learning trajectory. Extensive experiments on two benchmarks demonstrate that FedCMM consistently outperforms recent baselines on accuracy and backward transfer, confirming that holistic, modality-aware optimization enables robust evolutive adaptation across heterogeneous networked AI deployments.

[88] The Seriality Gap in Video Diffusion Models cs.LG | cs.CVPDF

Jorge Diaz Chao, Konpat Preechakul, Yuxi Liu, Yutong Bai

TL;DR: 本文研究了视频扩散模型在处理序列因果事件（如多球碰撞动力学）时的性能瓶颈，发现标准双向视频扩散模型在因果链增长时性能下降，而单球控制实验表明问题根源在于依赖事件结构而非视频长度。作者将这种现象定义为’序列性差距’，即任务所需的序列计算能力与模型去噪循环无法提供可扩展序列计算之间的不匹配。

Details

Motivation: 解决视频扩散模型在模拟序列因果事件（如多球连续碰撞）时性能随因果链增长而下降的问题，探究模型在序列推理任务上的根本局限性。

Result: 在多球硬球动力学控制实验中，标准双向视频扩散模型性能随因果链延长而下降，增加去噪步数无效；单球控制实验性能下降基本消失。自回归/分块生成和增加架构深度等方法能提升性能，但无法根本解决序列计算瓶颈。

Insight: 创新点在于提出’序列性差距’概念，并理论证明对于确定性视频预测，去噪步数无法为骨干网络增加额外序列计算，揭示了视频扩散模型在序列推理任务上的结构性障碍；实践上可通过自回归生成或增加模型深度缓解问题。

Abstract: When one ball strikes another, then another, video models should predict the consequences of each bounce. In controlled experiments on multi-ball hard-sphere dynamics, we find that the performance of standard bidirectional video diffusion degrades as the causal chain lengthens, even when provided more denoising steps. In a length-matched single-ball control, where ball-ball interactions are absent, the degradation largely disappears, isolating dependent-event structure rather than video length as the cause. Across intervention studies, methods that increase effective serial computation improve performance disproportionately, including autoregressive/blockwise generation and architectural depth. We identify this pattern as the seriality gap: a mismatch between tasks requiring growing serial computation and video diffusion models whose denoising loop does not provide scalable serial compute. We then prove that, for deterministic video prediction, denoising steps do not add serial computation beyond the backbone, indicating a structural obstacle for video diffusion on serial reasoning and simulation tasks.

Table of Contents

cs.CL [Back]

[1] G-SHARE: A Guideline-Based Structured Reasoning Framework for Human-Factor Event Diagnosis cs.CL | cs.AIPDF

[2] CANDI: Contextual Alignment for Niche Domains Question Answering cs.CL | cs.AIPDF

[3] Scaling Point-in-Time Language Models cs.CL | cs.AIPDF

[4] I’m Sorry, but I Can’t Help with Braille: Revealing Accessibility Failures in State-of-the-Art LLMs cs.CL | cs.AIPDF

[5] Graph-Based Detection of Disinformation Narrative Diffusion between Russian and Ukrainian Telegram Channels cs.CL | cs.AIPDF

[6] Fine-Tuned Multi-Agent Framework for Detecting OCEAN in Life Narratives cs.CL | cs.LG | cs.MAPDF

[7] LakeQuest: A Three-Domain Benchmark for Grounded Question Answering across Data Lakes cs.CL | cs.AIPDF

[8] Ring-Zero: Scaling Zero RL to a Trillion Parameters for Emergent Reasoning cs.CLPDF

[9] WikiSTAR: A System for Shedding Light on the Hidden History of Scientific Wikipedia Articles cs.CLPDF

[10] Segregate, Refine, Integrate: Decomposing Multimodal Fusion for Sentiment Analysis cs.CLPDF

[11] From Critic to Confidence: PPO for Language-Based Quantitative Prediction with Confidence Estimation cs.CL | cs.AIPDF

[12] Less Experts, Faster Decoding: Cost-Aware Speculative Decoding for Mixture-of-Experts cs.CL | cs.AI | cs.DCPDF

[13] Epistemic Stance Flexibility Probing: Measuring Prompt-Conditioned Register Shift in Large Language Models cs.CLPDF

[14] Knowledgeless Language Models: Suppressing Parametric Recall for Evidence-Grounded Language Modeling cs.CLPDF

cs.CV [Back]

[15] TSCA-Net: Temporal-Spatial Clique Attention for Interpretable Multimodal Pedestrian Trajectory Prediction cs.CVPDF

[16] Anomalous Frame Detection Using VLM-Based Description Comparison for Extracting Expert-Specific Actions and Contextual Decision-Making Scenes with Intra-Video Self-Similarity cs.CVPDF

[17] Anatomy-Privileged Distillation with Token Routing for MRI-Based Prediction of Perineural Invasion cs.CVPDF

[18] SymbOmni: Evolving Agentic Omni Models via Symbolic Concept Learning cs.CV | cs.LGPDF

[19] An Empirical Analysis of Continual Learning for Heterogeneous Medical Visual Question Answering cs.CV | cs.AI | cs.CLPDF

[20] Causal Supervision of Attention for Affective Behaviour Analysis cs.CVPDF

[21] NEEDL-Bench: Dataset for Swiss Needle Cast and Stomata Detection in Microscopy Images cs.CVPDF

[22] A Calibrated Multimodal Ensemble for Ambivalence/Hesitancy Recognition: System Description and Private-Test Submission Strategy cs.CVPDF

[23] Overview of Cross-Component In-loop Filters in Video Coding Standards cs.CVPDF

[24] RegHead: Non-Humanoid Head Blendshapes via Feed-Forward Registration cs.CV | cs.GRPDF

[25] Beyond Perfect Priors: Adaptive Gaussian Graph for 4D Driving Reconstruction in the Wild cs.CVPDF

[26] The GEST-Engine: From Event Graphs to Synthetic Video. A Full Technical Report cs.CVPDF

[27] Auditing Data Leakage in Whole-Slide Image Multimodal Benchmarks cs.CV | cs.LGPDF

[28] Rough Path Signature-Guided Geometry Augmentation for Few-Shot Industrial Surface Defect Detection cs.CV | cs.LG | math.PRPDF

[29] Semantic-Edge Response Decoding of SAM3 for Zero-Shot Crack Segmentation cs.CVPDF

[30] MobileSAM2: Lightweight Segment Anything for Spatial Intelligence cs.CVPDF

[31] Adaptive Cross-Modal Fusion with Sparse Attention for Pedestrian Crossing Intention Prediction cs.CVPDF

[32] DM-KG: A Novel Method for Boosting Spatial Cognition of Vision-Language Models in Street View Imagery cs.CVPDF

[33] ProtoPointNet: Prototype-Based Interpretable Classification of 3D Dental Point Clouds with Verifiable Spatial Activations cs.CVPDF

[34] What Does a Temporal Benchmark Score Measure? Decomposing Channel Use in Video VLM Evaluation cs.CV | cs.LGPDF

[35] ACID: Adaptive Caching for vIDeo generation cs.CVPDF

[36] Lost in Visual Translation: A VLM-Assisted Perceptual-Semantic Coherence Framework for EEG-to-Image Reconstruction cs.CV | cs.AIPDF

[37] UMSS: Towards Unsupervised Multi-modal Semantic Segmentation cs.CVPDF

[38] IQA-T1: Tool-based Visual Evidence Reasoning for Image Quality Assessment cs.CV | cs.AI | eess.IVPDF

[39] MQAdapter: Multi-Modal Quantum Adapter for Coarse-to-Fine VLM Fine-tuning cs.CVPDF

[40] Contrastive-Augmented Flow Matching for Style-Content Disentanglement cs.CVPDF

[41] DeGuNet: Depth-Guided Ultra-Compact Backbones for Efficient LiDAR-Camera 3D Detection cs.CVPDF

[42] More Than Where You Are: Learning Semantics, Structure, and Geometry from Cross-View Localization cs.CVPDF

[43] Let RGB Be the Language of Vision cs.CVPDF

[44] Steering Diffusion Models via Class-Contrastive Influence for Few-Shot Medical Classification cs.CV | cs.LGPDF

[45] TerraLogic: A Benchmark for Hierarchical Geospatial Reasoning in Earth Observation cs.CVPDF

[46] Self in Space: Benchmarking Self-Awareness and Spatial Cognition in UAV Embodied Intelligence cs.CVPDF

[47] DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMs cs.CVPDF

[48] Gaussian Mixture Modeling for Event-Aware Visual Allocation in Long Video Understanding cs.CVPDF

[49] WanToFight: Real-Time Generative Game Engine for Multi-Player Combat Interaction cs.CVPDF

[50] Decouple and Reason: Anatomically Guided Two-Stage Voxel-Level Grounding of Free-Text Findings in 3D Chest CT cs.CVPDF

[51] Text-Aided Multi-Modal Panoptic Symbol Spotting for CAD Floor Plan Drawings cs.CV | cs.AIPDF

[52] MAGE: Color-Invariant and Spatial Knowledge Distillation for Gastric Neoplasm Classification cs.CVPDF

[53] Towards Vision-Free CIR: Attribute-Augmented Scoring and LLM-Based Reranking for Zero-Shot Composed Image Retrieval cs.CV | cs.IRPDF

[54] ReflectVLN: Training Vision-Language Navigation Agents with Reflective Reasoning cs.CVPDF

[55] CRC-HGD: A Histopathological Image Dataset for Grading Colorectal Cancer cs.CVPDF

[56] MambaPSA: A Mamba-based Replacement for C2PSA in YOLO26 cs.CVPDF

[57] Hallo4D: Multi-Modal Hallucination Mitigation for Consistent Spatio-Temporal Generation cs.CV | cs.AIPDF

[58] VisCo: Leveraging Large Language Models as Intrinsic Encoders for Visual Token Compression cs.CVPDF

[59] RFMSR: Residual Flow Matching for Image Super-Resolution cs.CVPDF

[60] EvoGraph-R1: Self-Evolving Multimodal Knowledge Hypergraphs for Agentic Retrieval cs.CVPDF

[61] ExtraGS: Enhancing Endoscopic View Extrapolation via Diffusion-Guided 3D Gaussian Splatting cs.CVPDF

[62] HSEmotion Team at the 11th ABAW Challenge: Multi-Task Learning and Ambivalence/Hesitancy Video Recognition cs.CV | cs.AIPDF

[63] CoRe: A Comprehensive Framework for Cross-Image Comparative Reasoning in Vision-Language Models cs.CVPDF

[64] Breaking Déjà Vu: Independent Auditing of Visual Place Recognition through Vision-Language Reasoning cs.CVPDF

[65] LARAD: Layout-Aware Road Anomaly Detection via Spatial-Logic Reasoning cs.CVPDF

[66] AVSCap: Orchestrating Audio-Visual Synergy for Omni-modal Video Captioning cs.CVPDF

[67] UniVR: Thinking in Visual Space for Unified Visual Reasoning cs.CVPDF

[68] Metric-Guided Synthetic Image Data Rendering for Deep Learning compatible with Agentic AI cs.CV | q-bio.QMPDF

[69] Hy-Embodied-VLM-1.0: Efficient Physical-World Agents cs.CVPDF

[70] UniMedSeg: Unified In-Context Learning for Multi-Paradigm 2D/3D Medical Image Segmentation cs.CVPDF

[71] Inhibited Self-Attention: Sharpening Focus in Vision Transformers cs.CVPDF

[72] Open-KNEAD: Knowledge-grounded Nutrition Estimation via Agentic Decomposition cs.CVPDF

[73] ViCo3D: Empowering LiDAR-based Collaborative 3D Object Detection with Vision Foundation Models cs.CVPDF

cs.AI [Back]

[74] A Learning-Rate-Gated Failure of GRPO in a Small Language and Vision-Language Model Web Agent: A Controlled Null and Its Mechanism cs.AI | cs.CLPDF

[75] Function-Aware Fill-in-the-Middle as Mid-Training for Coding Agent Foundation Models cs.AI | cs.CLPDF

[76] Tracing Agentic Failure from the Flow of Success cs.AI | cs.CLPDF