cs.CL [Total: 8]
cs.CV [Total: 49]
cs.SE [Total: 1]
eess.IV [Total: 1]
cs.LG [Total: 1]
cs.GR [Total: 1]
cs.AI [Total: 2]

cs.CL [Back]

[1] Letter Lemmatization: One-to-one and Banded RNNs for Reversing Character-Set Simplification and Abbreviation in Medieval Text cs.CL | cs.CVPDF

Anguelos Nicolaou, Maria Pia Tiseo, Tamas Kovacs, Nicolas Renet, Georg Vogeler

TL;DR: 本文提出了一种名为’字母词形还原’的方法，用于处理中世纪文本中字符集简化和缩写的问题。通过训练字符级的一对一RNN和带约束的RNN，能够灵活地在不同字符集之间转换，并成功扩展缩写。

Details

Motivation: 解决中世纪文献转录中因转录实践和数字化政策差异导致的字符集不一致问题，实现字符集间的灵活转换。

Result: 在仅使用20行文本的情况下，CER（字符错误率）恢复了一半；在HTR后校正中取得了显著改进，并成功扩展了中世纪宪章转录中的缩写。

Insight: 创新点包括使用自监督的一对一RNN进行字符映射、提出带约束的RNN处理对齐数据，以及引入基于语义相似性的字符度量启发式方法，并提供了高效的Python库实现。

Abstract: Medieval document transcribers have very different practices; on top of that, heterogeneous digitization policies have resulted in corpora where the character-set must be viewed as fluid. In this paper we address the problem of changing between character-sets in a flexible manner. We focus on one-to-one character mappings and train characterlevel one-to-one RNNs to undo them with self-supervision; recovering half the CER even with 20 text lines. We analyse the use of these one-to-one networks for HTR post-correction and we see that they obtain significant improvements while totally ignoring ins-dels. We then use the exact same networks with character-level alignment groundtruth compiled from parallel corpora in a training and inference mode we call Banded RNNs. We use such networks to successfully expand abbreviations in medieval charter transcriptions. Finally we introduce an elaborate heuristic which takes the characters of two arbitrary character-sets and defines a metric encapsulating what we consider to be semantic similarity of characters. We call the construction of such mappings letter lemmatization and present a rich Python library that efficiently performs all presented methods.

[2] AgentKGV: Agentic LLM-RAG Framework with Two-Stage Training for the Fact Verification of Knowledge Graphs cs.CLPDF

Yumin Heo, Hyeon-gu Lee, Sumin Seo, Youngjoong Ko

TL;DR: 本文提出了AgentKGV，一个用于知识图谱事实验证的智能体化LLM-RAG框架。该框架集成了动态路由和迭代查询重写，以处理文档级检索中的表面形式不匹配问题。为了提升工业部署的准确性和成本效益，论文进一步引入了两阶段训练策略：基于回合级蒸馏的SFT和轨迹级GRPO，以优化搜索策略并减少不必要的检索。

Details

Motivation: 知识图谱通常从大规模语料库自动构建，不可避免地包含因噪声源和抽取失败导致的事实错误，在工业规模上可靠地验证这些事实仍是一个关键挑战。

Result: 在开放域T-REx基准的长尾谓词分割上，该框架将宏观F1分数相比单轮RAG提升了5.5个百分点，两阶段训练进一步提升了9.4个百分点。GRPO还将平均搜索调用次数从3.24次降低到1.63次，且未降低准确性。

Insight: 创新点在于将智能体范式与RAG结合，通过动态路由和迭代查询重写处理检索不匹配；两阶段训练策略（蒸馏SFT和GRPO）有效平衡了模型性能与推理成本，为工业级知识图谱验证提供了可扩展的解决方案。

Abstract: Knowledge graphs (KGs) are often automatically constructed from large-scale corpora, but they inevitably contain factual errors due to noisy sources and extraction failures, and verifying them reliably at industrial scale remains a critical challenge. To address this, we propose AgentKGV, the Agentic LLM-RAG framework for KG fact Verification, that integrates dynamic routing and iterative query rewriting, which handles surface-form mismatch in document-level retrieval. To make this framework more accurate and cost-efficient for industrial deployment, we further introduce a two-stage training strategy: turn-level distillation-based SFT that transfers reasoning ability from a large teacher model into a small model for stable query rewriting and reasoning, and trajectory-level GRPO that optimizes the search policy to reduce unnecessary retrieval at scale. On the long-tail-predicate split of the open-domain T-REx benchmark, our framework improves macro-F1 over single-turn RAG by 5.5 %p, and two-stage training does it further by 9.4 %p. GRPO also cuts the average number of search calls from 3.24 to 1.63 without lowering accuracy.

[3] HALO: Hybrid Adaptive Latent Reasoning for Language Models cs.CL | cs.LGPDF

Micah Zhang

TL;DR: 论文提出了HALO（混合自适应潜在推理）方法，旨在通过少量自适应额外计算来改进冻结的预训练语言模型。该方法结合了粗粒度精炼阶段和选择性第二阶段潜在精炼，通过令牌评分和单调令牌停止机制选择部分令牌进行二次精炼。在基于MMLU-Pro和GPQA-Diamond构建的公开基准测试中，HALO在面向论文的方法中取得了最佳平均性能。

Details

Motivation: 研究动机是改进冻结预训练语言模型，避免固定额外精炼步骤带来的计算浪费问题，例如单步精炼头可能能力不足，而强制进行全序列二次精炼则会增加计算开销却未必提升迁移效果。

Result: 在MMLU-Pro和GPQA-Diamond构建的主要公开基准测试中，HALO在面向论文的方法中取得了最佳整体平均性能，优于冻结主干模型、固定单步精炼和固定双步精炼方法。内部分析显示，HALO在达到与固定双步精炼相近的令牌准确率的同时，使用的平均精炼步骤少于固定单步精炼，远少于固定双步精炼。

Insight: 创新点在于提出了混合自适应潜在精炼机制，通过令牌评分和单调停止策略动态分配精炼计算资源。关键优势在于不是简单地增加精炼步骤，而是实现更优的精炼分配策略，在保持高性能的同时显著降低计算开销。

Abstract: We study how to improve a frozen pretrained language model with a small amount of adaptive extra computation. A simple approach is to add additional refinement steps on top of the backbone hidden states, but fixed extra refinement can be wasteful: a one-step refinement head may be too weak, while forcing a second full-sequence refinement step everywhere can increase compute without improving transfer. We introduce HALO, a hybrid adaptive latent-refinement method that combines a coarse refinement stage with selective second-stage latent refinement on a subset of tokens chosen by token scoring and monotonic token halting. On the main public benchmark comparison built from MMLU-Pro and GPQA-Diamond, HALO achieves the best overall average among the paper-facing methods, outperforming the frozen backbone, fixed-1, and fixed-2. Internal analysis further shows that HALO reaches nearly the same token-accuracy level as fixed-2 while using fewer average applied refine steps than fixed-1 and far fewer than fixed-2. These results suggest that the key advantage is not simply more refinement, but a better allocation of refinement: HALO achieves the strongest paper-facing result while also using less measured controller compute than either fixed baseline.

[4] WILDTRACE: Benchmarking Natural Evidence Trails in Long-Context Reasoning cs.CL | cs.AIPDF

Zixin Chen, Peng Liu, Haobo Li, Rui Sheng, Jianhong Tu

TL;DR: WILDTRACE是一个用于评估长文档推理中自然证据链的新基准，包含481个任务和214个自然长文档源（如技术事故报告和文学叙事）。它旨在解决现有基准中证据分布、位置或风格与真实文档不一致的问题，通过定义七种源内部证据几何结构来刻画长文档分析中的关系需求。

Details

Motivation: 现有长文档问答基准（如针探测试、植入事实）中的证据往往与宿主文本在分布、位置或语域上存在差异，导致模型性能可能反映的是分布伪影而非真正的源推理能力。因此，需要构建一个证据链完全源自文档自身因果、时间和叙事逻辑的基准，以评估模型在真实世界长文档分析中整合分散证据的能力。

Result: 论文构建了包含481个任务的WILDTRACE基准，并基于Pearl因果层次和先前多跳推理类型学定义了七种源内部证据几何结构。通过源优先的构建流程和多阶段验证（包括线索必要性、答案基础性、标准忠实度、抗污染性和可回答性）确保了任务质量。

Insight: 创新点在于提出了一个完全基于自然长文档内部证据链的基准，避免了人为植入证据带来的分布偏差。通过定义七种证据几何结构，系统化地刻画了长文档分析中复杂的证据关系，为评估模型在真实世界高风险分析任务中的推理能力提供了更可靠的测试平台。

Abstract: Answering complex questions over long documents frequently requires integrating evidence that the source itself disperses naturally across distant passages. In an incident report, the operating condition, design flaw, and missed safety check that jointly explain a disaster may appear dozens of sections apart; in a novel, a character’s true motive may surface only through scenes far removed from the moment it becomes relevant. This source-internal evidence integration is central to real-world long-document analysis, yet existing benchmarks largely sidestep it. Needle probes, planted facts, and reverse-engineered multi-hop chains embed evidence that may differ from the host text in distribution, placement, or register, making it unclear whether strong performance reflects genuine source reasoning or distributional artifacts. We introduce WILDTRACE, a benchmark of 481 tasks over 214 naturally occurring long-form sources such as technical incident reports and lesser-known literary narratives, where all evidence trails arise from the document’s own causal, temporal, and narrative logic. Drawing on Pearl’s causal hierarchy and prior multi-hop reasoning typologies, we define seven source-internal evidence geometries that characterize the distinct relational demands of analytical reading in long documents. A source-first construction pipeline mines candidate trails from document structure before writing questions; each item then undergoes multi-stage validation covering clue necessity, answer groundedness, rubric fidelity, contamination resistance and answerability. As models are increasingly entrusted with real-world high-stakes analytical tasks, this gap between accessing information and reasoning over naturally dispersed evidence emerges as a defining challenge for the next stage of long-context research.

[5] DKCD: Domain Knowledge-Enhanced Causal Discovery from Unstructured Data cs.CLPDF

Xin Li, Jin Li, Shoujin Wang, Kun Yu, Fang Chen

TL;DR: 本文提出了一种名为DKCD的领域知识增强因果发现框架，用于从医疗、金融等高专业领域的非结构化数据中构建因果图。该框架通过三个相互关联的组件——知识挖掘、知识引导的因果推理和因果结构发现——来解决现有方法在识别潜在因果因素和进行可靠因素标注方面的局限性。

Details

Motivation: 现有方法利用大语言模型（LLMs）的通用知识从非结构化数据中识别因果因素并标注为结构化数据以构建因果图，但面临两大挑战：一是因缺乏领域特定知识而无法充分识别数据中隐含但对因果发现至关重要的潜在因素；二是因缺乏基于领域的推理而导致因素标注不可靠，从而将错误传播到最终的因果图中。

Result: 在两个特定领域数据集上的实验表明，DKCD在因果因素识别和因果图构建方面均有显著提升。

Insight: 论文宣称的创新点在于引入了一个整合领域知识的三阶段框架，通过知识挖掘和知识引导的推理来增强潜在因素发现和标注的准确性。从客观角度看，其核心创新在于将外部领域知识系统地融入因果发现流程，以弥补LLMs在专业领域知识上的不足，从而提升从非结构化数据中构建可靠因果模型的能力。

Abstract: Causal discovery from unstructured data is a challenging yet underexplored task in high-expertise domains such as healthcare, finance, and education. Existing methods typically leverage the general knowledge of large language models (LLMs) to identify causal factors from unstructured data and annotate them into structured data for causal graph construction. However, they remain limited by two key challenges (CHs): (CH1) insufficient identification of latent factors, which are implicit in the data yet essential for causal discovery, due to the lack of domain-specific knowledge; and (CH2) unreliable factor annotation, caused by the lack of domain-grounded reasoning, which propagates errors to the resulting causal graphs. To address these challenges, we introduce a novel Domain Knowledge-enhanced Causal Discovery framework (DKCD) for causal discovery from unstructured data in high-expertise domains with three interconnected components: (1) Knowledge Mining: It retrieves relevant domain knowledge based on observable factors to support subsequent causal reasoning. (2) Knowledge-guided Causal Reasoning: Reasoning with relevant knowledge, it discovers latent causal factors to address CH1 and generates key causal clues for more accurate data annotation to address CH2. (3) Causal Structure Discovery: It constructs the final causal graphs based on a more complete factor set and accurate annotations. Experiments on two domain-specific datasets show that DKCD significantly improves both causal factor identification and causal graph construction.

[6] Self-Guided Test-Time Training for Long-Context LLMs cs.CL | cs.AIPDF

Xinyu Zhu, Zhe Xu, Xiaohan Wei, Yunchen Pu, Fei Tian

TL;DR: 本文提出了一种自引导的测试时训练方法（S-TTT），旨在提升大语言模型在长上下文场景下的推理能力。该方法的核心思想是：在测试时，模型首先自动识别输入长文本中与当前问题最相关的证据片段，然后仅在这些选定的片段上进行参数自适应训练，从而避免在无关噪声片段上训练导致的性能下降。

Details

Motivation: 现有大语言模型在处理长上下文时，即使扩展了上下文窗口，也常常无法有效利用长输入中的关键信息，导致准确率下降。标准的测试时训练方法若应用于整个长上下文或随机采样的片段，会因大量无关噪声而损害模型性能，因此需要一种能精准定位相关证据进行自适应的机制。

Result: 在两个具有挑战性的长上下文推理基准测试LongBench-v2和LongBench-Pro上，S-TTT方法显著提升了Qwen3-4B-Thinking-2507和Llama-3.1-8B-Instruct模型的准确率，实现了最高达15%的相对性能改进。

Insight: 论文的创新点在于将测试时训练与自引导的证据定位相结合，通过先识别关键证据片段再进行针对性训练，有效解决了长上下文中噪声干扰的问题。这种“先筛选，后适应”的范式为提升模型在长文档任务中的推理效率提供了一种轻量且高效的解决方案。

Abstract: Long-context processing has become increasingly important for large language models (LLMs), but simply extending the context window does not guarantee effective utilization of long inputs. As input length grows, accuracy often degrades, indicating that models still struggle to identify and use the evidence most relevant to a question. A promising way to improve long-context utilization is test-time training (TTT), which treats the test context as a training example for instance-specific parameter adaptation. However, applying TTT to the entire long context is prohibitively expensive, while adapting on randomly sampled spans introduces severe noise. Because most spans in a long context are irrelevant to the specific question, training on them may even degrade the base model’s performance. Our preliminary study shows that TTT is highly sensitive to training-span quality: on LongBench-v2, TTT on randomly sampled spans hurts performance, whereas TTT on oracle spans substantially improves it. Motivated by this, we propose a simple method, Self-Guided TTT (S-TTT): before adaptation, the model identifies the evidence spans it should learn from, and the standard language-modeling training objective is applied only to those selected spans. On two challenging long-context reasoning benchmarks, LongBench-v2 and LongBench-Pro, S-TTT improves accuracy for both Qwen3-4B-Thinking-2507 and Llama-3.1-8B-Instruct, achieving up to a 15% relative improvement.

[7] Test-Time Scaling for Small VLMs on Multilingual Visual MCQ cs.CL | cs.AI | cs.LGPDF

Spiros Baxevanakis, Peng-Jian Yang

TL;DR: 本文研究了测试时缩放（TTS）在小型开源视觉语言模型（如Qwen2.5-VL-7B-Instruct和Qwen3.5-4B）上的有效性，特别是在多语言视觉选择题基准EXAMS-V上。研究发现，TTS成功的关键在于运行条件（如提示格式的可解析性和解码预算），而非复杂的搜索或验证机制。通过优化提示格式（添加标准答案提示和引导修复步骤）并增加每链的解码令牌限制，性能得到显著提升。

Details

Motivation: 测试时缩放已被证明能可靠地提升大语言模型的推理能力，但其是否适用于小型开源视觉语言模型尚不明确。本研究旨在探索TTS在小型视觉语言模型上的迁移效果，以解决其在多模态、多语言视觉推理任务中的适用性问题。

Result: 在EXAMS-V基准上，最佳配置达到了84.1%的准确率，在ImageCLEF 2026测试集上排名第一，成为视觉多选题排行榜的SOTA。实验表明，增加每链解码令牌限制（从1k到2k）可带来3.7个百分点的显著提升，而更复杂的PRM引导波束搜索等方法相比简单的自洽性方法收益甚微且成本高昂。

Insight: 核心创新点在于揭示了对于小型视觉语言模型，TTS性能提升的关键是基础运行条件（如提示可解析性和充足的解码空间），而非复杂的后处理或搜索算法。这为高效部署小型多模态模型提供了实用洞见：优先优化提示工程和解码资源分配，可能比引入昂贵的验证机制更具成本效益。

Abstract: Test-time scaling (TTS) reliably improves reasoning in large language models, but whether it transfers to small open vision-language models remains unclear. We examine this on EXAMS-V, a multilingual visual multiple-choice benchmark, comparing self-consistency, describe-then-reason with PRM-guided beam search, and two post-hoc selectors across Qwen2.5-VL-7B-Instruct and Qwen3.5-4B. What matters is the conditions under which TTS runs, not the search or verification machinery. The largest factor is parseability: an early prompt format left many chains reasoning correctly yet never committing to an answer letter, which a standard answer cue and a guided repair step largely remove. A larger decoding budget removes the rest: raising the per-chain token limit from 1k to 2k recovers 3.7 pp, whereas sampling more chains (8 to 16) adds only 0.15 pp. Once chains have room to finish, elaborate methods contribute little: PRM-guided beam search trails plain self-consistency by 0.39 pp at over eight times the cost, and neither a training-free generative critic nor a trained multimodal PRM beats majority vote across both policies. The largest gain comes instead from the policy model itself (+11.4 pp). Our best configuration reaches 84.1% on the held-out ImageCLEF 2026 test split, ranking first on the Visual MCQ leaderboard.

[8] Task-Specific Multimodal Question Answering Agents via Confidence Calibration and Incremental Reasoning for QANTA 2026 cs.CL | cs.AIPDF

Nirjhar Das, Md. Al-Mamun Provath

TL;DR: 本文介绍了为ICML 2026 EMM-QA研讨会QANTA 2026挑战赛设计的提交系统。该挑战赛评估在效率约束下、基于逐步揭示的文本和图像回答金字塔式问题的多模态问答系统。作者针对挑战中的两个不同任务（Tossup和Bonus），开发了一个任务特定的双智能体架构，分别采用置信度校准、增量推理和结构化多模态证据集成等策略，最终在排行榜上取得了最高总分。

Details

Motivation: QANTA 2026挑战赛包含两个具有不同目标的任务：Tossup问题需要在不确定性下决定何时回答，而Bonus问题则强调精确答案选择和人类采纳性。现有方法可能依赖检索流水线或模型集成，但作者旨在设计一个在仅托管环境中、强调高效推理策略和置信度校准的轻量级解决方案。

Result: 该系统在QANTA 2026挑战赛的总体排行榜上取得了最高分0.402，其中Tossup任务得分0.238，Bonus Effect得分0.164。结果表明，轻量级的、任务特定的推理策略可以在资源受限的多模态问答基准上提供强大的性能。

Insight: 主要创新点在于针对不同任务目标设计了专用的智能体架构：Tossup智能体通过置信度校准和领域特定的数值推理策略来减少对孤立定量线索的过度自信预测；Bonus智能体则利用线索感知推理、结构化关系推理和多模态证据集成来提高精确答案选择。其核心思想是，不依赖检索或模型集成，而是通过精心设计的推理策略和置信度管理在托管环境中实现高效且强大的性能。

Abstract: We present our submission to the QANTA 2026 shared challenge at the ICML 2026 Workshop on Efficient Multimodal Question Answering (EMM-QA). Quanta evaluates multimodal quizbowl systems that answer pyramid-style questions from incrementally revealed text and accompanying images while operating under realistic efficiency constraints. The challenge consists of two distinct tasks: Tossup questions, which require deciding when to answer under uncertainty, and Bonus questions, which emphasize accurate answer selection and human adoption. To address these differing objectives, we develop a task-specific two-agent architecture. Our Tossup agent utilizes a GPT-4o-mini-class model (referred to as GPT-4.1-mini in the competition logs) with confidence-calibrated answering and a domain-specific numeric reasoning policy that reduces overconfident predictions from isolated quantitative clues. Our Bonus agent uses GPT-4o-class model (referred to as GPT-4.1) with leadin-aware reasoning, structured relational reasoning, and multimodal evidence integration to improve exact answer selection. Rather than relying on a retrieval pipeline or model ensembles, our approach emphasizes efficient reasoning policies and confidence calibration within a hosted-only environment. Our system achieved the highest overall leaderboard score of 0.402, including a Tossup score of 0.238 and a Bonus Effect score of 0.164. The results demonstrate that lightweight, task-specific reasoning strategies can provide strong performance on resource-constrained multimodal question answering benchmarks.

cs.CV [Back]

[9] Mixture of Probes: Learning from Privileged Modalities in Multimodal LLMs Through Probing cs.CV | cs.LGPDF

Dominick Reilly, Qiyu Wu, Hiromi Wakaki, Srijan Das, Yuki Mistufuji

TL;DR: 本文提出了一种名为Mixture of Probes (MoP)的新框架，旨在解决多模态大语言模型在特权模态设置下的学习问题。该框架通过结构化探针机制，从共享模态编码器的中间表示中提取并组织信息，以解耦模态特定和模态通用的信号，从而更有效地利用仅在训练时可用的辅助模态信息。

Details

Motivation: 现实世界中，多模态大语言模型常面临训练时可用模态在推理时不可用的问题，即特权模态设置。现有模型通常将模态视为可互换输入，未能有效利用这些辅助模态提供的互补监督信息。

Result: MoP在涵盖八个任务和四个模态的两个领域上进行了评估，在推理时每个模态独立作为唯一输入的特权模态设置下，始终优于强基线MLLM，实现了高达65%的相对性能提升。

Insight: 核心创新在于通过结构化探针机制解耦模态特定与模态通用信号，并引入MoP-X训练策略以防止探针坍缩并促进跨模态学习，这为在训练中有效利用推理时不可用的辅助模态信息提供了新思路。

Abstract: Multimodal Large Language Models (MLLMs) are typically designed under the assumption that all modalities available during training will also be accessible at inference. However, many real-world settings violate this assumption, requiring models to operate under a privileged modality setting, where auxiliary modalities are available only during training. While these modalities contain valuable information, existing MLLMs largely fail to leverage them effectively, as they treat modalities as interchangeable inputs rather than sources of complementary supervision. We propose Mixture of Probes (MoP), a novel framework that disentangles modality-specific and modality-general signals within the MLLM, allowing the model to preserve modality-dependent structure while learning transferable representations across modalities. At its core, MoP achieves this through a structured probing mechanism that extracts and organizes information from intermediate representations of a shared modality encoder, rather than relying only on final-layer alignment as done in existing MLLMs. To support this disentanglement, we further introduce MoP Cross-modal Training (MoP-X), a training strategy for MoP centered around a probe disentanglement loss that prevents probe collapse and encourages cross-modal learning. We evaluate MoP across two domains spanning eight tasks and four modalities under a comprehensive evaluation protocol tailored to the privileged modality setting, where each modality is independently treated as the sole input at inference time. MoP consistently outperforms strong MLLM baselines, achieving up to 65% relative improvement, demonstrating that auxiliary modalities, even when unavailable at inference, can provide substantial gains when effectively leveraged during training. Code, model checkpoints, and evaluation protocols will be made available at https://github.com/Sony/MoP.

[10] Decoupled Illumination Priors for Spatially Controllable Multi-View Indoor Scene Relighting cs.CVPDF

Chenjian Gao, Linning Xu, Tianfan Xue

TL;DR: 本文提出Lume-Palette框架，用于实现多视角室内场景重照明的空间可控性。该框架将重照明过程解耦为两个阶段：首先通过光照蒸馏从预训练扩散模型中提取规范光照调色板以保持真实材质-光照交互，然后通过光照投射将目标空间光照条件映射到粗略3D几何上。

Details

Motivation: 解决现有基于扩散模型的图像编辑方法在实现精确3D光照空间控制时，容易破坏其生成先验，难以同时保证照片级真实感、空间精确控制和严格多视角一致性的问题。

Result: 在多样化的合成场景和真实场景上的实验表明，Lume-Palette能够生成具有照片级真实感、空间可控且多视角一致的重照明结果。

Insight: 主要创新点在于将重照明任务解耦为光照蒸馏和光照投射两阶段，并引入了非对称多视角条件策略来高效处理密集多视角和多模态输入，从而在保持扩散模型先验的同时实现精确的空间光照控制。

Abstract: Indoor scene relighting demands photorealism, precise spatial control, and strict multi-view consistency. While diffusion-based image editing models enable semantic lighting manipulation via text prompts, enforcing exact 3D light placement often disrupts their generative priors. We propose Lume-Palette, a progressive framework that leverages semantic lighting priors for spatially controllable multi-view indoor relighting. The approach decouples relighting into two stages: (1) illumination distillation, which extracts canonical illumination palettes from a pretrained diffusion model to preserve realistic material-light interactions, and (2) illumination casting, which explicitly maps target spatial lighting conditions defined from coarse 3D geometry. To efficiently handle dense multi-view and multi-modal inputs, we introduce an asymmetric multi-view conditioning strategy that selectively injects essential spatial context. Experiments on diverse synthetic scenes and real-world scenes demonstrate that Lume-Palette produces photorealistic, spatially controllable, and multi-view consistent relighting results. Project Page: https://cjeen.github.io/lumepalette

[11] Vision Transformers Learn Gestalt-Like Figure-Ground Cues from Natural Images cs.CVPDF

Matthias Tangemann, Benjamin Lo, Zygmunt Pizlo, Kaleem Siddiqi, Dirk B. Walther

TL;DR: 本研究评估了Vision Transformers（ViTs）是否学习了类似于人类视觉系统中基于形状的图形-背景组织线索，包括包围性、凸性和对称性。通过使用自然图像和人工刺激训练线性探针，发现ViTs能够稳健地编码包围性和凸性，并在多个模型上实现从自然图像到人工刺激的零样本泛化，而对称性编码的结果则因区域纹理而异。

Details

Motivation: 人类视觉系统的图形-背景组织依赖于基于形状的线索，但这些线索在自然条件下的运作机制及其如何从自然场景统计中产生尚不清楚。本研究旨在探索ViTs是否能够作为可实验操作的模型系统，以揭示这些底层计算机制。

Result: 在25个ViT模型（包括监督和自监督训练目标）上测试，结果显示ViTs能够编码包围性和凸性，且从自然图像训练的探针能零样本泛化到人工刺激；对称性编码仅适用于均匀着色区域，不适用于纹理区域。

Insight: 论文的创新点在于首次系统性地证明了ViTs可以从自然图像统计中学习到格式塔式的图形-背景线索，这为将ViTs作为研究感知组织计算机制的模型系统提供了有力支持，并揭示了模型对纹理敏感性的潜在限制。

Abstract: Figure-ground organization in the human visual system relies on several shape-based cues, including surroundedness, convexity, and symmetry. While these cues have been extensively studied using abstract stimuli, little is known about how they operate under natural conditions or how they arise from the statistics of natural scenes. Deep neural networks offer a promising path forward: a model that relies on the same figure-ground cues as humans would provide tractable experimental access to the underlying mechanisms. In this study, we evaluate shape-based figure-ground organization in Vision Transformers (ViTs), for which prior work has demonstrated the emergence of object-based grouping. We test 25 ViTs spanning supervised and self-supervised training objectives, by fitting linear probes to predict figure-ground assignment from intermediate patch representations using both natural images and controlled artificial stimuli that isolate individual cues. Our results show that ViTs robustly encode surroundedness and convexity, and that probes trained on natural images generalize zero-shot to artificial stimuli across several models. For symmetry we observe mixed results: the cue is encoded for uniformly colored but not for textured regions. Taken together, our findings demonstrate that Gestalt-like figure-ground cues can be learned from natural scene statistics and position ViTs as a compelling model system for studying the computational mechanisms of perceptual organization. Code and data is available at https://github.com/mtangemann/mlvbench

[12] MultiView-Bench: A Diagnostic Benchmark for World-Centric Multi-View Integration in VLMs cs.CV | cs.AIPDF

Hantao Zhang, Jinru Sui, Ed Li, Dirk Bergemann, Zhuoran Yang

TL;DR: 该论文提出了MultiView-Bench，一个专门用于诊断和评估视觉语言模型在多视角整合能力方面的基准测试。该基准旨在测试模型将不同视角的观察整合成一个连贯的、以世界为中心的3D心理模型的核心认知能力，这是执行下游任务（如机械零件组装）的前提。论文还揭示了前沿VLM在该基准上的系统性失败模式，并提出了一个名为ViewNavigator的多智能体框架来主动选择信息视角并融合证据，从而显著提升了模型性能。

Details

Motivation: 现有的VLM基准主要评估单视角或有限视角的感知能力，未能测试模型跨视角整合信息以构建连贯的、以世界为中心的3D心理模型这一核心认知能力。这种能力对于VLM部署到需要整体3D场景理解的下游任务至关重要。

Result: 对前沿VLM的系统性评估揭示了其一致性的失败模式：在单图像的2D平面关系上表现强劲，但在3D空间关系以及跨视角信息聚合方面存在显著困难。论文提出的ViewNavigator框架在严格的预算匹配比较下，提升了不同基础模型在MultiView-Bench上的性能，完整智能体版本提升了3-5倍。

Insight: 论文的创新点在于创建了一个诊断性的基准（MultiView-Bench），它明确要求模型将物体定位与瞬时视角解耦，并将其锚定在固定的全局坐标系中，从而直接评估世界中心的多视角整合能力。此外，提出的ViewNavigator框架通过主动视角选择和多视角证据融合，为解决VLM在此类任务上的局限性提供了一个有效的多智能体解决方案。

Abstract: Recent benchmarks for VLMs largely assess single- or limited-view perception, leaving untested the core cognitive ability to integrate observations across viewpoints into a coherent, world-centric (allocentric) 3D mental model. We introduce MultiView-Bench, a diagnostic benchmark expressly designed to evaluate multi-view integration for holistic 3D scene comprehension. Unlike existing datasets that focus on pixel-level mapping or camera-relative navigation, MultiView-Bench requires models to decouple object positioning from transient perspectives and ground them in a fixed global coordinate system. This capability serves as a prerequisite for VLMs before being deployed for downstream tasks such as mechanical part assembly. Our systematic evaluation of frontier VLMs reveals consistent failure modes: strong performance on 2D planar relations from a single image, but marked difficulty with 3D spatial relations and with aggregating information across views. We further identify biases in VLMs, such as struggles with unconventional axis directions and sensitivity to object colorways and texture variations. Acknowledging these limitations, we propose ViewNavigator, a multi-agent framework that actively selects informative viewpoints, perceives, and fuses multi-view evidence, improving diverse base models on MultiView-Bench even under a strict budget-matched comparison (and by 3-5x for the full agent).

[13] C-GAP: Class-Aware and Online Prompting Improves Vision-Language Models on Imbalanced Classes cs.CVPDF

Francis Fernandez, Arash Jahangiri, Salimeh Sekeh

TL;DR: C-GAP是一个针对类别不平衡问题的视觉语言模型提示优化框架，它通过两阶段方法提升少数类检测性能：首先建立结合图像场景描述和类别数量信息的复合提示基线，然后利用LLM迭代优化图像描述，无需更新检测器权重或额外标注。

Details

Motivation: 解决安全关键感知系统中少数类物体检测不可靠的问题，传统长尾检测方法不适用于小标签空间，而开放词汇检测器的性能高度依赖提示质量，因此研究通过优化提示而非重训练模型来改善类别不平衡。

Result: 在多个开放词汇架构和基准测试中，C-GAP将少数类平均精度提升高达53%；在COCO数据集上，少数类AP@0.5相对复合基线提升约81%（从17.69提高到32.09），达到SOTA水平。

Insight: 创新点在于提出复合提示作为优化基础，并结合LLM进行迭代优化与动态阈值评估；客观分析认为其检测器无关、无需标注的框架设计，为利用提示工程解决类别不平衡提供了新思路。

Abstract: Safety-critical perception systems must reliably detect rare object classes within small label spaces, a setting that long-tailed detection methods, designed for hundreds of classes with dense annotation, fundamentally do not address. Open-vocabulary detectors offer a promising alternative, as they use natural language queries at inference time, making prompt quality a first-class lever for detection performance. We exploit this property to address class imbalance: rather than retraining models or collecting additional annotations, we ask whether iteratively refining the language prompts, fed to frozen detectors, can improve minority class detection. We introduce C-GAP Caption-Guided Augmentation and Prompting), a detector-agnostic, annotation-free framework that operates in two phases. First, we establish a composite caption baseline combining per-image scene descriptions with class-quantity context, which we show outperforms scene-description only or class-quantity-only prompts across multiple open-vocabulary architectures and benchmarks. Second, an LLM iteratively refines each image’s caption individually, with trials triaged into accept, tentative, or regenerate buckets based on minority-class AP@0.5 against a dynamic threshold derived from the composite baseline. Refinement terminates early once sufficient AP@0.5 gain is achieved. No detector weights are updated at any stage. Our experiments shows that C-GAP improves minority-class average precision up to 53% over the baselines. On COCO, C-GAP improves minority-class AP@0.5 by ~81% relative over the composite baseline (17.69 -> 32.09). Experiments confirm that composite captions provide the critical foundation for effective refinement: using scene-description-only or class-quantity-only prompts as the refinement starting point yields diminishing returns, supporting both stages of C-GAP as necessary contributions.

[14] Video Generation Models are General-Purpose Vision Learners cs.CV | cs.AIPDF

Letian Wang, Chuhan Zhang, Rishabh Kabra, Jasper Uijlings, Steven Waslander

TL;DR: 本文提出GenCeption，一种利用预训练视频生成扩散模型作为主干，通过文本指令驱动执行多种视觉任务的通用视觉学习框架。研究表明，大规模文本到视频生成可作为强大的视觉预训练范式，使模型在深度估计、表面法线估计、相机姿态估计、表达式参考分割和3D关键点预测等多样化任务上达到SOTA性能，并展现出卓越的数据效率和涌现能力。

Details

Motivation: 受NLP领域通过下一词预测发展出通用基础模型的启发，本文旨在探索计算机视觉中实现通用模型的催化剂，认为大规模文本到视频生成能提供必要的时空先验、视觉-语言对齐和可扩展性，是实现通用视觉智能的关键路径。

Result: GenCeption在多个视觉任务上实现了最先进的性能，常匹配或超越专用模型（如DepthAnything、SAM等）；其视频生成预训练主干在可比设置下优于其他预训练范式（如V-JEPA、Video MAE）；模型展现出卓越的数据效率，仅需7到500倍更少的训练数据即可达到与领先模型相当的性能。

Insight: 创新点在于将视频生成模型重新定位为通用视觉学习器，通过文本指令驱动实现多任务统一感知；关键洞察是视频生成预训练不仅能合成内容，更能作为学习物理世界时空表征的基础，其涌现的泛化能力（如从合成人类视频泛化到真实世界和分布外类别）为通用视觉智能提供了新路径。

Abstract: Driven by next-token prediction, NLP shifted from task-specific models into powerful generalist foundation models. What, then, is the equivalent catalyst needed to achieve a general-purpose model in computer vision? In this paper, we contend that large-scale text-to-video generation serves as a strong pre-training paradigm for computer vision, providing the necessary spatiotemporal priors, vision-language alignment, and scalability required for general visual intelligence. We introduce GenCeption, which leverages a pre-trained video generative diffusion backbone to define a feed-forward perception model, capable of performing various vision tasks steered by text instructions. Empirical results demonstrate that GenCeption achieves state-of-the-art performance across a diverse suite of tasks, including depth, surface normal, and camera pose estimation, expression-referring segmentation, and 3D keypoint prediction, often matching or surpassing specialized models (e.g. DepthAnything3, SAM3, D4RT, VGGT-Omega, Sapiens, David, Genmo, and Lotus-2). Furthermore, the video generative pretrained backbone outperforms alternative pretraining paradigms (e.g., V-JEPA, and Video MAE) under comparable settings. Importantly, GenCeption exhibits preliminary data and model scaling properties along with exceptional data efficiency, where it achieves comparable performance with leading models like D4RT and VGGT-Omega with 7 to 500 less training data. Finally, GenCeption also exhibits intriguing emergent behaviors: a model trained exclusively on synthetic human videos generalizes to real-world footage and out-of-distribution object categories (e.g., animals and robots). These findings suggest that video generation is not merely a synthesis tool, but a foundational path toward generalist vision intelligence for the physical world. Project page: https://genception.github.io

[15] On Locality and Length Generalization in Visual Reasoning cs.CV | cs.AI | cs.LGPDF

Pulkit Madan, Sanjay Haresh, Reza Ebrahimi, Sunny Panchal, Apratim Bhattacharyya

TL;DR: 本文研究了视觉推理中局部感知与长度泛化的关系，发现与语言模型类似，全局视觉模型容易利用捷径而无法泛化到更长或更复杂的任务，而基于严格局部感知的循环视觉策略能有效提升泛化能力。

Details

Motivation: 探究局部、序列化的视觉模型（类似人眼注视机制）是否比全局单次计算的模型在视觉状态跟踪和长度泛化方面具有计算优势。

Result: 实验表明，在需要聚合图像局部信息的简单视觉任务上，全局视觉模型会学习全局捷径而无法泛化任务长度或复杂度，而基于严格局部感知的循环视觉策略能成功泛化。

Insight: 局部注意力可能是实现鲁棒组合泛化的关键被忽视要素，这为设计更接近生物视觉的模型提供了新方向。

Abstract: A striking feature of the human visual system is that it ingests visual information through a series of local foveated glimpses, rather than a single global computation. This makes human vision distinctly different from most popular computer vision models in use today, which input images globally and in a single shot. A natural question therefore is whether local, sequential vision models may provide any fundamental computational benefits in addition to being biologically more plausible than global models. In this work, we investigate this question from the perspective of visual state tracking and length generalization. Inspired by recent studies of length generalization in language models, we study the behavior of vision models trained on simple vision tasks that require the aggregation of local information across an image. Our experiments reveal that, similar to language models, vision models can learn to exploit global shortcuts and thereby fail to generalize over task length or complexity. We also show that recurrent vision policies based on strictly local perception can mitigate these failures, thereby allowing models to generalize on these tasks. Our results show that local attention may be an essential overlooked requirement for robust compositional generalization.

[16] MOSAIC: Adaptive Inter-layer Composition for Efficient Heterogeneous Vision-Language Models cs.CVPDF

Yuncheng Yang, Feiyang Ye, Shixian Luo, Yinna Zhu, Lianlei Shan

TL;DR: 本文提出了MOSAIC方法，一种硬件感知的搜索框架，用于自动将同构的视觉语言模型（VLM）转换为优化的异构架构。该方法通过多目标混合整数规划，在统一的搜索空间中集成多种高效算子（如线性、稀疏、低秩），并在严格的硬件延迟约束下最大化下游性能。通过两阶段参数恢复过程（全局离策略蒸馏和双教师策略蒸馏）缓解结构转换带来的性能下降。实验表明，从Qwen3-VL-4B-Instruct衍生的MOSAIC-4B模型在多个基准测试中性能与基线相当，训练成本不到原模型的2%，推理效率显著提升（预填充速度提升1.76倍，解码速度提升2.54倍）。

Details

Motivation: 当前异构视觉语言模型（VLM）依赖于手工设计的静态混合模式，这些模式并非最优且难以适应特定硬件。为了弥合这一差距，本文旨在自动化地搜索和构建高效的异构架构，以在保证性能的同时优化推理延迟。

Result: 在从Qwen3-VL-4B-Instruct转换而来的MOSAIC-4B模型上验证，该方法在多个基准测试中性能与基线相当，同时训练成本不到原模型的2%，并显著提升了推理效率（预填充速度提升1.76倍，解码速度提升2.54倍）。

Insight: 创新点在于提出了一个硬件感知的自动化搜索框架（MOSAIC），将异构算子选择形式化为多目标混合整数规划问题，并引入两阶段参数恢复过程（结合离策略和双教师策略蒸馏）来稳定和提升模型性能。这为高效VLM架构设计提供了自动化和硬件适配的新思路。

Abstract: Vision-Language Models (VLMs) have achieved success using homogeneous Transformers to process multimedia data. Recent studies show that heterogeneous structures interleaving efficient mechanisms, like linear attention, improve both performance and inference latency over homogeneous designs. However, these efforts rely on handcrafted static mixing patterns, which are sub-optimal and difficult to adapt to specific hardware. To bridge this gap, we propose Multi-Objective Search for Adaptive Inter-layer Composition (MOSAIC), a hardware-aware search method that automatically transforms homogeneous models into optimized heterogeneous architectures. MOSAIC integrates diverse efficiency mechanisms–including linear, sparse, and low-rank operators–into a unified search space. By formulating the selection as a multi-objective Mixed Integer Programming (MIP) problem, our method identifies optimal configurations that maximize downstream performance under strict hardware latency constraints. To mitigate performance degradation from structural transitions, we introduce a two-stage parameter recovery process: global off-policy distillation to stabilize internal representations, followed by a dual-teacher on-policy distillation leveraging a 235B oracle for knowledge expansion and the original 4B teacher for distributional stability. We validate MOSAIC through MOSAIC-4B, derived from Qwen3-VL-4B-Instruct. Results demonstrate that MOSAIC-4B matches the baseline’s performance across multiple benchmarks while requiring less than 2% of the original training cost. Furthermore, it substantially improves inference efficiency, achieving 1.76x prefilling and 2.54x decoding speedups.

[17] Probing Diffusion Denoising Dynamics for Contrastive Representation Learning cs.CVPDF

Yasong Dai, Zeeshan Hayder, David Ahmedt-Aristizabal, Hongdong Li

TL;DR: 本文提出了D³CL框架，通过将对比学习目标与去噪重建损失相结合，探索了预训练扩散模型的去噪动态如何适应判别性表示学习，同时保持其生成能力。该方法在ImageNet-1K上实现了80.1%的线性探测精度和5.56的FID分数，证明了重建与对比目标的互补性。

Details

Motivation: 动机在于利用文本到图像扩散模型丰富的中间表示来支持判别性视觉任务，同时通过参数高效更新保持其生成行为。

Result: 在ImageNet-1K上，D³CL实现了80.1%的线性探测准确率和5.56的FID（256×256无条件生成），达到了SOTA水平。

Insight: 创新点在于将不同扩散时间步的噪声潜在变量视为同一图像的随机视图，从而结合对比学习与去噪损失；使用LoRA进行轻量级适配，揭示了去噪状态采样位置和方式对特征有用性的影响。

Abstract: Text-to-image diffusion models exhibit unprecedented generative capability and contain rich intermediate representations that can be useful for discriminative vision tasks. Motivated by this observation, we study a focused question: how can the denoising dynamics of a pretrained diffusion model be adapted to support discriminative representation learning while preserving its generative behavior under parameter-efficient updates? We present D$^3$CL as an investigation of this question. Our key observation is that noisy latents at different diffusion timesteps can be interpreted as stochastic views of the same underlying image, enabling a contrastive objective to be coupled with the standard denoising reconstruction loss. This formulation provides a simple way to probe the interaction between generative denoising and discriminative representation learning without training from scratch. To keep the adaptation lightweight, we apply LoRA updates to a pretrained Stable Diffusion backbone while freezing the original model parameters. D$^3$CL provides strong empirical evidence that reconstruction and noise-level contrastive objectives can be complementary: on ImageNet-1K, it obtains 80.1% linear-probing accuracy and an FID of 5.56 for $256 \times 256$ unconditional generation. Additional ablations on the design space suggest that the usefulness of diffusion features depends on where and how denoising states are sampled. These results establish D$^3$CL as a parameter-efficient adaptation framework for pretrained diffusion models, showing that noise-level contrastive learning can structure denoising representations for discriminative tasks while maintaining generative performance.

[18] OmniMapBench: Benchmarking Visual-Centric Reasoning on Diverse Map Documents cs.CV | cs.AIPDF

Yang Chen, Yunwen Li, Yufan Shen, Minghao Liu, Tianyu Zheng

TL;DR: 本文提出了OmniMapBench，一个专注于地图文档视觉推理的基准测试，包含来自9个类别的1,603个地图文档和2,096个人工标注的问答对。该基准旨在评估从感知到多步视觉推理的技能层次，并引入了视觉依赖指数（VDI）来量化其对不可简化的视觉内容的依赖。对25个领先的LVLM的评估显示，最佳模型准确率仅为75.03%，揭示了当前模型在视觉中心推理方面的挑战。

Details

Motivation: 现有文档理解基准中的视觉内容常可简化为文本，导致模型无需真正视觉基础即可取得高性能，这限制了视觉中心推理的评估。本文旨在解决这一局限性，通过地图文档促进不可简化的视觉推理。

Result: 在OmniMapBench上评估了25个领先的LVLM，最佳模型准确率为75.03%，显示出显著的性能差距。该基准的VDI高于现有基准，定量验证了其对视觉推理的聚焦。

Insight: 创新点包括引入专门针对地图文档的视觉中心推理基准，以及提出VDI这一简单有效的基准级指标来量化视觉依赖。这为评估LVLM的视觉基础能力提供了更严格的测试平台，并强调了不可简化的视觉内容在文档理解中的重要性。

Abstract: Recent advancements in LVLMs necessitate robust benchmarks for complex, visually grounded reasoning. A critical limitation is identified in many document understanding benchmarks: visual content is often reducible to text, enabling high performance without genuine visual grounding. To address this limitation, OmniMapBench is introduced to foster visual-centric reasoning for map documents. The benchmark comprises 2,096 manually annotated question-answer pairs across 1,603 map documents from nine categories. It is designed to probe a hierarchy of skills, ranging from perception to multi-step visual reasoning. To quantify benchmark properties, a simple yet effective benchmark-level metric is proposed: the Visual Dependency Index (VDI), defined as the accuracy drop when images are replaced with question-agnostic descriptions. OmniMapBench exhibits higher VDI than established benchmarks, which quantitatively validates its focus on irreducible visual reasoning. Comprehensive evaluations of 25 leading LVLMs are conducted on OmniMapBench. A significant performance gap is observed, with the top-performing model achieving only 75.03% accuracy. This result underscores the challenges posed by OmniMapBench to current LVLMs. This work aims to catalyze progress in visual-centric reasoning for document understanding of LVLMs. The dataset and code are publicly available at https://github.com/SIGMME/OmniMapBench.

[19] Toward Active Object Detection for UAVs in the Wild: A Large-Scale Dataset, Benchmark and Method cs.CV | cs.ROPDF

Tianpeng Liu, Xinhua Jiang, Li Liu, Qinmu Shen, Siwei Tang

TL;DR: 本文提出了首个面向无人机-地面主动目标检测（UGAOD）的大规模真实世界数据集ATRNet-LUDO，包含12.1万张多视角全景图像和121万个局部目标切片，并基于此建立了全面的评估基准。针对现有基于深度强化学习的AOD方法泛化能力差的问题，论文提出了一种结合联合嵌入预测架构（JEPA）和领域先验知识的新方法AOD-JEPA，通过构建世界模型来增强状态表示学习，实验验证了其有效性和优越性。

Details

Motivation: 无人机应用中的目标检测长期受遮挡和目标像素稀少等问题困扰，主动目标检测（AOD）通过主动视觉为解决这些问题提供了新范式，但该领域缺乏高质量的数据集和基准来支持算法开发与评估。

Result: 在提出的ATRNet-LUDO基准上的大量实验表明，现有基于DRL的AOD策略存在显著的训练-测试泛化差距，而提出的AOD-JEPA方法在实验中验证了其有效性和优越性。

Insight: 主要创新点在于构建了首个大规模、多场景、多目标的UGAOD真实数据集和评估基准，为领域研究提供了关键基础设施；方法上创新性地将JEPA架构引入AOD任务，通过构建世界模型并结合领域先验知识来提升策略的泛化能力，为改善AOD的泛化问题提供了新思路。

Abstract: Object detection is a fundamental component in numerous Unmanned Aerial Vehicle (UAV) applications, yet it has long been plagued by hindrances like occlusion or target pixel scarcity. Active Object Detection (AOD) provides a novel paradigm to address these challenges via active vision, while UAV-based AOD research remains scarce due to the lack of high-quality datasets and benchmarks for algorithm development and evaluation. To fill this gap, this paper presents ATRNet-LUDO, the first large-scale real-world dataset for UAV-Ground Active Object Detection (UGAOD). It contains 121,000 multi-view panoramic multi-target aerial images and 1.21 million local single-target slices, covering 10 vehicle targets across 40 scenarios. It enables the construction of diverse training and testing environments for UAV agent interaction and active observation policy learning. Based on this dataset, we establish a comprehensive evaluation benchmark for AOD policy learning methods. Most existing AOD policies rely on Deep Reinforcement Learning (DRL) but suffer from poor generalization. Evaluations on our benchmark reveal a significant generalization gap between training and testing performance, highlighting an urgent need for solutions. To this end, we leverage the Joint Embedding Predictive Architecture (JEPA) to construct a world model that enhances state representation learning, and propose AOD-JEPA by incorporating AOD-specific prior knowledge. Extensive experiments validate its effectiveness and superiority. We hope ATRNet-LUDO and the benchmark will advance research in the UGAOD field. The dataset and code are soon available at https://github.com/Leo000ooo/LUDO_dataset.

[20] GeoTrace: Geometry-Aware Trajectory Token Compression for Video Large Language Models cs.CVPDF

Guohuan Xie, Mengqi Lei, Chuan Shi, Wei Bao, Yue Gao

TL;DR: 本文提出了GeoTrace，一种无需训练的时空令牌压缩框架，用于提升视频大语言模型的效率。该方法将视频证据分解为精确的骨架令牌和可追踪的残差事件令牌，通过上下文最远点锚定和轨迹约束残差压缩来减少视觉令牌数量，同时保持性能。

Details

Motivation: 现有视频令牌压缩方法通常依赖逐帧显著性或启发式令牌合并，容易过度关注局部显著区域并产生模糊的融合特征，限制了视频大语言模型的效率。

Result: 在四个视频理解基准上对四种视频大语言模型进行评估，结果表明该方法具有有效性和泛化性。在LLaVA-OneVision上，仅保留10%的视觉令牌即可实现12.99倍的TFLOPs减少，同时保持99.1%的原始性能。

Insight: 创新点在于将视频证据分解为骨架令牌和可追踪的残差事件令牌，通过几何感知的轨迹约束进行压缩，提供了紧凑且可追踪的令牌表示，有助于实现高效且鲁棒的视频大语言模型推理。

Abstract: Although Video Large Language Models (Video LLMs) have shown strong performance in video understanding, their efficiency is still limited by the large number of visual tokens. Existing video token compression methods typically rely on frame-wise saliency or heuristic token merging, which can over-focus on locally salient regions and produce ambiguous fused features. To address these issues, we propose GeoTrace, a training-free spatiotemporal token compression framework that decomposes video evidence into exact skeleton tokens and traceable residual event tokens. Specifically, Contextual Farthest-Point Anchoring (CFPA) preserves salient, context-consistent, and high-coverage skeleton tokens, while Trajectory-Constrained Residual Condensation (TCRC) compresses residual tokens through one-to-one temporal trajectories and constrained near-manifold condensation, producing traceable event tokens with reduced ambiguity. We evaluate GeoTrace on four Video LLMs across four video understanding benchmarks, and the results demonstrate its effectiveness and generalization across different model architectures and scenarios. On LLaVA-OneVision, with only 10% visual tokens retained, GeoTrace achieves a (12.99\times) TFLOPs reduction while preserving 99.1% of the vanilla performance. Overall, GeoTrace offers a compact and traceable token representation for efficient and robust Video LLM inference. Code is available at \href{https://github.com/guohuan-xie/GeoTrace.git}{\texttt{Code}}.

[21] Adaptive Latent Trajectory Anchoring for Action Segmentation Dataset Condensation cs.CVPDF

Artheme Gauthier-Villar, Guodong Ding, Angela Yao

TL;DR: 本文提出了一种用于动作分割数据集压缩的新方法，通过将压缩范式从基于优化的反演转变为确定性潜在映射，利用去噪扩散隐式模型将动作片段表示为噪声流形中由稀疏潜在点锚定的连续轨迹，并引入自适应分配机制动态调整锚点预算，从而显著提升了压缩效率和重建质量。

Details

Motivation: 现有基于变分自编码器和迭代潜在优化的动作分割数据集压缩方法计算成本高，且存在重建过度平滑和时序约束僵化的问题，本文旨在解决这些局限性。

Result: 在多个常用数据集上的广泛实验表明，该方法在分割性能上显著优于现有最先进方法，特别是在Breakfast数据集上，仅使用2.4%的压缩比就能达到与使用真实数据训练相当的性能。

Insight: 创新点在于将压缩范式转向确定性潜在映射，并利用扩散模型和自适应锚点分配来高效表示动作轨迹；从客观角度看，该方法通过稀疏锚定和动态预算分配，有效平衡了压缩率与信息保真度，为视频时序数据的紧凑表示提供了新思路。

Abstract: Dataset condensation for action segmentation synthesizes compact, informative representations of long, untrimmed video datasets. The existing approach relies on Variational Autoencoders and an iterative latent optimization; it is computationally expensive and suffers from over-smoothed reconstructions and rigid temporal constraints. This paper proposes to shift the condensation paradigm from optimization-based inversion to deterministic latent mapping. By leveraging Denoising Diffusion Implicit Models, we represent action segments as continuous trajectories anchored by sparse latent points in the noise manifold. To maximize representational efficiency, we introduce an adaptive allocation mechanism that dynamically redistributes the anchoring budget based on segment-wise reconstruction difficulty. Extensive experiments demonstrate that our framework significantly outperforms state-of-the-art methods in segmentation performance across common datasets. Notably, our approach achieves performance parity with real data training while maintaining a condensation ratio of 2.4% on Breakfast dataset.

[22] REBASE: Reference-Background Subspace Elimination for Training-Free In-Context Segmentation cs.CVPDF

Mantha Sai Gopal, Jaison Saji Chacko, Harsh Nandwana, Sandesh Hegde, Debarshi Banerjee

TL;DR: REBASE是一种无需训练即可实现上下文分割的框架，通过消除参考图像与查询图像之间共享背景特征子空间的影响，提升语义匹配的准确性。该方法利用低秩背景特征子空间的正交补投影来抑制虚假上下文对应，并结合相似度加权最远点采样生成点提示，在多个数据集上达到训练无关方法的新SOTA水平。

Details

Motivation: 现有基于视觉基础模型和可提示分割网络（如SAM）的免训练上下文分割方法，其性能受限于跨图像相似度图的质量，尤其是参考图像与查询图像共享的背景上下文会系统性提升非目标区域的相似度，从而降低提示定位的准确性。

Result: 在PACO-Part、FSS-1000以及跨域数据集（如ISIC2018）上，REBASE在无需任何训练或参数更新的情况下，在训练无关方法中达到了新的最先进水平（SOTA）。

Insight: 创新点在于明确识别并消除参考图像的低秩背景特征子空间，通过正交投影获得更干净的语义匹配；同时，采用相似度加权最远点采样生成点提示，结合精炼的密集相似度先验，为一次性定位提供了高效原理。

Abstract: Training-free in-context segmentation enables new object categories to be introduced at inference time from a single annotated reference image, eliminating the retraining and memory overhead of class-incremental learning. Recent approaches achieve this by combining vision foundation models for semantic correspondence with promptable segmentation networks like SAM. However, their performance is fundamentally limited by the quality of the cross-image similarity map; shared contextual backgrounds between the reference and query systematically elevate similarity in non-target regions, degrading prompt localization. We present REBASE, a training-free framework that explicitly suppresses these spurious contextual correspondences. Our method identifies the low-rank background feature subspace from the reference image and project the reference and query features onto its orthogonal complement in closed form, yielding cleaner semantic matching. We then generate positive point prompts using similarity-weighted farthest-point sampling, paired with a refined dense similarity prior. Without any training or parameter updates, our approach establishes a new state of the art among training-free methods on PACO-Part, FSS-1000, and cross-domain datasets such as ISIC2018, demonstrating that explicit background subspace removal is a highly effective principle for one-shot localization.

[23] DETRAM: End-to-end DEtection, Tracking and Recovery of HumAn Meshes cs.CVPDF

Chunggi Lee, Seonwook Park, Wanhua Li, Umar Iqbal, Hanspeter Pfister

TL;DR: DETRAM是一个端到端的多人体网格恢复与跟踪统一框架，能够同时检测、重建和跟踪视频中的人体。它使用单一Transformer解码器和跨帧保持的身份一致可学习查询嵌入，包括检测查询、跟踪查询和提示查询，以自动或通过用户提示处理多人体场景。

Details

Motivation: 解决多人体网格恢复任务中，由于多人出现和相互遮挡导致的跟踪困难问题，现有方法依赖预训练检测模块，增加了运行时间并限制了跟踪实体数量。

Result: 在PoseTrack21、3DPW、BEDLAM和MuPoTS-3D数据集上实现了最先进的跟踪结果，在BEDLAM和3DPW上获得了有竞争力的重建精度。

Insight: 首次将可提示性与多人体网格恢复及跟踪统一到端到端可训练框架中，通过身份一致的查询嵌入实现跨帧持续跟踪，支持用户指定个体的基于提示的跟踪。

Abstract: In the task of human mesh recovery (HMR), multi-person scenes are particularly difficult to handle due to the many entities that appear and occlusions between them over time. In particular for video inputs, there is a need to track each entity reliably and consistently. Existing methods rely on pretrained human detection modules, increasing their runtime and limiting the number of tracked entities. We present DETRAM, a unified framework for multi-person HMR and tracking that simultaneously detects, reconstructs, and tracks humans across time, both automatically and via user prompts. DETRAM uses a single transformer decoder with an identity-consistent set of learnable query embeddings that persist across frames: detection queries discover new people, tracking queries maintain pose and shape for existing individuals, and prompt queries follow user-specified identities. Our approach achieves state-of-the-art tracking results on PoseTrack21, 3DPW, BEDLAM, and MuPoTS-3D, and competitive reconstruction accuracy on BEDLAM and 3DPW, while uniquely supporting prompt-based tracking of individuals in multi-person scenes. To our knowledge, this is the first method to unify promptability and multi-person HMR with tracking in an end-to-end trainable framework, enabling user-directed human analysis in videos.

[24] Subtoken Vision Transformer for Fine-grained Recognition cs.CVPDF

Jie Zhu, Ivy Zhang, Minchul Kim, Xiaoming Liu

TL;DR: 本文提出了Subtoken Vision Transformer (SubViT)，一种用于细粒度视觉识别的选择性图像标记化方法。它通过为判别性图像块分配多个子标记来增强局部细节表示，同时保留全局上下文。采用两阶段训练策略，先通过随机注意力头采样进行微调，再蒸馏出轻量级路由器来预测标记重要性，从而在推理时无需额外前向传播。

Details

Motivation: 标准Vision Transformer将每个固定大小的图像块压缩为单个标记，但细粒度识别往往依赖于少数几个图像块内的局部细微变化，这种不匹配限制了模型对细节的捕捉能力。

Result: 在广义类别发现（GCD）任务上，于CUB、FGVC-Aircraft和Stanford Cars数据集上，SubViT将DINOv2的新类别平均准确率从81.3%提升至84.7%，仅增加0.50ms延迟和3.4%的FLOPs，且相比Retina Patch降低了73.8%的延迟。在CIFAR-10和ImageNet-100上的结果也证明了其更广泛的适用性。

Insight: 创新点在于提出了选择性子标记化机制，为关键图像块分配更多表示容量；以及两阶段训练策略，通过随机采样和蒸馏，实现了无需推理时额外计算开销的轻量级路由器，有效平衡了细粒度识别精度与计算效率。

Abstract: We present Subtoken Vision Transformer (SubViT), a selective image tokenization method for fine-grained visual recognition. Standard Vision Transformers compress each fixed-size patch into a single token, although fine-grained distinctions often depend on localized variations within only a few patches. SubViT addresses this mismatch by representing discriminative patches with multiple subtokens while retaining the original token sequence for global context, thereby allocating additional capacity where it is most needed. Since attention heads encode complementary semantics and extracting attention maps at inference requires an extra backbone forward, we adopt a two-stage training strategy. Stage 1 fine-tunes the ViT using subdivision regions sampled from random attention heads, exposing the model to diverse subdivision patterns. Stage 2 identifies informative attention maps through feature-degradation distances and distills them into a lightweight single-map router, which directly predicts deterministic token-importance scores without a separate attention forward. We evaluate SubViT on Generalized Category Discovery (GCD), a challenging task requiring both fine-grained discrimination and generalization to unlabeled novel categories. Across CUB, FGVC-Aircraft, and Stanford Cars, SubViT improves the average novel-category accuracy of DINOv2 from $81.3%$ to $84.7%$, with only $0.50$ ms additional latency and $3.4%$ more FLOPs, while reducing latency by $73.8%$ relative to Retina Patch. Results on CIFAR-10 and ImageNet-100 demonstrate its broader applicability.

[25] Equivariant Filter for High Performance Image Tracking using an Event Camera cs.CVPDF

Angus Apps, Yixiao Ge, Timothy L. Molloy, Robert Mahony

TL;DR: 本文提出了一种基于事件相机的高性能图像跟踪方法，通过结合异步事件斑点（AEB）跟踪器和等变滤波器，实现了对平面图像变换（如仿射平移和旋转）的平滑跟踪。该方法利用等变滤波器处理AEB跟踪器提供的特征位置测量，通过等效测量更新步骤去相关时间高度相关的数据，并在涉及快速旋转运动的数据集上进行了实验验证。

Details

Motivation: 解决在自主车辆或机器人控制中，从事件相机流中估计图像变换（如平移和旋转）的问题，以提高跟踪性能，特别是在快速运动场景下。

Result: 在涉及一般和快速旋转运动的数据集上实验，该方法能平滑跟踪图像平面上每秒移动高达7000像素的特征，性能优于直接优化和协方差交叉方法。

Insight: 创新点在于将等变滤波器与AEB跟踪器结合，利用特殊欧几里得群对称性处理仿射变换，并通过等效测量更新步骤有效去相关时间相关数据，提升了事件相机在高速运动下的跟踪鲁棒性。

Abstract: Image tracking is the problem of estimating the transformation that relates a moving image of a scene to an original reference image. The problem is important in control of autonomous vehicles or robots, where the image encodes information about the motion of the camera or environment, as well as in pure computer vision applications. In this paper, we present an equivariant filter design for high performance tracking of planar image transformations using an event camera. The design exploits the Asynchronous Event Blob (AEB) tracker (Wang et al., 2024) to extract feature-position measurements from the raw event stream, and an equivariant filter to compute an affine image translation and rotation using the special Euclidean group symmetry. The equivariant filter incorporates an equivalent-measurement update step that de-correlates the (highly temporally correlated) feature-position measurements provided by the AEB tracker. We evaluate the design experimentally using two datasets involving general and fast rotational motion. We benchmark results against direct optimisation (estimating the relative transformation from the raw blob tracks), and a covariance intersection approach for overcoming data correlation. Our design provides smooth image tracking for features moving up to 7000 pixels per second on the image plane.

[26] Integrating Large Language Models and Graph Convolutional Networks for Semi-Supervised Image Classification cs.CV | cs.AIPDF

Camila Piscioneri Magalhães, Lucas Pascotti Valem

TL;DR: 本文提出了一种结合大型语言模型和图卷积网络的半监督图像分类方法，利用视觉语言模型生成图像描述，通过LLM计算语义相似度来优化kNN和互kNN图的边剪枝，从而提升分类精度。

Details

Motivation: 解决图卷积网络在图像分类中图构建的挑战，因为图像缺乏预定义结构，传统方法基于特征向量相似性构建图可能忽略高层语义信息，而LLM在捕捉语义方面的潜力尚未充分探索。

Result: 实验表明，利用LLM进行图优化能提高分类准确率，特别是在kNN图和某些骨干网络上，具体基准和SOTA水平未在摘要中明确提及。

Insight: 创新点在于将LLM与GCN结合，通过文本描述和语义相似度来细化图结构，过滤语义不相关的邻居，这为半监督学习中的图构建提供了新的语义增强思路。

Abstract: While the growing availability of image data has driven significant advances, labeling datasets remains costly and time-consuming. Therefore, semi-supervised approaches such as Graph Convolutional Networks (GCNs), which learn from both labeled and unlabeled data, have emerged as a promising solution. One of the primary challenges in applying GCNs to image classification is graph construction, since, unlike in citation networks or similar domains, images typically do not come with a predefined structural representation. For visual data, most studies construct graphs based on the similarity between feature vectors from pretrained deep learning backbones, typically by employing kNN or reciprocal kNN algorithms. Although Large Language Models (LLMs) have shown remarkable capability in capturing high-level semantics, their integration with GCNs for image classification remains underexplored. Aiming to fill this gap, our approach uses a Vision Language Model (VLM) to generate textual image descriptions, which are then processed by an LLM to estimate semantic similarity scores between connected images. These scores guide the pruning of edges in kNN and reciprocal kNN graphs, filtering out semantically irrelevant neighbors. Experimental results reveal that leveraging LLMs for graph refinement can improve classification accuracy, particularly for kNN graphs and some backbones. The source code is publicly available at http://gcnllm.lucasvalem.com.

Peipei Zhu, Yueqing Niu, Lin Zhu, Guanchong Niu, Yang Yu

TL;DR: 本文提出了EVAD，一种基于事件流增强的视频异常检测框架，通过联合利用传统视频和仿生事件相机捕获的事件流来提升检测性能。作者构建了一个大规模可见光-事件基准数据集，包含63亿个事件和376,368个视频帧，并设计了一个对比多模态预训练框架来学习判别性事件表示。实验表明，EVAD在多个基准测试中优于现有方法，验证了事件传感在现实世界VAD场景中的有效性。

Details

Motivation: 解决传统仅依赖可见光视频的VAD在光照变化、快速运动和复杂背景等挑战性条件下性能脆弱的问题。

Result: 在基准测试和提出的TJUTCM Pha数据集上，EVAD持续优于现有方法，证明了其有效性。

Insight: 创新点在于引入事件流作为互补模态，构建大规模多模态VAD数据集，并设计了对比预训练和自适应融合模块来整合时空线索，提升了对环境干扰的鲁棒性。

Abstract: Video anomaly detection (VAD) is critical for automated surveillance but remains fragile under challenging conditions such as illumination variations, fast motion, and complex backgrounds when relying solely on visible light videos. To address these limitations, we propose EVAD, an event enhanced VAD framework that jointly exploits conventional video and event streams captured by bio inspired event cameras. Event sensors asynchronously capture brightness changes with high temporal resolution, offering robustness to motion blur and extreme lighting, and providing motion salient cues complementary to video based visual information. To support multi modal VAD research, we construct a large scale visible event benchmark comprising 6.3 billion events and 376,368 video frames collected under diverse illumination levels, motion patterns, and background complexities, filling the gap of realistic and scalable datasets for event based anomaly detection. Building upon this dataset, we design a contrastive multi modal pretraining framework to learn discriminative event representations by aligning semantic embeddings across event streams, visible videos, and textual descriptions. An adaptive fusion module then dynamically integrates event based temporal cues with video based spatial semantics, improving robustness to environmental disturbances. Experiments on benchmarks and the proposed TJUTCM Pha dataset demonstrate that E VAD consistently outperforms methods, validating the effectiveness of event-based sensing for VAD in real world scenarios.

[28] VTaMo: Video-Text Alignment Model for Sign Language Translation cs.CV | cs.CLPDF

Junyi Hu, Zhewen He, Haomian Huang, Aoxiang Yang, Yi Fang

TL;DR: VTaMo是一个用于手语翻译（SLT）的视频-文本对齐模型，通过引入显式的多粒度对齐机制，将连续的手语视频转换为口语文本。它在三个层次上实现对齐：局部对齐使用熵正则化最优传输和可学习的空标记来建立细粒度的帧到标记对应关系；全局对齐通过可学习的正交变换和推土机距离校准嵌入空间几何；位置对齐对比学习用于获得判别性的标记级表示。

Details

Motivation: 现有的无注释（gloss-free）手语翻译方法依赖于翻译监督带来的隐式跨模态对齐，缺乏显式的对齐机制。本文旨在通过引入显式的多粒度视频-文本对齐来提升翻译性能。

Result: 在Phoenix-2014T、CSL-Daily、How2Sign和OpenASL等多个手语翻译基准测试上，VTaMo均取得了最先进的（state-of-the-art）性能。消融实验证实了每个组件的互补贡献。

Insight: 创新点在于提出了一个包含局部、全局和位置对齐三个层次的显式多粒度对齐框架。特别是局部对齐中引入可学习的空标记来处理帧与标记的非一一对应关系，以及全局对齐中使用可学习的正交变换来校准嵌入空间，这些设计对于处理视频序列与文本序列的复杂对齐问题具有借鉴意义。

Abstract: Sign language translation (SLT) converts continuous sign videos into spoken language text. Gloss-free approaches leverage pre-trained visual encoders and language models but rely on implicit cross-modal alignment from translation supervision alone. We present VTaMo, a framework that introduces explicit multi-granularity alignment at three levels: (1) local alignment via entropy-regularized optimal transport with a learnable null token for fine-grained frame-to-token correspondences; (2) global alignment via a learnable orthogonal transformation that calibrates embedding space geometry through Earth Mover’s Distance; and (3) position-aligned contrastive learning for discriminative token-level representations. Experiments on Phoenix-2014T, CSL-Daily, How2Sign, and OpenASL demonstrate consistent state-of-the-art performance, with ablations confirming the complementary contributions of each component. Code is available at https://github.com/junyi2005/vtamo.

[29] Event Burst Trigger: An Availability Backdoor Attack on Event-Based SNN Object Detection cs.CV | cs.CRPDF

Jaesun Baek, Chanwook Lee, Eun-Kyu Lee

TL;DR: 本文提出了Event Burst Trigger（EBT），一种针对基于脉冲神经网络（SNN）的事件相机目标检测模型的可用性后门攻击。该攻击通过在训练数据中注入精心设计的事件触发模式，在推理时诱导出时间上集中的事件流，从而增加虚假目标候选框数量，并显著提升后处理阶段（特别是非极大值抑制，NMS）的计算延迟，进而影响系统整体可用性。

Details

Motivation: 事件相机与脉冲神经网络（SNNs）因其低延迟和低能耗特性，在边缘智能中应用日益广泛，但其在可用性后门攻击方面的脆弱性尚未得到充分研究。本文旨在探索和揭示基于事件的SNN目标检测模型面临的一种新型可用性威胁。

Result: 在先进的SNN目标检测器SpikeYOLO上进行的实验表明，攻击在保持检测精度基本不变（mAP@0.5下降小于0.099）的同时，使NMS阶段的延迟最高增加了38%。在边缘平台上的实验进一步显示，攻击提升了基线资源利用率并减少了调度余量，且基于STRIP的后门检测方法无法可靠识别该攻击。

Insight: 论文的创新点在于首次针对事件驱动的SNN目标检测模型，设计了一种通过诱导事件流爆发来攻击后处理阶段（NMS）可用性的后门方法，揭示了NMS可能成为此类系统的关键性能瓶颈，并证明了该攻击在保持隐蔽性（不影响精度、不产生明显资源峰值）方面的有效性。

Abstract: Event-based vision and spiking neural networks (SNNs) are increasingly adopted for edge intelligence under strict latency and energy constraints. However, the vulnerability of event-based SNN object detection models to availability backdoor attacks remains insufficiently studied. This paper presents Event Burst Trigger (EBT), an availability backdoor attack targeting SNN-based object detection models. EBT injects carefully crafted event-based triggers into the training data, which induce temporally concentrated event streams during inference. These burst-like activations increase the number of phantom (i.e., spurious) object candidates, and consequently inflate the computational cost of the post-processing stage, particularly Non-Maximum Suppression (NMS). We evaluate EBT on SpikeYOLO, the state-of-the-art SNN-based object detector, under a poison-only threat model that does not require modifications to the model architecture, loss function, or inference pipeline. Experimental results show that while detection accuracy remains largely preserved, with mAP@0.5 decreasing by less than 0.099, the latency of the NMS stage increases by up to 38%. This indicates that NMS can become a dominant availability bottleneck in event-based SNN object detection. Experiments on an edge platform further show that the proposed attack elevates baseline resource utilization and reduces scheduling slack without inducing conspicuous peaks in resource usage. In addition, STRIP-based backdoor detection fails to reliably distinguish the proposed attack from benign inputs. These results characterize a previously underexplored availability backdoor threat in event-based SNN object detection systems.

[30] 4D Human-Scene Reconstruction from Low-Overlap Captures cs.CVPDF

Minhyuk Hwang, Sangmin Kim, Seunguk Do, Daneul Kim, Jaesik Park

TL;DR: 本文提出StudioRecon，一种从稀疏、低重叠相机中重建4D人体场景的流程。该方法通过解耦背景和人体，利用视频扩散模型合成大量新视角以增强背景监督，并通过交叉视角身份关联和三角化多视角关键点拟合来初始化可变形高斯人体。最终通过递归增强模块与运动自适应一致性注入来协调合成输出，减少伪影。

Details

Motivation: 解决在现实场景中，仅有少量低重叠相机可用时，现有动态人体捕捉方法输出质量下降、大片区域未被观测到的问题，以及现有4D重建方法在观测不足区域仍存在明显伪影、视频扩散模型对人体产生几何不一致结果的局限性。

Result: 在四个真实世界数据集上实现了最先进的新视角合成效果，并展示了新轨迹渲染和人体替换等应用。

Insight: 创新点在于将背景与人体解耦重建，并分别利用视频扩散模型进行背景视角增强，以及通过交叉视角关联和关键点拟合稳健初始化人体模型；同时，提出的递归增强与运动自适应一致性注入模块有效提升了合成结果的协调性与一致性。

Abstract: Existing volumetric capture of dynamic human performance achieves high fidelity with dense camera arrays. However, in real-world scenarios, only a handful of low-overlap cameras are available, which degrades the output quality and leaves large areas unobserved. Recent 4D reconstruction methods have focused on low-overlap settings, yet they still produce noticeable artifacts in under-observed regions. Video diffusion models have emerged as another option, but they show geometrically inconsistent results for humans. To address these limitations, we propose StudioRecon, a pipeline that reconstructs 4D human scenes from sparse, low-overlap cameras by decoupling background and humans. We densify background supervision by synthesizing hundreds of camera-controlled novel views with a video diffusion model. We also robustly initialize deformable Gaussian humans with cross-view identity association and triangulated multi-view keypoint fitting. Finally, our recursive enhancement module with motion-adaptive consistency injection harmonizes the composed output, thereby further avoiding remaining artifacts. We achieve state-of-the-art novel view synthesis across four real-world datasets and demonstrate applications such as novel trajectory rendering and human replacement.

[31] Super-Generalist: Towards Comprehensive and Accurate Medical Image Understanding via Generalist-Specialist Synergy cs.CVPDF

Shaoteng Zhang, Weiwei Cao, Wanxing Chang, Yutong Xie, Kai Cao

TL;DR: 本文提出了一种名为SuG的超级通用医学图像理解框架，通过整合通用视觉语言模型与专家模型的目标，实现了广泛的泛化能力和专家级的诊断性能。该框架利用多个分割专家（如解剖结构、类别特定病变和类别无关病变分割器）提供的空间先验，进行专家增强的视觉语言对齐，并通过病变掩码校准文本条件视觉注意力，以提升病变定位能力。

Details

Motivation: 当前医学图像理解中，通用视觉语言模型虽覆盖广泛任务并具备零样本能力，但缺乏细粒度解剖和病变感知，导致诊断可靠性和空间可解释性不足；而监督专家模型在特定任务上表现优异，却难以跨疾病和解剖结构泛化。本文旨在解决这一矛盾，构建一个兼具广泛泛化与专家级诊断能力的统一框架。

Result: 在广泛的胸部和腹部CT基准测试（包括CT-RATE、Merlin、MedVL-CT69K及多个内部肿瘤数据集）上，SuG在多种疾病诊断任务中达到最先进性能，并在多个关键肿瘤诊断基准上超越了专家模型。此外，SuG展现出强大的病变定位能力，包括对缺乏类别特定监督的病变类型的鲁棒泛化。

Insight: 创新点在于通过通用-专家协同机制，将通用视觉语言学习与专家目标统一，利用多分割专家的空间先验增强对齐，并通过病变掩码校准注意力以提升临床相关性。客观分析认为，该方法有效结合了通用模型的广度与专家模型的深度，为医学图像理解提供了可扩展且准确的解决方案。

Abstract: Medical images require comprehensive and accurate interpretation to support the diagnosis of diverse clincial conditions. Recent vision-language generalist models offer broad task coverage and promising zero-shot capabilities, yet often lack fine-grained anatomical and lesion awareness for reliable diagnosis and spatial interpretability. In contrast, supervised specialist models achieve strong performance on specific tasks but typically lack generalization across diseases and anatomies. In this work, we present SuG, a Super-Generalist framework that unifies generalist vision-language learning with specialist objectives, enabling both broad generalization and specialist-level diagnostic capability. We perform specialist-enhanced vision-language alignment in SuG by incorporating spatial priors from multiple segmentation experts, including anatomy, class-specific lesion and class-agnostic lesion segmentors that captures lesions beyond anatomies annotated during training. To improve lesion grounding capability, we leverage lesion masks as spatial priors to calibrate text-conditioned visual attention, encouraging disease-related semantics to focus on clinically relevant regions. We evaluate SuG on extensive chest and abdominal CT benchmarks, including CT-RATE, Merlin, MedVL-CT69K, and several in-house tumor datasets. SuG achieves state-of-the-art performance across a wide range of disease diagnosis tasks and surpasses specialist models on several critical tumor diagnosis benchmarks. Furthermore, SuG demonstrates strong lesion grounding capability, including robust generalization to lesion types lacking class-specific supervision.

[32] Weaving Light and Time: Unified Harmonic-Geometric Representation Learning for Dense RGB-Event Parsing cs.CVPDF

Chenxu Peng, Chongtian zhou, Dicheng Liu, Bo-Wen Yin, Yimian Dai

TL;DR: 本文提出了Evita，首个专为密集RGB-事件解析设计的统一骨干网络。它通过几何视差校正、谐波频谱共振和瞬态全局路由等内嵌协同学习模块，解决了RGB图像与事件流之间的表征鸿沟问题。该方法在多个基准测试中实现了新的SOTA性能，并提供了优越的精度-延迟权衡。

Details

Motivation: 融合标准RGB帧与异步事件流已成为在退化环境中实现鲁棒感知的明确范式，但现有统一架构要么计算开销翻倍，要么无法解决密集强度网格与稀疏运动脉冲之间的极端表征差异所导致的隐式几何视差和跨光谱混叠问题。

Result: 在DELIVER、DDD17和DSEC基准测试上的广泛评估证实，Evita建立了新的最先进指标，同时为实时多模态感知提供了优越的精度-延迟权衡。

Insight: 创新点在于将几何视差校正、谐波频谱共振（专门在复频域进行纹理传递）和瞬态全局路由（事件驱动的不对称注意力）等协同学习模块直接嵌入到每个编码器层，并提出了N-ImageNetV2数据集和随机事件表征混合预训练协议，使网络能无缝适应下游任务中的任意事件格式。

Abstract: Fusing standard RGB frames with asynchronous event streams has emerged as a definitive paradigm for robust perception in degraded environments. Although unified backbones have recently gained traction in multi-modal vision, adapting them to the RGB-Event domain remains fundamentally challenging. Existing architectures either resort to decoupled dual encoders that double computational overhead, or adopt generic unified designs that fail to resolve implicit geometric parallax and cross-spectral aliasing under the extreme representational divide between dense intensity grids and sparse kinematic spikes. To transcend these bottlenecks, we present Evita, the first unified backbone specifically engineered for dedicated dense RGB-Event parsing. To achieve profound modal synergy, Evita explicitly embeds a suite of intrinsic co-learning modules directly into every encoder layer. Specifically, it features Geometric Parallax Rectification for adaptive spatial alignment, Harmonic Spectral Resonance for texture transfer exclusively in the complex frequency domain, and Transient Global Routing for event-driven asymmetric attention. To guarantee robust feature extraction against spatial misalignments and decouple representations from specific event encodings, we construct N-ImageNetV2 alongside a stochastic event representation mixing pretraining protocol, empowering the network to seamlessly accommodate arbitrary event formats in downstream tasks. Extensive evaluations across the DELIVER, DDD17, and DSEC benchmarks confirm that Evita establishes new state-of-the-art metrics while delivering a superior accuracy-latency trade-off for real-time multimodal perception.The code are publicly available at: https://github.com/chaineypung/Evita.

Md Mushfiqur Azam, John Quarles, Kevin Desai

TL;DR: TSR-Ego是一个用于第一人称视角（头戴式立体相机）3D人体姿态估计的时间引导立体细化框架。它通过因果深度可分离时间卷积来丰富立体特征图，并利用因果立体解码器结合时间自注意力、关节自注意力和鱼眼变形立体交叉注意力来细化3D关节查询，从而在弱立体线索情况下提高鲁棒性。

Details

Motivation: 解决第一人称视角立体相机下，因鱼眼畸变、严重自遮挡和关节频繁移出视野导致的3D人体姿态估计挑战。现有方法过度依赖单帧局部证据或仅将时间信息作为辅助姿态级上下文，在当前帧立体线索弱时鲁棒性不足。

Result: 在UnrealEgo2和UnrealEgo-RW基准测试上取得了最先进的性能，尤其是在真实世界序列上表现出显著的性能提升。

Insight: 创新点在于将短期运动证据与投影引导的特征采样耦合，在姿态预测前利用时间上下文来塑造采样的立体特征和关节表示，同时保持无需未来帧的在线推理能力。这提供了一种更早、更有效地融合时空信息的新范式。

Abstract: Egocentric 3D human pose estimation from head-mounted stereo cameras is challenging due to fisheye distortion, severe self-occlusion, and frequent truncation of body joints outside the camera field of view. Recent stereo egocentric methods have improved performance through heatmap lifting, stereo correspondence, and transformer-based refinement, but they often rely heavily on frame-local evidence or use temporal information only as auxiliary pose-level context. This limits robustness when current-frame stereo cues are weak, occluded, or ambiguous. We propose TSR-Ego, a temporally guided stereo framework that couples short-term motion evidence with projection-guided feature sampling. The model first enriches dense stereo feature maps using a causal depthwise-separable temporal convolution, allowing past visual evidence to influence the feature space before deformable cross-attention. A single-stage causal stereo decoder then refines learned 3D joint queries through temporal self-attention, joint self-attention, and fisheye deformable stereo cross-attention, using the evolving pose estimate to generate 2D sampling references. Unlike methods that apply temporal reasoning mainly after pose prediction, TSR-Ego uses motion context to shape both the sampled stereo features and the joint representations while preserving online inference without future frames. Experiments on UnrealEgo2 and UnrealEgo-RW show state-of-the-art performance, with especially strong gains on real-world sequences.

[34] AnythingReality: Robust Online Gaussian Splatting SLAM for Open-Vocabulary VR Scene Exploration cs.CVPDF

Timofei Kozlov, Dmitrii Maliukov, Andrey Marchenko, Miguel Altamirano Cabrera, Dzmitry Tsetserukou

TL;DR: 本文提出了一种名为AnythingReality的新型集成架构，用于实现鲁棒的在线3D高斯溅射、实时VR探索和语音驱动的视觉语言模型交互。该系统将基于ORB-SLAM3的位姿估计与在线高斯重建相结合，以处理真实世界的噪声数据，并包含一个支持沉浸式探索和语音语义交互的VR流程。

Details

Motivation: 现有方法通常假设干净的深度或外部位姿，难以处理真实场景中的噪声数据。本文旨在构建一个鲁棒的在线系统，能够在嘈杂的真实世界数据上实现高质量的三维重建与交互。

Result: 在自建数据集和TUM-RGBD基准上，该方法在图像质量指标（PSNR、SSIM、LPIPS）上显著优于最先进的在线高斯溅射方法，同时保持了相当或更优的帧率。视觉语言模型的对象识别率达到88%。

Insight: 主要创新点在于将鲁棒的SLAM位姿估计与在线高斯重建紧密集成，并构建了一个包含VR探索和语音语义交互的完整系统。其质量-速度配置策略在保证性能的同时兼顾了效率。

Abstract: We present a novel integrated architecture for robust online 3D Gaussian splatting, real-time VR exploration, and speech-driven Vision-Language-Model interaction. Unlike methods assuming clean depth or external poses, our system combines ORB-SLAM3-based pose estimation with online Gaussian reconstruction for noisy real-world data. A VR pipeline enables immersive exploration of incremental reconstructions; a semantic module transcribes voice commands, generates scene descriptions, and records points of interest. Against state-of-the-art online Gaussian splatting methods, we improve image quality on our dataset (+14.5% PSNR, +8.6% SSIM, -14.3% LPIPS) and TUM-RGBD (+11.7% PSNR, +7.8% SSIM, -21.6% LPIPS), with comparable or superior frame rates via quality-speed configurations. We achieve an 88% VLM object-recognition rate.

[35] Semantic Hardness Is Not Visual Hardness: Sign-Aware Hard Negative Mining for Sign Language Retrieval cs.CVPDF

Junmyeong Lee, Chan Hur, ChangSu Choi, Sukmin Cho, Fitsum Gaim

TL;DR: 本文针对手语检索（SLRet）在细粒度场景下区分视觉相似手势的脆弱性问题，提出了一种基于视觉混淆性的负样本挖掘方法SAN。该方法通过在手语嵌入空间中构建视觉混淆的困难负样本，而非依赖语言相似性，以解决现有文本挖掘策略无法捕捉视觉歧义的局限性。在PHOENIX-2014T数据集上的实验表明，SAN显著提升了细粒度检索性能，同时保持了粗粒度准确性。

Details

Motivation: 解决手语检索在细粒度场景中因视觉相似手势难以区分而导致的性能瓶颈，指出问题根源在于现有基于文本的困难负样本挖掘策略未能有效处理视觉歧义，而非模型容量不足。

Result: 在PHOENIX-2014T基准测试中，SAN方法显著提升了细粒度检索性能，同时保持了粗粒度准确性，验证了其有效性。

Insight: 创新点在于提出视觉混淆性驱动的困难负样本挖掘策略，强调负样本监督应与视觉歧义对齐而非语义相似性，这为细粒度跨模态检索任务提供了新的监督信号设计思路。

Abstract: Sign Language Retrieval (SLRet) enables efficient access to sign language content but remains fragile in fine-grained scenarios where visually similar signs must be distinguished. We show that this limitation does not stem from model capacity, but from ineffective hard negative supervision. Specifically, we formulate fine-grained retrieval failures as a negative distribution mismatch: semantically distinct yet visually confusable signs are rarely treated as hard negatives, while existing text-based mining strategies fail to capture such visual ambiguity. To address this issue, we propose Sign-Aware Hard Negative Mining (SAN), which constructs hard negatives based on visual confusability in the sign embedding space rather than linguistic similarity. Experiments on PHOENIX-2014T demonstrate that SAN substantially improves fine-grained retrieval performance while preserving coarse-grained accuracy, highlighting the importance of aligning negative supervision with visual ambiguity in sign language retrieval.

[36] Causally Debiased Latent Action Model for Embodied Action Conditioned World Models cs.CV | cs.ROPDF

Yufan Wei, Kun Zhou, Lingjun Mao, Zijun Zhang, Ziming Xu

TL;DR: 本文提出了一种因果去偏的隐式动作模型（CD-LAM），用于改进基于隐式动作的具身动作条件世界模型（ACWM）。该方法通过三种高效的微调目标——以具身为中心的重建、以动作为中心的对比学习和隐空间校准——来减少动作无关的视觉因素（如背景和未接触物体）带来的偏差，从而提升模型的可控性和下游任务性能。

Details

Motivation: 现有的隐式动作模型（LAMs）通常仅使用重建目标进行训练，导致学习到的隐式动作表示与动作无关的视觉因素（如背景）纠缠在一起，这严重阻碍了动作条件世界模型（ACWMs）的可控性。本文旨在解决这一动作无关偏差问题，以构建更可控的ACWMs。

Result: 在2B和14B参数的ACWM骨干网络上进行的实验表明，CD-LAM显著提升了隐式动作的可控性、下游机器人动作跟随能力、视觉保真度和适应效率。该方法仅需6k微调步数，且机器人动作适应所需的更新次数比基线方法减少了12倍以上。

Insight: 论文的创新点在于明确识别了动作无关偏差是ACWM可控性的关键障碍，并提出了一个包含三种高效微调目标的因果去偏框架。从客观角度看，其将对比学习和隐空间校准等技术与具身重建目标结合，为从无标签视频中学习解耦且可控的隐式动作表示提供了一种系统且高效的解决方案。

Abstract: Action-conditioned world models (ACWMs) aim to simulate future observations conditioned on embodied actions, offering a promising foundation for robot planning, policy evaluation, and data augmentation. However, learning controllable ACWMs requires large-scale action-labeled data, which remains costly to collect in the real world. Latent action models (LAMs) mitigate this bottleneck by inferring latent actions from unlabeled videos, but existing LAMs are typically trained with reconstruction-only objectives and therefore entangle action-relevant dynamics with action-irrelevant visual factors such as backgrounds and untouched objects. In this work, we identify this action-irrelevant bias as a key obstacle to controllable ACWMs and introduce evaluation metrics to measure latent-action bias, action following, and robustness. We propose CD-LAM, a causally debiased framework for LAM-based ACWMs. CD-LAM introduces three efficient fine-tuning objectives: embodiment-centric reconstruction, action-centric contrastive learning, and latent space calibration, which together encourage embodiment-focused, action-aware, and calibrated non-collapsed latent action representations. Experiments on 2B and 14B ACWM backbones show that CD-LAM substantially improves latent-action controllability, downstream robot-action following, visual fidelity, and adaptation efficiency, requiring only 6k fine-tuning steps and more than 12$\times$ fewer robot-action adaptation updates than the baseline.

Pablo Diaz-Pereda, Alejandro Rodriguez-Ramos, David Perez-Saura, Pascual Campoy

TL;DR: REMIND是一种用于室内导航的在线多目标重识别跟踪器，旨在解决移动机器人在长时间间隔、显著视角变化和严重光照变化下重新识别先前观察到的通用室内物体的挑战。该方法结合了冻结的DINOv3特征、双库多原型外观记忆、部件和背景级描述符、邻居上下文推理模块以及联合匈牙利分配与歧义感知保护机制，无需相机姿态或深度信息。

Details

Motivation: 现有方法在室内长期多目标重识别方面存在局限：多目标跟踪方法主要针对视频速率下的短期行人/车辆关联，重识别方法缺乏持久记忆机制，而最先进的视频对象分割技术依赖于反应性干扰过滤而非强制全局身份一致性。REMIND受人类视觉认知启发，旨在通过累积外观熟悉度和空间上下文来实现鲁棒的长期重识别。

Result: 在专门构建的室内数据集上，REMIND达到90.35%的IDF1分数，比最先进的视频对象分割基线高出近20个百分点，比强检测跟踪基线高出36分以上。在ScanNet++数据集上，除端到端检测场景外，REMIND在所有设置中均取得最高IDF1，且在身份关联和恢复方面更准确，同时能完成所有场景处理，而视频对象分割基线在66.9%的场景下因GPU内存耗尽而失败。

Insight: 创新点包括：结合认知启发（外观熟悉度与空间上下文）的长期记忆机制、双库多原型外观记忆架构、邻居上下文推理模块利用空间共现关系，以及联合匈牙利分配与歧义感知保护。客观分析认为，该方法通过融合语义特征（DINOv3）、结构化记忆和上下文推理，为无姿态/深度依赖的通用室内物体长期重识别提供了系统化解决方案。

Abstract: Mobile robots operating indoors must re-identify previously observed objects after long temporal gaps, significant viewpoint changes, and severe illumination variations. This remains a challenging problem: multi-object tracking methods are optimized for short-term association of pedestrians and vehicles at video rates, person and vehicle re-identification approaches lack persistent memory mechanisms, and state-of-the-art video object segmentation techniques rely on reactive distractor filtering rather than enforcing global identity consistency. To address these limitations, we present REMIND, an online tracker designed for long-term multi-object re-identification of generic indoor objects from monocular RGB imagery, requiring neither camera pose nor depth. Motivated by evidence from visual cognition that humans rely on accumulated appearance familiarity and spatial context rather than explicit self-localization, REMIND combines frozen DINOv3 features with a dual-bank multi-prototype appearance memory, part- and background-level descriptors, a neighbour-context reasoning module exploiting spatial co-occurrence, and joint Hungarian assignment with ambiguity-aware safeguards. On a purpose-built indoor dataset featuring controlled revisits and dense same-class clutter, REMIND reaches 90.35% IDF1, nearly 20 points above a state-of-the-art video object segmentation baseline and more than 36 above a strong tracking-by-detection baseline. On ScanNet++, it attains the highest IDF1 in every setting but one, end-to-end detection over all scenes, where the tracking-by-detection baseline is marginally ahead while REMIND still associates and recovers identities more accurately; it also completes every scene, whereas the video object segmentation baseline exhausts GPU memory on 66.9% under YOLO detections. The complete system, evaluation framework, and dataset are publicly released.

[38] Dynamic Inverse Rendering for Enhanced Material-Lighting Decomposition cs.CV | cs.GRPDF

Raza Yunus, Benjamin Ummenhofer, Jan Eric Lenssen, Eddy Ilg

TL;DR: 本文提出了一种动态逆渲染方法，用于从视频中分解物体的材质和光照。该方法利用刚性运动物体的多视角观测来约束优化，从而更准确地解耦材质和光照，即使在真实世界的噪声条件下也能保持优势。

Details

Motivation: 逆渲染中从出射表面辐射分解材质和光照是高度不适定问题，因为多种组合可能导致相同的观测颜色。本文探索利用刚性运动物体提供的多样化光-表面交互观测来解决这一模糊性。

Result: 在合成数据上的实验分析表明，与静态观测相比，在刚性运动下重建的材质精度显著更高。在真实手持物体的RGB视频上的结果也显示，该流程在噪声现实条件下仍保持此优势。

Insight: 创新点在于将物体跟踪与重建和逆渲染相结合，利用运动作为先验来约束不适定问题。客观来看，将动态观测作为额外约束是解决逆渲染中材质-光照模糊性的一个有效且实用的方向。

Abstract: Decomposing outgoing surface radiance into material and illumination during inverse rendering is essential for applications such as relighting and augmented reality, yet it is severely ill-posed since multiple combinations can result in the same observed colour. Capturing an object under multiple lighting conditions usually helps resolve this ambiguity as it constrains the optimization towards correct solutions. In this work, we explore the potential of reconstructing rigidly moving objects – which provides observations of diverse light-surface interactions – to resolve the material-lighting ambiguity in inverse rendering. For this purpose, we introduce a relightable approach that marries object tracking and reconstruction with inverse rendering for general rigidly moving objects. Our experimental analysis on synthetic data demonstrates that motion can be an advantage for disentangling material and lighting: the reconstructed material is significantly more accurate when the object is observed under rigid motion than when it is static. Moreover, results on RGB videos of real hand-held objects show that our pipeline preserves this advantage even under noisy real-world conditions.

[39] Simon-SR: Spatially Adaptive Modulation and Visual Prompt Adaptation for Text-Reinforced Super-Resolution cs.CVPDF

Haotong Cheng, Yuxuan Li, Zijie Cui, Rongling Tan, Chenyuan Wang

TL;DR: 本文提出了Simon-SR，一个用于单图像超分辨率（SISR）的多模态框架。它利用可学习的提示进行高效的语义挖掘和鲁棒的文本-图像融合，通过对比提示学习和提示引导的空间自适应细化来增强多模态对齐，以解决现有方法对错误先验敏感且需要昂贵标注的问题。

Details

Motivation: 现有基于多模态的单图像超分辨率方法虽然提升了感知质量，但对错误先验敏感且依赖昂贵的标注数据。本文旨在解决这些问题，实现更鲁棒和高效的文本增强超分辨率。

Result: 实验表明，Simon-SR在PSNR、SSIM和LPIPS指标上超越了现有最先进（SOTA）方法，最大提升分别达到0.50 dB、0.0133和0.0695。

Insight: 主要创新点在于结合了可学习的对比提示进行语义挖掘，以及提示引导的空间自适应细化模块，以实现更鲁棒的多模态对齐和融合，这为利用文本信息增强视觉任务提供了一种高效且抗干扰的新思路。

Abstract: Single Image Super-Resolution (SISR) reconstructs high-quality images from low-resolution inputs. While recent multi-modal methods improve perceptual quality, they remain sensitive to erroneous priors and require expensive annotations. To address these issues, we propose Simon-SR, a multi-modal SISR framework leveraging learnable prompts for efficient semantic mining and robust text-image fusion. Our approach combines Contrastive Prompt Learning with Prompt-Guided Spatially Adaptive Refinement to enhance multi-modal alignment. Experiments demonstrate that Simon-SR surpasses state-of-the-art methods, achieving maximum improvements of 0.50 dB in PSNR, 0.0133 in SSIM, and 0.0695 in LPIPS. Code will be released.

Hyein Park, Namho Kim, Junhwa Kim

TL;DR: 本文提出了一种名为SVF-CR的同步视觉-面部交叉精炼框架，用于识别多模态行为中的矛盾与犹豫状态。该方法通过同步划分视频片段和面部区域，利用自注意力和双向交叉注意力进行模态内和模态间信息交互，并结合一致性与差异性建模构建证据，最后与文本、声学特征进行成对融合以做出最终决策。

Details

Motivation: 矛盾与犹豫是微妙的行为状态，需要通过语言内容、面部行为、视觉上下文和声学线索的组合来表达。有效识别不仅需要提取信息丰富的单模态表征，还需要对时间对齐的行为证据在跨模态间的交互进行建模。

Result: 在BAH（行为矛盾/犹豫）公共评估集上的实验表明，所提出的同步视觉-面部交叉精炼方法在公共macro-F1指标上优于全局视觉-面部令牌融合和同步证据基线方法，达到了0.7156的公共macro-F1分数。

Insight: 创新点在于提出了同步的视觉-面部交叉精炼机制，通过共享时间划分实现模态对齐，并利用双向交叉注意力让全局视频上下文与局部面部行为相互精炼。此外，通过一致性与差异性建模构建证据，以及成对证据融合策略，有效整合了多模态信息。

Abstract: Ambivalence and hesitancy are subtle behavioral states that are expressed through a combination of verbal content, facial behavior, visual context, and acoustic cues. Effective recognition therefore requires not only extracting informative unimodal representations, but also modeling how temporally aligned behavioral evidence interacts across modalities. In this paper, we propose a synchronized visual-facial cross-refinement framework (SVF-CR) with pairwise multimodal evidence fusion for ambivalence and hesitancy recognition. The proposed method first extracts whole-video segment tokens and cropped-face segment tokens using the same temporal partition. The synchronized visual and facial tokens are refined through intra-modal self-attention and bidirectional visual-facial cross-attention, allowing whole-video context and local facial behavior to mutually refine each other before evidence construction. We then construct segment-level visual-facial evidence using consistency and discrepancy modeling, followed by temporal self-attention and attention pooling. Textual and acoustic features are lightly refined through context self-attention and are fused with the enhanced visual-facial evidence at the final decision stage using pairwise evidence fusion. Experiments on the BAH (Behavioral Ambivalence/Hesitancy) public evaluation split show that the proposed synchronized visual-facial cross-refinement improves public macro-F1 over both global visual-face token fusion and synchronized evidence baselines, achieving a public macro-F1 of 0.7156. Code is available at : https://github.com/hiinnnii/BAH-Challenge-ECCV2026\_SVF-CR.

[41] Parameter-Efficient Vision-Language Adaptation with Continuous Metadata Conditioning for Animal Re-Identification cs.CV | cs.AIPDF

Anil Osman Tur, Tonje Knutsen Sordalen, Kim Tallaksen Halvorsen, Cigdem Beyan

TL;DR: 本文提出了一种参数高效的CLIP适应框架用于动物重识别，通过引入连续元数据条件机制，将数值属性直接融入训练时的提示表示，以应对长期外观变化和时间分布偏移。

Details

Motivation: 解决长期动物重识别中因形态渐变和季节性外观变化带来的挑战，特别是在身份和时间分布偏移下，适应预训练视觉语言模型到纵向生态场景的困难。

Result: 在七年纵向鱼类数据集和多个野生动物基准测试上，闭集、开集和时间感知评估协议下均表现出性能提升，增强了对外观变化和时间偏移的鲁棒性。

Insight: 主要创新点在于连续元数据条件策略，通过保留数值元数据的连续结构而非离散化为文本类别，在训练中平滑调制嵌入空间，同时保持纯视觉推理流程，无需测试时元数据。

Abstract: Long-term animal re-identification (ReID) must remain robust to gradual morphological evolution and seasonal appearance shifts. Although recent vision-language models provide strong pretrained visual representations, adapting them to longitudinal ecological settings remains challenging, particularly under identity and temporal distribution shifts. We present a parameter-efficient CLIP adaptation framework for animal ReID and introduce a continuous metadata-conditioning mechanism that incorporates numerical attributes directly into the prompt representation during training. While low-rank visual adaptation, prompt-based supervision, and cross-modal alignment provide the adaptation framework, the proposed metadata-conditioning strategy constitutes the primary methodological contribution. By preserving the continuous structure of numerical metadata rather than discretizing it into textual categories, the proposed approach enables smooth modulation of the embedding space during training while maintaining a purely visual inference pipeline. Experiments on a seven-year longitudinal fish dataset and multiple wildlife benchmarks demonstrate improved performance under closed-set, open-set, and time-aware evaluation protocols. The results demonstrate that continuous metadata conditioning improves robustness to longitudinal appearance variation and temporal distribution shifts, while parameter-efficient adaptation enables a purely visual inference pipeline without requiring metadata at test time. Code and evaluation splits can be found at: https://github.com/AnilOsmanTur/MetaPrompt-ReID.

[42] Multimodal Scenario Similarity Search for Autonomous Driving cs.CV | cs.LGPDF

Tamás Matuszka, András Tamásy, Balázs Szolár

TL;DR: 本文提出了一种用于自动驾驶场景检索的多模态框架，该框架将视觉和基于轨迹的表示结合在一个统一的检索流程中。论文研究了两种基于轨迹的方法：基于周围智能体运动的显式匹配方法Exo-Trajectory，以及通过对比学习从物体轨迹中学习的基于Transformer的表示ScenarioFormer。实验表明，轨迹表示在运动中心事件（如切入、转弯、交通排队）上检索性能强，而视觉嵌入在表观信息重要时表现优异，两者结合能持续提升检索质量。

Details

Motivation: 大规模自动驾驶数据集包含大量记录场景，需要高效的检索方法来识别与给定查询相似的情况。现有方法通常依赖视觉或基于运动的描述，难以理解它们在场景检索中的相对优势和局限性。

Result: 实验结果表明，轨迹表示在运动中心事件（如切入、转弯、交通排队）上提供了强大的检索性能，而视觉嵌入在表观信息重要时表现出色。最重要的是，结合视觉和轨迹信息能持续提高检索质量，获得最佳整体性能。

Insight: 创新点在于提出了一个结合视觉和轨迹表示的多模态检索框架，并系统比较了两种轨迹方法。核心洞察是表观和运动捕捉是场景相似性的互补概念，这为自动驾驶数据挖掘、数据集管理和基于场景的验证提供了多模态检索系统的动机。

Abstract: Large-scale autonomous-driving datasets contain vast numbers of recorded scenarios, creating a need for efficient retrieval methods that can identify situations similar to a given query. Existing approaches typically rely on either visual representations or motion-based descriptions, making it difficult to understand their relative strengths and limitations for scenario retrieval. In this work, we present a multimodal framework for autonomous-driving scenario retrieval that combines visual and trajectory-based representations within a unified retrieval pipeline. We investigate two trajectory-based approaches: Exo-Trajectory, an explicit matching method based on surrounding-agent motion, and ScenarioFormer, a transformer-based representation learned from object trajectories using contrastive learning. We compare these approaches against strong vision-based baselines and analyze their behavior across a diverse set of driving scenarios. Experimental results show that trajectory representations provide strong retrieval performance for motion-centric events such as cut-ins, turning maneuvers, and traffic queueing, while visual embeddings excel when appearance cues are informative. Most importantly, combining visual and trajectory information consistently improves retrieval quality, yielding the best overall performance. These findings demonstrate that appearance and motion capture are complementary notions of scenario similarity and motivate multimodal retrieval systems for autonomous-driving data mining, dataset curation, and scenario-based validation.

[43] Robustifying Vision-Language Models via Test-Time Prompt Adaptation cs.CV | cs.LGPDF

Xingyu Zhu, Huanshen Wu, Shuo Wang, Beier Zhu, Jiannan Ge

TL;DR: 本文提出RITA框架，通过测试时提示适应增强视觉语言模型的对抗鲁棒性。该方法利用最优传输对齐增强视觉特征与文本原型的分布，并引入动态缓存在线积累可靠线索，从而在保持干净数据精度的同时显著提升对抗扰动下的性能。

Details

Motivation: 现有视觉语言模型在对抗扰动下性能急剧下降，而传统的测试时适应方法依赖样本级置信度启发，忽略了数据的内在分布结构，无法区分对抗性误预测与真实语义一致性。

Result: 大量实验表明，RITA在多个基准测试中显著提升了对抗鲁棒性，且不损害干净数据的准确性，实现了在对抗环境下的稳定性能。

Insight: 创新点在于从样本级估计转向分布级对齐，利用最优传输处理增强视图的分布以缓解对抗异常值，并通过动态缓存实现在线优化，为测试时适应提供了结构化的分布视角。

Abstract: Pre-trained Vision-Language Models (VLMs) such as CLIP achieve strong zero-shot generalization, but their performance degrades sharply under adversarial perturbations. Existing test-time adaptation methods typically rely on sample-level confidence heuristics, overlooking the intrinsic distributional structure of the data. This sample-centric approach limits robustness, as it fails to distinguish confident adversarial mispredictions from true semantic consistency. In this work, we observe that adversarial distortion is structurally brittle: while holistic representations are corrupted, semantic integrity is often preserved in the distribution of augmented views. Motivated by this insight, we propose RITA, a Robust test-tIme prompt-TAdaptation framework that shifts from sample-level estimates to distribution-level alignment. Specifically, RITA employs optimal transport to align the distribution of augmented visual features with textual prototypes, mitigating adversarial outliers and rectifying cross-modal semantic misalignment. Furthermore, we introduce a dynamic cache to progressively accumulate reliable cues from the test stream for online refinement. Extensive experiments demonstrate that RITA significantly improves adversarial robustness without compromising clean accuracy.

[44] Decoupling Language Guidance from Backbones for Text-Guided Medical Segmentation cs.CV | cs.AIPDF

Yungeng Liu, Xuanzi Fang, Haijin Zeng, Qi Dai, Yongyong Chen

TL;DR: 本文提出了一种名为BTHA的骨干网络可迁移分层适配器框架，用于文本引导的医学图像分割。该框架通过解耦语言引导模块与视觉/文本骨干网络，实现了跨异构编码器的通用性，并引入分层监督策略和尺度自适应门控语义引导适配器来提升分割性能。

Details

Motivation: 现有文本引导医学图像分割模型通常将跨模态融合、监督和解码器设计紧密耦合到特定架构中，导致语言引导模块难以在不同视觉和文本骨干网络间复用，且更换编码器对时常需重新设计网络。

Result: 在多个公共数据集上的评估表明，BTHA框架在卷积和基于Transformer的视觉编码器以及不同语言编码器上均保持有效，能以适度的计算开销提升强文本引导基线的性能。

Insight: 创新点在于提出了一个稳定的特征级接口和骨干网络可迁移的适配器设计，通过分层由粗到细的监督策略和尺度自适应门控机制，实现了语言引导与骨干网络的解耦，增强了模型的通用性和灵活性。

Abstract: Text-guided medical image segmentation leverages clinical semantics to improve lesion delineation, yet many existing models bind cross-modal fusion, supervision, and decoder design into a task-specific architecture. Such tight coupling makes it difficult to reuse language guidance modules across heterogeneous vision and text backbones, and often requires redesigning the network when the encoder pair changes. This paper presents BTHA, a backbone-transferable hierarchical adapter framework for text-guided medical image segmentation. BTHA is built around a stable feature-level interface: given multi-scale visual features and a text representation, it injects semantic guidance through shape-preserving adapters while maintaining the decoder-side tensor contract. To make this interface effective, we introduce a Hierarchical Coarse-to-Fine Supervision Strategy that decomposes learning into global image-text alignment, multi-scale auxiliary localization, and boundary-aware final mask refinement. We further design a Scale-Adaptive Gated Semantic Guidance (SAGSG) adapter, where resolution-specific gates adaptively control textual injection and channel recalibration suppresses redundant cross-modal responses. Evaluations across diverse vision and text backbones show that the same adapter and supervision design remains effective across convolutional and transformer-based visual encoders as well as different language encoders. Experiments on four public datasets further demonstrate that BTHA improves strong text-guided baselines with modest computational overhead.

[45] Foveation-Guided Dynamic Token Selection for Robust and Efficient Vision Transformers cs.CV | cs.LG | cs.NEPDF

Ibrahim Batuhan Akkaya, Kishaan Jeeveswaran, Bahram Zonooz, Elahe Arani

TL;DR: 本文受人类视觉系统（HVS）的启发，提出了Foveated Dynamic Transformer（FDT），一种基于注视点引导的动态令牌选择架构，旨在提升视觉Transformer的鲁棒性和效率。FDT通过注视模块和中央凹模块，在未针对噪声和对抗攻击进行专门训练的情况下，展现出对这些干扰的固有鲁棒性。在50%注视预算设置下，FDT在ImageNet上取得了比DeiT-S更高的准确率（81.9% vs. 80.9%），同时减少了34.57%的乘加运算，实现了精度与效率的良好权衡。

Details

Motivation: 受人类视觉系统（HVS）利用中央凹采样和眼动实现高效、鲁棒感知的启发，旨在将这种自适应计算机制引入视觉Transformer，以同时提升模型对噪声/对抗攻击的鲁棒性和计算效率。

Result: 在ImageNet基准测试中，FDT在50%注视预算下达到81.9%的准确率，优于DeiT-S的80.9%，同时计算量（乘加操作）减少了34.57%，展示了其精度-效率权衡上的一个优势操作点。

Insight: 核心创新在于将HVS的注视点选择与中央凹处理机制形式化为可学习的“注视模块”和“中央凹模块”，实现了动态、自适应的令牌选择与多尺度信息嵌入。这为构建兼具自适应计算与内在鲁棒性的神经网络提供了新思路。

Abstract: The human visual system (HVS) employs foveated sampling and eye movements to achieve efficient perception, conserving both metabolic energy and computational resources. Drawing inspiration from this robustness and adaptability, we introduce the Foveated Dynamic Transformer (FDT), a foveation-guided dynamic token-selection architecture that integrates these mechanisms into a vision transformer framework. The FDT exhibits strong resilience to various types of noise and adversarial attacks, despite not being explicitly trained for such challenges. This inherent robustness is achieved through the use of fixation and foveation modules: the fixation module identifies fixation points to filter out irrelevant information, while the foveation module generates foveated embeddings with multi-scale information. At the 50% fixation-budget setting, FDT achieves higher accuracy than DeiT-S (81.9% vs. 80.9%) while reducing multiply-accumulate operations by 34.57%, highlighting one operating point on its accuracy-efficiency trade-off. These attributes position FDT as an HVS-inspired step toward artificial neural networks that combine adaptive computation with improved resilience.

[46] SigLIP-HD by Fine-to-Coarse Supervision cs.CVPDF

Lihe Yang, Zhen Zhao, Hengshuang Zhao

TL;DR: 本文提出SigLIP-HD模型，旨在不增加图像分辨率的情况下，通过一种新颖的从细粒度到粗粒度的监督设计，提升视觉表示的质量。该方法强制中分辨率图像的粗粒度特征模仿其高分辨率版本的细粒度特征，从而在相同推理成本下生成更优的视觉token。

Details

Motivation: 动机在于解决多模态大语言模型中，单纯提高图像分辨率以获取更细粒度视觉token所带来的计算和设计复杂度增加的问题。研究核心是探索如何在较低成本下，不依赖更大图像，实现精细的视觉感知。

Result: 在广泛的MLLM基准测试上得到验证，模型在相同推理预算下持续产生比基线模型更强的结果，特别是在OCR相关任务上表现突出。

Insight: 创新点在于提出了一种简单而有效的“从细到粗”的监督框架，通过特征模仿策略，在标准分辨率下解锁了模型的感知潜力，为提升视觉表示质量提供了一种高效的新途径。

Abstract: High-quality visual representation is a long-standing pursuit in computer vision. In the context of multimodal LLMs (MLLMs), feeding higher-resolution images can produce more fine-grained visual tokens. However, it introduces additional computational and design complexity, due to multiple forward passes and post-processing of increased tokens. Before simply adopting a higher resolution, have we truly unlocked the model’s full perception capability at a standard resolution? Therefore, we study an interesting problem: how to achieve fine visual perception under lower cost without larger images. We present SigLIP-HD in this work. The core is a highly simple fine-to-coarse supervision design. We enforce the coarse feature of a mid-resolution image to mimic the fine-grained feature of its high-resolution version. We build this framework on the advanced SigLIP 2 model. Our final model produces better visual tokens at exactly the same inference budget. It is validated on extensive MLLM benchmarks and consistently delivers stronger results than our baseline model, especially on OCR-related tasks.

[47] What VGGT Knows About Overlap: Probing Geometric Foundation Models for Co-Visibility cs.CV | cs.AIPDF

Filippo Ziliotto, Luciano Serafini, Lamberto Ballan, Tommaso Campari

TL;DR: 该论文发现视觉几何基础模型VGGT能够隐式编码共可见性，并基于此提出了Co-VGGT方法，该方法冻结VGGT主干，仅训练一个轻量级的层间专家混合头来从RGB图像中分类共可见性。在Co-VisiON基准测试中，该方法超越了人类标注基线，并在成对和多视图指标上显著优于先前工作。

Details

Motivation: 解决3D重建和机器人定位中的一个基本挑战——共可见性，即在重叠区域极小的情况下，确定哪些图像对共享重叠的可见表面。

Result: 在Co-VisiON基准上，Co-VGGT超越了人类标注基线，成对和多视图性能分别比先前工作提升了超过25%和10%。其成对预测经过良好校准（ECE=0.030），可直接用作下游SfM和SLAM流程中可见性图的边权重。

Insight: 揭示了VGGT等几何基础模型内部表征存在层次化结构，早期层构建3D感知场景表示，而后期层（如L17）专门负责共可见性推理。创新性地将模型各层视为专业化专家，通过轻量级自适应加权机制（MoE头）有效利用这种隐式知识，实现了高效且校准良好的共可见性预测。

Abstract: A fundamental challenge in 3D reconstruction and robotic localization is co-visibility: determining which image pairs share overlapping visible surfaces, particularly in scenarios with minimal overlap. We demonstrate that VGGT implicitly encodes co-visibility as an emergent behavior: without any supervision for this task, its internal representations exhibit a clear hierarchical structure mirroring that of large language models, i.e. early layers build a 3D-aware scene representation, while late layers act as dedicated co-visibility reasoners. In particular, we identify layer L17 as a negative anchor that consistently routes non-co-visible pairs for this backbone, regardless of the evaluation setting, providing task-grounded evidence of layer specialization in a geometry-grounded foundation model. Building on this, we introduce Co-VGGT, which freezes VGGT and trains only a lightweight layer-wise mixture-of-experts head (less than 7.5M parameters) to classify co-visibility from RGB alone, treating each layer as a specialized expert whose geometric abstraction is adaptively weighted per input pair. On the Co-VisiON benchmark, Co-VGGT surpasses the human annotation baseline and improves over prior work by more than 25% pairwise and 10% multiview. Pairwise predictions are well-calibrated (ECE=0.030), enabling direct use as edge weights in visibility graphs for downstream SfM and SLAM pipelines without post-hoc correction. Code and data are available.

[48] The Count Is There, but Misaligned: Understanding and Correcting Counting Failures in VLMs cs.CV | cs.LGPDF

Ahmed Oumar El-Shangiti, Abzal Nurgazy, Hilal AlQuabeh, Nikolai Rozanov, Kentaro Inui

TL;DR: 本文研究了视觉语言模型（VLMs）在物体计数任务上表现不佳的问题，发现模型内部通常编码了正确的计数信息，但输出时存在错位。通过训练非线性探针检测计数错误，并利用因果干预验证了内部计数知识的存在。基于此，作者提出了一种基于检测器引导的自校正方法，在推理时无需更新参数即可显著提升计数准确率。

Details

Motivation: 尽管VLMs在多模态任务上表现强劲，但在基础物体计数任务上仍存在困难。本文旨在探究这种失败是由于模型内部缺乏计数知识，还是内部表征与语言化输出之间存在差距。

Result: 在五个计数数据集和四个VLM上的实验表明，该方法可将计数准确率最高提升15.6个百分点（绝对百分比），且无需参数更新。

Insight: 论文的创新点在于揭示了VLMs内部知识与输出之间的错位现象，并提出了基于激活的错误探测和自校正方法。这为理解模型内部工作机制和设计推理时干预策略提供了新视角。

Abstract: Despite strong performance on many multimodal tasks, vision-language models (VLMs) still struggle with basic object counting. We investigate whether this reflects missing internal knowledge or a gap between internal representations and verbalized outputs. Training simple probes on activations from four VLMs across five counting datasets reveals that nonlinear probes can reliably detect counting errors, suggesting that VLMs often encode the correct count even when they output the wrong answer. SVCCA analysis shows that probes trained on ground-truth counts and probes trained on model outputs occupy a partially shared activation subspace but read out along misaligned directions. We further validate our findings using a causal steering intervention, proving that strengthening the direction of count-identified probes does improve model counting performance. Motivated by this result, we propose a detector-guided self-correction method that selectively re-prompts the model only when an internal error detector predicts failure. This simple inference-time intervention improves counting accuracy by up to 15.6 absolute percentage points, without any parameter updates. Our results establish activation-based error probing as both a practical tool for improving VLM counting and a mechanistic lens on the gap between internal knowledge and model outputs.

[49] Seeing is Free, Speaking is Not: Uncovering the True Energy Bottleneck in Edge VLM Inference cs.CV | cs.AIPDF

Junfei Zhan, Haoxun Shen, Mingang Guo, Zixuan Huang, Tengjiao He

TL;DR: 本文通过首次对边缘设备上视觉语言模型（VLM）推理进行系统性能耗分析，揭示了输出生成（解码阶段）而非视觉处理是主要的能耗瓶颈。研究发现，平均推理功耗是模型固有的常数，而能耗差异主要由推理时间（即输出令牌数量）驱动，输出令牌的能耗成本是输入令牌的11至39倍。

Details

Motivation: 现有提升VLM效率的研究主要集中于减少视觉令牌，隐含地认为视觉处理是主要能耗成本。本文旨在通过实际能耗剖析，验证这一假设并揭示边缘VLM推理中真正的能耗瓶颈。

Result: 在NVIDIA RTX 3070和Jetson Orin NX两个硬件平台上，对五个不同架构的模型进行了分析。结果表明，控制输出长度最多可节省97%的总能耗，而即使完全移除所有视觉令牌，对于固定令牌模型最多也只能节省10%的能耗。解码阶段的能耗主导性随着模型规模的增大而增强。

Insight: 论文的核心创新点在于通过实证测量推翻了“视觉处理是主要能耗源”的隐含假设，明确指出输出令牌数量（即模型生成文本的长度）是边缘VLM推理中延迟和能量的主要驱动因素。这为未来面向边缘设备的VLM效率优化（如输出长度控制）提供了新的关键方向。

Abstract: Vision-Language Models (VLMs) are the perceptual backbone of embodied AI, but their energy footprint on edge hardware remains poorly understood. Existing efficiency efforts focus predominantly on reducing visual tokens, implicitly treating visual processing as the dominant energy cost. We overturn this implicit assumption through the first systematic energy profiling of on-device VLM inference, spanning five models across three architecture families, four input resolutions, and two hardware platforms (NVIDIA RTX 3070 and Jetson Orin NX). Our analysis yields three findings. First, average inference power is a model-intrinsic constant, invariant to input resolution, image complexity, and prompt type, with less than 5% variation across all conditions. This means that all energy variation across inputs must arise from variation in inference time, not from variation in power draw. Second, each output token costs 11 to 39x more wall-clock time than each input token due to the compute-bound and memory-bound asymmetry between prefill and decode, making output token count the dominant driver of both latency and energy. Third, image complexity, measured by the number of objects in an image, induces up to 4.1x energy differences at identical resolution. This variation arises not from increased visual processing cost, but from differences in output length. These findings expose a fundamental limitation of visual token pruning: even removing all visual tokens saves at most 10% of total energy for fixed-token models. Across models spanning 1 billion to 8 billion parameters, controlling output length saves up to 97% of total energy, with the energy dominance of decoding growing stronger at larger model scale. In short, the true energy bottleneck in edge VLM inference is not what the model sees, but how much it says.

[50] ALICE: Learning a General-Purpose Pathology Foundation Model from Vision, Vision-Language, and Slide-Level Experts cs.CV | cs.AIPDF

Jiawen Li, Tian Guan, Huijuan Shi, Xitong Ling, Mingxi Fu

TL;DR: ALICE是一个通过多阶段聚合蒸馏训练的统一病理学基础模型，它从八个视觉、视觉语言和玻片级教师模型中蒸馏出专业知识，整合到单一骨干网络中。模型在近2500万图块级病理图像和15.5万高分辨率图像上预训练，并在21个任务场景、96个下游任务和48个数据源上评估，覆盖组织分析、视觉语言多模态评估和全玻片临床评估。

Details

Motivation: 现有病理学基础模型的能力受预训练目标、数据源和空间尺度限制，导致互补的专业知识分散在不同骨干网络中，需要统一整合这些能力。

Result: 在区域组织分析、视觉语言多模态评估和全玻片临床评估三种设置中，ALICE在所有任务匹配的病理学基础模型中取得了最佳平均排名，展示了其广泛适用性。

Insight: 创新点在于采用多阶段聚合蒸馏策略，将不同专业模型（视觉、视觉语言、玻片级）的能力整合到单一骨干中，实现了病理学领域互补专业知识的统一与泛化。

Abstract: Foundation models are reshaping computational pathology, yet their capabilities remain shaped by pretraining objectives, data sources, and spatial scales, fragmenting complementary expertise across separate backbones. Here we present ALICE, a unified foundation model trained through multi-stage agglomerative distillation that sequentially distills eight vision-only, vision-language, and slide-level teacher models into dedicated modules of a single backbone. ALICE is pretrained on 24,985,184 tile-level pathology images and 155,604 high-resolution images, and evaluated across 21 task scenarios, 96 downstream tasks, and 48 data sources, spanning region-of-interest tissue analysis, vision-language multimodal evaluation, and whole-slide clinical assessment. In all three evaluation settings, ALICE achieved the best average rank among task-matched pathology foundation models. These results demonstrate that agglomerative distillation can consolidate complementary capabilities from specialized models into a unified backbone for broad computational pathology applications. The model is available at https://github.com/WonderLandxD/ALICE.

[51] TCLA: Training-Free Class-wise Logit Adaptation for Medical Vision-Language Models cs.CV | cs.AIPDF

Tianyou Jiang, Ziyu Zhou

TL;DR: 本文提出了一种无需训练、模型无关的少样本适应方法TCLA，用于提升医学视觉语言模型（VLMs）在分布外（OOD）数据上的性能。该方法利用少量支持样本校正推理logits，以改善类间区分度并减少域偏移。在涵盖X光、超声、MRI、CT和组织病理学等多个模态的九个数据集上的实验表明，TCLA能持续提升医学VLMs的OOD性能，并且在多数情况下优于现有的基于训练的自适应方法。

Details

Motivation: 医学视觉语言模型在零样本任务上表现良好，但由于大规模预训练带来的域偏移和类别偏差，其在分布外数据上的性能会下降。现有的少样本适应方法通常需要引入可训练组件，在极低数据场景（如1-shot）下不稳定，且在不同医学数据上缺乏鲁棒性。

Result: 在涵盖X光、超声、MRI、CT和组织病理学等多个模态的九个数据集上进行广泛实验，结果表明TCLA能持续提升医学VLMs的OOD性能，并且在多数情况下优于现有的基于训练的自适应方法。

Insight: 论文宣称的创新点在于提出了一种完全无需训练的、快速且模型无关的少样本适应方法TCLA，通过校正logits来提升性能。从客观角度看，其核心创新在于利用少量支持样本进行纯推理时的logit自适应调整，避免了在极低数据场景下训练的不稳定性，并实现了跨模态和跨数据集的鲁棒性提升。

Abstract: Medical Vision-Language Models (VLMs) exhibit strong zero-shot performance, yet their effectiveness still declines on out-of-distribution (OOD) data due to domain shifts and class bias inherited from large-scale pretraining. Existing few-shot adaptation methods typically introduce additional trainable components, which can be unstable in extremely low-data regimes (e.g., 1-shot), and lack robustness on different medical data. We present TCLA, a purely training-free few-shot adaptation method for Medical VLMs, which is fast and model-agnostic. TCLA corrects inference logits based on a small set of support samples, boosting pretrained VLMs performance by improving inter-class deconfusion and reducing domain shift. Extensive experiments on nine datasets across multiple medical imaging modalities including X-ray, Ultrasound, MRI, CT, Histopathology, demonstrate that TCLA consistently improves OOD performance of Medical VLMs and, in most of cases, outperforms existing training-based adaptation methods.

[52] Promptable Concept Segmentation from Above: Evaluating SAM 3’s Zero-Shot and One-Shot Capabilities in Remote Sensing cs.CVPDF

Mohammad Dabaja, Turgay Celik

TL;DR: 本文对Segment Anything Model 3 (SAM 3)在遥感图像上的零样本和单样本能力进行了全面的多任务实证评估，包括场景分类、目标检测和实例分割。研究发现，SAM 3能避免传统领域适应模型的过拟合问题，在分割任务中取得高调和平均分，但其性能受到亚像素分辨率限制和俯视语义盲点的制约。

Details

Motivation: 大型基础模型（如SAM 3）在复杂、自上而下的地球观测图像中的分布外泛化能力尚未得到充分量化，且其在高度专业化领域存在性能差异，因此需要严格评估其在遥感领域的零样本和单样本能力。

Result: 在严格的零样本和单样本约束下，SAM 3在分割任务中实现了高调和平均分（Harmonic Mean），避免了传统领域适应模型的过拟合，但其性能受限于亚像素分辨率和俯视语义盲点。

Insight: 创新点包括：将SAM 3的解耦二元存在头重新用作独立的零样本分类器；通过系统隔离文本和视觉提示模态来诊断多模态解码器内的对齐机制；提出了一种无需训练的新型代理评估协议用于广义零样本任务。研究发现视觉提示能成功对齐复杂遥感几何，但文本提示会引入未对齐的地面级语义偏差，从而损害坐标回归，这揭示了严重的跨模态干扰问题。

Abstract: The deployment of large-scale foundation models, such as the Segment Anything Model 3 (SAM 3), promises a transition toward open-vocabulary, training-free computer vision. However, their capacity to generalize out-of-distribution to the complex, top-down geometric structures of Earth Observation imagery remains largely unquantified. Driven by SAM 3’s performance disparities in highly specialized domains, we present a comprehensive, multi-task empirical evaluation across remote sensing scene classification, object detection, and instance segmentation under strict zero-shot and one-shot constraints. To achieve this, we introduce a structural adaptation of SAM 3 by repurposing its decoupled binary presence head into a standalone zero-shot classifier. Furthermore, by systematically isolating textual and visual prompt modalities across five configurations, we explicitly diagnose the alignment mechanics within the model’s multimodal decoder. Our findings reveal severe cross-modal interference: while visual prompts successfully align the decoder to complex remote sensing geometry, textual prompts inject misaligned, ground-level semantic bias, actively degrading coordinate regression. To benchmark these capabilities without resource-intensive training, we formulate a novel training-free proxy evaluation protocol for Generalized Zero-Shot tasks (scene classification and instance segmentation). Ultimately, our results demonstrate that SAM 3 avoids the overfitting commonly seen in legacy domain-adapted models, achieving high Harmonic Mean scores in segmentation tasks. However, it remains fundamentally constrained by sub-pixel resolution limits and overhead semantic blind spots, charting a definitive mandate for parameter-efficient geospatial fine-tuning of its multimodal decoder.

[53] Wan-Dancer: A Hierarchical Framework for Minute-scale Coherent Music-to-Dance Generation cs.CV | cs.SDPDF

Mingyang Huang, Peng Zhang, Li Hu, Guangyuan Wang, Bang Zhang

TL;DR: 本文提出了一种名为Wan-Dancer的分层框架，用于解决从音乐生成分钟级长时、高清且节奏同步的舞蹈视频的挑战。该方法将生成过程解耦为全局关键帧规划和局部时序细化，利用全曲音乐上下文确保长程连贯性，并通过动态帧率适配、光流损失和运动速度控制等创新技术，成功生成了超过一分钟的稳定720p/30fps视频。

Details

Motivation: 当前基于扩散模型的音乐到舞蹈生成方法受限于时序约束（通常不超过20秒），在生成长视频时存在时序漂移、身份不一致和动作模式重复等问题，因此需要一种能够生成分钟级连贯舞蹈视频的新框架。

Result: 实验表明，该框架突破了传统时长限制，生成了超过一分钟、720p/30fps的稳定视频，在时序稳定性上表现优异，并在五种不同舞蹈类型上展现出鲁棒的泛化能力，在连贯的长视频舞蹈合成任务上达到了新的SOTA水平。

Insight: 论文的创新点包括：采用分层框架（全局规划与局部细化）解耦长视频生成难题；引入基于时间映射RoPE嵌入的动态帧率适配以实现精确对齐；使用基于光流的损失函数增强运动连续性；以及通过运动速度控制在快速运动中保持高保真细节。这些技术为长序列视频生成提供了可借鉴的架构和训练策略。

Abstract: Generating long-duration, high-definition, and rhythmically synchronized dance videos directly from music remains a significant challenge, primarily due to the temporal constraints of current diffusion models, which typically fail beyond 20 seconds. Existing approaches, whether they rely on intermediate 3D skeletons or on end-to-end video synthesis, suffer from temporal drift, identity inconsistency, and repetitive motion patterns when extended to longer horizons. To address these limitations, we propose a novel hierarchical framework for minute-scale coherent music-to-dance generation. Our method decouples the process into global keyframe planning and local temporal refinement, leveraging full-track musical context to ensure long-range coherence. Key innovations include dynamic frame rate adaptation via time-mapped RoPE embeddings for precise alignment, an optical-flow-based loss function to enhance motion continuity, and motion-speed control to preserve high-fidelity details during rapid movements. Extensive experiments demonstrate that our framework surpasses the conventional duration barrier, generating stable, 720p/30fps videos exceeding one minute with superior temporal stability. Furthermore, the model exhibits robust versatility across five distinct dance genres, conditioned on both audio and textual prompts, establishing a new state-of-the-art in coherent, long-form dance video synthesis.

[54] 4DR360: State Reasoning for Joint 3D Detection and Occupancy Prediction in 4D Radar-Camera Full-Scene Perception cs.CV | cs.AIPDF

Xiaokai Bai, Lianqing Zheng, Runwei Guan, Songkai Wang, Siyuan Cao

TL;DR: 本文提出4DR360，一个用于360度全场景感知的4D雷达-相机融合框架，旨在联合进行3D检测和占据预测。该方法将语义占据建模为持续的场景状态，通过跨模态状态推理范式，利用状态引导的BEV增强和多普勒引导的时序融合，实现从粗到细的特征聚合。

Details

Motivation: 现有雷达-相机方法主要优化检测任务，而双任务系统（如检测与占据预测）的交互有限。为解决这一差距并推进基于雷达的多任务学习，需要一种能够耦合前景物体与密集语义布局的全场景感知方法。

Result: 实验在一个统一的雷达-相机多任务评估框架下进行，涵盖了精度、鲁棒性、消融和效率分析。所提出的方法在扩展的ManTruckScenes数据集（带有基于卫星地图生成的占据标签）和OmniHD-Scenes数据集上进行了评估。

Insight: 创新点在于将语义占据建模为持续的场景状态而非终端输出，并采用跨模态状态推理范式，通过状态引导的BEV增强（SBE）和多普勒引导的时序融合（DTF）实现特征增强与证据保持。这为雷达-相机融合的多任务学习提供了新的思路。

Abstract: Reliable autonomous driving requires full-scene perception that couples foreground objects with dense semantic layout. Recently, 4D millimeter-wave radar has emerged as a robust and affordable sensor, yet its sparse returns make radar-camera fusion necessary for comprehensive scene understanding. Existing radar-camera methods mainly optimize detection, while dual-task systems usually decode boxes and occupancy with limited interaction. To address this gap and advance radar-based multi-task learning, we propose \method, a 4D radar-camera framework for 360$^\circ$ full-scene perception, which models semantic occupancy as a persistent scene state rather than a terminal output. \method{} follows a cross-modal state reasoning paradigm, where the occupancy state is modeled and propagated through stages for coarse-to-fine feature aggregation. Specifically, State-guided BEV Enhancement (SBE) strengthens intra-frame BEV representation, while Doppler-guided Temporal Fusion (DTF) preserves state evidence over longer temporal horizons. Beyond the model, we further extend ManTruckScenes with satellite-map-based generated occupancy labels and pair it with OmniHD-Scenes in a unified cross-dataset detection-and-occupancy protocol. The resulting experiments cover accuracy, robustness, ablation, and efficiency under one radar-camera multi-task evaluation framework. Code and labels will be released upon acceptance.

[55] Evolution of Accuracy and Visual-Cognitive Errors in a Decade of Vision-Language AI Models cs.CV | cs.AIPDF

Shravan Murlidaran, Miguel P. Eckstein

TL;DR: 该论文通过引入包含复杂社交行为的CSB数据集，评估了过去十年间视觉语言模型在场景描述准确性及视觉认知错误类型上的演变。研究发现，多模态大语言模型在CSB数据集上取得了显著进步，其准确性已接近人类最佳描述水平，并基本消除了在简单场景与复杂行为场景间的描述差距，仅空间依赖错误仍有残留。

Details

Motivation: 现有评估多使用简单场景数据集（如MS-COCO），缺乏对复杂人类互动行为的覆盖，且未系统分析模型的错误类型，因此需要更全面的评估框架来理解视觉语言模型的演进。

Result: 在CSB数据集上，多模态大语言模型的场景描述准确性大幅提升，达到与人类最佳描述相当的水平，而在MS-COCO上提升较小；检测、识别和幻觉错误对准确性影响最大，除空间依赖错误外，其他错误类型在多模态大语言模型中已基本消除。

Insight: 创新点在于构建了专注于复杂社交行为的CSB数据集，并系统分析了五种视觉认知错误类型；客观来看，该研究为视觉语言模型的演进提供了更细致的评估维度，揭示了模型在复杂场景理解上的进步与残余挑战。

Abstract: Vision language models (VLMs) have made remarkable progress in visual reasoning during the last decade. Most evaluations have used simple scenes (MS-COCO) that do not showcase complex human interactions or behaviors, only a handful of non-curated human descriptions as a benchmark, and have not focused on understanding the model’s error types. Here, we introduce the Complex Social Behavior (CSB) dataset, containing 100 images depicting complex social interactions/behaviors. We analyze the progression of scene descriptions over a decade (2017-2025) of VLMs (four pre-Multimodal Large Language Models, MLLMs, and five MLLMs). We evaluate the accuracy of the models and 20 human descriptions relative to a gold standard on the CSB dataset and on a sample from MS-COCO. We analyzed five visual-cognitive error types: object detection, recognition, hallucination, scene understanding, and spatial dependence. The CSB dataset showed a more pronounced improvement than MS-COCO in scene description accuracy, with pre-MLLMs achieving much lower accuracy than the bottom-ranked human descriptions and MLLMs attaining accuracies similar to the top-ranked human descriptions. We show that MLLMs have eliminated the gap in scene description accuracy between simpler MS-COCO scenes and scenes depicting complex behaviors (CSB). MLLMs have almost eliminated all error types in our tested datasets, except for occasionally relying on different image regions for scene descriptions than humans do (spatial dependence error). We also show that detection, recognition, and hallucination errors have the highest impact on scene description accuracy. Together, our findings provide a more thorough evaluation of how visual language models have advanced over the last decade.

[56] PanoWorld: Real-World Panoramic Generation cs.CVPDF

Haoyuan Li, Dizhe Zhang, Yuemei Zhou, Xiangkai Zhang, Haoran Feng

TL;DR: 本文提出了PanoWorld，一种用于全景世界建模的方法，旨在解决全景环境中长程记忆的挑战。该方法利用全景表示的旋转等变性，通过固定航向将相机轨迹简化为平移，并结合密集全景射线条件化（DPRC）和几何感知记忆增强（GMA）组件。作者还构建了World360数据集，包含真实世界全景无人机视频和AirSim360模拟片段，用于评估大规模空间变化和多样光照条件下的物理一致性。实验表明PanoWorld在World360上显著优于其他方法。

Details

Motivation: 解决全景世界模型中长程记忆的挑战，并应对现有数据集在评估大规模空间变化和多样光照条件下物理一致性方面的不足。

Result: 在构建的大规模数据集World360上进行了广泛实验，PanoWorld大幅优于其他替代方法。

Insight: 创新点在于利用全景表示的旋转等变性来简化相机轨迹建模，并提出了DPRC和GMA组件来处理当前动作和长程记忆。同时，构建了包含真实和模拟数据的World360数据集，以更好地评估物理一致性。

Abstract: In this work, we aim to address the challenge of long-range memory in panoramic world models by exploiting the rotation-equivariant property of omnidirectional representations, where rotation can be treated as an implicit geometric transformation.Building on this insight, we propose PanoWorld, which simplifies camera trajectories into translations via fixed headings for both current-action modeling and long-range memory through Dense Panoramic Ray-Conditioning (DPRC) and Geometry-aware Memory Augmentation (GMA).Then, a three-stage training pipeline is introduced to progressively optimize each component. To better evaluate physical consistency under large-scale spatial variations and diverse illumination conditions, where existing datasets are relatively stable, we construct World360, a large-scale dataset consisting of both real-world video clips collected via panoramic unmanned aerial vehicles and high-quality simulated clips generated by AirSim360.Extensive experiments on World360 demonstrate the effectiveness of PanoWorld, outperforming alternative methods by a large margin.Our models, training code, and dataset will be publicly available. More information can be found on our project page: https://lihaoy-ux.github.io/panoworld-page/.

[57] OpenLongTail: Generative Scaling of Long-Tail Driving Data cs.CVPDF

Lulin Liu, Nuo Chen, Yan Wang, Bangya Liu, Wenyan Cong

TL;DR: 本文提出了OpenLongTail，一个用于在长尾事件下扩展自动驾驶策略的开源生成数据引擎。为了解决异构数据源（如单目行车记录仪视频）缺乏完整多视角覆盖的问题，该方法通过一个基于姿态信息的外推式视图合成流程，生成缺失的视角，从而将异构长尾数据转换为可用于策略学习的视图对齐、时序连贯的多视角资产。

Details

Motivation: 当前自动驾驶策略的规模化受限于精心策划数据集中边缘案例的稀缺性。虽然现实世界不断产生这些关键的长尾事件，但从异构来源（如缺乏完整视角覆盖的单目视频）收集的数据却未被充分利用，存在模态鸿沟，无法转化为可扩展的训练数据。

Result: 通过合成异构长尾数据，在闭环驾驶鲁棒性处理长尾事件方面观察到了显著提升。通过评估外推式视图合成和姿态指标，验证了OpenLongTail在视觉保真度、跨视图一致性和自车轨迹恢复方面的有效性。

Insight: 核心创新点在于提出了一个将姿态信息注入可扩展生成引擎的视图合成流程，以解决异构长尾数据视角缺失的问题，从而弥合模态鸿沟，为策略学习生成高质量的多视角训练数据。这为利用广泛存在的非结构化长尾视频数据提供了一种生成式解决方案。

Abstract: Scaling robust driving policies is fundamentally bottlenecked by the scarcity of edge cases in curated datasets. While the real world continuously captures these critical events, such long-tail events remain underutilized when collected from heterogeneous sources. Specifically, diverse but valuable in-the-wild long-tail videos lack the full view coverage required for training policy models, often missing multi-view poses or originating solely from monocular dash cameras. This modality gap prevents these ubiquitous observations from being converted into scalable training data for long-tail generalization. We introduce OpenLongTail, an open-source generative data engine for scaling autonomous driving policies under long-tail events. To transform heterogeneous data sources into view-aligned and temporally coherent multi-view assets that are useful for policy learning, we develop a pose-informed extrapolative view synthesis pipeline that generates the missing views. We further enhance cross-view consistency and the temporal alignment for the newly generated views by injecting Plücker ray geometry into the scalable generation engine. By synthesizing heterogeneous long-tail data, we observe a significant improvement in closed-loop driving robustness in handling long-tail events. By measuring the extrapolative view synthesis and pose metrics, we validate the effectiveness of OpenLongTail in visual fidelity, cross-view consistency, and ego-trajectory recovery.

cs.SE [Back]

[58] Git-Assistant: Planning-Based Support for Updating Git Repositories cs.SE | cs.AI | cs.CLPDF

Alfredo Garrachón Ruiz, Tomás de la Rosa, Daniel Borrajo

TL;DR: 本文提出了Git-Assistant，一个结合大型语言模型（LLMs）与自动化规划技术的AI助手，旨在帮助开发者执行复杂的Git仓库操作。它通过分析仓库上下文、将自然语言请求转化为可执行的命令序列，并利用规划技术确保操作的正确性与安全性。

Details

Motivation: Git等版本控制系统对许多开发者而言仍具挑战性，现有LLMs在仓库管理任务中因缺乏形式化推理能力而效果有限。本文旨在解决如何可靠地将开发者意图转化为安全、正确的Git操作序列的问题。

Result: 在合成与随机化的Git环境中进行的系统评估表明，与纯LLM方法相比，结合了形式化推理（规划）的混合方法在多个指标上提高了可靠性并减少了错误。

Insight: 核心创新点在于将LLMs的意图理解能力与自动化规划的形式化推理相结合，构建了一个混合AI系统。这为智能开发助手领域提供了一种可借鉴的范式，即通过结合符号AI技术来增强数据驱动模型的可靠性与安全性。

Abstract: Version control systems are essential for collaborative software development, yet tools like git remain challenging for many practitioners. Recent advances in Large Language Models (LLMs) offer promising capabilities for interpreting developer intent, but their effectiveness in repository management tasks is limited by the need for formal reasoning. This work introduces Git-Assistant, an AI-based assistant that combines LLMs with automated planning to support developers in executing non-trivial git operations. The assistant analyzes repository context, translates natural language requests into actionable command sequences, and incorporates planning techniques to ensure correctness and safety. We present a systematic evaluation methodology using synthetic and randomized git environments, comparing the performance of LLM-only and planning-augmented variants across multiple metrics. Experimental results demonstrate that integrating formal reasoning with LLMs improves reliability and reduces errors in repository management, highlighting the potential of hybrid AI approaches for intelligent developer assistance.

eess.IV [Back]

[59] Joint-Embedding Predictive Architecture for Solar PV Panel Fault Classification eess.IV | cs.CVPDF

Seyyedhamid Azimidokht, Mehdi Monemi, Abdelhak Kharbouch, Farid Hamzehaghdam, Mehdi Rasti

TL;DR: 该论文提出了一种名为JEFFNet的多分支架构，用于太阳能光伏（PV）面板的热红外（IR）图像故障分类。该方法结合了基于联合嵌入预测架构（JEPA）的自监督表示学习和基于EfficientNetV2-S的监督卷积特征提取，融合了Vision Transformer的语义表示和卷积网络的局部特征。在两个公开的热红外数据集（PVF-10和ISM）上进行了评估，在多项分类和二元分类任务中均取得了高准确率和F1分数，同时显著减少了模型参数量。

Details

Motivation: 随着太阳能光伏系统的快速扩张，需要可靠且可扩展的故障分类方法，因为大规模手动检查不切实际。热红外成像提供了非接触式解决方案，但由于类别不平衡、纹理信息有限和热差异细微，准确分类仍然具有挑战性。

Result: 在PVF-10数据集的10类任务中，JEFFNet取得了93.21的F1分数和94.33%的准确率；在衍生的2类任务中，取得了97.53的F1分数和96.41%的准确率。在ISM数据集的12类任务中，取得了72.60的F1分数和83.88%的准确率；在衍生的2类任务中，取得了94.69的F1分数和94.78%的准确率。与GEPFNet相比，参数量减少了47.2%（108.6M vs 205.91M）。

Insight: 论文的主要创新点在于提出了一种结合自监督语义特征（来自JEPA预训练的Vision Transformer）和监督卷积特征（来自EfficientNetV2-S）的多分支融合架构JEFFNet，实现了互补的特征学习。从客观角度看，这种融合策略为热红外图像分类提供了一种有效且参数高效的解决方案，特别是在数据有限或类别不平衡的场景下，自监督预训练可能有助于提升模型性能。

Abstract: The rapid expansion of solar photovoltaic (PV) systems has increased the need for reliable and scalable fault classification, as manual inspection is impractical at scale. Thermal infrared (IR) imaging provides a non-contact solution for identifying PV faults; however, accurate classification remains challenging due to class imbalance, limited texture information, and subtle thermal differences. In this work, we investigate the applicability of Joint-Embedding Predictive Architecture (JEPA) for thermal IR PV fault classification across various scenarios and propose JEFFNet (JEPA-EFFicientNet), a multibranch architecture that combines JEPA-based self-supervised representation learning with EfficientNetV2-S-based supervised convolutional feature extraction. JEFFNet fuses semantic representations from a JEPA-pretrained Vision Transformer with convolutional features from EfficientNetV2-S, enabling complementary feature learning. JEFFNet is evaluated on two public thermal IR datasets, PVF-10 and InfraredSolarModules (ISM), for both multiclass and derived binary (healthy/faulty) classification. On PVF-10, JEFFNet achieves an F1-score of $93.21$ and an accuracy of $94.33$ in the 10-class task, and an F1-score of $97.53$ and an accuracy of $96.41$ in the derived 2-class task. On ISM, JEFFNet achieves an F1-score of $72.60$ and an accuracy of $83.88$ in the 12-class task, and an F1-score of $94.69$ and an accuracy of $94.78$ in the derived 2-class task. JEFFNet also uses only 108.6M parameters versus 205.91M for GEPFNet, a 47.2% reduction. These results demonstrate that combining self-supervised semantic and supervised convolutional features provides an effective, parameter-efficient solution for thermal IR PV fault classification. The source code is publicly available at https://github.com/Azimi2kht/JEFFNet

cs.LG [Back]

[60] Mach-Mind-4-Flash Technical Report cs.LG | cs.CLPDF

Foundation Model Team

TL;DR: 本文介绍了Mach-Mind-4-Flash，一个拥有350亿参数但仅激活30亿参数的混合专家（MoE）智能体模型。通过仅进行后训练优化而不扩展预训练计算，该模型在多个基准测试上达到了与千亿参数模型相当或更优的性能，同时显著降低了推理成本。

Details

Motivation: 旨在通过高效的模型架构和训练方法，在不增加预训练计算开销的情况下，构建一个参数高效、性能强大的智能体模型，以解决大规模模型部署成本高的问题。

Result: 在AIME’26（92.70）、IFBench（82.82）、Behavioral-SafetyBench（80.74）、BFCL-v4（75.80）、BrowseComp-zh（72.31）和ClawBench（84.20）等多个基准测试上取得领先或匹配的结果，其性能与激活参数量为其10-30倍的模型相当。

Insight: 创新点包括：1）采用多教师策略蒸馏（MOPD）融合多个领域专家，避免了混合奖励强化学习中的性能震荡；2）提出混合中长策略优化（HMPO），在几乎不损失精度的情况下大幅压缩推理链；3）构建了可扩展的智能体交互环境用于大规模强化学习。

Abstract: We present Mach-Mind-4-Flash, a 35B-parameter Mixture-of-Experts (MoE) agentic model with 3B activated parameters. Through post-training optimization alone without scaling pre-training compute, the model achieves performance on par with or surpassing that of 100B-parameter-class models. By introducing scalable agentic interaction environments for large-scale reinforcement learning, the model attains significant performance gains on real-world application tasks. Our pipeline comprises three stages: (1) a unified RL/OPD training infrastructure with dynamic multi-teacher scheduling and operator-level acceleration, delivering 17% end-to-end training speedup; (2) multiple domain-specific RL experts trained in parallel across Reasoning, General, and Agent tracks, then fused into a single generalist via Multi-Teacher On-Policy Distillation (MOPD) – a routed reverse-KL objective that eliminates the see-saw degradation of mixed-reward RL; (3) Hybrid Median-length Policy Optimization (HMPO), a single-stage token-efficiency method that compresses reasoning chains by 19–46% with $\le$0.7 percentage-point accuracy loss. Mach-Mind-4-Flash scores 92.70 on AIME’26, 82.82 on IFBench, 80.74 on Behavioral-SafetyBench, 75.80 on BFCL-v4, 72.31 on BrowseComp-zh, and 84.20 on ClawBench – leading or matching models with 10–30$\times$ its activated size at a fraction of the inference cost.

cs.GR [Back]

Kartik Bali, Mahish K. Guru, Christian J Cyron, Roland Aydin

TL;DR: 本文提出GReFEM框架，探索利用现成的多模态大语言模型（MLLMs）作为零样本语义助手，基于物理引导的文本提示来视觉定位应力关键区域，从而指导三维有限元网格的自适应细化。该框架通过引入orthoViews视图选择模块来弥合MLLMs的2D预训练与3D几何体之间的差距，并在多种CAD几何和载荷条件下进行了评估。

Details

Motivation: 自适应体积有限元网格划分是计算机辅助工程中的关键步骤，传统方法需要迭代PDE求解器或大量监督数据训练的代理模型。本研究旨在探索现成MLLMs的高级语义理解能力，能否作为一种可行的、零样本的几何代理，用于有限元网格细化，以降低对大规模仿真数据和迭代求解的依赖。

Result: 在严格的匹配细化预算下，与调优的几何启发式方法相比，MLLMs展现出强大的零样本能力，能够准确遵循复杂的空间-物理指令，以更高的精度隔离与应力相关的特征。评估覆盖了多样化的CAD几何、载荷情况和SOTA MLLMs。

Insight: 创新点在于首次系统性地探索了现成MLLMs作为零样本语义助手在物理引导的3D网格细化任务中的潜力。orthoViews模块的创新设计有效连接了2D视觉模型与3D几何理解。研究结果为将基础模型作为语义助手集成到自动化仿真工作流中定义了前沿方向。

Abstract: Adaptive volumetric finite element meshing is a critical step in computer-aided engineering and analysis that dictates the computational budget of a given problem. It traditionally requires iterative PDE solvers or heavily supervised, data-driven surrogates trained on large-scale simulation data. While Multimodal Large Language Models (MLLMs) excel in 2D visual tasks, their zero-shot capability to semantically ground regions based on geometric understanding and physics remains an open question. Overall, this study explores a significant question: can the high-level semantic understanding of off-the-shelf MLLMs serve as a viable, zero-shot geometric proxy for finite element mesh refinement? To investigate this, we introduce GReFEM (Geometric Reasoning Enhanced Multimodal LLMs for Finite Element Meshing), a framework that utilizes MLLMs to visually localize stress-critical regions based on physics-guided textual prompts. To bridge the gap between 2D MLLM pre-training and 3D geometries, we introduce orthoViews, a view-selection module that maximizes the observability of key geometric features. We conduct an in-depth empirical evaluation across diverse CAD geometries, loading cases, and SOTA MLLMs, comparing them against a tuned geometric heuristic under a strict, matched refinement budget. Our findings reveal that MLLMs demonstrate robust zero-shot capacity to accurately follow complex spatial-physical instructions, isolating stress-relevant features with higher precision than blind heuristics. By mapping both the successes and current limitations of MLLMs in physical grounding, this study defines the frontier of foundation models as semantic assistants in automated simulation workflows.

cs.AI [Back]

[62] MedRealMM: A Real-World Multimodal Benchmark for Chinese Online Medical Consultation cs.AI | cs.CL | cs.CVPDF

Runhan Shi, Quan Zhou, Yuqian Xu, Shuai Yang, Xin Wu

TL;DR: 该论文提出了MedRealMM，一个基于真实中国互联网医院患者-医生交互构建的大规模多模态在线医疗咨询基准数据集。该数据集包含5,620个真实世界多模态病例，覆盖64个临床科室，并采用多模态临床挑战点提取框架来识别咨询轨迹中的关键临床需求时刻，将其转化为标准化的下一轮响应生成任务。

Details

Motivation: 现有医疗大语言模型基准与真实临床实践脱节，常依赖合成对话、忽略患者上传的医学图像，或使用选择题等不反映临床质量的评估指标。

Result: 评估了19个通用及医疗专用LLM，结果表明图像信息对可靠的临床表现至关重要，当前前沿模型的表现仍低于在线医生响应。虽然部分前沿模型满足的正面临床标准数量与医生相当甚至更多，但也触发了更多负面标准，表明安全敏感的错误规避仍是核心瓶颈。

Insight: 创新点在于从真实世界交互中构建多模态基准，并引入多模态临床挑战点提取框架和由医生细化的病例特异性评估准则，以更真实地评估多模态医疗推理。

Abstract: Large language models (LLMs) are increasingly deployed in online medical consultation, yet existing benchmarks remain poorly aligned with real clinical practice. Many rely on synthetic conversations or patient simulators, omit patient-uploaded medical images, or evaluate open-ended clinical responses using multiple-choice or lexical-overlap metrics that poorly reflect clinical quality. We introduce \textbf{MedRealMM}, a large-scale benchmark for multimodal online medical consultation built from de-identified patient-doctor interactions collected from a nationwide Chinese internet hospital. MedRealMM uses a Multimodal Clinical Challenge Point (MCCP) extraction framework to identify clinically demanding moments in authentic consultation trajectories and converts each into a standardized next-response generation task while preserving the preceding text-image context. Each instance is paired with a case-specific rubric refined by physicians that rewards clinically desirable behaviors and penalizes unsafe, unsupported, or contradictory responses. The current release contains 5,620 real-world multimodal cases spanning 64 clinical departments. We evaluate 19 general-purpose and medical-specialized LLMs, including text-only and multimodal systems. Our results show that image information is critical for reliable clinical performance and that current frontier models remain below the online physician response. Although some frontier models satisfy as many or more positive clinical criteria than physicians, they trigger more negative criteria, indicating that safety-sensitive error avoidance remains a central bottleneck. MedRealMM offers a realistic and reproducible benchmark for evaluating multimodal medical reasoning in real-world online consultation. The dataset will be publicly available on Hugging Face at https://huggingface.co/datasets/jdh-algo/MedRealMM.

[63] Agora: Enhancing LLM Agent Reasoning Via Auction-Based Task Allocation cs.AI | cs.CLPDF

Kaiji Zhou, Ales Leonardis, Yue Feng

TL;DR: 本文提出了Agora框架，通过引入激励相容的拍卖机制来动态分配任务给专家模型和工具，以增强大语言模型（LLM）智能体的推理能力。该框架将推理步骤视为可交易物品，让智能体基于其校正后的能力进行出价，从而将关键逻辑路由给最有能力的求解器，而非最自信的求解器。

Details

Motivation: 现有框架通常基于任务与专家模型或工具功能的粗粒度匹配来调用API，忽略了功能相似替代方案之间的性能差异和成本效率等关键因素，因此需要更有效的编排机制。

Result: 在五个基准测试上的评估表明，在可比较的候选池下，Agora优于匹配的单模型、路由和级联基线，并通过单个拍卖参数实现了可控的成本-质量权衡。

Insight: 创新点在于将拍卖机制引入任务分配，通过激励相容的设计和基于校正能力的出价，优化了推理路径的选择；客观来看，这提供了一种动态、经济高效且可控制权衡的智能体协作新范式。

Abstract: Enhancing the reasoning capabilities of large language model (LLM) agents requires effective orchestration of diverse expert models and tools. However, existing frameworks typically call APIs based on coarse-grained matching between tasks and the functions of expert models or tools, while overlooking critical factors such as performance variability and cost efficiency among functionally similar alternatives. To address this, we propose Agora, a framework that introduces an incentive-compatible auction mechanism for dynamically allocating tasks to expert models and tools. By treating reasoning steps as tradeable items, Agora enables agents to bid based on their rectified competence-ensuring that critical logic is routed to the most capable solver rather than the most overconfident one. Evaluations across five benchmarks show that Agora improves over matched single-model, routing, and cascade baselines under comparable candidate pools, while exposing a controllable cost-quality trade-off through a single auction parameter.

Table of Contents

cs.CL [Back]

[1] Letter Lemmatization: One-to-one and Banded RNNs for Reversing Character-Set Simplification and Abbreviation in Medieval Text cs.CL | cs.CVPDF

[2] AgentKGV: Agentic LLM-RAG Framework with Two-Stage Training for the Fact Verification of Knowledge Graphs cs.CLPDF

[3] HALO: Hybrid Adaptive Latent Reasoning for Language Models cs.CL | cs.LGPDF

[4] WILDTRACE: Benchmarking Natural Evidence Trails in Long-Context Reasoning cs.CL | cs.AIPDF

[5] DKCD: Domain Knowledge-Enhanced Causal Discovery from Unstructured Data cs.CLPDF

[6] Self-Guided Test-Time Training for Long-Context LLMs cs.CL | cs.AIPDF

[7] Test-Time Scaling for Small VLMs on Multilingual Visual MCQ cs.CL | cs.AI | cs.LGPDF

[8] Task-Specific Multimodal Question Answering Agents via Confidence Calibration and Incremental Reasoning for QANTA 2026 cs.CL | cs.AIPDF

cs.CV [Back]

[9] Mixture of Probes: Learning from Privileged Modalities in Multimodal LLMs Through Probing cs.CV | cs.LGPDF

[10] Decoupled Illumination Priors for Spatially Controllable Multi-View Indoor Scene Relighting cs.CVPDF

[11] Vision Transformers Learn Gestalt-Like Figure-Ground Cues from Natural Images cs.CVPDF

[12] MultiView-Bench: A Diagnostic Benchmark for World-Centric Multi-View Integration in VLMs cs.CV | cs.AIPDF

[13] C-GAP: Class-Aware and Online Prompting Improves Vision-Language Models on Imbalanced Classes cs.CVPDF

[14] Video Generation Models are General-Purpose Vision Learners cs.CV | cs.AIPDF

[15] On Locality and Length Generalization in Visual Reasoning cs.CV | cs.AI | cs.LGPDF

[16] MOSAIC: Adaptive Inter-layer Composition for Efficient Heterogeneous Vision-Language Models cs.CVPDF

[17] Probing Diffusion Denoising Dynamics for Contrastive Representation Learning cs.CVPDF

[18] OmniMapBench: Benchmarking Visual-Centric Reasoning on Diverse Map Documents cs.CV | cs.AIPDF

[19] Toward Active Object Detection for UAVs in the Wild: A Large-Scale Dataset, Benchmark and Method cs.CV | cs.ROPDF

[20] GeoTrace: Geometry-Aware Trajectory Token Compression for Video Large Language Models cs.CVPDF

[21] Adaptive Latent Trajectory Anchoring for Action Segmentation Dataset Condensation cs.CVPDF

[22] REBASE: Reference-Background Subspace Elimination for Training-Free In-Context Segmentation cs.CVPDF

[23] DETRAM: End-to-end DEtection, Tracking and Recovery of HumAn Meshes cs.CVPDF

[24] Subtoken Vision Transformer for Fine-grained Recognition cs.CVPDF

[25] Equivariant Filter for High Performance Image Tracking using an Event Camera cs.CVPDF

[26] Integrating Large Language Models and Graph Convolutional Networks for Semi-Supervised Image Classification cs.CV | cs.AIPDF

[27] Event Stream based Multi-Modal Video Anomaly Detection: A Benchmark Dataset and Algorithms cs.CV | cs.AI | cs.MMPDF

[28] VTaMo: Video-Text Alignment Model for Sign Language Translation cs.CV | cs.CLPDF

[29] Event Burst Trigger: An Availability Backdoor Attack on Event-Based SNN Object Detection cs.CV | cs.CRPDF

[30] 4D Human-Scene Reconstruction from Low-Overlap Captures cs.CVPDF

[31] Super-Generalist: Towards Comprehensive and Accurate Medical Image Understanding via Generalist-Specialist Synergy cs.CVPDF

[32] Weaving Light and Time: Unified Harmonic-Geometric Representation Learning for Dense RGB-Event Parsing cs.CVPDF

[33] TSR-Ego: Temporally Guided Stereo Refinement Framework for Egocentric 3D Human Pose Estimation cs.CVPDF

[34] AnythingReality: Robust Online Gaussian Splatting SLAM for Open-Vocabulary VR Scene Exploration cs.CVPDF

[35] Semantic Hardness Is Not Visual Hardness: Sign-Aware Hard Negative Mining for Sign Language Retrieval cs.CVPDF

[36] Causally Debiased Latent Action Model for Embodied Action Conditioned World Models cs.CV | cs.ROPDF

[37] REMIND: RE-Identification with Memory for INDoor Navigation cs.CVPDF

[38] Dynamic Inverse Rendering for Enhanced Material-Lighting Decomposition cs.CV | cs.GRPDF

[39] Simon-SR: Spatially Adaptive Modulation and Visual Prompt Adaptation for Text-Reinforced Super-Resolution cs.CVPDF

[40] SVF-CR: Synchronized Visual-Facial Cross-Refinement for Multimodal Ambivalence and Hesitancy Recognition cs.CV | cs.AIPDF

[41] Parameter-Efficient Vision-Language Adaptation with Continuous Metadata Conditioning for Animal Re-Identification cs.CV | cs.AIPDF

[42] Multimodal Scenario Similarity Search for Autonomous Driving cs.CV | cs.LGPDF

[43] Robustifying Vision-Language Models via Test-Time Prompt Adaptation cs.CV | cs.LGPDF

[44] Decoupling Language Guidance from Backbones for Text-Guided Medical Segmentation cs.CV | cs.AIPDF

[45] Foveation-Guided Dynamic Token Selection for Robust and Efficient Vision Transformers cs.CV | cs.LG | cs.NEPDF

[46] SigLIP-HD by Fine-to-Coarse Supervision cs.CVPDF

[47] What VGGT Knows About Overlap: Probing Geometric Foundation Models for Co-Visibility cs.CV | cs.AIPDF

[48] The Count Is There, but Misaligned: Understanding and Correcting Counting Failures in VLMs cs.CV | cs.LGPDF

[49] Seeing is Free, Speaking is Not: Uncovering the True Energy Bottleneck in Edge VLM Inference cs.CV | cs.AIPDF

[50] ALICE: Learning a General-Purpose Pathology Foundation Model from Vision, Vision-Language, and Slide-Level Experts cs.CV | cs.AIPDF

[51] TCLA: Training-Free Class-wise Logit Adaptation for Medical Vision-Language Models cs.CV | cs.AIPDF

[52] Promptable Concept Segmentation from Above: Evaluating SAM 3’s Zero-Shot and One-Shot Capabilities in Remote Sensing cs.CVPDF

[53] Wan-Dancer: A Hierarchical Framework for Minute-scale Coherent Music-to-Dance Generation cs.CV | cs.SDPDF

[54] 4DR360: State Reasoning for Joint 3D Detection and Occupancy Prediction in 4D Radar-Camera Full-Scene Perception cs.CV | cs.AIPDF

[55] Evolution of Accuracy and Visual-Cognitive Errors in a Decade of Vision-Language AI Models cs.CV | cs.AIPDF

[56] PanoWorld: Real-World Panoramic Generation cs.CVPDF

[57] OpenLongTail: Generative Scaling of Long-Tail Driving Data cs.CVPDF

cs.SE [Back]

[58] Git-Assistant: Planning-Based Support for Updating Git Repositories cs.SE | cs.AI | cs.CLPDF

eess.IV [Back]

[59] Joint-Embedding Predictive Architecture for Solar PV Panel Fault Classification eess.IV | cs.CVPDF

cs.LG [Back]

[60] Mach-Mind-4-Flash Technical Report cs.LG | cs.CLPDF

cs.GR [Back]

[61] GReFEM: Multimodal LLMs as Zero-Shot Semantic Assistants for Physics-Guided 3D Mesh Refinement cs.GR | cs.CVPDF

cs.AI [Back]

[62] MedRealMM: A Real-World Multimodal Benchmark for Chinese Online Medical Consultation cs.AI | cs.CL | cs.CVPDF

[63] Agora: Enhancing LLM Agent Reasoning Via Auction-Based Task Allocation cs.AI | cs.CLPDF